-- Logs begin at Thu 2022-09-08 09:51:49 UTC, end at Thu 2022-09-08 12:26:08 UTC. -- Sep 08 10:26:09.601707 n-d-850501-12 systemd[1]: Starting Devstack devstack@n-api.service... Sep 08 10:26:09.609621 n-d-850501-12 devstack@n-api.service[106549]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 08 10:26:09.611631 n-d-850501-12 devstack@n-api.service[106549]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 8 10:26:09 2022] *** Sep 08 10:26:09.611631 n-d-850501-12 devstack@n-api.service[106549]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 08 10:26:09.611631 n-d-850501-12 devstack@n-api.service[106549]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 08 10:26:09.611631 n-d-850501-12 devstack@n-api.service[106549]: nodename: n-d-850501-12 Sep 08 10:26:09.611631 n-d-850501-12 devstack@n-api.service[106549]: machine: x86_64 Sep 08 10:26:09.611631 n-d-850501-12 devstack@n-api.service[106549]: clock source: unix Sep 08 10:26:09.611631 n-d-850501-12 devstack@n-api.service[106549]: pcre jit disabled Sep 08 10:26:09.611631 n-d-850501-12 devstack@n-api.service[106549]: detected number of CPU cores: 4 Sep 08 10:26:09.611631 n-d-850501-12 devstack@n-api.service[106549]: current working directory: / Sep 08 10:26:09.612292 n-d-850501-12 devstack@n-api.service[106549]: detected binary path: /usr/bin/uwsgi-core Sep 08 10:26:09.612292 n-d-850501-12 devstack@n-api.service[106549]: your processes number limit is 47680 Sep 08 10:26:09.612292 n-d-850501-12 devstack@n-api.service[106549]: your memory page size is 4096 bytes Sep 08 10:26:09.612292 n-d-850501-12 devstack@n-api.service[106549]: detected max file descriptor number: 2048 Sep 08 10:26:09.612292 n-d-850501-12 devstack@n-api.service[106549]: lock engine: pthread robust mutexes Sep 08 10:26:09.612292 n-d-850501-12 devstack@n-api.service[106549]: thunder lock: enabled Sep 08 10:26:09.612292 n-d-850501-12 devstack@n-api.service[106549]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 08 10:26:09.612292 n-d-850501-12 devstack@n-api.service[106549]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 08 10:26:09.652787 n-d-850501-12 devstack@n-api.service[106549]: Python main interpreter initialized at 0x55ef5b0279c0 Sep 08 10:26:09.652787 n-d-850501-12 devstack@n-api.service[106549]: python threads support enabled Sep 08 10:26:09.652787 n-d-850501-12 devstack@n-api.service[106549]: your server socket listen backlog is limited to 100 connections Sep 08 10:26:09.652787 n-d-850501-12 devstack@n-api.service[106549]: your mercy for graceful operations on workers is 90 seconds Sep 08 10:26:09.653245 n-d-850501-12 devstack@n-api.service[106549]: mapped 403077 bytes (393 KB) for 2 cores Sep 08 10:26:09.653245 n-d-850501-12 devstack@n-api.service[106549]: *** Operational MODE: preforking *** Sep 08 10:26:09.653509 n-d-850501-12 devstack@n-api.service[106549]: *** uWSGI is running in multiple interpreter mode *** Sep 08 10:26:09.653509 n-d-850501-12 devstack@n-api.service[106549]: spawned uWSGI master process (pid: 106549) Sep 08 10:26:09.653722 n-d-850501-12 systemd[1]: Started Devstack devstack@n-api.service. Sep 08 10:26:09.657078 n-d-850501-12 devstack@n-api.service[106549]: spawned uWSGI worker 1 (pid: 106550, cores: 1) Sep 08 10:26:09.657078 n-d-850501-12 devstack@n-api.service[106549]: spawned uWSGI worker 2 (pid: 106551, cores: 1) Sep 08 10:26:09.657078 n-d-850501-12 devstack@n-api.service[106549]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 08 10:26:10.316953 n-d-850501-12 devstack@n-api.service[106550]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 08 10:26:10.317585 n-d-850501-12 devstack@n-api.service[106551]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 08 10:26:11.413617 n-d-850501-12 devstack@n-api.service[106551]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 10:26:11.413617 n-d-850501-12 devstack@n-api.service[106551]: from cryptography.utils import int_from_bytes Sep 08 10:26:11.414317 n-d-850501-12 devstack@n-api.service[106551]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 10:26:11.414317 n-d-850501-12 devstack@n-api.service[106551]: from cryptography.utils import int_from_bytes Sep 08 10:26:11.414462 n-d-850501-12 devstack@n-api.service[106550]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 10:26:11.414462 n-d-850501-12 devstack@n-api.service[106550]: from cryptography.utils import int_from_bytes Sep 08 10:26:11.414872 n-d-850501-12 devstack@n-api.service[106550]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 10:26:11.414872 n-d-850501-12 devstack@n-api.service[106550]: from cryptography.utils import int_from_bytes Sep 08 10:26:13.915795 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 08 10:26:13.916323 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 08 10:26:13.916573 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 08 10:26:13.916937 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 08 10:26:13.917224 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 08 10:26:13.917615 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.917942 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.918263 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.918583 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.918915 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.919226 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.919314 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 08 10:26:13.919697 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.919782 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 08 10:26:13.919872 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.920084 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 08 10:26:13.920185 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.920414 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.920518 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 08 10:26:13.920698 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 08 10:26:13.920831 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.921055 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-850501-12 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.921162 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.921384 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.921494 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.921691 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.921789 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.922003 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.922090 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.922320 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.922421 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.922622 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.922715 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.922942 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.923028 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.923254 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.923343 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.923590 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.923755 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.923867 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.924163 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.924485 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.924585 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-850501-12 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.924800 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.924892 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.925133 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.925240 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.925449 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.925557 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.925770 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.925858 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.926078 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.926165 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.926397 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.926503 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.926702 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.926821 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.927031 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.927216 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.927341 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.927530 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.927741 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-850501-12 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.927839 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.928061 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.928183 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.928374 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.928497 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.928693 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.928809 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.929094 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.929262 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.929426 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.929574 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.929734 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.929906 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.930046 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.930222 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.930941 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.931077 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.931255 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.931438 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-850501-12 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.931582 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.931759 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.931904 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.932079 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.932224 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.932399 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.932547 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.932818 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.932912 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.933157 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.933261 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.933470 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.933570 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.933800 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.933892 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.934092 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.934200 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.934395 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.934482 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.934645 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.934733 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.934951 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.935047 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.935273 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.935371 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.935594 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.935682 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.935916 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.936013 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.936168 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.936267 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.936419 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.936556 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.936737 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.936880 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.937084 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.937214 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.937462 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.937570 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.937706 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.937792 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.938012 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.938099 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.938320 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.938414 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.938625 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.938718 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.938931 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.939018 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.939232 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.939331 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.939493 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.939583 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.939817 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.939903 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.940137 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.940233 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.940446 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.940531 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.940751 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.940842 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.941077 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.941180 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.941391 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.941477 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.941902 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.942046 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.942046 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.942263 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.942374 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.942586 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.942715 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.942823 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.942936 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.943025 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.943210 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.943298 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.943534 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.943628 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.943843 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.943971 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.944145 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.944237 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.944451 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.944594 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.944771 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.944867 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.945129 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.945219 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.945438 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.945542 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.945688 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.945849 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.946262 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.946405 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.946519 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.946615 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.946778 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.946866 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.947092 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.947179 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.947403 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.947498 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.947711 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.947796 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.948015 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.948101 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.948325 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.948413 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.948631 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.948718 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.948884 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.948974 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.949215 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.949307 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.949530 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.949618 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.949853 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.949939 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.950155 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.950247 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.950461 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.950547 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.950762 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.950847 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.951063 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.951204 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.951375 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.951469 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.951685 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.951780 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.951990 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.952085 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.952296 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.952389 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.952599 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.952686 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.952904 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.952990 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.953232 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.953320 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.953542 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.953638 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.953847 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.953933 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.954158 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.954244 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.954462 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.954554 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.954767 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.954853 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.955082 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.955166 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.955388 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.955485 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.955693 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.955790 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.956003 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.956089 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.956300 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.956397 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.956606 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.956693 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.956914 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.956998 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.957251 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.957353 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.957557 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.957643 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.957857 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.957942 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.958176 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.958275 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.958481 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.958566 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.958784 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.958871 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.959087 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.959181 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.959390 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.959518 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.959690 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.959785 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.960005 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.960092 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.960317 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.960403 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.960623 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.960707 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.960924 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.961011 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.961255 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.961358 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.961586 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.961767 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.961894 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.962200 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.962289 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.962506 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.962601 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.962809 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.962904 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.963126 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.963212 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.963449 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.963548 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.963760 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.963854 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.964069 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.964177 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.964376 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.964493 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.964700 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:26:13.964811 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.965048 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.965166 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.965387 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.965486 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.965734 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.965822 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.966053 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.966138 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.966385 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.966483 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.966705 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.966791 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.967029 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.967123 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.967346 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.967439 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.967665 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.967798 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.967984 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.968096 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.968296 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.968390 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.968610 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.968699 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.968928 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.969016 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.969272 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.969370 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.969585 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.969672 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.969915 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.970010 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.970236 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.970397 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.970553 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.970641 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.970873 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.970959 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.971191 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.971278 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.971501 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.971588 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.971815 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.971911 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.972128 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.972223 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.972438 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.972523 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.972768 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.972855 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.973104 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.973196 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.973427 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.973514 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.973742 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.973828 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.974067 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.974169 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.974381 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.974466 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.974688 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.974782 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.975000 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.975133 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.975309 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.975397 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.975619 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.975723 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.975953 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.976042 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.976268 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.976362 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.976582 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.976675 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.976898 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.977495 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.977763 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.977926 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.978081 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.978253 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.978399 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.978571 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.978717 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.978887 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.979033 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.979201 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.979375 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.979510 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.979693 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.979820 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.980029 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.980118 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.980352 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.980438 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.980668 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.980754 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.980989 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.981120 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.981327 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.981413 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.981642 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.981731 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.981956 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.982045 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.982265 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.982353 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.982575 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.982663 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.982884 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.982972 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.983195 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.983280 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.983499 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.983595 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.983811 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.983904 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.984124 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.984211 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.984431 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.984525 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.984756 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.984843 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.985082 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.985173 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.985397 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.985494 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.985710 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.985796 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.986015 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.986103 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.986321 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.986423 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.986634 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.986729 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.986946 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.987031 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.987253 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.987341 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.987562 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.987648 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.987876 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.987969 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.988180 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.988267 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.988498 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.988586 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.988806 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.988898 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.989143 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.989235 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.989465 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.989553 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.989771 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.989857 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.990089 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.990175 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.990404 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.990494 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.990716 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.990811 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.991042 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.991136 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.991357 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.991445 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.991662 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.991760 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.991973 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.992067 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.992277 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.992367 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.992608 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.993300 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.993467 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.993722 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.993903 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.994066 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.994152 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.994369 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.994469 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.994673 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.994763 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.994994 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.995088 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.995301 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.995387 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.995606 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.995699 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.995911 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.996045 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.996215 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.996302 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.996520 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.996605 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.996830 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.996929 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.997167 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.997268 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.997476 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.997563 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.997783 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.997883 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.998109 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.998197 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.998419 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.998505 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.998726 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.998813 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.999033 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.999127 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.999340 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.999426 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.999649 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.999735 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:13.999960 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.000046 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.000280 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.000368 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.000592 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.000689 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.000910 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.001005 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.001246 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.001338 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.001573 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.001665 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.001884 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.001973 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.002196 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.002283 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.002500 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.002587 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.002812 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.002904 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.003125 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.003220 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.003448 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.003536 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.003761 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.003853 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.004344 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.004446 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.004653 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.004738 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.004966 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.005071 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.005301 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.005401 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.005612 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.005699 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.005916 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.006000 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.006224 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.006345 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.006542 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.006633 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.006849 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.006935 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.007165 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.007253 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.007474 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.007560 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.007795 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.007880 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.008107 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.008193 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.008469 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.008747 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.008832 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.008962 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.009185 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.009306 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.009503 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.009635 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.009831 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.009970 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.010146 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.010284 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.010466 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.010599 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.010779 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.010920 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.011105 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.011284 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.011418 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.011602 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.011739 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.011918 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.012039 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.012225 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.012348 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.012536 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.012679 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.012830 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.012999 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.013171 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.013338 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.013475 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.013656 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.013802 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.013979 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.014115 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.014294 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.014428 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.014607 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.014754 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.014920 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.015051 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.015230 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.015379 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.015525 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.015658 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.015835 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.015977 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.016148 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.016290 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.016459 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.016547 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.016772 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.016866 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.017095 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.017186 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.017404 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.017493 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.017722 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.017808 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.018031 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.018128 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.018335 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.018437 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.018642 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.018728 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.018945 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.019040 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.019265 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.019350 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.019589 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.019735 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.019897 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.019994 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.020213 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.020299 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.020525 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.020610 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.020832 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.020926 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.021180 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.021272 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.021489 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.021630 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.021797 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.021897 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.022104 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.022198 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.022422 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.022509 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.022732 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.022821 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.023043 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.023130 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.023355 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.023443 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.023665 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.023761 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.024114 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.024255 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.024614 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.024760 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.024937 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.025400 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.025506 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.025588 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.025680 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.025872 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.025974 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.026180 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.026267 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.026495 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.026642 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.026812 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.026948 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.027128 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.027380 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.027515 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.027713 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.027868 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.028035 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.028223 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.028352 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.028486 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.028654 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.028800 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.028947 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.029112 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.029286 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.029432 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.029612 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.029748 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.029986 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.030185 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.030318 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.030522 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.030659 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.030838 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.030981 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.031145 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.031287 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.031460 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.031594 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.031768 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.031917 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.032070 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.032202 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.032367 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.032503 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.032677 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.032836 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.032983 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.033152 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.033286 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.033419 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.033589 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.033735 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.033894 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.034041 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.034207 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.034342 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.034511 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.034658 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.034822 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.034962 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.035125 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.035255 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.035438 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.035579 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.035744 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.035887 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.036048 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.036193 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.036349 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.036500 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.036652 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.036738 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.036969 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.037106 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.037300 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.037396 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.037620 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.037745 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.037923 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.038022 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.038248 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.038337 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.038561 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.038649 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.038861 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.038948 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.039166 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.039261 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.039986 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.040080 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.040299 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.040387 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.040607 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.040717 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.040910 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.040998 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.041245 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.041344 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.041547 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.041636 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.041858 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.041944 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.042167 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.042268 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.042474 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.042562 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.042781 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.042912 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.043081 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.043181 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.043388 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.043476 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.043689 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.043783 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.043995 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.044094 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.044298 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.044385 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.044598 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.044685 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.044896 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.044985 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.045226 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.045327 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.045529 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.045615 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.045830 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.045917 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.046134 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.046220 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.046436 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.046558 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.046746 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.046843 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.047048 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.047135 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.047347 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.047434 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.047647 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.047742 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.047957 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.048043 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.048263 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.048358 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.048606 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.048697 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.048860 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.048948 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.049189 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.049292 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.049489 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.049582 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.049792 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.049878 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.050098 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.050197 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.050396 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.050482 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.050698 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.050793 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.051004 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.051098 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.051307 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.051395 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.051623 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.051709 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.051926 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.052015 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.052229 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.052313 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.052527 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.052613 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.052830 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.052929 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.053155 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.053245 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.053461 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.053548 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.053762 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.053851 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.054063 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.054151 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.054364 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.054457 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.054665 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.054767 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.054967 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.055053 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.055845 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.056021 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.056168 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.056443 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.056598 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.056739 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.056896 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.057164 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.057257 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.057381 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.057484 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.057691 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.057792 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.058001 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.058114 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.058309 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.058417 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.058619 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.058733 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.058947 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.059036 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.059263 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.059349 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.059573 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.059668 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.059885 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.059974 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.060198 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.060293 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.060521 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.060615 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.060829 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.060916 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.061169 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.061260 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.061476 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.061576 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.061780 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.061867 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.062102 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.062198 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.062414 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.062579 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.062724 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.062809 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.063042 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.063171 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.063346 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.063434 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.063667 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.063753 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.063968 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.064061 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.064277 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.064366 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.064582 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.064674 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.064888 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.064974 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.065223 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.065319 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.065535 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.065680 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.065843 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.065978 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.066155 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.066292 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.066465 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.066607 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.066814 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.066961 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.067104 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.067235 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.067367 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.067500 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.067676 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.067817 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.067984 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.068119 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.068289 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.068423 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.068599 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.068752 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.068893 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.069058 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.069223 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.069353 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.069545 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.069759 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.069896 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.070029 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.070169 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.070303 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.070435 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.070590 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.070743 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.070885 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.071142 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.071284 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.071452 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.071626 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.071768 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.071962 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.072096 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.072280 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.072423 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.072592 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.072683 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.072907 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.073000 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.073242 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.073343 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.073558 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.073645 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.073869 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.073957 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.074259 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.074353 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.074570 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.074664 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.074875 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.074962 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.075177 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.075266 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.075485 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.075572 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.075804 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.075891 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.076104 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.076198 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.076407 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.076494 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.076709 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.076795 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.077046 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.077140 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.077355 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.077444 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.077682 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.077770 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.078058 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.078145 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.078367 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.078454 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.078673 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.078770 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.078988 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.079077 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.079316 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.079402 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.079624 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.079718 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.079929 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.080016 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.080241 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.080335 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.080564 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.080661 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.080870 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.080956 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.081217 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.081307 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.081543 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.081644 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.081867 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.081963 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.082191 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.082282 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.082504 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.082637 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.082818 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.082922 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.083124 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.083233 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.083447 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.083548 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.083770 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.083861 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.084082 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.084190 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.084403 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.084547 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.084806 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.084895 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.085145 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.085237 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.085459 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.085583 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.085781 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.085870 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.086093 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.086178 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.086424 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.086680 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.086824 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.086995 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.087094 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.087313 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.087405 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.087623 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.087712 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.087943 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.088028 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.088244 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.088331 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.088553 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.088674 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.088863 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.089002 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.089196 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.089336 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.089504 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.089660 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.089808 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.089989 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.090132 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.090304 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.090475 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.090616 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.090758 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.090894 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.091054 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.091214 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.091368 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.091500 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.091688 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.091831 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.091994 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.092160 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.092317 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.092447 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.092625 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.092760 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.092931 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.093064 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.093263 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.093353 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.093569 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.093659 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.093913 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.094010 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.094219 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.094306 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.094539 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.094625 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.094855 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.094943 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.095185 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.095280 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.095493 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.095579 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.095807 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.095897 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.096133 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.096220 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.096448 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.096535 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.096756 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.096856 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.097082 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.097171 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.097395 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.097494 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.097704 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.097791 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.098007 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.098094 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.098316 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.098412 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.098622 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.098709 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.098929 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.099025 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.099233 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.099328 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.099541 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.099627 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.099844 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.099932 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.100150 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.100258 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.100451 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.100549 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.100775 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.100870 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.101100 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.101193 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.101426 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.101523 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.101737 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.101826 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.102651 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.102796 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.102961 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.103051 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.103276 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.103363 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.103587 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.103683 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.103902 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.103991 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.104212 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.104307 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.104521 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.104609 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.104831 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.104918 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.105175 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.105277 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.105485 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.105571 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.105803 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.105889 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.106114 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.106209 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.106426 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.106512 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.106734 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.106821 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.107044 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.107139 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.107351 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.107438 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.107667 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.107754 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.107985 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.108081 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.108303 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.108392 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.108630 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.108828 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.108955 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.109199 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.109289 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.109523 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.109610 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.109843 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.109982 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.110163 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.110252 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.110481 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.110568 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.110801 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.110904 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.111116 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.111205 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.111431 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.111518 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.111743 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.111902 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.112040 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.112171 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.112368 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.112568 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.112710 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.112902 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.113079 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.113246 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.113390 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.113563 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.113708 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.113883 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.113971 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.114202 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.114289 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.114521 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.114617 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.114838 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.114925 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.115153 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.115241 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.115467 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.115556 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.115784 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.115924 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.116114 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.116202 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.116426 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.116515 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.116739 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.116828 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.117069 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.117237 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.117389 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.117485 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.118252 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.118349 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.118569 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.118666 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.118970 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.119059 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.119290 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.119386 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.119607 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.119697 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.119935 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.120021 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.120257 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.120343 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.120574 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.120663 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.120890 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.120976 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.121236 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.121331 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.121552 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.121640 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.121872 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.122069 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.122218 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.122389 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.122534 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.122725 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.122859 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.123053 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.123197 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.123381 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.123517 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.123696 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.123828 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.124015 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.124151 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.124340 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.124432 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.124644 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.124733 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.124950 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.125060 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.125313 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.125630 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.125892 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.126039 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.126245 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.126420 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.126557 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.126740 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.126864 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.127078 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.127186 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.127406 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.127495 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.127733 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.128018 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.128106 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.128361 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.128478 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.128674 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.128767 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.129260 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.129356 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.129573 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.129673 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.129888 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.129976 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.130194 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.130288 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.130498 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.130595 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.130812 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.130899 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.131118 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.131206 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.131430 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.131527 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.131737 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.131868 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.132043 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.132131 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.132348 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.132576 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.132673 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.132935 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.133100 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.133314 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.133484 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.133633 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.133771 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.133968 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.134058 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.134294 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.134385 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.134610 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.134706 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.134929 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.135024 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.135236 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.135332 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.135544 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.135643 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.135850 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.135937 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.136158 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.136311 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.136455 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.136590 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.136756 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.136899 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.137098 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.137241 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.137375 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.137506 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.137690 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.137837 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.137993 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.138128 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.138301 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.138435 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.138630 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.138781 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.138929 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.139062 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.139236 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.139379 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.139544 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.139694 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.139901 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.140041 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.140175 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.140305 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.140444 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.140590 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.140729 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.140870 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.141053 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.141199 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.141374 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.141512 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.141681 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.141817 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.141995 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.142138 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.142306 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.142442 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.142620 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.142845 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.142987 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.143181 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.143333 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.143504 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.143642 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.143841 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.143990 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.144175 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.144314 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.144481 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.144610 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.144789 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.144920 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.145118 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.145263 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.145443 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.145583 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.145754 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.145899 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.146066 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.146156 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.146373 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.146503 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.146685 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.146828 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.147010 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.147244 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.147396 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.147583 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.147721 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.147889 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.148031 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.148199 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.148291 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.148509 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.148599 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.148818 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.149464 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.149694 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.149781 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.150013 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.150117 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.150336 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.150428 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.150654 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.150743 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.150974 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.151061 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.151296 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.151386 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.151610 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.151698 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.151926 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.152072 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.152237 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.152324 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.152543 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.152629 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.152852 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.152989 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.153185 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.153273 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.153496 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.153599 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.153807 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.153909 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.154119 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.154207 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.154429 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.154516 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.154736 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.154826 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.155052 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.155394 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.155487 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.155716 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.155876 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.156033 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.156119 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.156354 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.156443 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.156664 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.156760 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.156976 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.157090 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.157315 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.157402 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.157628 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.157717 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.157939 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.158025 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.158256 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.158349 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.158587 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.158677 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.158907 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.159002 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.159217 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.159311 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.159555 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.159862 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.159949 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.160170 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.160258 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.160479 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.160567 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.160790 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.160879 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.161173 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.161409 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.161515 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.161763 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.161859 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.162095 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.162184 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.162406 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.162501 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.162715 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.162811 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.163019 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.163114 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.163322 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.163419 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.163626 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.163717 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.163936 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.164024 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.164239 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.164328 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.165165 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.165312 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.165496 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.165589 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.165804 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.165894 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.166110 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.166198 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.166414 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.166501 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.166722 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.166821 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.167027 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.167114 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.167330 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.167417 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.167650 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.167747 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.167936 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.168033 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.168241 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.168386 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.168549 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.168650 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.168856 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.168945 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.169191 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.169296 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.169496 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.169583 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.169801 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.169895 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.170107 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.170204 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.170470 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.170569 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.170718 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.170806 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.171023 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.171120 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.171340 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.171428 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.171647 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.171734 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.171955 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.172044 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.172260 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.172348 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.172566 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.172653 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.172896 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.172988 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.173247 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.173336 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.173562 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.173650 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.173875 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.173964 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.174200 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.174331 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.174517 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.174624 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.174823 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.174911 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.175148 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.175241 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.175464 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.175560 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.175784 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.175872 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.176100 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.176194 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.176410 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.176543 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.176739 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.176828 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.177072 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.177164 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.177388 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.177488 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.177699 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.177787 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.178012 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.178100 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.178381 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.178485 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.178632 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.178719 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.178940 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.179028 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.179254 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.179352 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.179570 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.179659 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.179887 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.179976 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.180233 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.180351 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.180559 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.180656 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.180870 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.180967 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.181213 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.181302 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.181539 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.181626 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.181852 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.181953 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.182167 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.182256 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.182481 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.182573 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.182797 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.182895 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.183112 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.183243 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.183425 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.183513 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.183731 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.183820 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.183974 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 08 10:26:14.184063 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.184346 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.184666 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.184997 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.185354 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.185671 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.186002 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.186333 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.186683 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.187000 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.187346 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.187678 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.187996 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.188311 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.188619 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:26:14.188866 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 08 10:26:14.336889 n-d-850501-12 devstack@n-api.service[106551]: INFO dbcounter [None req-801583ba-293d-4ec6-a08e-c6bfe7209b53 None None] Registered counter for database nova_api Sep 08 10:26:14.342630 n-d-850501-12 devstack@n-api.service[106550]: INFO dbcounter [None req-9afd6ec5-93e2-4117-a8d3-0a1d1c1b8ac6 None None] Registered counter for database nova_api Sep 08 10:26:14.357472 n-d-850501-12 devstack@n-api.service[106551]: DEBUG oslo_db.sqlalchemy.engines [None req-801583ba-293d-4ec6-a08e-c6bfe7209b53 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 10:26:14.362546 n-d-850501-12 devstack@n-api.service[106550]: DEBUG oslo_db.sqlalchemy.engines [None req-9afd6ec5-93e2-4117-a8d3-0a1d1c1b8ac6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106550) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 10:26:14.364117 n-d-850501-12 devstack@n-api.service[106551]: DEBUG dbcounter [-] [106551] Writer thread running {{(pid=106551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 10:26:14.369116 n-d-850501-12 devstack@n-api.service[106550]: DEBUG dbcounter [-] [106550] Writer thread running {{(pid=106550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 10:26:14.421959 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.context [None req-801583ba-293d-4ec6-a08e-c6bfe7209b53 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2785b110-f847-4739-9d30-5b571c6d79f4(cell1) {{(pid=106551) load_cells /opt/stack/nova/nova/context.py:464}} Sep 08 10:26:14.425763 n-d-850501-12 devstack@n-api.service[106551]: DEBUG oslo_concurrency.lockutils [None req-801583ba-293d-4ec6-a08e-c6bfe7209b53 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:14.426234 n-d-850501-12 devstack@n-api.service[106551]: DEBUG oslo_concurrency.lockutils [None req-801583ba-293d-4ec6-a08e-c6bfe7209b53 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:14.426438 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.context [None req-9afd6ec5-93e2-4117-a8d3-0a1d1c1b8ac6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2785b110-f847-4739-9d30-5b571c6d79f4(cell1) {{(pid=106550) load_cells /opt/stack/nova/nova/context.py:464}} Sep 08 10:26:14.427845 n-d-850501-12 devstack@n-api.service[106551]: DEBUG oslo_concurrency.lockutils [None req-801583ba-293d-4ec6-a08e-c6bfe7209b53 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:14.428570 n-d-850501-12 devstack@n-api.service[106551]: DEBUG oslo_concurrency.lockutils [None req-801583ba-293d-4ec6-a08e-c6bfe7209b53 None None] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:14.429067 n-d-850501-12 devstack@n-api.service[106551]: DEBUG oslo_concurrency.lockutils [None req-801583ba-293d-4ec6-a08e-c6bfe7209b53 None None] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:14.430396 n-d-850501-12 devstack@n-api.service[106550]: DEBUG oslo_concurrency.lockutils [None req-9afd6ec5-93e2-4117-a8d3-0a1d1c1b8ac6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:14.431139 n-d-850501-12 devstack@n-api.service[106550]: DEBUG oslo_concurrency.lockutils [None req-9afd6ec5-93e2-4117-a8d3-0a1d1c1b8ac6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:14.431306 n-d-850501-12 devstack@n-api.service[106551]: DEBUG oslo_concurrency.lockutils [None req-801583ba-293d-4ec6-a08e-c6bfe7209b53 None None] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:14.432809 n-d-850501-12 devstack@n-api.service[106550]: DEBUG oslo_concurrency.lockutils [None req-9afd6ec5-93e2-4117-a8d3-0a1d1c1b8ac6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:14.433249 n-d-850501-12 devstack@n-api.service[106551]: INFO dbcounter [None req-801583ba-293d-4ec6-a08e-c6bfe7209b53 None None] Registered counter for database nova_cell0 Sep 08 10:26:14.433570 n-d-850501-12 devstack@n-api.service[106550]: DEBUG oslo_concurrency.lockutils [None req-9afd6ec5-93e2-4117-a8d3-0a1d1c1b8ac6 None None] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:14.434014 n-d-850501-12 devstack@n-api.service[106550]: DEBUG oslo_concurrency.lockutils [None req-9afd6ec5-93e2-4117-a8d3-0a1d1c1b8ac6 None None] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:14.436035 n-d-850501-12 devstack@n-api.service[106550]: DEBUG oslo_concurrency.lockutils [None req-9afd6ec5-93e2-4117-a8d3-0a1d1c1b8ac6 None None] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:14.437259 n-d-850501-12 devstack@n-api.service[106551]: INFO dbcounter [None req-801583ba-293d-4ec6-a08e-c6bfe7209b53 None None] Registered counter for database nova_cell1 Sep 08 10:26:14.438067 n-d-850501-12 devstack@n-api.service[106550]: INFO dbcounter [None req-9afd6ec5-93e2-4117-a8d3-0a1d1c1b8ac6 None None] Registered counter for database nova_cell0 Sep 08 10:26:14.442056 n-d-850501-12 devstack@n-api.service[106550]: INFO dbcounter [None req-9afd6ec5-93e2-4117-a8d3-0a1d1c1b8ac6 None None] Registered counter for database nova_cell1 Sep 08 10:26:14.444326 n-d-850501-12 devstack@n-api.service[106551]: DEBUG oslo_db.sqlalchemy.engines [None req-801583ba-293d-4ec6-a08e-c6bfe7209b53 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 10:26:14.448662 n-d-850501-12 devstack@n-api.service[106550]: DEBUG oslo_db.sqlalchemy.engines [None req-9afd6ec5-93e2-4117-a8d3-0a1d1c1b8ac6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106550) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 10:26:14.449045 n-d-850501-12 devstack@n-api.service[106551]: DEBUG oslo_db.sqlalchemy.engines [None req-801583ba-293d-4ec6-a08e-c6bfe7209b53 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 10:26:14.452762 n-d-850501-12 devstack@n-api.service[106550]: DEBUG oslo_db.sqlalchemy.engines [None req-9afd6ec5-93e2-4117-a8d3-0a1d1c1b8ac6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106550) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 10:26:14.454306 n-d-850501-12 devstack@n-api.service[106550]: DEBUG dbcounter [-] [106550] Writer thread running {{(pid=106550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 10:26:14.455325 n-d-850501-12 devstack@n-api.service[106551]: DEBUG dbcounter [-] [106551] Writer thread running {{(pid=106551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 10:26:14.456777 n-d-850501-12 devstack@n-api.service[106551]: DEBUG dbcounter [-] [106551] Writer thread running {{(pid=106551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 10:26:14.601478 n-d-850501-12 devstack@n-api.service[106550]: DEBUG dbcounter [-] [106550] Writer thread running {{(pid=106550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 10:26:14.606894 n-d-850501-12 devstack@n-api.service[106551]: INFO dbcounter [None req-801583ba-293d-4ec6-a08e-c6bfe7209b53 None None] Registered counter for database nova_cell0 Sep 08 10:26:14.610430 n-d-850501-12 devstack@n-api.service[106550]: INFO dbcounter [None req-9afd6ec5-93e2-4117-a8d3-0a1d1c1b8ac6 None None] Registered counter for database nova_cell0 Sep 08 10:26:14.615717 n-d-850501-12 devstack@n-api.service[106551]: DEBUG oslo_db.sqlalchemy.engines [None req-801583ba-293d-4ec6-a08e-c6bfe7209b53 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 10:26:14.619284 n-d-850501-12 devstack@n-api.service[106550]: DEBUG oslo_db.sqlalchemy.engines [None req-9afd6ec5-93e2-4117-a8d3-0a1d1c1b8ac6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106550) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 10:26:14.620350 n-d-850501-12 devstack@n-api.service[106551]: DEBUG dbcounter [-] [106551] Writer thread running {{(pid=106551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 10:26:14.623601 n-d-850501-12 devstack@n-api.service[106550]: DEBUG dbcounter [-] [106550] Writer thread running {{(pid=106550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 10:26:14.959258 n-d-850501-12 devstack@n-api.service[106550]: WARNING keystonemiddleware.auth_token [None req-9afd6ec5-93e2-4117-a8d3-0a1d1c1b8ac6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 08 10:26:14.968127 n-d-850501-12 devstack@n-api.service[106550]: WARNING keystonemiddleware.auth_token [None req-9afd6ec5-93e2-4117-a8d3-0a1d1c1b8ac6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 08 10:26:14.968967 n-d-850501-12 devstack@n-api.service[106551]: WARNING keystonemiddleware.auth_token [None req-801583ba-293d-4ec6-a08e-c6bfe7209b53 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 08 10:26:14.984175 n-d-850501-12 devstack@n-api.service[106551]: WARNING keystonemiddleware.auth_token [None req-801583ba-293d-4ec6-a08e-c6bfe7209b53 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 08 10:26:15.309908 n-d-850501-12 devstack@n-api.service[106550]: WARNING keystonemiddleware.auth_token [None req-9afd6ec5-93e2-4117-a8d3-0a1d1c1b8ac6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 08 10:26:15.315804 n-d-850501-12 devstack@n-api.service[106550]: WARNING keystonemiddleware.auth_token [None req-9afd6ec5-93e2-4117-a8d3-0a1d1c1b8ac6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 08 10:26:15.321573 n-d-850501-12 devstack@n-api.service[106550]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ef5b0279c0 pid: 106550 (default app) Sep 08 10:26:15.323676 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi [None req-9afd6ec5-93e2-4117-a8d3-0a1d1c1b8ac6 None None] Calling method '>' {{(pid=106550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:15.324845 n-d-850501-12 devstack@n-api.service[106550]: INFO nova.api.openstack.requestlog [None req-9afd6ec5-93e2-4117-a8d3-0a1d1c1b8ac6 None None] 10.222.0.27 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001709 Sep 08 10:26:15.325286 n-d-850501-12 devstack@n-api.service[106550]: [pid: 106550|app: 0|req: 1/1] 10.222.0.27 () {50 vars in 788 bytes} [Thu Sep 8 10:26:15 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:26:15.328893 n-d-850501-12 devstack@n-api.service[106551]: WARNING keystonemiddleware.auth_token [None req-801583ba-293d-4ec6-a08e-c6bfe7209b53 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 08 10:26:15.334302 n-d-850501-12 devstack@n-api.service[106551]: WARNING keystonemiddleware.auth_token [None req-801583ba-293d-4ec6-a08e-c6bfe7209b53 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 08 10:26:15.340751 n-d-850501-12 devstack@n-api.service[106551]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ef5b0279c0 pid: 106551 (default app) Sep 08 10:27:37.278599 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi [None req-9afd6ec5-93e2-4117-a8d3-0a1d1c1b8ac6 None None] Calling method '>' {{(pid=106550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:37.279656 n-d-850501-12 devstack@n-api.service[106550]: INFO nova.api.openstack.requestlog [None req-9afd6ec5-93e2-4117-a8d3-0a1d1c1b8ac6 None None] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001538 Sep 08 10:27:37.280108 n-d-850501-12 devstack@n-api.service[106550]: [pid: 106550|app: 0|req: 2/2] 10.222.0.27 () {54 vars in 931 bytes} [Thu Sep 8 10:27:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:27:37.293063 n-d-850501-12 devstack@n-api.service[106551]: DEBUG dbcounter [-] [106551] Writing DB stats nova_api:SELECT=3 {{(pid=106551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:27:37.294402 n-d-850501-12 devstack@n-api.service[106551]: DEBUG dbcounter [-] [106551] Writing DB stats nova_cell0:SELECT=3 {{(pid=106551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:27:37.295366 n-d-850501-12 devstack@n-api.service[106551]: DEBUG dbcounter [-] [106551] Writing DB stats nova_cell1:SELECT=3 {{(pid=106551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:27:37.296335 n-d-850501-12 devstack@n-api.service[106551]: DEBUG dbcounter [-] [106551] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:27:38.192874 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi [None req-360388b7-cbbf-4982-a341-9fabcabd876b admin admin] Calling method '>' {{(pid=106551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:38.227671 n-d-850501-12 devstack@n-api.service[106551]: INFO nova.api.openstack.requestlog [None req-360388b7-cbbf-4982-a341-9fabcabd876b admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.940579 Sep 08 10:27:38.228444 n-d-850501-12 devstack@n-api.service[106551]: [pid: 106551|app: 0|req: 1/3] 10.222.0.27 () {60 vars in 1292 bytes} [Thu Sep 8 10:27:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:27:40.879800 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi [None req-9afd6ec5-93e2-4117-a8d3-0a1d1c1b8ac6 None None] Calling method '>' {{(pid=106550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:40.880787 n-d-850501-12 devstack@n-api.service[106550]: INFO nova.api.openstack.requestlog [None req-9afd6ec5-93e2-4117-a8d3-0a1d1c1b8ac6 None None] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002130 Sep 08 10:27:40.882817 n-d-850501-12 devstack@n-api.service[106550]: [pid: 106550|app: 0|req: 3/4] 10.222.0.27 () {54 vars in 931 bytes} [Thu Sep 8 10:27:40 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:27:41.323995 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi [None req-5160698d-ae77-467a-81e4-60cdacf2d6c5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "rxtx_factor": 1.0, "disk": 1, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 1}} {{(pid=106551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:27:41.372268 n-d-850501-12 devstack@n-api.service[106551]: INFO nova.api.openstack.requestlog [None req-5160698d-ae77-467a-81e4-60cdacf2d6c5 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.483572 Sep 08 10:27:41.372831 n-d-850501-12 devstack@n-api.service[106551]: [pid: 106551|app: 0|req: 2/5] 10.222.0.27 () {64 vars in 1283 bytes} [Thu Sep 8 10:27:40 2022] POST /compute/v2.1/flavors => generated 407 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:27:41.387050 n-d-850501-12 devstack@n-api.service[106550]: DEBUG dbcounter [-] [106550] Writing DB stats nova_api:SELECT=3 {{(pid=106550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:27:41.387883 n-d-850501-12 devstack@n-api.service[106550]: DEBUG dbcounter [-] [106550] Writing DB stats nova_cell0:SELECT=3 {{(pid=106550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:27:41.388836 n-d-850501-12 devstack@n-api.service[106550]: DEBUG dbcounter [-] [106550] Writing DB stats nova_cell1:SELECT=3 {{(pid=106550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:27:41.389585 n-d-850501-12 devstack@n-api.service[106550]: DEBUG dbcounter [-] [106550] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:27:41.599429 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi [None req-b4d0004b-94f2-45bc-8415-649102442eef admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:27:41.670479 n-d-850501-12 devstack@n-api.service[106550]: INFO nova.api.openstack.requestlog [None req-b4d0004b-94f2-45bc-8415-649102442eef admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.288631 Sep 08 10:27:41.671071 n-d-850501-12 devstack@n-api.service[106550]: [pid: 106550|app: 0|req: 4/6] 10.222.0.27 () {64 vars in 1336 bytes} [Thu Sep 8 10:27:41 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:27:44.344892 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi [None req-5160698d-ae77-467a-81e4-60cdacf2d6c5 admin admin] Calling method '>' {{(pid=106551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:44.346593 n-d-850501-12 devstack@n-api.service[106551]: INFO nova.api.openstack.requestlog [None req-5160698d-ae77-467a-81e4-60cdacf2d6c5 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002155 Sep 08 10:27:44.348227 n-d-850501-12 devstack@n-api.service[106551]: [pid: 106551|app: 0|req: 3/7] 10.222.0.27 () {54 vars in 931 bytes} [Thu Sep 8 10:27:44 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:27:45.179577 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi [None req-443be1ee-6c20-435e-811a-b0835f6e2ba3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "disk": 5, "rxtx_factor": 1.0, "vcpus": 1, "ram": 512, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds512M"}} {{(pid=106550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:27:45.249629 n-d-850501-12 devstack@n-api.service[106550]: INFO nova.api.openstack.requestlog [None req-443be1ee-6c20-435e-811a-b0835f6e2ba3 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.894711 Sep 08 10:27:45.251287 n-d-850501-12 devstack@n-api.service[106550]: [pid: 106550|app: 0|req: 5/8] 10.222.0.27 () {64 vars in 1283 bytes} [Thu Sep 8 10:27:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:27:45.265944 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi [None req-96dd5be5-f6af-4eec-abd2-e65e88e535a9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:27:45.336430 n-d-850501-12 devstack@n-api.service[106551]: INFO nova.api.openstack.requestlog [None req-96dd5be5-f6af-4eec-abd2-e65e88e535a9 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.075634 Sep 08 10:27:45.362241 n-d-850501-12 devstack@n-api.service[106551]: [pid: 106551|app: 0|req: 4/9] 10.222.0.27 () {64 vars in 1336 bytes} [Thu Sep 8 10:27:45 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:27:48.202628 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi [None req-443be1ee-6c20-435e-811a-b0835f6e2ba3 admin admin] Calling method '>' {{(pid=106550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:48.203781 n-d-850501-12 devstack@n-api.service[106550]: INFO nova.api.openstack.requestlog [None req-443be1ee-6c20-435e-811a-b0835f6e2ba3 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001628 Sep 08 10:27:48.204475 n-d-850501-12 devstack@n-api.service[106550]: [pid: 106550|app: 0|req: 6/10] 10.222.0.27 () {54 vars in 931 bytes} [Thu Sep 8 10:27:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:27:48.834524 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi [None req-43397f7c-7e5b-41e1-b82b-9e13ac67e1fe admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "ram": 1024, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "swap": 0, "name": "ds1G", "vcpus": 1}} {{(pid=106551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:27:48.855146 n-d-850501-12 devstack@n-api.service[106551]: INFO nova.api.openstack.requestlog [None req-43397f7c-7e5b-41e1-b82b-9e13ac67e1fe admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.641763 Sep 08 10:27:48.855859 n-d-850501-12 devstack@n-api.service[106551]: [pid: 106551|app: 0|req: 5/11] 10.222.0.27 () {64 vars in 1283 bytes} [Thu Sep 8 10:27:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 10:27:48.867859 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi [None req-0c785096-94b6-4ce0-926c-870c40df9547 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:27:48.902310 n-d-850501-12 devstack@n-api.service[106550]: INFO nova.api.openstack.requestlog [None req-0c785096-94b6-4ce0-926c-870c40df9547 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037951 Sep 08 10:27:48.903085 n-d-850501-12 devstack@n-api.service[106550]: [pid: 106550|app: 0|req: 7/12] 10.222.0.27 () {64 vars in 1336 bytes} [Thu Sep 8 10:27:48 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:27:51.571969 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi [None req-43397f7c-7e5b-41e1-b82b-9e13ac67e1fe admin admin] Calling method '>' {{(pid=106551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:51.572989 n-d-850501-12 devstack@n-api.service[106551]: INFO nova.api.openstack.requestlog [None req-43397f7c-7e5b-41e1-b82b-9e13ac67e1fe admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Sep 08 10:27:51.573446 n-d-850501-12 devstack@n-api.service[106551]: [pid: 106551|app: 0|req: 6/13] 10.222.0.27 () {54 vars in 931 bytes} [Thu Sep 8 10:27:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:27:52.061715 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi [None req-ad33ae7a-2bac-4f91-b7d3-f53542118633 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "id": "d3", "name": "ds2G", "ram": 2048}} {{(pid=106550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:27:52.082315 n-d-850501-12 devstack@n-api.service[106550]: INFO nova.api.openstack.requestlog [None req-ad33ae7a-2bac-4f91-b7d3-f53542118633 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.501766 Sep 08 10:27:52.083064 n-d-850501-12 devstack@n-api.service[106550]: [pid: 106550|app: 0|req: 8/14] 10.222.0.27 () {64 vars in 1283 bytes} [Thu Sep 8 10:27:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:27:52.095777 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi [None req-ec329c3f-5cd0-4f7e-a2ba-6a1fa9679734 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:27:52.130560 n-d-850501-12 devstack@n-api.service[106551]: INFO nova.api.openstack.requestlog [None req-ec329c3f-5cd0-4f7e-a2ba-6a1fa9679734 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038649 Sep 08 10:27:52.133285 n-d-850501-12 devstack@n-api.service[106551]: [pid: 106551|app: 0|req: 7/15] 10.222.0.27 () {64 vars in 1336 bytes} [Thu Sep 8 10:27:52 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:27:54.934832 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi [None req-ad33ae7a-2bac-4f91-b7d3-f53542118633 admin admin] Calling method '>' {{(pid=106550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:54.936456 n-d-850501-12 devstack@n-api.service[106550]: INFO nova.api.openstack.requestlog [None req-ad33ae7a-2bac-4f91-b7d3-f53542118633 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002058 Sep 08 10:27:54.948525 n-d-850501-12 devstack@n-api.service[106550]: [pid: 106550|app: 0|req: 9/16] 10.222.0.27 () {54 vars in 931 bytes} [Thu Sep 8 10:27:54 2022] GET /compute/v2.1 => generated 388 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:27:55.460552 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi [None req-db869037-dfbf-4f78-97c3-64294f1f3a65 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 4096, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "id": "d4", "rxtx_factor": 1.0, "vcpus": 4, "disk": 20}} {{(pid=106551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:27:55.483514 n-d-850501-12 devstack@n-api.service[106551]: INFO nova.api.openstack.requestlog [None req-db869037-dfbf-4f78-97c3-64294f1f3a65 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.538934 Sep 08 10:27:55.498743 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi [None req-a366fb27-5f9e-4c59-8a27-84979fe80e60 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:27:55.504281 n-d-850501-12 devstack@n-api.service[106551]: [pid: 106551|app: 0|req: 8/17] 10.222.0.27 () {64 vars in 1283 bytes} [Thu Sep 8 10:27:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:27:55.529341 n-d-850501-12 devstack@n-api.service[106550]: INFO nova.api.openstack.requestlog [None req-a366fb27-5f9e-4c59-8a27-84979fe80e60 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034475 Sep 08 10:27:55.549122 n-d-850501-12 devstack@n-api.service[106550]: [pid: 106550|app: 0|req: 10/18] 10.222.0.27 () {64 vars in 1336 bytes} [Thu Sep 8 10:27:55 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:27:58.302899 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi [None req-db869037-dfbf-4f78-97c3-64294f1f3a65 admin admin] Calling method '>' {{(pid=106551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:58.304216 n-d-850501-12 devstack@n-api.service[106551]: INFO nova.api.openstack.requestlog [None req-db869037-dfbf-4f78-97c3-64294f1f3a65 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001937 Sep 08 10:27:58.305099 n-d-850501-12 devstack@n-api.service[106551]: [pid: 106551|app: 0|req: 9/19] 10.222.0.27 () {54 vars in 931 bytes} [Thu Sep 8 10:27:58 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:27:58.736309 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi [None req-5b398b55-d044-4d8d-ba00-b0f75a66aa13 admin admin] Calling method '>' {{(pid=106550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:58.763528 n-d-850501-12 devstack@n-api.service[106550]: INFO nova.api.openstack.requestlog [None req-5b398b55-d044-4d8d-ba00-b0f75a66aa13 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.450690 Sep 08 10:27:58.764240 n-d-850501-12 devstack@n-api.service[106550]: [pid: 106550|app: 0|req: 11/20] 10.222.0.27 () {60 vars in 1292 bytes} [Thu Sep 8 10:27:58 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:28:02.052470 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi [None req-db869037-dfbf-4f78-97c3-64294f1f3a65 admin admin] Calling method '>' {{(pid=106551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:02.053709 n-d-850501-12 devstack@n-api.service[106551]: INFO nova.api.openstack.requestlog [None req-db869037-dfbf-4f78-97c3-64294f1f3a65 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001737 Sep 08 10:28:02.054176 n-d-850501-12 devstack@n-api.service[106551]: [pid: 106551|app: 0|req: 10/21] 10.222.0.27 () {54 vars in 931 bytes} [Thu Sep 8 10:28:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:28:02.508231 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi [None req-8314495b-d595-45aa-916c-c4c60904a07a admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "id": "1", "vcpus": 1, "disk": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.tiny"}} {{(pid=106550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:28:02.527288 n-d-850501-12 devstack@n-api.service[106550]: INFO nova.api.openstack.requestlog [None req-8314495b-d595-45aa-916c-c4c60904a07a admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.466691 Sep 08 10:28:02.527797 n-d-850501-12 devstack@n-api.service[106550]: [pid: 106550|app: 0|req: 12/22] 10.222.0.27 () {64 vars in 1283 bytes} [Thu Sep 8 10:28:02 2022] POST /compute/v2.1/flavors => generated 402 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 10:28:02.540673 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi [None req-95e5b03f-c670-48a5-9ffe-754d14b502ed admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:28:02.572137 n-d-850501-12 devstack@n-api.service[106551]: INFO nova.api.openstack.requestlog [None req-95e5b03f-c670-48a5-9ffe-754d14b502ed admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035114 Sep 08 10:28:02.572725 n-d-850501-12 devstack@n-api.service[106551]: [pid: 106551|app: 0|req: 11/23] 10.222.0.27 () {64 vars in 1333 bytes} [Thu Sep 8 10:28:02 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:28:05.402063 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi [None req-8314495b-d595-45aa-916c-c4c60904a07a admin admin] Calling method '>' {{(pid=106550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:05.403087 n-d-850501-12 devstack@n-api.service[106550]: INFO nova.api.openstack.requestlog [None req-8314495b-d595-45aa-916c-c4c60904a07a admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Sep 08 10:28:05.403490 n-d-850501-12 devstack@n-api.service[106550]: [pid: 106550|app: 0|req: 13/24] 10.222.0.27 () {54 vars in 931 bytes} [Thu Sep 8 10:28:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:28:05.818243 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi [None req-f8e3d35b-fc72-419c-997e-fece62e128c5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "vcpus": 1, "ram": 2048, "id": "2", "rxtx_factor": 1.0, "name": "m1.small"}} {{(pid=106551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:28:05.837202 n-d-850501-12 devstack@n-api.service[106551]: INFO nova.api.openstack.requestlog [None req-f8e3d35b-fc72-419c-997e-fece62e128c5 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.427321 Sep 08 10:28:05.845019 n-d-850501-12 devstack@n-api.service[106551]: [pid: 106551|app: 0|req: 12/25] 10.222.0.27 () {64 vars in 1283 bytes} [Thu Sep 8 10:28:05 2022] POST /compute/v2.1/flavors => generated 405 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:28:05.850470 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi [None req-babd92e6-98b5-489e-a2bd-e97f29395056 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:28:05.874693 n-d-850501-12 devstack@n-api.service[106550]: INFO nova.api.openstack.requestlog [None req-babd92e6-98b5-489e-a2bd-e97f29395056 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028172 Sep 08 10:28:05.875280 n-d-850501-12 devstack@n-api.service[106550]: [pid: 106550|app: 0|req: 14/26] 10.222.0.27 () {64 vars in 1333 bytes} [Thu Sep 8 10:28:05 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:28:08.523175 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi [None req-f8e3d35b-fc72-419c-997e-fece62e128c5 admin admin] Calling method '>' {{(pid=106551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:08.524188 n-d-850501-12 devstack@n-api.service[106551]: INFO nova.api.openstack.requestlog [None req-f8e3d35b-fc72-419c-997e-fece62e128c5 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Sep 08 10:28:08.524591 n-d-850501-12 devstack@n-api.service[106551]: [pid: 106551|app: 0|req: 13/27] 10.222.0.27 () {54 vars in 931 bytes} [Thu Sep 8 10:28:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:28:08.960865 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi [None req-d9639061-36e6-4217-8d02-c174ddd8369f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "disk": 40, "swap": 0, "vcpus": 2, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "3"}} {{(pid=106550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:28:08.980307 n-d-850501-12 devstack@n-api.service[106550]: INFO nova.api.openstack.requestlog [None req-d9639061-36e6-4217-8d02-c174ddd8369f admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.449673 Sep 08 10:28:08.981182 n-d-850501-12 devstack@n-api.service[106550]: [pid: 106550|app: 0|req: 15/28] 10.222.0.27 () {64 vars in 1283 bytes} [Thu Sep 8 10:28:08 2022] POST /compute/v2.1/flavors => generated 406 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:28:08.993949 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi [None req-56ace1eb-b882-4712-8ede-e1a17fce9aeb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:28:08.999124 n-d-850501-12 devstack@n-api.service[106551]: DEBUG dbcounter [-] [106551] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=106551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:28:09.027946 n-d-850501-12 devstack@n-api.service[106551]: INFO nova.api.openstack.requestlog [None req-56ace1eb-b882-4712-8ede-e1a17fce9aeb admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037543 Sep 08 10:28:09.028529 n-d-850501-12 devstack@n-api.service[106551]: [pid: 106551|app: 0|req: 14/29] 10.222.0.27 () {64 vars in 1333 bytes} [Thu Sep 8 10:28:08 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:28:11.762372 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi [None req-d9639061-36e6-4217-8d02-c174ddd8369f admin admin] Calling method '>' {{(pid=106550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:11.763994 n-d-850501-12 devstack@n-api.service[106550]: INFO nova.api.openstack.requestlog [None req-d9639061-36e6-4217-8d02-c174ddd8369f admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002133 Sep 08 10:28:11.764399 n-d-850501-12 devstack@n-api.service[106550]: [pid: 106550|app: 0|req: 16/30] 10.222.0.27 () {54 vars in 931 bytes} [Thu Sep 8 10:28:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:28:12.222795 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi [None req-7841687c-fc6c-49db-8552-217c9b46fecc admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "name": "m1.large", "ram": 8192, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 80, "id": "4", "swap": 0}} {{(pid=106551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:28:12.249316 n-d-850501-12 devstack@n-api.service[106551]: INFO nova.api.openstack.requestlog [None req-7841687c-fc6c-49db-8552-217c9b46fecc admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.477052 Sep 08 10:28:12.253069 n-d-850501-12 devstack@n-api.service[106551]: [pid: 106551|app: 0|req: 15/31] 10.222.0.27 () {64 vars in 1283 bytes} [Thu Sep 8 10:28:11 2022] POST /compute/v2.1/flavors => generated 405 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:28:12.262655 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi [None req-c2f8afc6-2391-4171-8d35-5fd0ea06b026 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:28:12.270213 n-d-850501-12 devstack@n-api.service[106550]: DEBUG dbcounter [-] [106550] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=106550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:28:12.300431 n-d-850501-12 devstack@n-api.service[106550]: INFO nova.api.openstack.requestlog [None req-c2f8afc6-2391-4171-8d35-5fd0ea06b026 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041495 Sep 08 10:28:12.309228 n-d-850501-12 devstack@n-api.service[106550]: [pid: 106550|app: 0|req: 17/32] 10.222.0.27 () {64 vars in 1333 bytes} [Thu Sep 8 10:28:12 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:28:14.913077 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi [None req-7841687c-fc6c-49db-8552-217c9b46fecc admin admin] Calling method '>' {{(pid=106551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:14.913951 n-d-850501-12 devstack@n-api.service[106551]: INFO nova.api.openstack.requestlog [None req-7841687c-fc6c-49db-8552-217c9b46fecc admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Sep 08 10:28:14.914510 n-d-850501-12 devstack@n-api.service[106551]: [pid: 106551|app: 0|req: 16/33] 10.222.0.27 () {54 vars in 931 bytes} [Thu Sep 8 10:28:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:28:15.355834 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi [None req-754822ec-66f6-4e1d-b3e8-a3dd20efe501 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "id": "5", "disk": 160, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 16384, "vcpus": 8}} {{(pid=106550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:28:15.376387 n-d-850501-12 devstack@n-api.service[106550]: INFO nova.api.openstack.requestlog [None req-754822ec-66f6-4e1d-b3e8-a3dd20efe501 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.455398 Sep 08 10:28:15.376869 n-d-850501-12 devstack@n-api.service[106550]: [pid: 106550|app: 0|req: 18/34] 10.222.0.27 () {64 vars in 1283 bytes} [Thu Sep 8 10:28:14 2022] POST /compute/v2.1/flavors => generated 408 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:28:15.390089 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi [None req-7f7bb361-beb1-4dd3-8838-1b6abe18664e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:28:15.418011 n-d-850501-12 devstack@n-api.service[106551]: INFO nova.api.openstack.requestlog [None req-7f7bb361-beb1-4dd3-8838-1b6abe18664e admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030595 Sep 08 10:28:15.418011 n-d-850501-12 devstack@n-api.service[106551]: [pid: 106551|app: 0|req: 17/35] 10.222.0.27 () {64 vars in 1333 bytes} [Thu Sep 8 10:28:15 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:28:35.526822 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi [None req-754822ec-66f6-4e1d-b3e8-a3dd20efe501 admin admin] Calling method '>' {{(pid=106550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:35.527848 n-d-850501-12 devstack@n-api.service[106550]: INFO nova.api.openstack.requestlog [None req-754822ec-66f6-4e1d-b3e8-a3dd20efe501 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Sep 08 10:28:35.528247 n-d-850501-12 devstack@n-api.service[106550]: [pid: 106550|app: 0|req: 19/36] 10.222.0.27 () {54 vars in 931 bytes} [Thu Sep 8 10:28:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:28:35.539339 n-d-850501-12 devstack@n-api.service[106551]: DEBUG dbcounter [-] [106551] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=106551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:28:35.980474 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi [None req-8edf4938-560e-4f59-9fe3-1093dc74ec39 admin admin] Calling method '>' {{(pid=106551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:35.999851 n-d-850501-12 devstack@n-api.service[106551]: INFO nova.api.openstack.requestlog [None req-8edf4938-560e-4f59-9fe3-1093dc74ec39 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.464859 Sep 08 10:28:36.000848 n-d-850501-12 devstack@n-api.service[106551]: [pid: 106551|app: 0|req: 18/37] 10.222.0.27 () {60 vars in 1292 bytes} [Thu Sep 8 10:28:35 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:28:37.376157 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi [None req-754822ec-66f6-4e1d-b3e8-a3dd20efe501 admin admin] Calling method '>' {{(pid=106550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:37.377241 n-d-850501-12 devstack@n-api.service[106550]: INFO nova.api.openstack.requestlog [None req-754822ec-66f6-4e1d-b3e8-a3dd20efe501 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001696 Sep 08 10:28:37.377814 n-d-850501-12 devstack@n-api.service[106550]: [pid: 106550|app: 0|req: 20/38] 10.222.0.27 () {56 vars in 1074 bytes} [Thu Sep 8 10:28:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:28:37.932340 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi [None req-729a89ec-1414-47ee-8242-4b4332807f21 admin admin] Calling method '>' {{(pid=106551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:37.937609 n-d-850501-12 devstack@n-api.service[106551]: INFO nova.api.openstack.wsgi [None req-729a89ec-1414-47ee-8242-4b4332807f21 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 08 10:28:37.941366 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi [None req-729a89ec-1414-47ee-8242-4b4332807f21 admin admin] Request method failure captured: Sep 08 10:28:37.941366 n-d-850501-12 devstack@n-api.service[106551]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 08 10:28:37.941366 n-d-850501-12 devstack@n-api.service[106551]: Accept: application/json Sep 08 10:28:37.941366 n-d-850501-12 devstack@n-api.service[106551]: Accept-Encoding: gzip, deflate Sep 08 10:28:37.941366 n-d-850501-12 devstack@n-api.service[106551]: Connection: keep-alive Sep 08 10:28:37.941366 n-d-850501-12 devstack@n-api.service[106551]: Content-Length: 0 Sep 08 10:28:37.941366 n-d-850501-12 devstack@n-api.service[106551]: Host: 10.222.0.27 Sep 08 10:28:37.941366 n-d-850501-12 devstack@n-api.service[106551]: Openstack-Api-Version: compute 2.92 Sep 08 10:28:37.941366 n-d-850501-12 devstack@n-api.service[106551]: Openstack-System-Scope: None Sep 08 10:28:37.941366 n-d-850501-12 devstack@n-api.service[106551]: User-Agent: python-novaclient Sep 08 10:28:37.941366 n-d-850501-12 devstack@n-api.service[106551]: X-Auth-Token: gAAAAABjGcPVfS4oNBt350FRuCbUENPMIn4RXaPIvZAEAOCML5gexRp5p5GYUTZfvLQUE2Y_PRZ-8dTl5pOPP_VxjcGQL5o-M5Yvkl6fFI5L5J6b6-irELsZcSaUJO_dTKb2QcqQlvaEItuFL7alQr6vXYhPCpi09f1DIq_GIDjEMm1pb7Znd6s Sep 08 10:28:37.941366 n-d-850501-12 devstack@n-api.service[106551]: X-Domain-Id: None Sep 08 10:28:37.941366 n-d-850501-12 devstack@n-api.service[106551]: X-Domain-Name: None Sep 08 10:28:37.941366 n-d-850501-12 devstack@n-api.service[106551]: X-Identity-Status: Confirmed Sep 08 10:28:37.941366 n-d-850501-12 devstack@n-api.service[106551]: X-Is-Admin-Project: True Sep 08 10:28:37.941366 n-d-850501-12 devstack@n-api.service[106551]: X-Openstack-Nova-Api-Version: 2.92 Sep 08 10:28:37.941366 n-d-850501-12 devstack@n-api.service[106551]: X-Project-Domain-Id: default Sep 08 10:28:37.941366 n-d-850501-12 devstack@n-api.service[106551]: X-Project-Domain-Name: Default Sep 08 10:28:37.941366 n-d-850501-12 devstack@n-api.service[106551]: X-Project-Id: a583042a7b0e4d04a43898975c17dea5 Sep 08 10:28:37.941366 n-d-850501-12 devstack@n-api.service[106551]: X-Project-Name: admin Sep 08 10:28:37.941366 n-d-850501-12 devstack@n-api.service[106551]: X-Role: reader,admin,member Sep 08 10:28:37.941366 n-d-850501-12 devstack@n-api.service[106551]: X-Roles: reader,admin,member Sep 08 10:28:37.943098 n-d-850501-12 devstack@n-api.service[106551]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a583042a7b0e4d04a43898975c17dea5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a583042a7b0e4d04a43898975c17dea5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a583042a7b0e4d04a43898975c17dea5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a583042a7b0e4d04a43898975c17dea5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:28:37.943098 n-d-850501-12 devstack@n-api.service[106551]: X-Tenant: admin Sep 08 10:28:37.943098 n-d-850501-12 devstack@n-api.service[106551]: X-Tenant-Id: a583042a7b0e4d04a43898975c17dea5 Sep 08 10:28:37.943098 n-d-850501-12 devstack@n-api.service[106551]: X-Tenant-Name: admin Sep 08 10:28:37.943098 n-d-850501-12 devstack@n-api.service[106551]: X-User: admin Sep 08 10:28:37.943098 n-d-850501-12 devstack@n-api.service[106551]: X-User-Domain-Id: default Sep 08 10:28:37.943098 n-d-850501-12 devstack@n-api.service[106551]: X-User-Domain-Name: Default Sep 08 10:28:37.943098 n-d-850501-12 devstack@n-api.service[106551]: X-User-Id: 79e9dd741e6a4f668898d6e2537cb2e9 Sep 08 10:28:37.943098 n-d-850501-12 devstack@n-api.service[106551]: X-User-Name: admin Sep 08 10:28:37.943098 n-d-850501-12 devstack@n-api.service[106551]: method: > Sep 08 10:28:37.943098 n-d-850501-12 devstack@n-api.service[106551]: exception: Flavor 42 could not be found. Sep 08 10:28:37.943098 n-d-850501-12 devstack@n-api.service[106551]: action_args: {'id': '42'} Sep 08 10:28:37.943098 n-d-850501-12 devstack@n-api.service[106551]: {{(pid=106551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:28:37.943098 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:37.944210 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 08 10:28:37.944210 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 08 10:28:37.944210 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 08 10:28:37.944210 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 08 10:28:37.944210 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 10:28:37.944210 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 10:28:37.944210 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 08 10:28:37.944210 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 08 10:28:37.944210 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 08 10:28:37.944210 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:28:37.944210 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 08 10:28:37.944210 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 08 10:28:37.944210 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 08 10:28:37.944210 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi Sep 08 10:28:37.944210 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:28:37.944210 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi Sep 08 10:28:37.944210 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:37.944210 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:28:37.944210 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:28:37.945674 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:28:37.945674 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:28:37.945674 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:28:37.945674 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:28:37.945674 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 08 10:28:37.945674 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:28:37.945674 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 08 10:28:37.945674 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi Sep 08 10:28:37.945674 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:28:37.945674 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi Sep 08 10:28:37.945674 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:37.945674 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:28:37.945674 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:28:37.945674 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:28:37.945674 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:28:37.945674 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 08 10:28:37.945674 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi Sep 08 10:28:37.945674 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi [None req-729a89ec-1414-47ee-8242-4b4332807f21 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106551) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:28:37.946994 n-d-850501-12 devstack@n-api.service[106551]: INFO nova.api.openstack.requestlog [None req-729a89ec-1414-47ee-8242-4b4332807f21 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.402606 Sep 08 10:28:37.946994 n-d-850501-12 devstack@n-api.service[106551]: [pid: 106551|app: 0|req: 19/39] 10.222.0.27 () {60 vars in 1190 bytes} [Thu Sep 8 10:28:37 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 404 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 08 10:28:37.952574 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi [None req-f8ae0c92-d2c9-41b2-a182-847fe3bb7a07 admin admin] Calling method '>' {{(pid=106550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:37.957251 n-d-850501-12 devstack@n-api.service[106550]: DEBUG dbcounter [-] [106550] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=106550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:28:37.975900 n-d-850501-12 devstack@n-api.service[106550]: INFO nova.api.openstack.requestlog [None req-f8ae0c92-d2c9-41b2-a182-847fe3bb7a07 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026977 Sep 08 10:28:37.976435 n-d-850501-12 devstack@n-api.service[106550]: [pid: 106550|app: 0|req: 21/40] 10.222.0.27 () {60 vars in 1210 bytes} [Thu Sep 8 10:28:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:28:37.987825 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi [None req-5c809357-ece8-47df-97ff-6ec907f7b0a9 admin admin] Calling method '>' {{(pid=106551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:38.010714 n-d-850501-12 devstack@n-api.service[106551]: INFO nova.api.openstack.requestlog [None req-5c809357-ece8-47df-97ff-6ec907f7b0a9 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.028200 Sep 08 10:28:38.011263 n-d-850501-12 devstack@n-api.service[106551]: [pid: 106551|app: 0|req: 20/41] 10.222.0.27 () {60 vars in 1210 bytes} [Thu Sep 8 10:28:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:28:38.021619 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi [None req-109f85f5-ae5a-41fb-8279-49da4450183f admin admin] Calling method '>' {{(pid=106550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:38.027313 n-d-850501-12 devstack@n-api.service[106550]: INFO nova.api.openstack.wsgi [None req-109f85f5-ae5a-41fb-8279-49da4450183f admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 08 10:28:38.030604 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi [None req-109f85f5-ae5a-41fb-8279-49da4450183f admin admin] Request method failure captured: Sep 08 10:28:38.030604 n-d-850501-12 devstack@n-api.service[106550]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 08 10:28:38.030604 n-d-850501-12 devstack@n-api.service[106550]: Accept: application/json Sep 08 10:28:38.030604 n-d-850501-12 devstack@n-api.service[106550]: Accept-Encoding: gzip, deflate Sep 08 10:28:38.030604 n-d-850501-12 devstack@n-api.service[106550]: Connection: keep-alive Sep 08 10:28:38.030604 n-d-850501-12 devstack@n-api.service[106550]: Content-Length: 0 Sep 08 10:28:38.030604 n-d-850501-12 devstack@n-api.service[106550]: Host: 10.222.0.27 Sep 08 10:28:38.030604 n-d-850501-12 devstack@n-api.service[106550]: Openstack-Api-Version: compute 2.92 Sep 08 10:28:38.030604 n-d-850501-12 devstack@n-api.service[106550]: Openstack-System-Scope: None Sep 08 10:28:38.030604 n-d-850501-12 devstack@n-api.service[106550]: User-Agent: python-novaclient Sep 08 10:28:38.030604 n-d-850501-12 devstack@n-api.service[106550]: X-Auth-Token: gAAAAABjGcPVfS4oNBt350FRuCbUENPMIn4RXaPIvZAEAOCML5gexRp5p5GYUTZfvLQUE2Y_PRZ-8dTl5pOPP_VxjcGQL5o-M5Yvkl6fFI5L5J6b6-irELsZcSaUJO_dTKb2QcqQlvaEItuFL7alQr6vXYhPCpi09f1DIq_GIDjEMm1pb7Znd6s Sep 08 10:28:38.030604 n-d-850501-12 devstack@n-api.service[106550]: X-Domain-Id: None Sep 08 10:28:38.030604 n-d-850501-12 devstack@n-api.service[106550]: X-Domain-Name: None Sep 08 10:28:38.030604 n-d-850501-12 devstack@n-api.service[106550]: X-Identity-Status: Confirmed Sep 08 10:28:38.030604 n-d-850501-12 devstack@n-api.service[106550]: X-Is-Admin-Project: True Sep 08 10:28:38.030604 n-d-850501-12 devstack@n-api.service[106550]: X-Openstack-Nova-Api-Version: 2.92 Sep 08 10:28:38.030604 n-d-850501-12 devstack@n-api.service[106550]: X-Project-Domain-Id: default Sep 08 10:28:38.030604 n-d-850501-12 devstack@n-api.service[106550]: X-Project-Domain-Name: Default Sep 08 10:28:38.030604 n-d-850501-12 devstack@n-api.service[106550]: X-Project-Id: a583042a7b0e4d04a43898975c17dea5 Sep 08 10:28:38.030604 n-d-850501-12 devstack@n-api.service[106550]: X-Project-Name: admin Sep 08 10:28:38.030604 n-d-850501-12 devstack@n-api.service[106550]: X-Role: reader,admin,member Sep 08 10:28:38.030604 n-d-850501-12 devstack@n-api.service[106550]: X-Roles: reader,admin,member Sep 08 10:28:38.032242 n-d-850501-12 devstack@n-api.service[106550]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a583042a7b0e4d04a43898975c17dea5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a583042a7b0e4d04a43898975c17dea5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a583042a7b0e4d04a43898975c17dea5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a583042a7b0e4d04a43898975c17dea5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:28:38.032242 n-d-850501-12 devstack@n-api.service[106550]: X-Tenant: admin Sep 08 10:28:38.032242 n-d-850501-12 devstack@n-api.service[106550]: X-Tenant-Id: a583042a7b0e4d04a43898975c17dea5 Sep 08 10:28:38.032242 n-d-850501-12 devstack@n-api.service[106550]: X-Tenant-Name: admin Sep 08 10:28:38.032242 n-d-850501-12 devstack@n-api.service[106550]: X-User: admin Sep 08 10:28:38.032242 n-d-850501-12 devstack@n-api.service[106550]: X-User-Domain-Id: default Sep 08 10:28:38.032242 n-d-850501-12 devstack@n-api.service[106550]: X-User-Domain-Name: Default Sep 08 10:28:38.032242 n-d-850501-12 devstack@n-api.service[106550]: X-User-Id: 79e9dd741e6a4f668898d6e2537cb2e9 Sep 08 10:28:38.032242 n-d-850501-12 devstack@n-api.service[106550]: X-User-Name: admin Sep 08 10:28:38.032242 n-d-850501-12 devstack@n-api.service[106550]: method: > Sep 08 10:28:38.032242 n-d-850501-12 devstack@n-api.service[106550]: exception: Flavor 42 could not be found. Sep 08 10:28:38.032242 n-d-850501-12 devstack@n-api.service[106550]: action_args: {'id': '42'} Sep 08 10:28:38.032242 n-d-850501-12 devstack@n-api.service[106550]: {{(pid=106550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:28:38.032242 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:38.033456 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 08 10:28:38.033456 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 08 10:28:38.033456 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 08 10:28:38.033456 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 08 10:28:38.033456 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 10:28:38.033456 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 10:28:38.033456 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 08 10:28:38.033456 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 08 10:28:38.033456 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 08 10:28:38.033456 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:28:38.033456 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 08 10:28:38.033456 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 08 10:28:38.033456 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 08 10:28:38.033456 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi Sep 08 10:28:38.033456 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:28:38.033456 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi Sep 08 10:28:38.033456 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:38.033456 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:28:38.033456 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:28:38.035200 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:28:38.035200 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:28:38.035200 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:28:38.035200 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:28:38.035200 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 08 10:28:38.035200 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:28:38.035200 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 08 10:28:38.035200 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi Sep 08 10:28:38.035200 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:28:38.035200 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi Sep 08 10:28:38.035200 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:38.035200 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:28:38.035200 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:28:38.035200 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:28:38.035200 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:28:38.035200 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 08 10:28:38.035200 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi Sep 08 10:28:38.035200 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi [None req-109f85f5-ae5a-41fb-8279-49da4450183f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:28:38.036483 n-d-850501-12 devstack@n-api.service[106550]: INFO nova.api.openstack.requestlog [None req-109f85f5-ae5a-41fb-8279-49da4450183f admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014984 Sep 08 10:28:38.036483 n-d-850501-12 devstack@n-api.service[106550]: [pid: 106550|app: 0|req: 22/42] 10.222.0.27 () {60 vars in 1190 bytes} [Thu Sep 8 10:28:38 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 08 10:28:39.248751 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi [None req-5c809357-ece8-47df-97ff-6ec907f7b0a9 admin admin] Calling method '>' {{(pid=106551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:39.249798 n-d-850501-12 devstack@n-api.service[106551]: INFO nova.api.openstack.requestlog [None req-5c809357-ece8-47df-97ff-6ec907f7b0a9 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Sep 08 10:28:39.250449 n-d-850501-12 devstack@n-api.service[106551]: [pid: 106551|app: 0|req: 21/43] 10.222.0.27 () {56 vars in 1074 bytes} [Thu Sep 8 10:28:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:28:39.787362 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi [None req-0fc87e22-e5f8-483a-8e8a-9cd284d41027 admin admin] Calling method '>' {{(pid=106550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:39.792354 n-d-850501-12 devstack@n-api.service[106550]: INFO nova.api.openstack.wsgi [None req-0fc87e22-e5f8-483a-8e8a-9cd284d41027 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 08 10:28:39.793925 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi [None req-0fc87e22-e5f8-483a-8e8a-9cd284d41027 admin admin] Request method failure captured: Sep 08 10:28:39.793925 n-d-850501-12 devstack@n-api.service[106550]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 08 10:28:39.793925 n-d-850501-12 devstack@n-api.service[106550]: Accept: application/json Sep 08 10:28:39.793925 n-d-850501-12 devstack@n-api.service[106550]: Accept-Encoding: gzip, deflate Sep 08 10:28:39.793925 n-d-850501-12 devstack@n-api.service[106550]: Connection: keep-alive Sep 08 10:28:39.793925 n-d-850501-12 devstack@n-api.service[106550]: Content-Length: 0 Sep 08 10:28:39.793925 n-d-850501-12 devstack@n-api.service[106550]: Host: 10.222.0.27 Sep 08 10:28:39.793925 n-d-850501-12 devstack@n-api.service[106550]: Openstack-Api-Version: compute 2.92 Sep 08 10:28:39.793925 n-d-850501-12 devstack@n-api.service[106550]: Openstack-System-Scope: None Sep 08 10:28:39.793925 n-d-850501-12 devstack@n-api.service[106550]: User-Agent: python-novaclient Sep 08 10:28:39.793925 n-d-850501-12 devstack@n-api.service[106550]: X-Auth-Token: gAAAAABjGcPX4xqCPi2KbVm3Y_J8ZV4SEmKb8U2JPBoppn3cvQwefA6WsNwYYFe9nZq8f4r5lIvzPfxENauvk3YuOvzm9sF-Ev-C1Dxb8P5Vx1b-aQ-U7QHJTMNQRePiSNxHkZjcnXxwbOaqCAstGNfa9MQnP4aRvSn9FPF7I1Q-aFIsKheZp_8 Sep 08 10:28:39.793925 n-d-850501-12 devstack@n-api.service[106550]: X-Domain-Id: None Sep 08 10:28:39.793925 n-d-850501-12 devstack@n-api.service[106550]: X-Domain-Name: None Sep 08 10:28:39.793925 n-d-850501-12 devstack@n-api.service[106550]: X-Identity-Status: Confirmed Sep 08 10:28:39.793925 n-d-850501-12 devstack@n-api.service[106550]: X-Is-Admin-Project: True Sep 08 10:28:39.793925 n-d-850501-12 devstack@n-api.service[106550]: X-Openstack-Nova-Api-Version: 2.92 Sep 08 10:28:39.793925 n-d-850501-12 devstack@n-api.service[106550]: X-Project-Domain-Id: default Sep 08 10:28:39.793925 n-d-850501-12 devstack@n-api.service[106550]: X-Project-Domain-Name: Default Sep 08 10:28:39.793925 n-d-850501-12 devstack@n-api.service[106550]: X-Project-Id: a583042a7b0e4d04a43898975c17dea5 Sep 08 10:28:39.793925 n-d-850501-12 devstack@n-api.service[106550]: X-Project-Name: admin Sep 08 10:28:39.793925 n-d-850501-12 devstack@n-api.service[106550]: X-Role: reader,admin,member Sep 08 10:28:39.793925 n-d-850501-12 devstack@n-api.service[106550]: X-Roles: reader,admin,member Sep 08 10:28:39.795496 n-d-850501-12 devstack@n-api.service[106550]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a583042a7b0e4d04a43898975c17dea5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a583042a7b0e4d04a43898975c17dea5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a583042a7b0e4d04a43898975c17dea5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a583042a7b0e4d04a43898975c17dea5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:28:39.795496 n-d-850501-12 devstack@n-api.service[106550]: X-Tenant: admin Sep 08 10:28:39.795496 n-d-850501-12 devstack@n-api.service[106550]: X-Tenant-Id: a583042a7b0e4d04a43898975c17dea5 Sep 08 10:28:39.795496 n-d-850501-12 devstack@n-api.service[106550]: X-Tenant-Name: admin Sep 08 10:28:39.795496 n-d-850501-12 devstack@n-api.service[106550]: X-User: admin Sep 08 10:28:39.795496 n-d-850501-12 devstack@n-api.service[106550]: X-User-Domain-Id: default Sep 08 10:28:39.795496 n-d-850501-12 devstack@n-api.service[106550]: X-User-Domain-Name: Default Sep 08 10:28:39.795496 n-d-850501-12 devstack@n-api.service[106550]: X-User-Id: 79e9dd741e6a4f668898d6e2537cb2e9 Sep 08 10:28:39.795496 n-d-850501-12 devstack@n-api.service[106550]: X-User-Name: admin Sep 08 10:28:39.795496 n-d-850501-12 devstack@n-api.service[106550]: method: > Sep 08 10:28:39.795496 n-d-850501-12 devstack@n-api.service[106550]: exception: Flavor 84 could not be found. Sep 08 10:28:39.795496 n-d-850501-12 devstack@n-api.service[106550]: action_args: {'id': '84'} Sep 08 10:28:39.795496 n-d-850501-12 devstack@n-api.service[106550]: {{(pid=106550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:28:39.795496 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:39.796492 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 08 10:28:39.796492 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 08 10:28:39.796492 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 08 10:28:39.796492 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 08 10:28:39.796492 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 10:28:39.796492 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 10:28:39.796492 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 08 10:28:39.796492 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 08 10:28:39.796492 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 08 10:28:39.796492 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:28:39.796492 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 08 10:28:39.796492 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 08 10:28:39.796492 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 08 10:28:39.796492 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi Sep 08 10:28:39.796492 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:28:39.796492 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi Sep 08 10:28:39.796492 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:39.796492 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:28:39.796492 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:28:39.797955 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:28:39.797955 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:28:39.797955 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:28:39.797955 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:28:39.797955 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 08 10:28:39.797955 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:28:39.797955 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 08 10:28:39.797955 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi Sep 08 10:28:39.797955 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:28:39.797955 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi Sep 08 10:28:39.797955 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:39.797955 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:28:39.797955 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:28:39.797955 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:28:39.797955 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:28:39.797955 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 08 10:28:39.797955 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi Sep 08 10:28:39.797955 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi [None req-0fc87e22-e5f8-483a-8e8a-9cd284d41027 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:28:39.800225 n-d-850501-12 devstack@n-api.service[106550]: INFO nova.api.openstack.requestlog [None req-0fc87e22-e5f8-483a-8e8a-9cd284d41027 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.408349 Sep 08 10:28:39.800225 n-d-850501-12 devstack@n-api.service[106550]: [pid: 106550|app: 0|req: 23/44] 10.222.0.27 () {60 vars in 1190 bytes} [Thu Sep 8 10:28:39 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 410 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 08 10:28:39.806005 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi [None req-7df3235c-7a19-4259-a65c-b771adba7b4b admin admin] Calling method '>' {{(pid=106551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:39.821471 n-d-850501-12 devstack@n-api.service[106551]: INFO nova.api.openstack.requestlog [None req-7df3235c-7a19-4259-a65c-b771adba7b4b admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019053 Sep 08 10:28:39.822013 n-d-850501-12 devstack@n-api.service[106551]: [pid: 106551|app: 0|req: 22/45] 10.222.0.27 () {60 vars in 1210 bytes} [Thu Sep 8 10:28:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:28:39.831643 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi [None req-15344afc-51ec-4c05-8868-3ea67e4e7c07 admin admin] Calling method '>' {{(pid=106550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:39.849444 n-d-850501-12 devstack@n-api.service[106550]: INFO nova.api.openstack.requestlog [None req-15344afc-51ec-4c05-8868-3ea67e4e7c07 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.021395 Sep 08 10:28:39.849969 n-d-850501-12 devstack@n-api.service[106550]: [pid: 106550|app: 0|req: 24/46] 10.222.0.27 () {60 vars in 1210 bytes} [Thu Sep 8 10:28:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:28:39.859165 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi [None req-4abde66d-5385-47ed-b479-dc21e1fe0268 admin admin] Calling method '>' {{(pid=106551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:39.865245 n-d-850501-12 devstack@n-api.service[106551]: INFO nova.api.openstack.wsgi [None req-4abde66d-5385-47ed-b479-dc21e1fe0268 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 08 10:28:39.866757 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi [None req-4abde66d-5385-47ed-b479-dc21e1fe0268 admin admin] Request method failure captured: Sep 08 10:28:39.866757 n-d-850501-12 devstack@n-api.service[106551]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 08 10:28:39.866757 n-d-850501-12 devstack@n-api.service[106551]: Accept: application/json Sep 08 10:28:39.866757 n-d-850501-12 devstack@n-api.service[106551]: Accept-Encoding: gzip, deflate Sep 08 10:28:39.866757 n-d-850501-12 devstack@n-api.service[106551]: Connection: keep-alive Sep 08 10:28:39.866757 n-d-850501-12 devstack@n-api.service[106551]: Content-Length: 0 Sep 08 10:28:39.866757 n-d-850501-12 devstack@n-api.service[106551]: Host: 10.222.0.27 Sep 08 10:28:39.866757 n-d-850501-12 devstack@n-api.service[106551]: Openstack-Api-Version: compute 2.92 Sep 08 10:28:39.866757 n-d-850501-12 devstack@n-api.service[106551]: Openstack-System-Scope: None Sep 08 10:28:39.866757 n-d-850501-12 devstack@n-api.service[106551]: User-Agent: python-novaclient Sep 08 10:28:39.866757 n-d-850501-12 devstack@n-api.service[106551]: X-Auth-Token: gAAAAABjGcPX4xqCPi2KbVm3Y_J8ZV4SEmKb8U2JPBoppn3cvQwefA6WsNwYYFe9nZq8f4r5lIvzPfxENauvk3YuOvzm9sF-Ev-C1Dxb8P5Vx1b-aQ-U7QHJTMNQRePiSNxHkZjcnXxwbOaqCAstGNfa9MQnP4aRvSn9FPF7I1Q-aFIsKheZp_8 Sep 08 10:28:39.866757 n-d-850501-12 devstack@n-api.service[106551]: X-Domain-Id: None Sep 08 10:28:39.866757 n-d-850501-12 devstack@n-api.service[106551]: X-Domain-Name: None Sep 08 10:28:39.866757 n-d-850501-12 devstack@n-api.service[106551]: X-Identity-Status: Confirmed Sep 08 10:28:39.866757 n-d-850501-12 devstack@n-api.service[106551]: X-Is-Admin-Project: True Sep 08 10:28:39.866757 n-d-850501-12 devstack@n-api.service[106551]: X-Openstack-Nova-Api-Version: 2.92 Sep 08 10:28:39.866757 n-d-850501-12 devstack@n-api.service[106551]: X-Project-Domain-Id: default Sep 08 10:28:39.866757 n-d-850501-12 devstack@n-api.service[106551]: X-Project-Domain-Name: Default Sep 08 10:28:39.866757 n-d-850501-12 devstack@n-api.service[106551]: X-Project-Id: a583042a7b0e4d04a43898975c17dea5 Sep 08 10:28:39.866757 n-d-850501-12 devstack@n-api.service[106551]: X-Project-Name: admin Sep 08 10:28:39.866757 n-d-850501-12 devstack@n-api.service[106551]: X-Role: reader,admin,member Sep 08 10:28:39.866757 n-d-850501-12 devstack@n-api.service[106551]: X-Roles: reader,admin,member Sep 08 10:28:39.868267 n-d-850501-12 devstack@n-api.service[106551]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a583042a7b0e4d04a43898975c17dea5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a583042a7b0e4d04a43898975c17dea5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a583042a7b0e4d04a43898975c17dea5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a583042a7b0e4d04a43898975c17dea5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:28:39.868267 n-d-850501-12 devstack@n-api.service[106551]: X-Tenant: admin Sep 08 10:28:39.868267 n-d-850501-12 devstack@n-api.service[106551]: X-Tenant-Id: a583042a7b0e4d04a43898975c17dea5 Sep 08 10:28:39.868267 n-d-850501-12 devstack@n-api.service[106551]: X-Tenant-Name: admin Sep 08 10:28:39.868267 n-d-850501-12 devstack@n-api.service[106551]: X-User: admin Sep 08 10:28:39.868267 n-d-850501-12 devstack@n-api.service[106551]: X-User-Domain-Id: default Sep 08 10:28:39.868267 n-d-850501-12 devstack@n-api.service[106551]: X-User-Domain-Name: Default Sep 08 10:28:39.868267 n-d-850501-12 devstack@n-api.service[106551]: X-User-Id: 79e9dd741e6a4f668898d6e2537cb2e9 Sep 08 10:28:39.868267 n-d-850501-12 devstack@n-api.service[106551]: X-User-Name: admin Sep 08 10:28:39.868267 n-d-850501-12 devstack@n-api.service[106551]: method: > Sep 08 10:28:39.868267 n-d-850501-12 devstack@n-api.service[106551]: exception: Flavor 84 could not be found. Sep 08 10:28:39.868267 n-d-850501-12 devstack@n-api.service[106551]: action_args: {'id': '84'} Sep 08 10:28:39.868267 n-d-850501-12 devstack@n-api.service[106551]: {{(pid=106551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:28:39.868267 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:39.869170 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 08 10:28:39.869170 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 08 10:28:39.869170 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 08 10:28:39.869170 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 08 10:28:39.869170 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 10:28:39.869170 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 10:28:39.869170 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 08 10:28:39.869170 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 08 10:28:39.869170 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 08 10:28:39.869170 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:28:39.869170 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 08 10:28:39.869170 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 08 10:28:39.869170 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 08 10:28:39.869170 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi Sep 08 10:28:39.869170 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:28:39.869170 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi Sep 08 10:28:39.869170 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:39.869170 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:28:39.869170 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:28:39.870667 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:28:39.870667 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:28:39.870667 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:28:39.870667 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:28:39.870667 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 08 10:28:39.870667 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:28:39.870667 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 08 10:28:39.870667 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi Sep 08 10:28:39.870667 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:28:39.870667 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi Sep 08 10:28:39.870667 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:39.870667 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:28:39.870667 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:28:39.870667 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:28:39.870667 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:28:39.870667 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 08 10:28:39.870667 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi Sep 08 10:28:39.870667 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi [None req-4abde66d-5385-47ed-b479-dc21e1fe0268 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106551) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:28:39.871929 n-d-850501-12 devstack@n-api.service[106551]: INFO nova.api.openstack.requestlog [None req-4abde66d-5385-47ed-b479-dc21e1fe0268 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.012526 Sep 08 10:28:39.871929 n-d-850501-12 devstack@n-api.service[106551]: [pid: 106551|app: 0|req: 23/47] 10.222.0.27 () {60 vars in 1190 bytes} [Thu Sep 8 10:28:39 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 08 10:28:41.100904 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi [None req-15344afc-51ec-4c05-8868-3ea67e4e7c07 admin admin] Calling method '>' {{(pid=106550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:41.101950 n-d-850501-12 devstack@n-api.service[106550]: INFO nova.api.openstack.requestlog [None req-15344afc-51ec-4c05-8868-3ea67e4e7c07 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Sep 08 10:28:41.102345 n-d-850501-12 devstack@n-api.service[106550]: [pid: 106550|app: 0|req: 25/48] 10.222.0.27 () {56 vars in 1074 bytes} [Thu Sep 8 10:28:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:28:41.630346 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi [None req-7b8f096f-879e-49d6-99ac-548b613d61e5 admin admin] Calling method '>' {{(pid=106551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:41.636222 n-d-850501-12 devstack@n-api.service[106551]: INFO nova.api.openstack.wsgi [None req-7b8f096f-879e-49d6-99ac-548b613d61e5 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 08 10:28:41.637780 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi [None req-7b8f096f-879e-49d6-99ac-548b613d61e5 admin admin] Request method failure captured: Sep 08 10:28:41.637780 n-d-850501-12 devstack@n-api.service[106551]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 08 10:28:41.637780 n-d-850501-12 devstack@n-api.service[106551]: Accept: application/json Sep 08 10:28:41.637780 n-d-850501-12 devstack@n-api.service[106551]: Accept-Encoding: gzip, deflate Sep 08 10:28:41.637780 n-d-850501-12 devstack@n-api.service[106551]: Connection: keep-alive Sep 08 10:28:41.637780 n-d-850501-12 devstack@n-api.service[106551]: Content-Length: 0 Sep 08 10:28:41.637780 n-d-850501-12 devstack@n-api.service[106551]: Host: 10.222.0.27 Sep 08 10:28:41.637780 n-d-850501-12 devstack@n-api.service[106551]: Openstack-Api-Version: compute 2.92 Sep 08 10:28:41.637780 n-d-850501-12 devstack@n-api.service[106551]: Openstack-System-Scope: None Sep 08 10:28:41.637780 n-d-850501-12 devstack@n-api.service[106551]: User-Agent: python-novaclient Sep 08 10:28:41.637780 n-d-850501-12 devstack@n-api.service[106551]: X-Auth-Token: gAAAAABjGcPYqHfFFLVeP63XCXvc5RNFbAOgbVMnQe4iFnMupfDHZ-SXUmtYVayu_wwygngIEG59wI9emL2dGOd8jxZ79ehpbg2EQaRHR3qPMj_bBcXk4mOwUWrUMlSmzyj5JijNYD70mvMHg145ZmA4JGOlZsGvy2gixL7UmcpRFr2v56ZLylU Sep 08 10:28:41.637780 n-d-850501-12 devstack@n-api.service[106551]: X-Domain-Id: None Sep 08 10:28:41.637780 n-d-850501-12 devstack@n-api.service[106551]: X-Domain-Name: None Sep 08 10:28:41.637780 n-d-850501-12 devstack@n-api.service[106551]: X-Identity-Status: Confirmed Sep 08 10:28:41.637780 n-d-850501-12 devstack@n-api.service[106551]: X-Is-Admin-Project: True Sep 08 10:28:41.637780 n-d-850501-12 devstack@n-api.service[106551]: X-Openstack-Nova-Api-Version: 2.92 Sep 08 10:28:41.637780 n-d-850501-12 devstack@n-api.service[106551]: X-Project-Domain-Id: default Sep 08 10:28:41.637780 n-d-850501-12 devstack@n-api.service[106551]: X-Project-Domain-Name: Default Sep 08 10:28:41.637780 n-d-850501-12 devstack@n-api.service[106551]: X-Project-Id: a583042a7b0e4d04a43898975c17dea5 Sep 08 10:28:41.637780 n-d-850501-12 devstack@n-api.service[106551]: X-Project-Name: admin Sep 08 10:28:41.637780 n-d-850501-12 devstack@n-api.service[106551]: X-Role: reader,admin,member Sep 08 10:28:41.637780 n-d-850501-12 devstack@n-api.service[106551]: X-Roles: reader,admin,member Sep 08 10:28:41.639134 n-d-850501-12 devstack@n-api.service[106551]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a583042a7b0e4d04a43898975c17dea5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a583042a7b0e4d04a43898975c17dea5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a583042a7b0e4d04a43898975c17dea5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a583042a7b0e4d04a43898975c17dea5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:28:41.639134 n-d-850501-12 devstack@n-api.service[106551]: X-Tenant: admin Sep 08 10:28:41.639134 n-d-850501-12 devstack@n-api.service[106551]: X-Tenant-Id: a583042a7b0e4d04a43898975c17dea5 Sep 08 10:28:41.639134 n-d-850501-12 devstack@n-api.service[106551]: X-Tenant-Name: admin Sep 08 10:28:41.639134 n-d-850501-12 devstack@n-api.service[106551]: X-User: admin Sep 08 10:28:41.639134 n-d-850501-12 devstack@n-api.service[106551]: X-User-Domain-Id: default Sep 08 10:28:41.639134 n-d-850501-12 devstack@n-api.service[106551]: X-User-Domain-Name: Default Sep 08 10:28:41.639134 n-d-850501-12 devstack@n-api.service[106551]: X-User-Id: 79e9dd741e6a4f668898d6e2537cb2e9 Sep 08 10:28:41.639134 n-d-850501-12 devstack@n-api.service[106551]: X-User-Name: admin Sep 08 10:28:41.639134 n-d-850501-12 devstack@n-api.service[106551]: method: > Sep 08 10:28:41.639134 n-d-850501-12 devstack@n-api.service[106551]: exception: Flavor 451 could not be found. Sep 08 10:28:41.639134 n-d-850501-12 devstack@n-api.service[106551]: action_args: {'id': '451'} Sep 08 10:28:41.639134 n-d-850501-12 devstack@n-api.service[106551]: {{(pid=106551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:28:41.639134 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:41.640010 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 08 10:28:41.640010 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 08 10:28:41.640010 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 08 10:28:41.640010 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 08 10:28:41.640010 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 10:28:41.640010 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 10:28:41.640010 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 08 10:28:41.640010 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 08 10:28:41.640010 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 08 10:28:41.640010 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:28:41.640010 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 08 10:28:41.640010 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 08 10:28:41.640010 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 08 10:28:41.640010 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi Sep 08 10:28:41.640010 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:28:41.640010 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi Sep 08 10:28:41.640010 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:41.640010 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:28:41.640010 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:28:41.641420 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:28:41.641420 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:28:41.641420 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:28:41.641420 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:28:41.641420 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 08 10:28:41.641420 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:28:41.641420 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 08 10:28:41.641420 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi Sep 08 10:28:41.641420 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:28:41.641420 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi Sep 08 10:28:41.641420 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:41.641420 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:28:41.641420 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:28:41.641420 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:28:41.641420 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:28:41.641420 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 08 10:28:41.641420 n-d-850501-12 devstack@n-api.service[106551]: ERROR nova.api.openstack.wsgi Sep 08 10:28:41.641420 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi [None req-7b8f096f-879e-49d6-99ac-548b613d61e5 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106551) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:28:41.642683 n-d-850501-12 devstack@n-api.service[106551]: INFO nova.api.openstack.requestlog [None req-7b8f096f-879e-49d6-99ac-548b613d61e5 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.400020 Sep 08 10:28:41.642683 n-d-850501-12 devstack@n-api.service[106551]: [pid: 106551|app: 0|req: 24/49] 10.222.0.27 () {60 vars in 1193 bytes} [Thu Sep 8 10:28:41 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 401 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 08 10:28:41.648962 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi [None req-8912850e-35a9-4786-9440-a189804405fc admin admin] Calling method '>' {{(pid=106550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:41.664521 n-d-850501-12 devstack@n-api.service[106550]: INFO nova.api.openstack.requestlog [None req-8912850e-35a9-4786-9440-a189804405fc admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019127 Sep 08 10:28:41.665062 n-d-850501-12 devstack@n-api.service[106550]: [pid: 106550|app: 0|req: 26/50] 10.222.0.27 () {60 vars in 1210 bytes} [Thu Sep 8 10:28:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:28:41.675121 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi [None req-5f6c92bd-8456-4ceb-99d0-7760e321ffad admin admin] Calling method '>' {{(pid=106551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:41.690706 n-d-850501-12 devstack@n-api.service[106551]: INFO nova.api.openstack.requestlog [None req-5f6c92bd-8456-4ceb-99d0-7760e321ffad admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019815 Sep 08 10:28:41.691240 n-d-850501-12 devstack@n-api.service[106551]: [pid: 106551|app: 0|req: 25/51] 10.222.0.27 () {60 vars in 1210 bytes} [Thu Sep 8 10:28:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:28:41.700360 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi [None req-5d77d4da-b6cb-4dac-958b-b5c1a33049c3 admin admin] Calling method '>' {{(pid=106550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:41.705477 n-d-850501-12 devstack@n-api.service[106550]: INFO nova.api.openstack.wsgi [None req-5d77d4da-b6cb-4dac-958b-b5c1a33049c3 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 08 10:28:41.706970 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi [None req-5d77d4da-b6cb-4dac-958b-b5c1a33049c3 admin admin] Request method failure captured: Sep 08 10:28:41.706970 n-d-850501-12 devstack@n-api.service[106550]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 08 10:28:41.706970 n-d-850501-12 devstack@n-api.service[106550]: Accept: application/json Sep 08 10:28:41.706970 n-d-850501-12 devstack@n-api.service[106550]: Accept-Encoding: gzip, deflate Sep 08 10:28:41.706970 n-d-850501-12 devstack@n-api.service[106550]: Connection: keep-alive Sep 08 10:28:41.706970 n-d-850501-12 devstack@n-api.service[106550]: Content-Length: 0 Sep 08 10:28:41.706970 n-d-850501-12 devstack@n-api.service[106550]: Host: 10.222.0.27 Sep 08 10:28:41.706970 n-d-850501-12 devstack@n-api.service[106550]: Openstack-Api-Version: compute 2.92 Sep 08 10:28:41.706970 n-d-850501-12 devstack@n-api.service[106550]: Openstack-System-Scope: None Sep 08 10:28:41.706970 n-d-850501-12 devstack@n-api.service[106550]: User-Agent: python-novaclient Sep 08 10:28:41.706970 n-d-850501-12 devstack@n-api.service[106550]: X-Auth-Token: gAAAAABjGcPYqHfFFLVeP63XCXvc5RNFbAOgbVMnQe4iFnMupfDHZ-SXUmtYVayu_wwygngIEG59wI9emL2dGOd8jxZ79ehpbg2EQaRHR3qPMj_bBcXk4mOwUWrUMlSmzyj5JijNYD70mvMHg145ZmA4JGOlZsGvy2gixL7UmcpRFr2v56ZLylU Sep 08 10:28:41.706970 n-d-850501-12 devstack@n-api.service[106550]: X-Domain-Id: None Sep 08 10:28:41.706970 n-d-850501-12 devstack@n-api.service[106550]: X-Domain-Name: None Sep 08 10:28:41.706970 n-d-850501-12 devstack@n-api.service[106550]: X-Identity-Status: Confirmed Sep 08 10:28:41.706970 n-d-850501-12 devstack@n-api.service[106550]: X-Is-Admin-Project: True Sep 08 10:28:41.706970 n-d-850501-12 devstack@n-api.service[106550]: X-Openstack-Nova-Api-Version: 2.92 Sep 08 10:28:41.706970 n-d-850501-12 devstack@n-api.service[106550]: X-Project-Domain-Id: default Sep 08 10:28:41.706970 n-d-850501-12 devstack@n-api.service[106550]: X-Project-Domain-Name: Default Sep 08 10:28:41.706970 n-d-850501-12 devstack@n-api.service[106550]: X-Project-Id: a583042a7b0e4d04a43898975c17dea5 Sep 08 10:28:41.706970 n-d-850501-12 devstack@n-api.service[106550]: X-Project-Name: admin Sep 08 10:28:41.706970 n-d-850501-12 devstack@n-api.service[106550]: X-Role: reader,admin,member Sep 08 10:28:41.706970 n-d-850501-12 devstack@n-api.service[106550]: X-Roles: reader,admin,member Sep 08 10:28:41.708617 n-d-850501-12 devstack@n-api.service[106550]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a583042a7b0e4d04a43898975c17dea5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a583042a7b0e4d04a43898975c17dea5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a583042a7b0e4d04a43898975c17dea5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a583042a7b0e4d04a43898975c17dea5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:28:41.708617 n-d-850501-12 devstack@n-api.service[106550]: X-Tenant: admin Sep 08 10:28:41.708617 n-d-850501-12 devstack@n-api.service[106550]: X-Tenant-Id: a583042a7b0e4d04a43898975c17dea5 Sep 08 10:28:41.708617 n-d-850501-12 devstack@n-api.service[106550]: X-Tenant-Name: admin Sep 08 10:28:41.708617 n-d-850501-12 devstack@n-api.service[106550]: X-User: admin Sep 08 10:28:41.708617 n-d-850501-12 devstack@n-api.service[106550]: X-User-Domain-Id: default Sep 08 10:28:41.708617 n-d-850501-12 devstack@n-api.service[106550]: X-User-Domain-Name: Default Sep 08 10:28:41.708617 n-d-850501-12 devstack@n-api.service[106550]: X-User-Id: 79e9dd741e6a4f668898d6e2537cb2e9 Sep 08 10:28:41.708617 n-d-850501-12 devstack@n-api.service[106550]: X-User-Name: admin Sep 08 10:28:41.708617 n-d-850501-12 devstack@n-api.service[106550]: method: > Sep 08 10:28:41.708617 n-d-850501-12 devstack@n-api.service[106550]: exception: Flavor 451 could not be found. Sep 08 10:28:41.708617 n-d-850501-12 devstack@n-api.service[106550]: action_args: {'id': '451'} Sep 08 10:28:41.708617 n-d-850501-12 devstack@n-api.service[106550]: {{(pid=106550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:28:41.708617 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:41.709697 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 08 10:28:41.709697 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 08 10:28:41.709697 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 08 10:28:41.709697 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 08 10:28:41.709697 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 10:28:41.709697 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 10:28:41.709697 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 08 10:28:41.709697 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 08 10:28:41.709697 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 08 10:28:41.709697 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:28:41.709697 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 08 10:28:41.709697 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 08 10:28:41.709697 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 08 10:28:41.709697 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi Sep 08 10:28:41.709697 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:28:41.709697 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi Sep 08 10:28:41.709697 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:41.709697 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:28:41.709697 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:28:41.711008 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:28:41.711008 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:28:41.711008 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:28:41.711008 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:28:41.711008 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 08 10:28:41.711008 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:28:41.711008 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 08 10:28:41.711008 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi Sep 08 10:28:41.711008 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:28:41.711008 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi Sep 08 10:28:41.711008 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:41.711008 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:28:41.711008 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:28:41.711008 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:28:41.711008 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:28:41.711008 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 08 10:28:41.711008 n-d-850501-12 devstack@n-api.service[106550]: ERROR nova.api.openstack.wsgi Sep 08 10:28:41.711008 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi [None req-5d77d4da-b6cb-4dac-958b-b5c1a33049c3 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:28:41.712305 n-d-850501-12 devstack@n-api.service[106550]: INFO nova.api.openstack.requestlog [None req-5d77d4da-b6cb-4dac-958b-b5c1a33049c3 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011502 Sep 08 10:28:41.712305 n-d-850501-12 devstack@n-api.service[106550]: [pid: 106550|app: 0|req: 27/52] 10.222.0.27 () {60 vars in 1193 bytes} [Thu Sep 8 10:28:41 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 08 10:28:42.956959 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi [None req-5f6c92bd-8456-4ceb-99d0-7760e321ffad admin admin] Calling method '>' {{(pid=106551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:42.958163 n-d-850501-12 devstack@n-api.service[106551]: INFO nova.api.openstack.requestlog [None req-5f6c92bd-8456-4ceb-99d0-7760e321ffad admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001633 Sep 08 10:28:42.958638 n-d-850501-12 devstack@n-api.service[106551]: [pid: 106551|app: 0|req: 26/53] 10.222.0.27 () {56 vars in 1074 bytes} [Thu Sep 8 10:28:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:28:43.481258 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi [None req-12c190dd-a914-4366-96e6-c2e84d71e15b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:28:43.501104 n-d-850501-12 devstack@n-api.service[106550]: INFO nova.api.openstack.requestlog [None req-12c190dd-a914-4366-96e6-c2e84d71e15b admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.403621 Sep 08 10:28:43.501641 n-d-850501-12 devstack@n-api.service[106550]: [pid: 106550|app: 0|req: 28/54] 10.222.0.27 () {64 vars in 1235 bytes} [Thu Sep 8 10:28:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:28:44.722417 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi [None req-5f6c92bd-8456-4ceb-99d0-7760e321ffad admin admin] Calling method '>' {{(pid=106551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:44.723429 n-d-850501-12 devstack@n-api.service[106551]: INFO nova.api.openstack.requestlog [None req-5f6c92bd-8456-4ceb-99d0-7760e321ffad admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Sep 08 10:28:44.723827 n-d-850501-12 devstack@n-api.service[106551]: [pid: 106551|app: 0|req: 27/55] 10.222.0.27 () {56 vars in 1074 bytes} [Thu Sep 8 10:28:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:28:45.249536 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi [None req-39e348d3-2adb-4a9d-b322-42ef674fc0fd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:28:45.268451 n-d-850501-12 devstack@n-api.service[106550]: INFO nova.api.openstack.requestlog [None req-39e348d3-2adb-4a9d-b322-42ef674fc0fd admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.407942 Sep 08 10:28:45.268991 n-d-850501-12 devstack@n-api.service[106550]: [pid: 106550|app: 0|req: 29/56] 10.222.0.27 () {64 vars in 1235 bytes} [Thu Sep 8 10:28:44 2022] POST /compute/v2.1/flavors => generated 405 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:28:46.487969 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi [None req-5f6c92bd-8456-4ceb-99d0-7760e321ffad admin admin] Calling method '>' {{(pid=106551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:46.489047 n-d-850501-12 devstack@n-api.service[106551]: INFO nova.api.openstack.requestlog [None req-5f6c92bd-8456-4ceb-99d0-7760e321ffad admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001770 Sep 08 10:28:46.489442 n-d-850501-12 devstack@n-api.service[106551]: [pid: 106551|app: 0|req: 28/57] 10.222.0.27 () {56 vars in 1074 bytes} [Thu Sep 8 10:28:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:28:47.018490 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi [None req-6e350af0-d153-42d8-bfa3-0b1c879f4b8b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:28:47.039208 n-d-850501-12 devstack@n-api.service[106550]: INFO nova.api.openstack.requestlog [None req-6e350af0-d153-42d8-bfa3-0b1c879f4b8b admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.407099 Sep 08 10:28:47.039756 n-d-850501-12 devstack@n-api.service[106550]: [pid: 106550|app: 0|req: 30/58] 10.222.0.27 () {64 vars in 1235 bytes} [Thu Sep 8 10:28:46 2022] POST /compute/v2.1/flavors => generated 407 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:28:48.253158 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi [None req-5f6c92bd-8456-4ceb-99d0-7760e321ffad admin admin] Calling method '>' {{(pid=106551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:48.254165 n-d-850501-12 devstack@n-api.service[106551]: INFO nova.api.openstack.requestlog [None req-5f6c92bd-8456-4ceb-99d0-7760e321ffad admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Sep 08 10:28:48.254553 n-d-850501-12 devstack@n-api.service[106551]: [pid: 106551|app: 0|req: 29/59] 10.222.0.27 () {56 vars in 1074 bytes} [Thu Sep 8 10:28:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:28:48.790789 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi [None req-3ba569da-c808-4a50-a594-42a9d0b555b4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:28:48.809602 n-d-850501-12 devstack@n-api.service[106550]: INFO nova.api.openstack.requestlog [None req-3ba569da-c808-4a50-a594-42a9d0b555b4 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.418360 Sep 08 10:28:48.810147 n-d-850501-12 devstack@n-api.service[106550]: [pid: 106550|app: 0|req: 31/60] 10.222.0.27 () {64 vars in 1235 bytes} [Thu Sep 8 10:28:48 2022] POST /compute/v2.1/flavors => generated 409 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:28:50.027522 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi [None req-5f6c92bd-8456-4ceb-99d0-7760e321ffad admin admin] Calling method '>' {{(pid=106551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:50.028526 n-d-850501-12 devstack@n-api.service[106551]: INFO nova.api.openstack.requestlog [None req-5f6c92bd-8456-4ceb-99d0-7760e321ffad admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Sep 08 10:28:50.029068 n-d-850501-12 devstack@n-api.service[106551]: [pid: 106551|app: 0|req: 30/61] 10.222.0.27 () {56 vars in 1074 bytes} [Thu Sep 8 10:28:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:28:50.550936 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi [None req-ddf8f050-b1c5-4f10-8c08-7745ccb8666d admin admin] Calling method '>' {{(pid=106550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:50.571453 n-d-850501-12 devstack@n-api.service[106550]: INFO nova.api.openstack.requestlog [None req-ddf8f050-b1c5-4f10-8c08-7745ccb8666d admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.403226 Sep 08 10:28:50.571997 n-d-850501-12 devstack@n-api.service[106550]: [pid: 106550|app: 0|req: 32/62] 10.222.0.27 () {60 vars in 1202 bytes} [Thu Sep 8 10:28:50 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:29:47.851332 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi [None req-5f6c92bd-8456-4ceb-99d0-7760e321ffad admin admin] Calling method '>' {{(pid=106551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:47.852266 n-d-850501-12 devstack@n-api.service[106551]: INFO nova.api.openstack.requestlog [None req-5f6c92bd-8456-4ceb-99d0-7760e321ffad admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Sep 08 10:29:47.852673 n-d-850501-12 devstack@n-api.service[106551]: [pid: 106551|app: 0|req: 31/63] 10.222.0.27 () {54 vars in 931 bytes} [Thu Sep 8 10:29:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:29:47.863928 n-d-850501-12 devstack@n-api.service[106550]: DEBUG dbcounter [-] [106550] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=106550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:29:48.371235 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi [None req-ec6bb640-4303-4cc1-b496-e25ce8b5cafc admin admin] Calling method '>' {{(pid=106550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:48.393321 n-d-850501-12 devstack@n-api.service[106550]: INFO nova.api.openstack.requestlog [None req-ec6bb640-4303-4cc1-b496-e25ce8b5cafc admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.533722 Sep 08 10:29:48.393796 n-d-850501-12 devstack@n-api.service[106550]: [pid: 106550|app: 0|req: 33/64] 10.222.0.27 () {60 vars in 1292 bytes} [Thu Sep 8 10:29:47 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:29:48.414692 n-d-850501-12 devstack@n-api.service[106551]: DEBUG dbcounter [-] [106551] Writing DB stats nova_api:SELECT=14 {{(pid=106551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:29:48.418465 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi [None req-9f10ef1f-5714-48e2-ab8c-b4bd269205d9 admin admin] Calling method '>' {{(pid=106551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:48.426266 n-d-850501-12 devstack@n-api.service[106551]: INFO nova.api.openstack.requestlog [None req-9f10ef1f-5714-48e2-ab8c-b4bd269205d9 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013016 Sep 08 10:29:48.426798 n-d-850501-12 devstack@n-api.service[106551]: [pid: 106551|app: 0|req: 32/65] 10.222.0.27 () {60 vars in 1283 bytes} [Thu Sep 8 10:29:48 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:48.439048 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi [None req-90250134-1c04-47b2-8104-ca783105a55d admin admin] Calling method '>' {{(pid=106550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:48.446525 n-d-850501-12 devstack@n-api.service[106550]: INFO nova.api.openstack.requestlog [None req-90250134-1c04-47b2-8104-ca783105a55d admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011699 Sep 08 10:29:48.447052 n-d-850501-12 devstack@n-api.service[106550]: [pid: 106550|app: 0|req: 34/66] 10.222.0.27 () {60 vars in 1286 bytes} [Thu Sep 8 10:29:48 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:48.459224 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi [None req-7a8a5ecd-6fcc-4b0d-9c7f-550d948debf3 admin admin] Calling method '>' {{(pid=106551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:48.467074 n-d-850501-12 devstack@n-api.service[106551]: INFO nova.api.openstack.requestlog [None req-7a8a5ecd-6fcc-4b0d-9c7f-550d948debf3 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011249 Sep 08 10:29:48.467814 n-d-850501-12 devstack@n-api.service[106551]: [pid: 106551|app: 0|req: 33/67] 10.222.0.27 () {60 vars in 1286 bytes} [Thu Sep 8 10:29:48 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:48.479922 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi [None req-ad173b8f-e0ae-4e37-b4d5-3e61743fb74a admin admin] Calling method '>' {{(pid=106550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:48.487435 n-d-850501-12 devstack@n-api.service[106550]: INFO nova.api.openstack.requestlog [None req-ad173b8f-e0ae-4e37-b4d5-3e61743fb74a admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011227 Sep 08 10:29:48.487962 n-d-850501-12 devstack@n-api.service[106550]: [pid: 106550|app: 0|req: 35/68] 10.222.0.27 () {60 vars in 1283 bytes} [Thu Sep 8 10:29:48 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:35:05.925342 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi [None req-7a8a5ecd-6fcc-4b0d-9c7f-550d948debf3 admin admin] Calling method '>' {{(pid=106551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:35:05.926405 n-d-850501-12 devstack@n-api.service[106551]: INFO nova.api.openstack.requestlog [None req-7a8a5ecd-6fcc-4b0d-9c7f-550d948debf3 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Sep 08 10:35:05.926793 n-d-850501-12 devstack@n-api.service[106551]: [pid: 106551|app: 0|req: 34/69] 10.222.0.27 () {56 vars in 1074 bytes} [Thu Sep 8 10:35:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:35:06.071519 n-d-850501-12 devstack@n-api.service[106550]: DEBUG dbcounter [-] [106550] Writing DB stats nova_api:SELECT=6 {{(pid=106550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:35:06.216952 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi [None req-ba070387-b97b-47d1-b1ff-cc540d3151be admin admin] Calling method '>' {{(pid=106550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:35:06.221673 n-d-850501-12 devstack@n-api.service[106550]: DEBUG oslo_concurrency.lockutils [None req-ba070387-b97b-47d1-b1ff-cc540d3151be admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:06.222156 n-d-850501-12 devstack@n-api.service[106550]: DEBUG oslo_concurrency.lockutils [None req-ba070387-b97b-47d1-b1ff-cc540d3151be admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:06.222589 n-d-850501-12 devstack@n-api.service[106550]: DEBUG oslo_concurrency.lockutils [None req-ba070387-b97b-47d1-b1ff-cc540d3151be admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:06.223313 n-d-850501-12 devstack@n-api.service[106550]: DEBUG oslo_concurrency.lockutils [None req-ba070387-b97b-47d1-b1ff-cc540d3151be admin admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:06.223779 n-d-850501-12 devstack@n-api.service[106550]: DEBUG oslo_concurrency.lockutils [None req-ba070387-b97b-47d1-b1ff-cc540d3151be admin admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:06.224191 n-d-850501-12 devstack@n-api.service[106550]: DEBUG oslo_concurrency.lockutils [None req-ba070387-b97b-47d1-b1ff-cc540d3151be admin admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:06.264509 n-d-850501-12 devstack@n-api.service[106550]: INFO nova.api.openstack.requestlog [None req-ba070387-b97b-47d1-b1ff-cc540d3151be admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.92 time: 0.194698 Sep 08 10:35:06.265090 n-d-850501-12 devstack@n-api.service[106550]: [pid: 106550|app: 0|req: 36/70] 10.222.0.27 () {60 vars in 1193 bytes} [Thu Sep 8 10:35:06 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:35:07.365634 n-d-850501-12 devstack@n-api.service[106551]: DEBUG nova.api.openstack.wsgi [None req-7a8a5ecd-6fcc-4b0d-9c7f-550d948debf3 admin admin] Calling method '>' {{(pid=106551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:35:07.367254 n-d-850501-12 devstack@n-api.service[106551]: INFO nova.api.openstack.requestlog [None req-7a8a5ecd-6fcc-4b0d-9c7f-550d948debf3 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001743 Sep 08 10:35:07.367896 n-d-850501-12 devstack@n-api.service[106551]: [pid: 106551|app: 0|req: 35/71] 10.222.0.27 () {56 vars in 1074 bytes} [Thu Sep 8 10:35:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:35:07.572699 n-d-850501-12 devstack@n-api.service[106550]: DEBUG nova.api.openstack.wsgi [None req-ccab0ea1-8a82-46c2-9b39-def0e0c60283 admin admin] Calling method '>' {{(pid=106550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:35:07.576780 n-d-850501-12 devstack@n-api.service[106550]: DEBUG oslo_concurrency.lockutils [None req-ccab0ea1-8a82-46c2-9b39-def0e0c60283 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:07.577312 n-d-850501-12 devstack@n-api.service[106550]: DEBUG oslo_concurrency.lockutils [None req-ccab0ea1-8a82-46c2-9b39-def0e0c60283 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:07.577745 n-d-850501-12 devstack@n-api.service[106550]: DEBUG oslo_concurrency.lockutils [None req-ccab0ea1-8a82-46c2-9b39-def0e0c60283 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:07.578455 n-d-850501-12 devstack@n-api.service[106550]: DEBUG oslo_concurrency.lockutils [None req-ccab0ea1-8a82-46c2-9b39-def0e0c60283 admin admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:07.578898 n-d-850501-12 devstack@n-api.service[106550]: DEBUG oslo_concurrency.lockutils [None req-ccab0ea1-8a82-46c2-9b39-def0e0c60283 admin admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:07.579313 n-d-850501-12 devstack@n-api.service[106550]: DEBUG oslo_concurrency.lockutils [None req-ccab0ea1-8a82-46c2-9b39-def0e0c60283 admin admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:07.601763 n-d-850501-12 devstack@n-api.service[106550]: INFO nova.api.openstack.requestlog [None req-ccab0ea1-8a82-46c2-9b39-def0e0c60283 admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.92 time: 0.081418 Sep 08 10:35:07.602319 n-d-850501-12 devstack@n-api.service[106550]: [pid: 106550|app: 0|req: 37/72] 10.222.0.27 () {60 vars in 1193 bytes} [Thu Sep 8 10:35:07 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:35:53.139710 n-d-850501-12 devstack@n-api.service[106549]: Thu Sep 8 10:35:53 2022 - graceful shutdown triggered... Sep 08 10:35:53.139195 n-d-850501-12 systemd[1]: Stopping Devstack devstack@n-api.service... Sep 08 10:35:53.140705 n-d-850501-12 devstack@n-api.service[106550]: Gracefully killing worker 1 (pid: 106550)... Sep 08 10:35:53.141112 n-d-850501-12 devstack@n-api.service[106551]: Gracefully killing worker 2 (pid: 106551)... Sep 08 10:35:53.296982 n-d-850501-12 devstack@n-api.service[106551]: DEBUG dbcounter [-] [106551] Writing DB stats nova_api:SELECT=4 {{(pid=106551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:35:54.140247 n-d-850501-12 devstack@n-api.service[106549]: worker 1 buried after 1 seconds Sep 08 10:35:54.140247 n-d-850501-12 devstack@n-api.service[106549]: worker 2 buried after 1 seconds Sep 08 10:35:54.140247 n-d-850501-12 devstack@n-api.service[106549]: goodbye to uWSGI. Sep 08 10:35:54.141885 n-d-850501-12 systemd[1]: devstack@n-api.service: Succeeded. Sep 08 10:35:54.142452 n-d-850501-12 systemd[1]: Stopped Devstack devstack@n-api.service. Sep 08 10:35:54.145419 n-d-850501-12 systemd[1]: Starting Devstack devstack@n-api.service... Sep 08 10:35:54.161189 n-d-850501-12 devstack@n-api.service[128843]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 08 10:35:54.177672 n-d-850501-12 devstack@n-api.service[128843]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 8 10:35:54 2022] *** Sep 08 10:35:54.177672 n-d-850501-12 devstack@n-api.service[128843]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 08 10:35:54.177672 n-d-850501-12 devstack@n-api.service[128843]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 08 10:35:54.177672 n-d-850501-12 devstack@n-api.service[128843]: nodename: n-d-850501-12 Sep 08 10:35:54.177672 n-d-850501-12 devstack@n-api.service[128843]: machine: x86_64 Sep 08 10:35:54.177672 n-d-850501-12 devstack@n-api.service[128843]: clock source: unix Sep 08 10:35:54.177672 n-d-850501-12 devstack@n-api.service[128843]: pcre jit disabled Sep 08 10:35:54.177672 n-d-850501-12 devstack@n-api.service[128843]: detected number of CPU cores: 4 Sep 08 10:35:54.177672 n-d-850501-12 devstack@n-api.service[128843]: current working directory: / Sep 08 10:35:54.177672 n-d-850501-12 devstack@n-api.service[128843]: detected binary path: /usr/bin/uwsgi-core Sep 08 10:35:54.177672 n-d-850501-12 devstack@n-api.service[128843]: your processes number limit is 47680 Sep 08 10:35:54.177672 n-d-850501-12 devstack@n-api.service[128843]: your memory page size is 4096 bytes Sep 08 10:35:54.178644 n-d-850501-12 devstack@n-api.service[128843]: detected max file descriptor number: 2048 Sep 08 10:35:54.178644 n-d-850501-12 devstack@n-api.service[128843]: lock engine: pthread robust mutexes Sep 08 10:35:54.178644 n-d-850501-12 devstack@n-api.service[128843]: thunder lock: enabled Sep 08 10:35:54.178644 n-d-850501-12 devstack@n-api.service[128843]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 08 10:35:54.178644 n-d-850501-12 devstack@n-api.service[128843]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 08 10:35:54.219981 n-d-850501-12 devstack@n-api.service[128843]: Python main interpreter initialized at 0x55c04890d9c0 Sep 08 10:35:54.219981 n-d-850501-12 devstack@n-api.service[128843]: python threads support enabled Sep 08 10:35:54.219981 n-d-850501-12 devstack@n-api.service[128843]: your server socket listen backlog is limited to 100 connections Sep 08 10:35:54.219981 n-d-850501-12 devstack@n-api.service[128843]: your mercy for graceful operations on workers is 90 seconds Sep 08 10:35:54.220451 n-d-850501-12 devstack@n-api.service[128843]: mapped 403077 bytes (393 KB) for 2 cores Sep 08 10:35:54.220451 n-d-850501-12 devstack@n-api.service[128843]: *** Operational MODE: preforking *** Sep 08 10:35:54.220683 n-d-850501-12 devstack@n-api.service[128843]: *** uWSGI is running in multiple interpreter mode *** Sep 08 10:35:54.220683 n-d-850501-12 devstack@n-api.service[128843]: spawned uWSGI master process (pid: 128843) Sep 08 10:35:54.220899 n-d-850501-12 systemd[1]: Started Devstack devstack@n-api.service. Sep 08 10:35:54.221501 n-d-850501-12 devstack@n-api.service[128843]: spawned uWSGI worker 1 (pid: 128861, cores: 1) Sep 08 10:35:54.222032 n-d-850501-12 devstack@n-api.service[128843]: spawned uWSGI worker 2 (pid: 128862, cores: 1) Sep 08 10:35:54.231181 n-d-850501-12 devstack@n-api.service[128843]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 08 10:35:54.896375 n-d-850501-12 devstack@n-api.service[128861]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 08 10:35:54.918264 n-d-850501-12 devstack@n-api.service[128862]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 08 10:35:56.099897 n-d-850501-12 devstack@n-api.service[128861]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 10:35:56.099897 n-d-850501-12 devstack@n-api.service[128861]: from cryptography.utils import int_from_bytes Sep 08 10:35:56.100551 n-d-850501-12 devstack@n-api.service[128861]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 10:35:56.100551 n-d-850501-12 devstack@n-api.service[128861]: from cryptography.utils import int_from_bytes Sep 08 10:35:56.126586 n-d-850501-12 devstack@n-api.service[128862]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 10:35:56.126586 n-d-850501-12 devstack@n-api.service[128862]: from cryptography.utils import int_from_bytes Sep 08 10:35:56.127175 n-d-850501-12 devstack@n-api.service[128862]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 10:35:56.127175 n-d-850501-12 devstack@n-api.service[128862]: from cryptography.utils import int_from_bytes Sep 08 10:35:58.557952 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 08 10:35:58.558539 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 08 10:35:58.558749 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 08 10:35:58.559117 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 08 10:35:58.559375 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 08 10:35:58.559765 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.560092 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.560417 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.560839 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.561207 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.561526 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.561860 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.562170 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.562504 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.562765 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.563084 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.563411 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-850501-12 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.563743 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.564052 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.564364 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.564684 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.565011 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.565342 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.565652 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.566152 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.566610 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.566921 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.567364 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.567593 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.567892 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.568201 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.568527 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.568838 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.569204 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.570123 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.570542 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-850501-12 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.570950 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.571280 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.571615 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.572027 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.572345 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.572659 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.572984 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.573338 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.573650 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.573983 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.574305 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.574628 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.574952 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.575258 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.575569 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.575899 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.576205 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.576513 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 08 10:35:58.576960 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.577116 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 08 10:35:58.577224 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.577224 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.577417 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 08 10:35:58.577536 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.577665 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 08 10:35:58.577779 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.577931 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 08 10:35:58.578081 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.578315 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.578452 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.578548 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.578645 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.578801 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.578953 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.579152 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.579310 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.579464 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.579625 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.579758 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.579887 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.580072 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.580233 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.580398 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.580516 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.580678 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.580839 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.581019 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.581184 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.581307 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.581427 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.581622 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.581927 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-850501-12 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.582033 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.582245 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.582351 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.582563 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.582675 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.582873 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.582969 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.583181 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.583276 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.583500 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.583613 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.583809 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.583918 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.584116 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.584222 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.584427 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.584623 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.584755 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.584940 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.585132 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.585296 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.585450 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.585601 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.585751 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.585937 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.586075 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.586250 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.586396 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.586569 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.586712 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.586855 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.587000 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.587152 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.587249 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.587472 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.587577 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.587781 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.587888 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.588117 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.588233 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-850501-12 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.588427 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.588572 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.588734 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.588854 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.589072 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.589183 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.589386 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.589503 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.589695 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.589812 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.590006 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.590126 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.590306 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.590403 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.590617 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.590738 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.590927 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.591046 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.591233 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.591348 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.591538 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.591671 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.591845 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.591959 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.592154 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.592338 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.592463 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.592559 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.592769 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.592873 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.593098 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.593219 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.593408 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.593512 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.593729 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.593832 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.594030 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.594139 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.594279 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.594375 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.594584 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.594682 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.594906 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.595002 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.595224 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.595347 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.595542 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.595641 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.595774 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.595878 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.596027 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.596137 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.596345 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.596449 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.596663 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.596775 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.596968 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.597104 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.597371 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.597467 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.597679 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.597772 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.597985 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.598091 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.598290 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.598384 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.598597 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.598711 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.598900 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.599012 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.599202 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.599316 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.599508 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.599604 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.599816 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.599921 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.600121 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.600225 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.600424 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.600526 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.600750 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.600910 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.601236 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.601383 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.601477 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.601571 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.601671 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.601881 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.601994 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.602220 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.602338 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.602533 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.602632 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.602840 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.602943 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.603153 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.603248 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.603460 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.603557 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.603762 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.603864 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.604064 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.604160 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.604367 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.604465 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.604684 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.604789 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.605016 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.605152 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.605341 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.605438 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.605588 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.605723 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.605888 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.606045 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.606192 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.606360 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.606508 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.606681 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.606863 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.607031 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.607180 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.607332 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.607486 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.607644 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.607791 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.607947 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.608097 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.608246 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.608397 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.608528 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.608625 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.608835 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.608919 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.609230 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.609343 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.609467 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.609564 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.609769 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.609854 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.610073 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.610176 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.610432 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.610544 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.610671 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.610782 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.611037 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.611142 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.611398 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.611523 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.611652 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.611769 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.611957 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.612066 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.612272 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.612382 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.612553 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.612705 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.612872 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.612971 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.613470 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.613575 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.613775 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.613885 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.614096 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.614206 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.614400 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.614505 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.614703 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.614809 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.615022 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.615126 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.615328 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.615433 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.615632 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.615757 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.615947 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.616043 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.616750 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.616854 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.617189 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.617307 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.617516 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.617620 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.617834 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.617944 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.618148 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.618260 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.618477 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.618575 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.618781 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.618886 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.619084 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.619190 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.619389 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.619534 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.619691 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.619803 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.619990 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.620120 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.620336 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.620473 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.621152 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.621282 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.621400 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.621503 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.621594 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.621682 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.621769 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.621856 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.621943 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.622060 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.622151 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:35:58.622435 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.622435 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.622613 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.622742 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.622853 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.623074 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.623170 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.623389 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.623585 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.623719 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.623824 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.624028 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.624132 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.624343 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.624503 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.624652 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.624757 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.624963 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.625089 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.625298 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.625404 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.625614 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.625717 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.625925 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.626021 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.626234 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.626349 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.626553 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.626651 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.627237 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.627352 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.627442 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.627541 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.627633 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.627720 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.627807 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.627894 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.628080 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.628191 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.628397 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.628500 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.628729 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.628832 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.629040 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.629158 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.629372 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.629492 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.629687 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.629804 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.630013 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.630110 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.630331 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.630436 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.630648 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.630753 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.630980 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.631076 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.631301 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.631406 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.631608 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.631702 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.632015 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.632802 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.632969 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.633182 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.633401 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.633552 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.633680 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.633776 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.633997 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.634095 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.634308 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.634413 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.634620 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.634727 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.634931 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.635035 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.635241 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.635346 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.635546 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.635645 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.635855 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.635949 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.636160 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.636263 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.636466 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.636561 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.636772 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.636865 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.637122 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.637237 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.637444 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.637541 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.637754 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.637860 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.638064 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.638177 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.638369 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.638464 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.638684 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.638787 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.638995 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.639092 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.639306 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.639411 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.639612 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.639731 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.639922 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.640065 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.640228 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.640350 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.640536 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.640633 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.640841 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.640939 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.641185 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.641297 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.641513 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.641618 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.641819 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.641917 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.642143 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.642245 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.642451 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.642560 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.642763 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.642913 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.643079 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.643179 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.643391 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.643521 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.643692 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.643788 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.644003 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.644107 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.644310 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.644417 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.644614 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.644708 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.644932 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.645090 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.645267 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.645386 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.645572 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.645677 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.645894 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.646006 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.646197 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.646303 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.646505 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.646674 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.646818 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.646916 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.647129 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.647236 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.647438 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.647559 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.647797 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.647895 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.648117 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.648241 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.648440 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.648550 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.648754 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.648847 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.649086 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.649201 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.649423 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.649519 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.649754 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.649860 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.650059 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.650165 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.650383 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.650486 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.650695 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.650806 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.651009 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.651103 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.651312 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.651408 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.651623 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.651739 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.651928 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.652024 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.652237 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.652333 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.652539 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.652651 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.652849 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.652977 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.653178 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.653291 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.653479 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.653586 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.653781 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.653887 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.654085 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.654183 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.654387 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.654491 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.654708 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.654804 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.655014 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.655117 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.655321 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.655453 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.655627 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.655718 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.655928 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.656034 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.656247 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.656343 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.656557 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.656681 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.656868 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.657123 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.657297 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.657455 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.657562 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.657653 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.657828 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.657939 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.658153 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.658257 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.658467 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.658571 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.658772 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.658879 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.659081 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.659195 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.659390 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.659493 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.659704 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.659813 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.660039 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.660473 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.660612 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.660699 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.660802 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.660945 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.661081 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.661299 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.661470 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.661624 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.661784 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.662023 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.662189 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.662377 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.662523 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.662820 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.662999 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.663194 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.663377 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.664094 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.664268 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.664427 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.664585 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.664740 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.664882 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.665066 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.665171 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.665270 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.665369 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.665459 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.665553 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.665650 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.665762 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.665866 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.665973 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.666064 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.666223 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.666400 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.666519 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.666718 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.666831 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.667035 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.667132 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.667350 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.667454 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.667662 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.667775 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.667979 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.668082 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.668301 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.668405 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.668651 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.668888 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.668985 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.669272 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.669387 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.669595 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.669709 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.669919 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.670025 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.670225 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.670323 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.670538 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.670647 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.670863 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.670962 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.671174 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.671261 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.671487 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.671665 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.671803 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.671926 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.672118 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.672273 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.672429 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.672575 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.672728 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.672881 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.673071 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.673163 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.673342 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.673455 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.673648 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.673758 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.673954 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.674049 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.674266 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.674369 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.674573 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.674677 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.674875 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.674978 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.675178 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.675281 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.675485 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.675594 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.675805 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.675902 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.676113 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.676214 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.676429 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.676537 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.676739 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.676845 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.677054 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.677165 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.677365 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.677513 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.677689 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.677812 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.678002 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.678174 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.678352 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.678505 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.678651 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.679386 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.679543 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.679698 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.679840 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.680022 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.680168 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.680396 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.680559 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.680719 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.680864 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.681014 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.681190 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.681335 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.681440 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.681648 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.681755 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.681966 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.682072 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.682279 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.682376 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.682593 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.682697 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.682905 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.683000 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.683215 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.683320 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.683525 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.683630 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.683833 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.683929 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.684145 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.684249 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.684456 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.684558 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.684766 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.684860 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.685093 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.685209 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.685406 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.685509 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.685711 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.685807 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.686013 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.686123 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.686324 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.686422 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.686631 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.686725 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.686943 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.687196 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.687292 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.687532 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.687628 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.687849 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.687953 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.688162 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.688264 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.688474 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.688579 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.688797 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.688904 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.689130 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.689239 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.689446 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.689544 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.689757 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.689860 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.690066 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.690161 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.690377 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.690480 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.690680 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.690783 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.691020 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.691130 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.691295 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.691394 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.691600 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.691701 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.691906 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.691995 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.692209 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.692306 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.692514 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.692610 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.692814 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.692918 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.693142 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.693243 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.693449 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.693550 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.693751 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.693860 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.694067 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.694170 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.694388 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.695037 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.695260 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.695417 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.695566 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.695816 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.695921 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.696177 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.696282 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.696481 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.696578 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.696791 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.696905 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.697119 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.697231 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.697438 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.697535 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.697751 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.697849 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.698063 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.698188 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.698398 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.698529 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.698713 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.698813 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.699024 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.699135 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.699327 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.699424 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.699636 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.699744 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.699942 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.700051 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.700247 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.700353 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.700551 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.700654 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.700858 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.700958 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.701190 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.701288 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.701495 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.701594 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.701813 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.701989 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.702137 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.702279 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.702424 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.702566 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.702724 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.702814 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.703008 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.703096 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.703316 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.703409 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.703649 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.703756 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.703930 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.704015 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.704237 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.704346 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.704539 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.704633 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.705108 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.705347 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.705427 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.705512 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.705597 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.706204 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.706293 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.706372 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.706471 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.706598 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.706761 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.706916 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.707012 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.707111 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.707212 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.707317 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.707446 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.707531 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.707642 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.707875 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.708108 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.708206 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.708305 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.708494 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.708600 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.708813 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.708927 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.709550 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.709668 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.709784 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.709886 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.709886 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.710129 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.710211 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.710302 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.710392 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.710476 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.710667 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.710766 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.710978 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.711350 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.711476 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.711643 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.711811 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.711924 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.712021 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.712112 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.712326 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.712445 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.712554 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.712832 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.712973 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.713149 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.713300 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.713446 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.713583 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.713812 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.713957 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.714090 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.714206 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.714362 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.714588 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.714736 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.714872 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.715006 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.715139 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.715349 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.715495 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.715629 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.715764 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.715896 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.716029 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.716180 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.716317 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.716450 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.716628 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.716768 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.716945 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.717122 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.717286 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.717424 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.717609 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.717747 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.718050 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.718200 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.718344 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.718478 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.718620 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.718763 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.718914 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.719060 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.719203 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.719330 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.719445 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.719567 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.719726 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.719866 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.720054 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.720198 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.720365 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.720519 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.720765 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.720990 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.721199 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.721341 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.721458 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.721629 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.721791 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.721896 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.722036 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.722379 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.722530 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.722676 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.722818 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.722980 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.723102 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.723228 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.723355 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.723556 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.723697 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.723883 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.724098 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.724254 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.724400 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.724537 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.724779 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.724889 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.724990 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.725163 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.725332 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.725468 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.725681 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.725853 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.725998 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.726287 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.726465 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.726661 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.726752 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.726906 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.727010 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.727218 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.727333 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.727528 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.727637 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.727834 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.727941 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.728159 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.728259 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.728469 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.728574 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.728773 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.728878 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.729104 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.729246 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.729411 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.729578 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.729724 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.729889 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.730028 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.730198 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.730465 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.730562 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.730776 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.730881 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.731086 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.731194 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.731391 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.731502 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.731702 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.731808 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.732016 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.732111 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.732329 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.732444 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.732638 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.732783 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.732940 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.733085 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.733270 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.733386 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.733598 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.733741 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.733906 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.734010 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.734237 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.734357 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.734553 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.734652 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.734876 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.734985 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.735183 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.735294 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.735495 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.735597 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.735796 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.735893 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.736100 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.736242 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.736494 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.736607 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.736706 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.736795 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.737008 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.737216 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.737358 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.737451 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.737680 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.737836 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.738093 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.738523 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.738672 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.738841 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.739011 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.739262 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.739370 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.739643 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.739825 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.739968 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.740121 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.740255 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.740360 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.740587 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.740694 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.740909 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.741008 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.741771 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.741887 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.742123 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.742268 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.742370 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.742467 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.742682 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.742830 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.742975 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.743159 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.743290 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.743476 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.743589 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.743796 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.743896 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.744104 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.744200 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.744431 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.744548 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.744756 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.744861 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.745094 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.745199 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.745406 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.745559 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.745737 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.745845 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.746053 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.746194 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.746362 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.746470 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.746672 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.746777 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.746983 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.747079 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.747334 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.747475 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.747648 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.747744 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.747959 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.748057 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.748264 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.748363 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.748571 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.748670 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.748894 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.749007 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.749227 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.749328 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.749540 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.749654 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.749852 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.749965 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.750160 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.750258 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.750466 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.750612 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.750770 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.750878 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.751081 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.751186 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.751385 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.751489 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.751707 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.751823 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.752025 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.752129 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.752349 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.752587 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.752691 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.752919 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.753098 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.753262 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.753367 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.753774 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.753900 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.754003 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.754094 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.754190 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.754280 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.754491 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.754599 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.754832 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.754931 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.755138 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.755290 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.755450 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.755558 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.755777 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.755917 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.756106 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.756210 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.756415 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.756526 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.756744 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.756851 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.757740 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.757849 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.758087 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.758194 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.758446 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.758550 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.758768 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.758872 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.759096 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.759216 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.759404 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.759503 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.759711 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.759821 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.760022 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.760120 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.760328 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.760469 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.760636 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.760747 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.760942 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.761064 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.761295 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.761392 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.761601 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.761713 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.761911 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.762009 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.762217 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.762315 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.762537 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.762641 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.762842 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.762937 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.763159 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.763303 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.763454 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.763547 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.763764 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.763864 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.764071 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.764176 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.764379 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.764487 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.764724 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.764824 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.765062 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.765178 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.765368 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.765473 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.765679 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.765894 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.765990 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.766215 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.766322 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.766554 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.766658 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.766885 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.766990 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.787049 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.787436 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.787795 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.788184 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.788440 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.788720 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.788720 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.789226 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.789478 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.789756 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.790060 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.790329 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.790606 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.790860 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.791257 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.791512 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.791770 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.791770 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.792197 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.792418 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.792643 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.792860 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.793103 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.793362 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.793563 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.793752 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.794021 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.794021 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.794453 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.794691 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.794944 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.795205 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.795422 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.795608 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.795800 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.795987 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.796161 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.796356 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.796574 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.796832 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.797063 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.797269 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.797466 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.797676 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.797991 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.798279 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.798473 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.798674 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.798986 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.799271 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.799539 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.799878 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.800167 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.800798 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.801726 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.801913 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.802127 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.802127 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.802559 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.802559 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.802559 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.802559 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.802559 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.802559 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.803670 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.804315 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.804594 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.804781 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.804997 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.805233 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.805374 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.805828 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.805948 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.806030 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.806122 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.806311 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.806405 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.806405 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.806526 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.806591 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.806673 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.806775 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.806902 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.806993 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.807125 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.807203 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.807281 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.807385 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.807493 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.807602 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.807690 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.807817 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.807817 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.807999 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.808209 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.808411 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.808502 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.808578 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.808649 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.808719 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.808791 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.808861 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.808941 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.809015 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.809119 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.809190 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.809260 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.809345 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.809420 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.809491 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.809561 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.809632 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.809632 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.809839 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.809913 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.810000 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.810077 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.810202 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.810279 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.810359 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.810450 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.810525 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.810596 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.810596 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.810596 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.810781 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.810861 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.810936 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.811009 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.811009 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.811009 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.811009 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.811286 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.811286 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.811417 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.811489 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.811561 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.811656 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.811733 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.811733 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.811883 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.811957 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.812029 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.812110 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.812185 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.812257 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.812343 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.812422 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.812422 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.812561 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.812636 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.812708 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.812794 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.812873 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.812954 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.813068 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.813148 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.813148 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.813148 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.813148 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.813406 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.813482 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.813549 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.813609 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.813609 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.813609 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.813922 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.814008 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.814081 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.814153 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.814225 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.814297 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.814297 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.814439 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.814511 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.814511 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.814619 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.814740 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.814822 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.814901 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.814901 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.815082 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.815157 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.815238 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.815313 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.815385 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.815457 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.815528 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.815600 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.815744 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.815858 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.815981 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.816098 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.816175 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.816284 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.816399 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.816399 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.816539 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.816539 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.816670 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.816670 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.816812 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.816884 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.816956 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.817044 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.817122 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.817206 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.817206 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.817346 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.817346 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.817478 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.817550 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.817629 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.817629 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.817763 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.817835 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.817907 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.817987 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.818061 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.818133 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.818228 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.818304 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.818555 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.818649 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.818725 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.818799 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.818870 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.818943 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.819015 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.819096 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.819170 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.819170 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.819301 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.819409 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.820069 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.820208 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.820342 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.820458 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.820596 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.820735 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.820857 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.820936 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.821008 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.821154 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.821232 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.821303 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.821389 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.821465 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.821537 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.821609 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.821681 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.821761 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.821843 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.821917 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.821989 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.822079 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.822156 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.822228 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.822309 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.822385 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.822457 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.822528 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.822618 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.822693 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.822774 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.822848 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.822921 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.822921 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.823095 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.823178 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.823253 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.823326 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.823412 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.823499 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.823573 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.823655 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.823734 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.823800 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.823877 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.824027 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.824109 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.824192 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.824267 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.824357 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.824431 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.824503 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.824574 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.824708 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.824791 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.824853 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.824853 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.824958 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.825060 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.825127 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.825191 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.825266 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.825340 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.825412 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.825497 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.825594 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.825690 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.825768 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.825829 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.825899 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.825992 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.826110 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.826224 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.826318 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.826393 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.826474 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.826541 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.826619 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.826680 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.826752 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.826826 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.826933 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.826933 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.827060 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.827060 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.827190 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.827190 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.827331 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.827331 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.827464 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.827464 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.827593 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.827664 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.827744 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.827819 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.827890 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.827961 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.828033 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.828113 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.828187 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.828259 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.828330 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.828401 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.828489 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.828733 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.828820 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.828895 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.828967 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.829131 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.829208 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.829296 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.829372 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.829445 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.829517 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.829589 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.829669 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.829744 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.829883 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.829968 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.830044 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.830130 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.830306 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.830390 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.830622 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.830708 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.830944 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.831036 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.831264 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.831346 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.831597 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.831677 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.831933 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.832032 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.832226 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.832307 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.832535 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.832616 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.832859 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.832943 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.833214 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.833341 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.833525 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.833608 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.833848 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.833932 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.834165 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.834247 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.834473 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.834562 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.834808 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.834891 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.835145 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.835287 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.835425 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 08 10:35:58.835569 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.835786 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.836098 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.836408 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.836720 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.837070 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.837403 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.837711 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.838042 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.838362 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.838762 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.839003 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.839312 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.839645 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.839958 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.840273 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.840584 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.840894 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.841231 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.841551 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.841863 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.842175 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.842493 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.842807 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.843143 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.843469 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.843778 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.844104 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.844430 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.844780 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.845115 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.845468 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.845797 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.846114 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.846428 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.846734 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:35:58.846976 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 08 10:35:58.898490 n-d-850501-12 devstack@n-api.service[128861]: INFO dbcounter [None req-d44a6386-8fdb-4cb4-b550-4a6128a268a5 None None] Registered counter for database nova_api Sep 08 10:35:58.910639 n-d-850501-12 devstack@n-api.service[128862]: INFO dbcounter [None req-6ec2cbde-249e-4538-986c-847953b967d6 None None] Registered counter for database nova_api Sep 08 10:35:58.920071 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_db.sqlalchemy.engines [None req-d44a6386-8fdb-4cb4-b550-4a6128a268a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128861) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 10:35:58.926823 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writer thread running {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 10:35:58.931725 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_db.sqlalchemy.engines [None req-6ec2cbde-249e-4538-986c-847953b967d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128862) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 10:35:58.938421 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writer thread running {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 10:35:58.984937 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.context [None req-d44a6386-8fdb-4cb4-b550-4a6128a268a5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2785b110-f847-4739-9d30-5b571c6d79f4(cell1) {{(pid=128861) load_cells /opt/stack/nova/nova/context.py:464}} Sep 08 10:35:58.989295 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d44a6386-8fdb-4cb4-b550-4a6128a268a5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:58.989780 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d44a6386-8fdb-4cb4-b550-4a6128a268a5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:58.992060 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d44a6386-8fdb-4cb4-b550-4a6128a268a5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:58.993120 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d44a6386-8fdb-4cb4-b550-4a6128a268a5 None None] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:58.993455 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d44a6386-8fdb-4cb4-b550-4a6128a268a5 None None] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:58.995067 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.context [None req-6ec2cbde-249e-4538-986c-847953b967d6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2785b110-f847-4739-9d30-5b571c6d79f4(cell1) {{(pid=128862) load_cells /opt/stack/nova/nova/context.py:464}} Sep 08 10:35:58.995954 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d44a6386-8fdb-4cb4-b550-4a6128a268a5 None None] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:58.998080 n-d-850501-12 devstack@n-api.service[128861]: INFO dbcounter [None req-d44a6386-8fdb-4cb4-b550-4a6128a268a5 None None] Registered counter for database nova_cell0 Sep 08 10:35:58.999110 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ec2cbde-249e-4538-986c-847953b967d6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:58.999586 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ec2cbde-249e-4538-986c-847953b967d6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:59.001188 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ec2cbde-249e-4538-986c-847953b967d6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:59.001929 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ec2cbde-249e-4538-986c-847953b967d6 None None] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:59.002376 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ec2cbde-249e-4538-986c-847953b967d6 None None] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:59.003810 n-d-850501-12 devstack@n-api.service[128861]: INFO dbcounter [None req-d44a6386-8fdb-4cb4-b550-4a6128a268a5 None None] Registered counter for database nova_cell1 Sep 08 10:35:59.004755 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ec2cbde-249e-4538-986c-847953b967d6 None None] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:59.006759 n-d-850501-12 devstack@n-api.service[128862]: INFO dbcounter [None req-6ec2cbde-249e-4538-986c-847953b967d6 None None] Registered counter for database nova_cell0 Sep 08 10:35:59.012305 n-d-850501-12 devstack@n-api.service[128862]: INFO dbcounter [None req-6ec2cbde-249e-4538-986c-847953b967d6 None None] Registered counter for database nova_cell1 Sep 08 10:35:59.012458 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_db.sqlalchemy.engines [None req-d44a6386-8fdb-4cb4-b550-4a6128a268a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128861) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 10:35:59.015019 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_db.sqlalchemy.engines [None req-d44a6386-8fdb-4cb4-b550-4a6128a268a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128861) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 10:35:59.019550 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_db.sqlalchemy.engines [None req-6ec2cbde-249e-4538-986c-847953b967d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128862) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 10:35:59.019979 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writer thread running {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 10:35:59.022152 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_db.sqlalchemy.engines [None req-6ec2cbde-249e-4538-986c-847953b967d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128862) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 10:35:59.025827 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writer thread running {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 10:35:59.027957 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writer thread running {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 10:35:59.029270 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writer thread running {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 10:35:59.177752 n-d-850501-12 devstack@n-api.service[128861]: INFO dbcounter [None req-d44a6386-8fdb-4cb4-b550-4a6128a268a5 None None] Registered counter for database nova_cell0 Sep 08 10:35:59.184466 n-d-850501-12 devstack@n-api.service[128862]: INFO dbcounter [None req-6ec2cbde-249e-4538-986c-847953b967d6 None None] Registered counter for database nova_cell0 Sep 08 10:35:59.185983 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_db.sqlalchemy.engines [None req-d44a6386-8fdb-4cb4-b550-4a6128a268a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128861) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 10:35:59.189558 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_db.sqlalchemy.engines [None req-6ec2cbde-249e-4538-986c-847953b967d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128862) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 10:35:59.190857 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writer thread running {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 10:35:59.194215 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writer thread running {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 10:35:59.520107 n-d-850501-12 devstack@n-api.service[128861]: WARNING keystonemiddleware.auth_token [None req-d44a6386-8fdb-4cb4-b550-4a6128a268a5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 08 10:35:59.524550 n-d-850501-12 devstack@n-api.service[128862]: WARNING keystonemiddleware.auth_token [None req-6ec2cbde-249e-4538-986c-847953b967d6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 08 10:35:59.528182 n-d-850501-12 devstack@n-api.service[128861]: WARNING keystonemiddleware.auth_token [None req-d44a6386-8fdb-4cb4-b550-4a6128a268a5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 08 10:35:59.531876 n-d-850501-12 devstack@n-api.service[128862]: WARNING keystonemiddleware.auth_token [None req-6ec2cbde-249e-4538-986c-847953b967d6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 08 10:35:59.878975 n-d-850501-12 devstack@n-api.service[128862]: WARNING keystonemiddleware.auth_token [None req-6ec2cbde-249e-4538-986c-847953b967d6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 08 10:35:59.885578 n-d-850501-12 devstack@n-api.service[128862]: WARNING keystonemiddleware.auth_token [None req-6ec2cbde-249e-4538-986c-847953b967d6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 08 10:35:59.887874 n-d-850501-12 devstack@n-api.service[128861]: WARNING keystonemiddleware.auth_token [None req-d44a6386-8fdb-4cb4-b550-4a6128a268a5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 08 10:35:59.890929 n-d-850501-12 devstack@n-api.service[128862]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c04890d9c0 pid: 128862 (default app) Sep 08 10:35:59.894352 n-d-850501-12 devstack@n-api.service[128861]: WARNING keystonemiddleware.auth_token [None req-d44a6386-8fdb-4cb4-b550-4a6128a268a5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 08 10:35:59.900847 n-d-850501-12 devstack@n-api.service[128861]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c04890d9c0 pid: 128861 (default app) Sep 08 10:36:40.929888 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:36:40.930994 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:36:40.931972 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:36:40.932748 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:36:41.021432 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=3 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:36:41.022289 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=3 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:36:41.023437 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=3 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:36:41.024231 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=3 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:36:42.219963 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ec39c564-993e-4c96-a2de-442efb0bd712 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:42.225993 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec39c564-993e-4c96-a2de-442efb0bd712 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:42.226490 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec39c564-993e-4c96-a2de-442efb0bd712 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:42.226934 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec39c564-993e-4c96-a2de-442efb0bd712 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:42.227681 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec39c564-993e-4c96-a2de-442efb0bd712 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:42.228118 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec39c564-993e-4c96-a2de-442efb0bd712 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:42.228703 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec39c564-993e-4c96-a2de-442efb0bd712 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:42.280029 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ec39c564-993e-4c96-a2de-442efb0bd712 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 1.356365 Sep 08 10:36:42.281206 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1/1] 10.222.0.27 () {58 vars in 1176 bytes} [Thu Sep 8 10:36:40 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:36:42.326506 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-af14dff8-a20e-47b3-a82f-fc8eaa4d3b17 tempest-AggregatesAdminTestV241-639686868 tempest-AggregatesAdminTestV241-639686868-project-admin] Calling method '.version_select at 0x7f68e6268b80>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:42.338647 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-af14dff8-a20e-47b3-a82f-fc8eaa4d3b17 tempest-AggregatesAdminTestV241-639686868 tempest-AggregatesAdminTestV241-639686868-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2785b110-f847-4739-9d30-5b571c6d79f4(cell1) {{(pid=128861) load_cells /opt/stack/nova/nova/compute/api.py:319}} Sep 08 10:36:42.340757 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-af14dff8-a20e-47b3-a82f-fc8eaa4d3b17 tempest-AggregatesAdminTestV241-639686868 tempest-AggregatesAdminTestV241-639686868-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:42.341303 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-af14dff8-a20e-47b3-a82f-fc8eaa4d3b17 tempest-AggregatesAdminTestV241-639686868 tempest-AggregatesAdminTestV241-639686868-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:42.341755 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-af14dff8-a20e-47b3-a82f-fc8eaa4d3b17 tempest-AggregatesAdminTestV241-639686868 tempest-AggregatesAdminTestV241-639686868-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:42.376680 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-af14dff8-a20e-47b3-a82f-fc8eaa4d3b17 tempest-AggregatesAdminTestV241-639686868 tempest-AggregatesAdminTestV241-639686868-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:42.376680 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-af14dff8-a20e-47b3-a82f-fc8eaa4d3b17 tempest-AggregatesAdminTestV241-639686868 tempest-AggregatesAdminTestV241-639686868-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:42.376680 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-af14dff8-a20e-47b3-a82f-fc8eaa4d3b17 tempest-AggregatesAdminTestV241-639686868 tempest-AggregatesAdminTestV241-639686868-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:42.397139 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-af14dff8-a20e-47b3-a82f-fc8eaa4d3b17 tempest-AggregatesAdminTestV241-639686868 tempest-AggregatesAdminTestV241-639686868-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:42.398002 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-af14dff8-a20e-47b3-a82f-fc8eaa4d3b17 tempest-AggregatesAdminTestV241-639686868 tempest-AggregatesAdminTestV241-639686868-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:42.399953 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-af14dff8-a20e-47b3-a82f-fc8eaa4d3b17 tempest-AggregatesAdminTestV241-639686868 tempest-AggregatesAdminTestV241-639686868-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:42.407699 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-af14dff8-a20e-47b3-a82f-fc8eaa4d3b17 tempest-AggregatesAdminTestV241-639686868 tempest-AggregatesAdminTestV241-639686868-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1427 microversion: 2.41 time: 1.395985 Sep 08 10:36:42.408329 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1/2] 10.222.0.27 () {60 vars in 1208 bytes} [Thu Sep 8 10:36:41 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1427 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:36:42.649366 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-42081984-046e-4cd3-b531-5b20636ba73e tempest-AZAdminV2TestJSON-450079135 tempest-AZAdminV2TestJSON-450079135-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:42.651246 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42081984-046e-4cd3-b531-5b20636ba73e tempest-AZAdminV2TestJSON-450079135 tempest-AZAdminV2TestJSON-450079135-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:42.651721 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42081984-046e-4cd3-b531-5b20636ba73e tempest-AZAdminV2TestJSON-450079135 tempest-AZAdminV2TestJSON-450079135-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:42.652149 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42081984-046e-4cd3-b531-5b20636ba73e tempest-AZAdminV2TestJSON-450079135 tempest-AZAdminV2TestJSON-450079135-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:42.652863 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42081984-046e-4cd3-b531-5b20636ba73e tempest-AZAdminV2TestJSON-450079135 tempest-AZAdminV2TestJSON-450079135-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:42.653342 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42081984-046e-4cd3-b531-5b20636ba73e tempest-AZAdminV2TestJSON-450079135 tempest-AZAdminV2TestJSON-450079135-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:42.653761 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42081984-046e-4cd3-b531-5b20636ba73e tempest-AZAdminV2TestJSON-450079135 tempest-AZAdminV2TestJSON-450079135-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:42.681151 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b21a6593-77a3-4299-b761-45502a9a0506 tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Calling method '.version_select at 0x7f68e6187c10>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:42.683651 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-42081984-046e-4cd3-b531-5b20636ba73e tempest-AZAdminV2TestJSON-450079135 tempest-AZAdminV2TestJSON-450079135-project-admin] 10.222.0.27 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.400880 Sep 08 10:36:42.684268 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2/3] 10.222.0.27 () {58 vars in 1164 bytes} [Thu Sep 8 10:36:42 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:36:42.684381 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b21a6593-77a3-4299-b761-45502a9a0506 tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:42.685150 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b21a6593-77a3-4299-b761-45502a9a0506 tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:42.685962 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b21a6593-77a3-4299-b761-45502a9a0506 tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:42.704334 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b21a6593-77a3-4299-b761-45502a9a0506 tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:42.704895 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b21a6593-77a3-4299-b761-45502a9a0506 tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:42.705442 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b21a6593-77a3-4299-b761-45502a9a0506 tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:42.717004 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b21a6593-77a3-4299-b761-45502a9a0506 tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:42.717614 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b21a6593-77a3-4299-b761-45502a9a0506 tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:42.718812 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b21a6593-77a3-4299-b761-45502a9a0506 tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:42.725570 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b21a6593-77a3-4299-b761-45502a9a0506 tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1507 microversion: 2.1 time: 0.315603 Sep 08 10:36:42.737223 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2/4] 10.222.0.27 () {58 vars in 1167 bytes} [Thu Sep 8 10:36:42 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1507 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:36:42.737223 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9e135546-9f8e-4785-8e7b-38e19e67c4b8 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2042075640"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:36:42.751552 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.aggregate [None req-9e135546-9f8e-4785-8e7b-38e19e67c4b8 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Generated uuid e95e67df-5d37-4445-a9ac-64c6cbce44ea for aggregate {{(pid=128861) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 08 10:36:42.829328 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9e135546-9f8e-4785-8e7b-38e19e67c4b8 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.101293 Sep 08 10:36:42.830287 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3/5] 10.222.0.27 () {60 vars in 1164 bytes} [Thu Sep 8 10:36:42 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:36:42.840940 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-12d88834-2691-4c64-a42a-994eeaa56507 tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1777590888", "id": 1736159169, "os-flavor-access:is_public": "True"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:36:42.898826 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-12d88834-2691-4c64-a42a-994eeaa56507 tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.208430 Sep 08 10:36:42.908187 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3/6] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:36:42 2022] POST /compute/v2.1/flavors => generated 430 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:36:42.971436 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-608363dd-6656-442f-985b-a6608cf4c199 tempest-QuotasAdminTestJSON-1017043201 tempest-QuotasAdminTestJSON-1017043201-project-admin] Calling method '.version_select at 0x7f68e60a6820>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:43.091385 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4e28cb3f-c24f-4365-8a73-02cdeb4056ce tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1741337531", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:36:43.212428 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-608363dd-6656-442f-985b-a6608cf4c199 tempest-QuotasAdminTestJSON-1017043201 tempest-QuotasAdminTestJSON-1017043201-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/354ae2f134594eda82240ed01ac6a52a" status: 200 len: 371 microversion: 2.1 time: 0.380790 Sep 08 10:36:43.213009 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 4/7] 10.222.0.27 () {58 vars in 1242 bytes} [Thu Sep 8 10:36:42 2022] GET /compute/v2.1/os-quota-sets/354ae2f134594eda82240ed01ac6a52a => generated 371 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:36:43.223432 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d36d3eef-2662-463a-a6cc-18ed1987c3a2 tempest-AZAdminV2TestJSON-450079135 tempest-AZAdminV2TestJSON-450079135-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:43.225393 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d36d3eef-2662-463a-a6cc-18ed1987c3a2 tempest-AZAdminV2TestJSON-450079135 tempest-AZAdminV2TestJSON-450079135-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:43.225892 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d36d3eef-2662-463a-a6cc-18ed1987c3a2 tempest-AZAdminV2TestJSON-450079135 tempest-AZAdminV2TestJSON-450079135-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:43.226332 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d36d3eef-2662-463a-a6cc-18ed1987c3a2 tempest-AZAdminV2TestJSON-450079135 tempest-AZAdminV2TestJSON-450079135-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:43.227056 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d36d3eef-2662-463a-a6cc-18ed1987c3a2 tempest-AZAdminV2TestJSON-450079135 tempest-AZAdminV2TestJSON-450079135-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:43.227506 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d36d3eef-2662-463a-a6cc-18ed1987c3a2 tempest-AZAdminV2TestJSON-450079135 tempest-AZAdminV2TestJSON-450079135-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:43.227927 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d36d3eef-2662-463a-a6cc-18ed1987c3a2 tempest-AZAdminV2TestJSON-450079135 tempest-AZAdminV2TestJSON-450079135-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:43.268911 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d36d3eef-2662-463a-a6cc-18ed1987c3a2 tempest-AZAdminV2TestJSON-450079135 tempest-AZAdminV2TestJSON-450079135-project-admin] 10.222.0.27 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.054685 Sep 08 10:36:43.269886 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 5/8] 10.222.0.27 () {58 vars in 1185 bytes} [Thu Sep 8 10:36:43 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:36:43.274655 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4b891f68-bf54-474a-9dbb-31e1ef1e85e2 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-850501-12"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:36:43.285138 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4b891f68-bf54-474a-9dbb-31e1ef1e85e2 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:43.285627 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4b891f68-bf54-474a-9dbb-31e1ef1e85e2 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:43.286175 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4b891f68-bf54-474a-9dbb-31e1ef1e85e2 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:43.524581 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-4e28cb3f-c24f-4365-8a73-02cdeb4056ce tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] validate_networks() for None {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:36:43.762723 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-4e28cb3f-c24f-4365-8a73-02cdeb4056ce tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:36:43.763360 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-4e28cb3f-c24f-4365-8a73-02cdeb4056ce tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:36:43.763991 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-4e28cb3f-c24f-4365-8a73-02cdeb4056ce tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:36:43.764548 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-4e28cb3f-c24f-4365-8a73-02cdeb4056ce tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:36:43.765165 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-4e28cb3f-c24f-4365-8a73-02cdeb4056ce tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:36:43.789920 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e28cb3f-c24f-4365-8a73-02cdeb4056ce tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:43.790972 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e28cb3f-c24f-4365-8a73-02cdeb4056ce tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:43.791584 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e28cb3f-c24f-4365-8a73-02cdeb4056ce tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:43.792811 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e28cb3f-c24f-4365-8a73-02cdeb4056ce tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:43.793424 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e28cb3f-c24f-4365-8a73-02cdeb4056ce tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:43.794108 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e28cb3f-c24f-4365-8a73-02cdeb4056ce tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:43.835443 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-4e28cb3f-c24f-4365-8a73-02cdeb4056ce tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Getting quotas for project 2eb116f8d7dd4858a91c03e0a4310fa9. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:36:43.843094 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4b891f68-bf54-474a-9dbb-31e1ef1e85e2 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 243 microversion: 2.1 time: 0.571825 Sep 08 10:36:43.843717 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-4e28cb3f-c24f-4365-8a73-02cdeb4056ce tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Getting quotas for user 6fdbe35f311e435ba9e0516f302ba519 and project 2eb116f8d7dd4858a91c03e0a4310fa9. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:36:43.844145 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 6/9] 10.222.0.27 () {60 vars in 1191 bytes} [Thu Sep 8 10:36:43 2022] POST /compute/v2.1/os-aggregates/1/action => generated 243 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:36:43.849565 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-70f5985c-7b7f-4f65-b5ab-32092cd4d0e1 tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:43.857570 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4e28cb3f-c24f-4365-8a73-02cdeb4056ce tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:36:43.869586 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4e28cb3f-c24f-4365-8a73-02cdeb4056ce tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] [instance: e605c39e-7644-4842-8476-9c9af611282f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:36:43.909148 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-70f5985c-7b7f-4f65-b5ab-32092cd4d0e1 tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1736159169" status: 202 len: 0 microversion: 2.1 time: 0.063175 Sep 08 10:36:43.910467 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 7/10] 10.222.0.27 () {58 vars in 1161 bytes} [Thu Sep 8 10:36:43 2022] DELETE /compute/v2.1/flavors/1736159169 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:36:43.920283 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-33b7ed69-c8bf-46de-9ebd-eb6052539a9a tempest-QuotasAdminTestJSON-1017043201 tempest-QuotasAdminTestJSON-1017043201-project-admin] Action: 'update', calling method: .version_select at 0x7f68e60bd1f0>, body: {"quota_set": {"ram": "5120"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:36:43.970644 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4e28cb3f-c24f-4365-8a73-02cdeb4056ce tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.068122 Sep 08 10:36:43.975524 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 4/11] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:36:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1072 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:36:43.984995 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c3e0023c-f0e7-4b05-a262-408aac33763e tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-850501-12"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:36:44.036078 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c3e0023c-f0e7-4b05-a262-408aac33763e tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:44.036620 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c3e0023c-f0e7-4b05-a262-408aac33763e tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:44.037095 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c3e0023c-f0e7-4b05-a262-408aac33763e tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:44.091245 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-c3e0023c-f0e7-4b05-a262-408aac33763e tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] HTTP exception thrown: Aggregate 1 already has host n-h1-850501-12. Sep 08 10:36:44.118149 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c3e0023c-f0e7-4b05-a262-408aac33763e tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Request method failure captured: Sep 08 10:36:44.118149 n-d-850501-12 devstack@n-api.service[128862]: request: POST /compute/v2.1/os-aggregates/1/action HTTP/1.1 Sep 08 10:36:44.118149 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:36:44.118149 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:36:44.118149 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:36:44.118149 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 40 Sep 08 10:36:44.118149 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:36:44.118149 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:36:44.118149 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:36:44.118149 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:36:44.118149 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcW42jKNF2wJ6tUgDr7GFhj8bDGclBm0y_GYAQnVvDAMYJ1jDUbUnOvdDZSin9luvRPOB6TjofqglWozsQ0mxm4M6iQFvXQru9-G8m76lXYiOi9vSC3hj03Cl53AEeaywrmiyKWkTCr0fuRfryKOtrDuR7P_LtA1MCxYImmijauXgZk Sep 08 10:36:44.118149 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:36:44.118149 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:36:44.118149 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:36:44.118149 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:36:44.118149 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:36:44.118149 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:36:44.118149 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 874e026251854684a06d3fd636701d17 Sep 08 10:36:44.118149 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1714194550 Sep 08 10:36:44.118149 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,admin,member Sep 08 10:36:44.118149 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,admin,member Sep 08 10:36:44.119375 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/874e026251854684a06d3fd636701d17"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/874e026251854684a06d3fd636701d17"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_874e026251854684a06d3fd636701d17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/874e026251854684a06d3fd636701d17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:36:44.119375 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1714194550 Sep 08 10:36:44.119375 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 874e026251854684a06d3fd636701d17 Sep 08 10:36:44.119375 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1714194550 Sep 08 10:36:44.119375 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin Sep 08 10:36:44.119375 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:36:44.119375 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:36:44.119375 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 55fc120859bb42faa1ba5cea5894d548 Sep 08 10:36:44.119375 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin Sep 08 10:36:44.119375 n-d-850501-12 devstack@n-api.service[128862]: Sep 08 10:36:44.119375 n-d-850501-12 devstack@n-api.service[128862]: {"add_host": {"host": "n-h1-850501-12"}} Sep 08 10:36:44.119375 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:36:44.119375 n-d-850501-12 devstack@n-api.service[128862]: exception: Aggregate 1 already has host n-h1-850501-12. Sep 08 10:36:44.120069 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '1', 'body': {'add_host': {'host': 'n-h1-850501-12'}}} Sep 08 10:36:44.120069 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:36:44.120069 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:44.120069 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 08 10:36:44.120069 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 08 10:36:44.120069 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 08 10:36:44.120069 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 08 10:36:44.120069 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 08 10:36:44.120069 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 08 10:36:44.120069 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 08 10:36:44.120069 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 08 10:36:44.120069 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 08 10:36:44.120069 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 08 10:36:44.120069 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 08 10:36:44.120069 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result.read() Sep 08 10:36:44.120069 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 08 10:36:44.120069 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 08 10:36:44.120069 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 08 10:36:44.120069 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 08 10:36:44.121014 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 08 10:36:44.121014 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 08 10:36:44.121014 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 08 10:36:44.121014 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 08 10:36:44.121014 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-850501-12-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Sep 08 10:36:44.121014 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:36:44.121014 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 08 10:36:44.121014 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:36:44.121014 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:44.121014 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Sep 08 10:36:44.121014 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Sep 08 10:36:44.121014 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Sep 08 10:36:44.121014 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi session.flush() Sep 08 10:36:44.121014 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 08 10:36:44.121014 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._flush(objects) Sep 08 10:36:44.121014 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 08 10:36:44.121014 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Sep 08 10:36:44.121014 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 08 10:36:44.121014 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi compat.raise_( Sep 08 10:36:44.122007 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 08 10:36:44.122007 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception Sep 08 10:36:44.122007 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 08 10:36:44.122007 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi flush_context.execute() Sep 08 10:36:44.122007 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 08 10:36:44.122007 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi rec.execute(self) Sep 08 10:36:44.122007 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 08 10:36:44.122007 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Sep 08 10:36:44.122007 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 08 10:36:44.122007 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Sep 08 10:36:44.122007 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 08 10:36:44.122007 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Sep 08 10:36:44.122007 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 08 10:36:44.122007 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Sep 08 10:36:44.122007 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 08 10:36:44.122007 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Sep 08 10:36:44.122007 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 08 10:36:44.122007 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Sep 08 10:36:44.124307 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 08 10:36:44.124307 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Sep 08 10:36:44.124307 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 08 10:36:44.124307 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 08 10:36:44.124307 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 08 10:36:44.124307 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception Sep 08 10:36:44.124307 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 08 10:36:44.124307 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 08 10:36:44.124307 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 08 10:36:44.124307 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 08 10:36:44.124307 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 08 10:36:44.124307 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 08 10:36:44.124307 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 08 10:36:44.124307 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 08 10:36:44.124307 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 08 10:36:44.124307 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 08 10:36:44.124307 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 08 10:36:44.124307 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result.read() Sep 08 10:36:44.125481 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 08 10:36:44.125481 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 08 10:36:44.125481 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 08 10:36:44.125481 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 08 10:36:44.125481 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 08 10:36:44.125481 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 08 10:36:44.125481 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 08 10:36:44.125481 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 08 10:36:44.125481 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-850501-12-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Sep 08 10:36:44.125481 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Sep 08 10:36:44.125481 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 9, 8, 10, 36, 44, 75813), 'updated_at': None, 'host': 'n-h1-850501-12', 'aggregate_id': 1}] Sep 08 10:36:44.125481 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 08 10:36:44.125481 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:36:44.125481 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:36:44.125481 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:36:44.125481 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:44.125481 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Sep 08 10:36:44.126529 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Sep 08 10:36:44.126529 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 08 10:36:44.126529 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 08 10:36:44.126529 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:36:44.126529 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:36:44.126529 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:36:44.126529 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:36:44.126529 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 08 10:36:44.126529 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 08 10:36:44.126529 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Sep 08 10:36:44.126529 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Sep 08 10:36:44.126529 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 08 10:36:44.126529 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 08 10:36:44.126529 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Sep 08 10:36:44.126529 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Sep 08 10:36:44.126529 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Sep 08 10:36:44.126529 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Sep 08 10:36:44.126529 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 1 already has host n-h1-850501-12. Sep 08 10:36:44.126529 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:36:44.126529 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:36:44.127751 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:36:44.127751 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:44.127751 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:36:44.127751 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:36:44.127751 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:36:44.127751 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:36:44.127751 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:36:44.127751 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:36:44.127751 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:36:44.127751 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:36:44.127751 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Sep 08 10:36:44.127751 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Sep 08 10:36:44.127751 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 1 already has host n-h1-850501-12. Sep 08 10:36:44.127751 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:36:44.127751 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:36:44.127751 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:36:44.127751 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:44.127751 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:36:44.127751 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:36:44.127751 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:36:44.127751 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:36:44.129051 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 1 already has host n-h1-850501-12. Sep 08 10:36:44.129051 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:36:44.129051 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c3e0023c-f0e7-4b05-a262-408aac33763e tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Returning 409 to user: Aggregate 1 already has host n-h1-850501-12. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:36:44.129051 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c3e0023c-f0e7-4b05-a262-408aac33763e tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/1/action" status: 409 len: 96 microversion: 2.1 time: 0.143136 Sep 08 10:36:44.129051 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 5/12] 10.222.0.27 () {60 vars in 1191 bytes} [Thu Sep 8 10:36:43 2022] POST /compute/v2.1/os-aggregates/1/action => generated 96 bytes in 146 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Sep 08 10:36:44.135315 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ca0d979a-b9f8-4ff4-944c-b44859eee1b2 tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:44.178269 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ca0d979a-b9f8-4ff4-944c-b44859eee1b2 tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.049860 Sep 08 10:36:44.191606 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 6/13] 10.222.0.27 () {58 vars in 1146 bytes} [Thu Sep 8 10:36:44 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:36:44.191606 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4ef3053a-388f-44e1-a053-fd1c89917683 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:44.191606 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4ef3053a-388f-44e1-a053-fd1c89917683 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] [instance: e605c39e-7644-4842-8476-9c9af611282f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:44.287429 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4ef3053a-388f-44e1-a053-fd1c89917683 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdbe35f311e435ba9e0516f302ba519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb116f8d7dd4858a91c03e0a4310fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:44.287654 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-33b7ed69-c8bf-46de-9ebd-eb6052539a9a tempest-QuotasAdminTestJSON-1017043201 tempest-QuotasAdminTestJSON-1017043201-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:44.288369 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-33b7ed69-c8bf-46de-9ebd-eb6052539a9a tempest-QuotasAdminTestJSON-1017043201 tempest-QuotasAdminTestJSON-1017043201-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:44.288885 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-33b7ed69-c8bf-46de-9ebd-eb6052539a9a tempest-QuotasAdminTestJSON-1017043201 tempest-QuotasAdminTestJSON-1017043201-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:44.289732 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-33b7ed69-c8bf-46de-9ebd-eb6052539a9a tempest-QuotasAdminTestJSON-1017043201 tempest-QuotasAdminTestJSON-1017043201-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:44.290271 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-33b7ed69-c8bf-46de-9ebd-eb6052539a9a tempest-QuotasAdminTestJSON-1017043201 tempest-QuotasAdminTestJSON-1017043201-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:44.290804 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-33b7ed69-c8bf-46de-9ebd-eb6052539a9a tempest-QuotasAdminTestJSON-1017043201 tempest-QuotasAdminTestJSON-1017043201-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:44.302929 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4ef3053a-388f-44e1-a053-fd1c89917683 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] 10.222.0.27 "GET /compute/v2.1/servers/e605c39e-7644-4842-8476-9c9af611282f" status: 200 len: 1220 microversion: 2.1 time: 0.122952 Sep 08 10:36:44.304075 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 7/14] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:36:44 2022] GET /compute/v2.1/servers/e605c39e-7644-4842-8476-9c9af611282f => generated 1220 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:36:44.308798 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-180c8789-05be-4c35-9783-0c8758ab358b tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-850501-12"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:36:44.323191 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-180c8789-05be-4c35-9783-0c8758ab358b tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:44.323961 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-180c8789-05be-4c35-9783-0c8758ab358b tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:44.324616 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-180c8789-05be-4c35-9783-0c8758ab358b tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:44.371537 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-33b7ed69-c8bf-46de-9ebd-eb6052539a9a tempest-QuotasAdminTestJSON-1017043201 tempest-QuotasAdminTestJSON-1017043201-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/354ae2f134594eda82240ed01ac6a52a" status: 200 len: 328 microversion: 2.1 time: 0.458530 Sep 08 10:36:44.372396 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 8/15] 10.222.0.27 () {60 vars in 1262 bytes} [Thu Sep 8 10:36:43 2022] PUT /compute/v2.1/os-quota-sets/354ae2f134594eda82240ed01ac6a52a => generated 328 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:36:44.376963 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d987507d-0b8b-4910-a6c9-8fb392ab20e5 tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1760543202", "id": 1429053553, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:36:44.411793 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d987507d-0b8b-4910-a6c9-8fb392ab20e5 tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 417 microversion: 2.1 time: 0.038136 Sep 08 10:36:44.412962 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 9/16] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:36:44 2022] POST /compute/v2.1/flavors => generated 417 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:36:44.417722 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-28d63327-1826-49eb-9771-903ab6a36227 tempest-QuotasAdminTestJSON-1017043201 tempest-QuotasAdminTestJSON-1017043201-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:44.430760 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-28d63327-1826-49eb-9771-903ab6a36227 tempest-QuotasAdminTestJSON-1017043201 tempest-QuotasAdminTestJSON-1017043201-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-quota-sets/354ae2f134594eda82240ed01ac6a52a" status: 202 len: 0 microversion: 2.1 time: 0.016514 Sep 08 10:36:44.431665 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 10/17] 10.222.0.27 () {58 vars in 1245 bytes} [Thu Sep 8 10:36:44 2022] DELETE /compute/v2.1/os-quota-sets/354ae2f134594eda82240ed01ac6a52a => generated 0 bytes in 18 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:36:44.660208 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7d65f9cd-2b1c-4deb-be2f-37b113c3a5e7 tempest-FlavorsExtraSpecsTestJSON-1547836576 tempest-FlavorsExtraSpecsTestJSON-1547836576-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1451451945", "ram": 512, "vcpus": 1, "disk": 10, "id": 772098848, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:36:44.680897 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7d65f9cd-2b1c-4deb-be2f-37b113c3a5e7 tempest-FlavorsExtraSpecsTestJSON-1547836576 tempest-FlavorsExtraSpecsTestJSON-1547836576-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.246650 Sep 08 10:36:44.681790 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 11/18] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:36:44 2022] POST /compute/v2.1/flavors => generated 413 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:36:44.696533 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cffc3cbc-f5d3-4587-8f0b-2a2046636e3b tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:44.750176 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cffc3cbc-f5d3-4587-8f0b-2a2046636e3b tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5801 microversion: 2.1 time: 0.057817 Sep 08 10:36:44.765769 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 12/19] 10.222.0.27 () {58 vars in 1146 bytes} [Thu Sep 8 10:36:44 2022] GET /compute/v2.1/flavors/detail => generated 5801 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:36:44.771182 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d9f203cc-46db-4abf-a071-5b0b974cc186 tempest-QuotasAdminTestJSON-1017043201 tempest-QuotasAdminTestJSON-1017043201-project-admin] Calling method '.version_select at 0x7f68e579e700>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:44.852420 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-180c8789-05be-4c35-9783-0c8758ab358b tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 227 microversion: 2.1 time: 0.546874 Sep 08 10:36:44.854819 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 8/20] 10.222.0.27 () {60 vars in 1191 bytes} [Thu Sep 8 10:36:44 2022] POST /compute/v2.1/os-aggregates/1/action => generated 227 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:36:44.860903 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b2417c8e-8db9-4aaa-850c-6f05c2862544 tempest-FlavorsExtraSpecsTestJSON-1547836576 tempest-FlavorsExtraSpecsTestJSON-1547836576-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:36:44.903484 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b2417c8e-8db9-4aaa-850c-6f05c2862544 tempest-FlavorsExtraSpecsTestJSON-1547836576 tempest-FlavorsExtraSpecsTestJSON-1547836576-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/772098848/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.047134 Sep 08 10:36:44.904079 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 9/21] 10.222.0.27 () {60 vars in 1221 bytes} [Thu Sep 8 10:36:44 2022] POST /compute/v2.1/flavors/772098848/os-extra_specs => generated 66 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:36:44.908951 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fa8236ef-2c39-4641-9bf5-72cb59e5b2c1 tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:44.937695 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fa8236ef-2c39-4641-9bf5-72cb59e5b2c1 tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1429053553" status: 202 len: 0 microversion: 2.1 time: 0.032151 Sep 08 10:36:44.939423 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 10/22] 10.222.0.27 () {58 vars in 1161 bytes} [Thu Sep 8 10:36:44 2022] DELETE /compute/v2.1/flavors/1429053553 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:36:44.945378 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b58b7069-2046-4040-abc5-d06f1484ad04 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:44.972626 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b58b7069-2046-4040-abc5-d06f1484ad04 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.031641 Sep 08 10:36:44.974626 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 11/23] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Sep 8 10:36:44 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 08 10:36:45.091628 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d9f203cc-46db-4abf-a071-5b0b974cc186 tempest-QuotasAdminTestJSON-1017043201 tempest-QuotasAdminTestJSON-1017043201-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/354ae2f134594eda82240ed01ac6a52a" status: 200 len: 371 microversion: 2.1 time: 0.324387 Sep 08 10:36:45.092219 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 13/24] 10.222.0.27 () {58 vars in 1242 bytes} [Thu Sep 8 10:36:44 2022] GET /compute/v2.1/os-quota-sets/354ae2f134594eda82240ed01ac6a52a => generated 371 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:36:45.111440 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-418aea8f-6f95-4ff6-9440-127b52e83c23 tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:45.170391 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-418aea8f-6f95-4ff6-9440-127b52e83c23 tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.075799 Sep 08 10:36:45.171360 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 14/25] 10.222.0.27 () {58 vars in 1146 bytes} [Thu Sep 8 10:36:45 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:36:45.177083 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e7ac2502-49c5-43e0-bb7b-e2645ccad650 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1432116307"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:36:45.181307 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.aggregate [None req-e7ac2502-49c5-43e0-bb7b-e2645ccad650 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Generated uuid 455e966e-f7b2-4145-adbb-7dc768d445b9 for aggregate {{(pid=128861) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 08 10:36:45.217237 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e7ac2502-49c5-43e0-bb7b-e2645ccad650 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.043000 Sep 08 10:36:45.220217 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 15/26] 10.222.0.27 () {60 vars in 1164 bytes} [Thu Sep 8 10:36:45 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:36:45.228443 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-245e0309-9c49-476b-a073-302e6158452b tempest-AggregatesAdminTestV241-639686868 tempest-AggregatesAdminTestV241-639686868-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1934145356"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:36:45.238143 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.aggregate [None req-245e0309-9c49-476b-a073-302e6158452b tempest-AggregatesAdminTestV241-639686868 tempest-AggregatesAdminTestV241-639686868-project-admin] Generated uuid 7830c792-1b9e-4d09-98a5-d66ecb351d76 for aggregate {{(pid=128861) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 08 10:36:45.277966 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-245e0309-9c49-476b-a073-302e6158452b tempest-AggregatesAdminTestV241-639686868 tempest-AggregatesAdminTestV241-639686868-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.056641 Sep 08 10:36:45.278836 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 16/27] 10.222.0.27 () {62 vars in 1205 bytes} [Thu Sep 8 10:36:45 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:36:45.283690 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2b6973d1-8145-46c9-b9d9-ec04f67532fd tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-88846036", "id": 2061196778, "os-flavor-access:is_public": "True"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:36:45.305391 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f2559110-9976-442c-a081-767aeb793fac tempest-FlavorsExtraSpecsTestJSON-496929229 tempest-FlavorsExtraSpecsTestJSON-496929229-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:45.306862 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2b6973d1-8145-46c9-b9d9-ec04f67532fd tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.026850 Sep 08 10:36:45.307593 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 17/28] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:36:45 2022] POST /compute/v2.1/flavors => generated 427 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:36:45.327640 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f2559110-9976-442c-a081-767aeb793fac tempest-FlavorsExtraSpecsTestJSON-496929229 tempest-FlavorsExtraSpecsTestJSON-496929229-project] 10.222.0.27 "GET /compute/v2.1/flavors/772098848/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.350630 Sep 08 10:36:45.328885 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 12/29] 10.222.0.27 () {58 vars in 1200 bytes} [Thu Sep 8 10:36:44 2022] GET /compute/v2.1/flavors/772098848/os-extra_specs => generated 66 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:36:45.341416 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-df5a1873-962b-4e9a-b254-efff62186f78 tempest-QuotasAdminTestJSON-1017043201 tempest-QuotasAdminTestJSON-1017043201-project-admin] Calling method '.version_select at 0x7f68e53f9f70>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:45.550137 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3c35a7ac-1962-4d2b-86ca-0facf2006183 tempest-AggregatesAdminNegativeTestJSON-1094852279 tempest-AggregatesAdminNegativeTestJSON-1094852279-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-850501-12"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:36:45.554509 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-3c35a7ac-1962-4d2b-86ca-0facf2006183 tempest-AggregatesAdminNegativeTestJSON-1094852279 tempest-AggregatesAdminNegativeTestJSON-1094852279-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': 'b09ae3666ab54662a1177d5a4846e0ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eef52c589914f27b0461b81fa603192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:45.560147 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3c35a7ac-1962-4d2b-86ca-0facf2006183 tempest-AggregatesAdminNegativeTestJSON-1094852279 tempest-AggregatesAdminNegativeTestJSON-1094852279-project] Request method failure captured: Sep 08 10:36:45.560147 n-d-850501-12 devstack@n-api.service[128861]: request: POST /compute/v2.1/os-aggregates/2/action HTTP/1.1 Sep 08 10:36:45.560147 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:36:45.560147 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:36:45.560147 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:36:45.560147 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 40 Sep 08 10:36:45.560147 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:36:45.560147 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:36:45.560147 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:36:45.560147 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:36:45.560147 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcW2psWwH7qgDl5lB5Ns76DLKNYvqg7qV-R6a3j9SQpX6EhtX6sw7woCEBqo7bmYSR5iTwts_TgOPw5RjYQ_ZzjFpf3An69FmlwlZAB4ayhquw0iHJJ4djJf3BA4gUaMZYhyrFm1sM5LcV5OF6c0_cuBThWiJTf496Np_YojZjq5pbQ Sep 08 10:36:45.560147 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:36:45.560147 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:36:45.560147 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:36:45.560147 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:36:45.560147 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:36:45.560147 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:36:45.560147 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 5eef52c589914f27b0461b81fa603192 Sep 08 10:36:45.560147 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1094852279 Sep 08 10:36:45.560147 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:36:45.560147 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:36:45.561324 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5eef52c589914f27b0461b81fa603192"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5eef52c589914f27b0461b81fa603192"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5eef52c589914f27b0461b81fa603192"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5eef52c589914f27b0461b81fa603192"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:36:45.561324 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1094852279 Sep 08 10:36:45.561324 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 5eef52c589914f27b0461b81fa603192 Sep 08 10:36:45.561324 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1094852279 Sep 08 10:36:45.561324 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-AggregatesAdminNegativeTestJSON-1094852279-project Sep 08 10:36:45.561324 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:36:45.561324 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:36:45.561324 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: b09ae3666ab54662a1177d5a4846e0ca Sep 08 10:36:45.561324 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1094852279-project Sep 08 10:36:45.561324 n-d-850501-12 devstack@n-api.service[128861]: Sep 08 10:36:45.561324 n-d-850501-12 devstack@n-api.service[128861]: {"add_host": {"host": "n-h1-850501-12"}} Sep 08 10:36:45.561324 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:36:45.561324 n-d-850501-12 devstack@n-api.service[128861]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Sep 08 10:36:45.561998 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '2', 'body': {'add_host': {'host': 'n-h1-850501-12'}}} Sep 08 10:36:45.561998 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:36:45.561998 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:45.561998 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:36:45.561998 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:36:45.561998 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:36:45.561998 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:36:45.561998 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:36:45.561998 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:36:45.561998 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:36:45.561998 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:36:45.561998 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Sep 08 10:36:45.561998 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Sep 08 10:36:45.561998 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 10:36:45.561998 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 10:36:45.561998 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 10:36:45.561998 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 10:36:45.561998 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:36:45.561998 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:36:45.563011 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:36:45.563011 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:36:45.563011 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 10:36:45.563011 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 10:36:45.563011 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 10:36:45.563011 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 10:36:45.563011 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 10:36:45.563011 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 10:36:45.563011 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Sep 08 10:36:45.563011 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:36:45.563011 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:36:45.563011 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:36:45.563011 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:45.563011 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:36:45.563011 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:36:45.563011 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 10:36:45.563011 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 10:36:45.563011 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Sep 08 10:36:45.563011 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:36:45.564025 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3c35a7ac-1962-4d2b-86ca-0facf2006183 tempest-AggregatesAdminNegativeTestJSON-1094852279 tempest-AggregatesAdminNegativeTestJSON-1094852279-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:36:45.564025 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3c35a7ac-1962-4d2b-86ca-0facf2006183 tempest-AggregatesAdminNegativeTestJSON-1094852279 tempest-AggregatesAdminNegativeTestJSON-1094852279-project] 10.222.0.27 "POST /compute/v2.1/os-aggregates/2/action" status: 403 len: 118 microversion: 2.1 time: 0.253005 Sep 08 10:36:45.564025 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 18/30] 10.222.0.27 () {60 vars in 1191 bytes} [Thu Sep 8 10:36:45 2022] POST /compute/v2.1/os-aggregates/2/action => generated 118 bytes in 254 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:36:45.571847 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b4bf2e33-52b7-418e-be33-6992268cd082 tempest-AggregatesAdminTestV241-639686868 tempest-AggregatesAdminTestV241-639686868-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-731957701"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:36:45.696327 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b4bf2e33-52b7-418e-be33-6992268cd082 tempest-AggregatesAdminTestV241-639686868 tempest-AggregatesAdminTestV241-639686868-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-aggregates/3" status: 200 len: 298 microversion: 2.41 time: 0.132879 Sep 08 10:36:45.697826 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 19/31] 10.222.0.27 () {62 vars in 1210 bytes} [Thu Sep 8 10:36:45 2022] PUT /compute/v2.1/os-aggregates/3 => generated 298 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:36:45.703873 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a48a1334-0087-4263-8bba-c7b33bad4b8a tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:45.723360 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a48a1334-0087-4263-8bba-c7b33bad4b8a tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/2061196778" status: 202 len: 0 microversion: 2.1 time: 0.023993 Sep 08 10:36:45.725174 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 20/32] 10.222.0.27 () {58 vars in 1161 bytes} [Thu Sep 8 10:36:45 2022] DELETE /compute/v2.1/flavors/2061196778 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:36:45.731538 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-567375a0-33c4-430f-885a-1224d576dbd0 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:45.732513 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-567375a0-33c4-430f-885a-1224d576dbd0 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] [instance: e605c39e-7644-4842-8476-9c9af611282f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:45.747851 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-567375a0-33c4-430f-885a-1224d576dbd0 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:45.748607 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-567375a0-33c4-430f-885a-1224d576dbd0 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:45.749282 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-567375a0-33c4-430f-885a-1224d576dbd0 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:45.750177 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-567375a0-33c4-430f-885a-1224d576dbd0 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:45.750834 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-567375a0-33c4-430f-885a-1224d576dbd0 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:45.751454 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-567375a0-33c4-430f-885a-1224d576dbd0 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:45.812207 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-df5a1873-962b-4e9a-b254-efff62186f78 tempest-QuotasAdminTestJSON-1017043201 tempest-QuotasAdminTestJSON-1017043201-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/40fed67000b842d881cb0b8ed3777cb0/defaults" status: 200 len: 371 microversion: 2.1 time: 0.475218 Sep 08 10:36:45.812796 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 13/33] 10.222.0.27 () {58 vars in 1269 bytes} [Thu Sep 8 10:36:45 2022] GET /compute/v2.1/os-quota-sets/40fed67000b842d881cb0b8ed3777cb0/defaults => generated 371 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:36:45.818514 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8c609246-c87c-4d86-9473-077c49bd2c3f tempest-FlavorsExtraSpecsTestJSON-1547836576 tempest-FlavorsExtraSpecsTestJSON-1547836576-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:36:45.857336 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8c609246-c87c-4d86-9473-077c49bd2c3f tempest-FlavorsExtraSpecsTestJSON-1547836576 tempest-FlavorsExtraSpecsTestJSON-1547836576-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/772098848/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.043057 Sep 08 10:36:45.858631 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 14/34] 10.222.0.27 () {60 vars in 1221 bytes} [Thu Sep 8 10:36:45 2022] POST /compute/v2.1/flavors/772098848/os-extra_specs => generated 66 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:36:45.870318 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8b0369fd-2e32-4a86-b817-8758743b3c9b tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:45.911814 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8b0369fd-2e32-4a86-b817-8758743b3c9b tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.050568 Sep 08 10:36:45.917682 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 15/35] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Sep 8 10:36:45 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 08 10:36:45.923509 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e2e24d10-7597-4ce5-a6da-e173f06f620d tempest-AggregatesAdminTestV241-639686868 tempest-AggregatesAdminTestV241-639686868-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:45.933374 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e2e24d10-7597-4ce5-a6da-e173f06f620d tempest-AggregatesAdminTestV241-639686868 tempest-AggregatesAdminTestV241-639686868-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/3" status: 200 len: 298 microversion: 2.41 time: 0.014482 Sep 08 10:36:45.933881 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 16/36] 10.222.0.27 () {60 vars in 1190 bytes} [Thu Sep 8 10:36:45 2022] GET /compute/v2.1/os-aggregates/3 => generated 298 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:36:45.938480 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-563ffc33-7ce1-4b90-8001-385daf126e52 tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:45.968643 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-563ffc33-7ce1-4b90-8001-385daf126e52 tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.033703 Sep 08 10:36:45.969485 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 17/37] 10.222.0.27 () {58 vars in 1146 bytes} [Thu Sep 8 10:36:45 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:36:45.976122 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f9a35a92-cda0-4125-bf09-ca52b03dea8a tempest-FlavorsExtraSpecsTestJSON-496929229 tempest-FlavorsExtraSpecsTestJSON-496929229-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:45.993473 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f9a35a92-cda0-4125-bf09-ca52b03dea8a tempest-FlavorsExtraSpecsTestJSON-496929229 tempest-FlavorsExtraSpecsTestJSON-496929229-project] 10.222.0.27 "GET /compute/v2.1/flavors/772098848/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.022534 Sep 08 10:36:45.994055 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 18/38] 10.222.0.27 () {58 vars in 1242 bytes} [Thu Sep 8 10:36:45 2022] GET /compute/v2.1/flavors/772098848/os-extra_specs/hw:numa_nodes => generated 22 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:36:46.004849 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4991e484-112e-4486-819a-7740b1ce825d tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-780387843"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:36:46.009560 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.aggregate [None req-4991e484-112e-4486-819a-7740b1ce825d tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Generated uuid 597dc2ba-a496-429b-baba-8b7cfb682d1e for aggregate {{(pid=128862) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 08 10:36:46.019624 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=8,nova_api:DELETE=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:36:46.039666 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4991e484-112e-4486-819a-7740b1ce825d tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.039178 Sep 08 10:36:46.047320 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 19/39] 10.222.0.27 () {60 vars in 1164 bytes} [Thu Sep 8 10:36:45 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:36:46.051143 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ef713bef-2627-4107-891b-f79180d6455d tempest-AggregatesAdminTestV241-639686868 tempest-AggregatesAdminTestV241-639686868-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-850501-12"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:36:46.066498 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef713bef-2627-4107-891b-f79180d6455d tempest-AggregatesAdminTestV241-639686868 tempest-AggregatesAdminTestV241-639686868-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:46.068181 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef713bef-2627-4107-891b-f79180d6455d tempest-AggregatesAdminTestV241-639686868 tempest-AggregatesAdminTestV241-639686868-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:46.068626 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef713bef-2627-4107-891b-f79180d6455d tempest-AggregatesAdminTestV241-639686868 tempest-AggregatesAdminTestV241-639686868-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:46.204716 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ef713bef-2627-4107-891b-f79180d6455d tempest-AggregatesAdminTestV241-639686868 tempest-AggregatesAdminTestV241-639686868-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 314 microversion: 2.41 time: 0.157394 Sep 08 10:36:46.205654 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 20/40] 10.222.0.27 () {62 vars in 1232 bytes} [Thu Sep 8 10:36:46 2022] POST /compute/v2.1/os-aggregates/3/action => generated 314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:36:46.210949 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-61fb0fb6-7cc0-4e03-8729-6a14cbe79fcb tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1434391051", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:36:46.236161 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-61fb0fb6-7cc0-4e03-8729-6a14cbe79fcb tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.029374 Sep 08 10:36:46.237107 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 21/41] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:36:46 2022] POST /compute/v2.1/flavors => generated 507 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:36:46.248210 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f02d64c5-74b4-4857-99c8-cf83a20a2420 tempest-FlavorsExtraSpecsTestJSON-1547836576 tempest-FlavorsExtraSpecsTestJSON-1547836576-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:36:46.279174 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f02d64c5-74b4-4857-99c8-cf83a20a2420 tempest-FlavorsExtraSpecsTestJSON-1547836576 tempest-FlavorsExtraSpecsTestJSON-1547836576-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/772098848/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.036490 Sep 08 10:36:46.284509 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 22/42] 10.222.0.27 () {60 vars in 1221 bytes} [Thu Sep 8 10:36:46 2022] POST /compute/v2.1/flavors/772098848/os-extra_specs => generated 66 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:36:46.290509 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c58faeb9-faf5-42a2-9571-2b73933f84a6 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-26456349"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:36:46.310460 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c58faeb9-faf5-42a2-9571-2b73933f84a6 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2785b110-f847-4739-9d30-5b571c6d79f4(cell1) {{(pid=128862) load_cells /opt/stack/nova/nova/compute/api.py:319}} Sep 08 10:36:46.311225 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c58faeb9-faf5-42a2-9571-2b73933f84a6 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:46.311716 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c58faeb9-faf5-42a2-9571-2b73933f84a6 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:46.312282 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c58faeb9-faf5-42a2-9571-2b73933f84a6 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:46.320598 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c58faeb9-faf5-42a2-9571-2b73933f84a6 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:46.320952 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c58faeb9-faf5-42a2-9571-2b73933f84a6 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:46.321837 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c58faeb9-faf5-42a2-9571-2b73933f84a6 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:46.331470 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-c58faeb9-faf5-42a2-9571-2b73933f84a6 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-26456349 could not be found. Sep 08 10:36:46.336816 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c58faeb9-faf5-42a2-9571-2b73933f84a6 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Request method failure captured: Sep 08 10:36:46.336816 n-d-850501-12 devstack@n-api.service[128862]: request: POST /compute/v2.1/os-aggregates/4/action HTTP/1.1 Sep 08 10:36:46.336816 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:36:46.336816 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:36:46.336816 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:36:46.336816 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 56 Sep 08 10:36:46.336816 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:36:46.336816 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:36:46.336816 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:36:46.336816 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:36:46.336816 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcW42jKNF2wJ6tUgDr7GFhj8bDGclBm0y_GYAQnVvDAMYJ1jDUbUnOvdDZSin9luvRPOB6TjofqglWozsQ0mxm4M6iQFvXQru9-G8m76lXYiOi9vSC3hj03Cl53AEeaywrmiyKWkTCr0fuRfryKOtrDuR7P_LtA1MCxYImmijauXgZk Sep 08 10:36:46.336816 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:36:46.336816 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:36:46.336816 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:36:46.336816 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:36:46.336816 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:36:46.336816 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:36:46.336816 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 874e026251854684a06d3fd636701d17 Sep 08 10:36:46.336816 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1714194550 Sep 08 10:36:46.336816 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,admin,member Sep 08 10:36:46.336816 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,admin,member Sep 08 10:36:46.338155 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/874e026251854684a06d3fd636701d17"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/874e026251854684a06d3fd636701d17"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_874e026251854684a06d3fd636701d17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/874e026251854684a06d3fd636701d17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:36:46.338155 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1714194550 Sep 08 10:36:46.338155 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 874e026251854684a06d3fd636701d17 Sep 08 10:36:46.338155 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1714194550 Sep 08 10:36:46.338155 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin Sep 08 10:36:46.338155 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:36:46.338155 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:36:46.338155 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 55fc120859bb42faa1ba5cea5894d548 Sep 08 10:36:46.338155 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin Sep 08 10:36:46.338155 n-d-850501-12 devstack@n-api.service[128862]: Sep 08 10:36:46.338155 n-d-850501-12 devstack@n-api.service[128862]: {"add_host": {"host": "tempest-nonexist_host-26456349"}} Sep 08 10:36:46.338155 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:36:46.338155 n-d-850501-12 devstack@n-api.service[128862]: exception: Compute host tempest-nonexist_host-26456349 could not be found. Sep 08 10:36:46.338900 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '4', 'body': {'add_host': {'host': 'tempest-nonexist_host-26456349'}}} Sep 08 10:36:46.338900 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:36:46.338900 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:46.338900 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Sep 08 10:36:46.338900 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Sep 08 10:36:46.338900 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 10:36:46.338900 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 10:36:46.338900 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 08 10:36:46.338900 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 08 10:36:46.338900 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 08 10:36:46.338900 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 08 10:36:46.338900 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 08 10:36:46.338900 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 08 10:36:46.338900 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-26456349' is not mapped to any cell Sep 08 10:36:46.338900 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:36:46.338900 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:36:46.338900 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:36:46.338900 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:46.338900 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Sep 08 10:36:46.339909 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Sep 08 10:36:46.339909 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 08 10:36:46.339909 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 08 10:36:46.339909 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 08 10:36:46.339909 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:36:46.339909 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:36:46.339909 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:36:46.339909 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:46.339909 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Sep 08 10:36:46.339909 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Sep 08 10:36:46.339909 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 08 10:36:46.339909 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 08 10:36:46.339909 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:36:46.339909 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:36:46.339909 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:36:46.339909 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:36:46.339909 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 08 10:36:46.339909 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 08 10:36:46.339909 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Sep 08 10:36:46.339909 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Sep 08 10:36:46.340988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Sep 08 10:36:46.340988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Sep 08 10:36:46.340988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-26456349 could not be found. Sep 08 10:36:46.340988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:36:46.340988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:36:46.340988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:36:46.340988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:46.340988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:36:46.340988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:36:46.340988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:36:46.340988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:36:46.340988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:36:46.340988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:36:46.340988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:36:46.340988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:36:46.340988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Sep 08 10:36:46.340988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:36:46.340988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-26456349 could not be found. Sep 08 10:36:46.340988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:36:46.340988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:36:46.340988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:36:46.342171 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:46.342171 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:36:46.342171 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:36:46.342171 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:36:46.342171 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:36:46.342171 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-26456349 could not be found. Sep 08 10:36:46.342171 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:36:46.344623 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c58faeb9-faf5-42a2-9571-2b73933f84a6 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-26456349 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:36:46.345858 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c58faeb9-faf5-42a2-9571-2b73933f84a6 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/4/action" status: 404 len: 109 microversion: 2.1 time: 0.060002 Sep 08 10:36:46.346456 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 23/43] 10.222.0.27 () {60 vars in 1191 bytes} [Thu Sep 8 10:36:46 2022] POST /compute/v2.1/os-aggregates/4/action => generated 109 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:36:46.357599 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-56ed02a0-29d6-437c-ab17-935af0cfc9e0 tempest-AggregatesAdminTestV241-639686868 tempest-AggregatesAdminTestV241-639686868-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-850501-12"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:36:46.371962 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-56ed02a0-29d6-437c-ab17-935af0cfc9e0 tempest-AggregatesAdminTestV241-639686868 tempest-AggregatesAdminTestV241-639686868-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:46.372680 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-56ed02a0-29d6-437c-ab17-935af0cfc9e0 tempest-AggregatesAdminTestV241-639686868 tempest-AggregatesAdminTestV241-639686868-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:46.373581 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-56ed02a0-29d6-437c-ab17-935af0cfc9e0 tempest-AggregatesAdminTestV241-639686868 tempest-AggregatesAdminTestV241-639686868-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:46.391813 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-567375a0-33c4-430f-885a-1224d576dbd0 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdbe35f311e435ba9e0516f302ba519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb116f8d7dd4858a91c03e0a4310fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:46.430651 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-567375a0-33c4-430f-885a-1224d576dbd0 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] 10.222.0.27 "GET /compute/v2.1/servers/e605c39e-7644-4842-8476-9c9af611282f" status: 200 len: 1272 microversion: 2.1 time: 0.703543 Sep 08 10:36:46.432725 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 21/44] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:36:45 2022] GET /compute/v2.1/servers/e605c39e-7644-4842-8476-9c9af611282f => generated 1272 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:36:46.441118 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-19323ed1-ce40-4f88-b970-0a9c219ad50a tempest-QuotasAdminTestJSON-1017043201 tempest-QuotasAdminTestJSON-1017043201-project-admin] Action: 'update', calling method: .version_select at 0x7f68e55f1040>, body: {"quota_set": {"ram": "5120"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:36:46.561836 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-56ed02a0-29d6-437c-ab17-935af0cfc9e0 tempest-AggregatesAdminTestV241-639686868 tempest-AggregatesAdminTestV241-639686868-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 298 microversion: 2.41 time: 0.209680 Sep 08 10:36:46.562475 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 24/45] 10.222.0.27 () {62 vars in 1232 bytes} [Thu Sep 8 10:36:46 2022] POST /compute/v2.1/os-aggregates/3/action => generated 298 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:36:46.569365 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-03a6f39e-1fe0-4674-8bda-2b2d068faaa4 tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:46.591051 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-03a6f39e-1fe0-4674-8bda-2b2d068faaa4 tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/30ef9952-6ef0-46bd-8271-7c52c610a269" status: 202 len: 0 microversion: 2.1 time: 0.027022 Sep 08 10:36:46.591721 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 25/46] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:36:46 2022] DELETE /compute/v2.1/flavors/30ef9952-6ef0-46bd-8271-7c52c610a269 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:36:46.596830 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-de8bb0a8-56df-4ff0-9f94-0340e446c3d4 tempest-FlavorsExtraSpecsTestJSON-1547836576 tempest-FlavorsExtraSpecsTestJSON-1547836576-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:46.606400 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-de8bb0a8-56df-4ff0-9f94-0340e446c3d4 tempest-FlavorsExtraSpecsTestJSON-1547836576 tempest-FlavorsExtraSpecsTestJSON-1547836576-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/772098848/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.013613 Sep 08 10:36:46.606999 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 26/47] 10.222.0.27 () {58 vars in 1200 bytes} [Thu Sep 8 10:36:46 2022] GET /compute/v2.1/flavors/772098848/os-extra_specs => generated 66 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:36:46.618065 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-78cf52ba-6795-48d6-9b2a-4186852bcf21 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:46.647187 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-78cf52ba-6795-48d6-9b2a-4186852bcf21 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.032772 Sep 08 10:36:46.647778 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 27/48] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Sep 8 10:36:46 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 08 10:36:46.652536 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-af090e02-40ea-4897-b1ff-69058b3c59f4 tempest-AggregatesAdminTestV241-639686868 tempest-AggregatesAdminTestV241-639686868-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:46.675535 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-af090e02-40ea-4897-b1ff-69058b3c59f4 tempest-AggregatesAdminTestV241-639686868 tempest-AggregatesAdminTestV241-639686868-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.41 time: 0.025781 Sep 08 10:36:46.681230 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 28/49] 10.222.0.27 () {60 vars in 1193 bytes} [Thu Sep 8 10:36:46 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:36:46.687454 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3a94c958-3270-44c5-a35b-dea7cb9ab36e tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:46.721073 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3a94c958-3270-44c5-a35b-dea7cb9ab36e tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.038293 Sep 08 10:36:46.737396 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 29/50] 10.222.0.27 () {58 vars in 1146 bytes} [Thu Sep 8 10:36:46 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:36:46.750516 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-01be49c5-de1c-45e6-80f3-66fba9a2846a tempest-FlavorsExtraSpecsTestJSON-1547836576 tempest-FlavorsExtraSpecsTestJSON-1547836576-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:36:46.761850 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=8,nova_api:DELETE=8,nova_api:UPDATE=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:36:46.784308 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-01be49c5-de1c-45e6-80f3-66fba9a2846a tempest-FlavorsExtraSpecsTestJSON-1547836576 tempest-FlavorsExtraSpecsTestJSON-1547836576-project-admin] 10.222.0.27 "PUT /compute/v2.1/flavors/772098848/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.045518 Sep 08 10:36:46.785558 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 30/51] 10.222.0.27 () {60 vars in 1262 bytes} [Thu Sep 8 10:36:46 2022] PUT /compute/v2.1/flavors/772098848/os-extra_specs/hw:numa_nodes => generated 22 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:36:46.786448 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-19323ed1-ce40-4f88-b970-0a9c219ad50a tempest-QuotasAdminTestJSON-1017043201 tempest-QuotasAdminTestJSON-1017043201-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:46.788439 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-19323ed1-ce40-4f88-b970-0a9c219ad50a tempest-QuotasAdminTestJSON-1017043201 tempest-QuotasAdminTestJSON-1017043201-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:46.788963 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-19323ed1-ce40-4f88-b970-0a9c219ad50a tempest-QuotasAdminTestJSON-1017043201 tempest-QuotasAdminTestJSON-1017043201-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:46.791375 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-19323ed1-ce40-4f88-b970-0a9c219ad50a tempest-QuotasAdminTestJSON-1017043201 tempest-QuotasAdminTestJSON-1017043201-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:46.791832 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e75679a6-a2e2-40d8-93d6-46c6f42b67e4 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:36:46.791951 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-19323ed1-ce40-4f88-b970-0a9c219ad50a tempest-QuotasAdminTestJSON-1017043201 tempest-QuotasAdminTestJSON-1017043201-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:46.792635 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-19323ed1-ce40-4f88-b970-0a9c219ad50a tempest-QuotasAdminTestJSON-1017043201 tempest-QuotasAdminTestJSON-1017043201-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:46.797625 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e75679a6-a2e2-40d8-93d6-46c6f42b67e4 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Request method failure captured: Sep 08 10:36:46.797625 n-d-850501-12 devstack@n-api.service[128862]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 08 10:36:46.797625 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:36:46.797625 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:36:46.797625 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:36:46.797625 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 283 Sep 08 10:36:46.797625 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:36:46.797625 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:36:46.797625 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:36:46.797625 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:36:46.797625 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcW42jKNF2wJ6tUgDr7GFhj8bDGclBm0y_GYAQnVvDAMYJ1jDUbUnOvdDZSin9luvRPOB6TjofqglWozsQ0mxm4M6iQFvXQru9-G8m76lXYiOi9vSC3hj03Cl53AEeaywrmiyKWkTCr0fuRfryKOtrDuR7P_LtA1MCxYImmijauXgZk Sep 08 10:36:46.797625 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:36:46.797625 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:36:46.797625 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:36:46.797625 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:36:46.797625 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:36:46.797625 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:36:46.797625 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 874e026251854684a06d3fd636701d17 Sep 08 10:36:46.797625 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1714194550 Sep 08 10:36:46.797625 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,admin,member Sep 08 10:36:46.797625 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,admin,member Sep 08 10:36:46.798806 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/874e026251854684a06d3fd636701d17"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/874e026251854684a06d3fd636701d17"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_874e026251854684a06d3fd636701d17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/874e026251854684a06d3fd636701d17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:36:46.798806 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1714194550 Sep 08 10:36:46.798806 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 874e026251854684a06d3fd636701d17 Sep 08 10:36:46.798806 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1714194550 Sep 08 10:36:46.798806 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin Sep 08 10:36:46.798806 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:36:46.798806 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:36:46.798806 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 55fc120859bb42faa1ba5cea5894d548 Sep 08 10:36:46.798806 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin Sep 08 10:36:46.798806 n-d-850501-12 devstack@n-api.service[128862]: Sep 08 10:36:46.799334 n-d-850501-12 devstack@n-api.service[128862]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Sep 08 10:36:46.799334 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:36:46.799334 n-d-850501-12 devstack@n-api.service[128862]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 08 10:36:46.799334 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Sep 08 10:36:46.799334 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:36:46.799334 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:46.799334 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 10:36:46.799334 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 10:36:46.799334 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 10:36:46.799334 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise error Sep 08 10:36:46.799966 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 08 10:36:46.799966 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:36:46.799966 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Sep 08 10:36:46.799966 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 08 10:36:46.799966 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:36:46.799966 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Sep 08 10:36:46.799966 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 08 10:36:46.799966 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:36:46.799966 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:36:46.799966 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:36:46.799966 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:46.799966 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:36:46.799966 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:36:46.799966 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:36:46.799966 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:36:46.799966 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:36:46.799966 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:36:46.800866 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:36:46.800866 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:36:46.800866 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 10:36:46.800866 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 10:36:46.800866 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 10:36:46.800866 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 10:36:46.800866 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 10:36:46.800866 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 10:36:46.800866 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 08 10:36:46.800866 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:36:46.800866 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:36:46.800866 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:36:46.800866 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:46.800866 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:36:46.800866 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:36:46.802694 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 10:36:46.802694 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 10:36:46.802694 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 08 10:36:46.802694 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:36:46.803996 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e75679a6-a2e2-40d8-93d6-46c6f42b67e4 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:36:46.805284 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e75679a6-a2e2-40d8-93d6-46c6f42b67e4 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.018389 Sep 08 10:36:46.806474 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 31/52] 10.222.0.27 () {60 vars in 1165 bytes} [Thu Sep 8 10:36:46 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:36:46.812940 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9fecdcf2-aade-4505-b9fa-ce0b839de569 tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1754546271", "name": "tempest-test_aggregate-755476225"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:36:46.837932 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.aggregate [None req-9fecdcf2-aade-4505-b9fa-ce0b839de569 tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Generated uuid 7a22344f-81f4-493f-b349-6cfed7e2bc41 for aggregate {{(pid=128862) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 08 10:36:46.874894 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9fecdcf2-aade-4505-b9fa-ce0b839de569 tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.067185 Sep 08 10:36:46.876230 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 32/53] 10.222.0.27 () {60 vars in 1165 bytes} [Thu Sep 8 10:36:46 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:36:46.887166 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a78982f6-fb2c-4460-a0a4-f53ecfa5ec0d tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-725651991", "id": "11dc742a-8123-4dd5-a051-78d31f4c5bfc", "os-flavor-access:is_public": "True"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:36:46.914396 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a78982f6-fb2c-4460-a0a4-f53ecfa5ec0d tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.036916 Sep 08 10:36:46.925588 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 33/54] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:36:46 2022] POST /compute/v2.1/flavors => generated 506 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:36:46.927876 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-19323ed1-ce40-4f88-b970-0a9c219ad50a tempest-QuotasAdminTestJSON-1017043201 tempest-QuotasAdminTestJSON-1017043201-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/10176c91858b4986858a59e9b0b13275" status: 200 len: 328 microversion: 2.1 time: 0.491900 Sep 08 10:36:46.928969 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 22/55] 10.222.0.27 () {60 vars in 1262 bytes} [Thu Sep 8 10:36:46 2022] PUT /compute/v2.1/os-quota-sets/10176c91858b4986858a59e9b0b13275 => generated 328 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:36:46.933971 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f169d743-5627-46a8-9068-80fcd4270c9e tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:36:46.935471 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-09597998-e69d-4701-acc1-23f6f3f63a40 tempest-FlavorsExtraSpecsTestJSON-1547836576 tempest-FlavorsExtraSpecsTestJSON-1547836576-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:46.940674 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f169d743-5627-46a8-9068-80fcd4270c9e tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Request method failure captured: Sep 08 10:36:46.940674 n-d-850501-12 devstack@n-api.service[128861]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 08 10:36:46.940674 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:36:46.940674 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:36:46.940674 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:36:46.940674 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 27 Sep 08 10:36:46.940674 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:36:46.940674 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:36:46.940674 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:36:46.940674 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:36:46.940674 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcW42jKNF2wJ6tUgDr7GFhj8bDGclBm0y_GYAQnVvDAMYJ1jDUbUnOvdDZSin9luvRPOB6TjofqglWozsQ0mxm4M6iQFvXQru9-G8m76lXYiOi9vSC3hj03Cl53AEeaywrmiyKWkTCr0fuRfryKOtrDuR7P_LtA1MCxYImmijauXgZk Sep 08 10:36:46.940674 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:36:46.940674 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:36:46.940674 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:36:46.940674 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:36:46.940674 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:36:46.940674 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:36:46.940674 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 874e026251854684a06d3fd636701d17 Sep 08 10:36:46.940674 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1714194550 Sep 08 10:36:46.940674 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,admin,member Sep 08 10:36:46.940674 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,admin,member Sep 08 10:36:46.941882 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/874e026251854684a06d3fd636701d17"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/874e026251854684a06d3fd636701d17"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_874e026251854684a06d3fd636701d17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/874e026251854684a06d3fd636701d17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:36:46.941882 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1714194550 Sep 08 10:36:46.941882 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 874e026251854684a06d3fd636701d17 Sep 08 10:36:46.941882 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1714194550 Sep 08 10:36:46.941882 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin Sep 08 10:36:46.941882 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:36:46.941882 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:36:46.941882 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 55fc120859bb42faa1ba5cea5894d548 Sep 08 10:36:46.941882 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin Sep 08 10:36:46.941882 n-d-850501-12 devstack@n-api.service[128861]: Sep 08 10:36:46.941882 n-d-850501-12 devstack@n-api.service[128861]: {"aggregate": {"name": ""}} Sep 08 10:36:46.941882 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:36:46.941882 n-d-850501-12 devstack@n-api.service[128861]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 08 10:36:46.943174 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'body': {'aggregate': {'name': ''}}} Sep 08 10:36:46.943174 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:36:46.943174 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:46.943174 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 10:36:46.943174 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 10:36:46.943174 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 10:36:46.943174 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise error Sep 08 10:36:46.943174 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 08 10:36:46.943174 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:36:46.943174 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Sep 08 10:36:46.943174 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 08 10:36:46.943174 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:36:46.943174 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Sep 08 10:36:46.943174 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi '' Sep 08 10:36:46.943174 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:36:46.943174 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:36:46.943174 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:36:46.943174 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:46.943174 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:36:46.943174 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:36:46.943174 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:36:46.943174 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:36:46.943174 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:36:46.944452 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:36:46.944452 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:36:46.944452 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:36:46.944452 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 10:36:46.944452 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 10:36:46.944452 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 10:36:46.944452 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 10:36:46.944452 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 10:36:46.944452 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 10:36:46.944452 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 08 10:36:46.944452 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:36:46.944452 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:36:46.944452 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:36:46.944452 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:46.944452 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:36:46.944452 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:36:46.944452 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 10:36:46.944452 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 10:36:46.944452 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 08 10:36:46.944452 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:36:46.947475 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f169d743-5627-46a8-9068-80fcd4270c9e tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:36:46.948837 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-09597998-e69d-4701-acc1-23f6f3f63a40 tempest-FlavorsExtraSpecsTestJSON-1547836576 tempest-FlavorsExtraSpecsTestJSON-1547836576-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/772098848/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.020224 Sep 08 10:36:46.949317 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f169d743-5627-46a8-9068-80fcd4270c9e tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.019295 Sep 08 10:36:46.949769 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 34/56] 10.222.0.27 () {58 vars in 1200 bytes} [Thu Sep 8 10:36:46 2022] GET /compute/v2.1/flavors/772098848/os-extra_specs => generated 66 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:36:46.950471 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 23/57] 10.222.0.27 () {60 vars in 1164 bytes} [Thu Sep 8 10:36:46 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:36:46.962547 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9531dae1-8a2c-429a-895f-a76eccd919fc tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:46.965486 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c03030c5-0c8f-495b-ab75-50e35302cfef tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:46.976597 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9531dae1-8a2c-429a-895f-a76eccd919fc tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates" status: 200 len: 302 microversion: 2.1 time: 0.025537 Sep 08 10:36:46.984098 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 35/58] 10.222.0.27 () {58 vars in 1143 bytes} [Thu Sep 8 10:36:46 2022] GET /compute/v2.1/os-aggregates => generated 302 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:36:46.984098 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d8073f99-ef58-4c86-9709-a35ea49fcd7a tempest-QuotasAdminTestJSON-1017043201 tempest-QuotasAdminTestJSON-1017043201-project-admin] Calling method '.version_select at 0x7f68e53f95e0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:47.008716 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c03030c5-0c8f-495b-ab75-50e35302cfef tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/11dc742a-8123-4dd5-a051-78d31f4c5bfc" status: 202 len: 0 microversion: 2.1 time: 0.056993 Sep 08 10:36:47.012342 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 24/59] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:36:46 2022] DELETE /compute/v2.1/flavors/11dc742a-8123-4dd5-a051-78d31f4c5bfc => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:36:47.014878 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e6697e3c-1518-4987-9543-9548dc135cec tempest-AggregatesAdminNegativeTestJSON-1094852279 tempest-AggregatesAdminNegativeTestJSON-1094852279-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-583802774"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:36:47.019223 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e6697e3c-1518-4987-9543-9548dc135cec tempest-AggregatesAdminNegativeTestJSON-1094852279 tempest-AggregatesAdminNegativeTestJSON-1094852279-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': 'b09ae3666ab54662a1177d5a4846e0ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eef52c589914f27b0461b81fa603192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:47.021807 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e6697e3c-1518-4987-9543-9548dc135cec tempest-AggregatesAdminNegativeTestJSON-1094852279 tempest-AggregatesAdminNegativeTestJSON-1094852279-project] Request method failure captured: Sep 08 10:36:47.021807 n-d-850501-12 devstack@n-api.service[128861]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 08 10:36:47.021807 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:36:47.021807 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:36:47.021807 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:36:47.021807 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 59 Sep 08 10:36:47.021807 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:36:47.021807 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:36:47.021807 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:36:47.021807 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:36:47.021807 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcW2psWwH7qgDl5lB5Ns76DLKNYvqg7qV-R6a3j9SQpX6EhtX6sw7woCEBqo7bmYSR5iTwts_TgOPw5RjYQ_ZzjFpf3An69FmlwlZAB4ayhquw0iHJJ4djJf3BA4gUaMZYhyrFm1sM5LcV5OF6c0_cuBThWiJTf496Np_YojZjq5pbQ Sep 08 10:36:47.021807 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:36:47.021807 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:36:47.021807 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:36:47.021807 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:36:47.021807 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:36:47.021807 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:36:47.021807 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 5eef52c589914f27b0461b81fa603192 Sep 08 10:36:47.021807 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1094852279 Sep 08 10:36:47.021807 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:36:47.021807 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:36:47.022994 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5eef52c589914f27b0461b81fa603192"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5eef52c589914f27b0461b81fa603192"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5eef52c589914f27b0461b81fa603192"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5eef52c589914f27b0461b81fa603192"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:36:47.022994 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1094852279 Sep 08 10:36:47.022994 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 5eef52c589914f27b0461b81fa603192 Sep 08 10:36:47.022994 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1094852279 Sep 08 10:36:47.022994 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-AggregatesAdminNegativeTestJSON-1094852279-project Sep 08 10:36:47.022994 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:36:47.022994 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:36:47.022994 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: b09ae3666ab54662a1177d5a4846e0ca Sep 08 10:36:47.022994 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1094852279-project Sep 08 10:36:47.022994 n-d-850501-12 devstack@n-api.service[128861]: Sep 08 10:36:47.022994 n-d-850501-12 devstack@n-api.service[128861]: {"aggregate": {"name": "tempest-test_aggregate-583802774"}} Sep 08 10:36:47.022994 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:36:47.022994 n-d-850501-12 devstack@n-api.service[128861]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Sep 08 10:36:47.023697 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-583802774'}}} Sep 08 10:36:47.023697 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:36:47.023697 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:47.023697 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:36:47.023697 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:36:47.023697 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:36:47.023697 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:36:47.023697 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:36:47.023697 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:36:47.023697 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:36:47.023697 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:36:47.023697 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:36:47.023697 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:36:47.023697 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Sep 08 10:36:47.023697 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Sep 08 10:36:47.023697 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 10:36:47.023697 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 10:36:47.023697 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 10:36:47.023697 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 10:36:47.024663 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:36:47.024663 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:36:47.024663 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:36:47.024663 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:36:47.024663 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 10:36:47.024663 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 10:36:47.024663 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 10:36:47.024663 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 10:36:47.024663 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 10:36:47.024663 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 10:36:47.024663 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Sep 08 10:36:47.024663 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:36:47.024663 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:36:47.024663 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:36:47.024663 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:47.024663 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:36:47.024663 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:36:47.024663 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 10:36:47.024663 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 10:36:47.024663 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Sep 08 10:36:47.025752 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:36:47.025752 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e6697e3c-1518-4987-9543-9548dc135cec tempest-AggregatesAdminNegativeTestJSON-1094852279 tempest-AggregatesAdminNegativeTestJSON-1094852279-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:36:47.025752 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e6697e3c-1518-4987-9543-9548dc135cec tempest-AggregatesAdminNegativeTestJSON-1094852279 tempest-AggregatesAdminNegativeTestJSON-1094852279-project] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.012810 Sep 08 10:36:47.025752 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 25/60] 10.222.0.27 () {60 vars in 1164 bytes} [Thu Sep 8 10:36:47 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:36:47.032341 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-46fc55b3-0584-4d77-ab27-d798a81c7cbc tempest-FlavorsExtraSpecsTestJSON-1547836576 tempest-FlavorsExtraSpecsTestJSON-1547836576-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:47.083498 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-46fc55b3-0584-4d77-ab27-d798a81c7cbc tempest-FlavorsExtraSpecsTestJSON-1547836576 tempest-FlavorsExtraSpecsTestJSON-1547836576-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/772098848/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.058223 Sep 08 10:36:47.084497 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 26/61] 10.222.0.27 () {58 vars in 1245 bytes} [Thu Sep 8 10:36:47 2022] DELETE /compute/v2.1/flavors/772098848/os-extra_specs/hw:numa_nodes => generated 0 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 08 10:36:47.091328 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-37dd64ee-f582-47f5-85b0-0c96500bfc91 tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-850501-12"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:36:47.102711 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-37dd64ee-f582-47f5-85b0-0c96500bfc91 tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:47.103195 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-37dd64ee-f582-47f5-85b0-0c96500bfc91 tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:47.103763 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-37dd64ee-f582-47f5-85b0-0c96500bfc91 tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:47.298877 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-37dd64ee-f582-47f5-85b0-0c96500bfc91 tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 315 microversion: 2.1 time: 0.212685 Sep 08 10:36:47.300207 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 27/62] 10.222.0.27 () {60 vars in 1191 bytes} [Thu Sep 8 10:36:47 2022] POST /compute/v2.1/os-aggregates/5/action => generated 315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:36:47.328783 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a378d562-6df0-4b44-98bc-f080ef34cfe6 tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:47.359554 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a378d562-6df0-4b44-98bc-f080ef34cfe6 tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.058120 Sep 08 10:36:47.375431 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 28/63] 10.222.0.27 () {58 vars in 1146 bytes} [Thu Sep 8 10:36:47 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:36:47.385062 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9f4c2103-03a7-4385-a7c6-803c509d3d63 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1234188060"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:36:47.389391 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.aggregate [None req-9f4c2103-03a7-4385-a7c6-803c509d3d63 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Generated uuid 8b9700c3-2987-48c2-bb08-ecf6e4b4aa86 for aggregate {{(pid=128861) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 08 10:36:47.426627 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9f4c2103-03a7-4385-a7c6-803c509d3d63 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.044511 Sep 08 10:36:47.428072 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 29/64] 10.222.0.27 () {60 vars in 1164 bytes} [Thu Sep 8 10:36:47 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:36:47.438344 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a58bc6e2-900f-41df-b5d1-802d309dde2d tempest-FlavorsExtraSpecsTestJSON-1547836576 tempest-FlavorsExtraSpecsTestJSON-1547836576-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:47.466671 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a58bc6e2-900f-41df-b5d1-802d309dde2d tempest-FlavorsExtraSpecsTestJSON-1547836576 tempest-FlavorsExtraSpecsTestJSON-1547836576-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/772098848/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.034524 Sep 08 10:36:47.467553 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 30/65] 10.222.0.27 () {58 vars in 1245 bytes} [Thu Sep 8 10:36:47 2022] DELETE /compute/v2.1/flavors/772098848/os-extra_specs/hw:cpu_policy => generated 0 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 08 10:36:47.476025 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8645544a-747c-4360-9a96-b8375d831d89 tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-501769292", "id": 103327002, "os-flavor-access:is_public": "True"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:36:47.511094 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8645544a-747c-4360-9a96-b8375d831d89 tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.040066 Sep 08 10:36:47.513882 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 31/66] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:36:47 2022] POST /compute/v2.1/flavors => generated 410 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:36:47.524243 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-70ea7bfb-bb9c-4060-ba30-5b9d2ef67142 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1234188060"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:36:47.531147 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.aggregate [None req-70ea7bfb-bb9c-4060-ba30-5b9d2ef67142 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Generated uuid 7f55a815-47b4-4710-8b9e-8d5dbbd7da3d for aggregate {{(pid=128861) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 08 10:36:47.554060 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d8073f99-ef58-4c86-9709-a35ea49fcd7a tempest-QuotasAdminTestJSON-1017043201 tempest-QuotasAdminTestJSON-1017043201-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:47.555201 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d8073f99-ef58-4c86-9709-a35ea49fcd7a tempest-QuotasAdminTestJSON-1017043201 tempest-QuotasAdminTestJSON-1017043201-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:47.555677 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d8073f99-ef58-4c86-9709-a35ea49fcd7a tempest-QuotasAdminTestJSON-1017043201 tempest-QuotasAdminTestJSON-1017043201-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:47.556997 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-70ea7bfb-bb9c-4060-ba30-5b9d2ef67142 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1234188060 already exists. Sep 08 10:36:47.557158 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d8073f99-ef58-4c86-9709-a35ea49fcd7a tempest-QuotasAdminTestJSON-1017043201 tempest-QuotasAdminTestJSON-1017043201-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:47.557548 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d8073f99-ef58-4c86-9709-a35ea49fcd7a tempest-QuotasAdminTestJSON-1017043201 tempest-QuotasAdminTestJSON-1017043201-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:47.560023 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d8073f99-ef58-4c86-9709-a35ea49fcd7a tempest-QuotasAdminTestJSON-1017043201 tempest-QuotasAdminTestJSON-1017043201-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:47.576442 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-70ea7bfb-bb9c-4060-ba30-5b9d2ef67142 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Request method failure captured: Sep 08 10:36:47.576442 n-d-850501-12 devstack@n-api.service[128861]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 08 10:36:47.576442 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:36:47.576442 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:36:47.576442 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:36:47.576442 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 60 Sep 08 10:36:47.576442 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:36:47.576442 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:36:47.576442 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:36:47.576442 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:36:47.576442 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcW42jKNF2wJ6tUgDr7GFhj8bDGclBm0y_GYAQnVvDAMYJ1jDUbUnOvdDZSin9luvRPOB6TjofqglWozsQ0mxm4M6iQFvXQru9-G8m76lXYiOi9vSC3hj03Cl53AEeaywrmiyKWkTCr0fuRfryKOtrDuR7P_LtA1MCxYImmijauXgZk Sep 08 10:36:47.576442 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:36:47.576442 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:36:47.576442 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:36:47.576442 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:36:47.576442 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:36:47.576442 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:36:47.576442 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 874e026251854684a06d3fd636701d17 Sep 08 10:36:47.576442 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1714194550 Sep 08 10:36:47.576442 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,admin,member Sep 08 10:36:47.576442 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,admin,member Sep 08 10:36:47.577768 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/874e026251854684a06d3fd636701d17"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/874e026251854684a06d3fd636701d17"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_874e026251854684a06d3fd636701d17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/874e026251854684a06d3fd636701d17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:36:47.577768 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1714194550 Sep 08 10:36:47.577768 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 874e026251854684a06d3fd636701d17 Sep 08 10:36:47.577768 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1714194550 Sep 08 10:36:47.577768 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin Sep 08 10:36:47.577768 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:36:47.577768 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:36:47.577768 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 55fc120859bb42faa1ba5cea5894d548 Sep 08 10:36:47.577768 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin Sep 08 10:36:47.577768 n-d-850501-12 devstack@n-api.service[128861]: Sep 08 10:36:47.577768 n-d-850501-12 devstack@n-api.service[128861]: {"aggregate": {"name": "tempest-test_aggregate-1234188060"}} Sep 08 10:36:47.577768 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:36:47.577768 n-d-850501-12 devstack@n-api.service[128861]: exception: Aggregate tempest-test_aggregate-1234188060 already exists. Sep 08 10:36:47.578612 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1234188060'}}} Sep 08 10:36:47.578612 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:36:47.578612 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:47.578612 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Sep 08 10:36:47.578612 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Sep 08 10:36:47.578612 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 08 10:36:47.578612 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 08 10:36:47.578612 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:36:47.578612 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:36:47.578612 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:36:47.578612 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:36:47.578612 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 08 10:36:47.578612 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 08 10:36:47.578612 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Sep 08 10:36:47.578612 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi aggregate.create() Sep 08 10:36:47.578612 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 08 10:36:47.578612 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 08 10:36:47.578612 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Sep 08 10:36:47.578612 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Sep 08 10:36:47.579785 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 08 10:36:47.579785 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 08 10:36:47.579785 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Sep 08 10:36:47.579785 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Sep 08 10:36:47.579785 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1234188060 already exists. Sep 08 10:36:47.579785 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:36:47.579785 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:36:47.579785 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:36:47.579785 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:47.579785 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:36:47.579785 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:36:47.579785 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:36:47.579785 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:36:47.579785 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:36:47.579785 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:36:47.579785 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:36:47.579785 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:36:47.579785 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:36:47.579785 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:36:47.579785 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Sep 08 10:36:47.580988 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Sep 08 10:36:47.580988 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1234188060 already exists. Sep 08 10:36:47.580988 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:36:47.580988 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:36:47.580988 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:36:47.580988 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:47.580988 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:36:47.580988 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:36:47.580988 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:36:47.580988 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:36:47.580988 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1234188060 already exists. Sep 08 10:36:47.580988 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:36:47.584283 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-70ea7bfb-bb9c-4060-ba30-5b9d2ef67142 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1234188060 already exists. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:36:47.588149 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-70ea7bfb-bb9c-4060-ba30-5b9d2ef67142 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.073471 Sep 08 10:36:47.589932 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 32/67] 10.222.0.27 () {60 vars in 1164 bytes} [Thu Sep 8 10:36:47 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 76 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:36:47.603021 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d3eaa86f-d96d-4bfd-81ff-954dda0858d5 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:47.605526 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d3eaa86f-d96d-4bfd-81ff-954dda0858d5 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] [instance: e605c39e-7644-4842-8476-9c9af611282f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:47.621228 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d3eaa86f-d96d-4bfd-81ff-954dda0858d5 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:47.622185 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d3eaa86f-d96d-4bfd-81ff-954dda0858d5 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:47.623733 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d3eaa86f-d96d-4bfd-81ff-954dda0858d5 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:47.625889 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d3eaa86f-d96d-4bfd-81ff-954dda0858d5 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:47.627819 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d8073f99-ef58-4c86-9709-a35ea49fcd7a tempest-QuotasAdminTestJSON-1017043201 tempest-QuotasAdminTestJSON-1017043201-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/10176c91858b4986858a59e9b0b13275/detail" status: 200 len: 916 microversion: 2.1 time: 0.649409 Sep 08 10:36:47.628524 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d3eaa86f-d96d-4bfd-81ff-954dda0858d5 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:47.629176 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d3eaa86f-d96d-4bfd-81ff-954dda0858d5 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:47.631347 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 36/68] 10.222.0.27 () {58 vars in 1263 bytes} [Thu Sep 8 10:36:46 2022] GET /compute/v2.1/os-quota-sets/10176c91858b4986858a59e9b0b13275/detail => generated 916 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:36:47.639289 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-23026d22-0190-49c7-9110-bde23fc0a93a tempest-FlavorsExtraSpecsTestJSON-1547836576 tempest-FlavorsExtraSpecsTestJSON-1547836576-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:47.659622 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-23026d22-0190-49c7-9110-bde23fc0a93a tempest-FlavorsExtraSpecsTestJSON-1547836576 tempest-FlavorsExtraSpecsTestJSON-1547836576-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/772098848/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.024193 Sep 08 10:36:47.665767 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 37/69] 10.222.0.27 () {58 vars in 1200 bytes} [Thu Sep 8 10:36:47 2022] GET /compute/v2.1/flavors/772098848/os-extra_specs => generated 19 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:36:47.671029 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-15da8fa1-41d6-481d-b19f-c8a5a385624a tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:47.689526 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-15da8fa1-41d6-481d-b19f-c8a5a385624a tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/103327002" status: 200 len: 410 microversion: 2.1 time: 0.019747 Sep 08 10:36:47.691233 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 38/70] 10.222.0.27 () {58 vars in 1155 bytes} [Thu Sep 8 10:36:47 2022] GET /compute/v2.1/flavors/103327002 => generated 410 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:36:47.702951 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bc57bbd1-96fd-4dfa-acb4-b14c82fc41b8 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:47.749777 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bc57bbd1-96fd-4dfa-acb4-b14c82fc41b8 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.057072 Sep 08 10:36:47.754739 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 39/71] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Sep 8 10:36:47 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 08 10:36:47.760929 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f92bbd55-136e-461d-aca4-c80d296e5751 tempest-FlavorsExtraSpecsTestJSON-1547836576 tempest-FlavorsExtraSpecsTestJSON-1547836576-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:47.777535 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=5,nova_api:SAVEPOINT=4,nova_api:RELEASE=4,nova_api:DELETE=11,nova_api:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:36:47.800165 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d3eaa86f-d96d-4bfd-81ff-954dda0858d5 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdbe35f311e435ba9e0516f302ba519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb116f8d7dd4858a91c03e0a4310fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:47.811572 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d3eaa86f-d96d-4bfd-81ff-954dda0858d5 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] 10.222.0.27 "GET /compute/v2.1/servers/e605c39e-7644-4842-8476-9c9af611282f" status: 200 len: 1278 microversion: 2.1 time: 0.220269 Sep 08 10:36:47.815110 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f92bbd55-136e-461d-aca4-c80d296e5751 tempest-FlavorsExtraSpecsTestJSON-1547836576 tempest-FlavorsExtraSpecsTestJSON-1547836576-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/772098848" status: 202 len: 0 microversion: 2.1 time: 0.059154 Sep 08 10:36:47.816413 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 40/73] 10.222.0.27 () {58 vars in 1158 bytes} [Thu Sep 8 10:36:47 2022] DELETE /compute/v2.1/flavors/772098848 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:36:47.819186 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 33/73] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:36:47 2022] GET /compute/v2.1/servers/e605c39e-7644-4842-8476-9c9af611282f => generated 1278 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:36:48.170206 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7cd2760f-2407-4841-85de-9edd0d2d3b9a tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-319181933", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "availability_zone": "tempest-test_az-1754546271"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:36:48.232940 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7cd2760f-2407-4841-85de-9edd0d2d3b9a tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:48.233705 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7cd2760f-2407-4841-85de-9edd0d2d3b9a tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:48.234288 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7cd2760f-2407-4841-85de-9edd0d2d3b9a tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:48.235472 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7cd2760f-2407-4841-85de-9edd0d2d3b9a tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:48.236561 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7cd2760f-2407-4841-85de-9edd0d2d3b9a tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:48.237434 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7cd2760f-2407-4841-85de-9edd0d2d3b9a tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:48.391388 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4ed82b54-c9c7-424e-87af-86da03ab34b8 tempest-FlavorsAdminTestJSON-1127336046 tempest-FlavorsAdminTestJSON-1127336046-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:48.460045 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-7cd2760f-2407-4841-85de-9edd0d2d3b9a tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] validate_networks() for None {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:36:48.480302 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4ed82b54-c9c7-424e-87af-86da03ab34b8 tempest-FlavorsAdminTestJSON-1127336046 tempest-FlavorsAdminTestJSON-1127336046-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5391 microversion: 2.1 time: 0.660265 Sep 08 10:36:48.482834 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 41/74] 10.222.0.27 () {58 vars in 1146 bytes} [Thu Sep 8 10:36:47 2022] GET /compute/v2.1/flavors/detail => generated 5391 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:36:48.496788 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b52170c3-2c2e-450c-8fbd-a50d55ab2d35 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-195681346"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:36:48.511348 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.aggregate [None req-b52170c3-2c2e-450c-8fbd-a50d55ab2d35 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Generated uuid 2f26f9f4-c797-4b7a-94f6-efcb6464a040 for aggregate {{(pid=128862) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 08 10:36:48.569822 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b52170c3-2c2e-450c-8fbd-a50d55ab2d35 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.085268 Sep 08 10:36:48.579291 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 42/75] 10.222.0.27 () {60 vars in 1164 bytes} [Thu Sep 8 10:36:48 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:36:48.591085 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c3c1cada-a6b8-48bd-a354-29c7fc51c372 tempest-FlavorsExtraSpecsTestJSON-1547836576 tempest-FlavorsExtraSpecsTestJSON-1547836576-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:48.637562 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c3c1cada-a6b8-48bd-a354-29c7fc51c372 tempest-FlavorsExtraSpecsTestJSON-1547836576 tempest-FlavorsExtraSpecsTestJSON-1547836576-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5391 microversion: 2.1 time: 0.056560 Sep 08 10:36:48.642548 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 43/76] 10.222.0.27 () {58 vars in 1146 bytes} [Thu Sep 8 10:36:48 2022] GET /compute/v2.1/flavors/detail => generated 5391 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:36:48.650984 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-83b1e153-aab7-47d1-8833-329b457d4831 tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:48.750336 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-83b1e153-aab7-47d1-8833-329b457d4831 tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/103327002" status: 202 len: 0 microversion: 2.1 time: 0.102571 Sep 08 10:36:48.750336 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 44/77] 10.222.0.27 () {58 vars in 1158 bytes} [Thu Sep 8 10:36:48 2022] DELETE /compute/v2.1/flavors/103327002 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:36:48.763538 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0e2ed435-1eb3-45be-b2a9-abb164c4a435 tempest-AggregatesAdminNegativeTestJSON-1094852279 tempest-AggregatesAdminNegativeTestJSON-1094852279-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:48.765523 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0e2ed435-1eb3-45be-b2a9-abb164c4a435 tempest-AggregatesAdminNegativeTestJSON-1094852279 tempest-AggregatesAdminNegativeTestJSON-1094852279-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': 'b09ae3666ab54662a1177d5a4846e0ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eef52c589914f27b0461b81fa603192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:48.773950 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0e2ed435-1eb3-45be-b2a9-abb164c4a435 tempest-AggregatesAdminNegativeTestJSON-1094852279 tempest-AggregatesAdminNegativeTestJSON-1094852279-project] Request method failure captured: Sep 08 10:36:48.773950 n-d-850501-12 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Sep 08 10:36:48.773950 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:36:48.773950 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:36:48.773950 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:36:48.773950 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:36:48.773950 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:36:48.773950 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:36:48.773950 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:36:48.773950 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:36:48.773950 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcW2psWwH7qgDl5lB5Ns76DLKNYvqg7qV-R6a3j9SQpX6EhtX6sw7woCEBqo7bmYSR5iTwts_TgOPw5RjYQ_ZzjFpf3An69FmlwlZAB4ayhquw0iHJJ4djJf3BA4gUaMZYhyrFm1sM5LcV5OF6c0_cuBThWiJTf496Np_YojZjq5pbQ Sep 08 10:36:48.773950 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:36:48.773950 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:36:48.773950 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:36:48.773950 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:36:48.773950 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:36:48.773950 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:36:48.773950 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 5eef52c589914f27b0461b81fa603192 Sep 08 10:36:48.773950 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1094852279 Sep 08 10:36:48.773950 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:36:48.773950 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:36:48.776595 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5eef52c589914f27b0461b81fa603192"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5eef52c589914f27b0461b81fa603192"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5eef52c589914f27b0461b81fa603192"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5eef52c589914f27b0461b81fa603192"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:36:48.776595 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1094852279 Sep 08 10:36:48.776595 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 5eef52c589914f27b0461b81fa603192 Sep 08 10:36:48.776595 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1094852279 Sep 08 10:36:48.776595 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-AggregatesAdminNegativeTestJSON-1094852279-project Sep 08 10:36:48.776595 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:36:48.776595 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:36:48.776595 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: b09ae3666ab54662a1177d5a4846e0ca Sep 08 10:36:48.776595 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1094852279-project Sep 08 10:36:48.776595 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:36:48.776595 n-d-850501-12 devstack@n-api.service[128862]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Sep 08 10:36:48.776595 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '7'} Sep 08 10:36:48.778344 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:36:48.778344 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:48.778344 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:36:48.778344 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:36:48.778344 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:36:48.778344 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:36:48.778344 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:36:48.778344 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:36:48.778344 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Sep 08 10:36:48.778344 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Sep 08 10:36:48.778344 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 10:36:48.778344 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 10:36:48.778344 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 10:36:48.778344 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 10:36:48.778344 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:36:48.778344 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:36:48.778344 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:36:48.778344 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:36:48.778344 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 10:36:48.779369 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 10:36:48.779369 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 10:36:48.779369 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 10:36:48.779369 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 10:36:48.779369 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 10:36:48.779369 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Sep 08 10:36:48.779369 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:36:48.779369 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:36:48.779369 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:36:48.779369 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:48.779369 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:36:48.779369 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:36:48.779369 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 10:36:48.779369 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 10:36:48.779369 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Sep 08 10:36:48.779369 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:36:48.779369 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0e2ed435-1eb3-45be-b2a9-abb164c4a435 tempest-AggregatesAdminNegativeTestJSON-1094852279 tempest-AggregatesAdminNegativeTestJSON-1094852279-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:36:48.783297 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0e2ed435-1eb3-45be-b2a9-abb164c4a435 tempest-AggregatesAdminNegativeTestJSON-1094852279 tempest-AggregatesAdminNegativeTestJSON-1094852279-project] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/7" status: 403 len: 116 microversion: 2.1 time: 0.025876 Sep 08 10:36:48.783297 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 45/78] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Sep 8 10:36:48 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 116 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:36:48.791140 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9795d52f-9422-4a87-98fb-0a06cfdcb7ee tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:48.829088 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9795d52f-9422-4a87-98fb-0a06cfdcb7ee tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.041543 Sep 08 10:36:48.831295 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 46/79] 10.222.0.27 () {58 vars in 1146 bytes} [Thu Sep 8 10:36:48 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:36:48.848410 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-626ac1fe-de62-405f-b004-57c2f1658eb1 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:48.895471 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-626ac1fe-de62-405f-b004-57c2f1658eb1 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.058019 Sep 08 10:36:48.901784 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 47/80] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Sep 8 10:36:48 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 08 10:36:48.908619 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d4907e7a-62d3-45cb-876f-80b4f0bbabda tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:48.922690 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d4907e7a-62d3-45cb-876f-80b4f0bbabda tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] [instance: e605c39e-7644-4842-8476-9c9af611282f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:48.929965 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d4907e7a-62d3-45cb-876f-80b4f0bbabda tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:48.932186 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d4907e7a-62d3-45cb-876f-80b4f0bbabda tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:48.934374 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d4907e7a-62d3-45cb-876f-80b4f0bbabda tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:48.936554 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d4907e7a-62d3-45cb-876f-80b4f0bbabda tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:48.937769 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d4907e7a-62d3-45cb-876f-80b4f0bbabda tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:48.938557 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d4907e7a-62d3-45cb-876f-80b4f0bbabda tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:49.061438 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-7cd2760f-2407-4841-85de-9edd0d2d3b9a tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:36:49.062161 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-7cd2760f-2407-4841-85de-9edd0d2d3b9a tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:36:49.062930 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-7cd2760f-2407-4841-85de-9edd0d2d3b9a tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:36:49.063492 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-7cd2760f-2407-4841-85de-9edd0d2d3b9a tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:36:49.064061 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-7cd2760f-2407-4841-85de-9edd0d2d3b9a tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:36:49.093302 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7cd2760f-2407-4841-85de-9edd0d2d3b9a tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:49.094068 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7cd2760f-2407-4841-85de-9edd0d2d3b9a tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:49.096767 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7cd2760f-2407-4841-85de-9edd0d2d3b9a tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:49.097757 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7cd2760f-2407-4841-85de-9edd0d2d3b9a tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:49.100943 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7cd2760f-2407-4841-85de-9edd0d2d3b9a tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:49.101631 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7cd2760f-2407-4841-85de-9edd0d2d3b9a tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:49.152624 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-7cd2760f-2407-4841-85de-9edd0d2d3b9a tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Getting quotas for project d5e11d5906f0407d9ea1f1deed40aab7. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:36:49.166264 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-7cd2760f-2407-4841-85de-9edd0d2d3b9a tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Getting quotas for user 5b76777df7594f7a9d03376362b80b0f and project d5e11d5906f0407d9ea1f1deed40aab7. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:36:49.208006 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7cd2760f-2407-4841-85de-9edd0d2d3b9a tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:36:49.219139 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7cd2760f-2407-4841-85de-9edd0d2d3b9a tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] [instance: a14a2e92-7b76-4576-bc3e-3b567afa63ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:36:49.329472 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7cd2760f-2407-4841-85de-9edd0d2d3b9a tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.508591 Sep 08 10:36:49.330601 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 34/81] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:36:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1511 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:36:49.336290 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bcb623cd-cf70-42dd-b9ed-03ba3aaf1942 tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1471092621", "id": 1802190689, "os-flavor-access:is_public": "False"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:36:49.372212 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bcb623cd-cf70-42dd-b9ed-03ba3aaf1942 tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.037774 Sep 08 10:36:49.374438 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 35/82] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:36:49 2022] POST /compute/v2.1/flavors => generated 430 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:36:49.389860 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-40517e57-3668-453a-96bd-7c3253772c5f tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:49.416875 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-40517e57-3668-453a-96bd-7c3253772c5f tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Sep 08 10:36:49.424528 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-40517e57-3668-453a-96bd-7c3253772c5f tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Request method failure captured: Sep 08 10:36:49.424528 n-d-850501-12 devstack@n-api.service[128861]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Sep 08 10:36:49.424528 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:36:49.424528 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:36:49.424528 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:36:49.424528 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:36:49.424528 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:36:49.424528 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:36:49.424528 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:36:49.424528 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:36:49.424528 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcW42jKNF2wJ6tUgDr7GFhj8bDGclBm0y_GYAQnVvDAMYJ1jDUbUnOvdDZSin9luvRPOB6TjofqglWozsQ0mxm4M6iQFvXQru9-G8m76lXYiOi9vSC3hj03Cl53AEeaywrmiyKWkTCr0fuRfryKOtrDuR7P_LtA1MCxYImmijauXgZk Sep 08 10:36:49.424528 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:36:49.424528 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:36:49.424528 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:36:49.424528 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:36:49.424528 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:36:49.424528 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:36:49.424528 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 874e026251854684a06d3fd636701d17 Sep 08 10:36:49.424528 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1714194550 Sep 08 10:36:49.424528 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,admin,member Sep 08 10:36:49.424528 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,admin,member Sep 08 10:36:49.426019 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/874e026251854684a06d3fd636701d17"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/874e026251854684a06d3fd636701d17"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_874e026251854684a06d3fd636701d17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/874e026251854684a06d3fd636701d17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:36:49.426019 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1714194550 Sep 08 10:36:49.426019 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 874e026251854684a06d3fd636701d17 Sep 08 10:36:49.426019 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1714194550 Sep 08 10:36:49.426019 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin Sep 08 10:36:49.426019 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:36:49.426019 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:36:49.426019 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 55fc120859bb42faa1ba5cea5894d548 Sep 08 10:36:49.426019 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin Sep 08 10:36:49.426019 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:36:49.426019 n-d-850501-12 devstack@n-api.service[128861]: exception: Aggregate -1 could not be found. Sep 08 10:36:49.426019 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '-1'} Sep 08 10:36:49.426772 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:36:49.426772 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:49.426772 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Sep 08 10:36:49.426772 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Sep 08 10:36:49.426772 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 08 10:36:49.426772 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 08 10:36:49.426772 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:36:49.426772 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:36:49.426772 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:36:49.426772 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:36:49.426772 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 08 10:36:49.426772 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 08 10:36:49.426772 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Sep 08 10:36:49.426772 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Sep 08 10:36:49.426772 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 10:36:49.426772 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 10:36:49.426772 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 08 10:36:49.426772 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 08 10:36:49.426772 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 08 10:36:49.427861 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 08 10:36:49.427861 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 08 10:36:49.427861 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 08 10:36:49.427861 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Sep 08 10:36:49.427861 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:36:49.427861 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:36:49.427861 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:36:49.427861 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:49.427861 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:36:49.427861 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:36:49.427861 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:36:49.427861 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:36:49.427861 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:36:49.427861 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:36:49.427861 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Sep 08 10:36:49.427861 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:36:49.427861 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Sep 08 10:36:49.427861 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:36:49.427861 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:36:49.427861 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:36:49.427861 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:49.431731 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:36:49.431731 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:36:49.431731 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:36:49.431731 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:36:49.431731 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Sep 08 10:36:49.431731 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:36:49.431731 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-40517e57-3668-453a-96bd-7c3253772c5f tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:36:49.431731 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-40517e57-3668-453a-96bd-7c3253772c5f tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.049668 Sep 08 10:36:49.431731 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 36/83] 10.222.0.27 () {58 vars in 1155 bytes} [Thu Sep 8 10:36:49 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:36:49.608905 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d4907e7a-62d3-45cb-876f-80b4f0bbabda tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdbe35f311e435ba9e0516f302ba519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb116f8d7dd4858a91c03e0a4310fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:49.636834 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d4907e7a-62d3-45cb-876f-80b4f0bbabda tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] 10.222.0.27 "GET /compute/v2.1/servers/e605c39e-7644-4842-8476-9c9af611282f" status: 200 len: 1320 microversion: 2.1 time: 0.733664 Sep 08 10:36:49.637458 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 48/84] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:36:48 2022] GET /compute/v2.1/servers/e605c39e-7644-4842-8476-9c9af611282f => generated 1320 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:36:49.655319 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2f101291-e7b3-44f2-8171-825875af9efc tempest-QuotasAdminTestJSON-1017043201 tempest-QuotasAdminTestJSON-1017043201-project-admin] Action: 'update', calling method: .version_select at 0x7f68e5276a60>, body: {"quota_set": {"ram": "2048"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:36:50.018817 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-73455097-d642-4b4c-8bf8-21feecdda790 tempest-FlavorMetadataValidation-895288869 tempest-FlavorMetadataValidation-895288869-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-885877562", "id": 822458649, "os-flavor-access:is_public": "True"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:36:50.077236 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-73455097-d642-4b4c-8bf8-21feecdda790 tempest-FlavorMetadataValidation-895288869 tempest-FlavorMetadataValidation-895288869-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.86 time: 0.637957 Sep 08 10:36:50.081614 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 37/85] 10.222.0.27 () {62 vars in 1188 bytes} [Thu Sep 8 10:36:49 2022] POST /compute/v2.1/flavors => generated 467 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:36:50.100988 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-71f0e0aa-6e41-4292-a7cc-fa2d991b2f8e tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:50.103536 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-71f0e0aa-6e41-4292-a7cc-fa2d991b2f8e tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] [instance: a14a2e92-7b76-4576-bc3e-3b567afa63ac] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:50.227648 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-71f0e0aa-6e41-4292-a7cc-fa2d991b2f8e tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b76777df7594f7a9d03376362b80b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e11d5906f0407d9ea1f1deed40aab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:50.243796 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-71f0e0aa-6e41-4292-a7cc-fa2d991b2f8e tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] 10.222.0.27 "GET /compute/v2.1/servers/a14a2e92-7b76-4576-bc3e-3b567afa63ac" status: 200 len: 1242 microversion: 2.1 time: 0.158658 Sep 08 10:36:50.245191 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 38/86] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:36:50 2022] GET /compute/v2.1/servers/a14a2e92-7b76-4576-bc3e-3b567afa63ac => generated 1242 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:36:50.251711 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cdaf0593-663f-4f17-816b-cac796e37229 tempest-FlavorsAdminTestJSON-1127336046 tempest-FlavorsAdminTestJSON-1127336046-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "1802190689"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:36:50.271647 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-cdaf0593-663f-4f17-816b-cac796e37229 tempest-FlavorsAdminTestJSON-1127336046 tempest-FlavorsAdminTestJSON-1127336046-project] HTTP exception thrown: Flavor 1802190689 could not be found. Sep 08 10:36:50.278862 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cdaf0593-663f-4f17-816b-cac796e37229 tempest-FlavorsAdminTestJSON-1127336046 tempest-FlavorsAdminTestJSON-1127336046-project] Request method failure captured: Sep 08 10:36:50.278862 n-d-850501-12 devstack@n-api.service[128861]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 10:36:50.278862 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:36:50.278862 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:36:50.278862 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:36:50.278862 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 107 Sep 08 10:36:50.278862 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:36:50.278862 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:36:50.278862 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:36:50.278862 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:36:50.278862 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcW3RvJzYm7ablSz1Wh0Q2DvbWW3FvRB9-b9DKhGkkGyKWyIG5T629ahG9Fqx_lOZxuqQxQp4Q95T8MH8VxYJzUooFDI6JO2mCN6e_GZ8wGYeCj8snCp5GngxarTwq3hSAtBLDpovP6FZVR4H9LrZ2TXJUtMS7CPW0tZBTl_-X1XLNM Sep 08 10:36:50.278862 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:36:50.278862 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:36:50.278862 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:36:50.278862 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:36:50.278862 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:36:50.278862 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:36:50.278862 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: d17f89a2875f425586df992fa4783ae4 Sep 08 10:36:50.278862 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-FlavorsAdminTestJSON-1127336046 Sep 08 10:36:50.278862 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:36:50.278862 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:36:50.280299 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d17f89a2875f425586df992fa4783ae4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d17f89a2875f425586df992fa4783ae4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d17f89a2875f425586df992fa4783ae4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d17f89a2875f425586df992fa4783ae4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:36:50.280299 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-FlavorsAdminTestJSON-1127336046 Sep 08 10:36:50.280299 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: d17f89a2875f425586df992fa4783ae4 Sep 08 10:36:50.280299 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-1127336046 Sep 08 10:36:50.280299 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-FlavorsAdminTestJSON-1127336046-project Sep 08 10:36:50.280299 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:36:50.280299 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:36:50.280299 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: dd25beef6fa3489bbd59b502a3171fe3 Sep 08 10:36:50.280299 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-FlavorsAdminTestJSON-1127336046-project Sep 08 10:36:50.280299 n-d-850501-12 devstack@n-api.service[128861]: Sep 08 10:36:50.280299 n-d-850501-12 devstack@n-api.service[128861]: {"server": {"name": "test", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "1802190689"}} Sep 08 10:36:50.280299 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:36:50.280299 n-d-850501-12 devstack@n-api.service[128861]: exception: Flavor 1802190689 could not be found. Sep 08 10:36:50.281373 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '503f4a0f-e18f-47fd-ad12-0289e3463117', 'flavorRef': '1802190689'}}} Sep 08 10:36:50.281373 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:36:50.281373 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:50.281373 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Sep 08 10:36:50.281373 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Sep 08 10:36:50.281373 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 08 10:36:50.281373 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 08 10:36:50.281373 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 10:36:50.281373 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 10:36:50.281373 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 08 10:36:50.281373 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 08 10:36:50.281373 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 08 10:36:50.281373 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:36:50.281373 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 08 10:36:50.281373 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 08 10:36:50.281373 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1802190689 could not be found. Sep 08 10:36:50.281373 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:36:50.281373 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:36:50.281373 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:36:50.281373 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:50.282945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:36:50.282945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:36:50.282945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:36:50.282945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:36:50.282945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:36:50.282945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:36:50.282945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:36:50.282945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:36:50.282945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:36:50.282945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:36:50.282945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:36:50.282945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:36:50.282945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 08 10:36:50.282945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 08 10:36:50.282945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 08 10:36:50.282945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1802190689 could not be found. Sep 08 10:36:50.282945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:36:50.282945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:36:50.282945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:36:50.282945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:50.282945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:36:50.285139 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:36:50.285139 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:36:50.285139 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:36:50.285139 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1802190689 could not be found. Sep 08 10:36:50.285139 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:36:50.285139 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cdaf0593-663f-4f17-816b-cac796e37229 tempest-FlavorsAdminTestJSON-1127336046 tempest-FlavorsAdminTestJSON-1127336046-project] Returning 400 to user: Flavor 1802190689 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:36:50.307970 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cdaf0593-663f-4f17-816b-cac796e37229 tempest-FlavorsAdminTestJSON-1127336046 tempest-FlavorsAdminTestJSON-1127336046-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.056949 Sep 08 10:36:50.307970 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 39/87] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:36:50 2022] POST /compute/v2.1/servers => generated 81 bytes in 59 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 08 10:36:50.310114 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b285958d-e3ac-4a86-a47a-db9ba9a2090e tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-662057833"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:36:50.330458 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.aggregate [None req-b285958d-e3ac-4a86-a47a-db9ba9a2090e tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Generated uuid d1d21ed7-6e77-4d9a-a264-e891a7aec283 for aggregate {{(pid=128861) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 08 10:36:50.341440 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=9,nova_api:DELETE=5,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:36:50.400461 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b285958d-e3ac-4a86-a47a-db9ba9a2090e tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.094126 Sep 08 10:36:50.401262 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 40/88] 10.222.0.27 () {60 vars in 1164 bytes} [Thu Sep 8 10:36:50 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:36:50.425353 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-46823434-70fc-4b88-8f0c-d78d27ae4b11 tempest-FlavorMetadataValidation-895288869 tempest-FlavorMetadataValidation-895288869-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:36:50.435055 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2f101291-e7b3-44f2-8171-825875af9efc tempest-QuotasAdminTestJSON-1017043201 tempest-QuotasAdminTestJSON-1017043201-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:50.436052 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2f101291-e7b3-44f2-8171-825875af9efc tempest-QuotasAdminTestJSON-1017043201 tempest-QuotasAdminTestJSON-1017043201-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:50.437127 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2f101291-e7b3-44f2-8171-825875af9efc tempest-QuotasAdminTestJSON-1017043201 tempest-QuotasAdminTestJSON-1017043201-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:50.439380 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2f101291-e7b3-44f2-8171-825875af9efc tempest-QuotasAdminTestJSON-1017043201 tempest-QuotasAdminTestJSON-1017043201-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:50.440184 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2f101291-e7b3-44f2-8171-825875af9efc tempest-QuotasAdminTestJSON-1017043201 tempest-QuotasAdminTestJSON-1017043201-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:50.441334 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2f101291-e7b3-44f2-8171-825875af9efc tempest-QuotasAdminTestJSON-1017043201 tempest-QuotasAdminTestJSON-1017043201-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:50.578754 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2f101291-e7b3-44f2-8171-825875af9efc tempest-QuotasAdminTestJSON-1017043201 tempest-QuotasAdminTestJSON-1017043201-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:50.579540 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2f101291-e7b3-44f2-8171-825875af9efc tempest-QuotasAdminTestJSON-1017043201 tempest-QuotasAdminTestJSON-1017043201-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:50.584592 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2f101291-e7b3-44f2-8171-825875af9efc tempest-QuotasAdminTestJSON-1017043201 tempest-QuotasAdminTestJSON-1017043201-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:50.587511 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2f101291-e7b3-44f2-8171-825875af9efc tempest-QuotasAdminTestJSON-1017043201 tempest-QuotasAdminTestJSON-1017043201-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:50.589674 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2f101291-e7b3-44f2-8171-825875af9efc tempest-QuotasAdminTestJSON-1017043201 tempest-QuotasAdminTestJSON-1017043201-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:50.590651 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2f101291-e7b3-44f2-8171-825875af9efc tempest-QuotasAdminTestJSON-1017043201 tempest-QuotasAdminTestJSON-1017043201-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:50.832973 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2f101291-e7b3-44f2-8171-825875af9efc tempest-QuotasAdminTestJSON-1017043201 tempest-QuotasAdminTestJSON-1017043201-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/10176c91858b4986858a59e9b0b13275?user_id=b69cff8c048e4d64b90c9d1966324f92" status: 200 len: 328 microversion: 2.1 time: 1.186533 Sep 08 10:36:50.844106 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 49/89] 10.222.0.27 () {60 vars in 1343 bytes} [Thu Sep 8 10:36:49 2022] PUT /compute/v2.1/os-quota-sets/10176c91858b4986858a59e9b0b13275?user_id=b69cff8c048e4d64b90c9d1966324f92 => generated 328 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:36:50.857608 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c71750ba-0300-45a9-8d79-4162b31b0365 tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:50.879384 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-46823434-70fc-4b88-8f0c-d78d27ae4b11 tempest-FlavorMetadataValidation-895288869 tempest-FlavorMetadataValidation-895288869-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/822458649/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.467611 Sep 08 10:36:50.891309 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 41/90] 10.222.0.27 () {62 vars in 1262 bytes} [Thu Sep 8 10:36:50 2022] POST /compute/v2.1/flavors/822458649/os-extra_specs => generated 62 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:36:50.902261 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c71750ba-0300-45a9-8d79-4162b31b0365 tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1802190689" status: 202 len: 0 microversion: 2.1 time: 0.055644 Sep 08 10:36:50.906977 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 50/91] 10.222.0.27 () {58 vars in 1161 bytes} [Thu Sep 8 10:36:50 2022] DELETE /compute/v2.1/flavors/1802190689 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:36:50.923029 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b7096a1c-fc80-4e3b-b762-578e03a54ff4 tempest-AggregatesAdminNegativeTestJSON-1094852279 tempest-AggregatesAdminNegativeTestJSON-1094852279-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:50.927186 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b7096a1c-fc80-4e3b-b762-578e03a54ff4 tempest-AggregatesAdminNegativeTestJSON-1094852279 tempest-AggregatesAdminNegativeTestJSON-1094852279-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': 'b09ae3666ab54662a1177d5a4846e0ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eef52c589914f27b0461b81fa603192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:50.927397 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7bf8ff0e-20d6-4947-bb6a-e362ea502326 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:50.928813 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b7096a1c-fc80-4e3b-b762-578e03a54ff4 tempest-AggregatesAdminNegativeTestJSON-1094852279 tempest-AggregatesAdminNegativeTestJSON-1094852279-project] Request method failure captured: Sep 08 10:36:50.928813 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/os-aggregates/8 HTTP/1.1 Sep 08 10:36:50.928813 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:36:50.928813 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:36:50.928813 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:36:50.928813 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:36:50.928813 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:36:50.928813 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:36:50.928813 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:36:50.928813 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:36:50.928813 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcW2psWwH7qgDl5lB5Ns76DLKNYvqg7qV-R6a3j9SQpX6EhtX6sw7woCEBqo7bmYSR5iTwts_TgOPw5RjYQ_ZzjFpf3An69FmlwlZAB4ayhquw0iHJJ4djJf3BA4gUaMZYhyrFm1sM5LcV5OF6c0_cuBThWiJTf496Np_YojZjq5pbQ Sep 08 10:36:50.928813 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:36:50.928813 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:36:50.928813 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:36:50.928813 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:36:50.928813 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:36:50.928813 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:36:50.928813 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 5eef52c589914f27b0461b81fa603192 Sep 08 10:36:50.928813 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1094852279 Sep 08 10:36:50.928813 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:36:50.928813 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:36:50.930225 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5eef52c589914f27b0461b81fa603192"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5eef52c589914f27b0461b81fa603192"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5eef52c589914f27b0461b81fa603192"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5eef52c589914f27b0461b81fa603192"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:36:50.930225 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1094852279 Sep 08 10:36:50.930225 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 5eef52c589914f27b0461b81fa603192 Sep 08 10:36:50.930225 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1094852279 Sep 08 10:36:50.930225 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-AggregatesAdminNegativeTestJSON-1094852279-project Sep 08 10:36:50.930225 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:36:50.930225 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:36:50.930225 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: b09ae3666ab54662a1177d5a4846e0ca Sep 08 10:36:50.930225 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1094852279-project Sep 08 10:36:50.930225 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:36:50.930225 n-d-850501-12 devstack@n-api.service[128861]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Sep 08 10:36:50.930225 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '8'} Sep 08 10:36:50.931044 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:36:50.931044 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:50.931044 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:36:50.931044 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:36:50.931044 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:36:50.931044 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:36:50.931044 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:36:50.931044 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:36:50.931044 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Sep 08 10:36:50.931044 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Sep 08 10:36:50.931044 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 10:36:50.931044 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 10:36:50.931044 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 10:36:50.931044 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 10:36:50.931044 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:36:50.931044 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:36:50.931044 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:36:50.931044 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:36:50.931044 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 10:36:50.932347 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 10:36:50.932347 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 10:36:50.932347 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 10:36:50.932347 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 10:36:50.932347 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 10:36:50.932347 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Sep 08 10:36:50.932347 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:36:50.932347 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:36:50.932347 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:36:50.932347 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:50.932347 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:36:50.932347 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:36:50.932347 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 10:36:50.932347 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 10:36:50.932347 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Sep 08 10:36:50.932347 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:36:50.932347 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b7096a1c-fc80-4e3b-b762-578e03a54ff4 tempest-AggregatesAdminNegativeTestJSON-1094852279 tempest-AggregatesAdminNegativeTestJSON-1094852279-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:36:50.933800 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b7096a1c-fc80-4e3b-b762-578e03a54ff4 tempest-AggregatesAdminNegativeTestJSON-1094852279 tempest-AggregatesAdminNegativeTestJSON-1094852279-project] 10.222.0.27 "GET /compute/v2.1/os-aggregates/8" status: 403 len: 114 microversion: 2.1 time: 0.037090 Sep 08 10:36:50.937376 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7bf8ff0e-20d6-4947-bb6a-e362ea502326 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] [instance: e605c39e-7644-4842-8476-9c9af611282f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:50.950928 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7bf8ff0e-20d6-4947-bb6a-e362ea502326 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:50.953833 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 42/92] 10.222.0.27 () {58 vars in 1149 bytes} [Thu Sep 8 10:36:50 2022] GET /compute/v2.1/os-aggregates/8 => generated 114 bytes in 61 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:36:50.955294 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7bf8ff0e-20d6-4947-bb6a-e362ea502326 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:50.956279 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7bf8ff0e-20d6-4947-bb6a-e362ea502326 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:50.959558 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7bf8ff0e-20d6-4947-bb6a-e362ea502326 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:50.963032 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7bf8ff0e-20d6-4947-bb6a-e362ea502326 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:50.963787 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7bf8ff0e-20d6-4947-bb6a-e362ea502326 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:50.968995 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8b87b3ae-55c5-4980-8364-379e6556ee7e tempest-QuotasAdminTestJSON-1017043201 tempest-QuotasAdminTestJSON-1017043201-project-admin] Calling method '.version_select at 0x7f68e54398b0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:51.445880 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7bf8ff0e-20d6-4947-bb6a-e362ea502326 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdbe35f311e435ba9e0516f302ba519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb116f8d7dd4858a91c03e0a4310fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:51.455258 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7bf8ff0e-20d6-4947-bb6a-e362ea502326 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] 10.222.0.27 "GET /compute/v2.1/servers/e605c39e-7644-4842-8476-9c9af611282f" status: 200 len: 1320 microversion: 2.1 time: 0.546510 Sep 08 10:36:51.460623 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 51/93] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:36:50 2022] GET /compute/v2.1/servers/e605c39e-7644-4842-8476-9c9af611282f => generated 1320 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:36:51.473596 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e3b218e1-e1f1-420f-b055-9011b35a90f4 tempest-FlavorMetadataValidation-895288869 tempest-FlavorMetadataValidation-895288869-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:51.516372 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e3b218e1-e1f1-420f-b055-9011b35a90f4 tempest-FlavorMetadataValidation-895288869 tempest-FlavorMetadataValidation-895288869-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/822458649" status: 202 len: 0 microversion: 2.86 time: 0.054195 Sep 08 10:36:51.518319 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 52/94] 10.222.0.27 () {60 vars in 1199 bytes} [Thu Sep 8 10:36:51 2022] DELETE /compute/v2.1/flavors/822458649 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:36:51.527545 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f058c882-5b4f-49e5-aa27-4c0422b2eec9 tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:51.578953 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f058c882-5b4f-49e5-aa27-4c0422b2eec9 tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.056956 Sep 08 10:36:51.580446 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 53/95] 10.222.0.27 () {58 vars in 1146 bytes} [Thu Sep 8 10:36:51 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:36:51.588846 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ba2ef083-45d4-40fb-8468-b6b0d4b8760e tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:51.634049 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ba2ef083-45d4-40fb-8468-b6b0d4b8760e tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.051819 Sep 08 10:36:51.635418 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 54/96] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Sep 8 10:36:51 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 08 10:36:51.641553 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e5c132f5-828c-4e79-bb9f-7c8aaf7b3f79 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:51.642675 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e5c132f5-828c-4e79-bb9f-7c8aaf7b3f79 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] [instance: a14a2e92-7b76-4576-bc3e-3b567afa63ac] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:51.654301 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e5c132f5-828c-4e79-bb9f-7c8aaf7b3f79 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:51.655100 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e5c132f5-828c-4e79-bb9f-7c8aaf7b3f79 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:51.655845 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e5c132f5-828c-4e79-bb9f-7c8aaf7b3f79 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:51.657145 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e5c132f5-828c-4e79-bb9f-7c8aaf7b3f79 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:51.657943 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e5c132f5-828c-4e79-bb9f-7c8aaf7b3f79 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:51.658589 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e5c132f5-828c-4e79-bb9f-7c8aaf7b3f79 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:51.848497 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8b87b3ae-55c5-4980-8364-379e6556ee7e tempest-QuotasAdminTestJSON-1017043201 tempest-QuotasAdminTestJSON-1017043201-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/10176c91858b4986858a59e9b0b13275?user_id=b69cff8c048e4d64b90c9d1966324f92" status: 200 len: 370 microversion: 2.1 time: 0.891426 Sep 08 10:36:51.858219 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 43/97] 10.222.0.27 () {58 vars in 1323 bytes} [Thu Sep 8 10:36:50 2022] GET /compute/v2.1/os-quota-sets/10176c91858b4986858a59e9b0b13275?user_id=b69cff8c048e4d64b90c9d1966324f92 => generated 370 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:36:51.865070 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ada229b9-436f-4d5a-81bb-6d26a1a41197 tempest-FlavorMetadataValidation-895288869 tempest-FlavorMetadataValidation-895288869-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:51.895851 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ada229b9-436f-4d5a-81bb-6d26a1a41197 tempest-FlavorMetadataValidation-895288869 tempest-FlavorMetadataValidation-895288869-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.035139 Sep 08 10:36:51.897415 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 44/98] 10.222.0.27 () {60 vars in 1187 bytes} [Thu Sep 8 10:36:51 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:36:51.903612 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-db7ea105-82e3-4af1-9886-174fc43ac33c tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2080346520", "id": 1257687507, "os-flavor-access:is_public": "False"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:36:51.931578 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e5c132f5-828c-4e79-bb9f-7c8aaf7b3f79 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b76777df7594f7a9d03376362b80b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e11d5906f0407d9ea1f1deed40aab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:51.979182 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e5c132f5-828c-4e79-bb9f-7c8aaf7b3f79 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] 10.222.0.27 "GET /compute/v2.1/servers/a14a2e92-7b76-4576-bc3e-3b567afa63ac" status: 200 len: 1290 microversion: 2.1 time: 0.342004 Sep 08 10:36:51.981789 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 55/99] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:36:51 2022] GET /compute/v2.1/servers/a14a2e92-7b76-4576-bc3e-3b567afa63ac => generated 1290 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:36:52.011842 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c540a8ed-9ea5-4b15-9991-c9c4e6b58c88 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:52.034544 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-db7ea105-82e3-4af1-9886-174fc43ac33c tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.135690 Sep 08 10:36:52.035160 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 45/100] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:36:51 2022] POST /compute/v2.1/flavors => generated 415 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:36:52.050682 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9f03442b-b52b-49bb-9d36-0329388c4e58 tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2006284712", "id": 1284920433, "os-flavor-access:is_public": "True"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:36:52.074535 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-c540a8ed-9ea5-4b15-9991-c9c4e6b58c88 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Sep 08 10:36:52.080551 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c540a8ed-9ea5-4b15-9991-c9c4e6b58c88 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Request method failure captured: Sep 08 10:36:52.080551 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Sep 08 10:36:52.080551 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:36:52.080551 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:36:52.080551 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:36:52.080551 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:36:52.080551 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:36:52.080551 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:36:52.080551 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:36:52.080551 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:36:52.080551 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcW42jKNF2wJ6tUgDr7GFhj8bDGclBm0y_GYAQnVvDAMYJ1jDUbUnOvdDZSin9luvRPOB6TjofqglWozsQ0mxm4M6iQFvXQru9-G8m76lXYiOi9vSC3hj03Cl53AEeaywrmiyKWkTCr0fuRfryKOtrDuR7P_LtA1MCxYImmijauXgZk Sep 08 10:36:52.080551 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:36:52.080551 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:36:52.080551 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:36:52.080551 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:36:52.080551 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:36:52.080551 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:36:52.080551 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 874e026251854684a06d3fd636701d17 Sep 08 10:36:52.080551 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1714194550 Sep 08 10:36:52.080551 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,admin,member Sep 08 10:36:52.080551 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,admin,member Sep 08 10:36:52.081930 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/874e026251854684a06d3fd636701d17"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/874e026251854684a06d3fd636701d17"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_874e026251854684a06d3fd636701d17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/874e026251854684a06d3fd636701d17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:36:52.081930 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1714194550 Sep 08 10:36:52.081930 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 874e026251854684a06d3fd636701d17 Sep 08 10:36:52.081930 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1714194550 Sep 08 10:36:52.081930 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin Sep 08 10:36:52.081930 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:36:52.081930 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:36:52.081930 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 55fc120859bb42faa1ba5cea5894d548 Sep 08 10:36:52.081930 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin Sep 08 10:36:52.081930 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:36:52.081930 n-d-850501-12 devstack@n-api.service[128862]: exception: Aggregate -1 could not be found. Sep 08 10:36:52.081930 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '-1'} Sep 08 10:36:52.082737 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:36:52.082737 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:52.082737 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Sep 08 10:36:52.082737 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Sep 08 10:36:52.082737 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Sep 08 10:36:52.082737 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Sep 08 10:36:52.082737 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 10:36:52.082737 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 10:36:52.082737 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 08 10:36:52.082737 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 08 10:36:52.082737 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 08 10:36:52.082737 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 08 10:36:52.082737 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 08 10:36:52.082737 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 08 10:36:52.082737 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Sep 08 10:36:52.082737 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:36:52.082737 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:36:52.082737 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:36:52.082737 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:52.082737 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:36:52.084174 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:36:52.084174 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:36:52.084174 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:36:52.084174 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:36:52.084174 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:36:52.084174 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Sep 08 10:36:52.084174 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:36:52.084174 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Sep 08 10:36:52.084174 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:36:52.084174 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:36:52.084174 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:36:52.084174 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:52.084174 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:36:52.084174 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:36:52.084174 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:36:52.084174 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:36:52.084174 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Sep 08 10:36:52.084174 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:36:52.089158 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c540a8ed-9ea5-4b15-9991-c9c4e6b58c88 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:36:52.090252 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c540a8ed-9ea5-4b15-9991-c9c4e6b58c88 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.106902 Sep 08 10:36:52.095757 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 56/101] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Sep 8 10:36:51 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:36:52.100945 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9f03442b-b52b-49bb-9d36-0329388c4e58 tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.055033 Sep 08 10:36:52.103477 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 46/102] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:36:52 2022] POST /compute/v2.1/flavors => generated 414 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:36:52.110638 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-97266ecb-9b09-4687-9b73-8afcdff2715c tempest-AggregatesAdminNegativeTestJSON-1094852279 tempest-AggregatesAdminNegativeTestJSON-1094852279-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:52.116552 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-97266ecb-9b09-4687-9b73-8afcdff2715c tempest-AggregatesAdminNegativeTestJSON-1094852279 tempest-AggregatesAdminNegativeTestJSON-1094852279-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': 'b09ae3666ab54662a1177d5a4846e0ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eef52c589914f27b0461b81fa603192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:52.118413 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-97266ecb-9b09-4687-9b73-8afcdff2715c tempest-AggregatesAdminNegativeTestJSON-1094852279 tempest-AggregatesAdminNegativeTestJSON-1094852279-project] Request method failure captured: Sep 08 10:36:52.118413 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Sep 08 10:36:52.118413 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:36:52.118413 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:36:52.118413 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:36:52.118413 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:36:52.118413 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:36:52.118413 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:36:52.118413 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:36:52.118413 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:36:52.118413 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcW2psWwH7qgDl5lB5Ns76DLKNYvqg7qV-R6a3j9SQpX6EhtX6sw7woCEBqo7bmYSR5iTwts_TgOPw5RjYQ_ZzjFpf3An69FmlwlZAB4ayhquw0iHJJ4djJf3BA4gUaMZYhyrFm1sM5LcV5OF6c0_cuBThWiJTf496Np_YojZjq5pbQ Sep 08 10:36:52.118413 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:36:52.118413 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:36:52.118413 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:36:52.118413 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:36:52.118413 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:36:52.118413 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:36:52.118413 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 5eef52c589914f27b0461b81fa603192 Sep 08 10:36:52.118413 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1094852279 Sep 08 10:36:52.118413 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:36:52.118413 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:36:52.119580 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5eef52c589914f27b0461b81fa603192"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5eef52c589914f27b0461b81fa603192"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5eef52c589914f27b0461b81fa603192"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5eef52c589914f27b0461b81fa603192"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:36:52.119580 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1094852279 Sep 08 10:36:52.119580 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 5eef52c589914f27b0461b81fa603192 Sep 08 10:36:52.119580 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1094852279 Sep 08 10:36:52.119580 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-AggregatesAdminNegativeTestJSON-1094852279-project Sep 08 10:36:52.119580 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:36:52.119580 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:36:52.119580 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: b09ae3666ab54662a1177d5a4846e0ca Sep 08 10:36:52.119580 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1094852279-project Sep 08 10:36:52.119580 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:36:52.119580 n-d-850501-12 devstack@n-api.service[128862]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Sep 08 10:36:52.119580 n-d-850501-12 devstack@n-api.service[128862]: action_args: {} Sep 08 10:36:52.120512 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:36:52.120512 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:52.120512 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:36:52.120512 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:36:52.120512 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:36:52.120512 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:36:52.120512 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:36:52.120512 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:36:52.120512 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Sep 08 10:36:52.120512 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Sep 08 10:36:52.120512 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 10:36:52.120512 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 10:36:52.120512 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 10:36:52.120512 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 10:36:52.120512 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:36:52.120512 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:36:52.120512 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:36:52.120512 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:36:52.120512 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 10:36:52.121643 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 10:36:52.121643 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 10:36:52.121643 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 10:36:52.121643 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 10:36:52.121643 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 10:36:52.121643 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Sep 08 10:36:52.121643 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:36:52.121643 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:36:52.121643 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:36:52.121643 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:52.121643 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:36:52.121643 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:36:52.121643 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 10:36:52.121643 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 10:36:52.121643 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Sep 08 10:36:52.121643 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:36:52.124120 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-97266ecb-9b09-4687-9b73-8afcdff2715c tempest-AggregatesAdminNegativeTestJSON-1094852279 tempest-AggregatesAdminNegativeTestJSON-1094852279-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:36:52.125093 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-97266ecb-9b09-4687-9b73-8afcdff2715c tempest-AggregatesAdminNegativeTestJSON-1094852279 tempest-AggregatesAdminNegativeTestJSON-1094852279-project] 10.222.0.27 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.027643 Sep 08 10:36:52.126530 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0776fe25-5a9b-4578-9dc1-e37645231f6b tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:52.129139 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 57/103] 10.222.0.27 () {58 vars in 1143 bytes} [Thu Sep 8 10:36:52 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:36:52.159234 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0776fe25-5a9b-4578-9dc1-e37645231f6b tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 418 microversion: 2.1 time: 0.043549 Sep 08 10:36:52.169414 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 47/104] 10.222.0.27 () {58 vars in 1169 bytes} [Thu Sep 8 10:36:52 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 418 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:36:52.175259 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-10f1672d-412c-478c-b459-d9320770d7f9 tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:52.251151 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-10f1672d-412c-478c-b459-d9320770d7f9 tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 418 microversion: 2.1 time: 0.080138 Sep 08 10:36:52.260075 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 58/105] 10.222.0.27 () {58 vars in 1177 bytes} [Thu Sep 8 10:36:52 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 418 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:36:52.265684 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b2916520-c4c5-4d5f-aa21-024354a20d47 tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:52.341163 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b2916520-c4c5-4d5f-aa21-024354a20d47 tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 418 microversion: 2.1 time: 0.064200 Sep 08 10:36:52.353491 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 48/106] 10.222.0.27 () {58 vars in 1171 bytes} [Thu Sep 8 10:36:52 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 418 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:36:52.361336 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-035df356-1e9c-46dc-89dc-5e89059db653 tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:52.392826 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-035df356-1e9c-46dc-89dc-5e89059db653 tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 418 microversion: 2.1 time: 0.036720 Sep 08 10:36:52.404748 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 59/107] 10.222.0.27 () {58 vars in 1169 bytes} [Thu Sep 8 10:36:52 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 418 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:36:52.410247 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4eb47268-01c2-44dd-ad68-7a7f239c2ad1 tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:52.481920 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f631b2c8-2fe5-4a6c-b08b-116679ef3c8b tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:52.482787 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f631b2c8-2fe5-4a6c-b08b-116679ef3c8b tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] [instance: e605c39e-7644-4842-8476-9c9af611282f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:52.492358 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f631b2c8-2fe5-4a6c-b08b-116679ef3c8b tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:52.496698 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4eb47268-01c2-44dd-ad68-7a7f239c2ad1 tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5395 microversion: 2.1 time: 0.092360 Sep 08 10:36:52.516498 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 49/108] 10.222.0.27 () {58 vars in 1169 bytes} [Thu Sep 8 10:36:52 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5395 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:36:52.517294 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f631b2c8-2fe5-4a6c-b08b-116679ef3c8b tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:52.519185 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f631b2c8-2fe5-4a6c-b08b-116679ef3c8b tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:52.523145 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-391311a2-26f7-41c4-ab2b-33d54ec28c93 tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:52.523500 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f631b2c8-2fe5-4a6c-b08b-116679ef3c8b tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:52.525248 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f631b2c8-2fe5-4a6c-b08b-116679ef3c8b tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:52.526231 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f631b2c8-2fe5-4a6c-b08b-116679ef3c8b tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:52.581042 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-391311a2-26f7-41c4-ab2b-33d54ec28c93 tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5395 microversion: 2.1 time: 0.062616 Sep 08 10:36:52.595703 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 50/109] 10.222.0.27 () {58 vars in 1175 bytes} [Thu Sep 8 10:36:52 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5395 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:36:52.601082 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9a5444b6-d390-4948-a373-9d379ad9f5a0 tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:52.663712 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9a5444b6-d390-4948-a373-9d379ad9f5a0 tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5395 microversion: 2.1 time: 0.063295 Sep 08 10:36:52.677054 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 51/110] 10.222.0.27 () {58 vars in 1173 bytes} [Thu Sep 8 10:36:52 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5395 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:36:52.688343 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e1293274-401a-4815-8489-109c4bcff512 tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:52.737166 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e1293274-401a-4815-8489-109c4bcff512 tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5395 microversion: 2.1 time: 0.052316 Sep 08 10:36:52.738177 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 52/111] 10.222.0.27 () {58 vars in 1169 bytes} [Thu Sep 8 10:36:52 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5395 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:36:52.768506 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2aff00aa-8797-4a0d-b5fc-1f1fcfe2e2be tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:52.812451 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2aff00aa-8797-4a0d-b5fc-1f1fcfe2e2be tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1284920433" status: 202 len: 0 microversion: 2.1 time: 0.055459 Sep 08 10:36:52.814425 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 53/112] 10.222.0.27 () {58 vars in 1161 bytes} [Thu Sep 8 10:36:52 2022] DELETE /compute/v2.1/flavors/1284920433 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:36:52.845884 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-eeb8b864-f702-4e81-b810-9080186c432b tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:52.940197 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-eeb8b864-f702-4e81-b810-9080186c432b tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.105771 Sep 08 10:36:52.943446 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 54/113] 10.222.0.27 () {58 vars in 1146 bytes} [Thu Sep 8 10:36:52 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:36:52.965534 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e48fb2c0-a7d5-4fc5-abf5-b7c38a691166 tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:53.007398 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e48fb2c0-a7d5-4fc5-abf5-b7c38a691166 tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1257687507" status: 202 len: 0 microversion: 2.1 time: 0.046375 Sep 08 10:36:53.008236 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 55/114] 10.222.0.27 () {58 vars in 1161 bytes} [Thu Sep 8 10:36:52 2022] DELETE /compute/v2.1/flavors/1257687507 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 10:36:53.015069 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a87c8213-ec90-4da9-8a3a-863530a21976 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:53.023246 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a87c8213-ec90-4da9-8a3a-863530a21976 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] [instance: a14a2e92-7b76-4576-bc3e-3b567afa63ac] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:53.043593 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a87c8213-ec90-4da9-8a3a-863530a21976 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:53.044416 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a87c8213-ec90-4da9-8a3a-863530a21976 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:53.048396 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a87c8213-ec90-4da9-8a3a-863530a21976 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:53.049618 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a87c8213-ec90-4da9-8a3a-863530a21976 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:53.050383 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a87c8213-ec90-4da9-8a3a-863530a21976 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:53.053271 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a87c8213-ec90-4da9-8a3a-863530a21976 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:53.213498 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f631b2c8-2fe5-4a6c-b08b-116679ef3c8b tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdbe35f311e435ba9e0516f302ba519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb116f8d7dd4858a91c03e0a4310fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:53.228854 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f631b2c8-2fe5-4a6c-b08b-116679ef3c8b tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] 10.222.0.27 "GET /compute/v2.1/servers/e605c39e-7644-4842-8476-9c9af611282f" status: 200 len: 1320 microversion: 2.1 time: 0.750202 Sep 08 10:36:53.231879 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 60/115] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:36:52 2022] GET /compute/v2.1/servers/e605c39e-7644-4842-8476-9c9af611282f => generated 1320 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:36:53.242927 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-696f9b24-5768-4bd9-846f-9c9211795a2d tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:53.303942 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-696f9b24-5768-4bd9-846f-9c9211795a2d tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.070675 Sep 08 10:36:53.309083 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 61/116] 10.222.0.27 () {58 vars in 1146 bytes} [Thu Sep 8 10:36:53 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:36:53.322734 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c688ae62-849a-4221-a42c-6c0473e04b87 tempest-QuotasAdminTestJSON-1017043201 tempest-QuotasAdminTestJSON-1017043201-project-admin] Calling method '.version_select at 0x7f68e51ed310>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:53.328188 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a87c8213-ec90-4da9-8a3a-863530a21976 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b76777df7594f7a9d03376362b80b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e11d5906f0407d9ea1f1deed40aab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:53.343877 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a87c8213-ec90-4da9-8a3a-863530a21976 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] 10.222.0.27 "GET /compute/v2.1/servers/a14a2e92-7b76-4576-bc3e-3b567afa63ac" status: 200 len: 1296 microversion: 2.1 time: 0.330176 Sep 08 10:36:53.345960 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 56/117] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:36:53 2022] GET /compute/v2.1/servers/a14a2e92-7b76-4576-bc3e-3b567afa63ac => generated 1296 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:36:53.362946 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-39c455ac-aa03-4ad2-8208-d4bacb2497bc tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-45924899", "id": 612078165, "os-flavor-access:is_public": "False"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:36:53.425097 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-39c455ac-aa03-4ad2-8208-d4bacb2497bc tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.075154 Sep 08 10:36:53.425679 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 57/118] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:36:53 2022] POST /compute/v2.1/flavors => generated 410 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:36:53.839835 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c688ae62-849a-4221-a42c-6c0473e04b87 tempest-QuotasAdminTestJSON-1017043201 tempest-QuotasAdminTestJSON-1017043201-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/40fed67000b842d881cb0b8ed3777cb0/defaults" status: 200 len: 371 microversion: 2.1 time: 0.533136 Sep 08 10:36:53.840589 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 62/119] 10.222.0.27 () {58 vars in 1269 bytes} [Thu Sep 8 10:36:53 2022] GET /compute/v2.1/os-quota-sets/40fed67000b842d881cb0b8ed3777cb0/defaults => generated 371 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:36:53.850792 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2bd882d1-bf89-4455-94ef-7a03fb08dc82 tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:53.942001 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2bd882d1-bf89-4455-94ef-7a03fb08dc82 tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.098557 Sep 08 10:36:53.943748 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 63/120] 10.222.0.27 () {58 vars in 1146 bytes} [Thu Sep 8 10:36:53 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:36:53.956920 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cb52d463-c9de-4751-b20d-7706301a5237 tempest-QuotasAdminTestJSON-1017043201 tempest-QuotasAdminTestJSON-1017043201-project-admin] Action: 'update', calling method: .version_select at 0x7f68e5276160>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:36:54.261585 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-6ce44be0-5f15-4dc9-9cf3-a1fba0210591 req-5c787eee-9f75-4a33-aa59-63cecc1f3b86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e605c39e-7644-4842-8476-9c9af611282f", "tag": "8c4cf5b9-c6e2-4335-97b1-d398b92bb922"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:36:54.311303 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-6ce44be0-5f15-4dc9-9cf3-a1fba0210591 req-5c787eee-9f75-4a33-aa59-63cecc1f3b86 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:54.314385 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-6ce44be0-5f15-4dc9-9cf3-a1fba0210591 req-5c787eee-9f75-4a33-aa59-63cecc1f3b86 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:54.318164 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-6ce44be0-5f15-4dc9-9cf3-a1fba0210591 req-5c787eee-9f75-4a33-aa59-63cecc1f3b86 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:54.401324 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-6ce44be0-5f15-4dc9-9cf3-a1fba0210591 req-5c787eee-9f75-4a33-aa59-63cecc1f3b86 service nova] Creating event network-changed:8c4cf5b9-c6e2-4335-97b1-d398b92bb922 for instance e605c39e-7644-4842-8476-9c9af611282f on n-h2-850501-12 Sep 08 10:36:54.408109 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-6ce44be0-5f15-4dc9-9cf3-a1fba0210591 req-5c787eee-9f75-4a33-aa59-63cecc1f3b86 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=128861) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 08 10:36:54.408868 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-6ce44be0-5f15-4dc9-9cf3-a1fba0210591 req-5c787eee-9f75-4a33-aa59-63cecc1f3b86 service nova] Acquired lock "compute-rpcapi-router" {{(pid=128861) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 08 10:36:54.410440 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0deab31e-592c-404e-af65-bba616ce94eb None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:54.411091 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0deab31e-592c-404e-af65-bba616ce94eb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:54.411829 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0deab31e-592c-404e-af65-bba616ce94eb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:54.414889 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0deab31e-592c-404e-af65-bba616ce94eb None None] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:54.415580 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0deab31e-592c-404e-af65-bba616ce94eb None None] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:54.416365 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0deab31e-592c-404e-af65-bba616ce94eb None None] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:54.448834 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.compute.rpcapi [None req-0deab31e-592c-404e-af65-bba616ce94eb None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 08 10:36:54.450254 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0deab31e-592c-404e-af65-bba616ce94eb None None] Releasing lock "compute-rpcapi-router" {{(pid=128861) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 08 10:36:54.485505 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0deab31e-592c-404e-af65-bba616ce94eb None None] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.054667 Sep 08 10:36:54.490211 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 58/121] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:36:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:36:54.501037 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb52d463-c9de-4751-b20d-7706301a5237 tempest-QuotasAdminTestJSON-1017043201 tempest-QuotasAdminTestJSON-1017043201-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:54.507262 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb52d463-c9de-4751-b20d-7706301a5237 tempest-QuotasAdminTestJSON-1017043201 tempest-QuotasAdminTestJSON-1017043201-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:54.509282 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb52d463-c9de-4751-b20d-7706301a5237 tempest-QuotasAdminTestJSON-1017043201 tempest-QuotasAdminTestJSON-1017043201-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:54.511837 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb52d463-c9de-4751-b20d-7706301a5237 tempest-QuotasAdminTestJSON-1017043201 tempest-QuotasAdminTestJSON-1017043201-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:54.515294 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb52d463-c9de-4751-b20d-7706301a5237 tempest-QuotasAdminTestJSON-1017043201 tempest-QuotasAdminTestJSON-1017043201-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:54.517422 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb52d463-c9de-4751-b20d-7706301a5237 tempest-QuotasAdminTestJSON-1017043201 tempest-QuotasAdminTestJSON-1017043201-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:54.522569 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d99436eb-0167-4de7-8a7b-44210d67b64e tempest-FlavorsAdminTestJSON-1127336046 tempest-FlavorsAdminTestJSON-1127336046-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:54.667598 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d99436eb-0167-4de7-8a7b-44210d67b64e tempest-FlavorsAdminTestJSON-1127336046 tempest-FlavorsAdminTestJSON-1127336046-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.171193 Sep 08 10:36:54.672127 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 59/122] 10.222.0.27 () {58 vars in 1146 bytes} [Thu Sep 8 10:36:54 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:36:54.689133 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7b4dfb6f-df53-47f2-82fb-436f7c742b25 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:54.696100 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7b4dfb6f-df53-47f2-82fb-436f7c742b25 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] [instance: e605c39e-7644-4842-8476-9c9af611282f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:54.696893 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:DELETE=15,nova_api:SELECT=83,nova_api:INSERT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:36:54.719310 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7b4dfb6f-df53-47f2-82fb-436f7c742b25 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:54.726364 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7b4dfb6f-df53-47f2-82fb-436f7c742b25 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:54.728888 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7b4dfb6f-df53-47f2-82fb-436f7c742b25 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:54.729953 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7b4dfb6f-df53-47f2-82fb-436f7c742b25 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:54.736098 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7b4dfb6f-df53-47f2-82fb-436f7c742b25 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:54.737195 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7b4dfb6f-df53-47f2-82fb-436f7c742b25 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:55.259623 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cb52d463-c9de-4751-b20d-7706301a5237 tempest-QuotasAdminTestJSON-1017043201 tempest-QuotasAdminTestJSON-1017043201-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/40fed67000b842d881cb0b8ed3777cb0" status: 200 len: 329 microversion: 2.1 time: 1.314427 Sep 08 10:36:55.268697 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 64/123] 10.222.0.27 () {60 vars in 1263 bytes} [Thu Sep 8 10:36:53 2022] PUT /compute/v2.1/os-quota-sets/40fed67000b842d881cb0b8ed3777cb0 => generated 329 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:36:55.275939 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dc550ad7-00cb-4d9b-a491-0c6fe12a3d8d tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:55.277262 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-dc550ad7-00cb-4d9b-a491-0c6fe12a3d8d tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] [instance: a14a2e92-7b76-4576-bc3e-3b567afa63ac] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:55.287351 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dc550ad7-00cb-4d9b-a491-0c6fe12a3d8d tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:55.287994 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dc550ad7-00cb-4d9b-a491-0c6fe12a3d8d tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:55.288867 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dc550ad7-00cb-4d9b-a491-0c6fe12a3d8d tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:55.290033 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dc550ad7-00cb-4d9b-a491-0c6fe12a3d8d tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:55.290588 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dc550ad7-00cb-4d9b-a491-0c6fe12a3d8d tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:55.291029 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dc550ad7-00cb-4d9b-a491-0c6fe12a3d8d tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:55.495404 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7b4dfb6f-df53-47f2-82fb-436f7c742b25 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdbe35f311e435ba9e0516f302ba519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb116f8d7dd4858a91c03e0a4310fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:55.510845 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7b4dfb6f-df53-47f2-82fb-436f7c742b25 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] 10.222.0.27 "GET /compute/v2.1/servers/e605c39e-7644-4842-8476-9c9af611282f" status: 200 len: 1320 microversion: 2.1 time: 0.836498 Sep 08 10:36:55.516214 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 60/124] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:36:54 2022] GET /compute/v2.1/servers/e605c39e-7644-4842-8476-9c9af611282f => generated 1320 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:36:55.524733 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-de44ef0e-696b-4c42-b272-a2c34164885b tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:55.571431 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-de44ef0e-696b-4c42-b272-a2c34164885b tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/612078165" status: 202 len: 0 microversion: 2.1 time: 0.054082 Sep 08 10:36:55.572014 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 61/125] 10.222.0.27 () {58 vars in 1158 bytes} [Thu Sep 8 10:36:55 2022] DELETE /compute/v2.1/flavors/612078165 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:36:55.585643 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-80208806-450a-47f1-8fe7-0abb4e6ea603 tempest-QuotasAdminTestJSON-1017043201 tempest-QuotasAdminTestJSON-1017043201-project-admin] Action: 'update', calling method: .version_select at 0x7f68e5357dc0>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:36:55.614517 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-dc550ad7-00cb-4d9b-a491-0c6fe12a3d8d tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b76777df7594f7a9d03376362b80b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e11d5906f0407d9ea1f1deed40aab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:55.628422 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-dc550ad7-00cb-4d9b-a491-0c6fe12a3d8d tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] 10.222.0.27 "GET /compute/v2.1/servers/a14a2e92-7b76-4576-bc3e-3b567afa63ac" status: 200 len: 1296 microversion: 2.1 time: 0.357937 Sep 08 10:36:55.638421 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 65/126] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:36:55 2022] GET /compute/v2.1/servers/a14a2e92-7b76-4576-bc3e-3b567afa63ac => generated 1296 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:36:55.662548 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-34915e92-5171-4eeb-abcf-8003e3297234 tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:55.752862 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-34915e92-5171-4eeb-abcf-8003e3297234 tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.108788 Sep 08 10:36:55.756579 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 66/127] 10.222.0.27 () {58 vars in 1146 bytes} [Thu Sep 8 10:36:55 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:36:55.782338 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cdba03d3-e6fd-4cfd-90eb-380375289b0b tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-440832319", "id": 1607460706, "os-flavor-access:is_public": "True"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:36:55.809082 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cdba03d3-e6fd-4cfd-90eb-380375289b0b tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.031531 Sep 08 10:36:55.819739 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 67/128] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:36:55 2022] POST /compute/v2.1/flavors => generated 413 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:36:55.826420 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a5c5344b-97bf-418b-a29b-0443b0f1c0a5 tempest-FlavorsAdminTestJSON-1127336046 tempest-FlavorsAdminTestJSON-1127336046-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:55.880669 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a5c5344b-97bf-418b-a29b-0443b0f1c0a5 tempest-FlavorsAdminTestJSON-1127336046 tempest-FlavorsAdminTestJSON-1127336046-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.057657 Sep 08 10:36:55.883588 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 68/129] 10.222.0.27 () {58 vars in 1146 bytes} [Thu Sep 8 10:36:55 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:36:55.916937 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e04b8db2-07d1-43df-8d9a-99c88150324c tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:55.960103 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e04b8db2-07d1-43df-8d9a-99c88150324c tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1607460706" status: 202 len: 0 microversion: 2.1 time: 0.052753 Sep 08 10:36:55.966031 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 69/130] 10.222.0.27 () {58 vars in 1161 bytes} [Thu Sep 8 10:36:55 2022] DELETE /compute/v2.1/flavors/1607460706 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 10:36:55.979988 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-50b09701-fcc6-465c-9bf9-18bd113c1d6c tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:56.082526 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-50b09701-fcc6-465c-9bf9-18bd113c1d6c tempest-FlavorsAdminTestJSON-1548966009 tempest-FlavorsAdminTestJSON-1548966009-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.114384 Sep 08 10:36:56.086738 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 70/131] 10.222.0.27 () {58 vars in 1146 bytes} [Thu Sep 8 10:36:55 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:36:56.538948 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2a299b60-8909-41e5-9d42-5477c0a24ce1 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:56.539572 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2a299b60-8909-41e5-9d42-5477c0a24ce1 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] [instance: e605c39e-7644-4842-8476-9c9af611282f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:56.545987 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2a299b60-8909-41e5-9d42-5477c0a24ce1 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:56.546942 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2a299b60-8909-41e5-9d42-5477c0a24ce1 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:56.546942 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2a299b60-8909-41e5-9d42-5477c0a24ce1 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:56.568234 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2a299b60-8909-41e5-9d42-5477c0a24ce1 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:56.568904 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2a299b60-8909-41e5-9d42-5477c0a24ce1 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:56.580727 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2a299b60-8909-41e5-9d42-5477c0a24ce1 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:56.596372 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-80208806-450a-47f1-8fe7-0abb4e6ea603 tempest-QuotasAdminTestJSON-1017043201 tempest-QuotasAdminTestJSON-1017043201-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:56.598508 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-80208806-450a-47f1-8fe7-0abb4e6ea603 tempest-QuotasAdminTestJSON-1017043201 tempest-QuotasAdminTestJSON-1017043201-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:56.599538 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-80208806-450a-47f1-8fe7-0abb4e6ea603 tempest-QuotasAdminTestJSON-1017043201 tempest-QuotasAdminTestJSON-1017043201-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:56.600905 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-80208806-450a-47f1-8fe7-0abb4e6ea603 tempest-QuotasAdminTestJSON-1017043201 tempest-QuotasAdminTestJSON-1017043201-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:56.601736 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-80208806-450a-47f1-8fe7-0abb4e6ea603 tempest-QuotasAdminTestJSON-1017043201 tempest-QuotasAdminTestJSON-1017043201-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:56.603483 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-80208806-450a-47f1-8fe7-0abb4e6ea603 tempest-QuotasAdminTestJSON-1017043201 tempest-QuotasAdminTestJSON-1017043201-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:56.904737 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:INSERT=10,nova_api:SELECT=74,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=9,nova_api:UPDATE=3 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:36:57.156383 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2a299b60-8909-41e5-9d42-5477c0a24ce1 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdbe35f311e435ba9e0516f302ba519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb116f8d7dd4858a91c03e0a4310fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:57.174810 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2a299b60-8909-41e5-9d42-5477c0a24ce1 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] 10.222.0.27 "GET /compute/v2.1/servers/e605c39e-7644-4842-8476-9c9af611282f" status: 200 len: 1320 microversion: 2.1 time: 0.639717 Sep 08 10:36:57.183636 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 71/132] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:36:56 2022] GET /compute/v2.1/servers/e605c39e-7644-4842-8476-9c9af611282f => generated 1320 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:36:57.193556 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4bb5b8b6-1b1b-4bc5-b862-b942fc6cf5af tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:57.194182 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4bb5b8b6-1b1b-4bc5-b862-b942fc6cf5af tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] [instance: a14a2e92-7b76-4576-bc3e-3b567afa63ac] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:57.234427 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4bb5b8b6-1b1b-4bc5-b862-b942fc6cf5af tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:57.235001 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4bb5b8b6-1b1b-4bc5-b862-b942fc6cf5af tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:57.235451 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4bb5b8b6-1b1b-4bc5-b862-b942fc6cf5af tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:57.236273 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4bb5b8b6-1b1b-4bc5-b862-b942fc6cf5af tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:57.237012 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4bb5b8b6-1b1b-4bc5-b862-b942fc6cf5af tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:57.237904 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4bb5b8b6-1b1b-4bc5-b862-b942fc6cf5af tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:57.467966 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-80208806-450a-47f1-8fe7-0abb4e6ea603 tempest-QuotasAdminTestJSON-1017043201 tempest-QuotasAdminTestJSON-1017043201-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/40fed67000b842d881cb0b8ed3777cb0" status: 200 len: 329 microversion: 2.1 time: 1.892651 Sep 08 10:36:57.469056 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 62/133] 10.222.0.27 () {60 vars in 1263 bytes} [Thu Sep 8 10:36:55 2022] PUT /compute/v2.1/os-quota-sets/40fed67000b842d881cb0b8ed3777cb0 => generated 329 bytes in 1894 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:36:57.697646 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4bb5b8b6-1b1b-4bc5-b862-b942fc6cf5af tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b76777df7594f7a9d03376362b80b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e11d5906f0407d9ea1f1deed40aab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:57.714585 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4bb5b8b6-1b1b-4bc5-b862-b942fc6cf5af tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] 10.222.0.27 "GET /compute/v2.1/servers/a14a2e92-7b76-4576-bc3e-3b567afa63ac" status: 200 len: 1338 microversion: 2.1 time: 0.526513 Sep 08 10:36:57.716661 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 72/134] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:36:57 2022] GET /compute/v2.1/servers/a14a2e92-7b76-4576-bc3e-3b567afa63ac => generated 1338 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:36:58.210547 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-04997721-3741-4c0e-bee7-1b52b3bf5fd5 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:58.214609 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-04997721-3741-4c0e-bee7-1b52b3bf5fd5 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] [instance: e605c39e-7644-4842-8476-9c9af611282f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:58.252011 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04997721-3741-4c0e-bee7-1b52b3bf5fd5 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:58.257427 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04997721-3741-4c0e-bee7-1b52b3bf5fd5 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:58.262086 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04997721-3741-4c0e-bee7-1b52b3bf5fd5 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:58.267108 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04997721-3741-4c0e-bee7-1b52b3bf5fd5 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:58.267659 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04997721-3741-4c0e-bee7-1b52b3bf5fd5 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:58.278356 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04997721-3741-4c0e-bee7-1b52b3bf5fd5 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:58.314795 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-49798178-75ec-40b5-afc2-fc54605350dd tempest-AZAdminNegativeTestJSON-975492549 tempest-AZAdminNegativeTestJSON-975492549-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:58.316924 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-49798178-75ec-40b5-afc2-fc54605350dd tempest-AZAdminNegativeTestJSON-975492549 tempest-AZAdminNegativeTestJSON-975492549-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '5e7de7cf78144018a7ca22d8f8b9372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b82505ebb2c748eba93112ec4c14b2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:58.326498 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-49798178-75ec-40b5-afc2-fc54605350dd tempest-AZAdminNegativeTestJSON-975492549 tempest-AZAdminNegativeTestJSON-975492549-project] Request method failure captured: Sep 08 10:36:58.326498 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Sep 08 10:36:58.326498 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:36:58.326498 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:36:58.326498 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:36:58.326498 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:36:58.326498 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:36:58.326498 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:36:58.326498 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:36:58.326498 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:36:58.326498 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcXGK70_rLspqrA_btKLsnd6Iwfpvxu-FXdv47Covn3I6Io4YLOsOPupFLckgK6BSyxWlZZH5vQsyNjiNrx6nvbXFMHEr81BDagoEk8PgIwuALMJJFYfkYF-vZBe8SrvIYtFsDwM7HYB6A28UU-_qXH1GLUSsr9OUHXHqr0qMrPrvLw Sep 08 10:36:58.326498 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:36:58.326498 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:36:58.326498 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:36:58.326498 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:36:58.326498 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:36:58.326498 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:36:58.326498 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: b82505ebb2c748eba93112ec4c14b2c6 Sep 08 10:36:58.326498 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-AZAdminNegativeTestJSON-975492549 Sep 08 10:36:58.326498 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:36:58.326498 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:36:58.327974 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b82505ebb2c748eba93112ec4c14b2c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b82505ebb2c748eba93112ec4c14b2c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b82505ebb2c748eba93112ec4c14b2c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b82505ebb2c748eba93112ec4c14b2c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:36:58.327974 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-AZAdminNegativeTestJSON-975492549 Sep 08 10:36:58.327974 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: b82505ebb2c748eba93112ec4c14b2c6 Sep 08 10:36:58.327974 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-975492549 Sep 08 10:36:58.327974 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-AZAdminNegativeTestJSON-975492549-project Sep 08 10:36:58.327974 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:36:58.327974 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:36:58.327974 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 5e7de7cf78144018a7ca22d8f8b9372e Sep 08 10:36:58.327974 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-AZAdminNegativeTestJSON-975492549-project Sep 08 10:36:58.327974 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:36:58.327974 n-d-850501-12 devstack@n-api.service[128861]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Sep 08 10:36:58.327974 n-d-850501-12 devstack@n-api.service[128861]: action_args: {} Sep 08 10:36:58.329484 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:36:58.329484 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:58.329484 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:36:58.329484 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:36:58.329484 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:36:58.329484 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:36:58.329484 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:36:58.329484 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:36:58.329484 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Sep 08 10:36:58.329484 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Sep 08 10:36:58.329484 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 10:36:58.329484 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 10:36:58.329484 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 10:36:58.329484 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 10:36:58.329484 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:36:58.329484 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:36:58.329484 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:36:58.329484 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:36:58.329484 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 10:36:58.330729 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 10:36:58.330729 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 10:36:58.330729 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 10:36:58.330729 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 10:36:58.330729 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 10:36:58.330729 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Sep 08 10:36:58.330729 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:36:58.330729 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:36:58.330729 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:36:58.330729 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:58.330729 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:36:58.330729 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:36:58.330729 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 10:36:58.330729 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 10:36:58.330729 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Sep 08 10:36:58.330729 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:36:58.330729 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-49798178-75ec-40b5-afc2-fc54605350dd tempest-AZAdminNegativeTestJSON-975492549 tempest-AZAdminNegativeTestJSON-975492549-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:36:58.331933 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-49798178-75ec-40b5-afc2-fc54605350dd tempest-AZAdminNegativeTestJSON-975492549 tempest-AZAdminNegativeTestJSON-975492549-project] 10.222.0.27 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.816427 Sep 08 10:36:58.331933 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 63/135] 10.222.0.27 () {58 vars in 1185 bytes} [Thu Sep 8 10:36:57 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 817 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 08 10:36:58.729254 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-04997721-3741-4c0e-bee7-1b52b3bf5fd5 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdbe35f311e435ba9e0516f302ba519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb116f8d7dd4858a91c03e0a4310fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:58.737540 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-781b3f55-77cc-4466-847d-c66e263c8d0f tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:58.738270 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-781b3f55-77cc-4466-847d-c66e263c8d0f tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] [instance: a14a2e92-7b76-4576-bc3e-3b567afa63ac] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:58.750639 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-04997721-3741-4c0e-bee7-1b52b3bf5fd5 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] 10.222.0.27 "GET /compute/v2.1/servers/e605c39e-7644-4842-8476-9c9af611282f" status: 200 len: 1320 microversion: 2.1 time: 0.544973 Sep 08 10:36:58.752317 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-781b3f55-77cc-4466-847d-c66e263c8d0f tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:58.752942 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 73/136] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:36:58 2022] GET /compute/v2.1/servers/e605c39e-7644-4842-8476-9c9af611282f => generated 1320 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:36:58.761832 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-781b3f55-77cc-4466-847d-c66e263c8d0f tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:58.762990 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-781b3f55-77cc-4466-847d-c66e263c8d0f tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:58.764665 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-781b3f55-77cc-4466-847d-c66e263c8d0f tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:58.765146 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-781b3f55-77cc-4466-847d-c66e263c8d0f tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:58.765920 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-781b3f55-77cc-4466-847d-c66e263c8d0f tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:59.197207 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-781b3f55-77cc-4466-847d-c66e263c8d0f tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b76777df7594f7a9d03376362b80b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e11d5906f0407d9ea1f1deed40aab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:59.207458 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-781b3f55-77cc-4466-847d-c66e263c8d0f tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] 10.222.0.27 "GET /compute/v2.1/servers/a14a2e92-7b76-4576-bc3e-3b567afa63ac" status: 200 len: 1338 microversion: 2.1 time: 0.473363 Sep 08 10:36:59.213688 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 64/137] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:36:58 2022] GET /compute/v2.1/servers/a14a2e92-7b76-4576-bc3e-3b567afa63ac => generated 1338 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:36:59.778546 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e59ad060-ebde-4b2a-9b9b-e7972b88a3b1 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:59.780542 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e59ad060-ebde-4b2a-9b9b-e7972b88a3b1 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] [instance: e605c39e-7644-4842-8476-9c9af611282f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:59.805915 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e59ad060-ebde-4b2a-9b9b-e7972b88a3b1 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:59.808008 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e59ad060-ebde-4b2a-9b9b-e7972b88a3b1 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:59.812844 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e59ad060-ebde-4b2a-9b9b-e7972b88a3b1 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:59.818289 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e59ad060-ebde-4b2a-9b9b-e7972b88a3b1 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:59.823659 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e59ad060-ebde-4b2a-9b9b-e7972b88a3b1 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:59.832081 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e59ad060-ebde-4b2a-9b9b-e7972b88a3b1 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:00.238670 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b3340f7a-042e-4482-91ec-c196e272762f tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:00.242263 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b3340f7a-042e-4482-91ec-c196e272762f tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] [instance: a14a2e92-7b76-4576-bc3e-3b567afa63ac] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:00.295227 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b3340f7a-042e-4482-91ec-c196e272762f tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:00.304476 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b3340f7a-042e-4482-91ec-c196e272762f tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:00.307411 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b3340f7a-042e-4482-91ec-c196e272762f tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:00.311687 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b3340f7a-042e-4482-91ec-c196e272762f tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:00.321826 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b3340f7a-042e-4482-91ec-c196e272762f tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:00.328689 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b3340f7a-042e-4482-91ec-c196e272762f tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:00.643129 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e59ad060-ebde-4b2a-9b9b-e7972b88a3b1 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdbe35f311e435ba9e0516f302ba519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb116f8d7dd4858a91c03e0a4310fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:00.664533 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e59ad060-ebde-4b2a-9b9b-e7972b88a3b1 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] 10.222.0.27 "GET /compute/v2.1/servers/e605c39e-7644-4842-8476-9c9af611282f" status: 200 len: 1320 microversion: 2.1 time: 0.892419 Sep 08 10:37:00.668999 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 74/138] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:36:59 2022] GET /compute/v2.1/servers/e605c39e-7644-4842-8476-9c9af611282f => generated 1320 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:37:01.573274 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b3340f7a-042e-4482-91ec-c196e272762f tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b76777df7594f7a9d03376362b80b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e11d5906f0407d9ea1f1deed40aab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:01.613885 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b3340f7a-042e-4482-91ec-c196e272762f tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] 10.222.0.27 "GET /compute/v2.1/servers/a14a2e92-7b76-4576-bc3e-3b567afa63ac" status: 200 len: 1338 microversion: 2.1 time: 1.372744 Sep 08 10:37:01.621608 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 65/139] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:00 2022] GET /compute/v2.1/servers/a14a2e92-7b76-4576-bc3e-3b567afa63ac => generated 1338 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:01.716629 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-03275fde-ae0e-4960-897a-2557a859dba2 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:01.717327 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-03275fde-ae0e-4960-897a-2557a859dba2 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] [instance: e605c39e-7644-4842-8476-9c9af611282f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:01.749383 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03275fde-ae0e-4960-897a-2557a859dba2 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:01.749887 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03275fde-ae0e-4960-897a-2557a859dba2 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:01.757581 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03275fde-ae0e-4960-897a-2557a859dba2 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:01.758483 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03275fde-ae0e-4960-897a-2557a859dba2 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:01.761137 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03275fde-ae0e-4960-897a-2557a859dba2 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:01.765542 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03275fde-ae0e-4960-897a-2557a859dba2 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:02.167815 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-03275fde-ae0e-4960-897a-2557a859dba2 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdbe35f311e435ba9e0516f302ba519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb116f8d7dd4858a91c03e0a4310fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:02.178770 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-03275fde-ae0e-4960-897a-2557a859dba2 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] 10.222.0.27 "GET /compute/v2.1/servers/e605c39e-7644-4842-8476-9c9af611282f" status: 200 len: 1320 microversion: 2.1 time: 0.475921 Sep 08 10:37:02.179976 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 75/140] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:01 2022] GET /compute/v2.1/servers/e605c39e-7644-4842-8476-9c9af611282f => generated 1320 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:02.824209 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-807d9e3f-e4f4-4bba-be96-2ff588211176 req-6a5ba601-fb1d-4cdd-815b-b06be70c44cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a14a2e92-7b76-4576-bc3e-3b567afa63ac", "tag": "0752003c-bc8c-4a51-b82a-3d434d535a4b"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:02.843301 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-807d9e3f-e4f4-4bba-be96-2ff588211176 req-6a5ba601-fb1d-4cdd-815b-b06be70c44cb service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:02.844147 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-807d9e3f-e4f4-4bba-be96-2ff588211176 req-6a5ba601-fb1d-4cdd-815b-b06be70c44cb service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:02.844738 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-807d9e3f-e4f4-4bba-be96-2ff588211176 req-6a5ba601-fb1d-4cdd-815b-b06be70c44cb service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:02.884630 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-807d9e3f-e4f4-4bba-be96-2ff588211176 req-6a5ba601-fb1d-4cdd-815b-b06be70c44cb service nova] Creating event network-changed:0752003c-bc8c-4a51-b82a-3d434d535a4b for instance a14a2e92-7b76-4576-bc3e-3b567afa63ac on n-h1-850501-12 Sep 08 10:37:02.896329 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-807d9e3f-e4f4-4bba-be96-2ff588211176 req-6a5ba601-fb1d-4cdd-815b-b06be70c44cb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.629206 Sep 08 10:37:02.897665 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 66/141] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:37:02.913012 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9ae34c7a-0b40-489d-8195-970bd67b6b56 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:02.914240 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9ae34c7a-0b40-489d-8195-970bd67b6b56 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] [instance: a14a2e92-7b76-4576-bc3e-3b567afa63ac] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:02.932589 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ae34c7a-0b40-489d-8195-970bd67b6b56 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:02.933358 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ae34c7a-0b40-489d-8195-970bd67b6b56 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:02.933795 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ae34c7a-0b40-489d-8195-970bd67b6b56 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:02.934660 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ae34c7a-0b40-489d-8195-970bd67b6b56 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:02.935284 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ae34c7a-0b40-489d-8195-970bd67b6b56 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:02.935852 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ae34c7a-0b40-489d-8195-970bd67b6b56 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:03.146974 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9ae34c7a-0b40-489d-8195-970bd67b6b56 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b76777df7594f7a9d03376362b80b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e11d5906f0407d9ea1f1deed40aab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:03.165689 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-348cccc2-7767-4980-8c9f-980ce4187518 tempest-FlavorsV261TestJSON-1465286874 tempest-FlavorsV261TestJSON-1465286874-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-2013804302", "id": 1988264376, "os-flavor-access:is_public": "True"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:03.195229 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9ae34c7a-0b40-489d-8195-970bd67b6b56 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] 10.222.0.27 "GET /compute/v2.1/servers/a14a2e92-7b76-4576-bc3e-3b567afa63ac" status: 200 len: 1338 microversion: 2.1 time: 0.296042 Sep 08 10:37:03.200352 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 67/142] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:02 2022] GET /compute/v2.1/servers/a14a2e92-7b76-4576-bc3e-3b567afa63ac => generated 1338 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:03.211346 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b761dee2-d679-4b55-b6d6-592928164334 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:03.212346 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b761dee2-d679-4b55-b6d6-592928164334 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] [instance: e605c39e-7644-4842-8476-9c9af611282f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:03.247046 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b761dee2-d679-4b55-b6d6-592928164334 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:03.248386 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-348cccc2-7767-4980-8c9f-980ce4187518 tempest-FlavorsV261TestJSON-1465286874 tempest-FlavorsV261TestJSON-1465286874-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.61 time: 0.781294 Sep 08 10:37:03.257538 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 76/143] 10.222.0.27 () {62 vars in 1188 bytes} [Thu Sep 8 10:37:02 2022] POST /compute/v2.1/flavors => generated 468 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 10:37:03.259083 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b761dee2-d679-4b55-b6d6-592928164334 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:03.259967 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b761dee2-d679-4b55-b6d6-592928164334 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:03.261583 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b761dee2-d679-4b55-b6d6-592928164334 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:03.262583 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b761dee2-d679-4b55-b6d6-592928164334 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:03.263764 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b761dee2-d679-4b55-b6d6-592928164334 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:03.520850 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b761dee2-d679-4b55-b6d6-592928164334 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdbe35f311e435ba9e0516f302ba519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb116f8d7dd4858a91c03e0a4310fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:03.531890 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b761dee2-d679-4b55-b6d6-592928164334 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] 10.222.0.27 "GET /compute/v2.1/servers/e605c39e-7644-4842-8476-9c9af611282f" status: 200 len: 1320 microversion: 2.1 time: 0.326643 Sep 08 10:37:03.532966 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 68/144] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:03 2022] GET /compute/v2.1/servers/e605c39e-7644-4842-8476-9c9af611282f => generated 1320 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:03.711889 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b6f4ae2d-4454-4126-adce-1a57e92efdd7 tempest-FlavorsV261TestJSON-927587455 tempest-FlavorsV261TestJSON-927587455-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:03.723180 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b6f4ae2d-4454-4126-adce-1a57e92efdd7 tempest-FlavorsV261TestJSON-927587455 tempest-FlavorsV261TestJSON-927587455-project] 10.222.0.27 "GET /compute/v2.1/flavors/1988264376" status: 200 len: 468 microversion: 2.61 time: 0.463403 Sep 08 10:37:03.724534 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 77/145] 10.222.0.27 () {60 vars in 1199 bytes} [Thu Sep 8 10:37:03 2022] GET /compute/v2.1/flavors/1988264376 => generated 468 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:37:03.741671 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5098e34e-1191-465c-b823-7aa30888f43e tempest-FlavorsV261TestJSON-1465286874 tempest-FlavorsV261TestJSON-1465286874-project-admin] Action: 'update', calling method: .version_select at 0x7f68e65b1280>, body: {"flavor": {"description": "new"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:03.789197 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5098e34e-1191-465c-b823-7aa30888f43e tempest-FlavorsV261TestJSON-1465286874 tempest-FlavorsV261TestJSON-1465286874-project-admin] 10.222.0.27 "PUT /compute/v2.1/flavors/1988264376" status: 200 len: 469 microversion: 2.61 time: 0.053465 Sep 08 10:37:03.797641 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 69/146] 10.222.0.27 () {62 vars in 1219 bytes} [Thu Sep 8 10:37:03 2022] PUT /compute/v2.1/flavors/1988264376 => generated 469 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 10:37:03.805903 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8a667858-8399-49ab-85cf-1a87322960ef tempest-FlavorsV261TestJSON-927587455 tempest-FlavorsV261TestJSON-927587455-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:03.852951 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8a667858-8399-49ab-85cf-1a87322960ef tempest-FlavorsV261TestJSON-927587455 tempest-FlavorsV261TestJSON-927587455-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 6250 microversion: 2.61 time: 0.052355 Sep 08 10:37:03.854235 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 78/147] 10.222.0.27 () {60 vars in 1187 bytes} [Thu Sep 8 10:37:03 2022] GET /compute/v2.1/flavors/detail => generated 6250 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:37:03.877090 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-36c0413c-b253-4c8c-8e28-bbca076815bb tempest-FlavorsV261TestJSON-927587455 tempest-FlavorsV261TestJSON-927587455-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:03.908023 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-36c0413c-b253-4c8c-8e28-bbca076815bb tempest-FlavorsV261TestJSON-927587455 tempest-FlavorsV261TestJSON-927587455-project] 10.222.0.27 "GET /compute/v2.1/flavors" status: 200 len: 3157 microversion: 2.61 time: 0.034685 Sep 08 10:37:03.909088 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 70/148] 10.222.0.27 () {60 vars in 1166 bytes} [Thu Sep 8 10:37:03 2022] GET /compute/v2.1/flavors => generated 3157 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:37:03.929357 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6a8108a6-de7e-41e7-bbb2-de1c7da0661f tempest-FlavorsV261TestJSON-1465286874 tempest-FlavorsV261TestJSON-1465286874-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:03.956286 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6a8108a6-de7e-41e7-bbb2-de1c7da0661f tempest-FlavorsV261TestJSON-1465286874 tempest-FlavorsV261TestJSON-1465286874-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1988264376" status: 202 len: 0 microversion: 2.61 time: 0.030552 Sep 08 10:37:03.958504 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 79/149] 10.222.0.27 () {60 vars in 1202 bytes} [Thu Sep 8 10:37:03 2022] DELETE /compute/v2.1/flavors/1988264376 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:37:03.967210 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-50146280-48d5-469a-a28a-c9db9f67d793 tempest-FlavorsV261TestJSON-1465286874 tempest-FlavorsV261TestJSON-1465286874-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:03.998965 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-50146280-48d5-469a-a28a-c9db9f67d793 tempest-FlavorsV261TestJSON-1465286874 tempest-FlavorsV261TestJSON-1465286874-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.034842 Sep 08 10:37:04.009321 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 71/150] 10.222.0.27 () {60 vars in 1187 bytes} [Thu Sep 8 10:37:03 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:37:04.226592 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f56832e5-47c3-496a-b8d2-3a6d0f504fc9 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:04.227295 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f56832e5-47c3-496a-b8d2-3a6d0f504fc9 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] [instance: a14a2e92-7b76-4576-bc3e-3b567afa63ac] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:04.233388 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f56832e5-47c3-496a-b8d2-3a6d0f504fc9 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:04.234141 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f56832e5-47c3-496a-b8d2-3a6d0f504fc9 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:04.234573 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f56832e5-47c3-496a-b8d2-3a6d0f504fc9 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:04.235440 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f56832e5-47c3-496a-b8d2-3a6d0f504fc9 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:04.236047 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f56832e5-47c3-496a-b8d2-3a6d0f504fc9 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:04.236874 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f56832e5-47c3-496a-b8d2-3a6d0f504fc9 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:04.405370 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f56832e5-47c3-496a-b8d2-3a6d0f504fc9 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b76777df7594f7a9d03376362b80b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e11d5906f0407d9ea1f1deed40aab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:04.414226 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f56832e5-47c3-496a-b8d2-3a6d0f504fc9 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] 10.222.0.27 "GET /compute/v2.1/servers/a14a2e92-7b76-4576-bc3e-3b567afa63ac" status: 200 len: 1338 microversion: 2.1 time: 0.192021 Sep 08 10:37:04.414804 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 80/151] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:04 2022] GET /compute/v2.1/servers/a14a2e92-7b76-4576-bc3e-3b567afa63ac => generated 1338 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:04.563844 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0f5b4fa2-551f-4a03-af02-5b888cf1a63b tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:04.564559 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0f5b4fa2-551f-4a03-af02-5b888cf1a63b tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] [instance: e605c39e-7644-4842-8476-9c9af611282f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:04.572418 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0f5b4fa2-551f-4a03-af02-5b888cf1a63b tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:04.573080 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0f5b4fa2-551f-4a03-af02-5b888cf1a63b tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:04.573834 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0f5b4fa2-551f-4a03-af02-5b888cf1a63b tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:04.575053 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0f5b4fa2-551f-4a03-af02-5b888cf1a63b tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:04.575720 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0f5b4fa2-551f-4a03-af02-5b888cf1a63b tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:04.576609 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0f5b4fa2-551f-4a03-af02-5b888cf1a63b tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:04.809300 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0f5b4fa2-551f-4a03-af02-5b888cf1a63b tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdbe35f311e435ba9e0516f302ba519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb116f8d7dd4858a91c03e0a4310fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:04.821836 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0f5b4fa2-551f-4a03-af02-5b888cf1a63b tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] 10.222.0.27 "GET /compute/v2.1/servers/e605c39e-7644-4842-8476-9c9af611282f" status: 200 len: 1320 microversion: 2.1 time: 0.262158 Sep 08 10:37:04.826941 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 72/152] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:04 2022] GET /compute/v2.1/servers/e605c39e-7644-4842-8476-9c9af611282f => generated 1320 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:05.448336 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1334facb-1c63-4bfa-8356-6d48112616b7 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:05.449203 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1334facb-1c63-4bfa-8356-6d48112616b7 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] [instance: a14a2e92-7b76-4576-bc3e-3b567afa63ac] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:05.465549 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=17 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:37:05.468950 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=56 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:37:05.473613 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1334facb-1c63-4bfa-8356-6d48112616b7 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:05.475511 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1334facb-1c63-4bfa-8356-6d48112616b7 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:05.477967 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1334facb-1c63-4bfa-8356-6d48112616b7 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:05.480246 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1334facb-1c63-4bfa-8356-6d48112616b7 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:05.480876 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1334facb-1c63-4bfa-8356-6d48112616b7 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:05.483782 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1334facb-1c63-4bfa-8356-6d48112616b7 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:05.538879 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:37:05.858395 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2a0e7e42-7dce-4fad-902b-ffa8d0af6295 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:05.859253 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2a0e7e42-7dce-4fad-902b-ffa8d0af6295 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] [instance: e605c39e-7644-4842-8476-9c9af611282f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:05.876968 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2a0e7e42-7dce-4fad-902b-ffa8d0af6295 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:05.889302 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2a0e7e42-7dce-4fad-902b-ffa8d0af6295 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:05.889894 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2a0e7e42-7dce-4fad-902b-ffa8d0af6295 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:05.890680 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2a0e7e42-7dce-4fad-902b-ffa8d0af6295 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:05.891160 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2a0e7e42-7dce-4fad-902b-ffa8d0af6295 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:05.891600 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2a0e7e42-7dce-4fad-902b-ffa8d0af6295 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:05.949769 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1334facb-1c63-4bfa-8356-6d48112616b7 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b76777df7594f7a9d03376362b80b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e11d5906f0407d9ea1f1deed40aab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:05.964965 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1334facb-1c63-4bfa-8356-6d48112616b7 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] 10.222.0.27 "GET /compute/v2.1/servers/a14a2e92-7b76-4576-bc3e-3b567afa63ac" status: 200 len: 1338 microversion: 2.1 time: 0.523707 Sep 08 10:37:05.966069 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 81/153] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:05 2022] GET /compute/v2.1/servers/a14a2e92-7b76-4576-bc3e-3b567afa63ac => generated 1338 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:06.318400 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2a0e7e42-7dce-4fad-902b-ffa8d0af6295 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdbe35f311e435ba9e0516f302ba519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb116f8d7dd4858a91c03e0a4310fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:06.332136 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2a0e7e42-7dce-4fad-902b-ffa8d0af6295 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] 10.222.0.27 "GET /compute/v2.1/servers/e605c39e-7644-4842-8476-9c9af611282f" status: 200 len: 1320 microversion: 2.1 time: 0.480218 Sep 08 10:37:06.352819 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 73/154] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:05 2022] GET /compute/v2.1/servers/e605c39e-7644-4842-8476-9c9af611282f => generated 1320 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:37:07.001399 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0da46120-5f65-4c18-8816-fe73f9da405c tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:07.002204 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0da46120-5f65-4c18-8816-fe73f9da405c tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] [instance: a14a2e92-7b76-4576-bc3e-3b567afa63ac] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:07.012433 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0da46120-5f65-4c18-8816-fe73f9da405c tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:07.017547 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0da46120-5f65-4c18-8816-fe73f9da405c tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:07.018231 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0da46120-5f65-4c18-8816-fe73f9da405c tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:07.020344 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0da46120-5f65-4c18-8816-fe73f9da405c tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:07.021051 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0da46120-5f65-4c18-8816-fe73f9da405c tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:07.021495 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0da46120-5f65-4c18-8816-fe73f9da405c tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:07.364439 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2dae0425-5cb1-4d2f-bb8d-f0cb47d50b08 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:07.364439 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2dae0425-5cb1-4d2f-bb8d-f0cb47d50b08 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] [instance: e605c39e-7644-4842-8476-9c9af611282f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:07.364439 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=14 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:37:07.381122 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2dae0425-5cb1-4d2f-bb8d-f0cb47d50b08 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:07.392146 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2dae0425-5cb1-4d2f-bb8d-f0cb47d50b08 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:07.392695 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2dae0425-5cb1-4d2f-bb8d-f0cb47d50b08 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:07.393479 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2dae0425-5cb1-4d2f-bb8d-f0cb47d50b08 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:07.393989 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2dae0425-5cb1-4d2f-bb8d-f0cb47d50b08 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:07.394512 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2dae0425-5cb1-4d2f-bb8d-f0cb47d50b08 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:07.446883 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0da46120-5f65-4c18-8816-fe73f9da405c tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b76777df7594f7a9d03376362b80b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e11d5906f0407d9ea1f1deed40aab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:07.449076 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=100 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:37:07.458374 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0da46120-5f65-4c18-8816-fe73f9da405c tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] 10.222.0.27 "GET /compute/v2.1/servers/a14a2e92-7b76-4576-bc3e-3b567afa63ac" status: 200 len: 1338 microversion: 2.1 time: 0.458865 Sep 08 10:37:07.466211 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=66 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:37:07.474772 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 82/155] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:06 2022] GET /compute/v2.1/servers/a14a2e92-7b76-4576-bc3e-3b567afa63ac => generated 1338 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:37:07.910191 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2dae0425-5cb1-4d2f-bb8d-f0cb47d50b08 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdbe35f311e435ba9e0516f302ba519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb116f8d7dd4858a91c03e0a4310fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:07.928381 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2dae0425-5cb1-4d2f-bb8d-f0cb47d50b08 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] 10.222.0.27 "GET /compute/v2.1/servers/e605c39e-7644-4842-8476-9c9af611282f" status: 200 len: 1320 microversion: 2.1 time: 0.571769 Sep 08 10:37:07.929645 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 74/156] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:07 2022] GET /compute/v2.1/servers/e605c39e-7644-4842-8476-9c9af611282f => generated 1320 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:37:08.478522 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a9583d95-2e83-415f-bee6-1d6be2273b52 tempest-FlavorsAccessTestJSON-1375729564 tempest-FlavorsAccessTestJSON-1375729564-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-296247546", "id": 2352702, "os-flavor-access:is_public": "False"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:08.514783 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a9583d95-2e83-415f-bee6-1d6be2273b52 tempest-FlavorsAccessTestJSON-1375729564 tempest-FlavorsAccessTestJSON-1375729564-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 421 microversion: 2.1 time: 0.592875 Sep 08 10:37:08.515402 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 83/157] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:37:07 2022] POST /compute/v2.1/flavors => generated 421 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:37:08.542052 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2f56ddbc-f4b7-4c1c-9f27-cfb2d92a48cf tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:08.542691 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2f56ddbc-f4b7-4c1c-9f27-cfb2d92a48cf tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] [instance: a14a2e92-7b76-4576-bc3e-3b567afa63ac] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:08.559539 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2f56ddbc-f4b7-4c1c-9f27-cfb2d92a48cf tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:08.560035 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2f56ddbc-f4b7-4c1c-9f27-cfb2d92a48cf tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:08.560475 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2f56ddbc-f4b7-4c1c-9f27-cfb2d92a48cf tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:08.565658 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2f56ddbc-f4b7-4c1c-9f27-cfb2d92a48cf tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:08.566633 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2f56ddbc-f4b7-4c1c-9f27-cfb2d92a48cf tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:08.567209 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2f56ddbc-f4b7-4c1c-9f27-cfb2d92a48cf tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:08.590899 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b9e206d1-88ee-4ce3-b977-e8306f5b0d3e tempest-FlavorsV255TestJSON-665729067 tempest-FlavorsV255TestJSON-665729067-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1303870665", "id": 873182563, "os-flavor-access:is_public": "True"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:08.638384 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b9e206d1-88ee-4ce3-b977-e8306f5b0d3e tempest-FlavorsV255TestJSON-665729067 tempest-FlavorsV255TestJSON-665729067-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 446 microversion: 2.55 time: 0.551220 Sep 08 10:37:08.638998 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 75/158] 10.222.0.27 () {62 vars in 1188 bytes} [Thu Sep 8 10:37:08 2022] POST /compute/v2.1/flavors => generated 446 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:37:08.651682 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3ec7b793-6291-4c83-8bb8-0b2e03e9c254 tempest-FlavorsAccessTestJSON-1375729564 tempest-FlavorsAccessTestJSON-1375729564-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "78572a136a5a4830828318029818da7f"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:08.820428 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2f56ddbc-f4b7-4c1c-9f27-cfb2d92a48cf tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b76777df7594f7a9d03376362b80b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e11d5906f0407d9ea1f1deed40aab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:08.832232 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2f56ddbc-f4b7-4c1c-9f27-cfb2d92a48cf tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] 10.222.0.27 "GET /compute/v2.1/servers/a14a2e92-7b76-4576-bc3e-3b567afa63ac" status: 200 len: 1338 microversion: 2.1 time: 0.314736 Sep 08 10:37:08.833453 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 84/159] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:08 2022] GET /compute/v2.1/servers/a14a2e92-7b76-4576-bc3e-3b567afa63ac => generated 1338 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:09.150899 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b10b3b26-8bca-4149-bbbe-44d900f94a6f tempest-FlavorsV255TestJSON-1274265794 tempest-FlavorsV255TestJSON-1274265794-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:09.168003 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b10b3b26-8bca-4149-bbbe-44d900f94a6f tempest-FlavorsV255TestJSON-1274265794 tempest-FlavorsV255TestJSON-1274265794-project] 10.222.0.27 "GET /compute/v2.1/flavors/873182563" status: 200 len: 446 microversion: 2.55 time: 0.330624 Sep 08 10:37:09.172289 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 85/160] 10.222.0.27 () {60 vars in 1196 bytes} [Thu Sep 8 10:37:08 2022] GET /compute/v2.1/flavors/873182563 => generated 446 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:37:09.312393 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3ec7b793-6291-4c83-8bb8-0b2e03e9c254 tempest-FlavorsAccessTestJSON-1375729564 tempest-FlavorsAccessTestJSON-1375729564-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/2352702/action" status: 200 len: 94 microversion: 2.1 time: 0.667099 Sep 08 10:37:09.313355 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 76/161] 10.222.0.27 () {60 vars in 1191 bytes} [Thu Sep 8 10:37:08 2022] POST /compute/v2.1/flavors/2352702/action => generated 94 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:37:09.324235 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ed74ea0f-888d-4906-9e86-e20406f56bda tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:09.325799 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ed74ea0f-888d-4906-9e86-e20406f56bda tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] [instance: e605c39e-7644-4842-8476-9c9af611282f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:09.340959 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed74ea0f-888d-4906-9e86-e20406f56bda tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:09.349179 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed74ea0f-888d-4906-9e86-e20406f56bda tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:09.349966 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed74ea0f-888d-4906-9e86-e20406f56bda tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:09.351578 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed74ea0f-888d-4906-9e86-e20406f56bda tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:09.352424 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed74ea0f-888d-4906-9e86-e20406f56bda tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:09.354110 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed74ea0f-888d-4906-9e86-e20406f56bda tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:09.537427 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d578df4a-971b-457f-8e22-474c9a548a80 tempest-QuotasAdminTestV236-1019635658 tempest-QuotasAdminTestV236-1019635658-project-admin] Action: 'update', calling method: .version_select at 0x7f68e51edee0>, body: {"quota_set": {"ram": "5120"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:09.841567 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d578df4a-971b-457f-8e22-474c9a548a80 tempest-QuotasAdminTestV236-1019635658 tempest-QuotasAdminTestV236-1019635658-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:09.842265 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d578df4a-971b-457f-8e22-474c9a548a80 tempest-QuotasAdminTestV236-1019635658 tempest-QuotasAdminTestV236-1019635658-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:09.842896 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d578df4a-971b-457f-8e22-474c9a548a80 tempest-QuotasAdminTestV236-1019635658 tempest-QuotasAdminTestV236-1019635658-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:09.843708 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d578df4a-971b-457f-8e22-474c9a548a80 tempest-QuotasAdminTestV236-1019635658 tempest-QuotasAdminTestV236-1019635658-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:09.844442 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d578df4a-971b-457f-8e22-474c9a548a80 tempest-QuotasAdminTestV236-1019635658 tempest-QuotasAdminTestV236-1019635658-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:09.844939 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d578df4a-971b-457f-8e22-474c9a548a80 tempest-QuotasAdminTestV236-1019635658 tempest-QuotasAdminTestV236-1019635658-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:09.921592 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:INSERT=18,nova_api:SELECT=76,nova_api:DELETE=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:37:09.936968 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d578df4a-971b-457f-8e22-474c9a548a80 tempest-QuotasAdminTestV236-1019635658 tempest-QuotasAdminTestV236-1019635658-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/e443f4906ca34df7b25186178744dde1" status: 200 len: 240 microversion: 2.36 time: 0.753859 Sep 08 10:37:09.937960 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 86/162] 10.222.0.27 () {62 vars in 1303 bytes} [Thu Sep 8 10:37:09 2022] PUT /compute/v2.1/os-quota-sets/e443f4906ca34df7b25186178744dde1 => generated 240 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:37:09.944431 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b8917a7c-3627-4558-bcbd-f286d425e836 tempest-FlavorsV255TestJSON-665729067 tempest-FlavorsV255TestJSON-665729067-project-admin] Action: 'update', calling method: .version_select at 0x7f68e65b01f0>, body: {"flavor": {"description": "new"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:09.990291 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b8917a7c-3627-4558-bcbd-f286d425e836 tempest-FlavorsV255TestJSON-665729067 tempest-FlavorsV255TestJSON-665729067-project-admin] 10.222.0.27 "PUT /compute/v2.1/flavors/873182563" status: 200 len: 447 microversion: 2.55 time: 0.051162 Sep 08 10:37:09.992098 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 87/163] 10.222.0.27 () {62 vars in 1216 bytes} [Thu Sep 8 10:37:09 2022] PUT /compute/v2.1/flavors/873182563 => generated 447 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:37:10.169141 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-050b04bf-7bd1-428c-9893-124bdc21fccd req-33b2d373-d666-43bb-86fc-e6cb2b4760a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e605c39e-7644-4842-8476-9c9af611282f", "name": "network-vif-plugged", "status": "completed", "tag": "8c4cf5b9-c6e2-4335-97b1-d398b92bb922"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:10.170796 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ed74ea0f-888d-4906-9e86-e20406f56bda tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdbe35f311e435ba9e0516f302ba519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb116f8d7dd4858a91c03e0a4310fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:10.181553 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ed74ea0f-888d-4906-9e86-e20406f56bda tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] 10.222.0.27 "GET /compute/v2.1/servers/e605c39e-7644-4842-8476-9c9af611282f" status: 200 len: 1320 microversion: 2.1 time: 0.865915 Sep 08 10:37:10.185693 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-050b04bf-7bd1-428c-9893-124bdc21fccd req-33b2d373-d666-43bb-86fc-e6cb2b4760a0 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:10.185889 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 77/164] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:09 2022] GET /compute/v2.1/servers/e605c39e-7644-4842-8476-9c9af611282f => generated 1320 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:10.186508 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-050b04bf-7bd1-428c-9893-124bdc21fccd req-33b2d373-d666-43bb-86fc-e6cb2b4760a0 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:10.187082 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-050b04bf-7bd1-428c-9893-124bdc21fccd req-33b2d373-d666-43bb-86fc-e6cb2b4760a0 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:10.223479 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-050b04bf-7bd1-428c-9893-124bdc21fccd req-33b2d373-d666-43bb-86fc-e6cb2b4760a0 service nova] Creating event network-vif-plugged:8c4cf5b9-c6e2-4335-97b1-d398b92bb922 for instance e605c39e-7644-4842-8476-9c9af611282f on n-h2-850501-12 Sep 08 10:37:10.229394 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-050b04bf-7bd1-428c-9893-124bdc21fccd req-33b2d373-d666-43bb-86fc-e6cb2b4760a0 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=128862) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 08 10:37:10.234626 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-050b04bf-7bd1-428c-9893-124bdc21fccd req-33b2d373-d666-43bb-86fc-e6cb2b4760a0 service nova] Acquired lock "compute-rpcapi-router" {{(pid=128862) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 08 10:37:10.235985 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c068b178-0589-4ece-8269-2a83d1da12cc None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:10.240063 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c068b178-0589-4ece-8269-2a83d1da12cc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:10.240761 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c068b178-0589-4ece-8269-2a83d1da12cc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:10.241990 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c068b178-0589-4ece-8269-2a83d1da12cc None None] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:10.242618 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c068b178-0589-4ece-8269-2a83d1da12cc None None] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:10.244516 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c068b178-0589-4ece-8269-2a83d1da12cc None None] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:10.269947 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.compute.rpcapi [None req-c068b178-0589-4ece-8269-2a83d1da12cc None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 08 10:37:10.272577 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c068b178-0589-4ece-8269-2a83d1da12cc None None] Releasing lock "compute-rpcapi-router" {{(pid=128862) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 08 10:37:10.302153 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c068b178-0589-4ece-8269-2a83d1da12cc None None] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.308014 Sep 08 10:37:10.304013 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 88/165] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:37:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:37:10.310970 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4d062e41-c3a2-4d9c-990a-7a654ab4140b tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:10.312066 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4d062e41-c3a2-4d9c-990a-7a654ab4140b tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] [instance: a14a2e92-7b76-4576-bc3e-3b567afa63ac] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:10.322806 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d062e41-c3a2-4d9c-990a-7a654ab4140b tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:10.323899 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d062e41-c3a2-4d9c-990a-7a654ab4140b tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:10.324584 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d062e41-c3a2-4d9c-990a-7a654ab4140b tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:10.325552 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d062e41-c3a2-4d9c-990a-7a654ab4140b tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:10.326320 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d062e41-c3a2-4d9c-990a-7a654ab4140b tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:10.327187 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d062e41-c3a2-4d9c-990a-7a654ab4140b tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:10.609661 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0d65d04d-5faf-4fd9-a7dd-b37fe9f4f114 tempest-FlavorsAccessTestJSON-2031260696 tempest-FlavorsAccessTestJSON-2031260696-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:10.674141 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0d65d04d-5faf-4fd9-a7dd-b37fe9f4f114 tempest-FlavorsAccessTestJSON-2031260696 tempest-FlavorsAccessTestJSON-2031260696-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.471184 Sep 08 10:37:10.692358 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4d062e41-c3a2-4d9c-990a-7a654ab4140b tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b76777df7594f7a9d03376362b80b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e11d5906f0407d9ea1f1deed40aab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:10.692993 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4d062e41-c3a2-4d9c-990a-7a654ab4140b tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] 10.222.0.27 "GET /compute/v2.1/servers/a14a2e92-7b76-4576-bc3e-3b567afa63ac" status: 200 len: 1338 microversion: 2.1 time: 0.387517 Sep 08 10:37:10.697242 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 78/166] 10.222.0.27 () {58 vars in 1146 bytes} [Thu Sep 8 10:37:10 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:10.698073 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 89/167] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:10 2022] GET /compute/v2.1/servers/a14a2e92-7b76-4576-bc3e-3b567afa63ac => generated 1338 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:10.707514 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-eca76603-2f55-43c2-b77d-83289460e363 tempest-QuotasAdminTestV236-1019635658 tempest-QuotasAdminTestV236-1019635658-project-admin] Calling method '.version_select at 0x7f68e5326af0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:10.712480 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-59332940-ce94-427c-9168-b7203b5e33ac tempest-FlavorsV255TestJSON-1274265794 tempest-FlavorsV255TestJSON-1274265794-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:10.750942 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-59332940-ce94-427c-9168-b7203b5e33ac tempest-FlavorsV255TestJSON-1274265794 tempest-FlavorsV255TestJSON-1274265794-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5722 microversion: 2.55 time: 0.048794 Sep 08 10:37:10.761488 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 90/168] 10.222.0.27 () {60 vars in 1187 bytes} [Thu Sep 8 10:37:10 2022] GET /compute/v2.1/flavors/detail => generated 5722 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:37:10.774694 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4a9bc50b-e5ce-4565-960d-a312dfde2f51 tempest-FlavorsAccessTestJSON-1375729564 tempest-FlavorsAccessTestJSON-1375729564-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "78572a136a5a4830828318029818da7f"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:11.084941 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eca76603-2f55-43c2-b77d-83289460e363 tempest-QuotasAdminTestV236-1019635658 tempest-QuotasAdminTestV236-1019635658-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:11.085483 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eca76603-2f55-43c2-b77d-83289460e363 tempest-QuotasAdminTestV236-1019635658 tempest-QuotasAdminTestV236-1019635658-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:11.085931 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eca76603-2f55-43c2-b77d-83289460e363 tempest-QuotasAdminTestV236-1019635658 tempest-QuotasAdminTestV236-1019635658-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:11.090282 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eca76603-2f55-43c2-b77d-83289460e363 tempest-QuotasAdminTestV236-1019635658 tempest-QuotasAdminTestV236-1019635658-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:11.090848 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eca76603-2f55-43c2-b77d-83289460e363 tempest-QuotasAdminTestV236-1019635658 tempest-QuotasAdminTestV236-1019635658-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:11.093942 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eca76603-2f55-43c2-b77d-83289460e363 tempest-QuotasAdminTestV236-1019635658 tempest-QuotasAdminTestV236-1019635658-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:11.137251 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4a9bc50b-e5ce-4565-960d-a312dfde2f51 tempest-FlavorsAccessTestJSON-1375729564 tempest-FlavorsAccessTestJSON-1375729564-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/2352702/action" status: 200 len: 21 microversion: 2.1 time: 0.373571 Sep 08 10:37:11.138486 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 91/169] 10.222.0.27 () {60 vars in 1191 bytes} [Thu Sep 8 10:37:10 2022] POST /compute/v2.1/flavors/2352702/action => generated 21 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:37:11.157093 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-eca76603-2f55-43c2-b77d-83289460e363 tempest-QuotasAdminTestV236-1019635658 tempest-QuotasAdminTestV236-1019635658-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/e443f4906ca34df7b25186178744dde1/detail" status: 200 len: 672 microversion: 2.36 time: 0.457284 Sep 08 10:37:11.157633 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 79/170] 10.222.0.27 () {60 vars in 1304 bytes} [Thu Sep 8 10:37:10 2022] GET /compute/v2.1/os-quota-sets/e443f4906ca34df7b25186178744dde1/detail => generated 672 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:37:11.169719 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fcb266c9-12b4-4d2e-8a0c-1b6c1005815d tempest-FlavorsV255TestJSON-1274265794 tempest-FlavorsV255TestJSON-1274265794-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:11.228104 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fcb266c9-12b4-4d2e-8a0c-1b6c1005815d tempest-FlavorsV255TestJSON-1274265794 tempest-FlavorsV255TestJSON-1274265794-project] 10.222.0.27 "GET /compute/v2.1/flavors" status: 200 len: 3154 microversion: 2.55 time: 0.069332 Sep 08 10:37:11.234298 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 80/171] 10.222.0.27 () {60 vars in 1166 bytes} [Thu Sep 8 10:37:11 2022] GET /compute/v2.1/flavors => generated 3154 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:37:11.247176 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d82ee8ad-cfff-4486-9191-368148e9aad0 tempest-FlavorsAccessTestJSON-2031260696 tempest-FlavorsAccessTestJSON-2031260696-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:11.294154 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3c883762-ee89-46e6-aafe-5237d9101a43 tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] Calling method '.version_select at 0x7f68e57c8670>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:11.295379 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d82ee8ad-cfff-4486-9191-368148e9aad0 tempest-FlavorsAccessTestJSON-2031260696 tempest-FlavorsAccessTestJSON-2031260696-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5406 microversion: 2.1 time: 0.059871 Sep 08 10:37:11.296453 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 81/172] 10.222.0.27 () {58 vars in 1146 bytes} [Thu Sep 8 10:37:11 2022] GET /compute/v2.1/flavors/detail => generated 5406 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:11.296610 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c883762-ee89-46e6-aafe-5237d9101a43 tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:11.298057 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c883762-ee89-46e6-aafe-5237d9101a43 tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:11.300018 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c883762-ee89-46e6-aafe-5237d9101a43 tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:11.309292 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d12ca5c9-4160-4ca5-bec6-7abcf787db70 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:11.310167 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d12ca5c9-4160-4ca5-bec6-7abcf787db70 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] [instance: e605c39e-7644-4842-8476-9c9af611282f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:11.329661 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d12ca5c9-4160-4ca5-bec6-7abcf787db70 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:11.330470 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d12ca5c9-4160-4ca5-bec6-7abcf787db70 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:11.330916 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d12ca5c9-4160-4ca5-bec6-7abcf787db70 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:11.340223 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d12ca5c9-4160-4ca5-bec6-7abcf787db70 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:11.340732 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d12ca5c9-4160-4ca5-bec6-7abcf787db70 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:11.341209 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d12ca5c9-4160-4ca5-bec6-7abcf787db70 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:11.359999 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c883762-ee89-46e6-aafe-5237d9101a43 tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:11.360574 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c883762-ee89-46e6-aafe-5237d9101a43 tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:11.363730 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c883762-ee89-46e6-aafe-5237d9101a43 tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:11.392295 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c883762-ee89-46e6-aafe-5237d9101a43 tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:11.397060 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c883762-ee89-46e6-aafe-5237d9101a43 tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:11.398335 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c883762-ee89-46e6-aafe-5237d9101a43 tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:11.417655 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3c883762-ee89-46e6-aafe-5237d9101a43 tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.277936 Sep 08 10:37:11.418450 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 92/173] 10.222.0.27 () {58 vars in 1146 bytes} [Thu Sep 8 10:37:11 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:37:11.430887 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5db119ab-f471-4f6f-bbba-0c2acad53ad1 tempest-FlavorsV255TestJSON-665729067 tempest-FlavorsV255TestJSON-665729067-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:11.463035 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5db119ab-f471-4f6f-bbba-0c2acad53ad1 tempest-FlavorsV255TestJSON-665729067 tempest-FlavorsV255TestJSON-665729067-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/873182563" status: 202 len: 0 microversion: 2.55 time: 0.039504 Sep 08 10:37:11.464365 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 93/174] 10.222.0.27 () {60 vars in 1199 bytes} [Thu Sep 8 10:37:11 2022] DELETE /compute/v2.1/flavors/873182563 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:37:11.476548 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a92beb81-945c-4f55-b085-d28ce58b9cad tempest-FlavorsAccessTestJSON-1375729564 tempest-FlavorsAccessTestJSON-1375729564-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:11.501475 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a92beb81-945c-4f55-b085-d28ce58b9cad tempest-FlavorsAccessTestJSON-1375729564 tempest-FlavorsAccessTestJSON-1375729564-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/2352702" status: 202 len: 0 microversion: 2.1 time: 0.034339 Sep 08 10:37:11.507067 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 94/175] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Sep 8 10:37:11 2022] DELETE /compute/v2.1/flavors/2352702 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:37:11.509824 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-aef065fd-c608-490a-91d1-a52856b28e49 tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] Calling method '.version_select at 0x7f68e51ed700>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:11.513202 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aef065fd-c608-490a-91d1-a52856b28e49 tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:11.513836 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aef065fd-c608-490a-91d1-a52856b28e49 tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:11.514387 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aef065fd-c608-490a-91d1-a52856b28e49 tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:11.536280 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aef065fd-c608-490a-91d1-a52856b28e49 tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:11.536953 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aef065fd-c608-490a-91d1-a52856b28e49 tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:11.537501 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aef065fd-c608-490a-91d1-a52856b28e49 tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:11.553235 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aef065fd-c608-490a-91d1-a52856b28e49 tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:11.553925 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aef065fd-c608-490a-91d1-a52856b28e49 tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:11.554575 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aef065fd-c608-490a-91d1-a52856b28e49 tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:11.575511 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-aef065fd-c608-490a-91d1-a52856b28e49 tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1509 microversion: 2.1 time: 0.070812 Sep 08 10:37:11.585284 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 95/176] 10.222.0.27 () {58 vars in 1167 bytes} [Thu Sep 8 10:37:11 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1509 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:11.600646 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ffb2a59c-8c9c-4b18-bc94-2bd113799516 tempest-QuotasAdminTestV236-1019635658 tempest-QuotasAdminTestV236-1019635658-project-admin] Action: 'update', calling method: .version_select at 0x7f68e51edf70>, body: {"quota_set": {"ram": "2048"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:11.733898 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ffb2a59c-8c9c-4b18-bc94-2bd113799516 tempest-QuotasAdminTestV236-1019635658 tempest-QuotasAdminTestV236-1019635658-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:11.738577 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ffb2a59c-8c9c-4b18-bc94-2bd113799516 tempest-QuotasAdminTestV236-1019635658 tempest-QuotasAdminTestV236-1019635658-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:11.738577 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ffb2a59c-8c9c-4b18-bc94-2bd113799516 tempest-QuotasAdminTestV236-1019635658 tempest-QuotasAdminTestV236-1019635658-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:11.738577 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ffb2a59c-8c9c-4b18-bc94-2bd113799516 tempest-QuotasAdminTestV236-1019635658 tempest-QuotasAdminTestV236-1019635658-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:11.738577 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ffb2a59c-8c9c-4b18-bc94-2bd113799516 tempest-QuotasAdminTestV236-1019635658 tempest-QuotasAdminTestV236-1019635658-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:11.742691 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ffb2a59c-8c9c-4b18-bc94-2bd113799516 tempest-QuotasAdminTestV236-1019635658 tempest-QuotasAdminTestV236-1019635658-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:11.747387 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d12ca5c9-4160-4ca5-bec6-7abcf787db70 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdbe35f311e435ba9e0516f302ba519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb116f8d7dd4858a91c03e0a4310fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:11.762968 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d12ca5c9-4160-4ca5-bec6-7abcf787db70 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] 10.222.0.27 "GET /compute/v2.1/servers/e605c39e-7644-4842-8476-9c9af611282f" status: 200 len: 1320 microversion: 2.1 time: 0.465092 Sep 08 10:37:11.763808 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 82/177] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:11 2022] GET /compute/v2.1/servers/e605c39e-7644-4842-8476-9c9af611282f => generated 1320 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:11.782343 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3082ce69-2c6d-4541-abee-5080818137ad tempest-FlavorsV255TestJSON-665729067 tempest-FlavorsV255TestJSON-665729067-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:11.798122 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ffb2a59c-8c9c-4b18-bc94-2bd113799516 tempest-QuotasAdminTestV236-1019635658 tempest-QuotasAdminTestV236-1019635658-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:11.798642 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ffb2a59c-8c9c-4b18-bc94-2bd113799516 tempest-QuotasAdminTestV236-1019635658 tempest-QuotasAdminTestV236-1019635658-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:11.799087 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ffb2a59c-8c9c-4b18-bc94-2bd113799516 tempest-QuotasAdminTestV236-1019635658 tempest-QuotasAdminTestV236-1019635658-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:11.800386 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ffb2a59c-8c9c-4b18-bc94-2bd113799516 tempest-QuotasAdminTestV236-1019635658 tempest-QuotasAdminTestV236-1019635658-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:11.801149 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ffb2a59c-8c9c-4b18-bc94-2bd113799516 tempest-QuotasAdminTestV236-1019635658 tempest-QuotasAdminTestV236-1019635658-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:11.802071 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ffb2a59c-8c9c-4b18-bc94-2bd113799516 tempest-QuotasAdminTestV236-1019635658 tempest-QuotasAdminTestV236-1019635658-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:11.818431 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=12,nova_api:INSERT=12 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:37:11.827128 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3082ce69-2c6d-4541-abee-5080818137ad tempest-FlavorsV255TestJSON-665729067 tempest-FlavorsV255TestJSON-665729067-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.061423 Sep 08 10:37:11.828442 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 83/178] 10.222.0.27 () {60 vars in 1187 bytes} [Thu Sep 8 10:37:11 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:37:11.833933 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-86ac3ee6-75f8-4e34-ae27-ec0894494805 tempest-FlavorsAccessTestJSON-1375729564 tempest-FlavorsAccessTestJSON-1375729564-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:11.898338 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-86ac3ee6-75f8-4e34-ae27-ec0894494805 tempest-FlavorsAccessTestJSON-1375729564 tempest-FlavorsAccessTestJSON-1375729564-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.067186 Sep 08 10:37:11.899928 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 84/179] 10.222.0.27 () {58 vars in 1146 bytes} [Thu Sep 8 10:37:11 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:11.923388 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2f20add8-2686-48a8-aa9f-709558cbe8d9 tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] Calling method '.version_select at 0x7f68e5357820>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:11.930470 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2f20add8-2686-48a8-aa9f-709558cbe8d9 tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:11.931191 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2f20add8-2686-48a8-aa9f-709558cbe8d9 tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:11.931913 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2f20add8-2686-48a8-aa9f-709558cbe8d9 tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:11.954041 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2f20add8-2686-48a8-aa9f-709558cbe8d9 tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:11.954521 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2f20add8-2686-48a8-aa9f-709558cbe8d9 tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:11.958481 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2f20add8-2686-48a8-aa9f-709558cbe8d9 tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:11.966175 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ffb2a59c-8c9c-4b18-bc94-2bd113799516 tempest-QuotasAdminTestV236-1019635658 tempest-QuotasAdminTestV236-1019635658-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/e443f4906ca34df7b25186178744dde1?user_id=7365412dfa894346bbde4efe81cedb03" status: 200 len: 240 microversion: 2.36 time: 0.379244 Sep 08 10:37:11.976165 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 96/180] 10.222.0.27 () {62 vars in 1384 bytes} [Thu Sep 8 10:37:11 2022] PUT /compute/v2.1/os-quota-sets/e443f4906ca34df7b25186178744dde1?user_id=7365412dfa894346bbde4efe81cedb03 => generated 240 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:37:11.983244 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2f20add8-2686-48a8-aa9f-709558cbe8d9 tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:11.983740 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2f20add8-2686-48a8-aa9f-709558cbe8d9 tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:11.984178 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2f20add8-2686-48a8-aa9f-709558cbe8d9 tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:11.984519 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9477ae89-a882-4a0f-a632-803f877fd2f5 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:11.985502 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9477ae89-a882-4a0f-a632-803f877fd2f5 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] [instance: a14a2e92-7b76-4576-bc3e-3b567afa63ac] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:11.996190 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9477ae89-a882-4a0f-a632-803f877fd2f5 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:11.997473 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9477ae89-a882-4a0f-a632-803f877fd2f5 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:11.997944 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2f20add8-2686-48a8-aa9f-709558cbe8d9 tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.096452 Sep 08 10:37:11.998091 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9477ae89-a882-4a0f-a632-803f877fd2f5 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:11.998371 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 85/181] 10.222.0.27 () {58 vars in 1146 bytes} [Thu Sep 8 10:37:11 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:37:12.003377 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5f156b00-d7b6-4462-a96a-7ad0d1bc7ad6 tempest-FlavorsAccessTestJSON-1375729564 tempest-FlavorsAccessTestJSON-1375729564-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-352429369", "id": 1463687654, "os-flavor-access:is_public": "False"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:12.005164 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9477ae89-a882-4a0f-a632-803f877fd2f5 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:12.005918 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9477ae89-a882-4a0f-a632-803f877fd2f5 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:12.006517 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9477ae89-a882-4a0f-a632-803f877fd2f5 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:12.047862 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5f156b00-d7b6-4462-a96a-7ad0d1bc7ad6 tempest-FlavorsAccessTestJSON-1375729564 tempest-FlavorsAccessTestJSON-1375729564-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.048379 Sep 08 10:37:12.049390 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 86/182] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:37:11 2022] POST /compute/v2.1/flavors => generated 430 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:37:12.061831 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-76a70e92-2479-4c41-ab76-b8d6928d4c74 tempest-QuotasAdminTestV236-1019635658 tempest-QuotasAdminTestV236-1019635658-project-admin] Calling method '.version_select at 0x7f68e53431f0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:12.192586 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-76a70e92-2479-4c41-ab76-b8d6928d4c74 tempest-QuotasAdminTestV236-1019635658 tempest-QuotasAdminTestV236-1019635658-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/e443f4906ca34df7b25186178744dde1?user_id=7365412dfa894346bbde4efe81cedb03" status: 200 len: 282 microversion: 2.36 time: 0.141460 Sep 08 10:37:12.193525 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 87/183] 10.222.0.27 () {60 vars in 1364 bytes} [Thu Sep 8 10:37:12 2022] GET /compute/v2.1/os-quota-sets/e443f4906ca34df7b25186178744dde1?user_id=7365412dfa894346bbde4efe81cedb03 => generated 282 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:37:12.198234 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-089ae5c1-618c-4dc8-ad0b-ee2e2b21af33 tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] Calling method '.version_select at 0x7f68e53261f0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:12.208822 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-089ae5c1-618c-4dc8-ad0b-ee2e2b21af33 tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:12.209588 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-089ae5c1-618c-4dc8-ad0b-ee2e2b21af33 tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:12.210012 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-089ae5c1-618c-4dc8-ad0b-ee2e2b21af33 tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:12.257643 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-089ae5c1-618c-4dc8-ad0b-ee2e2b21af33 tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:12.258826 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-089ae5c1-618c-4dc8-ad0b-ee2e2b21af33 tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:12.266286 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-089ae5c1-618c-4dc8-ad0b-ee2e2b21af33 tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:12.275723 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-089ae5c1-618c-4dc8-ad0b-ee2e2b21af33 tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.080902 Sep 08 10:37:12.279263 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 88/184] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Sep 8 10:37:12 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:37:12.286137 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4f9cf4ce-3dcd-45b9-8148-11b40e54d558 tempest-FlavorsAccessTestJSON-1375729564 tempest-FlavorsAccessTestJSON-1375729564-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:12.321357 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4f9cf4ce-3dcd-45b9-8148-11b40e54d558 tempest-FlavorsAccessTestJSON-1375729564 tempest-FlavorsAccessTestJSON-1375729564-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/1463687654/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.039975 Sep 08 10:37:12.322575 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 89/185] 10.222.0.27 () {58 vars in 1209 bytes} [Thu Sep 8 10:37:12 2022] GET /compute/v2.1/flavors/1463687654/os-flavor-access => generated 21 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:37:12.337978 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e0b143a1-cb56-453e-8a91-9e40d61755a3 tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] Calling method '.version_select at 0x7f68e5326f70>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:12.340268 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e0b143a1-cb56-453e-8a91-9e40d61755a3 tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:12.340920 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e0b143a1-cb56-453e-8a91-9e40d61755a3 tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:12.342663 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e0b143a1-cb56-453e-8a91-9e40d61755a3 tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:12.370505 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e0b143a1-cb56-453e-8a91-9e40d61755a3 tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.046605 Sep 08 10:37:12.371678 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 90/186] 10.222.0.27 () {58 vars in 1179 bytes} [Thu Sep 8 10:37:12 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:37:12.376841 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1422c6b4-1938-4a08-9798-d7e27797ad81 tempest-FlavorsAccessTestJSON-1375729564 tempest-FlavorsAccessTestJSON-1375729564-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:12.387132 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9477ae89-a882-4a0f-a632-803f877fd2f5 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b76777df7594f7a9d03376362b80b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e11d5906f0407d9ea1f1deed40aab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:12.401754 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9477ae89-a882-4a0f-a632-803f877fd2f5 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] 10.222.0.27 "GET /compute/v2.1/servers/a14a2e92-7b76-4576-bc3e-3b567afa63ac" status: 200 len: 1338 microversion: 2.1 time: 0.423740 Sep 08 10:37:12.402510 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 97/187] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:11 2022] GET /compute/v2.1/servers/a14a2e92-7b76-4576-bc3e-3b567afa63ac => generated 1338 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:12.414068 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0e9d95cf-e492-4f05-8d8d-707527f96e2f tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] Calling method '.version_select at 0x7f68e51ed430>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:12.415964 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e9d95cf-e492-4f05-8d8d-707527f96e2f tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:12.418281 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e9d95cf-e492-4f05-8d8d-707527f96e2f tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:12.420595 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e9d95cf-e492-4f05-8d8d-707527f96e2f tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:12.446243 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1422c6b4-1938-4a08-9798-d7e27797ad81 tempest-FlavorsAccessTestJSON-1375729564 tempest-FlavorsAccessTestJSON-1375729564-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1463687654" status: 202 len: 0 microversion: 2.1 time: 0.073328 Sep 08 10:37:12.446981 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 91/188] 10.222.0.27 () {58 vars in 1161 bytes} [Thu Sep 8 10:37:12 2022] DELETE /compute/v2.1/flavors/1463687654 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:37:12.449689 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e9d95cf-e492-4f05-8d8d-707527f96e2f tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:12.450477 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e9d95cf-e492-4f05-8d8d-707527f96e2f tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:12.455263 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9021503a-6f13-4186-84c2-c609f2a0afa0 tempest-FlavorsAccessTestJSON-1375729564 tempest-FlavorsAccessTestJSON-1375729564-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:12.461521 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e9d95cf-e492-4f05-8d8d-707527f96e2f tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:12.493235 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9021503a-6f13-4186-84c2-c609f2a0afa0 tempest-FlavorsAccessTestJSON-1375729564 tempest-FlavorsAccessTestJSON-1375729564-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.041279 Sep 08 10:37:12.493938 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 92/189] 10.222.0.27 () {58 vars in 1146 bytes} [Thu Sep 8 10:37:12 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:12.497471 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e9d95cf-e492-4f05-8d8d-707527f96e2f tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:12.499380 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e9d95cf-e492-4f05-8d8d-707527f96e2f tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:12.499858 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e9d95cf-e492-4f05-8d8d-707527f96e2f tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:12.522102 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0e9d95cf-e492-4f05-8d8d-707527f96e2f tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.117138 Sep 08 10:37:12.522821 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 98/190] 10.222.0.27 () {58 vars in 1146 bytes} [Thu Sep 8 10:37:12 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:37:12.533539 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-66b178a4-6f37-416d-94df-7ff602722443 tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] Calling method '.version_select at 0x7f68e53ad940>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:12.535535 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-66b178a4-6f37-416d-94df-7ff602722443 tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:12.536546 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-66b178a4-6f37-416d-94df-7ff602722443 tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:12.536929 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-66b178a4-6f37-416d-94df-7ff602722443 tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:12.581885 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-66b178a4-6f37-416d-94df-7ff602722443 tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:12.582118 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-66b178a4-6f37-416d-94df-7ff602722443 tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:12.582437 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-66b178a4-6f37-416d-94df-7ff602722443 tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:12.606418 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-66b178a4-6f37-416d-94df-7ff602722443 tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.076404 Sep 08 10:37:12.607121 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 93/191] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Sep 8 10:37:12 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:37:12.627605 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ec10f448-16f9-4ded-8cda-d5abe0f3b3fa tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] Calling method '.version_select at 0x7f68e5276670>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:12.630154 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec10f448-16f9-4ded-8cda-d5abe0f3b3fa tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:12.630652 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec10f448-16f9-4ded-8cda-d5abe0f3b3fa tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:12.631097 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec10f448-16f9-4ded-8cda-d5abe0f3b3fa tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:12.686647 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec10f448-16f9-4ded-8cda-d5abe0f3b3fa tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:12.687045 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec10f448-16f9-4ded-8cda-d5abe0f3b3fa tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:12.687465 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec10f448-16f9-4ded-8cda-d5abe0f3b3fa tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:12.714975 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ec10f448-16f9-4ded-8cda-d5abe0f3b3fa tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 760 microversion: 2.1 time: 0.089880 Sep 08 10:37:12.723446 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 99/192] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Sep 8 10:37:12 2022] GET /compute/v2.1/os-hypervisors/2 => generated 760 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:37:12.733570 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-de05f4e1-0aef-4ba6-971f-6308c0969045 tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] Calling method '.version_select at 0x7f68e53ad4c0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:12.735422 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-de05f4e1-0aef-4ba6-971f-6308c0969045 tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:12.735909 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-de05f4e1-0aef-4ba6-971f-6308c0969045 tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:12.736602 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-de05f4e1-0aef-4ba6-971f-6308c0969045 tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:12.758087 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-de05f4e1-0aef-4ba6-971f-6308c0969045 tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:12.758582 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-de05f4e1-0aef-4ba6-971f-6308c0969045 tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:12.759023 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-de05f4e1-0aef-4ba6-971f-6308c0969045 tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:12.775362 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-de05f4e1-0aef-4ba6-971f-6308c0969045 tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:12.775651 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-de05f4e1-0aef-4ba6-971f-6308c0969045 tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:12.776547 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-de05f4e1-0aef-4ba6-971f-6308c0969045 tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:12.805537 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a8fc8c5a-79ee-4b04-80a6-2ab151655203 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:12.806551 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a8fc8c5a-79ee-4b04-80a6-2ab151655203 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] [instance: e605c39e-7644-4842-8476-9c9af611282f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:12.810706 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-de05f4e1-0aef-4ba6-971f-6308c0969045 tempest-HypervisorAdminTestJSON-856299972 tempest-HypervisorAdminTestJSON-856299972-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 176 microversion: 2.1 time: 0.080394 Sep 08 10:37:12.813204 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 94/193] 10.222.0.27 () {58 vars in 1173 bytes} [Thu Sep 8 10:37:12 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 176 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:37:12.822133 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a8fc8c5a-79ee-4b04-80a6-2ab151655203 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:12.825200 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a8fc8c5a-79ee-4b04-80a6-2ab151655203 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:12.827478 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a8fc8c5a-79ee-4b04-80a6-2ab151655203 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:12.828472 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a8fc8c5a-79ee-4b04-80a6-2ab151655203 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:12.835828 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a8fc8c5a-79ee-4b04-80a6-2ab151655203 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:12.837063 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a8fc8c5a-79ee-4b04-80a6-2ab151655203 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:13.049167 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a8fc8c5a-79ee-4b04-80a6-2ab151655203 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdbe35f311e435ba9e0516f302ba519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb116f8d7dd4858a91c03e0a4310fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:13.059534 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a8fc8c5a-79ee-4b04-80a6-2ab151655203 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] 10.222.0.27 "GET /compute/v2.1/servers/e605c39e-7644-4842-8476-9c9af611282f" status: 200 len: 1320 microversion: 2.1 time: 0.260626 Sep 08 10:37:13.060563 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 100/194] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:12 2022] GET /compute/v2.1/servers/e605c39e-7644-4842-8476-9c9af611282f => generated 1320 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:13.236923 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-c3836f9a-7281-402d-833b-73973e90ca59 req-0921a011-afe0-4d27-ae44-d1fc11ab5ee9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a14a2e92-7b76-4576-bc3e-3b567afa63ac", "name": "network-vif-plugged", "status": "completed", "tag": "0752003c-bc8c-4a51-b82a-3d434d535a4b"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:13.258787 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-c3836f9a-7281-402d-833b-73973e90ca59 req-0921a011-afe0-4d27-ae44-d1fc11ab5ee9 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:13.261442 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-c3836f9a-7281-402d-833b-73973e90ca59 req-0921a011-afe0-4d27-ae44-d1fc11ab5ee9 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:13.263569 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-c3836f9a-7281-402d-833b-73973e90ca59 req-0921a011-afe0-4d27-ae44-d1fc11ab5ee9 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:13.287100 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-c3836f9a-7281-402d-833b-73973e90ca59 req-0921a011-afe0-4d27-ae44-d1fc11ab5ee9 service nova] Creating event network-vif-plugged:0752003c-bc8c-4a51-b82a-3d434d535a4b for instance a14a2e92-7b76-4576-bc3e-3b567afa63ac on n-h1-850501-12 Sep 08 10:37:13.298366 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-c3836f9a-7281-402d-833b-73973e90ca59 req-0921a011-afe0-4d27-ae44-d1fc11ab5ee9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064189 Sep 08 10:37:13.302790 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 95/195] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:37:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:37:13.433911 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-128d969e-7317-43ea-bc55-098d2c978b63 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:13.435028 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-128d969e-7317-43ea-bc55-098d2c978b63 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] [instance: a14a2e92-7b76-4576-bc3e-3b567afa63ac] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:13.454302 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-128d969e-7317-43ea-bc55-098d2c978b63 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:13.455021 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-128d969e-7317-43ea-bc55-098d2c978b63 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:13.455645 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-128d969e-7317-43ea-bc55-098d2c978b63 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:13.462354 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-128d969e-7317-43ea-bc55-098d2c978b63 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:13.463102 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-128d969e-7317-43ea-bc55-098d2c978b63 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:13.463740 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-128d969e-7317-43ea-bc55-098d2c978b63 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:13.831814 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-128d969e-7317-43ea-bc55-098d2c978b63 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b76777df7594f7a9d03376362b80b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e11d5906f0407d9ea1f1deed40aab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:13.842583 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-128d969e-7317-43ea-bc55-098d2c978b63 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] 10.222.0.27 "GET /compute/v2.1/servers/a14a2e92-7b76-4576-bc3e-3b567afa63ac" status: 200 len: 1338 microversion: 2.1 time: 0.415319 Sep 08 10:37:13.858091 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 101/196] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:13 2022] GET /compute/v2.1/servers/a14a2e92-7b76-4576-bc3e-3b567afa63ac => generated 1338 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:14.091464 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-81b579a2-c383-4a67-b454-c36e088e6c04 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:14.093105 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-81b579a2-c383-4a67-b454-c36e088e6c04 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] [instance: e605c39e-7644-4842-8476-9c9af611282f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:14.118019 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-81b579a2-c383-4a67-b454-c36e088e6c04 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:14.119265 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-81b579a2-c383-4a67-b454-c36e088e6c04 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:14.120722 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-81b579a2-c383-4a67-b454-c36e088e6c04 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:14.122176 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-81b579a2-c383-4a67-b454-c36e088e6c04 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:14.123629 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-81b579a2-c383-4a67-b454-c36e088e6c04 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:14.129973 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-81b579a2-c383-4a67-b454-c36e088e6c04 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:14.725172 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-81b579a2-c383-4a67-b454-c36e088e6c04 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdbe35f311e435ba9e0516f302ba519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb116f8d7dd4858a91c03e0a4310fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:14.756300 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-81b579a2-c383-4a67-b454-c36e088e6c04 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] 10.222.0.27 "GET /compute/v2.1/servers/e605c39e-7644-4842-8476-9c9af611282f" status: 200 len: 1470 microversion: 2.1 time: 0.672468 Sep 08 10:37:14.765878 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 96/197] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:14 2022] GET /compute/v2.1/servers/e605c39e-7644-4842-8476-9c9af611282f => generated 1470 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:14.909574 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-97d0c017-6b84-4751-b6bd-acb260bc1199 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:14.923263 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-97d0c017-6b84-4751-b6bd-acb260bc1199 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] [instance: a14a2e92-7b76-4576-bc3e-3b567afa63ac] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:14.950090 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-97d0c017-6b84-4751-b6bd-acb260bc1199 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:14.951042 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-97d0c017-6b84-4751-b6bd-acb260bc1199 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:14.952515 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-97d0c017-6b84-4751-b6bd-acb260bc1199 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:14.954422 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-97d0c017-6b84-4751-b6bd-acb260bc1199 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:14.955649 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-97d0c017-6b84-4751-b6bd-acb260bc1199 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:14.959762 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-97d0c017-6b84-4751-b6bd-acb260bc1199 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:15.435000 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6953b04c-a708-4e13-9397-a81b37b7790b tempest-DeleteServersAdminTestJSON-1323785645 tempest-DeleteServersAdminTestJSON-1323785645-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:15.436996 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6953b04c-a708-4e13-9397-a81b37b7790b tempest-DeleteServersAdminTestJSON-1323785645 tempest-DeleteServersAdminTestJSON-1323785645-project-admin] [instance: e605c39e-7644-4842-8476-9c9af611282f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:15.470985 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6953b04c-a708-4e13-9397-a81b37b7790b tempest-DeleteServersAdminTestJSON-1323785645 tempest-DeleteServersAdminTestJSON-1323785645-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:15.474050 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6953b04c-a708-4e13-9397-a81b37b7790b tempest-DeleteServersAdminTestJSON-1323785645 tempest-DeleteServersAdminTestJSON-1323785645-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:15.475022 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6953b04c-a708-4e13-9397-a81b37b7790b tempest-DeleteServersAdminTestJSON-1323785645 tempest-DeleteServersAdminTestJSON-1323785645-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:15.476464 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6953b04c-a708-4e13-9397-a81b37b7790b tempest-DeleteServersAdminTestJSON-1323785645 tempest-DeleteServersAdminTestJSON-1323785645-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:15.477639 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6953b04c-a708-4e13-9397-a81b37b7790b tempest-DeleteServersAdminTestJSON-1323785645 tempest-DeleteServersAdminTestJSON-1323785645-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:15.478740 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6953b04c-a708-4e13-9397-a81b37b7790b tempest-DeleteServersAdminTestJSON-1323785645 tempest-DeleteServersAdminTestJSON-1323785645-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:15.486748 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-97d0c017-6b84-4751-b6bd-acb260bc1199 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b76777df7594f7a9d03376362b80b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e11d5906f0407d9ea1f1deed40aab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:15.537826 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-97d0c017-6b84-4751-b6bd-acb260bc1199 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] 10.222.0.27 "GET /compute/v2.1/servers/a14a2e92-7b76-4576-bc3e-3b567afa63ac" status: 200 len: 1338 microversion: 2.1 time: 0.654640 Sep 08 10:37:15.545110 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 97/198] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:14 2022] GET /compute/v2.1/servers/a14a2e92-7b76-4576-bc3e-3b567afa63ac => generated 1338 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:15.657602 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6953b04c-a708-4e13-9397-a81b37b7790b tempest-DeleteServersAdminTestJSON-1323785645 tempest-DeleteServersAdminTestJSON-1323785645-project-admin] [instance: e605c39e-7644-4842-8476-9c9af611282f] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:37:16.030943 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6953b04c-a708-4e13-9397-a81b37b7790b tempest-DeleteServersAdminTestJSON-1323785645 tempest-DeleteServersAdminTestJSON-1323785645-project-admin] 10.222.0.27 "DELETE /compute/v2.1/servers/e605c39e-7644-4842-8476-9c9af611282f" status: 204 len: 0 microversion: 2.1 time: 1.232432 Sep 08 10:37:16.040114 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 102/199] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:37:14 2022] DELETE /compute/v2.1/servers/e605c39e-7644-4842-8476-9c9af611282f => generated 0 bytes in 1243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:37:16.072954 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-971ad674-9162-4937-ad89-f251351b23f1 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:16.083181 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-971ad674-9162-4937-ad89-f251351b23f1 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] [instance: e605c39e-7644-4842-8476-9c9af611282f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:16.124481 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-971ad674-9162-4937-ad89-f251351b23f1 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:16.127089 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-971ad674-9162-4937-ad89-f251351b23f1 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:16.129806 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-971ad674-9162-4937-ad89-f251351b23f1 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:16.130634 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-971ad674-9162-4937-ad89-f251351b23f1 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:16.131120 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-971ad674-9162-4937-ad89-f251351b23f1 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:16.131564 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-971ad674-9162-4937-ad89-f251351b23f1 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:16.566312 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5150682e-0955-47d1-83df-5fcd7d0dee0c tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:16.567090 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5150682e-0955-47d1-83df-5fcd7d0dee0c tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] [instance: a14a2e92-7b76-4576-bc3e-3b567afa63ac] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:16.587821 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5150682e-0955-47d1-83df-5fcd7d0dee0c tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:16.590277 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5150682e-0955-47d1-83df-5fcd7d0dee0c tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:16.592487 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5150682e-0955-47d1-83df-5fcd7d0dee0c tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:16.593887 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5150682e-0955-47d1-83df-5fcd7d0dee0c tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:16.595806 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5150682e-0955-47d1-83df-5fcd7d0dee0c tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:16.596486 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5150682e-0955-47d1-83df-5fcd7d0dee0c tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:16.871203 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-971ad674-9162-4937-ad89-f251351b23f1 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdbe35f311e435ba9e0516f302ba519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb116f8d7dd4858a91c03e0a4310fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:16.880812 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-971ad674-9162-4937-ad89-f251351b23f1 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] 10.222.0.27 "GET /compute/v2.1/servers/e605c39e-7644-4842-8476-9c9af611282f" status: 200 len: 1476 microversion: 2.1 time: 0.832944 Sep 08 10:37:16.881693 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 98/200] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:16 2022] GET /compute/v2.1/servers/e605c39e-7644-4842-8476-9c9af611282f => generated 1476 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:17.009292 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5150682e-0955-47d1-83df-5fcd7d0dee0c tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b76777df7594f7a9d03376362b80b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e11d5906f0407d9ea1f1deed40aab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:17.032887 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5150682e-0955-47d1-83df-5fcd7d0dee0c tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] 10.222.0.27 "GET /compute/v2.1/servers/a14a2e92-7b76-4576-bc3e-3b567afa63ac" status: 200 len: 1488 microversion: 2.1 time: 0.470522 Sep 08 10:37:17.036424 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 103/201] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:16 2022] GET /compute/v2.1/servers/a14a2e92-7b76-4576-bc3e-3b567afa63ac => generated 1488 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:17.061220 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9d76a731-235a-4d8f-a17d-b5f29b7d46bb tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:17.062198 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9d76a731-235a-4d8f-a17d-b5f29b7d46bb tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] [instance: a14a2e92-7b76-4576-bc3e-3b567afa63ac] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:17.071906 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9d76a731-235a-4d8f-a17d-b5f29b7d46bb tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:17.072730 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9d76a731-235a-4d8f-a17d-b5f29b7d46bb tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:17.073368 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9d76a731-235a-4d8f-a17d-b5f29b7d46bb tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:17.074164 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9d76a731-235a-4d8f-a17d-b5f29b7d46bb tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:17.074713 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9d76a731-235a-4d8f-a17d-b5f29b7d46bb tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:17.075066 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9d76a731-235a-4d8f-a17d-b5f29b7d46bb tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:17.921238 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2738c2ac-0d5b-42af-bb68-a7d9e2e3d129 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:17.922982 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2738c2ac-0d5b-42af-bb68-a7d9e2e3d129 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] [instance: e605c39e-7644-4842-8476-9c9af611282f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:17.934829 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2738c2ac-0d5b-42af-bb68-a7d9e2e3d129 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:17.935727 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2738c2ac-0d5b-42af-bb68-a7d9e2e3d129 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:17.936677 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2738c2ac-0d5b-42af-bb68-a7d9e2e3d129 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:17.937753 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2738c2ac-0d5b-42af-bb68-a7d9e2e3d129 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:17.938995 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2738c2ac-0d5b-42af-bb68-a7d9e2e3d129 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:17.939766 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2738c2ac-0d5b-42af-bb68-a7d9e2e3d129 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:18.153350 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9d76a731-235a-4d8f-a17d-b5f29b7d46bb tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/a14a2e92-7b76-4576-bc3e-3b567afa63ac" status: 200 len: 1641 microversion: 2.1 time: 1.089452 Sep 08 10:37:18.175091 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 99/202] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:17 2022] GET /compute/v2.1/servers/a14a2e92-7b76-4576-bc3e-3b567afa63ac => generated 1641 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:18.189422 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fdf0c92b-b296-4f22-9bca-05c8b7dadfb1 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:18.191734 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fdf0c92b-b296-4f22-9bca-05c8b7dadfb1 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] [instance: a14a2e92-7b76-4576-bc3e-3b567afa63ac] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:18.213522 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fdf0c92b-b296-4f22-9bca-05c8b7dadfb1 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:18.216392 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fdf0c92b-b296-4f22-9bca-05c8b7dadfb1 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:18.218673 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fdf0c92b-b296-4f22-9bca-05c8b7dadfb1 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:18.223190 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fdf0c92b-b296-4f22-9bca-05c8b7dadfb1 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:18.227821 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fdf0c92b-b296-4f22-9bca-05c8b7dadfb1 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:18.228800 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fdf0c92b-b296-4f22-9bca-05c8b7dadfb1 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:18.342741 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fdf0c92b-b296-4f22-9bca-05c8b7dadfb1 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] [instance: a14a2e92-7b76-4576-bc3e-3b567afa63ac] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:37:18.592085 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2738c2ac-0d5b-42af-bb68-a7d9e2e3d129 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdbe35f311e435ba9e0516f302ba519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb116f8d7dd4858a91c03e0a4310fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:18.598846 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:37:18.618041 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2738c2ac-0d5b-42af-bb68-a7d9e2e3d129 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] 10.222.0.27 "GET /compute/v2.1/servers/e605c39e-7644-4842-8476-9c9af611282f" status: 200 len: 1476 microversion: 2.1 time: 0.708630 Sep 08 10:37:18.620167 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 104/203] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:17 2022] GET /compute/v2.1/servers/e605c39e-7644-4842-8476-9c9af611282f => generated 1476 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:18.717359 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fdf0c92b-b296-4f22-9bca-05c8b7dadfb1 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a14a2e92-7b76-4576-bc3e-3b567afa63ac" status: 204 len: 0 microversion: 2.1 time: 0.539335 Sep 08 10:37:18.721539 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 100/204] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:37:18 2022] DELETE /compute/v2.1/servers/a14a2e92-7b76-4576-bc3e-3b567afa63ac => generated 0 bytes in 543 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:37:18.732942 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d6c21bf3-620b-4e8a-8c08-c11c8d15c8a6 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:18.733640 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d6c21bf3-620b-4e8a-8c08-c11c8d15c8a6 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] [instance: a14a2e92-7b76-4576-bc3e-3b567afa63ac] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:18.746191 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d6c21bf3-620b-4e8a-8c08-c11c8d15c8a6 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:18.746832 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d6c21bf3-620b-4e8a-8c08-c11c8d15c8a6 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:18.747640 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d6c21bf3-620b-4e8a-8c08-c11c8d15c8a6 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:18.750246 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d6c21bf3-620b-4e8a-8c08-c11c8d15c8a6 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:18.751518 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d6c21bf3-620b-4e8a-8c08-c11c8d15c8a6 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:18.752181 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d6c21bf3-620b-4e8a-8c08-c11c8d15c8a6 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:19.447829 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d6c21bf3-620b-4e8a-8c08-c11c8d15c8a6 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b76777df7594f7a9d03376362b80b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e11d5906f0407d9ea1f1deed40aab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:19.459023 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d6c21bf3-620b-4e8a-8c08-c11c8d15c8a6 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] 10.222.0.27 "GET /compute/v2.1/servers/a14a2e92-7b76-4576-bc3e-3b567afa63ac" status: 200 len: 1494 microversion: 2.1 time: 0.733949 Sep 08 10:37:19.482445 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 105/205] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:18 2022] GET /compute/v2.1/servers/a14a2e92-7b76-4576-bc3e-3b567afa63ac => generated 1494 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:19.657435 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9adb798e-7908-416e-9a5d-5fb09638c12a tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:19.665251 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9adb798e-7908-416e-9a5d-5fb09638c12a tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] [instance: e605c39e-7644-4842-8476-9c9af611282f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:19.685049 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9adb798e-7908-416e-9a5d-5fb09638c12a tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:19.685883 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9adb798e-7908-416e-9a5d-5fb09638c12a tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:19.686544 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9adb798e-7908-416e-9a5d-5fb09638c12a tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:19.687773 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9adb798e-7908-416e-9a5d-5fb09638c12a tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:19.688853 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9adb798e-7908-416e-9a5d-5fb09638c12a tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:19.690499 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9adb798e-7908-416e-9a5d-5fb09638c12a tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:19.987912 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9adb798e-7908-416e-9a5d-5fb09638c12a tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdbe35f311e435ba9e0516f302ba519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb116f8d7dd4858a91c03e0a4310fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:20.000270 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9adb798e-7908-416e-9a5d-5fb09638c12a tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] 10.222.0.27 "GET /compute/v2.1/servers/e605c39e-7644-4842-8476-9c9af611282f" status: 200 len: 1476 microversion: 2.1 time: 0.357683 Sep 08 10:37:20.003339 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 101/206] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:19 2022] GET /compute/v2.1/servers/e605c39e-7644-4842-8476-9c9af611282f => generated 1476 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:20.350516 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-db430500-b196-48eb-9ff0-7f70a9893492 tempest-HypervisorAdminUnderV252Test-872163599 tempest-HypervisorAdminUnderV252Test-872163599-project-admin] Calling method '.version_select at 0x7f68e5232280>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:20.352555 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db430500-b196-48eb-9ff0-7f70a9893492 tempest-HypervisorAdminUnderV252Test-872163599 tempest-HypervisorAdminUnderV252Test-872163599-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:20.360707 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-a61b2006-a13b-4612-8b94-dc3540a6fa41 req-27513349-070d-4f30-9c92-2e9d68ec8cd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e605c39e-7644-4842-8476-9c9af611282f", "name": "network-vif-deleted", "tag": "8c4cf5b9-c6e2-4335-97b1-d398b92bb922"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:20.362695 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db430500-b196-48eb-9ff0-7f70a9893492 tempest-HypervisorAdminUnderV252Test-872163599 tempest-HypervisorAdminUnderV252Test-872163599-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:20.363242 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db430500-b196-48eb-9ff0-7f70a9893492 tempest-HypervisorAdminUnderV252Test-872163599 tempest-HypervisorAdminUnderV252Test-872163599-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:20.406116 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-a61b2006-a13b-4612-8b94-dc3540a6fa41 req-27513349-070d-4f30-9c92-2e9d68ec8cd1 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:20.409894 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-a61b2006-a13b-4612-8b94-dc3540a6fa41 req-27513349-070d-4f30-9c92-2e9d68ec8cd1 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:20.410497 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-a61b2006-a13b-4612-8b94-dc3540a6fa41 req-27513349-070d-4f30-9c92-2e9d68ec8cd1 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:20.449651 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db430500-b196-48eb-9ff0-7f70a9893492 tempest-HypervisorAdminUnderV252Test-872163599 tempest-HypervisorAdminUnderV252Test-872163599-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:20.454568 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db430500-b196-48eb-9ff0-7f70a9893492 tempest-HypervisorAdminUnderV252Test-872163599 tempest-HypervisorAdminUnderV252Test-872163599-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:20.455311 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db430500-b196-48eb-9ff0-7f70a9893492 tempest-HypervisorAdminUnderV252Test-872163599 tempest-HypervisorAdminUnderV252Test-872163599-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:20.500958 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-a61b2006-a13b-4612-8b94-dc3540a6fa41 req-27513349-070d-4f30-9c92-2e9d68ec8cd1 service nova] Creating event network-vif-deleted:8c4cf5b9-c6e2-4335-97b1-d398b92bb922 for instance e605c39e-7644-4842-8476-9c9af611282f on n-h2-850501-12 Sep 08 10:37:20.513449 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db430500-b196-48eb-9ff0-7f70a9893492 tempest-HypervisorAdminUnderV252Test-872163599 tempest-HypervisorAdminUnderV252Test-872163599-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:20.514023 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db430500-b196-48eb-9ff0-7f70a9893492 tempest-HypervisorAdminUnderV252Test-872163599 tempest-HypervisorAdminUnderV252Test-872163599-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:20.516498 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-a61b2006-a13b-4612-8b94-dc3540a6fa41 req-27513349-070d-4f30-9c92-2e9d68ec8cd1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171979 Sep 08 10:37:20.518652 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db430500-b196-48eb-9ff0-7f70a9893492 tempest-HypervisorAdminUnderV252Test-872163599 tempest-HypervisorAdminUnderV252Test-872163599-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:20.520269 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 102/207] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:37:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:37:20.545115 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-db430500-b196-48eb-9ff0-7f70a9893492 tempest-HypervisorAdminUnderV252Test-872163599 tempest-HypervisorAdminUnderV252Test-872163599-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.708148 Sep 08 10:37:20.550559 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 106/208] 10.222.0.27 () {58 vars in 1146 bytes} [Thu Sep 8 10:37:19 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:37:20.566974 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-84475d61-ee49-4a33-83fa-6317e3ab7029 tempest-HypervisorAdminUnderV252Test-872163599 tempest-HypervisorAdminUnderV252Test-872163599-project-admin] Calling method '.version_select at 0x7f68e509b160>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:20.581397 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c3ae670e-569d-4f83-9b15-501793442fe9 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:20.582136 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-84475d61-ee49-4a33-83fa-6317e3ab7029 tempest-HypervisorAdminUnderV252Test-872163599 tempest-HypervisorAdminUnderV252Test-872163599-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:20.583078 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-84475d61-ee49-4a33-83fa-6317e3ab7029 tempest-HypervisorAdminUnderV252Test-872163599 tempest-HypervisorAdminUnderV252Test-872163599-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:20.584948 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-84475d61-ee49-4a33-83fa-6317e3ab7029 tempest-HypervisorAdminUnderV252Test-872163599 tempest-HypervisorAdminUnderV252Test-872163599-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:20.597042 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c3ae670e-569d-4f83-9b15-501793442fe9 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] [instance: a14a2e92-7b76-4576-bc3e-3b567afa63ac] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:20.608734 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c3ae670e-569d-4f83-9b15-501793442fe9 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:20.609576 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c3ae670e-569d-4f83-9b15-501793442fe9 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:20.610082 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c3ae670e-569d-4f83-9b15-501793442fe9 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:20.611194 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c3ae670e-569d-4f83-9b15-501793442fe9 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:20.612911 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c3ae670e-569d-4f83-9b15-501793442fe9 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:20.613399 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c3ae670e-569d-4f83-9b15-501793442fe9 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:21.050244 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c3ae670e-569d-4f83-9b15-501793442fe9 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b76777df7594f7a9d03376362b80b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e11d5906f0407d9ea1f1deed40aab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:21.060584 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c3ae670e-569d-4f83-9b15-501793442fe9 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] 10.222.0.27 "GET /compute/v2.1/servers/a14a2e92-7b76-4576-bc3e-3b567afa63ac" status: 200 len: 1494 microversion: 2.1 time: 0.538923 Sep 08 10:37:21.062520 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 103/209] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:20 2022] GET /compute/v2.1/servers/a14a2e92-7b76-4576-bc3e-3b567afa63ac => generated 1494 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:21.074103 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-84475d61-ee49-4a33-83fa-6317e3ab7029 tempest-HypervisorAdminUnderV252Test-872163599 tempest-HypervisorAdminUnderV252Test-872163599-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:21.075695 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-84475d61-ee49-4a33-83fa-6317e3ab7029 tempest-HypervisorAdminUnderV252Test-872163599 tempest-HypervisorAdminUnderV252Test-872163599-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:21.077259 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-84475d61-ee49-4a33-83fa-6317e3ab7029 tempest-HypervisorAdminUnderV252Test-872163599 tempest-HypervisorAdminUnderV252Test-872163599-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:21.088325 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-89bf3747-0f60-4c6b-aec0-261bc684c860 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:21.089537 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-89bf3747-0f60-4c6b-aec0-261bc684c860 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] [instance: e605c39e-7644-4842-8476-9c9af611282f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:21.102574 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-89bf3747-0f60-4c6b-aec0-261bc684c860 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:21.103075 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-89bf3747-0f60-4c6b-aec0-261bc684c860 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:21.103512 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-89bf3747-0f60-4c6b-aec0-261bc684c860 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:21.104216 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-89bf3747-0f60-4c6b-aec0-261bc684c860 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:21.107661 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-89bf3747-0f60-4c6b-aec0-261bc684c860 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:21.113062 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-89bf3747-0f60-4c6b-aec0-261bc684c860 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:21.122844 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:37:21.162166 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:37:21.204507 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=2,nova_api:DELETE=7,nova_api:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:37:21.208758 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-84475d61-ee49-4a33-83fa-6317e3ab7029 tempest-HypervisorAdminUnderV252Test-872163599 tempest-HypervisorAdminUnderV252Test-872163599-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:21.210827 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-84475d61-ee49-4a33-83fa-6317e3ab7029 tempest-HypervisorAdminUnderV252Test-872163599 tempest-HypervisorAdminUnderV252Test-872163599-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:21.213711 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-89bf3747-0f60-4c6b-aec0-261bc684c860 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:21.215311 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-84475d61-ee49-4a33-83fa-6317e3ab7029 tempest-HypervisorAdminUnderV252Test-872163599 tempest-HypervisorAdminUnderV252Test-872163599-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:21.216073 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-89bf3747-0f60-4c6b-aec0-261bc684c860 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:21.216747 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-89bf3747-0f60-4c6b-aec0-261bc684c860 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:21.217460 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-89bf3747-0f60-4c6b-aec0-261bc684c860 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lazy-loading 'fault' on Instance uuid e605c39e-7644-4842-8476-9c9af611282f {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:37:21.240671 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-84475d61-ee49-4a33-83fa-6317e3ab7029 tempest-HypervisorAdminUnderV252Test-872163599 tempest-HypervisorAdminUnderV252Test-872163599-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/n-h1-850501-12/servers" status: 200 len: 197 microversion: 2.1 time: 0.678652 Sep 08 10:37:21.242637 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 107/210] 10.222.0.27 () {58 vars in 1215 bytes} [Thu Sep 8 10:37:20 2022] GET /compute/v2.1/os-hypervisors/n-h1-850501-12/servers => generated 197 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:37:21.279650 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-513ab518-2420-4130-b110-2d8145c322fb tempest-HypervisorAdminUnderV252Test-872163599 tempest-HypervisorAdminUnderV252Test-872163599-project-admin] Calling method '.version_select at 0x7f68e509bc10>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:21.284401 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-513ab518-2420-4130-b110-2d8145c322fb tempest-HypervisorAdminUnderV252Test-872163599 tempest-HypervisorAdminUnderV252Test-872163599-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:21.290132 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-513ab518-2420-4130-b110-2d8145c322fb tempest-HypervisorAdminUnderV252Test-872163599 tempest-HypervisorAdminUnderV252Test-872163599-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:21.290742 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-513ab518-2420-4130-b110-2d8145c322fb tempest-HypervisorAdminUnderV252Test-872163599 tempest-HypervisorAdminUnderV252Test-872163599-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:21.324418 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-513ab518-2420-4130-b110-2d8145c322fb tempest-HypervisorAdminUnderV252Test-872163599 tempest-HypervisorAdminUnderV252Test-872163599-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:21.333476 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-513ab518-2420-4130-b110-2d8145c322fb tempest-HypervisorAdminUnderV252Test-872163599 tempest-HypervisorAdminUnderV252Test-872163599-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:21.334387 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-513ab518-2420-4130-b110-2d8145c322fb tempest-HypervisorAdminUnderV252Test-872163599 tempest-HypervisorAdminUnderV252Test-872163599-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:21.354099 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-513ab518-2420-4130-b110-2d8145c322fb tempest-HypervisorAdminUnderV252Test-872163599 tempest-HypervisorAdminUnderV252Test-872163599-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:21.354971 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-513ab518-2420-4130-b110-2d8145c322fb tempest-HypervisorAdminUnderV252Test-872163599 tempest-HypervisorAdminUnderV252Test-872163599-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:21.355858 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-513ab518-2420-4130-b110-2d8145c322fb tempest-HypervisorAdminUnderV252Test-872163599 tempest-HypervisorAdminUnderV252Test-872163599-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:21.366294 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-513ab518-2420-4130-b110-2d8145c322fb tempest-HypervisorAdminUnderV252Test-872163599 tempest-HypervisorAdminUnderV252Test-872163599-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.100699 Sep 08 10:37:21.367599 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 108/211] 10.222.0.27 () {58 vars in 1146 bytes} [Thu Sep 8 10:37:21 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:37:21.385863 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e824595c-cf7a-4d4d-ad70-8ca9c55f4257 tempest-HypervisorAdminUnderV252Test-872163599 tempest-HypervisorAdminUnderV252Test-872163599-project-admin] Calling method '.version_select at 0x7f68e509b4c0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:21.387435 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-89bf3747-0f60-4c6b-aec0-261bc684c860 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdbe35f311e435ba9e0516f302ba519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb116f8d7dd4858a91c03e0a4310fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:21.391551 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e824595c-cf7a-4d4d-ad70-8ca9c55f4257 tempest-HypervisorAdminUnderV252Test-872163599 tempest-HypervisorAdminUnderV252Test-872163599-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:21.397894 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-89bf3747-0f60-4c6b-aec0-261bc684c860 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] 10.222.0.27 "GET /compute/v2.1/servers/e605c39e-7644-4842-8476-9c9af611282f" status: 200 len: 1310 microversion: 2.1 time: 0.328033 Sep 08 10:37:21.398387 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e824595c-cf7a-4d4d-ad70-8ca9c55f4257 tempest-HypervisorAdminUnderV252Test-872163599 tempest-HypervisorAdminUnderV252Test-872163599-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:21.399913 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e824595c-cf7a-4d4d-ad70-8ca9c55f4257 tempest-HypervisorAdminUnderV252Test-872163599 tempest-HypervisorAdminUnderV252Test-872163599-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:21.402034 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 104/212] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:21 2022] GET /compute/v2.1/servers/e605c39e-7644-4842-8476-9c9af611282f => generated 1310 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:21.451306 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e824595c-cf7a-4d4d-ad70-8ca9c55f4257 tempest-HypervisorAdminUnderV252Test-872163599 tempest-HypervisorAdminUnderV252Test-872163599-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:21.451848 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e824595c-cf7a-4d4d-ad70-8ca9c55f4257 tempest-HypervisorAdminUnderV252Test-872163599 tempest-HypervisorAdminUnderV252Test-872163599-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:21.452347 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e824595c-cf7a-4d4d-ad70-8ca9c55f4257 tempest-HypervisorAdminUnderV252Test-872163599 tempest-HypervisorAdminUnderV252Test-872163599-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:21.471238 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e824595c-cf7a-4d4d-ad70-8ca9c55f4257 tempest-HypervisorAdminUnderV252Test-872163599 tempest-HypervisorAdminUnderV252Test-872163599-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/n-h1-850501-12/search" status: 200 len: 105 microversion: 2.1 time: 0.096246 Sep 08 10:37:21.475182 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 109/213] 10.222.0.27 () {58 vars in 1212 bytes} [Thu Sep 8 10:37:21 2022] GET /compute/v2.1/os-hypervisors/n-h1-850501-12/search => generated 105 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:37:22.089250 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-38f41336-298d-4c93-8f2a-2b51367eb240 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:22.091375 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-38f41336-298d-4c93-8f2a-2b51367eb240 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] [instance: a14a2e92-7b76-4576-bc3e-3b567afa63ac] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:22.103918 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-38f41336-298d-4c93-8f2a-2b51367eb240 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:22.108559 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-38f41336-298d-4c93-8f2a-2b51367eb240 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:22.109558 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-38f41336-298d-4c93-8f2a-2b51367eb240 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:22.110673 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-38f41336-298d-4c93-8f2a-2b51367eb240 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:22.111675 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-38f41336-298d-4c93-8f2a-2b51367eb240 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:22.113494 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-38f41336-298d-4c93-8f2a-2b51367eb240 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:22.142638 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-ff541cd4-661f-4c0b-b925-f145015b8e36 req-a9363ed7-664d-47c5-b7e7-97aa964d77ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a14a2e92-7b76-4576-bc3e-3b567afa63ac", "name": "network-vif-deleted", "tag": "0752003c-bc8c-4a51-b82a-3d434d535a4b"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:22.164815 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=9 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:37:22.166079 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=20 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:37:22.185814 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ff541cd4-661f-4c0b-b925-f145015b8e36 req-a9363ed7-664d-47c5-b7e7-97aa964d77ce service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:22.186897 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ff541cd4-661f-4c0b-b925-f145015b8e36 req-a9363ed7-664d-47c5-b7e7-97aa964d77ce service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:22.188493 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ff541cd4-661f-4c0b-b925-f145015b8e36 req-a9363ed7-664d-47c5-b7e7-97aa964d77ce service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:22.234811 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-ff541cd4-661f-4c0b-b925-f145015b8e36 req-a9363ed7-664d-47c5-b7e7-97aa964d77ce service nova] Creating event network-vif-deleted:0752003c-bc8c-4a51-b82a-3d434d535a4b for instance a14a2e92-7b76-4576-bc3e-3b567afa63ac on n-h1-850501-12 Sep 08 10:37:22.255730 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-ff541cd4-661f-4c0b-b925-f145015b8e36 req-a9363ed7-664d-47c5-b7e7-97aa964d77ce service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119450 Sep 08 10:37:22.256633 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 110/214] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:37:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:37:22.429339 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e775242f-c4f7-4455-93e1-2740ceb95bf5 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:22.429935 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e775242f-c4f7-4455-93e1-2740ceb95bf5 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] [instance: e605c39e-7644-4842-8476-9c9af611282f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:22.441387 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e775242f-c4f7-4455-93e1-2740ceb95bf5 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:22.442050 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e775242f-c4f7-4455-93e1-2740ceb95bf5 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:22.442683 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e775242f-c4f7-4455-93e1-2740ceb95bf5 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:22.443734 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e775242f-c4f7-4455-93e1-2740ceb95bf5 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:22.444161 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e775242f-c4f7-4455-93e1-2740ceb95bf5 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:22.444761 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e775242f-c4f7-4455-93e1-2740ceb95bf5 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:22.479911 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=6 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:37:22.490422 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-e775242f-c4f7-4455-93e1-2740ceb95bf5 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] HTTP exception thrown: Instance e605c39e-7644-4842-8476-9c9af611282f could not be found. Sep 08 10:37:22.498634 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e775242f-c4f7-4455-93e1-2740ceb95bf5 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Request method failure captured: Sep 08 10:37:22.498634 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/e605c39e-7644-4842-8476-9c9af611282f HTTP/1.1 Sep 08 10:37:22.498634 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:37:22.498634 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:37:22.498634 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:37:22.498634 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:37:22.498634 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:37:22.498634 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:37:22.498634 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:37:22.498634 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:37:22.498634 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcW3Cf6YoBWqaJLIIYaTO1fiMbOcWzpwHj6KKsufXrmQTTVhvcr8sv7TsKPAB8KFmxSVgs668LgkXMpgIKGyhAFeUTzWwcB0c1DtXy5FfOUaR2q9un-0uNPllUCMWrAPu7rKctDIn0-L_U6zEGJ4HdMYUVYI6y-HKkHNnc0-XO9pkIs Sep 08 10:37:22.498634 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:37:22.498634 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:37:22.498634 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:37:22.498634 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:37:22.498634 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:37:22.498634 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:37:22.498634 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 2eb116f8d7dd4858a91c03e0a4310fa9 Sep 08 10:37:22.498634 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1505808489 Sep 08 10:37:22.498634 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:37:22.498634 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:37:22.499903 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2eb116f8d7dd4858a91c03e0a4310fa9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2eb116f8d7dd4858a91c03e0a4310fa9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2eb116f8d7dd4858a91c03e0a4310fa9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2eb116f8d7dd4858a91c03e0a4310fa9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:37:22.499903 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-DeleteServersAdminTestJSON-1505808489 Sep 08 10:37:22.499903 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 2eb116f8d7dd4858a91c03e0a4310fa9 Sep 08 10:37:22.499903 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1505808489 Sep 08 10:37:22.499903 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-DeleteServersAdminTestJSON-1505808489-project Sep 08 10:37:22.499903 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:37:22.499903 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:37:22.499903 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 6fdbe35f311e435ba9e0516f302ba519 Sep 08 10:37:22.499903 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-DeleteServersAdminTestJSON-1505808489-project Sep 08 10:37:22.499903 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:37:22.499903 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance e605c39e-7644-4842-8476-9c9af611282f could not be found. Sep 08 10:37:22.499903 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'e605c39e-7644-4842-8476-9c9af611282f'} Sep 08 10:37:22.500579 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:37:22.500579 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:22.500579 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:37:22.500579 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:37:22.500579 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:37:22.500579 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:37:22.500579 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:37:22.500579 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:37:22.500579 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:37:22.500579 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:37:22.500579 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e605c39e-7644-4842-8476-9c9af611282f could not be found. Sep 08 10:37:22.500579 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:22.500579 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:22.500579 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:22.500579 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:22.500579 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:22.500579 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:22.500579 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:37:22.500579 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:37:22.500579 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:37:22.501764 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:37:22.501764 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:37:22.501764 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:37:22.501764 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:37:22.501764 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:37:22.501764 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:37:22.501764 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:37:22.501764 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e605c39e-7644-4842-8476-9c9af611282f could not be found. Sep 08 10:37:22.501764 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:22.501764 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:22.501764 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:22.501764 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:22.501764 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:22.501764 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:22.501764 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:37:22.501764 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:37:22.501764 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e605c39e-7644-4842-8476-9c9af611282f could not be found. Sep 08 10:37:22.501764 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:22.513383 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e775242f-c4f7-4455-93e1-2740ceb95bf5 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Returning 404 to user: Instance e605c39e-7644-4842-8476-9c9af611282f could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:37:22.513383 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e775242f-c4f7-4455-93e1-2740ceb95bf5 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] 10.222.0.27 "GET /compute/v2.1/servers/e605c39e-7644-4842-8476-9c9af611282f" status: 404 len: 111 microversion: 2.1 time: 0.077714 Sep 08 10:37:22.513383 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 111/215] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:22 2022] GET /compute/v2.1/servers/e605c39e-7644-4842-8476-9c9af611282f => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:37:22.668796 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-38f41336-298d-4c93-8f2a-2b51367eb240 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b76777df7594f7a9d03376362b80b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e11d5906f0407d9ea1f1deed40aab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:22.685453 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-38f41336-298d-4c93-8f2a-2b51367eb240 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] 10.222.0.27 "GET /compute/v2.1/servers/a14a2e92-7b76-4576-bc3e-3b567afa63ac" status: 200 len: 1452 microversion: 2.1 time: 0.601265 Sep 08 10:37:22.709459 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 105/216] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:22 2022] GET /compute/v2.1/servers/a14a2e92-7b76-4576-bc3e-3b567afa63ac => generated 1452 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:22.825756 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d71a261d-f7d0-4ee7-b988-af2ceb91c547 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1821272559", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:22.969299 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-d71a261d-f7d0-4ee7-b988-af2ceb91c547 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] validate_networks() for None {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:37:23.581860 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-d71a261d-f7d0-4ee7-b988-af2ceb91c547 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:37:23.582411 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-d71a261d-f7d0-4ee7-b988-af2ceb91c547 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:37:23.582802 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-d71a261d-f7d0-4ee7-b988-af2ceb91c547 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:37:23.583195 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-d71a261d-f7d0-4ee7-b988-af2ceb91c547 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:37:23.583870 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-d71a261d-f7d0-4ee7-b988-af2ceb91c547 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:37:23.601540 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d71a261d-f7d0-4ee7-b988-af2ceb91c547 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:23.602061 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d71a261d-f7d0-4ee7-b988-af2ceb91c547 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:23.602507 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d71a261d-f7d0-4ee7-b988-af2ceb91c547 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:23.603285 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d71a261d-f7d0-4ee7-b988-af2ceb91c547 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:23.606641 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d71a261d-f7d0-4ee7-b988-af2ceb91c547 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:23.607408 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d71a261d-f7d0-4ee7-b988-af2ceb91c547 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:23.639310 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-d71a261d-f7d0-4ee7-b988-af2ceb91c547 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Getting quotas for project 2eb116f8d7dd4858a91c03e0a4310fa9. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:37:23.644535 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-d71a261d-f7d0-4ee7-b988-af2ceb91c547 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Getting quotas for user 6fdbe35f311e435ba9e0516f302ba519 and project 2eb116f8d7dd4858a91c03e0a4310fa9. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:37:23.660356 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d71a261d-f7d0-4ee7-b988-af2ceb91c547 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:37:23.664755 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d71a261d-f7d0-4ee7-b988-af2ceb91c547 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] [instance: 0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:37:23.742169 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d71a261d-f7d0-4ee7-b988-af2ceb91c547 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.920400 Sep 08 10:37:23.745394 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 112/217] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:37:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 924 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:37:23.756429 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-487b5941-d29b-47d3-b423-f0c3bef668f8 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:23.757366 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-487b5941-d29b-47d3-b423-f0c3bef668f8 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] [instance: a14a2e92-7b76-4576-bc3e-3b567afa63ac] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:23.771031 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-487b5941-d29b-47d3-b423-f0c3bef668f8 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:23.773831 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-487b5941-d29b-47d3-b423-f0c3bef668f8 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:23.776517 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-487b5941-d29b-47d3-b423-f0c3bef668f8 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:23.777943 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-487b5941-d29b-47d3-b423-f0c3bef668f8 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:23.778908 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-487b5941-d29b-47d3-b423-f0c3bef668f8 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:23.780140 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0b66be8a-9d35-4bf0-bf3d-c3ee144e0b44 tempest-HostsAdminNegativeTestJSON-1037938327 tempest-HostsAdminNegativeTestJSON-1037938327-project-admin] Calling method '.version_select at 0x7f68e520a820>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:23.781011 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-487b5941-d29b-47d3-b423-f0c3bef668f8 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:23.784656 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0b66be8a-9d35-4bf0-bf3d-c3ee144e0b44 tempest-HostsAdminNegativeTestJSON-1037938327 tempest-HostsAdminNegativeTestJSON-1037938327-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:23.786973 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0b66be8a-9d35-4bf0-bf3d-c3ee144e0b44 tempest-HostsAdminNegativeTestJSON-1037938327 tempest-HostsAdminNegativeTestJSON-1037938327-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:23.787515 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0b66be8a-9d35-4bf0-bf3d-c3ee144e0b44 tempest-HostsAdminNegativeTestJSON-1037938327 tempest-HostsAdminNegativeTestJSON-1037938327-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:23.788574 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0b66be8a-9d35-4bf0-bf3d-c3ee144e0b44 tempest-HostsAdminNegativeTestJSON-1037938327 tempest-HostsAdminNegativeTestJSON-1037938327-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:23.791667 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0b66be8a-9d35-4bf0-bf3d-c3ee144e0b44 tempest-HostsAdminNegativeTestJSON-1037938327 tempest-HostsAdminNegativeTestJSON-1037938327-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:23.792478 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0b66be8a-9d35-4bf0-bf3d-c3ee144e0b44 tempest-HostsAdminNegativeTestJSON-1037938327 tempest-HostsAdminNegativeTestJSON-1037938327-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:23.842550 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-487b5941-d29b-47d3-b423-f0c3bef668f8 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] HTTP exception thrown: Instance a14a2e92-7b76-4576-bc3e-3b567afa63ac could not be found. Sep 08 10:37:23.847312 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-487b5941-d29b-47d3-b423-f0c3bef668f8 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Request method failure captured: Sep 08 10:37:23.847312 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/a14a2e92-7b76-4576-bc3e-3b567afa63ac HTTP/1.1 Sep 08 10:37:23.847312 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:37:23.847312 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:37:23.847312 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:37:23.847312 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:37:23.847312 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:37:23.847312 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:37:23.847312 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:37:23.847312 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:37:23.847312 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcW3NsHhQ2tRCGBQVfVokClDWCWMxc2oP-6tl5QsaP6ReB8nYkWuZowrUPnFSDRp2NMxhoJValvn9lObdLS41H6R5f9THHtFepuVClCkg2IEh-coXewr3iJClZ00kxzwh26D0E1CLRQsbHO6bNVTNyij5YDnoUn5oBqrcXdU9XuiwT4 Sep 08 10:37:23.847312 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:37:23.847312 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:37:23.847312 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:37:23.847312 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:37:23.847312 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:37:23.847312 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:37:23.847312 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: d5e11d5906f0407d9ea1f1deed40aab7 Sep 08 10:37:23.847312 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-AggregatesAdminTestJSON-1601146989 Sep 08 10:37:23.847312 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:37:23.847312 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:37:23.848813 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d5e11d5906f0407d9ea1f1deed40aab7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d5e11d5906f0407d9ea1f1deed40aab7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d5e11d5906f0407d9ea1f1deed40aab7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d5e11d5906f0407d9ea1f1deed40aab7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:37:23.848813 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-AggregatesAdminTestJSON-1601146989 Sep 08 10:37:23.848813 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: d5e11d5906f0407d9ea1f1deed40aab7 Sep 08 10:37:23.848813 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1601146989 Sep 08 10:37:23.848813 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-AggregatesAdminTestJSON-1601146989-project Sep 08 10:37:23.848813 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:37:23.848813 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:37:23.848813 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 5b76777df7594f7a9d03376362b80b0f Sep 08 10:37:23.848813 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-AggregatesAdminTestJSON-1601146989-project Sep 08 10:37:23.848813 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:37:23.848813 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance a14a2e92-7b76-4576-bc3e-3b567afa63ac could not be found. Sep 08 10:37:23.848813 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'a14a2e92-7b76-4576-bc3e-3b567afa63ac'} Sep 08 10:37:23.849630 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:37:23.849630 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:23.849630 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:37:23.849630 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:37:23.849630 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:37:23.849630 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:37:23.849630 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:37:23.849630 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:37:23.849630 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:37:23.849630 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:37:23.849630 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a14a2e92-7b76-4576-bc3e-3b567afa63ac could not be found. Sep 08 10:37:23.849630 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:23.849630 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:23.849630 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:23.849630 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:23.849630 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:23.849630 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:23.849630 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:37:23.849630 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:37:23.849630 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:37:23.851559 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:37:23.851559 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:37:23.851559 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:37:23.851559 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:37:23.851559 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:37:23.851559 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:37:23.851559 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:37:23.851559 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a14a2e92-7b76-4576-bc3e-3b567afa63ac could not be found. Sep 08 10:37:23.851559 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:23.851559 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:23.851559 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:23.851559 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:23.851559 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:23.851559 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:23.851559 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:37:23.851559 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:37:23.851559 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a14a2e92-7b76-4576-bc3e-3b567afa63ac could not be found. Sep 08 10:37:23.851559 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:23.852891 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-487b5941-d29b-47d3-b423-f0c3bef668f8 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Returning 404 to user: Instance a14a2e92-7b76-4576-bc3e-3b567afa63ac could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:37:23.852891 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-487b5941-d29b-47d3-b423-f0c3bef668f8 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] 10.222.0.27 "GET /compute/v2.1/servers/a14a2e92-7b76-4576-bc3e-3b567afa63ac" status: 404 len: 111 microversion: 2.1 time: 0.102283 Sep 08 10:37:23.858207 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 113/218] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:23 2022] GET /compute/v2.1/servers/a14a2e92-7b76-4576-bc3e-3b567afa63ac => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:37:23.868063 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c2af7f71-5b9b-4737-85ef-36ecb67376aa tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:23.868679 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c2af7f71-5b9b-4737-85ef-36ecb67376aa tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] [instance: 0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:23.870989 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0b66be8a-9d35-4bf0-bf3d-c3ee144e0b44 tempest-HostsAdminNegativeTestJSON-1037938327 tempest-HostsAdminNegativeTestJSON-1037938327-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts" status: 200 len: 403 microversion: 2.1 time: 0.558402 Sep 08 10:37:23.871817 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 106/219] 10.222.0.27 () {58 vars in 1128 bytes} [Thu Sep 8 10:37:23 2022] GET /compute/v2.1/os-hosts => generated 403 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:37:23.886954 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a0feb4d9-85c4-4612-bc82-d4f92cb6694f tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-850501-12"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:23.906468 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a0feb4d9-85c4-4612-bc82-d4f92cb6694f tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:23.908487 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a0feb4d9-85c4-4612-bc82-d4f92cb6694f tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:23.908954 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a0feb4d9-85c4-4612-bc82-d4f92cb6694f tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:24.019742 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c2af7f71-5b9b-4737-85ef-36ecb67376aa tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdbe35f311e435ba9e0516f302ba519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb116f8d7dd4858a91c03e0a4310fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:24.029327 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c2af7f71-5b9b-4737-85ef-36ecb67376aa tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] 10.222.0.27 "GET /compute/v2.1/servers/0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc" status: 200 len: 1220 microversion: 2.1 time: 0.169923 Sep 08 10:37:24.056323 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 114/220] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:23 2022] GET /compute/v2.1/servers/0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc => generated 1220 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:24.182334 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a0feb4d9-85c4-4612-bc82-d4f92cb6694f tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 299 microversion: 2.1 time: 0.308134 Sep 08 10:37:24.183868 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 107/221] 10.222.0.27 () {60 vars in 1191 bytes} [Thu Sep 8 10:37:23 2022] POST /compute/v2.1/os-aggregates/5/action => generated 299 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:37:24.605899 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a410bd17-0ef5-4d3d-80db-abd84ec018e5 tempest-HostsAdminNegativeTestJSON-1630574095 tempest-HostsAdminNegativeTestJSON-1630574095-project] Calling method '.version_select at 0x7f68e522be50>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:24.611300 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a410bd17-0ef5-4d3d-80db-abd84ec018e5 tempest-HostsAdminNegativeTestJSON-1630574095 tempest-HostsAdminNegativeTestJSON-1630574095-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '7fcc388060c4480ca2dc6b3e43653c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b7f2de96c34165a296d79961c0079f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:24.614135 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a410bd17-0ef5-4d3d-80db-abd84ec018e5 tempest-HostsAdminNegativeTestJSON-1630574095 tempest-HostsAdminNegativeTestJSON-1630574095-project] Request method failure captured: Sep 08 10:37:24.614135 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Sep 08 10:37:24.614135 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:37:24.614135 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:37:24.614135 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:37:24.614135 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:37:24.614135 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:37:24.614135 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:37:24.614135 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:37:24.614135 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:37:24.614135 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcXg9R_X3BZDMnQVc5RAldmfboT6cRMPvT9ozrOMqdouNhNWNBlu6lE6pzRH3jdiQ1W-_dqL_KC_qWW2q_Ojhcf0rtyB7bBrKoXQrVGr55biK3ge-r4xlBrPsBgagexdSVJYCupMu9Fa9-6cca1vZCsYtnCHmiVKirGUQ4ryb0TwS3I Sep 08 10:37:24.614135 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:37:24.614135 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:37:24.614135 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:37:24.614135 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:37:24.614135 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:37:24.614135 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:37:24.614135 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 77b7f2de96c34165a296d79961c0079f Sep 08 10:37:24.614135 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1630574095 Sep 08 10:37:24.614135 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:37:24.614135 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:37:24.615410 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/77b7f2de96c34165a296d79961c0079f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/77b7f2de96c34165a296d79961c0079f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_77b7f2de96c34165a296d79961c0079f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/77b7f2de96c34165a296d79961c0079f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:37:24.615410 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1630574095 Sep 08 10:37:24.615410 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 77b7f2de96c34165a296d79961c0079f Sep 08 10:37:24.615410 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1630574095 Sep 08 10:37:24.615410 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-HostsAdminNegativeTestJSON-1630574095-project Sep 08 10:37:24.615410 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:37:24.615410 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:37:24.615410 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 7fcc388060c4480ca2dc6b3e43653c5f Sep 08 10:37:24.615410 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1630574095-project Sep 08 10:37:24.615410 n-d-850501-12 devstack@n-api.service[128862]: method: Sep 08 10:37:24.615410 n-d-850501-12 devstack@n-api.service[128862]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Sep 08 10:37:24.615410 n-d-850501-12 devstack@n-api.service[128862]: action_args: {} Sep 08 10:37:24.615410 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:37:24.616244 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:24.616244 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:24.616244 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:24.616244 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:37:24.616244 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:37:24.616244 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:37:24.616244 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:37:24.616244 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 08 10:37:24.616244 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:37:24.616244 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:37:24.616244 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:37:24.616244 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Sep 08 10:37:24.616244 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Sep 08 10:37:24.616244 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 10:37:24.616244 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 10:37:24.616244 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 10:37:24.616244 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 10:37:24.616244 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:37:24.616244 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:37:24.617335 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:37:24.617335 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:37:24.617335 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 10:37:24.617335 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 10:37:24.617335 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 10:37:24.617335 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 10:37:24.617335 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 10:37:24.617335 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 10:37:24.617335 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Sep 08 10:37:24.617335 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:24.617335 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:24.617335 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:24.617335 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:24.617335 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:24.617335 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:24.617335 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 10:37:24.617335 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 10:37:24.617335 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Sep 08 10:37:24.617335 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:24.624534 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a410bd17-0ef5-4d3d-80db-abd84ec018e5 tempest-HostsAdminNegativeTestJSON-1630574095 tempest-HostsAdminNegativeTestJSON-1630574095-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:37:24.626116 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a410bd17-0ef5-4d3d-80db-abd84ec018e5 tempest-HostsAdminNegativeTestJSON-1630574095 tempest-HostsAdminNegativeTestJSON-1630574095-project] 10.222.0.27 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.568550 Sep 08 10:37:24.634418 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 115/222] 10.222.0.27 () {58 vars in 1128 bytes} [Thu Sep 8 10:37:24 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 577 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:37:24.641375 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d38fdeba-ad72-4787-98fe-0c60cd40d29f tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:24.703906 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d38fdeba-ad72-4787-98fe-0c60cd40d29f tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.068018 Sep 08 10:37:24.708658 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 116/223] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Sep 8 10:37:24 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 08 10:37:24.720674 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-94600eb1-a432-44b7-add4-189409a73794 tempest-HostsAdminNegativeTestJSON-1630574095 tempest-HostsAdminNegativeTestJSON-1630574095-project] Calling method '.version_select at 0x7f68e5066ee0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:24.724686 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-94600eb1-a432-44b7-add4-189409a73794 tempest-HostsAdminNegativeTestJSON-1630574095 tempest-HostsAdminNegativeTestJSON-1630574095-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '7fcc388060c4480ca2dc6b3e43653c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b7f2de96c34165a296d79961c0079f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:24.726860 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-94600eb1-a432-44b7-add4-189409a73794 tempest-HostsAdminNegativeTestJSON-1630574095 tempest-HostsAdminNegativeTestJSON-1630574095-project] Request method failure captured: Sep 08 10:37:24.726860 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/os-hosts/n-d-850501-12/reboot HTTP/1.1 Sep 08 10:37:24.726860 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:37:24.726860 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:37:24.726860 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:37:24.726860 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:37:24.726860 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:37:24.726860 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:37:24.726860 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:37:24.726860 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:37:24.726860 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcXg9R_X3BZDMnQVc5RAldmfboT6cRMPvT9ozrOMqdouNhNWNBlu6lE6pzRH3jdiQ1W-_dqL_KC_qWW2q_Ojhcf0rtyB7bBrKoXQrVGr55biK3ge-r4xlBrPsBgagexdSVJYCupMu9Fa9-6cca1vZCsYtnCHmiVKirGUQ4ryb0TwS3I Sep 08 10:37:24.726860 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:37:24.726860 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:37:24.726860 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:37:24.726860 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:37:24.726860 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:37:24.726860 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:37:24.726860 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 77b7f2de96c34165a296d79961c0079f Sep 08 10:37:24.726860 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1630574095 Sep 08 10:37:24.726860 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:37:24.726860 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:37:24.728211 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/77b7f2de96c34165a296d79961c0079f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/77b7f2de96c34165a296d79961c0079f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_77b7f2de96c34165a296d79961c0079f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/77b7f2de96c34165a296d79961c0079f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:37:24.728211 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1630574095 Sep 08 10:37:24.728211 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 77b7f2de96c34165a296d79961c0079f Sep 08 10:37:24.728211 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1630574095 Sep 08 10:37:24.728211 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-HostsAdminNegativeTestJSON-1630574095-project Sep 08 10:37:24.728211 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:37:24.728211 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:37:24.728211 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 7fcc388060c4480ca2dc6b3e43653c5f Sep 08 10:37:24.728211 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1630574095-project Sep 08 10:37:24.728211 n-d-850501-12 devstack@n-api.service[128862]: method: Sep 08 10:37:24.728211 n-d-850501-12 devstack@n-api.service[128862]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Sep 08 10:37:24.728211 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'n-d-850501-12'} Sep 08 10:37:24.728211 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:37:24.729009 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:24.729009 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:24.729009 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:24.729009 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:37:24.729009 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:37:24.729009 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:37:24.729009 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:37:24.729009 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:37:24.729009 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:37:24.729009 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Sep 08 10:37:24.729009 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Sep 08 10:37:24.729009 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 10:37:24.729009 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 10:37:24.729009 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 10:37:24.729009 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 10:37:24.729009 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:37:24.729009 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:37:24.729009 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:37:24.729009 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:37:24.730263 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 10:37:24.730263 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 10:37:24.730263 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 10:37:24.730263 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 10:37:24.730263 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 10:37:24.730263 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 10:37:24.730263 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Sep 08 10:37:24.730263 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:24.730263 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:24.730263 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:24.730263 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:24.730263 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:24.730263 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:24.730263 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 10:37:24.730263 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 10:37:24.730263 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Sep 08 10:37:24.730263 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:24.733504 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-94600eb1-a432-44b7-add4-189409a73794 tempest-HostsAdminNegativeTestJSON-1630574095 tempest-HostsAdminNegativeTestJSON-1630574095-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:37:24.734841 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-94600eb1-a432-44b7-add4-189409a73794 tempest-HostsAdminNegativeTestJSON-1630574095 tempest-HostsAdminNegativeTestJSON-1630574095-project] 10.222.0.27 "GET /compute/v2.1/os-hosts/n-d-850501-12/reboot" status: 403 len: 111 microversion: 2.1 time: 0.021224 Sep 08 10:37:24.744803 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 117/224] 10.222.0.27 () {58 vars in 1191 bytes} [Thu Sep 8 10:37:24 2022] GET /compute/v2.1/os-hosts/n-d-850501-12/reboot => generated 111 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:37:24.757557 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-be0c0ed3-33f9-45bb-a4fe-cb1f26d0ddaf tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2015400318"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:24.764218 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.aggregate [None req-be0c0ed3-33f9-45bb-a4fe-cb1f26d0ddaf tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Generated uuid 2bacc6ca-975d-43f8-beda-a968104d2b8f for aggregate {{(pid=128862) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 08 10:37:24.805972 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-be0c0ed3-33f9-45bb-a4fe-cb1f26d0ddaf tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.059663 Sep 08 10:37:24.807106 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 118/225] 10.222.0.27 () {60 vars in 1164 bytes} [Thu Sep 8 10:37:24 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:37:24.817873 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8803927c-85c1-46c7-be27-633bef067d07 tempest-HostsAdminNegativeTestJSON-1037938327 tempest-HostsAdminNegativeTestJSON-1037938327-project-admin] Calling method '.version_select at 0x7f68e51ed940>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:24.829266 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-8803927c-85c1-46c7-be27-633bef067d07 tempest-HostsAdminNegativeTestJSON-1037938327 tempest-HostsAdminNegativeTestJSON-1037938327-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 08 10:37:24.831475 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8803927c-85c1-46c7-be27-633bef067d07 tempest-HostsAdminNegativeTestJSON-1037938327 tempest-HostsAdminNegativeTestJSON-1037938327-project-admin] Request method failure captured: Sep 08 10:37:24.831475 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Sep 08 10:37:24.831475 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:37:24.831475 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:37:24.831475 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:37:24.831475 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:37:24.831475 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:37:24.831475 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:37:24.831475 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:37:24.831475 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:37:24.831475 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcXjwFmWcKQle5UWMD3j3sp8mzXApGCH35L1xgJ9IaobXfxY0nr0VOml2H9Eob8jnLfMjbOjMdWuV-ZYrnAZavu1OyabPhCuDeJxLppKrNKJt2a1bM7D8GTNshg6rtl4_htr7eB92VZlMVKreuuiTcUpz0oxzta7_u9xjL9Jiy22-a8 Sep 08 10:37:24.831475 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:37:24.831475 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:37:24.831475 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:37:24.831475 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:37:24.831475 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:37:24.831475 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:37:24.831475 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 922b734bfd4f42f5a7cb9b60ef9fbd9b Sep 08 10:37:24.831475 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1037938327 Sep 08 10:37:24.831475 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,admin,member Sep 08 10:37:24.831475 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,admin,member Sep 08 10:37:24.832822 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/922b734bfd4f42f5a7cb9b60ef9fbd9b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/922b734bfd4f42f5a7cb9b60ef9fbd9b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_922b734bfd4f42f5a7cb9b60ef9fbd9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/922b734bfd4f42f5a7cb9b60ef9fbd9b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:37:24.832822 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1037938327 Sep 08 10:37:24.832822 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 922b734bfd4f42f5a7cb9b60ef9fbd9b Sep 08 10:37:24.832822 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1037938327 Sep 08 10:37:24.832822 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-HostsAdminNegativeTestJSON-1037938327-project-admin Sep 08 10:37:24.832822 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:37:24.832822 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:37:24.832822 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 254752a88f7442ad9d3ecbd01185f906 Sep 08 10:37:24.832822 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1037938327-project-admin Sep 08 10:37:24.832822 n-d-850501-12 devstack@n-api.service[128862]: method: Sep 08 10:37:24.832822 n-d-850501-12 devstack@n-api.service[128862]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 08 10:37:24.832822 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'nonexistent_hostname'} Sep 08 10:37:24.832822 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:37:24.833609 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:24.833609 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Sep 08 10:37:24.833609 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Sep 08 10:37:24.833609 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 08 10:37:24.833609 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 08 10:37:24.833609 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:37:24.833609 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:37:24.833609 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:37:24.833609 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:37:24.833609 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 08 10:37:24.833609 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 08 10:37:24.833609 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 08 10:37:24.833609 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 08 10:37:24.833609 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 10:37:24.833609 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 10:37:24.833609 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 08 10:37:24.833609 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 08 10:37:24.833609 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 08 10:37:24.833609 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 08 10:37:24.834638 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 08 10:37:24.834638 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 08 10:37:24.834638 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 08 10:37:24.834638 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:24.834638 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:24.834638 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:24.834638 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:24.834638 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:24.834638 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:24.834638 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:37:24.834638 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:37:24.834638 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:37:24.834638 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:37:24.834638 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:37:24.834638 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:37:24.834638 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Sep 08 10:37:24.834638 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Sep 08 10:37:24.834638 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Sep 08 10:37:24.834638 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:37:24.835846 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 08 10:37:24.835846 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:24.835846 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:24.835846 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:24.835846 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:24.835846 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:24.835846 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:24.835846 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:37:24.835846 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:37:24.835846 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 08 10:37:24.835846 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:24.836435 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0a567af0-950c-4847-b71a-e356e458cba2 tempest-HypervisorAdminNegativeUnderV252Test-1675952754 tempest-HypervisorAdminNegativeUnderV252Test-1675952754-project-admin] Calling method '.version_select at 0x7f68e5296670>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:24.839436 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8803927c-85c1-46c7-be27-633bef067d07 tempest-HostsAdminNegativeTestJSON-1037938327 tempest-HostsAdminNegativeTestJSON-1037938327-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:37:24.840572 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8803927c-85c1-46c7-be27-633bef067d07 tempest-HostsAdminNegativeTestJSON-1037938327 tempest-HostsAdminNegativeTestJSON-1037938327-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.032213 Sep 08 10:37:24.848217 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 119/226] 10.222.0.27 () {58 vars in 1212 bytes} [Thu Sep 8 10:37:24 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:37:24.852751 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0a567af0-950c-4847-b71a-e356e458cba2 tempest-HypervisorAdminNegativeUnderV252Test-1675952754 tempest-HypervisorAdminNegativeUnderV252Test-1675952754-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:24.853424 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0a567af0-950c-4847-b71a-e356e458cba2 tempest-HypervisorAdminNegativeUnderV252Test-1675952754 tempest-HypervisorAdminNegativeUnderV252Test-1675952754-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:24.854076 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0a567af0-950c-4847-b71a-e356e458cba2 tempest-HypervisorAdminNegativeUnderV252Test-1675952754 tempest-HypervisorAdminNegativeUnderV252Test-1675952754-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:24.855059 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-83a762d6-9cb9-4175-a1e7-dc1226b2964e tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-850501-12"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:24.871396 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-83a762d6-9cb9-4175-a1e7-dc1226b2964e tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:24.872254 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-83a762d6-9cb9-4175-a1e7-dc1226b2964e tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:24.872891 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-83a762d6-9cb9-4175-a1e7-dc1226b2964e tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:24.925376 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0a567af0-950c-4847-b71a-e356e458cba2 tempest-HypervisorAdminNegativeUnderV252Test-1675952754 tempest-HypervisorAdminNegativeUnderV252Test-1675952754-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:24.926283 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0a567af0-950c-4847-b71a-e356e458cba2 tempest-HypervisorAdminNegativeUnderV252Test-1675952754 tempest-HypervisorAdminNegativeUnderV252Test-1675952754-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:24.926876 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0a567af0-950c-4847-b71a-e356e458cba2 tempest-HypervisorAdminNegativeUnderV252Test-1675952754 tempest-HypervisorAdminNegativeUnderV252Test-1675952754-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:25.015373 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0a567af0-950c-4847-b71a-e356e458cba2 tempest-HypervisorAdminNegativeUnderV252Test-1675952754 tempest-HypervisorAdminNegativeUnderV252Test-1675952754-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:25.016302 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0a567af0-950c-4847-b71a-e356e458cba2 tempest-HypervisorAdminNegativeUnderV252Test-1675952754 tempest-HypervisorAdminNegativeUnderV252Test-1675952754-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:25.030935 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0a567af0-950c-4847-b71a-e356e458cba2 tempest-HypervisorAdminNegativeUnderV252Test-1675952754 tempest-HypervisorAdminNegativeUnderV252Test-1675952754-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:25.041378 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0a567af0-950c-4847-b71a-e356e458cba2 tempest-HypervisorAdminNegativeUnderV252Test-1675952754 tempest-HypervisorAdminNegativeUnderV252Test-1675952754-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.856203 Sep 08 10:37:25.046260 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 108/227] 10.222.0.27 () {58 vars in 1146 bytes} [Thu Sep 8 10:37:24 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:37:25.054254 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c85d86a9-5e66-4dd6-be49-9bb302c9ee04 tempest-HostsAdminNegativeTestJSON-1630574095 tempest-HostsAdminNegativeTestJSON-1630574095-project] Calling method '.version_select at 0x7f68e52a3700>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:25.065741 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c85d86a9-5e66-4dd6-be49-9bb302c9ee04 tempest-HostsAdminNegativeTestJSON-1630574095 tempest-HostsAdminNegativeTestJSON-1630574095-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '7fcc388060c4480ca2dc6b3e43653c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b7f2de96c34165a296d79961c0079f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:25.077054 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c85d86a9-5e66-4dd6-be49-9bb302c9ee04 tempest-HostsAdminNegativeTestJSON-1630574095 tempest-HostsAdminNegativeTestJSON-1630574095-project] Request method failure captured: Sep 08 10:37:25.077054 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/os-hosts/n-d-850501-12 HTTP/1.1 Sep 08 10:37:25.077054 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:37:25.077054 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:37:25.077054 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:37:25.077054 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:37:25.077054 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:37:25.077054 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:37:25.077054 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:37:25.077054 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:37:25.077054 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcXg9R_X3BZDMnQVc5RAldmfboT6cRMPvT9ozrOMqdouNhNWNBlu6lE6pzRH3jdiQ1W-_dqL_KC_qWW2q_Ojhcf0rtyB7bBrKoXQrVGr55biK3ge-r4xlBrPsBgagexdSVJYCupMu9Fa9-6cca1vZCsYtnCHmiVKirGUQ4ryb0TwS3I Sep 08 10:37:25.077054 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:37:25.077054 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:37:25.077054 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:37:25.077054 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:37:25.077054 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:37:25.077054 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:37:25.077054 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 77b7f2de96c34165a296d79961c0079f Sep 08 10:37:25.077054 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1630574095 Sep 08 10:37:25.077054 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:37:25.077054 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:37:25.078432 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/77b7f2de96c34165a296d79961c0079f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/77b7f2de96c34165a296d79961c0079f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_77b7f2de96c34165a296d79961c0079f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/77b7f2de96c34165a296d79961c0079f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:37:25.078432 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1630574095 Sep 08 10:37:25.078432 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 77b7f2de96c34165a296d79961c0079f Sep 08 10:37:25.078432 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1630574095 Sep 08 10:37:25.078432 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-HostsAdminNegativeTestJSON-1630574095-project Sep 08 10:37:25.078432 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:37:25.078432 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:37:25.078432 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 7fcc388060c4480ca2dc6b3e43653c5f Sep 08 10:37:25.078432 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1630574095-project Sep 08 10:37:25.078432 n-d-850501-12 devstack@n-api.service[128861]: method: Sep 08 10:37:25.078432 n-d-850501-12 devstack@n-api.service[128861]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Sep 08 10:37:25.078432 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': 'n-d-850501-12'} Sep 08 10:37:25.078432 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:37:25.079852 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:25.079852 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:25.079852 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:25.079852 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:37:25.079852 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:37:25.079852 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:37:25.079852 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:37:25.079852 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:37:25.079852 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:37:25.079852 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Sep 08 10:37:25.079852 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Sep 08 10:37:25.079852 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 10:37:25.079852 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 10:37:25.079852 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 10:37:25.079852 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 10:37:25.079852 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:37:25.079852 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:37:25.079852 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:37:25.079852 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:37:25.081400 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 10:37:25.081400 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 10:37:25.081400 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 10:37:25.081400 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 10:37:25.081400 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 10:37:25.081400 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 10:37:25.081400 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Sep 08 10:37:25.081400 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:25.081400 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:25.081400 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:25.081400 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:25.081400 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:25.081400 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:25.081400 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 10:37:25.081400 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 10:37:25.081400 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Sep 08 10:37:25.081400 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:25.085361 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c85d86a9-5e66-4dd6-be49-9bb302c9ee04 tempest-HostsAdminNegativeTestJSON-1630574095 tempest-HostsAdminNegativeTestJSON-1630574095-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:37:25.086239 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c85d86a9-5e66-4dd6-be49-9bb302c9ee04 tempest-HostsAdminNegativeTestJSON-1630574095 tempest-HostsAdminNegativeTestJSON-1630574095-project] 10.222.0.27 "GET /compute/v2.1/os-hosts/n-d-850501-12" status: 403 len: 109 microversion: 2.1 time: 0.038812 Sep 08 10:37:25.091150 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 109/228] 10.222.0.27 () {58 vars in 1170 bytes} [Thu Sep 8 10:37:25 2022] GET /compute/v2.1/os-hosts/n-d-850501-12 => generated 109 bytes in 40 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:37:25.102433 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-73078ec3-4c8f-4ed2-bf59-0d6e6684029b tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:25.103621 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-73078ec3-4c8f-4ed2-bf59-0d6e6684029b tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] [instance: 0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:25.114609 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-83a762d6-9cb9-4175-a1e7-dc1226b2964e tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 243 microversion: 2.1 time: 0.264582 Sep 08 10:37:25.114998 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 120/229] 10.222.0.27 () {60 vars in 1191 bytes} [Thu Sep 8 10:37:24 2022] POST /compute/v2.1/os-aggregates/9/action => generated 243 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:37:25.150198 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-73078ec3-4c8f-4ed2-bf59-0d6e6684029b tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:25.150730 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-73078ec3-4c8f-4ed2-bf59-0d6e6684029b tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:25.151135 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-73078ec3-4c8f-4ed2-bf59-0d6e6684029b tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:25.151843 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-73078ec3-4c8f-4ed2-bf59-0d6e6684029b tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:25.152830 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-73078ec3-4c8f-4ed2-bf59-0d6e6684029b tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:25.152830 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-73078ec3-4c8f-4ed2-bf59-0d6e6684029b tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:25.394062 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-73078ec3-4c8f-4ed2-bf59-0d6e6684029b tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdbe35f311e435ba9e0516f302ba519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb116f8d7dd4858a91c03e0a4310fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:25.405844 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-73078ec3-4c8f-4ed2-bf59-0d6e6684029b tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] 10.222.0.27 "GET /compute/v2.1/servers/0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc" status: 200 len: 1216 microversion: 2.1 time: 0.317541 Sep 08 10:37:25.420761 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 110/230] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:25 2022] GET /compute/v2.1/servers/0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc => generated 1216 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:25.431023 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-017570f9-5ab6-4b43-9b46-347be32998bc tempest-HostsAdminNegativeTestJSON-1037938327 tempest-HostsAdminNegativeTestJSON-1037938327-project-admin] Calling method '.version_select at 0x7f68e5288790>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:25.448959 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-017570f9-5ab6-4b43-9b46-347be32998bc tempest-HostsAdminNegativeTestJSON-1037938327 tempest-HostsAdminNegativeTestJSON-1037938327-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 08 10:37:25.453913 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-017570f9-5ab6-4b43-9b46-347be32998bc tempest-HostsAdminNegativeTestJSON-1037938327 tempest-HostsAdminNegativeTestJSON-1037938327-project-admin] Request method failure captured: Sep 08 10:37:25.453913 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Sep 08 10:37:25.453913 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:37:25.453913 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:37:25.453913 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:37:25.453913 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:37:25.453913 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:37:25.453913 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:37:25.453913 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:37:25.453913 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:37:25.453913 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcXjwFmWcKQle5UWMD3j3sp8mzXApGCH35L1xgJ9IaobXfxY0nr0VOml2H9Eob8jnLfMjbOjMdWuV-ZYrnAZavu1OyabPhCuDeJxLppKrNKJt2a1bM7D8GTNshg6rtl4_htr7eB92VZlMVKreuuiTcUpz0oxzta7_u9xjL9Jiy22-a8 Sep 08 10:37:25.453913 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:37:25.453913 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:37:25.453913 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:37:25.453913 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:37:25.453913 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:37:25.453913 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:37:25.453913 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 922b734bfd4f42f5a7cb9b60ef9fbd9b Sep 08 10:37:25.453913 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1037938327 Sep 08 10:37:25.453913 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,admin,member Sep 08 10:37:25.453913 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,admin,member Sep 08 10:37:25.455798 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/922b734bfd4f42f5a7cb9b60ef9fbd9b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/922b734bfd4f42f5a7cb9b60ef9fbd9b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_922b734bfd4f42f5a7cb9b60ef9fbd9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/922b734bfd4f42f5a7cb9b60ef9fbd9b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:37:25.455798 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1037938327 Sep 08 10:37:25.455798 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 922b734bfd4f42f5a7cb9b60ef9fbd9b Sep 08 10:37:25.455798 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1037938327 Sep 08 10:37:25.455798 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-HostsAdminNegativeTestJSON-1037938327-project-admin Sep 08 10:37:25.455798 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:37:25.455798 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:37:25.455798 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 254752a88f7442ad9d3ecbd01185f906 Sep 08 10:37:25.455798 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1037938327-project-admin Sep 08 10:37:25.455798 n-d-850501-12 devstack@n-api.service[128861]: method: Sep 08 10:37:25.455798 n-d-850501-12 devstack@n-api.service[128861]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 08 10:37:25.455798 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': 'nonexistent_hostname'} Sep 08 10:37:25.455798 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:37:25.456679 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:25.456679 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Sep 08 10:37:25.456679 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Sep 08 10:37:25.456679 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 10:37:25.456679 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 10:37:25.456679 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 08 10:37:25.456679 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 08 10:37:25.456679 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 08 10:37:25.456679 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 08 10:37:25.456679 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 08 10:37:25.456679 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 08 10:37:25.456679 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 08 10:37:25.456679 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:25.456679 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:25.456679 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:25.456679 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:25.456679 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:25.456679 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:25.456679 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:37:25.459516 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:37:25.459516 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:37:25.459516 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:37:25.459516 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:37:25.459516 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:37:25.459516 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Sep 08 10:37:25.459516 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:37:25.459516 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 08 10:37:25.459516 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:25.459516 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:25.459516 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:25.459516 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:25.459516 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:25.459516 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:25.459516 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:37:25.459516 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:37:25.459516 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 08 10:37:25.459516 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:25.462060 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-017570f9-5ab6-4b43-9b46-347be32998bc tempest-HostsAdminNegativeTestJSON-1037938327 tempest-HostsAdminNegativeTestJSON-1037938327-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:37:25.462060 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-017570f9-5ab6-4b43-9b46-347be32998bc tempest-HostsAdminNegativeTestJSON-1037938327 tempest-HostsAdminNegativeTestJSON-1037938327-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.033556 Sep 08 10:37:25.462060 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 111/231] 10.222.0.27 () {58 vars in 1191 bytes} [Thu Sep 8 10:37:25 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:37:25.469248 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b3bc5785-41c4-40f5-aefa-85d9335ad005 tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:25.475431 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6ac9faa2-2f74-4151-b076-749cda868d4a tempest-HypervisorAdminNegativeUnderV252Test-1614554825 tempest-HypervisorAdminNegativeUnderV252Test-1614554825-project] Calling method '.version_select at 0x7f68e51fc9d0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:25.477239 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6ac9faa2-2f74-4151-b076-749cda868d4a tempest-HypervisorAdminNegativeUnderV252Test-1614554825 tempest-HypervisorAdminNegativeUnderV252Test-1614554825-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': 'faa00d910b354aac954278342843339a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82aa06f9c28b4ddaade8def470bec53d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:25.479139 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6ac9faa2-2f74-4151-b076-749cda868d4a tempest-HypervisorAdminNegativeUnderV252Test-1614554825 tempest-HypervisorAdminNegativeUnderV252Test-1614554825-project] Request method failure captured: Sep 08 10:37:25.479139 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/os-hypervisors/n-h1-850501-12/search HTTP/1.1 Sep 08 10:37:25.479139 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:37:25.479139 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:37:25.479139 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:37:25.479139 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:37:25.479139 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:37:25.479139 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:37:25.479139 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:37:25.479139 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:37:25.479139 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcXhAmPhcOK6u0HmEhS0jek03Yd1INPGisdODd2cCuYCALEgUx0XK3sff1xAzxgdcIuSqmbTZPPFRXTKgKIQMEAy6DI5VO8m2JiwH3OnddUuMuWqEJYk3MHLTuFyz4xN7wyHUC3cK5s8UQfpqbjcvunPYaKNEurpg7q4Rf2sMkTQQf0 Sep 08 10:37:25.479139 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:37:25.479139 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:37:25.479139 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:37:25.479139 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:37:25.479139 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:37:25.479139 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:37:25.479139 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 82aa06f9c28b4ddaade8def470bec53d Sep 08 10:37:25.479139 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1614554825 Sep 08 10:37:25.479139 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:37:25.479139 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:37:25.480401 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/82aa06f9c28b4ddaade8def470bec53d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/82aa06f9c28b4ddaade8def470bec53d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_82aa06f9c28b4ddaade8def470bec53d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/82aa06f9c28b4ddaade8def470bec53d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:37:25.480401 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1614554825 Sep 08 10:37:25.480401 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 82aa06f9c28b4ddaade8def470bec53d Sep 08 10:37:25.480401 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1614554825 Sep 08 10:37:25.480401 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1614554825-project Sep 08 10:37:25.480401 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:37:25.480401 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:37:25.480401 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: faa00d910b354aac954278342843339a Sep 08 10:37:25.480401 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1614554825-project Sep 08 10:37:25.480401 n-d-850501-12 devstack@n-api.service[128862]: method: Sep 08 10:37:25.480401 n-d-850501-12 devstack@n-api.service[128862]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Sep 08 10:37:25.480401 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'n-h1-850501-12'} Sep 08 10:37:25.481784 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:37:25.481784 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:25.481784 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:25.481784 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:25.481784 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:37:25.481784 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:37:25.481784 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:37:25.481784 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:37:25.481784 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:37:25.481784 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:37:25.481784 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Sep 08 10:37:25.481784 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Sep 08 10:37:25.481784 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 10:37:25.481784 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 10:37:25.481784 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 10:37:25.481784 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 10:37:25.481784 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:37:25.481784 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:37:25.481784 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:37:25.482902 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:37:25.482902 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 10:37:25.482902 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 10:37:25.482902 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 10:37:25.482902 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 10:37:25.482902 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 10:37:25.482902 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 10:37:25.482902 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Sep 08 10:37:25.482902 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:25.482902 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:25.482902 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:25.482902 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:25.482902 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:25.482902 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:25.482902 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 10:37:25.482902 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 10:37:25.482902 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Sep 08 10:37:25.482902 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:25.486016 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6ac9faa2-2f74-4151-b076-749cda868d4a tempest-HypervisorAdminNegativeUnderV252Test-1614554825 tempest-HypervisorAdminNegativeUnderV252Test-1614554825-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:37:25.486016 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6ac9faa2-2f74-4151-b076-749cda868d4a tempest-HypervisorAdminNegativeUnderV252Test-1614554825 tempest-HypervisorAdminNegativeUnderV252Test-1614554825-project] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/n-h1-850501-12/search" status: 403 len: 117 microversion: 2.1 time: 0.364414 Sep 08 10:37:25.486016 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 121/232] 10.222.0.27 () {58 vars in 1212 bytes} [Thu Sep 8 10:37:25 2022] GET /compute/v2.1/os-hypervisors/n-h1-850501-12/search => generated 117 bytes in 365 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:37:25.491271 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3fa454da-d7f7-4899-a11a-48bd27a84493 tempest-HostsAdminNegativeTestJSON-1630574095 tempest-HostsAdminNegativeTestJSON-1630574095-project] Calling method '.version_select at 0x7f68e5476e50>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:25.493105 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3fa454da-d7f7-4899-a11a-48bd27a84493 tempest-HostsAdminNegativeTestJSON-1630574095 tempest-HostsAdminNegativeTestJSON-1630574095-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '7fcc388060c4480ca2dc6b3e43653c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b7f2de96c34165a296d79961c0079f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:25.494879 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3fa454da-d7f7-4899-a11a-48bd27a84493 tempest-HostsAdminNegativeTestJSON-1630574095 tempest-HostsAdminNegativeTestJSON-1630574095-project] Request method failure captured: Sep 08 10:37:25.494879 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/os-hosts/n-d-850501-12/shutdown HTTP/1.1 Sep 08 10:37:25.494879 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:37:25.494879 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:37:25.494879 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:37:25.494879 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:37:25.494879 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:37:25.494879 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:37:25.494879 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:37:25.494879 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:37:25.494879 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcXg9R_X3BZDMnQVc5RAldmfboT6cRMPvT9ozrOMqdouNhNWNBlu6lE6pzRH3jdiQ1W-_dqL_KC_qWW2q_Ojhcf0rtyB7bBrKoXQrVGr55biK3ge-r4xlBrPsBgagexdSVJYCupMu9Fa9-6cca1vZCsYtnCHmiVKirGUQ4ryb0TwS3I Sep 08 10:37:25.494879 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:37:25.494879 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:37:25.494879 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:37:25.494879 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:37:25.494879 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:37:25.494879 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:37:25.494879 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 77b7f2de96c34165a296d79961c0079f Sep 08 10:37:25.494879 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1630574095 Sep 08 10:37:25.494879 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:37:25.494879 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:37:25.496283 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/77b7f2de96c34165a296d79961c0079f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/77b7f2de96c34165a296d79961c0079f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_77b7f2de96c34165a296d79961c0079f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/77b7f2de96c34165a296d79961c0079f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:37:25.496283 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1630574095 Sep 08 10:37:25.496283 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 77b7f2de96c34165a296d79961c0079f Sep 08 10:37:25.496283 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1630574095 Sep 08 10:37:25.496283 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-HostsAdminNegativeTestJSON-1630574095-project Sep 08 10:37:25.496283 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:37:25.496283 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:37:25.496283 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 7fcc388060c4480ca2dc6b3e43653c5f Sep 08 10:37:25.496283 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1630574095-project Sep 08 10:37:25.496283 n-d-850501-12 devstack@n-api.service[128862]: method: Sep 08 10:37:25.496283 n-d-850501-12 devstack@n-api.service[128862]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Sep 08 10:37:25.496283 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'n-d-850501-12'} Sep 08 10:37:25.496283 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:37:25.497004 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:25.497004 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:25.497004 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:25.497004 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:37:25.497004 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:37:25.497004 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:37:25.497004 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:37:25.497004 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:37:25.497004 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:37:25.497004 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Sep 08 10:37:25.497004 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Sep 08 10:37:25.497004 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 10:37:25.497004 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 10:37:25.497004 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 10:37:25.497004 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 10:37:25.497004 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:37:25.497004 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:37:25.497004 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:37:25.497004 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:37:25.498188 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 10:37:25.498188 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 10:37:25.498188 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 10:37:25.498188 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 10:37:25.498188 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 10:37:25.498188 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 10:37:25.498188 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Sep 08 10:37:25.498188 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:25.498188 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:25.498188 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:25.498188 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:25.498188 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:25.498188 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:25.498188 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 10:37:25.498188 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 10:37:25.498188 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Sep 08 10:37:25.498188 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:25.507984 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b3bc5785-41c4-40f5-aefa-85d9335ad005 tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 243 microversion: 2.1 time: 0.043403 Sep 08 10:37:25.509152 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 112/233] 10.222.0.27 () {58 vars in 1149 bytes} [Thu Sep 8 10:37:25 2022] GET /compute/v2.1/os-aggregates/9 => generated 243 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:37:25.510847 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3fa454da-d7f7-4899-a11a-48bd27a84493 tempest-HostsAdminNegativeTestJSON-1630574095 tempest-HostsAdminNegativeTestJSON-1630574095-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:37:25.512298 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3fa454da-d7f7-4899-a11a-48bd27a84493 tempest-HostsAdminNegativeTestJSON-1630574095 tempest-HostsAdminNegativeTestJSON-1630574095-project] 10.222.0.27 "GET /compute/v2.1/os-hosts/n-d-850501-12/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.030315 Sep 08 10:37:25.514248 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 122/234] 10.222.0.27 () {58 vars in 1197 bytes} [Thu Sep 8 10:37:25 2022] GET /compute/v2.1/os-hosts/n-d-850501-12/shutdown => generated 113 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:37:25.522914 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8e29740b-9e14-48d9-8ef8-bd9681b6bd01 tempest-HypervisorAdminNegativeUnderV252Test-1675952754 tempest-HypervisorAdminNegativeUnderV252Test-1675952754-project-admin] Calling method '.version_select at 0x7f68e5357dc0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:25.525983 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e8b82904-43b9-4904-a44a-af0fedc27995 tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-850501-12"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:25.528683 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8e29740b-9e14-48d9-8ef8-bd9681b6bd01 tempest-HypervisorAdminNegativeUnderV252Test-1675952754 tempest-HypervisorAdminNegativeUnderV252Test-1675952754-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:25.529450 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8e29740b-9e14-48d9-8ef8-bd9681b6bd01 tempest-HypervisorAdminNegativeUnderV252Test-1675952754 tempest-HypervisorAdminNegativeUnderV252Test-1675952754-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:25.530200 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8e29740b-9e14-48d9-8ef8-bd9681b6bd01 tempest-HypervisorAdminNegativeUnderV252Test-1675952754 tempest-HypervisorAdminNegativeUnderV252Test-1675952754-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:25.554887 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e8b82904-43b9-4904-a44a-af0fedc27995 tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:25.558907 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e8b82904-43b9-4904-a44a-af0fedc27995 tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:25.559619 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e8b82904-43b9-4904-a44a-af0fedc27995 tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:25.560041 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-8e29740b-9e14-48d9-8ef8-bd9681b6bd01 tempest-HypervisorAdminNegativeUnderV252Test-1675952754 tempest-HypervisorAdminNegativeUnderV252Test-1675952754-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 08 10:37:25.562655 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8e29740b-9e14-48d9-8ef8-bd9681b6bd01 tempest-HypervisorAdminNegativeUnderV252Test-1675952754 tempest-HypervisorAdminNegativeUnderV252Test-1675952754-project-admin] Request method failure captured: Sep 08 10:37:25.562655 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Sep 08 10:37:25.562655 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:37:25.562655 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:37:25.562655 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:37:25.562655 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:37:25.562655 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:37:25.562655 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:37:25.562655 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:37:25.562655 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:37:25.562655 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcXjwFA2CzTU9Fy3KcImw5H73BvRsBVPzFMqpZxghz3vBL_e_9msOKIz6oYbGxTuae-TDMbR2bMZld231QSCpLlR7ngKoFchaIon5BteAtI3X9jQDaQ1qmYiKeJCCuzVEs2OqEGi3cS-zGTaHHiQqKZJSz_Dyim1rhbHze0DoBeiZ9M Sep 08 10:37:25.562655 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:37:25.562655 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:37:25.562655 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:37:25.562655 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:37:25.562655 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:37:25.562655 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:37:25.562655 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 8e1231aacc024e3c892b59b19cddf0ea Sep 08 10:37:25.562655 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1675952754 Sep 08 10:37:25.562655 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,admin,member Sep 08 10:37:25.562655 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,admin,member Sep 08 10:37:25.564070 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8e1231aacc024e3c892b59b19cddf0ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8e1231aacc024e3c892b59b19cddf0ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8e1231aacc024e3c892b59b19cddf0ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8e1231aacc024e3c892b59b19cddf0ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:37:25.564070 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1675952754 Sep 08 10:37:25.564070 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 8e1231aacc024e3c892b59b19cddf0ea Sep 08 10:37:25.564070 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1675952754 Sep 08 10:37:25.564070 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1675952754-project-admin Sep 08 10:37:25.564070 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:37:25.564070 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:37:25.564070 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 2730b00405e44a009a158a37337087ee Sep 08 10:37:25.564070 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1675952754-project-admin Sep 08 10:37:25.564070 n-d-850501-12 devstack@n-api.service[128861]: method: Sep 08 10:37:25.564070 n-d-850501-12 devstack@n-api.service[128861]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 08 10:37:25.564070 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': 'nonexistent_hypervisor_name'} Sep 08 10:37:25.565644 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:37:25.565644 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:25.565644 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:25.565644 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:25.565644 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:37:25.565644 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:37:25.565644 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:37:25.565644 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:37:25.565644 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:37:25.565644 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:37:25.565644 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Sep 08 10:37:25.565644 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Sep 08 10:37:25.565644 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Sep 08 10:37:25.565644 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 08 10:37:25.565644 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 08 10:37:25.565644 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:25.565644 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:25.565644 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:25.565644 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:25.565644 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:25.568479 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:25.568479 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:37:25.568479 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:37:25.568479 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 08 10:37:25.568479 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:25.569954 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8e29740b-9e14-48d9-8ef8-bd9681b6bd01 tempest-HypervisorAdminNegativeUnderV252Test-1675952754 tempest-HypervisorAdminNegativeUnderV252Test-1675952754-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:37:25.571019 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8e29740b-9e14-48d9-8ef8-bd9681b6bd01 tempest-HypervisorAdminNegativeUnderV252Test-1675952754 tempest-HypervisorAdminNegativeUnderV252Test-1675952754-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.060763 Sep 08 10:37:25.571786 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 113/235] 10.222.0.27 () {58 vars in 1251 bytes} [Thu Sep 8 10:37:25 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:37:25.578175 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c6b12c55-288f-44d0-97a1-4b32933079a0 tempest-HostsAdminNegativeTestJSON-1037938327 tempest-HostsAdminNegativeTestJSON-1037938327-project-admin] Calling method '.version_select at 0x7f68e579e160>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:25.590903 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-c6b12c55-288f-44d0-97a1-4b32933079a0 tempest-HostsAdminNegativeTestJSON-1037938327 tempest-HostsAdminNegativeTestJSON-1037938327-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 08 10:37:25.592837 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c6b12c55-288f-44d0-97a1-4b32933079a0 tempest-HostsAdminNegativeTestJSON-1037938327 tempest-HostsAdminNegativeTestJSON-1037938327-project-admin] Request method failure captured: Sep 08 10:37:25.592837 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Sep 08 10:37:25.592837 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:37:25.592837 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:37:25.592837 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:37:25.592837 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:37:25.592837 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:37:25.592837 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:37:25.592837 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:37:25.592837 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:37:25.592837 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcXjwFmWcKQle5UWMD3j3sp8mzXApGCH35L1xgJ9IaobXfxY0nr0VOml2H9Eob8jnLfMjbOjMdWuV-ZYrnAZavu1OyabPhCuDeJxLppKrNKJt2a1bM7D8GTNshg6rtl4_htr7eB92VZlMVKreuuiTcUpz0oxzta7_u9xjL9Jiy22-a8 Sep 08 10:37:25.592837 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:37:25.592837 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:37:25.592837 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:37:25.592837 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:37:25.592837 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:37:25.592837 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:37:25.592837 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 922b734bfd4f42f5a7cb9b60ef9fbd9b Sep 08 10:37:25.592837 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1037938327 Sep 08 10:37:25.592837 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,admin,member Sep 08 10:37:25.592837 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,admin,member Sep 08 10:37:25.594150 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/922b734bfd4f42f5a7cb9b60ef9fbd9b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/922b734bfd4f42f5a7cb9b60ef9fbd9b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_922b734bfd4f42f5a7cb9b60ef9fbd9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/922b734bfd4f42f5a7cb9b60ef9fbd9b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:37:25.594150 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1037938327 Sep 08 10:37:25.594150 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 922b734bfd4f42f5a7cb9b60ef9fbd9b Sep 08 10:37:25.594150 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1037938327 Sep 08 10:37:25.594150 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-HostsAdminNegativeTestJSON-1037938327-project-admin Sep 08 10:37:25.594150 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:37:25.594150 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:37:25.594150 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 254752a88f7442ad9d3ecbd01185f906 Sep 08 10:37:25.594150 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1037938327-project-admin Sep 08 10:37:25.594150 n-d-850501-12 devstack@n-api.service[128861]: method: Sep 08 10:37:25.594150 n-d-850501-12 devstack@n-api.service[128861]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 08 10:37:25.594150 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': 'nonexistent_hostname'} Sep 08 10:37:25.594150 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:37:25.594955 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:25.594955 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Sep 08 10:37:25.594955 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Sep 08 10:37:25.594955 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 08 10:37:25.594955 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 08 10:37:25.594955 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:37:25.594955 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:37:25.594955 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:37:25.594955 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:37:25.594955 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 08 10:37:25.594955 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 08 10:37:25.594955 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 08 10:37:25.594955 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 08 10:37:25.594955 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 10:37:25.594955 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 10:37:25.594955 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 08 10:37:25.594955 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 08 10:37:25.594955 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 08 10:37:25.594955 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 08 10:37:25.596019 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 08 10:37:25.596019 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 08 10:37:25.596019 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 08 10:37:25.596019 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:25.596019 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:25.596019 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:25.596019 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:25.596019 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:25.596019 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:25.596019 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:37:25.596019 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:37:25.596019 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:37:25.596019 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:37:25.596019 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:37:25.596019 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:37:25.596019 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Sep 08 10:37:25.596019 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Sep 08 10:37:25.596019 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Sep 08 10:37:25.596019 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:37:25.597060 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 08 10:37:25.597060 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:25.597060 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:25.597060 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:25.597060 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:25.597060 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:25.597060 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:25.597060 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:37:25.597060 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:37:25.597060 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 08 10:37:25.597060 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:25.601695 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c6b12c55-288f-44d0-97a1-4b32933079a0 tempest-HostsAdminNegativeTestJSON-1037938327 tempest-HostsAdminNegativeTestJSON-1037938327-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:37:25.608656 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c6b12c55-288f-44d0-97a1-4b32933079a0 tempest-HostsAdminNegativeTestJSON-1037938327 tempest-HostsAdminNegativeTestJSON-1037938327-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.033945 Sep 08 10:37:25.612756 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 114/236] 10.222.0.27 () {58 vars in 1218 bytes} [Thu Sep 8 10:37:25 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:37:25.632043 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5857482d-2764-4f24-a01c-4906505813b0 tempest-HypervisorAdminNegativeUnderV252Test-1675952754 tempest-HypervisorAdminNegativeUnderV252Test-1675952754-project-admin] Calling method '.version_select at 0x7f68e52daca0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:25.636172 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5857482d-2764-4f24-a01c-4906505813b0 tempest-HypervisorAdminNegativeUnderV252Test-1675952754 tempest-HypervisorAdminNegativeUnderV252Test-1675952754-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:25.641176 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5857482d-2764-4f24-a01c-4906505813b0 tempest-HypervisorAdminNegativeUnderV252Test-1675952754 tempest-HypervisorAdminNegativeUnderV252Test-1675952754-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:25.641695 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5857482d-2764-4f24-a01c-4906505813b0 tempest-HypervisorAdminNegativeUnderV252Test-1675952754 tempest-HypervisorAdminNegativeUnderV252Test-1675952754-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:25.726637 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5857482d-2764-4f24-a01c-4906505813b0 tempest-HypervisorAdminNegativeUnderV252Test-1675952754 tempest-HypervisorAdminNegativeUnderV252Test-1675952754-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:25.727308 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5857482d-2764-4f24-a01c-4906505813b0 tempest-HypervisorAdminNegativeUnderV252Test-1675952754 tempest-HypervisorAdminNegativeUnderV252Test-1675952754-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:25.727719 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5857482d-2764-4f24-a01c-4906505813b0 tempest-HypervisorAdminNegativeUnderV252Test-1675952754 tempest-HypervisorAdminNegativeUnderV252Test-1675952754-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:25.742940 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5857482d-2764-4f24-a01c-4906505813b0 tempest-HypervisorAdminNegativeUnderV252Test-1675952754 tempest-HypervisorAdminNegativeUnderV252Test-1675952754-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:25.743430 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5857482d-2764-4f24-a01c-4906505813b0 tempest-HypervisorAdminNegativeUnderV252Test-1675952754 tempest-HypervisorAdminNegativeUnderV252Test-1675952754-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:25.744076 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5857482d-2764-4f24-a01c-4906505813b0 tempest-HypervisorAdminNegativeUnderV252Test-1675952754 tempest-HypervisorAdminNegativeUnderV252Test-1675952754-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:25.751480 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5857482d-2764-4f24-a01c-4906505813b0 tempest-HypervisorAdminNegativeUnderV252Test-1675952754 tempest-HypervisorAdminNegativeUnderV252Test-1675952754-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.137541 Sep 08 10:37:25.753336 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 115/237] 10.222.0.27 () {58 vars in 1146 bytes} [Thu Sep 8 10:37:25 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:37:25.758387 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0f2b447d-e857-4208-820a-ff3780132a56 tempest-HostsAdminNegativeTestJSON-1630574095 tempest-HostsAdminNegativeTestJSON-1630574095-project] Calling method '.version_select at 0x7f68e5439c10>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:25.761164 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0f2b447d-e857-4208-820a-ff3780132a56 tempest-HostsAdminNegativeTestJSON-1630574095 tempest-HostsAdminNegativeTestJSON-1630574095-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '7fcc388060c4480ca2dc6b3e43653c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b7f2de96c34165a296d79961c0079f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:25.763142 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0f2b447d-e857-4208-820a-ff3780132a56 tempest-HostsAdminNegativeTestJSON-1630574095 tempest-HostsAdminNegativeTestJSON-1630574095-project] Request method failure captured: Sep 08 10:37:25.763142 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/os-hosts/n-d-850501-12/startup HTTP/1.1 Sep 08 10:37:25.763142 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:37:25.763142 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:37:25.763142 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:37:25.763142 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:37:25.763142 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:37:25.763142 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:37:25.763142 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:37:25.763142 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:37:25.763142 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcXg9R_X3BZDMnQVc5RAldmfboT6cRMPvT9ozrOMqdouNhNWNBlu6lE6pzRH3jdiQ1W-_dqL_KC_qWW2q_Ojhcf0rtyB7bBrKoXQrVGr55biK3ge-r4xlBrPsBgagexdSVJYCupMu9Fa9-6cca1vZCsYtnCHmiVKirGUQ4ryb0TwS3I Sep 08 10:37:25.763142 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:37:25.763142 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:37:25.763142 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:37:25.763142 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:37:25.763142 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:37:25.763142 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:37:25.763142 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 77b7f2de96c34165a296d79961c0079f Sep 08 10:37:25.763142 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1630574095 Sep 08 10:37:25.763142 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:37:25.763142 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:37:25.764549 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/77b7f2de96c34165a296d79961c0079f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/77b7f2de96c34165a296d79961c0079f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_77b7f2de96c34165a296d79961c0079f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/77b7f2de96c34165a296d79961c0079f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:37:25.764549 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1630574095 Sep 08 10:37:25.764549 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 77b7f2de96c34165a296d79961c0079f Sep 08 10:37:25.764549 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1630574095 Sep 08 10:37:25.764549 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-HostsAdminNegativeTestJSON-1630574095-project Sep 08 10:37:25.764549 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:37:25.764549 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:37:25.764549 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 7fcc388060c4480ca2dc6b3e43653c5f Sep 08 10:37:25.764549 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1630574095-project Sep 08 10:37:25.764549 n-d-850501-12 devstack@n-api.service[128861]: method: Sep 08 10:37:25.764549 n-d-850501-12 devstack@n-api.service[128861]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Sep 08 10:37:25.764549 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': 'n-d-850501-12'} Sep 08 10:37:25.764549 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:37:25.765319 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:25.765319 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:25.765319 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:25.765319 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:37:25.765319 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:37:25.765319 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:37:25.765319 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:37:25.765319 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:37:25.765319 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:37:25.765319 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Sep 08 10:37:25.765319 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Sep 08 10:37:25.765319 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 10:37:25.765319 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 10:37:25.765319 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 10:37:25.765319 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 10:37:25.765319 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:37:25.765319 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:37:25.765319 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:37:25.765319 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:37:25.766320 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 10:37:25.766320 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 10:37:25.766320 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 10:37:25.766320 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 10:37:25.766320 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 10:37:25.766320 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 10:37:25.766320 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Sep 08 10:37:25.766320 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:25.766320 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:25.766320 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:25.766320 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:25.766320 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:25.766320 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:25.766320 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 10:37:25.766320 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 10:37:25.766320 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Sep 08 10:37:25.766320 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:25.770377 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0f2b447d-e857-4208-820a-ff3780132a56 tempest-HostsAdminNegativeTestJSON-1630574095 tempest-HostsAdminNegativeTestJSON-1630574095-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:37:25.771420 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0f2b447d-e857-4208-820a-ff3780132a56 tempest-HostsAdminNegativeTestJSON-1630574095 tempest-HostsAdminNegativeTestJSON-1630574095-project] 10.222.0.27 "GET /compute/v2.1/os-hosts/n-d-850501-12/startup" status: 403 len: 110 microversion: 2.1 time: 0.016964 Sep 08 10:37:25.777505 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 116/238] 10.222.0.27 () {58 vars in 1194 bytes} [Thu Sep 8 10:37:25 2022] GET /compute/v2.1/os-hosts/n-d-850501-12/startup => generated 110 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:37:25.784315 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-37b7b87e-2f7a-4a2c-a1d1-ad4e5cf18a51 tempest-HypervisorAdminNegativeUnderV252Test-1614554825 tempest-HypervisorAdminNegativeUnderV252Test-1614554825-project] Calling method '.version_select at 0x7f68e520a160>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:25.800090 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-37b7b87e-2f7a-4a2c-a1d1-ad4e5cf18a51 tempest-HypervisorAdminNegativeUnderV252Test-1614554825 tempest-HypervisorAdminNegativeUnderV252Test-1614554825-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': 'faa00d910b354aac954278342843339a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82aa06f9c28b4ddaade8def470bec53d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:25.802634 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-37b7b87e-2f7a-4a2c-a1d1-ad4e5cf18a51 tempest-HypervisorAdminNegativeUnderV252Test-1614554825 tempest-HypervisorAdminNegativeUnderV252Test-1614554825-project] Request method failure captured: Sep 08 10:37:25.802634 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Sep 08 10:37:25.802634 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:37:25.802634 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:37:25.802634 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:37:25.802634 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:37:25.802634 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:37:25.802634 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:37:25.802634 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:37:25.802634 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:37:25.802634 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcXhAmPhcOK6u0HmEhS0jek03Yd1INPGisdODd2cCuYCALEgUx0XK3sff1xAzxgdcIuSqmbTZPPFRXTKgKIQMEAy6DI5VO8m2JiwH3OnddUuMuWqEJYk3MHLTuFyz4xN7wyHUC3cK5s8UQfpqbjcvunPYaKNEurpg7q4Rf2sMkTQQf0 Sep 08 10:37:25.802634 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:37:25.802634 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:37:25.802634 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:37:25.802634 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:37:25.802634 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:37:25.802634 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:37:25.802634 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 82aa06f9c28b4ddaade8def470bec53d Sep 08 10:37:25.802634 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1614554825 Sep 08 10:37:25.802634 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:37:25.802634 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:37:25.804185 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/82aa06f9c28b4ddaade8def470bec53d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/82aa06f9c28b4ddaade8def470bec53d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_82aa06f9c28b4ddaade8def470bec53d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/82aa06f9c28b4ddaade8def470bec53d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:37:25.804185 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1614554825 Sep 08 10:37:25.804185 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 82aa06f9c28b4ddaade8def470bec53d Sep 08 10:37:25.804185 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1614554825 Sep 08 10:37:25.804185 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1614554825-project Sep 08 10:37:25.804185 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:37:25.804185 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:37:25.804185 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: faa00d910b354aac954278342843339a Sep 08 10:37:25.804185 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1614554825-project Sep 08 10:37:25.804185 n-d-850501-12 devstack@n-api.service[128861]: method: Sep 08 10:37:25.804185 n-d-850501-12 devstack@n-api.service[128861]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Sep 08 10:37:25.804185 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '1'} Sep 08 10:37:25.805107 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:37:25.805107 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:25.805107 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:25.805107 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:25.805107 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:37:25.805107 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:37:25.805107 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:37:25.805107 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:37:25.805107 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:37:25.805107 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:37:25.805107 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Sep 08 10:37:25.805107 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Sep 08 10:37:25.805107 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 10:37:25.805107 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 10:37:25.805107 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 10:37:25.805107 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 10:37:25.805107 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:37:25.805107 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:37:25.805107 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:37:25.806286 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:37:25.806286 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 10:37:25.806286 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 10:37:25.806286 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 10:37:25.806286 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 10:37:25.806286 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 10:37:25.806286 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 10:37:25.806286 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Sep 08 10:37:25.806286 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:25.806286 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:25.806286 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:25.806286 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:25.806286 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:25.806286 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:25.806286 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 10:37:25.806286 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 10:37:25.806286 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Sep 08 10:37:25.806286 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:25.813808 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-37b7b87e-2f7a-4a2c-a1d1-ad4e5cf18a51 tempest-HypervisorAdminNegativeUnderV252Test-1614554825 tempest-HypervisorAdminNegativeUnderV252Test-1614554825-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:37:25.816586 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e8b82904-43b9-4904-a44a-af0fedc27995 tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 227 microversion: 2.1 time: 0.296104 Sep 08 10:37:25.819896 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-37b7b87e-2f7a-4a2c-a1d1-ad4e5cf18a51 tempest-HypervisorAdminNegativeUnderV252Test-1614554825 tempest-HypervisorAdminNegativeUnderV252Test-1614554825-project] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.038714 Sep 08 10:37:25.822795 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 117/239] 10.222.0.27 () {58 vars in 1176 bytes} [Thu Sep 8 10:37:25 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 44 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:37:25.823107 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 123/240] 10.222.0.27 () {60 vars in 1191 bytes} [Thu Sep 8 10:37:25 2022] POST /compute/v2.1/os-aggregates/9/action => generated 227 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:37:25.833812 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2fa5b30c-6083-49a7-b953-a10a597211ab tempest-HostsAdminNegativeTestJSON-1037938327 tempest-HostsAdminNegativeTestJSON-1037938327-project-admin] Calling method '.version_select at 0x7f68e52a3e50>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:25.836967 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d7b07b9c-7a8e-481a-a992-82b7b0d339d4 tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:25.866343 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-2fa5b30c-6083-49a7-b953-a10a597211ab tempest-HostsAdminNegativeTestJSON-1037938327 tempest-HostsAdminNegativeTestJSON-1037938327-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 08 10:37:25.868234 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2fa5b30c-6083-49a7-b953-a10a597211ab tempest-HostsAdminNegativeTestJSON-1037938327 tempest-HostsAdminNegativeTestJSON-1037938327-project-admin] Request method failure captured: Sep 08 10:37:25.868234 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Sep 08 10:37:25.868234 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:37:25.868234 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:37:25.868234 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:37:25.868234 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:37:25.868234 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:37:25.868234 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:37:25.868234 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:37:25.868234 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:37:25.868234 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcXjwFmWcKQle5UWMD3j3sp8mzXApGCH35L1xgJ9IaobXfxY0nr0VOml2H9Eob8jnLfMjbOjMdWuV-ZYrnAZavu1OyabPhCuDeJxLppKrNKJt2a1bM7D8GTNshg6rtl4_htr7eB92VZlMVKreuuiTcUpz0oxzta7_u9xjL9Jiy22-a8 Sep 08 10:37:25.868234 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:37:25.868234 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:37:25.868234 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:37:25.868234 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:37:25.868234 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:37:25.868234 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:37:25.868234 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 922b734bfd4f42f5a7cb9b60ef9fbd9b Sep 08 10:37:25.868234 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1037938327 Sep 08 10:37:25.868234 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,admin,member Sep 08 10:37:25.868234 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,admin,member Sep 08 10:37:25.869631 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/922b734bfd4f42f5a7cb9b60ef9fbd9b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/922b734bfd4f42f5a7cb9b60ef9fbd9b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_922b734bfd4f42f5a7cb9b60ef9fbd9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/922b734bfd4f42f5a7cb9b60ef9fbd9b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:37:25.869631 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1037938327 Sep 08 10:37:25.869631 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 922b734bfd4f42f5a7cb9b60ef9fbd9b Sep 08 10:37:25.869631 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1037938327 Sep 08 10:37:25.869631 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-HostsAdminNegativeTestJSON-1037938327-project-admin Sep 08 10:37:25.869631 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:37:25.869631 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:37:25.869631 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 254752a88f7442ad9d3ecbd01185f906 Sep 08 10:37:25.869631 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1037938327-project-admin Sep 08 10:37:25.869631 n-d-850501-12 devstack@n-api.service[128861]: method: Sep 08 10:37:25.869631 n-d-850501-12 devstack@n-api.service[128861]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 08 10:37:25.869631 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': 'nonexistent_hostname'} Sep 08 10:37:25.869631 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:37:25.870409 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:25.870409 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Sep 08 10:37:25.870409 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Sep 08 10:37:25.870409 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 08 10:37:25.870409 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 08 10:37:25.870409 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:37:25.870409 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:37:25.870409 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:37:25.870409 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:37:25.870409 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 08 10:37:25.870409 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 08 10:37:25.870409 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 08 10:37:25.870409 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 08 10:37:25.870409 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 10:37:25.870409 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 10:37:25.870409 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 08 10:37:25.870409 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 08 10:37:25.870409 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 08 10:37:25.870409 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 08 10:37:25.871444 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 08 10:37:25.871444 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 08 10:37:25.871444 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 08 10:37:25.871444 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:25.871444 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:25.871444 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:25.871444 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:25.871444 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:25.871444 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:25.871444 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:37:25.871444 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:37:25.871444 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:37:25.871444 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:37:25.871444 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:37:25.871444 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:37:25.871444 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Sep 08 10:37:25.871444 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Sep 08 10:37:25.871444 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Sep 08 10:37:25.871444 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:37:25.875155 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 08 10:37:25.875155 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:25.875155 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:25.875155 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:25.875155 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:25.875155 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:25.875155 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:25.875155 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:37:25.875155 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:37:25.875155 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 08 10:37:25.875155 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:25.875155 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2fa5b30c-6083-49a7-b953-a10a597211ab tempest-HostsAdminNegativeTestJSON-1037938327 tempest-HostsAdminNegativeTestJSON-1037938327-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:37:25.875155 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2fa5b30c-6083-49a7-b953-a10a597211ab tempest-HostsAdminNegativeTestJSON-1037938327 tempest-HostsAdminNegativeTestJSON-1037938327-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.045264 Sep 08 10:37:25.875155 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 118/241] 10.222.0.27 () {58 vars in 1215 bytes} [Thu Sep 8 10:37:25 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:37:25.891471 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-db9eee89-420b-4699-94d7-9e77b1ad92eb tempest-HypervisorAdminNegativeUnderV252Test-1675952754 tempest-HypervisorAdminNegativeUnderV252Test-1675952754-project-admin] Calling method '.version_select at 0x7f68e520a0d0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:25.894035 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-db9eee89-420b-4699-94d7-9e77b1ad92eb tempest-HypervisorAdminNegativeUnderV252Test-1675952754 tempest-HypervisorAdminNegativeUnderV252Test-1675952754-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:25.894674 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-db9eee89-420b-4699-94d7-9e77b1ad92eb tempest-HypervisorAdminNegativeUnderV252Test-1675952754 tempest-HypervisorAdminNegativeUnderV252Test-1675952754-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:25.894925 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-db9eee89-420b-4699-94d7-9e77b1ad92eb tempest-HypervisorAdminNegativeUnderV252Test-1675952754 tempest-HypervisorAdminNegativeUnderV252Test-1675952754-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:25.907100 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d7b07b9c-7a8e-481a-a992-82b7b0d339d4 tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.082200 Sep 08 10:37:25.907358 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-db9eee89-420b-4699-94d7-9e77b1ad92eb tempest-HypervisorAdminNegativeUnderV252Test-1675952754 tempest-HypervisorAdminNegativeUnderV252Test-1675952754-project-admin] HTTP exception thrown: No hypervisor matching '632dd493-a26c-4cc4-b569-00e4e40d6a44' could be found. Sep 08 10:37:25.907782 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 124/242] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Sep 8 10:37:25 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Sep 08 10:37:25.912551 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2e12c758-8ed4-4b70-bcab-30fc0e054c46 tempest-HostsAdminNegativeTestJSON-1037938327 tempest-HostsAdminNegativeTestJSON-1037938327-project-admin] Action: 'update', calling method: .version_select at 0x7f68e5114280>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:25.915284 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-db9eee89-420b-4699-94d7-9e77b1ad92eb tempest-HypervisorAdminNegativeUnderV252Test-1675952754 tempest-HypervisorAdminNegativeUnderV252Test-1675952754-project-admin] Request method failure captured: Sep 08 10:37:25.915284 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/os-hypervisors/632dd493-a26c-4cc4-b569-00e4e40d6a44/servers HTTP/1.1 Sep 08 10:37:25.915284 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:37:25.915284 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:37:25.915284 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:37:25.915284 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:37:25.915284 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:37:25.915284 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:37:25.915284 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:37:25.915284 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:37:25.915284 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcXjwFA2CzTU9Fy3KcImw5H73BvRsBVPzFMqpZxghz3vBL_e_9msOKIz6oYbGxTuae-TDMbR2bMZld231QSCpLlR7ngKoFchaIon5BteAtI3X9jQDaQ1qmYiKeJCCuzVEs2OqEGi3cS-zGTaHHiQqKZJSz_Dyim1rhbHze0DoBeiZ9M Sep 08 10:37:25.915284 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:37:25.915284 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:37:25.915284 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:37:25.915284 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:37:25.915284 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:37:25.915284 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:37:25.915284 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 8e1231aacc024e3c892b59b19cddf0ea Sep 08 10:37:25.915284 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1675952754 Sep 08 10:37:25.915284 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,admin,member Sep 08 10:37:25.915284 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,admin,member Sep 08 10:37:25.916562 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8e1231aacc024e3c892b59b19cddf0ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8e1231aacc024e3c892b59b19cddf0ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8e1231aacc024e3c892b59b19cddf0ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8e1231aacc024e3c892b59b19cddf0ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:37:25.916562 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1675952754 Sep 08 10:37:25.916562 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 8e1231aacc024e3c892b59b19cddf0ea Sep 08 10:37:25.916562 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1675952754 Sep 08 10:37:25.916562 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1675952754-project-admin Sep 08 10:37:25.916562 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:37:25.916562 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:37:25.916562 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 2730b00405e44a009a158a37337087ee Sep 08 10:37:25.916562 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1675952754-project-admin Sep 08 10:37:25.916562 n-d-850501-12 devstack@n-api.service[128861]: method: Sep 08 10:37:25.916562 n-d-850501-12 devstack@n-api.service[128861]: exception: No hypervisor matching '632dd493-a26c-4cc4-b569-00e4e40d6a44' could be found. Sep 08 10:37:25.916562 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '632dd493-a26c-4cc4-b569-00e4e40d6a44'} Sep 08 10:37:25.917271 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:37:25.917271 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:25.917271 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:25.917271 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:25.917271 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:37:25.917271 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:37:25.917271 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:37:25.917271 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:37:25.917271 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:37:25.917271 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:37:25.917271 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Sep 08 10:37:25.917271 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Sep 08 10:37:25.917271 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Sep 08 10:37:25.917271 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 08 10:37:25.917271 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '632dd493-a26c-4cc4-b569-00e4e40d6a44' could be found. Sep 08 10:37:25.917271 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:25.917271 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:25.917271 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:25.917271 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:25.923280 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:25.923280 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:25.923280 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:37:25.923280 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:37:25.923280 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '632dd493-a26c-4cc4-b569-00e4e40d6a44' could be found. Sep 08 10:37:25.923280 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:25.923280 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-db9eee89-420b-4699-94d7-9e77b1ad92eb tempest-HypervisorAdminNegativeUnderV252Test-1675952754 tempest-HypervisorAdminNegativeUnderV252Test-1675952754-project-admin] Returning 404 to user: No hypervisor matching '632dd493-a26c-4cc4-b569-00e4e40d6a44' could be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:37:25.923280 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-db9eee89-420b-4699-94d7-9e77b1ad92eb tempest-HypervisorAdminNegativeUnderV252Test-1675952754 tempest-HypervisorAdminNegativeUnderV252Test-1675952754-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/632dd493-a26c-4cc4-b569-00e4e40d6a44/servers" status: 404 len: 123 microversion: 2.1 time: 0.041422 Sep 08 10:37:25.923280 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 119/243] 10.222.0.27 () {58 vars in 1281 bytes} [Thu Sep 8 10:37:25 2022] GET /compute/v2.1/os-hypervisors/632dd493-a26c-4cc4-b569-00e4e40d6a44/servers => generated 123 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:37:25.933005 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-66bf6c36-fe54-4bcf-b8ca-f2855288de46 tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-778338573"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:25.937215 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2e12c758-8ed4-4b70-bcab-30fc0e054c46 tempest-HostsAdminNegativeTestJSON-1037938327 tempest-HostsAdminNegativeTestJSON-1037938327-project-admin] Request method failure captured: Sep 08 10:37:25.937215 n-d-850501-12 devstack@n-api.service[128862]: request: PUT /compute/v2.1/os-hosts/n-d-850501-12 HTTP/1.1 Sep 08 10:37:25.937215 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:37:25.937215 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:37:25.937215 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:37:25.937215 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 51 Sep 08 10:37:25.937215 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:37:25.937215 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:37:25.937215 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:37:25.937215 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:37:25.937215 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcXjwFmWcKQle5UWMD3j3sp8mzXApGCH35L1xgJ9IaobXfxY0nr0VOml2H9Eob8jnLfMjbOjMdWuV-ZYrnAZavu1OyabPhCuDeJxLppKrNKJt2a1bM7D8GTNshg6rtl4_htr7eB92VZlMVKreuuiTcUpz0oxzta7_u9xjL9Jiy22-a8 Sep 08 10:37:25.937215 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:37:25.937215 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:37:25.937215 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:37:25.937215 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:37:25.937215 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:37:25.937215 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:37:25.937215 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 922b734bfd4f42f5a7cb9b60ef9fbd9b Sep 08 10:37:25.937215 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1037938327 Sep 08 10:37:25.937215 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,admin,member Sep 08 10:37:25.937215 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,admin,member Sep 08 10:37:25.938486 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/922b734bfd4f42f5a7cb9b60ef9fbd9b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/922b734bfd4f42f5a7cb9b60ef9fbd9b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_922b734bfd4f42f5a7cb9b60ef9fbd9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/922b734bfd4f42f5a7cb9b60ef9fbd9b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:37:25.938486 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1037938327 Sep 08 10:37:25.938486 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 922b734bfd4f42f5a7cb9b60ef9fbd9b Sep 08 10:37:25.938486 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1037938327 Sep 08 10:37:25.938486 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-HostsAdminNegativeTestJSON-1037938327-project-admin Sep 08 10:37:25.938486 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:37:25.938486 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:37:25.938486 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 254752a88f7442ad9d3ecbd01185f906 Sep 08 10:37:25.938486 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1037938327-project-admin Sep 08 10:37:25.938486 n-d-850501-12 devstack@n-api.service[128862]: Sep 08 10:37:25.938486 n-d-850501-12 devstack@n-api.service[128862]: {"status": "enable", "maintenance_mode": "invalid"} Sep 08 10:37:25.938486 n-d-850501-12 devstack@n-api.service[128862]: method: Sep 08 10:37:25.938486 n-d-850501-12 devstack@n-api.service[128862]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 08 10:37:25.939209 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'n-d-850501-12', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Sep 08 10:37:25.939209 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:37:25.939209 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:25.939209 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 10:37:25.939209 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 10:37:25.939209 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 10:37:25.939209 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise error Sep 08 10:37:25.939209 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 08 10:37:25.939209 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:25.939209 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Sep 08 10:37:25.939209 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Sep 08 10:37:25.939209 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'disable', Sep 08 10:37:25.939209 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'Enable', Sep 08 10:37:25.939209 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'Disable', Sep 08 10:37:25.939209 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'ENABLE', Sep 08 10:37:25.939209 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'DISABLE'], Sep 08 10:37:25.939209 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 08 10:37:25.939209 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:25.939209 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi On instance: Sep 08 10:37:25.939209 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'invalid' Sep 08 10:37:25.939209 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:25.939209 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:25.939209 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:25.939209 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:25.939209 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:25.941965 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:25.941965 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:37:25.941965 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:37:25.941965 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:37:25.941965 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:37:25.941965 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:37:25.941965 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:37:25.941965 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 10:37:25.941965 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 10:37:25.941965 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 10:37:25.941965 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 10:37:25.941965 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 10:37:25.941965 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 10:37:25.941965 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 08 10:37:25.941965 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:25.941965 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:25.941965 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:25.941965 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:25.941965 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:25.944133 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:25.944133 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 10:37:25.944133 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 10:37:25.944133 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 08 10:37:25.944133 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:25.944133 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2e12c758-8ed4-4b70-bcab-30fc0e054c46 tempest-HostsAdminNegativeTestJSON-1037938327 tempest-HostsAdminNegativeTestJSON-1037938327-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:37:25.944133 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2e12c758-8ed4-4b70-bcab-30fc0e054c46 tempest-HostsAdminNegativeTestJSON-1037938327 tempest-HostsAdminNegativeTestJSON-1037938327-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-hosts/n-d-850501-12" status: 400 len: 199 microversion: 2.1 time: 0.029859 Sep 08 10:37:25.946634 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 125/244] 10.222.0.27 () {60 vars in 1190 bytes} [Thu Sep 8 10:37:25 2022] PUT /compute/v2.1/os-hosts/n-d-850501-12 => generated 199 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:37:25.953561 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.aggregate [None req-66bf6c36-fe54-4bcf-b8ca-f2855288de46 tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Generated uuid aa70f7ad-78a2-43b9-9664-3b2b8f8bb3a2 for aggregate {{(pid=128861) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 08 10:37:25.965566 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ff6d9071-0284-4b73-9690-8e8a4c7a9726 tempest-HostsAdminNegativeTestJSON-1037938327 tempest-HostsAdminNegativeTestJSON-1037938327-project-admin] Action: 'update', calling method: .version_select at 0x7f68e51fc9d0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:25.974186 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=1,nova_api:DELETE=4,nova_api:UPDATE=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:37:25.981813 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ff6d9071-0284-4b73-9690-8e8a4c7a9726 tempest-HostsAdminNegativeTestJSON-1037938327 tempest-HostsAdminNegativeTestJSON-1037938327-project-admin] Request method failure captured: Sep 08 10:37:25.981813 n-d-850501-12 devstack@n-api.service[128862]: request: PUT /compute/v2.1/os-hosts/n-d-850501-12 HTTP/1.1 Sep 08 10:37:25.981813 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:37:25.981813 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:37:25.981813 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:37:25.981813 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 51 Sep 08 10:37:25.981813 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:37:25.981813 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:37:25.981813 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:37:25.981813 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:37:25.981813 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcXjwFmWcKQle5UWMD3j3sp8mzXApGCH35L1xgJ9IaobXfxY0nr0VOml2H9Eob8jnLfMjbOjMdWuV-ZYrnAZavu1OyabPhCuDeJxLppKrNKJt2a1bM7D8GTNshg6rtl4_htr7eB92VZlMVKreuuiTcUpz0oxzta7_u9xjL9Jiy22-a8 Sep 08 10:37:25.981813 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:37:25.981813 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:37:25.981813 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:37:25.981813 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:37:25.981813 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:37:25.981813 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:37:25.981813 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 922b734bfd4f42f5a7cb9b60ef9fbd9b Sep 08 10:37:25.981813 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1037938327 Sep 08 10:37:25.981813 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,admin,member Sep 08 10:37:25.981813 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,admin,member Sep 08 10:37:25.983349 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/922b734bfd4f42f5a7cb9b60ef9fbd9b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/922b734bfd4f42f5a7cb9b60ef9fbd9b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_922b734bfd4f42f5a7cb9b60ef9fbd9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/922b734bfd4f42f5a7cb9b60ef9fbd9b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:37:25.983349 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1037938327 Sep 08 10:37:25.983349 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 922b734bfd4f42f5a7cb9b60ef9fbd9b Sep 08 10:37:25.983349 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1037938327 Sep 08 10:37:25.983349 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-HostsAdminNegativeTestJSON-1037938327-project-admin Sep 08 10:37:25.983349 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:37:25.983349 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:37:25.983349 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 254752a88f7442ad9d3ecbd01185f906 Sep 08 10:37:25.983349 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1037938327-project-admin Sep 08 10:37:25.983349 n-d-850501-12 devstack@n-api.service[128862]: Sep 08 10:37:25.983349 n-d-850501-12 devstack@n-api.service[128862]: {"status": "invalid", "maintenance_mode": "enable"} Sep 08 10:37:25.983349 n-d-850501-12 devstack@n-api.service[128862]: method: Sep 08 10:37:25.983349 n-d-850501-12 devstack@n-api.service[128862]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 08 10:37:25.984227 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'n-d-850501-12', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Sep 08 10:37:25.984227 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:37:25.984227 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:25.984227 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 10:37:25.984227 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 10:37:25.984227 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 10:37:25.984227 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise error Sep 08 10:37:25.984227 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 08 10:37:25.984227 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:25.984227 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Sep 08 10:37:25.984227 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Sep 08 10:37:25.984227 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'disable', Sep 08 10:37:25.984227 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'Enable', Sep 08 10:37:25.984227 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'Disable', Sep 08 10:37:25.984227 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'ENABLE', Sep 08 10:37:25.984227 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'DISABLE'], Sep 08 10:37:25.984227 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 08 10:37:25.984227 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:25.984227 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi On instance: Sep 08 10:37:25.984227 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'invalid' Sep 08 10:37:25.984227 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:25.984227 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:25.984227 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:25.984227 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:25.984227 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:25.988701 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:25.988701 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:37:25.988701 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:37:25.988701 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:37:25.988701 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:37:25.988701 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:37:25.988701 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:37:25.988701 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 10:37:25.988701 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 10:37:25.988701 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 10:37:25.988701 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 10:37:25.988701 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 10:37:25.988701 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 10:37:25.988701 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 08 10:37:25.988701 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:25.988701 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:25.988701 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:25.988701 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:25.988701 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:25.991248 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:25.991248 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 10:37:25.991248 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 10:37:25.991248 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 08 10:37:25.991248 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:25.991248 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ff6d9071-0284-4b73-9690-8e8a4c7a9726 tempest-HostsAdminNegativeTestJSON-1037938327 tempest-HostsAdminNegativeTestJSON-1037938327-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:37:25.993933 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ff6d9071-0284-4b73-9690-8e8a4c7a9726 tempest-HostsAdminNegativeTestJSON-1037938327 tempest-HostsAdminNegativeTestJSON-1037938327-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-hosts/n-d-850501-12" status: 400 len: 189 microversion: 2.1 time: 0.039010 Sep 08 10:37:25.999832 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 126/245] 10.222.0.27 () {60 vars in 1190 bytes} [Thu Sep 8 10:37:25 2022] PUT /compute/v2.1/os-hosts/n-d-850501-12 => generated 189 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:37:26.027012 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8ffb6cbe-4a49-4e40-826b-599df52020be tempest-HostsAdminNegativeTestJSON-1630574095 tempest-HostsAdminNegativeTestJSON-1630574095-project] Action: 'update', calling method: .version_select at 0x7f68e51ed430>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:26.028450 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-66bf6c36-fe54-4bcf-b8ca-f2855288de46 tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.109268 Sep 08 10:37:26.034210 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 120/246] 10.222.0.27 () {60 vars in 1164 bytes} [Thu Sep 8 10:37:25 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:37:26.038079 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8ffb6cbe-4a49-4e40-826b-599df52020be tempest-HostsAdminNegativeTestJSON-1630574095 tempest-HostsAdminNegativeTestJSON-1630574095-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '7fcc388060c4480ca2dc6b3e43653c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b7f2de96c34165a296d79961c0079f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:26.045047 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8ffb6cbe-4a49-4e40-826b-599df52020be tempest-HostsAdminNegativeTestJSON-1630574095 tempest-HostsAdminNegativeTestJSON-1630574095-project] Request method failure captured: Sep 08 10:37:26.045047 n-d-850501-12 devstack@n-api.service[128862]: request: PUT /compute/v2.1/os-hosts/n-d-850501-12 HTTP/1.1 Sep 08 10:37:26.045047 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:37:26.045047 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:37:26.045047 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:37:26.045047 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 50 Sep 08 10:37:26.045047 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:37:26.045047 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:37:26.045047 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:37:26.045047 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:37:26.045047 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcXg9R_X3BZDMnQVc5RAldmfboT6cRMPvT9ozrOMqdouNhNWNBlu6lE6pzRH3jdiQ1W-_dqL_KC_qWW2q_Ojhcf0rtyB7bBrKoXQrVGr55biK3ge-r4xlBrPsBgagexdSVJYCupMu9Fa9-6cca1vZCsYtnCHmiVKirGUQ4ryb0TwS3I Sep 08 10:37:26.045047 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:37:26.045047 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:37:26.045047 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:37:26.045047 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:37:26.045047 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:37:26.045047 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:37:26.045047 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 77b7f2de96c34165a296d79961c0079f Sep 08 10:37:26.045047 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1630574095 Sep 08 10:37:26.045047 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:37:26.045047 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:37:26.046432 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/77b7f2de96c34165a296d79961c0079f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/77b7f2de96c34165a296d79961c0079f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_77b7f2de96c34165a296d79961c0079f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/77b7f2de96c34165a296d79961c0079f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:37:26.046432 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1630574095 Sep 08 10:37:26.046432 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 77b7f2de96c34165a296d79961c0079f Sep 08 10:37:26.046432 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1630574095 Sep 08 10:37:26.046432 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-HostsAdminNegativeTestJSON-1630574095-project Sep 08 10:37:26.046432 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:37:26.046432 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:37:26.046432 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 7fcc388060c4480ca2dc6b3e43653c5f Sep 08 10:37:26.046432 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1630574095-project Sep 08 10:37:26.046432 n-d-850501-12 devstack@n-api.service[128862]: Sep 08 10:37:26.046432 n-d-850501-12 devstack@n-api.service[128862]: {"status": "enable", "maintenance_mode": "enable"} Sep 08 10:37:26.046432 n-d-850501-12 devstack@n-api.service[128862]: method: Sep 08 10:37:26.046432 n-d-850501-12 devstack@n-api.service[128862]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Sep 08 10:37:26.046432 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'n-d-850501-12', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Sep 08 10:37:26.047216 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:37:26.047216 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:26.047216 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:26.047216 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:26.047216 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:37:26.047216 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:37:26.047216 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:37:26.047216 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:37:26.047216 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:37:26.047216 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:37:26.047216 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:37:26.047216 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:37:26.047216 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Sep 08 10:37:26.047216 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Sep 08 10:37:26.047216 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 10:37:26.047216 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 10:37:26.047216 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 10:37:26.047216 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 10:37:26.047216 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:37:26.047216 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:37:26.048299 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:37:26.048299 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:37:26.048299 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 10:37:26.048299 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 10:37:26.048299 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 10:37:26.048299 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 10:37:26.048299 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 10:37:26.048299 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 10:37:26.048299 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Sep 08 10:37:26.048299 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:26.048299 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:26.048299 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:26.048299 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:26.048299 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:26.048299 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:26.048299 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 10:37:26.048299 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 10:37:26.048299 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Sep 08 10:37:26.048299 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:26.053140 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8ffb6cbe-4a49-4e40-826b-599df52020be tempest-HostsAdminNegativeTestJSON-1630574095 tempest-HostsAdminNegativeTestJSON-1630574095-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:37:26.053140 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8ffb6cbe-4a49-4e40-826b-599df52020be tempest-HostsAdminNegativeTestJSON-1630574095 tempest-HostsAdminNegativeTestJSON-1630574095-project] 10.222.0.27 "PUT /compute/v2.1/os-hosts/n-d-850501-12" status: 403 len: 111 microversion: 2.1 time: 0.034637 Sep 08 10:37:26.053140 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 127/247] 10.222.0.27 () {60 vars in 1190 bytes} [Thu Sep 8 10:37:26 2022] PUT /compute/v2.1/os-hosts/n-d-850501-12 => generated 111 bytes in 36 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:37:26.060753 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f49e9145-d95b-4068-b5e9-648eab1fa650 tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-850501-12"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:26.067890 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9805fd88-5240-4800-8642-19f66a7d7aa8 tempest-HostsAdminNegativeTestJSON-1037938327 tempest-HostsAdminNegativeTestJSON-1037938327-project-admin] Action: 'update', calling method: .version_select at 0x7f68e5062820>, body: {"status": null, "maintenance_mode": null} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:26.071931 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9805fd88-5240-4800-8642-19f66a7d7aa8 tempest-HostsAdminNegativeTestJSON-1037938327 tempest-HostsAdminNegativeTestJSON-1037938327-project-admin] Request method failure captured: Sep 08 10:37:26.071931 n-d-850501-12 devstack@n-api.service[128862]: request: PUT /compute/v2.1/os-hosts/n-d-850501-12 HTTP/1.1 Sep 08 10:37:26.071931 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:37:26.071931 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:37:26.071931 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:37:26.071931 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 42 Sep 08 10:37:26.071931 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:37:26.071931 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:37:26.071931 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:37:26.071931 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:37:26.071931 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcXjwFmWcKQle5UWMD3j3sp8mzXApGCH35L1xgJ9IaobXfxY0nr0VOml2H9Eob8jnLfMjbOjMdWuV-ZYrnAZavu1OyabPhCuDeJxLppKrNKJt2a1bM7D8GTNshg6rtl4_htr7eB92VZlMVKreuuiTcUpz0oxzta7_u9xjL9Jiy22-a8 Sep 08 10:37:26.071931 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:37:26.071931 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:37:26.071931 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:37:26.071931 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:37:26.071931 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:37:26.071931 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:37:26.071931 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 922b734bfd4f42f5a7cb9b60ef9fbd9b Sep 08 10:37:26.071931 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1037938327 Sep 08 10:37:26.071931 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,admin,member Sep 08 10:37:26.071931 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,admin,member Sep 08 10:37:26.073214 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/922b734bfd4f42f5a7cb9b60ef9fbd9b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/922b734bfd4f42f5a7cb9b60ef9fbd9b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_922b734bfd4f42f5a7cb9b60ef9fbd9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/922b734bfd4f42f5a7cb9b60ef9fbd9b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:37:26.073214 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1037938327 Sep 08 10:37:26.073214 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 922b734bfd4f42f5a7cb9b60ef9fbd9b Sep 08 10:37:26.073214 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1037938327 Sep 08 10:37:26.073214 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-HostsAdminNegativeTestJSON-1037938327-project-admin Sep 08 10:37:26.073214 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:37:26.073214 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:37:26.073214 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 254752a88f7442ad9d3ecbd01185f906 Sep 08 10:37:26.073214 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1037938327-project-admin Sep 08 10:37:26.073214 n-d-850501-12 devstack@n-api.service[128862]: Sep 08 10:37:26.073214 n-d-850501-12 devstack@n-api.service[128862]: {"status": null, "maintenance_mode": null} Sep 08 10:37:26.073214 n-d-850501-12 devstack@n-api.service[128862]: method: Sep 08 10:37:26.073214 n-d-850501-12 devstack@n-api.service[128862]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Sep 08 10:37:26.073214 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'n-d-850501-12', 'body': {'status': None, 'maintenance_mode': None}} Sep 08 10:37:26.073988 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:37:26.073988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:26.073988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 10:37:26.073988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 10:37:26.073988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 10:37:26.073988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise error Sep 08 10:37:26.073988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Sep 08 10:37:26.073988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:26.073988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Sep 08 10:37:26.073988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Sep 08 10:37:26.073988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'disable', Sep 08 10:37:26.073988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'Enable', Sep 08 10:37:26.073988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'Disable', Sep 08 10:37:26.073988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'ENABLE', Sep 08 10:37:26.073988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'DISABLE'], Sep 08 10:37:26.073988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 08 10:37:26.073988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:26.073988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi On instance: Sep 08 10:37:26.073988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi None Sep 08 10:37:26.073988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:26.073988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:26.073988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:26.073988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:26.073988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:26.073988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:26.075350 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:37:26.075350 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:37:26.075350 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:37:26.075350 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:37:26.075350 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:37:26.075350 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:37:26.075350 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 10:37:26.075350 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 10:37:26.075350 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 10:37:26.075350 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 10:37:26.075350 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 10:37:26.075350 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 10:37:26.075350 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Sep 08 10:37:26.075350 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:26.075350 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:26.075350 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:26.075350 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:26.075350 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:26.075350 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:26.076418 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 10:37:26.076418 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 10:37:26.076418 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Sep 08 10:37:26.076418 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:26.076418 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9805fd88-5240-4800-8642-19f66a7d7aa8 tempest-HostsAdminNegativeTestJSON-1037938327 tempest-HostsAdminNegativeTestJSON-1037938327-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:37:26.076418 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9805fd88-5240-4800-8642-19f66a7d7aa8 tempest-HostsAdminNegativeTestJSON-1037938327 tempest-HostsAdminNegativeTestJSON-1037938327-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-hosts/n-d-850501-12" status: 400 len: 127 microversion: 2.1 time: 0.018015 Sep 08 10:37:26.076418 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 128/248] 10.222.0.27 () {60 vars in 1190 bytes} [Thu Sep 8 10:37:26 2022] PUT /compute/v2.1/os-hosts/n-d-850501-12 => generated 127 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 08 10:37:26.089199 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e6d64329-b8b5-4eaf-a03e-0819fe64344c tempest-HostsAdminNegativeTestJSON-1037938327 tempest-HostsAdminNegativeTestJSON-1037938327-project-admin] Action: 'update', calling method: .version_select at 0x7f68e5066a60>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:26.097486 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.hosts [None req-e6d64329-b8b5-4eaf-a03e-0819fe64344c tempest-HostsAdminNegativeTestJSON-1037938327 tempest-HostsAdminNegativeTestJSON-1037938327-project-admin] Enabling host nonexistent_hostname. Sep 08 10:37:26.100146 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f49e9145-d95b-4068-b5e9-648eab1fa650 tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:26.100653 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f49e9145-d95b-4068-b5e9-648eab1fa650 tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:26.101108 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f49e9145-d95b-4068-b5e9-648eab1fa650 tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:26.112976 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-e6d64329-b8b5-4eaf-a03e-0819fe64344c tempest-HostsAdminNegativeTestJSON-1037938327 tempest-HostsAdminNegativeTestJSON-1037938327-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 08 10:37:26.115826 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e6d64329-b8b5-4eaf-a03e-0819fe64344c tempest-HostsAdminNegativeTestJSON-1037938327 tempest-HostsAdminNegativeTestJSON-1037938327-project-admin] Request method failure captured: Sep 08 10:37:26.115826 n-d-850501-12 devstack@n-api.service[128862]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Sep 08 10:37:26.115826 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:37:26.115826 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:37:26.115826 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:37:26.115826 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 50 Sep 08 10:37:26.115826 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:37:26.115826 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:37:26.115826 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:37:26.115826 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:37:26.115826 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcXjwFmWcKQle5UWMD3j3sp8mzXApGCH35L1xgJ9IaobXfxY0nr0VOml2H9Eob8jnLfMjbOjMdWuV-ZYrnAZavu1OyabPhCuDeJxLppKrNKJt2a1bM7D8GTNshg6rtl4_htr7eB92VZlMVKreuuiTcUpz0oxzta7_u9xjL9Jiy22-a8 Sep 08 10:37:26.115826 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:37:26.115826 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:37:26.115826 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:37:26.115826 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:37:26.115826 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:37:26.115826 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:37:26.115826 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 922b734bfd4f42f5a7cb9b60ef9fbd9b Sep 08 10:37:26.115826 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1037938327 Sep 08 10:37:26.115826 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,admin,member Sep 08 10:37:26.115826 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,admin,member Sep 08 10:37:26.117078 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/922b734bfd4f42f5a7cb9b60ef9fbd9b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/922b734bfd4f42f5a7cb9b60ef9fbd9b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_922b734bfd4f42f5a7cb9b60ef9fbd9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/922b734bfd4f42f5a7cb9b60ef9fbd9b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:37:26.117078 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1037938327 Sep 08 10:37:26.117078 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 922b734bfd4f42f5a7cb9b60ef9fbd9b Sep 08 10:37:26.117078 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1037938327 Sep 08 10:37:26.117078 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-HostsAdminNegativeTestJSON-1037938327-project-admin Sep 08 10:37:26.117078 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:37:26.117078 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:37:26.117078 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 254752a88f7442ad9d3ecbd01185f906 Sep 08 10:37:26.117078 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1037938327-project-admin Sep 08 10:37:26.117078 n-d-850501-12 devstack@n-api.service[128862]: Sep 08 10:37:26.117078 n-d-850501-12 devstack@n-api.service[128862]: {"status": "enable", "maintenance_mode": "enable"} Sep 08 10:37:26.117078 n-d-850501-12 devstack@n-api.service[128862]: method: Sep 08 10:37:26.117078 n-d-850501-12 devstack@n-api.service[128862]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 08 10:37:26.117078 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Sep 08 10:37:26.117884 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:37:26.117884 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:26.117884 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Sep 08 10:37:26.117884 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Sep 08 10:37:26.117884 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 08 10:37:26.117884 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 08 10:37:26.117884 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:37:26.117884 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:37:26.117884 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:37:26.117884 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:37:26.117884 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 08 10:37:26.117884 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 08 10:37:26.117884 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 08 10:37:26.117884 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 08 10:37:26.117884 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 10:37:26.117884 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 10:37:26.117884 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 08 10:37:26.117884 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 08 10:37:26.119080 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 08 10:37:26.119080 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 08 10:37:26.119080 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 08 10:37:26.119080 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 08 10:37:26.119080 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 08 10:37:26.119080 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:26.119080 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:26.119080 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:26.119080 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:26.119080 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:26.119080 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:26.119080 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:37:26.119080 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:37:26.119080 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:37:26.119080 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:37:26.119080 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:37:26.119080 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:37:26.119080 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:37:26.119080 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:37:26.119080 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Sep 08 10:37:26.120260 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Sep 08 10:37:26.120260 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Sep 08 10:37:26.120260 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:37:26.120260 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 08 10:37:26.120260 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:26.120260 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:26.120260 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:26.120260 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:26.120260 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:26.120260 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:26.120260 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:37:26.120260 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:37:26.120260 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 08 10:37:26.120260 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:26.120260 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e6d64329-b8b5-4eaf-a03e-0819fe64344c tempest-HostsAdminNegativeTestJSON-1037938327 tempest-HostsAdminNegativeTestJSON-1037938327-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:37:26.121091 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e6d64329-b8b5-4eaf-a03e-0819fe64344c tempest-HostsAdminNegativeTestJSON-1037938327 tempest-HostsAdminNegativeTestJSON-1037938327-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.036472 Sep 08 10:37:26.121091 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 129/249] 10.222.0.27 () {60 vars in 1211 bytes} [Thu Sep 8 10:37:26 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 08 10:37:26.376015 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f49e9145-d95b-4068-b5e9-648eab1fa650 tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 243 microversion: 2.1 time: 0.332105 Sep 08 10:37:26.376637 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 121/250] 10.222.0.27 () {60 vars in 1194 bytes} [Thu Sep 8 10:37:26 2022] POST /compute/v2.1/os-aggregates/10/action => generated 243 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:37:26.390153 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5648bddd-9037-4dfe-84ff-8a3623cda3b6 tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:26.414123 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5648bddd-9037-4dfe-84ff-8a3623cda3b6 tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.1 time: 0.029616 Sep 08 10:37:26.417416 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 122/251] 10.222.0.27 () {58 vars in 1143 bytes} [Thu Sep 8 10:37:26 2022] GET /compute/v2.1/os-aggregates => generated 246 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:37:26.441777 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4a190d53-c25f-460b-bb98-6656ac02d467 tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-850501-12"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:26.474435 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a190d53-c25f-460b-bb98-6656ac02d467 tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:26.475106 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a190d53-c25f-460b-bb98-6656ac02d467 tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:26.475546 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a190d53-c25f-460b-bb98-6656ac02d467 tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:26.676901 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4a190d53-c25f-460b-bb98-6656ac02d467 tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 227 microversion: 2.1 time: 0.250080 Sep 08 10:37:26.679466 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 123/252] 10.222.0.27 () {60 vars in 1194 bytes} [Thu Sep 8 10:37:26 2022] POST /compute/v2.1/os-aggregates/10/action => generated 227 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:37:26.684155 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d5213544-f72f-4047-9c3c-e1eebd7837a2 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:26.685810 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d5213544-f72f-4047-9c3c-e1eebd7837a2 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] [instance: 0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:26.699790 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d5213544-f72f-4047-9c3c-e1eebd7837a2 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:26.700284 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d5213544-f72f-4047-9c3c-e1eebd7837a2 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:26.700724 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d5213544-f72f-4047-9c3c-e1eebd7837a2 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:26.702178 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d5213544-f72f-4047-9c3c-e1eebd7837a2 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:26.702178 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d5213544-f72f-4047-9c3c-e1eebd7837a2 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:26.703295 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d5213544-f72f-4047-9c3c-e1eebd7837a2 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:26.793057 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d5213544-f72f-4047-9c3c-e1eebd7837a2 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdbe35f311e435ba9e0516f302ba519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb116f8d7dd4858a91c03e0a4310fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:26.802906 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d5213544-f72f-4047-9c3c-e1eebd7837a2 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] 10.222.0.27 "GET /compute/v2.1/servers/0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc" status: 200 len: 1278 microversion: 2.1 time: 0.122245 Sep 08 10:37:26.804160 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 124/253] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:26 2022] GET /compute/v2.1/servers/0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc => generated 1278 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:26.809903 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b3811f6f-cc7a-45f4-ba10-795e817157cd tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:26.856843 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b3811f6f-cc7a-45f4-ba10-795e817157cd tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.051299 Sep 08 10:37:26.862038 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 125/254] 10.222.0.27 () {58 vars in 1155 bytes} [Thu Sep 8 10:37:26 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 08 10:37:26.870790 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9e80acd6-9576-4ab3-9f45-91fef3f3eb1b tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-234043026"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:26.875875 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.aggregate [None req-9e80acd6-9576-4ab3-9f45-91fef3f3eb1b tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Generated uuid b10cc8f8-937e-4d57-ae79-95abaf0ded87 for aggregate {{(pid=128861) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 08 10:37:26.880990 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0a953ae6-5a66-4aa9-8624-23d01ae09263 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1999433985", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "cebc319d-cd30-49da-85de-4414687896b3"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:26.903689 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9e80acd6-9576-4ab3-9f45-91fef3f3eb1b tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.037973 Sep 08 10:37:26.905427 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 126/255] 10.222.0.27 () {60 vars in 1164 bytes} [Thu Sep 8 10:37:26 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:37:26.926487 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f9b23c60-8032-4512-b1ef-3b06b68f25c4 tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-850501-12"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:26.951805 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f9b23c60-8032-4512-b1ef-3b06b68f25c4 tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:26.953728 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f9b23c60-8032-4512-b1ef-3b06b68f25c4 tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:26.956221 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f9b23c60-8032-4512-b1ef-3b06b68f25c4 tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:26.996250 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-0a953ae6-5a66-4aa9-8624-23d01ae09263 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] validate_networks() for [('cebc319d-cd30-49da-85de-4414687896b3', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:37:27.213246 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f9b23c60-8032-4512-b1ef-3b06b68f25c4 tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 243 microversion: 2.1 time: 0.298953 Sep 08 10:37:27.221960 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 127/256] 10.222.0.27 () {60 vars in 1194 bytes} [Thu Sep 8 10:37:26 2022] POST /compute/v2.1/os-aggregates/11/action => generated 243 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:37:27.229252 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-933c3711-1f8f-4d26-be4c-726dfa2f3b2b tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-850501-12"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:27.260987 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-933c3711-1f8f-4d26-be4c-726dfa2f3b2b tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:27.262983 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-933c3711-1f8f-4d26-be4c-726dfa2f3b2b tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:27.263444 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-933c3711-1f8f-4d26-be4c-726dfa2f3b2b tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:27.523797 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-933c3711-1f8f-4d26-be4c-726dfa2f3b2b tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 227 microversion: 2.1 time: 0.300646 Sep 08 10:37:27.525424 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 128/257] 10.222.0.27 () {60 vars in 1194 bytes} [Thu Sep 8 10:37:27 2022] POST /compute/v2.1/os-aggregates/11/action => generated 227 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:37:27.540408 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-db21d94e-e3c9-4c78-9f19-54130c5b0a11 tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:27.605154 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-db21d94e-e3c9-4c78-9f19-54130c5b0a11 tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.072278 Sep 08 10:37:27.606222 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 129/258] 10.222.0.27 () {58 vars in 1155 bytes} [Thu Sep 8 10:37:27 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Sep 08 10:37:27.618895 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cbc1ecfe-2865-4186-874d-54d1e0b92ebe tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-819054017"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:27.626162 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.aggregate [None req-cbc1ecfe-2865-4186-874d-54d1e0b92ebe tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Generated uuid d6f1ad90-369c-4071-95e6-4dc4ab473854 for aggregate {{(pid=128861) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 08 10:37:27.677122 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cbc1ecfe-2865-4186-874d-54d1e0b92ebe tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.064104 Sep 08 10:37:27.678458 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 130/259] 10.222.0.27 () {60 vars in 1164 bytes} [Thu Sep 8 10:37:27 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:37:27.687498 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e3e312d3-5d47-433b-9952-c90d53619d4a tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-902995719"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:27.710952 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.aggregate [None req-e3e312d3-5d47-433b-9952-c90d53619d4a tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Generated uuid fc2bec66-6ff3-423c-8dfe-4a8f825e0d3c for aggregate {{(pid=128861) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 08 10:37:27.762383 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e3e312d3-5d47-433b-9952-c90d53619d4a tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.081807 Sep 08 10:37:27.769385 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 131/260] 10.222.0.27 () {60 vars in 1164 bytes} [Thu Sep 8 10:37:27 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:37:27.781081 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d76b77e8-43e0-491c-9bcf-f6c209f54c62 tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:27.831531 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d76b77e8-43e0-491c-9bcf-f6c209f54c62 tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.064791 Sep 08 10:37:27.835751 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 132/261] 10.222.0.27 () {58 vars in 1155 bytes} [Thu Sep 8 10:37:27 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 08 10:37:27.852864 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-864fc432-6366-4009-bc04-d7b909478b91 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-850501-12"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:27.879640 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-864fc432-6366-4009-bc04-d7b909478b91 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:27.880968 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-864fc432-6366-4009-bc04-d7b909478b91 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:27.882087 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-864fc432-6366-4009-bc04-d7b909478b91 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:28.143378 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-864fc432-6366-4009-bc04-d7b909478b91 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 243 microversion: 2.1 time: 0.305244 Sep 08 10:37:28.144946 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 133/262] 10.222.0.27 () {60 vars in 1194 bytes} [Thu Sep 8 10:37:27 2022] POST /compute/v2.1/os-aggregates/13/action => generated 243 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:37:28.168613 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ba97db89-b344-4147-af3a-86809c7d6460 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:28.176565 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ba97db89-b344-4147-af3a-86809c7d6460 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] [instance: 0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:28.187229 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ba97db89-b344-4147-af3a-86809c7d6460 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:28.187229 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ba97db89-b344-4147-af3a-86809c7d6460 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:28.187538 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ba97db89-b344-4147-af3a-86809c7d6460 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:28.188266 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ba97db89-b344-4147-af3a-86809c7d6460 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:28.191909 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ba97db89-b344-4147-af3a-86809c7d6460 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:28.192377 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ba97db89-b344-4147-af3a-86809c7d6460 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:28.546218 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ba97db89-b344-4147-af3a-86809c7d6460 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdbe35f311e435ba9e0516f302ba519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb116f8d7dd4858a91c03e0a4310fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:28.557502 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ba97db89-b344-4147-af3a-86809c7d6460 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] 10.222.0.27 "GET /compute/v2.1/servers/0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc" status: 200 len: 1320 microversion: 2.1 time: 0.411124 Sep 08 10:37:28.576891 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 134/263] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:28 2022] GET /compute/v2.1/servers/0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc => generated 1320 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:28.588097 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1f4c5db7-5063-4535-b8d2-4275823062b2 tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:28.613976 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-1f4c5db7-5063-4535-b8d2-4275823062b2 tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Sep 08 10:37:28.623048 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1f4c5db7-5063-4535-b8d2-4275823062b2 tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Request method failure captured: Sep 08 10:37:28.623048 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/os-aggregates/12 HTTP/1.1 Sep 08 10:37:28.623048 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:37:28.623048 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:37:28.623048 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:37:28.623048 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:37:28.623048 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:37:28.623048 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:37:28.623048 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:37:28.623048 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:37:28.623048 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcW5mXc-dMSxWM9fSi3B26sHSo_4HtLqxHGwZ03SJJK-TJt44npJSwqATa_vGI4i9wQ9EYMx3auewB8kIkZnBVLDkYdOvhtlcb5KG6pn_jpdSDgIpuny-aJ4veIjdVitT3nyzscWlIvGnSYm61JnvqGp1UjjjBBZR-8rVi6s1WaiD3U Sep 08 10:37:28.623048 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:37:28.623048 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:37:28.623048 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:37:28.623048 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:37:28.623048 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:37:28.623048 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:37:28.623048 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 3f4ed9a5ac6649dabef253eebb2eac18 Sep 08 10:37:28.623048 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-AggregatesAdminTestJSON-1617984150 Sep 08 10:37:28.623048 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,admin,member Sep 08 10:37:28.623048 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,admin,member Sep 08 10:37:28.624478 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3f4ed9a5ac6649dabef253eebb2eac18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3f4ed9a5ac6649dabef253eebb2eac18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3f4ed9a5ac6649dabef253eebb2eac18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3f4ed9a5ac6649dabef253eebb2eac18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:37:28.624478 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-AggregatesAdminTestJSON-1617984150 Sep 08 10:37:28.624478 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 3f4ed9a5ac6649dabef253eebb2eac18 Sep 08 10:37:28.624478 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1617984150 Sep 08 10:37:28.624478 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-AggregatesAdminTestJSON-1617984150-project-admin Sep 08 10:37:28.624478 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:37:28.624478 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:37:28.624478 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: c4f90d0055d148d09b67c4683e917b65 Sep 08 10:37:28.624478 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-AggregatesAdminTestJSON-1617984150-project-admin Sep 08 10:37:28.624478 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:37:28.624478 n-d-850501-12 devstack@n-api.service[128861]: exception: Aggregate 12 could not be found. Sep 08 10:37:28.624478 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '12'} Sep 08 10:37:28.624478 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:37:28.625385 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:28.625385 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Sep 08 10:37:28.625385 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Sep 08 10:37:28.625385 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Sep 08 10:37:28.625385 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Sep 08 10:37:28.625385 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 10:37:28.625385 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 10:37:28.625385 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 08 10:37:28.625385 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 08 10:37:28.625385 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 08 10:37:28.625385 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 08 10:37:28.625385 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 08 10:37:28.625385 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 08 10:37:28.625385 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Sep 08 10:37:28.625385 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:28.625385 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:28.625385 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:28.625385 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:28.625385 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:28.626617 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:28.626617 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:37:28.626617 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:37:28.626617 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:37:28.626617 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:37:28.626617 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Sep 08 10:37:28.626617 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:37:28.626617 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Sep 08 10:37:28.626617 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:28.626617 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:28.626617 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:28.626617 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:28.626617 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:28.626617 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:28.626617 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:37:28.626617 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:37:28.626617 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Sep 08 10:37:28.626617 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:28.628407 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1f4c5db7-5063-4535-b8d2-4275823062b2 tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:37:28.630789 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1f4c5db7-5063-4535-b8d2-4275823062b2 tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.053948 Sep 08 10:37:28.635007 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 135/264] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Sep 8 10:37:28 2022] GET /compute/v2.1/os-aggregates/12 => generated 78 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:37:28.649305 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4bcf6af5-a357-4200-a403-77d72605433c tempest-AggregatesAdminNegativeTestJSON-1094852279 tempest-AggregatesAdminNegativeTestJSON-1094852279-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-850501-12"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:28.663655 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4bcf6af5-a357-4200-a403-77d72605433c tempest-AggregatesAdminNegativeTestJSON-1094852279 tempest-AggregatesAdminNegativeTestJSON-1094852279-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': 'b09ae3666ab54662a1177d5a4846e0ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eef52c589914f27b0461b81fa603192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:28.669977 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4bcf6af5-a357-4200-a403-77d72605433c tempest-AggregatesAdminNegativeTestJSON-1094852279 tempest-AggregatesAdminNegativeTestJSON-1094852279-project] Request method failure captured: Sep 08 10:37:28.669977 n-d-850501-12 devstack@n-api.service[128861]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Sep 08 10:37:28.669977 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:37:28.669977 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:37:28.669977 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:37:28.669977 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 43 Sep 08 10:37:28.669977 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:37:28.669977 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:37:28.669977 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:37:28.669977 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:37:28.669977 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcW2psWwH7qgDl5lB5Ns76DLKNYvqg7qV-R6a3j9SQpX6EhtX6sw7woCEBqo7bmYSR5iTwts_TgOPw5RjYQ_ZzjFpf3An69FmlwlZAB4ayhquw0iHJJ4djJf3BA4gUaMZYhyrFm1sM5LcV5OF6c0_cuBThWiJTf496Np_YojZjq5pbQ Sep 08 10:37:28.669977 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:37:28.669977 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:37:28.669977 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:37:28.669977 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:37:28.669977 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:37:28.669977 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:37:28.669977 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 5eef52c589914f27b0461b81fa603192 Sep 08 10:37:28.669977 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1094852279 Sep 08 10:37:28.669977 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:37:28.669977 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:37:28.671262 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5eef52c589914f27b0461b81fa603192"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5eef52c589914f27b0461b81fa603192"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5eef52c589914f27b0461b81fa603192"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5eef52c589914f27b0461b81fa603192"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:37:28.671262 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1094852279 Sep 08 10:37:28.671262 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 5eef52c589914f27b0461b81fa603192 Sep 08 10:37:28.671262 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1094852279 Sep 08 10:37:28.671262 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-AggregatesAdminNegativeTestJSON-1094852279-project Sep 08 10:37:28.671262 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:37:28.671262 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:37:28.671262 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: b09ae3666ab54662a1177d5a4846e0ca Sep 08 10:37:28.671262 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1094852279-project Sep 08 10:37:28.671262 n-d-850501-12 devstack@n-api.service[128861]: Sep 08 10:37:28.671262 n-d-850501-12 devstack@n-api.service[128861]: {"remove_host": {"host": "n-h1-850501-12"}} Sep 08 10:37:28.671262 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:37:28.671262 n-d-850501-12 devstack@n-api.service[128861]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Sep 08 10:37:28.672011 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '13', 'body': {'remove_host': {'host': 'n-h1-850501-12'}}} Sep 08 10:37:28.672011 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:37:28.672011 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:28.672011 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:28.672011 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:28.672011 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:37:28.672011 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:37:28.672011 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:37:28.672011 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:37:28.672011 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:37:28.672011 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:37:28.672011 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Sep 08 10:37:28.672011 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Sep 08 10:37:28.672011 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 10:37:28.672011 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 10:37:28.672011 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 10:37:28.672011 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 10:37:28.672011 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:37:28.672011 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:37:28.677797 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:37:28.677797 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:37:28.677797 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 10:37:28.677797 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 10:37:28.677797 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 10:37:28.677797 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 10:37:28.677797 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 10:37:28.677797 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 10:37:28.677797 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Sep 08 10:37:28.677797 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:28.677797 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:28.677797 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:28.677797 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:28.677797 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:28.677797 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:28.677797 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 10:37:28.677797 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 10:37:28.677797 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Sep 08 10:37:28.677797 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:28.679762 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4bcf6af5-a357-4200-a403-77d72605433c tempest-AggregatesAdminNegativeTestJSON-1094852279 tempest-AggregatesAdminNegativeTestJSON-1094852279-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:37:28.679762 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4bcf6af5-a357-4200-a403-77d72605433c tempest-AggregatesAdminNegativeTestJSON-1094852279 tempest-AggregatesAdminNegativeTestJSON-1094852279-project] 10.222.0.27 "POST /compute/v2.1/os-aggregates/13/action" status: 403 len: 121 microversion: 2.1 time: 0.037317 Sep 08 10:37:28.679762 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 136/265] 10.222.0.27 () {60 vars in 1194 bytes} [Thu Sep 8 10:37:28 2022] POST /compute/v2.1/os-aggregates/13/action => generated 121 bytes in 43 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:37:28.697497 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-def26fe3-6ef5-4c52-b7a6-2872761aefbb tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:28.735432 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-def26fe3-6ef5-4c52-b7a6-2872761aefbb tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Sep 08 10:37:28.741638 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-def26fe3-6ef5-4c52-b7a6-2872761aefbb tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Request method failure captured: Sep 08 10:37:28.741638 n-d-850501-12 devstack@n-api.service[128861]: request: DELETE /compute/v2.1/os-aggregates/12 HTTP/1.1 Sep 08 10:37:28.741638 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:37:28.741638 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:37:28.741638 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:37:28.741638 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:37:28.741638 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:37:28.741638 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:37:28.741638 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:37:28.741638 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:37:28.741638 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcW5mXc-dMSxWM9fSi3B26sHSo_4HtLqxHGwZ03SJJK-TJt44npJSwqATa_vGI4i9wQ9EYMx3auewB8kIkZnBVLDkYdOvhtlcb5KG6pn_jpdSDgIpuny-aJ4veIjdVitT3nyzscWlIvGnSYm61JnvqGp1UjjjBBZR-8rVi6s1WaiD3U Sep 08 10:37:28.741638 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:37:28.741638 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:37:28.741638 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:37:28.741638 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:37:28.741638 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:37:28.741638 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:37:28.741638 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 3f4ed9a5ac6649dabef253eebb2eac18 Sep 08 10:37:28.741638 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-AggregatesAdminTestJSON-1617984150 Sep 08 10:37:28.741638 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,admin,member Sep 08 10:37:28.741638 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,admin,member Sep 08 10:37:28.743234 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3f4ed9a5ac6649dabef253eebb2eac18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3f4ed9a5ac6649dabef253eebb2eac18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3f4ed9a5ac6649dabef253eebb2eac18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3f4ed9a5ac6649dabef253eebb2eac18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:37:28.743234 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-AggregatesAdminTestJSON-1617984150 Sep 08 10:37:28.743234 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 3f4ed9a5ac6649dabef253eebb2eac18 Sep 08 10:37:28.743234 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1617984150 Sep 08 10:37:28.743234 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-AggregatesAdminTestJSON-1617984150-project-admin Sep 08 10:37:28.743234 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:37:28.743234 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:37:28.743234 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: c4f90d0055d148d09b67c4683e917b65 Sep 08 10:37:28.743234 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-AggregatesAdminTestJSON-1617984150-project-admin Sep 08 10:37:28.743234 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:37:28.743234 n-d-850501-12 devstack@n-api.service[128861]: exception: Aggregate 12 could not be found. Sep 08 10:37:28.743234 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '12'} Sep 08 10:37:28.743234 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:37:28.743978 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:28.743978 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Sep 08 10:37:28.743978 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Sep 08 10:37:28.743978 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 08 10:37:28.743978 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 08 10:37:28.743978 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:37:28.743978 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:37:28.743978 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:37:28.743978 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:37:28.743978 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 08 10:37:28.743978 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 08 10:37:28.743978 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Sep 08 10:37:28.743978 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Sep 08 10:37:28.743978 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 10:37:28.743978 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 10:37:28.743978 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 08 10:37:28.743978 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 08 10:37:28.743978 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 08 10:37:28.743978 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 08 10:37:28.745015 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 08 10:37:28.745015 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 08 10:37:28.745015 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Sep 08 10:37:28.745015 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:28.745015 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:28.745015 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:28.745015 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:28.745015 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:28.745015 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:28.745015 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:37:28.745015 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:37:28.745015 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:37:28.745015 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:37:28.745015 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Sep 08 10:37:28.745015 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:37:28.745015 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Sep 08 10:37:28.745015 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:28.745015 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:28.745015 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:28.745015 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:28.745015 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:28.746840 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:28.746840 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:37:28.746840 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:37:28.746840 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Sep 08 10:37:28.746840 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:28.746840 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-def26fe3-6ef5-4c52-b7a6-2872761aefbb tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:37:28.746840 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-def26fe3-6ef5-4c52-b7a6-2872761aefbb tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.062109 Sep 08 10:37:28.750435 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 137/266] 10.222.0.27 () {58 vars in 1155 bytes} [Thu Sep 8 10:37:28 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 78 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:37:28.761457 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ce06a168-e99e-464e-9987-1c865ccaae37 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-850501-12"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:28.793468 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ce06a168-e99e-464e-9987-1c865ccaae37 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:28.793983 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ce06a168-e99e-464e-9987-1c865ccaae37 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:28.794480 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ce06a168-e99e-464e-9987-1c865ccaae37 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:28.995858 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-0a953ae6-5a66-4aa9-8624-23d01ae09263 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:37:28.998695 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-0a953ae6-5a66-4aa9-8624-23d01ae09263 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:37:28.999380 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-0a953ae6-5a66-4aa9-8624-23d01ae09263 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:37:28.999975 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-0a953ae6-5a66-4aa9-8624-23d01ae09263 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:37:29.000540 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-0a953ae6-5a66-4aa9-8624-23d01ae09263 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:37:29.011767 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0a953ae6-5a66-4aa9-8624-23d01ae09263 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:29.013181 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0a953ae6-5a66-4aa9-8624-23d01ae09263 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:29.013793 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0a953ae6-5a66-4aa9-8624-23d01ae09263 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:29.014706 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0a953ae6-5a66-4aa9-8624-23d01ae09263 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:29.015319 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0a953ae6-5a66-4aa9-8624-23d01ae09263 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:29.016210 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0a953ae6-5a66-4aa9-8624-23d01ae09263 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:29.045578 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-0a953ae6-5a66-4aa9-8624-23d01ae09263 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Getting quotas for project 57d64134da60477da24b7fde4e1b9680. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:37:29.052788 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-0a953ae6-5a66-4aa9-8624-23d01ae09263 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Getting quotas for user 27456dd9f49540b09f2e8addd1045a94 and project 57d64134da60477da24b7fde4e1b9680. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:37:29.072527 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0a953ae6-5a66-4aa9-8624-23d01ae09263 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:37:29.078055 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0a953ae6-5a66-4aa9-8624-23d01ae09263 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 292d240e-1176-4875-8f87-9ca911437fbe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:37:29.095459 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ce06a168-e99e-464e-9987-1c865ccaae37 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 227 microversion: 2.1 time: 0.343672 Sep 08 10:37:29.098856 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 138/267] 10.222.0.27 () {60 vars in 1194 bytes} [Thu Sep 8 10:37:28 2022] POST /compute/v2.1/os-aggregates/13/action => generated 227 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:37:29.116596 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c785e630-4789-4ea3-a7b4-50190938cead tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1057622670", "name": "tempest-test_aggregate-629435147"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:29.178248 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.aggregate [None req-c785e630-4789-4ea3-a7b4-50190938cead tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Generated uuid 0b24698d-e40c-46ba-9e65-65303fde58b0 for aggregate {{(pid=128861) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 08 10:37:29.182103 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0a953ae6-5a66-4aa9-8624-23d01ae09263 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 3.038753 Sep 08 10:37:29.183364 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 130/268] 10.222.0.27 () {62 vars in 1188 bytes} [Thu Sep 8 10:37:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 3041 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 08 10:37:29.195286 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-700652f0-cdee-4455-b598-5e0e99d77d5f tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:29.264632 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-700652f0-cdee-4455-b598-5e0e99d77d5f tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.079914 Sep 08 10:37:29.267242 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 131/269] 10.222.0.27 () {58 vars in 1155 bytes} [Thu Sep 8 10:37:29 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 08 10:37:29.285938 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b0756ee1-16cd-4960-aba1-44b9dde2c6cf tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:29.293923 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b0756ee1-16cd-4960-aba1-44b9dde2c6cf tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 292d240e-1176-4875-8f87-9ca911437fbe] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:29.310317 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c785e630-4789-4ea3-a7b4-50190938cead tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.206527 Sep 08 10:37:29.312949 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 139/270] 10.222.0.27 () {60 vars in 1165 bytes} [Thu Sep 8 10:37:29 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:37:29.328198 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ef95f0af-09de-449e-a856-200d55eee497 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-455292974"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:29.339276 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.aggregate [None req-ef95f0af-09de-449e-a856-200d55eee497 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Generated uuid 841ada3f-eee0-4e41-955c-41e05c43bbae for aggregate {{(pid=128861) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 08 10:37:29.400320 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ef95f0af-09de-449e-a856-200d55eee497 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.080101 Sep 08 10:37:29.415945 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 140/271] 10.222.0.27 () {60 vars in 1164 bytes} [Thu Sep 8 10:37:29 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:37:29.432639 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0e42ff3d-158a-455a-b110-d0aa79431592 tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:29.446216 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=10,nova_api:DELETE=9 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:37:29.500353 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0e42ff3d-158a-455a-b110-d0aa79431592 tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.083183 Sep 08 10:37:29.504056 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 141/272] 10.222.0.27 () {58 vars in 1155 bytes} [Thu Sep 8 10:37:29 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 08 10:37:29.515678 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f162746e-8906-4825-8a7a-6c196a3b3c14 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:29.549364 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b0756ee1-16cd-4960-aba1-44b9dde2c6cf tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:29.549937 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f162746e-8906-4825-8a7a-6c196a3b3c14 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:29.551093 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f162746e-8906-4825-8a7a-6c196a3b3c14 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:29.553451 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f162746e-8906-4825-8a7a-6c196a3b3c14 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:29.559845 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b0756ee1-16cd-4960-aba1-44b9dde2c6cf tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:29.572319 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b0756ee1-16cd-4960-aba1-44b9dde2c6cf tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:29.574798 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b0756ee1-16cd-4960-aba1-44b9dde2c6cf tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/292d240e-1176-4875-8f87-9ca911437fbe" status: 200 len: 1262 microversion: 2.25 time: 0.304837 Sep 08 10:37:29.577818 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 132/273] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:37:29 2022] GET /compute/v2.1/servers/292d240e-1176-4875-8f87-9ca911437fbe => generated 1262 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:37:29.594211 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f162746e-8906-4825-8a7a-6c196a3b3c14 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:29.596821 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-62fa4d04-fbf3-4517-8610-c8326d17bf23 tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:29.598492 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f162746e-8906-4825-8a7a-6c196a3b3c14 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:29.602270 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f162746e-8906-4825-8a7a-6c196a3b3c14 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:29.627519 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-62fa4d04-fbf3-4517-8610-c8326d17bf23 tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Sep 08 10:37:29.636404 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-62fa4d04-fbf3-4517-8610-c8326d17bf23 tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Request method failure captured: Sep 08 10:37:29.636404 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/os-aggregates/14 HTTP/1.1 Sep 08 10:37:29.636404 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:37:29.636404 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:37:29.636404 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:37:29.636404 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:37:29.636404 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:37:29.636404 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:37:29.636404 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:37:29.636404 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:37:29.636404 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcW5mXc-dMSxWM9fSi3B26sHSo_4HtLqxHGwZ03SJJK-TJt44npJSwqATa_vGI4i9wQ9EYMx3auewB8kIkZnBVLDkYdOvhtlcb5KG6pn_jpdSDgIpuny-aJ4veIjdVitT3nyzscWlIvGnSYm61JnvqGp1UjjjBBZR-8rVi6s1WaiD3U Sep 08 10:37:29.636404 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:37:29.636404 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:37:29.636404 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:37:29.636404 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:37:29.636404 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:37:29.636404 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:37:29.636404 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 3f4ed9a5ac6649dabef253eebb2eac18 Sep 08 10:37:29.636404 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-AggregatesAdminTestJSON-1617984150 Sep 08 10:37:29.636404 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,admin,member Sep 08 10:37:29.636404 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,admin,member Sep 08 10:37:29.637812 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3f4ed9a5ac6649dabef253eebb2eac18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3f4ed9a5ac6649dabef253eebb2eac18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3f4ed9a5ac6649dabef253eebb2eac18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3f4ed9a5ac6649dabef253eebb2eac18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:37:29.637812 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-AggregatesAdminTestJSON-1617984150 Sep 08 10:37:29.637812 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 3f4ed9a5ac6649dabef253eebb2eac18 Sep 08 10:37:29.637812 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1617984150 Sep 08 10:37:29.637812 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-AggregatesAdminTestJSON-1617984150-project-admin Sep 08 10:37:29.637812 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:37:29.637812 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:37:29.637812 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: c4f90d0055d148d09b67c4683e917b65 Sep 08 10:37:29.637812 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-AggregatesAdminTestJSON-1617984150-project-admin Sep 08 10:37:29.637812 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:37:29.637812 n-d-850501-12 devstack@n-api.service[128862]: exception: Aggregate 14 could not be found. Sep 08 10:37:29.637812 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '14'} Sep 08 10:37:29.637812 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:37:29.638988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:29.638988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Sep 08 10:37:29.638988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Sep 08 10:37:29.638988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Sep 08 10:37:29.638988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Sep 08 10:37:29.638988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 10:37:29.638988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 10:37:29.638988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 08 10:37:29.638988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 08 10:37:29.638988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 08 10:37:29.638988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 08 10:37:29.638988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 08 10:37:29.638988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 08 10:37:29.638988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Sep 08 10:37:29.638988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:29.638988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:29.638988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:29.638988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:29.638988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:29.641322 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:29.641322 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:37:29.641322 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:37:29.641322 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:37:29.641322 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:37:29.641322 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Sep 08 10:37:29.641322 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:37:29.641322 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Sep 08 10:37:29.641322 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:29.641322 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:29.641322 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:29.641322 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:29.641322 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:29.641322 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:29.641322 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:37:29.641322 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:37:29.641322 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Sep 08 10:37:29.641322 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:29.649607 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-62fa4d04-fbf3-4517-8610-c8326d17bf23 tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:37:29.650970 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-62fa4d04-fbf3-4517-8610-c8326d17bf23 tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.072045 Sep 08 10:37:29.652099 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 133/274] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Sep 8 10:37:29 2022] GET /compute/v2.1/os-aggregates/14 => generated 78 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:37:29.660915 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ffb0f43e-5f63-4791-80a6-6f6bda19bce8 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:29.662486 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ffb0f43e-5f63-4791-80a6-6f6bda19bce8 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] [instance: 0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:29.663040 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.compute.aggregates [None req-f162746e-8906-4825-8a7a-6c196a3b3c14 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Failed to remove host nonexist_host from aggregate 15. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Sep 08 10:37:29.666579 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-f162746e-8906-4825-8a7a-6c196a3b3c14 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 15 Sep 08 10:37:29.672989 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ffb0f43e-5f63-4791-80a6-6f6bda19bce8 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:29.674342 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ffb0f43e-5f63-4791-80a6-6f6bda19bce8 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:29.674784 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f162746e-8906-4825-8a7a-6c196a3b3c14 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Request method failure captured: Sep 08 10:37:29.674784 n-d-850501-12 devstack@n-api.service[128861]: request: POST /compute/v2.1/os-aggregates/15/action HTTP/1.1 Sep 08 10:37:29.674784 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:37:29.674784 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:37:29.674784 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:37:29.674784 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 42 Sep 08 10:37:29.674784 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:37:29.674784 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:37:29.674784 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:37:29.674784 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:37:29.674784 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcW42jKNF2wJ6tUgDr7GFhj8bDGclBm0y_GYAQnVvDAMYJ1jDUbUnOvdDZSin9luvRPOB6TjofqglWozsQ0mxm4M6iQFvXQru9-G8m76lXYiOi9vSC3hj03Cl53AEeaywrmiyKWkTCr0fuRfryKOtrDuR7P_LtA1MCxYImmijauXgZk Sep 08 10:37:29.674784 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:37:29.674784 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:37:29.674784 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:37:29.674784 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:37:29.674784 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:37:29.674784 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:37:29.674784 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 874e026251854684a06d3fd636701d17 Sep 08 10:37:29.674784 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1714194550 Sep 08 10:37:29.674784 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,admin,member Sep 08 10:37:29.674784 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,admin,member Sep 08 10:37:29.676225 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/874e026251854684a06d3fd636701d17"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/874e026251854684a06d3fd636701d17"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_874e026251854684a06d3fd636701d17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/874e026251854684a06d3fd636701d17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:37:29.676225 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1714194550 Sep 08 10:37:29.676225 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 874e026251854684a06d3fd636701d17 Sep 08 10:37:29.676225 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1714194550 Sep 08 10:37:29.676225 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin Sep 08 10:37:29.676225 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:37:29.676225 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:37:29.676225 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 55fc120859bb42faa1ba5cea5894d548 Sep 08 10:37:29.676225 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin Sep 08 10:37:29.676225 n-d-850501-12 devstack@n-api.service[128861]: Sep 08 10:37:29.676225 n-d-850501-12 devstack@n-api.service[128861]: {"remove_host": {"host": "nonexist_host"}} Sep 08 10:37:29.676225 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:37:29.676225 n-d-850501-12 devstack@n-api.service[128861]: exception: Cannot remove host nonexist_host in aggregate 15 Sep 08 10:37:29.677003 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '15', 'body': {'remove_host': {'host': 'nonexist_host'}}} Sep 08 10:37:29.677003 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:37:29.677003 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:29.677003 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Sep 08 10:37:29.677003 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Sep 08 10:37:29.677003 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 10:37:29.677003 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 10:37:29.677003 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 08 10:37:29.677003 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 08 10:37:29.677003 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 08 10:37:29.677003 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 08 10:37:29.677003 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 08 10:37:29.677003 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 08 10:37:29.677003 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Sep 08 10:37:29.677003 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:29.677003 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:29.677003 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:29.677003 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:29.677003 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Sep 08 10:37:29.677003 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Sep 08 10:37:29.678646 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 08 10:37:29.678646 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 08 10:37:29.678646 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 08 10:37:29.678646 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:29.678646 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:29.678646 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:29.678646 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:29.678646 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Sep 08 10:37:29.678646 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Sep 08 10:37:29.678646 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 08 10:37:29.678646 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 08 10:37:29.678646 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:37:29.678646 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:37:29.678646 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:37:29.678646 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:37:29.678646 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 08 10:37:29.678646 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 08 10:37:29.678646 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Sep 08 10:37:29.678646 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Sep 08 10:37:29.678646 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Sep 08 10:37:29.680378 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Sep 08 10:37:29.680378 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Sep 08 10:37:29.680378 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:29.680378 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:29.680378 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:29.680378 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:29.680378 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:29.680378 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:29.680378 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:37:29.680378 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:37:29.680378 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:37:29.680378 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:37:29.680378 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:37:29.680378 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:37:29.680378 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Sep 08 10:37:29.680378 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 08 10:37:29.680378 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 15 Sep 08 10:37:29.680378 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:29.680378 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:29.680378 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:29.680378 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:29.684599 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:29.684599 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:29.684599 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:37:29.684599 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:37:29.684599 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 15 Sep 08 10:37:29.684599 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:29.684599 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f162746e-8906-4825-8a7a-6c196a3b3c14 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 15 {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:37:29.689194 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f162746e-8906-4825-8a7a-6c196a3b3c14 tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/15/action" status: 404 len: 94 microversion: 2.1 time: 0.171458 Sep 08 10:37:29.689194 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 142/275] 10.222.0.27 () {60 vars in 1194 bytes} [Thu Sep 8 10:37:29 2022] POST /compute/v2.1/os-aggregates/15/action => generated 94 bytes in 182 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:37:29.691029 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ffb0f43e-5f63-4791-80a6-6f6bda19bce8 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:29.691029 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ffb0f43e-5f63-4791-80a6-6f6bda19bce8 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:29.692433 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ffb0f43e-5f63-4791-80a6-6f6bda19bce8 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:29.693227 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ffb0f43e-5f63-4791-80a6-6f6bda19bce8 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:29.711329 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b5634534-ce1f-4b23-ab4e-0ce9e3c3e59e tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:29.773076 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-b5634534-ce1f-4b23-ab4e-0ce9e3c3e59e tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Sep 08 10:37:29.781687 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b5634534-ce1f-4b23-ab4e-0ce9e3c3e59e tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Request method failure captured: Sep 08 10:37:29.781687 n-d-850501-12 devstack@n-api.service[128861]: request: DELETE /compute/v2.1/os-aggregates/14 HTTP/1.1 Sep 08 10:37:29.781687 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:37:29.781687 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:37:29.781687 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:37:29.781687 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:37:29.781687 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:37:29.781687 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:37:29.781687 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:37:29.781687 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:37:29.781687 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcW5mXc-dMSxWM9fSi3B26sHSo_4HtLqxHGwZ03SJJK-TJt44npJSwqATa_vGI4i9wQ9EYMx3auewB8kIkZnBVLDkYdOvhtlcb5KG6pn_jpdSDgIpuny-aJ4veIjdVitT3nyzscWlIvGnSYm61JnvqGp1UjjjBBZR-8rVi6s1WaiD3U Sep 08 10:37:29.781687 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:37:29.781687 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:37:29.781687 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:37:29.781687 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:37:29.781687 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:37:29.781687 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:37:29.781687 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 3f4ed9a5ac6649dabef253eebb2eac18 Sep 08 10:37:29.781687 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-AggregatesAdminTestJSON-1617984150 Sep 08 10:37:29.781687 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,admin,member Sep 08 10:37:29.781687 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,admin,member Sep 08 10:37:29.783511 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3f4ed9a5ac6649dabef253eebb2eac18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3f4ed9a5ac6649dabef253eebb2eac18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3f4ed9a5ac6649dabef253eebb2eac18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3f4ed9a5ac6649dabef253eebb2eac18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:37:29.783511 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-AggregatesAdminTestJSON-1617984150 Sep 08 10:37:29.783511 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 3f4ed9a5ac6649dabef253eebb2eac18 Sep 08 10:37:29.783511 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1617984150 Sep 08 10:37:29.783511 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-AggregatesAdminTestJSON-1617984150-project-admin Sep 08 10:37:29.783511 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:37:29.783511 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:37:29.783511 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: c4f90d0055d148d09b67c4683e917b65 Sep 08 10:37:29.783511 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-AggregatesAdminTestJSON-1617984150-project-admin Sep 08 10:37:29.783511 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:37:29.783511 n-d-850501-12 devstack@n-api.service[128861]: exception: Aggregate 14 could not be found. Sep 08 10:37:29.783511 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '14'} Sep 08 10:37:29.783511 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:37:29.784947 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:29.784947 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Sep 08 10:37:29.784947 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Sep 08 10:37:29.784947 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 08 10:37:29.784947 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 08 10:37:29.784947 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:37:29.784947 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:37:29.784947 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:37:29.784947 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:37:29.784947 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 08 10:37:29.784947 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 08 10:37:29.784947 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Sep 08 10:37:29.784947 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Sep 08 10:37:29.784947 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 10:37:29.784947 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 10:37:29.784947 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 08 10:37:29.784947 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 08 10:37:29.784947 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 08 10:37:29.784947 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 08 10:37:29.789114 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 08 10:37:29.789114 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 08 10:37:29.789114 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Sep 08 10:37:29.789114 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:29.789114 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:29.789114 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:29.789114 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:29.789114 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:29.789114 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:29.789114 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:37:29.789114 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:37:29.789114 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:37:29.789114 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:37:29.789114 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Sep 08 10:37:29.789114 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:37:29.789114 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Sep 08 10:37:29.789114 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:29.789114 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:29.789114 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:29.789114 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:29.789114 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:29.790955 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:29.790955 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:37:29.790955 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:37:29.790955 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Sep 08 10:37:29.790955 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:29.794030 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b5634534-ce1f-4b23-ab4e-0ce9e3c3e59e tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:37:29.794795 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b5634534-ce1f-4b23-ab4e-0ce9e3c3e59e tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.106691 Sep 08 10:37:29.795791 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 143/276] 10.222.0.27 () {58 vars in 1155 bytes} [Thu Sep 8 10:37:29 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 78 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:37:29.803704 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-46236a57-5caa-4076-af17-ae0ad71c139a tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:29.856750 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-46236a57-5caa-4076-af17-ae0ad71c139a tempest-AggregatesAdminNegativeTestJSON-1714194550 tempest-AggregatesAdminNegativeTestJSON-1714194550-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.059334 Sep 08 10:37:29.857630 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 144/277] 10.222.0.27 () {58 vars in 1155 bytes} [Thu Sep 8 10:37:29 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 08 10:37:29.887835 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7de17762-dd97-45e3-b284-5d4c39483276 tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1358789304"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:29.892672 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.aggregate [None req-7de17762-dd97-45e3-b284-5d4c39483276 tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Generated uuid 44235281-5c29-4995-ae1f-ff469b21238c for aggregate {{(pid=128861) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 08 10:37:29.956795 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7de17762-dd97-45e3-b284-5d4c39483276 tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.087953 Sep 08 10:37:29.958400 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 145/278] 10.222.0.27 () {60 vars in 1164 bytes} [Thu Sep 8 10:37:29 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:37:29.970052 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6cc2d9e7-982b-4702-ad25-2ba5bad8365d tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:29.992591 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6cc2d9e7-982b-4702-ad25-2ba5bad8365d tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 228 microversion: 2.1 time: 0.026487 Sep 08 10:37:29.993163 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 146/279] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Sep 8 10:37:29 2022] GET /compute/v2.1/os-aggregates/16 => generated 228 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:37:30.012456 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e1c81c87-441f-4f74-be92-9bd4847e2f76 tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:30.094739 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e1c81c87-441f-4f74-be92-9bd4847e2f76 tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/16/action" status: 200 len: 266 microversion: 2.1 time: 0.087312 Sep 08 10:37:30.098831 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 147/280] 10.222.0.27 () {60 vars in 1194 bytes} [Thu Sep 8 10:37:30 2022] POST /compute/v2.1/os-aggregates/16/action => generated 266 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:37:30.115674 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-f58a528d-4bd3-4ab8-88ef-3b0cc8b57a7e req-f1fdef51-35eb-4795-a14e-b90383ce84ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc", "tag": "f417b3b4-4ba4-4d76-9929-ee95e97b0ee9"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:30.147079 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-f58a528d-4bd3-4ab8-88ef-3b0cc8b57a7e req-f1fdef51-35eb-4795-a14e-b90383ce84ff service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:30.148095 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-f58a528d-4bd3-4ab8-88ef-3b0cc8b57a7e req-f1fdef51-35eb-4795-a14e-b90383ce84ff service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:30.148727 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-f58a528d-4bd3-4ab8-88ef-3b0cc8b57a7e req-f1fdef51-35eb-4795-a14e-b90383ce84ff service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:30.173406 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-f58a528d-4bd3-4ab8-88ef-3b0cc8b57a7e req-f1fdef51-35eb-4795-a14e-b90383ce84ff service nova] Creating event network-changed:f417b3b4-4ba4-4d76-9929-ee95e97b0ee9 for instance 0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc on n-h2-850501-12 Sep 08 10:37:30.181961 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-f58a528d-4bd3-4ab8-88ef-3b0cc8b57a7e req-f1fdef51-35eb-4795-a14e-b90383ce84ff service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080832 Sep 08 10:37:30.183455 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 148/281] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:37:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:37:30.200405 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4fdd144d-1a58-4dca-88cb-e97ea7021ed6 tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:30.227279 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4fdd144d-1a58-4dca-88cb-e97ea7021ed6 tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 242 microversion: 2.1 time: 0.041315 Sep 08 10:37:30.228723 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 149/282] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Sep 8 10:37:30 2022] GET /compute/v2.1/os-aggregates/16 => generated 242 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:37:30.247858 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b12703fe-1baa-4c57-b2f6-2088aa28c4e9 tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:30.303251 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b12703fe-1baa-4c57-b2f6-2088aa28c4e9 tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.064883 Sep 08 10:37:30.305314 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 150/283] 10.222.0.27 () {58 vars in 1155 bytes} [Thu Sep 8 10:37:30 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 08 10:37:30.315264 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5ef62f22-ffe0-4469-8a26-eb7d361aacd2 tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1771210613", "availability_zone": "tempest-test_az-1130248821"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:30.331961 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.aggregate [None req-5ef62f22-ffe0-4469-8a26-eb7d361aacd2 tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Generated uuid 7e0c9049-4a59-48c6-bf72-31c6103808b1 for aggregate {{(pid=128861) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 08 10:37:30.421348 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5ef62f22-ffe0-4469-8a26-eb7d361aacd2 tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 223 microversion: 2.1 time: 0.110196 Sep 08 10:37:30.426085 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 151/284] 10.222.0.27 () {60 vars in 1165 bytes} [Thu Sep 8 10:37:30 2022] POST /compute/v2.1/os-aggregates => generated 223 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:37:30.448524 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a6c1613a-b438-4959-9c03-1ab7f2aa517b tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1771210613_new", "availability_zone": "tempest-test_az-1130248821_new"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:30.604499 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ffb0f43e-5f63-4791-80a6-6f6bda19bce8 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdbe35f311e435ba9e0516f302ba519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb116f8d7dd4858a91c03e0a4310fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:30.617495 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a6c1613a-b438-4959-9c03-1ab7f2aa517b tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:30.618257 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a6c1613a-b438-4959-9c03-1ab7f2aa517b tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:30.618819 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ffb0f43e-5f63-4791-80a6-6f6bda19bce8 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] 10.222.0.27 "GET /compute/v2.1/servers/0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc" status: 200 len: 1320 microversion: 2.1 time: 0.965431 Sep 08 10:37:30.619070 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a6c1613a-b438-4959-9c03-1ab7f2aa517b tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:30.619419 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 134/285] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:29 2022] GET /compute/v2.1/servers/0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc => generated 1320 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:30.636176 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e6230f33-afc5-4151-9bdd-702f2833d547 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:30.636851 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e6230f33-afc5-4151-9bdd-702f2833d547 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 292d240e-1176-4875-8f87-9ca911437fbe] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:30.663039 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e6230f33-afc5-4151-9bdd-702f2833d547 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:30.666553 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e6230f33-afc5-4151-9bdd-702f2833d547 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:30.667157 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e6230f33-afc5-4151-9bdd-702f2833d547 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:30.668070 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e6230f33-afc5-4151-9bdd-702f2833d547 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:30.668948 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e6230f33-afc5-4151-9bdd-702f2833d547 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:30.672335 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e6230f33-afc5-4151-9bdd-702f2833d547 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:30.696498 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a6c1613a-b438-4959-9c03-1ab7f2aa517b tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-aggregates/17" status: 200 len: 337 microversion: 2.1 time: 0.262375 Sep 08 10:37:30.700260 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 152/286] 10.222.0.27 () {60 vars in 1173 bytes} [Thu Sep 8 10:37:30 2022] PUT /compute/v2.1/os-aggregates/17 => generated 337 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:37:30.717712 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e87ec847-90c7-4397-b39e-51c9be3dca1e tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:30.745194 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e87ec847-90c7-4397-b39e-51c9be3dca1e tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates" status: 200 len: 340 microversion: 2.1 time: 0.032316 Sep 08 10:37:30.746786 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 153/287] 10.222.0.27 () {58 vars in 1143 bytes} [Thu Sep 8 10:37:30 2022] GET /compute/v2.1/os-aggregates => generated 340 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:37:30.761156 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a1abb4db-8b2c-483a-9fa0-8d69bab5ed8a tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:30.821510 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a1abb4db-8b2c-483a-9fa0-8d69bab5ed8a tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.065532 Sep 08 10:37:30.822670 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 154/288] 10.222.0.27 () {58 vars in 1155 bytes} [Thu Sep 8 10:37:30 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 08 10:37:30.837198 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8f6a22d6-3dbe-48c8-8508-f616a7b50073 tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1202174301"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:30.843107 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.aggregate [None req-8f6a22d6-3dbe-48c8-8508-f616a7b50073 tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Generated uuid 5fadecaf-0d3b-4f9e-b5bb-7b3fc17f4c22 for aggregate {{(pid=128861) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 08 10:37:30.907034 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8f6a22d6-3dbe-48c8-8508-f616a7b50073 tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.074799 Sep 08 10:37:30.909093 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 155/289] 10.222.0.27 () {60 vars in 1164 bytes} [Thu Sep 8 10:37:30 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:37:30.935666 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fd08940d-e51f-4f43-9b47-ecf355b7e678 tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:30.959040 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e6230f33-afc5-4151-9bdd-702f2833d547 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:30.960431 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fd08940d-e51f-4f43-9b47-ecf355b7e678 tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates" status: 200 len: 231 microversion: 2.1 time: 0.039327 Sep 08 10:37:30.967894 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 156/290] 10.222.0.27 () {58 vars in 1143 bytes} [Thu Sep 8 10:37:30 2022] GET /compute/v2.1/os-aggregates => generated 231 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:37:30.976644 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d66cf3d4-f011-4717-9630-e776d07f9b4a tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:30.991522 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e6230f33-afc5-4151-9bdd-702f2833d547 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:30.998972 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e6230f33-afc5-4151-9bdd-702f2833d547 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:31.003869 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e6230f33-afc5-4151-9bdd-702f2833d547 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/292d240e-1176-4875-8f87-9ca911437fbe" status: 200 len: 1258 microversion: 2.25 time: 0.379295 Sep 08 10:37:31.010497 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 135/291] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:37:30 2022] GET /compute/v2.1/servers/292d240e-1176-4875-8f87-9ca911437fbe => generated 1258 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:37:31.022206 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d66cf3d4-f011-4717-9630-e776d07f9b4a tempest-AggregatesAdminTestJSON-1617984150 tempest-AggregatesAdminTestJSON-1617984150-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.051837 Sep 08 10:37:31.026759 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 157/292] 10.222.0.27 () {58 vars in 1155 bytes} [Thu Sep 8 10:37:30 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Sep 08 10:37:31.048060 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8f912ecc-b96d-4912-82fd-e98b06b2b19f tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:31.050115 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8f912ecc-b96d-4912-82fd-e98b06b2b19f tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] [instance: a14a2e92-7b76-4576-bc3e-3b567afa63ac] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:31.057065 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f912ecc-b96d-4912-82fd-e98b06b2b19f tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:31.058168 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f912ecc-b96d-4912-82fd-e98b06b2b19f tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:31.059304 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f912ecc-b96d-4912-82fd-e98b06b2b19f tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:31.060213 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f912ecc-b96d-4912-82fd-e98b06b2b19f tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:31.061191 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f912ecc-b96d-4912-82fd-e98b06b2b19f tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:31.061191 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f912ecc-b96d-4912-82fd-e98b06b2b19f tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:31.081331 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-8f912ecc-b96d-4912-82fd-e98b06b2b19f tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] HTTP exception thrown: Instance a14a2e92-7b76-4576-bc3e-3b567afa63ac could not be found. Sep 08 10:37:31.082994 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8f912ecc-b96d-4912-82fd-e98b06b2b19f tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Request method failure captured: Sep 08 10:37:31.082994 n-d-850501-12 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/servers/a14a2e92-7b76-4576-bc3e-3b567afa63ac HTTP/1.1 Sep 08 10:37:31.082994 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:37:31.082994 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:37:31.082994 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:37:31.082994 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:37:31.082994 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:37:31.082994 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:37:31.082994 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:37:31.082994 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:37:31.082994 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcW3NsHhQ2tRCGBQVfVokClDWCWMxc2oP-6tl5QsaP6ReB8nYkWuZowrUPnFSDRp2NMxhoJValvn9lObdLS41H6R5f9THHtFepuVClCkg2IEh-coXewr3iJClZ00kxzwh26D0E1CLRQsbHO6bNVTNyij5YDnoUn5oBqrcXdU9XuiwT4 Sep 08 10:37:31.082994 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:37:31.082994 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:37:31.082994 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:37:31.082994 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:37:31.082994 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:37:31.082994 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:37:31.082994 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: d5e11d5906f0407d9ea1f1deed40aab7 Sep 08 10:37:31.082994 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-AggregatesAdminTestJSON-1601146989 Sep 08 10:37:31.082994 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:37:31.082994 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:37:31.084459 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d5e11d5906f0407d9ea1f1deed40aab7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d5e11d5906f0407d9ea1f1deed40aab7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d5e11d5906f0407d9ea1f1deed40aab7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d5e11d5906f0407d9ea1f1deed40aab7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:37:31.084459 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-AggregatesAdminTestJSON-1601146989 Sep 08 10:37:31.084459 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: d5e11d5906f0407d9ea1f1deed40aab7 Sep 08 10:37:31.084459 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1601146989 Sep 08 10:37:31.084459 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-AggregatesAdminTestJSON-1601146989-project Sep 08 10:37:31.084459 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:37:31.084459 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:37:31.084459 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 5b76777df7594f7a9d03376362b80b0f Sep 08 10:37:31.084459 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-AggregatesAdminTestJSON-1601146989-project Sep 08 10:37:31.084459 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:37:31.084459 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance a14a2e92-7b76-4576-bc3e-3b567afa63ac could not be found. Sep 08 10:37:31.084459 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'a14a2e92-7b76-4576-bc3e-3b567afa63ac'} Sep 08 10:37:31.085226 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:37:31.085226 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:31.085226 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:37:31.085226 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:37:31.085226 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:37:31.085226 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:37:31.085226 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:37:31.085226 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:37:31.085226 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:37:31.085226 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:37:31.085226 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a14a2e92-7b76-4576-bc3e-3b567afa63ac could not be found. Sep 08 10:37:31.085226 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:31.085226 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:31.085226 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:31.085226 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:31.085226 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:31.085226 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:31.085226 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:37:31.085226 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:37:31.085226 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:37:31.090588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:37:31.090588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:37:31.090588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:37:31.090588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:37:31.090588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:37:31.090588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:37:31.090588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:37:31.090588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:37:31.090588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:37:31.090588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a14a2e92-7b76-4576-bc3e-3b567afa63ac could not be found. Sep 08 10:37:31.090588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:31.090588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:31.090588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:31.090588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:31.090588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:31.090588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:31.090588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:37:31.090588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:37:31.090588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a14a2e92-7b76-4576-bc3e-3b567afa63ac could not be found. Sep 08 10:37:31.090588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:31.095243 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8f912ecc-b96d-4912-82fd-e98b06b2b19f tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Returning 404 to user: Instance a14a2e92-7b76-4576-bc3e-3b567afa63ac could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:37:31.097183 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8f912ecc-b96d-4912-82fd-e98b06b2b19f tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a14a2e92-7b76-4576-bc3e-3b567afa63ac" status: 404 len: 111 microversion: 2.1 time: 0.061399 Sep 08 10:37:31.098854 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 136/293] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:37:31 2022] DELETE /compute/v2.1/servers/a14a2e92-7b76-4576-bc3e-3b567afa63ac => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:37:31.107029 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9230f6a9-e337-4172-b25c-30e61e86ee08 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:31.107923 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9230f6a9-e337-4172-b25c-30e61e86ee08 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] [instance: a14a2e92-7b76-4576-bc3e-3b567afa63ac] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:31.119802 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9230f6a9-e337-4172-b25c-30e61e86ee08 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:31.120314 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9230f6a9-e337-4172-b25c-30e61e86ee08 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:31.120753 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9230f6a9-e337-4172-b25c-30e61e86ee08 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:31.121508 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9230f6a9-e337-4172-b25c-30e61e86ee08 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:31.121965 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9230f6a9-e337-4172-b25c-30e61e86ee08 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:31.123240 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9230f6a9-e337-4172-b25c-30e61e86ee08 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:31.176749 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-9230f6a9-e337-4172-b25c-30e61e86ee08 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] HTTP exception thrown: Instance a14a2e92-7b76-4576-bc3e-3b567afa63ac could not be found. Sep 08 10:37:31.181984 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9230f6a9-e337-4172-b25c-30e61e86ee08 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Request method failure captured: Sep 08 10:37:31.181984 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/a14a2e92-7b76-4576-bc3e-3b567afa63ac HTTP/1.1 Sep 08 10:37:31.181984 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:37:31.181984 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:37:31.181984 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:37:31.181984 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:37:31.181984 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:37:31.181984 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:37:31.181984 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:37:31.181984 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:37:31.181984 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcW3NsHhQ2tRCGBQVfVokClDWCWMxc2oP-6tl5QsaP6ReB8nYkWuZowrUPnFSDRp2NMxhoJValvn9lObdLS41H6R5f9THHtFepuVClCkg2IEh-coXewr3iJClZ00kxzwh26D0E1CLRQsbHO6bNVTNyij5YDnoUn5oBqrcXdU9XuiwT4 Sep 08 10:37:31.181984 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:37:31.181984 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:37:31.181984 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:37:31.181984 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:37:31.181984 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:37:31.181984 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:37:31.181984 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: d5e11d5906f0407d9ea1f1deed40aab7 Sep 08 10:37:31.181984 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-AggregatesAdminTestJSON-1601146989 Sep 08 10:37:31.181984 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:37:31.181984 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:37:31.183907 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d5e11d5906f0407d9ea1f1deed40aab7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d5e11d5906f0407d9ea1f1deed40aab7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d5e11d5906f0407d9ea1f1deed40aab7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d5e11d5906f0407d9ea1f1deed40aab7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:37:31.183907 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-AggregatesAdminTestJSON-1601146989 Sep 08 10:37:31.183907 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: d5e11d5906f0407d9ea1f1deed40aab7 Sep 08 10:37:31.183907 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1601146989 Sep 08 10:37:31.183907 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-AggregatesAdminTestJSON-1601146989-project Sep 08 10:37:31.183907 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:37:31.183907 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:37:31.183907 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 5b76777df7594f7a9d03376362b80b0f Sep 08 10:37:31.183907 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-AggregatesAdminTestJSON-1601146989-project Sep 08 10:37:31.183907 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:37:31.183907 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance a14a2e92-7b76-4576-bc3e-3b567afa63ac could not be found. Sep 08 10:37:31.183907 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': 'a14a2e92-7b76-4576-bc3e-3b567afa63ac'} Sep 08 10:37:31.185171 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:37:31.185171 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:31.185171 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:37:31.185171 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:37:31.185171 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:37:31.185171 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:37:31.185171 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:37:31.185171 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:37:31.185171 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:37:31.185171 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:37:31.185171 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a14a2e92-7b76-4576-bc3e-3b567afa63ac could not be found. Sep 08 10:37:31.185171 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:31.185171 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:31.185171 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:31.185171 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:31.185171 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:31.185171 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:31.185171 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:37:31.185171 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:37:31.185171 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:37:31.186321 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:37:31.186321 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:37:31.186321 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:37:31.186321 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:37:31.186321 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:37:31.186321 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:37:31.186321 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:37:31.186321 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a14a2e92-7b76-4576-bc3e-3b567afa63ac could not be found. Sep 08 10:37:31.186321 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:31.186321 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:31.186321 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:31.186321 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:31.186321 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:31.186321 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:31.186321 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:37:31.186321 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:37:31.186321 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a14a2e92-7b76-4576-bc3e-3b567afa63ac could not be found. Sep 08 10:37:31.186321 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:31.190301 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9230f6a9-e337-4172-b25c-30e61e86ee08 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] Returning 404 to user: Instance a14a2e92-7b76-4576-bc3e-3b567afa63ac could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:37:31.190301 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9230f6a9-e337-4172-b25c-30e61e86ee08 tempest-AggregatesAdminTestJSON-1601146989 tempest-AggregatesAdminTestJSON-1601146989-project] 10.222.0.27 "GET /compute/v2.1/servers/a14a2e92-7b76-4576-bc3e-3b567afa63ac" status: 404 len: 111 microversion: 2.1 time: 0.080111 Sep 08 10:37:31.190301 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 158/294] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:31 2022] GET /compute/v2.1/servers/a14a2e92-7b76-4576-bc3e-3b567afa63ac => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 10:37:31.644866 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4502c31c-c05c-4b47-8563-a2523850282b tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:31.648434 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4502c31c-c05c-4b47-8563-a2523850282b tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] [instance: 0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:31.660299 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=8,nova_api:DELETE=7 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:37:31.664358 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4502c31c-c05c-4b47-8563-a2523850282b tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:31.667815 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4502c31c-c05c-4b47-8563-a2523850282b tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:31.668699 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4502c31c-c05c-4b47-8563-a2523850282b tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:31.672182 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4502c31c-c05c-4b47-8563-a2523850282b tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:31.680084 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4502c31c-c05c-4b47-8563-a2523850282b tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:31.681101 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4502c31c-c05c-4b47-8563-a2523850282b tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:32.042790 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c05f281e-4f51-4705-a6c3-139796adb759 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:32.043764 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c05f281e-4f51-4705-a6c3-139796adb759 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 292d240e-1176-4875-8f87-9ca911437fbe] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:32.052570 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c05f281e-4f51-4705-a6c3-139796adb759 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:32.053780 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c05f281e-4f51-4705-a6c3-139796adb759 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:32.055539 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c05f281e-4f51-4705-a6c3-139796adb759 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:32.056837 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c05f281e-4f51-4705-a6c3-139796adb759 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:32.057705 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c05f281e-4f51-4705-a6c3-139796adb759 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:32.058515 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c05f281e-4f51-4705-a6c3-139796adb759 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:32.349380 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c05f281e-4f51-4705-a6c3-139796adb759 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:32.367722 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c05f281e-4f51-4705-a6c3-139796adb759 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:32.374407 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c05f281e-4f51-4705-a6c3-139796adb759 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:32.380150 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4502c31c-c05c-4b47-8563-a2523850282b tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdbe35f311e435ba9e0516f302ba519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb116f8d7dd4858a91c03e0a4310fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:32.386052 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c05f281e-4f51-4705-a6c3-139796adb759 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/292d240e-1176-4875-8f87-9ca911437fbe" status: 200 len: 1320 microversion: 2.25 time: 0.349256 Sep 08 10:37:32.391264 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 159/295] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:37:32 2022] GET /compute/v2.1/servers/292d240e-1176-4875-8f87-9ca911437fbe => generated 1320 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:37:32.397621 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4502c31c-c05c-4b47-8563-a2523850282b tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] 10.222.0.27 "GET /compute/v2.1/servers/0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc" status: 200 len: 1320 microversion: 2.1 time: 0.752966 Sep 08 10:37:32.398522 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 137/296] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:31 2022] GET /compute/v2.1/servers/0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc => generated 1320 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:33.429987 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fad3941d-7953-4661-87a9-f470c20b5a04 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:33.431234 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fad3941d-7953-4661-87a9-f470c20b5a04 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 292d240e-1176-4875-8f87-9ca911437fbe] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:33.440809 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-55499844-d8d8-450d-875f-83a32e5868ab tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:33.441851 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-55499844-d8d8-450d-875f-83a32e5868ab tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] [instance: 0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:33.464117 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55499844-d8d8-450d-875f-83a32e5868ab tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:33.464829 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55499844-d8d8-450d-875f-83a32e5868ab tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:33.466556 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fad3941d-7953-4661-87a9-f470c20b5a04 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:33.467116 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fad3941d-7953-4661-87a9-f470c20b5a04 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:33.467554 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fad3941d-7953-4661-87a9-f470c20b5a04 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:33.468270 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fad3941d-7953-4661-87a9-f470c20b5a04 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:33.469439 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55499844-d8d8-450d-875f-83a32e5868ab tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:33.471368 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55499844-d8d8-450d-875f-83a32e5868ab tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:33.471858 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55499844-d8d8-450d-875f-83a32e5868ab tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:33.472284 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55499844-d8d8-450d-875f-83a32e5868ab tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:33.476197 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fad3941d-7953-4661-87a9-f470c20b5a04 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:33.476802 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fad3941d-7953-4661-87a9-f470c20b5a04 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:34.290579 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-fad3941d-7953-4661-87a9-f470c20b5a04 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:34.302745 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-55499844-d8d8-450d-875f-83a32e5868ab tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdbe35f311e435ba9e0516f302ba519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb116f8d7dd4858a91c03e0a4310fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:34.316954 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-55499844-d8d8-450d-875f-83a32e5868ab tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] 10.222.0.27 "GET /compute/v2.1/servers/0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc" status: 200 len: 1320 microversion: 2.1 time: 0.877980 Sep 08 10:37:34.319628 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 138/297] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:33 2022] GET /compute/v2.1/servers/0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc => generated 1320 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:37:34.320579 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-fad3941d-7953-4661-87a9-f470c20b5a04 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:34.323067 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-fad3941d-7953-4661-87a9-f470c20b5a04 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:34.324097 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fad3941d-7953-4661-87a9-f470c20b5a04 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/292d240e-1176-4875-8f87-9ca911437fbe" status: 200 len: 1362 microversion: 2.25 time: 0.904487 Sep 08 10:37:34.324623 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 160/298] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:37:33 2022] GET /compute/v2.1/servers/292d240e-1176-4875-8f87-9ca911437fbe => generated 1362 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:37:35.344761 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9df7576b-48d4-432b-a8b1-5a278b18aea3 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:35.346347 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9df7576b-48d4-432b-a8b1-5a278b18aea3 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] [instance: 0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:35.357780 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-76398fd6-b8e3-454a-bd42-c2da065b716b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:35.358440 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-76398fd6-b8e3-454a-bd42-c2da065b716b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 292d240e-1176-4875-8f87-9ca911437fbe] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:35.373610 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9df7576b-48d4-432b-a8b1-5a278b18aea3 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:35.375139 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9df7576b-48d4-432b-a8b1-5a278b18aea3 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:35.378530 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9df7576b-48d4-432b-a8b1-5a278b18aea3 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:35.380859 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-76398fd6-b8e3-454a-bd42-c2da065b716b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:35.381210 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9df7576b-48d4-432b-a8b1-5a278b18aea3 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:35.383319 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9df7576b-48d4-432b-a8b1-5a278b18aea3 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:35.383994 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-76398fd6-b8e3-454a-bd42-c2da065b716b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:35.384618 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9df7576b-48d4-432b-a8b1-5a278b18aea3 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:35.389002 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-76398fd6-b8e3-454a-bd42-c2da065b716b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:35.394255 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-76398fd6-b8e3-454a-bd42-c2da065b716b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:35.403064 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-76398fd6-b8e3-454a-bd42-c2da065b716b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:35.403847 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-76398fd6-b8e3-454a-bd42-c2da065b716b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:35.841985 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-76398fd6-b8e3-454a-bd42-c2da065b716b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:35.848258 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=100 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:37:35.876609 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-76398fd6-b8e3-454a-bd42-c2da065b716b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:35.884080 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-76398fd6-b8e3-454a-bd42-c2da065b716b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:35.902030 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-76398fd6-b8e3-454a-bd42-c2da065b716b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/292d240e-1176-4875-8f87-9ca911437fbe" status: 200 len: 1362 microversion: 2.25 time: 0.532443 Sep 08 10:37:35.906281 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 161/299] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:37:35 2022] GET /compute/v2.1/servers/292d240e-1176-4875-8f87-9ca911437fbe => generated 1362 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:37:36.397727 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-be6074c7-d2e8-46a9-a9db-26ea1a0f1aac tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-367853938", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:36.503582 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-be6074c7-d2e8-46a9-a9db-26ea1a0f1aac tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] validate_networks() for None {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:37:36.773853 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9df7576b-48d4-432b-a8b1-5a278b18aea3 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdbe35f311e435ba9e0516f302ba519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb116f8d7dd4858a91c03e0a4310fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:36.785999 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9df7576b-48d4-432b-a8b1-5a278b18aea3 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] 10.222.0.27 "GET /compute/v2.1/servers/0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc" status: 200 len: 1320 microversion: 2.1 time: 1.445796 Sep 08 10:37:36.789355 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 139/300] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:35 2022] GET /compute/v2.1/servers/0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc => generated 1320 bytes in 1450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:36.796989 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-e5d7f484-5309-4476-8c26-c4d7b7520727 req-120b4d0f-c3cb-4768-8da6-63df990406ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "292d240e-1176-4875-8f87-9ca911437fbe", "tag": "73b84527-1c36-4494-857a-3c9441bb8f82"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:36.813390 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e5d7f484-5309-4476-8c26-c4d7b7520727 req-120b4d0f-c3cb-4768-8da6-63df990406ca service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:36.814613 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e5d7f484-5309-4476-8c26-c4d7b7520727 req-120b4d0f-c3cb-4768-8da6-63df990406ca service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:36.815225 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e5d7f484-5309-4476-8c26-c4d7b7520727 req-120b4d0f-c3cb-4768-8da6-63df990406ca service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:36.838445 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-e5d7f484-5309-4476-8c26-c4d7b7520727 req-120b4d0f-c3cb-4768-8da6-63df990406ca service nova] Creating event network-changed:73b84527-1c36-4494-857a-3c9441bb8f82 for instance 292d240e-1176-4875-8f87-9ca911437fbe on n-h1-850501-12 Sep 08 10:37:36.851074 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-e5d7f484-5309-4476-8c26-c4d7b7520727 req-120b4d0f-c3cb-4768-8da6-63df990406ca service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060151 Sep 08 10:37:36.852303 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 140/301] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:37:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:37:36.995679 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-be6074c7-d2e8-46a9-a9db-26ea1a0f1aac tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:37:36.996316 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-be6074c7-d2e8-46a9-a9db-26ea1a0f1aac tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:37:36.996978 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-be6074c7-d2e8-46a9-a9db-26ea1a0f1aac tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:37:36.997616 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-be6074c7-d2e8-46a9-a9db-26ea1a0f1aac tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:37:36.998172 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-be6074c7-d2e8-46a9-a9db-26ea1a0f1aac tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:37:37.018182 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-be6074c7-d2e8-46a9-a9db-26ea1a0f1aac tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:37.018685 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-be6074c7-d2e8-46a9-a9db-26ea1a0f1aac tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:37.019115 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-be6074c7-d2e8-46a9-a9db-26ea1a0f1aac tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:37.020111 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-be6074c7-d2e8-46a9-a9db-26ea1a0f1aac tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:37.020757 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-be6074c7-d2e8-46a9-a9db-26ea1a0f1aac tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:37.021628 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-be6074c7-d2e8-46a9-a9db-26ea1a0f1aac tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:37.047486 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-be6074c7-d2e8-46a9-a9db-26ea1a0f1aac tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Getting quotas for project 2a3d4a2ec8674e418602b6dc0cec6ab9. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:37:37.054300 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-be6074c7-d2e8-46a9-a9db-26ea1a0f1aac tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Getting quotas for user 771c067cf6814084a5520128a970dc82 and project 2a3d4a2ec8674e418602b6dc0cec6ab9. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:37:37.098077 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-be6074c7-d2e8-46a9-a9db-26ea1a0f1aac tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:37:37.103736 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-be6074c7-d2e8-46a9-a9db-26ea1a0f1aac tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: a3147437-e6f2-480d-bcaf-cc0f030d497d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:37:37.172869 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-be6074c7-d2e8-46a9-a9db-26ea1a0f1aac tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.265151 Sep 08 10:37:37.177238 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 162/302] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:37:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1270 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:37:37.316719 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a3ea19ba-5fef-4499-af52-43af5150098f tempest-InstanceUsageAuditLogTestJSON-1348201562 tempest-InstanceUsageAuditLogTestJSON-1348201562-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:37.361375 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a3ea19ba-5fef-4499-af52-43af5150098f tempest-InstanceUsageAuditLogTestJSON-1348201562 tempest-InstanceUsageAuditLogTestJSON-1348201562-project-admin] 10.222.0.27 "GET /compute/v2.1/os-instance_usage_audit_log/2022-09-08 10:37:35" status: 200 len: 318 microversion: 2.1 time: 0.507209 Sep 08 10:37:37.379340 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 141/303] 10.222.0.27 () {58 vars in 1251 bytes} [Thu Sep 8 10:37:36 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-09-08%2010%3A37%3A35 => generated 318 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:37:37.385798 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-69ace97e-47a1-42ce-8f1f-2705c0023247 req-b6c9378f-e2d4-43f2-8af1-71641bab8733 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc", "name": "network-vif-plugged", "status": "completed", "tag": "f417b3b4-4ba4-4d76-9929-ee95e97b0ee9"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:37.408895 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-69ace97e-47a1-42ce-8f1f-2705c0023247 req-b6c9378f-e2d4-43f2-8af1-71641bab8733 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:37.412265 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-69ace97e-47a1-42ce-8f1f-2705c0023247 req-b6c9378f-e2d4-43f2-8af1-71641bab8733 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:37.412953 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-69ace97e-47a1-42ce-8f1f-2705c0023247 req-b6c9378f-e2d4-43f2-8af1-71641bab8733 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:37.435736 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-69ace97e-47a1-42ce-8f1f-2705c0023247 req-b6c9378f-e2d4-43f2-8af1-71641bab8733 service nova] Creating event network-vif-plugged:f417b3b4-4ba4-4d76-9929-ee95e97b0ee9 for instance 0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc on n-h2-850501-12 Sep 08 10:37:37.442760 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-69ace97e-47a1-42ce-8f1f-2705c0023247 req-b6c9378f-e2d4-43f2-8af1-71641bab8733 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061354 Sep 08 10:37:37.444350 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 142/304] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:37:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:37:37.451706 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-042c38ab-158d-408b-b36c-f6802732ce95 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:37.452426 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-042c38ab-158d-408b-b36c-f6802732ce95 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 292d240e-1176-4875-8f87-9ca911437fbe] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:37.461081 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-042c38ab-158d-408b-b36c-f6802732ce95 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:37.462787 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-042c38ab-158d-408b-b36c-f6802732ce95 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:37.463728 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-042c38ab-158d-408b-b36c-f6802732ce95 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:37.464955 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-042c38ab-158d-408b-b36c-f6802732ce95 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:37.465633 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-042c38ab-158d-408b-b36c-f6802732ce95 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:37.466768 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-042c38ab-158d-408b-b36c-f6802732ce95 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:37.964521 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-042c38ab-158d-408b-b36c-f6802732ce95 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:37.984130 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-042c38ab-158d-408b-b36c-f6802732ce95 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:37.988470 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-042c38ab-158d-408b-b36c-f6802732ce95 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:37.993171 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-042c38ab-158d-408b-b36c-f6802732ce95 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/292d240e-1176-4875-8f87-9ca911437fbe" status: 200 len: 1362 microversion: 2.25 time: 0.546775 Sep 08 10:37:38.008036 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 143/305] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:37:37 2022] GET /compute/v2.1/servers/292d240e-1176-4875-8f87-9ca911437fbe => generated 1362 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:37:38.022049 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dd5f0b9a-7f0d-4f53-8f65-e5ea68bd77c1 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:38.032440 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-dd5f0b9a-7f0d-4f53-8f65-e5ea68bd77c1 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: a3147437-e6f2-480d-bcaf-cc0f030d497d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:38.066201 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e07feaff-bdf1-4479-be97-5a72f8cf9a17 tempest-HypervisorAdminV253TestBase-535849445 tempest-HypervisorAdminV253TestBase-535849445-project-admin] Calling method '.version_select at 0x7f68e518e1f0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:38.070425 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e07feaff-bdf1-4479-be97-5a72f8cf9a17 tempest-HypervisorAdminV253TestBase-535849445 tempest-HypervisorAdminV253TestBase-535849445-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:38.070923 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e07feaff-bdf1-4479-be97-5a72f8cf9a17 tempest-HypervisorAdminV253TestBase-535849445 tempest-HypervisorAdminV253TestBase-535849445-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:38.075044 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e07feaff-bdf1-4479-be97-5a72f8cf9a17 tempest-HypervisorAdminV253TestBase-535849445 tempest-HypervisorAdminV253TestBase-535849445-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:38.142693 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e07feaff-bdf1-4479-be97-5a72f8cf9a17 tempest-HypervisorAdminV253TestBase-535849445 tempest-HypervisorAdminV253TestBase-535849445-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:38.143743 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e07feaff-bdf1-4479-be97-5a72f8cf9a17 tempest-HypervisorAdminV253TestBase-535849445 tempest-HypervisorAdminV253TestBase-535849445-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:38.144253 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e07feaff-bdf1-4479-be97-5a72f8cf9a17 tempest-HypervisorAdminV253TestBase-535849445 tempest-HypervisorAdminV253TestBase-535849445-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:38.205368 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-dd5f0b9a-7f0d-4f53-8f65-e5ea68bd77c1 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:38.221511 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-dd5f0b9a-7f0d-4f53-8f65-e5ea68bd77c1 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/a3147437-e6f2-480d-bcaf-cc0f030d497d" status: 200 len: 1216 microversion: 2.1 time: 0.212318 Sep 08 10:37:38.222408 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 144/306] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:38 2022] GET /compute/v2.1/servers/a3147437-e6f2-480d-bcaf-cc0f030d497d => generated 1216 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:38.226802 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3e3c7aa9-1e99-49ca-aa17-fd748758f4ed tempest-InstanceUsageAuditLogTestJSON-1348201562 tempest-InstanceUsageAuditLogTestJSON-1348201562-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:38.242949 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=10,nova_api:INSERT=8,nova_api:UPDATE=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:37:38.256607 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e07feaff-bdf1-4479-be97-5a72f8cf9a17 tempest-HypervisorAdminV253TestBase-535849445 tempest-HypervisorAdminV253TestBase-535849445-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:38.257569 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e07feaff-bdf1-4479-be97-5a72f8cf9a17 tempest-HypervisorAdminV253TestBase-535849445 tempest-HypervisorAdminV253TestBase-535849445-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:38.257846 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3e3c7aa9-1e99-49ca-aa17-fd748758f4ed tempest-InstanceUsageAuditLogTestJSON-1348201562 tempest-InstanceUsageAuditLogTestJSON-1348201562-project-admin] 10.222.0.27 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.034379 Sep 08 10:37:38.258466 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e07feaff-bdf1-4479-be97-5a72f8cf9a17 tempest-HypervisorAdminV253TestBase-535849445 tempest-HypervisorAdminV253TestBase-535849445-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:38.259308 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 145/307] 10.222.0.27 () {58 vars in 1185 bytes} [Thu Sep 8 10:37:38 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:37:38.272853 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-af085a23-7f85-42a3-95d4-513678f579c4 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:38.273507 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-af085a23-7f85-42a3-95d4-513678f579c4 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] [instance: 0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:38.289153 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af085a23-7f85-42a3-95d4-513678f579c4 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:38.290001 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af085a23-7f85-42a3-95d4-513678f579c4 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:38.290603 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af085a23-7f85-42a3-95d4-513678f579c4 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:38.291578 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af085a23-7f85-42a3-95d4-513678f579c4 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:38.292222 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af085a23-7f85-42a3-95d4-513678f579c4 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:38.292828 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af085a23-7f85-42a3-95d4-513678f579c4 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:38.302172 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e07feaff-bdf1-4479-be97-5a72f8cf9a17 tempest-HypervisorAdminV253TestBase-535849445 tempest-HypervisorAdminV253TestBase-535849445-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:38.302685 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e07feaff-bdf1-4479-be97-5a72f8cf9a17 tempest-HypervisorAdminV253TestBase-535849445 tempest-HypervisorAdminV253TestBase-535849445-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:38.303132 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e07feaff-bdf1-4479-be97-5a72f8cf9a17 tempest-HypervisorAdminV253TestBase-535849445 tempest-HypervisorAdminV253TestBase-535849445-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:38.353547 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e07feaff-bdf1-4479-be97-5a72f8cf9a17 tempest-HypervisorAdminV253TestBase-535849445 tempest-HypervisorAdminV253TestBase-535849445-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:38.354063 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e07feaff-bdf1-4479-be97-5a72f8cf9a17 tempest-HypervisorAdminV253TestBase-535849445 tempest-HypervisorAdminV253TestBase-535849445-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:38.357544 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e07feaff-bdf1-4479-be97-5a72f8cf9a17 tempest-HypervisorAdminV253TestBase-535849445 tempest-HypervisorAdminV253TestBase-535849445-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:38.399068 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e07feaff-bdf1-4479-be97-5a72f8cf9a17 tempest-HypervisorAdminV253TestBase-535849445 tempest-HypervisorAdminV253TestBase-535849445-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1761 microversion: 2.53 time: 1.216477 Sep 08 10:37:38.400199 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 163/308] 10.222.0.27 () {60 vars in 1243 bytes} [Thu Sep 8 10:37:37 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1761 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:37:38.421872 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b952187f-14c5-4895-b090-d125749c5318 tempest-HypervisorAdminV253TestBase-535849445 tempest-HypervisorAdminV253TestBase-535849445-project-admin] Calling method '.version_select at 0x7f68e52da5e0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:38.434605 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b952187f-14c5-4895-b090-d125749c5318 tempest-HypervisorAdminV253TestBase-535849445 tempest-HypervisorAdminV253TestBase-535849445-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:38.436379 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b952187f-14c5-4895-b090-d125749c5318 tempest-HypervisorAdminV253TestBase-535849445 tempest-HypervisorAdminV253TestBase-535849445-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:38.441909 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b952187f-14c5-4895-b090-d125749c5318 tempest-HypervisorAdminV253TestBase-535849445 tempest-HypervisorAdminV253TestBase-535849445-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:38.494687 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b952187f-14c5-4895-b090-d125749c5318 tempest-HypervisorAdminV253TestBase-535849445 tempest-HypervisorAdminV253TestBase-535849445-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:38.496411 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b952187f-14c5-4895-b090-d125749c5318 tempest-HypervisorAdminV253TestBase-535849445 tempest-HypervisorAdminV253TestBase-535849445-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:38.497924 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b952187f-14c5-4895-b090-d125749c5318 tempest-HypervisorAdminV253TestBase-535849445 tempest-HypervisorAdminV253TestBase-535849445-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:38.571490 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b952187f-14c5-4895-b090-d125749c5318 tempest-HypervisorAdminV253TestBase-535849445 tempest-HypervisorAdminV253TestBase-535849445-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:38.573272 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b952187f-14c5-4895-b090-d125749c5318 tempest-HypervisorAdminV253TestBase-535849445 tempest-HypervisorAdminV253TestBase-535849445-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:38.574643 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b952187f-14c5-4895-b090-d125749c5318 tempest-HypervisorAdminV253TestBase-535849445 tempest-HypervisorAdminV253TestBase-535849445-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:38.598421 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b952187f-14c5-4895-b090-d125749c5318 tempest-HypervisorAdminV253TestBase-535849445 tempest-HypervisorAdminV253TestBase-535849445-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:38.599235 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b952187f-14c5-4895-b090-d125749c5318 tempest-HypervisorAdminV253TestBase-535849445 tempest-HypervisorAdminV253TestBase-535849445-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:38.600307 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b952187f-14c5-4895-b090-d125749c5318 tempest-HypervisorAdminV253TestBase-535849445 tempest-HypervisorAdminV253TestBase-535849445-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:38.639769 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b952187f-14c5-4895-b090-d125749c5318 tempest-HypervisorAdminV253TestBase-535849445 tempest-HypervisorAdminV253TestBase-535849445-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:38.640664 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b952187f-14c5-4895-b090-d125749c5318 tempest-HypervisorAdminV253TestBase-535849445 tempest-HypervisorAdminV253TestBase-535849445-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:38.641332 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b952187f-14c5-4895-b090-d125749c5318 tempest-HypervisorAdminV253TestBase-535849445 tempest-HypervisorAdminV253TestBase-535849445-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:38.650298 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b952187f-14c5-4895-b090-d125749c5318 tempest-HypervisorAdminV253TestBase-535849445 tempest-HypervisorAdminV253TestBase-535849445-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 451 microversion: 2.53 time: 0.233301 Sep 08 10:37:38.652976 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 164/309] 10.222.0.27 () {60 vars in 1222 bytes} [Thu Sep 8 10:37:38 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 451 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:37:38.671668 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-af085a23-7f85-42a3-95d4-513678f579c4 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdbe35f311e435ba9e0516f302ba519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb116f8d7dd4858a91c03e0a4310fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:38.673658 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bcc0f471-5cea-4888-ab10-a18ecd9aeb98 tempest-HypervisorAdminV253TestBase-535849445 tempest-HypervisorAdminV253TestBase-535849445-project-admin] Calling method '.version_select at 0x7f68e52da310>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:38.681500 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-af085a23-7f85-42a3-95d4-513678f579c4 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] 10.222.0.27 "GET /compute/v2.1/servers/0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc" status: 200 len: 1320 microversion: 2.1 time: 0.421129 Sep 08 10:37:38.683599 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 146/310] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:38 2022] GET /compute/v2.1/servers/0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc => generated 1320 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:38.684513 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bcc0f471-5cea-4888-ab10-a18ecd9aeb98 tempest-HypervisorAdminV253TestBase-535849445 tempest-HypervisorAdminV253TestBase-535849445-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:38.685424 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bcc0f471-5cea-4888-ab10-a18ecd9aeb98 tempest-HypervisorAdminV253TestBase-535849445 tempest-HypervisorAdminV253TestBase-535849445-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:38.685868 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bcc0f471-5cea-4888-ab10-a18ecd9aeb98 tempest-HypervisorAdminV253TestBase-535849445 tempest-HypervisorAdminV253TestBase-535849445-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:38.723722 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bcc0f471-5cea-4888-ab10-a18ecd9aeb98 tempest-HypervisorAdminV253TestBase-535849445 tempest-HypervisorAdminV253TestBase-535849445-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:38.724230 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bcc0f471-5cea-4888-ab10-a18ecd9aeb98 tempest-HypervisorAdminV253TestBase-535849445 tempest-HypervisorAdminV253TestBase-535849445-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:38.724679 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bcc0f471-5cea-4888-ab10-a18ecd9aeb98 tempest-HypervisorAdminV253TestBase-535849445 tempest-HypervisorAdminV253TestBase-535849445-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:38.735298 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bcc0f471-5cea-4888-ab10-a18ecd9aeb98 tempest-HypervisorAdminV253TestBase-535849445 tempest-HypervisorAdminV253TestBase-535849445-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/3a2423be-1d76-46e6-975e-9a7afe825321" status: 200 len: 794 microversion: 2.53 time: 0.073917 Sep 08 10:37:38.737167 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 165/311] 10.222.0.27 () {60 vars in 1298 bytes} [Thu Sep 8 10:37:38 2022] GET /compute/v2.1/os-hypervisors/3a2423be-1d76-46e6-975e-9a7afe825321 => generated 794 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:37:39.027613 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-64124441-8fb4-4a09-b283-738349a985ca tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:39.030991 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-64124441-8fb4-4a09-b283-738349a985ca tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 292d240e-1176-4875-8f87-9ca911437fbe] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:39.036708 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=4 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:37:39.049258 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64124441-8fb4-4a09-b283-738349a985ca tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:39.051856 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64124441-8fb4-4a09-b283-738349a985ca tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:39.053149 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64124441-8fb4-4a09-b283-738349a985ca tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:39.055966 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64124441-8fb4-4a09-b283-738349a985ca tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:39.056514 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64124441-8fb4-4a09-b283-738349a985ca tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:39.058958 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64124441-8fb4-4a09-b283-738349a985ca tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:39.121603 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:37:39.243763 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-32b24f6d-b772-4521-a1c1-e43eda64bcd4 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:39.244374 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-32b24f6d-b772-4521-a1c1-e43eda64bcd4 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: a3147437-e6f2-480d-bcaf-cc0f030d497d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:39.253207 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-32b24f6d-b772-4521-a1c1-e43eda64bcd4 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:39.253715 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-32b24f6d-b772-4521-a1c1-e43eda64bcd4 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:39.254153 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-32b24f6d-b772-4521-a1c1-e43eda64bcd4 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:39.254951 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-32b24f6d-b772-4521-a1c1-e43eda64bcd4 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:39.256471 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-32b24f6d-b772-4521-a1c1-e43eda64bcd4 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:39.261885 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-32b24f6d-b772-4521-a1c1-e43eda64bcd4 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:39.666307 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-32b24f6d-b772-4521-a1c1-e43eda64bcd4 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:39.681015 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-32b24f6d-b772-4521-a1c1-e43eda64bcd4 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/a3147437-e6f2-480d-bcaf-cc0f030d497d" status: 200 len: 1268 microversion: 2.1 time: 0.440829 Sep 08 10:37:39.701760 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 166/312] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:39 2022] GET /compute/v2.1/servers/a3147437-e6f2-480d-bcaf-cc0f030d497d => generated 1268 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:39.716098 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2b4e1bc4-6302-4910-8b25-0af09744ca8f tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:39.717220 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2b4e1bc4-6302-4910-8b25-0af09744ca8f tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] [instance: 0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:39.730619 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2b4e1bc4-6302-4910-8b25-0af09744ca8f tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:39.731122 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2b4e1bc4-6302-4910-8b25-0af09744ca8f tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:39.731565 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2b4e1bc4-6302-4910-8b25-0af09744ca8f tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:39.732282 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2b4e1bc4-6302-4910-8b25-0af09744ca8f tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:39.732744 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2b4e1bc4-6302-4910-8b25-0af09744ca8f tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:39.739357 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2b4e1bc4-6302-4910-8b25-0af09744ca8f tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:39.770542 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-64124441-8fb4-4a09-b283-738349a985ca tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:39.784542 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-64124441-8fb4-4a09-b283-738349a985ca tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:39.793306 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-64124441-8fb4-4a09-b283-738349a985ca tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:39.798235 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-64124441-8fb4-4a09-b283-738349a985ca tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/292d240e-1176-4875-8f87-9ca911437fbe" status: 200 len: 1362 microversion: 2.25 time: 0.775036 Sep 08 10:37:39.799025 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 147/313] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:37:39 2022] GET /compute/v2.1/servers/292d240e-1176-4875-8f87-9ca911437fbe => generated 1362 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:37:40.374126 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2b4e1bc4-6302-4910-8b25-0af09744ca8f tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdbe35f311e435ba9e0516f302ba519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb116f8d7dd4858a91c03e0a4310fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:40.388141 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2b4e1bc4-6302-4910-8b25-0af09744ca8f tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] 10.222.0.27 "GET /compute/v2.1/servers/0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc" status: 200 len: 1469 microversion: 2.1 time: 0.683649 Sep 08 10:37:40.391739 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 167/314] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:39 2022] GET /compute/v2.1/servers/0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc => generated 1469 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:40.431063 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-756880c8-1b82-43cb-aef5-91186f6a6cbb tempest-DeleteServersAdminTestJSON-1323785645 tempest-DeleteServersAdminTestJSON-1323785645-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:40.434103 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-756880c8-1b82-43cb-aef5-91186f6a6cbb tempest-DeleteServersAdminTestJSON-1323785645 tempest-DeleteServersAdminTestJSON-1323785645-project-admin] [instance: 0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:40.454858 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-756880c8-1b82-43cb-aef5-91186f6a6cbb tempest-DeleteServersAdminTestJSON-1323785645 tempest-DeleteServersAdminTestJSON-1323785645-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:40.470164 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-756880c8-1b82-43cb-aef5-91186f6a6cbb tempest-DeleteServersAdminTestJSON-1323785645 tempest-DeleteServersAdminTestJSON-1323785645-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:40.471061 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-756880c8-1b82-43cb-aef5-91186f6a6cbb tempest-DeleteServersAdminTestJSON-1323785645 tempest-DeleteServersAdminTestJSON-1323785645-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:40.474477 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-756880c8-1b82-43cb-aef5-91186f6a6cbb tempest-DeleteServersAdminTestJSON-1323785645 tempest-DeleteServersAdminTestJSON-1323785645-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:40.474998 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-756880c8-1b82-43cb-aef5-91186f6a6cbb tempest-DeleteServersAdminTestJSON-1323785645 tempest-DeleteServersAdminTestJSON-1323785645-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:40.475446 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-756880c8-1b82-43cb-aef5-91186f6a6cbb tempest-DeleteServersAdminTestJSON-1323785645 tempest-DeleteServersAdminTestJSON-1323785645-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:40.657003 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-756880c8-1b82-43cb-aef5-91186f6a6cbb tempest-DeleteServersAdminTestJSON-1323785645 tempest-DeleteServersAdminTestJSON-1323785645-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc/action" status: 202 len: 0 microversion: 2.1 time: 0.239841 Sep 08 10:37:40.660797 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 148/315] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:37:40 2022] POST /compute/v2.1/servers/0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:37:40.666790 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d4a09357-e825-405c-8c92-6824a7983ee7 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:40.667492 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d4a09357-e825-405c-8c92-6824a7983ee7 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] [instance: 0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:40.689680 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d4a09357-e825-405c-8c92-6824a7983ee7 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:40.696300 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d4a09357-e825-405c-8c92-6824a7983ee7 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:40.701739 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d4a09357-e825-405c-8c92-6824a7983ee7 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:40.702504 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d4a09357-e825-405c-8c92-6824a7983ee7 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:40.703074 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d4a09357-e825-405c-8c92-6824a7983ee7 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:40.706265 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d4a09357-e825-405c-8c92-6824a7983ee7 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:40.780636 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d4a09357-e825-405c-8c92-6824a7983ee7 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:40.785653 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d4a09357-e825-405c-8c92-6824a7983ee7 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:40.788202 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d4a09357-e825-405c-8c92-6824a7983ee7 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:40.788921 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-d4a09357-e825-405c-8c92-6824a7983ee7 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lazy-loading 'fault' on Instance uuid 0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:37:41.056844 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-536aa2dd-3f36-4b2a-bc13-0cc7d9cfd96f tempest-FlavorsAccessNegativeTestJSON-1742185309 tempest-FlavorsAccessNegativeTestJSON-1742185309-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-595587748", "id": 1590183204, "os-flavor-access:is_public": "False"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:41.057792 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d4a09357-e825-405c-8c92-6824a7983ee7 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdbe35f311e435ba9e0516f302ba519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb116f8d7dd4858a91c03e0a4310fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:41.070014 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d4a09357-e825-405c-8c92-6824a7983ee7 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] 10.222.0.27 "GET /compute/v2.1/servers/0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc" status: 200 len: 1452 microversion: 2.1 time: 0.407365 Sep 08 10:37:41.070797 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 168/316] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:40 2022] GET /compute/v2.1/servers/0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc => generated 1452 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:41.076021 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e73cc4cb-bf9c-476b-9aa0-7dcce9f851cb tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:41.076871 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e73cc4cb-bf9c-476b-9aa0-7dcce9f851cb tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: a3147437-e6f2-480d-bcaf-cc0f030d497d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:41.083573 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e73cc4cb-bf9c-476b-9aa0-7dcce9f851cb tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:41.084528 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e73cc4cb-bf9c-476b-9aa0-7dcce9f851cb tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:41.085495 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e73cc4cb-bf9c-476b-9aa0-7dcce9f851cb tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:41.086413 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e73cc4cb-bf9c-476b-9aa0-7dcce9f851cb tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:41.087074 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e73cc4cb-bf9c-476b-9aa0-7dcce9f851cb tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:41.087699 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e73cc4cb-bf9c-476b-9aa0-7dcce9f851cb tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:41.121540 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-536aa2dd-3f36-4b2a-bc13-0cc7d9cfd96f tempest-FlavorsAccessNegativeTestJSON-1742185309 tempest-FlavorsAccessNegativeTestJSON-1742185309-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.424537 Sep 08 10:37:41.131440 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 149/317] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:37:40 2022] POST /compute/v2.1/flavors => generated 438 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:37:41.131440 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5d863480-6257-43eb-9755-5599062f930a tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:41.131440 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5d863480-6257-43eb-9755-5599062f930a tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 292d240e-1176-4875-8f87-9ca911437fbe] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:41.142089 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5d863480-6257-43eb-9755-5599062f930a tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:41.144646 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5d863480-6257-43eb-9755-5599062f930a tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:41.145162 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5d863480-6257-43eb-9755-5599062f930a tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:41.145918 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5d863480-6257-43eb-9755-5599062f930a tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:41.146812 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5d863480-6257-43eb-9755-5599062f930a tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:41.147499 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5d863480-6257-43eb-9755-5599062f930a tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:41.265203 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e73cc4cb-bf9c-476b-9aa0-7dcce9f851cb tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:41.276508 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e73cc4cb-bf9c-476b-9aa0-7dcce9f851cb tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/a3147437-e6f2-480d-bcaf-cc0f030d497d" status: 200 len: 1274 microversion: 2.1 time: 0.202294 Sep 08 10:37:41.278610 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 169/318] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:41 2022] GET /compute/v2.1/servers/a3147437-e6f2-480d-bcaf-cc0f030d497d => generated 1274 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:41.288794 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f6f332cf-3371-4b9a-9bb4-d3fd08327307 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:41.296068 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f6f332cf-3371-4b9a-9bb4-d3fd08327307 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] [instance: 0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:41.310325 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f6f332cf-3371-4b9a-9bb4-d3fd08327307 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:41.310988 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f6f332cf-3371-4b9a-9bb4-d3fd08327307 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:41.312659 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f6f332cf-3371-4b9a-9bb4-d3fd08327307 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:41.316418 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f6f332cf-3371-4b9a-9bb4-d3fd08327307 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:41.317189 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f6f332cf-3371-4b9a-9bb4-d3fd08327307 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:41.320021 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f6f332cf-3371-4b9a-9bb4-d3fd08327307 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:41.403462 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f6f332cf-3371-4b9a-9bb4-d3fd08327307 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] [instance: 0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:37:41.573053 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f6f332cf-3371-4b9a-9bb4-d3fd08327307 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc" status: 204 len: 0 microversion: 2.1 time: 0.292613 Sep 08 10:37:41.583544 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 170/319] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:37:41 2022] DELETE /compute/v2.1/servers/0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:37:41.604847 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0d8d628f-018d-4a14-8f2e-0b04eb29952d tempest-FlavorsAccessNegativeTestJSON-1742185309 tempest-FlavorsAccessNegativeTestJSON-1742185309-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "f7be1156a9f640a4b835c250c10048a2"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:41.835853 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5d863480-6257-43eb-9755-5599062f930a tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:41.848217 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5d863480-6257-43eb-9755-5599062f930a tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:41.849737 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5d863480-6257-43eb-9755-5599062f930a tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:41.862545 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5d863480-6257-43eb-9755-5599062f930a tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/292d240e-1176-4875-8f87-9ca911437fbe" status: 200 len: 1362 microversion: 2.25 time: 0.737627 Sep 08 10:37:41.863662 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 150/320] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:37:41 2022] GET /compute/v2.1/servers/292d240e-1176-4875-8f87-9ca911437fbe => generated 1362 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:37:41.874248 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7eeee8e2-e6c7-49fc-96cd-acedbf6235d7 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:41.875048 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7eeee8e2-e6c7-49fc-96cd-acedbf6235d7 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] [instance: 0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:41.903612 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7eeee8e2-e6c7-49fc-96cd-acedbf6235d7 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:41.904650 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7eeee8e2-e6c7-49fc-96cd-acedbf6235d7 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:41.905688 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7eeee8e2-e6c7-49fc-96cd-acedbf6235d7 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:41.906854 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7eeee8e2-e6c7-49fc-96cd-acedbf6235d7 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:41.908189 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7eeee8e2-e6c7-49fc-96cd-acedbf6235d7 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:41.908996 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7eeee8e2-e6c7-49fc-96cd-acedbf6235d7 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:41.992684 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7eeee8e2-e6c7-49fc-96cd-acedbf6235d7 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:41.994624 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7eeee8e2-e6c7-49fc-96cd-acedbf6235d7 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:41.995243 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7eeee8e2-e6c7-49fc-96cd-acedbf6235d7 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:41.996030 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-7eeee8e2-e6c7-49fc-96cd-acedbf6235d7 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lazy-loading 'fault' on Instance uuid 0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:37:42.208108 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0d8d628f-018d-4a14-8f2e-0b04eb29952d tempest-FlavorsAccessNegativeTestJSON-1742185309 tempest-FlavorsAccessNegativeTestJSON-1742185309-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/1590183204/action" status: 200 len: 97 microversion: 2.1 time: 0.622344 Sep 08 10:37:42.209449 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 171/321] 10.222.0.27 () {60 vars in 1200 bytes} [Thu Sep 8 10:37:41 2022] POST /compute/v2.1/flavors/1590183204/action => generated 97 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:37:42.224174 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-39d01882-3736-4bee-b14b-c24813285876 tempest-FlavorsAccessNegativeTestJSON-1742185309 tempest-FlavorsAccessNegativeTestJSON-1742185309-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "f7be1156a9f640a4b835c250c10048a2"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:42.781972 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7eeee8e2-e6c7-49fc-96cd-acedbf6235d7 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdbe35f311e435ba9e0516f302ba519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb116f8d7dd4858a91c03e0a4310fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:42.794696 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7eeee8e2-e6c7-49fc-96cd-acedbf6235d7 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] 10.222.0.27 "GET /compute/v2.1/servers/0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc" status: 200 len: 1458 microversion: 2.1 time: 0.929802 Sep 08 10:37:42.797755 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 151/322] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:41 2022] GET /compute/v2.1/servers/0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc => generated 1458 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:42.803769 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-489421b7-8cc8-4c02-a09f-5fdedc934553 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:42.805978 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-489421b7-8cc8-4c02-a09f-5fdedc934553 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: a3147437-e6f2-480d-bcaf-cc0f030d497d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:42.832662 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-489421b7-8cc8-4c02-a09f-5fdedc934553 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:42.833458 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-489421b7-8cc8-4c02-a09f-5fdedc934553 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:42.833950 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-489421b7-8cc8-4c02-a09f-5fdedc934553 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:42.835304 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-489421b7-8cc8-4c02-a09f-5fdedc934553 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:42.835801 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-489421b7-8cc8-4c02-a09f-5fdedc934553 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:42.836321 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-489421b7-8cc8-4c02-a09f-5fdedc934553 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:42.974835 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-489421b7-8cc8-4c02-a09f-5fdedc934553 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:42.984139 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-489421b7-8cc8-4c02-a09f-5fdedc934553 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/a3147437-e6f2-480d-bcaf-cc0f030d497d" status: 200 len: 1274 microversion: 2.1 time: 0.184845 Sep 08 10:37:42.987276 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 152/323] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:42 2022] GET /compute/v2.1/servers/a3147437-e6f2-480d-bcaf-cc0f030d497d => generated 1274 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:43.006405 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dbfb3b4a-4417-4b0f-988b-7c89e589cd66 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:43.009039 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-dbfb3b4a-4417-4b0f-988b-7c89e589cd66 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 292d240e-1176-4875-8f87-9ca911437fbe] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:43.016184 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dbfb3b4a-4417-4b0f-988b-7c89e589cd66 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:43.017505 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dbfb3b4a-4417-4b0f-988b-7c89e589cd66 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:43.018119 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dbfb3b4a-4417-4b0f-988b-7c89e589cd66 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:43.019155 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dbfb3b4a-4417-4b0f-988b-7c89e589cd66 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:43.020416 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dbfb3b4a-4417-4b0f-988b-7c89e589cd66 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:43.021044 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dbfb3b4a-4417-4b0f-988b-7c89e589cd66 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:43.202210 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-39d01882-3736-4bee-b14b-c24813285876 tempest-FlavorsAccessNegativeTestJSON-1742185309 tempest-FlavorsAccessNegativeTestJSON-1742185309-project-admin] HTTP exception thrown: Flavor access already exists for flavor 32 and project f7be1156a9f640a4b835c250c10048a2 combination. Sep 08 10:37:43.248075 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-39d01882-3736-4bee-b14b-c24813285876 tempest-FlavorsAccessNegativeTestJSON-1742185309 tempest-FlavorsAccessNegativeTestJSON-1742185309-project-admin] Request method failure captured: Sep 08 10:37:43.248075 n-d-850501-12 devstack@n-api.service[128861]: request: POST /compute/v2.1/flavors/1590183204/action HTTP/1.1 Sep 08 10:37:43.248075 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:37:43.248075 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:37:43.248075 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:37:43.248075 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 67 Sep 08 10:37:43.248075 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:37:43.248075 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:37:43.248075 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:37:43.248075 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:37:43.248075 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcXzEBDOHYxbBumFA5zxytZPgurqNxUwCFZqOOSh0Fh8FBc3lE7Roq1WrGBAXYZVVGbuTF75aU35Ag4E0Wd4UjCMkPAZ3BP5Q3dev_F6tFQsjZZmkFUoGmYFh7qLxdCKqD3elpwa2JpdRGpw2uGRof_T1WCFXrmdM0HqVsNjqWbT6oc Sep 08 10:37:43.248075 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:37:43.248075 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:37:43.248075 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:37:43.248075 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:37:43.248075 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:37:43.248075 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:37:43.248075 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 6cd59e0af0434a0286c29582b711d7ae Sep 08 10:37:43.248075 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1742185309 Sep 08 10:37:43.248075 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,admin,member Sep 08 10:37:43.248075 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,admin,member Sep 08 10:37:43.249952 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6cd59e0af0434a0286c29582b711d7ae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6cd59e0af0434a0286c29582b711d7ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6cd59e0af0434a0286c29582b711d7ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6cd59e0af0434a0286c29582b711d7ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:37:43.249952 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1742185309 Sep 08 10:37:43.249952 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 6cd59e0af0434a0286c29582b711d7ae Sep 08 10:37:43.249952 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1742185309 Sep 08 10:37:43.249952 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-FlavorsAccessNegativeTestJSON-1742185309-project-admin Sep 08 10:37:43.249952 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:37:43.249952 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:37:43.249952 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: b7c2d75ff06f4c499e9c3d0e151fe99e Sep 08 10:37:43.249952 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1742185309-project-admin Sep 08 10:37:43.249952 n-d-850501-12 devstack@n-api.service[128861]: Sep 08 10:37:43.249952 n-d-850501-12 devstack@n-api.service[128861]: {"addTenantAccess": {"tenant": "f7be1156a9f640a4b835c250c10048a2"}} Sep 08 10:37:43.249952 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:37:43.250762 n-d-850501-12 devstack@n-api.service[128861]: exception: Flavor access already exists for flavor 32 and project f7be1156a9f640a4b835c250c10048a2 combination. Sep 08 10:37:43.250762 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '1590183204', 'body': {'addTenantAccess': {'tenant': 'f7be1156a9f640a4b835c250c10048a2'}}} Sep 08 10:37:43.250762 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:37:43.250762 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:43.250762 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 08 10:37:43.250762 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 08 10:37:43.250762 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 08 10:37:43.250762 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 08 10:37:43.250762 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 08 10:37:43.250762 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 08 10:37:43.250762 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 08 10:37:43.250762 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 08 10:37:43.250762 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 08 10:37:43.250762 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 08 10:37:43.250762 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 08 10:37:43.250762 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi result.read() Sep 08 10:37:43.250762 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 08 10:37:43.250762 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 08 10:37:43.252422 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 08 10:37:43.252422 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 08 10:37:43.252422 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 08 10:37:43.252422 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 08 10:37:43.252422 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 08 10:37:43.252422 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 08 10:37:43.252422 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '32-f7be1156a9f640a4b835c250c10048a2' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Sep 08 10:37:43.252422 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:43.252422 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 08 10:37:43.252422 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:43.252422 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:43.252422 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Sep 08 10:37:43.252422 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi project.save(context.session) Sep 08 10:37:43.252422 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Sep 08 10:37:43.252422 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi session.flush() Sep 08 10:37:43.252422 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 08 10:37:43.252422 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self._flush(objects) Sep 08 10:37:43.252422 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 08 10:37:43.252422 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Sep 08 10:37:43.260884 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 08 10:37:43.260884 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi compat.raise_( Sep 08 10:37:43.260884 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 08 10:37:43.260884 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception Sep 08 10:37:43.260884 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 08 10:37:43.260884 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi flush_context.execute() Sep 08 10:37:43.260884 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 08 10:37:43.260884 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi rec.execute(self) Sep 08 10:37:43.260884 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 08 10:37:43.260884 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Sep 08 10:37:43.260884 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 08 10:37:43.260884 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Sep 08 10:37:43.260884 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 08 10:37:43.260884 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Sep 08 10:37:43.260884 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 08 10:37:43.260884 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Sep 08 10:37:43.260884 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 08 10:37:43.260884 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Sep 08 10:37:43.264758 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 08 10:37:43.264758 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Sep 08 10:37:43.264758 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 08 10:37:43.264758 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Sep 08 10:37:43.264758 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 08 10:37:43.264758 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 08 10:37:43.264758 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 08 10:37:43.264758 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception Sep 08 10:37:43.264758 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 08 10:37:43.264758 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 08 10:37:43.264758 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 08 10:37:43.264758 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 08 10:37:43.264758 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 08 10:37:43.264758 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 08 10:37:43.264758 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 08 10:37:43.264758 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 08 10:37:43.264758 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 08 10:37:43.264758 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 08 10:37:43.272002 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 08 10:37:43.272002 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi result.read() Sep 08 10:37:43.272002 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 08 10:37:43.272002 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 08 10:37:43.272002 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 08 10:37:43.272002 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 08 10:37:43.272002 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 08 10:37:43.272002 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 08 10:37:43.272002 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 08 10:37:43.272002 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 08 10:37:43.272002 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '32-f7be1156a9f640a4b835c250c10048a2' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Sep 08 10:37:43.272002 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Sep 08 10:37:43.272002 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 9, 8, 10, 37, 43, 196686), 'updated_at': None, 'flavor_id': 32, 'project_id': 'f7be1156a9f640a4b835c250c10048a2'}] Sep 08 10:37:43.272002 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 08 10:37:43.272002 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:43.272002 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:43.272002 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:43.277562 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:43.277562 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Sep 08 10:37:43.277562 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Sep 08 10:37:43.277562 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 08 10:37:43.277562 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 08 10:37:43.277562 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Sep 08 10:37:43.277562 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Sep 08 10:37:43.277562 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Sep 08 10:37:43.277562 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Sep 08 10:37:43.277562 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Sep 08 10:37:43.277562 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Sep 08 10:37:43.277562 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 08 10:37:43.277562 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 08 10:37:43.277562 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Sep 08 10:37:43.277562 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Sep 08 10:37:43.277562 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 32 and project f7be1156a9f640a4b835c250c10048a2 combination. Sep 08 10:37:43.277562 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:43.277562 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:43.277562 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:43.285102 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:43.285102 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:43.285102 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:43.285102 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:37:43.285102 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:37:43.285102 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:37:43.285102 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:37:43.285102 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:37:43.285102 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:37:43.285102 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Sep 08 10:37:43.285102 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Sep 08 10:37:43.285102 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 32 and project f7be1156a9f640a4b835c250c10048a2 combination. Sep 08 10:37:43.285102 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:43.285102 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:43.285102 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:43.285102 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:43.285102 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:43.285102 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:43.285102 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:37:43.285102 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:37:43.290847 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 32 and project f7be1156a9f640a4b835c250c10048a2 combination. Sep 08 10:37:43.290847 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:43.292083 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-39d01882-3736-4bee-b14b-c24813285876 tempest-FlavorsAccessNegativeTestJSON-1742185309 tempest-FlavorsAccessNegativeTestJSON-1742185309-project-admin] Returning 409 to user: Flavor access already exists for flavor 32 and project f7be1156a9f640a4b835c250c10048a2 combination. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:37:43.296448 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-39d01882-3736-4bee-b14b-c24813285876 tempest-FlavorsAccessNegativeTestJSON-1742185309 tempest-FlavorsAccessNegativeTestJSON-1742185309-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/1590183204/action" status: 409 len: 152 microversion: 2.1 time: 1.077583 Sep 08 10:37:43.300620 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 172/324] 10.222.0.27 () {60 vars in 1200 bytes} [Thu Sep 8 10:37:42 2022] POST /compute/v2.1/flavors/1590183204/action => generated 152 bytes in 1086 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 08 10:37:43.329445 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-185233af-cb9a-49aa-b741-5227bc8b2ccc tempest-FlavorsAccessNegativeTestJSON-1742185309 tempest-FlavorsAccessNegativeTestJSON-1742185309-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "f7be1156a9f640a4b835c250c10048a2"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:43.405390 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-dbfb3b4a-4417-4b0f-988b-7c89e589cd66 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:43.430539 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-dbfb3b4a-4417-4b0f-988b-7c89e589cd66 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:43.433963 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-dbfb3b4a-4417-4b0f-988b-7c89e589cd66 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:43.435779 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-dbfb3b4a-4417-4b0f-988b-7c89e589cd66 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/292d240e-1176-4875-8f87-9ca911437fbe" status: 200 len: 1362 microversion: 2.25 time: 0.447275 Sep 08 10:37:43.437010 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 153/325] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:37:42 2022] GET /compute/v2.1/servers/292d240e-1176-4875-8f87-9ca911437fbe => generated 1362 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:37:43.834587 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d21e86a3-dd37-4b97-9d87-99f1a7f776cb tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:43.835203 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d21e86a3-dd37-4b97-9d87-99f1a7f776cb tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] [instance: 0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:43.857739 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d21e86a3-dd37-4b97-9d87-99f1a7f776cb tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:43.858414 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d21e86a3-dd37-4b97-9d87-99f1a7f776cb tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:43.858576 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d21e86a3-dd37-4b97-9d87-99f1a7f776cb tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:43.861690 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d21e86a3-dd37-4b97-9d87-99f1a7f776cb tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:43.863258 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d21e86a3-dd37-4b97-9d87-99f1a7f776cb tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:43.863767 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d21e86a3-dd37-4b97-9d87-99f1a7f776cb tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:43.951932 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d21e86a3-dd37-4b97-9d87-99f1a7f776cb tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:43.952428 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d21e86a3-dd37-4b97-9d87-99f1a7f776cb tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:43.952864 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d21e86a3-dd37-4b97-9d87-99f1a7f776cb tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:43.955323 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-d21e86a3-dd37-4b97-9d87-99f1a7f776cb tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lazy-loading 'fault' on Instance uuid 0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:37:44.047228 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-185233af-cb9a-49aa-b741-5227bc8b2ccc tempest-FlavorsAccessNegativeTestJSON-1742185309 tempest-FlavorsAccessNegativeTestJSON-1742185309-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/1590183204/action" status: 200 len: 21 microversion: 2.1 time: 0.738082 Sep 08 10:37:44.048589 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 173/326] 10.222.0.27 () {60 vars in 1200 bytes} [Thu Sep 8 10:37:43 2022] POST /compute/v2.1/flavors/1590183204/action => generated 21 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:37:44.066986 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-face0c05-33b9-4eeb-8e29-c3cfb8f23c45 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:44.068737 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-face0c05-33b9-4eeb-8e29-c3cfb8f23c45 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: a3147437-e6f2-480d-bcaf-cc0f030d497d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:44.092061 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-face0c05-33b9-4eeb-8e29-c3cfb8f23c45 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:44.093556 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-face0c05-33b9-4eeb-8e29-c3cfb8f23c45 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:44.094322 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-face0c05-33b9-4eeb-8e29-c3cfb8f23c45 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:44.097991 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-face0c05-33b9-4eeb-8e29-c3cfb8f23c45 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:44.098770 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-face0c05-33b9-4eeb-8e29-c3cfb8f23c45 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:44.099769 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-face0c05-33b9-4eeb-8e29-c3cfb8f23c45 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:44.109791 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d21e86a3-dd37-4b97-9d87-99f1a7f776cb tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdbe35f311e435ba9e0516f302ba519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb116f8d7dd4858a91c03e0a4310fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:44.162072 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d21e86a3-dd37-4b97-9d87-99f1a7f776cb tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] 10.222.0.27 "GET /compute/v2.1/servers/0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc" status: 200 len: 1416 microversion: 2.1 time: 0.327537 Sep 08 10:37:44.165558 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 154/327] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:43 2022] GET /compute/v2.1/servers/0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc => generated 1416 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:44.173229 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ba20d704-97b1-4a60-a9d8-4e2173c2efcd tempest-FlavorsAccessNegativeTestJSON-1742185309 tempest-FlavorsAccessNegativeTestJSON-1742185309-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:44.239269 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ba20d704-97b1-4a60-a9d8-4e2173c2efcd tempest-FlavorsAccessNegativeTestJSON-1742185309 tempest-FlavorsAccessNegativeTestJSON-1742185309-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1590183204" status: 202 len: 0 microversion: 2.1 time: 0.071478 Sep 08 10:37:44.244788 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 155/328] 10.222.0.27 () {58 vars in 1161 bytes} [Thu Sep 8 10:37:44 2022] DELETE /compute/v2.1/flavors/1590183204 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:37:44.267834 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-be927546-6898-47fd-9dee-d7a795eb523d req-3ff16013-a508-4299-b1be-16870284f2fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc", "name": "network-vif-deleted", "tag": "f417b3b4-4ba4-4d76-9929-ee95e97b0ee9"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:44.301191 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-be927546-6898-47fd-9dee-d7a795eb523d req-3ff16013-a508-4299-b1be-16870284f2fc service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:44.302812 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-be927546-6898-47fd-9dee-d7a795eb523d req-3ff16013-a508-4299-b1be-16870284f2fc service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:44.304821 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-be927546-6898-47fd-9dee-d7a795eb523d req-3ff16013-a508-4299-b1be-16870284f2fc service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:44.331862 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-be927546-6898-47fd-9dee-d7a795eb523d req-3ff16013-a508-4299-b1be-16870284f2fc service nova] Creating event network-vif-deleted:f417b3b4-4ba4-4d76-9929-ee95e97b0ee9 for instance 0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc on n-h2-850501-12 Sep 08 10:37:44.338748 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-be927546-6898-47fd-9dee-d7a795eb523d req-3ff16013-a508-4299-b1be-16870284f2fc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089998 Sep 08 10:37:44.339962 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 156/329] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:37:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:37:44.347321 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e3747593-9c32-4bca-9f05-3e56e1e8a46c tempest-FlavorsAccessNegativeTestJSON-1742185309 tempest-FlavorsAccessNegativeTestJSON-1742185309-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:44.412363 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e3747593-9c32-4bca-9f05-3e56e1e8a46c tempest-FlavorsAccessNegativeTestJSON-1742185309 tempest-FlavorsAccessNegativeTestJSON-1742185309-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.070787 Sep 08 10:37:44.427121 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 157/330] 10.222.0.27 () {58 vars in 1146 bytes} [Thu Sep 8 10:37:44 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:44.445636 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9c094dd7-1c83-48cd-b0bf-c0ce2d00b939 tempest-FlavorsAccessNegativeTestJSON-1742185309 tempest-FlavorsAccessNegativeTestJSON-1742185309-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1792841352", "id": 517674032, "os-flavor-access:is_public": "True"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:44.472113 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9c094dd7-1c83-48cd-b0bf-c0ce2d00b939 tempest-FlavorsAccessNegativeTestJSON-1742185309 tempest-FlavorsAccessNegativeTestJSON-1742185309-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.039587 Sep 08 10:37:44.480998 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 158/331] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:37:44 2022] POST /compute/v2.1/flavors => generated 435 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:37:44.488430 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-26c29df7-3ff7-4bbb-b980-10b8ebd272af tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:44.489845 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-26c29df7-3ff7-4bbb-b980-10b8ebd272af tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 292d240e-1176-4875-8f87-9ca911437fbe] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:44.498242 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-26c29df7-3ff7-4bbb-b980-10b8ebd272af tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:44.500434 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-26c29df7-3ff7-4bbb-b980-10b8ebd272af tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:44.501545 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-26c29df7-3ff7-4bbb-b980-10b8ebd272af tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:44.502450 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-26c29df7-3ff7-4bbb-b980-10b8ebd272af tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:44.503071 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-26c29df7-3ff7-4bbb-b980-10b8ebd272af tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:44.504750 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-26c29df7-3ff7-4bbb-b980-10b8ebd272af tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:44.635659 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-face0c05-33b9-4eeb-8e29-c3cfb8f23c45 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:44.644307 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-face0c05-33b9-4eeb-8e29-c3cfb8f23c45 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/a3147437-e6f2-480d-bcaf-cc0f030d497d" status: 200 len: 1316 microversion: 2.1 time: 0.591917 Sep 08 10:37:44.666978 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 174/332] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:44 2022] GET /compute/v2.1/servers/a3147437-e6f2-480d-bcaf-cc0f030d497d => generated 1316 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:44.677469 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1e403688-a74f-4f91-889c-68c93ebb184d tempest-FlavorsAccessNegativeTestJSON-1742185309 tempest-FlavorsAccessNegativeTestJSON-1742185309-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:44.693940 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-1e403688-a74f-4f91-889c-68c93ebb184d tempest-FlavorsAccessNegativeTestJSON-1742185309 tempest-FlavorsAccessNegativeTestJSON-1742185309-project-admin] HTTP exception thrown: Access list not available for public flavors. Sep 08 10:37:44.696365 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1e403688-a74f-4f91-889c-68c93ebb184d tempest-FlavorsAccessNegativeTestJSON-1742185309 tempest-FlavorsAccessNegativeTestJSON-1742185309-project-admin] Request method failure captured: Sep 08 10:37:44.696365 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/flavors/517674032/os-flavor-access HTTP/1.1 Sep 08 10:37:44.696365 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:37:44.696365 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:37:44.696365 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:37:44.696365 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:37:44.696365 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:37:44.696365 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:37:44.696365 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:37:44.696365 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:37:44.696365 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcXzEBDOHYxbBumFA5zxytZPgurqNxUwCFZqOOSh0Fh8FBc3lE7Roq1WrGBAXYZVVGbuTF75aU35Ag4E0Wd4UjCMkPAZ3BP5Q3dev_F6tFQsjZZmkFUoGmYFh7qLxdCKqD3elpwa2JpdRGpw2uGRof_T1WCFXrmdM0HqVsNjqWbT6oc Sep 08 10:37:44.696365 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:37:44.696365 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:37:44.696365 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:37:44.696365 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:37:44.696365 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:37:44.696365 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:37:44.696365 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 6cd59e0af0434a0286c29582b711d7ae Sep 08 10:37:44.696365 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1742185309 Sep 08 10:37:44.696365 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,admin,member Sep 08 10:37:44.696365 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,admin,member Sep 08 10:37:44.697891 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6cd59e0af0434a0286c29582b711d7ae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6cd59e0af0434a0286c29582b711d7ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6cd59e0af0434a0286c29582b711d7ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6cd59e0af0434a0286c29582b711d7ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:37:44.697891 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1742185309 Sep 08 10:37:44.697891 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 6cd59e0af0434a0286c29582b711d7ae Sep 08 10:37:44.697891 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1742185309 Sep 08 10:37:44.697891 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-FlavorsAccessNegativeTestJSON-1742185309-project-admin Sep 08 10:37:44.697891 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:37:44.697891 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:37:44.697891 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: b7c2d75ff06f4c499e9c3d0e151fe99e Sep 08 10:37:44.697891 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1742185309-project-admin Sep 08 10:37:44.697891 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:37:44.697891 n-d-850501-12 devstack@n-api.service[128861]: exception: Access list not available for public flavors. Sep 08 10:37:44.697891 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'flavor_id': '517674032'} Sep 08 10:37:44.698733 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:37:44.698733 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:44.698733 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:44.698733 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:44.698733 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:37:44.698733 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:37:44.698733 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:37:44.698733 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:37:44.698733 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Sep 08 10:37:44.698733 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 08 10:37:44.698733 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Sep 08 10:37:44.698733 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:44.698733 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:44.698733 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:44.698733 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:44.698733 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:44.698733 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:44.698733 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:37:44.698733 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:37:44.698733 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Sep 08 10:37:44.698733 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:44.700783 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1e403688-a74f-4f91-889c-68c93ebb184d tempest-FlavorsAccessNegativeTestJSON-1742185309 tempest-FlavorsAccessNegativeTestJSON-1742185309-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:37:44.702987 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1e403688-a74f-4f91-889c-68c93ebb184d tempest-FlavorsAccessNegativeTestJSON-1742185309 tempest-FlavorsAccessNegativeTestJSON-1742185309-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/517674032/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.034993 Sep 08 10:37:44.703543 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 175/333] 10.222.0.27 () {58 vars in 1206 bytes} [Thu Sep 8 10:37:44 2022] GET /compute/v2.1/flavors/517674032/os-flavor-access => generated 91 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:37:44.717277 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e82ed7ca-0519-4878-be9d-8e09f7012f7d tempest-FlavorsAccessNegativeTestJSON-1742185309 tempest-FlavorsAccessNegativeTestJSON-1742185309-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:44.755954 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e82ed7ca-0519-4878-be9d-8e09f7012f7d tempest-FlavorsAccessNegativeTestJSON-1742185309 tempest-FlavorsAccessNegativeTestJSON-1742185309-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/517674032" status: 202 len: 0 microversion: 2.1 time: 0.047364 Sep 08 10:37:44.757100 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 176/334] 10.222.0.27 () {58 vars in 1158 bytes} [Thu Sep 8 10:37:44 2022] DELETE /compute/v2.1/flavors/517674032 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:37:44.773345 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2c974646-ea6b-4dfb-a8ff-0839d9b56986 tempest-FlavorsAccessNegativeTestJSON-1742185309 tempest-FlavorsAccessNegativeTestJSON-1742185309-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:44.813220 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2c974646-ea6b-4dfb-a8ff-0839d9b56986 tempest-FlavorsAccessNegativeTestJSON-1742185309 tempest-FlavorsAccessNegativeTestJSON-1742185309-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.043375 Sep 08 10:37:44.816771 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 177/335] 10.222.0.27 () {58 vars in 1146 bytes} [Thu Sep 8 10:37:44 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:44.848205 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5e085d83-cd7e-4b9b-b357-f4414221b40d tempest-FlavorsAccessNegativeTestJSON-1742185309 tempest-FlavorsAccessNegativeTestJSON-1742185309-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1440583119", "id": 1008627643, "os-flavor-access:is_public": "False"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:44.894383 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5e085d83-cd7e-4b9b-b357-f4414221b40d tempest-FlavorsAccessNegativeTestJSON-1742185309 tempest-FlavorsAccessNegativeTestJSON-1742185309-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.050269 Sep 08 10:37:44.895326 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 178/336] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:37:44 2022] POST /compute/v2.1/flavors => generated 439 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:37:45.090727 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-26c29df7-3ff7-4bbb-b980-10b8ebd272af tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:45.111610 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-26c29df7-3ff7-4bbb-b980-10b8ebd272af tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:45.112956 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-26c29df7-3ff7-4bbb-b980-10b8ebd272af tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:45.116267 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-26c29df7-3ff7-4bbb-b980-10b8ebd272af tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/292d240e-1176-4875-8f87-9ca911437fbe" status: 200 len: 1362 microversion: 2.25 time: 0.633771 Sep 08 10:37:45.139389 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 159/337] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:37:44 2022] GET /compute/v2.1/servers/292d240e-1176-4875-8f87-9ca911437fbe => generated 1362 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:37:45.194710 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c6f277e5-bec9-4b24-af23-499581fe2599 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:45.195685 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c6f277e5-bec9-4b24-af23-499581fe2599 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] [instance: 0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:45.203937 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c6f277e5-bec9-4b24-af23-499581fe2599 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:45.205381 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c6f277e5-bec9-4b24-af23-499581fe2599 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:45.206569 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c6f277e5-bec9-4b24-af23-499581fe2599 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:45.208336 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c6f277e5-bec9-4b24-af23-499581fe2599 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:45.209733 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c6f277e5-bec9-4b24-af23-499581fe2599 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:45.210843 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c6f277e5-bec9-4b24-af23-499581fe2599 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:45.260747 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-c6f277e5-bec9-4b24-af23-499581fe2599 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] HTTP exception thrown: Instance 0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc could not be found. Sep 08 10:37:45.267483 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c6f277e5-bec9-4b24-af23-499581fe2599 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Request method failure captured: Sep 08 10:37:45.267483 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc HTTP/1.1 Sep 08 10:37:45.267483 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:37:45.267483 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:37:45.267483 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:37:45.267483 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:37:45.267483 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:37:45.267483 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:37:45.267483 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:37:45.267483 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:37:45.267483 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcW3Cf6YoBWqaJLIIYaTO1fiMbOcWzpwHj6KKsufXrmQTTVhvcr8sv7TsKPAB8KFmxSVgs668LgkXMpgIKGyhAFeUTzWwcB0c1DtXy5FfOUaR2q9un-0uNPllUCMWrAPu7rKctDIn0-L_U6zEGJ4HdMYUVYI6y-HKkHNnc0-XO9pkIs Sep 08 10:37:45.267483 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:37:45.267483 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:37:45.267483 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:37:45.267483 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:37:45.267483 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:37:45.267483 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:37:45.267483 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 2eb116f8d7dd4858a91c03e0a4310fa9 Sep 08 10:37:45.267483 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1505808489 Sep 08 10:37:45.267483 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:37:45.267483 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:37:45.268844 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2eb116f8d7dd4858a91c03e0a4310fa9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2eb116f8d7dd4858a91c03e0a4310fa9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2eb116f8d7dd4858a91c03e0a4310fa9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2eb116f8d7dd4858a91c03e0a4310fa9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:37:45.268844 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-DeleteServersAdminTestJSON-1505808489 Sep 08 10:37:45.268844 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 2eb116f8d7dd4858a91c03e0a4310fa9 Sep 08 10:37:45.268844 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1505808489 Sep 08 10:37:45.268844 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-DeleteServersAdminTestJSON-1505808489-project Sep 08 10:37:45.268844 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:37:45.268844 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:37:45.268844 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 6fdbe35f311e435ba9e0516f302ba519 Sep 08 10:37:45.268844 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-DeleteServersAdminTestJSON-1505808489-project Sep 08 10:37:45.268844 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:37:45.268844 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc could not be found. Sep 08 10:37:45.268844 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc'} Sep 08 10:37:45.269579 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:37:45.269579 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:45.269579 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:37:45.269579 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:37:45.269579 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:37:45.269579 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:37:45.269579 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:37:45.269579 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:37:45.269579 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:37:45.269579 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:37:45.269579 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc could not be found. Sep 08 10:37:45.269579 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:45.269579 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:45.269579 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:45.269579 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:45.269579 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:45.269579 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:45.269579 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:37:45.269579 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:37:45.269579 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:37:45.270667 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:37:45.270667 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:37:45.270667 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:37:45.270667 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:37:45.270667 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:37:45.270667 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:37:45.270667 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:37:45.270667 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc could not be found. Sep 08 10:37:45.270667 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:45.270667 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:45.270667 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:45.270667 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:45.270667 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:45.270667 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:45.270667 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:37:45.270667 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:37:45.270667 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc could not be found. Sep 08 10:37:45.270667 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:45.274627 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c6f277e5-bec9-4b24-af23-499581fe2599 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Returning 404 to user: Instance 0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:37:45.280938 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c6f277e5-bec9-4b24-af23-499581fe2599 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] 10.222.0.27 "GET /compute/v2.1/servers/0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc" status: 404 len: 111 microversion: 2.1 time: 0.095906 Sep 08 10:37:45.283732 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 160/338] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:45 2022] GET /compute/v2.1/servers/0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:37:45.284756 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0500cd31-17f7-4fb5-98a1-dd688eda01b7 tempest-FlavorsAccessNegativeTestJSON-1813856669 tempest-FlavorsAccessNegativeTestJSON-1813856669-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "f7be1156a9f640a4b835c250c10048a2"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:45.288107 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0500cd31-17f7-4fb5-98a1-dd688eda01b7 tempest-FlavorsAccessNegativeTestJSON-1813856669 tempest-FlavorsAccessNegativeTestJSON-1813856669-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '22efb3f968be4d0d8417a15425816e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7be1156a9f640a4b835c250c10048a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:45.294228 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0500cd31-17f7-4fb5-98a1-dd688eda01b7 tempest-FlavorsAccessNegativeTestJSON-1813856669 tempest-FlavorsAccessNegativeTestJSON-1813856669-project] Request method failure captured: Sep 08 10:37:45.294228 n-d-850501-12 devstack@n-api.service[128861]: request: POST /compute/v2.1/flavors/1008627643/action HTTP/1.1 Sep 08 10:37:45.294228 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:37:45.294228 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:37:45.294228 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:37:45.294228 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 67 Sep 08 10:37:45.294228 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:37:45.294228 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:37:45.294228 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:37:45.294228 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:37:45.294228 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcXxwCzN25-K7AsFfoL9pjeZp5KFXK3GYBCPb85_y9pB09PUMe7c4K4u6zvDXUiq8SQ5VA_lb8bkEyV1asYNHz60jWXVManQZWv4yEIzMS-i78A7UdaYMd9WElYUMJ5U9M2Di9_9dln4zGqBYVcU6Z086VREwVEOSFrP7YPIn6EcgS4 Sep 08 10:37:45.294228 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:37:45.294228 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:37:45.294228 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:37:45.294228 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:37:45.294228 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:37:45.294228 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:37:45.294228 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: f7be1156a9f640a4b835c250c10048a2 Sep 08 10:37:45.294228 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1813856669 Sep 08 10:37:45.294228 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:37:45.294228 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:37:45.295712 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f7be1156a9f640a4b835c250c10048a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f7be1156a9f640a4b835c250c10048a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f7be1156a9f640a4b835c250c10048a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f7be1156a9f640a4b835c250c10048a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:37:45.295712 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1813856669 Sep 08 10:37:45.295712 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: f7be1156a9f640a4b835c250c10048a2 Sep 08 10:37:45.295712 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1813856669 Sep 08 10:37:45.295712 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-FlavorsAccessNegativeTestJSON-1813856669-project Sep 08 10:37:45.295712 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:37:45.295712 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:37:45.295712 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 22efb3f968be4d0d8417a15425816e89 Sep 08 10:37:45.295712 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1813856669-project Sep 08 10:37:45.295712 n-d-850501-12 devstack@n-api.service[128861]: Sep 08 10:37:45.295712 n-d-850501-12 devstack@n-api.service[128861]: {"addTenantAccess": {"tenant": "f7be1156a9f640a4b835c250c10048a2"}} Sep 08 10:37:45.295712 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:37:45.296630 n-d-850501-12 devstack@n-api.service[128861]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Sep 08 10:37:45.296630 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '1008627643', 'body': {'addTenantAccess': {'tenant': 'f7be1156a9f640a4b835c250c10048a2'}}} Sep 08 10:37:45.296630 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:37:45.296630 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:45.296630 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:45.296630 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:45.296630 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:37:45.296630 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:37:45.296630 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:37:45.296630 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:37:45.296630 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:37:45.296630 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:37:45.296630 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Sep 08 10:37:45.296630 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Sep 08 10:37:45.296630 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 10:37:45.296630 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 10:37:45.296630 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 10:37:45.296630 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 10:37:45.296630 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:37:45.298578 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:37:45.298578 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:37:45.298578 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:37:45.298578 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 10:37:45.298578 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 10:37:45.298578 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 10:37:45.298578 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 10:37:45.298578 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 10:37:45.298578 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 10:37:45.298578 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Sep 08 10:37:45.298578 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:45.298578 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:45.298578 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:45.298578 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:45.298578 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:45.298578 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:45.298578 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 10:37:45.298578 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 10:37:45.298578 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Sep 08 10:37:45.298578 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:45.300422 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0500cd31-17f7-4fb5-98a1-dd688eda01b7 tempest-FlavorsAccessNegativeTestJSON-1813856669 tempest-FlavorsAccessNegativeTestJSON-1813856669-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:37:45.303621 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0500cd31-17f7-4fb5-98a1-dd688eda01b7 tempest-FlavorsAccessNegativeTestJSON-1813856669 tempest-FlavorsAccessNegativeTestJSON-1813856669-project] 10.222.0.27 "POST /compute/v2.1/flavors/1008627643/action" status: 403 len: 130 microversion: 2.1 time: 0.398345 Sep 08 10:37:45.305317 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 179/339] 10.222.0.27 () {60 vars in 1200 bytes} [Thu Sep 8 10:37:44 2022] POST /compute/v2.1/flavors/1008627643/action => generated 130 bytes in 402 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 08 10:37:45.313462 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fcd69dd8-0e25-4777-bb5c-72e7a61df89c tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:45.313971 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fcd69dd8-0e25-4777-bb5c-72e7a61df89c tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] [instance: 0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:45.318666 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8cb6d520-3769-4799-b636-ff9e90247d1f tempest-FlavorsAccessNegativeTestJSON-1742185309 tempest-FlavorsAccessNegativeTestJSON-1742185309-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:45.325330 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fcd69dd8-0e25-4777-bb5c-72e7a61df89c tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:45.326075 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fcd69dd8-0e25-4777-bb5c-72e7a61df89c tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:45.327275 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fcd69dd8-0e25-4777-bb5c-72e7a61df89c tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:45.343192 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fcd69dd8-0e25-4777-bb5c-72e7a61df89c tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:45.346677 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fcd69dd8-0e25-4777-bb5c-72e7a61df89c tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:45.347400 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fcd69dd8-0e25-4777-bb5c-72e7a61df89c tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:45.364631 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8cb6d520-3769-4799-b636-ff9e90247d1f tempest-FlavorsAccessNegativeTestJSON-1742185309 tempest-FlavorsAccessNegativeTestJSON-1742185309-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1008627643" status: 202 len: 0 microversion: 2.1 time: 0.055606 Sep 08 10:37:45.365358 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 180/340] 10.222.0.27 () {58 vars in 1161 bytes} [Thu Sep 8 10:37:45 2022] DELETE /compute/v2.1/flavors/1008627643 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:37:45.374065 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0fd1f7d7-da4c-497a-ac1c-94519facd276 tempest-FlavorsAccessNegativeTestJSON-1742185309 tempest-FlavorsAccessNegativeTestJSON-1742185309-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:45.381391 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-fcd69dd8-0e25-4777-bb5c-72e7a61df89c tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] HTTP exception thrown: Instance 0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc could not be found. Sep 08 10:37:45.384537 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fcd69dd8-0e25-4777-bb5c-72e7a61df89c tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Request method failure captured: Sep 08 10:37:45.384537 n-d-850501-12 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/servers/0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc HTTP/1.1 Sep 08 10:37:45.384537 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:37:45.384537 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:37:45.384537 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:37:45.384537 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:37:45.384537 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:37:45.384537 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:37:45.384537 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:37:45.384537 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:37:45.384537 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcW3Cf6YoBWqaJLIIYaTO1fiMbOcWzpwHj6KKsufXrmQTTVhvcr8sv7TsKPAB8KFmxSVgs668LgkXMpgIKGyhAFeUTzWwcB0c1DtXy5FfOUaR2q9un-0uNPllUCMWrAPu7rKctDIn0-L_U6zEGJ4HdMYUVYI6y-HKkHNnc0-XO9pkIs Sep 08 10:37:45.384537 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:37:45.384537 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:37:45.384537 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:37:45.384537 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:37:45.384537 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:37:45.384537 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:37:45.384537 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 2eb116f8d7dd4858a91c03e0a4310fa9 Sep 08 10:37:45.384537 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1505808489 Sep 08 10:37:45.384537 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:37:45.384537 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:37:45.386035 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2eb116f8d7dd4858a91c03e0a4310fa9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2eb116f8d7dd4858a91c03e0a4310fa9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2eb116f8d7dd4858a91c03e0a4310fa9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2eb116f8d7dd4858a91c03e0a4310fa9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:37:45.386035 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-DeleteServersAdminTestJSON-1505808489 Sep 08 10:37:45.386035 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 2eb116f8d7dd4858a91c03e0a4310fa9 Sep 08 10:37:45.386035 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1505808489 Sep 08 10:37:45.386035 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-DeleteServersAdminTestJSON-1505808489-project Sep 08 10:37:45.386035 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:37:45.386035 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:37:45.386035 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 6fdbe35f311e435ba9e0516f302ba519 Sep 08 10:37:45.386035 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-DeleteServersAdminTestJSON-1505808489-project Sep 08 10:37:45.386035 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:37:45.386035 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc could not be found. Sep 08 10:37:45.386035 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc'} Sep 08 10:37:45.386910 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:37:45.386910 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:45.386910 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:37:45.386910 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:37:45.386910 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:37:45.386910 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:37:45.386910 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:37:45.386910 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:37:45.386910 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:37:45.386910 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:37:45.386910 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc could not be found. Sep 08 10:37:45.386910 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:45.386910 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:45.386910 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:45.386910 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:45.386910 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:45.386910 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:45.386910 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:37:45.386910 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:37:45.386910 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:37:45.388419 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:37:45.388419 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:37:45.388419 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:37:45.388419 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:37:45.388419 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:37:45.388419 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:37:45.388419 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:37:45.388419 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:37:45.388419 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:37:45.388419 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc could not be found. Sep 08 10:37:45.388419 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:45.388419 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:45.388419 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:45.388419 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:45.388419 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:45.388419 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:45.388419 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:37:45.388419 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:37:45.388419 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc could not be found. Sep 08 10:37:45.388419 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:45.394724 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fcd69dd8-0e25-4777-bb5c-72e7a61df89c tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Returning 404 to user: Instance 0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:37:45.395783 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fcd69dd8-0e25-4777-bb5c-72e7a61df89c tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc" status: 404 len: 111 microversion: 2.1 time: 0.105501 Sep 08 10:37:45.406274 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 161/341] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:37:45 2022] DELETE /compute/v2.1/servers/0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:37:45.422158 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0fd1f7d7-da4c-497a-ac1c-94519facd276 tempest-FlavorsAccessNegativeTestJSON-1742185309 tempest-FlavorsAccessNegativeTestJSON-1742185309-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.051577 Sep 08 10:37:45.423603 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 181/342] 10.222.0.27 () {58 vars in 1146 bytes} [Thu Sep 8 10:37:45 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:45.443777 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-614342fd-66c5-452d-bae2-2342b6509959 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:45.445108 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-614342fd-66c5-452d-bae2-2342b6509959 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] [instance: 0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:45.446262 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2568d44c-fb65-4fdd-bcf3-2792a37b7062 tempest-FlavorsAccessNegativeTestJSON-1742185309 tempest-FlavorsAccessNegativeTestJSON-1742185309-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-509646083", "id": 2141322514, "os-flavor-access:is_public": "False"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:45.462940 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-614342fd-66c5-452d-bae2-2342b6509959 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:45.463464 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-614342fd-66c5-452d-bae2-2342b6509959 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:45.464865 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-614342fd-66c5-452d-bae2-2342b6509959 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:45.464865 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-614342fd-66c5-452d-bae2-2342b6509959 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:45.467508 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-614342fd-66c5-452d-bae2-2342b6509959 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:45.468650 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-614342fd-66c5-452d-bae2-2342b6509959 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:45.486149 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2568d44c-fb65-4fdd-bcf3-2792a37b7062 tempest-FlavorsAccessNegativeTestJSON-1742185309 tempest-FlavorsAccessNegativeTestJSON-1742185309-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.042892 Sep 08 10:37:45.487484 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 182/343] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:37:45 2022] POST /compute/v2.1/flavors => generated 438 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:37:45.502159 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-505a5038-badc-4f09-9363-0d2c57d5d09f tempest-FlavorsAccessNegativeTestJSON-1742185309 tempest-FlavorsAccessNegativeTestJSON-1742185309-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "f7be1156a9f640a4b835c250c10048a2"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:45.504790 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-614342fd-66c5-452d-bae2-2342b6509959 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] HTTP exception thrown: Instance 0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc could not be found. Sep 08 10:37:45.506396 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-614342fd-66c5-452d-bae2-2342b6509959 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Request method failure captured: Sep 08 10:37:45.506396 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc HTTP/1.1 Sep 08 10:37:45.506396 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:37:45.506396 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:37:45.506396 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:37:45.506396 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:37:45.506396 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:37:45.506396 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:37:45.506396 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:37:45.506396 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:37:45.506396 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcW3Cf6YoBWqaJLIIYaTO1fiMbOcWzpwHj6KKsufXrmQTTVhvcr8sv7TsKPAB8KFmxSVgs668LgkXMpgIKGyhAFeUTzWwcB0c1DtXy5FfOUaR2q9un-0uNPllUCMWrAPu7rKctDIn0-L_U6zEGJ4HdMYUVYI6y-HKkHNnc0-XO9pkIs Sep 08 10:37:45.506396 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:37:45.506396 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:37:45.506396 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:37:45.506396 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:37:45.506396 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:37:45.506396 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:37:45.506396 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 2eb116f8d7dd4858a91c03e0a4310fa9 Sep 08 10:37:45.506396 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1505808489 Sep 08 10:37:45.506396 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:37:45.506396 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:37:45.507908 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2eb116f8d7dd4858a91c03e0a4310fa9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2eb116f8d7dd4858a91c03e0a4310fa9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2eb116f8d7dd4858a91c03e0a4310fa9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2eb116f8d7dd4858a91c03e0a4310fa9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:37:45.507908 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-DeleteServersAdminTestJSON-1505808489 Sep 08 10:37:45.507908 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 2eb116f8d7dd4858a91c03e0a4310fa9 Sep 08 10:37:45.507908 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1505808489 Sep 08 10:37:45.507908 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-DeleteServersAdminTestJSON-1505808489-project Sep 08 10:37:45.507908 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:37:45.507908 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:37:45.507908 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 6fdbe35f311e435ba9e0516f302ba519 Sep 08 10:37:45.507908 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-DeleteServersAdminTestJSON-1505808489-project Sep 08 10:37:45.507908 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:37:45.507908 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc could not be found. Sep 08 10:37:45.507908 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc'} Sep 08 10:37:45.508650 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:37:45.508650 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:45.508650 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:37:45.508650 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:37:45.508650 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:37:45.508650 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:37:45.508650 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:37:45.508650 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:37:45.508650 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:37:45.508650 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:37:45.508650 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc could not be found. Sep 08 10:37:45.508650 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:45.508650 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:45.508650 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:45.508650 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:45.508650 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:45.508650 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:45.508650 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:37:45.508650 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:37:45.508650 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:37:45.509834 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:37:45.509834 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:37:45.509834 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:37:45.509834 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:37:45.509834 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:37:45.509834 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:37:45.509834 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:37:45.509834 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc could not be found. Sep 08 10:37:45.509834 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:45.509834 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:45.509834 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:45.509834 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:45.509834 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:45.509834 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:45.509834 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:37:45.509834 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:37:45.509834 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc could not be found. Sep 08 10:37:45.509834 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:45.510821 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-614342fd-66c5-452d-bae2-2342b6509959 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Returning 404 to user: Instance 0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:37:45.510821 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-614342fd-66c5-452d-bae2-2342b6509959 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] 10.222.0.27 "GET /compute/v2.1/servers/0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc" status: 404 len: 111 microversion: 2.1 time: 0.092018 Sep 08 10:37:45.510821 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 162/344] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:45 2022] GET /compute/v2.1/servers/0d1a16cf-890b-4e0c-a289-e3eb74dbc9cc => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:37:45.516851 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ec8475b4-8a54-45fe-80f5-39e6be3b58ce tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:45.517723 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ec8475b4-8a54-45fe-80f5-39e6be3b58ce tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] [instance: e605c39e-7644-4842-8476-9c9af611282f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:45.523834 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec8475b4-8a54-45fe-80f5-39e6be3b58ce tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:45.524869 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec8475b4-8a54-45fe-80f5-39e6be3b58ce tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:45.525351 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec8475b4-8a54-45fe-80f5-39e6be3b58ce tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:45.527122 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec8475b4-8a54-45fe-80f5-39e6be3b58ce tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:45.527628 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec8475b4-8a54-45fe-80f5-39e6be3b58ce tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:45.528040 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec8475b4-8a54-45fe-80f5-39e6be3b58ce tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:45.550577 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-ec8475b4-8a54-45fe-80f5-39e6be3b58ce tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] HTTP exception thrown: Instance e605c39e-7644-4842-8476-9c9af611282f could not be found. Sep 08 10:37:45.552249 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ec8475b4-8a54-45fe-80f5-39e6be3b58ce tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Request method failure captured: Sep 08 10:37:45.552249 n-d-850501-12 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/servers/e605c39e-7644-4842-8476-9c9af611282f HTTP/1.1 Sep 08 10:37:45.552249 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:37:45.552249 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:37:45.552249 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:37:45.552249 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:37:45.552249 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:37:45.552249 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:37:45.552249 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:37:45.552249 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:37:45.552249 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcW3Cf6YoBWqaJLIIYaTO1fiMbOcWzpwHj6KKsufXrmQTTVhvcr8sv7TsKPAB8KFmxSVgs668LgkXMpgIKGyhAFeUTzWwcB0c1DtXy5FfOUaR2q9un-0uNPllUCMWrAPu7rKctDIn0-L_U6zEGJ4HdMYUVYI6y-HKkHNnc0-XO9pkIs Sep 08 10:37:45.552249 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:37:45.552249 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:37:45.552249 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:37:45.552249 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:37:45.552249 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:37:45.552249 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:37:45.552249 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 2eb116f8d7dd4858a91c03e0a4310fa9 Sep 08 10:37:45.552249 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1505808489 Sep 08 10:37:45.552249 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:37:45.552249 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:37:45.553566 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2eb116f8d7dd4858a91c03e0a4310fa9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2eb116f8d7dd4858a91c03e0a4310fa9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2eb116f8d7dd4858a91c03e0a4310fa9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2eb116f8d7dd4858a91c03e0a4310fa9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:37:45.553566 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-DeleteServersAdminTestJSON-1505808489 Sep 08 10:37:45.553566 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 2eb116f8d7dd4858a91c03e0a4310fa9 Sep 08 10:37:45.553566 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1505808489 Sep 08 10:37:45.553566 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-DeleteServersAdminTestJSON-1505808489-project Sep 08 10:37:45.553566 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:37:45.553566 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:37:45.553566 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 6fdbe35f311e435ba9e0516f302ba519 Sep 08 10:37:45.553566 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-DeleteServersAdminTestJSON-1505808489-project Sep 08 10:37:45.553566 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:37:45.553566 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance e605c39e-7644-4842-8476-9c9af611282f could not be found. Sep 08 10:37:45.553566 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'e605c39e-7644-4842-8476-9c9af611282f'} Sep 08 10:37:45.554247 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:37:45.554247 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:45.554247 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:37:45.554247 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:37:45.554247 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:37:45.554247 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:37:45.554247 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:37:45.554247 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:37:45.554247 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:37:45.554247 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:37:45.554247 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e605c39e-7644-4842-8476-9c9af611282f could not be found. Sep 08 10:37:45.554247 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:45.554247 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:45.554247 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:45.554247 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:45.554247 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:45.554247 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:45.554247 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:37:45.554247 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:37:45.554247 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:37:45.555627 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:37:45.555627 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:37:45.555627 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:37:45.555627 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:37:45.555627 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:37:45.555627 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:37:45.555627 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:37:45.555627 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:37:45.555627 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:37:45.555627 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e605c39e-7644-4842-8476-9c9af611282f could not be found. Sep 08 10:37:45.555627 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:45.555627 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:45.555627 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:45.555627 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:45.555627 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:45.555627 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:45.555627 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:37:45.555627 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:37:45.555627 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e605c39e-7644-4842-8476-9c9af611282f could not be found. Sep 08 10:37:45.555627 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:45.556834 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ec8475b4-8a54-45fe-80f5-39e6be3b58ce tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Returning 404 to user: Instance e605c39e-7644-4842-8476-9c9af611282f could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:37:45.556834 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ec8475b4-8a54-45fe-80f5-39e6be3b58ce tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e605c39e-7644-4842-8476-9c9af611282f" status: 404 len: 111 microversion: 2.1 time: 0.041195 Sep 08 10:37:45.558184 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 163/345] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:37:45 2022] DELETE /compute/v2.1/servers/e605c39e-7644-4842-8476-9c9af611282f => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 10:37:45.566306 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-03773b7f-725f-43cb-b19c-25e14a6c19c7 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:45.568576 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-03773b7f-725f-43cb-b19c-25e14a6c19c7 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] [instance: e605c39e-7644-4842-8476-9c9af611282f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:45.582201 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03773b7f-725f-43cb-b19c-25e14a6c19c7 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:45.583010 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03773b7f-725f-43cb-b19c-25e14a6c19c7 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:45.583964 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03773b7f-725f-43cb-b19c-25e14a6c19c7 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:45.586967 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03773b7f-725f-43cb-b19c-25e14a6c19c7 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:45.589164 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03773b7f-725f-43cb-b19c-25e14a6c19c7 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:45.589773 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03773b7f-725f-43cb-b19c-25e14a6c19c7 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:45.609271 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-03773b7f-725f-43cb-b19c-25e14a6c19c7 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] HTTP exception thrown: Instance e605c39e-7644-4842-8476-9c9af611282f could not be found. Sep 08 10:37:45.612180 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-03773b7f-725f-43cb-b19c-25e14a6c19c7 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Request method failure captured: Sep 08 10:37:45.612180 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/e605c39e-7644-4842-8476-9c9af611282f HTTP/1.1 Sep 08 10:37:45.612180 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:37:45.612180 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:37:45.612180 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:37:45.612180 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:37:45.612180 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:37:45.612180 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:37:45.612180 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:37:45.612180 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:37:45.612180 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcW3Cf6YoBWqaJLIIYaTO1fiMbOcWzpwHj6KKsufXrmQTTVhvcr8sv7TsKPAB8KFmxSVgs668LgkXMpgIKGyhAFeUTzWwcB0c1DtXy5FfOUaR2q9un-0uNPllUCMWrAPu7rKctDIn0-L_U6zEGJ4HdMYUVYI6y-HKkHNnc0-XO9pkIs Sep 08 10:37:45.612180 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:37:45.612180 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:37:45.612180 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:37:45.612180 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:37:45.612180 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:37:45.612180 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:37:45.612180 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 2eb116f8d7dd4858a91c03e0a4310fa9 Sep 08 10:37:45.612180 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1505808489 Sep 08 10:37:45.612180 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:37:45.612180 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:37:45.613674 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2eb116f8d7dd4858a91c03e0a4310fa9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2eb116f8d7dd4858a91c03e0a4310fa9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2eb116f8d7dd4858a91c03e0a4310fa9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2eb116f8d7dd4858a91c03e0a4310fa9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:37:45.613674 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-DeleteServersAdminTestJSON-1505808489 Sep 08 10:37:45.613674 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 2eb116f8d7dd4858a91c03e0a4310fa9 Sep 08 10:37:45.613674 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1505808489 Sep 08 10:37:45.613674 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-DeleteServersAdminTestJSON-1505808489-project Sep 08 10:37:45.613674 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:37:45.613674 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:37:45.613674 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 6fdbe35f311e435ba9e0516f302ba519 Sep 08 10:37:45.613674 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-DeleteServersAdminTestJSON-1505808489-project Sep 08 10:37:45.613674 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:37:45.613674 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance e605c39e-7644-4842-8476-9c9af611282f could not be found. Sep 08 10:37:45.613674 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'e605c39e-7644-4842-8476-9c9af611282f'} Sep 08 10:37:45.614517 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:37:45.614517 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:45.614517 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:37:45.614517 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:37:45.614517 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:37:45.614517 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:37:45.614517 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:37:45.614517 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:37:45.614517 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:37:45.614517 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:37:45.614517 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e605c39e-7644-4842-8476-9c9af611282f could not be found. Sep 08 10:37:45.614517 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:45.614517 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:45.614517 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:45.614517 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:45.614517 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:45.614517 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:45.614517 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:37:45.614517 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:37:45.614517 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:37:45.615622 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:37:45.615622 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:37:45.615622 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:37:45.615622 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:37:45.615622 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:37:45.615622 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:37:45.615622 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:37:45.615622 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e605c39e-7644-4842-8476-9c9af611282f could not be found. Sep 08 10:37:45.615622 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:45.615622 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:45.615622 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:45.615622 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:45.615622 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:45.615622 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:45.615622 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:37:45.615622 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:37:45.615622 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e605c39e-7644-4842-8476-9c9af611282f could not be found. Sep 08 10:37:45.615622 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:45.617410 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-03773b7f-725f-43cb-b19c-25e14a6c19c7 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] Returning 404 to user: Instance e605c39e-7644-4842-8476-9c9af611282f could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:37:45.618394 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-03773b7f-725f-43cb-b19c-25e14a6c19c7 tempest-DeleteServersAdminTestJSON-1505808489 tempest-DeleteServersAdminTestJSON-1505808489-project] 10.222.0.27 "GET /compute/v2.1/servers/e605c39e-7644-4842-8476-9c9af611282f" status: 404 len: 111 microversion: 2.1 time: 0.059207 Sep 08 10:37:45.622997 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 164/346] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:45 2022] GET /compute/v2.1/servers/e605c39e-7644-4842-8476-9c9af611282f => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:37:45.680589 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9e9e2f83-1961-4fa5-9f7f-ced5433aaea5 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:45.681859 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9e9e2f83-1961-4fa5-9f7f-ced5433aaea5 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: a3147437-e6f2-480d-bcaf-cc0f030d497d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:45.696662 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9e9e2f83-1961-4fa5-9f7f-ced5433aaea5 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:45.697688 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9e9e2f83-1961-4fa5-9f7f-ced5433aaea5 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:45.698319 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9e9e2f83-1961-4fa5-9f7f-ced5433aaea5 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:45.699248 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9e9e2f83-1961-4fa5-9f7f-ced5433aaea5 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:45.702043 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9e9e2f83-1961-4fa5-9f7f-ced5433aaea5 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:45.702718 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9e9e2f83-1961-4fa5-9f7f-ced5433aaea5 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:45.913573 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-505a5038-badc-4f09-9363-0d2c57d5d09f tempest-FlavorsAccessNegativeTestJSON-1742185309 tempest-FlavorsAccessNegativeTestJSON-1742185309-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/2141322514/action" status: 200 len: 97 microversion: 2.1 time: 0.417566 Sep 08 10:37:45.917205 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 183/347] 10.222.0.27 () {60 vars in 1200 bytes} [Thu Sep 8 10:37:45 2022] POST /compute/v2.1/flavors/2141322514/action => generated 97 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:37:45.929728 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8b771f81-4f9c-4798-a01c-918c08cd3a98 tempest-FlavorsAccessNegativeTestJSON-1813856669 tempest-FlavorsAccessNegativeTestJSON-1813856669-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "f7be1156a9f640a4b835c250c10048a2"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:45.943932 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8b771f81-4f9c-4798-a01c-918c08cd3a98 tempest-FlavorsAccessNegativeTestJSON-1813856669 tempest-FlavorsAccessNegativeTestJSON-1813856669-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '22efb3f968be4d0d8417a15425816e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7be1156a9f640a4b835c250c10048a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:45.946606 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8b771f81-4f9c-4798-a01c-918c08cd3a98 tempest-FlavorsAccessNegativeTestJSON-1813856669 tempest-FlavorsAccessNegativeTestJSON-1813856669-project] Request method failure captured: Sep 08 10:37:45.946606 n-d-850501-12 devstack@n-api.service[128861]: request: POST /compute/v2.1/flavors/2141322514/action HTTP/1.1 Sep 08 10:37:45.946606 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:37:45.946606 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:37:45.946606 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:37:45.946606 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 70 Sep 08 10:37:45.946606 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:37:45.946606 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:37:45.946606 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:37:45.946606 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:37:45.946606 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcXxwCzN25-K7AsFfoL9pjeZp5KFXK3GYBCPb85_y9pB09PUMe7c4K4u6zvDXUiq8SQ5VA_lb8bkEyV1asYNHz60jWXVManQZWv4yEIzMS-i78A7UdaYMd9WElYUMJ5U9M2Di9_9dln4zGqBYVcU6Z086VREwVEOSFrP7YPIn6EcgS4 Sep 08 10:37:45.946606 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:37:45.946606 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:37:45.946606 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:37:45.946606 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:37:45.946606 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:37:45.946606 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:37:45.946606 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: f7be1156a9f640a4b835c250c10048a2 Sep 08 10:37:45.946606 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1813856669 Sep 08 10:37:45.946606 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:37:45.946606 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:37:45.948004 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f7be1156a9f640a4b835c250c10048a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f7be1156a9f640a4b835c250c10048a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f7be1156a9f640a4b835c250c10048a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f7be1156a9f640a4b835c250c10048a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:37:45.948004 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1813856669 Sep 08 10:37:45.948004 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: f7be1156a9f640a4b835c250c10048a2 Sep 08 10:37:45.948004 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1813856669 Sep 08 10:37:45.948004 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-FlavorsAccessNegativeTestJSON-1813856669-project Sep 08 10:37:45.948004 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:37:45.948004 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:37:45.948004 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 22efb3f968be4d0d8417a15425816e89 Sep 08 10:37:45.948004 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1813856669-project Sep 08 10:37:45.948004 n-d-850501-12 devstack@n-api.service[128861]: Sep 08 10:37:45.948004 n-d-850501-12 devstack@n-api.service[128861]: {"removeTenantAccess": {"tenant": "f7be1156a9f640a4b835c250c10048a2"}} Sep 08 10:37:45.948004 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:37:45.948714 n-d-850501-12 devstack@n-api.service[128861]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Sep 08 10:37:45.948714 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '2141322514', 'body': {'removeTenantAccess': {'tenant': 'f7be1156a9f640a4b835c250c10048a2'}}} Sep 08 10:37:45.948714 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:37:45.948714 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:45.948714 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:45.948714 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:45.948714 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:37:45.948714 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:37:45.948714 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:37:45.948714 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:37:45.948714 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:37:45.948714 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:37:45.948714 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Sep 08 10:37:45.948714 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi context.can( Sep 08 10:37:45.948714 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 10:37:45.948714 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 10:37:45.948714 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 10:37:45.948714 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 10:37:45.948714 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:37:45.948714 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:37:45.949929 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:37:45.949929 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:37:45.949929 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 10:37:45.949929 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 10:37:45.949929 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 10:37:45.949929 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 10:37:45.949929 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 10:37:45.949929 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 10:37:45.949929 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Sep 08 10:37:45.949929 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:45.949929 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:45.949929 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:45.949929 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:45.949929 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:45.949929 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:45.949929 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 10:37:45.949929 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 10:37:45.949929 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Sep 08 10:37:45.949929 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:45.954429 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8b771f81-4f9c-4798-a01c-918c08cd3a98 tempest-FlavorsAccessNegativeTestJSON-1813856669 tempest-FlavorsAccessNegativeTestJSON-1813856669-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:37:45.958881 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8b771f81-4f9c-4798-a01c-918c08cd3a98 tempest-FlavorsAccessNegativeTestJSON-1813856669 tempest-FlavorsAccessNegativeTestJSON-1813856669-project] 10.222.0.27 "POST /compute/v2.1/flavors/2141322514/action" status: 403 len: 133 microversion: 2.1 time: 0.035565 Sep 08 10:37:45.960170 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 184/348] 10.222.0.27 () {60 vars in 1200 bytes} [Thu Sep 8 10:37:45 2022] POST /compute/v2.1/flavors/2141322514/action => generated 133 bytes in 37 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:37:45.974926 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cf6116a1-4f93-4a9e-a63b-a10461073bcf tempest-FlavorsAccessNegativeTestJSON-1742185309 tempest-FlavorsAccessNegativeTestJSON-1742185309-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "f7be1156a9f640a4b835c250c10048a2"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:46.377298 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cf6116a1-4f93-4a9e-a63b-a10461073bcf tempest-FlavorsAccessNegativeTestJSON-1742185309 tempest-FlavorsAccessNegativeTestJSON-1742185309-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/2141322514/action" status: 200 len: 21 microversion: 2.1 time: 0.410508 Sep 08 10:37:46.378512 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 185/349] 10.222.0.27 () {60 vars in 1200 bytes} [Thu Sep 8 10:37:45 2022] POST /compute/v2.1/flavors/2141322514/action => generated 21 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:37:46.397468 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6fdd3429-0118-4ec0-977c-2dd93d8abe18 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:46.398164 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6fdd3429-0118-4ec0-977c-2dd93d8abe18 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 292d240e-1176-4875-8f87-9ca911437fbe] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:46.410788 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6fdd3429-0118-4ec0-977c-2dd93d8abe18 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:46.411286 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6fdd3429-0118-4ec0-977c-2dd93d8abe18 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:46.412128 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6fdd3429-0118-4ec0-977c-2dd93d8abe18 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:46.414615 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6fdd3429-0118-4ec0-977c-2dd93d8abe18 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:46.418103 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6fdd3429-0118-4ec0-977c-2dd93d8abe18 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:46.419013 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6fdd3429-0118-4ec0-977c-2dd93d8abe18 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:46.732770 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6fdd3429-0118-4ec0-977c-2dd93d8abe18 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:46.750410 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6fdd3429-0118-4ec0-977c-2dd93d8abe18 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:46.756554 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6fdd3429-0118-4ec0-977c-2dd93d8abe18 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:46.759643 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6fdd3429-0118-4ec0-977c-2dd93d8abe18 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/292d240e-1176-4875-8f87-9ca911437fbe" status: 200 len: 1362 microversion: 2.25 time: 0.379319 Sep 08 10:37:46.762745 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 186/350] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:37:46 2022] GET /compute/v2.1/servers/292d240e-1176-4875-8f87-9ca911437fbe => generated 1362 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:37:46.775113 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-378b6e56-8078-411c-a326-c4008703a043 req-9ea47fd2-226a-45f8-ad6c-f305185ac5af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "292d240e-1176-4875-8f87-9ca911437fbe", "name": "network-vif-plugged", "status": "completed", "tag": "73b84527-1c36-4494-857a-3c9441bb8f82"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:46.805848 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-378b6e56-8078-411c-a326-c4008703a043 req-9ea47fd2-226a-45f8-ad6c-f305185ac5af service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:46.808698 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-378b6e56-8078-411c-a326-c4008703a043 req-9ea47fd2-226a-45f8-ad6c-f305185ac5af service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:46.809629 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-378b6e56-8078-411c-a326-c4008703a043 req-9ea47fd2-226a-45f8-ad6c-f305185ac5af service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:46.840034 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-378b6e56-8078-411c-a326-c4008703a043 req-9ea47fd2-226a-45f8-ad6c-f305185ac5af service nova] Creating event network-vif-plugged:73b84527-1c36-4494-857a-3c9441bb8f82 for instance 292d240e-1176-4875-8f87-9ca911437fbe on n-h1-850501-12 Sep 08 10:37:46.883632 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-378b6e56-8078-411c-a326-c4008703a043 req-9ea47fd2-226a-45f8-ad6c-f305185ac5af service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119390 Sep 08 10:37:46.900049 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 187/351] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:37:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:37:46.907114 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e6000375-92ae-456c-927a-a72c133ad070 tempest-FlavorsAccessNegativeTestJSON-1742185309 tempest-FlavorsAccessNegativeTestJSON-1742185309-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:46.943344 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:INSERT=5,nova_api:DELETE=10 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:37:46.962883 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e6000375-92ae-456c-927a-a72c133ad070 tempest-FlavorsAccessNegativeTestJSON-1742185309 tempest-FlavorsAccessNegativeTestJSON-1742185309-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/2141322514" status: 202 len: 0 microversion: 2.1 time: 0.060676 Sep 08 10:37:46.965915 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 188/352] 10.222.0.27 () {58 vars in 1161 bytes} [Thu Sep 8 10:37:46 2022] DELETE /compute/v2.1/flavors/2141322514 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:37:46.977993 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5ccff337-1acf-4adc-a141-923eb5a13a19 tempest-FlavorsAccessNegativeTestJSON-1742185309 tempest-FlavorsAccessNegativeTestJSON-1742185309-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:47.024942 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5ccff337-1acf-4adc-a141-923eb5a13a19 tempest-FlavorsAccessNegativeTestJSON-1742185309 tempest-FlavorsAccessNegativeTestJSON-1742185309-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.056418 Sep 08 10:37:47.030481 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 189/353] 10.222.0.27 () {58 vars in 1146 bytes} [Thu Sep 8 10:37:46 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:47.052726 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-63dcd30b-0555-4154-aca2-8b33267ec8c2 tempest-FlavorsAccessNegativeTestJSON-1742185309 tempest-FlavorsAccessNegativeTestJSON-1742185309-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-515560061", "id": 458351930, "os-flavor-access:is_public": "False"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:47.071493 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=6 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:37:47.081638 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=6 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:37:47.088889 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-63dcd30b-0555-4154-aca2-8b33267ec8c2 tempest-FlavorsAccessNegativeTestJSON-1742185309 tempest-FlavorsAccessNegativeTestJSON-1742185309-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.041581 Sep 08 10:37:47.090297 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 190/354] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:37:47 2022] POST /compute/v2.1/flavors => generated 435 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:37:47.104807 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0e5622f6-daed-47d7-9045-191b3e12a025 tempest-FlavorsAccessNegativeTestJSON-1742185309 tempest-FlavorsAccessNegativeTestJSON-1742185309-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "0b43e46fd55240e3b7d88a1de76aa7a5"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:47.198410 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9e9e2f83-1961-4fa5-9f7f-ced5433aaea5 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:47.223008 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9e9e2f83-1961-4fa5-9f7f-ced5433aaea5 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/a3147437-e6f2-480d-bcaf-cc0f030d497d" status: 200 len: 1316 microversion: 2.1 time: 1.551625 Sep 08 10:37:47.225419 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 165/355] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:45 2022] GET /compute/v2.1/servers/a3147437-e6f2-480d-bcaf-cc0f030d497d => generated 1316 bytes in 1556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:37:47.792112 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cecd9faa-e1a6-4a3b-af0f-b3afe15ecde2 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:47.792687 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cecd9faa-e1a6-4a3b-af0f-b3afe15ecde2 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 292d240e-1176-4875-8f87-9ca911437fbe] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:47.818936 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cecd9faa-e1a6-4a3b-af0f-b3afe15ecde2 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:47.819683 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-0e5622f6-daed-47d7-9045-191b3e12a025 tempest-FlavorsAccessNegativeTestJSON-1742185309 tempest-FlavorsAccessNegativeTestJSON-1742185309-project-admin] HTTP exception thrown: Flavor access not found for 36 / 0b43e46fd55240e3b7d88a1de76aa7a5 combination. Sep 08 10:37:47.821616 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cecd9faa-e1a6-4a3b-af0f-b3afe15ecde2 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:47.823162 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cecd9faa-e1a6-4a3b-af0f-b3afe15ecde2 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:47.825480 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cecd9faa-e1a6-4a3b-af0f-b3afe15ecde2 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:47.825996 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cecd9faa-e1a6-4a3b-af0f-b3afe15ecde2 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:47.826440 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cecd9faa-e1a6-4a3b-af0f-b3afe15ecde2 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:47.829393 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0e5622f6-daed-47d7-9045-191b3e12a025 tempest-FlavorsAccessNegativeTestJSON-1742185309 tempest-FlavorsAccessNegativeTestJSON-1742185309-project-admin] Request method failure captured: Sep 08 10:37:47.829393 n-d-850501-12 devstack@n-api.service[128861]: request: POST /compute/v2.1/flavors/458351930/action HTTP/1.1 Sep 08 10:37:47.829393 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:37:47.829393 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:37:47.829393 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:37:47.829393 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 70 Sep 08 10:37:47.829393 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:37:47.829393 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:37:47.829393 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:37:47.829393 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:37:47.829393 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcXzEBDOHYxbBumFA5zxytZPgurqNxUwCFZqOOSh0Fh8FBc3lE7Roq1WrGBAXYZVVGbuTF75aU35Ag4E0Wd4UjCMkPAZ3BP5Q3dev_F6tFQsjZZmkFUoGmYFh7qLxdCKqD3elpwa2JpdRGpw2uGRof_T1WCFXrmdM0HqVsNjqWbT6oc Sep 08 10:37:47.829393 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:37:47.829393 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:37:47.829393 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:37:47.829393 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:37:47.829393 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:37:47.829393 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:37:47.829393 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 6cd59e0af0434a0286c29582b711d7ae Sep 08 10:37:47.829393 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1742185309 Sep 08 10:37:47.829393 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,admin,member Sep 08 10:37:47.829393 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,admin,member Sep 08 10:37:47.831136 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6cd59e0af0434a0286c29582b711d7ae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6cd59e0af0434a0286c29582b711d7ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6cd59e0af0434a0286c29582b711d7ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6cd59e0af0434a0286c29582b711d7ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:37:47.831136 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1742185309 Sep 08 10:37:47.831136 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 6cd59e0af0434a0286c29582b711d7ae Sep 08 10:37:47.831136 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1742185309 Sep 08 10:37:47.831136 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-FlavorsAccessNegativeTestJSON-1742185309-project-admin Sep 08 10:37:47.831136 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:37:47.831136 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:37:47.831136 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: b7c2d75ff06f4c499e9c3d0e151fe99e Sep 08 10:37:47.831136 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1742185309-project-admin Sep 08 10:37:47.831136 n-d-850501-12 devstack@n-api.service[128861]: Sep 08 10:37:47.831136 n-d-850501-12 devstack@n-api.service[128861]: {"removeTenantAccess": {"tenant": "0b43e46fd55240e3b7d88a1de76aa7a5"}} Sep 08 10:37:47.831136 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:37:47.831957 n-d-850501-12 devstack@n-api.service[128861]: exception: Flavor access not found for 36 / 0b43e46fd55240e3b7d88a1de76aa7a5 combination. Sep 08 10:37:47.831957 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '458351930', 'body': {'removeTenantAccess': {'tenant': '0b43e46fd55240e3b7d88a1de76aa7a5'}}} Sep 08 10:37:47.831957 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:37:47.831957 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:47.831957 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Sep 08 10:37:47.831957 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Sep 08 10:37:47.831957 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 08 10:37:47.831957 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 08 10:37:47.831957 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Sep 08 10:37:47.831957 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Sep 08 10:37:47.831957 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Sep 08 10:37:47.831957 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Sep 08 10:37:47.831957 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Sep 08 10:37:47.831957 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Sep 08 10:37:47.831957 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 08 10:37:47.831957 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 08 10:37:47.831957 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Sep 08 10:37:47.831957 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Sep 08 10:37:47.833258 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 36 / 0b43e46fd55240e3b7d88a1de76aa7a5 combination. Sep 08 10:37:47.833258 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:47.833258 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:47.833258 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:47.833258 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:47.833258 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:47.833258 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:47.833258 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:37:47.833258 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:37:47.833258 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:37:47.833258 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:37:47.833258 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:37:47.833258 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:37:47.833258 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Sep 08 10:37:47.833258 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:37:47.833258 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 36 / 0b43e46fd55240e3b7d88a1de76aa7a5 combination. Sep 08 10:37:47.833258 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:47.833258 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:47.833258 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:47.833258 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:47.834699 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:47.834699 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:47.834699 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:37:47.834699 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:37:47.834699 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 36 / 0b43e46fd55240e3b7d88a1de76aa7a5 combination. Sep 08 10:37:47.834699 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:47.834699 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0e5622f6-daed-47d7-9045-191b3e12a025 tempest-FlavorsAccessNegativeTestJSON-1742185309 tempest-FlavorsAccessNegativeTestJSON-1742185309-project-admin] Returning 404 to user: Flavor access not found for 36 / 0b43e46fd55240e3b7d88a1de76aa7a5 combination. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:37:47.834699 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0e5622f6-daed-47d7-9045-191b3e12a025 tempest-FlavorsAccessNegativeTestJSON-1742185309 tempest-FlavorsAccessNegativeTestJSON-1742185309-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/458351930/action" status: 404 len: 124 microversion: 2.1 time: 0.731060 Sep 08 10:37:47.851348 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 191/356] 10.222.0.27 () {60 vars in 1197 bytes} [Thu Sep 8 10:37:47 2022] POST /compute/v2.1/flavors/458351930/action => generated 124 bytes in 752 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 10:37:47.857932 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ce32cc74-d582-4be8-82bc-d6d10b8254fa tempest-FlavorsAccessNegativeTestJSON-1742185309 tempest-FlavorsAccessNegativeTestJSON-1742185309-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:47.925506 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ce32cc74-d582-4be8-82bc-d6d10b8254fa tempest-FlavorsAccessNegativeTestJSON-1742185309 tempest-FlavorsAccessNegativeTestJSON-1742185309-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/458351930" status: 202 len: 0 microversion: 2.1 time: 0.072825 Sep 08 10:37:47.926253 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 192/357] 10.222.0.27 () {58 vars in 1158 bytes} [Thu Sep 8 10:37:47 2022] DELETE /compute/v2.1/flavors/458351930 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:37:47.935631 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-be11ec1d-45e5-40c9-be43-518d79028a3c tempest-FlavorsAccessNegativeTestJSON-1742185309 tempest-FlavorsAccessNegativeTestJSON-1742185309-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:47.970575 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-be11ec1d-45e5-40c9-be43-518d79028a3c tempest-FlavorsAccessNegativeTestJSON-1742185309 tempest-FlavorsAccessNegativeTestJSON-1742185309-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.039211 Sep 08 10:37:47.973389 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 193/358] 10.222.0.27 () {58 vars in 1146 bytes} [Thu Sep 8 10:37:47 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:37:48.003908 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-1fb14cfb-be9e-4a3c-a117-2e9fb269da60 req-d99ed6f5-6183-4e39-9223-1b226e06df81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3147437-e6f2-480d-bcaf-cc0f030d497d", "tag": "38fe5d2c-fe31-4e0c-aa4e-7ae415d02939"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:48.014772 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-1fb14cfb-be9e-4a3c-a117-2e9fb269da60 req-d99ed6f5-6183-4e39-9223-1b226e06df81 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:48.015515 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-1fb14cfb-be9e-4a3c-a117-2e9fb269da60 req-d99ed6f5-6183-4e39-9223-1b226e06df81 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:48.016124 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-1fb14cfb-be9e-4a3c-a117-2e9fb269da60 req-d99ed6f5-6183-4e39-9223-1b226e06df81 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:48.030938 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-1fb14cfb-be9e-4a3c-a117-2e9fb269da60 req-d99ed6f5-6183-4e39-9223-1b226e06df81 service nova] Creating event network-changed:38fe5d2c-fe31-4e0c-aa4e-7ae415d02939 for instance a3147437-e6f2-480d-bcaf-cc0f030d497d on n-h2-850501-12 Sep 08 10:37:48.037459 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-1fb14cfb-be9e-4a3c-a117-2e9fb269da60 req-d99ed6f5-6183-4e39-9223-1b226e06df81 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040032 Sep 08 10:37:48.038872 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 194/359] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:37:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:37:48.246857 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=26 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:37:48.253664 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-14b26d8b-dc30-4318-a323-82a6a10af6fe tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:48.254977 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-14b26d8b-dc30-4318-a323-82a6a10af6fe tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: a3147437-e6f2-480d-bcaf-cc0f030d497d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:48.297834 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-14b26d8b-dc30-4318-a323-82a6a10af6fe tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:48.298941 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-14b26d8b-dc30-4318-a323-82a6a10af6fe tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:48.299783 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-14b26d8b-dc30-4318-a323-82a6a10af6fe tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:48.300692 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-14b26d8b-dc30-4318-a323-82a6a10af6fe tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:48.301336 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-14b26d8b-dc30-4318-a323-82a6a10af6fe tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:48.302111 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-14b26d8b-dc30-4318-a323-82a6a10af6fe tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:48.631551 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cecd9faa-e1a6-4a3b-af0f-b3afe15ecde2 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:48.646746 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cecd9faa-e1a6-4a3b-af0f-b3afe15ecde2 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:48.658017 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cecd9faa-e1a6-4a3b-af0f-b3afe15ecde2 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:48.659195 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cecd9faa-e1a6-4a3b-af0f-b3afe15ecde2 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/292d240e-1176-4875-8f87-9ca911437fbe" status: 200 len: 1362 microversion: 2.25 time: 0.871816 Sep 08 10:37:48.661232 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 166/360] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:37:47 2022] GET /compute/v2.1/servers/292d240e-1176-4875-8f87-9ca911437fbe => generated 1362 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:37:48.992537 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-14b26d8b-dc30-4318-a323-82a6a10af6fe tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:49.011577 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-14b26d8b-dc30-4318-a323-82a6a10af6fe tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/a3147437-e6f2-480d-bcaf-cc0f030d497d" status: 200 len: 1316 microversion: 2.1 time: 0.764883 Sep 08 10:37:49.014779 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 195/361] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:48 2022] GET /compute/v2.1/servers/a3147437-e6f2-480d-bcaf-cc0f030d497d => generated 1316 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:49.616807 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ead92c53-88d4-4e8a-9eef-87e486af067c tempest-KeyPairsV210TestJSON-1816127021 tempest-KeyPairsV210TestJSON-1816127021-project-admin] Action: 'create', calling method: .version_select at 0x7f68e5025670>, body: {"keypair": {"name": "tempest-keypair-962228054", "type": "ssh", "user_id": "d1246d17fa6f412791a8845624dccd95", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPcDhUqfe9N+RPox/bzJQyss2XJdi9ubETTeO5eiZXSU4A6AHmBfKLE8K7WB/ilRAV4Kf/Wwz11a7tlNCoJJP0DK/mHeVFB6qCMmN19j5N0fmGjT2VC5xF8hxwE72etUjA=="}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:49.689006 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d889ec3a-e963-4ac7-8d29-3c13b19fd3ac tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:49.690036 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d889ec3a-e963-4ac7-8d29-3c13b19fd3ac tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 292d240e-1176-4875-8f87-9ca911437fbe] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:49.756130 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-ead92c53-88d4-4e8a-9eef-87e486af067c tempest-KeyPairsV210TestJSON-1816127021 tempest-KeyPairsV210TestJSON-1816127021-project-admin] Getting quotas for project 384f083c3b0641d5a3ac681d5a941460. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:37:49.757258 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d889ec3a-e963-4ac7-8d29-3c13b19fd3ac tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:49.760326 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d889ec3a-e963-4ac7-8d29-3c13b19fd3ac tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:49.761109 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d889ec3a-e963-4ac7-8d29-3c13b19fd3ac tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:49.762576 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d889ec3a-e963-4ac7-8d29-3c13b19fd3ac tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:49.764334 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d889ec3a-e963-4ac7-8d29-3c13b19fd3ac tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:49.765214 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d889ec3a-e963-4ac7-8d29-3c13b19fd3ac tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:49.775575 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-ead92c53-88d4-4e8a-9eef-87e486af067c tempest-KeyPairsV210TestJSON-1816127021 tempest-KeyPairsV210TestJSON-1816127021-project-admin] Getting quotas for user 059f07f2202941d2a7ba11c5211e6b05 and project 384f083c3b0641d5a3ac681d5a941460. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:37:49.790855 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:37:49.837443 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ead92c53-88d4-4e8a-9eef-87e486af067c tempest-KeyPairsV210TestJSON-1816127021 tempest-KeyPairsV210TestJSON-1816127021-project-admin] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.842268 Sep 08 10:37:49.851431 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 167/362] 10.222.0.27 () {62 vars in 1200 bytes} [Thu Sep 8 10:37:48 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 858 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Sep 08 10:37:49.862994 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ddac8173-ff16-4fe5-8fb3-d8e9db816adc tempest-KeyPairsV210TestJSON-1816127021 tempest-KeyPairsV210TestJSON-1816127021-project-admin] Action: 'create', calling method: .version_select at 0x7f68e5025f70>, body: {"keypair": {"name": "tempest-keypair-284113263", "type": "ssh", "user_id": "d1246d17fa6f412791a8845624dccd95", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrhMV49gSHwHieYh2GDPoHio31TMpKMW5sfTDNe/wDuri0wcUrF6uEgBsjf79KVpfoGjNy5WXXnN9aFXAourCCHsIxHBJoCWYHxL2GfWsd3MvMnmKHRcrqlTMkgT1ySBA=="}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:49.938177 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-ddac8173-ff16-4fe5-8fb3-d8e9db816adc tempest-KeyPairsV210TestJSON-1816127021 tempest-KeyPairsV210TestJSON-1816127021-project-admin] Getting quotas for project 384f083c3b0641d5a3ac681d5a941460. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:37:49.949423 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-ddac8173-ff16-4fe5-8fb3-d8e9db816adc tempest-KeyPairsV210TestJSON-1816127021 tempest-KeyPairsV210TestJSON-1816127021-project-admin] Getting quotas for user 059f07f2202941d2a7ba11c5211e6b05 and project 384f083c3b0641d5a3ac681d5a941460. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:37:50.014142 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ddac8173-ff16-4fe5-8fb3-d8e9db816adc tempest-KeyPairsV210TestJSON-1816127021 tempest-KeyPairsV210TestJSON-1816127021-project-admin] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.160105 Sep 08 10:37:50.018848 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 168/363] 10.222.0.27 () {62 vars in 1200 bytes} [Thu Sep 8 10:37:49 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 166 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 08 10:37:50.032934 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e560cc2f-92b3-4a0e-8709-59d43e6691f4 tempest-KeyPairsV210TestJSON-1816127021 tempest-KeyPairsV210TestJSON-1816127021-project-admin] Calling method '.version_select at 0x7f68e4f6ea60>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:50.091308 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e560cc2f-92b3-4a0e-8709-59d43e6691f4 tempest-KeyPairsV210TestJSON-1816127021 tempest-KeyPairsV210TestJSON-1816127021-project-admin] 10.222.0.27 "GET /compute/v2.1/os-keypairs/tempest-keypair-962228054?user_id=d1246d17fa6f412791a8845624dccd95" status: 200 len: 511 microversion: 2.10 time: 0.062371 Sep 08 10:37:50.093811 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 169/364] 10.222.0.27 () {60 vars in 1337 bytes} [Thu Sep 8 10:37:50 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-962228054?user_id=d1246d17fa6f412791a8845624dccd95 => generated 511 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 10:37:50.107552 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7ceeeeae-2344-44d7-bd37-f071743ba110 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:50.108537 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7ceeeeae-2344-44d7-bd37-f071743ba110 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: a3147437-e6f2-480d-bcaf-cc0f030d497d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:50.125349 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ceeeeae-2344-44d7-bd37-f071743ba110 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:50.129092 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ceeeeae-2344-44d7-bd37-f071743ba110 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:50.131889 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ceeeeae-2344-44d7-bd37-f071743ba110 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:50.132849 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ceeeeae-2344-44d7-bd37-f071743ba110 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:50.136521 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ceeeeae-2344-44d7-bd37-f071743ba110 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:50.137195 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ceeeeae-2344-44d7-bd37-f071743ba110 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:50.239337 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d889ec3a-e963-4ac7-8d29-3c13b19fd3ac tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:50.255849 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d889ec3a-e963-4ac7-8d29-3c13b19fd3ac tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:50.260209 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d889ec3a-e963-4ac7-8d29-3c13b19fd3ac tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:50.261946 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d889ec3a-e963-4ac7-8d29-3c13b19fd3ac tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/292d240e-1176-4875-8f87-9ca911437fbe" status: 200 len: 1559 microversion: 2.25 time: 0.578319 Sep 08 10:37:50.263230 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 196/365] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:37:49 2022] GET /compute/v2.1/servers/292d240e-1176-4875-8f87-9ca911437fbe => generated 1559 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:37:50.269902 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-986acf64-4da7-4de1-869f-a68a236cc904 tempest-KeyPairsV210TestJSON-1816127021 tempest-KeyPairsV210TestJSON-1816127021-project-admin] Action: 'create', calling method: .version_select at 0x7f68e4ed0430>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-742242173", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLWJN6tqYfEiH0WSB+lCbp/Sxwpm/wXX9kbc4olnknOmja37AaNmkapWfm2UKukwkTXl+ri6wWJgE7ORBD00mgXaTagqtatr1O/xWrJgorcSkcM1w52DzaJ4Xa3hT3KAng=="}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:50.317707 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-986acf64-4da7-4de1-869f-a68a236cc904 tempest-KeyPairsV210TestJSON-1816127021 tempest-KeyPairsV210TestJSON-1816127021-project-admin] Getting quotas for project 384f083c3b0641d5a3ac681d5a941460. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:37:50.323234 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-986acf64-4da7-4de1-869f-a68a236cc904 tempest-KeyPairsV210TestJSON-1816127021 tempest-KeyPairsV210TestJSON-1816127021-project-admin] Getting quotas for user 059f07f2202941d2a7ba11c5211e6b05 and project 384f083c3b0641d5a3ac681d5a941460. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:37:50.381322 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-986acf64-4da7-4de1-869f-a68a236cc904 tempest-KeyPairsV210TestJSON-1816127021 tempest-KeyPairsV210TestJSON-1816127021-project-admin] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.10 time: 0.112511 Sep 08 10:37:50.386400 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 197/366] 10.222.0.27 () {62 vars in 1200 bytes} [Thu Sep 8 10:37:50 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 122 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 08 10:37:51.244560 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5a7b3169-9b97-48ba-b8c5-20d0445d492a tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:51.245253 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5a7b3169-9b97-48ba-b8c5-20d0445d492a tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] [instance: 292d240e-1176-4875-8f87-9ca911437fbe] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:51.264803 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5a7b3169-9b97-48ba-b8c5-20d0445d492a tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:51.265345 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5a7b3169-9b97-48ba-b8c5-20d0445d492a tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:51.265790 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5a7b3169-9b97-48ba-b8c5-20d0445d492a tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:51.272126 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5a7b3169-9b97-48ba-b8c5-20d0445d492a tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:51.273198 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5a7b3169-9b97-48ba-b8c5-20d0445d492a tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:51.284616 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5a7b3169-9b97-48ba-b8c5-20d0445d492a tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:51.562553 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-5a7b3169-9b97-48ba-b8c5-20d0445d492a tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lazy-loading 'services' on Instance uuid 292d240e-1176-4875-8f87-9ca911437fbe {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:37:51.741001 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5a7b3169-9b97-48ba-b8c5-20d0445d492a tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/292d240e-1176-4875-8f87-9ca911437fbe" status: 200 len: 2054 microversion: 2.25 time: 1.344971 Sep 08 10:37:51.744116 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 198/367] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:37:50 2022] GET /compute/v2.1/servers/292d240e-1176-4875-8f87-9ca911437fbe => generated 2054 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:37:51.757474 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ec1c656f-876b-4b21-a2be-d0d010361706 tempest-KeyPairsV210TestJSON-1816127021 tempest-KeyPairsV210TestJSON-1816127021-project-admin] Calling method '.version_select at 0x7f68e4ec39d0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:51.762133 n-d-850501-12 devstack@n-api.service[128861]: WARNING oslo_db.sqlalchemy.utils [None req-ec1c656f-876b-4b21-a2be-d0d010361706 tempest-KeyPairsV210TestJSON-1816127021 tempest-KeyPairsV210TestJSON-1816127021-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Sep 08 10:37:51.781573 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ec1c656f-876b-4b21-a2be-d0d010361706 tempest-KeyPairsV210TestJSON-1816127021 tempest-KeyPairsV210TestJSON-1816127021-project-admin] 10.222.0.27 "GET /compute/v2.1/os-keypairs?user_id=d1246d17fa6f412791a8845624dccd95" status: 200 len: 724 microversion: 2.10 time: 0.036053 Sep 08 10:37:51.785390 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 199/368] 10.222.0.27 () {60 vars in 1259 bytes} [Thu Sep 8 10:37:51 2022] GET /compute/v2.1/os-keypairs?user_id=d1246d17fa6f412791a8845624dccd95 => generated 724 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:37:51.791635 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0bba1141-7703-423d-858b-d59e785d341b tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:51.803072 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0bba1141-7703-423d-858b-d59e785d341b tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] [instance: 292d240e-1176-4875-8f87-9ca911437fbe] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:51.823142 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0bba1141-7703-423d-858b-d59e785d341b tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:51.823642 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0bba1141-7703-423d-858b-d59e785d341b tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:51.824077 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0bba1141-7703-423d-858b-d59e785d341b tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:51.824783 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0bba1141-7703-423d-858b-d59e785d341b tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:51.825263 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0bba1141-7703-423d-858b-d59e785d341b tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:51.826304 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0bba1141-7703-423d-858b-d59e785d341b tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:52.102966 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-0bba1141-7703-423d-858b-d59e785d341b tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lazy-loading 'services' on Instance uuid 292d240e-1176-4875-8f87-9ca911437fbe {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:37:52.123017 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0bba1141-7703-423d-858b-d59e785d341b tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/292d240e-1176-4875-8f87-9ca911437fbe" status: 200 len: 2054 microversion: 2.25 time: 0.336254 Sep 08 10:37:52.124300 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 200/369] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:37:51 2022] GET /compute/v2.1/servers/292d240e-1176-4875-8f87-9ca911437fbe => generated 2054 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:37:52.130216 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c4360c69-5dfc-4511-84b2-d16ef1df21e6 tempest-KeyPairsV210TestJSON-1816127021 tempest-KeyPairsV210TestJSON-1816127021-project-admin] Calling method '.version_select at 0x7f68e4ec8700>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:52.177340 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c4360c69-5dfc-4511-84b2-d16ef1df21e6 tempest-KeyPairsV210TestJSON-1816127021 tempest-KeyPairsV210TestJSON-1816127021-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-742242173" status: 204 len: 0 microversion: 2.10 time: 0.051738 Sep 08 10:37:52.178563 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7ceeeeae-2344-44d7-bd37-f071743ba110 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:52.179931 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 201/370] 10.222.0.27 () {60 vars in 1322 bytes} [Thu Sep 8 10:37:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-742242173 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 10:37:52.192568 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-501f98fa-1894-4d5c-9970-7f4d0e83099c tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:52.201590 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7ceeeeae-2344-44d7-bd37-f071743ba110 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/a3147437-e6f2-480d-bcaf-cc0f030d497d" status: 200 len: 1316 microversion: 2.1 time: 2.097432 Sep 08 10:37:52.202228 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 170/371] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:50 2022] GET /compute/v2.1/servers/a3147437-e6f2-480d-bcaf-cc0f030d497d => generated 1316 bytes in 2107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:52.204308 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-501f98fa-1894-4d5c-9970-7f4d0e83099c tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:52.210187 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-501f98fa-1894-4d5c-9970-7f4d0e83099c tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:52.210988 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-501f98fa-1894-4d5c-9970-7f4d0e83099c tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:52.215505 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-501f98fa-1894-4d5c-9970-7f4d0e83099c tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:52.216448 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-501f98fa-1894-4d5c-9970-7f4d0e83099c tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:52.218706 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-501f98fa-1894-4d5c-9970-7f4d0e83099c tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:52.238381 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b263c2dc-ce58-4309-8081-6989e19a6949 tempest-KeyPairsV210TestJSON-1816127021 tempest-KeyPairsV210TestJSON-1816127021-project-admin] Calling method '.version_select at 0x7f68e4fe3310>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:52.281305 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:37:52.301850 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-501f98fa-1894-4d5c-9970-7f4d0e83099c tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.120483 Sep 08 10:37:52.304112 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 202/372] 10.222.0.27 () {60 vars in 1217 bytes} [Thu Sep 8 10:37:52 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:37:52.317613 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bdeb2e56-7a53-420e-b490-29e80b61e79f tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-850501-12", "block_migration": "auto"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:52.320389 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bdeb2e56-7a53-420e-b490-29e80b61e79f tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] [instance: 292d240e-1176-4875-8f87-9ca911437fbe] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:52.324386 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b263c2dc-ce58-4309-8081-6989e19a6949 tempest-KeyPairsV210TestJSON-1816127021 tempest-KeyPairsV210TestJSON-1816127021-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-284113263?user_id=d1246d17fa6f412791a8845624dccd95" status: 204 len: 0 microversion: 2.10 time: 0.107599 Sep 08 10:37:52.331495 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 171/373] 10.222.0.27 () {60 vars in 1340 bytes} [Thu Sep 8 10:37:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-284113263?user_id=d1246d17fa6f412791a8845624dccd95 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 10:37:52.341079 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bdeb2e56-7a53-420e-b490-29e80b61e79f tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:52.341875 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bdeb2e56-7a53-420e-b490-29e80b61e79f tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:52.342566 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bdeb2e56-7a53-420e-b490-29e80b61e79f tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:52.343644 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bdeb2e56-7a53-420e-b490-29e80b61e79f tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:52.345060 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bdeb2e56-7a53-420e-b490-29e80b61e79f tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:52.345731 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bdeb2e56-7a53-420e-b490-29e80b61e79f tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:52.346107 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dabd2549-1d06-4161-9524-7b1fcf3a5e3a tempest-KeyPairsV210TestJSON-1816127021 tempest-KeyPairsV210TestJSON-1816127021-project-admin] Calling method '.version_select at 0x7f68e4f94040>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:52.414591 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-dabd2549-1d06-4161-9524-7b1fcf3a5e3a tempest-KeyPairsV210TestJSON-1816127021 tempest-KeyPairsV210TestJSON-1816127021-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-962228054?user_id=d1246d17fa6f412791a8845624dccd95" status: 204 len: 0 microversion: 2.10 time: 0.080633 Sep 08 10:37:52.420829 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 172/374] 10.222.0.27 () {60 vars in 1340 bytes} [Thu Sep 8 10:37:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-962228054?user_id=d1246d17fa6f412791a8845624dccd95 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 10:37:52.554557 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dabd2549-1d06-4161-9524-7b1fcf3a5e3a tempest-KeyPairsV210TestJSON-1816127021 tempest-KeyPairsV210TestJSON-1816127021-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:52.555829 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-dabd2549-1d06-4161-9524-7b1fcf3a5e3a tempest-KeyPairsV210TestJSON-1816127021 tempest-KeyPairsV210TestJSON-1816127021-project-admin] 10.222.0.27 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001862 Sep 08 10:37:52.556878 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 173/375] 10.222.0.27 () {56 vars in 886 bytes} [Thu Sep 8 10:37:52 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 08 10:37:53.228433 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a110538d-4916-4470-92c6-d63b9c469075 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:53.229854 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a110538d-4916-4470-92c6-d63b9c469075 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: a3147437-e6f2-480d-bcaf-cc0f030d497d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:53.244453 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a110538d-4916-4470-92c6-d63b9c469075 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:53.247184 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a110538d-4916-4470-92c6-d63b9c469075 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:53.249141 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a110538d-4916-4470-92c6-d63b9c469075 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:53.250401 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a110538d-4916-4470-92c6-d63b9c469075 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:53.253850 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a110538d-4916-4470-92c6-d63b9c469075 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:53.255149 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a110538d-4916-4470-92c6-d63b9c469075 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:53.448947 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-bdeb2e56-7a53-420e-b490-29e80b61e79f tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lazy-loading 'flavor' on Instance uuid 292d240e-1176-4875-8f87-9ca911437fbe {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:37:53.567056 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bdeb2e56-7a53-420e-b490-29e80b61e79f tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] [instance: 292d240e-1176-4875-8f87-9ca911437fbe] Going to try to live migrate instance to n-h2-850501-12 {{(pid=128861) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 08 10:37:53.948751 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a110538d-4916-4470-92c6-d63b9c469075 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:53.957745 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a110538d-4916-4470-92c6-d63b9c469075 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/a3147437-e6f2-480d-bcaf-cc0f030d497d" status: 200 len: 1316 microversion: 2.1 time: 0.735049 Sep 08 10:37:53.974820 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 174/376] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:53 2022] GET /compute/v2.1/servers/a3147437-e6f2-480d-bcaf-cc0f030d497d => generated 1316 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:54.982796 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5c73739e-4e7d-4765-b398-002d0ab53356 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:54.983403 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5c73739e-4e7d-4765-b398-002d0ab53356 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: a3147437-e6f2-480d-bcaf-cc0f030d497d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:55.003058 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c73739e-4e7d-4765-b398-002d0ab53356 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:55.003862 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c73739e-4e7d-4765-b398-002d0ab53356 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:55.004316 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c73739e-4e7d-4765-b398-002d0ab53356 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:55.008522 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c73739e-4e7d-4765-b398-002d0ab53356 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:55.011815 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c73739e-4e7d-4765-b398-002d0ab53356 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:55.013770 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c73739e-4e7d-4765-b398-002d0ab53356 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:55.914908 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5c73739e-4e7d-4765-b398-002d0ab53356 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:55.926476 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5c73739e-4e7d-4765-b398-002d0ab53356 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/a3147437-e6f2-480d-bcaf-cc0f030d497d" status: 200 len: 1316 microversion: 2.1 time: 0.948345 Sep 08 10:37:55.927072 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 175/377] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:54 2022] GET /compute/v2.1/servers/a3147437-e6f2-480d-bcaf-cc0f030d497d => generated 1316 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:37:56.949979 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-195a261c-93f3-4f29-a252-c0850f88a43e tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:56.950623 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-195a261c-93f3-4f29-a252-c0850f88a43e tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: a3147437-e6f2-480d-bcaf-cc0f030d497d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:56.971649 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-195a261c-93f3-4f29-a252-c0850f88a43e tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:56.974247 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-195a261c-93f3-4f29-a252-c0850f88a43e tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:56.982988 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-195a261c-93f3-4f29-a252-c0850f88a43e tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:56.988035 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-195a261c-93f3-4f29-a252-c0850f88a43e tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:56.996444 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-195a261c-93f3-4f29-a252-c0850f88a43e tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:56.997915 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-195a261c-93f3-4f29-a252-c0850f88a43e tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:57.086012 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:37:58.100509 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-195a261c-93f3-4f29-a252-c0850f88a43e tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:58.115432 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-195a261c-93f3-4f29-a252-c0850f88a43e tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/a3147437-e6f2-480d-bcaf-cc0f030d497d" status: 200 len: 1316 microversion: 2.1 time: 1.169529 Sep 08 10:37:58.116405 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 176/378] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:56 2022] GET /compute/v2.1/servers/a3147437-e6f2-480d-bcaf-cc0f030d497d => generated 1316 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:58.126467 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-d85b723a-5002-46e6-8a8d-68bcb6346617 req-a10ba094-413d-4140-9e80-1eeff27fe46f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3147437-e6f2-480d-bcaf-cc0f030d497d", "name": "network-vif-plugged", "status": "completed", "tag": "38fe5d2c-fe31-4e0c-aa4e-7ae415d02939"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:58.139885 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d85b723a-5002-46e6-8a8d-68bcb6346617 req-a10ba094-413d-4140-9e80-1eeff27fe46f service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:58.140631 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d85b723a-5002-46e6-8a8d-68bcb6346617 req-a10ba094-413d-4140-9e80-1eeff27fe46f service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:58.142289 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d85b723a-5002-46e6-8a8d-68bcb6346617 req-a10ba094-413d-4140-9e80-1eeff27fe46f service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:58.170557 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-d85b723a-5002-46e6-8a8d-68bcb6346617 req-a10ba094-413d-4140-9e80-1eeff27fe46f service nova] Creating event network-vif-plugged:38fe5d2c-fe31-4e0c-aa4e-7ae415d02939 for instance a3147437-e6f2-480d-bcaf-cc0f030d497d on n-h2-850501-12 Sep 08 10:37:58.182572 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-d85b723a-5002-46e6-8a8d-68bcb6346617 req-a10ba094-413d-4140-9e80-1eeff27fe46f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064678 Sep 08 10:37:58.183732 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 177/379] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:37:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:37:58.677795 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-69094ad5-73a0-401f-a67a-0269142496c6 tempest-FlavorsExtraSpecsNegativeTestJSON-1828059886 tempest-FlavorsExtraSpecsNegativeTestJSON-1828059886-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1419155198", "ram": 512, "vcpus": 1, "disk": 10, "id": 1862353447, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:58.709659 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-69094ad5-73a0-401f-a67a-0269142496c6 tempest-FlavorsExtraSpecsNegativeTestJSON-1828059886 tempest-FlavorsExtraSpecsNegativeTestJSON-1828059886-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.524150 Sep 08 10:37:58.710264 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 178/380] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:37:58 2022] POST /compute/v2.1/flavors => generated 416 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:37:59.169049 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6354e0ff-764f-40a2-9502-cc47de0b0aea tempest-FlavorsExtraSpecsNegativeTestJSON-1665482687 tempest-FlavorsExtraSpecsNegativeTestJSON-1665482687-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:59.199712 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-6354e0ff-764f-40a2-9502-cc47de0b0aea tempest-FlavorsExtraSpecsNegativeTestJSON-1665482687 tempest-FlavorsExtraSpecsNegativeTestJSON-1665482687-project] HTTP exception thrown: Flavor 1862353447 has no extra specs with key hw:cpu_thread_policy. Sep 08 10:37:59.204263 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6354e0ff-764f-40a2-9502-cc47de0b0aea tempest-FlavorsExtraSpecsNegativeTestJSON-1665482687 tempest-FlavorsExtraSpecsNegativeTestJSON-1665482687-project] Request method failure captured: Sep 08 10:37:59.204263 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/flavors/1862353447/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Sep 08 10:37:59.204263 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:37:59.204263 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:37:59.204263 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:37:59.204263 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:37:59.204263 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:37:59.204263 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:37:59.204263 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:37:59.204263 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:37:59.204263 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcYCpsDdkqD01vK33JmCTl6QMn8h_weKhWoQKN7IT1TZtqHwREcL5398_Qpmtg4JBIa-srtH31g6XcPK53iLO20jVesHbxYCfWYqUsiUoAcMss6LY-1iLeAemp7L11Wred0YUA19KpWqiSGayZFCynU0VN2UMvA3IDs_hctFkNS65fY Sep 08 10:37:59.204263 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:37:59.204263 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:37:59.204263 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:37:59.204263 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:37:59.204263 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:37:59.204263 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:37:59.204263 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 608fa83a4c384ec5940152fe62a731f0 Sep 08 10:37:59.204263 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1665482687 Sep 08 10:37:59.204263 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:37:59.204263 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:37:59.205924 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/608fa83a4c384ec5940152fe62a731f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/608fa83a4c384ec5940152fe62a731f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_608fa83a4c384ec5940152fe62a731f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/608fa83a4c384ec5940152fe62a731f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:37:59.205924 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1665482687 Sep 08 10:37:59.205924 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 608fa83a4c384ec5940152fe62a731f0 Sep 08 10:37:59.205924 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1665482687 Sep 08 10:37:59.205924 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1665482687-project Sep 08 10:37:59.205924 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:37:59.205924 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:37:59.205924 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 15690ecb5e644496a72b199b0ad37c18 Sep 08 10:37:59.205924 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1665482687-project Sep 08 10:37:59.205924 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:37:59.205924 n-d-850501-12 devstack@n-api.service[128862]: exception: Flavor 1862353447 has no extra specs with key hw:cpu_thread_policy. Sep 08 10:37:59.206619 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'flavor_id': '1862353447', 'id': 'hw:cpu_thread_policy'} Sep 08 10:37:59.206619 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:37:59.206619 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:59.206619 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Sep 08 10:37:59.206619 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Sep 08 10:37:59.206619 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Sep 08 10:37:59.206619 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:59.206619 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:59.206619 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:59.206619 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:59.206619 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:59.206619 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:59.206619 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:37:59.206619 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:37:59.206619 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:37:59.206619 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:37:59.206619 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Sep 08 10:37:59.206619 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 08 10:37:59.206619 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1862353447 has no extra specs with key hw:cpu_thread_policy. Sep 08 10:37:59.206619 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:59.206619 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:59.206619 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:59.207927 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:59.207927 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:59.207927 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:59.207927 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:37:59.207927 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:37:59.207927 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1862353447 has no extra specs with key hw:cpu_thread_policy. Sep 08 10:37:59.207927 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:37:59.213438 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6354e0ff-764f-40a2-9502-cc47de0b0aea tempest-FlavorsExtraSpecsNegativeTestJSON-1665482687 tempest-FlavorsExtraSpecsNegativeTestJSON-1665482687-project] Returning 404 to user: Flavor 1862353447 has no extra specs with key hw:cpu_thread_policy. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:37:59.218227 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6354e0ff-764f-40a2-9502-cc47de0b0aea tempest-FlavorsExtraSpecsNegativeTestJSON-1665482687 tempest-FlavorsExtraSpecsNegativeTestJSON-1665482687-project] 10.222.0.27 "GET /compute/v2.1/flavors/1862353447/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.498487 Sep 08 10:37:59.223239 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 179/381] 10.222.0.27 () {58 vars in 1266 bytes} [Thu Sep 8 10:37:58 2022] GET /compute/v2.1/flavors/1862353447/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 504 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 10:37:59.243176 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-75a7adf6-017e-4b2d-95cf-3ed9fa28767c tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:59.244024 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-75a7adf6-017e-4b2d-95cf-3ed9fa28767c tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: a3147437-e6f2-480d-bcaf-cc0f030d497d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:59.263532 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-75a7adf6-017e-4b2d-95cf-3ed9fa28767c tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:59.264091 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-75a7adf6-017e-4b2d-95cf-3ed9fa28767c tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:59.265575 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-75a7adf6-017e-4b2d-95cf-3ed9fa28767c tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:59.268592 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-75a7adf6-017e-4b2d-95cf-3ed9fa28767c tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:59.270848 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-75a7adf6-017e-4b2d-95cf-3ed9fa28767c tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:59.272419 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-75a7adf6-017e-4b2d-95cf-3ed9fa28767c tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:59.844634 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bdeb2e56-7a53-420e-b490-29e80b61e79f tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/292d240e-1176-4875-8f87-9ca911437fbe/action" status: 202 len: 0 microversion: 2.25 time: 7.531370 Sep 08 10:37:59.846424 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 203/382] 10.222.0.27 () {62 vars in 1319 bytes} [Thu Sep 8 10:37:52 2022] POST /compute/v2.1/servers/292d240e-1176-4875-8f87-9ca911437fbe/action => generated 0 bytes in 7534 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 08 10:37:59.871423 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cf73d157-a91d-44b0-abdf-6b58bd33d42b tempest-FlavorsExtraSpecsNegativeTestJSON-1665482687 tempest-FlavorsExtraSpecsNegativeTestJSON-1665482687-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:59.880092 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-cf73d157-a91d-44b0-abdf-6b58bd33d42b tempest-FlavorsExtraSpecsNegativeTestJSON-1665482687 tempest-FlavorsExtraSpecsNegativeTestJSON-1665482687-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '15690ecb5e644496a72b199b0ad37c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608fa83a4c384ec5940152fe62a731f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:59.903193 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cf73d157-a91d-44b0-abdf-6b58bd33d42b tempest-FlavorsExtraSpecsNegativeTestJSON-1665482687 tempest-FlavorsExtraSpecsNegativeTestJSON-1665482687-project] Request method failure captured: Sep 08 10:37:59.903193 n-d-850501-12 devstack@n-api.service[128861]: request: POST /compute/v2.1/flavors/1862353447/os-extra_specs HTTP/1.1 Sep 08 10:37:59.903193 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:37:59.903193 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:37:59.903193 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:37:59.903193 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 66 Sep 08 10:37:59.903193 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:37:59.903193 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:37:59.903193 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:37:59.903193 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:37:59.903193 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcYCpsDdkqD01vK33JmCTl6QMn8h_weKhWoQKN7IT1TZtqHwREcL5398_Qpmtg4JBIa-srtH31g6XcPK53iLO20jVesHbxYCfWYqUsiUoAcMss6LY-1iLeAemp7L11Wred0YUA19KpWqiSGayZFCynU0VN2UMvA3IDs_hctFkNS65fY Sep 08 10:37:59.903193 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:37:59.903193 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:37:59.903193 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:37:59.903193 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:37:59.903193 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:37:59.903193 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:37:59.903193 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 608fa83a4c384ec5940152fe62a731f0 Sep 08 10:37:59.903193 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1665482687 Sep 08 10:37:59.903193 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:37:59.903193 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:37:59.904916 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/608fa83a4c384ec5940152fe62a731f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/608fa83a4c384ec5940152fe62a731f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_608fa83a4c384ec5940152fe62a731f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/608fa83a4c384ec5940152fe62a731f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:37:59.904916 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1665482687 Sep 08 10:37:59.904916 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 608fa83a4c384ec5940152fe62a731f0 Sep 08 10:37:59.904916 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1665482687 Sep 08 10:37:59.904916 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1665482687-project Sep 08 10:37:59.904916 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:37:59.904916 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:37:59.904916 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 15690ecb5e644496a72b199b0ad37c18 Sep 08 10:37:59.904916 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1665482687-project Sep 08 10:37:59.904916 n-d-850501-12 devstack@n-api.service[128861]: Sep 08 10:37:59.904916 n-d-850501-12 devstack@n-api.service[128861]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Sep 08 10:37:59.904916 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:37:59.906099 n-d-850501-12 devstack@n-api.service[128861]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Sep 08 10:37:59.906099 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'flavor_id': '1862353447', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Sep 08 10:37:59.906099 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:37:59.906099 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:59.906099 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:59.906099 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:59.906099 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:37:59.906099 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:37:59.906099 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:37:59.906099 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:37:59.906099 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:37:59.906099 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:37:59.906099 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Sep 08 10:37:59.906099 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Sep 08 10:37:59.906099 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 10:37:59.906099 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 10:37:59.906099 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 10:37:59.906099 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 10:37:59.906099 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:37:59.908182 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:37:59.908182 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:37:59.908182 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:37:59.908182 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 10:37:59.908182 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 10:37:59.908182 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 10:37:59.908182 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 10:37:59.908182 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 10:37:59.908182 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 10:37:59.908182 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Sep 08 10:37:59.908182 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:59.908182 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:59.908182 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:59.908182 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:59.908182 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:59.908182 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:59.908182 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 10:37:59.908182 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 10:37:59.908182 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Sep 08 10:37:59.908182 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:37:59.913875 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cf73d157-a91d-44b0-abdf-6b58bd33d42b tempest-FlavorsExtraSpecsNegativeTestJSON-1665482687 tempest-FlavorsExtraSpecsNegativeTestJSON-1665482687-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:37:59.915707 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cf73d157-a91d-44b0-abdf-6b58bd33d42b tempest-FlavorsExtraSpecsNegativeTestJSON-1665482687 tempest-FlavorsExtraSpecsNegativeTestJSON-1665482687-project] 10.222.0.27 "POST /compute/v2.1/flavors/1862353447/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.067190 Sep 08 10:37:59.929856 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 204/383] 10.222.0.27 () {60 vars in 1224 bytes} [Thu Sep 8 10:37:59 2022] POST /compute/v2.1/flavors/1862353447/os-extra_specs => generated 124 bytes in 83 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:37:59.961130 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-37b7347a-fd60-4f7b-84cc-3d373b01490c tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:59.964689 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-37b7347a-fd60-4f7b-84cc-3d373b01490c tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 292d240e-1176-4875-8f87-9ca911437fbe] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:59.965263 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=8 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:37:59.994781 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-37b7347a-fd60-4f7b-84cc-3d373b01490c tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:00.001451 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-37b7347a-fd60-4f7b-84cc-3d373b01490c tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:00.011523 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-37b7347a-fd60-4f7b-84cc-3d373b01490c tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:00.012456 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-37b7347a-fd60-4f7b-84cc-3d373b01490c tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:00.014921 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-37b7347a-fd60-4f7b-84cc-3d373b01490c tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:00.015384 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-37b7347a-fd60-4f7b-84cc-3d373b01490c tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:00.075767 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-75a7adf6-017e-4b2d-95cf-3ed9fa28767c tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:00.094621 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-75a7adf6-017e-4b2d-95cf-3ed9fa28767c tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/a3147437-e6f2-480d-bcaf-cc0f030d497d" status: 200 len: 1316 microversion: 2.1 time: 0.867183 Sep 08 10:38:00.096058 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 180/384] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:59 2022] GET /compute/v2.1/servers/a3147437-e6f2-480d-bcaf-cc0f030d497d => generated 1316 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:00.106961 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-11a3eccc-0694-481c-810e-d36ebc671e35 tempest-FlavorsExtraSpecsNegativeTestJSON-1828059886 tempest-FlavorsExtraSpecsNegativeTestJSON-1828059886-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:38:00.164908 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-11a3eccc-0694-481c-810e-d36ebc671e35 tempest-FlavorsExtraSpecsNegativeTestJSON-1828059886 tempest-FlavorsExtraSpecsNegativeTestJSON-1828059886-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/1862353447/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.067509 Sep 08 10:38:00.165578 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 181/385] 10.222.0.27 () {60 vars in 1224 bytes} [Thu Sep 8 10:38:00 2022] POST /compute/v2.1/flavors/1862353447/os-extra_specs => generated 66 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:38:00.180749 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2f03a991-a08d-4ad5-9dd3-c8254d538ac2 tempest-FlavorsExtraSpecsNegativeTestJSON-1665482687 tempest-FlavorsExtraSpecsNegativeTestJSON-1665482687-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:00.185485 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2f03a991-a08d-4ad5-9dd3-c8254d538ac2 tempest-FlavorsExtraSpecsNegativeTestJSON-1665482687 tempest-FlavorsExtraSpecsNegativeTestJSON-1665482687-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '15690ecb5e644496a72b199b0ad37c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608fa83a4c384ec5940152fe62a731f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:00.189946 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2f03a991-a08d-4ad5-9dd3-c8254d538ac2 tempest-FlavorsExtraSpecsNegativeTestJSON-1665482687 tempest-FlavorsExtraSpecsNegativeTestJSON-1665482687-project] Request method failure captured: Sep 08 10:38:00.189946 n-d-850501-12 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/flavors/1862353447/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 08 10:38:00.189946 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:38:00.189946 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:38:00.189946 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:38:00.189946 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:38:00.189946 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:38:00.189946 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:38:00.189946 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:38:00.189946 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:38:00.189946 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcYCpsDdkqD01vK33JmCTl6QMn8h_weKhWoQKN7IT1TZtqHwREcL5398_Qpmtg4JBIa-srtH31g6XcPK53iLO20jVesHbxYCfWYqUsiUoAcMss6LY-1iLeAemp7L11Wred0YUA19KpWqiSGayZFCynU0VN2UMvA3IDs_hctFkNS65fY Sep 08 10:38:00.189946 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:38:00.189946 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:38:00.189946 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:38:00.189946 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:38:00.189946 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:38:00.189946 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:38:00.189946 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 608fa83a4c384ec5940152fe62a731f0 Sep 08 10:38:00.189946 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1665482687 Sep 08 10:38:00.189946 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:38:00.189946 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:38:00.191260 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/608fa83a4c384ec5940152fe62a731f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/608fa83a4c384ec5940152fe62a731f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_608fa83a4c384ec5940152fe62a731f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/608fa83a4c384ec5940152fe62a731f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:38:00.191260 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1665482687 Sep 08 10:38:00.191260 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 608fa83a4c384ec5940152fe62a731f0 Sep 08 10:38:00.191260 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1665482687 Sep 08 10:38:00.191260 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1665482687-project Sep 08 10:38:00.191260 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:38:00.191260 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:38:00.191260 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 15690ecb5e644496a72b199b0ad37c18 Sep 08 10:38:00.191260 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1665482687-project Sep 08 10:38:00.191260 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:38:00.191260 n-d-850501-12 devstack@n-api.service[128862]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Sep 08 10:38:00.191907 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'flavor_id': '1862353447', 'id': 'hw:numa_nodes'} Sep 08 10:38:00.191907 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:38:00.191907 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:38:00.191907 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:38:00.191907 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:38:00.191907 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:38:00.191907 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:38:00.191907 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:38:00.191907 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:38:00.191907 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Sep 08 10:38:00.191907 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Sep 08 10:38:00.191907 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 10:38:00.191907 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 10:38:00.191907 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 10:38:00.191907 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 10:38:00.191907 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:38:00.191907 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:38:00.191907 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:38:00.191907 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:38:00.191907 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 10:38:00.193051 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 10:38:00.193051 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 10:38:00.193051 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 10:38:00.193051 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 10:38:00.193051 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 10:38:00.193051 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Sep 08 10:38:00.193051 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:38:00.193051 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:38:00.193051 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:38:00.193051 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:38:00.193051 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:38:00.193051 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:38:00.193051 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 10:38:00.193051 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 10:38:00.193051 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Sep 08 10:38:00.193051 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:38:00.197328 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2f03a991-a08d-4ad5-9dd3-c8254d538ac2 tempest-FlavorsExtraSpecsNegativeTestJSON-1665482687 tempest-FlavorsExtraSpecsNegativeTestJSON-1665482687-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:38:00.198523 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2f03a991-a08d-4ad5-9dd3-c8254d538ac2 tempest-FlavorsExtraSpecsNegativeTestJSON-1665482687 tempest-FlavorsExtraSpecsNegativeTestJSON-1665482687-project] 10.222.0.27 "DELETE /compute/v2.1/flavors/1862353447/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.023121 Sep 08 10:38:00.201348 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 182/386] 10.222.0.27 () {58 vars in 1248 bytes} [Thu Sep 8 10:38:00 2022] DELETE /compute/v2.1/flavors/1862353447/os-extra_specs/hw:numa_nodes => generated 124 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:38:00.223005 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3c8adba5-3214-46f7-b55f-2c905f3d1223 tempest-FlavorsExtraSpecsNegativeTestJSON-1828059886 tempest-FlavorsExtraSpecsNegativeTestJSON-1828059886-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:38:00.294309 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3c8adba5-3214-46f7-b55f-2c905f3d1223 tempest-FlavorsExtraSpecsNegativeTestJSON-1828059886 tempest-FlavorsExtraSpecsNegativeTestJSON-1828059886-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/1862353447/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.087096 Sep 08 10:38:00.302759 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 183/387] 10.222.0.27 () {60 vars in 1224 bytes} [Thu Sep 8 10:38:00 2022] POST /compute/v2.1/flavors/1862353447/os-extra_specs => generated 66 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:38:00.335659 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-045330d7-20cb-4330-8f68-57f007f90b3a tempest-FlavorsExtraSpecsNegativeTestJSON-1665482687 tempest-FlavorsExtraSpecsNegativeTestJSON-1665482687-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:38:00.336965 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=4 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:38:00.351364 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-045330d7-20cb-4330-8f68-57f007f90b3a tempest-FlavorsExtraSpecsNegativeTestJSON-1665482687 tempest-FlavorsExtraSpecsNegativeTestJSON-1665482687-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '15690ecb5e644496a72b199b0ad37c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608fa83a4c384ec5940152fe62a731f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:00.362758 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-045330d7-20cb-4330-8f68-57f007f90b3a tempest-FlavorsExtraSpecsNegativeTestJSON-1665482687 tempest-FlavorsExtraSpecsNegativeTestJSON-1665482687-project] Request method failure captured: Sep 08 10:38:00.362758 n-d-850501-12 devstack@n-api.service[128862]: request: PUT /compute/v2.1/flavors/1862353447/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 08 10:38:00.362758 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:38:00.362758 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:38:00.362758 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:38:00.362758 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 22 Sep 08 10:38:00.362758 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:38:00.362758 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:38:00.362758 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:38:00.362758 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:38:00.362758 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcYCpsDdkqD01vK33JmCTl6QMn8h_weKhWoQKN7IT1TZtqHwREcL5398_Qpmtg4JBIa-srtH31g6XcPK53iLO20jVesHbxYCfWYqUsiUoAcMss6LY-1iLeAemp7L11Wred0YUA19KpWqiSGayZFCynU0VN2UMvA3IDs_hctFkNS65fY Sep 08 10:38:00.362758 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:38:00.362758 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:38:00.362758 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:38:00.362758 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:38:00.362758 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:38:00.362758 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:38:00.362758 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 608fa83a4c384ec5940152fe62a731f0 Sep 08 10:38:00.362758 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1665482687 Sep 08 10:38:00.362758 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:38:00.362758 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:38:00.365042 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/608fa83a4c384ec5940152fe62a731f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/608fa83a4c384ec5940152fe62a731f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_608fa83a4c384ec5940152fe62a731f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/608fa83a4c384ec5940152fe62a731f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:38:00.365042 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1665482687 Sep 08 10:38:00.365042 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 608fa83a4c384ec5940152fe62a731f0 Sep 08 10:38:00.365042 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1665482687 Sep 08 10:38:00.365042 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1665482687-project Sep 08 10:38:00.365042 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:38:00.365042 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:38:00.365042 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 15690ecb5e644496a72b199b0ad37c18 Sep 08 10:38:00.365042 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1665482687-project Sep 08 10:38:00.365042 n-d-850501-12 devstack@n-api.service[128862]: Sep 08 10:38:00.365042 n-d-850501-12 devstack@n-api.service[128862]: {"hw:numa_nodes": "1"} Sep 08 10:38:00.365042 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:38:00.365042 n-d-850501-12 devstack@n-api.service[128862]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Sep 08 10:38:00.366046 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'flavor_id': '1862353447', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Sep 08 10:38:00.366046 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:38:00.366046 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:38:00.366046 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:38:00.366046 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:38:00.366046 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:38:00.366046 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:38:00.366046 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:38:00.366046 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:38:00.366046 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:38:00.366046 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:38:00.366046 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Sep 08 10:38:00.366046 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Sep 08 10:38:00.366046 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 10:38:00.366046 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 10:38:00.366046 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 10:38:00.366046 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 10:38:00.366046 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:38:00.366046 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:38:00.367852 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:38:00.367852 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:38:00.367852 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 10:38:00.367852 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 10:38:00.367852 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 10:38:00.367852 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 10:38:00.367852 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 10:38:00.367852 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 10:38:00.367852 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Sep 08 10:38:00.367852 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:38:00.367852 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:38:00.367852 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:38:00.367852 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:38:00.367852 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:38:00.367852 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:38:00.367852 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 10:38:00.367852 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 10:38:00.367852 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Sep 08 10:38:00.367852 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:38:00.384105 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-045330d7-20cb-4330-8f68-57f007f90b3a tempest-FlavorsExtraSpecsNegativeTestJSON-1665482687 tempest-FlavorsExtraSpecsNegativeTestJSON-1665482687-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:38:00.385244 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-045330d7-20cb-4330-8f68-57f007f90b3a tempest-FlavorsExtraSpecsNegativeTestJSON-1665482687 tempest-FlavorsExtraSpecsNegativeTestJSON-1665482687-project] 10.222.0.27 "PUT /compute/v2.1/flavors/1862353447/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.076349 Sep 08 10:38:00.391596 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 184/388] 10.222.0.27 () {60 vars in 1265 bytes} [Thu Sep 8 10:38:00 2022] PUT /compute/v2.1/flavors/1862353447/os-extra_specs/hw:numa_nodes => generated 124 bytes in 83 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:38:00.405566 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c9b6bca0-509f-4291-9198-8c01cdb68074 tempest-FlavorsExtraSpecsNegativeTestJSON-1828059886 tempest-FlavorsExtraSpecsNegativeTestJSON-1828059886-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:00.455245 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-c9b6bca0-509f-4291-9198-8c01cdb68074 tempest-FlavorsExtraSpecsNegativeTestJSON-1828059886 tempest-FlavorsExtraSpecsNegativeTestJSON-1828059886-project-admin] HTTP exception thrown: Flavor 1862353447 has no extra specs with key hw:cpu_thread_policy. Sep 08 10:38:00.470576 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c9b6bca0-509f-4291-9198-8c01cdb68074 tempest-FlavorsExtraSpecsNegativeTestJSON-1828059886 tempest-FlavorsExtraSpecsNegativeTestJSON-1828059886-project-admin] Request method failure captured: Sep 08 10:38:00.470576 n-d-850501-12 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/flavors/1862353447/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Sep 08 10:38:00.470576 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:38:00.470576 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:38:00.470576 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:38:00.470576 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:38:00.470576 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:38:00.470576 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:38:00.470576 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:38:00.470576 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:38:00.470576 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcYF--qzRmyVwP_oYx7CitnE6dXzQsYcpnIahHJbsIxCM77-FVvShqNy0XSHH9Tl8xnH9vE8cZCoTqTIA7YG5Km4FT9_gkrKywlV0eHYwk8h1c-LUG0u9y-Y8950SCTGBJz-CtJ9lCRWIaESxCrrRMaGhfrZH6ET8S1m-zuVUkSdB0E Sep 08 10:38:00.470576 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:38:00.470576 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:38:00.470576 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:38:00.470576 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:38:00.470576 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:38:00.470576 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:38:00.470576 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 35fa11de44744f46898a918ffa3009ec Sep 08 10:38:00.470576 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1828059886 Sep 08 10:38:00.470576 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,admin,member Sep 08 10:38:00.470576 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,admin,member Sep 08 10:38:00.471968 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/35fa11de44744f46898a918ffa3009ec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/35fa11de44744f46898a918ffa3009ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_35fa11de44744f46898a918ffa3009ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/35fa11de44744f46898a918ffa3009ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:38:00.471968 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1828059886 Sep 08 10:38:00.471968 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 35fa11de44744f46898a918ffa3009ec Sep 08 10:38:00.471968 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1828059886 Sep 08 10:38:00.471968 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1828059886-project-admin Sep 08 10:38:00.471968 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:38:00.471968 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:38:00.471968 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: f2690e26ab5a41bc83720e8dd9157b76 Sep 08 10:38:00.471968 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1828059886-project-admin Sep 08 10:38:00.471968 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:38:00.471968 n-d-850501-12 devstack@n-api.service[128862]: exception: Flavor 1862353447 has no extra specs with key hw:cpu_thread_policy. Sep 08 10:38:00.472800 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'flavor_id': '1862353447', 'id': 'hw:cpu_thread_policy'} Sep 08 10:38:00.472800 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:38:00.472800 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:38:00.472800 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Sep 08 10:38:00.472800 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Sep 08 10:38:00.472800 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Sep 08 10:38:00.472800 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:38:00.472800 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:38:00.472800 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:38:00.472800 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:38:00.472800 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:38:00.472800 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:38:00.472800 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:38:00.472800 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:38:00.472800 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:38:00.472800 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:38:00.472800 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Sep 08 10:38:00.472800 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 08 10:38:00.472800 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1862353447 has no extra specs with key hw:cpu_thread_policy. Sep 08 10:38:00.472800 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:38:00.472800 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:38:00.472800 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:38:00.474192 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:38:00.474192 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:38:00.474192 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:38:00.474192 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:38:00.474192 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:38:00.474192 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1862353447 has no extra specs with key hw:cpu_thread_policy. Sep 08 10:38:00.474192 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:38:00.474192 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c9b6bca0-509f-4291-9198-8c01cdb68074 tempest-FlavorsExtraSpecsNegativeTestJSON-1828059886 tempest-FlavorsExtraSpecsNegativeTestJSON-1828059886-project-admin] Returning 404 to user: Flavor 1862353447 has no extra specs with key hw:cpu_thread_policy. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:38:00.482680 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c9b6bca0-509f-4291-9198-8c01cdb68074 tempest-FlavorsExtraSpecsNegativeTestJSON-1828059886 tempest-FlavorsExtraSpecsNegativeTestJSON-1828059886-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1862353447/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.080738 Sep 08 10:38:00.485166 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 185/389] 10.222.0.27 () {58 vars in 1269 bytes} [Thu Sep 8 10:38:00 2022] DELETE /compute/v2.1/flavors/1862353447/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:38:00.497967 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-387b5c8c-30ec-4254-8b7f-668bd1d23b3f tempest-FlavorsExtraSpecsNegativeTestJSON-1828059886 tempest-FlavorsExtraSpecsNegativeTestJSON-1828059886-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:38:00.508445 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-387b5c8c-30ec-4254-8b7f-668bd1d23b3f tempest-FlavorsExtraSpecsNegativeTestJSON-1828059886 tempest-FlavorsExtraSpecsNegativeTestJSON-1828059886-project-admin] HTTP exception thrown: Request body and URI mismatch Sep 08 10:38:00.517721 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-387b5c8c-30ec-4254-8b7f-668bd1d23b3f tempest-FlavorsExtraSpecsNegativeTestJSON-1828059886 tempest-FlavorsExtraSpecsNegativeTestJSON-1828059886-project-admin] Request method failure captured: Sep 08 10:38:00.517721 n-d-850501-12 devstack@n-api.service[128862]: request: PUT /compute/v2.1/flavors/1862353447/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 08 10:38:00.517721 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:38:00.517721 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:38:00.517721 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:38:00.517721 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 27 Sep 08 10:38:00.517721 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:38:00.517721 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:38:00.517721 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:38:00.517721 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:38:00.517721 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcYF--qzRmyVwP_oYx7CitnE6dXzQsYcpnIahHJbsIxCM77-FVvShqNy0XSHH9Tl8xnH9vE8cZCoTqTIA7YG5Km4FT9_gkrKywlV0eHYwk8h1c-LUG0u9y-Y8950SCTGBJz-CtJ9lCRWIaESxCrrRMaGhfrZH6ET8S1m-zuVUkSdB0E Sep 08 10:38:00.517721 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:38:00.517721 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:38:00.517721 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:38:00.517721 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:38:00.517721 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:38:00.517721 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:38:00.517721 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 35fa11de44744f46898a918ffa3009ec Sep 08 10:38:00.517721 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1828059886 Sep 08 10:38:00.517721 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,admin,member Sep 08 10:38:00.517721 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,admin,member Sep 08 10:38:00.519296 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/35fa11de44744f46898a918ffa3009ec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/35fa11de44744f46898a918ffa3009ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_35fa11de44744f46898a918ffa3009ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/35fa11de44744f46898a918ffa3009ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:38:00.519296 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1828059886 Sep 08 10:38:00.519296 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 35fa11de44744f46898a918ffa3009ec Sep 08 10:38:00.519296 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1828059886 Sep 08 10:38:00.519296 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1828059886-project-admin Sep 08 10:38:00.519296 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:38:00.519296 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:38:00.519296 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: f2690e26ab5a41bc83720e8dd9157b76 Sep 08 10:38:00.519296 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1828059886-project-admin Sep 08 10:38:00.519296 n-d-850501-12 devstack@n-api.service[128862]: Sep 08 10:38:00.519296 n-d-850501-12 devstack@n-api.service[128862]: {"hw:cpu_policy": "shared"} Sep 08 10:38:00.519296 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:38:00.519296 n-d-850501-12 devstack@n-api.service[128862]: exception: Request body and URI mismatch Sep 08 10:38:00.520264 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'flavor_id': '1862353447', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Sep 08 10:38:00.520264 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:38:00.520264 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:38:00.520264 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:38:00.520264 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:38:00.520264 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:38:00.520264 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:38:00.520264 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:38:00.520264 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:38:00.520264 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:38:00.520264 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:38:00.520264 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Sep 08 10:38:00.520264 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Sep 08 10:38:00.520264 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Sep 08 10:38:00.520264 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:38:00.520264 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:38:00.520264 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:38:00.520264 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:38:00.520264 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:38:00.520264 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:38:00.521511 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:38:00.521511 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:38:00.521511 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Sep 08 10:38:00.521511 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:38:00.523510 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-387b5c8c-30ec-4254-8b7f-668bd1d23b3f tempest-FlavorsExtraSpecsNegativeTestJSON-1828059886 tempest-FlavorsExtraSpecsNegativeTestJSON-1828059886-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:38:00.526135 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-387b5c8c-30ec-4254-8b7f-668bd1d23b3f tempest-FlavorsExtraSpecsNegativeTestJSON-1828059886 tempest-FlavorsExtraSpecsNegativeTestJSON-1828059886-project-admin] 10.222.0.27 "PUT /compute/v2.1/flavors/1862353447/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.036307 Sep 08 10:38:00.527028 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 186/390] 10.222.0.27 () {60 vars in 1265 bytes} [Thu Sep 8 10:38:00 2022] PUT /compute/v2.1/flavors/1862353447/os-extra_specs/hw:numa_nodes => generated 73 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 08 10:38:00.538081 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6be7a2c4-bfe6-4767-8db2-0e700225443b tempest-FlavorsExtraSpecsNegativeTestJSON-1828059886 tempest-FlavorsExtraSpecsNegativeTestJSON-1828059886-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:38:00.551109 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6be7a2c4-bfe6-4767-8db2-0e700225443b tempest-FlavorsExtraSpecsNegativeTestJSON-1828059886 tempest-FlavorsExtraSpecsNegativeTestJSON-1828059886-project-admin] Request method failure captured: Sep 08 10:38:00.551109 n-d-850501-12 devstack@n-api.service[128862]: request: PUT /compute/v2.1/flavors/1862353447/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 08 10:38:00.551109 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:38:00.551109 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:38:00.551109 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:38:00.551109 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 49 Sep 08 10:38:00.551109 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:38:00.551109 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:38:00.551109 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:38:00.551109 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:38:00.551109 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcYF--qzRmyVwP_oYx7CitnE6dXzQsYcpnIahHJbsIxCM77-FVvShqNy0XSHH9Tl8xnH9vE8cZCoTqTIA7YG5Km4FT9_gkrKywlV0eHYwk8h1c-LUG0u9y-Y8950SCTGBJz-CtJ9lCRWIaESxCrrRMaGhfrZH6ET8S1m-zuVUkSdB0E Sep 08 10:38:00.551109 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:38:00.551109 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:38:00.551109 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:38:00.551109 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:38:00.551109 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:38:00.551109 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:38:00.551109 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 35fa11de44744f46898a918ffa3009ec Sep 08 10:38:00.551109 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1828059886 Sep 08 10:38:00.551109 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,admin,member Sep 08 10:38:00.551109 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,admin,member Sep 08 10:38:00.552453 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/35fa11de44744f46898a918ffa3009ec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/35fa11de44744f46898a918ffa3009ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_35fa11de44744f46898a918ffa3009ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/35fa11de44744f46898a918ffa3009ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:38:00.552453 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1828059886 Sep 08 10:38:00.552453 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 35fa11de44744f46898a918ffa3009ec Sep 08 10:38:00.552453 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1828059886 Sep 08 10:38:00.552453 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1828059886-project-admin Sep 08 10:38:00.552453 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:38:00.552453 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:38:00.552453 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: f2690e26ab5a41bc83720e8dd9157b76 Sep 08 10:38:00.552453 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1828059886-project-admin Sep 08 10:38:00.552453 n-d-850501-12 devstack@n-api.service[128862]: Sep 08 10:38:00.552453 n-d-850501-12 devstack@n-api.service[128862]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Sep 08 10:38:00.552453 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:38:00.553205 n-d-850501-12 devstack@n-api.service[128862]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 08 10:38:00.553205 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'flavor_id': '1862353447', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Sep 08 10:38:00.553205 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:38:00.553205 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:38:00.553205 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 10:38:00.553205 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 10:38:00.553205 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 10:38:00.553205 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise error Sep 08 10:38:00.553205 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 08 10:38:00.553205 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:38:00.553205 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Sep 08 10:38:00.553205 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 08 10:38:00.553205 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Sep 08 10:38:00.553205 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Sep 08 10:38:00.553205 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 08 10:38:00.553205 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'type': ['string', Sep 08 10:38:00.553205 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'number']}}, Sep 08 10:38:00.553205 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 08 10:38:00.553205 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:38:00.553205 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi On instance: Sep 08 10:38:00.553205 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Sep 08 10:38:00.553205 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:38:00.554681 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:38:00.554681 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:38:00.554681 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:38:00.554681 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:38:00.554681 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:38:00.554681 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:38:00.554681 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:38:00.554681 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:38:00.554681 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:38:00.554681 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 10:38:00.554681 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 10:38:00.554681 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 10:38:00.554681 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 10:38:00.554681 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 10:38:00.554681 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 10:38:00.554681 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 08 10:38:00.554681 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:38:00.554681 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:38:00.554681 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:38:00.554681 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:38:00.555832 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:38:00.555832 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:38:00.555832 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 10:38:00.555832 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 10:38:00.555832 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 08 10:38:00.555832 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:38:00.561186 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6be7a2c4-bfe6-4767-8db2-0e700225443b tempest-FlavorsExtraSpecsNegativeTestJSON-1828059886 tempest-FlavorsExtraSpecsNegativeTestJSON-1828059886-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:38:00.562301 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6be7a2c4-bfe6-4767-8db2-0e700225443b tempest-FlavorsExtraSpecsNegativeTestJSON-1828059886 tempest-FlavorsExtraSpecsNegativeTestJSON-1828059886-project-admin] 10.222.0.27 "PUT /compute/v2.1/flavors/1862353447/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.028247 Sep 08 10:38:00.571388 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 187/391] 10.222.0.27 () {60 vars in 1265 bytes} [Thu Sep 8 10:38:00 2022] PUT /compute/v2.1/flavors/1862353447/os-extra_specs/hw:numa_nodes => generated 117 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:38:00.576961 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-44ca6967-cae1-41f8-bc0d-309303f7f007 tempest-FlavorsExtraSpecsNegativeTestJSON-1828059886 tempest-FlavorsExtraSpecsNegativeTestJSON-1828059886-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:00.647004 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-44ca6967-cae1-41f8-bc0d-309303f7f007 tempest-FlavorsExtraSpecsNegativeTestJSON-1828059886 tempest-FlavorsExtraSpecsNegativeTestJSON-1828059886-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1862353447" status: 202 len: 0 microversion: 2.1 time: 0.073693 Sep 08 10:38:00.655249 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-37b7347a-fd60-4f7b-84cc-3d373b01490c tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:00.658596 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 188/392] 10.222.0.27 () {58 vars in 1161 bytes} [Thu Sep 8 10:38:00 2022] DELETE /compute/v2.1/flavors/1862353447 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:38:00.667932 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cfda6863-1e97-4a2c-ac71-da610aeece4d tempest-FlavorsExtraSpecsNegativeTestJSON-1828059886 tempest-FlavorsExtraSpecsNegativeTestJSON-1828059886-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:00.668985 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-37b7347a-fd60-4f7b-84cc-3d373b01490c tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:00.670492 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-37b7347a-fd60-4f7b-84cc-3d373b01490c tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:00.671681 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-37b7347a-fd60-4f7b-84cc-3d373b01490c tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/292d240e-1176-4875-8f87-9ca911437fbe" status: 200 len: 1569 microversion: 2.25 time: 0.739877 Sep 08 10:38:00.672766 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 205/393] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:37:59 2022] GET /compute/v2.1/servers/292d240e-1176-4875-8f87-9ca911437fbe => generated 1569 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:38:00.768923 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cfda6863-1e97-4a2c-ac71-da610aeece4d tempest-FlavorsExtraSpecsNegativeTestJSON-1828059886 tempest-FlavorsExtraSpecsNegativeTestJSON-1828059886-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.099387 Sep 08 10:38:00.769767 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 189/394] 10.222.0.27 () {58 vars in 1146 bytes} [Thu Sep 8 10:38:00 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:01.003903 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6c36f022-2c3f-48bc-ae14-fc8593b4d7f1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1769520039", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:38:01.117217 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-6c36f022-2c3f-48bc-ae14-fc8593b4d7f1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] validate_networks() for None {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:38:01.153957 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b4eb2e2d-60d2-4a78-aa75-7a18ca50aa45 tempest-InstanceUsageAuditLogNegativeTestJSON-602665880 tempest-InstanceUsageAuditLogNegativeTestJSON-602665880-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:01.155868 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-b4eb2e2d-60d2-4a78-aa75-7a18ca50aa45 tempest-InstanceUsageAuditLogNegativeTestJSON-602665880 tempest-InstanceUsageAuditLogNegativeTestJSON-602665880-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Sep 08 10:38:01.162082 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b4eb2e2d-60d2-4a78-aa75-7a18ca50aa45 tempest-InstanceUsageAuditLogNegativeTestJSON-602665880 tempest-InstanceUsageAuditLogNegativeTestJSON-602665880-project-admin] Request method failure captured: Sep 08 10:38:01.162082 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Sep 08 10:38:01.162082 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:38:01.162082 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:38:01.162082 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:38:01.162082 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:38:01.162082 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:38:01.162082 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:38:01.162082 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:38:01.162082 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:38:01.162082 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcYIwKD0qvzWEt3UFzMMf0D36BzLlKZRTLXdkcP6_qzsSh0WUJzKvfW67yaBSErLbps9WAj05P2LEOaPmbWCGaDA9r6aeDVQS17ydWo3uuhvteKM7sr9QRJM4a0FDn1ETnG4hTVS01Fyoo28Rg2aln80z07ixfG3a1YSsG80VZLsgTg Sep 08 10:38:01.162082 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:38:01.162082 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:38:01.162082 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:38:01.162082 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:38:01.162082 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:38:01.162082 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:38:01.162082 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 4516b0195f934547925ed473edc31e4a Sep 08 10:38:01.162082 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-602665880 Sep 08 10:38:01.162082 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,admin,member Sep 08 10:38:01.162082 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,admin,member Sep 08 10:38:01.163801 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4516b0195f934547925ed473edc31e4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4516b0195f934547925ed473edc31e4a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4516b0195f934547925ed473edc31e4a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4516b0195f934547925ed473edc31e4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:38:01.163801 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-602665880 Sep 08 10:38:01.163801 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 4516b0195f934547925ed473edc31e4a Sep 08 10:38:01.163801 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-602665880 Sep 08 10:38:01.163801 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-602665880-project-admin Sep 08 10:38:01.163801 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:38:01.163801 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:38:01.163801 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 650dab3a7d244742be0df56090e9fe76 Sep 08 10:38:01.163801 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-602665880-project-admin Sep 08 10:38:01.163801 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:38:01.163801 n-d-850501-12 devstack@n-api.service[128862]: exception: Invalid timestamp for date invalid_time Sep 08 10:38:01.164688 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'invalid_time'} Sep 08 10:38:01.164688 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:38:01.164688 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:38:01.164688 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Sep 08 10:38:01.164688 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Sep 08 10:38:01.164688 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Sep 08 10:38:01.164688 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Sep 08 10:38:01.164688 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Sep 08 10:38:01.164688 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Sep 08 10:38:01.164688 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Sep 08 10:38:01.164688 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:38:01.164688 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:38:01.164688 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:38:01.164688 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:38:01.164688 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:38:01.164688 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:38:01.164688 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:38:01.164688 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:38:01.164688 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:38:01.164688 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:38:01.166120 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Sep 08 10:38:01.166120 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Sep 08 10:38:01.166120 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Sep 08 10:38:01.166120 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:38:01.166120 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:38:01.166120 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:38:01.166120 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:38:01.166120 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:38:01.166120 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:38:01.166120 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:38:01.166120 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:38:01.166120 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Sep 08 10:38:01.166120 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:38:01.166120 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b4eb2e2d-60d2-4a78-aa75-7a18ca50aa45 tempest-InstanceUsageAuditLogNegativeTestJSON-602665880 tempest-InstanceUsageAuditLogNegativeTestJSON-602665880-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:38:01.166120 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b4eb2e2d-60d2-4a78-aa75-7a18ca50aa45 tempest-InstanceUsageAuditLogNegativeTestJSON-602665880 tempest-InstanceUsageAuditLogNegativeTestJSON-602665880-project-admin] 10.222.0.27 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.390458 Sep 08 10:38:01.170797 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 190/395] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Sep 8 10:38:00 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 395 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 08 10:38:01.185956 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3c2bee8e-fb14-4b21-a3b6-836b43f2f285 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:01.188819 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3c2bee8e-fb14-4b21-a3b6-836b43f2f285 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: a3147437-e6f2-480d-bcaf-cc0f030d497d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:01.222375 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c2bee8e-fb14-4b21-a3b6-836b43f2f285 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:01.225255 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c2bee8e-fb14-4b21-a3b6-836b43f2f285 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:01.226100 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c2bee8e-fb14-4b21-a3b6-836b43f2f285 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:01.227003 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c2bee8e-fb14-4b21-a3b6-836b43f2f285 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:01.229690 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c2bee8e-fb14-4b21-a3b6-836b43f2f285 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:01.230338 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c2bee8e-fb14-4b21-a3b6-836b43f2f285 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:01.832519 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3c2bee8e-fb14-4b21-a3b6-836b43f2f285 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:01.857827 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3c2bee8e-fb14-4b21-a3b6-836b43f2f285 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/a3147437-e6f2-480d-bcaf-cc0f030d497d" status: 200 len: 1466 microversion: 2.1 time: 0.682982 Sep 08 10:38:01.858528 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 191/396] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:01 2022] GET /compute/v2.1/servers/a3147437-e6f2-480d-bcaf-cc0f030d497d => generated 1466 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:02.237284 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:38:02.522870 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0d711800-af02-4cbe-8c9f-7b2e6b39e949 tempest-InstanceUsageAuditLogNegativeTestJSON-900106402 tempest-InstanceUsageAuditLogNegativeTestJSON-900106402-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:02.525456 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0d711800-af02-4cbe-8c9f-7b2e6b39e949 tempest-InstanceUsageAuditLogNegativeTestJSON-900106402 tempest-InstanceUsageAuditLogNegativeTestJSON-900106402-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'aa4497e46de94ffc8b755876d0d49f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c3cb5b81ed4c4ab7bd12b969a7bf09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:02.527696 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0d711800-af02-4cbe-8c9f-7b2e6b39e949 tempest-InstanceUsageAuditLogNegativeTestJSON-900106402 tempest-InstanceUsageAuditLogNegativeTestJSON-900106402-project] Request method failure captured: Sep 08 10:38:02.527696 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Sep 08 10:38:02.527696 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:38:02.527696 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:38:02.527696 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:38:02.527696 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:38:02.527696 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:38:02.527696 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:38:02.527696 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:38:02.527696 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:38:02.527696 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcYGB5bBJvOpApmBhCLNvMWVp53wsLTYVHlWXYWQkRDYlQwu4_2Pk_cCNaPQadloTi_qtn9GoKon2_tPMfQIAwdSMH1EdGUNeK_t2GDKWl_qHoNWYTBlaYINu-qulxCjwdbDTnEeFcjAK1hfhmCW4ZbUklFVDT8VUBkL_-F315QZUKE Sep 08 10:38:02.527696 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:38:02.527696 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:38:02.527696 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:38:02.527696 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:38:02.527696 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:38:02.527696 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:38:02.527696 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 36c3cb5b81ed4c4ab7bd12b969a7bf09 Sep 08 10:38:02.527696 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-900106402 Sep 08 10:38:02.527696 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:38:02.527696 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:38:02.528933 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/36c3cb5b81ed4c4ab7bd12b969a7bf09"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/36c3cb5b81ed4c4ab7bd12b969a7bf09"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_36c3cb5b81ed4c4ab7bd12b969a7bf09"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/36c3cb5b81ed4c4ab7bd12b969a7bf09"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:38:02.528933 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-900106402 Sep 08 10:38:02.528933 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 36c3cb5b81ed4c4ab7bd12b969a7bf09 Sep 08 10:38:02.528933 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-900106402 Sep 08 10:38:02.528933 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-900106402-project Sep 08 10:38:02.528933 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:38:02.528933 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:38:02.528933 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: aa4497e46de94ffc8b755876d0d49f4b Sep 08 10:38:02.528933 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-900106402-project Sep 08 10:38:02.528933 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:38:02.529574 n-d-850501-12 devstack@n-api.service[128862]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Sep 08 10:38:02.529574 n-d-850501-12 devstack@n-api.service[128862]: action_args: {} Sep 08 10:38:02.529574 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:38:02.529574 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:38:02.529574 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:38:02.529574 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:38:02.529574 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:38:02.529574 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:38:02.529574 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:38:02.529574 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:38:02.529574 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Sep 08 10:38:02.529574 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Sep 08 10:38:02.529574 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 10:38:02.529574 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 10:38:02.529574 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 10:38:02.529574 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 10:38:02.529574 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:38:02.529574 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:38:02.529574 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:38:02.529574 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:38:02.530706 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 10:38:02.530706 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 10:38:02.530706 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 10:38:02.530706 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 10:38:02.530706 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 10:38:02.530706 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 10:38:02.530706 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Sep 08 10:38:02.530706 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:38:02.530706 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:38:02.530706 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:38:02.530706 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:38:02.530706 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:38:02.530706 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:38:02.530706 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 10:38:02.530706 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 10:38:02.530706 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Sep 08 10:38:02.530706 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:38:02.543851 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0d711800-af02-4cbe-8c9f-7b2e6b39e949 tempest-InstanceUsageAuditLogNegativeTestJSON-900106402 tempest-InstanceUsageAuditLogNegativeTestJSON-900106402-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:38:02.545900 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0d711800-af02-4cbe-8c9f-7b2e6b39e949 tempest-InstanceUsageAuditLogNegativeTestJSON-900106402 tempest-InstanceUsageAuditLogNegativeTestJSON-900106402-project] 10.222.0.27 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.684694 Sep 08 10:38:02.546730 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 192/397] 10.222.0.27 () {58 vars in 1185 bytes} [Thu Sep 8 10:38:01 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 688 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:38:02.552142 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-921f2e0b-4f48-441e-9e38-c50ccd35d736 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:02.558384 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-921f2e0b-4f48-441e-9e38-c50ccd35d736 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 292d240e-1176-4875-8f87-9ca911437fbe] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:02.578025 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-921f2e0b-4f48-441e-9e38-c50ccd35d736 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:02.579969 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-921f2e0b-4f48-441e-9e38-c50ccd35d736 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:02.585442 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-921f2e0b-4f48-441e-9e38-c50ccd35d736 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:02.587325 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-921f2e0b-4f48-441e-9e38-c50ccd35d736 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:02.588669 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-921f2e0b-4f48-441e-9e38-c50ccd35d736 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:02.589367 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-921f2e0b-4f48-441e-9e38-c50ccd35d736 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:03.164877 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-6c36f022-2c3f-48bc-ae14-fc8593b4d7f1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:38:03.165557 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-6c36f022-2c3f-48bc-ae14-fc8593b4d7f1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:38:03.166195 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-6c36f022-2c3f-48bc-ae14-fc8593b4d7f1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:38:03.166800 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-6c36f022-2c3f-48bc-ae14-fc8593b4d7f1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:38:03.167374 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-6c36f022-2c3f-48bc-ae14-fc8593b4d7f1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:38:03.186469 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6c36f022-2c3f-48bc-ae14-fc8593b4d7f1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:03.187228 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6c36f022-2c3f-48bc-ae14-fc8593b4d7f1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:03.188665 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6c36f022-2c3f-48bc-ae14-fc8593b4d7f1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:03.189756 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6c36f022-2c3f-48bc-ae14-fc8593b4d7f1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:03.190424 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6c36f022-2c3f-48bc-ae14-fc8593b4d7f1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:03.191014 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6c36f022-2c3f-48bc-ae14-fc8593b4d7f1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:03.216375 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-6c36f022-2c3f-48bc-ae14-fc8593b4d7f1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Getting quotas for project a52c0b4a043445df94dab4dd4292607a. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:38:03.222340 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-6c36f022-2c3f-48bc-ae14-fc8593b4d7f1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Getting quotas for user 5450284cb50b4f75be0915074bf8fe78 and project a52c0b4a043445df94dab4dd4292607a. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:38:03.243867 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6c36f022-2c3f-48bc-ae14-fc8593b4d7f1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:38:03.252479 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6c36f022-2c3f-48bc-ae14-fc8593b4d7f1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 815705bc-e49e-47a1-864b-9cc550464808] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:38:03.327237 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6c36f022-2c3f-48bc-ae14-fc8593b4d7f1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.628710 Sep 08 10:38:03.329223 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 206/398] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:38:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 2631 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:38:03.689778 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-921f2e0b-4f48-441e-9e38-c50ccd35d736 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:03.722811 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-921f2e0b-4f48-441e-9e38-c50ccd35d736 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:03.728609 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-921f2e0b-4f48-441e-9e38-c50ccd35d736 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:03.736431 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-921f2e0b-4f48-441e-9e38-c50ccd35d736 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/292d240e-1176-4875-8f87-9ca911437fbe" status: 200 len: 1569 microversion: 2.25 time: 1.187899 Sep 08 10:38:03.737089 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 193/399] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:38:02 2022] GET /compute/v2.1/servers/292d240e-1176-4875-8f87-9ca911437fbe => generated 1569 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:38:03.756889 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d6a3f300-7aac-4292-9e85-74a1ae3ce3f1 tempest-InstanceUsageAuditLogNegativeTestJSON-900106402 tempest-InstanceUsageAuditLogNegativeTestJSON-900106402-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:03.769972 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d6a3f300-7aac-4292-9e85-74a1ae3ce3f1 tempest-InstanceUsageAuditLogNegativeTestJSON-900106402 tempest-InstanceUsageAuditLogNegativeTestJSON-900106402-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'aa4497e46de94ffc8b755876d0d49f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c3cb5b81ed4c4ab7bd12b969a7bf09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:03.792442 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d6a3f300-7aac-4292-9e85-74a1ae3ce3f1 tempest-InstanceUsageAuditLogNegativeTestJSON-900106402 tempest-InstanceUsageAuditLogNegativeTestJSON-900106402-project] Request method failure captured: Sep 08 10:38:03.792442 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-09-08%2010:38:02 HTTP/1.1 Sep 08 10:38:03.792442 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:38:03.792442 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:38:03.792442 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:38:03.792442 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:38:03.792442 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:38:03.792442 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:38:03.792442 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:38:03.792442 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:38:03.792442 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcYGB5bBJvOpApmBhCLNvMWVp53wsLTYVHlWXYWQkRDYlQwu4_2Pk_cCNaPQadloTi_qtn9GoKon2_tPMfQIAwdSMH1EdGUNeK_t2GDKWl_qHoNWYTBlaYINu-qulxCjwdbDTnEeFcjAK1hfhmCW4ZbUklFVDT8VUBkL_-F315QZUKE Sep 08 10:38:03.792442 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:38:03.792442 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:38:03.792442 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:38:03.792442 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:38:03.792442 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:38:03.792442 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:38:03.792442 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 36c3cb5b81ed4c4ab7bd12b969a7bf09 Sep 08 10:38:03.792442 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-900106402 Sep 08 10:38:03.792442 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:38:03.792442 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:38:03.793894 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/36c3cb5b81ed4c4ab7bd12b969a7bf09"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/36c3cb5b81ed4c4ab7bd12b969a7bf09"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_36c3cb5b81ed4c4ab7bd12b969a7bf09"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/36c3cb5b81ed4c4ab7bd12b969a7bf09"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:38:03.793894 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-900106402 Sep 08 10:38:03.793894 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 36c3cb5b81ed4c4ab7bd12b969a7bf09 Sep 08 10:38:03.793894 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-900106402 Sep 08 10:38:03.793894 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-900106402-project Sep 08 10:38:03.793894 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:38:03.793894 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:38:03.793894 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: aa4497e46de94ffc8b755876d0d49f4b Sep 08 10:38:03.793894 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-900106402-project Sep 08 10:38:03.793894 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:38:03.794551 n-d-850501-12 devstack@n-api.service[128862]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Sep 08 10:38:03.794551 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '2022-09-08 10:38:02'} Sep 08 10:38:03.794551 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:38:03.794551 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:38:03.794551 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:38:03.794551 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:38:03.794551 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:38:03.794551 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:38:03.794551 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:38:03.794551 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:38:03.794551 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Sep 08 10:38:03.794551 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Sep 08 10:38:03.794551 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 10:38:03.794551 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 10:38:03.794551 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 10:38:03.794551 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 10:38:03.794551 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:38:03.794551 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:38:03.794551 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:38:03.794551 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:38:03.795820 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 10:38:03.795820 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 10:38:03.795820 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 10:38:03.795820 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 10:38:03.795820 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 10:38:03.795820 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 10:38:03.795820 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Sep 08 10:38:03.795820 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:38:03.795820 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:38:03.795820 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:38:03.795820 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:38:03.795820 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:38:03.795820 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:38:03.795820 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 10:38:03.795820 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 10:38:03.795820 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Sep 08 10:38:03.795820 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:38:03.799391 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d6a3f300-7aac-4292-9e85-74a1ae3ce3f1 tempest-InstanceUsageAuditLogNegativeTestJSON-900106402 tempest-InstanceUsageAuditLogNegativeTestJSON-900106402-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:38:03.800508 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d6a3f300-7aac-4292-9e85-74a1ae3ce3f1 tempest-InstanceUsageAuditLogNegativeTestJSON-900106402 tempest-InstanceUsageAuditLogNegativeTestJSON-900106402-project] 10.222.0.27 "GET /compute/v2.1/os-instance_usage_audit_log/2022-09-08 10:38:02" status: 403 len: 128 microversion: 2.1 time: 0.062434 Sep 08 10:38:03.801472 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 194/400] 10.222.0.27 () {58 vars in 1251 bytes} [Thu Sep 8 10:38:03 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-09-08%2010%3A38%3A02 => generated 128 bytes in 64 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:38:03.809389 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-d5d6d7a8-4663-4830-bbe4-646b39908c7e req-14e3d8ce-2fdb-4e8c-ad2b-e68462b4f830 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "292d240e-1176-4875-8f87-9ca911437fbe", "name": "network-vif-unplugged", "status": "completed", "tag": "73b84527-1c36-4494-857a-3c9441bb8f82"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:38:03.826967 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d5d6d7a8-4663-4830-bbe4-646b39908c7e req-14e3d8ce-2fdb-4e8c-ad2b-e68462b4f830 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:03.827797 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d5d6d7a8-4663-4830-bbe4-646b39908c7e req-14e3d8ce-2fdb-4e8c-ad2b-e68462b4f830 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:03.828667 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d5d6d7a8-4663-4830-bbe4-646b39908c7e req-14e3d8ce-2fdb-4e8c-ad2b-e68462b4f830 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:03.842384 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-d5d6d7a8-4663-4830-bbe4-646b39908c7e req-14e3d8ce-2fdb-4e8c-ad2b-e68462b4f830 service nova] Creating event network-vif-unplugged:73b84527-1c36-4494-857a-3c9441bb8f82 for instance 292d240e-1176-4875-8f87-9ca911437fbe on n-h1-850501-12 Sep 08 10:38:03.868878 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-d5d6d7a8-4663-4830-bbe4-646b39908c7e req-14e3d8ce-2fdb-4e8c-ad2b-e68462b4f830 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065413 Sep 08 10:38:03.870920 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 195/401] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:38:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:38:03.877876 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a20e6a2d-046f-49ce-9c19-380c005b3b72 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:03.891773 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a20e6a2d-046f-49ce-9c19-380c005b3b72 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 815705bc-e49e-47a1-864b-9cc550464808] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:04.002136 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-49220f14-f7bf-4604-8445-d5abb6618cf9 tempest-ServersOnMultiNodesTest-60601867 tempest-ServersOnMultiNodesTest-60601867-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:04.003001 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-49220f14-f7bf-4604-8445-d5abb6618cf9 tempest-ServersOnMultiNodesTest-60601867 tempest-ServersOnMultiNodesTest-60601867-project-admin] [instance: a3147437-e6f2-480d-bcaf-cc0f030d497d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:04.031074 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-49220f14-f7bf-4604-8445-d5abb6618cf9 tempest-ServersOnMultiNodesTest-60601867 tempest-ServersOnMultiNodesTest-60601867-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:04.031791 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-49220f14-f7bf-4604-8445-d5abb6618cf9 tempest-ServersOnMultiNodesTest-60601867 tempest-ServersOnMultiNodesTest-60601867-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:04.033429 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-49220f14-f7bf-4604-8445-d5abb6618cf9 tempest-ServersOnMultiNodesTest-60601867 tempest-ServersOnMultiNodesTest-60601867-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:04.039690 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-49220f14-f7bf-4604-8445-d5abb6618cf9 tempest-ServersOnMultiNodesTest-60601867 tempest-ServersOnMultiNodesTest-60601867-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:04.041346 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-49220f14-f7bf-4604-8445-d5abb6618cf9 tempest-ServersOnMultiNodesTest-60601867 tempest-ServersOnMultiNodesTest-60601867-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:04.042640 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-49220f14-f7bf-4604-8445-d5abb6618cf9 tempest-ServersOnMultiNodesTest-60601867 tempest-ServersOnMultiNodesTest-60601867-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:04.341995 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a20e6a2d-046f-49ce-9c19-380c005b3b72 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:04.357645 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a20e6a2d-046f-49ce-9c19-380c005b3b72 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808" status: 200 len: 1213 microversion: 2.1 time: 0.485173 Sep 08 10:38:04.358248 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 196/402] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:03 2022] GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808 => generated 1213 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:04.784473 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5d654361-e283-4a5f-8124-6e9ca2cd356a tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:04.788749 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5d654361-e283-4a5f-8124-6e9ca2cd356a tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 292d240e-1176-4875-8f87-9ca911437fbe] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:04.821470 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5d654361-e283-4a5f-8124-6e9ca2cd356a tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:04.826405 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5d654361-e283-4a5f-8124-6e9ca2cd356a tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:04.827116 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5d654361-e283-4a5f-8124-6e9ca2cd356a tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:04.830743 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5d654361-e283-4a5f-8124-6e9ca2cd356a tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:04.832600 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5d654361-e283-4a5f-8124-6e9ca2cd356a tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:04.834265 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5d654361-e283-4a5f-8124-6e9ca2cd356a tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:05.405326 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5d654361-e283-4a5f-8124-6e9ca2cd356a tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:05.428794 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5d654361-e283-4a5f-8124-6e9ca2cd356a tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:05.436736 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5d654361-e283-4a5f-8124-6e9ca2cd356a tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:05.442746 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5d654361-e283-4a5f-8124-6e9ca2cd356a tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/292d240e-1176-4875-8f87-9ca911437fbe" status: 200 len: 1569 microversion: 2.25 time: 0.661690 Sep 08 10:38:05.445544 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 197/403] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:38:04 2022] GET /compute/v2.1/servers/292d240e-1176-4875-8f87-9ca911437fbe => generated 1569 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:38:05.468923 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-155b27b6-b0b0-4890-b63b-f4cc27b73747 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:05.472059 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-155b27b6-b0b0-4890-b63b-f4cc27b73747 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 815705bc-e49e-47a1-864b-9cc550464808] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:05.498738 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-155b27b6-b0b0-4890-b63b-f4cc27b73747 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:05.505569 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-155b27b6-b0b0-4890-b63b-f4cc27b73747 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:05.506823 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-155b27b6-b0b0-4890-b63b-f4cc27b73747 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:05.510265 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-155b27b6-b0b0-4890-b63b-f4cc27b73747 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:05.512847 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-155b27b6-b0b0-4890-b63b-f4cc27b73747 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:05.517234 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-155b27b6-b0b0-4890-b63b-f4cc27b73747 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:05.572378 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-49220f14-f7bf-4604-8445-d5abb6618cf9 tempest-ServersOnMultiNodesTest-60601867 tempest-ServersOnMultiNodesTest-60601867-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/a3147437-e6f2-480d-bcaf-cc0f030d497d" status: 200 len: 1619 microversion: 2.1 time: 2.241302 Sep 08 10:38:05.583193 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 207/404] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:03 2022] GET /compute/v2.1/servers/a3147437-e6f2-480d-bcaf-cc0f030d497d => generated 1619 bytes in 2253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:05.624177 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-63120215-16c6-4674-9646-9e25a862cf70 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Action: 'create', calling method: .version_select at 0x7f68e4cf1d30>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1016186715", "policies": ["affinity"]}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:38:05.738459 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-63120215-16c6-4674-9646-9e25a862cf70 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Getting quotas for project 2a3d4a2ec8674e418602b6dc0cec6ab9. Resources: {'server_groups'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:38:05.766614 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-63120215-16c6-4674-9646-9e25a862cf70 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Getting quotas for user 771c067cf6814084a5520128a970dc82 and project 2a3d4a2ec8674e418602b6dc0cec6ab9. Resources: {'server_groups'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:38:05.767320 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-155b27b6-b0b0-4890-b63b-f4cc27b73747 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:05.784061 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-155b27b6-b0b0-4890-b63b-f4cc27b73747 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808" status: 200 len: 1265 microversion: 2.1 time: 0.333042 Sep 08 10:38:05.788429 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 198/405] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:05 2022] GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808 => generated 1265 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:05.903078 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-96abf071-8fc1-4541-8fb8-df813999eef3 req-377c266e-671e-4619-a365-8aee7ff9716c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "292d240e-1176-4875-8f87-9ca911437fbe", "tag": "73b84527-1c36-4494-857a-3c9441bb8f82"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:38:05.931267 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-96abf071-8fc1-4541-8fb8-df813999eef3 req-377c266e-671e-4619-a365-8aee7ff9716c service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:05.932052 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-96abf071-8fc1-4541-8fb8-df813999eef3 req-377c266e-671e-4619-a365-8aee7ff9716c service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:05.932691 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-96abf071-8fc1-4541-8fb8-df813999eef3 req-377c266e-671e-4619-a365-8aee7ff9716c service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:05.948310 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-63120215-16c6-4674-9646-9e25a862cf70 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Getting quotas for project 2a3d4a2ec8674e418602b6dc0cec6ab9. Resources: {'server_groups'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:38:05.961310 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-63120215-16c6-4674-9646-9e25a862cf70 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Getting quotas for user 771c067cf6814084a5520128a970dc82 and project 2a3d4a2ec8674e418602b6dc0cec6ab9. Resources: {'server_groups'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:38:05.966549 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-96abf071-8fc1-4541-8fb8-df813999eef3 req-377c266e-671e-4619-a365-8aee7ff9716c service nova] Creating event network-changed:73b84527-1c36-4494-857a-3c9441bb8f82 for instance 292d240e-1176-4875-8f87-9ca911437fbe on n-h1-850501-12 Sep 08 10:38:05.973590 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:DELETE=6,nova_api:SELECT=87,nova_api:INSERT=7 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:38:05.979517 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-96abf071-8fc1-4541-8fb8-df813999eef3 req-377c266e-671e-4619-a365-8aee7ff9716c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080768 Sep 08 10:38:05.980124 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 199/406] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:38:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:38:06.016531 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-63120215-16c6-4674-9646-9e25a862cf70 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.407382 Sep 08 10:38:06.027416 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 208/407] 10.222.0.27 () {60 vars in 1174 bytes} [Thu Sep 8 10:38:05 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:38:06.273131 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0f8ced0e-bca6-453d-b450-e637189466bb tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1711101188", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "3c7ac2f4-7900-4460-88d2-b99d2a90cb64"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:38:06.375376 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-0f8ced0e-bca6-453d-b450-e637189466bb tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] validate_networks() for None {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:38:06.479514 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3edafb12-fb8e-436e-a77d-d26118ad0134 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:06.480364 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3edafb12-fb8e-436e-a77d-d26118ad0134 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 292d240e-1176-4875-8f87-9ca911437fbe] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:06.489191 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3edafb12-fb8e-436e-a77d-d26118ad0134 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:06.489631 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3edafb12-fb8e-436e-a77d-d26118ad0134 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:06.495334 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3edafb12-fb8e-436e-a77d-d26118ad0134 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:06.497863 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3edafb12-fb8e-436e-a77d-d26118ad0134 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:06.501955 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3edafb12-fb8e-436e-a77d-d26118ad0134 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:06.502834 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3edafb12-fb8e-436e-a77d-d26118ad0134 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:07.309306 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-0f8ced0e-bca6-453d-b450-e637189466bb tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:38:07.309805 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-0f8ced0e-bca6-453d-b450-e637189466bb tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:38:07.310282 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-0f8ced0e-bca6-453d-b450-e637189466bb tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:38:07.310686 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-0f8ced0e-bca6-453d-b450-e637189466bb tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:38:07.311271 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-0f8ced0e-bca6-453d-b450-e637189466bb tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:38:07.354310 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-3edafb12-fb8e-436e-a77d-d26118ad0134 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:07.376041 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-3edafb12-fb8e-436e-a77d-d26118ad0134 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:07.380633 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f8ced0e-bca6-453d-b450-e637189466bb tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:07.381531 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f8ced0e-bca6-453d-b450-e637189466bb tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:07.382175 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f8ced0e-bca6-453d-b450-e637189466bb tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:07.382840 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-3edafb12-fb8e-436e-a77d-d26118ad0134 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:07.383728 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f8ced0e-bca6-453d-b450-e637189466bb tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:07.384194 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f8ced0e-bca6-453d-b450-e637189466bb tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:07.385467 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3edafb12-fb8e-436e-a77d-d26118ad0134 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/292d240e-1176-4875-8f87-9ca911437fbe" status: 200 len: 1569 microversion: 2.25 time: 0.909801 Sep 08 10:38:07.385596 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f8ced0e-bca6-453d-b450-e637189466bb tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:07.387124 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 209/408] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:38:06 2022] GET /compute/v2.1/servers/292d240e-1176-4875-8f87-9ca911437fbe => generated 1569 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:38:07.393223 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1279f25c-4a38-4930-bed4-427064be434e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:07.394220 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1279f25c-4a38-4930-bed4-427064be434e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 815705bc-e49e-47a1-864b-9cc550464808] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:07.415660 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1279f25c-4a38-4930-bed4-427064be434e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:07.416832 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1279f25c-4a38-4930-bed4-427064be434e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:07.422386 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-0f8ced0e-bca6-453d-b450-e637189466bb tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Getting quotas for project 2a3d4a2ec8674e418602b6dc0cec6ab9. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:38:07.422890 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1279f25c-4a38-4930-bed4-427064be434e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:07.423718 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1279f25c-4a38-4930-bed4-427064be434e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:07.424200 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1279f25c-4a38-4930-bed4-427064be434e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:07.424810 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1279f25c-4a38-4930-bed4-427064be434e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:07.428168 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-0f8ced0e-bca6-453d-b450-e637189466bb tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Getting quotas for user 771c067cf6814084a5520128a970dc82 and project 2a3d4a2ec8674e418602b6dc0cec6ab9. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:38:07.446127 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0f8ced0e-bca6-453d-b450-e637189466bb tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Going to run 2 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:38:07.450021 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0f8ced0e-bca6-453d-b450-e637189466bb tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: b135e70e-1c5a-4432-9b50-237c118a5296] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:38:07.517271 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-0f8ced0e-bca6-453d-b450-e637189466bb tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=128862) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Sep 08 10:38:07.547648 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-0f8ced0e-bca6-453d-b450-e637189466bb tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Getting quotas for project 2a3d4a2ec8674e418602b6dc0cec6ab9. Resources: {'server_group_members'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:38:07.552357 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-0f8ced0e-bca6-453d-b450-e637189466bb tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Getting quotas for user 771c067cf6814084a5520128a970dc82 and project 2a3d4a2ec8674e418602b6dc0cec6ab9. Resources: {'server_group_members'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:38:07.556606 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=5,nova_api:INSERT=6,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:38:07.603807 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1279f25c-4a38-4930-bed4-427064be434e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:07.620508 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1279f25c-4a38-4930-bed4-427064be434e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808" status: 200 len: 1271 microversion: 2.1 time: 0.231691 Sep 08 10:38:07.623791 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 210/409] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:07 2022] GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808 => generated 1271 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:07.628183 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-0f8ced0e-bca6-453d-b450-e637189466bb tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Getting quotas for project 2a3d4a2ec8674e418602b6dc0cec6ab9. Resources: {'server_group_members'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:38:07.633511 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-0f8ced0e-bca6-453d-b450-e637189466bb tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Getting quotas for user 771c067cf6814084a5520128a970dc82 and project 2a3d4a2ec8674e418602b6dc0cec6ab9. Resources: {'server_group_members'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:38:07.658848 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0f8ced0e-bca6-453d-b450-e637189466bb tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: d32351b1-7fc7-4ce4-846d-16add998d5ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=b135e70e-1c5a-4432-9b50-237c118a5296,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:38:07.793100 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-0f8ced0e-bca6-453d-b450-e637189466bb tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Getting quotas for project 2a3d4a2ec8674e418602b6dc0cec6ab9. Resources: {'server_group_members'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:38:07.803715 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-0f8ced0e-bca6-453d-b450-e637189466bb tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Getting quotas for user 771c067cf6814084a5520128a970dc82 and project 2a3d4a2ec8674e418602b6dc0cec6ab9. Resources: {'server_group_members'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:38:07.902461 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-0f8ced0e-bca6-453d-b450-e637189466bb tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Getting quotas for project 2a3d4a2ec8674e418602b6dc0cec6ab9. Resources: {'server_group_members'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:38:07.914556 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-0f8ced0e-bca6-453d-b450-e637189466bb tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Getting quotas for user 771c067cf6814084a5520128a970dc82 and project 2a3d4a2ec8674e418602b6dc0cec6ab9. Resources: {'server_group_members'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:38:08.000894 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0f8ced0e-bca6-453d-b450-e637189466bb tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.732481 Sep 08 10:38:08.002438 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 200/410] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:38:06 2022] POST /compute/v2.1/servers => generated 32 bytes in 1735 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Sep 08 10:38:08.011381 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0c6829fe-6751-4b93-9706-79c892d64f3f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:08.033218 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0c6829fe-6751-4b93-9706-79c892d64f3f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:08.034172 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0c6829fe-6751-4b93-9706-79c892d64f3f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Searching by: {'deleted': False, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9'} {{(pid=128861) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:38:08.078921 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0c6829fe-6751-4b93-9706-79c892d64f3f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:08.083144 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0c6829fe-6751-4b93-9706-79c892d64f3f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:08.085629 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0c6829fe-6751-4b93-9706-79c892d64f3f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:08.086684 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0c6829fe-6751-4b93-9706-79c892d64f3f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:08.094887 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0c6829fe-6751-4b93-9706-79c892d64f3f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:08.095666 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0c6829fe-6751-4b93-9706-79c892d64f3f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:08.295901 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.multi_cell_list [None req-0c6829fe-6751-4b93-9706-79c892d64f3f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=128861) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 10:38:08.425010 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-47aa6569-e03d-4891-9b84-0a50e895b52b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:08.434046 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-47aa6569-e03d-4891-9b84-0a50e895b52b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 292d240e-1176-4875-8f87-9ca911437fbe] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:08.477661 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-47aa6569-e03d-4891-9b84-0a50e895b52b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:08.482462 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-47aa6569-e03d-4891-9b84-0a50e895b52b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:08.482928 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-47aa6569-e03d-4891-9b84-0a50e895b52b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:08.492366 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-47aa6569-e03d-4891-9b84-0a50e895b52b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:08.497970 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-47aa6569-e03d-4891-9b84-0a50e895b52b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:08.498451 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-47aa6569-e03d-4891-9b84-0a50e895b52b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:08.825648 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0c6829fe-6751-4b93-9706-79c892d64f3f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 1003 microversion: 2.1 time: 0.818696 Sep 08 10:38:08.839799 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 211/411] 10.222.0.27 () {58 vars in 1125 bytes} [Thu Sep 8 10:38:08 2022] GET /compute/v2.1/servers => generated 1003 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:08.862152 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0b4043ed-f488-4ebe-9d26-2e594e975798 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:08.863310 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0b4043ed-f488-4ebe-9d26-2e594e975798 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 815705bc-e49e-47a1-864b-9cc550464808] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:08.888654 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0b4043ed-f488-4ebe-9d26-2e594e975798 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:08.891653 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0b4043ed-f488-4ebe-9d26-2e594e975798 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:08.892131 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0b4043ed-f488-4ebe-9d26-2e594e975798 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:08.902867 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0b4043ed-f488-4ebe-9d26-2e594e975798 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:08.905428 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0b4043ed-f488-4ebe-9d26-2e594e975798 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:08.906749 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0b4043ed-f488-4ebe-9d26-2e594e975798 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:09.781912 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0b4043ed-f488-4ebe-9d26-2e594e975798 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:09.795323 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-47aa6569-e03d-4891-9b84-0a50e895b52b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:09.801254 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0b4043ed-f488-4ebe-9d26-2e594e975798 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808" status: 200 len: 1271 microversion: 2.1 time: 0.952096 Sep 08 10:38:09.801945 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 212/412] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:08 2022] GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808 => generated 1271 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:09.811442 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-47aa6569-e03d-4891-9b84-0a50e895b52b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:09.813251 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-47aa6569-e03d-4891-9b84-0a50e895b52b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:09.814736 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-47aa6569-e03d-4891-9b84-0a50e895b52b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/292d240e-1176-4875-8f87-9ca911437fbe" status: 200 len: 1569 microversion: 2.25 time: 1.401549 Sep 08 10:38:09.820475 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7c0d0262-f10a-45c1-817a-862b8825bd7b tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:09.821615 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7c0d0262-f10a-45c1-817a-862b8825bd7b tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: d32351b1-7fc7-4ce4-846d-16add998d5ab] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:09.855384 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 201/413] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:38:08 2022] GET /compute/v2.1/servers/292d240e-1176-4875-8f87-9ca911437fbe => generated 1569 bytes in 1443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:38:09.967624 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7c0d0262-f10a-45c1-817a-862b8825bd7b tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:09.982882 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7c0d0262-f10a-45c1-817a-862b8825bd7b tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/d32351b1-7fc7-4ce4-846d-16add998d5ab" status: 200 len: 1219 microversion: 2.1 time: 0.179817 Sep 08 10:38:09.983473 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 213/414] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:09 2022] GET /compute/v2.1/servers/d32351b1-7fc7-4ce4-846d-16add998d5ab => generated 1219 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:10.828455 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dc0826ee-1cf8-4b82-9879-4984eaba35a1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:10.829118 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-dc0826ee-1cf8-4b82-9879-4984eaba35a1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 815705bc-e49e-47a1-864b-9cc550464808] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:10.841270 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dc0826ee-1cf8-4b82-9879-4984eaba35a1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:10.841785 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dc0826ee-1cf8-4b82-9879-4984eaba35a1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:10.844725 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dc0826ee-1cf8-4b82-9879-4984eaba35a1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:10.845544 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dc0826ee-1cf8-4b82-9879-4984eaba35a1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:10.846239 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dc0826ee-1cf8-4b82-9879-4984eaba35a1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:10.846431 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-39036ee2-7490-4328-9868-695c8a5273fe tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:10.846679 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dc0826ee-1cf8-4b82-9879-4984eaba35a1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:10.847057 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-39036ee2-7490-4328-9868-695c8a5273fe tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 292d240e-1176-4875-8f87-9ca911437fbe] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:10.879786 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-39036ee2-7490-4328-9868-695c8a5273fe tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:10.882560 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-39036ee2-7490-4328-9868-695c8a5273fe tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:10.883167 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-39036ee2-7490-4328-9868-695c8a5273fe tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:10.887328 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-39036ee2-7490-4328-9868-695c8a5273fe tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:10.890511 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-39036ee2-7490-4328-9868-695c8a5273fe tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:10.893647 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-39036ee2-7490-4328-9868-695c8a5273fe tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:11.420999 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-dc0826ee-1cf8-4b82-9879-4984eaba35a1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:11.438763 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-dc0826ee-1cf8-4b82-9879-4984eaba35a1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808" status: 200 len: 1271 microversion: 2.1 time: 0.612822 Sep 08 10:38:11.442212 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 202/415] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:10 2022] GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808 => generated 1271 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:11.502697 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-39036ee2-7490-4328-9868-695c8a5273fe tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:11.512779 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-39036ee2-7490-4328-9868-695c8a5273fe tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:11.527524 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-39036ee2-7490-4328-9868-695c8a5273fe tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:11.535023 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-39036ee2-7490-4328-9868-695c8a5273fe tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/292d240e-1176-4875-8f87-9ca911437fbe" status: 200 len: 1569 microversion: 2.25 time: 0.687745 Sep 08 10:38:11.536619 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 214/416] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:38:10 2022] GET /compute/v2.1/servers/292d240e-1176-4875-8f87-9ca911437fbe => generated 1569 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:38:11.541859 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-69fd7d6f-510e-4aa9-8e09-43f2e9944b78 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:11.550744 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-69fd7d6f-510e-4aa9-8e09-43f2e9944b78 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: d32351b1-7fc7-4ce4-846d-16add998d5ab] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:11.572048 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-69fd7d6f-510e-4aa9-8e09-43f2e9944b78 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:11.572893 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-69fd7d6f-510e-4aa9-8e09-43f2e9944b78 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:11.573891 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-69fd7d6f-510e-4aa9-8e09-43f2e9944b78 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:11.574842 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-69fd7d6f-510e-4aa9-8e09-43f2e9944b78 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:11.575674 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-69fd7d6f-510e-4aa9-8e09-43f2e9944b78 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:11.576829 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-69fd7d6f-510e-4aa9-8e09-43f2e9944b78 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:11.732409 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-69fd7d6f-510e-4aa9-8e09-43f2e9944b78 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:11.751371 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-69fd7d6f-510e-4aa9-8e09-43f2e9944b78 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/d32351b1-7fc7-4ce4-846d-16add998d5ab" status: 200 len: 1271 microversion: 2.1 time: 0.212765 Sep 08 10:38:11.760295 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 215/417] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:11 2022] GET /compute/v2.1/servers/d32351b1-7fc7-4ce4-846d-16add998d5ab => generated 1271 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:12.471806 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a7b00a42-6361-4aa6-8dc8-9adda84ee6f1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:12.472438 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a7b00a42-6361-4aa6-8dc8-9adda84ee6f1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 815705bc-e49e-47a1-864b-9cc550464808] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:12.488319 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a7b00a42-6361-4aa6-8dc8-9adda84ee6f1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:12.489187 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a7b00a42-6361-4aa6-8dc8-9adda84ee6f1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:12.492238 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a7b00a42-6361-4aa6-8dc8-9adda84ee6f1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:12.493194 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a7b00a42-6361-4aa6-8dc8-9adda84ee6f1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:12.497053 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a7b00a42-6361-4aa6-8dc8-9adda84ee6f1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:12.497516 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a7b00a42-6361-4aa6-8dc8-9adda84ee6f1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:12.523181 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a9f3bdb4-9026-475b-abbf-ffd67bd8ab51 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-576560571", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "15b153a9-4f79-4605-9c99-0d83878931cf"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:38:12.666646 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-a9f3bdb4-9026-475b-abbf-ffd67bd8ab51 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] validate_networks() for [('15b153a9-4f79-4605-9c99-0d83878931cf', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:38:13.864070 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-a9f3bdb4-9026-475b-abbf-ffd67bd8ab51 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:38:13.865302 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-a9f3bdb4-9026-475b-abbf-ffd67bd8ab51 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:38:13.866044 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-a9f3bdb4-9026-475b-abbf-ffd67bd8ab51 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:38:13.866834 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-a9f3bdb4-9026-475b-abbf-ffd67bd8ab51 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:38:13.867755 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-a9f3bdb4-9026-475b-abbf-ffd67bd8ab51 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:38:13.879142 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a9f3bdb4-9026-475b-abbf-ffd67bd8ab51 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:13.880047 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a9f3bdb4-9026-475b-abbf-ffd67bd8ab51 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:13.881327 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a9f3bdb4-9026-475b-abbf-ffd67bd8ab51 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:13.882513 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a9f3bdb4-9026-475b-abbf-ffd67bd8ab51 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:13.883451 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a9f3bdb4-9026-475b-abbf-ffd67bd8ab51 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:13.884091 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a9f3bdb4-9026-475b-abbf-ffd67bd8ab51 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:13.922084 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-a9f3bdb4-9026-475b-abbf-ffd67bd8ab51 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Getting quotas for project c7f9807a4eb2473e87377097b0544d0e. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:38:13.930204 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-a9f3bdb4-9026-475b-abbf-ffd67bd8ab51 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Getting quotas for user 3ecf9924d86b4fd38a6f31430e9d3418 and project c7f9807a4eb2473e87377097b0544d0e. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:38:13.953208 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a9f3bdb4-9026-475b-abbf-ffd67bd8ab51 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:38:13.959364 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a9f3bdb4-9026-475b-abbf-ffd67bd8ab51 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: ec8a85b1-636c-4699-8042-4dbefbc881f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:38:13.993554 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a7b00a42-6361-4aa6-8dc8-9adda84ee6f1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:14.024645 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a7b00a42-6361-4aa6-8dc8-9adda84ee6f1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808" status: 200 len: 1313 microversion: 2.1 time: 1.560468 Sep 08 10:38:14.034734 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 216/418] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:12 2022] GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808 => generated 1313 bytes in 1571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:38:14.056968 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a9f3bdb4-9026-475b-abbf-ffd67bd8ab51 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.611658 Sep 08 10:38:14.058008 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 203/419] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:38:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 2614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:38:14.069769 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3a0059ff-ea07-4c28-919e-c6d3402c0c18 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:14.070809 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3a0059ff-ea07-4c28-919e-c6d3402c0c18 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: d32351b1-7fc7-4ce4-846d-16add998d5ab] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:14.084054 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a0059ff-ea07-4c28-919e-c6d3402c0c18 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:14.084874 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a0059ff-ea07-4c28-919e-c6d3402c0c18 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:14.085625 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a0059ff-ea07-4c28-919e-c6d3402c0c18 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:14.086315 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-65c40a83-621b-454c-9ff3-e7a218bf4302 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:14.087360 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a0059ff-ea07-4c28-919e-c6d3402c0c18 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:14.088773 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a0059ff-ea07-4c28-919e-c6d3402c0c18 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:14.089689 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a0059ff-ea07-4c28-919e-c6d3402c0c18 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:14.092493 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-65c40a83-621b-454c-9ff3-e7a218bf4302 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 292d240e-1176-4875-8f87-9ca911437fbe] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:14.126289 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-65c40a83-621b-454c-9ff3-e7a218bf4302 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:14.126789 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-65c40a83-621b-454c-9ff3-e7a218bf4302 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:14.130581 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-65c40a83-621b-454c-9ff3-e7a218bf4302 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:14.131375 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-65c40a83-621b-454c-9ff3-e7a218bf4302 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:14.131847 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-65c40a83-621b-454c-9ff3-e7a218bf4302 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:14.132277 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-65c40a83-621b-454c-9ff3-e7a218bf4302 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:14.140642 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:38:14.321485 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3a0059ff-ea07-4c28-919e-c6d3402c0c18 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:14.334176 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3a0059ff-ea07-4c28-919e-c6d3402c0c18 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/d32351b1-7fc7-4ce4-846d-16add998d5ab" status: 200 len: 1277 microversion: 2.1 time: 0.274505 Sep 08 10:38:14.347360 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 204/420] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:14 2022] GET /compute/v2.1/servers/d32351b1-7fc7-4ce4-846d-16add998d5ab => generated 1277 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:15.070183 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-65c40a83-621b-454c-9ff3-e7a218bf4302 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:15.083210 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-65c40a83-621b-454c-9ff3-e7a218bf4302 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:15.085761 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-65c40a83-621b-454c-9ff3-e7a218bf4302 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:15.089472 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-65c40a83-621b-454c-9ff3-e7a218bf4302 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/292d240e-1176-4875-8f87-9ca911437fbe" status: 200 len: 1569 microversion: 2.25 time: 1.049149 Sep 08 10:38:15.108582 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 217/421] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:38:14 2022] GET /compute/v2.1/servers/292d240e-1176-4875-8f87-9ca911437fbe => generated 1569 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:38:15.123983 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-19ed398d-1be9-4a03-a662-173a6713e420 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:15.129866 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-19ed398d-1be9-4a03-a662-173a6713e420 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: ec8a85b1-636c-4699-8042-4dbefbc881f3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:15.163525 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3999654d-102c-46ca-8649-2dc1fcd449ee tempest-HostsAdminTestJSON-56208176 tempest-HostsAdminTestJSON-56208176-project-admin] Calling method '.version_select at 0x7f68e4fa8f70>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:15.176174 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3999654d-102c-46ca-8649-2dc1fcd449ee tempest-HostsAdminTestJSON-56208176 tempest-HostsAdminTestJSON-56208176-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:15.179649 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3999654d-102c-46ca-8649-2dc1fcd449ee tempest-HostsAdminTestJSON-56208176 tempest-HostsAdminTestJSON-56208176-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:15.181335 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3999654d-102c-46ca-8649-2dc1fcd449ee tempest-HostsAdminTestJSON-56208176 tempest-HostsAdminTestJSON-56208176-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:15.183419 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3999654d-102c-46ca-8649-2dc1fcd449ee tempest-HostsAdminTestJSON-56208176 tempest-HostsAdminTestJSON-56208176-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:15.184590 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3999654d-102c-46ca-8649-2dc1fcd449ee tempest-HostsAdminTestJSON-56208176 tempest-HostsAdminTestJSON-56208176-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:15.185941 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3999654d-102c-46ca-8649-2dc1fcd449ee tempest-HostsAdminTestJSON-56208176 tempest-HostsAdminTestJSON-56208176-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:15.289663 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3999654d-102c-46ca-8649-2dc1fcd449ee tempest-HostsAdminTestJSON-56208176 tempest-HostsAdminTestJSON-56208176-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.940222 Sep 08 10:38:15.290315 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 205/422] 10.222.0.27 () {58 vars in 1128 bytes} [Thu Sep 8 10:38:14 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:38:15.305191 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cc30fdfe-84ff-4dd3-8b89-151a1e32a841 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:15.306341 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cc30fdfe-84ff-4dd3-8b89-151a1e32a841 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 815705bc-e49e-47a1-864b-9cc550464808] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:15.327923 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc30fdfe-84ff-4dd3-8b89-151a1e32a841 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:15.329970 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc30fdfe-84ff-4dd3-8b89-151a1e32a841 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:15.332229 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc30fdfe-84ff-4dd3-8b89-151a1e32a841 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:15.335975 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc30fdfe-84ff-4dd3-8b89-151a1e32a841 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:15.338247 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc30fdfe-84ff-4dd3-8b89-151a1e32a841 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:15.338925 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc30fdfe-84ff-4dd3-8b89-151a1e32a841 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:15.429220 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-19ed398d-1be9-4a03-a662-173a6713e420 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:15.443658 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-19ed398d-1be9-4a03-a662-173a6713e420 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/ec8a85b1-636c-4699-8042-4dbefbc881f3" status: 200 len: 1210 microversion: 2.1 time: 0.332934 Sep 08 10:38:15.447205 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 218/423] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:15 2022] GET /compute/v2.1/servers/ec8a85b1-636c-4699-8042-4dbefbc881f3 => generated 1210 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:15.458103 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9046745f-0bd0-4fc2-8944-cf9471434bb7 tempest-HostsAdminTestJSON-56208176 tempest-HostsAdminTestJSON-56208176-project-admin] Calling method '.version_select at 0x7f68e4e0fc10>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:15.472576 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9046745f-0bd0-4fc2-8944-cf9471434bb7 tempest-HostsAdminTestJSON-56208176 tempest-HostsAdminTestJSON-56208176-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:15.473571 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9046745f-0bd0-4fc2-8944-cf9471434bb7 tempest-HostsAdminTestJSON-56208176 tempest-HostsAdminTestJSON-56208176-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:15.474296 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9046745f-0bd0-4fc2-8944-cf9471434bb7 tempest-HostsAdminTestJSON-56208176 tempest-HostsAdminTestJSON-56208176-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:15.480066 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9046745f-0bd0-4fc2-8944-cf9471434bb7 tempest-HostsAdminTestJSON-56208176 tempest-HostsAdminTestJSON-56208176-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:15.481080 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9046745f-0bd0-4fc2-8944-cf9471434bb7 tempest-HostsAdminTestJSON-56208176 tempest-HostsAdminTestJSON-56208176-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:15.483083 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9046745f-0bd0-4fc2-8944-cf9471434bb7 tempest-HostsAdminTestJSON-56208176 tempest-HostsAdminTestJSON-56208176-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:15.568630 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9046745f-0bd0-4fc2-8944-cf9471434bb7 tempest-HostsAdminTestJSON-56208176 tempest-HostsAdminTestJSON-56208176-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 381 microversion: 2.1 time: 0.119915 Sep 08 10:38:15.585996 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 219/424] 10.222.0.27 () {58 vars in 1139 bytes} [Thu Sep 8 10:38:15 2022] GET /compute/v2.1/os-hosts?zone= => generated 381 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:38:15.689851 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d6b052ff-9363-45a6-8519-11fbdccf802d tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1621890161", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:38:15.769962 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-d6b052ff-9363-45a6-8519-11fbdccf802d tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] validate_networks() for None {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:38:16.819455 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cc30fdfe-84ff-4dd3-8b89-151a1e32a841 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:16.832963 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cc30fdfe-84ff-4dd3-8b89-151a1e32a841 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808" status: 200 len: 1313 microversion: 2.1 time: 1.537271 Sep 08 10:38:16.833716 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 206/425] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:15 2022] GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808 => generated 1313 bytes in 1542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:16.839883 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7487d224-a433-46d8-a891-b04b8b1430b0 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:16.840801 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7487d224-a433-46d8-a891-b04b8b1430b0 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: d32351b1-7fc7-4ce4-846d-16add998d5ab] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:16.860353 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7487d224-a433-46d8-a891-b04b8b1430b0 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:16.865809 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7487d224-a433-46d8-a891-b04b8b1430b0 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:16.868006 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7487d224-a433-46d8-a891-b04b8b1430b0 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:16.868006 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7487d224-a433-46d8-a891-b04b8b1430b0 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:16.870168 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7487d224-a433-46d8-a891-b04b8b1430b0 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:16.871865 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7487d224-a433-46d8-a891-b04b8b1430b0 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:16.912087 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-d6b052ff-9363-45a6-8519-11fbdccf802d tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:38:16.913502 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-d6b052ff-9363-45a6-8519-11fbdccf802d tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:38:16.914364 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-d6b052ff-9363-45a6-8519-11fbdccf802d tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:38:16.917019 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-d6b052ff-9363-45a6-8519-11fbdccf802d tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:38:16.917814 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-d6b052ff-9363-45a6-8519-11fbdccf802d tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:38:16.945270 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d6b052ff-9363-45a6-8519-11fbdccf802d tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:16.950203 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d6b052ff-9363-45a6-8519-11fbdccf802d tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:16.950667 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d6b052ff-9363-45a6-8519-11fbdccf802d tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:16.951448 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d6b052ff-9363-45a6-8519-11fbdccf802d tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:16.951913 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d6b052ff-9363-45a6-8519-11fbdccf802d tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:16.958135 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d6b052ff-9363-45a6-8519-11fbdccf802d tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:17.010087 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-d6b052ff-9363-45a6-8519-11fbdccf802d tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Getting quotas for project 49b3414c389540e7a35f03809b064d03. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:38:17.017890 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-d6b052ff-9363-45a6-8519-11fbdccf802d tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Getting quotas for user 9913da38392048c897ada11a1ac5e6a8 and project 49b3414c389540e7a35f03809b064d03. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:38:17.044589 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d6b052ff-9363-45a6-8519-11fbdccf802d tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:38:17.049400 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d6b052ff-9363-45a6-8519-11fbdccf802d tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] [instance: bc3d77c9-40f4-4f37-9717-9c11e724e637] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:38:17.151489 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7487d224-a433-46d8-a891-b04b8b1430b0 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:17.169290 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7487d224-a433-46d8-a891-b04b8b1430b0 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/d32351b1-7fc7-4ce4-846d-16add998d5ab" status: 200 len: 1277 microversion: 2.1 time: 0.333381 Sep 08 10:38:17.174049 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 207/426] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:16 2022] GET /compute/v2.1/servers/d32351b1-7fc7-4ce4-846d-16add998d5ab => generated 1277 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:17.177765 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d6b052ff-9363-45a6-8519-11fbdccf802d tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.589642 Sep 08 10:38:17.178685 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 220/427] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:38:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1592 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:38:17.184983 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-87b3615c-2903-4855-9aff-af88cdf0d76b tempest-HostsAdminTestJSON-56208176 tempest-HostsAdminTestJSON-56208176-project-admin] Calling method '.version_select at 0x7f68e4f94ca0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:17.188446 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fd8c3ff8-bcec-41ce-ad3c-6fa707db22d5 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:17.193184 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fd8c3ff8-bcec-41ce-ad3c-6fa707db22d5 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 292d240e-1176-4875-8f87-9ca911437fbe] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:17.195321 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87b3615c-2903-4855-9aff-af88cdf0d76b tempest-HostsAdminTestJSON-56208176 tempest-HostsAdminTestJSON-56208176-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:17.196240 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87b3615c-2903-4855-9aff-af88cdf0d76b tempest-HostsAdminTestJSON-56208176 tempest-HostsAdminTestJSON-56208176-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:17.197245 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87b3615c-2903-4855-9aff-af88cdf0d76b tempest-HostsAdminTestJSON-56208176 tempest-HostsAdminTestJSON-56208176-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:17.198407 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87b3615c-2903-4855-9aff-af88cdf0d76b tempest-HostsAdminTestJSON-56208176 tempest-HostsAdminTestJSON-56208176-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:17.199241 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87b3615c-2903-4855-9aff-af88cdf0d76b tempest-HostsAdminTestJSON-56208176 tempest-HostsAdminTestJSON-56208176-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:17.200090 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87b3615c-2903-4855-9aff-af88cdf0d76b tempest-HostsAdminTestJSON-56208176 tempest-HostsAdminTestJSON-56208176-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:17.207415 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fd8c3ff8-bcec-41ce-ad3c-6fa707db22d5 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:17.207977 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fd8c3ff8-bcec-41ce-ad3c-6fa707db22d5 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:17.208411 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fd8c3ff8-bcec-41ce-ad3c-6fa707db22d5 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:17.209145 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fd8c3ff8-bcec-41ce-ad3c-6fa707db22d5 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:17.209772 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fd8c3ff8-bcec-41ce-ad3c-6fa707db22d5 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:17.210371 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fd8c3ff8-bcec-41ce-ad3c-6fa707db22d5 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:17.246142 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-87b3615c-2903-4855-9aff-af88cdf0d76b tempest-HostsAdminTestJSON-56208176 tempest-HostsAdminTestJSON-56208176-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.070454 Sep 08 10:38:17.248906 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 208/428] 10.222.0.27 () {58 vars in 1145 bytes} [Thu Sep 8 10:38:17 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:38:17.262278 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b7bd8afb-9c5c-45df-9b97-012fd2f164e7 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:17.263155 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b7bd8afb-9c5c-45df-9b97-012fd2f164e7 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: ec8a85b1-636c-4699-8042-4dbefbc881f3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:17.305856 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b7bd8afb-9c5c-45df-9b97-012fd2f164e7 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:17.309299 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b7bd8afb-9c5c-45df-9b97-012fd2f164e7 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:17.314276 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b7bd8afb-9c5c-45df-9b97-012fd2f164e7 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:17.316396 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b7bd8afb-9c5c-45df-9b97-012fd2f164e7 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:17.321809 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b7bd8afb-9c5c-45df-9b97-012fd2f164e7 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:17.322332 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b7bd8afb-9c5c-45df-9b97-012fd2f164e7 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:17.698805 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b7bd8afb-9c5c-45df-9b97-012fd2f164e7 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:17.716512 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b7bd8afb-9c5c-45df-9b97-012fd2f164e7 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/ec8a85b1-636c-4699-8042-4dbefbc881f3" status: 200 len: 1268 microversion: 2.1 time: 0.466237 Sep 08 10:38:17.717147 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 209/429] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:17 2022] GET /compute/v2.1/servers/ec8a85b1-636c-4699-8042-4dbefbc881f3 => generated 1268 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:17.723961 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-24cc12d4-b14f-4511-93dd-e80a1eb3d31b req-669f56f7-7108-4f30-86d1-5ab070148c0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "815705bc-e49e-47a1-864b-9cc550464808", "tag": "9c8702f3-cdfe-4a4b-9877-3df5412c0e8d"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:38:17.753308 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-24cc12d4-b14f-4511-93dd-e80a1eb3d31b req-669f56f7-7108-4f30-86d1-5ab070148c0d service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:17.754142 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-24cc12d4-b14f-4511-93dd-e80a1eb3d31b req-669f56f7-7108-4f30-86d1-5ab070148c0d service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:17.754789 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-24cc12d4-b14f-4511-93dd-e80a1eb3d31b req-669f56f7-7108-4f30-86d1-5ab070148c0d service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:17.768866 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-24cc12d4-b14f-4511-93dd-e80a1eb3d31b req-669f56f7-7108-4f30-86d1-5ab070148c0d service nova] Creating event network-changed:9c8702f3-cdfe-4a4b-9877-3df5412c0e8d for instance 815705bc-e49e-47a1-864b-9cc550464808 on n-h1-850501-12 Sep 08 10:38:17.789637 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-24cc12d4-b14f-4511-93dd-e80a1eb3d31b req-669f56f7-7108-4f30-86d1-5ab070148c0d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070731 Sep 08 10:38:17.791651 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 210/430] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:38:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:38:17.798123 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-286011ff-2709-4efa-8921-27a176cd370b tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:17.812744 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-286011ff-2709-4efa-8921-27a176cd370b tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] [instance: bc3d77c9-40f4-4f37-9717-9c11e724e637] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:17.988820 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-286011ff-2709-4efa-8921-27a176cd370b tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9913da38392048c897ada11a1ac5e6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b3414c389540e7a35f03809b064d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:18.001939 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-286011ff-2709-4efa-8921-27a176cd370b tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] 10.222.0.27 "GET /compute/v2.1/servers/bc3d77c9-40f4-4f37-9717-9c11e724e637" status: 200 len: 1223 microversion: 2.1 time: 0.206470 Sep 08 10:38:18.006287 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 211/431] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:17 2022] GET /compute/v2.1/servers/bc3d77c9-40f4-4f37-9717-9c11e724e637 => generated 1223 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:18.017173 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4d117f99-ccf7-4344-8a9d-eb46daa33768 tempest-HostsAdminTestJSON-56208176 tempest-HostsAdminTestJSON-56208176-project-admin] Calling method '.version_select at 0x7f68e4ead790>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:18.025403 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d117f99-ccf7-4344-8a9d-eb46daa33768 tempest-HostsAdminTestJSON-56208176 tempest-HostsAdminTestJSON-56208176-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:18.031988 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d117f99-ccf7-4344-8a9d-eb46daa33768 tempest-HostsAdminTestJSON-56208176 tempest-HostsAdminTestJSON-56208176-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:18.043528 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d117f99-ccf7-4344-8a9d-eb46daa33768 tempest-HostsAdminTestJSON-56208176 tempest-HostsAdminTestJSON-56208176-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:18.048038 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d117f99-ccf7-4344-8a9d-eb46daa33768 tempest-HostsAdminTestJSON-56208176 tempest-HostsAdminTestJSON-56208176-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:18.050047 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d117f99-ccf7-4344-8a9d-eb46daa33768 tempest-HostsAdminTestJSON-56208176 tempest-HostsAdminTestJSON-56208176-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:18.053567 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d117f99-ccf7-4344-8a9d-eb46daa33768 tempest-HostsAdminTestJSON-56208176 tempest-HostsAdminTestJSON-56208176-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:18.079899 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-fd8c3ff8-bcec-41ce-ad3c-6fa707db22d5 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:18.129964 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-fd8c3ff8-bcec-41ce-ad3c-6fa707db22d5 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:18.133954 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-fd8c3ff8-bcec-41ce-ad3c-6fa707db22d5 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:18.135190 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fd8c3ff8-bcec-41ce-ad3c-6fa707db22d5 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/292d240e-1176-4875-8f87-9ca911437fbe" status: 200 len: 1569 microversion: 2.25 time: 0.955578 Sep 08 10:38:18.137716 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 221/432] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:38:17 2022] GET /compute/v2.1/servers/292d240e-1176-4875-8f87-9ca911437fbe => generated 1569 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:38:18.149260 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7e0a0644-e3fc-400b-aa34-5895e6cbe895 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:18.150157 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7e0a0644-e3fc-400b-aa34-5895e6cbe895 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 815705bc-e49e-47a1-864b-9cc550464808] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:18.159469 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7e0a0644-e3fc-400b-aa34-5895e6cbe895 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:18.160296 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7e0a0644-e3fc-400b-aa34-5895e6cbe895 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:18.160806 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7e0a0644-e3fc-400b-aa34-5895e6cbe895 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:18.162320 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7e0a0644-e3fc-400b-aa34-5895e6cbe895 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:18.163051 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7e0a0644-e3fc-400b-aa34-5895e6cbe895 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:18.164286 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7e0a0644-e3fc-400b-aa34-5895e6cbe895 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:18.192977 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4d117f99-ccf7-4344-8a9d-eb46daa33768 tempest-HostsAdminTestJSON-56208176 tempest-HostsAdminTestJSON-56208176-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.184319 Sep 08 10:38:18.200856 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 212/433] 10.222.0.27 () {58 vars in 1128 bytes} [Thu Sep 8 10:38:18 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:38:18.204374 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-01238d2a-44c8-4c73-a240-2bb8d70d8913 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:18.205232 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-01238d2a-44c8-4c73-a240-2bb8d70d8913 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: d32351b1-7fc7-4ce4-846d-16add998d5ab] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:18.221808 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01238d2a-44c8-4c73-a240-2bb8d70d8913 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:18.228910 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01238d2a-44c8-4c73-a240-2bb8d70d8913 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:18.230216 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01238d2a-44c8-4c73-a240-2bb8d70d8913 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:18.230940 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01238d2a-44c8-4c73-a240-2bb8d70d8913 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:18.231505 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01238d2a-44c8-4c73-a240-2bb8d70d8913 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:18.231999 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01238d2a-44c8-4c73-a240-2bb8d70d8913 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:19.143364 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7e0a0644-e3fc-400b-aa34-5895e6cbe895 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:19.152409 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7e0a0644-e3fc-400b-aa34-5895e6cbe895 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808" status: 200 len: 1313 microversion: 2.1 time: 1.013373 Sep 08 10:38:19.153393 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 222/434] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:18 2022] GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808 => generated 1313 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:19.159404 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7a33c192-3aac-4142-9c5e-3fdb0299ab6e tempest-HostsAdminTestJSON-56208176 tempest-HostsAdminTestJSON-56208176-project-admin] Calling method '.version_select at 0x7f68e4cf1a60>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:19.164189 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a33c192-3aac-4142-9c5e-3fdb0299ab6e tempest-HostsAdminTestJSON-56208176 tempest-HostsAdminTestJSON-56208176-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:19.164969 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a33c192-3aac-4142-9c5e-3fdb0299ab6e tempest-HostsAdminTestJSON-56208176 tempest-HostsAdminTestJSON-56208176-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:19.165697 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a33c192-3aac-4142-9c5e-3fdb0299ab6e tempest-HostsAdminTestJSON-56208176 tempest-HostsAdminTestJSON-56208176-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:19.166677 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a33c192-3aac-4142-9c5e-3fdb0299ab6e tempest-HostsAdminTestJSON-56208176 tempest-HostsAdminTestJSON-56208176-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:19.167471 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a33c192-3aac-4142-9c5e-3fdb0299ab6e tempest-HostsAdminTestJSON-56208176 tempest-HostsAdminTestJSON-56208176-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:19.168124 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a33c192-3aac-4142-9c5e-3fdb0299ab6e tempest-HostsAdminTestJSON-56208176 tempest-HostsAdminTestJSON-56208176-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:19.199259 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7a33c192-3aac-4142-9c5e-3fdb0299ab6e tempest-HostsAdminTestJSON-56208176 tempest-HostsAdminTestJSON-56208176-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.044471 Sep 08 10:38:19.200883 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 223/435] 10.222.0.27 () {58 vars in 1155 bytes} [Thu Sep 8 10:38:19 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:38:19.207202 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-729c8eb1-9993-42b2-827f-f58246e7f33a tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:19.208376 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-729c8eb1-9993-42b2-827f-f58246e7f33a tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: ec8a85b1-636c-4699-8042-4dbefbc881f3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:19.215109 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-729c8eb1-9993-42b2-827f-f58246e7f33a tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:19.215733 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-729c8eb1-9993-42b2-827f-f58246e7f33a tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:19.216242 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-729c8eb1-9993-42b2-827f-f58246e7f33a tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:19.217083 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-729c8eb1-9993-42b2-827f-f58246e7f33a tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:19.217628 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-729c8eb1-9993-42b2-827f-f58246e7f33a tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:19.218669 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-729c8eb1-9993-42b2-827f-f58246e7f33a tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:19.313730 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-729c8eb1-9993-42b2-827f-f58246e7f33a tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:19.325940 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-729c8eb1-9993-42b2-827f-f58246e7f33a tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/ec8a85b1-636c-4699-8042-4dbefbc881f3" status: 200 len: 1268 microversion: 2.1 time: 0.123434 Sep 08 10:38:19.326901 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 224/436] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:19 2022] GET /compute/v2.1/servers/ec8a85b1-636c-4699-8042-4dbefbc881f3 => generated 1268 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:19.332806 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a6c68f99-8298-4394-97ab-a93bc64b03b2 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:19.333708 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a6c68f99-8298-4394-97ab-a93bc64b03b2 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] [instance: bc3d77c9-40f4-4f37-9717-9c11e724e637] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:19.340518 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a6c68f99-8298-4394-97ab-a93bc64b03b2 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:19.341471 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a6c68f99-8298-4394-97ab-a93bc64b03b2 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:19.342068 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a6c68f99-8298-4394-97ab-a93bc64b03b2 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:19.343726 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a6c68f99-8298-4394-97ab-a93bc64b03b2 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:19.344354 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a6c68f99-8298-4394-97ab-a93bc64b03b2 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:19.353825 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a6c68f99-8298-4394-97ab-a93bc64b03b2 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:19.488755 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a6c68f99-8298-4394-97ab-a93bc64b03b2 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9913da38392048c897ada11a1ac5e6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b3414c389540e7a35f03809b064d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:19.509045 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a6c68f99-8298-4394-97ab-a93bc64b03b2 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] 10.222.0.27 "GET /compute/v2.1/servers/bc3d77c9-40f4-4f37-9717-9c11e724e637" status: 200 len: 1283 microversion: 2.1 time: 0.173304 Sep 08 10:38:19.521049 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 225/437] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:19 2022] GET /compute/v2.1/servers/bc3d77c9-40f4-4f37-9717-9c11e724e637 => generated 1283 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:19.529360 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-42f74f4a-a5d5-4b81-9811-3cc44bcd4d3d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:19.532442 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-42f74f4a-a5d5-4b81-9811-3cc44bcd4d3d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 292d240e-1176-4875-8f87-9ca911437fbe] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:19.551105 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-42f74f4a-a5d5-4b81-9811-3cc44bcd4d3d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:19.554080 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-42f74f4a-a5d5-4b81-9811-3cc44bcd4d3d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:19.556431 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-42f74f4a-a5d5-4b81-9811-3cc44bcd4d3d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:19.564883 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-42f74f4a-a5d5-4b81-9811-3cc44bcd4d3d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:19.567284 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-42f74f4a-a5d5-4b81-9811-3cc44bcd4d3d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:19.568724 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-42f74f4a-a5d5-4b81-9811-3cc44bcd4d3d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:19.752488 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-01238d2a-44c8-4c73-a240-2bb8d70d8913 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:19.776911 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-01238d2a-44c8-4c73-a240-2bb8d70d8913 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/d32351b1-7fc7-4ce4-846d-16add998d5ab" status: 200 len: 1319 microversion: 2.1 time: 1.577112 Sep 08 10:38:19.783483 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 213/438] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:18 2022] GET /compute/v2.1/servers/d32351b1-7fc7-4ce4-846d-16add998d5ab => generated 1319 bytes in 1584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:38:19.802694 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bec51677-0774-4ac6-b4f6-94f459ed449a tempest-HostsAdminTestJSON-56208176 tempest-HostsAdminTestJSON-56208176-project-admin] Calling method '.version_select at 0x7f68e4ff9040>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:19.808460 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bec51677-0774-4ac6-b4f6-94f459ed449a tempest-HostsAdminTestJSON-56208176 tempest-HostsAdminTestJSON-56208176-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:19.809457 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bec51677-0774-4ac6-b4f6-94f459ed449a tempest-HostsAdminTestJSON-56208176 tempest-HostsAdminTestJSON-56208176-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:19.809977 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bec51677-0774-4ac6-b4f6-94f459ed449a tempest-HostsAdminTestJSON-56208176 tempest-HostsAdminTestJSON-56208176-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:19.811241 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bec51677-0774-4ac6-b4f6-94f459ed449a tempest-HostsAdminTestJSON-56208176 tempest-HostsAdminTestJSON-56208176-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:19.813061 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bec51677-0774-4ac6-b4f6-94f459ed449a tempest-HostsAdminTestJSON-56208176 tempest-HostsAdminTestJSON-56208176-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:19.814820 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bec51677-0774-4ac6-b4f6-94f459ed449a tempest-HostsAdminTestJSON-56208176 tempest-HostsAdminTestJSON-56208176-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:19.857605 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bec51677-0774-4ac6-b4f6-94f459ed449a tempest-HostsAdminTestJSON-56208176 tempest-HostsAdminTestJSON-56208176-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.072673 Sep 08 10:38:19.859947 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 214/439] 10.222.0.27 () {58 vars in 1128 bytes} [Thu Sep 8 10:38:19 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:38:19.874516 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f52c56e8-fe2c-4367-8d5c-d5e0dd56091f tempest-HostsAdminTestJSON-56208176 tempest-HostsAdminTestJSON-56208176-project-admin] Calling method '.version_select at 0x7f68e4ff9790>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:19.898941 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f52c56e8-fe2c-4367-8d5c-d5e0dd56091f tempest-HostsAdminTestJSON-56208176 tempest-HostsAdminTestJSON-56208176-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:19.902986 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f52c56e8-fe2c-4367-8d5c-d5e0dd56091f tempest-HostsAdminTestJSON-56208176 tempest-HostsAdminTestJSON-56208176-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:19.903900 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f52c56e8-fe2c-4367-8d5c-d5e0dd56091f tempest-HostsAdminTestJSON-56208176 tempest-HostsAdminTestJSON-56208176-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:19.942564 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-42f74f4a-a5d5-4b81-9811-3cc44bcd4d3d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:19.954994 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f52c56e8-fe2c-4367-8d5c-d5e0dd56091f tempest-HostsAdminTestJSON-56208176 tempest-HostsAdminTestJSON-56208176-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:19.956060 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f52c56e8-fe2c-4367-8d5c-d5e0dd56091f tempest-HostsAdminTestJSON-56208176 tempest-HostsAdminTestJSON-56208176-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:19.956695 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f52c56e8-fe2c-4367-8d5c-d5e0dd56091f tempest-HostsAdminTestJSON-56208176 tempest-HostsAdminTestJSON-56208176-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:19.960363 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:38:19.963469 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-42f74f4a-a5d5-4b81-9811-3cc44bcd4d3d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:19.969322 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-42f74f4a-a5d5-4b81-9811-3cc44bcd4d3d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:19.971554 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-42f74f4a-a5d5-4b81-9811-3cc44bcd4d3d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/292d240e-1176-4875-8f87-9ca911437fbe" status: 200 len: 1569 microversion: 2.25 time: 0.460106 Sep 08 10:38:19.975243 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 226/440] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:38:19 2022] GET /compute/v2.1/servers/292d240e-1176-4875-8f87-9ca911437fbe => generated 1569 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:38:20.007756 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f52c56e8-fe2c-4367-8d5c-d5e0dd56091f tempest-HostsAdminTestJSON-56208176 tempest-HostsAdminTestJSON-56208176-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts/n-h1-850501-12" status: 200 len: 867 microversion: 2.1 time: 0.137786 Sep 08 10:38:20.008879 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 215/441] 10.222.0.27 () {58 vars in 1173 bytes} [Thu Sep 8 10:38:19 2022] GET /compute/v2.1/os-hosts/n-h1-850501-12 => generated 867 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:38:20.019566 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-85eb95c4-e5a2-44e3-8db8-613aba166145 tempest-HostsAdminTestJSON-56208176 tempest-HostsAdminTestJSON-56208176-project-admin] Calling method '.version_select at 0x7f68e4d14430>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:20.032161 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-85eb95c4-e5a2-44e3-8db8-613aba166145 tempest-HostsAdminTestJSON-56208176 tempest-HostsAdminTestJSON-56208176-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:20.032982 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-85eb95c4-e5a2-44e3-8db8-613aba166145 tempest-HostsAdminTestJSON-56208176 tempest-HostsAdminTestJSON-56208176-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:20.034613 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-85eb95c4-e5a2-44e3-8db8-613aba166145 tempest-HostsAdminTestJSON-56208176 tempest-HostsAdminTestJSON-56208176-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:20.068653 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-85eb95c4-e5a2-44e3-8db8-613aba166145 tempest-HostsAdminTestJSON-56208176 tempest-HostsAdminTestJSON-56208176-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:20.074381 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-85eb95c4-e5a2-44e3-8db8-613aba166145 tempest-HostsAdminTestJSON-56208176 tempest-HostsAdminTestJSON-56208176-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:20.075692 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-85eb95c4-e5a2-44e3-8db8-613aba166145 tempest-HostsAdminTestJSON-56208176 tempest-HostsAdminTestJSON-56208176-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:20.124564 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-85eb95c4-e5a2-44e3-8db8-613aba166145 tempest-HostsAdminTestJSON-56208176 tempest-HostsAdminTestJSON-56208176-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts/n-h2-850501-12" status: 200 len: 471 microversion: 2.1 time: 0.108992 Sep 08 10:38:20.137073 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 227/442] 10.222.0.27 () {58 vars in 1173 bytes} [Thu Sep 8 10:38:20 2022] GET /compute/v2.1/os-hosts/n-h2-850501-12 => generated 471 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:38:20.179456 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-36ad9226-0acf-4dae-83ca-da31e80d088f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:20.180147 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-36ad9226-0acf-4dae-83ca-da31e80d088f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 815705bc-e49e-47a1-864b-9cc550464808] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:20.195700 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:38:20.202569 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36ad9226-0acf-4dae-83ca-da31e80d088f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:20.204082 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36ad9226-0acf-4dae-83ca-da31e80d088f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:20.208953 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36ad9226-0acf-4dae-83ca-da31e80d088f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:20.210172 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36ad9226-0acf-4dae-83ca-da31e80d088f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:20.213073 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36ad9226-0acf-4dae-83ca-da31e80d088f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:20.215801 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36ad9226-0acf-4dae-83ca-da31e80d088f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:20.354061 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-93529770-0b00-4870-927b-9ce3b16aa136 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:20.355337 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-93529770-0b00-4870-927b-9ce3b16aa136 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: ec8a85b1-636c-4699-8042-4dbefbc881f3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:20.377291 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-93529770-0b00-4870-927b-9ce3b16aa136 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:20.379330 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-93529770-0b00-4870-927b-9ce3b16aa136 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:20.387340 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-93529770-0b00-4870-927b-9ce3b16aa136 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:20.388361 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-93529770-0b00-4870-927b-9ce3b16aa136 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:20.389317 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-93529770-0b00-4870-927b-9ce3b16aa136 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:20.391062 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-93529770-0b00-4870-927b-9ce3b16aa136 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:20.766420 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-93529770-0b00-4870-927b-9ce3b16aa136 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:20.789597 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-93529770-0b00-4870-927b-9ce3b16aa136 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/ec8a85b1-636c-4699-8042-4dbefbc881f3" status: 200 len: 1268 microversion: 2.1 time: 0.439638 Sep 08 10:38:20.790946 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 228/443] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:20 2022] GET /compute/v2.1/servers/ec8a85b1-636c-4699-8042-4dbefbc881f3 => generated 1268 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:20.797002 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-dbcf903b-9282-47a4-a856-c98c1e9a90fa tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:20.798057 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-dbcf903b-9282-47a4-a856-c98c1e9a90fa tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] [instance: bc3d77c9-40f4-4f37-9717-9c11e724e637] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:20.804968 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dbcf903b-9282-47a4-a856-c98c1e9a90fa tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:20.805912 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dbcf903b-9282-47a4-a856-c98c1e9a90fa tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:20.806577 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dbcf903b-9282-47a4-a856-c98c1e9a90fa tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:20.807513 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dbcf903b-9282-47a4-a856-c98c1e9a90fa tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:20.808209 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dbcf903b-9282-47a4-a856-c98c1e9a90fa tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:20.808802 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dbcf903b-9282-47a4-a856-c98c1e9a90fa tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:21.048477 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-dbcf903b-9282-47a4-a856-c98c1e9a90fa tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9913da38392048c897ada11a1ac5e6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b3414c389540e7a35f03809b064d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:21.064486 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-dbcf903b-9282-47a4-a856-c98c1e9a90fa tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] 10.222.0.27 "GET /compute/v2.1/servers/bc3d77c9-40f4-4f37-9717-9c11e724e637" status: 200 len: 1281 microversion: 2.1 time: 0.267269 Sep 08 10:38:21.065750 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 229/444] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:20 2022] GET /compute/v2.1/servers/bc3d77c9-40f4-4f37-9717-9c11e724e637 => generated 1281 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:21.071849 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3edf63c8-299d-427d-96cb-da8a4b6c7b96 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:21.081577 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3edf63c8-299d-427d-96cb-da8a4b6c7b96 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: d32351b1-7fc7-4ce4-846d-16add998d5ab] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:21.088094 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3edf63c8-299d-427d-96cb-da8a4b6c7b96 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:21.088721 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3edf63c8-299d-427d-96cb-da8a4b6c7b96 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:21.089180 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3edf63c8-299d-427d-96cb-da8a4b6c7b96 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:21.091910 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3edf63c8-299d-427d-96cb-da8a4b6c7b96 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:21.092619 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3edf63c8-299d-427d-96cb-da8a4b6c7b96 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:21.093251 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3edf63c8-299d-427d-96cb-da8a4b6c7b96 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:21.228394 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-36ad9226-0acf-4dae-83ca-da31e80d088f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:21.241623 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-36ad9226-0acf-4dae-83ca-da31e80d088f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808" status: 200 len: 1313 microversion: 2.1 time: 1.065978 Sep 08 10:38:21.242726 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 216/445] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:20 2022] GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808 => generated 1313 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:21.255799 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2b3b443f-a890-4abe-ab9e-9f408e4469d8 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:21.256610 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2b3b443f-a890-4abe-ab9e-9f408e4469d8 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 292d240e-1176-4875-8f87-9ca911437fbe] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:21.265898 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b3b443f-a890-4abe-ab9e-9f408e4469d8 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:21.267180 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b3b443f-a890-4abe-ab9e-9f408e4469d8 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:21.267939 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b3b443f-a890-4abe-ab9e-9f408e4469d8 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:21.268915 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b3b443f-a890-4abe-ab9e-9f408e4469d8 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:21.269610 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b3b443f-a890-4abe-ab9e-9f408e4469d8 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:21.270798 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b3b443f-a890-4abe-ab9e-9f408e4469d8 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:21.895699 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2b3b443f-a890-4abe-ab9e-9f408e4469d8 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:21.908909 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2b3b443f-a890-4abe-ab9e-9f408e4469d8 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:21.910397 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2b3b443f-a890-4abe-ab9e-9f408e4469d8 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:21.911564 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2b3b443f-a890-4abe-ab9e-9f408e4469d8 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/292d240e-1176-4875-8f87-9ca911437fbe" status: 200 len: 1569 microversion: 2.25 time: 0.667547 Sep 08 10:38:21.924141 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 217/446] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:38:21 2022] GET /compute/v2.1/servers/292d240e-1176-4875-8f87-9ca911437fbe => generated 1569 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:38:21.932224 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-55c9bcba-06c7-4edd-a02e-ef8a776398c9 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:21.938293 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-55c9bcba-06c7-4edd-a02e-ef8a776398c9 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: ec8a85b1-636c-4699-8042-4dbefbc881f3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:21.946712 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55c9bcba-06c7-4edd-a02e-ef8a776398c9 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:21.947238 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55c9bcba-06c7-4edd-a02e-ef8a776398c9 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:21.949724 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55c9bcba-06c7-4edd-a02e-ef8a776398c9 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:21.950846 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55c9bcba-06c7-4edd-a02e-ef8a776398c9 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:21.951474 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55c9bcba-06c7-4edd-a02e-ef8a776398c9 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:21.952612 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55c9bcba-06c7-4edd-a02e-ef8a776398c9 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:22.225382 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-3edf63c8-299d-427d-96cb-da8a4b6c7b96 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:22.254120 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3edf63c8-299d-427d-96cb-da8a4b6c7b96 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/d32351b1-7fc7-4ce4-846d-16add998d5ab" status: 200 len: 1319 microversion: 2.1 time: 1.185070 Sep 08 10:38:22.255657 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 230/447] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:21 2022] GET /compute/v2.1/servers/d32351b1-7fc7-4ce4-846d-16add998d5ab => generated 1319 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:22.266342 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-673bbd75-530d-473a-84e4-c0367e1db639 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:22.267274 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-673bbd75-530d-473a-84e4-c0367e1db639 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] [instance: bc3d77c9-40f4-4f37-9717-9c11e724e637] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:22.277203 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-673bbd75-530d-473a-84e4-c0367e1db639 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:22.340735 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-673bbd75-530d-473a-84e4-c0367e1db639 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:22.348568 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-673bbd75-530d-473a-84e4-c0367e1db639 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.067s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:22.362698 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-673bbd75-530d-473a-84e4-c0367e1db639 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:22.366484 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-673bbd75-530d-473a-84e4-c0367e1db639 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:22.367192 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-673bbd75-530d-473a-84e4-c0367e1db639 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:22.413267 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-55c9bcba-06c7-4edd-a02e-ef8a776398c9 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:22.426720 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-55c9bcba-06c7-4edd-a02e-ef8a776398c9 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/ec8a85b1-636c-4699-8042-4dbefbc881f3" status: 200 len: 1310 microversion: 2.1 time: 0.500004 Sep 08 10:38:22.444426 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 218/448] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:21 2022] GET /compute/v2.1/servers/ec8a85b1-636c-4699-8042-4dbefbc881f3 => generated 1310 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:22.456444 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-291ab92c-dd40-4de6-b64e-c10aa0414147 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:22.460014 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-291ab92c-dd40-4de6-b64e-c10aa0414147 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 815705bc-e49e-47a1-864b-9cc550464808] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:22.479633 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-291ab92c-dd40-4de6-b64e-c10aa0414147 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:22.482505 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-291ab92c-dd40-4de6-b64e-c10aa0414147 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:22.483146 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-291ab92c-dd40-4de6-b64e-c10aa0414147 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:22.485897 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-291ab92c-dd40-4de6-b64e-c10aa0414147 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:22.486539 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-291ab92c-dd40-4de6-b64e-c10aa0414147 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:22.487120 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-291ab92c-dd40-4de6-b64e-c10aa0414147 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:22.557345 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-673bbd75-530d-473a-84e4-c0367e1db639 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9913da38392048c897ada11a1ac5e6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b3414c389540e7a35f03809b064d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:22.577596 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-673bbd75-530d-473a-84e4-c0367e1db639 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] 10.222.0.27 "GET /compute/v2.1/servers/bc3d77c9-40f4-4f37-9717-9c11e724e637" status: 200 len: 1281 microversion: 2.1 time: 0.319160 Sep 08 10:38:22.580263 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 231/449] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:22 2022] GET /compute/v2.1/servers/bc3d77c9-40f4-4f37-9717-9c11e724e637 => generated 1281 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:22.591117 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-5f6900b4-1992-4e37-8894-422335683bca req-8d62cdb7-10bd-47d1-8a51-9df0eaf11397 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b135e70e-1c5a-4432-9b50-237c118a5296", "tag": "8adcdce4-ec06-4542-bcf8-1fd85137feef"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:38:22.610715 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-5f6900b4-1992-4e37-8894-422335683bca req-8d62cdb7-10bd-47d1-8a51-9df0eaf11397 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:22.611502 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-5f6900b4-1992-4e37-8894-422335683bca req-8d62cdb7-10bd-47d1-8a51-9df0eaf11397 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:22.612564 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-5f6900b4-1992-4e37-8894-422335683bca req-8d62cdb7-10bd-47d1-8a51-9df0eaf11397 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:22.640917 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-5f6900b4-1992-4e37-8894-422335683bca req-8d62cdb7-10bd-47d1-8a51-9df0eaf11397 service nova] Creating event network-changed:8adcdce4-ec06-4542-bcf8-1fd85137feef for instance b135e70e-1c5a-4432-9b50-237c118a5296 on n-h2-850501-12 Sep 08 10:38:22.648812 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-5f6900b4-1992-4e37-8894-422335683bca req-8d62cdb7-10bd-47d1-8a51-9df0eaf11397 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062026 Sep 08 10:38:22.649782 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 232/450] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:38:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:38:22.951624 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ea6d5faa-e774-48cc-9f69-a66803648c4b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:22.953806 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ea6d5faa-e774-48cc-9f69-a66803648c4b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 292d240e-1176-4875-8f87-9ca911437fbe] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:22.960977 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ea6d5faa-e774-48cc-9f69-a66803648c4b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:22.961706 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ea6d5faa-e774-48cc-9f69-a66803648c4b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:22.962303 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ea6d5faa-e774-48cc-9f69-a66803648c4b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:22.963673 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ea6d5faa-e774-48cc-9f69-a66803648c4b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:22.964297 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ea6d5faa-e774-48cc-9f69-a66803648c4b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:22.964878 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ea6d5faa-e774-48cc-9f69-a66803648c4b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:23.092290 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-291ab92c-dd40-4de6-b64e-c10aa0414147 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:23.111239 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-291ab92c-dd40-4de6-b64e-c10aa0414147 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808" status: 200 len: 1313 microversion: 2.1 time: 0.661377 Sep 08 10:38:23.116691 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 219/451] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:22 2022] GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808 => generated 1313 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:23.288664 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fa9571d6-bff9-4e21-999c-aa8ed1bbad20 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:23.289693 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fa9571d6-bff9-4e21-999c-aa8ed1bbad20 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: d32351b1-7fc7-4ce4-846d-16add998d5ab] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:23.300617 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fa9571d6-bff9-4e21-999c-aa8ed1bbad20 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:23.308345 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fa9571d6-bff9-4e21-999c-aa8ed1bbad20 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:23.311037 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fa9571d6-bff9-4e21-999c-aa8ed1bbad20 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:23.315970 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fa9571d6-bff9-4e21-999c-aa8ed1bbad20 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:23.317342 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fa9571d6-bff9-4e21-999c-aa8ed1bbad20 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:23.321676 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fa9571d6-bff9-4e21-999c-aa8ed1bbad20 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:23.769485 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ea6d5faa-e774-48cc-9f69-a66803648c4b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:23.779192 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fa9571d6-bff9-4e21-999c-aa8ed1bbad20 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:23.813289 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fa9571d6-bff9-4e21-999c-aa8ed1bbad20 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/d32351b1-7fc7-4ce4-846d-16add998d5ab" status: 200 len: 1319 microversion: 2.1 time: 0.524801 Sep 08 10:38:23.813822 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ea6d5faa-e774-48cc-9f69-a66803648c4b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:23.818003 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ea6d5faa-e774-48cc-9f69-a66803648c4b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:23.820719 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ea6d5faa-e774-48cc-9f69-a66803648c4b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/292d240e-1176-4875-8f87-9ca911437fbe" status: 200 len: 1559 microversion: 2.25 time: 0.874516 Sep 08 10:38:23.822322 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 233/452] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:38:22 2022] GET /compute/v2.1/servers/292d240e-1176-4875-8f87-9ca911437fbe => generated 1559 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:38:23.830067 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 220/453] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:23 2022] GET /compute/v2.1/servers/d32351b1-7fc7-4ce4-846d-16add998d5ab => generated 1319 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:38:23.849436 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-81ba660f-cac7-4533-9624-084267155728 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:23.850878 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-81ba660f-cac7-4533-9624-084267155728 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] [instance: bc3d77c9-40f4-4f37-9717-9c11e724e637] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:23.860119 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c6c44c9a-f7cf-421a-b889-8d058c016b7d tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:23.861270 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c6c44c9a-f7cf-421a-b889-8d058c016b7d tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: ec8a85b1-636c-4699-8042-4dbefbc881f3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:23.871444 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81ba660f-cac7-4533-9624-084267155728 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:23.872002 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81ba660f-cac7-4533-9624-084267155728 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:23.872803 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81ba660f-cac7-4533-9624-084267155728 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:23.874919 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81ba660f-cac7-4533-9624-084267155728 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:23.876490 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81ba660f-cac7-4533-9624-084267155728 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:23.877513 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81ba660f-cac7-4533-9624-084267155728 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:23.879816 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c6c44c9a-f7cf-421a-b889-8d058c016b7d tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:23.883522 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c6c44c9a-f7cf-421a-b889-8d058c016b7d tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:23.885153 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c6c44c9a-f7cf-421a-b889-8d058c016b7d tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:23.888003 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c6c44c9a-f7cf-421a-b889-8d058c016b7d tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:23.888849 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c6c44c9a-f7cf-421a-b889-8d058c016b7d tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:23.890065 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c6c44c9a-f7cf-421a-b889-8d058c016b7d tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:24.021379 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-81ba660f-cac7-4533-9624-084267155728 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9913da38392048c897ada11a1ac5e6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b3414c389540e7a35f03809b064d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:24.031304 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-81ba660f-cac7-4533-9624-084267155728 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] 10.222.0.27 "GET /compute/v2.1/servers/bc3d77c9-40f4-4f37-9717-9c11e724e637" status: 200 len: 1281 microversion: 2.1 time: 0.199621 Sep 08 10:38:24.036248 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 221/454] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:23 2022] GET /compute/v2.1/servers/bc3d77c9-40f4-4f37-9717-9c11e724e637 => generated 1281 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:24.043283 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d6fc8cd9-9d9e-48c4-8b97-e38f0b9dff7a tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Calling method '.version_select at 0x7f68e4f50af0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:24.049046 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d6fc8cd9-9d9e-48c4-8b97-e38f0b9dff7a tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:24.049833 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d6fc8cd9-9d9e-48c4-8b97-e38f0b9dff7a tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:24.050533 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d6fc8cd9-9d9e-48c4-8b97-e38f0b9dff7a tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:24.111515 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d6fc8cd9-9d9e-48c4-8b97-e38f0b9dff7a tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 440 microversion: 2.25 time: 0.073499 Sep 08 10:38:24.118872 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 222/455] 10.222.0.27 () {60 vars in 1184 bytes} [Thu Sep 8 10:38:24 2022] GET /compute/v2.1/os-migrations => generated 440 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:38:24.139078 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-318db394-4426-4c72-84f9-7b30a091728e tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:24.142087 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-318db394-4426-4c72-84f9-7b30a091728e tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] [instance: 292d240e-1176-4875-8f87-9ca911437fbe] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:24.163206 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-318db394-4426-4c72-84f9-7b30a091728e tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:24.163701 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-318db394-4426-4c72-84f9-7b30a091728e tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:24.165903 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-318db394-4426-4c72-84f9-7b30a091728e tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:24.166864 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-318db394-4426-4c72-84f9-7b30a091728e tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:24.168476 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-318db394-4426-4c72-84f9-7b30a091728e tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:24.174667 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-318db394-4426-4c72-84f9-7b30a091728e tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:24.505482 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-318db394-4426-4c72-84f9-7b30a091728e tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lazy-loading 'services' on Instance uuid 292d240e-1176-4875-8f87-9ca911437fbe {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:38:24.579409 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-318db394-4426-4c72-84f9-7b30a091728e tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/292d240e-1176-4875-8f87-9ca911437fbe" status: 200 len: 2054 microversion: 2.25 time: 0.454926 Sep 08 10:38:24.583029 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 223/456] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:38:24 2022] GET /compute/v2.1/servers/292d240e-1176-4875-8f87-9ca911437fbe => generated 2054 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:38:24.588386 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-80f956b1-27d6-497c-9cbd-04d79fd31ddc tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:24.589312 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-80f956b1-27d6-497c-9cbd-04d79fd31ddc tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 815705bc-e49e-47a1-864b-9cc550464808] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:24.598264 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80f956b1-27d6-497c-9cbd-04d79fd31ddc tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:24.598986 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80f956b1-27d6-497c-9cbd-04d79fd31ddc tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:24.600025 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80f956b1-27d6-497c-9cbd-04d79fd31ddc tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:24.601413 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80f956b1-27d6-497c-9cbd-04d79fd31ddc tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:24.602052 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80f956b1-27d6-497c-9cbd-04d79fd31ddc tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:24.602654 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80f956b1-27d6-497c-9cbd-04d79fd31ddc tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:24.850101 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-80f956b1-27d6-497c-9cbd-04d79fd31ddc tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:24.859804 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-80f956b1-27d6-497c-9cbd-04d79fd31ddc tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808" status: 200 len: 1313 microversion: 2.1 time: 0.274234 Sep 08 10:38:24.860680 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 224/457] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:24 2022] GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808 => generated 1313 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:24.882275 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-7dad5544-9745-40e0-9540-87658d61b837 req-03757dfe-5887-4e42-80a8-0bb7b59291ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d32351b1-7fc7-4ce4-846d-16add998d5ab", "tag": "a60232cc-0216-484c-93ae-ebe3068438d7"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:38:24.892880 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c6c44c9a-f7cf-421a-b889-8d058c016b7d tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:24.898306 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-7dad5544-9745-40e0-9540-87658d61b837 req-03757dfe-5887-4e42-80a8-0bb7b59291ff service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:24.898800 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-7dad5544-9745-40e0-9540-87658d61b837 req-03757dfe-5887-4e42-80a8-0bb7b59291ff service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:24.899228 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-7dad5544-9745-40e0-9540-87658d61b837 req-03757dfe-5887-4e42-80a8-0bb7b59291ff service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:24.909672 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c6c44c9a-f7cf-421a-b889-8d058c016b7d tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/ec8a85b1-636c-4699-8042-4dbefbc881f3" status: 200 len: 1310 microversion: 2.1 time: 1.085488 Sep 08 10:38:24.911333 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 234/458] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:23 2022] GET /compute/v2.1/servers/ec8a85b1-636c-4699-8042-4dbefbc881f3 => generated 1310 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:24.912190 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-7dad5544-9745-40e0-9540-87658d61b837 req-03757dfe-5887-4e42-80a8-0bb7b59291ff service nova] Creating event network-changed:a60232cc-0216-484c-93ae-ebe3068438d7 for instance d32351b1-7fc7-4ce4-846d-16add998d5ab on n-h2-850501-12 Sep 08 10:38:24.918983 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bc224b3e-dd87-4359-874e-5f5a813542fe tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-12143379", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "cebc319d-cd30-49da-85de-4414687896b3"}]}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:38:24.928555 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-7dad5544-9745-40e0-9540-87658d61b837 req-03757dfe-5887-4e42-80a8-0bb7b59291ff service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053193 Sep 08 10:38:24.929892 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 225/459] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:38:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:38:24.936366 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-e5372a44-3bfb-422e-8493-859e21d2c3ff req-58a18c4a-cda6-48fe-bf34-bb0f47289789 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec8a85b1-636c-4699-8042-4dbefbc881f3", "tag": "820cda60-30f4-4974-ab85-eee32186c6c0"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:38:24.948594 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e5372a44-3bfb-422e-8493-859e21d2c3ff req-58a18c4a-cda6-48fe-bf34-bb0f47289789 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:24.949385 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e5372a44-3bfb-422e-8493-859e21d2c3ff req-58a18c4a-cda6-48fe-bf34-bb0f47289789 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:24.950007 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e5372a44-3bfb-422e-8493-859e21d2c3ff req-58a18c4a-cda6-48fe-bf34-bb0f47289789 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:24.964035 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-e5372a44-3bfb-422e-8493-859e21d2c3ff req-58a18c4a-cda6-48fe-bf34-bb0f47289789 service nova] Creating event network-changed:820cda60-30f4-4974-ab85-eee32186c6c0 for instance ec8a85b1-636c-4699-8042-4dbefbc881f3 on n-h1-850501-12 Sep 08 10:38:24.971948 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-e5372a44-3bfb-422e-8493-859e21d2c3ff req-58a18c4a-cda6-48fe-bf34-bb0f47289789 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040356 Sep 08 10:38:24.973228 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 226/460] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:38:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:38:24.978806 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0797672a-2c93-464f-80f7-7066e4fc7229 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:24.980154 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0797672a-2c93-464f-80f7-7066e4fc7229 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: d32351b1-7fc7-4ce4-846d-16add998d5ab] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:24.991067 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0797672a-2c93-464f-80f7-7066e4fc7229 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:24.991614 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0797672a-2c93-464f-80f7-7066e4fc7229 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:24.991983 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0797672a-2c93-464f-80f7-7066e4fc7229 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:24.992926 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0797672a-2c93-464f-80f7-7066e4fc7229 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:24.993337 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0797672a-2c93-464f-80f7-7066e4fc7229 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:24.993934 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0797672a-2c93-464f-80f7-7066e4fc7229 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:25.030742 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-bc224b3e-dd87-4359-874e-5f5a813542fe tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] validate_networks() for [('cebc319d-cd30-49da-85de-4414687896b3', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:38:25.279349 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0797672a-2c93-464f-80f7-7066e4fc7229 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:25.300589 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0797672a-2c93-464f-80f7-7066e4fc7229 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/d32351b1-7fc7-4ce4-846d-16add998d5ab" status: 200 len: 1319 microversion: 2.1 time: 0.324750 Sep 08 10:38:25.300967 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 227/461] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:24 2022] GET /compute/v2.1/servers/d32351b1-7fc7-4ce4-846d-16add998d5ab => generated 1319 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:25.311786 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0e2b7cc7-ac23-4446-94a0-9a03b4ace347 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:25.312495 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0e2b7cc7-ac23-4446-94a0-9a03b4ace347 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] [instance: bc3d77c9-40f4-4f37-9717-9c11e724e637] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:25.320580 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e2b7cc7-ac23-4446-94a0-9a03b4ace347 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:25.320580 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e2b7cc7-ac23-4446-94a0-9a03b4ace347 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:25.320580 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e2b7cc7-ac23-4446-94a0-9a03b4ace347 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:25.321200 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e2b7cc7-ac23-4446-94a0-9a03b4ace347 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:25.321546 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e2b7cc7-ac23-4446-94a0-9a03b4ace347 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:25.321929 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e2b7cc7-ac23-4446-94a0-9a03b4ace347 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:25.444617 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0e2b7cc7-ac23-4446-94a0-9a03b4ace347 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9913da38392048c897ada11a1ac5e6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b3414c389540e7a35f03809b064d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:25.458649 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0e2b7cc7-ac23-4446-94a0-9a03b4ace347 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] 10.222.0.27 "GET /compute/v2.1/servers/bc3d77c9-40f4-4f37-9717-9c11e724e637" status: 200 len: 1281 microversion: 2.1 time: 0.153292 Sep 08 10:38:25.459725 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 228/462] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:25 2022] GET /compute/v2.1/servers/bc3d77c9-40f4-4f37-9717-9c11e724e637 => generated 1281 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:25.672681 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-737afa51-1c56-4847-85a0-94029bbf79c7 req-9956018d-8a0a-4734-acf9-aceaaea31629 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "815705bc-e49e-47a1-864b-9cc550464808", "name": "network-vif-plugged", "status": "completed", "tag": "9c8702f3-cdfe-4a4b-9877-3df5412c0e8d"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:38:25.716040 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-737afa51-1c56-4847-85a0-94029bbf79c7 req-9956018d-8a0a-4734-acf9-aceaaea31629 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:25.722348 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-737afa51-1c56-4847-85a0-94029bbf79c7 req-9956018d-8a0a-4734-acf9-aceaaea31629 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:25.725535 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-737afa51-1c56-4847-85a0-94029bbf79c7 req-9956018d-8a0a-4734-acf9-aceaaea31629 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:25.770682 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-737afa51-1c56-4847-85a0-94029bbf79c7 req-9956018d-8a0a-4734-acf9-aceaaea31629 service nova] Creating event network-vif-plugged:9c8702f3-cdfe-4a4b-9877-3df5412c0e8d for instance 815705bc-e49e-47a1-864b-9cc550464808 on n-h1-850501-12 Sep 08 10:38:25.791627 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-737afa51-1c56-4847-85a0-94029bbf79c7 req-9956018d-8a0a-4734-acf9-aceaaea31629 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120106 Sep 08 10:38:25.793866 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 229/463] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:38:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:38:26.190836 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6ec1934d-fd0f-4d07-b9f4-42b878674cd0 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:26.201092 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6ec1934d-fd0f-4d07-b9f4-42b878674cd0 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.396003 Sep 08 10:38:26.202820 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 230/464] 10.222.0.27 () {58 vars in 1137 bytes} [Thu Sep 8 10:38:25 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:38:26.210319 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e25f2377-dcbb-4648-9a9a-19492859071f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:26.211432 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e25f2377-dcbb-4648-9a9a-19492859071f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 815705bc-e49e-47a1-864b-9cc550464808] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:26.231572 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e25f2377-dcbb-4648-9a9a-19492859071f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:26.232329 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e25f2377-dcbb-4648-9a9a-19492859071f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:26.232861 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e25f2377-dcbb-4648-9a9a-19492859071f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:26.234012 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e25f2377-dcbb-4648-9a9a-19492859071f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:26.234948 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e25f2377-dcbb-4648-9a9a-19492859071f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:26.235533 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e25f2377-dcbb-4648-9a9a-19492859071f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:26.724829 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e25f2377-dcbb-4648-9a9a-19492859071f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:26.753188 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e25f2377-dcbb-4648-9a9a-19492859071f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808" status: 200 len: 1313 microversion: 2.1 time: 0.546754 Sep 08 10:38:26.755391 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 231/465] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:26 2022] GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808 => generated 1313 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:26.766479 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-08d7a31e-41cd-40f2-b0af-4bddf149441e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:26.770986 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-08d7a31e-41cd-40f2-b0af-4bddf149441e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: ec8a85b1-636c-4699-8042-4dbefbc881f3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:26.794020 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08d7a31e-41cd-40f2-b0af-4bddf149441e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:26.798271 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08d7a31e-41cd-40f2-b0af-4bddf149441e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:26.799761 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08d7a31e-41cd-40f2-b0af-4bddf149441e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:26.800519 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08d7a31e-41cd-40f2-b0af-4bddf149441e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:26.800994 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08d7a31e-41cd-40f2-b0af-4bddf149441e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:26.804602 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08d7a31e-41cd-40f2-b0af-4bddf149441e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:27.033165 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=24 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:38:27.090463 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-08d7a31e-41cd-40f2-b0af-4bddf149441e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:27.104060 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-08d7a31e-41cd-40f2-b0af-4bddf149441e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/ec8a85b1-636c-4699-8042-4dbefbc881f3" status: 200 len: 1310 microversion: 2.1 time: 0.344494 Sep 08 10:38:27.121725 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 232/466] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:26 2022] GET /compute/v2.1/servers/ec8a85b1-636c-4699-8042-4dbefbc881f3 => generated 1310 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:27.230743 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8395e2c6-d2b0-44a7-819a-95d33d1cb4c2 tempest-ServersWithSpecificFlavorTestJSON-1768133948 tempest-ServersWithSpecificFlavorTestJSON-1768133948-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-277180704", "id": 528789528, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:38:27.266428 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8395e2c6-d2b0-44a7-819a-95d33d1cb4c2 tempest-ServersWithSpecificFlavorTestJSON-1768133948 tempest-ServersWithSpecificFlavorTestJSON-1768133948-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 421 microversion: 2.1 time: 0.141732 Sep 08 10:38:27.269414 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 233/467] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:38:27 2022] POST /compute/v2.1/flavors => generated 421 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:38:27.280227 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9cd0f738-c32f-468b-af5f-c240b08d3a50 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:27.286795 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9cd0f738-c32f-468b-af5f-c240b08d3a50 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: d32351b1-7fc7-4ce4-846d-16add998d5ab] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:27.308144 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9cd0f738-c32f-468b-af5f-c240b08d3a50 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:27.310501 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9cd0f738-c32f-468b-af5f-c240b08d3a50 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:27.315546 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9cd0f738-c32f-468b-af5f-c240b08d3a50 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:27.322401 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9cd0f738-c32f-468b-af5f-c240b08d3a50 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:27.323147 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9cd0f738-c32f-468b-af5f-c240b08d3a50 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:27.326582 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9cd0f738-c32f-468b-af5f-c240b08d3a50 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:27.834984 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9cd0f738-c32f-468b-af5f-c240b08d3a50 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:27.845576 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9cd0f738-c32f-468b-af5f-c240b08d3a50 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/d32351b1-7fc7-4ce4-846d-16add998d5ab" status: 200 len: 1319 microversion: 2.1 time: 0.574859 Sep 08 10:38:27.854753 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 234/468] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:27 2022] GET /compute/v2.1/servers/d32351b1-7fc7-4ce4-846d-16add998d5ab => generated 1319 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:27.860170 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0a97aad3-7dfd-427e-9c5d-b1d49813577b tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:27.875231 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0a97aad3-7dfd-427e-9c5d-b1d49813577b tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] [instance: bc3d77c9-40f4-4f37-9717-9c11e724e637] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:27.954560 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0a97aad3-7dfd-427e-9c5d-b1d49813577b tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:27.955149 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0a97aad3-7dfd-427e-9c5d-b1d49813577b tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:27.955649 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0a97aad3-7dfd-427e-9c5d-b1d49813577b tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:27.956468 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0a97aad3-7dfd-427e-9c5d-b1d49813577b tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:27.956990 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0a97aad3-7dfd-427e-9c5d-b1d49813577b tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:27.961734 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0a97aad3-7dfd-427e-9c5d-b1d49813577b tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:27.996974 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=32 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:38:28.025145 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-bc224b3e-dd87-4359-874e-5f5a813542fe tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:38:28.026096 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-bc224b3e-dd87-4359-874e-5f5a813542fe tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:38:28.026931 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-bc224b3e-dd87-4359-874e-5f5a813542fe tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:38:28.027499 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-bc224b3e-dd87-4359-874e-5f5a813542fe tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:38:28.028083 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-bc224b3e-dd87-4359-874e-5f5a813542fe tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:38:28.059707 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bc224b3e-dd87-4359-874e-5f5a813542fe tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:28.066055 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bc224b3e-dd87-4359-874e-5f5a813542fe tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:28.067036 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bc224b3e-dd87-4359-874e-5f5a813542fe tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:28.068203 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bc224b3e-dd87-4359-874e-5f5a813542fe tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:28.069000 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bc224b3e-dd87-4359-874e-5f5a813542fe tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:28.069722 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bc224b3e-dd87-4359-874e-5f5a813542fe tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:28.130078 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-bc224b3e-dd87-4359-874e-5f5a813542fe tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Getting quotas for project 57d64134da60477da24b7fde4e1b9680. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:38:28.144431 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-bc224b3e-dd87-4359-874e-5f5a813542fe tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Getting quotas for user 27456dd9f49540b09f2e8addd1045a94 and project 57d64134da60477da24b7fde4e1b9680. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:38:28.180967 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bc224b3e-dd87-4359-874e-5f5a813542fe tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:38:28.183424 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bc224b3e-dd87-4359-874e-5f5a813542fe tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 422ceb5f-740f-45e5-9596-6796719adf27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:38:28.307939 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bc224b3e-dd87-4359-874e-5f5a813542fe tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 3.394370 Sep 08 10:38:28.316505 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 235/469] 10.222.0.27 () {62 vars in 1188 bytes} [Thu Sep 8 10:38:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 3404 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 08 10:38:28.323040 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-92b3d85d-bc1f-4d5a-b18f-031d6a0f9202 tempest-ServersWithSpecificFlavorTestJSON-1768133948 tempest-ServersWithSpecificFlavorTestJSON-1768133948-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:28.332726 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-92b3d85d-bc1f-4d5a-b18f-031d6a0f9202 tempest-ServersWithSpecificFlavorTestJSON-1768133948 tempest-ServersWithSpecificFlavorTestJSON-1768133948-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.014655 Sep 08 10:38:28.334116 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 236/470] 10.222.0.27 () {58 vars in 1182 bytes} [Thu Sep 8 10:38:28 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:38:28.356746 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9a996362-2067-4d22-8ba8-af806b961d4f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:28.357779 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9a996362-2067-4d22-8ba8-af806b961d4f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 815705bc-e49e-47a1-864b-9cc550464808] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:28.370584 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9a996362-2067-4d22-8ba8-af806b961d4f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:28.371398 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9a996362-2067-4d22-8ba8-af806b961d4f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:28.372134 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9a996362-2067-4d22-8ba8-af806b961d4f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:28.373115 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9a996362-2067-4d22-8ba8-af806b961d4f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:28.374006 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9a996362-2067-4d22-8ba8-af806b961d4f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:28.374697 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9a996362-2067-4d22-8ba8-af806b961d4f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:28.461109 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0a97aad3-7dfd-427e-9c5d-b1d49813577b tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9913da38392048c897ada11a1ac5e6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b3414c389540e7a35f03809b064d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:28.479008 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0a97aad3-7dfd-427e-9c5d-b1d49813577b tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] 10.222.0.27 "GET /compute/v2.1/servers/bc3d77c9-40f4-4f37-9717-9c11e724e637" status: 200 len: 1323 microversion: 2.1 time: 0.616099 Sep 08 10:38:28.481925 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 235/471] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:27 2022] GET /compute/v2.1/servers/bc3d77c9-40f4-4f37-9717-9c11e724e637 => generated 1323 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:28.489319 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9d8beb81-746f-43c9-85ce-5f40030253ce tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:28.490328 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9d8beb81-746f-43c9-85ce-5f40030253ce tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: ec8a85b1-636c-4699-8042-4dbefbc881f3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:28.537170 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d8beb81-746f-43c9-85ce-5f40030253ce tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:28.543671 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d8beb81-746f-43c9-85ce-5f40030253ce tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:28.543999 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d8beb81-746f-43c9-85ce-5f40030253ce tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:28.552305 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d8beb81-746f-43c9-85ce-5f40030253ce tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:28.553772 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d8beb81-746f-43c9-85ce-5f40030253ce tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:28.554374 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d8beb81-746f-43c9-85ce-5f40030253ce tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:28.597872 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:38:29.269077 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9d8beb81-746f-43c9-85ce-5f40030253ce tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:29.278590 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9d8beb81-746f-43c9-85ce-5f40030253ce tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/ec8a85b1-636c-4699-8042-4dbefbc881f3" status: 200 len: 1310 microversion: 2.1 time: 0.793377 Sep 08 10:38:29.298065 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 236/472] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:28 2022] GET /compute/v2.1/servers/ec8a85b1-636c-4699-8042-4dbefbc881f3 => generated 1310 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:29.303011 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-89b4e615-62f6-4d47-969c-7796ccfbdb3b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:29.303622 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-89b4e615-62f6-4d47-969c-7796ccfbdb3b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 422ceb5f-740f-45e5-9596-6796719adf27] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:29.311642 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89b4e615-62f6-4d47-969c-7796ccfbdb3b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:29.312133 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89b4e615-62f6-4d47-969c-7796ccfbdb3b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:29.312806 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89b4e615-62f6-4d47-969c-7796ccfbdb3b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:29.313728 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89b4e615-62f6-4d47-969c-7796ccfbdb3b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:29.314533 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89b4e615-62f6-4d47-969c-7796ccfbdb3b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:29.316030 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89b4e615-62f6-4d47-969c-7796ccfbdb3b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:29.400949 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9a996362-2067-4d22-8ba8-af806b961d4f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:29.432876 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9a996362-2067-4d22-8ba8-af806b961d4f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808" status: 200 len: 1313 microversion: 2.1 time: 1.097324 Sep 08 10:38:29.436652 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 237/473] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:28 2022] GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808 => generated 1313 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:29.453384 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6bcd1972-1300-4ff3-be43-e8dc30969a61 tempest-ServersWithSpecificFlavorTestJSON-1768133948 tempest-ServersWithSpecificFlavorTestJSON-1768133948-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1032850168", "id": 1000307758, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:38:29.464528 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-89b4e615-62f6-4d47-969c-7796ccfbdb3b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:29.469640 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:38:29.482722 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-89b4e615-62f6-4d47-969c-7796ccfbdb3b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:29.490739 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-89b4e615-62f6-4d47-969c-7796ccfbdb3b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:29.493640 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-89b4e615-62f6-4d47-969c-7796ccfbdb3b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/422ceb5f-740f-45e5-9596-6796719adf27" status: 200 len: 1256 microversion: 2.25 time: 0.193111 Sep 08 10:38:29.496463 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 237/474] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:38:29 2022] GET /compute/v2.1/servers/422ceb5f-740f-45e5-9596-6796719adf27 => generated 1256 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:38:29.509680 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6bcd1972-1300-4ff3-be43-e8dc30969a61 tempest-ServersWithSpecificFlavorTestJSON-1768133948 tempest-ServersWithSpecificFlavorTestJSON-1768133948-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.069385 Sep 08 10:38:29.513061 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d7625729-e286-4512-8c8d-47181423b27f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:29.514345 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d7625729-e286-4512-8c8d-47181423b27f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: d32351b1-7fc7-4ce4-846d-16add998d5ab] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:29.521120 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 238/475] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:38:29 2022] POST /compute/v2.1/flavors => generated 425 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:38:29.538255 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-aa2e7418-6cc1-495e-b301-a7f2b6192613 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:29.539683 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d7625729-e286-4512-8c8d-47181423b27f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:29.539884 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-aa2e7418-6cc1-495e-b301-a7f2b6192613 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] [instance: bc3d77c9-40f4-4f37-9717-9c11e724e637] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:29.540245 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d7625729-e286-4512-8c8d-47181423b27f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:29.543139 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d7625729-e286-4512-8c8d-47181423b27f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:29.546389 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d7625729-e286-4512-8c8d-47181423b27f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:29.548533 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d7625729-e286-4512-8c8d-47181423b27f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:29.549416 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d7625729-e286-4512-8c8d-47181423b27f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:29.563490 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aa2e7418-6cc1-495e-b301-a7f2b6192613 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:29.564270 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aa2e7418-6cc1-495e-b301-a7f2b6192613 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:29.565698 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aa2e7418-6cc1-495e-b301-a7f2b6192613 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:29.569544 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aa2e7418-6cc1-495e-b301-a7f2b6192613 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:29.581683 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aa2e7418-6cc1-495e-b301-a7f2b6192613 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:29.582251 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aa2e7418-6cc1-495e-b301-a7f2b6192613 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:29.824596 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=12 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:38:29.862445 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d7625729-e286-4512-8c8d-47181423b27f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:29.874412 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d7625729-e286-4512-8c8d-47181423b27f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/d32351b1-7fc7-4ce4-846d-16add998d5ab" status: 200 len: 1319 microversion: 2.1 time: 0.372996 Sep 08 10:38:29.875568 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 238/476] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:29 2022] GET /compute/v2.1/servers/d32351b1-7fc7-4ce4-846d-16add998d5ab => generated 1319 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:29.881803 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-57b2376d-5de0-4a20-9cf9-80a8ee9014cb tempest-ServersWithSpecificFlavorTestJSON-1768133948 tempest-ServersWithSpecificFlavorTestJSON-1768133948-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:29.903281 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-57b2376d-5de0-4a20-9cf9-80a8ee9014cb tempest-ServersWithSpecificFlavorTestJSON-1768133948 tempest-ServersWithSpecificFlavorTestJSON-1768133948-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.025640 Sep 08 10:38:29.904541 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 239/477] 10.222.0.27 () {58 vars in 1182 bytes} [Thu Sep 8 10:38:29 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:38:29.937647 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-98ddc3cb-7e51-447e-b5c3-0f8289f7e665 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Action: 'create', calling method: .version_select at 0x7f68e4e5c790>, body: {"keypair": {"name": "tempest-keypair-1011037597", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEkyTxGEReC2ZfAXNTII6S/7LZJnW/MAdf1qSi5YpJg2cXl8HwurLmKe82NTwf0ZCBrh/fSZa/+MyFsrMyqiLdjx1tGnrR/lFKON6bS8LqrSEW+zhqmhJbcwzX3K8dRkmw=="}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:38:29.961379 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-98ddc3cb-7e51-447e-b5c3-0f8289f7e665 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Getting quotas for project de5388c25cdb4a35ae8d58fa5b6cf125. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:38:29.966638 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-98ddc3cb-7e51-447e-b5c3-0f8289f7e665 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Getting quotas for user 6e4cde361139445eb147c4f634ec663f and project de5388c25cdb4a35ae8d58fa5b6cf125. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:38:30.002119 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-98ddc3cb-7e51-447e-b5c3-0f8289f7e665 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.070990 Sep 08 10:38:30.002829 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 240/478] 10.222.0.27 () {60 vars in 1159 bytes} [Thu Sep 8 10:38:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:38:30.239456 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-eb1bd8f2-0dcb-43a1-a458-fb84d29c7812 tempest-HypervisorAdminV228Test-836145851 tempest-HypervisorAdminV228Test-836145851-project-admin] Calling method '.version_select at 0x7f68e4fa80d0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:30.241576 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb1bd8f2-0dcb-43a1-a458-fb84d29c7812 tempest-HypervisorAdminV228Test-836145851 tempest-HypervisorAdminV228Test-836145851-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:30.242235 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb1bd8f2-0dcb-43a1-a458-fb84d29c7812 tempest-HypervisorAdminV228Test-836145851 tempest-HypervisorAdminV228Test-836145851-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:30.243019 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb1bd8f2-0dcb-43a1-a458-fb84d29c7812 tempest-HypervisorAdminV228Test-836145851 tempest-HypervisorAdminV228Test-836145851-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:30.255457 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-aa2e7418-6cc1-495e-b301-a7f2b6192613 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9913da38392048c897ada11a1ac5e6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b3414c389540e7a35f03809b064d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:30.267245 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb1bd8f2-0dcb-43a1-a458-fb84d29c7812 tempest-HypervisorAdminV228Test-836145851 tempest-HypervisorAdminV228Test-836145851-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:30.267995 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb1bd8f2-0dcb-43a1-a458-fb84d29c7812 tempest-HypervisorAdminV228Test-836145851 tempest-HypervisorAdminV228Test-836145851-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:30.268645 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb1bd8f2-0dcb-43a1-a458-fb84d29c7812 tempest-HypervisorAdminV228Test-836145851 tempest-HypervisorAdminV228Test-836145851-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:30.274053 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-aa2e7418-6cc1-495e-b301-a7f2b6192613 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] 10.222.0.27 "GET /compute/v2.1/servers/bc3d77c9-40f4-4f37-9717-9c11e724e637" status: 200 len: 1323 microversion: 2.1 time: 0.755907 Sep 08 10:38:30.278764 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 239/479] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:29 2022] GET /compute/v2.1/servers/bc3d77c9-40f4-4f37-9717-9c11e724e637 => generated 1323 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:30.288986 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb1bd8f2-0dcb-43a1-a458-fb84d29c7812 tempest-HypervisorAdminV228Test-836145851 tempest-HypervisorAdminV228Test-836145851-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:30.289709 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb1bd8f2-0dcb-43a1-a458-fb84d29c7812 tempest-HypervisorAdminV228Test-836145851 tempest-HypervisorAdminV228Test-836145851-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:30.290412 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb1bd8f2-0dcb-43a1-a458-fb84d29c7812 tempest-HypervisorAdminV228Test-836145851 tempest-HypervisorAdminV228Test-836145851-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:30.306578 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-eb1bd8f2-0dcb-43a1-a458-fb84d29c7812 tempest-HypervisorAdminV228Test-836145851 tempest-HypervisorAdminV228Test-836145851-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.28 time: 0.301178 Sep 08 10:38:30.312348 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 241/480] 10.222.0.27 () {60 vars in 1187 bytes} [Thu Sep 8 10:38:30 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:38:30.316039 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-136075bb-30de-4f05-9e6f-60c7ce61153f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:30.320487 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-136075bb-30de-4f05-9e6f-60c7ce61153f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: ec8a85b1-636c-4699-8042-4dbefbc881f3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:30.327519 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-136075bb-30de-4f05-9e6f-60c7ce61153f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:30.328094 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-136075bb-30de-4f05-9e6f-60c7ce61153f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:30.328792 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-136075bb-30de-4f05-9e6f-60c7ce61153f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:30.330209 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ac99b01e-98a5-4643-9bc9-6c3982fa2b18 tempest-HypervisorAdminV228Test-836145851 tempest-HypervisorAdminV228Test-836145851-project-admin] Calling method '.version_select at 0x7f68e4ff9280>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:30.330470 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-136075bb-30de-4f05-9e6f-60c7ce61153f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:30.330948 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-136075bb-30de-4f05-9e6f-60c7ce61153f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:30.331379 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-136075bb-30de-4f05-9e6f-60c7ce61153f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:30.336301 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ac99b01e-98a5-4643-9bc9-6c3982fa2b18 tempest-HypervisorAdminV228Test-836145851 tempest-HypervisorAdminV228Test-836145851-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:30.338153 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ac99b01e-98a5-4643-9bc9-6c3982fa2b18 tempest-HypervisorAdminV228Test-836145851 tempest-HypervisorAdminV228Test-836145851-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:30.338870 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ac99b01e-98a5-4643-9bc9-6c3982fa2b18 tempest-HypervisorAdminV228Test-836145851 tempest-HypervisorAdminV228Test-836145851-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:30.340291 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=100 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:38:30.360013 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ac99b01e-98a5-4643-9bc9-6c3982fa2b18 tempest-HypervisorAdminV228Test-836145851 tempest-HypervisorAdminV228Test-836145851-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:30.360916 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ac99b01e-98a5-4643-9bc9-6c3982fa2b18 tempest-HypervisorAdminV228Test-836145851 tempest-HypervisorAdminV228Test-836145851-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:30.361664 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ac99b01e-98a5-4643-9bc9-6c3982fa2b18 tempest-HypervisorAdminV228Test-836145851 tempest-HypervisorAdminV228Test-836145851-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:30.369801 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ac99b01e-98a5-4643-9bc9-6c3982fa2b18 tempest-HypervisorAdminV228Test-836145851 tempest-HypervisorAdminV228Test-836145851-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 720 microversion: 2.28 time: 0.050393 Sep 08 10:38:30.381952 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 242/481] 10.222.0.27 () {60 vars in 1193 bytes} [Thu Sep 8 10:38:30 2022] GET /compute/v2.1/os-hypervisors/1 => generated 720 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:38:30.462724 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-eb03d4d3-fef6-4bc2-bf3d-6e04e5ba0c91 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:30.468092 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-eb03d4d3-fef6-4bc2-bf3d-6e04e5ba0c91 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 815705bc-e49e-47a1-864b-9cc550464808] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:30.478711 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb03d4d3-fef6-4bc2-bf3d-6e04e5ba0c91 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:30.481194 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb03d4d3-fef6-4bc2-bf3d-6e04e5ba0c91 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:30.481948 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb03d4d3-fef6-4bc2-bf3d-6e04e5ba0c91 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:30.483845 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb03d4d3-fef6-4bc2-bf3d-6e04e5ba0c91 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:30.485143 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb03d4d3-fef6-4bc2-bf3d-6e04e5ba0c91 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:30.485965 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb03d4d3-fef6-4bc2-bf3d-6e04e5ba0c91 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:30.953905 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-eb03d4d3-fef6-4bc2-bf3d-6e04e5ba0c91 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:30.966636 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-eb03d4d3-fef6-4bc2-bf3d-6e04e5ba0c91 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808" status: 200 len: 1463 microversion: 2.1 time: 0.509202 Sep 08 10:38:30.968377 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 243/482] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:30 2022] GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808 => generated 1463 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:30.980175 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8ed74123-347a-4e5c-8992-94886a3185ab tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:30.981312 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8ed74123-347a-4e5c-8992-94886a3185ab tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 422ceb5f-740f-45e5-9596-6796719adf27] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:30.994508 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ed74123-347a-4e5c-8992-94886a3185ab tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:30.997719 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ed74123-347a-4e5c-8992-94886a3185ab tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:30.999092 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ed74123-347a-4e5c-8992-94886a3185ab tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:31.001487 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ed74123-347a-4e5c-8992-94886a3185ab tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:31.002514 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ed74123-347a-4e5c-8992-94886a3185ab tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:31.008936 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ed74123-347a-4e5c-8992-94886a3185ab tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:31.117436 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-136075bb-30de-4f05-9e6f-60c7ce61153f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:31.136637 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-136075bb-30de-4f05-9e6f-60c7ce61153f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/ec8a85b1-636c-4699-8042-4dbefbc881f3" status: 200 len: 1310 microversion: 2.1 time: 0.826920 Sep 08 10:38:31.137261 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 240/483] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:30 2022] GET /compute/v2.1/servers/ec8a85b1-636c-4699-8042-4dbefbc881f3 => generated 1310 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:31.152104 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-661992e9-4f8c-4c1d-8233-21ebe537ea2a req-eed1164d-014d-4ea9-b92b-0d1d18c79bf0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc3d77c9-40f4-4f37-9717-9c11e724e637", "tag": "ae00f6df-3009-4a3a-93bb-25a2344e9fe0"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:38:31.154383 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8ed74123-347a-4e5c-8992-94886a3185ab tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:31.168644 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8ed74123-347a-4e5c-8992-94886a3185ab tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:31.172821 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8ed74123-347a-4e5c-8992-94886a3185ab tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:31.175686 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8ed74123-347a-4e5c-8992-94886a3185ab tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/422ceb5f-740f-45e5-9596-6796719adf27" status: 200 len: 1318 microversion: 2.25 time: 0.204175 Sep 08 10:38:31.177226 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 244/484] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:38:30 2022] GET /compute/v2.1/servers/422ceb5f-740f-45e5-9596-6796719adf27 => generated 1318 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:38:31.188081 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9ef61a67-76a4-4836-9c9d-bfd01d372f95 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:31.191997 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-661992e9-4f8c-4c1d-8233-21ebe537ea2a req-eed1164d-014d-4ea9-b92b-0d1d18c79bf0 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:31.192498 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-661992e9-4f8c-4c1d-8233-21ebe537ea2a req-eed1164d-014d-4ea9-b92b-0d1d18c79bf0 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:31.192932 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-661992e9-4f8c-4c1d-8233-21ebe537ea2a req-eed1164d-014d-4ea9-b92b-0d1d18c79bf0 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:31.193378 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9ef61a67-76a4-4836-9c9d-bfd01d372f95 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: d32351b1-7fc7-4ce4-846d-16add998d5ab] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:31.209760 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9ef61a67-76a4-4836-9c9d-bfd01d372f95 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:31.210491 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9ef61a67-76a4-4836-9c9d-bfd01d372f95 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:31.211487 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9ef61a67-76a4-4836-9c9d-bfd01d372f95 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:31.214944 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9ef61a67-76a4-4836-9c9d-bfd01d372f95 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:31.215854 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9ef61a67-76a4-4836-9c9d-bfd01d372f95 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:31.216446 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9ef61a67-76a4-4836-9c9d-bfd01d372f95 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:31.219166 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-661992e9-4f8c-4c1d-8233-21ebe537ea2a req-eed1164d-014d-4ea9-b92b-0d1d18c79bf0 service nova] Creating event network-changed:ae00f6df-3009-4a3a-93bb-25a2344e9fe0 for instance bc3d77c9-40f4-4f37-9717-9c11e724e637 on n-h1-850501-12 Sep 08 10:38:31.225562 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-661992e9-4f8c-4c1d-8233-21ebe537ea2a req-eed1164d-014d-4ea9-b92b-0d1d18c79bf0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086702 Sep 08 10:38:31.226480 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 241/485] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:38:31.627488 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cf7c2ca9-3f04-45d2-b405-6d8b06ca6548 tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:31.628258 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cf7c2ca9-3f04-45d2-b405-6d8b06ca6548 tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] [instance: 815705bc-e49e-47a1-864b-9cc550464808] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:31.642763 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cf7c2ca9-3f04-45d2-b405-6d8b06ca6548 tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:31.643265 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cf7c2ca9-3f04-45d2-b405-6d8b06ca6548 tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:31.643705 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cf7c2ca9-3f04-45d2-b405-6d8b06ca6548 tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:31.644430 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cf7c2ca9-3f04-45d2-b405-6d8b06ca6548 tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:31.644890 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cf7c2ca9-3f04-45d2-b405-6d8b06ca6548 tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:31.645492 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cf7c2ca9-3f04-45d2-b405-6d8b06ca6548 tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:31.844619 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9ef61a67-76a4-4836-9c9d-bfd01d372f95 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:31.856254 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9ef61a67-76a4-4836-9c9d-bfd01d372f95 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/d32351b1-7fc7-4ce4-846d-16add998d5ab" status: 200 len: 1319 microversion: 2.1 time: 0.677080 Sep 08 10:38:31.857778 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 245/486] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:31 2022] GET /compute/v2.1/servers/d32351b1-7fc7-4ce4-846d-16add998d5ab => generated 1319 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:31.875337 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5e26b613-369f-4759-b713-4fc0243535ce tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:31.876451 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5e26b613-369f-4759-b713-4fc0243535ce tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] [instance: bc3d77c9-40f4-4f37-9717-9c11e724e637] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:31.899246 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5e26b613-369f-4759-b713-4fc0243535ce tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:31.902255 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5e26b613-369f-4759-b713-4fc0243535ce tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:31.903222 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5e26b613-369f-4759-b713-4fc0243535ce tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:31.904152 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5e26b613-369f-4759-b713-4fc0243535ce tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:31.904488 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5e26b613-369f-4759-b713-4fc0243535ce tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:31.904914 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5e26b613-369f-4759-b713-4fc0243535ce tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:32.257943 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5e26b613-369f-4759-b713-4fc0243535ce tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9913da38392048c897ada11a1ac5e6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b3414c389540e7a35f03809b064d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:32.275544 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5e26b613-369f-4759-b713-4fc0243535ce tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] 10.222.0.27 "GET /compute/v2.1/servers/bc3d77c9-40f4-4f37-9717-9c11e724e637" status: 200 len: 1323 microversion: 2.1 time: 0.415255 Sep 08 10:38:32.277735 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 246/487] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:31 2022] GET /compute/v2.1/servers/bc3d77c9-40f4-4f37-9717-9c11e724e637 => generated 1323 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:32.285617 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-1e14bec4-1792-4583-b6f0-aa58514286aa req-91f18766-52f4-4f3d-93a9-70880b9ee34a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d32351b1-7fc7-4ce4-846d-16add998d5ab", "name": "network-vif-plugged", "status": "completed", "tag": "a60232cc-0216-484c-93ae-ebe3068438d7"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:38:32.404995 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-1e14bec4-1792-4583-b6f0-aa58514286aa req-91f18766-52f4-4f3d-93a9-70880b9ee34a service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:32.406743 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-1e14bec4-1792-4583-b6f0-aa58514286aa req-91f18766-52f4-4f3d-93a9-70880b9ee34a service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:32.408394 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-1e14bec4-1792-4583-b6f0-aa58514286aa req-91f18766-52f4-4f3d-93a9-70880b9ee34a service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:32.439355 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-1e14bec4-1792-4583-b6f0-aa58514286aa req-91f18766-52f4-4f3d-93a9-70880b9ee34a service nova] Creating event network-vif-plugged:a60232cc-0216-484c-93ae-ebe3068438d7 for instance d32351b1-7fc7-4ce4-846d-16add998d5ab on n-h2-850501-12 Sep 08 10:38:32.454587 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-1e14bec4-1792-4583-b6f0-aa58514286aa req-91f18766-52f4-4f3d-93a9-70880b9ee34a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171926 Sep 08 10:38:32.455314 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 247/488] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:38:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:38:32.465385 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a36b6e59-ed6d-4f7b-a3d9-05da4b97fe39 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:32.466154 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a36b6e59-ed6d-4f7b-a3d9-05da4b97fe39 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: ec8a85b1-636c-4699-8042-4dbefbc881f3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:32.492546 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a36b6e59-ed6d-4f7b-a3d9-05da4b97fe39 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:32.493232 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a36b6e59-ed6d-4f7b-a3d9-05da4b97fe39 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:32.493821 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a36b6e59-ed6d-4f7b-a3d9-05da4b97fe39 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:32.495320 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a36b6e59-ed6d-4f7b-a3d9-05da4b97fe39 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:32.496625 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a36b6e59-ed6d-4f7b-a3d9-05da4b97fe39 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:32.496625 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a36b6e59-ed6d-4f7b-a3d9-05da4b97fe39 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:32.752568 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a36b6e59-ed6d-4f7b-a3d9-05da4b97fe39 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:32.766024 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a36b6e59-ed6d-4f7b-a3d9-05da4b97fe39 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/ec8a85b1-636c-4699-8042-4dbefbc881f3" status: 200 len: 1310 microversion: 2.1 time: 0.307901 Sep 08 10:38:32.778154 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 248/489] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:32 2022] GET /compute/v2.1/servers/ec8a85b1-636c-4699-8042-4dbefbc881f3 => generated 1310 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:32.786131 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8d0675a9-43ec-404a-bbf2-2fb46fbd14cb tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:32.787049 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8d0675a9-43ec-404a-bbf2-2fb46fbd14cb tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 422ceb5f-740f-45e5-9596-6796719adf27] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:32.795769 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d0675a9-43ec-404a-bbf2-2fb46fbd14cb tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:32.796941 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d0675a9-43ec-404a-bbf2-2fb46fbd14cb tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:32.797643 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d0675a9-43ec-404a-bbf2-2fb46fbd14cb tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:32.798862 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d0675a9-43ec-404a-bbf2-2fb46fbd14cb tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:32.799524 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d0675a9-43ec-404a-bbf2-2fb46fbd14cb tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:32.800177 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d0675a9-43ec-404a-bbf2-2fb46fbd14cb tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:33.015450 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8d0675a9-43ec-404a-bbf2-2fb46fbd14cb tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:33.028953 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8d0675a9-43ec-404a-bbf2-2fb46fbd14cb tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:33.034127 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8d0675a9-43ec-404a-bbf2-2fb46fbd14cb tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:33.036441 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8d0675a9-43ec-404a-bbf2-2fb46fbd14cb tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/422ceb5f-740f-45e5-9596-6796719adf27" status: 200 len: 1360 microversion: 2.25 time: 0.256332 Sep 08 10:38:33.037846 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 249/490] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:38:32 2022] GET /compute/v2.1/servers/422ceb5f-740f-45e5-9596-6796719adf27 => generated 1360 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:38:33.043567 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f0d2950f-63f7-489d-a38a-4d5ec965150b tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:33.044996 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f0d2950f-63f7-489d-a38a-4d5ec965150b tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: d32351b1-7fc7-4ce4-846d-16add998d5ab] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:33.056550 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0d2950f-63f7-489d-a38a-4d5ec965150b tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:33.057401 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0d2950f-63f7-489d-a38a-4d5ec965150b tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:33.058057 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0d2950f-63f7-489d-a38a-4d5ec965150b tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:33.059079 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0d2950f-63f7-489d-a38a-4d5ec965150b tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:33.059985 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0d2950f-63f7-489d-a38a-4d5ec965150b tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:33.062539 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0d2950f-63f7-489d-a38a-4d5ec965150b tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:33.313294 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cf7c2ca9-3f04-45d2-b405-6d8b06ca6548 tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808" status: 200 len: 1616 microversion: 2.1 time: 2.085152 Sep 08 10:38:33.314284 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 242/491] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:31 2022] GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808 => generated 1616 bytes in 2087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:33.317864 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f0d2950f-63f7-489d-a38a-4d5ec965150b tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:33.328815 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-40c11a44-fcd0-44ef-a259-b20493755d55 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:33.331538 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-40c11a44-fcd0-44ef-a259-b20493755d55 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] [instance: bc3d77c9-40f4-4f37-9717-9c11e724e637] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:33.331744 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f0d2950f-63f7-489d-a38a-4d5ec965150b tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/d32351b1-7fc7-4ce4-846d-16add998d5ab" status: 200 len: 1319 microversion: 2.1 time: 0.292541 Sep 08 10:38:33.332559 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 250/492] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:33 2022] GET /compute/v2.1/servers/d32351b1-7fc7-4ce4-846d-16add998d5ab => generated 1319 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:33.344948 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-40c11a44-fcd0-44ef-a259-b20493755d55 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:33.345245 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-47ba90cb-36db-4c72-991d-a1341ed22163 tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:38:33.345782 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-47ba90cb-36db-4c72-991d-a1341ed22163 tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] [instance: 815705bc-e49e-47a1-864b-9cc550464808] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:33.347000 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-40c11a44-fcd0-44ef-a259-b20493755d55 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:33.348181 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-40c11a44-fcd0-44ef-a259-b20493755d55 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:33.349774 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-40c11a44-fcd0-44ef-a259-b20493755d55 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:33.350949 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-40c11a44-fcd0-44ef-a259-b20493755d55 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:33.352042 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-40c11a44-fcd0-44ef-a259-b20493755d55 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:33.366130 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-47ba90cb-36db-4c72-991d-a1341ed22163 tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:33.366635 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-47ba90cb-36db-4c72-991d-a1341ed22163 tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:33.367349 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-47ba90cb-36db-4c72-991d-a1341ed22163 tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:33.368286 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-47ba90cb-36db-4c72-991d-a1341ed22163 tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:33.368901 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-47ba90cb-36db-4c72-991d-a1341ed22163 tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:33.372630 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-47ba90cb-36db-4c72-991d-a1341ed22163 tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:33.527677 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-47ba90cb-36db-4c72-991d-a1341ed22163 tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '637a55ca4c684640a58a6afb579a864f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549722de06cc45c1aaec10bf5ba656aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:33.528339 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-47ba90cb-36db-4c72-991d-a1341ed22163 tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] [instance: 815705bc-e49e-47a1-864b-9cc550464808] flavor_id is None. Assuming migration. {{(pid=128862) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 08 10:38:33.530419 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-47ba90cb-36db-4c72-991d-a1341ed22163 tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] [instance: 815705bc-e49e-47a1-864b-9cc550464808] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128862) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 08 10:38:33.760639 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-47ba90cb-36db-4c72-991d-a1341ed22163 tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808/action" status: 202 len: 0 microversion: 2.1 time: 0.426750 Sep 08 10:38:33.764608 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 251/493] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:38:33 2022] POST /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808/action => generated 0 bytes in 428 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:38:33.771439 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8e2e6c95-d243-4e94-acae-760448b2f40e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:33.772804 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8e2e6c95-d243-4e94-acae-760448b2f40e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 815705bc-e49e-47a1-864b-9cc550464808] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:33.780940 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e2e6c95-d243-4e94-acae-760448b2f40e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:33.781351 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e2e6c95-d243-4e94-acae-760448b2f40e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:33.781764 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e2e6c95-d243-4e94-acae-760448b2f40e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:33.782477 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e2e6c95-d243-4e94-acae-760448b2f40e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:33.782984 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e2e6c95-d243-4e94-acae-760448b2f40e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:33.783412 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e2e6c95-d243-4e94-acae-760448b2f40e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:34.062368 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-40c11a44-fcd0-44ef-a259-b20493755d55 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9913da38392048c897ada11a1ac5e6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b3414c389540e7a35f03809b064d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:34.092375 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-40c11a44-fcd0-44ef-a259-b20493755d55 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] 10.222.0.27 "GET /compute/v2.1/servers/bc3d77c9-40f4-4f37-9717-9c11e724e637" status: 200 len: 1323 microversion: 2.1 time: 0.775135 Sep 08 10:38:34.096626 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 243/494] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:33 2022] GET /compute/v2.1/servers/bc3d77c9-40f4-4f37-9717-9c11e724e637 => generated 1323 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:34.109306 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3da2a572-120a-4a4f-9781-ad5d1e86ebf5 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:34.118878 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3da2a572-120a-4a4f-9781-ad5d1e86ebf5 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: ec8a85b1-636c-4699-8042-4dbefbc881f3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:34.138538 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3da2a572-120a-4a4f-9781-ad5d1e86ebf5 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:34.141262 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3da2a572-120a-4a4f-9781-ad5d1e86ebf5 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:34.142928 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3da2a572-120a-4a4f-9781-ad5d1e86ebf5 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:34.144957 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3da2a572-120a-4a4f-9781-ad5d1e86ebf5 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:34.145688 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3da2a572-120a-4a4f-9781-ad5d1e86ebf5 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:34.149157 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3da2a572-120a-4a4f-9781-ad5d1e86ebf5 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:34.155510 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8e2e6c95-d243-4e94-acae-760448b2f40e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:34.175166 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8e2e6c95-d243-4e94-acae-760448b2f40e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808" status: 200 len: 1472 microversion: 2.1 time: 0.401532 Sep 08 10:38:34.175839 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 252/495] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:33 2022] GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808 => generated 1472 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:34.245860 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-128caa43-26ff-4f8e-808e-f9d0a350460a tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:34.268778 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-128caa43-26ff-4f8e-808e-f9d0a350460a tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 422ceb5f-740f-45e5-9596-6796719adf27] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:34.294195 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-128caa43-26ff-4f8e-808e-f9d0a350460a tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:34.294942 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-128caa43-26ff-4f8e-808e-f9d0a350460a tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:34.295609 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-128caa43-26ff-4f8e-808e-f9d0a350460a tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:34.303104 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-128caa43-26ff-4f8e-808e-f9d0a350460a tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:34.303715 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-128caa43-26ff-4f8e-808e-f9d0a350460a tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:34.304265 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-128caa43-26ff-4f8e-808e-f9d0a350460a tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:34.690307 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-128caa43-26ff-4f8e-808e-f9d0a350460a tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:34.705272 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-128caa43-26ff-4f8e-808e-f9d0a350460a tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:34.708971 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-128caa43-26ff-4f8e-808e-f9d0a350460a tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:34.713502 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-128caa43-26ff-4f8e-808e-f9d0a350460a tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/422ceb5f-740f-45e5-9596-6796719adf27" status: 200 len: 1360 microversion: 2.25 time: 0.512127 Sep 08 10:38:34.716426 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 253/496] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:38:34 2022] GET /compute/v2.1/servers/422ceb5f-740f-45e5-9596-6796719adf27 => generated 1360 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:38:34.726471 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fa6967e3-6034-40cf-9cfe-29041d1f983d tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:34.728718 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fa6967e3-6034-40cf-9cfe-29041d1f983d tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: d32351b1-7fc7-4ce4-846d-16add998d5ab] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:34.744358 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fa6967e3-6034-40cf-9cfe-29041d1f983d tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:34.746591 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fa6967e3-6034-40cf-9cfe-29041d1f983d tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:34.748378 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fa6967e3-6034-40cf-9cfe-29041d1f983d tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:34.750876 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fa6967e3-6034-40cf-9cfe-29041d1f983d tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:34.751485 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fa6967e3-6034-40cf-9cfe-29041d1f983d tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:34.753483 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fa6967e3-6034-40cf-9cfe-29041d1f983d tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:34.794589 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:38:35.147704 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-3da2a572-120a-4a4f-9781-ad5d1e86ebf5 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:35.162640 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3da2a572-120a-4a4f-9781-ad5d1e86ebf5 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/ec8a85b1-636c-4699-8042-4dbefbc881f3" status: 200 len: 1310 microversion: 2.1 time: 1.064326 Sep 08 10:38:35.177401 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 244/497] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:34 2022] GET /compute/v2.1/servers/ec8a85b1-636c-4699-8042-4dbefbc881f3 => generated 1310 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:35.185218 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-32dc3f1c-f2de-496c-9933-01efef0a164a req-49379286-672b-4d6f-a809-33387331b0c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec8a85b1-636c-4699-8042-4dbefbc881f3", "name": "network-vif-plugged", "status": "completed", "tag": "820cda60-30f4-4974-ab85-eee32186c6c0"}, {"server_uuid": "b135e70e-1c5a-4432-9b50-237c118a5296", "name": "network-vif-plugged", "status": "completed", "tag": "8adcdce4-ec06-4542-bcf8-1fd85137feef"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:38:35.207750 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-32dc3f1c-f2de-496c-9933-01efef0a164a req-49379286-672b-4d6f-a809-33387331b0c8 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:35.208028 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-32dc3f1c-f2de-496c-9933-01efef0a164a req-49379286-672b-4d6f-a809-33387331b0c8 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:35.211806 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-32dc3f1c-f2de-496c-9933-01efef0a164a req-49379286-672b-4d6f-a809-33387331b0c8 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:35.246139 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-32dc3f1c-f2de-496c-9933-01efef0a164a req-49379286-672b-4d6f-a809-33387331b0c8 service nova] Creating event network-vif-plugged:820cda60-30f4-4974-ab85-eee32186c6c0 for instance ec8a85b1-636c-4699-8042-4dbefbc881f3 on n-h1-850501-12 Sep 08 10:38:35.247066 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-32dc3f1c-f2de-496c-9933-01efef0a164a req-49379286-672b-4d6f-a809-33387331b0c8 service nova] Creating event network-vif-plugged:8adcdce4-ec06-4542-bcf8-1fd85137feef for instance b135e70e-1c5a-4432-9b50-237c118a5296 on n-h2-850501-12 Sep 08 10:38:35.265288 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-32dc3f1c-f2de-496c-9933-01efef0a164a req-49379286-672b-4d6f-a809-33387331b0c8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.085250 Sep 08 10:38:35.267733 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 245/498] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:38:35 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:38:35.302379 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4c62dbfb-dbab-4650-bd4d-9a732037e6dc tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:35.304927 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4c62dbfb-dbab-4650-bd4d-9a732037e6dc tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] [instance: bc3d77c9-40f4-4f37-9717-9c11e724e637] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:35.306154 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fa6967e3-6034-40cf-9cfe-29041d1f983d tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:35.319137 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fa6967e3-6034-40cf-9cfe-29041d1f983d tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/d32351b1-7fc7-4ce4-846d-16add998d5ab" status: 200 len: 1469 microversion: 2.1 time: 0.600590 Sep 08 10:38:35.319732 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 254/499] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:34 2022] GET /compute/v2.1/servers/d32351b1-7fc7-4ce4-846d-16add998d5ab => generated 1469 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:35.324333 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4c62dbfb-dbab-4650-bd4d-9a732037e6dc tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:35.325193 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4c62dbfb-dbab-4650-bd4d-9a732037e6dc tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:35.325763 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4c62dbfb-dbab-4650-bd4d-9a732037e6dc tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:35.327684 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4c62dbfb-dbab-4650-bd4d-9a732037e6dc tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:35.328812 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4c62dbfb-dbab-4650-bd4d-9a732037e6dc tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:35.329389 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4c62dbfb-dbab-4650-bd4d-9a732037e6dc tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:35.341291 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-deaee344-725d-4ee8-ba96-586867a17ea6 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:35.342495 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-deaee344-725d-4ee8-ba96-586867a17ea6 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 815705bc-e49e-47a1-864b-9cc550464808] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:35.382824 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-deaee344-725d-4ee8-ba96-586867a17ea6 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:35.383325 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-deaee344-725d-4ee8-ba96-586867a17ea6 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:35.383755 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-deaee344-725d-4ee8-ba96-586867a17ea6 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:35.384463 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-deaee344-725d-4ee8-ba96-586867a17ea6 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:35.384918 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-deaee344-725d-4ee8-ba96-586867a17ea6 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:35.385372 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-deaee344-725d-4ee8-ba96-586867a17ea6 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:36.167163 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-deaee344-725d-4ee8-ba96-586867a17ea6 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:36.177797 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-deaee344-725d-4ee8-ba96-586867a17ea6 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808" status: 200 len: 1472 microversion: 2.1 time: 0.855675 Sep 08 10:38:36.178653 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 255/500] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:35 2022] GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808 => generated 1472 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:36.193388 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-e14ce225-ee91-491f-9596-215a64c254e4 req-bbbcfa24-27b9-42ef-aef8-1dbea1916828 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "422ceb5f-740f-45e5-9596-6796719adf27", "tag": "9dcf1823-c8b6-4d30-88b4-559bc9d90002"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:38:36.226323 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e14ce225-ee91-491f-9596-215a64c254e4 req-bbbcfa24-27b9-42ef-aef8-1dbea1916828 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:36.226999 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e14ce225-ee91-491f-9596-215a64c254e4 req-bbbcfa24-27b9-42ef-aef8-1dbea1916828 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:36.227485 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e14ce225-ee91-491f-9596-215a64c254e4 req-bbbcfa24-27b9-42ef-aef8-1dbea1916828 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:36.247739 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-e14ce225-ee91-491f-9596-215a64c254e4 req-bbbcfa24-27b9-42ef-aef8-1dbea1916828 service nova] Creating event network-changed:9dcf1823-c8b6-4d30-88b4-559bc9d90002 for instance 422ceb5f-740f-45e5-9596-6796719adf27 on n-h1-850501-12 Sep 08 10:38:36.262045 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-e14ce225-ee91-491f-9596-215a64c254e4 req-bbbcfa24-27b9-42ef-aef8-1dbea1916828 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079094 Sep 08 10:38:36.264702 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 256/501] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:38:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:38:36.273382 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f168fdc6-e190-47d3-8e63-6a522a357d30 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:36.275161 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f168fdc6-e190-47d3-8e63-6a522a357d30 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: b135e70e-1c5a-4432-9b50-237c118a5296] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:36.284785 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f168fdc6-e190-47d3-8e63-6a522a357d30 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:36.285577 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f168fdc6-e190-47d3-8e63-6a522a357d30 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:36.286231 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f168fdc6-e190-47d3-8e63-6a522a357d30 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:36.287113 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f168fdc6-e190-47d3-8e63-6a522a357d30 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:36.287729 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f168fdc6-e190-47d3-8e63-6a522a357d30 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:36.288519 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f168fdc6-e190-47d3-8e63-6a522a357d30 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:36.537695 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4c62dbfb-dbab-4650-bd4d-9a732037e6dc tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9913da38392048c897ada11a1ac5e6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b3414c389540e7a35f03809b064d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:36.546514 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4c62dbfb-dbab-4650-bd4d-9a732037e6dc tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] 10.222.0.27 "GET /compute/v2.1/servers/bc3d77c9-40f4-4f37-9717-9c11e724e637" status: 200 len: 1323 microversion: 2.1 time: 1.272411 Sep 08 10:38:36.547111 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 246/502] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:35 2022] GET /compute/v2.1/servers/bc3d77c9-40f4-4f37-9717-9c11e724e637 => generated 1323 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:36.564405 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4336ec53-8950-459c-8986-9f7eade7923b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:36.565063 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4336ec53-8950-459c-8986-9f7eade7923b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 422ceb5f-740f-45e5-9596-6796719adf27] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:36.576769 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4336ec53-8950-459c-8986-9f7eade7923b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:36.577312 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4336ec53-8950-459c-8986-9f7eade7923b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:36.577766 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4336ec53-8950-459c-8986-9f7eade7923b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:36.578639 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4336ec53-8950-459c-8986-9f7eade7923b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:36.579241 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4336ec53-8950-459c-8986-9f7eade7923b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:36.579687 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4336ec53-8950-459c-8986-9f7eade7923b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:36.771842 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f168fdc6-e190-47d3-8e63-6a522a357d30 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:36.788105 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f168fdc6-e190-47d3-8e63-6a522a357d30 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/b135e70e-1c5a-4432-9b50-237c118a5296" status: 200 len: 1319 microversion: 2.1 time: 0.521525 Sep 08 10:38:36.805074 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 257/503] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:36 2022] GET /compute/v2.1/servers/b135e70e-1c5a-4432-9b50-237c118a5296 => generated 1319 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:36.818010 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-97be7a7e-2d27-4976-bf91-b3ca9dedd6ff tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:36.820329 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-97be7a7e-2d27-4976-bf91-b3ca9dedd6ff tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: ec8a85b1-636c-4699-8042-4dbefbc881f3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:36.834752 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-97be7a7e-2d27-4976-bf91-b3ca9dedd6ff tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:36.836403 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-97be7a7e-2d27-4976-bf91-b3ca9dedd6ff tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:36.838511 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-97be7a7e-2d27-4976-bf91-b3ca9dedd6ff tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:36.840446 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-97be7a7e-2d27-4976-bf91-b3ca9dedd6ff tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:36.841299 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-97be7a7e-2d27-4976-bf91-b3ca9dedd6ff tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:36.842745 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-97be7a7e-2d27-4976-bf91-b3ca9dedd6ff tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:37.019626 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4336ec53-8950-459c-8986-9f7eade7923b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:37.033461 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4336ec53-8950-459c-8986-9f7eade7923b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:37.040784 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4336ec53-8950-459c-8986-9f7eade7923b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:37.042441 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4336ec53-8950-459c-8986-9f7eade7923b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/422ceb5f-740f-45e5-9596-6796719adf27" status: 200 len: 1360 microversion: 2.25 time: 0.494058 Sep 08 10:38:37.043423 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 247/504] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:38:36 2022] GET /compute/v2.1/servers/422ceb5f-740f-45e5-9596-6796719adf27 => generated 1360 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:38:37.075466 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-63727dd8-4d93-4619-a97e-e3f292750822 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-80090785", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "1000307758", "adminPass": "***", "networks": [{"uuid": "88216a69-baf8-4ec5-b0a7-24191ec4e581"}], "security_groups": [{"name": "tempest-securitygroup--818077460"}], "key_name": "tempest-keypair-1011037597", "user_data": "}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:38:37.383247 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-63727dd8-4d93-4619-a97e-e3f292750822 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] validate_networks() for [('88216a69-baf8-4ec5-b0a7-24191ec4e581', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:38:37.417755 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-97be7a7e-2d27-4976-bf91-b3ca9dedd6ff tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:37.431827 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-97be7a7e-2d27-4976-bf91-b3ca9dedd6ff tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/ec8a85b1-636c-4699-8042-4dbefbc881f3" status: 200 len: 1310 microversion: 2.1 time: 0.629141 Sep 08 10:38:37.433289 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 258/505] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:36 2022] GET /compute/v2.1/servers/ec8a85b1-636c-4699-8042-4dbefbc881f3 => generated 1310 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:37.473937 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1c780bbf-b780-43f7-a905-ce04094c508c tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:37.474883 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1c780bbf-b780-43f7-a905-ce04094c508c tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 815705bc-e49e-47a1-864b-9cc550464808] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:37.478226 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:38:37.488618 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c780bbf-b780-43f7-a905-ce04094c508c tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:37.489540 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c780bbf-b780-43f7-a905-ce04094c508c tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:37.490386 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c780bbf-b780-43f7-a905-ce04094c508c tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:37.491729 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c780bbf-b780-43f7-a905-ce04094c508c tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:37.492464 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c780bbf-b780-43f7-a905-ce04094c508c tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:37.493415 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c780bbf-b780-43f7-a905-ce04094c508c tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:37.851785 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1c780bbf-b780-43f7-a905-ce04094c508c tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:37.870118 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1c780bbf-b780-43f7-a905-ce04094c508c tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808" status: 200 len: 1472 microversion: 2.1 time: 0.421511 Sep 08 10:38:37.873983 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 259/506] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:37 2022] GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808 => generated 1472 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:38.093712 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=12 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:38:38.167414 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=6 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:38:38.221233 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f05602ad-0cc6-42ed-b979-d691b8c7bae5 tempest-HypervisorAdminNegativeTestJSON-424354540 tempest-HypervisorAdminNegativeTestJSON-424354540-project] Calling method '.version_select at 0x7f68e4e4e040>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:38.225089 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f05602ad-0cc6-42ed-b979-d691b8c7bae5 tempest-HypervisorAdminNegativeTestJSON-424354540 tempest-HypervisorAdminNegativeTestJSON-424354540-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'cd9356dc7b734ce2a0c072a07f46b7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d753c438f04776b9bd5b3011bc4638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:38.229072 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f05602ad-0cc6-42ed-b979-d691b8c7bae5 tempest-HypervisorAdminNegativeTestJSON-424354540 tempest-HypervisorAdminNegativeTestJSON-424354540-project] Request method failure captured: Sep 08 10:38:38.229072 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Sep 08 10:38:38.229072 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:38:38.229072 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:38:38.229072 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:38:38.229072 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:38:38.229072 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:38:38.229072 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:38:38.229072 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:38:38.229072 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:38:38.229072 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcYrXj84WVvhHP-nqpecy-saLhTLra-_zJ0VFCey5Z9LaDbcdTFsLR3L40qCOQZ-A7XmuiCJuwYASJzek5_j8YAzUFEFsnGhLK73kLmeXHqWJOUP6lAbEU86CQk828WIuu84ptQgfQ_d9kJuP3rk9wCj0iaMmfVRKpLCmghmjbyFEzI Sep 08 10:38:38.229072 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:38:38.229072 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:38:38.229072 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:38:38.229072 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:38:38.229072 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:38:38.229072 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:38:38.229072 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: d6d753c438f04776b9bd5b3011bc4638 Sep 08 10:38:38.229072 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-424354540 Sep 08 10:38:38.229072 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:38:38.229072 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:38:38.231625 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d6d753c438f04776b9bd5b3011bc4638"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d6d753c438f04776b9bd5b3011bc4638"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d6d753c438f04776b9bd5b3011bc4638"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d6d753c438f04776b9bd5b3011bc4638"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:38:38.231625 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-424354540 Sep 08 10:38:38.231625 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: d6d753c438f04776b9bd5b3011bc4638 Sep 08 10:38:38.231625 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-424354540 Sep 08 10:38:38.231625 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-HypervisorAdminNegativeTestJSON-424354540-project Sep 08 10:38:38.231625 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:38:38.231625 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:38:38.231625 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: cd9356dc7b734ce2a0c072a07f46b7d8 Sep 08 10:38:38.231625 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-424354540-project Sep 08 10:38:38.231625 n-d-850501-12 devstack@n-api.service[128862]: method: Sep 08 10:38:38.231625 n-d-850501-12 devstack@n-api.service[128862]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Sep 08 10:38:38.231625 n-d-850501-12 devstack@n-api.service[128862]: action_args: {} Sep 08 10:38:38.231625 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:38:38.233284 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:38:38.233284 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:38:38.233284 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:38:38.233284 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:38:38.233284 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:38:38.233284 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:38:38.233284 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:38:38.233284 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:38:38.233284 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:38:38.233284 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Sep 08 10:38:38.233284 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._detail(req) Sep 08 10:38:38.233284 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Sep 08 10:38:38.233284 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Sep 08 10:38:38.233284 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 10:38:38.233284 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 10:38:38.233284 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 10:38:38.233284 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 10:38:38.233284 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:38:38.233284 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:38:38.237683 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:38:38.237683 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:38:38.237683 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 10:38:38.237683 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 10:38:38.237683 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 10:38:38.237683 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 10:38:38.237683 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 10:38:38.237683 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 10:38:38.237683 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Sep 08 10:38:38.237683 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:38:38.237683 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:38:38.237683 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:38:38.237683 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:38:38.237683 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:38:38.237683 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:38:38.237683 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 10:38:38.237683 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 10:38:38.237683 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Sep 08 10:38:38.237683 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:38:38.245227 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f05602ad-0cc6-42ed-b979-d691b8c7bae5 tempest-HypervisorAdminNegativeTestJSON-424354540 tempest-HypervisorAdminNegativeTestJSON-424354540-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:38:38.245227 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f05602ad-0cc6-42ed-b979-d691b8c7bae5 tempest-HypervisorAdminNegativeTestJSON-424354540 tempest-HypervisorAdminNegativeTestJSON-424354540-project] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.366474 Sep 08 10:38:38.245227 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 260/507] 10.222.0.27 () {58 vars in 1167 bytes} [Thu Sep 8 10:38:37 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 368 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:38:38.255898 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c5ac7492-c476-4e1c-909b-a4b1b913e799 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:38.257057 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c5ac7492-c476-4e1c-909b-a4b1b913e799 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] [instance: bc3d77c9-40f4-4f37-9717-9c11e724e637] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:38.267318 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5ac7492-c476-4e1c-909b-a4b1b913e799 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:38.267942 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5ac7492-c476-4e1c-909b-a4b1b913e799 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:38.269333 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5ac7492-c476-4e1c-909b-a4b1b913e799 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:38.270176 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5ac7492-c476-4e1c-909b-a4b1b913e799 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:38.271460 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5ac7492-c476-4e1c-909b-a4b1b913e799 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:38.271977 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5ac7492-c476-4e1c-909b-a4b1b913e799 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:38.426760 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c5ac7492-c476-4e1c-909b-a4b1b913e799 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9913da38392048c897ada11a1ac5e6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b3414c389540e7a35f03809b064d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:38.434739 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c5ac7492-c476-4e1c-909b-a4b1b913e799 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] 10.222.0.27 "GET /compute/v2.1/servers/bc3d77c9-40f4-4f37-9717-9c11e724e637" status: 200 len: 1323 microversion: 2.1 time: 0.190900 Sep 08 10:38:38.435901 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 261/508] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:38 2022] GET /compute/v2.1/servers/bc3d77c9-40f4-4f37-9717-9c11e724e637 => generated 1323 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:38.444699 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a40021bb-0d17-4ccc-a452-75cabd9dce4d tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:38.446482 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a40021bb-0d17-4ccc-a452-75cabd9dce4d tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: b135e70e-1c5a-4432-9b50-237c118a5296] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:38.467540 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a40021bb-0d17-4ccc-a452-75cabd9dce4d tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:38.468555 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a40021bb-0d17-4ccc-a452-75cabd9dce4d tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:38.469287 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a40021bb-0d17-4ccc-a452-75cabd9dce4d tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:38.470316 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a40021bb-0d17-4ccc-a452-75cabd9dce4d tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:38.470875 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a40021bb-0d17-4ccc-a452-75cabd9dce4d tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:38.471390 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a40021bb-0d17-4ccc-a452-75cabd9dce4d tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:38.548413 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-63727dd8-4d93-4619-a97e-e3f292750822 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:38:38.549064 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-63727dd8-4d93-4619-a97e-e3f292750822 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:38:38.549740 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-63727dd8-4d93-4619-a97e-e3f292750822 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:38:38.550180 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-63727dd8-4d93-4619-a97e-e3f292750822 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:38:38.550601 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-63727dd8-4d93-4619-a97e-e3f292750822 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:38:38.562986 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-63727dd8-4d93-4619-a97e-e3f292750822 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:38.563826 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-63727dd8-4d93-4619-a97e-e3f292750822 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:38.564539 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-63727dd8-4d93-4619-a97e-e3f292750822 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:38.565547 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-63727dd8-4d93-4619-a97e-e3f292750822 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:38.566243 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-63727dd8-4d93-4619-a97e-e3f292750822 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:38.567060 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-63727dd8-4d93-4619-a97e-e3f292750822 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:38.587754 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-63727dd8-4d93-4619-a97e-e3f292750822 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Getting quotas for project de5388c25cdb4a35ae8d58fa5b6cf125. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:38:38.592915 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-63727dd8-4d93-4619-a97e-e3f292750822 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Getting quotas for user 6e4cde361139445eb147c4f634ec663f and project de5388c25cdb4a35ae8d58fa5b6cf125. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:38:38.605837 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-63727dd8-4d93-4619-a97e-e3f292750822 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:38:38.610559 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-63727dd8-4d93-4619-a97e-e3f292750822 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] [instance: 1a01253b-8ff8-44d9-961b-1b91de83d671] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:38:38.667415 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-63727dd8-4d93-4619-a97e-e3f292750822 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.623514 Sep 08 10:38:38.675465 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 248/509] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:38:37 2022] POST /compute/v2.1/servers => generated 401 bytes in 1632 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:38:38.681653 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2037a464-dab3-4ff1-909e-78661ce72757 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:38.682656 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2037a464-dab3-4ff1-909e-78661ce72757 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 422ceb5f-740f-45e5-9596-6796719adf27] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:38.690824 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2037a464-dab3-4ff1-909e-78661ce72757 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:38.691700 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2037a464-dab3-4ff1-909e-78661ce72757 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:38.692385 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2037a464-dab3-4ff1-909e-78661ce72757 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:38.693367 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2037a464-dab3-4ff1-909e-78661ce72757 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:38.694052 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2037a464-dab3-4ff1-909e-78661ce72757 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:38.694740 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2037a464-dab3-4ff1-909e-78661ce72757 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:38.722704 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a40021bb-0d17-4ccc-a452-75cabd9dce4d tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:38.757644 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a40021bb-0d17-4ccc-a452-75cabd9dce4d tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/b135e70e-1c5a-4432-9b50-237c118a5296" status: 200 len: 1469 microversion: 2.1 time: 0.319925 Sep 08 10:38:38.758482 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 262/510] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:38 2022] GET /compute/v2.1/servers/b135e70e-1c5a-4432-9b50-237c118a5296 => generated 1469 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:38.764726 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-88b393cb-5ad9-4aa3-992e-025a320ab387 req-d862ad08-d9b5-4997-b169-cc4051b3634c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc3d77c9-40f4-4f37-9717-9c11e724e637", "name": "network-vif-plugged", "status": "completed", "tag": "ae00f6df-3009-4a3a-93bb-25a2344e9fe0"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:38:38.776844 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-88b393cb-5ad9-4aa3-992e-025a320ab387 req-d862ad08-d9b5-4997-b169-cc4051b3634c service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:38.777507 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-88b393cb-5ad9-4aa3-992e-025a320ab387 req-d862ad08-d9b5-4997-b169-cc4051b3634c service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:38.777942 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-88b393cb-5ad9-4aa3-992e-025a320ab387 req-d862ad08-d9b5-4997-b169-cc4051b3634c service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:38.791832 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-88b393cb-5ad9-4aa3-992e-025a320ab387 req-d862ad08-d9b5-4997-b169-cc4051b3634c service nova] Creating event network-vif-plugged:ae00f6df-3009-4a3a-93bb-25a2344e9fe0 for instance bc3d77c9-40f4-4f37-9717-9c11e724e637 on n-h1-850501-12 Sep 08 10:38:38.798154 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-88b393cb-5ad9-4aa3-992e-025a320ab387 req-d862ad08-d9b5-4997-b169-cc4051b3634c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038400 Sep 08 10:38:38.802479 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 263/511] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:38:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:38:38.815121 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-85b77fa1-78e6-4016-9b32-696b8094edc8 tempest-HypervisorAdminNegativeTestJSON-424354540 tempest-HypervisorAdminNegativeTestJSON-424354540-project] Calling method '.version_select at 0x7f68e4ded5e0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:38.817471 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-85b77fa1-78e6-4016-9b32-696b8094edc8 tempest-HypervisorAdminNegativeTestJSON-424354540 tempest-HypervisorAdminNegativeTestJSON-424354540-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'cd9356dc7b734ce2a0c072a07f46b7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d753c438f04776b9bd5b3011bc4638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:38.819302 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-85b77fa1-78e6-4016-9b32-696b8094edc8 tempest-HypervisorAdminNegativeTestJSON-424354540 tempest-HypervisorAdminNegativeTestJSON-424354540-project] Request method failure captured: Sep 08 10:38:38.819302 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Sep 08 10:38:38.819302 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:38:38.819302 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:38:38.819302 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:38:38.819302 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:38:38.819302 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:38:38.819302 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:38:38.819302 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:38:38.819302 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:38:38.819302 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcYrXj84WVvhHP-nqpecy-saLhTLra-_zJ0VFCey5Z9LaDbcdTFsLR3L40qCOQZ-A7XmuiCJuwYASJzek5_j8YAzUFEFsnGhLK73kLmeXHqWJOUP6lAbEU86CQk828WIuu84ptQgfQ_d9kJuP3rk9wCj0iaMmfVRKpLCmghmjbyFEzI Sep 08 10:38:38.819302 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:38:38.819302 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:38:38.819302 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:38:38.819302 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:38:38.819302 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:38:38.819302 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:38:38.819302 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: d6d753c438f04776b9bd5b3011bc4638 Sep 08 10:38:38.819302 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-424354540 Sep 08 10:38:38.819302 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:38:38.819302 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:38:38.821678 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d6d753c438f04776b9bd5b3011bc4638"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d6d753c438f04776b9bd5b3011bc4638"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d6d753c438f04776b9bd5b3011bc4638"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d6d753c438f04776b9bd5b3011bc4638"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:38:38.821678 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-424354540 Sep 08 10:38:38.821678 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: d6d753c438f04776b9bd5b3011bc4638 Sep 08 10:38:38.821678 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-424354540 Sep 08 10:38:38.821678 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-HypervisorAdminNegativeTestJSON-424354540-project Sep 08 10:38:38.821678 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:38:38.821678 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:38:38.821678 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: cd9356dc7b734ce2a0c072a07f46b7d8 Sep 08 10:38:38.821678 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-424354540-project Sep 08 10:38:38.821678 n-d-850501-12 devstack@n-api.service[128862]: method: Sep 08 10:38:38.821678 n-d-850501-12 devstack@n-api.service[128862]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Sep 08 10:38:38.821678 n-d-850501-12 devstack@n-api.service[128862]: action_args: {} Sep 08 10:38:38.821678 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:38:38.824255 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:38:38.824255 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:38:38.824255 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:38:38.824255 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:38:38.824255 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:38:38.824255 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:38:38.824255 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:38:38.824255 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:38:38.824255 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:38:38.824255 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Sep 08 10:38:38.824255 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._index(req) Sep 08 10:38:38.824255 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Sep 08 10:38:38.824255 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Sep 08 10:38:38.824255 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 10:38:38.824255 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 10:38:38.824255 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 10:38:38.824255 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 10:38:38.824255 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:38:38.824255 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:38:38.829655 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:38:38.829655 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:38:38.829655 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 10:38:38.829655 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 10:38:38.829655 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 10:38:38.829655 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 10:38:38.829655 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 10:38:38.829655 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 10:38:38.829655 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Sep 08 10:38:38.829655 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:38:38.829655 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:38:38.829655 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:38:38.829655 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:38:38.829655 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:38:38.829655 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:38:38.829655 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 10:38:38.829655 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 10:38:38.829655 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Sep 08 10:38:38.829655 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:38:38.835817 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-85b77fa1-78e6-4016-9b32-696b8094edc8 tempest-HypervisorAdminNegativeTestJSON-424354540 tempest-HypervisorAdminNegativeTestJSON-424354540-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:38:38.835817 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-85b77fa1-78e6-4016-9b32-696b8094edc8 tempest-HypervisorAdminNegativeTestJSON-424354540 tempest-HypervisorAdminNegativeTestJSON-424354540-project] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.017648 Sep 08 10:38:38.835817 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 264/512] 10.222.0.27 () {58 vars in 1146 bytes} [Thu Sep 8 10:38:38 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:38:38.835817 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f2b26e3b-5efc-411e-a7f7-a81721115468 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:38.835817 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f2b26e3b-5efc-411e-a7f7-a81721115468 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: ec8a85b1-636c-4699-8042-4dbefbc881f3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:38.843476 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f2b26e3b-5efc-411e-a7f7-a81721115468 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:38.843942 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f2b26e3b-5efc-411e-a7f7-a81721115468 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:38.844607 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f2b26e3b-5efc-411e-a7f7-a81721115468 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:38.845435 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f2b26e3b-5efc-411e-a7f7-a81721115468 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:38.846065 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f2b26e3b-5efc-411e-a7f7-a81721115468 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:38.846551 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f2b26e3b-5efc-411e-a7f7-a81721115468 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:38.887343 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2037a464-dab3-4ff1-909e-78661ce72757 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:38.914181 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2037a464-dab3-4ff1-909e-78661ce72757 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:38.916447 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2037a464-dab3-4ff1-909e-78661ce72757 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:38.917856 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2037a464-dab3-4ff1-909e-78661ce72757 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/422ceb5f-740f-45e5-9596-6796719adf27" status: 200 len: 1360 microversion: 2.25 time: 0.240985 Sep 08 10:38:38.932859 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 249/513] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:38:38 2022] GET /compute/v2.1/servers/422ceb5f-740f-45e5-9596-6796719adf27 => generated 1360 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:38:38.949650 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c1624e1c-ab06-487d-822b-15f04065b128 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:38.950249 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c1624e1c-ab06-487d-822b-15f04065b128 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] [instance: 1a01253b-8ff8-44d9-961b-1b91de83d671] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:39.070358 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c1624e1c-ab06-487d-822b-15f04065b128 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4cde361139445eb147c4f634ec663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5388c25cdb4a35ae8d58fa5b6cf125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:39.081567 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c1624e1c-ab06-487d-822b-15f04065b128 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] 10.222.0.27 "GET /compute/v2.1/servers/1a01253b-8ff8-44d9-961b-1b91de83d671" status: 200 len: 1263 microversion: 2.1 time: 0.146712 Sep 08 10:38:39.082153 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 250/514] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:38 2022] GET /compute/v2.1/servers/1a01253b-8ff8-44d9-961b-1b91de83d671 => generated 1263 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:39.100312 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f2b26e3b-5efc-411e-a7f7-a81721115468 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:39.110084 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3fea9620-fca3-4330-9a4c-c04ef4ce9d34 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:39.118027 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f2b26e3b-5efc-411e-a7f7-a81721115468 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/ec8a85b1-636c-4699-8042-4dbefbc881f3" status: 200 len: 1310 microversion: 2.1 time: 0.289450 Sep 08 10:38:39.119497 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 265/515] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:38 2022] GET /compute/v2.1/servers/ec8a85b1-636c-4699-8042-4dbefbc881f3 => generated 1310 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:39.133773 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-3fea9620-fca3-4330-9a4c-c04ef4ce9d34 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:39.134718 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3fea9620-fca3-4330-9a4c-c04ef4ce9d34 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Searching by: {'reservation_id': 'r-57gzhtlb', 'deleted': False, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9'} {{(pid=128861) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:38:39.137268 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-aab57c6c-4adc-453c-aeef-d21fd28dd91d tempest-HypervisorAdminNegativeTestJSON-424354540 tempest-HypervisorAdminNegativeTestJSON-424354540-project] Calling method '.version_select at 0x7f68e4ded700>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:39.144855 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-aab57c6c-4adc-453c-aeef-d21fd28dd91d tempest-HypervisorAdminNegativeTestJSON-424354540 tempest-HypervisorAdminNegativeTestJSON-424354540-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'cd9356dc7b734ce2a0c072a07f46b7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d753c438f04776b9bd5b3011bc4638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:39.148763 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-aab57c6c-4adc-453c-aeef-d21fd28dd91d tempest-HypervisorAdminNegativeTestJSON-424354540 tempest-HypervisorAdminNegativeTestJSON-424354540-project] Request method failure captured: Sep 08 10:38:39.148763 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Sep 08 10:38:39.148763 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:38:39.148763 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:38:39.148763 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:38:39.148763 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:38:39.148763 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:38:39.148763 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:38:39.148763 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:38:39.148763 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:38:39.148763 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcYrXj84WVvhHP-nqpecy-saLhTLra-_zJ0VFCey5Z9LaDbcdTFsLR3L40qCOQZ-A7XmuiCJuwYASJzek5_j8YAzUFEFsnGhLK73kLmeXHqWJOUP6lAbEU86CQk828WIuu84ptQgfQ_d9kJuP3rk9wCj0iaMmfVRKpLCmghmjbyFEzI Sep 08 10:38:39.148763 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:38:39.148763 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:38:39.148763 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:38:39.148763 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:38:39.148763 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:38:39.148763 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:38:39.148763 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: d6d753c438f04776b9bd5b3011bc4638 Sep 08 10:38:39.148763 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-424354540 Sep 08 10:38:39.148763 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:38:39.148763 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:38:39.150167 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d6d753c438f04776b9bd5b3011bc4638"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d6d753c438f04776b9bd5b3011bc4638"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d6d753c438f04776b9bd5b3011bc4638"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d6d753c438f04776b9bd5b3011bc4638"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:38:39.150167 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-424354540 Sep 08 10:38:39.150167 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: d6d753c438f04776b9bd5b3011bc4638 Sep 08 10:38:39.150167 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-424354540 Sep 08 10:38:39.150167 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-HypervisorAdminNegativeTestJSON-424354540-project Sep 08 10:38:39.150167 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:38:39.150167 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:38:39.150167 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: cd9356dc7b734ce2a0c072a07f46b7d8 Sep 08 10:38:39.150167 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-424354540-project Sep 08 10:38:39.150167 n-d-850501-12 devstack@n-api.service[128862]: method: Sep 08 10:38:39.150167 n-d-850501-12 devstack@n-api.service[128862]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Sep 08 10:38:39.150167 n-d-850501-12 devstack@n-api.service[128862]: action_args: {} Sep 08 10:38:39.150167 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:38:39.157619 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:38:39.157619 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:38:39.157619 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:38:39.157619 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:38:39.157619 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:38:39.157619 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:38:39.157619 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:38:39.157619 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:38:39.157619 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:38:39.157619 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Sep 08 10:38:39.157619 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Sep 08 10:38:39.157619 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 10:38:39.157619 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 10:38:39.157619 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 10:38:39.157619 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 10:38:39.157619 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:38:39.157619 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:38:39.157619 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:38:39.157619 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:38:39.159365 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 10:38:39.159365 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 10:38:39.159365 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 10:38:39.159365 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 10:38:39.159365 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 10:38:39.159365 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 10:38:39.159365 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Sep 08 10:38:39.159365 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:38:39.159365 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:38:39.159365 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:38:39.159365 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:38:39.159365 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:38:39.159365 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:38:39.159365 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 10:38:39.159365 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 10:38:39.159365 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Sep 08 10:38:39.159365 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:38:39.160949 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-aab57c6c-4adc-453c-aeef-d21fd28dd91d tempest-HypervisorAdminNegativeTestJSON-424354540 tempest-HypervisorAdminNegativeTestJSON-424354540-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:38:39.160949 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-aab57c6c-4adc-453c-aeef-d21fd28dd91d tempest-HypervisorAdminNegativeTestJSON-424354540 tempest-HypervisorAdminNegativeTestJSON-424354540-project] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.029080 Sep 08 10:38:39.161146 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3fea9620-fca3-4330-9a4c-c04ef4ce9d34 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:39.161146 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3fea9620-fca3-4330-9a4c-c04ef4ce9d34 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:39.161146 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3fea9620-fca3-4330-9a4c-c04ef4ce9d34 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:39.161427 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 266/516] 10.222.0.27 () {58 vars in 1179 bytes} [Thu Sep 8 10:38:39 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 40 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:38:39.169487 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3fea9620-fca3-4330-9a4c-c04ef4ce9d34 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:39.170862 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3fea9620-fca3-4330-9a4c-c04ef4ce9d34 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:39.171590 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3fea9620-fca3-4330-9a4c-c04ef4ce9d34 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:39.174507 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e1220701-30cc-4a21-b84b-a8ca0772ed68 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:39.176114 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e1220701-30cc-4a21-b84b-a8ca0772ed68 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 815705bc-e49e-47a1-864b-9cc550464808] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:39.215587 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e1220701-30cc-4a21-b84b-a8ca0772ed68 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:39.224800 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e1220701-30cc-4a21-b84b-a8ca0772ed68 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:39.225877 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e1220701-30cc-4a21-b84b-a8ca0772ed68 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:39.230782 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e1220701-30cc-4a21-b84b-a8ca0772ed68 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:39.235192 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e1220701-30cc-4a21-b84b-a8ca0772ed68 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:39.236844 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e1220701-30cc-4a21-b84b-a8ca0772ed68 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:39.419468 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.multi_cell_list [None req-3fea9620-fca3-4330-9a4c-c04ef4ce9d34 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128861) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 10:38:39.595652 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-3fea9620-fca3-4330-9a4c-c04ef4ce9d34 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:39.605917 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3fea9620-fca3-4330-9a4c-c04ef4ce9d34 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:39.606403 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3fea9620-fca3-4330-9a4c-c04ef4ce9d34 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:39.606831 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3fea9620-fca3-4330-9a4c-c04ef4ce9d34 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:39.710177 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e1220701-30cc-4a21-b84b-a8ca0772ed68 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:39.728149 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e1220701-30cc-4a21-b84b-a8ca0772ed68 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808" status: 200 len: 1472 microversion: 2.1 time: 0.566055 Sep 08 10:38:39.728850 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 267/517] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:39 2022] GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808 => generated 1472 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:39.861625 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-12fe2782-875d-40c5-a6c8-b57f2c7279ca tempest-HypervisorAdminNegativeTestJSON-673992683 tempest-HypervisorAdminNegativeTestJSON-673992683-project-admin] Calling method '.version_select at 0x7f68e5025700>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:39.867890 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12fe2782-875d-40c5-a6c8-b57f2c7279ca tempest-HypervisorAdminNegativeTestJSON-673992683 tempest-HypervisorAdminNegativeTestJSON-673992683-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:39.869161 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12fe2782-875d-40c5-a6c8-b57f2c7279ca tempest-HypervisorAdminNegativeTestJSON-673992683 tempest-HypervisorAdminNegativeTestJSON-673992683-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:39.870284 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12fe2782-875d-40c5-a6c8-b57f2c7279ca tempest-HypervisorAdminNegativeTestJSON-673992683 tempest-HypervisorAdminNegativeTestJSON-673992683-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:39.898278 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12fe2782-875d-40c5-a6c8-b57f2c7279ca tempest-HypervisorAdminNegativeTestJSON-673992683 tempest-HypervisorAdminNegativeTestJSON-673992683-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:39.899143 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12fe2782-875d-40c5-a6c8-b57f2c7279ca tempest-HypervisorAdminNegativeTestJSON-673992683 tempest-HypervisorAdminNegativeTestJSON-673992683-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:39.900109 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12fe2782-875d-40c5-a6c8-b57f2c7279ca tempest-HypervisorAdminNegativeTestJSON-673992683 tempest-HypervisorAdminNegativeTestJSON-673992683-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:39.920361 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12fe2782-875d-40c5-a6c8-b57f2c7279ca tempest-HypervisorAdminNegativeTestJSON-673992683 tempest-HypervisorAdminNegativeTestJSON-673992683-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:39.921289 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12fe2782-875d-40c5-a6c8-b57f2c7279ca tempest-HypervisorAdminNegativeTestJSON-673992683 tempest-HypervisorAdminNegativeTestJSON-673992683-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:39.922071 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12fe2782-875d-40c5-a6c8-b57f2c7279ca tempest-HypervisorAdminNegativeTestJSON-673992683 tempest-HypervisorAdminNegativeTestJSON-673992683-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:39.934135 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-12fe2782-875d-40c5-a6c8-b57f2c7279ca tempest-HypervisorAdminNegativeTestJSON-673992683 tempest-HypervisorAdminNegativeTestJSON-673992683-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.203735 Sep 08 10:38:39.935199 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 268/518] 10.222.0.27 () {58 vars in 1146 bytes} [Thu Sep 8 10:38:39 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:38:39.976800 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-524bc4cc-0dc4-4b53-a3d6-09744f9bbae4 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:39.977949 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-524bc4cc-0dc4-4b53-a3d6-09744f9bbae4 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] [instance: bc3d77c9-40f4-4f37-9717-9c11e724e637] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:39.981258 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=4 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:38:39.991685 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-524bc4cc-0dc4-4b53-a3d6-09744f9bbae4 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:39.992868 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-524bc4cc-0dc4-4b53-a3d6-09744f9bbae4 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:39.994064 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-524bc4cc-0dc4-4b53-a3d6-09744f9bbae4 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:39.995547 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-524bc4cc-0dc4-4b53-a3d6-09744f9bbae4 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:39.996876 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-524bc4cc-0dc4-4b53-a3d6-09744f9bbae4 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:39.998155 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-524bc4cc-0dc4-4b53-a3d6-09744f9bbae4 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:40.261729 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3fea9620-fca3-4330-9a4c-c04ef4ce9d34 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/detail?reservation_id=r-57gzhtlb" status: 200 len: 2931 microversion: 2.1 time: 1.176770 Sep 08 10:38:40.277672 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 251/519] 10.222.0.27 () {58 vars in 1197 bytes} [Thu Sep 8 10:38:39 2022] GET /compute/v2.1/servers/detail?reservation_id=r-57gzhtlb => generated 2931 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:40.278344 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-524bc4cc-0dc4-4b53-a3d6-09744f9bbae4 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9913da38392048c897ada11a1ac5e6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b3414c389540e7a35f03809b064d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:40.291250 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-524bc4cc-0dc4-4b53-a3d6-09744f9bbae4 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] 10.222.0.27 "GET /compute/v2.1/servers/bc3d77c9-40f4-4f37-9717-9c11e724e637" status: 200 len: 1323 microversion: 2.1 time: 0.354532 Sep 08 10:38:40.291508 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e51e4aa3-7d64-4f11-9388-3d93d9918d43 tempest-HypervisorAdminNegativeTestJSON-424354540 tempest-HypervisorAdminNegativeTestJSON-424354540-project] Calling method '.version_select at 0x7f68e4ba3ca0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:40.291850 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 269/520] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:39 2022] GET /compute/v2.1/servers/bc3d77c9-40f4-4f37-9717-9c11e724e637 => generated 1323 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:40.297335 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e51e4aa3-7d64-4f11-9388-3d93d9918d43 tempest-HypervisorAdminNegativeTestJSON-424354540 tempest-HypervisorAdminNegativeTestJSON-424354540-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'cd9356dc7b734ce2a0c072a07f46b7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d753c438f04776b9bd5b3011bc4638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:40.300574 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bb2e1f44-64ae-46c0-b6f7-7900fbd2f8d4 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:40.300889 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e51e4aa3-7d64-4f11-9388-3d93d9918d43 tempest-HypervisorAdminNegativeTestJSON-424354540 tempest-HypervisorAdminNegativeTestJSON-424354540-project] Request method failure captured: Sep 08 10:38:40.300889 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Sep 08 10:38:40.300889 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:38:40.300889 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:38:40.300889 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:38:40.300889 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:38:40.300889 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:38:40.300889 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:38:40.300889 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:38:40.300889 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:38:40.300889 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcYrXj84WVvhHP-nqpecy-saLhTLra-_zJ0VFCey5Z9LaDbcdTFsLR3L40qCOQZ-A7XmuiCJuwYASJzek5_j8YAzUFEFsnGhLK73kLmeXHqWJOUP6lAbEU86CQk828WIuu84ptQgfQ_d9kJuP3rk9wCj0iaMmfVRKpLCmghmjbyFEzI Sep 08 10:38:40.300889 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:38:40.300889 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:38:40.300889 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:38:40.300889 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:38:40.300889 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:38:40.300889 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:38:40.300889 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: d6d753c438f04776b9bd5b3011bc4638 Sep 08 10:38:40.300889 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-424354540 Sep 08 10:38:40.300889 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:38:40.300889 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:38:40.302428 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d6d753c438f04776b9bd5b3011bc4638"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d6d753c438f04776b9bd5b3011bc4638"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d6d753c438f04776b9bd5b3011bc4638"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d6d753c438f04776b9bd5b3011bc4638"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:38:40.302428 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-424354540 Sep 08 10:38:40.302428 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: d6d753c438f04776b9bd5b3011bc4638 Sep 08 10:38:40.302428 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-424354540 Sep 08 10:38:40.302428 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-HypervisorAdminNegativeTestJSON-424354540-project Sep 08 10:38:40.302428 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:38:40.302428 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:38:40.302428 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: cd9356dc7b734ce2a0c072a07f46b7d8 Sep 08 10:38:40.302428 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-424354540-project Sep 08 10:38:40.302428 n-d-850501-12 devstack@n-api.service[128861]: method: Sep 08 10:38:40.302428 n-d-850501-12 devstack@n-api.service[128861]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Sep 08 10:38:40.302428 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '1'} Sep 08 10:38:40.302428 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:38:40.303245 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:38:40.303245 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:38:40.303245 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:38:40.303245 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:38:40.303245 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:38:40.303245 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:38:40.303245 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:38:40.303245 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:38:40.303245 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:38:40.303245 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Sep 08 10:38:40.303245 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Sep 08 10:38:40.303245 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 10:38:40.303245 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 10:38:40.303245 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 10:38:40.303245 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 10:38:40.303245 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:38:40.303245 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:38:40.303245 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:38:40.303245 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:38:40.304918 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 10:38:40.304918 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 10:38:40.304918 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 10:38:40.304918 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 10:38:40.304918 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 10:38:40.304918 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 10:38:40.304918 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Sep 08 10:38:40.304918 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:38:40.304918 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:38:40.304918 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:38:40.304918 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:38:40.304918 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:38:40.304918 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:38:40.304918 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 10:38:40.304918 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 10:38:40.304918 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Sep 08 10:38:40.304918 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:38:40.306019 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e51e4aa3-7d64-4f11-9388-3d93d9918d43 tempest-HypervisorAdminNegativeTestJSON-424354540 tempest-HypervisorAdminNegativeTestJSON-424354540-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:38:40.306102 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bb2e1f44-64ae-46c0-b6f7-7900fbd2f8d4 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 422ceb5f-740f-45e5-9596-6796719adf27] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:40.306192 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e51e4aa3-7d64-4f11-9388-3d93d9918d43 tempest-HypervisorAdminNegativeTestJSON-424354540 tempest-HypervisorAdminNegativeTestJSON-424354540-project] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.027063 Sep 08 10:38:40.311634 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 252/521] 10.222.0.27 () {58 vars in 1173 bytes} [Thu Sep 8 10:38:40 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:38:40.321540 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9088fd02-7e41-4a8d-a5ab-4505f893e178 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:40.323325 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb2e1f44-64ae-46c0-b6f7-7900fbd2f8d4 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:40.323832 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb2e1f44-64ae-46c0-b6f7-7900fbd2f8d4 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:40.324271 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb2e1f44-64ae-46c0-b6f7-7900fbd2f8d4 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:40.326579 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9088fd02-7e41-4a8d-a5ab-4505f893e178 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] [instance: 1a01253b-8ff8-44d9-961b-1b91de83d671] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:40.328414 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb2e1f44-64ae-46c0-b6f7-7900fbd2f8d4 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:40.328919 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb2e1f44-64ae-46c0-b6f7-7900fbd2f8d4 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:40.329416 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb2e1f44-64ae-46c0-b6f7-7900fbd2f8d4 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:40.334390 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9088fd02-7e41-4a8d-a5ab-4505f893e178 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:40.335197 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9088fd02-7e41-4a8d-a5ab-4505f893e178 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:40.335873 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9088fd02-7e41-4a8d-a5ab-4505f893e178 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:40.336824 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9088fd02-7e41-4a8d-a5ab-4505f893e178 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:40.337497 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9088fd02-7e41-4a8d-a5ab-4505f893e178 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:40.337932 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9088fd02-7e41-4a8d-a5ab-4505f893e178 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:40.462193 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9088fd02-7e41-4a8d-a5ab-4505f893e178 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4cde361139445eb147c4f634ec663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5388c25cdb4a35ae8d58fa5b6cf125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:40.478467 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9088fd02-7e41-4a8d-a5ab-4505f893e178 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] 10.222.0.27 "GET /compute/v2.1/servers/1a01253b-8ff8-44d9-961b-1b91de83d671" status: 200 len: 1259 microversion: 2.1 time: 0.165401 Sep 08 10:38:40.479315 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 253/522] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:40 2022] GET /compute/v2.1/servers/1a01253b-8ff8-44d9-961b-1b91de83d671 => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:40.487029 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7dc6fce9-eaa3-4480-8917-b4b6601e55a9 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:40.488145 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7dc6fce9-eaa3-4480-8917-b4b6601e55a9 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: ec8a85b1-636c-4699-8042-4dbefbc881f3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:40.495746 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7dc6fce9-eaa3-4480-8917-b4b6601e55a9 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:40.496495 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7dc6fce9-eaa3-4480-8917-b4b6601e55a9 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:40.497146 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7dc6fce9-eaa3-4480-8917-b4b6601e55a9 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:40.499021 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7dc6fce9-eaa3-4480-8917-b4b6601e55a9 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:40.499849 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7dc6fce9-eaa3-4480-8917-b4b6601e55a9 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:40.500531 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7dc6fce9-eaa3-4480-8917-b4b6601e55a9 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:40.584995 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bb2e1f44-64ae-46c0-b6f7-7900fbd2f8d4 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:40.596194 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bb2e1f44-64ae-46c0-b6f7-7900fbd2f8d4 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:40.598039 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bb2e1f44-64ae-46c0-b6f7-7900fbd2f8d4 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:40.599586 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bb2e1f44-64ae-46c0-b6f7-7900fbd2f8d4 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/422ceb5f-740f-45e5-9596-6796719adf27" status: 200 len: 1360 microversion: 2.25 time: 0.306782 Sep 08 10:38:40.600385 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 270/523] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:38:40 2022] GET /compute/v2.1/servers/422ceb5f-740f-45e5-9596-6796719adf27 => generated 1360 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:38:40.605067 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-51f0f7c7-e3c8-46b1-ace5-8e9108992f0b tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:40.624814 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.compute.server_groups [None req-51f0f7c7-e3c8-46b1-ace5-8e9108992f0b tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Querying cell 2785b110-f847-4739-9d30-5b571c6d79f4(cell1) for 2 instances {{(pid=128862) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 08 10:38:40.625660 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51f0f7c7-e3c8-46b1-ace5-8e9108992f0b tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:40.626237 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51f0f7c7-e3c8-46b1-ace5-8e9108992f0b tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:40.626740 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51f0f7c7-e3c8-46b1-ace5-8e9108992f0b tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:40.668459 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-51f0f7c7-e3c8-46b1-ace5-8e9108992f0b tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups/3c7ac2f4-7900-4460-88d2-b99d2a90cb64" status: 200 len: 266 microversion: 2.1 time: 0.066478 Sep 08 10:38:40.670252 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 271/524] 10.222.0.27 () {58 vars in 1263 bytes} [Thu Sep 8 10:38:40 2022] GET /compute/v2.1/os-server-groups/3c7ac2f4-7900-4460-88d2-b99d2a90cb64 => generated 266 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:38:40.677373 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-116bae06-c59a-4e7e-96af-dd8be91088bf tempest-HypervisorAdminNegativeTestJSON-673992683 tempest-HypervisorAdminNegativeTestJSON-673992683-project-admin] Calling method '.version_select at 0x7f68e4f94670>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:40.680191 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-116bae06-c59a-4e7e-96af-dd8be91088bf tempest-HypervisorAdminNegativeTestJSON-673992683 tempest-HypervisorAdminNegativeTestJSON-673992683-project-admin] HTTP exception thrown: Hypervisor with ID '9c165f68-1928-4a37-85f3-11bd3e164c9a' could not be found. Sep 08 10:38:40.696521 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-116bae06-c59a-4e7e-96af-dd8be91088bf tempest-HypervisorAdminNegativeTestJSON-673992683 tempest-HypervisorAdminNegativeTestJSON-673992683-project-admin] Request method failure captured: Sep 08 10:38:40.696521 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/os-hypervisors/9c165f68-1928-4a37-85f3-11bd3e164c9a/uptime HTTP/1.1 Sep 08 10:38:40.696521 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:38:40.696521 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:38:40.696521 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:38:40.696521 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:38:40.696521 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:38:40.696521 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:38:40.696521 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:38:40.696521 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:38:40.696521 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcYt0kydPSizKFPxtgfQRccosw2_Z40fPh1zpZVwTW_jKuU0ISyhU_vUeDs10givHT5rTJvYE3sAr0muiPZk2HOVf-baRa6nmek0l6ZacrUoiJRC3kMTHBO2S3I7KuCl-3MjTcmT8m6d5XDVPyeTtMHnpH2T7nTLS6vTNowuJa-k3KE Sep 08 10:38:40.696521 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:38:40.696521 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:38:40.696521 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:38:40.696521 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:38:40.696521 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:38:40.696521 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:38:40.696521 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 3a17c1c9a10b466a9eccdd7a25931e1e Sep 08 10:38:40.696521 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-673992683 Sep 08 10:38:40.696521 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,admin,member Sep 08 10:38:40.696521 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,admin,member Sep 08 10:38:40.698153 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3a17c1c9a10b466a9eccdd7a25931e1e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3a17c1c9a10b466a9eccdd7a25931e1e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3a17c1c9a10b466a9eccdd7a25931e1e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3a17c1c9a10b466a9eccdd7a25931e1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:38:40.698153 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-673992683 Sep 08 10:38:40.698153 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 3a17c1c9a10b466a9eccdd7a25931e1e Sep 08 10:38:40.698153 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-673992683 Sep 08 10:38:40.698153 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-HypervisorAdminNegativeTestJSON-673992683-project-admin Sep 08 10:38:40.698153 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:38:40.698153 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:38:40.698153 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 4230ec38482a41b89e69b061532523e6 Sep 08 10:38:40.698153 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-673992683-project-admin Sep 08 10:38:40.698153 n-d-850501-12 devstack@n-api.service[128862]: method: Sep 08 10:38:40.698153 n-d-850501-12 devstack@n-api.service[128862]: exception: Hypervisor with ID '9c165f68-1928-4a37-85f3-11bd3e164c9a' could not be found. Sep 08 10:38:40.698153 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '9c165f68-1928-4a37-85f3-11bd3e164c9a'} Sep 08 10:38:40.698984 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:38:40.698984 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:38:40.698984 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Sep 08 10:38:40.698984 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi value = int(str(value)) Sep 08 10:38:40.698984 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '9c165f68-1928-4a37-85f3-11bd3e164c9a' Sep 08 10:38:40.698984 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:38:40.698984 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:38:40.698984 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:38:40.698984 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:38:40.698984 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Sep 08 10:38:40.698984 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Sep 08 10:38:40.698984 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Sep 08 10:38:40.698984 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Sep 08 10:38:40.698984 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Sep 08 10:38:40.698984 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:38:40.698984 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:38:40.698984 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:38:40.698984 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:38:40.698984 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Sep 08 10:38:40.698984 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Sep 08 10:38:40.698984 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Sep 08 10:38:40.698984 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Sep 08 10:38:40.701999 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Sep 08 10:38:40.701999 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:38:40.701999 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:38:40.701999 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:38:40.701999 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:38:40.701999 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:38:40.701999 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:38:40.701999 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:38:40.701999 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:38:40.701999 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:38:40.701999 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:38:40.701999 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:38:40.701999 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:38:40.701999 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Sep 08 10:38:40.701999 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Sep 08 10:38:40.701999 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Sep 08 10:38:40.701999 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 08 10:38:40.701999 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '9c165f68-1928-4a37-85f3-11bd3e164c9a' could not be found. Sep 08 10:38:40.701999 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:38:40.701999 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:38:40.701999 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:38:40.705062 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:38:40.705062 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:38:40.705062 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:38:40.705062 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:38:40.705062 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:38:40.705062 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '9c165f68-1928-4a37-85f3-11bd3e164c9a' could not be found. Sep 08 10:38:40.705062 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:38:40.705062 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-116bae06-c59a-4e7e-96af-dd8be91088bf tempest-HypervisorAdminNegativeTestJSON-673992683 tempest-HypervisorAdminNegativeTestJSON-673992683-project-admin] Returning 404 to user: Hypervisor with ID '9c165f68-1928-4a37-85f3-11bd3e164c9a' could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:38:40.705062 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-116bae06-c59a-4e7e-96af-dd8be91088bf tempest-HypervisorAdminNegativeTestJSON-673992683 tempest-HypervisorAdminNegativeTestJSON-673992683-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/9c165f68-1928-4a37-85f3-11bd3e164c9a/uptime" status: 404 len: 123 microversion: 2.1 time: 0.026742 Sep 08 10:38:40.705062 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 272/525] 10.222.0.27 () {58 vars in 1278 bytes} [Thu Sep 8 10:38:40 2022] GET /compute/v2.1/os-hypervisors/9c165f68-1928-4a37-85f3-11bd3e164c9a/uptime => generated 123 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:38:40.708041 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2c342db0-030f-4bed-a2a2-383542473865 tempest-ServersOnMultiNodesTest-60601867 tempest-ServersOnMultiNodesTest-60601867-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:40.709190 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2c342db0-030f-4bed-a2a2-383542473865 tempest-ServersOnMultiNodesTest-60601867 tempest-ServersOnMultiNodesTest-60601867-project-admin] [instance: b135e70e-1c5a-4432-9b50-237c118a5296] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:40.717654 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2c342db0-030f-4bed-a2a2-383542473865 tempest-ServersOnMultiNodesTest-60601867 tempest-ServersOnMultiNodesTest-60601867-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:40.718705 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2c342db0-030f-4bed-a2a2-383542473865 tempest-ServersOnMultiNodesTest-60601867 tempest-ServersOnMultiNodesTest-60601867-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:40.719511 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2c342db0-030f-4bed-a2a2-383542473865 tempest-ServersOnMultiNodesTest-60601867 tempest-ServersOnMultiNodesTest-60601867-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:40.720423 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2c342db0-030f-4bed-a2a2-383542473865 tempest-ServersOnMultiNodesTest-60601867 tempest-ServersOnMultiNodesTest-60601867-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:40.721118 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2c342db0-030f-4bed-a2a2-383542473865 tempest-ServersOnMultiNodesTest-60601867 tempest-ServersOnMultiNodesTest-60601867-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:40.721809 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2c342db0-030f-4bed-a2a2-383542473865 tempest-ServersOnMultiNodesTest-60601867 tempest-ServersOnMultiNodesTest-60601867-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:40.871182 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7dc6fce9-eaa3-4480-8917-b4b6601e55a9 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:40.882004 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7dc6fce9-eaa3-4480-8917-b4b6601e55a9 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/ec8a85b1-636c-4699-8042-4dbefbc881f3" status: 200 len: 1493 microversion: 2.1 time: 0.400492 Sep 08 10:38:40.882578 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 254/526] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:40 2022] GET /compute/v2.1/servers/ec8a85b1-636c-4699-8042-4dbefbc881f3 => generated 1493 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:40.887197 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8e3d70ac-8788-4bdc-b21f-e468079893f1 tempest-HypervisorAdminNegativeTestJSON-673992683 tempest-HypervisorAdminNegativeTestJSON-673992683-project-admin] Calling method '.version_select at 0x7f68e4ec3ca0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:40.890918 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8e3d70ac-8788-4bdc-b21f-e468079893f1 tempest-HypervisorAdminNegativeTestJSON-673992683 tempest-HypervisorAdminNegativeTestJSON-673992683-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:40.892081 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8e3d70ac-8788-4bdc-b21f-e468079893f1 tempest-HypervisorAdminNegativeTestJSON-673992683 tempest-HypervisorAdminNegativeTestJSON-673992683-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:40.892732 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8e3d70ac-8788-4bdc-b21f-e468079893f1 tempest-HypervisorAdminNegativeTestJSON-673992683 tempest-HypervisorAdminNegativeTestJSON-673992683-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:40.936406 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2c342db0-030f-4bed-a2a2-383542473865 tempest-ServersOnMultiNodesTest-60601867 tempest-ServersOnMultiNodesTest-60601867-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/b135e70e-1c5a-4432-9b50-237c118a5296" status: 200 len: 1622 microversion: 2.1 time: 0.233863 Sep 08 10:38:40.937394 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 273/527] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:40 2022] GET /compute/v2.1/servers/b135e70e-1c5a-4432-9b50-237c118a5296 => generated 1622 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:40.952012 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8e3d70ac-8788-4bdc-b21f-e468079893f1 tempest-HypervisorAdminNegativeTestJSON-673992683 tempest-HypervisorAdminNegativeTestJSON-673992683-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:40.952507 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8e3d70ac-8788-4bdc-b21f-e468079893f1 tempest-HypervisorAdminNegativeTestJSON-673992683 tempest-HypervisorAdminNegativeTestJSON-673992683-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:40.953183 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8e3d70ac-8788-4bdc-b21f-e468079893f1 tempest-HypervisorAdminNegativeTestJSON-673992683 tempest-HypervisorAdminNegativeTestJSON-673992683-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:40.965749 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-35bb552a-b8fc-462a-a70c-f7651df513bf tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:40.967806 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-35bb552a-b8fc-462a-a70c-f7651df513bf tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 815705bc-e49e-47a1-864b-9cc550464808] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:40.973928 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8e3d70ac-8788-4bdc-b21f-e468079893f1 tempest-HypervisorAdminNegativeTestJSON-673992683 tempest-HypervisorAdminNegativeTestJSON-673992683-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:40.974841 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35bb552a-b8fc-462a-a70c-f7651df513bf tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:40.975265 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8e3d70ac-8788-4bdc-b21f-e468079893f1 tempest-HypervisorAdminNegativeTestJSON-673992683 tempest-HypervisorAdminNegativeTestJSON-673992683-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:40.975451 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35bb552a-b8fc-462a-a70c-f7651df513bf tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:40.976190 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35bb552a-b8fc-462a-a70c-f7651df513bf tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:40.976389 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8e3d70ac-8788-4bdc-b21f-e468079893f1 tempest-HypervisorAdminNegativeTestJSON-673992683 tempest-HypervisorAdminNegativeTestJSON-673992683-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:40.977567 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35bb552a-b8fc-462a-a70c-f7651df513bf tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:40.978186 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35bb552a-b8fc-462a-a70c-f7651df513bf tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:40.978760 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35bb552a-b8fc-462a-a70c-f7651df513bf tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:40.984920 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8e3d70ac-8788-4bdc-b21f-e468079893f1 tempest-HypervisorAdminNegativeTestJSON-673992683 tempest-HypervisorAdminNegativeTestJSON-673992683-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.101089 Sep 08 10:38:40.986270 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 255/528] 10.222.0.27 () {58 vars in 1146 bytes} [Thu Sep 8 10:38:40 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:38:41.218201 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-02cba5a3-e7d0-4909-a863-8ee41f8a1de1 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:41.218833 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-02cba5a3-e7d0-4909-a863-8ee41f8a1de1 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] [instance: ec8a85b1-636c-4699-8042-4dbefbc881f3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:41.232935 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-02cba5a3-e7d0-4909-a863-8ee41f8a1de1 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:41.234131 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-02cba5a3-e7d0-4909-a863-8ee41f8a1de1 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:41.234793 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-02cba5a3-e7d0-4909-a863-8ee41f8a1de1 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:41.235704 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-02cba5a3-e7d0-4909-a863-8ee41f8a1de1 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:41.236346 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-02cba5a3-e7d0-4909-a863-8ee41f8a1de1 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:41.237059 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-02cba5a3-e7d0-4909-a863-8ee41f8a1de1 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:41.266872 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-35bb552a-b8fc-462a-a70c-f7651df513bf tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:41.287477 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-35bb552a-b8fc-462a-a70c-f7651df513bf tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808" status: 200 len: 1472 microversion: 2.1 time: 0.348800 Sep 08 10:38:41.298086 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 274/529] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:40 2022] GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808 => generated 1472 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:41.309368 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d3a31c4b-f6ba-48b4-b0cb-7923920619d2 tempest-ServersOnMultiNodesTest-60601867 tempest-ServersOnMultiNodesTest-60601867-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:41.313569 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d3a31c4b-f6ba-48b4-b0cb-7923920619d2 tempest-ServersOnMultiNodesTest-60601867 tempest-ServersOnMultiNodesTest-60601867-project-admin] [instance: d32351b1-7fc7-4ce4-846d-16add998d5ab] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:41.330080 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d3a31c4b-f6ba-48b4-b0cb-7923920619d2 tempest-ServersOnMultiNodesTest-60601867 tempest-ServersOnMultiNodesTest-60601867-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:41.331490 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d3a31c4b-f6ba-48b4-b0cb-7923920619d2 tempest-ServersOnMultiNodesTest-60601867 tempest-ServersOnMultiNodesTest-60601867-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:41.332269 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d3a31c4b-f6ba-48b4-b0cb-7923920619d2 tempest-ServersOnMultiNodesTest-60601867 tempest-ServersOnMultiNodesTest-60601867-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:41.337006 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d3a31c4b-f6ba-48b4-b0cb-7923920619d2 tempest-ServersOnMultiNodesTest-60601867 tempest-ServersOnMultiNodesTest-60601867-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:41.337798 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d3a31c4b-f6ba-48b4-b0cb-7923920619d2 tempest-ServersOnMultiNodesTest-60601867 tempest-ServersOnMultiNodesTest-60601867-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:41.338397 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d3a31c4b-f6ba-48b4-b0cb-7923920619d2 tempest-ServersOnMultiNodesTest-60601867 tempest-ServersOnMultiNodesTest-60601867-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:41.508316 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-02cba5a3-e7d0-4909-a863-8ee41f8a1de1 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/ec8a85b1-636c-4699-8042-4dbefbc881f3" status: 200 len: 1646 microversion: 2.1 time: 0.520586 Sep 08 10:38:41.540237 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 256/530] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:40 2022] GET /compute/v2.1/servers/ec8a85b1-636c-4699-8042-4dbefbc881f3 => generated 1646 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:41.568186 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ed480ecd-73c6-4939-a335-bf96dad899c4 tempest-HypervisorAdminNegativeTestJSON-424354540 tempest-HypervisorAdminNegativeTestJSON-424354540-project] Calling method '.version_select at 0x7f68e4d23790>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:41.576271 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ed480ecd-73c6-4939-a335-bf96dad899c4 tempest-HypervisorAdminNegativeTestJSON-424354540 tempest-HypervisorAdminNegativeTestJSON-424354540-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'cd9356dc7b734ce2a0c072a07f46b7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d753c438f04776b9bd5b3011bc4638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:41.582840 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ed480ecd-73c6-4939-a335-bf96dad899c4 tempest-HypervisorAdminNegativeTestJSON-424354540 tempest-HypervisorAdminNegativeTestJSON-424354540-project] Request method failure captured: Sep 08 10:38:41.582840 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Sep 08 10:38:41.582840 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:38:41.582840 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:38:41.582840 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:38:41.582840 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:38:41.582840 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:38:41.582840 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:38:41.582840 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:38:41.582840 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:38:41.582840 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcYrXj84WVvhHP-nqpecy-saLhTLra-_zJ0VFCey5Z9LaDbcdTFsLR3L40qCOQZ-A7XmuiCJuwYASJzek5_j8YAzUFEFsnGhLK73kLmeXHqWJOUP6lAbEU86CQk828WIuu84ptQgfQ_d9kJuP3rk9wCj0iaMmfVRKpLCmghmjbyFEzI Sep 08 10:38:41.582840 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:38:41.582840 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:38:41.582840 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:38:41.582840 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:38:41.582840 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:38:41.582840 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:38:41.582840 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: d6d753c438f04776b9bd5b3011bc4638 Sep 08 10:38:41.582840 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-424354540 Sep 08 10:38:41.582840 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:38:41.582840 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:38:41.584189 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d6d753c438f04776b9bd5b3011bc4638"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d6d753c438f04776b9bd5b3011bc4638"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d6d753c438f04776b9bd5b3011bc4638"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d6d753c438f04776b9bd5b3011bc4638"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:38:41.584189 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-424354540 Sep 08 10:38:41.584189 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: d6d753c438f04776b9bd5b3011bc4638 Sep 08 10:38:41.584189 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-424354540 Sep 08 10:38:41.584189 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-HypervisorAdminNegativeTestJSON-424354540-project Sep 08 10:38:41.584189 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:38:41.584189 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:38:41.584189 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: cd9356dc7b734ce2a0c072a07f46b7d8 Sep 08 10:38:41.584189 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-424354540-project Sep 08 10:38:41.584189 n-d-850501-12 devstack@n-api.service[128861]: method: Sep 08 10:38:41.584189 n-d-850501-12 devstack@n-api.service[128861]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Sep 08 10:38:41.584189 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '1'} Sep 08 10:38:41.584189 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:38:41.584993 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:38:41.584993 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:38:41.584993 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:38:41.584993 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:38:41.584993 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:38:41.584993 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:38:41.584993 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:38:41.584993 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:38:41.584993 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:38:41.584993 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Sep 08 10:38:41.584993 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self._show(req, id) Sep 08 10:38:41.584993 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Sep 08 10:38:41.584993 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Sep 08 10:38:41.584993 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 10:38:41.584993 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 10:38:41.584993 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 10:38:41.584993 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 10:38:41.584993 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:38:41.584993 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:38:41.586154 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:38:41.586154 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:38:41.586154 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 10:38:41.586154 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 10:38:41.586154 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 10:38:41.586154 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 10:38:41.586154 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 10:38:41.586154 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 10:38:41.586154 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Sep 08 10:38:41.586154 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:38:41.586154 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:38:41.586154 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:38:41.586154 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:38:41.586154 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:38:41.586154 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:38:41.586154 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 10:38:41.586154 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 10:38:41.586154 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Sep 08 10:38:41.586154 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:38:41.599579 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ed480ecd-73c6-4939-a335-bf96dad899c4 tempest-HypervisorAdminNegativeTestJSON-424354540 tempest-HypervisorAdminNegativeTestJSON-424354540-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:38:41.600735 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ed480ecd-73c6-4939-a335-bf96dad899c4 tempest-HypervisorAdminNegativeTestJSON-424354540 tempest-HypervisorAdminNegativeTestJSON-424354540-project] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.058956 Sep 08 10:38:41.603422 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 257/531] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Sep 8 10:38:41 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 62 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:38:41.615293 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-64749131-3ae9-4a62-87e6-6297a5df632c tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:41.634592 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-64749131-3ae9-4a62-87e6-6297a5df632c tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] [instance: bc3d77c9-40f4-4f37-9717-9c11e724e637] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:41.667883 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64749131-3ae9-4a62-87e6-6297a5df632c tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:41.670475 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64749131-3ae9-4a62-87e6-6297a5df632c tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:41.671352 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64749131-3ae9-4a62-87e6-6297a5df632c tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:41.674457 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64749131-3ae9-4a62-87e6-6297a5df632c tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:41.675282 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64749131-3ae9-4a62-87e6-6297a5df632c tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:41.675941 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64749131-3ae9-4a62-87e6-6297a5df632c tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:41.973954 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-64749131-3ae9-4a62-87e6-6297a5df632c tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9913da38392048c897ada11a1ac5e6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b3414c389540e7a35f03809b064d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:41.998757 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-64749131-3ae9-4a62-87e6-6297a5df632c tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] 10.222.0.27 "GET /compute/v2.1/servers/bc3d77c9-40f4-4f37-9717-9c11e724e637" status: 200 len: 1323 microversion: 2.1 time: 0.392104 Sep 08 10:38:42.000648 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 258/532] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:41 2022] GET /compute/v2.1/servers/bc3d77c9-40f4-4f37-9717-9c11e724e637 => generated 1323 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:42.007048 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-045b352d-4c84-4caa-acca-23a7a7860630 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:42.007843 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-045b352d-4c84-4caa-acca-23a7a7860630 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] [instance: 1a01253b-8ff8-44d9-961b-1b91de83d671] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:42.019363 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-045b352d-4c84-4caa-acca-23a7a7860630 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:42.020127 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-045b352d-4c84-4caa-acca-23a7a7860630 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:42.020736 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-045b352d-4c84-4caa-acca-23a7a7860630 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:42.021676 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-045b352d-4c84-4caa-acca-23a7a7860630 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:42.022298 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-045b352d-4c84-4caa-acca-23a7a7860630 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:42.023022 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-045b352d-4c84-4caa-acca-23a7a7860630 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:42.171788 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-045b352d-4c84-4caa-acca-23a7a7860630 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4cde361139445eb147c4f634ec663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5388c25cdb4a35ae8d58fa5b6cf125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:42.190935 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-045b352d-4c84-4caa-acca-23a7a7860630 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] 10.222.0.27 "GET /compute/v2.1/servers/1a01253b-8ff8-44d9-961b-1b91de83d671" status: 200 len: 1321 microversion: 2.1 time: 0.188358 Sep 08 10:38:42.191377 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 259/533] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:42 2022] GET /compute/v2.1/servers/1a01253b-8ff8-44d9-961b-1b91de83d671 => generated 1321 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:42.197831 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cb2c5a43-0c1f-4ccc-b126-7638360b3d90 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:42.198856 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cb2c5a43-0c1f-4ccc-b126-7638360b3d90 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] [instance: ec8a85b1-636c-4699-8042-4dbefbc881f3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:42.207687 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb2c5a43-0c1f-4ccc-b126-7638360b3d90 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:42.208296 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb2c5a43-0c1f-4ccc-b126-7638360b3d90 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:42.208886 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb2c5a43-0c1f-4ccc-b126-7638360b3d90 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:42.209737 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb2c5a43-0c1f-4ccc-b126-7638360b3d90 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:42.210346 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb2c5a43-0c1f-4ccc-b126-7638360b3d90 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:42.211524 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb2c5a43-0c1f-4ccc-b126-7638360b3d90 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:42.336990 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d3a31c4b-f6ba-48b4-b0cb-7923920619d2 tempest-ServersOnMultiNodesTest-60601867 tempest-ServersOnMultiNodesTest-60601867-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/d32351b1-7fc7-4ce4-846d-16add998d5ab" status: 200 len: 1622 microversion: 2.1 time: 1.028159 Sep 08 10:38:42.338855 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 275/534] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:41 2022] GET /compute/v2.1/servers/d32351b1-7fc7-4ce4-846d-16add998d5ab => generated 1622 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:42.400943 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-df342597-5299-4fbe-ac43-3f86bb784ab1 tempest-HypervisorAdminNegativeTestJSON-673992683 tempest-HypervisorAdminNegativeTestJSON-673992683-project-admin] Calling method '.version_select at 0x7f68e4d4d820>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:42.405571 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-df342597-5299-4fbe-ac43-3f86bb784ab1 tempest-HypervisorAdminNegativeTestJSON-673992683 tempest-HypervisorAdminNegativeTestJSON-673992683-project-admin] HTTP exception thrown: Hypervisor with ID '05239062-d14f-45b8-a628-ade6768a6cf1' could not be found. Sep 08 10:38:42.409928 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-df342597-5299-4fbe-ac43-3f86bb784ab1 tempest-HypervisorAdminNegativeTestJSON-673992683 tempest-HypervisorAdminNegativeTestJSON-673992683-project-admin] Request method failure captured: Sep 08 10:38:42.409928 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/os-hypervisors/05239062-d14f-45b8-a628-ade6768a6cf1 HTTP/1.1 Sep 08 10:38:42.409928 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:38:42.409928 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:38:42.409928 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:38:42.409928 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:38:42.409928 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:38:42.409928 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:38:42.409928 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:38:42.409928 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:38:42.409928 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcYt0kydPSizKFPxtgfQRccosw2_Z40fPh1zpZVwTW_jKuU0ISyhU_vUeDs10givHT5rTJvYE3sAr0muiPZk2HOVf-baRa6nmek0l6ZacrUoiJRC3kMTHBO2S3I7KuCl-3MjTcmT8m6d5XDVPyeTtMHnpH2T7nTLS6vTNowuJa-k3KE Sep 08 10:38:42.409928 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:38:42.409928 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:38:42.409928 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:38:42.409928 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:38:42.409928 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:38:42.409928 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:38:42.409928 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 3a17c1c9a10b466a9eccdd7a25931e1e Sep 08 10:38:42.409928 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-673992683 Sep 08 10:38:42.409928 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,admin,member Sep 08 10:38:42.409928 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,admin,member Sep 08 10:38:42.412414 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3a17c1c9a10b466a9eccdd7a25931e1e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3a17c1c9a10b466a9eccdd7a25931e1e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3a17c1c9a10b466a9eccdd7a25931e1e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3a17c1c9a10b466a9eccdd7a25931e1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:38:42.412414 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-673992683 Sep 08 10:38:42.412414 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 3a17c1c9a10b466a9eccdd7a25931e1e Sep 08 10:38:42.412414 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-673992683 Sep 08 10:38:42.412414 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-HypervisorAdminNegativeTestJSON-673992683-project-admin Sep 08 10:38:42.412414 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:38:42.412414 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:38:42.412414 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 4230ec38482a41b89e69b061532523e6 Sep 08 10:38:42.412414 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-673992683-project-admin Sep 08 10:38:42.412414 n-d-850501-12 devstack@n-api.service[128862]: method: Sep 08 10:38:42.412414 n-d-850501-12 devstack@n-api.service[128862]: exception: Hypervisor with ID '05239062-d14f-45b8-a628-ade6768a6cf1' could not be found. Sep 08 10:38:42.412414 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '05239062-d14f-45b8-a628-ade6768a6cf1'} Sep 08 10:38:42.413855 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:38:42.413855 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:38:42.413855 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Sep 08 10:38:42.413855 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi value = int(str(value)) Sep 08 10:38:42.413855 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '05239062-d14f-45b8-a628-ade6768a6cf1' Sep 08 10:38:42.413855 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:38:42.413855 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:38:42.413855 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:38:42.413855 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:38:42.413855 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Sep 08 10:38:42.413855 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Sep 08 10:38:42.413855 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Sep 08 10:38:42.413855 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Sep 08 10:38:42.413855 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Sep 08 10:38:42.413855 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:38:42.413855 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:38:42.413855 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:38:42.413855 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:38:42.413855 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Sep 08 10:38:42.413855 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Sep 08 10:38:42.413855 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Sep 08 10:38:42.413855 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Sep 08 10:38:42.418403 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Sep 08 10:38:42.418403 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:38:42.418403 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:38:42.418403 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:38:42.418403 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:38:42.418403 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:38:42.418403 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:38:42.418403 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:38:42.418403 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:38:42.418403 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:38:42.418403 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:38:42.418403 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:38:42.418403 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:38:42.418403 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Sep 08 10:38:42.418403 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._show(req, id) Sep 08 10:38:42.418403 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Sep 08 10:38:42.418403 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Sep 08 10:38:42.418403 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Sep 08 10:38:42.418403 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 08 10:38:42.418403 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '05239062-d14f-45b8-a628-ade6768a6cf1' could not be found. Sep 08 10:38:42.426598 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:38:42.426598 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:38:42.426598 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:38:42.426598 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:38:42.426598 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:38:42.426598 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:38:42.426598 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:38:42.426598 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:38:42.426598 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '05239062-d14f-45b8-a628-ade6768a6cf1' could not be found. Sep 08 10:38:42.426598 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:38:42.426598 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-df342597-5299-4fbe-ac43-3f86bb784ab1 tempest-HypervisorAdminNegativeTestJSON-673992683 tempest-HypervisorAdminNegativeTestJSON-673992683-project-admin] Returning 404 to user: Hypervisor with ID '05239062-d14f-45b8-a628-ade6768a6cf1' could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:38:42.426598 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-df342597-5299-4fbe-ac43-3f86bb784ab1 tempest-HypervisorAdminNegativeTestJSON-673992683 tempest-HypervisorAdminNegativeTestJSON-673992683-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/05239062-d14f-45b8-a628-ade6768a6cf1" status: 404 len: 123 microversion: 2.1 time: 0.031022 Sep 08 10:38:42.426598 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 276/535] 10.222.0.27 () {58 vars in 1257 bytes} [Thu Sep 8 10:38:42 2022] GET /compute/v2.1/os-hypervisors/05239062-d14f-45b8-a628-ade6768a6cf1 => generated 123 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:38:42.429458 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3b68969e-4266-4351-a551-905b6c9a54e1 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:42.429458 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3b68969e-4266-4351-a551-905b6c9a54e1 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 422ceb5f-740f-45e5-9596-6796719adf27] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:42.447452 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b68969e-4266-4351-a551-905b6c9a54e1 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:42.448359 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b68969e-4266-4351-a551-905b6c9a54e1 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:42.449228 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b68969e-4266-4351-a551-905b6c9a54e1 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:42.452921 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b68969e-4266-4351-a551-905b6c9a54e1 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:42.453984 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b68969e-4266-4351-a551-905b6c9a54e1 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:42.456706 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b68969e-4266-4351-a551-905b6c9a54e1 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:42.528052 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cb2c5a43-0c1f-4ccc-b126-7638360b3d90 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/ec8a85b1-636c-4699-8042-4dbefbc881f3" status: 200 len: 1646 microversion: 2.1 time: 0.335201 Sep 08 10:38:42.537230 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 260/536] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:42 2022] GET /compute/v2.1/servers/ec8a85b1-636c-4699-8042-4dbefbc881f3 => generated 1646 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:42.569352 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3d9c9f46-c5f3-4e88-b222-1237bcb9295e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:42.570800 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3d9c9f46-c5f3-4e88-b222-1237bcb9295e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 815705bc-e49e-47a1-864b-9cc550464808] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:42.598784 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3d9c9f46-c5f3-4e88-b222-1237bcb9295e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:42.599290 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3d9c9f46-c5f3-4e88-b222-1237bcb9295e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:42.599729 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3d9c9f46-c5f3-4e88-b222-1237bcb9295e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:42.600449 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3d9c9f46-c5f3-4e88-b222-1237bcb9295e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:42.600909 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3d9c9f46-c5f3-4e88-b222-1237bcb9295e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:42.601360 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3d9c9f46-c5f3-4e88-b222-1237bcb9295e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:42.618233 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=100 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:38:43.304859 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-3d9c9f46-c5f3-4e88-b222-1237bcb9295e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:43.308705 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3b68969e-4266-4351-a551-905b6c9a54e1 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:43.318594 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:38:43.322978 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3b68969e-4266-4351-a551-905b6c9a54e1 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:43.324167 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3d9c9f46-c5f3-4e88-b222-1237bcb9295e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808" status: 200 len: 1472 microversion: 2.1 time: 0.784927 Sep 08 10:38:43.324863 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3b68969e-4266-4351-a551-905b6c9a54e1 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:43.326183 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 261/537] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:42 2022] GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808 => generated 1472 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:43.327931 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3b68969e-4266-4351-a551-905b6c9a54e1 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/422ceb5f-740f-45e5-9596-6796719adf27" status: 200 len: 1360 microversion: 2.25 time: 0.909885 Sep 08 10:38:43.329055 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 277/538] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:38:42 2022] GET /compute/v2.1/servers/422ceb5f-740f-45e5-9596-6796719adf27 => generated 1360 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:38:43.331937 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b6d4fe94-41ad-46e4-9d7d-390559dd3974 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Action: 'create', calling method: .version_select at 0x7f68e4ec3ca0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1858622044", "policies": ["anti-affinity"]}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:38:43.352748 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-670fca0d-1b61-44bd-a42b-16f389d9a305 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:43.356638 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-b6d4fe94-41ad-46e4-9d7d-390559dd3974 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Getting quotas for project 2a3d4a2ec8674e418602b6dc0cec6ab9. Resources: {'server_groups'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:38:43.363434 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-b6d4fe94-41ad-46e4-9d7d-390559dd3974 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Getting quotas for user 771c067cf6814084a5520128a970dc82 and project 2a3d4a2ec8674e418602b6dc0cec6ab9. Resources: {'server_groups'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:38:43.380192 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-670fca0d-1b61-44bd-a42b-16f389d9a305 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:43.384172 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-670fca0d-1b61-44bd-a42b-16f389d9a305 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:43.386470 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-670fca0d-1b61-44bd-a42b-16f389d9a305 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:43.387558 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-670fca0d-1b61-44bd-a42b-16f389d9a305 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:43.388695 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-670fca0d-1b61-44bd-a42b-16f389d9a305 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:43.391191 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-670fca0d-1b61-44bd-a42b-16f389d9a305 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:43.463108 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-b6d4fe94-41ad-46e4-9d7d-390559dd3974 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Getting quotas for project 2a3d4a2ec8674e418602b6dc0cec6ab9. Resources: {'server_groups'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:38:43.469943 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-b6d4fe94-41ad-46e4-9d7d-390559dd3974 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Getting quotas for user 771c067cf6814084a5520128a970dc82 and project 2a3d4a2ec8674e418602b6dc0cec6ab9. Resources: {'server_groups'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:38:43.474435 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-670fca0d-1b61-44bd-a42b-16f389d9a305 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.142227 Sep 08 10:38:43.476304 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 278/539] 10.222.0.27 () {58 vars in 1176 bytes} [Thu Sep 8 10:38:43 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:38:43.489799 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1dc3a218-9ca4-4597-ad2e-9968c7d08c69 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:43.490385 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b6d4fe94-41ad-46e4-9d7d-390559dd3974 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.162385 Sep 08 10:38:43.502502 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1dc3a218-9ca4-4597-ad2e-9968c7d08c69 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] [instance: bc3d77c9-40f4-4f37-9717-9c11e724e637] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:43.503190 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 262/540] 10.222.0.27 () {60 vars in 1174 bytes} [Thu Sep 8 10:38:43 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:38:43.503190 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a95150bf-bbbb-4fba-96bc-c2b2442c67fb tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:43.503190 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a95150bf-bbbb-4fba-96bc-c2b2442c67fb tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] [instance: 1a01253b-8ff8-44d9-961b-1b91de83d671] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:43.521228 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a95150bf-bbbb-4fba-96bc-c2b2442c67fb tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:43.522001 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a95150bf-bbbb-4fba-96bc-c2b2442c67fb tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:43.522668 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a95150bf-bbbb-4fba-96bc-c2b2442c67fb tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:43.523761 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a95150bf-bbbb-4fba-96bc-c2b2442c67fb tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:43.524435 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a95150bf-bbbb-4fba-96bc-c2b2442c67fb tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:43.525114 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a95150bf-bbbb-4fba-96bc-c2b2442c67fb tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:43.526508 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1dc3a218-9ca4-4597-ad2e-9968c7d08c69 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:43.541374 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1dc3a218-9ca4-4597-ad2e-9968c7d08c69 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:43.554896 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1dc3a218-9ca4-4597-ad2e-9968c7d08c69 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:43.565664 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1dc3a218-9ca4-4597-ad2e-9968c7d08c69 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:43.566220 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1dc3a218-9ca4-4597-ad2e-9968c7d08c69 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:43.569056 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1dc3a218-9ca4-4597-ad2e-9968c7d08c69 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:43.738856 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a95150bf-bbbb-4fba-96bc-c2b2442c67fb tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4cde361139445eb147c4f634ec663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5388c25cdb4a35ae8d58fa5b6cf125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:43.750157 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a95150bf-bbbb-4fba-96bc-c2b2442c67fb tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] 10.222.0.27 "GET /compute/v2.1/servers/1a01253b-8ff8-44d9-961b-1b91de83d671" status: 200 len: 1321 microversion: 2.1 time: 0.256581 Sep 08 10:38:43.751957 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 263/541] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:43 2022] GET /compute/v2.1/servers/1a01253b-8ff8-44d9-961b-1b91de83d671 => generated 1321 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:43.759785 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-375eaf46-bfc2-4ba0-aad1-fabca7ea2e83 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-850501-12", "block_migration": true, "disk_over_commit": false}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:38:43.764775 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-375eaf46-bfc2-4ba0-aad1-fabca7ea2e83 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] [instance: ec8a85b1-636c-4699-8042-4dbefbc881f3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:43.774758 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-375eaf46-bfc2-4ba0-aad1-fabca7ea2e83 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:43.776335 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-375eaf46-bfc2-4ba0-aad1-fabca7ea2e83 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:43.777438 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-375eaf46-bfc2-4ba0-aad1-fabca7ea2e83 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:43.778664 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-375eaf46-bfc2-4ba0-aad1-fabca7ea2e83 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:43.779646 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-375eaf46-bfc2-4ba0-aad1-fabca7ea2e83 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:43.780630 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-375eaf46-bfc2-4ba0-aad1-fabca7ea2e83 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:43.818160 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-375eaf46-bfc2-4ba0-aad1-fabca7ea2e83 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lazy-loading 'flavor' on Instance uuid ec8a85b1-636c-4699-8042-4dbefbc881f3 {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:38:43.834651 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-375eaf46-bfc2-4ba0-aad1-fabca7ea2e83 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] [instance: ec8a85b1-636c-4699-8042-4dbefbc881f3] Going to try to live migrate instance to n-h2-850501-12 {{(pid=128861) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 08 10:38:43.852775 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=94 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:38:44.549584 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1dc3a218-9ca4-4597-ad2e-9968c7d08c69 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9913da38392048c897ada11a1ac5e6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b3414c389540e7a35f03809b064d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:44.563088 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1dc3a218-9ca4-4597-ad2e-9968c7d08c69 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] 10.222.0.27 "GET /compute/v2.1/servers/bc3d77c9-40f4-4f37-9717-9c11e724e637" status: 200 len: 1473 microversion: 2.1 time: 1.084219 Sep 08 10:38:44.577053 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 279/542] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:43 2022] GET /compute/v2.1/servers/bc3d77c9-40f4-4f37-9717-9c11e724e637 => generated 1473 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:44.587520 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-04d94207-8fe8-42ab-8513-f9ad54522d2a tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-324004240", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "bf93089d-19b3-4149-bb6d-266993d8a421"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:38:44.658515 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-04d94207-8fe8-42ab-8513-f9ad54522d2a tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] validate_networks() for None {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:38:45.788221 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-04d94207-8fe8-42ab-8513-f9ad54522d2a tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:38:45.789493 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-04d94207-8fe8-42ab-8513-f9ad54522d2a tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:38:45.790623 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-04d94207-8fe8-42ab-8513-f9ad54522d2a tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:38:45.791327 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-04d94207-8fe8-42ab-8513-f9ad54522d2a tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:38:45.792178 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-04d94207-8fe8-42ab-8513-f9ad54522d2a tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:38:45.814854 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04d94207-8fe8-42ab-8513-f9ad54522d2a tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:45.815706 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04d94207-8fe8-42ab-8513-f9ad54522d2a tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:45.816401 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04d94207-8fe8-42ab-8513-f9ad54522d2a tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:45.817272 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04d94207-8fe8-42ab-8513-f9ad54522d2a tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:45.817952 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04d94207-8fe8-42ab-8513-f9ad54522d2a tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:45.818619 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04d94207-8fe8-42ab-8513-f9ad54522d2a tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:45.838102 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-04d94207-8fe8-42ab-8513-f9ad54522d2a tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Getting quotas for project 2a3d4a2ec8674e418602b6dc0cec6ab9. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:38:45.843923 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-04d94207-8fe8-42ab-8513-f9ad54522d2a tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Getting quotas for user 771c067cf6814084a5520128a970dc82 and project 2a3d4a2ec8674e418602b6dc0cec6ab9. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:38:45.858821 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-04d94207-8fe8-42ab-8513-f9ad54522d2a tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Going to run 2 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:38:45.861573 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-04d94207-8fe8-42ab-8513-f9ad54522d2a tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: 493cd490-27c5-4e08-a789-767757111cb2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:38:45.931932 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-04d94207-8fe8-42ab-8513-f9ad54522d2a tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Getting quotas for project 2a3d4a2ec8674e418602b6dc0cec6ab9. Resources: {'server_group_members'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:38:45.938805 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-04d94207-8fe8-42ab-8513-f9ad54522d2a tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Getting quotas for user 771c067cf6814084a5520128a970dc82 and project 2a3d4a2ec8674e418602b6dc0cec6ab9. Resources: {'server_group_members'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:38:46.004333 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-04d94207-8fe8-42ab-8513-f9ad54522d2a tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Getting quotas for project 2a3d4a2ec8674e418602b6dc0cec6ab9. Resources: {'server_group_members'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:38:46.012563 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-04d94207-8fe8-42ab-8513-f9ad54522d2a tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Getting quotas for user 771c067cf6814084a5520128a970dc82 and project 2a3d4a2ec8674e418602b6dc0cec6ab9. Resources: {'server_group_members'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:38:46.035288 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-04d94207-8fe8-42ab-8513-f9ad54522d2a tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: 83037cf6-4a7d-4ba8-8ecb-469feb7598b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=493cd490-27c5-4e08-a789-767757111cb2,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:38:46.109524 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-04d94207-8fe8-42ab-8513-f9ad54522d2a tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Getting quotas for project 2a3d4a2ec8674e418602b6dc0cec6ab9. Resources: {'server_group_members'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:38:46.114096 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-04d94207-8fe8-42ab-8513-f9ad54522d2a tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Getting quotas for user 771c067cf6814084a5520128a970dc82 and project 2a3d4a2ec8674e418602b6dc0cec6ab9. Resources: {'server_group_members'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:38:46.154991 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:38:46.169334 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-04d94207-8fe8-42ab-8513-f9ad54522d2a tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Getting quotas for project 2a3d4a2ec8674e418602b6dc0cec6ab9. Resources: {'server_group_members'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:38:46.177354 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-04d94207-8fe8-42ab-8513-f9ad54522d2a tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Getting quotas for user 771c067cf6814084a5520128a970dc82 and project 2a3d4a2ec8674e418602b6dc0cec6ab9. Resources: {'server_group_members'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:38:46.225526 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-04d94207-8fe8-42ab-8513-f9ad54522d2a tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.654272 Sep 08 10:38:46.231071 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 280/543] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:38:44 2022] POST /compute/v2.1/servers => generated 32 bytes in 1656 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Sep 08 10:38:46.236198 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-1a849586-3aee-44ab-8cde-a34f321b1f15 req-4c52500c-2981-4c50-9c36-84d997de7bd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "422ceb5f-740f-45e5-9596-6796719adf27", "name": "network-vif-plugged", "status": "completed", "tag": "9dcf1823-c8b6-4d30-88b4-559bc9d90002"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:38:46.247262 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-1a849586-3aee-44ab-8cde-a34f321b1f15 req-4c52500c-2981-4c50-9c36-84d997de7bd2 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:46.247858 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-1a849586-3aee-44ab-8cde-a34f321b1f15 req-4c52500c-2981-4c50-9c36-84d997de7bd2 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:46.249759 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-1a849586-3aee-44ab-8cde-a34f321b1f15 req-4c52500c-2981-4c50-9c36-84d997de7bd2 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:46.269485 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-1a849586-3aee-44ab-8cde-a34f321b1f15 req-4c52500c-2981-4c50-9c36-84d997de7bd2 service nova] Creating event network-vif-plugged:9dcf1823-c8b6-4d30-88b4-559bc9d90002 for instance 422ceb5f-740f-45e5-9596-6796719adf27 on n-h1-850501-12 Sep 08 10:38:46.280714 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-1a849586-3aee-44ab-8cde-a34f321b1f15 req-4c52500c-2981-4c50-9c36-84d997de7bd2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051092 Sep 08 10:38:46.282679 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 281/544] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:38:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:38:46.296008 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-91a2c61c-9300-493d-935a-dd72239f4508 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:46.298686 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-91a2c61c-9300-493d-935a-dd72239f4508 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 815705bc-e49e-47a1-864b-9cc550464808] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:46.309873 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-91a2c61c-9300-493d-935a-dd72239f4508 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:46.310528 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-91a2c61c-9300-493d-935a-dd72239f4508 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:46.311156 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-91a2c61c-9300-493d-935a-dd72239f4508 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:46.312235 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-91a2c61c-9300-493d-935a-dd72239f4508 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:46.312709 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-91a2c61c-9300-493d-935a-dd72239f4508 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:46.313165 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-91a2c61c-9300-493d-935a-dd72239f4508 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:46.616397 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-375eaf46-bfc2-4ba0-aad1-fabca7ea2e83 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/ec8a85b1-636c-4699-8042-4dbefbc881f3/action" status: 202 len: 0 microversion: 2.1 time: 2.859105 Sep 08 10:38:46.616397 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 264/545] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:38:43 2022] POST /compute/v2.1/servers/ec8a85b1-636c-4699-8042-4dbefbc881f3/action => generated 0 bytes in 2861 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:38:46.626035 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7d75d9c2-f521-462c-aa04-4255d0bee33a tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:46.626584 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7d75d9c2-f521-462c-aa04-4255d0bee33a tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 422ceb5f-740f-45e5-9596-6796719adf27] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:46.633395 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7d75d9c2-f521-462c-aa04-4255d0bee33a tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:46.633895 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7d75d9c2-f521-462c-aa04-4255d0bee33a tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:46.634336 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7d75d9c2-f521-462c-aa04-4255d0bee33a tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:46.635728 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7d75d9c2-f521-462c-aa04-4255d0bee33a tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:46.636200 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7d75d9c2-f521-462c-aa04-4255d0bee33a tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:46.636631 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7d75d9c2-f521-462c-aa04-4255d0bee33a tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:46.834787 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-91a2c61c-9300-493d-935a-dd72239f4508 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:46.850097 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-91a2c61c-9300-493d-935a-dd72239f4508 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808" status: 200 len: 1477 microversion: 2.1 time: 0.565592 Sep 08 10:38:46.854119 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7d75d9c2-f521-462c-aa04-4255d0bee33a tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:46.858985 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 282/546] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:46 2022] GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808 => generated 1477 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:46.870841 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-df56486f-95e5-41ac-b2a0-835fc578f09e tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:46.872284 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-df56486f-95e5-41ac-b2a0-835fc578f09e tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] [instance: bc3d77c9-40f4-4f37-9717-9c11e724e637] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:46.875563 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7d75d9c2-f521-462c-aa04-4255d0bee33a tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:46.878672 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7d75d9c2-f521-462c-aa04-4255d0bee33a tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:46.880568 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7d75d9c2-f521-462c-aa04-4255d0bee33a tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/422ceb5f-740f-45e5-9596-6796719adf27" status: 200 len: 1360 microversion: 2.25 time: 0.265827 Sep 08 10:38:46.893833 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 265/547] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:38:46 2022] GET /compute/v2.1/servers/422ceb5f-740f-45e5-9596-6796719adf27 => generated 1360 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:38:46.901056 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df56486f-95e5-41ac-b2a0-835fc578f09e tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:46.901913 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df56486f-95e5-41ac-b2a0-835fc578f09e tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:46.903063 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df56486f-95e5-41ac-b2a0-835fc578f09e tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:46.905220 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df56486f-95e5-41ac-b2a0-835fc578f09e tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:46.915578 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df56486f-95e5-41ac-b2a0-835fc578f09e tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:46.916848 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df56486f-95e5-41ac-b2a0-835fc578f09e tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:46.921063 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-06a80240-7bd2-49e8-861c-49e96bc4608c tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:46.922325 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-06a80240-7bd2-49e8-861c-49e96bc4608c tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] [instance: 1a01253b-8ff8-44d9-961b-1b91de83d671] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:46.940535 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06a80240-7bd2-49e8-861c-49e96bc4608c tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:46.942959 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06a80240-7bd2-49e8-861c-49e96bc4608c tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:46.944632 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06a80240-7bd2-49e8-861c-49e96bc4608c tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:46.945482 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06a80240-7bd2-49e8-861c-49e96bc4608c tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:46.945969 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06a80240-7bd2-49e8-861c-49e96bc4608c tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:46.946434 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06a80240-7bd2-49e8-861c-49e96bc4608c tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:47.109891 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-df56486f-95e5-41ac-b2a0-835fc578f09e tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '9913da38392048c897ada11a1ac5e6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b3414c389540e7a35f03809b064d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:47.112993 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-df56486f-95e5-41ac-b2a0-835fc578f09e tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Request method failure captured: Sep 08 10:38:47.112993 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/bc3d77c9-40f4-4f37-9717-9c11e724e637/diagnostics HTTP/1.1 Sep 08 10:38:47.112993 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:38:47.112993 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:38:47.112993 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:38:47.112993 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:38:47.112993 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:38:47.112993 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:38:47.112993 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:38:47.112993 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:38:47.112993 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcYVCUAH6efNaigTRd1TJ-MPK5-X4RTjiPZGzxo5bWXIK_7o8ZI8CQ7tY0YwoXLpuo-ZimvobYGNyRPjejFzI2xNPyMESE2BAWsKI4DB3cGzRRhngORF_7bLimajiSjRQKAWf_GCg8hgzVivBoc9WaFvyyX985rhsfT2cQH6XgQVYGU Sep 08 10:38:47.112993 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:38:47.112993 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:38:47.112993 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:38:47.112993 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:38:47.112993 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:38:47.112993 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:38:47.112993 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 49b3414c389540e7a35f03809b064d03 Sep 08 10:38:47.112993 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-959287831 Sep 08 10:38:47.112993 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:38:47.112993 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:38:47.115761 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/49b3414c389540e7a35f03809b064d03"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/49b3414c389540e7a35f03809b064d03"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_49b3414c389540e7a35f03809b064d03"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/49b3414c389540e7a35f03809b064d03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:38:47.115761 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-959287831 Sep 08 10:38:47.115761 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 49b3414c389540e7a35f03809b064d03 Sep 08 10:38:47.115761 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-959287831 Sep 08 10:38:47.115761 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServerDiagnosticsNegativeTest-959287831-project Sep 08 10:38:47.115761 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:38:47.115761 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:38:47.115761 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 9913da38392048c897ada11a1ac5e6a8 Sep 08 10:38:47.115761 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-959287831-project Sep 08 10:38:47.115761 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:38:47.115761 n-d-850501-12 devstack@n-api.service[128862]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Sep 08 10:38:47.117263 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'server_id': 'bc3d77c9-40f4-4f37-9717-9c11e724e637'} Sep 08 10:38:47.117263 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:38:47.117263 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:38:47.117263 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:38:47.117263 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:38:47.117263 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:38:47.117263 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:38:47.117263 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:38:47.117263 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:38:47.117263 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Sep 08 10:38:47.117263 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Sep 08 10:38:47.117263 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 10:38:47.117263 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 10:38:47.117263 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 10:38:47.117263 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 10:38:47.117263 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:38:47.117263 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:38:47.117263 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:38:47.117263 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:38:47.117263 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 10:38:47.119551 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 10:38:47.119551 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 10:38:47.119551 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 10:38:47.119551 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 10:38:47.119551 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 10:38:47.119551 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Sep 08 10:38:47.119551 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:38:47.119551 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:38:47.119551 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:38:47.119551 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:38:47.119551 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:38:47.119551 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:38:47.119551 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 10:38:47.119551 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 10:38:47.119551 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Sep 08 10:38:47.119551 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:38:47.119551 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-df56486f-95e5-41ac-b2a0-835fc578f09e tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:38:47.121965 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-df56486f-95e5-41ac-b2a0-835fc578f09e tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] 10.222.0.27 "GET /compute/v2.1/servers/bc3d77c9-40f4-4f37-9717-9c11e724e637/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.249730 Sep 08 10:38:47.121965 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 283/548] 10.222.0.27 () {58 vars in 1272 bytes} [Thu Sep 8 10:38:46 2022] GET /compute/v2.1/servers/bc3d77c9-40f4-4f37-9717-9c11e724e637/diagnostics => generated 117 bytes in 259 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:38:47.128696 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-688c907d-0abc-4257-9626-bd66219d9b8b tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:47.144930 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-688c907d-0abc-4257-9626-bd66219d9b8b tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:47.151654 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-688c907d-0abc-4257-9626-bd66219d9b8b tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Searching by: {'deleted': False, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9'} {{(pid=128862) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:38:47.204054 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-688c907d-0abc-4257-9626-bd66219d9b8b tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:47.204957 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-688c907d-0abc-4257-9626-bd66219d9b8b tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:47.205761 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-688c907d-0abc-4257-9626-bd66219d9b8b tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:47.206647 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-688c907d-0abc-4257-9626-bd66219d9b8b tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:47.207576 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-688c907d-0abc-4257-9626-bd66219d9b8b tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:47.208247 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-688c907d-0abc-4257-9626-bd66219d9b8b tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:47.255803 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-06a80240-7bd2-49e8-861c-49e96bc4608c tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4cde361139445eb147c4f634ec663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5388c25cdb4a35ae8d58fa5b6cf125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:47.267725 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-06a80240-7bd2-49e8-861c-49e96bc4608c tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] 10.222.0.27 "GET /compute/v2.1/servers/1a01253b-8ff8-44d9-961b-1b91de83d671" status: 200 len: 1388 microversion: 2.1 time: 0.358919 Sep 08 10:38:47.281294 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 266/549] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:46 2022] GET /compute/v2.1/servers/1a01253b-8ff8-44d9-961b-1b91de83d671 => generated 1388 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:47.297746 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7b57aeb5-868f-4ea8-a2d4-01ba7d311a06 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:47.299078 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7b57aeb5-868f-4ea8-a2d4-01ba7d311a06 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: ec8a85b1-636c-4699-8042-4dbefbc881f3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:47.309535 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7b57aeb5-868f-4ea8-a2d4-01ba7d311a06 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:47.312383 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7b57aeb5-868f-4ea8-a2d4-01ba7d311a06 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:47.313604 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7b57aeb5-868f-4ea8-a2d4-01ba7d311a06 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:47.327148 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7b57aeb5-868f-4ea8-a2d4-01ba7d311a06 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:47.328178 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7b57aeb5-868f-4ea8-a2d4-01ba7d311a06 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:47.329006 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7b57aeb5-868f-4ea8-a2d4-01ba7d311a06 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:47.503053 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.multi_cell_list [None req-688c907d-0abc-4257-9626-bd66219d9b8b tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Listed batch of 4 results from cell out of 998 limit. Returned 4 total so far. {{(pid=128862) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 10:38:47.721214 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7b57aeb5-868f-4ea8-a2d4-01ba7d311a06 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:47.748744 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7b57aeb5-868f-4ea8-a2d4-01ba7d311a06 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/ec8a85b1-636c-4699-8042-4dbefbc881f3" status: 200 len: 1503 microversion: 2.1 time: 0.461275 Sep 08 10:38:47.751428 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 267/550] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:47 2022] GET /compute/v2.1/servers/ec8a85b1-636c-4699-8042-4dbefbc881f3 => generated 1503 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:47.761859 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-688c907d-0abc-4257-9626-bd66219d9b8b tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 1663 microversion: 2.1 time: 0.641562 Sep 08 10:38:47.769430 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-488ab848-c780-40a1-aac7-747907bb6358 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:47.776254 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 284/551] 10.222.0.27 () {58 vars in 1125 bytes} [Thu Sep 8 10:38:47 2022] GET /compute/v2.1/servers => generated 1663 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:47.777237 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-488ab848-c780-40a1-aac7-747907bb6358 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] [instance: bc3d77c9-40f4-4f37-9717-9c11e724e637] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:47.795771 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-488ab848-c780-40a1-aac7-747907bb6358 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:47.797350 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-488ab848-c780-40a1-aac7-747907bb6358 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:47.799865 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-488ab848-c780-40a1-aac7-747907bb6358 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:47.802814 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-488ab848-c780-40a1-aac7-747907bb6358 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:47.803249 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e255e2a0-6df9-40e8-a163-52ccd84f2e21 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:47.803751 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e255e2a0-6df9-40e8-a163-52ccd84f2e21 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: 83037cf6-4a7d-4ba8-8ecb-469feb7598b8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:47.804752 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-488ab848-c780-40a1-aac7-747907bb6358 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:47.806785 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-488ab848-c780-40a1-aac7-747907bb6358 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:47.878002 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-488ab848-c780-40a1-aac7-747907bb6358 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] [instance: bc3d77c9-40f4-4f37-9717-9c11e724e637] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:38:48.069180 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e255e2a0-6df9-40e8-a163-52ccd84f2e21 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:48.089250 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e255e2a0-6df9-40e8-a163-52ccd84f2e21 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/83037cf6-4a7d-4ba8-8ecb-469feb7598b8" status: 200 len: 1218 microversion: 2.1 time: 0.301006 Sep 08 10:38:48.089250 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 285/552] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:47 2022] GET /compute/v2.1/servers/83037cf6-4a7d-4ba8-8ecb-469feb7598b8 => generated 1218 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:38:48.100054 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5ebdb43e-16b5-49fa-aae5-2bbddb8934a9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:48.100717 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5ebdb43e-16b5-49fa-aae5-2bbddb8934a9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 815705bc-e49e-47a1-864b-9cc550464808] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:48.104313 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-488ab848-c780-40a1-aac7-747907bb6358 tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] 10.222.0.27 "DELETE /compute/v2.1/servers/bc3d77c9-40f4-4f37-9717-9c11e724e637" status: 204 len: 0 microversion: 2.1 time: 0.335216 Sep 08 10:38:48.108022 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 268/553] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:38:47 2022] DELETE /compute/v2.1/servers/bc3d77c9-40f4-4f37-9717-9c11e724e637 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:38:48.118644 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ebdb43e-16b5-49fa-aae5-2bbddb8934a9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:48.119324 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ebdb43e-16b5-49fa-aae5-2bbddb8934a9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:48.123878 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ebdb43e-16b5-49fa-aae5-2bbddb8934a9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:48.128040 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ebdb43e-16b5-49fa-aae5-2bbddb8934a9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:48.129228 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ebdb43e-16b5-49fa-aae5-2bbddb8934a9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:48.129702 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c6ab04b8-a195-451f-8698-54f416ade353 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:48.131247 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c6ab04b8-a195-451f-8698-54f416ade353 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 422ceb5f-740f-45e5-9596-6796719adf27] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:48.132292 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ebdb43e-16b5-49fa-aae5-2bbddb8934a9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:48.159300 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c6ab04b8-a195-451f-8698-54f416ade353 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:48.162219 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c6ab04b8-a195-451f-8698-54f416ade353 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:48.162219 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c6ab04b8-a195-451f-8698-54f416ade353 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:48.165396 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c6ab04b8-a195-451f-8698-54f416ade353 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:48.166677 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c6ab04b8-a195-451f-8698-54f416ade353 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:48.169428 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c6ab04b8-a195-451f-8698-54f416ade353 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:48.593066 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5ebdb43e-16b5-49fa-aae5-2bbddb8934a9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:48.609393 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5ebdb43e-16b5-49fa-aae5-2bbddb8934a9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808" status: 200 len: 1477 microversion: 2.1 time: 0.519636 Sep 08 10:38:48.610774 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 286/554] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:48 2022] GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808 => generated 1477 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:48.617937 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4f5e5028-c354-4439-b3ee-31012753ae9c tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:48.618832 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4f5e5028-c354-4439-b3ee-31012753ae9c tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] [instance: bc3d77c9-40f4-4f37-9717-9c11e724e637] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:48.630659 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f5e5028-c354-4439-b3ee-31012753ae9c tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:48.632642 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f5e5028-c354-4439-b3ee-31012753ae9c tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:48.633878 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f5e5028-c354-4439-b3ee-31012753ae9c tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:48.635862 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f5e5028-c354-4439-b3ee-31012753ae9c tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:48.636926 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f5e5028-c354-4439-b3ee-31012753ae9c tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:48.638467 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f5e5028-c354-4439-b3ee-31012753ae9c tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:48.705547 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c6ab04b8-a195-451f-8698-54f416ade353 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:48.719897 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c6ab04b8-a195-451f-8698-54f416ade353 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:48.725203 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c6ab04b8-a195-451f-8698-54f416ade353 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:48.726125 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c6ab04b8-a195-451f-8698-54f416ade353 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/422ceb5f-740f-45e5-9596-6796719adf27" status: 200 len: 1360 microversion: 2.25 time: 0.616018 Sep 08 10:38:48.750061 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 269/555] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:38:48 2022] GET /compute/v2.1/servers/422ceb5f-740f-45e5-9596-6796719adf27 => generated 1360 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:38:48.758177 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-deb7209b-3c74-4087-a99a-e9b15d96203e tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:48.758794 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-deb7209b-3c74-4087-a99a-e9b15d96203e tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] [instance: 1a01253b-8ff8-44d9-961b-1b91de83d671] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:48.771115 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-deb7209b-3c74-4087-a99a-e9b15d96203e tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:48.771530 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-deb7209b-3c74-4087-a99a-e9b15d96203e tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:48.771815 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-deb7209b-3c74-4087-a99a-e9b15d96203e tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:48.772538 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-deb7209b-3c74-4087-a99a-e9b15d96203e tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:48.772996 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-deb7209b-3c74-4087-a99a-e9b15d96203e tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:48.773576 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-deb7209b-3c74-4087-a99a-e9b15d96203e tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:48.989248 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-deb7209b-3c74-4087-a99a-e9b15d96203e tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4cde361139445eb147c4f634ec663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5388c25cdb4a35ae8d58fa5b6cf125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:49.004183 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-deb7209b-3c74-4087-a99a-e9b15d96203e tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] 10.222.0.27 "GET /compute/v2.1/servers/1a01253b-8ff8-44d9-961b-1b91de83d671" status: 200 len: 1388 microversion: 2.1 time: 0.252856 Sep 08 10:38:49.019147 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 270/556] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:48 2022] GET /compute/v2.1/servers/1a01253b-8ff8-44d9-961b-1b91de83d671 => generated 1388 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:49.019147 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-c4799489-00ce-4bc1-b19b-434ebeb36e09 req-6ec41962-0939-4d57-9748-4c0cd1dadd51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a01253b-8ff8-44d9-961b-1b91de83d671", "tag": "65a6d6d7-af12-4f90-9ea8-61dc9032943b"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:38:49.031781 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-c4799489-00ce-4bc1-b19b-434ebeb36e09 req-6ec41962-0939-4d57-9748-4c0cd1dadd51 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:49.032793 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-c4799489-00ce-4bc1-b19b-434ebeb36e09 req-6ec41962-0939-4d57-9748-4c0cd1dadd51 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:49.033714 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-c4799489-00ce-4bc1-b19b-434ebeb36e09 req-6ec41962-0939-4d57-9748-4c0cd1dadd51 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:49.070548 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-c4799489-00ce-4bc1-b19b-434ebeb36e09 req-6ec41962-0939-4d57-9748-4c0cd1dadd51 service nova] Creating event network-changed:65a6d6d7-af12-4f90-9ea8-61dc9032943b for instance 1a01253b-8ff8-44d9-961b-1b91de83d671 on n-h2-850501-12 Sep 08 10:38:49.080739 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-c4799489-00ce-4bc1-b19b-434ebeb36e09 req-6ec41962-0939-4d57-9748-4c0cd1dadd51 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073905 Sep 08 10:38:49.082391 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 271/557] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:38:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:38:49.093193 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2b6e4cf9-1d30-46a3-9b4f-cd7de440a039 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:49.094718 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2b6e4cf9-1d30-46a3-9b4f-cd7de440a039 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: ec8a85b1-636c-4699-8042-4dbefbc881f3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:49.106486 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2b6e4cf9-1d30-46a3-9b4f-cd7de440a039 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:49.108327 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2b6e4cf9-1d30-46a3-9b4f-cd7de440a039 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:49.109494 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2b6e4cf9-1d30-46a3-9b4f-cd7de440a039 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:49.110841 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2b6e4cf9-1d30-46a3-9b4f-cd7de440a039 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:49.111797 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2b6e4cf9-1d30-46a3-9b4f-cd7de440a039 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:49.112523 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2b6e4cf9-1d30-46a3-9b4f-cd7de440a039 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:49.234058 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=4 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:38:49.405917 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4f5e5028-c354-4439-b3ee-31012753ae9c tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9913da38392048c897ada11a1ac5e6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b3414c389540e7a35f03809b064d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:49.424594 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4f5e5028-c354-4439-b3ee-31012753ae9c tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] 10.222.0.27 "GET /compute/v2.1/servers/bc3d77c9-40f4-4f37-9717-9c11e724e637" status: 200 len: 1479 microversion: 2.1 time: 0.812225 Sep 08 10:38:49.425628 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 287/558] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:48 2022] GET /compute/v2.1/servers/bc3d77c9-40f4-4f37-9717-9c11e724e637 => generated 1479 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:49.526560 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2b6e4cf9-1d30-46a3-9b4f-cd7de440a039 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:49.541958 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2b6e4cf9-1d30-46a3-9b4f-cd7de440a039 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/ec8a85b1-636c-4699-8042-4dbefbc881f3" status: 200 len: 1503 microversion: 2.1 time: 0.456461 Sep 08 10:38:49.544738 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 272/559] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:49 2022] GET /compute/v2.1/servers/ec8a85b1-636c-4699-8042-4dbefbc881f3 => generated 1503 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:49.553801 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e25da719-cc66-4e43-aa4d-3fc1459818a9 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:49.555345 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e25da719-cc66-4e43-aa4d-3fc1459818a9 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: 83037cf6-4a7d-4ba8-8ecb-469feb7598b8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:49.568508 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e25da719-cc66-4e43-aa4d-3fc1459818a9 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:49.570989 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e25da719-cc66-4e43-aa4d-3fc1459818a9 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:49.573982 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e25da719-cc66-4e43-aa4d-3fc1459818a9 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:49.576255 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e25da719-cc66-4e43-aa4d-3fc1459818a9 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:49.577389 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e25da719-cc66-4e43-aa4d-3fc1459818a9 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:49.578439 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e25da719-cc66-4e43-aa4d-3fc1459818a9 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:49.725627 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e25da719-cc66-4e43-aa4d-3fc1459818a9 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:49.746200 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e25da719-cc66-4e43-aa4d-3fc1459818a9 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/83037cf6-4a7d-4ba8-8ecb-469feb7598b8" status: 200 len: 1214 microversion: 2.1 time: 0.199463 Sep 08 10:38:49.757086 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 273/560] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:49 2022] GET /compute/v2.1/servers/83037cf6-4a7d-4ba8-8ecb-469feb7598b8 => generated 1214 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:49.757086 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-dfe6ce10-5b28-4f94-b560-0790cc4603dc tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:49.757086 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-dfe6ce10-5b28-4f94-b560-0790cc4603dc tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 815705bc-e49e-47a1-864b-9cc550464808] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:49.777657 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dfe6ce10-5b28-4f94-b560-0790cc4603dc tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:49.777958 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-92320d14-cba6-4fd2-84de-986b58c95cc3 tempest-NetworksTest-1825687449 tempest-NetworksTest-1825687449-project-admin] Calling method '.version_select at 0x7f68e4f940d0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:49.779609 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dfe6ce10-5b28-4f94-b560-0790cc4603dc tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:49.780601 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dfe6ce10-5b28-4f94-b560-0790cc4603dc tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:49.781740 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dfe6ce10-5b28-4f94-b560-0790cc4603dc tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:49.783533 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dfe6ce10-5b28-4f94-b560-0790cc4603dc tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:49.783533 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dfe6ce10-5b28-4f94-b560-0790cc4603dc tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:50.243352 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-92320d14-cba6-4fd2-84de-986b58c95cc3 tempest-NetworksTest-1825687449 tempest-NetworksTest-1825687449-project-admin] 10.222.0.27 "GET /compute/v2.1/os-networks" status: 200 len: 6763 microversion: 2.1 time: 0.802483 Sep 08 10:38:50.245318 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 288/561] 10.222.0.27 () {58 vars in 1137 bytes} [Thu Sep 8 10:38:49 2022] GET /compute/v2.1/os-networks => generated 6763 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:50.259296 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9420ae27-b420-4642-a134-a526a3c1a6e4 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:50.263413 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9420ae27-b420-4642-a134-a526a3c1a6e4 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 422ceb5f-740f-45e5-9596-6796719adf27] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:50.283574 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9420ae27-b420-4642-a134-a526a3c1a6e4 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:50.288505 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9420ae27-b420-4642-a134-a526a3c1a6e4 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:50.292867 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9420ae27-b420-4642-a134-a526a3c1a6e4 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:50.294242 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9420ae27-b420-4642-a134-a526a3c1a6e4 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:50.296570 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9420ae27-b420-4642-a134-a526a3c1a6e4 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:50.298145 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9420ae27-b420-4642-a134-a526a3c1a6e4 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:50.303042 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-dfe6ce10-5b28-4f94-b560-0790cc4603dc tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:50.327555 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-dfe6ce10-5b28-4f94-b560-0790cc4603dc tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808" status: 200 len: 1477 microversion: 2.1 time: 0.578302 Sep 08 10:38:50.336786 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 274/562] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:49 2022] GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808 => generated 1477 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:50.353721 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-455fa3e4-2a68-4242-b86e-60c80920ca9f tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:50.354349 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-455fa3e4-2a68-4242-b86e-60c80920ca9f tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] [instance: 1a01253b-8ff8-44d9-961b-1b91de83d671] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:50.376357 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-455fa3e4-2a68-4242-b86e-60c80920ca9f tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:50.378033 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-455fa3e4-2a68-4242-b86e-60c80920ca9f tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:50.378033 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-455fa3e4-2a68-4242-b86e-60c80920ca9f tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:50.379001 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-455fa3e4-2a68-4242-b86e-60c80920ca9f tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:50.379743 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-455fa3e4-2a68-4242-b86e-60c80920ca9f tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:50.380424 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-455fa3e4-2a68-4242-b86e-60c80920ca9f tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:50.692675 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9420ae27-b420-4642-a134-a526a3c1a6e4 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:50.703534 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9420ae27-b420-4642-a134-a526a3c1a6e4 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:50.708289 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9420ae27-b420-4642-a134-a526a3c1a6e4 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:50.712181 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9420ae27-b420-4642-a134-a526a3c1a6e4 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/422ceb5f-740f-45e5-9596-6796719adf27" status: 200 len: 1556 microversion: 2.25 time: 0.464822 Sep 08 10:38:50.712941 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 289/563] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:38:50 2022] GET /compute/v2.1/servers/422ceb5f-740f-45e5-9596-6796719adf27 => generated 1556 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:38:50.733323 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ee986609-e60f-481b-a8b9-9968c7b17a83 tempest-NetworksTest-1825687449 tempest-NetworksTest-1825687449-project-admin] Calling method '.version_select at 0x7f68e4cf3ca0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:51.032626 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-455fa3e4-2a68-4242-b86e-60c80920ca9f tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4cde361139445eb147c4f634ec663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5388c25cdb4a35ae8d58fa5b6cf125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:51.036591 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:38:51.036860 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ee986609-e60f-481b-a8b9-9968c7b17a83 tempest-NetworksTest-1825687449 tempest-NetworksTest-1825687449-project-admin] 10.222.0.27 "GET /compute/v2.1/os-networks/6c07d17e-5454-404f-a4da-2b5f7caefef4" status: 200 len: 652 microversion: 2.1 time: 0.314687 Sep 08 10:38:51.043767 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 290/564] 10.222.0.27 () {58 vars in 1248 bytes} [Thu Sep 8 10:38:50 2022] GET /compute/v2.1/os-networks/6c07d17e-5454-404f-a4da-2b5f7caefef4 => generated 652 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:38:51.050492 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c4da16fb-1620-497f-a585-a07c51f05e3f tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:51.050745 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-455fa3e4-2a68-4242-b86e-60c80920ca9f tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] 10.222.0.27 "GET /compute/v2.1/servers/1a01253b-8ff8-44d9-961b-1b91de83d671" status: 200 len: 1388 microversion: 2.1 time: 0.711849 Sep 08 10:38:51.051690 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 275/565] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:50 2022] GET /compute/v2.1/servers/1a01253b-8ff8-44d9-961b-1b91de83d671 => generated 1388 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:51.056948 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c4da16fb-1620-497f-a585-a07c51f05e3f tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] [instance: bc3d77c9-40f4-4f37-9717-9c11e724e637] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:51.065577 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d956e858-710c-46f6-bdb8-4afbc4853e02 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:51.072726 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c4da16fb-1620-497f-a585-a07c51f05e3f tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:51.072726 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c4da16fb-1620-497f-a585-a07c51f05e3f tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:51.072726 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c4da16fb-1620-497f-a585-a07c51f05e3f tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:51.072726 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c4da16fb-1620-497f-a585-a07c51f05e3f tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:51.073089 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c4da16fb-1620-497f-a585-a07c51f05e3f tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:51.073201 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d956e858-710c-46f6-bdb8-4afbc4853e02 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: ec8a85b1-636c-4699-8042-4dbefbc881f3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:51.073296 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c4da16fb-1620-497f-a585-a07c51f05e3f tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:51.090379 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d956e858-710c-46f6-bdb8-4afbc4853e02 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:51.092540 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d956e858-710c-46f6-bdb8-4afbc4853e02 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:51.093663 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d956e858-710c-46f6-bdb8-4afbc4853e02 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:51.096677 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d956e858-710c-46f6-bdb8-4afbc4853e02 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:51.097912 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d956e858-710c-46f6-bdb8-4afbc4853e02 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:51.099997 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d956e858-710c-46f6-bdb8-4afbc4853e02 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:51.393718 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c4da16fb-1620-497f-a585-a07c51f05e3f tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9913da38392048c897ada11a1ac5e6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b3414c389540e7a35f03809b064d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:51.411080 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c4da16fb-1620-497f-a585-a07c51f05e3f tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] 10.222.0.27 "GET /compute/v2.1/servers/bc3d77c9-40f4-4f37-9717-9c11e724e637" status: 200 len: 1479 microversion: 2.1 time: 0.370951 Sep 08 10:38:51.429132 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 291/566] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:51 2022] GET /compute/v2.1/servers/bc3d77c9-40f4-4f37-9717-9c11e724e637 => generated 1479 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:51.456617 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-94d48dfb-3d75-4230-baf1-cb6930705bf8 req-7ad80106-3b24-4997-9fd4-62dbd66b2c77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec8a85b1-636c-4699-8042-4dbefbc881f3", "name": "network-vif-unplugged", "status": "completed", "tag": "820cda60-30f4-4974-ab85-eee32186c6c0"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:38:51.485423 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-94d48dfb-3d75-4230-baf1-cb6930705bf8 req-7ad80106-3b24-4997-9fd4-62dbd66b2c77 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:51.497747 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-94d48dfb-3d75-4230-baf1-cb6930705bf8 req-7ad80106-3b24-4997-9fd4-62dbd66b2c77 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:51.499195 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-94d48dfb-3d75-4230-baf1-cb6930705bf8 req-7ad80106-3b24-4997-9fd4-62dbd66b2c77 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:51.521385 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-94d48dfb-3d75-4230-baf1-cb6930705bf8 req-7ad80106-3b24-4997-9fd4-62dbd66b2c77 service nova] Creating event network-vif-unplugged:820cda60-30f4-4974-ab85-eee32186c6c0 for instance ec8a85b1-636c-4699-8042-4dbefbc881f3 on n-h1-850501-12 Sep 08 10:38:51.536756 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-94d48dfb-3d75-4230-baf1-cb6930705bf8 req-7ad80106-3b24-4997-9fd4-62dbd66b2c77 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.104883 Sep 08 10:38:51.538519 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 292/567] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:38:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:38:51.546648 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ca2a23f2-4586-4394-b224-896c68d1cfe4 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:51.548073 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ca2a23f2-4586-4394-b224-896c68d1cfe4 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] [instance: 422ceb5f-740f-45e5-9596-6796719adf27] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:51.558386 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ca2a23f2-4586-4394-b224-896c68d1cfe4 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:51.560091 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ca2a23f2-4586-4394-b224-896c68d1cfe4 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:51.561377 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ca2a23f2-4586-4394-b224-896c68d1cfe4 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:51.568511 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ca2a23f2-4586-4394-b224-896c68d1cfe4 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:51.569404 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ca2a23f2-4586-4394-b224-896c68d1cfe4 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:51.570765 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ca2a23f2-4586-4394-b224-896c68d1cfe4 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:52.168279 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d956e858-710c-46f6-bdb8-4afbc4853e02 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:52.179647 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d956e858-710c-46f6-bdb8-4afbc4853e02 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/ec8a85b1-636c-4699-8042-4dbefbc881f3" status: 200 len: 1503 microversion: 2.1 time: 1.126543 Sep 08 10:38:52.183352 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 276/568] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:51 2022] GET /compute/v2.1/servers/ec8a85b1-636c-4699-8042-4dbefbc881f3 => generated 1503 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:52.191223 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3e5d0d68-6b1d-404d-a0b6-e9bc4e909120 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:52.192819 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3e5d0d68-6b1d-404d-a0b6-e9bc4e909120 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: 83037cf6-4a7d-4ba8-8ecb-469feb7598b8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:52.202456 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3e5d0d68-6b1d-404d-a0b6-e9bc4e909120 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:52.203312 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3e5d0d68-6b1d-404d-a0b6-e9bc4e909120 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:52.204197 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3e5d0d68-6b1d-404d-a0b6-e9bc4e909120 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:52.205609 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3e5d0d68-6b1d-404d-a0b6-e9bc4e909120 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:52.206999 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3e5d0d68-6b1d-404d-a0b6-e9bc4e909120 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:52.207912 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3e5d0d68-6b1d-404d-a0b6-e9bc4e909120 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:52.301643 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-ca2a23f2-4586-4394-b224-896c68d1cfe4 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lazy-loading 'services' on Instance uuid 422ceb5f-740f-45e5-9596-6796719adf27 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:38:52.334348 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-3e5d0d68-6b1d-404d-a0b6-e9bc4e909120 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:52.374682 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3e5d0d68-6b1d-404d-a0b6-e9bc4e909120 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/83037cf6-4a7d-4ba8-8ecb-469feb7598b8" status: 200 len: 1276 microversion: 2.1 time: 0.188876 Sep 08 10:38:52.378680 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 277/569] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:52 2022] GET /compute/v2.1/servers/83037cf6-4a7d-4ba8-8ecb-469feb7598b8 => generated 1276 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:52.391282 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1c6f13a5-f6e5-41fc-9b69-347b6942bb67 tempest-NetworksTest-1825687449 tempest-NetworksTest-1825687449-project-admin] Calling method '.version_select at 0x7f68e4a54dc0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:52.393069 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ca2a23f2-4586-4394-b224-896c68d1cfe4 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/422ceb5f-740f-45e5-9596-6796719adf27" status: 200 len: 2049 microversion: 2.25 time: 0.851765 Sep 08 10:38:52.397230 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 293/570] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:38:51 2022] GET /compute/v2.1/servers/422ceb5f-740f-45e5-9596-6796719adf27 => generated 2049 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:38:52.409384 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-71f70b6e-c8cf-429e-8407-857a8ca7fd64 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:52.411850 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-71f70b6e-c8cf-429e-8407-857a8ca7fd64 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 815705bc-e49e-47a1-864b-9cc550464808] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:52.419956 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71f70b6e-c8cf-429e-8407-857a8ca7fd64 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:52.421458 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71f70b6e-c8cf-429e-8407-857a8ca7fd64 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:52.422243 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71f70b6e-c8cf-429e-8407-857a8ca7fd64 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:52.424781 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71f70b6e-c8cf-429e-8407-857a8ca7fd64 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:52.426495 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71f70b6e-c8cf-429e-8407-857a8ca7fd64 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:52.428399 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71f70b6e-c8cf-429e-8407-857a8ca7fd64 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:53.002703 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-71f70b6e-c8cf-429e-8407-857a8ca7fd64 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:53.031313 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-71f70b6e-c8cf-429e-8407-857a8ca7fd64 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808" status: 200 len: 1477 microversion: 2.1 time: 0.629769 Sep 08 10:38:53.054589 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 294/571] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:52 2022] GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808 => generated 1477 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:53.063002 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a8bb6b0c-4f98-4ca2-8dad-6df58f855690 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:53.072048 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a8bb6b0c-4f98-4ca2-8dad-6df58f855690 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] [instance: 1a01253b-8ff8-44d9-961b-1b91de83d671] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:53.085109 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1c6f13a5-f6e5-41fc-9b69-347b6942bb67 tempest-NetworksTest-1825687449 tempest-NetworksTest-1825687449-project-admin] 10.222.0.27 "GET /compute/v2.1/os-networks" status: 200 len: 6763 microversion: 2.1 time: 0.703574 Sep 08 10:38:53.086287 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 278/572] 10.222.0.27 () {58 vars in 1137 bytes} [Thu Sep 8 10:38:52 2022] GET /compute/v2.1/os-networks => generated 6763 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:53.092066 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a8bb6b0c-4f98-4ca2-8dad-6df58f855690 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:53.092771 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a8bb6b0c-4f98-4ca2-8dad-6df58f855690 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:53.093861 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a8bb6b0c-4f98-4ca2-8dad-6df58f855690 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:53.094630 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a8bb6b0c-4f98-4ca2-8dad-6df58f855690 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:53.095349 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a8bb6b0c-4f98-4ca2-8dad-6df58f855690 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:53.102058 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a8bb6b0c-4f98-4ca2-8dad-6df58f855690 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:53.110460 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-604f9f26-d20c-48d5-95d7-33bda8cae8a7 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:53.113625 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-604f9f26-d20c-48d5-95d7-33bda8cae8a7 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] [instance: 422ceb5f-740f-45e5-9596-6796719adf27] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:53.155668 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-604f9f26-d20c-48d5-95d7-33bda8cae8a7 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:53.163780 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-604f9f26-d20c-48d5-95d7-33bda8cae8a7 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:53.164564 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-604f9f26-d20c-48d5-95d7-33bda8cae8a7 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:53.171032 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-604f9f26-d20c-48d5-95d7-33bda8cae8a7 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:53.172528 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-604f9f26-d20c-48d5-95d7-33bda8cae8a7 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:53.173209 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-604f9f26-d20c-48d5-95d7-33bda8cae8a7 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:53.482906 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=18 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:38:54.014131 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-604f9f26-d20c-48d5-95d7-33bda8cae8a7 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lazy-loading 'services' on Instance uuid 422ceb5f-740f-45e5-9596-6796719adf27 {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:38:54.041839 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a8bb6b0c-4f98-4ca2-8dad-6df58f855690 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4cde361139445eb147c4f634ec663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5388c25cdb4a35ae8d58fa5b6cf125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:54.053336 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a8bb6b0c-4f98-4ca2-8dad-6df58f855690 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] 10.222.0.27 "GET /compute/v2.1/servers/1a01253b-8ff8-44d9-961b-1b91de83d671" status: 200 len: 1388 microversion: 2.1 time: 0.997291 Sep 08 10:38:54.068530 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-604f9f26-d20c-48d5-95d7-33bda8cae8a7 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/422ceb5f-740f-45e5-9596-6796719adf27" status: 200 len: 2049 microversion: 2.25 time: 0.979627 Sep 08 10:38:54.073353 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 295/573] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:53 2022] GET /compute/v2.1/servers/1a01253b-8ff8-44d9-961b-1b91de83d671 => generated 1388 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:54.075679 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 279/574] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:38:53 2022] GET /compute/v2.1/servers/422ceb5f-740f-45e5-9596-6796719adf27 => generated 2049 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:38:54.089758 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9248fcf9-23d9-4079-afe0-c03fc93451cf tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:54.090390 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9248fcf9-23d9-4079-afe0-c03fc93451cf tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] [instance: bc3d77c9-40f4-4f37-9717-9c11e724e637] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:54.093404 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5c12196e-14fb-4011-b0cf-04521c304b7b tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:54.102354 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9248fcf9-23d9-4079-afe0-c03fc93451cf tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:54.102871 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9248fcf9-23d9-4079-afe0-c03fc93451cf tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:54.103314 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9248fcf9-23d9-4079-afe0-c03fc93451cf tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:54.104044 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9248fcf9-23d9-4079-afe0-c03fc93451cf tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:54.104304 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5c12196e-14fb-4011-b0cf-04521c304b7b tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: ec8a85b1-636c-4699-8042-4dbefbc881f3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:54.104649 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9248fcf9-23d9-4079-afe0-c03fc93451cf tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:54.107934 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9248fcf9-23d9-4079-afe0-c03fc93451cf tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:54.142054 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5c12196e-14fb-4011-b0cf-04521c304b7b tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:54.146670 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5c12196e-14fb-4011-b0cf-04521c304b7b tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:54.147839 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5c12196e-14fb-4011-b0cf-04521c304b7b tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:54.153912 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5c12196e-14fb-4011-b0cf-04521c304b7b tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:54.154877 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5c12196e-14fb-4011-b0cf-04521c304b7b tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:54.155665 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5c12196e-14fb-4011-b0cf-04521c304b7b tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:54.205378 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9248fcf9-23d9-4079-afe0-c03fc93451cf tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:54.206152 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9248fcf9-23d9-4079-afe0-c03fc93451cf tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:54.206753 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9248fcf9-23d9-4079-afe0-c03fc93451cf tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:54.207417 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-9248fcf9-23d9-4079-afe0-c03fc93451cf tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lazy-loading 'fault' on Instance uuid bc3d77c9-40f4-4f37-9717-9c11e724e637 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:38:54.291907 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9248fcf9-23d9-4079-afe0-c03fc93451cf tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9913da38392048c897ada11a1ac5e6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b3414c389540e7a35f03809b064d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:54.304738 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9248fcf9-23d9-4079-afe0-c03fc93451cf tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] 10.222.0.27 "GET /compute/v2.1/servers/bc3d77c9-40f4-4f37-9717-9c11e724e637" status: 200 len: 1313 microversion: 2.1 time: 0.228887 Sep 08 10:38:54.305686 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 296/575] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:54 2022] GET /compute/v2.1/servers/bc3d77c9-40f4-4f37-9717-9c11e724e637 => generated 1313 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:54.311355 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8b20c23f-790b-4448-ba73-d67ef6284209 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:54.312395 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8b20c23f-790b-4448-ba73-d67ef6284209 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: 83037cf6-4a7d-4ba8-8ecb-469feb7598b8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:54.319953 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8b20c23f-790b-4448-ba73-d67ef6284209 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:54.321139 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8b20c23f-790b-4448-ba73-d67ef6284209 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:54.321799 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8b20c23f-790b-4448-ba73-d67ef6284209 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:54.322994 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8b20c23f-790b-4448-ba73-d67ef6284209 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:54.323908 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8b20c23f-790b-4448-ba73-d67ef6284209 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:54.324743 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8b20c23f-790b-4448-ba73-d67ef6284209 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:54.477150 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5c12196e-14fb-4011-b0cf-04521c304b7b tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:54.490014 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8b20c23f-790b-4448-ba73-d67ef6284209 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:54.518051 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5c12196e-14fb-4011-b0cf-04521c304b7b tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/ec8a85b1-636c-4699-8042-4dbefbc881f3" status: 200 len: 1503 microversion: 2.1 time: 0.425306 Sep 08 10:38:54.521510 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 280/576] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:54 2022] GET /compute/v2.1/servers/ec8a85b1-636c-4699-8042-4dbefbc881f3 => generated 1503 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:54.535127 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8b20c23f-790b-4448-ba73-d67ef6284209 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/83037cf6-4a7d-4ba8-8ecb-469feb7598b8" status: 200 len: 1276 microversion: 2.1 time: 0.225444 Sep 08 10:38:54.542488 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-0506acfa-6889-4030-a987-05e5362c35a7 req-55e4ff03-69b3-4c67-9e75-e6d1d69e1e4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec8a85b1-636c-4699-8042-4dbefbc881f3", "tag": "820cda60-30f4-4974-ab85-eee32186c6c0"}, {"server_uuid": "bc3d77c9-40f4-4f37-9717-9c11e724e637", "name": "network-vif-deleted", "tag": "ae00f6df-3009-4a3a-93bb-25a2344e9fe0"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:38:54.552876 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 297/577] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:54 2022] GET /compute/v2.1/servers/83037cf6-4a7d-4ba8-8ecb-469feb7598b8 => generated 1276 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:54.570534 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-138712c3-cca9-4646-8e7c-9118725374da tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:54.571546 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-138712c3-cca9-4646-8e7c-9118725374da tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 815705bc-e49e-47a1-864b-9cc550464808] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:54.572351 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-0506acfa-6889-4030-a987-05e5362c35a7 req-55e4ff03-69b3-4c67-9e75-e6d1d69e1e4a service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:54.575412 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-0506acfa-6889-4030-a987-05e5362c35a7 req-55e4ff03-69b3-4c67-9e75-e6d1d69e1e4a service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:54.576615 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-0506acfa-6889-4030-a987-05e5362c35a7 req-55e4ff03-69b3-4c67-9e75-e6d1d69e1e4a service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:54.607081 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-138712c3-cca9-4646-8e7c-9118725374da tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:54.608652 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-138712c3-cca9-4646-8e7c-9118725374da tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:54.610340 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-138712c3-cca9-4646-8e7c-9118725374da tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:54.614692 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-138712c3-cca9-4646-8e7c-9118725374da tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:54.614692 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-138712c3-cca9-4646-8e7c-9118725374da tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:54.614692 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-138712c3-cca9-4646-8e7c-9118725374da tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:54.620599 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-0506acfa-6889-4030-a987-05e5362c35a7 req-55e4ff03-69b3-4c67-9e75-e6d1d69e1e4a service nova] Creating event network-changed:820cda60-30f4-4974-ab85-eee32186c6c0 for instance ec8a85b1-636c-4699-8042-4dbefbc881f3 on n-h1-850501-12 Sep 08 10:38:54.623290 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-0506acfa-6889-4030-a987-05e5362c35a7 req-55e4ff03-69b3-4c67-9e75-e6d1d69e1e4a service nova] Creating event network-vif-deleted:ae00f6df-3009-4a3a-93bb-25a2344e9fe0 for instance bc3d77c9-40f4-4f37-9717-9c11e724e637 on n-h1-850501-12 Sep 08 10:38:54.639335 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-0506acfa-6889-4030-a987-05e5362c35a7 req-55e4ff03-69b3-4c67-9e75-e6d1d69e1e4a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.114364 Sep 08 10:38:54.640880 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 281/578] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:38:54 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:38:54.665901 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ac6322f4-fc1d-43e9-b1fd-1c0d78cafd87 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:54.680258 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ac6322f4-fc1d-43e9-b1fd-1c0d78cafd87 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:54.686607 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ac6322f4-fc1d-43e9-b1fd-1c0d78cafd87 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:54.688880 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ac6322f4-fc1d-43e9-b1fd-1c0d78cafd87 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:54.690592 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ac6322f4-fc1d-43e9-b1fd-1c0d78cafd87 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:54.692917 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ac6322f4-fc1d-43e9-b1fd-1c0d78cafd87 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:54.694673 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ac6322f4-fc1d-43e9-b1fd-1c0d78cafd87 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:54.768215 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ac6322f4-fc1d-43e9-b1fd-1c0d78cafd87 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.119337 Sep 08 10:38:54.771978 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 282/579] 10.222.0.27 () {60 vars in 1217 bytes} [Thu Sep 8 10:38:54 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:38:54.801144 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e35c57d0-8144-4864-9961-19dc67c40e9c tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:38:54.802563 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e35c57d0-8144-4864-9961-19dc67c40e9c tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] [instance: 422ceb5f-740f-45e5-9596-6796719adf27] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:54.815691 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e35c57d0-8144-4864-9961-19dc67c40e9c tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:54.816226 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e35c57d0-8144-4864-9961-19dc67c40e9c tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:54.816715 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e35c57d0-8144-4864-9961-19dc67c40e9c tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:54.817631 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e35c57d0-8144-4864-9961-19dc67c40e9c tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:54.818070 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e35c57d0-8144-4864-9961-19dc67c40e9c tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:54.818551 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e35c57d0-8144-4864-9961-19dc67c40e9c tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:54.949788 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e35c57d0-8144-4864-9961-19dc67c40e9c tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/422ceb5f-740f-45e5-9596-6796719adf27/action" status: 202 len: 0 microversion: 2.25 time: 0.163581 Sep 08 10:38:54.951193 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 283/580] 10.222.0.27 () {62 vars in 1319 bytes} [Thu Sep 8 10:38:54 2022] POST /compute/v2.1/servers/422ceb5f-740f-45e5-9596-6796719adf27/action => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 08 10:38:54.965965 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a92161bf-3f2b-4d68-bdba-f5cad71d341b tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:54.968354 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a92161bf-3f2b-4d68-bdba-f5cad71d341b tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] [instance: 422ceb5f-740f-45e5-9596-6796719adf27] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:54.977416 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a92161bf-3f2b-4d68-bdba-f5cad71d341b tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:54.977416 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a92161bf-3f2b-4d68-bdba-f5cad71d341b tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:54.977893 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a92161bf-3f2b-4d68-bdba-f5cad71d341b tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:54.978600 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a92161bf-3f2b-4d68-bdba-f5cad71d341b tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:54.979058 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a92161bf-3f2b-4d68-bdba-f5cad71d341b tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:54.979482 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a92161bf-3f2b-4d68-bdba-f5cad71d341b tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:55.369203 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-138712c3-cca9-4646-8e7c-9118725374da tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:55.384086 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-138712c3-cca9-4646-8e7c-9118725374da tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808" status: 200 len: 1477 microversion: 2.1 time: 0.829960 Sep 08 10:38:55.385159 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 298/581] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:54 2022] GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808 => generated 1477 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:55.396244 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-04a5deef-e7fe-4bc2-bcfc-205304b9173b tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:55.402975 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-04a5deef-e7fe-4bc2-bcfc-205304b9173b tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] [instance: 1a01253b-8ff8-44d9-961b-1b91de83d671] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:55.419362 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04a5deef-e7fe-4bc2-bcfc-205304b9173b tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:55.420763 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04a5deef-e7fe-4bc2-bcfc-205304b9173b tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:55.426723 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04a5deef-e7fe-4bc2-bcfc-205304b9173b tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:55.427834 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04a5deef-e7fe-4bc2-bcfc-205304b9173b tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:55.428501 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04a5deef-e7fe-4bc2-bcfc-205304b9173b tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:55.429207 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04a5deef-e7fe-4bc2-bcfc-205304b9173b tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:55.458303 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:38:55.580399 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-a92161bf-3f2b-4d68-bdba-f5cad71d341b tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lazy-loading 'services' on Instance uuid 422ceb5f-740f-45e5-9596-6796719adf27 {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:38:55.622373 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a92161bf-3f2b-4d68-bdba-f5cad71d341b tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/422ceb5f-740f-45e5-9596-6796719adf27" status: 200 len: 2054 microversion: 2.25 time: 0.651505 Sep 08 10:38:55.633177 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 284/582] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:38:54 2022] GET /compute/v2.1/servers/422ceb5f-740f-45e5-9596-6796719adf27 => generated 2054 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:38:55.633177 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-eed9c6f9-99aa-491a-93cd-27581d36c050 req-4682941d-d34b-4a10-bba6-8dd36abe330a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "493cd490-27c5-4e08-a789-767757111cb2", "tag": "9806eb02-bb40-40a3-973c-f43c9af0fd37"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:38:55.658548 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-eed9c6f9-99aa-491a-93cd-27581d36c050 req-4682941d-d34b-4a10-bba6-8dd36abe330a service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:55.659061 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-eed9c6f9-99aa-491a-93cd-27581d36c050 req-4682941d-d34b-4a10-bba6-8dd36abe330a service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:55.659589 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-eed9c6f9-99aa-491a-93cd-27581d36c050 req-4682941d-d34b-4a10-bba6-8dd36abe330a service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:55.696834 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-eed9c6f9-99aa-491a-93cd-27581d36c050 req-4682941d-d34b-4a10-bba6-8dd36abe330a service nova] Creating event network-changed:9806eb02-bb40-40a3-973c-f43c9af0fd37 for instance 493cd490-27c5-4e08-a789-767757111cb2 on n-h2-850501-12 Sep 08 10:38:55.710217 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-eed9c6f9-99aa-491a-93cd-27581d36c050 req-4682941d-d34b-4a10-bba6-8dd36abe330a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084524 Sep 08 10:38:55.721736 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 285/583] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:38:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:38:55.729335 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ca449dee-6898-48d4-b6f0-9ae7aa71dffe tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:55.730060 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ca449dee-6898-48d4-b6f0-9ae7aa71dffe tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] [instance: bc3d77c9-40f4-4f37-9717-9c11e724e637] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:55.756939 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ca449dee-6898-48d4-b6f0-9ae7aa71dffe tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:55.757733 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ca449dee-6898-48d4-b6f0-9ae7aa71dffe tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:55.758360 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ca449dee-6898-48d4-b6f0-9ae7aa71dffe tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:55.759374 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ca449dee-6898-48d4-b6f0-9ae7aa71dffe tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:55.760184 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ca449dee-6898-48d4-b6f0-9ae7aa71dffe tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:55.764569 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ca449dee-6898-48d4-b6f0-9ae7aa71dffe tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:55.792088 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-ca449dee-6898-48d4-b6f0-9ae7aa71dffe tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] HTTP exception thrown: Instance bc3d77c9-40f4-4f37-9717-9c11e724e637 could not be found. Sep 08 10:38:55.794526 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ca449dee-6898-48d4-b6f0-9ae7aa71dffe tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Request method failure captured: Sep 08 10:38:55.794526 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/bc3d77c9-40f4-4f37-9717-9c11e724e637 HTTP/1.1 Sep 08 10:38:55.794526 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:38:55.794526 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:38:55.794526 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:38:55.794526 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:38:55.794526 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:38:55.794526 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:38:55.794526 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:38:55.794526 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:38:55.794526 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcYVCUAH6efNaigTRd1TJ-MPK5-X4RTjiPZGzxo5bWXIK_7o8ZI8CQ7tY0YwoXLpuo-ZimvobYGNyRPjejFzI2xNPyMESE2BAWsKI4DB3cGzRRhngORF_7bLimajiSjRQKAWf_GCg8hgzVivBoc9WaFvyyX985rhsfT2cQH6XgQVYGU Sep 08 10:38:55.794526 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:38:55.794526 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:38:55.794526 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:38:55.794526 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:38:55.794526 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:38:55.794526 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:38:55.794526 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 49b3414c389540e7a35f03809b064d03 Sep 08 10:38:55.794526 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-959287831 Sep 08 10:38:55.794526 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:38:55.794526 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:38:55.796074 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/49b3414c389540e7a35f03809b064d03"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/49b3414c389540e7a35f03809b064d03"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_49b3414c389540e7a35f03809b064d03"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/49b3414c389540e7a35f03809b064d03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:38:55.796074 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-959287831 Sep 08 10:38:55.796074 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 49b3414c389540e7a35f03809b064d03 Sep 08 10:38:55.796074 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-959287831 Sep 08 10:38:55.796074 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServerDiagnosticsNegativeTest-959287831-project Sep 08 10:38:55.796074 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:38:55.796074 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:38:55.796074 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 9913da38392048c897ada11a1ac5e6a8 Sep 08 10:38:55.796074 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-959287831-project Sep 08 10:38:55.796074 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:38:55.796074 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance bc3d77c9-40f4-4f37-9717-9c11e724e637 could not be found. Sep 08 10:38:55.796074 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': 'bc3d77c9-40f4-4f37-9717-9c11e724e637'} Sep 08 10:38:55.796990 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:38:55.796990 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:38:55.796990 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:38:55.796990 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:38:55.796990 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:38:55.796990 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:38:55.796990 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:38:55.796990 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:38:55.796990 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:38:55.796990 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:38:55.796990 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc3d77c9-40f4-4f37-9717-9c11e724e637 could not be found. Sep 08 10:38:55.796990 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:38:55.796990 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:38:55.796990 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:38:55.796990 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:38:55.796990 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:38:55.796990 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:38:55.796990 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:38:55.796990 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:38:55.796990 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:38:55.798331 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:38:55.798331 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:38:55.798331 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:38:55.798331 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:38:55.798331 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:38:55.798331 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:38:55.798331 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:38:55.798331 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc3d77c9-40f4-4f37-9717-9c11e724e637 could not be found. Sep 08 10:38:55.798331 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:38:55.798331 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:38:55.798331 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:38:55.798331 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:38:55.798331 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:38:55.798331 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:38:55.798331 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:38:55.798331 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:38:55.798331 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc3d77c9-40f4-4f37-9717-9c11e724e637 could not be found. Sep 08 10:38:55.798331 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:38:55.803292 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ca449dee-6898-48d4-b6f0-9ae7aa71dffe tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] Returning 404 to user: Instance bc3d77c9-40f4-4f37-9717-9c11e724e637 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:38:55.804456 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ca449dee-6898-48d4-b6f0-9ae7aa71dffe tempest-ServerDiagnosticsNegativeTest-959287831 tempest-ServerDiagnosticsNegativeTest-959287831-project] 10.222.0.27 "GET /compute/v2.1/servers/bc3d77c9-40f4-4f37-9717-9c11e724e637" status: 404 len: 111 microversion: 2.1 time: 0.081020 Sep 08 10:38:55.806763 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 286/584] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:55 2022] GET /compute/v2.1/servers/bc3d77c9-40f4-4f37-9717-9c11e724e637 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:38:55.818283 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-04505391-a613-45b1-97ae-c413a2926610 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:55.819192 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-04505391-a613-45b1-97ae-c413a2926610 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: ec8a85b1-636c-4699-8042-4dbefbc881f3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:55.828422 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-04505391-a613-45b1-97ae-c413a2926610 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:55.829372 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-04505391-a613-45b1-97ae-c413a2926610 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:55.830047 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-04505391-a613-45b1-97ae-c413a2926610 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:55.831131 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-04505391-a613-45b1-97ae-c413a2926610 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:55.831846 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-04505391-a613-45b1-97ae-c413a2926610 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:55.832575 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-04505391-a613-45b1-97ae-c413a2926610 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:56.377486 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-04505391-a613-45b1-97ae-c413a2926610 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:56.385607 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-04505391-a613-45b1-97ae-c413a2926610 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/ec8a85b1-636c-4699-8042-4dbefbc881f3" status: 200 len: 1503 microversion: 2.1 time: 0.577212 Sep 08 10:38:56.389421 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 287/585] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:55 2022] GET /compute/v2.1/servers/ec8a85b1-636c-4699-8042-4dbefbc881f3 => generated 1503 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:56.394550 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-daf42d6d-bd66-4508-85e5-709502380d58 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:56.399381 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-daf42d6d-bd66-4508-85e5-709502380d58 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: 83037cf6-4a7d-4ba8-8ecb-469feb7598b8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:56.419428 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-daf42d6d-bd66-4508-85e5-709502380d58 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:56.420042 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-daf42d6d-bd66-4508-85e5-709502380d58 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:56.421792 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-daf42d6d-bd66-4508-85e5-709502380d58 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:56.424375 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-daf42d6d-bd66-4508-85e5-709502380d58 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:56.424735 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-daf42d6d-bd66-4508-85e5-709502380d58 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:56.425214 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-daf42d6d-bd66-4508-85e5-709502380d58 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:56.555994 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-04a5deef-e7fe-4bc2-bcfc-205304b9173b tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4cde361139445eb147c4f634ec663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5388c25cdb4a35ae8d58fa5b6cf125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:56.570538 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-04a5deef-e7fe-4bc2-bcfc-205304b9173b tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] 10.222.0.27 "GET /compute/v2.1/servers/1a01253b-8ff8-44d9-961b-1b91de83d671" status: 200 len: 1388 microversion: 2.1 time: 1.181829 Sep 08 10:38:56.571892 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 299/586] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:55 2022] GET /compute/v2.1/servers/1a01253b-8ff8-44d9-961b-1b91de83d671 => generated 1388 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:56.584275 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-03f432e1-1d9d-4c2a-82b2-b2475c411498 req-2dac838a-98ee-4a9a-bbd0-a0e3580a73f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a01253b-8ff8-44d9-961b-1b91de83d671", "name": "network-vif-plugged", "status": "completed", "tag": "65a6d6d7-af12-4f90-9ea8-61dc9032943b"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:38:56.621195 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-03f432e1-1d9d-4c2a-82b2-b2475c411498 req-2dac838a-98ee-4a9a-bbd0-a0e3580a73f1 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:56.623353 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-03f432e1-1d9d-4c2a-82b2-b2475c411498 req-2dac838a-98ee-4a9a-bbd0-a0e3580a73f1 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:56.627154 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-03f432e1-1d9d-4c2a-82b2-b2475c411498 req-2dac838a-98ee-4a9a-bbd0-a0e3580a73f1 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:56.703703 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-03f432e1-1d9d-4c2a-82b2-b2475c411498 req-2dac838a-98ee-4a9a-bbd0-a0e3580a73f1 service nova] Creating event network-vif-plugged:65a6d6d7-af12-4f90-9ea8-61dc9032943b for instance 1a01253b-8ff8-44d9-961b-1b91de83d671 on n-h2-850501-12 Sep 08 10:38:56.720932 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-03f432e1-1d9d-4c2a-82b2-b2475c411498 req-2dac838a-98ee-4a9a-bbd0-a0e3580a73f1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142862 Sep 08 10:38:56.721664 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 300/587] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:38:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:38:56.742097 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b514b5e1-34a3-47ef-8cd0-173d454e7029 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:56.743163 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b514b5e1-34a3-47ef-8cd0-173d454e7029 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 815705bc-e49e-47a1-864b-9cc550464808] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:56.751732 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b514b5e1-34a3-47ef-8cd0-173d454e7029 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:56.753093 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b514b5e1-34a3-47ef-8cd0-173d454e7029 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:56.753717 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b514b5e1-34a3-47ef-8cd0-173d454e7029 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:56.754777 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b514b5e1-34a3-47ef-8cd0-173d454e7029 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:56.755462 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b514b5e1-34a3-47ef-8cd0-173d454e7029 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:56.756136 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b514b5e1-34a3-47ef-8cd0-173d454e7029 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:56.999945 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-daf42d6d-bd66-4508-85e5-709502380d58 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:57.007760 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-daf42d6d-bd66-4508-85e5-709502380d58 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/83037cf6-4a7d-4ba8-8ecb-469feb7598b8" status: 200 len: 1318 microversion: 2.1 time: 0.616997 Sep 08 10:38:57.015810 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 288/588] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:56 2022] GET /compute/v2.1/servers/83037cf6-4a7d-4ba8-8ecb-469feb7598b8 => generated 1318 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:57.021979 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7c9a564b-5918-406e-922d-24966dbd3c9f tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:57.023953 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7c9a564b-5918-406e-922d-24966dbd3c9f tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] [instance: 422ceb5f-740f-45e5-9596-6796719adf27] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:57.038116 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c9a564b-5918-406e-922d-24966dbd3c9f tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:57.039064 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c9a564b-5918-406e-922d-24966dbd3c9f tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:57.040039 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c9a564b-5918-406e-922d-24966dbd3c9f tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:57.044093 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c9a564b-5918-406e-922d-24966dbd3c9f tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:57.044842 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c9a564b-5918-406e-922d-24966dbd3c9f tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:57.045496 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c9a564b-5918-406e-922d-24966dbd3c9f tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:57.287820 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:38:57.328377 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b514b5e1-34a3-47ef-8cd0-173d454e7029 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:57.355009 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b514b5e1-34a3-47ef-8cd0-173d454e7029 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808" status: 200 len: 1477 microversion: 2.1 time: 0.629360 Sep 08 10:38:57.359758 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 301/589] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:56 2022] GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808 => generated 1477 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:57.415717 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-20aaaa22-0bbf-4038-ad08-97ab47721be9 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:57.416355 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-20aaaa22-0bbf-4038-ad08-97ab47721be9 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: ec8a85b1-636c-4699-8042-4dbefbc881f3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:57.435462 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-20aaaa22-0bbf-4038-ad08-97ab47721be9 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:57.436093 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-20aaaa22-0bbf-4038-ad08-97ab47721be9 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:57.436390 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-7c9a564b-5918-406e-922d-24966dbd3c9f tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lazy-loading 'services' on Instance uuid 422ceb5f-740f-45e5-9596-6796719adf27 {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:38:57.436525 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-20aaaa22-0bbf-4038-ad08-97ab47721be9 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:57.437497 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-20aaaa22-0bbf-4038-ad08-97ab47721be9 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:57.437991 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-20aaaa22-0bbf-4038-ad08-97ab47721be9 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:57.438373 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-20aaaa22-0bbf-4038-ad08-97ab47721be9 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:57.451982 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7c9a564b-5918-406e-922d-24966dbd3c9f tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/422ceb5f-740f-45e5-9596-6796719adf27" status: 200 len: 2034 microversion: 2.25 time: 0.434427 Sep 08 10:38:57.466637 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 289/590] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:38:57 2022] GET /compute/v2.1/servers/422ceb5f-740f-45e5-9596-6796719adf27 => generated 2034 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:38:57.479513 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a403b832-ea8d-4b95-88f9-8676fe1e7f88 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-850501-12", "block_migration": "auto"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:38:57.482992 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a403b832-ea8d-4b95-88f9-8676fe1e7f88 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] [instance: 422ceb5f-740f-45e5-9596-6796719adf27] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:57.489509 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a403b832-ea8d-4b95-88f9-8676fe1e7f88 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:57.490352 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a403b832-ea8d-4b95-88f9-8676fe1e7f88 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:57.491033 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a403b832-ea8d-4b95-88f9-8676fe1e7f88 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:57.491984 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a403b832-ea8d-4b95-88f9-8676fe1e7f88 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:57.492656 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a403b832-ea8d-4b95-88f9-8676fe1e7f88 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:57.493328 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a403b832-ea8d-4b95-88f9-8676fe1e7f88 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:57.547643 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-a403b832-ea8d-4b95-88f9-8676fe1e7f88 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lazy-loading 'flavor' on Instance uuid 422ceb5f-740f-45e5-9596-6796719adf27 {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:38:57.577926 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a403b832-ea8d-4b95-88f9-8676fe1e7f88 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] [instance: 422ceb5f-740f-45e5-9596-6796719adf27] Going to try to live migrate instance to n-h2-850501-12 {{(pid=128861) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 08 10:38:57.827837 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-20aaaa22-0bbf-4038-ad08-97ab47721be9 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:57.860734 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-20aaaa22-0bbf-4038-ad08-97ab47721be9 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/ec8a85b1-636c-4699-8042-4dbefbc881f3" status: 200 len: 1503 microversion: 2.1 time: 0.446515 Sep 08 10:38:57.861852 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 302/591] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:57 2022] GET /compute/v2.1/servers/ec8a85b1-636c-4699-8042-4dbefbc881f3 => generated 1503 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:57.874304 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-198d9a54-d15e-461c-bce4-4150235638e2 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:57.874871 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-198d9a54-d15e-461c-bce4-4150235638e2 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] [instance: 1a01253b-8ff8-44d9-961b-1b91de83d671] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:57.894030 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-198d9a54-d15e-461c-bce4-4150235638e2 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:57.894761 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-198d9a54-d15e-461c-bce4-4150235638e2 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:57.895371 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-198d9a54-d15e-461c-bce4-4150235638e2 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:57.897088 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-198d9a54-d15e-461c-bce4-4150235638e2 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:57.897729 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-198d9a54-d15e-461c-bce4-4150235638e2 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:57.898345 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-198d9a54-d15e-461c-bce4-4150235638e2 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:58.074213 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=24 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:38:58.347893 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-198d9a54-d15e-461c-bce4-4150235638e2 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4cde361139445eb147c4f634ec663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5388c25cdb4a35ae8d58fa5b6cf125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:58.362268 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-198d9a54-d15e-461c-bce4-4150235638e2 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] 10.222.0.27 "GET /compute/v2.1/servers/1a01253b-8ff8-44d9-961b-1b91de83d671" status: 200 len: 1388 microversion: 2.1 time: 0.499212 Sep 08 10:38:58.366506 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 303/592] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:57 2022] GET /compute/v2.1/servers/1a01253b-8ff8-44d9-961b-1b91de83d671 => generated 1388 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:58.380469 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dde7e613-4658-4f8c-ad77-7f4217555217 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:58.381117 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-dde7e613-4658-4f8c-ad77-7f4217555217 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: 83037cf6-4a7d-4ba8-8ecb-469feb7598b8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:58.392744 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dde7e613-4658-4f8c-ad77-7f4217555217 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:58.393297 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dde7e613-4658-4f8c-ad77-7f4217555217 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:58.394200 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dde7e613-4658-4f8c-ad77-7f4217555217 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:58.396123 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dde7e613-4658-4f8c-ad77-7f4217555217 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:58.396920 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dde7e613-4658-4f8c-ad77-7f4217555217 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:58.397602 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dde7e613-4658-4f8c-ad77-7f4217555217 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:58.689858 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-dde7e613-4658-4f8c-ad77-7f4217555217 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:58.699780 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-dde7e613-4658-4f8c-ad77-7f4217555217 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/83037cf6-4a7d-4ba8-8ecb-469feb7598b8" status: 200 len: 1318 microversion: 2.1 time: 0.331944 Sep 08 10:38:58.704125 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 304/593] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:58 2022] GET /compute/v2.1/servers/83037cf6-4a7d-4ba8-8ecb-469feb7598b8 => generated 1318 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:58.714682 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ef0e3852-635a-4830-922f-310fe3e29896 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:58.715747 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ef0e3852-635a-4830-922f-310fe3e29896 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 815705bc-e49e-47a1-864b-9cc550464808] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:58.723626 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef0e3852-635a-4830-922f-310fe3e29896 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:58.724719 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef0e3852-635a-4830-922f-310fe3e29896 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:58.725445 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef0e3852-635a-4830-922f-310fe3e29896 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:58.726382 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef0e3852-635a-4830-922f-310fe3e29896 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:58.727234 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef0e3852-635a-4830-922f-310fe3e29896 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:58.728505 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef0e3852-635a-4830-922f-310fe3e29896 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:59.003488 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ef0e3852-635a-4830-922f-310fe3e29896 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:59.015855 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ef0e3852-635a-4830-922f-310fe3e29896 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808" status: 200 len: 1477 microversion: 2.1 time: 0.310004 Sep 08 10:38:59.016764 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 305/594] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:58 2022] GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808 => generated 1477 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:59.021796 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-cf65909b-14df-424a-8e72-895b44a662da req-476fee91-3b91-4bbe-bd74-eeae8cbb2fd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83037cf6-4a7d-4ba8-8ecb-469feb7598b8", "tag": "a3f2e153-1c65-4344-a6ba-682a68953e59"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:38:59.034584 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-cf65909b-14df-424a-8e72-895b44a662da req-476fee91-3b91-4bbe-bd74-eeae8cbb2fd4 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:59.035684 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-cf65909b-14df-424a-8e72-895b44a662da req-476fee91-3b91-4bbe-bd74-eeae8cbb2fd4 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:59.037340 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-cf65909b-14df-424a-8e72-895b44a662da req-476fee91-3b91-4bbe-bd74-eeae8cbb2fd4 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:59.052589 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-cf65909b-14df-424a-8e72-895b44a662da req-476fee91-3b91-4bbe-bd74-eeae8cbb2fd4 service nova] Creating event network-changed:a3f2e153-1c65-4344-a6ba-682a68953e59 for instance 83037cf6-4a7d-4ba8-8ecb-469feb7598b8 on n-h1-850501-12 Sep 08 10:38:59.060045 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-cf65909b-14df-424a-8e72-895b44a662da req-476fee91-3b91-4bbe-bd74-eeae8cbb2fd4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040479 Sep 08 10:38:59.062214 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 306/595] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:38:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:38:59.068345 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5256567b-61ef-4ba9-b2d5-fd840ee43c6a tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:59.069137 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5256567b-61ef-4ba9-b2d5-fd840ee43c6a tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: ec8a85b1-636c-4699-8042-4dbefbc881f3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:59.076402 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5256567b-61ef-4ba9-b2d5-fd840ee43c6a tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:59.077246 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5256567b-61ef-4ba9-b2d5-fd840ee43c6a tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:59.077690 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5256567b-61ef-4ba9-b2d5-fd840ee43c6a tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:59.078447 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5256567b-61ef-4ba9-b2d5-fd840ee43c6a tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:59.079112 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5256567b-61ef-4ba9-b2d5-fd840ee43c6a tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:59.079697 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5256567b-61ef-4ba9-b2d5-fd840ee43c6a tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:59.448731 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5256567b-61ef-4ba9-b2d5-fd840ee43c6a tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:59.458854 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5256567b-61ef-4ba9-b2d5-fd840ee43c6a tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/ec8a85b1-636c-4699-8042-4dbefbc881f3" status: 200 len: 1503 microversion: 2.1 time: 0.394985 Sep 08 10:38:59.463086 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 307/596] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:59 2022] GET /compute/v2.1/servers/ec8a85b1-636c-4699-8042-4dbefbc881f3 => generated 1503 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:59.477687 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-876461fc-ab3f-4b89-a423-a4b93671f6c5 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:59.478720 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-876461fc-ab3f-4b89-a423-a4b93671f6c5 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] [instance: 1a01253b-8ff8-44d9-961b-1b91de83d671] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:59.496637 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-876461fc-ab3f-4b89-a423-a4b93671f6c5 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:59.497552 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-876461fc-ab3f-4b89-a423-a4b93671f6c5 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:59.498156 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-876461fc-ab3f-4b89-a423-a4b93671f6c5 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:59.499070 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-876461fc-ab3f-4b89-a423-a4b93671f6c5 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:59.503903 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-876461fc-ab3f-4b89-a423-a4b93671f6c5 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:59.504631 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-876461fc-ab3f-4b89-a423-a4b93671f6c5 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:00.212726 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-876461fc-ab3f-4b89-a423-a4b93671f6c5 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4cde361139445eb147c4f634ec663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5388c25cdb4a35ae8d58fa5b6cf125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:00.227037 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-876461fc-ab3f-4b89-a423-a4b93671f6c5 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] 10.222.0.27 "GET /compute/v2.1/servers/1a01253b-8ff8-44d9-961b-1b91de83d671" status: 200 len: 1388 microversion: 2.1 time: 0.762369 Sep 08 10:39:00.229197 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 308/597] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:59 2022] GET /compute/v2.1/servers/1a01253b-8ff8-44d9-961b-1b91de83d671 => generated 1388 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:00.245432 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-73f14b82-e401-41d3-b8a3-b299e8f2c18c tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:00.249564 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-73f14b82-e401-41d3-b8a3-b299e8f2c18c tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: 83037cf6-4a7d-4ba8-8ecb-469feb7598b8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:00.261924 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-73f14b82-e401-41d3-b8a3-b299e8f2c18c tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:00.263501 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-73f14b82-e401-41d3-b8a3-b299e8f2c18c tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:00.264183 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-73f14b82-e401-41d3-b8a3-b299e8f2c18c tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:00.265610 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-73f14b82-e401-41d3-b8a3-b299e8f2c18c tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:00.266398 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-73f14b82-e401-41d3-b8a3-b299e8f2c18c tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:00.267197 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-73f14b82-e401-41d3-b8a3-b299e8f2c18c tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:00.707632 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-73f14b82-e401-41d3-b8a3-b299e8f2c18c tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:00.718997 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-73f14b82-e401-41d3-b8a3-b299e8f2c18c tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/83037cf6-4a7d-4ba8-8ecb-469feb7598b8" status: 200 len: 1318 microversion: 2.1 time: 0.481274 Sep 08 10:39:00.719845 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 309/598] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:00 2022] GET /compute/v2.1/servers/83037cf6-4a7d-4ba8-8ecb-469feb7598b8 => generated 1318 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:00.740860 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-884616f2-ac3f-47fe-84ac-686dc9d7a56a tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:00.741765 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-884616f2-ac3f-47fe-84ac-686dc9d7a56a tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 815705bc-e49e-47a1-864b-9cc550464808] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:00.750106 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-884616f2-ac3f-47fe-84ac-686dc9d7a56a tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:00.750531 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-884616f2-ac3f-47fe-84ac-686dc9d7a56a tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:00.750960 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-884616f2-ac3f-47fe-84ac-686dc9d7a56a tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:00.751677 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-884616f2-ac3f-47fe-84ac-686dc9d7a56a tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:00.752301 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-884616f2-ac3f-47fe-84ac-686dc9d7a56a tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:00.752614 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-884616f2-ac3f-47fe-84ac-686dc9d7a56a tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:01.223891 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-884616f2-ac3f-47fe-84ac-686dc9d7a56a tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:01.243445 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-884616f2-ac3f-47fe-84ac-686dc9d7a56a tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808" status: 200 len: 1477 microversion: 2.1 time: 0.506289 Sep 08 10:39:01.256382 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 310/599] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:00 2022] GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808 => generated 1477 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:01.286244 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bee2a1b0-a105-4c8f-97df-79ef38372e4e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:01.287039 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bee2a1b0-a105-4c8f-97df-79ef38372e4e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: ec8a85b1-636c-4699-8042-4dbefbc881f3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:01.299388 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bee2a1b0-a105-4c8f-97df-79ef38372e4e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:01.301362 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bee2a1b0-a105-4c8f-97df-79ef38372e4e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:01.304189 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bee2a1b0-a105-4c8f-97df-79ef38372e4e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:01.305711 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bee2a1b0-a105-4c8f-97df-79ef38372e4e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:01.307477 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bee2a1b0-a105-4c8f-97df-79ef38372e4e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:01.308098 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bee2a1b0-a105-4c8f-97df-79ef38372e4e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:01.475727 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a403b832-ea8d-4b95-88f9-8676fe1e7f88 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/422ceb5f-740f-45e5-9596-6796719adf27/action" status: 202 len: 0 microversion: 2.25 time: 3.999836 Sep 08 10:39:01.478170 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 290/600] 10.222.0.27 () {62 vars in 1319 bytes} [Thu Sep 8 10:38:57 2022] POST /compute/v2.1/servers/422ceb5f-740f-45e5-9596-6796719adf27/action => generated 0 bytes in 4003 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:39:01.489984 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-64cddced-a9b4-4be8-94fa-791369c67d3e tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:01.490804 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-64cddced-a9b4-4be8-94fa-791369c67d3e tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] [instance: 1a01253b-8ff8-44d9-961b-1b91de83d671] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:01.504509 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64cddced-a9b4-4be8-94fa-791369c67d3e tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:01.506343 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64cddced-a9b4-4be8-94fa-791369c67d3e tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:01.506881 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64cddced-a9b4-4be8-94fa-791369c67d3e tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:01.507692 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64cddced-a9b4-4be8-94fa-791369c67d3e tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:01.508619 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64cddced-a9b4-4be8-94fa-791369c67d3e tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:01.509199 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64cddced-a9b4-4be8-94fa-791369c67d3e tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:01.798430 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-64cddced-a9b4-4be8-94fa-791369c67d3e tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4cde361139445eb147c4f634ec663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5388c25cdb4a35ae8d58fa5b6cf125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:01.817230 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-64cddced-a9b4-4be8-94fa-791369c67d3e tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] 10.222.0.27 "GET /compute/v2.1/servers/1a01253b-8ff8-44d9-961b-1b91de83d671" status: 200 len: 1588 microversion: 2.1 time: 0.336243 Sep 08 10:39:01.818229 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 291/601] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:01 2022] GET /compute/v2.1/servers/1a01253b-8ff8-44d9-961b-1b91de83d671 => generated 1588 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:01.942474 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bee2a1b0-a105-4c8f-97df-79ef38372e4e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:01.957745 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bee2a1b0-a105-4c8f-97df-79ef38372e4e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/ec8a85b1-636c-4699-8042-4dbefbc881f3" status: 200 len: 1503 microversion: 2.1 time: 0.698895 Sep 08 10:39:01.976511 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 311/602] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:01 2022] GET /compute/v2.1/servers/ec8a85b1-636c-4699-8042-4dbefbc881f3 => generated 1503 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:01.988082 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-62447143-acd6-4d05-aaa8-61f1aca02d80 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:01.988892 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-62447143-acd6-4d05-aaa8-61f1aca02d80 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 422ceb5f-740f-45e5-9596-6796719adf27] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:01.995659 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-62447143-acd6-4d05-aaa8-61f1aca02d80 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:01.997862 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-62447143-acd6-4d05-aaa8-61f1aca02d80 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:01.998823 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-62447143-acd6-4d05-aaa8-61f1aca02d80 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:01.999618 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-62447143-acd6-4d05-aaa8-61f1aca02d80 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:02.000577 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-62447143-acd6-4d05-aaa8-61f1aca02d80 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:02.001212 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-62447143-acd6-4d05-aaa8-61f1aca02d80 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:02.087305 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d3167d10-ee14-4975-9373-d64dac9a1515 tempest-QuotaClassesAdminTestJSON-1180182333 tempest-QuotaClassesAdminTestJSON-1180182333-project-admin] Calling method '.version_select at 0x7f68e4a57550>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:02.103252 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d3167d10-ee14-4975-9373-d64dac9a1515 tempest-QuotaClassesAdminTestJSON-1180182333 tempest-QuotaClassesAdminTestJSON-1180182333-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.283552 Sep 08 10:39:02.104076 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 292/603] 10.222.0.27 () {58 vars in 1185 bytes} [Thu Sep 8 10:39:01 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:39:02.109516 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e79e2080-2faf-4a69-9fbb-65b8fdbb9f62 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:02.110422 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e79e2080-2faf-4a69-9fbb-65b8fdbb9f62 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: 83037cf6-4a7d-4ba8-8ecb-469feb7598b8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:02.117268 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e79e2080-2faf-4a69-9fbb-65b8fdbb9f62 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:02.118326 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e79e2080-2faf-4a69-9fbb-65b8fdbb9f62 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:02.119530 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e79e2080-2faf-4a69-9fbb-65b8fdbb9f62 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:02.120482 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e79e2080-2faf-4a69-9fbb-65b8fdbb9f62 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:02.122136 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e79e2080-2faf-4a69-9fbb-65b8fdbb9f62 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:02.122870 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e79e2080-2faf-4a69-9fbb-65b8fdbb9f62 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:02.128026 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:39:02.366289 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-62447143-acd6-4d05-aaa8-61f1aca02d80 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:02.392182 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e79e2080-2faf-4a69-9fbb-65b8fdbb9f62 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:02.408406 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e79e2080-2faf-4a69-9fbb-65b8fdbb9f62 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/83037cf6-4a7d-4ba8-8ecb-469feb7598b8" status: 200 len: 1318 microversion: 2.1 time: 0.302578 Sep 08 10:39:02.410237 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 293/604] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:02 2022] GET /compute/v2.1/servers/83037cf6-4a7d-4ba8-8ecb-469feb7598b8 => generated 1318 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:02.420780 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-73c062ed-5527-435c-9c73-287bb9428cc8 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:02.422162 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-73c062ed-5527-435c-9c73-287bb9428cc8 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] [instance: 1a01253b-8ff8-44d9-961b-1b91de83d671] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:02.423055 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-62447143-acd6-4d05-aaa8-61f1aca02d80 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:02.427592 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-62447143-acd6-4d05-aaa8-61f1aca02d80 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:02.437427 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-62447143-acd6-4d05-aaa8-61f1aca02d80 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/422ceb5f-740f-45e5-9596-6796719adf27" status: 200 len: 1566 microversion: 2.25 time: 0.450525 Sep 08 10:39:02.437869 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-73c062ed-5527-435c-9c73-287bb9428cc8 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:02.438922 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 312/605] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:39:01 2022] GET /compute/v2.1/servers/422ceb5f-740f-45e5-9596-6796719adf27 => generated 1566 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:39:02.439475 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-73c062ed-5527-435c-9c73-287bb9428cc8 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:02.440611 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-73c062ed-5527-435c-9c73-287bb9428cc8 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:02.442144 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-73c062ed-5527-435c-9c73-287bb9428cc8 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:02.443180 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-73c062ed-5527-435c-9c73-287bb9428cc8 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:02.444242 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-73c062ed-5527-435c-9c73-287bb9428cc8 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:02.562138 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-73c062ed-5527-435c-9c73-287bb9428cc8 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] 10.222.0.27 "GET /compute/v2.1/servers/1a01253b-8ff8-44d9-961b-1b91de83d671/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.149260 Sep 08 10:39:02.563062 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 294/606] 10.222.0.27 () {58 vars in 1275 bytes} [Thu Sep 8 10:39:02 2022] GET /compute/v2.1/servers/1a01253b-8ff8-44d9-961b-1b91de83d671/os-interface => generated 285 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:39:02.568672 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-56acc4ff-6b2f-4525-b867-9f568f28343c tempest-QuotaClassesAdminTestJSON-1180182333 tempest-QuotaClassesAdminTestJSON-1180182333-project-admin] Action: 'update', calling method: .version_select at 0x7f68e4ec3940>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:39:02.800710 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=8,nova_api:INSERT=6 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:39:02.870997 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-46ac980e-5a2f-4bc1-a981-6a5cdfae60e9 tempest-QuotasAdminNegativeTest-1037091041 tempest-QuotasAdminNegativeTest-1037091041-project-admin] Calling method '.version_select at 0x7f68e4da1280>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:02.997114 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-46ac980e-5a2f-4bc1-a981-6a5cdfae60e9 tempest-QuotasAdminNegativeTest-1037091041 tempest-QuotasAdminNegativeTest-1037091041-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/aa32aea2a8d94171a573610b4562f643" status: 200 len: 375 microversion: 2.1 time: 0.552763 Sep 08 10:39:02.999073 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 313/607] 10.222.0.27 () {58 vars in 1242 bytes} [Thu Sep 8 10:39:02 2022] GET /compute/v2.1/os-quota-sets/aa32aea2a8d94171a573610b4562f643 => generated 375 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:39:03.008584 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0398a13e-80a1-46c8-98e0-31dc91dac333 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:03.010740 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0398a13e-80a1-46c8-98e0-31dc91dac333 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 815705bc-e49e-47a1-864b-9cc550464808] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:03.021411 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0398a13e-80a1-46c8-98e0-31dc91dac333 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:03.022985 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0398a13e-80a1-46c8-98e0-31dc91dac333 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:03.023806 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0398a13e-80a1-46c8-98e0-31dc91dac333 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:03.024933 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0398a13e-80a1-46c8-98e0-31dc91dac333 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:03.025654 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0398a13e-80a1-46c8-98e0-31dc91dac333 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:03.026496 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0398a13e-80a1-46c8-98e0-31dc91dac333 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:03.077635 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-56acc4ff-6b2f-4525-b867-9f568f28343c tempest-QuotaClassesAdminTestJSON-1180182333 tempest-QuotaClassesAdminTestJSON-1180182333-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.513105 Sep 08 10:39:03.084290 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 295/608] 10.222.0.27 () {60 vars in 1206 bytes} [Thu Sep 8 10:39:02 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:39:03.089097 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fa1fb2a9-9a61-4edb-b567-7e7d6e82be1c tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:03.089715 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fa1fb2a9-9a61-4edb-b567-7e7d6e82be1c tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: ec8a85b1-636c-4699-8042-4dbefbc881f3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:03.097012 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fa1fb2a9-9a61-4edb-b567-7e7d6e82be1c tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:03.097531 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fa1fb2a9-9a61-4edb-b567-7e7d6e82be1c tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:03.097971 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fa1fb2a9-9a61-4edb-b567-7e7d6e82be1c tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:03.098675 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fa1fb2a9-9a61-4edb-b567-7e7d6e82be1c tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:03.099273 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fa1fb2a9-9a61-4edb-b567-7e7d6e82be1c tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:03.099701 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fa1fb2a9-9a61-4edb-b567-7e7d6e82be1c tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:03.250000 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-fa1fb2a9-9a61-4edb-b567-7e7d6e82be1c tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:03.259443 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fa1fb2a9-9a61-4edb-b567-7e7d6e82be1c tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/ec8a85b1-636c-4699-8042-4dbefbc881f3" status: 200 len: 1493 microversion: 2.1 time: 0.174031 Sep 08 10:39:03.260430 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 296/609] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:03 2022] GET /compute/v2.1/servers/ec8a85b1-636c-4699-8042-4dbefbc881f3 => generated 1493 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:03.266517 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c66990e2-e757-4c39-8cac-7e6feb086759 tempest-QuotasAdminNegativeTest-1037091041 tempest-QuotasAdminNegativeTest-1037091041-project-admin] Action: 'update', calling method: .version_select at 0x7f68e4a25940>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:39:03.354919 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c66990e2-e757-4c39-8cac-7e6feb086759 tempest-QuotasAdminNegativeTest-1037091041 tempest-QuotasAdminNegativeTest-1037091041-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:03.354919 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c66990e2-e757-4c39-8cac-7e6feb086759 tempest-QuotasAdminNegativeTest-1037091041 tempest-QuotasAdminNegativeTest-1037091041-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:03.355426 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c66990e2-e757-4c39-8cac-7e6feb086759 tempest-QuotasAdminNegativeTest-1037091041 tempest-QuotasAdminNegativeTest-1037091041-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:03.357265 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c66990e2-e757-4c39-8cac-7e6feb086759 tempest-QuotasAdminNegativeTest-1037091041 tempest-QuotasAdminNegativeTest-1037091041-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:03.357659 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c66990e2-e757-4c39-8cac-7e6feb086759 tempest-QuotasAdminNegativeTest-1037091041 tempest-QuotasAdminNegativeTest-1037091041-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:03.358345 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c66990e2-e757-4c39-8cac-7e6feb086759 tempest-QuotasAdminNegativeTest-1037091041 tempest-QuotasAdminNegativeTest-1037091041-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:03.387832 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0398a13e-80a1-46c8-98e0-31dc91dac333 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:03.400659 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0398a13e-80a1-46c8-98e0-31dc91dac333 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808" status: 200 len: 1477 microversion: 2.1 time: 0.399719 Sep 08 10:39:03.403174 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 314/610] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:02 2022] GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808 => generated 1477 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:03.437775 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c66990e2-e757-4c39-8cac-7e6feb086759 tempest-QuotasAdminNegativeTest-1037091041 tempest-QuotasAdminNegativeTest-1037091041-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/aa32aea2a8d94171a573610b4562f643" status: 200 len: 331 microversion: 2.1 time: 0.176047 Sep 08 10:39:03.439067 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 297/611] 10.222.0.27 () {60 vars in 1262 bytes} [Thu Sep 8 10:39:03 2022] PUT /compute/v2.1/os-quota-sets/aa32aea2a8d94171a573610b4562f643 => generated 331 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:39:03.444481 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e0ce1a20-5815-4b81-a227-2d8ced5cb3e2 tempest-QuotaClassesAdminTestJSON-1180182333 tempest-QuotaClassesAdminTestJSON-1180182333-project-admin] Calling method '.version_select at 0x7f68e4af15e0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:03.459642 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e0ce1a20-5815-4b81-a227-2d8ced5cb3e2 tempest-QuotaClassesAdminTestJSON-1180182333 tempest-QuotaClassesAdminTestJSON-1180182333-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.017828 Sep 08 10:39:03.469721 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 298/612] 10.222.0.27 () {58 vars in 1185 bytes} [Thu Sep 8 10:39:03 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:39:03.475223 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c6201adf-0fb3-48e6-9752-46348c85bd6e tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Calling method '.version_select at 0x7f68e4a54dc0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:03.491847 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c6201adf-0fb3-48e6-9752-46348c85bd6e tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:03.492502 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c6201adf-0fb3-48e6-9752-46348c85bd6e tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:03.493496 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c6201adf-0fb3-48e6-9752-46348c85bd6e tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:03.526104 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0f564c0a-112e-4434-886c-5add3b093be3 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-772212283", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:39:03.536962 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c6201adf-0fb3-48e6-9752-46348c85bd6e tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 1572 microversion: 2.1 time: 0.065918 Sep 08 10:39:03.548296 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 299/613] 10.222.0.27 () {58 vars in 1143 bytes} [Thu Sep 8 10:39:03 2022] GET /compute/v2.1/os-migrations => generated 1572 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:03.560477 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-bd12d49f-17b1-4796-9f80-737bc2cf7285 req-351146da-bb85-469e-acf5-abf1cf7e25ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "493cd490-27c5-4e08-a789-767757111cb2", "name": "network-vif-plugged", "status": "completed", "tag": "9806eb02-bb40-40a3-973c-f43c9af0fd37"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:39:03.572649 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-bd12d49f-17b1-4796-9f80-737bc2cf7285 req-351146da-bb85-469e-acf5-abf1cf7e25ea service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:03.574037 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-bd12d49f-17b1-4796-9f80-737bc2cf7285 req-351146da-bb85-469e-acf5-abf1cf7e25ea service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:03.575598 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-bd12d49f-17b1-4796-9f80-737bc2cf7285 req-351146da-bb85-469e-acf5-abf1cf7e25ea service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:03.596161 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-bd12d49f-17b1-4796-9f80-737bc2cf7285 req-351146da-bb85-469e-acf5-abf1cf7e25ea service nova] Creating event network-vif-plugged:9806eb02-bb40-40a3-973c-f43c9af0fd37 for instance 493cd490-27c5-4e08-a789-767757111cb2 on n-h2-850501-12 Sep 08 10:39:03.602882 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-bd12d49f-17b1-4796-9f80-737bc2cf7285 req-351146da-bb85-469e-acf5-abf1cf7e25ea service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056111 Sep 08 10:39:03.617290 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 300/614] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:39:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:39:03.629444 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1de118a0-b14a-4562-b7af-cedae55ea8ee tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:03.630342 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1de118a0-b14a-4562-b7af-cedae55ea8ee tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: 83037cf6-4a7d-4ba8-8ecb-469feb7598b8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:03.642956 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-0f564c0a-112e-4434-886c-5add3b093be3 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] validate_networks() for None {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:39:03.644725 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1de118a0-b14a-4562-b7af-cedae55ea8ee tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:03.645271 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1de118a0-b14a-4562-b7af-cedae55ea8ee tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:03.645719 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1de118a0-b14a-4562-b7af-cedae55ea8ee tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:03.646439 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1de118a0-b14a-4562-b7af-cedae55ea8ee tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:03.646899 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1de118a0-b14a-4562-b7af-cedae55ea8ee tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:03.650246 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1de118a0-b14a-4562-b7af-cedae55ea8ee tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:04.070973 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1de118a0-b14a-4562-b7af-cedae55ea8ee tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:04.079926 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1de118a0-b14a-4562-b7af-cedae55ea8ee tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/83037cf6-4a7d-4ba8-8ecb-469feb7598b8" status: 200 len: 1318 microversion: 2.1 time: 0.460962 Sep 08 10:39:04.080520 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 301/615] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:03 2022] GET /compute/v2.1/servers/83037cf6-4a7d-4ba8-8ecb-469feb7598b8 => generated 1318 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:04.085251 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-720e475d-2e96-433f-9f1b-f3f6d12c3f0b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:04.085869 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-720e475d-2e96-433f-9f1b-f3f6d12c3f0b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 422ceb5f-740f-45e5-9596-6796719adf27] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:04.092868 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-720e475d-2e96-433f-9f1b-f3f6d12c3f0b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:04.093497 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-720e475d-2e96-433f-9f1b-f3f6d12c3f0b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:04.093829 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-720e475d-2e96-433f-9f1b-f3f6d12c3f0b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:04.094563 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-720e475d-2e96-433f-9f1b-f3f6d12c3f0b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:04.095018 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-720e475d-2e96-433f-9f1b-f3f6d12c3f0b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:04.095438 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-720e475d-2e96-433f-9f1b-f3f6d12c3f0b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:04.246805 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-720e475d-2e96-433f-9f1b-f3f6d12c3f0b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:04.255347 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-720e475d-2e96-433f-9f1b-f3f6d12c3f0b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:04.256829 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-720e475d-2e96-433f-9f1b-f3f6d12c3f0b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:04.258370 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-720e475d-2e96-433f-9f1b-f3f6d12c3f0b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/422ceb5f-740f-45e5-9596-6796719adf27" status: 200 len: 1566 microversion: 2.25 time: 0.176531 Sep 08 10:39:04.258632 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 302/616] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:39:04 2022] GET /compute/v2.1/servers/422ceb5f-740f-45e5-9596-6796719adf27 => generated 1566 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:39:04.281529 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-04dcd262-0681-4dd6-979c-e0b1d67cefc3 tempest-QuotaClassesAdminTestJSON-1180182333 tempest-QuotaClassesAdminTestJSON-1180182333-project-admin] Action: 'update', calling method: .version_select at 0x7f68e4a2ad30>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:39:04.398877 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-04dcd262-0681-4dd6-979c-e0b1d67cefc3 tempest-QuotaClassesAdminTestJSON-1180182333 tempest-QuotaClassesAdminTestJSON-1180182333-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.124429 Sep 08 10:39:04.399633 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 303/617] 10.222.0.27 () {60 vars in 1206 bytes} [Thu Sep 8 10:39:04 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:39:04.404834 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e9634635-8736-447c-bf7c-0b3ec0c02293 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:04.405480 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e9634635-8736-447c-bf7c-0b3ec0c02293 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] [instance: ec8a85b1-636c-4699-8042-4dbefbc881f3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:04.413901 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e9634635-8736-447c-bf7c-0b3ec0c02293 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:04.414410 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e9634635-8736-447c-bf7c-0b3ec0c02293 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:04.414857 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e9634635-8736-447c-bf7c-0b3ec0c02293 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:04.415570 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e9634635-8736-447c-bf7c-0b3ec0c02293 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:04.416124 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e9634635-8736-447c-bf7c-0b3ec0c02293 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:04.416566 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e9634635-8736-447c-bf7c-0b3ec0c02293 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:04.594307 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e9634635-8736-447c-bf7c-0b3ec0c02293 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/ec8a85b1-636c-4699-8042-4dbefbc881f3" status: 200 len: 1646 microversion: 2.1 time: 0.193597 Sep 08 10:39:04.609787 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 304/618] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:04 2022] GET /compute/v2.1/servers/ec8a85b1-636c-4699-8042-4dbefbc881f3 => generated 1646 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:04.638919 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-0f564c0a-112e-4434-886c-5add3b093be3 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:39:04.640282 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-0f564c0a-112e-4434-886c-5add3b093be3 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:39:04.641007 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-0f564c0a-112e-4434-886c-5add3b093be3 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:39:04.641911 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-0f564c0a-112e-4434-886c-5add3b093be3 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:39:04.642560 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-0f564c0a-112e-4434-886c-5add3b093be3 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:39:04.657001 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f564c0a-112e-4434-886c-5add3b093be3 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:04.657939 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f564c0a-112e-4434-886c-5add3b093be3 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:04.658617 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f564c0a-112e-4434-886c-5add3b093be3 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:04.659639 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f564c0a-112e-4434-886c-5add3b093be3 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:04.660833 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f564c0a-112e-4434-886c-5add3b093be3 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:04.661931 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f564c0a-112e-4434-886c-5add3b093be3 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:04.689639 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-0f564c0a-112e-4434-886c-5add3b093be3 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Getting quotas for project 07bc2a412ede463e94d6933c30bc06ab. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:39:04.696762 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-0f564c0a-112e-4434-886c-5add3b093be3 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Getting quotas for user dad3d26d79c34a0c90a99eeaa85f6e26 and project 07bc2a412ede463e94d6933c30bc06ab. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:39:04.714603 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0f564c0a-112e-4434-886c-5add3b093be3 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:39:04.719244 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0f564c0a-112e-4434-886c-5add3b093be3 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] [instance: c7a958dd-d267-4932-b7d1-6e50d6c1b21e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:39:04.788764 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0f564c0a-112e-4434-886c-5add3b093be3 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.383779 Sep 08 10:39:04.797176 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 315/619] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:39:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1393 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:39:04.804559 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-36584c77-f903-4f2f-8a88-333212c01eaf tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:04.805601 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-36584c77-f903-4f2f-8a88-333212c01eaf tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 815705bc-e49e-47a1-864b-9cc550464808] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:04.815192 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36584c77-f903-4f2f-8a88-333212c01eaf tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:04.816040 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36584c77-f903-4f2f-8a88-333212c01eaf tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:04.816814 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36584c77-f903-4f2f-8a88-333212c01eaf tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:04.818153 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36584c77-f903-4f2f-8a88-333212c01eaf tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:04.819133 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36584c77-f903-4f2f-8a88-333212c01eaf tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:04.819819 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36584c77-f903-4f2f-8a88-333212c01eaf tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:04.980687 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b03f24d2-a11f-42c5-8393-26d4b64b5547 tempest-QuotasAdminNegativeTest-359616318 tempest-QuotasAdminNegativeTest-359616318-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1752206351", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:39:05.065488 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-b03f24d2-a11f-42c5-8393-26d4b64b5547 tempest-QuotasAdminNegativeTest-359616318 tempest-QuotasAdminNegativeTest-359616318-project] validate_networks() for None {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:39:05.140450 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-36584c77-f903-4f2f-8a88-333212c01eaf tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:05.156469 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-36584c77-f903-4f2f-8a88-333212c01eaf tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808" status: 200 len: 1477 microversion: 2.1 time: 0.356957 Sep 08 10:39:05.157979 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 316/620] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:04 2022] GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808 => generated 1477 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:05.165228 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2737d30c-b5e9-4892-ace2-331c0a828802 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-2147173420", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "15b153a9-4f79-4605-9c99-0d83878931cf"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:39:05.264983 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-2737d30c-b5e9-4892-ace2-331c0a828802 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] validate_networks() for [('15b153a9-4f79-4605-9c99-0d83878931cf', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:39:05.383294 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-b03f24d2-a11f-42c5-8393-26d4b64b5547 tempest-QuotasAdminNegativeTest-359616318 tempest-QuotasAdminNegativeTest-359616318-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:39:05.384006 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-b03f24d2-a11f-42c5-8393-26d4b64b5547 tempest-QuotasAdminNegativeTest-359616318 tempest-QuotasAdminNegativeTest-359616318-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:39:05.384488 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-b03f24d2-a11f-42c5-8393-26d4b64b5547 tempest-QuotasAdminNegativeTest-359616318 tempest-QuotasAdminNegativeTest-359616318-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:39:05.385068 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-b03f24d2-a11f-42c5-8393-26d4b64b5547 tempest-QuotasAdminNegativeTest-359616318 tempest-QuotasAdminNegativeTest-359616318-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:39:05.385568 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-b03f24d2-a11f-42c5-8393-26d4b64b5547 tempest-QuotasAdminNegativeTest-359616318 tempest-QuotasAdminNegativeTest-359616318-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:39:05.401781 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b03f24d2-a11f-42c5-8393-26d4b64b5547 tempest-QuotasAdminNegativeTest-359616318 tempest-QuotasAdminNegativeTest-359616318-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:05.402280 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b03f24d2-a11f-42c5-8393-26d4b64b5547 tempest-QuotasAdminNegativeTest-359616318 tempest-QuotasAdminNegativeTest-359616318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:05.405362 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b03f24d2-a11f-42c5-8393-26d4b64b5547 tempest-QuotasAdminNegativeTest-359616318 tempest-QuotasAdminNegativeTest-359616318-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:05.410233 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b03f24d2-a11f-42c5-8393-26d4b64b5547 tempest-QuotasAdminNegativeTest-359616318 tempest-QuotasAdminNegativeTest-359616318-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:05.411138 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b03f24d2-a11f-42c5-8393-26d4b64b5547 tempest-QuotasAdminNegativeTest-359616318 tempest-QuotasAdminNegativeTest-359616318-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:05.411741 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b03f24d2-a11f-42c5-8393-26d4b64b5547 tempest-QuotasAdminNegativeTest-359616318 tempest-QuotasAdminNegativeTest-359616318-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:05.446252 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-b03f24d2-a11f-42c5-8393-26d4b64b5547 tempest-QuotasAdminNegativeTest-359616318 tempest-QuotasAdminNegativeTest-359616318-project] Getting quotas for project aa32aea2a8d94171a573610b4562f643. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:39:05.452461 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-b03f24d2-a11f-42c5-8393-26d4b64b5547 tempest-QuotasAdminNegativeTest-359616318 tempest-QuotasAdminNegativeTest-359616318-project] Getting quotas for user 4031f73b38214174ac528c1f0fe3144c and project aa32aea2a8d94171a573610b4562f643. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:39:05.469408 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.utils [None req-b03f24d2-a11f-42c5-8393-26d4b64b5547 tempest-QuotasAdminNegativeTest-359616318 tempest-QuotasAdminNegativeTest-359616318-project] cores quota exceeded for aa32aea2a8d94171a573610b4562f643, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=128861) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Sep 08 10:39:05.470302 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-b03f24d2-a11f-42c5-8393-26d4b64b5547 tempest-QuotasAdminNegativeTest-359616318 tempest-QuotasAdminNegativeTest-359616318-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 08 10:39:05.475749 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b03f24d2-a11f-42c5-8393-26d4b64b5547 tempest-QuotasAdminNegativeTest-359616318 tempest-QuotasAdminNegativeTest-359616318-project] Request method failure captured: Sep 08 10:39:05.475749 n-d-850501-12 devstack@n-api.service[128861]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 10:39:05.475749 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:39:05.475749 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:39:05.475749 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:39:05.475749 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 145 Sep 08 10:39:05.475749 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:39:05.475749 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:39:05.475749 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:39:05.475749 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:39:05.475749 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcZEmgFYArtgeXDxJnAbUCdIfqotVtGXkZLXqqPZBBM2UYCvVyyokSkM4VqLPezRd8VXjIs8qyY416z4LPITQDe97Z2Ee7It-I9BfBpnXVrY8h9tDa4PkZf8l6w9VVFwEKEZaVlbPv9DiVuZQLv7v3m5zy8vFT6irBdusPJ8JVCzRFc Sep 08 10:39:05.475749 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:39:05.475749 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:39:05.475749 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:39:05.475749 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:39:05.475749 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:39:05.475749 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:39:05.475749 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: aa32aea2a8d94171a573610b4562f643 Sep 08 10:39:05.475749 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-QuotasAdminNegativeTest-359616318 Sep 08 10:39:05.475749 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:39:05.475749 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:39:05.477514 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/aa32aea2a8d94171a573610b4562f643"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/aa32aea2a8d94171a573610b4562f643"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_aa32aea2a8d94171a573610b4562f643"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/aa32aea2a8d94171a573610b4562f643"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:39:05.477514 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-QuotasAdminNegativeTest-359616318 Sep 08 10:39:05.477514 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: aa32aea2a8d94171a573610b4562f643 Sep 08 10:39:05.477514 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-359616318 Sep 08 10:39:05.477514 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-QuotasAdminNegativeTest-359616318-project Sep 08 10:39:05.477514 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:39:05.477514 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:39:05.477514 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 4031f73b38214174ac528c1f0fe3144c Sep 08 10:39:05.477514 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-QuotasAdminNegativeTest-359616318-project Sep 08 10:39:05.477514 n-d-850501-12 devstack@n-api.service[128861]: Sep 08 10:39:05.477514 n-d-850501-12 devstack@n-api.service[128861]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1752206351", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452"}} Sep 08 10:39:05.477514 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:39:05.478421 n-d-850501-12 devstack@n-api.service[128861]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 08 10:39:05.478421 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1752206351', 'imageRef': '503f4a0f-e18f-47fd-ad12-0289e3463117', 'flavorRef': '452'}}} Sep 08 10:39:05.478421 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:39:05.478421 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:39:05.478421 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Sep 08 10:39:05.478421 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Sep 08 10:39:05.478421 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 10:39:05.478421 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 10:39:05.478421 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 08 10:39:05.478421 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc Sep 08 10:39:05.478421 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 08 10:39:05.478421 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 08 10:39:05.478421 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 10:39:05.478421 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 10:39:05.478421 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 08 10:39:05.478421 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 08 10:39:05.478421 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 08 10:39:05.478421 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 08 10:39:05.484367 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Sep 08 10:39:05.484367 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 08 10:39:05.484367 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Sep 08 10:39:05.484367 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:39:05.484367 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:39:05.484367 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:39:05.484367 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:39:05.484367 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 08 10:39:05.484367 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 08 10:39:05.484367 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 08 10:39:05.484367 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 08 10:39:05.484367 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Sep 08 10:39:05.484367 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Sep 08 10:39:05.484367 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Sep 08 10:39:05.484367 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Sep 08 10:39:05.484367 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Sep 08 10:39:05.484367 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 08 10:39:05.484367 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 08 10:39:05.484367 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:39:05.484367 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:39:05.484367 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:39:05.486038 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:39:05.486038 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:39:05.486038 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:39:05.486038 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:39:05.486038 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:39:05.486038 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:39:05.486038 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:39:05.486038 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:39:05.486038 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:39:05.486038 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:39:05.486038 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:39:05.486038 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:39:05.486038 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:39:05.486038 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 08 10:39:05.486038 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 08 10:39:05.486038 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 08 10:39:05.486038 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 08 10:39:05.486038 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:39:05.486038 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:39:05.486038 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:39:05.486038 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:39:05.487834 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:39:05.487834 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:39:05.487834 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:39:05.487834 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:39:05.487834 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 08 10:39:05.487834 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:39:05.487834 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b03f24d2-a11f-42c5-8393-26d4b64b5547 tempest-QuotasAdminNegativeTest-359616318 tempest-QuotasAdminNegativeTest-359616318-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:39:05.487834 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b03f24d2-a11f-42c5-8393-26d4b64b5547 tempest-QuotasAdminNegativeTest-359616318 tempest-QuotasAdminNegativeTest-359616318-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.865479 Sep 08 10:39:05.487834 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 305/621] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:39:04 2022] POST /compute/v2.1/servers => generated 111 bytes in 869 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:39:05.499149 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4a350c22-5a3b-47fc-818d-f9ea7217b18a tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:05.499844 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4a350c22-5a3b-47fc-818d-f9ea7217b18a tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] [instance: c7a958dd-d267-4932-b7d1-6e50d6c1b21e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:05.521720 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a350c22-5a3b-47fc-818d-f9ea7217b18a tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:05.526540 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a350c22-5a3b-47fc-818d-f9ea7217b18a tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:05.527099 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a350c22-5a3b-47fc-818d-f9ea7217b18a tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:05.528246 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a350c22-5a3b-47fc-818d-f9ea7217b18a tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:05.528760 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a350c22-5a3b-47fc-818d-f9ea7217b18a tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:05.530265 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a350c22-5a3b-47fc-818d-f9ea7217b18a tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:05.665751 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4a350c22-5a3b-47fc-818d-f9ea7217b18a tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad3d26d79c34a0c90a99eeaa85f6e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bc2a412ede463e94d6933c30bc06ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:05.679174 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4a350c22-5a3b-47fc-818d-f9ea7217b18a tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] 10.222.0.27 "GET /compute/v2.1/servers/c7a958dd-d267-4932-b7d1-6e50d6c1b21e" status: 200 len: 1217 microversion: 2.1 time: 0.192102 Sep 08 10:39:05.689061 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 306/622] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:05 2022] GET /compute/v2.1/servers/c7a958dd-d267-4932-b7d1-6e50d6c1b21e => generated 1217 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:05.696994 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ec346e92-6132-4b28-a4fd-92ae6ac45229 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:05.696994 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ec346e92-6132-4b28-a4fd-92ae6ac45229 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: 83037cf6-4a7d-4ba8-8ecb-469feb7598b8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:05.708793 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ec346e92-6132-4b28-a4fd-92ae6ac45229 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:05.711493 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ec346e92-6132-4b28-a4fd-92ae6ac45229 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:05.713479 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ec346e92-6132-4b28-a4fd-92ae6ac45229 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:05.716469 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ec346e92-6132-4b28-a4fd-92ae6ac45229 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:05.717532 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ec346e92-6132-4b28-a4fd-92ae6ac45229 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:05.718062 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ec346e92-6132-4b28-a4fd-92ae6ac45229 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:05.982511 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ec346e92-6132-4b28-a4fd-92ae6ac45229 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:06.000719 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ec346e92-6132-4b28-a4fd-92ae6ac45229 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/83037cf6-4a7d-4ba8-8ecb-469feb7598b8" status: 200 len: 1318 microversion: 2.1 time: 0.315808 Sep 08 10:39:06.001821 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 307/623] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:05 2022] GET /compute/v2.1/servers/83037cf6-4a7d-4ba8-8ecb-469feb7598b8 => generated 1318 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:06.029828 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a8e0c301-ac13-46be-9665-ce92ccb7f03f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:06.030469 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a8e0c301-ac13-46be-9665-ce92ccb7f03f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 422ceb5f-740f-45e5-9596-6796719adf27] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:06.038446 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=7,nova_api:UPDATE=17 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:39:06.045397 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a8e0c301-ac13-46be-9665-ce92ccb7f03f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:06.046326 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a8e0c301-ac13-46be-9665-ce92ccb7f03f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:06.046462 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a8e0c301-ac13-46be-9665-ce92ccb7f03f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:06.047096 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a8e0c301-ac13-46be-9665-ce92ccb7f03f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:06.047638 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a8e0c301-ac13-46be-9665-ce92ccb7f03f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:06.048075 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a8e0c301-ac13-46be-9665-ce92ccb7f03f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:06.077370 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-2737d30c-b5e9-4892-ace2-331c0a828802 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:39:06.077370 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-2737d30c-b5e9-4892-ace2-331c0a828802 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:39:06.077370 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-2737d30c-b5e9-4892-ace2-331c0a828802 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:39:06.077370 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-2737d30c-b5e9-4892-ace2-331c0a828802 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:39:06.077370 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-2737d30c-b5e9-4892-ace2-331c0a828802 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:39:06.103715 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2737d30c-b5e9-4892-ace2-331c0a828802 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:06.107071 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2737d30c-b5e9-4892-ace2-331c0a828802 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:06.107523 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2737d30c-b5e9-4892-ace2-331c0a828802 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:06.110275 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2737d30c-b5e9-4892-ace2-331c0a828802 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:06.114253 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2737d30c-b5e9-4892-ace2-331c0a828802 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:06.114763 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2737d30c-b5e9-4892-ace2-331c0a828802 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:06.161734 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:39:06.175357 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-2737d30c-b5e9-4892-ace2-331c0a828802 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Getting quotas for project c7f9807a4eb2473e87377097b0544d0e. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:39:06.183013 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-2737d30c-b5e9-4892-ace2-331c0a828802 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Getting quotas for user 3ecf9924d86b4fd38a6f31430e9d3418 and project c7f9807a4eb2473e87377097b0544d0e. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:39:06.203869 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2737d30c-b5e9-4892-ace2-331c0a828802 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:39:06.218632 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2737d30c-b5e9-4892-ace2-331c0a828802 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 1fc866b1-81ac-4c09-86ab-6d8a4a580294] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:39:06.288043 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2737d30c-b5e9-4892-ace2-331c0a828802 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.128096 Sep 08 10:39:06.289229 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 317/624] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:39:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1130 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:39:06.296451 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fa9f822e-491a-4e0d-9f4a-f840397b9d8f tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:06.297982 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fa9f822e-491a-4e0d-9f4a-f840397b9d8f tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] [instance: 1a01253b-8ff8-44d9-961b-1b91de83d671] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:06.310343 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fa9f822e-491a-4e0d-9f4a-f840397b9d8f tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:06.311757 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fa9f822e-491a-4e0d-9f4a-f840397b9d8f tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:06.312492 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fa9f822e-491a-4e0d-9f4a-f840397b9d8f tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:06.313431 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fa9f822e-491a-4e0d-9f4a-f840397b9d8f tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:06.314342 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fa9f822e-491a-4e0d-9f4a-f840397b9d8f tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:06.315083 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fa9f822e-491a-4e0d-9f4a-f840397b9d8f tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:06.339038 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a8e0c301-ac13-46be-9665-ce92ccb7f03f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:06.350123 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a8e0c301-ac13-46be-9665-ce92ccb7f03f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:06.352544 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a8e0c301-ac13-46be-9665-ce92ccb7f03f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:06.353792 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a8e0c301-ac13-46be-9665-ce92ccb7f03f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/422ceb5f-740f-45e5-9596-6796719adf27" status: 200 len: 1566 microversion: 2.25 time: 0.349481 Sep 08 10:39:06.357633 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 308/625] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:39:06 2022] GET /compute/v2.1/servers/422ceb5f-740f-45e5-9596-6796719adf27 => generated 1566 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:39:06.367179 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-18c255e8-1d22-42d7-bade-a8aeed6a1981 req-a3325b11-ec74-4d09-a31d-0cb11fe06c88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a01253b-8ff8-44d9-961b-1b91de83d671", "tag": "65a6d6d7-af12-4f90-9ea8-61dc9032943b"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:39:06.392044 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-18c255e8-1d22-42d7-bade-a8aeed6a1981 req-a3325b11-ec74-4d09-a31d-0cb11fe06c88 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:06.392885 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-18c255e8-1d22-42d7-bade-a8aeed6a1981 req-a3325b11-ec74-4d09-a31d-0cb11fe06c88 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:06.395123 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-18c255e8-1d22-42d7-bade-a8aeed6a1981 req-a3325b11-ec74-4d09-a31d-0cb11fe06c88 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:06.426913 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-18c255e8-1d22-42d7-bade-a8aeed6a1981 req-a3325b11-ec74-4d09-a31d-0cb11fe06c88 service nova] Creating event network-changed:65a6d6d7-af12-4f90-9ea8-61dc9032943b for instance 1a01253b-8ff8-44d9-961b-1b91de83d671 on n-h2-850501-12 Sep 08 10:39:06.443995 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-18c255e8-1d22-42d7-bade-a8aeed6a1981 req-a3325b11-ec74-4d09-a31d-0cb11fe06c88 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082281 Sep 08 10:39:06.446759 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 309/626] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:39:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:39:06.461902 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a544365e-98a5-47cf-9a98-76ca20baca2c tempest-QuotasAdminNegativeTest-1037091041 tempest-QuotasAdminNegativeTest-1037091041-project-admin] Action: 'update', calling method: .version_select at 0x7f68e49cbb80>, body: {"quota_set": {"cores": 120}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:39:06.924657 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a544365e-98a5-47cf-9a98-76ca20baca2c tempest-QuotasAdminNegativeTest-1037091041 tempest-QuotasAdminNegativeTest-1037091041-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:06.925291 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a544365e-98a5-47cf-9a98-76ca20baca2c tempest-QuotasAdminNegativeTest-1037091041 tempest-QuotasAdminNegativeTest-1037091041-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:06.925566 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a544365e-98a5-47cf-9a98-76ca20baca2c tempest-QuotasAdminNegativeTest-1037091041 tempest-QuotasAdminNegativeTest-1037091041-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:06.928710 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a544365e-98a5-47cf-9a98-76ca20baca2c tempest-QuotasAdminNegativeTest-1037091041 tempest-QuotasAdminNegativeTest-1037091041-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:06.929384 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a544365e-98a5-47cf-9a98-76ca20baca2c tempest-QuotasAdminNegativeTest-1037091041 tempest-QuotasAdminNegativeTest-1037091041-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:06.930030 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a544365e-98a5-47cf-9a98-76ca20baca2c tempest-QuotasAdminNegativeTest-1037091041 tempest-QuotasAdminNegativeTest-1037091041-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:06.984040 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fa9f822e-491a-4e0d-9f4a-f840397b9d8f tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4cde361139445eb147c4f634ec663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5388c25cdb4a35ae8d58fa5b6cf125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:06.992967 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fa9f822e-491a-4e0d-9f4a-f840397b9d8f tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] 10.222.0.27 "GET /compute/v2.1/servers/1a01253b-8ff8-44d9-961b-1b91de83d671" status: 200 len: 1588 microversion: 2.1 time: 0.702319 Sep 08 10:39:06.997459 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 318/627] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:06 2022] GET /compute/v2.1/servers/1a01253b-8ff8-44d9-961b-1b91de83d671 => generated 1588 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:07.010412 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-e9225a09-9e13-451a-8c5a-8f39699db9f4 req-87638617-784a-4b5a-b627-88ea909694ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83037cf6-4a7d-4ba8-8ecb-469feb7598b8", "name": "network-vif-plugged", "status": "completed", "tag": "a3f2e153-1c65-4344-a6ba-682a68953e59"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:39:07.036148 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e9225a09-9e13-451a-8c5a-8f39699db9f4 req-87638617-784a-4b5a-b627-88ea909694ba service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:07.036457 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a544365e-98a5-47cf-9a98-76ca20baca2c tempest-QuotasAdminNegativeTest-1037091041 tempest-QuotasAdminNegativeTest-1037091041-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/aa32aea2a8d94171a573610b4562f643" status: 200 len: 330 microversion: 2.1 time: 0.587692 Sep 08 10:39:07.037452 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 310/628] 10.222.0.27 () {60 vars in 1262 bytes} [Thu Sep 8 10:39:06 2022] PUT /compute/v2.1/os-quota-sets/aa32aea2a8d94171a573610b4562f643 => generated 330 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:39:07.042285 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-088e64f5-3e22-49ac-a498-2fe0fe2cf93c tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:07.045589 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-088e64f5-3e22-49ac-a498-2fe0fe2cf93c tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 815705bc-e49e-47a1-864b-9cc550464808] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:07.046107 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e9225a09-9e13-451a-8c5a-8f39699db9f4 req-87638617-784a-4b5a-b627-88ea909694ba service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:07.046662 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e9225a09-9e13-451a-8c5a-8f39699db9f4 req-87638617-784a-4b5a-b627-88ea909694ba service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:07.053451 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-088e64f5-3e22-49ac-a498-2fe0fe2cf93c tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:07.053952 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-088e64f5-3e22-49ac-a498-2fe0fe2cf93c tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:07.054535 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-088e64f5-3e22-49ac-a498-2fe0fe2cf93c tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:07.055104 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-088e64f5-3e22-49ac-a498-2fe0fe2cf93c tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:07.055558 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-088e64f5-3e22-49ac-a498-2fe0fe2cf93c tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:07.056053 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-088e64f5-3e22-49ac-a498-2fe0fe2cf93c tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:07.079127 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-e9225a09-9e13-451a-8c5a-8f39699db9f4 req-87638617-784a-4b5a-b627-88ea909694ba service nova] Creating event network-vif-plugged:a3f2e153-1c65-4344-a6ba-682a68953e59 for instance 83037cf6-4a7d-4ba8-8ecb-469feb7598b8 on n-h1-850501-12 Sep 08 10:39:07.096890 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-e9225a09-9e13-451a-8c5a-8f39699db9f4 req-87638617-784a-4b5a-b627-88ea909694ba service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097885 Sep 08 10:39:07.097691 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 319/629] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:39:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:39:07.111238 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3e697d3e-c4bd-4924-9210-27e189c3bd68 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:07.112831 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3e697d3e-c4bd-4924-9210-27e189c3bd68 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 1fc866b1-81ac-4c09-86ab-6d8a4a580294] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:07.310455 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-088e64f5-3e22-49ac-a498-2fe0fe2cf93c tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:07.321893 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-088e64f5-3e22-49ac-a498-2fe0fe2cf93c tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808" status: 200 len: 1477 microversion: 2.1 time: 0.283325 Sep 08 10:39:07.323072 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 311/630] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:07 2022] GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808 => generated 1477 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:07.328464 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d03dc367-c715-4570-bf3d-6a138b10096a tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:07.329512 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d03dc367-c715-4570-bf3d-6a138b10096a tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] [instance: c7a958dd-d267-4932-b7d1-6e50d6c1b21e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:07.359912 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d03dc367-c715-4570-bf3d-6a138b10096a tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:07.360794 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d03dc367-c715-4570-bf3d-6a138b10096a tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:07.361584 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d03dc367-c715-4570-bf3d-6a138b10096a tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:07.364101 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d03dc367-c715-4570-bf3d-6a138b10096a tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:07.364866 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d03dc367-c715-4570-bf3d-6a138b10096a tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:07.367900 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d03dc367-c715-4570-bf3d-6a138b10096a tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:07.513869 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d03dc367-c715-4570-bf3d-6a138b10096a tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad3d26d79c34a0c90a99eeaa85f6e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bc2a412ede463e94d6933c30bc06ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:07.528732 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d03dc367-c715-4570-bf3d-6a138b10096a tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] 10.222.0.27 "GET /compute/v2.1/servers/c7a958dd-d267-4932-b7d1-6e50d6c1b21e" status: 200 len: 1265 microversion: 2.1 time: 0.204142 Sep 08 10:39:07.529242 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 312/631] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:07 2022] GET /compute/v2.1/servers/c7a958dd-d267-4932-b7d1-6e50d6c1b21e => generated 1265 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:07.545253 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-95e54bb2-fc80-4277-8a32-d8a7faf15201 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:07.545253 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-95e54bb2-fc80-4277-8a32-d8a7faf15201 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: 83037cf6-4a7d-4ba8-8ecb-469feb7598b8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:07.555776 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-95e54bb2-fc80-4277-8a32-d8a7faf15201 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:07.558372 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-95e54bb2-fc80-4277-8a32-d8a7faf15201 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:07.558985 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-95e54bb2-fc80-4277-8a32-d8a7faf15201 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:07.585812 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-95e54bb2-fc80-4277-8a32-d8a7faf15201 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:07.586406 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-95e54bb2-fc80-4277-8a32-d8a7faf15201 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:07.586869 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-95e54bb2-fc80-4277-8a32-d8a7faf15201 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:07.710580 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3e697d3e-c4bd-4924-9210-27e189c3bd68 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:07.718793 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3e697d3e-c4bd-4924-9210-27e189c3bd68 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/1fc866b1-81ac-4c09-86ab-6d8a4a580294" status: 200 len: 1211 microversion: 2.1 time: 0.619407 Sep 08 10:39:07.733760 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 320/632] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:07 2022] GET /compute/v2.1/servers/1fc866b1-81ac-4c09-86ab-6d8a4a580294 => generated 1211 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:07.733760 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bb55bc01-1479-4fd5-986c-7c7db99fc214 tempest-QuotasAdminNegativeTest-1037091041 tempest-QuotasAdminNegativeTest-1037091041-project-admin] Calling method '.version_select at 0x7f68e4cf39d0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:07.942610 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-95e54bb2-fc80-4277-8a32-d8a7faf15201 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:07.955999 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-95e54bb2-fc80-4277-8a32-d8a7faf15201 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/83037cf6-4a7d-4ba8-8ecb-469feb7598b8" status: 200 len: 1318 microversion: 2.1 time: 0.425615 Sep 08 10:39:07.969604 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 313/633] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:07 2022] GET /compute/v2.1/servers/83037cf6-4a7d-4ba8-8ecb-469feb7598b8 => generated 1318 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:07.990345 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c2ca96d2-6e8f-4b2d-89d3-e0336e18e869 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:07.994480 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c2ca96d2-6e8f-4b2d-89d3-e0336e18e869 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 422ceb5f-740f-45e5-9596-6796719adf27] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:08.016800 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c2ca96d2-6e8f-4b2d-89d3-e0336e18e869 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:08.017640 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c2ca96d2-6e8f-4b2d-89d3-e0336e18e869 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:08.018357 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c2ca96d2-6e8f-4b2d-89d3-e0336e18e869 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:08.019144 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c2ca96d2-6e8f-4b2d-89d3-e0336e18e869 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:08.020027 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c2ca96d2-6e8f-4b2d-89d3-e0336e18e869 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:08.020451 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c2ca96d2-6e8f-4b2d-89d3-e0336e18e869 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:08.290880 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bb55bc01-1479-4fd5-986c-7c7db99fc214 tempest-QuotasAdminNegativeTest-1037091041 tempest-QuotasAdminNegativeTest-1037091041-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/aa32aea2a8d94171a573610b4562f643" status: 200 len: 372 microversion: 2.1 time: 0.566254 Sep 08 10:39:08.300763 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 321/634] 10.222.0.27 () {58 vars in 1242 bytes} [Thu Sep 8 10:39:07 2022] GET /compute/v2.1/os-quota-sets/aa32aea2a8d94171a573610b4562f643 => generated 372 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:39:08.308051 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4ea50acd-bbcf-4ac3-be74-a3bfa0774155 tempest-QuotasAdminNegativeTest-1037091041 tempest-QuotasAdminNegativeTest-1037091041-project-admin] Action: 'update', calling method: .version_select at 0x7f68e4f50820>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:39:08.553870 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c2ca96d2-6e8f-4b2d-89d3-e0336e18e869 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:08.568475 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c2ca96d2-6e8f-4b2d-89d3-e0336e18e869 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:08.571155 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c2ca96d2-6e8f-4b2d-89d3-e0336e18e869 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:08.575240 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c2ca96d2-6e8f-4b2d-89d3-e0336e18e869 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/422ceb5f-740f-45e5-9596-6796719adf27" status: 200 len: 1566 microversion: 2.25 time: 0.610085 Sep 08 10:39:08.596180 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 314/635] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:39:07 2022] GET /compute/v2.1/servers/422ceb5f-740f-45e5-9596-6796719adf27 => generated 1566 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:39:08.604784 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9b9bcfc5-b7be-4e8b-be0c-30d747529bc8 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:08.606693 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9b9bcfc5-b7be-4e8b-be0c-30d747529bc8 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 815705bc-e49e-47a1-864b-9cc550464808] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:08.615004 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9b9bcfc5-b7be-4e8b-be0c-30d747529bc8 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:08.616003 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9b9bcfc5-b7be-4e8b-be0c-30d747529bc8 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:08.616689 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9b9bcfc5-b7be-4e8b-be0c-30d747529bc8 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:08.618425 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9b9bcfc5-b7be-4e8b-be0c-30d747529bc8 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:08.619124 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9b9bcfc5-b7be-4e8b-be0c-30d747529bc8 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:08.619763 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9b9bcfc5-b7be-4e8b-be0c-30d747529bc8 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:08.774504 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ea50acd-bbcf-4ac3-be74-a3bfa0774155 tempest-QuotasAdminNegativeTest-1037091041 tempest-QuotasAdminNegativeTest-1037091041-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:08.775474 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ea50acd-bbcf-4ac3-be74-a3bfa0774155 tempest-QuotasAdminNegativeTest-1037091041 tempest-QuotasAdminNegativeTest-1037091041-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:08.776136 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ea50acd-bbcf-4ac3-be74-a3bfa0774155 tempest-QuotasAdminNegativeTest-1037091041 tempest-QuotasAdminNegativeTest-1037091041-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:08.778000 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ea50acd-bbcf-4ac3-be74-a3bfa0774155 tempest-QuotasAdminNegativeTest-1037091041 tempest-QuotasAdminNegativeTest-1037091041-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:08.778749 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ea50acd-bbcf-4ac3-be74-a3bfa0774155 tempest-QuotasAdminNegativeTest-1037091041 tempest-QuotasAdminNegativeTest-1037091041-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:08.779452 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ea50acd-bbcf-4ac3-be74-a3bfa0774155 tempest-QuotasAdminNegativeTest-1037091041 tempest-QuotasAdminNegativeTest-1037091041-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:08.848249 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4ea50acd-bbcf-4ac3-be74-a3bfa0774155 tempest-QuotasAdminNegativeTest-1037091041 tempest-QuotasAdminNegativeTest-1037091041-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/aa32aea2a8d94171a573610b4562f643" status: 200 len: 329 microversion: 2.1 time: 0.545492 Sep 08 10:39:08.848905 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 322/636] 10.222.0.27 () {60 vars in 1262 bytes} [Thu Sep 8 10:39:08 2022] PUT /compute/v2.1/os-quota-sets/aa32aea2a8d94171a573610b4562f643 => generated 329 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:39:08.854277 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-0f58dbba-1cc2-44f0-a75a-c4e84ee0f9a5 req-54de333a-ae36-4791-afb7-b7cf424d3d20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "422ceb5f-740f-45e5-9596-6796719adf27", "name": "network-vif-unplugged", "status": "completed", "tag": "9dcf1823-c8b6-4d30-88b4-559bc9d90002"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:39:08.878238 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-0f58dbba-1cc2-44f0-a75a-c4e84ee0f9a5 req-54de333a-ae36-4791-afb7-b7cf424d3d20 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:08.879058 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-0f58dbba-1cc2-44f0-a75a-c4e84ee0f9a5 req-54de333a-ae36-4791-afb7-b7cf424d3d20 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:08.880699 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-0f58dbba-1cc2-44f0-a75a-c4e84ee0f9a5 req-54de333a-ae36-4791-afb7-b7cf424d3d20 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:08.892300 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:39:08.912308 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-0f58dbba-1cc2-44f0-a75a-c4e84ee0f9a5 req-54de333a-ae36-4791-afb7-b7cf424d3d20 service nova] Creating event network-vif-unplugged:9dcf1823-c8b6-4d30-88b4-559bc9d90002 for instance 422ceb5f-740f-45e5-9596-6796719adf27 on n-h1-850501-12 Sep 08 10:39:08.919748 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-0f58dbba-1cc2-44f0-a75a-c4e84ee0f9a5 req-54de333a-ae36-4791-afb7-b7cf424d3d20 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068981 Sep 08 10:39:08.920659 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 323/637] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:39:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:39:08.928387 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b226711b-f0d1-47b3-9e25-ca8cd91ddcc3 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:08.929477 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b226711b-f0d1-47b3-9e25-ca8cd91ddcc3 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] [instance: c7a958dd-d267-4932-b7d1-6e50d6c1b21e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:08.938840 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b226711b-f0d1-47b3-9e25-ca8cd91ddcc3 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:08.939853 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b226711b-f0d1-47b3-9e25-ca8cd91ddcc3 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:08.940663 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b226711b-f0d1-47b3-9e25-ca8cd91ddcc3 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:08.941970 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b226711b-f0d1-47b3-9e25-ca8cd91ddcc3 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:08.942774 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b226711b-f0d1-47b3-9e25-ca8cd91ddcc3 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:08.943452 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b226711b-f0d1-47b3-9e25-ca8cd91ddcc3 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:08.979793 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9b9bcfc5-b7be-4e8b-be0c-30d747529bc8 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:08.995817 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9b9bcfc5-b7be-4e8b-be0c-30d747529bc8 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808" status: 200 len: 1476 microversion: 2.1 time: 0.398164 Sep 08 10:39:08.997836 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 315/638] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:08 2022] GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808 => generated 1476 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:09.045516 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b226711b-f0d1-47b3-9e25-ca8cd91ddcc3 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad3d26d79c34a0c90a99eeaa85f6e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bc2a412ede463e94d6933c30bc06ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:09.054090 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b226711b-f0d1-47b3-9e25-ca8cd91ddcc3 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] 10.222.0.27 "GET /compute/v2.1/servers/c7a958dd-d267-4932-b7d1-6e50d6c1b21e" status: 200 len: 1271 microversion: 2.1 time: 0.131848 Sep 08 10:39:09.055042 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 324/639] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:08 2022] GET /compute/v2.1/servers/c7a958dd-d267-4932-b7d1-6e50d6c1b21e => generated 1271 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:09.060568 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e2d3274a-2ddb-4638-8244-a8ab48db00d4 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:09.062078 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e2d3274a-2ddb-4638-8244-a8ab48db00d4 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 1fc866b1-81ac-4c09-86ab-6d8a4a580294] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:09.068573 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e2d3274a-2ddb-4638-8244-a8ab48db00d4 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:09.069006 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e2d3274a-2ddb-4638-8244-a8ab48db00d4 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:09.069490 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e2d3274a-2ddb-4638-8244-a8ab48db00d4 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:09.070214 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e2d3274a-2ddb-4638-8244-a8ab48db00d4 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:09.070966 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e2d3274a-2ddb-4638-8244-a8ab48db00d4 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:09.071086 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e2d3274a-2ddb-4638-8244-a8ab48db00d4 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:09.144101 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e2d3274a-2ddb-4638-8244-a8ab48db00d4 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:09.154958 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e2d3274a-2ddb-4638-8244-a8ab48db00d4 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/1fc866b1-81ac-4c09-86ab-6d8a4a580294" status: 200 len: 1263 microversion: 2.1 time: 0.098663 Sep 08 10:39:09.156376 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 325/640] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:09 2022] GET /compute/v2.1/servers/1fc866b1-81ac-4c09-86ab-6d8a4a580294 => generated 1263 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:09.162947 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-19b3de8f-1338-4110-9d45-287f15313184 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:09.163632 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-19b3de8f-1338-4110-9d45-287f15313184 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: 83037cf6-4a7d-4ba8-8ecb-469feb7598b8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:09.179556 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-19b3de8f-1338-4110-9d45-287f15313184 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:09.180387 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-19b3de8f-1338-4110-9d45-287f15313184 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:09.180839 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-19b3de8f-1338-4110-9d45-287f15313184 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:09.181658 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-19b3de8f-1338-4110-9d45-287f15313184 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:09.182657 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-19b3de8f-1338-4110-9d45-287f15313184 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:09.183304 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-19b3de8f-1338-4110-9d45-287f15313184 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:09.186484 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-20e0dcf1-5b66-48e4-9860-519b9bcdaf70 tempest-FlavorsV2TestJSON-83950459 tempest-FlavorsV2TestJSON-83950459-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:09.195368 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-20e0dcf1-5b66-48e4-9860-519b9bcdaf70 tempest-FlavorsV2TestJSON-83950459 tempest-FlavorsV2TestJSON-83950459-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.191530 Sep 08 10:39:09.196098 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 316/641] 10.222.0.27 () {58 vars in 1137 bytes} [Thu Sep 8 10:39:08 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:39:09.201667 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-575e3b15-3184-49dd-a1c4-2a5da58060b9 tempest-QuotasAdminNegativeTest-359616318 tempest-QuotasAdminNegativeTest-359616318-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1190081363", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:39:09.282007 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-575e3b15-3184-49dd-a1c4-2a5da58060b9 tempest-QuotasAdminNegativeTest-359616318 tempest-QuotasAdminNegativeTest-359616318-project] validate_networks() for None {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:39:09.381628 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-19b3de8f-1338-4110-9d45-287f15313184 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:09.392603 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-19b3de8f-1338-4110-9d45-287f15313184 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/83037cf6-4a7d-4ba8-8ecb-469feb7598b8" status: 200 len: 1318 microversion: 2.1 time: 0.235099 Sep 08 10:39:09.393546 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 326/642] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:09 2022] GET /compute/v2.1/servers/83037cf6-4a7d-4ba8-8ecb-469feb7598b8 => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:09.398202 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d20d84d9-5b90-4f08-873a-96e9cf8af51a tempest-FlavorsV2TestJSON-83950459 tempest-FlavorsV2TestJSON-83950459-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:09.430266 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d20d84d9-5b90-4f08-873a-96e9cf8af51a tempest-FlavorsV2TestJSON-83950459 tempest-FlavorsV2TestJSON-83950459-project] 10.222.0.27 "GET /compute/v2.1/flavors" status: 200 len: 3078 microversion: 2.1 time: 0.035368 Sep 08 10:39:09.431014 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 327/643] 10.222.0.27 () {58 vars in 1125 bytes} [Thu Sep 8 10:39:09 2022] GET /compute/v2.1/flavors => generated 3078 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:09.437895 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-44bf44bf-317c-4bb3-9e5d-2dffe6dd3698 req-03262cdc-18cb-4b48-8466-b26f42cb8921 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "815705bc-e49e-47a1-864b-9cc550464808", "name": "network-vif-unplugged", "status": "completed", "tag": "9c8702f3-cdfe-4a4b-9877-3df5412c0e8d"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:39:09.447074 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-44bf44bf-317c-4bb3-9e5d-2dffe6dd3698 req-03262cdc-18cb-4b48-8466-b26f42cb8921 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:09.447756 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-44bf44bf-317c-4bb3-9e5d-2dffe6dd3698 req-03262cdc-18cb-4b48-8466-b26f42cb8921 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:09.448343 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-44bf44bf-317c-4bb3-9e5d-2dffe6dd3698 req-03262cdc-18cb-4b48-8466-b26f42cb8921 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:09.468587 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-44bf44bf-317c-4bb3-9e5d-2dffe6dd3698 req-03262cdc-18cb-4b48-8466-b26f42cb8921 service nova] Creating event network-vif-unplugged:9c8702f3-cdfe-4a4b-9877-3df5412c0e8d for instance 815705bc-e49e-47a1-864b-9cc550464808 on n-h2-850501-12 Sep 08 10:39:09.477385 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [req-44bf44bf-317c-4bb3-9e5d-2dffe6dd3698 req-03262cdc-18cb-4b48-8466-b26f42cb8921 service nova] Instance 815705bc-e49e-47a1-864b-9cc550464808 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850501-12', 'n-h1-850501-12'} {{(pid=128862) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 10:39:09.490827 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-44bf44bf-317c-4bb3-9e5d-2dffe6dd3698 req-03262cdc-18cb-4b48-8466-b26f42cb8921 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057991 Sep 08 10:39:09.492056 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 328/644] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:39:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:39:09.500879 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fd46714e-54e9-4ab1-97b7-83b9b5fbbe40 tempest-FlavorsV2TestJSON-83950459 tempest-FlavorsV2TestJSON-83950459-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:09.513992 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fd46714e-54e9-4ab1-97b7-83b9b5fbbe40 tempest-FlavorsV2TestJSON-83950459 tempest-FlavorsV2TestJSON-83950459-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019525 Sep 08 10:39:09.516791 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 329/645] 10.222.0.27 () {58 vars in 1137 bytes} [Thu Sep 8 10:39:09 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:39:09.534989 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-54ae5145-94cd-4334-9789-a096551f4346 tempest-FlavorsV2TestJSON-83950459 tempest-FlavorsV2TestJSON-83950459-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:09.545549 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-54ae5145-94cd-4334-9789-a096551f4346 tempest-FlavorsV2TestJSON-83950459 tempest-FlavorsV2TestJSON-83950459-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014144 Sep 08 10:39:09.546147 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 330/646] 10.222.0.27 () {58 vars in 1137 bytes} [Thu Sep 8 10:39:09 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:39:09.559843 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9ebea40f-515c-4450-9420-90575dd1e292 tempest-FlavorsV2TestJSON-83950459 tempest-FlavorsV2TestJSON-83950459-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:09.588642 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9ebea40f-515c-4450-9420-90575dd1e292 tempest-FlavorsV2TestJSON-83950459 tempest-FlavorsV2TestJSON-83950459-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.034254 Sep 08 10:39:09.589261 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 331/647] 10.222.0.27 () {58 vars in 1165 bytes} [Thu Sep 8 10:39:09 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:39:09.613775 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-202a7fac-0b2f-4fe9-b459-5b3c36c16c68 tempest-FlavorsV2TestJSON-83950459 tempest-FlavorsV2TestJSON-83950459-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:09.623036 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-202a7fac-0b2f-4fe9-b459-5b3c36c16c68 tempest-FlavorsV2TestJSON-83950459 tempest-FlavorsV2TestJSON-83950459-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016323 Sep 08 10:39:09.626268 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 332/648] 10.222.0.27 () {58 vars in 1137 bytes} [Thu Sep 8 10:39:09 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:39:09.633578 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1175a358-ebae-4734-a7e4-833fab4699f8 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:09.634950 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1175a358-ebae-4734-a7e4-833fab4699f8 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 422ceb5f-740f-45e5-9596-6796719adf27] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:09.643753 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1175a358-ebae-4734-a7e4-833fab4699f8 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:09.644105 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1175a358-ebae-4734-a7e4-833fab4699f8 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:09.644392 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1175a358-ebae-4734-a7e4-833fab4699f8 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:09.645159 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1175a358-ebae-4734-a7e4-833fab4699f8 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:09.645644 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1175a358-ebae-4734-a7e4-833fab4699f8 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:09.646049 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1175a358-ebae-4734-a7e4-833fab4699f8 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:09.818193 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-575e3b15-3184-49dd-a1c4-2a5da58060b9 tempest-QuotasAdminNegativeTest-359616318 tempest-QuotasAdminNegativeTest-359616318-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:39:09.818700 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-575e3b15-3184-49dd-a1c4-2a5da58060b9 tempest-QuotasAdminNegativeTest-359616318 tempest-QuotasAdminNegativeTest-359616318-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:39:09.819189 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-575e3b15-3184-49dd-a1c4-2a5da58060b9 tempest-QuotasAdminNegativeTest-359616318 tempest-QuotasAdminNegativeTest-359616318-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:39:09.820478 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-575e3b15-3184-49dd-a1c4-2a5da58060b9 tempest-QuotasAdminNegativeTest-359616318 tempest-QuotasAdminNegativeTest-359616318-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:39:09.821157 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-575e3b15-3184-49dd-a1c4-2a5da58060b9 tempest-QuotasAdminNegativeTest-359616318 tempest-QuotasAdminNegativeTest-359616318-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:39:09.852291 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-575e3b15-3184-49dd-a1c4-2a5da58060b9 tempest-QuotasAdminNegativeTest-359616318 tempest-QuotasAdminNegativeTest-359616318-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:09.853575 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-575e3b15-3184-49dd-a1c4-2a5da58060b9 tempest-QuotasAdminNegativeTest-359616318 tempest-QuotasAdminNegativeTest-359616318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:09.858358 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-575e3b15-3184-49dd-a1c4-2a5da58060b9 tempest-QuotasAdminNegativeTest-359616318 tempest-QuotasAdminNegativeTest-359616318-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:09.860401 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-575e3b15-3184-49dd-a1c4-2a5da58060b9 tempest-QuotasAdminNegativeTest-359616318 tempest-QuotasAdminNegativeTest-359616318-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:09.861327 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-575e3b15-3184-49dd-a1c4-2a5da58060b9 tempest-QuotasAdminNegativeTest-359616318 tempest-QuotasAdminNegativeTest-359616318-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:09.861935 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-575e3b15-3184-49dd-a1c4-2a5da58060b9 tempest-QuotasAdminNegativeTest-359616318 tempest-QuotasAdminNegativeTest-359616318-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:09.869191 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1175a358-ebae-4734-a7e4-833fab4699f8 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:09.881819 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1175a358-ebae-4734-a7e4-833fab4699f8 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:09.883207 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1175a358-ebae-4734-a7e4-833fab4699f8 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:09.884406 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1175a358-ebae-4734-a7e4-833fab4699f8 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/422ceb5f-740f-45e5-9596-6796719adf27" status: 200 len: 1566 microversion: 2.25 time: 0.257000 Sep 08 10:39:09.889454 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 333/649] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:39:09 2022] GET /compute/v2.1/servers/422ceb5f-740f-45e5-9596-6796719adf27 => generated 1566 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:39:09.897250 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b68af990-32ac-47aa-832c-a6ab486f38b8 tempest-FlavorsV2TestJSON-83950459 tempest-FlavorsV2TestJSON-83950459-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:09.928438 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-575e3b15-3184-49dd-a1c4-2a5da58060b9 tempest-QuotasAdminNegativeTest-359616318 tempest-QuotasAdminNegativeTest-359616318-project] Getting quotas for project aa32aea2a8d94171a573610b4562f643. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:39:09.930753 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b68af990-32ac-47aa-832c-a6ab486f38b8 tempest-FlavorsV2TestJSON-83950459 tempest-FlavorsV2TestJSON-83950459-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.040465 Sep 08 10:39:09.932633 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 334/650] 10.222.0.27 () {58 vars in 1169 bytes} [Thu Sep 8 10:39:09 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:09.946998 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-575e3b15-3184-49dd-a1c4-2a5da58060b9 tempest-QuotasAdminNegativeTest-359616318 tempest-QuotasAdminNegativeTest-359616318-project] Getting quotas for user 4031f73b38214174ac528c1f0fe3144c and project aa32aea2a8d94171a573610b4562f643. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:39:09.963865 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-28a20bb1-456e-43b7-a45b-03625a1f35d4 tempest-FlavorsV2TestJSON-83950459 tempest-FlavorsV2TestJSON-83950459-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:09.980656 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.utils [None req-575e3b15-3184-49dd-a1c4-2a5da58060b9 tempest-QuotasAdminNegativeTest-359616318 tempest-QuotasAdminNegativeTest-359616318-project] instances quota exceeded for aa32aea2a8d94171a573610b4562f643, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=128861) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Sep 08 10:39:09.983875 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-575e3b15-3184-49dd-a1c4-2a5da58060b9 tempest-QuotasAdminNegativeTest-359616318 tempest-QuotasAdminNegativeTest-359616318-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 08 10:39:09.992034 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-28a20bb1-456e-43b7-a45b-03625a1f35d4 tempest-FlavorsV2TestJSON-83950459 tempest-FlavorsV2TestJSON-83950459-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.029379 Sep 08 10:39:09.992712 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-575e3b15-3184-49dd-a1c4-2a5da58060b9 tempest-QuotasAdminNegativeTest-359616318 tempest-QuotasAdminNegativeTest-359616318-project] Request method failure captured: Sep 08 10:39:09.992712 n-d-850501-12 devstack@n-api.service[128861]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 10:39:09.992712 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:39:09.992712 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:39:09.992712 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:39:09.992712 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 145 Sep 08 10:39:09.992712 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:39:09.992712 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:39:09.992712 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:39:09.992712 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:39:09.992712 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcZEmgFYArtgeXDxJnAbUCdIfqotVtGXkZLXqqPZBBM2UYCvVyyokSkM4VqLPezRd8VXjIs8qyY416z4LPITQDe97Z2Ee7It-I9BfBpnXVrY8h9tDa4PkZf8l6w9VVFwEKEZaVlbPv9DiVuZQLv7v3m5zy8vFT6irBdusPJ8JVCzRFc Sep 08 10:39:09.992712 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:39:09.992712 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:39:09.992712 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:39:09.992712 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:39:09.992712 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:39:09.992712 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:39:09.992712 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: aa32aea2a8d94171a573610b4562f643 Sep 08 10:39:09.992712 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-QuotasAdminNegativeTest-359616318 Sep 08 10:39:09.992712 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:39:09.992712 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:39:09.995657 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/aa32aea2a8d94171a573610b4562f643"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/aa32aea2a8d94171a573610b4562f643"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_aa32aea2a8d94171a573610b4562f643"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/aa32aea2a8d94171a573610b4562f643"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:39:09.995657 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-QuotasAdminNegativeTest-359616318 Sep 08 10:39:09.995657 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: aa32aea2a8d94171a573610b4562f643 Sep 08 10:39:09.995657 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-359616318 Sep 08 10:39:09.995657 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-QuotasAdminNegativeTest-359616318-project Sep 08 10:39:09.995657 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:39:09.995657 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:39:09.995657 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 4031f73b38214174ac528c1f0fe3144c Sep 08 10:39:09.995657 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-QuotasAdminNegativeTest-359616318-project Sep 08 10:39:09.995657 n-d-850501-12 devstack@n-api.service[128861]: Sep 08 10:39:09.995657 n-d-850501-12 devstack@n-api.service[128861]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1190081363", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452"}} Sep 08 10:39:09.995657 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:39:09.997976 n-d-850501-12 devstack@n-api.service[128861]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 08 10:39:09.997976 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1190081363', 'imageRef': '503f4a0f-e18f-47fd-ad12-0289e3463117', 'flavorRef': '452'}}} Sep 08 10:39:09.997976 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:39:09.997976 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:39:09.997976 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Sep 08 10:39:09.997976 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Sep 08 10:39:09.997976 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 10:39:09.997976 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 10:39:09.997976 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 08 10:39:09.997976 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc Sep 08 10:39:09.997976 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 08 10:39:09.997976 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 08 10:39:09.997976 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 10:39:09.997976 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 10:39:09.997976 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 08 10:39:09.997976 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 08 10:39:09.997976 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 08 10:39:09.997976 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 08 10:39:10.000238 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Sep 08 10:39:10.000238 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 08 10:39:10.000238 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Sep 08 10:39:10.000238 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:39:10.000238 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:39:10.000238 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:39:10.000238 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:39:10.000238 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 08 10:39:10.000238 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 08 10:39:10.000238 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 08 10:39:10.000238 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 08 10:39:10.000238 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Sep 08 10:39:10.000238 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Sep 08 10:39:10.000238 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Sep 08 10:39:10.000238 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Sep 08 10:39:10.000238 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Sep 08 10:39:10.000238 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 08 10:39:10.000238 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 08 10:39:10.000238 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:39:10.000238 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:39:10.000238 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:39:10.003199 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:39:10.003199 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:39:10.003199 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:39:10.003199 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:39:10.003199 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:39:10.003199 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:39:10.003199 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:39:10.003199 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:39:10.003199 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:39:10.003199 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:39:10.003199 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:39:10.003199 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:39:10.003199 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:39:10.003199 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 08 10:39:10.003199 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 08 10:39:10.003199 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 08 10:39:10.003199 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 08 10:39:10.003199 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:39:10.003199 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:39:10.003199 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:39:10.003199 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:39:10.009216 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:39:10.009216 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:39:10.009216 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:39:10.009216 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:39:10.009216 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 08 10:39:10.009216 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:39:10.009216 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-575e3b15-3184-49dd-a1c4-2a5da58060b9 tempest-QuotasAdminNegativeTest-359616318 tempest-QuotasAdminNegativeTest-359616318-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:39:10.011174 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 335/651] 10.222.0.27 () {58 vars in 1161 bytes} [Thu Sep 8 10:39:09 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:39:10.011365 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-575e3b15-3184-49dd-a1c4-2a5da58060b9 tempest-QuotasAdminNegativeTest-359616318 tempest-QuotasAdminNegativeTest-359616318-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.813005 Sep 08 10:39:10.013455 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 317/652] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:39:09 2022] POST /compute/v2.1/servers => generated 119 bytes in 816 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:39:10.021233 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-aba10ea5-fe08-466f-a54f-f024952f05c0 tempest-FlavorsV2TestJSON-83950459 tempest-FlavorsV2TestJSON-83950459-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:10.028725 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e4eadf1a-368e-4e53-9242-46e8fac1da5f tempest-QuotasAdminNegativeTest-1037091041 tempest-QuotasAdminNegativeTest-1037091041-project-admin] Action: 'update', calling method: .version_select at 0x7f68e4959af0>, body: {"quota_set": {"instances": 10}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:39:10.032879 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-aba10ea5-fe08-466f-a54f-f024952f05c0 tempest-FlavorsV2TestJSON-83950459 tempest-FlavorsV2TestJSON-83950459-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017129 Sep 08 10:39:10.041590 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 336/653] 10.222.0.27 () {58 vars in 1137 bytes} [Thu Sep 8 10:39:10 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:39:10.048643 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2d7a78a2-04e5-46ae-84d4-32abbcda0a69 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:10.049284 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2d7a78a2-04e5-46ae-84d4-32abbcda0a69 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 815705bc-e49e-47a1-864b-9cc550464808] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:10.073872 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2d7a78a2-04e5-46ae-84d4-32abbcda0a69 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:10.074681 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2d7a78a2-04e5-46ae-84d4-32abbcda0a69 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:10.077537 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2d7a78a2-04e5-46ae-84d4-32abbcda0a69 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:10.078458 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2d7a78a2-04e5-46ae-84d4-32abbcda0a69 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:10.079050 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2d7a78a2-04e5-46ae-84d4-32abbcda0a69 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:10.079598 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2d7a78a2-04e5-46ae-84d4-32abbcda0a69 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:10.123013 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e4eadf1a-368e-4e53-9242-46e8fac1da5f tempest-QuotasAdminNegativeTest-1037091041 tempest-QuotasAdminNegativeTest-1037091041-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:10.123535 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e4eadf1a-368e-4e53-9242-46e8fac1da5f tempest-QuotasAdminNegativeTest-1037091041 tempest-QuotasAdminNegativeTest-1037091041-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:10.123976 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e4eadf1a-368e-4e53-9242-46e8fac1da5f tempest-QuotasAdminNegativeTest-1037091041 tempest-QuotasAdminNegativeTest-1037091041-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:10.124717 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e4eadf1a-368e-4e53-9242-46e8fac1da5f tempest-QuotasAdminNegativeTest-1037091041 tempest-QuotasAdminNegativeTest-1037091041-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:10.125947 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e4eadf1a-368e-4e53-9242-46e8fac1da5f tempest-QuotasAdminNegativeTest-1037091041 tempest-QuotasAdminNegativeTest-1037091041-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:10.126403 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e4eadf1a-368e-4e53-9242-46e8fac1da5f tempest-QuotasAdminNegativeTest-1037091041 tempest-QuotasAdminNegativeTest-1037091041-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:10.197359 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e4eadf1a-368e-4e53-9242-46e8fac1da5f tempest-QuotasAdminNegativeTest-1037091041 tempest-QuotasAdminNegativeTest-1037091041-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/aa32aea2a8d94171a573610b4562f643" status: 200 len: 330 microversion: 2.1 time: 0.174062 Sep 08 10:39:10.198132 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 318/654] 10.222.0.27 () {60 vars in 1262 bytes} [Thu Sep 8 10:39:10 2022] PUT /compute/v2.1/os-quota-sets/aa32aea2a8d94171a573610b4562f643 => generated 330 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:39:10.204194 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e1c9bbbb-dab5-4f11-8279-b8e7a7259341 tempest-FlavorsV2TestJSON-83950459 tempest-FlavorsV2TestJSON-83950459-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:10.278279 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e1c9bbbb-dab5-4f11-8279-b8e7a7259341 tempest-FlavorsV2TestJSON-83950459 tempest-FlavorsV2TestJSON-83950459-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2911 microversion: 2.1 time: 0.078769 Sep 08 10:39:10.279347 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 319/655] 10.222.0.27 () {58 vars in 1167 bytes} [Thu Sep 8 10:39:10 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2911 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:10.295762 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8dba030f-6380-4275-981a-f8e489a8ef26 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:10.297066 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8dba030f-6380-4275-981a-f8e489a8ef26 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] [instance: c7a958dd-d267-4932-b7d1-6e50d6c1b21e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:10.304707 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8dba030f-6380-4275-981a-f8e489a8ef26 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:10.305532 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8dba030f-6380-4275-981a-f8e489a8ef26 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:10.306167 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8dba030f-6380-4275-981a-f8e489a8ef26 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:10.308960 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8dba030f-6380-4275-981a-f8e489a8ef26 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:10.309549 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8dba030f-6380-4275-981a-f8e489a8ef26 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:10.309962 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8dba030f-6380-4275-981a-f8e489a8ef26 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:10.324574 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2d7a78a2-04e5-46ae-84d4-32abbcda0a69 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:10.334603 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2d7a78a2-04e5-46ae-84d4-32abbcda0a69 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808" status: 200 len: 1476 microversion: 2.1 time: 0.291927 Sep 08 10:39:10.336205 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=100 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:39:10.338469 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 337/656] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:10 2022] GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808 => generated 1476 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:10.347870 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a5571c80-f420-4bea-82a2-15b246d1ed4d tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:10.348487 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a5571c80-f420-4bea-82a2-15b246d1ed4d tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 1fc866b1-81ac-4c09-86ab-6d8a4a580294] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:10.356669 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a5571c80-f420-4bea-82a2-15b246d1ed4d tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:10.357428 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a5571c80-f420-4bea-82a2-15b246d1ed4d tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:10.358265 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a5571c80-f420-4bea-82a2-15b246d1ed4d tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:10.359131 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a5571c80-f420-4bea-82a2-15b246d1ed4d tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:10.359765 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a5571c80-f420-4bea-82a2-15b246d1ed4d tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:10.360352 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a5571c80-f420-4bea-82a2-15b246d1ed4d tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:10.467999 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a5571c80-f420-4bea-82a2-15b246d1ed4d tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:10.480888 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a5571c80-f420-4bea-82a2-15b246d1ed4d tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/1fc866b1-81ac-4c09-86ab-6d8a4a580294" status: 200 len: 1269 microversion: 2.1 time: 0.140638 Sep 08 10:39:10.486970 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 338/657] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:10 2022] GET /compute/v2.1/servers/1fc866b1-81ac-4c09-86ab-6d8a4a580294 => generated 1269 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:10.496285 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9dc64cb8-a2b2-4128-860f-7b0c95a400ce tempest-QuotasAdminNegativeTest-1037091041 tempest-QuotasAdminNegativeTest-1037091041-project-admin] Calling method '.version_select at 0x7f68e4dede50>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:10.615254 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9dc64cb8-a2b2-4128-860f-7b0c95a400ce tempest-QuotasAdminNegativeTest-1037091041 tempest-QuotasAdminNegativeTest-1037091041-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/aa32aea2a8d94171a573610b4562f643" status: 200 len: 372 microversion: 2.1 time: 0.126938 Sep 08 10:39:10.616097 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 339/658] 10.222.0.27 () {58 vars in 1242 bytes} [Thu Sep 8 10:39:10 2022] GET /compute/v2.1/os-quota-sets/aa32aea2a8d94171a573610b4562f643 => generated 372 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:39:10.621227 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3dc246da-9aae-4ebe-9cb9-43d9e6f25906 tempest-FlavorsV2TestJSON-83950459 tempest-FlavorsV2TestJSON-83950459-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:10.631603 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3dc246da-9aae-4ebe-9cb9-43d9e6f25906 tempest-FlavorsV2TestJSON-83950459 tempest-FlavorsV2TestJSON-83950459-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014233 Sep 08 10:39:10.641114 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 340/659] 10.222.0.27 () {58 vars in 1137 bytes} [Thu Sep 8 10:39:10 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:39:10.646998 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3a2a8327-9beb-4884-a82a-7aa8b71d28b6 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:10.648314 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3a2a8327-9beb-4884-a82a-7aa8b71d28b6 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: 83037cf6-4a7d-4ba8-8ecb-469feb7598b8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:10.661461 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a2a8327-9beb-4884-a82a-7aa8b71d28b6 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:10.662053 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a2a8327-9beb-4884-a82a-7aa8b71d28b6 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:10.662564 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a2a8327-9beb-4884-a82a-7aa8b71d28b6 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:10.663601 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a2a8327-9beb-4884-a82a-7aa8b71d28b6 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:10.664283 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a2a8327-9beb-4884-a82a-7aa8b71d28b6 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:10.665262 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a2a8327-9beb-4884-a82a-7aa8b71d28b6 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:10.705998 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8dba030f-6380-4275-981a-f8e489a8ef26 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad3d26d79c34a0c90a99eeaa85f6e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bc2a412ede463e94d6933c30bc06ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:10.714019 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8dba030f-6380-4275-981a-f8e489a8ef26 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] 10.222.0.27 "GET /compute/v2.1/servers/c7a958dd-d267-4932-b7d1-6e50d6c1b21e" status: 200 len: 1313 microversion: 2.1 time: 0.427265 Sep 08 10:39:10.733364 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 320/660] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:10 2022] GET /compute/v2.1/servers/c7a958dd-d267-4932-b7d1-6e50d6c1b21e => generated 1313 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:10.738492 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fa69e1bb-ad77-464b-95a7-f90bbbffc620 tempest-QuotasAdminNegativeTest-1037091041 tempest-QuotasAdminNegativeTest-1037091041-project-admin] Action: 'update', calling method: .version_select at 0x7f68e4a540d0>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:39:10.807646 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fa69e1bb-ad77-464b-95a7-f90bbbffc620 tempest-QuotasAdminNegativeTest-1037091041 tempest-QuotasAdminNegativeTest-1037091041-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:10.808639 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fa69e1bb-ad77-464b-95a7-f90bbbffc620 tempest-QuotasAdminNegativeTest-1037091041 tempest-QuotasAdminNegativeTest-1037091041-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:10.809292 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fa69e1bb-ad77-464b-95a7-f90bbbffc620 tempest-QuotasAdminNegativeTest-1037091041 tempest-QuotasAdminNegativeTest-1037091041-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:10.810435 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fa69e1bb-ad77-464b-95a7-f90bbbffc620 tempest-QuotasAdminNegativeTest-1037091041 tempest-QuotasAdminNegativeTest-1037091041-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:10.811215 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fa69e1bb-ad77-464b-95a7-f90bbbffc620 tempest-QuotasAdminNegativeTest-1037091041 tempest-QuotasAdminNegativeTest-1037091041-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:10.811636 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fa69e1bb-ad77-464b-95a7-f90bbbffc620 tempest-QuotasAdminNegativeTest-1037091041 tempest-QuotasAdminNegativeTest-1037091041-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:10.864626 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=88,nova_cell0:UPDATE=12 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:39:10.876294 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fa69e1bb-ad77-464b-95a7-f90bbbffc620 tempest-QuotasAdminNegativeTest-1037091041 tempest-QuotasAdminNegativeTest-1037091041-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/aa32aea2a8d94171a573610b4562f643" status: 200 len: 326 microversion: 2.1 time: 0.141347 Sep 08 10:39:10.877647 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 321/661] 10.222.0.27 () {60 vars in 1262 bytes} [Thu Sep 8 10:39:10 2022] PUT /compute/v2.1/os-quota-sets/aa32aea2a8d94171a573610b4562f643 => generated 326 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:39:10.882731 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ef0bb01f-7eba-425d-b5a3-e61e8d38d619 tempest-FlavorsV2TestJSON-83950459 tempest-FlavorsV2TestJSON-83950459-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:10.923551 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ef0bb01f-7eba-425d-b5a3-e61e8d38d619 tempest-FlavorsV2TestJSON-83950459 tempest-FlavorsV2TestJSON-83950459-project] 10.222.0.27 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.044590 Sep 08 10:39:10.924150 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 322/662] 10.222.0.27 () {58 vars in 1144 bytes} [Thu Sep 8 10:39:10 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:10.948658 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-755b3e81-5f44-43da-b953-32f32fb8974b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:10.950246 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-755b3e81-5f44-43da-b953-32f32fb8974b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 422ceb5f-740f-45e5-9596-6796719adf27] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:10.963880 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-755b3e81-5f44-43da-b953-32f32fb8974b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:10.971093 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-755b3e81-5f44-43da-b953-32f32fb8974b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:10.971710 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-755b3e81-5f44-43da-b953-32f32fb8974b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:10.972642 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-755b3e81-5f44-43da-b953-32f32fb8974b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:10.973359 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-755b3e81-5f44-43da-b953-32f32fb8974b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:10.974109 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-755b3e81-5f44-43da-b953-32f32fb8974b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:11.009264 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3a2a8327-9beb-4884-a82a-7aa8b71d28b6 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:11.020073 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3a2a8327-9beb-4884-a82a-7aa8b71d28b6 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/83037cf6-4a7d-4ba8-8ecb-469feb7598b8" status: 200 len: 1467 microversion: 2.1 time: 0.374084 Sep 08 10:39:11.033411 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 341/663] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:10 2022] GET /compute/v2.1/servers/83037cf6-4a7d-4ba8-8ecb-469feb7598b8 => generated 1467 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:11.037618 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-acc815e8-db10-4e01-a68a-bd7bb1617324 req-59e6d675-ebe6-4ba8-9b2a-9841af6e530a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "422ceb5f-740f-45e5-9596-6796719adf27", "tag": "9dcf1823-c8b6-4d30-88b4-559bc9d90002"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:39:11.056848 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-acc815e8-db10-4e01-a68a-bd7bb1617324 req-59e6d675-ebe6-4ba8-9b2a-9841af6e530a service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:11.057365 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-acc815e8-db10-4e01-a68a-bd7bb1617324 req-59e6d675-ebe6-4ba8-9b2a-9841af6e530a service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:11.057790 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-acc815e8-db10-4e01-a68a-bd7bb1617324 req-59e6d675-ebe6-4ba8-9b2a-9841af6e530a service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:11.077319 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-acc815e8-db10-4e01-a68a-bd7bb1617324 req-59e6d675-ebe6-4ba8-9b2a-9841af6e530a service nova] Creating event network-changed:9dcf1823-c8b6-4d30-88b4-559bc9d90002 for instance 422ceb5f-740f-45e5-9596-6796719adf27 on n-h1-850501-12 Sep 08 10:39:11.083704 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-acc815e8-db10-4e01-a68a-bd7bb1617324 req-59e6d675-ebe6-4ba8-9b2a-9841af6e530a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060139 Sep 08 10:39:11.084715 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 342/664] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:39:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:39:11.091048 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e4bb9bc5-49a4-482c-85dc-c949ad465baa tempest-FlavorsV2TestJSON-83950459 tempest-FlavorsV2TestJSON-83950459-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:11.099757 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e4bb9bc5-49a4-482c-85dc-c949ad465baa tempest-FlavorsV2TestJSON-83950459 tempest-FlavorsV2TestJSON-83950459-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013614 Sep 08 10:39:11.100816 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 343/665] 10.222.0.27 () {58 vars in 1137 bytes} [Thu Sep 8 10:39:11 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:39:11.119473 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-77d21312-4046-4b18-bfc8-1e8dfed8f49b tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:11.120279 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-77d21312-4046-4b18-bfc8-1e8dfed8f49b tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: 493cd490-27c5-4e08-a789-767757111cb2] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:11.128220 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-77d21312-4046-4b18-bfc8-1e8dfed8f49b tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:11.129742 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-77d21312-4046-4b18-bfc8-1e8dfed8f49b tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:11.129742 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-77d21312-4046-4b18-bfc8-1e8dfed8f49b tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:11.129958 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-77d21312-4046-4b18-bfc8-1e8dfed8f49b tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:11.130347 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-77d21312-4046-4b18-bfc8-1e8dfed8f49b tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:11.131383 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-77d21312-4046-4b18-bfc8-1e8dfed8f49b tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:11.440359 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-77d21312-4046-4b18-bfc8-1e8dfed8f49b tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:11.449697 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-77d21312-4046-4b18-bfc8-1e8dfed8f49b tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/493cd490-27c5-4e08-a789-767757111cb2" status: 200 len: 1467 microversion: 2.1 time: 0.346991 Sep 08 10:39:11.456084 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 344/666] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:11 2022] GET /compute/v2.1/servers/493cd490-27c5-4e08-a789-767757111cb2 => generated 1467 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:11.463422 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d63f9b10-0a3c-4d47-be0f-b6d30bc4556d tempest-QuotasAdminNegativeTest-359616318 tempest-QuotasAdminNegativeTest-359616318-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1645952710", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:39:11.524947 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-d63f9b10-0a3c-4d47-be0f-b6d30bc4556d tempest-QuotasAdminNegativeTest-359616318 tempest-QuotasAdminNegativeTest-359616318-project] validate_networks() for None {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:39:11.679640 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-755b3e81-5f44-43da-b953-32f32fb8974b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:11.692808 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-755b3e81-5f44-43da-b953-32f32fb8974b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:11.694725 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-755b3e81-5f44-43da-b953-32f32fb8974b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:11.696313 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-755b3e81-5f44-43da-b953-32f32fb8974b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/422ceb5f-740f-45e5-9596-6796719adf27" status: 200 len: 1566 microversion: 2.25 time: 0.759484 Sep 08 10:39:11.709117 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 323/667] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:39:10 2022] GET /compute/v2.1/servers/422ceb5f-740f-45e5-9596-6796719adf27 => generated 1566 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:39:11.709117 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-527e6fe6-fc0c-41b1-b2a7-3e9885f28d2f tempest-FlavorsV2TestJSON-83950459 tempest-FlavorsV2TestJSON-83950459-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:11.735784 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-527e6fe6-fc0c-41b1-b2a7-3e9885f28d2f tempest-FlavorsV2TestJSON-83950459 tempest-FlavorsV2TestJSON-83950459-project] 10.222.0.27 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.033652 Sep 08 10:39:11.736820 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 324/668] 10.222.0.27 () {58 vars in 1148 bytes} [Thu Sep 8 10:39:11 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:11.742302 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e9b44a88-633a-4ad6-a5bd-a9bc9cd81d81 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:11.743616 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e9b44a88-633a-4ad6-a5bd-a9bc9cd81d81 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 815705bc-e49e-47a1-864b-9cc550464808] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:11.751155 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e9b44a88-633a-4ad6-a5bd-a9bc9cd81d81 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:11.751771 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e9b44a88-633a-4ad6-a5bd-a9bc9cd81d81 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:11.752304 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e9b44a88-633a-4ad6-a5bd-a9bc9cd81d81 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:11.753228 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e9b44a88-633a-4ad6-a5bd-a9bc9cd81d81 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:11.753793 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e9b44a88-633a-4ad6-a5bd-a9bc9cd81d81 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:11.754291 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e9b44a88-633a-4ad6-a5bd-a9bc9cd81d81 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:11.962206 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-d63f9b10-0a3c-4d47-be0f-b6d30bc4556d tempest-QuotasAdminNegativeTest-359616318 tempest-QuotasAdminNegativeTest-359616318-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:39:11.963646 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-d63f9b10-0a3c-4d47-be0f-b6d30bc4556d tempest-QuotasAdminNegativeTest-359616318 tempest-QuotasAdminNegativeTest-359616318-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:39:11.963646 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-d63f9b10-0a3c-4d47-be0f-b6d30bc4556d tempest-QuotasAdminNegativeTest-359616318 tempest-QuotasAdminNegativeTest-359616318-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:39:11.963646 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-d63f9b10-0a3c-4d47-be0f-b6d30bc4556d tempest-QuotasAdminNegativeTest-359616318 tempest-QuotasAdminNegativeTest-359616318-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:39:11.964080 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-d63f9b10-0a3c-4d47-be0f-b6d30bc4556d tempest-QuotasAdminNegativeTest-359616318 tempest-QuotasAdminNegativeTest-359616318-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:39:11.975816 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d63f9b10-0a3c-4d47-be0f-b6d30bc4556d tempest-QuotasAdminNegativeTest-359616318 tempest-QuotasAdminNegativeTest-359616318-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:11.976201 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d63f9b10-0a3c-4d47-be0f-b6d30bc4556d tempest-QuotasAdminNegativeTest-359616318 tempest-QuotasAdminNegativeTest-359616318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:11.976561 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d63f9b10-0a3c-4d47-be0f-b6d30bc4556d tempest-QuotasAdminNegativeTest-359616318 tempest-QuotasAdminNegativeTest-359616318-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:11.977222 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d63f9b10-0a3c-4d47-be0f-b6d30bc4556d tempest-QuotasAdminNegativeTest-359616318 tempest-QuotasAdminNegativeTest-359616318-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:11.977712 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d63f9b10-0a3c-4d47-be0f-b6d30bc4556d tempest-QuotasAdminNegativeTest-359616318 tempest-QuotasAdminNegativeTest-359616318-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:11.978172 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d63f9b10-0a3c-4d47-be0f-b6d30bc4556d tempest-QuotasAdminNegativeTest-359616318 tempest-QuotasAdminNegativeTest-359616318-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:12.003508 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-d63f9b10-0a3c-4d47-be0f-b6d30bc4556d tempest-QuotasAdminNegativeTest-359616318 tempest-QuotasAdminNegativeTest-359616318-project] Getting quotas for project aa32aea2a8d94171a573610b4562f643. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:39:12.009838 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-d63f9b10-0a3c-4d47-be0f-b6d30bc4556d tempest-QuotasAdminNegativeTest-359616318 tempest-QuotasAdminNegativeTest-359616318-project] Getting quotas for user 4031f73b38214174ac528c1f0fe3144c and project aa32aea2a8d94171a573610b4562f643. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:39:12.029196 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.utils [None req-d63f9b10-0a3c-4d47-be0f-b6d30bc4556d tempest-QuotasAdminNegativeTest-359616318 tempest-QuotasAdminNegativeTest-359616318-project] ram quota exceeded for aa32aea2a8d94171a573610b4562f643, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=128862) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Sep 08 10:39:12.030547 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-d63f9b10-0a3c-4d47-be0f-b6d30bc4556d tempest-QuotasAdminNegativeTest-359616318 tempest-QuotasAdminNegativeTest-359616318-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 08 10:39:12.035021 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d63f9b10-0a3c-4d47-be0f-b6d30bc4556d tempest-QuotasAdminNegativeTest-359616318 tempest-QuotasAdminNegativeTest-359616318-project] Request method failure captured: Sep 08 10:39:12.035021 n-d-850501-12 devstack@n-api.service[128862]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 10:39:12.035021 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:39:12.035021 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:39:12.035021 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:39:12.035021 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 145 Sep 08 10:39:12.035021 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:39:12.035021 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:39:12.035021 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:39:12.035021 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:39:12.035021 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcZEmgFYArtgeXDxJnAbUCdIfqotVtGXkZLXqqPZBBM2UYCvVyyokSkM4VqLPezRd8VXjIs8qyY416z4LPITQDe97Z2Ee7It-I9BfBpnXVrY8h9tDa4PkZf8l6w9VVFwEKEZaVlbPv9DiVuZQLv7v3m5zy8vFT6irBdusPJ8JVCzRFc Sep 08 10:39:12.035021 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:39:12.035021 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:39:12.035021 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:39:12.035021 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:39:12.035021 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:39:12.035021 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:39:12.035021 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: aa32aea2a8d94171a573610b4562f643 Sep 08 10:39:12.035021 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-QuotasAdminNegativeTest-359616318 Sep 08 10:39:12.035021 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:39:12.035021 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:39:12.036619 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/aa32aea2a8d94171a573610b4562f643"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/aa32aea2a8d94171a573610b4562f643"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_aa32aea2a8d94171a573610b4562f643"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/aa32aea2a8d94171a573610b4562f643"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:39:12.036619 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-QuotasAdminNegativeTest-359616318 Sep 08 10:39:12.036619 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: aa32aea2a8d94171a573610b4562f643 Sep 08 10:39:12.036619 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-359616318 Sep 08 10:39:12.036619 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-QuotasAdminNegativeTest-359616318-project Sep 08 10:39:12.036619 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:39:12.036619 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:39:12.036619 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 4031f73b38214174ac528c1f0fe3144c Sep 08 10:39:12.036619 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-QuotasAdminNegativeTest-359616318-project Sep 08 10:39:12.036619 n-d-850501-12 devstack@n-api.service[128862]: Sep 08 10:39:12.036619 n-d-850501-12 devstack@n-api.service[128862]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1645952710", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452"}} Sep 08 10:39:12.036619 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:39:12.037391 n-d-850501-12 devstack@n-api.service[128862]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 08 10:39:12.037391 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1645952710', 'imageRef': '503f4a0f-e18f-47fd-ad12-0289e3463117', 'flavorRef': '452'}}} Sep 08 10:39:12.037391 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:39:12.037391 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:39:12.037391 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Sep 08 10:39:12.037391 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Sep 08 10:39:12.037391 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 10:39:12.037391 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 10:39:12.037391 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 08 10:39:12.037391 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc Sep 08 10:39:12.037391 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 08 10:39:12.037391 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 08 10:39:12.037391 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 10:39:12.037391 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 10:39:12.037391 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 08 10:39:12.037391 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 08 10:39:12.037391 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 08 10:39:12.037391 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 08 10:39:12.038455 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Sep 08 10:39:12.038455 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 08 10:39:12.038455 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Sep 08 10:39:12.038455 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:39:12.038455 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:39:12.038455 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:39:12.038455 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:39:12.038455 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 08 10:39:12.038455 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 08 10:39:12.038455 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 08 10:39:12.038455 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 08 10:39:12.038455 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Sep 08 10:39:12.038455 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Sep 08 10:39:12.038455 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Sep 08 10:39:12.038455 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Sep 08 10:39:12.038455 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Sep 08 10:39:12.038455 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 08 10:39:12.038455 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 08 10:39:12.038455 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:39:12.038455 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:39:12.038455 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:39:12.040683 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:39:12.040683 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:39:12.040683 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:39:12.040683 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:39:12.040683 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:39:12.040683 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:39:12.040683 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:39:12.040683 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:39:12.040683 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:39:12.040683 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:39:12.040683 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:39:12.040683 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:39:12.040683 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:39:12.040683 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 08 10:39:12.040683 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 08 10:39:12.040683 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 08 10:39:12.040683 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 08 10:39:12.040683 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:39:12.040683 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:39:12.040683 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:39:12.040683 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:39:12.044621 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:39:12.044621 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:39:12.044621 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:39:12.044621 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:39:12.044621 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 08 10:39:12.044621 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:39:12.044621 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d63f9b10-0a3c-4d47-be0f-b6d30bc4556d tempest-QuotasAdminNegativeTest-359616318 tempest-QuotasAdminNegativeTest-359616318-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:39:12.044621 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d63f9b10-0a3c-4d47-be0f-b6d30bc4556d tempest-QuotasAdminNegativeTest-359616318 tempest-QuotasAdminNegativeTest-359616318-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.578265 Sep 08 10:39:12.044621 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 345/669] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:39:11 2022] POST /compute/v2.1/servers => generated 110 bytes in 581 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:39:12.044621 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d458a870-d50e-41fc-92be-a48dcb01abc6 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:12.052821 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d458a870-d50e-41fc-92be-a48dcb01abc6 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:12.052821 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d458a870-d50e-41fc-92be-a48dcb01abc6 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Searching by: {'reservation_id': 'r-58yco0bq', 'deleted': False, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9'} {{(pid=128862) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:39:12.057543 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d458a870-d50e-41fc-92be-a48dcb01abc6 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:12.058044 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d458a870-d50e-41fc-92be-a48dcb01abc6 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:12.059145 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d458a870-d50e-41fc-92be-a48dcb01abc6 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:12.060212 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d458a870-d50e-41fc-92be-a48dcb01abc6 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:12.060676 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d458a870-d50e-41fc-92be-a48dcb01abc6 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:12.061135 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d458a870-d50e-41fc-92be-a48dcb01abc6 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:12.151275 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e9b44a88-633a-4ad6-a5bd-a9bc9cd81d81 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:12.171466 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e9b44a88-633a-4ad6-a5bd-a9bc9cd81d81 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808" status: 200 len: 1476 microversion: 2.1 time: 0.432820 Sep 08 10:39:12.171674 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.multi_cell_list [None req-d458a870-d50e-41fc-92be-a48dcb01abc6 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128862) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 10:39:12.172904 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 325/670] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:11 2022] GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808 => generated 1476 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:12.190078 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-33a41d2e-97b7-49ac-af1a-3ed9fc10336c tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:12.194021 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-33a41d2e-97b7-49ac-af1a-3ed9fc10336c tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 1fc866b1-81ac-4c09-86ab-6d8a4a580294] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:12.207777 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-33a41d2e-97b7-49ac-af1a-3ed9fc10336c tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:12.208069 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-33a41d2e-97b7-49ac-af1a-3ed9fc10336c tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:12.208654 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-33a41d2e-97b7-49ac-af1a-3ed9fc10336c tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:12.209633 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-33a41d2e-97b7-49ac-af1a-3ed9fc10336c tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:12.210462 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-33a41d2e-97b7-49ac-af1a-3ed9fc10336c tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:12.211199 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-33a41d2e-97b7-49ac-af1a-3ed9fc10336c tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:12.369078 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d458a870-d50e-41fc-92be-a48dcb01abc6 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:12.392042 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d458a870-d50e-41fc-92be-a48dcb01abc6 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:12.393657 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d458a870-d50e-41fc-92be-a48dcb01abc6 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:12.397492 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d458a870-d50e-41fc-92be-a48dcb01abc6 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:12.680003 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-33a41d2e-97b7-49ac-af1a-3ed9fc10336c tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:12.690145 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-33a41d2e-97b7-49ac-af1a-3ed9fc10336c tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/1fc866b1-81ac-4c09-86ab-6d8a4a580294" status: 200 len: 1311 microversion: 2.1 time: 0.511205 Sep 08 10:39:12.703312 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 326/671] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:12 2022] GET /compute/v2.1/servers/1fc866b1-81ac-4c09-86ab-6d8a4a580294 => generated 1311 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:12.703312 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-455d05a5-f0ce-4d40-8f5c-fdd2c03166b3 req-bf2418d9-404e-4922-bf74-55160ecc36b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "815705bc-e49e-47a1-864b-9cc550464808", "tag": "9c8702f3-cdfe-4a4b-9877-3df5412c0e8d"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:39:12.711868 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-455d05a5-f0ce-4d40-8f5c-fdd2c03166b3 req-bf2418d9-404e-4922-bf74-55160ecc36b0 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:12.712785 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-455d05a5-f0ce-4d40-8f5c-fdd2c03166b3 req-bf2418d9-404e-4922-bf74-55160ecc36b0 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:12.713488 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-455d05a5-f0ce-4d40-8f5c-fdd2c03166b3 req-bf2418d9-404e-4922-bf74-55160ecc36b0 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:12.718464 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d458a870-d50e-41fc-92be-a48dcb01abc6 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/detail?reservation_id=r-58yco0bq" status: 200 len: 2927 microversion: 2.1 time: 0.679033 Sep 08 10:39:12.719414 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 346/672] 10.222.0.27 () {58 vars in 1197 bytes} [Thu Sep 8 10:39:12 2022] GET /compute/v2.1/servers/detail?reservation_id=r-58yco0bq => generated 2927 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:12.734965 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-69bd214e-77b9-48e2-83f7-3b74178a431e tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:12.735669 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-69bd214e-77b9-48e2-83f7-3b74178a431e tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] [instance: c7a958dd-d267-4932-b7d1-6e50d6c1b21e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:12.737636 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:39:12.746557 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-69bd214e-77b9-48e2-83f7-3b74178a431e tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:12.747738 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-69bd214e-77b9-48e2-83f7-3b74178a431e tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:12.748877 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-69bd214e-77b9-48e2-83f7-3b74178a431e tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:12.749856 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-69bd214e-77b9-48e2-83f7-3b74178a431e tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:12.750351 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-69bd214e-77b9-48e2-83f7-3b74178a431e tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:12.751356 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-69bd214e-77b9-48e2-83f7-3b74178a431e tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:12.752425 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-455d05a5-f0ce-4d40-8f5c-fdd2c03166b3 req-bf2418d9-404e-4922-bf74-55160ecc36b0 service nova] Creating event network-changed:9c8702f3-cdfe-4a4b-9877-3df5412c0e8d for instance 815705bc-e49e-47a1-864b-9cc550464808 on n-h2-850501-12 Sep 08 10:39:12.765410 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [req-455d05a5-f0ce-4d40-8f5c-fdd2c03166b3 req-bf2418d9-404e-4922-bf74-55160ecc36b0 service nova] Instance 815705bc-e49e-47a1-864b-9cc550464808 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850501-12', 'n-h1-850501-12'} {{(pid=128861) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 10:39:12.791882 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-455d05a5-f0ce-4d40-8f5c-fdd2c03166b3 req-bf2418d9-404e-4922-bf74-55160ecc36b0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098729 Sep 08 10:39:12.795477 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 327/673] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:39:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:39:12.803779 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b2582821-e498-4649-a8c1-6f430c13912e tempest-FlavorsV2TestJSON-83950459 tempest-FlavorsV2TestJSON-83950459-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:12.819820 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b2582821-e498-4649-a8c1-6f430c13912e tempest-FlavorsV2TestJSON-83950459 tempest-FlavorsV2TestJSON-83950459-project] 10.222.0.27 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.020467 Sep 08 10:39:12.820671 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 328/674] 10.222.0.27 () {58 vars in 1140 bytes} [Thu Sep 8 10:39:12 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:39:12.826759 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3f3776fd-22cd-4e4b-ab72-7434e726117c tempest-QuotasAdminNegativeTest-1037091041 tempest-QuotasAdminNegativeTest-1037091041-project-admin] Action: 'update', calling method: .version_select at 0x7f68e4953dc0>, body: {"quota_set": {"ram": 51200}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:39:12.930598 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3f3776fd-22cd-4e4b-ab72-7434e726117c tempest-QuotasAdminNegativeTest-1037091041 tempest-QuotasAdminNegativeTest-1037091041-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:12.931523 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3f3776fd-22cd-4e4b-ab72-7434e726117c tempest-QuotasAdminNegativeTest-1037091041 tempest-QuotasAdminNegativeTest-1037091041-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:12.932025 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3f3776fd-22cd-4e4b-ab72-7434e726117c tempest-QuotasAdminNegativeTest-1037091041 tempest-QuotasAdminNegativeTest-1037091041-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:12.933017 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3f3776fd-22cd-4e4b-ab72-7434e726117c tempest-QuotasAdminNegativeTest-1037091041 tempest-QuotasAdminNegativeTest-1037091041-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:12.934472 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3f3776fd-22cd-4e4b-ab72-7434e726117c tempest-QuotasAdminNegativeTest-1037091041 tempest-QuotasAdminNegativeTest-1037091041-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:12.934981 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3f3776fd-22cd-4e4b-ab72-7434e726117c tempest-QuotasAdminNegativeTest-1037091041 tempest-QuotasAdminNegativeTest-1037091041-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:12.972129 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:39:13.002054 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3f3776fd-22cd-4e4b-ab72-7434e726117c tempest-QuotasAdminNegativeTest-1037091041 tempest-QuotasAdminNegativeTest-1037091041-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/aa32aea2a8d94171a573610b4562f643" status: 200 len: 330 microversion: 2.1 time: 0.180041 Sep 08 10:39:13.003070 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 329/675] 10.222.0.27 () {60 vars in 1262 bytes} [Thu Sep 8 10:39:12 2022] PUT /compute/v2.1/os-quota-sets/aa32aea2a8d94171a573610b4562f643 => generated 330 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:39:13.009753 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8e7283e5-d90d-4a27-b1fd-dae42e2b3fac tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:13.009753 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8e7283e5-d90d-4a27-b1fd-dae42e2b3fac tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 422ceb5f-740f-45e5-9596-6796719adf27] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:13.018397 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8e7283e5-d90d-4a27-b1fd-dae42e2b3fac tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:13.018988 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8e7283e5-d90d-4a27-b1fd-dae42e2b3fac tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:13.019486 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8e7283e5-d90d-4a27-b1fd-dae42e2b3fac tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:13.020318 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8e7283e5-d90d-4a27-b1fd-dae42e2b3fac tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:13.020778 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8e7283e5-d90d-4a27-b1fd-dae42e2b3fac tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:13.021256 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8e7283e5-d90d-4a27-b1fd-dae42e2b3fac tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:13.087703 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-69bd214e-77b9-48e2-83f7-3b74178a431e tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad3d26d79c34a0c90a99eeaa85f6e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bc2a412ede463e94d6933c30bc06ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:13.096337 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-69bd214e-77b9-48e2-83f7-3b74178a431e tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] 10.222.0.27 "GET /compute/v2.1/servers/c7a958dd-d267-4932-b7d1-6e50d6c1b21e" status: 200 len: 1313 microversion: 2.1 time: 0.369547 Sep 08 10:39:13.101636 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 347/676] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:12 2022] GET /compute/v2.1/servers/c7a958dd-d267-4932-b7d1-6e50d6c1b21e => generated 1313 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:13.102394 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f4ce5ee7-4b72-4e9d-a702-0488f2300446 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:13.119559 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.compute.server_groups [None req-f4ce5ee7-4b72-4e9d-a702-0488f2300446 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Querying cell 2785b110-f847-4739-9d30-5b571c6d79f4(cell1) for 2 instances {{(pid=128862) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 08 10:39:13.120279 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f4ce5ee7-4b72-4e9d-a702-0488f2300446 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:13.121952 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f4ce5ee7-4b72-4e9d-a702-0488f2300446 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:13.122692 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f4ce5ee7-4b72-4e9d-a702-0488f2300446 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:13.166360 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f4ce5ee7-4b72-4e9d-a702-0488f2300446 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups/bf93089d-19b3-4149-bb6d-266993d8a421" status: 200 len: 271 microversion: 2.1 time: 0.057657 Sep 08 10:39:13.170025 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 348/677] 10.222.0.27 () {58 vars in 1263 bytes} [Thu Sep 8 10:39:13 2022] GET /compute/v2.1/os-server-groups/bf93089d-19b3-4149-bb6d-266993d8a421 => generated 271 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:39:13.174450 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-070641d2-81fd-4cb1-b1c0-adb5993ab9ec tempest-FlavorsV2TestJSON-83950459 tempest-FlavorsV2TestJSON-83950459-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:13.182754 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-070641d2-81fd-4cb1-b1c0-adb5993ab9ec tempest-FlavorsV2TestJSON-83950459 tempest-FlavorsV2TestJSON-83950459-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014397 Sep 08 10:39:13.183318 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 349/678] 10.222.0.27 () {58 vars in 1137 bytes} [Thu Sep 8 10:39:13 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:39:13.188344 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-95078064-78af-4abe-9b69-53e3813abad9 tempest-QuotasAdminNegativeTest-359616318 tempest-QuotasAdminNegativeTest-359616318-project] Action: 'update', calling method: .version_select at 0x7f68e4aec8b0>, body: {"quota_set": {"ram": 0}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:39:13.193336 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-95078064-78af-4abe-9b69-53e3813abad9 tempest-QuotasAdminNegativeTest-359616318 tempest-QuotasAdminNegativeTest-359616318-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '4031f73b38214174ac528c1f0fe3144c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa32aea2a8d94171a573610b4562f643', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:13.195269 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-95078064-78af-4abe-9b69-53e3813abad9 tempest-QuotasAdminNegativeTest-359616318 tempest-QuotasAdminNegativeTest-359616318-project] Request method failure captured: Sep 08 10:39:13.195269 n-d-850501-12 devstack@n-api.service[128862]: request: PUT /compute/v2.1/os-quota-sets/aa32aea2a8d94171a573610b4562f643 HTTP/1.1 Sep 08 10:39:13.195269 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:39:13.195269 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:39:13.195269 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:39:13.195269 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 25 Sep 08 10:39:13.195269 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:39:13.195269 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:39:13.195269 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:39:13.195269 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:39:13.195269 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcZEmgFYArtgeXDxJnAbUCdIfqotVtGXkZLXqqPZBBM2UYCvVyyokSkM4VqLPezRd8VXjIs8qyY416z4LPITQDe97Z2Ee7It-I9BfBpnXVrY8h9tDa4PkZf8l6w9VVFwEKEZaVlbPv9DiVuZQLv7v3m5zy8vFT6irBdusPJ8JVCzRFc Sep 08 10:39:13.195269 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:39:13.195269 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:39:13.195269 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:39:13.195269 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:39:13.195269 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:39:13.195269 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:39:13.195269 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: aa32aea2a8d94171a573610b4562f643 Sep 08 10:39:13.195269 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-QuotasAdminNegativeTest-359616318 Sep 08 10:39:13.195269 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:39:13.195269 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:39:13.197424 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/aa32aea2a8d94171a573610b4562f643"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/aa32aea2a8d94171a573610b4562f643"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_aa32aea2a8d94171a573610b4562f643"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/aa32aea2a8d94171a573610b4562f643"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:39:13.197424 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-QuotasAdminNegativeTest-359616318 Sep 08 10:39:13.197424 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: aa32aea2a8d94171a573610b4562f643 Sep 08 10:39:13.197424 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-359616318 Sep 08 10:39:13.197424 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-QuotasAdminNegativeTest-359616318-project Sep 08 10:39:13.197424 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:39:13.197424 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:39:13.197424 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 4031f73b38214174ac528c1f0fe3144c Sep 08 10:39:13.197424 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-QuotasAdminNegativeTest-359616318-project Sep 08 10:39:13.197424 n-d-850501-12 devstack@n-api.service[128862]: Sep 08 10:39:13.197424 n-d-850501-12 devstack@n-api.service[128862]: {"quota_set": {"ram": 0}} Sep 08 10:39:13.197424 n-d-850501-12 devstack@n-api.service[128862]: method: Sep 08 10:39:13.197424 n-d-850501-12 devstack@n-api.service[128862]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Sep 08 10:39:13.197424 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'aa32aea2a8d94171a573610b4562f643', 'body': {'quota_set': {'ram': 0}}} Sep 08 10:39:13.201732 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:39:13.201732 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:39:13.201732 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:39:13.201732 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:39:13.201732 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:39:13.201732 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:39:13.201732 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:39:13.201732 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:39:13.201732 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:39:13.201732 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:39:13.201732 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:39:13.201732 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:39:13.201732 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Sep 08 10:39:13.201732 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Sep 08 10:39:13.201732 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 08 10:39:13.201732 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:39:13.201732 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 08 10:39:13.201732 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:39:13.201732 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Sep 08 10:39:13.205324 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Sep 08 10:39:13.205324 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 10:39:13.205324 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 10:39:13.205324 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 10:39:13.205324 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 10:39:13.205324 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:39:13.205324 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:39:13.205324 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:39:13.205324 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:39:13.205324 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 10:39:13.205324 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 10:39:13.205324 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 10:39:13.205324 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 10:39:13.205324 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 10:39:13.205324 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 10:39:13.205324 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Sep 08 10:39:13.205324 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:39:13.205324 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:39:13.205324 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:39:13.205324 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:39:13.207693 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:39:13.207693 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:39:13.207693 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 10:39:13.207693 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 10:39:13.207693 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Sep 08 10:39:13.207693 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:39:13.207693 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-95078064-78af-4abe-9b69-53e3813abad9 tempest-QuotasAdminNegativeTest-359616318 tempest-QuotasAdminNegativeTest-359616318-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:39:13.207693 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-95078064-78af-4abe-9b69-53e3813abad9 tempest-QuotasAdminNegativeTest-359616318 tempest-QuotasAdminNegativeTest-359616318-project] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/aa32aea2a8d94171a573610b4562f643" status: 403 len: 116 microversion: 2.1 time: 0.012335 Sep 08 10:39:13.207693 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 350/679] 10.222.0.27 () {60 vars in 1262 bytes} [Thu Sep 8 10:39:13 2022] PUT /compute/v2.1/os-quota-sets/aa32aea2a8d94171a573610b4562f643 => generated 116 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:39:13.208992 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-f1936794-7705-44a2-b480-83c3d85c7520 req-0085a890-22ff-43fe-b297-091ad756d102 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fc866b1-81ac-4c09-86ab-6d8a4a580294", "tag": "db9922aa-1490-4e6a-9ed5-89cbee224339"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:39:13.215514 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-f1936794-7705-44a2-b480-83c3d85c7520 req-0085a890-22ff-43fe-b297-091ad756d102 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:13.215784 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-f1936794-7705-44a2-b480-83c3d85c7520 req-0085a890-22ff-43fe-b297-091ad756d102 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:13.216523 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-f1936794-7705-44a2-b480-83c3d85c7520 req-0085a890-22ff-43fe-b297-091ad756d102 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:13.227882 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-f1936794-7705-44a2-b480-83c3d85c7520 req-0085a890-22ff-43fe-b297-091ad756d102 service nova] Creating event network-changed:db9922aa-1490-4e6a-9ed5-89cbee224339 for instance 1fc866b1-81ac-4c09-86ab-6d8a4a580294 on n-h1-850501-12 Sep 08 10:39:13.234216 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-f1936794-7705-44a2-b480-83c3d85c7520 req-0085a890-22ff-43fe-b297-091ad756d102 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035845 Sep 08 10:39:13.235103 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 351/680] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:39:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:39:13.239805 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7bb7b93c-0663-4122-a38f-6f2dda807830 tempest-ServersOnMultiNodesTest-60601867 tempest-ServersOnMultiNodesTest-60601867-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:13.240539 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7bb7b93c-0663-4122-a38f-6f2dda807830 tempest-ServersOnMultiNodesTest-60601867 tempest-ServersOnMultiNodesTest-60601867-project-admin] [instance: 83037cf6-4a7d-4ba8-8ecb-469feb7598b8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:13.247821 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7bb7b93c-0663-4122-a38f-6f2dda807830 tempest-ServersOnMultiNodesTest-60601867 tempest-ServersOnMultiNodesTest-60601867-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:13.248425 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7bb7b93c-0663-4122-a38f-6f2dda807830 tempest-ServersOnMultiNodesTest-60601867 tempest-ServersOnMultiNodesTest-60601867-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:13.249007 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7bb7b93c-0663-4122-a38f-6f2dda807830 tempest-ServersOnMultiNodesTest-60601867 tempest-ServersOnMultiNodesTest-60601867-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:13.249800 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7bb7b93c-0663-4122-a38f-6f2dda807830 tempest-ServersOnMultiNodesTest-60601867 tempest-ServersOnMultiNodesTest-60601867-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:13.250263 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7bb7b93c-0663-4122-a38f-6f2dda807830 tempest-ServersOnMultiNodesTest-60601867 tempest-ServersOnMultiNodesTest-60601867-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:13.250768 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7bb7b93c-0663-4122-a38f-6f2dda807830 tempest-ServersOnMultiNodesTest-60601867 tempest-ServersOnMultiNodesTest-60601867-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:13.302846 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8e7283e5-d90d-4a27-b1fd-dae42e2b3fac tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:13.315276 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8e7283e5-d90d-4a27-b1fd-dae42e2b3fac tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:13.316871 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8e7283e5-d90d-4a27-b1fd-dae42e2b3fac tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:13.318142 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8e7283e5-d90d-4a27-b1fd-dae42e2b3fac tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/422ceb5f-740f-45e5-9596-6796719adf27" status: 200 len: 1566 microversion: 2.25 time: 0.314285 Sep 08 10:39:13.318785 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 330/681] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:39:13 2022] GET /compute/v2.1/servers/422ceb5f-740f-45e5-9596-6796719adf27 => generated 1566 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:39:13.323513 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6c0fb910-8038-496e-a422-f149c0f4e207 tempest-FlavorsV2TestJSON-83950459 tempest-FlavorsV2TestJSON-83950459-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:13.351504 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6c0fb910-8038-496e-a422-f149c0f4e207 tempest-FlavorsV2TestJSON-83950459 tempest-FlavorsV2TestJSON-83950459-project] 10.222.0.27 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1540 microversion: 2.1 time: 0.031265 Sep 08 10:39:13.363810 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 331/682] 10.222.0.27 () {58 vars in 1146 bytes} [Thu Sep 8 10:39:13 2022] GET /compute/v2.1/flavors?marker=452 => generated 1540 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:13.371727 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c6ebab97-bb8a-4149-9571-a993edf34b83 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:13.372552 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c6ebab97-bb8a-4149-9571-a993edf34b83 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 815705bc-e49e-47a1-864b-9cc550464808] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:13.379579 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c6ebab97-bb8a-4149-9571-a993edf34b83 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:13.380236 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c6ebab97-bb8a-4149-9571-a993edf34b83 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:13.380976 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c6ebab97-bb8a-4149-9571-a993edf34b83 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:13.382012 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c6ebab97-bb8a-4149-9571-a993edf34b83 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:13.382528 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c6ebab97-bb8a-4149-9571-a993edf34b83 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:13.383149 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c6ebab97-bb8a-4149-9571-a993edf34b83 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:13.456764 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7bb7b93c-0663-4122-a38f-6f2dda807830 tempest-ServersOnMultiNodesTest-60601867 tempest-ServersOnMultiNodesTest-60601867-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/83037cf6-4a7d-4ba8-8ecb-469feb7598b8" status: 200 len: 1620 microversion: 2.1 time: 0.213172 Sep 08 10:39:13.457487 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 352/683] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:13 2022] GET /compute/v2.1/servers/83037cf6-4a7d-4ba8-8ecb-469feb7598b8 => generated 1620 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:13.462099 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5221345f-56e4-4504-98e0-16a4c3b84bcc tempest-FlavorsV2TestJSON-83950459 tempest-FlavorsV2TestJSON-83950459-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:13.505494 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5221345f-56e4-4504-98e0-16a4c3b84bcc tempest-FlavorsV2TestJSON-83950459 tempest-FlavorsV2TestJSON-83950459-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.046655 Sep 08 10:39:13.506305 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 353/684] 10.222.0.27 () {58 vars in 1146 bytes} [Thu Sep 8 10:39:13 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:13.516151 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3b437154-daf1-479e-a5d8-b9a0a8ec999f tempest-ServersOnMultiNodesTest-60601867 tempest-ServersOnMultiNodesTest-60601867-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:13.517430 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3b437154-daf1-479e-a5d8-b9a0a8ec999f tempest-ServersOnMultiNodesTest-60601867 tempest-ServersOnMultiNodesTest-60601867-project-admin] [instance: 493cd490-27c5-4e08-a789-767757111cb2] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:13.527607 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b437154-daf1-479e-a5d8-b9a0a8ec999f tempest-ServersOnMultiNodesTest-60601867 tempest-ServersOnMultiNodesTest-60601867-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:13.528687 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b437154-daf1-479e-a5d8-b9a0a8ec999f tempest-ServersOnMultiNodesTest-60601867 tempest-ServersOnMultiNodesTest-60601867-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:13.529642 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b437154-daf1-479e-a5d8-b9a0a8ec999f tempest-ServersOnMultiNodesTest-60601867 tempest-ServersOnMultiNodesTest-60601867-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:13.530859 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b437154-daf1-479e-a5d8-b9a0a8ec999f tempest-ServersOnMultiNodesTest-60601867 tempest-ServersOnMultiNodesTest-60601867-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:13.531810 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b437154-daf1-479e-a5d8-b9a0a8ec999f tempest-ServersOnMultiNodesTest-60601867 tempest-ServersOnMultiNodesTest-60601867-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:13.532748 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b437154-daf1-479e-a5d8-b9a0a8ec999f tempest-ServersOnMultiNodesTest-60601867 tempest-ServersOnMultiNodesTest-60601867-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:13.590117 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c6ebab97-bb8a-4149-9571-a993edf34b83 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:13.598861 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c6ebab97-bb8a-4149-9571-a993edf34b83 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808" status: 200 len: 1474 microversion: 2.1 time: 0.233460 Sep 08 10:39:13.599676 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 332/685] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:13 2022] GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808 => generated 1474 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:13.604658 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-143c2335-b3c2-4a72-9366-54110d783ca0 tempest-FlavorsV2TestJSON-83950459 tempest-FlavorsV2TestJSON-83950459-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:13.614608 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-143c2335-b3c2-4a72-9366-54110d783ca0 tempest-FlavorsV2TestJSON-83950459 tempest-FlavorsV2TestJSON-83950459-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013640 Sep 08 10:39:13.615845 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 333/686] 10.222.0.27 () {58 vars in 1137 bytes} [Thu Sep 8 10:39:13 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:39:13.690605 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3b437154-daf1-479e-a5d8-b9a0a8ec999f tempest-ServersOnMultiNodesTest-60601867 tempest-ServersOnMultiNodesTest-60601867-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/493cd490-27c5-4e08-a789-767757111cb2" status: 200 len: 1620 microversion: 2.1 time: 0.181703 Sep 08 10:39:13.691398 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 354/687] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:13 2022] GET /compute/v2.1/servers/493cd490-27c5-4e08-a789-767757111cb2 => generated 1620 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:13.716462 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-749e71a2-ef96-43d3-b7de-b68c740bf2d0 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:13.718083 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-749e71a2-ef96-43d3-b7de-b68c740bf2d0 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 1fc866b1-81ac-4c09-86ab-6d8a4a580294] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:13.734710 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-749e71a2-ef96-43d3-b7de-b68c740bf2d0 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:13.735557 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-749e71a2-ef96-43d3-b7de-b68c740bf2d0 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:13.736099 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-749e71a2-ef96-43d3-b7de-b68c740bf2d0 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:13.737703 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-749e71a2-ef96-43d3-b7de-b68c740bf2d0 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:13.738401 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-749e71a2-ef96-43d3-b7de-b68c740bf2d0 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:13.740021 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-749e71a2-ef96-43d3-b7de-b68c740bf2d0 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:13.881196 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-21e25870-e091-4d20-9e1f-fbb8fd2b82f5 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-971828583", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "a3147437-e6f2-480d-bcaf-cc0f030d497d"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:39:13.947325 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-21e25870-e091-4d20-9e1f-fbb8fd2b82f5 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] validate_networks() for None {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:39:13.962103 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-749e71a2-ef96-43d3-b7de-b68c740bf2d0 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:13.976405 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-749e71a2-ef96-43d3-b7de-b68c740bf2d0 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/1fc866b1-81ac-4c09-86ab-6d8a4a580294" status: 200 len: 1311 microversion: 2.1 time: 0.264982 Sep 08 10:39:13.977063 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 334/688] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:13 2022] GET /compute/v2.1/servers/1fc866b1-81ac-4c09-86ab-6d8a4a580294 => generated 1311 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:14.125638 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d8cad352-e97c-4a22-bf89-83f5d7be91e8 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:14.126290 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d8cad352-e97c-4a22-bf89-83f5d7be91e8 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] [instance: c7a958dd-d267-4932-b7d1-6e50d6c1b21e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:14.134324 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d8cad352-e97c-4a22-bf89-83f5d7be91e8 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:14.135077 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d8cad352-e97c-4a22-bf89-83f5d7be91e8 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:14.135702 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d8cad352-e97c-4a22-bf89-83f5d7be91e8 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:14.138600 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d8cad352-e97c-4a22-bf89-83f5d7be91e8 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:14.139487 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d8cad352-e97c-4a22-bf89-83f5d7be91e8 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:14.140290 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d8cad352-e97c-4a22-bf89-83f5d7be91e8 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:14.282731 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-21e25870-e091-4d20-9e1f-fbb8fd2b82f5 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:39:14.283152 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-21e25870-e091-4d20-9e1f-fbb8fd2b82f5 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:39:14.283801 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-21e25870-e091-4d20-9e1f-fbb8fd2b82f5 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:39:14.284374 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-21e25870-e091-4d20-9e1f-fbb8fd2b82f5 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:39:14.285216 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-21e25870-e091-4d20-9e1f-fbb8fd2b82f5 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:39:14.297293 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-21e25870-e091-4d20-9e1f-fbb8fd2b82f5 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:14.297782 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-21e25870-e091-4d20-9e1f-fbb8fd2b82f5 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:14.298339 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-21e25870-e091-4d20-9e1f-fbb8fd2b82f5 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:14.299306 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-21e25870-e091-4d20-9e1f-fbb8fd2b82f5 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:14.299922 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-21e25870-e091-4d20-9e1f-fbb8fd2b82f5 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:14.300895 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-21e25870-e091-4d20-9e1f-fbb8fd2b82f5 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:14.326319 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-21e25870-e091-4d20-9e1f-fbb8fd2b82f5 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Getting quotas for project 2a3d4a2ec8674e418602b6dc0cec6ab9. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:39:14.331926 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-21e25870-e091-4d20-9e1f-fbb8fd2b82f5 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Getting quotas for user 771c067cf6814084a5520128a970dc82 and project 2a3d4a2ec8674e418602b6dc0cec6ab9. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:39:14.349374 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-21e25870-e091-4d20-9e1f-fbb8fd2b82f5 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:39:14.351776 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-21e25870-e091-4d20-9e1f-fbb8fd2b82f5 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: 8be00267-7835-4f68-bb40-6677750c0e3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:39:14.417109 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-21e25870-e091-4d20-9e1f-fbb8fd2b82f5 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.537274 Sep 08 10:39:14.420620 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 355/689] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:39:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 544 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 10:39:14.442766 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c6b978cd-0ea0-45b8-a3c5-86e7ca719dba tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:14.443389 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c6b978cd-0ea0-45b8-a3c5-86e7ca719dba tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 422ceb5f-740f-45e5-9596-6796719adf27] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:14.458076 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c6b978cd-0ea0-45b8-a3c5-86e7ca719dba tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:14.458721 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c6b978cd-0ea0-45b8-a3c5-86e7ca719dba tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:14.459368 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c6b978cd-0ea0-45b8-a3c5-86e7ca719dba tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:14.460718 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c6b978cd-0ea0-45b8-a3c5-86e7ca719dba tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:14.461395 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c6b978cd-0ea0-45b8-a3c5-86e7ca719dba tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:14.462214 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c6b978cd-0ea0-45b8-a3c5-86e7ca719dba tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:14.986876 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d8cad352-e97c-4a22-bf89-83f5d7be91e8 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad3d26d79c34a0c90a99eeaa85f6e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bc2a412ede463e94d6933c30bc06ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:15.003869 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d8cad352-e97c-4a22-bf89-83f5d7be91e8 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] 10.222.0.27 "GET /compute/v2.1/servers/c7a958dd-d267-4932-b7d1-6e50d6c1b21e" status: 200 len: 1313 microversion: 2.1 time: 0.883379 Sep 08 10:39:15.006168 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 335/690] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:14 2022] GET /compute/v2.1/servers/c7a958dd-d267-4932-b7d1-6e50d6c1b21e => generated 1313 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:15.025588 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2418dca9-ce22-4e3e-92ba-bb3d973b4726 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:15.026464 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2418dca9-ce22-4e3e-92ba-bb3d973b4726 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: 8be00267-7835-4f68-bb40-6677750c0e3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:15.045386 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2418dca9-ce22-4e3e-92ba-bb3d973b4726 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:15.047102 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2418dca9-ce22-4e3e-92ba-bb3d973b4726 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:15.048409 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2418dca9-ce22-4e3e-92ba-bb3d973b4726 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:15.051272 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2418dca9-ce22-4e3e-92ba-bb3d973b4726 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:15.052141 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2418dca9-ce22-4e3e-92ba-bb3d973b4726 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:15.053318 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2418dca9-ce22-4e3e-92ba-bb3d973b4726 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:15.207456 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c6b978cd-0ea0-45b8-a3c5-86e7ca719dba tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:15.220833 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c6b978cd-0ea0-45b8-a3c5-86e7ca719dba tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:15.222353 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c6b978cd-0ea0-45b8-a3c5-86e7ca719dba tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:15.223547 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c6b978cd-0ea0-45b8-a3c5-86e7ca719dba tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/422ceb5f-740f-45e5-9596-6796719adf27" status: 200 len: 1566 microversion: 2.25 time: 0.801893 Sep 08 10:39:15.231737 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 356/691] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:39:14 2022] GET /compute/v2.1/servers/422ceb5f-740f-45e5-9596-6796719adf27 => generated 1566 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:39:15.256802 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-95ac32a4-f790-40e6-9dd5-767da98d661e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:15.257503 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-95ac32a4-f790-40e6-9dd5-767da98d661e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 815705bc-e49e-47a1-864b-9cc550464808] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:15.267162 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-95ac32a4-f790-40e6-9dd5-767da98d661e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:15.270541 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-95ac32a4-f790-40e6-9dd5-767da98d661e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:15.274288 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-95ac32a4-f790-40e6-9dd5-767da98d661e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:15.274856 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-95ac32a4-f790-40e6-9dd5-767da98d661e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:15.275347 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-95ac32a4-f790-40e6-9dd5-767da98d661e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:15.275853 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-95ac32a4-f790-40e6-9dd5-767da98d661e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:15.284944 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:39:15.524195 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2418dca9-ce22-4e3e-92ba-bb3d973b4726 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:15.548572 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2418dca9-ce22-4e3e-92ba-bb3d973b4726 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/8be00267-7835-4f68-bb40-6677750c0e3c" status: 200 len: 1220 microversion: 2.1 time: 0.525587 Sep 08 10:39:15.570836 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 336/692] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:15 2022] GET /compute/v2.1/servers/8be00267-7835-4f68-bb40-6677750c0e3c => generated 1220 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:15.596333 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-e48989f9-839c-477d-9c01-007d5d72fc14 req-a47a959b-7188-4e5a-9a3b-b7d3450bf164 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7a958dd-d267-4932-b7d1-6e50d6c1b21e", "tag": "3ada0876-b5fd-4760-bd4f-a946d46aeeae"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:39:15.610128 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-e48989f9-839c-477d-9c01-007d5d72fc14 req-a47a959b-7188-4e5a-9a3b-b7d3450bf164 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:15.611171 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-e48989f9-839c-477d-9c01-007d5d72fc14 req-a47a959b-7188-4e5a-9a3b-b7d3450bf164 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:15.611615 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-e48989f9-839c-477d-9c01-007d5d72fc14 req-a47a959b-7188-4e5a-9a3b-b7d3450bf164 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:15.657959 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-e48989f9-839c-477d-9c01-007d5d72fc14 req-a47a959b-7188-4e5a-9a3b-b7d3450bf164 service nova] Creating event network-changed:3ada0876-b5fd-4760-bd4f-a946d46aeeae for instance c7a958dd-d267-4932-b7d1-6e50d6c1b21e on n-h1-850501-12 Sep 08 10:39:15.670151 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-e48989f9-839c-477d-9c01-007d5d72fc14 req-a47a959b-7188-4e5a-9a3b-b7d3450bf164 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096804 Sep 08 10:39:15.675515 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 337/693] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:39:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:39:15.680949 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-95ac32a4-f790-40e6-9dd5-767da98d661e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:15.690846 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-20a9d671-d0e2-4e46-90d0-b402757a70aa tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:15.694184 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-20a9d671-d0e2-4e46-90d0-b402757a70aa tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 1fc866b1-81ac-4c09-86ab-6d8a4a580294] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:15.694503 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-95ac32a4-f790-40e6-9dd5-767da98d661e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808" status: 200 len: 1471 microversion: 2.1 time: 0.446319 Sep 08 10:39:15.696767 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 357/694] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:15 2022] GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808 => generated 1471 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:15.720744 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9add88eb-c620-489c-9ca6-830542a29ec9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:39:15.721612 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9add88eb-c620-489c-9ca6-830542a29ec9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 815705bc-e49e-47a1-864b-9cc550464808] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:15.724286 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-20a9d671-d0e2-4e46-90d0-b402757a70aa tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:15.725515 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-20a9d671-d0e2-4e46-90d0-b402757a70aa tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:15.726115 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-20a9d671-d0e2-4e46-90d0-b402757a70aa tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:15.727122 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-20a9d671-d0e2-4e46-90d0-b402757a70aa tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:15.727731 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-20a9d671-d0e2-4e46-90d0-b402757a70aa tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:15.728331 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-20a9d671-d0e2-4e46-90d0-b402757a70aa tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:15.737863 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9add88eb-c620-489c-9ca6-830542a29ec9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:15.738817 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9add88eb-c620-489c-9ca6-830542a29ec9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:15.741454 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9add88eb-c620-489c-9ca6-830542a29ec9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:15.744716 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9add88eb-c620-489c-9ca6-830542a29ec9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:15.745999 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9add88eb-c620-489c-9ca6-830542a29ec9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:15.748117 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9add88eb-c620-489c-9ca6-830542a29ec9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:15.858133 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9add88eb-c620-489c-9ca6-830542a29ec9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "POST /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808/action" status: 204 len: 0 microversion: 2.1 time: 0.142364 Sep 08 10:39:15.863763 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 358/695] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:39:15 2022] POST /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808/action => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 10:39:15.870081 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a112fd49-ccb1-4e91-8f86-f5ba818f549a tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:15.880423 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a112fd49-ccb1-4e91-8f86-f5ba818f549a tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 815705bc-e49e-47a1-864b-9cc550464808] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:15.900722 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a112fd49-ccb1-4e91-8f86-f5ba818f549a tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:15.901280 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a112fd49-ccb1-4e91-8f86-f5ba818f549a tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:15.904402 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a112fd49-ccb1-4e91-8f86-f5ba818f549a tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:15.905345 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a112fd49-ccb1-4e91-8f86-f5ba818f549a tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:15.905827 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a112fd49-ccb1-4e91-8f86-f5ba818f549a tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:15.906262 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a112fd49-ccb1-4e91-8f86-f5ba818f549a tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:16.285829 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a112fd49-ccb1-4e91-8f86-f5ba818f549a tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:16.312519 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a112fd49-ccb1-4e91-8f86-f5ba818f549a tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808" status: 200 len: 1471 microversion: 2.1 time: 0.446960 Sep 08 10:39:16.328020 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 359/696] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:15 2022] GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808 => generated 1471 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:16.341165 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ab6b068d-1b01-44a5-a88b-2c200acc12dc tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:16.341841 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ab6b068d-1b01-44a5-a88b-2c200acc12dc tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] [instance: c7a958dd-d267-4932-b7d1-6e50d6c1b21e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:16.357050 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab6b068d-1b01-44a5-a88b-2c200acc12dc tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:16.358324 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab6b068d-1b01-44a5-a88b-2c200acc12dc tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:16.358989 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab6b068d-1b01-44a5-a88b-2c200acc12dc tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:16.360522 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab6b068d-1b01-44a5-a88b-2c200acc12dc tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:16.361367 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab6b068d-1b01-44a5-a88b-2c200acc12dc tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:16.362193 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab6b068d-1b01-44a5-a88b-2c200acc12dc tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:16.467586 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-20a9d671-d0e2-4e46-90d0-b402757a70aa tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:16.483118 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-20a9d671-d0e2-4e46-90d0-b402757a70aa tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/1fc866b1-81ac-4c09-86ab-6d8a4a580294" status: 200 len: 1311 microversion: 2.1 time: 0.805974 Sep 08 10:39:16.484083 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 338/697] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:15 2022] GET /compute/v2.1/servers/1fc866b1-81ac-4c09-86ab-6d8a4a580294 => generated 1311 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:16.500817 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1e133858-eae9-4c71-a9b5-b3d7ef8f95e1 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:16.501606 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1e133858-eae9-4c71-a9b5-b3d7ef8f95e1 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 422ceb5f-740f-45e5-9596-6796719adf27] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:16.508052 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e133858-eae9-4c71-a9b5-b3d7ef8f95e1 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:16.508543 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e133858-eae9-4c71-a9b5-b3d7ef8f95e1 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:16.508970 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e133858-eae9-4c71-a9b5-b3d7ef8f95e1 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:16.509828 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e133858-eae9-4c71-a9b5-b3d7ef8f95e1 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:16.510287 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e133858-eae9-4c71-a9b5-b3d7ef8f95e1 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:16.512594 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e133858-eae9-4c71-a9b5-b3d7ef8f95e1 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:16.644313 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ab6b068d-1b01-44a5-a88b-2c200acc12dc tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad3d26d79c34a0c90a99eeaa85f6e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bc2a412ede463e94d6933c30bc06ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:16.670855 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ab6b068d-1b01-44a5-a88b-2c200acc12dc tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] 10.222.0.27 "GET /compute/v2.1/servers/c7a958dd-d267-4932-b7d1-6e50d6c1b21e" status: 200 len: 1313 microversion: 2.1 time: 0.341110 Sep 08 10:39:16.685243 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 360/698] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:16 2022] GET /compute/v2.1/servers/c7a958dd-d267-4932-b7d1-6e50d6c1b21e => generated 1313 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:16.698863 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2c299ac0-c345-4de0-945d-3cfc952bf37d tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:16.699870 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2c299ac0-c345-4de0-945d-3cfc952bf37d tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: 8be00267-7835-4f68-bb40-6677750c0e3c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:16.707393 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2c299ac0-c345-4de0-945d-3cfc952bf37d tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:16.707901 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2c299ac0-c345-4de0-945d-3cfc952bf37d tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:16.708862 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2c299ac0-c345-4de0-945d-3cfc952bf37d tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:16.709828 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2c299ac0-c345-4de0-945d-3cfc952bf37d tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:16.711000 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2c299ac0-c345-4de0-945d-3cfc952bf37d tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:16.711434 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2c299ac0-c345-4de0-945d-3cfc952bf37d tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:16.802106 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2c299ac0-c345-4de0-945d-3cfc952bf37d tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:16.813114 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2c299ac0-c345-4de0-945d-3cfc952bf37d tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/8be00267-7835-4f68-bb40-6677750c0e3c" status: 200 len: 1268 microversion: 2.1 time: 0.124484 Sep 08 10:39:16.819214 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 361/699] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:16 2022] GET /compute/v2.1/servers/8be00267-7835-4f68-bb40-6677750c0e3c => generated 1268 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:16.833532 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1e133858-eae9-4c71-a9b5-b3d7ef8f95e1 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:16.843883 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1e133858-eae9-4c71-a9b5-b3d7ef8f95e1 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:16.846259 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1e133858-eae9-4c71-a9b5-b3d7ef8f95e1 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:16.847523 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1e133858-eae9-4c71-a9b5-b3d7ef8f95e1 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/422ceb5f-740f-45e5-9596-6796719adf27" status: 200 len: 1566 microversion: 2.25 time: 0.362500 Sep 08 10:39:16.848174 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 339/700] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:39:16 2022] GET /compute/v2.1/servers/422ceb5f-740f-45e5-9596-6796719adf27 => generated 1566 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:39:17.360681 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6245af86-bc06-4c55-af0e-42500a934c4a tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:17.362057 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6245af86-bc06-4c55-af0e-42500a934c4a tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 815705bc-e49e-47a1-864b-9cc550464808] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:17.377591 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6245af86-bc06-4c55-af0e-42500a934c4a tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:17.378572 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6245af86-bc06-4c55-af0e-42500a934c4a tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:17.379199 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6245af86-bc06-4c55-af0e-42500a934c4a tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:17.381178 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6245af86-bc06-4c55-af0e-42500a934c4a tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:17.382112 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6245af86-bc06-4c55-af0e-42500a934c4a tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:17.382740 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6245af86-bc06-4c55-af0e-42500a934c4a tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:17.526512 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9bde2901-b281-4bd6-85a0-54d8705458ae tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:17.527684 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9bde2901-b281-4bd6-85a0-54d8705458ae tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 1fc866b1-81ac-4c09-86ab-6d8a4a580294] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:17.548993 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9bde2901-b281-4bd6-85a0-54d8705458ae tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:17.549584 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9bde2901-b281-4bd6-85a0-54d8705458ae tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:17.550030 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9bde2901-b281-4bd6-85a0-54d8705458ae tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:17.550956 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9bde2901-b281-4bd6-85a0-54d8705458ae tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:17.551432 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9bde2901-b281-4bd6-85a0-54d8705458ae tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:17.551868 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9bde2901-b281-4bd6-85a0-54d8705458ae tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:17.936606 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6245af86-bc06-4c55-af0e-42500a934c4a tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:17.952422 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6245af86-bc06-4c55-af0e-42500a934c4a tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808" status: 200 len: 1471 microversion: 2.1 time: 0.609993 Sep 08 10:39:17.955361 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 362/701] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:17 2022] GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808 => generated 1471 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:17.965350 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-08ecf080-9706-422b-847e-3b68ae2783e2 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:17.967041 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-08ecf080-9706-422b-847e-3b68ae2783e2 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] [instance: c7a958dd-d267-4932-b7d1-6e50d6c1b21e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:17.984303 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08ecf080-9706-422b-847e-3b68ae2783e2 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:17.984811 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08ecf080-9706-422b-847e-3b68ae2783e2 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:17.985287 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08ecf080-9706-422b-847e-3b68ae2783e2 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:17.986413 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08ecf080-9706-422b-847e-3b68ae2783e2 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:17.986883 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08ecf080-9706-422b-847e-3b68ae2783e2 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:17.987315 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08ecf080-9706-422b-847e-3b68ae2783e2 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:18.196860 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9bde2901-b281-4bd6-85a0-54d8705458ae tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:18.211589 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9bde2901-b281-4bd6-85a0-54d8705458ae tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/1fc866b1-81ac-4c09-86ab-6d8a4a580294" status: 200 len: 1311 microversion: 2.1 time: 0.690551 Sep 08 10:39:18.213868 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 340/702] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:17 2022] GET /compute/v2.1/servers/1fc866b1-81ac-4c09-86ab-6d8a4a580294 => generated 1311 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:18.224210 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-40dcee29-2a5e-4236-9c1d-227d3a8b21a3 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:18.227668 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-40dcee29-2a5e-4236-9c1d-227d3a8b21a3 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: 8be00267-7835-4f68-bb40-6677750c0e3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:18.240183 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-40dcee29-2a5e-4236-9c1d-227d3a8b21a3 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:18.244260 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-40dcee29-2a5e-4236-9c1d-227d3a8b21a3 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:18.244826 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-40dcee29-2a5e-4236-9c1d-227d3a8b21a3 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:18.247640 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-40dcee29-2a5e-4236-9c1d-227d3a8b21a3 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:18.248239 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-40dcee29-2a5e-4236-9c1d-227d3a8b21a3 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:18.250270 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-40dcee29-2a5e-4236-9c1d-227d3a8b21a3 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:18.430031 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-08ecf080-9706-422b-847e-3b68ae2783e2 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad3d26d79c34a0c90a99eeaa85f6e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bc2a412ede463e94d6933c30bc06ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:18.445787 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-08ecf080-9706-422b-847e-3b68ae2783e2 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] 10.222.0.27 "GET /compute/v2.1/servers/c7a958dd-d267-4932-b7d1-6e50d6c1b21e" status: 200 len: 1313 microversion: 2.1 time: 0.487753 Sep 08 10:39:18.446388 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 363/703] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:17 2022] GET /compute/v2.1/servers/c7a958dd-d267-4932-b7d1-6e50d6c1b21e => generated 1313 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:18.451045 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-634d1ddd-9376-4027-876e-468ebb0567c9 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:18.451658 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-634d1ddd-9376-4027-876e-468ebb0567c9 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 422ceb5f-740f-45e5-9596-6796719adf27] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:18.469500 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-634d1ddd-9376-4027-876e-468ebb0567c9 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:18.470010 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-634d1ddd-9376-4027-876e-468ebb0567c9 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:18.470458 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-634d1ddd-9376-4027-876e-468ebb0567c9 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:18.471165 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-634d1ddd-9376-4027-876e-468ebb0567c9 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:18.471637 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-634d1ddd-9376-4027-876e-468ebb0567c9 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:18.472069 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-634d1ddd-9376-4027-876e-468ebb0567c9 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:18.534723 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-40dcee29-2a5e-4236-9c1d-227d3a8b21a3 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:18.543627 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-40dcee29-2a5e-4236-9c1d-227d3a8b21a3 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/8be00267-7835-4f68-bb40-6677750c0e3c" status: 200 len: 1274 microversion: 2.1 time: 0.327863 Sep 08 10:39:18.561831 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 341/704] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:18 2022] GET /compute/v2.1/servers/8be00267-7835-4f68-bb40-6677750c0e3c => generated 1274 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:18.567413 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-4c68fdc4-72bf-4b0c-be4e-8da2c97910df req-a9df913d-4449-46b7-a85c-b81fba4668eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "815705bc-e49e-47a1-864b-9cc550464808", "name": "network-vif-plugged", "status": "completed", "tag": "9c8702f3-cdfe-4a4b-9877-3df5412c0e8d"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:39:18.578665 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-4c68fdc4-72bf-4b0c-be4e-8da2c97910df req-a9df913d-4449-46b7-a85c-b81fba4668eb service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:18.579423 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-4c68fdc4-72bf-4b0c-be4e-8da2c97910df req-a9df913d-4449-46b7-a85c-b81fba4668eb service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:18.580034 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-4c68fdc4-72bf-4b0c-be4e-8da2c97910df req-a9df913d-4449-46b7-a85c-b81fba4668eb service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:18.601867 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-4c68fdc4-72bf-4b0c-be4e-8da2c97910df req-a9df913d-4449-46b7-a85c-b81fba4668eb service nova] Creating event network-vif-plugged:9c8702f3-cdfe-4a4b-9877-3df5412c0e8d for instance 815705bc-e49e-47a1-864b-9cc550464808 on n-h2-850501-12 Sep 08 10:39:18.612187 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [req-4c68fdc4-72bf-4b0c-be4e-8da2c97910df req-a9df913d-4449-46b7-a85c-b81fba4668eb service nova] Instance 815705bc-e49e-47a1-864b-9cc550464808 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850501-12', 'n-h1-850501-12'} {{(pid=128861) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 10:39:18.644051 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-4c68fdc4-72bf-4b0c-be4e-8da2c97910df req-a9df913d-4449-46b7-a85c-b81fba4668eb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080508 Sep 08 10:39:18.661541 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 342/705] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:39:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:39:18.815746 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-634d1ddd-9376-4027-876e-468ebb0567c9 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:18.825161 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-634d1ddd-9376-4027-876e-468ebb0567c9 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:18.826640 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-634d1ddd-9376-4027-876e-468ebb0567c9 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:18.827817 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-634d1ddd-9376-4027-876e-468ebb0567c9 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/422ceb5f-740f-45e5-9596-6796719adf27" status: 200 len: 1566 microversion: 2.25 time: 0.380506 Sep 08 10:39:18.828380 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 364/706] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:39:18 2022] GET /compute/v2.1/servers/422ceb5f-740f-45e5-9596-6796719adf27 => generated 1566 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:39:18.895192 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b983eb2c-d7cd-4bda-acfd-8d465bd2cab9 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-653448786", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": "none"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:39:18.963091 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-b983eb2c-d7cd-4bda-acfd-8d465bd2cab9 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:39:18.963946 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-b983eb2c-d7cd-4bda-acfd-8d465bd2cab9 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:39:18.965251 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-b983eb2c-d7cd-4bda-acfd-8d465bd2cab9 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:39:18.965735 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-b983eb2c-d7cd-4bda-acfd-8d465bd2cab9 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:39:18.966215 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-b983eb2c-d7cd-4bda-acfd-8d465bd2cab9 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:39:18.976219 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b983eb2c-d7cd-4bda-acfd-8d465bd2cab9 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:18.976807 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b983eb2c-d7cd-4bda-acfd-8d465bd2cab9 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:18.977480 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b983eb2c-d7cd-4bda-acfd-8d465bd2cab9 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:18.978379 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b983eb2c-d7cd-4bda-acfd-8d465bd2cab9 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:18.978986 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b983eb2c-d7cd-4bda-acfd-8d465bd2cab9 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:18.979785 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b983eb2c-d7cd-4bda-acfd-8d465bd2cab9 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:18.987156 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-69d56f4b-d467-4856-9de0-61e8258d8ab9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:18.988568 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-69d56f4b-d467-4856-9de0-61e8258d8ab9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 815705bc-e49e-47a1-864b-9cc550464808] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:18.997679 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-69d56f4b-d467-4856-9de0-61e8258d8ab9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:19.000159 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-69d56f4b-d467-4856-9de0-61e8258d8ab9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:19.000159 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-69d56f4b-d467-4856-9de0-61e8258d8ab9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:19.001270 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-69d56f4b-d467-4856-9de0-61e8258d8ab9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:19.001897 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-69d56f4b-d467-4856-9de0-61e8258d8ab9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:19.002409 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-69d56f4b-d467-4856-9de0-61e8258d8ab9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:19.003052 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-b983eb2c-d7cd-4bda-acfd-8d465bd2cab9 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Getting quotas for project 61a225d8dbbb4febbb470cb27da07cae. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:39:19.008734 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-b983eb2c-d7cd-4bda-acfd-8d465bd2cab9 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Getting quotas for user 26c78589f2504ddd8985c82d4042ef98 and project 61a225d8dbbb4febbb470cb27da07cae. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:39:19.022415 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b983eb2c-d7cd-4bda-acfd-8d465bd2cab9 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:39:19.025914 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b983eb2c-d7cd-4bda-acfd-8d465bd2cab9 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] [instance: 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:39:19.081537 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b983eb2c-d7cd-4bda-acfd-8d465bd2cab9 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.362901 Sep 08 10:39:19.082190 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 343/707] 10.222.0.27 () {62 vars in 1188 bytes} [Thu Sep 8 10:39:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 365 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 08 10:39:19.098416 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e7d1038a-150f-445a-b3ba-371332179404 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:39:19.103008 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e7d1038a-150f-445a-b3ba-371332179404 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] [instance: 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:19.430684 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-69d56f4b-d467-4856-9de0-61e8258d8ab9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:19.441012 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-69d56f4b-d467-4856-9de0-61e8258d8ab9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808" status: 200 len: 1471 microversion: 2.1 time: 0.463178 Sep 08 10:39:19.462659 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 365/708] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:18 2022] GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808 => generated 1471 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:39:19.476171 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e7d1038a-150f-445a-b3ba-371332179404 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:19.476444 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1dc37248-a9fe-40e5-933c-6ba96406024e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:19.477009 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1dc37248-a9fe-40e5-933c-6ba96406024e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 1fc866b1-81ac-4c09-86ab-6d8a4a580294] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:19.486743 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e7d1038a-150f-445a-b3ba-371332179404 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:19.491686 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e7d1038a-150f-445a-b3ba-371332179404 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:19.500047 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1dc37248-a9fe-40e5-933c-6ba96406024e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:19.500972 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1dc37248-a9fe-40e5-933c-6ba96406024e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:19.501612 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1dc37248-a9fe-40e5-933c-6ba96406024e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:19.503551 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1dc37248-a9fe-40e5-933c-6ba96406024e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:19.505436 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1dc37248-a9fe-40e5-933c-6ba96406024e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:19.514012 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e7d1038a-150f-445a-b3ba-371332179404 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] 10.222.0.27 "PUT /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a" status: 200 len: 1358 microversion: 2.75 time: 0.422972 Sep 08 10:39:19.517902 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1dc37248-a9fe-40e5-933c-6ba96406024e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:19.521152 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 344/709] 10.222.0.27 () {62 vars in 1297 bytes} [Thu Sep 8 10:39:19 2022] PUT /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a => generated 1358 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:39:19.526042 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2884b684-7fc6-457a-ac8e-57b1b04694ad tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:19.527552 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2884b684-7fc6-457a-ac8e-57b1b04694ad tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] [instance: c7a958dd-d267-4932-b7d1-6e50d6c1b21e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:19.554944 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2884b684-7fc6-457a-ac8e-57b1b04694ad tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:19.556437 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2884b684-7fc6-457a-ac8e-57b1b04694ad tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:19.557063 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2884b684-7fc6-457a-ac8e-57b1b04694ad tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:19.557825 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2884b684-7fc6-457a-ac8e-57b1b04694ad tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:19.558823 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2884b684-7fc6-457a-ac8e-57b1b04694ad tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:19.559249 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2884b684-7fc6-457a-ac8e-57b1b04694ad tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:19.972073 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1dc37248-a9fe-40e5-933c-6ba96406024e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:19.982074 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1dc37248-a9fe-40e5-933c-6ba96406024e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/1fc866b1-81ac-4c09-86ab-6d8a4a580294" status: 200 len: 1311 microversion: 2.1 time: 0.518152 Sep 08 10:39:19.984685 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 366/710] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:19 2022] GET /compute/v2.1/servers/1fc866b1-81ac-4c09-86ab-6d8a4a580294 => generated 1311 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:20.013186 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d7e341ba-64c2-4cce-bdc4-647befdcf3e8 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:20.014604 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d7e341ba-64c2-4cce-bdc4-647befdcf3e8 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] [instance: 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:20.030812 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d7e341ba-64c2-4cce-bdc4-647befdcf3e8 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:20.032824 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d7e341ba-64c2-4cce-bdc4-647befdcf3e8 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:20.034711 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d7e341ba-64c2-4cce-bdc4-647befdcf3e8 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:20.035672 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d7e341ba-64c2-4cce-bdc4-647befdcf3e8 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:20.037036 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d7e341ba-64c2-4cce-bdc4-647befdcf3e8 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:20.037693 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d7e341ba-64c2-4cce-bdc4-647befdcf3e8 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:20.485638 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d7e341ba-64c2-4cce-bdc4-647befdcf3e8 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:20.513139 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d7e341ba-64c2-4cce-bdc4-647befdcf3e8 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:20.518279 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d7e341ba-64c2-4cce-bdc4-647befdcf3e8 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:20.545546 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d7e341ba-64c2-4cce-bdc4-647befdcf3e8 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] 10.222.0.27 "GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a" status: 200 len: 1354 microversion: 2.75 time: 0.559316 Sep 08 10:39:20.590775 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 367/711] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:39:19 2022] GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a => generated 1354 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:39:20.614924 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-254b7f2f-69e4-447a-b204-d2154c271ad1 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:20.616898 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-254b7f2f-69e4-447a-b204-d2154c271ad1 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: 8be00267-7835-4f68-bb40-6677750c0e3c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:20.637676 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2884b684-7fc6-457a-ac8e-57b1b04694ad tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad3d26d79c34a0c90a99eeaa85f6e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bc2a412ede463e94d6933c30bc06ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:20.639355 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-254b7f2f-69e4-447a-b204-d2154c271ad1 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:20.641289 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-254b7f2f-69e4-447a-b204-d2154c271ad1 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:20.643440 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-254b7f2f-69e4-447a-b204-d2154c271ad1 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:20.644632 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-254b7f2f-69e4-447a-b204-d2154c271ad1 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:20.647583 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-254b7f2f-69e4-447a-b204-d2154c271ad1 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:20.648273 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-254b7f2f-69e4-447a-b204-d2154c271ad1 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:20.658059 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2884b684-7fc6-457a-ac8e-57b1b04694ad tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] 10.222.0.27 "GET /compute/v2.1/servers/c7a958dd-d267-4932-b7d1-6e50d6c1b21e" status: 200 len: 1313 microversion: 2.1 time: 1.125685 Sep 08 10:39:20.659382 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 345/712] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:19 2022] GET /compute/v2.1/servers/c7a958dd-d267-4932-b7d1-6e50d6c1b21e => generated 1313 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:20.665319 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-eed5a5ad-6d56-48ce-ab32-81fb055660c1 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:20.666284 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-eed5a5ad-6d56-48ce-ab32-81fb055660c1 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 422ceb5f-740f-45e5-9596-6796719adf27] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:20.679300 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eed5a5ad-6d56-48ce-ab32-81fb055660c1 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:20.684587 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eed5a5ad-6d56-48ce-ab32-81fb055660c1 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:20.688269 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eed5a5ad-6d56-48ce-ab32-81fb055660c1 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:20.689263 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eed5a5ad-6d56-48ce-ab32-81fb055660c1 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:20.689912 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eed5a5ad-6d56-48ce-ab32-81fb055660c1 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:20.690519 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eed5a5ad-6d56-48ce-ab32-81fb055660c1 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:20.740549 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=100 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:39:21.082806 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-254b7f2f-69e4-447a-b204-d2154c271ad1 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:21.092312 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-eed5a5ad-6d56-48ce-ab32-81fb055660c1 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:21.093283 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-254b7f2f-69e4-447a-b204-d2154c271ad1 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/8be00267-7835-4f68-bb40-6677750c0e3c" status: 200 len: 1316 microversion: 2.1 time: 0.497930 Sep 08 10:39:21.094364 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 368/713] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:20 2022] GET /compute/v2.1/servers/8be00267-7835-4f68-bb40-6677750c0e3c => generated 1316 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:21.103067 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-148cbe8e-5031-46b2-8e0a-3a1041717c1b tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:21.104426 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-148cbe8e-5031-46b2-8e0a-3a1041717c1b tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 815705bc-e49e-47a1-864b-9cc550464808] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:21.113746 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-148cbe8e-5031-46b2-8e0a-3a1041717c1b tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:21.114575 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-148cbe8e-5031-46b2-8e0a-3a1041717c1b tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:21.115170 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-148cbe8e-5031-46b2-8e0a-3a1041717c1b tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:21.116215 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-148cbe8e-5031-46b2-8e0a-3a1041717c1b tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:21.117086 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-148cbe8e-5031-46b2-8e0a-3a1041717c1b tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:21.117810 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-148cbe8e-5031-46b2-8e0a-3a1041717c1b tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:21.126007 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-eed5a5ad-6d56-48ce-ab32-81fb055660c1 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:21.128871 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-eed5a5ad-6d56-48ce-ab32-81fb055660c1 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:21.130653 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-eed5a5ad-6d56-48ce-ab32-81fb055660c1 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/422ceb5f-740f-45e5-9596-6796719adf27" status: 200 len: 1541 microversion: 2.25 time: 0.469864 Sep 08 10:39:21.132188 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 346/714] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:39:20 2022] GET /compute/v2.1/servers/422ceb5f-740f-45e5-9596-6796719adf27 => generated 1541 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:39:21.139182 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-0036918b-70be-4546-980f-a5935fca441c req-894a774f-0a3a-45f0-b887-b146d1b5a8f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fc866b1-81ac-4c09-86ab-6d8a4a580294", "name": "network-vif-plugged", "status": "completed", "tag": "db9922aa-1490-4e6a-9ed5-89cbee224339"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:39:21.150774 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-0036918b-70be-4546-980f-a5935fca441c req-894a774f-0a3a-45f0-b887-b146d1b5a8f0 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:21.151615 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-0036918b-70be-4546-980f-a5935fca441c req-894a774f-0a3a-45f0-b887-b146d1b5a8f0 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:21.152787 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-0036918b-70be-4546-980f-a5935fca441c req-894a774f-0a3a-45f0-b887-b146d1b5a8f0 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:21.172934 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-0036918b-70be-4546-980f-a5935fca441c req-894a774f-0a3a-45f0-b887-b146d1b5a8f0 service nova] Creating event network-vif-plugged:db9922aa-1490-4e6a-9ed5-89cbee224339 for instance 1fc866b1-81ac-4c09-86ab-6d8a4a580294 on n-h1-850501-12 Sep 08 10:39:21.189160 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-0036918b-70be-4546-980f-a5935fca441c req-894a774f-0a3a-45f0-b887-b146d1b5a8f0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054748 Sep 08 10:39:21.190248 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 347/715] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:39:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:39:21.197995 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0b922cd3-0dbc-4e9e-8c59-e67927b683fb tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:21.200194 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0b922cd3-0dbc-4e9e-8c59-e67927b683fb tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 1fc866b1-81ac-4c09-86ab-6d8a4a580294] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:21.218599 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0b922cd3-0dbc-4e9e-8c59-e67927b683fb tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:21.219138 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0b922cd3-0dbc-4e9e-8c59-e67927b683fb tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:21.220041 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0b922cd3-0dbc-4e9e-8c59-e67927b683fb tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:21.220775 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0b922cd3-0dbc-4e9e-8c59-e67927b683fb tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:21.222221 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0b922cd3-0dbc-4e9e-8c59-e67927b683fb tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:21.222668 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0b922cd3-0dbc-4e9e-8c59-e67927b683fb tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:21.480269 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-148cbe8e-5031-46b2-8e0a-3a1041717c1b tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:21.499530 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-148cbe8e-5031-46b2-8e0a-3a1041717c1b tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808" status: 200 len: 1471 microversion: 2.1 time: 0.403467 Sep 08 10:39:21.500505 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 369/716] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:21 2022] GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808 => generated 1471 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:21.505548 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7c3e6ee2-76d3-497c-a102-ffea05f61ff0 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Calling method '.version_select at 0x7f68e4b92e50>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:21.508963 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c3e6ee2-76d3-497c-a102-ffea05f61ff0 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:21.509480 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c3e6ee2-76d3-497c-a102-ffea05f61ff0 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:21.509916 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c3e6ee2-76d3-497c-a102-ffea05f61ff0 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:21.534056 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7c3e6ee2-76d3-497c-a102-ffea05f61ff0 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 1960 microversion: 2.25 time: 0.032625 Sep 08 10:39:21.534971 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 370/717] 10.222.0.27 () {60 vars in 1184 bytes} [Thu Sep 8 10:39:21 2022] GET /compute/v2.1/os-migrations => generated 1960 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:39:21.547461 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-43eeca28-2e4a-4b9c-826b-05084a0fb820 req-4c137c15-1ce2-4583-bff3-101010fc51e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8be00267-7835-4f68-bb40-6677750c0e3c", "tag": "74f17ad2-8bfa-440e-9794-09a424196407"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:39:21.560009 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-43eeca28-2e4a-4b9c-826b-05084a0fb820 req-4c137c15-1ce2-4583-bff3-101010fc51e7 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:21.560814 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-43eeca28-2e4a-4b9c-826b-05084a0fb820 req-4c137c15-1ce2-4583-bff3-101010fc51e7 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:21.561529 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-43eeca28-2e4a-4b9c-826b-05084a0fb820 req-4c137c15-1ce2-4583-bff3-101010fc51e7 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:21.575234 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-43eeca28-2e4a-4b9c-826b-05084a0fb820 req-4c137c15-1ce2-4583-bff3-101010fc51e7 service nova] Creating event network-changed:74f17ad2-8bfa-440e-9794-09a424196407 for instance 8be00267-7835-4f68-bb40-6677750c0e3c on n-h1-850501-12 Sep 08 10:39:21.583136 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-43eeca28-2e4a-4b9c-826b-05084a0fb820 req-4c137c15-1ce2-4583-bff3-101010fc51e7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046805 Sep 08 10:39:21.587886 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 371/718] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:39:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:39:21.593643 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-85278b6a-6e06-4fae-8687-ef7c4066f95b tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:21.594583 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-85278b6a-6e06-4fae-8687-ef7c4066f95b tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] [instance: 422ceb5f-740f-45e5-9596-6796719adf27] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:21.604101 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-85278b6a-6e06-4fae-8687-ef7c4066f95b tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:21.605179 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-85278b6a-6e06-4fae-8687-ef7c4066f95b tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:21.605870 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-85278b6a-6e06-4fae-8687-ef7c4066f95b tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:21.606765 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-85278b6a-6e06-4fae-8687-ef7c4066f95b tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:21.607400 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-85278b6a-6e06-4fae-8687-ef7c4066f95b tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:21.608234 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-85278b6a-6e06-4fae-8687-ef7c4066f95b tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:21.622870 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0b922cd3-0dbc-4e9e-8c59-e67927b683fb tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:21.635887 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0b922cd3-0dbc-4e9e-8c59-e67927b683fb tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/1fc866b1-81ac-4c09-86ab-6d8a4a580294" status: 200 len: 1311 microversion: 2.1 time: 0.444314 Sep 08 10:39:21.645883 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 348/719] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:21 2022] GET /compute/v2.1/servers/1fc866b1-81ac-4c09-86ab-6d8a4a580294 => generated 1311 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:21.660342 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5e69dcd5-9f43-49ef-9b86-0d5f538a36f2 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:21.660964 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5e69dcd5-9f43-49ef-9b86-0d5f538a36f2 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] [instance: 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:21.673281 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5e69dcd5-9f43-49ef-9b86-0d5f538a36f2 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:21.674061 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5e69dcd5-9f43-49ef-9b86-0d5f538a36f2 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:21.674701 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5e69dcd5-9f43-49ef-9b86-0d5f538a36f2 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:21.676249 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5e69dcd5-9f43-49ef-9b86-0d5f538a36f2 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:21.678700 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5e69dcd5-9f43-49ef-9b86-0d5f538a36f2 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:21.694244 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5e69dcd5-9f43-49ef-9b86-0d5f538a36f2 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:21.919884 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5e69dcd5-9f43-49ef-9b86-0d5f538a36f2 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:21.935747 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5e69dcd5-9f43-49ef-9b86-0d5f538a36f2 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:21.937550 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5e69dcd5-9f43-49ef-9b86-0d5f538a36f2 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:21.944475 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-85278b6a-6e06-4fae-8687-ef7c4066f95b tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lazy-loading 'services' on Instance uuid 422ceb5f-740f-45e5-9596-6796719adf27 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:39:21.951619 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5e69dcd5-9f43-49ef-9b86-0d5f538a36f2 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] 10.222.0.27 "GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a" status: 200 len: 1416 microversion: 2.75 time: 0.297486 Sep 08 10:39:21.952543 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 349/720] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:39:21 2022] GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a => generated 1416 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:39:21.960637 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-89c36768-a9f2-4c32-bc76-fafa21474ae8 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:21.963847 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-89c36768-a9f2-4c32-bc76-fafa21474ae8 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] [instance: c7a958dd-d267-4932-b7d1-6e50d6c1b21e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:21.975542 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-85278b6a-6e06-4fae-8687-ef7c4066f95b tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/422ceb5f-740f-45e5-9596-6796719adf27" status: 200 len: 2034 microversion: 2.25 time: 0.385936 Sep 08 10:39:21.978927 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-89c36768-a9f2-4c32-bc76-fafa21474ae8 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:21.979828 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-89c36768-a9f2-4c32-bc76-fafa21474ae8 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:21.982065 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 372/721] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:39:21 2022] GET /compute/v2.1/servers/422ceb5f-740f-45e5-9596-6796719adf27 => generated 2034 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:39:21.982324 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-89c36768-a9f2-4c32-bc76-fafa21474ae8 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:21.985159 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-89c36768-a9f2-4c32-bc76-fafa21474ae8 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:21.985751 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-89c36768-a9f2-4c32-bc76-fafa21474ae8 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:21.986292 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-89c36768-a9f2-4c32-bc76-fafa21474ae8 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:22.029362 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-25febe8d-715a-469b-8a48-903f03c86eca tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Action: 'create', calling method: .version_select at 0x7f68e49b9d30>, body: {"keypair": {"name": "tempest-keypair-143108311", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCKeWfQHqcqrQNH6JidQ74RV4ltSmHQDOODlMtJn7wNrYWURCZ5zvgPuYGaNigUAhtqg8GhLsl8LXyQ+e5O1OpKGNq5pRsc+rGuAcySJhWDGgV6quCb5im/Y5112tQxh3g=="}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:39:22.063840 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-25febe8d-715a-469b-8a48-903f03c86eca tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Getting quotas for project 57d64134da60477da24b7fde4e1b9680. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:39:22.084981 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-25febe8d-715a-469b-8a48-903f03c86eca tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Getting quotas for user 27456dd9f49540b09f2e8addd1045a94 and project 57d64134da60477da24b7fde4e1b9680. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:39:22.152494 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-25febe8d-715a-469b-8a48-903f03c86eca tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.25 time: 0.143402 Sep 08 10:39:22.154419 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 373/722] 10.222.0.27 () {62 vars in 1200 bytes} [Thu Sep 8 10:39:22 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 147 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 08 10:39:22.162682 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d37f1f69-ec3f-4334-8e8e-cc945491caf4 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:22.163662 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d37f1f69-ec3f-4334-8e8e-cc945491caf4 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: 8be00267-7835-4f68-bb40-6677750c0e3c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:22.175524 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d37f1f69-ec3f-4334-8e8e-cc945491caf4 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:22.176539 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d37f1f69-ec3f-4334-8e8e-cc945491caf4 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:22.177486 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d37f1f69-ec3f-4334-8e8e-cc945491caf4 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:22.178914 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d37f1f69-ec3f-4334-8e8e-cc945491caf4 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:22.179875 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d37f1f69-ec3f-4334-8e8e-cc945491caf4 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:22.180906 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d37f1f69-ec3f-4334-8e8e-cc945491caf4 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:22.227392 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:39:22.517458 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-89c36768-a9f2-4c32-bc76-fafa21474ae8 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad3d26d79c34a0c90a99eeaa85f6e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bc2a412ede463e94d6933c30bc06ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:22.543451 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-89c36768-a9f2-4c32-bc76-fafa21474ae8 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] 10.222.0.27 "GET /compute/v2.1/servers/c7a958dd-d267-4932-b7d1-6e50d6c1b21e" status: 200 len: 1313 microversion: 2.1 time: 0.588666 Sep 08 10:39:22.550564 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 350/723] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:21 2022] GET /compute/v2.1/servers/c7a958dd-d267-4932-b7d1-6e50d6c1b21e => generated 1313 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:22.568620 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-58c202e8-6e4e-4fdb-b798-d8391d367b97 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:22.570169 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-58c202e8-6e4e-4fdb-b798-d8391d367b97 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 815705bc-e49e-47a1-864b-9cc550464808] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:22.588187 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d37f1f69-ec3f-4334-8e8e-cc945491caf4 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:22.590023 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-58c202e8-6e4e-4fdb-b798-d8391d367b97 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:22.591924 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-58c202e8-6e4e-4fdb-b798-d8391d367b97 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:22.592610 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-58c202e8-6e4e-4fdb-b798-d8391d367b97 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:22.594275 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-58c202e8-6e4e-4fdb-b798-d8391d367b97 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:22.594955 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-58c202e8-6e4e-4fdb-b798-d8391d367b97 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:22.596165 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-58c202e8-6e4e-4fdb-b798-d8391d367b97 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:22.604379 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d37f1f69-ec3f-4334-8e8e-cc945491caf4 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/8be00267-7835-4f68-bb40-6677750c0e3c" status: 200 len: 1316 microversion: 2.1 time: 0.448503 Sep 08 10:39:22.617327 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 374/724] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:22 2022] GET /compute/v2.1/servers/8be00267-7835-4f68-bb40-6677750c0e3c => generated 1316 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:22.678645 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c71f6299-e9e2-4877-8a8d-dc97fef4027b tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:22.679496 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c71f6299-e9e2-4877-8a8d-dc97fef4027b tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 1fc866b1-81ac-4c09-86ab-6d8a4a580294] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:22.688236 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c71f6299-e9e2-4877-8a8d-dc97fef4027b tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:22.689475 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c71f6299-e9e2-4877-8a8d-dc97fef4027b tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:22.703564 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c71f6299-e9e2-4877-8a8d-dc97fef4027b tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:22.708756 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c71f6299-e9e2-4877-8a8d-dc97fef4027b tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:22.709673 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c71f6299-e9e2-4877-8a8d-dc97fef4027b tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:22.710167 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c71f6299-e9e2-4877-8a8d-dc97fef4027b tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:22.908314 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c71f6299-e9e2-4877-8a8d-dc97fef4027b tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:22.917270 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c71f6299-e9e2-4877-8a8d-dc97fef4027b tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/1fc866b1-81ac-4c09-86ab-6d8a4a580294" status: 200 len: 1311 microversion: 2.1 time: 0.244725 Sep 08 10:39:22.926931 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 375/725] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:22 2022] GET /compute/v2.1/servers/1fc866b1-81ac-4c09-86ab-6d8a4a580294 => generated 1311 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:22.980646 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0e753bf0-5dfd-481c-8717-76385d6d0b20 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:22.981649 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0e753bf0-5dfd-481c-8717-76385d6d0b20 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] [instance: 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:22.992672 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e753bf0-5dfd-481c-8717-76385d6d0b20 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:22.993614 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e753bf0-5dfd-481c-8717-76385d6d0b20 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:22.994142 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e753bf0-5dfd-481c-8717-76385d6d0b20 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:22.995656 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e753bf0-5dfd-481c-8717-76385d6d0b20 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:22.996246 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e753bf0-5dfd-481c-8717-76385d6d0b20 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:22.996718 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e753bf0-5dfd-481c-8717-76385d6d0b20 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:23.135285 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-58c202e8-6e4e-4fdb-b798-d8391d367b97 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:23.160754 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-58c202e8-6e4e-4fdb-b798-d8391d367b97 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808" status: 200 len: 1463 microversion: 2.1 time: 0.608377 Sep 08 10:39:23.161665 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 351/726] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:22 2022] GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808 => generated 1463 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:23.205701 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4413fe5a-4b5d-43a8-bfd5-b0f234945638 tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:23.206424 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4413fe5a-4b5d-43a8-bfd5-b0f234945638 tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] [instance: 815705bc-e49e-47a1-864b-9cc550464808] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:23.226616 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4413fe5a-4b5d-43a8-bfd5-b0f234945638 tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:23.227401 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4413fe5a-4b5d-43a8-bfd5-b0f234945638 tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:23.228014 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4413fe5a-4b5d-43a8-bfd5-b0f234945638 tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:23.228916 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4413fe5a-4b5d-43a8-bfd5-b0f234945638 tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:23.230266 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4413fe5a-4b5d-43a8-bfd5-b0f234945638 tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:23.231021 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4413fe5a-4b5d-43a8-bfd5-b0f234945638 tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:23.368518 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0e753bf0-5dfd-481c-8717-76385d6d0b20 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:23.384154 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0e753bf0-5dfd-481c-8717-76385d6d0b20 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:23.385978 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0e753bf0-5dfd-481c-8717-76385d6d0b20 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:23.392819 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0e753bf0-5dfd-481c-8717-76385d6d0b20 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] 10.222.0.27 "GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a" status: 200 len: 1416 microversion: 2.75 time: 0.416210 Sep 08 10:39:23.393926 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 376/727] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:39:22 2022] GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a => generated 1416 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:39:23.579727 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8be15dd0-78f0-4d1e-9027-5329faefd247 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:23.580340 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8be15dd0-78f0-4d1e-9027-5329faefd247 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] [instance: c7a958dd-d267-4932-b7d1-6e50d6c1b21e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:23.594146 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8be15dd0-78f0-4d1e-9027-5329faefd247 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:23.595337 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8be15dd0-78f0-4d1e-9027-5329faefd247 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:23.595947 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8be15dd0-78f0-4d1e-9027-5329faefd247 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:23.596858 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8be15dd0-78f0-4d1e-9027-5329faefd247 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:23.597551 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8be15dd0-78f0-4d1e-9027-5329faefd247 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:23.598138 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8be15dd0-78f0-4d1e-9027-5329faefd247 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:23.842910 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8be15dd0-78f0-4d1e-9027-5329faefd247 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad3d26d79c34a0c90a99eeaa85f6e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bc2a412ede463e94d6933c30bc06ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:23.852666 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8be15dd0-78f0-4d1e-9027-5329faefd247 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] 10.222.0.27 "GET /compute/v2.1/servers/c7a958dd-d267-4932-b7d1-6e50d6c1b21e" status: 200 len: 1313 microversion: 2.1 time: 0.276678 Sep 08 10:39:23.854252 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 377/728] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:23 2022] GET /compute/v2.1/servers/c7a958dd-d267-4932-b7d1-6e50d6c1b21e => generated 1313 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:39:23.860321 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5eb3e3c6-74f6-408f-bac8-e52aa28911e3 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:23.861454 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5eb3e3c6-74f6-408f-bac8-e52aa28911e3 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: 8be00267-7835-4f68-bb40-6677750c0e3c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:23.871426 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5eb3e3c6-74f6-408f-bac8-e52aa28911e3 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:23.873214 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5eb3e3c6-74f6-408f-bac8-e52aa28911e3 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:23.874084 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5eb3e3c6-74f6-408f-bac8-e52aa28911e3 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:23.874972 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5eb3e3c6-74f6-408f-bac8-e52aa28911e3 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:23.875516 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5eb3e3c6-74f6-408f-bac8-e52aa28911e3 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:23.876083 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5eb3e3c6-74f6-408f-bac8-e52aa28911e3 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:24.069360 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5eb3e3c6-74f6-408f-bac8-e52aa28911e3 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:24.078217 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4413fe5a-4b5d-43a8-bfd5-b0f234945638 tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808" status: 200 len: 1616 microversion: 2.1 time: 0.874947 Sep 08 10:39:24.091391 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5eb3e3c6-74f6-408f-bac8-e52aa28911e3 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/8be00267-7835-4f68-bb40-6677750c0e3c" status: 200 len: 1316 microversion: 2.1 time: 0.227916 Sep 08 10:39:24.098772 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 352/729] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:23 2022] GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808 => generated 1616 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:24.105678 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 378/730] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:23 2022] GET /compute/v2.1/servers/8be00267-7835-4f68-bb40-6677750c0e3c => generated 1316 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:24.113187 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1c8d9654-056d-4e28-935f-49eecbb10d03 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:24.116562 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1c8d9654-056d-4e28-935f-49eecbb10d03 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 1fc866b1-81ac-4c09-86ab-6d8a4a580294] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:24.134368 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1c8d9654-056d-4e28-935f-49eecbb10d03 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:24.135147 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1c8d9654-056d-4e28-935f-49eecbb10d03 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:24.136307 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1c8d9654-056d-4e28-935f-49eecbb10d03 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:24.137243 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-725cb631-d7e4-48e6-8e2c-4ff066ae2762 tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] Calling method '.version_select at 0x7f68e49b9940>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:24.138472 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1c8d9654-056d-4e28-935f-49eecbb10d03 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:24.138955 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1c8d9654-056d-4e28-935f-49eecbb10d03 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:24.139399 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1c8d9654-056d-4e28-935f-49eecbb10d03 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:24.142081 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-725cb631-d7e4-48e6-8e2c-4ff066ae2762 tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:24.142579 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-725cb631-d7e4-48e6-8e2c-4ff066ae2762 tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:24.143022 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-725cb631-d7e4-48e6-8e2c-4ff066ae2762 tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:24.154728 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-725cb631-d7e4-48e6-8e2c-4ff066ae2762 tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 1575 microversion: 2.1 time: 0.022473 Sep 08 10:39:24.165167 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 379/731] 10.222.0.27 () {58 vars in 1143 bytes} [Thu Sep 8 10:39:24 2022] GET /compute/v2.1/os-migrations => generated 1575 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:39:24.308629 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bbd5b726-339f-4c7a-992a-bbe3c3f173a4 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1567372000", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:39:24.319566 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=12 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:39:24.398784 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-bbd5b726-339f-4c7a-992a-bbe3c3f173a4 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] validate_networks() for None {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:39:24.591188 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1c8d9654-056d-4e28-935f-49eecbb10d03 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:24.599693 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1c8d9654-056d-4e28-935f-49eecbb10d03 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/1fc866b1-81ac-4c09-86ab-6d8a4a580294" status: 200 len: 1494 microversion: 2.1 time: 0.500099 Sep 08 10:39:24.618900 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 353/732] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:24 2022] GET /compute/v2.1/servers/1fc866b1-81ac-4c09-86ab-6d8a4a580294 => generated 1494 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:24.618900 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-a8559d20-2fd1-4c36-8cc7-730322f6a5c4 req-dbf96304-7c55-497f-ab42-a44f0f200bf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7a958dd-d267-4932-b7d1-6e50d6c1b21e", "name": "network-vif-plugged", "status": "completed", "tag": "3ada0876-b5fd-4760-bd4f-a946d46aeeae"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:39:24.632812 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-a8559d20-2fd1-4c36-8cc7-730322f6a5c4 req-dbf96304-7c55-497f-ab42-a44f0f200bf0 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:24.633434 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-a8559d20-2fd1-4c36-8cc7-730322f6a5c4 req-dbf96304-7c55-497f-ab42-a44f0f200bf0 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:24.633937 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-a8559d20-2fd1-4c36-8cc7-730322f6a5c4 req-dbf96304-7c55-497f-ab42-a44f0f200bf0 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:24.647668 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-a8559d20-2fd1-4c36-8cc7-730322f6a5c4 req-dbf96304-7c55-497f-ab42-a44f0f200bf0 service nova] Creating event network-vif-plugged:3ada0876-b5fd-4760-bd4f-a946d46aeeae for instance c7a958dd-d267-4932-b7d1-6e50d6c1b21e on n-h1-850501-12 Sep 08 10:39:24.653811 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-a8559d20-2fd1-4c36-8cc7-730322f6a5c4 req-dbf96304-7c55-497f-ab42-a44f0f200bf0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042662 Sep 08 10:39:24.654523 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 354/733] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:39:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:39:24.661193 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b5260e1a-c7fa-44da-ae4d-f012bd81fbbe tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:24.662126 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b5260e1a-c7fa-44da-ae4d-f012bd81fbbe tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] [instance: 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:24.673514 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b5260e1a-c7fa-44da-ae4d-f012bd81fbbe tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:24.674027 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b5260e1a-c7fa-44da-ae4d-f012bd81fbbe tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:24.674487 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b5260e1a-c7fa-44da-ae4d-f012bd81fbbe tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:24.675207 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b5260e1a-c7fa-44da-ae4d-f012bd81fbbe tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:24.675689 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b5260e1a-c7fa-44da-ae4d-f012bd81fbbe tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:24.676383 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b5260e1a-c7fa-44da-ae4d-f012bd81fbbe tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:24.780366 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b5260e1a-c7fa-44da-ae4d-f012bd81fbbe tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:24.791367 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b5260e1a-c7fa-44da-ae4d-f012bd81fbbe tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:24.792640 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b5260e1a-c7fa-44da-ae4d-f012bd81fbbe tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:24.799202 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b5260e1a-c7fa-44da-ae4d-f012bd81fbbe tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] 10.222.0.27 "GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a" status: 200 len: 1416 microversion: 2.75 time: 0.143043 Sep 08 10:39:24.801054 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 355/734] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:39:24 2022] GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a => generated 1416 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:39:24.806351 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b3e5472d-8c30-43ee-be3b-dc02357f49ac tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:24.806970 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b3e5472d-8c30-43ee-be3b-dc02357f49ac tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] [instance: 1fc866b1-81ac-4c09-86ab-6d8a4a580294] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:24.816981 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b3e5472d-8c30-43ee-be3b-dc02357f49ac tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:24.816981 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b3e5472d-8c30-43ee-be3b-dc02357f49ac tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:24.816981 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b3e5472d-8c30-43ee-be3b-dc02357f49ac tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:24.817886 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b3e5472d-8c30-43ee-be3b-dc02357f49ac tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:24.818217 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b3e5472d-8c30-43ee-be3b-dc02357f49ac tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:24.818694 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b3e5472d-8c30-43ee-be3b-dc02357f49ac tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:24.943175 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-bbd5b726-339f-4c7a-992a-bbe3c3f173a4 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:39:24.943741 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-bbd5b726-339f-4c7a-992a-bbe3c3f173a4 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:39:24.944156 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-bbd5b726-339f-4c7a-992a-bbe3c3f173a4 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:39:24.944557 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-bbd5b726-339f-4c7a-992a-bbe3c3f173a4 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:39:24.944973 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-bbd5b726-339f-4c7a-992a-bbe3c3f173a4 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:39:24.956155 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bbd5b726-339f-4c7a-992a-bbe3c3f173a4 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:24.956645 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bbd5b726-339f-4c7a-992a-bbe3c3f173a4 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:24.957111 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bbd5b726-339f-4c7a-992a-bbe3c3f173a4 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:24.957861 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bbd5b726-339f-4c7a-992a-bbe3c3f173a4 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:24.958321 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bbd5b726-339f-4c7a-992a-bbe3c3f173a4 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:24.958748 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bbd5b726-339f-4c7a-992a-bbe3c3f173a4 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:24.978012 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-bbd5b726-339f-4c7a-992a-bbe3c3f173a4 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Getting quotas for project a52c0b4a043445df94dab4dd4292607a. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:39:24.984942 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-bbd5b726-339f-4c7a-992a-bbe3c3f173a4 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Getting quotas for user 5450284cb50b4f75be0915074bf8fe78 and project a52c0b4a043445df94dab4dd4292607a. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:39:24.995862 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:39:25.004558 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bbd5b726-339f-4c7a-992a-bbe3c3f173a4 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:39:25.007012 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bbd5b726-339f-4c7a-992a-bbe3c3f173a4 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 923d2401-f860-4284-a580-37ed478720f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:39:25.062023 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bbd5b726-339f-4c7a-992a-bbe3c3f173a4 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.760530 Sep 08 10:39:25.062925 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 380/735] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:39:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 762 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:39:25.075118 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-83267dde-54f8-4235-9bab-1509e9dfb8dd tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:25.076327 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-83267dde-54f8-4235-9bab-1509e9dfb8dd tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] [instance: c7a958dd-d267-4932-b7d1-6e50d6c1b21e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:25.086243 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-83267dde-54f8-4235-9bab-1509e9dfb8dd tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:25.087096 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-83267dde-54f8-4235-9bab-1509e9dfb8dd tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:25.087840 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-83267dde-54f8-4235-9bab-1509e9dfb8dd tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:25.089017 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-83267dde-54f8-4235-9bab-1509e9dfb8dd tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:25.090232 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-83267dde-54f8-4235-9bab-1509e9dfb8dd tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:25.091335 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-83267dde-54f8-4235-9bab-1509e9dfb8dd tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:25.179365 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b3e5472d-8c30-43ee-be3b-dc02357f49ac tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/1fc866b1-81ac-4c09-86ab-6d8a4a580294" status: 200 len: 1647 microversion: 2.1 time: 0.376609 Sep 08 10:39:25.181580 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 356/736] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:24 2022] GET /compute/v2.1/servers/1fc866b1-81ac-4c09-86ab-6d8a4a580294 => generated 1647 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:25.219905 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8875a110-4b5b-4350-8cbb-b58d4d3471ab tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:25.224471 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8875a110-4b5b-4350-8cbb-b58d4d3471ab tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 923d2401-f860-4284-a580-37ed478720f6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:25.371517 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8875a110-4b5b-4350-8cbb-b58d4d3471ab tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:25.393138 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8875a110-4b5b-4350-8cbb-b58d4d3471ab tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6" status: 200 len: 1213 microversion: 2.1 time: 0.197611 Sep 08 10:39:25.410037 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 357/737] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:25 2022] GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6 => generated 1213 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:25.416229 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-89e3dd5f-2c72-49b6-bca8-78f3b2bbe116 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:25.427249 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-89e3dd5f-2c72-49b6-bca8-78f3b2bbe116 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: 8be00267-7835-4f68-bb40-6677750c0e3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:25.441518 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-89e3dd5f-2c72-49b6-bca8-78f3b2bbe116 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:25.444533 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-89e3dd5f-2c72-49b6-bca8-78f3b2bbe116 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:25.445397 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-89e3dd5f-2c72-49b6-bca8-78f3b2bbe116 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:25.446718 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-89e3dd5f-2c72-49b6-bca8-78f3b2bbe116 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:25.452348 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-89e3dd5f-2c72-49b6-bca8-78f3b2bbe116 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:25.453257 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-89e3dd5f-2c72-49b6-bca8-78f3b2bbe116 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:25.523014 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-83267dde-54f8-4235-9bab-1509e9dfb8dd tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad3d26d79c34a0c90a99eeaa85f6e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bc2a412ede463e94d6933c30bc06ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:25.547109 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-83267dde-54f8-4235-9bab-1509e9dfb8dd tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] 10.222.0.27 "GET /compute/v2.1/servers/c7a958dd-d267-4932-b7d1-6e50d6c1b21e" status: 200 len: 1313 microversion: 2.1 time: 0.480680 Sep 08 10:39:25.548338 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 381/738] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:25 2022] GET /compute/v2.1/servers/c7a958dd-d267-4932-b7d1-6e50d6c1b21e => generated 1313 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:25.556970 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-966303ca-2bed-4939-a436-53b4f9223237 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:25.561448 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-966303ca-2bed-4939-a436-53b4f9223237 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] [instance: 1fc866b1-81ac-4c09-86ab-6d8a4a580294] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:25.595207 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-966303ca-2bed-4939-a436-53b4f9223237 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:25.596555 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-966303ca-2bed-4939-a436-53b4f9223237 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:25.597252 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-966303ca-2bed-4939-a436-53b4f9223237 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:25.598174 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-966303ca-2bed-4939-a436-53b4f9223237 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:25.599691 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-966303ca-2bed-4939-a436-53b4f9223237 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:25.600994 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-966303ca-2bed-4939-a436-53b4f9223237 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:25.924579 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-89e3dd5f-2c72-49b6-bca8-78f3b2bbe116 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:25.938794 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-89e3dd5f-2c72-49b6-bca8-78f3b2bbe116 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/8be00267-7835-4f68-bb40-6677750c0e3c" status: 200 len: 1316 microversion: 2.1 time: 0.534469 Sep 08 10:39:25.939378 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 358/739] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:25 2022] GET /compute/v2.1/servers/8be00267-7835-4f68-bb40-6677750c0e3c => generated 1316 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:25.961690 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ebf7dd4d-9b77-4bd9-b22c-9597095a8f45 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:25.962378 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ebf7dd4d-9b77-4bd9-b22c-9597095a8f45 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] [instance: 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:25.972718 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ebf7dd4d-9b77-4bd9-b22c-9597095a8f45 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:25.973249 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ebf7dd4d-9b77-4bd9-b22c-9597095a8f45 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:25.973680 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ebf7dd4d-9b77-4bd9-b22c-9597095a8f45 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:25.974397 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ebf7dd4d-9b77-4bd9-b22c-9597095a8f45 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:25.974853 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ebf7dd4d-9b77-4bd9-b22c-9597095a8f45 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:25.975393 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ebf7dd4d-9b77-4bd9-b22c-9597095a8f45 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:26.048094 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-966303ca-2bed-4939-a436-53b4f9223237 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/1fc866b1-81ac-4c09-86ab-6d8a4a580294" status: 200 len: 1647 microversion: 2.1 time: 0.488324 Sep 08 10:39:26.056247 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 382/740] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:25 2022] GET /compute/v2.1/servers/1fc866b1-81ac-4c09-86ab-6d8a4a580294 => generated 1647 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:26.081976 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6426f478-a957-46b9-93f5-9c274ef3befd tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:26.087361 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6426f478-a957-46b9-93f5-9c274ef3befd tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:26.087904 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6426f478-a957-46b9-93f5-9c274ef3befd tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:26.088360 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6426f478-a957-46b9-93f5-9c274ef3befd tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:26.089527 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6426f478-a957-46b9-93f5-9c274ef3befd tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:26.090114 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6426f478-a957-46b9-93f5-9c274ef3befd tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:26.090554 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6426f478-a957-46b9-93f5-9c274ef3befd tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:26.122456 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6426f478-a957-46b9-93f5-9c274ef3befd tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.046497 Sep 08 10:39:26.123326 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 383/741] 10.222.0.27 () {58 vars in 1176 bytes} [Thu Sep 8 10:39:26 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:39:26.139975 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-71a9a0f9-135f-490a-8089-076cb50a5fa1 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:39:26.142315 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-71a9a0f9-135f-490a-8089-076cb50a5fa1 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] [instance: 1fc866b1-81ac-4c09-86ab-6d8a4a580294] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:26.159561 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ebf7dd4d-9b77-4bd9-b22c-9597095a8f45 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:26.171762 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71a9a0f9-135f-490a-8089-076cb50a5fa1 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:26.173753 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ebf7dd4d-9b77-4bd9-b22c-9597095a8f45 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:26.174485 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71a9a0f9-135f-490a-8089-076cb50a5fa1 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:26.175232 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ebf7dd4d-9b77-4bd9-b22c-9597095a8f45 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:26.176005 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71a9a0f9-135f-490a-8089-076cb50a5fa1 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:26.176758 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71a9a0f9-135f-490a-8089-076cb50a5fa1 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:26.177260 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71a9a0f9-135f-490a-8089-076cb50a5fa1 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:26.177686 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71a9a0f9-135f-490a-8089-076cb50a5fa1 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:26.193301 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ebf7dd4d-9b77-4bd9-b22c-9597095a8f45 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] 10.222.0.27 "GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a" status: 200 len: 1437 microversion: 2.75 time: 0.249565 Sep 08 10:39:26.201317 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 359/742] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:39:25 2022] GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a => generated 1437 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:39:26.231163 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-75a60f81-73ba-41c6-b778-15de9c9855f2 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:39:26.234587 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-75a60f81-73ba-41c6-b778-15de9c9855f2 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] [instance: 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:26.237754 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=95,nova_api:UPDATE=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:39:26.255555 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-75a60f81-73ba-41c6-b778-15de9c9855f2 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:26.256097 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-75a60f81-73ba-41c6-b778-15de9c9855f2 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:26.256548 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-75a60f81-73ba-41c6-b778-15de9c9855f2 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:26.257324 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-75a60f81-73ba-41c6-b778-15de9c9855f2 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:26.257794 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-75a60f81-73ba-41c6-b778-15de9c9855f2 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:26.258232 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-75a60f81-73ba-41c6-b778-15de9c9855f2 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:26.332739 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-71a9a0f9-135f-490a-8089-076cb50a5fa1 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/1fc866b1-81ac-4c09-86ab-6d8a4a580294/action" status: 202 len: 0 microversion: 2.1 time: 0.197324 Sep 08 10:39:26.337474 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 384/743] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:39:26 2022] POST /compute/v2.1/servers/1fc866b1-81ac-4c09-86ab-6d8a4a580294/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:39:26.344621 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b84d2724-4f99-43f9-bd1d-51cfb3564d62 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:26.345366 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b84d2724-4f99-43f9-bd1d-51cfb3564d62 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] [instance: 1fc866b1-81ac-4c09-86ab-6d8a4a580294] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:26.360715 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b84d2724-4f99-43f9-bd1d-51cfb3564d62 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:26.363150 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b84d2724-4f99-43f9-bd1d-51cfb3564d62 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:26.364856 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b84d2724-4f99-43f9-bd1d-51cfb3564d62 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:26.365821 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b84d2724-4f99-43f9-bd1d-51cfb3564d62 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:26.366871 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b84d2724-4f99-43f9-bd1d-51cfb3564d62 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:26.367314 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b84d2724-4f99-43f9-bd1d-51cfb3564d62 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:26.403640 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-75a60f81-73ba-41c6-b778-15de9c9855f2 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:39:26.410339 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-75a60f81-73ba-41c6-b778-15de9c9855f2 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:39:26.416954 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-75a60f81-73ba-41c6-b778-15de9c9855f2 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:39:26.418952 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-75a60f81-73ba-41c6-b778-15de9c9855f2 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:39:26.419373 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-75a60f81-73ba-41c6-b778-15de9c9855f2 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:39:26.512550 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-75a60f81-73ba-41c6-b778-15de9c9855f2 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] [instance: 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:26.520539 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-75a60f81-73ba-41c6-b778-15de9c9855f2 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:26.522656 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-75a60f81-73ba-41c6-b778-15de9c9855f2 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:26.523673 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-75a60f81-73ba-41c6-b778-15de9c9855f2 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:26.525200 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-75a60f81-73ba-41c6-b778-15de9c9855f2 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:26.527192 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-75a60f81-73ba-41c6-b778-15de9c9855f2 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:26.528205 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-75a60f81-73ba-41c6-b778-15de9c9855f2 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:26.646201 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-75a60f81-73ba-41c6-b778-15de9c9855f2 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:26.665553 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-75a60f81-73ba-41c6-b778-15de9c9855f2 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:26.667305 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-75a60f81-73ba-41c6-b778-15de9c9855f2 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:26.685531 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b84d2724-4f99-43f9-bd1d-51cfb3564d62 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/1fc866b1-81ac-4c09-86ab-6d8a4a580294" status: 200 len: 1652 microversion: 2.1 time: 0.346133 Sep 08 10:39:26.689165 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-75a60f81-73ba-41c6-b778-15de9c9855f2 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] 10.222.0.27 "POST /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a/action" status: 202 len: 1494 microversion: 2.75 time: 0.461985 Sep 08 10:39:26.690325 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 360/744] 10.222.0.27 () {62 vars in 1319 bytes} [Thu Sep 8 10:39:26 2022] POST /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a/action => generated 1494 bytes in 464 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 08 10:39:26.693196 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 385/745] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:26 2022] GET /compute/v2.1/servers/1fc866b1-81ac-4c09-86ab-6d8a4a580294 => generated 1652 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:26.702631 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cf70d434-140e-4b73-a940-df1cce6de63e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:26.702631 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cf70d434-140e-4b73-a940-df1cce6de63e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 923d2401-f860-4284-a580-37ed478720f6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:26.741995 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-04f95a1c-4a1b-47fb-bc59-440d1f787aee tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:26.743351 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-04f95a1c-4a1b-47fb-bc59-440d1f787aee tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] [instance: c7a958dd-d267-4932-b7d1-6e50d6c1b21e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:26.746724 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cf70d434-140e-4b73-a940-df1cce6de63e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:26.753348 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cf70d434-140e-4b73-a940-df1cce6de63e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:26.756324 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cf70d434-140e-4b73-a940-df1cce6de63e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:26.761379 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cf70d434-140e-4b73-a940-df1cce6de63e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:26.762732 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cf70d434-140e-4b73-a940-df1cce6de63e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:26.764539 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cf70d434-140e-4b73-a940-df1cce6de63e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:26.769860 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04f95a1c-4a1b-47fb-bc59-440d1f787aee tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:26.772392 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04f95a1c-4a1b-47fb-bc59-440d1f787aee tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:26.773114 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04f95a1c-4a1b-47fb-bc59-440d1f787aee tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:26.774791 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04f95a1c-4a1b-47fb-bc59-440d1f787aee tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:26.775732 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04f95a1c-4a1b-47fb-bc59-440d1f787aee tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:26.776639 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04f95a1c-4a1b-47fb-bc59-440d1f787aee tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:26.946710 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-cf70d434-140e-4b73-a940-df1cce6de63e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:26.959803 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cf70d434-140e-4b73-a940-df1cce6de63e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6" status: 200 len: 1209 microversion: 2.1 time: 0.268176 Sep 08 10:39:26.972764 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 361/746] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:26 2022] GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6 => generated 1209 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:26.972764 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-eccefb2b-0281-4e66-95ad-f219a9e1d2ad tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:26.972764 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-eccefb2b-0281-4e66-95ad-f219a9e1d2ad tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] [instance: 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:26.988396 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eccefb2b-0281-4e66-95ad-f219a9e1d2ad tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:26.994912 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eccefb2b-0281-4e66-95ad-f219a9e1d2ad tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:26.996444 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eccefb2b-0281-4e66-95ad-f219a9e1d2ad tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:26.998433 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eccefb2b-0281-4e66-95ad-f219a9e1d2ad tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:26.999264 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eccefb2b-0281-4e66-95ad-f219a9e1d2ad tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:27.000556 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eccefb2b-0281-4e66-95ad-f219a9e1d2ad tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:27.107674 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-eccefb2b-0281-4e66-95ad-f219a9e1d2ad tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:27.152282 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-eccefb2b-0281-4e66-95ad-f219a9e1d2ad tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:27.157487 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-eccefb2b-0281-4e66-95ad-f219a9e1d2ad tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:27.180745 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-eccefb2b-0281-4e66-95ad-f219a9e1d2ad tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] 10.222.0.27 "GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a" status: 200 len: 1446 microversion: 2.75 time: 0.216851 Sep 08 10:39:27.184500 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 362/747] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:39:26 2022] GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a => generated 1446 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:39:27.206013 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b9dce5ea-6dfa-4196-8d2f-55940f234a31 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-23626826", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "cebc319d-cd30-49da-85de-4414687896b3"}], "security_groups": [{"name": "tempest-securitygroup--721453448"}], "key_name": "tempest-keypair-143108311", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:39:27.296369 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-04f95a1c-4a1b-47fb-bc59-440d1f787aee tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad3d26d79c34a0c90a99eeaa85f6e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bc2a412ede463e94d6933c30bc06ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:27.310150 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-04f95a1c-4a1b-47fb-bc59-440d1f787aee tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] 10.222.0.27 "GET /compute/v2.1/servers/c7a958dd-d267-4932-b7d1-6e50d6c1b21e" status: 200 len: 1313 microversion: 2.1 time: 0.595104 Sep 08 10:39:27.311709 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 386/748] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:26 2022] GET /compute/v2.1/servers/c7a958dd-d267-4932-b7d1-6e50d6c1b21e => generated 1313 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:27.319843 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b3c163d4-1ccb-4668-9d2e-d7153f2e09e6 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:27.321666 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b3c163d4-1ccb-4668-9d2e-d7153f2e09e6 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: 8be00267-7835-4f68-bb40-6677750c0e3c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:27.346803 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3c163d4-1ccb-4668-9d2e-d7153f2e09e6 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:27.348176 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3c163d4-1ccb-4668-9d2e-d7153f2e09e6 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:27.349552 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3c163d4-1ccb-4668-9d2e-d7153f2e09e6 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:27.351253 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3c163d4-1ccb-4668-9d2e-d7153f2e09e6 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:27.352477 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3c163d4-1ccb-4668-9d2e-d7153f2e09e6 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:27.353701 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3c163d4-1ccb-4668-9d2e-d7153f2e09e6 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:27.420858 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-b9dce5ea-6dfa-4196-8d2f-55940f234a31 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] validate_networks() for [('cebc319d-cd30-49da-85de-4414687896b3', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:39:27.905296 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b3c163d4-1ccb-4668-9d2e-d7153f2e09e6 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:27.923079 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b3c163d4-1ccb-4668-9d2e-d7153f2e09e6 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/8be00267-7835-4f68-bb40-6677750c0e3c" status: 200 len: 1316 microversion: 2.1 time: 0.609175 Sep 08 10:39:27.923931 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 387/749] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:27 2022] GET /compute/v2.1/servers/8be00267-7835-4f68-bb40-6677750c0e3c => generated 1316 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:27.937168 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6542eb2e-6823-410f-a136-579291c08b9f tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:27.937750 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6542eb2e-6823-410f-a136-579291c08b9f tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] [instance: 1fc866b1-81ac-4c09-86ab-6d8a4a580294] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:27.952915 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6542eb2e-6823-410f-a136-579291c08b9f tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:27.953727 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6542eb2e-6823-410f-a136-579291c08b9f tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:27.954385 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6542eb2e-6823-410f-a136-579291c08b9f tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:27.955034 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6542eb2e-6823-410f-a136-579291c08b9f tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:27.955494 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6542eb2e-6823-410f-a136-579291c08b9f tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:27.955923 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6542eb2e-6823-410f-a136-579291c08b9f tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:28.070086 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-b9dce5ea-6dfa-4196-8d2f-55940f234a31 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:39:28.070585 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-b9dce5ea-6dfa-4196-8d2f-55940f234a31 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:39:28.071507 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-b9dce5ea-6dfa-4196-8d2f-55940f234a31 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:39:28.072124 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-b9dce5ea-6dfa-4196-8d2f-55940f234a31 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:39:28.072618 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-b9dce5ea-6dfa-4196-8d2f-55940f234a31 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:39:28.091933 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b9dce5ea-6dfa-4196-8d2f-55940f234a31 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:28.092917 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b9dce5ea-6dfa-4196-8d2f-55940f234a31 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:28.093446 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b9dce5ea-6dfa-4196-8d2f-55940f234a31 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:28.094412 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b9dce5ea-6dfa-4196-8d2f-55940f234a31 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:28.095045 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b9dce5ea-6dfa-4196-8d2f-55940f234a31 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:28.095685 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b9dce5ea-6dfa-4196-8d2f-55940f234a31 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:28.105280 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=19 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:39:28.108521 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:39:28.164583 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-b9dce5ea-6dfa-4196-8d2f-55940f234a31 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Getting quotas for project 57d64134da60477da24b7fde4e1b9680. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:39:28.182617 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-b9dce5ea-6dfa-4196-8d2f-55940f234a31 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Getting quotas for user 27456dd9f49540b09f2e8addd1045a94 and project 57d64134da60477da24b7fde4e1b9680. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:39:28.200410 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b9dce5ea-6dfa-4196-8d2f-55940f234a31 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:39:28.202947 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b9dce5ea-6dfa-4196-8d2f-55940f234a31 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:39:28.271974 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b9dce5ea-6dfa-4196-8d2f-55940f234a31 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.25 time: 1.085666 Sep 08 10:39:28.280562 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 363/750] 10.222.0.27 () {62 vars in 1188 bytes} [Thu Sep 8 10:39:27 2022] POST /compute/v2.1/servers => generated 405 bytes in 1095 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 08 10:39:28.285785 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4230afaf-8ee3-48da-937a-fa950dee523d tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:28.286410 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4230afaf-8ee3-48da-937a-fa950dee523d tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 923d2401-f860-4284-a580-37ed478720f6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:28.293978 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4230afaf-8ee3-48da-937a-fa950dee523d tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:28.294516 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4230afaf-8ee3-48da-937a-fa950dee523d tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:28.294908 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4230afaf-8ee3-48da-937a-fa950dee523d tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:28.295847 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4230afaf-8ee3-48da-937a-fa950dee523d tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:28.296378 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4230afaf-8ee3-48da-937a-fa950dee523d tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:28.296808 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4230afaf-8ee3-48da-937a-fa950dee523d tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:28.454314 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4230afaf-8ee3-48da-937a-fa950dee523d tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:28.455978 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6542eb2e-6823-410f-a136-579291c08b9f tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/1fc866b1-81ac-4c09-86ab-6d8a4a580294" status: 200 len: 1632 microversion: 2.1 time: 0.522602 Sep 08 10:39:28.473229 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 388/751] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:27 2022] GET /compute/v2.1/servers/1fc866b1-81ac-4c09-86ab-6d8a4a580294 => generated 1632 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:28.487229 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f62f2d2b-689b-490e-8eb4-54ffb9303565 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:28.487917 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f62f2d2b-689b-490e-8eb4-54ffb9303565 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] [instance: 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:28.494485 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4230afaf-8ee3-48da-937a-fa950dee523d tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6" status: 200 len: 1265 microversion: 2.1 time: 0.212472 Sep 08 10:39:28.511464 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 364/752] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:28 2022] GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6 => generated 1265 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:28.516534 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8e168e40-efd8-40e8-bde3-9eea24d33022 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:28.517206 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8e168e40-efd8-40e8-bde3-9eea24d33022 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:28.534844 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f62f2d2b-689b-490e-8eb4-54ffb9303565 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:28.536769 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f62f2d2b-689b-490e-8eb4-54ffb9303565 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:28.538668 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f62f2d2b-689b-490e-8eb4-54ffb9303565 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:28.539658 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f62f2d2b-689b-490e-8eb4-54ffb9303565 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:28.540596 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f62f2d2b-689b-490e-8eb4-54ffb9303565 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:28.543462 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f62f2d2b-689b-490e-8eb4-54ffb9303565 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:28.581130 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8e168e40-efd8-40e8-bde3-9eea24d33022 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:28.594940 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8e168e40-efd8-40e8-bde3-9eea24d33022 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:28.596785 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8e168e40-efd8-40e8-bde3-9eea24d33022 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:28.598200 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8e168e40-efd8-40e8-bde3-9eea24d33022 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e" status: 200 len: 1283 microversion: 2.25 time: 0.085635 Sep 08 10:39:28.598997 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 365/753] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:39:28 2022] GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e => generated 1283 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:39:28.618478 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-82b569a9-1a06-429e-9401-4d3313e7e58e tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:28.619384 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-82b569a9-1a06-429e-9401-4d3313e7e58e tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] [instance: c7a958dd-d267-4932-b7d1-6e50d6c1b21e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:28.639673 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-82b569a9-1a06-429e-9401-4d3313e7e58e tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:28.640374 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-82b569a9-1a06-429e-9401-4d3313e7e58e tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:28.641007 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-82b569a9-1a06-429e-9401-4d3313e7e58e tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:28.641994 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-82b569a9-1a06-429e-9401-4d3313e7e58e tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:28.643031 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-82b569a9-1a06-429e-9401-4d3313e7e58e tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:28.643630 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-82b569a9-1a06-429e-9401-4d3313e7e58e tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:28.813680 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f62f2d2b-689b-490e-8eb4-54ffb9303565 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:28.832801 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f62f2d2b-689b-490e-8eb4-54ffb9303565 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:28.834746 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f62f2d2b-689b-490e-8eb4-54ffb9303565 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:28.846562 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f62f2d2b-689b-490e-8eb4-54ffb9303565 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] 10.222.0.27 "GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a" status: 200 len: 1446 microversion: 2.75 time: 0.371462 Sep 08 10:39:28.873333 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 389/754] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:39:28 2022] GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a => generated 1446 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:39:28.888314 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-42c1d88d-0d81-4693-878a-ef5c2f9e0582 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-850501-12", "block_migration": true, "disk_over_commit": false}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:39:28.899593 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-42c1d88d-0d81-4693-878a-ef5c2f9e0582 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] [instance: 1fc866b1-81ac-4c09-86ab-6d8a4a580294] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:28.921443 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42c1d88d-0d81-4693-878a-ef5c2f9e0582 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:28.925203 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42c1d88d-0d81-4693-878a-ef5c2f9e0582 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:28.930984 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42c1d88d-0d81-4693-878a-ef5c2f9e0582 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:28.933688 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42c1d88d-0d81-4693-878a-ef5c2f9e0582 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:28.936093 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42c1d88d-0d81-4693-878a-ef5c2f9e0582 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:28.938822 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42c1d88d-0d81-4693-878a-ef5c2f9e0582 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:28.944428 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-82b569a9-1a06-429e-9401-4d3313e7e58e tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad3d26d79c34a0c90a99eeaa85f6e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bc2a412ede463e94d6933c30bc06ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:28.958994 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-82b569a9-1a06-429e-9401-4d3313e7e58e tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] 10.222.0.27 "GET /compute/v2.1/servers/c7a958dd-d267-4932-b7d1-6e50d6c1b21e" status: 200 len: 1463 microversion: 2.1 time: 0.358666 Sep 08 10:39:28.960380 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 366/755] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:28 2022] GET /compute/v2.1/servers/c7a958dd-d267-4932-b7d1-6e50d6c1b21e => generated 1463 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:28.989144 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2a51599a-107b-4152-b7c1-e574abfeae13 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:28.991231 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2a51599a-107b-4152-b7c1-e574abfeae13 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: 8be00267-7835-4f68-bb40-6677750c0e3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:29.008136 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2a51599a-107b-4152-b7c1-e574abfeae13 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:29.008882 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2a51599a-107b-4152-b7c1-e574abfeae13 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:29.010912 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2a51599a-107b-4152-b7c1-e574abfeae13 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:29.011893 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2a51599a-107b-4152-b7c1-e574abfeae13 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:29.013306 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2a51599a-107b-4152-b7c1-e574abfeae13 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:29.015343 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2a51599a-107b-4152-b7c1-e574abfeae13 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:29.184692 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-42c1d88d-0d81-4693-878a-ef5c2f9e0582 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lazy-loading 'flavor' on Instance uuid 1fc866b1-81ac-4c09-86ab-6d8a4a580294 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:39:29.201453 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2a51599a-107b-4152-b7c1-e574abfeae13 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:29.214839 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2a51599a-107b-4152-b7c1-e574abfeae13 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/8be00267-7835-4f68-bb40-6677750c0e3c" status: 200 len: 1316 microversion: 2.1 time: 0.243120 Sep 08 10:39:29.216124 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 367/756] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:28 2022] GET /compute/v2.1/servers/8be00267-7835-4f68-bb40-6677750c0e3c => generated 1316 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:29.301245 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-42c1d88d-0d81-4693-878a-ef5c2f9e0582 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] [instance: 1fc866b1-81ac-4c09-86ab-6d8a4a580294] Going to try to live migrate instance to n-h2-850501-12 {{(pid=128862) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 08 10:39:29.399348 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:39:29.547745 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-91d506af-5e9f-4270-ac8e-4d7bc0ff34e0 tempest-TenantUsagesTestJSON-1813072697 tempest-TenantUsagesTestJSON-1813072697-project-admin] Calling method '.version_select at 0x7f68e4bab430>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:29.568205 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-91d506af-5e9f-4270-ac8e-4d7bc0ff34e0 tempest-TenantUsagesTestJSON-1813072697 tempest-TenantUsagesTestJSON-1813072697-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:29.569096 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-91d506af-5e9f-4270-ac8e-4d7bc0ff34e0 tempest-TenantUsagesTestJSON-1813072697 tempest-TenantUsagesTestJSON-1813072697-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:29.569727 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-91d506af-5e9f-4270-ac8e-4d7bc0ff34e0 tempest-TenantUsagesTestJSON-1813072697 tempest-TenantUsagesTestJSON-1813072697-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:29.598347 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-91d506af-5e9f-4270-ac8e-4d7bc0ff34e0 tempest-TenantUsagesTestJSON-1813072697 tempest-TenantUsagesTestJSON-1813072697-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:29.599305 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-91d506af-5e9f-4270-ac8e-4d7bc0ff34e0 tempest-TenantUsagesTestJSON-1813072697 tempest-TenantUsagesTestJSON-1813072697-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:29.600223 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-91d506af-5e9f-4270-ac8e-4d7bc0ff34e0 tempest-TenantUsagesTestJSON-1813072697 tempest-TenantUsagesTestJSON-1813072697-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:29.643489 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-91d506af-5e9f-4270-ac8e-4d7bc0ff34e0 tempest-TenantUsagesTestJSON-1813072697 tempest-TenantUsagesTestJSON-1813072697-project-admin] 10.222.0.27 "GET /compute/v2.1/os-simple-tenant-usage/07bc2a412ede463e94d6933c30bc06ab?start=2022-09-07T10%3A39%3A28.984386&end=2022-09-09T10%3A39%3A28.984386" status: 200 len: 694 microversion: 2.1 time: 0.426489 Sep 08 10:39:29.644464 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 368/757] 10.222.0.27 () {58 vars in 1412 bytes} [Thu Sep 8 10:39:29 2022] GET /compute/v2.1/os-simple-tenant-usage/07bc2a412ede463e94d6933c30bc06ab?start=2022-09-07T10%3A39%3A28.984386&end=2022-09-09T10%3A39%3A28.984386 => generated 694 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:39:29.652484 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-21d8407b-01c4-49e1-bc35-d973e9d089ab tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:29.655374 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-21d8407b-01c4-49e1-bc35-d973e9d089ab tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 923d2401-f860-4284-a580-37ed478720f6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:29.665235 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-21d8407b-01c4-49e1-bc35-d973e9d089ab tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:29.667347 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-21d8407b-01c4-49e1-bc35-d973e9d089ab tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:29.668121 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-21d8407b-01c4-49e1-bc35-d973e9d089ab tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:29.668863 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-21d8407b-01c4-49e1-bc35-d973e9d089ab tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:29.669505 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-21d8407b-01c4-49e1-bc35-d973e9d089ab tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:29.669951 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-21d8407b-01c4-49e1-bc35-d973e9d089ab tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:29.853187 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-21d8407b-01c4-49e1-bc35-d973e9d089ab tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:29.869311 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-21d8407b-01c4-49e1-bc35-d973e9d089ab tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6" status: 200 len: 1271 microversion: 2.1 time: 0.221582 Sep 08 10:39:29.871435 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 369/758] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:29 2022] GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6 => generated 1271 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:29.877918 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e8482ee7-a6df-45b7-9139-e8fdc2aa976f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:29.889976 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e8482ee7-a6df-45b7-9139-e8fdc2aa976f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:29.900422 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e8482ee7-a6df-45b7-9139-e8fdc2aa976f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:29.901293 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e8482ee7-a6df-45b7-9139-e8fdc2aa976f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:29.904872 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e8482ee7-a6df-45b7-9139-e8fdc2aa976f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:29.907201 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e8482ee7-a6df-45b7-9139-e8fdc2aa976f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:29.908606 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e8482ee7-a6df-45b7-9139-e8fdc2aa976f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:29.908606 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e8482ee7-a6df-45b7-9139-e8fdc2aa976f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:30.051015 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e8482ee7-a6df-45b7-9139-e8fdc2aa976f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:30.066670 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e8482ee7-a6df-45b7-9139-e8fdc2aa976f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:30.069304 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e8482ee7-a6df-45b7-9139-e8fdc2aa976f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:30.071109 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e8482ee7-a6df-45b7-9139-e8fdc2aa976f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e" status: 200 len: 1335 microversion: 2.25 time: 0.198197 Sep 08 10:39:30.072289 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 370/759] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:39:29 2022] GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e => generated 1335 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:39:30.079211 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0ff534f4-c70c-4a62-bb09-6ea30b980256 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Calling method '.version_select at 0x7f68e4ba3790>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:30.090694 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0ff534f4-c70c-4a62-bb09-6ea30b980256 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:30.091725 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0ff534f4-c70c-4a62-bb09-6ea30b980256 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:30.092382 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0ff534f4-c70c-4a62-bb09-6ea30b980256 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:30.116197 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0ff534f4-c70c-4a62-bb09-6ea30b980256 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:30.117283 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0ff534f4-c70c-4a62-bb09-6ea30b980256 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:30.117999 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0ff534f4-c70c-4a62-bb09-6ea30b980256 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:30.138424 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0ff534f4-c70c-4a62-bb09-6ea30b980256 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] 10.222.0.27 "GET /compute/v2.1/os-simple-tenant-usage/07bc2a412ede463e94d6933c30bc06ab?start=2022-09-07T10%3A39%3A28.984386&end=2022-09-09T10%3A39%3A28.984386" status: 200 len: 694 microversion: 2.1 time: 0.064577 Sep 08 10:39:30.139747 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 371/760] 10.222.0.27 () {58 vars in 1412 bytes} [Thu Sep 8 10:39:30 2022] GET /compute/v2.1/os-simple-tenant-usage/07bc2a412ede463e94d6933c30bc06ab?start=2022-09-07T10%3A39%3A28.984386&end=2022-09-09T10%3A39%3A28.984386 => generated 694 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:39:30.145110 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8cb17da6-978a-4a4f-89d1-ac28f2155adf tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:30.146154 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8cb17da6-978a-4a4f-89d1-ac28f2155adf tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] [instance: 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:30.155413 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8cb17da6-978a-4a4f-89d1-ac28f2155adf tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:30.156280 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8cb17da6-978a-4a4f-89d1-ac28f2155adf tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:30.157045 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8cb17da6-978a-4a4f-89d1-ac28f2155adf tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:30.158266 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8cb17da6-978a-4a4f-89d1-ac28f2155adf tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:30.158959 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8cb17da6-978a-4a4f-89d1-ac28f2155adf tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:30.159642 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8cb17da6-978a-4a4f-89d1-ac28f2155adf tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:30.252288 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8cb17da6-978a-4a4f-89d1-ac28f2155adf tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:30.300264 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8cb17da6-978a-4a4f-89d1-ac28f2155adf tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:30.303517 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8cb17da6-978a-4a4f-89d1-ac28f2155adf tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:30.318064 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8cb17da6-978a-4a4f-89d1-ac28f2155adf tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] 10.222.0.27 "GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a" status: 200 len: 1446 microversion: 2.75 time: 0.176986 Sep 08 10:39:30.333684 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 372/761] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:39:30 2022] GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a => generated 1446 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:39:30.339079 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c821847c-5f0a-4e35-a407-b465baf922cf tempest-TenantUsagesTestJSON-1813072697 tempest-TenantUsagesTestJSON-1813072697-project-admin] Calling method '.version_select at 0x7f68e49f7280>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:30.354910 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c821847c-5f0a-4e35-a407-b465baf922cf tempest-TenantUsagesTestJSON-1813072697 tempest-TenantUsagesTestJSON-1813072697-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:30.356338 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c821847c-5f0a-4e35-a407-b465baf922cf tempest-TenantUsagesTestJSON-1813072697 tempest-TenantUsagesTestJSON-1813072697-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:30.356841 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c821847c-5f0a-4e35-a407-b465baf922cf tempest-TenantUsagesTestJSON-1813072697 tempest-TenantUsagesTestJSON-1813072697-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:30.375600 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c821847c-5f0a-4e35-a407-b465baf922cf tempest-TenantUsagesTestJSON-1813072697 tempest-TenantUsagesTestJSON-1813072697-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:30.376226 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c821847c-5f0a-4e35-a407-b465baf922cf tempest-TenantUsagesTestJSON-1813072697 tempest-TenantUsagesTestJSON-1813072697-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:30.376923 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c821847c-5f0a-4e35-a407-b465baf922cf tempest-TenantUsagesTestJSON-1813072697 tempest-TenantUsagesTestJSON-1813072697-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:30.493629 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c821847c-5f0a-4e35-a407-b465baf922cf tempest-TenantUsagesTestJSON-1813072697 tempest-TenantUsagesTestJSON-1813072697-project-admin] 10.222.0.27 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-07T10%3A39%3A28.984386&end=2022-09-09T10%3A39%3A28.984386&detailed=1" status: 200 len: 9491 microversion: 2.1 time: 0.158247 Sep 08 10:39:30.507635 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 373/762] 10.222.0.27 () {58 vars in 1335 bytes} [Thu Sep 8 10:39:30 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-07T10%3A39%3A28.984386&end=2022-09-09T10%3A39%3A28.984386&detailed=1 => generated 9491 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:30.519496 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0c99b05c-d902-4832-81f5-7e00143a1fc0 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:30.528916 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0c99b05c-d902-4832-81f5-7e00143a1fc0 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: 8be00267-7835-4f68-bb40-6677750c0e3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:30.556406 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0c99b05c-d902-4832-81f5-7e00143a1fc0 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:30.558570 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0c99b05c-d902-4832-81f5-7e00143a1fc0 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:30.559656 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0c99b05c-d902-4832-81f5-7e00143a1fc0 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:30.561123 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0c99b05c-d902-4832-81f5-7e00143a1fc0 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:30.562015 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0c99b05c-d902-4832-81f5-7e00143a1fc0 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:30.562714 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0c99b05c-d902-4832-81f5-7e00143a1fc0 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:31.030092 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0c99b05c-d902-4832-81f5-7e00143a1fc0 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:31.043329 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0c99b05c-d902-4832-81f5-7e00143a1fc0 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/8be00267-7835-4f68-bb40-6677750c0e3c" status: 200 len: 1316 microversion: 2.1 time: 0.529958 Sep 08 10:39:31.044139 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 374/763] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:30 2022] GET /compute/v2.1/servers/8be00267-7835-4f68-bb40-6677750c0e3c => generated 1316 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:31.052167 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8db497d7-d221-4b5d-af30-8f4d0c91577d tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:31.053395 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8db497d7-d221-4b5d-af30-8f4d0c91577d tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] [instance: c7a958dd-d267-4932-b7d1-6e50d6c1b21e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:31.065482 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8db497d7-d221-4b5d-af30-8f4d0c91577d tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:31.074947 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8db497d7-d221-4b5d-af30-8f4d0c91577d tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:31.075603 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8db497d7-d221-4b5d-af30-8f4d0c91577d tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:31.076498 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8db497d7-d221-4b5d-af30-8f4d0c91577d tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:31.077110 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8db497d7-d221-4b5d-af30-8f4d0c91577d tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:31.077648 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8db497d7-d221-4b5d-af30-8f4d0c91577d tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:31.115507 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8db497d7-d221-4b5d-af30-8f4d0c91577d tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] [instance: c7a958dd-d267-4932-b7d1-6e50d6c1b21e] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:39:31.303729 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8db497d7-d221-4b5d-af30-8f4d0c91577d tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c7a958dd-d267-4932-b7d1-6e50d6c1b21e" status: 204 len: 0 microversion: 2.1 time: 0.256145 Sep 08 10:39:31.304996 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 375/764] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:39:31 2022] DELETE /compute/v2.1/servers/c7a958dd-d267-4932-b7d1-6e50d6c1b21e => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:39:31.315865 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-5ed9a2c1-3e38-4ccf-80b5-bd955bb273fc req-fe419170-2dbc-4d5a-b496-dc6bb267c0d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8be00267-7835-4f68-bb40-6677750c0e3c", "name": "network-vif-plugged", "status": "completed", "tag": "74f17ad2-8bfa-440e-9794-09a424196407"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:39:31.331319 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-5ed9a2c1-3e38-4ccf-80b5-bd955bb273fc req-fe419170-2dbc-4d5a-b496-dc6bb267c0d0 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:31.332174 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-5ed9a2c1-3e38-4ccf-80b5-bd955bb273fc req-fe419170-2dbc-4d5a-b496-dc6bb267c0d0 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:31.332818 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-5ed9a2c1-3e38-4ccf-80b5-bd955bb273fc req-fe419170-2dbc-4d5a-b496-dc6bb267c0d0 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:31.374921 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-5ed9a2c1-3e38-4ccf-80b5-bd955bb273fc req-fe419170-2dbc-4d5a-b496-dc6bb267c0d0 service nova] Creating event network-vif-plugged:74f17ad2-8bfa-440e-9794-09a424196407 for instance 8be00267-7835-4f68-bb40-6677750c0e3c on n-h1-850501-12 Sep 08 10:39:31.383390 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-5ed9a2c1-3e38-4ccf-80b5-bd955bb273fc req-fe419170-2dbc-4d5a-b496-dc6bb267c0d0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076377 Sep 08 10:39:31.385736 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 376/765] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:39:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:39:31.397013 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fc690496-b37f-464e-9474-5d128091bfe7 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:31.398313 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fc690496-b37f-464e-9474-5d128091bfe7 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 923d2401-f860-4284-a580-37ed478720f6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:31.407092 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fc690496-b37f-464e-9474-5d128091bfe7 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:31.408560 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fc690496-b37f-464e-9474-5d128091bfe7 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:31.409266 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fc690496-b37f-464e-9474-5d128091bfe7 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:31.410499 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fc690496-b37f-464e-9474-5d128091bfe7 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:31.411296 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fc690496-b37f-464e-9474-5d128091bfe7 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:31.412038 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fc690496-b37f-464e-9474-5d128091bfe7 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:31.697512 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-42c1d88d-0d81-4693-878a-ef5c2f9e0582 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/1fc866b1-81ac-4c09-86ab-6d8a4a580294/action" status: 202 len: 0 microversion: 2.1 time: 2.821010 Sep 08 10:39:31.702575 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 390/766] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:39:28 2022] POST /compute/v2.1/servers/1fc866b1-81ac-4c09-86ab-6d8a4a580294/action => generated 0 bytes in 2826 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:39:31.738823 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-fc690496-b37f-464e-9474-5d128091bfe7 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:31.752234 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fc690496-b37f-464e-9474-5d128091bfe7 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6" status: 200 len: 1313 microversion: 2.1 time: 0.363418 Sep 08 10:39:31.766870 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 377/767] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:31 2022] GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6 => generated 1313 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:31.779430 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-64e227b4-f88a-4fdc-bb60-611451cc5915 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:31.779926 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-64e227b4-f88a-4fdc-bb60-611451cc5915 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:31.789088 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64e227b4-f88a-4fdc-bb60-611451cc5915 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:31.789595 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64e227b4-f88a-4fdc-bb60-611451cc5915 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:31.790160 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64e227b4-f88a-4fdc-bb60-611451cc5915 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:31.790986 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64e227b4-f88a-4fdc-bb60-611451cc5915 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:31.791816 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64e227b4-f88a-4fdc-bb60-611451cc5915 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:31.792575 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64e227b4-f88a-4fdc-bb60-611451cc5915 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:31.808797 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f67ce17f-c731-4d38-992f-d7b3b0da0de6 tempest-FloatingIPsTestJSON-198388105 tempest-FloatingIPsTestJSON-198388105-project] Action: 'create', calling method: .version_select at 0x7f68e4ff99d0>, body: {"pool": null} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:39:31.918954 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-64e227b4-f88a-4fdc-bb60-611451cc5915 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:31.934040 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-64e227b4-f88a-4fdc-bb60-611451cc5915 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:31.936219 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-64e227b4-f88a-4fdc-bb60-611451cc5915 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:31.937825 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-64e227b4-f88a-4fdc-bb60-611451cc5915 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e" status: 200 len: 1341 microversion: 2.25 time: 0.170210 Sep 08 10:39:31.938692 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 378/768] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:39:31 2022] GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e => generated 1341 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:39:31.957944 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c26fa4e4-7e2c-4e61-9813-108d3bc82917 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:31.962291 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c26fa4e4-7e2c-4e61-9813-108d3bc82917 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] [instance: c7a958dd-d267-4932-b7d1-6e50d6c1b21e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:31.977444 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c26fa4e4-7e2c-4e61-9813-108d3bc82917 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:31.978089 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c26fa4e4-7e2c-4e61-9813-108d3bc82917 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:31.978655 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c26fa4e4-7e2c-4e61-9813-108d3bc82917 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:31.980049 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c26fa4e4-7e2c-4e61-9813-108d3bc82917 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:31.980591 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c26fa4e4-7e2c-4e61-9813-108d3bc82917 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:31.981147 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c26fa4e4-7e2c-4e61-9813-108d3bc82917 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:32.297244 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c26fa4e4-7e2c-4e61-9813-108d3bc82917 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad3d26d79c34a0c90a99eeaa85f6e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bc2a412ede463e94d6933c30bc06ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:32.308118 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c26fa4e4-7e2c-4e61-9813-108d3bc82917 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] 10.222.0.27 "GET /compute/v2.1/servers/c7a958dd-d267-4932-b7d1-6e50d6c1b21e" status: 200 len: 1469 microversion: 2.1 time: 0.359078 Sep 08 10:39:32.308681 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 379/769] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:31 2022] GET /compute/v2.1/servers/c7a958dd-d267-4932-b7d1-6e50d6c1b21e => generated 1469 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:32.327883 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8428a0bd-dffe-4287-913c-bd5cc8471bdb tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:32.328860 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8428a0bd-dffe-4287-913c-bd5cc8471bdb tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] [instance: 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:32.338791 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8428a0bd-dffe-4287-913c-bd5cc8471bdb tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:32.339602 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8428a0bd-dffe-4287-913c-bd5cc8471bdb tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:32.340053 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8428a0bd-dffe-4287-913c-bd5cc8471bdb tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:32.341152 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8428a0bd-dffe-4287-913c-bd5cc8471bdb tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:32.341820 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8428a0bd-dffe-4287-913c-bd5cc8471bdb tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:32.342268 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8428a0bd-dffe-4287-913c-bd5cc8471bdb tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:32.428405 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8428a0bd-dffe-4287-913c-bd5cc8471bdb tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:32.438531 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8428a0bd-dffe-4287-913c-bd5cc8471bdb tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:32.440281 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8428a0bd-dffe-4287-913c-bd5cc8471bdb tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:32.446334 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8428a0bd-dffe-4287-913c-bd5cc8471bdb tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] 10.222.0.27 "GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a" status: 200 len: 1446 microversion: 2.75 time: 0.136574 Sep 08 10:39:32.447334 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 380/770] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:39:32 2022] GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a => generated 1446 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:39:32.452392 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-969219ae-cc53-49a2-850b-3fa35a1ffe6a tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:32.453319 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-969219ae-cc53-49a2-850b-3fa35a1ffe6a tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 1fc866b1-81ac-4c09-86ab-6d8a4a580294] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:32.459445 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-969219ae-cc53-49a2-850b-3fa35a1ffe6a tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:32.460078 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-969219ae-cc53-49a2-850b-3fa35a1ffe6a tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:32.460610 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-969219ae-cc53-49a2-850b-3fa35a1ffe6a tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:32.461491 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-969219ae-cc53-49a2-850b-3fa35a1ffe6a tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:32.462059 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-969219ae-cc53-49a2-850b-3fa35a1ffe6a tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:32.462589 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-969219ae-cc53-49a2-850b-3fa35a1ffe6a tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:32.942003 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-969219ae-cc53-49a2-850b-3fa35a1ffe6a tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:32.958734 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-969219ae-cc53-49a2-850b-3fa35a1ffe6a tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/1fc866b1-81ac-4c09-86ab-6d8a4a580294" status: 200 len: 1504 microversion: 2.1 time: 0.510370 Sep 08 10:39:32.960011 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 381/771] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:32 2022] GET /compute/v2.1/servers/1fc866b1-81ac-4c09-86ab-6d8a4a580294 => generated 1504 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:32.968383 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5c5f9383-3b32-4a6b-ae1e-070f9ecd9394 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:32.975106 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5c5f9383-3b32-4a6b-ae1e-070f9ecd9394 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: 8be00267-7835-4f68-bb40-6677750c0e3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:33.000539 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5c5f9383-3b32-4a6b-ae1e-070f9ecd9394 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:33.006597 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5c5f9383-3b32-4a6b-ae1e-070f9ecd9394 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:33.008782 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5c5f9383-3b32-4a6b-ae1e-070f9ecd9394 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:33.015433 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5c5f9383-3b32-4a6b-ae1e-070f9ecd9394 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:33.020037 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5c5f9383-3b32-4a6b-ae1e-070f9ecd9394 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:33.022756 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5c5f9383-3b32-4a6b-ae1e-070f9ecd9394 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:33.101352 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:39:33.940142 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5c5f9383-3b32-4a6b-ae1e-070f9ecd9394 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:33.955368 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5c5f9383-3b32-4a6b-ae1e-070f9ecd9394 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/8be00267-7835-4f68-bb40-6677750c0e3c" status: 200 len: 1316 microversion: 2.1 time: 0.992166 Sep 08 10:39:33.973640 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 382/772] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:32 2022] GET /compute/v2.1/servers/8be00267-7835-4f68-bb40-6677750c0e3c => generated 1316 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:33.983980 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c66cd9fe-6e1d-4ad7-9590-0967c89c40a9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:33.984852 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c66cd9fe-6e1d-4ad7-9590-0967c89c40a9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 923d2401-f860-4284-a580-37ed478720f6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:33.992737 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c66cd9fe-6e1d-4ad7-9590-0967c89c40a9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:33.993531 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c66cd9fe-6e1d-4ad7-9590-0967c89c40a9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:33.995040 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c66cd9fe-6e1d-4ad7-9590-0967c89c40a9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:33.996272 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c66cd9fe-6e1d-4ad7-9590-0967c89c40a9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:33.998427 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c66cd9fe-6e1d-4ad7-9590-0967c89c40a9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:33.999140 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c66cd9fe-6e1d-4ad7-9590-0967c89c40a9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:34.185662 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f67ce17f-c731-4d38-992f-d7b3b0da0de6 tempest-FloatingIPsTestJSON-198388105 tempest-FloatingIPsTestJSON-198388105-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.479961 Sep 08 10:39:34.196959 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 391/773] 10.222.0.27 () {60 vars in 1170 bytes} [Thu Sep 8 10:39:31 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2495 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:39:34.209449 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d5fcf46c-2fba-4d16-b4ba-d7be42dc30f5 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:34.217716 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d5fcf46c-2fba-4d16-b4ba-d7be42dc30f5 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:34.224628 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d5fcf46c-2fba-4d16-b4ba-d7be42dc30f5 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:34.225566 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d5fcf46c-2fba-4d16-b4ba-d7be42dc30f5 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:34.227212 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d5fcf46c-2fba-4d16-b4ba-d7be42dc30f5 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:34.227787 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d5fcf46c-2fba-4d16-b4ba-d7be42dc30f5 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:34.228415 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d5fcf46c-2fba-4d16-b4ba-d7be42dc30f5 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:34.230037 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d5fcf46c-2fba-4d16-b4ba-d7be42dc30f5 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:34.583264 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d5fcf46c-2fba-4d16-b4ba-d7be42dc30f5 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:34.584531 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c66cd9fe-6e1d-4ad7-9590-0967c89c40a9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:34.595161 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d5fcf46c-2fba-4d16-b4ba-d7be42dc30f5 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:34.597209 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d5fcf46c-2fba-4d16-b4ba-d7be42dc30f5 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:34.598660 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d5fcf46c-2fba-4d16-b4ba-d7be42dc30f5 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e" status: 200 len: 1408 microversion: 2.25 time: 0.397046 Sep 08 10:39:34.599281 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c66cd9fe-6e1d-4ad7-9590-0967c89c40a9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6" status: 200 len: 1313 microversion: 2.1 time: 0.624228 Sep 08 10:39:34.600367 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 383/774] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:33 2022] GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6 => generated 1313 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:34.610094 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 392/775] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:39:34 2022] GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e => generated 1408 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:39:34.614859 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1fdd6b0f-da72-4cc6-9244-9781115769c3 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:34.615707 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1fdd6b0f-da72-4cc6-9244-9781115769c3 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] [instance: c7a958dd-d267-4932-b7d1-6e50d6c1b21e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:34.624496 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1fdd6b0f-da72-4cc6-9244-9781115769c3 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:34.625401 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1fdd6b0f-da72-4cc6-9244-9781115769c3 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:34.626024 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1fdd6b0f-da72-4cc6-9244-9781115769c3 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:34.626931 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1fdd6b0f-da72-4cc6-9244-9781115769c3 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:34.627314 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-95b5664c-bd4a-4907-92f2-72e4da09fc50 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:34.627573 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1fdd6b0f-da72-4cc6-9244-9781115769c3 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:34.628015 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1fdd6b0f-da72-4cc6-9244-9781115769c3 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:34.628684 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-95b5664c-bd4a-4907-92f2-72e4da09fc50 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] [instance: 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:34.637868 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-95b5664c-bd4a-4907-92f2-72e4da09fc50 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:34.638675 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-95b5664c-bd4a-4907-92f2-72e4da09fc50 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:34.639614 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-95b5664c-bd4a-4907-92f2-72e4da09fc50 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:34.640614 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-95b5664c-bd4a-4907-92f2-72e4da09fc50 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:34.641305 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-95b5664c-bd4a-4907-92f2-72e4da09fc50 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:34.641944 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-95b5664c-bd4a-4907-92f2-72e4da09fc50 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:34.725999 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-95b5664c-bd4a-4907-92f2-72e4da09fc50 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:34.736610 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-95b5664c-bd4a-4907-92f2-72e4da09fc50 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:34.738449 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-95b5664c-bd4a-4907-92f2-72e4da09fc50 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:34.745512 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-95b5664c-bd4a-4907-92f2-72e4da09fc50 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] 10.222.0.27 "GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a" status: 200 len: 1446 microversion: 2.75 time: 0.125898 Sep 08 10:39:34.746321 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 393/776] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:39:34 2022] GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a => generated 1446 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:39:34.751259 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5f525818-55e3-4bdf-9c9a-54cc93cb9873 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:34.751974 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5f525818-55e3-4bdf-9c9a-54cc93cb9873 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 1fc866b1-81ac-4c09-86ab-6d8a4a580294] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:34.758360 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5f525818-55e3-4bdf-9c9a-54cc93cb9873 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:34.759259 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5f525818-55e3-4bdf-9c9a-54cc93cb9873 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:34.760052 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5f525818-55e3-4bdf-9c9a-54cc93cb9873 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:34.761013 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5f525818-55e3-4bdf-9c9a-54cc93cb9873 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:34.761698 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5f525818-55e3-4bdf-9c9a-54cc93cb9873 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:34.762281 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5f525818-55e3-4bdf-9c9a-54cc93cb9873 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:34.992830 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=52 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:39:35.093313 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5f525818-55e3-4bdf-9c9a-54cc93cb9873 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:35.103294 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5f525818-55e3-4bdf-9c9a-54cc93cb9873 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/1fc866b1-81ac-4c09-86ab-6d8a4a580294" status: 200 len: 1504 microversion: 2.1 time: 0.355718 Sep 08 10:39:35.105066 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 394/777] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:34 2022] GET /compute/v2.1/servers/1fc866b1-81ac-4c09-86ab-6d8a4a580294 => generated 1504 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:35.110733 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c81b8738-fea1-45b6-8e19-02c592977d9f tempest-FloatingIPsTestJSON-198388105 tempest-FloatingIPsTestJSON-198388105-project] Calling method '.version_select at 0x7f68e4986940>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:35.261912 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1fdd6b0f-da72-4cc6-9244-9781115769c3 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad3d26d79c34a0c90a99eeaa85f6e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bc2a412ede463e94d6933c30bc06ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:35.275097 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1fdd6b0f-da72-4cc6-9244-9781115769c3 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] 10.222.0.27 "GET /compute/v2.1/servers/c7a958dd-d267-4932-b7d1-6e50d6c1b21e" status: 200 len: 1469 microversion: 2.1 time: 0.669991 Sep 08 10:39:35.276343 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 384/778] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:34 2022] GET /compute/v2.1/servers/c7a958dd-d267-4932-b7d1-6e50d6c1b21e => generated 1469 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:35.312625 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-e9e90031-3407-478d-bff4-38321f5662fc req-9cef28b7-d936-41c1-9697-da3615ac9a1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "923d2401-f860-4284-a580-37ed478720f6", "tag": "bec27b4a-f6d6-449e-854b-1e502a76de67"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:39:35.345943 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-e9e90031-3407-478d-bff4-38321f5662fc req-9cef28b7-d936-41c1-9697-da3615ac9a1a service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:35.346682 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-e9e90031-3407-478d-bff4-38321f5662fc req-9cef28b7-d936-41c1-9697-da3615ac9a1a service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:35.347380 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-e9e90031-3407-478d-bff4-38321f5662fc req-9cef28b7-d936-41c1-9697-da3615ac9a1a service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:35.391466 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-e9e90031-3407-478d-bff4-38321f5662fc req-9cef28b7-d936-41c1-9697-da3615ac9a1a service nova] Creating event network-changed:bec27b4a-f6d6-449e-854b-1e502a76de67 for instance 923d2401-f860-4284-a580-37ed478720f6 on n-h1-850501-12 Sep 08 10:39:35.409626 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-e9e90031-3407-478d-bff4-38321f5662fc req-9cef28b7-d936-41c1-9697-da3615ac9a1a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107303 Sep 08 10:39:35.410321 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 385/779] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:39:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:39:35.423139 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b4305903-bfb4-4010-a1be-36be6b6a66c1 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:35.423782 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b4305903-bfb4-4010-a1be-36be6b6a66c1 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: 8be00267-7835-4f68-bb40-6677750c0e3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:35.439636 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b4305903-bfb4-4010-a1be-36be6b6a66c1 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:35.440659 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b4305903-bfb4-4010-a1be-36be6b6a66c1 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:35.441664 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b4305903-bfb4-4010-a1be-36be6b6a66c1 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:35.442960 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b4305903-bfb4-4010-a1be-36be6b6a66c1 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:35.443687 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b4305903-bfb4-4010-a1be-36be6b6a66c1 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:35.444328 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b4305903-bfb4-4010-a1be-36be6b6a66c1 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:35.826088 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b4305903-bfb4-4010-a1be-36be6b6a66c1 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:35.840162 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b4305903-bfb4-4010-a1be-36be6b6a66c1 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/8be00267-7835-4f68-bb40-6677750c0e3c" status: 200 len: 1466 microversion: 2.1 time: 0.422068 Sep 08 10:39:35.858086 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 386/780] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:35 2022] GET /compute/v2.1/servers/8be00267-7835-4f68-bb40-6677750c0e3c => generated 1466 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:35.868359 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-ad63273a-ebfb-49b5-b39a-3025702ba913 req-958e44b0-26f8-4179-ab0a-5b298fee4e3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7a958dd-d267-4932-b7d1-6e50d6c1b21e", "name": "network-vif-deleted", "tag": "3ada0876-b5fd-4760-bd4f-a946d46aeeae"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:39:35.882626 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-ad63273a-ebfb-49b5-b39a-3025702ba913 req-958e44b0-26f8-4179-ab0a-5b298fee4e3b service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:35.883482 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-ad63273a-ebfb-49b5-b39a-3025702ba913 req-958e44b0-26f8-4179-ab0a-5b298fee4e3b service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:35.884109 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-ad63273a-ebfb-49b5-b39a-3025702ba913 req-958e44b0-26f8-4179-ab0a-5b298fee4e3b service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:35.899603 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-ad63273a-ebfb-49b5-b39a-3025702ba913 req-958e44b0-26f8-4179-ab0a-5b298fee4e3b service nova] Creating event network-vif-deleted:3ada0876-b5fd-4760-bd4f-a946d46aeeae for instance c7a958dd-d267-4932-b7d1-6e50d6c1b21e on n-h1-850501-12 Sep 08 10:39:35.907845 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-ad63273a-ebfb-49b5-b39a-3025702ba913 req-958e44b0-26f8-4179-ab0a-5b298fee4e3b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046919 Sep 08 10:39:35.908770 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 387/781] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:39:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:39:35.917619 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3a142836-43db-4ffc-aee3-c2335c2653ff tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:35.919894 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3a142836-43db-4ffc-aee3-c2335c2653ff tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:35.927526 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3a142836-43db-4ffc-aee3-c2335c2653ff tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:35.928469 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3a142836-43db-4ffc-aee3-c2335c2653ff tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:35.929127 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3a142836-43db-4ffc-aee3-c2335c2653ff tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:35.930065 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3a142836-43db-4ffc-aee3-c2335c2653ff tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:35.930771 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3a142836-43db-4ffc-aee3-c2335c2653ff tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:35.931601 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3a142836-43db-4ffc-aee3-c2335c2653ff tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:35.980814 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c81b8738-fea1-45b6-8e19-02c592977d9f tempest-FloatingIPsTestJSON-198388105 tempest-FloatingIPsTestJSON-198388105-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips/f6f18b19-a24d-4747-8747-f0da6da288c9" status: 200 len: 142 microversion: 2.1 time: 0.874226 Sep 08 10:39:35.982723 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 395/782] 10.222.0.27 () {58 vars in 1260 bytes} [Thu Sep 8 10:39:35 2022] GET /compute/v2.1/os-floating-ips/f6f18b19-a24d-4747-8747-f0da6da288c9 => generated 142 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:39:35.988392 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-836f7437-9406-45d0-90e8-88b1e391e6b1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:35.989476 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-836f7437-9406-45d0-90e8-88b1e391e6b1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 923d2401-f860-4284-a580-37ed478720f6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:36.012431 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-836f7437-9406-45d0-90e8-88b1e391e6b1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:36.014161 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-836f7437-9406-45d0-90e8-88b1e391e6b1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:36.017772 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-836f7437-9406-45d0-90e8-88b1e391e6b1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:36.019302 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-836f7437-9406-45d0-90e8-88b1e391e6b1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:36.020333 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-836f7437-9406-45d0-90e8-88b1e391e6b1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:36.021543 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-836f7437-9406-45d0-90e8-88b1e391e6b1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:36.096732 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=4 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:39:36.476584 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-3a142836-43db-4ffc-aee3-c2335c2653ff tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:36.490058 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-3a142836-43db-4ffc-aee3-c2335c2653ff tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:36.495274 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-3a142836-43db-4ffc-aee3-c2335c2653ff tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:36.498029 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3a142836-43db-4ffc-aee3-c2335c2653ff tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e" status: 200 len: 1408 microversion: 2.25 time: 0.587459 Sep 08 10:39:36.499197 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 388/783] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:39:35 2022] GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e => generated 1408 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:39:36.508390 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1e683ba3-de6e-41e9-bf9f-6e43d4e49aa4 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:36.509841 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1e683ba3-de6e-41e9-bf9f-6e43d4e49aa4 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] [instance: 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:36.519603 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e683ba3-de6e-41e9-bf9f-6e43d4e49aa4 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:36.520362 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e683ba3-de6e-41e9-bf9f-6e43d4e49aa4 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:36.520961 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e683ba3-de6e-41e9-bf9f-6e43d4e49aa4 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:36.521931 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e683ba3-de6e-41e9-bf9f-6e43d4e49aa4 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:36.535819 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e683ba3-de6e-41e9-bf9f-6e43d4e49aa4 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:36.536310 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e683ba3-de6e-41e9-bf9f-6e43d4e49aa4 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:36.646946 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-836f7437-9406-45d0-90e8-88b1e391e6b1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:36.654786 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-836f7437-9406-45d0-90e8-88b1e391e6b1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6" status: 200 len: 1313 microversion: 2.1 time: 0.670703 Sep 08 10:39:36.655746 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 396/784] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:35 2022] GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6 => generated 1313 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:36.661838 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b2b284bf-ce35-4637-9353-87fe04e34d39 tempest-ServersOnMultiNodesTest-60601867 tempest-ServersOnMultiNodesTest-60601867-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:36.663387 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b2b284bf-ce35-4637-9353-87fe04e34d39 tempest-ServersOnMultiNodesTest-60601867 tempest-ServersOnMultiNodesTest-60601867-project-admin] [instance: 8be00267-7835-4f68-bb40-6677750c0e3c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:36.671924 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b2b284bf-ce35-4637-9353-87fe04e34d39 tempest-ServersOnMultiNodesTest-60601867 tempest-ServersOnMultiNodesTest-60601867-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:36.672789 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b2b284bf-ce35-4637-9353-87fe04e34d39 tempest-ServersOnMultiNodesTest-60601867 tempest-ServersOnMultiNodesTest-60601867-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:36.673533 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b2b284bf-ce35-4637-9353-87fe04e34d39 tempest-ServersOnMultiNodesTest-60601867 tempest-ServersOnMultiNodesTest-60601867-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:36.674491 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b2b284bf-ce35-4637-9353-87fe04e34d39 tempest-ServersOnMultiNodesTest-60601867 tempest-ServersOnMultiNodesTest-60601867-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:36.675128 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b2b284bf-ce35-4637-9353-87fe04e34d39 tempest-ServersOnMultiNodesTest-60601867 tempest-ServersOnMultiNodesTest-60601867-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:36.675589 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b2b284bf-ce35-4637-9353-87fe04e34d39 tempest-ServersOnMultiNodesTest-60601867 tempest-ServersOnMultiNodesTest-60601867-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:36.717199 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1e683ba3-de6e-41e9-bf9f-6e43d4e49aa4 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:36.736338 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1e683ba3-de6e-41e9-bf9f-6e43d4e49aa4 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:36.738014 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1e683ba3-de6e-41e9-bf9f-6e43d4e49aa4 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:36.750617 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1e683ba3-de6e-41e9-bf9f-6e43d4e49aa4 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] 10.222.0.27 "GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a" status: 200 len: 1446 microversion: 2.75 time: 0.250131 Sep 08 10:39:36.765096 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 389/785] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:39:36 2022] GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a => generated 1446 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:39:36.765096 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-919ba35e-6ce5-4b37-a328-9263c9b93daa tempest-FloatingIPsTestJSON-198388105 tempest-FloatingIPsTestJSON-198388105-project] Calling method '.version_select at 0x7f68e4d26430>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:36.999576 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b2b284bf-ce35-4637-9353-87fe04e34d39 tempest-ServersOnMultiNodesTest-60601867 tempest-ServersOnMultiNodesTest-60601867-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/8be00267-7835-4f68-bb40-6677750c0e3c" status: 200 len: 1619 microversion: 2.1 time: 0.342036 Sep 08 10:39:37.000607 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 397/786] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:36 2022] GET /compute/v2.1/servers/8be00267-7835-4f68-bb40-6677750c0e3c => generated 1619 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:37.007553 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-33c7d50f-4df9-4bd2-b154-9bcc05ec5b0c tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:37.008539 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-33c7d50f-4df9-4bd2-b154-9bcc05ec5b0c tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 1fc866b1-81ac-4c09-86ab-6d8a4a580294] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:37.017889 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33c7d50f-4df9-4bd2-b154-9bcc05ec5b0c tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:37.022298 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33c7d50f-4df9-4bd2-b154-9bcc05ec5b0c tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:37.023433 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33c7d50f-4df9-4bd2-b154-9bcc05ec5b0c tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:37.024374 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33c7d50f-4df9-4bd2-b154-9bcc05ec5b0c tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:37.025004 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33c7d50f-4df9-4bd2-b154-9bcc05ec5b0c tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:37.025646 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33c7d50f-4df9-4bd2-b154-9bcc05ec5b0c tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:37.289832 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-33c7d50f-4df9-4bd2-b154-9bcc05ec5b0c tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:37.299271 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-33c7d50f-4df9-4bd2-b154-9bcc05ec5b0c tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/1fc866b1-81ac-4c09-86ab-6d8a4a580294" status: 200 len: 1504 microversion: 2.1 time: 0.297486 Sep 08 10:39:37.314612 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 398/787] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:37 2022] GET /compute/v2.1/servers/1fc866b1-81ac-4c09-86ab-6d8a4a580294 => generated 1504 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:37.323100 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e5d61be6-8054-44c8-bc37-60e937d8cefc tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:37.324195 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e5d61be6-8054-44c8-bc37-60e937d8cefc tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] [instance: c7a958dd-d267-4932-b7d1-6e50d6c1b21e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:37.332802 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e5d61be6-8054-44c8-bc37-60e937d8cefc tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:37.333764 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e5d61be6-8054-44c8-bc37-60e937d8cefc tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:37.335180 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e5d61be6-8054-44c8-bc37-60e937d8cefc tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:37.337013 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e5d61be6-8054-44c8-bc37-60e937d8cefc tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:37.338144 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e5d61be6-8054-44c8-bc37-60e937d8cefc tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:37.340073 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e5d61be6-8054-44c8-bc37-60e937d8cefc tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:37.429645 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e5d61be6-8054-44c8-bc37-60e937d8cefc tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:37.430283 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e5d61be6-8054-44c8-bc37-60e937d8cefc tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:37.430972 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e5d61be6-8054-44c8-bc37-60e937d8cefc tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:37.432082 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-e5d61be6-8054-44c8-bc37-60e937d8cefc tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lazy-loading 'fault' on Instance uuid c7a958dd-d267-4932-b7d1-6e50d6c1b21e {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:39:37.485934 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-919ba35e-6ce5-4b37-a328-9263c9b93daa tempest-FloatingIPsTestJSON-198388105 tempest-FloatingIPsTestJSON-198388105-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.732711 Sep 08 10:39:37.487857 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 390/788] 10.222.0.27 () {58 vars in 1149 bytes} [Thu Sep 8 10:39:36 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:39:37.498660 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e4a39a3d-2940-4bda-a9bb-c1b704229540 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-909590400", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["a3147437-e6f2-480d-bcaf-cc0f030d497d"]}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:39:37.500450 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e5d61be6-8054-44c8-bc37-60e937d8cefc tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad3d26d79c34a0c90a99eeaa85f6e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bc2a412ede463e94d6933c30bc06ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:37.513507 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e5d61be6-8054-44c8-bc37-60e937d8cefc tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] 10.222.0.27 "GET /compute/v2.1/servers/c7a958dd-d267-4932-b7d1-6e50d6c1b21e" status: 200 len: 1303 microversion: 2.1 time: 0.197595 Sep 08 10:39:37.514116 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 399/789] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:37 2022] GET /compute/v2.1/servers/c7a958dd-d267-4932-b7d1-6e50d6c1b21e => generated 1303 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:37.518985 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-eeb36ff6-a79b-406a-a4cc-8c3bc53813b4 tempest-FloatingIPsTestJSON-198388105 tempest-FloatingIPsTestJSON-198388105-project] Calling method '.version_select at 0x7f68e491b3a0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:37.570696 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-e4a39a3d-2940-4bda-a9bb-c1b704229540 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] validate_networks() for None {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:39:37.878727 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-e4a39a3d-2940-4bda-a9bb-c1b704229540 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:39:37.879160 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-e4a39a3d-2940-4bda-a9bb-c1b704229540 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:39:37.879653 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-e4a39a3d-2940-4bda-a9bb-c1b704229540 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:39:37.880072 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-e4a39a3d-2940-4bda-a9bb-c1b704229540 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:39:37.880519 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-e4a39a3d-2940-4bda-a9bb-c1b704229540 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:39:37.891508 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:39:37.900431 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e4a39a3d-2940-4bda-a9bb-c1b704229540 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:37.900975 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e4a39a3d-2940-4bda-a9bb-c1b704229540 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:37.901505 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e4a39a3d-2940-4bda-a9bb-c1b704229540 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:37.902370 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e4a39a3d-2940-4bda-a9bb-c1b704229540 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:37.902883 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e4a39a3d-2940-4bda-a9bb-c1b704229540 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:37.903321 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e4a39a3d-2940-4bda-a9bb-c1b704229540 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:37.925468 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-e4a39a3d-2940-4bda-a9bb-c1b704229540 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Getting quotas for project 2a3d4a2ec8674e418602b6dc0cec6ab9. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:39:37.935792 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-e4a39a3d-2940-4bda-a9bb-c1b704229540 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Getting quotas for user 771c067cf6814084a5520128a970dc82 and project 2a3d4a2ec8674e418602b6dc0cec6ab9. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:39:37.951192 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e4a39a3d-2940-4bda-a9bb-c1b704229540 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:39:37.953643 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e4a39a3d-2940-4bda-a9bb-c1b704229540 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: c04e1b8c-38c0-44c2-b02d-a6c1ca61d8cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:39:38.008771 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e4a39a3d-2940-4bda-a9bb-c1b704229540 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.519033 Sep 08 10:39:38.016669 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 391/790] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:39:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 521 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:39:38.016669 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-27042a21-d99d-4a2d-b23a-64523a93c113 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:38.016669 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-27042a21-d99d-4a2d-b23a-64523a93c113 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:38.023605 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-27042a21-d99d-4a2d-b23a-64523a93c113 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:38.024107 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-27042a21-d99d-4a2d-b23a-64523a93c113 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:38.024551 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-27042a21-d99d-4a2d-b23a-64523a93c113 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:38.025677 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-27042a21-d99d-4a2d-b23a-64523a93c113 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:38.026068 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-27042a21-d99d-4a2d-b23a-64523a93c113 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:38.026830 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-27042a21-d99d-4a2d-b23a-64523a93c113 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:38.216518 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-27042a21-d99d-4a2d-b23a-64523a93c113 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:38.225926 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-27042a21-d99d-4a2d-b23a-64523a93c113 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:38.227792 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-27042a21-d99d-4a2d-b23a-64523a93c113 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:38.229741 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-27042a21-d99d-4a2d-b23a-64523a93c113 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e" status: 200 len: 1408 microversion: 2.25 time: 0.218297 Sep 08 10:39:38.237474 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 392/791] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:39:38 2022] GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e => generated 1408 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:39:38.237474 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-178cc18b-9f6c-4a4d-affa-34b8c224a74d req-634bebb9-a3f5-4371-95d0-f126af22649d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fc866b1-81ac-4c09-86ab-6d8a4a580294", "name": "network-vif-unplugged", "status": "completed", "tag": "db9922aa-1490-4e6a-9ed5-89cbee224339"}, {"name": "network-changed", "server_uuid": "1fc866b1-81ac-4c09-86ab-6d8a4a580294", "tag": "db9922aa-1490-4e6a-9ed5-89cbee224339"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:39:38.249390 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-178cc18b-9f6c-4a4d-affa-34b8c224a74d req-634bebb9-a3f5-4371-95d0-f126af22649d service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:38.249963 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-178cc18b-9f6c-4a4d-affa-34b8c224a74d req-634bebb9-a3f5-4371-95d0-f126af22649d service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:38.250519 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-178cc18b-9f6c-4a4d-affa-34b8c224a74d req-634bebb9-a3f5-4371-95d0-f126af22649d service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:38.264685 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-178cc18b-9f6c-4a4d-affa-34b8c224a74d req-634bebb9-a3f5-4371-95d0-f126af22649d service nova] Creating event network-vif-unplugged:db9922aa-1490-4e6a-9ed5-89cbee224339 for instance 1fc866b1-81ac-4c09-86ab-6d8a4a580294 on n-h1-850501-12 Sep 08 10:39:38.265139 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-178cc18b-9f6c-4a4d-affa-34b8c224a74d req-634bebb9-a3f5-4371-95d0-f126af22649d service nova] Creating event network-changed:db9922aa-1490-4e6a-9ed5-89cbee224339 for instance 1fc866b1-81ac-4c09-86ab-6d8a4a580294 on n-h1-850501-12 Sep 08 10:39:38.272102 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-178cc18b-9f6c-4a4d-affa-34b8c224a74d req-634bebb9-a3f5-4371-95d0-f126af22649d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.040052 Sep 08 10:39:38.273075 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 393/792] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:39:38.280566 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c3196d38-649c-42a6-bfbc-4cde42733ec5 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:38.281539 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c3196d38-649c-42a6-bfbc-4cde42733ec5 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 923d2401-f860-4284-a580-37ed478720f6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:38.289493 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c3196d38-649c-42a6-bfbc-4cde42733ec5 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:38.290236 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c3196d38-649c-42a6-bfbc-4cde42733ec5 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:38.290868 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c3196d38-649c-42a6-bfbc-4cde42733ec5 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:38.292591 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c3196d38-649c-42a6-bfbc-4cde42733ec5 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:38.293347 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c3196d38-649c-42a6-bfbc-4cde42733ec5 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:38.293965 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c3196d38-649c-42a6-bfbc-4cde42733ec5 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:38.702156 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c3196d38-649c-42a6-bfbc-4cde42733ec5 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:38.716571 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c3196d38-649c-42a6-bfbc-4cde42733ec5 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6" status: 200 len: 1313 microversion: 2.1 time: 0.441990 Sep 08 10:39:38.717487 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 394/793] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:38 2022] GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6 => generated 1313 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:38.723479 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-eeb36ff6-a79b-406a-a4cc-8c3bc53813b4 tempest-FloatingIPsTestJSON-198388105 tempest-FloatingIPsTestJSON-198388105-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/f6f18b19-a24d-4747-8747-f0da6da288c9" status: 202 len: 0 microversion: 2.1 time: 1.207791 Sep 08 10:39:38.724070 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 400/794] 10.222.0.27 () {58 vars in 1263 bytes} [Thu Sep 8 10:39:37 2022] DELETE /compute/v2.1/os-floating-ips/f6f18b19-a24d-4747-8747-f0da6da288c9 => generated 0 bytes in 1209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:39:38.730263 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-7adfc780-27c8-49f2-8f8a-455051fe4ca4 req-98cb2620-685f-4978-b865-954ddb2ddcd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e", "tag": "1db6620e-f793-4486-a97c-149109663837"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:39:38.731658 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6ba3355c-c329-44de-8bdc-5f757ac1f7c4 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:38.732843 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6ba3355c-c329-44de-8bdc-5f757ac1f7c4 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] [instance: 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:38.740643 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6ba3355c-c329-44de-8bdc-5f757ac1f7c4 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:38.741282 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6ba3355c-c329-44de-8bdc-5f757ac1f7c4 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:38.741920 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6ba3355c-c329-44de-8bdc-5f757ac1f7c4 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:38.742887 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6ba3355c-c329-44de-8bdc-5f757ac1f7c4 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:38.743587 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6ba3355c-c329-44de-8bdc-5f757ac1f7c4 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:38.744169 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6ba3355c-c329-44de-8bdc-5f757ac1f7c4 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:38.749869 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-7adfc780-27c8-49f2-8f8a-455051fe4ca4 req-98cb2620-685f-4978-b865-954ddb2ddcd2 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:38.750554 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-7adfc780-27c8-49f2-8f8a-455051fe4ca4 req-98cb2620-685f-4978-b865-954ddb2ddcd2 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:38.751148 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-7adfc780-27c8-49f2-8f8a-455051fe4ca4 req-98cb2620-685f-4978-b865-954ddb2ddcd2 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:38.766584 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-7adfc780-27c8-49f2-8f8a-455051fe4ca4 req-98cb2620-685f-4978-b865-954ddb2ddcd2 service nova] Creating event network-changed:1db6620e-f793-4486-a97c-149109663837 for instance 4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e on n-h1-850501-12 Sep 08 10:39:38.771830 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-7adfc780-27c8-49f2-8f8a-455051fe4ca4 req-98cb2620-685f-4978-b865-954ddb2ddcd2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045518 Sep 08 10:39:38.772360 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 401/795] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:39:38.778376 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0e528076-d830-4bc3-82a1-a076defa1781 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:38.779089 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0e528076-d830-4bc3-82a1-a076defa1781 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: c04e1b8c-38c0-44c2-b02d-a6c1ca61d8cb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:38.785838 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e528076-d830-4bc3-82a1-a076defa1781 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:38.786307 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e528076-d830-4bc3-82a1-a076defa1781 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:38.786748 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e528076-d830-4bc3-82a1-a076defa1781 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:38.787469 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e528076-d830-4bc3-82a1-a076defa1781 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:38.788016 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e528076-d830-4bc3-82a1-a076defa1781 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:38.788362 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e528076-d830-4bc3-82a1-a076defa1781 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:38.836864 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6ba3355c-c329-44de-8bdc-5f757ac1f7c4 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:38.849236 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6ba3355c-c329-44de-8bdc-5f757ac1f7c4 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:38.850727 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6ba3355c-c329-44de-8bdc-5f757ac1f7c4 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:38.857616 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6ba3355c-c329-44de-8bdc-5f757ac1f7c4 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] 10.222.0.27 "GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a" status: 200 len: 1446 microversion: 2.75 time: 0.137990 Sep 08 10:39:38.858495 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 395/796] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:39:38 2022] GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a => generated 1446 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:39:38.863388 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-56ada84c-131b-449e-b864-e89739e055f2 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:38.864250 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-56ada84c-131b-449e-b864-e89739e055f2 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 1fc866b1-81ac-4c09-86ab-6d8a4a580294] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:38.871666 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-56ada84c-131b-449e-b864-e89739e055f2 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:38.872448 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-56ada84c-131b-449e-b864-e89739e055f2 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:38.873123 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-56ada84c-131b-449e-b864-e89739e055f2 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:38.874052 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-56ada84c-131b-449e-b864-e89739e055f2 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:38.874577 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-56ada84c-131b-449e-b864-e89739e055f2 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:38.875044 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-56ada84c-131b-449e-b864-e89739e055f2 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:38.900056 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0e528076-d830-4bc3-82a1-a076defa1781 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:38.921017 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0e528076-d830-4bc3-82a1-a076defa1781 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/c04e1b8c-38c0-44c2-b02d-a6c1ca61d8cb" status: 200 len: 1220 microversion: 2.1 time: 0.147274 Sep 08 10:39:38.922199 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 402/797] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:38 2022] GET /compute/v2.1/servers/c04e1b8c-38c0-44c2-b02d-a6c1ca61d8cb => generated 1220 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:38.944862 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b65d69fb-237f-496e-8fcb-956d8ad93652 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:38.945897 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b65d69fb-237f-496e-8fcb-956d8ad93652 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] [instance: c7a958dd-d267-4932-b7d1-6e50d6c1b21e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:38.954309 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b65d69fb-237f-496e-8fcb-956d8ad93652 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:38.955421 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b65d69fb-237f-496e-8fcb-956d8ad93652 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:38.956186 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b65d69fb-237f-496e-8fcb-956d8ad93652 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:38.956916 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b65d69fb-237f-496e-8fcb-956d8ad93652 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:38.957475 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b65d69fb-237f-496e-8fcb-956d8ad93652 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:38.958064 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b65d69fb-237f-496e-8fcb-956d8ad93652 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:38.976944 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-b65d69fb-237f-496e-8fcb-956d8ad93652 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] HTTP exception thrown: Instance c7a958dd-d267-4932-b7d1-6e50d6c1b21e could not be found. Sep 08 10:39:38.978932 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b65d69fb-237f-496e-8fcb-956d8ad93652 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Request method failure captured: Sep 08 10:39:38.978932 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/c7a958dd-d267-4932-b7d1-6e50d6c1b21e HTTP/1.1 Sep 08 10:39:38.978932 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:39:38.978932 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:39:38.978932 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:39:38.978932 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:39:38.978932 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:39:38.978932 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:39:38.978932 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:39:38.978932 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:39:38.978932 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcZFgmzToild32vB6WILkuJKObP5YKoI-_TBjifnws8wMWtPAKvfX5l8f5kXNdQWyfIvsCSAr0RGdGdPWMAWCV_e9YYW1PBSjhMPoHTvVlCZnue7sjG5dpiqJIj8bhnE8i8KfUrVdtAyF-24fdF64-Z9RwIP96vrMvexLfK8pHvaIhM Sep 08 10:39:38.978932 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:39:38.978932 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:39:38.978932 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:39:38.978932 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:39:38.978932 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:39:38.978932 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:39:38.978932 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 07bc2a412ede463e94d6933c30bc06ab Sep 08 10:39:38.978932 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-TenantUsagesTestJSON-1381419230 Sep 08 10:39:38.978932 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:39:38.978932 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:39:38.980978 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/07bc2a412ede463e94d6933c30bc06ab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/07bc2a412ede463e94d6933c30bc06ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_07bc2a412ede463e94d6933c30bc06ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/07bc2a412ede463e94d6933c30bc06ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:39:38.980978 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-TenantUsagesTestJSON-1381419230 Sep 08 10:39:38.980978 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 07bc2a412ede463e94d6933c30bc06ab Sep 08 10:39:38.980978 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1381419230 Sep 08 10:39:38.980978 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-TenantUsagesTestJSON-1381419230-project Sep 08 10:39:38.980978 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:39:38.980978 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:39:38.980978 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: dad3d26d79c34a0c90a99eeaa85f6e26 Sep 08 10:39:38.980978 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-TenantUsagesTestJSON-1381419230-project Sep 08 10:39:38.980978 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:39:38.980978 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance c7a958dd-d267-4932-b7d1-6e50d6c1b21e could not be found. Sep 08 10:39:38.980978 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'c7a958dd-d267-4932-b7d1-6e50d6c1b21e'} Sep 08 10:39:38.984542 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:39:38.984542 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:39:38.984542 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:39:38.984542 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:39:38.984542 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:39:38.984542 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:39:38.984542 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:39:38.984542 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:39:38.984542 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:39:38.984542 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:39:38.984542 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7a958dd-d267-4932-b7d1-6e50d6c1b21e could not be found. Sep 08 10:39:38.984542 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:39:38.984542 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:39:38.984542 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:39:38.984542 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:39:38.984542 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:39:38.984542 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:39:38.984542 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:39:38.984542 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:39:38.984542 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:39:38.985926 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:39:38.985926 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:39:38.985926 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:39:38.985926 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:39:38.985926 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:39:38.985926 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:39:38.985926 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:39:38.985926 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7a958dd-d267-4932-b7d1-6e50d6c1b21e could not be found. Sep 08 10:39:38.985926 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:39:38.985926 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:39:38.985926 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:39:38.985926 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:39:38.985926 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:39:38.985926 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:39:38.985926 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:39:38.985926 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:39:38.985926 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7a958dd-d267-4932-b7d1-6e50d6c1b21e could not be found. Sep 08 10:39:38.985926 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:39:38.987068 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b65d69fb-237f-496e-8fcb-956d8ad93652 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] Returning 404 to user: Instance c7a958dd-d267-4932-b7d1-6e50d6c1b21e could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:39:38.987068 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b65d69fb-237f-496e-8fcb-956d8ad93652 tempest-TenantUsagesTestJSON-1381419230 tempest-TenantUsagesTestJSON-1381419230-project] 10.222.0.27 "GET /compute/v2.1/servers/c7a958dd-d267-4932-b7d1-6e50d6c1b21e" status: 404 len: 111 microversion: 2.1 time: 0.040809 Sep 08 10:39:38.987068 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 403/798] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:38 2022] GET /compute/v2.1/servers/c7a958dd-d267-4932-b7d1-6e50d6c1b21e => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:39:38.993339 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-daf03614-1d4d-4b2d-b5ca-607414076b7c tempest-FloatingIPsTestJSON-198388105 tempest-FloatingIPsTestJSON-198388105-project] Action: 'create', calling method: .version_select at 0x7f68e4ba7a60>, body: {"pool": null} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:39:39.399362 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-56ada84c-131b-449e-b864-e89739e055f2 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:39.410123 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-56ada84c-131b-449e-b864-e89739e055f2 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/1fc866b1-81ac-4c09-86ab-6d8a4a580294" status: 200 len: 1504 microversion: 2.1 time: 0.550479 Sep 08 10:39:39.415517 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 396/799] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:38 2022] GET /compute/v2.1/servers/1fc866b1-81ac-4c09-86ab-6d8a4a580294 => generated 1504 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:39.432296 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a497bb13-d034-4938-a041-635eb66c4147 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:39.438398 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a497bb13-d034-4938-a041-635eb66c4147 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:39.451199 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a497bb13-d034-4938-a041-635eb66c4147 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:39.452106 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a497bb13-d034-4938-a041-635eb66c4147 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:39.462884 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a497bb13-d034-4938-a041-635eb66c4147 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:39.464430 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a497bb13-d034-4938-a041-635eb66c4147 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:39.465167 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a497bb13-d034-4938-a041-635eb66c4147 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:39.465781 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a497bb13-d034-4938-a041-635eb66c4147 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:39.748933 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a497bb13-d034-4938-a041-635eb66c4147 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:39.763568 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a497bb13-d034-4938-a041-635eb66c4147 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:39.767182 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a497bb13-d034-4938-a041-635eb66c4147 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:39.768574 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a497bb13-d034-4938-a041-635eb66c4147 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e" status: 200 len: 1408 microversion: 2.25 time: 0.348462 Sep 08 10:39:39.769181 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 397/800] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:39:39 2022] GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e => generated 1408 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:39:39.774882 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2a88ce5d-adf1-4d65-859f-05e291bb08e0 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:39.777220 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2a88ce5d-adf1-4d65-859f-05e291bb08e0 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 923d2401-f860-4284-a580-37ed478720f6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:39.790356 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2a88ce5d-adf1-4d65-859f-05e291bb08e0 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:39.792292 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2a88ce5d-adf1-4d65-859f-05e291bb08e0 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:39.793609 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2a88ce5d-adf1-4d65-859f-05e291bb08e0 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:39.795602 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2a88ce5d-adf1-4d65-859f-05e291bb08e0 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:39.796620 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2a88ce5d-adf1-4d65-859f-05e291bb08e0 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:39.808999 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2a88ce5d-adf1-4d65-859f-05e291bb08e0 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:40.049800 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2a88ce5d-adf1-4d65-859f-05e291bb08e0 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:40.074788 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2a88ce5d-adf1-4d65-859f-05e291bb08e0 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6" status: 200 len: 1313 microversion: 2.1 time: 0.303945 Sep 08 10:39:40.077102 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 398/801] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:39 2022] GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6 => generated 1313 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:40.095073 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a3dccbd6-7ba0-4359-8d73-ac7756a24d74 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:40.097565 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a3dccbd6-7ba0-4359-8d73-ac7756a24d74 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] [instance: 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:40.114267 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a3dccbd6-7ba0-4359-8d73-ac7756a24d74 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:40.115376 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a3dccbd6-7ba0-4359-8d73-ac7756a24d74 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:40.116352 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a3dccbd6-7ba0-4359-8d73-ac7756a24d74 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:40.117890 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a3dccbd6-7ba0-4359-8d73-ac7756a24d74 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:40.118919 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a3dccbd6-7ba0-4359-8d73-ac7756a24d74 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:40.120458 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a3dccbd6-7ba0-4359-8d73-ac7756a24d74 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:40.342502 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a3dccbd6-7ba0-4359-8d73-ac7756a24d74 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:40.365582 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a3dccbd6-7ba0-4359-8d73-ac7756a24d74 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:40.366798 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a3dccbd6-7ba0-4359-8d73-ac7756a24d74 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:40.374072 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a3dccbd6-7ba0-4359-8d73-ac7756a24d74 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] 10.222.0.27 "GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a" status: 200 len: 1446 microversion: 2.75 time: 0.294702 Sep 08 10:39:40.375828 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 399/802] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:39:40 2022] GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a => generated 1446 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:39:40.380786 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e2ecb371-955e-4945-a23d-e7656c78ce69 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:40.381660 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e2ecb371-955e-4945-a23d-e7656c78ce69 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: c04e1b8c-38c0-44c2-b02d-a6c1ca61d8cb] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:40.389998 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e2ecb371-955e-4945-a23d-e7656c78ce69 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:40.390873 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e2ecb371-955e-4945-a23d-e7656c78ce69 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:40.391519 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e2ecb371-955e-4945-a23d-e7656c78ce69 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:40.392608 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e2ecb371-955e-4945-a23d-e7656c78ce69 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:40.393289 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e2ecb371-955e-4945-a23d-e7656c78ce69 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:40.394330 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e2ecb371-955e-4945-a23d-e7656c78ce69 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:40.523909 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e2ecb371-955e-4945-a23d-e7656c78ce69 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:40.537683 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e2ecb371-955e-4945-a23d-e7656c78ce69 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/c04e1b8c-38c0-44c2-b02d-a6c1ca61d8cb" status: 200 len: 1268 microversion: 2.1 time: 0.160012 Sep 08 10:39:40.545907 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 400/803] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:40 2022] GET /compute/v2.1/servers/c04e1b8c-38c0-44c2-b02d-a6c1ca61d8cb => generated 1268 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:40.551935 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9bd9e57a-8007-43b3-ae64-a046391adb83 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:40.552746 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9bd9e57a-8007-43b3-ae64-a046391adb83 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 1fc866b1-81ac-4c09-86ab-6d8a4a580294] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:40.577289 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9bd9e57a-8007-43b3-ae64-a046391adb83 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:40.580267 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9bd9e57a-8007-43b3-ae64-a046391adb83 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:40.580724 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9bd9e57a-8007-43b3-ae64-a046391adb83 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:40.581718 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9bd9e57a-8007-43b3-ae64-a046391adb83 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:40.582433 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9bd9e57a-8007-43b3-ae64-a046391adb83 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:40.583120 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9bd9e57a-8007-43b3-ae64-a046391adb83 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:41.046114 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9bd9e57a-8007-43b3-ae64-a046391adb83 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:41.059211 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9bd9e57a-8007-43b3-ae64-a046391adb83 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/1fc866b1-81ac-4c09-86ab-6d8a4a580294" status: 200 len: 1504 microversion: 2.1 time: 0.511777 Sep 08 10:39:41.076323 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 401/804] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:40 2022] GET /compute/v2.1/servers/1fc866b1-81ac-4c09-86ab-6d8a4a580294 => generated 1504 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:41.083292 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-54a13e6c-ca20-42d0-81d7-bbadac6837c1 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:41.084400 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-54a13e6c-ca20-42d0-81d7-bbadac6837c1 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:41.095214 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-54a13e6c-ca20-42d0-81d7-bbadac6837c1 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:41.096491 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-54a13e6c-ca20-42d0-81d7-bbadac6837c1 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:41.097292 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-54a13e6c-ca20-42d0-81d7-bbadac6837c1 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:41.098395 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-54a13e6c-ca20-42d0-81d7-bbadac6837c1 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:41.099124 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-54a13e6c-ca20-42d0-81d7-bbadac6837c1 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:41.099755 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-54a13e6c-ca20-42d0-81d7-bbadac6837c1 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:41.506408 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-54a13e6c-ca20-42d0-81d7-bbadac6837c1 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:41.511864 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=100 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:39:41.535993 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-54a13e6c-ca20-42d0-81d7-bbadac6837c1 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:41.539460 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-54a13e6c-ca20-42d0-81d7-bbadac6837c1 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:41.543435 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-54a13e6c-ca20-42d0-81d7-bbadac6837c1 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e" status: 200 len: 1408 microversion: 2.25 time: 0.465180 Sep 08 10:39:41.544905 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 402/805] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:39:41 2022] GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e => generated 1408 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:39:41.554947 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-42639de1-d839-4ea2-89f1-cd0e37c9e026 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:41.562527 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-42639de1-d839-4ea2-89f1-cd0e37c9e026 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 923d2401-f860-4284-a580-37ed478720f6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:41.575390 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-42639de1-d839-4ea2-89f1-cd0e37c9e026 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:41.576806 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-42639de1-d839-4ea2-89f1-cd0e37c9e026 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:41.579057 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-42639de1-d839-4ea2-89f1-cd0e37c9e026 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:41.582048 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-42639de1-d839-4ea2-89f1-cd0e37c9e026 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:41.583376 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-42639de1-d839-4ea2-89f1-cd0e37c9e026 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:41.584521 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-42639de1-d839-4ea2-89f1-cd0e37c9e026 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:42.018710 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-daf03614-1d4d-4b2d-b5ca-607414076b7c tempest-FloatingIPsTestJSON-198388105 tempest-FloatingIPsTestJSON-198388105-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.029783 Sep 08 10:39:42.028975 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 404/806] 10.222.0.27 () {60 vars in 1170 bytes} [Thu Sep 8 10:39:38 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3042 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:39:42.034775 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d832fb83-28c8-44d3-8c6f-a20ee9acf1b7 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:42.035851 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d832fb83-28c8-44d3-8c6f-a20ee9acf1b7 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] [instance: 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:42.062284 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d832fb83-28c8-44d3-8c6f-a20ee9acf1b7 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:42.066843 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d832fb83-28c8-44d3-8c6f-a20ee9acf1b7 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:42.067987 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d832fb83-28c8-44d3-8c6f-a20ee9acf1b7 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:42.073676 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d832fb83-28c8-44d3-8c6f-a20ee9acf1b7 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:42.074873 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d832fb83-28c8-44d3-8c6f-a20ee9acf1b7 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:42.075835 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d832fb83-28c8-44d3-8c6f-a20ee9acf1b7 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:42.249833 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d832fb83-28c8-44d3-8c6f-a20ee9acf1b7 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:42.266902 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d832fb83-28c8-44d3-8c6f-a20ee9acf1b7 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:42.269347 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d832fb83-28c8-44d3-8c6f-a20ee9acf1b7 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:42.277814 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d832fb83-28c8-44d3-8c6f-a20ee9acf1b7 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] 10.222.0.27 "GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a" status: 200 len: 1446 microversion: 2.75 time: 0.247332 Sep 08 10:39:42.278766 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 405/807] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:39:42 2022] GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a => generated 1446 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:39:42.300718 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9c66cfc5-f505-4644-8570-0cf7da7f100d tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:42.302225 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9c66cfc5-f505-4644-8570-0cf7da7f100d tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: c04e1b8c-38c0-44c2-b02d-a6c1ca61d8cb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:42.311808 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-42639de1-d839-4ea2-89f1-cd0e37c9e026 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:42.322669 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9c66cfc5-f505-4644-8570-0cf7da7f100d tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:42.324964 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9c66cfc5-f505-4644-8570-0cf7da7f100d tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:42.325898 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9c66cfc5-f505-4644-8570-0cf7da7f100d tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:42.327505 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9c66cfc5-f505-4644-8570-0cf7da7f100d tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:42.328774 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9c66cfc5-f505-4644-8570-0cf7da7f100d tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:42.329754 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9c66cfc5-f505-4644-8570-0cf7da7f100d tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:42.333095 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-42639de1-d839-4ea2-89f1-cd0e37c9e026 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6" status: 200 len: 1313 microversion: 2.1 time: 0.784666 Sep 08 10:39:42.333938 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 403/808] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:41 2022] GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6 => generated 1313 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:42.365730 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-97fbd663-0b36-436e-ba73-109e60bba422 tempest-FloatingIPsTestJSON-198388105 tempest-FloatingIPsTestJSON-198388105-project] Calling method '.version_select at 0x7f68e49f7310>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:42.488860 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9c66cfc5-f505-4644-8570-0cf7da7f100d tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:42.505899 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9c66cfc5-f505-4644-8570-0cf7da7f100d tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/c04e1b8c-38c0-44c2-b02d-a6c1ca61d8cb" status: 200 len: 1274 microversion: 2.1 time: 0.224413 Sep 08 10:39:42.522588 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 406/809] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:42 2022] GET /compute/v2.1/servers/c04e1b8c-38c0-44c2-b02d-a6c1ca61d8cb => generated 1274 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:42.554388 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-09715c83-9323-4b83-bcdc-b2aa2c44c881 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:42.555858 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-09715c83-9323-4b83-bcdc-b2aa2c44c881 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 1fc866b1-81ac-4c09-86ab-6d8a4a580294] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:42.568646 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-09715c83-9323-4b83-bcdc-b2aa2c44c881 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:42.569889 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-09715c83-9323-4b83-bcdc-b2aa2c44c881 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:42.570907 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-09715c83-9323-4b83-bcdc-b2aa2c44c881 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:42.572554 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-09715c83-9323-4b83-bcdc-b2aa2c44c881 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:42.573868 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-09715c83-9323-4b83-bcdc-b2aa2c44c881 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:42.575308 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-09715c83-9323-4b83-bcdc-b2aa2c44c881 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:43.017229 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-09715c83-9323-4b83-bcdc-b2aa2c44c881 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:43.055397 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-09715c83-9323-4b83-bcdc-b2aa2c44c881 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/1fc866b1-81ac-4c09-86ab-6d8a4a580294" status: 200 len: 1504 microversion: 2.1 time: 0.528862 Sep 08 10:39:43.059181 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 407/810] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:42 2022] GET /compute/v2.1/servers/1fc866b1-81ac-4c09-86ab-6d8a4a580294 => generated 1504 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:43.080515 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-ded66d2f-28f5-472d-8168-17f407c7e75f req-cb480cfb-90cc-44a3-bd84-8b24304c8520 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "923d2401-f860-4284-a580-37ed478720f6", "name": "network-vif-plugged", "status": "completed", "tag": "bec27b4a-f6d6-449e-854b-1e502a76de67"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:39:43.109977 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ded66d2f-28f5-472d-8168-17f407c7e75f req-cb480cfb-90cc-44a3-bd84-8b24304c8520 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:43.110909 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ded66d2f-28f5-472d-8168-17f407c7e75f req-cb480cfb-90cc-44a3-bd84-8b24304c8520 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:43.111569 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ded66d2f-28f5-472d-8168-17f407c7e75f req-cb480cfb-90cc-44a3-bd84-8b24304c8520 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:43.128004 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-ded66d2f-28f5-472d-8168-17f407c7e75f req-cb480cfb-90cc-44a3-bd84-8b24304c8520 service nova] Creating event network-vif-plugged:bec27b4a-f6d6-449e-854b-1e502a76de67 for instance 923d2401-f860-4284-a580-37ed478720f6 on n-h1-850501-12 Sep 08 10:39:43.133739 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-ded66d2f-28f5-472d-8168-17f407c7e75f req-cb480cfb-90cc-44a3-bd84-8b24304c8520 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071738 Sep 08 10:39:43.135008 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 408/811] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:39:43.142124 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1c01077c-8e1f-48ef-8cab-a286d7f1c879 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:43.142957 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1c01077c-8e1f-48ef-8cab-a286d7f1c879 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:43.153311 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c01077c-8e1f-48ef-8cab-a286d7f1c879 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:43.155277 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c01077c-8e1f-48ef-8cab-a286d7f1c879 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:43.156265 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c01077c-8e1f-48ef-8cab-a286d7f1c879 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:43.158997 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c01077c-8e1f-48ef-8cab-a286d7f1c879 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:43.160289 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c01077c-8e1f-48ef-8cab-a286d7f1c879 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:43.161378 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c01077c-8e1f-48ef-8cab-a286d7f1c879 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:43.639167 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1c01077c-8e1f-48ef-8cab-a286d7f1c879 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:43.648894 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1c01077c-8e1f-48ef-8cab-a286d7f1c879 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:43.650795 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1c01077c-8e1f-48ef-8cab-a286d7f1c879 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:43.652302 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1c01077c-8e1f-48ef-8cab-a286d7f1c879 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e" status: 200 len: 1408 microversion: 2.25 time: 0.515616 Sep 08 10:39:43.653151 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 409/812] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:39:43 2022] GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e => generated 1408 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:39:43.658473 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6d79e60d-c8d3-4ba9-8119-810f4d03632d tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:43.659425 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6d79e60d-c8d3-4ba9-8119-810f4d03632d tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] [instance: 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:43.671276 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d79e60d-c8d3-4ba9-8119-810f4d03632d tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:43.672242 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d79e60d-c8d3-4ba9-8119-810f4d03632d tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:43.673143 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d79e60d-c8d3-4ba9-8119-810f4d03632d tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:43.675328 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d79e60d-c8d3-4ba9-8119-810f4d03632d tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:43.676156 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d79e60d-c8d3-4ba9-8119-810f4d03632d tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:43.676921 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d79e60d-c8d3-4ba9-8119-810f4d03632d tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:43.798589 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6d79e60d-c8d3-4ba9-8119-810f4d03632d tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:43.813983 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6d79e60d-c8d3-4ba9-8119-810f4d03632d tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:43.816677 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6d79e60d-c8d3-4ba9-8119-810f4d03632d tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:43.826248 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6d79e60d-c8d3-4ba9-8119-810f4d03632d tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] 10.222.0.27 "GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a" status: 200 len: 1446 microversion: 2.75 time: 0.171704 Sep 08 10:39:43.827346 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 410/813] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:39:43 2022] GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a => generated 1446 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:39:43.836862 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a35a0a78-1111-40da-9869-d65bc340694b tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:43.838523 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a35a0a78-1111-40da-9869-d65bc340694b tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 923d2401-f860-4284-a580-37ed478720f6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:43.852350 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a35a0a78-1111-40da-9869-d65bc340694b tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:43.854277 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a35a0a78-1111-40da-9869-d65bc340694b tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:43.855525 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a35a0a78-1111-40da-9869-d65bc340694b tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:43.857615 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a35a0a78-1111-40da-9869-d65bc340694b tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:43.859183 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a35a0a78-1111-40da-9869-d65bc340694b tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:43.860433 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a35a0a78-1111-40da-9869-d65bc340694b tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:44.316690 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a35a0a78-1111-40da-9869-d65bc340694b tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:44.343773 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a35a0a78-1111-40da-9869-d65bc340694b tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6" status: 200 len: 1313 microversion: 2.1 time: 0.514650 Sep 08 10:39:44.344417 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 411/814] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:43 2022] GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6 => generated 1313 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:44.361893 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d05ba787-0ef8-4c27-9b94-b07fbaddf3ec tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:44.363560 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d05ba787-0ef8-4c27-9b94-b07fbaddf3ec tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: c04e1b8c-38c0-44c2-b02d-a6c1ca61d8cb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:44.378079 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d05ba787-0ef8-4c27-9b94-b07fbaddf3ec tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:44.378887 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d05ba787-0ef8-4c27-9b94-b07fbaddf3ec tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:44.379494 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d05ba787-0ef8-4c27-9b94-b07fbaddf3ec tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:44.382622 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d05ba787-0ef8-4c27-9b94-b07fbaddf3ec tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:44.383444 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d05ba787-0ef8-4c27-9b94-b07fbaddf3ec tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:44.384733 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d05ba787-0ef8-4c27-9b94-b07fbaddf3ec tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:44.414246 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:39:44.639361 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d05ba787-0ef8-4c27-9b94-b07fbaddf3ec tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:44.652380 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d05ba787-0ef8-4c27-9b94-b07fbaddf3ec tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/c04e1b8c-38c0-44c2-b02d-a6c1ca61d8cb" status: 200 len: 1316 microversion: 2.1 time: 0.300753 Sep 08 10:39:44.654984 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 412/815] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:44 2022] GET /compute/v2.1/servers/c04e1b8c-38c0-44c2-b02d-a6c1ca61d8cb => generated 1316 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:44.662350 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d8142a47-743d-40bb-9924-9fcdd38f41c2 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:44.663268 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d8142a47-743d-40bb-9924-9fcdd38f41c2 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 1fc866b1-81ac-4c09-86ab-6d8a4a580294] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:44.671532 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d8142a47-743d-40bb-9924-9fcdd38f41c2 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:44.672877 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d8142a47-743d-40bb-9924-9fcdd38f41c2 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:44.673674 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d8142a47-743d-40bb-9924-9fcdd38f41c2 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:44.675441 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d8142a47-743d-40bb-9924-9fcdd38f41c2 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:44.676101 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d8142a47-743d-40bb-9924-9fcdd38f41c2 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:44.676743 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d8142a47-743d-40bb-9924-9fcdd38f41c2 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:45.091246 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d8142a47-743d-40bb-9924-9fcdd38f41c2 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:45.114757 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d8142a47-743d-40bb-9924-9fcdd38f41c2 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/1fc866b1-81ac-4c09-86ab-6d8a4a580294" status: 200 len: 1504 microversion: 2.1 time: 0.454960 Sep 08 10:39:45.116916 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 413/816] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:44 2022] GET /compute/v2.1/servers/1fc866b1-81ac-4c09-86ab-6d8a4a580294 => generated 1504 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:45.130459 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-36cc4837-8f24-4f49-9528-8e878302b1cd tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:45.132611 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-36cc4837-8f24-4f49-9528-8e878302b1cd tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:45.164433 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36cc4837-8f24-4f49-9528-8e878302b1cd tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:45.168097 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36cc4837-8f24-4f49-9528-8e878302b1cd tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:45.169571 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36cc4837-8f24-4f49-9528-8e878302b1cd tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:45.172870 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36cc4837-8f24-4f49-9528-8e878302b1cd tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:45.175405 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36cc4837-8f24-4f49-9528-8e878302b1cd tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:45.177589 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36cc4837-8f24-4f49-9528-8e878302b1cd tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:45.413929 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-97fbd663-0b36-436e-ba73-109e60bba422 tempest-FloatingIPsTestJSON-198388105 tempest-FloatingIPsTestJSON-198388105-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/e2264768-3645-4b8f-9ae0-0ebcdb998311" status: 202 len: 0 microversion: 2.1 time: 3.065081 Sep 08 10:39:45.420676 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 404/817] 10.222.0.27 () {58 vars in 1263 bytes} [Thu Sep 8 10:39:42 2022] DELETE /compute/v2.1/os-floating-ips/e2264768-3645-4b8f-9ae0-0ebcdb998311 => generated 0 bytes in 3086 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:39:45.439607 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4201fe1f-19a4-477b-9089-123470b7e2a8 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:45.440373 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4201fe1f-19a4-477b-9089-123470b7e2a8 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] [instance: 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:45.467233 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4201fe1f-19a4-477b-9089-123470b7e2a8 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:45.468228 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4201fe1f-19a4-477b-9089-123470b7e2a8 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:45.469656 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4201fe1f-19a4-477b-9089-123470b7e2a8 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:45.472208 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4201fe1f-19a4-477b-9089-123470b7e2a8 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:45.474743 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4201fe1f-19a4-477b-9089-123470b7e2a8 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:45.475364 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4201fe1f-19a4-477b-9089-123470b7e2a8 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:45.721176 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4201fe1f-19a4-477b-9089-123470b7e2a8 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:45.735304 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4201fe1f-19a4-477b-9089-123470b7e2a8 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:45.737065 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4201fe1f-19a4-477b-9089-123470b7e2a8 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:45.743609 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4201fe1f-19a4-477b-9089-123470b7e2a8 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] 10.222.0.27 "GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a" status: 200 len: 1446 microversion: 2.75 time: 0.320897 Sep 08 10:39:45.745238 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 405/818] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:39:45 2022] GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a => generated 1446 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:39:45.759029 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-554cbea6-5f6f-49cf-af64-01b1a51a9e6d tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:45.760000 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-554cbea6-5f6f-49cf-af64-01b1a51a9e6d tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 923d2401-f860-4284-a580-37ed478720f6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:45.768489 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-554cbea6-5f6f-49cf-af64-01b1a51a9e6d tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:45.769374 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-554cbea6-5f6f-49cf-af64-01b1a51a9e6d tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:45.769831 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-554cbea6-5f6f-49cf-af64-01b1a51a9e6d tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:45.770552 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-554cbea6-5f6f-49cf-af64-01b1a51a9e6d tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:45.771277 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-554cbea6-5f6f-49cf-af64-01b1a51a9e6d tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:45.771922 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-554cbea6-5f6f-49cf-af64-01b1a51a9e6d tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:45.781527 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-36cc4837-8f24-4f49-9528-8e878302b1cd tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:45.791486 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-36cc4837-8f24-4f49-9528-8e878302b1cd tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:45.793377 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-36cc4837-8f24-4f49-9528-8e878302b1cd tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:45.794708 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-36cc4837-8f24-4f49-9528-8e878302b1cd tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e" status: 200 len: 1408 microversion: 2.25 time: 0.674594 Sep 08 10:39:45.809988 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 414/819] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:39:45 2022] GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e => generated 1408 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:39:45.824662 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3005cad4-c1a1-46b3-9075-3cfa1bbd723e tempest-FloatingIPsTestJSON-198388105 tempest-FloatingIPsTestJSON-198388105-project] Calling method '.version_select at 0x7f68e4ba7670>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:45.909798 n-d-850501-12 devstack@n-api.service[128862]: DEBUG neutronclient.v2_0.client [None req-3005cad4-c1a1-46b3-9075-3cfa1bbd723e tempest-FloatingIPsTestJSON-198388105 tempest-FloatingIPsTestJSON-198388105-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP e2264768-3645-4b8f-9ae0-0ebcdb998311 could not be found", "detail": ""}} {{(pid=128862) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 08 10:39:45.910662 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-3005cad4-c1a1-46b3-9075-3cfa1bbd723e tempest-FloatingIPsTestJSON-198388105 tempest-FloatingIPsTestJSON-198388105-project] HTTP exception thrown: Floating IP not found for ID e2264768-3645-4b8f-9ae0-0ebcdb998311 Sep 08 10:39:45.929859 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3005cad4-c1a1-46b3-9075-3cfa1bbd723e tempest-FloatingIPsTestJSON-198388105 tempest-FloatingIPsTestJSON-198388105-project] Request method failure captured: Sep 08 10:39:45.929859 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/os-floating-ips/e2264768-3645-4b8f-9ae0-0ebcdb998311 HTTP/1.1 Sep 08 10:39:45.929859 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:39:45.929859 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:39:45.929859 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:39:45.929859 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:39:45.929859 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:39:45.929859 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:39:45.929859 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:39:45.929859 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:39:45.929859 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcZiJGvwj0hRy5aIBookuwY2zUwcAbPPrlSEyvSLJMuj8GkMY8SRbDuXF6iWpoqlFUDEdseI_yvW6TjO-e6_elXo6KEPGpVAQLuHRK55OJ0CSAa9fvNlWKdGsZtphDtgTzXam2J1JkVRT2nqlFIXTBI0YPyLqQCu8A3lEN6Fitd4oUQ Sep 08 10:39:45.929859 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:39:45.929859 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:39:45.929859 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:39:45.929859 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:39:45.929859 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:39:45.929859 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:39:45.929859 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: f360dbefb38f4f149b6cacb01b451b6b Sep 08 10:39:45.929859 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-FloatingIPsTestJSON-198388105 Sep 08 10:39:45.929859 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:39:45.929859 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:39:45.931574 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f360dbefb38f4f149b6cacb01b451b6b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f360dbefb38f4f149b6cacb01b451b6b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f360dbefb38f4f149b6cacb01b451b6b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f360dbefb38f4f149b6cacb01b451b6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:39:45.931574 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-FloatingIPsTestJSON-198388105 Sep 08 10:39:45.931574 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: f360dbefb38f4f149b6cacb01b451b6b Sep 08 10:39:45.931574 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-FloatingIPsTestJSON-198388105 Sep 08 10:39:45.931574 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-FloatingIPsTestJSON-198388105-project Sep 08 10:39:45.931574 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:39:45.931574 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:39:45.931574 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: c17c248b3f28465786251a655ddb75c2 Sep 08 10:39:45.931574 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-FloatingIPsTestJSON-198388105-project Sep 08 10:39:45.931574 n-d-850501-12 devstack@n-api.service[128862]: method: Sep 08 10:39:45.931574 n-d-850501-12 devstack@n-api.service[128862]: exception: Floating IP not found for ID e2264768-3645-4b8f-9ae0-0ebcdb998311 Sep 08 10:39:45.931574 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'e2264768-3645-4b8f-9ae0-0ebcdb998311'} Sep 08 10:39:45.931574 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:39:45.932578 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:39:45.932578 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 08 10:39:45.932578 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 08 10:39:45.932578 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:39:45.932578 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:39:45.932578 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 08 10:39:45.932578 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 08 10:39:45.932578 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:39:45.932578 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:39:45.932578 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 08 10:39:45.932578 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 08 10:39:45.932578 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:39:45.932578 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:39:45.932578 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 08 10:39:45.932578 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 08 10:39:45.932578 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:39:45.932578 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:39:45.932578 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 08 10:39:45.932578 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 08 10:39:45.933959 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:39:45.933959 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:39:45.933959 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 08 10:39:45.933959 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 08 10:39:45.933959 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 08 10:39:45.933959 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 08 10:39:45.933959 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP e2264768-3645-4b8f-9ae0-0ebcdb998311 could not be found Sep 08 10:39:45.933959 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7fb0a6c4-f329-452c-aead-cfb60519f81c'] Sep 08 10:39:45.933959 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:39:45.933959 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:39:45.933959 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:39:45.933959 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:39:45.933959 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Sep 08 10:39:45.933959 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 08 10:39:45.933959 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 08 10:39:45.933959 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 08 10:39:45.933959 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID e2264768-3645-4b8f-9ae0-0ebcdb998311. Sep 08 10:39:45.933959 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:39:45.933959 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:39:45.933959 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:39:45.935468 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:39:45.935468 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:39:45.935468 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:39:45.935468 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:39:45.935468 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:39:45.935468 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:39:45.935468 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:39:45.935468 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:39:45.935468 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:39:45.935468 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Sep 08 10:39:45.935468 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 08 10:39:45.935468 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID e2264768-3645-4b8f-9ae0-0ebcdb998311 Sep 08 10:39:45.935468 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:39:45.935468 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:39:45.935468 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:39:45.935468 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:39:45.935468 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:39:45.935468 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:39:45.935468 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:39:45.935468 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:39:45.937088 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID e2264768-3645-4b8f-9ae0-0ebcdb998311 Sep 08 10:39:45.937088 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:39:45.937088 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3005cad4-c1a1-46b3-9075-3cfa1bbd723e tempest-FloatingIPsTestJSON-198388105 tempest-FloatingIPsTestJSON-198388105-project] Returning 404 to user: Floating IP not found for ID e2264768-3645-4b8f-9ae0-0ebcdb998311 {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:39:45.937088 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3005cad4-c1a1-46b3-9075-3cfa1bbd723e tempest-FloatingIPsTestJSON-198388105 tempest-FloatingIPsTestJSON-198388105-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips/e2264768-3645-4b8f-9ae0-0ebcdb998311" status: 404 len: 111 microversion: 2.1 time: 0.125257 Sep 08 10:39:45.940354 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 415/820] 10.222.0.27 () {58 vars in 1260 bytes} [Thu Sep 8 10:39:45 2022] GET /compute/v2.1/os-floating-ips/e2264768-3645-4b8f-9ae0-0ebcdb998311 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:39:45.945911 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1c93f198-0fc9-4563-a7f7-b28b8bafb73f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:45.946651 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1c93f198-0fc9-4563-a7f7-b28b8bafb73f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: c04e1b8c-38c0-44c2-b02d-a6c1ca61d8cb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:45.954562 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c93f198-0fc9-4563-a7f7-b28b8bafb73f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:45.955082 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c93f198-0fc9-4563-a7f7-b28b8bafb73f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:45.955838 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c93f198-0fc9-4563-a7f7-b28b8bafb73f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:45.956615 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c93f198-0fc9-4563-a7f7-b28b8bafb73f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:45.957055 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c93f198-0fc9-4563-a7f7-b28b8bafb73f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:45.957680 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c93f198-0fc9-4563-a7f7-b28b8bafb73f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:46.094501 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-554cbea6-5f6f-49cf-af64-01b1a51a9e6d tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:46.110204 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-554cbea6-5f6f-49cf-af64-01b1a51a9e6d tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6" status: 200 len: 1463 microversion: 2.1 time: 0.363616 Sep 08 10:39:46.125804 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 406/821] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:45 2022] GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6 => generated 1463 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:46.152303 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-38afe5eb-2165-4c1a-a651-444078e8b84f tempest-FloatingIPsTestJSON-198388105 tempest-FloatingIPsTestJSON-198388105-project] Calling method '.version_select at 0x7f68e4d37a60>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:46.232741 n-d-850501-12 devstack@n-api.service[128861]: DEBUG neutronclient.v2_0.client [None req-38afe5eb-2165-4c1a-a651-444078e8b84f tempest-FloatingIPsTestJSON-198388105 tempest-FloatingIPsTestJSON-198388105-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP e2264768-3645-4b8f-9ae0-0ebcdb998311 could not be found", "detail": ""}} {{(pid=128861) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 08 10:39:46.233531 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-38afe5eb-2165-4c1a-a651-444078e8b84f tempest-FloatingIPsTestJSON-198388105 tempest-FloatingIPsTestJSON-198388105-project] HTTP exception thrown: Floating IP not found for ID e2264768-3645-4b8f-9ae0-0ebcdb998311 Sep 08 10:39:46.238825 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-38afe5eb-2165-4c1a-a651-444078e8b84f tempest-FloatingIPsTestJSON-198388105 tempest-FloatingIPsTestJSON-198388105-project] Request method failure captured: Sep 08 10:39:46.238825 n-d-850501-12 devstack@n-api.service[128861]: request: DELETE /compute/v2.1/os-floating-ips/e2264768-3645-4b8f-9ae0-0ebcdb998311 HTTP/1.1 Sep 08 10:39:46.238825 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:39:46.238825 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:39:46.238825 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:39:46.238825 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:39:46.238825 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:39:46.238825 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:39:46.238825 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:39:46.238825 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:39:46.238825 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcZiJGvwj0hRy5aIBookuwY2zUwcAbPPrlSEyvSLJMuj8GkMY8SRbDuXF6iWpoqlFUDEdseI_yvW6TjO-e6_elXo6KEPGpVAQLuHRK55OJ0CSAa9fvNlWKdGsZtphDtgTzXam2J1JkVRT2nqlFIXTBI0YPyLqQCu8A3lEN6Fitd4oUQ Sep 08 10:39:46.238825 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:39:46.238825 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:39:46.238825 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:39:46.238825 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:39:46.238825 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:39:46.238825 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:39:46.238825 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: f360dbefb38f4f149b6cacb01b451b6b Sep 08 10:39:46.238825 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-FloatingIPsTestJSON-198388105 Sep 08 10:39:46.238825 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:39:46.238825 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:39:46.241637 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f360dbefb38f4f149b6cacb01b451b6b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f360dbefb38f4f149b6cacb01b451b6b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f360dbefb38f4f149b6cacb01b451b6b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f360dbefb38f4f149b6cacb01b451b6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:39:46.241637 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-FloatingIPsTestJSON-198388105 Sep 08 10:39:46.241637 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: f360dbefb38f4f149b6cacb01b451b6b Sep 08 10:39:46.241637 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-FloatingIPsTestJSON-198388105 Sep 08 10:39:46.241637 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-FloatingIPsTestJSON-198388105-project Sep 08 10:39:46.241637 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:39:46.241637 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:39:46.241637 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: c17c248b3f28465786251a655ddb75c2 Sep 08 10:39:46.241637 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-FloatingIPsTestJSON-198388105-project Sep 08 10:39:46.241637 n-d-850501-12 devstack@n-api.service[128861]: method: Sep 08 10:39:46.241637 n-d-850501-12 devstack@n-api.service[128861]: exception: Floating IP not found for ID e2264768-3645-4b8f-9ae0-0ebcdb998311 Sep 08 10:39:46.241637 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': 'e2264768-3645-4b8f-9ae0-0ebcdb998311'} Sep 08 10:39:46.241637 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:39:46.243469 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:39:46.243469 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 08 10:39:46.243469 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 08 10:39:46.243469 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:39:46.243469 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:39:46.243469 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 08 10:39:46.243469 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 08 10:39:46.243469 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:39:46.243469 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:39:46.243469 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 08 10:39:46.243469 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 08 10:39:46.243469 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:39:46.243469 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:39:46.243469 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 08 10:39:46.243469 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 08 10:39:46.243469 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:39:46.243469 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:39:46.243469 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 08 10:39:46.243469 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 08 10:39:46.246771 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:39:46.246771 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:39:46.246771 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 08 10:39:46.246771 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 08 10:39:46.246771 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 08 10:39:46.246771 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 08 10:39:46.246771 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP e2264768-3645-4b8f-9ae0-0ebcdb998311 could not be found Sep 08 10:39:46.246771 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1dd92cfc-115f-44dd-830a-9dc544d947e2'] Sep 08 10:39:46.246771 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:39:46.246771 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:39:46.246771 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:39:46.246771 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:39:46.246771 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Sep 08 10:39:46.246771 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 08 10:39:46.246771 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 08 10:39:46.246771 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 08 10:39:46.246771 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID e2264768-3645-4b8f-9ae0-0ebcdb998311. Sep 08 10:39:46.246771 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:39:46.246771 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:39:46.246771 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:39:46.252832 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:39:46.252832 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:39:46.252832 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:39:46.252832 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:39:46.252832 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:39:46.252832 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:39:46.252832 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:39:46.252832 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:39:46.252832 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:39:46.252832 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Sep 08 10:39:46.252832 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 08 10:39:46.252832 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID e2264768-3645-4b8f-9ae0-0ebcdb998311 Sep 08 10:39:46.252832 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:39:46.252832 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:39:46.252832 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:39:46.252832 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:39:46.252832 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:39:46.252832 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:39:46.252832 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:39:46.252832 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:39:46.255504 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID e2264768-3645-4b8f-9ae0-0ebcdb998311 Sep 08 10:39:46.255504 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:39:46.255504 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-38afe5eb-2165-4c1a-a651-444078e8b84f tempest-FloatingIPsTestJSON-198388105 tempest-FloatingIPsTestJSON-198388105-project] Returning 404 to user: Floating IP not found for ID e2264768-3645-4b8f-9ae0-0ebcdb998311 {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:39:46.255504 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-38afe5eb-2165-4c1a-a651-444078e8b84f tempest-FloatingIPsTestJSON-198388105 tempest-FloatingIPsTestJSON-198388105-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/e2264768-3645-4b8f-9ae0-0ebcdb998311" status: 404 len: 111 microversion: 2.1 time: 0.113447 Sep 08 10:39:46.255504 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 407/822] 10.222.0.27 () {58 vars in 1263 bytes} [Thu Sep 8 10:39:46 2022] DELETE /compute/v2.1/os-floating-ips/e2264768-3645-4b8f-9ae0-0ebcdb998311 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:39:46.256388 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1c93f198-0fc9-4563-a7f7-b28b8bafb73f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:46.262737 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3ae19dfa-94d9-4491-8424-a29376adb8f9 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:46.262737 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3ae19dfa-94d9-4491-8424-a29376adb8f9 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 1fc866b1-81ac-4c09-86ab-6d8a4a580294] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:46.271675 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1c93f198-0fc9-4563-a7f7-b28b8bafb73f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/c04e1b8c-38c0-44c2-b02d-a6c1ca61d8cb" status: 200 len: 1316 microversion: 2.1 time: 0.325292 Sep 08 10:39:46.273587 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 416/823] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:45 2022] GET /compute/v2.1/servers/c04e1b8c-38c0-44c2-b02d-a6c1ca61d8cb => generated 1316 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:46.280661 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3ae19dfa-94d9-4491-8424-a29376adb8f9 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:46.291265 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3ae19dfa-94d9-4491-8424-a29376adb8f9 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:46.292613 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3ae19dfa-94d9-4491-8424-a29376adb8f9 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:46.293891 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3ae19dfa-94d9-4491-8424-a29376adb8f9 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:46.293891 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3ae19dfa-94d9-4491-8424-a29376adb8f9 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:46.294464 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3ae19dfa-94d9-4491-8424-a29376adb8f9 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:46.295172 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dcddb9b8-ea02-4865-b6d6-147d50a67fd3 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:39:46.301084 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-dcddb9b8-ea02-4865-b6d6-147d50a67fd3 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 923d2401-f860-4284-a580-37ed478720f6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:46.338758 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dcddb9b8-ea02-4865-b6d6-147d50a67fd3 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:46.342728 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dcddb9b8-ea02-4865-b6d6-147d50a67fd3 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:46.343567 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dcddb9b8-ea02-4865-b6d6-147d50a67fd3 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:46.345857 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dcddb9b8-ea02-4865-b6d6-147d50a67fd3 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:46.346786 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dcddb9b8-ea02-4865-b6d6-147d50a67fd3 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:46.348797 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dcddb9b8-ea02-4865-b6d6-147d50a67fd3 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:46.533713 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-dcddb9b8-ea02-4865-b6d6-147d50a67fd3 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:46.543758 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-dcddb9b8-ea02-4865-b6d6-147d50a67fd3 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 923d2401-f860-4284-a580-37ed478720f6] Old instance type m1.heat2, new instance type m1.heat {{(pid=128862) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 08 10:39:46.554266 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-dcddb9b8-ea02-4865-b6d6-147d50a67fd3 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:39:46.555094 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-dcddb9b8-ea02-4865-b6d6-147d50a67fd3 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:39:46.556040 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-dcddb9b8-ea02-4865-b6d6-147d50a67fd3 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:39:46.557392 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-dcddb9b8-ea02-4865-b6d6-147d50a67fd3 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:39:46.558015 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-dcddb9b8-ea02-4865-b6d6-147d50a67fd3 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:39:46.736331 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-dcddb9b8-ea02-4865-b6d6-147d50a67fd3 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "POST /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6/action" status: 202 len: 0 microversion: 2.1 time: 0.462252 Sep 08 10:39:46.743226 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 417/824] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:39:46 2022] POST /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6/action => generated 0 bytes in 468 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:39:46.752612 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-84e64f6a-4eab-4534-bace-ae7599a935bb req-e35cdce1-267a-4aa2-a5ce-3539176aaade service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c04e1b8c-38c0-44c2-b02d-a6c1ca61d8cb", "tag": "a06cc3a1-f52a-4dfc-aee6-7025a0d03093"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:39:46.770704 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-3ae19dfa-94d9-4491-8424-a29376adb8f9 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:46.773407 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-84e64f6a-4eab-4534-bace-ae7599a935bb req-e35cdce1-267a-4aa2-a5ce-3539176aaade service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:46.773899 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-84e64f6a-4eab-4534-bace-ae7599a935bb req-e35cdce1-267a-4aa2-a5ce-3539176aaade service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:46.774327 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-84e64f6a-4eab-4534-bace-ae7599a935bb req-e35cdce1-267a-4aa2-a5ce-3539176aaade service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:46.783733 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3ae19dfa-94d9-4491-8424-a29376adb8f9 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/1fc866b1-81ac-4c09-86ab-6d8a4a580294" status: 200 len: 1504 microversion: 2.1 time: 0.536662 Sep 08 10:39:46.789553 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 408/825] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:46 2022] GET /compute/v2.1/servers/1fc866b1-81ac-4c09-86ab-6d8a4a580294 => generated 1504 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:46.806591 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-84e64f6a-4eab-4534-bace-ae7599a935bb req-e35cdce1-267a-4aa2-a5ce-3539176aaade service nova] Creating event network-changed:a06cc3a1-f52a-4dfc-aee6-7025a0d03093 for instance c04e1b8c-38c0-44c2-b02d-a6c1ca61d8cb on n-h1-850501-12 Sep 08 10:39:46.813487 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-febfd532-e71b-4ba8-8bee-b970575e53a2 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:46.817532 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-febfd532-e71b-4ba8-8bee-b970575e53a2 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 923d2401-f860-4284-a580-37ed478720f6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:46.818938 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-84e64f6a-4eab-4534-bace-ae7599a935bb req-e35cdce1-267a-4aa2-a5ce-3539176aaade service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074748 Sep 08 10:39:46.820638 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 418/826] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:39:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:39:46.827931 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d033b156-f7ab-4850-9420-9ff4382d136a tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:46.828858 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d033b156-f7ab-4850-9420-9ff4382d136a tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] [instance: 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:46.834841 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-febfd532-e71b-4ba8-8bee-b970575e53a2 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:46.840106 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d033b156-f7ab-4850-9420-9ff4382d136a tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:46.840727 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-febfd532-e71b-4ba8-8bee-b970575e53a2 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:46.841075 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d033b156-f7ab-4850-9420-9ff4382d136a tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:46.841662 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d033b156-f7ab-4850-9420-9ff4382d136a tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:46.842353 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-febfd532-e71b-4ba8-8bee-b970575e53a2 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:46.842721 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d033b156-f7ab-4850-9420-9ff4382d136a tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:46.843108 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-febfd532-e71b-4ba8-8bee-b970575e53a2 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:46.843506 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d033b156-f7ab-4850-9420-9ff4382d136a tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:46.843627 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-febfd532-e71b-4ba8-8bee-b970575e53a2 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:46.843997 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-febfd532-e71b-4ba8-8bee-b970575e53a2 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:46.844341 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d033b156-f7ab-4850-9420-9ff4382d136a tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:46.990979 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d033b156-f7ab-4850-9420-9ff4382d136a tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:47.003031 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d033b156-f7ab-4850-9420-9ff4382d136a tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:47.005562 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d033b156-f7ab-4850-9420-9ff4382d136a tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:47.013855 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d033b156-f7ab-4850-9420-9ff4382d136a tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] 10.222.0.27 "GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a" status: 200 len: 1446 microversion: 2.75 time: 0.191089 Sep 08 10:39:47.014718 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 419/827] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:39:46 2022] GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a => generated 1446 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:39:47.057833 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-df493730-1666-4b6e-89a2-ef7b38a9cdbb tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:47.059391 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-df493730-1666-4b6e-89a2-ef7b38a9cdbb tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:47.089884 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df493730-1666-4b6e-89a2-ef7b38a9cdbb tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:47.091344 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df493730-1666-4b6e-89a2-ef7b38a9cdbb tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:47.092341 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df493730-1666-4b6e-89a2-ef7b38a9cdbb tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:47.094736 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df493730-1666-4b6e-89a2-ef7b38a9cdbb tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:47.095802 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df493730-1666-4b6e-89a2-ef7b38a9cdbb tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:47.096851 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df493730-1666-4b6e-89a2-ef7b38a9cdbb tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:47.364200 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-df493730-1666-4b6e-89a2-ef7b38a9cdbb tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:47.382019 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-df493730-1666-4b6e-89a2-ef7b38a9cdbb tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:47.383812 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-df493730-1666-4b6e-89a2-ef7b38a9cdbb tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:47.408386 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-df493730-1666-4b6e-89a2-ef7b38a9cdbb tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e" status: 200 len: 1408 microversion: 2.25 time: 0.359935 Sep 08 10:39:47.422242 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 420/828] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:39:47 2022] GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e => generated 1408 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:39:47.439340 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-02d33564-d052-472e-afdf-9b8b34a7273f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:47.440362 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-02d33564-d052-472e-afdf-9b8b34a7273f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: c04e1b8c-38c0-44c2-b02d-a6c1ca61d8cb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:47.449148 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02d33564-d052-472e-afdf-9b8b34a7273f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:47.449957 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02d33564-d052-472e-afdf-9b8b34a7273f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:47.450565 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02d33564-d052-472e-afdf-9b8b34a7273f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:47.451595 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02d33564-d052-472e-afdf-9b8b34a7273f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:47.452952 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02d33564-d052-472e-afdf-9b8b34a7273f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:47.454054 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02d33564-d052-472e-afdf-9b8b34a7273f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:47.638661 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-febfd532-e71b-4ba8-8bee-b970575e53a2 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:47.648392 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-febfd532-e71b-4ba8-8bee-b970575e53a2 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6" status: 200 len: 1472 microversion: 2.1 time: 0.855102 Sep 08 10:39:47.656003 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 409/829] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:46 2022] GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6 => generated 1472 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:47.670121 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-f4da6679-710c-4be6-8cda-7d6da75ee342 req-87c35539-0cbb-4507-866f-566e39314a2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e", "name": "network-vif-plugged", "status": "completed", "tag": "1db6620e-f793-4486-a97c-149109663837"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:39:47.699934 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-f4da6679-710c-4be6-8cda-7d6da75ee342 req-87c35539-0cbb-4507-866f-566e39314a2b service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:47.700435 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-f4da6679-710c-4be6-8cda-7d6da75ee342 req-87c35539-0cbb-4507-866f-566e39314a2b service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:47.700866 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-f4da6679-710c-4be6-8cda-7d6da75ee342 req-87c35539-0cbb-4507-866f-566e39314a2b service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:47.728712 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-f4da6679-710c-4be6-8cda-7d6da75ee342 req-87c35539-0cbb-4507-866f-566e39314a2b service nova] Creating event network-vif-plugged:1db6620e-f793-4486-a97c-149109663837 for instance 4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e on n-h1-850501-12 Sep 08 10:39:47.735446 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-f4da6679-710c-4be6-8cda-7d6da75ee342 req-87c35539-0cbb-4507-866f-566e39314a2b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077331 Sep 08 10:39:47.736380 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 410/830] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:39:47.747422 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-02d33564-d052-472e-afdf-9b8b34a7273f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:47.761565 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-02d33564-d052-472e-afdf-9b8b34a7273f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/c04e1b8c-38c0-44c2-b02d-a6c1ca61d8cb" status: 200 len: 1316 microversion: 2.1 time: 0.326884 Sep 08 10:39:47.764475 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 421/831] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:47 2022] GET /compute/v2.1/servers/c04e1b8c-38c0-44c2-b02d-a6c1ca61d8cb => generated 1316 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:47.833250 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4e4f7c32-f937-4b4b-af4e-e7c59ede575e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:47.835753 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4e4f7c32-f937-4b4b-af4e-e7c59ede575e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 1fc866b1-81ac-4c09-86ab-6d8a4a580294] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:47.860807 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4e4f7c32-f937-4b4b-af4e-e7c59ede575e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:47.861691 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4e4f7c32-f937-4b4b-af4e-e7c59ede575e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:47.862442 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4e4f7c32-f937-4b4b-af4e-e7c59ede575e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:47.863569 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4e4f7c32-f937-4b4b-af4e-e7c59ede575e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:47.864374 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4e4f7c32-f937-4b4b-af4e-e7c59ede575e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:47.869361 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4e4f7c32-f937-4b4b-af4e-e7c59ede575e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:47.919623 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=9 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:39:47.955030 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=32 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:39:48.065327 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3a06f6ce-947b-4842-8d8d-8cdeff8758c5 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:48.066147 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3a06f6ce-947b-4842-8d8d-8cdeff8758c5 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] [instance: 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:48.075502 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a06f6ce-947b-4842-8d8d-8cdeff8758c5 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:48.076359 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a06f6ce-947b-4842-8d8d-8cdeff8758c5 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:48.077115 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a06f6ce-947b-4842-8d8d-8cdeff8758c5 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:48.078063 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a06f6ce-947b-4842-8d8d-8cdeff8758c5 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:48.078670 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a06f6ce-947b-4842-8d8d-8cdeff8758c5 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:48.079663 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a06f6ce-947b-4842-8d8d-8cdeff8758c5 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:48.185971 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3a06f6ce-947b-4842-8d8d-8cdeff8758c5 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:48.216919 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3a06f6ce-947b-4842-8d8d-8cdeff8758c5 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:48.219556 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3a06f6ce-947b-4842-8d8d-8cdeff8758c5 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:48.226465 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:39:48.232348 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3a06f6ce-947b-4842-8d8d-8cdeff8758c5 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] 10.222.0.27 "GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a" status: 200 len: 1446 microversion: 2.75 time: 0.172152 Sep 08 10:39:48.233355 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 422/832] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:39:48 2022] GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a => generated 1446 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:39:48.428080 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4e4f7c32-f937-4b4b-af4e-e7c59ede575e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:48.439390 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4e4f7c32-f937-4b4b-af4e-e7c59ede575e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/1fc866b1-81ac-4c09-86ab-6d8a4a580294" status: 200 len: 1479 microversion: 2.1 time: 0.618220 Sep 08 10:39:48.442141 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 411/833] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:47 2022] GET /compute/v2.1/servers/1fc866b1-81ac-4c09-86ab-6d8a4a580294 => generated 1479 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:48.444355 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-01a9b4e1-df1b-49b8-acb4-7904a464f303 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:48.445300 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-01a9b4e1-df1b-49b8-acb4-7904a464f303 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:48.456831 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01a9b4e1-df1b-49b8-acb4-7904a464f303 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:48.457828 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01a9b4e1-df1b-49b8-acb4-7904a464f303 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:48.458506 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01a9b4e1-df1b-49b8-acb4-7904a464f303 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:48.460158 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01a9b4e1-df1b-49b8-acb4-7904a464f303 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:48.461129 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01a9b4e1-df1b-49b8-acb4-7904a464f303 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:48.464083 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01a9b4e1-df1b-49b8-acb4-7904a464f303 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:48.465376 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6fbf33d5-fe62-4739-bd2f-5d6caf51dc4e tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Calling method '.version_select at 0x7f68e51361f0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:48.470693 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6fbf33d5-fe62-4739-bd2f-5d6caf51dc4e tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:48.471880 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6fbf33d5-fe62-4739-bd2f-5d6caf51dc4e tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:48.472697 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6fbf33d5-fe62-4739-bd2f-5d6caf51dc4e tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:48.491105 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6fbf33d5-fe62-4739-bd2f-5d6caf51dc4e tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 2307 microversion: 2.1 time: 0.029899 Sep 08 10:39:48.492545 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 412/834] 10.222.0.27 () {58 vars in 1143 bytes} [Thu Sep 8 10:39:48 2022] GET /compute/v2.1/os-migrations => generated 2307 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:39:48.507721 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2d01512e-789c-46d9-93f5-ef0dbbf85452 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:48.508634 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2d01512e-789c-46d9-93f5-ef0dbbf85452 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] [instance: 1fc866b1-81ac-4c09-86ab-6d8a4a580294] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:48.516107 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2d01512e-789c-46d9-93f5-ef0dbbf85452 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:48.516603 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2d01512e-789c-46d9-93f5-ef0dbbf85452 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:48.517253 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2d01512e-789c-46d9-93f5-ef0dbbf85452 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:48.518162 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2d01512e-789c-46d9-93f5-ef0dbbf85452 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:48.518820 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2d01512e-789c-46d9-93f5-ef0dbbf85452 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:48.519407 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2d01512e-789c-46d9-93f5-ef0dbbf85452 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:48.660327 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-01a9b4e1-df1b-49b8-acb4-7904a464f303 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:48.675007 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-01a9b4e1-df1b-49b8-acb4-7904a464f303 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:48.676680 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-01a9b4e1-df1b-49b8-acb4-7904a464f303 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:48.679011 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-01a9b4e1-df1b-49b8-acb4-7904a464f303 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e" status: 200 len: 1408 microversion: 2.25 time: 0.242374 Sep 08 10:39:48.693805 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 423/835] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:39:48 2022] GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e => generated 1408 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:39:48.710224 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-86940746-dcad-4ef5-8a24-2a05e94d464c tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:48.711295 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-86940746-dcad-4ef5-8a24-2a05e94d464c tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 923d2401-f860-4284-a580-37ed478720f6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:48.722777 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-86940746-dcad-4ef5-8a24-2a05e94d464c tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:48.724204 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-86940746-dcad-4ef5-8a24-2a05e94d464c tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:48.726206 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-86940746-dcad-4ef5-8a24-2a05e94d464c tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:48.727722 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-86940746-dcad-4ef5-8a24-2a05e94d464c tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:48.729214 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-86940746-dcad-4ef5-8a24-2a05e94d464c tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:48.730095 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-86940746-dcad-4ef5-8a24-2a05e94d464c tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:49.071185 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2d01512e-789c-46d9-93f5-ef0dbbf85452 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/1fc866b1-81ac-4c09-86ab-6d8a4a580294" status: 200 len: 1632 microversion: 2.1 time: 0.567014 Sep 08 10:39:49.072954 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 413/836] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:48 2022] GET /compute/v2.1/servers/1fc866b1-81ac-4c09-86ab-6d8a4a580294 => generated 1632 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:49.083456 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-38e8ebd3-abce-4a24-84ff-92de44d02336 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:49.084410 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-38e8ebd3-abce-4a24-84ff-92de44d02336 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: c04e1b8c-38c0-44c2-b02d-a6c1ca61d8cb] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:49.098639 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-38e8ebd3-abce-4a24-84ff-92de44d02336 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:49.101645 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-38e8ebd3-abce-4a24-84ff-92de44d02336 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:49.104379 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-38e8ebd3-abce-4a24-84ff-92de44d02336 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:49.106347 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-38e8ebd3-abce-4a24-84ff-92de44d02336 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:49.107351 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-38e8ebd3-abce-4a24-84ff-92de44d02336 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:49.108433 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-38e8ebd3-abce-4a24-84ff-92de44d02336 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:49.167029 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-86940746-dcad-4ef5-8a24-2a05e94d464c tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:49.216044 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-86940746-dcad-4ef5-8a24-2a05e94d464c tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6" status: 200 len: 1472 microversion: 2.1 time: 0.520805 Sep 08 10:39:49.217407 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 424/837] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:48 2022] GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6 => generated 1472 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:49.226853 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d735ce7b-4dc0-4ecc-8f63-51a99f06a7d3 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Action: 'create', calling method: .version_select at 0x7f68e47314c0>, body: {"keypair": {"name": "tempest-keypair-2018570631", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGpVEBTLp5NQj5s8lD2PgYFiEoSP4joAGyd/PkBCs+DOLzwKzdvFSuH+1MdXcTW5rGgFytdEr8QRJNMvW8uZKcDWkRYLFyXvHzUo+okm2pD6Ie30UZddW7UGKUED24WL7Q=="}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:39:49.281374 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-d735ce7b-4dc0-4ecc-8f63-51a99f06a7d3 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Getting quotas for project c7f9807a4eb2473e87377097b0544d0e. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:39:49.311982 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-d735ce7b-4dc0-4ecc-8f63-51a99f06a7d3 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Getting quotas for user 3ecf9924d86b4fd38a6f31430e9d3418 and project c7f9807a4eb2473e87377097b0544d0e. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:39:49.395500 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d735ce7b-4dc0-4ecc-8f63-51a99f06a7d3 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.176512 Sep 08 10:39:49.397221 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 425/838] 10.222.0.27 () {60 vars in 1159 bytes} [Thu Sep 8 10:39:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:39:49.408003 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dda955d0-2067-4d89-be47-6fcaaca7fa73 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:49.409137 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-dda955d0-2067-4d89-be47-6fcaaca7fa73 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] [instance: 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:49.422715 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dda955d0-2067-4d89-be47-6fcaaca7fa73 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:49.423997 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dda955d0-2067-4d89-be47-6fcaaca7fa73 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:49.424917 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dda955d0-2067-4d89-be47-6fcaaca7fa73 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:49.426345 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dda955d0-2067-4d89-be47-6fcaaca7fa73 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:49.427476 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dda955d0-2067-4d89-be47-6fcaaca7fa73 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:49.428391 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dda955d0-2067-4d89-be47-6fcaaca7fa73 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:49.622059 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-dda955d0-2067-4d89-be47-6fcaaca7fa73 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:49.644930 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-dda955d0-2067-4d89-be47-6fcaaca7fa73 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:49.652768 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-dda955d0-2067-4d89-be47-6fcaaca7fa73 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:49.668505 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-dda955d0-2067-4d89-be47-6fcaaca7fa73 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] 10.222.0.27 "GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a" status: 200 len: 1446 microversion: 2.75 time: 0.266451 Sep 08 10:39:49.669898 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 426/839] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:39:49 2022] GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a => generated 1446 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:39:49.678234 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-38e8ebd3-abce-4a24-84ff-92de44d02336 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:49.709393 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9582d0e5-2110-42b6-8886-97875d092742 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:49.710020 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9582d0e5-2110-42b6-8886-97875d092742 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:49.717649 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-38e8ebd3-abce-4a24-84ff-92de44d02336 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/c04e1b8c-38c0-44c2-b02d-a6c1ca61d8cb" status: 200 len: 1316 microversion: 2.1 time: 0.639193 Sep 08 10:39:49.729906 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9582d0e5-2110-42b6-8886-97875d092742 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:49.729906 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9582d0e5-2110-42b6-8886-97875d092742 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:49.729906 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9582d0e5-2110-42b6-8886-97875d092742 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:49.729906 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9582d0e5-2110-42b6-8886-97875d092742 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:49.730591 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9582d0e5-2110-42b6-8886-97875d092742 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:49.730591 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9582d0e5-2110-42b6-8886-97875d092742 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:49.737992 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 414/840] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:49 2022] GET /compute/v2.1/servers/c04e1b8c-38c0-44c2-b02d-a6c1ca61d8cb => generated 1316 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:50.168991 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9582d0e5-2110-42b6-8886-97875d092742 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:50.186332 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9582d0e5-2110-42b6-8886-97875d092742 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:50.189392 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9582d0e5-2110-42b6-8886-97875d092742 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:50.192703 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9582d0e5-2110-42b6-8886-97875d092742 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e" status: 200 len: 1408 microversion: 2.25 time: 0.487536 Sep 08 10:39:50.194289 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 427/841] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:39:49 2022] GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e => generated 1408 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:39:50.261654 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-734a1bb2-3c34-42dd-8b29-2d5e199f6b98 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:50.262619 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-734a1bb2-3c34-42dd-8b29-2d5e199f6b98 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 923d2401-f860-4284-a580-37ed478720f6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:50.277549 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-734a1bb2-3c34-42dd-8b29-2d5e199f6b98 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:50.278060 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-734a1bb2-3c34-42dd-8b29-2d5e199f6b98 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:50.278502 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-734a1bb2-3c34-42dd-8b29-2d5e199f6b98 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:50.279253 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-734a1bb2-3c34-42dd-8b29-2d5e199f6b98 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:50.279721 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-734a1bb2-3c34-42dd-8b29-2d5e199f6b98 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:50.280155 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-734a1bb2-3c34-42dd-8b29-2d5e199f6b98 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:50.705057 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f201058f-af74-4ad7-975d-82b8135c7494 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:50.706031 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f201058f-af74-4ad7-975d-82b8135c7494 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] [instance: 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:50.724982 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f201058f-af74-4ad7-975d-82b8135c7494 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:50.725544 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f201058f-af74-4ad7-975d-82b8135c7494 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:50.725991 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f201058f-af74-4ad7-975d-82b8135c7494 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:50.727283 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f201058f-af74-4ad7-975d-82b8135c7494 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:50.727721 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f201058f-af74-4ad7-975d-82b8135c7494 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:50.729294 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f201058f-af74-4ad7-975d-82b8135c7494 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:50.844729 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f201058f-af74-4ad7-975d-82b8135c7494 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:50.859569 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f201058f-af74-4ad7-975d-82b8135c7494 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:50.862568 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f201058f-af74-4ad7-975d-82b8135c7494 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:50.878096 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f201058f-af74-4ad7-975d-82b8135c7494 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] 10.222.0.27 "GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a" status: 200 len: 1446 microversion: 2.75 time: 0.173945 Sep 08 10:39:50.893573 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 428/842] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:39:50 2022] GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a => generated 1446 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:39:50.904950 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c3f2b91a-b851-4512-b46c-631b78b5ec21 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:50.905998 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c3f2b91a-b851-4512-b46c-631b78b5ec21 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: c04e1b8c-38c0-44c2-b02d-a6c1ca61d8cb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:50.921643 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c3f2b91a-b851-4512-b46c-631b78b5ec21 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:50.922457 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c3f2b91a-b851-4512-b46c-631b78b5ec21 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:50.922628 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c3f2b91a-b851-4512-b46c-631b78b5ec21 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:50.923464 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c3f2b91a-b851-4512-b46c-631b78b5ec21 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:50.924023 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c3f2b91a-b851-4512-b46c-631b78b5ec21 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:50.924531 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c3f2b91a-b851-4512-b46c-631b78b5ec21 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:51.246025 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c3f2b91a-b851-4512-b46c-631b78b5ec21 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:51.266062 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c3f2b91a-b851-4512-b46c-631b78b5ec21 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/c04e1b8c-38c0-44c2-b02d-a6c1ca61d8cb" status: 200 len: 1316 microversion: 2.1 time: 0.370194 Sep 08 10:39:51.277635 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 429/843] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:50 2022] GET /compute/v2.1/servers/c04e1b8c-38c0-44c2-b02d-a6c1ca61d8cb => generated 1316 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:51.296036 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8add6fb8-9b06-4c90-8dfa-c9c6a6b00016 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:51.296889 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8add6fb8-9b06-4c90-8dfa-c9c6a6b00016 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] [instance: 1a01253b-8ff8-44d9-961b-1b91de83d671] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:51.304370 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8add6fb8-9b06-4c90-8dfa-c9c6a6b00016 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:51.305254 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8add6fb8-9b06-4c90-8dfa-c9c6a6b00016 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:51.306131 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8add6fb8-9b06-4c90-8dfa-c9c6a6b00016 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:51.307361 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8add6fb8-9b06-4c90-8dfa-c9c6a6b00016 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:51.309269 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8add6fb8-9b06-4c90-8dfa-c9c6a6b00016 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:51.310042 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8add6fb8-9b06-4c90-8dfa-c9c6a6b00016 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:51.343469 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:39:51.358325 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8add6fb8-9b06-4c90-8dfa-c9c6a6b00016 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] [instance: 1a01253b-8ff8-44d9-961b-1b91de83d671] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:39:51.440552 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-734a1bb2-3c34-42dd-8b29-2d5e199f6b98 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:51.453153 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-734a1bb2-3c34-42dd-8b29-2d5e199f6b98 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6" status: 200 len: 1472 microversion: 2.1 time: 1.197050 Sep 08 10:39:51.455109 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 415/844] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:50 2022] GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6 => generated 1472 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:51.463492 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9e22fa80-ee12-4e1e-b16f-513db97ebd27 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:51.464833 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9e22fa80-ee12-4e1e-b16f-513db97ebd27 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:51.484283 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e22fa80-ee12-4e1e-b16f-513db97ebd27 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:51.485319 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e22fa80-ee12-4e1e-b16f-513db97ebd27 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:51.486199 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e22fa80-ee12-4e1e-b16f-513db97ebd27 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:51.487853 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e22fa80-ee12-4e1e-b16f-513db97ebd27 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:51.488771 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e22fa80-ee12-4e1e-b16f-513db97ebd27 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:51.489644 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e22fa80-ee12-4e1e-b16f-513db97ebd27 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:51.589091 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8add6fb8-9b06-4c90-8dfa-c9c6a6b00016 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1a01253b-8ff8-44d9-961b-1b91de83d671" status: 204 len: 0 microversion: 2.1 time: 0.298825 Sep 08 10:39:51.590387 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 430/845] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:39:51 2022] DELETE /compute/v2.1/servers/1a01253b-8ff8-44d9-961b-1b91de83d671 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:39:51.600494 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-60d2db92-6c46-4fc8-b1ea-091c45e8c070 req-b4cd8c6c-0f45-44e1-a799-415423730eb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c04e1b8c-38c0-44c2-b02d-a6c1ca61d8cb", "name": "network-vif-plugged", "status": "completed", "tag": "a06cc3a1-f52a-4dfc-aee6-7025a0d03093"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:39:51.619755 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-60d2db92-6c46-4fc8-b1ea-091c45e8c070 req-b4cd8c6c-0f45-44e1-a799-415423730eb0 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:51.620846 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-60d2db92-6c46-4fc8-b1ea-091c45e8c070 req-b4cd8c6c-0f45-44e1-a799-415423730eb0 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:51.621992 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-60d2db92-6c46-4fc8-b1ea-091c45e8c070 req-b4cd8c6c-0f45-44e1-a799-415423730eb0 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:51.673553 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-60d2db92-6c46-4fc8-b1ea-091c45e8c070 req-b4cd8c6c-0f45-44e1-a799-415423730eb0 service nova] Creating event network-vif-plugged:a06cc3a1-f52a-4dfc-aee6-7025a0d03093 for instance c04e1b8c-38c0-44c2-b02d-a6c1ca61d8cb on n-h1-850501-12 Sep 08 10:39:51.699663 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-60d2db92-6c46-4fc8-b1ea-091c45e8c070 req-b4cd8c6c-0f45-44e1-a799-415423730eb0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107234 Sep 08 10:39:51.700857 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 431/846] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:39:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:39:51.930666 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3a6a7147-10e5-4591-97a9-bedc48a5cef7 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:51.932788 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3a6a7147-10e5-4591-97a9-bedc48a5cef7 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] [instance: 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:51.955624 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a6a7147-10e5-4591-97a9-bedc48a5cef7 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:51.956741 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a6a7147-10e5-4591-97a9-bedc48a5cef7 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:51.961333 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a6a7147-10e5-4591-97a9-bedc48a5cef7 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:51.963606 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a6a7147-10e5-4591-97a9-bedc48a5cef7 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:51.966730 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a6a7147-10e5-4591-97a9-bedc48a5cef7 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:51.967128 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a6a7147-10e5-4591-97a9-bedc48a5cef7 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:52.185663 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9e22fa80-ee12-4e1e-b16f-513db97ebd27 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:52.217335 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9e22fa80-ee12-4e1e-b16f-513db97ebd27 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:52.221536 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9e22fa80-ee12-4e1e-b16f-513db97ebd27 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:52.230665 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9e22fa80-ee12-4e1e-b16f-513db97ebd27 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e" status: 200 len: 1408 microversion: 2.25 time: 0.772603 Sep 08 10:39:52.238800 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 416/847] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:39:51 2022] GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e => generated 1408 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:39:52.258764 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0a02b76a-bad1-4211-9f19-7e130b3b1ff6 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1968828688", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "528789528", "adminPass": "***", "networks": [{"uuid": "88216a69-baf8-4ec5-b0a7-24191ec4e581"}], "security_groups": [{"name": "tempest-securitygroup--818077460"}], "key_name": "tempest-keypair-1011037597", "user_data": "}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:39:52.720564 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-0a02b76a-bad1-4211-9f19-7e130b3b1ff6 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] validate_networks() for [('88216a69-baf8-4ec5-b0a7-24191ec4e581', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:39:52.763393 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3a6a7147-10e5-4591-97a9-bedc48a5cef7 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:52.778010 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3a6a7147-10e5-4591-97a9-bedc48a5cef7 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:52.780652 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3a6a7147-10e5-4591-97a9-bedc48a5cef7 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:52.797310 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3a6a7147-10e5-4591-97a9-bedc48a5cef7 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] 10.222.0.27 "GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a" status: 200 len: 1446 microversion: 2.75 time: 0.878042 Sep 08 10:39:52.807003 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 432/848] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:39:51 2022] GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a => generated 1446 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:39:52.821104 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b440dfb5-e50c-4ef1-9556-d8bc165ed171 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:52.826656 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b440dfb5-e50c-4ef1-9556-d8bc165ed171 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: c04e1b8c-38c0-44c2-b02d-a6c1ca61d8cb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:52.846088 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b440dfb5-e50c-4ef1-9556-d8bc165ed171 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:52.846896 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b440dfb5-e50c-4ef1-9556-d8bc165ed171 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:52.847498 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b440dfb5-e50c-4ef1-9556-d8bc165ed171 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:52.848436 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b440dfb5-e50c-4ef1-9556-d8bc165ed171 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:52.849103 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b440dfb5-e50c-4ef1-9556-d8bc165ed171 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:52.849701 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b440dfb5-e50c-4ef1-9556-d8bc165ed171 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:53.244928 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b440dfb5-e50c-4ef1-9556-d8bc165ed171 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:53.266099 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b440dfb5-e50c-4ef1-9556-d8bc165ed171 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/c04e1b8c-38c0-44c2-b02d-a6c1ca61d8cb" status: 200 len: 1316 microversion: 2.1 time: 0.455753 Sep 08 10:39:53.269214 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 433/849] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:52 2022] GET /compute/v2.1/servers/c04e1b8c-38c0-44c2-b02d-a6c1ca61d8cb => generated 1316 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:53.276697 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-57f78c89-255a-4e85-b7d2-cbc3761674ee tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:53.277352 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-57f78c89-255a-4e85-b7d2-cbc3761674ee tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 923d2401-f860-4284-a580-37ed478720f6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:53.303052 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-57f78c89-255a-4e85-b7d2-cbc3761674ee tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:53.303593 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-57f78c89-255a-4e85-b7d2-cbc3761674ee tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:53.304045 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-57f78c89-255a-4e85-b7d2-cbc3761674ee tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:53.305328 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-57f78c89-255a-4e85-b7d2-cbc3761674ee tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:53.306750 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-57f78c89-255a-4e85-b7d2-cbc3761674ee tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:53.307584 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-57f78c89-255a-4e85-b7d2-cbc3761674ee tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:53.738482 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-57f78c89-255a-4e85-b7d2-cbc3761674ee tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:53.754464 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-57f78c89-255a-4e85-b7d2-cbc3761674ee tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6" status: 200 len: 1472 microversion: 2.1 time: 0.483853 Sep 08 10:39:53.763741 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 434/850] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:53 2022] GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6 => generated 1472 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:53.780567 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dc8d131a-6494-4d6d-8b9d-a3ec9a26efa2 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:53.785880 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-dc8d131a-6494-4d6d-8b9d-a3ec9a26efa2 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:53.807562 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dc8d131a-6494-4d6d-8b9d-a3ec9a26efa2 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:53.811741 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dc8d131a-6494-4d6d-8b9d-a3ec9a26efa2 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:53.812513 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dc8d131a-6494-4d6d-8b9d-a3ec9a26efa2 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:53.815097 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dc8d131a-6494-4d6d-8b9d-a3ec9a26efa2 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:53.815773 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dc8d131a-6494-4d6d-8b9d-a3ec9a26efa2 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:53.817266 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dc8d131a-6494-4d6d-8b9d-a3ec9a26efa2 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:54.212270 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-dc8d131a-6494-4d6d-8b9d-a3ec9a26efa2 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:54.234934 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-dc8d131a-6494-4d6d-8b9d-a3ec9a26efa2 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:54.237603 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-dc8d131a-6494-4d6d-8b9d-a3ec9a26efa2 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:54.239051 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-dc8d131a-6494-4d6d-8b9d-a3ec9a26efa2 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e" status: 200 len: 1604 microversion: 2.25 time: 0.472927 Sep 08 10:39:54.240552 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 435/851] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:39:53 2022] GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e => generated 1604 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:39:54.248007 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d8c59514-2bd4-4e17-9c9d-b7cee9ad728d tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:54.248857 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d8c59514-2bd4-4e17-9c9d-b7cee9ad728d tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] [instance: 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:54.257525 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d8c59514-2bd4-4e17-9c9d-b7cee9ad728d tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:54.259066 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d8c59514-2bd4-4e17-9c9d-b7cee9ad728d tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:54.260204 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d8c59514-2bd4-4e17-9c9d-b7cee9ad728d tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:54.261206 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d8c59514-2bd4-4e17-9c9d-b7cee9ad728d tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:54.261843 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d8c59514-2bd4-4e17-9c9d-b7cee9ad728d tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:54.262431 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d8c59514-2bd4-4e17-9c9d-b7cee9ad728d tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:54.441917 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d8c59514-2bd4-4e17-9c9d-b7cee9ad728d tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:54.467701 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d8c59514-2bd4-4e17-9c9d-b7cee9ad728d tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:54.469501 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d8c59514-2bd4-4e17-9c9d-b7cee9ad728d tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:54.490498 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d8c59514-2bd4-4e17-9c9d-b7cee9ad728d tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] 10.222.0.27 "GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a" status: 200 len: 1464 microversion: 2.75 time: 0.248195 Sep 08 10:39:54.517798 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 436/852] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:39:54 2022] GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a => generated 1464 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:39:54.550938 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-66be7972-4b82-4719-a25f-717998fad2d8 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:54.550938 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-66be7972-4b82-4719-a25f-717998fad2d8 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:54.561180 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-66be7972-4b82-4719-a25f-717998fad2d8 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:54.561693 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-66be7972-4b82-4719-a25f-717998fad2d8 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:54.562139 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-66be7972-4b82-4719-a25f-717998fad2d8 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:54.562867 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-66be7972-4b82-4719-a25f-717998fad2d8 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:54.563336 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-66be7972-4b82-4719-a25f-717998fad2d8 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:54.564107 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-66be7972-4b82-4719-a25f-717998fad2d8 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:54.796751 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-0a02b76a-bad1-4211-9f19-7e130b3b1ff6 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:39:54.798902 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-0a02b76a-bad1-4211-9f19-7e130b3b1ff6 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:39:54.800188 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-0a02b76a-bad1-4211-9f19-7e130b3b1ff6 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:39:54.801362 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-0a02b76a-bad1-4211-9f19-7e130b3b1ff6 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:39:54.802485 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-0a02b76a-bad1-4211-9f19-7e130b3b1ff6 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:39:54.817986 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0a02b76a-bad1-4211-9f19-7e130b3b1ff6 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:54.819127 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0a02b76a-bad1-4211-9f19-7e130b3b1ff6 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:54.819927 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0a02b76a-bad1-4211-9f19-7e130b3b1ff6 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:54.820978 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0a02b76a-bad1-4211-9f19-7e130b3b1ff6 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:54.821795 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0a02b76a-bad1-4211-9f19-7e130b3b1ff6 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:54.822474 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0a02b76a-bad1-4211-9f19-7e130b3b1ff6 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:54.857446 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-0a02b76a-bad1-4211-9f19-7e130b3b1ff6 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Getting quotas for project de5388c25cdb4a35ae8d58fa5b6cf125. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:39:54.875133 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-0a02b76a-bad1-4211-9f19-7e130b3b1ff6 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Getting quotas for user 6e4cde361139445eb147c4f634ec663f and project de5388c25cdb4a35ae8d58fa5b6cf125. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:39:54.890142 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-66be7972-4b82-4719-a25f-717998fad2d8 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.370210 Sep 08 10:39:54.892011 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 437/853] 10.222.0.27 () {60 vars in 1316 bytes} [Thu Sep 8 10:39:54 2022] GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e/os-interface => generated 284 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:39:54.905895 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0f58ac6c-f90a-44b1-b6b8-9dc99de1dc07 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:54.910125 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0f58ac6c-f90a-44b1-b6b8-9dc99de1dc07 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: c04e1b8c-38c0-44c2-b02d-a6c1ca61d8cb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:54.924372 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f58ac6c-f90a-44b1-b6b8-9dc99de1dc07 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:54.928447 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f58ac6c-f90a-44b1-b6b8-9dc99de1dc07 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:54.929216 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f58ac6c-f90a-44b1-b6b8-9dc99de1dc07 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:54.930213 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f58ac6c-f90a-44b1-b6b8-9dc99de1dc07 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:54.934237 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f58ac6c-f90a-44b1-b6b8-9dc99de1dc07 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:54.934974 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f58ac6c-f90a-44b1-b6b8-9dc99de1dc07 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:54.947328 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0a02b76a-bad1-4211-9f19-7e130b3b1ff6 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:39:54.962976 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0a02b76a-bad1-4211-9f19-7e130b3b1ff6 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] [instance: 7dac6a5f-62eb-4c60-8904-f23e50e1dcc8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:39:55.109346 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0a02b76a-bad1-4211-9f19-7e130b3b1ff6 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.868065 Sep 08 10:39:55.110745 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 417/854] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:39:52 2022] POST /compute/v2.1/servers => generated 401 bytes in 2871 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:39:55.117887 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9125d1fa-2ed8-4257-9ed6-b71f5be02bd8 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1722022557", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "15b153a9-4f79-4605-9c99-0d83878931cf"}], "security_groups": [{"name": "tempest-securitygroup--2101014986"}], "key_name": "tempest-keypair-2018570631", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:39:55.524869 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0f58ac6c-f90a-44b1-b6b8-9dc99de1dc07 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:55.539165 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0f58ac6c-f90a-44b1-b6b8-9dc99de1dc07 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/c04e1b8c-38c0-44c2-b02d-a6c1ca61d8cb" status: 200 len: 1316 microversion: 2.1 time: 0.645503 Sep 08 10:39:55.540586 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 438/855] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:54 2022] GET /compute/v2.1/servers/c04e1b8c-38c0-44c2-b02d-a6c1ca61d8cb => generated 1316 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:55.554400 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7a05ef65-a836-4370-a0ba-1c119e09c6d2 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:55.555504 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7a05ef65-a836-4370-a0ba-1c119e09c6d2 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 923d2401-f860-4284-a580-37ed478720f6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:55.570457 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7a05ef65-a836-4370-a0ba-1c119e09c6d2 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:55.571089 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7a05ef65-a836-4370-a0ba-1c119e09c6d2 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:55.572728 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7a05ef65-a836-4370-a0ba-1c119e09c6d2 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:55.574625 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7a05ef65-a836-4370-a0ba-1c119e09c6d2 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:55.575148 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7a05ef65-a836-4370-a0ba-1c119e09c6d2 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:55.575602 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7a05ef65-a836-4370-a0ba-1c119e09c6d2 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:55.576834 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-9125d1fa-2ed8-4257-9ed6-b71f5be02bd8 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] validate_networks() for [('15b153a9-4f79-4605-9c99-0d83878931cf', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:39:56.057899 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7a05ef65-a836-4370-a0ba-1c119e09c6d2 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:56.073465 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7a05ef65-a836-4370-a0ba-1c119e09c6d2 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6" status: 200 len: 1472 microversion: 2.1 time: 0.530962 Sep 08 10:39:56.098408 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 439/856] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:55 2022] GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6 => generated 1472 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:56.126531 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-71beb738-6273-4b27-bee0-3d8941c5dbe4 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:56.127680 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-71beb738-6273-4b27-bee0-3d8941c5dbe4 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] [instance: 7dac6a5f-62eb-4c60-8904-f23e50e1dcc8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:56.158309 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71beb738-6273-4b27-bee0-3d8941c5dbe4 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:56.159696 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71beb738-6273-4b27-bee0-3d8941c5dbe4 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:56.160953 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71beb738-6273-4b27-bee0-3d8941c5dbe4 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:56.162683 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71beb738-6273-4b27-bee0-3d8941c5dbe4 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:56.163955 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71beb738-6273-4b27-bee0-3d8941c5dbe4 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:56.165920 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71beb738-6273-4b27-bee0-3d8941c5dbe4 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:56.391162 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-71beb738-6273-4b27-bee0-3d8941c5dbe4 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4cde361139445eb147c4f634ec663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5388c25cdb4a35ae8d58fa5b6cf125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:56.419961 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-71beb738-6273-4b27-bee0-3d8941c5dbe4 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] 10.222.0.27 "GET /compute/v2.1/servers/7dac6a5f-62eb-4c60-8904-f23e50e1dcc8" status: 200 len: 1267 microversion: 2.1 time: 0.318188 Sep 08 10:39:56.421617 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 440/857] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:56 2022] GET /compute/v2.1/servers/7dac6a5f-62eb-4c60-8904-f23e50e1dcc8 => generated 1267 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:56.433307 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7f9353cb-b513-4786-93bc-cd6fdb39a38d tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:56.434592 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7f9353cb-b513-4786-93bc-cd6fdb39a38d tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] [instance: 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:56.455252 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f9353cb-b513-4786-93bc-cd6fdb39a38d tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:56.456608 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f9353cb-b513-4786-93bc-cd6fdb39a38d tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:56.457782 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f9353cb-b513-4786-93bc-cd6fdb39a38d tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:56.459303 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f9353cb-b513-4786-93bc-cd6fdb39a38d tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:56.460488 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f9353cb-b513-4786-93bc-cd6fdb39a38d tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:56.461552 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f9353cb-b513-4786-93bc-cd6fdb39a38d tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:56.664822 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7f9353cb-b513-4786-93bc-cd6fdb39a38d tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:56.724258 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7f9353cb-b513-4786-93bc-cd6fdb39a38d tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:56.728856 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7f9353cb-b513-4786-93bc-cd6fdb39a38d tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:56.751383 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7f9353cb-b513-4786-93bc-cd6fdb39a38d tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] 10.222.0.27 "GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a" status: 200 len: 1452 microversion: 2.75 time: 0.322121 Sep 08 10:39:56.752695 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 441/858] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:39:56 2022] GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a => generated 1452 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:39:56.758126 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e400ab00-cedc-408c-81f5-fe11c10d6d3f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:56.759231 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e400ab00-cedc-408c-81f5-fe11c10d6d3f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: c04e1b8c-38c0-44c2-b02d-a6c1ca61d8cb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:56.766160 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e400ab00-cedc-408c-81f5-fe11c10d6d3f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:56.766982 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e400ab00-cedc-408c-81f5-fe11c10d6d3f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:56.767842 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e400ab00-cedc-408c-81f5-fe11c10d6d3f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:56.769449 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e400ab00-cedc-408c-81f5-fe11c10d6d3f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:56.770534 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e400ab00-cedc-408c-81f5-fe11c10d6d3f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:56.771501 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e400ab00-cedc-408c-81f5-fe11c10d6d3f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:57.464944 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e400ab00-cedc-408c-81f5-fe11c10d6d3f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:57.487230 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e400ab00-cedc-408c-81f5-fe11c10d6d3f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/c04e1b8c-38c0-44c2-b02d-a6c1ca61d8cb" status: 200 len: 1466 microversion: 2.1 time: 0.732854 Sep 08 10:39:57.488094 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 442/859] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:56 2022] GET /compute/v2.1/servers/c04e1b8c-38c0-44c2-b02d-a6c1ca61d8cb => generated 1466 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:57.493814 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-57246447-9f82-4b24-9318-1eca0c068f89 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:57.494624 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-57246447-9f82-4b24-9318-1eca0c068f89 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 923d2401-f860-4284-a580-37ed478720f6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:57.501580 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-57246447-9f82-4b24-9318-1eca0c068f89 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:57.502292 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-57246447-9f82-4b24-9318-1eca0c068f89 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:57.502902 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-57246447-9f82-4b24-9318-1eca0c068f89 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:57.503820 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-57246447-9f82-4b24-9318-1eca0c068f89 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:57.504430 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-57246447-9f82-4b24-9318-1eca0c068f89 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:57.505008 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-57246447-9f82-4b24-9318-1eca0c068f89 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:57.704885 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-9125d1fa-2ed8-4257-9ed6-b71f5be02bd8 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:39:57.705559 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-9125d1fa-2ed8-4257-9ed6-b71f5be02bd8 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:39:57.705903 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-9125d1fa-2ed8-4257-9ed6-b71f5be02bd8 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:39:57.706616 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-9125d1fa-2ed8-4257-9ed6-b71f5be02bd8 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:39:57.707231 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-9125d1fa-2ed8-4257-9ed6-b71f5be02bd8 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:39:57.735928 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9125d1fa-2ed8-4257-9ed6-b71f5be02bd8 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:57.741372 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9125d1fa-2ed8-4257-9ed6-b71f5be02bd8 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:57.744631 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9125d1fa-2ed8-4257-9ed6-b71f5be02bd8 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:57.751554 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9125d1fa-2ed8-4257-9ed6-b71f5be02bd8 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:57.760404 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9125d1fa-2ed8-4257-9ed6-b71f5be02bd8 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:57.762471 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9125d1fa-2ed8-4257-9ed6-b71f5be02bd8 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:57.834227 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-9125d1fa-2ed8-4257-9ed6-b71f5be02bd8 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Getting quotas for project c7f9807a4eb2473e87377097b0544d0e. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:39:57.868872 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-9125d1fa-2ed8-4257-9ed6-b71f5be02bd8 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Getting quotas for user 3ecf9924d86b4fd38a6f31430e9d3418 and project c7f9807a4eb2473e87377097b0544d0e. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:39:57.910791 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9125d1fa-2ed8-4257-9ed6-b71f5be02bd8 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:39:57.913459 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9125d1fa-2ed8-4257-9ed6-b71f5be02bd8 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 133a5f12-39e5-4e0f-81dc-b1948c073f15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:39:58.043471 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9125d1fa-2ed8-4257-9ed6-b71f5be02bd8 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.929774 Sep 08 10:39:58.045450 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 418/860] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:39:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 2934 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:39:58.055243 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-3877d215-fbe9-4e98-a9c1-745afe38e843 req-d97956a8-f108-496f-b2c3-0dc31f1403a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a01253b-8ff8-44d9-961b-1b91de83d671", "name": "network-vif-unplugged", "status": "completed", "tag": "65a6d6d7-af12-4f90-9ea8-61dc9032943b"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:39:58.070556 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:39:58.075530 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-3877d215-fbe9-4e98-a9c1-745afe38e843 req-d97956a8-f108-496f-b2c3-0dc31f1403a3 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:58.076326 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-3877d215-fbe9-4e98-a9c1-745afe38e843 req-d97956a8-f108-496f-b2c3-0dc31f1403a3 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:58.076919 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-3877d215-fbe9-4e98-a9c1-745afe38e843 req-d97956a8-f108-496f-b2c3-0dc31f1403a3 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:58.103266 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-3877d215-fbe9-4e98-a9c1-745afe38e843 req-d97956a8-f108-496f-b2c3-0dc31f1403a3 service nova] Creating event network-vif-unplugged:65a6d6d7-af12-4f90-9ea8-61dc9032943b for instance 1a01253b-8ff8-44d9-961b-1b91de83d671 on n-h2-850501-12 Sep 08 10:39:58.121063 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-3877d215-fbe9-4e98-a9c1-745afe38e843 req-d97956a8-f108-496f-b2c3-0dc31f1403a3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073349 Sep 08 10:39:58.122456 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 419/861] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:39:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:39:58.128399 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f4a63e90-1d8c-4046-83b8-930999715056 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:58.129590 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f4a63e90-1d8c-4046-83b8-930999715056 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] [instance: 7dac6a5f-62eb-4c60-8904-f23e50e1dcc8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:58.139163 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f4a63e90-1d8c-4046-83b8-930999715056 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:58.140099 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f4a63e90-1d8c-4046-83b8-930999715056 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:58.140942 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f4a63e90-1d8c-4046-83b8-930999715056 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:58.141945 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f4a63e90-1d8c-4046-83b8-930999715056 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:58.142627 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f4a63e90-1d8c-4046-83b8-930999715056 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:58.143304 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f4a63e90-1d8c-4046-83b8-930999715056 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:58.287246 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-57246447-9f82-4b24-9318-1eca0c068f89 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:58.330389 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-57246447-9f82-4b24-9318-1eca0c068f89 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6" status: 200 len: 1477 microversion: 2.1 time: 0.840157 Sep 08 10:39:58.334213 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 443/862] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:57 2022] GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6 => generated 1477 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:58.365155 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5af7d07f-f2d6-4ad5-87bf-205b08ab5bcf tempest-ServersOnMultiNodesTest-60601867 tempest-ServersOnMultiNodesTest-60601867-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:58.370516 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5af7d07f-f2d6-4ad5-87bf-205b08ab5bcf tempest-ServersOnMultiNodesTest-60601867 tempest-ServersOnMultiNodesTest-60601867-project-admin] [instance: c04e1b8c-38c0-44c2-b02d-a6c1ca61d8cb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:58.412018 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5af7d07f-f2d6-4ad5-87bf-205b08ab5bcf tempest-ServersOnMultiNodesTest-60601867 tempest-ServersOnMultiNodesTest-60601867-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:58.413264 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5af7d07f-f2d6-4ad5-87bf-205b08ab5bcf tempest-ServersOnMultiNodesTest-60601867 tempest-ServersOnMultiNodesTest-60601867-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:58.421502 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5af7d07f-f2d6-4ad5-87bf-205b08ab5bcf tempest-ServersOnMultiNodesTest-60601867 tempest-ServersOnMultiNodesTest-60601867-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:58.424132 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5af7d07f-f2d6-4ad5-87bf-205b08ab5bcf tempest-ServersOnMultiNodesTest-60601867 tempest-ServersOnMultiNodesTest-60601867-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:58.425216 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5af7d07f-f2d6-4ad5-87bf-205b08ab5bcf tempest-ServersOnMultiNodesTest-60601867 tempest-ServersOnMultiNodesTest-60601867-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:58.432878 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5af7d07f-f2d6-4ad5-87bf-205b08ab5bcf tempest-ServersOnMultiNodesTest-60601867 tempest-ServersOnMultiNodesTest-60601867-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:58.764030 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f4a63e90-1d8c-4046-83b8-930999715056 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4cde361139445eb147c4f634ec663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5388c25cdb4a35ae8d58fa5b6cf125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:58.808142 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f4a63e90-1d8c-4046-83b8-930999715056 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] 10.222.0.27 "GET /compute/v2.1/servers/7dac6a5f-62eb-4c60-8904-f23e50e1dcc8" status: 200 len: 1323 microversion: 2.1 time: 0.683849 Sep 08 10:39:58.829071 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 420/863] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:58 2022] GET /compute/v2.1/servers/7dac6a5f-62eb-4c60-8904-f23e50e1dcc8 => generated 1323 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:58.858559 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9f671409-16ab-43d2-8993-8d680ccdd4b4 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:58.862434 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9f671409-16ab-43d2-8993-8d680ccdd4b4 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] [instance: 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:58.887343 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f671409-16ab-43d2-8993-8d680ccdd4b4 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:58.888460 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f671409-16ab-43d2-8993-8d680ccdd4b4 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:58.889613 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f671409-16ab-43d2-8993-8d680ccdd4b4 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:58.891446 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f671409-16ab-43d2-8993-8d680ccdd4b4 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:58.893004 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f671409-16ab-43d2-8993-8d680ccdd4b4 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:58.894202 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f671409-16ab-43d2-8993-8d680ccdd4b4 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:58.921344 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5af7d07f-f2d6-4ad5-87bf-205b08ab5bcf tempest-ServersOnMultiNodesTest-60601867 tempest-ServersOnMultiNodesTest-60601867-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/c04e1b8c-38c0-44c2-b02d-a6c1ca61d8cb" status: 200 len: 1619 microversion: 2.1 time: 0.581674 Sep 08 10:39:58.927643 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 444/864] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:58 2022] GET /compute/v2.1/servers/c04e1b8c-38c0-44c2-b02d-a6c1ca61d8cb => generated 1619 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:58.941599 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d74f76a1-be89-4b1c-b248-87a120670703 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:58.943794 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d74f76a1-be89-4b1c-b248-87a120670703 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 133a5f12-39e5-4e0f-81dc-b1948c073f15] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:59.169498 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d74f76a1-be89-4b1c-b248-87a120670703 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:59.180140 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d74f76a1-be89-4b1c-b248-87a120670703 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15" status: 200 len: 1235 microversion: 2.1 time: 0.250290 Sep 08 10:39:59.181325 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 445/865] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:58 2022] GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15 => generated 1235 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:59.190363 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-0c5a8654-958d-431b-adf5-209693f71e55 req-47a57df7-2b80-4b88-87ac-6b14c84a5bf1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e", "tag": "1db6620e-f793-4486-a97c-149109663837"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:39:59.217343 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-0c5a8654-958d-431b-adf5-209693f71e55 req-47a57df7-2b80-4b88-87ac-6b14c84a5bf1 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:59.218346 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-0c5a8654-958d-431b-adf5-209693f71e55 req-47a57df7-2b80-4b88-87ac-6b14c84a5bf1 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:59.219074 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-0c5a8654-958d-431b-adf5-209693f71e55 req-47a57df7-2b80-4b88-87ac-6b14c84a5bf1 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:59.245714 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-0c5a8654-958d-431b-adf5-209693f71e55 req-47a57df7-2b80-4b88-87ac-6b14c84a5bf1 service nova] Creating event network-changed:1db6620e-f793-4486-a97c-149109663837 for instance 4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e on n-h1-850501-12 Sep 08 10:39:59.259131 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-0c5a8654-958d-431b-adf5-209693f71e55 req-47a57df7-2b80-4b88-87ac-6b14c84a5bf1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076250 Sep 08 10:39:59.261909 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 446/866] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:39:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:39:59.363454 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5e1569cb-17bb-4806-92c6-681ae281a033 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:59.364542 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5e1569cb-17bb-4806-92c6-681ae281a033 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 923d2401-f860-4284-a580-37ed478720f6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:59.381712 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5e1569cb-17bb-4806-92c6-681ae281a033 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:59.382219 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5e1569cb-17bb-4806-92c6-681ae281a033 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:59.382657 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5e1569cb-17bb-4806-92c6-681ae281a033 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:59.383377 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5e1569cb-17bb-4806-92c6-681ae281a033 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:59.384548 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5e1569cb-17bb-4806-92c6-681ae281a033 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:59.385059 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5e1569cb-17bb-4806-92c6-681ae281a033 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:59.557557 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9f671409-16ab-43d2-8993-8d680ccdd4b4 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:59.594923 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9f671409-16ab-43d2-8993-8d680ccdd4b4 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:59.604815 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9f671409-16ab-43d2-8993-8d680ccdd4b4 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:59.631574 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9f671409-16ab-43d2-8993-8d680ccdd4b4 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] 10.222.0.27 "GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a" status: 200 len: 1437 microversion: 2.75 time: 0.797740 Sep 08 10:39:59.636112 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 421/867] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:39:58 2022] GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a => generated 1437 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:39:59.665782 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5ecf9599-bf37-466c-86e9-84b1697e0e82 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1459271132", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "a3147437-e6f2-480d-bcaf-cc0f030d497d"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:39:59.905581 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-5ecf9599-bf37-466c-86e9-84b1697e0e82 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] validate_networks() for None {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:40:00.224597 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5e1569cb-17bb-4806-92c6-681ae281a033 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:00.263043 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5e1569cb-17bb-4806-92c6-681ae281a033 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6" status: 200 len: 1477 microversion: 2.1 time: 0.903740 Sep 08 10:40:00.270062 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 447/868] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:59 2022] GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6 => generated 1477 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:40:01.162250 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e343a836-7999-4eb2-85db-3ead483802d7 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:40:01.183686 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e343a836-7999-4eb2-85db-3ead483802d7 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] [instance: 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:01.229288 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e343a836-7999-4eb2-85db-3ead483802d7 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:01.235242 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e343a836-7999-4eb2-85db-3ead483802d7 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:01.236305 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e343a836-7999-4eb2-85db-3ead483802d7 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:01.242101 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e343a836-7999-4eb2-85db-3ead483802d7 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:01.246469 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e343a836-7999-4eb2-85db-3ead483802d7 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:01.249550 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e343a836-7999-4eb2-85db-3ead483802d7 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:01.277147 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:40:01.578367 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-e343a836-7999-4eb2-85db-3ead483802d7 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:40:01.580340 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-e343a836-7999-4eb2-85db-3ead483802d7 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:40:01.582015 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-e343a836-7999-4eb2-85db-3ead483802d7 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:40:01.583462 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-e343a836-7999-4eb2-85db-3ead483802d7 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:40:01.587867 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-e343a836-7999-4eb2-85db-3ead483802d7 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:40:01.839144 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e343a836-7999-4eb2-85db-3ead483802d7 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] [instance: 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:01.885996 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e343a836-7999-4eb2-85db-3ead483802d7 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:01.886945 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e343a836-7999-4eb2-85db-3ead483802d7 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:01.887764 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e343a836-7999-4eb2-85db-3ead483802d7 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:01.888548 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e343a836-7999-4eb2-85db-3ead483802d7 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:01.889050 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e343a836-7999-4eb2-85db-3ead483802d7 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:01.889485 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e343a836-7999-4eb2-85db-3ead483802d7 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:01.911080 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-5ecf9599-bf37-466c-86e9-84b1697e0e82 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:40:01.912837 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-5ecf9599-bf37-466c-86e9-84b1697e0e82 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:40:01.914381 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-5ecf9599-bf37-466c-86e9-84b1697e0e82 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:40:01.917317 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-5ecf9599-bf37-466c-86e9-84b1697e0e82 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:40:01.921273 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-5ecf9599-bf37-466c-86e9-84b1697e0e82 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:40:01.939084 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5ecf9599-bf37-466c-86e9-84b1697e0e82 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:01.939902 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5ecf9599-bf37-466c-86e9-84b1697e0e82 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:01.942966 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5ecf9599-bf37-466c-86e9-84b1697e0e82 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:01.944226 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5ecf9599-bf37-466c-86e9-84b1697e0e82 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:01.945274 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5ecf9599-bf37-466c-86e9-84b1697e0e82 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:01.947058 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5ecf9599-bf37-466c-86e9-84b1697e0e82 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:01.972090 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-5ecf9599-bf37-466c-86e9-84b1697e0e82 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Getting quotas for project 2a3d4a2ec8674e418602b6dc0cec6ab9. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:40:01.981190 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-5ecf9599-bf37-466c-86e9-84b1697e0e82 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Getting quotas for user 771c067cf6814084a5520128a970dc82 and project 2a3d4a2ec8674e418602b6dc0cec6ab9. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:40:02.001391 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5ecf9599-bf37-466c-86e9-84b1697e0e82 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:40:02.005228 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5ecf9599-bf37-466c-86e9-84b1697e0e82 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: f60a95b0-93ca-4e4d-a51f-1cb4bb05e1ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:40:02.104633 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5ecf9599-bf37-466c-86e9-84b1697e0e82 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.462899 Sep 08 10:40:02.108460 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 422/869] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:39:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 2472 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:40:02.121276 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-37ba959e-b02a-4148-abcd-ff5fae2c914b tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:02.122494 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-37ba959e-b02a-4148-abcd-ff5fae2c914b tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] [instance: 7dac6a5f-62eb-4c60-8904-f23e50e1dcc8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:02.134358 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-37ba959e-b02a-4148-abcd-ff5fae2c914b tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:02.135356 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-37ba959e-b02a-4148-abcd-ff5fae2c914b tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:02.135903 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-37ba959e-b02a-4148-abcd-ff5fae2c914b tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:02.136749 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-37ba959e-b02a-4148-abcd-ff5fae2c914b tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:02.137474 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-37ba959e-b02a-4148-abcd-ff5fae2c914b tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:02.138018 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-37ba959e-b02a-4148-abcd-ff5fae2c914b tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:02.859878 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-37ba959e-b02a-4148-abcd-ff5fae2c914b tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4cde361139445eb147c4f634ec663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5388c25cdb4a35ae8d58fa5b6cf125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:02.874056 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-37ba959e-b02a-4148-abcd-ff5fae2c914b tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] 10.222.0.27 "GET /compute/v2.1/servers/7dac6a5f-62eb-4c60-8904-f23e50e1dcc8" status: 200 len: 1388 microversion: 2.1 time: 0.763082 Sep 08 10:40:02.878979 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 423/870] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:02 2022] GET /compute/v2.1/servers/7dac6a5f-62eb-4c60-8904-f23e50e1dcc8 => generated 1388 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:02.888706 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4e932a35-89c2-4ba5-a5e5-cf2468faaff2 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:02.898350 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4e932a35-89c2-4ba5-a5e5-cf2468faaff2 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 133a5f12-39e5-4e0f-81dc-b1948c073f15] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:02.931918 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4e932a35-89c2-4ba5-a5e5-cf2468faaff2 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:02.934079 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4e932a35-89c2-4ba5-a5e5-cf2468faaff2 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:02.949471 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4e932a35-89c2-4ba5-a5e5-cf2468faaff2 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:02.954853 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4e932a35-89c2-4ba5-a5e5-cf2468faaff2 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:02.957898 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4e932a35-89c2-4ba5-a5e5-cf2468faaff2 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:02.958734 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4e932a35-89c2-4ba5-a5e5-cf2468faaff2 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:03.303494 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4e932a35-89c2-4ba5-a5e5-cf2468faaff2 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:03.325715 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4e932a35-89c2-4ba5-a5e5-cf2468faaff2 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15" status: 200 len: 1293 microversion: 2.1 time: 0.445085 Sep 08 10:40:03.337940 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 424/871] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:02 2022] GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15 => generated 1293 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:03.337940 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d4ac83c8-d0d2-46df-a838-ea07fb7295d5 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:03.337940 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d4ac83c8-d0d2-46df-a838-ea07fb7295d5 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 923d2401-f860-4284-a580-37ed478720f6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:03.343746 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d4ac83c8-d0d2-46df-a838-ea07fb7295d5 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:03.344558 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d4ac83c8-d0d2-46df-a838-ea07fb7295d5 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:03.345207 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d4ac83c8-d0d2-46df-a838-ea07fb7295d5 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:03.346921 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d4ac83c8-d0d2-46df-a838-ea07fb7295d5 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:03.347917 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d4ac83c8-d0d2-46df-a838-ea07fb7295d5 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:03.348570 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d4ac83c8-d0d2-46df-a838-ea07fb7295d5 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:03.396354 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=100 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:40:03.932814 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-e343a836-7999-4eb2-85db-3ead483802d7 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lazy-loading 'services' on Instance uuid 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:40:04.007329 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e343a836-7999-4eb2-85db-3ead483802d7 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a/action" status: 202 len: 1942 microversion: 2.75 time: 3.735329 Sep 08 10:40:04.007995 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 448/872] 10.222.0.27 () {62 vars in 1319 bytes} [Thu Sep 8 10:40:00 2022] POST /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a/action => generated 1942 bytes in 3737 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 08 10:40:04.018265 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-61d900c8-41fc-4e87-a3a0-d61a62c0ecf6 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:04.018265 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-61d900c8-41fc-4e87-a3a0-d61a62c0ecf6 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: f60a95b0-93ca-4e4d-a51f-1cb4bb05e1ab] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:04.037321 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-61d900c8-41fc-4e87-a3a0-d61a62c0ecf6 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:04.038259 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-61d900c8-41fc-4e87-a3a0-d61a62c0ecf6 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:04.038900 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-61d900c8-41fc-4e87-a3a0-d61a62c0ecf6 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:04.041988 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-61d900c8-41fc-4e87-a3a0-d61a62c0ecf6 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:04.042697 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-61d900c8-41fc-4e87-a3a0-d61a62c0ecf6 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:04.043316 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-61d900c8-41fc-4e87-a3a0-d61a62c0ecf6 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:04.310382 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d4ac83c8-d0d2-46df-a838-ea07fb7295d5 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:04.351606 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d4ac83c8-d0d2-46df-a838-ea07fb7295d5 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6" status: 200 len: 1477 microversion: 2.1 time: 1.019564 Sep 08 10:40:04.353367 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 425/873] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:03 2022] GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6 => generated 1477 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:04.379149 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-8bfee76b-2aee-48de-af6e-5a7767a3b169 req-04ecfb89-71e7-4df7-abe8-3bfb574bf309 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a01253b-8ff8-44d9-961b-1b91de83d671", "name": "network-vif-deleted", "tag": "65a6d6d7-af12-4f90-9ea8-61dc9032943b"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:40:04.436876 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-8bfee76b-2aee-48de-af6e-5a7767a3b169 req-04ecfb89-71e7-4df7-abe8-3bfb574bf309 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:04.438056 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-8bfee76b-2aee-48de-af6e-5a7767a3b169 req-04ecfb89-71e7-4df7-abe8-3bfb574bf309 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:04.438817 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-8bfee76b-2aee-48de-af6e-5a7767a3b169 req-04ecfb89-71e7-4df7-abe8-3bfb574bf309 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:04.479614 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-8bfee76b-2aee-48de-af6e-5a7767a3b169 req-04ecfb89-71e7-4df7-abe8-3bfb574bf309 service nova] Creating event network-vif-deleted:65a6d6d7-af12-4f90-9ea8-61dc9032943b for instance 1a01253b-8ff8-44d9-961b-1b91de83d671 on n-h2-850501-12 Sep 08 10:40:04.490817 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-8bfee76b-2aee-48de-af6e-5a7767a3b169 req-04ecfb89-71e7-4df7-abe8-3bfb574bf309 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131081 Sep 08 10:40:04.494184 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 426/874] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:40:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:40:04.502093 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ed2ea801-ecb4-47eb-a365-3fff11c6f3e0 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:04.507043 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ed2ea801-ecb4-47eb-a365-3fff11c6f3e0 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] [instance: 7dac6a5f-62eb-4c60-8904-f23e50e1dcc8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:04.520994 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed2ea801-ecb4-47eb-a365-3fff11c6f3e0 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:04.522659 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed2ea801-ecb4-47eb-a365-3fff11c6f3e0 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:04.523101 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed2ea801-ecb4-47eb-a365-3fff11c6f3e0 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:04.527468 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-61d900c8-41fc-4e87-a3a0-d61a62c0ecf6 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:04.538111 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed2ea801-ecb4-47eb-a365-3fff11c6f3e0 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:04.540219 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed2ea801-ecb4-47eb-a365-3fff11c6f3e0 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:04.540526 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-61d900c8-41fc-4e87-a3a0-d61a62c0ecf6 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/f60a95b0-93ca-4e4d-a51f-1cb4bb05e1ab" status: 200 len: 1213 microversion: 2.1 time: 0.529579 Sep 08 10:40:04.541297 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed2ea801-ecb4-47eb-a365-3fff11c6f3e0 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:04.542114 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 449/875] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:04 2022] GET /compute/v2.1/servers/f60a95b0-93ca-4e4d-a51f-1cb4bb05e1ab => generated 1213 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:04.570691 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f1b44a83-1ea5-404e-aebd-a450dea83a91 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:04.571844 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f1b44a83-1ea5-404e-aebd-a450dea83a91 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] [instance: 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:04.590362 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1b44a83-1ea5-404e-aebd-a450dea83a91 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:04.591181 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1b44a83-1ea5-404e-aebd-a450dea83a91 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:04.591835 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1b44a83-1ea5-404e-aebd-a450dea83a91 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:04.592764 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1b44a83-1ea5-404e-aebd-a450dea83a91 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:04.595892 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1b44a83-1ea5-404e-aebd-a450dea83a91 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:04.596627 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1b44a83-1ea5-404e-aebd-a450dea83a91 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:04.774592 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ed2ea801-ecb4-47eb-a365-3fff11c6f3e0 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4cde361139445eb147c4f634ec663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5388c25cdb4a35ae8d58fa5b6cf125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:04.783932 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ed2ea801-ecb4-47eb-a365-3fff11c6f3e0 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] 10.222.0.27 "GET /compute/v2.1/servers/7dac6a5f-62eb-4c60-8904-f23e50e1dcc8" status: 200 len: 1388 microversion: 2.1 time: 0.288430 Sep 08 10:40:04.784533 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 427/876] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:04 2022] GET /compute/v2.1/servers/7dac6a5f-62eb-4c60-8904-f23e50e1dcc8 => generated 1388 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:04.899140 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e5592793-a0a0-4c66-a615-2e104b009d62 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-743689998", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "1bfe376b-33d6-4996-8274-cfa24df5a837"}]}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:40:04.947078 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-f1b44a83-1ea5-404e-aebd-a450dea83a91 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lazy-loading 'services' on Instance uuid 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:40:05.023829 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-e5592793-a0a0-4c66-a615-2e104b009d62 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] validate_networks() for [('1bfe376b-33d6-4996-8274-cfa24df5a837', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:40:05.027869 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f1b44a83-1ea5-404e-aebd-a450dea83a91 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a" status: 200 len: 1929 microversion: 2.75 time: 0.463263 Sep 08 10:40:05.029310 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 450/877] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:40:04 2022] GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a => generated 1929 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:40:05.074498 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8b0ecdae-d4fb-4ede-93e4-f1c9463ada4e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:05.075889 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8b0ecdae-d4fb-4ede-93e4-f1c9463ada4e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 133a5f12-39e5-4e0f-81dc-b1948c073f15] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:05.134043 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8b0ecdae-d4fb-4ede-93e4-f1c9463ada4e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:05.135269 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8b0ecdae-d4fb-4ede-93e4-f1c9463ada4e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:05.136217 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8b0ecdae-d4fb-4ede-93e4-f1c9463ada4e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:05.137554 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8b0ecdae-d4fb-4ede-93e4-f1c9463ada4e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:05.138411 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8b0ecdae-d4fb-4ede-93e4-f1c9463ada4e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:05.139146 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8b0ecdae-d4fb-4ede-93e4-f1c9463ada4e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:05.524816 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8b0ecdae-d4fb-4ede-93e4-f1c9463ada4e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:05.548797 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8b0ecdae-d4fb-4ede-93e4-f1c9463ada4e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15" status: 200 len: 1293 microversion: 2.1 time: 0.517292 Sep 08 10:40:05.549952 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 451/878] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:05 2022] GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15 => generated 1293 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:05.566378 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-157c0a16-3b5a-4921-9a42-699311d7b23a tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:05.567907 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-157c0a16-3b5a-4921-9a42-699311d7b23a tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 923d2401-f860-4284-a580-37ed478720f6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:05.590269 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-157c0a16-3b5a-4921-9a42-699311d7b23a tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:05.600171 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-157c0a16-3b5a-4921-9a42-699311d7b23a tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:05.600581 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-157c0a16-3b5a-4921-9a42-699311d7b23a tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:05.603944 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-157c0a16-3b5a-4921-9a42-699311d7b23a tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:05.605115 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-157c0a16-3b5a-4921-9a42-699311d7b23a tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:05.606945 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-157c0a16-3b5a-4921-9a42-699311d7b23a tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:06.067340 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-157c0a16-3b5a-4921-9a42-699311d7b23a tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:06.096154 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-157c0a16-3b5a-4921-9a42-699311d7b23a tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6" status: 200 len: 1477 microversion: 2.1 time: 0.544529 Sep 08 10:40:06.097910 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 452/879] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:05 2022] GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6 => generated 1477 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:06.121476 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5c947ce6-164f-429a-b565-070c99902482 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:06.123568 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5c947ce6-164f-429a-b565-070c99902482 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: f60a95b0-93ca-4e4d-a51f-1cb4bb05e1ab] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:06.146101 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c947ce6-164f-429a-b565-070c99902482 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:06.147154 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c947ce6-164f-429a-b565-070c99902482 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:06.148341 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c947ce6-164f-429a-b565-070c99902482 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:06.150985 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c947ce6-164f-429a-b565-070c99902482 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:06.152474 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c947ce6-164f-429a-b565-070c99902482 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:06.154393 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c947ce6-164f-429a-b565-070c99902482 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:06.323984 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5c947ce6-164f-429a-b565-070c99902482 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:06.354113 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5c947ce6-164f-429a-b565-070c99902482 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/f60a95b0-93ca-4e4d-a51f-1cb4bb05e1ab" status: 200 len: 1275 microversion: 2.1 time: 0.244010 Sep 08 10:40:06.355036 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 453/880] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:06 2022] GET /compute/v2.1/servers/f60a95b0-93ca-4e4d-a51f-1cb4bb05e1ab => generated 1275 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:06.372912 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-32153e02-32f8-4af3-bcfe-5607d8d24da2 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:06.373956 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-32153e02-32f8-4af3-bcfe-5607d8d24da2 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] [instance: 7dac6a5f-62eb-4c60-8904-f23e50e1dcc8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:06.379410 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:40:06.382312 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-32153e02-32f8-4af3-bcfe-5607d8d24da2 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:06.388996 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-32153e02-32f8-4af3-bcfe-5607d8d24da2 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:06.389780 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-32153e02-32f8-4af3-bcfe-5607d8d24da2 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:06.390788 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-32153e02-32f8-4af3-bcfe-5607d8d24da2 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:06.391440 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-32153e02-32f8-4af3-bcfe-5607d8d24da2 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:06.392086 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-32153e02-32f8-4af3-bcfe-5607d8d24da2 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:06.766395 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-e5592793-a0a0-4c66-a615-2e104b009d62 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:40:06.767638 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-e5592793-a0a0-4c66-a615-2e104b009d62 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:40:06.768335 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-e5592793-a0a0-4c66-a615-2e104b009d62 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:40:06.769176 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-e5592793-a0a0-4c66-a615-2e104b009d62 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:40:06.769823 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-e5592793-a0a0-4c66-a615-2e104b009d62 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:40:06.788730 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e5592793-a0a0-4c66-a615-2e104b009d62 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:06.790707 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e5592793-a0a0-4c66-a615-2e104b009d62 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:06.792162 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e5592793-a0a0-4c66-a615-2e104b009d62 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:06.794255 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e5592793-a0a0-4c66-a615-2e104b009d62 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:06.796009 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e5592793-a0a0-4c66-a615-2e104b009d62 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:06.797885 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e5592793-a0a0-4c66-a615-2e104b009d62 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:06.857867 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-e5592793-a0a0-4c66-a615-2e104b009d62 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Getting quotas for project 3674a3f87ee348428b195602234e4dd4. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:40:06.871291 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-e5592793-a0a0-4c66-a615-2e104b009d62 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Getting quotas for user 55e7bb8eedfa46c487513057a67a9537 and project 3674a3f87ee348428b195602234e4dd4. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:40:06.922907 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e5592793-a0a0-4c66-a615-2e104b009d62 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:40:06.931491 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e5592793-a0a0-4c66-a615-2e104b009d62 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] [instance: 60ad91da-8810-4117-8b13-ffe0c0e3714f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:40:06.964853 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-32153e02-32f8-4af3-bcfe-5607d8d24da2 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4cde361139445eb147c4f634ec663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5388c25cdb4a35ae8d58fa5b6cf125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:06.985996 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-32153e02-32f8-4af3-bcfe-5607d8d24da2 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] 10.222.0.27 "GET /compute/v2.1/servers/7dac6a5f-62eb-4c60-8904-f23e50e1dcc8" status: 200 len: 1388 microversion: 2.1 time: 0.629648 Sep 08 10:40:06.997506 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 454/881] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:06 2022] GET /compute/v2.1/servers/7dac6a5f-62eb-4c60-8904-f23e50e1dcc8 => generated 1388 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:07.005363 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-eff6ae81-264d-4aac-8b59-ef4111366737 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:07.006444 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-eff6ae81-264d-4aac-8b59-ef4111366737 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] [instance: 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:07.030316 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eff6ae81-264d-4aac-8b59-ef4111366737 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:07.031549 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eff6ae81-264d-4aac-8b59-ef4111366737 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:07.032607 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eff6ae81-264d-4aac-8b59-ef4111366737 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:07.035036 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eff6ae81-264d-4aac-8b59-ef4111366737 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:07.035702 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e5592793-a0a0-4c66-a615-2e104b009d62 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.250028 Sep 08 10:40:07.042246 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eff6ae81-264d-4aac-8b59-ef4111366737 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:07.043227 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eff6ae81-264d-4aac-8b59-ef4111366737 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:07.047018 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 428/882] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:40:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 2261 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:40:07.060682 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-85d34b82-445f-4504-98f0-cb7cbcf3cc86 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:07.063255 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-85d34b82-445f-4504-98f0-cb7cbcf3cc86 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 133a5f12-39e5-4e0f-81dc-b1948c073f15] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:07.103880 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-85d34b82-445f-4504-98f0-cb7cbcf3cc86 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:07.107015 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-85d34b82-445f-4504-98f0-cb7cbcf3cc86 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:07.108783 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-85d34b82-445f-4504-98f0-cb7cbcf3cc86 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:07.112902 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-85d34b82-445f-4504-98f0-cb7cbcf3cc86 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:07.115514 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-85d34b82-445f-4504-98f0-cb7cbcf3cc86 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:07.116193 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-85d34b82-445f-4504-98f0-cb7cbcf3cc86 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:07.224152 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-eff6ae81-264d-4aac-8b59-ef4111366737 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lazy-loading 'services' on Instance uuid 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:40:07.269471 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-eff6ae81-264d-4aac-8b59-ef4111366737 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a" status: 200 len: 1929 microversion: 2.75 time: 0.269351 Sep 08 10:40:07.271308 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 455/883] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:40:06 2022] GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a => generated 1929 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:40:07.292204 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-aeafa8d3-fe58-407b-bd97-a10b7410f7fc tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:07.292756 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-aeafa8d3-fe58-407b-bd97-a10b7410f7fc tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] [instance: 60ad91da-8810-4117-8b13-ffe0c0e3714f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:07.392815 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-85d34b82-445f-4504-98f0-cb7cbcf3cc86 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:07.450955 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-85d34b82-445f-4504-98f0-cb7cbcf3cc86 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15" status: 200 len: 1293 microversion: 2.1 time: 0.401482 Sep 08 10:40:07.451949 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 429/884] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:07 2022] GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15 => generated 1293 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:07.468849 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-34aebd97-7be7-44be-81d8-a543c7e990e4 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:07.468849 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-34aebd97-7be7-44be-81d8-a543c7e990e4 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 923d2401-f860-4284-a580-37ed478720f6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:07.506773 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-34aebd97-7be7-44be-81d8-a543c7e990e4 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:07.510010 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-34aebd97-7be7-44be-81d8-a543c7e990e4 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:07.511924 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-34aebd97-7be7-44be-81d8-a543c7e990e4 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:07.514753 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-34aebd97-7be7-44be-81d8-a543c7e990e4 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:07.515405 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-34aebd97-7be7-44be-81d8-a543c7e990e4 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:07.522563 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-34aebd97-7be7-44be-81d8-a543c7e990e4 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:07.622123 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-aeafa8d3-fe58-407b-bd97-a10b7410f7fc tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e7bb8eedfa46c487513057a67a9537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3674a3f87ee348428b195602234e4dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:07.659898 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-aeafa8d3-fe58-407b-bd97-a10b7410f7fc tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] 10.222.0.27 "GET /compute/v2.1/servers/60ad91da-8810-4117-8b13-ffe0c0e3714f" status: 200 len: 1231 microversion: 2.1 time: 0.381238 Sep 08 10:40:07.661174 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 456/885] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:07 2022] GET /compute/v2.1/servers/60ad91da-8810-4117-8b13-ffe0c0e3714f => generated 1231 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:07.676943 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-54b91474-6006-4b58-8e5d-5b47b4037a2f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:07.693139 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-54b91474-6006-4b58-8e5d-5b47b4037a2f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: f60a95b0-93ca-4e4d-a51f-1cb4bb05e1ab] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:07.726292 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54b91474-6006-4b58-8e5d-5b47b4037a2f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:07.727727 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54b91474-6006-4b58-8e5d-5b47b4037a2f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:07.734050 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54b91474-6006-4b58-8e5d-5b47b4037a2f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:07.735955 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54b91474-6006-4b58-8e5d-5b47b4037a2f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:07.737773 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54b91474-6006-4b58-8e5d-5b47b4037a2f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:07.739662 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54b91474-6006-4b58-8e5d-5b47b4037a2f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:08.134073 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-34aebd97-7be7-44be-81d8-a543c7e990e4 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:08.176397 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-34aebd97-7be7-44be-81d8-a543c7e990e4 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6" status: 200 len: 1477 microversion: 2.1 time: 0.711609 Sep 08 10:40:08.177096 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 430/886] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:07 2022] GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6 => generated 1477 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:08.207522 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-d1911492-a9ec-43e4-932f-124e808af499 req-3ffcc313-d5d6-4ad1-8784-2b41f9de86fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dac6a5f-62eb-4c60-8904-f23e50e1dcc8", "tag": "629f2b6c-399c-4a00-a715-4e34d0f557fe"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:40:08.248054 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-d1911492-a9ec-43e4-932f-124e808af499 req-3ffcc313-d5d6-4ad1-8784-2b41f9de86fd service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:08.248568 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-d1911492-a9ec-43e4-932f-124e808af499 req-3ffcc313-d5d6-4ad1-8784-2b41f9de86fd service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:08.248975 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-d1911492-a9ec-43e4-932f-124e808af499 req-3ffcc313-d5d6-4ad1-8784-2b41f9de86fd service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:08.281867 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-d1911492-a9ec-43e4-932f-124e808af499 req-3ffcc313-d5d6-4ad1-8784-2b41f9de86fd service nova] Creating event network-changed:629f2b6c-399c-4a00-a715-4e34d0f557fe for instance 7dac6a5f-62eb-4c60-8904-f23e50e1dcc8 on n-h1-850501-12 Sep 08 10:40:08.290166 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-d1911492-a9ec-43e4-932f-124e808af499 req-3ffcc313-d5d6-4ad1-8784-2b41f9de86fd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091134 Sep 08 10:40:08.293575 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 431/887] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:40:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:40:08.308095 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-78f29a6c-1e8a-46c2-b7b0-ab2faaa50f53 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:08.313982 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-78f29a6c-1e8a-46c2-b7b0-ab2faaa50f53 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] [instance: 7dac6a5f-62eb-4c60-8904-f23e50e1dcc8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:08.328987 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-78f29a6c-1e8a-46c2-b7b0-ab2faaa50f53 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:08.329852 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-78f29a6c-1e8a-46c2-b7b0-ab2faaa50f53 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:08.330451 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-78f29a6c-1e8a-46c2-b7b0-ab2faaa50f53 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:08.331372 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-78f29a6c-1e8a-46c2-b7b0-ab2faaa50f53 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:08.337699 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-78f29a6c-1e8a-46c2-b7b0-ab2faaa50f53 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:08.338322 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-78f29a6c-1e8a-46c2-b7b0-ab2faaa50f53 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:08.583172 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-78f29a6c-1e8a-46c2-b7b0-ab2faaa50f53 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4cde361139445eb147c4f634ec663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5388c25cdb4a35ae8d58fa5b6cf125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:08.605246 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-78f29a6c-1e8a-46c2-b7b0-ab2faaa50f53 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] 10.222.0.27 "GET /compute/v2.1/servers/7dac6a5f-62eb-4c60-8904-f23e50e1dcc8" status: 200 len: 1388 microversion: 2.1 time: 0.298015 Sep 08 10:40:08.606780 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 432/888] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:08 2022] GET /compute/v2.1/servers/7dac6a5f-62eb-4c60-8904-f23e50e1dcc8 => generated 1388 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:08.611634 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a7d1e22b-0f96-47bd-a79b-6329c9ecc187 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:08.612443 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a7d1e22b-0f96-47bd-a79b-6329c9ecc187 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] [instance: 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:08.622882 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a7d1e22b-0f96-47bd-a79b-6329c9ecc187 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:08.623629 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a7d1e22b-0f96-47bd-a79b-6329c9ecc187 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:08.624252 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a7d1e22b-0f96-47bd-a79b-6329c9ecc187 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:08.625825 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a7d1e22b-0f96-47bd-a79b-6329c9ecc187 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:08.634648 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a7d1e22b-0f96-47bd-a79b-6329c9ecc187 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:08.635463 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a7d1e22b-0f96-47bd-a79b-6329c9ecc187 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:08.687358 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-54b91474-6006-4b58-8e5d-5b47b4037a2f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:08.700891 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-54b91474-6006-4b58-8e5d-5b47b4037a2f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/f60a95b0-93ca-4e4d-a51f-1cb4bb05e1ab" status: 200 len: 1317 microversion: 2.1 time: 1.030712 Sep 08 10:40:08.721521 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 457/889] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:07 2022] GET /compute/v2.1/servers/f60a95b0-93ca-4e4d-a51f-1cb4bb05e1ab => generated 1317 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:08.747866 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d265789b-654d-41bc-b46b-49f9d805fff5 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:08.749128 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d265789b-654d-41bc-b46b-49f9d805fff5 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 133a5f12-39e5-4e0f-81dc-b1948c073f15] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:08.778726 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d265789b-654d-41bc-b46b-49f9d805fff5 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:08.781925 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d265789b-654d-41bc-b46b-49f9d805fff5 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:08.796580 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d265789b-654d-41bc-b46b-49f9d805fff5 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:08.797866 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d265789b-654d-41bc-b46b-49f9d805fff5 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:08.798526 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d265789b-654d-41bc-b46b-49f9d805fff5 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:08.799151 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d265789b-654d-41bc-b46b-49f9d805fff5 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:09.182263 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-a7d1e22b-0f96-47bd-a79b-6329c9ecc187 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lazy-loading 'services' on Instance uuid 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:40:09.236676 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a7d1e22b-0f96-47bd-a79b-6329c9ecc187 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a" status: 200 len: 1929 microversion: 2.75 time: 0.628502 Sep 08 10:40:09.237426 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 433/890] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:40:08 2022] GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a => generated 1929 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:40:09.258831 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-95a8d8f9-ce2c-4091-bee6-a49fe9f002a5 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:09.261002 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-95a8d8f9-ce2c-4091-bee6-a49fe9f002a5 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] [instance: 60ad91da-8810-4117-8b13-ffe0c0e3714f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:09.276707 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-95a8d8f9-ce2c-4091-bee6-a49fe9f002a5 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:09.277562 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-95a8d8f9-ce2c-4091-bee6-a49fe9f002a5 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:09.278187 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-95a8d8f9-ce2c-4091-bee6-a49fe9f002a5 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:09.287888 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-95a8d8f9-ce2c-4091-bee6-a49fe9f002a5 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:09.290998 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-95a8d8f9-ce2c-4091-bee6-a49fe9f002a5 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:09.297706 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-95a8d8f9-ce2c-4091-bee6-a49fe9f002a5 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:09.337945 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d265789b-654d-41bc-b46b-49f9d805fff5 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:09.376585 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d265789b-654d-41bc-b46b-49f9d805fff5 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15" status: 200 len: 1361 microversion: 2.1 time: 0.653101 Sep 08 10:40:09.377865 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 458/891] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:08 2022] GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15 => generated 1361 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:09.394643 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cc4bd3fa-d2d1-46a9-a067-b1158b712c52 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:09.396100 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cc4bd3fa-d2d1-46a9-a067-b1158b712c52 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 923d2401-f860-4284-a580-37ed478720f6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:09.428934 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc4bd3fa-d2d1-46a9-a067-b1158b712c52 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:09.429492 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc4bd3fa-d2d1-46a9-a067-b1158b712c52 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:09.430605 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc4bd3fa-d2d1-46a9-a067-b1158b712c52 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:09.431538 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc4bd3fa-d2d1-46a9-a067-b1158b712c52 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:09.432084 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc4bd3fa-d2d1-46a9-a067-b1158b712c52 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:09.432833 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc4bd3fa-d2d1-46a9-a067-b1158b712c52 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:09.619162 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-95a8d8f9-ce2c-4091-bee6-a49fe9f002a5 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e7bb8eedfa46c487513057a67a9537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3674a3f87ee348428b195602234e4dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:09.648448 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-95a8d8f9-ce2c-4091-bee6-a49fe9f002a5 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] 10.222.0.27 "GET /compute/v2.1/servers/60ad91da-8810-4117-8b13-ffe0c0e3714f" status: 200 len: 1283 microversion: 2.1 time: 0.405790 Sep 08 10:40:09.652164 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 434/892] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:09 2022] GET /compute/v2.1/servers/60ad91da-8810-4117-8b13-ffe0c0e3714f => generated 1283 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:09.661385 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4bbc68a4-5646-4893-a2dc-6010e9424c07 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:09.662310 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4bbc68a4-5646-4893-a2dc-6010e9424c07 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] [instance: 7dac6a5f-62eb-4c60-8904-f23e50e1dcc8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:09.672481 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4bbc68a4-5646-4893-a2dc-6010e9424c07 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:09.673756 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4bbc68a4-5646-4893-a2dc-6010e9424c07 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:09.674457 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4bbc68a4-5646-4893-a2dc-6010e9424c07 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:09.675420 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4bbc68a4-5646-4893-a2dc-6010e9424c07 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:09.676145 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4bbc68a4-5646-4893-a2dc-6010e9424c07 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:09.676817 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4bbc68a4-5646-4893-a2dc-6010e9424c07 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:10.116505 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4bbc68a4-5646-4893-a2dc-6010e9424c07 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4cde361139445eb147c4f634ec663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5388c25cdb4a35ae8d58fa5b6cf125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:10.157178 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4bbc68a4-5646-4893-a2dc-6010e9424c07 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] 10.222.0.27 "GET /compute/v2.1/servers/7dac6a5f-62eb-4c60-8904-f23e50e1dcc8" status: 200 len: 1388 microversion: 2.1 time: 0.501379 Sep 08 10:40:10.160221 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 435/893] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:09 2022] GET /compute/v2.1/servers/7dac6a5f-62eb-4c60-8904-f23e50e1dcc8 => generated 1388 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:10.174675 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b481d379-74b6-4506-8ad1-278a7ecb4ba1 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:10.175742 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b481d379-74b6-4506-8ad1-278a7ecb4ba1 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: f60a95b0-93ca-4e4d-a51f-1cb4bb05e1ab] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:10.182914 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b481d379-74b6-4506-8ad1-278a7ecb4ba1 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:10.185629 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b481d379-74b6-4506-8ad1-278a7ecb4ba1 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:10.186225 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b481d379-74b6-4506-8ad1-278a7ecb4ba1 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:10.187233 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b481d379-74b6-4506-8ad1-278a7ecb4ba1 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:10.188461 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b481d379-74b6-4506-8ad1-278a7ecb4ba1 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:10.189018 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b481d379-74b6-4506-8ad1-278a7ecb4ba1 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:10.370313 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cc4bd3fa-d2d1-46a9-a067-b1158b712c52 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:10.386519 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cc4bd3fa-d2d1-46a9-a067-b1158b712c52 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6" status: 200 len: 1477 microversion: 2.1 time: 1.005756 Sep 08 10:40:10.387116 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 459/894] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:09 2022] GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6 => generated 1477 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:10.395493 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-e1cee572-8938-41f8-9e9e-92014740f364 req-98795ca3-ff18-42ab-a993-00e6055299a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f60a95b0-93ca-4e4d-a51f-1cb4bb05e1ab", "tag": "0110c783-e116-4860-a329-1e610dbd18b3"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:40:10.421288 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e1cee572-8938-41f8-9e9e-92014740f364 req-98795ca3-ff18-42ab-a993-00e6055299a7 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:10.421792 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e1cee572-8938-41f8-9e9e-92014740f364 req-98795ca3-ff18-42ab-a993-00e6055299a7 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:10.422412 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e1cee572-8938-41f8-9e9e-92014740f364 req-98795ca3-ff18-42ab-a993-00e6055299a7 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:10.436298 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-e1cee572-8938-41f8-9e9e-92014740f364 req-98795ca3-ff18-42ab-a993-00e6055299a7 service nova] Creating event network-changed:0110c783-e116-4860-a329-1e610dbd18b3 for instance f60a95b0-93ca-4e4d-a51f-1cb4bb05e1ab on n-h2-850501-12 Sep 08 10:40:10.444844 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-e1cee572-8938-41f8-9e9e-92014740f364 req-98795ca3-ff18-42ab-a993-00e6055299a7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052707 Sep 08 10:40:10.446526 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 460/895] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:40:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:40:10.451955 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f97f6cf3-b346-4670-b728-3a109ff74e2d tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:10.452934 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f97f6cf3-b346-4670-b728-3a109ff74e2d tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] [instance: 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:10.460391 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f97f6cf3-b346-4670-b728-3a109ff74e2d tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:10.460967 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f97f6cf3-b346-4670-b728-3a109ff74e2d tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:10.461920 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f97f6cf3-b346-4670-b728-3a109ff74e2d tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:10.462724 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f97f6cf3-b346-4670-b728-3a109ff74e2d tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:10.463384 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f97f6cf3-b346-4670-b728-3a109ff74e2d tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:10.464101 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f97f6cf3-b346-4670-b728-3a109ff74e2d tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:10.536639 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b481d379-74b6-4506-8ad1-278a7ecb4ba1 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:10.552440 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b481d379-74b6-4506-8ad1-278a7ecb4ba1 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/f60a95b0-93ca-4e4d-a51f-1cb4bb05e1ab" status: 200 len: 1317 microversion: 2.1 time: 0.390316 Sep 08 10:40:10.554043 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 436/896] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:10 2022] GET /compute/v2.1/servers/f60a95b0-93ca-4e4d-a51f-1cb4bb05e1ab => generated 1317 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:10.564887 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-edc42ed2-b93b-42ff-a408-5968c12b1236 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:10.565780 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-edc42ed2-b93b-42ff-a408-5968c12b1236 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 133a5f12-39e5-4e0f-81dc-b1948c073f15] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:10.574247 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-edc42ed2-b93b-42ff-a408-5968c12b1236 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:10.574930 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-edc42ed2-b93b-42ff-a408-5968c12b1236 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:10.576782 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-edc42ed2-b93b-42ff-a408-5968c12b1236 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:10.576782 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-edc42ed2-b93b-42ff-a408-5968c12b1236 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:10.576782 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-edc42ed2-b93b-42ff-a408-5968c12b1236 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:10.577550 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-edc42ed2-b93b-42ff-a408-5968c12b1236 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:10.692031 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-f97f6cf3-b346-4670-b728-3a109ff74e2d tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lazy-loading 'services' on Instance uuid 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:40:10.731021 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f97f6cf3-b346-4670-b728-3a109ff74e2d tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a" status: 200 len: 1929 microversion: 2.75 time: 0.282656 Sep 08 10:40:10.745696 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 461/897] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:40:10 2022] GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a => generated 1929 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:40:10.766033 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3797d396-e65c-4c91-aa21-757c6ee085f7 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:10.767542 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3797d396-e65c-4c91-aa21-757c6ee085f7 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] [instance: 60ad91da-8810-4117-8b13-ffe0c0e3714f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:10.780202 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3797d396-e65c-4c91-aa21-757c6ee085f7 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:10.781325 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3797d396-e65c-4c91-aa21-757c6ee085f7 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:10.782111 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3797d396-e65c-4c91-aa21-757c6ee085f7 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:10.785336 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3797d396-e65c-4c91-aa21-757c6ee085f7 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:10.786192 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3797d396-e65c-4c91-aa21-757c6ee085f7 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:10.786942 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3797d396-e65c-4c91-aa21-757c6ee085f7 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:10.962288 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3797d396-e65c-4c91-aa21-757c6ee085f7 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e7bb8eedfa46c487513057a67a9537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3674a3f87ee348428b195602234e4dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:10.970646 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:40:10.983973 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3797d396-e65c-4c91-aa21-757c6ee085f7 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] 10.222.0.27 "GET /compute/v2.1/servers/60ad91da-8810-4117-8b13-ffe0c0e3714f" status: 200 len: 1291 microversion: 2.1 time: 0.236392 Sep 08 10:40:10.998413 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 462/898] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:10 2022] GET /compute/v2.1/servers/60ad91da-8810-4117-8b13-ffe0c0e3714f => generated 1291 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:11.199959 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c4d84d26-8b7b-4168-b1cd-763ab71a1a35 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:11.200666 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c4d84d26-8b7b-4168-b1cd-763ab71a1a35 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] [instance: 7dac6a5f-62eb-4c60-8904-f23e50e1dcc8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:11.211140 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c4d84d26-8b7b-4168-b1cd-763ab71a1a35 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:11.211922 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c4d84d26-8b7b-4168-b1cd-763ab71a1a35 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:11.212556 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c4d84d26-8b7b-4168-b1cd-763ab71a1a35 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:11.213943 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c4d84d26-8b7b-4168-b1cd-763ab71a1a35 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:11.214933 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c4d84d26-8b7b-4168-b1cd-763ab71a1a35 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:11.215680 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c4d84d26-8b7b-4168-b1cd-763ab71a1a35 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:11.232675 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-edc42ed2-b93b-42ff-a408-5968c12b1236 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:11.245854 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-edc42ed2-b93b-42ff-a408-5968c12b1236 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15" status: 200 len: 1361 microversion: 2.1 time: 0.688550 Sep 08 10:40:11.246447 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 437/899] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:10 2022] GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15 => generated 1361 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:11.426440 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-370ba662-82ac-424b-8ff4-90c647798bd3 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:11.427326 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-370ba662-82ac-424b-8ff4-90c647798bd3 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 923d2401-f860-4284-a580-37ed478720f6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:11.445773 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-370ba662-82ac-424b-8ff4-90c647798bd3 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:11.446273 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-370ba662-82ac-424b-8ff4-90c647798bd3 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:11.448144 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-370ba662-82ac-424b-8ff4-90c647798bd3 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:11.451885 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-370ba662-82ac-424b-8ff4-90c647798bd3 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:11.453575 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-370ba662-82ac-424b-8ff4-90c647798bd3 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:11.454369 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-370ba662-82ac-424b-8ff4-90c647798bd3 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:11.600865 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c4d84d26-8b7b-4168-b1cd-763ab71a1a35 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4cde361139445eb147c4f634ec663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5388c25cdb4a35ae8d58fa5b6cf125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:11.617908 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c4d84d26-8b7b-4168-b1cd-763ab71a1a35 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] 10.222.0.27 "GET /compute/v2.1/servers/7dac6a5f-62eb-4c60-8904-f23e50e1dcc8" status: 200 len: 1388 microversion: 2.1 time: 0.422687 Sep 08 10:40:11.630154 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 463/900] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:11 2022] GET /compute/v2.1/servers/7dac6a5f-62eb-4c60-8904-f23e50e1dcc8 => generated 1388 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:40:11.640528 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e9b2db2a-bdc9-4863-b414-f938b8c8092a tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:11.643208 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e9b2db2a-bdc9-4863-b414-f938b8c8092a tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: f60a95b0-93ca-4e4d-a51f-1cb4bb05e1ab] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:11.666690 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9b2db2a-bdc9-4863-b414-f938b8c8092a tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:11.667380 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9b2db2a-bdc9-4863-b414-f938b8c8092a tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:11.668052 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9b2db2a-bdc9-4863-b414-f938b8c8092a tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:11.668960 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9b2db2a-bdc9-4863-b414-f938b8c8092a tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:11.669746 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9b2db2a-bdc9-4863-b414-f938b8c8092a tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:11.670390 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9b2db2a-bdc9-4863-b414-f938b8c8092a tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:11.671292 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-370ba662-82ac-424b-8ff4-90c647798bd3 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:11.694382 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-370ba662-82ac-424b-8ff4-90c647798bd3 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6" status: 200 len: 1477 microversion: 2.1 time: 0.281865 Sep 08 10:40:11.696547 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 438/901] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:11 2022] GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6 => generated 1477 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:11.707178 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-ed609ea8-32ea-49f2-b450-3beb5ef9488a req-d009edcb-84a9-4cda-97b3-33d2c2cb3b5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "133a5f12-39e5-4e0f-81dc-b1948c073f15", "tag": "f7bbb779-b8ca-4ca2-b84e-e3203ed8de69"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:40:11.729006 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-ed609ea8-32ea-49f2-b450-3beb5ef9488a req-d009edcb-84a9-4cda-97b3-33d2c2cb3b5b service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:11.729902 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-ed609ea8-32ea-49f2-b450-3beb5ef9488a req-d009edcb-84a9-4cda-97b3-33d2c2cb3b5b service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:11.730614 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-ed609ea8-32ea-49f2-b450-3beb5ef9488a req-d009edcb-84a9-4cda-97b3-33d2c2cb3b5b service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:11.743634 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-ed609ea8-32ea-49f2-b450-3beb5ef9488a req-d009edcb-84a9-4cda-97b3-33d2c2cb3b5b service nova] Creating event network-changed:f7bbb779-b8ca-4ca2-b84e-e3203ed8de69 for instance 133a5f12-39e5-4e0f-81dc-b1948c073f15 on n-h2-850501-12 Sep 08 10:40:11.751080 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-ed609ea8-32ea-49f2-b450-3beb5ef9488a req-d009edcb-84a9-4cda-97b3-33d2c2cb3b5b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049824 Sep 08 10:40:11.751791 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 439/902] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:40:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:40:11.781268 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b809b4ca-6ec6-496c-887f-4e3d62cfd169 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:11.782440 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b809b4ca-6ec6-496c-887f-4e3d62cfd169 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] [instance: 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:11.791341 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b809b4ca-6ec6-496c-887f-4e3d62cfd169 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:11.792006 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b809b4ca-6ec6-496c-887f-4e3d62cfd169 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:11.792534 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b809b4ca-6ec6-496c-887f-4e3d62cfd169 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:11.793659 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b809b4ca-6ec6-496c-887f-4e3d62cfd169 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:11.794176 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b809b4ca-6ec6-496c-887f-4e3d62cfd169 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:11.794743 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b809b4ca-6ec6-496c-887f-4e3d62cfd169 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:11.927248 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-b809b4ca-6ec6-496c-887f-4e3d62cfd169 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lazy-loading 'services' on Instance uuid 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:40:11.958275 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b809b4ca-6ec6-496c-887f-4e3d62cfd169 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a" status: 200 len: 1929 microversion: 2.75 time: 0.182682 Sep 08 10:40:11.958929 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 440/903] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:40:11 2022] GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a => generated 1929 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:40:11.997924 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e9b2db2a-bdc9-4863-b414-f938b8c8092a tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:12.012423 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e9b2db2a-bdc9-4863-b414-f938b8c8092a tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/f60a95b0-93ca-4e4d-a51f-1cb4bb05e1ab" status: 200 len: 1317 microversion: 2.1 time: 0.378838 Sep 08 10:40:12.013951 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 464/904] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:11 2022] GET /compute/v2.1/servers/f60a95b0-93ca-4e4d-a51f-1cb4bb05e1ab => generated 1317 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:12.030853 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-10f62e87-0cdc-4f9d-95f7-5f0993e21bb3 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:12.031943 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-10f62e87-0cdc-4f9d-95f7-5f0993e21bb3 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] [instance: 60ad91da-8810-4117-8b13-ffe0c0e3714f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:12.042169 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-10f62e87-0cdc-4f9d-95f7-5f0993e21bb3 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:12.043112 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-10f62e87-0cdc-4f9d-95f7-5f0993e21bb3 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:12.043907 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-10f62e87-0cdc-4f9d-95f7-5f0993e21bb3 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:12.045286 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-10f62e87-0cdc-4f9d-95f7-5f0993e21bb3 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:12.046110 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-10f62e87-0cdc-4f9d-95f7-5f0993e21bb3 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:12.046837 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-10f62e87-0cdc-4f9d-95f7-5f0993e21bb3 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:12.154897 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-10f62e87-0cdc-4f9d-95f7-5f0993e21bb3 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e7bb8eedfa46c487513057a67a9537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3674a3f87ee348428b195602234e4dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:12.173218 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-10f62e87-0cdc-4f9d-95f7-5f0993e21bb3 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] 10.222.0.27 "GET /compute/v2.1/servers/60ad91da-8810-4117-8b13-ffe0c0e3714f" status: 200 len: 1291 microversion: 2.1 time: 0.150346 Sep 08 10:40:12.174352 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 441/905] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:12 2022] GET /compute/v2.1/servers/60ad91da-8810-4117-8b13-ffe0c0e3714f => generated 1291 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:12.275886 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1f9fad39-36aa-46fc-a06f-9182205140c0 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:12.276922 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1f9fad39-36aa-46fc-a06f-9182205140c0 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 133a5f12-39e5-4e0f-81dc-b1948c073f15] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:12.284536 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f9fad39-36aa-46fc-a06f-9182205140c0 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:12.285329 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f9fad39-36aa-46fc-a06f-9182205140c0 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:12.285938 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f9fad39-36aa-46fc-a06f-9182205140c0 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:12.287084 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f9fad39-36aa-46fc-a06f-9182205140c0 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:12.287793 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f9fad39-36aa-46fc-a06f-9182205140c0 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:12.288434 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f9fad39-36aa-46fc-a06f-9182205140c0 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:12.552357 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1f9fad39-36aa-46fc-a06f-9182205140c0 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:12.563895 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1f9fad39-36aa-46fc-a06f-9182205140c0 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15" status: 200 len: 1361 microversion: 2.1 time: 0.294576 Sep 08 10:40:12.565645 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 465/906] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:12 2022] GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15 => generated 1361 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:12.645364 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-68193093-b20c-4523-9b58-73a5db08078d tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:12.645364 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-68193093-b20c-4523-9b58-73a5db08078d tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] [instance: 7dac6a5f-62eb-4c60-8904-f23e50e1dcc8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:12.662925 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-68193093-b20c-4523-9b58-73a5db08078d tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:12.663438 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-68193093-b20c-4523-9b58-73a5db08078d tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:12.663850 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-68193093-b20c-4523-9b58-73a5db08078d tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:12.664611 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-68193093-b20c-4523-9b58-73a5db08078d tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:12.665353 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-68193093-b20c-4523-9b58-73a5db08078d tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:12.665794 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-68193093-b20c-4523-9b58-73a5db08078d tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:12.727855 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ba6bb4d7-4141-4d4f-9bb4-cf1f7c1e5cae tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:12.728915 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ba6bb4d7-4141-4d4f-9bb4-cf1f7c1e5cae tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 923d2401-f860-4284-a580-37ed478720f6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:12.752710 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba6bb4d7-4141-4d4f-9bb4-cf1f7c1e5cae tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:12.754036 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba6bb4d7-4141-4d4f-9bb4-cf1f7c1e5cae tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:12.757096 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba6bb4d7-4141-4d4f-9bb4-cf1f7c1e5cae tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:12.758657 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba6bb4d7-4141-4d4f-9bb4-cf1f7c1e5cae tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:12.762473 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba6bb4d7-4141-4d4f-9bb4-cf1f7c1e5cae tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:12.763983 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba6bb4d7-4141-4d4f-9bb4-cf1f7c1e5cae tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:13.265904 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ba6bb4d7-4141-4d4f-9bb4-cf1f7c1e5cae tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:13.283824 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ba6bb4d7-4141-4d4f-9bb4-cf1f7c1e5cae tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6" status: 200 len: 1477 microversion: 2.1 time: 0.562021 Sep 08 10:40:13.284415 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 466/907] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:12 2022] GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6 => generated 1477 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:13.289842 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a95d6089-7074-4337-9de2-7a9fc1e6f2eb tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:13.290823 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a95d6089-7074-4337-9de2-7a9fc1e6f2eb tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] [instance: 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:13.310449 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a95d6089-7074-4337-9de2-7a9fc1e6f2eb tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:13.311197 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a95d6089-7074-4337-9de2-7a9fc1e6f2eb tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:13.311814 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a95d6089-7074-4337-9de2-7a9fc1e6f2eb tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:13.312522 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a95d6089-7074-4337-9de2-7a9fc1e6f2eb tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:13.312981 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a95d6089-7074-4337-9de2-7a9fc1e6f2eb tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:13.313433 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a95d6089-7074-4337-9de2-7a9fc1e6f2eb tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:13.347830 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-68193093-b20c-4523-9b58-73a5db08078d tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4cde361139445eb147c4f634ec663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5388c25cdb4a35ae8d58fa5b6cf125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:13.381955 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-68193093-b20c-4523-9b58-73a5db08078d tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] 10.222.0.27 "GET /compute/v2.1/servers/7dac6a5f-62eb-4c60-8904-f23e50e1dcc8" status: 200 len: 1388 microversion: 2.1 time: 0.740987 Sep 08 10:40:13.383886 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 442/908] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:12 2022] GET /compute/v2.1/servers/7dac6a5f-62eb-4c60-8904-f23e50e1dcc8 => generated 1388 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:13.393081 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5e551de6-9bd4-46e3-927f-756fd5032967 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:13.395273 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5e551de6-9bd4-46e3-927f-756fd5032967 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: f60a95b0-93ca-4e4d-a51f-1cb4bb05e1ab] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:13.407193 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5e551de6-9bd4-46e3-927f-756fd5032967 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:13.419989 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5e551de6-9bd4-46e3-927f-756fd5032967 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:13.429115 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5e551de6-9bd4-46e3-927f-756fd5032967 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:13.433603 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5e551de6-9bd4-46e3-927f-756fd5032967 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:13.434480 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5e551de6-9bd4-46e3-927f-756fd5032967 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:13.435273 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5e551de6-9bd4-46e3-927f-756fd5032967 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:13.607865 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-a95d6089-7074-4337-9de2-7a9fc1e6f2eb tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lazy-loading 'services' on Instance uuid 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:40:13.704826 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a95d6089-7074-4337-9de2-7a9fc1e6f2eb tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a" status: 200 len: 1929 microversion: 2.75 time: 0.418757 Sep 08 10:40:13.708614 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 467/909] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:40:13 2022] GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a => generated 1929 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:40:13.732836 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9f78fc76-95ff-4ede-aa75-8c74fb9a5a72 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:13.734063 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9f78fc76-95ff-4ede-aa75-8c74fb9a5a72 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] [instance: 60ad91da-8810-4117-8b13-ffe0c0e3714f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:13.764912 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f78fc76-95ff-4ede-aa75-8c74fb9a5a72 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:13.765811 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f78fc76-95ff-4ede-aa75-8c74fb9a5a72 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:13.766579 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f78fc76-95ff-4ede-aa75-8c74fb9a5a72 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:13.767857 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f78fc76-95ff-4ede-aa75-8c74fb9a5a72 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:13.779444 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f78fc76-95ff-4ede-aa75-8c74fb9a5a72 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:13.780372 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f78fc76-95ff-4ede-aa75-8c74fb9a5a72 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:14.074671 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9f78fc76-95ff-4ede-aa75-8c74fb9a5a72 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e7bb8eedfa46c487513057a67a9537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3674a3f87ee348428b195602234e4dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:14.088967 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9f78fc76-95ff-4ede-aa75-8c74fb9a5a72 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] 10.222.0.27 "GET /compute/v2.1/servers/60ad91da-8810-4117-8b13-ffe0c0e3714f" status: 200 len: 1289 microversion: 2.1 time: 0.374283 Sep 08 10:40:14.090832 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 468/910] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:13 2022] GET /compute/v2.1/servers/60ad91da-8810-4117-8b13-ffe0c0e3714f => generated 1289 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:14.099488 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6096d8ee-15fc-4772-97a3-7d589286d449 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:14.100495 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6096d8ee-15fc-4772-97a3-7d589286d449 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 133a5f12-39e5-4e0f-81dc-b1948c073f15] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:14.115147 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6096d8ee-15fc-4772-97a3-7d589286d449 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:14.116242 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6096d8ee-15fc-4772-97a3-7d589286d449 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:14.117365 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6096d8ee-15fc-4772-97a3-7d589286d449 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:14.119914 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6096d8ee-15fc-4772-97a3-7d589286d449 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:14.123173 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6096d8ee-15fc-4772-97a3-7d589286d449 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:14.125423 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6096d8ee-15fc-4772-97a3-7d589286d449 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:14.181624 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5e551de6-9bd4-46e3-927f-756fd5032967 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:14.198542 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5e551de6-9bd4-46e3-927f-756fd5032967 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/f60a95b0-93ca-4e4d-a51f-1cb4bb05e1ab" status: 200 len: 1317 microversion: 2.1 time: 0.812770 Sep 08 10:40:14.199151 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 443/911] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:13 2022] GET /compute/v2.1/servers/f60a95b0-93ca-4e4d-a51f-1cb4bb05e1ab => generated 1317 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:14.330636 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f9d1a55d-3331-4bd9-841c-dff4fa3623f9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:14.331303 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f9d1a55d-3331-4bd9-841c-dff4fa3623f9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 923d2401-f860-4284-a580-37ed478720f6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:14.353255 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f9d1a55d-3331-4bd9-841c-dff4fa3623f9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:14.354297 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f9d1a55d-3331-4bd9-841c-dff4fa3623f9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:14.355301 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f9d1a55d-3331-4bd9-841c-dff4fa3623f9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:14.356908 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f9d1a55d-3331-4bd9-841c-dff4fa3623f9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:14.358221 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f9d1a55d-3331-4bd9-841c-dff4fa3623f9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:14.359213 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f9d1a55d-3331-4bd9-841c-dff4fa3623f9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:14.399782 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=100 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:40:14.723992 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f9d1a55d-3331-4bd9-841c-dff4fa3623f9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:14.747487 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f9d1a55d-3331-4bd9-841c-dff4fa3623f9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6" status: 200 len: 1477 microversion: 2.1 time: 0.420115 Sep 08 10:40:14.749101 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 444/912] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:14 2022] GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6 => generated 1477 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:14.760429 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d487fc06-a026-4a2e-8a18-a20f6379e131 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:14.761486 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d487fc06-a026-4a2e-8a18-a20f6379e131 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] [instance: 7dac6a5f-62eb-4c60-8904-f23e50e1dcc8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:14.784100 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d487fc06-a026-4a2e-8a18-a20f6379e131 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:14.784880 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d487fc06-a026-4a2e-8a18-a20f6379e131 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:14.799114 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d487fc06-a026-4a2e-8a18-a20f6379e131 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:14.801275 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d487fc06-a026-4a2e-8a18-a20f6379e131 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:14.802198 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d487fc06-a026-4a2e-8a18-a20f6379e131 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:14.803279 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d487fc06-a026-4a2e-8a18-a20f6379e131 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:14.936390 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6096d8ee-15fc-4772-97a3-7d589286d449 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:14.962626 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6096d8ee-15fc-4772-97a3-7d589286d449 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15" status: 200 len: 1361 microversion: 2.1 time: 0.869227 Sep 08 10:40:14.966478 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 469/913] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:14 2022] GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15 => generated 1361 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:14.982357 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-af86a479-3520-40cd-96e8-9d59beb4fc81 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:14.984633 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-af86a479-3520-40cd-96e8-9d59beb4fc81 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] [instance: 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:15.016105 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af86a479-3520-40cd-96e8-9d59beb4fc81 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:15.034866 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af86a479-3520-40cd-96e8-9d59beb4fc81 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:15.036067 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af86a479-3520-40cd-96e8-9d59beb4fc81 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:15.040679 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af86a479-3520-40cd-96e8-9d59beb4fc81 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:15.041597 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af86a479-3520-40cd-96e8-9d59beb4fc81 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:15.042241 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af86a479-3520-40cd-96e8-9d59beb4fc81 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:15.176037 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-af86a479-3520-40cd-96e8-9d59beb4fc81 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lazy-loading 'services' on Instance uuid 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:40:15.223529 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-af86a479-3520-40cd-96e8-9d59beb4fc81 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a" status: 200 len: 1929 microversion: 2.75 time: 0.255190 Sep 08 10:40:15.226744 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 470/914] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:40:14 2022] GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a => generated 1929 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:40:15.235911 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d8a4d6bb-04ef-42ec-a801-e1cdb0fac148 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:15.237246 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d8a4d6bb-04ef-42ec-a801-e1cdb0fac148 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] [instance: 60ad91da-8810-4117-8b13-ffe0c0e3714f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:15.249473 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d8a4d6bb-04ef-42ec-a801-e1cdb0fac148 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:15.250803 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d8a4d6bb-04ef-42ec-a801-e1cdb0fac148 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:15.251589 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d8a4d6bb-04ef-42ec-a801-e1cdb0fac148 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:15.253384 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d8a4d6bb-04ef-42ec-a801-e1cdb0fac148 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:15.254220 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d8a4d6bb-04ef-42ec-a801-e1cdb0fac148 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:15.254859 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d8a4d6bb-04ef-42ec-a801-e1cdb0fac148 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:15.477500 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d487fc06-a026-4a2e-8a18-a20f6379e131 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4cde361139445eb147c4f634ec663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5388c25cdb4a35ae8d58fa5b6cf125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:15.508754 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d487fc06-a026-4a2e-8a18-a20f6379e131 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] 10.222.0.27 "GET /compute/v2.1/servers/7dac6a5f-62eb-4c60-8904-f23e50e1dcc8" status: 200 len: 1388 microversion: 2.1 time: 0.756983 Sep 08 10:40:15.512251 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 445/915] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:14 2022] GET /compute/v2.1/servers/7dac6a5f-62eb-4c60-8904-f23e50e1dcc8 => generated 1388 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:15.531709 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-75760106-7d3c-4b16-8256-6b02a4fd7f07 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:15.536801 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-75760106-7d3c-4b16-8256-6b02a4fd7f07 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: f60a95b0-93ca-4e4d-a51f-1cb4bb05e1ab] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:15.560662 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-75760106-7d3c-4b16-8256-6b02a4fd7f07 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:15.562924 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-75760106-7d3c-4b16-8256-6b02a4fd7f07 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:15.568347 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-75760106-7d3c-4b16-8256-6b02a4fd7f07 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:15.570998 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-75760106-7d3c-4b16-8256-6b02a4fd7f07 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:15.572005 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-75760106-7d3c-4b16-8256-6b02a4fd7f07 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:15.572874 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-75760106-7d3c-4b16-8256-6b02a4fd7f07 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:15.877345 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d8a4d6bb-04ef-42ec-a801-e1cdb0fac148 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e7bb8eedfa46c487513057a67a9537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3674a3f87ee348428b195602234e4dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:15.912918 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d8a4d6bb-04ef-42ec-a801-e1cdb0fac148 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] 10.222.0.27 "GET /compute/v2.1/servers/60ad91da-8810-4117-8b13-ffe0c0e3714f" status: 200 len: 1331 microversion: 2.1 time: 0.684025 Sep 08 10:40:15.914538 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 471/916] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:15 2022] GET /compute/v2.1/servers/60ad91da-8810-4117-8b13-ffe0c0e3714f => generated 1331 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:15.934597 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1753e538-a270-461f-bc1d-ab1423ea2227 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:15.935491 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1753e538-a270-461f-bc1d-ab1423ea2227 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 923d2401-f860-4284-a580-37ed478720f6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:15.950800 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1753e538-a270-461f-bc1d-ab1423ea2227 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:15.952446 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1753e538-a270-461f-bc1d-ab1423ea2227 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:15.953191 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1753e538-a270-461f-bc1d-ab1423ea2227 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:15.954705 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1753e538-a270-461f-bc1d-ab1423ea2227 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:15.955237 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1753e538-a270-461f-bc1d-ab1423ea2227 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:15.955669 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1753e538-a270-461f-bc1d-ab1423ea2227 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:16.278040 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-75760106-7d3c-4b16-8256-6b02a4fd7f07 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:16.287830 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1753e538-a270-461f-bc1d-ab1423ea2227 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:16.288745 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-75760106-7d3c-4b16-8256-6b02a4fd7f07 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/f60a95b0-93ca-4e4d-a51f-1cb4bb05e1ab" status: 200 len: 1317 microversion: 2.1 time: 0.774793 Sep 08 10:40:16.291188 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 446/917] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:15 2022] GET /compute/v2.1/servers/f60a95b0-93ca-4e4d-a51f-1cb4bb05e1ab => generated 1317 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:16.297159 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ead63779-4249-4660-9242-c0180c9f7c29 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:16.301061 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ead63779-4249-4660-9242-c0180c9f7c29 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 133a5f12-39e5-4e0f-81dc-b1948c073f15] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:16.303489 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1753e538-a270-461f-bc1d-ab1423ea2227 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6" status: 200 len: 1477 microversion: 2.1 time: 0.384919 Sep 08 10:40:16.306138 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 472/918] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:15 2022] GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6 => generated 1477 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:16.306138 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-69c1d5c2-cc51-4f4e-b8ed-166bff12917f tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:16.306138 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-69c1d5c2-cc51-4f4e-b8ed-166bff12917f tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] [instance: 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:16.326860 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-69c1d5c2-cc51-4f4e-b8ed-166bff12917f tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:16.327610 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-69c1d5c2-cc51-4f4e-b8ed-166bff12917f tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:16.330682 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-69c1d5c2-cc51-4f4e-b8ed-166bff12917f tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:16.331796 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-69c1d5c2-cc51-4f4e-b8ed-166bff12917f tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:16.333265 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-69c1d5c2-cc51-4f4e-b8ed-166bff12917f tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:16.333842 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-69c1d5c2-cc51-4f4e-b8ed-166bff12917f tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:16.346480 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ead63779-4249-4660-9242-c0180c9f7c29 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:16.347267 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ead63779-4249-4660-9242-c0180c9f7c29 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:16.347815 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ead63779-4249-4660-9242-c0180c9f7c29 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:16.349360 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ead63779-4249-4660-9242-c0180c9f7c29 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:16.349949 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ead63779-4249-4660-9242-c0180c9f7c29 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:16.350483 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ead63779-4249-4660-9242-c0180c9f7c29 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:16.479746 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-69c1d5c2-cc51-4f4e-b8ed-166bff12917f tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lazy-loading 'services' on Instance uuid 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:40:16.518380 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-69c1d5c2-cc51-4f4e-b8ed-166bff12917f tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a" status: 200 len: 1929 microversion: 2.75 time: 0.211123 Sep 08 10:40:16.519618 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 473/919] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:40:16 2022] GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a => generated 1929 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:40:16.539333 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dde39d3d-d4bb-4c3a-91da-320e2a6937fb tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:16.540638 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-dde39d3d-d4bb-4c3a-91da-320e2a6937fb tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] [instance: 7dac6a5f-62eb-4c60-8904-f23e50e1dcc8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:16.550944 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dde39d3d-d4bb-4c3a-91da-320e2a6937fb tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:16.551797 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dde39d3d-d4bb-4c3a-91da-320e2a6937fb tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:16.553132 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dde39d3d-d4bb-4c3a-91da-320e2a6937fb tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:16.554043 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dde39d3d-d4bb-4c3a-91da-320e2a6937fb tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:16.555415 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dde39d3d-d4bb-4c3a-91da-320e2a6937fb tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:16.556392 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dde39d3d-d4bb-4c3a-91da-320e2a6937fb tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:16.705616 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ead63779-4249-4660-9242-c0180c9f7c29 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:16.723103 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ead63779-4249-4660-9242-c0180c9f7c29 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15" status: 200 len: 1361 microversion: 2.1 time: 0.429984 Sep 08 10:40:16.725190 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 447/920] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:16 2022] GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15 => generated 1361 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:16.733836 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-76c8948a-9b8b-4a36-a20e-db60cee3f9e1 req-97256dd9-8214-4423-a9d6-37c33c1fa735 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dac6a5f-62eb-4c60-8904-f23e50e1dcc8", "name": "network-vif-plugged", "status": "completed", "tag": "629f2b6c-399c-4a00-a715-4e34d0f557fe"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:40:16.759918 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-76c8948a-9b8b-4a36-a20e-db60cee3f9e1 req-97256dd9-8214-4423-a9d6-37c33c1fa735 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:16.763318 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-76c8948a-9b8b-4a36-a20e-db60cee3f9e1 req-97256dd9-8214-4423-a9d6-37c33c1fa735 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:16.764791 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-76c8948a-9b8b-4a36-a20e-db60cee3f9e1 req-97256dd9-8214-4423-a9d6-37c33c1fa735 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:16.785081 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-76c8948a-9b8b-4a36-a20e-db60cee3f9e1 req-97256dd9-8214-4423-a9d6-37c33c1fa735 service nova] Creating event network-vif-plugged:629f2b6c-399c-4a00-a715-4e34d0f557fe for instance 7dac6a5f-62eb-4c60-8904-f23e50e1dcc8 on n-h1-850501-12 Sep 08 10:40:16.793246 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-76c8948a-9b8b-4a36-a20e-db60cee3f9e1 req-97256dd9-8214-4423-a9d6-37c33c1fa735 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066348 Sep 08 10:40:16.794685 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 448/921] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:40:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:40:16.809069 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-dde39d3d-d4bb-4c3a-91da-320e2a6937fb tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4cde361139445eb147c4f634ec663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5388c25cdb4a35ae8d58fa5b6cf125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:16.822851 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-dde39d3d-d4bb-4c3a-91da-320e2a6937fb tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] 10.222.0.27 "GET /compute/v2.1/servers/7dac6a5f-62eb-4c60-8904-f23e50e1dcc8" status: 200 len: 1388 microversion: 2.1 time: 0.291043 Sep 08 10:40:16.824031 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 474/922] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:16 2022] GET /compute/v2.1/servers/7dac6a5f-62eb-4c60-8904-f23e50e1dcc8 => generated 1388 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:40:16.947825 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=8 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:40:16.949737 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=24 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:40:16.958095 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-46facd12-8969-4bfe-ad51-86c31f57fae0 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:16.959422 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-46facd12-8969-4bfe-ad51-86c31f57fae0 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] [instance: 60ad91da-8810-4117-8b13-ffe0c0e3714f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:16.972928 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-46facd12-8969-4bfe-ad51-86c31f57fae0 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:16.974056 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-46facd12-8969-4bfe-ad51-86c31f57fae0 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:16.974855 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-46facd12-8969-4bfe-ad51-86c31f57fae0 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:16.977312 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-46facd12-8969-4bfe-ad51-86c31f57fae0 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:16.978204 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-46facd12-8969-4bfe-ad51-86c31f57fae0 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:16.978959 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-46facd12-8969-4bfe-ad51-86c31f57fae0 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:17.291885 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-46facd12-8969-4bfe-ad51-86c31f57fae0 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e7bb8eedfa46c487513057a67a9537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3674a3f87ee348428b195602234e4dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:17.303167 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-46facd12-8969-4bfe-ad51-86c31f57fae0 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] 10.222.0.27 "GET /compute/v2.1/servers/60ad91da-8810-4117-8b13-ffe0c0e3714f" status: 200 len: 1331 microversion: 2.1 time: 0.358428 Sep 08 10:40:17.309642 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 449/923] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:16 2022] GET /compute/v2.1/servers/60ad91da-8810-4117-8b13-ffe0c0e3714f => generated 1331 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:17.314703 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5d77d113-37a8-46ff-8d33-b8c7430e15d7 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:17.315510 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5d77d113-37a8-46ff-8d33-b8c7430e15d7 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: f60a95b0-93ca-4e4d-a51f-1cb4bb05e1ab] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:17.332835 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5d77d113-37a8-46ff-8d33-b8c7430e15d7 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:17.338575 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5d77d113-37a8-46ff-8d33-b8c7430e15d7 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:17.339411 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5d77d113-37a8-46ff-8d33-b8c7430e15d7 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:17.340430 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8b4ab02b-0a70-4b7b-a4da-6151ce79ba4c tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:17.341258 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8b4ab02b-0a70-4b7b-a4da-6151ce79ba4c tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 923d2401-f860-4284-a580-37ed478720f6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:17.341453 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5d77d113-37a8-46ff-8d33-b8c7430e15d7 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:17.342456 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5d77d113-37a8-46ff-8d33-b8c7430e15d7 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:17.343398 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5d77d113-37a8-46ff-8d33-b8c7430e15d7 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:17.356809 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8b4ab02b-0a70-4b7b-a4da-6151ce79ba4c tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:17.356809 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8b4ab02b-0a70-4b7b-a4da-6151ce79ba4c tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:17.357220 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8b4ab02b-0a70-4b7b-a4da-6151ce79ba4c tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:17.357978 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8b4ab02b-0a70-4b7b-a4da-6151ce79ba4c tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:17.358431 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8b4ab02b-0a70-4b7b-a4da-6151ce79ba4c tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:17.358863 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8b4ab02b-0a70-4b7b-a4da-6151ce79ba4c tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:17.655770 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=8 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:40:17.668671 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5d77d113-37a8-46ff-8d33-b8c7430e15d7 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:17.678021 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5d77d113-37a8-46ff-8d33-b8c7430e15d7 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/f60a95b0-93ca-4e4d-a51f-1cb4bb05e1ab" status: 200 len: 1317 microversion: 2.1 time: 0.367007 Sep 08 10:40:17.699046 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 475/924] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:17 2022] GET /compute/v2.1/servers/f60a95b0-93ca-4e4d-a51f-1cb4bb05e1ab => generated 1317 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:17.706283 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-de1672cf-bd68-462b-8963-2dc7c7aba733 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:17.706915 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-de1672cf-bd68-462b-8963-2dc7c7aba733 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] [instance: 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:17.713380 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de1672cf-bd68-462b-8963-2dc7c7aba733 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:17.714174 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de1672cf-bd68-462b-8963-2dc7c7aba733 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:17.714772 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de1672cf-bd68-462b-8963-2dc7c7aba733 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:17.715933 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de1672cf-bd68-462b-8963-2dc7c7aba733 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:17.717183 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de1672cf-bd68-462b-8963-2dc7c7aba733 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:17.717774 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de1672cf-bd68-462b-8963-2dc7c7aba733 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:17.797343 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8b4ab02b-0a70-4b7b-a4da-6151ce79ba4c tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:17.820936 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8b4ab02b-0a70-4b7b-a4da-6151ce79ba4c tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6" status: 200 len: 1477 microversion: 2.1 time: 0.485036 Sep 08 10:40:17.840737 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 450/925] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:17 2022] GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6 => generated 1477 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:17.849989 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-32c3ad22-a930-4031-a667-b3f2383ecb6e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:17.851048 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-32c3ad22-a930-4031-a667-b3f2383ecb6e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 133a5f12-39e5-4e0f-81dc-b1948c073f15] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:17.860671 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-32c3ad22-a930-4031-a667-b3f2383ecb6e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:17.861653 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-32c3ad22-a930-4031-a667-b3f2383ecb6e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:17.862365 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-32c3ad22-a930-4031-a667-b3f2383ecb6e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:17.863566 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-32c3ad22-a930-4031-a667-b3f2383ecb6e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:17.864339 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-32c3ad22-a930-4031-a667-b3f2383ecb6e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:17.865098 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-32c3ad22-a930-4031-a667-b3f2383ecb6e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:18.035853 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-de1672cf-bd68-462b-8963-2dc7c7aba733 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lazy-loading 'services' on Instance uuid 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:40:18.088293 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-de1672cf-bd68-462b-8963-2dc7c7aba733 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a" status: 200 len: 1929 microversion: 2.75 time: 0.386795 Sep 08 10:40:18.088899 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 476/926] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:40:17 2022] GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a => generated 1929 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:40:18.112136 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-95dd80f0-5347-452d-b3f4-7deb5e85ce2d tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:18.112136 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-95dd80f0-5347-452d-b3f4-7deb5e85ce2d tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] [instance: 7dac6a5f-62eb-4c60-8904-f23e50e1dcc8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:18.127576 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-95dd80f0-5347-452d-b3f4-7deb5e85ce2d tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:18.127946 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-95dd80f0-5347-452d-b3f4-7deb5e85ce2d tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:18.128756 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-95dd80f0-5347-452d-b3f4-7deb5e85ce2d tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:18.135776 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-95dd80f0-5347-452d-b3f4-7deb5e85ce2d tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:18.136292 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-95dd80f0-5347-452d-b3f4-7deb5e85ce2d tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:18.136737 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-95dd80f0-5347-452d-b3f4-7deb5e85ce2d tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:18.316028 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-32c3ad22-a930-4031-a667-b3f2383ecb6e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:18.338450 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-32c3ad22-a930-4031-a667-b3f2383ecb6e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15" status: 200 len: 1361 microversion: 2.1 time: 0.495690 Sep 08 10:40:18.339393 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 451/927] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:17 2022] GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15 => generated 1361 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:18.346335 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-9c692ec0-82c1-4fa6-a705-022cf1f909c9 req-c942334d-3a34-4df2-a824-e00e27cb354a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60ad91da-8810-4117-8b13-ffe0c0e3714f", "tag": "f3291f9f-85d0-4bcc-8f0e-f2e1e4d5e84c"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:40:18.358870 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:40:18.362559 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-9c692ec0-82c1-4fa6-a705-022cf1f909c9 req-c942334d-3a34-4df2-a824-e00e27cb354a service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:18.363710 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-9c692ec0-82c1-4fa6-a705-022cf1f909c9 req-c942334d-3a34-4df2-a824-e00e27cb354a service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:18.364715 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-9c692ec0-82c1-4fa6-a705-022cf1f909c9 req-c942334d-3a34-4df2-a824-e00e27cb354a service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:18.368765 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-95dd80f0-5347-452d-b3f4-7deb5e85ce2d tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4cde361139445eb147c4f634ec663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5388c25cdb4a35ae8d58fa5b6cf125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:18.390384 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-95dd80f0-5347-452d-b3f4-7deb5e85ce2d tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] 10.222.0.27 "GET /compute/v2.1/servers/7dac6a5f-62eb-4c60-8904-f23e50e1dcc8" status: 200 len: 1388 microversion: 2.1 time: 0.299941 Sep 08 10:40:18.392195 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-9c692ec0-82c1-4fa6-a705-022cf1f909c9 req-c942334d-3a34-4df2-a824-e00e27cb354a service nova] Creating event network-changed:f3291f9f-85d0-4bcc-8f0e-f2e1e4d5e84c for instance 60ad91da-8810-4117-8b13-ffe0c0e3714f on n-h1-850501-12 Sep 08 10:40:18.392417 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 477/928] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:18 2022] GET /compute/v2.1/servers/7dac6a5f-62eb-4c60-8904-f23e50e1dcc8 => generated 1388 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:18.405058 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-9c692ec0-82c1-4fa6-a705-022cf1f909c9 req-c942334d-3a34-4df2-a824-e00e27cb354a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063665 Sep 08 10:40:18.406641 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4c22c49d-0ae7-44e9-a52b-5c169a70a62d tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:18.407183 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 452/929] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:40:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:40:18.408904 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4c22c49d-0ae7-44e9-a52b-5c169a70a62d tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] [instance: 60ad91da-8810-4117-8b13-ffe0c0e3714f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:18.425316 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c22c49d-0ae7-44e9-a52b-5c169a70a62d tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:18.426492 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c22c49d-0ae7-44e9-a52b-5c169a70a62d tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:18.427515 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c22c49d-0ae7-44e9-a52b-5c169a70a62d tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:18.428975 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c22c49d-0ae7-44e9-a52b-5c169a70a62d tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:18.430586 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c22c49d-0ae7-44e9-a52b-5c169a70a62d tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:18.431325 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c22c49d-0ae7-44e9-a52b-5c169a70a62d tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:18.437901 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:40:18.659761 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4c22c49d-0ae7-44e9-a52b-5c169a70a62d tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e7bb8eedfa46c487513057a67a9537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3674a3f87ee348428b195602234e4dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:18.695344 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4c22c49d-0ae7-44e9-a52b-5c169a70a62d tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] 10.222.0.27 "GET /compute/v2.1/servers/60ad91da-8810-4117-8b13-ffe0c0e3714f" status: 200 len: 1331 microversion: 2.1 time: 0.301154 Sep 08 10:40:18.696107 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 478/930] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:18 2022] GET /compute/v2.1/servers/60ad91da-8810-4117-8b13-ffe0c0e3714f => generated 1331 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:18.722689 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d34b2c5f-fa45-4049-bcac-82522276ed0d tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:18.727882 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d34b2c5f-fa45-4049-bcac-82522276ed0d tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: f60a95b0-93ca-4e4d-a51f-1cb4bb05e1ab] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:18.739374 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d34b2c5f-fa45-4049-bcac-82522276ed0d tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:18.740932 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d34b2c5f-fa45-4049-bcac-82522276ed0d tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:18.742671 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d34b2c5f-fa45-4049-bcac-82522276ed0d tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:18.744016 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d34b2c5f-fa45-4049-bcac-82522276ed0d tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:18.744960 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d34b2c5f-fa45-4049-bcac-82522276ed0d tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:18.745650 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d34b2c5f-fa45-4049-bcac-82522276ed0d tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:18.824258 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-7d7acd06-714f-476d-88ac-b4d5c1083594 req-5a24c0e5-fad5-4562-b8e4-39dbe0257002 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f60a95b0-93ca-4e4d-a51f-1cb4bb05e1ab", "name": "network-vif-plugged", "status": "completed", "tag": "0110c783-e116-4860-a329-1e610dbd18b3"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:40:18.838289 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-7d7acd06-714f-476d-88ac-b4d5c1083594 req-5a24c0e5-fad5-4562-b8e4-39dbe0257002 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:18.839234 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-7d7acd06-714f-476d-88ac-b4d5c1083594 req-5a24c0e5-fad5-4562-b8e4-39dbe0257002 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:18.840027 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-7d7acd06-714f-476d-88ac-b4d5c1083594 req-5a24c0e5-fad5-4562-b8e4-39dbe0257002 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:18.854148 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-7d7acd06-714f-476d-88ac-b4d5c1083594 req-5a24c0e5-fad5-4562-b8e4-39dbe0257002 service nova] Creating event network-vif-plugged:0110c783-e116-4860-a329-1e610dbd18b3 for instance f60a95b0-93ca-4e4d-a51f-1cb4bb05e1ab on n-h2-850501-12 Sep 08 10:40:18.862084 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-7d7acd06-714f-476d-88ac-b4d5c1083594 req-5a24c0e5-fad5-4562-b8e4-39dbe0257002 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045076 Sep 08 10:40:18.863603 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 479/931] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:40:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:40:18.871178 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2e466f8a-b773-4a9f-a570-256d5f18d5de tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:18.872229 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2e466f8a-b773-4a9f-a570-256d5f18d5de tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 923d2401-f860-4284-a580-37ed478720f6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:18.881967 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e466f8a-b773-4a9f-a570-256d5f18d5de tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:18.883171 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e466f8a-b773-4a9f-a570-256d5f18d5de tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:18.883929 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e466f8a-b773-4a9f-a570-256d5f18d5de tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:18.884845 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e466f8a-b773-4a9f-a570-256d5f18d5de tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:18.885561 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e466f8a-b773-4a9f-a570-256d5f18d5de tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:18.886152 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e466f8a-b773-4a9f-a570-256d5f18d5de tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:19.144778 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2e466f8a-b773-4a9f-a570-256d5f18d5de tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:19.214367 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2e466f8a-b773-4a9f-a570-256d5f18d5de tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6" status: 200 len: 1477 microversion: 2.1 time: 0.336662 Sep 08 10:40:19.243659 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 480/932] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:18 2022] GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6 => generated 1477 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:19.243953 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d34b2c5f-fa45-4049-bcac-82522276ed0d tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:19.257081 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ea14fe11-2270-4b29-a129-de5695e90e18 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:19.258047 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ea14fe11-2270-4b29-a129-de5695e90e18 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] [instance: 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:19.264461 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d34b2c5f-fa45-4049-bcac-82522276ed0d tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/f60a95b0-93ca-4e4d-a51f-1cb4bb05e1ab" status: 200 len: 1317 microversion: 2.1 time: 0.550342 Sep 08 10:40:19.265406 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 453/933] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:18 2022] GET /compute/v2.1/servers/f60a95b0-93ca-4e4d-a51f-1cb4bb05e1ab => generated 1317 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:19.269132 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea14fe11-2270-4b29-a129-de5695e90e18 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:19.271140 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea14fe11-2270-4b29-a129-de5695e90e18 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:19.271973 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea14fe11-2270-4b29-a129-de5695e90e18 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:19.273551 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea14fe11-2270-4b29-a129-de5695e90e18 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:19.276155 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea14fe11-2270-4b29-a129-de5695e90e18 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:19.278357 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea14fe11-2270-4b29-a129-de5695e90e18 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:19.390483 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3fadca24-2a81-44cc-8b3d-ab49f1df59f0 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:19.398121 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3fadca24-2a81-44cc-8b3d-ab49f1df59f0 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 133a5f12-39e5-4e0f-81dc-b1948c073f15] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:19.433398 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3fadca24-2a81-44cc-8b3d-ab49f1df59f0 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:19.434692 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3fadca24-2a81-44cc-8b3d-ab49f1df59f0 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:19.435061 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-ea14fe11-2270-4b29-a129-de5695e90e18 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lazy-loading 'services' on Instance uuid 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:40:19.435731 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3fadca24-2a81-44cc-8b3d-ab49f1df59f0 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:19.445903 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3fadca24-2a81-44cc-8b3d-ab49f1df59f0 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:19.447153 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3fadca24-2a81-44cc-8b3d-ab49f1df59f0 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:19.448018 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3fadca24-2a81-44cc-8b3d-ab49f1df59f0 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:19.467192 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ea14fe11-2270-4b29-a129-de5695e90e18 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a" status: 200 len: 1929 microversion: 2.75 time: 0.220657 Sep 08 10:40:19.468454 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 481/934] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:40:19 2022] GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a => generated 1929 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:40:19.475443 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6dbb2764-e0ed-4c25-8ca7-2d81a803d894 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:19.476946 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6dbb2764-e0ed-4c25-8ca7-2d81a803d894 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] [instance: 7dac6a5f-62eb-4c60-8904-f23e50e1dcc8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:19.487077 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6dbb2764-e0ed-4c25-8ca7-2d81a803d894 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:19.487658 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6dbb2764-e0ed-4c25-8ca7-2d81a803d894 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:19.488221 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6dbb2764-e0ed-4c25-8ca7-2d81a803d894 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:19.488998 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6dbb2764-e0ed-4c25-8ca7-2d81a803d894 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:19.489746 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6dbb2764-e0ed-4c25-8ca7-2d81a803d894 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:19.490535 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6dbb2764-e0ed-4c25-8ca7-2d81a803d894 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:19.729411 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6dbb2764-e0ed-4c25-8ca7-2d81a803d894 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4cde361139445eb147c4f634ec663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5388c25cdb4a35ae8d58fa5b6cf125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:19.743334 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6dbb2764-e0ed-4c25-8ca7-2d81a803d894 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] 10.222.0.27 "GET /compute/v2.1/servers/7dac6a5f-62eb-4c60-8904-f23e50e1dcc8" status: 200 len: 1587 microversion: 2.1 time: 0.271399 Sep 08 10:40:19.745335 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 482/935] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:19 2022] GET /compute/v2.1/servers/7dac6a5f-62eb-4c60-8904-f23e50e1dcc8 => generated 1587 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:19.752409 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4275bd7c-37bf-483e-973b-4900045367af tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:19.753051 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4275bd7c-37bf-483e-973b-4900045367af tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] [instance: 60ad91da-8810-4117-8b13-ffe0c0e3714f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:19.766118 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4275bd7c-37bf-483e-973b-4900045367af tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:19.766767 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4275bd7c-37bf-483e-973b-4900045367af tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:19.767183 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4275bd7c-37bf-483e-973b-4900045367af tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:19.768642 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4275bd7c-37bf-483e-973b-4900045367af tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:19.769841 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4275bd7c-37bf-483e-973b-4900045367af tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:19.770273 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4275bd7c-37bf-483e-973b-4900045367af tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:19.826376 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-3fadca24-2a81-44cc-8b3d-ab49f1df59f0 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:19.837173 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3fadca24-2a81-44cc-8b3d-ab49f1df59f0 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15" status: 200 len: 1361 microversion: 2.1 time: 0.454708 Sep 08 10:40:19.857176 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 454/936] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:19 2022] GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15 => generated 1361 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:40:19.864967 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6f70b3ba-6d51-464f-8570-f9a64387f380 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:19.867312 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6f70b3ba-6d51-464f-8570-f9a64387f380 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] [instance: 7dac6a5f-62eb-4c60-8904-f23e50e1dcc8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:19.875306 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6f70b3ba-6d51-464f-8570-f9a64387f380 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:19.877325 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6f70b3ba-6d51-464f-8570-f9a64387f380 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:19.878047 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6f70b3ba-6d51-464f-8570-f9a64387f380 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:19.879031 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6f70b3ba-6d51-464f-8570-f9a64387f380 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:19.880196 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6f70b3ba-6d51-464f-8570-f9a64387f380 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:19.880821 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6f70b3ba-6d51-464f-8570-f9a64387f380 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:19.966935 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4275bd7c-37bf-483e-973b-4900045367af tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e7bb8eedfa46c487513057a67a9537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3674a3f87ee348428b195602234e4dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:19.976004 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4275bd7c-37bf-483e-973b-4900045367af tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] 10.222.0.27 "GET /compute/v2.1/servers/60ad91da-8810-4117-8b13-ffe0c0e3714f" status: 200 len: 1331 microversion: 2.1 time: 0.229146 Sep 08 10:40:19.977551 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 483/937] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:19 2022] GET /compute/v2.1/servers/60ad91da-8810-4117-8b13-ffe0c0e3714f => generated 1331 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:20.040969 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6f70b3ba-6d51-464f-8570-f9a64387f380 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] 10.222.0.27 "GET /compute/v2.1/servers/7dac6a5f-62eb-4c60-8904-f23e50e1dcc8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.181723 Sep 08 10:40:20.046293 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 455/938] 10.222.0.27 () {58 vars in 1275 bytes} [Thu Sep 8 10:40:19 2022] GET /compute/v2.1/servers/7dac6a5f-62eb-4c60-8904-f23e50e1dcc8/os-interface => generated 284 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:40:20.267980 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-136fbcdf-feaa-420f-ae32-f0674e6a0561 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:20.268719 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-136fbcdf-feaa-420f-ae32-f0674e6a0561 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 923d2401-f860-4284-a580-37ed478720f6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:20.277269 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-136fbcdf-feaa-420f-ae32-f0674e6a0561 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:20.277839 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-136fbcdf-feaa-420f-ae32-f0674e6a0561 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:20.278334 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-136fbcdf-feaa-420f-ae32-f0674e6a0561 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:20.279279 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-136fbcdf-feaa-420f-ae32-f0674e6a0561 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:20.279745 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-136fbcdf-feaa-420f-ae32-f0674e6a0561 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:20.280177 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-136fbcdf-feaa-420f-ae32-f0674e6a0561 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:20.299228 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-98af922d-7562-4827-a112-bf3442d00a4f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:20.299899 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-98af922d-7562-4827-a112-bf3442d00a4f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: f60a95b0-93ca-4e4d-a51f-1cb4bb05e1ab] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:20.312042 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-98af922d-7562-4827-a112-bf3442d00a4f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:20.312559 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-98af922d-7562-4827-a112-bf3442d00a4f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:20.313005 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-98af922d-7562-4827-a112-bf3442d00a4f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:20.313768 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-98af922d-7562-4827-a112-bf3442d00a4f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:20.314250 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-98af922d-7562-4827-a112-bf3442d00a4f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:20.314666 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-98af922d-7562-4827-a112-bf3442d00a4f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:20.692039 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-98af922d-7562-4827-a112-bf3442d00a4f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:20.709569 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-98af922d-7562-4827-a112-bf3442d00a4f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/f60a95b0-93ca-4e4d-a51f-1cb4bb05e1ab" status: 200 len: 1317 microversion: 2.1 time: 0.414887 Sep 08 10:40:20.711903 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 456/939] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:20 2022] GET /compute/v2.1/servers/f60a95b0-93ca-4e4d-a51f-1cb4bb05e1ab => generated 1317 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:20.727903 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-87abf877-203a-4569-b836-b2ac6f67dbb5 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:20.731412 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-87abf877-203a-4569-b836-b2ac6f67dbb5 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] [instance: 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:20.754949 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-87abf877-203a-4569-b836-b2ac6f67dbb5 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:20.755976 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-87abf877-203a-4569-b836-b2ac6f67dbb5 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:20.756631 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-87abf877-203a-4569-b836-b2ac6f67dbb5 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:20.758525 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-87abf877-203a-4569-b836-b2ac6f67dbb5 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:20.759245 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-87abf877-203a-4569-b836-b2ac6f67dbb5 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:20.759895 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-87abf877-203a-4569-b836-b2ac6f67dbb5 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:20.782674 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-136fbcdf-feaa-420f-ae32-f0674e6a0561 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:20.796514 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-136fbcdf-feaa-420f-ae32-f0674e6a0561 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6" status: 200 len: 1477 microversion: 2.1 time: 0.532834 Sep 08 10:40:20.819238 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 484/940] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:20 2022] GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6 => generated 1477 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:40:20.889148 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4a446fce-6858-4a18-9137-0aeccddcf6bf tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:20.896609 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4a446fce-6858-4a18-9137-0aeccddcf6bf tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 133a5f12-39e5-4e0f-81dc-b1948c073f15] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:20.909868 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a446fce-6858-4a18-9137-0aeccddcf6bf tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:20.910759 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a446fce-6858-4a18-9137-0aeccddcf6bf tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:20.911929 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a446fce-6858-4a18-9137-0aeccddcf6bf tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:20.913309 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a446fce-6858-4a18-9137-0aeccddcf6bf tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:20.915340 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a446fce-6858-4a18-9137-0aeccddcf6bf tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:20.916085 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a446fce-6858-4a18-9137-0aeccddcf6bf tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:21.102763 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-87abf877-203a-4569-b836-b2ac6f67dbb5 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lazy-loading 'services' on Instance uuid 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:40:21.166393 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-87abf877-203a-4569-b836-b2ac6f67dbb5 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a" status: 200 len: 1929 microversion: 2.75 time: 0.451408 Sep 08 10:40:21.181439 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 457/941] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:40:20 2022] GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a => generated 1929 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:40:21.197483 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9e69087b-6b5d-412e-80bc-76da26d7dc12 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:21.197884 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9e69087b-6b5d-412e-80bc-76da26d7dc12 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] [instance: 60ad91da-8810-4117-8b13-ffe0c0e3714f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:21.214235 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e69087b-6b5d-412e-80bc-76da26d7dc12 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:21.216317 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e69087b-6b5d-412e-80bc-76da26d7dc12 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:21.218250 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e69087b-6b5d-412e-80bc-76da26d7dc12 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:21.219033 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e69087b-6b5d-412e-80bc-76da26d7dc12 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:21.220442 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e69087b-6b5d-412e-80bc-76da26d7dc12 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:21.220442 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e69087b-6b5d-412e-80bc-76da26d7dc12 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:21.394453 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4a446fce-6858-4a18-9137-0aeccddcf6bf tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:21.419858 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4a446fce-6858-4a18-9137-0aeccddcf6bf tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15" status: 200 len: 1361 microversion: 2.1 time: 0.555994 Sep 08 10:40:21.433749 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 485/942] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:20 2022] GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15 => generated 1361 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:21.544716 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9e69087b-6b5d-412e-80bc-76da26d7dc12 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e7bb8eedfa46c487513057a67a9537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3674a3f87ee348428b195602234e4dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:21.553789 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9e69087b-6b5d-412e-80bc-76da26d7dc12 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] 10.222.0.27 "GET /compute/v2.1/servers/60ad91da-8810-4117-8b13-ffe0c0e3714f" status: 200 len: 1331 microversion: 2.1 time: 0.371312 Sep 08 10:40:21.567574 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 458/943] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:21 2022] GET /compute/v2.1/servers/60ad91da-8810-4117-8b13-ffe0c0e3714f => generated 1331 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:21.758382 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4d44c535-35cb-4246-9e83-d7704a0ee5c7 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:21.759969 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4d44c535-35cb-4246-9e83-d7704a0ee5c7 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: f60a95b0-93ca-4e4d-a51f-1cb4bb05e1ab] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:21.773553 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4d44c535-35cb-4246-9e83-d7704a0ee5c7 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:21.774809 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4d44c535-35cb-4246-9e83-d7704a0ee5c7 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:21.775843 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4d44c535-35cb-4246-9e83-d7704a0ee5c7 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:21.777370 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4d44c535-35cb-4246-9e83-d7704a0ee5c7 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:21.778469 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4d44c535-35cb-4246-9e83-d7704a0ee5c7 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:21.779699 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4d44c535-35cb-4246-9e83-d7704a0ee5c7 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:21.892922 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8e5f087e-0dc7-4631-9110-4b5f91c410a3 tempest-FloatingIPDetailsNegativeTestJSON-2017989961 tempest-FloatingIPDetailsNegativeTestJSON-2017989961-project] Calling method '.version_select at 0x7f68e46c94c0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:22.005550 n-d-850501-12 devstack@n-api.service[128862]: DEBUG neutronclient.v2_0.client [None req-8e5f087e-0dc7-4631-9110-4b5f91c410a3 tempest-FloatingIPDetailsNegativeTestJSON-2017989961 tempest-FloatingIPDetailsNegativeTestJSON-2017989961-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 56eca82e-1146-4432-a0db-e6f4ae9d0228 could not be found", "detail": ""}} {{(pid=128862) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 08 10:40:22.006789 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-8e5f087e-0dc7-4631-9110-4b5f91c410a3 tempest-FloatingIPDetailsNegativeTestJSON-2017989961 tempest-FloatingIPDetailsNegativeTestJSON-2017989961-project] HTTP exception thrown: Floating IP not found for ID 56eca82e-1146-4432-a0db-e6f4ae9d0228 Sep 08 10:40:22.011159 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8e5f087e-0dc7-4631-9110-4b5f91c410a3 tempest-FloatingIPDetailsNegativeTestJSON-2017989961 tempest-FloatingIPDetailsNegativeTestJSON-2017989961-project] Request method failure captured: Sep 08 10:40:22.011159 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/os-floating-ips/56eca82e-1146-4432-a0db-e6f4ae9d0228 HTTP/1.1 Sep 08 10:40:22.011159 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:40:22.011159 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:40:22.011159 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:40:22.011159 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:40:22.011159 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:40:22.011159 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:40:22.011159 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:40:22.011159 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:40:22.011159 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcaVlzKKA8zi31md8VXJvLbb1-UTMYaIHLYaSQrrK5l14vjDGosGKq18OFb-RphtO7fxK-V-xz-H2LpsIHhx5iKLJCqWwDQjv2dFlFaFCM7XIqNOSdLHbZFkSsFFlGKZ1sMBGnqlZfESV5UDc3r2qmQlf49W-hhIGumlaThmsaj2Z8c Sep 08 10:40:22.011159 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:40:22.011159 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:40:22.011159 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:40:22.011159 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:40:22.011159 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:40:22.011159 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:40:22.011159 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 03e3a410498040e4aff40ab3a3935349 Sep 08 10:40:22.011159 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-2017989961 Sep 08 10:40:22.011159 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:40:22.011159 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:40:22.013552 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/03e3a410498040e4aff40ab3a3935349"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/03e3a410498040e4aff40ab3a3935349"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_03e3a410498040e4aff40ab3a3935349"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/03e3a410498040e4aff40ab3a3935349"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:40:22.013552 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-2017989961 Sep 08 10:40:22.013552 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 03e3a410498040e4aff40ab3a3935349 Sep 08 10:40:22.013552 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-2017989961 Sep 08 10:40:22.013552 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-2017989961-project Sep 08 10:40:22.013552 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:40:22.013552 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:40:22.013552 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: dbaab3017b104d4d897a10d74c14bf40 Sep 08 10:40:22.013552 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-2017989961-project Sep 08 10:40:22.013552 n-d-850501-12 devstack@n-api.service[128862]: method: Sep 08 10:40:22.013552 n-d-850501-12 devstack@n-api.service[128862]: exception: Floating IP not found for ID 56eca82e-1146-4432-a0db-e6f4ae9d0228 Sep 08 10:40:22.013552 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '56eca82e-1146-4432-a0db-e6f4ae9d0228'} Sep 08 10:40:22.015210 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:40:22.015210 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:22.015210 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 08 10:40:22.015210 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 08 10:40:22.015210 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:40:22.015210 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:40:22.015210 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 08 10:40:22.015210 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 08 10:40:22.015210 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:40:22.015210 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:40:22.015210 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 08 10:40:22.015210 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 08 10:40:22.015210 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:40:22.015210 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:40:22.015210 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 08 10:40:22.015210 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 08 10:40:22.015210 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:40:22.015210 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:40:22.015210 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 08 10:40:22.017319 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 08 10:40:22.017319 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:40:22.017319 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:40:22.017319 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 08 10:40:22.017319 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 08 10:40:22.017319 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 08 10:40:22.017319 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 08 10:40:22.017319 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 56eca82e-1146-4432-a0db-e6f4ae9d0228 could not be found Sep 08 10:40:22.017319 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-18b0270e-df51-4233-97e6-a25fa838eb4a'] Sep 08 10:40:22.017319 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:22.017319 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:40:22.017319 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:22.017319 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:22.017319 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Sep 08 10:40:22.017319 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 08 10:40:22.017319 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 08 10:40:22.017319 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 08 10:40:22.017319 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 56eca82e-1146-4432-a0db-e6f4ae9d0228. Sep 08 10:40:22.017319 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:22.019489 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:40:22.019489 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:22.019489 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:22.019489 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:40:22.019489 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:40:22.019489 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:40:22.019489 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:40:22.019489 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:40:22.019489 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:40:22.019489 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:40:22.019489 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:40:22.019489 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Sep 08 10:40:22.019489 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 08 10:40:22.019489 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 56eca82e-1146-4432-a0db-e6f4ae9d0228 Sep 08 10:40:22.019489 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:22.019489 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:40:22.019489 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:22.019489 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:22.019489 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:40:22.019489 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:40:22.019489 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:40:22.025372 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:40:22.025372 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 56eca82e-1146-4432-a0db-e6f4ae9d0228 Sep 08 10:40:22.025372 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:22.025372 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8e5f087e-0dc7-4631-9110-4b5f91c410a3 tempest-FloatingIPDetailsNegativeTestJSON-2017989961 tempest-FloatingIPDetailsNegativeTestJSON-2017989961-project] Returning 404 to user: Floating IP not found for ID 56eca82e-1146-4432-a0db-e6f4ae9d0228 {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:40:22.025372 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8e5f087e-0dc7-4631-9110-4b5f91c410a3 tempest-FloatingIPDetailsNegativeTestJSON-2017989961 tempest-FloatingIPDetailsNegativeTestJSON-2017989961-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips/56eca82e-1146-4432-a0db-e6f4ae9d0228" status: 404 len: 111 microversion: 2.1 time: 0.351957 Sep 08 10:40:22.031768 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 486/944] 10.222.0.27 () {58 vars in 1260 bytes} [Thu Sep 8 10:40:21 2022] GET /compute/v2.1/os-floating-ips/56eca82e-1146-4432-a0db-e6f4ae9d0228 => generated 111 bytes in 362 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:40:22.049914 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0bf2572f-ea0a-4777-ba51-82a7cf65f340 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:22.051582 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0bf2572f-ea0a-4777-ba51-82a7cf65f340 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 923d2401-f860-4284-a580-37ed478720f6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:22.066424 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0bf2572f-ea0a-4777-ba51-82a7cf65f340 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:22.068035 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0bf2572f-ea0a-4777-ba51-82a7cf65f340 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:22.069146 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0bf2572f-ea0a-4777-ba51-82a7cf65f340 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:22.071402 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0bf2572f-ea0a-4777-ba51-82a7cf65f340 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:22.072519 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0bf2572f-ea0a-4777-ba51-82a7cf65f340 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:22.073823 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0bf2572f-ea0a-4777-ba51-82a7cf65f340 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:22.546064 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4d44c535-35cb-4246-9e83-d7704a0ee5c7 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:22.561063 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4d44c535-35cb-4246-9e83-d7704a0ee5c7 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/f60a95b0-93ca-4e4d-a51f-1cb4bb05e1ab" status: 200 len: 1466 microversion: 2.1 time: 0.810369 Sep 08 10:40:22.577702 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 459/945] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:21 2022] GET /compute/v2.1/servers/f60a95b0-93ca-4e4d-a51f-1cb4bb05e1ab => generated 1466 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:22.609811 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a782ae1c-0378-4108-a88d-e56a95a028bf tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:22.617769 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a782ae1c-0378-4108-a88d-e56a95a028bf tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] [instance: 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:22.635708 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a782ae1c-0378-4108-a88d-e56a95a028bf tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:22.636225 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a782ae1c-0378-4108-a88d-e56a95a028bf tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:22.636934 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a782ae1c-0378-4108-a88d-e56a95a028bf tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:22.638133 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a782ae1c-0378-4108-a88d-e56a95a028bf tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:22.638908 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a782ae1c-0378-4108-a88d-e56a95a028bf tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:22.639665 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a782ae1c-0378-4108-a88d-e56a95a028bf tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:22.797890 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-a782ae1c-0378-4108-a88d-e56a95a028bf tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lazy-loading 'services' on Instance uuid 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:40:22.824893 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a782ae1c-0378-4108-a88d-e56a95a028bf tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a" status: 200 len: 1929 microversion: 2.75 time: 0.245329 Sep 08 10:40:22.826117 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 460/946] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:40:22 2022] GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a => generated 1929 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:40:22.854959 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c9001128-efa3-4492-9f5c-4a164cfc772e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:22.856283 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c9001128-efa3-4492-9f5c-4a164cfc772e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 133a5f12-39e5-4e0f-81dc-b1948c073f15] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:22.866441 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c9001128-efa3-4492-9f5c-4a164cfc772e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:22.868757 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c9001128-efa3-4492-9f5c-4a164cfc772e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:22.870051 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c9001128-efa3-4492-9f5c-4a164cfc772e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:22.871113 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c9001128-efa3-4492-9f5c-4a164cfc772e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:22.871828 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c9001128-efa3-4492-9f5c-4a164cfc772e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:22.872572 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c9001128-efa3-4492-9f5c-4a164cfc772e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:23.013760 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0bf2572f-ea0a-4777-ba51-82a7cf65f340 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:23.026708 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0bf2572f-ea0a-4777-ba51-82a7cf65f340 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6" status: 200 len: 1477 microversion: 2.1 time: 0.991981 Sep 08 10:40:23.027536 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 487/947] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:22 2022] GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6 => generated 1477 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:23.046809 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-86369a83-26f1-4159-9d83-2241d08822bc tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:23.047589 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-86369a83-26f1-4159-9d83-2241d08822bc tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] [instance: 60ad91da-8810-4117-8b13-ffe0c0e3714f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:23.069395 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-86369a83-26f1-4159-9d83-2241d08822bc tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:23.070427 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-86369a83-26f1-4159-9d83-2241d08822bc tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:23.070974 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-86369a83-26f1-4159-9d83-2241d08822bc tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:23.082843 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-86369a83-26f1-4159-9d83-2241d08822bc tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:23.083719 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-86369a83-26f1-4159-9d83-2241d08822bc tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:23.084523 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-86369a83-26f1-4159-9d83-2241d08822bc tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:23.161542 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c9001128-efa3-4492-9f5c-4a164cfc772e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:23.166640 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=100 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:40:23.176468 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c9001128-efa3-4492-9f5c-4a164cfc772e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15" status: 200 len: 1361 microversion: 2.1 time: 0.337064 Sep 08 10:40:23.197087 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 461/948] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:22 2022] GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15 => generated 1361 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:23.203248 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-154ed785-1f29-466a-9343-4da769a37ad5 tempest-ServersOnMultiNodesTest-60601867 tempest-ServersOnMultiNodesTest-60601867-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:23.204267 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-154ed785-1f29-466a-9343-4da769a37ad5 tempest-ServersOnMultiNodesTest-60601867 tempest-ServersOnMultiNodesTest-60601867-project-admin] [instance: f60a95b0-93ca-4e4d-a51f-1cb4bb05e1ab] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:23.213431 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-154ed785-1f29-466a-9343-4da769a37ad5 tempest-ServersOnMultiNodesTest-60601867 tempest-ServersOnMultiNodesTest-60601867-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:23.214424 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-154ed785-1f29-466a-9343-4da769a37ad5 tempest-ServersOnMultiNodesTest-60601867 tempest-ServersOnMultiNodesTest-60601867-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:23.215040 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-154ed785-1f29-466a-9343-4da769a37ad5 tempest-ServersOnMultiNodesTest-60601867 tempest-ServersOnMultiNodesTest-60601867-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:23.216070 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-154ed785-1f29-466a-9343-4da769a37ad5 tempest-ServersOnMultiNodesTest-60601867 tempest-ServersOnMultiNodesTest-60601867-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:23.216531 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-154ed785-1f29-466a-9343-4da769a37ad5 tempest-ServersOnMultiNodesTest-60601867 tempest-ServersOnMultiNodesTest-60601867-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:23.217224 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-154ed785-1f29-466a-9343-4da769a37ad5 tempest-ServersOnMultiNodesTest-60601867 tempest-ServersOnMultiNodesTest-60601867-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:23.422712 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-154ed785-1f29-466a-9343-4da769a37ad5 tempest-ServersOnMultiNodesTest-60601867 tempest-ServersOnMultiNodesTest-60601867-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/f60a95b0-93ca-4e4d-a51f-1cb4bb05e1ab" status: 200 len: 1619 microversion: 2.1 time: 0.223680 Sep 08 10:40:23.437104 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 462/949] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:23 2022] GET /compute/v2.1/servers/f60a95b0-93ca-4e4d-a51f-1cb4bb05e1ab => generated 1619 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:23.444338 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-39fa3e29-c1ed-4992-9d29-98b7608c8630 req-26cb1d27-c20a-477c-b5ee-b705d466a868 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "133a5f12-39e5-4e0f-81dc-b1948c073f15", "name": "network-vif-plugged", "status": "completed", "tag": "f7bbb779-b8ca-4ca2-b84e-e3203ed8de69"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:40:23.459657 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-39fa3e29-c1ed-4992-9d29-98b7608c8630 req-26cb1d27-c20a-477c-b5ee-b705d466a868 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:23.461394 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-39fa3e29-c1ed-4992-9d29-98b7608c8630 req-26cb1d27-c20a-477c-b5ee-b705d466a868 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:23.462055 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-39fa3e29-c1ed-4992-9d29-98b7608c8630 req-26cb1d27-c20a-477c-b5ee-b705d466a868 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:23.479070 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-39fa3e29-c1ed-4992-9d29-98b7608c8630 req-26cb1d27-c20a-477c-b5ee-b705d466a868 service nova] Creating event network-vif-plugged:f7bbb779-b8ca-4ca2-b84e-e3203ed8de69 for instance 133a5f12-39e5-4e0f-81dc-b1948c073f15 on n-h2-850501-12 Sep 08 10:40:23.484555 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-39fa3e29-c1ed-4992-9d29-98b7608c8630 req-26cb1d27-c20a-477c-b5ee-b705d466a868 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047161 Sep 08 10:40:23.485678 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 463/950] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:40:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:40:23.497225 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8e35758f-3322-4487-a766-b7a3884f6a92 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:23.498316 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8e35758f-3322-4487-a766-b7a3884f6a92 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: f60a95b0-93ca-4e4d-a51f-1cb4bb05e1ab] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:23.505692 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8e35758f-3322-4487-a766-b7a3884f6a92 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:23.506759 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8e35758f-3322-4487-a766-b7a3884f6a92 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:23.509086 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8e35758f-3322-4487-a766-b7a3884f6a92 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:23.510555 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8e35758f-3322-4487-a766-b7a3884f6a92 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:23.511569 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8e35758f-3322-4487-a766-b7a3884f6a92 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:23.513431 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8e35758f-3322-4487-a766-b7a3884f6a92 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:23.555789 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8e35758f-3322-4487-a766-b7a3884f6a92 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: f60a95b0-93ca-4e4d-a51f-1cb4bb05e1ab] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:40:23.747210 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-86369a83-26f1-4159-9d83-2241d08822bc tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e7bb8eedfa46c487513057a67a9537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3674a3f87ee348428b195602234e4dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:23.757337 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8e35758f-3322-4487-a766-b7a3884f6a92 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f60a95b0-93ca-4e4d-a51f-1cb4bb05e1ab" status: 204 len: 0 microversion: 2.1 time: 0.269182 Sep 08 10:40:23.758255 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-86369a83-26f1-4159-9d83-2241d08822bc tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] 10.222.0.27 "GET /compute/v2.1/servers/60ad91da-8810-4117-8b13-ffe0c0e3714f" status: 200 len: 1331 microversion: 2.1 time: 0.729435 Sep 08 10:40:23.761139 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 464/951] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:40:23 2022] DELETE /compute/v2.1/servers/f60a95b0-93ca-4e4d-a51f-1cb4bb05e1ab => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:40:23.765319 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 488/952] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:23 2022] GET /compute/v2.1/servers/60ad91da-8810-4117-8b13-ffe0c0e3714f => generated 1331 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:23.783512 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0157472c-45e6-406e-ba50-813b0699467a tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:23.789967 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0157472c-45e6-406e-ba50-813b0699467a tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: f60a95b0-93ca-4e4d-a51f-1cb4bb05e1ab] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:23.805609 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0157472c-45e6-406e-ba50-813b0699467a tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:23.807374 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d567e29b-04d0-487b-bcae-2f797c6cb4b2 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:23.808334 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0157472c-45e6-406e-ba50-813b0699467a tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:23.808825 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d567e29b-04d0-487b-bcae-2f797c6cb4b2 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] [instance: 7dac6a5f-62eb-4c60-8904-f23e50e1dcc8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:23.810555 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0157472c-45e6-406e-ba50-813b0699467a tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:23.812951 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0157472c-45e6-406e-ba50-813b0699467a tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:23.813716 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0157472c-45e6-406e-ba50-813b0699467a tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:23.814554 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0157472c-45e6-406e-ba50-813b0699467a tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:23.820952 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d567e29b-04d0-487b-bcae-2f797c6cb4b2 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:23.824787 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d567e29b-04d0-487b-bcae-2f797c6cb4b2 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:23.825693 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d567e29b-04d0-487b-bcae-2f797c6cb4b2 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:23.827688 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d567e29b-04d0-487b-bcae-2f797c6cb4b2 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:23.830896 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d567e29b-04d0-487b-bcae-2f797c6cb4b2 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:23.831658 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d567e29b-04d0-487b-bcae-2f797c6cb4b2 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:24.095740 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0157472c-45e6-406e-ba50-813b0699467a tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:24.113411 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0157472c-45e6-406e-ba50-813b0699467a tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/f60a95b0-93ca-4e4d-a51f-1cb4bb05e1ab" status: 200 len: 1472 microversion: 2.1 time: 0.346258 Sep 08 10:40:24.113656 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 465/953] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:23 2022] GET /compute/v2.1/servers/f60a95b0-93ca-4e4d-a51f-1cb4bb05e1ab => generated 1472 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:24.119554 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-e04a7d9c-9474-4aae-b37a-f302658081a2 req-092d7b0f-732f-467e-b4f9-98f78bbf1ec2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dac6a5f-62eb-4c60-8904-f23e50e1dcc8", "tag": "629f2b6c-399c-4a00-a715-4e34d0f557fe"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:40:24.129869 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-e04a7d9c-9474-4aae-b37a-f302658081a2 req-092d7b0f-732f-467e-b4f9-98f78bbf1ec2 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:24.130358 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-e04a7d9c-9474-4aae-b37a-f302658081a2 req-092d7b0f-732f-467e-b4f9-98f78bbf1ec2 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:24.130784 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-e04a7d9c-9474-4aae-b37a-f302658081a2 req-092d7b0f-732f-467e-b4f9-98f78bbf1ec2 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:24.146350 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-e04a7d9c-9474-4aae-b37a-f302658081a2 req-092d7b0f-732f-467e-b4f9-98f78bbf1ec2 service nova] Creating event network-changed:629f2b6c-399c-4a00-a715-4e34d0f557fe for instance 7dac6a5f-62eb-4c60-8904-f23e50e1dcc8 on n-h1-850501-12 Sep 08 10:40:24.152499 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-e04a7d9c-9474-4aae-b37a-f302658081a2 req-092d7b0f-732f-467e-b4f9-98f78bbf1ec2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037392 Sep 08 10:40:24.153461 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 466/954] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:40:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:40:24.159420 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4a28142c-6c71-4982-a78a-45599e9c6c6b tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:24.160197 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4a28142c-6c71-4982-a78a-45599e9c6c6b tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] [instance: 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:24.171854 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a28142c-6c71-4982-a78a-45599e9c6c6b tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:24.173489 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a28142c-6c71-4982-a78a-45599e9c6c6b tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:24.174246 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a28142c-6c71-4982-a78a-45599e9c6c6b tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:24.175403 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a28142c-6c71-4982-a78a-45599e9c6c6b tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:24.176157 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a28142c-6c71-4982-a78a-45599e9c6c6b tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:24.176734 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a28142c-6c71-4982-a78a-45599e9c6c6b tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:24.329357 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-4a28142c-6c71-4982-a78a-45599e9c6c6b tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lazy-loading 'services' on Instance uuid 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:40:24.350457 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4a28142c-6c71-4982-a78a-45599e9c6c6b tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a" status: 200 len: 1929 microversion: 2.75 time: 0.195619 Sep 08 10:40:24.352199 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 467/955] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:40:24 2022] GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a => generated 1929 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:40:24.359088 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6179b465-e5ef-4768-aea9-433ac279baf5 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:24.359929 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6179b465-e5ef-4768-aea9-433ac279baf5 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 923d2401-f860-4284-a580-37ed478720f6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:24.385431 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6179b465-e5ef-4768-aea9-433ac279baf5 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:24.389722 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6179b465-e5ef-4768-aea9-433ac279baf5 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:24.390866 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6179b465-e5ef-4768-aea9-433ac279baf5 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:24.394007 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6179b465-e5ef-4768-aea9-433ac279baf5 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:24.394908 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6179b465-e5ef-4768-aea9-433ac279baf5 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:24.397607 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6179b465-e5ef-4768-aea9-433ac279baf5 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:24.405344 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d567e29b-04d0-487b-bcae-2f797c6cb4b2 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4cde361139445eb147c4f634ec663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5388c25cdb4a35ae8d58fa5b6cf125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:24.416799 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d567e29b-04d0-487b-bcae-2f797c6cb4b2 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] 10.222.0.27 "GET /compute/v2.1/servers/7dac6a5f-62eb-4c60-8904-f23e50e1dcc8" status: 200 len: 1587 microversion: 2.1 time: 0.615142 Sep 08 10:40:24.417450 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 489/956] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:23 2022] GET /compute/v2.1/servers/7dac6a5f-62eb-4c60-8904-f23e50e1dcc8 => generated 1587 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:40:24.423896 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2a99c4de-fd2f-437e-bed4-2245cd23665f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:24.425608 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2a99c4de-fd2f-437e-bed4-2245cd23665f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 133a5f12-39e5-4e0f-81dc-b1948c073f15] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:24.438777 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2a99c4de-fd2f-437e-bed4-2245cd23665f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:24.440095 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2a99c4de-fd2f-437e-bed4-2245cd23665f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:24.440808 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2a99c4de-fd2f-437e-bed4-2245cd23665f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:24.442328 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2a99c4de-fd2f-437e-bed4-2245cd23665f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:24.444048 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2a99c4de-fd2f-437e-bed4-2245cd23665f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:24.446305 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2a99c4de-fd2f-437e-bed4-2245cd23665f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:24.716746 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6179b465-e5ef-4768-aea9-433ac279baf5 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:24.729622 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6179b465-e5ef-4768-aea9-433ac279baf5 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6" status: 200 len: 1477 microversion: 2.1 time: 0.376144 Sep 08 10:40:24.731124 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 468/957] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:24 2022] GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6 => generated 1477 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:24.802973 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9465edca-0d96-45f0-9fa7-57cd61fa4792 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:24.805514 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9465edca-0d96-45f0-9fa7-57cd61fa4792 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] [instance: 60ad91da-8810-4117-8b13-ffe0c0e3714f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:24.815404 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9465edca-0d96-45f0-9fa7-57cd61fa4792 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:24.819033 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9465edca-0d96-45f0-9fa7-57cd61fa4792 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:24.819033 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9465edca-0d96-45f0-9fa7-57cd61fa4792 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:24.821042 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9465edca-0d96-45f0-9fa7-57cd61fa4792 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:24.821640 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9465edca-0d96-45f0-9fa7-57cd61fa4792 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:24.822342 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9465edca-0d96-45f0-9fa7-57cd61fa4792 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:25.072931 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9465edca-0d96-45f0-9fa7-57cd61fa4792 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e7bb8eedfa46c487513057a67a9537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3674a3f87ee348428b195602234e4dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:25.087392 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9465edca-0d96-45f0-9fa7-57cd61fa4792 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] 10.222.0.27 "GET /compute/v2.1/servers/60ad91da-8810-4117-8b13-ffe0c0e3714f" status: 200 len: 1331 microversion: 2.1 time: 0.292757 Sep 08 10:40:25.088688 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 469/958] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:24 2022] GET /compute/v2.1/servers/60ad91da-8810-4117-8b13-ffe0c0e3714f => generated 1331 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:25.107585 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2a99c4de-fd2f-437e-bed4-2245cd23665f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:25.120930 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2a99c4de-fd2f-437e-bed4-2245cd23665f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15" status: 200 len: 1361 microversion: 2.1 time: 0.702008 Sep 08 10:40:25.122277 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 490/959] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:24 2022] GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15 => generated 1361 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:25.157195 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-badc5837-8c39-49ee-b558-d3f559492cf6 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:25.159033 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-badc5837-8c39-49ee-b558-d3f559492cf6 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: f60a95b0-93ca-4e4d-a51f-1cb4bb05e1ab] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:25.173516 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-badc5837-8c39-49ee-b558-d3f559492cf6 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:25.174383 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-badc5837-8c39-49ee-b558-d3f559492cf6 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:25.175167 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-badc5837-8c39-49ee-b558-d3f559492cf6 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:25.176539 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-badc5837-8c39-49ee-b558-d3f559492cf6 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:25.177650 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-badc5837-8c39-49ee-b558-d3f559492cf6 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:25.178561 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-badc5837-8c39-49ee-b558-d3f559492cf6 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:25.405886 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f9fa4db2-e728-43c3-9a65-f4e48ae8d011 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:25.407854 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f9fa4db2-e728-43c3-9a65-f4e48ae8d011 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] [instance: 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:25.425723 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f9fa4db2-e728-43c3-9a65-f4e48ae8d011 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:25.427814 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f9fa4db2-e728-43c3-9a65-f4e48ae8d011 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:25.431338 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f9fa4db2-e728-43c3-9a65-f4e48ae8d011 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:25.435678 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f9fa4db2-e728-43c3-9a65-f4e48ae8d011 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:25.436853 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f9fa4db2-e728-43c3-9a65-f4e48ae8d011 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:25.438347 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f9fa4db2-e728-43c3-9a65-f4e48ae8d011 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:25.575693 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-badc5837-8c39-49ee-b558-d3f559492cf6 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:25.585603 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-badc5837-8c39-49ee-b558-d3f559492cf6 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/f60a95b0-93ca-4e4d-a51f-1cb4bb05e1ab" status: 200 len: 1472 microversion: 2.1 time: 0.436938 Sep 08 10:40:25.587351 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 470/960] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:25 2022] GET /compute/v2.1/servers/f60a95b0-93ca-4e4d-a51f-1cb4bb05e1ab => generated 1472 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:25.615744 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-51bcf59a-4210-492c-97cc-366a49045435 req-d24bb6ed-9bac-4309-8433-708f5fe10f4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60ad91da-8810-4117-8b13-ffe0c0e3714f", "name": "network-vif-plugged", "status": "completed", "tag": "f3291f9f-85d0-4bcc-8f0e-f2e1e4d5e84c"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:40:25.630264 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-51bcf59a-4210-492c-97cc-366a49045435 req-d24bb6ed-9bac-4309-8433-708f5fe10f4e service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:25.630870 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-51bcf59a-4210-492c-97cc-366a49045435 req-d24bb6ed-9bac-4309-8433-708f5fe10f4e service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:25.631367 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-51bcf59a-4210-492c-97cc-366a49045435 req-d24bb6ed-9bac-4309-8433-708f5fe10f4e service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:25.663255 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-f9fa4db2-e728-43c3-9a65-f4e48ae8d011 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lazy-loading 'services' on Instance uuid 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:40:25.675538 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-51bcf59a-4210-492c-97cc-366a49045435 req-d24bb6ed-9bac-4309-8433-708f5fe10f4e service nova] Creating event network-vif-plugged:f3291f9f-85d0-4bcc-8f0e-f2e1e4d5e84c for instance 60ad91da-8810-4117-8b13-ffe0c0e3714f on n-h1-850501-12 Sep 08 10:40:25.687169 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-51bcf59a-4210-492c-97cc-366a49045435 req-d24bb6ed-9bac-4309-8433-708f5fe10f4e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084768 Sep 08 10:40:25.688835 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 471/961] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:40:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:40:25.748628 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f9fa4db2-e728-43c3-9a65-f4e48ae8d011 tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a" status: 200 len: 1929 microversion: 2.75 time: 0.348269 Sep 08 10:40:25.792621 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-965f9341-fba6-4c1f-947a-61e6eb65fe92 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:25.808760 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 491/962] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:40:25 2022] GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a => generated 1929 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:40:25.812034 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-965f9341-fba6-4c1f-947a-61e6eb65fe92 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 923d2401-f860-4284-a580-37ed478720f6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:25.827278 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-965f9341-fba6-4c1f-947a-61e6eb65fe92 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:25.827781 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-965f9341-fba6-4c1f-947a-61e6eb65fe92 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:25.831239 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-965f9341-fba6-4c1f-947a-61e6eb65fe92 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:25.832070 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-965f9341-fba6-4c1f-947a-61e6eb65fe92 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:25.832748 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-965f9341-fba6-4c1f-947a-61e6eb65fe92 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:25.833231 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-965f9341-fba6-4c1f-947a-61e6eb65fe92 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:26.113456 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-017c804f-6b7e-41f7-a554-a8c3fa7be73c tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:26.114422 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-017c804f-6b7e-41f7-a554-a8c3fa7be73c tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] [instance: 60ad91da-8810-4117-8b13-ffe0c0e3714f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:26.137462 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-017c804f-6b7e-41f7-a554-a8c3fa7be73c tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:26.138291 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-017c804f-6b7e-41f7-a554-a8c3fa7be73c tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:26.138875 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-017c804f-6b7e-41f7-a554-a8c3fa7be73c tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:26.142889 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-017c804f-6b7e-41f7-a554-a8c3fa7be73c tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:26.149727 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-017c804f-6b7e-41f7-a554-a8c3fa7be73c tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:26.152609 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-017c804f-6b7e-41f7-a554-a8c3fa7be73c tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:26.422306 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-965f9341-fba6-4c1f-947a-61e6eb65fe92 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:26.440138 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-965f9341-fba6-4c1f-947a-61e6eb65fe92 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6" status: 200 len: 1477 microversion: 2.1 time: 0.667088 Sep 08 10:40:26.444097 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 472/963] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:25 2022] GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6 => generated 1477 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:26.457262 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-76c77645-4537-40e3-b932-e41d2c2652a6 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:26.467840 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-76c77645-4537-40e3-b932-e41d2c2652a6 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 133a5f12-39e5-4e0f-81dc-b1948c073f15] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:26.488220 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-76c77645-4537-40e3-b932-e41d2c2652a6 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:26.489112 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-76c77645-4537-40e3-b932-e41d2c2652a6 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:26.490294 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-76c77645-4537-40e3-b932-e41d2c2652a6 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:26.492298 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-76c77645-4537-40e3-b932-e41d2c2652a6 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:26.495570 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-76c77645-4537-40e3-b932-e41d2c2652a6 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:26.496651 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-76c77645-4537-40e3-b932-e41d2c2652a6 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:26.633598 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-017c804f-6b7e-41f7-a554-a8c3fa7be73c tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e7bb8eedfa46c487513057a67a9537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3674a3f87ee348428b195602234e4dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:26.653692 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-017c804f-6b7e-41f7-a554-a8c3fa7be73c tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] 10.222.0.27 "GET /compute/v2.1/servers/60ad91da-8810-4117-8b13-ffe0c0e3714f" status: 200 len: 1331 microversion: 2.1 time: 0.545000 Sep 08 10:40:26.655047 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 492/964] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:26 2022] GET /compute/v2.1/servers/60ad91da-8810-4117-8b13-ffe0c0e3714f => generated 1331 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:26.665675 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b65bfc1a-d7b7-4942-9ec7-cbb59b6d9ca8 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:26.667429 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b65bfc1a-d7b7-4942-9ec7-cbb59b6d9ca8 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: f60a95b0-93ca-4e4d-a51f-1cb4bb05e1ab] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:26.703540 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b65bfc1a-d7b7-4942-9ec7-cbb59b6d9ca8 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:26.705370 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b65bfc1a-d7b7-4942-9ec7-cbb59b6d9ca8 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:26.706513 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b65bfc1a-d7b7-4942-9ec7-cbb59b6d9ca8 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:26.708819 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b65bfc1a-d7b7-4942-9ec7-cbb59b6d9ca8 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:26.709959 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b65bfc1a-d7b7-4942-9ec7-cbb59b6d9ca8 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:26.711078 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b65bfc1a-d7b7-4942-9ec7-cbb59b6d9ca8 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:27.141922 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-76c77645-4537-40e3-b932-e41d2c2652a6 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:27.152365 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-76c77645-4537-40e3-b932-e41d2c2652a6 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15" status: 200 len: 1543 microversion: 2.1 time: 0.703938 Sep 08 10:40:27.157344 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 473/965] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:26 2022] GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15 => generated 1543 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:27.181652 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8c997acf-d64d-48cf-97cb-70e6ce9f8abe tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:27.182672 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8c997acf-d64d-48cf-97cb-70e6ce9f8abe tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] [instance: 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:27.205764 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8c997acf-d64d-48cf-97cb-70e6ce9f8abe tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:27.206285 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8c997acf-d64d-48cf-97cb-70e6ce9f8abe tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:27.206726 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8c997acf-d64d-48cf-97cb-70e6ce9f8abe tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:27.207467 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8c997acf-d64d-48cf-97cb-70e6ce9f8abe tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:27.207966 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8c997acf-d64d-48cf-97cb-70e6ce9f8abe tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:27.208399 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8c997acf-d64d-48cf-97cb-70e6ce9f8abe tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:27.243542 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b65bfc1a-d7b7-4942-9ec7-cbb59b6d9ca8 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:27.290761 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b65bfc1a-d7b7-4942-9ec7-cbb59b6d9ca8 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/f60a95b0-93ca-4e4d-a51f-1cb4bb05e1ab" status: 200 len: 1472 microversion: 2.1 time: 0.633893 Sep 08 10:40:27.302773 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 493/966] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:26 2022] GET /compute/v2.1/servers/f60a95b0-93ca-4e4d-a51f-1cb4bb05e1ab => generated 1472 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:27.324940 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-20344b15-d12c-49b4-91d9-c0c66e0adfc8 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:27.326988 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-20344b15-d12c-49b4-91d9-c0c66e0adfc8 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 133a5f12-39e5-4e0f-81dc-b1948c073f15] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:27.350486 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-20344b15-d12c-49b4-91d9-c0c66e0adfc8 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:27.356821 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-20344b15-d12c-49b4-91d9-c0c66e0adfc8 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:27.358318 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-20344b15-d12c-49b4-91d9-c0c66e0adfc8 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:27.362100 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-20344b15-d12c-49b4-91d9-c0c66e0adfc8 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:27.366863 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-20344b15-d12c-49b4-91d9-c0c66e0adfc8 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:27.368372 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-20344b15-d12c-49b4-91d9-c0c66e0adfc8 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:27.440631 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-8c997acf-d64d-48cf-97cb-70e6ce9f8abe tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lazy-loading 'services' on Instance uuid 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:40:27.539156 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8c997acf-d64d-48cf-97cb-70e6ce9f8abe tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a" status: 200 len: 1929 microversion: 2.75 time: 0.377383 Sep 08 10:40:27.549960 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 474/967] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:40:27 2022] GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a => generated 1929 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:40:27.571166 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-cf8126ca-bd10-45cb-9c9a-8d1b3e0d55c1 req-363bec7a-f922-4c8b-ae6f-53748aee29e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f60a95b0-93ca-4e4d-a51f-1cb4bb05e1ab", "name": "network-vif-deleted", "tag": "0110c783-e116-4860-a329-1e610dbd18b3"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:40:27.587889 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-cf8126ca-bd10-45cb-9c9a-8d1b3e0d55c1 req-363bec7a-f922-4c8b-ae6f-53748aee29e2 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:27.590510 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-cf8126ca-bd10-45cb-9c9a-8d1b3e0d55c1 req-363bec7a-f922-4c8b-ae6f-53748aee29e2 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:27.591131 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-cf8126ca-bd10-45cb-9c9a-8d1b3e0d55c1 req-363bec7a-f922-4c8b-ae6f-53748aee29e2 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:27.614566 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-cf8126ca-bd10-45cb-9c9a-8d1b3e0d55c1 req-363bec7a-f922-4c8b-ae6f-53748aee29e2 service nova] Creating event network-vif-deleted:0110c783-e116-4860-a329-1e610dbd18b3 for instance f60a95b0-93ca-4e4d-a51f-1cb4bb05e1ab on n-h2-850501-12 Sep 08 10:40:27.627185 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-cf8126ca-bd10-45cb-9c9a-8d1b3e0d55c1 req-363bec7a-f922-4c8b-ae6f-53748aee29e2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075321 Sep 08 10:40:27.639811 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 475/968] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:40:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:40:27.652584 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9d32c99d-9dc7-4e14-831e-416a7b08efd7 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:27.669070 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9d32c99d-9dc7-4e14-831e-416a7b08efd7 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 923d2401-f860-4284-a580-37ed478720f6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:27.694641 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9d32c99d-9dc7-4e14-831e-416a7b08efd7 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:27.695917 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9d32c99d-9dc7-4e14-831e-416a7b08efd7 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:27.695917 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9d32c99d-9dc7-4e14-831e-416a7b08efd7 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:27.696354 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9d32c99d-9dc7-4e14-831e-416a7b08efd7 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:27.696763 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9d32c99d-9dc7-4e14-831e-416a7b08efd7 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:27.697490 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9d32c99d-9dc7-4e14-831e-416a7b08efd7 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:27.753302 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-20344b15-d12c-49b4-91d9-c0c66e0adfc8 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.444417 Sep 08 10:40:27.754695 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 494/969] 10.222.0.27 () {58 vars in 1275 bytes} [Thu Sep 8 10:40:27 2022] GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15/os-interface => generated 284 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:40:27.775892 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a5856ea9-e32d-4c61-9dd5-0da307d3a723 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:27.777212 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a5856ea9-e32d-4c61-9dd5-0da307d3a723 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] [instance: 60ad91da-8810-4117-8b13-ffe0c0e3714f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:27.787708 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a5856ea9-e32d-4c61-9dd5-0da307d3a723 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:27.788785 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a5856ea9-e32d-4c61-9dd5-0da307d3a723 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:27.789820 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a5856ea9-e32d-4c61-9dd5-0da307d3a723 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:27.790963 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a5856ea9-e32d-4c61-9dd5-0da307d3a723 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:27.791710 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a5856ea9-e32d-4c61-9dd5-0da307d3a723 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:27.792369 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a5856ea9-e32d-4c61-9dd5-0da307d3a723 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:28.088383 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a5856ea9-e32d-4c61-9dd5-0da307d3a723 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e7bb8eedfa46c487513057a67a9537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3674a3f87ee348428b195602234e4dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:28.109371 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a5856ea9-e32d-4c61-9dd5-0da307d3a723 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] 10.222.0.27 "GET /compute/v2.1/servers/60ad91da-8810-4117-8b13-ffe0c0e3714f" status: 200 len: 1331 microversion: 2.1 time: 0.342310 Sep 08 10:40:28.110835 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 495/970] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:27 2022] GET /compute/v2.1/servers/60ad91da-8810-4117-8b13-ffe0c0e3714f => generated 1331 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:28.355109 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e4723aaf-6e93-403e-8097-1c7ec8b036d9 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:28.359395 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e4723aaf-6e93-403e-8097-1c7ec8b036d9 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: f60a95b0-93ca-4e4d-a51f-1cb4bb05e1ab] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:28.365382 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:40:28.375421 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e4723aaf-6e93-403e-8097-1c7ec8b036d9 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:28.376719 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e4723aaf-6e93-403e-8097-1c7ec8b036d9 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:28.377797 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e4723aaf-6e93-403e-8097-1c7ec8b036d9 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:28.379427 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e4723aaf-6e93-403e-8097-1c7ec8b036d9 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:28.380748 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e4723aaf-6e93-403e-8097-1c7ec8b036d9 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:28.381784 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e4723aaf-6e93-403e-8097-1c7ec8b036d9 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:28.422223 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:40:28.446174 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e4723aaf-6e93-403e-8097-1c7ec8b036d9 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:28.447064 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e4723aaf-6e93-403e-8097-1c7ec8b036d9 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:28.447672 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e4723aaf-6e93-403e-8097-1c7ec8b036d9 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:28.448292 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-e4723aaf-6e93-403e-8097-1c7ec8b036d9 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lazy-loading 'fault' on Instance uuid f60a95b0-93ca-4e4d-a51f-1cb4bb05e1ab {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:40:28.456260 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9d32c99d-9dc7-4e14-831e-416a7b08efd7 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:28.470348 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9d32c99d-9dc7-4e14-831e-416a7b08efd7 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6" status: 200 len: 1477 microversion: 2.1 time: 0.829154 Sep 08 10:40:28.471410 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 476/971] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:27 2022] GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6 => generated 1477 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:28.502961 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e4723aaf-6e93-403e-8097-1c7ec8b036d9 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:28.513672 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e4723aaf-6e93-403e-8097-1c7ec8b036d9 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/f60a95b0-93ca-4e4d-a51f-1cb4bb05e1ab" status: 200 len: 1307 microversion: 2.1 time: 0.167855 Sep 08 10:40:28.515206 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 496/972] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:28 2022] GET /compute/v2.1/servers/f60a95b0-93ca-4e4d-a51f-1cb4bb05e1ab => generated 1307 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:28.602553 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c72483e5-919c-491a-ae65-fc315a43c06e tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:28.603614 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c72483e5-919c-491a-ae65-fc315a43c06e tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] [instance: 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:28.610967 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c72483e5-919c-491a-ae65-fc315a43c06e tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:28.611650 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c72483e5-919c-491a-ae65-fc315a43c06e tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:28.612421 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c72483e5-919c-491a-ae65-fc315a43c06e tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:28.613305 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c72483e5-919c-491a-ae65-fc315a43c06e tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:28.614046 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c72483e5-919c-491a-ae65-fc315a43c06e tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:28.614726 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c72483e5-919c-491a-ae65-fc315a43c06e tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:28.861237 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-c72483e5-919c-491a-ae65-fc315a43c06e tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lazy-loading 'services' on Instance uuid 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:40:28.931560 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c72483e5-919c-491a-ae65-fc315a43c06e tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a" status: 200 len: 1929 microversion: 2.75 time: 0.333574 Sep 08 10:40:28.945693 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 477/973] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:40:28 2022] GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a => generated 1929 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:40:29.156809 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b5f42ec2-542f-434b-a7f4-fc2f4be9c70d tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:29.158320 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b5f42ec2-542f-434b-a7f4-fc2f4be9c70d tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] [instance: 60ad91da-8810-4117-8b13-ffe0c0e3714f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:29.169752 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b5f42ec2-542f-434b-a7f4-fc2f4be9c70d tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:29.171090 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b5f42ec2-542f-434b-a7f4-fc2f4be9c70d tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:29.172111 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b5f42ec2-542f-434b-a7f4-fc2f4be9c70d tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:29.173630 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b5f42ec2-542f-434b-a7f4-fc2f4be9c70d tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:29.174724 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b5f42ec2-542f-434b-a7f4-fc2f4be9c70d tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:29.175739 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b5f42ec2-542f-434b-a7f4-fc2f4be9c70d tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:29.424152 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b5f42ec2-542f-434b-a7f4-fc2f4be9c70d tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e7bb8eedfa46c487513057a67a9537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3674a3f87ee348428b195602234e4dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:29.438124 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b5f42ec2-542f-434b-a7f4-fc2f4be9c70d tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] 10.222.0.27 "GET /compute/v2.1/servers/60ad91da-8810-4117-8b13-ffe0c0e3714f" status: 200 len: 1534 microversion: 2.1 time: 0.289854 Sep 08 10:40:29.439143 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 497/974] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:29 2022] GET /compute/v2.1/servers/60ad91da-8810-4117-8b13-ffe0c0e3714f => generated 1534 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:29.482727 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5bcfdb72-e6d9-4c94-99a1-b50dbfb246b3 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Action: 'create', calling method: .version_select at 0x7f68e47104c0>, body: {"pool": "6c07d17e-5454-404f-a4da-2b5f7caefef4"} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:40:29.509196 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bc987770-0d88-487a-a58d-d2075c5d458c tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:29.509974 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bc987770-0d88-487a-a58d-d2075c5d458c tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 923d2401-f860-4284-a580-37ed478720f6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:29.521077 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bc987770-0d88-487a-a58d-d2075c5d458c tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:29.522392 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bc987770-0d88-487a-a58d-d2075c5d458c tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:29.524333 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bc987770-0d88-487a-a58d-d2075c5d458c tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:29.525745 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bc987770-0d88-487a-a58d-d2075c5d458c tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:29.526606 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bc987770-0d88-487a-a58d-d2075c5d458c tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:29.527404 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bc987770-0d88-487a-a58d-d2075c5d458c tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:29.775523 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bc987770-0d88-487a-a58d-d2075c5d458c tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:29.791674 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bc987770-0d88-487a-a58d-d2075c5d458c tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6" status: 200 len: 1477 microversion: 2.1 time: 0.287017 Sep 08 10:40:29.792528 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 498/975] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:29 2022] GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6 => generated 1477 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:40:29.801332 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-48287636-5e0d-4333-bbb8-510e54d89946 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:29.802523 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-48287636-5e0d-4333-bbb8-510e54d89946 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: f60a95b0-93ca-4e4d-a51f-1cb4bb05e1ab] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:29.811755 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-48287636-5e0d-4333-bbb8-510e54d89946 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:29.812563 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-48287636-5e0d-4333-bbb8-510e54d89946 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:29.813340 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-48287636-5e0d-4333-bbb8-510e54d89946 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:29.814395 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-48287636-5e0d-4333-bbb8-510e54d89946 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:29.814909 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-48287636-5e0d-4333-bbb8-510e54d89946 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:29.815584 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-48287636-5e0d-4333-bbb8-510e54d89946 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:29.870024 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-48287636-5e0d-4333-bbb8-510e54d89946 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:29.870865 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-48287636-5e0d-4333-bbb8-510e54d89946 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:29.871613 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-48287636-5e0d-4333-bbb8-510e54d89946 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:29.872452 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-48287636-5e0d-4333-bbb8-510e54d89946 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lazy-loading 'fault' on Instance uuid f60a95b0-93ca-4e4d-a51f-1cb4bb05e1ab {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:40:29.934723 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-48287636-5e0d-4333-bbb8-510e54d89946 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:29.949270 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-48287636-5e0d-4333-bbb8-510e54d89946 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/f60a95b0-93ca-4e4d-a51f-1cb4bb05e1ab" status: 200 len: 1307 microversion: 2.1 time: 0.154967 Sep 08 10:40:29.950248 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 499/976] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:29 2022] GET /compute/v2.1/servers/f60a95b0-93ca-4e4d-a51f-1cb4bb05e1ab => generated 1307 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:29.994261 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8e35d79b-a2b1-4b10-8094-5eefc2ed15ef tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:29.995334 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8e35d79b-a2b1-4b10-8094-5eefc2ed15ef tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] [instance: 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:30.008176 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e35d79b-a2b1-4b10-8094-5eefc2ed15ef tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:30.008944 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e35d79b-a2b1-4b10-8094-5eefc2ed15ef tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:30.010286 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e35d79b-a2b1-4b10-8094-5eefc2ed15ef tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:30.011246 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e35d79b-a2b1-4b10-8094-5eefc2ed15ef tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:30.011752 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e35d79b-a2b1-4b10-8094-5eefc2ed15ef tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:30.012246 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e35d79b-a2b1-4b10-8094-5eefc2ed15ef tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:30.149994 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-8e35d79b-a2b1-4b10-8094-5eefc2ed15ef tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lazy-loading 'services' on Instance uuid 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:40:30.182606 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8e35d79b-a2b1-4b10-8094-5eefc2ed15ef tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a" status: 200 len: 1935 microversion: 2.75 time: 0.196700 Sep 08 10:40:30.183419 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 500/977] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:40:29 2022] GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a => generated 1935 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:40:30.841496 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-af93b5f9-9a1b-43ea-b46b-52cbaf44eaf1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:30.843774 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-af93b5f9-9a1b-43ea-b46b-52cbaf44eaf1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 923d2401-f860-4284-a580-37ed478720f6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:30.854326 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af93b5f9-9a1b-43ea-b46b-52cbaf44eaf1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:30.854824 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af93b5f9-9a1b-43ea-b46b-52cbaf44eaf1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:30.855377 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af93b5f9-9a1b-43ea-b46b-52cbaf44eaf1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:30.856377 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af93b5f9-9a1b-43ea-b46b-52cbaf44eaf1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:30.856818 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af93b5f9-9a1b-43ea-b46b-52cbaf44eaf1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:30.857289 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af93b5f9-9a1b-43ea-b46b-52cbaf44eaf1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:31.132599 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-af93b5f9-9a1b-43ea-b46b-52cbaf44eaf1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:31.151001 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-af93b5f9-9a1b-43ea-b46b-52cbaf44eaf1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6" status: 200 len: 1477 microversion: 2.1 time: 0.322151 Sep 08 10:40:31.151942 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 501/978] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:30 2022] GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6 => generated 1477 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:40:31.183656 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9b361227-6000-4194-a923-90a88a68b490 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:31.184489 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9b361227-6000-4194-a923-90a88a68b490 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: f60a95b0-93ca-4e4d-a51f-1cb4bb05e1ab] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:31.195042 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9b361227-6000-4194-a923-90a88a68b490 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:31.195764 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9b361227-6000-4194-a923-90a88a68b490 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:31.196460 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9b361227-6000-4194-a923-90a88a68b490 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:31.202335 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9b361227-6000-4194-a923-90a88a68b490 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:31.202335 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9b361227-6000-4194-a923-90a88a68b490 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:31.202335 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9b361227-6000-4194-a923-90a88a68b490 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:31.224712 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-9b361227-6000-4194-a923-90a88a68b490 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] HTTP exception thrown: Instance f60a95b0-93ca-4e4d-a51f-1cb4bb05e1ab could not be found. Sep 08 10:40:31.226869 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9b361227-6000-4194-a923-90a88a68b490 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Request method failure captured: Sep 08 10:40:31.226869 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/f60a95b0-93ca-4e4d-a51f-1cb4bb05e1ab HTTP/1.1 Sep 08 10:40:31.226869 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:40:31.226869 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:40:31.226869 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:40:31.226869 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:40:31.226869 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:40:31.226869 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:40:31.226869 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:40:31.226869 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:40:31.226869 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcXsmHH1yoQtgpWVsTlKGRZ1RD9sGjJDO3R5IIX2mO0TzFlOkGo4Nrt9P8ms3HuxErnST87nkHuEi-VzkaDAC8r3keukBBYL9HR0teGPa-du_tj-nOftdvIVdc8Rf3uKj_SiRNumvszg8v8N8iSarJ11mQfNqN8vl0lBx8hzlRuGs8w Sep 08 10:40:31.226869 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:40:31.226869 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:40:31.226869 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:40:31.226869 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:40:31.226869 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:40:31.226869 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:40:31.226869 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 2a3d4a2ec8674e418602b6dc0cec6ab9 Sep 08 10:40:31.226869 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersOnMultiNodesTest-1266277988 Sep 08 10:40:31.226869 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:40:31.226869 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:40:31.229385 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2a3d4a2ec8674e418602b6dc0cec6ab9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2a3d4a2ec8674e418602b6dc0cec6ab9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2a3d4a2ec8674e418602b6dc0cec6ab9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2a3d4a2ec8674e418602b6dc0cec6ab9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:40:31.229385 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServersOnMultiNodesTest-1266277988 Sep 08 10:40:31.229385 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 2a3d4a2ec8674e418602b6dc0cec6ab9 Sep 08 10:40:31.229385 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1266277988 Sep 08 10:40:31.229385 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServersOnMultiNodesTest-1266277988-project Sep 08 10:40:31.229385 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:40:31.229385 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:40:31.229385 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 771c067cf6814084a5520128a970dc82 Sep 08 10:40:31.229385 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServersOnMultiNodesTest-1266277988-project Sep 08 10:40:31.229385 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:40:31.229385 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance f60a95b0-93ca-4e4d-a51f-1cb4bb05e1ab could not be found. Sep 08 10:40:31.229385 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'f60a95b0-93ca-4e4d-a51f-1cb4bb05e1ab'} Sep 08 10:40:31.231166 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:40:31.231166 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:31.231166 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:40:31.231166 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:40:31.231166 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:40:31.231166 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:40:31.231166 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:40:31.231166 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:40:31.231166 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:40:31.231166 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:40:31.231166 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f60a95b0-93ca-4e4d-a51f-1cb4bb05e1ab could not be found. Sep 08 10:40:31.231166 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:31.231166 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:40:31.231166 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:31.231166 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:31.231166 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:40:31.231166 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:40:31.231166 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:40:31.231166 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:40:31.231166 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:40:31.233782 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:40:31.233782 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:40:31.233782 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:40:31.233782 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:40:31.233782 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:40:31.233782 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:40:31.233782 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:40:31.233782 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f60a95b0-93ca-4e4d-a51f-1cb4bb05e1ab could not be found. Sep 08 10:40:31.233782 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:31.233782 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:40:31.233782 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:31.233782 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:31.233782 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:40:31.233782 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:40:31.233782 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:40:31.233782 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:40:31.233782 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f60a95b0-93ca-4e4d-a51f-1cb4bb05e1ab could not be found. Sep 08 10:40:31.233782 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:31.235852 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9b361227-6000-4194-a923-90a88a68b490 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Returning 404 to user: Instance f60a95b0-93ca-4e4d-a51f-1cb4bb05e1ab could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:40:31.235852 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9b361227-6000-4194-a923-90a88a68b490 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/f60a95b0-93ca-4e4d-a51f-1cb4bb05e1ab" status: 404 len: 111 microversion: 2.1 time: 0.050119 Sep 08 10:40:31.235852 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 502/979] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:31 2022] GET /compute/v2.1/servers/f60a95b0-93ca-4e4d-a51f-1cb4bb05e1ab => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:40:31.242370 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ca57c159-c973-4978-a09e-a4d5c8152f0e tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:31.243335 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ca57c159-c973-4978-a09e-a4d5c8152f0e tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] [instance: 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:31.251045 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ca57c159-c973-4978-a09e-a4d5c8152f0e tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:31.251554 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ca57c159-c973-4978-a09e-a4d5c8152f0e tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:31.251998 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ca57c159-c973-4978-a09e-a4d5c8152f0e tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:31.252715 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ca57c159-c973-4978-a09e-a4d5c8152f0e tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:31.253408 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ca57c159-c973-4978-a09e-a4d5c8152f0e tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:31.254023 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ca57c159-c973-4978-a09e-a4d5c8152f0e tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:31.394149 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-ca57c159-c973-4978-a09e-a4d5c8152f0e tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lazy-loading 'services' on Instance uuid 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:40:31.419203 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ca57c159-c973-4978-a09e-a4d5c8152f0e tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a" status: 200 len: 1935 microversion: 2.75 time: 0.181886 Sep 08 10:40:31.419836 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 503/980] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:40:31 2022] GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a => generated 1935 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:40:31.425054 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-12c99fa8-964e-4695-a079-3dc5e3860ad2 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:31.425845 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-12c99fa8-964e-4695-a079-3dc5e3860ad2 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: c04e1b8c-38c0-44c2-b02d-a6c1ca61d8cb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:31.433634 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12c99fa8-964e-4695-a079-3dc5e3860ad2 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:31.434453 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12c99fa8-964e-4695-a079-3dc5e3860ad2 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:31.435114 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12c99fa8-964e-4695-a079-3dc5e3860ad2 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:31.436215 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12c99fa8-964e-4695-a079-3dc5e3860ad2 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:31.436897 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12c99fa8-964e-4695-a079-3dc5e3860ad2 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:31.437628 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12c99fa8-964e-4695-a079-3dc5e3860ad2 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:31.503926 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-12c99fa8-964e-4695-a079-3dc5e3860ad2 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: c04e1b8c-38c0-44c2-b02d-a6c1ca61d8cb] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:40:31.627007 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-12c99fa8-964e-4695-a079-3dc5e3860ad2 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c04e1b8c-38c0-44c2-b02d-a6c1ca61d8cb" status: 204 len: 0 microversion: 2.1 time: 0.205001 Sep 08 10:40:31.629245 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 504/981] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:40:31 2022] DELETE /compute/v2.1/servers/c04e1b8c-38c0-44c2-b02d-a6c1ca61d8cb => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:40:31.643273 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c3a15374-8bc1-43df-acf2-3f7168890af2 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:31.645181 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c3a15374-8bc1-43df-acf2-3f7168890af2 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: c04e1b8c-38c0-44c2-b02d-a6c1ca61d8cb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:31.661985 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c3a15374-8bc1-43df-acf2-3f7168890af2 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:31.663176 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c3a15374-8bc1-43df-acf2-3f7168890af2 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:31.663974 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c3a15374-8bc1-43df-acf2-3f7168890af2 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:31.667567 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c3a15374-8bc1-43df-acf2-3f7168890af2 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:31.669161 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c3a15374-8bc1-43df-acf2-3f7168890af2 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:31.670264 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c3a15374-8bc1-43df-acf2-3f7168890af2 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:32.401641 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c3a15374-8bc1-43df-acf2-3f7168890af2 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:32.441581 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c3a15374-8bc1-43df-acf2-3f7168890af2 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/c04e1b8c-38c0-44c2-b02d-a6c1ca61d8cb" status: 200 len: 1472 microversion: 2.1 time: 0.806152 Sep 08 10:40:32.443051 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 505/982] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:31 2022] GET /compute/v2.1/servers/c04e1b8c-38c0-44c2-b02d-a6c1ca61d8cb => generated 1472 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:32.448916 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-190f5d30-36e2-41b9-93bd-b36507efd56d req-5a75f3e5-e180-429d-bb57-f55fc5f6a5f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "133a5f12-39e5-4e0f-81dc-b1948c073f15", "tag": "f7bbb779-b8ca-4ca2-b84e-e3203ed8de69"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:40:32.459504 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-190f5d30-36e2-41b9-93bd-b36507efd56d req-5a75f3e5-e180-429d-bb57-f55fc5f6a5f1 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:32.460569 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-190f5d30-36e2-41b9-93bd-b36507efd56d req-5a75f3e5-e180-429d-bb57-f55fc5f6a5f1 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:32.461249 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-190f5d30-36e2-41b9-93bd-b36507efd56d req-5a75f3e5-e180-429d-bb57-f55fc5f6a5f1 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:32.494067 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-190f5d30-36e2-41b9-93bd-b36507efd56d req-5a75f3e5-e180-429d-bb57-f55fc5f6a5f1 service nova] Creating event network-changed:f7bbb779-b8ca-4ca2-b84e-e3203ed8de69 for instance 133a5f12-39e5-4e0f-81dc-b1948c073f15 on n-h2-850501-12 Sep 08 10:40:32.501525 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-190f5d30-36e2-41b9-93bd-b36507efd56d req-5a75f3e5-e180-429d-bb57-f55fc5f6a5f1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056780 Sep 08 10:40:32.502487 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 506/983] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:40:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:40:32.524562 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c681943e-102c-4348-9bb0-2186c992632f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:32.530689 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c681943e-102c-4348-9bb0-2186c992632f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 923d2401-f860-4284-a580-37ed478720f6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:32.541176 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c681943e-102c-4348-9bb0-2186c992632f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:32.542729 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c681943e-102c-4348-9bb0-2186c992632f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:32.543409 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c681943e-102c-4348-9bb0-2186c992632f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:32.544293 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c681943e-102c-4348-9bb0-2186c992632f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:32.544770 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c681943e-102c-4348-9bb0-2186c992632f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:32.545243 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c681943e-102c-4348-9bb0-2186c992632f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:32.876186 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c681943e-102c-4348-9bb0-2186c992632f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:32.900182 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c681943e-102c-4348-9bb0-2186c992632f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6" status: 200 len: 1476 microversion: 2.1 time: 0.395403 Sep 08 10:40:32.901319 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 507/984] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:32 2022] GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6 => generated 1476 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:32.923173 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4233e061-c866-4d0c-ab46-dd957ec89ace tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:32.924169 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4233e061-c866-4d0c-ab46-dd957ec89ace tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] [instance: 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:32.938684 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4233e061-c866-4d0c-ab46-dd957ec89ace tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:32.939752 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4233e061-c866-4d0c-ab46-dd957ec89ace tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:32.940665 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4233e061-c866-4d0c-ab46-dd957ec89ace tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:32.942248 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4233e061-c866-4d0c-ab46-dd957ec89ace tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:32.943215 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4233e061-c866-4d0c-ab46-dd957ec89ace tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:32.944630 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4233e061-c866-4d0c-ab46-dd957ec89ace tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:33.095885 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-4233e061-c866-4d0c-ab46-dd957ec89ace tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] Lazy-loading 'services' on Instance uuid 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:40:33.119286 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4233e061-c866-4d0c-ab46-dd957ec89ace tempest-ServersAdmin275Test-744678993 tempest-ServersAdmin275Test-744678993-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a" status: 200 len: 1920 microversion: 2.75 time: 0.215977 Sep 08 10:40:33.120393 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 508/985] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:40:32 2022] GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a => generated 1920 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:40:33.174504 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-63fffab9-3fcf-4595-a2b1-740cce679301 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:33.175823 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-63fffab9-3fcf-4595-a2b1-740cce679301 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] [instance: 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:33.183696 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63fffab9-3fcf-4595-a2b1-740cce679301 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:33.184182 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63fffab9-3fcf-4595-a2b1-740cce679301 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:33.184629 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63fffab9-3fcf-4595-a2b1-740cce679301 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:33.185364 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63fffab9-3fcf-4595-a2b1-740cce679301 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:33.185960 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63fffab9-3fcf-4595-a2b1-740cce679301 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:33.186564 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63fffab9-3fcf-4595-a2b1-740cce679301 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:33.225455 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-63fffab9-3fcf-4595-a2b1-740cce679301 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] [instance: 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:40:33.284352 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:40:33.363534 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-63fffab9-3fcf-4595-a2b1-740cce679301 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a" status: 204 len: 0 microversion: 2.75 time: 0.194561 Sep 08 10:40:33.368467 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 509/986] 10.222.0.27 () {60 vars in 1280 bytes} [Thu Sep 8 10:40:33 2022] DELETE /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 10:40:33.387818 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bff0e7cb-e9ed-4049-8728-ba4ccaa0104c tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:33.389090 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bff0e7cb-e9ed-4049-8728-ba4ccaa0104c tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] [instance: 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:33.401483 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bff0e7cb-e9ed-4049-8728-ba4ccaa0104c tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:33.402348 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bff0e7cb-e9ed-4049-8728-ba4ccaa0104c tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:33.403150 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bff0e7cb-e9ed-4049-8728-ba4ccaa0104c tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:33.404790 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bff0e7cb-e9ed-4049-8728-ba4ccaa0104c tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:33.406066 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bff0e7cb-e9ed-4049-8728-ba4ccaa0104c tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:33.406967 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bff0e7cb-e9ed-4049-8728-ba4ccaa0104c tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:33.543360 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bff0e7cb-e9ed-4049-8728-ba4ccaa0104c tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:33.555331 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bff0e7cb-e9ed-4049-8728-ba4ccaa0104c tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:33.557491 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bff0e7cb-e9ed-4049-8728-ba4ccaa0104c tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:33.565538 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bff0e7cb-e9ed-4049-8728-ba4ccaa0104c tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] 10.222.0.27 "GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a" status: 200 len: 1443 microversion: 2.75 time: 0.193969 Sep 08 10:40:33.566877 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 510/987] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:40:33 2022] GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a => generated 1443 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:40:33.591244 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bdb0a5c2-937e-4b18-ba6f-d5c06277cddc tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:33.592901 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bdb0a5c2-937e-4b18-ba6f-d5c06277cddc tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: c04e1b8c-38c0-44c2-b02d-a6c1ca61d8cb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:33.603971 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bdb0a5c2-937e-4b18-ba6f-d5c06277cddc tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:33.604811 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bdb0a5c2-937e-4b18-ba6f-d5c06277cddc tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:33.605787 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bdb0a5c2-937e-4b18-ba6f-d5c06277cddc tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:33.608150 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bdb0a5c2-937e-4b18-ba6f-d5c06277cddc tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:33.608972 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bdb0a5c2-937e-4b18-ba6f-d5c06277cddc tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:33.609923 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bdb0a5c2-937e-4b18-ba6f-d5c06277cddc tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:34.065952 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bdb0a5c2-937e-4b18-ba6f-d5c06277cddc tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:34.077551 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bdb0a5c2-937e-4b18-ba6f-d5c06277cddc tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/c04e1b8c-38c0-44c2-b02d-a6c1ca61d8cb" status: 200 len: 1472 microversion: 2.1 time: 0.496168 Sep 08 10:40:34.084454 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 511/988] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:33 2022] GET /compute/v2.1/servers/c04e1b8c-38c0-44c2-b02d-a6c1ca61d8cb => generated 1472 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:34.098247 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dc9f3c9d-d9e0-41f0-977d-d3ad04e77f98 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:34.099500 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-dc9f3c9d-d9e0-41f0-977d-d3ad04e77f98 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 923d2401-f860-4284-a580-37ed478720f6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:34.118653 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dc9f3c9d-d9e0-41f0-977d-d3ad04e77f98 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:34.119486 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dc9f3c9d-d9e0-41f0-977d-d3ad04e77f98 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:34.120114 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dc9f3c9d-d9e0-41f0-977d-d3ad04e77f98 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:34.121120 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dc9f3c9d-d9e0-41f0-977d-d3ad04e77f98 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:34.121792 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dc9f3c9d-d9e0-41f0-977d-d3ad04e77f98 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:34.122403 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dc9f3c9d-d9e0-41f0-977d-d3ad04e77f98 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:34.639358 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-dc9f3c9d-d9e0-41f0-977d-d3ad04e77f98 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:34.649193 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-dc9f3c9d-d9e0-41f0-977d-d3ad04e77f98 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6" status: 200 len: 1476 microversion: 2.1 time: 0.562904 Sep 08 10:40:34.661064 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 512/989] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:34 2022] GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6 => generated 1476 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:34.661064 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-b6cad7ac-654c-4935-9610-dac2129c90e2 req-46ce447e-dd92-4290-bb43-9b0799f04cd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "923d2401-f860-4284-a580-37ed478720f6", "name": "network-vif-unplugged", "status": "completed", "tag": "bec27b4a-f6d6-449e-854b-1e502a76de67"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:40:34.668118 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b6cad7ac-654c-4935-9610-dac2129c90e2 req-46ce447e-dd92-4290-bb43-9b0799f04cd1 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:34.668118 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b6cad7ac-654c-4935-9610-dac2129c90e2 req-46ce447e-dd92-4290-bb43-9b0799f04cd1 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:34.668118 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b6cad7ac-654c-4935-9610-dac2129c90e2 req-46ce447e-dd92-4290-bb43-9b0799f04cd1 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:34.680984 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-b6cad7ac-654c-4935-9610-dac2129c90e2 req-46ce447e-dd92-4290-bb43-9b0799f04cd1 service nova] Creating event network-vif-unplugged:bec27b4a-f6d6-449e-854b-1e502a76de67 for instance 923d2401-f860-4284-a580-37ed478720f6 on n-h1-850501-12 Sep 08 10:40:34.687583 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [req-b6cad7ac-654c-4935-9610-dac2129c90e2 req-46ce447e-dd92-4290-bb43-9b0799f04cd1 service nova] Instance 923d2401-f860-4284-a580-37ed478720f6 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850501-12'} {{(pid=128862) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 10:40:34.696628 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-b6cad7ac-654c-4935-9610-dac2129c90e2 req-46ce447e-dd92-4290-bb43-9b0799f04cd1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044294 Sep 08 10:40:34.697416 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 513/990] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:40:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:40:34.706744 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-57d55dcd-1550-49ad-967f-f6f17afad06b tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:34.707924 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-57d55dcd-1550-49ad-967f-f6f17afad06b tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] [instance: 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:34.720893 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-57d55dcd-1550-49ad-967f-f6f17afad06b tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:34.721897 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-57d55dcd-1550-49ad-967f-f6f17afad06b tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:34.722706 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-57d55dcd-1550-49ad-967f-f6f17afad06b tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:34.724678 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-57d55dcd-1550-49ad-967f-f6f17afad06b tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:34.726393 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-57d55dcd-1550-49ad-967f-f6f17afad06b tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:34.727440 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-57d55dcd-1550-49ad-967f-f6f17afad06b tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:34.793744 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5bcfdb72-e6d9-4c94-99a1-b50dbfb246b3 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.318475 Sep 08 10:40:34.796014 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 478/991] 10.222.0.27 () {60 vars in 1170 bytes} [Thu Sep 8 10:40:29 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:40:34.810024 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f6e546b3-00dd-4f79-b524-e3902a24efd3 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Action: 'action', calling method: .version_select at 0x7f68e6d9c550>, body: {"addFloatingIp": {"address": "172.25.7.227"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:40:34.813238 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f6e546b3-00dd-4f79-b524-e3902a24efd3 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] [instance: 60ad91da-8810-4117-8b13-ffe0c0e3714f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:34.824147 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f6e546b3-00dd-4f79-b524-e3902a24efd3 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:34.824662 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f6e546b3-00dd-4f79-b524-e3902a24efd3 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:34.825118 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f6e546b3-00dd-4f79-b524-e3902a24efd3 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:34.825870 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f6e546b3-00dd-4f79-b524-e3902a24efd3 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:34.826416 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f6e546b3-00dd-4f79-b524-e3902a24efd3 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:34.827059 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f6e546b3-00dd-4f79-b524-e3902a24efd3 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:34.901429 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:40:34.908786 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f6e546b3-00dd-4f79-b524-e3902a24efd3 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Acquiring lock "refresh_cache-60ad91da-8810-4117-8b13-ffe0c0e3714f" {{(pid=128861) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 08 10:40:34.909508 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f6e546b3-00dd-4f79-b524-e3902a24efd3 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Acquired lock "refresh_cache-60ad91da-8810-4117-8b13-ffe0c0e3714f" {{(pid=128861) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 08 10:40:34.916976 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-57d55dcd-1550-49ad-967f-f6f17afad06b tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:34.930109 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-57d55dcd-1550-49ad-967f-f6f17afad06b tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:34.931650 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-57d55dcd-1550-49ad-967f-f6f17afad06b tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:34.943145 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-57d55dcd-1550-49ad-967f-f6f17afad06b tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] 10.222.0.27 "GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a" status: 200 len: 1443 microversion: 2.75 time: 0.244222 Sep 08 10:40:34.944500 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 514/992] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:40:34 2022] GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a => generated 1443 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:40:35.122040 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e5f9b80a-c412-4013-9ed6-4f488c7ed714 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:35.127020 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e5f9b80a-c412-4013-9ed6-4f488c7ed714 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: c04e1b8c-38c0-44c2-b02d-a6c1ca61d8cb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:35.144599 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e5f9b80a-c412-4013-9ed6-4f488c7ed714 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:35.146665 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e5f9b80a-c412-4013-9ed6-4f488c7ed714 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:35.152366 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e5f9b80a-c412-4013-9ed6-4f488c7ed714 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:35.154264 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e5f9b80a-c412-4013-9ed6-4f488c7ed714 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:35.155418 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e5f9b80a-c412-4013-9ed6-4f488c7ed714 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:35.156623 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e5f9b80a-c412-4013-9ed6-4f488c7ed714 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:35.306753 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e5f9b80a-c412-4013-9ed6-4f488c7ed714 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:35.322673 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e5f9b80a-c412-4013-9ed6-4f488c7ed714 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/c04e1b8c-38c0-44c2-b02d-a6c1ca61d8cb" status: 200 len: 1430 microversion: 2.1 time: 0.220245 Sep 08 10:40:35.337527 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 515/993] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:35 2022] GET /compute/v2.1/servers/c04e1b8c-38c0-44c2-b02d-a6c1ca61d8cb => generated 1430 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:40:35.523138 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-c8b97af4-4ff2-4e28-897c-e7eaa86b8898 req-e763d67e-fe13-43f8-be8b-26050e1b626f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c04e1b8c-38c0-44c2-b02d-a6c1ca61d8cb", "name": "network-vif-deleted", "tag": "a06cc3a1-f52a-4dfc-aee6-7025a0d03093"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:40:35.551443 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c8b97af4-4ff2-4e28-897c-e7eaa86b8898 req-e763d67e-fe13-43f8-be8b-26050e1b626f service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:35.552313 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c8b97af4-4ff2-4e28-897c-e7eaa86b8898 req-e763d67e-fe13-43f8-be8b-26050e1b626f service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:35.561486 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c8b97af4-4ff2-4e28-897c-e7eaa86b8898 req-e763d67e-fe13-43f8-be8b-26050e1b626f service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:35.599257 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-c8b97af4-4ff2-4e28-897c-e7eaa86b8898 req-e763d67e-fe13-43f8-be8b-26050e1b626f service nova] Creating event network-vif-deleted:a06cc3a1-f52a-4dfc-aee6-7025a0d03093 for instance c04e1b8c-38c0-44c2-b02d-a6c1ca61d8cb on n-h1-850501-12 Sep 08 10:40:35.638314 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-c8b97af4-4ff2-4e28-897c-e7eaa86b8898 req-e763d67e-fe13-43f8-be8b-26050e1b626f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135483 Sep 08 10:40:35.639421 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 516/994] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:40:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:40:35.681252 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a211b9a9-a81c-4de3-ba5a-f585d06dfc3e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:35.682877 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a211b9a9-a81c-4de3-ba5a-f585d06dfc3e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 923d2401-f860-4284-a580-37ed478720f6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:35.704597 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a211b9a9-a81c-4de3-ba5a-f585d06dfc3e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:35.705723 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a211b9a9-a81c-4de3-ba5a-f585d06dfc3e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:35.706354 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a211b9a9-a81c-4de3-ba5a-f585d06dfc3e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:35.707418 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a211b9a9-a81c-4de3-ba5a-f585d06dfc3e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:35.708228 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a211b9a9-a81c-4de3-ba5a-f585d06dfc3e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:35.708677 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a211b9a9-a81c-4de3-ba5a-f585d06dfc3e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:36.034091 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a211b9a9-a81c-4de3-ba5a-f585d06dfc3e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:36.046422 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a211b9a9-a81c-4de3-ba5a-f585d06dfc3e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6" status: 200 len: 1474 microversion: 2.1 time: 0.374463 Sep 08 10:40:36.061292 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 517/995] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:35 2022] GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6 => generated 1474 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:36.061292 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-87ae24bb-38f2-478c-b072-7860af15c097 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:36.061292 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-87ae24bb-38f2-478c-b072-7860af15c097 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] [instance: 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:36.071639 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87ae24bb-38f2-478c-b072-7860af15c097 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:36.072510 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87ae24bb-38f2-478c-b072-7860af15c097 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:36.073398 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87ae24bb-38f2-478c-b072-7860af15c097 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:36.075015 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87ae24bb-38f2-478c-b072-7860af15c097 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:36.076312 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87ae24bb-38f2-478c-b072-7860af15c097 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:36.076926 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87ae24bb-38f2-478c-b072-7860af15c097 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:36.216345 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87ae24bb-38f2-478c-b072-7860af15c097 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:36.216847 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87ae24bb-38f2-478c-b072-7860af15c097 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:36.217325 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87ae24bb-38f2-478c-b072-7860af15c097 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:36.217786 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-87ae24bb-38f2-478c-b072-7860af15c097 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lazy-loading 'fault' on Instance uuid 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:40:36.350972 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-87ae24bb-38f2-478c-b072-7860af15c097 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:36.372755 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-87ae24bb-38f2-478c-b072-7860af15c097 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:36.374565 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-87ae24bb-38f2-478c-b072-7860af15c097 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26c78589f2504ddd8985c82d4042ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a225d8dbbb4febbb470cb27da07cae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:36.392868 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-87ae24bb-38f2-478c-b072-7860af15c097 tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] 10.222.0.27 "GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a" status: 200 len: 1448 microversion: 2.75 time: 0.344121 Sep 08 10:40:36.394453 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 518/996] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:40:36 2022] GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a => generated 1448 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:40:36.403933 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e765df12-e109-421e-8d97-e89d519d2074 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:36.406989 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e765df12-e109-421e-8d97-e89d519d2074 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: c04e1b8c-38c0-44c2-b02d-a6c1ca61d8cb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:36.442614 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e765df12-e109-421e-8d97-e89d519d2074 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:36.443182 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e765df12-e109-421e-8d97-e89d519d2074 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:36.443638 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e765df12-e109-421e-8d97-e89d519d2074 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:36.445898 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e765df12-e109-421e-8d97-e89d519d2074 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:36.446751 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e765df12-e109-421e-8d97-e89d519d2074 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:36.447507 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e765df12-e109-421e-8d97-e89d519d2074 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:36.669058 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e765df12-e109-421e-8d97-e89d519d2074 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:36.687872 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e765df12-e109-421e-8d97-e89d519d2074 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/c04e1b8c-38c0-44c2-b02d-a6c1ca61d8cb" status: 200 len: 1430 microversion: 2.1 time: 0.290560 Sep 08 10:40:36.698219 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 519/997] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:36 2022] GET /compute/v2.1/servers/c04e1b8c-38c0-44c2-b02d-a6c1ca61d8cb => generated 1430 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:36.915848 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-44c03a7b-615b-4fec-bafd-5efb656eb78d tempest-KeyPairsV2TestJSON-1585091982 tempest-KeyPairsV2TestJSON-1585091982-project] Action: 'create', calling method: .version_select at 0x7f68e4748af0>, body: {"keypair": {"name": "tempest-keypair-1863151258", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJSqO+vEJPwjITHQG57raSZDRQBhUy/4I8Jerup6NFmGNKWsJPchgTMiUX4rBFajBLAS4uAsgW8g0T9J4M3X7yfr0pmgUyTNMvbg0bqmthg48dgJgcVqxDQGeNxdK/AWrg=="}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:40:36.946654 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-44c03a7b-615b-4fec-bafd-5efb656eb78d tempest-KeyPairsV2TestJSON-1585091982 tempest-KeyPairsV2TestJSON-1585091982-project] Getting quotas for project 0ef0eecf09514ca7b4d299572c32ca69. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:40:36.953594 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-44c03a7b-615b-4fec-bafd-5efb656eb78d tempest-KeyPairsV2TestJSON-1585091982 tempest-KeyPairsV2TestJSON-1585091982-project] Getting quotas for user 97214a54116d45129528a781f99c62f6 and project 0ef0eecf09514ca7b4d299572c32ca69. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:40:36.994099 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-44c03a7b-615b-4fec-bafd-5efb656eb78d tempest-KeyPairsV2TestJSON-1585091982 tempest-KeyPairsV2TestJSON-1585091982-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.276506 Sep 08 10:40:36.995169 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 520/998] 10.222.0.27 () {60 vars in 1159 bytes} [Thu Sep 8 10:40:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:40:37.014999 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-18dfa52a-45ef-4951-b3ee-c18807ffc5f7 tempest-KeyPairsV2TestJSON-1585091982 tempest-KeyPairsV2TestJSON-1585091982-project] Calling method '.version_select at 0x7f68e464a940>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:37.027304 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-18dfa52a-45ef-4951-b3ee-c18807ffc5f7 tempest-KeyPairsV2TestJSON-1585091982 tempest-KeyPairsV2TestJSON-1585091982-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs/tempest-keypair-1863151258" status: 200 len: 497 microversion: 2.1 time: 0.019866 Sep 08 10:40:37.028218 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 521/999] 10.222.0.27 () {58 vars in 1218 bytes} [Thu Sep 8 10:40:37 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1863151258 => generated 497 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:40:37.041818 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-08b6e2ed-44a5-4ef8-ab6b-e9c008d7558c tempest-KeyPairsV2TestJSON-1585091982 tempest-KeyPairsV2TestJSON-1585091982-project] Calling method '.version_select at 0x7f68e464a430>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:37.078038 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-08b6e2ed-44a5-4ef8-ab6b-e9c008d7558c tempest-KeyPairsV2TestJSON-1585091982 tempest-KeyPairsV2TestJSON-1585091982-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1863151258" status: 202 len: 0 microversion: 2.1 time: 0.041976 Sep 08 10:40:37.079752 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 522/1000] 10.222.0.27 () {58 vars in 1221 bytes} [Thu Sep 8 10:40:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1863151258 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 10:40:37.093956 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9430cf62-d3c1-48b4-b0e8-9002317887da tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:37.094625 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9430cf62-d3c1-48b4-b0e8-9002317887da tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 923d2401-f860-4284-a580-37ed478720f6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:37.106079 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9430cf62-d3c1-48b4-b0e8-9002317887da tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:37.106079 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9430cf62-d3c1-48b4-b0e8-9002317887da tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:37.106298 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9430cf62-d3c1-48b4-b0e8-9002317887da tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:37.107078 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9430cf62-d3c1-48b4-b0e8-9002317887da tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:37.107444 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9430cf62-d3c1-48b4-b0e8-9002317887da tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:37.107873 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9430cf62-d3c1-48b4-b0e8-9002317887da tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:37.226932 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-f6e546b3-00dd-4f79-b524-e3902a24efd3 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] [instance: 60ad91da-8810-4117-8b13-ffe0c0e3714f] Building network info cache for instance {{(pid=128861) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 08 10:40:37.538904 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9430cf62-d3c1-48b4-b0e8-9002317887da tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:37.548416 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9430cf62-d3c1-48b4-b0e8-9002317887da tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6" status: 200 len: 1474 microversion: 2.1 time: 0.468561 Sep 08 10:40:37.549367 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 523/1001] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:37 2022] GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6 => generated 1474 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:37.582017 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9cace0b9-05a8-4762-8393-ede50296e14f tempest-KeyPairsV2TestJSON-1585091982 tempest-KeyPairsV2TestJSON-1585091982-project] Action: 'create', calling method: .version_select at 0x7f68e46df160>, body: {"keypair": {"name": "tempest-keypair-2025508916", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG0ZJeWALmsXEFxxMwceVNwbu/CIpbpcKulKf2cyXsQyrr7j/0tufPba2uYnbtN/sdfXy0qknSyABvAR6HaP7fo4ETiimJQyBRVgwLrz6SZt+xntX984aSnq44BBbNc5jA=="}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:40:37.606368 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:40:37.637611 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-9cace0b9-05a8-4762-8393-ede50296e14f tempest-KeyPairsV2TestJSON-1585091982 tempest-KeyPairsV2TestJSON-1585091982-project] Getting quotas for project 0ef0eecf09514ca7b4d299572c32ca69. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:40:37.645880 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-9cace0b9-05a8-4762-8393-ede50296e14f tempest-KeyPairsV2TestJSON-1585091982 tempest-KeyPairsV2TestJSON-1585091982-project] Getting quotas for user 97214a54116d45129528a781f99c62f6 and project 0ef0eecf09514ca7b4d299572c32ca69. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:40:37.728655 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9cace0b9-05a8-4762-8393-ede50296e14f tempest-KeyPairsV2TestJSON-1585091982 tempest-KeyPairsV2TestJSON-1585091982-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.165091 Sep 08 10:40:37.733625 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 524/1002] 10.222.0.27 () {60 vars in 1159 bytes} [Thu Sep 8 10:40:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:40:37.747814 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-7a31d6d0-9824-4fee-a397-2787c5b53a93 req-e3197e22-e20f-4bc5-a516-b95dd583733d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60ad91da-8810-4117-8b13-ffe0c0e3714f", "tag": "f3291f9f-85d0-4bcc-8f0e-f2e1e4d5e84c"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:40:37.774984 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-7a31d6d0-9824-4fee-a397-2787c5b53a93 req-e3197e22-e20f-4bc5-a516-b95dd583733d service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:37.775774 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-7a31d6d0-9824-4fee-a397-2787c5b53a93 req-e3197e22-e20f-4bc5-a516-b95dd583733d service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:37.776479 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-7a31d6d0-9824-4fee-a397-2787c5b53a93 req-e3197e22-e20f-4bc5-a516-b95dd583733d service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:37.836590 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-7a31d6d0-9824-4fee-a397-2787c5b53a93 req-e3197e22-e20f-4bc5-a516-b95dd583733d service nova] Creating event network-changed:f3291f9f-85d0-4bcc-8f0e-f2e1e4d5e84c for instance 60ad91da-8810-4117-8b13-ffe0c0e3714f on n-h1-850501-12 Sep 08 10:40:37.849848 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-7a31d6d0-9824-4fee-a397-2787c5b53a93 req-e3197e22-e20f-4bc5-a516-b95dd583733d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111583 Sep 08 10:40:37.858009 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 525/1003] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:40:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:40:37.894128 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bdbcce47-f3f3-474d-af0b-c63fc8614ebd tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:37.895991 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bdbcce47-f3f3-474d-af0b-c63fc8614ebd tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] [instance: 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:37.931849 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bdbcce47-f3f3-474d-af0b-c63fc8614ebd tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:37.933580 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bdbcce47-f3f3-474d-af0b-c63fc8614ebd tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:37.934710 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bdbcce47-f3f3-474d-af0b-c63fc8614ebd tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:37.936154 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bdbcce47-f3f3-474d-af0b-c63fc8614ebd tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:37.938242 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bdbcce47-f3f3-474d-af0b-c63fc8614ebd tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:37.940206 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bdbcce47-f3f3-474d-af0b-c63fc8614ebd tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:38.000628 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-bdbcce47-f3f3-474d-af0b-c63fc8614ebd tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] HTTP exception thrown: Instance 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a could not be found. Sep 08 10:40:38.006205 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bdbcce47-f3f3-474d-af0b-c63fc8614ebd tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Request method failure captured: Sep 08 10:40:38.006205 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a HTTP/1.1 Sep 08 10:40:38.006205 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:40:38.006205 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:40:38.006205 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:40:38.006205 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:40:38.006205 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:40:38.006205 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:40:38.006205 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:40:38.006205 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:40:38.006205 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcZVrX3z5DdEk0mfynhOT7RW2ufSB8gxPV_-uNmG6KRCIBAMbSnhwYeO_xuC5N6s3K28jqMlXlQgEcSdg-3rI8sJlpemo75LNjCZ-gowaw2EpwM76eSEDsxoHo_qCr7nhdnoekBPkQ1GWQR8A02LT2xSemWdXCUE3kPtYSadKdTYs7Y Sep 08 10:40:38.006205 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:40:38.006205 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:40:38.006205 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:40:38.006205 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:40:38.006205 n-d-850501-12 devstack@n-api.service[128862]: X-Openstack-Nova-Api-Version: 2.75 Sep 08 10:40:38.006205 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:40:38.006205 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:40:38.006205 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 61a225d8dbbb4febbb470cb27da07cae Sep 08 10:40:38.006205 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersAdmin275Test-1051993311 Sep 08 10:40:38.006205 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:40:38.006205 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:40:38.009817 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/61a225d8dbbb4febbb470cb27da07cae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/61a225d8dbbb4febbb470cb27da07cae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_61a225d8dbbb4febbb470cb27da07cae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/61a225d8dbbb4febbb470cb27da07cae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:40:38.009817 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServersAdmin275Test-1051993311 Sep 08 10:40:38.009817 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 61a225d8dbbb4febbb470cb27da07cae Sep 08 10:40:38.009817 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersAdmin275Test-1051993311 Sep 08 10:40:38.009817 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServersAdmin275Test-1051993311-project Sep 08 10:40:38.009817 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:40:38.009817 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:40:38.009817 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 26c78589f2504ddd8985c82d4042ef98 Sep 08 10:40:38.009817 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServersAdmin275Test-1051993311-project Sep 08 10:40:38.009817 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:40:38.009817 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a could not be found. Sep 08 10:40:38.009817 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '6ee4f054-e0e8-4a2a-8b3e-4653cf66507a'} Sep 08 10:40:38.011434 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:40:38.011434 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:38.011434 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:40:38.011434 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:40:38.011434 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:40:38.011434 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:40:38.011434 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:40:38.011434 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:40:38.011434 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:40:38.011434 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:40:38.011434 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a could not be found. Sep 08 10:40:38.011434 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:38.011434 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:40:38.011434 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:38.011434 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:38.011434 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:40:38.011434 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:40:38.011434 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:40:38.011434 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:40:38.011434 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:40:38.013820 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:40:38.013820 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:40:38.013820 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:40:38.013820 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:40:38.013820 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:40:38.013820 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:40:38.013820 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:40:38.013820 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a could not be found. Sep 08 10:40:38.013820 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:38.013820 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:40:38.013820 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:38.013820 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:38.013820 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:40:38.013820 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:40:38.013820 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:40:38.013820 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:40:38.013820 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a could not be found. Sep 08 10:40:38.013820 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:38.016610 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bdbcce47-f3f3-474d-af0b-c63fc8614ebd tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] Returning 404 to user: Instance 6ee4f054-e0e8-4a2a-8b3e-4653cf66507a could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:40:38.018269 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bdbcce47-f3f3-474d-af0b-c63fc8614ebd tempest-ServersAdmin275Test-1051993311 tempest-ServersAdmin275Test-1051993311-project] 10.222.0.27 "GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a" status: 404 len: 111 microversion: 2.75 time: 0.157122 Sep 08 10:40:38.019231 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 526/1004] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:40:37 2022] GET /compute/v2.1/servers/6ee4f054-e0e8-4a2a-8b3e-4653cf66507a => generated 111 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:40:38.028473 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-21495216-e3b8-4e45-bd74-ac28c0b0d9d4 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:38.029701 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-21495216-e3b8-4e45-bd74-ac28c0b0d9d4 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: c04e1b8c-38c0-44c2-b02d-a6c1ca61d8cb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:38.056764 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-21495216-e3b8-4e45-bd74-ac28c0b0d9d4 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:38.058052 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-21495216-e3b8-4e45-bd74-ac28c0b0d9d4 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:38.061296 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-21495216-e3b8-4e45-bd74-ac28c0b0d9d4 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:38.062568 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-21495216-e3b8-4e45-bd74-ac28c0b0d9d4 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:38.063348 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-21495216-e3b8-4e45-bd74-ac28c0b0d9d4 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:38.068083 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-21495216-e3b8-4e45-bd74-ac28c0b0d9d4 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:38.146317 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-21495216-e3b8-4e45-bd74-ac28c0b0d9d4 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:38.146816 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-21495216-e3b8-4e45-bd74-ac28c0b0d9d4 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:38.147784 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-21495216-e3b8-4e45-bd74-ac28c0b0d9d4 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:38.148235 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-21495216-e3b8-4e45-bd74-ac28c0b0d9d4 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lazy-loading 'fault' on Instance uuid c04e1b8c-38c0-44c2-b02d-a6c1ca61d8cb {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:40:38.220150 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-21495216-e3b8-4e45-bd74-ac28c0b0d9d4 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:38.242052 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-21495216-e3b8-4e45-bd74-ac28c0b0d9d4 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/c04e1b8c-38c0-44c2-b02d-a6c1ca61d8cb" status: 200 len: 1306 microversion: 2.1 time: 0.220339 Sep 08 10:40:38.243400 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 527/1005] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:38 2022] GET /compute/v2.1/servers/c04e1b8c-38c0-44c2-b02d-a6c1ca61d8cb => generated 1306 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:38.265275 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e42a1198-7b8b-418a-b79d-c89b47ed2633 tempest-KeyPairsV2TestJSON-1585091982 tempest-KeyPairsV2TestJSON-1585091982-project] Calling method '.version_select at 0x7f68e4748790>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:38.340859 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e42a1198-7b8b-418a-b79d-c89b47ed2633 tempest-KeyPairsV2TestJSON-1585091982 tempest-KeyPairsV2TestJSON-1585091982-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2025508916" status: 202 len: 0 microversion: 2.1 time: 0.095526 Sep 08 10:40:38.346843 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 528/1006] 10.222.0.27 () {58 vars in 1221 bytes} [Thu Sep 8 10:40:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2025508916 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:40:38.372854 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d16a9f32-7e6b-4704-86e5-18b3d3658128 tempest-KeyPairsV2TestJSON-1585091982 tempest-KeyPairsV2TestJSON-1585091982-project] Action: 'create', calling method: .version_select at 0x7f68e479bca0>, body: {"keypair": {"name": "tempest-keypair-2130250690", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:40:38.442646 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-d16a9f32-7e6b-4704-86e5-18b3d3658128 tempest-KeyPairsV2TestJSON-1585091982 tempest-KeyPairsV2TestJSON-1585091982-project] Getting quotas for project 0ef0eecf09514ca7b4d299572c32ca69. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:40:38.464368 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-d16a9f32-7e6b-4704-86e5-18b3d3658128 tempest-KeyPairsV2TestJSON-1585091982 tempest-KeyPairsV2TestJSON-1585091982-project] Getting quotas for user 97214a54116d45129528a781f99c62f6 and project 0ef0eecf09514ca7b4d299572c32ca69. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:40:38.516661 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d16a9f32-7e6b-4704-86e5-18b3d3658128 tempest-KeyPairsV2TestJSON-1585091982 tempest-KeyPairsV2TestJSON-1585091982-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.159139 Sep 08 10:40:38.519381 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 529/1007] 10.222.0.27 () {60 vars in 1159 bytes} [Thu Sep 8 10:40:38 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:40:38.537133 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-008ad54a-3e2a-4c36-b9a0-c5f15fbdbd97 tempest-KeyPairsV2TestJSON-1585091982 tempest-KeyPairsV2TestJSON-1585091982-project] Calling method '.version_select at 0x7f68e469f8b0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:38.575455 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-008ad54a-3e2a-4c36-b9a0-c5f15fbdbd97 tempest-KeyPairsV2TestJSON-1585091982 tempest-KeyPairsV2TestJSON-1585091982-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2130250690" status: 202 len: 0 microversion: 2.1 time: 0.041317 Sep 08 10:40:38.581759 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 530/1008] 10.222.0.27 () {58 vars in 1221 bytes} [Thu Sep 8 10:40:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2130250690 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 10:40:38.597743 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-55b8d27f-4425-4f0e-b749-77025e454d16 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:38.599245 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-55b8d27f-4425-4f0e-b749-77025e454d16 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 923d2401-f860-4284-a580-37ed478720f6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:38.617091 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-f6e546b3-00dd-4f79-b524-e3902a24efd3 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] [instance: 60ad91da-8810-4117-8b13-ffe0c0e3714f] Updating instance_info_cache with network_info: [{"id": "f3291f9f-85d0-4bcc-8f0e-f2e1e4d5e84c", "address": "fa:16:3e:26:bf:f1", "network": {"id": "1bfe376b-33d6-4996-8274-cfa24df5a837", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-467880614-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.7.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "3674a3f87ee348428b195602234e4dd4", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf3291f9f-85", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128861) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 08 10:40:38.620727 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55b8d27f-4425-4f0e-b749-77025e454d16 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:38.621702 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55b8d27f-4425-4f0e-b749-77025e454d16 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:38.626982 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55b8d27f-4425-4f0e-b749-77025e454d16 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:38.628324 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55b8d27f-4425-4f0e-b749-77025e454d16 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:38.629183 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55b8d27f-4425-4f0e-b749-77025e454d16 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:38.629962 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55b8d27f-4425-4f0e-b749-77025e454d16 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:38.637271 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f6e546b3-00dd-4f79-b524-e3902a24efd3 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Releasing lock "refresh_cache-60ad91da-8810-4117-8b13-ffe0c0e3714f" {{(pid=128861) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 08 10:40:38.638178 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f6e546b3-00dd-4f79-b524-e3902a24efd3 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] 10.222.0.27 "POST /compute/v2.1/servers/60ad91da-8810-4117-8b13-ffe0c0e3714f/action" status: 202 len: 0 microversion: 2.1 time: 3.833989 Sep 08 10:40:38.640716 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 479/1009] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:40:34 2022] POST /compute/v2.1/servers/60ad91da-8810-4117-8b13-ffe0c0e3714f/action => generated 0 bytes in 3837 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Sep 08 10:40:38.653471 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9edd3f33-6800-49d8-894a-1d5f6b2d149b tempest-KeyPairsV2TestJSON-1585091982 tempest-KeyPairsV2TestJSON-1585091982-project] Action: 'create', calling method: .version_select at 0x7f68e4d23670>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1931705870", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIfROCmZoTP55cOIiTcNiShugOOgo1RVfWLVb17bfRvsSsVM4Fj/G1NNcPNAQW8VZxNTxjiJxbZ86ByWESm4hXJN37au+qfK9G/KTDz5RTPTifOrCu5OTqQXKIk8tWsKGg=="}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:40:38.684907 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-9edd3f33-6800-49d8-894a-1d5f6b2d149b tempest-KeyPairsV2TestJSON-1585091982 tempest-KeyPairsV2TestJSON-1585091982-project] Getting quotas for project 0ef0eecf09514ca7b4d299572c32ca69. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:40:38.693163 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-9edd3f33-6800-49d8-894a-1d5f6b2d149b tempest-KeyPairsV2TestJSON-1585091982 tempest-KeyPairsV2TestJSON-1585091982-project] Getting quotas for user 97214a54116d45129528a781f99c62f6 and project 0ef0eecf09514ca7b4d299572c32ca69. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:40:38.745513 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9edd3f33-6800-49d8-894a-1d5f6b2d149b tempest-KeyPairsV2TestJSON-1585091982 tempest-KeyPairsV2TestJSON-1585091982-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.102301 Sep 08 10:40:38.763263 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 480/1010] 10.222.0.27 () {60 vars in 1159 bytes} [Thu Sep 8 10:40:38 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:40:38.776954 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1a12d2ec-c6ac-4330-9e04-99c1cb4d9d6e tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Action: 'create', calling method: .version_select at 0x7f68e4923d30>, body: {"pool": "6c07d17e-5454-404f-a4da-2b5f7caefef4"} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:40:38.979164 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-55b8d27f-4425-4f0e-b749-77025e454d16 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:38.997459 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-55b8d27f-4425-4f0e-b749-77025e454d16 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6" status: 200 len: 1471 microversion: 2.1 time: 0.409138 Sep 08 10:40:38.998604 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 531/1011] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:38 2022] GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6 => generated 1471 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:39.017520 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4b1b9fa7-04a1-41e0-bb4d-155e2ccfba97 tempest-KeyPairsV2TestJSON-1585091982 tempest-KeyPairsV2TestJSON-1585091982-project] Action: 'create', calling method: .version_select at 0x7f68e469e430>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1450575940", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF08B7e+u9NgonGHaO9CaE/4dwhd+FNCj47aH7IXov723GKj54s7XlpWwgcAZbGh6IawxM6vuQxH/IgcxOzk29NXcHBvzJ01mkF1rtAG1puSe7nRNhMFY999R+9eVXzuTg=="}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:40:39.047467 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-4b1b9fa7-04a1-41e0-bb4d-155e2ccfba97 tempest-KeyPairsV2TestJSON-1585091982 tempest-KeyPairsV2TestJSON-1585091982-project] Getting quotas for project 0ef0eecf09514ca7b4d299572c32ca69. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:40:39.058759 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-4b1b9fa7-04a1-41e0-bb4d-155e2ccfba97 tempest-KeyPairsV2TestJSON-1585091982 tempest-KeyPairsV2TestJSON-1585091982-project] Getting quotas for user 97214a54116d45129528a781f99c62f6 and project 0ef0eecf09514ca7b4d299572c32ca69. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:40:39.107542 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4b1b9fa7-04a1-41e0-bb4d-155e2ccfba97 tempest-KeyPairsV2TestJSON-1585091982 tempest-KeyPairsV2TestJSON-1585091982-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.107160 Sep 08 10:40:39.109224 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 532/1012] 10.222.0.27 () {60 vars in 1159 bytes} [Thu Sep 8 10:40:38 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:40:39.117912 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-eb421cb8-b9d9-408f-b572-5c3381175244 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:40:39.118831 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-eb421cb8-b9d9-408f-b572-5c3381175244 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 923d2401-f860-4284-a580-37ed478720f6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:39.127511 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb421cb8-b9d9-408f-b572-5c3381175244 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:39.128522 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb421cb8-b9d9-408f-b572-5c3381175244 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:39.129638 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb421cb8-b9d9-408f-b572-5c3381175244 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:39.130931 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb421cb8-b9d9-408f-b572-5c3381175244 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:39.131945 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb421cb8-b9d9-408f-b572-5c3381175244 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:39.132870 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb421cb8-b9d9-408f-b572-5c3381175244 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:39.277171 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-eb421cb8-b9d9-408f-b572-5c3381175244 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "POST /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6/action" status: 204 len: 0 microversion: 2.1 time: 0.166006 Sep 08 10:40:39.278609 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 533/1013] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:40:39 2022] POST /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6/action => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:40:39.291938 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-871ed2a4-10f5-4e19-ad96-d7fa6038582f tempest-KeyPairsV2TestJSON-1585091982 tempest-KeyPairsV2TestJSON-1585091982-project] Action: 'create', calling method: .version_select at 0x7f68e4832b80>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-2074622984", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJE9ZuOJvXGJmY434PRmS4peHnYEFa+anjrWZsFC+vOTNdSVgkzqep4IiD028xhpzxGBE3iVUsBQlDMMsCr+fBJyRy5AlC+jt1ETmnFy8ezjFYUbsXOeTwd+FciXKQjqag=="}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:40:39.347454 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-871ed2a4-10f5-4e19-ad96-d7fa6038582f tempest-KeyPairsV2TestJSON-1585091982 tempest-KeyPairsV2TestJSON-1585091982-project] Getting quotas for project 0ef0eecf09514ca7b4d299572c32ca69. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:40:39.362004 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-871ed2a4-10f5-4e19-ad96-d7fa6038582f tempest-KeyPairsV2TestJSON-1585091982 tempest-KeyPairsV2TestJSON-1585091982-project] Getting quotas for user 97214a54116d45129528a781f99c62f6 and project 0ef0eecf09514ca7b4d299572c32ca69. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:40:39.409825 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-871ed2a4-10f5-4e19-ad96-d7fa6038582f tempest-KeyPairsV2TestJSON-1585091982 tempest-KeyPairsV2TestJSON-1585091982-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.129053 Sep 08 10:40:39.412616 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 534/1014] 10.222.0.27 () {60 vars in 1159 bytes} [Thu Sep 8 10:40:39 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:40:39.432109 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-975bc144-0b6e-43ef-884e-28d1b33a351a tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:39.433385 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-975bc144-0b6e-43ef-884e-28d1b33a351a tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: c04e1b8c-38c0-44c2-b02d-a6c1ca61d8cb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:39.461225 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-975bc144-0b6e-43ef-884e-28d1b33a351a tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:39.462881 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-975bc144-0b6e-43ef-884e-28d1b33a351a tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:39.463449 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-975bc144-0b6e-43ef-884e-28d1b33a351a tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:39.464710 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-975bc144-0b6e-43ef-884e-28d1b33a351a tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:39.465635 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-975bc144-0b6e-43ef-884e-28d1b33a351a tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:39.466377 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-975bc144-0b6e-43ef-884e-28d1b33a351a tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:39.557761 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:40:39.592827 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-975bc144-0b6e-43ef-884e-28d1b33a351a tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:39.599599 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-975bc144-0b6e-43ef-884e-28d1b33a351a tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:39.600723 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-975bc144-0b6e-43ef-884e-28d1b33a351a tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:39.601799 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-975bc144-0b6e-43ef-884e-28d1b33a351a tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lazy-loading 'fault' on Instance uuid c04e1b8c-38c0-44c2-b02d-a6c1ca61d8cb {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:40:39.689441 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-975bc144-0b6e-43ef-884e-28d1b33a351a tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:39.706445 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-975bc144-0b6e-43ef-884e-28d1b33a351a tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/c04e1b8c-38c0-44c2-b02d-a6c1ca61d8cb" status: 200 len: 1306 microversion: 2.1 time: 0.286713 Sep 08 10:40:39.710475 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 535/1015] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:39 2022] GET /compute/v2.1/servers/c04e1b8c-38c0-44c2-b02d-a6c1ca61d8cb => generated 1306 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:39.729254 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c9fa2496-59a3-4cff-8dec-ba5db77fdffe tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:39.731312 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c9fa2496-59a3-4cff-8dec-ba5db77fdffe tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 923d2401-f860-4284-a580-37ed478720f6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:39.752937 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c9fa2496-59a3-4cff-8dec-ba5db77fdffe tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:39.754012 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c9fa2496-59a3-4cff-8dec-ba5db77fdffe tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:39.754873 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c9fa2496-59a3-4cff-8dec-ba5db77fdffe tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:39.756712 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c9fa2496-59a3-4cff-8dec-ba5db77fdffe tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:39.757909 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c9fa2496-59a3-4cff-8dec-ba5db77fdffe tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:39.758925 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c9fa2496-59a3-4cff-8dec-ba5db77fdffe tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:40.291778 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c9fa2496-59a3-4cff-8dec-ba5db77fdffe tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:40.302465 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c9fa2496-59a3-4cff-8dec-ba5db77fdffe tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6" status: 200 len: 1471 microversion: 2.1 time: 0.587544 Sep 08 10:40:40.320306 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 536/1016] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:39 2022] GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6 => generated 1471 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:40.326145 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-583bff6b-be9a-4128-840d-fff60165242a tempest-KeyPairsV2TestJSON-1585091982 tempest-KeyPairsV2TestJSON-1585091982-project] Calling method '.version_select at 0x7f68e4731af0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:40.332819 n-d-850501-12 devstack@n-api.service[128862]: WARNING oslo_db.sqlalchemy.utils [None req-583bff6b-be9a-4128-840d-fff60165242a tempest-KeyPairsV2TestJSON-1585091982 tempest-KeyPairsV2TestJSON-1585091982-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 08 10:40:40.342101 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-583bff6b-be9a-4128-840d-fff60165242a tempest-KeyPairsV2TestJSON-1585091982 tempest-KeyPairsV2TestJSON-1585091982-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs" status: 200 len: 1094 microversion: 2.1 time: 0.020610 Sep 08 10:40:40.343062 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 537/1017] 10.222.0.27 () {58 vars in 1137 bytes} [Thu Sep 8 10:40:40 2022] GET /compute/v2.1/os-keypairs => generated 1094 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:40.364428 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-042fe999-354e-4ae5-929f-09e5274222ff tempest-KeyPairsV2TestJSON-1585091982 tempest-KeyPairsV2TestJSON-1585091982-project] Calling method '.version_select at 0x7f68e464aca0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:40.412906 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-042fe999-354e-4ae5-929f-09e5274222ff tempest-KeyPairsV2TestJSON-1585091982 tempest-KeyPairsV2TestJSON-1585091982-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-2074622984" status: 202 len: 0 microversion: 2.1 time: 0.055764 Sep 08 10:40:40.415372 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 538/1018] 10.222.0.27 () {58 vars in 1278 bytes} [Thu Sep 8 10:40:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-2074622984 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:40:40.448809 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-999ead2a-74c7-47ba-95fc-b78a35691b96 tempest-KeyPairsV2TestJSON-1585091982 tempest-KeyPairsV2TestJSON-1585091982-project] Calling method '.version_select at 0x7f68e469eca0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:40.498820 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-999ead2a-74c7-47ba-95fc-b78a35691b96 tempest-KeyPairsV2TestJSON-1585091982 tempest-KeyPairsV2TestJSON-1585091982-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1450575940" status: 202 len: 0 microversion: 2.1 time: 0.076252 Sep 08 10:40:40.501596 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 539/1019] 10.222.0.27 () {58 vars in 1278 bytes} [Thu Sep 8 10:40:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1450575940 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:40:40.516000 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1c6ec67e-6bb2-4c57-b05b-dad5f6e19897 tempest-KeyPairsV2TestJSON-1585091982 tempest-KeyPairsV2TestJSON-1585091982-project] Calling method '.version_select at 0x7f68e4731670>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:40.547255 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1c6ec67e-6bb2-4c57-b05b-dad5f6e19897 tempest-KeyPairsV2TestJSON-1585091982 tempest-KeyPairsV2TestJSON-1585091982-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1931705870" status: 202 len: 0 microversion: 2.1 time: 0.037650 Sep 08 10:40:40.549091 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 540/1020] 10.222.0.27 () {58 vars in 1278 bytes} [Thu Sep 8 10:40:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1931705870 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 10:40:40.736504 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-072d03b3-de50-4bff-99fe-b2e012d5fb50 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:40.737178 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-072d03b3-de50-4bff-99fe-b2e012d5fb50 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: c04e1b8c-38c0-44c2-b02d-a6c1ca61d8cb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:40.765725 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-072d03b3-de50-4bff-99fe-b2e012d5fb50 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:40.767191 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-072d03b3-de50-4bff-99fe-b2e012d5fb50 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:40.768470 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-072d03b3-de50-4bff-99fe-b2e012d5fb50 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:40.775674 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-072d03b3-de50-4bff-99fe-b2e012d5fb50 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:40.777145 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-072d03b3-de50-4bff-99fe-b2e012d5fb50 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:40.780502 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-072d03b3-de50-4bff-99fe-b2e012d5fb50 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:40.809011 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-072d03b3-de50-4bff-99fe-b2e012d5fb50 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] HTTP exception thrown: Instance c04e1b8c-38c0-44c2-b02d-a6c1ca61d8cb could not be found. Sep 08 10:40:40.811764 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-072d03b3-de50-4bff-99fe-b2e012d5fb50 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Request method failure captured: Sep 08 10:40:40.811764 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/c04e1b8c-38c0-44c2-b02d-a6c1ca61d8cb HTTP/1.1 Sep 08 10:40:40.811764 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:40:40.811764 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:40:40.811764 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:40:40.811764 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:40:40.811764 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:40:40.811764 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:40:40.811764 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:40:40.811764 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:40:40.811764 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcXsmHH1yoQtgpWVsTlKGRZ1RD9sGjJDO3R5IIX2mO0TzFlOkGo4Nrt9P8ms3HuxErnST87nkHuEi-VzkaDAC8r3keukBBYL9HR0teGPa-du_tj-nOftdvIVdc8Rf3uKj_SiRNumvszg8v8N8iSarJ11mQfNqN8vl0lBx8hzlRuGs8w Sep 08 10:40:40.811764 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:40:40.811764 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:40:40.811764 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:40:40.811764 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:40:40.811764 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:40:40.811764 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:40:40.811764 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 2a3d4a2ec8674e418602b6dc0cec6ab9 Sep 08 10:40:40.811764 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersOnMultiNodesTest-1266277988 Sep 08 10:40:40.811764 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:40:40.811764 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:40:40.814580 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2a3d4a2ec8674e418602b6dc0cec6ab9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2a3d4a2ec8674e418602b6dc0cec6ab9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2a3d4a2ec8674e418602b6dc0cec6ab9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2a3d4a2ec8674e418602b6dc0cec6ab9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:40:40.814580 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServersOnMultiNodesTest-1266277988 Sep 08 10:40:40.814580 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 2a3d4a2ec8674e418602b6dc0cec6ab9 Sep 08 10:40:40.814580 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1266277988 Sep 08 10:40:40.814580 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServersOnMultiNodesTest-1266277988-project Sep 08 10:40:40.814580 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:40:40.814580 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:40:40.814580 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 771c067cf6814084a5520128a970dc82 Sep 08 10:40:40.814580 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServersOnMultiNodesTest-1266277988-project Sep 08 10:40:40.814580 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:40:40.814580 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance c04e1b8c-38c0-44c2-b02d-a6c1ca61d8cb could not be found. Sep 08 10:40:40.814580 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'c04e1b8c-38c0-44c2-b02d-a6c1ca61d8cb'} Sep 08 10:40:40.816031 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:40:40.816031 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:40.816031 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:40:40.816031 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:40:40.816031 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:40:40.816031 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:40:40.816031 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:40:40.816031 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:40:40.816031 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:40:40.816031 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:40:40.816031 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c04e1b8c-38c0-44c2-b02d-a6c1ca61d8cb could not be found. Sep 08 10:40:40.816031 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:40.816031 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:40:40.816031 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:40.816031 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:40.816031 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:40:40.816031 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:40:40.816031 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:40:40.816031 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:40:40.816031 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:40:40.820227 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:40:40.820227 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:40:40.820227 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:40:40.820227 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:40:40.820227 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:40:40.820227 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:40:40.820227 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:40:40.820227 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c04e1b8c-38c0-44c2-b02d-a6c1ca61d8cb could not be found. Sep 08 10:40:40.820227 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:40.820227 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:40:40.820227 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:40.820227 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:40.820227 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:40:40.820227 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:40:40.820227 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:40:40.820227 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:40:40.820227 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c04e1b8c-38c0-44c2-b02d-a6c1ca61d8cb could not be found. Sep 08 10:40:40.820227 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:40.838723 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-072d03b3-de50-4bff-99fe-b2e012d5fb50 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Returning 404 to user: Instance c04e1b8c-38c0-44c2-b02d-a6c1ca61d8cb could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:40:40.843182 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-072d03b3-de50-4bff-99fe-b2e012d5fb50 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/c04e1b8c-38c0-44c2-b02d-a6c1ca61d8cb" status: 404 len: 111 microversion: 2.1 time: 0.111532 Sep 08 10:40:40.846089 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 541/1021] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:40 2022] GET /compute/v2.1/servers/c04e1b8c-38c0-44c2-b02d-a6c1ca61d8cb => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:40:40.857562 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-903570db-431c-4d8c-81bf-ec8ef6712e12 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:40.858511 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-903570db-431c-4d8c-81bf-ec8ef6712e12 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: 8be00267-7835-4f68-bb40-6677750c0e3c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:40.873355 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-903570db-431c-4d8c-81bf-ec8ef6712e12 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:40.874217 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-903570db-431c-4d8c-81bf-ec8ef6712e12 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:40.874867 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-903570db-431c-4d8c-81bf-ec8ef6712e12 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:40.876762 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-903570db-431c-4d8c-81bf-ec8ef6712e12 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:40.878743 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-903570db-431c-4d8c-81bf-ec8ef6712e12 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:40.879430 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-903570db-431c-4d8c-81bf-ec8ef6712e12 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:40.947609 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-903570db-431c-4d8c-81bf-ec8ef6712e12 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: 8be00267-7835-4f68-bb40-6677750c0e3c] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:40:41.185346 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-903570db-431c-4d8c-81bf-ec8ef6712e12 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8be00267-7835-4f68-bb40-6677750c0e3c" status: 204 len: 0 microversion: 2.1 time: 0.331122 Sep 08 10:40:41.195073 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 542/1022] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:40:40 2022] DELETE /compute/v2.1/servers/8be00267-7835-4f68-bb40-6677750c0e3c => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:40:41.209580 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-916176d0-ad66-42f6-a7c7-c3b9aca0a7ac req-99b20afc-0dca-486c-a4f5-5cb752dfd26d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "923d2401-f860-4284-a580-37ed478720f6", "name": "network-vif-plugged", "status": "completed", "tag": "bec27b4a-f6d6-449e-854b-1e502a76de67"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:40:41.230102 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-916176d0-ad66-42f6-a7c7-c3b9aca0a7ac req-99b20afc-0dca-486c-a4f5-5cb752dfd26d service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:41.231739 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-916176d0-ad66-42f6-a7c7-c3b9aca0a7ac req-99b20afc-0dca-486c-a4f5-5cb752dfd26d service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:41.232248 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-916176d0-ad66-42f6-a7c7-c3b9aca0a7ac req-99b20afc-0dca-486c-a4f5-5cb752dfd26d service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:41.262779 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-916176d0-ad66-42f6-a7c7-c3b9aca0a7ac req-99b20afc-0dca-486c-a4f5-5cb752dfd26d service nova] Creating event network-vif-plugged:bec27b4a-f6d6-449e-854b-1e502a76de67 for instance 923d2401-f860-4284-a580-37ed478720f6 on n-h1-850501-12 Sep 08 10:40:41.277909 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [req-916176d0-ad66-42f6-a7c7-c3b9aca0a7ac req-99b20afc-0dca-486c-a4f5-5cb752dfd26d service nova] Instance 923d2401-f860-4284-a580-37ed478720f6 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850501-12'} {{(pid=128862) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 10:40:41.295281 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-916176d0-ad66-42f6-a7c7-c3b9aca0a7ac req-99b20afc-0dca-486c-a4f5-5cb752dfd26d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094691 Sep 08 10:40:41.301897 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 543/1023] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:40:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:40:41.315250 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9744eaec-aa6b-4d04-a8c9-fe689cc2d3bf tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:41.316499 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9744eaec-aa6b-4d04-a8c9-fe689cc2d3bf tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: 8be00267-7835-4f68-bb40-6677750c0e3c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:41.330411 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9744eaec-aa6b-4d04-a8c9-fe689cc2d3bf tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:41.331217 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9744eaec-aa6b-4d04-a8c9-fe689cc2d3bf tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:41.331995 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9744eaec-aa6b-4d04-a8c9-fe689cc2d3bf tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:41.335051 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9744eaec-aa6b-4d04-a8c9-fe689cc2d3bf tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:41.335767 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9744eaec-aa6b-4d04-a8c9-fe689cc2d3bf tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:41.336554 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9744eaec-aa6b-4d04-a8c9-fe689cc2d3bf tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:41.541619 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9744eaec-aa6b-4d04-a8c9-fe689cc2d3bf tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:41.556597 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9744eaec-aa6b-4d04-a8c9-fe689cc2d3bf tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/8be00267-7835-4f68-bb40-6677750c0e3c" status: 200 len: 1472 microversion: 2.1 time: 0.251339 Sep 08 10:40:41.557704 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 544/1024] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:41 2022] GET /compute/v2.1/servers/8be00267-7835-4f68-bb40-6677750c0e3c => generated 1472 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:41.566368 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b24c57c3-2c73-4e16-91c6-60c993c699ff tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:41.567467 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b24c57c3-2c73-4e16-91c6-60c993c699ff tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 923d2401-f860-4284-a580-37ed478720f6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:41.571937 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4,nova_api:DELETE=5,nova_api:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:40:41.582277 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b24c57c3-2c73-4e16-91c6-60c993c699ff tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:41.583540 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b24c57c3-2c73-4e16-91c6-60c993c699ff tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:41.585464 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b24c57c3-2c73-4e16-91c6-60c993c699ff tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:41.586785 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b24c57c3-2c73-4e16-91c6-60c993c699ff tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:41.587778 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b24c57c3-2c73-4e16-91c6-60c993c699ff tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:41.588638 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b24c57c3-2c73-4e16-91c6-60c993c699ff tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:41.717973 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1a12d2ec-c6ac-4330-9e04-99c1cb4d9d6e tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.948468 Sep 08 10:40:41.721266 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 481/1025] 10.222.0.27 () {60 vars in 1170 bytes} [Thu Sep 8 10:40:38 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2957 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:40:41.745203 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6fcb921d-937e-4b62-b530-8d2edd9b9d19 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.7.187"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:40:41.752896 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6fcb921d-937e-4b62-b530-8d2edd9b9d19 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] [instance: 60ad91da-8810-4117-8b13-ffe0c0e3714f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:41.766108 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6fcb921d-937e-4b62-b530-8d2edd9b9d19 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:41.773858 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6fcb921d-937e-4b62-b530-8d2edd9b9d19 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:41.774727 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6fcb921d-937e-4b62-b530-8d2edd9b9d19 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:41.776038 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6fcb921d-937e-4b62-b530-8d2edd9b9d19 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:41.783106 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6fcb921d-937e-4b62-b530-8d2edd9b9d19 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:41.783895 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6fcb921d-937e-4b62-b530-8d2edd9b9d19 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:41.843875 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6fcb921d-937e-4b62-b530-8d2edd9b9d19 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Acquiring lock "refresh_cache-60ad91da-8810-4117-8b13-ffe0c0e3714f" {{(pid=128861) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 08 10:40:41.844918 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b24c57c3-2c73-4e16-91c6-60c993c699ff tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:41.845215 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6fcb921d-937e-4b62-b530-8d2edd9b9d19 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Acquired lock "refresh_cache-60ad91da-8810-4117-8b13-ffe0c0e3714f" {{(pid=128861) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 08 10:40:41.857638 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b24c57c3-2c73-4e16-91c6-60c993c699ff tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6" status: 200 len: 1471 microversion: 2.1 time: 0.298443 Sep 08 10:40:41.858239 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 545/1026] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:41 2022] GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6 => generated 1471 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:42.466300 n-d-850501-12 devstack@n-api.service[128861]: DEBUG neutronclient.v2_0.client [None req-6fcb921d-937e-4b62-b530-8d2edd9b9d19 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.7.187 (2801ba6c-ccc5-4fe6-81cb-045aa485c510) with port f3291f9f-85d0-4bcc-8f0e-f2e1e4d5e84c using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network 6c07d17e-5454-404f-a4da-2b5f7caefef4.", "detail": ""}} {{(pid=128861) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 08 10:40:42.467234 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6fcb921d-937e-4b62-b530-8d2edd9b9d19 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Releasing lock "refresh_cache-60ad91da-8810-4117-8b13-ffe0c0e3714f" {{(pid=128861) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 08 10:40:42.468225 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-6fcb921d-937e-4b62-b530-8d2edd9b9d19 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] HTTP exception thrown: Cannot associate floating IP 172.25.7.187 (2801ba6c-ccc5-4fe6-81cb-045aa485c510) with port f3291f9f-85d0-4bcc-8f0e-f2e1e4d5e84c using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network 6c07d17e-5454-404f-a4da-2b5f7caefef4. Sep 08 10:40:42.468225 n-d-850501-12 devstack@n-api.service[128861]: Neutron server returns request_ids: ['req-3321ad3e-dfcf-4759-b47d-8525ff210c49'] Sep 08 10:40:42.473448 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6fcb921d-937e-4b62-b530-8d2edd9b9d19 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Request method failure captured: Sep 08 10:40:42.473448 n-d-850501-12 devstack@n-api.service[128861]: request: POST /compute/v2.1/servers/60ad91da-8810-4117-8b13-ffe0c0e3714f/action HTTP/1.1 Sep 08 10:40:42.473448 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:40:42.473448 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:40:42.473448 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:40:42.473448 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 46 Sep 08 10:40:42.473448 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:40:42.473448 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:40:42.473448 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:40:42.473448 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:40:42.473448 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcaDH0qBBGNIs2z6CL8YMxdZCeOhnYFK6VIFv3PopAGGEIh6bl2Lj_U5tbU_AfW8V9WbCTXO2mXvB8JS0_KgTquQqCPhlYmGDhVIuYNx-eN6Y_cM9KOseed44Fsk8NAZgK4oPmG4z70583YdZDp1x68OuR7RnaeVInIExqo20-gfl90 Sep 08 10:40:42.473448 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:40:42.473448 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:40:42.473448 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:40:42.473448 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:40:42.473448 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:40:42.473448 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:40:42.473448 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 3674a3f87ee348428b195602234e4dd4 Sep 08 10:40:42.473448 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 Sep 08 10:40:42.473448 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:40:42.473448 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:40:42.476432 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3674a3f87ee348428b195602234e4dd4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3674a3f87ee348428b195602234e4dd4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3674a3f87ee348428b195602234e4dd4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3674a3f87ee348428b195602234e4dd4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:40:42.476432 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 Sep 08 10:40:42.476432 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 3674a3f87ee348428b195602234e4dd4 Sep 08 10:40:42.476432 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 Sep 08 10:40:42.476432 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project Sep 08 10:40:42.476432 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:40:42.476432 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:40:42.476432 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 55e7bb8eedfa46c487513057a67a9537 Sep 08 10:40:42.476432 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project Sep 08 10:40:42.476432 n-d-850501-12 devstack@n-api.service[128861]: Sep 08 10:40:42.476432 n-d-850501-12 devstack@n-api.service[128861]: {"addFloatingIp": {"address": "172.25.7.187"}} Sep 08 10:40:42.476432 n-d-850501-12 devstack@n-api.service[128861]: method: Sep 08 10:40:42.477983 n-d-850501-12 devstack@n-api.service[128861]: exception: Cannot associate floating IP 172.25.7.187 (2801ba6c-ccc5-4fe6-81cb-045aa485c510) with port f3291f9f-85d0-4bcc-8f0e-f2e1e4d5e84c using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network 6c07d17e-5454-404f-a4da-2b5f7caefef4. Sep 08 10:40:42.477983 n-d-850501-12 devstack@n-api.service[128861]: Neutron server returns request_ids: ['req-3321ad3e-dfcf-4759-b47d-8525ff210c49'] Sep 08 10:40:42.477983 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '60ad91da-8810-4117-8b13-ffe0c0e3714f', 'body': {'addFloatingIp': {'address': '172.25.7.187'}}} Sep 08 10:40:42.477983 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:40:42.477983 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:42.477983 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Sep 08 10:40:42.477983 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Sep 08 10:40:42.477983 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:40:42.477983 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:40:42.477983 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Sep 08 10:40:42.477983 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Sep 08 10:40:42.477983 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:40:42.477983 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:40:42.477983 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Sep 08 10:40:42.477983 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Sep 08 10:40:42.477983 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:40:42.477983 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:40:42.479874 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Sep 08 10:40:42.479874 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Sep 08 10:40:42.479874 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:40:42.479874 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:40:42.479874 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 08 10:40:42.479874 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 08 10:40:42.479874 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:40:42.479874 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:40:42.479874 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 08 10:40:42.479874 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 08 10:40:42.479874 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:40:42.479874 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:40:42.479874 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 08 10:40:42.479874 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 08 10:40:42.479874 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 08 10:40:42.479874 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 08 10:40:42.481777 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.7.187 (2801ba6c-ccc5-4fe6-81cb-045aa485c510) with port f3291f9f-85d0-4bcc-8f0e-f2e1e4d5e84c using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network 6c07d17e-5454-404f-a4da-2b5f7caefef4. Sep 08 10:40:42.481777 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3321ad3e-dfcf-4759-b47d-8525ff210c49'] Sep 08 10:40:42.481777 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:40:42.481777 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:40:42.481777 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:40:42.481777 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:42.481777 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Sep 08 10:40:42.481777 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Sep 08 10:40:42.481777 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Sep 08 10:40:42.481777 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Sep 08 10:40:42.481777 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Sep 08 10:40:42.481777 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Sep 08 10:40:42.481777 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.7.187 (2801ba6c-ccc5-4fe6-81cb-045aa485c510) with port f3291f9f-85d0-4bcc-8f0e-f2e1e4d5e84c using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network 6c07d17e-5454-404f-a4da-2b5f7caefef4. Sep 08 10:40:42.481777 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3321ad3e-dfcf-4759-b47d-8525ff210c49'] Sep 08 10:40:42.481777 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:40:42.481777 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:40:42.485544 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:40:42.485544 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:42.485544 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:40:42.485544 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:40:42.485544 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:40:42.485544 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:40:42.485544 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:40:42.485544 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:40:42.485544 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:40:42.485544 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:40:42.485544 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:40:42.485544 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:40:42.485544 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Sep 08 10:40:42.485544 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Sep 08 10:40:42.485544 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.7.187 (2801ba6c-ccc5-4fe6-81cb-045aa485c510) with port f3291f9f-85d0-4bcc-8f0e-f2e1e4d5e84c using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network 6c07d17e-5454-404f-a4da-2b5f7caefef4. Sep 08 10:40:42.485544 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3321ad3e-dfcf-4759-b47d-8525ff210c49'] Sep 08 10:40:42.485544 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:40:42.485544 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:40:42.489135 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:40:42.489135 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:42.489135 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:40:42.489135 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:40:42.489135 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:40:42.489135 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:40:42.489135 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.7.187 (2801ba6c-ccc5-4fe6-81cb-045aa485c510) with port f3291f9f-85d0-4bcc-8f0e-f2e1e4d5e84c using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network 6c07d17e-5454-404f-a4da-2b5f7caefef4. Sep 08 10:40:42.489135 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3321ad3e-dfcf-4759-b47d-8525ff210c49'] Sep 08 10:40:42.489135 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:40:42.489135 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6fcb921d-937e-4b62-b530-8d2edd9b9d19 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Returning 400 to user: Cannot associate floating IP 172.25.7.187 (2801ba6c-ccc5-4fe6-81cb-045aa485c510) with port f3291f9f-85d0-4bcc-8f0e-f2e1e4d5e84c using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network 6c07d17e-5454-404f-a4da-2b5f7caefef4. Sep 08 10:40:42.489135 n-d-850501-12 devstack@n-api.service[128861]: Neutron server returns request_ids: ['req-3321ad3e-dfcf-4759-b47d-8525ff210c49'] {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:40:42.490649 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6fcb921d-937e-4b62-b530-8d2edd9b9d19 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] 10.222.0.27 "POST /compute/v2.1/servers/60ad91da-8810-4117-8b13-ffe0c0e3714f/action" status: 400 len: 381 microversion: 2.1 time: 0.745159 Sep 08 10:40:42.490649 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 482/1027] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:40:41 2022] POST /compute/v2.1/servers/60ad91da-8810-4117-8b13-ffe0c0e3714f/action => generated 381 bytes in 753 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 08 10:40:42.519069 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fa168583-fe86-47f3-811f-121bc83a274f tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Calling method '.version_select at 0x7f68e4731c10>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:42.586548 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ce76c504-adc6-4119-9899-3091f3cf1702 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:42.587467 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ce76c504-adc6-4119-9899-3091f3cf1702 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: 8be00267-7835-4f68-bb40-6677750c0e3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:42.596056 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ce76c504-adc6-4119-9899-3091f3cf1702 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:42.596768 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ce76c504-adc6-4119-9899-3091f3cf1702 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:42.597826 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ce76c504-adc6-4119-9899-3091f3cf1702 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:42.598797 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ce76c504-adc6-4119-9899-3091f3cf1702 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:42.599558 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ce76c504-adc6-4119-9899-3091f3cf1702 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:42.600428 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ce76c504-adc6-4119-9899-3091f3cf1702 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:42.818180 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ce76c504-adc6-4119-9899-3091f3cf1702 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:42.836718 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ce76c504-adc6-4119-9899-3091f3cf1702 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/8be00267-7835-4f68-bb40-6677750c0e3c" status: 200 len: 1472 microversion: 2.1 time: 0.256572 Sep 08 10:40:42.837899 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 483/1028] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:42 2022] GET /compute/v2.1/servers/8be00267-7835-4f68-bb40-6677750c0e3c => generated 1472 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:40:42.895304 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0c411ef6-35a8-4968-b16c-4603c38326ec tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:42.896426 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0c411ef6-35a8-4968-b16c-4603c38326ec tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 923d2401-f860-4284-a580-37ed478720f6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:42.906271 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0c411ef6-35a8-4968-b16c-4603c38326ec tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:42.907507 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0c411ef6-35a8-4968-b16c-4603c38326ec tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:42.909463 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0c411ef6-35a8-4968-b16c-4603c38326ec tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:42.910602 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0c411ef6-35a8-4968-b16c-4603c38326ec tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:42.911304 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0c411ef6-35a8-4968-b16c-4603c38326ec tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:42.912069 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0c411ef6-35a8-4968-b16c-4603c38326ec tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:43.206819 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0c411ef6-35a8-4968-b16c-4603c38326ec tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:43.238469 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0c411ef6-35a8-4968-b16c-4603c38326ec tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6" status: 200 len: 1471 microversion: 2.1 time: 0.348063 Sep 08 10:40:43.249888 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 484/1029] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:42 2022] GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6 => generated 1471 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:40:43.919590 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2c6c4ac9-ff2a-4a7b-8bb8-01b0e9b40aff tempest-KeyPairsNegativeTestJSON-1688980726 tempest-KeyPairsNegativeTestJSON-1688980726-project] Action: 'create', calling method: .version_select at 0x7f68e46adb80>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBoDOSVYrav+GlCa4L/eEPx86Bt7XUkd4RqEJUm+dCVhDVXvZhvjSiNzVq/AjMilg6LgyBiQMEP15JTikFKc0MlMFv41+2CTT7JOTWwQWOjRbHxOErhjJ/znob2ub9aHZg=="}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:40:43.931794 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2c6c4ac9-ff2a-4a7b-8bb8-01b0e9b40aff tempest-KeyPairsNegativeTestJSON-1688980726 tempest-KeyPairsNegativeTestJSON-1688980726-project] Request method failure captured: Sep 08 10:40:43.931794 n-d-850501-12 devstack@n-api.service[128861]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 08 10:40:43.931794 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:40:43.931794 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:40:43.931794 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:40:43.931794 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 257 Sep 08 10:40:43.931794 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:40:43.931794 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:40:43.931794 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:40:43.931794 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:40:43.931794 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcar0HTSz11SW0L2pZJ2DQIdEbFJngVgf54HfXslpPti3PEEwkMC6pOaQ0W89q6guSW790Vmq6yM5FGxolNB1pgY1MykKoH_eJK6ZcdWqzSzbOOBnSLZwQRAZv9Z1tCkbZUs9pNWPR_kn4z7dE5H_17gblP3z-2o-tfHCbbIIQjGx6I Sep 08 10:40:43.931794 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:40:43.931794 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:40:43.931794 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:40:43.931794 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:40:43.931794 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:40:43.931794 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:40:43.931794 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 846ab73f8a8140f4ae159701f1ee46d9 Sep 08 10:40:43.931794 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1688980726 Sep 08 10:40:43.931794 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:40:43.931794 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:40:43.937429 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/846ab73f8a8140f4ae159701f1ee46d9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/846ab73f8a8140f4ae159701f1ee46d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_846ab73f8a8140f4ae159701f1ee46d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/846ab73f8a8140f4ae159701f1ee46d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:40:43.937429 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1688980726 Sep 08 10:40:43.937429 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 846ab73f8a8140f4ae159701f1ee46d9 Sep 08 10:40:43.937429 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1688980726 Sep 08 10:40:43.937429 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-KeyPairsNegativeTestJSON-1688980726-project Sep 08 10:40:43.937429 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:40:43.937429 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:40:43.937429 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 69d34aeb636f4db6819f54619df5b17f Sep 08 10:40:43.937429 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1688980726-project Sep 08 10:40:43.937429 n-d-850501-12 devstack@n-api.service[128861]: Sep 08 10:40:43.937429 n-d-850501-12 devstack@n-api.service[128861]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBoDOSVYrav+GlCa4L/eEPx86Bt7XUkd4RqEJUm+dCVhDVXvZhvjSiNzVq/AjMilg6LgyBiQMEP15JTikFKc0MlMFv41+2CTT7JOTWwQWOjRbHxOErhjJ/znob2ub9aHZg=="}} Sep 08 10:40:43.938995 n-d-850501-12 devstack@n-api.service[128861]: method: Sep 08 10:40:43.938995 n-d-850501-12 devstack@n-api.service[128861]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 08 10:40:43.938995 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBoDOSVYrav+GlCa4L/eEPx86Bt7XUkd4RqEJUm+dCVhDVXvZhvjSiNzVq/AjMilg6LgyBiQMEP15JTikFKc0MlMFv41+2CTT7JOTWwQWOjRbHxOErhjJ/znob2ub9aHZg=='}}} Sep 08 10:40:43.938995 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:40:43.938995 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:43.938995 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Sep 08 10:40:43.938995 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi result = func(instance) Sep 08 10:40:43.938995 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Sep 08 10:40:43.938995 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Sep 08 10:40:43.938995 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Sep 08 10:40:43.938995 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Sep 08 10:40:43.938995 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 08 10:40:43.938995 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:40:43.938995 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 08 10:40:43.938995 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:40:43.938995 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:43.938995 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 10:40:43.942328 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 10:40:43.942328 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 10:40:43.942328 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise error Sep 08 10:40:43.942328 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Sep 08 10:40:43.942328 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:40:43.942328 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Sep 08 10:40:43.942328 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Sep 08 10:40:43.942328 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Sep 08 10:40:43.942328 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi 'minLength': 1, Sep 08 10:40:43.942328 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 08 10:40:43.942328 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:40:43.942328 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Sep 08 10:40:43.942328 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Sep 08 10:40:43.942328 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:40:43.942328 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:40:43.942328 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:40:43.942328 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:43.942328 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:40:43.942328 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:40:43.942328 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:40:43.942328 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:40:43.942328 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:40:43.942328 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:40:43.959144 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:40:43.959144 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:40:43.959144 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:40:43.959144 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:40:43.959144 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 10:40:43.959144 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 10:40:43.959144 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 10:40:43.959144 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 10:40:43.959144 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 10:40:43.959144 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 10:40:43.959144 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 08 10:40:43.959144 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:40:43.959144 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:40:43.959144 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:40:43.959144 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:43.959144 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:40:43.959144 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:40:43.959144 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 10:40:43.959144 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 10:40:43.969078 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 08 10:40:43.969078 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:40:43.969078 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2c6c4ac9-ff2a-4a7b-8bb8-01b0e9b40aff tempest-KeyPairsNegativeTestJSON-1688980726 tempest-KeyPairsNegativeTestJSON-1688980726-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:40:43.969078 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2c6c4ac9-ff2a-4a7b-8bb8-01b0e9b40aff tempest-KeyPairsNegativeTestJSON-1688980726 tempest-KeyPairsNegativeTestJSON-1688980726-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.256747 Sep 08 10:40:43.969078 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 485/1030] 10.222.0.27 () {60 vars in 1159 bytes} [Thu Sep 8 10:40:43 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 262 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 08 10:40:43.969078 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1ac3768c-a1e0-4603-9be3-cd3154e36f32 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:43.970211 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1ac3768c-a1e0-4603-9be3-cd3154e36f32 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: 8be00267-7835-4f68-bb40-6677750c0e3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:43.972813 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1ac3768c-a1e0-4603-9be3-cd3154e36f32 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:43.978033 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1ac3768c-a1e0-4603-9be3-cd3154e36f32 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:43.978653 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1ac3768c-a1e0-4603-9be3-cd3154e36f32 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:43.979249 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1ac3768c-a1e0-4603-9be3-cd3154e36f32 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:43.979975 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1ac3768c-a1e0-4603-9be3-cd3154e36f32 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:43.980704 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1ac3768c-a1e0-4603-9be3-cd3154e36f32 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:44.252863 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fa168583-fe86-47f3-811f-121bc83a274f tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/2801ba6c-ccc5-4fe6-81cb-045aa485c510" status: 202 len: 0 microversion: 2.1 time: 1.757697 Sep 08 10:40:44.260399 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 546/1031] 10.222.0.27 () {58 vars in 1263 bytes} [Thu Sep 8 10:40:42 2022] DELETE /compute/v2.1/os-floating-ips/2801ba6c-ccc5-4fe6-81cb-045aa485c510 => generated 0 bytes in 1776 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:40:44.270928 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2beaf396-ed2a-40df-b69c-892ac7e9d6b1 tempest-KeyPairsNegativeTestJSON-1688980726 tempest-KeyPairsNegativeTestJSON-1688980726-project] Action: 'create', calling method: .version_select at 0x7f68e464be50>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1007934275", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:40:44.298997 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-2beaf396-ed2a-40df-b69c-892ac7e9d6b1 tempest-KeyPairsNegativeTestJSON-1688980726 tempest-KeyPairsNegativeTestJSON-1688980726-project] Getting quotas for project 846ab73f8a8140f4ae159701f1ee46d9. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:40:44.310410 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-2beaf396-ed2a-40df-b69c-892ac7e9d6b1 tempest-KeyPairsNegativeTestJSON-1688980726 tempest-KeyPairsNegativeTestJSON-1688980726-project] Getting quotas for user 69d34aeb636f4db6819f54619df5b17f and project 846ab73f8a8140f4ae159701f1ee46d9. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:40:44.329473 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1ac3768c-a1e0-4603-9be3-cd3154e36f32 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:44.346485 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-2beaf396-ed2a-40df-b69c-892ac7e9d6b1 tempest-KeyPairsNegativeTestJSON-1688980726 tempest-KeyPairsNegativeTestJSON-1688980726-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Sep 08 10:40:44.349550 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1ac3768c-a1e0-4603-9be3-cd3154e36f32 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/8be00267-7835-4f68-bb40-6677750c0e3c" status: 200 len: 1472 microversion: 2.1 time: 0.400702 Sep 08 10:40:44.351354 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 486/1032] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:43 2022] GET /compute/v2.1/servers/8be00267-7835-4f68-bb40-6677750c0e3c => generated 1472 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:44.359337 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f1fc22df-1929-495b-878d-7fc7fab5ced0 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Action: 'action', calling method: .version_select at 0x7f68e69d51f0>, body: {"removeFloatingIp": {"address": "172.25.7.227"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:40:44.372706 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2beaf396-ed2a-40df-b69c-892ac7e9d6b1 tempest-KeyPairsNegativeTestJSON-1688980726 tempest-KeyPairsNegativeTestJSON-1688980726-project] Request method failure captured: Sep 08 10:40:44.372706 n-d-850501-12 devstack@n-api.service[128862]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 08 10:40:44.372706 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:40:44.372706 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:40:44.372706 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:40:44.372706 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 2167 Sep 08 10:40:44.372706 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:40:44.372706 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:40:44.372706 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:40:44.372706 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:40:44.372706 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcar0HTSz11SW0L2pZJ2DQIdEbFJngVgf54HfXslpPti3PEEwkMC6pOaQ0W89q6guSW790Vmq6yM5FGxolNB1pgY1MykKoH_eJK6ZcdWqzSzbOOBnSLZwQRAZv9Z1tCkbZUs9pNWPR_kn4z7dE5H_17gblP3z-2o-tfHCbbIIQjGx6I Sep 08 10:40:44.372706 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:40:44.372706 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:40:44.372706 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:40:44.372706 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:40:44.372706 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:40:44.372706 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:40:44.372706 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 846ab73f8a8140f4ae159701f1ee46d9 Sep 08 10:40:44.372706 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1688980726 Sep 08 10:40:44.372706 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:40:44.372706 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:40:44.372706 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/846ab73f8a8140f4ae159701f1ee46d9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/846ab73f8a8140f4ae159701f1ee46d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_846ab73f8a8140f4ae159701f1ee46d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/846ab73f8a8140f4ae159701f1ee46d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:40:44.372706 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1688980726 Sep 08 10:40:44.372706 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 846ab73f8a8140f4ae159701f1ee46d9 Sep 08 10:40:44.372706 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1688980726 Sep 08 10:40:44.372706 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-KeyPairsNegativeTestJSON-1688980726-project Sep 08 10:40:44.372706 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:40:44.372706 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:40:44.372706 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 69d34aeb636f4db6819f54619df5b17f Sep 08 10:40:44.372706 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1688980726-project Sep 08 10:40:44.372706 n-d-850501-12 devstack@n-api.service[128862]: Sep 08 10:40:44.372706 n-d-850501-12 devstack@n-api.service[128862]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1007934275", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Sep 08 10:40:44.372706 n-d-850501-12 devstack@n-api.service[128862]: method: Sep 08 10:40:44.372706 n-d-850501-12 devstack@n-api.service[128862]: exception: Keypair data is invalid: failed to generate fingerprint Sep 08 10:40:44.376778 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1007934275', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Sep 08 10:40:44.376778 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:40:44.376778 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:44.376778 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Sep 08 10:40:44.376778 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Sep 08 10:40:44.376778 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Sep 08 10:40:44.376778 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Sep 08 10:40:44.376778 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Sep 08 10:40:44.376778 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:44.376778 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:40:44.376778 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:44.376778 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:44.376778 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 08 10:40:44.376778 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 08 10:40:44.376778 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 08 10:40:44.376778 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 08 10:40:44.376778 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:40:44.376778 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:40:44.376778 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:40:44.376778 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:40:44.376778 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 08 10:40:44.376778 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 08 10:40:44.376778 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Sep 08 10:40:44.376778 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Sep 08 10:40:44.376778 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Sep 08 10:40:44.376778 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Sep 08 10:40:44.376778 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Sep 08 10:40:44.376778 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Sep 08 10:40:44.376778 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Sep 08 10:40:44.376778 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:44.376778 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:40:44.376778 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:44.376778 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:44.376778 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:40:44.376778 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:40:44.376778 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:40:44.376778 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:40:44.376778 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:40:44.376778 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:40:44.376778 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:40:44.376778 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:40:44.381254 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:40:44.381254 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:40:44.381254 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:40:44.381254 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:40:44.381254 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 08 10:40:44.381254 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 08 10:40:44.381254 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Sep 08 10:40:44.381254 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Sep 08 10:40:44.381254 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Sep 08 10:40:44.381254 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:44.381254 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:40:44.381254 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:44.381254 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:44.381254 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:40:44.381254 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:40:44.381254 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:40:44.381254 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:40:44.381254 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Sep 08 10:40:44.381254 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:44.385346 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2beaf396-ed2a-40df-b69c-892ac7e9d6b1 tempest-KeyPairsNegativeTestJSON-1688980726 tempest-KeyPairsNegativeTestJSON-1688980726-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:40:44.386609 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2beaf396-ed2a-40df-b69c-892ac7e9d6b1 tempest-KeyPairsNegativeTestJSON-1688980726 tempest-KeyPairsNegativeTestJSON-1688980726-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.123745 Sep 08 10:40:44.387410 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 547/1033] 10.222.0.27 () {60 vars in 1160 bytes} [Thu Sep 8 10:40:44 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 126 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 08 10:40:44.396234 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-95372d35-119e-4450-aa86-720aecf48f2f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:44.398229 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-95372d35-119e-4450-aa86-720aecf48f2f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 923d2401-f860-4284-a580-37ed478720f6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:44.406314 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-95372d35-119e-4450-aa86-720aecf48f2f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:44.406805 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-95372d35-119e-4450-aa86-720aecf48f2f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:44.407441 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-95372d35-119e-4450-aa86-720aecf48f2f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:44.408563 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-95372d35-119e-4450-aa86-720aecf48f2f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:44.409062 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-95372d35-119e-4450-aa86-720aecf48f2f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:44.409809 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-95372d35-119e-4450-aa86-720aecf48f2f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:44.795162 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-95372d35-119e-4450-aa86-720aecf48f2f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:44.808470 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-95372d35-119e-4450-aa86-720aecf48f2f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6" status: 200 len: 1471 microversion: 2.1 time: 0.419787 Sep 08 10:40:44.809318 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 548/1034] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:44 2022] GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6 => generated 1471 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:44.828861 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c914525e-8afa-45c9-a6f0-71d04e1983d5 tempest-KeyPairsNegativeTestJSON-1688980726 tempest-KeyPairsNegativeTestJSON-1688980726-project] Action: 'create', calling method: .version_select at 0x7f68e469f040>, body: {"keypair": {"name": "tempest-keypair-1782054466", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBU+6sGAECLsl2anUPQeCLtid8Cu2YcLuAomDzg83rKRHZCVIyr4ItwhdMJZGak3QfOZ8siZQraENx2i1ugq9VqffpOtU39cntLdsfSfrN7Ea6BZ4dXEEk27MaZ/kg1Q5Q=="}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:40:44.858666 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-c914525e-8afa-45c9-a6f0-71d04e1983d5 tempest-KeyPairsNegativeTestJSON-1688980726 tempest-KeyPairsNegativeTestJSON-1688980726-project] Getting quotas for project 846ab73f8a8140f4ae159701f1ee46d9. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:40:44.866317 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-c914525e-8afa-45c9-a6f0-71d04e1983d5 tempest-KeyPairsNegativeTestJSON-1688980726 tempest-KeyPairsNegativeTestJSON-1688980726-project] Getting quotas for user 69d34aeb636f4db6819f54619df5b17f and project 846ab73f8a8140f4ae159701f1ee46d9. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:40:44.924866 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c914525e-8afa-45c9-a6f0-71d04e1983d5 tempest-KeyPairsNegativeTestJSON-1688980726 tempest-KeyPairsNegativeTestJSON-1688980726-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.107383 Sep 08 10:40:44.925529 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 549/1035] 10.222.0.27 () {60 vars in 1159 bytes} [Thu Sep 8 10:40:44 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:40:44.946040 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fe4ee89e-332b-4501-b2ce-f1e9af46fe41 tempest-KeyPairsNegativeTestJSON-1688980726 tempest-KeyPairsNegativeTestJSON-1688980726-project] Action: 'create', calling method: .version_select at 0x7f68e479b430>, body: {"keypair": {"name": "tempest-keypair-1782054466", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB3hL5Tvm0wlff27mDxtSipYTHC28ID6Nt89XfQBjtLvZgv1i/4wBb0PbNgk4frWPXCut7ys2j/RUqZk/ccuzG3OLyTdGOVjmbgYVx4cfN1yoRJIX9MV2UjjyTQHPbsmDw=="}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:40:44.968338 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-fe4ee89e-332b-4501-b2ce-f1e9af46fe41 tempest-KeyPairsNegativeTestJSON-1688980726 tempest-KeyPairsNegativeTestJSON-1688980726-project] Getting quotas for project 846ab73f8a8140f4ae159701f1ee46d9. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:40:44.976070 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-fe4ee89e-332b-4501-b2ce-f1e9af46fe41 tempest-KeyPairsNegativeTestJSON-1688980726 tempest-KeyPairsNegativeTestJSON-1688980726-project] Getting quotas for user 69d34aeb636f4db6819f54619df5b17f and project 846ab73f8a8140f4ae159701f1ee46d9. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:40:45.020910 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-fe4ee89e-332b-4501-b2ce-f1e9af46fe41 tempest-KeyPairsNegativeTestJSON-1688980726 tempest-KeyPairsNegativeTestJSON-1688980726-project] HTTP exception thrown: Key pair 'tempest-keypair-1782054466' already exists. Sep 08 10:40:45.027032 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fe4ee89e-332b-4501-b2ce-f1e9af46fe41 tempest-KeyPairsNegativeTestJSON-1688980726 tempest-KeyPairsNegativeTestJSON-1688980726-project] Request method failure captured: Sep 08 10:40:45.027032 n-d-850501-12 devstack@n-api.service[128862]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 08 10:40:45.027032 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:40:45.027032 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:40:45.027032 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:40:45.027032 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 273 Sep 08 10:40:45.027032 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:40:45.027032 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:40:45.027032 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:40:45.027032 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:40:45.027032 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcar0HTSz11SW0L2pZJ2DQIdEbFJngVgf54HfXslpPti3PEEwkMC6pOaQ0W89q6guSW790Vmq6yM5FGxolNB1pgY1MykKoH_eJK6ZcdWqzSzbOOBnSLZwQRAZv9Z1tCkbZUs9pNWPR_kn4z7dE5H_17gblP3z-2o-tfHCbbIIQjGx6I Sep 08 10:40:45.027032 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:40:45.027032 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:40:45.027032 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:40:45.027032 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:40:45.027032 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:40:45.027032 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:40:45.027032 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 846ab73f8a8140f4ae159701f1ee46d9 Sep 08 10:40:45.027032 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1688980726 Sep 08 10:40:45.027032 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:40:45.027032 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:40:45.027032 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/846ab73f8a8140f4ae159701f1ee46d9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/846ab73f8a8140f4ae159701f1ee46d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_846ab73f8a8140f4ae159701f1ee46d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/846ab73f8a8140f4ae159701f1ee46d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:40:45.027032 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1688980726 Sep 08 10:40:45.027032 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 846ab73f8a8140f4ae159701f1ee46d9 Sep 08 10:40:45.027032 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1688980726 Sep 08 10:40:45.027032 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-KeyPairsNegativeTestJSON-1688980726-project Sep 08 10:40:45.027032 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:40:45.027032 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:40:45.027032 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 69d34aeb636f4db6819f54619df5b17f Sep 08 10:40:45.027032 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1688980726-project Sep 08 10:40:45.027032 n-d-850501-12 devstack@n-api.service[128862]: Sep 08 10:40:45.027032 n-d-850501-12 devstack@n-api.service[128862]: {"keypair": {"name": "tempest-keypair-1782054466", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB3hL5Tvm0wlff27mDxtSipYTHC28ID6Nt89XfQBjtLvZgv1i/4wBb0PbNgk4frWPXCut7ys2j/RUqZk/ccuzG3OLyTdGOVjmbgYVx4cfN1yoRJIX9MV2UjjyTQHPbsmDw=="}} Sep 08 10:40:45.027032 n-d-850501-12 devstack@n-api.service[128862]: method: Sep 08 10:40:45.027032 n-d-850501-12 devstack@n-api.service[128862]: exception: Key pair 'tempest-keypair-1782054466' already exists. Sep 08 10:40:45.027032 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1782054466', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB3hL5Tvm0wlff27mDxtSipYTHC28ID6Nt89XfQBjtLvZgv1i/4wBb0PbNgk4frWPXCut7ys2j/RUqZk/ccuzG3OLyTdGOVjmbgYVx4cfN1yoRJIX9MV2UjjyTQHPbsmDw=='}}} Sep 08 10:40:45.027032 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:40:45.027032 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:45.027032 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 08 10:40:45.027032 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 08 10:40:45.027032 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 08 10:40:45.027032 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 08 10:40:45.027032 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 08 10:40:45.027032 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 08 10:40:45.027032 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 08 10:40:45.027032 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 08 10:40:45.027032 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 08 10:40:45.027032 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 08 10:40:45.027032 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 08 10:40:45.027032 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result.read() Sep 08 10:40:45.027032 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 08 10:40:45.027032 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 08 10:40:45.027032 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 08 10:40:45.027032 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 08 10:40:45.027032 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 08 10:40:45.027032 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 08 10:40:45.027032 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 08 10:40:45.027032 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 08 10:40:45.027032 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '69d34aeb636f4db6819f54619df5b17f-tempest-keypair-1782054466' for key 'key_pairs.uniq_key_pairs0user_id0name'") Sep 08 10:40:45.027032 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:45.032631 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 08 10:40:45.032631 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:45.032631 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:45.032631 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Sep 08 10:40:45.032631 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi kp.save(context.session) Sep 08 10:40:45.032631 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Sep 08 10:40:45.032631 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi session.flush() Sep 08 10:40:45.032631 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 08 10:40:45.032631 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._flush(objects) Sep 08 10:40:45.032631 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 08 10:40:45.032631 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Sep 08 10:40:45.032631 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 08 10:40:45.032631 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi compat.raise_( Sep 08 10:40:45.032631 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 08 10:40:45.032631 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception Sep 08 10:40:45.032631 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 08 10:40:45.032631 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi flush_context.execute() Sep 08 10:40:45.032631 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 08 10:40:45.032631 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi rec.execute(self) Sep 08 10:40:45.032631 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 08 10:40:45.032631 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Sep 08 10:40:45.032631 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 08 10:40:45.032631 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Sep 08 10:40:45.032631 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 08 10:40:45.032631 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Sep 08 10:40:45.032631 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 08 10:40:45.032631 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Sep 08 10:40:45.032631 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 08 10:40:45.032631 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Sep 08 10:40:45.032631 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 08 10:40:45.032631 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Sep 08 10:40:45.032631 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 08 10:40:45.032631 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Sep 08 10:40:45.032631 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 08 10:40:45.032631 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 08 10:40:45.032631 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 08 10:40:45.032631 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception Sep 08 10:40:45.032631 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 08 10:40:45.032631 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 08 10:40:45.032631 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 08 10:40:45.032631 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 08 10:40:45.032631 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 08 10:40:45.032631 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 08 10:40:45.032631 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 08 10:40:45.032631 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 08 10:40:45.032631 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 08 10:40:45.032631 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 08 10:40:45.032631 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 08 10:40:45.032631 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result.read() Sep 08 10:40:45.032631 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 08 10:40:45.032631 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 08 10:40:45.032631 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 08 10:40:45.032631 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 08 10:40:45.032631 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 08 10:40:45.032631 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 08 10:40:45.032631 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 08 10:40:45.041990 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 08 10:40:45.041990 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '69d34aeb636f4db6819f54619df5b17f-tempest-keypair-1782054466' for key 'key_pairs.uniq_key_pairs0user_id0name'") Sep 08 10:40:45.041990 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Sep 08 10:40:45.041990 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 9, 8, 10, 40, 45, 12077), 'updated_at': None, 'name': 'tempest-keypair-1782054466', 'user_id': '69d34aeb636f4db6819f54619df5b17f', 'fingerprint': 'fd:ab:32:0e:d2:ee:4e:40:a4:8e:77:a0:f0:28:cf:24', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB3hL5Tvm0wlff27mDxtSipYTHC28ID6Nt89XfQBjtLvZgv1i/4wBb0PbNgk4frWPXCut7ys2j/RUqZk/ccuzG3OLyTdGOVjmbgYVx4cfN1yoRJIX9MV2UjjyTQHPbsmDw==', 'type': 'ssh'}] Sep 08 10:40:45.041990 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 08 10:40:45.041990 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:45.041990 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:40:45.041990 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:45.041990 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:45.041990 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 08 10:40:45.041990 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 08 10:40:45.041990 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 08 10:40:45.041990 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 08 10:40:45.041990 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:40:45.041990 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:40:45.041990 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:40:45.041990 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:40:45.041990 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 08 10:40:45.041990 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 08 10:40:45.041990 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Sep 08 10:40:45.041990 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi keypair.create() Sep 08 10:40:45.041990 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 08 10:40:45.041990 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 08 10:40:45.041990 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Sep 08 10:40:45.041990 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._create() Sep 08 10:40:45.041990 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Sep 08 10:40:45.041990 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Sep 08 10:40:45.041990 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Sep 08 10:40:45.041990 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Sep 08 10:40:45.041990 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 08 10:40:45.041990 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 08 10:40:45.041990 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Sep 08 10:40:45.041990 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Sep 08 10:40:45.041990 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1782054466' already exists. Sep 08 10:40:45.041990 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:45.041990 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:40:45.041990 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:45.041990 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:45.041990 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:40:45.041990 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:40:45.041990 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:40:45.041990 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:40:45.041990 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:40:45.041990 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:40:45.041990 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:40:45.041990 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:40:45.041990 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:40:45.041990 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:40:45.041990 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:40:45.041990 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:40:45.041990 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 08 10:40:45.041990 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 08 10:40:45.041990 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Sep 08 10:40:45.041990 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Sep 08 10:40:45.041990 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1782054466' already exists. Sep 08 10:40:45.055297 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:45.055297 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:40:45.055297 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:45.055297 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:45.055297 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:40:45.055297 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:40:45.055297 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:40:45.055297 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:40:45.055297 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1782054466' already exists. Sep 08 10:40:45.055297 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:45.055297 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fe4ee89e-332b-4501-b2ce-f1e9af46fe41 tempest-KeyPairsNegativeTestJSON-1688980726 tempest-KeyPairsNegativeTestJSON-1688980726-project] Returning 409 to user: Key pair 'tempest-keypair-1782054466' already exists. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:40:45.055297 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fe4ee89e-332b-4501-b2ce-f1e9af46fe41 tempest-KeyPairsNegativeTestJSON-1688980726 tempest-KeyPairsNegativeTestJSON-1688980726-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.105812 Sep 08 10:40:45.059220 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 550/1036] 10.222.0.27 () {60 vars in 1159 bytes} [Thu Sep 8 10:40:44 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 121 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 08 10:40:45.067419 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f1fc22df-1929-495b-878d-7fc7fab5ced0 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] [instance: 60ad91da-8810-4117-8b13-ffe0c0e3714f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:45.080216 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1e091b01-bdc6-40c0-a147-34eeedffd5e2 tempest-KeyPairsNegativeTestJSON-1688980726 tempest-KeyPairsNegativeTestJSON-1688980726-project] Calling method '.version_select at 0x7f68e4ba7dc0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:45.087103 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f1fc22df-1929-495b-878d-7fc7fab5ced0 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:45.087612 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f1fc22df-1929-495b-878d-7fc7fab5ced0 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:45.088055 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f1fc22df-1929-495b-878d-7fc7fab5ced0 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:45.088771 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f1fc22df-1929-495b-878d-7fc7fab5ced0 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:45.089283 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f1fc22df-1929-495b-878d-7fc7fab5ced0 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:45.089693 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f1fc22df-1929-495b-878d-7fc7fab5ced0 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:45.173278 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1e091b01-bdc6-40c0-a147-34eeedffd5e2 tempest-KeyPairsNegativeTestJSON-1688980726 tempest-KeyPairsNegativeTestJSON-1688980726-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1782054466" status: 202 len: 0 microversion: 2.1 time: 0.104974 Sep 08 10:40:45.177487 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 551/1037] 10.222.0.27 () {58 vars in 1221 bytes} [Thu Sep 8 10:40:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1782054466 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:40:45.211379 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bd9a410c-d681-4196-a81a-3f9ad9bd4da2 tempest-KeyPairsNegativeTestJSON-1688980726 tempest-KeyPairsNegativeTestJSON-1688980726-project] Action: 'create', calling method: .version_select at 0x7f68e464b5e0>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeBiiCwgQ/2VD4ukOzXd2GoV1ERJjY/j1pw/YDmIlnIJyGz4l1BH3lUie2GHQ72gpsaGd8iHtT+HbCI826BbHUlFyKXTQ9LNVg9kjEa/UqKx6YWRDMmTeDAdlx7JaWTZg=="}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:40:45.229599 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bd9a410c-d681-4196-a81a-3f9ad9bd4da2 tempest-KeyPairsNegativeTestJSON-1688980726 tempest-KeyPairsNegativeTestJSON-1688980726-project] Request method failure captured: Sep 08 10:40:45.229599 n-d-850501-12 devstack@n-api.service[128862]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 08 10:40:45.229599 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:40:45.229599 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:40:45.229599 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:40:45.229599 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 247 Sep 08 10:40:45.229599 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:40:45.229599 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:40:45.229599 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:40:45.229599 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:40:45.229599 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcar0HTSz11SW0L2pZJ2DQIdEbFJngVgf54HfXslpPti3PEEwkMC6pOaQ0W89q6guSW790Vmq6yM5FGxolNB1pgY1MykKoH_eJK6ZcdWqzSzbOOBnSLZwQRAZv9Z1tCkbZUs9pNWPR_kn4z7dE5H_17gblP3z-2o-tfHCbbIIQjGx6I Sep 08 10:40:45.229599 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:40:45.229599 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:40:45.229599 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:40:45.229599 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:40:45.229599 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:40:45.229599 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:40:45.229599 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 846ab73f8a8140f4ae159701f1ee46d9 Sep 08 10:40:45.229599 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1688980726 Sep 08 10:40:45.229599 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:40:45.229599 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:40:45.229599 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/846ab73f8a8140f4ae159701f1ee46d9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/846ab73f8a8140f4ae159701f1ee46d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_846ab73f8a8140f4ae159701f1ee46d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/846ab73f8a8140f4ae159701f1ee46d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:40:45.229599 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1688980726 Sep 08 10:40:45.229599 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 846ab73f8a8140f4ae159701f1ee46d9 Sep 08 10:40:45.229599 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1688980726 Sep 08 10:40:45.229599 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-KeyPairsNegativeTestJSON-1688980726-project Sep 08 10:40:45.229599 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:40:45.229599 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:40:45.229599 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 69d34aeb636f4db6819f54619df5b17f Sep 08 10:40:45.229599 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1688980726-project Sep 08 10:40:45.229599 n-d-850501-12 devstack@n-api.service[128862]: Sep 08 10:40:45.229599 n-d-850501-12 devstack@n-api.service[128862]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeBiiCwgQ/2VD4ukOzXd2GoV1ERJjY/j1pw/YDmIlnIJyGz4l1BH3lUie2GHQ72gpsaGd8iHtT+HbCI826BbHUlFyKXTQ9LNVg9kjEa/UqKx6YWRDMmTeDAdlx7JaWTZg=="}} Sep 08 10:40:45.229599 n-d-850501-12 devstack@n-api.service[128862]: method: Sep 08 10:40:45.229599 n-d-850501-12 devstack@n-api.service[128862]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 08 10:40:45.229599 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeBiiCwgQ/2VD4ukOzXd2GoV1ERJjY/j1pw/YDmIlnIJyGz4l1BH3lUie2GHQ72gpsaGd8iHtT+HbCI826BbHUlFyKXTQ9LNVg9kjEa/UqKx6YWRDMmTeDAdlx7JaWTZg=='}}} Sep 08 10:40:45.229599 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:40:45.229599 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:45.229599 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 10:40:45.229599 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 10:40:45.229599 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 10:40:45.229599 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise error Sep 08 10:40:45.229599 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 08 10:40:45.229599 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:45.229599 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Sep 08 10:40:45.229599 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 08 10:40:45.229599 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:45.229599 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi On instance['keypair']: Sep 08 10:40:45.229599 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi '' Sep 08 10:40:45.229599 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:45.229599 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:40:45.229599 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:45.229599 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:45.229599 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:40:45.229599 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:40:45.229599 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:40:45.229599 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:40:45.229599 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:40:45.229599 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:40:45.229599 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:40:45.229599 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:40:45.229599 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:40:45.229599 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:40:45.229599 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 10:40:45.229599 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 10:40:45.234005 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 10:40:45.234005 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 10:40:45.234005 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 10:40:45.234005 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 10:40:45.234005 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 08 10:40:45.234005 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:45.234005 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:40:45.234005 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:45.234005 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:45.234005 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:40:45.234005 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:40:45.234005 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 10:40:45.234005 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 10:40:45.234005 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 08 10:40:45.234005 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:45.235187 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bd9a410c-d681-4196-a81a-3f9ad9bd4da2 tempest-KeyPairsNegativeTestJSON-1688980726 tempest-KeyPairsNegativeTestJSON-1688980726-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:40:45.236032 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bd9a410c-d681-4196-a81a-3f9ad9bd4da2 tempest-KeyPairsNegativeTestJSON-1688980726 tempest-KeyPairsNegativeTestJSON-1688980726-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.049094 Sep 08 10:40:45.237214 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 552/1038] 10.222.0.27 () {60 vars in 1159 bytes} [Thu Sep 8 10:40:45 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 51 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:40:45.254244 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-7f787afb-edd2-4e51-8c47-d815ee7aafad req-69b1d398-e46d-4a66-9836-9e83a9f5e4a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8be00267-7835-4f68-bb40-6677750c0e3c", "name": "network-vif-deleted", "tag": "74f17ad2-8bfa-440e-9794-09a424196407"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:40:45.285066 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-7f787afb-edd2-4e51-8c47-d815ee7aafad req-69b1d398-e46d-4a66-9836-9e83a9f5e4a5 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:45.286254 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-7f787afb-edd2-4e51-8c47-d815ee7aafad req-69b1d398-e46d-4a66-9836-9e83a9f5e4a5 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:45.287787 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-7f787afb-edd2-4e51-8c47-d815ee7aafad req-69b1d398-e46d-4a66-9836-9e83a9f5e4a5 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:45.325157 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-7f787afb-edd2-4e51-8c47-d815ee7aafad req-69b1d398-e46d-4a66-9836-9e83a9f5e4a5 service nova] Creating event network-vif-deleted:74f17ad2-8bfa-440e-9794-09a424196407 for instance 8be00267-7835-4f68-bb40-6677750c0e3c on n-h1-850501-12 Sep 08 10:40:45.345423 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-7f787afb-edd2-4e51-8c47-d815ee7aafad req-69b1d398-e46d-4a66-9836-9e83a9f5e4a5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105080 Sep 08 10:40:45.347805 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 553/1039] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:40:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:40:45.365230 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1a8e9af3-2f7b-4493-bcac-3c8e51a4d796 tempest-KeyPairsNegativeTestJSON-1688980726 tempest-KeyPairsNegativeTestJSON-1688980726-project] Action: 'create', calling method: .version_select at 0x7f68e4670ca0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-508674702", "public_key": " "}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:40:45.397527 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-1a8e9af3-2f7b-4493-bcac-3c8e51a4d796 tempest-KeyPairsNegativeTestJSON-1688980726 tempest-KeyPairsNegativeTestJSON-1688980726-project] Getting quotas for project 846ab73f8a8140f4ae159701f1ee46d9. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:40:45.403543 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-1a8e9af3-2f7b-4493-bcac-3c8e51a4d796 tempest-KeyPairsNegativeTestJSON-1688980726 tempest-KeyPairsNegativeTestJSON-1688980726-project] Getting quotas for user 69d34aeb636f4db6819f54619df5b17f and project 846ab73f8a8140f4ae159701f1ee46d9. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:40:45.427015 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-1a8e9af3-2f7b-4493-bcac-3c8e51a4d796 tempest-KeyPairsNegativeTestJSON-1688980726 tempest-KeyPairsNegativeTestJSON-1688980726-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Sep 08 10:40:45.430073 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1a8e9af3-2f7b-4493-bcac-3c8e51a4d796 tempest-KeyPairsNegativeTestJSON-1688980726 tempest-KeyPairsNegativeTestJSON-1688980726-project] Request method failure captured: Sep 08 10:40:45.430073 n-d-850501-12 devstack@n-api.service[128862]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 08 10:40:45.430073 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:40:45.430073 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:40:45.430073 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:40:45.430073 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 94 Sep 08 10:40:45.430073 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:40:45.430073 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:40:45.430073 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:40:45.430073 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:40:45.430073 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcar0HTSz11SW0L2pZJ2DQIdEbFJngVgf54HfXslpPti3PEEwkMC6pOaQ0W89q6guSW790Vmq6yM5FGxolNB1pgY1MykKoH_eJK6ZcdWqzSzbOOBnSLZwQRAZv9Z1tCkbZUs9pNWPR_kn4z7dE5H_17gblP3z-2o-tfHCbbIIQjGx6I Sep 08 10:40:45.430073 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:40:45.430073 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:40:45.430073 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:40:45.430073 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:40:45.430073 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:40:45.430073 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:40:45.430073 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 846ab73f8a8140f4ae159701f1ee46d9 Sep 08 10:40:45.430073 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1688980726 Sep 08 10:40:45.430073 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:40:45.430073 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:40:45.430073 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/846ab73f8a8140f4ae159701f1ee46d9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/846ab73f8a8140f4ae159701f1ee46d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_846ab73f8a8140f4ae159701f1ee46d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/846ab73f8a8140f4ae159701f1ee46d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:40:45.430073 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1688980726 Sep 08 10:40:45.430073 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 846ab73f8a8140f4ae159701f1ee46d9 Sep 08 10:40:45.430073 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1688980726 Sep 08 10:40:45.430073 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-KeyPairsNegativeTestJSON-1688980726-project Sep 08 10:40:45.430073 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:40:45.430073 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:40:45.430073 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 69d34aeb636f4db6819f54619df5b17f Sep 08 10:40:45.430073 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1688980726-project Sep 08 10:40:45.430073 n-d-850501-12 devstack@n-api.service[128862]: Sep 08 10:40:45.430073 n-d-850501-12 devstack@n-api.service[128862]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-508674702", "public_key": " "}} Sep 08 10:40:45.430073 n-d-850501-12 devstack@n-api.service[128862]: method: Sep 08 10:40:45.430073 n-d-850501-12 devstack@n-api.service[128862]: exception: Keypair data is invalid: failed to generate fingerprint Sep 08 10:40:45.430073 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-508674702', 'public_key': ' '}}} Sep 08 10:40:45.430073 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:40:45.430073 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:45.430073 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Sep 08 10:40:45.430073 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Sep 08 10:40:45.430073 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Sep 08 10:40:45.430073 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Sep 08 10:40:45.430073 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Sep 08 10:40:45.430073 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:45.430073 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:40:45.430073 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:45.430073 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:45.430073 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 08 10:40:45.430073 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 08 10:40:45.430073 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 08 10:40:45.430073 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 08 10:40:45.430073 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:40:45.430073 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:40:45.430073 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:40:45.430073 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:40:45.430073 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 08 10:40:45.430073 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 08 10:40:45.430073 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Sep 08 10:40:45.430073 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Sep 08 10:40:45.430073 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Sep 08 10:40:45.430073 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Sep 08 10:40:45.430073 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Sep 08 10:40:45.430073 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Sep 08 10:40:45.430073 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Sep 08 10:40:45.430073 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:45.430073 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:40:45.430073 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:45.435010 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:45.435010 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:40:45.435010 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:40:45.435010 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:40:45.435010 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:40:45.435010 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:40:45.435010 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:40:45.435010 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:40:45.435010 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:40:45.435010 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:40:45.435010 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:40:45.435010 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:40:45.435010 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:40:45.435010 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 08 10:40:45.435010 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 08 10:40:45.435010 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Sep 08 10:40:45.435010 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Sep 08 10:40:45.435010 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Sep 08 10:40:45.435010 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:45.435010 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:40:45.435010 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:45.435010 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:45.435010 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:40:45.435010 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:40:45.435010 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:40:45.435010 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:40:45.435010 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Sep 08 10:40:45.435010 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:45.438646 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1a8e9af3-2f7b-4493-bcac-3c8e51a4d796 tempest-KeyPairsNegativeTestJSON-1688980726 tempest-KeyPairsNegativeTestJSON-1688980726-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:40:45.439706 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1a8e9af3-2f7b-4493-bcac-3c8e51a4d796 tempest-KeyPairsNegativeTestJSON-1688980726 tempest-KeyPairsNegativeTestJSON-1688980726-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.090524 Sep 08 10:40:45.440477 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 554/1040] 10.222.0.27 () {60 vars in 1158 bytes} [Thu Sep 8 10:40:45 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 92 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 08 10:40:45.456861 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-eb9a6402-2b50-4d28-bed0-04dad7947d49 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:45.458082 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-eb9a6402-2b50-4d28-bed0-04dad7947d49 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: 8be00267-7835-4f68-bb40-6677750c0e3c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:45.472714 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb9a6402-2b50-4d28-bed0-04dad7947d49 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:45.475489 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb9a6402-2b50-4d28-bed0-04dad7947d49 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:45.478538 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb9a6402-2b50-4d28-bed0-04dad7947d49 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:45.481131 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb9a6402-2b50-4d28-bed0-04dad7947d49 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:45.483425 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb9a6402-2b50-4d28-bed0-04dad7947d49 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:45.484534 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb9a6402-2b50-4d28-bed0-04dad7947d49 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:45.550284 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb9a6402-2b50-4d28-bed0-04dad7947d49 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:45.550882 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb9a6402-2b50-4d28-bed0-04dad7947d49 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:45.551801 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb9a6402-2b50-4d28-bed0-04dad7947d49 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:45.552451 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-eb9a6402-2b50-4d28-bed0-04dad7947d49 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lazy-loading 'fault' on Instance uuid 8be00267-7835-4f68-bb40-6677750c0e3c {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:40:45.630657 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-eb9a6402-2b50-4d28-bed0-04dad7947d49 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:45.645243 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-eb9a6402-2b50-4d28-bed0-04dad7947d49 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/8be00267-7835-4f68-bb40-6677750c0e3c" status: 200 len: 1306 microversion: 2.1 time: 0.198802 Sep 08 10:40:45.657052 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 555/1041] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:45 2022] GET /compute/v2.1/servers/8be00267-7835-4f68-bb40-6677750c0e3c => generated 1306 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:45.657052 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-313b7284-ed60-475b-946a-a1e1e9f20cca tempest-KeyPairsNegativeTestJSON-1688980726 tempest-KeyPairsNegativeTestJSON-1688980726-project] Action: 'create', calling method: .version_select at 0x7f68e479b160>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBByf2Wr4rkFOzDAHlExwC9qGtUWrOANOHLfWz2Sg+oxg9EJzmru1JYhIakHZMn/cxFP57aZdZRSseLUnaO8FqvTurcgp8ZLH6uWefhpJ/1m/kwajIXsFbew4zqv12JC+Zg=="}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:40:45.659925 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-313b7284-ed60-475b-946a-a1e1e9f20cca tempest-KeyPairsNegativeTestJSON-1688980726 tempest-KeyPairsNegativeTestJSON-1688980726-project] Request method failure captured: Sep 08 10:40:45.659925 n-d-850501-12 devstack@n-api.service[128862]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 08 10:40:45.659925 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:40:45.659925 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:40:45.659925 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:40:45.659925 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 507 Sep 08 10:40:45.659925 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:40:45.659925 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:40:45.659925 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:40:45.659925 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:40:45.659925 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcar0HTSz11SW0L2pZJ2DQIdEbFJngVgf54HfXslpPti3PEEwkMC6pOaQ0W89q6guSW790Vmq6yM5FGxolNB1pgY1MykKoH_eJK6ZcdWqzSzbOOBnSLZwQRAZv9Z1tCkbZUs9pNWPR_kn4z7dE5H_17gblP3z-2o-tfHCbbIIQjGx6I Sep 08 10:40:45.659925 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:40:45.659925 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:40:45.659925 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:40:45.659925 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:40:45.659925 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:40:45.659925 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:40:45.659925 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 846ab73f8a8140f4ae159701f1ee46d9 Sep 08 10:40:45.659925 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1688980726 Sep 08 10:40:45.659925 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:40:45.659925 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:40:45.659925 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/846ab73f8a8140f4ae159701f1ee46d9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/846ab73f8a8140f4ae159701f1ee46d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_846ab73f8a8140f4ae159701f1ee46d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/846ab73f8a8140f4ae159701f1ee46d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:40:45.659925 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1688980726 Sep 08 10:40:45.659925 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 846ab73f8a8140f4ae159701f1ee46d9 Sep 08 10:40:45.659925 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1688980726 Sep 08 10:40:45.659925 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-KeyPairsNegativeTestJSON-1688980726-project Sep 08 10:40:45.659925 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:40:45.659925 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:40:45.659925 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 69d34aeb636f4db6819f54619df5b17f Sep 08 10:40:45.659925 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1688980726-project Sep 08 10:40:45.659925 n-d-850501-12 devstack@n-api.service[128862]: Sep 08 10:40:45.659925 n-d-850501-12 devstack@n-api.service[128862]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBByf2Wr4rkFOzDAHlExwC9qGtUWrOANOHLfWz2Sg+oxg9EJzmru1JYhIakHZMn/cxFP57aZdZRSseLUnaO8FqvTurcgp8ZLH6uWefhpJ/1m/kwajIXsFbew4zqv12JC+Zg=="}} Sep 08 10:40:45.659925 n-d-850501-12 devstack@n-api.service[128862]: method: Sep 08 10:40:45.659925 n-d-850501-12 devstack@n-api.service[128862]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 08 10:40:45.659925 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBByf2Wr4rkFOzDAHlExwC9qGtUWrOANOHLfWz2Sg+oxg9EJzmru1JYhIakHZMn/cxFP57aZdZRSseLUnaO8FqvTurcgp8ZLH6uWefhpJ/1m/kwajIXsFbew4zqv12JC+Zg=='}}} Sep 08 10:40:45.659925 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:40:45.659925 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:45.659925 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 10:40:45.659925 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 10:40:45.659925 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 10:40:45.659925 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise error Sep 08 10:40:45.659925 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 08 10:40:45.659925 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:45.659925 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Sep 08 10:40:45.659925 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 08 10:40:45.659925 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:45.659925 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi On instance['keypair']: Sep 08 10:40:45.659925 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Sep 08 10:40:45.666988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:45.666988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:40:45.666988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:45.666988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:45.666988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:40:45.666988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:40:45.666988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:40:45.666988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:40:45.666988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:40:45.666988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:40:45.666988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:40:45.666988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:40:45.666988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:40:45.666988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:40:45.666988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 10:40:45.666988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 10:40:45.666988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 10:40:45.666988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 10:40:45.666988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 10:40:45.666988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 10:40:45.666988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 08 10:40:45.666988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:45.666988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:40:45.666988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:45.666988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:45.666988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:40:45.666988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:40:45.666988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 10:40:45.666988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 10:40:45.666988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 08 10:40:45.666988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:45.672628 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-313b7284-ed60-475b-946a-a1e1e9f20cca tempest-KeyPairsNegativeTestJSON-1688980726 tempest-KeyPairsNegativeTestJSON-1688980726-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:40:45.672628 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-313b7284-ed60-475b-946a-a1e1e9f20cca tempest-KeyPairsNegativeTestJSON-1688980726 tempest-KeyPairsNegativeTestJSON-1688980726-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.021736 Sep 08 10:40:45.677479 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 556/1042] 10.222.0.27 () {60 vars in 1159 bytes} [Thu Sep 8 10:40:45 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:40:45.684143 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5a8599f2-5aeb-4af7-bbf5-cb0424c017a0 tempest-KeyPairsNegativeTestJSON-1688980726 tempest-KeyPairsNegativeTestJSON-1688980726-project] Action: 'create', calling method: .version_select at 0x7f68e469eaf0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-511894544", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:40:45.703720 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-5a8599f2-5aeb-4af7-bbf5-cb0424c017a0 tempest-KeyPairsNegativeTestJSON-1688980726 tempest-KeyPairsNegativeTestJSON-1688980726-project] Getting quotas for project 846ab73f8a8140f4ae159701f1ee46d9. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:40:45.710188 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-5a8599f2-5aeb-4af7-bbf5-cb0424c017a0 tempest-KeyPairsNegativeTestJSON-1688980726 tempest-KeyPairsNegativeTestJSON-1688980726-project] Getting quotas for user 69d34aeb636f4db6819f54619df5b17f and project 846ab73f8a8140f4ae159701f1ee46d9. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:40:45.744690 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-5a8599f2-5aeb-4af7-bbf5-cb0424c017a0 tempest-KeyPairsNegativeTestJSON-1688980726 tempest-KeyPairsNegativeTestJSON-1688980726-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Sep 08 10:40:45.747675 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5a8599f2-5aeb-4af7-bbf5-cb0424c017a0 tempest-KeyPairsNegativeTestJSON-1688980726 tempest-KeyPairsNegativeTestJSON-1688980726-project] Request method failure captured: Sep 08 10:40:45.747675 n-d-850501-12 devstack@n-api.service[128862]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 08 10:40:45.747675 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:40:45.747675 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:40:45.747675 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:40:45.747675 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 117 Sep 08 10:40:45.747675 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:40:45.747675 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:40:45.747675 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:40:45.747675 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:40:45.747675 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcar0HTSz11SW0L2pZJ2DQIdEbFJngVgf54HfXslpPti3PEEwkMC6pOaQ0W89q6guSW790Vmq6yM5FGxolNB1pgY1MykKoH_eJK6ZcdWqzSzbOOBnSLZwQRAZv9Z1tCkbZUs9pNWPR_kn4z7dE5H_17gblP3z-2o-tfHCbbIIQjGx6I Sep 08 10:40:45.747675 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:40:45.747675 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:40:45.747675 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:40:45.747675 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:40:45.747675 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:40:45.747675 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:40:45.747675 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 846ab73f8a8140f4ae159701f1ee46d9 Sep 08 10:40:45.747675 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1688980726 Sep 08 10:40:45.747675 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:40:45.747675 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:40:45.747675 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/846ab73f8a8140f4ae159701f1ee46d9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/846ab73f8a8140f4ae159701f1ee46d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_846ab73f8a8140f4ae159701f1ee46d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/846ab73f8a8140f4ae159701f1ee46d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:40:45.747675 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1688980726 Sep 08 10:40:45.747675 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 846ab73f8a8140f4ae159701f1ee46d9 Sep 08 10:40:45.747675 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1688980726 Sep 08 10:40:45.747675 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-KeyPairsNegativeTestJSON-1688980726-project Sep 08 10:40:45.747675 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:40:45.747675 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:40:45.747675 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 69d34aeb636f4db6819f54619df5b17f Sep 08 10:40:45.747675 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1688980726-project Sep 08 10:40:45.747675 n-d-850501-12 devstack@n-api.service[128862]: Sep 08 10:40:45.747675 n-d-850501-12 devstack@n-api.service[128862]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-511894544", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Sep 08 10:40:45.747675 n-d-850501-12 devstack@n-api.service[128862]: method: Sep 08 10:40:45.747675 n-d-850501-12 devstack@n-api.service[128862]: exception: Keypair data is invalid: failed to generate fingerprint Sep 08 10:40:45.747675 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-511894544', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Sep 08 10:40:45.747675 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:40:45.747675 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:45.747675 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Sep 08 10:40:45.747675 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Sep 08 10:40:45.747675 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Sep 08 10:40:45.747675 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Sep 08 10:40:45.747675 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Sep 08 10:40:45.747675 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Sep 08 10:40:45.747675 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Sep 08 10:40:45.747675 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Sep 08 10:40:45.747675 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Sep 08 10:40:45.747675 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:45.747675 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:40:45.747675 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:45.747675 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:45.747675 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 08 10:40:45.747675 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 08 10:40:45.747675 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 08 10:40:45.747675 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 08 10:40:45.747675 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:40:45.747675 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:40:45.747675 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:40:45.747675 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:40:45.747675 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 08 10:40:45.747675 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 08 10:40:45.747675 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Sep 08 10:40:45.747675 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Sep 08 10:40:45.747675 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Sep 08 10:40:45.747675 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Sep 08 10:40:45.756313 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Sep 08 10:40:45.756313 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Sep 08 10:40:45.756313 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Sep 08 10:40:45.756313 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:45.756313 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:40:45.756313 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:45.756313 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:45.756313 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:40:45.756313 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:40:45.756313 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:40:45.756313 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:40:45.756313 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:40:45.756313 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:40:45.756313 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:40:45.756313 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:40:45.756313 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:40:45.756313 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:40:45.756313 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:40:45.756313 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:40:45.756313 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 08 10:40:45.756313 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 08 10:40:45.756313 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Sep 08 10:40:45.756313 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Sep 08 10:40:45.756313 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Sep 08 10:40:45.756313 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:45.756313 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:40:45.756313 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:45.756313 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:45.756313 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:40:45.756313 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:40:45.756313 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:40:45.756313 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:40:45.756313 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Sep 08 10:40:45.756313 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:45.756313 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5a8599f2-5aeb-4af7-bbf5-cb0424c017a0 tempest-KeyPairsNegativeTestJSON-1688980726 tempest-KeyPairsNegativeTestJSON-1688980726-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:40:45.756313 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5a8599f2-5aeb-4af7-bbf5-cb0424c017a0 tempest-KeyPairsNegativeTestJSON-1688980726 tempest-KeyPairsNegativeTestJSON-1688980726-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.071384 Sep 08 10:40:45.756313 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 557/1043] 10.222.0.27 () {60 vars in 1159 bytes} [Thu Sep 8 10:40:45 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 74 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Sep 08 10:40:45.770068 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f8b37901-a759-414f-81a2-38b3e0261993 tempest-KeyPairsNegativeTestJSON-1688980726 tempest-KeyPairsNegativeTestJSON-1688980726-project] Calling method '.version_select at 0x7f68e4670a60>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:45.794017 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-f8b37901-a759-414f-81a2-38b3e0261993 tempest-KeyPairsNegativeTestJSON-1688980726 tempest-KeyPairsNegativeTestJSON-1688980726-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-250229068 not found for user 69d34aeb636f4db6819f54619df5b17f Sep 08 10:40:45.797826 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f1fc22df-1929-495b-878d-7fc7fab5ced0 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Acquiring lock "refresh_cache-60ad91da-8810-4117-8b13-ffe0c0e3714f" {{(pid=128861) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 08 10:40:45.798616 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f1fc22df-1929-495b-878d-7fc7fab5ced0 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Acquired lock "refresh_cache-60ad91da-8810-4117-8b13-ffe0c0e3714f" {{(pid=128861) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 08 10:40:45.809643 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f8b37901-a759-414f-81a2-38b3e0261993 tempest-KeyPairsNegativeTestJSON-1688980726 tempest-KeyPairsNegativeTestJSON-1688980726-project] Request method failure captured: Sep 08 10:40:45.809643 n-d-850501-12 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-250229068 HTTP/1.1 Sep 08 10:40:45.809643 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:40:45.809643 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:40:45.809643 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:40:45.809643 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:40:45.809643 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:40:45.809643 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:40:45.809643 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:40:45.809643 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:40:45.809643 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcar0HTSz11SW0L2pZJ2DQIdEbFJngVgf54HfXslpPti3PEEwkMC6pOaQ0W89q6guSW790Vmq6yM5FGxolNB1pgY1MykKoH_eJK6ZcdWqzSzbOOBnSLZwQRAZv9Z1tCkbZUs9pNWPR_kn4z7dE5H_17gblP3z-2o-tfHCbbIIQjGx6I Sep 08 10:40:45.809643 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:40:45.809643 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:40:45.809643 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:40:45.809643 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:40:45.809643 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:40:45.809643 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:40:45.809643 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 846ab73f8a8140f4ae159701f1ee46d9 Sep 08 10:40:45.809643 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1688980726 Sep 08 10:40:45.809643 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:40:45.809643 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:40:45.809643 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/846ab73f8a8140f4ae159701f1ee46d9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/846ab73f8a8140f4ae159701f1ee46d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_846ab73f8a8140f4ae159701f1ee46d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/846ab73f8a8140f4ae159701f1ee46d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:40:45.809643 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1688980726 Sep 08 10:40:45.809643 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 846ab73f8a8140f4ae159701f1ee46d9 Sep 08 10:40:45.809643 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1688980726 Sep 08 10:40:45.809643 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-KeyPairsNegativeTestJSON-1688980726-project Sep 08 10:40:45.809643 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:40:45.809643 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:40:45.809643 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 69d34aeb636f4db6819f54619df5b17f Sep 08 10:40:45.809643 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1688980726-project Sep 08 10:40:45.809643 n-d-850501-12 devstack@n-api.service[128862]: method: Sep 08 10:40:45.809643 n-d-850501-12 devstack@n-api.service[128862]: exception: Keypair tempest-keypair-non-existent-250229068 not found for user 69d34aeb636f4db6819f54619df5b17f Sep 08 10:40:45.809643 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'tempest-keypair-non-existent-250229068'} Sep 08 10:40:45.809643 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:40:45.809643 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:45.809643 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Sep 08 10:40:45.809643 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Sep 08 10:40:45.809643 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 08 10:40:45.809643 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 08 10:40:45.809643 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:40:45.809643 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:40:45.809643 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:40:45.809643 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:40:45.809643 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 08 10:40:45.809643 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 08 10:40:45.809643 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Sep 08 10:40:45.809643 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Sep 08 10:40:45.809643 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Sep 08 10:40:45.809643 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Sep 08 10:40:45.809643 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 10:40:45.809643 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 10:40:45.809643 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Sep 08 10:40:45.809643 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Sep 08 10:40:45.809643 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Sep 08 10:40:45.809643 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Sep 08 10:40:45.809643 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 08 10:40:45.809643 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 08 10:40:45.809643 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Sep 08 10:40:45.809643 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Sep 08 10:40:45.809643 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-250229068 not found for user 69d34aeb636f4db6819f54619df5b17f Sep 08 10:40:45.809643 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:45.809643 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:40:45.820089 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:45.820089 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:45.820089 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:40:45.820089 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:40:45.820089 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:40:45.820089 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:40:45.820089 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:40:45.820089 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:40:45.820089 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 08 10:40:45.820089 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:40:45.820089 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:40:45.820089 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:40:45.820089 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Sep 08 10:40:45.820089 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._delete(req, id) Sep 08 10:40:45.820089 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Sep 08 10:40:45.820089 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Sep 08 10:40:45.820089 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-250229068 not found for user 69d34aeb636f4db6819f54619df5b17f Sep 08 10:40:45.820089 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:45.820089 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:40:45.820089 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:45.820089 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:45.820089 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:40:45.820089 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:40:45.820089 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:40:45.820089 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:40:45.820089 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-250229068 not found for user 69d34aeb636f4db6819f54619df5b17f Sep 08 10:40:45.820089 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:45.820089 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f8b37901-a759-414f-81a2-38b3e0261993 tempest-KeyPairsNegativeTestJSON-1688980726 tempest-KeyPairsNegativeTestJSON-1688980726-project] Returning 404 to user: Keypair tempest-keypair-non-existent-250229068 not found for user 69d34aeb636f4db6819f54619df5b17f {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:40:45.820089 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f8b37901-a759-414f-81a2-38b3e0261993 tempest-KeyPairsNegativeTestJSON-1688980726 tempest-KeyPairsNegativeTestJSON-1688980726-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-250229068" status: 404 len: 144 microversion: 2.1 time: 0.050039 Sep 08 10:40:45.820089 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 558/1044] 10.222.0.27 () {58 vars in 1257 bytes} [Thu Sep 8 10:40:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-250229068 => generated 144 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:40:45.844576 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b793d456-9fb5-43f1-b466-45d3f0a4ae8e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:45.845470 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b793d456-9fb5-43f1-b466-45d3f0a4ae8e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 923d2401-f860-4284-a580-37ed478720f6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:45.855007 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b793d456-9fb5-43f1-b466-45d3f0a4ae8e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:45.855916 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b793d456-9fb5-43f1-b466-45d3f0a4ae8e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:45.856456 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b793d456-9fb5-43f1-b466-45d3f0a4ae8e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:45.857494 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b793d456-9fb5-43f1-b466-45d3f0a4ae8e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:45.858121 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b793d456-9fb5-43f1-b466-45d3f0a4ae8e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:45.858877 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b793d456-9fb5-43f1-b466-45d3f0a4ae8e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:46.161787 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b793d456-9fb5-43f1-b466-45d3f0a4ae8e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:46.186624 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b793d456-9fb5-43f1-b466-45d3f0a4ae8e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6" status: 200 len: 1471 microversion: 2.1 time: 0.348925 Sep 08 10:40:46.217294 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 559/1045] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:45 2022] GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6 => generated 1471 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:46.674400 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b2b4520a-7ae2-4549-ad71-1beda3eadc77 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:46.675619 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b2b4520a-7ae2-4549-ad71-1beda3eadc77 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: 8be00267-7835-4f68-bb40-6677750c0e3c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:46.690674 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b2b4520a-7ae2-4549-ad71-1beda3eadc77 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:46.692167 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b2b4520a-7ae2-4549-ad71-1beda3eadc77 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:46.694299 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b2b4520a-7ae2-4549-ad71-1beda3eadc77 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:46.696079 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b2b4520a-7ae2-4549-ad71-1beda3eadc77 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:46.697336 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b2b4520a-7ae2-4549-ad71-1beda3eadc77 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:46.698480 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b2b4520a-7ae2-4549-ad71-1beda3eadc77 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:46.768918 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b2b4520a-7ae2-4549-ad71-1beda3eadc77 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:46.769616 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b2b4520a-7ae2-4549-ad71-1beda3eadc77 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:46.770234 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b2b4520a-7ae2-4549-ad71-1beda3eadc77 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:46.770947 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-b2b4520a-7ae2-4549-ad71-1beda3eadc77 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lazy-loading 'fault' on Instance uuid 8be00267-7835-4f68-bb40-6677750c0e3c {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:40:46.837539 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b2b4520a-7ae2-4549-ad71-1beda3eadc77 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:46.885961 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b2b4520a-7ae2-4549-ad71-1beda3eadc77 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/8be00267-7835-4f68-bb40-6677750c0e3c" status: 200 len: 1306 microversion: 2.1 time: 0.214712 Sep 08 10:40:46.892472 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 560/1046] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:46 2022] GET /compute/v2.1/servers/8be00267-7835-4f68-bb40-6677750c0e3c => generated 1306 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:47.233562 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0933618b-307a-42c8-9c7f-e53ba57f2cf1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:47.235066 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0933618b-307a-42c8-9c7f-e53ba57f2cf1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 923d2401-f860-4284-a580-37ed478720f6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:47.246013 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0933618b-307a-42c8-9c7f-e53ba57f2cf1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:47.247670 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0933618b-307a-42c8-9c7f-e53ba57f2cf1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:47.248639 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0933618b-307a-42c8-9c7f-e53ba57f2cf1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:47.250852 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0933618b-307a-42c8-9c7f-e53ba57f2cf1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:47.251973 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0933618b-307a-42c8-9c7f-e53ba57f2cf1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:47.253166 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0933618b-307a-42c8-9c7f-e53ba57f2cf1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:47.474546 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0933618b-307a-42c8-9c7f-e53ba57f2cf1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:47.490019 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0933618b-307a-42c8-9c7f-e53ba57f2cf1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6" status: 200 len: 1463 microversion: 2.1 time: 0.266017 Sep 08 10:40:47.504266 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 561/1047] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:47 2022] GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6 => generated 1463 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:40:47.513461 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-28a1ae38-fb10-42e4-8bd7-6685385bab2d tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:47.514595 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-28a1ae38-fb10-42e4-8bd7-6685385bab2d tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 923d2401-f860-4284-a580-37ed478720f6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:47.522789 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28a1ae38-fb10-42e4-8bd7-6685385bab2d tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:47.523658 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28a1ae38-fb10-42e4-8bd7-6685385bab2d tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:47.524507 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28a1ae38-fb10-42e4-8bd7-6685385bab2d tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:47.525852 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28a1ae38-fb10-42e4-8bd7-6685385bab2d tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:47.526557 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28a1ae38-fb10-42e4-8bd7-6685385bab2d tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:47.527383 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28a1ae38-fb10-42e4-8bd7-6685385bab2d tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:47.597085 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-f1fc22df-1929-495b-878d-7fc7fab5ced0 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] [instance: 60ad91da-8810-4117-8b13-ffe0c0e3714f] Building network info cache for instance {{(pid=128861) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 08 10:40:47.774747 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-28a1ae38-fb10-42e4-8bd7-6685385bab2d tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:47.791352 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-28a1ae38-fb10-42e4-8bd7-6685385bab2d tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6" status: 200 len: 1463 microversion: 2.1 time: 0.281236 Sep 08 10:40:47.794169 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 562/1048] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:47 2022] GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6 => generated 1463 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:47.804168 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-455f11cd-6d70-4a4f-9f34-296c101a337e req-e8e2d281-dc4f-4efb-a604-220440ea2f4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60ad91da-8810-4117-8b13-ffe0c0e3714f", "tag": "f3291f9f-85d0-4bcc-8f0e-f2e1e4d5e84c"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:40:47.834221 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-455f11cd-6d70-4a4f-9f34-296c101a337e req-e8e2d281-dc4f-4efb-a604-220440ea2f4f service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:47.835507 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-455f11cd-6d70-4a4f-9f34-296c101a337e req-e8e2d281-dc4f-4efb-a604-220440ea2f4f service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:47.836750 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-455f11cd-6d70-4a4f-9f34-296c101a337e req-e8e2d281-dc4f-4efb-a604-220440ea2f4f service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:47.875797 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-455f11cd-6d70-4a4f-9f34-296c101a337e req-e8e2d281-dc4f-4efb-a604-220440ea2f4f service nova] Creating event network-changed:f3291f9f-85d0-4bcc-8f0e-f2e1e4d5e84c for instance 60ad91da-8810-4117-8b13-ffe0c0e3714f on n-h1-850501-12 Sep 08 10:40:47.890115 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-455f11cd-6d70-4a4f-9f34-296c101a337e req-e8e2d281-dc4f-4efb-a604-220440ea2f4f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093730 Sep 08 10:40:47.892935 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 563/1049] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:40:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:40:47.911705 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-77c7ec7c-56aa-47d0-8881-34bdf6aa77ce tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Action: 'create', calling method: .version_select at 0x7f68e469e280>, body: {"keypair": {"name": "tempest-keypair-1457951439", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJizBrefE06PaX+Ga0LcRxv9pRWni3JW/rvu3Bks3PeMFZ5NsXV+T7G15ruKgs44ThcT54YlJHSjqahO1eWmUQEKAG/x85GZy5ZrskrCmuDoJ3c3ucPpigHFpXhlt8Yj1Q=="}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:40:47.945187 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-77c7ec7c-56aa-47d0-8881-34bdf6aa77ce tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Getting quotas for project a52c0b4a043445df94dab4dd4292607a. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:40:47.953483 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-77c7ec7c-56aa-47d0-8881-34bdf6aa77ce tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Getting quotas for user 5450284cb50b4f75be0915074bf8fe78 and project a52c0b4a043445df94dab4dd4292607a. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:40:47.992277 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-77c7ec7c-56aa-47d0-8881-34bdf6aa77ce tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.090852 Sep 08 10:40:48.002818 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 564/1050] 10.222.0.27 () {60 vars in 1159 bytes} [Thu Sep 8 10:40:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:40:48.009652 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-43578f8b-be26-4be1-91f2-df6fc49f488a tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:48.011063 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-43578f8b-be26-4be1-91f2-df6fc49f488a tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: 8be00267-7835-4f68-bb40-6677750c0e3c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:48.022813 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-43578f8b-be26-4be1-91f2-df6fc49f488a tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:48.028141 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-43578f8b-be26-4be1-91f2-df6fc49f488a tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:48.029534 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-43578f8b-be26-4be1-91f2-df6fc49f488a tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:48.036246 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-43578f8b-be26-4be1-91f2-df6fc49f488a tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:48.058619 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-43578f8b-be26-4be1-91f2-df6fc49f488a tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:48.061561 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-43578f8b-be26-4be1-91f2-df6fc49f488a tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:48.151028 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-43578f8b-be26-4be1-91f2-df6fc49f488a tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] HTTP exception thrown: Instance 8be00267-7835-4f68-bb40-6677750c0e3c could not be found. Sep 08 10:40:48.151028 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-43578f8b-be26-4be1-91f2-df6fc49f488a tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Request method failure captured: Sep 08 10:40:48.151028 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/8be00267-7835-4f68-bb40-6677750c0e3c HTTP/1.1 Sep 08 10:40:48.151028 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:40:48.151028 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:40:48.151028 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:40:48.151028 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:40:48.151028 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:40:48.151028 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:40:48.151028 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:40:48.151028 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:40:48.151028 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcXsmHH1yoQtgpWVsTlKGRZ1RD9sGjJDO3R5IIX2mO0TzFlOkGo4Nrt9P8ms3HuxErnST87nkHuEi-VzkaDAC8r3keukBBYL9HR0teGPa-du_tj-nOftdvIVdc8Rf3uKj_SiRNumvszg8v8N8iSarJ11mQfNqN8vl0lBx8hzlRuGs8w Sep 08 10:40:48.151028 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:40:48.151028 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:40:48.151028 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:40:48.151028 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:40:48.151028 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:40:48.151028 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:40:48.151028 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 2a3d4a2ec8674e418602b6dc0cec6ab9 Sep 08 10:40:48.151028 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersOnMultiNodesTest-1266277988 Sep 08 10:40:48.151028 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:40:48.151028 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:40:48.151028 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2a3d4a2ec8674e418602b6dc0cec6ab9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2a3d4a2ec8674e418602b6dc0cec6ab9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2a3d4a2ec8674e418602b6dc0cec6ab9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2a3d4a2ec8674e418602b6dc0cec6ab9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:40:48.151028 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServersOnMultiNodesTest-1266277988 Sep 08 10:40:48.151028 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 2a3d4a2ec8674e418602b6dc0cec6ab9 Sep 08 10:40:48.151028 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1266277988 Sep 08 10:40:48.151028 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServersOnMultiNodesTest-1266277988-project Sep 08 10:40:48.151028 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:40:48.151028 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:40:48.151028 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 771c067cf6814084a5520128a970dc82 Sep 08 10:40:48.151028 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServersOnMultiNodesTest-1266277988-project Sep 08 10:40:48.151028 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:40:48.151028 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 8be00267-7835-4f68-bb40-6677750c0e3c could not be found. Sep 08 10:40:48.151028 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '8be00267-7835-4f68-bb40-6677750c0e3c'} Sep 08 10:40:48.151028 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:40:48.151028 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:48.151028 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:40:48.151028 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:40:48.151028 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:40:48.151028 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:40:48.151028 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:40:48.151028 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:40:48.151028 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:40:48.151028 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:40:48.151028 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8be00267-7835-4f68-bb40-6677750c0e3c could not be found. Sep 08 10:40:48.151028 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:48.151028 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:40:48.151028 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:48.151028 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:48.151028 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:40:48.151028 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:40:48.151028 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:40:48.151028 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:40:48.151028 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:40:48.151028 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:40:48.151028 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:40:48.151028 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:40:48.151028 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:40:48.151028 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:40:48.151028 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:40:48.151028 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:40:48.155615 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8be00267-7835-4f68-bb40-6677750c0e3c could not be found. Sep 08 10:40:48.155615 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:48.155615 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:40:48.155615 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:48.155615 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:48.155615 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:40:48.155615 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:40:48.155615 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:40:48.155615 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:40:48.155615 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8be00267-7835-4f68-bb40-6677750c0e3c could not be found. Sep 08 10:40:48.155615 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:48.157998 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-43578f8b-be26-4be1-91f2-df6fc49f488a tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Returning 404 to user: Instance 8be00267-7835-4f68-bb40-6677750c0e3c could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:40:48.168384 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-43578f8b-be26-4be1-91f2-df6fc49f488a tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/8be00267-7835-4f68-bb40-6677750c0e3c" status: 404 len: 111 microversion: 2.1 time: 0.164377 Sep 08 10:40:48.169868 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 565/1051] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:48 2022] GET /compute/v2.1/servers/8be00267-7835-4f68-bb40-6677750c0e3c => generated 111 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:40:48.187884 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-deab6959-abbe-4203-a368-0a0ccca7201f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:48.189782 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-deab6959-abbe-4203-a368-0a0ccca7201f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: 493cd490-27c5-4e08-a789-767757111cb2] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:48.210773 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-deab6959-abbe-4203-a368-0a0ccca7201f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:48.211801 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-deab6959-abbe-4203-a368-0a0ccca7201f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:48.212399 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-deab6959-abbe-4203-a368-0a0ccca7201f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:48.215481 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-deab6959-abbe-4203-a368-0a0ccca7201f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:48.217825 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-deab6959-abbe-4203-a368-0a0ccca7201f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:48.218380 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-deab6959-abbe-4203-a368-0a0ccca7201f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:48.282349 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-deab6959-abbe-4203-a368-0a0ccca7201f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: 493cd490-27c5-4e08-a789-767757111cb2] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:40:48.363794 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:40:48.467175 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:40:48.501220 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-deab6959-abbe-4203-a368-0a0ccca7201f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "DELETE /compute/v2.1/servers/493cd490-27c5-4e08-a789-767757111cb2" status: 204 len: 0 microversion: 2.1 time: 0.323394 Sep 08 10:40:48.505702 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 566/1052] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:40:48 2022] DELETE /compute/v2.1/servers/493cd490-27c5-4e08-a789-767757111cb2 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 10:40:48.521667 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7d4836d3-bbd3-4af9-bbcd-3a86b72228a6 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:48.522971 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7d4836d3-bbd3-4af9-bbcd-3a86b72228a6 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: 83037cf6-4a7d-4ba8-8ecb-469feb7598b8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:48.530127 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d4836d3-bbd3-4af9-bbcd-3a86b72228a6 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:48.531379 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d4836d3-bbd3-4af9-bbcd-3a86b72228a6 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:48.532076 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d4836d3-bbd3-4af9-bbcd-3a86b72228a6 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:48.532979 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d4836d3-bbd3-4af9-bbcd-3a86b72228a6 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:48.533678 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d4836d3-bbd3-4af9-bbcd-3a86b72228a6 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:48.534210 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d4836d3-bbd3-4af9-bbcd-3a86b72228a6 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:48.564195 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7d4836d3-bbd3-4af9-bbcd-3a86b72228a6 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: 83037cf6-4a7d-4ba8-8ecb-469feb7598b8] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:40:48.702204 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7d4836d3-bbd3-4af9-bbcd-3a86b72228a6 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "DELETE /compute/v2.1/servers/83037cf6-4a7d-4ba8-8ecb-469feb7598b8" status: 204 len: 0 microversion: 2.1 time: 0.189112 Sep 08 10:40:48.703955 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 567/1053] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:40:48 2022] DELETE /compute/v2.1/servers/83037cf6-4a7d-4ba8-8ecb-469feb7598b8 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:40:48.704347 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=4 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:40:48.726745 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-392c755a-c6d3-4fc7-b8f9-ba73040dbed8 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:48.728797 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-392c755a-c6d3-4fc7-b8f9-ba73040dbed8 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: 493cd490-27c5-4e08-a789-767757111cb2] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:48.759486 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-392c755a-c6d3-4fc7-b8f9-ba73040dbed8 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:48.764358 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-392c755a-c6d3-4fc7-b8f9-ba73040dbed8 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:48.765167 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-392c755a-c6d3-4fc7-b8f9-ba73040dbed8 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:48.767745 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-392c755a-c6d3-4fc7-b8f9-ba73040dbed8 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:48.768400 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-392c755a-c6d3-4fc7-b8f9-ba73040dbed8 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:48.770619 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-392c755a-c6d3-4fc7-b8f9-ba73040dbed8 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:49.166307 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-392c755a-c6d3-4fc7-b8f9-ba73040dbed8 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:49.179178 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-392c755a-c6d3-4fc7-b8f9-ba73040dbed8 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/493cd490-27c5-4e08-a789-767757111cb2" status: 200 len: 1473 microversion: 2.1 time: 0.468295 Sep 08 10:40:49.180143 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 568/1054] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:48 2022] GET /compute/v2.1/servers/493cd490-27c5-4e08-a789-767757111cb2 => generated 1473 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:49.579030 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-98ff89d6-a269-475a-ba88-d09330af9681 tempest-AbsoluteLimitsNegativeTestJSON-773273371 tempest-AbsoluteLimitsNegativeTestJSON-773273371-project] Calling method '.version_select at 0x7f68e464b820>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:49.602106 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-98ff89d6-a269-475a-ba88-d09330af9681 tempest-AbsoluteLimitsNegativeTestJSON-773273371 tempest-AbsoluteLimitsNegativeTestJSON-773273371-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:49.608213 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-f1fc22df-1929-495b-878d-7fc7fab5ced0 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] [instance: 60ad91da-8810-4117-8b13-ffe0c0e3714f] Updating instance_info_cache with network_info: [{"id": "f3291f9f-85d0-4bcc-8f0e-f2e1e4d5e84c", "address": "fa:16:3e:26:bf:f1", "network": {"id": "1bfe376b-33d6-4996-8274-cfa24df5a837", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-467880614-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "3674a3f87ee348428b195602234e4dd4", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf3291f9f-85", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128861) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 08 10:40:49.608777 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-98ff89d6-a269-475a-ba88-d09330af9681 tempest-AbsoluteLimitsNegativeTestJSON-773273371 tempest-AbsoluteLimitsNegativeTestJSON-773273371-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:49.608777 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-98ff89d6-a269-475a-ba88-d09330af9681 tempest-AbsoluteLimitsNegativeTestJSON-773273371 tempest-AbsoluteLimitsNegativeTestJSON-773273371-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:49.613407 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-98ff89d6-a269-475a-ba88-d09330af9681 tempest-AbsoluteLimitsNegativeTestJSON-773273371 tempest-AbsoluteLimitsNegativeTestJSON-773273371-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:49.616006 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-98ff89d6-a269-475a-ba88-d09330af9681 tempest-AbsoluteLimitsNegativeTestJSON-773273371 tempest-AbsoluteLimitsNegativeTestJSON-773273371-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:49.616953 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-98ff89d6-a269-475a-ba88-d09330af9681 tempest-AbsoluteLimitsNegativeTestJSON-773273371 tempest-AbsoluteLimitsNegativeTestJSON-773273371-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:49.623590 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f1fc22df-1929-495b-878d-7fc7fab5ced0 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Releasing lock "refresh_cache-60ad91da-8810-4117-8b13-ffe0c0e3714f" {{(pid=128861) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 08 10:40:49.624840 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f1fc22df-1929-495b-878d-7fc7fab5ced0 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] 10.222.0.27 "POST /compute/v2.1/servers/60ad91da-8810-4117-8b13-ffe0c0e3714f/action" status: 202 len: 0 microversion: 2.1 time: 5.271360 Sep 08 10:40:49.632738 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 487/1055] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:40:44 2022] POST /compute/v2.1/servers/60ad91da-8810-4117-8b13-ffe0c0e3714f/action => generated 0 bytes in 5279 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 08 10:40:49.644073 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-39556ec6-aed5-4c2b-ad9e-6f76c67bed0d tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Calling method '.version_select at 0x7f68e46e1e50>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:49.653912 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-98ff89d6-a269-475a-ba88-d09330af9681 tempest-AbsoluteLimitsNegativeTestJSON-773273371 tempest-AbsoluteLimitsNegativeTestJSON-773273371-project] 10.222.0.27 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.350534 Sep 08 10:40:49.654915 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 569/1056] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Sep 8 10:40:49 2022] GET /compute/v2.1/limits => generated 511 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:40:49.735169 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-630825f8-d7bb-4b42-b222-10471dc2abbb tempest-AbsoluteLimitsNegativeTestJSON-773273371 tempest-AbsoluteLimitsNegativeTestJSON-773273371-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1229373451", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:40:49.807615 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-630825f8-d7bb-4b42-b222-10471dc2abbb tempest-AbsoluteLimitsNegativeTestJSON-773273371 tempest-AbsoluteLimitsNegativeTestJSON-773273371-project] validate_networks() for None {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:40:50.603643 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-630825f8-d7bb-4b42-b222-10471dc2abbb tempest-AbsoluteLimitsNegativeTestJSON-773273371 tempest-AbsoluteLimitsNegativeTestJSON-773273371-project] Getting quotas for project 670dc03b061f4622a1a0861b458c79d0. Resources: dict_keys(['metadata_items']) {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:40:50.619552 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-630825f8-d7bb-4b42-b222-10471dc2abbb tempest-AbsoluteLimitsNegativeTestJSON-773273371 tempest-AbsoluteLimitsNegativeTestJSON-773273371-project] Getting quotas for user 99dc8bea69484c24bbd3a08f896b3588 and project 670dc03b061f4622a1a0861b458c79d0. Resources: dict_keys(['metadata_items']) {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:40:50.647663 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-630825f8-d7bb-4b42-b222-10471dc2abbb tempest-AbsoluteLimitsNegativeTestJSON-773273371 tempest-AbsoluteLimitsNegativeTestJSON-773273371-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Sep 08 10:40:50.651065 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-630825f8-d7bb-4b42-b222-10471dc2abbb tempest-AbsoluteLimitsNegativeTestJSON-773273371 tempest-AbsoluteLimitsNegativeTestJSON-773273371-project] Request method failure captured: Sep 08 10:40:50.651065 n-d-850501-12 devstack@n-api.service[128862]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 10:40:50.651065 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:40:50.651065 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:40:50.651065 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:40:50.651065 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 1752 Sep 08 10:40:50.651065 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:40:50.651065 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:40:50.651065 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:40:50.651065 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:40:50.651065 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcaxsCa0cuyHUCp2mRDBNbj3xtn5pdEi7nDW7arAsRquLFyy3v9twObQwcUpJvqcB7ddX4tDmiIqQw-KUKPnvR9vj8I8sl5OytAWnSY78UmxU8CFKM-pE-QyQtSxO01Vn8tiTKJT5b03Gkvb8uzK9HUiaRrNs0IJyg82LXFKb0ZF3Bc Sep 08 10:40:50.651065 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:40:50.651065 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:40:50.651065 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:40:50.651065 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:40:50.651065 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:40:50.651065 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:40:50.651065 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 670dc03b061f4622a1a0861b458c79d0 Sep 08 10:40:50.651065 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-773273371 Sep 08 10:40:50.651065 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:40:50.651065 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:40:50.651065 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/670dc03b061f4622a1a0861b458c79d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/670dc03b061f4622a1a0861b458c79d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_670dc03b061f4622a1a0861b458c79d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/670dc03b061f4622a1a0861b458c79d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:40:50.651065 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-773273371 Sep 08 10:40:50.651065 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 670dc03b061f4622a1a0861b458c79d0 Sep 08 10:40:50.651065 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-773273371 Sep 08 10:40:50.651065 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-773273371-project Sep 08 10:40:50.651065 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:40:50.651065 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:40:50.651065 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 99dc8bea69484c24bbd3a08f896b3588 Sep 08 10:40:50.651065 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-773273371-project Sep 08 10:40:50.651065 n-d-850501-12 devstack@n-api.service[128862]: Sep 08 10:40:50.651065 n-d-850501-12 devstack@n-api.service[128862]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1229373451", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Sep 08 10:40:50.651065 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:40:50.651065 n-d-850501-12 devstack@n-api.service[128862]: exception: Maximum number of metadata items exceeds 128 Sep 08 10:40:50.654656 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1229373451', 'imageRef': '503f4a0f-e18f-47fd-ad12-0289e3463117', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Sep 08 10:40:50.654656 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:40:50.654656 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:50.654656 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Sep 08 10:40:50.654656 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Sep 08 10:40:50.654656 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 10:40:50.654656 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 10:40:50.654656 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Sep 08 10:40:50.654656 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Sep 08 10:40:50.654656 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Sep 08 10:40:50.654656 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Sep 08 10:40:50.654656 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Sep 08 10:40:50.654656 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Sep 08 10:40:50.654656 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Sep 08 10:40:50.654656 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:50.654656 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:40:50.654656 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:50.654656 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:50.654656 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 08 10:40:50.654656 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 08 10:40:50.654656 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 08 10:40:50.654656 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 08 10:40:50.654656 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Sep 08 10:40:50.654656 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Sep 08 10:40:50.654656 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Sep 08 10:40:50.654656 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Sep 08 10:40:50.654656 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Sep 08 10:40:50.654656 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Sep 08 10:40:50.654656 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Sep 08 10:40:50.654656 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:50.654656 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:40:50.654656 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:50.654656 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:50.654656 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:40:50.654656 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:40:50.654656 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:40:50.654656 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:40:50.654656 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:40:50.654656 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:40:50.654656 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:40:50.654656 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:40:50.654656 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:40:50.654656 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:40:50.654656 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:40:50.661258 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:40:50.661258 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 08 10:40:50.661258 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 08 10:40:50.661258 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 08 10:40:50.661258 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Sep 08 10:40:50.661258 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:50.661258 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:40:50.661258 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:50.661258 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:50.661258 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:40:50.661258 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:40:50.661258 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:40:50.661258 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:40:50.661258 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Sep 08 10:40:50.661258 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:50.661258 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-630825f8-d7bb-4b42-b222-10471dc2abbb tempest-AbsoluteLimitsNegativeTestJSON-773273371 tempest-AbsoluteLimitsNegativeTestJSON-773273371-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:40:50.661258 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-630825f8-d7bb-4b42-b222-10471dc2abbb tempest-AbsoluteLimitsNegativeTestJSON-773273371 tempest-AbsoluteLimitsNegativeTestJSON-773273371-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.924479 Sep 08 10:40:50.667707 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 570/1057] 10.222.0.27 () {60 vars in 1148 bytes} [Thu Sep 8 10:40:49 2022] POST /compute/v2.1/servers => generated 87 bytes in 934 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:40:50.669755 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e7a8977a-2a41-46e8-a8fa-02f5dcb68306 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:50.670411 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e7a8977a-2a41-46e8-a8fa-02f5dcb68306 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: 493cd490-27c5-4e08-a789-767757111cb2] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:50.679415 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7a8977a-2a41-46e8-a8fa-02f5dcb68306 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:50.679975 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7a8977a-2a41-46e8-a8fa-02f5dcb68306 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:50.680430 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7a8977a-2a41-46e8-a8fa-02f5dcb68306 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:50.681192 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7a8977a-2a41-46e8-a8fa-02f5dcb68306 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:50.681895 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7a8977a-2a41-46e8-a8fa-02f5dcb68306 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:50.682622 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7a8977a-2a41-46e8-a8fa-02f5dcb68306 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:51.076308 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e7a8977a-2a41-46e8-a8fa-02f5dcb68306 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:51.140900 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e7a8977a-2a41-46e8-a8fa-02f5dcb68306 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/493cd490-27c5-4e08-a789-767757111cb2" status: 200 len: 1473 microversion: 2.1 time: 0.476605 Sep 08 10:40:51.150680 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 571/1058] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:50 2022] GET /compute/v2.1/servers/493cd490-27c5-4e08-a789-767757111cb2 => generated 1473 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:51.339483 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-530ba5c9-4779-4233-a2df-11e5f15b9f6f req-694e503e-9c3a-476d-a194-1df39bd56c8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "493cd490-27c5-4e08-a789-767757111cb2", "name": "network-vif-deleted", "tag": "9806eb02-bb40-40a3-973c-f43c9af0fd37"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:40:51.361408 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-530ba5c9-4779-4233-a2df-11e5f15b9f6f req-694e503e-9c3a-476d-a194-1df39bd56c8a service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:51.361906 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-530ba5c9-4779-4233-a2df-11e5f15b9f6f req-694e503e-9c3a-476d-a194-1df39bd56c8a service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:51.367543 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-530ba5c9-4779-4233-a2df-11e5f15b9f6f req-694e503e-9c3a-476d-a194-1df39bd56c8a service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:51.391898 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-530ba5c9-4779-4233-a2df-11e5f15b9f6f req-694e503e-9c3a-476d-a194-1df39bd56c8a service nova] Creating event network-vif-deleted:9806eb02-bb40-40a3-973c-f43c9af0fd37 for instance 493cd490-27c5-4e08-a789-767757111cb2 on n-h2-850501-12 Sep 08 10:40:51.410114 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-530ba5c9-4779-4233-a2df-11e5f15b9f6f req-694e503e-9c3a-476d-a194-1df39bd56c8a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074361 Sep 08 10:40:51.410728 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 572/1059] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:40:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:40:52.198979 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7439272a-8726-4d67-b16d-198e683a306c tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:52.202844 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7439272a-8726-4d67-b16d-198e683a306c tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: 493cd490-27c5-4e08-a789-767757111cb2] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:52.231617 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7439272a-8726-4d67-b16d-198e683a306c tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:52.232149 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7439272a-8726-4d67-b16d-198e683a306c tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:52.232601 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7439272a-8726-4d67-b16d-198e683a306c tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:52.233366 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7439272a-8726-4d67-b16d-198e683a306c tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:52.233833 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7439272a-8726-4d67-b16d-198e683a306c tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:52.234269 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7439272a-8726-4d67-b16d-198e683a306c tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:52.340332 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7439272a-8726-4d67-b16d-198e683a306c tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:52.340842 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7439272a-8726-4d67-b16d-198e683a306c tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:52.341317 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7439272a-8726-4d67-b16d-198e683a306c tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:52.341790 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-7439272a-8726-4d67-b16d-198e683a306c tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lazy-loading 'fault' on Instance uuid 493cd490-27c5-4e08-a789-767757111cb2 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:40:53.035408 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-39556ec6-aed5-4c2b-ad9e-6f76c67bed0d tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/1364532c-9259-48f7-96d6-4c807bfcf5ef" status: 202 len: 0 microversion: 2.1 time: 3.397808 Sep 08 10:40:53.039807 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 488/1060] 10.222.0.27 () {58 vars in 1263 bytes} [Thu Sep 8 10:40:49 2022] DELETE /compute/v2.1/os-floating-ips/1364532c-9259-48f7-96d6-4c807bfcf5ef => generated 0 bytes in 3406 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:40:53.064043 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6612a323-4f8e-43e2-8473-6cc86d87e51d tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:40:53.076286 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6612a323-4f8e-43e2-8473-6cc86d87e51d tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Request method failure captured: Sep 08 10:40:53.076286 n-d-850501-12 devstack@n-api.service[128861]: request: POST /compute/v2.1/servers/60ad91da-8810-4117-8b13-ffe0c0e3714f/action HTTP/1.1 Sep 08 10:40:53.076286 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:40:53.076286 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:40:53.076286 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:40:53.076286 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 34 Sep 08 10:40:53.076286 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:40:53.076286 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:40:53.076286 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:40:53.076286 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:40:53.076286 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcaDH0qBBGNIs2z6CL8YMxdZCeOhnYFK6VIFv3PopAGGEIh6bl2Lj_U5tbU_AfW8V9WbCTXO2mXvB8JS0_KgTquQqCPhlYmGDhVIuYNx-eN6Y_cM9KOseed44Fsk8NAZgK4oPmG4z70583YdZDp1x68OuR7RnaeVInIExqo20-gfl90 Sep 08 10:40:53.076286 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:40:53.076286 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:40:53.076286 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:40:53.076286 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:40:53.076286 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:40:53.076286 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:40:53.076286 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 3674a3f87ee348428b195602234e4dd4 Sep 08 10:40:53.076286 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 Sep 08 10:40:53.076286 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:40:53.076286 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:40:53.076286 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3674a3f87ee348428b195602234e4dd4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3674a3f87ee348428b195602234e4dd4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3674a3f87ee348428b195602234e4dd4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3674a3f87ee348428b195602234e4dd4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:40:53.076286 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 Sep 08 10:40:53.076286 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 3674a3f87ee348428b195602234e4dd4 Sep 08 10:40:53.076286 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 Sep 08 10:40:53.076286 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project Sep 08 10:40:53.076286 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:40:53.076286 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:40:53.076286 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 55e7bb8eedfa46c487513057a67a9537 Sep 08 10:40:53.076286 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project Sep 08 10:40:53.076286 n-d-850501-12 devstack@n-api.service[128861]: Sep 08 10:40:53.076286 n-d-850501-12 devstack@n-api.service[128861]: {"addFloatingIp": {"address": ""}} Sep 08 10:40:53.076286 n-d-850501-12 devstack@n-api.service[128861]: method: Sep 08 10:40:53.076286 n-d-850501-12 devstack@n-api.service[128861]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Sep 08 10:40:53.076286 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '60ad91da-8810-4117-8b13-ffe0c0e3714f', 'body': {'addFloatingIp': {'address': ''}}} Sep 08 10:40:53.076286 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:40:53.076286 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:53.076286 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 10:40:53.076286 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 10:40:53.076286 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 10:40:53.076286 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise error Sep 08 10:40:53.076286 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Sep 08 10:40:53.076286 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:40:53.076286 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Sep 08 10:40:53.076286 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Sep 08 10:40:53.076286 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:40:53.076286 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Sep 08 10:40:53.076286 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi '' Sep 08 10:40:53.076286 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:40:53.076286 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:40:53.076286 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:40:53.076286 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:53.076286 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:40:53.076286 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:40:53.076286 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:40:53.076286 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:40:53.076286 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:40:53.076286 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:40:53.076286 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:40:53.076286 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:40:53.076286 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 10:40:53.076286 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 10:40:53.076286 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 10:40:53.076286 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 10:40:53.076286 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 10:40:53.081451 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 10:40:53.081451 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Sep 08 10:40:53.081451 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:40:53.081451 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:40:53.081451 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:40:53.081451 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:53.081451 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:40:53.081451 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:40:53.081451 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 10:40:53.081451 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 10:40:53.081451 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Sep 08 10:40:53.081451 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:40:53.087274 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6612a323-4f8e-43e2-8473-6cc86d87e51d tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:40:53.090457 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6612a323-4f8e-43e2-8473-6cc86d87e51d tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] 10.222.0.27 "POST /compute/v2.1/servers/60ad91da-8810-4117-8b13-ffe0c0e3714f/action" status: 400 len: 142 microversion: 2.1 time: 0.040973 Sep 08 10:40:53.093909 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 489/1061] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:40:53 2022] POST /compute/v2.1/servers/60ad91da-8810-4117-8b13-ffe0c0e3714f/action => generated 142 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:40:53.135165 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-dbb34960-416b-4441-8f7a-e6db570f1e95 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:40:53.148971 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-dbb34960-416b-4441-8f7a-e6db570f1e95 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] [instance: 60ad91da-8810-4117-8b13-ffe0c0e3714f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:53.186384 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:40:53.188333 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7439272a-8726-4d67-b16d-198e683a306c tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:53.190060 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dbb34960-416b-4441-8f7a-e6db570f1e95 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:53.190564 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dbb34960-416b-4441-8f7a-e6db570f1e95 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:53.191007 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dbb34960-416b-4441-8f7a-e6db570f1e95 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:53.195688 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dbb34960-416b-4441-8f7a-e6db570f1e95 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:53.196486 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dbb34960-416b-4441-8f7a-e6db570f1e95 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:53.200979 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dbb34960-416b-4441-8f7a-e6db570f1e95 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:53.222275 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7439272a-8726-4d67-b16d-198e683a306c tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/493cd490-27c5-4e08-a789-767757111cb2" status: 200 len: 1308 microversion: 2.1 time: 1.042080 Sep 08 10:40:53.225448 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 573/1062] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:52 2022] GET /compute/v2.1/servers/493cd490-27c5-4e08-a789-767757111cb2 => generated 1308 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:53.307455 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dbb34960-416b-4441-8f7a-e6db570f1e95 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Acquiring lock "refresh_cache-60ad91da-8810-4117-8b13-ffe0c0e3714f" {{(pid=128861) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 08 10:40:53.310478 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dbb34960-416b-4441-8f7a-e6db570f1e95 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Acquired lock "refresh_cache-60ad91da-8810-4117-8b13-ffe0c0e3714f" {{(pid=128861) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 08 10:40:53.467202 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-3067edfa-867c-46dc-aab5-b4b8cf137064 req-ea90c863-5d17-4b94-b0e8-ba583ec15af5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83037cf6-4a7d-4ba8-8ecb-469feb7598b8", "name": "network-vif-deleted", "tag": "a3f2e153-1c65-4344-a6ba-682a68953e59"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:40:53.533119 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-3067edfa-867c-46dc-aab5-b4b8cf137064 req-ea90c863-5d17-4b94-b0e8-ba583ec15af5 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:53.533468 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-3067edfa-867c-46dc-aab5-b4b8cf137064 req-ea90c863-5d17-4b94-b0e8-ba583ec15af5 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:53.533989 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-3067edfa-867c-46dc-aab5-b4b8cf137064 req-ea90c863-5d17-4b94-b0e8-ba583ec15af5 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:53.581966 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-3067edfa-867c-46dc-aab5-b4b8cf137064 req-ea90c863-5d17-4b94-b0e8-ba583ec15af5 service nova] Creating event network-vif-deleted:a3f2e153-1c65-4344-a6ba-682a68953e59 for instance 83037cf6-4a7d-4ba8-8ecb-469feb7598b8 on n-h1-850501-12 Sep 08 10:40:53.595798 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-3067edfa-867c-46dc-aab5-b4b8cf137064 req-ea90c863-5d17-4b94-b0e8-ba583ec15af5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140776 Sep 08 10:40:53.598924 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 574/1063] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:40:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:40:53.972698 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dbb34960-416b-4441-8f7a-e6db570f1e95 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Releasing lock "refresh_cache-60ad91da-8810-4117-8b13-ffe0c0e3714f" {{(pid=128861) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 08 10:40:53.975032 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-dbb34960-416b-4441-8f7a-e6db570f1e95 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] HTTP exception thrown: floating IP not found Sep 08 10:40:53.981354 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-dbb34960-416b-4441-8f7a-e6db570f1e95 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Request method failure captured: Sep 08 10:40:53.981354 n-d-850501-12 devstack@n-api.service[128861]: request: POST /compute/v2.1/servers/60ad91da-8810-4117-8b13-ffe0c0e3714f/action HTTP/1.1 Sep 08 10:40:53.981354 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:40:53.981354 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:40:53.981354 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:40:53.981354 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 41 Sep 08 10:40:53.981354 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:40:53.981354 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:40:53.981354 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:40:53.981354 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:40:53.981354 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcaDH0qBBGNIs2z6CL8YMxdZCeOhnYFK6VIFv3PopAGGEIh6bl2Lj_U5tbU_AfW8V9WbCTXO2mXvB8JS0_KgTquQqCPhlYmGDhVIuYNx-eN6Y_cM9KOseed44Fsk8NAZgK4oPmG4z70583YdZDp1x68OuR7RnaeVInIExqo20-gfl90 Sep 08 10:40:53.981354 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:40:53.981354 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:40:53.981354 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:40:53.981354 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:40:53.981354 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:40:53.981354 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:40:53.981354 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 3674a3f87ee348428b195602234e4dd4 Sep 08 10:40:53.981354 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 Sep 08 10:40:53.981354 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:40:53.981354 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:40:53.981354 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3674a3f87ee348428b195602234e4dd4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3674a3f87ee348428b195602234e4dd4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3674a3f87ee348428b195602234e4dd4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3674a3f87ee348428b195602234e4dd4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:40:53.981354 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 Sep 08 10:40:53.981354 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 3674a3f87ee348428b195602234e4dd4 Sep 08 10:40:53.981354 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 Sep 08 10:40:53.981354 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project Sep 08 10:40:53.981354 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:40:53.981354 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:40:53.981354 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 55e7bb8eedfa46c487513057a67a9537 Sep 08 10:40:53.981354 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project Sep 08 10:40:53.981354 n-d-850501-12 devstack@n-api.service[128861]: Sep 08 10:40:53.981354 n-d-850501-12 devstack@n-api.service[128861]: {"addFloatingIp": {"address": "0.0.0.0"}} Sep 08 10:40:53.981354 n-d-850501-12 devstack@n-api.service[128861]: method: Sep 08 10:40:53.981354 n-d-850501-12 devstack@n-api.service[128861]: exception: floating IP not found Sep 08 10:40:53.981354 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '60ad91da-8810-4117-8b13-ffe0c0e3714f', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Sep 08 10:40:53.981354 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:40:53.981354 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:53.981354 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Sep 08 10:40:53.981354 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Sep 08 10:40:53.981354 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Sep 08 10:40:53.981354 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Sep 08 10:40:53.981354 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Sep 08 10:40:53.981354 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Sep 08 10:40:53.981354 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Sep 08 10:40:53.981354 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Sep 08 10:40:53.981354 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Sep 08 10:40:53.981354 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:40:53.981354 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:40:53.981354 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:40:53.981354 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:53.981354 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:40:53.981354 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:40:53.981354 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:40:53.981354 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:40:53.981354 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:40:53.981354 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:40:53.981354 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:40:53.981354 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:40:53.981354 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:40:53.981354 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:40:53.981354 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Sep 08 10:40:53.981354 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 08 10:40:53.981354 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Sep 08 10:40:53.981354 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:40:53.988936 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:40:53.988936 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:40:53.988936 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:53.988936 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:40:53.988936 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:40:53.988936 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:40:53.988936 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:40:53.988936 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Sep 08 10:40:53.988936 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:40:53.991836 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-dbb34960-416b-4441-8f7a-e6db570f1e95 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Returning 404 to user: floating IP not found {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:40:54.002661 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-dbb34960-416b-4441-8f7a-e6db570f1e95 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] 10.222.0.27 "POST /compute/v2.1/servers/60ad91da-8810-4117-8b13-ffe0c0e3714f/action" status: 404 len: 67 microversion: 2.1 time: 0.894489 Sep 08 10:40:54.005533 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 490/1064] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:40:53 2022] POST /compute/v2.1/servers/60ad91da-8810-4117-8b13-ffe0c0e3714f/action => generated 67 bytes in 903 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:40:54.023912 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-686a9c1d-d59a-43c7-be51-69826f3ccb4e tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Action: 'action', calling method: .version_select at 0x7f68e69d51f0>, body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:40:54.096820 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-686a9c1d-d59a-43c7-be51-69826f3ccb4e tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Sep 08 10:40:54.100261 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-686a9c1d-d59a-43c7-be51-69826f3ccb4e tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Request method failure captured: Sep 08 10:40:54.100261 n-d-850501-12 devstack@n-api.service[128862]: request: POST /compute/v2.1/servers/60ad91da-8810-4117-8b13-ffe0c0e3714f/action HTTP/1.1 Sep 08 10:40:54.100261 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:40:54.100261 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:40:54.100261 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:40:54.100261 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 44 Sep 08 10:40:54.100261 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:40:54.100261 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:40:54.100261 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:40:54.100261 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:40:54.100261 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcaDH0qBBGNIs2z6CL8YMxdZCeOhnYFK6VIFv3PopAGGEIh6bl2Lj_U5tbU_AfW8V9WbCTXO2mXvB8JS0_KgTquQqCPhlYmGDhVIuYNx-eN6Y_cM9KOseed44Fsk8NAZgK4oPmG4z70583YdZDp1x68OuR7RnaeVInIExqo20-gfl90 Sep 08 10:40:54.100261 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:40:54.100261 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:40:54.100261 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:40:54.100261 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:40:54.100261 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:40:54.100261 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:40:54.100261 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 3674a3f87ee348428b195602234e4dd4 Sep 08 10:40:54.100261 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 Sep 08 10:40:54.100261 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:40:54.100261 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:40:54.100261 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3674a3f87ee348428b195602234e4dd4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3674a3f87ee348428b195602234e4dd4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3674a3f87ee348428b195602234e4dd4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3674a3f87ee348428b195602234e4dd4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:40:54.100261 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 Sep 08 10:40:54.100261 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 3674a3f87ee348428b195602234e4dd4 Sep 08 10:40:54.100261 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 Sep 08 10:40:54.100261 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project Sep 08 10:40:54.100261 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:40:54.100261 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:40:54.100261 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 55e7bb8eedfa46c487513057a67a9537 Sep 08 10:40:54.100261 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project Sep 08 10:40:54.100261 n-d-850501-12 devstack@n-api.service[128862]: Sep 08 10:40:54.100261 n-d-850501-12 devstack@n-api.service[128862]: {"removeFloatingIp": {"address": "0.0.0.0"}} Sep 08 10:40:54.100261 n-d-850501-12 devstack@n-api.service[128862]: method: Sep 08 10:40:54.100261 n-d-850501-12 devstack@n-api.service[128862]: exception: Floating IP not found for address 0.0.0.0. Sep 08 10:40:54.100261 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '60ad91da-8810-4117-8b13-ffe0c0e3714f', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Sep 08 10:40:54.100261 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:40:54.100261 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:54.100261 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Sep 08 10:40:54.100261 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Sep 08 10:40:54.100261 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Sep 08 10:40:54.100261 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Sep 08 10:40:54.100261 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Sep 08 10:40:54.100261 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Sep 08 10:40:54.100261 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Sep 08 10:40:54.100261 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:54.100261 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:40:54.100261 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:54.100261 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:54.100261 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:40:54.100261 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:40:54.100261 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:40:54.100261 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:40:54.100261 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:40:54.100261 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:40:54.100261 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:40:54.100261 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:40:54.100261 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:40:54.100261 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:40:54.100261 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Sep 08 10:40:54.100261 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Sep 08 10:40:54.100261 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Sep 08 10:40:54.100261 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Sep 08 10:40:54.106795 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Sep 08 10:40:54.106795 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:54.106795 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:40:54.106795 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:54.106795 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:54.106795 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:40:54.106795 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:40:54.106795 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:40:54.106795 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:40:54.106795 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Sep 08 10:40:54.106795 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:54.110688 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-686a9c1d-d59a-43c7-be51-69826f3ccb4e tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:40:54.112376 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-686a9c1d-d59a-43c7-be51-69826f3ccb4e tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] 10.222.0.27 "POST /compute/v2.1/servers/60ad91da-8810-4117-8b13-ffe0c0e3714f/action" status: 404 len: 88 microversion: 2.1 time: 0.099355 Sep 08 10:40:54.114263 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 575/1065] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:40:54 2022] POST /compute/v2.1/servers/60ad91da-8810-4117-8b13-ffe0c0e3714f/action => generated 88 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:40:54.130342 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cb9b891c-f1b4-4208-ad40-54c62347148f tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:54.133521 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cb9b891c-f1b4-4208-ad40-54c62347148f tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] [instance: 60ad91da-8810-4117-8b13-ffe0c0e3714f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:54.146648 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb9b891c-f1b4-4208-ad40-54c62347148f tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:54.148878 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb9b891c-f1b4-4208-ad40-54c62347148f tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:54.149921 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb9b891c-f1b4-4208-ad40-54c62347148f tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:54.151510 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb9b891c-f1b4-4208-ad40-54c62347148f tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:54.152684 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb9b891c-f1b4-4208-ad40-54c62347148f tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:54.154076 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb9b891c-f1b4-4208-ad40-54c62347148f tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:54.213360 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cb9b891c-f1b4-4208-ad40-54c62347148f tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] [instance: 60ad91da-8810-4117-8b13-ffe0c0e3714f] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:40:54.277161 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fc25e2e8-1e3f-49ac-a9d8-f652ba45bfe3 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:54.279471 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fc25e2e8-1e3f-49ac-a9d8-f652ba45bfe3 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: 493cd490-27c5-4e08-a789-767757111cb2] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:54.296342 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fc25e2e8-1e3f-49ac-a9d8-f652ba45bfe3 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:54.299142 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fc25e2e8-1e3f-49ac-a9d8-f652ba45bfe3 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:54.301653 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fc25e2e8-1e3f-49ac-a9d8-f652ba45bfe3 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:54.305577 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fc25e2e8-1e3f-49ac-a9d8-f652ba45bfe3 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:54.307430 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fc25e2e8-1e3f-49ac-a9d8-f652ba45bfe3 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:54.309408 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fc25e2e8-1e3f-49ac-a9d8-f652ba45bfe3 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:54.389015 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-fc25e2e8-1e3f-49ac-a9d8-f652ba45bfe3 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] HTTP exception thrown: Instance 493cd490-27c5-4e08-a789-767757111cb2 could not be found. Sep 08 10:40:54.390588 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fc25e2e8-1e3f-49ac-a9d8-f652ba45bfe3 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Request method failure captured: Sep 08 10:40:54.390588 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/493cd490-27c5-4e08-a789-767757111cb2 HTTP/1.1 Sep 08 10:40:54.390588 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:40:54.390588 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:40:54.390588 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:40:54.390588 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:40:54.390588 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:40:54.390588 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:40:54.390588 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:40:54.390588 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:40:54.390588 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcXsmHH1yoQtgpWVsTlKGRZ1RD9sGjJDO3R5IIX2mO0TzFlOkGo4Nrt9P8ms3HuxErnST87nkHuEi-VzkaDAC8r3keukBBYL9HR0teGPa-du_tj-nOftdvIVdc8Rf3uKj_SiRNumvszg8v8N8iSarJ11mQfNqN8vl0lBx8hzlRuGs8w Sep 08 10:40:54.390588 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:40:54.390588 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:40:54.390588 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:40:54.390588 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:40:54.390588 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:40:54.390588 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:40:54.390588 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 2a3d4a2ec8674e418602b6dc0cec6ab9 Sep 08 10:40:54.390588 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersOnMultiNodesTest-1266277988 Sep 08 10:40:54.390588 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:40:54.390588 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:40:54.390588 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2a3d4a2ec8674e418602b6dc0cec6ab9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2a3d4a2ec8674e418602b6dc0cec6ab9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2a3d4a2ec8674e418602b6dc0cec6ab9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2a3d4a2ec8674e418602b6dc0cec6ab9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:40:54.390588 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServersOnMultiNodesTest-1266277988 Sep 08 10:40:54.390588 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 2a3d4a2ec8674e418602b6dc0cec6ab9 Sep 08 10:40:54.390588 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1266277988 Sep 08 10:40:54.390588 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServersOnMultiNodesTest-1266277988-project Sep 08 10:40:54.390588 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:40:54.390588 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:40:54.390588 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 771c067cf6814084a5520128a970dc82 Sep 08 10:40:54.390588 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServersOnMultiNodesTest-1266277988-project Sep 08 10:40:54.390588 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:40:54.390588 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 493cd490-27c5-4e08-a789-767757111cb2 could not be found. Sep 08 10:40:54.390588 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '493cd490-27c5-4e08-a789-767757111cb2'} Sep 08 10:40:54.390588 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:40:54.390588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:54.390588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:40:54.390588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:40:54.390588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:40:54.390588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:40:54.390588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:40:54.390588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:40:54.390588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:40:54.390588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:40:54.390588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 493cd490-27c5-4e08-a789-767757111cb2 could not be found. Sep 08 10:40:54.390588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:54.390588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:40:54.390588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:54.390588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:54.390588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:40:54.390588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:40:54.390588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:40:54.390588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:40:54.390588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:40:54.390588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:40:54.390588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:40:54.390588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:40:54.390588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:40:54.390588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:40:54.390588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:40:54.390588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:40:54.390588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 493cd490-27c5-4e08-a789-767757111cb2 could not be found. Sep 08 10:40:54.390588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:54.390588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:40:54.390588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:54.395342 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:54.395342 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:40:54.395342 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:40:54.395342 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:40:54.395342 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:40:54.395342 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 493cd490-27c5-4e08-a789-767757111cb2 could not be found. Sep 08 10:40:54.395342 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:54.405980 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fc25e2e8-1e3f-49ac-a9d8-f652ba45bfe3 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Returning 404 to user: Instance 493cd490-27c5-4e08-a789-767757111cb2 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:40:54.409739 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fc25e2e8-1e3f-49ac-a9d8-f652ba45bfe3 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/493cd490-27c5-4e08-a789-767757111cb2" status: 404 len: 111 microversion: 2.1 time: 0.143351 Sep 08 10:40:54.410597 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 576/1066] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:54 2022] GET /compute/v2.1/servers/493cd490-27c5-4e08-a789-767757111cb2 => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:40:54.415942 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cb9b891c-f1b4-4208-ad40-54c62347148f tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] 10.222.0.27 "DELETE /compute/v2.1/servers/60ad91da-8810-4117-8b13-ffe0c0e3714f" status: 204 len: 0 microversion: 2.1 time: 0.293019 Sep 08 10:40:54.417279 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 491/1067] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:40:54 2022] DELETE /compute/v2.1/servers/60ad91da-8810-4117-8b13-ffe0c0e3714f => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:40:54.422471 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-70afff29-0a54-4d34-bea2-76c69878d308 tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] Calling method '.version_select at 0x7f68e464b4c0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:54.430272 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7a05e390-ce68-4990-9d55-236fcceea5ff tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:54.431990 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7a05e390-ce68-4990-9d55-236fcceea5ff tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: 83037cf6-4a7d-4ba8-8ecb-469feb7598b8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:54.443719 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a05e390-ce68-4990-9d55-236fcceea5ff tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:54.443986 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70afff29-0a54-4d34-bea2-76c69878d308 tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:54.444944 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a05e390-ce68-4990-9d55-236fcceea5ff tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:54.446001 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a05e390-ce68-4990-9d55-236fcceea5ff tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:54.447219 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a05e390-ce68-4990-9d55-236fcceea5ff tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:54.447377 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70afff29-0a54-4d34-bea2-76c69878d308 tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:54.448219 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a05e390-ce68-4990-9d55-236fcceea5ff tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:54.448539 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70afff29-0a54-4d34-bea2-76c69878d308 tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:54.449768 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a05e390-ce68-4990-9d55-236fcceea5ff tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:54.492629 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-70afff29-0a54-4d34-bea2-76c69878d308 tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 2362 microversion: 2.1 time: 0.080276 Sep 08 10:40:54.496132 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 577/1068] 10.222.0.27 () {58 vars in 1143 bytes} [Thu Sep 8 10:40:54 2022] GET /compute/v2.1/os-migrations => generated 2362 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:54.506713 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b24bbb4d-56e4-43b4-b89c-600fc436bb6b tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:54.508698 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b24bbb4d-56e4-43b4-b89c-600fc436bb6b tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] [instance: 60ad91da-8810-4117-8b13-ffe0c0e3714f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:54.514195 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a05e390-ce68-4990-9d55-236fcceea5ff tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:54.515533 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a05e390-ce68-4990-9d55-236fcceea5ff tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:54.517172 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a05e390-ce68-4990-9d55-236fcceea5ff tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:54.520516 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-7a05e390-ce68-4990-9d55-236fcceea5ff tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lazy-loading 'fault' on Instance uuid 83037cf6-4a7d-4ba8-8ecb-469feb7598b8 {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:40:54.539320 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b24bbb4d-56e4-43b4-b89c-600fc436bb6b tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:54.540287 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b24bbb4d-56e4-43b4-b89c-600fc436bb6b tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:54.541093 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b24bbb4d-56e4-43b4-b89c-600fc436bb6b tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:54.543018 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b24bbb4d-56e4-43b4-b89c-600fc436bb6b tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:54.544476 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b24bbb4d-56e4-43b4-b89c-600fc436bb6b tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:54.545704 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b24bbb4d-56e4-43b4-b89c-600fc436bb6b tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:54.631858 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7a05e390-ce68-4990-9d55-236fcceea5ff tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:54.665013 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7a05e390-ce68-4990-9d55-236fcceea5ff tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/83037cf6-4a7d-4ba8-8ecb-469feb7598b8" status: 200 len: 1308 microversion: 2.1 time: 0.245894 Sep 08 10:40:54.669333 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 492/1069] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:54 2022] GET /compute/v2.1/servers/83037cf6-4a7d-4ba8-8ecb-469feb7598b8 => generated 1308 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:54.697556 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-907f6d59-3023-43e5-9a6e-1d3c3715fa66 tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:54.727828 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-907f6d59-3023-43e5-9a6e-1d3c3715fa66 tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.053187 Sep 08 10:40:54.729856 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 493/1070] 10.222.0.27 () {58 vars in 1137 bytes} [Thu Sep 8 10:40:54 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:40:54.771442 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-41221bb9-de55-4d26-9430-28084a77a867 tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1114086924", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:40:54.821050 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-41221bb9-de55-4d26-9430-28084a77a867 tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.071336 Sep 08 10:40:54.826495 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 494/1071] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Sep 8 10:40:54 2022] POST /compute/v2.1/flavors => generated 499 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:40:54.854616 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-882d2666-055f-43c5-9141-fcf1624aa916 tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:54.872005 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-882d2666-055f-43c5-9141-fcf1624aa916 tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.031183 Sep 08 10:40:54.874316 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 495/1072] 10.222.0.27 () {58 vars in 1182 bytes} [Thu Sep 8 10:40:54 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:40:54.944595 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b24bbb4d-56e4-43b4-b89c-600fc436bb6b tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e7bb8eedfa46c487513057a67a9537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3674a3f87ee348428b195602234e4dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:54.956894 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b24bbb4d-56e4-43b4-b89c-600fc436bb6b tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] 10.222.0.27 "GET /compute/v2.1/servers/60ad91da-8810-4117-8b13-ffe0c0e3714f" status: 200 len: 1540 microversion: 2.1 time: 0.458799 Sep 08 10:40:54.970271 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 578/1073] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:54 2022] GET /compute/v2.1/servers/60ad91da-8810-4117-8b13-ffe0c0e3714f => generated 1540 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:55.107262 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-437ae4f7-0278-44c3-816f-9458c78432de tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-687330671", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "73d2dc41-0ed5-4d71-96c5-c690131aa7dc"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:40:55.225002 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-437ae4f7-0278-44c3-816f-9458c78432de tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] validate_networks() for None {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:40:55.714877 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-03999ff3-6483-4aff-9282-cc73109324b1 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:55.716776 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-03999ff3-6483-4aff-9282-cc73109324b1 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: 83037cf6-4a7d-4ba8-8ecb-469feb7598b8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:55.738775 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03999ff3-6483-4aff-9282-cc73109324b1 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:55.739342 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03999ff3-6483-4aff-9282-cc73109324b1 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:55.741301 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03999ff3-6483-4aff-9282-cc73109324b1 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:55.741912 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03999ff3-6483-4aff-9282-cc73109324b1 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:55.742742 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03999ff3-6483-4aff-9282-cc73109324b1 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:55.744374 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03999ff3-6483-4aff-9282-cc73109324b1 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:55.779142 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-03999ff3-6483-4aff-9282-cc73109324b1 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] HTTP exception thrown: Instance 83037cf6-4a7d-4ba8-8ecb-469feb7598b8 could not be found. Sep 08 10:40:55.781107 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-03999ff3-6483-4aff-9282-cc73109324b1 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Request method failure captured: Sep 08 10:40:55.781107 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/83037cf6-4a7d-4ba8-8ecb-469feb7598b8 HTTP/1.1 Sep 08 10:40:55.781107 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:40:55.781107 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:40:55.781107 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:40:55.781107 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:40:55.781107 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:40:55.781107 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:40:55.781107 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:40:55.781107 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:40:55.781107 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcXsmHH1yoQtgpWVsTlKGRZ1RD9sGjJDO3R5IIX2mO0TzFlOkGo4Nrt9P8ms3HuxErnST87nkHuEi-VzkaDAC8r3keukBBYL9HR0teGPa-du_tj-nOftdvIVdc8Rf3uKj_SiRNumvszg8v8N8iSarJ11mQfNqN8vl0lBx8hzlRuGs8w Sep 08 10:40:55.781107 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:40:55.781107 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:40:55.781107 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:40:55.781107 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:40:55.781107 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:40:55.781107 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:40:55.781107 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 2a3d4a2ec8674e418602b6dc0cec6ab9 Sep 08 10:40:55.781107 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersOnMultiNodesTest-1266277988 Sep 08 10:40:55.781107 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:40:55.781107 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:40:55.781107 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2a3d4a2ec8674e418602b6dc0cec6ab9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2a3d4a2ec8674e418602b6dc0cec6ab9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2a3d4a2ec8674e418602b6dc0cec6ab9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2a3d4a2ec8674e418602b6dc0cec6ab9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:40:55.781107 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServersOnMultiNodesTest-1266277988 Sep 08 10:40:55.781107 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 2a3d4a2ec8674e418602b6dc0cec6ab9 Sep 08 10:40:55.781107 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1266277988 Sep 08 10:40:55.781107 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServersOnMultiNodesTest-1266277988-project Sep 08 10:40:55.781107 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:40:55.781107 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:40:55.781107 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 771c067cf6814084a5520128a970dc82 Sep 08 10:40:55.781107 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServersOnMultiNodesTest-1266277988-project Sep 08 10:40:55.781107 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:40:55.781107 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 83037cf6-4a7d-4ba8-8ecb-469feb7598b8 could not be found. Sep 08 10:40:55.781107 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '83037cf6-4a7d-4ba8-8ecb-469feb7598b8'} Sep 08 10:40:55.781107 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:40:55.781107 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:55.781107 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:40:55.781107 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:40:55.781107 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:40:55.781107 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:40:55.781107 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:40:55.781107 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:40:55.781107 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:40:55.781107 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:40:55.781107 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83037cf6-4a7d-4ba8-8ecb-469feb7598b8 could not be found. Sep 08 10:40:55.781107 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:55.781107 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:40:55.781107 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:55.781107 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:55.781107 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:40:55.781107 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:40:55.781107 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:40:55.781107 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:40:55.781107 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:40:55.781107 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:40:55.781107 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:40:55.781107 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:40:55.781107 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:40:55.781107 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:40:55.781107 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:40:55.781107 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:40:55.781107 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83037cf6-4a7d-4ba8-8ecb-469feb7598b8 could not be found. Sep 08 10:40:55.781107 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:55.781107 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:40:55.781107 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:55.785806 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:55.785806 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:40:55.785806 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:40:55.785806 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:40:55.785806 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:40:55.785806 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83037cf6-4a7d-4ba8-8ecb-469feb7598b8 could not be found. Sep 08 10:40:55.785806 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:40:55.787934 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-03999ff3-6483-4aff-9282-cc73109324b1 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Returning 404 to user: Instance 83037cf6-4a7d-4ba8-8ecb-469feb7598b8 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:40:55.788995 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-03999ff3-6483-4aff-9282-cc73109324b1 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/83037cf6-4a7d-4ba8-8ecb-469feb7598b8" status: 404 len: 111 microversion: 2.1 time: 0.080985 Sep 08 10:40:55.790068 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 579/1074] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:55 2022] GET /compute/v2.1/servers/83037cf6-4a7d-4ba8-8ecb-469feb7598b8 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 10:40:55.800202 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-62c5ef27-b9c8-4b9d-8946-9fb1a5dafc4e tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:55.852387 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-62c5ef27-b9c8-4b9d-8946-9fb1a5dafc4e tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/bf93089d-19b3-4149-bb6d-266993d8a421" status: 204 len: 0 microversion: 2.1 time: 0.055979 Sep 08 10:40:55.857016 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 580/1075] 10.222.0.27 () {58 vars in 1266 bytes} [Thu Sep 8 10:40:55 2022] DELETE /compute/v2.1/os-server-groups/bf93089d-19b3-4149-bb6d-266993d8a421 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 10:40:55.864780 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-88a9747a-4616-4b41-911b-88c2b806c8f9 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:55.866327 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-88a9747a-4616-4b41-911b-88c2b806c8f9 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: b135e70e-1c5a-4432-9b50-237c118a5296] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:55.876129 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-88a9747a-4616-4b41-911b-88c2b806c8f9 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:55.876984 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-88a9747a-4616-4b41-911b-88c2b806c8f9 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:55.877672 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-88a9747a-4616-4b41-911b-88c2b806c8f9 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:55.878607 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-88a9747a-4616-4b41-911b-88c2b806c8f9 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:55.879273 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-88a9747a-4616-4b41-911b-88c2b806c8f9 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:55.879893 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-88a9747a-4616-4b41-911b-88c2b806c8f9 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:55.926624 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-88a9747a-4616-4b41-911b-88c2b806c8f9 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: b135e70e-1c5a-4432-9b50-237c118a5296] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:40:56.026819 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-437ae4f7-0278-44c3-816f-9458c78432de tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:40:56.029568 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-437ae4f7-0278-44c3-816f-9458c78432de tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:40:56.030987 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-437ae4f7-0278-44c3-816f-9458c78432de tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:40:56.032850 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-437ae4f7-0278-44c3-816f-9458c78432de tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:40:56.034947 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-437ae4f7-0278-44c3-816f-9458c78432de tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:40:56.060002 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-437ae4f7-0278-44c3-816f-9458c78432de tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:56.063541 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-437ae4f7-0278-44c3-816f-9458c78432de tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:56.065563 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-437ae4f7-0278-44c3-816f-9458c78432de tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:56.071369 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-437ae4f7-0278-44c3-816f-9458c78432de tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:56.072691 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-437ae4f7-0278-44c3-816f-9458c78432de tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:56.073500 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-437ae4f7-0278-44c3-816f-9458c78432de tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:56.111296 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-437ae4f7-0278-44c3-816f-9458c78432de tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Getting quotas for project a52c0b4a043445df94dab4dd4292607a. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:40:56.120799 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-437ae4f7-0278-44c3-816f-9458c78432de tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Getting quotas for user 5450284cb50b4f75be0915074bf8fe78 and project a52c0b4a043445df94dab4dd4292607a. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:40:56.168328 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-88a9747a-4616-4b41-911b-88c2b806c8f9 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b135e70e-1c5a-4432-9b50-237c118a5296" status: 204 len: 0 microversion: 2.1 time: 0.308871 Sep 08 10:40:56.170218 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 581/1076] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:40:55 2022] DELETE /compute/v2.1/servers/b135e70e-1c5a-4432-9b50-237c118a5296 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:40:56.171854 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-437ae4f7-0278-44c3-816f-9458c78432de tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:40:56.175087 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-437ae4f7-0278-44c3-816f-9458c78432de tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: a3a6ce0f-e362-4cbc-afc2-3cfd349a4812] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:40:56.180561 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6ab1b7ad-bb64-42df-bc31-cc2982ce9b2d tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:56.182373 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6ab1b7ad-bb64-42df-bc31-cc2982ce9b2d tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] [instance: 60ad91da-8810-4117-8b13-ffe0c0e3714f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:56.195397 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ab1b7ad-bb64-42df-bc31-cc2982ce9b2d tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:56.197668 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ab1b7ad-bb64-42df-bc31-cc2982ce9b2d tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:56.198840 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ab1b7ad-bb64-42df-bc31-cc2982ce9b2d tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:56.200554 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ab1b7ad-bb64-42df-bc31-cc2982ce9b2d tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:56.201457 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ab1b7ad-bb64-42df-bc31-cc2982ce9b2d tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:56.202690 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ab1b7ad-bb64-42df-bc31-cc2982ce9b2d tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:56.245767 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-437ae4f7-0278-44c3-816f-9458c78432de tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.147487 Sep 08 10:40:56.246840 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 496/1077] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:40:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1149 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:40:56.252498 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a2e39c04-6db1-4b0a-b04d-a378e40c3823 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:56.253011 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a2e39c04-6db1-4b0a-b04d-a378e40c3823 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: d32351b1-7fc7-4ce4-846d-16add998d5ab] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:56.269708 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a2e39c04-6db1-4b0a-b04d-a378e40c3823 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:56.272434 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a2e39c04-6db1-4b0a-b04d-a378e40c3823 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:56.272997 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a2e39c04-6db1-4b0a-b04d-a378e40c3823 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:56.273783 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a2e39c04-6db1-4b0a-b04d-a378e40c3823 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:56.277903 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a2e39c04-6db1-4b0a-b04d-a378e40c3823 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:56.278326 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a2e39c04-6db1-4b0a-b04d-a378e40c3823 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:56.351504 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a2e39c04-6db1-4b0a-b04d-a378e40c3823 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: d32351b1-7fc7-4ce4-846d-16add998d5ab] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:40:56.552890 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a2e39c04-6db1-4b0a-b04d-a378e40c3823 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d32351b1-7fc7-4ce4-846d-16add998d5ab" status: 204 len: 0 microversion: 2.1 time: 0.303894 Sep 08 10:40:56.562143 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 497/1078] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:40:56 2022] DELETE /compute/v2.1/servers/d32351b1-7fc7-4ce4-846d-16add998d5ab => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:40:56.569601 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0739dd64-a387-4adb-a25c-8518b363373a tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:56.579438 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0739dd64-a387-4adb-a25c-8518b363373a tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: a3a6ce0f-e362-4cbc-afc2-3cfd349a4812] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:56.755850 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0739dd64-a387-4adb-a25c-8518b363373a tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:56.780949 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0739dd64-a387-4adb-a25c-8518b363373a tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812" status: 200 len: 1278 microversion: 2.1 time: 0.220152 Sep 08 10:40:56.783330 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 498/1079] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:56 2022] GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812 => generated 1278 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:56.800100 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d6238493-f379-49b1-887a-049503ee5f25 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:56.806169 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d6238493-f379-49b1-887a-049503ee5f25 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: b135e70e-1c5a-4432-9b50-237c118a5296] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:56.838117 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d6238493-f379-49b1-887a-049503ee5f25 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:56.839343 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d6238493-f379-49b1-887a-049503ee5f25 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:56.840336 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d6238493-f379-49b1-887a-049503ee5f25 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:56.841851 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d6238493-f379-49b1-887a-049503ee5f25 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:56.842874 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d6238493-f379-49b1-887a-049503ee5f25 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:56.843613 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d6238493-f379-49b1-887a-049503ee5f25 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:56.911187 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6ab1b7ad-bb64-42df-bc31-cc2982ce9b2d tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e7bb8eedfa46c487513057a67a9537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3674a3f87ee348428b195602234e4dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:56.924920 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6ab1b7ad-bb64-42df-bc31-cc2982ce9b2d tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] 10.222.0.27 "GET /compute/v2.1/servers/60ad91da-8810-4117-8b13-ffe0c0e3714f" status: 200 len: 1540 microversion: 2.1 time: 0.752122 Sep 08 10:40:56.925628 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 582/1080] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:56 2022] GET /compute/v2.1/servers/60ad91da-8810-4117-8b13-ffe0c0e3714f => generated 1540 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:56.944496 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-10400dc5-1003-4634-907c-c1e79b54615b tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:56.944496 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-10400dc5-1003-4634-907c-c1e79b54615b tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] [instance: 4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:56.956366 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10400dc5-1003-4634-907c-c1e79b54615b tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:56.956972 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10400dc5-1003-4634-907c-c1e79b54615b tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:56.957540 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10400dc5-1003-4634-907c-c1e79b54615b tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:56.959008 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10400dc5-1003-4634-907c-c1e79b54615b tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:56.965252 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10400dc5-1003-4634-907c-c1e79b54615b tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:56.966246 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10400dc5-1003-4634-907c-c1e79b54615b tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:57.274810 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d6238493-f379-49b1-887a-049503ee5f25 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:57.308646 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d6238493-f379-49b1-887a-049503ee5f25 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/b135e70e-1c5a-4432-9b50-237c118a5296" status: 200 len: 1475 microversion: 2.1 time: 0.523358 Sep 08 10:40:57.311315 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 499/1081] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:56 2022] GET /compute/v2.1/servers/b135e70e-1c5a-4432-9b50-237c118a5296 => generated 1475 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:57.358418 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-10400dc5-1003-4634-907c-c1e79b54615b tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lazy-loading 'services' on Instance uuid 4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:40:57.415028 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-10400dc5-1003-4634-907c-c1e79b54615b tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e" status: 200 len: 2341 microversion: 2.25 time: 0.483532 Sep 08 10:40:57.422274 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 583/1082] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:40:56 2022] GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e => generated 2341 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:40:57.456692 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0a4e8afb-fabd-4f1f-9fb1-c4a003b36e20 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:57.471088 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0a4e8afb-fabd-4f1f-9fb1-c4a003b36e20 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:57.473707 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0a4e8afb-fabd-4f1f-9fb1-c4a003b36e20 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:57.474912 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0a4e8afb-fabd-4f1f-9fb1-c4a003b36e20 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:57.476545 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0a4e8afb-fabd-4f1f-9fb1-c4a003b36e20 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:57.478681 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0a4e8afb-fabd-4f1f-9fb1-c4a003b36e20 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:57.479792 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0a4e8afb-fabd-4f1f-9fb1-c4a003b36e20 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:57.612369 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0a4e8afb-fabd-4f1f-9fb1-c4a003b36e20 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.167782 Sep 08 10:40:57.614371 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 500/1083] 10.222.0.27 () {60 vars in 1217 bytes} [Thu Sep 8 10:40:57 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:40:57.809679 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-26bf349e-261e-4b0c-b75a-1738fc2b3edf tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:57.821432 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-26bf349e-261e-4b0c-b75a-1738fc2b3edf tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: a3a6ce0f-e362-4cbc-afc2-3cfd349a4812] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:57.842285 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-26bf349e-261e-4b0c-b75a-1738fc2b3edf tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:57.842805 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-26bf349e-261e-4b0c-b75a-1738fc2b3edf tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:57.843407 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-26bf349e-261e-4b0c-b75a-1738fc2b3edf tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:57.844354 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-26bf349e-261e-4b0c-b75a-1738fc2b3edf tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:57.844824 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-26bf349e-261e-4b0c-b75a-1738fc2b3edf tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:57.855152 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-26bf349e-261e-4b0c-b75a-1738fc2b3edf tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:57.953812 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3377f193-920c-4ef1-b6c7-504957e9b1ad tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:57.954720 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3377f193-920c-4ef1-b6c7-504957e9b1ad tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] [instance: 60ad91da-8810-4117-8b13-ffe0c0e3714f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:58.013361 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3377f193-920c-4ef1-b6c7-504957e9b1ad tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:58.014114 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3377f193-920c-4ef1-b6c7-504957e9b1ad tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:58.020017 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3377f193-920c-4ef1-b6c7-504957e9b1ad tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:58.022619 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3377f193-920c-4ef1-b6c7-504957e9b1ad tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:58.024867 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3377f193-920c-4ef1-b6c7-504957e9b1ad tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:58.028174 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3377f193-920c-4ef1-b6c7-504957e9b1ad tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:58.172343 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-3377f193-920c-4ef1-b6c7-504957e9b1ad tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e7bb8eedfa46c487513057a67a9537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3674a3f87ee348428b195602234e4dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:58.176492 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=90,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=4,nova_cell1:RELEASE=2,nova_cell1:INSERT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:40:58.191409 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3377f193-920c-4ef1-b6c7-504957e9b1ad tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] 10.222.0.27 "GET /compute/v2.1/servers/60ad91da-8810-4117-8b13-ffe0c0e3714f" status: 200 len: 1498 microversion: 2.1 time: 0.241550 Sep 08 10:40:58.198377 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 501/1084] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:57 2022] GET /compute/v2.1/servers/60ad91da-8810-4117-8b13-ffe0c0e3714f => generated 1498 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:58.215330 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-26bf349e-261e-4b0c-b75a-1738fc2b3edf tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:58.234208 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-26bf349e-261e-4b0c-b75a-1738fc2b3edf tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812" status: 200 len: 1330 microversion: 2.1 time: 0.430780 Sep 08 10:40:58.239108 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 584/1085] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:57 2022] GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812 => generated 1330 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:58.349258 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9e2bc258-6b64-4626-87ab-6f7cbbfb2417 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:58.350175 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9e2bc258-6b64-4626-87ab-6f7cbbfb2417 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: b135e70e-1c5a-4432-9b50-237c118a5296] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:58.357191 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e2bc258-6b64-4626-87ab-6f7cbbfb2417 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:58.358035 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e2bc258-6b64-4626-87ab-6f7cbbfb2417 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:58.358695 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e2bc258-6b64-4626-87ab-6f7cbbfb2417 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:58.359875 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e2bc258-6b64-4626-87ab-6f7cbbfb2417 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:58.360689 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e2bc258-6b64-4626-87ab-6f7cbbfb2417 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:58.361384 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e2bc258-6b64-4626-87ab-6f7cbbfb2417 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:58.665075 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-60e8d866-3811-46f9-b819-891a130eab0d req-d03d34d6-a6bb-4bd4-ba45-080c2c0d1bf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60ad91da-8810-4117-8b13-ffe0c0e3714f", "name": "network-vif-deleted", "tag": "f3291f9f-85d0-4bcc-8f0e-f2e1e4d5e84c"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:40:58.700496 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-60e8d866-3811-46f9-b819-891a130eab0d req-d03d34d6-a6bb-4bd4-ba45-080c2c0d1bf6 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:58.705219 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-60e8d866-3811-46f9-b819-891a130eab0d req-d03d34d6-a6bb-4bd4-ba45-080c2c0d1bf6 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:58.708106 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-60e8d866-3811-46f9-b819-891a130eab0d req-d03d34d6-a6bb-4bd4-ba45-080c2c0d1bf6 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:58.757415 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-60e8d866-3811-46f9-b819-891a130eab0d req-d03d34d6-a6bb-4bd4-ba45-080c2c0d1bf6 service nova] Creating event network-vif-deleted:f3291f9f-85d0-4bcc-8f0e-f2e1e4d5e84c for instance 60ad91da-8810-4117-8b13-ffe0c0e3714f on n-h1-850501-12 Sep 08 10:40:58.780896 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-60e8d866-3811-46f9-b819-891a130eab0d req-d03d34d6-a6bb-4bd4-ba45-080c2c0d1bf6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128065 Sep 08 10:40:58.785113 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 585/1086] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:40:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:40:58.874981 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9e2bc258-6b64-4626-87ab-6f7cbbfb2417 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:58.906156 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9e2bc258-6b64-4626-87ab-6f7cbbfb2417 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/b135e70e-1c5a-4432-9b50-237c118a5296" status: 200 len: 1475 microversion: 2.1 time: 0.558869 Sep 08 10:40:58.929460 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 502/1087] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:58 2022] GET /compute/v2.1/servers/b135e70e-1c5a-4432-9b50-237c118a5296 => generated 1475 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:59.258874 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-267e213c-e2bd-4e0e-8a20-0f9bcbeb19dc tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:59.275937 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a404d53a-b04c-4d01-9213-01cc236e521f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:59.279530 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-267e213c-e2bd-4e0e-8a20-0f9bcbeb19dc tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] [instance: 60ad91da-8810-4117-8b13-ffe0c0e3714f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:59.282993 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a404d53a-b04c-4d01-9213-01cc236e521f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: a3a6ce0f-e362-4cbc-afc2-3cfd349a4812] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:59.323540 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-267e213c-e2bd-4e0e-8a20-0f9bcbeb19dc tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:59.324795 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-267e213c-e2bd-4e0e-8a20-0f9bcbeb19dc tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:59.329328 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-267e213c-e2bd-4e0e-8a20-0f9bcbeb19dc tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:59.333146 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-267e213c-e2bd-4e0e-8a20-0f9bcbeb19dc tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:59.338387 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-267e213c-e2bd-4e0e-8a20-0f9bcbeb19dc tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:59.338906 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a404d53a-b04c-4d01-9213-01cc236e521f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:59.340667 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-267e213c-e2bd-4e0e-8a20-0f9bcbeb19dc tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:59.345302 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a404d53a-b04c-4d01-9213-01cc236e521f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:59.345992 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a404d53a-b04c-4d01-9213-01cc236e521f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:59.347090 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a404d53a-b04c-4d01-9213-01cc236e521f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:59.347811 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a404d53a-b04c-4d01-9213-01cc236e521f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:59.360551 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a404d53a-b04c-4d01-9213-01cc236e521f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:59.468549 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:40:59.504390 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-267e213c-e2bd-4e0e-8a20-0f9bcbeb19dc tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:59.504755 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-267e213c-e2bd-4e0e-8a20-0f9bcbeb19dc tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:59.517299 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-267e213c-e2bd-4e0e-8a20-0f9bcbeb19dc tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:59.517984 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-267e213c-e2bd-4e0e-8a20-0f9bcbeb19dc tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lazy-loading 'fault' on Instance uuid 60ad91da-8810-4117-8b13-ffe0c0e3714f {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:40:59.633665 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a404d53a-b04c-4d01-9213-01cc236e521f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:59.634382 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:40:59.653975 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a404d53a-b04c-4d01-9213-01cc236e521f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812" status: 200 len: 1348 microversion: 2.1 time: 0.386006 Sep 08 10:40:59.657660 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 503/1088] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:59 2022] GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812 => generated 1348 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:59.720359 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-267e213c-e2bd-4e0e-8a20-0f9bcbeb19dc tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e7bb8eedfa46c487513057a67a9537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3674a3f87ee348428b195602234e4dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:59.736558 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-267e213c-e2bd-4e0e-8a20-0f9bcbeb19dc tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] 10.222.0.27 "GET /compute/v2.1/servers/60ad91da-8810-4117-8b13-ffe0c0e3714f" status: 200 len: 1321 microversion: 2.1 time: 0.501126 Sep 08 10:40:59.737790 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 586/1089] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:59 2022] GET /compute/v2.1/servers/60ad91da-8810-4117-8b13-ffe0c0e3714f => generated 1321 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:40:59.939079 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-345fb8a1-6991-405c-b928-9788946b7d1c tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:59.939820 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-345fb8a1-6991-405c-b928-9788946b7d1c tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: b135e70e-1c5a-4432-9b50-237c118a5296] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:59.954789 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-345fb8a1-6991-405c-b928-9788946b7d1c tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:59.958257 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-345fb8a1-6991-405c-b928-9788946b7d1c tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:59.959955 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-345fb8a1-6991-405c-b928-9788946b7d1c tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:59.961182 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-345fb8a1-6991-405c-b928-9788946b7d1c tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:59.964853 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-345fb8a1-6991-405c-b928-9788946b7d1c tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:59.965414 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-345fb8a1-6991-405c-b928-9788946b7d1c tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:00.517544 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-ec762399-2bbf-4d2b-bac8-565a93909daf req-a992b107-7b9e-44fc-adae-7d1e5513eb25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d32351b1-7fc7-4ce4-846d-16add998d5ab", "name": "network-vif-deleted", "tag": "a60232cc-0216-484c-93ae-ebe3068438d7"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:41:00.570969 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-345fb8a1-6991-405c-b928-9788946b7d1c tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:00.586383 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-345fb8a1-6991-405c-b928-9788946b7d1c tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/b135e70e-1c5a-4432-9b50-237c118a5296" status: 200 len: 1475 microversion: 2.1 time: 0.652252 Sep 08 10:41:00.587536 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 504/1090] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:59 2022] GET /compute/v2.1/servers/b135e70e-1c5a-4432-9b50-237c118a5296 => generated 1475 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:41:00.632570 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ec762399-2bbf-4d2b-bac8-565a93909daf req-a992b107-7b9e-44fc-adae-7d1e5513eb25 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:00.633578 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ec762399-2bbf-4d2b-bac8-565a93909daf req-a992b107-7b9e-44fc-adae-7d1e5513eb25 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:00.634062 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ec762399-2bbf-4d2b-bac8-565a93909daf req-a992b107-7b9e-44fc-adae-7d1e5513eb25 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:00.666801 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=50 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:41:00.698687 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a41fd994-113a-4a26-8bb3-60d99d631c42 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:00.707807 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a41fd994-113a-4a26-8bb3-60d99d631c42 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: a3a6ce0f-e362-4cbc-afc2-3cfd349a4812] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:00.732854 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-ec762399-2bbf-4d2b-bac8-565a93909daf req-a992b107-7b9e-44fc-adae-7d1e5513eb25 service nova] Creating event network-vif-deleted:a60232cc-0216-484c-93ae-ebe3068438d7 for instance d32351b1-7fc7-4ce4-846d-16add998d5ab on n-h2-850501-12 Sep 08 10:41:00.758393 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-ec762399-2bbf-4d2b-bac8-565a93909daf req-a992b107-7b9e-44fc-adae-7d1e5513eb25 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.246631 Sep 08 10:41:00.762447 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 587/1091] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:41:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:41:00.764466 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a41fd994-113a-4a26-8bb3-60d99d631c42 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:00.768523 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a41fd994-113a-4a26-8bb3-60d99d631c42 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:00.770029 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a41fd994-113a-4a26-8bb3-60d99d631c42 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:00.772281 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a41fd994-113a-4a26-8bb3-60d99d631c42 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:00.779221 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a41fd994-113a-4a26-8bb3-60d99d631c42 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:00.786903 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a41fd994-113a-4a26-8bb3-60d99d631c42 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:00.788981 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2f93fc6c-e575-4693-85aa-32746f97f138 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:00.793613 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2f93fc6c-e575-4693-85aa-32746f97f138 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] [instance: 60ad91da-8810-4117-8b13-ffe0c0e3714f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:00.845966 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2f93fc6c-e575-4693-85aa-32746f97f138 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:00.848407 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2f93fc6c-e575-4693-85aa-32746f97f138 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:00.850127 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2f93fc6c-e575-4693-85aa-32746f97f138 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:00.859909 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2f93fc6c-e575-4693-85aa-32746f97f138 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:00.860824 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2f93fc6c-e575-4693-85aa-32746f97f138 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:00.861468 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2f93fc6c-e575-4693-85aa-32746f97f138 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:00.898208 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-2f93fc6c-e575-4693-85aa-32746f97f138 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] HTTP exception thrown: Instance 60ad91da-8810-4117-8b13-ffe0c0e3714f could not be found. Sep 08 10:41:00.907106 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2f93fc6c-e575-4693-85aa-32746f97f138 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Request method failure captured: Sep 08 10:41:00.907106 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/60ad91da-8810-4117-8b13-ffe0c0e3714f HTTP/1.1 Sep 08 10:41:00.907106 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:41:00.907106 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:41:00.907106 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:41:00.907106 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:41:00.907106 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:41:00.907106 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:41:00.907106 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:41:00.907106 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:41:00.907106 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcaDH0qBBGNIs2z6CL8YMxdZCeOhnYFK6VIFv3PopAGGEIh6bl2Lj_U5tbU_AfW8V9WbCTXO2mXvB8JS0_KgTquQqCPhlYmGDhVIuYNx-eN6Y_cM9KOseed44Fsk8NAZgK4oPmG4z70583YdZDp1x68OuR7RnaeVInIExqo20-gfl90 Sep 08 10:41:00.907106 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:41:00.907106 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:41:00.907106 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:41:00.907106 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:41:00.907106 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:41:00.907106 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:41:00.907106 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 3674a3f87ee348428b195602234e4dd4 Sep 08 10:41:00.907106 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 Sep 08 10:41:00.907106 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:41:00.907106 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:41:00.907106 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3674a3f87ee348428b195602234e4dd4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3674a3f87ee348428b195602234e4dd4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3674a3f87ee348428b195602234e4dd4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3674a3f87ee348428b195602234e4dd4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:41:00.907106 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 Sep 08 10:41:00.907106 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 3674a3f87ee348428b195602234e4dd4 Sep 08 10:41:00.907106 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 Sep 08 10:41:00.907106 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project Sep 08 10:41:00.907106 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:41:00.907106 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:41:00.907106 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 55e7bb8eedfa46c487513057a67a9537 Sep 08 10:41:00.907106 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project Sep 08 10:41:00.907106 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:41:00.907106 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 60ad91da-8810-4117-8b13-ffe0c0e3714f could not be found. Sep 08 10:41:00.907106 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '60ad91da-8810-4117-8b13-ffe0c0e3714f'} Sep 08 10:41:00.907106 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:41:00.907106 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:41:00.907106 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:41:00.907106 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:41:00.907106 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:41:00.907106 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:41:00.907106 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:41:00.907106 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:41:00.907106 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:41:00.907106 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:41:00.907106 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60ad91da-8810-4117-8b13-ffe0c0e3714f could not be found. Sep 08 10:41:00.907106 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:41:00.907106 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:41:00.907106 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:41:00.907106 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:41:00.907106 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:41:00.907106 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:41:00.907106 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:41:00.907106 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:41:00.907106 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:41:00.907106 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:41:00.907106 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:41:00.907106 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:41:00.907106 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:41:00.907106 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:41:00.907106 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:41:00.907106 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:41:00.907106 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60ad91da-8810-4117-8b13-ffe0c0e3714f could not be found. Sep 08 10:41:00.907106 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:41:00.916508 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:41:00.916508 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:41:00.916508 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:41:00.916508 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:41:00.916508 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:41:00.916508 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:41:00.916508 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:41:00.916508 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60ad91da-8810-4117-8b13-ffe0c0e3714f could not be found. Sep 08 10:41:00.916508 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:41:00.918934 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2f93fc6c-e575-4693-85aa-32746f97f138 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] Returning 404 to user: Instance 60ad91da-8810-4117-8b13-ffe0c0e3714f could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:41:00.920755 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2f93fc6c-e575-4693-85aa-32746f97f138 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525 tempest-FloatingIPsAssociationNegativeTestJSON-1280250525-project] 10.222.0.27 "GET /compute/v2.1/servers/60ad91da-8810-4117-8b13-ffe0c0e3714f" status: 404 len: 111 microversion: 2.1 time: 0.150143 Sep 08 10:41:00.923122 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 588/1092] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:00 2022] GET /compute/v2.1/servers/60ad91da-8810-4117-8b13-ffe0c0e3714f => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:41:01.107291 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a41fd994-113a-4a26-8bb3-60d99d631c42 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:01.138025 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a41fd994-113a-4a26-8bb3-60d99d631c42 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812" status: 200 len: 1336 microversion: 2.1 time: 0.449538 Sep 08 10:41:01.139785 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 505/1093] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:00 2022] GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812 => generated 1336 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:41:01.302835 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-51e6359a-09c9-4736-9a3c-f48fe9697d87 req-30e3cea3-4227-4235-8a9a-d0e55d5038a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b135e70e-1c5a-4432-9b50-237c118a5296", "name": "network-vif-deleted", "tag": "8adcdce4-ec06-4542-bcf8-1fd85137feef"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:41:01.335800 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-51e6359a-09c9-4736-9a3c-f48fe9697d87 req-30e3cea3-4227-4235-8a9a-d0e55d5038a5 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:01.336695 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-51e6359a-09c9-4736-9a3c-f48fe9697d87 req-30e3cea3-4227-4235-8a9a-d0e55d5038a5 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:01.341589 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-51e6359a-09c9-4736-9a3c-f48fe9697d87 req-30e3cea3-4227-4235-8a9a-d0e55d5038a5 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:01.437938 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-51e6359a-09c9-4736-9a3c-f48fe9697d87 req-30e3cea3-4227-4235-8a9a-d0e55d5038a5 service nova] Creating event network-vif-deleted:8adcdce4-ec06-4542-bcf8-1fd85137feef for instance b135e70e-1c5a-4432-9b50-237c118a5296 on n-h2-850501-12 Sep 08 10:41:01.448246 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-51e6359a-09c9-4736-9a3c-f48fe9697d87 req-30e3cea3-4227-4235-8a9a-d0e55d5038a5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155680 Sep 08 10:41:01.454884 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 589/1094] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:41:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:41:01.639483 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0f683200-5a13-46cf-80b5-9bffe605203f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:01.640901 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0f683200-5a13-46cf-80b5-9bffe605203f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: b135e70e-1c5a-4432-9b50-237c118a5296] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:01.660817 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0f683200-5a13-46cf-80b5-9bffe605203f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:01.661868 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0f683200-5a13-46cf-80b5-9bffe605203f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:01.663304 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0f683200-5a13-46cf-80b5-9bffe605203f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:01.668170 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0f683200-5a13-46cf-80b5-9bffe605203f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:01.669504 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0f683200-5a13-46cf-80b5-9bffe605203f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:01.672052 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0f683200-5a13-46cf-80b5-9bffe605203f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:01.837427 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0f683200-5a13-46cf-80b5-9bffe605203f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:01.838323 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0f683200-5a13-46cf-80b5-9bffe605203f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:01.840492 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0f683200-5a13-46cf-80b5-9bffe605203f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:01.855471 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-0f683200-5a13-46cf-80b5-9bffe605203f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lazy-loading 'fault' on Instance uuid b135e70e-1c5a-4432-9b50-237c118a5296 {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:41:02.175015 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a4515c38-b5fb-4e1a-9d6d-9a99b668f1d6 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:02.176460 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a4515c38-b5fb-4e1a-9d6d-9a99b668f1d6 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: a3a6ce0f-e362-4cbc-afc2-3cfd349a4812] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:02.192034 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0f683200-5a13-46cf-80b5-9bffe605203f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:02.203425 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a4515c38-b5fb-4e1a-9d6d-9a99b668f1d6 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:02.213371 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a4515c38-b5fb-4e1a-9d6d-9a99b668f1d6 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:02.214120 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a4515c38-b5fb-4e1a-9d6d-9a99b668f1d6 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:02.215333 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a4515c38-b5fb-4e1a-9d6d-9a99b668f1d6 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:02.216136 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a4515c38-b5fb-4e1a-9d6d-9a99b668f1d6 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:02.216886 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a4515c38-b5fb-4e1a-9d6d-9a99b668f1d6 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:02.224556 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0f683200-5a13-46cf-80b5-9bffe605203f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/b135e70e-1c5a-4432-9b50-237c118a5296" status: 200 len: 1309 microversion: 2.1 time: 0.594343 Sep 08 10:41:02.228921 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 506/1095] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:01 2022] GET /compute/v2.1/servers/b135e70e-1c5a-4432-9b50-237c118a5296 => generated 1309 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:41:02.567457 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a4515c38-b5fb-4e1a-9d6d-9a99b668f1d6 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:02.584868 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a4515c38-b5fb-4e1a-9d6d-9a99b668f1d6 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812" status: 200 len: 1336 microversion: 2.1 time: 0.420031 Sep 08 10:41:02.586856 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 590/1096] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:02 2022] GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812 => generated 1336 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:41:03.249738 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-81012f81-f0d0-4dda-b3a5-8bd050a6c7af tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2ee93f6f-70ca-470c-9304-ce777d18f138", "device": "/dev/xvdb"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:41:03.266873 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-19ddcfa9-9310-4ded-8144-70c24d2a0557 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:03.270261 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-19ddcfa9-9310-4ded-8144-70c24d2a0557 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: b135e70e-1c5a-4432-9b50-237c118a5296] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:03.280364 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-81012f81-f0d0-4dda-b3a5-8bd050a6c7af tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:03.333816 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-19ddcfa9-9310-4ded-8144-70c24d2a0557 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:03.336362 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-19ddcfa9-9310-4ded-8144-70c24d2a0557 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:03.338309 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-19ddcfa9-9310-4ded-8144-70c24d2a0557 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:03.339827 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-19ddcfa9-9310-4ded-8144-70c24d2a0557 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:03.340554 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-19ddcfa9-9310-4ded-8144-70c24d2a0557 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:03.341237 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-19ddcfa9-9310-4ded-8144-70c24d2a0557 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:03.358750 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-81012f81-f0d0-4dda-b3a5-8bd050a6c7af tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:03.359584 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-81012f81-f0d0-4dda-b3a5-8bd050a6c7af tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:03.360822 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-81012f81-f0d0-4dda-b3a5-8bd050a6c7af tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:03.367596 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-81012f81-f0d0-4dda-b3a5-8bd050a6c7af tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:03.368865 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-81012f81-f0d0-4dda-b3a5-8bd050a6c7af tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:03.370004 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-81012f81-f0d0-4dda-b3a5-8bd050a6c7af tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:03.381816 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-19ddcfa9-9310-4ded-8144-70c24d2a0557 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] HTTP exception thrown: Instance b135e70e-1c5a-4432-9b50-237c118a5296 could not be found. Sep 08 10:41:03.383948 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-19ddcfa9-9310-4ded-8144-70c24d2a0557 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Request method failure captured: Sep 08 10:41:03.383948 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/b135e70e-1c5a-4432-9b50-237c118a5296 HTTP/1.1 Sep 08 10:41:03.383948 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:41:03.383948 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:41:03.383948 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:41:03.383948 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:41:03.383948 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:41:03.383948 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:41:03.383948 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:41:03.383948 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:41:03.383948 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcXsmHH1yoQtgpWVsTlKGRZ1RD9sGjJDO3R5IIX2mO0TzFlOkGo4Nrt9P8ms3HuxErnST87nkHuEi-VzkaDAC8r3keukBBYL9HR0teGPa-du_tj-nOftdvIVdc8Rf3uKj_SiRNumvszg8v8N8iSarJ11mQfNqN8vl0lBx8hzlRuGs8w Sep 08 10:41:03.383948 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:41:03.383948 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:41:03.383948 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:41:03.383948 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:41:03.383948 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:41:03.383948 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:41:03.383948 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 2a3d4a2ec8674e418602b6dc0cec6ab9 Sep 08 10:41:03.383948 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersOnMultiNodesTest-1266277988 Sep 08 10:41:03.383948 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:41:03.383948 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:41:03.383948 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2a3d4a2ec8674e418602b6dc0cec6ab9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2a3d4a2ec8674e418602b6dc0cec6ab9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2a3d4a2ec8674e418602b6dc0cec6ab9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2a3d4a2ec8674e418602b6dc0cec6ab9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:41:03.383948 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServersOnMultiNodesTest-1266277988 Sep 08 10:41:03.383948 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 2a3d4a2ec8674e418602b6dc0cec6ab9 Sep 08 10:41:03.383948 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1266277988 Sep 08 10:41:03.383948 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServersOnMultiNodesTest-1266277988-project Sep 08 10:41:03.383948 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:41:03.383948 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:41:03.383948 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 771c067cf6814084a5520128a970dc82 Sep 08 10:41:03.383948 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServersOnMultiNodesTest-1266277988-project Sep 08 10:41:03.383948 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:41:03.383948 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance b135e70e-1c5a-4432-9b50-237c118a5296 could not be found. Sep 08 10:41:03.383948 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'b135e70e-1c5a-4432-9b50-237c118a5296'} Sep 08 10:41:03.383948 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:41:03.383948 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:41:03.383948 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:41:03.383948 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:41:03.383948 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:41:03.383948 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:41:03.383948 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:41:03.383948 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:41:03.383948 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:41:03.383948 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:41:03.383948 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b135e70e-1c5a-4432-9b50-237c118a5296 could not be found. Sep 08 10:41:03.383948 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:41:03.383948 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:41:03.383948 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:41:03.383948 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:41:03.383948 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:41:03.383948 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:41:03.383948 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:41:03.383948 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:41:03.383948 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:41:03.383948 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:41:03.383948 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:41:03.383948 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:41:03.383948 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:41:03.383948 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:41:03.383948 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:41:03.383948 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:41:03.383948 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b135e70e-1c5a-4432-9b50-237c118a5296 could not be found. Sep 08 10:41:03.383948 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:41:03.383948 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:41:03.383948 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:41:03.394702 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:41:03.394702 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:41:03.394702 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:41:03.394702 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:41:03.394702 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:41:03.394702 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b135e70e-1c5a-4432-9b50-237c118a5296 could not be found. Sep 08 10:41:03.394702 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:41:03.394702 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-19ddcfa9-9310-4ded-8144-70c24d2a0557 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Returning 404 to user: Instance b135e70e-1c5a-4432-9b50-237c118a5296 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:41:03.394702 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-19ddcfa9-9310-4ded-8144-70c24d2a0557 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/b135e70e-1c5a-4432-9b50-237c118a5296" status: 404 len: 111 microversion: 2.1 time: 0.125900 Sep 08 10:41:03.394702 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 591/1097] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:03 2022] GET /compute/v2.1/servers/b135e70e-1c5a-4432-9b50-237c118a5296 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:41:03.400417 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-75a20b73-be40-4a85-9fed-ff9928cc1826 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:03.400774 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-75a20b73-be40-4a85-9fed-ff9928cc1826 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: d32351b1-7fc7-4ce4-846d-16add998d5ab] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:03.418766 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-75a20b73-be40-4a85-9fed-ff9928cc1826 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:03.419147 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-75a20b73-be40-4a85-9fed-ff9928cc1826 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:03.421865 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-75a20b73-be40-4a85-9fed-ff9928cc1826 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:03.422884 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-75a20b73-be40-4a85-9fed-ff9928cc1826 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:03.426923 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-75a20b73-be40-4a85-9fed-ff9928cc1826 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:03.427481 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-75a20b73-be40-4a85-9fed-ff9928cc1826 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:03.457231 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-75a20b73-be40-4a85-9fed-ff9928cc1826 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] HTTP exception thrown: Instance d32351b1-7fc7-4ce4-846d-16add998d5ab could not be found. Sep 08 10:41:03.463716 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-75a20b73-be40-4a85-9fed-ff9928cc1826 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Request method failure captured: Sep 08 10:41:03.463716 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/d32351b1-7fc7-4ce4-846d-16add998d5ab HTTP/1.1 Sep 08 10:41:03.463716 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:41:03.463716 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:41:03.463716 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:41:03.463716 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:41:03.463716 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:41:03.463716 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:41:03.463716 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:41:03.463716 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:41:03.463716 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcXsmHH1yoQtgpWVsTlKGRZ1RD9sGjJDO3R5IIX2mO0TzFlOkGo4Nrt9P8ms3HuxErnST87nkHuEi-VzkaDAC8r3keukBBYL9HR0teGPa-du_tj-nOftdvIVdc8Rf3uKj_SiRNumvszg8v8N8iSarJ11mQfNqN8vl0lBx8hzlRuGs8w Sep 08 10:41:03.463716 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:41:03.463716 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:41:03.463716 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:41:03.463716 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:41:03.463716 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:41:03.463716 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:41:03.463716 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 2a3d4a2ec8674e418602b6dc0cec6ab9 Sep 08 10:41:03.463716 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersOnMultiNodesTest-1266277988 Sep 08 10:41:03.463716 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:41:03.463716 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:41:03.463716 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2a3d4a2ec8674e418602b6dc0cec6ab9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2a3d4a2ec8674e418602b6dc0cec6ab9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2a3d4a2ec8674e418602b6dc0cec6ab9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2a3d4a2ec8674e418602b6dc0cec6ab9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:41:03.463716 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServersOnMultiNodesTest-1266277988 Sep 08 10:41:03.463716 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 2a3d4a2ec8674e418602b6dc0cec6ab9 Sep 08 10:41:03.463716 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1266277988 Sep 08 10:41:03.463716 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServersOnMultiNodesTest-1266277988-project Sep 08 10:41:03.463716 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:41:03.463716 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:41:03.463716 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 771c067cf6814084a5520128a970dc82 Sep 08 10:41:03.463716 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServersOnMultiNodesTest-1266277988-project Sep 08 10:41:03.463716 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:41:03.463716 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance d32351b1-7fc7-4ce4-846d-16add998d5ab could not be found. Sep 08 10:41:03.463716 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'd32351b1-7fc7-4ce4-846d-16add998d5ab'} Sep 08 10:41:03.463716 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:41:03.463716 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:41:03.463716 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:41:03.463716 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:41:03.463716 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:41:03.463716 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:41:03.463716 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:41:03.463716 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:41:03.463716 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:41:03.463716 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:41:03.463716 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d32351b1-7fc7-4ce4-846d-16add998d5ab could not be found. Sep 08 10:41:03.463716 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:41:03.463716 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:41:03.463716 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:41:03.463716 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:41:03.463716 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:41:03.463716 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:41:03.463716 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:41:03.463716 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:41:03.463716 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:41:03.463716 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:41:03.463716 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:41:03.463716 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:41:03.463716 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:41:03.463716 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:41:03.463716 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:41:03.463716 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:41:03.463716 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d32351b1-7fc7-4ce4-846d-16add998d5ab could not be found. Sep 08 10:41:03.463716 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:41:03.463716 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:41:03.463716 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:41:03.475178 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:41:03.475178 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:41:03.475178 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:41:03.475178 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:41:03.475178 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:41:03.475178 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d32351b1-7fc7-4ce4-846d-16add998d5ab could not be found. Sep 08 10:41:03.475178 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:41:03.478360 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-75a20b73-be40-4a85-9fed-ff9928cc1826 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Returning 404 to user: Instance d32351b1-7fc7-4ce4-846d-16add998d5ab could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:41:03.480188 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-75a20b73-be40-4a85-9fed-ff9928cc1826 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/d32351b1-7fc7-4ce4-846d-16add998d5ab" status: 404 len: 111 microversion: 2.1 time: 0.087474 Sep 08 10:41:03.487247 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 592/1098] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:03 2022] GET /compute/v2.1/servers/d32351b1-7fc7-4ce4-846d-16add998d5ab => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 10:41:03.495996 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5caf378e-42d5-44d1-9e5e-3165a926b546 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:03.553944 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5caf378e-42d5-44d1-9e5e-3165a926b546 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/3c7ac2f4-7900-4460-88d2-b99d2a90cb64" status: 204 len: 0 microversion: 2.1 time: 0.064485 Sep 08 10:41:03.560822 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 593/1099] 10.222.0.27 () {58 vars in 1266 bytes} [Thu Sep 8 10:41:03 2022] DELETE /compute/v2.1/os-server-groups/3c7ac2f4-7900-4460-88d2-b99d2a90cb64 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:41:03.569354 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d9d2593d-d171-4a5d-b219-3d808758f99e tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:03.570334 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d9d2593d-d171-4a5d-b219-3d808758f99e tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: a3147437-e6f2-480d-bcaf-cc0f030d497d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:03.628702 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d9d2593d-d171-4a5d-b219-3d808758f99e tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:03.629710 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d9d2593d-d171-4a5d-b219-3d808758f99e tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:03.630609 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d9d2593d-d171-4a5d-b219-3d808758f99e tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:03.632228 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d9d2593d-d171-4a5d-b219-3d808758f99e tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:03.633827 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d9d2593d-d171-4a5d-b219-3d808758f99e tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:03.635268 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d9d2593d-d171-4a5d-b219-3d808758f99e tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:03.704970 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d9d2593d-d171-4a5d-b219-3d808758f99e tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: a3147437-e6f2-480d-bcaf-cc0f030d497d] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:41:03.955015 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=4,nova_api:DELETE=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:41:03.962113 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d9d2593d-d171-4a5d-b219-3d808758f99e tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a3147437-e6f2-480d-bcaf-cc0f030d497d" status: 204 len: 0 microversion: 2.1 time: 0.399711 Sep 08 10:41:03.962761 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 594/1100] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:41:03 2022] DELETE /compute/v2.1/servers/a3147437-e6f2-480d-bcaf-cc0f030d497d => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:41:03.977811 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-10dd4006-ee2e-4ecf-b7dd-6d7a27afd87b tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:03.981600 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-10dd4006-ee2e-4ecf-b7dd-6d7a27afd87b tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: a3a6ce0f-e362-4cbc-afc2-3cfd349a4812] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:03.999040 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10dd4006-ee2e-4ecf-b7dd-6d7a27afd87b tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:03.999868 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10dd4006-ee2e-4ecf-b7dd-6d7a27afd87b tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:04.000907 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10dd4006-ee2e-4ecf-b7dd-6d7a27afd87b tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:04.003445 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10dd4006-ee2e-4ecf-b7dd-6d7a27afd87b tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:04.004234 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10dd4006-ee2e-4ecf-b7dd-6d7a27afd87b tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:04.004961 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10dd4006-ee2e-4ecf-b7dd-6d7a27afd87b tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:04.187551 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-81012f81-f0d0-4dda-b3a5-8bd050a6c7af tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "POST /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.949462 Sep 08 10:41:04.197197 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 507/1101] 10.222.0.27 () {62 vars in 1364 bytes} [Thu Sep 8 10:41:03 2022] POST /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e/os-volume_attachments => generated 194 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:41:04.210613 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6bc5da12-ac05-40cd-bf24-618d7ed32ed2 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:04.215733 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6bc5da12-ac05-40cd-bf24-618d7ed32ed2 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: a3147437-e6f2-480d-bcaf-cc0f030d497d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:04.233422 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6bc5da12-ac05-40cd-bf24-618d7ed32ed2 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:04.235884 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6bc5da12-ac05-40cd-bf24-618d7ed32ed2 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:04.237873 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6bc5da12-ac05-40cd-bf24-618d7ed32ed2 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:04.240623 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6bc5da12-ac05-40cd-bf24-618d7ed32ed2 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:04.242498 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6bc5da12-ac05-40cd-bf24-618d7ed32ed2 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:04.243249 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6bc5da12-ac05-40cd-bf24-618d7ed32ed2 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:04.833673 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-10dd4006-ee2e-4ecf-b7dd-6d7a27afd87b tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:04.845999 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-10dd4006-ee2e-4ecf-b7dd-6d7a27afd87b tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812" status: 200 len: 1378 microversion: 2.1 time: 0.877214 Sep 08 10:41:04.846593 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 595/1102] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:03 2022] GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812 => generated 1378 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:41:04.872691 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6bc5da12-ac05-40cd-bf24-618d7ed32ed2 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:04.892699 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6bc5da12-ac05-40cd-bf24-618d7ed32ed2 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/a3147437-e6f2-480d-bcaf-cc0f030d497d" status: 200 len: 1472 microversion: 2.1 time: 0.684834 Sep 08 10:41:04.906136 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 508/1103] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:04 2022] GET /compute/v2.1/servers/a3147437-e6f2-480d-bcaf-cc0f030d497d => generated 1472 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:41:05.881464 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-20bc9ae5-5344-4aa7-b63a-eb660f3820fa tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:05.882100 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-20bc9ae5-5344-4aa7-b63a-eb660f3820fa tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: a3a6ce0f-e362-4cbc-afc2-3cfd349a4812] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:05.901319 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-20bc9ae5-5344-4aa7-b63a-eb660f3820fa tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:05.901828 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-20bc9ae5-5344-4aa7-b63a-eb660f3820fa tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:05.902270 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-20bc9ae5-5344-4aa7-b63a-eb660f3820fa tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:05.902990 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-20bc9ae5-5344-4aa7-b63a-eb660f3820fa tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:05.903457 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-20bc9ae5-5344-4aa7-b63a-eb660f3820fa tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:05.912598 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-20bc9ae5-5344-4aa7-b63a-eb660f3820fa tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:05.926247 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ba9459e1-9d30-4090-a7e8-6e61eda1eab3 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:05.927504 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ba9459e1-9d30-4090-a7e8-6e61eda1eab3 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: a3147437-e6f2-480d-bcaf-cc0f030d497d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:05.946891 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ba9459e1-9d30-4090-a7e8-6e61eda1eab3 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:05.947397 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ba9459e1-9d30-4090-a7e8-6e61eda1eab3 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:05.947832 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ba9459e1-9d30-4090-a7e8-6e61eda1eab3 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:05.948562 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ba9459e1-9d30-4090-a7e8-6e61eda1eab3 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:05.949017 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ba9459e1-9d30-4090-a7e8-6e61eda1eab3 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:05.949468 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ba9459e1-9d30-4090-a7e8-6e61eda1eab3 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:06.763727 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=8 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:41:07.161809 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ba9459e1-9d30-4090-a7e8-6e61eda1eab3 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:07.184970 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ba9459e1-9d30-4090-a7e8-6e61eda1eab3 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/a3147437-e6f2-480d-bcaf-cc0f030d497d" status: 200 len: 1472 microversion: 2.1 time: 1.258444 Sep 08 10:41:07.194314 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 509/1104] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:05 2022] GET /compute/v2.1/servers/a3147437-e6f2-480d-bcaf-cc0f030d497d => generated 1472 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:41:07.212151 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e35f7d31-2056-40c7-88e3-4f1eadf88bfe tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:07.213988 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e35f7d31-2056-40c7-88e3-4f1eadf88bfe tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] [instance: 133a5f12-39e5-4e0f-81dc-b1948c073f15] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:07.230366 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e35f7d31-2056-40c7-88e3-4f1eadf88bfe tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:07.234082 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e35f7d31-2056-40c7-88e3-4f1eadf88bfe tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:07.235739 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e35f7d31-2056-40c7-88e3-4f1eadf88bfe tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:07.237371 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e35f7d31-2056-40c7-88e3-4f1eadf88bfe tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:07.245520 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e35f7d31-2056-40c7-88e3-4f1eadf88bfe tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:07.246238 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e35f7d31-2056-40c7-88e3-4f1eadf88bfe tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:07.497673 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=4 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:41:07.536581 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e35f7d31-2056-40c7-88e3-4f1eadf88bfe tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15" status: 200 len: 1815 microversion: 2.1 time: 0.340532 Sep 08 10:41:07.537721 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 510/1105] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:07 2022] GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15 => generated 1815 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:41:07.581638 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e4d5f40a-3faf-40ea-9343-1094132a5750 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:07.586158 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e4d5f40a-3faf-40ea-9343-1094132a5750 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:07.586601 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e4d5f40a-3faf-40ea-9343-1094132a5750 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:07.587052 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e4d5f40a-3faf-40ea-9343-1094132a5750 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:07.587804 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e4d5f40a-3faf-40ea-9343-1094132a5750 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:07.588267 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e4d5f40a-3faf-40ea-9343-1094132a5750 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:07.588731 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e4d5f40a-3faf-40ea-9343-1094132a5750 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:07.589707 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-20bc9ae5-5344-4aa7-b63a-eb660f3820fa tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:07.601294 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-20bc9ae5-5344-4aa7-b63a-eb660f3820fa tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812" status: 200 len: 1378 microversion: 2.1 time: 1.728194 Sep 08 10:41:07.617657 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 596/1106] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:05 2022] GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812 => generated 1378 bytes in 1735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:41:07.713714 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e4d5f40a-3faf-40ea-9343-1094132a5750 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.137702 Sep 08 10:41:07.715692 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 511/1107] 10.222.0.27 () {58 vars in 1176 bytes} [Thu Sep 8 10:41:07 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:41:08.228065 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-08a6d79d-52d9-4308-ad19-7d3e48e7c95d tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:08.228695 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-08a6d79d-52d9-4308-ad19-7d3e48e7c95d tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: a3147437-e6f2-480d-bcaf-cc0f030d497d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:08.249391 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08a6d79d-52d9-4308-ad19-7d3e48e7c95d tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:08.249881 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08a6d79d-52d9-4308-ad19-7d3e48e7c95d tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:08.250382 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08a6d79d-52d9-4308-ad19-7d3e48e7c95d tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:08.251090 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08a6d79d-52d9-4308-ad19-7d3e48e7c95d tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:08.251550 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08a6d79d-52d9-4308-ad19-7d3e48e7c95d tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:08.251984 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08a6d79d-52d9-4308-ad19-7d3e48e7c95d tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:08.633503 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d8fdaa2b-46ed-40f2-8d92-155b22ee3677 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:08.634342 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d8fdaa2b-46ed-40f2-8d92-155b22ee3677 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: a3a6ce0f-e362-4cbc-afc2-3cfd349a4812] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:08.664464 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d8fdaa2b-46ed-40f2-8d92-155b22ee3677 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:08.666587 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d8fdaa2b-46ed-40f2-8d92-155b22ee3677 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:08.667614 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d8fdaa2b-46ed-40f2-8d92-155b22ee3677 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:08.671144 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d8fdaa2b-46ed-40f2-8d92-155b22ee3677 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:08.672925 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d8fdaa2b-46ed-40f2-8d92-155b22ee3677 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:08.674700 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d8fdaa2b-46ed-40f2-8d92-155b22ee3677 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:09.271676 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d8fdaa2b-46ed-40f2-8d92-155b22ee3677 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:09.287628 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d8fdaa2b-46ed-40f2-8d92-155b22ee3677 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812" status: 200 len: 1378 microversion: 2.1 time: 0.656232 Sep 08 10:41:09.293437 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 512/1108] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:08 2022] GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812 => generated 1378 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:41:09.549411 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-08a6d79d-52d9-4308-ad19-7d3e48e7c95d tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:09.568280 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-08a6d79d-52d9-4308-ad19-7d3e48e7c95d tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/a3147437-e6f2-480d-bcaf-cc0f030d497d" status: 200 len: 1472 microversion: 2.1 time: 1.344886 Sep 08 10:41:09.587175 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 597/1109] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:08 2022] GET /compute/v2.1/servers/a3147437-e6f2-480d-bcaf-cc0f030d497d => generated 1472 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:41:10.311935 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ae256080-fa24-4b3c-8f0c-370e77f9f1f4 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:10.313212 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ae256080-fa24-4b3c-8f0c-370e77f9f1f4 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: a3a6ce0f-e362-4cbc-afc2-3cfd349a4812] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:10.334556 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ae256080-fa24-4b3c-8f0c-370e77f9f1f4 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:10.341436 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ae256080-fa24-4b3c-8f0c-370e77f9f1f4 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:10.342383 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ae256080-fa24-4b3c-8f0c-370e77f9f1f4 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:10.351775 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ae256080-fa24-4b3c-8f0c-370e77f9f1f4 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:10.352993 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ae256080-fa24-4b3c-8f0c-370e77f9f1f4 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:10.353925 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ae256080-fa24-4b3c-8f0c-370e77f9f1f4 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:10.602553 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-96f20f09-c493-4d2f-8820-94821f32186f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:10.603134 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-96f20f09-c493-4d2f-8820-94821f32186f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: a3147437-e6f2-480d-bcaf-cc0f030d497d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:10.620676 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-96f20f09-c493-4d2f-8820-94821f32186f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:10.621225 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-96f20f09-c493-4d2f-8820-94821f32186f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:10.621665 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-96f20f09-c493-4d2f-8820-94821f32186f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:10.622389 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-96f20f09-c493-4d2f-8820-94821f32186f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:10.622847 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-96f20f09-c493-4d2f-8820-94821f32186f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:10.623271 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-96f20f09-c493-4d2f-8820-94821f32186f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:11.490920 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-96f20f09-c493-4d2f-8820-94821f32186f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771c067cf6814084a5520128a970dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3d4a2ec8674e418602b6dc0cec6ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:11.491173 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ae256080-fa24-4b3c-8f0c-370e77f9f1f4 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:11.510521 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-96f20f09-c493-4d2f-8820-94821f32186f tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/a3147437-e6f2-480d-bcaf-cc0f030d497d" status: 200 len: 1430 microversion: 2.1 time: 0.914303 Sep 08 10:41:11.521461 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ae256080-fa24-4b3c-8f0c-370e77f9f1f4 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812" status: 200 len: 1378 microversion: 2.1 time: 1.213157 Sep 08 10:41:11.530117 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 513/1110] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:10 2022] GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812 => generated 1378 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:41:11.530518 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 598/1111] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:10 2022] GET /compute/v2.1/servers/a3147437-e6f2-480d-bcaf-cc0f030d497d => generated 1430 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:41:11.557862 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-8fd29950-a775-4b39-a841-3b058ea688ad req-99f8cdce-f77e-4b6b-aee9-3d6f683adf2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3147437-e6f2-480d-bcaf-cc0f030d497d", "name": "network-vif-deleted", "tag": "38fe5d2c-fe31-4e0c-aa4e-7ae415d02939"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:41:11.610391 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-8fd29950-a775-4b39-a841-3b058ea688ad req-99f8cdce-f77e-4b6b-aee9-3d6f683adf2c service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:11.612972 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-8fd29950-a775-4b39-a841-3b058ea688ad req-99f8cdce-f77e-4b6b-aee9-3d6f683adf2c service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:11.635412 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-8fd29950-a775-4b39-a841-3b058ea688ad req-99f8cdce-f77e-4b6b-aee9-3d6f683adf2c service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:11.713582 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-8fd29950-a775-4b39-a841-3b058ea688ad req-99f8cdce-f77e-4b6b-aee9-3d6f683adf2c service nova] Creating event network-vif-deleted:38fe5d2c-fe31-4e0c-aa4e-7ae415d02939 for instance a3147437-e6f2-480d-bcaf-cc0f030d497d on n-h2-850501-12 Sep 08 10:41:11.731298 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-8fd29950-a775-4b39-a841-3b058ea688ad req-99f8cdce-f77e-4b6b-aee9-3d6f683adf2c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.195311 Sep 08 10:41:11.734190 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 514/1112] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:41:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:41:12.541270 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6e438906-da26-4768-974b-c721b188e582 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:12.543052 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6e438906-da26-4768-974b-c721b188e582 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] [instance: a3147437-e6f2-480d-bcaf-cc0f030d497d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:12.556706 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6e438906-da26-4768-974b-c721b188e582 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:12.561414 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6e438906-da26-4768-974b-c721b188e582 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:12.562214 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6e438906-da26-4768-974b-c721b188e582 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:12.563140 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6e438906-da26-4768-974b-c721b188e582 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:12.565075 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6e438906-da26-4768-974b-c721b188e582 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:12.566291 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1ef73882-5596-4f5d-af69-e691c0b71779 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:12.567246 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6e438906-da26-4768-974b-c721b188e582 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:12.571022 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1ef73882-5596-4f5d-af69-e691c0b71779 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: a3a6ce0f-e362-4cbc-afc2-3cfd349a4812] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:12.629876 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-6e438906-da26-4768-974b-c721b188e582 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] HTTP exception thrown: Instance a3147437-e6f2-480d-bcaf-cc0f030d497d could not be found. Sep 08 10:41:12.635397 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6e438906-da26-4768-974b-c721b188e582 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Request method failure captured: Sep 08 10:41:12.635397 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/a3147437-e6f2-480d-bcaf-cc0f030d497d HTTP/1.1 Sep 08 10:41:12.635397 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:41:12.635397 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:41:12.635397 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:41:12.635397 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:41:12.635397 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:41:12.635397 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:41:12.635397 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:41:12.635397 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:41:12.635397 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcXsmHH1yoQtgpWVsTlKGRZ1RD9sGjJDO3R5IIX2mO0TzFlOkGo4Nrt9P8ms3HuxErnST87nkHuEi-VzkaDAC8r3keukBBYL9HR0teGPa-du_tj-nOftdvIVdc8Rf3uKj_SiRNumvszg8v8N8iSarJ11mQfNqN8vl0lBx8hzlRuGs8w Sep 08 10:41:12.635397 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:41:12.635397 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:41:12.635397 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:41:12.635397 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:41:12.635397 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:41:12.635397 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:41:12.635397 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 2a3d4a2ec8674e418602b6dc0cec6ab9 Sep 08 10:41:12.635397 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersOnMultiNodesTest-1266277988 Sep 08 10:41:12.635397 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:41:12.635397 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:41:12.635397 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2a3d4a2ec8674e418602b6dc0cec6ab9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2a3d4a2ec8674e418602b6dc0cec6ab9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2a3d4a2ec8674e418602b6dc0cec6ab9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2a3d4a2ec8674e418602b6dc0cec6ab9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:41:12.635397 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServersOnMultiNodesTest-1266277988 Sep 08 10:41:12.635397 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 2a3d4a2ec8674e418602b6dc0cec6ab9 Sep 08 10:41:12.635397 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1266277988 Sep 08 10:41:12.635397 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServersOnMultiNodesTest-1266277988-project Sep 08 10:41:12.635397 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:41:12.635397 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:41:12.635397 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 771c067cf6814084a5520128a970dc82 Sep 08 10:41:12.635397 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServersOnMultiNodesTest-1266277988-project Sep 08 10:41:12.635397 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:41:12.635397 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance a3147437-e6f2-480d-bcaf-cc0f030d497d could not be found. Sep 08 10:41:12.635397 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'a3147437-e6f2-480d-bcaf-cc0f030d497d'} Sep 08 10:41:12.635397 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:41:12.635397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:41:12.635397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:41:12.635397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:41:12.635397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:41:12.635397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:41:12.635397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:41:12.635397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:41:12.635397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:41:12.635397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:41:12.635397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3147437-e6f2-480d-bcaf-cc0f030d497d could not be found. Sep 08 10:41:12.635397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:41:12.635397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:41:12.635397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:41:12.635397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:41:12.635397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:41:12.635397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:41:12.635397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:41:12.635397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:41:12.635397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:41:12.635397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:41:12.635397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:41:12.635397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:41:12.635397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:41:12.635397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:41:12.635397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:41:12.635397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:41:12.635397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3147437-e6f2-480d-bcaf-cc0f030d497d could not be found. Sep 08 10:41:12.635397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:41:12.635397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:41:12.635397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:41:12.640035 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:41:12.640035 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:41:12.640035 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:41:12.640035 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:41:12.640035 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:41:12.640035 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3147437-e6f2-480d-bcaf-cc0f030d497d could not be found. Sep 08 10:41:12.640035 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:41:12.641535 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6e438906-da26-4768-974b-c721b188e582 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] Returning 404 to user: Instance a3147437-e6f2-480d-bcaf-cc0f030d497d could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:41:12.644912 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6e438906-da26-4768-974b-c721b188e582 tempest-ServersOnMultiNodesTest-1266277988 tempest-ServersOnMultiNodesTest-1266277988-project] 10.222.0.27 "GET /compute/v2.1/servers/a3147437-e6f2-480d-bcaf-cc0f030d497d" status: 404 len: 111 microversion: 2.1 time: 0.110389 Sep 08 10:41:12.645628 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1ef73882-5596-4f5d-af69-e691c0b71779 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:12.646149 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1ef73882-5596-4f5d-af69-e691c0b71779 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:12.646595 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1ef73882-5596-4f5d-af69-e691c0b71779 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:12.646900 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 599/1113] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:12 2022] GET /compute/v2.1/servers/a3147437-e6f2-480d-bcaf-cc0f030d497d => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 10:41:12.647326 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1ef73882-5596-4f5d-af69-e691c0b71779 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:12.647797 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1ef73882-5596-4f5d-af69-e691c0b71779 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:12.661597 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1ef73882-5596-4f5d-af69-e691c0b71779 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:13.197013 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1ef73882-5596-4f5d-af69-e691c0b71779 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:13.234078 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1ef73882-5596-4f5d-af69-e691c0b71779 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812" status: 200 len: 1378 microversion: 2.1 time: 0.677228 Sep 08 10:41:13.237268 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 515/1114] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:12 2022] GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812 => generated 1378 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:41:13.357964 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e7bab8bf-7744-486f-94a6-3e979ca6fe6c tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f49ef527-a901-4aa1-b79f-94d518c3d221", "device": "/dev/xvdb"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:41:13.362779 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e7bab8bf-7744-486f-94a6-3e979ca6fe6c tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 133a5f12-39e5-4e0f-81dc-b1948c073f15] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:13.391937 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7bab8bf-7744-486f-94a6-3e979ca6fe6c tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:13.394676 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7bab8bf-7744-486f-94a6-3e979ca6fe6c tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:13.396427 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7bab8bf-7744-486f-94a6-3e979ca6fe6c tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:13.400861 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7bab8bf-7744-486f-94a6-3e979ca6fe6c tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:13.403089 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7bab8bf-7744-486f-94a6-3e979ca6fe6c tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:13.403900 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7bab8bf-7744-486f-94a6-3e979ca6fe6c tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:13.822751 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-dcfc4443-450f-4121-86d8-80bf4d8dffe2 req-913fa9f1-eb32-4422-aeeb-37962d59590b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3a6ce0f-e362-4cbc-afc2-3cfd349a4812", "tag": "8ff15ca8-cc64-424e-b9f6-8f38b142e5ac"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:41:13.861542 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-dcfc4443-450f-4121-86d8-80bf4d8dffe2 req-913fa9f1-eb32-4422-aeeb-37962d59590b service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:13.862032 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-dcfc4443-450f-4121-86d8-80bf4d8dffe2 req-913fa9f1-eb32-4422-aeeb-37962d59590b service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:13.862463 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-dcfc4443-450f-4121-86d8-80bf4d8dffe2 req-913fa9f1-eb32-4422-aeeb-37962d59590b service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:13.908712 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-dcfc4443-450f-4121-86d8-80bf4d8dffe2 req-913fa9f1-eb32-4422-aeeb-37962d59590b service nova] Creating event network-changed:8ff15ca8-cc64-424e-b9f6-8f38b142e5ac for instance a3a6ce0f-e362-4cbc-afc2-3cfd349a4812 on n-h1-850501-12 Sep 08 10:41:13.939635 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-dcfc4443-450f-4121-86d8-80bf4d8dffe2 req-913fa9f1-eb32-4422-aeeb-37962d59590b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111979 Sep 08 10:41:13.944926 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 516/1115] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:41:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:41:14.267833 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e7bab8bf-7744-486f-94a6-3e979ca6fe6c tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "POST /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.911588 Sep 08 10:41:14.278872 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 600/1116] 10.222.0.27 () {60 vars in 1323 bytes} [Thu Sep 8 10:41:13 2022] POST /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15/os-volume_attachments => generated 194 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:41:14.286956 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b7f25708-1fa8-489e-850b-b6ec01d20579 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:14.289290 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b7f25708-1fa8-489e-850b-b6ec01d20579 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: a3a6ce0f-e362-4cbc-afc2-3cfd349a4812] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:14.356029 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b7f25708-1fa8-489e-850b-b6ec01d20579 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:14.356831 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b7f25708-1fa8-489e-850b-b6ec01d20579 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:14.371083 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b7f25708-1fa8-489e-850b-b6ec01d20579 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:14.372298 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b7f25708-1fa8-489e-850b-b6ec01d20579 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:14.373344 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b7f25708-1fa8-489e-850b-b6ec01d20579 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:14.374021 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b7f25708-1fa8-489e-850b-b6ec01d20579 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:14.712025 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b7f25708-1fa8-489e-850b-b6ec01d20579 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:14.727433 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b7f25708-1fa8-489e-850b-b6ec01d20579 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812" status: 200 len: 1378 microversion: 2.1 time: 0.446630 Sep 08 10:41:14.737129 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 517/1117] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:14 2022] GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812 => generated 1378 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:41:15.765196 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-260923b4-6bb3-49b2-babc-2fc333047520 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:15.767570 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-260923b4-6bb3-49b2-babc-2fc333047520 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: a3a6ce0f-e362-4cbc-afc2-3cfd349a4812] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:15.783607 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-260923b4-6bb3-49b2-babc-2fc333047520 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:15.786004 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-260923b4-6bb3-49b2-babc-2fc333047520 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:15.787818 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-260923b4-6bb3-49b2-babc-2fc333047520 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:15.790374 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-260923b4-6bb3-49b2-babc-2fc333047520 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:15.792751 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-260923b4-6bb3-49b2-babc-2fc333047520 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:15.794613 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-260923b4-6bb3-49b2-babc-2fc333047520 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:16.825701 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-260923b4-6bb3-49b2-babc-2fc333047520 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:16.853385 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-260923b4-6bb3-49b2-babc-2fc333047520 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812" status: 200 len: 1378 microversion: 2.1 time: 1.095047 Sep 08 10:41:16.860279 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 601/1118] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:15 2022] GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812 => generated 1378 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:41:17.913438 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5269356d-f85a-4842-a38e-f106db03a805 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:17.914758 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5269356d-f85a-4842-a38e-f106db03a805 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: a3a6ce0f-e362-4cbc-afc2-3cfd349a4812] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:17.926569 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:41:17.947524 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5269356d-f85a-4842-a38e-f106db03a805 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:17.958270 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5269356d-f85a-4842-a38e-f106db03a805 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:17.959540 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5269356d-f85a-4842-a38e-f106db03a805 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:17.976887 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5269356d-f85a-4842-a38e-f106db03a805 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:17.980639 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5269356d-f85a-4842-a38e-f106db03a805 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:17.984407 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5269356d-f85a-4842-a38e-f106db03a805 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:19.771769 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5269356d-f85a-4842-a38e-f106db03a805 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:19.788406 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:41:19.794645 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5269356d-f85a-4842-a38e-f106db03a805 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812" status: 200 len: 1378 microversion: 2.1 time: 1.888769 Sep 08 10:41:19.807756 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 518/1119] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:17 2022] GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812 => generated 1378 bytes in 1903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:41:20.026548 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-87effaf4-c127-4b51-9bfb-357dd0a1a406 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2086452505", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "cf032a39-d4e2-476c-8052-c76f4ee567c9"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:41:20.167691 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-87effaf4-c127-4b51-9bfb-357dd0a1a406 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] validate_networks() for [('cf032a39-d4e2-476c-8052-c76f4ee567c9', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:41:20.843125 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9ee464bb-d5f7-4865-a6fa-0736e220a759 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:20.848852 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9ee464bb-d5f7-4865-a6fa-0736e220a759 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: a3a6ce0f-e362-4cbc-afc2-3cfd349a4812] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:20.883804 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ee464bb-d5f7-4865-a6fa-0736e220a759 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:20.891602 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ee464bb-d5f7-4865-a6fa-0736e220a759 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:20.892597 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ee464bb-d5f7-4865-a6fa-0736e220a759 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:20.893986 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ee464bb-d5f7-4865-a6fa-0736e220a759 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:20.897848 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ee464bb-d5f7-4865-a6fa-0736e220a759 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:20.902366 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ee464bb-d5f7-4865-a6fa-0736e220a759 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:21.231888 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-87effaf4-c127-4b51-9bfb-357dd0a1a406 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:41:21.232977 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-87effaf4-c127-4b51-9bfb-357dd0a1a406 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:41:21.240119 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-87effaf4-c127-4b51-9bfb-357dd0a1a406 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:41:21.240833 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-87effaf4-c127-4b51-9bfb-357dd0a1a406 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:41:21.241602 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-87effaf4-c127-4b51-9bfb-357dd0a1a406 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:41:21.287791 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87effaf4-c127-4b51-9bfb-357dd0a1a406 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:21.291629 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87effaf4-c127-4b51-9bfb-357dd0a1a406 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:21.292716 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87effaf4-c127-4b51-9bfb-357dd0a1a406 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:21.294306 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87effaf4-c127-4b51-9bfb-357dd0a1a406 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:21.299638 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87effaf4-c127-4b51-9bfb-357dd0a1a406 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:21.302198 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87effaf4-c127-4b51-9bfb-357dd0a1a406 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:21.392322 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-87effaf4-c127-4b51-9bfb-357dd0a1a406 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Getting quotas for project 998378cc815344ba8a107d1cd61f40fd. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:41:21.423571 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-87effaf4-c127-4b51-9bfb-357dd0a1a406 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Getting quotas for user d08269c53bcb41c88953e7c79f5ad185 and project 998378cc815344ba8a107d1cd61f40fd. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:41:21.513335 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-87effaf4-c127-4b51-9bfb-357dd0a1a406 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:41:21.530145 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-87effaf4-c127-4b51-9bfb-357dd0a1a406 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 2f4552b5-2e31-458b-b0f3-5bd551cc9ced] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:41:21.771970 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-87effaf4-c127-4b51-9bfb-357dd0a1a406 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.543128 Sep 08 10:41:21.774878 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 602/1120] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:41:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 2547 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:41:21.798613 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5b434f29-c3e7-44f7-9a27-9def7f83a382 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:21.803603 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5b434f29-c3e7-44f7-9a27-9def7f83a382 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 2f4552b5-2e31-458b-b0f3-5bd551cc9ced] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:22.084220 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5b434f29-c3e7-44f7-9a27-9def7f83a382 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:22.117763 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5b434f29-c3e7-44f7-9a27-9def7f83a382 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/2f4552b5-2e31-458b-b0f3-5bd551cc9ced" status: 200 len: 1215 microversion: 2.1 time: 0.330701 Sep 08 10:41:22.120795 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 603/1121] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:21 2022] GET /compute/v2.1/servers/2f4552b5-2e31-458b-b0f3-5bd551cc9ced => generated 1215 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:41:22.802398 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9ee464bb-d5f7-4865-a6fa-0736e220a759 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:22.819600 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9ee464bb-d5f7-4865-a6fa-0736e220a759 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812" status: 200 len: 1378 microversion: 2.1 time: 1.987977 Sep 08 10:41:22.820613 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 519/1122] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:20 2022] GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812 => generated 1378 bytes in 1990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:41:22.852436 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9619df47-3ce1-4f30-be56-83f2c7b322cf tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:22.855412 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9619df47-3ce1-4f30-be56-83f2c7b322cf tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] [instance: 7dac6a5f-62eb-4c60-8904-f23e50e1dcc8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:22.877616 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9619df47-3ce1-4f30-be56-83f2c7b322cf tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:22.904364 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9619df47-3ce1-4f30-be56-83f2c7b322cf tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:22.907977 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9619df47-3ce1-4f30-be56-83f2c7b322cf tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:22.910334 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9619df47-3ce1-4f30-be56-83f2c7b322cf tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:22.927351 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4601e77d-f8f1-4d37-b157-f9e7e52db163 tempest-ServicesAdminTestJSON-1636870313 tempest-ServicesAdminTestJSON-1636870313-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:22.932645 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4601e77d-f8f1-4d37-b157-f9e7e52db163 tempest-ServicesAdminTestJSON-1636870313 tempest-ServicesAdminTestJSON-1636870313-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:22.933768 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9619df47-3ce1-4f30-be56-83f2c7b322cf tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:22.936501 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9619df47-3ce1-4f30-be56-83f2c7b322cf tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:22.939257 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4601e77d-f8f1-4d37-b157-f9e7e52db163 tempest-ServicesAdminTestJSON-1636870313 tempest-ServicesAdminTestJSON-1636870313-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:22.943881 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4601e77d-f8f1-4d37-b157-f9e7e52db163 tempest-ServicesAdminTestJSON-1636870313 tempest-ServicesAdminTestJSON-1636870313-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:22.948270 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4601e77d-f8f1-4d37-b157-f9e7e52db163 tempest-ServicesAdminTestJSON-1636870313 tempest-ServicesAdminTestJSON-1636870313-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:22.950647 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4601e77d-f8f1-4d37-b157-f9e7e52db163 tempest-ServicesAdminTestJSON-1636870313 tempest-ServicesAdminTestJSON-1636870313-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:22.951414 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4601e77d-f8f1-4d37-b157-f9e7e52db163 tempest-ServicesAdminTestJSON-1636870313 tempest-ServicesAdminTestJSON-1636870313-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:23.064717 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9619df47-3ce1-4f30-be56-83f2c7b322cf tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] [instance: 7dac6a5f-62eb-4c60-8904-f23e50e1dcc8] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:41:23.077710 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4601e77d-f8f1-4d37-b157-f9e7e52db163 tempest-ServicesAdminTestJSON-1636870313 tempest-ServicesAdminTestJSON-1636870313-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.766284 Sep 08 10:41:23.095624 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 604/1123] 10.222.0.27 () {58 vars in 1137 bytes} [Thu Sep 8 10:41:22 2022] GET /compute/v2.1/os-services => generated 949 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:41:23.104865 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-00d9a473-0c5e-4536-bdba-2d2e3527f1f2 tempest-ServicesAdminTestJSON-1636870313 tempest-ServicesAdminTestJSON-1636870313-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:23.125089 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00d9a473-0c5e-4536-bdba-2d2e3527f1f2 tempest-ServicesAdminTestJSON-1636870313 tempest-ServicesAdminTestJSON-1636870313-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:23.128262 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00d9a473-0c5e-4536-bdba-2d2e3527f1f2 tempest-ServicesAdminTestJSON-1636870313 tempest-ServicesAdminTestJSON-1636870313-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:23.129549 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00d9a473-0c5e-4536-bdba-2d2e3527f1f2 tempest-ServicesAdminTestJSON-1636870313 tempest-ServicesAdminTestJSON-1636870313-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:23.134293 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00d9a473-0c5e-4536-bdba-2d2e3527f1f2 tempest-ServicesAdminTestJSON-1636870313 tempest-ServicesAdminTestJSON-1636870313-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:23.135256 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00d9a473-0c5e-4536-bdba-2d2e3527f1f2 tempest-ServicesAdminTestJSON-1636870313 tempest-ServicesAdminTestJSON-1636870313-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:23.135929 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00d9a473-0c5e-4536-bdba-2d2e3527f1f2 tempest-ServicesAdminTestJSON-1636870313 tempest-ServicesAdminTestJSON-1636870313-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:23.244639 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-00d9a473-0c5e-4536-bdba-2d2e3527f1f2 tempest-ServicesAdminTestJSON-1636870313 tempest-ServicesAdminTestJSON-1636870313-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?host=n-d-850501-12" status: 200 len: 581 microversion: 2.1 time: 0.145630 Sep 08 10:41:23.245308 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 605/1124] 10.222.0.27 () {58 vars in 1174 bytes} [Thu Sep 8 10:41:23 2022] GET /compute/v2.1/os-services?host=n-d-850501-12 => generated 581 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:41:23.291353 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-05236941-ce96-4577-ad93-86031f8a945c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:23.295893 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-05236941-ce96-4577-ad93-86031f8a945c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 2f4552b5-2e31-458b-b0f3-5bd551cc9ced] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:23.389184 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:41:23.436487 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9619df47-3ce1-4f30-be56-83f2c7b322cf tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7dac6a5f-62eb-4c60-8904-f23e50e1dcc8" status: 204 len: 0 microversion: 2.1 time: 0.613375 Sep 08 10:41:23.444755 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 520/1125] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:41:22 2022] DELETE /compute/v2.1/servers/7dac6a5f-62eb-4c60-8904-f23e50e1dcc8 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:41:23.478005 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6417b602-7e7c-4dc5-b517-2a61a4eeac53 tempest-ServicesAdminTestJSON-1636870313 tempest-ServicesAdminTestJSON-1636870313-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:23.499743 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6417b602-7e7c-4dc5-b517-2a61a4eeac53 tempest-ServicesAdminTestJSON-1636870313 tempest-ServicesAdminTestJSON-1636870313-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:23.504766 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6417b602-7e7c-4dc5-b517-2a61a4eeac53 tempest-ServicesAdminTestJSON-1636870313 tempest-ServicesAdminTestJSON-1636870313-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:23.505530 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6417b602-7e7c-4dc5-b517-2a61a4eeac53 tempest-ServicesAdminTestJSON-1636870313 tempest-ServicesAdminTestJSON-1636870313-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:23.510153 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6417b602-7e7c-4dc5-b517-2a61a4eeac53 tempest-ServicesAdminTestJSON-1636870313 tempest-ServicesAdminTestJSON-1636870313-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:23.519988 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6417b602-7e7c-4dc5-b517-2a61a4eeac53 tempest-ServicesAdminTestJSON-1636870313 tempest-ServicesAdminTestJSON-1636870313-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:23.522695 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6417b602-7e7c-4dc5-b517-2a61a4eeac53 tempest-ServicesAdminTestJSON-1636870313 tempest-ServicesAdminTestJSON-1636870313-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:23.560098 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-05236941-ce96-4577-ad93-86031f8a945c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:23.570589 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-05236941-ce96-4577-ad93-86031f8a945c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/2f4552b5-2e31-458b-b0f3-5bd551cc9ced" status: 200 len: 1215 microversion: 2.1 time: 0.301335 Sep 08 10:41:23.585620 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 606/1126] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:23 2022] GET /compute/v2.1/servers/2f4552b5-2e31-458b-b0f3-5bd551cc9ced => generated 1215 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:41:23.614804 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-30cf0ac7-3313-4f23-b157-78be60d6e55f tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:23.616517 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-30cf0ac7-3313-4f23-b157-78be60d6e55f tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] [instance: 7dac6a5f-62eb-4c60-8904-f23e50e1dcc8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:23.658755 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6417b602-7e7c-4dc5-b517-2a61a4eeac53 tempest-ServicesAdminTestJSON-1636870313 tempest-ServicesAdminTestJSON-1636870313-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.194801 Sep 08 10:41:23.660346 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 521/1127] 10.222.0.27 () {58 vars in 1176 bytes} [Thu Sep 8 10:41:23 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:41:23.662618 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-30cf0ac7-3313-4f23-b157-78be60d6e55f tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:23.663170 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-30cf0ac7-3313-4f23-b157-78be60d6e55f tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:23.663624 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-30cf0ac7-3313-4f23-b157-78be60d6e55f tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:23.664504 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-30cf0ac7-3313-4f23-b157-78be60d6e55f tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:23.664976 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-30cf0ac7-3313-4f23-b157-78be60d6e55f tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:23.677623 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-30cf0ac7-3313-4f23-b157-78be60d6e55f tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:23.682343 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0ae08775-35c6-4848-8121-fd6ff525606b tempest-ServicesAdminTestJSON-1636870313 tempest-ServicesAdminTestJSON-1636870313-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:23.693335 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0ae08775-35c6-4848-8121-fd6ff525606b tempest-ServicesAdminTestJSON-1636870313 tempest-ServicesAdminTestJSON-1636870313-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:23.699520 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0ae08775-35c6-4848-8121-fd6ff525606b tempest-ServicesAdminTestJSON-1636870313 tempest-ServicesAdminTestJSON-1636870313-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:23.699981 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0ae08775-35c6-4848-8121-fd6ff525606b tempest-ServicesAdminTestJSON-1636870313 tempest-ServicesAdminTestJSON-1636870313-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:23.709155 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0ae08775-35c6-4848-8121-fd6ff525606b tempest-ServicesAdminTestJSON-1636870313 tempest-ServicesAdminTestJSON-1636870313-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:23.712212 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0ae08775-35c6-4848-8121-fd6ff525606b tempest-ServicesAdminTestJSON-1636870313 tempest-ServicesAdminTestJSON-1636870313-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:23.717686 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0ae08775-35c6-4848-8121-fd6ff525606b tempest-ServicesAdminTestJSON-1636870313 tempest-ServicesAdminTestJSON-1636870313-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:23.862268 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0ae08775-35c6-4848-8121-fd6ff525606b tempest-ServicesAdminTestJSON-1636870313 tempest-ServicesAdminTestJSON-1636870313-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.185163 Sep 08 10:41:23.873827 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 522/1128] 10.222.0.27 () {58 vars in 1137 bytes} [Thu Sep 8 10:41:23 2022] GET /compute/v2.1/os-services => generated 949 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:41:23.907586 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-413e9547-0920-47cf-a9fc-8a52b2b875ef tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:23.909050 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-413e9547-0920-47cf-a9fc-8a52b2b875ef tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: a3a6ce0f-e362-4cbc-afc2-3cfd349a4812] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:23.931043 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-413e9547-0920-47cf-a9fc-8a52b2b875ef tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:23.931847 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-413e9547-0920-47cf-a9fc-8a52b2b875ef tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:23.932949 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-413e9547-0920-47cf-a9fc-8a52b2b875ef tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:23.935715 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-413e9547-0920-47cf-a9fc-8a52b2b875ef tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:23.937105 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-413e9547-0920-47cf-a9fc-8a52b2b875ef tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:23.939232 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-413e9547-0920-47cf-a9fc-8a52b2b875ef tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:24.592711 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-30cf0ac7-3313-4f23-b157-78be60d6e55f tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4cde361139445eb147c4f634ec663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5388c25cdb4a35ae8d58fa5b6cf125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:24.624830 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-30cf0ac7-3313-4f23-b157-78be60d6e55f tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] 10.222.0.27 "GET /compute/v2.1/servers/7dac6a5f-62eb-4c60-8904-f23e50e1dcc8" status: 200 len: 1712 microversion: 2.1 time: 1.037239 Sep 08 10:41:24.627680 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 607/1129] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:23 2022] GET /compute/v2.1/servers/7dac6a5f-62eb-4c60-8904-f23e50e1dcc8 => generated 1712 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:41:24.645852 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-413e9547-0920-47cf-a9fc-8a52b2b875ef tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:24.652742 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-aa2b9eae-3d2b-418e-81fc-96536f82670b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:24.663158 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-413e9547-0920-47cf-a9fc-8a52b2b875ef tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812" status: 200 len: 1378 microversion: 2.1 time: 0.765436 Sep 08 10:41:24.666433 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-aa2b9eae-3d2b-418e-81fc-96536f82670b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 2f4552b5-2e31-458b-b0f3-5bd551cc9ced] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:24.683457 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 523/1130] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:23 2022] GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812 => generated 1378 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:41:24.712646 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa2b9eae-3d2b-418e-81fc-96536f82670b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:24.731832 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa2b9eae-3d2b-418e-81fc-96536f82670b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:24.733046 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa2b9eae-3d2b-418e-81fc-96536f82670b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:24.738906 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa2b9eae-3d2b-418e-81fc-96536f82670b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:24.740144 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa2b9eae-3d2b-418e-81fc-96536f82670b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:24.741263 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa2b9eae-3d2b-418e-81fc-96536f82670b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:24.784269 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:41:25.012097 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-aa2b9eae-3d2b-418e-81fc-96536f82670b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:25.034538 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-aa2b9eae-3d2b-418e-81fc-96536f82670b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/2f4552b5-2e31-458b-b0f3-5bd551cc9ced" status: 200 len: 1267 microversion: 2.1 time: 0.401494 Sep 08 10:41:25.039101 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 608/1131] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:24 2022] GET /compute/v2.1/servers/2f4552b5-2e31-458b-b0f3-5bd551cc9ced => generated 1267 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:41:25.700424 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b3765a67-65de-41b6-81a5-fe5221c82671 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:25.701271 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b3765a67-65de-41b6-81a5-fe5221c82671 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] [instance: 7dac6a5f-62eb-4c60-8904-f23e50e1dcc8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:25.739869 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7bae4670-4f2b-4d89-b418-a433ab64fd1a tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:25.742502 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7bae4670-4f2b-4d89-b418-a433ab64fd1a tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: a3a6ce0f-e362-4cbc-afc2-3cfd349a4812] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:25.757060 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b3765a67-65de-41b6-81a5-fe5221c82671 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:25.758278 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b3765a67-65de-41b6-81a5-fe5221c82671 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:25.766113 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b3765a67-65de-41b6-81a5-fe5221c82671 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:25.772086 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b3765a67-65de-41b6-81a5-fe5221c82671 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:25.773059 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b3765a67-65de-41b6-81a5-fe5221c82671 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:25.773897 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b3765a67-65de-41b6-81a5-fe5221c82671 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:25.824659 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7bae4670-4f2b-4d89-b418-a433ab64fd1a tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:25.825637 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7bae4670-4f2b-4d89-b418-a433ab64fd1a tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:25.826053 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7bae4670-4f2b-4d89-b418-a433ab64fd1a tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:25.843324 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7bae4670-4f2b-4d89-b418-a433ab64fd1a tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:25.846395 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7bae4670-4f2b-4d89-b418-a433ab64fd1a tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:25.853812 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7bae4670-4f2b-4d89-b418-a433ab64fd1a tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:26.659628 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b3765a67-65de-41b6-81a5-fe5221c82671 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4cde361139445eb147c4f634ec663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5388c25cdb4a35ae8d58fa5b6cf125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:26.680482 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b3765a67-65de-41b6-81a5-fe5221c82671 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] 10.222.0.27 "GET /compute/v2.1/servers/7dac6a5f-62eb-4c60-8904-f23e50e1dcc8" status: 200 len: 1712 microversion: 2.1 time: 0.984017 Sep 08 10:41:26.702631 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 524/1132] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:25 2022] GET /compute/v2.1/servers/7dac6a5f-62eb-4c60-8904-f23e50e1dcc8 => generated 1712 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:41:26.739154 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b9004936-31af-460b-8bb5-b7df706b8e51 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:26.741149 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b9004936-31af-460b-8bb5-b7df706b8e51 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 2f4552b5-2e31-458b-b0f3-5bd551cc9ced] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:26.770516 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b9004936-31af-460b-8bb5-b7df706b8e51 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:26.774332 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b9004936-31af-460b-8bb5-b7df706b8e51 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:26.774979 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b9004936-31af-460b-8bb5-b7df706b8e51 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:26.779590 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b9004936-31af-460b-8bb5-b7df706b8e51 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:26.780758 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b9004936-31af-460b-8bb5-b7df706b8e51 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:26.781927 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b9004936-31af-460b-8bb5-b7df706b8e51 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:26.954418 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b9004936-31af-460b-8bb5-b7df706b8e51 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:26.969609 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b9004936-31af-460b-8bb5-b7df706b8e51 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/2f4552b5-2e31-458b-b0f3-5bd551cc9ced" status: 200 len: 1273 microversion: 2.1 time: 0.263178 Sep 08 10:41:26.976536 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 525/1133] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:26 2022] GET /compute/v2.1/servers/2f4552b5-2e31-458b-b0f3-5bd551cc9ced => generated 1273 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:41:27.007261 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-d29e40eb-fcbe-4351-87fe-cb9074199f15 req-d174ef27-06c1-44e1-8f2c-63cd23713965 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3a6ce0f-e362-4cbc-afc2-3cfd349a4812", "name": "network-vif-plugged", "status": "completed", "tag": "8ff15ca8-cc64-424e-b9f6-8f38b142e5ac"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:41:27.027444 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-d29e40eb-fcbe-4351-87fe-cb9074199f15 req-d174ef27-06c1-44e1-8f2c-63cd23713965 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:27.028666 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-d29e40eb-fcbe-4351-87fe-cb9074199f15 req-d174ef27-06c1-44e1-8f2c-63cd23713965 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:27.042871 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-d29e40eb-fcbe-4351-87fe-cb9074199f15 req-d174ef27-06c1-44e1-8f2c-63cd23713965 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:27.096549 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-d29e40eb-fcbe-4351-87fe-cb9074199f15 req-d174ef27-06c1-44e1-8f2c-63cd23713965 service nova] Creating event network-vif-plugged:8ff15ca8-cc64-424e-b9f6-8f38b142e5ac for instance a3a6ce0f-e362-4cbc-afc2-3cfd349a4812 on n-h1-850501-12 Sep 08 10:41:27.115939 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-d29e40eb-fcbe-4351-87fe-cb9074199f15 req-d174ef27-06c1-44e1-8f2c-63cd23713965 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136248 Sep 08 10:41:27.118199 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 526/1134] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:41:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:41:27.717408 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8794778e-4c89-4ce0-a1a7-618efdf61afc tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:27.718998 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8794778e-4c89-4ce0-a1a7-618efdf61afc tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] [instance: 7dac6a5f-62eb-4c60-8904-f23e50e1dcc8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:27.744230 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8794778e-4c89-4ce0-a1a7-618efdf61afc tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:27.745374 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8794778e-4c89-4ce0-a1a7-618efdf61afc tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:27.749124 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8794778e-4c89-4ce0-a1a7-618efdf61afc tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:27.750445 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8794778e-4c89-4ce0-a1a7-618efdf61afc tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:27.754273 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8794778e-4c89-4ce0-a1a7-618efdf61afc tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:27.755306 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8794778e-4c89-4ce0-a1a7-618efdf61afc tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:28.410792 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8794778e-4c89-4ce0-a1a7-618efdf61afc tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4cde361139445eb147c4f634ec663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5388c25cdb4a35ae8d58fa5b6cf125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:28.444260 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8794778e-4c89-4ce0-a1a7-618efdf61afc tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] 10.222.0.27 "GET /compute/v2.1/servers/7dac6a5f-62eb-4c60-8904-f23e50e1dcc8" status: 200 len: 1712 microversion: 2.1 time: 0.727085 Sep 08 10:41:28.448205 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 527/1135] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:27 2022] GET /compute/v2.1/servers/7dac6a5f-62eb-4c60-8904-f23e50e1dcc8 => generated 1712 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:41:28.494764 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d8f2ee10-97f8-4223-9f2f-0aa8ebd7ce77 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:28.497336 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d8f2ee10-97f8-4223-9f2f-0aa8ebd7ce77 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 2f4552b5-2e31-458b-b0f3-5bd551cc9ced] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:28.517941 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d8f2ee10-97f8-4223-9f2f-0aa8ebd7ce77 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:28.518688 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d8f2ee10-97f8-4223-9f2f-0aa8ebd7ce77 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:28.521483 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d8f2ee10-97f8-4223-9f2f-0aa8ebd7ce77 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:28.530505 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d8f2ee10-97f8-4223-9f2f-0aa8ebd7ce77 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:28.536720 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d8f2ee10-97f8-4223-9f2f-0aa8ebd7ce77 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:28.552934 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d8f2ee10-97f8-4223-9f2f-0aa8ebd7ce77 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:29.037546 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d8f2ee10-97f8-4223-9f2f-0aa8ebd7ce77 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:29.053855 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d8f2ee10-97f8-4223-9f2f-0aa8ebd7ce77 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/2f4552b5-2e31-458b-b0f3-5bd551cc9ced" status: 200 len: 1273 microversion: 2.1 time: 0.597162 Sep 08 10:41:29.054711 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 528/1136] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:28 2022] GET /compute/v2.1/servers/2f4552b5-2e31-458b-b0f3-5bd551cc9ced => generated 1273 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:41:29.083845 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-edbbe67e-589d-4ac0-88ac-8ad836da1862 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:29.085909 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-edbbe67e-589d-4ac0-88ac-8ad836da1862 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] [instance: 4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:29.093832 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-edbbe67e-589d-4ac0-88ac-8ad836da1862 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:29.101521 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-edbbe67e-589d-4ac0-88ac-8ad836da1862 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:29.101982 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-edbbe67e-589d-4ac0-88ac-8ad836da1862 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:29.102829 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-edbbe67e-589d-4ac0-88ac-8ad836da1862 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:29.106806 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-edbbe67e-589d-4ac0-88ac-8ad836da1862 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:29.107381 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-edbbe67e-589d-4ac0-88ac-8ad836da1862 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:29.134704 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7bae4670-4f2b-4d89-b418-a433ab64fd1a tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:29.142911 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7bae4670-4f2b-4d89-b418-a433ab64fd1a tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812" status: 200 len: 1378 microversion: 2.1 time: 3.412541 Sep 08 10:41:29.152007 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 609/1137] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:25 2022] GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812 => generated 1378 bytes in 3424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:41:29.415748 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-edbbe67e-589d-4ac0-88ac-8ad836da1862 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lazy-loading 'services' on Instance uuid 4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:41:29.448202 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-edbbe67e-589d-4ac0-88ac-8ad836da1862 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e" status: 200 len: 2419 microversion: 2.25 time: 0.390978 Sep 08 10:41:29.458222 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 529/1138] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:41:29 2022] GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e => generated 2419 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:41:29.485667 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3a4f5cdd-f366-4b0d-af25-41299e9b0d7d tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:29.487941 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3a4f5cdd-f366-4b0d-af25-41299e9b0d7d tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] [instance: 7dac6a5f-62eb-4c60-8904-f23e50e1dcc8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:29.489013 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7c35039f-aca3-446e-8d0d-d182a907206d tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-850501-12", "block_migration": "auto"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:41:29.491926 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7c35039f-aca3-446e-8d0d-d182a907206d tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] [instance: 4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:29.503025 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a4f5cdd-f366-4b0d-af25-41299e9b0d7d tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:29.510217 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a4f5cdd-f366-4b0d-af25-41299e9b0d7d tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:29.514021 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a4f5cdd-f366-4b0d-af25-41299e9b0d7d tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:29.515236 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a4f5cdd-f366-4b0d-af25-41299e9b0d7d tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:29.516835 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a4f5cdd-f366-4b0d-af25-41299e9b0d7d tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:29.521758 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a4f5cdd-f366-4b0d-af25-41299e9b0d7d tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:29.536605 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c35039f-aca3-446e-8d0d-d182a907206d tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:29.539394 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c35039f-aca3-446e-8d0d-d182a907206d tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:29.542319 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c35039f-aca3-446e-8d0d-d182a907206d tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:29.544498 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c35039f-aca3-446e-8d0d-d182a907206d tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:29.549615 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c35039f-aca3-446e-8d0d-d182a907206d tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:29.550289 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c35039f-aca3-446e-8d0d-d182a907206d tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:29.673519 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-7c35039f-aca3-446e-8d0d-d182a907206d tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lazy-loading 'flavor' on Instance uuid 4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:41:29.717554 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7c35039f-aca3-446e-8d0d-d182a907206d tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] [instance: 4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e] Going to try to live migrate instance to n-h2-850501-12 {{(pid=128861) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 08 10:41:29.949291 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3a4f5cdd-f366-4b0d-af25-41299e9b0d7d tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4cde361139445eb147c4f634ec663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5388c25cdb4a35ae8d58fa5b6cf125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:29.963005 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3a4f5cdd-f366-4b0d-af25-41299e9b0d7d tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] 10.222.0.27 "GET /compute/v2.1/servers/7dac6a5f-62eb-4c60-8904-f23e50e1dcc8" status: 200 len: 1712 microversion: 2.1 time: 0.484013 Sep 08 10:41:29.982741 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 610/1139] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:29 2022] GET /compute/v2.1/servers/7dac6a5f-62eb-4c60-8904-f23e50e1dcc8 => generated 1712 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:41:30.080443 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b77b5221-b6ce-4292-b838-abaeb9cf300c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:30.081092 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b77b5221-b6ce-4292-b838-abaeb9cf300c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 2f4552b5-2e31-458b-b0f3-5bd551cc9ced] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:30.103142 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b77b5221-b6ce-4292-b838-abaeb9cf300c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:30.104315 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b77b5221-b6ce-4292-b838-abaeb9cf300c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:30.104788 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b77b5221-b6ce-4292-b838-abaeb9cf300c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:30.117856 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b77b5221-b6ce-4292-b838-abaeb9cf300c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:30.118443 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b77b5221-b6ce-4292-b838-abaeb9cf300c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:30.118959 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b77b5221-b6ce-4292-b838-abaeb9cf300c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:30.856530 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b77b5221-b6ce-4292-b838-abaeb9cf300c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:30.881504 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b77b5221-b6ce-4292-b838-abaeb9cf300c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/2f4552b5-2e31-458b-b0f3-5bd551cc9ced" status: 200 len: 1273 microversion: 2.1 time: 0.805191 Sep 08 10:41:30.899330 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 611/1140] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:30 2022] GET /compute/v2.1/servers/2f4552b5-2e31-458b-b0f3-5bd551cc9ced => generated 1273 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:41:30.915625 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2f3eb222-9c94-4107-93f5-8597253369be tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:30.916578 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2f3eb222-9c94-4107-93f5-8597253369be tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: a3a6ce0f-e362-4cbc-afc2-3cfd349a4812] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:30.947623 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2f3eb222-9c94-4107-93f5-8597253369be tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:30.948454 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2f3eb222-9c94-4107-93f5-8597253369be tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:30.949697 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2f3eb222-9c94-4107-93f5-8597253369be tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:30.951679 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2f3eb222-9c94-4107-93f5-8597253369be tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:30.953504 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2f3eb222-9c94-4107-93f5-8597253369be tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:30.954411 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2f3eb222-9c94-4107-93f5-8597253369be tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:32.068280 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2f3eb222-9c94-4107-93f5-8597253369be tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:32.106402 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2f3eb222-9c94-4107-93f5-8597253369be tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812" status: 200 len: 1378 microversion: 2.1 time: 1.203353 Sep 08 10:41:32.125575 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 612/1141] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:30 2022] GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812 => generated 1378 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:41:32.127351 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-588c8fe0-0bd9-4c65-9937-9c555bc334e6 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:32.128122 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-588c8fe0-0bd9-4c65-9937-9c555bc334e6 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] [instance: 7dac6a5f-62eb-4c60-8904-f23e50e1dcc8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:32.139459 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-588c8fe0-0bd9-4c65-9937-9c555bc334e6 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:32.140076 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-588c8fe0-0bd9-4c65-9937-9c555bc334e6 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:32.140905 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-588c8fe0-0bd9-4c65-9937-9c555bc334e6 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:32.142422 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-588c8fe0-0bd9-4c65-9937-9c555bc334e6 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:32.142892 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-588c8fe0-0bd9-4c65-9937-9c555bc334e6 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:32.143333 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-588c8fe0-0bd9-4c65-9937-9c555bc334e6 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:32.354184 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-588c8fe0-0bd9-4c65-9937-9c555bc334e6 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4cde361139445eb147c4f634ec663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5388c25cdb4a35ae8d58fa5b6cf125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:32.393154 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-588c8fe0-0bd9-4c65-9937-9c555bc334e6 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] 10.222.0.27 "GET /compute/v2.1/servers/7dac6a5f-62eb-4c60-8904-f23e50e1dcc8" status: 200 len: 1645 microversion: 2.1 time: 0.275115 Sep 08 10:41:32.395484 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 613/1142] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:32 2022] GET /compute/v2.1/servers/7dac6a5f-62eb-4c60-8904-f23e50e1dcc8 => generated 1645 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:41:32.405136 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2ee9e0b7-cbcf-429c-9d44-1824319bc10c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:32.406325 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2ee9e0b7-cbcf-429c-9d44-1824319bc10c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 2f4552b5-2e31-458b-b0f3-5bd551cc9ced] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:32.414517 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2ee9e0b7-cbcf-429c-9d44-1824319bc10c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:32.415448 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2ee9e0b7-cbcf-429c-9d44-1824319bc10c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:32.416174 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2ee9e0b7-cbcf-429c-9d44-1824319bc10c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:32.417627 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2ee9e0b7-cbcf-429c-9d44-1824319bc10c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:32.418493 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2ee9e0b7-cbcf-429c-9d44-1824319bc10c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:32.419204 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2ee9e0b7-cbcf-429c-9d44-1824319bc10c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:32.631912 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2ee9e0b7-cbcf-429c-9d44-1824319bc10c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:32.643083 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2ee9e0b7-cbcf-429c-9d44-1824319bc10c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/2f4552b5-2e31-458b-b0f3-5bd551cc9ced" status: 200 len: 1273 microversion: 2.1 time: 0.243538 Sep 08 10:41:32.654436 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 614/1143] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:32 2022] GET /compute/v2.1/servers/2f4552b5-2e31-458b-b0f3-5bd551cc9ced => generated 1273 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:41:33.135986 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7c1b8b1e-d4e1-4992-9b34-0fb175ba2c61 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:33.146507 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7c1b8b1e-d4e1-4992-9b34-0fb175ba2c61 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: a3a6ce0f-e362-4cbc-afc2-3cfd349a4812] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:33.163934 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:41:33.189660 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c1b8b1e-d4e1-4992-9b34-0fb175ba2c61 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:33.190676 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c1b8b1e-d4e1-4992-9b34-0fb175ba2c61 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:33.195499 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c1b8b1e-d4e1-4992-9b34-0fb175ba2c61 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:33.196793 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c1b8b1e-d4e1-4992-9b34-0fb175ba2c61 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:33.199485 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c1b8b1e-d4e1-4992-9b34-0fb175ba2c61 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:33.201773 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c1b8b1e-d4e1-4992-9b34-0fb175ba2c61 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:33.564878 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=10 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:41:33.779303 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=4 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:41:34.183408 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7c1b8b1e-d4e1-4992-9b34-0fb175ba2c61 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:34.198522 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7c1b8b1e-d4e1-4992-9b34-0fb175ba2c61 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812" status: 200 len: 1528 microversion: 2.1 time: 1.067941 Sep 08 10:41:34.200019 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 615/1144] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:33 2022] GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812 => generated 1528 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:41:34.224377 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-048acb06-013b-42b1-b915-acec6e9d9624 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:34.227292 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-048acb06-013b-42b1-b915-acec6e9d9624 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] [instance: 7dac6a5f-62eb-4c60-8904-f23e50e1dcc8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:34.241757 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:41:34.243846 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-048acb06-013b-42b1-b915-acec6e9d9624 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:34.246589 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-048acb06-013b-42b1-b915-acec6e9d9624 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:34.248342 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-048acb06-013b-42b1-b915-acec6e9d9624 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:34.250915 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-048acb06-013b-42b1-b915-acec6e9d9624 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:34.253092 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-048acb06-013b-42b1-b915-acec6e9d9624 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:34.253829 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-048acb06-013b-42b1-b915-acec6e9d9624 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:34.295935 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7c35039f-aca3-446e-8d0d-d182a907206d tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e/action" status: 202 len: 0 microversion: 2.25 time: 4.811525 Sep 08 10:41:34.309165 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 530/1145] 10.222.0.27 () {62 vars in 1319 bytes} [Thu Sep 8 10:41:29 2022] POST /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e/action => generated 0 bytes in 4825 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:41:34.340771 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8dbcdf5d-5416-4112-b0ff-178e9e9fea92 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:34.349859 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8dbcdf5d-5416-4112-b0ff-178e9e9fea92 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 2f4552b5-2e31-458b-b0f3-5bd551cc9ced] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:34.406571 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8dbcdf5d-5416-4112-b0ff-178e9e9fea92 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:34.408846 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8dbcdf5d-5416-4112-b0ff-178e9e9fea92 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:34.412560 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8dbcdf5d-5416-4112-b0ff-178e9e9fea92 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:34.435021 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8dbcdf5d-5416-4112-b0ff-178e9e9fea92 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:34.436140 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8dbcdf5d-5416-4112-b0ff-178e9e9fea92 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:34.436845 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8dbcdf5d-5416-4112-b0ff-178e9e9fea92 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:34.619935 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-048acb06-013b-42b1-b915-acec6e9d9624 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4cde361139445eb147c4f634ec663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5388c25cdb4a35ae8d58fa5b6cf125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:34.629006 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-048acb06-013b-42b1-b915-acec6e9d9624 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] 10.222.0.27 "GET /compute/v2.1/servers/7dac6a5f-62eb-4c60-8904-f23e50e1dcc8" status: 200 len: 1645 microversion: 2.1 time: 0.427011 Sep 08 10:41:34.629995 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 616/1146] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:34 2022] GET /compute/v2.1/servers/7dac6a5f-62eb-4c60-8904-f23e50e1dcc8 => generated 1645 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:41:34.647900 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7a20e699-4726-4fe3-8271-d4e2be15a951 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:34.648529 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7a20e699-4726-4fe3-8271-d4e2be15a951 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: a3a6ce0f-e362-4cbc-afc2-3cfd349a4812] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:34.675480 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7a20e699-4726-4fe3-8271-d4e2be15a951 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:34.675982 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7a20e699-4726-4fe3-8271-d4e2be15a951 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:34.681697 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7a20e699-4726-4fe3-8271-d4e2be15a951 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:34.682714 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7a20e699-4726-4fe3-8271-d4e2be15a951 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:34.686474 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7a20e699-4726-4fe3-8271-d4e2be15a951 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:34.689215 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7a20e699-4726-4fe3-8271-d4e2be15a951 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:35.153927 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8dbcdf5d-5416-4112-b0ff-178e9e9fea92 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:35.189325 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8dbcdf5d-5416-4112-b0ff-178e9e9fea92 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/2f4552b5-2e31-458b-b0f3-5bd551cc9ced" status: 200 len: 1315 microversion: 2.1 time: 0.875345 Sep 08 10:41:35.198573 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 531/1147] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:34 2022] GET /compute/v2.1/servers/2f4552b5-2e31-458b-b0f3-5bd551cc9ced => generated 1315 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:41:35.221116 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ea1c0219-5452-4e06-a685-1f28fcb5fdfe tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:35.240155 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ea1c0219-5452-4e06-a685-1f28fcb5fdfe tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:35.269886 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ea1c0219-5452-4e06-a685-1f28fcb5fdfe tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:35.273288 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ea1c0219-5452-4e06-a685-1f28fcb5fdfe tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:35.273917 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ea1c0219-5452-4e06-a685-1f28fcb5fdfe tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:35.283387 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ea1c0219-5452-4e06-a685-1f28fcb5fdfe tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:35.283949 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ea1c0219-5452-4e06-a685-1f28fcb5fdfe tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:35.289454 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ea1c0219-5452-4e06-a685-1f28fcb5fdfe tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:35.643433 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7a20e699-4726-4fe3-8271-d4e2be15a951 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:35.661189 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7a20e699-4726-4fe3-8271-d4e2be15a951 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812" status: 200 len: 1528 microversion: 2.1 time: 1.029691 Sep 08 10:41:35.666458 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 617/1148] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:34 2022] GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812 => generated 1528 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:41:35.677060 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-971291a6-6030-4757-a5c2-977c92bd1116 req-47bb09b7-5e54-4ff3-b6fa-47e883ca86a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dac6a5f-62eb-4c60-8904-f23e50e1dcc8", "name": "network-vif-deleted", "tag": "629f2b6c-399c-4a00-a715-4e34d0f557fe"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:41:35.728208 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-971291a6-6030-4757-a5c2-977c92bd1116 req-47bb09b7-5e54-4ff3-b6fa-47e883ca86a4 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:35.730065 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-971291a6-6030-4757-a5c2-977c92bd1116 req-47bb09b7-5e54-4ff3-b6fa-47e883ca86a4 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:35.734731 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-971291a6-6030-4757-a5c2-977c92bd1116 req-47bb09b7-5e54-4ff3-b6fa-47e883ca86a4 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:35.830166 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-971291a6-6030-4757-a5c2-977c92bd1116 req-47bb09b7-5e54-4ff3-b6fa-47e883ca86a4 service nova] Creating event network-vif-deleted:629f2b6c-399c-4a00-a715-4e34d0f557fe for instance 7dac6a5f-62eb-4c60-8904-f23e50e1dcc8 on n-h1-850501-12 Sep 08 10:41:35.857384 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-971291a6-6030-4757-a5c2-977c92bd1116 req-47bb09b7-5e54-4ff3-b6fa-47e883ca86a4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.188037 Sep 08 10:41:35.862305 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 618/1149] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:41:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:41:35.890069 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5b83495b-eb7e-4b96-aafa-762fe2bae021 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:35.895763 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5b83495b-eb7e-4b96-aafa-762fe2bae021 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] [instance: 7dac6a5f-62eb-4c60-8904-f23e50e1dcc8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:35.929656 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b83495b-eb7e-4b96-aafa-762fe2bae021 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:35.930343 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b83495b-eb7e-4b96-aafa-762fe2bae021 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:35.933408 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b83495b-eb7e-4b96-aafa-762fe2bae021 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:35.934479 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b83495b-eb7e-4b96-aafa-762fe2bae021 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:35.936442 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b83495b-eb7e-4b96-aafa-762fe2bae021 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:35.941890 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b83495b-eb7e-4b96-aafa-762fe2bae021 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:36.080074 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b83495b-eb7e-4b96-aafa-762fe2bae021 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:36.080580 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b83495b-eb7e-4b96-aafa-762fe2bae021 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:36.085650 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b83495b-eb7e-4b96-aafa-762fe2bae021 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:36.086142 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-5b83495b-eb7e-4b96-aafa-762fe2bae021 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lazy-loading 'fault' on Instance uuid 7dac6a5f-62eb-4c60-8904-f23e50e1dcc8 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:41:36.138771 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ea1c0219-5452-4e06-a685-1f28fcb5fdfe tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:36.173842 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ea1c0219-5452-4e06-a685-1f28fcb5fdfe tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:36.185979 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ea1c0219-5452-4e06-a685-1f28fcb5fdfe tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:36.188877 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ea1c0219-5452-4e06-a685-1f28fcb5fdfe tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e" status: 200 len: 1810 microversion: 2.25 time: 0.988841 Sep 08 10:41:36.200193 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 532/1150] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:41:35 2022] GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e => generated 1810 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:41:36.213630 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-14e6f1bd-6e37-4d98-a74e-d220ec705cfd tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:36.257439 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-14e6f1bd-6e37-4d98-a74e-d220ec705cfd tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/73d2dc41-0ed5-4d71-96c5-c690131aa7dc" status: 202 len: 0 microversion: 2.1 time: 0.055079 Sep 08 10:41:36.260168 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 533/1151] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:41:36 2022] DELETE /compute/v2.1/flavors/73d2dc41-0ed5-4d71-96c5-c690131aa7dc => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:41:36.276615 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0e66d55f-8ce1-4b32-8453-88f645425a3b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:36.277697 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0e66d55f-8ce1-4b32-8453-88f645425a3b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 2f4552b5-2e31-458b-b0f3-5bd551cc9ced] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:36.291725 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e66d55f-8ce1-4b32-8453-88f645425a3b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:36.296117 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e66d55f-8ce1-4b32-8453-88f645425a3b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:36.301294 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e66d55f-8ce1-4b32-8453-88f645425a3b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:36.302470 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e66d55f-8ce1-4b32-8453-88f645425a3b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:36.303170 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e66d55f-8ce1-4b32-8453-88f645425a3b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:36.303840 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e66d55f-8ce1-4b32-8453-88f645425a3b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:36.343029 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:41:37.031307 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0e66d55f-8ce1-4b32-8453-88f645425a3b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:37.045799 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0e66d55f-8ce1-4b32-8453-88f645425a3b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/2f4552b5-2e31-458b-b0f3-5bd551cc9ced" status: 200 len: 1315 microversion: 2.1 time: 0.784184 Sep 08 10:41:37.049336 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 534/1152] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:36 2022] GET /compute/v2.1/servers/2f4552b5-2e31-458b-b0f3-5bd551cc9ced => generated 1315 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:41:37.060442 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-95e8a01a-2d54-44b6-9204-d0f239c2cef5 tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:37.086287 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5b83495b-eb7e-4b96-aafa-762fe2bae021 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4cde361139445eb147c4f634ec663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5388c25cdb4a35ae8d58fa5b6cf125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:37.105599 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5b83495b-eb7e-4b96-aafa-762fe2bae021 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] 10.222.0.27 "GET /compute/v2.1/servers/7dac6a5f-62eb-4c60-8904-f23e50e1dcc8" status: 200 len: 1353 microversion: 2.1 time: 1.238357 Sep 08 10:41:37.118389 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 619/1153] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:35 2022] GET /compute/v2.1/servers/7dac6a5f-62eb-4c60-8904-f23e50e1dcc8 => generated 1353 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:41:37.140026 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-95e8a01a-2d54-44b6-9204-d0f239c2cef5 tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.088405 Sep 08 10:41:37.141167 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 535/1154] 10.222.0.27 () {58 vars in 1146 bytes} [Thu Sep 8 10:41:37 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:41:37.164716 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f28f5639-7a04-4128-88a1-dd71851ecd1b tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:41:37.168477 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f28f5639-7a04-4128-88a1-dd71851ecd1b tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: a3a6ce0f-e362-4cbc-afc2-3cfd349a4812] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:37.188744 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f28f5639-7a04-4128-88a1-dd71851ecd1b tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:37.189561 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f28f5639-7a04-4128-88a1-dd71851ecd1b tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:37.190192 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f28f5639-7a04-4128-88a1-dd71851ecd1b tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:37.191169 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f28f5639-7a04-4128-88a1-dd71851ecd1b tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:37.191806 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f28f5639-7a04-4128-88a1-dd71851ecd1b tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:37.194737 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f28f5639-7a04-4128-88a1-dd71851ecd1b tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:37.223043 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e2db2015-4bd5-4d88-823c-1322d3b8560d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:37.224344 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e2db2015-4bd5-4d88-823c-1322d3b8560d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:37.239646 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e2db2015-4bd5-4d88-823c-1322d3b8560d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:37.245992 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e2db2015-4bd5-4d88-823c-1322d3b8560d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:37.248915 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e2db2015-4bd5-4d88-823c-1322d3b8560d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:37.249921 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e2db2015-4bd5-4d88-823c-1322d3b8560d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:37.254982 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e2db2015-4bd5-4d88-823c-1322d3b8560d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:37.255678 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e2db2015-4bd5-4d88-823c-1322d3b8560d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:37.306126 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f28f5639-7a04-4128-88a1-dd71851ecd1b tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:37.339713 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f28f5639-7a04-4128-88a1-dd71851ecd1b tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: a3a6ce0f-e362-4cbc-afc2-3cfd349a4812] Old instance type tempest-test_resize_flavor_-1114086924, new instance type m1.heat {{(pid=128862) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 08 10:41:37.391221 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-f28f5639-7a04-4128-88a1-dd71851ecd1b tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:41:37.391945 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-f28f5639-7a04-4128-88a1-dd71851ecd1b tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:41:37.396290 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-f28f5639-7a04-4128-88a1-dd71851ecd1b tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:41:37.397963 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-f28f5639-7a04-4128-88a1-dd71851ecd1b tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:41:37.399164 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-f28f5639-7a04-4128-88a1-dd71851ecd1b tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:41:37.553149 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f28f5639-7a04-4128-88a1-dd71851ecd1b tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "POST /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812/action" status: 202 len: 0 microversion: 2.1 time: 0.392265 Sep 08 10:41:37.555580 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 620/1155] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:41:37 2022] POST /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812/action => generated 0 bytes in 395 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 10:41:37.583135 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f2f1fee0-3278-4e05-9487-d4ffbd51ec13 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:37.584522 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f2f1fee0-3278-4e05-9487-d4ffbd51ec13 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: a3a6ce0f-e362-4cbc-afc2-3cfd349a4812] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:37.607158 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f2f1fee0-3278-4e05-9487-d4ffbd51ec13 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:37.611781 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f2f1fee0-3278-4e05-9487-d4ffbd51ec13 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:37.629494 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f2f1fee0-3278-4e05-9487-d4ffbd51ec13 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:37.630397 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f2f1fee0-3278-4e05-9487-d4ffbd51ec13 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:37.630897 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f2f1fee0-3278-4e05-9487-d4ffbd51ec13 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:37.639206 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f2f1fee0-3278-4e05-9487-d4ffbd51ec13 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:38.164637 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f2f1fee0-3278-4e05-9487-d4ffbd51ec13 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:38.178125 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f2f1fee0-3278-4e05-9487-d4ffbd51ec13 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812" status: 200 len: 1537 microversion: 2.1 time: 0.617257 Sep 08 10:41:38.199338 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 621/1156] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:37 2022] GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812 => generated 1537 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:41:38.212230 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-c44bfba1-3868-42f2-9b68-b41ff46b9c18 req-4941d23d-2c90-450f-8682-4ea550fa872a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f4552b5-2e31-458b-b0f3-5bd551cc9ced", "tag": "8a49fb6e-bf0b-42c4-b517-f48e7c1727ec"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:41:38.238792 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c44bfba1-3868-42f2-9b68-b41ff46b9c18 req-4941d23d-2c90-450f-8682-4ea550fa872a service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:38.242291 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c44bfba1-3868-42f2-9b68-b41ff46b9c18 req-4941d23d-2c90-450f-8682-4ea550fa872a service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:38.243462 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c44bfba1-3868-42f2-9b68-b41ff46b9c18 req-4941d23d-2c90-450f-8682-4ea550fa872a service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:38.274277 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-c44bfba1-3868-42f2-9b68-b41ff46b9c18 req-4941d23d-2c90-450f-8682-4ea550fa872a service nova] Creating event network-changed:8a49fb6e-bf0b-42c4-b517-f48e7c1727ec for instance 2f4552b5-2e31-458b-b0f3-5bd551cc9ced on n-h2-850501-12 Sep 08 10:41:38.295335 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-c44bfba1-3868-42f2-9b68-b41ff46b9c18 req-4941d23d-2c90-450f-8682-4ea550fa872a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093517 Sep 08 10:41:38.296174 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 622/1157] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:41:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:41:38.309045 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a52db703-9ca0-4f02-b7be-ffb04e6a31e8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:38.310232 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a52db703-9ca0-4f02-b7be-ffb04e6a31e8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 2f4552b5-2e31-458b-b0f3-5bd551cc9ced] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:38.317864 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a52db703-9ca0-4f02-b7be-ffb04e6a31e8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:38.318611 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a52db703-9ca0-4f02-b7be-ffb04e6a31e8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:38.319220 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a52db703-9ca0-4f02-b7be-ffb04e6a31e8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:38.320110 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a52db703-9ca0-4f02-b7be-ffb04e6a31e8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:38.320805 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a52db703-9ca0-4f02-b7be-ffb04e6a31e8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:38.321508 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a52db703-9ca0-4f02-b7be-ffb04e6a31e8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:38.917015 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a52db703-9ca0-4f02-b7be-ffb04e6a31e8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:38.927546 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a52db703-9ca0-4f02-b7be-ffb04e6a31e8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/2f4552b5-2e31-458b-b0f3-5bd551cc9ced" status: 200 len: 1315 microversion: 2.1 time: 0.625421 Sep 08 10:41:38.932945 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 623/1158] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:38 2022] GET /compute/v2.1/servers/2f4552b5-2e31-458b-b0f3-5bd551cc9ced => generated 1315 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:41:38.947373 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e2db2015-4bd5-4d88-823c-1322d3b8560d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:38.963130 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-77459555-386a-4ed8-a11a-715d95658120 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:38.970951 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e2db2015-4bd5-4d88-823c-1322d3b8560d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:38.972439 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-77459555-386a-4ed8-a11a-715d95658120 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] [instance: 7dac6a5f-62eb-4c60-8904-f23e50e1dcc8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:38.977169 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e2db2015-4bd5-4d88-823c-1322d3b8560d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:38.988598 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e2db2015-4bd5-4d88-823c-1322d3b8560d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e" status: 200 len: 1810 microversion: 2.25 time: 1.769006 Sep 08 10:41:38.998677 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-77459555-386a-4ed8-a11a-715d95658120 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:39.000063 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-77459555-386a-4ed8-a11a-715d95658120 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:39.002430 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-77459555-386a-4ed8-a11a-715d95658120 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:39.004247 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-77459555-386a-4ed8-a11a-715d95658120 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:39.004974 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-77459555-386a-4ed8-a11a-715d95658120 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:39.007102 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-77459555-386a-4ed8-a11a-715d95658120 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:39.013710 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 536/1159] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:41:37 2022] GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e => generated 1810 bytes in 1788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:41:39.062184 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-77459555-386a-4ed8-a11a-715d95658120 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] HTTP exception thrown: Instance 7dac6a5f-62eb-4c60-8904-f23e50e1dcc8 could not be found. Sep 08 10:41:39.064345 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-77459555-386a-4ed8-a11a-715d95658120 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Request method failure captured: Sep 08 10:41:39.064345 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/7dac6a5f-62eb-4c60-8904-f23e50e1dcc8 HTTP/1.1 Sep 08 10:41:39.064345 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:41:39.064345 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:41:39.064345 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:41:39.064345 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:41:39.064345 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:41:39.064345 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:41:39.064345 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:41:39.064345 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:41:39.064345 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcYJG7WOpsCapt7pguZ-6js1PZFEd6hTs8PoX2AEtryTJx7dFMIVdu1iT9vHc7EpR7BrROJHv3_XBHZbqSKBDzSerlP0SDLhJhWphMvpmQhEu4YvBwaI1QHlPx3Mm72Y87NlGhOgBhLtpCJuB0NkXITgVI6cGh0vHbgFxUCHaZeVIsc Sep 08 10:41:39.064345 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:41:39.064345 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:41:39.064345 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:41:39.064345 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:41:39.064345 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:41:39.064345 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:41:39.064345 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: de5388c25cdb4a35ae8d58fa5b6cf125 Sep 08 10:41:39.064345 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1901140458 Sep 08 10:41:39.064345 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:41:39.064345 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:41:39.064345 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/de5388c25cdb4a35ae8d58fa5b6cf125"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/de5388c25cdb4a35ae8d58fa5b6cf125"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_de5388c25cdb4a35ae8d58fa5b6cf125"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/de5388c25cdb4a35ae8d58fa5b6cf125"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:41:39.064345 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1901140458 Sep 08 10:41:39.064345 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: de5388c25cdb4a35ae8d58fa5b6cf125 Sep 08 10:41:39.064345 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1901140458 Sep 08 10:41:39.064345 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1901140458-project Sep 08 10:41:39.064345 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:41:39.064345 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:41:39.064345 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 6e4cde361139445eb147c4f634ec663f Sep 08 10:41:39.064345 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1901140458-project Sep 08 10:41:39.064345 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:41:39.064345 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 7dac6a5f-62eb-4c60-8904-f23e50e1dcc8 could not be found. Sep 08 10:41:39.064345 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '7dac6a5f-62eb-4c60-8904-f23e50e1dcc8'} Sep 08 10:41:39.064345 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:41:39.064345 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:41:39.064345 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:41:39.064345 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:41:39.064345 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:41:39.064345 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:41:39.064345 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:41:39.064345 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:41:39.064345 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:41:39.064345 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:41:39.064345 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7dac6a5f-62eb-4c60-8904-f23e50e1dcc8 could not be found. Sep 08 10:41:39.064345 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:41:39.064345 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:41:39.064345 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:41:39.064345 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:41:39.064345 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:41:39.064345 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:41:39.064345 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:41:39.064345 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:41:39.064345 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:41:39.064345 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:41:39.064345 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:41:39.064345 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:41:39.064345 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:41:39.064345 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:41:39.064345 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:41:39.064345 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:41:39.064345 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7dac6a5f-62eb-4c60-8904-f23e50e1dcc8 could not be found. Sep 08 10:41:39.064345 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:41:39.068980 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:41:39.068980 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:41:39.068980 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:41:39.068980 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:41:39.068980 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:41:39.068980 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:41:39.068980 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:41:39.068980 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7dac6a5f-62eb-4c60-8904-f23e50e1dcc8 could not be found. Sep 08 10:41:39.068980 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:41:39.079900 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-77459555-386a-4ed8-a11a-715d95658120 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Returning 404 to user: Instance 7dac6a5f-62eb-4c60-8904-f23e50e1dcc8 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:41:39.104859 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-77459555-386a-4ed8-a11a-715d95658120 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] 10.222.0.27 "GET /compute/v2.1/servers/7dac6a5f-62eb-4c60-8904-f23e50e1dcc8" status: 404 len: 111 microversion: 2.1 time: 0.165464 Sep 08 10:41:39.107432 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 624/1160] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:38 2022] GET /compute/v2.1/servers/7dac6a5f-62eb-4c60-8904-f23e50e1dcc8 => generated 111 bytes in 174 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:41:39.117948 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-27621756-6d26-401f-9dde-2f27fc42fdab tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:39.118708 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-27621756-6d26-401f-9dde-2f27fc42fdab tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] [instance: 1a01253b-8ff8-44d9-961b-1b91de83d671] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:39.129751 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-27621756-6d26-401f-9dde-2f27fc42fdab tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:39.130494 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-27621756-6d26-401f-9dde-2f27fc42fdab tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:39.132224 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-27621756-6d26-401f-9dde-2f27fc42fdab tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:39.133163 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-27621756-6d26-401f-9dde-2f27fc42fdab tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:39.135236 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-27621756-6d26-401f-9dde-2f27fc42fdab tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:39.138430 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-27621756-6d26-401f-9dde-2f27fc42fdab tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:39.199250 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-27621756-6d26-401f-9dde-2f27fc42fdab tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] HTTP exception thrown: Instance 1a01253b-8ff8-44d9-961b-1b91de83d671 could not be found. Sep 08 10:41:39.207987 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a611677a-9463-4de8-9323-54d709c332ad tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:39.209359 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a611677a-9463-4de8-9323-54d709c332ad tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: a3a6ce0f-e362-4cbc-afc2-3cfd349a4812] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:39.210216 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-27621756-6d26-401f-9dde-2f27fc42fdab tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Request method failure captured: Sep 08 10:41:39.210216 n-d-850501-12 devstack@n-api.service[128861]: request: DELETE /compute/v2.1/servers/1a01253b-8ff8-44d9-961b-1b91de83d671 HTTP/1.1 Sep 08 10:41:39.210216 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:41:39.210216 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:41:39.210216 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:41:39.210216 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:41:39.210216 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:41:39.210216 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:41:39.210216 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:41:39.210216 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:41:39.210216 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcYJG7WOpsCapt7pguZ-6js1PZFEd6hTs8PoX2AEtryTJx7dFMIVdu1iT9vHc7EpR7BrROJHv3_XBHZbqSKBDzSerlP0SDLhJhWphMvpmQhEu4YvBwaI1QHlPx3Mm72Y87NlGhOgBhLtpCJuB0NkXITgVI6cGh0vHbgFxUCHaZeVIsc Sep 08 10:41:39.210216 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:41:39.210216 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:41:39.210216 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:41:39.210216 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:41:39.210216 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:41:39.210216 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:41:39.210216 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: de5388c25cdb4a35ae8d58fa5b6cf125 Sep 08 10:41:39.210216 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1901140458 Sep 08 10:41:39.210216 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:41:39.210216 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:41:39.210216 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/de5388c25cdb4a35ae8d58fa5b6cf125"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/de5388c25cdb4a35ae8d58fa5b6cf125"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_de5388c25cdb4a35ae8d58fa5b6cf125"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/de5388c25cdb4a35ae8d58fa5b6cf125"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:41:39.210216 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1901140458 Sep 08 10:41:39.210216 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: de5388c25cdb4a35ae8d58fa5b6cf125 Sep 08 10:41:39.210216 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1901140458 Sep 08 10:41:39.210216 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1901140458-project Sep 08 10:41:39.210216 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:41:39.210216 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:41:39.210216 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 6e4cde361139445eb147c4f634ec663f Sep 08 10:41:39.210216 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1901140458-project Sep 08 10:41:39.210216 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:41:39.210216 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 1a01253b-8ff8-44d9-961b-1b91de83d671 could not be found. Sep 08 10:41:39.210216 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '1a01253b-8ff8-44d9-961b-1b91de83d671'} Sep 08 10:41:39.210216 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:41:39.210216 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:41:39.210216 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:41:39.210216 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:41:39.210216 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:41:39.210216 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:41:39.210216 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:41:39.210216 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:41:39.210216 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:41:39.210216 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:41:39.210216 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a01253b-8ff8-44d9-961b-1b91de83d671 could not be found. Sep 08 10:41:39.210216 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:41:39.210216 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:41:39.210216 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:41:39.210216 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:41:39.210216 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:41:39.210216 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:41:39.210216 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:41:39.210216 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:41:39.210216 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:41:39.210216 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:41:39.210216 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:41:39.210216 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:41:39.210216 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:41:39.210216 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:41:39.210216 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:41:39.210216 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:41:39.210216 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:41:39.210216 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:41:39.215229 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a01253b-8ff8-44d9-961b-1b91de83d671 could not be found. Sep 08 10:41:39.215229 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:41:39.215229 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:41:39.215229 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:41:39.215229 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:41:39.215229 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:41:39.215229 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:41:39.215229 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:41:39.215229 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:41:39.215229 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a01253b-8ff8-44d9-961b-1b91de83d671 could not be found. Sep 08 10:41:39.215229 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:41:39.220389 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-27621756-6d26-401f-9dde-2f27fc42fdab tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Returning 404 to user: Instance 1a01253b-8ff8-44d9-961b-1b91de83d671 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:41:39.224988 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-27621756-6d26-401f-9dde-2f27fc42fdab tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1a01253b-8ff8-44d9-961b-1b91de83d671" status: 404 len: 111 microversion: 2.1 time: 0.112447 Sep 08 10:41:39.231132 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a611677a-9463-4de8-9323-54d709c332ad tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:39.232431 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a611677a-9463-4de8-9323-54d709c332ad tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:39.232759 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 537/1161] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:41:39 2022] DELETE /compute/v2.1/servers/1a01253b-8ff8-44d9-961b-1b91de83d671 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:41:39.234445 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a611677a-9463-4de8-9323-54d709c332ad tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:39.239213 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a611677a-9463-4de8-9323-54d709c332ad tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:39.240792 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a611677a-9463-4de8-9323-54d709c332ad tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:39.244326 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a611677a-9463-4de8-9323-54d709c332ad tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:39.261474 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1836af79-0d18-40b8-8b74-8aef2820152e tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:39.262119 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1836af79-0d18-40b8-8b74-8aef2820152e tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] [instance: 1a01253b-8ff8-44d9-961b-1b91de83d671] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:39.300050 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1836af79-0d18-40b8-8b74-8aef2820152e tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:39.304028 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1836af79-0d18-40b8-8b74-8aef2820152e tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:39.306373 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1836af79-0d18-40b8-8b74-8aef2820152e tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:39.307447 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1836af79-0d18-40b8-8b74-8aef2820152e tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:39.309225 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1836af79-0d18-40b8-8b74-8aef2820152e tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:39.310373 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:41:39.311200 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1836af79-0d18-40b8-8b74-8aef2820152e tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:39.361509 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-1836af79-0d18-40b8-8b74-8aef2820152e tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] HTTP exception thrown: Instance 1a01253b-8ff8-44d9-961b-1b91de83d671 could not be found. Sep 08 10:41:39.372706 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1836af79-0d18-40b8-8b74-8aef2820152e tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Request method failure captured: Sep 08 10:41:39.372706 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/1a01253b-8ff8-44d9-961b-1b91de83d671 HTTP/1.1 Sep 08 10:41:39.372706 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:41:39.372706 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:41:39.372706 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:41:39.372706 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:41:39.372706 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:41:39.372706 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:41:39.372706 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:41:39.372706 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:41:39.372706 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcYJG7WOpsCapt7pguZ-6js1PZFEd6hTs8PoX2AEtryTJx7dFMIVdu1iT9vHc7EpR7BrROJHv3_XBHZbqSKBDzSerlP0SDLhJhWphMvpmQhEu4YvBwaI1QHlPx3Mm72Y87NlGhOgBhLtpCJuB0NkXITgVI6cGh0vHbgFxUCHaZeVIsc Sep 08 10:41:39.372706 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:41:39.372706 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:41:39.372706 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:41:39.372706 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:41:39.372706 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:41:39.372706 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:41:39.372706 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: de5388c25cdb4a35ae8d58fa5b6cf125 Sep 08 10:41:39.372706 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1901140458 Sep 08 10:41:39.372706 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:41:39.372706 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:41:39.372706 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/de5388c25cdb4a35ae8d58fa5b6cf125"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/de5388c25cdb4a35ae8d58fa5b6cf125"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_de5388c25cdb4a35ae8d58fa5b6cf125"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/de5388c25cdb4a35ae8d58fa5b6cf125"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:41:39.372706 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1901140458 Sep 08 10:41:39.372706 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: de5388c25cdb4a35ae8d58fa5b6cf125 Sep 08 10:41:39.372706 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1901140458 Sep 08 10:41:39.372706 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1901140458-project Sep 08 10:41:39.372706 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:41:39.372706 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:41:39.372706 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 6e4cde361139445eb147c4f634ec663f Sep 08 10:41:39.372706 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1901140458-project Sep 08 10:41:39.372706 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:41:39.372706 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 1a01253b-8ff8-44d9-961b-1b91de83d671 could not be found. Sep 08 10:41:39.372706 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '1a01253b-8ff8-44d9-961b-1b91de83d671'} Sep 08 10:41:39.372706 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:41:39.372706 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:41:39.372706 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:41:39.372706 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:41:39.372706 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:41:39.372706 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:41:39.372706 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:41:39.372706 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:41:39.372706 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:41:39.372706 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:41:39.372706 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a01253b-8ff8-44d9-961b-1b91de83d671 could not be found. Sep 08 10:41:39.372706 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:41:39.372706 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:41:39.372706 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:41:39.372706 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:41:39.372706 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:41:39.372706 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:41:39.372706 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:41:39.372706 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:41:39.372706 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:41:39.372706 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:41:39.372706 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:41:39.372706 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:41:39.372706 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:41:39.372706 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:41:39.372706 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:41:39.372706 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:41:39.372706 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a01253b-8ff8-44d9-961b-1b91de83d671 could not be found. Sep 08 10:41:39.372706 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:41:39.380012 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:41:39.380012 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:41:39.380012 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:41:39.380012 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:41:39.380012 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:41:39.380012 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:41:39.380012 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:41:39.380012 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a01253b-8ff8-44d9-961b-1b91de83d671 could not be found. Sep 08 10:41:39.380012 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:41:39.381586 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1836af79-0d18-40b8-8b74-8aef2820152e tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Returning 404 to user: Instance 1a01253b-8ff8-44d9-961b-1b91de83d671 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:41:39.382551 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1836af79-0d18-40b8-8b74-8aef2820152e tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] 10.222.0.27 "GET /compute/v2.1/servers/1a01253b-8ff8-44d9-961b-1b91de83d671" status: 404 len: 111 microversion: 2.1 time: 0.145473 Sep 08 10:41:39.386456 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 538/1162] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:39 2022] GET /compute/v2.1/servers/1a01253b-8ff8-44d9-961b-1b91de83d671 => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:41:39.391640 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8cad9fba-7da6-419b-bf10-501a9e11867c tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Calling method '.version_select at 0x7f68e46130d0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:39.448629 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8cad9fba-7da6-419b-bf10-501a9e11867c tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1011037597" status: 202 len: 0 microversion: 2.1 time: 0.060678 Sep 08 10:41:39.449246 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 539/1163] 10.222.0.27 () {58 vars in 1221 bytes} [Thu Sep 8 10:41:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1011037597 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 10:41:39.963940 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-db500f3f-c3f2-4234-ba3b-247ba0728d02 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:39.964625 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-db500f3f-c3f2-4234-ba3b-247ba0728d02 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 2f4552b5-2e31-458b-b0f3-5bd551cc9ced] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:39.977637 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-db500f3f-c3f2-4234-ba3b-247ba0728d02 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:39.978145 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-db500f3f-c3f2-4234-ba3b-247ba0728d02 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:39.978592 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-db500f3f-c3f2-4234-ba3b-247ba0728d02 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:39.979562 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-db500f3f-c3f2-4234-ba3b-247ba0728d02 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:39.980036 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-db500f3f-c3f2-4234-ba3b-247ba0728d02 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:39.980472 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-db500f3f-c3f2-4234-ba3b-247ba0728d02 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:40.272802 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a611677a-9463-4de8-9323-54d709c332ad tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:40.290907 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a611677a-9463-4de8-9323-54d709c332ad tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812" status: 200 len: 1537 microversion: 2.1 time: 1.089154 Sep 08 10:41:40.300796 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 625/1164] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:39 2022] GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812 => generated 1537 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:41:40.305910 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f975d1c9-9526-45f8-8fa2-77a52e6f7c48 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:40.306529 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f975d1c9-9526-45f8-8fa2-77a52e6f7c48 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:40.330051 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f975d1c9-9526-45f8-8fa2-77a52e6f7c48 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:40.330561 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f975d1c9-9526-45f8-8fa2-77a52e6f7c48 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:40.331676 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f975d1c9-9526-45f8-8fa2-77a52e6f7c48 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:40.333777 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f975d1c9-9526-45f8-8fa2-77a52e6f7c48 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:40.334253 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f975d1c9-9526-45f8-8fa2-77a52e6f7c48 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:40.334690 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f975d1c9-9526-45f8-8fa2-77a52e6f7c48 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:41.133804 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-db500f3f-c3f2-4234-ba3b-247ba0728d02 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:41.150292 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-db500f3f-c3f2-4234-ba3b-247ba0728d02 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/2f4552b5-2e31-458b-b0f3-5bd551cc9ced" status: 200 len: 1315 microversion: 2.1 time: 1.191178 Sep 08 10:41:41.152643 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 540/1165] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:39 2022] GET /compute/v2.1/servers/2f4552b5-2e31-458b-b0f3-5bd551cc9ced => generated 1315 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:41:41.157432 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-32a0c29a-b844-4182-a8af-5f7dd1118e48 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:41.166914 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-32a0c29a-b844-4182-a8af-5f7dd1118e48 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] [instance: 133a5f12-39e5-4e0f-81dc-b1948c073f15] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:41.193551 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-32a0c29a-b844-4182-a8af-5f7dd1118e48 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:41.194064 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-32a0c29a-b844-4182-a8af-5f7dd1118e48 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:41.194506 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-32a0c29a-b844-4182-a8af-5f7dd1118e48 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:41.209868 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-32a0c29a-b844-4182-a8af-5f7dd1118e48 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:41.210661 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-32a0c29a-b844-4182-a8af-5f7dd1118e48 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:41.211272 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-32a0c29a-b844-4182-a8af-5f7dd1118e48 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:41.526549 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f975d1c9-9526-45f8-8fa2-77a52e6f7c48 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:41.544645 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f975d1c9-9526-45f8-8fa2-77a52e6f7c48 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:41.552190 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f975d1c9-9526-45f8-8fa2-77a52e6f7c48 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:41.561438 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f975d1c9-9526-45f8-8fa2-77a52e6f7c48 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e" status: 200 len: 1810 microversion: 2.25 time: 1.259109 Sep 08 10:41:41.562456 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 626/1166] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:41:40 2022] GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e => generated 1810 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:41:41.609780 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ea916f4f-e155-4607-9fce-00e7fba82468 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:41.614031 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ea916f4f-e155-4607-9fce-00e7fba82468 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: a3a6ce0f-e362-4cbc-afc2-3cfd349a4812] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:41.623495 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea916f4f-e155-4607-9fce-00e7fba82468 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:41.624373 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea916f4f-e155-4607-9fce-00e7fba82468 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:41.626389 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea916f4f-e155-4607-9fce-00e7fba82468 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:41.657957 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea916f4f-e155-4607-9fce-00e7fba82468 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:41.659544 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea916f4f-e155-4607-9fce-00e7fba82468 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:41.664348 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea916f4f-e155-4607-9fce-00e7fba82468 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:41.897497 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-32a0c29a-b844-4182-a8af-5f7dd1118e48 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15" status: 200 len: 1861 microversion: 2.1 time: 0.743466 Sep 08 10:41:41.929153 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 541/1167] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:41 2022] GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15 => generated 1861 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:41:41.934844 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9235461b-d56b-4ca6-af67-f8de14ca3ec4 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-850501-12", "block_migration": true, "disk_over_commit": false}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:41:41.939799 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9235461b-d56b-4ca6-af67-f8de14ca3ec4 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] [instance: 133a5f12-39e5-4e0f-81dc-b1948c073f15] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:41.948686 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9235461b-d56b-4ca6-af67-f8de14ca3ec4 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:41.949631 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9235461b-d56b-4ca6-af67-f8de14ca3ec4 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:41.950464 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9235461b-d56b-4ca6-af67-f8de14ca3ec4 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:41.952887 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9235461b-d56b-4ca6-af67-f8de14ca3ec4 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:41.953647 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9235461b-d56b-4ca6-af67-f8de14ca3ec4 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:41.954343 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9235461b-d56b-4ca6-af67-f8de14ca3ec4 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:42.030793 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-9235461b-d56b-4ca6-af67-f8de14ca3ec4 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lazy-loading 'flavor' on Instance uuid 133a5f12-39e5-4e0f-81dc-b1948c073f15 {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:41:42.075049 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9235461b-d56b-4ca6-af67-f8de14ca3ec4 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] [instance: 133a5f12-39e5-4e0f-81dc-b1948c073f15] Going to try to live migrate instance to n-h1-850501-12 {{(pid=128861) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 08 10:41:43.611388 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ea916f4f-e155-4607-9fce-00e7fba82468 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:43.624341 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ea916f4f-e155-4607-9fce-00e7fba82468 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812" status: 200 len: 1537 microversion: 2.1 time: 2.025972 Sep 08 10:41:43.632704 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 627/1168] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:41 2022] GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812 => generated 1537 bytes in 2036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:41:43.638355 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0ede6f0b-0a0b-4272-b11f-8642a63c9e96 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:43.639002 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0ede6f0b-0a0b-4272-b11f-8642a63c9e96 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 2f4552b5-2e31-458b-b0f3-5bd551cc9ced] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:43.678911 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ede6f0b-0a0b-4272-b11f-8642a63c9e96 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:43.684303 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ede6f0b-0a0b-4272-b11f-8642a63c9e96 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:43.688204 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ede6f0b-0a0b-4272-b11f-8642a63c9e96 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:43.695356 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ede6f0b-0a0b-4272-b11f-8642a63c9e96 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:43.705422 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ede6f0b-0a0b-4272-b11f-8642a63c9e96 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:43.706700 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ede6f0b-0a0b-4272-b11f-8642a63c9e96 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:46.617789 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0ede6f0b-0a0b-4272-b11f-8642a63c9e96 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:46.630695 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0ede6f0b-0a0b-4272-b11f-8642a63c9e96 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/2f4552b5-2e31-458b-b0f3-5bd551cc9ced" status: 200 len: 1315 microversion: 2.1 time: 2.996123 Sep 08 10:41:46.636420 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 628/1169] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:43 2022] GET /compute/v2.1/servers/2f4552b5-2e31-458b-b0f3-5bd551cc9ced => generated 1315 bytes in 3003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:41:46.649960 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9312aacf-671f-4f3a-a258-6fb487c14d49 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:46.652431 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9312aacf-671f-4f3a-a258-6fb487c14d49 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:46.670334 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9312aacf-671f-4f3a-a258-6fb487c14d49 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:46.671262 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9312aacf-671f-4f3a-a258-6fb487c14d49 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:46.671711 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9312aacf-671f-4f3a-a258-6fb487c14d49 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:46.672449 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9312aacf-671f-4f3a-a258-6fb487c14d49 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:46.676506 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9312aacf-671f-4f3a-a258-6fb487c14d49 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:46.677247 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9312aacf-671f-4f3a-a258-6fb487c14d49 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:46.749522 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9235461b-d56b-4ca6-af67-f8de14ca3ec4 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15/action" status: 202 len: 0 microversion: 2.1 time: 4.818484 Sep 08 10:41:46.754333 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 542/1170] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:41:41 2022] POST /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15/action => generated 0 bytes in 4820 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:41:46.965102 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a692a61b-e305-40d2-bf0d-2f4bbdab88b6 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-132576610", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "286d91cd-2056-494a-8a93-8b799c5e8527"}]}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:41:47.481972 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-a692a61b-e305-40d2-bf0d-2f4bbdab88b6 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] validate_networks() for [('286d91cd-2056-494a-8a93-8b799c5e8527', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:41:48.019676 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9312aacf-671f-4f3a-a258-6fb487c14d49 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:48.039817 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9312aacf-671f-4f3a-a258-6fb487c14d49 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:48.048963 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9312aacf-671f-4f3a-a258-6fb487c14d49 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:48.055599 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9312aacf-671f-4f3a-a258-6fb487c14d49 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e" status: 200 len: 1810 microversion: 2.25 time: 1.417011 Sep 08 10:41:48.085211 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 629/1171] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:41:46 2022] GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e => generated 1810 bytes in 1448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:41:48.090080 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-49ba388e-7ef3-4c9e-9980-f5d2b0eb3a83 tempest-ServersWithSpecificFlavorTestJSON-1768133948 tempest-ServersWithSpecificFlavorTestJSON-1768133948-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:48.119052 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-a692a61b-e305-40d2-bf0d-2f4bbdab88b6 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:41:48.119542 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-a692a61b-e305-40d2-bf0d-2f4bbdab88b6 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:41:48.120058 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-a692a61b-e305-40d2-bf0d-2f4bbdab88b6 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:41:48.120543 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-a692a61b-e305-40d2-bf0d-2f4bbdab88b6 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:41:48.120961 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-a692a61b-e305-40d2-bf0d-2f4bbdab88b6 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:41:48.138817 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a692a61b-e305-40d2-bf0d-2f4bbdab88b6 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:48.144082 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-49ba388e-7ef3-4c9e-9980-f5d2b0eb3a83 tempest-ServersWithSpecificFlavorTestJSON-1768133948 tempest-ServersWithSpecificFlavorTestJSON-1768133948-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1000307758" status: 202 len: 0 microversion: 2.1 time: 0.056542 Sep 08 10:41:48.145461 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 630/1172] 10.222.0.27 () {58 vars in 1161 bytes} [Thu Sep 8 10:41:48 2022] DELETE /compute/v2.1/flavors/1000307758 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:41:48.146114 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a692a61b-e305-40d2-bf0d-2f4bbdab88b6 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:48.149086 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a692a61b-e305-40d2-bf0d-2f4bbdab88b6 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:48.150005 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a692a61b-e305-40d2-bf0d-2f4bbdab88b6 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:48.151750 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a692a61b-e305-40d2-bf0d-2f4bbdab88b6 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:48.152240 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7b76e6c6-cba6-4eda-bc91-8ac152231709 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:48.153139 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7b76e6c6-cba6-4eda-bc91-8ac152231709 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: a3a6ce0f-e362-4cbc-afc2-3cfd349a4812] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:48.160381 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7b76e6c6-cba6-4eda-bc91-8ac152231709 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:48.161248 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7b76e6c6-cba6-4eda-bc91-8ac152231709 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:48.162047 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7b76e6c6-cba6-4eda-bc91-8ac152231709 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:48.163054 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7b76e6c6-cba6-4eda-bc91-8ac152231709 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:48.163503 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a692a61b-e305-40d2-bf0d-2f4bbdab88b6 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:48.163929 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7b76e6c6-cba6-4eda-bc91-8ac152231709 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:48.164557 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7b76e6c6-cba6-4eda-bc91-8ac152231709 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:48.220118 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-a692a61b-e305-40d2-bf0d-2f4bbdab88b6 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Getting quotas for project c8d59ac71b6f459ea38d5ddc24964216. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:41:48.236340 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-a692a61b-e305-40d2-bf0d-2f4bbdab88b6 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Getting quotas for user 7ae3291d8d8f40dc98be9c965ba86adf and project c8d59ac71b6f459ea38d5ddc24964216. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:41:48.256704 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a692a61b-e305-40d2-bf0d-2f4bbdab88b6 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:41:48.259892 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a692a61b-e305-40d2-bf0d-2f4bbdab88b6 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] [instance: 26218db4-d06e-4ae2-8f15-f21004ce13b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:41:48.378574 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a692a61b-e305-40d2-bf0d-2f4bbdab88b6 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.617743 Sep 08 10:41:48.388142 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 543/1173] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:41:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:41:48.414990 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7c773be8-a538-4674-9c2c-2ee1ffbc8ade tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:48.419852 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7c773be8-a538-4674-9c2c-2ee1ffbc8ade tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 133a5f12-39e5-4e0f-81dc-b1948c073f15] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:48.457441 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c773be8-a538-4674-9c2c-2ee1ffbc8ade tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:48.458269 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c773be8-a538-4674-9c2c-2ee1ffbc8ade tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:48.458269 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c773be8-a538-4674-9c2c-2ee1ffbc8ade tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:48.459389 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c773be8-a538-4674-9c2c-2ee1ffbc8ade tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:48.459818 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c773be8-a538-4674-9c2c-2ee1ffbc8ade tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:48.461345 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c773be8-a538-4674-9c2c-2ee1ffbc8ade tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:48.821417 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7c773be8-a538-4674-9c2c-2ee1ffbc8ade tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:48.833588 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7c773be8-a538-4674-9c2c-2ee1ffbc8ade tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15" status: 200 len: 1718 microversion: 2.1 time: 0.443437 Sep 08 10:41:48.836467 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 544/1174] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:48 2022] GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15 => generated 1718 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:41:48.871890 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-069f4ddc-2fec-4e81-b26e-bebcb52ed5c6 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:48.875356 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-069f4ddc-2fec-4e81-b26e-bebcb52ed5c6 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 2f4552b5-2e31-458b-b0f3-5bd551cc9ced] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:48.889997 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-069f4ddc-2fec-4e81-b26e-bebcb52ed5c6 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:48.890709 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-069f4ddc-2fec-4e81-b26e-bebcb52ed5c6 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:48.891906 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-069f4ddc-2fec-4e81-b26e-bebcb52ed5c6 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:48.895562 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-069f4ddc-2fec-4e81-b26e-bebcb52ed5c6 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:48.898468 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-069f4ddc-2fec-4e81-b26e-bebcb52ed5c6 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:48.899098 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-069f4ddc-2fec-4e81-b26e-bebcb52ed5c6 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:49.262712 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-069f4ddc-2fec-4e81-b26e-bebcb52ed5c6 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:49.272807 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-069f4ddc-2fec-4e81-b26e-bebcb52ed5c6 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/2f4552b5-2e31-458b-b0f3-5bd551cc9ced" status: 200 len: 1315 microversion: 2.1 time: 0.418576 Sep 08 10:41:49.274008 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 545/1175] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:48 2022] GET /compute/v2.1/servers/2f4552b5-2e31-458b-b0f3-5bd551cc9ced => generated 1315 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:41:49.278945 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c65ee38a-c598-4043-972c-7710610d6aab tempest-ServersWithSpecificFlavorTestJSON-1768133948 tempest-ServersWithSpecificFlavorTestJSON-1768133948-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:49.307440 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c65ee38a-c598-4043-972c-7710610d6aab tempest-ServersWithSpecificFlavorTestJSON-1768133948 tempest-ServersWithSpecificFlavorTestJSON-1768133948-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5402 microversion: 2.1 time: 0.032042 Sep 08 10:41:49.308535 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 546/1176] 10.222.0.27 () {58 vars in 1146 bytes} [Thu Sep 8 10:41:49 2022] GET /compute/v2.1/flavors/detail => generated 5402 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:41:49.314270 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-151fe0b3-bdcc-4c5a-a9da-2300d6b1707d tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:49.315872 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-151fe0b3-bdcc-4c5a-a9da-2300d6b1707d tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] [instance: 26218db4-d06e-4ae2-8f15-f21004ce13b3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:49.415272 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-151fe0b3-bdcc-4c5a-a9da-2300d6b1707d tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae3291d8d8f40dc98be9c965ba86adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d59ac71b6f459ea38d5ddc24964216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:49.428487 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-151fe0b3-bdcc-4c5a-a9da-2300d6b1707d tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] 10.222.0.27 "GET /compute/v2.1/servers/26218db4-d06e-4ae2-8f15-f21004ce13b3" status: 200 len: 1216 microversion: 2.1 time: 0.117011 Sep 08 10:41:49.452059 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 547/1177] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:49 2022] GET /compute/v2.1/servers/26218db4-d06e-4ae2-8f15-f21004ce13b3 => generated 1216 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:41:49.465572 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b2a02821-0b68-459b-8787-3be0a57dc126 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:49.467893 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b2a02821-0b68-459b-8787-3be0a57dc126 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:49.490051 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7b76e6c6-cba6-4eda-bc91-8ac152231709 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:49.518091 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b2a02821-0b68-459b-8787-3be0a57dc126 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:49.519838 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b2a02821-0b68-459b-8787-3be0a57dc126 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:49.522022 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b2a02821-0b68-459b-8787-3be0a57dc126 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:49.524390 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b2a02821-0b68-459b-8787-3be0a57dc126 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:49.525092 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b2a02821-0b68-459b-8787-3be0a57dc126 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:49.527198 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b2a02821-0b68-459b-8787-3be0a57dc126 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:49.537748 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7b76e6c6-cba6-4eda-bc91-8ac152231709 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812" status: 200 len: 1542 microversion: 2.1 time: 1.385451 Sep 08 10:41:49.538404 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 631/1178] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:48 2022] GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812 => generated 1542 bytes in 1392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:41:49.554120 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ee0946b3-dbd1-4f84-acf0-b5f584942fed tempest-ServersWithSpecificFlavorTestJSON-1768133948 tempest-ServersWithSpecificFlavorTestJSON-1768133948-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:49.632913 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ee0946b3-dbd1-4f84-acf0-b5f584942fed tempest-ServersWithSpecificFlavorTestJSON-1768133948 tempest-ServersWithSpecificFlavorTestJSON-1768133948-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/528789528" status: 202 len: 0 microversion: 2.1 time: 0.089794 Sep 08 10:41:49.633848 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 632/1179] 10.222.0.27 () {58 vars in 1158 bytes} [Thu Sep 8 10:41:49 2022] DELETE /compute/v2.1/flavors/528789528 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:41:49.649160 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ff92fe71-f4c2-4913-a1cc-16ebf2ea1638 tempest-ServersWithSpecificFlavorTestJSON-1768133948 tempest-ServersWithSpecificFlavorTestJSON-1768133948-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:49.730471 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ff92fe71-f4c2-4913-a1cc-16ebf2ea1638 tempest-ServersWithSpecificFlavorTestJSON-1768133948 tempest-ServersWithSpecificFlavorTestJSON-1768133948-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.086006 Sep 08 10:41:49.761713 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 633/1180] 10.222.0.27 () {58 vars in 1146 bytes} [Thu Sep 8 10:41:49 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:41:49.781327 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-eb561d3b-75f5-4b6c-8aab-81286c8db247 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:49.782093 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-eb561d3b-75f5-4b6c-8aab-81286c8db247 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] [instance: 7dac6a5f-62eb-4c60-8904-f23e50e1dcc8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:49.794730 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb561d3b-75f5-4b6c-8aab-81286c8db247 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:49.798740 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb561d3b-75f5-4b6c-8aab-81286c8db247 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:49.801002 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb561d3b-75f5-4b6c-8aab-81286c8db247 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:49.802491 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb561d3b-75f5-4b6c-8aab-81286c8db247 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:49.803194 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb561d3b-75f5-4b6c-8aab-81286c8db247 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:49.803807 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb561d3b-75f5-4b6c-8aab-81286c8db247 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:49.829772 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-eb561d3b-75f5-4b6c-8aab-81286c8db247 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] HTTP exception thrown: Instance 7dac6a5f-62eb-4c60-8904-f23e50e1dcc8 could not be found. Sep 08 10:41:49.832799 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-eb561d3b-75f5-4b6c-8aab-81286c8db247 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Request method failure captured: Sep 08 10:41:49.832799 n-d-850501-12 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/servers/7dac6a5f-62eb-4c60-8904-f23e50e1dcc8 HTTP/1.1 Sep 08 10:41:49.832799 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:41:49.832799 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:41:49.832799 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:41:49.832799 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:41:49.832799 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:41:49.832799 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:41:49.832799 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:41:49.832799 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:41:49.832799 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcYJG7WOpsCapt7pguZ-6js1PZFEd6hTs8PoX2AEtryTJx7dFMIVdu1iT9vHc7EpR7BrROJHv3_XBHZbqSKBDzSerlP0SDLhJhWphMvpmQhEu4YvBwaI1QHlPx3Mm72Y87NlGhOgBhLtpCJuB0NkXITgVI6cGh0vHbgFxUCHaZeVIsc Sep 08 10:41:49.832799 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:41:49.832799 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:41:49.832799 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:41:49.832799 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:41:49.832799 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:41:49.832799 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:41:49.832799 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: de5388c25cdb4a35ae8d58fa5b6cf125 Sep 08 10:41:49.832799 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1901140458 Sep 08 10:41:49.832799 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:41:49.832799 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:41:49.832799 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/de5388c25cdb4a35ae8d58fa5b6cf125"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/de5388c25cdb4a35ae8d58fa5b6cf125"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_de5388c25cdb4a35ae8d58fa5b6cf125"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/de5388c25cdb4a35ae8d58fa5b6cf125"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:41:49.832799 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1901140458 Sep 08 10:41:49.832799 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: de5388c25cdb4a35ae8d58fa5b6cf125 Sep 08 10:41:49.832799 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1901140458 Sep 08 10:41:49.832799 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1901140458-project Sep 08 10:41:49.832799 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:41:49.832799 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:41:49.832799 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 6e4cde361139445eb147c4f634ec663f Sep 08 10:41:49.832799 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1901140458-project Sep 08 10:41:49.832799 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:41:49.832799 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 7dac6a5f-62eb-4c60-8904-f23e50e1dcc8 could not be found. Sep 08 10:41:49.832799 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '7dac6a5f-62eb-4c60-8904-f23e50e1dcc8'} Sep 08 10:41:49.832799 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:41:49.832799 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:41:49.832799 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:41:49.832799 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:41:49.832799 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:41:49.832799 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:41:49.832799 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:41:49.832799 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:41:49.832799 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:41:49.832799 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:41:49.832799 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7dac6a5f-62eb-4c60-8904-f23e50e1dcc8 could not be found. Sep 08 10:41:49.832799 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:41:49.832799 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:41:49.832799 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:41:49.832799 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:41:49.832799 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:41:49.832799 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:41:49.832799 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:41:49.832799 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:41:49.832799 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:41:49.832799 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:41:49.832799 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:41:49.832799 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:41:49.832799 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:41:49.832799 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:41:49.832799 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:41:49.832799 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:41:49.832799 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:41:49.832799 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:41:49.837275 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7dac6a5f-62eb-4c60-8904-f23e50e1dcc8 could not be found. Sep 08 10:41:49.837275 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:41:49.837275 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:41:49.837275 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:41:49.837275 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:41:49.837275 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:41:49.837275 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:41:49.837275 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:41:49.837275 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:41:49.837275 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7dac6a5f-62eb-4c60-8904-f23e50e1dcc8 could not be found. Sep 08 10:41:49.837275 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:41:49.839437 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-eb561d3b-75f5-4b6c-8aab-81286c8db247 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Returning 404 to user: Instance 7dac6a5f-62eb-4c60-8904-f23e50e1dcc8 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:41:49.840599 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-eb561d3b-75f5-4b6c-8aab-81286c8db247 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7dac6a5f-62eb-4c60-8904-f23e50e1dcc8" status: 404 len: 111 microversion: 2.1 time: 0.063658 Sep 08 10:41:49.844785 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 634/1181] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:41:49 2022] DELETE /compute/v2.1/servers/7dac6a5f-62eb-4c60-8904-f23e50e1dcc8 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:41:49.852645 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-442c8f97-0af8-4928-bef1-42afbd07fac1 req-44a503cc-4b58-4c16-ac14-ee28b4baa616 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f4552b5-2e31-458b-b0f3-5bd551cc9ced", "name": "network-vif-plugged", "status": "completed", "tag": "8a49fb6e-bf0b-42c4-b517-f48e7c1727ec"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:41:49.867394 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-442c8f97-0af8-4928-bef1-42afbd07fac1 req-44a503cc-4b58-4c16-ac14-ee28b4baa616 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:49.868199 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-442c8f97-0af8-4928-bef1-42afbd07fac1 req-44a503cc-4b58-4c16-ac14-ee28b4baa616 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:49.868928 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-442c8f97-0af8-4928-bef1-42afbd07fac1 req-44a503cc-4b58-4c16-ac14-ee28b4baa616 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:49.883867 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-442c8f97-0af8-4928-bef1-42afbd07fac1 req-44a503cc-4b58-4c16-ac14-ee28b4baa616 service nova] Creating event network-vif-plugged:8a49fb6e-bf0b-42c4-b517-f48e7c1727ec for instance 2f4552b5-2e31-458b-b0f3-5bd551cc9ced on n-h2-850501-12 Sep 08 10:41:49.898171 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-442c8f97-0af8-4928-bef1-42afbd07fac1 req-44a503cc-4b58-4c16-ac14-ee28b4baa616 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050328 Sep 08 10:41:49.900212 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 635/1182] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:41:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:41:49.933374 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fe9e5278-4366-436f-a6e3-140219f284b0 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:49.934799 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fe9e5278-4366-436f-a6e3-140219f284b0 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] [instance: 7dac6a5f-62eb-4c60-8904-f23e50e1dcc8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:49.954321 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fe9e5278-4366-436f-a6e3-140219f284b0 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:49.957267 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fe9e5278-4366-436f-a6e3-140219f284b0 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:49.962633 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fe9e5278-4366-436f-a6e3-140219f284b0 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:49.965154 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fe9e5278-4366-436f-a6e3-140219f284b0 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:49.966980 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fe9e5278-4366-436f-a6e3-140219f284b0 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:49.967611 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fe9e5278-4366-436f-a6e3-140219f284b0 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:49.970319 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b2a02821-0b68-459b-8787-3be0a57dc126 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:49.989949 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b2a02821-0b68-459b-8787-3be0a57dc126 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:50.002818 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b2a02821-0b68-459b-8787-3be0a57dc126 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:50.009921 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b2a02821-0b68-459b-8787-3be0a57dc126 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e" status: 200 len: 1810 microversion: 2.25 time: 0.554596 Sep 08 10:41:50.012049 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 548/1183] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:41:49 2022] GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e => generated 1810 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:41:50.019136 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-fe9e5278-4366-436f-a6e3-140219f284b0 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] HTTP exception thrown: Instance 7dac6a5f-62eb-4c60-8904-f23e50e1dcc8 could not be found. Sep 08 10:41:50.020831 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fe9e5278-4366-436f-a6e3-140219f284b0 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Request method failure captured: Sep 08 10:41:50.020831 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/7dac6a5f-62eb-4c60-8904-f23e50e1dcc8 HTTP/1.1 Sep 08 10:41:50.020831 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:41:50.020831 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:41:50.020831 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:41:50.020831 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:41:50.020831 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:41:50.020831 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:41:50.020831 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:41:50.020831 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:41:50.020831 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcYJG7WOpsCapt7pguZ-6js1PZFEd6hTs8PoX2AEtryTJx7dFMIVdu1iT9vHc7EpR7BrROJHv3_XBHZbqSKBDzSerlP0SDLhJhWphMvpmQhEu4YvBwaI1QHlPx3Mm72Y87NlGhOgBhLtpCJuB0NkXITgVI6cGh0vHbgFxUCHaZeVIsc Sep 08 10:41:50.020831 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:41:50.020831 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:41:50.020831 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:41:50.020831 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:41:50.020831 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:41:50.020831 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:41:50.020831 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: de5388c25cdb4a35ae8d58fa5b6cf125 Sep 08 10:41:50.020831 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1901140458 Sep 08 10:41:50.020831 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:41:50.020831 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:41:50.020831 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/de5388c25cdb4a35ae8d58fa5b6cf125"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/de5388c25cdb4a35ae8d58fa5b6cf125"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_de5388c25cdb4a35ae8d58fa5b6cf125"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/de5388c25cdb4a35ae8d58fa5b6cf125"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:41:50.020831 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1901140458 Sep 08 10:41:50.020831 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: de5388c25cdb4a35ae8d58fa5b6cf125 Sep 08 10:41:50.020831 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1901140458 Sep 08 10:41:50.020831 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1901140458-project Sep 08 10:41:50.020831 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:41:50.020831 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:41:50.020831 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 6e4cde361139445eb147c4f634ec663f Sep 08 10:41:50.020831 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1901140458-project Sep 08 10:41:50.020831 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:41:50.020831 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 7dac6a5f-62eb-4c60-8904-f23e50e1dcc8 could not be found. Sep 08 10:41:50.020831 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '7dac6a5f-62eb-4c60-8904-f23e50e1dcc8'} Sep 08 10:41:50.020831 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:41:50.020831 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:41:50.020831 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:41:50.020831 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:41:50.020831 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:41:50.020831 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:41:50.020831 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:41:50.020831 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:41:50.020831 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:41:50.020831 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:41:50.020831 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7dac6a5f-62eb-4c60-8904-f23e50e1dcc8 could not be found. Sep 08 10:41:50.020831 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:41:50.020831 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:41:50.020831 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:41:50.020831 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:41:50.020831 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:41:50.020831 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:41:50.020831 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:41:50.020831 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:41:50.020831 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:41:50.020831 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:41:50.020831 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:41:50.020831 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:41:50.020831 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:41:50.020831 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:41:50.020831 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:41:50.020831 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:41:50.020831 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7dac6a5f-62eb-4c60-8904-f23e50e1dcc8 could not be found. Sep 08 10:41:50.020831 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:41:50.024770 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:41:50.024770 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:41:50.024770 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:41:50.024770 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:41:50.024770 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:41:50.024770 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:41:50.024770 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:41:50.024770 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7dac6a5f-62eb-4c60-8904-f23e50e1dcc8 could not be found. Sep 08 10:41:50.024770 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:41:50.030337 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e7986a99-3899-4c9b-9c0e-9023272ecb8d tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:50.032663 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e7986a99-3899-4c9b-9c0e-9023272ecb8d tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 133a5f12-39e5-4e0f-81dc-b1948c073f15] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:50.045513 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e7986a99-3899-4c9b-9c0e-9023272ecb8d tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:50.046347 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e7986a99-3899-4c9b-9c0e-9023272ecb8d tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:50.046542 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fe9e5278-4366-436f-a6e3-140219f284b0 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Returning 404 to user: Instance 7dac6a5f-62eb-4c60-8904-f23e50e1dcc8 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:41:50.047145 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e7986a99-3899-4c9b-9c0e-9023272ecb8d tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:50.047520 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fe9e5278-4366-436f-a6e3-140219f284b0 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] 10.222.0.27 "GET /compute/v2.1/servers/7dac6a5f-62eb-4c60-8904-f23e50e1dcc8" status: 404 len: 111 microversion: 2.1 time: 0.144420 Sep 08 10:41:50.048300 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 636/1184] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:49 2022] GET /compute/v2.1/servers/7dac6a5f-62eb-4c60-8904-f23e50e1dcc8 => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:41:50.048907 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e7986a99-3899-4c9b-9c0e-9023272ecb8d tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:50.050113 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e7986a99-3899-4c9b-9c0e-9023272ecb8d tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:50.050841 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e7986a99-3899-4c9b-9c0e-9023272ecb8d tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:50.087826 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fb0f2ee2-e533-4ec9-a80b-a2dd584d8319 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:50.091639 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fb0f2ee2-e533-4ec9-a80b-a2dd584d8319 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] [instance: 1a01253b-8ff8-44d9-961b-1b91de83d671] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:50.120927 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb0f2ee2-e533-4ec9-a80b-a2dd584d8319 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:50.121466 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb0f2ee2-e533-4ec9-a80b-a2dd584d8319 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:50.123820 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb0f2ee2-e533-4ec9-a80b-a2dd584d8319 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:50.125550 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb0f2ee2-e533-4ec9-a80b-a2dd584d8319 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:50.126164 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb0f2ee2-e533-4ec9-a80b-a2dd584d8319 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:50.133427 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb0f2ee2-e533-4ec9-a80b-a2dd584d8319 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:50.181207 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-fb0f2ee2-e533-4ec9-a80b-a2dd584d8319 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] HTTP exception thrown: Instance 1a01253b-8ff8-44d9-961b-1b91de83d671 could not be found. Sep 08 10:41:50.184055 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fb0f2ee2-e533-4ec9-a80b-a2dd584d8319 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Request method failure captured: Sep 08 10:41:50.184055 n-d-850501-12 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/servers/1a01253b-8ff8-44d9-961b-1b91de83d671 HTTP/1.1 Sep 08 10:41:50.184055 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:41:50.184055 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:41:50.184055 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:41:50.184055 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:41:50.184055 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:41:50.184055 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:41:50.184055 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:41:50.184055 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:41:50.184055 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcYJG7WOpsCapt7pguZ-6js1PZFEd6hTs8PoX2AEtryTJx7dFMIVdu1iT9vHc7EpR7BrROJHv3_XBHZbqSKBDzSerlP0SDLhJhWphMvpmQhEu4YvBwaI1QHlPx3Mm72Y87NlGhOgBhLtpCJuB0NkXITgVI6cGh0vHbgFxUCHaZeVIsc Sep 08 10:41:50.184055 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:41:50.184055 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:41:50.184055 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:41:50.184055 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:41:50.184055 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:41:50.184055 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:41:50.184055 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: de5388c25cdb4a35ae8d58fa5b6cf125 Sep 08 10:41:50.184055 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1901140458 Sep 08 10:41:50.184055 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:41:50.184055 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:41:50.184055 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/de5388c25cdb4a35ae8d58fa5b6cf125"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/de5388c25cdb4a35ae8d58fa5b6cf125"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_de5388c25cdb4a35ae8d58fa5b6cf125"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/de5388c25cdb4a35ae8d58fa5b6cf125"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:41:50.184055 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1901140458 Sep 08 10:41:50.184055 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: de5388c25cdb4a35ae8d58fa5b6cf125 Sep 08 10:41:50.184055 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1901140458 Sep 08 10:41:50.184055 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1901140458-project Sep 08 10:41:50.184055 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:41:50.184055 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:41:50.184055 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 6e4cde361139445eb147c4f634ec663f Sep 08 10:41:50.184055 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1901140458-project Sep 08 10:41:50.184055 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:41:50.184055 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 1a01253b-8ff8-44d9-961b-1b91de83d671 could not be found. Sep 08 10:41:50.184055 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '1a01253b-8ff8-44d9-961b-1b91de83d671'} Sep 08 10:41:50.184055 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:41:50.184055 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:41:50.184055 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:41:50.184055 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:41:50.184055 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:41:50.184055 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:41:50.184055 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:41:50.184055 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:41:50.184055 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:41:50.184055 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:41:50.184055 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a01253b-8ff8-44d9-961b-1b91de83d671 could not be found. Sep 08 10:41:50.184055 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:41:50.184055 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:41:50.184055 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:41:50.184055 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:41:50.184055 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:41:50.184055 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:41:50.184055 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:41:50.184055 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:41:50.184055 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:41:50.184055 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:41:50.184055 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:41:50.184055 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:41:50.184055 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:41:50.184055 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:41:50.184055 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:41:50.184055 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:41:50.184055 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:41:50.184055 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:41:50.192047 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a01253b-8ff8-44d9-961b-1b91de83d671 could not be found. Sep 08 10:41:50.192047 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:41:50.192047 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:41:50.192047 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:41:50.192047 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:41:50.192047 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:41:50.192047 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:41:50.192047 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:41:50.192047 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:41:50.192047 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a01253b-8ff8-44d9-961b-1b91de83d671 could not be found. Sep 08 10:41:50.192047 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:41:50.194760 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fb0f2ee2-e533-4ec9-a80b-a2dd584d8319 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Returning 404 to user: Instance 1a01253b-8ff8-44d9-961b-1b91de83d671 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:41:50.210243 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fb0f2ee2-e533-4ec9-a80b-a2dd584d8319 tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1a01253b-8ff8-44d9-961b-1b91de83d671" status: 404 len: 111 microversion: 2.1 time: 0.147588 Sep 08 10:41:50.214330 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 637/1185] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:41:50 2022] DELETE /compute/v2.1/servers/1a01253b-8ff8-44d9-961b-1b91de83d671 => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:41:50.230998 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1782bef8-28b0-4d52-80fa-a38e49c9d6bc tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:50.233713 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1782bef8-28b0-4d52-80fa-a38e49c9d6bc tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] [instance: 1a01253b-8ff8-44d9-961b-1b91de83d671] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:50.254422 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1782bef8-28b0-4d52-80fa-a38e49c9d6bc tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:50.255519 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1782bef8-28b0-4d52-80fa-a38e49c9d6bc tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:50.256320 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1782bef8-28b0-4d52-80fa-a38e49c9d6bc tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:50.260646 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1782bef8-28b0-4d52-80fa-a38e49c9d6bc tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:50.265843 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1782bef8-28b0-4d52-80fa-a38e49c9d6bc tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:50.267181 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1782bef8-28b0-4d52-80fa-a38e49c9d6bc tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:50.305259 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-1782bef8-28b0-4d52-80fa-a38e49c9d6bc tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] HTTP exception thrown: Instance 1a01253b-8ff8-44d9-961b-1b91de83d671 could not be found. Sep 08 10:41:50.308347 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1782bef8-28b0-4d52-80fa-a38e49c9d6bc tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Request method failure captured: Sep 08 10:41:50.308347 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/1a01253b-8ff8-44d9-961b-1b91de83d671 HTTP/1.1 Sep 08 10:41:50.308347 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:41:50.308347 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:41:50.308347 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:41:50.308347 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:41:50.308347 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:41:50.308347 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:41:50.308347 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:41:50.308347 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:41:50.308347 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcYJG7WOpsCapt7pguZ-6js1PZFEd6hTs8PoX2AEtryTJx7dFMIVdu1iT9vHc7EpR7BrROJHv3_XBHZbqSKBDzSerlP0SDLhJhWphMvpmQhEu4YvBwaI1QHlPx3Mm72Y87NlGhOgBhLtpCJuB0NkXITgVI6cGh0vHbgFxUCHaZeVIsc Sep 08 10:41:50.308347 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:41:50.308347 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:41:50.308347 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:41:50.308347 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:41:50.308347 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:41:50.308347 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:41:50.308347 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: de5388c25cdb4a35ae8d58fa5b6cf125 Sep 08 10:41:50.308347 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1901140458 Sep 08 10:41:50.308347 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:41:50.308347 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:41:50.308347 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/de5388c25cdb4a35ae8d58fa5b6cf125"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/de5388c25cdb4a35ae8d58fa5b6cf125"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_de5388c25cdb4a35ae8d58fa5b6cf125"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/de5388c25cdb4a35ae8d58fa5b6cf125"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:41:50.308347 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1901140458 Sep 08 10:41:50.308347 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: de5388c25cdb4a35ae8d58fa5b6cf125 Sep 08 10:41:50.308347 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1901140458 Sep 08 10:41:50.308347 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1901140458-project Sep 08 10:41:50.308347 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:41:50.308347 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:41:50.308347 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 6e4cde361139445eb147c4f634ec663f Sep 08 10:41:50.308347 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1901140458-project Sep 08 10:41:50.308347 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:41:50.308347 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 1a01253b-8ff8-44d9-961b-1b91de83d671 could not be found. Sep 08 10:41:50.308347 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '1a01253b-8ff8-44d9-961b-1b91de83d671'} Sep 08 10:41:50.308347 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:41:50.308347 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:41:50.308347 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:41:50.308347 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:41:50.308347 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:41:50.308347 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:41:50.308347 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:41:50.308347 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:41:50.308347 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:41:50.308347 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:41:50.308347 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a01253b-8ff8-44d9-961b-1b91de83d671 could not be found. Sep 08 10:41:50.308347 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:41:50.308347 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:41:50.308347 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:41:50.308347 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:41:50.308347 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:41:50.308347 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:41:50.308347 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:41:50.308347 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:41:50.308347 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:41:50.308347 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:41:50.308347 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:41:50.308347 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:41:50.308347 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:41:50.308347 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:41:50.308347 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:41:50.308347 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:41:50.308347 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a01253b-8ff8-44d9-961b-1b91de83d671 could not be found. Sep 08 10:41:50.308347 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:41:50.313127 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:41:50.313127 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:41:50.313127 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:41:50.313127 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:41:50.313127 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:41:50.313127 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:41:50.313127 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:41:50.313127 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a01253b-8ff8-44d9-961b-1b91de83d671 could not be found. Sep 08 10:41:50.313127 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:41:50.316539 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1782bef8-28b0-4d52-80fa-a38e49c9d6bc tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] Returning 404 to user: Instance 1a01253b-8ff8-44d9-961b-1b91de83d671 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:41:50.318832 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1782bef8-28b0-4d52-80fa-a38e49c9d6bc tempest-ServersWithSpecificFlavorTestJSON-1901140458 tempest-ServersWithSpecificFlavorTestJSON-1901140458-project] 10.222.0.27 "GET /compute/v2.1/servers/1a01253b-8ff8-44d9-961b-1b91de83d671" status: 404 len: 111 microversion: 2.1 time: 0.100590 Sep 08 10:41:50.322083 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 638/1186] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:50 2022] GET /compute/v2.1/servers/1a01253b-8ff8-44d9-961b-1b91de83d671 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:41:50.359189 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5060162a-b65c-4780-b66d-359ec959ec04 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:50.363966 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5060162a-b65c-4780-b66d-359ec959ec04 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 2f4552b5-2e31-458b-b0f3-5bd551cc9ced] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:50.385327 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5060162a-b65c-4780-b66d-359ec959ec04 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:50.388195 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5060162a-b65c-4780-b66d-359ec959ec04 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:50.390917 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5060162a-b65c-4780-b66d-359ec959ec04 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:50.392010 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5060162a-b65c-4780-b66d-359ec959ec04 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:50.393175 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5060162a-b65c-4780-b66d-359ec959ec04 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:50.395885 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5060162a-b65c-4780-b66d-359ec959ec04 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:50.810969 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5060162a-b65c-4780-b66d-359ec959ec04 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:50.824969 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5060162a-b65c-4780-b66d-359ec959ec04 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/2f4552b5-2e31-458b-b0f3-5bd551cc9ced" status: 200 len: 1315 microversion: 2.1 time: 0.501563 Sep 08 10:41:50.827846 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 639/1187] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:50 2022] GET /compute/v2.1/servers/2f4552b5-2e31-458b-b0f3-5bd551cc9ced => generated 1315 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:41:50.839533 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a84ea669-4344-4d9c-a087-110b49bf16d4 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:50.842705 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a84ea669-4344-4d9c-a087-110b49bf16d4 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] [instance: 26218db4-d06e-4ae2-8f15-f21004ce13b3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:50.874728 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a84ea669-4344-4d9c-a087-110b49bf16d4 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:50.875247 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a84ea669-4344-4d9c-a087-110b49bf16d4 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:50.875778 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a84ea669-4344-4d9c-a087-110b49bf16d4 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:50.885754 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a84ea669-4344-4d9c-a087-110b49bf16d4 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:50.888012 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a84ea669-4344-4d9c-a087-110b49bf16d4 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:50.892541 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a84ea669-4344-4d9c-a087-110b49bf16d4 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:51.156051 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e7986a99-3899-4c9b-9c0e-9023272ecb8d tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:51.170038 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e7986a99-3899-4c9b-9c0e-9023272ecb8d tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15" status: 200 len: 1718 microversion: 2.1 time: 1.156662 Sep 08 10:41:51.186922 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 549/1188] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:50 2022] GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15 => generated 1718 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:41:51.195378 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4a4c2553-f2fd-436e-aafa-65acbe80eea8 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:51.197266 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4a4c2553-f2fd-436e-aafa-65acbe80eea8 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: a3a6ce0f-e362-4cbc-afc2-3cfd349a4812] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:51.204197 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a4c2553-f2fd-436e-aafa-65acbe80eea8 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:51.205004 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a4c2553-f2fd-436e-aafa-65acbe80eea8 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:51.207078 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a4c2553-f2fd-436e-aafa-65acbe80eea8 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:51.208030 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a4c2553-f2fd-436e-aafa-65acbe80eea8 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:51.208675 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a4c2553-f2fd-436e-aafa-65acbe80eea8 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:51.209331 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a4c2553-f2fd-436e-aafa-65acbe80eea8 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:51.829122 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a84ea669-4344-4d9c-a087-110b49bf16d4 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae3291d8d8f40dc98be9c965ba86adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d59ac71b6f459ea38d5ddc24964216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:51.851460 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a84ea669-4344-4d9c-a087-110b49bf16d4 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] 10.222.0.27 "GET /compute/v2.1/servers/26218db4-d06e-4ae2-8f15-f21004ce13b3" status: 200 len: 1268 microversion: 2.1 time: 1.022025 Sep 08 10:41:51.857821 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 640/1189] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:50 2022] GET /compute/v2.1/servers/26218db4-d06e-4ae2-8f15-f21004ce13b3 => generated 1268 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:41:51.881201 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-49a40dde-9d30-4448-92ba-6bea26659a9e tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:51.891907 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-49a40dde-9d30-4448-92ba-6bea26659a9e tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:51.911021 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49a40dde-9d30-4448-92ba-6bea26659a9e tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:51.914683 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49a40dde-9d30-4448-92ba-6bea26659a9e tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:51.921833 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49a40dde-9d30-4448-92ba-6bea26659a9e tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:51.924983 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49a40dde-9d30-4448-92ba-6bea26659a9e tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:51.933233 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49a40dde-9d30-4448-92ba-6bea26659a9e tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:51.933969 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49a40dde-9d30-4448-92ba-6bea26659a9e tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:51.989429 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4a4c2553-f2fd-436e-aafa-65acbe80eea8 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:51.998760 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4a4c2553-f2fd-436e-aafa-65acbe80eea8 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812" status: 200 len: 1542 microversion: 2.1 time: 0.810207 Sep 08 10:41:52.011257 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 550/1190] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:51 2022] GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812 => generated 1542 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:41:52.045642 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-02d1a328-891b-4340-a07b-48b1b0115f18 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:52.046289 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-02d1a328-891b-4340-a07b-48b1b0115f18 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 2f4552b5-2e31-458b-b0f3-5bd551cc9ced] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:52.067765 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-02d1a328-891b-4340-a07b-48b1b0115f18 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:52.070608 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-02d1a328-891b-4340-a07b-48b1b0115f18 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:52.071172 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-02d1a328-891b-4340-a07b-48b1b0115f18 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:52.071946 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-02d1a328-891b-4340-a07b-48b1b0115f18 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:52.072417 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-02d1a328-891b-4340-a07b-48b1b0115f18 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:52.072843 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-02d1a328-891b-4340-a07b-48b1b0115f18 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:52.556322 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-02d1a328-891b-4340-a07b-48b1b0115f18 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:52.569794 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-02d1a328-891b-4340-a07b-48b1b0115f18 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/2f4552b5-2e31-458b-b0f3-5bd551cc9ced" status: 200 len: 1315 microversion: 2.1 time: 0.557171 Sep 08 10:41:52.575325 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 551/1191] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:52 2022] GET /compute/v2.1/servers/2f4552b5-2e31-458b-b0f3-5bd551cc9ced => generated 1315 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:41:52.586157 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ac9cb323-56b6-4e1b-8790-20dec522fc3e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:52.588811 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ac9cb323-56b6-4e1b-8790-20dec522fc3e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 133a5f12-39e5-4e0f-81dc-b1948c073f15] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:52.602569 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:DELETE=4,nova_api:INSERT=3 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:41:52.606291 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ac9cb323-56b6-4e1b-8790-20dec522fc3e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:52.609359 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ac9cb323-56b6-4e1b-8790-20dec522fc3e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:52.610000 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ac9cb323-56b6-4e1b-8790-20dec522fc3e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:52.615118 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ac9cb323-56b6-4e1b-8790-20dec522fc3e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:52.615828 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ac9cb323-56b6-4e1b-8790-20dec522fc3e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:52.616435 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ac9cb323-56b6-4e1b-8790-20dec522fc3e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:52.652948 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-49a40dde-9d30-4448-92ba-6bea26659a9e tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:52.690026 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-49a40dde-9d30-4448-92ba-6bea26659a9e tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:52.691901 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-49a40dde-9d30-4448-92ba-6bea26659a9e tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:52.693412 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-49a40dde-9d30-4448-92ba-6bea26659a9e tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e" status: 200 len: 1810 microversion: 2.25 time: 0.834289 Sep 08 10:41:52.694515 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 641/1192] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:41:51 2022] GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e => generated 1810 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:41:52.890932 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c9daad48-c46d-431a-a3f0-54f4e2356f53 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:52.892413 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c9daad48-c46d-431a-a3f0-54f4e2356f53 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] [instance: 26218db4-d06e-4ae2-8f15-f21004ce13b3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:52.912702 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c9daad48-c46d-431a-a3f0-54f4e2356f53 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:52.913443 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c9daad48-c46d-431a-a3f0-54f4e2356f53 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:52.914066 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c9daad48-c46d-431a-a3f0-54f4e2356f53 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:52.914964 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c9daad48-c46d-431a-a3f0-54f4e2356f53 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:52.915597 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c9daad48-c46d-431a-a3f0-54f4e2356f53 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:52.920842 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c9daad48-c46d-431a-a3f0-54f4e2356f53 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:52.947453 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ac9cb323-56b6-4e1b-8790-20dec522fc3e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:52.956156 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ac9cb323-56b6-4e1b-8790-20dec522fc3e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15" status: 200 len: 1718 microversion: 2.1 time: 0.379517 Sep 08 10:41:52.969151 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 552/1193] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:52 2022] GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15 => generated 1718 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:41:53.029316 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d8d4acdf-3c43-4aeb-9ce8-d4133ccf05cc tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:53.030233 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d8d4acdf-3c43-4aeb-9ce8-d4133ccf05cc tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: a3a6ce0f-e362-4cbc-afc2-3cfd349a4812] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:53.044453 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d8d4acdf-3c43-4aeb-9ce8-d4133ccf05cc tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:53.045574 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d8d4acdf-3c43-4aeb-9ce8-d4133ccf05cc tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:53.046281 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d8d4acdf-3c43-4aeb-9ce8-d4133ccf05cc tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:53.047167 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d8d4acdf-3c43-4aeb-9ce8-d4133ccf05cc tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:53.050111 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d8d4acdf-3c43-4aeb-9ce8-d4133ccf05cc tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:53.057265 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d8d4acdf-3c43-4aeb-9ce8-d4133ccf05cc tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:53.161695 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c9daad48-c46d-431a-a3f0-54f4e2356f53 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae3291d8d8f40dc98be9c965ba86adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d59ac71b6f459ea38d5ddc24964216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:53.171872 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c9daad48-c46d-431a-a3f0-54f4e2356f53 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] 10.222.0.27 "GET /compute/v2.1/servers/26218db4-d06e-4ae2-8f15-f21004ce13b3" status: 200 len: 1274 microversion: 2.1 time: 0.284612 Sep 08 10:41:53.186171 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 642/1194] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:52 2022] GET /compute/v2.1/servers/26218db4-d06e-4ae2-8f15-f21004ce13b3 => generated 1274 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:41:53.603929 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-29e1df01-0efc-4f1f-b228-e133eaa95b81 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:53.604910 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-29e1df01-0efc-4f1f-b228-e133eaa95b81 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 2f4552b5-2e31-458b-b0f3-5bd551cc9ced] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:53.618581 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-29e1df01-0efc-4f1f-b228-e133eaa95b81 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:53.629343 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-29e1df01-0efc-4f1f-b228-e133eaa95b81 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:53.630190 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-29e1df01-0efc-4f1f-b228-e133eaa95b81 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:53.631138 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-29e1df01-0efc-4f1f-b228-e133eaa95b81 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:53.631772 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-29e1df01-0efc-4f1f-b228-e133eaa95b81 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:53.632353 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-29e1df01-0efc-4f1f-b228-e133eaa95b81 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:54.285422 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d8d4acdf-3c43-4aeb-9ce8-d4133ccf05cc tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:54.295200 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d8d4acdf-3c43-4aeb-9ce8-d4133ccf05cc tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812" status: 200 len: 1542 microversion: 2.1 time: 1.268063 Sep 08 10:41:54.296399 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 553/1195] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:53 2022] GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812 => generated 1542 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:41:54.301254 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-90e4a3de-8fc3-478c-9be2-91894fe43d21 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:54.301877 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-90e4a3de-8fc3-478c-9be2-91894fe43d21 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:54.308295 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90e4a3de-8fc3-478c-9be2-91894fe43d21 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:54.308794 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90e4a3de-8fc3-478c-9be2-91894fe43d21 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:54.309463 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90e4a3de-8fc3-478c-9be2-91894fe43d21 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:54.310164 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90e4a3de-8fc3-478c-9be2-91894fe43d21 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:54.310958 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90e4a3de-8fc3-478c-9be2-91894fe43d21 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:54.311406 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90e4a3de-8fc3-478c-9be2-91894fe43d21 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:54.883227 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-29e1df01-0efc-4f1f-b228-e133eaa95b81 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:54.908530 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-29e1df01-0efc-4f1f-b228-e133eaa95b81 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/2f4552b5-2e31-458b-b0f3-5bd551cc9ced" status: 200 len: 1502 microversion: 2.1 time: 1.308509 Sep 08 10:41:54.916221 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 643/1196] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:53 2022] GET /compute/v2.1/servers/2f4552b5-2e31-458b-b0f3-5bd551cc9ced => generated 1502 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:41:54.949171 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-03ec3a82-2e9f-4f1e-951e-69396e4a89df tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:54.949962 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-03ec3a82-2e9f-4f1e-951e-69396e4a89df tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 133a5f12-39e5-4e0f-81dc-b1948c073f15] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:54.985963 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03ec3a82-2e9f-4f1e-951e-69396e4a89df tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:54.987127 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03ec3a82-2e9f-4f1e-951e-69396e4a89df tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:54.987936 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03ec3a82-2e9f-4f1e-951e-69396e4a89df tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:54.988744 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03ec3a82-2e9f-4f1e-951e-69396e4a89df tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:55.009009 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03ec3a82-2e9f-4f1e-951e-69396e4a89df tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:55.010000 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03ec3a82-2e9f-4f1e-951e-69396e4a89df tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:55.176805 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-90e4a3de-8fc3-478c-9be2-91894fe43d21 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:55.193973 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-90e4a3de-8fc3-478c-9be2-91894fe43d21 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:55.195747 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-90e4a3de-8fc3-478c-9be2-91894fe43d21 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:55.199659 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-90e4a3de-8fc3-478c-9be2-91894fe43d21 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e" status: 200 len: 1810 microversion: 2.25 time: 0.901900 Sep 08 10:41:55.200439 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 554/1197] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:41:54 2022] GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e => generated 1810 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:41:55.207831 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-df7b3962-9ed4-4448-8ba3-7db1af9d44ba tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:55.208812 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-df7b3962-9ed4-4448-8ba3-7db1af9d44ba tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] [instance: 26218db4-d06e-4ae2-8f15-f21004ce13b3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:55.216026 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-df7b3962-9ed4-4448-8ba3-7db1af9d44ba tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:55.217248 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-df7b3962-9ed4-4448-8ba3-7db1af9d44ba tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:55.218141 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-df7b3962-9ed4-4448-8ba3-7db1af9d44ba tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:55.220367 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-df7b3962-9ed4-4448-8ba3-7db1af9d44ba tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:55.222158 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-df7b3962-9ed4-4448-8ba3-7db1af9d44ba tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:55.222832 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-df7b3962-9ed4-4448-8ba3-7db1af9d44ba tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:55.293765 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:41:55.536781 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-df7b3962-9ed4-4448-8ba3-7db1af9d44ba tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae3291d8d8f40dc98be9c965ba86adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d59ac71b6f459ea38d5ddc24964216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:55.548237 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-df7b3962-9ed4-4448-8ba3-7db1af9d44ba tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] 10.222.0.27 "GET /compute/v2.1/servers/26218db4-d06e-4ae2-8f15-f21004ce13b3" status: 200 len: 1316 microversion: 2.1 time: 0.343506 Sep 08 10:41:55.567124 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 555/1198] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:55 2022] GET /compute/v2.1/servers/26218db4-d06e-4ae2-8f15-f21004ce13b3 => generated 1316 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:41:55.573792 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3dec60ab-7b7b-42b2-b765-06a60211d357 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:55.578803 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3dec60ab-7b7b-42b2-b765-06a60211d357 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 2f4552b5-2e31-458b-b0f3-5bd551cc9ced] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:55.590957 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3dec60ab-7b7b-42b2-b765-06a60211d357 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:55.596749 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3dec60ab-7b7b-42b2-b765-06a60211d357 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:55.597624 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3dec60ab-7b7b-42b2-b765-06a60211d357 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:55.598615 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3dec60ab-7b7b-42b2-b765-06a60211d357 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:55.604312 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3dec60ab-7b7b-42b2-b765-06a60211d357 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:55.604864 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3dec60ab-7b7b-42b2-b765-06a60211d357 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:55.666914 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3dec60ab-7b7b-42b2-b765-06a60211d357 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 2f4552b5-2e31-458b-b0f3-5bd551cc9ced] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:41:55.873941 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3dec60ab-7b7b-42b2-b765-06a60211d357 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2f4552b5-2e31-458b-b0f3-5bd551cc9ced" status: 204 len: 0 microversion: 2.1 time: 0.303421 Sep 08 10:41:55.880258 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 556/1199] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:41:55 2022] DELETE /compute/v2.1/servers/2f4552b5-2e31-458b-b0f3-5bd551cc9ced => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:41:55.908312 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b7648840-9ab5-45f7-a3b8-d3266c516c8c tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:55.922347 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b7648840-9ab5-45f7-a3b8-d3266c516c8c tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: a3a6ce0f-e362-4cbc-afc2-3cfd349a4812] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:55.944459 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b7648840-9ab5-45f7-a3b8-d3266c516c8c tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:55.946130 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b7648840-9ab5-45f7-a3b8-d3266c516c8c tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:55.946889 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b7648840-9ab5-45f7-a3b8-d3266c516c8c tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:55.947819 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b7648840-9ab5-45f7-a3b8-d3266c516c8c tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:55.948510 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b7648840-9ab5-45f7-a3b8-d3266c516c8c tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:55.953310 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b7648840-9ab5-45f7-a3b8-d3266c516c8c tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:56.143753 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-03ec3a82-2e9f-4f1e-951e-69396e4a89df tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:56.158838 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-03ec3a82-2e9f-4f1e-951e-69396e4a89df tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15" status: 200 len: 1718 microversion: 2.1 time: 1.235252 Sep 08 10:41:56.162660 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 644/1200] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:54 2022] GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15 => generated 1718 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:41:56.170748 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-892aba75-7c25-4159-80a0-f97ad2ed7b3c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:56.171612 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-892aba75-7c25-4159-80a0-f97ad2ed7b3c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 2f4552b5-2e31-458b-b0f3-5bd551cc9ced] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:56.198378 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-892aba75-7c25-4159-80a0-f97ad2ed7b3c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:56.199395 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-892aba75-7c25-4159-80a0-f97ad2ed7b3c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:56.200010 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-892aba75-7c25-4159-80a0-f97ad2ed7b3c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:56.200972 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-892aba75-7c25-4159-80a0-f97ad2ed7b3c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:56.204182 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-892aba75-7c25-4159-80a0-f97ad2ed7b3c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:56.207499 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-892aba75-7c25-4159-80a0-f97ad2ed7b3c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:56.404504 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b7648840-9ab5-45f7-a3b8-d3266c516c8c tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:56.437328 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b7648840-9ab5-45f7-a3b8-d3266c516c8c tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812" status: 200 len: 1542 microversion: 2.1 time: 0.557124 Sep 08 10:41:56.438191 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 557/1201] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:55 2022] GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812 => generated 1542 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:41:56.458198 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-95c8094b-c212-4814-bf32-f6f99644ad4c tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:56.458988 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-95c8094b-c212-4814-bf32-f6f99644ad4c tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:56.465894 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-95c8094b-c212-4814-bf32-f6f99644ad4c tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:56.466527 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-95c8094b-c212-4814-bf32-f6f99644ad4c tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:56.467067 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-95c8094b-c212-4814-bf32-f6f99644ad4c tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:56.467902 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-95c8094b-c212-4814-bf32-f6f99644ad4c tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:56.468470 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-95c8094b-c212-4814-bf32-f6f99644ad4c tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:56.469002 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-95c8094b-c212-4814-bf32-f6f99644ad4c tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:56.706027 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-95c8094b-c212-4814-bf32-f6f99644ad4c tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:56.719069 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-95c8094b-c212-4814-bf32-f6f99644ad4c tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:56.721492 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-95c8094b-c212-4814-bf32-f6f99644ad4c tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:56.722734 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-95c8094b-c212-4814-bf32-f6f99644ad4c tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e" status: 200 len: 1810 microversion: 2.25 time: 0.278035 Sep 08 10:41:56.727711 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 558/1202] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:41:56 2022] GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e => generated 1810 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:41:56.742721 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a7033cb7-b622-4109-ba5d-d8348eba1fdf tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:56.756902 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a7033cb7-b622-4109-ba5d-d8348eba1fdf tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] [instance: 26218db4-d06e-4ae2-8f15-f21004ce13b3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:56.772835 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a7033cb7-b622-4109-ba5d-d8348eba1fdf tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:56.773560 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a7033cb7-b622-4109-ba5d-d8348eba1fdf tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:56.774576 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a7033cb7-b622-4109-ba5d-d8348eba1fdf tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:56.775493 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a7033cb7-b622-4109-ba5d-d8348eba1fdf tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:56.780755 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a7033cb7-b622-4109-ba5d-d8348eba1fdf tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:56.782130 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a7033cb7-b622-4109-ba5d-d8348eba1fdf tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:57.100211 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a7033cb7-b622-4109-ba5d-d8348eba1fdf tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae3291d8d8f40dc98be9c965ba86adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d59ac71b6f459ea38d5ddc24964216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:57.119871 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a7033cb7-b622-4109-ba5d-d8348eba1fdf tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] 10.222.0.27 "GET /compute/v2.1/servers/26218db4-d06e-4ae2-8f15-f21004ce13b3" status: 200 len: 1316 microversion: 2.1 time: 0.382272 Sep 08 10:41:57.122007 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 559/1203] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:56 2022] GET /compute/v2.1/servers/26218db4-d06e-4ae2-8f15-f21004ce13b3 => generated 1316 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:41:57.186986 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f84613fa-424f-4223-90fb-01778305ce9b tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:57.187684 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f84613fa-424f-4223-90fb-01778305ce9b tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 133a5f12-39e5-4e0f-81dc-b1948c073f15] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:57.200260 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f84613fa-424f-4223-90fb-01778305ce9b tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:57.200772 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f84613fa-424f-4223-90fb-01778305ce9b tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:57.201287 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f84613fa-424f-4223-90fb-01778305ce9b tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:57.205426 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f84613fa-424f-4223-90fb-01778305ce9b tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:57.206197 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f84613fa-424f-4223-90fb-01778305ce9b tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:57.207657 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f84613fa-424f-4223-90fb-01778305ce9b tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:57.543413 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f84613fa-424f-4223-90fb-01778305ce9b tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:57.561195 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f84613fa-424f-4223-90fb-01778305ce9b tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15" status: 200 len: 1718 microversion: 2.1 time: 0.378707 Sep 08 10:41:57.562148 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 560/1204] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:57 2022] GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15 => generated 1718 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:41:57.567599 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fe24b6ee-c860-406c-95da-dff610058866 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:57.568698 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fe24b6ee-c860-406c-95da-dff610058866 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: a3a6ce0f-e362-4cbc-afc2-3cfd349a4812] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:57.576855 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fe24b6ee-c860-406c-95da-dff610058866 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:57.578036 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fe24b6ee-c860-406c-95da-dff610058866 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:57.578208 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fe24b6ee-c860-406c-95da-dff610058866 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:57.579095 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fe24b6ee-c860-406c-95da-dff610058866 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:57.579633 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fe24b6ee-c860-406c-95da-dff610058866 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:57.581934 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fe24b6ee-c860-406c-95da-dff610058866 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:57.624228 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-892aba75-7c25-4159-80a0-f97ad2ed7b3c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:57.643153 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-892aba75-7c25-4159-80a0-f97ad2ed7b3c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/2f4552b5-2e31-458b-b0f3-5bd551cc9ced" status: 200 len: 1508 microversion: 2.1 time: 1.476323 Sep 08 10:41:57.645337 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 645/1205] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:56 2022] GET /compute/v2.1/servers/2f4552b5-2e31-458b-b0f3-5bd551cc9ced => generated 1508 bytes in 1480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:41:57.754390 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9e71d3ee-c790-4744-9b96-badf2cc4446d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:57.755324 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9e71d3ee-c790-4744-9b96-badf2cc4446d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:57.776260 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9e71d3ee-c790-4744-9b96-badf2cc4446d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:57.786093 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9e71d3ee-c790-4744-9b96-badf2cc4446d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:57.787165 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9e71d3ee-c790-4744-9b96-badf2cc4446d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:57.804220 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9e71d3ee-c790-4744-9b96-badf2cc4446d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:57.807177 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9e71d3ee-c790-4744-9b96-badf2cc4446d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:57.809944 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9e71d3ee-c790-4744-9b96-badf2cc4446d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:57.907270 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-fe24b6ee-c860-406c-95da-dff610058866 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:57.945452 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fe24b6ee-c860-406c-95da-dff610058866 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812" status: 200 len: 1542 microversion: 2.1 time: 0.377372 Sep 08 10:41:57.962092 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 561/1206] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:57 2022] GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812 => generated 1542 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:41:58.158692 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-433be9fb-0205-4c6d-90cd-a814cb8be694 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:58.159466 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-433be9fb-0205-4c6d-90cd-a814cb8be694 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] [instance: 26218db4-d06e-4ae2-8f15-f21004ce13b3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:58.177486 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-433be9fb-0205-4c6d-90cd-a814cb8be694 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:58.178023 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-433be9fb-0205-4c6d-90cd-a814cb8be694 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:58.178446 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-433be9fb-0205-4c6d-90cd-a814cb8be694 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:58.179166 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-433be9fb-0205-4c6d-90cd-a814cb8be694 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:58.179629 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-433be9fb-0205-4c6d-90cd-a814cb8be694 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:58.180066 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-433be9fb-0205-4c6d-90cd-a814cb8be694 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:58.235797 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:41:58.500941 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-433be9fb-0205-4c6d-90cd-a814cb8be694 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae3291d8d8f40dc98be9c965ba86adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d59ac71b6f459ea38d5ddc24964216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:58.511202 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-433be9fb-0205-4c6d-90cd-a814cb8be694 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] 10.222.0.27 "GET /compute/v2.1/servers/26218db4-d06e-4ae2-8f15-f21004ce13b3" status: 200 len: 1316 microversion: 2.1 time: 0.357897 Sep 08 10:41:58.532009 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 562/1207] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:58 2022] GET /compute/v2.1/servers/26218db4-d06e-4ae2-8f15-f21004ce13b3 => generated 1316 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:41:58.590465 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3eaba986-fdfd-42f4-ae38-0c0efef577fb tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:58.591950 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3eaba986-fdfd-42f4-ae38-0c0efef577fb tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 133a5f12-39e5-4e0f-81dc-b1948c073f15] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:58.608444 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3eaba986-fdfd-42f4-ae38-0c0efef577fb tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:58.609391 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3eaba986-fdfd-42f4-ae38-0c0efef577fb tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:58.610114 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3eaba986-fdfd-42f4-ae38-0c0efef577fb tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:58.614692 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3eaba986-fdfd-42f4-ae38-0c0efef577fb tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:58.615596 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3eaba986-fdfd-42f4-ae38-0c0efef577fb tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:58.616265 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3eaba986-fdfd-42f4-ae38-0c0efef577fb tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:58.861522 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-3eaba986-fdfd-42f4-ae38-0c0efef577fb tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:58.874828 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3eaba986-fdfd-42f4-ae38-0c0efef577fb tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15" status: 200 len: 1718 microversion: 2.1 time: 0.286538 Sep 08 10:41:58.876688 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 563/1208] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:58 2022] GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15 => generated 1718 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:41:58.882870 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d211bb41-3f6e-4015-a25d-ba72239ecb97 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:58.883789 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d211bb41-3f6e-4015-a25d-ba72239ecb97 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 2f4552b5-2e31-458b-b0f3-5bd551cc9ced] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:58.910125 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d211bb41-3f6e-4015-a25d-ba72239ecb97 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:58.920668 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d211bb41-3f6e-4015-a25d-ba72239ecb97 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:58.922674 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d211bb41-3f6e-4015-a25d-ba72239ecb97 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:58.923678 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d211bb41-3f6e-4015-a25d-ba72239ecb97 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:58.926704 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d211bb41-3f6e-4015-a25d-ba72239ecb97 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:58.927255 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d211bb41-3f6e-4015-a25d-ba72239ecb97 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:59.131143 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9e71d3ee-c790-4744-9b96-badf2cc4446d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:59.140269 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9e71d3ee-c790-4744-9b96-badf2cc4446d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:59.142146 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9e71d3ee-c790-4744-9b96-badf2cc4446d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:59.143574 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9e71d3ee-c790-4744-9b96-badf2cc4446d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e" status: 200 len: 1810 microversion: 2.25 time: 1.394438 Sep 08 10:41:59.158514 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 646/1209] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:41:57 2022] GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e => generated 1810 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:41:59.170013 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-33e32020-36ae-4235-9b80-5d8af0e24694 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:59.170835 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-33e32020-36ae-4235-9b80-5d8af0e24694 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: a3a6ce0f-e362-4cbc-afc2-3cfd349a4812] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:59.178459 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33e32020-36ae-4235-9b80-5d8af0e24694 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:59.179256 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33e32020-36ae-4235-9b80-5d8af0e24694 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:59.180148 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33e32020-36ae-4235-9b80-5d8af0e24694 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:59.181259 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33e32020-36ae-4235-9b80-5d8af0e24694 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:59.181915 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33e32020-36ae-4235-9b80-5d8af0e24694 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:59.182532 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33e32020-36ae-4235-9b80-5d8af0e24694 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:59.399791 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d211bb41-3f6e-4015-a25d-ba72239ecb97 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:59.418419 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d211bb41-3f6e-4015-a25d-ba72239ecb97 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/2f4552b5-2e31-458b-b0f3-5bd551cc9ced" status: 200 len: 1508 microversion: 2.1 time: 0.536261 Sep 08 10:41:59.420448 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 564/1210] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:58 2022] GET /compute/v2.1/servers/2f4552b5-2e31-458b-b0f3-5bd551cc9ced => generated 1508 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:41:59.541867 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b61e59dd-25b0-4079-b7e7-c998c590f1d9 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:59.543079 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b61e59dd-25b0-4079-b7e7-c998c590f1d9 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] [instance: 26218db4-d06e-4ae2-8f15-f21004ce13b3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:59.553454 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=8 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:41:59.576750 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b61e59dd-25b0-4079-b7e7-c998c590f1d9 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:59.577498 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b61e59dd-25b0-4079-b7e7-c998c590f1d9 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:59.580402 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b61e59dd-25b0-4079-b7e7-c998c590f1d9 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:59.581328 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b61e59dd-25b0-4079-b7e7-c998c590f1d9 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:59.581830 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b61e59dd-25b0-4079-b7e7-c998c590f1d9 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:59.585237 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b61e59dd-25b0-4079-b7e7-c998c590f1d9 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:59.909348 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b61e59dd-25b0-4079-b7e7-c998c590f1d9 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae3291d8d8f40dc98be9c965ba86adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d59ac71b6f459ea38d5ddc24964216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:59.922103 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b61e59dd-25b0-4079-b7e7-c998c590f1d9 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] 10.222.0.27 "GET /compute/v2.1/servers/26218db4-d06e-4ae2-8f15-f21004ce13b3" status: 200 len: 1316 microversion: 2.1 time: 0.384478 Sep 08 10:41:59.924657 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 565/1211] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:59 2022] GET /compute/v2.1/servers/26218db4-d06e-4ae2-8f15-f21004ce13b3 => generated 1316 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:41:59.933719 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-cf029aa4-ab4d-4e7e-8dc0-728b7a3756f5 req-cfb05204-c491-45ed-944c-e6101f806205 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f4552b5-2e31-458b-b0f3-5bd551cc9ced", "name": "network-vif-deleted", "tag": "8a49fb6e-bf0b-42c4-b517-f48e7c1727ec"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:41:59.948809 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-cf029aa4-ab4d-4e7e-8dc0-728b7a3756f5 req-cfb05204-c491-45ed-944c-e6101f806205 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:59.949666 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-cf029aa4-ab4d-4e7e-8dc0-728b7a3756f5 req-cfb05204-c491-45ed-944c-e6101f806205 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:59.950307 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-cf029aa4-ab4d-4e7e-8dc0-728b7a3756f5 req-cfb05204-c491-45ed-944c-e6101f806205 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:59.968121 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-cf029aa4-ab4d-4e7e-8dc0-728b7a3756f5 req-cfb05204-c491-45ed-944c-e6101f806205 service nova] Creating event network-vif-deleted:8a49fb6e-bf0b-42c4-b517-f48e7c1727ec for instance 2f4552b5-2e31-458b-b0f3-5bd551cc9ced on n-h2-850501-12 Sep 08 10:41:59.974295 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-cf029aa4-ab4d-4e7e-8dc0-728b7a3756f5 req-cfb05204-c491-45ed-944c-e6101f806205 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048296 Sep 08 10:41:59.981357 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 566/1212] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:41:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:41:59.990494 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0d817870-8e36-48af-85a7-8af442bc817f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:59.991499 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0d817870-8e36-48af-85a7-8af442bc817f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 133a5f12-39e5-4e0f-81dc-b1948c073f15] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:59.999990 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d817870-8e36-48af-85a7-8af442bc817f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:00.000574 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d817870-8e36-48af-85a7-8af442bc817f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:00.002538 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d817870-8e36-48af-85a7-8af442bc817f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:00.003619 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d817870-8e36-48af-85a7-8af442bc817f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:00.004477 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d817870-8e36-48af-85a7-8af442bc817f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:00.005354 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d817870-8e36-48af-85a7-8af442bc817f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:00.081482 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-33e32020-36ae-4235-9b80-5d8af0e24694 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:00.095714 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-33e32020-36ae-4235-9b80-5d8af0e24694 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812" status: 200 len: 1542 microversion: 2.1 time: 0.934464 Sep 08 10:42:00.101112 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 647/1213] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:59 2022] GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812 => generated 1542 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:00.258077 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0d817870-8e36-48af-85a7-8af442bc817f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:00.274068 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0d817870-8e36-48af-85a7-8af442bc817f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15" status: 200 len: 1718 microversion: 2.1 time: 0.289329 Sep 08 10:42:00.275269 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 567/1214] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:59 2022] GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15 => generated 1718 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:00.281917 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1f8cfac9-4c58-45d7-a061-ea1f52a478fd tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:00.290328 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1f8cfac9-4c58-45d7-a061-ea1f52a478fd tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:00.300799 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1f8cfac9-4c58-45d7-a061-ea1f52a478fd tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:00.301816 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1f8cfac9-4c58-45d7-a061-ea1f52a478fd tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:00.302643 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1f8cfac9-4c58-45d7-a061-ea1f52a478fd tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:00.303623 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1f8cfac9-4c58-45d7-a061-ea1f52a478fd tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:00.304386 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1f8cfac9-4c58-45d7-a061-ea1f52a478fd tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:00.305051 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1f8cfac9-4c58-45d7-a061-ea1f52a478fd tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:00.365618 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-05167bc4-48bb-42ea-920f-ceddbe85aae8 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Action: 'create', calling method: .version_select at 0x7f68e45878b0>, body: {"keypair": {"name": "tempest-keypair-1348238802", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJiejbPl755yHZn0f8RfQnDXj2jfvFH9Dz8EIBHNwJc7JGWCeN60awlynO+osgIblxWLdEYWXi7KbjGYmu0p+RBkHz/5qZ3BJPt74vkKd7GfSQcYuJ0XEfyHkRgWOO691g=="}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:42:00.416841 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-05167bc4-48bb-42ea-920f-ceddbe85aae8 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Getting quotas for project cb8038d51a764867a85d2eab4ac10d94. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:42:00.436095 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-05167bc4-48bb-42ea-920f-ceddbe85aae8 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Getting quotas for user 2b206b1f0a1d4f6ebefffc97c51e6f51 and project cb8038d51a764867a85d2eab4ac10d94. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:42:00.488384 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-05167bc4-48bb-42ea-920f-ceddbe85aae8 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.385575 Sep 08 10:42:00.488998 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 648/1215] 10.222.0.27 () {60 vars in 1159 bytes} [Thu Sep 8 10:42:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:42:00.613091 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1f8cfac9-4c58-45d7-a061-ea1f52a478fd tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:00.625263 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1f8cfac9-4c58-45d7-a061-ea1f52a478fd tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:00.627432 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1f8cfac9-4c58-45d7-a061-ea1f52a478fd tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:00.628940 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1f8cfac9-4c58-45d7-a061-ea1f52a478fd tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e" status: 200 len: 1810 microversion: 2.25 time: 0.352292 Sep 08 10:42:00.630114 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 568/1216] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:42:00 2022] GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e => generated 1810 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:42:00.635200 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fb2675b8-98e2-4fe4-953b-b5a86cb79a5a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:00.636167 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fb2675b8-98e2-4fe4-953b-b5a86cb79a5a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 2f4552b5-2e31-458b-b0f3-5bd551cc9ced] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:00.653247 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0b7acc99-8c5a-4689-9384-51633b2ac549 tempest-FloatingIPDetailsTestJSON-1685842162 tempest-FloatingIPDetailsTestJSON-1685842162-project] Action: 'create', calling method: .version_select at 0x7f68e44bbaf0>, body: {"pool": null} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:42:00.654124 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb2675b8-98e2-4fe4-953b-b5a86cb79a5a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:00.655643 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb2675b8-98e2-4fe4-953b-b5a86cb79a5a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:00.656344 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb2675b8-98e2-4fe4-953b-b5a86cb79a5a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:00.657323 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb2675b8-98e2-4fe4-953b-b5a86cb79a5a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:00.658864 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb2675b8-98e2-4fe4-953b-b5a86cb79a5a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:00.659613 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb2675b8-98e2-4fe4-953b-b5a86cb79a5a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:00.703791 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb2675b8-98e2-4fe4-953b-b5a86cb79a5a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:00.704456 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb2675b8-98e2-4fe4-953b-b5a86cb79a5a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:00.705230 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb2675b8-98e2-4fe4-953b-b5a86cb79a5a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:00.705843 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-fb2675b8-98e2-4fe4-953b-b5a86cb79a5a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lazy-loading 'fault' on Instance uuid 2f4552b5-2e31-458b-b0f3-5bd551cc9ced {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:42:00.796066 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-fb2675b8-98e2-4fe4-953b-b5a86cb79a5a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:00.808292 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fb2675b8-98e2-4fe4-953b-b5a86cb79a5a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/2f4552b5-2e31-458b-b0f3-5bd551cc9ced" status: 200 len: 1305 microversion: 2.1 time: 0.176270 Sep 08 10:42:00.825053 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 569/1217] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:00 2022] GET /compute/v2.1/servers/2f4552b5-2e31-458b-b0f3-5bd551cc9ced => generated 1305 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:00.915310 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-7e006a55-b2bc-4b98-bd46-89faba6d14e2 req-0d39636f-78d4-4428-bcbd-819398ec16dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26218db4-d06e-4ae2-8f15-f21004ce13b3", "tag": "94363ee7-29ad-4a4d-9c13-df432ed3359f"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:42:00.927646 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-7e006a55-b2bc-4b98-bd46-89faba6d14e2 req-0d39636f-78d4-4428-bcbd-819398ec16dc service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:00.929268 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-7e006a55-b2bc-4b98-bd46-89faba6d14e2 req-0d39636f-78d4-4428-bcbd-819398ec16dc service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:00.929962 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-7e006a55-b2bc-4b98-bd46-89faba6d14e2 req-0d39636f-78d4-4428-bcbd-819398ec16dc service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:00.946770 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-7e006a55-b2bc-4b98-bd46-89faba6d14e2 req-0d39636f-78d4-4428-bcbd-819398ec16dc service nova] Creating event network-changed:94363ee7-29ad-4a4d-9c13-df432ed3359f for instance 26218db4-d06e-4ae2-8f15-f21004ce13b3 on n-h1-850501-12 Sep 08 10:42:00.962698 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-7e006a55-b2bc-4b98-bd46-89faba6d14e2 req-0d39636f-78d4-4428-bcbd-819398ec16dc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140899 Sep 08 10:42:00.964989 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 570/1218] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:42:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:42:00.972740 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7478142f-f0b5-40ed-9369-b0595ac5bf29 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:00.974221 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7478142f-f0b5-40ed-9369-b0595ac5bf29 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] [instance: 26218db4-d06e-4ae2-8f15-f21004ce13b3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:00.993210 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7478142f-f0b5-40ed-9369-b0595ac5bf29 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:00.994033 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7478142f-f0b5-40ed-9369-b0595ac5bf29 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:00.994722 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7478142f-f0b5-40ed-9369-b0595ac5bf29 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:00.995611 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7478142f-f0b5-40ed-9369-b0595ac5bf29 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:00.996696 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7478142f-f0b5-40ed-9369-b0595ac5bf29 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:00.996696 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7478142f-f0b5-40ed-9369-b0595ac5bf29 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:01.031574 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:42:01.386552 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7478142f-f0b5-40ed-9369-b0595ac5bf29 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae3291d8d8f40dc98be9c965ba86adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d59ac71b6f459ea38d5ddc24964216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:01.402460 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7478142f-f0b5-40ed-9369-b0595ac5bf29 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] 10.222.0.27 "GET /compute/v2.1/servers/26218db4-d06e-4ae2-8f15-f21004ce13b3" status: 200 len: 1316 microversion: 2.1 time: 0.435772 Sep 08 10:42:01.416453 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 571/1219] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:00 2022] GET /compute/v2.1/servers/26218db4-d06e-4ae2-8f15-f21004ce13b3 => generated 1316 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:01.429279 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-10500b9a-c642-41b4-b210-7175135ce64b tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:01.430244 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-10500b9a-c642-41b4-b210-7175135ce64b tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: a3a6ce0f-e362-4cbc-afc2-3cfd349a4812] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:01.436980 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-10500b9a-c642-41b4-b210-7175135ce64b tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:01.437812 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-10500b9a-c642-41b4-b210-7175135ce64b tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:01.438488 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-10500b9a-c642-41b4-b210-7175135ce64b tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:01.440241 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-10500b9a-c642-41b4-b210-7175135ce64b tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:01.441247 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-10500b9a-c642-41b4-b210-7175135ce64b tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:01.441988 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-10500b9a-c642-41b4-b210-7175135ce64b tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:01.809379 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-10500b9a-c642-41b4-b210-7175135ce64b tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:01.820144 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-10500b9a-c642-41b4-b210-7175135ce64b tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812" status: 200 len: 1542 microversion: 2.1 time: 0.395329 Sep 08 10:42:01.821241 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 572/1220] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:01 2022] GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812 => generated 1542 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:01.826903 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2a840adf-cd98-475e-9462-4d7f7fc59833 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:01.827945 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2a840adf-cd98-475e-9462-4d7f7fc59833 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 133a5f12-39e5-4e0f-81dc-b1948c073f15] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:01.835660 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2a840adf-cd98-475e-9462-4d7f7fc59833 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:01.836707 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2a840adf-cd98-475e-9462-4d7f7fc59833 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:01.837767 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2a840adf-cd98-475e-9462-4d7f7fc59833 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:01.838795 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2a840adf-cd98-475e-9462-4d7f7fc59833 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:01.839537 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2a840adf-cd98-475e-9462-4d7f7fc59833 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:01.840233 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2a840adf-cd98-475e-9462-4d7f7fc59833 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:02.177578 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2a840adf-cd98-475e-9462-4d7f7fc59833 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:02.201111 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2a840adf-cd98-475e-9462-4d7f7fc59833 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15" status: 200 len: 1718 microversion: 2.1 time: 0.378417 Sep 08 10:42:02.237269 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 573/1221] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:01 2022] GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15 => generated 1718 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:02.258579 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-72fa5fb6-7588-47ab-9fb1-83d0e49e5b17 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:02.259940 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-72fa5fb6-7588-47ab-9fb1-83d0e49e5b17 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:02.274342 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-72fa5fb6-7588-47ab-9fb1-83d0e49e5b17 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:02.276327 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-72fa5fb6-7588-47ab-9fb1-83d0e49e5b17 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:02.277388 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-72fa5fb6-7588-47ab-9fb1-83d0e49e5b17 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:02.278836 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-72fa5fb6-7588-47ab-9fb1-83d0e49e5b17 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:02.279852 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-72fa5fb6-7588-47ab-9fb1-83d0e49e5b17 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:02.280877 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-72fa5fb6-7588-47ab-9fb1-83d0e49e5b17 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:02.628979 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-72fa5fb6-7588-47ab-9fb1-83d0e49e5b17 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:02.644103 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-72fa5fb6-7588-47ab-9fb1-83d0e49e5b17 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:02.648282 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-72fa5fb6-7588-47ab-9fb1-83d0e49e5b17 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:02.650690 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-72fa5fb6-7588-47ab-9fb1-83d0e49e5b17 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e" status: 200 len: 1810 microversion: 2.25 time: 0.411013 Sep 08 10:42:02.674227 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 574/1222] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:42:02 2022] GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e => generated 1810 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:42:02.682265 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-efd60d91-e0fc-440b-ae20-4ee74bef054c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:02.682906 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-efd60d91-e0fc-440b-ae20-4ee74bef054c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 2f4552b5-2e31-458b-b0f3-5bd551cc9ced] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:02.694013 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-efd60d91-e0fc-440b-ae20-4ee74bef054c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:02.695236 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-efd60d91-e0fc-440b-ae20-4ee74bef054c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:02.696230 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-efd60d91-e0fc-440b-ae20-4ee74bef054c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:02.698547 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-efd60d91-e0fc-440b-ae20-4ee74bef054c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:02.699219 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-efd60d91-e0fc-440b-ae20-4ee74bef054c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:02.699842 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-efd60d91-e0fc-440b-ae20-4ee74bef054c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:02.719619 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-efd60d91-e0fc-440b-ae20-4ee74bef054c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] HTTP exception thrown: Instance 2f4552b5-2e31-458b-b0f3-5bd551cc9ced could not be found. Sep 08 10:42:02.723045 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-efd60d91-e0fc-440b-ae20-4ee74bef054c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Request method failure captured: Sep 08 10:42:02.723045 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/2f4552b5-2e31-458b-b0f3-5bd551cc9ced HTTP/1.1 Sep 08 10:42:02.723045 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:42:02.723045 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:42:02.723045 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:42:02.723045 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:42:02.723045 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:42:02.723045 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:42:02.723045 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:42:02.723045 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:42:02.723045 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcbOYaOup_Ia1bHuprOxxP_LkfdCzYSX9xstQr2GVmRBueUQ0e967rlioz5jpJV566ZCuz_bYy_us0o8_CIFlOGOVfrC9_e_1_vEhZ3YdgjG89HBhaIJ_lG7Uv4nQrC-nfHrMx_LNyd0rOd4Blcm801SOcX7oe5VDxGTE8KVTDSeMPw Sep 08 10:42:02.723045 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:42:02.723045 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:42:02.723045 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:42:02.723045 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:42:02.723045 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:42:02.723045 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:42:02.723045 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 998378cc815344ba8a107d1cd61f40fd Sep 08 10:42:02.723045 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-DeleteServersTestJSON-69164830 Sep 08 10:42:02.723045 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:42:02.723045 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:42:02.723045 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:42:02.723045 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-DeleteServersTestJSON-69164830 Sep 08 10:42:02.723045 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 998378cc815344ba8a107d1cd61f40fd Sep 08 10:42:02.723045 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-DeleteServersTestJSON-69164830 Sep 08 10:42:02.723045 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-DeleteServersTestJSON-69164830-project Sep 08 10:42:02.723045 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:42:02.723045 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:42:02.723045 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: d08269c53bcb41c88953e7c79f5ad185 Sep 08 10:42:02.723045 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-DeleteServersTestJSON-69164830-project Sep 08 10:42:02.723045 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:42:02.723045 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 2f4552b5-2e31-458b-b0f3-5bd551cc9ced could not be found. Sep 08 10:42:02.723045 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '2f4552b5-2e31-458b-b0f3-5bd551cc9ced'} Sep 08 10:42:02.723045 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:42:02.723045 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:42:02.723045 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:42:02.723045 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:42:02.723045 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:42:02.723045 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:42:02.723045 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:42:02.723045 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:42:02.723045 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:42:02.723045 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:42:02.723045 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f4552b5-2e31-458b-b0f3-5bd551cc9ced could not be found. Sep 08 10:42:02.723045 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:42:02.723045 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:42:02.723045 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:42:02.723045 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:42:02.723045 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:42:02.723045 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:42:02.723045 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:42:02.723045 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:42:02.723045 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:42:02.723045 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:42:02.723045 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:42:02.723045 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:42:02.723045 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:42:02.723045 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:42:02.723045 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:42:02.723045 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:42:02.723045 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f4552b5-2e31-458b-b0f3-5bd551cc9ced could not be found. Sep 08 10:42:02.723045 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:42:02.723045 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:42:02.723045 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:42:02.728555 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:42:02.728555 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:42:02.728555 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:42:02.728555 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:42:02.728555 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:42:02.728555 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f4552b5-2e31-458b-b0f3-5bd551cc9ced could not be found. Sep 08 10:42:02.728555 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:42:02.731167 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-efd60d91-e0fc-440b-ae20-4ee74bef054c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Returning 404 to user: Instance 2f4552b5-2e31-458b-b0f3-5bd551cc9ced could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:42:02.732453 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-efd60d91-e0fc-440b-ae20-4ee74bef054c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/2f4552b5-2e31-458b-b0f3-5bd551cc9ced" status: 404 len: 111 microversion: 2.1 time: 0.056889 Sep 08 10:42:02.733918 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 575/1223] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:02 2022] GET /compute/v2.1/servers/2f4552b5-2e31-458b-b0f3-5bd551cc9ced => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:42:02.740698 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bfa779fd-3cf9-4ea5-83f2-ddb2ea755090 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:02.741653 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bfa779fd-3cf9-4ea5-83f2-ddb2ea755090 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] [instance: 26218db4-d06e-4ae2-8f15-f21004ce13b3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:02.765059 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bfa779fd-3cf9-4ea5-83f2-ddb2ea755090 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:02.765717 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bfa779fd-3cf9-4ea5-83f2-ddb2ea755090 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:02.766181 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bfa779fd-3cf9-4ea5-83f2-ddb2ea755090 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:02.767449 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bfa779fd-3cf9-4ea5-83f2-ddb2ea755090 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:02.773953 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bfa779fd-3cf9-4ea5-83f2-ddb2ea755090 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:02.774495 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bfa779fd-3cf9-4ea5-83f2-ddb2ea755090 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:03.045422 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-bfa779fd-3cf9-4ea5-83f2-ddb2ea755090 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae3291d8d8f40dc98be9c965ba86adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d59ac71b6f459ea38d5ddc24964216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:03.060257 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bfa779fd-3cf9-4ea5-83f2-ddb2ea755090 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] 10.222.0.27 "GET /compute/v2.1/servers/26218db4-d06e-4ae2-8f15-f21004ce13b3" status: 200 len: 1316 microversion: 2.1 time: 0.324733 Sep 08 10:42:03.073121 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 576/1224] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:02 2022] GET /compute/v2.1/servers/26218db4-d06e-4ae2-8f15-f21004ce13b3 => generated 1316 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:03.073121 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4e41c636-ed0b-454f-bda2-9ec31d5d9253 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:03.073121 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4e41c636-ed0b-454f-bda2-9ec31d5d9253 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: a3a6ce0f-e362-4cbc-afc2-3cfd349a4812] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:03.075039 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4e41c636-ed0b-454f-bda2-9ec31d5d9253 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:03.075401 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4e41c636-ed0b-454f-bda2-9ec31d5d9253 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:03.075940 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4e41c636-ed0b-454f-bda2-9ec31d5d9253 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:03.076803 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4e41c636-ed0b-454f-bda2-9ec31d5d9253 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:03.078607 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4e41c636-ed0b-454f-bda2-9ec31d5d9253 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:03.079992 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4e41c636-ed0b-454f-bda2-9ec31d5d9253 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:03.302099 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4e41c636-ed0b-454f-bda2-9ec31d5d9253 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:03.312471 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4e41c636-ed0b-454f-bda2-9ec31d5d9253 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812" status: 200 len: 1542 microversion: 2.1 time: 0.250082 Sep 08 10:42:03.325057 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 577/1225] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:03 2022] GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812 => generated 1542 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:03.337647 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fde1dc40-d5fb-49ff-86a1-60583f7ed4d3 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-347127179", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "cf032a39-d4e2-476c-8052-c76f4ee567c9"}]}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:42:03.424790 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-fde1dc40-d5fb-49ff-86a1-60583f7ed4d3 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] validate_networks() for [('cf032a39-d4e2-476c-8052-c76f4ee567c9', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:42:03.949996 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-fde1dc40-d5fb-49ff-86a1-60583f7ed4d3 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:42:03.950945 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-fde1dc40-d5fb-49ff-86a1-60583f7ed4d3 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:42:03.951641 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-fde1dc40-d5fb-49ff-86a1-60583f7ed4d3 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:42:03.952232 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-fde1dc40-d5fb-49ff-86a1-60583f7ed4d3 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:42:03.952832 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-fde1dc40-d5fb-49ff-86a1-60583f7ed4d3 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:42:03.967296 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fde1dc40-d5fb-49ff-86a1-60583f7ed4d3 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:03.967804 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fde1dc40-d5fb-49ff-86a1-60583f7ed4d3 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:03.968253 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fde1dc40-d5fb-49ff-86a1-60583f7ed4d3 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:03.969006 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fde1dc40-d5fb-49ff-86a1-60583f7ed4d3 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:03.970081 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fde1dc40-d5fb-49ff-86a1-60583f7ed4d3 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:03.971125 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fde1dc40-d5fb-49ff-86a1-60583f7ed4d3 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:03.992682 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-fde1dc40-d5fb-49ff-86a1-60583f7ed4d3 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Getting quotas for project 998378cc815344ba8a107d1cd61f40fd. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:42:04.001553 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-fde1dc40-d5fb-49ff-86a1-60583f7ed4d3 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Getting quotas for user d08269c53bcb41c88953e7c79f5ad185 and project 998378cc815344ba8a107d1cd61f40fd. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:42:04.026478 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fde1dc40-d5fb-49ff-86a1-60583f7ed4d3 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:42:04.029301 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fde1dc40-d5fb-49ff-86a1-60583f7ed4d3 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: c1406c0f-748a-4dae-9392-6957d4092c9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:42:04.105018 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fde1dc40-d5fb-49ff-86a1-60583f7ed4d3 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.789496 Sep 08 10:42:04.106155 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 578/1226] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:42:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 792 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:42:04.111667 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-14cb6598-f439-4687-b5ff-d0d2b2dbef0e req-b7230188-7f5e-4473-a4aa-f77b2ce47452 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e", "name": "network-vif-unplugged", "status": "completed", "tag": "1db6620e-f793-4486-a97c-149109663837"}, {"name": "network-changed", "server_uuid": "4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e", "tag": "1db6620e-f793-4486-a97c-149109663837"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:42:04.126147 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-14cb6598-f439-4687-b5ff-d0d2b2dbef0e req-b7230188-7f5e-4473-a4aa-f77b2ce47452 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:04.126682 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-14cb6598-f439-4687-b5ff-d0d2b2dbef0e req-b7230188-7f5e-4473-a4aa-f77b2ce47452 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:04.127898 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-14cb6598-f439-4687-b5ff-d0d2b2dbef0e req-b7230188-7f5e-4473-a4aa-f77b2ce47452 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:04.166185 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-14cb6598-f439-4687-b5ff-d0d2b2dbef0e req-b7230188-7f5e-4473-a4aa-f77b2ce47452 service nova] Creating event network-vif-unplugged:1db6620e-f793-4486-a97c-149109663837 for instance 4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e on n-h1-850501-12 Sep 08 10:42:04.167310 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-14cb6598-f439-4687-b5ff-d0d2b2dbef0e req-b7230188-7f5e-4473-a4aa-f77b2ce47452 service nova] Creating event network-changed:1db6620e-f793-4486-a97c-149109663837 for instance 4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e on n-h1-850501-12 Sep 08 10:42:04.179968 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-14cb6598-f439-4687-b5ff-d0d2b2dbef0e req-b7230188-7f5e-4473-a4aa-f77b2ce47452 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.071186 Sep 08 10:42:04.182014 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 579/1227] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:42:04 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:42:04.195985 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cabd7137-c48b-4750-8df9-a2e650cd7ff5 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:04.197775 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cabd7137-c48b-4750-8df9-a2e650cd7ff5 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 133a5f12-39e5-4e0f-81dc-b1948c073f15] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:04.210651 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cabd7137-c48b-4750-8df9-a2e650cd7ff5 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:04.211993 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cabd7137-c48b-4750-8df9-a2e650cd7ff5 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:04.212706 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cabd7137-c48b-4750-8df9-a2e650cd7ff5 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:04.214715 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cabd7137-c48b-4750-8df9-a2e650cd7ff5 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:04.215728 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cabd7137-c48b-4750-8df9-a2e650cd7ff5 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:04.216765 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cabd7137-c48b-4750-8df9-a2e650cd7ff5 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:04.748377 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-cabd7137-c48b-4750-8df9-a2e650cd7ff5 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:04.770198 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cabd7137-c48b-4750-8df9-a2e650cd7ff5 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15" status: 200 len: 1718 microversion: 2.1 time: 0.586048 Sep 08 10:42:04.771052 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 580/1228] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:04 2022] GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15 => generated 1718 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:04.776901 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-66fced37-9334-4e3e-b167-8540db8d40e1 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:04.778038 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-66fced37-9334-4e3e-b167-8540db8d40e1 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:04.786162 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-66fced37-9334-4e3e-b167-8540db8d40e1 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:04.787343 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-66fced37-9334-4e3e-b167-8540db8d40e1 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:04.788337 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-66fced37-9334-4e3e-b167-8540db8d40e1 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:04.789296 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-66fced37-9334-4e3e-b167-8540db8d40e1 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:04.789948 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-66fced37-9334-4e3e-b167-8540db8d40e1 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:04.790720 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-66fced37-9334-4e3e-b167-8540db8d40e1 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:05.091808 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-66fced37-9334-4e3e-b167-8540db8d40e1 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:05.103841 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-66fced37-9334-4e3e-b167-8540db8d40e1 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:05.105501 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-66fced37-9334-4e3e-b167-8540db8d40e1 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:05.106775 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-66fced37-9334-4e3e-b167-8540db8d40e1 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e" status: 200 len: 1810 microversion: 2.25 time: 0.334013 Sep 08 10:42:05.107795 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 581/1229] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:42:04 2022] GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e => generated 1810 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:42:05.113630 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3813fc9e-1d3c-4679-a0fe-b83bbce294e8 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:05.114548 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3813fc9e-1d3c-4679-a0fe-b83bbce294e8 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] [instance: 26218db4-d06e-4ae2-8f15-f21004ce13b3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:05.129894 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3813fc9e-1d3c-4679-a0fe-b83bbce294e8 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:05.139676 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3813fc9e-1d3c-4679-a0fe-b83bbce294e8 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:05.140465 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3813fc9e-1d3c-4679-a0fe-b83bbce294e8 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:05.141510 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3813fc9e-1d3c-4679-a0fe-b83bbce294e8 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:05.142365 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3813fc9e-1d3c-4679-a0fe-b83bbce294e8 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:05.143111 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3813fc9e-1d3c-4679-a0fe-b83bbce294e8 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:05.395879 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-3813fc9e-1d3c-4679-a0fe-b83bbce294e8 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae3291d8d8f40dc98be9c965ba86adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d59ac71b6f459ea38d5ddc24964216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:05.411073 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3813fc9e-1d3c-4679-a0fe-b83bbce294e8 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] 10.222.0.27 "GET /compute/v2.1/servers/26218db4-d06e-4ae2-8f15-f21004ce13b3" status: 200 len: 1316 microversion: 2.1 time: 0.301838 Sep 08 10:42:05.412956 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 582/1230] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:05 2022] GET /compute/v2.1/servers/26218db4-d06e-4ae2-8f15-f21004ce13b3 => generated 1316 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:05.420305 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d1ed89f0-a436-4c20-8096-73556e0b0fb3 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:05.421462 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d1ed89f0-a436-4c20-8096-73556e0b0fb3 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: c1406c0f-748a-4dae-9392-6957d4092c9f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:05.430683 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d1ed89f0-a436-4c20-8096-73556e0b0fb3 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:05.431564 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d1ed89f0-a436-4c20-8096-73556e0b0fb3 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:05.432206 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d1ed89f0-a436-4c20-8096-73556e0b0fb3 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:05.433298 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d1ed89f0-a436-4c20-8096-73556e0b0fb3 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:05.434230 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d1ed89f0-a436-4c20-8096-73556e0b0fb3 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:05.434928 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d1ed89f0-a436-4c20-8096-73556e0b0fb3 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:05.571886 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0b7acc99-8c5a-4689-9384-51633b2ac549 tempest-FloatingIPDetailsTestJSON-1685842162 tempest-FloatingIPDetailsTestJSON-1685842162-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.080720 Sep 08 10:42:05.573431 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 649/1231] 10.222.0.27 () {60 vars in 1170 bytes} [Thu Sep 8 10:42:00 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5084 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:42:05.578328 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d1ed89f0-a436-4c20-8096-73556e0b0fb3 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:05.590795 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d1ed89f0-a436-4c20-8096-73556e0b0fb3 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/c1406c0f-748a-4dae-9392-6957d4092c9f" status: 200 len: 1266 microversion: 2.1 time: 0.174396 Sep 08 10:42:05.591053 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-390a02e2-116c-4bf6-ba09-61b5f93a07cd tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:05.594681 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-390a02e2-116c-4bf6-ba09-61b5f93a07cd tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: a3a6ce0f-e362-4cbc-afc2-3cfd349a4812] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:05.605694 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 583/1232] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:05 2022] GET /compute/v2.1/servers/c1406c0f-748a-4dae-9392-6957d4092c9f => generated 1266 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:05.612389 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-521bcafe-88a3-402c-8e75-1a9fbbec91a6 tempest-FloatingIPDetailsTestJSON-1685842162 tempest-FloatingIPDetailsTestJSON-1685842162-project] Action: 'create', calling method: .version_select at 0x7f68e46411f0>, body: {"pool": null} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:42:05.627591 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=6,nova_api:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:42:05.630441 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-390a02e2-116c-4bf6-ba09-61b5f93a07cd tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:05.631436 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-390a02e2-116c-4bf6-ba09-61b5f93a07cd tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:05.632448 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-390a02e2-116c-4bf6-ba09-61b5f93a07cd tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:05.633687 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-390a02e2-116c-4bf6-ba09-61b5f93a07cd tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:05.634594 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-390a02e2-116c-4bf6-ba09-61b5f93a07cd tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:05.636106 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-390a02e2-116c-4bf6-ba09-61b5f93a07cd tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:05.668858 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:42:07.023801 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-390a02e2-116c-4bf6-ba09-61b5f93a07cd tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:07.048246 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-390a02e2-116c-4bf6-ba09-61b5f93a07cd tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812" status: 200 len: 1542 microversion: 2.1 time: 1.472670 Sep 08 10:42:07.050947 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 650/1233] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:05 2022] GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812 => generated 1542 bytes in 1476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:07.061288 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-561a4e1d-fad6-4f3b-b85f-55470a861be1 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:07.062578 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-561a4e1d-fad6-4f3b-b85f-55470a861be1 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 133a5f12-39e5-4e0f-81dc-b1948c073f15] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:07.074399 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-561a4e1d-fad6-4f3b-b85f-55470a861be1 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:07.075404 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-561a4e1d-fad6-4f3b-b85f-55470a861be1 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:07.076621 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-561a4e1d-fad6-4f3b-b85f-55470a861be1 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:07.080695 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-561a4e1d-fad6-4f3b-b85f-55470a861be1 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:07.083437 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-561a4e1d-fad6-4f3b-b85f-55470a861be1 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:07.085092 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-561a4e1d-fad6-4f3b-b85f-55470a861be1 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:07.807142 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-561a4e1d-fad6-4f3b-b85f-55470a861be1 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:07.821655 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-561a4e1d-fad6-4f3b-b85f-55470a861be1 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15" status: 200 len: 1718 microversion: 2.1 time: 0.767563 Sep 08 10:42:07.822274 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 651/1234] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:07 2022] GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15 => generated 1718 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:07.837441 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-15590184-3ec1-4f3f-a96f-6692cde5d71b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:07.840061 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-15590184-3ec1-4f3f-a96f-6692cde5d71b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:07.857917 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15590184-3ec1-4f3f-a96f-6692cde5d71b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:07.858824 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15590184-3ec1-4f3f-a96f-6692cde5d71b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:07.860638 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15590184-3ec1-4f3f-a96f-6692cde5d71b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:07.862034 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15590184-3ec1-4f3f-a96f-6692cde5d71b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:07.862795 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15590184-3ec1-4f3f-a96f-6692cde5d71b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:07.863382 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15590184-3ec1-4f3f-a96f-6692cde5d71b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:08.347899 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-521bcafe-88a3-402c-8e75-1a9fbbec91a6 tempest-FloatingIPDetailsTestJSON-1685842162 tempest-FloatingIPDetailsTestJSON-1685842162-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.740403 Sep 08 10:42:08.357996 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 584/1235] 10.222.0.27 () {60 vars in 1170 bytes} [Thu Sep 8 10:42:05 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2747 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:42:08.359754 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0e5b6923-06f2-43bb-98e0-f107d842b71b tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:08.364471 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0e5b6923-06f2-43bb-98e0-f107d842b71b tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] [instance: 26218db4-d06e-4ae2-8f15-f21004ce13b3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:08.382069 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e5b6923-06f2-43bb-98e0-f107d842b71b tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:08.383802 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e5b6923-06f2-43bb-98e0-f107d842b71b tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:08.384553 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e5b6923-06f2-43bb-98e0-f107d842b71b tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:08.385785 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e5b6923-06f2-43bb-98e0-f107d842b71b tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:08.386621 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e5b6923-06f2-43bb-98e0-f107d842b71b tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:08.387258 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e5b6923-06f2-43bb-98e0-f107d842b71b tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:08.658201 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0e5b6923-06f2-43bb-98e0-f107d842b71b tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae3291d8d8f40dc98be9c965ba86adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d59ac71b6f459ea38d5ddc24964216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:08.669949 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0e5b6923-06f2-43bb-98e0-f107d842b71b tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] 10.222.0.27 "GET /compute/v2.1/servers/26218db4-d06e-4ae2-8f15-f21004ce13b3" status: 200 len: 1316 microversion: 2.1 time: 0.314420 Sep 08 10:42:08.671094 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 585/1236] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:08 2022] GET /compute/v2.1/servers/26218db4-d06e-4ae2-8f15-f21004ce13b3 => generated 1316 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:08.679704 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a88bc341-4b7b-4e41-840d-3e3813f929e2 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:08.680664 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a88bc341-4b7b-4e41-840d-3e3813f929e2 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: c1406c0f-748a-4dae-9392-6957d4092c9f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:08.687881 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a88bc341-4b7b-4e41-840d-3e3813f929e2 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:08.689869 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a88bc341-4b7b-4e41-840d-3e3813f929e2 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:08.690678 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a88bc341-4b7b-4e41-840d-3e3813f929e2 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:08.691649 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a88bc341-4b7b-4e41-840d-3e3813f929e2 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:08.692128 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a88bc341-4b7b-4e41-840d-3e3813f929e2 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:08.692564 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a88bc341-4b7b-4e41-840d-3e3813f929e2 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:08.794780 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a88bc341-4b7b-4e41-840d-3e3813f929e2 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:08.809541 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a88bc341-4b7b-4e41-840d-3e3813f929e2 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/c1406c0f-748a-4dae-9392-6957d4092c9f" status: 200 len: 1272 microversion: 2.1 time: 0.136282 Sep 08 10:42:08.825208 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 586/1237] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:08 2022] GET /compute/v2.1/servers/c1406c0f-748a-4dae-9392-6957d4092c9f => generated 1272 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:08.825208 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-4ea81e9e-7fe5-4d69-9286-f4b72b43d915 req-058563a2-608f-4370-9530-1e2db049600d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26218db4-d06e-4ae2-8f15-f21004ce13b3", "name": "network-vif-plugged", "status": "completed", "tag": "94363ee7-29ad-4a4d-9c13-df432ed3359f"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:42:08.832305 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-4ea81e9e-7fe5-4d69-9286-f4b72b43d915 req-058563a2-608f-4370-9530-1e2db049600d service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:08.833001 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-4ea81e9e-7fe5-4d69-9286-f4b72b43d915 req-058563a2-608f-4370-9530-1e2db049600d service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:08.833668 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-4ea81e9e-7fe5-4d69-9286-f4b72b43d915 req-058563a2-608f-4370-9530-1e2db049600d service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:08.851972 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-4ea81e9e-7fe5-4d69-9286-f4b72b43d915 req-058563a2-608f-4370-9530-1e2db049600d service nova] Creating event network-vif-plugged:94363ee7-29ad-4a4d-9c13-df432ed3359f for instance 26218db4-d06e-4ae2-8f15-f21004ce13b3 on n-h1-850501-12 Sep 08 10:42:08.857888 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-4ea81e9e-7fe5-4d69-9286-f4b72b43d915 req-058563a2-608f-4370-9530-1e2db049600d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044353 Sep 08 10:42:08.858997 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 587/1238] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:42:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:42:08.867080 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c49739a2-6c9d-466c-b1da-a9c5961f3bde tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1663475794", "imageRef": "f3c316f8-807d-4124-832a-b82efa420c83", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "95614763-dbe6-473f-b9b1-cf052f9c42f8"}], "security_groups": [{"name": "tempest-securitygroup--1537797411"}], "key_name": "tempest-keypair-1348238802", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:42:08.928260 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-15590184-3ec1-4f3f-a96f-6692cde5d71b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:08.942431 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-15590184-3ec1-4f3f-a96f-6692cde5d71b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:08.945057 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-15590184-3ec1-4f3f-a96f-6692cde5d71b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:08.946940 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-15590184-3ec1-4f3f-a96f-6692cde5d71b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e" status: 200 len: 1810 microversion: 2.25 time: 1.122985 Sep 08 10:42:08.971949 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 652/1239] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:42:07 2022] GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e => generated 1810 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:42:08.979779 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1591e2fa-0405-454f-8521-aa7617af7a02 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:08.981049 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1591e2fa-0405-454f-8521-aa7617af7a02 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: a3a6ce0f-e362-4cbc-afc2-3cfd349a4812] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:08.990726 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1591e2fa-0405-454f-8521-aa7617af7a02 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:08.991300 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1591e2fa-0405-454f-8521-aa7617af7a02 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:08.991968 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1591e2fa-0405-454f-8521-aa7617af7a02 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:08.994677 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1591e2fa-0405-454f-8521-aa7617af7a02 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:08.995624 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1591e2fa-0405-454f-8521-aa7617af7a02 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:08.996302 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1591e2fa-0405-454f-8521-aa7617af7a02 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:09.196539 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-c49739a2-6c9d-466c-b1da-a9c5961f3bde tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] validate_networks() for [('95614763-dbe6-473f-b9b1-cf052f9c42f8', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:42:09.676712 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1591e2fa-0405-454f-8521-aa7617af7a02 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:09.689903 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1591e2fa-0405-454f-8521-aa7617af7a02 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812" status: 200 len: 1541 microversion: 2.1 time: 0.714176 Sep 08 10:42:09.691019 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 653/1240] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:08 2022] GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812 => generated 1541 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:09.700658 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5c1f46d7-bfb7-4ddd-808b-b92c80130230 tempest-FloatingIPDetailsTestJSON-1685842162 tempest-FloatingIPDetailsTestJSON-1685842162-project] Action: 'create', calling method: .version_select at 0x7f68e44c9ee0>, body: {"pool": null} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:42:09.843451 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-c49739a2-6c9d-466c-b1da-a9c5961f3bde tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:42:09.844332 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-c49739a2-6c9d-466c-b1da-a9c5961f3bde tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:42:09.846145 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-c49739a2-6c9d-466c-b1da-a9c5961f3bde tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:42:09.846842 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-c49739a2-6c9d-466c-b1da-a9c5961f3bde tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:42:09.847395 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-c49739a2-6c9d-466c-b1da-a9c5961f3bde tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:42:09.861217 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c49739a2-6c9d-466c-b1da-a9c5961f3bde tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:09.862779 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c49739a2-6c9d-466c-b1da-a9c5961f3bde tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:09.863632 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c49739a2-6c9d-466c-b1da-a9c5961f3bde tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:09.865327 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c49739a2-6c9d-466c-b1da-a9c5961f3bde tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:09.866063 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c49739a2-6c9d-466c-b1da-a9c5961f3bde tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:09.866796 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c49739a2-6c9d-466c-b1da-a9c5961f3bde tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:09.901891 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-c49739a2-6c9d-466c-b1da-a9c5961f3bde tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Getting quotas for project cb8038d51a764867a85d2eab4ac10d94. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:42:09.905134 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:42:09.916705 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-c49739a2-6c9d-466c-b1da-a9c5961f3bde tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Getting quotas for user 2b206b1f0a1d4f6ebefffc97c51e6f51 and project cb8038d51a764867a85d2eab4ac10d94. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:42:09.934524 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c49739a2-6c9d-466c-b1da-a9c5961f3bde tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:42:09.937312 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c49739a2-6c9d-466c-b1da-a9c5961f3bde tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] [instance: 790bcd42-ace5-4761-b46d-e0889855623f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f3c316f8-807d-4124-832a-b82efa420c83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:42:10.015516 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c49739a2-6c9d-466c-b1da-a9c5961f3bde tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.154635 Sep 08 10:42:10.017683 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 588/1241] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:42:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 1158 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:42:10.026175 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-871319d0-672d-458b-ab88-40346919fd0c tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:10.027613 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-871319d0-672d-458b-ab88-40346919fd0c tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 133a5f12-39e5-4e0f-81dc-b1948c073f15] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:10.038773 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-871319d0-672d-458b-ab88-40346919fd0c tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:10.039485 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-871319d0-672d-458b-ab88-40346919fd0c tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:10.039934 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-871319d0-672d-458b-ab88-40346919fd0c tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:10.040667 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-871319d0-672d-458b-ab88-40346919fd0c tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:10.041178 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-871319d0-672d-458b-ab88-40346919fd0c tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:10.041620 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-871319d0-672d-458b-ab88-40346919fd0c tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:10.259415 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-871319d0-672d-458b-ab88-40346919fd0c tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:10.270141 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-871319d0-672d-458b-ab88-40346919fd0c tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15" status: 200 len: 1718 microversion: 2.1 time: 0.250949 Sep 08 10:42:10.270934 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 589/1242] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:10 2022] GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15 => generated 1718 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:10.277166 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f38ac2c6-9d7b-4395-bedf-04428b0d3def tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:10.278201 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f38ac2c6-9d7b-4395-bedf-04428b0d3def tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] [instance: 26218db4-d06e-4ae2-8f15-f21004ce13b3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:10.286364 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f38ac2c6-9d7b-4395-bedf-04428b0d3def tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:10.287903 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f38ac2c6-9d7b-4395-bedf-04428b0d3def tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:10.289099 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f38ac2c6-9d7b-4395-bedf-04428b0d3def tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:10.290674 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f38ac2c6-9d7b-4395-bedf-04428b0d3def tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:10.292151 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f38ac2c6-9d7b-4395-bedf-04428b0d3def tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:10.293257 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f38ac2c6-9d7b-4395-bedf-04428b0d3def tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:10.457657 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=4 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:42:10.488068 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f38ac2c6-9d7b-4395-bedf-04428b0d3def tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae3291d8d8f40dc98be9c965ba86adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d59ac71b6f459ea38d5ddc24964216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:10.496224 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f38ac2c6-9d7b-4395-bedf-04428b0d3def tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] 10.222.0.27 "GET /compute/v2.1/servers/26218db4-d06e-4ae2-8f15-f21004ce13b3" status: 200 len: 1316 microversion: 2.1 time: 0.223464 Sep 08 10:42:10.498650 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 590/1243] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:10 2022] GET /compute/v2.1/servers/26218db4-d06e-4ae2-8f15-f21004ce13b3 => generated 1316 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:10.504924 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-10fc09c6-2498-4f21-bea6-9388cdb8f178 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:10.505872 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-10fc09c6-2498-4f21-bea6-9388cdb8f178 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: c1406c0f-748a-4dae-9392-6957d4092c9f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:10.512527 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-10fc09c6-2498-4f21-bea6-9388cdb8f178 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:10.513332 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-10fc09c6-2498-4f21-bea6-9388cdb8f178 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:10.514023 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-10fc09c6-2498-4f21-bea6-9388cdb8f178 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:10.515243 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-10fc09c6-2498-4f21-bea6-9388cdb8f178 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:10.515932 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-10fc09c6-2498-4f21-bea6-9388cdb8f178 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:10.517289 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-10fc09c6-2498-4f21-bea6-9388cdb8f178 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:10.702806 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-10fc09c6-2498-4f21-bea6-9388cdb8f178 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:10.713277 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-10fc09c6-2498-4f21-bea6-9388cdb8f178 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/c1406c0f-748a-4dae-9392-6957d4092c9f" status: 200 len: 1314 microversion: 2.1 time: 0.212935 Sep 08 10:42:10.726475 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 591/1244] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:10 2022] GET /compute/v2.1/servers/c1406c0f-748a-4dae-9392-6957d4092c9f => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:10.733592 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-662b1186-41ca-4c8c-a473-456c8787b85d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:10.734696 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-662b1186-41ca-4c8c-a473-456c8787b85d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:10.743815 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-662b1186-41ca-4c8c-a473-456c8787b85d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:10.744599 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-662b1186-41ca-4c8c-a473-456c8787b85d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:10.745256 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-662b1186-41ca-4c8c-a473-456c8787b85d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:10.746144 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-662b1186-41ca-4c8c-a473-456c8787b85d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:10.747293 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-662b1186-41ca-4c8c-a473-456c8787b85d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:10.748066 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-662b1186-41ca-4c8c-a473-456c8787b85d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:10.754029 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=100 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:42:10.967793 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-662b1186-41ca-4c8c-a473-456c8787b85d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:10.995644 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-662b1186-41ca-4c8c-a473-456c8787b85d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:11.000000 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-662b1186-41ca-4c8c-a473-456c8787b85d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:11.005602 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-662b1186-41ca-4c8c-a473-456c8787b85d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e" status: 200 len: 1810 microversion: 2.25 time: 0.277125 Sep 08 10:42:11.007570 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 592/1245] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:42:10 2022] GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e => generated 1810 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:42:11.020916 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-41611e45-b5d3-451e-9801-66ec62d18aac tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:11.021860 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-41611e45-b5d3-451e-9801-66ec62d18aac tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] [instance: 790bcd42-ace5-4761-b46d-e0889855623f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:11.030832 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41611e45-b5d3-451e-9801-66ec62d18aac tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:11.031501 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41611e45-b5d3-451e-9801-66ec62d18aac tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:11.032615 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41611e45-b5d3-451e-9801-66ec62d18aac tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:11.034247 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41611e45-b5d3-451e-9801-66ec62d18aac tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:11.034949 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41611e45-b5d3-451e-9801-66ec62d18aac tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:11.035627 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41611e45-b5d3-451e-9801-66ec62d18aac tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:11.176897 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-41611e45-b5d3-451e-9801-66ec62d18aac tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b206b1f0a1d4f6ebefffc97c51e6f51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8038d51a764867a85d2eab4ac10d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:11.194911 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-41611e45-b5d3-451e-9801-66ec62d18aac tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] 10.222.0.27 "GET /compute/v2.1/servers/790bcd42-ace5-4761-b46d-e0889855623f" status: 200 len: 1298 microversion: 2.1 time: 0.183919 Sep 08 10:42:11.212045 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 593/1246] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:11 2022] GET /compute/v2.1/servers/790bcd42-ace5-4761-b46d-e0889855623f => generated 1298 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:11.212045 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-281e48e9-e008-416a-b604-0b137ab222cb req-fee66f65-98e6-4b99-8c89-0fbdf0693781 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "133a5f12-39e5-4e0f-81dc-b1948c073f15", "name": "network-vif-unplugged", "status": "completed", "tag": "f7bbb779-b8ca-4ca2-b84e-e3203ed8de69"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:42:11.223952 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-281e48e9-e008-416a-b604-0b137ab222cb req-fee66f65-98e6-4b99-8c89-0fbdf0693781 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:11.225315 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-281e48e9-e008-416a-b604-0b137ab222cb req-fee66f65-98e6-4b99-8c89-0fbdf0693781 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:11.226110 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-281e48e9-e008-416a-b604-0b137ab222cb req-fee66f65-98e6-4b99-8c89-0fbdf0693781 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:11.249406 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-281e48e9-e008-416a-b604-0b137ab222cb req-fee66f65-98e6-4b99-8c89-0fbdf0693781 service nova] Creating event network-vif-unplugged:f7bbb779-b8ca-4ca2-b84e-e3203ed8de69 for instance 133a5f12-39e5-4e0f-81dc-b1948c073f15 on n-h2-850501-12 Sep 08 10:42:11.258878 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-281e48e9-e008-416a-b604-0b137ab222cb req-fee66f65-98e6-4b99-8c89-0fbdf0693781 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060528 Sep 08 10:42:11.260408 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 594/1247] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:42:11.269458 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-368e3999-4d37-42c5-b2bc-789649661afe tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:11.270467 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-368e3999-4d37-42c5-b2bc-789649661afe tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: a3a6ce0f-e362-4cbc-afc2-3cfd349a4812] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:11.278697 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-368e3999-4d37-42c5-b2bc-789649661afe tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:11.279197 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-368e3999-4d37-42c5-b2bc-789649661afe tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:11.279645 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-368e3999-4d37-42c5-b2bc-789649661afe tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:11.280377 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-368e3999-4d37-42c5-b2bc-789649661afe tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:11.280841 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-368e3999-4d37-42c5-b2bc-789649661afe tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:11.281485 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-368e3999-4d37-42c5-b2bc-789649661afe tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:11.531442 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-368e3999-4d37-42c5-b2bc-789649661afe tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:11.543280 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-368e3999-4d37-42c5-b2bc-789649661afe tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812" status: 200 len: 1473 microversion: 2.1 time: 0.281199 Sep 08 10:42:11.543904 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 595/1248] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:11 2022] GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812 => generated 1473 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:11.551403 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-86aeace5-8cce-486a-aca8-ed6b5d0e1873 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:11.552219 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-86aeace5-8cce-486a-aca8-ed6b5d0e1873 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 133a5f12-39e5-4e0f-81dc-b1948c073f15] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:11.560641 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-86aeace5-8cce-486a-aca8-ed6b5d0e1873 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:11.561230 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-86aeace5-8cce-486a-aca8-ed6b5d0e1873 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:11.561696 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-86aeace5-8cce-486a-aca8-ed6b5d0e1873 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:11.562404 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-86aeace5-8cce-486a-aca8-ed6b5d0e1873 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:11.562855 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-86aeace5-8cce-486a-aca8-ed6b5d0e1873 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:11.563338 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-86aeace5-8cce-486a-aca8-ed6b5d0e1873 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:11.744619 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-86aeace5-8cce-486a-aca8-ed6b5d0e1873 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:11.759780 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-86aeace5-8cce-486a-aca8-ed6b5d0e1873 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15" status: 200 len: 1718 microversion: 2.1 time: 0.214403 Sep 08 10:42:11.773981 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 596/1249] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:11 2022] GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15 => generated 1718 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:11.909059 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-3e7e6815-1e47-4147-bb31-f9c888ae69ab req-b39ae5ba-2f3b-46b7-b544-0466422a1aca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3a6ce0f-e362-4cbc-afc2-3cfd349a4812", "name": "network-vif-unplugged", "status": "completed", "tag": "8ff15ca8-cc64-424e-b9f6-8f38b142e5ac"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:42:11.921860 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-3e7e6815-1e47-4147-bb31-f9c888ae69ab req-b39ae5ba-2f3b-46b7-b544-0466422a1aca service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:11.922747 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-3e7e6815-1e47-4147-bb31-f9c888ae69ab req-b39ae5ba-2f3b-46b7-b544-0466422a1aca service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:11.924235 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-3e7e6815-1e47-4147-bb31-f9c888ae69ab req-b39ae5ba-2f3b-46b7-b544-0466422a1aca service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:11.940573 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-3e7e6815-1e47-4147-bb31-f9c888ae69ab req-b39ae5ba-2f3b-46b7-b544-0466422a1aca service nova] Creating event network-vif-unplugged:8ff15ca8-cc64-424e-b9f6-8f38b142e5ac for instance a3a6ce0f-e362-4cbc-afc2-3cfd349a4812 on n-h1-850501-12 Sep 08 10:42:11.946828 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [req-3e7e6815-1e47-4147-bb31-f9c888ae69ab req-b39ae5ba-2f3b-46b7-b544-0466422a1aca service nova] Instance a3a6ce0f-e362-4cbc-afc2-3cfd349a4812 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850501-12'} {{(pid=128861) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 10:42:11.955165 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-3e7e6815-1e47-4147-bb31-f9c888ae69ab req-b39ae5ba-2f3b-46b7-b544-0466422a1aca service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.179473 Sep 08 10:42:11.956250 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 597/1250] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:42:11.964531 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-14de0168-c7ec-4be4-b1e2-83691078198f tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:11.965601 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-14de0168-c7ec-4be4-b1e2-83691078198f tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] [instance: 26218db4-d06e-4ae2-8f15-f21004ce13b3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:11.975207 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-14de0168-c7ec-4be4-b1e2-83691078198f tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:11.976766 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-14de0168-c7ec-4be4-b1e2-83691078198f tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:11.977529 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-14de0168-c7ec-4be4-b1e2-83691078198f tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:11.978755 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-14de0168-c7ec-4be4-b1e2-83691078198f tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:11.979486 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-14de0168-c7ec-4be4-b1e2-83691078198f tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:11.981216 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-14de0168-c7ec-4be4-b1e2-83691078198f tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:12.276980 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-14de0168-c7ec-4be4-b1e2-83691078198f tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae3291d8d8f40dc98be9c965ba86adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d59ac71b6f459ea38d5ddc24964216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:12.289905 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-14de0168-c7ec-4be4-b1e2-83691078198f tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] 10.222.0.27 "GET /compute/v2.1/servers/26218db4-d06e-4ae2-8f15-f21004ce13b3" status: 200 len: 1316 microversion: 2.1 time: 0.331877 Sep 08 10:42:12.290539 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 598/1251] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:11 2022] GET /compute/v2.1/servers/26218db4-d06e-4ae2-8f15-f21004ce13b3 => generated 1316 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:12.301798 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e7c80bd0-4cd3-457f-9643-9958731610a8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:12.302447 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e7c80bd0-4cd3-457f-9643-9958731610a8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: c1406c0f-748a-4dae-9392-6957d4092c9f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:12.330516 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e7c80bd0-4cd3-457f-9643-9958731610a8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:12.331178 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e7c80bd0-4cd3-457f-9643-9958731610a8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:12.331713 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e7c80bd0-4cd3-457f-9643-9958731610a8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:12.332539 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e7c80bd0-4cd3-457f-9643-9958731610a8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:12.333320 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e7c80bd0-4cd3-457f-9643-9958731610a8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:12.333872 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e7c80bd0-4cd3-457f-9643-9958731610a8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:12.750276 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e7c80bd0-4cd3-457f-9643-9958731610a8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:12.774343 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e7c80bd0-4cd3-457f-9643-9958731610a8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/c1406c0f-748a-4dae-9392-6957d4092c9f" status: 200 len: 1314 microversion: 2.1 time: 0.480549 Sep 08 10:42:12.776730 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 599/1252] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:12 2022] GET /compute/v2.1/servers/c1406c0f-748a-4dae-9392-6957d4092c9f => generated 1314 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:12.794528 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-88263cca-6a20-46d3-9b21-01d8abd12503 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:12.797243 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-88263cca-6a20-46d3-9b21-01d8abd12503 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:12.808446 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88263cca-6a20-46d3-9b21-01d8abd12503 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:12.810018 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88263cca-6a20-46d3-9b21-01d8abd12503 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:12.810862 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88263cca-6a20-46d3-9b21-01d8abd12503 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:12.811963 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88263cca-6a20-46d3-9b21-01d8abd12503 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:12.812638 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88263cca-6a20-46d3-9b21-01d8abd12503 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:12.814532 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88263cca-6a20-46d3-9b21-01d8abd12503 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:13.289994 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-88263cca-6a20-46d3-9b21-01d8abd12503 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:13.309639 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-88263cca-6a20-46d3-9b21-01d8abd12503 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:13.318354 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-88263cca-6a20-46d3-9b21-01d8abd12503 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:13.325479 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-88263cca-6a20-46d3-9b21-01d8abd12503 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e" status: 200 len: 1810 microversion: 2.25 time: 0.546329 Sep 08 10:42:13.326090 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 600/1253] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:42:12 2022] GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e => generated 1810 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:42:13.380812 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7dd8f9f1-6c5e-4758-a013-a4412a5b84fa tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:13.383450 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7dd8f9f1-6c5e-4758-a013-a4412a5b84fa tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] [instance: 790bcd42-ace5-4761-b46d-e0889855623f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:13.401849 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7dd8f9f1-6c5e-4758-a013-a4412a5b84fa tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:13.414848 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7dd8f9f1-6c5e-4758-a013-a4412a5b84fa tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:13.415268 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7dd8f9f1-6c5e-4758-a013-a4412a5b84fa tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:13.416146 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7dd8f9f1-6c5e-4758-a013-a4412a5b84fa tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:13.416709 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7dd8f9f1-6c5e-4758-a013-a4412a5b84fa tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:13.417184 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7dd8f9f1-6c5e-4758-a013-a4412a5b84fa tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:13.638032 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7dd8f9f1-6c5e-4758-a013-a4412a5b84fa tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b206b1f0a1d4f6ebefffc97c51e6f51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8038d51a764867a85d2eab4ac10d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:13.662610 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7dd8f9f1-6c5e-4758-a013-a4412a5b84fa tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] 10.222.0.27 "GET /compute/v2.1/servers/790bcd42-ace5-4761-b46d-e0889855623f" status: 200 len: 1304 microversion: 2.1 time: 0.303374 Sep 08 10:42:13.682001 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 601/1254] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:13 2022] GET /compute/v2.1/servers/790bcd42-ace5-4761-b46d-e0889855623f => generated 1304 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:13.687255 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-dcc0f8cc-cd6c-4797-ac06-1ff1e563c7a1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:13.705661 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-dcc0f8cc-cd6c-4797-ac06-1ff1e563c7a1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: a3a6ce0f-e362-4cbc-afc2-3cfd349a4812] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:13.726616 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dcc0f8cc-cd6c-4797-ac06-1ff1e563c7a1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:13.727393 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dcc0f8cc-cd6c-4797-ac06-1ff1e563c7a1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:13.728299 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dcc0f8cc-cd6c-4797-ac06-1ff1e563c7a1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:13.732018 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dcc0f8cc-cd6c-4797-ac06-1ff1e563c7a1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:13.732692 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dcc0f8cc-cd6c-4797-ac06-1ff1e563c7a1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:13.754286 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dcc0f8cc-cd6c-4797-ac06-1ff1e563c7a1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:14.076287 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-dcc0f8cc-cd6c-4797-ac06-1ff1e563c7a1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:14.104552 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-dcc0f8cc-cd6c-4797-ac06-1ff1e563c7a1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812" status: 200 len: 1470 microversion: 2.1 time: 0.421165 Sep 08 10:42:14.109644 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 602/1255] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:13 2022] GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812 => generated 1470 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:14.129870 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-755f47dd-71de-4cc7-95d2-d15235575573 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:14.132937 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-755f47dd-71de-4cc7-95d2-d15235575573 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 133a5f12-39e5-4e0f-81dc-b1948c073f15] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:14.156077 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-755f47dd-71de-4cc7-95d2-d15235575573 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:14.156989 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-755f47dd-71de-4cc7-95d2-d15235575573 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:14.157847 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-755f47dd-71de-4cc7-95d2-d15235575573 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:14.159003 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-755f47dd-71de-4cc7-95d2-d15235575573 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:14.159582 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-755f47dd-71de-4cc7-95d2-d15235575573 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:14.162173 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-755f47dd-71de-4cc7-95d2-d15235575573 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:14.706620 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-755f47dd-71de-4cc7-95d2-d15235575573 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:14.726601 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-755f47dd-71de-4cc7-95d2-d15235575573 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15" status: 200 len: 1718 microversion: 2.1 time: 0.613623 Sep 08 10:42:14.728029 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 603/1256] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:14 2022] GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15 => generated 1718 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:14.741176 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-70cc08ba-d2f8-46aa-bb92-e723705fdf4f tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:14.749465 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-70cc08ba-d2f8-46aa-bb92-e723705fdf4f tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] [instance: 26218db4-d06e-4ae2-8f15-f21004ce13b3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:14.775071 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-70cc08ba-d2f8-46aa-bb92-e723705fdf4f tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:14.778780 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-70cc08ba-d2f8-46aa-bb92-e723705fdf4f tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:14.782635 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-70cc08ba-d2f8-46aa-bb92-e723705fdf4f tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:14.785132 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-70cc08ba-d2f8-46aa-bb92-e723705fdf4f tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:14.789148 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-70cc08ba-d2f8-46aa-bb92-e723705fdf4f tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:14.792461 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-70cc08ba-d2f8-46aa-bb92-e723705fdf4f tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:15.616425 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-70cc08ba-d2f8-46aa-bb92-e723705fdf4f tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae3291d8d8f40dc98be9c965ba86adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d59ac71b6f459ea38d5ddc24964216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:15.647592 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-70cc08ba-d2f8-46aa-bb92-e723705fdf4f tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] 10.222.0.27 "GET /compute/v2.1/servers/26218db4-d06e-4ae2-8f15-f21004ce13b3" status: 200 len: 1505 microversion: 2.1 time: 0.917070 Sep 08 10:42:15.652220 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 604/1257] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:14 2022] GET /compute/v2.1/servers/26218db4-d06e-4ae2-8f15-f21004ce13b3 => generated 1505 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:15.666262 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-da0581c3-4160-40a9-98cc-83fac83fe23b req-dc96b6b0-6e2b-423d-91d1-d7d174dcc2e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "133a5f12-39e5-4e0f-81dc-b1948c073f15", "tag": "f7bbb779-b8ca-4ca2-b84e-e3203ed8de69"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:42:15.704882 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-da0581c3-4160-40a9-98cc-83fac83fe23b req-dc96b6b0-6e2b-423d-91d1-d7d174dcc2e4 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:15.708891 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-da0581c3-4160-40a9-98cc-83fac83fe23b req-dc96b6b0-6e2b-423d-91d1-d7d174dcc2e4 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:15.711785 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-da0581c3-4160-40a9-98cc-83fac83fe23b req-dc96b6b0-6e2b-423d-91d1-d7d174dcc2e4 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:15.758815 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-da0581c3-4160-40a9-98cc-83fac83fe23b req-dc96b6b0-6e2b-423d-91d1-d7d174dcc2e4 service nova] Creating event network-changed:f7bbb779-b8ca-4ca2-b84e-e3203ed8de69 for instance 133a5f12-39e5-4e0f-81dc-b1948c073f15 on n-h2-850501-12 Sep 08 10:42:15.778875 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-da0581c3-4160-40a9-98cc-83fac83fe23b req-dc96b6b0-6e2b-423d-91d1-d7d174dcc2e4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123675 Sep 08 10:42:15.785862 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 605/1258] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:42:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:42:15.805152 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-65cd48ea-b81f-4990-ae19-faee303170e9 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:15.808174 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-65cd48ea-b81f-4990-ae19-faee303170e9 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: c1406c0f-748a-4dae-9392-6957d4092c9f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:15.835423 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-65cd48ea-b81f-4990-ae19-faee303170e9 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:15.837982 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-65cd48ea-b81f-4990-ae19-faee303170e9 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:15.840233 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-65cd48ea-b81f-4990-ae19-faee303170e9 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:15.841950 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-65cd48ea-b81f-4990-ae19-faee303170e9 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:15.843905 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-65cd48ea-b81f-4990-ae19-faee303170e9 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:15.846327 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-65cd48ea-b81f-4990-ae19-faee303170e9 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:16.413359 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-65cd48ea-b81f-4990-ae19-faee303170e9 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:16.427806 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-65cd48ea-b81f-4990-ae19-faee303170e9 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/c1406c0f-748a-4dae-9392-6957d4092c9f" status: 200 len: 1314 microversion: 2.1 time: 0.637506 Sep 08 10:42:16.430822 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 606/1259] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:15 2022] GET /compute/v2.1/servers/c1406c0f-748a-4dae-9392-6957d4092c9f => generated 1314 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:16.445061 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8599a408-1b50-4aa1-95c9-5c62d272935e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:42:16.446330 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8599a408-1b50-4aa1-95c9-5c62d272935e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: a3a6ce0f-e362-4cbc-afc2-3cfd349a4812] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:16.465956 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8599a408-1b50-4aa1-95c9-5c62d272935e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:16.467108 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8599a408-1b50-4aa1-95c9-5c62d272935e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:16.468669 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8599a408-1b50-4aa1-95c9-5c62d272935e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:16.469849 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8599a408-1b50-4aa1-95c9-5c62d272935e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:16.471801 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8599a408-1b50-4aa1-95c9-5c62d272935e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:16.474566 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8599a408-1b50-4aa1-95c9-5c62d272935e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:16.636041 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8599a408-1b50-4aa1-95c9-5c62d272935e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:16.636726 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8599a408-1b50-4aa1-95c9-5c62d272935e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:16.643016 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8599a408-1b50-4aa1-95c9-5c62d272935e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:16.643971 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8599a408-1b50-4aa1-95c9-5c62d272935e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:16.644762 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8599a408-1b50-4aa1-95c9-5c62d272935e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:16.644973 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8599a408-1b50-4aa1-95c9-5c62d272935e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:16.734585 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-8599a408-1b50-4aa1-95c9-5c62d272935e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Getting quotas for project a52c0b4a043445df94dab4dd4292607a. Resources: {'ram', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:42:16.742848 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-8599a408-1b50-4aa1-95c9-5c62d272935e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Getting quotas for user 5450284cb50b4f75be0915074bf8fe78 and project a52c0b4a043445df94dab4dd4292607a. Resources: {'ram', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:42:17.002818 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:42:17.076610 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8599a408-1b50-4aa1-95c9-5c62d272935e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "POST /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812/action" status: 202 len: 0 microversion: 2.1 time: 0.643173 Sep 08 10:42:17.083561 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 607/1260] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:42:16 2022] POST /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812/action => generated 0 bytes in 651 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:42:17.111666 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-360bcc37-8c5d-4793-ad64-bb36e42690fe tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:17.113728 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-360bcc37-8c5d-4793-ad64-bb36e42690fe tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:17.143626 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-360bcc37-8c5d-4793-ad64-bb36e42690fe tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:17.144144 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-360bcc37-8c5d-4793-ad64-bb36e42690fe tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:17.144628 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-360bcc37-8c5d-4793-ad64-bb36e42690fe tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:17.145396 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-360bcc37-8c5d-4793-ad64-bb36e42690fe tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:17.150379 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-360bcc37-8c5d-4793-ad64-bb36e42690fe tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:17.151053 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-360bcc37-8c5d-4793-ad64-bb36e42690fe tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:17.917085 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5c1f46d7-bfb7-4ddd-808b-b92c80130230 tempest-FloatingIPDetailsTestJSON-1685842162 tempest-FloatingIPDetailsTestJSON-1685842162-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 8.216771 Sep 08 10:42:17.921835 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 654/1261] 10.222.0.27 () {60 vars in 1170 bytes} [Thu Sep 8 10:42:09 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 8230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:42:17.927994 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f90cd7af-6c4f-4e05-ac09-75cde09f6cc1 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:17.928630 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f90cd7af-6c4f-4e05-ac09-75cde09f6cc1 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] [instance: 790bcd42-ace5-4761-b46d-e0889855623f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:17.973540 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f90cd7af-6c4f-4e05-ac09-75cde09f6cc1 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:17.974068 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f90cd7af-6c4f-4e05-ac09-75cde09f6cc1 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:17.974511 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f90cd7af-6c4f-4e05-ac09-75cde09f6cc1 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:17.976339 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f90cd7af-6c4f-4e05-ac09-75cde09f6cc1 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:17.978087 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f90cd7af-6c4f-4e05-ac09-75cde09f6cc1 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:17.980180 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f90cd7af-6c4f-4e05-ac09-75cde09f6cc1 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:18.086972 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-360bcc37-8c5d-4793-ad64-bb36e42690fe tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:18.108245 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-360bcc37-8c5d-4793-ad64-bb36e42690fe tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:18.129287 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-360bcc37-8c5d-4793-ad64-bb36e42690fe tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:18.131930 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-360bcc37-8c5d-4793-ad64-bb36e42690fe tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e" status: 200 len: 1810 microversion: 2.25 time: 1.046585 Sep 08 10:42:18.133315 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 608/1262] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:42:17 2022] GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e => generated 1810 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:42:18.142485 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0aa49ec7-fd37-44ec-8c88-dd5e2ef8f5f7 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:18.154310 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0aa49ec7-fd37-44ec-8c88-dd5e2ef8f5f7 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] [instance: 26218db4-d06e-4ae2-8f15-f21004ce13b3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:18.177284 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0aa49ec7-fd37-44ec-8c88-dd5e2ef8f5f7 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:18.190317 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0aa49ec7-fd37-44ec-8c88-dd5e2ef8f5f7 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:18.191502 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0aa49ec7-fd37-44ec-8c88-dd5e2ef8f5f7 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:18.193164 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0aa49ec7-fd37-44ec-8c88-dd5e2ef8f5f7 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:18.194283 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0aa49ec7-fd37-44ec-8c88-dd5e2ef8f5f7 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:18.195356 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0aa49ec7-fd37-44ec-8c88-dd5e2ef8f5f7 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:18.338284 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0aa49ec7-fd37-44ec-8c88-dd5e2ef8f5f7 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '7ae3291d8d8f40dc98be9c965ba86adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d59ac71b6f459ea38d5ddc24964216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:18.340456 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0aa49ec7-fd37-44ec-8c88-dd5e2ef8f5f7 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] 10.222.0.27 "GET /compute/v2.1/servers/26218db4-d06e-4ae2-8f15-f21004ce13b3/os-instance-actions/req-a692a61b-e305-40d2-bf0d-2f4bbdab88b6" status: 200 len: 313 microversion: 2.1 time: 0.205288 Sep 08 10:42:18.346366 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 609/1263] 10.222.0.27 () {58 vars in 1419 bytes} [Thu Sep 8 10:42:18 2022] GET /compute/v2.1/servers/26218db4-d06e-4ae2-8f15-f21004ce13b3/os-instance-actions/req-a692a61b-e305-40d2-bf0d-2f4bbdab88b6 => generated 313 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:42:18.360216 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7236b733-105a-4435-bd39-1b9cf90f76d7 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:18.366418 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7236b733-105a-4435-bd39-1b9cf90f76d7 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 133a5f12-39e5-4e0f-81dc-b1948c073f15] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:18.392053 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7236b733-105a-4435-bd39-1b9cf90f76d7 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:18.398312 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7236b733-105a-4435-bd39-1b9cf90f76d7 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:18.401922 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7236b733-105a-4435-bd39-1b9cf90f76d7 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:18.406250 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7236b733-105a-4435-bd39-1b9cf90f76d7 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:18.409487 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7236b733-105a-4435-bd39-1b9cf90f76d7 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:18.411389 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7236b733-105a-4435-bd39-1b9cf90f76d7 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:18.758627 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f90cd7af-6c4f-4e05-ac09-75cde09f6cc1 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b206b1f0a1d4f6ebefffc97c51e6f51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8038d51a764867a85d2eab4ac10d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:18.785617 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f90cd7af-6c4f-4e05-ac09-75cde09f6cc1 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] 10.222.0.27 "GET /compute/v2.1/servers/790bcd42-ace5-4761-b46d-e0889855623f" status: 200 len: 1372 microversion: 2.1 time: 0.859413 Sep 08 10:42:18.788101 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 655/1264] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:17 2022] GET /compute/v2.1/servers/790bcd42-ace5-4761-b46d-e0889855623f => generated 1372 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:18.815835 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d95975d2-94bf-41cf-806a-427f44ec1295 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:18.816756 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d95975d2-94bf-41cf-806a-427f44ec1295 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: a3a6ce0f-e362-4cbc-afc2-3cfd349a4812] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:18.827067 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d95975d2-94bf-41cf-806a-427f44ec1295 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:18.829859 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d95975d2-94bf-41cf-806a-427f44ec1295 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:18.830588 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d95975d2-94bf-41cf-806a-427f44ec1295 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:18.831595 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d95975d2-94bf-41cf-806a-427f44ec1295 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:18.832313 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d95975d2-94bf-41cf-806a-427f44ec1295 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:18.832909 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d95975d2-94bf-41cf-806a-427f44ec1295 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:18.880828 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7236b733-105a-4435-bd39-1b9cf90f76d7 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:18.896242 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7236b733-105a-4435-bd39-1b9cf90f76d7 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15" status: 200 len: 1718 microversion: 2.1 time: 0.548082 Sep 08 10:42:18.897079 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 610/1265] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:18 2022] GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15 => generated 1718 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:18.901387 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6f0dc3b3-0bd1-48bb-99d1-168367f6459b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:18.901991 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6f0dc3b3-0bd1-48bb-99d1-168367f6459b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: c1406c0f-748a-4dae-9392-6957d4092c9f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:18.910944 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6f0dc3b3-0bd1-48bb-99d1-168367f6459b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:18.912094 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6f0dc3b3-0bd1-48bb-99d1-168367f6459b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:18.913256 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6f0dc3b3-0bd1-48bb-99d1-168367f6459b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:18.914158 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6f0dc3b3-0bd1-48bb-99d1-168367f6459b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:18.914759 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6f0dc3b3-0bd1-48bb-99d1-168367f6459b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:18.936455 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6f0dc3b3-0bd1-48bb-99d1-168367f6459b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:19.299711 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d95975d2-94bf-41cf-806a-427f44ec1295 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:19.333230 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d95975d2-94bf-41cf-806a-427f44ec1295 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812" status: 200 len: 1469 microversion: 2.1 time: 0.515227 Sep 08 10:42:19.335862 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 656/1266] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:18 2022] GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812 => generated 1469 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:19.341911 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-6a13e101-404a-4fea-aaed-c62a133e5103 req-1c512607-fc16-42dd-a92d-dd973cffec00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3a6ce0f-e362-4cbc-afc2-3cfd349a4812", "name": "network-vif-plugged", "status": "completed", "tag": "8ff15ca8-cc64-424e-b9f6-8f38b142e5ac"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:42:19.356514 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-6a13e101-404a-4fea-aaed-c62a133e5103 req-1c512607-fc16-42dd-a92d-dd973cffec00 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:19.357328 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-6a13e101-404a-4fea-aaed-c62a133e5103 req-1c512607-fc16-42dd-a92d-dd973cffec00 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:19.357581 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6f0dc3b3-0bd1-48bb-99d1-168367f6459b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:19.358501 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-6a13e101-404a-4fea-aaed-c62a133e5103 req-1c512607-fc16-42dd-a92d-dd973cffec00 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:19.371281 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6f0dc3b3-0bd1-48bb-99d1-168367f6459b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/c1406c0f-748a-4dae-9392-6957d4092c9f" status: 200 len: 1314 microversion: 2.1 time: 0.473064 Sep 08 10:42:19.381679 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 611/1267] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:18 2022] GET /compute/v2.1/servers/c1406c0f-748a-4dae-9392-6957d4092c9f => generated 1314 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:19.386341 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bb22b436-b55d-417f-80fc-5ed2c5da9068 tempest-FloatingIPDetailsTestJSON-1685842162 tempest-FloatingIPDetailsTestJSON-1685842162-project] Action: 'create', calling method: .version_select at 0x7f68e44cb790>, body: {"pool": null} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:42:19.452504 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-6a13e101-404a-4fea-aaed-c62a133e5103 req-1c512607-fc16-42dd-a92d-dd973cffec00 service nova] Creating event network-vif-plugged:8ff15ca8-cc64-424e-b9f6-8f38b142e5ac for instance a3a6ce0f-e362-4cbc-afc2-3cfd349a4812 on n-h1-850501-12 Sep 08 10:42:19.466949 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [req-6a13e101-404a-4fea-aaed-c62a133e5103 req-1c512607-fc16-42dd-a92d-dd973cffec00 service nova] Instance a3a6ce0f-e362-4cbc-afc2-3cfd349a4812 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850501-12'} {{(pid=128862) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 10:42:19.484170 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-6a13e101-404a-4fea-aaed-c62a133e5103 req-1c512607-fc16-42dd-a92d-dd973cffec00 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146008 Sep 08 10:42:19.486210 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 657/1268] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:42:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:42:19.493953 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-8e835512-2664-4087-ac0d-f11c4fc72eb1 req-62c853d0-aa2a-4be8-8054-4b41df3a8af9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1406c0f-748a-4dae-9392-6957d4092c9f", "tag": "0f2423be-1d9a-4a47-aa8c-b141dd346374"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:42:19.522594 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-8e835512-2664-4087-ac0d-f11c4fc72eb1 req-62c853d0-aa2a-4be8-8054-4b41df3a8af9 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:19.523085 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-8e835512-2664-4087-ac0d-f11c4fc72eb1 req-62c853d0-aa2a-4be8-8054-4b41df3a8af9 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:19.523523 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-8e835512-2664-4087-ac0d-f11c4fc72eb1 req-62c853d0-aa2a-4be8-8054-4b41df3a8af9 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:19.545894 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-8e835512-2664-4087-ac0d-f11c4fc72eb1 req-62c853d0-aa2a-4be8-8054-4b41df3a8af9 service nova] Creating event network-changed:0f2423be-1d9a-4a47-aa8c-b141dd346374 for instance c1406c0f-748a-4dae-9392-6957d4092c9f on n-h2-850501-12 Sep 08 10:42:19.562029 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-8e835512-2664-4087-ac0d-f11c4fc72eb1 req-62c853d0-aa2a-4be8-8054-4b41df3a8af9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072256 Sep 08 10:42:19.562968 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 658/1269] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:42:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:42:19.568669 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6d1961d0-d9e7-4fc3-b2a7-dfe596f0259c tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:42:19.571639 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6d1961d0-d9e7-4fc3-b2a7-dfe596f0259c tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] [instance: 26218db4-d06e-4ae2-8f15-f21004ce13b3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:19.592090 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d1961d0-d9e7-4fc3-b2a7-dfe596f0259c tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:19.592894 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d1961d0-d9e7-4fc3-b2a7-dfe596f0259c tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:19.593511 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d1961d0-d9e7-4fc3-b2a7-dfe596f0259c tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:19.594580 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d1961d0-d9e7-4fc3-b2a7-dfe596f0259c tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:19.595212 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d1961d0-d9e7-4fc3-b2a7-dfe596f0259c tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:19.595787 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d1961d0-d9e7-4fc3-b2a7-dfe596f0259c tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:19.794957 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6d1961d0-d9e7-4fc3-b2a7-dfe596f0259c tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] 10.222.0.27 "POST /compute/v2.1/servers/26218db4-d06e-4ae2-8f15-f21004ce13b3/action" status: 202 len: 0 microversion: 2.1 time: 0.230289 Sep 08 10:42:19.798147 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 659/1270] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:42:19 2022] POST /compute/v2.1/servers/26218db4-d06e-4ae2-8f15-f21004ce13b3/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:42:19.819721 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-02e6e999-6dbc-43cd-880f-aab9b60235e8 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:19.820603 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-02e6e999-6dbc-43cd-880f-aab9b60235e8 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:19.836779 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02e6e999-6dbc-43cd-880f-aab9b60235e8 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:19.836779 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02e6e999-6dbc-43cd-880f-aab9b60235e8 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:19.837405 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02e6e999-6dbc-43cd-880f-aab9b60235e8 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:19.839565 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02e6e999-6dbc-43cd-880f-aab9b60235e8 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:19.841319 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02e6e999-6dbc-43cd-880f-aab9b60235e8 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:19.842991 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02e6e999-6dbc-43cd-880f-aab9b60235e8 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:19.927751 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=12 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:42:20.391915 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-02e6e999-6dbc-43cd-880f-aab9b60235e8 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:20.415425 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-02e6e999-6dbc-43cd-880f-aab9b60235e8 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:20.418545 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-02e6e999-6dbc-43cd-880f-aab9b60235e8 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:20.421062 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-02e6e999-6dbc-43cd-880f-aab9b60235e8 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e" status: 200 len: 1810 microversion: 2.25 time: 0.617399 Sep 08 10:42:20.456473 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 660/1271] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:42:19 2022] GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e => generated 1810 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:42:20.754181 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-179d4157-4134-45f8-82cc-b98396fb6d60 req-934fef66-4df0-44f5-8793-c2868f2a69f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "790bcd42-ace5-4761-b46d-e0889855623f", "tag": "6e25a2af-b9a9-477e-a24c-f79b73a6fdc9"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:42:20.789370 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-179d4157-4134-45f8-82cc-b98396fb6d60 req-934fef66-4df0-44f5-8793-c2868f2a69f0 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:20.792631 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-179d4157-4134-45f8-82cc-b98396fb6d60 req-934fef66-4df0-44f5-8793-c2868f2a69f0 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:20.793622 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-179d4157-4134-45f8-82cc-b98396fb6d60 req-934fef66-4df0-44f5-8793-c2868f2a69f0 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:20.834827 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-179d4157-4134-45f8-82cc-b98396fb6d60 req-934fef66-4df0-44f5-8793-c2868f2a69f0 service nova] Creating event network-changed:6e25a2af-b9a9-477e-a24c-f79b73a6fdc9 for instance 790bcd42-ace5-4761-b46d-e0889855623f on n-h2-850501-12 Sep 08 10:42:20.841139 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-179d4157-4134-45f8-82cc-b98396fb6d60 req-934fef66-4df0-44f5-8793-c2868f2a69f0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.379932 Sep 08 10:42:20.842301 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 661/1272] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:42:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:42:20.850440 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-19d99a03-e910-4705-9403-d181a3a66b1f tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:20.863840 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-19d99a03-e910-4705-9403-d181a3a66b1f tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] [instance: 26218db4-d06e-4ae2-8f15-f21004ce13b3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:20.874252 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-19d99a03-e910-4705-9403-d181a3a66b1f tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:20.875000 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-19d99a03-e910-4705-9403-d181a3a66b1f tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:20.875656 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-19d99a03-e910-4705-9403-d181a3a66b1f tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:20.876533 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-19d99a03-e910-4705-9403-d181a3a66b1f tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:20.889829 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-19d99a03-e910-4705-9403-d181a3a66b1f tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:20.892992 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-19d99a03-e910-4705-9403-d181a3a66b1f tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:22.018093 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-19d99a03-e910-4705-9403-d181a3a66b1f tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae3291d8d8f40dc98be9c965ba86adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d59ac71b6f459ea38d5ddc24964216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:22.045062 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-19d99a03-e910-4705-9403-d181a3a66b1f tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] 10.222.0.27 "GET /compute/v2.1/servers/26218db4-d06e-4ae2-8f15-f21004ce13b3" status: 200 len: 1507 microversion: 2.1 time: 1.200930 Sep 08 10:42:22.046188 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 662/1273] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:20 2022] GET /compute/v2.1/servers/26218db4-d06e-4ae2-8f15-f21004ce13b3 => generated 1507 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:22.062506 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2b4866d9-9c28-4446-b7c6-b79adae8a894 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:22.063816 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2b4866d9-9c28-4446-b7c6-b79adae8a894 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] [instance: 790bcd42-ace5-4761-b46d-e0889855623f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:22.087342 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b4866d9-9c28-4446-b7c6-b79adae8a894 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:22.088146 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b4866d9-9c28-4446-b7c6-b79adae8a894 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:22.088768 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b4866d9-9c28-4446-b7c6-b79adae8a894 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:22.089793 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b4866d9-9c28-4446-b7c6-b79adae8a894 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:22.090744 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b4866d9-9c28-4446-b7c6-b79adae8a894 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:22.091735 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b4866d9-9c28-4446-b7c6-b79adae8a894 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:23.766000 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2b4866d9-9c28-4446-b7c6-b79adae8a894 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b206b1f0a1d4f6ebefffc97c51e6f51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8038d51a764867a85d2eab4ac10d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:23.774537 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2b4866d9-9c28-4446-b7c6-b79adae8a894 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] 10.222.0.27 "GET /compute/v2.1/servers/790bcd42-ace5-4761-b46d-e0889855623f" status: 200 len: 1372 microversion: 2.1 time: 1.721243 Sep 08 10:42:23.782073 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 663/1274] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:22 2022] GET /compute/v2.1/servers/790bcd42-ace5-4761-b46d-e0889855623f => generated 1372 bytes in 1730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:23.794490 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6f949971-5488-40cc-830c-75a56a209322 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:23.806388 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6f949971-5488-40cc-830c-75a56a209322 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 133a5f12-39e5-4e0f-81dc-b1948c073f15] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:23.820851 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f949971-5488-40cc-830c-75a56a209322 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:23.824215 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f949971-5488-40cc-830c-75a56a209322 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:23.825983 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f949971-5488-40cc-830c-75a56a209322 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:23.829264 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f949971-5488-40cc-830c-75a56a209322 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:23.830121 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f949971-5488-40cc-830c-75a56a209322 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:23.831921 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f949971-5488-40cc-830c-75a56a209322 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:24.472606 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6f949971-5488-40cc-830c-75a56a209322 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:24.495852 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6f949971-5488-40cc-830c-75a56a209322 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15" status: 200 len: 1718 microversion: 2.1 time: 0.707252 Sep 08 10:42:24.536553 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 664/1275] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:23 2022] GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15 => generated 1718 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:24.563952 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-26316a1d-f3b7-44cb-9abf-16030f798748 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:24.568559 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-26316a1d-f3b7-44cb-9abf-16030f798748 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: a3a6ce0f-e362-4cbc-afc2-3cfd349a4812] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:24.591098 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-26316a1d-f3b7-44cb-9abf-16030f798748 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:24.592621 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-26316a1d-f3b7-44cb-9abf-16030f798748 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:24.596177 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-26316a1d-f3b7-44cb-9abf-16030f798748 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:24.598167 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-26316a1d-f3b7-44cb-9abf-16030f798748 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:24.620076 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-26316a1d-f3b7-44cb-9abf-16030f798748 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:24.621456 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-26316a1d-f3b7-44cb-9abf-16030f798748 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:25.374745 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-26316a1d-f3b7-44cb-9abf-16030f798748 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:25.388785 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-26316a1d-f3b7-44cb-9abf-16030f798748 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812" status: 200 len: 1535 microversion: 2.1 time: 0.845000 Sep 08 10:42:25.391319 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 665/1276] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:24 2022] GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812 => generated 1535 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:25.398431 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-abca3cc7-4a4f-4bb9-adc8-c9ec2d95689b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:25.399372 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-abca3cc7-4a4f-4bb9-adc8-c9ec2d95689b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: c1406c0f-748a-4dae-9392-6957d4092c9f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:25.424402 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-abca3cc7-4a4f-4bb9-adc8-c9ec2d95689b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:25.425913 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-abca3cc7-4a4f-4bb9-adc8-c9ec2d95689b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:25.428157 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-abca3cc7-4a4f-4bb9-adc8-c9ec2d95689b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:25.429293 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-abca3cc7-4a4f-4bb9-adc8-c9ec2d95689b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:25.432307 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-abca3cc7-4a4f-4bb9-adc8-c9ec2d95689b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:25.433789 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-abca3cc7-4a4f-4bb9-adc8-c9ec2d95689b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:25.448002 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bb22b436-b55d-417f-80fc-5ed2c5da9068 tempest-FloatingIPDetailsTestJSON-1685842162 tempest-FloatingIPDetailsTestJSON-1685842162-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.064379 Sep 08 10:42:25.448002 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 612/1277] 10.222.0.27 () {60 vars in 1170 bytes} [Thu Sep 8 10:42:19 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6066 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:42:25.456432 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5c411f1a-4861-4d19-a599-12207ee27ec5 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:25.457120 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5c411f1a-4861-4d19-a599-12207ee27ec5 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:25.478390 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5c411f1a-4861-4d19-a599-12207ee27ec5 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:25.479247 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5c411f1a-4861-4d19-a599-12207ee27ec5 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:25.479777 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5c411f1a-4861-4d19-a599-12207ee27ec5 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:25.504187 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5c411f1a-4861-4d19-a599-12207ee27ec5 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:25.506430 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5c411f1a-4861-4d19-a599-12207ee27ec5 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:25.507000 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5c411f1a-4861-4d19-a599-12207ee27ec5 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:25.888932 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5c411f1a-4861-4d19-a599-12207ee27ec5 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:25.907505 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5c411f1a-4861-4d19-a599-12207ee27ec5 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:25.910342 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5c411f1a-4861-4d19-a599-12207ee27ec5 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:25.912187 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5c411f1a-4861-4d19-a599-12207ee27ec5 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e" status: 200 len: 1810 microversion: 2.25 time: 0.463391 Sep 08 10:42:25.913558 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 613/1278] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:42:25 2022] GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e => generated 1810 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:42:25.922352 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-76d0d478-ef34-46f7-b02d-e68f0dab2b5e tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:25.928061 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-76d0d478-ef34-46f7-b02d-e68f0dab2b5e tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] [instance: 26218db4-d06e-4ae2-8f15-f21004ce13b3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:25.935785 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-abca3cc7-4a4f-4bb9-adc8-c9ec2d95689b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:25.945261 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-76d0d478-ef34-46f7-b02d-e68f0dab2b5e tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:25.954145 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-76d0d478-ef34-46f7-b02d-e68f0dab2b5e tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:25.955034 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-76d0d478-ef34-46f7-b02d-e68f0dab2b5e tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:25.955817 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-abca3cc7-4a4f-4bb9-adc8-c9ec2d95689b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/c1406c0f-748a-4dae-9392-6957d4092c9f" status: 200 len: 1314 microversion: 2.1 time: 0.563026 Sep 08 10:42:25.956499 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-76d0d478-ef34-46f7-b02d-e68f0dab2b5e tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:25.957649 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-76d0d478-ef34-46f7-b02d-e68f0dab2b5e tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:25.958379 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-76d0d478-ef34-46f7-b02d-e68f0dab2b5e tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:25.959568 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 666/1279] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:25 2022] GET /compute/v2.1/servers/c1406c0f-748a-4dae-9392-6957d4092c9f => generated 1314 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:25.976391 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-0018a2fc-ce7a-4d6a-96f3-9c04ced85ac4 req-f8c5fe0f-9574-44d5-915f-1f846d84b6f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1406c0f-748a-4dae-9392-6957d4092c9f", "name": "network-vif-plugged", "status": "completed", "tag": "0f2423be-1d9a-4a47-aa8c-b141dd346374"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:42:26.013879 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-0018a2fc-ce7a-4d6a-96f3-9c04ced85ac4 req-f8c5fe0f-9574-44d5-915f-1f846d84b6f5 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:26.020719 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-0018a2fc-ce7a-4d6a-96f3-9c04ced85ac4 req-f8c5fe0f-9574-44d5-915f-1f846d84b6f5 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:26.021210 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-0018a2fc-ce7a-4d6a-96f3-9c04ced85ac4 req-f8c5fe0f-9574-44d5-915f-1f846d84b6f5 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:26.046099 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-0018a2fc-ce7a-4d6a-96f3-9c04ced85ac4 req-f8c5fe0f-9574-44d5-915f-1f846d84b6f5 service nova] Creating event network-vif-plugged:0f2423be-1d9a-4a47-aa8c-b141dd346374 for instance c1406c0f-748a-4dae-9392-6957d4092c9f on n-h2-850501-12 Sep 08 10:42:26.053889 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-0018a2fc-ce7a-4d6a-96f3-9c04ced85ac4 req-f8c5fe0f-9574-44d5-915f-1f846d84b6f5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092617 Sep 08 10:42:26.055352 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 667/1280] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:42:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:42:26.071406 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-aad9c4a5-381b-4da7-afd3-7bbda821359e tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:26.073129 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-aad9c4a5-381b-4da7-afd3-7bbda821359e tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] [instance: 790bcd42-ace5-4761-b46d-e0889855623f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:26.085076 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aad9c4a5-381b-4da7-afd3-7bbda821359e tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:26.085842 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aad9c4a5-381b-4da7-afd3-7bbda821359e tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:26.086797 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aad9c4a5-381b-4da7-afd3-7bbda821359e tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:26.088140 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aad9c4a5-381b-4da7-afd3-7bbda821359e tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:26.088846 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aad9c4a5-381b-4da7-afd3-7bbda821359e tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:26.089465 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aad9c4a5-381b-4da7-afd3-7bbda821359e tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:26.271130 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-76d0d478-ef34-46f7-b02d-e68f0dab2b5e tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae3291d8d8f40dc98be9c965ba86adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d59ac71b6f459ea38d5ddc24964216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:26.286427 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-76d0d478-ef34-46f7-b02d-e68f0dab2b5e tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] 10.222.0.27 "GET /compute/v2.1/servers/26218db4-d06e-4ae2-8f15-f21004ce13b3" status: 200 len: 1505 microversion: 2.1 time: 0.371426 Sep 08 10:42:26.288459 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 614/1281] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:25 2022] GET /compute/v2.1/servers/26218db4-d06e-4ae2-8f15-f21004ce13b3 => generated 1505 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:26.294296 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f90a404d-e7d2-40f6-8b9c-afb723fb3356 tempest-FloatingIPDetailsTestJSON-1685842162 tempest-FloatingIPDetailsTestJSON-1685842162-project] Calling method '.version_select at 0x7f68e45339d0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:26.416735 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-aad9c4a5-381b-4da7-afd3-7bbda821359e tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b206b1f0a1d4f6ebefffc97c51e6f51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8038d51a764867a85d2eab4ac10d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:26.431005 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-aad9c4a5-381b-4da7-afd3-7bbda821359e tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] 10.222.0.27 "GET /compute/v2.1/servers/790bcd42-ace5-4761-b46d-e0889855623f" status: 200 len: 1372 microversion: 2.1 time: 0.365292 Sep 08 10:42:26.441805 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 668/1282] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:26 2022] GET /compute/v2.1/servers/790bcd42-ace5-4761-b46d-e0889855623f => generated 1372 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:26.445566 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-51ac1e14-b603-433a-a9a0-4d53047fb1b4 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:26.448617 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-51ac1e14-b603-433a-a9a0-4d53047fb1b4 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 133a5f12-39e5-4e0f-81dc-b1948c073f15] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:26.474772 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51ac1e14-b603-433a-a9a0-4d53047fb1b4 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:26.475494 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51ac1e14-b603-433a-a9a0-4d53047fb1b4 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:26.476148 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51ac1e14-b603-433a-a9a0-4d53047fb1b4 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:26.477256 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51ac1e14-b603-433a-a9a0-4d53047fb1b4 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:26.478152 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51ac1e14-b603-433a-a9a0-4d53047fb1b4 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:26.479252 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51ac1e14-b603-433a-a9a0-4d53047fb1b4 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:26.500017 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:42:26.608670 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f90a404d-e7d2-40f6-8b9c-afb723fb3356 tempest-FloatingIPDetailsTestJSON-1685842162 tempest-FloatingIPDetailsTestJSON-1685842162-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips/d74ba94e-bba0-4af4-95ad-084741ed93d3" status: 200 len: 142 microversion: 2.1 time: 0.318396 Sep 08 10:42:26.610895 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 615/1283] 10.222.0.27 () {58 vars in 1260 bytes} [Thu Sep 8 10:42:26 2022] GET /compute/v2.1/os-floating-ips/d74ba94e-bba0-4af4-95ad-084741ed93d3 => generated 142 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:42:26.616106 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-297c10f0-0f69-44dc-8eb0-0fe10e184894 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Calling method '.version_select at 0x7f68e4575790>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:26.616877 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-297c10f0-0f69-44dc-8eb0-0fe10e184894 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] [instance: 26218db4-d06e-4ae2-8f15-f21004ce13b3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:26.623810 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-297c10f0-0f69-44dc-8eb0-0fe10e184894 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:26.624534 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-297c10f0-0f69-44dc-8eb0-0fe10e184894 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:26.625874 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-297c10f0-0f69-44dc-8eb0-0fe10e184894 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:26.626778 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-297c10f0-0f69-44dc-8eb0-0fe10e184894 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:26.627492 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-297c10f0-0f69-44dc-8eb0-0fe10e184894 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:26.628310 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-297c10f0-0f69-44dc-8eb0-0fe10e184894 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:26.673841 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-297c10f0-0f69-44dc-8eb0-0fe10e184894 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] 10.222.0.27 "GET /compute/v2.1/servers/26218db4-d06e-4ae2-8f15-f21004ce13b3/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.061703 Sep 08 10:42:26.677151 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 616/1284] 10.222.0.27 () {58 vars in 1296 bytes} [Thu Sep 8 10:42:26 2022] GET /compute/v2.1/servers/26218db4-d06e-4ae2-8f15-f21004ce13b3/os-instance-actions => generated 611 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:42:26.688031 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f83b93b7-5597-4857-b245-f69b79cff290 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:26.688700 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f83b93b7-5597-4857-b245-f69b79cff290 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: a3a6ce0f-e362-4cbc-afc2-3cfd349a4812] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:26.695551 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=7 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:42:26.697771 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f83b93b7-5597-4857-b245-f69b79cff290 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:26.698452 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f83b93b7-5597-4857-b245-f69b79cff290 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:26.699084 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f83b93b7-5597-4857-b245-f69b79cff290 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:26.700102 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f83b93b7-5597-4857-b245-f69b79cff290 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:26.700926 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f83b93b7-5597-4857-b245-f69b79cff290 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:26.701669 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f83b93b7-5597-4857-b245-f69b79cff290 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:26.803574 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-51ac1e14-b603-433a-a9a0-4d53047fb1b4 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:26.819708 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-51ac1e14-b603-433a-a9a0-4d53047fb1b4 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15" status: 200 len: 1718 microversion: 2.1 time: 0.383771 Sep 08 10:42:26.824628 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 669/1285] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:26 2022] GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15 => generated 1718 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:26.832233 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-57f83020-7e9a-4607-a1d5-9eece89409d6 tempest-FloatingIPDetailsTestJSON-1685842162 tempest-FloatingIPDetailsTestJSON-1685842162-project] Calling method '.version_select at 0x7f68e44fc160>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:26.883507 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f83b93b7-5597-4857-b245-f69b79cff290 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:26.899371 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f83b93b7-5597-4857-b245-f69b79cff290 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812" status: 200 len: 1535 microversion: 2.1 time: 0.219239 Sep 08 10:42:26.900637 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 617/1286] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:26 2022] GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812 => generated 1535 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:26.906953 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-01f3df24-11e4-4eb2-bbe7-fc4150c6a3c6 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:26.907757 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-01f3df24-11e4-4eb2-bbe7-fc4150c6a3c6 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] [instance: 26218db4-d06e-4ae2-8f15-f21004ce13b3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:26.915847 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-01f3df24-11e4-4eb2-bbe7-fc4150c6a3c6 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:26.916599 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-01f3df24-11e4-4eb2-bbe7-fc4150c6a3c6 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:26.917282 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-01f3df24-11e4-4eb2-bbe7-fc4150c6a3c6 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:26.918003 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-01f3df24-11e4-4eb2-bbe7-fc4150c6a3c6 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:26.918468 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-01f3df24-11e4-4eb2-bbe7-fc4150c6a3c6 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:26.918924 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-01f3df24-11e4-4eb2-bbe7-fc4150c6a3c6 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:26.957062 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-01f3df24-11e4-4eb2-bbe7-fc4150c6a3c6 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] [instance: 26218db4-d06e-4ae2-8f15-f21004ce13b3] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:42:27.065618 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-01f3df24-11e4-4eb2-bbe7-fc4150c6a3c6 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] 10.222.0.27 "DELETE /compute/v2.1/servers/26218db4-d06e-4ae2-8f15-f21004ce13b3" status: 204 len: 0 microversion: 2.1 time: 0.162769 Sep 08 10:42:27.066680 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 618/1287] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:42:26 2022] DELETE /compute/v2.1/servers/26218db4-d06e-4ae2-8f15-f21004ce13b3 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:42:27.347437 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-423b0f46-8635-46fa-ab31-f3a655842408 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:27.348566 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-423b0f46-8635-46fa-ab31-f3a655842408 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:27.357493 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-423b0f46-8635-46fa-ab31-f3a655842408 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:27.359489 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-423b0f46-8635-46fa-ab31-f3a655842408 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:27.361215 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-423b0f46-8635-46fa-ab31-f3a655842408 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:27.362768 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-423b0f46-8635-46fa-ab31-f3a655842408 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:27.364105 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-423b0f46-8635-46fa-ab31-f3a655842408 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:27.365455 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-423b0f46-8635-46fa-ab31-f3a655842408 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:27.551500 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-423b0f46-8635-46fa-ab31-f3a655842408 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:27.563127 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-423b0f46-8635-46fa-ab31-f3a655842408 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:27.565626 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-423b0f46-8635-46fa-ab31-f3a655842408 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:27.567401 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-423b0f46-8635-46fa-ab31-f3a655842408 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e" status: 200 len: 1810 microversion: 2.25 time: 0.498573 Sep 08 10:42:27.577914 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 619/1288] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:42:27 2022] GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e => generated 1810 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:42:27.592760 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e641ea7e-fa60-40d7-a69e-2cea95663204 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:27.594275 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e641ea7e-fa60-40d7-a69e-2cea95663204 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: c1406c0f-748a-4dae-9392-6957d4092c9f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:27.601419 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e641ea7e-fa60-40d7-a69e-2cea95663204 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:27.601928 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e641ea7e-fa60-40d7-a69e-2cea95663204 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:27.602604 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e641ea7e-fa60-40d7-a69e-2cea95663204 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:27.603338 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e641ea7e-fa60-40d7-a69e-2cea95663204 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:27.603790 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e641ea7e-fa60-40d7-a69e-2cea95663204 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:27.604420 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e641ea7e-fa60-40d7-a69e-2cea95663204 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:27.899523 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e641ea7e-fa60-40d7-a69e-2cea95663204 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:27.909777 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e641ea7e-fa60-40d7-a69e-2cea95663204 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/c1406c0f-748a-4dae-9392-6957d4092c9f" status: 200 len: 1314 microversion: 2.1 time: 0.329964 Sep 08 10:42:27.911079 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 620/1289] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:27 2022] GET /compute/v2.1/servers/c1406c0f-748a-4dae-9392-6957d4092c9f => generated 1314 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:27.916969 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-985bdff0-619b-41da-8065-d21a4411205e tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:27.917873 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-985bdff0-619b-41da-8065-d21a4411205e tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] [instance: 26218db4-d06e-4ae2-8f15-f21004ce13b3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:27.925151 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-985bdff0-619b-41da-8065-d21a4411205e tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:27.925898 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-985bdff0-619b-41da-8065-d21a4411205e tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:27.926593 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-985bdff0-619b-41da-8065-d21a4411205e tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:27.927748 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-985bdff0-619b-41da-8065-d21a4411205e tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:27.928390 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-985bdff0-619b-41da-8065-d21a4411205e tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:27.929005 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-985bdff0-619b-41da-8065-d21a4411205e tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:28.032795 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-57f83020-7e9a-4607-a1d5-9eece89409d6 tempest-FloatingIPDetailsTestJSON-1685842162 tempest-FloatingIPDetailsTestJSON-1685842162-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/d74ba94e-bba0-4af4-95ad-084741ed93d3" status: 202 len: 0 microversion: 2.1 time: 1.206871 Sep 08 10:42:28.034420 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 670/1290] 10.222.0.27 () {58 vars in 1263 bytes} [Thu Sep 8 10:42:26 2022] DELETE /compute/v2.1/os-floating-ips/d74ba94e-bba0-4af4-95ad-084741ed93d3 => generated 0 bytes in 1209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:42:28.155863 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-985bdff0-619b-41da-8065-d21a4411205e tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae3291d8d8f40dc98be9c965ba86adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d59ac71b6f459ea38d5ddc24964216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:28.164704 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-985bdff0-619b-41da-8065-d21a4411205e tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] 10.222.0.27 "GET /compute/v2.1/servers/26218db4-d06e-4ae2-8f15-f21004ce13b3" status: 200 len: 1511 microversion: 2.1 time: 0.251373 Sep 08 10:42:28.165327 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 621/1291] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:27 2022] GET /compute/v2.1/servers/26218db4-d06e-4ae2-8f15-f21004ce13b3 => generated 1511 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:28.186123 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d2e5bf86-1ed6-406e-aefb-bc19f3913cb6 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:28.187194 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d2e5bf86-1ed6-406e-aefb-bc19f3913cb6 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] [instance: 790bcd42-ace5-4761-b46d-e0889855623f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:28.193245 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-06f9efae-ded8-4b17-92f4-8a46e52b912a tempest-ServicesAdminNegativeTestJSON-441219208 tempest-ServicesAdminNegativeTestJSON-441219208-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:28.194900 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d2e5bf86-1ed6-406e-aefb-bc19f3913cb6 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:28.195412 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d2e5bf86-1ed6-406e-aefb-bc19f3913cb6 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:28.196026 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d2e5bf86-1ed6-406e-aefb-bc19f3913cb6 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:28.196923 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d2e5bf86-1ed6-406e-aefb-bc19f3913cb6 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:28.197576 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d2e5bf86-1ed6-406e-aefb-bc19f3913cb6 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:28.198319 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d2e5bf86-1ed6-406e-aefb-bc19f3913cb6 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:28.198991 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-06f9efae-ded8-4b17-92f4-8a46e52b912a tempest-ServicesAdminNegativeTestJSON-441219208 tempest-ServicesAdminNegativeTestJSON-441219208-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:28.199829 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-06f9efae-ded8-4b17-92f4-8a46e52b912a tempest-ServicesAdminNegativeTestJSON-441219208 tempest-ServicesAdminNegativeTestJSON-441219208-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:28.200515 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-06f9efae-ded8-4b17-92f4-8a46e52b912a tempest-ServicesAdminNegativeTestJSON-441219208 tempest-ServicesAdminNegativeTestJSON-441219208-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:28.201356 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-06f9efae-ded8-4b17-92f4-8a46e52b912a tempest-ServicesAdminNegativeTestJSON-441219208 tempest-ServicesAdminNegativeTestJSON-441219208-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:28.201967 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-06f9efae-ded8-4b17-92f4-8a46e52b912a tempest-ServicesAdminNegativeTestJSON-441219208 tempest-ServicesAdminNegativeTestJSON-441219208-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:28.202407 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-06f9efae-ded8-4b17-92f4-8a46e52b912a tempest-ServicesAdminNegativeTestJSON-441219208 tempest-ServicesAdminNegativeTestJSON-441219208-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:28.227882 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-06f9efae-ded8-4b17-92f4-8a46e52b912a tempest-ServicesAdminNegativeTestJSON-441219208 tempest-ServicesAdminNegativeTestJSON-441219208-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.191887 Sep 08 10:42:28.228478 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 671/1292] 10.222.0.27 () {58 vars in 1137 bytes} [Thu Sep 8 10:42:28 2022] GET /compute/v2.1/os-services => generated 949 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:42:28.232970 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9bcf68d5-1d68-47d3-8009-62f8667d22e7 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:28.233611 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9bcf68d5-1d68-47d3-8009-62f8667d22e7 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 133a5f12-39e5-4e0f-81dc-b1948c073f15] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:28.240890 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9bcf68d5-1d68-47d3-8009-62f8667d22e7 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:28.241452 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9bcf68d5-1d68-47d3-8009-62f8667d22e7 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:28.248089 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9bcf68d5-1d68-47d3-8009-62f8667d22e7 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:28.248089 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9bcf68d5-1d68-47d3-8009-62f8667d22e7 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:28.248089 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9bcf68d5-1d68-47d3-8009-62f8667d22e7 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:28.248089 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9bcf68d5-1d68-47d3-8009-62f8667d22e7 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:28.364987 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d2e5bf86-1ed6-406e-aefb-bc19f3913cb6 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b206b1f0a1d4f6ebefffc97c51e6f51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8038d51a764867a85d2eab4ac10d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:28.380947 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d2e5bf86-1ed6-406e-aefb-bc19f3913cb6 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] 10.222.0.27 "GET /compute/v2.1/servers/790bcd42-ace5-4761-b46d-e0889855623f" status: 200 len: 1372 microversion: 2.1 time: 0.201891 Sep 08 10:42:28.381676 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 622/1293] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:28 2022] GET /compute/v2.1/servers/790bcd42-ace5-4761-b46d-e0889855623f => generated 1372 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:28.389855 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3e1e1a77-3a2d-4b60-841f-e1d67ef11308 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:28.391141 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3e1e1a77-3a2d-4b60-841f-e1d67ef11308 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: a3a6ce0f-e362-4cbc-afc2-3cfd349a4812] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:28.405614 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3e1e1a77-3a2d-4b60-841f-e1d67ef11308 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:28.406680 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3e1e1a77-3a2d-4b60-841f-e1d67ef11308 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:28.407156 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3e1e1a77-3a2d-4b60-841f-e1d67ef11308 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:28.407908 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3e1e1a77-3a2d-4b60-841f-e1d67ef11308 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:28.408423 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3e1e1a77-3a2d-4b60-841f-e1d67ef11308 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:28.409050 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3e1e1a77-3a2d-4b60-841f-e1d67ef11308 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:28.448563 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9bcf68d5-1d68-47d3-8009-62f8667d22e7 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:28.463147 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9bcf68d5-1d68-47d3-8009-62f8667d22e7 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15" status: 200 len: 1718 microversion: 2.1 time: 0.233587 Sep 08 10:42:28.463749 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 672/1294] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:28 2022] GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15 => generated 1718 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:28.473465 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f6595df8-9f3c-4e97-b91b-0e6901e78ca3 tempest-FloatingIPDetailsTestJSON-1685842162 tempest-FloatingIPDetailsTestJSON-1685842162-project] Calling method '.version_select at 0x7f68e44d69d0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:28.607721 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-3e1e1a77-3a2d-4b60-841f-e1d67ef11308 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:28.616607 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3e1e1a77-3a2d-4b60-841f-e1d67ef11308 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812" status: 200 len: 1535 microversion: 2.1 time: 0.233443 Sep 08 10:42:28.617218 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 623/1295] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:28 2022] GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812 => generated 1535 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:28.621704 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-f6dd5fa2-1559-44d5-9c82-94842a601aeb req-408d618a-1162-4814-a804-f4652f46dcd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3a6ce0f-e362-4cbc-afc2-3cfd349a4812", "name": "network-vif-unplugged", "status": "completed", "tag": "8ff15ca8-cc64-424e-b9f6-8f38b142e5ac"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:42:28.633111 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-f6dd5fa2-1559-44d5-9c82-94842a601aeb req-408d618a-1162-4814-a804-f4652f46dcd1 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:28.633111 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-f6dd5fa2-1559-44d5-9c82-94842a601aeb req-408d618a-1162-4814-a804-f4652f46dcd1 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:28.633111 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-f6dd5fa2-1559-44d5-9c82-94842a601aeb req-408d618a-1162-4814-a804-f4652f46dcd1 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:28.646547 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-f6dd5fa2-1559-44d5-9c82-94842a601aeb req-408d618a-1162-4814-a804-f4652f46dcd1 service nova] Creating event network-vif-unplugged:8ff15ca8-cc64-424e-b9f6-8f38b142e5ac for instance a3a6ce0f-e362-4cbc-afc2-3cfd349a4812 on n-h1-850501-12 Sep 08 10:42:28.652376 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:42:28.654406 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [req-f6dd5fa2-1559-44d5-9c82-94842a601aeb req-408d618a-1162-4814-a804-f4652f46dcd1 service nova] Instance a3a6ce0f-e362-4cbc-afc2-3cfd349a4812 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850501-12'} {{(pid=128861) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 10:42:28.667563 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-f6dd5fa2-1559-44d5-9c82-94842a601aeb req-408d618a-1162-4814-a804-f4652f46dcd1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048624 Sep 08 10:42:28.668622 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 624/1296] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:42:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:42:28.677780 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e019c44a-f393-42eb-8619-414f650ebb24 tempest-ServicesAdminNegativeTestJSON-441219208 tempest-ServicesAdminNegativeTestJSON-441219208-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:28.681455 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e019c44a-f393-42eb-8619-414f650ebb24 tempest-ServicesAdminNegativeTestJSON-441219208 tempest-ServicesAdminNegativeTestJSON-441219208-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:28.682026 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e019c44a-f393-42eb-8619-414f650ebb24 tempest-ServicesAdminNegativeTestJSON-441219208 tempest-ServicesAdminNegativeTestJSON-441219208-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:28.682551 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e019c44a-f393-42eb-8619-414f650ebb24 tempest-ServicesAdminNegativeTestJSON-441219208 tempest-ServicesAdminNegativeTestJSON-441219208-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:28.683371 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e019c44a-f393-42eb-8619-414f650ebb24 tempest-ServicesAdminNegativeTestJSON-441219208 tempest-ServicesAdminNegativeTestJSON-441219208-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:28.684690 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e019c44a-f393-42eb-8619-414f650ebb24 tempest-ServicesAdminNegativeTestJSON-441219208 tempest-ServicesAdminNegativeTestJSON-441219208-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:28.684690 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e019c44a-f393-42eb-8619-414f650ebb24 tempest-ServicesAdminNegativeTestJSON-441219208 tempest-ServicesAdminNegativeTestJSON-441219208-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:28.708452 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:42:28.721981 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e019c44a-f393-42eb-8619-414f650ebb24 tempest-ServicesAdminNegativeTestJSON-441219208 tempest-ServicesAdminNegativeTestJSON-441219208-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.048814 Sep 08 10:42:28.722616 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 625/1297] 10.222.0.27 () {58 vars in 1170 bytes} [Thu Sep 8 10:42:28 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 949 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:42:28.727279 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-278dbe2a-05b7-4696-a4db-ef2c4491a5a3 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:28.728270 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-278dbe2a-05b7-4696-a4db-ef2c4491a5a3 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:28.736098 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f6595df8-9f3c-4e97-b91b-0e6901e78ca3 tempest-FloatingIPDetailsTestJSON-1685842162 tempest-FloatingIPDetailsTestJSON-1685842162-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.271098 Sep 08 10:42:28.736692 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 673/1298] 10.222.0.27 () {58 vars in 1164 bytes} [Thu Sep 8 10:42:28 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:42:28.745198 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-278dbe2a-05b7-4696-a4db-ef2c4491a5a3 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:28.746187 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-278dbe2a-05b7-4696-a4db-ef2c4491a5a3 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:28.746765 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8753b59f-1516-4f6a-8e3d-373c5db6f3b1 tempest-ServicesAdminNegativeTestJSON-441219208 tempest-ServicesAdminNegativeTestJSON-441219208-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:28.747034 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-278dbe2a-05b7-4696-a4db-ef2c4491a5a3 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:28.748425 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-278dbe2a-05b7-4696-a4db-ef2c4491a5a3 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:28.749258 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-278dbe2a-05b7-4696-a4db-ef2c4491a5a3 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:28.750046 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-278dbe2a-05b7-4696-a4db-ef2c4491a5a3 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:28.751345 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8753b59f-1516-4f6a-8e3d-373c5db6f3b1 tempest-ServicesAdminNegativeTestJSON-441219208 tempest-ServicesAdminNegativeTestJSON-441219208-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:28.751915 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8753b59f-1516-4f6a-8e3d-373c5db6f3b1 tempest-ServicesAdminNegativeTestJSON-441219208 tempest-ServicesAdminNegativeTestJSON-441219208-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:28.752434 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8753b59f-1516-4f6a-8e3d-373c5db6f3b1 tempest-ServicesAdminNegativeTestJSON-441219208 tempest-ServicesAdminNegativeTestJSON-441219208-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:28.753455 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8753b59f-1516-4f6a-8e3d-373c5db6f3b1 tempest-ServicesAdminNegativeTestJSON-441219208 tempest-ServicesAdminNegativeTestJSON-441219208-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:28.753987 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8753b59f-1516-4f6a-8e3d-373c5db6f3b1 tempest-ServicesAdminNegativeTestJSON-441219208 tempest-ServicesAdminNegativeTestJSON-441219208-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:28.754490 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8753b59f-1516-4f6a-8e3d-373c5db6f3b1 tempest-ServicesAdminNegativeTestJSON-441219208 tempest-ServicesAdminNegativeTestJSON-441219208-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:28.780648 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8753b59f-1516-4f6a-8e3d-373c5db6f3b1 tempest-ServicesAdminNegativeTestJSON-441219208 tempest-ServicesAdminNegativeTestJSON-441219208-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.038248 Sep 08 10:42:28.794724 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 674/1299] 10.222.0.27 () {58 vars in 1137 bytes} [Thu Sep 8 10:42:28 2022] GET /compute/v2.1/os-services => generated 949 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:42:28.794724 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-73e30359-09d8-4555-811d-5e2d775a1d9d tempest-FloatingIPDetailsTestJSON-1685842162 tempest-FloatingIPDetailsTestJSON-1685842162-project] Calling method '.version_select at 0x7f68e454a670>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:28.932076 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-278dbe2a-05b7-4696-a4db-ef2c4491a5a3 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:28.942791 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-278dbe2a-05b7-4696-a4db-ef2c4491a5a3 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:28.944236 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-278dbe2a-05b7-4696-a4db-ef2c4491a5a3 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:28.945446 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-278dbe2a-05b7-4696-a4db-ef2c4491a5a3 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e" status: 200 len: 1800 microversion: 2.25 time: 0.221869 Sep 08 10:42:28.946021 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 626/1300] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:42:28 2022] GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e => generated 1800 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:42:28.950245 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2ed8be1e-2bf4-4bba-ab02-95dbffc3fc47 tempest-ServicesAdminNegativeTestJSON-441219208 tempest-ServicesAdminNegativeTestJSON-441219208-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:28.954032 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2ed8be1e-2bf4-4bba-ab02-95dbffc3fc47 tempest-ServicesAdminNegativeTestJSON-441219208 tempest-ServicesAdminNegativeTestJSON-441219208-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:28.954523 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2ed8be1e-2bf4-4bba-ab02-95dbffc3fc47 tempest-ServicesAdminNegativeTestJSON-441219208 tempest-ServicesAdminNegativeTestJSON-441219208-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:28.954956 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2ed8be1e-2bf4-4bba-ab02-95dbffc3fc47 tempest-ServicesAdminNegativeTestJSON-441219208 tempest-ServicesAdminNegativeTestJSON-441219208-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:28.955694 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2ed8be1e-2bf4-4bba-ab02-95dbffc3fc47 tempest-ServicesAdminNegativeTestJSON-441219208 tempest-ServicesAdminNegativeTestJSON-441219208-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:28.956148 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2ed8be1e-2bf4-4bba-ab02-95dbffc3fc47 tempest-ServicesAdminNegativeTestJSON-441219208 tempest-ServicesAdminNegativeTestJSON-441219208-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:28.956568 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2ed8be1e-2bf4-4bba-ab02-95dbffc3fc47 tempest-ServicesAdminNegativeTestJSON-441219208 tempest-ServicesAdminNegativeTestJSON-441219208-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:28.985009 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2ed8be1e-2bf4-4bba-ab02-95dbffc3fc47 tempest-ServicesAdminNegativeTestJSON-441219208 tempest-ServicesAdminNegativeTestJSON-441219208-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?host=n-d-850501-12&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.037247 Sep 08 10:42:28.985583 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 627/1301] 10.222.0.27 () {58 vars in 1196 bytes} [Thu Sep 8 10:42:28 2022] GET /compute/v2.1/os-services?host=n-d-850501-12&binary=xxx => generated 16 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:42:28.990591 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e14a6772-b19b-4bf7-8436-bff16b5ce1a3 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:28.991198 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e14a6772-b19b-4bf7-8436-bff16b5ce1a3 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: c1406c0f-748a-4dae-9392-6957d4092c9f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:28.997701 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e14a6772-b19b-4bf7-8436-bff16b5ce1a3 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:28.998194 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e14a6772-b19b-4bf7-8436-bff16b5ce1a3 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:28.998783 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e14a6772-b19b-4bf7-8436-bff16b5ce1a3 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:28.999492 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e14a6772-b19b-4bf7-8436-bff16b5ce1a3 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:29.000594 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e14a6772-b19b-4bf7-8436-bff16b5ce1a3 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:29.001105 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e14a6772-b19b-4bf7-8436-bff16b5ce1a3 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:29.186561 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e14a6772-b19b-4bf7-8436-bff16b5ce1a3 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:29.195599 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e14a6772-b19b-4bf7-8436-bff16b5ce1a3 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/c1406c0f-748a-4dae-9392-6957d4092c9f" status: 200 len: 1314 microversion: 2.1 time: 0.208493 Sep 08 10:42:29.201891 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 628/1302] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:28 2022] GET /compute/v2.1/servers/c1406c0f-748a-4dae-9392-6957d4092c9f => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:29.207652 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-41db402a-0c22-4c4c-87cf-dd7878e90255 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Calling method '.version_select at 0x7f68e4484a60>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:29.211545 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41db402a-0c22-4c4c-87cf-dd7878e90255 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:29.212046 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41db402a-0c22-4c4c-87cf-dd7878e90255 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:29.212667 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41db402a-0c22-4c4c-87cf-dd7878e90255 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:29.232914 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-41db402a-0c22-4c4c-87cf-dd7878e90255 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 4325 microversion: 2.25 time: 0.034287 Sep 08 10:42:29.233779 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 629/1303] 10.222.0.27 () {60 vars in 1184 bytes} [Thu Sep 8 10:42:29 2022] GET /compute/v2.1/os-migrations => generated 4325 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:42:29.240888 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ee7448b6-ac3a-450a-ab67-713bb37660b2 tempest-ServicesAdminNegativeTestJSON-441219208 tempest-ServicesAdminNegativeTestJSON-441219208-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:29.246948 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ee7448b6-ac3a-450a-ab67-713bb37660b2 tempest-ServicesAdminNegativeTestJSON-441219208 tempest-ServicesAdminNegativeTestJSON-441219208-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:29.247654 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ee7448b6-ac3a-450a-ab67-713bb37660b2 tempest-ServicesAdminNegativeTestJSON-441219208 tempest-ServicesAdminNegativeTestJSON-441219208-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:29.248206 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ee7448b6-ac3a-450a-ab67-713bb37660b2 tempest-ServicesAdminNegativeTestJSON-441219208 tempest-ServicesAdminNegativeTestJSON-441219208-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:29.249452 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ee7448b6-ac3a-450a-ab67-713bb37660b2 tempest-ServicesAdminNegativeTestJSON-441219208 tempest-ServicesAdminNegativeTestJSON-441219208-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:29.250854 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ee7448b6-ac3a-450a-ab67-713bb37660b2 tempest-ServicesAdminNegativeTestJSON-441219208 tempest-ServicesAdminNegativeTestJSON-441219208-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:29.251766 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ee7448b6-ac3a-450a-ab67-713bb37660b2 tempest-ServicesAdminNegativeTestJSON-441219208 tempest-ServicesAdminNegativeTestJSON-441219208-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:29.284650 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ee7448b6-ac3a-450a-ab67-713bb37660b2 tempest-ServicesAdminNegativeTestJSON-441219208 tempest-ServicesAdminNegativeTestJSON-441219208-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.048374 Sep 08 10:42:29.289201 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 630/1304] 10.222.0.27 () {58 vars in 1137 bytes} [Thu Sep 8 10:42:29 2022] GET /compute/v2.1/os-services => generated 949 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:42:29.295340 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f7350b6e-c281-431c-b23a-67cf661d8796 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:29.295954 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f7350b6e-c281-431c-b23a-67cf661d8796 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] [instance: 26218db4-d06e-4ae2-8f15-f21004ce13b3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:29.304783 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f7350b6e-c281-431c-b23a-67cf661d8796 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:29.311951 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f7350b6e-c281-431c-b23a-67cf661d8796 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:29.313261 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f7350b6e-c281-431c-b23a-67cf661d8796 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:29.315628 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f7350b6e-c281-431c-b23a-67cf661d8796 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:29.316432 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f7350b6e-c281-431c-b23a-67cf661d8796 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:29.317118 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f7350b6e-c281-431c-b23a-67cf661d8796 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:29.405383 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-73e30359-09d8-4555-811d-5e2d775a1d9d tempest-FloatingIPDetailsTestJSON-1685842162 tempest-FloatingIPDetailsTestJSON-1685842162-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips" status: 200 len: 397 microversion: 2.1 time: 0.621849 Sep 08 10:42:29.407186 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 675/1305] 10.222.0.27 () {58 vars in 1149 bytes} [Thu Sep 8 10:42:28 2022] GET /compute/v2.1/os-floating-ips => generated 397 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:42:29.417513 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c13d4561-73fd-450d-9b30-9540289d31d5 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:29.418957 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c13d4561-73fd-450d-9b30-9540289d31d5 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] [instance: 4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:29.430330 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c13d4561-73fd-450d-9b30-9540289d31d5 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:29.430933 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c13d4561-73fd-450d-9b30-9540289d31d5 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:29.431447 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c13d4561-73fd-450d-9b30-9540289d31d5 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:29.432242 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c13d4561-73fd-450d-9b30-9540289d31d5 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:29.432776 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c13d4561-73fd-450d-9b30-9540289d31d5 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:29.433340 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c13d4561-73fd-450d-9b30-9540289d31d5 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:29.528153 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f7350b6e-c281-431c-b23a-67cf661d8796 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae3291d8d8f40dc98be9c965ba86adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d59ac71b6f459ea38d5ddc24964216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:29.537587 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f7350b6e-c281-431c-b23a-67cf661d8796 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] 10.222.0.27 "GET /compute/v2.1/servers/26218db4-d06e-4ae2-8f15-f21004ce13b3" status: 200 len: 1511 microversion: 2.1 time: 0.246805 Sep 08 10:42:29.538177 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 631/1306] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:29 2022] GET /compute/v2.1/servers/26218db4-d06e-4ae2-8f15-f21004ce13b3 => generated 1511 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:29.542604 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ff9bfddb-7705-4e86-8a9c-81e515cb66ca tempest-ServicesAdminNegativeTestJSON-441219208 tempest-ServicesAdminNegativeTestJSON-441219208-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:29.547501 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ff9bfddb-7705-4e86-8a9c-81e515cb66ca tempest-ServicesAdminNegativeTestJSON-441219208 tempest-ServicesAdminNegativeTestJSON-441219208-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:29.547501 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ff9bfddb-7705-4e86-8a9c-81e515cb66ca tempest-ServicesAdminNegativeTestJSON-441219208 tempest-ServicesAdminNegativeTestJSON-441219208-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:29.547501 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ff9bfddb-7705-4e86-8a9c-81e515cb66ca tempest-ServicesAdminNegativeTestJSON-441219208 tempest-ServicesAdminNegativeTestJSON-441219208-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:29.548072 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ff9bfddb-7705-4e86-8a9c-81e515cb66ca tempest-ServicesAdminNegativeTestJSON-441219208 tempest-ServicesAdminNegativeTestJSON-441219208-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:29.548486 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ff9bfddb-7705-4e86-8a9c-81e515cb66ca tempest-ServicesAdminNegativeTestJSON-441219208 tempest-ServicesAdminNegativeTestJSON-441219208-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:29.548909 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ff9bfddb-7705-4e86-8a9c-81e515cb66ca tempest-ServicesAdminNegativeTestJSON-441219208 tempest-ServicesAdminNegativeTestJSON-441219208-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:29.577660 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ff9bfddb-7705-4e86-8a9c-81e515cb66ca tempest-ServicesAdminNegativeTestJSON-441219208 tempest-ServicesAdminNegativeTestJSON-441219208-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.038155 Sep 08 10:42:29.579342 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 632/1307] 10.222.0.27 () {58 vars in 1198 bytes} [Thu Sep 8 10:42:29 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:42:29.585140 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6665d40d-8cca-4851-8763-b62c608d3427 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:29.587337 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6665d40d-8cca-4851-8763-b62c608d3427 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] [instance: 790bcd42-ace5-4761-b46d-e0889855623f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:29.595446 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6665d40d-8cca-4851-8763-b62c608d3427 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:29.595937 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6665d40d-8cca-4851-8763-b62c608d3427 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:29.596370 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6665d40d-8cca-4851-8763-b62c608d3427 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:29.597225 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6665d40d-8cca-4851-8763-b62c608d3427 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:29.598542 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6665d40d-8cca-4851-8763-b62c608d3427 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:29.599293 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6665d40d-8cca-4851-8763-b62c608d3427 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:29.637756 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-c13d4561-73fd-450d-9b30-9540289d31d5 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lazy-loading 'services' on Instance uuid 4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:42:29.653216 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c13d4561-73fd-450d-9b30-9540289d31d5 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e" status: 200 len: 2419 microversion: 2.25 time: 0.244123 Sep 08 10:42:29.654054 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 676/1308] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:42:29 2022] GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e => generated 2419 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:42:29.659225 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d753533c-44ce-4759-a3d6-e8234e56615d tempest-FloatingIPDetailsTestJSON-1685842162 tempest-FloatingIPDetailsTestJSON-1685842162-project] Calling method '.version_select at 0x7f68e4670670>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:29.795192 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6665d40d-8cca-4851-8763-b62c608d3427 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b206b1f0a1d4f6ebefffc97c51e6f51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8038d51a764867a85d2eab4ac10d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:29.806443 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6665d40d-8cca-4851-8763-b62c608d3427 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] 10.222.0.27 "GET /compute/v2.1/servers/790bcd42-ace5-4761-b46d-e0889855623f" status: 200 len: 1372 microversion: 2.1 time: 0.225792 Sep 08 10:42:29.821870 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 633/1309] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:29 2022] GET /compute/v2.1/servers/790bcd42-ace5-4761-b46d-e0889855623f => generated 1372 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:29.828356 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-853d1216-a951-4d97-8359-ad2d4b5fabd7 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:29.828985 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-853d1216-a951-4d97-8359-ad2d4b5fabd7 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 133a5f12-39e5-4e0f-81dc-b1948c073f15] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:29.835636 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-853d1216-a951-4d97-8359-ad2d4b5fabd7 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:29.836138 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-853d1216-a951-4d97-8359-ad2d4b5fabd7 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:29.836599 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-853d1216-a951-4d97-8359-ad2d4b5fabd7 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:29.837332 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-853d1216-a951-4d97-8359-ad2d4b5fabd7 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:29.837802 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-853d1216-a951-4d97-8359-ad2d4b5fabd7 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:29.838228 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-853d1216-a951-4d97-8359-ad2d4b5fabd7 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:30.032153 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-853d1216-a951-4d97-8359-ad2d4b5fabd7 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:30.045976 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-853d1216-a951-4d97-8359-ad2d4b5fabd7 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15" status: 200 len: 1718 microversion: 2.1 time: 0.222861 Sep 08 10:42:30.047787 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 634/1310] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:29 2022] GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15 => generated 1718 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:30.195072 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b2018872-52ad-4d6a-a5f6-cad694cf783d tempest-ServicesAdminNegativeTestJSON-1559645119 tempest-ServicesAdminNegativeTestJSON-1559645119-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:30.199325 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b2018872-52ad-4d6a-a5f6-cad694cf783d tempest-ServicesAdminNegativeTestJSON-1559645119 tempest-ServicesAdminNegativeTestJSON-1559645119-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '98e44e8de75f4f6dbefc1c8e5d723f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7161292fcb945a398bc9bb39473820c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:30.205593 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b2018872-52ad-4d6a-a5f6-cad694cf783d tempest-ServicesAdminNegativeTestJSON-1559645119 tempest-ServicesAdminNegativeTestJSON-1559645119-project] Request method failure captured: Sep 08 10:42:30.205593 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/os-services HTTP/1.1 Sep 08 10:42:30.205593 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:42:30.205593 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:42:30.205593 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:42:30.205593 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:42:30.205593 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:42:30.205593 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:42:30.205593 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:42:30.205593 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:42:30.205593 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGccSJGH8wJ6uxbMTluQhVAw1W2T8giGf-e4vmP4RNtwG7zgQBtJctWIyR6xaXcts8_j8ZX7GGfn-7HTNshwrgfe7OFic6hnXnA5k2wXGUHvwDGeCCo-_3WAfDoQKXPJEwxxOkNbc9NJAlVcBXPrlewpb50d4T2X72pqV-AdXfJORD4U Sep 08 10:42:30.205593 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:42:30.205593 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:42:30.205593 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:42:30.205593 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:42:30.205593 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:42:30.205593 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:42:30.205593 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: f7161292fcb945a398bc9bb39473820c Sep 08 10:42:30.205593 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-1559645119 Sep 08 10:42:30.205593 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:42:30.205593 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:42:30.205593 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f7161292fcb945a398bc9bb39473820c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f7161292fcb945a398bc9bb39473820c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f7161292fcb945a398bc9bb39473820c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f7161292fcb945a398bc9bb39473820c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:42:30.205593 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-1559645119 Sep 08 10:42:30.205593 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: f7161292fcb945a398bc9bb39473820c Sep 08 10:42:30.205593 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-1559645119 Sep 08 10:42:30.205593 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServicesAdminNegativeTestJSON-1559645119-project Sep 08 10:42:30.205593 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:42:30.205593 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:42:30.205593 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 98e44e8de75f4f6dbefc1c8e5d723f3e Sep 08 10:42:30.205593 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-1559645119-project Sep 08 10:42:30.205593 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:42:30.205593 n-d-850501-12 devstack@n-api.service[128861]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 08 10:42:30.205593 n-d-850501-12 devstack@n-api.service[128861]: action_args: {} Sep 08 10:42:30.205593 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:42:30.205593 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:42:30.205593 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:42:30.205593 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:42:30.205593 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:42:30.205593 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:42:30.205593 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 08 10:42:30.205593 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:42:30.205593 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 08 10:42:30.205593 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:42:30.205593 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:42:30.205593 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:42:30.205593 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Sep 08 10:42:30.205593 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Sep 08 10:42:30.205593 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 10:42:30.205593 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 10:42:30.205593 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 10:42:30.205593 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 10:42:30.205593 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:42:30.205593 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:42:30.205593 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:42:30.205593 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:42:30.205593 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 10:42:30.205593 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 10:42:30.205593 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 10:42:30.205593 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 10:42:30.205593 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 10:42:30.205593 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 10:42:30.205593 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 08 10:42:30.205593 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:42:30.211447 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:42:30.211447 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:42:30.211447 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:42:30.211447 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:42:30.211447 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:42:30.211447 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 10:42:30.211447 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 10:42:30.211447 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 08 10:42:30.211447 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:42:30.211447 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b2018872-52ad-4d6a-a5f6-cad694cf783d tempest-ServicesAdminNegativeTestJSON-1559645119 tempest-ServicesAdminNegativeTestJSON-1559645119-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:42:30.211447 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b2018872-52ad-4d6a-a5f6-cad694cf783d tempest-ServicesAdminNegativeTestJSON-1559645119 tempest-ServicesAdminNegativeTestJSON-1559645119-project] 10.222.0.27 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.158546 Sep 08 10:42:30.211447 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 635/1311] 10.222.0.27 () {58 vars in 1137 bytes} [Thu Sep 8 10:42:30 2022] GET /compute/v2.1/os-services => generated 112 bytes in 160 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:42:30.217622 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9fecbf49-77a9-41e6-9f50-9c0030ccae34 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:30.218246 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9fecbf49-77a9-41e6-9f50-9c0030ccae34 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: a3a6ce0f-e362-4cbc-afc2-3cfd349a4812] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:30.226374 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9fecbf49-77a9-41e6-9f50-9c0030ccae34 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:30.227091 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9fecbf49-77a9-41e6-9f50-9c0030ccae34 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:30.227794 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9fecbf49-77a9-41e6-9f50-9c0030ccae34 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:30.229104 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9fecbf49-77a9-41e6-9f50-9c0030ccae34 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:30.229579 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9fecbf49-77a9-41e6-9f50-9c0030ccae34 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:30.230014 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9fecbf49-77a9-41e6-9f50-9c0030ccae34 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:30.441511 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9fecbf49-77a9-41e6-9f50-9c0030ccae34 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:30.457080 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9fecbf49-77a9-41e6-9f50-9c0030ccae34 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812" status: 200 len: 1535 microversion: 2.1 time: 0.247999 Sep 08 10:42:30.461451 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 636/1312] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:30 2022] GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812 => generated 1535 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:30.467172 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5536f614-0e72-4c10-9d03-6400cd668fab tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:30.468931 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5536f614-0e72-4c10-9d03-6400cd668fab tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] [instance: 4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:30.478647 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5536f614-0e72-4c10-9d03-6400cd668fab tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:30.479195 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5536f614-0e72-4c10-9d03-6400cd668fab tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:30.479775 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5536f614-0e72-4c10-9d03-6400cd668fab tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:30.480574 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5536f614-0e72-4c10-9d03-6400cd668fab tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:30.481499 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5536f614-0e72-4c10-9d03-6400cd668fab tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:30.482057 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5536f614-0e72-4c10-9d03-6400cd668fab tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:30.695588 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-5536f614-0e72-4c10-9d03-6400cd668fab tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lazy-loading 'services' on Instance uuid 4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:42:30.718322 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5536f614-0e72-4c10-9d03-6400cd668fab tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e" status: 200 len: 2419 microversion: 2.25 time: 0.255329 Sep 08 10:42:30.720978 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 637/1313] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:42:30 2022] GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e => generated 2419 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:42:30.731736 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7087f84b-a8a7-4cd0-b246-52c6164dd2fb tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:30.732869 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7087f84b-a8a7-4cd0-b246-52c6164dd2fb tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: c1406c0f-748a-4dae-9392-6957d4092c9f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:30.769560 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7087f84b-a8a7-4cd0-b246-52c6164dd2fb tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:30.770505 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7087f84b-a8a7-4cd0-b246-52c6164dd2fb tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:30.773504 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7087f84b-a8a7-4cd0-b246-52c6164dd2fb tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:30.774904 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7087f84b-a8a7-4cd0-b246-52c6164dd2fb tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:30.779822 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7087f84b-a8a7-4cd0-b246-52c6164dd2fb tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:30.781582 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7087f84b-a8a7-4cd0-b246-52c6164dd2fb tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:30.985769 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d753533c-44ce-4759-a3d6-e8234e56615d tempest-FloatingIPDetailsTestJSON-1685842162 tempest-FloatingIPDetailsTestJSON-1685842162-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/7da248a6-981d-4e51-860e-5cc7cd7c3258" status: 202 len: 0 microversion: 2.1 time: 1.330567 Sep 08 10:42:30.989387 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 677/1314] 10.222.0.27 () {58 vars in 1263 bytes} [Thu Sep 8 10:42:29 2022] DELETE /compute/v2.1/os-floating-ips/7da248a6-981d-4e51-860e-5cc7cd7c3258 => generated 0 bytes in 1335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:42:30.995498 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d70b83fe-4045-46cc-8311-048b9d93bfb4 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:30.996127 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d70b83fe-4045-46cc-8311-048b9d93bfb4 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] [instance: 26218db4-d06e-4ae2-8f15-f21004ce13b3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:31.010510 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d70b83fe-4045-46cc-8311-048b9d93bfb4 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:31.011458 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d70b83fe-4045-46cc-8311-048b9d93bfb4 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:31.012175 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d70b83fe-4045-46cc-8311-048b9d93bfb4 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:31.013245 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d70b83fe-4045-46cc-8311-048b9d93bfb4 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:31.014974 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d70b83fe-4045-46cc-8311-048b9d93bfb4 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:31.016992 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d70b83fe-4045-46cc-8311-048b9d93bfb4 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:31.135424 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7087f84b-a8a7-4cd0-b246-52c6164dd2fb tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:31.151116 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7087f84b-a8a7-4cd0-b246-52c6164dd2fb tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/c1406c0f-748a-4dae-9392-6957d4092c9f" status: 200 len: 1500 microversion: 2.1 time: 0.427877 Sep 08 10:42:31.152406 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 638/1315] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:30 2022] GET /compute/v2.1/servers/c1406c0f-748a-4dae-9392-6957d4092c9f => generated 1500 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:31.161344 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-04485793-af5c-43d0-abbc-cbf21df1b1be req-661a009a-f410-4e80-b05b-502df5a8c40f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "790bcd42-ace5-4761-b46d-e0889855623f", "name": "network-vif-plugged", "status": "completed", "tag": "6e25a2af-b9a9-477e-a24c-f79b73a6fdc9"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:42:31.188881 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-04485793-af5c-43d0-abbc-cbf21df1b1be req-661a009a-f410-4e80-b05b-502df5a8c40f service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:31.190991 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-04485793-af5c-43d0-abbc-cbf21df1b1be req-661a009a-f410-4e80-b05b-502df5a8c40f service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:31.191648 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-04485793-af5c-43d0-abbc-cbf21df1b1be req-661a009a-f410-4e80-b05b-502df5a8c40f service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:31.220202 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-04485793-af5c-43d0-abbc-cbf21df1b1be req-661a009a-f410-4e80-b05b-502df5a8c40f service nova] Creating event network-vif-plugged:6e25a2af-b9a9-477e-a24c-f79b73a6fdc9 for instance 790bcd42-ace5-4761-b46d-e0889855623f on n-h2-850501-12 Sep 08 10:42:31.240752 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-04485793-af5c-43d0-abbc-cbf21df1b1be req-661a009a-f410-4e80-b05b-502df5a8c40f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085408 Sep 08 10:42:31.241881 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 639/1316] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:42:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:42:31.269527 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-56d0b381-98af-4c81-8940-02aa5a5ba355 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:31.270941 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-56d0b381-98af-4c81-8940-02aa5a5ba355 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] [instance: 790bcd42-ace5-4761-b46d-e0889855623f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:31.286400 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-56d0b381-98af-4c81-8940-02aa5a5ba355 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:31.288293 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-56d0b381-98af-4c81-8940-02aa5a5ba355 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:31.288744 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-56d0b381-98af-4c81-8940-02aa5a5ba355 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:31.289947 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-56d0b381-98af-4c81-8940-02aa5a5ba355 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:31.291696 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-56d0b381-98af-4c81-8940-02aa5a5ba355 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:31.293285 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-56d0b381-98af-4c81-8940-02aa5a5ba355 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:31.610718 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d70b83fe-4045-46cc-8311-048b9d93bfb4 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae3291d8d8f40dc98be9c965ba86adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d59ac71b6f459ea38d5ddc24964216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:31.637706 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d70b83fe-4045-46cc-8311-048b9d93bfb4 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] 10.222.0.27 "GET /compute/v2.1/servers/26218db4-d06e-4ae2-8f15-f21004ce13b3" status: 200 len: 1511 microversion: 2.1 time: 0.647182 Sep 08 10:42:31.642468 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 678/1317] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:30 2022] GET /compute/v2.1/servers/26218db4-d06e-4ae2-8f15-f21004ce13b3 => generated 1511 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:31.650994 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3bec5055-fd5c-4610-9b05-262c09d6ac88 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:31.653617 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3bec5055-fd5c-4610-9b05-262c09d6ac88 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:31.668590 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3bec5055-fd5c-4610-9b05-262c09d6ac88 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:31.673265 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3bec5055-fd5c-4610-9b05-262c09d6ac88 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:31.674063 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3bec5055-fd5c-4610-9b05-262c09d6ac88 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:31.675028 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3bec5055-fd5c-4610-9b05-262c09d6ac88 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:31.676277 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3bec5055-fd5c-4610-9b05-262c09d6ac88 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:31.676905 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3bec5055-fd5c-4610-9b05-262c09d6ac88 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:31.702328 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-56d0b381-98af-4c81-8940-02aa5a5ba355 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b206b1f0a1d4f6ebefffc97c51e6f51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8038d51a764867a85d2eab4ac10d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:31.715024 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-56d0b381-98af-4c81-8940-02aa5a5ba355 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] 10.222.0.27 "GET /compute/v2.1/servers/790bcd42-ace5-4761-b46d-e0889855623f" status: 200 len: 1372 microversion: 2.1 time: 0.469935 Sep 08 10:42:31.721288 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 640/1318] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:31 2022] GET /compute/v2.1/servers/790bcd42-ace5-4761-b46d-e0889855623f => generated 1372 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:31.733524 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8d2f637e-398e-4439-9434-5b678c8ab1e4 tempest-FloatingIPDetailsTestJSON-1685842162 tempest-FloatingIPDetailsTestJSON-1685842162-project] Calling method '.version_select at 0x7f68e442f940>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:31.974822 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-3bec5055-fd5c-4610-9b05-262c09d6ac88 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lazy-loading 'services' on Instance uuid 4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:42:32.185915 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3bec5055-fd5c-4610-9b05-262c09d6ac88 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e/os-volume_attachments/2ee93f6f-70ca-470c-9304-ce777d18f138" status: 202 len: 0 microversion: 2.25 time: 0.540591 Sep 08 10:42:32.187943 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 679/1319] 10.222.0.27 () {60 vars in 1457 bytes} [Thu Sep 8 10:42:31 2022] DELETE /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e/os-volume_attachments/2ee93f6f-70ca-470c-9304-ce777d18f138 => generated 0 bytes in 545 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:42:32.220081 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6d974b66-d5b0-4b28-bd98-903913d803c1 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:32.223316 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6d974b66-d5b0-4b28-bd98-903913d803c1 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 133a5f12-39e5-4e0f-81dc-b1948c073f15] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:32.245067 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d974b66-d5b0-4b28-bd98-903913d803c1 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:32.247387 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d974b66-d5b0-4b28-bd98-903913d803c1 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:32.249078 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d974b66-d5b0-4b28-bd98-903913d803c1 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:32.256117 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d974b66-d5b0-4b28-bd98-903913d803c1 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:32.256980 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d974b66-d5b0-4b28-bd98-903913d803c1 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:32.258805 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d974b66-d5b0-4b28-bd98-903913d803c1 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:32.750180 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6d974b66-d5b0-4b28-bd98-903913d803c1 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:32.780011 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6d974b66-d5b0-4b28-bd98-903913d803c1 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15" status: 200 len: 1718 microversion: 2.1 time: 0.590310 Sep 08 10:42:32.781717 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 680/1320] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:32 2022] GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15 => generated 1718 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:32.790960 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-235ddc9f-5169-4878-9fa3-808453f77c5f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:32.791782 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-235ddc9f-5169-4878-9fa3-808453f77c5f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: a3a6ce0f-e362-4cbc-afc2-3cfd349a4812] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:32.799379 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-235ddc9f-5169-4878-9fa3-808453f77c5f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:32.800351 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-235ddc9f-5169-4878-9fa3-808453f77c5f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:32.800773 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-235ddc9f-5169-4878-9fa3-808453f77c5f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:32.801537 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-235ddc9f-5169-4878-9fa3-808453f77c5f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:32.802001 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-235ddc9f-5169-4878-9fa3-808453f77c5f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:32.802418 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-235ddc9f-5169-4878-9fa3-808453f77c5f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:32.974344 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-235ddc9f-5169-4878-9fa3-808453f77c5f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:32.985679 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-235ddc9f-5169-4878-9fa3-808453f77c5f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812" status: 200 len: 1528 microversion: 2.1 time: 0.201053 Sep 08 10:42:33.003780 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 681/1321] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:32 2022] GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812 => generated 1528 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:33.010294 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cd24c6ff-d2c8-4d0b-8675-a490693cc09b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:33.013291 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cd24c6ff-d2c8-4d0b-8675-a490693cc09b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:33.020962 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd24c6ff-d2c8-4d0b-8675-a490693cc09b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:33.022488 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd24c6ff-d2c8-4d0b-8675-a490693cc09b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:33.023207 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd24c6ff-d2c8-4d0b-8675-a490693cc09b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:33.024516 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd24c6ff-d2c8-4d0b-8675-a490693cc09b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:33.025241 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd24c6ff-d2c8-4d0b-8675-a490693cc09b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:33.025786 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd24c6ff-d2c8-4d0b-8675-a490693cc09b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:33.070979 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cd24c6ff-d2c8-4d0b-8675-a490693cc09b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.065126 Sep 08 10:42:33.071575 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 682/1322] 10.222.0.27 () {60 vars in 1343 bytes} [Thu Sep 8 10:42:33 2022] GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:42:33.083902 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-cfb7dd57-da3c-4a9b-9fb8-322a8de09194 req-bbe0f904-b2c2-43b3-886a-c53b0e8d4797 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26218db4-d06e-4ae2-8f15-f21004ce13b3", "name": "network-vif-deleted", "tag": "94363ee7-29ad-4a4d-9c13-df432ed3359f"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:42:33.100663 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-cfb7dd57-da3c-4a9b-9fb8-322a8de09194 req-bbe0f904-b2c2-43b3-886a-c53b0e8d4797 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:33.101247 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-cfb7dd57-da3c-4a9b-9fb8-322a8de09194 req-bbe0f904-b2c2-43b3-886a-c53b0e8d4797 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:33.101678 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-cfb7dd57-da3c-4a9b-9fb8-322a8de09194 req-bbe0f904-b2c2-43b3-886a-c53b0e8d4797 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:33.119078 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-cfb7dd57-da3c-4a9b-9fb8-322a8de09194 req-bbe0f904-b2c2-43b3-886a-c53b0e8d4797 service nova] Creating event network-vif-deleted:94363ee7-29ad-4a4d-9c13-df432ed3359f for instance 26218db4-d06e-4ae2-8f15-f21004ce13b3 on n-h1-850501-12 Sep 08 10:42:33.130228 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-cfb7dd57-da3c-4a9b-9fb8-322a8de09194 req-bbe0f904-b2c2-43b3-886a-c53b0e8d4797 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055223 Sep 08 10:42:33.131684 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 683/1323] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:42:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:42:33.142390 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-174c47e9-0e31-4fc8-b50f-956055f6e12f tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:33.144225 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-174c47e9-0e31-4fc8-b50f-956055f6e12f tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] [instance: 26218db4-d06e-4ae2-8f15-f21004ce13b3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:33.151877 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-174c47e9-0e31-4fc8-b50f-956055f6e12f tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:33.153080 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-174c47e9-0e31-4fc8-b50f-956055f6e12f tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:33.153757 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-174c47e9-0e31-4fc8-b50f-956055f6e12f tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:33.155048 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-174c47e9-0e31-4fc8-b50f-956055f6e12f tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:33.155703 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-174c47e9-0e31-4fc8-b50f-956055f6e12f tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:33.156800 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-174c47e9-0e31-4fc8-b50f-956055f6e12f tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:33.193938 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-174c47e9-0e31-4fc8-b50f-956055f6e12f tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:33.194587 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8d2f637e-398e-4439-9434-5b678c8ab1e4 tempest-FloatingIPDetailsTestJSON-1685842162 tempest-FloatingIPDetailsTestJSON-1685842162-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/200851c0-2707-43b0-8278-865ad23e60bd" status: 202 len: 0 microversion: 2.1 time: 1.470439 Sep 08 10:42:33.195302 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 641/1324] 10.222.0.27 () {58 vars in 1263 bytes} [Thu Sep 8 10:42:31 2022] DELETE /compute/v2.1/os-floating-ips/200851c0-2707-43b0-8278-865ad23e60bd => generated 0 bytes in 1473 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:42:33.196024 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-174c47e9-0e31-4fc8-b50f-956055f6e12f tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:33.196617 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-174c47e9-0e31-4fc8-b50f-956055f6e12f tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:33.197247 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-174c47e9-0e31-4fc8-b50f-956055f6e12f tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lazy-loading 'fault' on Instance uuid 26218db4-d06e-4ae2-8f15-f21004ce13b3 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:42:33.204043 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4297b681-513f-4358-8e92-ed99da160ce7 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:33.205467 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4297b681-513f-4358-8e92-ed99da160ce7 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] [instance: 790bcd42-ace5-4761-b46d-e0889855623f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:33.221625 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4297b681-513f-4358-8e92-ed99da160ce7 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:33.222284 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4297b681-513f-4358-8e92-ed99da160ce7 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:33.224871 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4297b681-513f-4358-8e92-ed99da160ce7 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:33.225964 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4297b681-513f-4358-8e92-ed99da160ce7 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:33.226729 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4297b681-513f-4358-8e92-ed99da160ce7 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:33.227738 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4297b681-513f-4358-8e92-ed99da160ce7 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:33.305391 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-174c47e9-0e31-4fc8-b50f-956055f6e12f tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae3291d8d8f40dc98be9c965ba86adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d59ac71b6f459ea38d5ddc24964216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:33.322328 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-174c47e9-0e31-4fc8-b50f-956055f6e12f tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] 10.222.0.27 "GET /compute/v2.1/servers/26218db4-d06e-4ae2-8f15-f21004ce13b3" status: 200 len: 1306 microversion: 2.1 time: 0.186471 Sep 08 10:42:33.322919 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 684/1325] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:33 2022] GET /compute/v2.1/servers/26218db4-d06e-4ae2-8f15-f21004ce13b3 => generated 1306 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:33.333148 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8691dc81-27c9-4ee5-9496-2c301ab7b584 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:33.336017 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8691dc81-27c9-4ee5-9496-2c301ab7b584 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: a3a6ce0f-e362-4cbc-afc2-3cfd349a4812] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:33.343902 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8691dc81-27c9-4ee5-9496-2c301ab7b584 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:33.345121 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8691dc81-27c9-4ee5-9496-2c301ab7b584 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:33.345739 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8691dc81-27c9-4ee5-9496-2c301ab7b584 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:33.346870 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8691dc81-27c9-4ee5-9496-2c301ab7b584 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:33.347696 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8691dc81-27c9-4ee5-9496-2c301ab7b584 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:33.348277 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8691dc81-27c9-4ee5-9496-2c301ab7b584 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:33.655550 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8691dc81-27c9-4ee5-9496-2c301ab7b584 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:33.671147 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8691dc81-27c9-4ee5-9496-2c301ab7b584 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812" status: 200 len: 1528 microversion: 2.1 time: 0.346880 Sep 08 10:42:33.672626 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 685/1326] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:33 2022] GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812 => generated 1528 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:33.677351 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-514b7755-f6a5-49ec-8418-fd4d7361739a tempest-FloatingIPDetailsTestJSON-1685842162 tempest-FloatingIPDetailsTestJSON-1685842162-project] Calling method '.version_select at 0x7f68e44c9af0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:33.909822 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4297b681-513f-4358-8e92-ed99da160ce7 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b206b1f0a1d4f6ebefffc97c51e6f51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8038d51a764867a85d2eab4ac10d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:33.920683 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4297b681-513f-4358-8e92-ed99da160ce7 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] 10.222.0.27 "GET /compute/v2.1/servers/790bcd42-ace5-4761-b46d-e0889855623f" status: 200 len: 1558 microversion: 2.1 time: 0.724106 Sep 08 10:42:33.921969 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 642/1327] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:33 2022] GET /compute/v2.1/servers/790bcd42-ace5-4761-b46d-e0889855623f => generated 1558 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:33.938178 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-cda81536-2772-4061-ae95-7c1a292746e4 req-0b363305-00da-4ddf-9e60-d31cb716ba5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3a6ce0f-e362-4cbc-afc2-3cfd349a4812", "name": "network-vif-plugged", "status": "completed", "tag": "8ff15ca8-cc64-424e-b9f6-8f38b142e5ac"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:42:33.948854 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-cda81536-2772-4061-ae95-7c1a292746e4 req-0b363305-00da-4ddf-9e60-d31cb716ba5c service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:33.949464 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-cda81536-2772-4061-ae95-7c1a292746e4 req-0b363305-00da-4ddf-9e60-d31cb716ba5c service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:33.950007 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-cda81536-2772-4061-ae95-7c1a292746e4 req-0b363305-00da-4ddf-9e60-d31cb716ba5c service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:33.962360 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-cda81536-2772-4061-ae95-7c1a292746e4 req-0b363305-00da-4ddf-9e60-d31cb716ba5c service nova] Creating event network-vif-plugged:8ff15ca8-cc64-424e-b9f6-8f38b142e5ac for instance a3a6ce0f-e362-4cbc-afc2-3cfd349a4812 on n-h1-850501-12 Sep 08 10:42:33.967394 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-cda81536-2772-4061-ae95-7c1a292746e4 req-0b363305-00da-4ddf-9e60-d31cb716ba5c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041466 Sep 08 10:42:33.969477 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 643/1328] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:42:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:42:33.975672 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bad163cb-d510-410f-9d2b-65991d5a5719 tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:33.983134 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-bad163cb-d510-410f-9d2b-65991d5a5719 tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] HTTP exception thrown: Flavor 73d2dc41-0ed5-4d71-96c5-c690131aa7dc could not be found. Sep 08 10:42:33.998776 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bad163cb-d510-410f-9d2b-65991d5a5719 tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] Request method failure captured: Sep 08 10:42:33.998776 n-d-850501-12 devstack@n-api.service[128861]: request: DELETE /compute/v2.1/flavors/73d2dc41-0ed5-4d71-96c5-c690131aa7dc HTTP/1.1 Sep 08 10:42:33.998776 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:42:33.998776 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:42:33.998776 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:42:33.998776 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:42:33.998776 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:42:33.998776 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:42:33.998776 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:42:33.998776 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:42:33.998776 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcYIi-lYpsVXTMd5pTSmKAuy-Zg_S-EAtZEQ-9EOK0UOnNftu_LwTgc128mpQNL13LVb1ANSLQGEIWrXy5GviMOKhr7bCxxI2comkjQKjQWuuwpe-cDxSlLPCe-CgChEFpcbmS5uG26I-wVbInSeKSS1WXMTRZz7u67TRpkLZ3LpKYI Sep 08 10:42:33.998776 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:42:33.998776 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:42:33.998776 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:42:33.998776 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:42:33.998776 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:42:33.998776 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:42:33.998776 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 549722de06cc45c1aaec10bf5ba656aa Sep 08 10:42:33.998776 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-MigrationsAdminTest-1473145899 Sep 08 10:42:33.998776 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,admin,member Sep 08 10:42:33.998776 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,admin,member Sep 08 10:42:33.998776 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/549722de06cc45c1aaec10bf5ba656aa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/549722de06cc45c1aaec10bf5ba656aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_549722de06cc45c1aaec10bf5ba656aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/549722de06cc45c1aaec10bf5ba656aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:42:33.998776 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-MigrationsAdminTest-1473145899 Sep 08 10:42:33.998776 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 549722de06cc45c1aaec10bf5ba656aa Sep 08 10:42:33.998776 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-MigrationsAdminTest-1473145899 Sep 08 10:42:33.998776 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-MigrationsAdminTest-1473145899-project-admin Sep 08 10:42:33.998776 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:42:33.998776 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:42:33.998776 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 637a55ca4c684640a58a6afb579a864f Sep 08 10:42:33.998776 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-MigrationsAdminTest-1473145899-project-admin Sep 08 10:42:33.998776 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:42:33.998776 n-d-850501-12 devstack@n-api.service[128861]: exception: Flavor 73d2dc41-0ed5-4d71-96c5-c690131aa7dc could not be found. Sep 08 10:42:33.998776 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '73d2dc41-0ed5-4d71-96c5-c690131aa7dc'} Sep 08 10:42:33.998776 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:42:33.998776 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:42:33.998776 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Sep 08 10:42:33.998776 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi flavor.destroy() Sep 08 10:42:33.998776 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 08 10:42:33.998776 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 08 10:42:33.998776 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Sep 08 10:42:33.998776 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Sep 08 10:42:33.998776 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Sep 08 10:42:33.998776 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Sep 08 10:42:33.998776 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 08 10:42:33.998776 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 08 10:42:33.998776 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Sep 08 10:42:33.998776 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Sep 08 10:42:33.998776 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 73d2dc41-0ed5-4d71-96c5-c690131aa7dc could not be found. Sep 08 10:42:33.998776 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:42:33.998776 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:42:33.998776 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:42:33.998776 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:42:33.998776 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:42:33.998776 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:42:33.998776 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:42:33.998776 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:42:33.998776 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:42:33.998776 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:42:33.998776 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Sep 08 10:42:33.998776 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:42:33.998776 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 73d2dc41-0ed5-4d71-96c5-c690131aa7dc could not be found. Sep 08 10:42:33.998776 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:42:33.998776 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:42:34.004198 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:42:34.004198 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:42:34.004198 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:42:34.004198 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:42:34.004198 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:42:34.004198 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:42:34.004198 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 73d2dc41-0ed5-4d71-96c5-c690131aa7dc could not be found. Sep 08 10:42:34.004198 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:42:34.004198 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bad163cb-d510-410f-9d2b-65991d5a5719 tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] Returning 404 to user: Flavor 73d2dc41-0ed5-4d71-96c5-c690131aa7dc could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:42:34.004198 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bad163cb-d510-410f-9d2b-65991d5a5719 tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/73d2dc41-0ed5-4d71-96c5-c690131aa7dc" status: 404 len: 109 microversion: 2.1 time: 0.031007 Sep 08 10:42:34.004198 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 644/1329] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:42:33 2022] DELETE /compute/v2.1/flavors/73d2dc41-0ed5-4d71-96c5-c690131aa7dc => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:42:34.012930 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d645fc72-1848-4cab-bb66-cb8174746002 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:34.013715 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d645fc72-1848-4cab-bb66-cb8174746002 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 133a5f12-39e5-4e0f-81dc-b1948c073f15] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:34.022434 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d645fc72-1848-4cab-bb66-cb8174746002 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:34.023282 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d645fc72-1848-4cab-bb66-cb8174746002 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:34.023970 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d645fc72-1848-4cab-bb66-cb8174746002 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:34.025257 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d645fc72-1848-4cab-bb66-cb8174746002 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:34.025957 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d645fc72-1848-4cab-bb66-cb8174746002 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:34.026626 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d645fc72-1848-4cab-bb66-cb8174746002 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:34.304283 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d645fc72-1848-4cab-bb66-cb8174746002 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:34.314405 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d645fc72-1848-4cab-bb66-cb8174746002 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15" status: 200 len: 1708 microversion: 2.1 time: 0.305753 Sep 08 10:42:34.315500 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 645/1330] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:34 2022] GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15 => generated 1708 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:34.321307 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ae1c1e0d-aa76-435b-8e7e-b7fb63dbd7d3 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "925a5ea9-c999-466a-96f0-7e114bf65dcb"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:42:34.323961 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ae1c1e0d-aa76-435b-8e7e-b7fb63dbd7d3 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: c1406c0f-748a-4dae-9392-6957d4092c9f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:34.333844 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ae1c1e0d-aa76-435b-8e7e-b7fb63dbd7d3 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:34.338922 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ae1c1e0d-aa76-435b-8e7e-b7fb63dbd7d3 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:34.339716 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ae1c1e0d-aa76-435b-8e7e-b7fb63dbd7d3 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:34.341586 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ae1c1e0d-aa76-435b-8e7e-b7fb63dbd7d3 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:34.342506 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ae1c1e0d-aa76-435b-8e7e-b7fb63dbd7d3 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:34.345725 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ae1c1e0d-aa76-435b-8e7e-b7fb63dbd7d3 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:34.826678 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ae1c1e0d-aa76-435b-8e7e-b7fb63dbd7d3 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "POST /compute/v2.1/servers/c1406c0f-748a-4dae-9392-6957d4092c9f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.509399 Sep 08 10:42:34.828934 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 646/1331] 10.222.0.27 () {60 vars in 1323 bytes} [Thu Sep 8 10:42:34 2022] POST /compute/v2.1/servers/c1406c0f-748a-4dae-9392-6957d4092c9f/os-volume_attachments => generated 194 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:42:34.846734 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5a1d7c4a-2b74-42c0-9b98-867ac0a77c13 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:34.863687 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5a1d7c4a-2b74-42c0-9b98-867ac0a77c13 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] [instance: 790bcd42-ace5-4761-b46d-e0889855623f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:34.877288 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5a1d7c4a-2b74-42c0-9b98-867ac0a77c13 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:34.880071 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5a1d7c4a-2b74-42c0-9b98-867ac0a77c13 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:34.880996 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5a1d7c4a-2b74-42c0-9b98-867ac0a77c13 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:34.884349 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5a1d7c4a-2b74-42c0-9b98-867ac0a77c13 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:34.893450 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5a1d7c4a-2b74-42c0-9b98-867ac0a77c13 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:34.895348 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5a1d7c4a-2b74-42c0-9b98-867ac0a77c13 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:34.927654 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-514b7755-f6a5-49ec-8418-fd4d7361739a tempest-FloatingIPDetailsTestJSON-1685842162 tempest-FloatingIPDetailsTestJSON-1685842162-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/9f6514a6-9fdc-4799-9cf2-9404779000b6" status: 202 len: 0 microversion: 2.1 time: 1.253903 Sep 08 10:42:34.928232 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 686/1332] 10.222.0.27 () {58 vars in 1263 bytes} [Thu Sep 8 10:42:33 2022] DELETE /compute/v2.1/os-floating-ips/9f6514a6-9fdc-4799-9cf2-9404779000b6 => generated 0 bytes in 1255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:42:34.936021 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d661db7a-6b29-42c6-955b-fa993e409bfd tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:34.939052 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d661db7a-6b29-42c6-955b-fa993e409bfd tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:34.949763 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d661db7a-6b29-42c6-955b-fa993e409bfd tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:34.950510 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d661db7a-6b29-42c6-955b-fa993e409bfd tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:34.951146 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d661db7a-6b29-42c6-955b-fa993e409bfd tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:34.951862 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d661db7a-6b29-42c6-955b-fa993e409bfd tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:34.952348 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d661db7a-6b29-42c6-955b-fa993e409bfd tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:34.952983 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d661db7a-6b29-42c6-955b-fa993e409bfd tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:34.970466 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:42:34.991903 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d661db7a-6b29-42c6-955b-fa993e409bfd tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.062263 Sep 08 10:42:34.993146 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 687/1333] 10.222.0.27 () {60 vars in 1343 bytes} [Thu Sep 8 10:42:34 2022] GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:42:35.004592 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-631416b0-aea8-4843-b662-808ae333e7f8 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1131974077", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:42:35.111017 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-631416b0-aea8-4843-b662-808ae333e7f8 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] validate_networks() for None {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:42:35.115525 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5a1d7c4a-2b74-42c0-9b98-867ac0a77c13 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] 10.222.0.27 "GET /compute/v2.1/servers/790bcd42-ace5-4761-b46d-e0889855623f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.282226 Sep 08 10:42:35.116122 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 647/1334] 10.222.0.27 () {58 vars in 1275 bytes} [Thu Sep 8 10:42:34 2022] GET /compute/v2.1/servers/790bcd42-ace5-4761-b46d-e0889855623f/os-interface => generated 284 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:42:35.125487 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-37ff9ea4-58f6-46ca-bb60-d444fd0c3704 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Calling method '.version_select at 0x7f68e44cb430>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:35.140787 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-37ff9ea4-58f6-46ca-bb60-d444fd0c3704 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:35.141318 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-37ff9ea4-58f6-46ca-bb60-d444fd0c3704 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:35.141760 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-37ff9ea4-58f6-46ca-bb60-d444fd0c3704 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:35.167373 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-37ff9ea4-58f6-46ca-bb60-d444fd0c3704 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 3532 microversion: 2.1 time: 0.050179 Sep 08 10:42:35.178920 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 648/1335] 10.222.0.27 () {58 vars in 1143 bytes} [Thu Sep 8 10:42:35 2022] GET /compute/v2.1/os-migrations => generated 3532 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:35.183968 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9f69776c-6dcc-48c1-85fd-9145417467a7 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:35.184827 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9f69776c-6dcc-48c1-85fd-9145417467a7 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] [instance: 26218db4-d06e-4ae2-8f15-f21004ce13b3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:35.193472 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f69776c-6dcc-48c1-85fd-9145417467a7 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:35.194138 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f69776c-6dcc-48c1-85fd-9145417467a7 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:35.194757 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f69776c-6dcc-48c1-85fd-9145417467a7 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:35.195793 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f69776c-6dcc-48c1-85fd-9145417467a7 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:35.196507 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f69776c-6dcc-48c1-85fd-9145417467a7 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:35.197123 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f69776c-6dcc-48c1-85fd-9145417467a7 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:35.212094 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-9f69776c-6dcc-48c1-85fd-9145417467a7 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] HTTP exception thrown: Instance 26218db4-d06e-4ae2-8f15-f21004ce13b3 could not be found. Sep 08 10:42:35.214237 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9f69776c-6dcc-48c1-85fd-9145417467a7 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Request method failure captured: Sep 08 10:42:35.214237 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/26218db4-d06e-4ae2-8f15-f21004ce13b3 HTTP/1.1 Sep 08 10:42:35.214237 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:42:35.214237 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:42:35.214237 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:42:35.214237 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:42:35.214237 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:42:35.214237 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:42:35.214237 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:42:35.214237 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:42:35.214237 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcboE6pT1MSgw8cC-C5wgxb36tEgX15gOSMtkd9_fMsX58RAZjqVqvKmtILru5yKzlttR28YiQdRkGK7CQ5-JcypnH-yBFrngBhc3fFMzv27xdyZrEAJ60D9wPpeYLPSIWWDvl2wWWmKnvETEk4DAU3ktHM-qAxUs5BncISQ3pmH_SA Sep 08 10:42:35.214237 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:42:35.214237 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:42:35.214237 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:42:35.214237 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:42:35.214237 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:42:35.214237 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:42:35.214237 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: c8d59ac71b6f459ea38d5ddc24964216 Sep 08 10:42:35.214237 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-InstanceActionsTestJSON-915087654 Sep 08 10:42:35.214237 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:42:35.214237 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:42:35.214237 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c8d59ac71b6f459ea38d5ddc24964216"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c8d59ac71b6f459ea38d5ddc24964216"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c8d59ac71b6f459ea38d5ddc24964216"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c8d59ac71b6f459ea38d5ddc24964216"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:42:35.214237 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-InstanceActionsTestJSON-915087654 Sep 08 10:42:35.214237 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: c8d59ac71b6f459ea38d5ddc24964216 Sep 08 10:42:35.214237 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-InstanceActionsTestJSON-915087654 Sep 08 10:42:35.214237 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-InstanceActionsTestJSON-915087654-project Sep 08 10:42:35.214237 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:42:35.214237 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:42:35.214237 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 7ae3291d8d8f40dc98be9c965ba86adf Sep 08 10:42:35.214237 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-InstanceActionsTestJSON-915087654-project Sep 08 10:42:35.214237 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:42:35.214237 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 26218db4-d06e-4ae2-8f15-f21004ce13b3 could not be found. Sep 08 10:42:35.214237 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '26218db4-d06e-4ae2-8f15-f21004ce13b3'} Sep 08 10:42:35.214237 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:42:35.214237 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:42:35.214237 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:42:35.214237 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:42:35.214237 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:42:35.214237 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:42:35.214237 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:42:35.214237 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:42:35.214237 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:42:35.214237 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:42:35.214237 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26218db4-d06e-4ae2-8f15-f21004ce13b3 could not be found. Sep 08 10:42:35.214237 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:42:35.214237 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:42:35.214237 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:42:35.214237 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:42:35.214237 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:42:35.214237 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:42:35.214237 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:42:35.214237 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:42:35.214237 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:42:35.214237 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:42:35.214237 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:42:35.214237 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:42:35.214237 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:42:35.214237 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:42:35.214237 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:42:35.214237 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:42:35.214237 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26218db4-d06e-4ae2-8f15-f21004ce13b3 could not be found. Sep 08 10:42:35.214237 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:42:35.214237 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:42:35.214237 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:42:35.219908 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:42:35.219908 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:42:35.219908 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:42:35.219908 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:42:35.219908 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:42:35.219908 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26218db4-d06e-4ae2-8f15-f21004ce13b3 could not be found. Sep 08 10:42:35.219908 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:42:35.221377 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9f69776c-6dcc-48c1-85fd-9145417467a7 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] Returning 404 to user: Instance 26218db4-d06e-4ae2-8f15-f21004ce13b3 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:42:35.222834 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9f69776c-6dcc-48c1-85fd-9145417467a7 tempest-InstanceActionsTestJSON-915087654 tempest-InstanceActionsTestJSON-915087654-project] 10.222.0.27 "GET /compute/v2.1/servers/26218db4-d06e-4ae2-8f15-f21004ce13b3" status: 404 len: 111 microversion: 2.1 time: 0.042693 Sep 08 10:42:35.232547 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 649/1336] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:35 2022] GET /compute/v2.1/servers/26218db4-d06e-4ae2-8f15-f21004ce13b3 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:42:35.240795 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c2473c1d-a410-4c74-a762-24aba780cb40 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:35.241715 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c2473c1d-a410-4c74-a762-24aba780cb40 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] [instance: 133a5f12-39e5-4e0f-81dc-b1948c073f15] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:35.256503 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c2473c1d-a410-4c74-a762-24aba780cb40 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:35.257232 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c2473c1d-a410-4c74-a762-24aba780cb40 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:35.257865 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c2473c1d-a410-4c74-a762-24aba780cb40 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:35.258832 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c2473c1d-a410-4c74-a762-24aba780cb40 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:35.259450 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c2473c1d-a410-4c74-a762-24aba780cb40 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:35.260116 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c2473c1d-a410-4c74-a762-24aba780cb40 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:35.783534 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c2473c1d-a410-4c74-a762-24aba780cb40 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15" status: 200 len: 1861 microversion: 2.1 time: 0.546938 Sep 08 10:42:35.788381 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 650/1337] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:35 2022] GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15 => generated 1861 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:35.824129 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2502edc7-42cf-4b0b-975d-75810591a8b6 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:35.825015 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2502edc7-42cf-4b0b-975d-75810591a8b6 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] [instance: 133a5f12-39e5-4e0f-81dc-b1948c073f15] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:35.841464 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2502edc7-42cf-4b0b-975d-75810591a8b6 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:35.842338 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2502edc7-42cf-4b0b-975d-75810591a8b6 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:35.842952 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2502edc7-42cf-4b0b-975d-75810591a8b6 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:35.844802 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2502edc7-42cf-4b0b-975d-75810591a8b6 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:35.845521 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2502edc7-42cf-4b0b-975d-75810591a8b6 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:35.846159 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2502edc7-42cf-4b0b-975d-75810591a8b6 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:36.233144 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2502edc7-42cf-4b0b-975d-75810591a8b6 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15" status: 200 len: 1861 microversion: 2.1 time: 0.412673 Sep 08 10:42:36.235639 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 651/1338] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:35 2022] GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15 => generated 1861 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:36.241225 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bf1d72fa-dd36-4348-a14e-7872b9947d4f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:36.243939 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bf1d72fa-dd36-4348-a14e-7872b9947d4f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:36.258340 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf1d72fa-dd36-4348-a14e-7872b9947d4f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:36.259303 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf1d72fa-dd36-4348-a14e-7872b9947d4f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:36.259419 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf1d72fa-dd36-4348-a14e-7872b9947d4f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:36.260337 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf1d72fa-dd36-4348-a14e-7872b9947d4f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:36.261285 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf1d72fa-dd36-4348-a14e-7872b9947d4f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:36.261782 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf1d72fa-dd36-4348-a14e-7872b9947d4f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:36.301615 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bf1d72fa-dd36-4348-a14e-7872b9947d4f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.064206 Sep 08 10:42:36.302559 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 652/1339] 10.222.0.27 () {60 vars in 1343 bytes} [Thu Sep 8 10:42:36 2022] GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:42:36.527056 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bfec777a-cd4d-4521-a16b-b16acbe89226 tempest-TenantUsagesNegativeTestJSON-10243495 tempest-TenantUsagesNegativeTestJSON-10243495-project-admin] 10.222.0.27 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-09-07T10%3A42%3A36.084368&end=2022-09-09T10%3A42%3A36.084368" status: 404 len: 112 microversion: - time: 0.222703 Sep 08 10:42:36.527916 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 653/1340] 10.222.0.27 () {58 vars in 1316 bytes} [Thu Sep 8 10:42:36 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-09-07T10%3A42%3A36.084368&end=2022-09-09T10%3A42%3A36.084368 => generated 112 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 08 10:42:36.541244 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-09ff223f-0ea6-4b62-81f2-3af5e1621392 tempest-TenantUsagesNegativeTestJSON-10243495 tempest-TenantUsagesNegativeTestJSON-10243495-project-admin] Calling method '.version_select at 0x7f68e458a8b0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:36.551993 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-09ff223f-0ea6-4b62-81f2-3af5e1621392 tempest-TenantUsagesNegativeTestJSON-10243495 tempest-TenantUsagesNegativeTestJSON-10243495-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Sep 08 10:42:36.555214 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-09ff223f-0ea6-4b62-81f2-3af5e1621392 tempest-TenantUsagesNegativeTestJSON-10243495 tempest-TenantUsagesNegativeTestJSON-10243495-project-admin] Request method failure captured: Sep 08 10:42:36.555214 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/os-simple-tenant-usage/c471acee7ef54398b48a6371b3f3269b?start=2022-09-09T10%3A42%3A36.084368&end=2022-09-07T10%3A42%3A36.084368 HTTP/1.1 Sep 08 10:42:36.555214 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:42:36.555214 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:42:36.555214 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:42:36.555214 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:42:36.555214 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:42:36.555214 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:42:36.555214 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:42:36.555214 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:42:36.555214 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGccbkNWrWKd0x5CeC82ehYxaeX0g4P2010CeQb4rebQaK8eHDpeaAi4lD0IKCogb4w_7gSFuTUzRh6CEyeBXYMy4ZauVCv-8BfZAasoEae_jugVjEju-CY1Cg6TyHmuw_AotIZ_l5wShpLjqwZBFAdPrMp7aOWUidtZkaaHef8l59YQ Sep 08 10:42:36.555214 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:42:36.555214 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:42:36.555214 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:42:36.555214 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:42:36.555214 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:42:36.555214 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:42:36.555214 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 36697c773bee4486809586a497095aed Sep 08 10:42:36.555214 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-10243495 Sep 08 10:42:36.555214 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,admin,member Sep 08 10:42:36.555214 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,admin,member Sep 08 10:42:36.555214 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/36697c773bee4486809586a497095aed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/36697c773bee4486809586a497095aed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_36697c773bee4486809586a497095aed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/36697c773bee4486809586a497095aed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:42:36.555214 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-10243495 Sep 08 10:42:36.555214 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 36697c773bee4486809586a497095aed Sep 08 10:42:36.555214 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-10243495 Sep 08 10:42:36.555214 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-TenantUsagesNegativeTestJSON-10243495-project-admin Sep 08 10:42:36.555214 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:42:36.555214 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:42:36.555214 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: afde089e019e41c18594adddd6306688 Sep 08 10:42:36.555214 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-10243495-project-admin Sep 08 10:42:36.555214 n-d-850501-12 devstack@n-api.service[128861]: method: Sep 08 10:42:36.555214 n-d-850501-12 devstack@n-api.service[128861]: exception: Invalid start time. The start time cannot occur after the end time. Sep 08 10:42:36.555214 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': 'c471acee7ef54398b48a6371b3f3269b'} Sep 08 10:42:36.555214 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:42:36.555214 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:42:36.555214 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:42:36.555214 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:42:36.555214 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:42:36.555214 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:42:36.555214 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:42:36.555214 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:42:36.555214 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 08 10:42:36.555214 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:42:36.555214 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:42:36.555214 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:42:36.555214 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Sep 08 10:42:36.555214 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self._show(req, id) Sep 08 10:42:36.555214 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Sep 08 10:42:36.555214 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Sep 08 10:42:36.555214 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Sep 08 10:42:36.555214 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 08 10:42:36.555214 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Sep 08 10:42:36.555214 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:42:36.555214 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:42:36.555214 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:42:36.555214 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:42:36.555214 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:42:36.555214 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:42:36.555214 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:42:36.555214 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:42:36.555214 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Sep 08 10:42:36.555214 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:42:36.561667 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-09ff223f-0ea6-4b62-81f2-3af5e1621392 tempest-TenantUsagesNegativeTestJSON-10243495 tempest-TenantUsagesNegativeTestJSON-10243495-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:42:36.563659 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-09ff223f-0ea6-4b62-81f2-3af5e1621392 tempest-TenantUsagesNegativeTestJSON-10243495 tempest-TenantUsagesNegativeTestJSON-10243495-project-admin] 10.222.0.27 "GET /compute/v2.1/os-simple-tenant-usage/c471acee7ef54398b48a6371b3f3269b?start=2022-09-09T10%3A42%3A36.084368&end=2022-09-07T10%3A42%3A36.084368" status: 400 len: 111 microversion: 2.1 time: 0.027489 Sep 08 10:42:36.571010 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 654/1341] 10.222.0.27 () {58 vars in 1412 bytes} [Thu Sep 8 10:42:36 2022] GET /compute/v2.1/os-simple-tenant-usage/c471acee7ef54398b48a6371b3f3269b?start=2022-09-09T10%3A42%3A36.084368&end=2022-09-07T10%3A42%3A36.084368 => generated 111 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:42:36.719033 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7254b687-6b84-4371-b88a-687f031054c5 tempest-TenantUsagesNegativeTestJSON-428833449 tempest-TenantUsagesNegativeTestJSON-428833449-project] Calling method '.version_select at 0x7f68e4460af0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:36.724989 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7254b687-6b84-4371-b88a-687f031054c5 tempest-TenantUsagesNegativeTestJSON-428833449 tempest-TenantUsagesNegativeTestJSON-428833449-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': 'd27388ad49d643af95b853f83ec0c3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c471acee7ef54398b48a6371b3f3269b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:36.726894 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7254b687-6b84-4371-b88a-687f031054c5 tempest-TenantUsagesNegativeTestJSON-428833449 tempest-TenantUsagesNegativeTestJSON-428833449-project] Request method failure captured: Sep 08 10:42:36.726894 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-07T10%3A42%3A36.084368&end=2022-09-09T10%3A42%3A36.084368&detailed=1 HTTP/1.1 Sep 08 10:42:36.726894 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:42:36.726894 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:42:36.726894 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:42:36.726894 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:42:36.726894 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:42:36.726894 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:42:36.726894 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:42:36.726894 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:42:36.726894 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcca7jkasSjEeh9TakIEgYZqi-W4YfYYF0zlzcUniWZr0viGAkWuwTQjIaGdsfvT3EBW2Sk0HHBYuuaiFpKCmnFOSGeoWacbcm9JJhVnWJScTaRLTTLMrk3Ekd1QZ9ng1B-RbFTgS8ngtEWWl4W7-y9Vh-dVw_MwGsAwTX0vvDxTP8c Sep 08 10:42:36.726894 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:42:36.726894 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:42:36.726894 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:42:36.726894 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:42:36.726894 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:42:36.726894 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:42:36.726894 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: c471acee7ef54398b48a6371b3f3269b Sep 08 10:42:36.726894 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-428833449 Sep 08 10:42:36.726894 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:42:36.726894 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:42:36.726894 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c471acee7ef54398b48a6371b3f3269b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c471acee7ef54398b48a6371b3f3269b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c471acee7ef54398b48a6371b3f3269b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c471acee7ef54398b48a6371b3f3269b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:42:36.726894 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-428833449 Sep 08 10:42:36.726894 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: c471acee7ef54398b48a6371b3f3269b Sep 08 10:42:36.726894 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-428833449 Sep 08 10:42:36.726894 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-TenantUsagesNegativeTestJSON-428833449-project Sep 08 10:42:36.726894 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:42:36.726894 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:42:36.726894 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: d27388ad49d643af95b853f83ec0c3f5 Sep 08 10:42:36.726894 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-428833449-project Sep 08 10:42:36.726894 n-d-850501-12 devstack@n-api.service[128861]: method: Sep 08 10:42:36.726894 n-d-850501-12 devstack@n-api.service[128861]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Sep 08 10:42:36.726894 n-d-850501-12 devstack@n-api.service[128861]: action_args: {} Sep 08 10:42:36.726894 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:42:36.726894 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:42:36.726894 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:42:36.726894 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:42:36.726894 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:42:36.726894 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:42:36.726894 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:42:36.726894 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:42:36.726894 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 08 10:42:36.726894 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:42:36.726894 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:42:36.726894 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:42:36.726894 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Sep 08 10:42:36.726894 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self._index(req) Sep 08 10:42:36.726894 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Sep 08 10:42:36.726894 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Sep 08 10:42:36.726894 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 10:42:36.726894 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 10:42:36.726894 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 10:42:36.726894 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 10:42:36.726894 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:42:36.726894 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:42:36.726894 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:42:36.726894 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:42:36.726894 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 10:42:36.726894 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 10:42:36.726894 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 10:42:36.726894 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 10:42:36.726894 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 10:42:36.726894 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 10:42:36.732890 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Sep 08 10:42:36.732890 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:42:36.732890 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:42:36.732890 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:42:36.732890 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:42:36.732890 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:42:36.732890 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:42:36.732890 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 10:42:36.732890 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 10:42:36.732890 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Sep 08 10:42:36.732890 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:42:36.735821 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7254b687-6b84-4371-b88a-687f031054c5 tempest-TenantUsagesNegativeTestJSON-428833449 tempest-TenantUsagesNegativeTestJSON-428833449-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:42:36.737358 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7254b687-6b84-4371-b88a-687f031054c5 tempest-TenantUsagesNegativeTestJSON-428833449 tempest-TenantUsagesNegativeTestJSON-428833449-project] 10.222.0.27 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-07T10%3A42%3A36.084368&end=2022-09-09T10%3A42%3A36.084368&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.164589 Sep 08 10:42:36.739514 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 655/1342] 10.222.0.27 () {58 vars in 1335 bytes} [Thu Sep 8 10:42:36 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-07T10%3A42%3A36.084368&end=2022-09-09T10%3A42%3A36.084368&detailed=1 => generated 123 bytes in 168 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 08 10:42:36.755253 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-631416b0-aea8-4843-b662-808ae333e7f8 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:42:36.755898 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-631416b0-aea8-4843-b662-808ae333e7f8 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:42:36.756142 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-631416b0-aea8-4843-b662-808ae333e7f8 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:42:36.756733 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-631416b0-aea8-4843-b662-808ae333e7f8 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:42:36.757348 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-631416b0-aea8-4843-b662-808ae333e7f8 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:42:36.763123 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=72 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:42:36.779856 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-631416b0-aea8-4843-b662-808ae333e7f8 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:36.780807 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-631416b0-aea8-4843-b662-808ae333e7f8 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:36.781462 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-631416b0-aea8-4843-b662-808ae333e7f8 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:36.792046 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-631416b0-aea8-4843-b662-808ae333e7f8 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:36.793328 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-631416b0-aea8-4843-b662-808ae333e7f8 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:36.794084 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-631416b0-aea8-4843-b662-808ae333e7f8 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:36.836525 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-631416b0-aea8-4843-b662-808ae333e7f8 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Getting quotas for project a52c0b4a043445df94dab4dd4292607a. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:42:36.851405 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-631416b0-aea8-4843-b662-808ae333e7f8 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Getting quotas for user 5450284cb50b4f75be0915074bf8fe78 and project a52c0b4a043445df94dab4dd4292607a. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:42:36.878459 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-631416b0-aea8-4843-b662-808ae333e7f8 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:42:36.884088 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-631416b0-aea8-4843-b662-808ae333e7f8 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 287be913-2461-45d0-8000-360c3fdb5940] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:42:36.992924 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-631416b0-aea8-4843-b662-808ae333e7f8 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.998433 Sep 08 10:42:36.994227 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 688/1343] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:42:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 2000 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:42:37.007544 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c3b59c11-fa5a-4b5b-aebb-9108a839e3f6 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:37.008939 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c3b59c11-fa5a-4b5b-aebb-9108a839e3f6 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 287be913-2461-45d0-8000-360c3fdb5940] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:37.167894 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c3b59c11-fa5a-4b5b-aebb-9108a839e3f6 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:37.180847 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c3b59c11-fa5a-4b5b-aebb-9108a839e3f6 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940" status: 200 len: 1213 microversion: 2.1 time: 0.178785 Sep 08 10:42:37.181452 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 656/1344] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:37 2022] GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940 => generated 1213 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:37.316341 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c72f957a-73ce-4b35-9839-bb72f5659cd3 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:37.319166 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c72f957a-73ce-4b35-9839-bb72f5659cd3 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:37.334749 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c72f957a-73ce-4b35-9839-bb72f5659cd3 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:37.345862 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c72f957a-73ce-4b35-9839-bb72f5659cd3 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:37.352928 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c72f957a-73ce-4b35-9839-bb72f5659cd3 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:37.356135 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c72f957a-73ce-4b35-9839-bb72f5659cd3 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:37.362767 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c72f957a-73ce-4b35-9839-bb72f5659cd3 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:37.364336 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c72f957a-73ce-4b35-9839-bb72f5659cd3 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:37.485015 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c72f957a-73ce-4b35-9839-bb72f5659cd3 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.170768 Sep 08 10:42:37.490823 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 689/1345] 10.222.0.27 () {60 vars in 1343 bytes} [Thu Sep 8 10:42:37 2022] GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e/os-volume_attachments => generated 197 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:42:38.204531 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-012cd50e-b990-417d-a453-80288b91c3aa tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:38.205808 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-012cd50e-b990-417d-a453-80288b91c3aa tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 287be913-2461-45d0-8000-360c3fdb5940] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:38.224067 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-012cd50e-b990-417d-a453-80288b91c3aa tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:38.224825 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-012cd50e-b990-417d-a453-80288b91c3aa tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:38.225276 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-012cd50e-b990-417d-a453-80288b91c3aa tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:38.226154 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-012cd50e-b990-417d-a453-80288b91c3aa tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:38.226773 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-012cd50e-b990-417d-a453-80288b91c3aa tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:38.227613 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-012cd50e-b990-417d-a453-80288b91c3aa tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:38.499003 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cfcdbbf5-4680-4a90-b863-bc981d9968d5 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:38.501772 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cfcdbbf5-4680-4a90-b863-bc981d9968d5 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:38.522544 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cfcdbbf5-4680-4a90-b863-bc981d9968d5 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:38.522924 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cfcdbbf5-4680-4a90-b863-bc981d9968d5 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:38.523362 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cfcdbbf5-4680-4a90-b863-bc981d9968d5 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:38.524090 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cfcdbbf5-4680-4a90-b863-bc981d9968d5 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:38.524680 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cfcdbbf5-4680-4a90-b863-bc981d9968d5 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:38.525135 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cfcdbbf5-4680-4a90-b863-bc981d9968d5 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:38.601496 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cfcdbbf5-4680-4a90-b863-bc981d9968d5 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.106985 Sep 08 10:42:38.615436 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 690/1346] 10.222.0.27 () {60 vars in 1343 bytes} [Thu Sep 8 10:42:38 2022] GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 10:42:38.620907 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-5176120c-d797-4ed0-9768-2625d05250eb req-3d2b2632-e290-4cee-b51e-5e16e832cedd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "790bcd42-ace5-4761-b46d-e0889855623f", "tag": "6e25a2af-b9a9-477e-a24c-f79b73a6fdc9"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:42:38.665119 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-5176120c-d797-4ed0-9768-2625d05250eb req-3d2b2632-e290-4cee-b51e-5e16e832cedd service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:38.665608 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-5176120c-d797-4ed0-9768-2625d05250eb req-3d2b2632-e290-4cee-b51e-5e16e832cedd service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:38.666039 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-5176120c-d797-4ed0-9768-2625d05250eb req-3d2b2632-e290-4cee-b51e-5e16e832cedd service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:38.688105 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-5176120c-d797-4ed0-9768-2625d05250eb req-3d2b2632-e290-4cee-b51e-5e16e832cedd service nova] Creating event network-changed:6e25a2af-b9a9-477e-a24c-f79b73a6fdc9 for instance 790bcd42-ace5-4761-b46d-e0889855623f on n-h2-850501-12 Sep 08 10:42:38.701206 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-5176120c-d797-4ed0-9768-2625d05250eb req-3d2b2632-e290-4cee-b51e-5e16e832cedd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082741 Sep 08 10:42:38.707351 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 691/1347] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:42:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:42:38.723683 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-012cd50e-b990-417d-a453-80288b91c3aa tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:38.740298 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-012cd50e-b990-417d-a453-80288b91c3aa tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940" status: 200 len: 1265 microversion: 2.1 time: 0.540170 Sep 08 10:42:38.741180 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 657/1348] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:38 2022] GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940 => generated 1265 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:39.619469 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b8d85244-aad9-4fdf-b476-20691944384b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:39.623438 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b8d85244-aad9-4fdf-b476-20691944384b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:39.656451 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8d85244-aad9-4fdf-b476-20691944384b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:39.661532 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8d85244-aad9-4fdf-b476-20691944384b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:39.667329 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8d85244-aad9-4fdf-b476-20691944384b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:39.668452 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8d85244-aad9-4fdf-b476-20691944384b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:39.669296 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8d85244-aad9-4fdf-b476-20691944384b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:39.676426 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8d85244-aad9-4fdf-b476-20691944384b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:39.769629 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e74f3ea6-d0ff-4e33-8c9d-fe73e9a5cc72 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:39.770622 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b8d85244-aad9-4fdf-b476-20691944384b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.155862 Sep 08 10:42:39.771045 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e74f3ea6-d0ff-4e33-8c9d-fe73e9a5cc72 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 287be913-2461-45d0-8000-360c3fdb5940] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:39.772171 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 692/1349] 10.222.0.27 () {60 vars in 1343 bytes} [Thu Sep 8 10:42:39 2022] GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e/os-volume_attachments => generated 197 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:42:39.787538 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=8 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:42:39.799021 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e74f3ea6-d0ff-4e33-8c9d-fe73e9a5cc72 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:39.799684 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e74f3ea6-d0ff-4e33-8c9d-fe73e9a5cc72 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:39.800615 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e74f3ea6-d0ff-4e33-8c9d-fe73e9a5cc72 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:39.805591 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e74f3ea6-d0ff-4e33-8c9d-fe73e9a5cc72 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:39.806425 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e74f3ea6-d0ff-4e33-8c9d-fe73e9a5cc72 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:39.806897 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e74f3ea6-d0ff-4e33-8c9d-fe73e9a5cc72 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:40.005004 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e74f3ea6-d0ff-4e33-8c9d-fe73e9a5cc72 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:40.023472 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e74f3ea6-d0ff-4e33-8c9d-fe73e9a5cc72 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940" status: 200 len: 1271 microversion: 2.1 time: 0.259216 Sep 08 10:42:40.028562 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 658/1350] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:39 2022] GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940 => generated 1271 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:42:40.548978 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6f94ae29-8d6e-4ac7-b943-1b4574ec58bf tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:40.549816 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6f94ae29-8d6e-4ac7-b943-1b4574ec58bf tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 133a5f12-39e5-4e0f-81dc-b1948c073f15] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:40.557225 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f94ae29-8d6e-4ac7-b943-1b4574ec58bf tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:40.557889 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f94ae29-8d6e-4ac7-b943-1b4574ec58bf tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:40.558548 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f94ae29-8d6e-4ac7-b943-1b4574ec58bf tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:40.559431 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f94ae29-8d6e-4ac7-b943-1b4574ec58bf tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:40.560050 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f94ae29-8d6e-4ac7-b943-1b4574ec58bf tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:40.560680 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f94ae29-8d6e-4ac7-b943-1b4574ec58bf tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:40.566256 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:42:40.780274 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-6f94ae29-8d6e-4ac7-b943-1b4574ec58bf tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lazy-loading 'services' on Instance uuid 133a5f12-39e5-4e0f-81dc-b1948c073f15 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:42:40.788694 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b4d94ab5-393b-4cb7-862d-f85ce4ff3491 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:40.791806 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b4d94ab5-393b-4cb7-862d-f85ce4ff3491 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:40.812430 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b4d94ab5-393b-4cb7-862d-f85ce4ff3491 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:40.812926 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b4d94ab5-393b-4cb7-862d-f85ce4ff3491 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:40.813390 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b4d94ab5-393b-4cb7-862d-f85ce4ff3491 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:40.814335 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b4d94ab5-393b-4cb7-862d-f85ce4ff3491 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:40.815013 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b4d94ab5-393b-4cb7-862d-f85ce4ff3491 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:40.815472 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b4d94ab5-393b-4cb7-862d-f85ce4ff3491 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:40.876871 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6f94ae29-8d6e-4ac7-b943-1b4574ec58bf tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "DELETE /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15/os-volume_attachments/f49ef527-a901-4aa1-b79f-94d518c3d221" status: 202 len: 0 microversion: 2.1 time: 0.333873 Sep 08 10:42:40.879337 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 693/1351] 10.222.0.27 () {58 vars in 1416 bytes} [Thu Sep 8 10:42:40 2022] DELETE /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15/os-volume_attachments/f49ef527-a901-4aa1-b79f-94d518c3d221 => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:42:40.917254 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5bdab17d-8b5a-489d-9214-fd9997938db9 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:40.931257 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5bdab17d-8b5a-489d-9214-fd9997938db9 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 133a5f12-39e5-4e0f-81dc-b1948c073f15] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:40.936103 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b4d94ab5-393b-4cb7-862d-f85ce4ff3491 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.152145 Sep 08 10:42:40.939036 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 659/1352] 10.222.0.27 () {60 vars in 1343 bytes} [Thu Sep 8 10:42:40 2022] GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e/os-volume_attachments => generated 25 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:40.944042 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5bdab17d-8b5a-489d-9214-fd9997938db9 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:40.956843 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5bdab17d-8b5a-489d-9214-fd9997938db9 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:40.958641 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5bdab17d-8b5a-489d-9214-fd9997938db9 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:40.959952 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5bdab17d-8b5a-489d-9214-fd9997938db9 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:40.960585 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5bdab17d-8b5a-489d-9214-fd9997938db9 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:40.961257 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5bdab17d-8b5a-489d-9214-fd9997938db9 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:41.042022 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5bdab17d-8b5a-489d-9214-fd9997938db9 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.142771 Sep 08 10:42:41.048066 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 694/1353] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 10:42:40 2022] GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15/os-volume_attachments => generated 197 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:42:41.058591 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-728001bc-4808-490c-b3f6-db8ad20b3992 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:41.059459 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-728001bc-4808-490c-b3f6-db8ad20b3992 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 287be913-2461-45d0-8000-360c3fdb5940] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:41.076002 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-728001bc-4808-490c-b3f6-db8ad20b3992 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:41.076788 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-728001bc-4808-490c-b3f6-db8ad20b3992 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:41.079164 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-728001bc-4808-490c-b3f6-db8ad20b3992 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:41.081547 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-728001bc-4808-490c-b3f6-db8ad20b3992 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:41.085627 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-728001bc-4808-490c-b3f6-db8ad20b3992 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:41.086280 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-728001bc-4808-490c-b3f6-db8ad20b3992 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:41.281488 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-728001bc-4808-490c-b3f6-db8ad20b3992 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:41.294958 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-728001bc-4808-490c-b3f6-db8ad20b3992 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940" status: 200 len: 1271 microversion: 2.1 time: 0.240829 Sep 08 10:42:41.306926 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 660/1354] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:41 2022] GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940 => generated 1271 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:42.056537 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-34e859e1-117b-460b-ac15-7ebf1c304fce tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:42.058726 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-34e859e1-117b-460b-ac15-7ebf1c304fce tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 133a5f12-39e5-4e0f-81dc-b1948c073f15] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:42.074966 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-34e859e1-117b-460b-ac15-7ebf1c304fce tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:42.076968 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-34e859e1-117b-460b-ac15-7ebf1c304fce tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:42.078132 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-34e859e1-117b-460b-ac15-7ebf1c304fce tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:42.082956 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-34e859e1-117b-460b-ac15-7ebf1c304fce tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:42.083706 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-34e859e1-117b-460b-ac15-7ebf1c304fce tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:42.084312 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-34e859e1-117b-460b-ac15-7ebf1c304fce tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:42.158445 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-34e859e1-117b-460b-ac15-7ebf1c304fce tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106894 Sep 08 10:42:42.163804 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 695/1355] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 10:42:42 2022] GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:42:42.336928 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-86ed3b46-7dd5-4dfa-accf-f3542beed998 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:42.338298 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-86ed3b46-7dd5-4dfa-accf-f3542beed998 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 287be913-2461-45d0-8000-360c3fdb5940] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:42.356864 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-86ed3b46-7dd5-4dfa-accf-f3542beed998 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:42.360013 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-86ed3b46-7dd5-4dfa-accf-f3542beed998 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:42.362087 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-86ed3b46-7dd5-4dfa-accf-f3542beed998 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:42.364428 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-86ed3b46-7dd5-4dfa-accf-f3542beed998 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:42.365516 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-86ed3b46-7dd5-4dfa-accf-f3542beed998 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:42.368855 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-86ed3b46-7dd5-4dfa-accf-f3542beed998 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:43.158629 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-86ed3b46-7dd5-4dfa-accf-f3542beed998 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:43.171225 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-61191a83-2a3f-4a15-a62a-d269bed44349 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:43.172721 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-86ed3b46-7dd5-4dfa-accf-f3542beed998 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940" status: 200 len: 1313 microversion: 2.1 time: 0.840639 Sep 08 10:42:43.173350 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 661/1356] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:42 2022] GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940 => generated 1313 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:43.173831 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-61191a83-2a3f-4a15-a62a-d269bed44349 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 133a5f12-39e5-4e0f-81dc-b1948c073f15] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:43.196912 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-61191a83-2a3f-4a15-a62a-d269bed44349 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:43.198155 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-61191a83-2a3f-4a15-a62a-d269bed44349 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:43.198823 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-61191a83-2a3f-4a15-a62a-d269bed44349 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:43.200618 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-61191a83-2a3f-4a15-a62a-d269bed44349 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:43.203153 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-61191a83-2a3f-4a15-a62a-d269bed44349 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:43.203717 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-61191a83-2a3f-4a15-a62a-d269bed44349 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:43.341545 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-61191a83-2a3f-4a15-a62a-d269bed44349 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.167663 Sep 08 10:42:43.344991 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 696/1357] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 10:42:43 2022] GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15/os-volume_attachments => generated 197 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:42:43.821555 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0132efab-195e-4b22-ac43-b54be4f1e32d tempest-FlavorsV2NegativeTest-1913981719 tempest-FlavorsV2NegativeTest-1913981719-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:43.830355 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0132efab-195e-4b22-ac43-b54be4f1e32d tempest-FlavorsV2NegativeTest-1913981719 tempest-FlavorsV2NegativeTest-1913981719-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.274551 Sep 08 10:42:43.831313 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 662/1358] 10.222.0.27 () {58 vars in 1137 bytes} [Thu Sep 8 10:42:43 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:42:44.196478 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0b2e2391-5ca8-4598-a9cb-a3f5a2d7dfa2 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:44.197254 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0b2e2391-5ca8-4598-a9cb-a3f5a2d7dfa2 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 287be913-2461-45d0-8000-360c3fdb5940] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:44.211302 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0b2e2391-5ca8-4598-a9cb-a3f5a2d7dfa2 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:44.218282 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0b2e2391-5ca8-4598-a9cb-a3f5a2d7dfa2 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:44.219332 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0b2e2391-5ca8-4598-a9cb-a3f5a2d7dfa2 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:44.220294 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0b2e2391-5ca8-4598-a9cb-a3f5a2d7dfa2 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:44.220951 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0b2e2391-5ca8-4598-a9cb-a3f5a2d7dfa2 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:44.221589 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0b2e2391-5ca8-4598-a9cb-a3f5a2d7dfa2 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:44.354775 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-10ae3928-1c11-4e80-ac3c-a0d2bf32ca12 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:44.358600 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-10ae3928-1c11-4e80-ac3c-a0d2bf32ca12 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 133a5f12-39e5-4e0f-81dc-b1948c073f15] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:44.417527 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-10ae3928-1c11-4e80-ac3c-a0d2bf32ca12 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:44.419542 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-10ae3928-1c11-4e80-ac3c-a0d2bf32ca12 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:44.424029 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-10ae3928-1c11-4e80-ac3c-a0d2bf32ca12 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:44.425957 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-10ae3928-1c11-4e80-ac3c-a0d2bf32ca12 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:44.428219 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-10ae3928-1c11-4e80-ac3c-a0d2bf32ca12 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:44.429080 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-10ae3928-1c11-4e80-ac3c-a0d2bf32ca12 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:44.535336 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-10ae3928-1c11-4e80-ac3c-a0d2bf32ca12 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.181659 Sep 08 10:42:44.540392 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 663/1359] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 10:42:44 2022] GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15/os-volume_attachments => generated 197 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:42:45.003518 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-90cd4083-401d-464b-84e4-779617d2c20d tempest-FlavorsV2NegativeTest-1913981719 tempest-FlavorsV2NegativeTest-1913981719-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1458933604", "imageRef": "10d8478c-96ad-4188-be3a-3753e5878931", "flavorRef": "452"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:42:45.141817 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-90cd4083-401d-464b-84e4-779617d2c20d tempest-FlavorsV2NegativeTest-1913981719 tempest-FlavorsV2NegativeTest-1913981719-project] validate_networks() for None {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:42:45.298883 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0b2e2391-5ca8-4598-a9cb-a3f5a2d7dfa2 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:45.310266 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0b2e2391-5ca8-4598-a9cb-a3f5a2d7dfa2 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940" status: 200 len: 1313 microversion: 2.1 time: 1.115866 Sep 08 10:42:45.311173 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 697/1360] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:44 2022] GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940 => generated 1313 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:45.549627 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-674dbcbc-20c1-4328-8d8d-654b2c22f5d1 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:45.552171 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-674dbcbc-20c1-4328-8d8d-654b2c22f5d1 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 133a5f12-39e5-4e0f-81dc-b1948c073f15] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:45.563580 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-674dbcbc-20c1-4328-8d8d-654b2c22f5d1 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:45.564048 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-674dbcbc-20c1-4328-8d8d-654b2c22f5d1 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:45.564490 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-674dbcbc-20c1-4328-8d8d-654b2c22f5d1 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:45.565284 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-674dbcbc-20c1-4328-8d8d-654b2c22f5d1 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:45.565759 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-674dbcbc-20c1-4328-8d8d-654b2c22f5d1 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:45.566214 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-674dbcbc-20c1-4328-8d8d-654b2c22f5d1 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:45.649988 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-674dbcbc-20c1-4328-8d8d-654b2c22f5d1 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105253 Sep 08 10:42:45.650578 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 698/1361] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 10:42:45 2022] GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:42:45.726381 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-90cd4083-401d-464b-84e4-779617d2c20d tempest-FlavorsV2NegativeTest-1913981719 tempest-FlavorsV2NegativeTest-1913981719-project] HTTP exception thrown: Flavor's memory is too small for requested image. Sep 08 10:42:45.730316 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-90cd4083-401d-464b-84e4-779617d2c20d tempest-FlavorsV2NegativeTest-1913981719 tempest-FlavorsV2NegativeTest-1913981719-project] Request method failure captured: Sep 08 10:42:45.730316 n-d-850501-12 devstack@n-api.service[128861]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 10:42:45.730316 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:42:45.730316 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:42:45.730316 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:42:45.730316 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 143 Sep 08 10:42:45.730316 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:42:45.730316 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:42:45.730316 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:42:45.730316 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:42:45.730316 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGccjW0hQNNnsYiewpxMrOAFWPV3BqUPq3Ile8RHh6kLNw_fngMPpkrxv-koNT17U6YF-JAieLOz0RebBbwP9iGQ2GpqVWoyfYpUfleBOEH8qTl0-5_aCQ6-Pecs_DAsI_dhIq4tgwDfKWCZzTLgquvENmXK8QmHYR0gk3OGpK4e3Bq0 Sep 08 10:42:45.730316 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:42:45.730316 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:42:45.730316 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:42:45.730316 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:42:45.730316 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:42:45.730316 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:42:45.730316 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 4ef2a7ae9d424e7bb45b3458fc17b5b8 Sep 08 10:42:45.730316 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-FlavorsV2NegativeTest-1913981719 Sep 08 10:42:45.730316 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:42:45.730316 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:42:45.730316 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4ef2a7ae9d424e7bb45b3458fc17b5b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4ef2a7ae9d424e7bb45b3458fc17b5b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4ef2a7ae9d424e7bb45b3458fc17b5b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4ef2a7ae9d424e7bb45b3458fc17b5b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:42:45.730316 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-FlavorsV2NegativeTest-1913981719 Sep 08 10:42:45.730316 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 4ef2a7ae9d424e7bb45b3458fc17b5b8 Sep 08 10:42:45.730316 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1913981719 Sep 08 10:42:45.730316 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-FlavorsV2NegativeTest-1913981719-project Sep 08 10:42:45.730316 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:42:45.730316 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:42:45.730316 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 119cbd0e2aff49358ae9b98e20edc51b Sep 08 10:42:45.730316 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-FlavorsV2NegativeTest-1913981719-project Sep 08 10:42:45.730316 n-d-850501-12 devstack@n-api.service[128861]: Sep 08 10:42:45.730316 n-d-850501-12 devstack@n-api.service[128861]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1458933604", "imageRef": "10d8478c-96ad-4188-be3a-3753e5878931", "flavorRef": "452"}} Sep 08 10:42:45.730316 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:42:45.730316 n-d-850501-12 devstack@n-api.service[128861]: exception: Flavor's memory is too small for requested image. Sep 08 10:42:45.730316 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-1458933604', 'imageRef': '10d8478c-96ad-4188-be3a-3753e5878931', 'flavorRef': '452'}}} Sep 08 10:42:45.730316 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:42:45.730316 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:42:45.730316 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 08 10:42:45.730316 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 08 10:42:45.730316 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 08 10:42:45.730316 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 08 10:42:45.730316 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Sep 08 10:42:45.730316 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Sep 08 10:42:45.730316 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Sep 08 10:42:45.730316 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Sep 08 10:42:45.730316 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Sep 08 10:42:45.730316 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Sep 08 10:42:45.730316 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Sep 08 10:42:45.730316 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Sep 08 10:42:45.730316 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Sep 08 10:42:45.730316 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:42:45.730316 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:42:45.730316 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:42:45.730316 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:42:45.730316 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:42:45.730316 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:42:45.730316 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:42:45.730316 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:42:45.730316 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:42:45.730316 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:42:45.730316 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:42:45.730316 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:42:45.730316 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:42:45.730316 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:42:45.736511 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:42:45.736511 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:42:45.736511 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 08 10:42:45.736511 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Sep 08 10:42:45.736511 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 08 10:42:45.736511 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Sep 08 10:42:45.736511 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:42:45.736511 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:42:45.736511 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:42:45.736511 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:42:45.736511 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:42:45.736511 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:42:45.736511 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:42:45.736511 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:42:45.736511 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Sep 08 10:42:45.736511 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:42:45.736511 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-90cd4083-401d-464b-84e4-779617d2c20d tempest-FlavorsV2NegativeTest-1913981719 tempest-FlavorsV2NegativeTest-1913981719-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:42:45.736511 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-90cd4083-401d-464b-84e4-779617d2c20d tempest-FlavorsV2NegativeTest-1913981719 tempest-FlavorsV2NegativeTest-1913981719-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.732933 Sep 08 10:42:45.736511 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 664/1362] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:42:44 2022] POST /compute/v2.1/servers => generated 93 bytes in 734 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 08 10:42:46.340884 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-10a1afd3-741a-4ca0-ad97-6560b7c685d1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:46.341576 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-10a1afd3-741a-4ca0-ad97-6560b7c685d1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 287be913-2461-45d0-8000-360c3fdb5940] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:46.360384 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10a1afd3-741a-4ca0-ad97-6560b7c685d1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:46.360887 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10a1afd3-741a-4ca0-ad97-6560b7c685d1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:46.361364 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10a1afd3-741a-4ca0-ad97-6560b7c685d1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:46.362084 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10a1afd3-741a-4ca0-ad97-6560b7c685d1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:46.362732 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10a1afd3-741a-4ca0-ad97-6560b7c685d1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:46.363323 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10a1afd3-741a-4ca0-ad97-6560b7c685d1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:46.596233 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-be27e1f6-bb67-4de9-a28d-586bd07f5340 req-f394625a-8483-4ba4-a0be-c2d322a08246 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "287be913-2461-45d0-8000-360c3fdb5940", "tag": "b0efdf4d-7120-405a-89e4-97e3a3ae0d87"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:42:46.651878 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-be27e1f6-bb67-4de9-a28d-586bd07f5340 req-f394625a-8483-4ba4-a0be-c2d322a08246 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:46.652699 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-be27e1f6-bb67-4de9-a28d-586bd07f5340 req-f394625a-8483-4ba4-a0be-c2d322a08246 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:46.653384 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-be27e1f6-bb67-4de9-a28d-586bd07f5340 req-f394625a-8483-4ba4-a0be-c2d322a08246 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:46.685218 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-be27e1f6-bb67-4de9-a28d-586bd07f5340 req-f394625a-8483-4ba4-a0be-c2d322a08246 service nova] Creating event network-changed:b0efdf4d-7120-405a-89e4-97e3a3ae0d87 for instance 287be913-2461-45d0-8000-360c3fdb5940 on n-h1-850501-12 Sep 08 10:42:46.703647 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-be27e1f6-bb67-4de9-a28d-586bd07f5340 req-f394625a-8483-4ba4-a0be-c2d322a08246 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120123 Sep 08 10:42:46.706695 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 665/1363] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:42:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:42:46.721470 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-19081d8e-8a4f-4ffe-92dc-47989af0339e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:46.728431 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-19081d8e-8a4f-4ffe-92dc-47989af0339e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 133a5f12-39e5-4e0f-81dc-b1948c073f15] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:46.759526 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-19081d8e-8a4f-4ffe-92dc-47989af0339e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:46.760368 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-19081d8e-8a4f-4ffe-92dc-47989af0339e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:46.762270 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-19081d8e-8a4f-4ffe-92dc-47989af0339e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:46.769119 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-19081d8e-8a4f-4ffe-92dc-47989af0339e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:46.774132 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-19081d8e-8a4f-4ffe-92dc-47989af0339e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:46.774804 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-19081d8e-8a4f-4ffe-92dc-47989af0339e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:46.808163 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:42:46.864217 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:42:46.890179 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-19081d8e-8a4f-4ffe-92dc-47989af0339e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.178570 Sep 08 10:42:46.893586 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 666/1364] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 10:42:46 2022] GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15/os-volume_attachments => generated 197 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:42:47.052160 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-10a1afd3-741a-4ca0-ad97-6560b7c685d1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:47.084140 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-10a1afd3-741a-4ca0-ad97-6560b7c685d1 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940" status: 200 len: 1313 microversion: 2.1 time: 0.745640 Sep 08 10:42:47.103295 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 699/1365] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:46 2022] GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940 => generated 1313 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:47.904029 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-56221a3b-f3d4-4332-b5f2-24d75206bc56 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:47.907750 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-56221a3b-f3d4-4332-b5f2-24d75206bc56 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 133a5f12-39e5-4e0f-81dc-b1948c073f15] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:47.910222 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:42:47.942791 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-56221a3b-f3d4-4332-b5f2-24d75206bc56 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:47.953313 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-56221a3b-f3d4-4332-b5f2-24d75206bc56 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:47.956526 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-56221a3b-f3d4-4332-b5f2-24d75206bc56 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:47.961170 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-56221a3b-f3d4-4332-b5f2-24d75206bc56 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:47.962771 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-56221a3b-f3d4-4332-b5f2-24d75206bc56 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:47.965272 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-56221a3b-f3d4-4332-b5f2-24d75206bc56 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:48.048537 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-56221a3b-f3d4-4332-b5f2-24d75206bc56 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.148370 Sep 08 10:42:48.049941 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 667/1366] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 10:42:47 2022] GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:42:48.125482 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-92d71be7-1435-4ad0-8a36-af1887db2499 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:48.126558 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-92d71be7-1435-4ad0-8a36-af1887db2499 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 287be913-2461-45d0-8000-360c3fdb5940] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:48.151332 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-92d71be7-1435-4ad0-8a36-af1887db2499 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:48.156497 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-92d71be7-1435-4ad0-8a36-af1887db2499 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:48.163345 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-92d71be7-1435-4ad0-8a36-af1887db2499 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:48.165412 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-92d71be7-1435-4ad0-8a36-af1887db2499 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:48.166486 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-92d71be7-1435-4ad0-8a36-af1887db2499 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:48.167267 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-92d71be7-1435-4ad0-8a36-af1887db2499 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:48.443694 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-92d71be7-1435-4ad0-8a36-af1887db2499 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:48.457530 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-92d71be7-1435-4ad0-8a36-af1887db2499 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940" status: 200 len: 1313 microversion: 2.1 time: 0.340291 Sep 08 10:42:48.462355 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 700/1367] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:48 2022] GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940 => generated 1313 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:48.902454 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f360c374-19bc-4623-ada7-66f850961930 tempest-MultipleCreateNegativeTestJSON-1351107186 tempest-MultipleCreateNegativeTestJSON-1351107186-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-934724522", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:42:48.906968 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-f360c374-19bc-4623-ada7-66f850961930 tempest-MultipleCreateNegativeTestJSON-1351107186 tempest-MultipleCreateNegativeTestJSON-1351107186-project] HTTP exception thrown: min_count must be <= max_count Sep 08 10:42:48.915781 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f360c374-19bc-4623-ada7-66f850961930 tempest-MultipleCreateNegativeTestJSON-1351107186 tempest-MultipleCreateNegativeTestJSON-1351107186-project] Request method failure captured: Sep 08 10:42:48.915781 n-d-850501-12 devstack@n-api.service[128861]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 10:42:48.915781 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:42:48.915781 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:42:48.915781 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:42:48.915781 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 183 Sep 08 10:42:48.915781 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:42:48.915781 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:42:48.915781 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:42:48.915781 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:42:48.915781 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGccnPnqzTUxVjNyk-ZUUyQR6RfbXDvjVUlu8nZTHI2ogQqIeVy3ihxkigGNmrHspjWmd3O9aFP0ClW8SIrU9HGOQTzIg4dSrMEoOF_YGOsNL-le_WKih3qYbGAV2GUCjaE2CrYr1uhXuC_I1yECBQ8GyUsdSBzVhCeYWRG1N8dLD8LM Sep 08 10:42:48.915781 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:42:48.915781 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:42:48.915781 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:42:48.915781 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:42:48.915781 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:42:48.915781 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:42:48.915781 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 4ea4600bda78422fbca7783ff47f431c Sep 08 10:42:48.915781 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1351107186 Sep 08 10:42:48.915781 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:42:48.915781 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:42:48.915781 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4ea4600bda78422fbca7783ff47f431c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4ea4600bda78422fbca7783ff47f431c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4ea4600bda78422fbca7783ff47f431c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4ea4600bda78422fbca7783ff47f431c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:42:48.915781 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1351107186 Sep 08 10:42:48.915781 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 4ea4600bda78422fbca7783ff47f431c Sep 08 10:42:48.915781 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1351107186 Sep 08 10:42:48.915781 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-MultipleCreateNegativeTestJSON-1351107186-project Sep 08 10:42:48.915781 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:42:48.915781 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:42:48.915781 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 5bbd408cc84f4b3f85786872bb45956e Sep 08 10:42:48.915781 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1351107186-project Sep 08 10:42:48.915781 n-d-850501-12 devstack@n-api.service[128861]: Sep 08 10:42:48.915781 n-d-850501-12 devstack@n-api.service[128861]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-934724522", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "min_count": 3, "max_count": 2}} Sep 08 10:42:48.915781 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:42:48.915781 n-d-850501-12 devstack@n-api.service[128861]: exception: min_count must be <= max_count Sep 08 10:42:48.915781 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-934724522', 'imageRef': '503f4a0f-e18f-47fd-ad12-0289e3463117', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Sep 08 10:42:48.915781 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:42:48.915781 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:42:48.915781 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:42:48.915781 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:42:48.915781 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:42:48.915781 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:42:48.915781 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:42:48.915781 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:42:48.915781 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:42:48.915781 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:42:48.915781 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:42:48.915781 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:42:48.915781 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:42:48.915781 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:42:48.915781 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 08 10:42:48.915781 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Sep 08 10:42:48.915781 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 08 10:42:48.915781 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Sep 08 10:42:48.915781 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:42:48.915781 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:42:48.915781 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:42:48.915781 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:42:48.915781 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:42:48.915781 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:42:48.915781 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:42:48.915781 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:42:48.915781 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Sep 08 10:42:48.915781 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:42:48.924635 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f360c374-19bc-4623-ada7-66f850961930 tempest-MultipleCreateNegativeTestJSON-1351107186 tempest-MultipleCreateNegativeTestJSON-1351107186-project] Returning 400 to user: min_count must be <= max_count {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:42:48.924635 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f360c374-19bc-4623-ada7-66f850961930 tempest-MultipleCreateNegativeTestJSON-1351107186 tempest-MultipleCreateNegativeTestJSON-1351107186-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.267507 Sep 08 10:42:48.928642 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 668/1368] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:42:48 2022] POST /compute/v2.1/servers => generated 74 bytes in 279 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 08 10:42:49.031627 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-87e3df55-4b25-4603-939c-2a32b2bc39e0 tempest-MultipleCreateNegativeTestJSON-1351107186 tempest-MultipleCreateNegativeTestJSON-1351107186-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-517592480", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "max_count": 0}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:42:49.039924 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-87e3df55-4b25-4603-939c-2a32b2bc39e0 tempest-MultipleCreateNegativeTestJSON-1351107186 tempest-MultipleCreateNegativeTestJSON-1351107186-project] Request method failure captured: Sep 08 10:42:49.039924 n-d-850501-12 devstack@n-api.service[128862]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 10:42:49.039924 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:42:49.039924 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:42:49.039924 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:42:49.039924 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 167 Sep 08 10:42:49.039924 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:42:49.039924 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:42:49.039924 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:42:49.039924 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:42:49.039924 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGccnPnqzTUxVjNyk-ZUUyQR6RfbXDvjVUlu8nZTHI2ogQqIeVy3ihxkigGNmrHspjWmd3O9aFP0ClW8SIrU9HGOQTzIg4dSrMEoOF_YGOsNL-le_WKih3qYbGAV2GUCjaE2CrYr1uhXuC_I1yECBQ8GyUsdSBzVhCeYWRG1N8dLD8LM Sep 08 10:42:49.039924 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:42:49.039924 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:42:49.039924 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:42:49.039924 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:42:49.039924 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:42:49.039924 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:42:49.039924 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 4ea4600bda78422fbca7783ff47f431c Sep 08 10:42:49.039924 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1351107186 Sep 08 10:42:49.039924 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:42:49.039924 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:42:49.039924 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4ea4600bda78422fbca7783ff47f431c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4ea4600bda78422fbca7783ff47f431c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4ea4600bda78422fbca7783ff47f431c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4ea4600bda78422fbca7783ff47f431c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:42:49.039924 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1351107186 Sep 08 10:42:49.039924 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 4ea4600bda78422fbca7783ff47f431c Sep 08 10:42:49.039924 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1351107186 Sep 08 10:42:49.039924 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-MultipleCreateNegativeTestJSON-1351107186-project Sep 08 10:42:49.039924 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:42:49.039924 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:42:49.039924 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 5bbd408cc84f4b3f85786872bb45956e Sep 08 10:42:49.039924 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1351107186-project Sep 08 10:42:49.039924 n-d-850501-12 devstack@n-api.service[128862]: Sep 08 10:42:49.039924 n-d-850501-12 devstack@n-api.service[128862]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-517592480", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "max_count": 0}} Sep 08 10:42:49.039924 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:42:49.039924 n-d-850501-12 devstack@n-api.service[128862]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Sep 08 10:42:49.039924 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-517592480', 'imageRef': '503f4a0f-e18f-47fd-ad12-0289e3463117', 'flavorRef': '452', 'max_count': 0}}} Sep 08 10:42:49.039924 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:42:49.039924 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:42:49.039924 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 10:42:49.039924 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 10:42:49.039924 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 10:42:49.039924 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise error Sep 08 10:42:49.039924 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 08 10:42:49.039924 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:42:49.039924 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Sep 08 10:42:49.039924 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 08 10:42:49.039924 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 08 10:42:49.039924 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 08 10:42:49.039924 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 08 10:42:49.039924 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:42:49.039924 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 08 10:42:49.039924 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 0 Sep 08 10:42:49.039924 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:42:49.039924 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:42:49.039924 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:42:49.039924 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:42:49.039924 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:42:49.039924 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:42:49.039924 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:42:49.039924 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:42:49.039924 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:42:49.039924 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:42:49.039924 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:42:49.039924 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:42:49.039924 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 10:42:49.039924 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 10:42:49.045207 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 10:42:49.045207 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 10:42:49.045207 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 10:42:49.045207 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 10:42:49.045207 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Sep 08 10:42:49.045207 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:42:49.045207 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:42:49.045207 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:42:49.045207 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:42:49.045207 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:42:49.045207 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:42:49.045207 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 10:42:49.045207 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 10:42:49.045207 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Sep 08 10:42:49.045207 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:42:49.045207 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-87e3df55-4b25-4603-939c-2a32b2bc39e0 tempest-MultipleCreateNegativeTestJSON-1351107186 tempest-MultipleCreateNegativeTestJSON-1351107186-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:42:49.045207 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-87e3df55-4b25-4603-939c-2a32b2bc39e0 tempest-MultipleCreateNegativeTestJSON-1351107186 tempest-MultipleCreateNegativeTestJSON-1351107186-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.019068 Sep 08 10:42:49.047510 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 701/1369] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:42:49 2022] POST /compute/v2.1/servers => generated 130 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:42:49.064946 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a9175abc-f554-400c-8a9e-61a19955b399 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:49.068948 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a9175abc-f554-400c-8a9e-61a19955b399 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 133a5f12-39e5-4e0f-81dc-b1948c073f15] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:49.088781 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a9175abc-f554-400c-8a9e-61a19955b399 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:49.089306 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a9175abc-f554-400c-8a9e-61a19955b399 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:49.090609 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a9175abc-f554-400c-8a9e-61a19955b399 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:49.095734 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a9175abc-f554-400c-8a9e-61a19955b399 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:49.097179 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a9175abc-f554-400c-8a9e-61a19955b399 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:49.098915 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a9175abc-f554-400c-8a9e-61a19955b399 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:49.176167 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a9175abc-f554-400c-8a9e-61a19955b399 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117909 Sep 08 10:42:49.177428 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 669/1370] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 10:42:49 2022] GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:42:49.315303 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-aceb1583-93f5-4227-8724-2a2c39be55f6 tempest-MultipleCreateNegativeTestJSON-1351107186 tempest-MultipleCreateNegativeTestJSON-1351107186-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2115970758", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "max_count": 2.5}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:42:49.333548 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-aceb1583-93f5-4227-8724-2a2c39be55f6 tempest-MultipleCreateNegativeTestJSON-1351107186 tempest-MultipleCreateNegativeTestJSON-1351107186-project] Request method failure captured: Sep 08 10:42:49.333548 n-d-850501-12 devstack@n-api.service[128862]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 10:42:49.333548 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:42:49.333548 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:42:49.333548 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:42:49.333548 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 170 Sep 08 10:42:49.333548 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:42:49.333548 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:42:49.333548 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:42:49.333548 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:42:49.333548 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGccnPnqzTUxVjNyk-ZUUyQR6RfbXDvjVUlu8nZTHI2ogQqIeVy3ihxkigGNmrHspjWmd3O9aFP0ClW8SIrU9HGOQTzIg4dSrMEoOF_YGOsNL-le_WKih3qYbGAV2GUCjaE2CrYr1uhXuC_I1yECBQ8GyUsdSBzVhCeYWRG1N8dLD8LM Sep 08 10:42:49.333548 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:42:49.333548 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:42:49.333548 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:42:49.333548 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:42:49.333548 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:42:49.333548 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:42:49.333548 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 4ea4600bda78422fbca7783ff47f431c Sep 08 10:42:49.333548 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1351107186 Sep 08 10:42:49.333548 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:42:49.333548 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:42:49.333548 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4ea4600bda78422fbca7783ff47f431c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4ea4600bda78422fbca7783ff47f431c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4ea4600bda78422fbca7783ff47f431c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4ea4600bda78422fbca7783ff47f431c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:42:49.333548 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1351107186 Sep 08 10:42:49.333548 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 4ea4600bda78422fbca7783ff47f431c Sep 08 10:42:49.333548 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1351107186 Sep 08 10:42:49.333548 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-MultipleCreateNegativeTestJSON-1351107186-project Sep 08 10:42:49.333548 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:42:49.333548 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:42:49.333548 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 5bbd408cc84f4b3f85786872bb45956e Sep 08 10:42:49.333548 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1351107186-project Sep 08 10:42:49.333548 n-d-850501-12 devstack@n-api.service[128862]: Sep 08 10:42:49.333548 n-d-850501-12 devstack@n-api.service[128862]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2115970758", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "max_count": 2.5}} Sep 08 10:42:49.333548 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:42:49.333548 n-d-850501-12 devstack@n-api.service[128862]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 08 10:42:49.333548 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-2115970758', 'imageRef': '503f4a0f-e18f-47fd-ad12-0289e3463117', 'flavorRef': '452', 'max_count': 2.5}}} Sep 08 10:42:49.333548 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:42:49.333548 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:42:49.333548 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 10:42:49.333548 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 10:42:49.333548 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 10:42:49.333548 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise error Sep 08 10:42:49.333548 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Sep 08 10:42:49.333548 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:42:49.333548 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Sep 08 10:42:49.333548 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 08 10:42:49.333548 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 08 10:42:49.333548 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 08 10:42:49.333548 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 08 10:42:49.333548 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:42:49.333548 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 08 10:42:49.333548 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 2.5 Sep 08 10:42:49.333548 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:42:49.333548 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:42:49.333548 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:42:49.333548 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:42:49.333548 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:42:49.333548 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:42:49.333548 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:42:49.333548 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:42:49.333548 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:42:49.333548 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:42:49.333548 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:42:49.333548 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:42:49.333548 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 10:42:49.333548 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 10:42:49.338089 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 10:42:49.338089 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 10:42:49.338089 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 10:42:49.338089 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 10:42:49.338089 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 08 10:42:49.338089 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:42:49.338089 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:42:49.338089 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:42:49.338089 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:42:49.338089 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:42:49.338089 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:42:49.338089 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 10:42:49.338089 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 10:42:49.338089 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 08 10:42:49.338089 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:42:49.339178 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-aceb1583-93f5-4227-8724-2a2c39be55f6 tempest-MultipleCreateNegativeTestJSON-1351107186 tempest-MultipleCreateNegativeTestJSON-1351107186-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:42:49.339263 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-aceb1583-93f5-4227-8724-2a2c39be55f6 tempest-MultipleCreateNegativeTestJSON-1351107186 tempest-MultipleCreateNegativeTestJSON-1351107186-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.031393 Sep 08 10:42:49.339769 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 702/1371] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:42:49 2022] POST /compute/v2.1/servers => generated 139 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:42:49.499936 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7c861b34-c9e6-40b0-82d6-1ffc44dcd383 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:49.501317 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7c861b34-c9e6-40b0-82d6-1ffc44dcd383 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 287be913-2461-45d0-8000-360c3fdb5940] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:49.516318 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c861b34-c9e6-40b0-82d6-1ffc44dcd383 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:49.517997 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c861b34-c9e6-40b0-82d6-1ffc44dcd383 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:49.521950 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c861b34-c9e6-40b0-82d6-1ffc44dcd383 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:49.522933 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c861b34-c9e6-40b0-82d6-1ffc44dcd383 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:49.523730 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c861b34-c9e6-40b0-82d6-1ffc44dcd383 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:49.527280 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c861b34-c9e6-40b0-82d6-1ffc44dcd383 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:49.774727 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-72cd5aa4-c908-44a0-9098-93fccf3cda38 tempest-MultipleCreateNegativeTestJSON-1351107186 tempest-MultipleCreateNegativeTestJSON-1351107186-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-18541076", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "min_count": 0}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:42:49.783955 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-72cd5aa4-c908-44a0-9098-93fccf3cda38 tempest-MultipleCreateNegativeTestJSON-1351107186 tempest-MultipleCreateNegativeTestJSON-1351107186-project] Request method failure captured: Sep 08 10:42:49.783955 n-d-850501-12 devstack@n-api.service[128862]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 10:42:49.783955 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:42:49.783955 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:42:49.783955 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:42:49.783955 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 166 Sep 08 10:42:49.783955 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:42:49.783955 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:42:49.783955 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:42:49.783955 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:42:49.783955 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGccnPnqzTUxVjNyk-ZUUyQR6RfbXDvjVUlu8nZTHI2ogQqIeVy3ihxkigGNmrHspjWmd3O9aFP0ClW8SIrU9HGOQTzIg4dSrMEoOF_YGOsNL-le_WKih3qYbGAV2GUCjaE2CrYr1uhXuC_I1yECBQ8GyUsdSBzVhCeYWRG1N8dLD8LM Sep 08 10:42:49.783955 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:42:49.783955 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:42:49.783955 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:42:49.783955 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:42:49.783955 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:42:49.783955 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:42:49.783955 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 4ea4600bda78422fbca7783ff47f431c Sep 08 10:42:49.783955 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1351107186 Sep 08 10:42:49.783955 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:42:49.783955 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:42:49.783955 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4ea4600bda78422fbca7783ff47f431c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4ea4600bda78422fbca7783ff47f431c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4ea4600bda78422fbca7783ff47f431c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4ea4600bda78422fbca7783ff47f431c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:42:49.783955 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1351107186 Sep 08 10:42:49.783955 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 4ea4600bda78422fbca7783ff47f431c Sep 08 10:42:49.783955 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1351107186 Sep 08 10:42:49.783955 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-MultipleCreateNegativeTestJSON-1351107186-project Sep 08 10:42:49.783955 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:42:49.783955 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:42:49.783955 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 5bbd408cc84f4b3f85786872bb45956e Sep 08 10:42:49.783955 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1351107186-project Sep 08 10:42:49.783955 n-d-850501-12 devstack@n-api.service[128862]: Sep 08 10:42:49.783955 n-d-850501-12 devstack@n-api.service[128862]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-18541076", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "min_count": 0}} Sep 08 10:42:49.783955 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:42:49.783955 n-d-850501-12 devstack@n-api.service[128862]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Sep 08 10:42:49.783955 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-18541076', 'imageRef': '503f4a0f-e18f-47fd-ad12-0289e3463117', 'flavorRef': '452', 'min_count': 0}}} Sep 08 10:42:49.783955 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:42:49.783955 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:42:49.783955 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 10:42:49.783955 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 10:42:49.783955 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 10:42:49.783955 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise error Sep 08 10:42:49.783955 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 08 10:42:49.783955 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:42:49.783955 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Sep 08 10:42:49.783955 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 08 10:42:49.783955 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 08 10:42:49.783955 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 08 10:42:49.783955 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 08 10:42:49.783955 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:42:49.783955 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 08 10:42:49.783955 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 0 Sep 08 10:42:49.783955 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:42:49.783955 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:42:49.783955 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:42:49.783955 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:42:49.783955 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:42:49.783955 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:42:49.783955 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:42:49.783955 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:42:49.783955 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:42:49.783955 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:42:49.783955 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:42:49.783955 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:42:49.783955 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 10:42:49.783955 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 10:42:49.788206 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 10:42:49.788206 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 10:42:49.788206 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 10:42:49.788206 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 10:42:49.788206 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Sep 08 10:42:49.788206 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:42:49.788206 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:42:49.788206 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:42:49.788206 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:42:49.788206 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:42:49.788206 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:42:49.788206 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 10:42:49.788206 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 10:42:49.788206 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Sep 08 10:42:49.788206 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:42:49.791317 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-72cd5aa4-c908-44a0-9098-93fccf3cda38 tempest-MultipleCreateNegativeTestJSON-1351107186 tempest-MultipleCreateNegativeTestJSON-1351107186-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:42:49.794735 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-72cd5aa4-c908-44a0-9098-93fccf3cda38 tempest-MultipleCreateNegativeTestJSON-1351107186 tempest-MultipleCreateNegativeTestJSON-1351107186-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.024479 Sep 08 10:42:49.797966 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 703/1372] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:42:49 2022] POST /compute/v2.1/servers => generated 130 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:42:49.965819 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-30895e02-c979-46d6-8073-b310147af764 tempest-MultipleCreateNegativeTestJSON-1351107186 tempest-MultipleCreateNegativeTestJSON-1351107186-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1691974135", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "min_count": 2.5}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:42:49.975208 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-30895e02-c979-46d6-8073-b310147af764 tempest-MultipleCreateNegativeTestJSON-1351107186 tempest-MultipleCreateNegativeTestJSON-1351107186-project] Request method failure captured: Sep 08 10:42:49.975208 n-d-850501-12 devstack@n-api.service[128862]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 10:42:49.975208 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:42:49.975208 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:42:49.975208 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:42:49.975208 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 170 Sep 08 10:42:49.975208 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:42:49.975208 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:42:49.975208 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:42:49.975208 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:42:49.975208 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGccnPnqzTUxVjNyk-ZUUyQR6RfbXDvjVUlu8nZTHI2ogQqIeVy3ihxkigGNmrHspjWmd3O9aFP0ClW8SIrU9HGOQTzIg4dSrMEoOF_YGOsNL-le_WKih3qYbGAV2GUCjaE2CrYr1uhXuC_I1yECBQ8GyUsdSBzVhCeYWRG1N8dLD8LM Sep 08 10:42:49.975208 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:42:49.975208 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:42:49.975208 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:42:49.975208 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:42:49.975208 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:42:49.975208 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:42:49.975208 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 4ea4600bda78422fbca7783ff47f431c Sep 08 10:42:49.975208 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1351107186 Sep 08 10:42:49.975208 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:42:49.975208 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:42:49.975208 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4ea4600bda78422fbca7783ff47f431c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4ea4600bda78422fbca7783ff47f431c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4ea4600bda78422fbca7783ff47f431c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4ea4600bda78422fbca7783ff47f431c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:42:49.975208 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1351107186 Sep 08 10:42:49.975208 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 4ea4600bda78422fbca7783ff47f431c Sep 08 10:42:49.975208 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1351107186 Sep 08 10:42:49.975208 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-MultipleCreateNegativeTestJSON-1351107186-project Sep 08 10:42:49.975208 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:42:49.975208 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:42:49.975208 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 5bbd408cc84f4b3f85786872bb45956e Sep 08 10:42:49.975208 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1351107186-project Sep 08 10:42:49.975208 n-d-850501-12 devstack@n-api.service[128862]: Sep 08 10:42:49.975208 n-d-850501-12 devstack@n-api.service[128862]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1691974135", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "min_count": 2.5}} Sep 08 10:42:49.975208 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:42:49.975208 n-d-850501-12 devstack@n-api.service[128862]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 08 10:42:49.975208 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1691974135', 'imageRef': '503f4a0f-e18f-47fd-ad12-0289e3463117', 'flavorRef': '452', 'min_count': 2.5}}} Sep 08 10:42:49.975208 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:42:49.975208 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:42:49.975208 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 10:42:49.975208 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 10:42:49.975208 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 10:42:49.975208 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise error Sep 08 10:42:49.975208 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Sep 08 10:42:49.975208 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:42:49.975208 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Sep 08 10:42:49.975208 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 08 10:42:49.975208 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 08 10:42:49.975208 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 08 10:42:49.975208 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 08 10:42:49.975208 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:42:49.975208 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 08 10:42:49.975208 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 2.5 Sep 08 10:42:49.975208 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:42:49.975208 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:42:49.975208 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:42:49.975208 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:42:49.975208 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:42:49.975208 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:42:49.975208 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:42:49.975208 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:42:49.975208 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:42:49.975208 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:42:49.975208 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:42:49.975208 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:42:49.975208 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 10:42:49.975208 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 10:42:49.980629 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 10:42:49.980629 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 10:42:49.980629 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 10:42:49.980629 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 10:42:49.980629 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 08 10:42:49.980629 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:42:49.980629 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:42:49.980629 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:42:49.980629 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:42:49.980629 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:42:49.980629 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:42:49.980629 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 10:42:49.980629 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 10:42:49.980629 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 08 10:42:49.980629 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:42:49.983607 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-30895e02-c979-46d6-8073-b310147af764 tempest-MultipleCreateNegativeTestJSON-1351107186 tempest-MultipleCreateNegativeTestJSON-1351107186-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:42:49.984841 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-30895e02-c979-46d6-8073-b310147af764 tempest-MultipleCreateNegativeTestJSON-1351107186 tempest-MultipleCreateNegativeTestJSON-1351107186-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.024627 Sep 08 10:42:49.989516 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 704/1373] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:42:49 2022] POST /compute/v2.1/servers => generated 139 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:42:50.190968 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-810707d0-5e3f-413a-a6e4-08fb2125a4df tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:50.193849 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-810707d0-5e3f-413a-a6e4-08fb2125a4df tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 133a5f12-39e5-4e0f-81dc-b1948c073f15] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:50.213173 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-810707d0-5e3f-413a-a6e4-08fb2125a4df tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:50.215296 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-810707d0-5e3f-413a-a6e4-08fb2125a4df tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:50.218174 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-810707d0-5e3f-413a-a6e4-08fb2125a4df tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:50.219374 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-810707d0-5e3f-413a-a6e4-08fb2125a4df tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:50.221258 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-810707d0-5e3f-413a-a6e4-08fb2125a4df tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:50.223069 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-810707d0-5e3f-413a-a6e4-08fb2125a4df tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:50.325882 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7c861b34-c9e6-40b0-82d6-1ffc44dcd383 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:50.327987 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-810707d0-5e3f-413a-a6e4-08fb2125a4df tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.140234 Sep 08 10:42:50.330761 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 705/1374] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 10:42:50 2022] GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:42:50.339262 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7c861b34-c9e6-40b0-82d6-1ffc44dcd383 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940" status: 200 len: 1313 microversion: 2.1 time: 0.844084 Sep 08 10:42:50.345420 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 670/1375] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:49 2022] GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940 => generated 1313 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:51.346919 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cba07e53-bf41-4f5f-894d-eb487d73f459 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:51.350065 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cba07e53-bf41-4f5f-894d-eb487d73f459 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 133a5f12-39e5-4e0f-81dc-b1948c073f15] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:51.363578 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3b7a71ed-60d4-4d25-b406-4e0c95b1c7b4 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:51.364200 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3b7a71ed-60d4-4d25-b406-4e0c95b1c7b4 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 287be913-2461-45d0-8000-360c3fdb5940] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:51.384676 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3b7a71ed-60d4-4d25-b406-4e0c95b1c7b4 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:51.385622 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cba07e53-bf41-4f5f-894d-eb487d73f459 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:51.386325 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cba07e53-bf41-4f5f-894d-eb487d73f459 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:51.386938 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cba07e53-bf41-4f5f-894d-eb487d73f459 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:51.387720 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cba07e53-bf41-4f5f-894d-eb487d73f459 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:51.388176 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cba07e53-bf41-4f5f-894d-eb487d73f459 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:51.388597 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cba07e53-bf41-4f5f-894d-eb487d73f459 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:51.390647 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3b7a71ed-60d4-4d25-b406-4e0c95b1c7b4 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:51.391092 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3b7a71ed-60d4-4d25-b406-4e0c95b1c7b4 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:51.391842 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3b7a71ed-60d4-4d25-b406-4e0c95b1c7b4 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:51.392339 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3b7a71ed-60d4-4d25-b406-4e0c95b1c7b4 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:51.392737 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3b7a71ed-60d4-4d25-b406-4e0c95b1c7b4 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:51.474093 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cba07e53-bf41-4f5f-894d-eb487d73f459 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.132775 Sep 08 10:42:51.479984 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 706/1376] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 10:42:51 2022] GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:42:51.686115 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-e96204da-f50b-4ab0-aa90-c80b9cfcd97d req-fc7d5e76-6ebc-4e38-ad61-ca0fdc6e7212 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "287be913-2461-45d0-8000-360c3fdb5940", "name": "network-vif-plugged", "status": "completed", "tag": "b0efdf4d-7120-405a-89e4-97e3a3ae0d87"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:42:51.707487 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e96204da-f50b-4ab0-aa90-c80b9cfcd97d req-fc7d5e76-6ebc-4e38-ad61-ca0fdc6e7212 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:51.707996 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e96204da-f50b-4ab0-aa90-c80b9cfcd97d req-fc7d5e76-6ebc-4e38-ad61-ca0fdc6e7212 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:51.708434 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e96204da-f50b-4ab0-aa90-c80b9cfcd97d req-fc7d5e76-6ebc-4e38-ad61-ca0fdc6e7212 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:51.734411 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-e96204da-f50b-4ab0-aa90-c80b9cfcd97d req-fc7d5e76-6ebc-4e38-ad61-ca0fdc6e7212 service nova] Creating event network-vif-plugged:b0efdf4d-7120-405a-89e4-97e3a3ae0d87 for instance 287be913-2461-45d0-8000-360c3fdb5940 on n-h1-850501-12 Sep 08 10:42:51.748180 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-e96204da-f50b-4ab0-aa90-c80b9cfcd97d req-fc7d5e76-6ebc-4e38-ad61-ca0fdc6e7212 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066112 Sep 08 10:42:51.749541 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 707/1377] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:42:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:42:51.851034 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-3b7a71ed-60d4-4d25-b406-4e0c95b1c7b4 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:51.860529 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3b7a71ed-60d4-4d25-b406-4e0c95b1c7b4 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940" status: 200 len: 1313 microversion: 2.1 time: 0.500820 Sep 08 10:42:51.861541 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 671/1378] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:51 2022] GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940 => generated 1313 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:42:52.495439 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c80cf4a4-c708-4654-a94a-05a3cc90fe81 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:52.504480 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c80cf4a4-c708-4654-a94a-05a3cc90fe81 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 133a5f12-39e5-4e0f-81dc-b1948c073f15] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:52.518561 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c80cf4a4-c708-4654-a94a-05a3cc90fe81 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:52.519947 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c80cf4a4-c708-4654-a94a-05a3cc90fe81 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:52.521113 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c80cf4a4-c708-4654-a94a-05a3cc90fe81 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:52.522609 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c80cf4a4-c708-4654-a94a-05a3cc90fe81 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:52.524951 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c80cf4a4-c708-4654-a94a-05a3cc90fe81 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:52.526229 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c80cf4a4-c708-4654-a94a-05a3cc90fe81 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:52.628581 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c80cf4a4-c708-4654-a94a-05a3cc90fe81 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.144284 Sep 08 10:42:52.634589 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 708/1379] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 10:42:52 2022] GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15/os-volume_attachments => generated 197 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:42:52.887570 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d2feecc6-cf78-4607-90fa-2543116f8975 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:52.888948 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d2feecc6-cf78-4607-90fa-2543116f8975 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 287be913-2461-45d0-8000-360c3fdb5940] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:52.925639 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d2feecc6-cf78-4607-90fa-2543116f8975 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:52.927644 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d2feecc6-cf78-4607-90fa-2543116f8975 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:52.929320 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d2feecc6-cf78-4607-90fa-2543116f8975 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:52.931895 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d2feecc6-cf78-4607-90fa-2543116f8975 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:52.933898 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d2feecc6-cf78-4607-90fa-2543116f8975 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:52.938386 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d2feecc6-cf78-4607-90fa-2543116f8975 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:53.174046 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d630e8f5-edb1-4cce-a967-431c9633876e tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '.version_select at 0x7f68e440d8b0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:53.319917 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d630e8f5-edb1-4cce-a967-431c9633876e tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/images/2525acfc-1c8e-46b2-a4bd-a7c498d332fe" status: 200 len: 662 microversion: 2.1 time: 0.155783 Sep 08 10:42:53.325376 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 709/1380] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:42:53 2022] GET /compute/v2.1/images/2525acfc-1c8e-46b2-a4bd-a7c498d332fe => generated 662 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:42:53.409872 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d2feecc6-cf78-4607-90fa-2543116f8975 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:53.432706 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d2feecc6-cf78-4607-90fa-2543116f8975 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940" status: 200 len: 1313 microversion: 2.1 time: 0.550581 Sep 08 10:42:53.441019 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 672/1381] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:52 2022] GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940 => generated 1313 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:53.459125 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-05931ef3-a1fe-435c-ba5b-c0b00ca80936 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '.version_select at 0x7f68e4463b80>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:53.564134 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-05931ef3-a1fe-435c-ba5b-c0b00ca80936 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/images/2525acfc-1c8e-46b2-a4bd-a7c498d332fe" status: 200 len: 662 microversion: 2.1 time: 0.121014 Sep 08 10:42:53.567053 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 673/1382] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:42:53 2022] GET /compute/v2.1/images/2525acfc-1c8e-46b2-a4bd-a7c498d332fe => generated 662 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:42:53.650337 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-34dc3423-5d31-4611-adc4-90522dde00c6 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:53.656655 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-34dc3423-5d31-4611-adc4-90522dde00c6 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 133a5f12-39e5-4e0f-81dc-b1948c073f15] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:53.672090 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-34dc3423-5d31-4611-adc4-90522dde00c6 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:53.674084 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-34dc3423-5d31-4611-adc4-90522dde00c6 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:53.674835 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-34dc3423-5d31-4611-adc4-90522dde00c6 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:53.676874 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-34dc3423-5d31-4611-adc4-90522dde00c6 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:53.678705 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-34dc3423-5d31-4611-adc4-90522dde00c6 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:53.681479 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-34dc3423-5d31-4611-adc4-90522dde00c6 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:53.800204 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=100 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:42:53.835010 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-34dc3423-5d31-4611-adc4-90522dde00c6 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.194383 Sep 08 10:42:53.860276 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 674/1383] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 10:42:53 2022] GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15/os-volume_attachments => generated 25 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:42:53.880357 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1caa313f-9afd-442e-801a-3a8b2eaa3ecd tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-673541206", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": "none"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:42:54.047495 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-1caa313f-9afd-442e-801a-3a8b2eaa3ecd tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:42:54.048155 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-1caa313f-9afd-442e-801a-3a8b2eaa3ecd tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:42:54.049792 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-1caa313f-9afd-442e-801a-3a8b2eaa3ecd tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:42:54.052557 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-1caa313f-9afd-442e-801a-3a8b2eaa3ecd tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:42:54.054204 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-1caa313f-9afd-442e-801a-3a8b2eaa3ecd tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:42:54.097552 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1caa313f-9afd-442e-801a-3a8b2eaa3ecd tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:54.098422 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1caa313f-9afd-442e-801a-3a8b2eaa3ecd tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:54.100388 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1caa313f-9afd-442e-801a-3a8b2eaa3ecd tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:54.103399 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1caa313f-9afd-442e-801a-3a8b2eaa3ecd tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:54.105446 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1caa313f-9afd-442e-801a-3a8b2eaa3ecd tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:54.106549 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1caa313f-9afd-442e-801a-3a8b2eaa3ecd tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:54.211477 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-1caa313f-9afd-442e-801a-3a8b2eaa3ecd tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Getting quotas for project de26f1b9fbbb4e31b1f4535a5a1ff512. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:42:54.241531 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-1caa313f-9afd-442e-801a-3a8b2eaa3ecd tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Getting quotas for user 9e25e1f9b61a4cddaa50e2a841aa7082 and project de26f1b9fbbb4e31b1f4535a5a1ff512. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:42:54.322040 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1caa313f-9afd-442e-801a-3a8b2eaa3ecd tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:42:54.348115 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1caa313f-9afd-442e-801a-3a8b2eaa3ecd tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] [instance: 24a25908-e543-400e-b922-392c9604ec2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:42:54.444778 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1caa313f-9afd-442e-801a-3a8b2eaa3ecd tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 1.117866 Sep 08 10:42:54.446380 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 710/1384] 10.222.0.27 () {62 vars in 1188 bytes} [Thu Sep 8 10:42:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1120 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 08 10:42:54.462365 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0697e782-6388-4138-9458-4163155847de tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:54.470871 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0697e782-6388-4138-9458-4163155847de tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] [instance: 24a25908-e543-400e-b922-392c9604ec2e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:54.480434 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dd202e58-6032-4638-bd8f-21ff5a885787 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:54.497378 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-dd202e58-6032-4638-bd8f-21ff5a885787 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 287be913-2461-45d0-8000-360c3fdb5940] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:54.550109 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd202e58-6032-4638-bd8f-21ff5a885787 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:54.550960 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd202e58-6032-4638-bd8f-21ff5a885787 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:54.551651 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd202e58-6032-4638-bd8f-21ff5a885787 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:54.552708 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd202e58-6032-4638-bd8f-21ff5a885787 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:54.553321 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd202e58-6032-4638-bd8f-21ff5a885787 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:54.553855 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd202e58-6032-4638-bd8f-21ff5a885787 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:55.007596 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-dd202e58-6032-4638-bd8f-21ff5a885787 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:55.041289 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-dd202e58-6032-4638-bd8f-21ff5a885787 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940" status: 200 len: 1463 microversion: 2.1 time: 0.566543 Sep 08 10:42:55.045714 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 711/1385] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:54 2022] GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940 => generated 1463 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:55.072195 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8c081ed6-bc92-4466-af26-8844e0b7463a tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:55.073906 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8c081ed6-bc92-4466-af26-8844e0b7463a tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] [instance: 287be913-2461-45d0-8000-360c3fdb5940] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:55.095641 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c081ed6-bc92-4466-af26-8844e0b7463a tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:55.096825 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c081ed6-bc92-4466-af26-8844e0b7463a tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:55.097458 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c081ed6-bc92-4466-af26-8844e0b7463a tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:55.098373 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c081ed6-bc92-4466-af26-8844e0b7463a tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:55.098995 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c081ed6-bc92-4466-af26-8844e0b7463a tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:55.099694 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c081ed6-bc92-4466-af26-8844e0b7463a tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:55.208231 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0697e782-6388-4138-9458-4163155847de tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e25e1f9b61a4cddaa50e2a841aa7082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de26f1b9fbbb4e31b1f4535a5a1ff512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:55.228372 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0697e782-6388-4138-9458-4163155847de tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e25e1f9b61a4cddaa50e2a841aa7082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de26f1b9fbbb4e31b1f4535a5a1ff512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:55.234790 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0697e782-6388-4138-9458-4163155847de tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e25e1f9b61a4cddaa50e2a841aa7082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de26f1b9fbbb4e31b1f4535a5a1ff512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:55.236024 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0697e782-6388-4138-9458-4163155847de tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] 10.222.0.27 "GET /compute/v2.1/servers/24a25908-e543-400e-b922-392c9604ec2e" status: 200 len: 1277 microversion: 2.54 time: 0.781928 Sep 08 10:42:55.236592 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 675/1386] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:42:54 2022] GET /compute/v2.1/servers/24a25908-e543-400e-b922-392c9604ec2e => generated 1277 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:42:55.623877 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8c081ed6-bc92-4466-af26-8844e0b7463a tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940" status: 200 len: 1616 microversion: 2.1 time: 0.556530 Sep 08 10:42:55.625015 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 712/1387] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:55 2022] GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940 => generated 1616 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:42:55.664701 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a3c5a6e6-3338-44f3-8e76-ab3c4af38613 tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:42:55.665407 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a3c5a6e6-3338-44f3-8e76-ab3c4af38613 tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] [instance: 287be913-2461-45d0-8000-360c3fdb5940] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:55.685616 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a3c5a6e6-3338-44f3-8e76-ab3c4af38613 tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:55.686585 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a3c5a6e6-3338-44f3-8e76-ab3c4af38613 tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:55.687048 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a3c5a6e6-3338-44f3-8e76-ab3c4af38613 tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:55.688036 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a3c5a6e6-3338-44f3-8e76-ab3c4af38613 tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:55.690676 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a3c5a6e6-3338-44f3-8e76-ab3c4af38613 tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:55.692596 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a3c5a6e6-3338-44f3-8e76-ab3c4af38613 tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:55.847015 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a3c5a6e6-3338-44f3-8e76-ab3c4af38613 tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '637a55ca4c684640a58a6afb579a864f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549722de06cc45c1aaec10bf5ba656aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:55.847798 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a3c5a6e6-3338-44f3-8e76-ab3c4af38613 tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] [instance: 287be913-2461-45d0-8000-360c3fdb5940] flavor_id is None. Assuming migration. {{(pid=128861) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 08 10:42:55.848316 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a3c5a6e6-3338-44f3-8e76-ab3c4af38613 tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] [instance: 287be913-2461-45d0-8000-360c3fdb5940] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128861) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 08 10:42:56.141101 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c22e0ab2-6e67-46ed-9d87-349b3002e1f0 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '.version_select at 0x7f68e4512040>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:56.421165 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c22e0ab2-6e67-46ed-9d87-349b3002e1f0 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/images/c2b844c1-5006-4cd0-a338-c22c553491a1" status: 200 len: 661 microversion: 2.1 time: 0.280929 Sep 08 10:42:56.427846 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 713/1388] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:42:56 2022] GET /compute/v2.1/images/c2b844c1-5006-4cd0-a338-c22c553491a1 => generated 661 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:42:56.450833 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6f5f3230-cd94-4d20-b1ac-2d4ff5b324ec tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:56.454144 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6f5f3230-cd94-4d20-b1ac-2d4ff5b324ec tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] [instance: 24a25908-e543-400e-b922-392c9604ec2e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:56.473837 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f5f3230-cd94-4d20-b1ac-2d4ff5b324ec tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:56.474350 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f5f3230-cd94-4d20-b1ac-2d4ff5b324ec tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:56.474793 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f5f3230-cd94-4d20-b1ac-2d4ff5b324ec tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:56.478858 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f5f3230-cd94-4d20-b1ac-2d4ff5b324ec tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:56.479343 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f5f3230-cd94-4d20-b1ac-2d4ff5b324ec tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:56.479787 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f5f3230-cd94-4d20-b1ac-2d4ff5b324ec tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:56.649691 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a3c5a6e6-3338-44f3-8e76-ab3c4af38613 tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940/action" status: 202 len: 0 microversion: 2.1 time: 0.986994 Sep 08 10:42:56.652827 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 676/1389] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:42:55 2022] POST /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940/action => generated 0 bytes in 993 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:42:56.679246 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-005c4be4-3511-4cae-97d9-a8d03a5c811a tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '.version_select at 0x7f68e458a1f0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:56.930111 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6f5f3230-cd94-4d20-b1ac-2d4ff5b324ec tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e25e1f9b61a4cddaa50e2a841aa7082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de26f1b9fbbb4e31b1f4535a5a1ff512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:56.953623 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6f5f3230-cd94-4d20-b1ac-2d4ff5b324ec tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e25e1f9b61a4cddaa50e2a841aa7082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de26f1b9fbbb4e31b1f4535a5a1ff512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:56.959785 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6f5f3230-cd94-4d20-b1ac-2d4ff5b324ec tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e25e1f9b61a4cddaa50e2a841aa7082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de26f1b9fbbb4e31b1f4535a5a1ff512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:56.962889 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6f5f3230-cd94-4d20-b1ac-2d4ff5b324ec tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] 10.222.0.27 "GET /compute/v2.1/servers/24a25908-e543-400e-b922-392c9604ec2e" status: 200 len: 1329 microversion: 2.54 time: 0.531985 Sep 08 10:42:56.967554 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 714/1390] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:42:56 2022] GET /compute/v2.1/servers/24a25908-e543-400e-b922-392c9604ec2e => generated 1329 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:42:56.977379 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6a0838fe-322d-4208-af4c-49dd24467811 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:56.978064 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6a0838fe-322d-4208-af4c-49dd24467811 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 287be913-2461-45d0-8000-360c3fdb5940] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:56.987938 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a0838fe-322d-4208-af4c-49dd24467811 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:56.988732 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a0838fe-322d-4208-af4c-49dd24467811 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:56.989248 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a0838fe-322d-4208-af4c-49dd24467811 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:56.989977 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a0838fe-322d-4208-af4c-49dd24467811 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:56.990446 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a0838fe-322d-4208-af4c-49dd24467811 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:56.993396 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a0838fe-322d-4208-af4c-49dd24467811 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:57.272053 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6a0838fe-322d-4208-af4c-49dd24467811 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:57.285473 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6a0838fe-322d-4208-af4c-49dd24467811 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940" status: 200 len: 1472 microversion: 2.1 time: 0.316209 Sep 08 10:42:57.286064 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 715/1391] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:56 2022] GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940 => generated 1472 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:57.997742 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ea91591d-d156-4c76-b39d-5172e99ade62 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:57.999394 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ea91591d-d156-4c76-b39d-5172e99ade62 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] [instance: 24a25908-e543-400e-b922-392c9604ec2e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:58.021665 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea91591d-d156-4c76-b39d-5172e99ade62 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:58.024320 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea91591d-d156-4c76-b39d-5172e99ade62 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:58.025921 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea91591d-d156-4c76-b39d-5172e99ade62 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:58.029008 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea91591d-d156-4c76-b39d-5172e99ade62 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:58.031499 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea91591d-d156-4c76-b39d-5172e99ade62 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:58.033316 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea91591d-d156-4c76-b39d-5172e99ade62 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:58.070972 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:42:58.155893 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ea91591d-d156-4c76-b39d-5172e99ade62 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e25e1f9b61a4cddaa50e2a841aa7082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de26f1b9fbbb4e31b1f4535a5a1ff512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:58.168758 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ea91591d-d156-4c76-b39d-5172e99ade62 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e25e1f9b61a4cddaa50e2a841aa7082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de26f1b9fbbb4e31b1f4535a5a1ff512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:58.172500 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ea91591d-d156-4c76-b39d-5172e99ade62 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e25e1f9b61a4cddaa50e2a841aa7082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de26f1b9fbbb4e31b1f4535a5a1ff512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:58.175042 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ea91591d-d156-4c76-b39d-5172e99ade62 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] 10.222.0.27 "GET /compute/v2.1/servers/24a25908-e543-400e-b922-392c9604ec2e" status: 200 len: 1335 microversion: 2.54 time: 0.183928 Sep 08 10:42:58.177304 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 716/1392] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:42:57 2022] GET /compute/v2.1/servers/24a25908-e543-400e-b922-392c9604ec2e => generated 1335 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:42:58.315860 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0f02c8b5-f446-470a-bd1a-68b89df6873a tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:58.322084 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0f02c8b5-f446-470a-bd1a-68b89df6873a tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 287be913-2461-45d0-8000-360c3fdb5940] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:58.331909 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f02c8b5-f446-470a-bd1a-68b89df6873a tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:58.332950 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f02c8b5-f446-470a-bd1a-68b89df6873a tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:58.334386 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f02c8b5-f446-470a-bd1a-68b89df6873a tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:58.335794 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f02c8b5-f446-470a-bd1a-68b89df6873a tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:58.336650 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f02c8b5-f446-470a-bd1a-68b89df6873a tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:58.337749 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f02c8b5-f446-470a-bd1a-68b89df6873a tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:58.551895 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0f02c8b5-f446-470a-bd1a-68b89df6873a tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:58.567136 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0f02c8b5-f446-470a-bd1a-68b89df6873a tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940" status: 200 len: 1472 microversion: 2.1 time: 0.258363 Sep 08 10:42:58.568985 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 717/1393] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:58 2022] GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940 => generated 1472 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:59.207867 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-75f26e90-d814-4145-87f0-d761388c6316 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:59.208736 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-75f26e90-d814-4145-87f0-d761388c6316 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] [instance: 24a25908-e543-400e-b922-392c9604ec2e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:59.223912 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-75f26e90-d814-4145-87f0-d761388c6316 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:59.224602 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-75f26e90-d814-4145-87f0-d761388c6316 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:59.228302 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-75f26e90-d814-4145-87f0-d761388c6316 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:59.230275 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-75f26e90-d814-4145-87f0-d761388c6316 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:59.232020 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-75f26e90-d814-4145-87f0-d761388c6316 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:59.235580 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-75f26e90-d814-4145-87f0-d761388c6316 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:59.384962 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-75f26e90-d814-4145-87f0-d761388c6316 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e25e1f9b61a4cddaa50e2a841aa7082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de26f1b9fbbb4e31b1f4535a5a1ff512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:59.397201 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-75f26e90-d814-4145-87f0-d761388c6316 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e25e1f9b61a4cddaa50e2a841aa7082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de26f1b9fbbb4e31b1f4535a5a1ff512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:59.400082 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-75f26e90-d814-4145-87f0-d761388c6316 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e25e1f9b61a4cddaa50e2a841aa7082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de26f1b9fbbb4e31b1f4535a5a1ff512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:59.403076 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-75f26e90-d814-4145-87f0-d761388c6316 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] 10.222.0.27 "GET /compute/v2.1/servers/24a25908-e543-400e-b922-392c9604ec2e" status: 200 len: 1335 microversion: 2.54 time: 0.203306 Sep 08 10:42:59.411241 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 718/1394] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:42:59 2022] GET /compute/v2.1/servers/24a25908-e543-400e-b922-392c9604ec2e => generated 1335 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:42:59.623533 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-86f9e454-164b-4f45-b033-da522f720582 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:59.625812 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-86f9e454-164b-4f45-b033-da522f720582 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 287be913-2461-45d0-8000-360c3fdb5940] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:59.638825 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-86f9e454-164b-4f45-b033-da522f720582 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:59.642378 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-86f9e454-164b-4f45-b033-da522f720582 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:59.643532 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-86f9e454-164b-4f45-b033-da522f720582 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:59.646873 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-86f9e454-164b-4f45-b033-da522f720582 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:59.648251 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-86f9e454-164b-4f45-b033-da522f720582 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:59.649293 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-86f9e454-164b-4f45-b033-da522f720582 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:00.248801 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-86f9e454-164b-4f45-b033-da522f720582 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:00.262593 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-86f9e454-164b-4f45-b033-da522f720582 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940" status: 200 len: 1472 microversion: 2.1 time: 0.670242 Sep 08 10:43:00.280060 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 719/1395] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:59 2022] GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940 => generated 1472 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:00.466113 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-20c61fba-7f3a-4fd4-87c2-97461a0c2a3a tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:00.467846 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-20c61fba-7f3a-4fd4-87c2-97461a0c2a3a tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] [instance: 24a25908-e543-400e-b922-392c9604ec2e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:00.480689 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-20c61fba-7f3a-4fd4-87c2-97461a0c2a3a tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:00.481771 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-20c61fba-7f3a-4fd4-87c2-97461a0c2a3a tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:00.485353 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-20c61fba-7f3a-4fd4-87c2-97461a0c2a3a tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:00.486306 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-20c61fba-7f3a-4fd4-87c2-97461a0c2a3a tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:00.486903 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-20c61fba-7f3a-4fd4-87c2-97461a0c2a3a tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:00.487454 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-20c61fba-7f3a-4fd4-87c2-97461a0c2a3a tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:00.675908 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-20c61fba-7f3a-4fd4-87c2-97461a0c2a3a tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e25e1f9b61a4cddaa50e2a841aa7082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de26f1b9fbbb4e31b1f4535a5a1ff512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:00.692647 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-20c61fba-7f3a-4fd4-87c2-97461a0c2a3a tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e25e1f9b61a4cddaa50e2a841aa7082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de26f1b9fbbb4e31b1f4535a5a1ff512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:00.695216 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-20c61fba-7f3a-4fd4-87c2-97461a0c2a3a tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e25e1f9b61a4cddaa50e2a841aa7082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de26f1b9fbbb4e31b1f4535a5a1ff512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:00.697082 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-20c61fba-7f3a-4fd4-87c2-97461a0c2a3a tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] 10.222.0.27 "GET /compute/v2.1/servers/24a25908-e543-400e-b922-392c9604ec2e" status: 200 len: 1335 microversion: 2.54 time: 0.236530 Sep 08 10:43:00.698101 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 720/1396] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:43:00 2022] GET /compute/v2.1/servers/24a25908-e543-400e-b922-392c9604ec2e => generated 1335 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:43:01.248571 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7d5a0ab7-344b-4fcd-92e7-5e9b05fc70e5 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1027241003", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "c5773ac9-6cb1-4d96-9195-6fd6adb76930"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:43:04.153098 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:43:04.268234 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:43:05.213388 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:43:06.032586 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-005c4be4-3511-4cae-97d9-a8d03a5c811a tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/images/c2b844c1-5006-4cd0-a338-c22c553491a1" status: 200 len: 661 microversion: 2.1 time: 9.374403 Sep 08 10:43:06.033506 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 677/1397] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:42:56 2022] GET /compute/v2.1/images/c2b844c1-5006-4cd0-a338-c22c553491a1 => generated 661 bytes in 9380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:43:06.036043 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-7d5a0ab7-344b-4fcd-92e7-5e9b05fc70e5 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] validate_networks() for [('c5773ac9-6cb1-4d96-9195-6fd6adb76930', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:43:06.232719 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-de087d7c-93d3-4c74-9796-961ebddc2eea tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:06.233368 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-de087d7c-93d3-4c74-9796-961ebddc2eea tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 287be913-2461-45d0-8000-360c3fdb5940] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:06.239720 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=98 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:43:06.242487 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-de087d7c-93d3-4c74-9796-961ebddc2eea tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:06.243406 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-de087d7c-93d3-4c74-9796-961ebddc2eea tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:06.244213 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-de087d7c-93d3-4c74-9796-961ebddc2eea tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:06.245447 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-de087d7c-93d3-4c74-9796-961ebddc2eea tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:06.246286 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-de087d7c-93d3-4c74-9796-961ebddc2eea tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:06.247706 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-de087d7c-93d3-4c74-9796-961ebddc2eea tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:06.429987 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-de087d7c-93d3-4c74-9796-961ebddc2eea tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:06.441660 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-de087d7c-93d3-4c74-9796-961ebddc2eea tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940" status: 200 len: 1477 microversion: 2.1 time: 0.406616 Sep 08 10:43:06.453184 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 678/1398] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:06 2022] GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940 => generated 1477 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:06.458145 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1b5db662-133f-4a27-a6e1-ecca15676238 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:06.459023 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1b5db662-133f-4a27-a6e1-ecca15676238 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] [instance: 24a25908-e543-400e-b922-392c9604ec2e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:06.465799 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1b5db662-133f-4a27-a6e1-ecca15676238 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:06.466389 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1b5db662-133f-4a27-a6e1-ecca15676238 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:06.467338 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1b5db662-133f-4a27-a6e1-ecca15676238 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:06.468078 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1b5db662-133f-4a27-a6e1-ecca15676238 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:06.468539 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1b5db662-133f-4a27-a6e1-ecca15676238 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:06.469245 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1b5db662-133f-4a27-a6e1-ecca15676238 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:06.599542 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1b5db662-133f-4a27-a6e1-ecca15676238 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e25e1f9b61a4cddaa50e2a841aa7082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de26f1b9fbbb4e31b1f4535a5a1ff512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:06.611209 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1b5db662-133f-4a27-a6e1-ecca15676238 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e25e1f9b61a4cddaa50e2a841aa7082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de26f1b9fbbb4e31b1f4535a5a1ff512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:06.612663 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1b5db662-133f-4a27-a6e1-ecca15676238 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e25e1f9b61a4cddaa50e2a841aa7082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de26f1b9fbbb4e31b1f4535a5a1ff512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:06.614430 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1b5db662-133f-4a27-a6e1-ecca15676238 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] 10.222.0.27 "GET /compute/v2.1/servers/24a25908-e543-400e-b922-392c9604ec2e" status: 200 len: 1356 microversion: 2.54 time: 0.160146 Sep 08 10:43:06.615155 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 679/1399] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:43:06 2022] GET /compute/v2.1/servers/24a25908-e543-400e-b922-392c9604ec2e => generated 1356 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:43:06.620588 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7daf96e7-ed17-4216-bc52-ee4cf86778f2 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:06.621312 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7daf96e7-ed17-4216-bc52-ee4cf86778f2 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: c1406c0f-748a-4dae-9392-6957d4092c9f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:06.628968 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7daf96e7-ed17-4216-bc52-ee4cf86778f2 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:06.629567 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7daf96e7-ed17-4216-bc52-ee4cf86778f2 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:06.630010 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7daf96e7-ed17-4216-bc52-ee4cf86778f2 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:06.630725 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7daf96e7-ed17-4216-bc52-ee4cf86778f2 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:06.631373 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7daf96e7-ed17-4216-bc52-ee4cf86778f2 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:06.631970 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7daf96e7-ed17-4216-bc52-ee4cf86778f2 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:06.699438 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7daf96e7-ed17-4216-bc52-ee4cf86778f2 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: c1406c0f-748a-4dae-9392-6957d4092c9f] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:43:06.805121 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-7d5a0ab7-344b-4fcd-92e7-5e9b05fc70e5 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:43:06.805958 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-7d5a0ab7-344b-4fcd-92e7-5e9b05fc70e5 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:43:06.806913 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-7d5a0ab7-344b-4fcd-92e7-5e9b05fc70e5 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:43:06.807913 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-7d5a0ab7-344b-4fcd-92e7-5e9b05fc70e5 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:43:06.808873 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-7d5a0ab7-344b-4fcd-92e7-5e9b05fc70e5 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:43:06.818295 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:43:06.849710 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d5a0ab7-344b-4fcd-92e7-5e9b05fc70e5 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:06.850351 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d5a0ab7-344b-4fcd-92e7-5e9b05fc70e5 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:06.851244 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d5a0ab7-344b-4fcd-92e7-5e9b05fc70e5 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:06.853325 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d5a0ab7-344b-4fcd-92e7-5e9b05fc70e5 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:06.853980 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d5a0ab7-344b-4fcd-92e7-5e9b05fc70e5 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:06.854584 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d5a0ab7-344b-4fcd-92e7-5e9b05fc70e5 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:06.866375 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7daf96e7-ed17-4216-bc52-ee4cf86778f2 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c1406c0f-748a-4dae-9392-6957d4092c9f" status: 204 len: 0 microversion: 2.1 time: 0.249775 Sep 08 10:43:06.871513 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 680/1400] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:43:06 2022] DELETE /compute/v2.1/servers/c1406c0f-748a-4dae-9392-6957d4092c9f => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:43:06.878302 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8dd5e970-3651-4fe5-a391-392b44dd9225 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Action: 'create', calling method: .version_select at 0x7f68e45d0040>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1693961064", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBMBbw0CYoHLaxTYF2gDAh26Ghmg79qzJeaIFRytT+a7Sa455rtHDuL2R7UeetVBzi6YaVOZ6pKeUX8g2AXgi64I6jX+mwdvNtKhk446EMvRzVF3jyObZIIhkp8hj+wyA=="}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:43:06.884955 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-7d5a0ab7-344b-4fcd-92e7-5e9b05fc70e5 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Getting quotas for project eeeb450420314221bd2469816e2995d1. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:43:06.909245 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-7d5a0ab7-344b-4fcd-92e7-5e9b05fc70e5 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Getting quotas for user ce8c8c85354d46aeb786c8049b81e04d and project eeeb450420314221bd2469816e2995d1. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:43:06.911082 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-8dd5e970-3651-4fe5-a391-392b44dd9225 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Getting quotas for project de26f1b9fbbb4e31b1f4535a5a1ff512. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:43:06.924992 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-8dd5e970-3651-4fe5-a391-392b44dd9225 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Getting quotas for user 9e25e1f9b61a4cddaa50e2a841aa7082 and project de26f1b9fbbb4e31b1f4535a5a1ff512. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:43:06.926909 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7d5a0ab7-344b-4fcd-92e7-5e9b05fc70e5 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:43:06.930384 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7d5a0ab7-344b-4fcd-92e7-5e9b05fc70e5 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 5a9072eb-573f-4576-b922-57245258445e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:43:06.967980 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8dd5e970-3651-4fe5-a391-392b44dd9225 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.094580 Sep 08 10:43:06.978096 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 681/1401] 10.222.0.27 () {62 vars in 1200 bytes} [Thu Sep 8 10:43:06 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 97 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 08 10:43:06.978096 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-80dd355b-cb97-45d8-a685-8f054b79342a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:06.978096 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-80dd355b-cb97-45d8-a685-8f054b79342a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: c1406c0f-748a-4dae-9392-6957d4092c9f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:06.989449 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-80dd355b-cb97-45d8-a685-8f054b79342a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:06.990082 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-80dd355b-cb97-45d8-a685-8f054b79342a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:06.994034 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-80dd355b-cb97-45d8-a685-8f054b79342a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:06.995093 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-80dd355b-cb97-45d8-a685-8f054b79342a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:06.995662 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-80dd355b-cb97-45d8-a685-8f054b79342a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:06.996123 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-80dd355b-cb97-45d8-a685-8f054b79342a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:07.002326 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7d5a0ab7-344b-4fcd-92e7-5e9b05fc70e5 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.894422 Sep 08 10:43:07.003898 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 721/1402] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:43:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 5897 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 10:43:07.010058 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-28d8881b-ed71-4bda-8a59-b1a291408618 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1693961064", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:43:07.013858 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-28d8881b-ed71-4bda-8a59-b1a291408618 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] [instance: 24a25908-e543-400e-b922-392c9604ec2e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:07.021094 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28d8881b-ed71-4bda-8a59-b1a291408618 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:07.021944 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28d8881b-ed71-4bda-8a59-b1a291408618 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:07.022600 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28d8881b-ed71-4bda-8a59-b1a291408618 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:07.023873 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28d8881b-ed71-4bda-8a59-b1a291408618 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:07.024585 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28d8881b-ed71-4bda-8a59-b1a291408618 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:07.025252 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28d8881b-ed71-4bda-8a59-b1a291408618 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:07.179197 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-28d8881b-ed71-4bda-8a59-b1a291408618 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:43:07.192402 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-28d8881b-ed71-4bda-8a59-b1a291408618 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:43:07.193817 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-28d8881b-ed71-4bda-8a59-b1a291408618 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:43:07.195384 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-28d8881b-ed71-4bda-8a59-b1a291408618 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:43:07.197511 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-28d8881b-ed71-4bda-8a59-b1a291408618 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:43:07.224703 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-80dd355b-cb97-45d8-a685-8f054b79342a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:07.241301 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-80dd355b-cb97-45d8-a685-8f054b79342a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/c1406c0f-748a-4dae-9392-6957d4092c9f" status: 200 len: 1552 microversion: 2.1 time: 0.269656 Sep 08 10:43:07.257922 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 682/1403] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:06 2022] GET /compute/v2.1/servers/c1406c0f-748a-4dae-9392-6957d4092c9f => generated 1552 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:07.264953 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-62ea9997-00d0-4175-bd3f-83163b49207a tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:07.265940 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-62ea9997-00d0-4175-bd3f-83163b49207a tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 5a9072eb-573f-4576-b922-57245258445e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:07.336864 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-62ea9997-00d0-4175-bd3f-83163b49207a tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:07.347317 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-62ea9997-00d0-4175-bd3f-83163b49207a tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9072eb-573f-4576-b922-57245258445e" status: 200 len: 1208 microversion: 2.1 time: 0.087927 Sep 08 10:43:07.347740 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 683/1404] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:07 2022] GET /compute/v2.1/servers/5a9072eb-573f-4576-b922-57245258445e => generated 1208 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:07.356935 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-28d8881b-ed71-4bda-8a59-b1a291408618 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] [instance: 24a25908-e543-400e-b922-392c9604ec2e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:07.366784 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28d8881b-ed71-4bda-8a59-b1a291408618 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:07.373701 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28d8881b-ed71-4bda-8a59-b1a291408618 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:07.373701 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28d8881b-ed71-4bda-8a59-b1a291408618 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:07.373701 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28d8881b-ed71-4bda-8a59-b1a291408618 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:07.373701 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28d8881b-ed71-4bda-8a59-b1a291408618 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:07.373701 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28d8881b-ed71-4bda-8a59-b1a291408618 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:07.429281 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-28d8881b-ed71-4bda-8a59-b1a291408618 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] 10.222.0.27 "POST /compute/v2.1/servers/24a25908-e543-400e-b922-392c9604ec2e/action" status: 202 len: 1139 microversion: 2.54 time: 0.423920 Sep 08 10:43:07.429966 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 722/1405] 10.222.0.27 () {62 vars in 1320 bytes} [Thu Sep 8 10:43:07 2022] POST /compute/v2.1/servers/24a25908-e543-400e-b922-392c9604ec2e/action => generated 1139 bytes in 425 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 08 10:43:07.456291 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bc63cf00-22eb-43ae-80c2-93a09107f889 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:07.457449 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bc63cf00-22eb-43ae-80c2-93a09107f889 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] [instance: 24a25908-e543-400e-b922-392c9604ec2e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:07.468509 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-94b20b9a-8c13-431c-8c0e-0b8fa8b1e08f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:07.469176 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-94b20b9a-8c13-431c-8c0e-0b8fa8b1e08f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 287be913-2461-45d0-8000-360c3fdb5940] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:07.473334 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bc63cf00-22eb-43ae-80c2-93a09107f889 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:07.474645 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bc63cf00-22eb-43ae-80c2-93a09107f889 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:07.478602 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bc63cf00-22eb-43ae-80c2-93a09107f889 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:07.480198 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bc63cf00-22eb-43ae-80c2-93a09107f889 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:07.482007 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bc63cf00-22eb-43ae-80c2-93a09107f889 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:07.483149 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94b20b9a-8c13-431c-8c0e-0b8fa8b1e08f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:07.483655 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94b20b9a-8c13-431c-8c0e-0b8fa8b1e08f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:07.484457 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94b20b9a-8c13-431c-8c0e-0b8fa8b1e08f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:07.484936 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bc63cf00-22eb-43ae-80c2-93a09107f889 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:07.485569 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94b20b9a-8c13-431c-8c0e-0b8fa8b1e08f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:07.486197 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94b20b9a-8c13-431c-8c0e-0b8fa8b1e08f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:07.488374 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94b20b9a-8c13-431c-8c0e-0b8fa8b1e08f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:07.650331 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-bc63cf00-22eb-43ae-80c2-93a09107f889 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e25e1f9b61a4cddaa50e2a841aa7082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de26f1b9fbbb4e31b1f4535a5a1ff512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:07.670584 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-bc63cf00-22eb-43ae-80c2-93a09107f889 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e25e1f9b61a4cddaa50e2a841aa7082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de26f1b9fbbb4e31b1f4535a5a1ff512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:07.672349 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-bc63cf00-22eb-43ae-80c2-93a09107f889 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e25e1f9b61a4cddaa50e2a841aa7082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de26f1b9fbbb4e31b1f4535a5a1ff512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:07.676991 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bc63cf00-22eb-43ae-80c2-93a09107f889 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] 10.222.0.27 "GET /compute/v2.1/servers/24a25908-e543-400e-b922-392c9604ec2e" status: 200 len: 1408 microversion: 2.54 time: 0.224553 Sep 08 10:43:07.696263 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 684/1406] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:43:07 2022] GET /compute/v2.1/servers/24a25908-e543-400e-b922-392c9604ec2e => generated 1408 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:43:07.791993 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-94b20b9a-8c13-431c-8c0e-0b8fa8b1e08f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:07.816480 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-94b20b9a-8c13-431c-8c0e-0b8fa8b1e08f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940" status: 200 len: 1477 microversion: 2.1 time: 0.350451 Sep 08 10:43:07.824295 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 723/1407] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:07 2022] GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940 => generated 1477 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:07.867951 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8c704516-e83d-459f-8855-0babd2e8b9d5 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '.version_select at 0x7f68e461f700>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:07.940676 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8c704516-e83d-459f-8855-0babd2e8b9d5 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/images/ed56d622-7fec-4a54-9346-fb3684f044f6" status: 200 len: 661 microversion: 2.1 time: 0.077899 Sep 08 10:43:07.945544 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 685/1408] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:43:07 2022] GET /compute/v2.1/images/ed56d622-7fec-4a54-9346-fb3684f044f6 => generated 661 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:43:07.962889 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-915a2258-fa95-4288-8925-20b07e0958a8 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '.version_select at 0x7f68e45125e0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:08.021584 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-915a2258-fa95-4288-8925-20b07e0958a8 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/images/ed56d622-7fec-4a54-9346-fb3684f044f6" status: 200 len: 661 microversion: 2.1 time: 0.064647 Sep 08 10:43:08.022512 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 724/1409] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:43:07 2022] GET /compute/v2.1/images/ed56d622-7fec-4a54-9346-fb3684f044f6 => generated 661 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:43:08.190905 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c21f57b6-8f78-4a59-ad96-2869dc873481 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-858129717", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:43:08.271339 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a4993e61-f631-473c-9167-039049a72d78 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:08.272656 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a4993e61-f631-473c-9167-039049a72d78 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: c1406c0f-748a-4dae-9392-6957d4092c9f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:08.280305 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a4993e61-f631-473c-9167-039049a72d78 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:08.280821 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a4993e61-f631-473c-9167-039049a72d78 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:08.281293 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a4993e61-f631-473c-9167-039049a72d78 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:08.282864 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a4993e61-f631-473c-9167-039049a72d78 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:08.283523 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a4993e61-f631-473c-9167-039049a72d78 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:08.284365 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a4993e61-f631-473c-9167-039049a72d78 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:08.292506 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-c21f57b6-8f78-4a59-ad96-2869dc873481 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] validate_networks() for None {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:43:08.582172 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a4993e61-f631-473c-9167-039049a72d78 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:08.593659 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a4993e61-f631-473c-9167-039049a72d78 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/c1406c0f-748a-4dae-9392-6957d4092c9f" status: 200 len: 1552 microversion: 2.1 time: 0.327218 Sep 08 10:43:08.594250 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 725/1410] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:08 2022] GET /compute/v2.1/servers/c1406c0f-748a-4dae-9392-6957d4092c9f => generated 1552 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:43:08.618346 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dcd00049-4813-433a-88c2-450f5d38a37f tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:08.619261 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-dcd00049-4813-433a-88c2-450f5d38a37f tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 5a9072eb-573f-4576-b922-57245258445e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:08.628575 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dcd00049-4813-433a-88c2-450f5d38a37f tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:08.629390 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dcd00049-4813-433a-88c2-450f5d38a37f tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:08.629987 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dcd00049-4813-433a-88c2-450f5d38a37f tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:08.630920 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dcd00049-4813-433a-88c2-450f5d38a37f tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:08.631566 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dcd00049-4813-433a-88c2-450f5d38a37f tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:08.632182 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dcd00049-4813-433a-88c2-450f5d38a37f tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:08.640811 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-c21f57b6-8f78-4a59-ad96-2869dc873481 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:43:08.642005 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-c21f57b6-8f78-4a59-ad96-2869dc873481 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:43:08.642777 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-c21f57b6-8f78-4a59-ad96-2869dc873481 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:43:08.643426 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-c21f57b6-8f78-4a59-ad96-2869dc873481 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:43:08.644133 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-c21f57b6-8f78-4a59-ad96-2869dc873481 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:43:08.656991 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c21f57b6-8f78-4a59-ad96-2869dc873481 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:08.657640 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c21f57b6-8f78-4a59-ad96-2869dc873481 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:08.658147 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c21f57b6-8f78-4a59-ad96-2869dc873481 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:08.658968 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c21f57b6-8f78-4a59-ad96-2869dc873481 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:08.659491 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c21f57b6-8f78-4a59-ad96-2869dc873481 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:08.660118 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c21f57b6-8f78-4a59-ad96-2869dc873481 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:08.700166 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-c21f57b6-8f78-4a59-ad96-2869dc873481 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Getting quotas for project 2604588959944720923ec2d5e0bf81c0. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:43:08.707509 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-c21f57b6-8f78-4a59-ad96-2869dc873481 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Getting quotas for user ff7415a5b46c4587a8806661b70e3913 and project 2604588959944720923ec2d5e0bf81c0. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:43:08.743738 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c21f57b6-8f78-4a59-ad96-2869dc873481 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:43:08.746879 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c21f57b6-8f78-4a59-ad96-2869dc873481 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] [instance: 3e6be670-294f-417f-a909-57c481faaf40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:43:08.803816 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-dcd00049-4813-433a-88c2-450f5d38a37f tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:08.815636 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-dcd00049-4813-433a-88c2-450f5d38a37f tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9072eb-573f-4576-b922-57245258445e" status: 200 len: 1260 microversion: 2.1 time: 0.220283 Sep 08 10:43:08.816624 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 726/1411] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:08 2022] GET /compute/v2.1/servers/5a9072eb-573f-4576-b922-57245258445e => generated 1260 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:08.823231 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0aaa4959-13be-43fc-9b72-7b7ef4762ff2 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:08.825519 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0aaa4959-13be-43fc-9b72-7b7ef4762ff2 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] [instance: 24a25908-e543-400e-b922-392c9604ec2e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:08.831118 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c21f57b6-8f78-4a59-ad96-2869dc873481 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.645862 Sep 08 10:43:08.834532 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0aaa4959-13be-43fc-9b72-7b7ef4762ff2 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:08.835644 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0aaa4959-13be-43fc-9b72-7b7ef4762ff2 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:08.836516 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0aaa4959-13be-43fc-9b72-7b7ef4762ff2 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:08.840374 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0aaa4959-13be-43fc-9b72-7b7ef4762ff2 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:08.843394 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0aaa4959-13be-43fc-9b72-7b7ef4762ff2 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:08.844292 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0aaa4959-13be-43fc-9b72-7b7ef4762ff2 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:08.855813 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 686/1412] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:43:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 671 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 10:43:08.876415 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-852177ab-d81b-43b7-84aa-2af00c72dee9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:08.877192 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-852177ab-d81b-43b7-84aa-2af00c72dee9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 287be913-2461-45d0-8000-360c3fdb5940] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:08.902999 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-852177ab-d81b-43b7-84aa-2af00c72dee9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:08.904899 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-852177ab-d81b-43b7-84aa-2af00c72dee9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:08.908177 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-852177ab-d81b-43b7-84aa-2af00c72dee9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:08.910051 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-852177ab-d81b-43b7-84aa-2af00c72dee9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:08.910783 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-852177ab-d81b-43b7-84aa-2af00c72dee9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:08.911480 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-852177ab-d81b-43b7-84aa-2af00c72dee9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:09.010540 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0aaa4959-13be-43fc-9b72-7b7ef4762ff2 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e25e1f9b61a4cddaa50e2a841aa7082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de26f1b9fbbb4e31b1f4535a5a1ff512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:09.024146 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0aaa4959-13be-43fc-9b72-7b7ef4762ff2 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e25e1f9b61a4cddaa50e2a841aa7082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de26f1b9fbbb4e31b1f4535a5a1ff512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:09.026321 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0aaa4959-13be-43fc-9b72-7b7ef4762ff2 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e25e1f9b61a4cddaa50e2a841aa7082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de26f1b9fbbb4e31b1f4535a5a1ff512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:09.028091 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0aaa4959-13be-43fc-9b72-7b7ef4762ff2 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] 10.222.0.27 "GET /compute/v2.1/servers/24a25908-e543-400e-b922-392c9604ec2e" status: 200 len: 1408 microversion: 2.54 time: 0.210382 Sep 08 10:43:09.042749 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 727/1413] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:43:08 2022] GET /compute/v2.1/servers/24a25908-e543-400e-b922-392c9604ec2e => generated 1408 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:43:09.067207 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f34c9367-6a64-4f59-a157-f33042db190a tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-355668694", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:43:09.192879 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-f34c9367-6a64-4f59-a157-f33042db190a tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] validate_networks() for None {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:43:09.584990 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-852177ab-d81b-43b7-84aa-2af00c72dee9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:09.594910 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-852177ab-d81b-43b7-84aa-2af00c72dee9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940" status: 200 len: 1477 microversion: 2.1 time: 0.736423 Sep 08 10:43:09.595496 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 687/1414] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:08 2022] GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940 => generated 1477 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:09.624458 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cbac9bc4-1ab1-46ae-9a39-597271a9eed4 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:09.625483 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cbac9bc4-1ab1-46ae-9a39-597271a9eed4 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: c1406c0f-748a-4dae-9392-6957d4092c9f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:09.649421 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cbac9bc4-1ab1-46ae-9a39-597271a9eed4 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:09.650230 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cbac9bc4-1ab1-46ae-9a39-597271a9eed4 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:09.651061 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cbac9bc4-1ab1-46ae-9a39-597271a9eed4 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:09.653981 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cbac9bc4-1ab1-46ae-9a39-597271a9eed4 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:09.655276 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cbac9bc4-1ab1-46ae-9a39-597271a9eed4 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:09.659325 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cbac9bc4-1ab1-46ae-9a39-597271a9eed4 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:09.851123 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-f34c9367-6a64-4f59-a157-f33042db190a tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:43:09.854850 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-f34c9367-6a64-4f59-a157-f33042db190a tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:43:09.855570 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-f34c9367-6a64-4f59-a157-f33042db190a tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:43:09.855988 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-f34c9367-6a64-4f59-a157-f33042db190a tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:43:09.864162 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-f34c9367-6a64-4f59-a157-f33042db190a tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:43:09.878222 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f34c9367-6a64-4f59-a157-f33042db190a tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:09.879061 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f34c9367-6a64-4f59-a157-f33042db190a tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:09.880311 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f34c9367-6a64-4f59-a157-f33042db190a tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:09.882187 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f34c9367-6a64-4f59-a157-f33042db190a tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:09.884266 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f34c9367-6a64-4f59-a157-f33042db190a tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:09.889053 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f34c9367-6a64-4f59-a157-f33042db190a tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:09.933253 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-f34c9367-6a64-4f59-a157-f33042db190a tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Getting quotas for project 2604588959944720923ec2d5e0bf81c0. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:43:09.949243 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-f34c9367-6a64-4f59-a157-f33042db190a tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Getting quotas for user ff7415a5b46c4587a8806661b70e3913 and project 2604588959944720923ec2d5e0bf81c0. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:43:09.982468 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f34c9367-6a64-4f59-a157-f33042db190a tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:43:09.985105 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f34c9367-6a64-4f59-a157-f33042db190a tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] [instance: dac27157-b08e-4f13-b97e-3c5b653bd0b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:43:10.099474 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-cbac9bc4-1ab1-46ae-9a39-597271a9eed4 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:10.111504 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cbac9bc4-1ab1-46ae-9a39-597271a9eed4 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/c1406c0f-748a-4dae-9392-6957d4092c9f" status: 200 len: 1552 microversion: 2.1 time: 0.495196 Sep 08 10:43:10.129146 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 688/1415] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:09 2022] GET /compute/v2.1/servers/c1406c0f-748a-4dae-9392-6957d4092c9f => generated 1552 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:10.133062 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f34c9367-6a64-4f59-a157-f33042db190a tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.088392 Sep 08 10:43:10.134997 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 728/1416] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:43:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1091 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:43:10.142641 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f106f614-eb53-4384-bafb-2eb44d256429 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:10.143535 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f106f614-eb53-4384-bafb-2eb44d256429 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 5a9072eb-573f-4576-b922-57245258445e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:10.146633 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e1915ce1-9cae-4aac-b507-5c0f3f6d90b1 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:10.147594 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e1915ce1-9cae-4aac-b507-5c0f3f6d90b1 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] [instance: 24a25908-e543-400e-b922-392c9604ec2e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:10.157631 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f106f614-eb53-4384-bafb-2eb44d256429 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:10.158304 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f106f614-eb53-4384-bafb-2eb44d256429 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:10.159191 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f106f614-eb53-4384-bafb-2eb44d256429 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:10.162103 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f106f614-eb53-4384-bafb-2eb44d256429 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:10.163930 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f106f614-eb53-4384-bafb-2eb44d256429 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:10.164374 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f106f614-eb53-4384-bafb-2eb44d256429 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:10.166488 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e1915ce1-9cae-4aac-b507-5c0f3f6d90b1 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:10.167209 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e1915ce1-9cae-4aac-b507-5c0f3f6d90b1 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:10.168364 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e1915ce1-9cae-4aac-b507-5c0f3f6d90b1 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:10.169440 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e1915ce1-9cae-4aac-b507-5c0f3f6d90b1 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:10.173071 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e1915ce1-9cae-4aac-b507-5c0f3f6d90b1 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:10.174030 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e1915ce1-9cae-4aac-b507-5c0f3f6d90b1 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:10.357379 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f106f614-eb53-4384-bafb-2eb44d256429 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:10.371749 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f106f614-eb53-4384-bafb-2eb44d256429 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9072eb-573f-4576-b922-57245258445e" status: 200 len: 1266 microversion: 2.1 time: 0.238465 Sep 08 10:43:10.374725 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 689/1417] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:10 2022] GET /compute/v2.1/servers/5a9072eb-573f-4576-b922-57245258445e => generated 1266 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:10.399361 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-8cdcef96-06aa-49f0-a7fc-126812b54b51 req-dcf2dda4-f19a-48c1-b1ee-9ecda15d286c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1406c0f-748a-4dae-9392-6957d4092c9f", "name": "network-vif-deleted", "tag": "0f2423be-1d9a-4a47-aa8c-b141dd346374"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:43:10.442351 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e1915ce1-9cae-4aac-b507-5c0f3f6d90b1 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e25e1f9b61a4cddaa50e2a841aa7082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de26f1b9fbbb4e31b1f4535a5a1ff512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:10.455287 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-8cdcef96-06aa-49f0-a7fc-126812b54b51 req-dcf2dda4-f19a-48c1-b1ee-9ecda15d286c service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:10.462152 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e1915ce1-9cae-4aac-b507-5c0f3f6d90b1 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e25e1f9b61a4cddaa50e2a841aa7082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de26f1b9fbbb4e31b1f4535a5a1ff512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:10.463176 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-8cdcef96-06aa-49f0-a7fc-126812b54b51 req-dcf2dda4-f19a-48c1-b1ee-9ecda15d286c service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:10.466796 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-8cdcef96-06aa-49f0-a7fc-126812b54b51 req-dcf2dda4-f19a-48c1-b1ee-9ecda15d286c service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:10.479783 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e1915ce1-9cae-4aac-b507-5c0f3f6d90b1 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e25e1f9b61a4cddaa50e2a841aa7082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de26f1b9fbbb4e31b1f4535a5a1ff512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:10.487574 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e1915ce1-9cae-4aac-b507-5c0f3f6d90b1 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] 10.222.0.27 "GET /compute/v2.1/servers/24a25908-e543-400e-b922-392c9604ec2e" status: 200 len: 1408 microversion: 2.54 time: 0.350276 Sep 08 10:43:10.502034 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 729/1418] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:43:10 2022] GET /compute/v2.1/servers/24a25908-e543-400e-b922-392c9604ec2e => generated 1408 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:43:10.530038 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d44e283a-6e22-4362-9942-37e46665e95a tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:10.530688 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d44e283a-6e22-4362-9942-37e46665e95a tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] [instance: dac27157-b08e-4f13-b97e-3c5b653bd0b3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:10.537408 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-8cdcef96-06aa-49f0-a7fc-126812b54b51 req-dcf2dda4-f19a-48c1-b1ee-9ecda15d286c service nova] Creating event network-vif-deleted:0f2423be-1d9a-4a47-aa8c-b141dd346374 for instance c1406c0f-748a-4dae-9392-6957d4092c9f on n-h2-850501-12 Sep 08 10:43:10.549448 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-8cdcef96-06aa-49f0-a7fc-126812b54b51 req-dcf2dda4-f19a-48c1-b1ee-9ecda15d286c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171973 Sep 08 10:43:10.552341 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 690/1419] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:43:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:43:10.633015 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cb41e9ca-b504-4d83-9d14-4e8319af1f2f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:10.637146 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cb41e9ca-b504-4d83-9d14-4e8319af1f2f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 287be913-2461-45d0-8000-360c3fdb5940] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:10.653371 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb41e9ca-b504-4d83-9d14-4e8319af1f2f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:10.655541 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb41e9ca-b504-4d83-9d14-4e8319af1f2f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:10.657134 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb41e9ca-b504-4d83-9d14-4e8319af1f2f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:10.658734 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb41e9ca-b504-4d83-9d14-4e8319af1f2f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:10.660035 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb41e9ca-b504-4d83-9d14-4e8319af1f2f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:10.662356 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb41e9ca-b504-4d83-9d14-4e8319af1f2f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:10.671498 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d44e283a-6e22-4362-9942-37e46665e95a tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7415a5b46c4587a8806661b70e3913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604588959944720923ec2d5e0bf81c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:10.682937 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d44e283a-6e22-4362-9942-37e46665e95a tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/servers/dac27157-b08e-4f13-b97e-3c5b653bd0b3" status: 200 len: 1217 microversion: 2.1 time: 0.178066 Sep 08 10:43:10.683528 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 730/1420] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:10 2022] GET /compute/v2.1/servers/dac27157-b08e-4f13-b97e-3c5b653bd0b3 => generated 1217 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:11.085517 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-cb41e9ca-b504-4d83-9d14-4e8319af1f2f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:11.094594 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cb41e9ca-b504-4d83-9d14-4e8319af1f2f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940" status: 200 len: 1477 microversion: 2.1 time: 0.473715 Sep 08 10:43:11.097396 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 691/1421] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:10 2022] GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940 => generated 1477 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:11.138373 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ad7dfb20-16a0-47c7-baba-76a282cd8332 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:11.139240 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ad7dfb20-16a0-47c7-baba-76a282cd8332 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: c1406c0f-748a-4dae-9392-6957d4092c9f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:11.155677 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad7dfb20-16a0-47c7-baba-76a282cd8332 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:11.156560 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad7dfb20-16a0-47c7-baba-76a282cd8332 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:11.158934 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad7dfb20-16a0-47c7-baba-76a282cd8332 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:11.159832 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad7dfb20-16a0-47c7-baba-76a282cd8332 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:11.161872 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad7dfb20-16a0-47c7-baba-76a282cd8332 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:11.162577 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad7dfb20-16a0-47c7-baba-76a282cd8332 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:11.355723 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ad7dfb20-16a0-47c7-baba-76a282cd8332 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:11.393762 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ad7dfb20-16a0-47c7-baba-76a282cd8332 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/c1406c0f-748a-4dae-9392-6957d4092c9f" status: 200 len: 1345 microversion: 2.1 time: 0.262444 Sep 08 10:43:11.400427 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b7b715de-aad9-44ed-b3c1-cb9899b866bd tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:11.401426 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b7b715de-aad9-44ed-b3c1-cb9899b866bd tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 5a9072eb-573f-4576-b922-57245258445e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:11.432052 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 731/1422] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:11 2022] GET /compute/v2.1/servers/c1406c0f-748a-4dae-9392-6957d4092c9f => generated 1345 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:11.440906 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b7b715de-aad9-44ed-b3c1-cb9899b866bd tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:11.450739 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b7b715de-aad9-44ed-b3c1-cb9899b866bd tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:11.451823 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b7b715de-aad9-44ed-b3c1-cb9899b866bd tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:11.454420 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b7b715de-aad9-44ed-b3c1-cb9899b866bd tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:11.458514 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b7b715de-aad9-44ed-b3c1-cb9899b866bd tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:11.465564 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b7b715de-aad9-44ed-b3c1-cb9899b866bd tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:11.548566 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-57036f57-a6e6-4b82-85af-cd120ff31e82 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:11.550970 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-57036f57-a6e6-4b82-85af-cd120ff31e82 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] [instance: 24a25908-e543-400e-b922-392c9604ec2e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:11.599136 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-57036f57-a6e6-4b82-85af-cd120ff31e82 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:11.602191 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-57036f57-a6e6-4b82-85af-cd120ff31e82 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:11.610556 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-57036f57-a6e6-4b82-85af-cd120ff31e82 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:11.613128 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-57036f57-a6e6-4b82-85af-cd120ff31e82 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:11.629601 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-57036f57-a6e6-4b82-85af-cd120ff31e82 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:11.630564 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-57036f57-a6e6-4b82-85af-cd120ff31e82 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:11.976054 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-57036f57-a6e6-4b82-85af-cd120ff31e82 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e25e1f9b61a4cddaa50e2a841aa7082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de26f1b9fbbb4e31b1f4535a5a1ff512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:11.993592 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-57036f57-a6e6-4b82-85af-cd120ff31e82 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e25e1f9b61a4cddaa50e2a841aa7082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de26f1b9fbbb4e31b1f4535a5a1ff512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:12.002602 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b7b715de-aad9-44ed-b3c1-cb9899b866bd tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:12.004563 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-57036f57-a6e6-4b82-85af-cd120ff31e82 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e25e1f9b61a4cddaa50e2a841aa7082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de26f1b9fbbb4e31b1f4535a5a1ff512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:12.011334 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-57036f57-a6e6-4b82-85af-cd120ff31e82 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] 10.222.0.27 "GET /compute/v2.1/servers/24a25908-e543-400e-b922-392c9604ec2e" status: 200 len: 1408 microversion: 2.54 time: 0.490227 Sep 08 10:43:12.033989 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 732/1423] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:43:11 2022] GET /compute/v2.1/servers/24a25908-e543-400e-b922-392c9604ec2e => generated 1408 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:43:12.042950 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6364883b-d92f-42bd-a1a4-ea74ecc1fd5b tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:12.045643 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6364883b-d92f-42bd-a1a4-ea74ecc1fd5b tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] [instance: dac27157-b08e-4f13-b97e-3c5b653bd0b3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:12.054039 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b7b715de-aad9-44ed-b3c1-cb9899b866bd tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9072eb-573f-4576-b922-57245258445e" status: 200 len: 1308 microversion: 2.1 time: 0.655903 Sep 08 10:43:12.055007 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 692/1424] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:11 2022] GET /compute/v2.1/servers/5a9072eb-573f-4576-b922-57245258445e => generated 1308 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:43:12.055778 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6364883b-d92f-42bd-a1a4-ea74ecc1fd5b tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:12.056547 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6364883b-d92f-42bd-a1a4-ea74ecc1fd5b tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:12.057322 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6364883b-d92f-42bd-a1a4-ea74ecc1fd5b tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:12.058305 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6364883b-d92f-42bd-a1a4-ea74ecc1fd5b tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:12.058997 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6364883b-d92f-42bd-a1a4-ea74ecc1fd5b tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:12.060189 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6364883b-d92f-42bd-a1a4-ea74ecc1fd5b tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:12.141192 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a6ec2afd-bb0d-414c-8ad6-ccf0e6a05fd9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:12.144323 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a6ec2afd-bb0d-414c-8ad6-ccf0e6a05fd9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 287be913-2461-45d0-8000-360c3fdb5940] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:12.158269 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a6ec2afd-bb0d-414c-8ad6-ccf0e6a05fd9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:12.159132 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a6ec2afd-bb0d-414c-8ad6-ccf0e6a05fd9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:12.159863 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a6ec2afd-bb0d-414c-8ad6-ccf0e6a05fd9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:12.160869 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a6ec2afd-bb0d-414c-8ad6-ccf0e6a05fd9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:12.161565 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a6ec2afd-bb0d-414c-8ad6-ccf0e6a05fd9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:12.162618 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a6ec2afd-bb0d-414c-8ad6-ccf0e6a05fd9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:12.322903 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6364883b-d92f-42bd-a1a4-ea74ecc1fd5b tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7415a5b46c4587a8806661b70e3913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604588959944720923ec2d5e0bf81c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:12.345596 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6364883b-d92f-42bd-a1a4-ea74ecc1fd5b tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/servers/dac27157-b08e-4f13-b97e-3c5b653bd0b3" status: 200 len: 1269 microversion: 2.1 time: 0.308610 Sep 08 10:43:12.347220 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 733/1425] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:12 2022] GET /compute/v2.1/servers/dac27157-b08e-4f13-b97e-3c5b653bd0b3 => generated 1269 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:12.448252 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f09fc52b-f089-47c3-8371-2aece8f9c50b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:12.449825 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f09fc52b-f089-47c3-8371-2aece8f9c50b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: c1406c0f-748a-4dae-9392-6957d4092c9f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:12.474038 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f09fc52b-f089-47c3-8371-2aece8f9c50b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:12.475180 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f09fc52b-f089-47c3-8371-2aece8f9c50b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:12.475866 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f09fc52b-f089-47c3-8371-2aece8f9c50b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:12.484057 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f09fc52b-f089-47c3-8371-2aece8f9c50b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:12.485500 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f09fc52b-f089-47c3-8371-2aece8f9c50b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:12.491119 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f09fc52b-f089-47c3-8371-2aece8f9c50b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:12.538375 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a6ec2afd-bb0d-414c-8ad6-ccf0e6a05fd9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:12.548815 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:43:12.554243 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a6ec2afd-bb0d-414c-8ad6-ccf0e6a05fd9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940" status: 200 len: 1477 microversion: 2.1 time: 0.422400 Sep 08 10:43:12.556121 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 693/1426] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:12 2022] GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940 => generated 1477 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:12.845365 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f09fc52b-f089-47c3-8371-2aece8f9c50b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:12.857719 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f09fc52b-f089-47c3-8371-2aece8f9c50b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/c1406c0f-748a-4dae-9392-6957d4092c9f" status: 200 len: 1345 microversion: 2.1 time: 0.414014 Sep 08 10:43:12.873061 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 734/1427] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:12 2022] GET /compute/v2.1/servers/c1406c0f-748a-4dae-9392-6957d4092c9f => generated 1345 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:43:13.040014 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0873efc5-fe6f-45a8-8ae4-e65c70440114 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:13.041641 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0873efc5-fe6f-45a8-8ae4-e65c70440114 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] [instance: 24a25908-e543-400e-b922-392c9604ec2e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:13.052717 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0873efc5-fe6f-45a8-8ae4-e65c70440114 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:13.056553 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0873efc5-fe6f-45a8-8ae4-e65c70440114 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:13.058193 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0873efc5-fe6f-45a8-8ae4-e65c70440114 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:13.059314 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0873efc5-fe6f-45a8-8ae4-e65c70440114 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:13.060776 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0873efc5-fe6f-45a8-8ae4-e65c70440114 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:13.061543 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0873efc5-fe6f-45a8-8ae4-e65c70440114 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:13.082611 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:43:13.093146 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ad062a87-826f-457d-ac72-b45bde884789 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:13.103093 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ad062a87-826f-457d-ac72-b45bde884789 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 5a9072eb-573f-4576-b922-57245258445e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:13.113905 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad062a87-826f-457d-ac72-b45bde884789 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:13.115403 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad062a87-826f-457d-ac72-b45bde884789 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:13.116645 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad062a87-826f-457d-ac72-b45bde884789 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:13.119416 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad062a87-826f-457d-ac72-b45bde884789 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:13.121237 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad062a87-826f-457d-ac72-b45bde884789 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:13.122893 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad062a87-826f-457d-ac72-b45bde884789 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:13.271699 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0873efc5-fe6f-45a8-8ae4-e65c70440114 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e25e1f9b61a4cddaa50e2a841aa7082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de26f1b9fbbb4e31b1f4535a5a1ff512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:13.287151 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0873efc5-fe6f-45a8-8ae4-e65c70440114 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e25e1f9b61a4cddaa50e2a841aa7082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de26f1b9fbbb4e31b1f4535a5a1ff512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:13.289370 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0873efc5-fe6f-45a8-8ae4-e65c70440114 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e25e1f9b61a4cddaa50e2a841aa7082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de26f1b9fbbb4e31b1f4535a5a1ff512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:13.291601 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0873efc5-fe6f-45a8-8ae4-e65c70440114 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] 10.222.0.27 "GET /compute/v2.1/servers/24a25908-e543-400e-b922-392c9604ec2e" status: 200 len: 1408 microversion: 2.54 time: 0.255440 Sep 08 10:43:13.301586 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 694/1428] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:43:13 2022] GET /compute/v2.1/servers/24a25908-e543-400e-b922-392c9604ec2e => generated 1408 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:43:13.385581 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-93b4fdde-07fd-4106-a1ff-06fffa87ab7f tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:13.387034 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-93b4fdde-07fd-4106-a1ff-06fffa87ab7f tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] [instance: dac27157-b08e-4f13-b97e-3c5b653bd0b3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:13.415396 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-93b4fdde-07fd-4106-a1ff-06fffa87ab7f tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:13.416998 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-93b4fdde-07fd-4106-a1ff-06fffa87ab7f tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:13.417688 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-93b4fdde-07fd-4106-a1ff-06fffa87ab7f tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:13.419954 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-93b4fdde-07fd-4106-a1ff-06fffa87ab7f tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:13.420701 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-93b4fdde-07fd-4106-a1ff-06fffa87ab7f tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:13.421326 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-93b4fdde-07fd-4106-a1ff-06fffa87ab7f tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:13.525777 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-93b4fdde-07fd-4106-a1ff-06fffa87ab7f tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7415a5b46c4587a8806661b70e3913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604588959944720923ec2d5e0bf81c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:13.536576 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-93b4fdde-07fd-4106-a1ff-06fffa87ab7f tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/servers/dac27157-b08e-4f13-b97e-3c5b653bd0b3" status: 200 len: 1275 microversion: 2.1 time: 0.159147 Sep 08 10:43:13.538149 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 695/1429] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:13 2022] GET /compute/v2.1/servers/dac27157-b08e-4f13-b97e-3c5b653bd0b3 => generated 1275 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:13.583264 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0c96804a-72f3-41b3-8e80-198d9152396b tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:13.584796 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0c96804a-72f3-41b3-8e80-198d9152396b tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 287be913-2461-45d0-8000-360c3fdb5940] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:13.606691 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0c96804a-72f3-41b3-8e80-198d9152396b tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:13.607823 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0c96804a-72f3-41b3-8e80-198d9152396b tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:13.608519 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0c96804a-72f3-41b3-8e80-198d9152396b tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:13.612709 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0c96804a-72f3-41b3-8e80-198d9152396b tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:13.613614 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0c96804a-72f3-41b3-8e80-198d9152396b tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:13.619983 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0c96804a-72f3-41b3-8e80-198d9152396b tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:13.887034 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0c96804a-72f3-41b3-8e80-198d9152396b tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:13.912985 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0c96804a-72f3-41b3-8e80-198d9152396b tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940" status: 200 len: 1477 microversion: 2.1 time: 0.336418 Sep 08 10:43:13.914371 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 696/1430] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:13 2022] GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940 => generated 1477 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:13.921019 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a16be365-ea9b-49a3-bf73-4113ac040c09 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:13.929962 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a16be365-ea9b-49a3-bf73-4113ac040c09 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: c1406c0f-748a-4dae-9392-6957d4092c9f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:13.942127 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a16be365-ea9b-49a3-bf73-4113ac040c09 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:13.943189 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a16be365-ea9b-49a3-bf73-4113ac040c09 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:13.944038 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a16be365-ea9b-49a3-bf73-4113ac040c09 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:13.945173 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a16be365-ea9b-49a3-bf73-4113ac040c09 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:13.946305 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a16be365-ea9b-49a3-bf73-4113ac040c09 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:13.947352 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a16be365-ea9b-49a3-bf73-4113ac040c09 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:14.081899 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ad062a87-826f-457d-ac72-b45bde884789 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:14.085991 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a16be365-ea9b-49a3-bf73-4113ac040c09 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:14.093983 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ad062a87-826f-457d-ac72-b45bde884789 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9072eb-573f-4576-b922-57245258445e" status: 200 len: 1308 microversion: 2.1 time: 1.006114 Sep 08 10:43:14.104438 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 735/1431] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:13 2022] GET /compute/v2.1/servers/5a9072eb-573f-4576-b922-57245258445e => generated 1308 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:43:14.120442 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a16be365-ea9b-49a3-bf73-4113ac040c09 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/c1406c0f-748a-4dae-9392-6957d4092c9f" status: 200 len: 1345 microversion: 2.1 time: 0.204667 Sep 08 10:43:14.133515 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 697/1432] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:13 2022] GET /compute/v2.1/servers/c1406c0f-748a-4dae-9392-6957d4092c9f => generated 1345 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:14.318513 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e7d1f8b6-2435-49a8-867d-556f8acdefff tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:14.319134 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e7d1f8b6-2435-49a8-867d-556f8acdefff tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] [instance: 24a25908-e543-400e-b922-392c9604ec2e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:14.331561 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7d1f8b6-2435-49a8-867d-556f8acdefff tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:14.332066 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7d1f8b6-2435-49a8-867d-556f8acdefff tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:14.332506 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7d1f8b6-2435-49a8-867d-556f8acdefff tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:14.333261 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7d1f8b6-2435-49a8-867d-556f8acdefff tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:14.333801 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7d1f8b6-2435-49a8-867d-556f8acdefff tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:14.334239 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7d1f8b6-2435-49a8-867d-556f8acdefff tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:14.561717 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-89c78cc2-ae5a-4a80-abc9-ac6de773bcdc tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:14.562691 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-89c78cc2-ae5a-4a80-abc9-ac6de773bcdc tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] [instance: dac27157-b08e-4f13-b97e-3c5b653bd0b3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:14.607697 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-89c78cc2-ae5a-4a80-abc9-ac6de773bcdc tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:14.608205 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-89c78cc2-ae5a-4a80-abc9-ac6de773bcdc tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:14.617251 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-89c78cc2-ae5a-4a80-abc9-ac6de773bcdc tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:14.618195 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-89c78cc2-ae5a-4a80-abc9-ac6de773bcdc tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:14.618677 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-89c78cc2-ae5a-4a80-abc9-ac6de773bcdc tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:14.619352 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-89c78cc2-ae5a-4a80-abc9-ac6de773bcdc tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:14.624317 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e7d1f8b6-2435-49a8-867d-556f8acdefff tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e25e1f9b61a4cddaa50e2a841aa7082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de26f1b9fbbb4e31b1f4535a5a1ff512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:14.639628 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e7d1f8b6-2435-49a8-867d-556f8acdefff tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e25e1f9b61a4cddaa50e2a841aa7082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de26f1b9fbbb4e31b1f4535a5a1ff512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:14.656152 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e7d1f8b6-2435-49a8-867d-556f8acdefff tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e25e1f9b61a4cddaa50e2a841aa7082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de26f1b9fbbb4e31b1f4535a5a1ff512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:14.657444 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e7d1f8b6-2435-49a8-867d-556f8acdefff tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] 10.222.0.27 "GET /compute/v2.1/servers/24a25908-e543-400e-b922-392c9604ec2e" status: 200 len: 1408 microversion: 2.54 time: 0.342896 Sep 08 10:43:14.658019 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 736/1433] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:43:14 2022] GET /compute/v2.1/servers/24a25908-e543-400e-b922-392c9604ec2e => generated 1408 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:43:14.816018 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-89c78cc2-ae5a-4a80-abc9-ac6de773bcdc tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7415a5b46c4587a8806661b70e3913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604588959944720923ec2d5e0bf81c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:14.827636 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-89c78cc2-ae5a-4a80-abc9-ac6de773bcdc tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/servers/dac27157-b08e-4f13-b97e-3c5b653bd0b3" status: 200 len: 1275 microversion: 2.1 time: 0.271461 Sep 08 10:43:14.830477 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 698/1434] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:14 2022] GET /compute/v2.1/servers/dac27157-b08e-4f13-b97e-3c5b653bd0b3 => generated 1275 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:14.942393 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9998589a-4e84-4814-9ab6-60338ef4949f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:14.944034 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9998589a-4e84-4814-9ab6-60338ef4949f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 287be913-2461-45d0-8000-360c3fdb5940] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:14.956586 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9998589a-4e84-4814-9ab6-60338ef4949f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:14.957123 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9998589a-4e84-4814-9ab6-60338ef4949f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:14.957571 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9998589a-4e84-4814-9ab6-60338ef4949f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:14.958295 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9998589a-4e84-4814-9ab6-60338ef4949f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:14.958757 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9998589a-4e84-4814-9ab6-60338ef4949f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:14.959185 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9998589a-4e84-4814-9ab6-60338ef4949f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:15.129520 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6d8987b4-f336-4b62-98c2-7f03f6686ed9 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:15.130198 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6d8987b4-f336-4b62-98c2-7f03f6686ed9 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 5a9072eb-573f-4576-b922-57245258445e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:15.146704 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6d8987b4-f336-4b62-98c2-7f03f6686ed9 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:15.154821 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6d8987b4-f336-4b62-98c2-7f03f6686ed9 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:15.155531 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6d8987b4-f336-4b62-98c2-7f03f6686ed9 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:15.157265 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6d8987b4-f336-4b62-98c2-7f03f6686ed9 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:15.158317 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6d8987b4-f336-4b62-98c2-7f03f6686ed9 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:15.159329 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6d8987b4-f336-4b62-98c2-7f03f6686ed9 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:15.611526 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6d8987b4-f336-4b62-98c2-7f03f6686ed9 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:15.621161 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6d8987b4-f336-4b62-98c2-7f03f6686ed9 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9072eb-573f-4576-b922-57245258445e" status: 200 len: 1308 microversion: 2.1 time: 0.497056 Sep 08 10:43:15.623006 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 699/1435] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:15 2022] GET /compute/v2.1/servers/5a9072eb-573f-4576-b922-57245258445e => generated 1308 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:15.631842 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-27cd860e-15ac-4dff-bef5-d94bc6f73e55 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:15.632791 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-27cd860e-15ac-4dff-bef5-d94bc6f73e55 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: c1406c0f-748a-4dae-9392-6957d4092c9f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:15.641658 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-27cd860e-15ac-4dff-bef5-d94bc6f73e55 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:15.642443 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-27cd860e-15ac-4dff-bef5-d94bc6f73e55 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:15.643110 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-27cd860e-15ac-4dff-bef5-d94bc6f73e55 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:15.644252 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-27cd860e-15ac-4dff-bef5-d94bc6f73e55 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:15.645393 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-27cd860e-15ac-4dff-bef5-d94bc6f73e55 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:15.646235 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-27cd860e-15ac-4dff-bef5-d94bc6f73e55 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:15.656798 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9998589a-4e84-4814-9ab6-60338ef4949f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:15.665416 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9998589a-4e84-4814-9ab6-60338ef4949f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940" status: 200 len: 1477 microversion: 2.1 time: 0.726590 Sep 08 10:43:15.676940 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 737/1436] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:14 2022] GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940 => generated 1477 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:15.693016 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-2b284331-2510-4f3f-83c2-b74c0b26617c req-6c5d99c6-951e-4fd6-881b-62e402606d50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a9072eb-573f-4576-b922-57245258445e", "tag": "b11c68f4-e560-4a23-9f9a-548f2856de5f"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:43:15.723868 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-2b284331-2510-4f3f-83c2-b74c0b26617c req-6c5d99c6-951e-4fd6-881b-62e402606d50 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:15.724465 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-2b284331-2510-4f3f-83c2-b74c0b26617c req-6c5d99c6-951e-4fd6-881b-62e402606d50 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:15.725197 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-2b284331-2510-4f3f-83c2-b74c0b26617c req-6c5d99c6-951e-4fd6-881b-62e402606d50 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:15.780457 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-2b284331-2510-4f3f-83c2-b74c0b26617c req-6c5d99c6-951e-4fd6-881b-62e402606d50 service nova] Creating event network-changed:b11c68f4-e560-4a23-9f9a-548f2856de5f for instance 5a9072eb-573f-4576-b922-57245258445e on n-h1-850501-12 Sep 08 10:43:15.782311 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-27cd860e-15ac-4dff-bef5-d94bc6f73e55 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:15.800882 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-2b284331-2510-4f3f-83c2-b74c0b26617c req-6c5d99c6-951e-4fd6-881b-62e402606d50 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121728 Sep 08 10:43:15.803381 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-27cd860e-15ac-4dff-bef5-d94bc6f73e55 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/c1406c0f-748a-4dae-9392-6957d4092c9f" status: 200 len: 1345 microversion: 2.1 time: 0.175486 Sep 08 10:43:15.806444 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 700/1438] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:15 2022] GET /compute/v2.1/servers/c1406c0f-748a-4dae-9392-6957d4092c9f => generated 1345 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:15.806674 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 738/1438] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:43:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:43:15.816934 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b2fcc16a-8d81-480c-8282-250499805ef9 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:15.817928 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b2fcc16a-8d81-480c-8282-250499805ef9 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] [instance: 24a25908-e543-400e-b922-392c9604ec2e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:15.842785 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b2fcc16a-8d81-480c-8282-250499805ef9 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:15.844128 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b2fcc16a-8d81-480c-8282-250499805ef9 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:15.845142 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b2fcc16a-8d81-480c-8282-250499805ef9 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:15.846079 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b2fcc16a-8d81-480c-8282-250499805ef9 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:15.849573 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b2fcc16a-8d81-480c-8282-250499805ef9 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:15.850414 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b2fcc16a-8d81-480c-8282-250499805ef9 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:15.862729 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5944e188-68d9-4089-9266-906747296a11 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:15.863398 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5944e188-68d9-4089-9266-906747296a11 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] [instance: dac27157-b08e-4f13-b97e-3c5b653bd0b3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:15.878236 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5944e188-68d9-4089-9266-906747296a11 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:15.878996 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5944e188-68d9-4089-9266-906747296a11 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:15.882181 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5944e188-68d9-4089-9266-906747296a11 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:15.883097 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5944e188-68d9-4089-9266-906747296a11 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:15.883638 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5944e188-68d9-4089-9266-906747296a11 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:15.884127 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5944e188-68d9-4089-9266-906747296a11 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:16.086154 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5944e188-68d9-4089-9266-906747296a11 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7415a5b46c4587a8806661b70e3913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604588959944720923ec2d5e0bf81c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:16.106242 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5944e188-68d9-4089-9266-906747296a11 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/servers/dac27157-b08e-4f13-b97e-3c5b653bd0b3" status: 200 len: 1275 microversion: 2.1 time: 0.248479 Sep 08 10:43:16.107301 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 701/1439] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:15 2022] GET /compute/v2.1/servers/dac27157-b08e-4f13-b97e-3c5b653bd0b3 => generated 1275 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:16.256422 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b2fcc16a-8d81-480c-8282-250499805ef9 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e25e1f9b61a4cddaa50e2a841aa7082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de26f1b9fbbb4e31b1f4535a5a1ff512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:16.272176 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b2fcc16a-8d81-480c-8282-250499805ef9 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e25e1f9b61a4cddaa50e2a841aa7082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de26f1b9fbbb4e31b1f4535a5a1ff512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:16.277656 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b2fcc16a-8d81-480c-8282-250499805ef9 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e25e1f9b61a4cddaa50e2a841aa7082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de26f1b9fbbb4e31b1f4535a5a1ff512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:16.282750 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b2fcc16a-8d81-480c-8282-250499805ef9 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] 10.222.0.27 "GET /compute/v2.1/servers/24a25908-e543-400e-b922-392c9604ec2e" status: 200 len: 1408 microversion: 2.54 time: 0.474738 Sep 08 10:43:16.283354 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 739/1440] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:43:15 2022] GET /compute/v2.1/servers/24a25908-e543-400e-b922-392c9604ec2e => generated 1408 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:43:16.685183 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d767266b-0f8d-4ed8-ac00-68c59ba8728b tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:16.686622 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d767266b-0f8d-4ed8-ac00-68c59ba8728b tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 5a9072eb-573f-4576-b922-57245258445e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:16.694577 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d767266b-0f8d-4ed8-ac00-68c59ba8728b tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:16.695415 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d767266b-0f8d-4ed8-ac00-68c59ba8728b tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:16.696108 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d767266b-0f8d-4ed8-ac00-68c59ba8728b tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:16.697144 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d767266b-0f8d-4ed8-ac00-68c59ba8728b tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:16.697804 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d767266b-0f8d-4ed8-ac00-68c59ba8728b tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:16.698410 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d767266b-0f8d-4ed8-ac00-68c59ba8728b tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:16.704541 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bc8054cc-f872-4f53-b0aa-ef39a736adf3 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:16.712487 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bc8054cc-f872-4f53-b0aa-ef39a736adf3 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 287be913-2461-45d0-8000-360c3fdb5940] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:16.727922 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bc8054cc-f872-4f53-b0aa-ef39a736adf3 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:16.730607 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bc8054cc-f872-4f53-b0aa-ef39a736adf3 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:16.733762 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bc8054cc-f872-4f53-b0aa-ef39a736adf3 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:16.735119 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bc8054cc-f872-4f53-b0aa-ef39a736adf3 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:16.736596 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bc8054cc-f872-4f53-b0aa-ef39a736adf3 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:16.738032 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bc8054cc-f872-4f53-b0aa-ef39a736adf3 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:17.071512 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d767266b-0f8d-4ed8-ac00-68c59ba8728b tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:17.095073 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d767266b-0f8d-4ed8-ac00-68c59ba8728b tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9072eb-573f-4576-b922-57245258445e" status: 200 len: 1308 microversion: 2.1 time: 0.433316 Sep 08 10:43:17.097826 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 702/1441] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:16 2022] GET /compute/v2.1/servers/5a9072eb-573f-4576-b922-57245258445e => generated 1308 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:17.130000 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-dfd18b20-f552-4c5e-b670-abad97ca659d tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:17.130728 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-dfd18b20-f552-4c5e-b670-abad97ca659d tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: c1406c0f-748a-4dae-9392-6957d4092c9f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:17.148123 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dfd18b20-f552-4c5e-b670-abad97ca659d tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:17.148973 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dfd18b20-f552-4c5e-b670-abad97ca659d tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:17.149871 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dfd18b20-f552-4c5e-b670-abad97ca659d tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:17.150878 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dfd18b20-f552-4c5e-b670-abad97ca659d tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:17.151627 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dfd18b20-f552-4c5e-b670-abad97ca659d tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:17.173139 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dfd18b20-f552-4c5e-b670-abad97ca659d tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:17.323834 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-dfd18b20-f552-4c5e-b670-abad97ca659d tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:17.341836 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-dfd18b20-f552-4c5e-b670-abad97ca659d tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/c1406c0f-748a-4dae-9392-6957d4092c9f" status: 200 len: 1345 microversion: 2.1 time: 0.227634 Sep 08 10:43:17.342932 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 703/1442] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:17 2022] GET /compute/v2.1/servers/c1406c0f-748a-4dae-9392-6957d4092c9f => generated 1345 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:17.358389 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-24fb01f8-5b13-4729-9ec3-7581b1dc62ef tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "07a71221-db08-4dca-a552-4fcd0424162d"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:43:17.364756 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-24fb01f8-5b13-4729-9ec3-7581b1dc62ef tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] [instance: 790bcd42-ace5-4761-b46d-e0889855623f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:17.372365 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24fb01f8-5b13-4729-9ec3-7581b1dc62ef tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:17.374422 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24fb01f8-5b13-4729-9ec3-7581b1dc62ef tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:17.375324 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24fb01f8-5b13-4729-9ec3-7581b1dc62ef tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:17.379728 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24fb01f8-5b13-4729-9ec3-7581b1dc62ef tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:17.380239 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24fb01f8-5b13-4729-9ec3-7581b1dc62ef tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:17.380793 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24fb01f8-5b13-4729-9ec3-7581b1dc62ef tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:17.694980 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bc8054cc-f872-4f53-b0aa-ef39a736adf3 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:17.707657 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bc8054cc-f872-4f53-b0aa-ef39a736adf3 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940" status: 200 len: 1477 microversion: 2.1 time: 1.007793 Sep 08 10:43:17.712818 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 740/1443] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:16 2022] GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940 => generated 1477 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:43:17.732253 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-91e3656a-3700-4b2b-a0b7-17b580fd0120 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:17.733348 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-91e3656a-3700-4b2b-a0b7-17b580fd0120 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] [instance: dac27157-b08e-4f13-b97e-3c5b653bd0b3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:17.742678 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-91e3656a-3700-4b2b-a0b7-17b580fd0120 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:17.744678 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-91e3656a-3700-4b2b-a0b7-17b580fd0120 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:17.745349 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-91e3656a-3700-4b2b-a0b7-17b580fd0120 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:17.759857 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-91e3656a-3700-4b2b-a0b7-17b580fd0120 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:17.760714 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-91e3656a-3700-4b2b-a0b7-17b580fd0120 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:17.761947 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-91e3656a-3700-4b2b-a0b7-17b580fd0120 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:17.915183 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-24fb01f8-5b13-4729-9ec3-7581b1dc62ef tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] 10.222.0.27 "POST /compute/v2.1/servers/790bcd42-ace5-4761-b46d-e0889855623f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.569745 Sep 08 10:43:17.933694 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 704/1444] 10.222.0.27 () {60 vars in 1323 bytes} [Thu Sep 8 10:43:17 2022] POST /compute/v2.1/servers/790bcd42-ace5-4761-b46d-e0889855623f/os-volume_attachments => generated 194 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:43:17.940406 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-78675c73-e427-4e20-ab1d-f0847976e45e tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:17.941330 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-78675c73-e427-4e20-ab1d-f0847976e45e tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] [instance: 24a25908-e543-400e-b922-392c9604ec2e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:17.953604 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-78675c73-e427-4e20-ab1d-f0847976e45e tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:17.954601 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-78675c73-e427-4e20-ab1d-f0847976e45e tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:17.955328 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-78675c73-e427-4e20-ab1d-f0847976e45e tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:17.956257 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-78675c73-e427-4e20-ab1d-f0847976e45e tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:17.957333 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-78675c73-e427-4e20-ab1d-f0847976e45e tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:17.957958 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-78675c73-e427-4e20-ab1d-f0847976e45e tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:18.076139 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-78675c73-e427-4e20-ab1d-f0847976e45e tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e25e1f9b61a4cddaa50e2a841aa7082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de26f1b9fbbb4e31b1f4535a5a1ff512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:18.091674 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-78675c73-e427-4e20-ab1d-f0847976e45e tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e25e1f9b61a4cddaa50e2a841aa7082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de26f1b9fbbb4e31b1f4535a5a1ff512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:18.098742 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-78675c73-e427-4e20-ab1d-f0847976e45e tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e25e1f9b61a4cddaa50e2a841aa7082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de26f1b9fbbb4e31b1f4535a5a1ff512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:18.100276 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-78675c73-e427-4e20-ab1d-f0847976e45e tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] 10.222.0.27 "GET /compute/v2.1/servers/24a25908-e543-400e-b922-392c9604ec2e" status: 200 len: 1408 microversion: 2.54 time: 0.164741 Sep 08 10:43:18.102633 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 705/1445] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:43:17 2022] GET /compute/v2.1/servers/24a25908-e543-400e-b922-392c9604ec2e => generated 1408 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:43:18.135827 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ff621b23-6cf9-45a5-b851-8ef5698716de tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:18.136987 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ff621b23-6cf9-45a5-b851-8ef5698716de tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 5a9072eb-573f-4576-b922-57245258445e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:18.150583 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ff621b23-6cf9-45a5-b851-8ef5698716de tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:18.151410 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ff621b23-6cf9-45a5-b851-8ef5698716de tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:18.152038 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ff621b23-6cf9-45a5-b851-8ef5698716de tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:18.153608 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ff621b23-6cf9-45a5-b851-8ef5698716de tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:18.154470 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ff621b23-6cf9-45a5-b851-8ef5698716de tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:18.155297 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ff621b23-6cf9-45a5-b851-8ef5698716de tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:18.471318 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ff621b23-6cf9-45a5-b851-8ef5698716de tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:18.491127 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ff621b23-6cf9-45a5-b851-8ef5698716de tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9072eb-573f-4576-b922-57245258445e" status: 200 len: 1308 microversion: 2.1 time: 0.362086 Sep 08 10:43:18.492977 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 706/1446] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:18 2022] GET /compute/v2.1/servers/5a9072eb-573f-4576-b922-57245258445e => generated 1308 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:18.505295 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a26c2eb7-4998-4339-8e18-1c051f1ce595 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:18.506064 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a26c2eb7-4998-4339-8e18-1c051f1ce595 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: c1406c0f-748a-4dae-9392-6957d4092c9f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:18.522918 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a26c2eb7-4998-4339-8e18-1c051f1ce595 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:18.527349 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a26c2eb7-4998-4339-8e18-1c051f1ce595 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:18.529819 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a26c2eb7-4998-4339-8e18-1c051f1ce595 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:18.532136 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a26c2eb7-4998-4339-8e18-1c051f1ce595 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:18.534289 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a26c2eb7-4998-4339-8e18-1c051f1ce595 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:18.536325 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a26c2eb7-4998-4339-8e18-1c051f1ce595 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:18.690535 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:43:18.703391 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a26c2eb7-4998-4339-8e18-1c051f1ce595 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:18.720699 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a26c2eb7-4998-4339-8e18-1c051f1ce595 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/c1406c0f-748a-4dae-9392-6957d4092c9f" status: 200 len: 1345 microversion: 2.1 time: 0.226535 Sep 08 10:43:18.724874 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 707/1447] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:18 2022] GET /compute/v2.1/servers/c1406c0f-748a-4dae-9392-6957d4092c9f => generated 1345 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:18.739726 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-57c8456f-c2d8-47a1-9d99-e6c1580ff015 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:18.740949 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-57c8456f-c2d8-47a1-9d99-e6c1580ff015 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 287be913-2461-45d0-8000-360c3fdb5940] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:18.754694 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=12 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:43:18.759280 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-57c8456f-c2d8-47a1-9d99-e6c1580ff015 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:18.760356 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-57c8456f-c2d8-47a1-9d99-e6c1580ff015 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:18.761298 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-57c8456f-c2d8-47a1-9d99-e6c1580ff015 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:18.766893 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-57c8456f-c2d8-47a1-9d99-e6c1580ff015 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:18.769560 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-57c8456f-c2d8-47a1-9d99-e6c1580ff015 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:18.771339 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-57c8456f-c2d8-47a1-9d99-e6c1580ff015 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:19.042501 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-57c8456f-c2d8-47a1-9d99-e6c1580ff015 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:19.053241 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-57c8456f-c2d8-47a1-9d99-e6c1580ff015 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940" status: 200 len: 1477 microversion: 2.1 time: 0.318745 Sep 08 10:43:19.054504 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 708/1448] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:18 2022] GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940 => generated 1477 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:43:19.088894 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-91e3656a-3700-4b2b-a0b7-17b580fd0120 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7415a5b46c4587a8806661b70e3913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604588959944720923ec2d5e0bf81c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:19.108954 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-91e3656a-3700-4b2b-a0b7-17b580fd0120 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/servers/dac27157-b08e-4f13-b97e-3c5b653bd0b3" status: 200 len: 1317 microversion: 2.1 time: 1.394207 Sep 08 10:43:19.110906 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 741/1449] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:17 2022] GET /compute/v2.1/servers/dac27157-b08e-4f13-b97e-3c5b653bd0b3 => generated 1317 bytes in 1397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:19.154888 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e3b62c2b-87e2-41e0-8a06-2ffe8a2b9cb4 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:19.156097 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e3b62c2b-87e2-41e0-8a06-2ffe8a2b9cb4 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] [instance: 24a25908-e543-400e-b922-392c9604ec2e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:19.172560 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e3b62c2b-87e2-41e0-8a06-2ffe8a2b9cb4 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:19.176655 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e3b62c2b-87e2-41e0-8a06-2ffe8a2b9cb4 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:19.179027 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e3b62c2b-87e2-41e0-8a06-2ffe8a2b9cb4 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:19.183185 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e3b62c2b-87e2-41e0-8a06-2ffe8a2b9cb4 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:19.184802 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e3b62c2b-87e2-41e0-8a06-2ffe8a2b9cb4 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:19.188887 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e3b62c2b-87e2-41e0-8a06-2ffe8a2b9cb4 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:19.252595 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:43:19.365738 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e3b62c2b-87e2-41e0-8a06-2ffe8a2b9cb4 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e25e1f9b61a4cddaa50e2a841aa7082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de26f1b9fbbb4e31b1f4535a5a1ff512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:19.376668 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e3b62c2b-87e2-41e0-8a06-2ffe8a2b9cb4 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e25e1f9b61a4cddaa50e2a841aa7082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de26f1b9fbbb4e31b1f4535a5a1ff512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:19.378806 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e3b62c2b-87e2-41e0-8a06-2ffe8a2b9cb4 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e25e1f9b61a4cddaa50e2a841aa7082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de26f1b9fbbb4e31b1f4535a5a1ff512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:19.380717 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e3b62c2b-87e2-41e0-8a06-2ffe8a2b9cb4 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] 10.222.0.27 "GET /compute/v2.1/servers/24a25908-e543-400e-b922-392c9604ec2e" status: 200 len: 1408 microversion: 2.54 time: 0.232130 Sep 08 10:43:19.394746 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 709/1450] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:43:19 2022] GET /compute/v2.1/servers/24a25908-e543-400e-b922-392c9604ec2e => generated 1408 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:43:19.493875 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-b0fbca24-8f5b-4ef2-ae82-d2cce309a635 req-8b1806b3-20f1-4064-84c6-a1271f705d03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e6be670-294f-417f-a909-57c481faaf40", "tag": "2dc5c573-e6fe-4942-be41-259b760efba3"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:43:19.514615 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b0fbca24-8f5b-4ef2-ae82-d2cce309a635 req-8b1806b3-20f1-4064-84c6-a1271f705d03 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:19.515770 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b0fbca24-8f5b-4ef2-ae82-d2cce309a635 req-8b1806b3-20f1-4064-84c6-a1271f705d03 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:19.516847 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b0fbca24-8f5b-4ef2-ae82-d2cce309a635 req-8b1806b3-20f1-4064-84c6-a1271f705d03 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:19.532458 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-364136fe-65d5-4621-9838-1118470f921a tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:19.533590 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-364136fe-65d5-4621-9838-1118470f921a tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 5a9072eb-573f-4576-b922-57245258445e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:19.539336 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-b0fbca24-8f5b-4ef2-ae82-d2cce309a635 req-8b1806b3-20f1-4064-84c6-a1271f705d03 service nova] Creating event network-changed:2dc5c573-e6fe-4942-be41-259b760efba3 for instance 3e6be670-294f-417f-a909-57c481faaf40 on n-h1-850501-12 Sep 08 10:43:19.549375 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-b0fbca24-8f5b-4ef2-ae82-d2cce309a635 req-8b1806b3-20f1-4064-84c6-a1271f705d03 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061064 Sep 08 10:43:19.550813 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 742/1451] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:43:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:43:19.570754 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-364136fe-65d5-4621-9838-1118470f921a tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:19.571580 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-364136fe-65d5-4621-9838-1118470f921a tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:19.572344 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-364136fe-65d5-4621-9838-1118470f921a tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:19.595395 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-364136fe-65d5-4621-9838-1118470f921a tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:19.596263 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-364136fe-65d5-4621-9838-1118470f921a tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:19.600198 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-364136fe-65d5-4621-9838-1118470f921a tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:19.776460 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e7310c83-a361-4f40-8d99-705494fe9c3b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:19.783020 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e7310c83-a361-4f40-8d99-705494fe9c3b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: c1406c0f-748a-4dae-9392-6957d4092c9f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:19.823786 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7310c83-a361-4f40-8d99-705494fe9c3b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:19.827839 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7310c83-a361-4f40-8d99-705494fe9c3b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:19.830228 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7310c83-a361-4f40-8d99-705494fe9c3b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:19.831954 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7310c83-a361-4f40-8d99-705494fe9c3b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:19.835642 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7310c83-a361-4f40-8d99-705494fe9c3b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:19.838412 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7310c83-a361-4f40-8d99-705494fe9c3b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:19.942058 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=4 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:43:20.006704 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7310c83-a361-4f40-8d99-705494fe9c3b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:20.007567 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7310c83-a361-4f40-8d99-705494fe9c3b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:20.008899 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7310c83-a361-4f40-8d99-705494fe9c3b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:20.009930 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-e7310c83-a361-4f40-8d99-705494fe9c3b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lazy-loading 'fault' on Instance uuid c1406c0f-748a-4dae-9392-6957d4092c9f {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:43:20.169816 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-364136fe-65d5-4621-9838-1118470f921a tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:20.179589 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-364136fe-65d5-4621-9838-1118470f921a tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9072eb-573f-4576-b922-57245258445e" status: 200 len: 1308 microversion: 2.1 time: 0.660208 Sep 08 10:43:20.181098 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 710/1452] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:19 2022] GET /compute/v2.1/servers/5a9072eb-573f-4576-b922-57245258445e => generated 1308 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:20.187445 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-900b439e-5828-4c7b-b048-4f82009540a8 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:20.188335 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-900b439e-5828-4c7b-b048-4f82009540a8 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 287be913-2461-45d0-8000-360c3fdb5940] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:20.203533 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-900b439e-5828-4c7b-b048-4f82009540a8 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:20.204335 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-900b439e-5828-4c7b-b048-4f82009540a8 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:20.204959 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-900b439e-5828-4c7b-b048-4f82009540a8 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:20.205986 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-900b439e-5828-4c7b-b048-4f82009540a8 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:20.206800 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-900b439e-5828-4c7b-b048-4f82009540a8 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:20.207443 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-900b439e-5828-4c7b-b048-4f82009540a8 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:20.390014 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-900b439e-5828-4c7b-b048-4f82009540a8 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:20.402563 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-900b439e-5828-4c7b-b048-4f82009540a8 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940" status: 200 len: 1477 microversion: 2.1 time: 0.220052 Sep 08 10:43:20.417060 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 711/1453] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:20 2022] GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940 => generated 1477 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:20.417060 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c5ac40cd-fb4d-4970-a912-d8bde6b2d3d1 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:20.428325 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c5ac40cd-fb4d-4970-a912-d8bde6b2d3d1 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] [instance: dac27157-b08e-4f13-b97e-3c5b653bd0b3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:20.441615 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c5ac40cd-fb4d-4970-a912-d8bde6b2d3d1 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:20.442061 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c5ac40cd-fb4d-4970-a912-d8bde6b2d3d1 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:20.442523 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c5ac40cd-fb4d-4970-a912-d8bde6b2d3d1 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:20.443732 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c5ac40cd-fb4d-4970-a912-d8bde6b2d3d1 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:20.443732 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c5ac40cd-fb4d-4970-a912-d8bde6b2d3d1 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:20.444190 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c5ac40cd-fb4d-4970-a912-d8bde6b2d3d1 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:20.677558 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=14 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:43:20.708011 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c5ac40cd-fb4d-4970-a912-d8bde6b2d3d1 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7415a5b46c4587a8806661b70e3913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604588959944720923ec2d5e0bf81c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:20.722001 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c5ac40cd-fb4d-4970-a912-d8bde6b2d3d1 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/servers/dac27157-b08e-4f13-b97e-3c5b653bd0b3" status: 200 len: 1317 microversion: 2.1 time: 0.317162 Sep 08 10:43:20.731953 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 712/1454] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:20 2022] GET /compute/v2.1/servers/dac27157-b08e-4f13-b97e-3c5b653bd0b3 => generated 1317 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:20.737482 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-41301846-dd1f-4aa7-b538-f2b43f8bd8f6 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-685270710", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "cebc319d-cd30-49da-85de-4414687896b3"}], "block_device_mapping_v2": [{"uuid": "91cef2ad-75d5-4ac4-87fd-04af95fe0832", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:43:20.769891 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:43:20.777578 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e7310c83-a361-4f40-8d99-705494fe9c3b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:20.795722 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e7310c83-a361-4f40-8d99-705494fe9c3b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/c1406c0f-748a-4dae-9392-6957d4092c9f" status: 200 len: 1350 microversion: 2.1 time: 1.037796 Sep 08 10:43:20.799904 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 743/1455] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:19 2022] GET /compute/v2.1/servers/c1406c0f-748a-4dae-9392-6957d4092c9f => generated 1350 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:43:20.815556 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9c5ca81c-20f2-4b03-8331-4290a87b891a tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:20.818280 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9c5ca81c-20f2-4b03-8331-4290a87b891a tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] [instance: 24a25908-e543-400e-b922-392c9604ec2e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:20.832785 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9c5ca81c-20f2-4b03-8331-4290a87b891a tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:20.833310 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9c5ca81c-20f2-4b03-8331-4290a87b891a tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:20.833754 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9c5ca81c-20f2-4b03-8331-4290a87b891a tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:20.834480 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9c5ca81c-20f2-4b03-8331-4290a87b891a tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:20.834938 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9c5ca81c-20f2-4b03-8331-4290a87b891a tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:20.835364 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9c5ca81c-20f2-4b03-8331-4290a87b891a tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:20.957912 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-41301846-dd1f-4aa7-b538-f2b43f8bd8f6 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] validate_networks() for [('cebc319d-cd30-49da-85de-4414687896b3', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:43:21.026549 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9c5ca81c-20f2-4b03-8331-4290a87b891a tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e25e1f9b61a4cddaa50e2a841aa7082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de26f1b9fbbb4e31b1f4535a5a1ff512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:21.037786 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9c5ca81c-20f2-4b03-8331-4290a87b891a tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e25e1f9b61a4cddaa50e2a841aa7082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de26f1b9fbbb4e31b1f4535a5a1ff512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:21.044422 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9c5ca81c-20f2-4b03-8331-4290a87b891a tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e25e1f9b61a4cddaa50e2a841aa7082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de26f1b9fbbb4e31b1f4535a5a1ff512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:21.045747 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9c5ca81c-20f2-4b03-8331-4290a87b891a tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] 10.222.0.27 "GET /compute/v2.1/servers/24a25908-e543-400e-b922-392c9604ec2e" status: 200 len: 1408 microversion: 2.54 time: 0.242647 Sep 08 10:43:21.046331 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 744/1456] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:43:20 2022] GET /compute/v2.1/servers/24a25908-e543-400e-b922-392c9604ec2e => generated 1408 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:43:21.207865 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4e1ae966-7562-4506-8477-52e0f4bd6a8e tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:21.208746 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4e1ae966-7562-4506-8477-52e0f4bd6a8e tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 5a9072eb-573f-4576-b922-57245258445e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:21.227647 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e1ae966-7562-4506-8477-52e0f4bd6a8e tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:21.228653 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e1ae966-7562-4506-8477-52e0f4bd6a8e tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:21.229355 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e1ae966-7562-4506-8477-52e0f4bd6a8e tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:21.230491 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e1ae966-7562-4506-8477-52e0f4bd6a8e tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:21.231695 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e1ae966-7562-4506-8477-52e0f4bd6a8e tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:21.232404 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e1ae966-7562-4506-8477-52e0f4bd6a8e tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:21.770202 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4e1ae966-7562-4506-8477-52e0f4bd6a8e tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:21.780360 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4e1ae966-7562-4506-8477-52e0f4bd6a8e tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9072eb-573f-4576-b922-57245258445e" status: 200 len: 1308 microversion: 2.1 time: 0.577777 Sep 08 10:43:21.792904 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 745/1457] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:21 2022] GET /compute/v2.1/servers/5a9072eb-573f-4576-b922-57245258445e => generated 1308 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:21.797997 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7a704cfa-d776-423c-aaa9-9470406b5fe2 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:21.798631 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7a704cfa-d776-423c-aaa9-9470406b5fe2 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 287be913-2461-45d0-8000-360c3fdb5940] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:21.811357 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7a704cfa-d776-423c-aaa9-9470406b5fe2 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:21.816720 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7a704cfa-d776-423c-aaa9-9470406b5fe2 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:21.817430 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7a704cfa-d776-423c-aaa9-9470406b5fe2 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:21.818226 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7a704cfa-d776-423c-aaa9-9470406b5fe2 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:21.818715 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7a704cfa-d776-423c-aaa9-9470406b5fe2 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:21.819263 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7a704cfa-d776-423c-aaa9-9470406b5fe2 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:22.152369 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-41301846-dd1f-4aa7-b538-f2b43f8bd8f6 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:43:22.153544 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-41301846-dd1f-4aa7-b538-f2b43f8bd8f6 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:43:22.154592 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-41301846-dd1f-4aa7-b538-f2b43f8bd8f6 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:43:22.155167 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-41301846-dd1f-4aa7-b538-f2b43f8bd8f6 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:43:22.155817 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-41301846-dd1f-4aa7-b538-f2b43f8bd8f6 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:43:22.176279 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41301846-dd1f-4aa7-b538-f2b43f8bd8f6 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:22.177006 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41301846-dd1f-4aa7-b538-f2b43f8bd8f6 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:22.177679 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41301846-dd1f-4aa7-b538-f2b43f8bd8f6 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:22.178621 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41301846-dd1f-4aa7-b538-f2b43f8bd8f6 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:22.179277 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41301846-dd1f-4aa7-b538-f2b43f8bd8f6 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:22.179717 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41301846-dd1f-4aa7-b538-f2b43f8bd8f6 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:22.219512 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-41301846-dd1f-4aa7-b538-f2b43f8bd8f6 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Getting quotas for project 57d64134da60477da24b7fde4e1b9680. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:43:22.225679 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-41301846-dd1f-4aa7-b538-f2b43f8bd8f6 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Getting quotas for user 27456dd9f49540b09f2e8addd1045a94 and project 57d64134da60477da24b7fde4e1b9680. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:43:22.310682 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-41301846-dd1f-4aa7-b538-f2b43f8bd8f6 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:43:22.313357 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-41301846-dd1f-4aa7-b538-f2b43f8bd8f6 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: cf3b6c0e-d390-44d6-91e5-09b389dff551] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='91cef2ad-75d5-4ac4-87fd-04af95fe0832',volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:43:22.410904 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7a704cfa-d776-423c-aaa9-9470406b5fe2 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:22.431791 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7a704cfa-d776-423c-aaa9-9470406b5fe2 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940" status: 200 len: 1477 microversion: 2.1 time: 0.637576 Sep 08 10:43:22.432639 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 746/1458] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:21 2022] GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940 => generated 1477 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:22.437747 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3b800ce6-13d1-44eb-af7e-8021ef5baa06 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:22.438373 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3b800ce6-13d1-44eb-af7e-8021ef5baa06 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] [instance: dac27157-b08e-4f13-b97e-3c5b653bd0b3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:22.455044 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b800ce6-13d1-44eb-af7e-8021ef5baa06 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:22.455555 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b800ce6-13d1-44eb-af7e-8021ef5baa06 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:22.455996 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b800ce6-13d1-44eb-af7e-8021ef5baa06 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:22.456732 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b800ce6-13d1-44eb-af7e-8021ef5baa06 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:22.457231 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b800ce6-13d1-44eb-af7e-8021ef5baa06 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:22.457664 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b800ce6-13d1-44eb-af7e-8021ef5baa06 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:22.563030 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-41301846-dd1f-4aa7-b538-f2b43f8bd8f6 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.829344 Sep 08 10:43:22.569946 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 713/1459] 10.222.0.27 () {62 vars in 1188 bytes} [Thu Sep 8 10:43:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1831 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 08 10:43:22.569946 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-550d77f6-a51d-4293-bbd0-0d83e6f73280 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:22.569946 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-550d77f6-a51d-4293-bbd0-0d83e6f73280 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: c1406c0f-748a-4dae-9392-6957d4092c9f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:22.576750 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-550d77f6-a51d-4293-bbd0-0d83e6f73280 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:22.577282 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-550d77f6-a51d-4293-bbd0-0d83e6f73280 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:22.577726 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-550d77f6-a51d-4293-bbd0-0d83e6f73280 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:22.578508 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-550d77f6-a51d-4293-bbd0-0d83e6f73280 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:22.579268 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-550d77f6-a51d-4293-bbd0-0d83e6f73280 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:22.579708 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-550d77f6-a51d-4293-bbd0-0d83e6f73280 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:22.608999 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-550d77f6-a51d-4293-bbd0-0d83e6f73280 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] HTTP exception thrown: Instance c1406c0f-748a-4dae-9392-6957d4092c9f could not be found. Sep 08 10:43:22.611305 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-550d77f6-a51d-4293-bbd0-0d83e6f73280 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Request method failure captured: Sep 08 10:43:22.611305 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/c1406c0f-748a-4dae-9392-6957d4092c9f HTTP/1.1 Sep 08 10:43:22.611305 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:43:22.611305 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:43:22.611305 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:43:22.611305 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:43:22.611305 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:43:22.611305 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:43:22.611305 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:43:22.611305 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:43:22.611305 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcbOYaOup_Ia1bHuprOxxP_LkfdCzYSX9xstQr2GVmRBueUQ0e967rlioz5jpJV566ZCuz_bYy_us0o8_CIFlOGOVfrC9_e_1_vEhZ3YdgjG89HBhaIJ_lG7Uv4nQrC-nfHrMx_LNyd0rOd4Blcm801SOcX7oe5VDxGTE8KVTDSeMPw Sep 08 10:43:22.611305 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:43:22.611305 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:43:22.611305 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:43:22.611305 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:43:22.611305 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:43:22.611305 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:43:22.611305 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 998378cc815344ba8a107d1cd61f40fd Sep 08 10:43:22.611305 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-DeleteServersTestJSON-69164830 Sep 08 10:43:22.611305 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:43:22.611305 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:43:22.611305 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:43:22.611305 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-DeleteServersTestJSON-69164830 Sep 08 10:43:22.611305 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 998378cc815344ba8a107d1cd61f40fd Sep 08 10:43:22.611305 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-DeleteServersTestJSON-69164830 Sep 08 10:43:22.611305 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-DeleteServersTestJSON-69164830-project Sep 08 10:43:22.611305 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:43:22.611305 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:43:22.611305 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: d08269c53bcb41c88953e7c79f5ad185 Sep 08 10:43:22.611305 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-DeleteServersTestJSON-69164830-project Sep 08 10:43:22.611305 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:43:22.611305 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance c1406c0f-748a-4dae-9392-6957d4092c9f could not be found. Sep 08 10:43:22.611305 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': 'c1406c0f-748a-4dae-9392-6957d4092c9f'} Sep 08 10:43:22.611305 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:43:22.611305 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:43:22.611305 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:43:22.611305 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:43:22.611305 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:43:22.611305 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:43:22.611305 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:43:22.611305 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:43:22.611305 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:43:22.611305 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:43:22.611305 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1406c0f-748a-4dae-9392-6957d4092c9f could not be found. Sep 08 10:43:22.611305 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:43:22.611305 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:43:22.611305 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:43:22.611305 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:43:22.611305 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:43:22.611305 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:43:22.611305 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:43:22.611305 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:43:22.611305 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:43:22.611305 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:43:22.611305 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:43:22.611305 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:43:22.611305 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:43:22.611305 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:43:22.611305 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:43:22.611305 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:43:22.611305 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1406c0f-748a-4dae-9392-6957d4092c9f could not be found. Sep 08 10:43:22.611305 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:43:22.611305 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:43:22.611305 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:43:22.616902 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:43:22.616902 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:43:22.616902 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:43:22.616902 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:43:22.616902 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:43:22.616902 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1406c0f-748a-4dae-9392-6957d4092c9f could not be found. Sep 08 10:43:22.616902 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:43:22.616902 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-550d77f6-a51d-4293-bbd0-0d83e6f73280 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Returning 404 to user: Instance c1406c0f-748a-4dae-9392-6957d4092c9f could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:43:22.616902 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-550d77f6-a51d-4293-bbd0-0d83e6f73280 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/c1406c0f-748a-4dae-9392-6957d4092c9f" status: 404 len: 111 microversion: 2.1 time: 0.048218 Sep 08 10:43:22.618098 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 714/1460] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:22 2022] GET /compute/v2.1/servers/c1406c0f-748a-4dae-9392-6957d4092c9f => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:43:22.624280 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1984848f-0042-4746-bb6c-4eae357de60b tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:22.624952 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1984848f-0042-4746-bb6c-4eae357de60b tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] [instance: 24a25908-e543-400e-b922-392c9604ec2e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:22.632488 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1984848f-0042-4746-bb6c-4eae357de60b tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:22.633059 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1984848f-0042-4746-bb6c-4eae357de60b tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:22.634967 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1984848f-0042-4746-bb6c-4eae357de60b tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:22.635571 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1984848f-0042-4746-bb6c-4eae357de60b tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:22.635939 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1984848f-0042-4746-bb6c-4eae357de60b tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:22.636424 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1984848f-0042-4746-bb6c-4eae357de60b tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:22.772513 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1984848f-0042-4746-bb6c-4eae357de60b tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e25e1f9b61a4cddaa50e2a841aa7082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de26f1b9fbbb4e31b1f4535a5a1ff512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:22.783867 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1984848f-0042-4746-bb6c-4eae357de60b tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e25e1f9b61a4cddaa50e2a841aa7082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de26f1b9fbbb4e31b1f4535a5a1ff512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:22.785383 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1984848f-0042-4746-bb6c-4eae357de60b tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e25e1f9b61a4cddaa50e2a841aa7082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de26f1b9fbbb4e31b1f4535a5a1ff512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:22.786580 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1984848f-0042-4746-bb6c-4eae357de60b tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] 10.222.0.27 "GET /compute/v2.1/servers/24a25908-e543-400e-b922-392c9604ec2e" status: 200 len: 1408 microversion: 2.54 time: 0.167476 Sep 08 10:43:22.787525 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 715/1461] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:43:22 2022] GET /compute/v2.1/servers/24a25908-e543-400e-b922-392c9604ec2e => generated 1408 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:43:22.792217 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-21d42a8e-b8de-4373-a7ba-d1aa82abb672 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:22.792824 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-21d42a8e-b8de-4373-a7ba-d1aa82abb672 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: cf3b6c0e-d390-44d6-91e5-09b389dff551] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:22.901461 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-21d42a8e-b8de-4373-a7ba-d1aa82abb672 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:22.914154 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-21d42a8e-b8de-4373-a7ba-d1aa82abb672 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:22.915481 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-21d42a8e-b8de-4373-a7ba-d1aa82abb672 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:22.916617 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-21d42a8e-b8de-4373-a7ba-d1aa82abb672 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551" status: 200 len: 1103 microversion: 2.25 time: 0.128044 Sep 08 10:43:22.947405 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 716/1462] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:43:22 2022] GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551 => generated 1103 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:43:22.953397 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f00462c3-f0c8-4586-bac4-2fdeb2b5c3b8 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:22.954027 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f00462c3-f0c8-4586-bac4-2fdeb2b5c3b8 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 5a9072eb-573f-4576-b922-57245258445e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:22.966145 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f00462c3-f0c8-4586-bac4-2fdeb2b5c3b8 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:22.966692 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f00462c3-f0c8-4586-bac4-2fdeb2b5c3b8 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:22.967339 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f00462c3-f0c8-4586-bac4-2fdeb2b5c3b8 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:22.968411 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f00462c3-f0c8-4586-bac4-2fdeb2b5c3b8 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:22.969172 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f00462c3-f0c8-4586-bac4-2fdeb2b5c3b8 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:22.969769 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f00462c3-f0c8-4586-bac4-2fdeb2b5c3b8 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:23.005818 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3b800ce6-13d1-44eb-af7e-8021ef5baa06 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7415a5b46c4587a8806661b70e3913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604588959944720923ec2d5e0bf81c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:23.023965 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3b800ce6-13d1-44eb-af7e-8021ef5baa06 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/servers/dac27157-b08e-4f13-b97e-3c5b653bd0b3" status: 200 len: 1317 microversion: 2.1 time: 0.589805 Sep 08 10:43:23.049315 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 747/1463] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:22 2022] GET /compute/v2.1/servers/dac27157-b08e-4f13-b97e-3c5b653bd0b3 => generated 1317 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:23.062158 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-03928d1a-5d36-4a90-8b94-d751ec58f01d tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:23.064565 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-03928d1a-5d36-4a90-8b94-d751ec58f01d tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: c1406c0f-748a-4dae-9392-6957d4092c9f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:23.081504 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03928d1a-5d36-4a90-8b94-d751ec58f01d tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:23.086668 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03928d1a-5d36-4a90-8b94-d751ec58f01d tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:23.087387 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03928d1a-5d36-4a90-8b94-d751ec58f01d tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:23.088339 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03928d1a-5d36-4a90-8b94-d751ec58f01d tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:23.089727 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03928d1a-5d36-4a90-8b94-d751ec58f01d tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:23.090692 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03928d1a-5d36-4a90-8b94-d751ec58f01d tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:23.126030 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-03928d1a-5d36-4a90-8b94-d751ec58f01d tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] HTTP exception thrown: Instance c1406c0f-748a-4dae-9392-6957d4092c9f could not be found. Sep 08 10:43:23.132996 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-03928d1a-5d36-4a90-8b94-d751ec58f01d tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Request method failure captured: Sep 08 10:43:23.132996 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/c1406c0f-748a-4dae-9392-6957d4092c9f/os-volume_attachments HTTP/1.1 Sep 08 10:43:23.132996 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:43:23.132996 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:43:23.132996 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:43:23.132996 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:43:23.132996 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:43:23.132996 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:43:23.132996 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:43:23.132996 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:43:23.132996 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcbOYaOup_Ia1bHuprOxxP_LkfdCzYSX9xstQr2GVmRBueUQ0e967rlioz5jpJV566ZCuz_bYy_us0o8_CIFlOGOVfrC9_e_1_vEhZ3YdgjG89HBhaIJ_lG7Uv4nQrC-nfHrMx_LNyd0rOd4Blcm801SOcX7oe5VDxGTE8KVTDSeMPw Sep 08 10:43:23.132996 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:43:23.132996 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:43:23.132996 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:43:23.132996 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:43:23.132996 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:43:23.132996 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:43:23.132996 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 998378cc815344ba8a107d1cd61f40fd Sep 08 10:43:23.132996 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-DeleteServersTestJSON-69164830 Sep 08 10:43:23.132996 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:43:23.132996 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:43:23.132996 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:43:23.132996 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-DeleteServersTestJSON-69164830 Sep 08 10:43:23.132996 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 998378cc815344ba8a107d1cd61f40fd Sep 08 10:43:23.132996 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-DeleteServersTestJSON-69164830 Sep 08 10:43:23.132996 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-DeleteServersTestJSON-69164830-project Sep 08 10:43:23.132996 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:43:23.132996 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:43:23.132996 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: d08269c53bcb41c88953e7c79f5ad185 Sep 08 10:43:23.132996 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-DeleteServersTestJSON-69164830-project Sep 08 10:43:23.132996 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:43:23.132996 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance c1406c0f-748a-4dae-9392-6957d4092c9f could not be found. Sep 08 10:43:23.132996 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'server_id': 'c1406c0f-748a-4dae-9392-6957d4092c9f'} Sep 08 10:43:23.132996 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:43:23.132996 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:43:23.132996 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:43:23.132996 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:43:23.132996 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:43:23.132996 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:43:23.132996 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:43:23.132996 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:43:23.132996 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:43:23.132996 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:43:23.132996 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1406c0f-748a-4dae-9392-6957d4092c9f could not be found. Sep 08 10:43:23.132996 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:43:23.132996 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:43:23.132996 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:43:23.132996 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:43:23.132996 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:43:23.132996 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:43:23.132996 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:43:23.132996 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:43:23.132996 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:43:23.132996 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:43:23.132996 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 08 10:43:23.132996 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:43:23.132996 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 08 10:43:23.132996 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:43:23.132996 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 08 10:43:23.132996 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 08 10:43:23.132996 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:43:23.132996 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:43:23.140927 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1406c0f-748a-4dae-9392-6957d4092c9f could not be found. Sep 08 10:43:23.140927 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:43:23.140927 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:43:23.140927 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:43:23.140927 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:43:23.140927 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:43:23.140927 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:43:23.140927 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:43:23.140927 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:43:23.140927 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1406c0f-748a-4dae-9392-6957d4092c9f could not be found. Sep 08 10:43:23.140927 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:43:23.140927 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-03928d1a-5d36-4a90-8b94-d751ec58f01d tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Returning 404 to user: Instance c1406c0f-748a-4dae-9392-6957d4092c9f could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:43:23.140927 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-03928d1a-5d36-4a90-8b94-d751ec58f01d tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/c1406c0f-748a-4dae-9392-6957d4092c9f/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.085665 Sep 08 10:43:23.142080 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 748/1464] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 10:43:23 2022] GET /compute/v2.1/servers/c1406c0f-748a-4dae-9392-6957d4092c9f/os-volume_attachments => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:43:23.240240 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-1ce7d0d6-ae66-4e5d-adda-1e527125d39f req-d23abacc-4ca2-43dc-b32e-b4049f0c6ef2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dac27157-b08e-4f13-b97e-3c5b653bd0b3", "tag": "0ad27959-ff24-48b6-9469-c1b114584c1e"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:43:23.275754 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-1ce7d0d6-ae66-4e5d-adda-1e527125d39f req-d23abacc-4ca2-43dc-b32e-b4049f0c6ef2 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:23.276415 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-1ce7d0d6-ae66-4e5d-adda-1e527125d39f req-d23abacc-4ca2-43dc-b32e-b4049f0c6ef2 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:23.276863 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-1ce7d0d6-ae66-4e5d-adda-1e527125d39f req-d23abacc-4ca2-43dc-b32e-b4049f0c6ef2 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:23.297750 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f00462c3-f0c8-4586-bac4-2fdeb2b5c3b8 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:23.308526 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-1ce7d0d6-ae66-4e5d-adda-1e527125d39f req-d23abacc-4ca2-43dc-b32e-b4049f0c6ef2 service nova] Creating event network-changed:0ad27959-ff24-48b6-9469-c1b114584c1e for instance dac27157-b08e-4f13-b97e-3c5b653bd0b3 on n-h1-850501-12 Sep 08 10:43:23.318013 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f00462c3-f0c8-4586-bac4-2fdeb2b5c3b8 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9072eb-573f-4576-b922-57245258445e" status: 200 len: 1308 microversion: 2.1 time: 0.369361 Sep 08 10:43:23.321408 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-1ce7d0d6-ae66-4e5d-adda-1e527125d39f req-d23abacc-4ca2-43dc-b32e-b4049f0c6ef2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088575 Sep 08 10:43:23.325557 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 717/1465] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:22 2022] GET /compute/v2.1/servers/5a9072eb-573f-4576-b922-57245258445e => generated 1308 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:23.326444 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 749/1466] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:43:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:43:23.436366 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c8fa9139-1f69-4919-aa36-809b44b0315b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1111413760", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "cf032a39-d4e2-476c-8052-c76f4ee567c9"}]}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:43:23.466458 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6946de21-357b-4da6-bedf-b0ea1d749016 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:23.467178 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6946de21-357b-4da6-bedf-b0ea1d749016 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 287be913-2461-45d0-8000-360c3fdb5940] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:23.486822 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6946de21-357b-4da6-bedf-b0ea1d749016 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:23.487670 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6946de21-357b-4da6-bedf-b0ea1d749016 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:23.488123 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6946de21-357b-4da6-bedf-b0ea1d749016 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:23.488858 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6946de21-357b-4da6-bedf-b0ea1d749016 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:23.489346 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6946de21-357b-4da6-bedf-b0ea1d749016 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:23.489856 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6946de21-357b-4da6-bedf-b0ea1d749016 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:23.508041 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-c8fa9139-1f69-4919-aa36-809b44b0315b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] validate_networks() for [('cf032a39-d4e2-476c-8052-c76f4ee567c9', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:43:23.841486 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6946de21-357b-4da6-bedf-b0ea1d749016 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:23.854754 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6946de21-357b-4da6-bedf-b0ea1d749016 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940" status: 200 len: 1477 microversion: 2.1 time: 0.394757 Sep 08 10:43:23.856984 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 750/1467] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:23 2022] GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940 => generated 1477 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:23.865603 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6b7dd822-bb7c-4b48-885d-a533d2144a7e tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:23.867227 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6b7dd822-bb7c-4b48-885d-a533d2144a7e tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] [instance: 24a25908-e543-400e-b922-392c9604ec2e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:23.876245 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b7dd822-bb7c-4b48-885d-a533d2144a7e tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:23.877430 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b7dd822-bb7c-4b48-885d-a533d2144a7e tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:23.879351 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b7dd822-bb7c-4b48-885d-a533d2144a7e tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:23.880598 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b7dd822-bb7c-4b48-885d-a533d2144a7e tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:23.881418 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b7dd822-bb7c-4b48-885d-a533d2144a7e tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:23.883838 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b7dd822-bb7c-4b48-885d-a533d2144a7e tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:23.992391 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6b7dd822-bb7c-4b48-885d-a533d2144a7e tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e25e1f9b61a4cddaa50e2a841aa7082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de26f1b9fbbb4e31b1f4535a5a1ff512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:24.003396 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6b7dd822-bb7c-4b48-885d-a533d2144a7e tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e25e1f9b61a4cddaa50e2a841aa7082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de26f1b9fbbb4e31b1f4535a5a1ff512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:24.005214 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6b7dd822-bb7c-4b48-885d-a533d2144a7e tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e25e1f9b61a4cddaa50e2a841aa7082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de26f1b9fbbb4e31b1f4535a5a1ff512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:24.006591 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6b7dd822-bb7c-4b48-885d-a533d2144a7e tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] 10.222.0.27 "GET /compute/v2.1/servers/24a25908-e543-400e-b922-392c9604ec2e" status: 200 len: 1408 microversion: 2.54 time: 0.146034 Sep 08 10:43:24.008278 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 751/1468] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:43:23 2022] GET /compute/v2.1/servers/24a25908-e543-400e-b922-392c9604ec2e => generated 1408 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:43:24.014763 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-88c43cc1-9ebb-4ba8-a26d-872a9a4ae7e2 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:24.015758 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-88c43cc1-9ebb-4ba8-a26d-872a9a4ae7e2 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: cf3b6c0e-d390-44d6-91e5-09b389dff551] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:24.025753 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-88c43cc1-9ebb-4ba8-a26d-872a9a4ae7e2 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:24.038028 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-88c43cc1-9ebb-4ba8-a26d-872a9a4ae7e2 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:24.039070 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-88c43cc1-9ebb-4ba8-a26d-872a9a4ae7e2 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:24.040028 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-88c43cc1-9ebb-4ba8-a26d-872a9a4ae7e2 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:24.040768 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-88c43cc1-9ebb-4ba8-a26d-872a9a4ae7e2 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:24.041402 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-88c43cc1-9ebb-4ba8-a26d-872a9a4ae7e2 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:24.169413 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-88c43cc1-9ebb-4ba8-a26d-872a9a4ae7e2 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:24.185362 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-88c43cc1-9ebb-4ba8-a26d-872a9a4ae7e2 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:24.186895 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-88c43cc1-9ebb-4ba8-a26d-872a9a4ae7e2 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:24.188036 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-88c43cc1-9ebb-4ba8-a26d-872a9a4ae7e2 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551" status: 200 len: 1176 microversion: 2.25 time: 0.178254 Sep 08 10:43:24.188807 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 752/1469] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:43:24 2022] GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551 => generated 1176 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:43:24.193541 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-79387269-12e6-4399-a474-1c2f09a66deb req-e811f7f3-4a83-43e5-bdda-c4880f4229b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a9072eb-573f-4576-b922-57245258445e", "name": "network-vif-plugged", "status": "completed", "tag": "b11c68f4-e560-4a23-9f9a-548f2856de5f"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:43:24.205469 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-79387269-12e6-4399-a474-1c2f09a66deb req-e811f7f3-4a83-43e5-bdda-c4880f4229b5 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:24.206244 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-79387269-12e6-4399-a474-1c2f09a66deb req-e811f7f3-4a83-43e5-bdda-c4880f4229b5 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:24.206852 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-79387269-12e6-4399-a474-1c2f09a66deb req-e811f7f3-4a83-43e5-bdda-c4880f4229b5 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:24.210101 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:43:24.222950 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-79387269-12e6-4399-a474-1c2f09a66deb req-e811f7f3-4a83-43e5-bdda-c4880f4229b5 service nova] Creating event network-vif-plugged:b11c68f4-e560-4a23-9f9a-548f2856de5f for instance 5a9072eb-573f-4576-b922-57245258445e on n-h1-850501-12 Sep 08 10:43:24.233015 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-79387269-12e6-4399-a474-1c2f09a66deb req-e811f7f3-4a83-43e5-bdda-c4880f4229b5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043009 Sep 08 10:43:24.234449 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 753/1470] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:43:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:43:24.241781 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-498fe833-79a5-4d8e-91fe-c63e9b6ae130 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:24.242763 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-498fe833-79a5-4d8e-91fe-c63e9b6ae130 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] [instance: dac27157-b08e-4f13-b97e-3c5b653bd0b3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:24.248849 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:43:24.251414 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-498fe833-79a5-4d8e-91fe-c63e9b6ae130 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:24.252194 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-498fe833-79a5-4d8e-91fe-c63e9b6ae130 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:24.252834 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-498fe833-79a5-4d8e-91fe-c63e9b6ae130 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:24.253749 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-498fe833-79a5-4d8e-91fe-c63e9b6ae130 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:24.254532 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-498fe833-79a5-4d8e-91fe-c63e9b6ae130 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:24.255267 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-498fe833-79a5-4d8e-91fe-c63e9b6ae130 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:24.328824 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-c8fa9139-1f69-4919-aa36-809b44b0315b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:43:24.330466 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-c8fa9139-1f69-4919-aa36-809b44b0315b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:43:24.331120 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-c8fa9139-1f69-4919-aa36-809b44b0315b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:43:24.331751 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-c8fa9139-1f69-4919-aa36-809b44b0315b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:43:24.332895 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-c8fa9139-1f69-4919-aa36-809b44b0315b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:43:24.345070 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c8fa9139-1f69-4919-aa36-809b44b0315b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:24.345904 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c8fa9139-1f69-4919-aa36-809b44b0315b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:24.346534 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c8fa9139-1f69-4919-aa36-809b44b0315b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:24.348844 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c8fa9139-1f69-4919-aa36-809b44b0315b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:24.349558 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c8fa9139-1f69-4919-aa36-809b44b0315b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:24.350196 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c8fa9139-1f69-4919-aa36-809b44b0315b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:24.378840 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-c8fa9139-1f69-4919-aa36-809b44b0315b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Getting quotas for project 998378cc815344ba8a107d1cd61f40fd. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:43:24.385228 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-c8fa9139-1f69-4919-aa36-809b44b0315b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Getting quotas for user d08269c53bcb41c88953e7c79f5ad185 and project 998378cc815344ba8a107d1cd61f40fd. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:43:24.402071 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c8fa9139-1f69-4919-aa36-809b44b0315b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:43:24.404824 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c8fa9139-1f69-4919-aa36-809b44b0315b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 2748dac9-3592-45b6-afe2-03a226e1026a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:43:24.480274 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c8fa9139-1f69-4919-aa36-809b44b0315b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.054318 Sep 08 10:43:24.485652 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 718/1471] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:43:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1062 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:43:24.522379 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-743cfe72-835d-4c32-a593-c10329ae57a1 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:24.523011 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-743cfe72-835d-4c32-a593-c10329ae57a1 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 5a9072eb-573f-4576-b922-57245258445e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:24.541956 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-743cfe72-835d-4c32-a593-c10329ae57a1 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:24.542462 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-743cfe72-835d-4c32-a593-c10329ae57a1 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:24.542906 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-743cfe72-835d-4c32-a593-c10329ae57a1 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:24.544311 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-743cfe72-835d-4c32-a593-c10329ae57a1 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:24.544775 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-743cfe72-835d-4c32-a593-c10329ae57a1 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:24.553527 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-743cfe72-835d-4c32-a593-c10329ae57a1 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:24.675704 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-498fe833-79a5-4d8e-91fe-c63e9b6ae130 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7415a5b46c4587a8806661b70e3913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604588959944720923ec2d5e0bf81c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:24.686005 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-498fe833-79a5-4d8e-91fe-c63e9b6ae130 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/servers/dac27157-b08e-4f13-b97e-3c5b653bd0b3" status: 200 len: 1317 microversion: 2.1 time: 0.449174 Sep 08 10:43:24.703222 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 754/1472] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:24 2022] GET /compute/v2.1/servers/dac27157-b08e-4f13-b97e-3c5b653bd0b3 => generated 1317 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:24.708446 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6f598369-ceb4-4c76-acd3-e22988df67c5 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:24.709071 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6f598369-ceb4-4c76-acd3-e22988df67c5 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 2748dac9-3592-45b6-afe2-03a226e1026a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:24.771987 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6f598369-ceb4-4c76-acd3-e22988df67c5 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:24.781984 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6f598369-ceb4-4c76-acd3-e22988df67c5 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/2748dac9-3592-45b6-afe2-03a226e1026a" status: 200 len: 1215 microversion: 2.1 time: 0.077531 Sep 08 10:43:24.783466 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 755/1473] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:24 2022] GET /compute/v2.1/servers/2748dac9-3592-45b6-afe2-03a226e1026a => generated 1215 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:24.804437 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b63c0067-ad09-431f-a407-52148c502f4a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:24.804947 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b63c0067-ad09-431f-a407-52148c502f4a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 2748dac9-3592-45b6-afe2-03a226e1026a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:24.822300 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-743cfe72-835d-4c32-a593-c10329ae57a1 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:24.831441 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-743cfe72-835d-4c32-a593-c10329ae57a1 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9072eb-573f-4576-b922-57245258445e" status: 200 len: 1308 microversion: 2.1 time: 0.344406 Sep 08 10:43:24.836896 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b63c0067-ad09-431f-a407-52148c502f4a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 2748dac9-3592-45b6-afe2-03a226e1026a] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:43:24.838947 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 719/1474] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:24 2022] GET /compute/v2.1/servers/5a9072eb-573f-4576-b922-57245258445e => generated 1308 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:24.893659 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-48bf07d7-8438-4a6c-ad0e-a3325459ede0 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:24.894455 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-48bf07d7-8438-4a6c-ad0e-a3325459ede0 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 287be913-2461-45d0-8000-360c3fdb5940] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:24.919163 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-48bf07d7-8438-4a6c-ad0e-a3325459ede0 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:24.919734 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-48bf07d7-8438-4a6c-ad0e-a3325459ede0 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:24.926402 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-48bf07d7-8438-4a6c-ad0e-a3325459ede0 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:24.927182 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-48bf07d7-8438-4a6c-ad0e-a3325459ede0 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:24.931580 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-48bf07d7-8438-4a6c-ad0e-a3325459ede0 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:24.933516 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-48bf07d7-8438-4a6c-ad0e-a3325459ede0 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:25.195240 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-48bf07d7-8438-4a6c-ad0e-a3325459ede0 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:25.208853 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.compute.api [None req-b63c0067-ad09-431f-a407-52148c502f4a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 2748dac9-3592-45b6-afe2-03a226e1026a] Instance Mapping does not exist while attempting local delete cleanup. Sep 08 10:43:25.214212 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b63c0067-ad09-431f-a407-52148c502f4a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2748dac9-3592-45b6-afe2-03a226e1026a" status: 204 len: 0 microversion: 2.1 time: 0.409914 Sep 08 10:43:25.214884 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 756/1475] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:43:24 2022] DELETE /compute/v2.1/servers/2748dac9-3592-45b6-afe2-03a226e1026a => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:43:25.220998 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-48bf07d7-8438-4a6c-ad0e-a3325459ede0 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940" status: 200 len: 1477 microversion: 2.1 time: 0.331901 Sep 08 10:43:25.221612 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 720/1476] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:24 2022] GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940 => generated 1477 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:25.229732 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b48c4471-132f-45bd-8d15-cece00a2e871 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:25.230655 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b48c4471-132f-45bd-8d15-cece00a2e871 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] [instance: 24a25908-e543-400e-b922-392c9604ec2e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:25.239361 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1ad4ecdf-2a8f-4327-82cd-9c66c52c0b30 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:25.240585 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1ad4ecdf-2a8f-4327-82cd-9c66c52c0b30 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: cf3b6c0e-d390-44d6-91e5-09b389dff551] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:25.249968 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b48c4471-132f-45bd-8d15-cece00a2e871 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:25.253294 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1ad4ecdf-2a8f-4327-82cd-9c66c52c0b30 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:25.255069 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b48c4471-132f-45bd-8d15-cece00a2e871 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:25.255784 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b48c4471-132f-45bd-8d15-cece00a2e871 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:25.256784 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b48c4471-132f-45bd-8d15-cece00a2e871 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:25.257509 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b48c4471-132f-45bd-8d15-cece00a2e871 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:25.258727 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1ad4ecdf-2a8f-4327-82cd-9c66c52c0b30 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:25.259395 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b48c4471-132f-45bd-8d15-cece00a2e871 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:25.261073 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1ad4ecdf-2a8f-4327-82cd-9c66c52c0b30 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:25.261989 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1ad4ecdf-2a8f-4327-82cd-9c66c52c0b30 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:25.264386 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1ad4ecdf-2a8f-4327-82cd-9c66c52c0b30 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:25.267450 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1ad4ecdf-2a8f-4327-82cd-9c66c52c0b30 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:25.382663 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b48c4471-132f-45bd-8d15-cece00a2e871 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e25e1f9b61a4cddaa50e2a841aa7082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de26f1b9fbbb4e31b1f4535a5a1ff512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:25.393994 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b48c4471-132f-45bd-8d15-cece00a2e871 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e25e1f9b61a4cddaa50e2a841aa7082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de26f1b9fbbb4e31b1f4535a5a1ff512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:25.396585 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b48c4471-132f-45bd-8d15-cece00a2e871 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e25e1f9b61a4cddaa50e2a841aa7082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de26f1b9fbbb4e31b1f4535a5a1ff512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:25.397946 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b48c4471-132f-45bd-8d15-cece00a2e871 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] 10.222.0.27 "GET /compute/v2.1/servers/24a25908-e543-400e-b922-392c9604ec2e" status: 200 len: 1408 microversion: 2.54 time: 0.180361 Sep 08 10:43:25.399920 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 757/1477] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:43:25 2022] GET /compute/v2.1/servers/24a25908-e543-400e-b922-392c9604ec2e => generated 1408 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:43:25.411283 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b33dc3bc-74c3-411f-b9e2-750968556e35 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:25.412269 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b33dc3bc-74c3-411f-b9e2-750968556e35 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 2748dac9-3592-45b6-afe2-03a226e1026a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:25.429060 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-b33dc3bc-74c3-411f-b9e2-750968556e35 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] HTTP exception thrown: Instance 2748dac9-3592-45b6-afe2-03a226e1026a could not be found. Sep 08 10:43:25.431383 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b33dc3bc-74c3-411f-b9e2-750968556e35 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Request method failure captured: Sep 08 10:43:25.431383 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/2748dac9-3592-45b6-afe2-03a226e1026a HTTP/1.1 Sep 08 10:43:25.431383 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:43:25.431383 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:43:25.431383 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:43:25.431383 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:43:25.431383 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:43:25.431383 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:43:25.431383 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:43:25.431383 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:43:25.431383 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcbOYaOup_Ia1bHuprOxxP_LkfdCzYSX9xstQr2GVmRBueUQ0e967rlioz5jpJV566ZCuz_bYy_us0o8_CIFlOGOVfrC9_e_1_vEhZ3YdgjG89HBhaIJ_lG7Uv4nQrC-nfHrMx_LNyd0rOd4Blcm801SOcX7oe5VDxGTE8KVTDSeMPw Sep 08 10:43:25.431383 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:43:25.431383 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:43:25.431383 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:43:25.431383 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:43:25.431383 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:43:25.431383 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:43:25.431383 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 998378cc815344ba8a107d1cd61f40fd Sep 08 10:43:25.431383 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-DeleteServersTestJSON-69164830 Sep 08 10:43:25.431383 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:43:25.431383 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:43:25.431383 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:43:25.431383 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-DeleteServersTestJSON-69164830 Sep 08 10:43:25.431383 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 998378cc815344ba8a107d1cd61f40fd Sep 08 10:43:25.431383 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-DeleteServersTestJSON-69164830 Sep 08 10:43:25.431383 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-DeleteServersTestJSON-69164830-project Sep 08 10:43:25.431383 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:43:25.431383 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:43:25.431383 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: d08269c53bcb41c88953e7c79f5ad185 Sep 08 10:43:25.431383 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-DeleteServersTestJSON-69164830-project Sep 08 10:43:25.431383 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:43:25.431383 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 2748dac9-3592-45b6-afe2-03a226e1026a could not be found. Sep 08 10:43:25.431383 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '2748dac9-3592-45b6-afe2-03a226e1026a'} Sep 08 10:43:25.431383 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:43:25.431383 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:43:25.431383 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:43:25.431383 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:43:25.431383 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:43:25.431383 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:43:25.431383 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 08 10:43:25.431383 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 08 10:43:25.431383 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2748dac9-3592-45b6-afe2-03a226e1026a could not be found. Sep 08 10:43:25.431383 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:43:25.431383 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:43:25.431383 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:43:25.431383 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:43:25.431383 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:43:25.431383 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:43:25.431383 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:43:25.431383 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:43:25.431383 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:43:25.431383 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:43:25.431383 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:43:25.431383 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:43:25.431383 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:43:25.431383 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:43:25.431383 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:43:25.431383 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:43:25.431383 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2748dac9-3592-45b6-afe2-03a226e1026a could not be found. Sep 08 10:43:25.431383 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:43:25.431383 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:43:25.431383 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:43:25.431383 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:43:25.431383 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:43:25.435745 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:43:25.435745 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:43:25.435745 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:43:25.435745 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2748dac9-3592-45b6-afe2-03a226e1026a could not be found. Sep 08 10:43:25.435745 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:43:25.437974 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b33dc3bc-74c3-411f-b9e2-750968556e35 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Returning 404 to user: Instance 2748dac9-3592-45b6-afe2-03a226e1026a could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:43:25.439144 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b33dc3bc-74c3-411f-b9e2-750968556e35 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/2748dac9-3592-45b6-afe2-03a226e1026a" status: 404 len: 111 microversion: 2.1 time: 0.038228 Sep 08 10:43:25.440370 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 758/1478] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:25 2022] GET /compute/v2.1/servers/2748dac9-3592-45b6-afe2-03a226e1026a => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:43:25.444915 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1ad4ecdf-2a8f-4327-82cd-9c66c52c0b30 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:25.464879 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1ad4ecdf-2a8f-4327-82cd-9c66c52c0b30 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:25.485972 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1ad4ecdf-2a8f-4327-82cd-9c66c52c0b30 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:25.487364 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1ad4ecdf-2a8f-4327-82cd-9c66c52c0b30 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551" status: 200 len: 1232 microversion: 2.25 time: 0.260464 Sep 08 10:43:25.498413 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 721/1479] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:43:25 2022] GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551 => generated 1232 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:43:25.526367 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ee74a888-eea3-4e19-b50d-948fee43144c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1197673270", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "cf032a39-d4e2-476c-8052-c76f4ee567c9"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:43:25.599569 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-ee74a888-eea3-4e19-b50d-948fee43144c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] validate_networks() for [('cf032a39-d4e2-476c-8052-c76f4ee567c9', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:43:25.712038 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d9058d0b-b13b-44ba-8ad3-e0c468b6359e tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:25.713013 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d9058d0b-b13b-44ba-8ad3-e0c468b6359e tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] [instance: dac27157-b08e-4f13-b97e-3c5b653bd0b3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:25.732466 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d9058d0b-b13b-44ba-8ad3-e0c468b6359e tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:25.736888 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d9058d0b-b13b-44ba-8ad3-e0c468b6359e tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:25.737883 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d9058d0b-b13b-44ba-8ad3-e0c468b6359e tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:25.739026 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d9058d0b-b13b-44ba-8ad3-e0c468b6359e tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:25.739731 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d9058d0b-b13b-44ba-8ad3-e0c468b6359e tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:25.740500 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d9058d0b-b13b-44ba-8ad3-e0c468b6359e tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:25.950833 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d9058d0b-b13b-44ba-8ad3-e0c468b6359e tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7415a5b46c4587a8806661b70e3913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604588959944720923ec2d5e0bf81c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:25.961368 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d9058d0b-b13b-44ba-8ad3-e0c468b6359e tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/servers/dac27157-b08e-4f13-b97e-3c5b653bd0b3" status: 200 len: 1317 microversion: 2.1 time: 0.254717 Sep 08 10:43:25.962839 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 722/1480] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:25 2022] GET /compute/v2.1/servers/dac27157-b08e-4f13-b97e-3c5b653bd0b3 => generated 1317 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:25.969402 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4b8ffb9f-f6d1-443d-b311-ca3837baec34 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:25.970619 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4b8ffb9f-f6d1-443d-b311-ca3837baec34 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 5a9072eb-573f-4576-b922-57245258445e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:25.977931 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4b8ffb9f-f6d1-443d-b311-ca3837baec34 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:25.978733 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4b8ffb9f-f6d1-443d-b311-ca3837baec34 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:25.979330 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4b8ffb9f-f6d1-443d-b311-ca3837baec34 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:25.980223 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4b8ffb9f-f6d1-443d-b311-ca3837baec34 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:25.981565 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4b8ffb9f-f6d1-443d-b311-ca3837baec34 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:25.982312 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4b8ffb9f-f6d1-443d-b311-ca3837baec34 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:26.291214 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4b8ffb9f-f6d1-443d-b311-ca3837baec34 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:26.300681 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4b8ffb9f-f6d1-443d-b311-ca3837baec34 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9072eb-573f-4576-b922-57245258445e" status: 200 len: 1308 microversion: 2.1 time: 0.336338 Sep 08 10:43:26.301294 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 723/1481] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:25 2022] GET /compute/v2.1/servers/5a9072eb-573f-4576-b922-57245258445e => generated 1308 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:26.310284 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3fac2771-08c5-4326-9ddf-07ccd06f7d21 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:26.311258 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3fac2771-08c5-4326-9ddf-07ccd06f7d21 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 287be913-2461-45d0-8000-360c3fdb5940] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:26.319366 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3fac2771-08c5-4326-9ddf-07ccd06f7d21 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:26.320391 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3fac2771-08c5-4326-9ddf-07ccd06f7d21 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:26.320994 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3fac2771-08c5-4326-9ddf-07ccd06f7d21 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:26.321971 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3fac2771-08c5-4326-9ddf-07ccd06f7d21 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:26.322835 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3fac2771-08c5-4326-9ddf-07ccd06f7d21 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:26.323476 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3fac2771-08c5-4326-9ddf-07ccd06f7d21 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:26.541231 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-3fac2771-08c5-4326-9ddf-07ccd06f7d21 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:26.551633 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3fac2771-08c5-4326-9ddf-07ccd06f7d21 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940" status: 200 len: 1477 microversion: 2.1 time: 0.247811 Sep 08 10:43:26.552287 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 724/1482] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:26 2022] GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940 => generated 1477 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:26.562040 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-ee74a888-eea3-4e19-b50d-948fee43144c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:43:26.562830 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-ee74a888-eea3-4e19-b50d-948fee43144c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:43:26.563178 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-ee74a888-eea3-4e19-b50d-948fee43144c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:43:26.563745 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-ee74a888-eea3-4e19-b50d-948fee43144c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:43:26.564262 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-ee74a888-eea3-4e19-b50d-948fee43144c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:43:26.576548 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-84bb1a64-2762-4cd0-88ca-ddd3dbc7ec02 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:26.577242 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-84bb1a64-2762-4cd0-88ca-ddd3dbc7ec02 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] [instance: 24a25908-e543-400e-b922-392c9604ec2e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:26.579754 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ee74a888-eea3-4e19-b50d-948fee43144c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:26.583705 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-84bb1a64-2762-4cd0-88ca-ddd3dbc7ec02 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:26.584200 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-84bb1a64-2762-4cd0-88ca-ddd3dbc7ec02 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:26.584547 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ee74a888-eea3-4e19-b50d-948fee43144c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:26.584679 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-84bb1a64-2762-4cd0-88ca-ddd3dbc7ec02 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:26.585220 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ee74a888-eea3-4e19-b50d-948fee43144c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:26.585379 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-84bb1a64-2762-4cd0-88ca-ddd3dbc7ec02 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:26.586331 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ee74a888-eea3-4e19-b50d-948fee43144c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:26.586908 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-84bb1a64-2762-4cd0-88ca-ddd3dbc7ec02 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:26.587050 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ee74a888-eea3-4e19-b50d-948fee43144c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:26.587351 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-84bb1a64-2762-4cd0-88ca-ddd3dbc7ec02 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:26.587927 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ee74a888-eea3-4e19-b50d-948fee43144c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:26.653469 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-ee74a888-eea3-4e19-b50d-948fee43144c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Getting quotas for project 998378cc815344ba8a107d1cd61f40fd. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:43:26.660273 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-ee74a888-eea3-4e19-b50d-948fee43144c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Getting quotas for user d08269c53bcb41c88953e7c79f5ad185 and project 998378cc815344ba8a107d1cd61f40fd. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:43:26.676401 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-84bb1a64-2762-4cd0-88ca-ddd3dbc7ec02 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e25e1f9b61a4cddaa50e2a841aa7082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de26f1b9fbbb4e31b1f4535a5a1ff512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:26.686995 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ee74a888-eea3-4e19-b50d-948fee43144c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:43:26.696638 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ee74a888-eea3-4e19-b50d-948fee43144c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 82f0d3c4-fc81-428a-9141-2cc36da8b1b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:43:26.699067 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-84bb1a64-2762-4cd0-88ca-ddd3dbc7ec02 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e25e1f9b61a4cddaa50e2a841aa7082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de26f1b9fbbb4e31b1f4535a5a1ff512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:26.701845 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-84bb1a64-2762-4cd0-88ca-ddd3dbc7ec02 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e25e1f9b61a4cddaa50e2a841aa7082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de26f1b9fbbb4e31b1f4535a5a1ff512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:26.704152 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-84bb1a64-2762-4cd0-88ca-ddd3dbc7ec02 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] 10.222.0.27 "GET /compute/v2.1/servers/24a25908-e543-400e-b922-392c9604ec2e" status: 200 len: 1414 microversion: 2.54 time: 0.136575 Sep 08 10:43:26.705550 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 725/1483] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:43:26 2022] GET /compute/v2.1/servers/24a25908-e543-400e-b922-392c9604ec2e => generated 1414 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:43:26.713006 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9ff00214-85a3-4ea5-8f45-17f666cfde71 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:26.713847 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9ff00214-85a3-4ea5-8f45-17f666cfde71 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: cf3b6c0e-d390-44d6-91e5-09b389dff551] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:26.729453 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ff00214-85a3-4ea5-8f45-17f666cfde71 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:26.730599 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ff00214-85a3-4ea5-8f45-17f666cfde71 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:26.732381 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ff00214-85a3-4ea5-8f45-17f666cfde71 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:26.733642 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ff00214-85a3-4ea5-8f45-17f666cfde71 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:26.734657 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ff00214-85a3-4ea5-8f45-17f666cfde71 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:26.735571 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ff00214-85a3-4ea5-8f45-17f666cfde71 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:26.801476 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ee74a888-eea3-4e19-b50d-948fee43144c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.281096 Sep 08 10:43:26.809204 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 759/1484] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:43:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1284 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:43:26.814807 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-04045dee-5b07-4641-8aa2-f52ebf3e0eb3 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:26.815567 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-04045dee-5b07-4641-8aa2-f52ebf3e0eb3 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 82f0d3c4-fc81-428a-9141-2cc36da8b1b2] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:26.914615 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9ff00214-85a3-4ea5-8f45-17f666cfde71 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:26.926969 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9ff00214-85a3-4ea5-8f45-17f666cfde71 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:26.928959 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9ff00214-85a3-4ea5-8f45-17f666cfde71 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:26.930448 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9ff00214-85a3-4ea5-8f45-17f666cfde71 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551" status: 200 len: 1232 microversion: 2.25 time: 0.223364 Sep 08 10:43:26.931576 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 726/1485] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:43:26 2022] GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551 => generated 1232 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:43:26.981667 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-04045dee-5b07-4641-8aa2-f52ebf3e0eb3 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:26.992375 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-50497bbc-cd99-49d8-83af-d6bbdea72469 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:26.993050 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-50497bbc-cd99-49d8-83af-d6bbdea72469 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] [instance: dac27157-b08e-4f13-b97e-3c5b653bd0b3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:26.998069 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-04045dee-5b07-4641-8aa2-f52ebf3e0eb3 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/82f0d3c4-fc81-428a-9141-2cc36da8b1b2" status: 200 len: 1215 microversion: 2.1 time: 0.187175 Sep 08 10:43:27.000258 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 760/1486] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:26 2022] GET /compute/v2.1/servers/82f0d3c4-fc81-428a-9141-2cc36da8b1b2 => generated 1215 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:27.010507 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-50497bbc-cd99-49d8-83af-d6bbdea72469 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:27.013168 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-50497bbc-cd99-49d8-83af-d6bbdea72469 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:27.014429 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-50497bbc-cd99-49d8-83af-d6bbdea72469 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:27.020730 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-50497bbc-cd99-49d8-83af-d6bbdea72469 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:27.021370 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-50497bbc-cd99-49d8-83af-d6bbdea72469 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:27.021887 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-50497bbc-cd99-49d8-83af-d6bbdea72469 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:27.328432 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fc0fde44-d4c7-47b9-af6b-c8282a42c9b9 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:27.329094 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fc0fde44-d4c7-47b9-af6b-c8282a42c9b9 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 5a9072eb-573f-4576-b922-57245258445e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:27.342194 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fc0fde44-d4c7-47b9-af6b-c8282a42c9b9 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:27.346210 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-50497bbc-cd99-49d8-83af-d6bbdea72469 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7415a5b46c4587a8806661b70e3913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604588959944720923ec2d5e0bf81c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:27.347873 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fc0fde44-d4c7-47b9-af6b-c8282a42c9b9 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:27.348342 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fc0fde44-d4c7-47b9-af6b-c8282a42c9b9 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:27.349235 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fc0fde44-d4c7-47b9-af6b-c8282a42c9b9 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:27.353252 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fc0fde44-d4c7-47b9-af6b-c8282a42c9b9 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:27.354161 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fc0fde44-d4c7-47b9-af6b-c8282a42c9b9 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:27.357697 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-50497bbc-cd99-49d8-83af-d6bbdea72469 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/servers/dac27157-b08e-4f13-b97e-3c5b653bd0b3" status: 200 len: 1317 microversion: 2.1 time: 0.371959 Sep 08 10:43:27.358937 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 727/1487] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:26 2022] GET /compute/v2.1/servers/dac27157-b08e-4f13-b97e-3c5b653bd0b3 => generated 1317 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:27.581342 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c1f23070-6fcf-454e-b748-6b329f13f7bd tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:27.582244 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c1f23070-6fcf-454e-b748-6b329f13f7bd tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 287be913-2461-45d0-8000-360c3fdb5940] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:27.594704 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c1f23070-6fcf-454e-b748-6b329f13f7bd tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:27.595211 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c1f23070-6fcf-454e-b748-6b329f13f7bd tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:27.595858 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c1f23070-6fcf-454e-b748-6b329f13f7bd tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:27.596609 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c1f23070-6fcf-454e-b748-6b329f13f7bd tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:27.597115 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c1f23070-6fcf-454e-b748-6b329f13f7bd tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:27.597905 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c1f23070-6fcf-454e-b748-6b329f13f7bd tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:27.750708 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fc0fde44-d4c7-47b9-af6b-c8282a42c9b9 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:27.764637 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fc0fde44-d4c7-47b9-af6b-c8282a42c9b9 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9072eb-573f-4576-b922-57245258445e" status: 200 len: 1487 microversion: 2.1 time: 0.436113 Sep 08 10:43:27.766132 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 761/1488] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:27 2022] GET /compute/v2.1/servers/5a9072eb-573f-4576-b922-57245258445e => generated 1487 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:43:27.776012 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b0b4244f-54c1-4427-a5b7-37123956cefe tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:27.776962 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b0b4244f-54c1-4427-a5b7-37123956cefe tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] [instance: 24a25908-e543-400e-b922-392c9604ec2e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:27.788984 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b0b4244f-54c1-4427-a5b7-37123956cefe tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:27.789856 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b0b4244f-54c1-4427-a5b7-37123956cefe tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:27.790513 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b0b4244f-54c1-4427-a5b7-37123956cefe tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:27.791464 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b0b4244f-54c1-4427-a5b7-37123956cefe tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:27.792137 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b0b4244f-54c1-4427-a5b7-37123956cefe tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:27.792807 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b0b4244f-54c1-4427-a5b7-37123956cefe tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:28.153344 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c1f23070-6fcf-454e-b748-6b329f13f7bd tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:28.188097 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c1f23070-6fcf-454e-b748-6b329f13f7bd tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940" status: 200 len: 1477 microversion: 2.1 time: 0.610398 Sep 08 10:43:28.189089 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 728/1489] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:27 2022] GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940 => generated 1477 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:43:28.198232 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4db62b77-793c-43bb-b05b-6d21a6d7496d tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:43:28.199795 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4db62b77-793c-43bb-b05b-6d21a6d7496d tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 5a9072eb-573f-4576-b922-57245258445e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:28.225166 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4db62b77-793c-43bb-b05b-6d21a6d7496d tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:28.226827 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4db62b77-793c-43bb-b05b-6d21a6d7496d tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:28.227932 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4db62b77-793c-43bb-b05b-6d21a6d7496d tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:28.229279 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4db62b77-793c-43bb-b05b-6d21a6d7496d tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:28.234075 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4db62b77-793c-43bb-b05b-6d21a6d7496d tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:28.235752 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4db62b77-793c-43bb-b05b-6d21a6d7496d tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:28.245683 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=100 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:43:28.359311 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4db62b77-793c-43bb-b05b-6d21a6d7496d tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "POST /compute/v2.1/servers/5a9072eb-573f-4576-b922-57245258445e/action" status: 202 len: 0 microversion: 2.1 time: 0.167177 Sep 08 10:43:28.367420 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 729/1490] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:43:28 2022] POST /compute/v2.1/servers/5a9072eb-573f-4576-b922-57245258445e/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:43:28.373652 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1b3c5a5b-1fcf-4234-9b72-e35b5501efff tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:28.374837 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1b3c5a5b-1fcf-4234-9b72-e35b5501efff tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: cf3b6c0e-d390-44d6-91e5-09b389dff551] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:28.385005 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1b3c5a5b-1fcf-4234-9b72-e35b5501efff tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:28.385784 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1b3c5a5b-1fcf-4234-9b72-e35b5501efff tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:28.386509 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1b3c5a5b-1fcf-4234-9b72-e35b5501efff tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:28.387740 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1b3c5a5b-1fcf-4234-9b72-e35b5501efff tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:28.388821 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1b3c5a5b-1fcf-4234-9b72-e35b5501efff tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:28.389555 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1b3c5a5b-1fcf-4234-9b72-e35b5501efff tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:28.492688 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1b3c5a5b-1fcf-4234-9b72-e35b5501efff tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:28.512627 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1b3c5a5b-1fcf-4234-9b72-e35b5501efff tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:28.515070 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1b3c5a5b-1fcf-4234-9b72-e35b5501efff tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:28.516756 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1b3c5a5b-1fcf-4234-9b72-e35b5501efff tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551" status: 200 len: 1250 microversion: 2.25 time: 0.147621 Sep 08 10:43:28.517941 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 730/1491] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:43:28 2022] GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551 => generated 1250 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:43:28.525761 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9b8a2362-51da-43ff-bbea-ae5c87dfccfd tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:28.527150 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9b8a2362-51da-43ff-bbea-ae5c87dfccfd tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 82f0d3c4-fc81-428a-9141-2cc36da8b1b2] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:28.548556 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9b8a2362-51da-43ff-bbea-ae5c87dfccfd tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:28.549730 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9b8a2362-51da-43ff-bbea-ae5c87dfccfd tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:28.551492 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9b8a2362-51da-43ff-bbea-ae5c87dfccfd tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:28.553464 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9b8a2362-51da-43ff-bbea-ae5c87dfccfd tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:28.553884 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9b8a2362-51da-43ff-bbea-ae5c87dfccfd tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:28.554468 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9b8a2362-51da-43ff-bbea-ae5c87dfccfd tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:28.559919 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b0b4244f-54c1-4427-a5b7-37123956cefe tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e25e1f9b61a4cddaa50e2a841aa7082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de26f1b9fbbb4e31b1f4535a5a1ff512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:28.587671 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b0b4244f-54c1-4427-a5b7-37123956cefe tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e25e1f9b61a4cddaa50e2a841aa7082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de26f1b9fbbb4e31b1f4535a5a1ff512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:28.591874 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b0b4244f-54c1-4427-a5b7-37123956cefe tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e25e1f9b61a4cddaa50e2a841aa7082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de26f1b9fbbb4e31b1f4535a5a1ff512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:28.593628 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b0b4244f-54c1-4427-a5b7-37123956cefe tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] 10.222.0.27 "GET /compute/v2.1/servers/24a25908-e543-400e-b922-392c9604ec2e" status: 200 len: 1414 microversion: 2.54 time: 0.825298 Sep 08 10:43:28.597974 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 762/1492] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:43:27 2022] GET /compute/v2.1/servers/24a25908-e543-400e-b922-392c9604ec2e => generated 1414 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:43:28.622428 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-109c1c54-be4e-425a-a76f-4e123c255e75 req-3a93e70f-3af0-4ce8-aebd-873d2ee46e28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e6be670-294f-417f-a909-57c481faaf40", "name": "network-vif-plugged", "status": "completed", "tag": "2dc5c573-e6fe-4942-be41-259b760efba3"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:43:28.653000 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-109c1c54-be4e-425a-a76f-4e123c255e75 req-3a93e70f-3af0-4ce8-aebd-873d2ee46e28 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:28.654848 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-109c1c54-be4e-425a-a76f-4e123c255e75 req-3a93e70f-3af0-4ce8-aebd-873d2ee46e28 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:28.655385 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-109c1c54-be4e-425a-a76f-4e123c255e75 req-3a93e70f-3af0-4ce8-aebd-873d2ee46e28 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:28.702072 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-109c1c54-be4e-425a-a76f-4e123c255e75 req-3a93e70f-3af0-4ce8-aebd-873d2ee46e28 service nova] Creating event network-vif-plugged:2dc5c573-e6fe-4942-be41-259b760efba3 for instance 3e6be670-294f-417f-a909-57c481faaf40 on n-h1-850501-12 Sep 08 10:43:28.722832 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-109c1c54-be4e-425a-a76f-4e123c255e75 req-3a93e70f-3af0-4ce8-aebd-873d2ee46e28 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122769 Sep 08 10:43:28.723365 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 763/1493] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:43:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:43:28.737079 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bc744382-3e91-48e0-be2d-c058875a1401 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:28.741200 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bc744382-3e91-48e0-be2d-c058875a1401 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 5a9072eb-573f-4576-b922-57245258445e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:28.755529 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bc744382-3e91-48e0-be2d-c058875a1401 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:28.756187 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bc744382-3e91-48e0-be2d-c058875a1401 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:28.756403 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bc744382-3e91-48e0-be2d-c058875a1401 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:28.757708 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bc744382-3e91-48e0-be2d-c058875a1401 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:28.760623 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bc744382-3e91-48e0-be2d-c058875a1401 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:28.777175 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bc744382-3e91-48e0-be2d-c058875a1401 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:28.781317 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9b8a2362-51da-43ff-bbea-ae5c87dfccfd tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:28.793600 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9b8a2362-51da-43ff-bbea-ae5c87dfccfd tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/82f0d3c4-fc81-428a-9141-2cc36da8b1b2" status: 200 len: 1219 microversion: 2.1 time: 0.274070 Sep 08 10:43:28.794711 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 731/1494] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:28 2022] GET /compute/v2.1/servers/82f0d3c4-fc81-428a-9141-2cc36da8b1b2 => generated 1219 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:28.800476 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b33e1a35-5d90-41de-9fb8-ab54ae4d8832 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:28.801396 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b33e1a35-5d90-41de-9fb8-ab54ae4d8832 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] [instance: dac27157-b08e-4f13-b97e-3c5b653bd0b3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:28.809247 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b33e1a35-5d90-41de-9fb8-ab54ae4d8832 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:28.810463 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b33e1a35-5d90-41de-9fb8-ab54ae4d8832 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:28.810629 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b33e1a35-5d90-41de-9fb8-ab54ae4d8832 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:28.811632 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b33e1a35-5d90-41de-9fb8-ab54ae4d8832 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:28.812192 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b33e1a35-5d90-41de-9fb8-ab54ae4d8832 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:28.812715 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b33e1a35-5d90-41de-9fb8-ab54ae4d8832 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:29.079238 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b33e1a35-5d90-41de-9fb8-ab54ae4d8832 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7415a5b46c4587a8806661b70e3913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604588959944720923ec2d5e0bf81c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:29.092871 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b33e1a35-5d90-41de-9fb8-ab54ae4d8832 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/servers/dac27157-b08e-4f13-b97e-3c5b653bd0b3" status: 200 len: 1317 microversion: 2.1 time: 0.295710 Sep 08 10:43:29.094264 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 732/1495] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:28 2022] GET /compute/v2.1/servers/dac27157-b08e-4f13-b97e-3c5b653bd0b3 => generated 1317 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:29.233100 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7d2725e9-bc95-4e83-9d8e-d8234c4a82d5 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:29.234349 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7d2725e9-bc95-4e83-9d8e-d8234c4a82d5 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 287be913-2461-45d0-8000-360c3fdb5940] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:29.243640 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7d2725e9-bc95-4e83-9d8e-d8234c4a82d5 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:29.244624 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7d2725e9-bc95-4e83-9d8e-d8234c4a82d5 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:29.245305 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7d2725e9-bc95-4e83-9d8e-d8234c4a82d5 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:29.247315 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7d2725e9-bc95-4e83-9d8e-d8234c4a82d5 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:29.260877 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7d2725e9-bc95-4e83-9d8e-d8234c4a82d5 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:29.262866 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7d2725e9-bc95-4e83-9d8e-d8234c4a82d5 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:29.467505 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7d2725e9-bc95-4e83-9d8e-d8234c4a82d5 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:29.478551 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7d2725e9-bc95-4e83-9d8e-d8234c4a82d5 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940" status: 200 len: 1477 microversion: 2.1 time: 0.250353 Sep 08 10:43:29.480218 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 733/1496] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:29 2022] GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940 => generated 1477 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:43:29.547735 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-befa5613-d3ba-4eb6-9707-ef3649030f44 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:29.548909 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-befa5613-d3ba-4eb6-9707-ef3649030f44 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: cf3b6c0e-d390-44d6-91e5-09b389dff551] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:29.561662 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-befa5613-d3ba-4eb6-9707-ef3649030f44 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:29.562341 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-befa5613-d3ba-4eb6-9707-ef3649030f44 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:29.562986 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-befa5613-d3ba-4eb6-9707-ef3649030f44 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:29.567807 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-befa5613-d3ba-4eb6-9707-ef3649030f44 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:29.569088 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-befa5613-d3ba-4eb6-9707-ef3649030f44 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:29.569277 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-befa5613-d3ba-4eb6-9707-ef3649030f44 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:29.587512 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bc744382-3e91-48e0-be2d-c058875a1401 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:29.614039 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bc744382-3e91-48e0-be2d-c058875a1401 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9072eb-573f-4576-b922-57245258445e" status: 200 len: 1492 microversion: 2.1 time: 0.887232 Sep 08 10:43:29.658218 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 764/1497] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:28 2022] GET /compute/v2.1/servers/5a9072eb-573f-4576-b922-57245258445e => generated 1492 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:29.678350 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5a2ba724-046e-4a17-8895-9e83d3b2ce2f tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:29.679349 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5a2ba724-046e-4a17-8895-9e83d3b2ce2f tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] [instance: 24a25908-e543-400e-b922-392c9604ec2e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:29.693879 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a2ba724-046e-4a17-8895-9e83d3b2ce2f tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:29.697719 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a2ba724-046e-4a17-8895-9e83d3b2ce2f tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:29.698195 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a2ba724-046e-4a17-8895-9e83d3b2ce2f tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:29.701017 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a2ba724-046e-4a17-8895-9e83d3b2ce2f tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:29.702663 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a2ba724-046e-4a17-8895-9e83d3b2ce2f tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:29.705348 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a2ba724-046e-4a17-8895-9e83d3b2ce2f tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:29.860533 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-befa5613-d3ba-4eb6-9707-ef3649030f44 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:29.879342 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-befa5613-d3ba-4eb6-9707-ef3649030f44 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:29.880947 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-befa5613-d3ba-4eb6-9707-ef3649030f44 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:29.882607 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-befa5613-d3ba-4eb6-9707-ef3649030f44 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551" status: 200 len: 1292 microversion: 2.25 time: 0.340600 Sep 08 10:43:29.897187 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 734/1498] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:43:29 2022] GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551 => generated 1292 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:43:29.899461 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9f89dc29-052a-4257-bc2f-b1e091a0a258 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:29.900096 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9f89dc29-052a-4257-bc2f-b1e091a0a258 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 82f0d3c4-fc81-428a-9141-2cc36da8b1b2] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:29.909047 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f89dc29-052a-4257-bc2f-b1e091a0a258 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:29.909562 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f89dc29-052a-4257-bc2f-b1e091a0a258 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:29.910009 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f89dc29-052a-4257-bc2f-b1e091a0a258 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:29.910734 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f89dc29-052a-4257-bc2f-b1e091a0a258 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:29.911201 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f89dc29-052a-4257-bc2f-b1e091a0a258 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:29.920144 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f89dc29-052a-4257-bc2f-b1e091a0a258 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:29.946174 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5a2ba724-046e-4a17-8895-9e83d3b2ce2f tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e25e1f9b61a4cddaa50e2a841aa7082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de26f1b9fbbb4e31b1f4535a5a1ff512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:29.955301 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5a2ba724-046e-4a17-8895-9e83d3b2ce2f tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e25e1f9b61a4cddaa50e2a841aa7082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de26f1b9fbbb4e31b1f4535a5a1ff512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:29.956683 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5a2ba724-046e-4a17-8895-9e83d3b2ce2f tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e25e1f9b61a4cddaa50e2a841aa7082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de26f1b9fbbb4e31b1f4535a5a1ff512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:29.966259 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5a2ba724-046e-4a17-8895-9e83d3b2ce2f tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] 10.222.0.27 "GET /compute/v2.1/servers/24a25908-e543-400e-b922-392c9604ec2e" status: 200 len: 1399 microversion: 2.54 time: 0.297925 Sep 08 10:43:29.978028 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 765/1499] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:43:29 2022] GET /compute/v2.1/servers/24a25908-e543-400e-b922-392c9604ec2e => generated 1399 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:43:30.003482 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-041412ed-21d3-4e19-9b16-df1dfc0574f1 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Calling method '.version_select at 0x7f68e45b99d0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:30.010784 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9f89dc29-052a-4257-bc2f-b1e091a0a258 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:30.021772 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9f89dc29-052a-4257-bc2f-b1e091a0a258 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/82f0d3c4-fc81-428a-9141-2cc36da8b1b2" status: 200 len: 1267 microversion: 2.1 time: 0.136112 Sep 08 10:43:30.023239 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 735/1500] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:29 2022] GET /compute/v2.1/servers/82f0d3c4-fc81-428a-9141-2cc36da8b1b2 => generated 1267 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:30.041829 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-041412ed-21d3-4e19-9b16-df1dfc0574f1 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1693961064" status: 204 len: 0 microversion: 2.54 time: 0.042848 Sep 08 10:43:30.045656 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 766/1501] 10.222.0.27 () {60 vars in 1319 bytes} [Thu Sep 8 10:43:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1693961064 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 08 10:43:30.066534 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a107d116-b658-4aba-9728-43bf6b9e665b tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:30.067097 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a107d116-b658-4aba-9728-43bf6b9e665b tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] [instance: 24a25908-e543-400e-b922-392c9604ec2e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:30.078775 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a107d116-b658-4aba-9728-43bf6b9e665b tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:30.085215 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a107d116-b658-4aba-9728-43bf6b9e665b tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:30.085919 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a107d116-b658-4aba-9728-43bf6b9e665b tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:30.086866 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a107d116-b658-4aba-9728-43bf6b9e665b tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:30.087413 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a107d116-b658-4aba-9728-43bf6b9e665b tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:30.087931 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a107d116-b658-4aba-9728-43bf6b9e665b tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:30.118909 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-336adf23-1a06-466d-bc70-2a4296fc2b18 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:30.120780 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-336adf23-1a06-466d-bc70-2a4296fc2b18 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] [instance: dac27157-b08e-4f13-b97e-3c5b653bd0b3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:30.133063 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-336adf23-1a06-466d-bc70-2a4296fc2b18 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:30.140353 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-336adf23-1a06-466d-bc70-2a4296fc2b18 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:30.141291 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-336adf23-1a06-466d-bc70-2a4296fc2b18 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:30.142443 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-336adf23-1a06-466d-bc70-2a4296fc2b18 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:30.145132 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-336adf23-1a06-466d-bc70-2a4296fc2b18 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:30.148867 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-336adf23-1a06-466d-bc70-2a4296fc2b18 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:30.167481 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a107d116-b658-4aba-9728-43bf6b9e665b tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] [instance: 24a25908-e543-400e-b922-392c9604ec2e] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:43:30.388587 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a107d116-b658-4aba-9728-43bf6b9e665b tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] 10.222.0.27 "DELETE /compute/v2.1/servers/24a25908-e543-400e-b922-392c9604ec2e" status: 204 len: 0 microversion: 2.54 time: 0.332802 Sep 08 10:43:30.390200 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 736/1502] 10.222.0.27 () {60 vars in 1280 bytes} [Thu Sep 8 10:43:30 2022] DELETE /compute/v2.1/servers/24a25908-e543-400e-b922-392c9604ec2e => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 10:43:30.415453 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-00322e96-2f6c-44fc-93f6-9464c5e8d826 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:30.420322 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-00322e96-2f6c-44fc-93f6-9464c5e8d826 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] [instance: 24a25908-e543-400e-b922-392c9604ec2e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:30.452067 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-00322e96-2f6c-44fc-93f6-9464c5e8d826 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:30.453824 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-00322e96-2f6c-44fc-93f6-9464c5e8d826 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:30.454490 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-00322e96-2f6c-44fc-93f6-9464c5e8d826 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:30.456116 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-00322e96-2f6c-44fc-93f6-9464c5e8d826 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:30.456810 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-00322e96-2f6c-44fc-93f6-9464c5e8d826 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:30.457507 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-00322e96-2f6c-44fc-93f6-9464c5e8d826 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:30.613133 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-00322e96-2f6c-44fc-93f6-9464c5e8d826 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e25e1f9b61a4cddaa50e2a841aa7082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de26f1b9fbbb4e31b1f4535a5a1ff512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:30.633998 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-00322e96-2f6c-44fc-93f6-9464c5e8d826 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e25e1f9b61a4cddaa50e2a841aa7082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de26f1b9fbbb4e31b1f4535a5a1ff512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:30.635253 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-336adf23-1a06-466d-bc70-2a4296fc2b18 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7415a5b46c4587a8806661b70e3913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604588959944720923ec2d5e0bf81c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:30.638560 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-00322e96-2f6c-44fc-93f6-9464c5e8d826 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e25e1f9b61a4cddaa50e2a841aa7082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de26f1b9fbbb4e31b1f4535a5a1ff512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:30.641438 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-00322e96-2f6c-44fc-93f6-9464c5e8d826 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] 10.222.0.27 "GET /compute/v2.1/servers/24a25908-e543-400e-b922-392c9604ec2e" status: 200 len: 1405 microversion: 2.54 time: 0.245619 Sep 08 10:43:30.642447 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 737/1503] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:43:30 2022] GET /compute/v2.1/servers/24a25908-e543-400e-b922-392c9604ec2e => generated 1405 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:43:30.651154 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0d8cc9e5-1cd5-4164-8e2f-4d2dda9285cc tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:30.652927 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0d8cc9e5-1cd5-4164-8e2f-4d2dda9285cc tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 287be913-2461-45d0-8000-360c3fdb5940] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:30.670567 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d8cc9e5-1cd5-4164-8e2f-4d2dda9285cc tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:30.671227 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d8cc9e5-1cd5-4164-8e2f-4d2dda9285cc tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:30.672476 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d8cc9e5-1cd5-4164-8e2f-4d2dda9285cc tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:30.678708 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-336adf23-1a06-466d-bc70-2a4296fc2b18 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/servers/dac27157-b08e-4f13-b97e-3c5b653bd0b3" status: 200 len: 1317 microversion: 2.1 time: 0.565269 Sep 08 10:43:30.679726 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 767/1504] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:30 2022] GET /compute/v2.1/servers/dac27157-b08e-4f13-b97e-3c5b653bd0b3 => generated 1317 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:43:30.690353 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d8cc9e5-1cd5-4164-8e2f-4d2dda9285cc tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:30.690964 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d8cc9e5-1cd5-4164-8e2f-4d2dda9285cc tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:30.691507 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d8cc9e5-1cd5-4164-8e2f-4d2dda9285cc tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:30.693423 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b44ba79f-6cdb-4ba5-b4a4-f8d5c30d9b09 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:30.694695 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b44ba79f-6cdb-4ba5-b4a4-f8d5c30d9b09 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 5a9072eb-573f-4576-b922-57245258445e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:30.704645 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b44ba79f-6cdb-4ba5-b4a4-f8d5c30d9b09 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:30.705670 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b44ba79f-6cdb-4ba5-b4a4-f8d5c30d9b09 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:30.708483 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b44ba79f-6cdb-4ba5-b4a4-f8d5c30d9b09 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:30.709577 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b44ba79f-6cdb-4ba5-b4a4-f8d5c30d9b09 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:30.710601 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b44ba79f-6cdb-4ba5-b4a4-f8d5c30d9b09 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:30.715565 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b44ba79f-6cdb-4ba5-b4a4-f8d5c30d9b09 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:31.055768 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b44ba79f-6cdb-4ba5-b4a4-f8d5c30d9b09 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:31.068958 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b44ba79f-6cdb-4ba5-b4a4-f8d5c30d9b09 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9072eb-573f-4576-b922-57245258445e" status: 200 len: 1472 microversion: 2.1 time: 0.387953 Sep 08 10:43:31.082049 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 768/1505] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:30 2022] GET /compute/v2.1/servers/5a9072eb-573f-4576-b922-57245258445e => generated 1472 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:31.097461 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ae2522af-807a-445d-b0b2-b440e3429186 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:31.098724 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ae2522af-807a-445d-b0b2-b440e3429186 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: cf3b6c0e-d390-44d6-91e5-09b389dff551] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:31.107817 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae2522af-807a-445d-b0b2-b440e3429186 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:31.108569 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae2522af-807a-445d-b0b2-b440e3429186 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:31.109223 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae2522af-807a-445d-b0b2-b440e3429186 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:31.110156 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0d8cc9e5-1cd5-4164-8e2f-4d2dda9285cc tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:31.110655 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae2522af-807a-445d-b0b2-b440e3429186 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:31.111289 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae2522af-807a-445d-b0b2-b440e3429186 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:31.111890 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae2522af-807a-445d-b0b2-b440e3429186 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:31.128511 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0d8cc9e5-1cd5-4164-8e2f-4d2dda9285cc tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940" status: 200 len: 1477 microversion: 2.1 time: 0.484397 Sep 08 10:43:31.130959 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 738/1506] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:30 2022] GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940 => generated 1477 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:31.141427 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9e5c0ceb-eb4d-49ea-9f0d-5a22a4005b3e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1781323553", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "15b153a9-4f79-4605-9c99-0d83878931cf"}], "block_device_mapping_v2": [{"uuid": "7f835f78-82c0-4adb-9cd2-da29bc58d2f6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:43:31.266109 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-9e5c0ceb-eb4d-49ea-9f0d-5a22a4005b3e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] validate_networks() for [('15b153a9-4f79-4605-9c99-0d83878931cf', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:43:31.488874 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ae2522af-807a-445d-b0b2-b440e3429186 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:31.499347 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ae2522af-807a-445d-b0b2-b440e3429186 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:31.501179 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ae2522af-807a-445d-b0b2-b440e3429186 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:31.502522 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ae2522af-807a-445d-b0b2-b440e3429186 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551" status: 200 len: 1292 microversion: 2.25 time: 0.419121 Sep 08 10:43:31.504055 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 769/1507] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:43:31 2022] GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551 => generated 1292 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:43:31.509804 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4990a219-99cf-4ee0-bd2e-b6ded7ade745 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:31.510956 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4990a219-99cf-4ee0-bd2e-b6ded7ade745 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 82f0d3c4-fc81-428a-9141-2cc36da8b1b2] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:31.520311 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4990a219-99cf-4ee0-bd2e-b6ded7ade745 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:31.521497 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4990a219-99cf-4ee0-bd2e-b6ded7ade745 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:31.522562 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4990a219-99cf-4ee0-bd2e-b6ded7ade745 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:31.524690 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4990a219-99cf-4ee0-bd2e-b6ded7ade745 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:31.525487 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4990a219-99cf-4ee0-bd2e-b6ded7ade745 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:31.526255 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4990a219-99cf-4ee0-bd2e-b6ded7ade745 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:31.700592 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4990a219-99cf-4ee0-bd2e-b6ded7ade745 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:31.716111 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4990a219-99cf-4ee0-bd2e-b6ded7ade745 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/82f0d3c4-fc81-428a-9141-2cc36da8b1b2" status: 200 len: 1273 microversion: 2.1 time: 0.209982 Sep 08 10:43:31.717343 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 770/1508] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:31 2022] GET /compute/v2.1/servers/82f0d3c4-fc81-428a-9141-2cc36da8b1b2 => generated 1273 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:31.727041 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-66bb0f87-03a3-43d4-9a77-ec6227f0e52b tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-602270522"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:43:31.731771 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-66bb0f87-03a3-43d4-9a77-ec6227f0e52b tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 5a9072eb-573f-4576-b922-57245258445e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:31.740864 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-66bb0f87-03a3-43d4-9a77-ec6227f0e52b tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:31.741642 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-66bb0f87-03a3-43d4-9a77-ec6227f0e52b tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:31.742533 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-66bb0f87-03a3-43d4-9a77-ec6227f0e52b tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:31.743894 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-66bb0f87-03a3-43d4-9a77-ec6227f0e52b tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:31.744839 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-66bb0f87-03a3-43d4-9a77-ec6227f0e52b tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:31.746724 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-66bb0f87-03a3-43d4-9a77-ec6227f0e52b tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:31.780858 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-9e5c0ceb-eb4d-49ea-9f0d-5a22a4005b3e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:43:31.781587 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-9e5c0ceb-eb4d-49ea-9f0d-5a22a4005b3e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:43:31.782238 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-9e5c0ceb-eb4d-49ea-9f0d-5a22a4005b3e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:43:31.783813 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-9e5c0ceb-eb4d-49ea-9f0d-5a22a4005b3e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:43:31.784494 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-9e5c0ceb-eb4d-49ea-9f0d-5a22a4005b3e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:43:31.807503 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e5c0ceb-eb4d-49ea-9f0d-5a22a4005b3e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:31.808188 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e5c0ceb-eb4d-49ea-9f0d-5a22a4005b3e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:31.813622 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e5c0ceb-eb4d-49ea-9f0d-5a22a4005b3e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:31.817517 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e5c0ceb-eb4d-49ea-9f0d-5a22a4005b3e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:31.818028 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e5c0ceb-eb4d-49ea-9f0d-5a22a4005b3e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:31.818479 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e5c0ceb-eb4d-49ea-9f0d-5a22a4005b3e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:31.877326 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-9e5c0ceb-eb4d-49ea-9f0d-5a22a4005b3e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Getting quotas for project c7f9807a4eb2473e87377097b0544d0e. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:43:31.894107 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-9e5c0ceb-eb4d-49ea-9f0d-5a22a4005b3e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Getting quotas for user 3ecf9924d86b4fd38a6f31430e9d3418 and project c7f9807a4eb2473e87377097b0544d0e. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:43:32.003411 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9e5c0ceb-eb4d-49ea-9f0d-5a22a4005b3e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:43:32.005801 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9e5c0ceb-eb4d-49ea-9f0d-5a22a4005b3e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 90974422-0d77-4970-9e94-ed6b3376ed29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7f835f78-82c0-4adb-9cd2-da29bc58d2f6',volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:43:32.083805 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-66bb0f87-03a3-43d4-9a77-ec6227f0e52b tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "POST /compute/v2.1/servers/5a9072eb-573f-4576-b922-57245258445e/action" status: 202 len: 0 microversion: 2.1 time: 0.364959 Sep 08 10:43:32.096290 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 771/1509] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:43:31 2022] POST /compute/v2.1/servers/5a9072eb-573f-4576-b922-57245258445e/action => generated 0 bytes in 379 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 08 10:43:32.107233 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3fba10c0-f449-4e8c-aa1a-b4177097e3aa tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:32.108116 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3fba10c0-f449-4e8c-aa1a-b4177097e3aa tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] [instance: 24a25908-e543-400e-b922-392c9604ec2e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:32.128304 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3fba10c0-f449-4e8c-aa1a-b4177097e3aa tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:32.133703 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3fba10c0-f449-4e8c-aa1a-b4177097e3aa tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:32.133703 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3fba10c0-f449-4e8c-aa1a-b4177097e3aa tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:32.134337 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3fba10c0-f449-4e8c-aa1a-b4177097e3aa tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:32.134939 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3fba10c0-f449-4e8c-aa1a-b4177097e3aa tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:32.139797 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3fba10c0-f449-4e8c-aa1a-b4177097e3aa tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:32.184928 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:43:32.252214 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9e5c0ceb-eb4d-49ea-9f0d-5a22a4005b3e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.120138 Sep 08 10:43:32.264831 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 739/1510] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:43:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1133 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:43:32.270563 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-25fe892a-44f8-4bd6-ad5f-5f727211a210 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:32.271454 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-25fe892a-44f8-4bd6-ad5f-5f727211a210 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] [instance: dac27157-b08e-4f13-b97e-3c5b653bd0b3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:32.278566 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-25fe892a-44f8-4bd6-ad5f-5f727211a210 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:32.279305 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-25fe892a-44f8-4bd6-ad5f-5f727211a210 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:32.279897 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-25fe892a-44f8-4bd6-ad5f-5f727211a210 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:32.280779 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-25fe892a-44f8-4bd6-ad5f-5f727211a210 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:32.281448 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-25fe892a-44f8-4bd6-ad5f-5f727211a210 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:32.282030 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-25fe892a-44f8-4bd6-ad5f-5f727211a210 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:32.331100 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3fba10c0-f449-4e8c-aa1a-b4177097e3aa tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e25e1f9b61a4cddaa50e2a841aa7082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de26f1b9fbbb4e31b1f4535a5a1ff512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:32.346437 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3fba10c0-f449-4e8c-aa1a-b4177097e3aa tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e25e1f9b61a4cddaa50e2a841aa7082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de26f1b9fbbb4e31b1f4535a5a1ff512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:32.350197 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3fba10c0-f449-4e8c-aa1a-b4177097e3aa tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e25e1f9b61a4cddaa50e2a841aa7082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de26f1b9fbbb4e31b1f4535a5a1ff512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:32.352453 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3fba10c0-f449-4e8c-aa1a-b4177097e3aa tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] 10.222.0.27 "GET /compute/v2.1/servers/24a25908-e543-400e-b922-392c9604ec2e" status: 200 len: 1405 microversion: 2.54 time: 0.254018 Sep 08 10:43:32.356181 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 772/1511] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:43:32 2022] GET /compute/v2.1/servers/24a25908-e543-400e-b922-392c9604ec2e => generated 1405 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:43:32.368324 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-18905bae-6a14-427b-aa33-161b7de8dc48 req-a65dd802-3c62-45b4-b55f-42e10179c0fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf3b6c0e-d390-44d6-91e5-09b389dff551", "tag": "1744beb8-80b4-4c92-8ebb-bb2e04113c75"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:43:32.395563 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-18905bae-6a14-427b-aa33-161b7de8dc48 req-a65dd802-3c62-45b4-b55f-42e10179c0fc service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:32.396164 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-18905bae-6a14-427b-aa33-161b7de8dc48 req-a65dd802-3c62-45b4-b55f-42e10179c0fc service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:32.396678 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-18905bae-6a14-427b-aa33-161b7de8dc48 req-a65dd802-3c62-45b4-b55f-42e10179c0fc service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:32.413367 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-18905bae-6a14-427b-aa33-161b7de8dc48 req-a65dd802-3c62-45b4-b55f-42e10179c0fc service nova] Creating event network-changed:1744beb8-80b4-4c92-8ebb-bb2e04113c75 for instance cf3b6c0e-d390-44d6-91e5-09b389dff551 on n-h2-850501-12 Sep 08 10:43:32.416642 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-18905bae-6a14-427b-aa33-161b7de8dc48 req-a65dd802-3c62-45b4-b55f-42e10179c0fc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056378 Sep 08 10:43:32.419635 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 773/1512] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:43:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:43:32.435416 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-772d6346-1b3a-4087-97cd-b2e9d13236c9 req-90996f38-ca7a-4e37-884d-f47db2082299 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dac27157-b08e-4f13-b97e-3c5b653bd0b3", "name": "network-vif-plugged", "status": "completed", "tag": "0ad27959-ff24-48b6-9469-c1b114584c1e"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:43:32.448797 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-772d6346-1b3a-4087-97cd-b2e9d13236c9 req-90996f38-ca7a-4e37-884d-f47db2082299 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:32.450608 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-772d6346-1b3a-4087-97cd-b2e9d13236c9 req-90996f38-ca7a-4e37-884d-f47db2082299 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:32.451175 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-772d6346-1b3a-4087-97cd-b2e9d13236c9 req-90996f38-ca7a-4e37-884d-f47db2082299 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:32.468884 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-772d6346-1b3a-4087-97cd-b2e9d13236c9 req-90996f38-ca7a-4e37-884d-f47db2082299 service nova] Creating event network-vif-plugged:0ad27959-ff24-48b6-9469-c1b114584c1e for instance dac27157-b08e-4f13-b97e-3c5b653bd0b3 on n-h1-850501-12 Sep 08 10:43:32.476322 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-772d6346-1b3a-4087-97cd-b2e9d13236c9 req-90996f38-ca7a-4e37-884d-f47db2082299 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045913 Sep 08 10:43:32.477754 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 774/1513] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:43:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:43:32.486274 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-024e889f-5dc5-44dd-9289-67619487f4b2 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '.version_select at 0x7f68e454a820>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:32.553404 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-024e889f-5dc5-44dd-9289-67619487f4b2 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/images/9a0f08f6-d8f6-4a73-8e9c-e267129f62dc" status: 200 len: 1413 microversion: 2.1 time: 0.073733 Sep 08 10:43:32.554198 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 775/1514] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:43:32 2022] GET /compute/v2.1/images/9a0f08f6-d8f6-4a73-8e9c-e267129f62dc => generated 1413 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:32.560868 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-de881e16-5cac-447f-826a-6951776fb90d tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:32.561587 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-de881e16-5cac-447f-826a-6951776fb90d tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 287be913-2461-45d0-8000-360c3fdb5940] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:32.571100 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de881e16-5cac-447f-826a-6951776fb90d tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:32.571626 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de881e16-5cac-447f-826a-6951776fb90d tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:32.572111 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de881e16-5cac-447f-826a-6951776fb90d tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:32.572840 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de881e16-5cac-447f-826a-6951776fb90d tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:32.573360 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de881e16-5cac-447f-826a-6951776fb90d tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:32.574598 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de881e16-5cac-447f-826a-6951776fb90d tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:32.660206 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-25fe892a-44f8-4bd6-ad5f-5f727211a210 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7415a5b46c4587a8806661b70e3913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604588959944720923ec2d5e0bf81c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:32.689777 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-25fe892a-44f8-4bd6-ad5f-5f727211a210 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/servers/dac27157-b08e-4f13-b97e-3c5b653bd0b3" status: 200 len: 1317 microversion: 2.1 time: 0.422889 Sep 08 10:43:32.713787 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 740/1515] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:32 2022] GET /compute/v2.1/servers/dac27157-b08e-4f13-b97e-3c5b653bd0b3 => generated 1317 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:32.727082 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cbd18b6a-b6dc-471b-8c5c-8835210e1601 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:32.732336 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cbd18b6a-b6dc-471b-8c5c-8835210e1601 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 90974422-0d77-4970-9e94-ed6b3376ed29] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:32.901520 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-cbd18b6a-b6dc-471b-8c5c-8835210e1601 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:32.916151 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cbd18b6a-b6dc-471b-8c5c-8835210e1601 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29" status: 200 len: 1053 microversion: 2.1 time: 0.198373 Sep 08 10:43:32.929062 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 741/1516] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:32 2022] GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29 => generated 1053 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:32.929062 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0bf6f5b2-49b7-4b0a-bfe5-7778c25fb7a1 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:32.929062 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0bf6f5b2-49b7-4b0a-bfe5-7778c25fb7a1 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: cf3b6c0e-d390-44d6-91e5-09b389dff551] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:32.965335 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0bf6f5b2-49b7-4b0a-bfe5-7778c25fb7a1 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:32.968992 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0bf6f5b2-49b7-4b0a-bfe5-7778c25fb7a1 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:32.971004 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0bf6f5b2-49b7-4b0a-bfe5-7778c25fb7a1 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:32.973523 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0bf6f5b2-49b7-4b0a-bfe5-7778c25fb7a1 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:32.976917 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0bf6f5b2-49b7-4b0a-bfe5-7778c25fb7a1 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:32.977615 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0bf6f5b2-49b7-4b0a-bfe5-7778c25fb7a1 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:33.103299 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-de881e16-5cac-447f-826a-6951776fb90d tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:33.128178 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-de881e16-5cac-447f-826a-6951776fb90d tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940" status: 200 len: 1477 microversion: 2.1 time: 0.571939 Sep 08 10:43:33.138799 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 776/1517] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:32 2022] GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940 => generated 1477 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:33.145241 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d060c5fd-1b34-47ee-ac29-bd7c126d28ed tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:33.145912 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d060c5fd-1b34-47ee-ac29-bd7c126d28ed tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 82f0d3c4-fc81-428a-9141-2cc36da8b1b2] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:33.183903 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d060c5fd-1b34-47ee-ac29-bd7c126d28ed tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:33.184989 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d060c5fd-1b34-47ee-ac29-bd7c126d28ed tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:33.185987 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d060c5fd-1b34-47ee-ac29-bd7c126d28ed tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:33.187568 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d060c5fd-1b34-47ee-ac29-bd7c126d28ed tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:33.188591 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d060c5fd-1b34-47ee-ac29-bd7c126d28ed tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:33.194057 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d060c5fd-1b34-47ee-ac29-bd7c126d28ed tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:33.374030 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0bf6f5b2-49b7-4b0a-bfe5-7778c25fb7a1 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:33.406969 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0bf6f5b2-49b7-4b0a-bfe5-7778c25fb7a1 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:33.409845 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0bf6f5b2-49b7-4b0a-bfe5-7778c25fb7a1 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:33.411367 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0bf6f5b2-49b7-4b0a-bfe5-7778c25fb7a1 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551" status: 200 len: 1292 microversion: 2.25 time: 0.492345 Sep 08 10:43:33.417975 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 742/1518] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:43:32 2022] GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551 => generated 1292 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:43:33.428106 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b0af200f-93f1-41ca-bdd3-26226a2ded88 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:33.429211 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b0af200f-93f1-41ca-bdd3-26226a2ded88 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] [instance: 24a25908-e543-400e-b922-392c9604ec2e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:33.443634 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b0af200f-93f1-41ca-bdd3-26226a2ded88 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:33.444598 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b0af200f-93f1-41ca-bdd3-26226a2ded88 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:33.445384 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b0af200f-93f1-41ca-bdd3-26226a2ded88 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:33.446524 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b0af200f-93f1-41ca-bdd3-26226a2ded88 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:33.447475 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b0af200f-93f1-41ca-bdd3-26226a2ded88 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:33.448466 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b0af200f-93f1-41ca-bdd3-26226a2ded88 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:33.519947 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b0af200f-93f1-41ca-bdd3-26226a2ded88 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:33.520970 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b0af200f-93f1-41ca-bdd3-26226a2ded88 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:33.521780 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b0af200f-93f1-41ca-bdd3-26226a2ded88 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:33.522484 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-b0af200f-93f1-41ca-bdd3-26226a2ded88 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lazy-loading 'fault' on Instance uuid 24a25908-e543-400e-b922-392c9604ec2e {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:43:33.578212 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b0af200f-93f1-41ca-bdd3-26226a2ded88 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e25e1f9b61a4cddaa50e2a841aa7082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de26f1b9fbbb4e31b1f4535a5a1ff512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:33.590156 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b0af200f-93f1-41ca-bdd3-26226a2ded88 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e25e1f9b61a4cddaa50e2a841aa7082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de26f1b9fbbb4e31b1f4535a5a1ff512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:33.593326 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b0af200f-93f1-41ca-bdd3-26226a2ded88 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e25e1f9b61a4cddaa50e2a841aa7082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de26f1b9fbbb4e31b1f4535a5a1ff512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:33.595155 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b0af200f-93f1-41ca-bdd3-26226a2ded88 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] 10.222.0.27 "GET /compute/v2.1/servers/24a25908-e543-400e-b922-392c9604ec2e" status: 200 len: 1410 microversion: 2.54 time: 0.175720 Sep 08 10:43:33.596873 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 743/1519] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:43:33 2022] GET /compute/v2.1/servers/24a25908-e543-400e-b922-392c9604ec2e => generated 1410 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:43:33.604515 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-38375341-19c9-40f5-8e5d-07a3751eb98d tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '.version_select at 0x7f68e44f0af0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:33.694790 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-38375341-19c9-40f5-8e5d-07a3751eb98d tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/images/9a0f08f6-d8f6-4a73-8e9c-e267129f62dc" status: 200 len: 1413 microversion: 2.1 time: 0.096444 Sep 08 10:43:33.700015 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 744/1520] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:43:33 2022] GET /compute/v2.1/images/9a0f08f6-d8f6-4a73-8e9c-e267129f62dc => generated 1413 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:33.722542 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0073f5f6-311b-4429-8cf4-866ac04983fa tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:33.723691 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0073f5f6-311b-4429-8cf4-866ac04983fa tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] [instance: dac27157-b08e-4f13-b97e-3c5b653bd0b3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:33.737302 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0073f5f6-311b-4429-8cf4-866ac04983fa tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:33.737302 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0073f5f6-311b-4429-8cf4-866ac04983fa tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:33.737302 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0073f5f6-311b-4429-8cf4-866ac04983fa tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:33.737302 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0073f5f6-311b-4429-8cf4-866ac04983fa tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:33.737302 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0073f5f6-311b-4429-8cf4-866ac04983fa tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:33.737302 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0073f5f6-311b-4429-8cf4-866ac04983fa tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:33.772494 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:43:33.779191 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d060c5fd-1b34-47ee-ac29-bd7c126d28ed tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:33.782247 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:43:33.797714 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d060c5fd-1b34-47ee-ac29-bd7c126d28ed tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/82f0d3c4-fc81-428a-9141-2cc36da8b1b2" status: 200 len: 1315 microversion: 2.1 time: 0.657573 Sep 08 10:43:33.800814 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 777/1521] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:33 2022] GET /compute/v2.1/servers/82f0d3c4-fc81-428a-9141-2cc36da8b1b2 => generated 1315 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:33.806102 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c12b0022-ee2e-4870-b056-59d552a3902b tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:33.815818 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c12b0022-ee2e-4870-b056-59d552a3902b tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] [instance: 790bcd42-ace5-4761-b46d-e0889855623f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:33.828352 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c12b0022-ee2e-4870-b056-59d552a3902b tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:33.828949 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c12b0022-ee2e-4870-b056-59d552a3902b tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:33.830134 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c12b0022-ee2e-4870-b056-59d552a3902b tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:33.831233 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c12b0022-ee2e-4870-b056-59d552a3902b tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:33.831771 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c12b0022-ee2e-4870-b056-59d552a3902b tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:33.832652 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c12b0022-ee2e-4870-b056-59d552a3902b tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:33.881082 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c12b0022-ee2e-4870-b056-59d552a3902b tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] 10.222.0.27 "GET /compute/v2.1/servers/790bcd42-ace5-4761-b46d-e0889855623f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078905 Sep 08 10:43:33.881678 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 778/1522] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 10:43:33 2022] GET /compute/v2.1/servers/790bcd42-ace5-4761-b46d-e0889855623f/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:43:33.910363 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c39894f0-d49d-4a59-b601-539218fea531 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:33.911131 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c39894f0-d49d-4a59-b601-539218fea531 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] [instance: 790bcd42-ace5-4761-b46d-e0889855623f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:33.932828 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c39894f0-d49d-4a59-b601-539218fea531 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:33.933577 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c39894f0-d49d-4a59-b601-539218fea531 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:33.934758 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c39894f0-d49d-4a59-b601-539218fea531 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:33.935802 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c39894f0-d49d-4a59-b601-539218fea531 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:33.936478 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c39894f0-d49d-4a59-b601-539218fea531 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:33.937315 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c39894f0-d49d-4a59-b601-539218fea531 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:33.976870 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0073f5f6-311b-4429-8cf4-866ac04983fa tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7415a5b46c4587a8806661b70e3913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604588959944720923ec2d5e0bf81c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:33.989434 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0073f5f6-311b-4429-8cf4-866ac04983fa tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/servers/dac27157-b08e-4f13-b97e-3c5b653bd0b3" status: 200 len: 1317 microversion: 2.1 time: 0.270862 Sep 08 10:43:34.004917 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 745/1523] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:33 2022] GET /compute/v2.1/servers/dac27157-b08e-4f13-b97e-3c5b653bd0b3 => generated 1317 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:34.008048 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5dba5474-3cd6-4aa6-82f8-aa33ec57b587 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:34.008694 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5dba5474-3cd6-4aa6-82f8-aa33ec57b587 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 90974422-0d77-4970-9e94-ed6b3376ed29] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:34.016555 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5dba5474-3cd6-4aa6-82f8-aa33ec57b587 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:34.017098 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5dba5474-3cd6-4aa6-82f8-aa33ec57b587 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:34.017546 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5dba5474-3cd6-4aa6-82f8-aa33ec57b587 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:34.018276 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5dba5474-3cd6-4aa6-82f8-aa33ec57b587 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:34.018718 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5dba5474-3cd6-4aa6-82f8-aa33ec57b587 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:34.019144 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5dba5474-3cd6-4aa6-82f8-aa33ec57b587 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:34.079999 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-c39894f0-d49d-4a59-b601-539218fea531 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lazy-loading 'services' on Instance uuid 790bcd42-ace5-4761-b46d-e0889855623f {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:43:34.098900 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5dba5474-3cd6-4aa6-82f8-aa33ec57b587 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:34.108165 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5dba5474-3cd6-4aa6-82f8-aa33ec57b587 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29" status: 200 len: 1095 microversion: 2.1 time: 0.111252 Sep 08 10:43:34.108757 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 746/1524] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:33 2022] GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29 => generated 1095 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:34.159953 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c47463ae-062b-4214-b9fc-c941be6b6df9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:34.160873 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c47463ae-062b-4214-b9fc-c941be6b6df9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 287be913-2461-45d0-8000-360c3fdb5940] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:34.168333 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c39894f0-d49d-4a59-b601-539218fea531 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] 10.222.0.27 "DELETE /compute/v2.1/servers/790bcd42-ace5-4761-b46d-e0889855623f/os-volume_attachments/07a71221-db08-4dca-a552-4fcd0424162d" status: 202 len: 0 microversion: 2.1 time: 0.268716 Sep 08 10:43:34.169823 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 779/1525] 10.222.0.27 () {58 vars in 1416 bytes} [Thu Sep 8 10:43:33 2022] DELETE /compute/v2.1/servers/790bcd42-ace5-4761-b46d-e0889855623f/os-volume_attachments/07a71221-db08-4dca-a552-4fcd0424162d => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:43:34.172917 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c47463ae-062b-4214-b9fc-c941be6b6df9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:34.172917 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c47463ae-062b-4214-b9fc-c941be6b6df9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:34.172917 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c47463ae-062b-4214-b9fc-c941be6b6df9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:34.172917 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c47463ae-062b-4214-b9fc-c941be6b6df9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:34.172917 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c47463ae-062b-4214-b9fc-c941be6b6df9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:34.173589 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c47463ae-062b-4214-b9fc-c941be6b6df9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:34.362002 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c47463ae-062b-4214-b9fc-c941be6b6df9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:34.387602 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c47463ae-062b-4214-b9fc-c941be6b6df9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940" status: 200 len: 1477 microversion: 2.1 time: 0.230560 Sep 08 10:43:34.389569 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 747/1526] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:34 2022] GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940 => generated 1477 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:43:34.473234 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-15b42205-7e28-4a5b-9f7e-d2a1bc4aa2d2 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:34.474977 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-15b42205-7e28-4a5b-9f7e-d2a1bc4aa2d2 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: cf3b6c0e-d390-44d6-91e5-09b389dff551] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:34.495399 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15b42205-7e28-4a5b-9f7e-d2a1bc4aa2d2 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:34.496427 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15b42205-7e28-4a5b-9f7e-d2a1bc4aa2d2 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:34.496875 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15b42205-7e28-4a5b-9f7e-d2a1bc4aa2d2 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:34.505076 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15b42205-7e28-4a5b-9f7e-d2a1bc4aa2d2 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:34.505814 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15b42205-7e28-4a5b-9f7e-d2a1bc4aa2d2 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:34.506429 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15b42205-7e28-4a5b-9f7e-d2a1bc4aa2d2 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:34.632120 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cc5f4240-0a01-4aee-a276-fecc09992910 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:34.632743 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cc5f4240-0a01-4aee-a276-fecc09992910 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] [instance: 24a25908-e543-400e-b922-392c9604ec2e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:34.639739 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc5f4240-0a01-4aee-a276-fecc09992910 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:34.640580 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc5f4240-0a01-4aee-a276-fecc09992910 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:34.641294 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc5f4240-0a01-4aee-a276-fecc09992910 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:34.642390 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc5f4240-0a01-4aee-a276-fecc09992910 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:34.643090 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc5f4240-0a01-4aee-a276-fecc09992910 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:34.643765 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc5f4240-0a01-4aee-a276-fecc09992910 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:34.692639 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc5f4240-0a01-4aee-a276-fecc09992910 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:34.693172 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc5f4240-0a01-4aee-a276-fecc09992910 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:34.693615 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc5f4240-0a01-4aee-a276-fecc09992910 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:34.694071 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-cc5f4240-0a01-4aee-a276-fecc09992910 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lazy-loading 'fault' on Instance uuid 24a25908-e543-400e-b922-392c9604ec2e {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:43:34.743464 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-cc5f4240-0a01-4aee-a276-fecc09992910 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e25e1f9b61a4cddaa50e2a841aa7082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de26f1b9fbbb4e31b1f4535a5a1ff512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:34.752951 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-cc5f4240-0a01-4aee-a276-fecc09992910 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e25e1f9b61a4cddaa50e2a841aa7082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de26f1b9fbbb4e31b1f4535a5a1ff512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:34.754429 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-cc5f4240-0a01-4aee-a276-fecc09992910 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e25e1f9b61a4cddaa50e2a841aa7082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de26f1b9fbbb4e31b1f4535a5a1ff512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:34.755660 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cc5f4240-0a01-4aee-a276-fecc09992910 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] 10.222.0.27 "GET /compute/v2.1/servers/24a25908-e543-400e-b922-392c9604ec2e" status: 200 len: 1410 microversion: 2.54 time: 0.129358 Sep 08 10:43:34.756422 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 748/1527] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:43:34 2022] GET /compute/v2.1/servers/24a25908-e543-400e-b922-392c9604ec2e => generated 1410 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:43:34.761750 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-49487f48-9d72-48fb-9912-80bffe9cc936 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '.version_select at 0x7f68e46ad040>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:34.816310 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-49487f48-9d72-48fb-9912-80bffe9cc936 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/images/9a0f08f6-d8f6-4a73-8e9c-e267129f62dc" status: 200 len: 1413 microversion: 2.1 time: 0.059033 Sep 08 10:43:34.825073 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 749/1528] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:43:34 2022] GET /compute/v2.1/images/9a0f08f6-d8f6-4a73-8e9c-e267129f62dc => generated 1413 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:34.827603 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-43f92765-0333-4a8e-9774-3f8a9f35db5c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:34.827880 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-43f92765-0333-4a8e-9774-3f8a9f35db5c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 82f0d3c4-fc81-428a-9141-2cc36da8b1b2] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:34.834558 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-43f92765-0333-4a8e-9774-3f8a9f35db5c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:34.835046 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-43f92765-0333-4a8e-9774-3f8a9f35db5c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:34.835547 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-43f92765-0333-4a8e-9774-3f8a9f35db5c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:34.836253 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-43f92765-0333-4a8e-9774-3f8a9f35db5c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:34.836706 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-43f92765-0333-4a8e-9774-3f8a9f35db5c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:34.837226 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-43f92765-0333-4a8e-9774-3f8a9f35db5c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:34.960488 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-15b42205-7e28-4a5b-9f7e-d2a1bc4aa2d2 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:34.976290 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-15b42205-7e28-4a5b-9f7e-d2a1bc4aa2d2 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:34.978511 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-15b42205-7e28-4a5b-9f7e-d2a1bc4aa2d2 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:34.983788 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-15b42205-7e28-4a5b-9f7e-d2a1bc4aa2d2 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551" status: 200 len: 1292 microversion: 2.25 time: 0.514366 Sep 08 10:43:34.986010 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 780/1529] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:43:34 2022] GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551 => generated 1292 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:43:35.010076 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-43f92765-0333-4a8e-9774-3f8a9f35db5c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:35.016318 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e9417a8a-f87c-49ed-9178-b5a3a974027d tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:35.017428 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e9417a8a-f87c-49ed-9178-b5a3a974027d tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] [instance: dac27157-b08e-4f13-b97e-3c5b653bd0b3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:35.032631 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-43f92765-0333-4a8e-9774-3f8a9f35db5c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/82f0d3c4-fc81-428a-9141-2cc36da8b1b2" status: 200 len: 1315 microversion: 2.1 time: 0.210045 Sep 08 10:43:35.049802 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9417a8a-f87c-49ed-9178-b5a3a974027d tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:35.053530 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9417a8a-f87c-49ed-9178-b5a3a974027d tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:35.054168 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 750/1530] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:34 2022] GET /compute/v2.1/servers/82f0d3c4-fc81-428a-9141-2cc36da8b1b2 => generated 1315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:35.057807 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9417a8a-f87c-49ed-9178-b5a3a974027d tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:35.064130 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9417a8a-f87c-49ed-9178-b5a3a974027d tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:35.065352 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9417a8a-f87c-49ed-9178-b5a3a974027d tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:35.066139 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9417a8a-f87c-49ed-9178-b5a3a974027d tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:35.135657 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bf667916-f1d2-4e15-8b6e-933aaca48a63 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:35.137136 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bf667916-f1d2-4e15-8b6e-933aaca48a63 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 90974422-0d77-4970-9e94-ed6b3376ed29] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:35.163374 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf667916-f1d2-4e15-8b6e-933aaca48a63 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:35.165327 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf667916-f1d2-4e15-8b6e-933aaca48a63 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:35.165327 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf667916-f1d2-4e15-8b6e-933aaca48a63 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:35.179080 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf667916-f1d2-4e15-8b6e-933aaca48a63 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:35.179940 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf667916-f1d2-4e15-8b6e-933aaca48a63 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:35.186844 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf667916-f1d2-4e15-8b6e-933aaca48a63 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:35.353010 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-bf667916-f1d2-4e15-8b6e-933aaca48a63 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:35.368788 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bf667916-f1d2-4e15-8b6e-933aaca48a63 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29" status: 200 len: 1151 microversion: 2.1 time: 0.240093 Sep 08 10:43:35.369924 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 751/1531] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:35 2022] GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29 => generated 1151 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:43:35.437433 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-594c515c-0cd2-4ff5-b003-bbc5c552fc46 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:35.438088 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-594c515c-0cd2-4ff5-b003-bbc5c552fc46 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 287be913-2461-45d0-8000-360c3fdb5940] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:35.450082 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-594c515c-0cd2-4ff5-b003-bbc5c552fc46 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:35.451771 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-594c515c-0cd2-4ff5-b003-bbc5c552fc46 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:35.452213 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-594c515c-0cd2-4ff5-b003-bbc5c552fc46 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:35.453536 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-594c515c-0cd2-4ff5-b003-bbc5c552fc46 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:35.454318 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-594c515c-0cd2-4ff5-b003-bbc5c552fc46 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:35.455801 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-594c515c-0cd2-4ff5-b003-bbc5c552fc46 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:35.556165 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e9417a8a-f87c-49ed-9178-b5a3a974027d tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7415a5b46c4587a8806661b70e3913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604588959944720923ec2d5e0bf81c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:35.565816 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e9417a8a-f87c-49ed-9178-b5a3a974027d tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/servers/dac27157-b08e-4f13-b97e-3c5b653bd0b3" status: 200 len: 1317 microversion: 2.1 time: 0.554827 Sep 08 10:43:35.567168 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 781/1532] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:35 2022] GET /compute/v2.1/servers/dac27157-b08e-4f13-b97e-3c5b653bd0b3 => generated 1317 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:43:35.711273 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-594c515c-0cd2-4ff5-b003-bbc5c552fc46 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:35.729156 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-594c515c-0cd2-4ff5-b003-bbc5c552fc46 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940" status: 200 len: 1476 microversion: 2.1 time: 0.311775 Sep 08 10:43:35.730952 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 752/1533] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:35 2022] GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940 => generated 1476 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:43:35.784724 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d12ee6a2-9dc2-4a9e-87c0-3383f4bceb24 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:35.785574 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d12ee6a2-9dc2-4a9e-87c0-3383f4bceb24 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] [instance: 24a25908-e543-400e-b922-392c9604ec2e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:35.803099 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d12ee6a2-9dc2-4a9e-87c0-3383f4bceb24 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:35.803942 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d12ee6a2-9dc2-4a9e-87c0-3383f4bceb24 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:35.804402 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d12ee6a2-9dc2-4a9e-87c0-3383f4bceb24 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:35.805207 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d12ee6a2-9dc2-4a9e-87c0-3383f4bceb24 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:35.809075 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d12ee6a2-9dc2-4a9e-87c0-3383f4bceb24 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:35.809792 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d12ee6a2-9dc2-4a9e-87c0-3383f4bceb24 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:35.839304 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a40597f8-8c96-4838-969b-2f19f063272c tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '.version_select at 0x7f68e493db80>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:35.854320 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-d12ee6a2-9dc2-4a9e-87c0-3383f4bceb24 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] HTTP exception thrown: Instance 24a25908-e543-400e-b922-392c9604ec2e could not be found. Sep 08 10:43:35.856761 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d12ee6a2-9dc2-4a9e-87c0-3383f4bceb24 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Request method failure captured: Sep 08 10:43:35.856761 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/24a25908-e543-400e-b922-392c9604ec2e HTTP/1.1 Sep 08 10:43:35.856761 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:43:35.856761 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:43:35.856761 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:43:35.856761 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:43:35.856761 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:43:35.856761 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:43:35.856761 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:43:35.856761 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:43:35.856761 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGccsULoGT1-5CHcUO3yez1Ol89YtqVcxVQ4bn85Rv6Cq5uw3prWkoqTjAryWCtnWhik61MY20Bo25iLtSbMGNCkaKd6IDeyC7iGpIVeGwTR_JwyGbIlmctwzBut1im4ENRclrYnbdKC5BAFXAnEXJonGutOWzdPSjI549JtW4gGjCMo Sep 08 10:43:35.856761 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:43:35.856761 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:43:35.856761 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:43:35.856761 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:43:35.856761 n-d-850501-12 devstack@n-api.service[128862]: X-Openstack-Nova-Api-Version: 2.54 Sep 08 10:43:35.856761 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:43:35.856761 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:43:35.856761 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: de26f1b9fbbb4e31b1f4535a5a1ff512 Sep 08 10:43:35.856761 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServerShowV254Test-1650612289 Sep 08 10:43:35.856761 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:43:35.856761 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:43:35.856761 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/de26f1b9fbbb4e31b1f4535a5a1ff512"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/de26f1b9fbbb4e31b1f4535a5a1ff512"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_de26f1b9fbbb4e31b1f4535a5a1ff512"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/de26f1b9fbbb4e31b1f4535a5a1ff512"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:43:35.856761 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServerShowV254Test-1650612289 Sep 08 10:43:35.856761 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: de26f1b9fbbb4e31b1f4535a5a1ff512 Sep 08 10:43:35.856761 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServerShowV254Test-1650612289 Sep 08 10:43:35.856761 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServerShowV254Test-1650612289-project Sep 08 10:43:35.856761 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:43:35.856761 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:43:35.856761 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 9e25e1f9b61a4cddaa50e2a841aa7082 Sep 08 10:43:35.856761 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServerShowV254Test-1650612289-project Sep 08 10:43:35.856761 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:43:35.856761 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 24a25908-e543-400e-b922-392c9604ec2e could not be found. Sep 08 10:43:35.856761 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '24a25908-e543-400e-b922-392c9604ec2e'} Sep 08 10:43:35.856761 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:43:35.856761 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:43:35.856761 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:43:35.856761 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:43:35.856761 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:43:35.856761 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:43:35.856761 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:43:35.856761 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:43:35.856761 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:43:35.856761 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:43:35.856761 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24a25908-e543-400e-b922-392c9604ec2e could not be found. Sep 08 10:43:35.856761 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:43:35.856761 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:43:35.856761 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:43:35.856761 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:43:35.856761 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:43:35.856761 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:43:35.856761 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:43:35.856761 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:43:35.856761 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:43:35.856761 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:43:35.856761 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:43:35.856761 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:43:35.856761 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:43:35.856761 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:43:35.856761 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:43:35.856761 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:43:35.856761 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24a25908-e543-400e-b922-392c9604ec2e could not be found. Sep 08 10:43:35.856761 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:43:35.856761 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:43:35.856761 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:43:35.861589 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:43:35.861589 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:43:35.861589 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:43:35.861589 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:43:35.861589 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:43:35.861589 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24a25908-e543-400e-b922-392c9604ec2e could not be found. Sep 08 10:43:35.861589 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:43:35.863552 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d12ee6a2-9dc2-4a9e-87c0-3383f4bceb24 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] Returning 404 to user: Instance 24a25908-e543-400e-b922-392c9604ec2e could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:43:35.864659 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d12ee6a2-9dc2-4a9e-87c0-3383f4bceb24 tempest-ServerShowV254Test-1650612289 tempest-ServerShowV254Test-1650612289-project] 10.222.0.27 "GET /compute/v2.1/servers/24a25908-e543-400e-b922-392c9604ec2e" status: 404 len: 111 microversion: 2.54 time: 0.084809 Sep 08 10:43:35.865462 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 782/1534] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:43:35 2022] GET /compute/v2.1/servers/24a25908-e543-400e-b922-392c9604ec2e => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 08 10:43:35.969396 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a40597f8-8c96-4838-969b-2f19f063272c tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/images/9a0f08f6-d8f6-4a73-8e9c-e267129f62dc" status: 200 len: 1413 microversion: 2.1 time: 0.136888 Sep 08 10:43:35.986162 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 753/1535] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:43:35 2022] GET /compute/v2.1/images/9a0f08f6-d8f6-4a73-8e9c-e267129f62dc => generated 1413 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:36.013069 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fcf8a6ca-f024-4a7a-a693-1aa9f9f3747f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:36.013813 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fcf8a6ca-f024-4a7a-a693-1aa9f9f3747f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: cf3b6c0e-d390-44d6-91e5-09b389dff551] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:36.051706 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fcf8a6ca-f024-4a7a-a693-1aa9f9f3747f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:36.052312 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fcf8a6ca-f024-4a7a-a693-1aa9f9f3747f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:36.052773 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fcf8a6ca-f024-4a7a-a693-1aa9f9f3747f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:36.059318 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fcf8a6ca-f024-4a7a-a693-1aa9f9f3747f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:36.060116 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fcf8a6ca-f024-4a7a-a693-1aa9f9f3747f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:36.063276 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fcf8a6ca-f024-4a7a-a693-1aa9f9f3747f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:36.065534 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7cd9db05-4a45-4241-a49c-7cc61a4af70a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:36.066821 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7cd9db05-4a45-4241-a49c-7cc61a4af70a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 82f0d3c4-fc81-428a-9141-2cc36da8b1b2] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:36.100361 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7cd9db05-4a45-4241-a49c-7cc61a4af70a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:36.101491 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7cd9db05-4a45-4241-a49c-7cc61a4af70a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:36.102136 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7cd9db05-4a45-4241-a49c-7cc61a4af70a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:36.103148 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7cd9db05-4a45-4241-a49c-7cc61a4af70a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:36.106077 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7cd9db05-4a45-4241-a49c-7cc61a4af70a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:36.111032 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7cd9db05-4a45-4241-a49c-7cc61a4af70a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:36.603847 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:43:36.764107 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7cd9db05-4a45-4241-a49c-7cc61a4af70a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:36.778358 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7cd9db05-4a45-4241-a49c-7cc61a4af70a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/82f0d3c4-fc81-428a-9141-2cc36da8b1b2" status: 200 len: 1315 microversion: 2.1 time: 0.722601 Sep 08 10:43:36.779053 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 754/1536] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:36 2022] GET /compute/v2.1/servers/82f0d3c4-fc81-428a-9141-2cc36da8b1b2 => generated 1315 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:43:36.794555 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1daee456-df01-4314-be49-4d10b4cbd171 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:36.802794 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1daee456-df01-4314-be49-4d10b4cbd171 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 90974422-0d77-4970-9e94-ed6b3376ed29] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:36.827776 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1daee456-df01-4314-be49-4d10b4cbd171 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:36.828597 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1daee456-df01-4314-be49-4d10b4cbd171 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:36.837231 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1daee456-df01-4314-be49-4d10b4cbd171 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:36.838307 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1daee456-df01-4314-be49-4d10b4cbd171 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:36.841776 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1daee456-df01-4314-be49-4d10b4cbd171 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:36.842456 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1daee456-df01-4314-be49-4d10b4cbd171 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:36.997508 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=12 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:43:37.092452 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1daee456-df01-4314-be49-4d10b4cbd171 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:37.100932 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1daee456-df01-4314-be49-4d10b4cbd171 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29" status: 200 len: 1169 microversion: 2.1 time: 0.310568 Sep 08 10:43:37.104232 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 755/1537] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:36 2022] GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29 => generated 1169 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:37.122042 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4f9dfcc0-20ff-4c1b-82cf-ed56f6bbb4c3 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:37.123961 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4f9dfcc0-20ff-4c1b-82cf-ed56f6bbb4c3 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] [instance: dac27157-b08e-4f13-b97e-3c5b653bd0b3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:37.155173 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4f9dfcc0-20ff-4c1b-82cf-ed56f6bbb4c3 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:37.155690 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4f9dfcc0-20ff-4c1b-82cf-ed56f6bbb4c3 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:37.156170 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4f9dfcc0-20ff-4c1b-82cf-ed56f6bbb4c3 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:37.156902 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4f9dfcc0-20ff-4c1b-82cf-ed56f6bbb4c3 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:37.157387 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4f9dfcc0-20ff-4c1b-82cf-ed56f6bbb4c3 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:37.157813 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4f9dfcc0-20ff-4c1b-82cf-ed56f6bbb4c3 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:37.301830 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fcf8a6ca-f024-4a7a-a693-1aa9f9f3747f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:37.316206 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fcf8a6ca-f024-4a7a-a693-1aa9f9f3747f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:37.318143 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fcf8a6ca-f024-4a7a-a693-1aa9f9f3747f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:37.319272 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fcf8a6ca-f024-4a7a-a693-1aa9f9f3747f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551" status: 200 len: 1292 microversion: 2.25 time: 1.311378 Sep 08 10:43:37.319885 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 783/1538] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:43:36 2022] GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551 => generated 1292 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:43:37.339038 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-318318e2-8264-41aa-8cb9-a1c165d02da6 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:37.356487 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-318318e2-8264-41aa-8cb9-a1c165d02da6 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 287be913-2461-45d0-8000-360c3fdb5940] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:37.377999 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-318318e2-8264-41aa-8cb9-a1c165d02da6 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:37.378506 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-318318e2-8264-41aa-8cb9-a1c165d02da6 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:37.379087 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-318318e2-8264-41aa-8cb9-a1c165d02da6 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:37.379865 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-318318e2-8264-41aa-8cb9-a1c165d02da6 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:37.380458 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-318318e2-8264-41aa-8cb9-a1c165d02da6 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:37.380954 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-318318e2-8264-41aa-8cb9-a1c165d02da6 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:37.655617 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4f9dfcc0-20ff-4c1b-82cf-ed56f6bbb4c3 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7415a5b46c4587a8806661b70e3913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604588959944720923ec2d5e0bf81c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:37.663508 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4f9dfcc0-20ff-4c1b-82cf-ed56f6bbb4c3 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/servers/dac27157-b08e-4f13-b97e-3c5b653bd0b3" status: 200 len: 1466 microversion: 2.1 time: 0.551341 Sep 08 10:43:37.674847 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 756/1539] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:37 2022] GET /compute/v2.1/servers/dac27157-b08e-4f13-b97e-3c5b653bd0b3 => generated 1466 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:37.689058 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-10ff0b82-41b3-49c7-a93f-23ae1092219b tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '.version_select at 0x7f68e51369d0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:37.822123 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-10ff0b82-41b3-49c7-a93f-23ae1092219b tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/images/9a0f08f6-d8f6-4a73-8e9c-e267129f62dc" status: 200 len: 1413 microversion: 2.1 time: 0.145683 Sep 08 10:43:37.822804 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 757/1540] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:43:37 2022] GET /compute/v2.1/images/9a0f08f6-d8f6-4a73-8e9c-e267129f62dc => generated 1413 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:37.837644 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-623dd464-3fa4-4bf0-8981-ec230ed9f7d4 req-3c5ab884-5689-43c3-8d11-5498bfc46bb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82f0d3c4-fc81-428a-9141-2cc36da8b1b2", "tag": "be795b19-5bca-4532-a89f-e4d4be7315ae"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:43:37.874855 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-623dd464-3fa4-4bf0-8981-ec230ed9f7d4 req-3c5ab884-5689-43c3-8d11-5498bfc46bb5 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:37.875362 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-623dd464-3fa4-4bf0-8981-ec230ed9f7d4 req-3c5ab884-5689-43c3-8d11-5498bfc46bb5 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:37.875967 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-623dd464-3fa4-4bf0-8981-ec230ed9f7d4 req-3c5ab884-5689-43c3-8d11-5498bfc46bb5 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:37.931937 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-623dd464-3fa4-4bf0-8981-ec230ed9f7d4 req-3c5ab884-5689-43c3-8d11-5498bfc46bb5 service nova] Creating event network-changed:be795b19-5bca-4532-a89f-e4d4be7315ae for instance 82f0d3c4-fc81-428a-9141-2cc36da8b1b2 on n-h1-850501-12 Sep 08 10:43:37.946725 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-623dd464-3fa4-4bf0-8981-ec230ed9f7d4 req-3c5ab884-5689-43c3-8d11-5498bfc46bb5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122819 Sep 08 10:43:37.957377 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 758/1541] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:43:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:43:37.969964 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-9527d51a-b65e-4fc8-9efc-2727be2f4366 req-c3ca8965-e26c-4205-bdac-6bdccdd3d76a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "287be913-2461-45d0-8000-360c3fdb5940", "name": "network-vif-unplugged", "status": "completed", "tag": "b0efdf4d-7120-405a-89e4-97e3a3ae0d87"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:43:37.998261 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-9527d51a-b65e-4fc8-9efc-2727be2f4366 req-c3ca8965-e26c-4205-bdac-6bdccdd3d76a service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:37.998744 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-9527d51a-b65e-4fc8-9efc-2727be2f4366 req-c3ca8965-e26c-4205-bdac-6bdccdd3d76a service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:37.999179 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-9527d51a-b65e-4fc8-9efc-2727be2f4366 req-c3ca8965-e26c-4205-bdac-6bdccdd3d76a service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:38.008702 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-318318e2-8264-41aa-8cb9-a1c165d02da6 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:38.023373 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-318318e2-8264-41aa-8cb9-a1c165d02da6 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940" status: 200 len: 1476 microversion: 2.1 time: 0.697105 Sep 08 10:43:38.037843 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 784/1542] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:37 2022] GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940 => generated 1476 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:38.050652 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a36e9da2-360e-4741-a371-47d1a08e104f tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:38.052374 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a36e9da2-360e-4741-a371-47d1a08e104f tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] [instance: 3e6be670-294f-417f-a909-57c481faaf40] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:38.056483 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-9527d51a-b65e-4fc8-9efc-2727be2f4366 req-c3ca8965-e26c-4205-bdac-6bdccdd3d76a service nova] Creating event network-vif-unplugged:b0efdf4d-7120-405a-89e4-97e3a3ae0d87 for instance 287be913-2461-45d0-8000-360c3fdb5940 on n-h2-850501-12 Sep 08 10:43:38.066529 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a36e9da2-360e-4741-a371-47d1a08e104f tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:38.068432 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a36e9da2-360e-4741-a371-47d1a08e104f tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:38.069111 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a36e9da2-360e-4741-a371-47d1a08e104f tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:38.069773 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [req-9527d51a-b65e-4fc8-9efc-2727be2f4366 req-c3ca8965-e26c-4205-bdac-6bdccdd3d76a service nova] Instance 287be913-2461-45d0-8000-360c3fdb5940 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850501-12', 'n-h1-850501-12'} {{(pid=128861) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 10:43:38.071202 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a36e9da2-360e-4741-a371-47d1a08e104f tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:38.076641 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a36e9da2-360e-4741-a371-47d1a08e104f tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:38.077423 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a36e9da2-360e-4741-a371-47d1a08e104f tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:38.113737 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-9527d51a-b65e-4fc8-9efc-2727be2f4366 req-c3ca8965-e26c-4205-bdac-6bdccdd3d76a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.143356 Sep 08 10:43:38.114323 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 759/1543] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:43:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:43:38.120112 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4ff4a258-b3ff-4a38-83b6-dc64795343ee tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:38.121637 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4ff4a258-b3ff-4a38-83b6-dc64795343ee tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 82f0d3c4-fc81-428a-9141-2cc36da8b1b2] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:38.135354 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ff4a258-b3ff-4a38-83b6-dc64795343ee tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:38.136155 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ff4a258-b3ff-4a38-83b6-dc64795343ee tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:38.136890 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ff4a258-b3ff-4a38-83b6-dc64795343ee tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:38.138271 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ff4a258-b3ff-4a38-83b6-dc64795343ee tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:38.138938 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ff4a258-b3ff-4a38-83b6-dc64795343ee tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:38.139548 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ff4a258-b3ff-4a38-83b6-dc64795343ee tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:38.762096 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4ff4a258-b3ff-4a38-83b6-dc64795343ee tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:38.773454 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a36e9da2-360e-4741-a371-47d1a08e104f tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7415a5b46c4587a8806661b70e3913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604588959944720923ec2d5e0bf81c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:38.774064 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4ff4a258-b3ff-4a38-83b6-dc64795343ee tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/82f0d3c4-fc81-428a-9141-2cc36da8b1b2" status: 200 len: 1315 microversion: 2.1 time: 0.657723 Sep 08 10:43:38.795376 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 760/1544] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:38 2022] GET /compute/v2.1/servers/82f0d3c4-fc81-428a-9141-2cc36da8b1b2 => generated 1315 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:38.800279 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a36e9da2-360e-4741-a371-47d1a08e104f tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/servers/3e6be670-294f-417f-a909-57c481faaf40" status: 200 len: 1466 microversion: 2.1 time: 0.754787 Sep 08 10:43:38.801525 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 785/1545] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:38 2022] GET /compute/v2.1/servers/3e6be670-294f-417f-a909-57c481faaf40 => generated 1466 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:38.807240 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-da71f661-7594-4376-a8a3-a61e31651130 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:38.810270 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-da71f661-7594-4376-a8a3-a61e31651130 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 90974422-0d77-4970-9e94-ed6b3376ed29] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:38.815274 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-f1f1a0b5-6260-4991-9c88-09abb1ed0036 req-dad7f0ab-f884-4bfe-a16c-ea9d8aded68b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a9072eb-573f-4576-b922-57245258445e", "name": "network-vif-plugged", "status": "completed", "tag": "b11c68f4-e560-4a23-9f9a-548f2856de5f"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:43:38.822244 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-da71f661-7594-4376-a8a3-a61e31651130 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:38.827293 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-da71f661-7594-4376-a8a3-a61e31651130 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:38.828082 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-da71f661-7594-4376-a8a3-a61e31651130 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:38.832891 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-da71f661-7594-4376-a8a3-a61e31651130 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:38.833768 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-da71f661-7594-4376-a8a3-a61e31651130 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:38.834588 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-da71f661-7594-4376-a8a3-a61e31651130 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:38.836205 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-f1f1a0b5-6260-4991-9c88-09abb1ed0036 req-dad7f0ab-f884-4bfe-a16c-ea9d8aded68b service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:38.836699 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-f1f1a0b5-6260-4991-9c88-09abb1ed0036 req-dad7f0ab-f884-4bfe-a16c-ea9d8aded68b service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:38.837358 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-f1f1a0b5-6260-4991-9c88-09abb1ed0036 req-dad7f0ab-f884-4bfe-a16c-ea9d8aded68b service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:38.854532 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-f1f1a0b5-6260-4991-9c88-09abb1ed0036 req-dad7f0ab-f884-4bfe-a16c-ea9d8aded68b service nova] Creating event network-vif-plugged:b11c68f4-e560-4a23-9f9a-548f2856de5f for instance 5a9072eb-573f-4576-b922-57245258445e on n-h1-850501-12 Sep 08 10:43:38.871670 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-f1f1a0b5-6260-4991-9c88-09abb1ed0036 req-dad7f0ab-f884-4bfe-a16c-ea9d8aded68b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074608 Sep 08 10:43:38.876747 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 761/1546] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:43:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:43:38.888996 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-95aad4f8-ee1e-4c22-9bc2-2478a452f021 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:38.896255 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-95aad4f8-ee1e-4c22-9bc2-2478a452f021 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: cf3b6c0e-d390-44d6-91e5-09b389dff551] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:38.913881 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-95aad4f8-ee1e-4c22-9bc2-2478a452f021 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:38.914694 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-95aad4f8-ee1e-4c22-9bc2-2478a452f021 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:38.918157 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-95aad4f8-ee1e-4c22-9bc2-2478a452f021 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:38.922262 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-95aad4f8-ee1e-4c22-9bc2-2478a452f021 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:38.922972 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-95aad4f8-ee1e-4c22-9bc2-2478a452f021 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:38.934490 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-95aad4f8-ee1e-4c22-9bc2-2478a452f021 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:39.023620 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-da71f661-7594-4376-a8a3-a61e31651130 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:39.049806 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-da71f661-7594-4376-a8a3-a61e31651130 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29" status: 200 len: 1169 microversion: 2.1 time: 0.246319 Sep 08 10:43:39.074670 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 786/1547] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:38 2022] GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29 => generated 1169 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:39.090158 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ab8f6631-2566-4ed8-9222-4a868ed2ef22 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-648651910"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:43:39.095145 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ab8f6631-2566-4ed8-9222-4a868ed2ef22 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] [instance: 3e6be670-294f-417f-a909-57c481faaf40] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:39.108027 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab8f6631-2566-4ed8-9222-4a868ed2ef22 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:39.109353 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab8f6631-2566-4ed8-9222-4a868ed2ef22 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:39.111535 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab8f6631-2566-4ed8-9222-4a868ed2ef22 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:39.112935 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab8f6631-2566-4ed8-9222-4a868ed2ef22 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:39.115698 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab8f6631-2566-4ed8-9222-4a868ed2ef22 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:39.123927 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab8f6631-2566-4ed8-9222-4a868ed2ef22 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:39.263522 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-95aad4f8-ee1e-4c22-9bc2-2478a452f021 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:39.291473 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-95aad4f8-ee1e-4c22-9bc2-2478a452f021 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:39.293488 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-95aad4f8-ee1e-4c22-9bc2-2478a452f021 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:39.294681 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-95aad4f8-ee1e-4c22-9bc2-2478a452f021 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551" status: 200 len: 1280 microversion: 2.25 time: 0.416482 Sep 08 10:43:39.336905 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 762/1548] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:43:38 2022] GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551 => generated 1280 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:43:39.361410 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bebdeab3-061a-4eca-9bfc-85393338c151 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '.version_select at 0x7f68e4696d30>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:39.743072 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bebdeab3-061a-4eca-9bfc-85393338c151 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/images/9a0f08f6-d8f6-4a73-8e9c-e267129f62dc" status: 200 len: 1413 microversion: 2.1 time: 0.399902 Sep 08 10:43:39.755834 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 763/1549] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:43:39 2022] GET /compute/v2.1/images/9a0f08f6-d8f6-4a73-8e9c-e267129f62dc => generated 1413 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:39.773595 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0d31dea9-b9ab-4c48-a522-fb11590b1d87 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:39.774561 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0d31dea9-b9ab-4c48-a522-fb11590b1d87 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 287be913-2461-45d0-8000-360c3fdb5940] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:39.807286 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d31dea9-b9ab-4c48-a522-fb11590b1d87 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:39.809732 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d31dea9-b9ab-4c48-a522-fb11590b1d87 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:39.810310 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d31dea9-b9ab-4c48-a522-fb11590b1d87 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:39.813100 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d31dea9-b9ab-4c48-a522-fb11590b1d87 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:39.813704 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d31dea9-b9ab-4c48-a522-fb11590b1d87 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:39.815711 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d31dea9-b9ab-4c48-a522-fb11590b1d87 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:39.840485 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ab8f6631-2566-4ed8-9222-4a868ed2ef22 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "POST /compute/v2.1/servers/3e6be670-294f-417f-a909-57c481faaf40/action" status: 202 len: 0 microversion: 2.1 time: 0.763260 Sep 08 10:43:39.841919 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 787/1550] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:43:39 2022] POST /compute/v2.1/servers/3e6be670-294f-417f-a909-57c481faaf40/action => generated 0 bytes in 767 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 08 10:43:39.849866 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-edb4f01a-1774-4d2f-9e0b-d674709e8911 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:39.851398 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-edb4f01a-1774-4d2f-9e0b-d674709e8911 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 82f0d3c4-fc81-428a-9141-2cc36da8b1b2] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:39.860759 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-edb4f01a-1774-4d2f-9e0b-d674709e8911 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:39.861939 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-edb4f01a-1774-4d2f-9e0b-d674709e8911 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:39.862737 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-edb4f01a-1774-4d2f-9e0b-d674709e8911 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:39.864156 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-edb4f01a-1774-4d2f-9e0b-d674709e8911 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:39.864878 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-edb4f01a-1774-4d2f-9e0b-d674709e8911 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:39.865661 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-edb4f01a-1774-4d2f-9e0b-d674709e8911 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:40.335390 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-edb4f01a-1774-4d2f-9e0b-d674709e8911 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:40.362678 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-edb4f01a-1774-4d2f-9e0b-d674709e8911 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/82f0d3c4-fc81-428a-9141-2cc36da8b1b2" status: 200 len: 1315 microversion: 2.1 time: 0.516358 Sep 08 10:43:40.364645 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 788/1551] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:39 2022] GET /compute/v2.1/servers/82f0d3c4-fc81-428a-9141-2cc36da8b1b2 => generated 1315 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:40.387220 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-657f6885-734b-4c58-892e-ee3c6ef52f16 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '.version_select at 0x7f68e4630ee0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:40.518355 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-657f6885-734b-4c58-892e-ee3c6ef52f16 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/images/8ca5d5cf-e00d-4aad-9d69-6851cbd20fce" status: 200 len: 1452 microversion: 2.1 time: 0.150455 Sep 08 10:43:40.520187 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 789/1552] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:43:40 2022] GET /compute/v2.1/images/8ca5d5cf-e00d-4aad-9d69-6851cbd20fce => generated 1452 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:40.559026 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-30e63054-c792-4d8f-9179-01656861b02f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:40.563921 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-30e63054-c792-4d8f-9179-01656861b02f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 90974422-0d77-4970-9e94-ed6b3376ed29] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:40.599105 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-30e63054-c792-4d8f-9179-01656861b02f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:40.599612 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-30e63054-c792-4d8f-9179-01656861b02f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:40.610642 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-30e63054-c792-4d8f-9179-01656861b02f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:40.614049 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-30e63054-c792-4d8f-9179-01656861b02f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:40.617530 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-30e63054-c792-4d8f-9179-01656861b02f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:40.618087 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-30e63054-c792-4d8f-9179-01656861b02f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:41.025693 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0d31dea9-b9ab-4c48-a522-fb11590b1d87 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:41.052811 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0d31dea9-b9ab-4c48-a522-fb11590b1d87 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940" status: 200 len: 1476 microversion: 2.1 time: 1.304892 Sep 08 10:43:41.056856 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 764/1553] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:39 2022] GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940 => generated 1476 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:41.074983 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-af7dacf0-622f-4822-bd39-3bb7bad53b39 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:41.076297 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-af7dacf0-622f-4822-bd39-3bb7bad53b39 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: cf3b6c0e-d390-44d6-91e5-09b389dff551] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:41.090539 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-af7dacf0-622f-4822-bd39-3bb7bad53b39 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:41.091555 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-af7dacf0-622f-4822-bd39-3bb7bad53b39 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:41.092417 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-af7dacf0-622f-4822-bd39-3bb7bad53b39 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:41.093745 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-af7dacf0-622f-4822-bd39-3bb7bad53b39 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:41.094456 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-af7dacf0-622f-4822-bd39-3bb7bad53b39 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:41.095138 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-af7dacf0-622f-4822-bd39-3bb7bad53b39 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:41.302106 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-30e63054-c792-4d8f-9179-01656861b02f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:41.335188 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-30e63054-c792-4d8f-9179-01656861b02f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29" status: 200 len: 1211 microversion: 2.1 time: 0.802412 Sep 08 10:43:41.347440 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 790/1554] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:40 2022] GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29 => generated 1211 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:41.374367 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-f7e76200-ba66-46ad-9947-522db34651cb req-637b26de-2712-4fc9-a77f-e5e155862a94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "287be913-2461-45d0-8000-360c3fdb5940", "tag": "b0efdf4d-7120-405a-89e4-97e3a3ae0d87"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:43:41.396789 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:43:41.401018 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-f7e76200-ba66-46ad-9947-522db34651cb req-637b26de-2712-4fc9-a77f-e5e155862a94 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:41.406486 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-f7e76200-ba66-46ad-9947-522db34651cb req-637b26de-2712-4fc9-a77f-e5e155862a94 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:41.411990 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-f7e76200-ba66-46ad-9947-522db34651cb req-637b26de-2712-4fc9-a77f-e5e155862a94 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:41.486732 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-f7e76200-ba66-46ad-9947-522db34651cb req-637b26de-2712-4fc9-a77f-e5e155862a94 service nova] Creating event network-changed:b0efdf4d-7120-405a-89e4-97e3a3ae0d87 for instance 287be913-2461-45d0-8000-360c3fdb5940 on n-h2-850501-12 Sep 08 10:43:41.513869 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-af7dacf0-622f-4822-bd39-3bb7bad53b39 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:41.526121 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [req-f7e76200-ba66-46ad-9947-522db34651cb req-637b26de-2712-4fc9-a77f-e5e155862a94 service nova] Instance 287be913-2461-45d0-8000-360c3fdb5940 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850501-12', 'n-h1-850501-12'} {{(pid=128862) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 10:43:41.546990 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-af7dacf0-622f-4822-bd39-3bb7bad53b39 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:41.551814 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-af7dacf0-622f-4822-bd39-3bb7bad53b39 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:41.559203 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-f7e76200-ba66-46ad-9947-522db34651cb req-637b26de-2712-4fc9-a77f-e5e155862a94 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.204580 Sep 08 10:43:41.561612 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 791/1555] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:43:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:43:41.562875 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-af7dacf0-622f-4822-bd39-3bb7bad53b39 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551" status: 200 len: 1280 microversion: 2.25 time: 0.502422 Sep 08 10:43:41.568011 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7efd3ab6-e321-4427-bf7f-32139f0f78b8 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '.version_select at 0x7f68e440d670>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:41.569720 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 765/1556] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:43:41 2022] GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551 => generated 1280 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:43:41.619627 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9b8b2dc2-72bd-4afd-9c3a-4bddd40b644a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:41.630707 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9b8b2dc2-72bd-4afd-9c3a-4bddd40b644a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 82f0d3c4-fc81-428a-9141-2cc36da8b1b2] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:41.654059 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9b8b2dc2-72bd-4afd-9c3a-4bddd40b644a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:41.656799 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9b8b2dc2-72bd-4afd-9c3a-4bddd40b644a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:41.661351 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9b8b2dc2-72bd-4afd-9c3a-4bddd40b644a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:41.667923 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9b8b2dc2-72bd-4afd-9c3a-4bddd40b644a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:41.675372 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9b8b2dc2-72bd-4afd-9c3a-4bddd40b644a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:41.675372 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9b8b2dc2-72bd-4afd-9c3a-4bddd40b644a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:41.711522 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7efd3ab6-e321-4427-bf7f-32139f0f78b8 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/images/9a0f08f6-d8f6-4a73-8e9c-e267129f62dc" status: 200 len: 1413 microversion: 2.1 time: 0.148178 Sep 08 10:43:41.712833 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 792/1557] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:43:41 2022] GET /compute/v2.1/images/9a0f08f6-d8f6-4a73-8e9c-e267129f62dc => generated 1413 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:41.752845 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-19363e88-2665-46cb-abc2-f8c54033c54a tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '.version_select at 0x7f68e4586af0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:41.842145 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=6 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:43:41.968046 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-19363e88-2665-46cb-abc2-f8c54033c54a tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/images/8ca5d5cf-e00d-4aad-9d69-6851cbd20fce" status: 200 len: 1452 microversion: 2.1 time: 0.251182 Sep 08 10:43:41.974693 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 793/1558] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:43:41 2022] GET /compute/v2.1/images/8ca5d5cf-e00d-4aad-9d69-6851cbd20fce => generated 1452 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:42.088323 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bbce0e4b-8c50-46fb-b0e1-e9bfbba53080 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:42.092165 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bbce0e4b-8c50-46fb-b0e1-e9bfbba53080 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 287be913-2461-45d0-8000-360c3fdb5940] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:42.119689 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bbce0e4b-8c50-46fb-b0e1-e9bfbba53080 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:42.124221 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bbce0e4b-8c50-46fb-b0e1-e9bfbba53080 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:42.126894 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bbce0e4b-8c50-46fb-b0e1-e9bfbba53080 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:42.136658 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bbce0e4b-8c50-46fb-b0e1-e9bfbba53080 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:42.143140 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bbce0e4b-8c50-46fb-b0e1-e9bfbba53080 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:42.145762 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bbce0e4b-8c50-46fb-b0e1-e9bfbba53080 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:42.350630 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9b8b2dc2-72bd-4afd-9c3a-4bddd40b644a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:42.365238 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9b8b2dc2-72bd-4afd-9c3a-4bddd40b644a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/82f0d3c4-fc81-428a-9141-2cc36da8b1b2" status: 200 len: 1315 microversion: 2.1 time: 0.791956 Sep 08 10:43:42.366712 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 766/1559] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:41 2022] GET /compute/v2.1/servers/82f0d3c4-fc81-428a-9141-2cc36da8b1b2 => generated 1315 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:42.389440 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-16d7eb31-104a-4c0f-b28b-09f9798202eb tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:42.390486 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-16d7eb31-104a-4c0f-b28b-09f9798202eb tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 90974422-0d77-4970-9e94-ed6b3376ed29] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:42.405784 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-16d7eb31-104a-4c0f-b28b-09f9798202eb tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:42.409861 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-16d7eb31-104a-4c0f-b28b-09f9798202eb tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:42.411482 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-16d7eb31-104a-4c0f-b28b-09f9798202eb tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:42.412513 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-16d7eb31-104a-4c0f-b28b-09f9798202eb tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:42.413302 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-16d7eb31-104a-4c0f-b28b-09f9798202eb tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:42.413901 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-16d7eb31-104a-4c0f-b28b-09f9798202eb tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:42.447588 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=100 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:43:42.894786 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-16d7eb31-104a-4c0f-b28b-09f9798202eb tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:42.921507 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=22 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:43:42.921712 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-16d7eb31-104a-4c0f-b28b-09f9798202eb tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29" status: 200 len: 1211 microversion: 2.1 time: 0.541749 Sep 08 10:43:42.942429 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 767/1560] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:42 2022] GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29 => generated 1211 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:43:42.953088 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e97e349e-dab3-4c6f-819c-ce6f3631752d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:42.954345 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e97e349e-dab3-4c6f-819c-ce6f3631752d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: cf3b6c0e-d390-44d6-91e5-09b389dff551] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:42.963829 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e97e349e-dab3-4c6f-819c-ce6f3631752d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:42.965080 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e97e349e-dab3-4c6f-819c-ce6f3631752d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:42.965736 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e97e349e-dab3-4c6f-819c-ce6f3631752d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:42.966561 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e97e349e-dab3-4c6f-819c-ce6f3631752d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:42.967214 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e97e349e-dab3-4c6f-819c-ce6f3631752d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:42.968006 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e97e349e-dab3-4c6f-819c-ce6f3631752d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:43.228270 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e97e349e-dab3-4c6f-819c-ce6f3631752d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:43.240363 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e97e349e-dab3-4c6f-819c-ce6f3631752d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:43.242447 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e97e349e-dab3-4c6f-819c-ce6f3631752d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:43.243961 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e97e349e-dab3-4c6f-819c-ce6f3631752d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551" status: 200 len: 1280 microversion: 2.25 time: 0.300191 Sep 08 10:43:43.245185 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 768/1561] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:43:42 2022] GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551 => generated 1280 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:43:43.251660 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0d022161-60ea-4436-9c14-28dd0d27103f tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '.version_select at 0x7f68e4d685e0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:43.340535 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0d022161-60ea-4436-9c14-28dd0d27103f tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/images/9a0f08f6-d8f6-4a73-8e9c-e267129f62dc" status: 200 len: 1413 microversion: 2.1 time: 0.092097 Sep 08 10:43:43.344608 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 769/1562] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:43:43 2022] GET /compute/v2.1/images/9a0f08f6-d8f6-4a73-8e9c-e267129f62dc => generated 1413 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:43.358308 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8808aa4b-4309-4242-84d8-845e0eda61ee tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '.version_select at 0x7f68e48c8550>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:43.437331 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8808aa4b-4309-4242-84d8-845e0eda61ee tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/images/8ca5d5cf-e00d-4aad-9d69-6851cbd20fce" status: 200 len: 1452 microversion: 2.1 time: 0.090991 Sep 08 10:43:43.446257 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 770/1563] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:43:43 2022] GET /compute/v2.1/images/8ca5d5cf-e00d-4aad-9d69-6851cbd20fce => generated 1452 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:43.452509 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-47d04a64-499d-44ce-9721-4c2d753ef900 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:43.453534 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-47d04a64-499d-44ce-9721-4c2d753ef900 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 82f0d3c4-fc81-428a-9141-2cc36da8b1b2] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:43.460815 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-47d04a64-499d-44ce-9721-4c2d753ef900 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:43.461815 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-47d04a64-499d-44ce-9721-4c2d753ef900 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:43.462512 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-47d04a64-499d-44ce-9721-4c2d753ef900 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:43.463553 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-47d04a64-499d-44ce-9721-4c2d753ef900 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:43.464332 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-47d04a64-499d-44ce-9721-4c2d753ef900 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:43.465014 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-47d04a64-499d-44ce-9721-4c2d753ef900 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:43.755467 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bbce0e4b-8c50-46fb-b0e1-e9bfbba53080 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:43.777060 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bbce0e4b-8c50-46fb-b0e1-e9bfbba53080 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940" status: 200 len: 1476 microversion: 2.1 time: 1.697972 Sep 08 10:43:43.797336 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 794/1564] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:42 2022] GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940 => generated 1476 bytes in 1713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:43:43.862534 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-47d04a64-499d-44ce-9721-4c2d753ef900 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:43.877957 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-47d04a64-499d-44ce-9721-4c2d753ef900 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/82f0d3c4-fc81-428a-9141-2cc36da8b1b2" status: 200 len: 1315 microversion: 2.1 time: 0.429939 Sep 08 10:43:43.878987 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 771/1565] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:43 2022] GET /compute/v2.1/servers/82f0d3c4-fc81-428a-9141-2cc36da8b1b2 => generated 1315 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:43.951121 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-187426ed-d90a-442e-8e3c-42d4b819751c tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:43.953703 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-187426ed-d90a-442e-8e3c-42d4b819751c tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 90974422-0d77-4970-9e94-ed6b3376ed29] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:43.974403 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-187426ed-d90a-442e-8e3c-42d4b819751c tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:43.975593 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-187426ed-d90a-442e-8e3c-42d4b819751c tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:43.976523 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-187426ed-d90a-442e-8e3c-42d4b819751c tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:43.977665 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-187426ed-d90a-442e-8e3c-42d4b819751c tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:43.978370 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-187426ed-d90a-442e-8e3c-42d4b819751c tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:43.979170 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-187426ed-d90a-442e-8e3c-42d4b819751c tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:44.276764 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a0f29025-b80f-42ad-b5de-2f795927483f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:44.277575 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a0f29025-b80f-42ad-b5de-2f795927483f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: cf3b6c0e-d390-44d6-91e5-09b389dff551] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:44.303701 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a0f29025-b80f-42ad-b5de-2f795927483f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:44.304464 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a0f29025-b80f-42ad-b5de-2f795927483f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:44.305451 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a0f29025-b80f-42ad-b5de-2f795927483f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:44.307337 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a0f29025-b80f-42ad-b5de-2f795927483f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:44.311791 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a0f29025-b80f-42ad-b5de-2f795927483f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:44.312683 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a0f29025-b80f-42ad-b5de-2f795927483f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:44.777500 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a0f29025-b80f-42ad-b5de-2f795927483f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:44.799907 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a0f29025-b80f-42ad-b5de-2f795927483f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:44.808706 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a0f29025-b80f-42ad-b5de-2f795927483f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:44.816793 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a0f29025-b80f-42ad-b5de-2f795927483f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551" status: 200 len: 1280 microversion: 2.25 time: 0.546957 Sep 08 10:43:44.828327 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 772/1566] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:43:44 2022] GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551 => generated 1280 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:43:44.858856 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ade48868-de32-4781-9481-ed2beb205e9f tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '.version_select at 0x7f68e5443550>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:45.491862 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-187426ed-d90a-442e-8e3c-42d4b819751c tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:45.546925 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-187426ed-d90a-442e-8e3c-42d4b819751c tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29" status: 200 len: 1211 microversion: 2.1 time: 1.569477 Sep 08 10:43:45.554905 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ade48868-de32-4781-9481-ed2beb205e9f tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/images/9a0f08f6-d8f6-4a73-8e9c-e267129f62dc" status: 200 len: 1413 microversion: 2.1 time: 0.713362 Sep 08 10:43:45.559308 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 795/1567] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:43 2022] GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29 => generated 1211 bytes in 1616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:45.563667 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 773/1568] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:43:44 2022] GET /compute/v2.1/images/9a0f08f6-d8f6-4a73-8e9c-e267129f62dc => generated 1413 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:45.582286 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ab564f63-f0cb-4fd6-a34c-adc0252f7d6a tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '.version_select at 0x7f68e4563940>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:45.588425 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-43c10db8-9318-4718-a9df-8b46decff2e5 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:45.591424 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-43c10db8-9318-4718-a9df-8b46decff2e5 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 287be913-2461-45d0-8000-360c3fdb5940] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:45.626783 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-43c10db8-9318-4718-a9df-8b46decff2e5 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:45.627885 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-43c10db8-9318-4718-a9df-8b46decff2e5 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:45.628587 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-43c10db8-9318-4718-a9df-8b46decff2e5 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:45.629679 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-43c10db8-9318-4718-a9df-8b46decff2e5 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:45.630418 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-43c10db8-9318-4718-a9df-8b46decff2e5 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:45.631175 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-43c10db8-9318-4718-a9df-8b46decff2e5 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:46.388500 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-43c10db8-9318-4718-a9df-8b46decff2e5 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:46.402155 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-43c10db8-9318-4718-a9df-8b46decff2e5 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940" status: 200 len: 1474 microversion: 2.1 time: 0.833908 Sep 08 10:43:46.405788 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 774/1569] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:45 2022] GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940 => generated 1474 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:46.417154 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-71e1cc69-2d35-4a3d-b7fd-25eb0d82af1c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:46.419184 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-71e1cc69-2d35-4a3d-b7fd-25eb0d82af1c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 82f0d3c4-fc81-428a-9141-2cc36da8b1b2] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:46.434265 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-71e1cc69-2d35-4a3d-b7fd-25eb0d82af1c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:46.435971 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-71e1cc69-2d35-4a3d-b7fd-25eb0d82af1c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:46.438353 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-71e1cc69-2d35-4a3d-b7fd-25eb0d82af1c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:46.440645 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-71e1cc69-2d35-4a3d-b7fd-25eb0d82af1c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:46.442335 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-71e1cc69-2d35-4a3d-b7fd-25eb0d82af1c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:46.444544 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-71e1cc69-2d35-4a3d-b7fd-25eb0d82af1c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:47.216882 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-71e1cc69-2d35-4a3d-b7fd-25eb0d82af1c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:47.238930 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-71e1cc69-2d35-4a3d-b7fd-25eb0d82af1c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/82f0d3c4-fc81-428a-9141-2cc36da8b1b2" status: 200 len: 1315 microversion: 2.1 time: 0.831355 Sep 08 10:43:47.253170 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 775/1570] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:46 2022] GET /compute/v2.1/servers/82f0d3c4-fc81-428a-9141-2cc36da8b1b2 => generated 1315 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:47.264887 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-12e1e6f2-c664-4dda-a054-d0076359f792 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:47.266275 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-12e1e6f2-c664-4dda-a054-d0076359f792 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: cf3b6c0e-d390-44d6-91e5-09b389dff551] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:47.278935 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-12e1e6f2-c664-4dda-a054-d0076359f792 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:47.280031 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-12e1e6f2-c664-4dda-a054-d0076359f792 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:47.280973 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-12e1e6f2-c664-4dda-a054-d0076359f792 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:47.287003 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-12e1e6f2-c664-4dda-a054-d0076359f792 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:47.293950 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-12e1e6f2-c664-4dda-a054-d0076359f792 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:47.295226 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-12e1e6f2-c664-4dda-a054-d0076359f792 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:47.826134 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-12e1e6f2-c664-4dda-a054-d0076359f792 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:47.850782 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-12e1e6f2-c664-4dda-a054-d0076359f792 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:47.862020 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-12e1e6f2-c664-4dda-a054-d0076359f792 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:47.885332 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-12e1e6f2-c664-4dda-a054-d0076359f792 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551" status: 200 len: 1280 microversion: 2.25 time: 0.630392 Sep 08 10:43:47.897572 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 776/1571] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:43:47 2022] GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551 => generated 1280 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:43:47.933806 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7c0671a3-a6ac-408c-a0ea-4ae27f92494f tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '.version_select at 0x7f68e4d261f0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:53.975933 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=5 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:43:55.508474 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:43:57.276778 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=64 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:43:57.848705 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=38 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:44:02.631587 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7c0671a3-a6ac-408c-a0ea-4ae27f92494f tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/images/9a0f08f6-d8f6-4a73-8e9c-e267129f62dc" status: 200 len: 1422 microversion: 2.1 time: 14.732233 Sep 08 10:44:02.635948 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ab564f63-f0cb-4fd6-a34c-adc0252f7d6a tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/images/8ca5d5cf-e00d-4aad-9d69-6851cbd20fce" status: 200 len: 1452 microversion: 2.1 time: 17.070563 Sep 08 10:44:02.637310 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 796/1572] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:43:45 2022] GET /compute/v2.1/images/8ca5d5cf-e00d-4aad-9d69-6851cbd20fce => generated 1452 bytes in 17077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:02.647342 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 777/1573] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:43:47 2022] GET /compute/v2.1/images/9a0f08f6-d8f6-4a73-8e9c-e267129f62dc => generated 1422 bytes in 14749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:02.659307 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6d27b104-df91-4fa2-8430-3818c41c76da tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:02.660922 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6d27b104-df91-4fa2-8430-3818c41c76da tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 90974422-0d77-4970-9e94-ed6b3376ed29] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:02.662085 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-431a539c-9d51-4b2e-92af-981e576b1f59 req-76f9e265-3e24-4252-a8dd-958ce92e231d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82f0d3c4-fc81-428a-9141-2cc36da8b1b2", "name": "network-vif-plugged", "status": "completed", "tag": "be795b19-5bca-4532-a89f-e4d4be7315ae"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:44:02.672884 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d27b104-df91-4fa2-8430-3818c41c76da tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:02.674825 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d27b104-df91-4fa2-8430-3818c41c76da tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:02.675574 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d27b104-df91-4fa2-8430-3818c41c76da tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:02.677503 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d27b104-df91-4fa2-8430-3818c41c76da tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:02.681435 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d27b104-df91-4fa2-8430-3818c41c76da tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:02.685509 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d27b104-df91-4fa2-8430-3818c41c76da tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:02.686016 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-431a539c-9d51-4b2e-92af-981e576b1f59 req-76f9e265-3e24-4252-a8dd-958ce92e231d service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:02.687439 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-431a539c-9d51-4b2e-92af-981e576b1f59 req-76f9e265-3e24-4252-a8dd-958ce92e231d service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:02.688143 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-431a539c-9d51-4b2e-92af-981e576b1f59 req-76f9e265-3e24-4252-a8dd-958ce92e231d service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:02.702723 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-431a539c-9d51-4b2e-92af-981e576b1f59 req-76f9e265-3e24-4252-a8dd-958ce92e231d service nova] Creating event network-vif-plugged:be795b19-5bca-4532-a89f-e4d4be7315ae for instance 82f0d3c4-fc81-428a-9141-2cc36da8b1b2 on n-h1-850501-12 Sep 08 10:44:02.717700 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-431a539c-9d51-4b2e-92af-981e576b1f59 req-76f9e265-3e24-4252-a8dd-958ce92e231d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060452 Sep 08 10:44:02.719199 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 778/1574] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:44:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:44:02.730436 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-24a8a056-e9a0-4e88-a5e8-b7998187cad4 req-833ea046-4d9e-41cf-bf63-6401aa2a0534 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90974422-0d77-4970-9e94-ed6b3376ed29", "tag": "4f14c555-3049-4edc-a15e-3ce8f070bbe0"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:44:02.765722 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-24a8a056-e9a0-4e88-a5e8-b7998187cad4 req-833ea046-4d9e-41cf-bf63-6401aa2a0534 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:02.766526 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-24a8a056-e9a0-4e88-a5e8-b7998187cad4 req-833ea046-4d9e-41cf-bf63-6401aa2a0534 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:02.767145 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-24a8a056-e9a0-4e88-a5e8-b7998187cad4 req-833ea046-4d9e-41cf-bf63-6401aa2a0534 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:02.813609 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-24a8a056-e9a0-4e88-a5e8-b7998187cad4 req-833ea046-4d9e-41cf-bf63-6401aa2a0534 service nova] Creating event network-changed:4f14c555-3049-4edc-a15e-3ce8f070bbe0 for instance 90974422-0d77-4970-9e94-ed6b3376ed29 on n-h2-850501-12 Sep 08 10:44:02.839132 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-24a8a056-e9a0-4e88-a5e8-b7998187cad4 req-833ea046-4d9e-41cf-bf63-6401aa2a0534 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116530 Sep 08 10:44:02.841174 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 779/1575] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:44:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:44:02.863349 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-204102b4-fa91-44f7-87fa-cd61816974fd tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:02.865124 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-204102b4-fa91-44f7-87fa-cd61816974fd tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 287be913-2461-45d0-8000-360c3fdb5940] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:02.884601 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-204102b4-fa91-44f7-87fa-cd61816974fd tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:02.891067 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-204102b4-fa91-44f7-87fa-cd61816974fd tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:02.891678 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-204102b4-fa91-44f7-87fa-cd61816974fd tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:02.892550 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-204102b4-fa91-44f7-87fa-cd61816974fd tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:02.897515 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-204102b4-fa91-44f7-87fa-cd61816974fd tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:02.901427 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-204102b4-fa91-44f7-87fa-cd61816974fd tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:03.234385 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-204102b4-fa91-44f7-87fa-cd61816974fd tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:03.247183 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-204102b4-fa91-44f7-87fa-cd61816974fd tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940" status: 200 len: 1471 microversion: 2.1 time: 0.403867 Sep 08 10:44:03.249600 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 780/1576] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:02 2022] GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940 => generated 1471 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:03.257531 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-eb2a9c68-a3a4-4c5a-96c9-ca0ec8c78303 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:03.263879 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-eb2a9c68-a3a4-4c5a-96c9-ca0ec8c78303 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] [instance: 790bcd42-ace5-4761-b46d-e0889855623f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:03.287956 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eb2a9c68-a3a4-4c5a-96c9-ca0ec8c78303 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:03.288734 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eb2a9c68-a3a4-4c5a-96c9-ca0ec8c78303 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:03.289532 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eb2a9c68-a3a4-4c5a-96c9-ca0ec8c78303 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:03.290603 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eb2a9c68-a3a4-4c5a-96c9-ca0ec8c78303 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:03.291821 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eb2a9c68-a3a4-4c5a-96c9-ca0ec8c78303 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:03.293005 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eb2a9c68-a3a4-4c5a-96c9-ca0ec8c78303 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:03.349067 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-eb2a9c68-a3a4-4c5a-96c9-ca0ec8c78303 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] 10.222.0.27 "GET /compute/v2.1/servers/790bcd42-ace5-4761-b46d-e0889855623f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.097966 Sep 08 10:44:03.350808 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 781/1577] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 10:44:03 2022] GET /compute/v2.1/servers/790bcd42-ace5-4761-b46d-e0889855623f/os-volume_attachments => generated 25 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:44:03.356122 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d5d445ae-ebf8-4ee9-b9d1-953ce867d2fd tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:03.357323 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d5d445ae-ebf8-4ee9-b9d1-953ce867d2fd tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 82f0d3c4-fc81-428a-9141-2cc36da8b1b2] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:03.365958 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d5d445ae-ebf8-4ee9-b9d1-953ce867d2fd tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:03.366966 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d5d445ae-ebf8-4ee9-b9d1-953ce867d2fd tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:03.367510 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d5d445ae-ebf8-4ee9-b9d1-953ce867d2fd tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:03.368391 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d5d445ae-ebf8-4ee9-b9d1-953ce867d2fd tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:03.368923 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d5d445ae-ebf8-4ee9-b9d1-953ce867d2fd tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:03.370262 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d5d445ae-ebf8-4ee9-b9d1-953ce867d2fd tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:03.825666 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6d27b104-df91-4fa2-8430-3818c41c76da tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:03.850480 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6d27b104-df91-4fa2-8430-3818c41c76da tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29" status: 200 len: 1199 microversion: 2.1 time: 1.211615 Sep 08 10:44:03.854592 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 797/1578] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:02 2022] GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29 => generated 1199 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:03.860219 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-eb1e39b0-526d-4457-9f94-bbad1fdf3e85 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:03.861147 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-eb1e39b0-526d-4457-9f94-bbad1fdf3e85 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: cf3b6c0e-d390-44d6-91e5-09b389dff551] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:03.869185 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb1e39b0-526d-4457-9f94-bbad1fdf3e85 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:03.870042 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb1e39b0-526d-4457-9f94-bbad1fdf3e85 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:03.870669 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb1e39b0-526d-4457-9f94-bbad1fdf3e85 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:03.871634 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb1e39b0-526d-4457-9f94-bbad1fdf3e85 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:03.872412 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb1e39b0-526d-4457-9f94-bbad1fdf3e85 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:03.873011 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb1e39b0-526d-4457-9f94-bbad1fdf3e85 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:03.882915 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d5d445ae-ebf8-4ee9-b9d1-953ce867d2fd tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:03.909356 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d5d445ae-ebf8-4ee9-b9d1-953ce867d2fd tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/82f0d3c4-fc81-428a-9141-2cc36da8b1b2" status: 200 len: 1315 microversion: 2.1 time: 0.557098 Sep 08 10:44:03.911029 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 782/1579] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:03 2022] GET /compute/v2.1/servers/82f0d3c4-fc81-428a-9141-2cc36da8b1b2 => generated 1315 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:03.918651 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bde26e3a-4654-4fbb-882f-03134b9faa59 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '.version_select at 0x7f68e518e310>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:04.020721 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bde26e3a-4654-4fbb-882f-03134b9faa59 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/images/9a0f08f6-d8f6-4a73-8e9c-e267129f62dc" status: 200 len: 1422 microversion: 2.1 time: 0.107949 Sep 08 10:44:04.021364 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 783/1580] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:44:03 2022] GET /compute/v2.1/images/9a0f08f6-d8f6-4a73-8e9c-e267129f62dc => generated 1422 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:04.044078 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-42919835-2de0-4d5b-90c3-a4355d31fba0 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:44:04.044516 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-42919835-2de0-4d5b-90c3-a4355d31fba0 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 287be913-2461-45d0-8000-360c3fdb5940] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:04.065532 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-42919835-2de0-4d5b-90c3-a4355d31fba0 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:04.066116 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-42919835-2de0-4d5b-90c3-a4355d31fba0 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:04.068755 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-42919835-2de0-4d5b-90c3-a4355d31fba0 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:04.071998 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-42919835-2de0-4d5b-90c3-a4355d31fba0 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:04.075319 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-42919835-2de0-4d5b-90c3-a4355d31fba0 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:04.075980 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-42919835-2de0-4d5b-90c3-a4355d31fba0 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:04.285522 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-42919835-2de0-4d5b-90c3-a4355d31fba0 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "POST /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940/action" status: 202 len: 0 microversion: 2.1 time: 0.250278 Sep 08 10:44:04.287132 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 784/1581] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:44:04 2022] POST /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:44:04.295661 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-dd7d9056-32f6-4692-8f61-f2033f9737c0 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:04.300161 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-dd7d9056-32f6-4692-8f61-f2033f9737c0 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] [instance: 790bcd42-ace5-4761-b46d-e0889855623f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:04.309592 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd7d9056-32f6-4692-8f61-f2033f9737c0 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:04.311893 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd7d9056-32f6-4692-8f61-f2033f9737c0 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:04.312699 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd7d9056-32f6-4692-8f61-f2033f9737c0 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:04.314120 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd7d9056-32f6-4692-8f61-f2033f9737c0 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:04.314969 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd7d9056-32f6-4692-8f61-f2033f9737c0 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:04.315703 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd7d9056-32f6-4692-8f61-f2033f9737c0 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:04.372315 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-dd7d9056-32f6-4692-8f61-f2033f9737c0 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] 10.222.0.27 "GET /compute/v2.1/servers/790bcd42-ace5-4761-b46d-e0889855623f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.083117 Sep 08 10:44:04.381418 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 785/1582] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 10:44:04 2022] GET /compute/v2.1/servers/790bcd42-ace5-4761-b46d-e0889855623f/os-volume_attachments => generated 25 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:44:04.390045 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a0a51b24-19d3-40c6-84c4-adc4b8c61aa3 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '.version_select at 0x7f68e4b745e0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:04.464990 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a0a51b24-19d3-40c6-84c4-adc4b8c61aa3 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/images/8ca5d5cf-e00d-4aad-9d69-6851cbd20fce" status: 200 len: 1452 microversion: 2.1 time: 0.080798 Sep 08 10:44:04.472123 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 786/1583] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:44:04 2022] GET /compute/v2.1/images/8ca5d5cf-e00d-4aad-9d69-6851cbd20fce => generated 1452 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:04.486216 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-02a22c7f-d11b-45bb-81b8-f3701bfeded9 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '.version_select at 0x7f68e493daf0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:04.754244 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-eb1e39b0-526d-4457-9f94-bbad1fdf3e85 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:04.773389 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-eb1e39b0-526d-4457-9f94-bbad1fdf3e85 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:04.775331 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-eb1e39b0-526d-4457-9f94-bbad1fdf3e85 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:04.777157 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-eb1e39b0-526d-4457-9f94-bbad1fdf3e85 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551" status: 200 len: 1280 microversion: 2.25 time: 0.920874 Sep 08 10:44:04.796311 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 798/1584] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:44:03 2022] GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551 => generated 1280 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:44:04.801953 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e3399531-cdb7-4817-8325-452d010057a9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:04.802893 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e3399531-cdb7-4817-8325-452d010057a9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 287be913-2461-45d0-8000-360c3fdb5940] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:04.815933 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e3399531-cdb7-4817-8325-452d010057a9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:04.816726 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e3399531-cdb7-4817-8325-452d010057a9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:04.817371 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e3399531-cdb7-4817-8325-452d010057a9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:04.818666 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e3399531-cdb7-4817-8325-452d010057a9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:04.819374 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e3399531-cdb7-4817-8325-452d010057a9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:04.820153 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e3399531-cdb7-4817-8325-452d010057a9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:05.396660 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e3399531-cdb7-4817-8325-452d010057a9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:05.450494 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e3399531-cdb7-4817-8325-452d010057a9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940" status: 200 len: 1470 microversion: 2.1 time: 0.646397 Sep 08 10:44:05.470990 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 799/1585] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:04 2022] GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940 => generated 1470 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:05.510277 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5c938914-fa63-4fa3-86f8-4c8ff18344e5 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:05.512629 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5c938914-fa63-4fa3-86f8-4c8ff18344e5 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] [instance: 790bcd42-ace5-4761-b46d-e0889855623f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:05.529870 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c938914-fa63-4fa3-86f8-4c8ff18344e5 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:05.530381 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c938914-fa63-4fa3-86f8-4c8ff18344e5 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:05.530835 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c938914-fa63-4fa3-86f8-4c8ff18344e5 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:05.531666 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c938914-fa63-4fa3-86f8-4c8ff18344e5 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:05.532141 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c938914-fa63-4fa3-86f8-4c8ff18344e5 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:05.532578 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c938914-fa63-4fa3-86f8-4c8ff18344e5 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:05.654768 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5c938914-fa63-4fa3-86f8-4c8ff18344e5 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] [instance: 790bcd42-ace5-4761-b46d-e0889855623f] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:44:05.928187 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5c938914-fa63-4fa3-86f8-4c8ff18344e5 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] 10.222.0.27 "DELETE /compute/v2.1/servers/790bcd42-ace5-4761-b46d-e0889855623f" status: 204 len: 0 microversion: 2.1 time: 0.458673 Sep 08 10:44:05.929584 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 800/1586] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:44:05 2022] DELETE /compute/v2.1/servers/790bcd42-ace5-4761-b46d-e0889855623f => generated 0 bytes in 461 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:44:05.936548 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-bd8a83a0-df44-4b10-8568-4c4002ad67b8 req-7a8b21ae-fab2-4398-9699-bcdc6786a897 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e6be670-294f-417f-a909-57c481faaf40", "name": "network-vif-plugged", "status": "completed", "tag": "2dc5c573-e6fe-4942-be41-259b760efba3"}, {"server_uuid": "cf3b6c0e-d390-44d6-91e5-09b389dff551", "name": "network-vif-plugged", "status": "completed", "tag": "1744beb8-80b4-4c92-8ebb-bb2e04113c75"}, {"server_uuid": "287be913-2461-45d0-8000-360c3fdb5940", "name": "network-vif-plugged", "status": "completed", "tag": "b0efdf4d-7120-405a-89e4-97e3a3ae0d87"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:44:05.986381 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-bd8a83a0-df44-4b10-8568-4c4002ad67b8 req-7a8b21ae-fab2-4398-9699-bcdc6786a897 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:05.997578 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-bd8a83a0-df44-4b10-8568-4c4002ad67b8 req-7a8b21ae-fab2-4398-9699-bcdc6786a897 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:05.998692 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-bd8a83a0-df44-4b10-8568-4c4002ad67b8 req-7a8b21ae-fab2-4398-9699-bcdc6786a897 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:06.018348 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-bd8a83a0-df44-4b10-8568-4c4002ad67b8 req-7a8b21ae-fab2-4398-9699-bcdc6786a897 service nova] Creating event network-vif-plugged:2dc5c573-e6fe-4942-be41-259b760efba3 for instance 3e6be670-294f-417f-a909-57c481faaf40 on n-h1-850501-12 Sep 08 10:44:06.022954 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-bd8a83a0-df44-4b10-8568-4c4002ad67b8 req-7a8b21ae-fab2-4398-9699-bcdc6786a897 service nova] Creating event network-vif-plugged:1744beb8-80b4-4c92-8ebb-bb2e04113c75 for instance cf3b6c0e-d390-44d6-91e5-09b389dff551 on n-h2-850501-12 Sep 08 10:44:06.024124 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-bd8a83a0-df44-4b10-8568-4c4002ad67b8 req-7a8b21ae-fab2-4398-9699-bcdc6786a897 service nova] Creating event network-vif-plugged:b0efdf4d-7120-405a-89e4-97e3a3ae0d87 for instance 287be913-2461-45d0-8000-360c3fdb5940 on n-h2-850501-12 Sep 08 10:44:06.039684 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [req-bd8a83a0-df44-4b10-8568-4c4002ad67b8 req-7a8b21ae-fab2-4398-9699-bcdc6786a897 service nova] Instance 287be913-2461-45d0-8000-360c3fdb5940 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850501-12', 'n-h1-850501-12'} {{(pid=128862) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 10:44:06.094341 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-bd8a83a0-df44-4b10-8568-4c4002ad67b8 req-7a8b21ae-fab2-4398-9699-bcdc6786a897 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.162275 Sep 08 10:44:06.096387 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 801/1587] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:44:05 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:44:06.120705 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-afdd8802-b342-4a5d-9b67-382f541345fc tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:06.122922 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-afdd8802-b342-4a5d-9b67-382f541345fc tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 90974422-0d77-4970-9e94-ed6b3376ed29] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:06.154615 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-afdd8802-b342-4a5d-9b67-382f541345fc tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:06.156358 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-afdd8802-b342-4a5d-9b67-382f541345fc tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:06.157521 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-afdd8802-b342-4a5d-9b67-382f541345fc tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:06.159252 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-afdd8802-b342-4a5d-9b67-382f541345fc tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:06.161589 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-afdd8802-b342-4a5d-9b67-382f541345fc tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:06.162814 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-afdd8802-b342-4a5d-9b67-382f541345fc tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:06.299792 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-02a22c7f-d11b-45bb-81b8-f3701bfeded9 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "DELETE /compute/v2.1/images/9a0f08f6-d8f6-4a73-8e9c-e267129f62dc" status: 204 len: 0 microversion: 2.1 time: 1.817064 Sep 08 10:44:06.301334 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 787/1588] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:04 2022] DELETE /compute/v2.1/images/9a0f08f6-d8f6-4a73-8e9c-e267129f62dc => generated 0 bytes in 1828 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:44:06.332221 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-10a8996d-7aeb-49a6-8ac2-526295e0f942 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:06.334458 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-10a8996d-7aeb-49a6-8ac2-526295e0f942 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 82f0d3c4-fc81-428a-9141-2cc36da8b1b2] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:06.385851 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-10a8996d-7aeb-49a6-8ac2-526295e0f942 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:06.400973 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-10a8996d-7aeb-49a6-8ac2-526295e0f942 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:06.402985 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-10a8996d-7aeb-49a6-8ac2-526295e0f942 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:06.405113 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-10a8996d-7aeb-49a6-8ac2-526295e0f942 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:06.405812 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-10a8996d-7aeb-49a6-8ac2-526295e0f942 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:06.406442 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-10a8996d-7aeb-49a6-8ac2-526295e0f942 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:06.852808 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-afdd8802-b342-4a5d-9b67-382f541345fc tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:06.869335 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-afdd8802-b342-4a5d-9b67-382f541345fc tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29" status: 200 len: 1199 microversion: 2.1 time: 0.767400 Sep 08 10:44:06.889774 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 802/1589] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:06 2022] GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29 => generated 1199 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:06.912549 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a30567dd-7296-4d95-9666-8a931452787d tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '.version_select at 0x7f68e4748550>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:06.989175 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a30567dd-7296-4d95-9666-8a931452787d tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/images/8ca5d5cf-e00d-4aad-9d69-6851cbd20fce" status: 200 len: 1452 microversion: 2.1 time: 0.097246 Sep 08 10:44:06.989710 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 803/1590] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:44:06 2022] GET /compute/v2.1/images/8ca5d5cf-e00d-4aad-9d69-6851cbd20fce => generated 1452 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:06.998006 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d55e55e4-c3e7-4f32-befe-9c7158486032 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:06.999546 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d55e55e4-c3e7-4f32-befe-9c7158486032 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: cf3b6c0e-d390-44d6-91e5-09b389dff551] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:07.009193 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d55e55e4-c3e7-4f32-befe-9c7158486032 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:07.011186 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d55e55e4-c3e7-4f32-befe-9c7158486032 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:07.011893 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d55e55e4-c3e7-4f32-befe-9c7158486032 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:07.013764 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d55e55e4-c3e7-4f32-befe-9c7158486032 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:07.014551 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d55e55e4-c3e7-4f32-befe-9c7158486032 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:07.016747 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d55e55e4-c3e7-4f32-befe-9c7158486032 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:07.143293 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-10a8996d-7aeb-49a6-8ac2-526295e0f942 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:07.176524 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-10a8996d-7aeb-49a6-8ac2-526295e0f942 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/82f0d3c4-fc81-428a-9141-2cc36da8b1b2" status: 200 len: 1501 microversion: 2.1 time: 0.873593 Sep 08 10:44:07.177137 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 788/1591] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:06 2022] GET /compute/v2.1/servers/82f0d3c4-fc81-428a-9141-2cc36da8b1b2 => generated 1501 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:07.199434 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a8df860a-b0eb-4ede-821a-5f18616b98ce tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:07.202920 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a8df860a-b0eb-4ede-821a-5f18616b98ce tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] [instance: 790bcd42-ace5-4761-b46d-e0889855623f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:07.225582 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a8df860a-b0eb-4ede-821a-5f18616b98ce tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:07.226361 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a8df860a-b0eb-4ede-821a-5f18616b98ce tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:07.228750 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a8df860a-b0eb-4ede-821a-5f18616b98ce tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:07.231768 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a8df860a-b0eb-4ede-821a-5f18616b98ce tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:07.232568 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a8df860a-b0eb-4ede-821a-5f18616b98ce tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:07.233462 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a8df860a-b0eb-4ede-821a-5f18616b98ce tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:07.289207 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d55e55e4-c3e7-4f32-befe-9c7158486032 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:07.343470 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d55e55e4-c3e7-4f32-befe-9c7158486032 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:07.353754 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d55e55e4-c3e7-4f32-befe-9c7158486032 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:07.359246 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d55e55e4-c3e7-4f32-befe-9c7158486032 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551" status: 200 len: 1280 microversion: 2.25 time: 0.366644 Sep 08 10:44:07.370812 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 804/1592] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:44:06 2022] GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551 => generated 1280 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:44:07.375911 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-945adb8e-1ba9-4321-9f49-1d80fe930072 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:07.385805 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-945adb8e-1ba9-4321-9f49-1d80fe930072 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 5a9072eb-573f-4576-b922-57245258445e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:07.417066 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-945adb8e-1ba9-4321-9f49-1d80fe930072 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:07.425314 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-945adb8e-1ba9-4321-9f49-1d80fe930072 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:07.426151 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-945adb8e-1ba9-4321-9f49-1d80fe930072 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:07.427643 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-945adb8e-1ba9-4321-9f49-1d80fe930072 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:07.440912 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-945adb8e-1ba9-4321-9f49-1d80fe930072 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:07.441496 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-945adb8e-1ba9-4321-9f49-1d80fe930072 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:07.535148 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-945adb8e-1ba9-4321-9f49-1d80fe930072 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 5a9072eb-573f-4576-b922-57245258445e] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:44:07.800722 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-945adb8e-1ba9-4321-9f49-1d80fe930072 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5a9072eb-573f-4576-b922-57245258445e" status: 204 len: 0 microversion: 2.1 time: 0.427660 Sep 08 10:44:07.802159 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 805/1593] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:44:07 2022] DELETE /compute/v2.1/servers/5a9072eb-573f-4576-b922-57245258445e => generated 0 bytes in 430 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:44:07.833117 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a8df860a-b0eb-4ede-821a-5f18616b98ce tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b206b1f0a1d4f6ebefffc97c51e6f51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8038d51a764867a85d2eab4ac10d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:07.849188 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a8df860a-b0eb-4ede-821a-5f18616b98ce tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] 10.222.0.27 "GET /compute/v2.1/servers/790bcd42-ace5-4761-b46d-e0889855623f" status: 200 len: 1683 microversion: 2.1 time: 0.670944 Sep 08 10:44:07.866685 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 789/1594] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:07 2022] GET /compute/v2.1/servers/790bcd42-ace5-4761-b46d-e0889855623f => generated 1683 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:07.871351 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-27f8575d-55d8-4bc6-bbcb-39ae9ea91e6c tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:07.872631 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-27f8575d-55d8-4bc6-bbcb-39ae9ea91e6c tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 287be913-2461-45d0-8000-360c3fdb5940] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:07.899992 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9603916e-db2a-4873-ba60-01c3f44e9b44 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:44:07.901106 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9603916e-db2a-4873-ba60-01c3f44e9b44 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 82f0d3c4-fc81-428a-9141-2cc36da8b1b2] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:07.923068 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27f8575d-55d8-4bc6-bbcb-39ae9ea91e6c tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:07.926321 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9603916e-db2a-4873-ba60-01c3f44e9b44 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:07.926645 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27f8575d-55d8-4bc6-bbcb-39ae9ea91e6c tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:07.927746 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27f8575d-55d8-4bc6-bbcb-39ae9ea91e6c tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:07.928437 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9603916e-db2a-4873-ba60-01c3f44e9b44 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:07.929760 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9603916e-db2a-4873-ba60-01c3f44e9b44 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:07.930666 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9603916e-db2a-4873-ba60-01c3f44e9b44 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:07.932377 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9603916e-db2a-4873-ba60-01c3f44e9b44 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:07.933167 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9603916e-db2a-4873-ba60-01c3f44e9b44 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:07.933901 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27f8575d-55d8-4bc6-bbcb-39ae9ea91e6c tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:07.935081 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27f8575d-55d8-4bc6-bbcb-39ae9ea91e6c tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:07.938580 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27f8575d-55d8-4bc6-bbcb-39ae9ea91e6c tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:08.112958 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9603916e-db2a-4873-ba60-01c3f44e9b44 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "POST /compute/v2.1/servers/82f0d3c4-fc81-428a-9141-2cc36da8b1b2/action" status: 202 len: 0 microversion: 2.1 time: 0.244019 Sep 08 10:44:08.115222 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 790/1595] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:44:07 2022] POST /compute/v2.1/servers/82f0d3c4-fc81-428a-9141-2cc36da8b1b2/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:44:08.132927 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9632d4c8-9e16-43b3-a23c-bf678d3d8515 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:08.137934 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9632d4c8-9e16-43b3-a23c-bf678d3d8515 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 90974422-0d77-4970-9e94-ed6b3376ed29] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:08.156132 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9632d4c8-9e16-43b3-a23c-bf678d3d8515 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:08.156707 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9632d4c8-9e16-43b3-a23c-bf678d3d8515 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:08.157237 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9632d4c8-9e16-43b3-a23c-bf678d3d8515 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:08.162549 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9632d4c8-9e16-43b3-a23c-bf678d3d8515 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:08.163070 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9632d4c8-9e16-43b3-a23c-bf678d3d8515 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:08.163532 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9632d4c8-9e16-43b3-a23c-bf678d3d8515 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:08.533850 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9632d4c8-9e16-43b3-a23c-bf678d3d8515 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:08.595123 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9632d4c8-9e16-43b3-a23c-bf678d3d8515 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29" status: 200 len: 1199 microversion: 2.1 time: 0.473452 Sep 08 10:44:08.596898 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 791/1596] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:08 2022] GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29 => generated 1199 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:08.618022 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-54e6c0a3-b303-492c-961c-8fc07553e650 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '.version_select at 0x7f68e493d8b0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:08.735773 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-54e6c0a3-b303-492c-961c-8fc07553e650 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/images/8ca5d5cf-e00d-4aad-9d69-6851cbd20fce" status: 200 len: 1452 microversion: 2.1 time: 0.136798 Sep 08 10:44:08.736812 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 792/1597] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:44:08 2022] GET /compute/v2.1/images/8ca5d5cf-e00d-4aad-9d69-6851cbd20fce => generated 1452 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:08.742414 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ce5562db-f8a8-4992-a703-3bad703c45fd tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-699803322", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "c5773ac9-6cb1-4d96-9195-6fd6adb76930"}]}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:44:08.862119 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-ce5562db-f8a8-4992-a703-3bad703c45fd tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] validate_networks() for [('c5773ac9-6cb1-4d96-9195-6fd6adb76930', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:44:09.223615 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-27f8575d-55d8-4bc6-bbcb-39ae9ea91e6c tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:09.239471 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-27f8575d-55d8-4bc6-bbcb-39ae9ea91e6c tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940" status: 200 len: 1470 microversion: 2.1 time: 1.435727 Sep 08 10:44:09.241399 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 806/1598] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:07 2022] GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940 => generated 1470 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:09.248145 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1c3ba7f1-91be-4381-ae0c-7b34e8dac945 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:09.258185 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1c3ba7f1-91be-4381-ae0c-7b34e8dac945 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 82f0d3c4-fc81-428a-9141-2cc36da8b1b2] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:09.271461 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c3ba7f1-91be-4381-ae0c-7b34e8dac945 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:09.281586 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c3ba7f1-91be-4381-ae0c-7b34e8dac945 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:09.282406 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c3ba7f1-91be-4381-ae0c-7b34e8dac945 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:09.283431 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c3ba7f1-91be-4381-ae0c-7b34e8dac945 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:09.284635 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c3ba7f1-91be-4381-ae0c-7b34e8dac945 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:09.285913 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c3ba7f1-91be-4381-ae0c-7b34e8dac945 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:09.774204 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1c3ba7f1-91be-4381-ae0c-7b34e8dac945 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:09.788127 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1c3ba7f1-91be-4381-ae0c-7b34e8dac945 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/82f0d3c4-fc81-428a-9141-2cc36da8b1b2" status: 200 len: 1506 microversion: 2.1 time: 0.545257 Sep 08 10:44:09.802486 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 807/1599] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:09 2022] GET /compute/v2.1/servers/82f0d3c4-fc81-428a-9141-2cc36da8b1b2 => generated 1506 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:09.813923 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-a52225b7-30ba-42d1-ad5b-34cd2c1cc39e req-7ff8729e-4587-4ae1-9c13-ee3fcec84693 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a9072eb-573f-4576-b922-57245258445e", "name": "network-vif-unplugged", "status": "completed", "tag": "b11c68f4-e560-4a23-9f9a-548f2856de5f"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:44:09.829441 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a52225b7-30ba-42d1-ad5b-34cd2c1cc39e req-7ff8729e-4587-4ae1-9c13-ee3fcec84693 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:09.832946 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a52225b7-30ba-42d1-ad5b-34cd2c1cc39e req-7ff8729e-4587-4ae1-9c13-ee3fcec84693 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:09.838950 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a52225b7-30ba-42d1-ad5b-34cd2c1cc39e req-7ff8729e-4587-4ae1-9c13-ee3fcec84693 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:09.871097 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-a52225b7-30ba-42d1-ad5b-34cd2c1cc39e req-7ff8729e-4587-4ae1-9c13-ee3fcec84693 service nova] Creating event network-vif-unplugged:b11c68f4-e560-4a23-9f9a-548f2856de5f for instance 5a9072eb-573f-4576-b922-57245258445e on n-h1-850501-12 Sep 08 10:44:09.880869 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-a52225b7-30ba-42d1-ad5b-34cd2c1cc39e req-7ff8729e-4587-4ae1-9c13-ee3fcec84693 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076650 Sep 08 10:44:09.884940 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 808/1600] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:44:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:44:09.909903 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ad067e77-68ee-46d4-8ab7-8fc297de939f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:09.923442 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ad067e77-68ee-46d4-8ab7-8fc297de939f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: cf3b6c0e-d390-44d6-91e5-09b389dff551] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:09.929872 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-ce5562db-f8a8-4992-a703-3bad703c45fd tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:44:09.930451 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-ce5562db-f8a8-4992-a703-3bad703c45fd tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:44:09.932595 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-ce5562db-f8a8-4992-a703-3bad703c45fd tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:44:09.933320 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-ce5562db-f8a8-4992-a703-3bad703c45fd tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:44:09.934054 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-ce5562db-f8a8-4992-a703-3bad703c45fd tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:44:09.942790 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad067e77-68ee-46d4-8ab7-8fc297de939f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:09.943560 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad067e77-68ee-46d4-8ab7-8fc297de939f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:09.944266 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad067e77-68ee-46d4-8ab7-8fc297de939f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:09.945274 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad067e77-68ee-46d4-8ab7-8fc297de939f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:09.946134 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad067e77-68ee-46d4-8ab7-8fc297de939f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:09.946832 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad067e77-68ee-46d4-8ab7-8fc297de939f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:09.964024 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ce5562db-f8a8-4992-a703-3bad703c45fd tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:09.966134 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ce5562db-f8a8-4992-a703-3bad703c45fd tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:09.966898 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ce5562db-f8a8-4992-a703-3bad703c45fd tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:09.967948 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ce5562db-f8a8-4992-a703-3bad703c45fd tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:09.968711 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ce5562db-f8a8-4992-a703-3bad703c45fd tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:09.969486 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ce5562db-f8a8-4992-a703-3bad703c45fd tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:10.042602 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-ce5562db-f8a8-4992-a703-3bad703c45fd tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Getting quotas for project eeeb450420314221bd2469816e2995d1. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:44:10.064398 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-ce5562db-f8a8-4992-a703-3bad703c45fd tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Getting quotas for user ce8c8c85354d46aeb786c8049b81e04d and project eeeb450420314221bd2469816e2995d1. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:44:10.099963 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ce5562db-f8a8-4992-a703-3bad703c45fd tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:44:10.105966 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ce5562db-f8a8-4992-a703-3bad703c45fd tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 64c88fa0-6a01-42fc-b0e9-98b9e84a199d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:44:10.201326 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ce5562db-f8a8-4992-a703-3bad703c45fd tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.462157 Sep 08 10:44:10.202650 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 793/1601] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:44:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1465 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:44:10.208673 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-54583c31-106a-46f3-a836-420845c4496f tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:10.209401 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-54583c31-106a-46f3-a836-420845c4496f tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] [instance: 790bcd42-ace5-4761-b46d-e0889855623f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:10.220297 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-54583c31-106a-46f3-a836-420845c4496f tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:10.221685 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-54583c31-106a-46f3-a836-420845c4496f tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:10.222377 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-54583c31-106a-46f3-a836-420845c4496f tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:10.225102 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-54583c31-106a-46f3-a836-420845c4496f tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:10.225947 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-54583c31-106a-46f3-a836-420845c4496f tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:10.226673 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-54583c31-106a-46f3-a836-420845c4496f tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:10.486769 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-54583c31-106a-46f3-a836-420845c4496f tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b206b1f0a1d4f6ebefffc97c51e6f51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8038d51a764867a85d2eab4ac10d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:10.499265 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-54583c31-106a-46f3-a836-420845c4496f tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] 10.222.0.27 "GET /compute/v2.1/servers/790bcd42-ace5-4761-b46d-e0889855623f" status: 200 len: 1683 microversion: 2.1 time: 0.295264 Sep 08 10:44:10.500517 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 794/1602] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:10 2022] GET /compute/v2.1/servers/790bcd42-ace5-4761-b46d-e0889855623f => generated 1683 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:10.519171 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ad067e77-68ee-46d4-8ab7-8fc297de939f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:10.529744 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1833b0db-2a4c-4ac3-ba4e-e6f7c9187c5a tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:10.530400 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1833b0db-2a4c-4ac3-ba4e-e6f7c9187c5a tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 90974422-0d77-4970-9e94-ed6b3376ed29] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:10.539283 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ad067e77-68ee-46d4-8ab7-8fc297de939f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:10.542976 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1833b0db-2a4c-4ac3-ba4e-e6f7c9187c5a tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:10.543477 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1833b0db-2a4c-4ac3-ba4e-e6f7c9187c5a tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:10.545224 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ad067e77-68ee-46d4-8ab7-8fc297de939f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:10.546715 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1833b0db-2a4c-4ac3-ba4e-e6f7c9187c5a tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:10.549246 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1833b0db-2a4c-4ac3-ba4e-e6f7c9187c5a tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:10.549558 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ad067e77-68ee-46d4-8ab7-8fc297de939f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551" status: 200 len: 1280 microversion: 2.25 time: 0.651645 Sep 08 10:44:10.549815 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1833b0db-2a4c-4ac3-ba4e-e6f7c9187c5a tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:10.550437 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1833b0db-2a4c-4ac3-ba4e-e6f7c9187c5a tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:10.552793 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 809/1603] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:44:09 2022] GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551 => generated 1280 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:44:10.590985 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c0ee583a-0c92-4bb8-88a6-4c713600b9e2 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '.version_select at 0x7f68e45cbd30>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:10.667972 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c0ee583a-0c92-4bb8-88a6-4c713600b9e2 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/images/8ca5d5cf-e00d-4aad-9d69-6851cbd20fce" status: 200 len: 1461 microversion: 2.1 time: 0.091320 Sep 08 10:44:10.673315 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 810/1604] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:44:10 2022] GET /compute/v2.1/images/8ca5d5cf-e00d-4aad-9d69-6851cbd20fce => generated 1461 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:10.684716 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-83b4668f-696c-4f6d-8fb2-8c8ff31728ac tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:10.685677 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-83b4668f-696c-4f6d-8fb2-8c8ff31728ac tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 64c88fa0-6a01-42fc-b0e9-98b9e84a199d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:10.921284 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-83b4668f-696c-4f6d-8fb2-8c8ff31728ac tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:10.964509 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-83b4668f-696c-4f6d-8fb2-8c8ff31728ac tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d" status: 200 len: 1207 microversion: 2.1 time: 0.288010 Sep 08 10:44:10.965582 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 811/1605] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:10 2022] GET /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d => generated 1207 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:10.985815 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1833b0db-2a4c-4ac3-ba4e-e6f7c9187c5a tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:10.989453 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-37f402b3-f272-403d-96e5-9df156877167 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:10.991221 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-37f402b3-f272-403d-96e5-9df156877167 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 287be913-2461-45d0-8000-360c3fdb5940] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:11.004104 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1833b0db-2a4c-4ac3-ba4e-e6f7c9187c5a tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29" status: 200 len: 1199 microversion: 2.1 time: 0.477642 Sep 08 10:44:11.005370 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 795/1606] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:10 2022] GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29 => generated 1199 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:11.009734 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-37f402b3-f272-403d-96e5-9df156877167 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:11.010266 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-37f402b3-f272-403d-96e5-9df156877167 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:11.010763 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-37f402b3-f272-403d-96e5-9df156877167 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:11.014840 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-37f402b3-f272-403d-96e5-9df156877167 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:11.015842 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-29055e98-7e13-4cc5-a0d3-3e3040db1554 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '.version_select at 0x7f68e4b74550>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:11.020496 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-37f402b3-f272-403d-96e5-9df156877167 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:11.021283 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-37f402b3-f272-403d-96e5-9df156877167 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:11.108033 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-29055e98-7e13-4cc5-a0d3-3e3040db1554 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/images/8ca5d5cf-e00d-4aad-9d69-6851cbd20fce" status: 200 len: 1461 microversion: 2.1 time: 0.099674 Sep 08 10:44:11.117454 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 796/1607] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:44:11 2022] GET /compute/v2.1/images/8ca5d5cf-e00d-4aad-9d69-6851cbd20fce => generated 1461 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:11.129493 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c627acaa-05d3-4589-b94d-e516dca4c2ad tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:11.133443 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c627acaa-05d3-4589-b94d-e516dca4c2ad tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 82f0d3c4-fc81-428a-9141-2cc36da8b1b2] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:11.156915 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c627acaa-05d3-4589-b94d-e516dca4c2ad tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:11.158195 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c627acaa-05d3-4589-b94d-e516dca4c2ad tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:11.159034 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c627acaa-05d3-4589-b94d-e516dca4c2ad tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:11.160270 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c627acaa-05d3-4589-b94d-e516dca4c2ad tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:11.160992 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c627acaa-05d3-4589-b94d-e516dca4c2ad tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:11.161690 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c627acaa-05d3-4589-b94d-e516dca4c2ad tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:11.419054 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c627acaa-05d3-4589-b94d-e516dca4c2ad tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:11.430228 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c627acaa-05d3-4589-b94d-e516dca4c2ad tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/82f0d3c4-fc81-428a-9141-2cc36da8b1b2" status: 200 len: 1486 microversion: 2.1 time: 0.311030 Sep 08 10:44:11.432017 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 797/1608] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:11 2022] GET /compute/v2.1/servers/82f0d3c4-fc81-428a-9141-2cc36da8b1b2 => generated 1486 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:11.454326 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b0aa6385-97a1-4714-94e2-735af991c729 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:11.455154 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b0aa6385-97a1-4714-94e2-735af991c729 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] [instance: 3e6be670-294f-417f-a909-57c481faaf40] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:11.469450 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b0aa6385-97a1-4714-94e2-735af991c729 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:11.471096 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b0aa6385-97a1-4714-94e2-735af991c729 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:11.471942 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b0aa6385-97a1-4714-94e2-735af991c729 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:11.474874 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b0aa6385-97a1-4714-94e2-735af991c729 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:11.476079 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b0aa6385-97a1-4714-94e2-735af991c729 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:11.477249 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b0aa6385-97a1-4714-94e2-735af991c729 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:11.706566 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b0aa6385-97a1-4714-94e2-735af991c729 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7415a5b46c4587a8806661b70e3913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604588959944720923ec2d5e0bf81c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:11.709447 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:44:11.721766 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b0aa6385-97a1-4714-94e2-735af991c729 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/servers/3e6be670-294f-417f-a909-57c481faaf40" status: 200 len: 1466 microversion: 2.1 time: 0.287789 Sep 08 10:44:11.722408 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 798/1609] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:11 2022] GET /compute/v2.1/servers/3e6be670-294f-417f-a909-57c481faaf40 => generated 1466 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:11.728796 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-58ba1e0b-d1ba-434e-8da2-7df6c0db8087 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:11.729246 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-58ba1e0b-d1ba-434e-8da2-7df6c0db8087 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 82f0d3c4-fc81-428a-9141-2cc36da8b1b2] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:11.736938 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-58ba1e0b-d1ba-434e-8da2-7df6c0db8087 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:11.737779 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-58ba1e0b-d1ba-434e-8da2-7df6c0db8087 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:11.738314 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-58ba1e0b-d1ba-434e-8da2-7df6c0db8087 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:11.739203 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-58ba1e0b-d1ba-434e-8da2-7df6c0db8087 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:11.739712 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-58ba1e0b-d1ba-434e-8da2-7df6c0db8087 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:11.740143 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-58ba1e0b-d1ba-434e-8da2-7df6c0db8087 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:11.758972 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-37f402b3-f272-403d-96e5-9df156877167 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:11.771612 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-37f402b3-f272-403d-96e5-9df156877167 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940" status: 200 len: 1470 microversion: 2.1 time: 0.802508 Sep 08 10:44:11.785063 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-58ba1e0b-d1ba-434e-8da2-7df6c0db8087 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 82f0d3c4-fc81-428a-9141-2cc36da8b1b2] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:44:11.785927 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 812/1610] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:10 2022] GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940 => generated 1470 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:11.794193 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c1d70eb6-6abc-4c1d-814d-714bd529b9ab tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:11.795363 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c1d70eb6-6abc-4c1d-814d-714bd529b9ab tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] [instance: 790bcd42-ace5-4761-b46d-e0889855623f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:11.805352 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c1d70eb6-6abc-4c1d-814d-714bd529b9ab tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:11.809999 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c1d70eb6-6abc-4c1d-814d-714bd529b9ab tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:11.810985 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c1d70eb6-6abc-4c1d-814d-714bd529b9ab tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:11.816360 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c1d70eb6-6abc-4c1d-814d-714bd529b9ab tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:11.816951 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c1d70eb6-6abc-4c1d-814d-714bd529b9ab tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:11.817604 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c1d70eb6-6abc-4c1d-814d-714bd529b9ab tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:11.941187 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-58ba1e0b-d1ba-434e-8da2-7df6c0db8087 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "DELETE /compute/v2.1/servers/82f0d3c4-fc81-428a-9141-2cc36da8b1b2" status: 204 len: 0 microversion: 2.1 time: 0.210526 Sep 08 10:44:11.941187 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 799/1611] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:44:11 2022] DELETE /compute/v2.1/servers/82f0d3c4-fc81-428a-9141-2cc36da8b1b2 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:44:11.944470 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-202be62e-93cd-44fd-b9eb-af0144421ddd tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:11.944470 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-202be62e-93cd-44fd-b9eb-af0144421ddd tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: cf3b6c0e-d390-44d6-91e5-09b389dff551] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:11.952874 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-202be62e-93cd-44fd-b9eb-af0144421ddd tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:11.953536 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-202be62e-93cd-44fd-b9eb-af0144421ddd tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:11.954039 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-202be62e-93cd-44fd-b9eb-af0144421ddd tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:11.954760 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-202be62e-93cd-44fd-b9eb-af0144421ddd tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:11.955216 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-202be62e-93cd-44fd-b9eb-af0144421ddd tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:11.955637 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-202be62e-93cd-44fd-b9eb-af0144421ddd tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:12.006213 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c1d70eb6-6abc-4c1d-814d-714bd529b9ab tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b206b1f0a1d4f6ebefffc97c51e6f51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8038d51a764867a85d2eab4ac10d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:12.022834 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c1d70eb6-6abc-4c1d-814d-714bd529b9ab tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] 10.222.0.27 "GET /compute/v2.1/servers/790bcd42-ace5-4761-b46d-e0889855623f" status: 200 len: 1615 microversion: 2.1 time: 0.235493 Sep 08 10:44:12.024101 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 813/1612] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:11 2022] GET /compute/v2.1/servers/790bcd42-ace5-4761-b46d-e0889855623f => generated 1615 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:12.029615 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9d8c04af-34c6-4816-b83c-2c719aeee5ef tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-2031456946"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:44:12.032889 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9d8c04af-34c6-4816-b83c-2c719aeee5ef tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] [instance: dac27157-b08e-4f13-b97e-3c5b653bd0b3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:12.041701 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d8c04af-34c6-4816-b83c-2c719aeee5ef tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:12.042556 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d8c04af-34c6-4816-b83c-2c719aeee5ef tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:12.043193 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d8c04af-34c6-4816-b83c-2c719aeee5ef tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:12.044119 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d8c04af-34c6-4816-b83c-2c719aeee5ef tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:12.044746 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d8c04af-34c6-4816-b83c-2c719aeee5ef tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:12.045281 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d8c04af-34c6-4816-b83c-2c719aeee5ef tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:12.051702 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:44:12.212674 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-202be62e-93cd-44fd-b9eb-af0144421ddd tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:12.244866 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-202be62e-93cd-44fd-b9eb-af0144421ddd tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:12.248404 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-202be62e-93cd-44fd-b9eb-af0144421ddd tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:12.251453 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-202be62e-93cd-44fd-b9eb-af0144421ddd tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551" status: 200 len: 1477 microversion: 2.25 time: 0.313549 Sep 08 10:44:12.252503 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 800/1613] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:44:11 2022] GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551 => generated 1477 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:44:12.259030 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1642a27b-13c1-4ca3-933e-8c8838a00116 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:12.261013 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1642a27b-13c1-4ca3-933e-8c8838a00116 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 82f0d3c4-fc81-428a-9141-2cc36da8b1b2] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:12.273758 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1642a27b-13c1-4ca3-933e-8c8838a00116 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:12.275252 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1642a27b-13c1-4ca3-933e-8c8838a00116 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:12.276364 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1642a27b-13c1-4ca3-933e-8c8838a00116 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:12.277541 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1642a27b-13c1-4ca3-933e-8c8838a00116 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:12.279723 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1642a27b-13c1-4ca3-933e-8c8838a00116 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:12.280451 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1642a27b-13c1-4ca3-933e-8c8838a00116 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:12.425235 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9d8c04af-34c6-4816-b83c-2c719aeee5ef tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "POST /compute/v2.1/servers/dac27157-b08e-4f13-b97e-3c5b653bd0b3/action" status: 202 len: 0 microversion: 2.1 time: 0.393856 Sep 08 10:44:12.427983 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 814/1614] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:44:12 2022] POST /compute/v2.1/servers/dac27157-b08e-4f13-b97e-3c5b653bd0b3/action => generated 0 bytes in 403 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 08 10:44:12.446317 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3a04b614-e40a-41b3-9424-cef917d5d3fc tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:12.448192 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3a04b614-e40a-41b3-9424-cef917d5d3fc tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 64c88fa0-6a01-42fc-b0e9-98b9e84a199d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:12.457371 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a04b614-e40a-41b3-9424-cef917d5d3fc tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:12.457371 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a04b614-e40a-41b3-9424-cef917d5d3fc tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:12.460373 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a04b614-e40a-41b3-9424-cef917d5d3fc tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:12.461782 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a04b614-e40a-41b3-9424-cef917d5d3fc tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:12.462187 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a04b614-e40a-41b3-9424-cef917d5d3fc tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:12.462761 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a04b614-e40a-41b3-9424-cef917d5d3fc tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:12.613941 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1642a27b-13c1-4ca3-933e-8c8838a00116 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:12.626366 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1642a27b-13c1-4ca3-933e-8c8838a00116 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/82f0d3c4-fc81-428a-9141-2cc36da8b1b2" status: 200 len: 1492 microversion: 2.1 time: 0.372283 Sep 08 10:44:12.627772 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 801/1615] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:12 2022] GET /compute/v2.1/servers/82f0d3c4-fc81-428a-9141-2cc36da8b1b2 => generated 1492 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:12.640826 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b9d60892-78cc-464c-b54b-b37522eb7db0 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:12.642268 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b9d60892-78cc-464c-b54b-b37522eb7db0 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 90974422-0d77-4970-9e94-ed6b3376ed29] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:12.675492 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b9d60892-78cc-464c-b54b-b37522eb7db0 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:12.679297 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b9d60892-78cc-464c-b54b-b37522eb7db0 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:12.679923 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b9d60892-78cc-464c-b54b-b37522eb7db0 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:12.681193 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b9d60892-78cc-464c-b54b-b37522eb7db0 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:12.682109 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b9d60892-78cc-464c-b54b-b37522eb7db0 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:12.685566 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b9d60892-78cc-464c-b54b-b37522eb7db0 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:12.697808 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3a04b614-e40a-41b3-9424-cef917d5d3fc tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:12.717881 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3a04b614-e40a-41b3-9424-cef917d5d3fc tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d" status: 200 len: 1259 microversion: 2.1 time: 0.285481 Sep 08 10:44:12.719403 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 815/1616] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:12 2022] GET /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d => generated 1259 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:13.186294 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b9d60892-78cc-464c-b54b-b37522eb7db0 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:13.201573 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b9d60892-78cc-464c-b54b-b37522eb7db0 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29" status: 200 len: 1199 microversion: 2.1 time: 0.572404 Sep 08 10:44:13.221001 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 802/1617] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:12 2022] GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29 => generated 1199 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:13.236577 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fc174f99-89f8-423e-9c7b-4d2b4129e29d tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '.version_select at 0x7f68e4d37790>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:13.327370 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fc174f99-89f8-423e-9c7b-4d2b4129e29d tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/images/ef654b65-07f7-425a-b46d-ccc7e6f6fb53" status: 200 len: 1453 microversion: 2.1 time: 0.117835 Sep 08 10:44:13.340180 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 803/1618] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:44:13 2022] GET /compute/v2.1/images/ef654b65-07f7-425a-b46d-ccc7e6f6fb53 => generated 1453 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:13.350317 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-78c10d82-680e-4aaf-8b29-f9b424d4cd38 req-00fd7e5a-2909-4216-a65d-9f5c5a2edeaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "790bcd42-ace5-4761-b46d-e0889855623f", "name": "network-vif-deleted", "tag": "6e25a2af-b9a9-477e-a24c-f79b73a6fdc9"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:44:13.382116 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-78c10d82-680e-4aaf-8b29-f9b424d4cd38 req-00fd7e5a-2909-4216-a65d-9f5c5a2edeaa service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:13.383244 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-78c10d82-680e-4aaf-8b29-f9b424d4cd38 req-00fd7e5a-2909-4216-a65d-9f5c5a2edeaa service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:13.388849 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-78c10d82-680e-4aaf-8b29-f9b424d4cd38 req-00fd7e5a-2909-4216-a65d-9f5c5a2edeaa service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:13.449532 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-78c10d82-680e-4aaf-8b29-f9b424d4cd38 req-00fd7e5a-2909-4216-a65d-9f5c5a2edeaa service nova] Creating event network-vif-deleted:6e25a2af-b9a9-477e-a24c-f79b73a6fdc9 for instance 790bcd42-ace5-4761-b46d-e0889855623f on n-h2-850501-12 Sep 08 10:44:13.466367 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-78c10d82-680e-4aaf-8b29-f9b424d4cd38 req-00fd7e5a-2909-4216-a65d-9f5c5a2edeaa service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124647 Sep 08 10:44:13.470155 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 804/1619] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:44:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:44:13.483896 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2fbfab0e-9ba1-4503-8e37-55d987d825e7 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:13.484153 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fba4386a-4d95-4fd6-9327-c9ba8a6fbf27 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:13.485309 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fba4386a-4d95-4fd6-9327-c9ba8a6fbf27 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] [instance: cf3b6c0e-d390-44d6-91e5-09b389dff551] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:13.491462 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2fbfab0e-9ba1-4503-8e37-55d987d825e7 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 287be913-2461-45d0-8000-360c3fdb5940] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:13.507702 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2fbfab0e-9ba1-4503-8e37-55d987d825e7 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:13.513169 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2fbfab0e-9ba1-4503-8e37-55d987d825e7 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:13.513169 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2fbfab0e-9ba1-4503-8e37-55d987d825e7 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:13.513169 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2fbfab0e-9ba1-4503-8e37-55d987d825e7 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:13.513648 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2fbfab0e-9ba1-4503-8e37-55d987d825e7 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:13.515671 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2fbfab0e-9ba1-4503-8e37-55d987d825e7 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:13.518672 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fba4386a-4d95-4fd6-9327-c9ba8a6fbf27 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:13.519530 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fba4386a-4d95-4fd6-9327-c9ba8a6fbf27 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:13.520290 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fba4386a-4d95-4fd6-9327-c9ba8a6fbf27 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:13.521616 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fba4386a-4d95-4fd6-9327-c9ba8a6fbf27 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:13.522440 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fba4386a-4d95-4fd6-9327-c9ba8a6fbf27 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:13.523195 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fba4386a-4d95-4fd6-9327-c9ba8a6fbf27 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:13.946241 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2fbfab0e-9ba1-4503-8e37-55d987d825e7 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:13.965533 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2fbfab0e-9ba1-4503-8e37-55d987d825e7 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940" status: 200 len: 1470 microversion: 2.1 time: 0.491224 Sep 08 10:44:14.001385 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 805/1620] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:13 2022] GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940 => generated 1470 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:14.008343 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-2e1e7d47-6fd1-439a-8d8f-995e23266119 req-c9452b28-f4fc-4c6c-a241-14ba8fa62788 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90974422-0d77-4970-9e94-ed6b3376ed29", "name": "network-vif-plugged", "status": "completed", "tag": "4f14c555-3049-4edc-a15e-3ce8f070bbe0"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:44:14.067950 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-2e1e7d47-6fd1-439a-8d8f-995e23266119 req-c9452b28-f4fc-4c6c-a241-14ba8fa62788 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:14.068451 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-2e1e7d47-6fd1-439a-8d8f-995e23266119 req-c9452b28-f4fc-4c6c-a241-14ba8fa62788 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:14.069121 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-2e1e7d47-6fd1-439a-8d8f-995e23266119 req-c9452b28-f4fc-4c6c-a241-14ba8fa62788 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:14.082819 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-fba4386a-4d95-4fd6-9327-c9ba8a6fbf27 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lazy-loading 'services' on Instance uuid cf3b6c0e-d390-44d6-91e5-09b389dff551 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:44:14.123456 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-2e1e7d47-6fd1-439a-8d8f-995e23266119 req-c9452b28-f4fc-4c6c-a241-14ba8fa62788 service nova] Creating event network-vif-plugged:4f14c555-3049-4edc-a15e-3ce8f070bbe0 for instance 90974422-0d77-4970-9e94-ed6b3376ed29 on n-h2-850501-12 Sep 08 10:44:14.125632 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fba4386a-4d95-4fd6-9327-c9ba8a6fbf27 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551" status: 200 len: 1971 microversion: 2.25 time: 1.393831 Sep 08 10:44:14.148632 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-2e1e7d47-6fd1-439a-8d8f-995e23266119 req-c9452b28-f4fc-4c6c-a241-14ba8fa62788 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145856 Sep 08 10:44:14.149283 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 806/1621] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:44:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:44:14.152559 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 816/1622] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:44:12 2022] GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551 => generated 1971 bytes in 1432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:44:14.161017 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4555c3b0-01ca-44d4-8a3e-ce2bc7aeeaf4 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:14.161803 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9ee1d9e7-a4d5-4e8d-a6b9-9ecbcebe5a73 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:14.162252 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4555c3b0-01ca-44d4-8a3e-ce2bc7aeeaf4 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 82f0d3c4-fc81-428a-9141-2cc36da8b1b2] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:14.162516 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9ee1d9e7-a4d5-4e8d-a6b9-9ecbcebe5a73 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] [instance: 790bcd42-ace5-4761-b46d-e0889855623f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:14.173682 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4555c3b0-01ca-44d4-8a3e-ce2bc7aeeaf4 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:14.176956 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4555c3b0-01ca-44d4-8a3e-ce2bc7aeeaf4 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:14.177412 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4555c3b0-01ca-44d4-8a3e-ce2bc7aeeaf4 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:14.178192 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4555c3b0-01ca-44d4-8a3e-ce2bc7aeeaf4 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:14.182355 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4555c3b0-01ca-44d4-8a3e-ce2bc7aeeaf4 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:14.182355 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4555c3b0-01ca-44d4-8a3e-ce2bc7aeeaf4 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:14.195069 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ee1d9e7-a4d5-4e8d-a6b9-9ecbcebe5a73 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:14.195640 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ee1d9e7-a4d5-4e8d-a6b9-9ecbcebe5a73 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:14.196078 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ee1d9e7-a4d5-4e8d-a6b9-9ecbcebe5a73 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:14.196839 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ee1d9e7-a4d5-4e8d-a6b9-9ecbcebe5a73 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:14.197327 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ee1d9e7-a4d5-4e8d-a6b9-9ecbcebe5a73 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:14.197920 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ee1d9e7-a4d5-4e8d-a6b9-9ecbcebe5a73 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:14.331190 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ee1d9e7-a4d5-4e8d-a6b9-9ecbcebe5a73 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:14.336431 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ee1d9e7-a4d5-4e8d-a6b9-9ecbcebe5a73 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:14.337619 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ee1d9e7-a4d5-4e8d-a6b9-9ecbcebe5a73 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:14.339595 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-9ee1d9e7-a4d5-4e8d-a6b9-9ecbcebe5a73 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lazy-loading 'fault' on Instance uuid 790bcd42-ace5-4761-b46d-e0889855623f {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:44:14.491708 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9ee1d9e7-a4d5-4e8d-a6b9-9ecbcebe5a73 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b206b1f0a1d4f6ebefffc97c51e6f51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8038d51a764867a85d2eab4ac10d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:14.505920 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9ee1d9e7-a4d5-4e8d-a6b9-9ecbcebe5a73 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] 10.222.0.27 "GET /compute/v2.1/servers/790bcd42-ace5-4761-b46d-e0889855623f" status: 200 len: 1332 microversion: 2.1 time: 0.354651 Sep 08 10:44:14.506512 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 807/1623] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:14 2022] GET /compute/v2.1/servers/790bcd42-ace5-4761-b46d-e0889855623f => generated 1332 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:14.513726 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1e7291ae-dc62-418a-8820-45d89c16ab31 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:14.514748 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1e7291ae-dc62-418a-8820-45d89c16ab31 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 64c88fa0-6a01-42fc-b0e9-98b9e84a199d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:14.521570 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e7291ae-dc62-418a-8820-45d89c16ab31 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:14.522660 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e7291ae-dc62-418a-8820-45d89c16ab31 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:14.527039 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e7291ae-dc62-418a-8820-45d89c16ab31 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:14.527948 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e7291ae-dc62-418a-8820-45d89c16ab31 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:14.528506 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e7291ae-dc62-418a-8820-45d89c16ab31 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:14.529009 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e7291ae-dc62-418a-8820-45d89c16ab31 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:14.620879 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1e7291ae-dc62-418a-8820-45d89c16ab31 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:14.631181 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1e7291ae-dc62-418a-8820-45d89c16ab31 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d" status: 200 len: 1259 microversion: 2.1 time: 0.123324 Sep 08 10:44:14.645065 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 808/1624] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:14 2022] GET /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d => generated 1259 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:14.646483 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c4ddd520-dd3e-4280-a6a1-abfc87a47b22 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:14.653996 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c4ddd520-dd3e-4280-a6a1-abfc87a47b22 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] [instance: cf3b6c0e-d390-44d6-91e5-09b389dff551] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:14.661948 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c4ddd520-dd3e-4280-a6a1-abfc87a47b22 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:14.662537 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c4ddd520-dd3e-4280-a6a1-abfc87a47b22 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:14.662990 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c4ddd520-dd3e-4280-a6a1-abfc87a47b22 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:14.663743 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c4ddd520-dd3e-4280-a6a1-abfc87a47b22 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:14.664220 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c4ddd520-dd3e-4280-a6a1-abfc87a47b22 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:14.664684 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c4ddd520-dd3e-4280-a6a1-abfc87a47b22 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:14.891214 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-c4ddd520-dd3e-4280-a6a1-abfc87a47b22 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lazy-loading 'services' on Instance uuid cf3b6c0e-d390-44d6-91e5-09b389dff551 {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:44:14.910109 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c4ddd520-dd3e-4280-a6a1-abfc87a47b22 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551" status: 200 len: 1971 microversion: 2.25 time: 0.272595 Sep 08 10:44:14.910844 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 809/1625] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:44:14 2022] GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551 => generated 1971 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:44:14.916066 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e08466a5-2884-4612-9c13-e893c17b86fc tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:14.923486 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e08466a5-2884-4612-9c13-e893c17b86fc tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 90974422-0d77-4970-9e94-ed6b3376ed29] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:14.939937 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e08466a5-2884-4612-9c13-e893c17b86fc tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:14.940878 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e08466a5-2884-4612-9c13-e893c17b86fc tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:14.941742 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e08466a5-2884-4612-9c13-e893c17b86fc tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:14.943703 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e08466a5-2884-4612-9c13-e893c17b86fc tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:14.944566 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e08466a5-2884-4612-9c13-e893c17b86fc tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:14.945072 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e08466a5-2884-4612-9c13-e893c17b86fc tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:15.313058 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e08466a5-2884-4612-9c13-e893c17b86fc tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:15.341637 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e08466a5-2884-4612-9c13-e893c17b86fc tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29" status: 200 len: 1199 microversion: 2.1 time: 0.429342 Sep 08 10:44:15.342608 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 810/1626] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:14 2022] GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29 => generated 1199 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:15.353617 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fb0c7b50-e989-4e24-a067-551e23bd84ad tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '.version_select at 0x7f68e4bde9d0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:15.487720 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fb0c7b50-e989-4e24-a067-551e23bd84ad tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/images/ef654b65-07f7-425a-b46d-ccc7e6f6fb53" status: 200 len: 1453 microversion: 2.1 time: 0.143256 Sep 08 10:44:15.488321 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 811/1627] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:44:15 2022] GET /compute/v2.1/images/ef654b65-07f7-425a-b46d-ccc7e6f6fb53 => generated 1453 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:15.501278 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8cf780db-b276-4db7-b030-fda5b241607d tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:15.522031 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8cf780db-b276-4db7-b030-fda5b241607d tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:15.522794 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8cf780db-b276-4db7-b030-fda5b241607d tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:15.529375 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8cf780db-b276-4db7-b030-fda5b241607d tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:15.531086 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8cf780db-b276-4db7-b030-fda5b241607d tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:15.532205 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8cf780db-b276-4db7-b030-fda5b241607d tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:15.532428 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8cf780db-b276-4db7-b030-fda5b241607d tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:15.601873 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8cf780db-b276-4db7-b030-fda5b241607d tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.110577 Sep 08 10:44:15.603679 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 812/1628] 10.222.0.27 () {60 vars in 1217 bytes} [Thu Sep 8 10:44:15 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:44:15.608925 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-41968d25-d036-4a08-877b-e11fbf5d86aa tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:15.609847 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-41968d25-d036-4a08-877b-e11fbf5d86aa tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 287be913-2461-45d0-8000-360c3fdb5940] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:15.625958 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41968d25-d036-4a08-877b-e11fbf5d86aa tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:15.626801 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41968d25-d036-4a08-877b-e11fbf5d86aa tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:15.627447 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41968d25-d036-4a08-877b-e11fbf5d86aa tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:15.628594 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41968d25-d036-4a08-877b-e11fbf5d86aa tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:15.629256 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41968d25-d036-4a08-877b-e11fbf5d86aa tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:15.629853 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41968d25-d036-4a08-877b-e11fbf5d86aa tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:15.800413 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4555c3b0-01ca-44d4-8a3e-ce2bc7aeeaf4 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:15.810309 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4555c3b0-01ca-44d4-8a3e-ce2bc7aeeaf4 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/82f0d3c4-fc81-428a-9141-2cc36da8b1b2" status: 200 len: 1492 microversion: 2.1 time: 1.654734 Sep 08 10:44:15.811449 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 817/1629] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:14 2022] GET /compute/v2.1/servers/82f0d3c4-fc81-428a-9141-2cc36da8b1b2 => generated 1492 bytes in 1658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:15.832696 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-41968d25-d036-4a08-877b-e11fbf5d86aa tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:15.844540 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ab494b7f-4fee-4424-ad41-804656a272d4 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:15.845677 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ab494b7f-4fee-4424-ad41-804656a272d4 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] [instance: 790bcd42-ace5-4761-b46d-e0889855623f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:15.851496 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-41968d25-d036-4a08-877b-e11fbf5d86aa tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940" status: 200 len: 1470 microversion: 2.1 time: 0.243311 Sep 08 10:44:15.854369 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 813/1630] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:15 2022] GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940 => generated 1470 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:15.855699 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab494b7f-4fee-4424-ad41-804656a272d4 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:15.856443 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab494b7f-4fee-4424-ad41-804656a272d4 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:15.857091 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab494b7f-4fee-4424-ad41-804656a272d4 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:15.858491 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab494b7f-4fee-4424-ad41-804656a272d4 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:15.859513 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab494b7f-4fee-4424-ad41-804656a272d4 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:15.860233 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab494b7f-4fee-4424-ad41-804656a272d4 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:15.862540 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-7b8174c8-e0f5-41f3-aaba-f34a2f22c71b req-04a3fbba-c7c3-491c-9d8a-8a976db73ee0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a9072eb-573f-4576-b922-57245258445e", "name": "network-vif-deleted", "tag": "b11c68f4-e560-4a23-9f9a-548f2856de5f"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:44:15.883617 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-ab494b7f-4fee-4424-ad41-804656a272d4 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] HTTP exception thrown: Instance 790bcd42-ace5-4761-b46d-e0889855623f could not be found. Sep 08 10:44:15.887746 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ab494b7f-4fee-4424-ad41-804656a272d4 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Request method failure captured: Sep 08 10:44:15.887746 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/790bcd42-ace5-4761-b46d-e0889855623f HTTP/1.1 Sep 08 10:44:15.887746 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:44:15.887746 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:44:15.887746 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:44:15.887746 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:44:15.887746 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:44:15.887746 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:44:15.887746 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:44:15.887746 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:44:15.887746 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGca6Bmtz2I4VLeVP50pc__figgpR-BYmiiPisBqsa5NOM0O1GRtBpLQ8PhIZ-qgHcLt5g5esxBeyKeL62KF9_ee9oARBsl4g-xJ9hO74j2jyukw8Y_zhj8TZkZt49znp2ed5m5XaZVYLg1hZiSolp0Wloti4DTzk3Ec5SVWW09IMjvY Sep 08 10:44:15.887746 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:44:15.887746 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:44:15.887746 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:44:15.887746 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:44:15.887746 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:44:15.887746 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:44:15.887746 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: cb8038d51a764867a85d2eab4ac10d94 Sep 08 10:44:15.887746 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-234993375 Sep 08 10:44:15.887746 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:44:15.887746 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:44:15.887746 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cb8038d51a764867a85d2eab4ac10d94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cb8038d51a764867a85d2eab4ac10d94"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cb8038d51a764867a85d2eab4ac10d94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cb8038d51a764867a85d2eab4ac10d94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:44:15.887746 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-234993375 Sep 08 10:44:15.887746 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: cb8038d51a764867a85d2eab4ac10d94 Sep 08 10:44:15.887746 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-234993375 Sep 08 10:44:15.887746 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-AttachSCSIVolumeTestJSON-234993375-project Sep 08 10:44:15.887746 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:44:15.887746 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:44:15.887746 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 2b206b1f0a1d4f6ebefffc97c51e6f51 Sep 08 10:44:15.887746 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-234993375-project Sep 08 10:44:15.887746 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:44:15.887746 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 790bcd42-ace5-4761-b46d-e0889855623f could not be found. Sep 08 10:44:15.887746 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '790bcd42-ace5-4761-b46d-e0889855623f'} Sep 08 10:44:15.887746 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:44:15.887746 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:44:15.887746 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:44:15.887746 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:44:15.887746 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:44:15.887746 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:44:15.887746 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:44:15.887746 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:44:15.887746 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:44:15.887746 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:44:15.887746 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 790bcd42-ace5-4761-b46d-e0889855623f could not be found. Sep 08 10:44:15.887746 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:44:15.887746 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:44:15.887746 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:44:15.887746 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:44:15.887746 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:44:15.887746 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:44:15.887746 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:44:15.887746 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:44:15.887746 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:44:15.887746 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:44:15.887746 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:44:15.887746 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:44:15.887746 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:44:15.887746 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:44:15.887746 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:44:15.887746 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:44:15.887746 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 790bcd42-ace5-4761-b46d-e0889855623f could not be found. Sep 08 10:44:15.887746 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:44:15.887746 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:44:15.887746 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:44:15.895079 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:44:15.895079 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:44:15.895079 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:44:15.895079 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:44:15.895079 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:44:15.895079 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 790bcd42-ace5-4761-b46d-e0889855623f could not be found. Sep 08 10:44:15.895079 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:44:15.898358 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ab494b7f-4fee-4424-ad41-804656a272d4 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Returning 404 to user: Instance 790bcd42-ace5-4761-b46d-e0889855623f could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:44:15.901210 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ab494b7f-4fee-4424-ad41-804656a272d4 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] 10.222.0.27 "GET /compute/v2.1/servers/790bcd42-ace5-4761-b46d-e0889855623f" status: 404 len: 111 microversion: 2.1 time: 0.070539 Sep 08 10:44:15.902364 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-7b8174c8-e0f5-41f3-aaba-f34a2f22c71b req-04a3fbba-c7c3-491c-9d8a-8a976db73ee0 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:15.902818 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 818/1631] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:15 2022] GET /compute/v2.1/servers/790bcd42-ace5-4761-b46d-e0889855623f => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:44:15.906633 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-7b8174c8-e0f5-41f3-aaba-f34a2f22c71b req-04a3fbba-c7c3-491c-9d8a-8a976db73ee0 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:15.908999 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-7b8174c8-e0f5-41f3-aaba-f34a2f22c71b req-04a3fbba-c7c3-491c-9d8a-8a976db73ee0 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:15.910770 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2111eacd-cfa8-4225-9633-7ac34e281131 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-850501-12", "block_migration": "auto"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:44:15.914436 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2111eacd-cfa8-4225-9633-7ac34e281131 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] [instance: cf3b6c0e-d390-44d6-91e5-09b389dff551] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:15.924317 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2111eacd-cfa8-4225-9633-7ac34e281131 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:15.925966 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2111eacd-cfa8-4225-9633-7ac34e281131 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:15.926423 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2111eacd-cfa8-4225-9633-7ac34e281131 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:15.927881 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2111eacd-cfa8-4225-9633-7ac34e281131 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:15.928339 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2111eacd-cfa8-4225-9633-7ac34e281131 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:15.928771 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2111eacd-cfa8-4225-9633-7ac34e281131 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:15.950944 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-7b8174c8-e0f5-41f3-aaba-f34a2f22c71b req-04a3fbba-c7c3-491c-9d8a-8a976db73ee0 service nova] Creating event network-vif-deleted:b11c68f4-e560-4a23-9f9a-548f2856de5f for instance 5a9072eb-573f-4576-b922-57245258445e on n-h1-850501-12 Sep 08 10:44:15.960857 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-7b8174c8-e0f5-41f3-aaba-f34a2f22c71b req-04a3fbba-c7c3-491c-9d8a-8a976db73ee0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103040 Sep 08 10:44:15.963160 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 814/1632] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:44:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:44:15.972450 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0e2ca81b-adf3-4563-9cdf-d1204689d419 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:15.975481 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0e2ca81b-adf3-4563-9cdf-d1204689d419 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 64c88fa0-6a01-42fc-b0e9-98b9e84a199d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:15.980232 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-2111eacd-cfa8-4225-9633-7ac34e281131 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lazy-loading 'flavor' on Instance uuid cf3b6c0e-d390-44d6-91e5-09b389dff551 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:44:15.991120 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e2ca81b-adf3-4563-9cdf-d1204689d419 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:15.991874 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e2ca81b-adf3-4563-9cdf-d1204689d419 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:15.992429 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e2ca81b-adf3-4563-9cdf-d1204689d419 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:15.994335 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e2ca81b-adf3-4563-9cdf-d1204689d419 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:15.995480 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e2ca81b-adf3-4563-9cdf-d1204689d419 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:15.997268 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e2ca81b-adf3-4563-9cdf-d1204689d419 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:15.999979 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2111eacd-cfa8-4225-9633-7ac34e281131 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] [instance: cf3b6c0e-d390-44d6-91e5-09b389dff551] Going to try to live migrate instance to n-h1-850501-12 {{(pid=128862) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 08 10:44:16.089517 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0e2ca81b-adf3-4563-9cdf-d1204689d419 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:16.099081 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0e2ca81b-adf3-4563-9cdf-d1204689d419 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d" status: 200 len: 1265 microversion: 2.1 time: 0.133965 Sep 08 10:44:16.100556 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 815/1633] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:15 2022] GET /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d => generated 1265 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:16.108517 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-22c0e90c-d6bd-4b55-b1c9-7df6c110c048 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Calling method '.version_select at 0x7f68e5136820>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:16.137100 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-22c0e90c-d6bd-4b55-b1c9-7df6c110c048 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1348238802" status: 202 len: 0 microversion: 2.1 time: 0.034205 Sep 08 10:44:16.138406 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 816/1634] 10.222.0.27 () {58 vars in 1221 bytes} [Thu Sep 8 10:44:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1348238802 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:44:16.253402 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-1647d6f0-cad8-4a35-9af5-0ac74c6a8407 req-48d3802e-abf7-4c92-9214-9873e9d1d8fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "287be913-2461-45d0-8000-360c3fdb5940", "name": "network-vif-unplugged", "status": "completed", "tag": "b0efdf4d-7120-405a-89e4-97e3a3ae0d87"}, {"server_uuid": "3e6be670-294f-417f-a909-57c481faaf40", "name": "network-vif-unplugged", "status": "completed", "tag": "2dc5c573-e6fe-4942-be41-259b760efba3"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:44:16.280544 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-1647d6f0-cad8-4a35-9af5-0ac74c6a8407 req-48d3802e-abf7-4c92-9214-9873e9d1d8fc service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:16.281233 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-1647d6f0-cad8-4a35-9af5-0ac74c6a8407 req-48d3802e-abf7-4c92-9214-9873e9d1d8fc service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:16.281792 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-1647d6f0-cad8-4a35-9af5-0ac74c6a8407 req-48d3802e-abf7-4c92-9214-9873e9d1d8fc service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:16.308716 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-1647d6f0-cad8-4a35-9af5-0ac74c6a8407 req-48d3802e-abf7-4c92-9214-9873e9d1d8fc service nova] Creating event network-vif-unplugged:b0efdf4d-7120-405a-89e4-97e3a3ae0d87 for instance 287be913-2461-45d0-8000-360c3fdb5940 on n-h1-850501-12 Sep 08 10:44:16.309793 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-1647d6f0-cad8-4a35-9af5-0ac74c6a8407 req-48d3802e-abf7-4c92-9214-9873e9d1d8fc service nova] Creating event network-vif-unplugged:2dc5c573-e6fe-4942-be41-259b760efba3 for instance 3e6be670-294f-417f-a909-57c481faaf40 on n-h1-850501-12 Sep 08 10:44:16.342747 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [req-1647d6f0-cad8-4a35-9af5-0ac74c6a8407 req-48d3802e-abf7-4c92-9214-9873e9d1d8fc service nova] Instance 287be913-2461-45d0-8000-360c3fdb5940 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850501-12', 'n-h1-850501-12'} {{(pid=128861) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 10:44:16.374789 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-1647d6f0-cad8-4a35-9af5-0ac74c6a8407 req-48d3802e-abf7-4c92-9214-9873e9d1d8fc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.125184 Sep 08 10:44:16.377921 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 817/1635] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:44:16 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:44:16.392642 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b1b01808-8e60-48fa-8059-1ff813265b16 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:16.396650 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b1b01808-8e60-48fa-8059-1ff813265b16 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 90974422-0d77-4970-9e94-ed6b3376ed29] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:16.414030 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b1b01808-8e60-48fa-8059-1ff813265b16 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:16.417460 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b1b01808-8e60-48fa-8059-1ff813265b16 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:16.418580 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b1b01808-8e60-48fa-8059-1ff813265b16 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:16.422648 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b1b01808-8e60-48fa-8059-1ff813265b16 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:16.425185 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b1b01808-8e60-48fa-8059-1ff813265b16 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:16.427979 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b1b01808-8e60-48fa-8059-1ff813265b16 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:16.846683 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b1b01808-8e60-48fa-8059-1ff813265b16 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:16.864767 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b1b01808-8e60-48fa-8059-1ff813265b16 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29" status: 200 len: 1199 microversion: 2.1 time: 0.484519 Sep 08 10:44:16.881763 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 818/1636] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:16 2022] GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29 => generated 1199 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:16.903814 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cc346fb6-44b0-4aa6-9f0a-b3775b048dc2 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '.version_select at 0x7f68e5136820>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:17.015548 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cc346fb6-44b0-4aa6-9f0a-b3775b048dc2 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/images/ef654b65-07f7-425a-b46d-ccc7e6f6fb53" status: 200 len: 1453 microversion: 2.1 time: 0.131696 Sep 08 10:44:17.017277 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 819/1637] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:44:16 2022] GET /compute/v2.1/images/ef654b65-07f7-425a-b46d-ccc7e6f6fb53 => generated 1453 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:17.022240 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fe61115a-1a64-4bf4-be59-0ba70e7ea8d9 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:17.023096 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fe61115a-1a64-4bf4-be59-0ba70e7ea8d9 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 82f0d3c4-fc81-428a-9141-2cc36da8b1b2] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:17.031362 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:44:17.033501 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fe61115a-1a64-4bf4-be59-0ba70e7ea8d9 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:17.034938 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fe61115a-1a64-4bf4-be59-0ba70e7ea8d9 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:17.035946 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fe61115a-1a64-4bf4-be59-0ba70e7ea8d9 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:17.037293 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fe61115a-1a64-4bf4-be59-0ba70e7ea8d9 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:17.038224 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fe61115a-1a64-4bf4-be59-0ba70e7ea8d9 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:17.039119 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fe61115a-1a64-4bf4-be59-0ba70e7ea8d9 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:17.044614 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:44:17.382606 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-fe61115a-1a64-4bf4-be59-0ba70e7ea8d9 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:17.394596 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fe61115a-1a64-4bf4-be59-0ba70e7ea8d9 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/82f0d3c4-fc81-428a-9141-2cc36da8b1b2" status: 200 len: 1492 microversion: 2.1 time: 0.376063 Sep 08 10:44:17.405976 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 820/1638] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:17 2022] GET /compute/v2.1/servers/82f0d3c4-fc81-428a-9141-2cc36da8b1b2 => generated 1492 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:17.421113 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-375e55a9-c56c-4c66-9408-816249ea0df6 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:17.422361 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-375e55a9-c56c-4c66-9408-816249ea0df6 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 287be913-2461-45d0-8000-360c3fdb5940] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:17.432448 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-375e55a9-c56c-4c66-9408-816249ea0df6 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:17.433353 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-375e55a9-c56c-4c66-9408-816249ea0df6 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:17.434033 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-375e55a9-c56c-4c66-9408-816249ea0df6 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:17.434941 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-375e55a9-c56c-4c66-9408-816249ea0df6 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:17.435721 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-375e55a9-c56c-4c66-9408-816249ea0df6 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:17.437164 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-375e55a9-c56c-4c66-9408-816249ea0df6 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:17.803118 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-375e55a9-c56c-4c66-9408-816249ea0df6 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:17.826195 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-375e55a9-c56c-4c66-9408-816249ea0df6 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940" status: 200 len: 1470 microversion: 2.1 time: 0.410384 Sep 08 10:44:17.831608 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 821/1639] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:17 2022] GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940 => generated 1470 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:17.856856 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e10056a0-6c7d-40c8-99ac-7e44c41c2b90 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:17.858313 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e10056a0-6c7d-40c8-99ac-7e44c41c2b90 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 64c88fa0-6a01-42fc-b0e9-98b9e84a199d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:17.881051 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e10056a0-6c7d-40c8-99ac-7e44c41c2b90 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:17.885304 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e10056a0-6c7d-40c8-99ac-7e44c41c2b90 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:17.886075 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e10056a0-6c7d-40c8-99ac-7e44c41c2b90 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:17.887179 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e10056a0-6c7d-40c8-99ac-7e44c41c2b90 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:17.903530 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e10056a0-6c7d-40c8-99ac-7e44c41c2b90 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:17.904879 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e10056a0-6c7d-40c8-99ac-7e44c41c2b90 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:18.136834 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e10056a0-6c7d-40c8-99ac-7e44c41c2b90 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:18.147104 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e10056a0-6c7d-40c8-99ac-7e44c41c2b90 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d" status: 200 len: 1265 microversion: 2.1 time: 0.313464 Sep 08 10:44:18.179931 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 822/1640] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:17 2022] GET /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d => generated 1265 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:18.201949 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3afb1768-4e9f-48d2-bead-d02c61586bce tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:18.203189 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3afb1768-4e9f-48d2-bead-d02c61586bce tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 90974422-0d77-4970-9e94-ed6b3376ed29] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:18.215646 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3afb1768-4e9f-48d2-bead-d02c61586bce tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:18.216441 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3afb1768-4e9f-48d2-bead-d02c61586bce tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:18.217058 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3afb1768-4e9f-48d2-bead-d02c61586bce tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:18.217898 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3afb1768-4e9f-48d2-bead-d02c61586bce tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:18.218707 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3afb1768-4e9f-48d2-bead-d02c61586bce tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:18.219542 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3afb1768-4e9f-48d2-bead-d02c61586bce tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:18.511192 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-3afb1768-4e9f-48d2-bead-d02c61586bce tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:18.530373 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3afb1768-4e9f-48d2-bead-d02c61586bce tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29" status: 200 len: 1381 microversion: 2.1 time: 0.348223 Sep 08 10:44:18.552324 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 823/1641] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:18 2022] GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29 => generated 1381 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:18.608557 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-d45a8c8c-4130-4dbf-8dca-3884253799b0 req-a878bb89-9126-4ee8-9b9b-7d0926e0b7e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82f0d3c4-fc81-428a-9141-2cc36da8b1b2", "name": "network-vif-deleted", "tag": "be795b19-5bca-4532-a89f-e4d4be7315ae"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:44:18.650126 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-d45a8c8c-4130-4dbf-8dca-3884253799b0 req-a878bb89-9126-4ee8-9b9b-7d0926e0b7e1 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:18.671203 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-d45a8c8c-4130-4dbf-8dca-3884253799b0 req-a878bb89-9126-4ee8-9b9b-7d0926e0b7e1 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:18.672138 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-d45a8c8c-4130-4dbf-8dca-3884253799b0 req-a878bb89-9126-4ee8-9b9b-7d0926e0b7e1 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:18.708166 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-d45a8c8c-4130-4dbf-8dca-3884253799b0 req-a878bb89-9126-4ee8-9b9b-7d0926e0b7e1 service nova] Creating event network-vif-deleted:be795b19-5bca-4532-a89f-e4d4be7315ae for instance 82f0d3c4-fc81-428a-9141-2cc36da8b1b2 on n-h1-850501-12 Sep 08 10:44:18.716969 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-d45a8c8c-4130-4dbf-8dca-3884253799b0 req-a878bb89-9126-4ee8-9b9b-7d0926e0b7e1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162960 Sep 08 10:44:18.717952 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 824/1642] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:44:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:44:18.725646 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1bc16b2c-171d-45b0-9e22-e3d046290225 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '.version_select at 0x7f68e45b0670>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:19.055230 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1bc16b2c-171d-45b0-9e22-e3d046290225 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/images/ef654b65-07f7-425a-b46d-ccc7e6f6fb53" status: 200 len: 1453 microversion: 2.1 time: 0.334739 Sep 08 10:44:19.057102 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 825/1643] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:44:18 2022] GET /compute/v2.1/images/ef654b65-07f7-425a-b46d-ccc7e6f6fb53 => generated 1453 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:19.070445 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b2d0051d-2957-4aea-bfa9-3820c1d758e8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:19.073447 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b2d0051d-2957-4aea-bfa9-3820c1d758e8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 82f0d3c4-fc81-428a-9141-2cc36da8b1b2] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:19.100733 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b2d0051d-2957-4aea-bfa9-3820c1d758e8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:19.101260 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b2d0051d-2957-4aea-bfa9-3820c1d758e8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:19.109752 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b2d0051d-2957-4aea-bfa9-3820c1d758e8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:19.110838 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b2d0051d-2957-4aea-bfa9-3820c1d758e8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:19.115135 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b2d0051d-2957-4aea-bfa9-3820c1d758e8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:19.115870 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b2d0051d-2957-4aea-bfa9-3820c1d758e8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:19.214178 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b2d0051d-2957-4aea-bfa9-3820c1d758e8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:19.214859 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b2d0051d-2957-4aea-bfa9-3820c1d758e8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:19.215663 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b2d0051d-2957-4aea-bfa9-3820c1d758e8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:19.216649 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-b2d0051d-2957-4aea-bfa9-3820c1d758e8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lazy-loading 'fault' on Instance uuid 82f0d3c4-fc81-428a-9141-2cc36da8b1b2 {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:44:19.350587 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b2d0051d-2957-4aea-bfa9-3820c1d758e8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:19.365348 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b2d0051d-2957-4aea-bfa9-3820c1d758e8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/82f0d3c4-fc81-428a-9141-2cc36da8b1b2" status: 200 len: 1305 microversion: 2.1 time: 0.306955 Sep 08 10:44:19.366473 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 826/1644] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:19 2022] GET /compute/v2.1/servers/82f0d3c4-fc81-428a-9141-2cc36da8b1b2 => generated 1305 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:19.583835 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2111eacd-cfa8-4225-9633-7ac34e281131 tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551/action" status: 202 len: 0 microversion: 2.25 time: 3.679611 Sep 08 10:44:19.585244 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 819/1645] 10.222.0.27 () {62 vars in 1319 bytes} [Thu Sep 8 10:44:15 2022] POST /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551/action => generated 0 bytes in 3682 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:44:19.784895 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-83ccd2fe-dd47-489f-bafa-09d60a0e6951 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-34577885", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "f4d7bc69-6643-44fb-8b0e-c93be87867b3"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:44:19.838220 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-51d09893-5691-438f-a0fe-2042b50df783 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:19.839356 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-51d09893-5691-438f-a0fe-2042b50df783 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] [instance: 90974422-0d77-4970-9e94-ed6b3376ed29] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:19.880149 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-51d09893-5691-438f-a0fe-2042b50df783 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:19.882864 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-51d09893-5691-438f-a0fe-2042b50df783 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:19.899668 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-51d09893-5691-438f-a0fe-2042b50df783 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:19.900785 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-51d09893-5691-438f-a0fe-2042b50df783 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:19.902228 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-51d09893-5691-438f-a0fe-2042b50df783 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:19.910506 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-51d09893-5691-438f-a0fe-2042b50df783 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:19.929225 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-83ccd2fe-dd47-489f-bafa-09d60a0e6951 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] validate_networks() for [('f4d7bc69-6643-44fb-8b0e-c93be87867b3', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:44:20.082661 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=6 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:44:20.234202 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-51d09893-5691-438f-a0fe-2042b50df783 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29" status: 200 len: 1534 microversion: 2.1 time: 0.858726 Sep 08 10:44:20.250537 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 827/1646] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:19 2022] GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29 => generated 1534 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:20.256329 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-98840b2f-5f10-416d-b59e-6aded24ce816 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:20.264937 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-98840b2f-5f10-416d-b59e-6aded24ce816 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 287be913-2461-45d0-8000-360c3fdb5940] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:20.271906 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-98840b2f-5f10-416d-b59e-6aded24ce816 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:20.272429 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-98840b2f-5f10-416d-b59e-6aded24ce816 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:20.273275 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-98840b2f-5f10-416d-b59e-6aded24ce816 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:20.274289 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-98840b2f-5f10-416d-b59e-6aded24ce816 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:20.275934 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-98840b2f-5f10-416d-b59e-6aded24ce816 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:20.276676 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-98840b2f-5f10-416d-b59e-6aded24ce816 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:20.600454 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-98840b2f-5f10-416d-b59e-6aded24ce816 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:20.626954 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-98840b2f-5f10-416d-b59e-6aded24ce816 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940" status: 200 len: 1470 microversion: 2.1 time: 0.374740 Sep 08 10:44:20.628291 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 828/1647] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:20 2022] GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940 => generated 1470 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:20.644286 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d5cc5cc0-90b4-40e5-80fb-e9d04eeea7f6 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:20.645428 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d5cc5cc0-90b4-40e5-80fb-e9d04eeea7f6 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 64c88fa0-6a01-42fc-b0e9-98b9e84a199d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:20.663483 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d5cc5cc0-90b4-40e5-80fb-e9d04eeea7f6 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:20.664469 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d5cc5cc0-90b4-40e5-80fb-e9d04eeea7f6 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:20.665845 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d5cc5cc0-90b4-40e5-80fb-e9d04eeea7f6 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:20.668867 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d5cc5cc0-90b4-40e5-80fb-e9d04eeea7f6 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:20.672128 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d5cc5cc0-90b4-40e5-80fb-e9d04eeea7f6 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:20.672921 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d5cc5cc0-90b4-40e5-80fb-e9d04eeea7f6 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:20.926276 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:44:20.999583 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d5cc5cc0-90b4-40e5-80fb-e9d04eeea7f6 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:21.013590 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d5cc5cc0-90b4-40e5-80fb-e9d04eeea7f6 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d" status: 200 len: 1307 microversion: 2.1 time: 0.383225 Sep 08 10:44:21.015412 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 829/1648] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:20 2022] GET /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d => generated 1307 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:21.036919 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f6b4b716-8183-4fd9-a1a3-974b52df3690 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:21.037926 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f6b4b716-8183-4fd9-a1a3-974b52df3690 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: cf3b6c0e-d390-44d6-91e5-09b389dff551] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:21.054862 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f6b4b716-8183-4fd9-a1a3-974b52df3690 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:21.055891 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f6b4b716-8183-4fd9-a1a3-974b52df3690 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:21.056972 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f6b4b716-8183-4fd9-a1a3-974b52df3690 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:21.058196 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f6b4b716-8183-4fd9-a1a3-974b52df3690 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:21.059084 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f6b4b716-8183-4fd9-a1a3-974b52df3690 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:21.059731 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f6b4b716-8183-4fd9-a1a3-974b52df3690 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:21.300290 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f6b4b716-8183-4fd9-a1a3-974b52df3690 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:21.318454 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f6b4b716-8183-4fd9-a1a3-974b52df3690 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:21.320729 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f6b4b716-8183-4fd9-a1a3-974b52df3690 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:21.323418 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f6b4b716-8183-4fd9-a1a3-974b52df3690 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551" status: 200 len: 1487 microversion: 2.25 time: 0.306125 Sep 08 10:44:21.325411 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 830/1649] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:44:21 2022] GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551 => generated 1487 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:44:21.331013 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-9a27e761-b814-4615-ba69-de054c20d53c req-28252d6c-48e2-431a-91fc-d2a3065883b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dac27157-b08e-4f13-b97e-3c5b653bd0b3", "name": "network-vif-plugged", "status": "completed", "tag": "0ad27959-ff24-48b6-9469-c1b114584c1e"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:44:21.346912 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-9a27e761-b814-4615-ba69-de054c20d53c req-28252d6c-48e2-431a-91fc-d2a3065883b8 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:21.347409 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-9a27e761-b814-4615-ba69-de054c20d53c req-28252d6c-48e2-431a-91fc-d2a3065883b8 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:21.347852 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-9a27e761-b814-4615-ba69-de054c20d53c req-28252d6c-48e2-431a-91fc-d2a3065883b8 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:21.367651 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-9a27e761-b814-4615-ba69-de054c20d53c req-28252d6c-48e2-431a-91fc-d2a3065883b8 service nova] Creating event network-vif-plugged:0ad27959-ff24-48b6-9469-c1b114584c1e for instance dac27157-b08e-4f13-b97e-3c5b653bd0b3 on n-h1-850501-12 Sep 08 10:44:21.375711 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-9a27e761-b814-4615-ba69-de054c20d53c req-28252d6c-48e2-431a-91fc-d2a3065883b8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047918 Sep 08 10:44:21.382324 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 831/1650] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:44:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:44:21.394734 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ce97fa84-449c-44e1-a804-616e5f22839f tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '.version_select at 0x7f68e4be8700>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:21.498206 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ce97fa84-449c-44e1-a804-616e5f22839f tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/images/ef654b65-07f7-425a-b46d-ccc7e6f6fb53" status: 200 len: 1453 microversion: 2.1 time: 0.108004 Sep 08 10:44:21.502016 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 832/1651] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:44:21 2022] GET /compute/v2.1/images/ef654b65-07f7-425a-b46d-ccc7e6f6fb53 => generated 1453 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:21.511351 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fd9cb703-2955-4220-a40c-41f36ca7f8d9 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:21.512159 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fd9cb703-2955-4220-a40c-41f36ca7f8d9 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] [instance: 90974422-0d77-4970-9e94-ed6b3376ed29] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:21.535205 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fd9cb703-2955-4220-a40c-41f36ca7f8d9 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:21.535820 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fd9cb703-2955-4220-a40c-41f36ca7f8d9 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:21.538267 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fd9cb703-2955-4220-a40c-41f36ca7f8d9 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:21.539336 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fd9cb703-2955-4220-a40c-41f36ca7f8d9 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:21.539733 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fd9cb703-2955-4220-a40c-41f36ca7f8d9 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:21.544136 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fd9cb703-2955-4220-a40c-41f36ca7f8d9 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:21.913436 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fd9cb703-2955-4220-a40c-41f36ca7f8d9 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29" status: 200 len: 1534 microversion: 2.1 time: 0.409573 Sep 08 10:44:21.917147 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 833/1652] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:21 2022] GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29 => generated 1534 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:21.928304 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2454035f-ad0c-41c4-9456-945a6e6cddb8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:21.932479 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2454035f-ad0c-41c4-9456-945a6e6cddb8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 82f0d3c4-fc81-428a-9141-2cc36da8b1b2] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:21.959491 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2454035f-ad0c-41c4-9456-945a6e6cddb8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:21.961432 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2454035f-ad0c-41c4-9456-945a6e6cddb8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:21.965860 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2454035f-ad0c-41c4-9456-945a6e6cddb8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:21.967060 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2454035f-ad0c-41c4-9456-945a6e6cddb8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:21.967717 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2454035f-ad0c-41c4-9456-945a6e6cddb8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:21.968597 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2454035f-ad0c-41c4-9456-945a6e6cddb8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:22.006038 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-2454035f-ad0c-41c4-9456-945a6e6cddb8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] HTTP exception thrown: Instance 82f0d3c4-fc81-428a-9141-2cc36da8b1b2 could not be found. Sep 08 10:44:22.013256 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2454035f-ad0c-41c4-9456-945a6e6cddb8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Request method failure captured: Sep 08 10:44:22.013256 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/82f0d3c4-fc81-428a-9141-2cc36da8b1b2 HTTP/1.1 Sep 08 10:44:22.013256 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:44:22.013256 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:44:22.013256 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:44:22.013256 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:44:22.013256 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:44:22.013256 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:44:22.013256 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:44:22.013256 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:44:22.013256 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcbOYaOup_Ia1bHuprOxxP_LkfdCzYSX9xstQr2GVmRBueUQ0e967rlioz5jpJV566ZCuz_bYy_us0o8_CIFlOGOVfrC9_e_1_vEhZ3YdgjG89HBhaIJ_lG7Uv4nQrC-nfHrMx_LNyd0rOd4Blcm801SOcX7oe5VDxGTE8KVTDSeMPw Sep 08 10:44:22.013256 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:44:22.013256 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:44:22.013256 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:44:22.013256 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:44:22.013256 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:44:22.013256 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:44:22.013256 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 998378cc815344ba8a107d1cd61f40fd Sep 08 10:44:22.013256 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-DeleteServersTestJSON-69164830 Sep 08 10:44:22.013256 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:44:22.013256 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:44:22.013256 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:44:22.013256 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-DeleteServersTestJSON-69164830 Sep 08 10:44:22.013256 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 998378cc815344ba8a107d1cd61f40fd Sep 08 10:44:22.013256 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-DeleteServersTestJSON-69164830 Sep 08 10:44:22.013256 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-DeleteServersTestJSON-69164830-project Sep 08 10:44:22.013256 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:44:22.013256 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:44:22.013256 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: d08269c53bcb41c88953e7c79f5ad185 Sep 08 10:44:22.013256 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-DeleteServersTestJSON-69164830-project Sep 08 10:44:22.013256 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:44:22.013256 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 82f0d3c4-fc81-428a-9141-2cc36da8b1b2 could not be found. Sep 08 10:44:22.013256 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '82f0d3c4-fc81-428a-9141-2cc36da8b1b2'} Sep 08 10:44:22.013256 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:44:22.013256 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:44:22.013256 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:44:22.013256 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:44:22.013256 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:44:22.013256 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:44:22.013256 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:44:22.013256 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:44:22.013256 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:44:22.013256 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:44:22.013256 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82f0d3c4-fc81-428a-9141-2cc36da8b1b2 could not be found. Sep 08 10:44:22.013256 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:44:22.013256 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:44:22.013256 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:44:22.013256 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:44:22.013256 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:44:22.013256 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:44:22.013256 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:44:22.013256 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:44:22.013256 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:44:22.013256 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:44:22.013256 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:44:22.013256 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:44:22.013256 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:44:22.013256 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:44:22.013256 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:44:22.013256 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:44:22.013256 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82f0d3c4-fc81-428a-9141-2cc36da8b1b2 could not be found. Sep 08 10:44:22.013256 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:44:22.013256 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:44:22.013256 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:44:22.022983 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:44:22.022983 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:44:22.022983 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:44:22.022983 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:44:22.022983 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:44:22.022983 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82f0d3c4-fc81-428a-9141-2cc36da8b1b2 could not be found. Sep 08 10:44:22.022983 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:44:22.026866 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2454035f-ad0c-41c4-9456-945a6e6cddb8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Returning 404 to user: Instance 82f0d3c4-fc81-428a-9141-2cc36da8b1b2 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:44:22.031366 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2454035f-ad0c-41c4-9456-945a6e6cddb8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/82f0d3c4-fc81-428a-9141-2cc36da8b1b2" status: 404 len: 111 microversion: 2.1 time: 0.112494 Sep 08 10:44:22.034966 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 834/1653] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:21 2022] GET /compute/v2.1/servers/82f0d3c4-fc81-428a-9141-2cc36da8b1b2 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:44:22.055636 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-54fbb264-c0c9-4e28-a9e2-948129dc7744 req-97f3d6a6-d18c-40aa-9e0e-0f793b541e27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "287be913-2461-45d0-8000-360c3fdb5940", "tag": "b0efdf4d-7120-405a-89e4-97e3a3ae0d87"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:44:22.082125 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-54fbb264-c0c9-4e28-a9e2-948129dc7744 req-97f3d6a6-d18c-40aa-9e0e-0f793b541e27 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:22.083114 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-54fbb264-c0c9-4e28-a9e2-948129dc7744 req-97f3d6a6-d18c-40aa-9e0e-0f793b541e27 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:22.084030 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-54fbb264-c0c9-4e28-a9e2-948129dc7744 req-97f3d6a6-d18c-40aa-9e0e-0f793b541e27 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:22.112577 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-54fbb264-c0c9-4e28-a9e2-948129dc7744 req-97f3d6a6-d18c-40aa-9e0e-0f793b541e27 service nova] Creating event network-changed:b0efdf4d-7120-405a-89e4-97e3a3ae0d87 for instance 287be913-2461-45d0-8000-360c3fdb5940 on n-h1-850501-12 Sep 08 10:44:22.127505 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [req-54fbb264-c0c9-4e28-a9e2-948129dc7744 req-97f3d6a6-d18c-40aa-9e0e-0f793b541e27 service nova] Instance 287be913-2461-45d0-8000-360c3fdb5940 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850501-12', 'n-h1-850501-12'} {{(pid=128861) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 10:44:22.166123 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-54fbb264-c0c9-4e28-a9e2-948129dc7744 req-97f3d6a6-d18c-40aa-9e0e-0f793b541e27 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123188 Sep 08 10:44:22.169723 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 835/1654] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:44:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:44:22.188756 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6565fb1e-6ff0-4cb4-b789-a73b4a5b9142 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:22.193627 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6565fb1e-6ff0-4cb4-b789-a73b4a5b9142 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 287be913-2461-45d0-8000-360c3fdb5940] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:22.211126 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6565fb1e-6ff0-4cb4-b789-a73b4a5b9142 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:22.214832 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6565fb1e-6ff0-4cb4-b789-a73b4a5b9142 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:22.215653 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6565fb1e-6ff0-4cb4-b789-a73b4a5b9142 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:22.218383 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6565fb1e-6ff0-4cb4-b789-a73b4a5b9142 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:22.219438 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6565fb1e-6ff0-4cb4-b789-a73b4a5b9142 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:22.221418 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6565fb1e-6ff0-4cb4-b789-a73b4a5b9142 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:22.612279 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6565fb1e-6ff0-4cb4-b789-a73b4a5b9142 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:22.642615 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6565fb1e-6ff0-4cb4-b789-a73b4a5b9142 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940" status: 200 len: 1470 microversion: 2.1 time: 0.466847 Sep 08 10:44:22.665527 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 836/1655] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:22 2022] GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940 => generated 1470 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:22.678286 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f28e5f49-d2e8-4c34-b56d-ba501cb62548 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:22.695675 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f28e5f49-d2e8-4c34-b56d-ba501cb62548 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:22.696385 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f28e5f49-d2e8-4c34-b56d-ba501cb62548 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:22.697741 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f28e5f49-d2e8-4c34-b56d-ba501cb62548 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:22.700066 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f28e5f49-d2e8-4c34-b56d-ba501cb62548 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:22.700549 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f28e5f49-d2e8-4c34-b56d-ba501cb62548 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:22.701949 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f28e5f49-d2e8-4c34-b56d-ba501cb62548 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:22.737206 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f28e5f49-d2e8-4c34-b56d-ba501cb62548 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.070030 Sep 08 10:44:22.737850 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 837/1656] 10.222.0.27 () {58 vars in 1176 bytes} [Thu Sep 8 10:44:22 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:44:22.749091 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e2847cc9-4fda-4296-a75d-49902c44401a tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:22.749091 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e2847cc9-4fda-4296-a75d-49902c44401a tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 64c88fa0-6a01-42fc-b0e9-98b9e84a199d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:22.754833 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e2847cc9-4fda-4296-a75d-49902c44401a tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:22.755188 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e2847cc9-4fda-4296-a75d-49902c44401a tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:22.755575 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e2847cc9-4fda-4296-a75d-49902c44401a tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:22.756268 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e2847cc9-4fda-4296-a75d-49902c44401a tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:22.756729 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e2847cc9-4fda-4296-a75d-49902c44401a tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:22.757218 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e2847cc9-4fda-4296-a75d-49902c44401a tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:23.074304 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e2847cc9-4fda-4296-a75d-49902c44401a tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:23.089743 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e2847cc9-4fda-4296-a75d-49902c44401a tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d" status: 200 len: 1307 microversion: 2.1 time: 0.350551 Sep 08 10:44:23.090964 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 838/1657] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:22 2022] GET /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d => generated 1307 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:23.105676 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2498112d-af2a-470a-ba21-ce889c163c15 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2139750999", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "cf032a39-d4e2-476c-8052-c76f4ee567c9"}]}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:44:23.207899 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-2498112d-af2a-470a-ba21-ce889c163c15 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] validate_networks() for [('cf032a39-d4e2-476c-8052-c76f4ee567c9', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:44:23.823406 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-83ccd2fe-dd47-489f-bafa-09d60a0e6951 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:44:23.825408 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-83ccd2fe-dd47-489f-bafa-09d60a0e6951 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:44:23.826841 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-83ccd2fe-dd47-489f-bafa-09d60a0e6951 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:44:23.828014 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-83ccd2fe-dd47-489f-bafa-09d60a0e6951 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:44:23.829188 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-83ccd2fe-dd47-489f-bafa-09d60a0e6951 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:44:23.867588 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-83ccd2fe-dd47-489f-bafa-09d60a0e6951 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:23.875602 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-83ccd2fe-dd47-489f-bafa-09d60a0e6951 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:23.876513 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-83ccd2fe-dd47-489f-bafa-09d60a0e6951 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:23.878048 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-83ccd2fe-dd47-489f-bafa-09d60a0e6951 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:23.882952 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-83ccd2fe-dd47-489f-bafa-09d60a0e6951 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:23.883778 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-83ccd2fe-dd47-489f-bafa-09d60a0e6951 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:23.955183 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-83ccd2fe-dd47-489f-bafa-09d60a0e6951 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Getting quotas for project de50a647dfb24b13945df8851e766db7. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:44:23.980447 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-83ccd2fe-dd47-489f-bafa-09d60a0e6951 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Getting quotas for user 173621608ea149b4b401f2da7351597a and project de50a647dfb24b13945df8851e766db7. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:44:23.998975 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:44:24.058045 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-83ccd2fe-dd47-489f-bafa-09d60a0e6951 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:44:24.070153 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-83ccd2fe-dd47-489f-bafa-09d60a0e6951 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] [instance: bf82fb33-6e90-4830-aa0e-5bff7fa782ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:44:24.237253 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-83ccd2fe-dd47-489f-bafa-09d60a0e6951 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.650032 Sep 08 10:44:24.261368 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 820/1658] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:44:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 4675 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:44:24.267392 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-38671048-843b-4e95-8c68-54d4a4e04582 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:24.268020 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-38671048-843b-4e95-8c68-54d4a4e04582 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: cf3b6c0e-d390-44d6-91e5-09b389dff551] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:24.374171 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38671048-843b-4e95-8c68-54d4a4e04582 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:24.375072 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38671048-843b-4e95-8c68-54d4a4e04582 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:24.376053 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38671048-843b-4e95-8c68-54d4a4e04582 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:24.382836 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38671048-843b-4e95-8c68-54d4a4e04582 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:24.389873 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38671048-843b-4e95-8c68-54d4a4e04582 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:24.390345 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38671048-843b-4e95-8c68-54d4a4e04582 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:24.518359 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-2498112d-af2a-470a-ba21-ce889c163c15 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:44:24.518978 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-2498112d-af2a-470a-ba21-ce889c163c15 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:44:24.519266 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-2498112d-af2a-470a-ba21-ce889c163c15 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:44:24.519682 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-2498112d-af2a-470a-ba21-ce889c163c15 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:44:24.520207 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-2498112d-af2a-470a-ba21-ce889c163c15 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:44:24.531626 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2498112d-af2a-470a-ba21-ce889c163c15 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:24.532147 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2498112d-af2a-470a-ba21-ce889c163c15 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:24.532587 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2498112d-af2a-470a-ba21-ce889c163c15 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:24.533379 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2498112d-af2a-470a-ba21-ce889c163c15 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:24.534055 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2498112d-af2a-470a-ba21-ce889c163c15 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:24.534820 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2498112d-af2a-470a-ba21-ce889c163c15 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:24.574279 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-2498112d-af2a-470a-ba21-ce889c163c15 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Getting quotas for project 998378cc815344ba8a107d1cd61f40fd. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:44:24.581650 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-2498112d-af2a-470a-ba21-ce889c163c15 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Getting quotas for user d08269c53bcb41c88953e7c79f5ad185 and project 998378cc815344ba8a107d1cd61f40fd. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:44:24.597667 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2498112d-af2a-470a-ba21-ce889c163c15 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:44:24.600506 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2498112d-af2a-470a-ba21-ce889c163c15 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: f9f308fa-d4a6-4ac9-8c64-927e082b0b4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:44:24.691937 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2498112d-af2a-470a-ba21-ce889c163c15 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.599128 Sep 08 10:44:24.695622 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 839/1659] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:44:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1604 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:44:24.712729 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5f608a70-af67-4d8c-b4ca-d37aba5c21b1 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '.version_select at 0x7f68e4be84c0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:24.818548 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5f608a70-af67-4d8c-b4ca-d37aba5c21b1 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/images/ef654b65-07f7-425a-b46d-ccc7e6f6fb53" status: 200 len: 1453 microversion: 2.1 time: 0.119430 Sep 08 10:44:24.820376 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 840/1660] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:44:24 2022] GET /compute/v2.1/images/ef654b65-07f7-425a-b46d-ccc7e6f6fb53 => generated 1453 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:24.838546 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fc19bbfe-8c63-47eb-a43a-2ad3db67cb56 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-850501-12", "block_migration": false, "disk_over_commit": false}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:44:24.848936 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fc19bbfe-8c63-47eb-a43a-2ad3db67cb56 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] [instance: 90974422-0d77-4970-9e94-ed6b3376ed29] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:24.859015 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fc19bbfe-8c63-47eb-a43a-2ad3db67cb56 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:24.859866 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fc19bbfe-8c63-47eb-a43a-2ad3db67cb56 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:24.860482 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fc19bbfe-8c63-47eb-a43a-2ad3db67cb56 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:24.861559 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fc19bbfe-8c63-47eb-a43a-2ad3db67cb56 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:24.862285 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fc19bbfe-8c63-47eb-a43a-2ad3db67cb56 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:24.862887 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fc19bbfe-8c63-47eb-a43a-2ad3db67cb56 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:24.910302 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-fc19bbfe-8c63-47eb-a43a-2ad3db67cb56 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lazy-loading 'flavor' on Instance uuid 90974422-0d77-4970-9e94-ed6b3376ed29 {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:44:24.956578 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fc19bbfe-8c63-47eb-a43a-2ad3db67cb56 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] [instance: 90974422-0d77-4970-9e94-ed6b3376ed29] Going to try to live migrate instance to n-h1-850501-12 {{(pid=128861) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 08 10:44:25.032023 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:44:25.470346 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-38671048-843b-4e95-8c68-54d4a4e04582 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:25.541737 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-38671048-843b-4e95-8c68-54d4a4e04582 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:25.553212 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-38671048-843b-4e95-8c68-54d4a4e04582 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:25.554865 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-38671048-843b-4e95-8c68-54d4a4e04582 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551" status: 200 len: 1487 microversion: 2.25 time: 1.292192 Sep 08 10:44:25.573055 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 821/1661] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:44:24 2022] GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551 => generated 1487 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:44:25.574781 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-35fedb4b-3792-4fab-bd24-71e13368f001 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:25.575530 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-35fedb4b-3792-4fab-bd24-71e13368f001 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 287be913-2461-45d0-8000-360c3fdb5940] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:25.603412 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35fedb4b-3792-4fab-bd24-71e13368f001 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:25.604810 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35fedb4b-3792-4fab-bd24-71e13368f001 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:25.610945 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35fedb4b-3792-4fab-bd24-71e13368f001 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:25.614730 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35fedb4b-3792-4fab-bd24-71e13368f001 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:25.615716 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35fedb4b-3792-4fab-bd24-71e13368f001 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:25.616615 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35fedb4b-3792-4fab-bd24-71e13368f001 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:25.998459 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-35fedb4b-3792-4fab-bd24-71e13368f001 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:26.032229 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-35fedb4b-3792-4fab-bd24-71e13368f001 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940" status: 200 len: 1470 microversion: 2.1 time: 0.468980 Sep 08 10:44:26.032859 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 822/1662] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:25 2022] GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940 => generated 1470 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:26.043479 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-19a99f6e-5a72-4350-b61d-af47e85c9305 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:26.053376 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-19a99f6e-5a72-4350-b61d-af47e85c9305 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 64c88fa0-6a01-42fc-b0e9-98b9e84a199d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:26.095436 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-19a99f6e-5a72-4350-b61d-af47e85c9305 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:26.097345 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-19a99f6e-5a72-4350-b61d-af47e85c9305 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:26.097857 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-19a99f6e-5a72-4350-b61d-af47e85c9305 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:26.098625 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-19a99f6e-5a72-4350-b61d-af47e85c9305 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:26.099355 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-19a99f6e-5a72-4350-b61d-af47e85c9305 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:26.099803 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-19a99f6e-5a72-4350-b61d-af47e85c9305 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:26.353325 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-19a99f6e-5a72-4350-b61d-af47e85c9305 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:26.368107 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-19a99f6e-5a72-4350-b61d-af47e85c9305 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d" status: 200 len: 1307 microversion: 2.1 time: 0.333958 Sep 08 10:44:26.369567 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 823/1663] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:26 2022] GET /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d => generated 1307 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:26.375907 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ef330351-9c68-4ebc-84e1-b02129603cbd tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:26.376845 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ef330351-9c68-4ebc-84e1-b02129603cbd tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] [instance: bf82fb33-6e90-4830-aa0e-5bff7fa782ba] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:26.390047 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef330351-9c68-4ebc-84e1-b02129603cbd tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:26.390659 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef330351-9c68-4ebc-84e1-b02129603cbd tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:26.393545 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef330351-9c68-4ebc-84e1-b02129603cbd tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:26.394713 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef330351-9c68-4ebc-84e1-b02129603cbd tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:26.395428 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef330351-9c68-4ebc-84e1-b02129603cbd tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:26.396429 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef330351-9c68-4ebc-84e1-b02129603cbd tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:26.921296 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ef330351-9c68-4ebc-84e1-b02129603cbd tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173621608ea149b4b401f2da7351597a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de50a647dfb24b13945df8851e766db7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:26.966159 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ef330351-9c68-4ebc-84e1-b02129603cbd tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] 10.222.0.27 "GET /compute/v2.1/servers/bf82fb33-6e90-4830-aa0e-5bff7fa782ba" status: 200 len: 1230 microversion: 2.1 time: 0.592176 Sep 08 10:44:26.967335 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 824/1664] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:26 2022] GET /compute/v2.1/servers/bf82fb33-6e90-4830-aa0e-5bff7fa782ba => generated 1230 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:26.992057 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ecc8c0c0-ad2c-4cc6-95e9-21ddd7b8df91 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:26.993273 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ecc8c0c0-ad2c-4cc6-95e9-21ddd7b8df91 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: f9f308fa-d4a6-4ac9-8c64-927e082b0b4a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:27.020327 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ecc8c0c0-ad2c-4cc6-95e9-21ddd7b8df91 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:27.022921 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ecc8c0c0-ad2c-4cc6-95e9-21ddd7b8df91 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:27.026873 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ecc8c0c0-ad2c-4cc6-95e9-21ddd7b8df91 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:27.031232 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ecc8c0c0-ad2c-4cc6-95e9-21ddd7b8df91 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:27.032126 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ecc8c0c0-ad2c-4cc6-95e9-21ddd7b8df91 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:27.032774 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ecc8c0c0-ad2c-4cc6-95e9-21ddd7b8df91 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:27.482692 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ecc8c0c0-ad2c-4cc6-95e9-21ddd7b8df91 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:27.502252 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ecc8c0c0-ad2c-4cc6-95e9-21ddd7b8df91 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a" status: 200 len: 1211 microversion: 2.1 time: 0.531886 Sep 08 10:44:27.503639 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 825/1665] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:26 2022] GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a => generated 1211 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:27.520623 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-45136fb1-56a0-4acb-8487-80101781dc83 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '.version_select at 0x7f68e4563670>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:27.682110 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-45136fb1-56a0-4acb-8487-80101781dc83 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/images/ef654b65-07f7-425a-b46d-ccc7e6f6fb53" status: 200 len: 1453 microversion: 2.1 time: 0.172637 Sep 08 10:44:27.684572 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 826/1666] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:44:27 2022] GET /compute/v2.1/images/ef654b65-07f7-425a-b46d-ccc7e6f6fb53 => generated 1453 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:27.723427 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-e2fc55df-83ae-44d7-ae60-a03115f68409 req-8598ef0b-c423-478a-a509-4c6a3418fc9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64c88fa0-6a01-42fc-b0e9-98b9e84a199d", "tag": "2a441d6d-9009-42c2-a8aa-1b70f9d6ee7f"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:44:27.766350 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e2fc55df-83ae-44d7-ae60-a03115f68409 req-8598ef0b-c423-478a-a509-4c6a3418fc9c service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:27.766969 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e2fc55df-83ae-44d7-ae60-a03115f68409 req-8598ef0b-c423-478a-a509-4c6a3418fc9c service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:27.767282 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e2fc55df-83ae-44d7-ae60-a03115f68409 req-8598ef0b-c423-478a-a509-4c6a3418fc9c service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:27.815747 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-e2fc55df-83ae-44d7-ae60-a03115f68409 req-8598ef0b-c423-478a-a509-4c6a3418fc9c service nova] Creating event network-changed:2a441d6d-9009-42c2-a8aa-1b70f9d6ee7f for instance 64c88fa0-6a01-42fc-b0e9-98b9e84a199d on n-h1-850501-12 Sep 08 10:44:27.833951 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-e2fc55df-83ae-44d7-ae60-a03115f68409 req-8598ef0b-c423-478a-a509-4c6a3418fc9c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144197 Sep 08 10:44:27.835017 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 827/1667] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:44:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:44:27.854775 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4f852885-c3a6-4838-929a-733e859a4604 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:27.855722 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4f852885-c3a6-4838-929a-733e859a4604 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] [instance: 790bcd42-ace5-4761-b46d-e0889855623f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:27.897420 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f852885-c3a6-4838-929a-733e859a4604 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:27.923075 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f852885-c3a6-4838-929a-733e859a4604 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:27.927712 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f852885-c3a6-4838-929a-733e859a4604 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:27.936013 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f852885-c3a6-4838-929a-733e859a4604 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:27.941727 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f852885-c3a6-4838-929a-733e859a4604 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:27.944062 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f852885-c3a6-4838-929a-733e859a4604 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:28.004252 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-4f852885-c3a6-4838-929a-733e859a4604 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] HTTP exception thrown: Instance 790bcd42-ace5-4761-b46d-e0889855623f could not be found. Sep 08 10:44:28.010620 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4f852885-c3a6-4838-929a-733e859a4604 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Request method failure captured: Sep 08 10:44:28.010620 n-d-850501-12 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/servers/790bcd42-ace5-4761-b46d-e0889855623f HTTP/1.1 Sep 08 10:44:28.010620 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:44:28.010620 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:44:28.010620 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:44:28.010620 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:44:28.010620 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:44:28.010620 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:44:28.010620 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:44:28.010620 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:44:28.010620 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGca6Bmtz2I4VLeVP50pc__figgpR-BYmiiPisBqsa5NOM0O1GRtBpLQ8PhIZ-qgHcLt5g5esxBeyKeL62KF9_ee9oARBsl4g-xJ9hO74j2jyukw8Y_zhj8TZkZt49znp2ed5m5XaZVYLg1hZiSolp0Wloti4DTzk3Ec5SVWW09IMjvY Sep 08 10:44:28.010620 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:44:28.010620 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:44:28.010620 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:44:28.010620 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:44:28.010620 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:44:28.010620 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:44:28.010620 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: cb8038d51a764867a85d2eab4ac10d94 Sep 08 10:44:28.010620 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-234993375 Sep 08 10:44:28.010620 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:44:28.010620 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:44:28.010620 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cb8038d51a764867a85d2eab4ac10d94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cb8038d51a764867a85d2eab4ac10d94"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cb8038d51a764867a85d2eab4ac10d94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cb8038d51a764867a85d2eab4ac10d94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:44:28.010620 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-234993375 Sep 08 10:44:28.010620 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: cb8038d51a764867a85d2eab4ac10d94 Sep 08 10:44:28.010620 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-234993375 Sep 08 10:44:28.010620 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-AttachSCSIVolumeTestJSON-234993375-project Sep 08 10:44:28.010620 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:44:28.010620 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:44:28.010620 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 2b206b1f0a1d4f6ebefffc97c51e6f51 Sep 08 10:44:28.010620 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-234993375-project Sep 08 10:44:28.010620 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:44:28.010620 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 790bcd42-ace5-4761-b46d-e0889855623f could not be found. Sep 08 10:44:28.010620 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '790bcd42-ace5-4761-b46d-e0889855623f'} Sep 08 10:44:28.010620 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:44:28.010620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:44:28.010620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:44:28.010620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:44:28.010620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:44:28.010620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:44:28.010620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:44:28.010620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:44:28.010620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:44:28.010620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:44:28.010620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 790bcd42-ace5-4761-b46d-e0889855623f could not be found. Sep 08 10:44:28.010620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:44:28.010620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:44:28.010620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:44:28.010620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:44:28.010620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:44:28.010620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:44:28.010620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:44:28.010620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:44:28.010620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:44:28.010620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:44:28.010620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:44:28.010620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:44:28.010620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:44:28.010620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:44:28.010620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:44:28.010620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:44:28.010620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:44:28.010620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:44:28.021515 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 790bcd42-ace5-4761-b46d-e0889855623f could not be found. Sep 08 10:44:28.021515 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:44:28.021515 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:44:28.021515 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:44:28.021515 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:44:28.021515 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:44:28.021515 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:44:28.021515 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:44:28.021515 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:44:28.021515 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 790bcd42-ace5-4761-b46d-e0889855623f could not be found. Sep 08 10:44:28.021515 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:44:28.021515 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4f852885-c3a6-4838-929a-733e859a4604 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Returning 404 to user: Instance 790bcd42-ace5-4761-b46d-e0889855623f could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:44:28.021515 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4f852885-c3a6-4838-929a-733e859a4604 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] 10.222.0.27 "DELETE /compute/v2.1/servers/790bcd42-ace5-4761-b46d-e0889855623f" status: 404 len: 111 microversion: 2.1 time: 0.172404 Sep 08 10:44:28.021515 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 828/1668] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:44:27 2022] DELETE /compute/v2.1/servers/790bcd42-ace5-4761-b46d-e0889855623f => generated 111 bytes in 180 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:44:28.032270 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f0b8285e-a1d9-4e31-93a6-2bd28d28328b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:28.032906 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f0b8285e-a1d9-4e31-93a6-2bd28d28328b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: cf3b6c0e-d390-44d6-91e5-09b389dff551] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:28.050179 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0b8285e-a1d9-4e31-93a6-2bd28d28328b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:28.050687 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0b8285e-a1d9-4e31-93a6-2bd28d28328b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:28.051134 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0b8285e-a1d9-4e31-93a6-2bd28d28328b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:28.051874 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0b8285e-a1d9-4e31-93a6-2bd28d28328b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:28.052341 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0b8285e-a1d9-4e31-93a6-2bd28d28328b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:28.052797 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0b8285e-a1d9-4e31-93a6-2bd28d28328b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:29.585372 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f0b8285e-a1d9-4e31-93a6-2bd28d28328b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:29.609531 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f0b8285e-a1d9-4e31-93a6-2bd28d28328b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:29.612052 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f0b8285e-a1d9-4e31-93a6-2bd28d28328b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:29.615650 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f0b8285e-a1d9-4e31-93a6-2bd28d28328b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551" status: 200 len: 1487 microversion: 2.25 time: 1.596246 Sep 08 10:44:29.620070 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 829/1669] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:44:28 2022] GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551 => generated 1487 bytes in 1602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:44:29.631660 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9c5efbae-608d-4176-887b-bf9b38e97fc9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:29.638305 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9c5efbae-608d-4176-887b-bf9b38e97fc9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 287be913-2461-45d0-8000-360c3fdb5940] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:29.654559 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9c5efbae-608d-4176-887b-bf9b38e97fc9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:29.655488 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9c5efbae-608d-4176-887b-bf9b38e97fc9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:29.656349 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9c5efbae-608d-4176-887b-bf9b38e97fc9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:29.659177 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9c5efbae-608d-4176-887b-bf9b38e97fc9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:29.660066 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9c5efbae-608d-4176-887b-bf9b38e97fc9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:29.664346 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9c5efbae-608d-4176-887b-bf9b38e97fc9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:30.578086 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9c5efbae-608d-4176-887b-bf9b38e97fc9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:30.591781 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:44:30.624217 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9c5efbae-608d-4176-887b-bf9b38e97fc9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940" status: 200 len: 1463 microversion: 2.1 time: 1.001709 Sep 08 10:44:30.630127 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 830/1670] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:29 2022] GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940 => generated 1463 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:30.638393 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d6422c4b-b4ee-4074-a65c-5d2578d7903f tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:30.646005 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d6422c4b-b4ee-4074-a65c-5d2578d7903f tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 64c88fa0-6a01-42fc-b0e9-98b9e84a199d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:30.654535 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d6422c4b-b4ee-4074-a65c-5d2578d7903f tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:30.655411 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d6422c4b-b4ee-4074-a65c-5d2578d7903f tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:30.655876 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d6422c4b-b4ee-4074-a65c-5d2578d7903f tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:30.656652 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d6422c4b-b4ee-4074-a65c-5d2578d7903f tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:30.657146 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d6422c4b-b4ee-4074-a65c-5d2578d7903f tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:30.657573 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d6422c4b-b4ee-4074-a65c-5d2578d7903f tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:30.831630 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fc19bbfe-8c63-47eb-a43a-2ad3db67cb56 tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29/action" status: 202 len: 0 microversion: 2.1 time: 6.008142 Sep 08 10:44:30.838317 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 841/1671] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:44:24 2022] POST /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29/action => generated 0 bytes in 6017 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:44:30.868303 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-06854197-b87d-47c6-b2b3-c0cf40d85d06 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:30.869771 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-06854197-b87d-47c6-b2b3-c0cf40d85d06 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] [instance: bf82fb33-6e90-4830-aa0e-5bff7fa782ba] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:30.908386 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06854197-b87d-47c6-b2b3-c0cf40d85d06 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:30.909253 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06854197-b87d-47c6-b2b3-c0cf40d85d06 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:30.909882 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06854197-b87d-47c6-b2b3-c0cf40d85d06 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:30.911248 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06854197-b87d-47c6-b2b3-c0cf40d85d06 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:30.917157 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06854197-b87d-47c6-b2b3-c0cf40d85d06 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:30.924184 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06854197-b87d-47c6-b2b3-c0cf40d85d06 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:31.043920 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-06854197-b87d-47c6-b2b3-c0cf40d85d06 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173621608ea149b4b401f2da7351597a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de50a647dfb24b13945df8851e766db7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:31.062432 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-06854197-b87d-47c6-b2b3-c0cf40d85d06 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] 10.222.0.27 "GET /compute/v2.1/servers/bf82fb33-6e90-4830-aa0e-5bff7fa782ba" status: 200 len: 1284 microversion: 2.1 time: 0.220802 Sep 08 10:44:31.064410 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 842/1672] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:30 2022] GET /compute/v2.1/servers/bf82fb33-6e90-4830-aa0e-5bff7fa782ba => generated 1284 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:31.072096 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a836a581-d521-4025-af9c-0cd9570a2f24 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:31.073250 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a836a581-d521-4025-af9c-0cd9570a2f24 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] [instance: 790bcd42-ace5-4761-b46d-e0889855623f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:31.098870 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a836a581-d521-4025-af9c-0cd9570a2f24 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:31.100204 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a836a581-d521-4025-af9c-0cd9570a2f24 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:31.101454 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a836a581-d521-4025-af9c-0cd9570a2f24 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:31.103384 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a836a581-d521-4025-af9c-0cd9570a2f24 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:31.104454 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a836a581-d521-4025-af9c-0cd9570a2f24 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:31.107008 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a836a581-d521-4025-af9c-0cd9570a2f24 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:31.130647 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-a836a581-d521-4025-af9c-0cd9570a2f24 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] HTTP exception thrown: Instance 790bcd42-ace5-4761-b46d-e0889855623f could not be found. Sep 08 10:44:31.132883 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a836a581-d521-4025-af9c-0cd9570a2f24 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Request method failure captured: Sep 08 10:44:31.132883 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/790bcd42-ace5-4761-b46d-e0889855623f HTTP/1.1 Sep 08 10:44:31.132883 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:44:31.132883 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:44:31.132883 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:44:31.132883 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:44:31.132883 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:44:31.132883 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:44:31.132883 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:44:31.132883 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:44:31.132883 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGca6Bmtz2I4VLeVP50pc__figgpR-BYmiiPisBqsa5NOM0O1GRtBpLQ8PhIZ-qgHcLt5g5esxBeyKeL62KF9_ee9oARBsl4g-xJ9hO74j2jyukw8Y_zhj8TZkZt49znp2ed5m5XaZVYLg1hZiSolp0Wloti4DTzk3Ec5SVWW09IMjvY Sep 08 10:44:31.132883 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:44:31.132883 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:44:31.132883 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:44:31.132883 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:44:31.132883 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:44:31.132883 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:44:31.132883 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: cb8038d51a764867a85d2eab4ac10d94 Sep 08 10:44:31.132883 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-234993375 Sep 08 10:44:31.132883 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:44:31.132883 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:44:31.132883 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cb8038d51a764867a85d2eab4ac10d94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cb8038d51a764867a85d2eab4ac10d94"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cb8038d51a764867a85d2eab4ac10d94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cb8038d51a764867a85d2eab4ac10d94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:44:31.132883 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-234993375 Sep 08 10:44:31.132883 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: cb8038d51a764867a85d2eab4ac10d94 Sep 08 10:44:31.132883 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-234993375 Sep 08 10:44:31.132883 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-AttachSCSIVolumeTestJSON-234993375-project Sep 08 10:44:31.132883 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:44:31.132883 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:44:31.132883 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 2b206b1f0a1d4f6ebefffc97c51e6f51 Sep 08 10:44:31.132883 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-234993375-project Sep 08 10:44:31.132883 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:44:31.132883 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 790bcd42-ace5-4761-b46d-e0889855623f could not be found. Sep 08 10:44:31.132883 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '790bcd42-ace5-4761-b46d-e0889855623f'} Sep 08 10:44:31.132883 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:44:31.132883 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:44:31.132883 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:44:31.132883 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:44:31.132883 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:44:31.132883 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:44:31.132883 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:44:31.132883 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:44:31.132883 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:44:31.132883 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:44:31.132883 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 790bcd42-ace5-4761-b46d-e0889855623f could not be found. Sep 08 10:44:31.132883 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:44:31.132883 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:44:31.132883 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:44:31.132883 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:44:31.132883 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:44:31.132883 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:44:31.132883 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:44:31.132883 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:44:31.132883 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:44:31.132883 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:44:31.132883 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:44:31.132883 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:44:31.132883 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:44:31.132883 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:44:31.132883 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:44:31.132883 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:44:31.132883 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 790bcd42-ace5-4761-b46d-e0889855623f could not be found. Sep 08 10:44:31.132883 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:44:31.132883 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:44:31.132883 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:44:31.138606 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:44:31.138606 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:44:31.138606 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:44:31.138606 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:44:31.138606 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:44:31.138606 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 790bcd42-ace5-4761-b46d-e0889855623f could not be found. Sep 08 10:44:31.138606 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:44:31.141294 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a836a581-d521-4025-af9c-0cd9570a2f24 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] Returning 404 to user: Instance 790bcd42-ace5-4761-b46d-e0889855623f could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:44:31.142553 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a836a581-d521-4025-af9c-0cd9570a2f24 tempest-AttachSCSIVolumeTestJSON-234993375 tempest-AttachSCSIVolumeTestJSON-234993375-project] 10.222.0.27 "GET /compute/v2.1/servers/790bcd42-ace5-4761-b46d-e0889855623f" status: 404 len: 111 microversion: 2.1 time: 0.076800 Sep 08 10:44:31.143871 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 843/1673] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:31 2022] GET /compute/v2.1/servers/790bcd42-ace5-4761-b46d-e0889855623f => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:44:31.159669 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b467202b-7ec8-4137-86f0-a9b0d6ff438f tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:31.168007 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b467202b-7ec8-4137-86f0-a9b0d6ff438f tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: f9f308fa-d4a6-4ac9-8c64-927e082b0b4a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:31.191058 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b467202b-7ec8-4137-86f0-a9b0d6ff438f tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:31.202595 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b467202b-7ec8-4137-86f0-a9b0d6ff438f tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:31.203871 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b467202b-7ec8-4137-86f0-a9b0d6ff438f tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:31.205373 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b467202b-7ec8-4137-86f0-a9b0d6ff438f tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:31.206352 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b467202b-7ec8-4137-86f0-a9b0d6ff438f tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:31.207375 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b467202b-7ec8-4137-86f0-a9b0d6ff438f tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:31.474346 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b467202b-7ec8-4137-86f0-a9b0d6ff438f tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:31.497194 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b467202b-7ec8-4137-86f0-a9b0d6ff438f tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a" status: 200 len: 1285 microversion: 2.1 time: 0.351784 Sep 08 10:44:31.498571 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 844/1674] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:31 2022] GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a => generated 1285 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:31.506748 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c28e1dca-687f-4cd4-a063-60bc65d7f05b tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '.version_select at 0x7f68e4710790>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:31.533114 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d6422c4b-b4ee-4074-a65c-5d2578d7903f tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:31.558023 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d6422c4b-b4ee-4074-a65c-5d2578d7903f tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d" status: 200 len: 1307 microversion: 2.1 time: 0.916707 Sep 08 10:44:31.564862 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 831/1675] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:30 2022] GET /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d => generated 1307 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:31.574439 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c28e1dca-687f-4cd4-a063-60bc65d7f05b tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/images/ef654b65-07f7-425a-b46d-ccc7e6f6fb53" status: 200 len: 1453 microversion: 2.1 time: 0.073817 Sep 08 10:44:31.580419 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-a34e1b79-5d64-4388-b060-a0696b9f320b req-e93ad74f-eed5-4fe4-bbaf-89258844817f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "287be913-2461-45d0-8000-360c3fdb5940", "name": "network-vif-plugged", "status": "completed", "tag": "b0efdf4d-7120-405a-89e4-97e3a3ae0d87"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:44:31.581200 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 845/1676] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:44:31 2022] GET /compute/v2.1/images/ef654b65-07f7-425a-b46d-ccc7e6f6fb53 => generated 1453 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:31.625880 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a34e1b79-5d64-4388-b060-a0696b9f320b req-e93ad74f-eed5-4fe4-bbaf-89258844817f service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:31.626475 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a34e1b79-5d64-4388-b060-a0696b9f320b req-e93ad74f-eed5-4fe4-bbaf-89258844817f service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:31.626800 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a34e1b79-5d64-4388-b060-a0696b9f320b req-e93ad74f-eed5-4fe4-bbaf-89258844817f service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:31.687261 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-a34e1b79-5d64-4388-b060-a0696b9f320b req-e93ad74f-eed5-4fe4-bbaf-89258844817f service nova] Creating event network-vif-plugged:b0efdf4d-7120-405a-89e4-97e3a3ae0d87 for instance 287be913-2461-45d0-8000-360c3fdb5940 on n-h1-850501-12 Sep 08 10:44:31.698106 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-a34e1b79-5d64-4388-b060-a0696b9f320b req-e93ad74f-eed5-4fe4-bbaf-89258844817f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131497 Sep 08 10:44:31.706276 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 832/1677] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:44:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:44:31.730515 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-051748f9-d570-4301-a402-72eb8e3fab26 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:31.737820 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-051748f9-d570-4301-a402-72eb8e3fab26 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: cf3b6c0e-d390-44d6-91e5-09b389dff551] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:31.757777 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-051748f9-d570-4301-a402-72eb8e3fab26 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:31.758371 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-051748f9-d570-4301-a402-72eb8e3fab26 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:31.758843 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-051748f9-d570-4301-a402-72eb8e3fab26 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:31.759582 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-051748f9-d570-4301-a402-72eb8e3fab26 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:31.760094 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-051748f9-d570-4301-a402-72eb8e3fab26 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:31.760526 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-051748f9-d570-4301-a402-72eb8e3fab26 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:31.961039 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-34eda8e9-9151-4366-bf5a-212e2c6bfdbe tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:31.962306 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-34eda8e9-9151-4366-bf5a-212e2c6bfdbe tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] [instance: 287be913-2461-45d0-8000-360c3fdb5940] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:31.980465 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-34eda8e9-9151-4366-bf5a-212e2c6bfdbe tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:31.981318 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-34eda8e9-9151-4366-bf5a-212e2c6bfdbe tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:31.982059 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-34eda8e9-9151-4366-bf5a-212e2c6bfdbe tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:31.985410 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-34eda8e9-9151-4366-bf5a-212e2c6bfdbe tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:31.986172 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-34eda8e9-9151-4366-bf5a-212e2c6bfdbe tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:31.987097 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-34eda8e9-9151-4366-bf5a-212e2c6bfdbe tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:32.491350 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-051748f9-d570-4301-a402-72eb8e3fab26 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:32.514901 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-051748f9-d570-4301-a402-72eb8e3fab26 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:32.519643 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-051748f9-d570-4301-a402-72eb8e3fab26 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:32.523217 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-051748f9-d570-4301-a402-72eb8e3fab26 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551" status: 200 len: 1487 microversion: 2.25 time: 0.815760 Sep 08 10:44:32.524878 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 833/1678] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:44:31 2022] GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551 => generated 1487 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:44:32.533582 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3f0ff87f-331b-4af4-946c-e2206507dd3d tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:32.534454 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3f0ff87f-331b-4af4-946c-e2206507dd3d tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 90974422-0d77-4970-9e94-ed6b3376ed29] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:32.548965 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3f0ff87f-331b-4af4-946c-e2206507dd3d tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:32.549740 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3f0ff87f-331b-4af4-946c-e2206507dd3d tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:32.550788 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3f0ff87f-331b-4af4-946c-e2206507dd3d tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:32.551698 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3f0ff87f-331b-4af4-946c-e2206507dd3d tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:32.552325 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3f0ff87f-331b-4af4-946c-e2206507dd3d tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:32.552917 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3f0ff87f-331b-4af4-946c-e2206507dd3d tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:32.653257 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-34eda8e9-9151-4366-bf5a-212e2c6bfdbe tempest-MigrationsAdminTest-1473145899 tempest-MigrationsAdminTest-1473145899-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940" status: 200 len: 1616 microversion: 2.1 time: 1.068636 Sep 08 10:44:32.654345 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 846/1679] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:31 2022] GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940 => generated 1616 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:32.668620 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4b4ecc29-bc3f-494f-b55d-37b75b063114 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:32.669649 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4b4ecc29-bc3f-494f-b55d-37b75b063114 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] [instance: bf82fb33-6e90-4830-aa0e-5bff7fa782ba] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:32.686242 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4b4ecc29-bc3f-494f-b55d-37b75b063114 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:32.687303 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4b4ecc29-bc3f-494f-b55d-37b75b063114 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:32.687997 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4b4ecc29-bc3f-494f-b55d-37b75b063114 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:32.689616 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4b4ecc29-bc3f-494f-b55d-37b75b063114 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:32.693764 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4b4ecc29-bc3f-494f-b55d-37b75b063114 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:32.694757 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4b4ecc29-bc3f-494f-b55d-37b75b063114 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:32.903972 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3f0ff87f-331b-4af4-946c-e2206507dd3d tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:32.928009 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3f0ff87f-331b-4af4-946c-e2206507dd3d tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29" status: 200 len: 1391 microversion: 2.1 time: 0.401483 Sep 08 10:44:32.939652 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 834/1680] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:32 2022] GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29 => generated 1391 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:32.979304 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ae88110d-ce5a-4843-a9b6-1b36404304bf tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:32.980238 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ae88110d-ce5a-4843-a9b6-1b36404304bf tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: f9f308fa-d4a6-4ac9-8c64-927e082b0b4a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:32.987805 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae88110d-ce5a-4843-a9b6-1b36404304bf tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:32.988942 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae88110d-ce5a-4843-a9b6-1b36404304bf tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:32.993109 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae88110d-ce5a-4843-a9b6-1b36404304bf tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:32.994385 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae88110d-ce5a-4843-a9b6-1b36404304bf tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:32.995916 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae88110d-ce5a-4843-a9b6-1b36404304bf tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:32.997299 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae88110d-ce5a-4843-a9b6-1b36404304bf tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:33.141155 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ae88110d-ce5a-4843-a9b6-1b36404304bf tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:33.154512 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ae88110d-ce5a-4843-a9b6-1b36404304bf tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a" status: 200 len: 1273 microversion: 2.1 time: 0.196006 Sep 08 10:44:33.168278 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 835/1681] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:32 2022] GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a => generated 1273 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:33.181054 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9f6823f5-30ae-48b5-a704-c93895ab7af3 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:33.189254 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9f6823f5-30ae-48b5-a704-c93895ab7af3 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 64c88fa0-6a01-42fc-b0e9-98b9e84a199d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:33.207736 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f6823f5-30ae-48b5-a704-c93895ab7af3 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:33.214842 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f6823f5-30ae-48b5-a704-c93895ab7af3 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:33.216084 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f6823f5-30ae-48b5-a704-c93895ab7af3 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:33.217389 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f6823f5-30ae-48b5-a704-c93895ab7af3 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:33.218953 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f6823f5-30ae-48b5-a704-c93895ab7af3 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:33.219703 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f6823f5-30ae-48b5-a704-c93895ab7af3 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:33.288639 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4b4ecc29-bc3f-494f-b55d-37b75b063114 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173621608ea149b4b401f2da7351597a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de50a647dfb24b13945df8851e766db7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:33.306551 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4b4ecc29-bc3f-494f-b55d-37b75b063114 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] 10.222.0.27 "GET /compute/v2.1/servers/bf82fb33-6e90-4830-aa0e-5bff7fa782ba" status: 200 len: 1326 microversion: 2.1 time: 0.650832 Sep 08 10:44:33.309777 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 847/1682] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:32 2022] GET /compute/v2.1/servers/bf82fb33-6e90-4830-aa0e-5bff7fa782ba => generated 1326 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:33.321102 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f90b728c-c261-4652-8fbf-aed7be272bbd tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '.version_select at 0x7f68e4959f70>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:33.452236 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f90b728c-c261-4652-8fbf-aed7be272bbd tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/images/ef654b65-07f7-425a-b46d-ccc7e6f6fb53" status: 200 len: 1453 microversion: 2.1 time: 0.141092 Sep 08 10:44:33.458780 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 848/1683] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:44:33 2022] GET /compute/v2.1/images/ef654b65-07f7-425a-b46d-ccc7e6f6fb53 => generated 1453 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:33.471152 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2eb79da6-4172-4af2-bf91-0593f769384f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:33.471932 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2eb79da6-4172-4af2-bf91-0593f769384f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 287be913-2461-45d0-8000-360c3fdb5940] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:33.490089 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2eb79da6-4172-4af2-bf91-0593f769384f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:33.495782 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2eb79da6-4172-4af2-bf91-0593f769384f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:33.497015 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2eb79da6-4172-4af2-bf91-0593f769384f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:33.499107 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2eb79da6-4172-4af2-bf91-0593f769384f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:33.499859 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2eb79da6-4172-4af2-bf91-0593f769384f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:33.500859 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2eb79da6-4172-4af2-bf91-0593f769384f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:33.578157 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2eb79da6-4172-4af2-bf91-0593f769384f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 287be913-2461-45d0-8000-360c3fdb5940] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:44:33.719908 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2eb79da6-4172-4af2-bf91-0593f769384f tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "DELETE /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940" status: 204 len: 0 microversion: 2.1 time: 0.258887 Sep 08 10:44:33.725600 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 849/1684] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:44:33 2022] DELETE /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:44:33.732585 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d5af30fe-cdad-43d6-a976-b0edf06c43de tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:33.733529 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d5af30fe-cdad-43d6-a976-b0edf06c43de tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: cf3b6c0e-d390-44d6-91e5-09b389dff551] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:33.740587 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d5af30fe-cdad-43d6-a976-b0edf06c43de tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:33.741141 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d5af30fe-cdad-43d6-a976-b0edf06c43de tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:33.741737 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d5af30fe-cdad-43d6-a976-b0edf06c43de tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:33.742759 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d5af30fe-cdad-43d6-a976-b0edf06c43de tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:33.743378 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d5af30fe-cdad-43d6-a976-b0edf06c43de tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:33.743978 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d5af30fe-cdad-43d6-a976-b0edf06c43de tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:33.923555 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:44:34.010504 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:44:34.187172 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d5af30fe-cdad-43d6-a976-b0edf06c43de tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:34.199862 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d5af30fe-cdad-43d6-a976-b0edf06c43de tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:34.209186 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d5af30fe-cdad-43d6-a976-b0edf06c43de tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:34.210712 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d5af30fe-cdad-43d6-a976-b0edf06c43de tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551" status: 200 len: 1487 microversion: 2.25 time: 0.483803 Sep 08 10:44:34.217726 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 850/1685] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:44:33 2022] GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551 => generated 1487 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:44:34.228913 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-09c63c0d-1702-41eb-8aa7-52f0cb4aa673 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:34.229637 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-09c63c0d-1702-41eb-8aa7-52f0cb4aa673 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 287be913-2461-45d0-8000-360c3fdb5940] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:34.239636 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-09c63c0d-1702-41eb-8aa7-52f0cb4aa673 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:34.240149 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-09c63c0d-1702-41eb-8aa7-52f0cb4aa673 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:34.240603 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-09c63c0d-1702-41eb-8aa7-52f0cb4aa673 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:34.243835 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-09c63c0d-1702-41eb-8aa7-52f0cb4aa673 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:34.244349 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-09c63c0d-1702-41eb-8aa7-52f0cb4aa673 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:34.244792 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-09c63c0d-1702-41eb-8aa7-52f0cb4aa673 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:34.496363 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9f6823f5-30ae-48b5-a704-c93895ab7af3 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:34.521177 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9f6823f5-30ae-48b5-a704-c93895ab7af3 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d" status: 200 len: 1307 microversion: 2.1 time: 1.351080 Sep 08 10:44:34.529189 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 836/1686] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:33 2022] GET /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d => generated 1307 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:34.544078 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-36b13ba4-059b-45a2-aa0a-583be2878e1e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:34.546056 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-36b13ba4-059b-45a2-aa0a-583be2878e1e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 90974422-0d77-4970-9e94-ed6b3376ed29] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:34.551443 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=8 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:44:34.571661 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36b13ba4-059b-45a2-aa0a-583be2878e1e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:34.572406 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-09c63c0d-1702-41eb-8aa7-52f0cb4aa673 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:34.574761 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36b13ba4-059b-45a2-aa0a-583be2878e1e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:34.581242 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36b13ba4-059b-45a2-aa0a-583be2878e1e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:34.582186 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-09c63c0d-1702-41eb-8aa7-52f0cb4aa673 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940" status: 200 len: 1469 microversion: 2.1 time: 0.363222 Sep 08 10:44:34.582801 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 851/1687] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:34 2022] GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940 => generated 1469 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:34.583047 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36b13ba4-059b-45a2-aa0a-583be2878e1e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:34.583877 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36b13ba4-059b-45a2-aa0a-583be2878e1e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:34.584565 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36b13ba4-059b-45a2-aa0a-583be2878e1e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:34.616586 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5fe782ab-6894-4b80-a88f-5f490fd8300c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:34.617283 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5fe782ab-6894-4b80-a88f-5f490fd8300c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: f9f308fa-d4a6-4ac9-8c64-927e082b0b4a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:34.627999 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=6 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:44:34.641505 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5fe782ab-6894-4b80-a88f-5f490fd8300c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:34.642681 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5fe782ab-6894-4b80-a88f-5f490fd8300c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:34.643326 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5fe782ab-6894-4b80-a88f-5f490fd8300c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:34.644264 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5fe782ab-6894-4b80-a88f-5f490fd8300c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:34.644935 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5fe782ab-6894-4b80-a88f-5f490fd8300c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:34.646169 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5fe782ab-6894-4b80-a88f-5f490fd8300c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:35.258028 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-36b13ba4-059b-45a2-aa0a-583be2878e1e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:35.293009 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-36b13ba4-059b-45a2-aa0a-583be2878e1e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29" status: 200 len: 1391 microversion: 2.1 time: 0.761497 Sep 08 10:44:35.329446 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 837/1688] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:34 2022] GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29 => generated 1391 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:35.337003 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fb5e82b2-322b-4a20-989b-f5cef06e59c1 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:35.340862 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fb5e82b2-322b-4a20-989b-f5cef06e59c1 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] [instance: bf82fb33-6e90-4830-aa0e-5bff7fa782ba] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:35.343957 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5fe782ab-6894-4b80-a88f-5f490fd8300c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:35.353012 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5fe782ab-6894-4b80-a88f-5f490fd8300c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a" status: 200 len: 1315 microversion: 2.1 time: 0.740444 Sep 08 10:44:35.359344 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 852/1689] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:34 2022] GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a => generated 1315 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:35.371726 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7459984c-7a96-45ec-8213-028c50451610 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '.version_select at 0x7f68e49591f0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:35.387657 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb5e82b2-322b-4a20-989b-f5cef06e59c1 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:35.387657 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb5e82b2-322b-4a20-989b-f5cef06e59c1 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:35.395635 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb5e82b2-322b-4a20-989b-f5cef06e59c1 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:35.402139 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb5e82b2-322b-4a20-989b-f5cef06e59c1 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:35.404967 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb5e82b2-322b-4a20-989b-f5cef06e59c1 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:35.405469 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb5e82b2-322b-4a20-989b-f5cef06e59c1 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:35.500797 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7459984c-7a96-45ec-8213-028c50451610 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/images/ef654b65-07f7-425a-b46d-ccc7e6f6fb53" status: 200 len: 1453 microversion: 2.1 time: 0.140155 Sep 08 10:44:35.503246 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 853/1690] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:44:35 2022] GET /compute/v2.1/images/ef654b65-07f7-425a-b46d-ccc7e6f6fb53 => generated 1453 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:35.523492 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-69a1fbcb-b018-4794-8819-c9ee082fe34a tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:35.524882 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-69a1fbcb-b018-4794-8819-c9ee082fe34a tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: cf3b6c0e-d390-44d6-91e5-09b389dff551] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:35.569571 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-69a1fbcb-b018-4794-8819-c9ee082fe34a tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:35.571103 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-69a1fbcb-b018-4794-8819-c9ee082fe34a tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:35.572205 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-69a1fbcb-b018-4794-8819-c9ee082fe34a tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:35.577125 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-69a1fbcb-b018-4794-8819-c9ee082fe34a tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:35.578030 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-69a1fbcb-b018-4794-8819-c9ee082fe34a tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:35.582534 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-69a1fbcb-b018-4794-8819-c9ee082fe34a tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:36.191725 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fb5e82b2-322b-4a20-989b-f5cef06e59c1 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173621608ea149b4b401f2da7351597a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de50a647dfb24b13945df8851e766db7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:36.209989 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fb5e82b2-322b-4a20-989b-f5cef06e59c1 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] 10.222.0.27 "GET /compute/v2.1/servers/bf82fb33-6e90-4830-aa0e-5bff7fa782ba" status: 200 len: 1326 microversion: 2.1 time: 0.878976 Sep 08 10:44:36.212981 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 838/1691] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:35 2022] GET /compute/v2.1/servers/bf82fb33-6e90-4830-aa0e-5bff7fa782ba => generated 1326 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:36.219212 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-5a594d1f-2e0b-48ae-bc80-d5fd4f030f54 req-a1f88ef9-bf93-441c-a33f-27becac513f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf82fb33-6e90-4830-aa0e-5bff7fa782ba", "tag": "203a672d-d2f0-4f46-843a-209ad13b7262"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:44:36.249152 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-5a594d1f-2e0b-48ae-bc80-d5fd4f030f54 req-a1f88ef9-bf93-441c-a33f-27becac513f7 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:36.251775 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-5a594d1f-2e0b-48ae-bc80-d5fd4f030f54 req-a1f88ef9-bf93-441c-a33f-27becac513f7 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:36.252534 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-5a594d1f-2e0b-48ae-bc80-d5fd4f030f54 req-a1f88ef9-bf93-441c-a33f-27becac513f7 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:36.300834 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-5a594d1f-2e0b-48ae-bc80-d5fd4f030f54 req-a1f88ef9-bf93-441c-a33f-27becac513f7 service nova] Creating event network-changed:203a672d-d2f0-4f46-843a-209ad13b7262 for instance bf82fb33-6e90-4830-aa0e-5bff7fa782ba on n-h1-850501-12 Sep 08 10:44:36.322792 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-5a594d1f-2e0b-48ae-bc80-d5fd4f030f54 req-a1f88ef9-bf93-441c-a33f-27becac513f7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106957 Sep 08 10:44:36.325279 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 839/1692] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:44:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:44:36.358994 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9a7da5f4-273a-4aea-aaca-f91cd70aa06a tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:36.360098 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9a7da5f4-273a-4aea-aaca-f91cd70aa06a tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 64c88fa0-6a01-42fc-b0e9-98b9e84a199d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:36.426546 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9a7da5f4-273a-4aea-aaca-f91cd70aa06a tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:36.428485 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9a7da5f4-273a-4aea-aaca-f91cd70aa06a tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:36.429164 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9a7da5f4-273a-4aea-aaca-f91cd70aa06a tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:36.431787 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9a7da5f4-273a-4aea-aaca-f91cd70aa06a tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:36.434783 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9a7da5f4-273a-4aea-aaca-f91cd70aa06a tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:36.435566 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9a7da5f4-273a-4aea-aaca-f91cd70aa06a tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:36.808719 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-69a1fbcb-b018-4794-8819-c9ee082fe34a tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:36.828177 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-69a1fbcb-b018-4794-8819-c9ee082fe34a tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:36.843133 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-69a1fbcb-b018-4794-8819-c9ee082fe34a tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:36.844711 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-69a1fbcb-b018-4794-8819-c9ee082fe34a tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551" status: 200 len: 1487 microversion: 2.25 time: 1.340003 Sep 08 10:44:36.845579 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 854/1693] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:44:35 2022] GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551 => generated 1487 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:44:36.883641 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6eeca71f-991b-486b-8943-10186d10943e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:36.885261 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6eeca71f-991b-486b-8943-10186d10943e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 287be913-2461-45d0-8000-360c3fdb5940] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:36.907666 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6eeca71f-991b-486b-8943-10186d10943e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:36.910538 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6eeca71f-991b-486b-8943-10186d10943e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:36.916385 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6eeca71f-991b-486b-8943-10186d10943e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:36.918070 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6eeca71f-991b-486b-8943-10186d10943e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:36.918938 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6eeca71f-991b-486b-8943-10186d10943e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:36.919724 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6eeca71f-991b-486b-8943-10186d10943e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:37.280405 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9a7da5f4-273a-4aea-aaca-f91cd70aa06a tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:37.295407 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9a7da5f4-273a-4aea-aaca-f91cd70aa06a tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d" status: 200 len: 1307 microversion: 2.1 time: 0.956448 Sep 08 10:44:37.309880 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6eeca71f-991b-486b-8943-10186d10943e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:37.311489 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 840/1694] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:36 2022] GET /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d => generated 1307 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:37.327608 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6eeca71f-991b-486b-8943-10186d10943e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940" status: 200 len: 1469 microversion: 2.1 time: 0.465748 Sep 08 10:44:37.331428 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 855/1695] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:36 2022] GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940 => generated 1469 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:37.354906 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-776d12af-72d9-4dbd-ae7b-bd846e27af67 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:37.356423 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-776d12af-72d9-4dbd-ae7b-bd846e27af67 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: f9f308fa-d4a6-4ac9-8c64-927e082b0b4a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:37.360941 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9b2cf205-6b4e-4f6c-bca1-76da9b9b49b3 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:37.362056 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9b2cf205-6b4e-4f6c-bca1-76da9b9b49b3 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 90974422-0d77-4970-9e94-ed6b3376ed29] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:37.381465 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-776d12af-72d9-4dbd-ae7b-bd846e27af67 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:37.386066 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-776d12af-72d9-4dbd-ae7b-bd846e27af67 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:37.387030 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-776d12af-72d9-4dbd-ae7b-bd846e27af67 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:37.389323 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-776d12af-72d9-4dbd-ae7b-bd846e27af67 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:37.391329 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9b2cf205-6b4e-4f6c-bca1-76da9b9b49b3 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:37.391864 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9b2cf205-6b4e-4f6c-bca1-76da9b9b49b3 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:37.392362 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9b2cf205-6b4e-4f6c-bca1-76da9b9b49b3 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:37.392837 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-776d12af-72d9-4dbd-ae7b-bd846e27af67 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:37.393575 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-776d12af-72d9-4dbd-ae7b-bd846e27af67 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:37.395513 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9b2cf205-6b4e-4f6c-bca1-76da9b9b49b3 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:37.396258 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9b2cf205-6b4e-4f6c-bca1-76da9b9b49b3 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:37.396753 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9b2cf205-6b4e-4f6c-bca1-76da9b9b49b3 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:37.800343 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-776d12af-72d9-4dbd-ae7b-bd846e27af67 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:37.818626 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-776d12af-72d9-4dbd-ae7b-bd846e27af67 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a" status: 200 len: 1315 microversion: 2.1 time: 0.484457 Sep 08 10:44:37.822637 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 856/1696] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:37 2022] GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a => generated 1315 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:37.831292 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b661ede6-63f0-4a66-8af1-87f65194c388 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '.version_select at 0x7f68e46ad1f0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:37.927655 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b661ede6-63f0-4a66-8af1-87f65194c388 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/images/ef654b65-07f7-425a-b46d-ccc7e6f6fb53" status: 200 len: 1453 microversion: 2.1 time: 0.103794 Sep 08 10:44:37.930778 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 857/1697] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:44:37 2022] GET /compute/v2.1/images/ef654b65-07f7-425a-b46d-ccc7e6f6fb53 => generated 1453 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:37.942939 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-6bea11db-9721-4fff-b71c-2920f4a8fbcb req-af915f44-5f99-4943-bc8e-87fbe3562034 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64c88fa0-6a01-42fc-b0e9-98b9e84a199d", "name": "network-vif-plugged", "status": "completed", "tag": "2a441d6d-9009-42c2-a8aa-1b70f9d6ee7f"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:44:37.964571 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9b2cf205-6b4e-4f6c-bca1-76da9b9b49b3 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:37.969731 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-6bea11db-9721-4fff-b71c-2920f4a8fbcb req-af915f44-5f99-4943-bc8e-87fbe3562034 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:37.971364 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-6bea11db-9721-4fff-b71c-2920f4a8fbcb req-af915f44-5f99-4943-bc8e-87fbe3562034 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:37.973444 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-6bea11db-9721-4fff-b71c-2920f4a8fbcb req-af915f44-5f99-4943-bc8e-87fbe3562034 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:37.984628 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9b2cf205-6b4e-4f6c-bca1-76da9b9b49b3 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29" status: 200 len: 1391 microversion: 2.1 time: 0.669847 Sep 08 10:44:37.989943 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 841/1698] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:37 2022] GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29 => generated 1391 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:38.004252 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-741b2a61-cb6d-48e3-ae43-9fbed1f5aa4d tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:38.010736 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-741b2a61-cb6d-48e3-ae43-9fbed1f5aa4d tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] [instance: bf82fb33-6e90-4830-aa0e-5bff7fa782ba] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:38.010948 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-6bea11db-9721-4fff-b71c-2920f4a8fbcb req-af915f44-5f99-4943-bc8e-87fbe3562034 service nova] Creating event network-vif-plugged:2a441d6d-9009-42c2-a8aa-1b70f9d6ee7f for instance 64c88fa0-6a01-42fc-b0e9-98b9e84a199d on n-h1-850501-12 Sep 08 10:44:38.024135 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-6bea11db-9721-4fff-b71c-2920f4a8fbcb req-af915f44-5f99-4943-bc8e-87fbe3562034 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091329 Sep 08 10:44:38.035124 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-741b2a61-cb6d-48e3-ae43-9fbed1f5aa4d tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:38.036020 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 858/1699] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:44:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:44:38.042138 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-741b2a61-cb6d-48e3-ae43-9fbed1f5aa4d tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:38.042607 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-eac080c0-2ad3-4401-90e9-d18e94f2a057 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:38.043722 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-eac080c0-2ad3-4401-90e9-d18e94f2a057 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: cf3b6c0e-d390-44d6-91e5-09b389dff551] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:38.044841 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-741b2a61-cb6d-48e3-ae43-9fbed1f5aa4d tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:38.046018 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-741b2a61-cb6d-48e3-ae43-9fbed1f5aa4d tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:38.051543 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-741b2a61-cb6d-48e3-ae43-9fbed1f5aa4d tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:38.052149 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-741b2a61-cb6d-48e3-ae43-9fbed1f5aa4d tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:38.067308 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eac080c0-2ad3-4401-90e9-d18e94f2a057 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:38.068906 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eac080c0-2ad3-4401-90e9-d18e94f2a057 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:38.069676 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eac080c0-2ad3-4401-90e9-d18e94f2a057 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:38.071637 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eac080c0-2ad3-4401-90e9-d18e94f2a057 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:38.077939 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eac080c0-2ad3-4401-90e9-d18e94f2a057 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:38.079107 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eac080c0-2ad3-4401-90e9-d18e94f2a057 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:38.499445 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-eac080c0-2ad3-4401-90e9-d18e94f2a057 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:38.519221 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-eac080c0-2ad3-4401-90e9-d18e94f2a057 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:38.521228 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-eac080c0-2ad3-4401-90e9-d18e94f2a057 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:38.522672 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-eac080c0-2ad3-4401-90e9-d18e94f2a057 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551" status: 200 len: 1487 microversion: 2.25 time: 0.485429 Sep 08 10:44:38.523922 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 859/1700] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:44:38 2022] GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551 => generated 1487 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:44:38.529063 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e9c5dab9-c8a6-428e-a671-8b5730c33b60 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:38.536775 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e9c5dab9-c8a6-428e-a671-8b5730c33b60 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 64c88fa0-6a01-42fc-b0e9-98b9e84a199d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:38.544205 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e9c5dab9-c8a6-428e-a671-8b5730c33b60 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:38.546848 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e9c5dab9-c8a6-428e-a671-8b5730c33b60 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:38.556778 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e9c5dab9-c8a6-428e-a671-8b5730c33b60 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:38.558161 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e9c5dab9-c8a6-428e-a671-8b5730c33b60 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:38.559002 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e9c5dab9-c8a6-428e-a671-8b5730c33b60 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:38.559658 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e9c5dab9-c8a6-428e-a671-8b5730c33b60 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:38.598081 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-741b2a61-cb6d-48e3-ae43-9fbed1f5aa4d tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173621608ea149b4b401f2da7351597a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de50a647dfb24b13945df8851e766db7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:38.611971 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-741b2a61-cb6d-48e3-ae43-9fbed1f5aa4d tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] 10.222.0.27 "GET /compute/v2.1/servers/bf82fb33-6e90-4830-aa0e-5bff7fa782ba" status: 200 len: 1326 microversion: 2.1 time: 0.620535 Sep 08 10:44:38.620325 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 842/1701] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:37 2022] GET /compute/v2.1/servers/bf82fb33-6e90-4830-aa0e-5bff7fa782ba => generated 1326 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:38.632436 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4a6ec57a-d514-46fd-953d-0915038e62b6 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:38.634578 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4a6ec57a-d514-46fd-953d-0915038e62b6 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 287be913-2461-45d0-8000-360c3fdb5940] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:38.668312 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a6ec57a-d514-46fd-953d-0915038e62b6 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:38.671907 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a6ec57a-d514-46fd-953d-0915038e62b6 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:38.673247 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a6ec57a-d514-46fd-953d-0915038e62b6 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:38.675830 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a6ec57a-d514-46fd-953d-0915038e62b6 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:38.676617 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a6ec57a-d514-46fd-953d-0915038e62b6 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:38.681907 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a6ec57a-d514-46fd-953d-0915038e62b6 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:39.444778 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4a6ec57a-d514-46fd-953d-0915038e62b6 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:39.465184 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4a6ec57a-d514-46fd-953d-0915038e62b6 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940" status: 200 len: 1427 microversion: 2.1 time: 0.841809 Sep 08 10:44:39.484321 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 843/1702] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:38 2022] GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940 => generated 1427 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:39.489288 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-0f9c20dc-0e48-48f6-a1e1-64cf61174ec1 req-e00045e7-10f4-45fb-a015-98f7c8786223 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "287be913-2461-45d0-8000-360c3fdb5940", "name": "network-vif-deleted", "tag": "b0efdf4d-7120-405a-89e4-97e3a3ae0d87"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:44:39.533324 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-0f9c20dc-0e48-48f6-a1e1-64cf61174ec1 req-e00045e7-10f4-45fb-a015-98f7c8786223 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:39.534127 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-0f9c20dc-0e48-48f6-a1e1-64cf61174ec1 req-e00045e7-10f4-45fb-a015-98f7c8786223 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:39.534670 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-0f9c20dc-0e48-48f6-a1e1-64cf61174ec1 req-e00045e7-10f4-45fb-a015-98f7c8786223 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:39.582440 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-0f9c20dc-0e48-48f6-a1e1-64cf61174ec1 req-e00045e7-10f4-45fb-a015-98f7c8786223 service nova] Creating event network-vif-deleted:b0efdf4d-7120-405a-89e4-97e3a3ae0d87 for instance 287be913-2461-45d0-8000-360c3fdb5940 on n-h1-850501-12 Sep 08 10:44:39.593994 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-0f9c20dc-0e48-48f6-a1e1-64cf61174ec1 req-e00045e7-10f4-45fb-a015-98f7c8786223 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108175 Sep 08 10:44:39.598125 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 844/1703] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:44:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:44:39.610754 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-131aa13d-98f8-4a45-a338-e597fbabe7a1 req-74afacc6-87cd-4429-9fe3-5b7bb9280f20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9f308fa-d4a6-4ac9-8c64-927e082b0b4a", "tag": "113493e8-8f02-4099-b529-0616d267ed77"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:44:39.612249 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e9c5dab9-c8a6-428e-a671-8b5730c33b60 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:39.631587 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e9c5dab9-c8a6-428e-a671-8b5730c33b60 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d" status: 200 len: 1307 microversion: 2.1 time: 1.106155 Sep 08 10:44:39.636899 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 860/1704] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:38 2022] GET /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d => generated 1307 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:39.643760 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8f287b37-1102-424d-b7ec-bd10df54a04d tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:39.650088 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8f287b37-1102-424d-b7ec-bd10df54a04d tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: f9f308fa-d4a6-4ac9-8c64-927e082b0b4a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:39.661788 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-131aa13d-98f8-4a45-a338-e597fbabe7a1 req-74afacc6-87cd-4429-9fe3-5b7bb9280f20 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:39.662877 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-131aa13d-98f8-4a45-a338-e597fbabe7a1 req-74afacc6-87cd-4429-9fe3-5b7bb9280f20 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:39.663555 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-131aa13d-98f8-4a45-a338-e597fbabe7a1 req-74afacc6-87cd-4429-9fe3-5b7bb9280f20 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:39.672443 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f287b37-1102-424d-b7ec-bd10df54a04d tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:39.674540 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f287b37-1102-424d-b7ec-bd10df54a04d tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:39.675296 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f287b37-1102-424d-b7ec-bd10df54a04d tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:39.680480 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f287b37-1102-424d-b7ec-bd10df54a04d tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:39.685905 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f287b37-1102-424d-b7ec-bd10df54a04d tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:39.686793 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f287b37-1102-424d-b7ec-bd10df54a04d tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:39.703861 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-131aa13d-98f8-4a45-a338-e597fbabe7a1 req-74afacc6-87cd-4429-9fe3-5b7bb9280f20 service nova] Creating event network-changed:113493e8-8f02-4099-b529-0616d267ed77 for instance f9f308fa-d4a6-4ac9-8c64-927e082b0b4a on n-h1-850501-12 Sep 08 10:44:39.716569 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-131aa13d-98f8-4a45-a338-e597fbabe7a1 req-74afacc6-87cd-4429-9fe3-5b7bb9280f20 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115953 Sep 08 10:44:39.723936 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 845/1705] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:44:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:44:39.733406 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-636975b8-096a-4470-bbcb-8b4de58fb52b tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '.version_select at 0x7f68e48328b0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:39.747666 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:44:39.869066 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-636975b8-096a-4470-bbcb-8b4de58fb52b tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/images/ef654b65-07f7-425a-b46d-ccc7e6f6fb53" status: 200 len: 1453 microversion: 2.1 time: 0.143349 Sep 08 10:44:39.870852 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 846/1706] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:44:39 2022] GET /compute/v2.1/images/ef654b65-07f7-425a-b46d-ccc7e6f6fb53 => generated 1453 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:39.880438 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4f7b4e9c-2321-4292-ab30-6fcd54f838f4 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:39.884594 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4f7b4e9c-2321-4292-ab30-6fcd54f838f4 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 90974422-0d77-4970-9e94-ed6b3376ed29] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:39.922305 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f7b4e9c-2321-4292-ab30-6fcd54f838f4 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:39.926978 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f7b4e9c-2321-4292-ab30-6fcd54f838f4 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:39.927807 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f7b4e9c-2321-4292-ab30-6fcd54f838f4 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:39.931133 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f7b4e9c-2321-4292-ab30-6fcd54f838f4 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:39.935038 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f7b4e9c-2321-4292-ab30-6fcd54f838f4 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:39.936493 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f7b4e9c-2321-4292-ab30-6fcd54f838f4 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:39.995370 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8f287b37-1102-424d-b7ec-bd10df54a04d tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:40.006168 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8f287b37-1102-424d-b7ec-bd10df54a04d tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a" status: 200 len: 1315 microversion: 2.1 time: 0.366671 Sep 08 10:44:40.018108 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 861/1707] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:39 2022] GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a => generated 1315 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:40.028384 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-893a6d5e-02ea-4f95-bd7b-d5772da2c8b7 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:40.031580 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-893a6d5e-02ea-4f95-bd7b-d5772da2c8b7 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: cf3b6c0e-d390-44d6-91e5-09b389dff551] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:40.069130 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-893a6d5e-02ea-4f95-bd7b-d5772da2c8b7 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:40.072179 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-893a6d5e-02ea-4f95-bd7b-d5772da2c8b7 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:40.074332 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-893a6d5e-02ea-4f95-bd7b-d5772da2c8b7 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:40.077284 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-893a6d5e-02ea-4f95-bd7b-d5772da2c8b7 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:40.079100 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-893a6d5e-02ea-4f95-bd7b-d5772da2c8b7 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:40.081606 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-893a6d5e-02ea-4f95-bd7b-d5772da2c8b7 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:40.442562 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-893a6d5e-02ea-4f95-bd7b-d5772da2c8b7 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:40.462443 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-893a6d5e-02ea-4f95-bd7b-d5772da2c8b7 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:40.471470 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-893a6d5e-02ea-4f95-bd7b-d5772da2c8b7 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:40.478212 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-893a6d5e-02ea-4f95-bd7b-d5772da2c8b7 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551" status: 200 len: 1487 microversion: 2.25 time: 0.461575 Sep 08 10:44:40.506093 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 862/1708] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:44:40 2022] GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551 => generated 1487 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:44:40.515699 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-763f181c-32e8-4043-b518-f2481d889273 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:40.517529 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-763f181c-32e8-4043-b518-f2481d889273 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] [instance: bf82fb33-6e90-4830-aa0e-5bff7fa782ba] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:40.533609 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-763f181c-32e8-4043-b518-f2481d889273 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:40.535325 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-763f181c-32e8-4043-b518-f2481d889273 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:40.538291 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-763f181c-32e8-4043-b518-f2481d889273 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:40.541416 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-763f181c-32e8-4043-b518-f2481d889273 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:40.542827 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-763f181c-32e8-4043-b518-f2481d889273 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:40.543569 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-763f181c-32e8-4043-b518-f2481d889273 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:40.687013 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4f7b4e9c-2321-4292-ab30-6fcd54f838f4 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:40.702827 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4f7b4e9c-2321-4292-ab30-6fcd54f838f4 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29" status: 200 len: 1391 microversion: 2.1 time: 0.828166 Sep 08 10:44:40.704190 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 847/1709] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:39 2022] GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29 => generated 1391 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:40.713213 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6ad2ad26-37ec-42b4-99c7-9f12ec3630a8 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:40.720093 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6ad2ad26-37ec-42b4-99c7-9f12ec3630a8 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 287be913-2461-45d0-8000-360c3fdb5940] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:40.746192 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ad2ad26-37ec-42b4-99c7-9f12ec3630a8 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:40.750941 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ad2ad26-37ec-42b4-99c7-9f12ec3630a8 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:40.754388 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ad2ad26-37ec-42b4-99c7-9f12ec3630a8 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:40.758946 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ad2ad26-37ec-42b4-99c7-9f12ec3630a8 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:40.762297 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ad2ad26-37ec-42b4-99c7-9f12ec3630a8 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:40.763467 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ad2ad26-37ec-42b4-99c7-9f12ec3630a8 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:40.824230 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-6ad2ad26-37ec-42b4-99c7-9f12ec3630a8 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] HTTP exception thrown: Instance 287be913-2461-45d0-8000-360c3fdb5940 could not be found. Sep 08 10:44:40.827872 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6ad2ad26-37ec-42b4-99c7-9f12ec3630a8 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Request method failure captured: Sep 08 10:44:40.827872 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940 HTTP/1.1 Sep 08 10:44:40.827872 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:44:40.827872 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:44:40.827872 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:44:40.827872 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:44:40.827872 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:44:40.827872 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:44:40.827872 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:44:40.827872 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:44:40.827872 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcYGgRkKVHRzVR9niOGjhwqpirZaCWJcRqqRBFlhL1VmFuxdG98PboRets-mDW1eiOn1mBTQzWopbf0-ncuece0UY9n3HH2MGNmaq7bojLbCqCyMZSM43Ty75CqX6jnN2RpnAuia-0vhvf6ydgpmghVLux4c6nabv9yseF4tgJm4EqM Sep 08 10:44:40.827872 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:44:40.827872 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:44:40.827872 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:44:40.827872 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:44:40.827872 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:44:40.827872 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:44:40.827872 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: a52c0b4a043445df94dab4dd4292607a Sep 08 10:44:40.827872 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-MigrationsAdminTest-381365870 Sep 08 10:44:40.827872 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:44:40.827872 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:44:40.827872 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a52c0b4a043445df94dab4dd4292607a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a52c0b4a043445df94dab4dd4292607a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a52c0b4a043445df94dab4dd4292607a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a52c0b4a043445df94dab4dd4292607a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:44:40.827872 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-MigrationsAdminTest-381365870 Sep 08 10:44:40.827872 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: a52c0b4a043445df94dab4dd4292607a Sep 08 10:44:40.827872 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-MigrationsAdminTest-381365870 Sep 08 10:44:40.827872 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-MigrationsAdminTest-381365870-project Sep 08 10:44:40.827872 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:44:40.827872 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:44:40.827872 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 5450284cb50b4f75be0915074bf8fe78 Sep 08 10:44:40.827872 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-MigrationsAdminTest-381365870-project Sep 08 10:44:40.827872 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:44:40.827872 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 287be913-2461-45d0-8000-360c3fdb5940 could not be found. Sep 08 10:44:40.827872 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '287be913-2461-45d0-8000-360c3fdb5940'} Sep 08 10:44:40.827872 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:44:40.827872 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:44:40.827872 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:44:40.827872 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:44:40.827872 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:44:40.827872 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:44:40.827872 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:44:40.827872 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:44:40.827872 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:44:40.827872 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:44:40.827872 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 287be913-2461-45d0-8000-360c3fdb5940 could not be found. Sep 08 10:44:40.827872 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:44:40.827872 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:44:40.827872 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:44:40.827872 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:44:40.827872 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:44:40.827872 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:44:40.827872 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:44:40.827872 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:44:40.827872 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:44:40.827872 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:44:40.827872 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:44:40.827872 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:44:40.827872 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:44:40.827872 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:44:40.827872 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:44:40.827872 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:44:40.827872 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 287be913-2461-45d0-8000-360c3fdb5940 could not be found. Sep 08 10:44:40.827872 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:44:40.827872 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:44:40.827872 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:44:40.834912 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:44:40.834912 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:44:40.834912 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:44:40.834912 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:44:40.834912 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:44:40.834912 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 287be913-2461-45d0-8000-360c3fdb5940 could not be found. Sep 08 10:44:40.834912 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:44:40.837245 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6ad2ad26-37ec-42b4-99c7-9f12ec3630a8 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Returning 404 to user: Instance 287be913-2461-45d0-8000-360c3fdb5940 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:44:40.838666 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6ad2ad26-37ec-42b4-99c7-9f12ec3630a8 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940" status: 404 len: 111 microversion: 2.1 time: 0.129687 Sep 08 10:44:40.839937 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 848/1710] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:40 2022] GET /compute/v2.1/servers/287be913-2461-45d0-8000-360c3fdb5940 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:44:40.846390 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c8f7365b-b40f-48e4-9b47-b63a3eb9c687 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:40.847519 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c8f7365b-b40f-48e4-9b47-b63a3eb9c687 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 64c88fa0-6a01-42fc-b0e9-98b9e84a199d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:40.856073 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c8f7365b-b40f-48e4-9b47-b63a3eb9c687 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:40.857210 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c8f7365b-b40f-48e4-9b47-b63a3eb9c687 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:40.857893 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c8f7365b-b40f-48e4-9b47-b63a3eb9c687 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:40.859086 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c8f7365b-b40f-48e4-9b47-b63a3eb9c687 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:40.859855 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c8f7365b-b40f-48e4-9b47-b63a3eb9c687 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:40.860672 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c8f7365b-b40f-48e4-9b47-b63a3eb9c687 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:41.144210 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-763f181c-32e8-4043-b518-f2481d889273 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173621608ea149b4b401f2da7351597a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de50a647dfb24b13945df8851e766db7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:41.168919 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-763f181c-32e8-4043-b518-f2481d889273 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] 10.222.0.27 "GET /compute/v2.1/servers/bf82fb33-6e90-4830-aa0e-5bff7fa782ba" status: 200 len: 1326 microversion: 2.1 time: 0.658129 Sep 08 10:44:41.170675 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 863/1711] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:40 2022] GET /compute/v2.1/servers/bf82fb33-6e90-4830-aa0e-5bff7fa782ba => generated 1326 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:41.189682 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0819fdfd-8fdc-4357-857b-6db85402566d tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:41.190674 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0819fdfd-8fdc-4357-857b-6db85402566d tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: a3a6ce0f-e362-4cbc-afc2-3cfd349a4812] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:41.207484 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:44:41.211691 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0819fdfd-8fdc-4357-857b-6db85402566d tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:41.211691 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0819fdfd-8fdc-4357-857b-6db85402566d tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:41.213412 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0819fdfd-8fdc-4357-857b-6db85402566d tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:41.213412 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0819fdfd-8fdc-4357-857b-6db85402566d tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:41.213412 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0819fdfd-8fdc-4357-857b-6db85402566d tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:41.214320 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0819fdfd-8fdc-4357-857b-6db85402566d tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:41.253857 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0819fdfd-8fdc-4357-857b-6db85402566d tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: a3a6ce0f-e362-4cbc-afc2-3cfd349a4812] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:44:41.407695 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0819fdfd-8fdc-4357-857b-6db85402566d tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812" status: 204 len: 0 microversion: 2.1 time: 0.234878 Sep 08 10:44:41.414893 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 864/1712] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:44:41 2022] DELETE /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:44:41.425690 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-77d5abee-c0d6-4a02-877c-c09952cc8b25 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '.version_select at 0x7f68e45b7940>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:41.495774 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-77d5abee-c0d6-4a02-877c-c09952cc8b25 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/images/ef654b65-07f7-425a-b46d-ccc7e6f6fb53" status: 200 len: 1453 microversion: 2.1 time: 0.076829 Sep 08 10:44:41.496345 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 865/1713] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:44:41 2022] GET /compute/v2.1/images/ef654b65-07f7-425a-b46d-ccc7e6f6fb53 => generated 1453 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:41.501984 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f43e546b-824d-4927-acee-79ceaa002119 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:41.503008 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f43e546b-824d-4927-acee-79ceaa002119 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: f9f308fa-d4a6-4ac9-8c64-927e082b0b4a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:41.514602 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f43e546b-824d-4927-acee-79ceaa002119 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:41.515360 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f43e546b-824d-4927-acee-79ceaa002119 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:41.516099 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f43e546b-824d-4927-acee-79ceaa002119 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:41.517437 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f43e546b-824d-4927-acee-79ceaa002119 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:41.518355 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f43e546b-824d-4927-acee-79ceaa002119 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:41.519418 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f43e546b-824d-4927-acee-79ceaa002119 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:41.805190 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f43e546b-824d-4927-acee-79ceaa002119 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:41.817730 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f43e546b-824d-4927-acee-79ceaa002119 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a" status: 200 len: 1315 microversion: 2.1 time: 0.319823 Sep 08 10:44:41.829659 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 866/1714] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:41 2022] GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a => generated 1315 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:41.841899 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-317de4b5-6817-47aa-9bab-f5dd77b3cd98 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:41.842776 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-317de4b5-6817-47aa-9bab-f5dd77b3cd98 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: a3a6ce0f-e362-4cbc-afc2-3cfd349a4812] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:41.850717 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-317de4b5-6817-47aa-9bab-f5dd77b3cd98 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:41.852561 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-317de4b5-6817-47aa-9bab-f5dd77b3cd98 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:41.853296 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-317de4b5-6817-47aa-9bab-f5dd77b3cd98 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:41.854322 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-317de4b5-6817-47aa-9bab-f5dd77b3cd98 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:41.855028 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-317de4b5-6817-47aa-9bab-f5dd77b3cd98 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:41.855734 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-317de4b5-6817-47aa-9bab-f5dd77b3cd98 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:42.141474 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-317de4b5-6817-47aa-9bab-f5dd77b3cd98 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:42.151087 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c8f7365b-b40f-48e4-9b47-b63a3eb9c687 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:42.154394 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-317de4b5-6817-47aa-9bab-f5dd77b3cd98 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812" status: 200 len: 1534 microversion: 2.1 time: 0.317282 Sep 08 10:44:42.155951 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 867/1715] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:41 2022] GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812 => generated 1534 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:42.161238 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d65fca5f-d071-42fc-a8bf-262f48aab7ed tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:42.162273 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d65fca5f-d071-42fc-a8bf-262f48aab7ed tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: cf3b6c0e-d390-44d6-91e5-09b389dff551] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:42.175709 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c8f7365b-b40f-48e4-9b47-b63a3eb9c687 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d" status: 200 len: 1307 microversion: 2.1 time: 1.330703 Sep 08 10:44:42.175709 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 849/1716] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:40 2022] GET /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d => generated 1307 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:42.184420 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c6bf5f72-3c53-4eb4-936d-494536a5584a tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:42.192329 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c6bf5f72-3c53-4eb4-936d-494536a5584a tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 90974422-0d77-4970-9e94-ed6b3376ed29] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:42.198188 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d65fca5f-d071-42fc-a8bf-262f48aab7ed tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:42.198188 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d65fca5f-d071-42fc-a8bf-262f48aab7ed tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:42.198188 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d65fca5f-d071-42fc-a8bf-262f48aab7ed tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:42.198188 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d65fca5f-d071-42fc-a8bf-262f48aab7ed tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:42.198871 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d65fca5f-d071-42fc-a8bf-262f48aab7ed tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:42.199560 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d65fca5f-d071-42fc-a8bf-262f48aab7ed tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:42.203257 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c6bf5f72-3c53-4eb4-936d-494536a5584a tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:42.203876 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c6bf5f72-3c53-4eb4-936d-494536a5584a tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:42.207036 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c6bf5f72-3c53-4eb4-936d-494536a5584a tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:42.208023 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c6bf5f72-3c53-4eb4-936d-494536a5584a tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:42.208618 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c6bf5f72-3c53-4eb4-936d-494536a5584a tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:42.212357 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c6bf5f72-3c53-4eb4-936d-494536a5584a tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:42.433540 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d65fca5f-d071-42fc-a8bf-262f48aab7ed tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:42.451793 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d65fca5f-d071-42fc-a8bf-262f48aab7ed tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:42.454632 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d65fca5f-d071-42fc-a8bf-262f48aab7ed tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:42.457654 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d65fca5f-d071-42fc-a8bf-262f48aab7ed tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551" status: 200 len: 1487 microversion: 2.25 time: 0.299517 Sep 08 10:44:42.459527 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 868/1717] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:44:42 2022] GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551 => generated 1487 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:44:42.467118 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5f54ae8f-4934-47ea-b3df-08866a7e915c tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:42.468261 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5f54ae8f-4934-47ea-b3df-08866a7e915c tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] [instance: bf82fb33-6e90-4830-aa0e-5bff7fa782ba] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:42.485175 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5f54ae8f-4934-47ea-b3df-08866a7e915c tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:42.486039 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5f54ae8f-4934-47ea-b3df-08866a7e915c tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:42.486778 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5f54ae8f-4934-47ea-b3df-08866a7e915c tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:42.487840 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5f54ae8f-4934-47ea-b3df-08866a7e915c tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:42.488548 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5f54ae8f-4934-47ea-b3df-08866a7e915c tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:42.489269 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5f54ae8f-4934-47ea-b3df-08866a7e915c tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:42.772547 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5f54ae8f-4934-47ea-b3df-08866a7e915c tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173621608ea149b4b401f2da7351597a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de50a647dfb24b13945df8851e766db7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:42.818989 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5f54ae8f-4934-47ea-b3df-08866a7e915c tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] 10.222.0.27 "GET /compute/v2.1/servers/bf82fb33-6e90-4830-aa0e-5bff7fa782ba" status: 200 len: 1326 microversion: 2.1 time: 0.356563 Sep 08 10:44:42.821733 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 869/1718] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:42 2022] GET /compute/v2.1/servers/bf82fb33-6e90-4830-aa0e-5bff7fa782ba => generated 1326 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:42.846641 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-388c5fac-6024-467b-bf9d-cb96abca3d2e tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '.version_select at 0x7f68e4b49c10>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:42.956135 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-388c5fac-6024-467b-bf9d-cb96abca3d2e tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/images/ef654b65-07f7-425a-b46d-ccc7e6f6fb53" status: 200 len: 1453 microversion: 2.1 time: 0.132420 Sep 08 10:44:42.957499 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 870/1719] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:44:42 2022] GET /compute/v2.1/images/ef654b65-07f7-425a-b46d-ccc7e6f6fb53 => generated 1453 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:42.963137 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8993770e-e6f4-4521-abe6-cd429612b876 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:42.964013 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8993770e-e6f4-4521-abe6-cd429612b876 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: f9f308fa-d4a6-4ac9-8c64-927e082b0b4a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:42.971636 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8993770e-e6f4-4521-abe6-cd429612b876 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:42.972700 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8993770e-e6f4-4521-abe6-cd429612b876 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:42.973438 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8993770e-e6f4-4521-abe6-cd429612b876 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:42.974635 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8993770e-e6f4-4521-abe6-cd429612b876 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:42.975529 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8993770e-e6f4-4521-abe6-cd429612b876 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:42.976897 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8993770e-e6f4-4521-abe6-cd429612b876 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:43.023373 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c6bf5f72-3c53-4eb4-936d-494536a5584a tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:43.035769 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c6bf5f72-3c53-4eb4-936d-494536a5584a tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29" status: 200 len: 1391 microversion: 2.1 time: 0.859481 Sep 08 10:44:43.039510 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 850/1720] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:42 2022] GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29 => generated 1391 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:43.190334 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7a4be76a-7947-4bd9-8aac-ca346e7378a8 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:43.192590 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7a4be76a-7947-4bd9-8aac-ca346e7378a8 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: a3a6ce0f-e362-4cbc-afc2-3cfd349a4812] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:43.207390 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7a4be76a-7947-4bd9-8aac-ca346e7378a8 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:43.210042 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7a4be76a-7947-4bd9-8aac-ca346e7378a8 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:43.212853 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7a4be76a-7947-4bd9-8aac-ca346e7378a8 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:43.214618 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7a4be76a-7947-4bd9-8aac-ca346e7378a8 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:43.216781 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7a4be76a-7947-4bd9-8aac-ca346e7378a8 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:43.217523 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7a4be76a-7947-4bd9-8aac-ca346e7378a8 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:43.300166 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8993770e-e6f4-4521-abe6-cd429612b876 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:43.313415 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8993770e-e6f4-4521-abe6-cd429612b876 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a" status: 200 len: 1315 microversion: 2.1 time: 0.354208 Sep 08 10:44:43.314856 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 871/1721] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:42 2022] GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a => generated 1315 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:43.322482 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-267dc2de-38c1-4290-bb26-ab19b429940e tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:43.323950 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-267dc2de-38c1-4290-bb26-ab19b429940e tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 64c88fa0-6a01-42fc-b0e9-98b9e84a199d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:43.331705 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-267dc2de-38c1-4290-bb26-ab19b429940e tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:43.332869 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-267dc2de-38c1-4290-bb26-ab19b429940e tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:43.334005 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-267dc2de-38c1-4290-bb26-ab19b429940e tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:43.335079 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-267dc2de-38c1-4290-bb26-ab19b429940e tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:43.336479 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-267dc2de-38c1-4290-bb26-ab19b429940e tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:43.337273 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-267dc2de-38c1-4290-bb26-ab19b429940e tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:43.563909 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7a4be76a-7947-4bd9-8aac-ca346e7378a8 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:43.572052 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:44:43.589612 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7a4be76a-7947-4bd9-8aac-ca346e7378a8 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812" status: 200 len: 1534 microversion: 2.1 time: 0.404595 Sep 08 10:44:43.591972 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 851/1722] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:43 2022] GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812 => generated 1534 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:43.597737 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-d8766088-ac99-4734-8352-18f958ebca91 req-43b5479f-1714-491e-83ad-ea2b1806336e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf82fb33-6e90-4830-aa0e-5bff7fa782ba", "name": "network-vif-plugged", "status": "completed", "tag": "203a672d-d2f0-4f46-843a-209ad13b7262"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:44:43.610153 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d8766088-ac99-4734-8352-18f958ebca91 req-43b5479f-1714-491e-83ad-ea2b1806336e service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:43.611193 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d8766088-ac99-4734-8352-18f958ebca91 req-43b5479f-1714-491e-83ad-ea2b1806336e service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:43.611874 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d8766088-ac99-4734-8352-18f958ebca91 req-43b5479f-1714-491e-83ad-ea2b1806336e service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:43.618769 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-267dc2de-38c1-4290-bb26-ab19b429940e tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:43.630159 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-d8766088-ac99-4734-8352-18f958ebca91 req-43b5479f-1714-491e-83ad-ea2b1806336e service nova] Creating event network-vif-plugged:203a672d-d2f0-4f46-843a-209ad13b7262 for instance bf82fb33-6e90-4830-aa0e-5bff7fa782ba on n-h1-850501-12 Sep 08 10:44:43.637394 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-d8766088-ac99-4734-8352-18f958ebca91 req-43b5479f-1714-491e-83ad-ea2b1806336e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043746 Sep 08 10:44:43.638962 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 852/1723] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:44:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:44:43.640960 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-267dc2de-38c1-4290-bb26-ab19b429940e tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d" status: 200 len: 1486 microversion: 2.1 time: 0.324581 Sep 08 10:44:43.653041 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 872/1724] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:43 2022] GET /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d => generated 1486 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:43.655353 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-875a0578-cebd-4acf-a3a3-c0e0bd4668e6 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:43.659360 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-875a0578-cebd-4acf-a3a3-c0e0bd4668e6 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: cf3b6c0e-d390-44d6-91e5-09b389dff551] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:43.671738 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a6cd0d60-9947-4b42-8ad9-cf7a03e07102 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:44:43.683396 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-875a0578-cebd-4acf-a3a3-c0e0bd4668e6 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:43.684373 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-875a0578-cebd-4acf-a3a3-c0e0bd4668e6 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:43.685161 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-875a0578-cebd-4acf-a3a3-c0e0bd4668e6 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:43.686160 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-875a0578-cebd-4acf-a3a3-c0e0bd4668e6 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:43.686997 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-875a0578-cebd-4acf-a3a3-c0e0bd4668e6 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:43.687838 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-875a0578-cebd-4acf-a3a3-c0e0bd4668e6 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:43.692139 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a6cd0d60-9947-4b42-8ad9-cf7a03e07102 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:43.695643 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a6cd0d60-9947-4b42-8ad9-cf7a03e07102 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:43.696509 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a6cd0d60-9947-4b42-8ad9-cf7a03e07102 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:43.824281 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a6cd0d60-9947-4b42-8ad9-cf7a03e07102 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 64c88fa0-6a01-42fc-b0e9-98b9e84a199d] Going to try to stop instance {{(pid=128861) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 08 10:44:43.944792 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a6cd0d60-9947-4b42-8ad9-cf7a03e07102 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "POST /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d/action" status: 202 len: 0 microversion: 2.1 time: 0.277457 Sep 08 10:44:43.950320 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 873/1725] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:44:43 2022] POST /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d/action => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:44:43.953061 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-21167c7b-365a-4ac0-afd4-7cb90aa03907 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:43.954460 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-21167c7b-365a-4ac0-afd4-7cb90aa03907 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] [instance: bf82fb33-6e90-4830-aa0e-5bff7fa782ba] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:43.972741 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-21167c7b-365a-4ac0-afd4-7cb90aa03907 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:43.974210 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-21167c7b-365a-4ac0-afd4-7cb90aa03907 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:43.974996 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-21167c7b-365a-4ac0-afd4-7cb90aa03907 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:43.978609 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-21167c7b-365a-4ac0-afd4-7cb90aa03907 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:43.980781 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-21167c7b-365a-4ac0-afd4-7cb90aa03907 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:43.982758 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-21167c7b-365a-4ac0-afd4-7cb90aa03907 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:44.117401 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-875a0578-cebd-4acf-a3a3-c0e0bd4668e6 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:44.133108 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-875a0578-cebd-4acf-a3a3-c0e0bd4668e6 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:44.146072 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-875a0578-cebd-4acf-a3a3-c0e0bd4668e6 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:44.153989 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-875a0578-cebd-4acf-a3a3-c0e0bd4668e6 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551" status: 200 len: 1487 microversion: 2.25 time: 0.507447 Sep 08 10:44:44.155264 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 853/1726] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:44:43 2022] GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551 => generated 1487 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:44:44.160311 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d578bbf6-4130-4d03-b9ef-a0b28e9ccdda tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:44.165445 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d578bbf6-4130-4d03-b9ef-a0b28e9ccdda tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 64c88fa0-6a01-42fc-b0e9-98b9e84a199d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:44.174381 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d578bbf6-4130-4d03-b9ef-a0b28e9ccdda tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:44.175046 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d578bbf6-4130-4d03-b9ef-a0b28e9ccdda tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:44.175587 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d578bbf6-4130-4d03-b9ef-a0b28e9ccdda tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:44.176605 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d578bbf6-4130-4d03-b9ef-a0b28e9ccdda tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:44.177353 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d578bbf6-4130-4d03-b9ef-a0b28e9ccdda tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:44.178011 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d578bbf6-4130-4d03-b9ef-a0b28e9ccdda tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:44.232549 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-21167c7b-365a-4ac0-afd4-7cb90aa03907 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173621608ea149b4b401f2da7351597a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de50a647dfb24b13945df8851e766db7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:44.254558 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-21167c7b-365a-4ac0-afd4-7cb90aa03907 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] 10.222.0.27 "GET /compute/v2.1/servers/bf82fb33-6e90-4830-aa0e-5bff7fa782ba" status: 200 len: 1326 microversion: 2.1 time: 0.306850 Sep 08 10:44:44.256028 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 874/1727] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:43 2022] GET /compute/v2.1/servers/bf82fb33-6e90-4830-aa0e-5bff7fa782ba => generated 1326 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:44.271314 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6b34ed17-d51a-4ef3-a908-c14a2e2ec213 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '.version_select at 0x7f68e4b49280>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:44.377951 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6b34ed17-d51a-4ef3-a908-c14a2e2ec213 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/images/ef654b65-07f7-425a-b46d-ccc7e6f6fb53" status: 200 len: 1453 microversion: 2.1 time: 0.120592 Sep 08 10:44:44.379586 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 875/1728] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:44:44 2022] GET /compute/v2.1/images/ef654b65-07f7-425a-b46d-ccc7e6f6fb53 => generated 1453 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:44.390324 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5ae422a2-debc-4b83-bcc1-0f8c2ba8bc22 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:44.391747 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5ae422a2-debc-4b83-bcc1-0f8c2ba8bc22 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 90974422-0d77-4970-9e94-ed6b3376ed29] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:44.407402 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5ae422a2-debc-4b83-bcc1-0f8c2ba8bc22 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:44.409705 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5ae422a2-debc-4b83-bcc1-0f8c2ba8bc22 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:44.411211 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5ae422a2-debc-4b83-bcc1-0f8c2ba8bc22 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:44.414352 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5ae422a2-debc-4b83-bcc1-0f8c2ba8bc22 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:44.421144 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5ae422a2-debc-4b83-bcc1-0f8c2ba8bc22 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:44.422969 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5ae422a2-debc-4b83-bcc1-0f8c2ba8bc22 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:44.650201 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d578bbf6-4130-4d03-b9ef-a0b28e9ccdda tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:44.681767 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d578bbf6-4130-4d03-b9ef-a0b28e9ccdda tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d" status: 200 len: 1496 microversion: 2.1 time: 0.524799 Sep 08 10:44:44.683695 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 854/1729] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:44 2022] GET /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d => generated 1496 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:44.700978 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b518bead-a323-43be-8d7f-b5eed77c242f tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:44.702021 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b518bead-a323-43be-8d7f-b5eed77c242f tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: f9f308fa-d4a6-4ac9-8c64-927e082b0b4a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:44.709575 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b518bead-a323-43be-8d7f-b5eed77c242f tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:44.710426 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b518bead-a323-43be-8d7f-b5eed77c242f tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:44.711377 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b518bead-a323-43be-8d7f-b5eed77c242f tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:44.712149 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b518bead-a323-43be-8d7f-b5eed77c242f tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:44.712633 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b518bead-a323-43be-8d7f-b5eed77c242f tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:44.713099 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b518bead-a323-43be-8d7f-b5eed77c242f tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:44.739091 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5ae422a2-debc-4b83-bcc1-0f8c2ba8bc22 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:44.754953 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5ae422a2-debc-4b83-bcc1-0f8c2ba8bc22 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29" status: 200 len: 1391 microversion: 2.1 time: 0.373936 Sep 08 10:44:44.765741 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 876/1730] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:44 2022] GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29 => generated 1391 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:44.793396 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a22bd7d7-a536-485d-9470-538a06ebe282 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:44.795448 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a22bd7d7-a536-485d-9470-538a06ebe282 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: a3a6ce0f-e362-4cbc-afc2-3cfd349a4812] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:44.803951 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a22bd7d7-a536-485d-9470-538a06ebe282 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:44.804705 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a22bd7d7-a536-485d-9470-538a06ebe282 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:44.805223 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a22bd7d7-a536-485d-9470-538a06ebe282 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:44.806024 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a22bd7d7-a536-485d-9470-538a06ebe282 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:44.806489 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a22bd7d7-a536-485d-9470-538a06ebe282 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:44.806914 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a22bd7d7-a536-485d-9470-538a06ebe282 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:45.113196 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a22bd7d7-a536-485d-9470-538a06ebe282 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:45.206011 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a22bd7d7-a536-485d-9470-538a06ebe282 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812" status: 200 len: 1534 microversion: 2.1 time: 0.437904 Sep 08 10:44:45.234900 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 877/1731] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:44 2022] GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812 => generated 1534 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:45.274897 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9c932c95-0759-4990-8941-94b2fbb794a3 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:45.276351 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9c932c95-0759-4990-8941-94b2fbb794a3 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: cf3b6c0e-d390-44d6-91e5-09b389dff551] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:45.283478 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9c932c95-0759-4990-8941-94b2fbb794a3 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:45.284152 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9c932c95-0759-4990-8941-94b2fbb794a3 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:45.285143 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9c932c95-0759-4990-8941-94b2fbb794a3 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:45.286255 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9c932c95-0759-4990-8941-94b2fbb794a3 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:45.286966 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9c932c95-0759-4990-8941-94b2fbb794a3 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:45.287400 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9c932c95-0759-4990-8941-94b2fbb794a3 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:45.307119 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:44:45.324506 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b518bead-a323-43be-8d7f-b5eed77c242f tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:45.337104 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b518bead-a323-43be-8d7f-b5eed77c242f tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a" status: 200 len: 1315 microversion: 2.1 time: 0.647393 Sep 08 10:44:45.338005 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 855/1732] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:44 2022] GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a => generated 1315 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:45.355711 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-465da35f-3f05-478c-a6d5-4e0cb456d671 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:45.356653 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-465da35f-3f05-478c-a6d5-4e0cb456d671 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] [instance: bf82fb33-6e90-4830-aa0e-5bff7fa782ba] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:45.367945 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-465da35f-3f05-478c-a6d5-4e0cb456d671 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:45.369202 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-465da35f-3f05-478c-a6d5-4e0cb456d671 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:45.370068 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-465da35f-3f05-478c-a6d5-4e0cb456d671 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:45.371172 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-465da35f-3f05-478c-a6d5-4e0cb456d671 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:45.372044 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-465da35f-3f05-478c-a6d5-4e0cb456d671 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:45.372881 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-465da35f-3f05-478c-a6d5-4e0cb456d671 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:45.678989 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-465da35f-3f05-478c-a6d5-4e0cb456d671 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173621608ea149b4b401f2da7351597a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de50a647dfb24b13945df8851e766db7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:45.693737 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-465da35f-3f05-478c-a6d5-4e0cb456d671 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] 10.222.0.27 "GET /compute/v2.1/servers/bf82fb33-6e90-4830-aa0e-5bff7fa782ba" status: 200 len: 1326 microversion: 2.1 time: 0.351274 Sep 08 10:44:45.696997 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 856/1733] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:45 2022] GET /compute/v2.1/servers/bf82fb33-6e90-4830-aa0e-5bff7fa782ba => generated 1326 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:45.721202 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8de18d99-ddc0-4b90-8847-e68e105652a3 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '.version_select at 0x7f68e4ff9c10>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:45.925984 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8de18d99-ddc0-4b90-8847-e68e105652a3 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/images/ef654b65-07f7-425a-b46d-ccc7e6f6fb53" status: 200 len: 1453 microversion: 2.1 time: 0.210880 Sep 08 10:44:45.926653 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 857/1734] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:44:45 2022] GET /compute/v2.1/images/ef654b65-07f7-425a-b46d-ccc7e6f6fb53 => generated 1453 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:45.947961 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6967f6dc-f5bd-49a0-a61e-bdd30eeea8bb tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:45.949954 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6967f6dc-f5bd-49a0-a61e-bdd30eeea8bb tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 64c88fa0-6a01-42fc-b0e9-98b9e84a199d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:45.965838 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6967f6dc-f5bd-49a0-a61e-bdd30eeea8bb tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:45.967739 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6967f6dc-f5bd-49a0-a61e-bdd30eeea8bb tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:45.968567 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6967f6dc-f5bd-49a0-a61e-bdd30eeea8bb tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:45.969792 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6967f6dc-f5bd-49a0-a61e-bdd30eeea8bb tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:45.970555 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6967f6dc-f5bd-49a0-a61e-bdd30eeea8bb tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:45.971242 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6967f6dc-f5bd-49a0-a61e-bdd30eeea8bb tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:46.144992 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9c932c95-0759-4990-8941-94b2fbb794a3 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:46.167168 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9c932c95-0759-4990-8941-94b2fbb794a3 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:46.172839 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9c932c95-0759-4990-8941-94b2fbb794a3 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:46.177610 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9c932c95-0759-4990-8941-94b2fbb794a3 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551" status: 200 len: 1487 microversion: 2.25 time: 0.940716 Sep 08 10:44:46.181543 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 878/1735] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:44:45 2022] GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551 => generated 1487 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:44:46.196960 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a02a8df0-98fb-4c3e-aece-9fd3a80267a8 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:46.203294 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a02a8df0-98fb-4c3e-aece-9fd3a80267a8 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 90974422-0d77-4970-9e94-ed6b3376ed29] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:46.228372 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a02a8df0-98fb-4c3e-aece-9fd3a80267a8 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:46.245837 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a02a8df0-98fb-4c3e-aece-9fd3a80267a8 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:46.246370 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a02a8df0-98fb-4c3e-aece-9fd3a80267a8 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:46.247139 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a02a8df0-98fb-4c3e-aece-9fd3a80267a8 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:46.253012 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a02a8df0-98fb-4c3e-aece-9fd3a80267a8 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:46.254335 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a02a8df0-98fb-4c3e-aece-9fd3a80267a8 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:46.710585 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a02a8df0-98fb-4c3e-aece-9fd3a80267a8 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:46.725433 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a02a8df0-98fb-4c3e-aece-9fd3a80267a8 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29" status: 200 len: 1391 microversion: 2.1 time: 0.541739 Sep 08 10:44:46.726512 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6967f6dc-f5bd-49a0-a61e-bdd30eeea8bb tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:46.727887 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 879/1736] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:46 2022] GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29 => generated 1391 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:46.735642 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-55af1bf4-7bcb-42fa-ac69-3b10b4ae69c6 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:46.736908 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-55af1bf4-7bcb-42fa-ac69-3b10b4ae69c6 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: a3a6ce0f-e362-4cbc-afc2-3cfd349a4812] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:46.740720 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6967f6dc-f5bd-49a0-a61e-bdd30eeea8bb tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d" status: 200 len: 1496 microversion: 2.1 time: 0.810803 Sep 08 10:44:46.747964 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-55af1bf4-7bcb-42fa-ac69-3b10b4ae69c6 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:46.749353 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 858/1737] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:45 2022] GET /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d => generated 1496 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:46.749871 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-55af1bf4-7bcb-42fa-ac69-3b10b4ae69c6 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:46.750886 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-55af1bf4-7bcb-42fa-ac69-3b10b4ae69c6 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:46.752321 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-55af1bf4-7bcb-42fa-ac69-3b10b4ae69c6 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:46.753558 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-55af1bf4-7bcb-42fa-ac69-3b10b4ae69c6 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:46.754522 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-55af1bf4-7bcb-42fa-ac69-3b10b4ae69c6 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:46.771950 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d58fdee5-0685-455d-9b98-d883bca03ffb tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:46.772699 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d58fdee5-0685-455d-9b98-d883bca03ffb tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: f9f308fa-d4a6-4ac9-8c64-927e082b0b4a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:46.781570 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d58fdee5-0685-455d-9b98-d883bca03ffb tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:46.782930 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d58fdee5-0685-455d-9b98-d883bca03ffb tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:46.783548 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d58fdee5-0685-455d-9b98-d883bca03ffb tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:46.785891 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d58fdee5-0685-455d-9b98-d883bca03ffb tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:46.786980 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d58fdee5-0685-455d-9b98-d883bca03ffb tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:46.788143 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d58fdee5-0685-455d-9b98-d883bca03ffb tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:47.201445 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-55af1bf4-7bcb-42fa-ac69-3b10b4ae69c6 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:47.238077 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-55af1bf4-7bcb-42fa-ac69-3b10b4ae69c6 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812" status: 200 len: 1534 microversion: 2.1 time: 0.508058 Sep 08 10:44:47.251964 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 880/1738] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:46 2022] GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812 => generated 1534 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:47.259957 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2bf64b87-80a2-40fa-ad34-fdf7177c3087 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:47.260983 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2bf64b87-80a2-40fa-ad34-fdf7177c3087 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] [instance: bf82fb33-6e90-4830-aa0e-5bff7fa782ba] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:47.272009 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2bf64b87-80a2-40fa-ad34-fdf7177c3087 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:47.274549 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2bf64b87-80a2-40fa-ad34-fdf7177c3087 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:47.278650 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2bf64b87-80a2-40fa-ad34-fdf7177c3087 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:47.279752 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2bf64b87-80a2-40fa-ad34-fdf7177c3087 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:47.280820 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2bf64b87-80a2-40fa-ad34-fdf7177c3087 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:47.301855 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d58fdee5-0685-455d-9b98-d883bca03ffb tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:47.312152 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d58fdee5-0685-455d-9b98-d883bca03ffb tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a" status: 200 len: 1315 microversion: 2.1 time: 0.548005 Sep 08 10:44:47.320974 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 859/1739] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:46 2022] GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a => generated 1315 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:47.326277 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a09711fc-c362-4c27-83a2-ac9c94c0c4cb tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '.version_select at 0x7f68e478f3a0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:47.327604 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2bf64b87-80a2-40fa-ad34-fdf7177c3087 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:47.447055 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a09711fc-c362-4c27-83a2-ac9c94c0c4cb tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/images/ef654b65-07f7-425a-b46d-ccc7e6f6fb53" status: 200 len: 1462 microversion: 2.1 time: 0.123904 Sep 08 10:44:47.449380 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 860/1740] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:44:47 2022] GET /compute/v2.1/images/ef654b65-07f7-425a-b46d-ccc7e6f6fb53 => generated 1462 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:47.457641 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-986cdd5d-3b77-406d-87c2-067e4e563e62 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:47.461952 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-986cdd5d-3b77-406d-87c2-067e4e563e62 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: cf3b6c0e-d390-44d6-91e5-09b389dff551] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:47.487090 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-986cdd5d-3b77-406d-87c2-067e4e563e62 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:47.489661 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-986cdd5d-3b77-406d-87c2-067e4e563e62 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:47.490306 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-986cdd5d-3b77-406d-87c2-067e4e563e62 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:47.491577 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-986cdd5d-3b77-406d-87c2-067e4e563e62 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:47.494616 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-986cdd5d-3b77-406d-87c2-067e4e563e62 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:47.495298 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-986cdd5d-3b77-406d-87c2-067e4e563e62 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:47.924321 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-986cdd5d-3b77-406d-87c2-067e4e563e62 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:47.934736 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-986cdd5d-3b77-406d-87c2-067e4e563e62 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:47.936103 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-986cdd5d-3b77-406d-87c2-067e4e563e62 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:47.937330 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-986cdd5d-3b77-406d-87c2-067e4e563e62 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551" status: 200 len: 1487 microversion: 2.25 time: 0.483795 Sep 08 10:44:47.944524 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 861/1741] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:44:47 2022] GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551 => generated 1487 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:44:47.950522 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2bf64b87-80a2-40fa-ad34-fdf7177c3087 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173621608ea149b4b401f2da7351597a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de50a647dfb24b13945df8851e766db7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:47.959681 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-f8777fee-80d1-43da-8aa5-5af6b2a19381 req-6bcad43e-dcc9-4a2f-9107-683cc852f8e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3a6ce0f-e362-4cbc-afc2-3cfd349a4812", "name": "network-vif-deleted", "tag": "8ff15ca8-cc64-424e-b9f6-8f38b142e5ac"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:44:47.973311 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2bf64b87-80a2-40fa-ad34-fdf7177c3087 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] 10.222.0.27 "GET /compute/v2.1/servers/bf82fb33-6e90-4830-aa0e-5bff7fa782ba" status: 200 len: 1326 microversion: 2.1 time: 0.719236 Sep 08 10:44:47.974774 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 881/1742] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:47 2022] GET /compute/v2.1/servers/bf82fb33-6e90-4830-aa0e-5bff7fa782ba => generated 1326 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:47.985236 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-f8777fee-80d1-43da-8aa5-5af6b2a19381 req-6bcad43e-dcc9-4a2f-9107-683cc852f8e0 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:47.986048 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-f8777fee-80d1-43da-8aa5-5af6b2a19381 req-6bcad43e-dcc9-4a2f-9107-683cc852f8e0 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:47.986660 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-f8777fee-80d1-43da-8aa5-5af6b2a19381 req-6bcad43e-dcc9-4a2f-9107-683cc852f8e0 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:47.989413 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-862ae8ad-5a4f-4e85-a20b-d0bec68ac5f8 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '.version_select at 0x7f68e4a25a60>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:48.017516 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-f8777fee-80d1-43da-8aa5-5af6b2a19381 req-6bcad43e-dcc9-4a2f-9107-683cc852f8e0 service nova] Creating event network-vif-deleted:8ff15ca8-cc64-424e-b9f6-8f38b142e5ac for instance a3a6ce0f-e362-4cbc-afc2-3cfd349a4812 on n-h1-850501-12 Sep 08 10:44:48.031294 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-f8777fee-80d1-43da-8aa5-5af6b2a19381 req-6bcad43e-dcc9-4a2f-9107-683cc852f8e0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083717 Sep 08 10:44:48.033887 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 862/1743] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:44:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:44:48.048551 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-266f1acd-d4f8-476d-9ab0-34662e0281d9 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:48.049724 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-266f1acd-d4f8-476d-9ab0-34662e0281d9 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 90974422-0d77-4970-9e94-ed6b3376ed29] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:48.060727 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-862ae8ad-5a4f-4e85-a20b-d0bec68ac5f8 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/images/ef654b65-07f7-425a-b46d-ccc7e6f6fb53" status: 200 len: 1462 microversion: 2.1 time: 0.084346 Sep 08 10:44:48.063752 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-266f1acd-d4f8-476d-9ab0-34662e0281d9 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:48.064957 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-266f1acd-d4f8-476d-9ab0-34662e0281d9 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:48.065955 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-266f1acd-d4f8-476d-9ab0-34662e0281d9 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:48.067341 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-266f1acd-d4f8-476d-9ab0-34662e0281d9 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:48.069492 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-266f1acd-d4f8-476d-9ab0-34662e0281d9 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:48.071139 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-266f1acd-d4f8-476d-9ab0-34662e0281d9 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:48.072622 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 882/1744] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:44:47 2022] GET /compute/v2.1/images/ef654b65-07f7-425a-b46d-ccc7e6f6fb53 => generated 1462 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:48.078416 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ccfff4c2-ce3e-4316-8a73-872e0e08dcd5 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:48.083146 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ccfff4c2-ce3e-4316-8a73-872e0e08dcd5 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 64c88fa0-6a01-42fc-b0e9-98b9e84a199d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:48.109072 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ccfff4c2-ce3e-4316-8a73-872e0e08dcd5 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:48.116815 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ccfff4c2-ce3e-4316-8a73-872e0e08dcd5 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:48.117625 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ccfff4c2-ce3e-4316-8a73-872e0e08dcd5 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:48.118582 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ccfff4c2-ce3e-4316-8a73-872e0e08dcd5 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:48.119228 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ccfff4c2-ce3e-4316-8a73-872e0e08dcd5 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:48.119667 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ccfff4c2-ce3e-4316-8a73-872e0e08dcd5 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:48.458637 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-266f1acd-d4f8-476d-9ab0-34662e0281d9 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:48.517307 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-266f1acd-d4f8-476d-9ab0-34662e0281d9 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29" status: 200 len: 1391 microversion: 2.1 time: 0.480314 Sep 08 10:44:48.529103 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 863/1745] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:48 2022] GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29 => generated 1391 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:48.556419 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-940eed7f-035b-4567-b78f-cfa4ce3ce14c tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:48.558758 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-940eed7f-035b-4567-b78f-cfa4ce3ce14c tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] [instance: dac27157-b08e-4f13-b97e-3c5b653bd0b3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:48.574767 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-940eed7f-035b-4567-b78f-cfa4ce3ce14c tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:48.575640 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-940eed7f-035b-4567-b78f-cfa4ce3ce14c tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:48.576312 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-940eed7f-035b-4567-b78f-cfa4ce3ce14c tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:48.580612 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-940eed7f-035b-4567-b78f-cfa4ce3ce14c tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:48.581863 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-940eed7f-035b-4567-b78f-cfa4ce3ce14c tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:48.582576 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-940eed7f-035b-4567-b78f-cfa4ce3ce14c tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:48.700639 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ccfff4c2-ce3e-4316-8a73-872e0e08dcd5 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:48.737140 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ccfff4c2-ce3e-4316-8a73-872e0e08dcd5 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d" status: 200 len: 1496 microversion: 2.1 time: 0.661963 Sep 08 10:44:48.744197 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 883/1746] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:48 2022] GET /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d => generated 1496 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:48.754202 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fb6c740e-47c4-4d6f-9f47-195b32a48b5e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:48.755167 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fb6c740e-47c4-4d6f-9f47-195b32a48b5e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: a3a6ce0f-e362-4cbc-afc2-3cfd349a4812] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:48.767346 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb6c740e-47c4-4d6f-9f47-195b32a48b5e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:48.771805 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb6c740e-47c4-4d6f-9f47-195b32a48b5e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:48.774051 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb6c740e-47c4-4d6f-9f47-195b32a48b5e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:48.776275 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb6c740e-47c4-4d6f-9f47-195b32a48b5e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:48.778548 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb6c740e-47c4-4d6f-9f47-195b32a48b5e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:48.780409 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb6c740e-47c4-4d6f-9f47-195b32a48b5e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:48.887430 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb6c740e-47c4-4d6f-9f47-195b32a48b5e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:48.888608 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb6c740e-47c4-4d6f-9f47-195b32a48b5e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:48.889540 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb6c740e-47c4-4d6f-9f47-195b32a48b5e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:48.890211 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-fb6c740e-47c4-4d6f-9f47-195b32a48b5e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lazy-loading 'fault' on Instance uuid a3a6ce0f-e362-4cbc-afc2-3cfd349a4812 {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:44:48.998221 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-fb6c740e-47c4-4d6f-9f47-195b32a48b5e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:49.011101 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-940eed7f-035b-4567-b78f-cfa4ce3ce14c tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7415a5b46c4587a8806661b70e3913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604588959944720923ec2d5e0bf81c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:49.013442 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fb6c740e-47c4-4d6f-9f47-195b32a48b5e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812" status: 200 len: 1368 microversion: 2.1 time: 0.267863 Sep 08 10:44:49.015130 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 884/1747] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:48 2022] GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812 => generated 1368 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:49.027309 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-96fff880-fe43-47f6-8476-6a2cdd180ebc tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:49.030840 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-96fff880-fe43-47f6-8476-6a2cdd180ebc tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: f9f308fa-d4a6-4ac9-8c64-927e082b0b4a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:49.037919 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-940eed7f-035b-4567-b78f-cfa4ce3ce14c tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/servers/dac27157-b08e-4f13-b97e-3c5b653bd0b3" status: 200 len: 1466 microversion: 2.1 time: 0.509361 Sep 08 10:44:49.038516 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 864/1748] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:48 2022] GET /compute/v2.1/servers/dac27157-b08e-4f13-b97e-3c5b653bd0b3 => generated 1466 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:49.045654 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-96fff880-fe43-47f6-8476-6a2cdd180ebc tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:49.046119 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-96fff880-fe43-47f6-8476-6a2cdd180ebc tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:49.046627 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-96fff880-fe43-47f6-8476-6a2cdd180ebc tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:49.047690 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-96fff880-fe43-47f6-8476-6a2cdd180ebc tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:49.048057 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-96fff880-fe43-47f6-8476-6a2cdd180ebc tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:49.048501 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-96fff880-fe43-47f6-8476-6a2cdd180ebc tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:49.051071 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-4b1fe20f-4366-4620-9346-95e127361574 req-18bf8ef4-0189-4613-87ab-051caf4ec642 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9f308fa-d4a6-4ac9-8c64-927e082b0b4a", "name": "network-vif-plugged", "status": "completed", "tag": "113493e8-8f02-4099-b529-0616d267ed77"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:44:49.066776 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-4b1fe20f-4366-4620-9346-95e127361574 req-18bf8ef4-0189-4613-87ab-051caf4ec642 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:49.067475 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-4b1fe20f-4366-4620-9346-95e127361574 req-18bf8ef4-0189-4613-87ab-051caf4ec642 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:49.070703 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-4b1fe20f-4366-4620-9346-95e127361574 req-18bf8ef4-0189-4613-87ab-051caf4ec642 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:49.086470 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-4b1fe20f-4366-4620-9346-95e127361574 req-18bf8ef4-0189-4613-87ab-051caf4ec642 service nova] Creating event network-vif-plugged:113493e8-8f02-4099-b529-0616d267ed77 for instance f9f308fa-d4a6-4ac9-8c64-927e082b0b4a on n-h1-850501-12 Sep 08 10:44:49.092506 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-4b1fe20f-4366-4620-9346-95e127361574 req-18bf8ef4-0189-4613-87ab-051caf4ec642 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050443 Sep 08 10:44:49.093741 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 865/1749] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:44:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:44:49.100652 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-03cc6f78-5eac-4b87-8f9d-0995ba6ffd2d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:49.102044 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-03cc6f78-5eac-4b87-8f9d-0995ba6ffd2d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: cf3b6c0e-d390-44d6-91e5-09b389dff551] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:49.110081 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03cc6f78-5eac-4b87-8f9d-0995ba6ffd2d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:49.110680 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03cc6f78-5eac-4b87-8f9d-0995ba6ffd2d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:49.111681 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03cc6f78-5eac-4b87-8f9d-0995ba6ffd2d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:49.112924 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03cc6f78-5eac-4b87-8f9d-0995ba6ffd2d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:49.113389 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03cc6f78-5eac-4b87-8f9d-0995ba6ffd2d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:49.114265 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03cc6f78-5eac-4b87-8f9d-0995ba6ffd2d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:49.654244 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-96fff880-fe43-47f6-8476-6a2cdd180ebc tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:49.676374 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-96fff880-fe43-47f6-8476-6a2cdd180ebc tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a" status: 200 len: 1315 microversion: 2.1 time: 0.653980 Sep 08 10:44:49.679045 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 885/1750] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:49 2022] GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a => generated 1315 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:49.686947 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c78d5529-5fb8-41d0-9bed-b4910d5aa8cc tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:49.687721 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c78d5529-5fb8-41d0-9bed-b4910d5aa8cc tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] [instance: bf82fb33-6e90-4830-aa0e-5bff7fa782ba] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:49.695494 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c78d5529-5fb8-41d0-9bed-b4910d5aa8cc tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:49.696110 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c78d5529-5fb8-41d0-9bed-b4910d5aa8cc tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:49.696527 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c78d5529-5fb8-41d0-9bed-b4910d5aa8cc tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:49.697388 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c78d5529-5fb8-41d0-9bed-b4910d5aa8cc tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:49.698145 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c78d5529-5fb8-41d0-9bed-b4910d5aa8cc tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:49.699024 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c78d5529-5fb8-41d0-9bed-b4910d5aa8cc tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:49.997829 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-03cc6f78-5eac-4b87-8f9d-0995ba6ffd2d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:50.015240 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-03cc6f78-5eac-4b87-8f9d-0995ba6ffd2d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:50.018385 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-03cc6f78-5eac-4b87-8f9d-0995ba6ffd2d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:50.020859 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-03cc6f78-5eac-4b87-8f9d-0995ba6ffd2d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551" status: 200 len: 1487 microversion: 2.25 time: 0.925466 Sep 08 10:44:50.021826 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 866/1751] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:44:49 2022] GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551 => generated 1487 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:44:50.040099 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-00badcd0-a4d6-4522-b67a-265b461a451e tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-768352641"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:44:50.046124 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-00badcd0-a4d6-4522-b67a-265b461a451e tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] [instance: 3e6be670-294f-417f-a909-57c481faaf40] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:50.046704 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c78d5529-5fb8-41d0-9bed-b4910d5aa8cc tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173621608ea149b4b401f2da7351597a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de50a647dfb24b13945df8851e766db7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:50.063672 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c78d5529-5fb8-41d0-9bed-b4910d5aa8cc tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] 10.222.0.27 "GET /compute/v2.1/servers/bf82fb33-6e90-4830-aa0e-5bff7fa782ba" status: 200 len: 1526 microversion: 2.1 time: 0.380861 Sep 08 10:44:50.075632 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 886/1752] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:49 2022] GET /compute/v2.1/servers/bf82fb33-6e90-4830-aa0e-5bff7fa782ba => generated 1526 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:50.075632 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-99cf7f2c-dfa9-497a-a2c9-9146eb5862c3 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:50.075632 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-99cf7f2c-dfa9-497a-a2c9-9146eb5862c3 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 90974422-0d77-4970-9e94-ed6b3376ed29] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:50.076478 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00badcd0-a4d6-4522-b67a-265b461a451e tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:50.076478 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00badcd0-a4d6-4522-b67a-265b461a451e tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:50.079788 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00badcd0-a4d6-4522-b67a-265b461a451e tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:50.079788 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00badcd0-a4d6-4522-b67a-265b461a451e tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:50.080548 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00badcd0-a4d6-4522-b67a-265b461a451e tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:50.081847 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00badcd0-a4d6-4522-b67a-265b461a451e tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:50.088468 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-99cf7f2c-dfa9-497a-a2c9-9146eb5862c3 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:50.089693 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-99cf7f2c-dfa9-497a-a2c9-9146eb5862c3 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:50.090636 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-99cf7f2c-dfa9-497a-a2c9-9146eb5862c3 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:50.092312 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-99cf7f2c-dfa9-497a-a2c9-9146eb5862c3 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:50.095901 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-99cf7f2c-dfa9-497a-a2c9-9146eb5862c3 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:50.097002 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-99cf7f2c-dfa9-497a-a2c9-9146eb5862c3 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:50.444745 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-99cf7f2c-dfa9-497a-a2c9-9146eb5862c3 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:50.454311 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-00badcd0-a4d6-4522-b67a-265b461a451e tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "POST /compute/v2.1/servers/3e6be670-294f-417f-a909-57c481faaf40/action" status: 202 len: 0 microversion: 2.1 time: 0.429627 Sep 08 10:44:50.461978 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 867/1753] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:44:50 2022] POST /compute/v2.1/servers/3e6be670-294f-417f-a909-57c481faaf40/action => generated 0 bytes in 433 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 08 10:44:50.467178 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-99cf7f2c-dfa9-497a-a2c9-9146eb5862c3 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29" status: 200 len: 1391 microversion: 2.1 time: 0.400854 Sep 08 10:44:50.469283 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 887/1754] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:50 2022] GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29 => generated 1391 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:50.482318 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-74e8d8bb-bfc0-4335-90d3-eac4ce2a3eb9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:50.483199 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a263b867-10cc-4bd6-87fa-c96eacbd5c7f tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:50.483694 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-74e8d8bb-bfc0-4335-90d3-eac4ce2a3eb9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: a3a6ce0f-e362-4cbc-afc2-3cfd349a4812] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:50.488715 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a263b867-10cc-4bd6-87fa-c96eacbd5c7f tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 64c88fa0-6a01-42fc-b0e9-98b9e84a199d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:50.495702 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-74e8d8bb-bfc0-4335-90d3-eac4ce2a3eb9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:50.496500 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-74e8d8bb-bfc0-4335-90d3-eac4ce2a3eb9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:50.497548 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-74e8d8bb-bfc0-4335-90d3-eac4ce2a3eb9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:50.498891 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-74e8d8bb-bfc0-4335-90d3-eac4ce2a3eb9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:50.499493 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-74e8d8bb-bfc0-4335-90d3-eac4ce2a3eb9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:50.499994 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-74e8d8bb-bfc0-4335-90d3-eac4ce2a3eb9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:50.523536 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a263b867-10cc-4bd6-87fa-c96eacbd5c7f tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:50.524386 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a263b867-10cc-4bd6-87fa-c96eacbd5c7f tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:50.524997 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a263b867-10cc-4bd6-87fa-c96eacbd5c7f tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:50.525906 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a263b867-10cc-4bd6-87fa-c96eacbd5c7f tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:50.536713 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a263b867-10cc-4bd6-87fa-c96eacbd5c7f tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:50.537777 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a263b867-10cc-4bd6-87fa-c96eacbd5c7f tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:50.572605 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-74e8d8bb-bfc0-4335-90d3-eac4ce2a3eb9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:50.573491 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-74e8d8bb-bfc0-4335-90d3-eac4ce2a3eb9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:50.574413 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-74e8d8bb-bfc0-4335-90d3-eac4ce2a3eb9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:50.575714 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-74e8d8bb-bfc0-4335-90d3-eac4ce2a3eb9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lazy-loading 'fault' on Instance uuid a3a6ce0f-e362-4cbc-afc2-3cfd349a4812 {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:44:50.656454 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-74e8d8bb-bfc0-4335-90d3-eac4ce2a3eb9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:50.670898 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-74e8d8bb-bfc0-4335-90d3-eac4ce2a3eb9 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812" status: 200 len: 1368 microversion: 2.1 time: 0.199434 Sep 08 10:44:50.689725 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 888/1755] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:50 2022] GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812 => generated 1368 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:50.698571 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-4577a710-7f31-4e73-9567-f5c8a3032803 req-4ccd8628-1bd5-48b0-9512-fe144037a44a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf3b6c0e-d390-44d6-91e5-09b389dff551", "name": "network-vif-unplugged", "status": "completed", "tag": "1744beb8-80b4-4c92-8ebb-bb2e04113c75"}, {"name": "network-changed", "server_uuid": "cf3b6c0e-d390-44d6-91e5-09b389dff551", "tag": "1744beb8-80b4-4c92-8ebb-bb2e04113c75"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:44:50.711478 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-4577a710-7f31-4e73-9567-f5c8a3032803 req-4ccd8628-1bd5-48b0-9512-fe144037a44a service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:50.712435 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-4577a710-7f31-4e73-9567-f5c8a3032803 req-4ccd8628-1bd5-48b0-9512-fe144037a44a service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:50.713151 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-4577a710-7f31-4e73-9567-f5c8a3032803 req-4ccd8628-1bd5-48b0-9512-fe144037a44a service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:50.727669 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-4577a710-7f31-4e73-9567-f5c8a3032803 req-4ccd8628-1bd5-48b0-9512-fe144037a44a service nova] Creating event network-vif-unplugged:1744beb8-80b4-4c92-8ebb-bb2e04113c75 for instance cf3b6c0e-d390-44d6-91e5-09b389dff551 on n-h2-850501-12 Sep 08 10:44:50.729405 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-4577a710-7f31-4e73-9567-f5c8a3032803 req-4ccd8628-1bd5-48b0-9512-fe144037a44a service nova] Creating event network-changed:1744beb8-80b4-4c92-8ebb-bb2e04113c75 for instance cf3b6c0e-d390-44d6-91e5-09b389dff551 on n-h2-850501-12 Sep 08 10:44:50.736229 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-4577a710-7f31-4e73-9567-f5c8a3032803 req-4ccd8628-1bd5-48b0-9512-fe144037a44a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.044879 Sep 08 10:44:50.737500 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 889/1756] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:44:50 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:44:50.743918 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-eaf2b90e-ca01-434c-8d71-5b561e114b5c tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:50.744978 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-eaf2b90e-ca01-434c-8d71-5b561e114b5c tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] [instance: bf82fb33-6e90-4830-aa0e-5bff7fa782ba] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:50.755551 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eaf2b90e-ca01-434c-8d71-5b561e114b5c tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:50.756477 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eaf2b90e-ca01-434c-8d71-5b561e114b5c tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:50.757403 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eaf2b90e-ca01-434c-8d71-5b561e114b5c tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:50.759197 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eaf2b90e-ca01-434c-8d71-5b561e114b5c tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:50.760514 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eaf2b90e-ca01-434c-8d71-5b561e114b5c tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:50.761318 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eaf2b90e-ca01-434c-8d71-5b561e114b5c tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:51.019933 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-eaf2b90e-ca01-434c-8d71-5b561e114b5c tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173621608ea149b4b401f2da7351597a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de50a647dfb24b13945df8851e766db7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:51.033712 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-eaf2b90e-ca01-434c-8d71-5b561e114b5c tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] 10.222.0.27 "GET /compute/v2.1/servers/bf82fb33-6e90-4830-aa0e-5bff7fa782ba" status: 200 len: 1526 microversion: 2.1 time: 0.294085 Sep 08 10:44:51.035647 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 890/1757] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:50 2022] GET /compute/v2.1/servers/bf82fb33-6e90-4830-aa0e-5bff7fa782ba => generated 1526 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:51.043574 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-46b0600a-edd0-4a2d-853e-f4a2c7d592f1 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '.version_select at 0x7f68e520adc0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:51.136878 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-46b0600a-edd0-4a2d-853e-f4a2c7d592f1 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/images/42339e5a-aebb-4b85-90de-86145010398d" status: 200 len: 1452 microversion: 2.1 time: 0.099512 Sep 08 10:44:51.144044 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 891/1758] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:44:51 2022] GET /compute/v2.1/images/42339e5a-aebb-4b85-90de-86145010398d => generated 1452 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:51.151455 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-16a84afc-203e-4263-8340-1ecbf768528f tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:51.152818 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-16a84afc-203e-4263-8340-1ecbf768528f tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: f9f308fa-d4a6-4ac9-8c64-927e082b0b4a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:51.167199 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-16a84afc-203e-4263-8340-1ecbf768528f tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:51.168506 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-16a84afc-203e-4263-8340-1ecbf768528f tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:51.169420 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-16a84afc-203e-4263-8340-1ecbf768528f tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:51.171713 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-16a84afc-203e-4263-8340-1ecbf768528f tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:51.172785 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-16a84afc-203e-4263-8340-1ecbf768528f tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:51.174444 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-16a84afc-203e-4263-8340-1ecbf768528f tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:51.272203 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a263b867-10cc-4bd6-87fa-c96eacbd5c7f tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:51.294144 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a263b867-10cc-4bd6-87fa-c96eacbd5c7f tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d" status: 200 len: 1496 microversion: 2.1 time: 0.835302 Sep 08 10:44:51.295650 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 868/1759] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:50 2022] GET /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d => generated 1496 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:51.306047 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1652d474-9e81-4741-877e-96ac8b130ac2 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:51.308417 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1652d474-9e81-4741-877e-96ac8b130ac2 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: cf3b6c0e-d390-44d6-91e5-09b389dff551] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:51.322032 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1652d474-9e81-4741-877e-96ac8b130ac2 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:51.323455 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1652d474-9e81-4741-877e-96ac8b130ac2 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:51.324321 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1652d474-9e81-4741-877e-96ac8b130ac2 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:51.326704 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1652d474-9e81-4741-877e-96ac8b130ac2 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:51.327500 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1652d474-9e81-4741-877e-96ac8b130ac2 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:51.328159 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1652d474-9e81-4741-877e-96ac8b130ac2 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:51.476945 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-16a84afc-203e-4263-8340-1ecbf768528f tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:51.486716 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-16a84afc-203e-4263-8340-1ecbf768528f tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a" status: 200 len: 1315 microversion: 2.1 time: 0.340613 Sep 08 10:44:51.487333 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 892/1760] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:51 2022] GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a => generated 1315 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:51.568814 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4bcf939b-df72-4c0a-a63b-038c8bc85f88 tempest-ServersNegativeTestMultiTenantJSON-1698363586 tempest-ServersNegativeTestMultiTenantJSON-1698363586-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:51.569438 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4bcf939b-df72-4c0a-a63b-038c8bc85f88 tempest-ServersNegativeTestMultiTenantJSON-1698363586 tempest-ServersNegativeTestMultiTenantJSON-1698363586-project] [instance: bf82fb33-6e90-4830-aa0e-5bff7fa782ba] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:51.578156 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4bcf939b-df72-4c0a-a63b-038c8bc85f88 tempest-ServersNegativeTestMultiTenantJSON-1698363586 tempest-ServersNegativeTestMultiTenantJSON-1698363586-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:51.578655 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4bcf939b-df72-4c0a-a63b-038c8bc85f88 tempest-ServersNegativeTestMultiTenantJSON-1698363586 tempest-ServersNegativeTestMultiTenantJSON-1698363586-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:51.580256 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4bcf939b-df72-4c0a-a63b-038c8bc85f88 tempest-ServersNegativeTestMultiTenantJSON-1698363586 tempest-ServersNegativeTestMultiTenantJSON-1698363586-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:51.581306 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4bcf939b-df72-4c0a-a63b-038c8bc85f88 tempest-ServersNegativeTestMultiTenantJSON-1698363586 tempest-ServersNegativeTestMultiTenantJSON-1698363586-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:51.581868 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4bcf939b-df72-4c0a-a63b-038c8bc85f88 tempest-ServersNegativeTestMultiTenantJSON-1698363586 tempest-ServersNegativeTestMultiTenantJSON-1698363586-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:51.582257 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4bcf939b-df72-4c0a-a63b-038c8bc85f88 tempest-ServersNegativeTestMultiTenantJSON-1698363586 tempest-ServersNegativeTestMultiTenantJSON-1698363586-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:51.605558 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-4bcf939b-df72-4c0a-a63b-038c8bc85f88 tempest-ServersNegativeTestMultiTenantJSON-1698363586 tempest-ServersNegativeTestMultiTenantJSON-1698363586-project] HTTP exception thrown: Instance bf82fb33-6e90-4830-aa0e-5bff7fa782ba could not be found. Sep 08 10:44:51.610098 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4bcf939b-df72-4c0a-a63b-038c8bc85f88 tempest-ServersNegativeTestMultiTenantJSON-1698363586 tempest-ServersNegativeTestMultiTenantJSON-1698363586-project] Request method failure captured: Sep 08 10:44:51.610098 n-d-850501-12 devstack@n-api.service[128861]: request: DELETE /compute/v2.1/servers/bf82fb33-6e90-4830-aa0e-5bff7fa782ba HTTP/1.1 Sep 08 10:44:51.610098 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:44:51.610098 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:44:51.610098 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:44:51.610098 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:44:51.610098 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:44:51.610098 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:44:51.610098 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:44:51.610098 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:44:51.610098 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGceCPyQ3C9DZATCLVmmRKelGRCcoAHjOl-KTRTlTsC6M1v2J6hT7SMXjZ5vW0nu4CUZBnYcmm1z4Ke2e01Qw_tMFslgs4of5G398GWDi3BV5dqxnIvrt5sRcERBU9j6QWBPnkiV4Xgu4rXc9fZrHUyQqOfLGJVyhAJThXSsXBbQ1kgw Sep 08 10:44:51.610098 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:44:51.610098 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:44:51.610098 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:44:51.610098 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:44:51.610098 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:44:51.610098 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:44:51.610098 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 931c658cd4184c77a57beef6367fbc1a Sep 08 10:44:51.610098 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1698363586 Sep 08 10:44:51.610098 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:44:51.610098 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:44:51.610098 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/931c658cd4184c77a57beef6367fbc1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/931c658cd4184c77a57beef6367fbc1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_931c658cd4184c77a57beef6367fbc1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/931c658cd4184c77a57beef6367fbc1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:44:51.610098 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1698363586 Sep 08 10:44:51.610098 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 931c658cd4184c77a57beef6367fbc1a Sep 08 10:44:51.610098 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1698363586 Sep 08 10:44:51.610098 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1698363586-project Sep 08 10:44:51.610098 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:44:51.610098 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:44:51.610098 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: a30e6c6acdde43269d363b6c73aad19d Sep 08 10:44:51.610098 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1698363586-project Sep 08 10:44:51.610098 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:44:51.610098 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance bf82fb33-6e90-4830-aa0e-5bff7fa782ba could not be found. Sep 08 10:44:51.610098 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': 'bf82fb33-6e90-4830-aa0e-5bff7fa782ba'} Sep 08 10:44:51.610098 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:44:51.610098 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:44:51.610098 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:44:51.610098 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:44:51.610098 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:44:51.610098 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:44:51.610098 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:44:51.610098 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:44:51.610098 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:44:51.610098 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:44:51.610098 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf82fb33-6e90-4830-aa0e-5bff7fa782ba could not be found. Sep 08 10:44:51.610098 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:44:51.610098 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:44:51.610098 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:44:51.610098 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:44:51.610098 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:44:51.610098 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:44:51.610098 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:44:51.610098 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:44:51.610098 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:44:51.610098 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:44:51.610098 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:44:51.610098 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:44:51.610098 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:44:51.610098 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:44:51.610098 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:44:51.610098 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:44:51.610098 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:44:51.610098 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:44:51.623229 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf82fb33-6e90-4830-aa0e-5bff7fa782ba could not be found. Sep 08 10:44:51.623229 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:44:51.623229 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:44:51.623229 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:44:51.623229 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:44:51.623229 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:44:51.623229 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:44:51.623229 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:44:51.623229 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:44:51.623229 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf82fb33-6e90-4830-aa0e-5bff7fa782ba could not be found. Sep 08 10:44:51.623229 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:44:51.623229 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4bcf939b-df72-4c0a-a63b-038c8bc85f88 tempest-ServersNegativeTestMultiTenantJSON-1698363586 tempest-ServersNegativeTestMultiTenantJSON-1698363586-project] Returning 404 to user: Instance bf82fb33-6e90-4830-aa0e-5bff7fa782ba could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:44:51.623229 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4bcf939b-df72-4c0a-a63b-038c8bc85f88 tempest-ServersNegativeTestMultiTenantJSON-1698363586 tempest-ServersNegativeTestMultiTenantJSON-1698363586-project] 10.222.0.27 "DELETE /compute/v2.1/servers/bf82fb33-6e90-4830-aa0e-5bff7fa782ba" status: 404 len: 111 microversion: 2.1 time: 0.124343 Sep 08 10:44:51.623229 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 893/1761] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:44:51 2022] DELETE /compute/v2.1/servers/bf82fb33-6e90-4830-aa0e-5bff7fa782ba => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:44:51.627200 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-b9d99a0c-f70e-4f16-a2cd-2bb9452b6f74 req-6890d0c6-78fe-4b7f-8f67-62e09fa96cd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dac27157-b08e-4f13-b97e-3c5b653bd0b3", "name": "network-vif-unplugged", "status": "completed", "tag": "0ad27959-ff24-48b6-9469-c1b114584c1e"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:44:51.646873 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-b9d99a0c-f70e-4f16-a2cd-2bb9452b6f74 req-6890d0c6-78fe-4b7f-8f67-62e09fa96cd0 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:51.648942 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-b9d99a0c-f70e-4f16-a2cd-2bb9452b6f74 req-6890d0c6-78fe-4b7f-8f67-62e09fa96cd0 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:51.649849 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-b9d99a0c-f70e-4f16-a2cd-2bb9452b6f74 req-6890d0c6-78fe-4b7f-8f67-62e09fa96cd0 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:51.675905 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-b9d99a0c-f70e-4f16-a2cd-2bb9452b6f74 req-6890d0c6-78fe-4b7f-8f67-62e09fa96cd0 service nova] Creating event network-vif-unplugged:0ad27959-ff24-48b6-9469-c1b114584c1e for instance dac27157-b08e-4f13-b97e-3c5b653bd0b3 on n-h1-850501-12 Sep 08 10:44:51.684996 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-b9d99a0c-f70e-4f16-a2cd-2bb9452b6f74 req-6890d0c6-78fe-4b7f-8f67-62e09fa96cd0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067367 Sep 08 10:44:51.686432 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 894/1762] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:44:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:44:51.699581 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4257787e-b79a-4300-b554-1b9c176f837d tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:51.699581 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4257787e-b79a-4300-b554-1b9c176f837d tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 90974422-0d77-4970-9e94-ed6b3376ed29] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:51.716033 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4257787e-b79a-4300-b554-1b9c176f837d tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:51.717468 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4257787e-b79a-4300-b554-1b9c176f837d tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:51.718098 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4257787e-b79a-4300-b554-1b9c176f837d tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:51.719294 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4257787e-b79a-4300-b554-1b9c176f837d tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:51.719895 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4257787e-b79a-4300-b554-1b9c176f837d tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:51.720439 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4257787e-b79a-4300-b554-1b9c176f837d tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:51.846469 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1652d474-9e81-4741-877e-96ac8b130ac2 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:51.879871 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1652d474-9e81-4741-877e-96ac8b130ac2 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:51.883945 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1652d474-9e81-4741-877e-96ac8b130ac2 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:51.887445 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1652d474-9e81-4741-877e-96ac8b130ac2 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551" status: 200 len: 1487 microversion: 2.25 time: 0.589383 Sep 08 10:44:51.889842 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 869/1763] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:44:51 2022] GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551 => generated 1487 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:44:51.907856 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-79109917-ed40-459f-a113-9e7fd0fbdcd1 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:51.910139 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-79109917-ed40-459f-a113-9e7fd0fbdcd1 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] [instance: bf82fb33-6e90-4830-aa0e-5bff7fa782ba] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:51.931481 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-79109917-ed40-459f-a113-9e7fd0fbdcd1 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:51.932885 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-79109917-ed40-459f-a113-9e7fd0fbdcd1 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:51.933917 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-79109917-ed40-459f-a113-9e7fd0fbdcd1 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:51.936295 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-79109917-ed40-459f-a113-9e7fd0fbdcd1 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:51.937727 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-79109917-ed40-459f-a113-9e7fd0fbdcd1 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:51.938842 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-79109917-ed40-459f-a113-9e7fd0fbdcd1 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:52.042799 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4257787e-b79a-4300-b554-1b9c176f837d tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:52.063534 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4257787e-b79a-4300-b554-1b9c176f837d tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29" status: 200 len: 1391 microversion: 2.1 time: 0.374909 Sep 08 10:44:52.065502 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 895/1764] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:51 2022] GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29 => generated 1391 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:52.075768 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-dc3f84b2-d9a6-41e7-888e-a6d9e5efdac2 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:52.077385 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-dc3f84b2-d9a6-41e7-888e-a6d9e5efdac2 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: a3a6ce0f-e362-4cbc-afc2-3cfd349a4812] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:52.093510 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dc3f84b2-d9a6-41e7-888e-a6d9e5efdac2 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:52.094987 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dc3f84b2-d9a6-41e7-888e-a6d9e5efdac2 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:52.103894 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dc3f84b2-d9a6-41e7-888e-a6d9e5efdac2 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:52.106031 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dc3f84b2-d9a6-41e7-888e-a6d9e5efdac2 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:52.107527 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dc3f84b2-d9a6-41e7-888e-a6d9e5efdac2 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:52.108691 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dc3f84b2-d9a6-41e7-888e-a6d9e5efdac2 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:52.205949 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dc3f84b2-d9a6-41e7-888e-a6d9e5efdac2 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:52.208656 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dc3f84b2-d9a6-41e7-888e-a6d9e5efdac2 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:52.209821 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dc3f84b2-d9a6-41e7-888e-a6d9e5efdac2 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:52.213348 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-dc3f84b2-d9a6-41e7-888e-a6d9e5efdac2 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lazy-loading 'fault' on Instance uuid a3a6ce0f-e362-4cbc-afc2-3cfd349a4812 {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:44:52.298335 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-dc3f84b2-d9a6-41e7-888e-a6d9e5efdac2 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:52.311063 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-dc3f84b2-d9a6-41e7-888e-a6d9e5efdac2 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812" status: 200 len: 1368 microversion: 2.1 time: 0.243570 Sep 08 10:44:52.318186 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 896/1765] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:52 2022] GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812 => generated 1368 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:52.322951 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7e700a3b-4397-4310-920b-4e5b87d430f8 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '.version_select at 0x7f68e48c9430>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:52.423670 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7e700a3b-4397-4310-920b-4e5b87d430f8 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/images/42339e5a-aebb-4b85-90de-86145010398d" status: 200 len: 1452 microversion: 2.1 time: 0.109146 Sep 08 10:44:52.435878 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 897/1766] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:44:52 2022] GET /compute/v2.1/images/42339e5a-aebb-4b85-90de-86145010398d => generated 1452 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:52.448415 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-79109917-ed40-459f-a113-9e7fd0fbdcd1 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173621608ea149b4b401f2da7351597a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de50a647dfb24b13945df8851e766db7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:52.452396 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-58523ac3-d63c-4188-ac40-d47011c8618d tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:52.453918 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-58523ac3-d63c-4188-ac40-d47011c8618d tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 64c88fa0-6a01-42fc-b0e9-98b9e84a199d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:52.466910 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-58523ac3-d63c-4188-ac40-d47011c8618d tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:52.467866 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-58523ac3-d63c-4188-ac40-d47011c8618d tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:52.468778 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-58523ac3-d63c-4188-ac40-d47011c8618d tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:52.470153 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-58523ac3-d63c-4188-ac40-d47011c8618d tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:52.470901 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-58523ac3-d63c-4188-ac40-d47011c8618d tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:52.471619 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-58523ac3-d63c-4188-ac40-d47011c8618d tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:52.475490 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-79109917-ed40-459f-a113-9e7fd0fbdcd1 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] 10.222.0.27 "GET /compute/v2.1/servers/bf82fb33-6e90-4830-aa0e-5bff7fa782ba" status: 200 len: 1526 microversion: 2.1 time: 0.583416 Sep 08 10:44:52.486897 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 870/1767] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:51 2022] GET /compute/v2.1/servers/bf82fb33-6e90-4830-aa0e-5bff7fa782ba => generated 1526 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:52.518245 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8245074e-db11-4efa-b05b-bb55078204b7 tempest-ServersNegativeTestMultiTenantJSON-1698363586 tempest-ServersNegativeTestMultiTenantJSON-1698363586-project] Action: 'update', calling method: >, body: {"server": {"name": "bf82fb33-6e90-4830-aa0e-5bff7fa782ba_new"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:44:52.527449 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8245074e-db11-4efa-b05b-bb55078204b7 tempest-ServersNegativeTestMultiTenantJSON-1698363586 tempest-ServersNegativeTestMultiTenantJSON-1698363586-project] [instance: bf82fb33-6e90-4830-aa0e-5bff7fa782ba] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:52.544416 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:44:52.550460 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8245074e-db11-4efa-b05b-bb55078204b7 tempest-ServersNegativeTestMultiTenantJSON-1698363586 tempest-ServersNegativeTestMultiTenantJSON-1698363586-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:52.572416 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8245074e-db11-4efa-b05b-bb55078204b7 tempest-ServersNegativeTestMultiTenantJSON-1698363586 tempest-ServersNegativeTestMultiTenantJSON-1698363586-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:52.574307 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8245074e-db11-4efa-b05b-bb55078204b7 tempest-ServersNegativeTestMultiTenantJSON-1698363586 tempest-ServersNegativeTestMultiTenantJSON-1698363586-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:52.576490 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8245074e-db11-4efa-b05b-bb55078204b7 tempest-ServersNegativeTestMultiTenantJSON-1698363586 tempest-ServersNegativeTestMultiTenantJSON-1698363586-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:52.579672 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8245074e-db11-4efa-b05b-bb55078204b7 tempest-ServersNegativeTestMultiTenantJSON-1698363586 tempest-ServersNegativeTestMultiTenantJSON-1698363586-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:52.581631 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8245074e-db11-4efa-b05b-bb55078204b7 tempest-ServersNegativeTestMultiTenantJSON-1698363586 tempest-ServersNegativeTestMultiTenantJSON-1698363586-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:52.649839 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:44:52.660312 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-8245074e-db11-4efa-b05b-bb55078204b7 tempest-ServersNegativeTestMultiTenantJSON-1698363586 tempest-ServersNegativeTestMultiTenantJSON-1698363586-project] HTTP exception thrown: Instance bf82fb33-6e90-4830-aa0e-5bff7fa782ba could not be found. Sep 08 10:44:52.666691 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8245074e-db11-4efa-b05b-bb55078204b7 tempest-ServersNegativeTestMultiTenantJSON-1698363586 tempest-ServersNegativeTestMultiTenantJSON-1698363586-project] Request method failure captured: Sep 08 10:44:52.666691 n-d-850501-12 devstack@n-api.service[128862]: request: PUT /compute/v2.1/servers/bf82fb33-6e90-4830-aa0e-5bff7fa782ba HTTP/1.1 Sep 08 10:44:52.666691 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:44:52.666691 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:44:52.666691 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:44:52.666691 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 64 Sep 08 10:44:52.666691 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:44:52.666691 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:44:52.666691 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:44:52.666691 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:44:52.666691 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGceCPyQ3C9DZATCLVmmRKelGRCcoAHjOl-KTRTlTsC6M1v2J6hT7SMXjZ5vW0nu4CUZBnYcmm1z4Ke2e01Qw_tMFslgs4of5G398GWDi3BV5dqxnIvrt5sRcERBU9j6QWBPnkiV4Xgu4rXc9fZrHUyQqOfLGJVyhAJThXSsXBbQ1kgw Sep 08 10:44:52.666691 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:44:52.666691 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:44:52.666691 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:44:52.666691 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:44:52.666691 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:44:52.666691 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:44:52.666691 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 931c658cd4184c77a57beef6367fbc1a Sep 08 10:44:52.666691 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1698363586 Sep 08 10:44:52.666691 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:44:52.666691 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:44:52.666691 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/931c658cd4184c77a57beef6367fbc1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/931c658cd4184c77a57beef6367fbc1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_931c658cd4184c77a57beef6367fbc1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/931c658cd4184c77a57beef6367fbc1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:44:52.666691 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1698363586 Sep 08 10:44:52.666691 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 931c658cd4184c77a57beef6367fbc1a Sep 08 10:44:52.666691 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1698363586 Sep 08 10:44:52.666691 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1698363586-project Sep 08 10:44:52.666691 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:44:52.666691 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:44:52.666691 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: a30e6c6acdde43269d363b6c73aad19d Sep 08 10:44:52.666691 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1698363586-project Sep 08 10:44:52.666691 n-d-850501-12 devstack@n-api.service[128862]: Sep 08 10:44:52.666691 n-d-850501-12 devstack@n-api.service[128862]: {"server": {"name": "bf82fb33-6e90-4830-aa0e-5bff7fa782ba_new"}} Sep 08 10:44:52.666691 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:44:52.666691 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance bf82fb33-6e90-4830-aa0e-5bff7fa782ba could not be found. Sep 08 10:44:52.666691 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'bf82fb33-6e90-4830-aa0e-5bff7fa782ba', 'body': {'server': {'name': 'bf82fb33-6e90-4830-aa0e-5bff7fa782ba_new'}}} Sep 08 10:44:52.666691 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:44:52.666691 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:44:52.666691 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:44:52.666691 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:44:52.666691 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:44:52.666691 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:44:52.666691 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:44:52.666691 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:44:52.666691 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:44:52.666691 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:44:52.666691 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf82fb33-6e90-4830-aa0e-5bff7fa782ba could not be found. Sep 08 10:44:52.666691 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:44:52.666691 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:44:52.666691 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:44:52.666691 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:44:52.666691 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:44:52.666691 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:44:52.666691 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:44:52.666691 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:44:52.666691 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:44:52.666691 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:44:52.666691 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:44:52.666691 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:44:52.666691 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:44:52.666691 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:44:52.666691 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:44:52.666691 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:44:52.666691 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 08 10:44:52.682112 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Sep 08 10:44:52.682112 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Sep 08 10:44:52.682112 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:44:52.682112 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:44:52.682112 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:44:52.682112 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:44:52.682112 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf82fb33-6e90-4830-aa0e-5bff7fa782ba could not be found. Sep 08 10:44:52.682112 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:44:52.682112 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:44:52.682112 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:44:52.682112 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:44:52.682112 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:44:52.682112 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:44:52.682112 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:44:52.682112 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:44:52.682112 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf82fb33-6e90-4830-aa0e-5bff7fa782ba could not be found. Sep 08 10:44:52.682112 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:44:52.690794 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8245074e-db11-4efa-b05b-bb55078204b7 tempest-ServersNegativeTestMultiTenantJSON-1698363586 tempest-ServersNegativeTestMultiTenantJSON-1698363586-project] Returning 404 to user: Instance bf82fb33-6e90-4830-aa0e-5bff7fa782ba could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:44:52.695749 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8245074e-db11-4efa-b05b-bb55078204b7 tempest-ServersNegativeTestMultiTenantJSON-1698363586 tempest-ServersNegativeTestMultiTenantJSON-1698363586-project] 10.222.0.27 "PUT /compute/v2.1/servers/bf82fb33-6e90-4830-aa0e-5bff7fa782ba" status: 404 len: 111 microversion: 2.1 time: 0.191005 Sep 08 10:44:52.700135 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 871/1768] 10.222.0.27 () {60 vars in 1256 bytes} [Thu Sep 8 10:44:52 2022] PUT /compute/v2.1/servers/bf82fb33-6e90-4830-aa0e-5bff7fa782ba => generated 111 bytes in 197 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:44:52.714640 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6ad29e1c-b8d6-4b10-98f6-530f4002bca2 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:52.716522 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6ad29e1c-b8d6-4b10-98f6-530f4002bca2 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: f9f308fa-d4a6-4ac9-8c64-927e082b0b4a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:52.732506 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ad29e1c-b8d6-4b10-98f6-530f4002bca2 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:52.734610 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ad29e1c-b8d6-4b10-98f6-530f4002bca2 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:52.735435 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ad29e1c-b8d6-4b10-98f6-530f4002bca2 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:52.736690 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ad29e1c-b8d6-4b10-98f6-530f4002bca2 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:52.737600 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ad29e1c-b8d6-4b10-98f6-530f4002bca2 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:52.738292 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ad29e1c-b8d6-4b10-98f6-530f4002bca2 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:52.818582 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-58523ac3-d63c-4188-ac40-d47011c8618d tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:52.842825 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-58523ac3-d63c-4188-ac40-d47011c8618d tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d" status: 200 len: 1496 microversion: 2.1 time: 0.399337 Sep 08 10:44:52.852504 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 898/1769] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:52 2022] GET /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d => generated 1496 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:52.865724 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b408bf6b-1897-4e56-91bc-3743c98de121 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:52.868963 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b408bf6b-1897-4e56-91bc-3743c98de121 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] [instance: bf82fb33-6e90-4830-aa0e-5bff7fa782ba] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:52.914113 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b408bf6b-1897-4e56-91bc-3743c98de121 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:52.915248 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b408bf6b-1897-4e56-91bc-3743c98de121 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:52.916065 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b408bf6b-1897-4e56-91bc-3743c98de121 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:52.917379 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b408bf6b-1897-4e56-91bc-3743c98de121 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:52.918194 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b408bf6b-1897-4e56-91bc-3743c98de121 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:52.919977 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b408bf6b-1897-4e56-91bc-3743c98de121 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:52.931011 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=100 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:44:52.985091 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b408bf6b-1897-4e56-91bc-3743c98de121 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] [instance: bf82fb33-6e90-4830-aa0e-5bff7fa782ba] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:44:53.136659 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6ad29e1c-b8d6-4b10-98f6-530f4002bca2 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:53.151357 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b408bf6b-1897-4e56-91bc-3743c98de121 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] 10.222.0.27 "DELETE /compute/v2.1/servers/bf82fb33-6e90-4830-aa0e-5bff7fa782ba" status: 204 len: 0 microversion: 2.1 time: 0.295801 Sep 08 10:44:53.153065 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 899/1770] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:44:52 2022] DELETE /compute/v2.1/servers/bf82fb33-6e90-4830-aa0e-5bff7fa782ba => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:44:53.165970 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6ad29e1c-b8d6-4b10-98f6-530f4002bca2 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a" status: 200 len: 1315 microversion: 2.1 time: 0.461932 Sep 08 10:44:53.168174 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f388a00e-7670-4ae2-8b3c-dfa6d331c259 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:53.169585 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f388a00e-7670-4ae2-8b3c-dfa6d331c259 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: cf3b6c0e-d390-44d6-91e5-09b389dff551] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:53.174832 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 872/1771] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:52 2022] GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a => generated 1315 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:53.183605 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f388a00e-7670-4ae2-8b3c-dfa6d331c259 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:53.184561 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f388a00e-7670-4ae2-8b3c-dfa6d331c259 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:53.187458 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f388a00e-7670-4ae2-8b3c-dfa6d331c259 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:53.189591 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f388a00e-7670-4ae2-8b3c-dfa6d331c259 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:53.190780 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f388a00e-7670-4ae2-8b3c-dfa6d331c259 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:53.191909 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-837e83e2-b626-4afb-8550-5c85e3a6a847 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:53.192163 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f388a00e-7670-4ae2-8b3c-dfa6d331c259 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:53.198583 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-837e83e2-b626-4afb-8550-5c85e3a6a847 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 90974422-0d77-4970-9e94-ed6b3376ed29] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:53.209116 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-837e83e2-b626-4afb-8550-5c85e3a6a847 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:53.215278 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-837e83e2-b626-4afb-8550-5c85e3a6a847 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:53.216393 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-837e83e2-b626-4afb-8550-5c85e3a6a847 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:53.217501 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-837e83e2-b626-4afb-8550-5c85e3a6a847 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:53.221281 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-837e83e2-b626-4afb-8550-5c85e3a6a847 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:53.229989 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-837e83e2-b626-4afb-8550-5c85e3a6a847 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:53.400488 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f388a00e-7670-4ae2-8b3c-dfa6d331c259 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:53.413914 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f388a00e-7670-4ae2-8b3c-dfa6d331c259 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:53.416592 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f388a00e-7670-4ae2-8b3c-dfa6d331c259 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:53.418820 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f388a00e-7670-4ae2-8b3c-dfa6d331c259 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551" status: 200 len: 1487 microversion: 2.25 time: 0.262629 Sep 08 10:44:53.419801 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 900/1772] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:44:53 2022] GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551 => generated 1487 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:44:53.426192 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-539f0f1c-95aa-4092-b381-6cab8feb5746 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:53.427175 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-539f0f1c-95aa-4092-b381-6cab8feb5746 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] [instance: bf82fb33-6e90-4830-aa0e-5bff7fa782ba] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:53.436537 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-539f0f1c-95aa-4092-b381-6cab8feb5746 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:53.437090 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-539f0f1c-95aa-4092-b381-6cab8feb5746 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:53.437584 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-539f0f1c-95aa-4092-b381-6cab8feb5746 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:53.438574 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-539f0f1c-95aa-4092-b381-6cab8feb5746 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:53.439062 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-539f0f1c-95aa-4092-b381-6cab8feb5746 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:53.439499 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-539f0f1c-95aa-4092-b381-6cab8feb5746 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:53.753910 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-539f0f1c-95aa-4092-b381-6cab8feb5746 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173621608ea149b4b401f2da7351597a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de50a647dfb24b13945df8851e766db7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:53.760277 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-837e83e2-b626-4afb-8550-5c85e3a6a847 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:53.779781 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-539f0f1c-95aa-4092-b381-6cab8feb5746 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] 10.222.0.27 "GET /compute/v2.1/servers/bf82fb33-6e90-4830-aa0e-5bff7fa782ba" status: 200 len: 1532 microversion: 2.1 time: 0.358365 Sep 08 10:44:53.780937 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 901/1773] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:53 2022] GET /compute/v2.1/servers/bf82fb33-6e90-4830-aa0e-5bff7fa782ba => generated 1532 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:53.799027 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-837e83e2-b626-4afb-8550-5c85e3a6a847 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29" status: 200 len: 1391 microversion: 2.1 time: 0.618112 Sep 08 10:44:53.802543 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 873/1774] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:53 2022] GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29 => generated 1391 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:53.814700 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d9928085-d61d-4838-af93-850eb8d8c6f2 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:53.817049 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d9928085-d61d-4838-af93-850eb8d8c6f2 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: a3a6ce0f-e362-4cbc-afc2-3cfd349a4812] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:53.827442 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-800d84e4-5a7e-458b-afcd-cf688f23d6ec tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '.version_select at 0x7f68e485cee0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:53.827803 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d9928085-d61d-4838-af93-850eb8d8c6f2 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:53.828229 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d9928085-d61d-4838-af93-850eb8d8c6f2 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:53.832516 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d9928085-d61d-4838-af93-850eb8d8c6f2 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:53.833471 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d9928085-d61d-4838-af93-850eb8d8c6f2 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:53.833946 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d9928085-d61d-4838-af93-850eb8d8c6f2 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:53.835638 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d9928085-d61d-4838-af93-850eb8d8c6f2 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:53.912678 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d9928085-d61d-4838-af93-850eb8d8c6f2 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:53.913773 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d9928085-d61d-4838-af93-850eb8d8c6f2 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:53.917797 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d9928085-d61d-4838-af93-850eb8d8c6f2 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:53.918573 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-d9928085-d61d-4838-af93-850eb8d8c6f2 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lazy-loading 'fault' on Instance uuid a3a6ce0f-e362-4cbc-afc2-3cfd349a4812 {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:44:53.932365 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-800d84e4-5a7e-458b-afcd-cf688f23d6ec tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/images/42339e5a-aebb-4b85-90de-86145010398d" status: 200 len: 1452 microversion: 2.1 time: 0.127707 Sep 08 10:44:53.936224 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 874/1775] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:44:53 2022] GET /compute/v2.1/images/42339e5a-aebb-4b85-90de-86145010398d => generated 1452 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:53.959880 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f563953c-f1c6-49b1-9439-bfe499ee7af9 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:53.960495 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f563953c-f1c6-49b1-9439-bfe499ee7af9 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 64c88fa0-6a01-42fc-b0e9-98b9e84a199d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:53.974062 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f563953c-f1c6-49b1-9439-bfe499ee7af9 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:53.974569 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f563953c-f1c6-49b1-9439-bfe499ee7af9 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:53.975013 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f563953c-f1c6-49b1-9439-bfe499ee7af9 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:53.975809 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f563953c-f1c6-49b1-9439-bfe499ee7af9 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:53.976298 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f563953c-f1c6-49b1-9439-bfe499ee7af9 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:53.976935 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f563953c-f1c6-49b1-9439-bfe499ee7af9 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:54.004152 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d9928085-d61d-4838-af93-850eb8d8c6f2 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:54.031169 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d9928085-d61d-4838-af93-850eb8d8c6f2 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812" status: 200 len: 1368 microversion: 2.1 time: 0.246809 Sep 08 10:44:54.032158 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 902/1776] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:53 2022] GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812 => generated 1368 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:54.212896 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-191406ef-0816-406e-a742-92fb88daa138 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:54.213837 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-191406ef-0816-406e-a742-92fb88daa138 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: f9f308fa-d4a6-4ac9-8c64-927e082b0b4a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:54.221187 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-191406ef-0816-406e-a742-92fb88daa138 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:54.221996 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-191406ef-0816-406e-a742-92fb88daa138 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:54.222647 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-191406ef-0816-406e-a742-92fb88daa138 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:54.223848 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-191406ef-0816-406e-a742-92fb88daa138 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:54.224505 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-191406ef-0816-406e-a742-92fb88daa138 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:54.225171 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-191406ef-0816-406e-a742-92fb88daa138 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:54.328528 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f563953c-f1c6-49b1-9439-bfe499ee7af9 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:54.346926 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f563953c-f1c6-49b1-9439-bfe499ee7af9 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d" status: 200 len: 1496 microversion: 2.1 time: 0.408830 Sep 08 10:44:54.348768 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 875/1777] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:53 2022] GET /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d => generated 1496 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:54.451940 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-de119fba-57ec-4fbd-8fb2-36b21a3fd0fb tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:54.453325 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-de119fba-57ec-4fbd-8fb2-36b21a3fd0fb tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: cf3b6c0e-d390-44d6-91e5-09b389dff551] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:54.461845 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de119fba-57ec-4fbd-8fb2-36b21a3fd0fb tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:54.462614 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de119fba-57ec-4fbd-8fb2-36b21a3fd0fb tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:54.463348 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de119fba-57ec-4fbd-8fb2-36b21a3fd0fb tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:54.464383 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de119fba-57ec-4fbd-8fb2-36b21a3fd0fb tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:54.465048 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de119fba-57ec-4fbd-8fb2-36b21a3fd0fb tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:54.466860 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de119fba-57ec-4fbd-8fb2-36b21a3fd0fb tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:54.495942 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-191406ef-0816-406e-a742-92fb88daa138 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:54.526646 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-191406ef-0816-406e-a742-92fb88daa138 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a" status: 200 len: 1502 microversion: 2.1 time: 0.318193 Sep 08 10:44:54.531698 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 903/1778] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:54 2022] GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a => generated 1502 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:54.569324 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1f351aa4-7071-4f5d-8b55-1040645ba299 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:44:54.569816 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1f351aa4-7071-4f5d-8b55-1040645ba299 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: f9f308fa-d4a6-4ac9-8c64-927e082b0b4a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:54.584176 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1f351aa4-7071-4f5d-8b55-1040645ba299 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:54.584679 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1f351aa4-7071-4f5d-8b55-1040645ba299 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:54.585695 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1f351aa4-7071-4f5d-8b55-1040645ba299 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:54.586407 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1f351aa4-7071-4f5d-8b55-1040645ba299 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:54.587055 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1f351aa4-7071-4f5d-8b55-1040645ba299 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:54.587755 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1f351aa4-7071-4f5d-8b55-1040645ba299 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:54.661208 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-1f351aa4-7071-4f5d-8b55-1040645ba299 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lazy-loading 'flavor' on Instance uuid f9f308fa-d4a6-4ac9-8c64-927e082b0b4a {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:44:54.963523 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-de119fba-57ec-4fbd-8fb2-36b21a3fd0fb tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:54.981979 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-de119fba-57ec-4fbd-8fb2-36b21a3fd0fb tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:54.989318 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-de119fba-57ec-4fbd-8fb2-36b21a3fd0fb tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:54.996991 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-de119fba-57ec-4fbd-8fb2-36b21a3fd0fb tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551" status: 200 len: 1487 microversion: 2.25 time: 0.550680 Sep 08 10:44:55.017277 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 876/1779] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:44:54 2022] GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551 => generated 1487 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:44:55.046679 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d89efb30-34cf-4709-b3b9-e0b927590a83 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:55.047948 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d89efb30-34cf-4709-b3b9-e0b927590a83 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] [instance: bf82fb33-6e90-4830-aa0e-5bff7fa782ba] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:55.056492 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1f351aa4-7071-4f5d-8b55-1040645ba299 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "POST /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a/action" status: 202 len: 0 microversion: 2.1 time: 0.490575 Sep 08 10:44:55.058918 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 904/1780] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:44:54 2022] POST /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a/action => generated 0 bytes in 494 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:44:55.072306 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-44c1c943-6a91-4013-a950-d4f047f0207e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:55.074713 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-44c1c943-6a91-4013-a950-d4f047f0207e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 90974422-0d77-4970-9e94-ed6b3376ed29] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:55.078596 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d89efb30-34cf-4709-b3b9-e0b927590a83 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:55.079096 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d89efb30-34cf-4709-b3b9-e0b927590a83 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:55.079532 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d89efb30-34cf-4709-b3b9-e0b927590a83 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:55.080247 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d89efb30-34cf-4709-b3b9-e0b927590a83 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:55.080706 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d89efb30-34cf-4709-b3b9-e0b927590a83 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:55.081167 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d89efb30-34cf-4709-b3b9-e0b927590a83 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:55.090184 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-44c1c943-6a91-4013-a950-d4f047f0207e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:55.091673 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-44c1c943-6a91-4013-a950-d4f047f0207e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:55.092815 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-44c1c943-6a91-4013-a950-d4f047f0207e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:55.094964 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-44c1c943-6a91-4013-a950-d4f047f0207e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:55.096269 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-44c1c943-6a91-4013-a950-d4f047f0207e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:55.097496 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-44c1c943-6a91-4013-a950-d4f047f0207e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:55.462319 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-44c1c943-6a91-4013-a950-d4f047f0207e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:55.478280 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-44c1c943-6a91-4013-a950-d4f047f0207e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29" status: 200 len: 1391 microversion: 2.1 time: 0.413713 Sep 08 10:44:55.479611 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 905/1781] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:55 2022] GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29 => generated 1391 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:55.486713 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0cd5f939-8e81-43fa-b25c-82b9ca04abb7 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '.version_select at 0x7f68e4522f70>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:55.633502 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0cd5f939-8e81-43fa-b25c-82b9ca04abb7 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/images/42339e5a-aebb-4b85-90de-86145010398d" status: 200 len: 1452 microversion: 2.1 time: 0.152142 Sep 08 10:44:55.668628 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 906/1782] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:44:55 2022] GET /compute/v2.1/images/42339e5a-aebb-4b85-90de-86145010398d => generated 1452 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:55.684361 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-43d23c4a-0e80-4c3e-80c5-ac0048e7c9cf tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:55.685221 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-43d23c4a-0e80-4c3e-80c5-ac0048e7c9cf tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: a3a6ce0f-e362-4cbc-afc2-3cfd349a4812] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:55.700692 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d89efb30-34cf-4709-b3b9-e0b927590a83 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173621608ea149b4b401f2da7351597a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de50a647dfb24b13945df8851e766db7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:55.704963 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-43d23c4a-0e80-4c3e-80c5-ac0048e7c9cf tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:55.706336 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-43d23c4a-0e80-4c3e-80c5-ac0048e7c9cf tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:55.707765 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-43d23c4a-0e80-4c3e-80c5-ac0048e7c9cf tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:55.709121 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-43d23c4a-0e80-4c3e-80c5-ac0048e7c9cf tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:55.712718 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-43d23c4a-0e80-4c3e-80c5-ac0048e7c9cf tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:55.713980 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-43d23c4a-0e80-4c3e-80c5-ac0048e7c9cf tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:55.717877 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d89efb30-34cf-4709-b3b9-e0b927590a83 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] 10.222.0.27 "GET /compute/v2.1/servers/bf82fb33-6e90-4830-aa0e-5bff7fa782ba" status: 200 len: 1532 microversion: 2.1 time: 0.697749 Sep 08 10:44:55.720016 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 877/1783] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:55 2022] GET /compute/v2.1/servers/bf82fb33-6e90-4830-aa0e-5bff7fa782ba => generated 1532 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:55.735672 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7f67ec31-8b43-42f4-94d4-1206e93f8ad0 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:55.745641 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7f67ec31-8b43-42f4-94d4-1206e93f8ad0 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: f9f308fa-d4a6-4ac9-8c64-927e082b0b4a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:55.755196 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f67ec31-8b43-42f4-94d4-1206e93f8ad0 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:55.758167 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f67ec31-8b43-42f4-94d4-1206e93f8ad0 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:55.758926 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f67ec31-8b43-42f4-94d4-1206e93f8ad0 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:55.760950 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f67ec31-8b43-42f4-94d4-1206e93f8ad0 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:55.761464 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f67ec31-8b43-42f4-94d4-1206e93f8ad0 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:55.772748 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f67ec31-8b43-42f4-94d4-1206e93f8ad0 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:55.789422 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-43d23c4a-0e80-4c3e-80c5-ac0048e7c9cf tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:55.790756 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-43d23c4a-0e80-4c3e-80c5-ac0048e7c9cf tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:55.791424 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-43d23c4a-0e80-4c3e-80c5-ac0048e7c9cf tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:55.792057 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-43d23c4a-0e80-4c3e-80c5-ac0048e7c9cf tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lazy-loading 'fault' on Instance uuid a3a6ce0f-e362-4cbc-afc2-3cfd349a4812 {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:44:55.854066 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-43d23c4a-0e80-4c3e-80c5-ac0048e7c9cf tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:55.865776 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-43d23c4a-0e80-4c3e-80c5-ac0048e7c9cf tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812" status: 200 len: 1368 microversion: 2.1 time: 0.192950 Sep 08 10:44:55.867239 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 907/1784] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:55 2022] GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812 => generated 1368 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:55.872929 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3945ba34-af25-480c-a817-1b73a9d688f1 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:55.873955 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3945ba34-af25-480c-a817-1b73a9d688f1 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 64c88fa0-6a01-42fc-b0e9-98b9e84a199d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:55.882716 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3945ba34-af25-480c-a817-1b73a9d688f1 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:55.883775 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3945ba34-af25-480c-a817-1b73a9d688f1 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:55.884392 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3945ba34-af25-480c-a817-1b73a9d688f1 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:55.885432 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3945ba34-af25-480c-a817-1b73a9d688f1 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:55.886108 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3945ba34-af25-480c-a817-1b73a9d688f1 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:55.886854 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3945ba34-af25-480c-a817-1b73a9d688f1 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:56.534362 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7f67ec31-8b43-42f4-94d4-1206e93f8ad0 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:56.545955 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7f67ec31-8b43-42f4-94d4-1206e93f8ad0 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a" status: 200 len: 1508 microversion: 2.1 time: 0.823646 Sep 08 10:44:56.547483 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 878/1785] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:55 2022] GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a => generated 1508 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:56.556281 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ae3d8855-db24-4519-afc3-e1a4d4ac2065 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:56.557377 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ae3d8855-db24-4519-afc3-e1a4d4ac2065 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: cf3b6c0e-d390-44d6-91e5-09b389dff551] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:56.575326 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae3d8855-db24-4519-afc3-e1a4d4ac2065 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:56.578986 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae3d8855-db24-4519-afc3-e1a4d4ac2065 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:56.582217 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae3d8855-db24-4519-afc3-e1a4d4ac2065 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:56.584493 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae3d8855-db24-4519-afc3-e1a4d4ac2065 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:56.588285 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae3d8855-db24-4519-afc3-e1a4d4ac2065 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:56.590279 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae3d8855-db24-4519-afc3-e1a4d4ac2065 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:56.614992 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-3945ba34-af25-480c-a817-1b73a9d688f1 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:56.631149 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3945ba34-af25-480c-a817-1b73a9d688f1 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d" status: 200 len: 1496 microversion: 2.1 time: 0.762461 Sep 08 10:44:56.634908 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 908/1786] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:55 2022] GET /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d => generated 1496 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:56.647290 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9ae125e9-3792-4be7-8cf8-2e19d1e9329f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:56.648442 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9ae125e9-3792-4be7-8cf8-2e19d1e9329f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 90974422-0d77-4970-9e94-ed6b3376ed29] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:56.675698 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ae125e9-3792-4be7-8cf8-2e19d1e9329f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:56.676524 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ae125e9-3792-4be7-8cf8-2e19d1e9329f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:56.680159 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ae125e9-3792-4be7-8cf8-2e19d1e9329f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:56.681853 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ae125e9-3792-4be7-8cf8-2e19d1e9329f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:56.684097 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ae125e9-3792-4be7-8cf8-2e19d1e9329f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:56.685333 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ae125e9-3792-4be7-8cf8-2e19d1e9329f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:57.030941 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9ae125e9-3792-4be7-8cf8-2e19d1e9329f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:57.058223 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9ae125e9-3792-4be7-8cf8-2e19d1e9329f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29" status: 200 len: 1391 microversion: 2.1 time: 0.419029 Sep 08 10:44:57.059215 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 909/1787] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:56 2022] GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29 => generated 1391 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:57.068969 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f088818f-f883-4991-ae9b-6eaeffe17bc5 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '.version_select at 0x7f68e4a25a60>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:57.153821 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f088818f-f883-4991-ae9b-6eaeffe17bc5 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/images/42339e5a-aebb-4b85-90de-86145010398d" status: 200 len: 1452 microversion: 2.1 time: 0.092114 Sep 08 10:44:57.155896 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 910/1788] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:44:57 2022] GET /compute/v2.1/images/42339e5a-aebb-4b85-90de-86145010398d => generated 1452 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:57.166514 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a459c7ab-69e4-4243-ad98-ee6f37284c9d tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:57.167712 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a459c7ab-69e4-4243-ad98-ee6f37284c9d tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] [instance: bf82fb33-6e90-4830-aa0e-5bff7fa782ba] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:57.172940 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:44:57.177774 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a459c7ab-69e4-4243-ad98-ee6f37284c9d tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:57.178259 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a459c7ab-69e4-4243-ad98-ee6f37284c9d tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:57.179110 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a459c7ab-69e4-4243-ad98-ee6f37284c9d tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:57.179875 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a459c7ab-69e4-4243-ad98-ee6f37284c9d tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:57.180654 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a459c7ab-69e4-4243-ad98-ee6f37284c9d tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:57.181505 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a459c7ab-69e4-4243-ad98-ee6f37284c9d tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:57.423925 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ae3d8855-db24-4519-afc3-e1a4d4ac2065 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:57.443104 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ae3d8855-db24-4519-afc3-e1a4d4ac2065 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:57.449765 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ae3d8855-db24-4519-afc3-e1a4d4ac2065 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:57.456420 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ae3d8855-db24-4519-afc3-e1a4d4ac2065 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551" status: 200 len: 1487 microversion: 2.25 time: 0.903474 Sep 08 10:44:57.469627 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 879/1789] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:44:56 2022] GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551 => generated 1487 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:44:57.484834 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1612ecb8-fe52-4910-bc91-6bb4c5c91640 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:57.486945 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1612ecb8-fe52-4910-bc91-6bb4c5c91640 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: a3a6ce0f-e362-4cbc-afc2-3cfd349a4812] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:57.507214 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1612ecb8-fe52-4910-bc91-6bb4c5c91640 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:57.510356 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1612ecb8-fe52-4910-bc91-6bb4c5c91640 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:57.511183 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1612ecb8-fe52-4910-bc91-6bb4c5c91640 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:57.512277 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1612ecb8-fe52-4910-bc91-6bb4c5c91640 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:57.512833 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1612ecb8-fe52-4910-bc91-6bb4c5c91640 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:57.513350 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1612ecb8-fe52-4910-bc91-6bb4c5c91640 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:57.533448 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-1612ecb8-fe52-4910-bc91-6bb4c5c91640 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] HTTP exception thrown: Instance a3a6ce0f-e362-4cbc-afc2-3cfd349a4812 could not be found. Sep 08 10:44:57.535343 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1612ecb8-fe52-4910-bc91-6bb4c5c91640 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Request method failure captured: Sep 08 10:44:57.535343 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812 HTTP/1.1 Sep 08 10:44:57.535343 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:44:57.535343 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:44:57.535343 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:44:57.535343 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:44:57.535343 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:44:57.535343 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:44:57.535343 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:44:57.535343 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:44:57.535343 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcYGgRkKVHRzVR9niOGjhwqpirZaCWJcRqqRBFlhL1VmFuxdG98PboRets-mDW1eiOn1mBTQzWopbf0-ncuece0UY9n3HH2MGNmaq7bojLbCqCyMZSM43Ty75CqX6jnN2RpnAuia-0vhvf6ydgpmghVLux4c6nabv9yseF4tgJm4EqM Sep 08 10:44:57.535343 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:44:57.535343 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:44:57.535343 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:44:57.535343 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:44:57.535343 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:44:57.535343 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:44:57.535343 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: a52c0b4a043445df94dab4dd4292607a Sep 08 10:44:57.535343 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-MigrationsAdminTest-381365870 Sep 08 10:44:57.535343 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:44:57.535343 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:44:57.535343 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a52c0b4a043445df94dab4dd4292607a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a52c0b4a043445df94dab4dd4292607a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a52c0b4a043445df94dab4dd4292607a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a52c0b4a043445df94dab4dd4292607a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:44:57.535343 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-MigrationsAdminTest-381365870 Sep 08 10:44:57.535343 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: a52c0b4a043445df94dab4dd4292607a Sep 08 10:44:57.535343 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-MigrationsAdminTest-381365870 Sep 08 10:44:57.535343 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-MigrationsAdminTest-381365870-project Sep 08 10:44:57.535343 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:44:57.535343 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:44:57.535343 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 5450284cb50b4f75be0915074bf8fe78 Sep 08 10:44:57.535343 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-MigrationsAdminTest-381365870-project Sep 08 10:44:57.535343 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:44:57.535343 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance a3a6ce0f-e362-4cbc-afc2-3cfd349a4812 could not be found. Sep 08 10:44:57.535343 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'a3a6ce0f-e362-4cbc-afc2-3cfd349a4812'} Sep 08 10:44:57.535343 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:44:57.535343 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:44:57.535343 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:44:57.535343 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:44:57.535343 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:44:57.535343 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:44:57.535343 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:44:57.535343 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:44:57.535343 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:44:57.535343 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:44:57.535343 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3a6ce0f-e362-4cbc-afc2-3cfd349a4812 could not be found. Sep 08 10:44:57.535343 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:44:57.535343 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:44:57.535343 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:44:57.535343 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:44:57.535343 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:44:57.535343 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:44:57.535343 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:44:57.535343 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:44:57.535343 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:44:57.535343 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:44:57.535343 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:44:57.535343 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:44:57.535343 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:44:57.535343 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:44:57.535343 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:44:57.535343 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:44:57.535343 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3a6ce0f-e362-4cbc-afc2-3cfd349a4812 could not be found. Sep 08 10:44:57.535343 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:44:57.535343 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:44:57.535343 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:44:57.542512 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:44:57.542512 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:44:57.542512 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:44:57.542512 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:44:57.542512 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:44:57.542512 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3a6ce0f-e362-4cbc-afc2-3cfd349a4812 could not be found. Sep 08 10:44:57.542512 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:44:57.542512 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1612ecb8-fe52-4910-bc91-6bb4c5c91640 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Returning 404 to user: Instance a3a6ce0f-e362-4cbc-afc2-3cfd349a4812 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:44:57.542512 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1612ecb8-fe52-4910-bc91-6bb4c5c91640 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812" status: 404 len: 111 microversion: 2.1 time: 0.062350 Sep 08 10:44:57.542512 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 880/1790] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:57 2022] GET /compute/v2.1/servers/a3a6ce0f-e362-4cbc-afc2-3cfd349a4812 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:44:57.547932 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-34181af1-1f2a-4a30-a990-b145ac1cdfdd tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '.version_select at 0x7f68e491bf70>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:57.574732 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-34181af1-1f2a-4a30-a990-b145ac1cdfdd tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1457951439" status: 202 len: 0 microversion: 2.1 time: 0.031357 Sep 08 10:44:57.579783 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 881/1791] 10.222.0.27 () {58 vars in 1221 bytes} [Thu Sep 8 10:44:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1457951439 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:44:57.586811 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-21760bc4-cb3e-4017-b35c-3442c851fa59 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:57.587742 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-21760bc4-cb3e-4017-b35c-3442c851fa59 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: f9f308fa-d4a6-4ac9-8c64-927e082b0b4a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:57.597699 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-21760bc4-cb3e-4017-b35c-3442c851fa59 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:57.598841 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-21760bc4-cb3e-4017-b35c-3442c851fa59 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:57.599493 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-21760bc4-cb3e-4017-b35c-3442c851fa59 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:57.601650 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-21760bc4-cb3e-4017-b35c-3442c851fa59 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:57.602167 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-21760bc4-cb3e-4017-b35c-3442c851fa59 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:57.603300 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-21760bc4-cb3e-4017-b35c-3442c851fa59 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:57.613717 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a459c7ab-69e4-4243-ad98-ee6f37284c9d tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173621608ea149b4b401f2da7351597a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de50a647dfb24b13945df8851e766db7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:57.633520 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a459c7ab-69e4-4243-ad98-ee6f37284c9d tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] 10.222.0.27 "GET /compute/v2.1/servers/bf82fb33-6e90-4830-aa0e-5bff7fa782ba" status: 200 len: 1532 microversion: 2.1 time: 0.475542 Sep 08 10:44:57.634842 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 911/1792] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:57 2022] GET /compute/v2.1/servers/bf82fb33-6e90-4830-aa0e-5bff7fa782ba => generated 1532 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:57.660624 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5b8b3013-9279-4e72-9481-0495767cca3c tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:57.661810 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5b8b3013-9279-4e72-9481-0495767cca3c tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 64c88fa0-6a01-42fc-b0e9-98b9e84a199d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:57.678909 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5b8b3013-9279-4e72-9481-0495767cca3c tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:57.679719 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5b8b3013-9279-4e72-9481-0495767cca3c tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:57.680485 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5b8b3013-9279-4e72-9481-0495767cca3c tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:57.681824 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5b8b3013-9279-4e72-9481-0495767cca3c tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:57.682982 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5b8b3013-9279-4e72-9481-0495767cca3c tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:57.684029 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5b8b3013-9279-4e72-9481-0495767cca3c tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:58.118331 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-21760bc4-cb3e-4017-b35c-3442c851fa59 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:58.137460 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-21760bc4-cb3e-4017-b35c-3442c851fa59 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a" status: 200 len: 1508 microversion: 2.1 time: 0.555732 Sep 08 10:44:58.141617 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 882/1793] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:57 2022] GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a => generated 1508 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:58.158538 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-ba0ef86e-2a86-43df-82f3-33090ff7aff6 req-9656d522-39b4-4db0-8aae-58e4567df45e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf82fb33-6e90-4830-aa0e-5bff7fa782ba", "name": "network-vif-deleted", "tag": "203a672d-d2f0-4f46-843a-209ad13b7262"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:44:58.183308 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ba0ef86e-2a86-43df-82f3-33090ff7aff6 req-9656d522-39b4-4db0-8aae-58e4567df45e service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:58.184155 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ba0ef86e-2a86-43df-82f3-33090ff7aff6 req-9656d522-39b4-4db0-8aae-58e4567df45e service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:58.185139 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ba0ef86e-2a86-43df-82f3-33090ff7aff6 req-9656d522-39b4-4db0-8aae-58e4567df45e service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:58.208225 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-ba0ef86e-2a86-43df-82f3-33090ff7aff6 req-9656d522-39b4-4db0-8aae-58e4567df45e service nova] Creating event network-vif-deleted:203a672d-d2f0-4f46-843a-209ad13b7262 for instance bf82fb33-6e90-4830-aa0e-5bff7fa782ba on n-h1-850501-12 Sep 08 10:44:58.219893 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-ba0ef86e-2a86-43df-82f3-33090ff7aff6 req-9656d522-39b4-4db0-8aae-58e4567df45e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072876 Sep 08 10:44:58.221718 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 883/1794] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:44:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:44:58.231327 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0ae5ed97-562c-4459-9893-034532dddb6f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:58.233441 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0ae5ed97-562c-4459-9893-034532dddb6f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 90974422-0d77-4970-9e94-ed6b3376ed29] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:58.248577 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ae5ed97-562c-4459-9893-034532dddb6f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:58.249934 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ae5ed97-562c-4459-9893-034532dddb6f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:58.251895 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ae5ed97-562c-4459-9893-034532dddb6f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:58.252104 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5b8b3013-9279-4e72-9481-0495767cca3c tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:58.254944 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ae5ed97-562c-4459-9893-034532dddb6f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:58.257356 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ae5ed97-562c-4459-9893-034532dddb6f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:58.259768 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ae5ed97-562c-4459-9893-034532dddb6f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:58.274982 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5b8b3013-9279-4e72-9481-0495767cca3c tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d" status: 200 len: 1496 microversion: 2.1 time: 0.621866 Sep 08 10:44:58.285958 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 912/1795] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:57 2022] GET /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d => generated 1496 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:44:58.320211 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8fe19668-3041-4f45-827d-49173952ea94 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '.version_select at 0x7f68e46a28b0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:58.405508 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8fe19668-3041-4f45-827d-49173952ea94 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/images/42339e5a-aebb-4b85-90de-86145010398d" status: 200 len: 1452 microversion: 2.1 time: 0.116810 Sep 08 10:44:58.406465 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 913/1796] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:44:58 2022] GET /compute/v2.1/images/42339e5a-aebb-4b85-90de-86145010398d => generated 1452 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:58.416233 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-9c41e3f2-cda5-430e-9b5d-fd03b7e3eafb req-cb0bf06f-4331-4bae-8b5a-6641eb9a34cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e6be670-294f-417f-a909-57c481faaf40", "name": "network-vif-plugged", "status": "completed", "tag": "2dc5c573-e6fe-4942-be41-259b760efba3"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:44:58.448701 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-9c41e3f2-cda5-430e-9b5d-fd03b7e3eafb req-cb0bf06f-4331-4bae-8b5a-6641eb9a34cb service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:58.451140 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-9c41e3f2-cda5-430e-9b5d-fd03b7e3eafb req-cb0bf06f-4331-4bae-8b5a-6641eb9a34cb service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:58.452950 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-9c41e3f2-cda5-430e-9b5d-fd03b7e3eafb req-cb0bf06f-4331-4bae-8b5a-6641eb9a34cb service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:58.472673 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-9c41e3f2-cda5-430e-9b5d-fd03b7e3eafb req-cb0bf06f-4331-4bae-8b5a-6641eb9a34cb service nova] Creating event network-vif-plugged:2dc5c573-e6fe-4942-be41-259b760efba3 for instance 3e6be670-294f-417f-a909-57c481faaf40 on n-h1-850501-12 Sep 08 10:44:58.480317 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-9c41e3f2-cda5-430e-9b5d-fd03b7e3eafb req-cb0bf06f-4331-4bae-8b5a-6641eb9a34cb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069452 Sep 08 10:44:58.481611 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 914/1797] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:44:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:44:58.512530 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-32349872-dd34-4110-afa0-b27cb7c697f5 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:58.513725 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-32349872-dd34-4110-afa0-b27cb7c697f5 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: cf3b6c0e-d390-44d6-91e5-09b389dff551] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:58.530837 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-32349872-dd34-4110-afa0-b27cb7c697f5 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:58.531695 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-32349872-dd34-4110-afa0-b27cb7c697f5 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:58.532401 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-32349872-dd34-4110-afa0-b27cb7c697f5 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:58.533814 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-32349872-dd34-4110-afa0-b27cb7c697f5 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:58.534629 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-32349872-dd34-4110-afa0-b27cb7c697f5 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:58.535424 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-32349872-dd34-4110-afa0-b27cb7c697f5 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:58.564015 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:44:58.767573 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0ae5ed97-562c-4459-9893-034532dddb6f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:58.779404 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0ae5ed97-562c-4459-9893-034532dddb6f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29" status: 200 len: 1391 microversion: 2.1 time: 0.555200 Sep 08 10:44:58.780749 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 884/1798] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:58 2022] GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29 => generated 1391 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:58.786438 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3b1fa0b6-05ca-4699-838d-c20cbf846844 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:58.787426 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3b1fa0b6-05ca-4699-838d-c20cbf846844 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] [instance: bf82fb33-6e90-4830-aa0e-5bff7fa782ba] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:58.810102 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b1fa0b6-05ca-4699-838d-c20cbf846844 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:58.811331 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b1fa0b6-05ca-4699-838d-c20cbf846844 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:58.812161 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b1fa0b6-05ca-4699-838d-c20cbf846844 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:58.812819 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b1fa0b6-05ca-4699-838d-c20cbf846844 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:58.813319 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b1fa0b6-05ca-4699-838d-c20cbf846844 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:58.813987 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b1fa0b6-05ca-4699-838d-c20cbf846844 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:58.866775 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b1fa0b6-05ca-4699-838d-c20cbf846844 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:58.868779 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b1fa0b6-05ca-4699-838d-c20cbf846844 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:58.869309 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b1fa0b6-05ca-4699-838d-c20cbf846844 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:58.869827 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-3b1fa0b6-05ca-4699-838d-c20cbf846844 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lazy-loading 'fault' on Instance uuid bf82fb33-6e90-4830-aa0e-5bff7fa782ba {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:44:58.949008 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3b1fa0b6-05ca-4699-838d-c20cbf846844 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173621608ea149b4b401f2da7351597a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de50a647dfb24b13945df8851e766db7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:58.957731 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3b1fa0b6-05ca-4699-838d-c20cbf846844 tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] 10.222.0.27 "GET /compute/v2.1/servers/bf82fb33-6e90-4830-aa0e-5bff7fa782ba" status: 200 len: 1316 microversion: 2.1 time: 0.175386 Sep 08 10:44:58.958338 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 885/1799] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:58 2022] GET /compute/v2.1/servers/bf82fb33-6e90-4830-aa0e-5bff7fa782ba => generated 1316 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:58.984065 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-32349872-dd34-4110-afa0-b27cb7c697f5 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:58.999896 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-32349872-dd34-4110-afa0-b27cb7c697f5 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:59.001721 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-32349872-dd34-4110-afa0-b27cb7c697f5 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:59.003352 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-32349872-dd34-4110-afa0-b27cb7c697f5 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551" status: 200 len: 1487 microversion: 2.25 time: 0.496144 Sep 08 10:44:59.004309 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 915/1800] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:44:58 2022] GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551 => generated 1487 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:44:59.171886 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f0a1bb38-0cbe-4ca3-a7ba-38fbf5c1f2c5 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:59.173149 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f0a1bb38-0cbe-4ca3-a7ba-38fbf5c1f2c5 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: f9f308fa-d4a6-4ac9-8c64-927e082b0b4a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:59.184687 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0a1bb38-0cbe-4ca3-a7ba-38fbf5c1f2c5 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:59.195543 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0a1bb38-0cbe-4ca3-a7ba-38fbf5c1f2c5 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:59.196300 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0a1bb38-0cbe-4ca3-a7ba-38fbf5c1f2c5 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:59.197304 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0a1bb38-0cbe-4ca3-a7ba-38fbf5c1f2c5 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:59.198012 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0a1bb38-0cbe-4ca3-a7ba-38fbf5c1f2c5 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:59.198710 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0a1bb38-0cbe-4ca3-a7ba-38fbf5c1f2c5 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:59.312192 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5f4fbc61-7af6-4b95-a794-87808c0c065c tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:59.313203 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5f4fbc61-7af6-4b95-a794-87808c0c065c tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 64c88fa0-6a01-42fc-b0e9-98b9e84a199d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:59.337950 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5f4fbc61-7af6-4b95-a794-87808c0c065c tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:59.338736 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5f4fbc61-7af6-4b95-a794-87808c0c065c tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:59.339375 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5f4fbc61-7af6-4b95-a794-87808c0c065c tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:59.340437 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5f4fbc61-7af6-4b95-a794-87808c0c065c tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:59.341118 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5f4fbc61-7af6-4b95-a794-87808c0c065c tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:59.341724 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5f4fbc61-7af6-4b95-a794-87808c0c065c tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:59.426886 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f0a1bb38-0cbe-4ca3-a7ba-38fbf5c1f2c5 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:59.438361 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f0a1bb38-0cbe-4ca3-a7ba-38fbf5c1f2c5 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a" status: 200 len: 1508 microversion: 2.1 time: 0.271793 Sep 08 10:44:59.455874 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 886/1801] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:59 2022] GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a => generated 1508 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:59.464768 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5a5fbf65-095c-4034-94b0-56dd07fa3463 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '.version_select at 0x7f68e45cbaf0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:59.520829 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5a5fbf65-095c-4034-94b0-56dd07fa3463 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/images/42339e5a-aebb-4b85-90de-86145010398d" status: 200 len: 1452 microversion: 2.1 time: 0.063843 Sep 08 10:44:59.521792 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 887/1802] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:44:59 2022] GET /compute/v2.1/images/42339e5a-aebb-4b85-90de-86145010398d => generated 1452 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:59.651379 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ef77867a-4f83-4fa9-b10b-d1ae38ab2f10 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:59.652474 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ef77867a-4f83-4fa9-b10b-d1ae38ab2f10 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 923d2401-f860-4284-a580-37ed478720f6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:59.662082 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef77867a-4f83-4fa9-b10b-d1ae38ab2f10 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:59.663791 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef77867a-4f83-4fa9-b10b-d1ae38ab2f10 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:59.664406 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef77867a-4f83-4fa9-b10b-d1ae38ab2f10 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:59.665476 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef77867a-4f83-4fa9-b10b-d1ae38ab2f10 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:59.666098 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef77867a-4f83-4fa9-b10b-d1ae38ab2f10 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:59.667103 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef77867a-4f83-4fa9-b10b-d1ae38ab2f10 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:59.731197 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ef77867a-4f83-4fa9-b10b-d1ae38ab2f10 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 923d2401-f860-4284-a580-37ed478720f6] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:44:59.784679 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5f4fbc61-7af6-4b95-a794-87808c0c065c tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:59.816003 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5f4fbc61-7af6-4b95-a794-87808c0c065c tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d" status: 200 len: 1496 microversion: 2.1 time: 0.506266 Sep 08 10:44:59.828886 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 916/1803] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:59 2022] GET /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d => generated 1496 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:59.836039 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cae287f8-c59d-4458-a995-9d1bad80c833 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:59.837931 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cae287f8-c59d-4458-a995-9d1bad80c833 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 90974422-0d77-4970-9e94-ed6b3376ed29] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:59.860050 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cae287f8-c59d-4458-a995-9d1bad80c833 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:59.863286 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cae287f8-c59d-4458-a995-9d1bad80c833 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:59.863889 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cae287f8-c59d-4458-a995-9d1bad80c833 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:59.864771 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cae287f8-c59d-4458-a995-9d1bad80c833 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:59.866116 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cae287f8-c59d-4458-a995-9d1bad80c833 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:59.870245 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cae287f8-c59d-4458-a995-9d1bad80c833 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:59.956103 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ef77867a-4f83-4fa9-b10b-d1ae38ab2f10 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "DELETE /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6" status: 204 len: 0 microversion: 2.1 time: 0.311184 Sep 08 10:44:59.958000 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 888/1804] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:44:59 2022] DELETE /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:44:59.968255 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bde9745c-8fc6-4f57-970e-f69d3cc171be tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:59.969362 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bde9745c-8fc6-4f57-970e-f69d3cc171be tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 923d2401-f860-4284-a580-37ed478720f6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:59.984078 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bde9745c-8fc6-4f57-970e-f69d3cc171be tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:59.985006 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bde9745c-8fc6-4f57-970e-f69d3cc171be tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:59.985770 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bde9745c-8fc6-4f57-970e-f69d3cc171be tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:59.986803 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bde9745c-8fc6-4f57-970e-f69d3cc171be tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:59.987484 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bde9745c-8fc6-4f57-970e-f69d3cc171be tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:59.988223 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bde9745c-8fc6-4f57-970e-f69d3cc171be tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:00.222685 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-cae287f8-c59d-4458-a995-9d1bad80c833 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:00.233138 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cae287f8-c59d-4458-a995-9d1bad80c833 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29" status: 200 len: 1391 microversion: 2.1 time: 0.413594 Sep 08 10:45:00.236184 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 917/1805] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:59 2022] GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29 => generated 1391 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:00.241856 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-937be4b4-9f1e-44e2-ab9d-98a75fd99b6b tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:00.242991 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-937be4b4-9f1e-44e2-ab9d-98a75fd99b6b tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] [instance: bf82fb33-6e90-4830-aa0e-5bff7fa782ba] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:00.250778 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-937be4b4-9f1e-44e2-ab9d-98a75fd99b6b tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:00.251642 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-937be4b4-9f1e-44e2-ab9d-98a75fd99b6b tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:00.252479 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-937be4b4-9f1e-44e2-ab9d-98a75fd99b6b tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:00.253572 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-937be4b4-9f1e-44e2-ab9d-98a75fd99b6b tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:00.254407 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-937be4b4-9f1e-44e2-ab9d-98a75fd99b6b tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:00.255059 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-937be4b4-9f1e-44e2-ab9d-98a75fd99b6b tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:00.259737 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bde9745c-8fc6-4f57-970e-f69d3cc171be tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:00.272596 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bde9745c-8fc6-4f57-970e-f69d3cc171be tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6" status: 200 len: 1469 microversion: 2.1 time: 0.309208 Sep 08 10:45:00.275493 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-937be4b4-9f1e-44e2-ab9d-98a75fd99b6b tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] HTTP exception thrown: Instance bf82fb33-6e90-4830-aa0e-5bff7fa782ba could not be found. Sep 08 10:45:00.276403 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 889/1806] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:59 2022] GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6 => generated 1469 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:45:00.279852 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-937be4b4-9f1e-44e2-ab9d-98a75fd99b6b tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Request method failure captured: Sep 08 10:45:00.279852 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/bf82fb33-6e90-4830-aa0e-5bff7fa782ba HTTP/1.1 Sep 08 10:45:00.279852 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:45:00.279852 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:45:00.279852 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:45:00.279852 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:45:00.279852 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:45:00.279852 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:45:00.279852 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:45:00.279852 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:45:00.279852 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcdujNWdsPoou6sO7eaL1oLnNC0_rbgrLRxSiNTiXV3ANMfGyMNMJzHQuD9Gea_hawXTJBlTiWbhX0glZhv-brrQW2IrxQppJNBnWIzT1M_vBnaAzeG98YED3kijhua7ncCH5up0p6flMCLrms1QaM27xbsPh_Sy-D9LXVdty2fBWys Sep 08 10:45:00.279852 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:45:00.279852 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:45:00.279852 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:45:00.279852 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:45:00.279852 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:45:00.279852 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:45:00.279852 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: de50a647dfb24b13945df8851e766db7 Sep 08 10:45:00.279852 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-348125718 Sep 08 10:45:00.279852 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:45:00.279852 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:45:00.279852 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/de50a647dfb24b13945df8851e766db7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/de50a647dfb24b13945df8851e766db7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_de50a647dfb24b13945df8851e766db7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/de50a647dfb24b13945df8851e766db7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:45:00.279852 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-348125718 Sep 08 10:45:00.279852 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: de50a647dfb24b13945df8851e766db7 Sep 08 10:45:00.279852 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-348125718 Sep 08 10:45:00.279852 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServersNegativeTestMultiTenantJSON-348125718-project Sep 08 10:45:00.279852 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:45:00.279852 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:45:00.279852 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 173621608ea149b4b401f2da7351597a Sep 08 10:45:00.279852 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-348125718-project Sep 08 10:45:00.279852 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:45:00.279852 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance bf82fb33-6e90-4830-aa0e-5bff7fa782ba could not be found. Sep 08 10:45:00.279852 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': 'bf82fb33-6e90-4830-aa0e-5bff7fa782ba'} Sep 08 10:45:00.279852 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:45:00.279852 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:45:00.279852 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:45:00.279852 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:45:00.279852 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:45:00.279852 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:45:00.279852 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:45:00.279852 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:45:00.279852 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:45:00.279852 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:45:00.279852 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf82fb33-6e90-4830-aa0e-5bff7fa782ba could not be found. Sep 08 10:45:00.279852 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:45:00.279852 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:45:00.279852 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:45:00.279852 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:45:00.279852 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:45:00.279852 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:45:00.279852 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:45:00.279852 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:45:00.279852 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:45:00.279852 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:45:00.279852 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:45:00.279852 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:45:00.279852 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:45:00.279852 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:45:00.279852 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:45:00.279852 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:45:00.279852 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf82fb33-6e90-4830-aa0e-5bff7fa782ba could not be found. Sep 08 10:45:00.279852 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:45:00.287306 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:45:00.287306 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:45:00.287306 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:45:00.287306 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:45:00.287306 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:45:00.287306 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:45:00.287306 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:45:00.287306 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf82fb33-6e90-4830-aa0e-5bff7fa782ba could not be found. Sep 08 10:45:00.287306 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:45:00.293380 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-937be4b4-9f1e-44e2-ab9d-98a75fd99b6b tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] Returning 404 to user: Instance bf82fb33-6e90-4830-aa0e-5bff7fa782ba could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:45:00.294708 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-937be4b4-9f1e-44e2-ab9d-98a75fd99b6b tempest-ServersNegativeTestMultiTenantJSON-348125718 tempest-ServersNegativeTestMultiTenantJSON-348125718-project] 10.222.0.27 "GET /compute/v2.1/servers/bf82fb33-6e90-4830-aa0e-5bff7fa782ba" status: 404 len: 111 microversion: 2.1 time: 0.057135 Sep 08 10:45:00.306322 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b6399b18-d58c-4235-9b47-85ec833aa62b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:00.308117 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b6399b18-d58c-4235-9b47-85ec833aa62b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: cf3b6c0e-d390-44d6-91e5-09b389dff551] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:00.309406 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 918/1807] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:00 2022] GET /compute/v2.1/servers/bf82fb33-6e90-4830-aa0e-5bff7fa782ba => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:45:00.317683 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b6399b18-d58c-4235-9b47-85ec833aa62b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:00.318312 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b6399b18-d58c-4235-9b47-85ec833aa62b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:00.318877 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b6399b18-d58c-4235-9b47-85ec833aa62b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:00.321217 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b6399b18-d58c-4235-9b47-85ec833aa62b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:00.321873 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b6399b18-d58c-4235-9b47-85ec833aa62b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:00.322484 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b6399b18-d58c-4235-9b47-85ec833aa62b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:00.469497 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-76d803b5-ac1d-4976-83d8-fd7eb112fc24 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:00.470739 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-76d803b5-ac1d-4976-83d8-fd7eb112fc24 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: f9f308fa-d4a6-4ac9-8c64-927e082b0b4a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:00.484016 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-76d803b5-ac1d-4976-83d8-fd7eb112fc24 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:00.484581 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-76d803b5-ac1d-4976-83d8-fd7eb112fc24 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:00.487899 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-76d803b5-ac1d-4976-83d8-fd7eb112fc24 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:00.488757 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-76d803b5-ac1d-4976-83d8-fd7eb112fc24 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:00.491855 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-76d803b5-ac1d-4976-83d8-fd7eb112fc24 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:00.493103 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-76d803b5-ac1d-4976-83d8-fd7eb112fc24 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:00.556039 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b6399b18-d58c-4235-9b47-85ec833aa62b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:00.560456 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:45:00.570918 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b6399b18-d58c-4235-9b47-85ec833aa62b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:00.572989 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b6399b18-d58c-4235-9b47-85ec833aa62b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:00.574281 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b6399b18-d58c-4235-9b47-85ec833aa62b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551" status: 200 len: 1487 microversion: 2.25 time: 0.294949 Sep 08 10:45:00.588372 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 890/1808] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:45:00 2022] GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551 => generated 1487 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:45:00.588372 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-13b9ae72-2c8c-46c2-a130-399afd0ba607 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '.version_select at 0x7f68e43503a0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:00.667928 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-13b9ae72-2c8c-46c2-a130-399afd0ba607 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/images/42339e5a-aebb-4b85-90de-86145010398d" status: 200 len: 1452 microversion: 2.1 time: 0.090724 Sep 08 10:45:00.670912 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 891/1809] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:45:00 2022] GET /compute/v2.1/images/42339e5a-aebb-4b85-90de-86145010398d => generated 1452 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:00.841946 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-76d803b5-ac1d-4976-83d8-fd7eb112fc24 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:00.854362 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e4579255-76c4-4ef4-aaa7-be01dffd96f8 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:00.855379 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e4579255-76c4-4ef4-aaa7-be01dffd96f8 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 64c88fa0-6a01-42fc-b0e9-98b9e84a199d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:00.874641 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e4579255-76c4-4ef4-aaa7-be01dffd96f8 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:00.875436 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-76d803b5-ac1d-4976-83d8-fd7eb112fc24 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a" status: 200 len: 1508 microversion: 2.1 time: 0.408121 Sep 08 10:45:00.877930 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e4579255-76c4-4ef4-aaa7-be01dffd96f8 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:00.878478 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 919/1810] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:00 2022] GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a => generated 1508 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:00.880501 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e4579255-76c4-4ef4-aaa7-be01dffd96f8 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:00.883658 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e4579255-76c4-4ef4-aaa7-be01dffd96f8 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:00.886193 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e4579255-76c4-4ef4-aaa7-be01dffd96f8 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:00.886911 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e4579255-76c4-4ef4-aaa7-be01dffd96f8 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:01.270434 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4cdbf2f2-1373-426d-9bd5-23d405bc8735 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:01.271770 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4cdbf2f2-1373-426d-9bd5-23d405bc8735 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 90974422-0d77-4970-9e94-ed6b3376ed29] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:01.281861 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4cdbf2f2-1373-426d-9bd5-23d405bc8735 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:01.287168 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4cdbf2f2-1373-426d-9bd5-23d405bc8735 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:01.287986 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4cdbf2f2-1373-426d-9bd5-23d405bc8735 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:01.288925 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4cdbf2f2-1373-426d-9bd5-23d405bc8735 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:01.290831 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4cdbf2f2-1373-426d-9bd5-23d405bc8735 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:01.296140 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4cdbf2f2-1373-426d-9bd5-23d405bc8735 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:01.766226 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e4579255-76c4-4ef4-aaa7-be01dffd96f8 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:01.783351 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4cdbf2f2-1373-426d-9bd5-23d405bc8735 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:01.785862 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e4579255-76c4-4ef4-aaa7-be01dffd96f8 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d" status: 200 len: 1496 microversion: 2.1 time: 0.941406 Sep 08 10:45:01.798262 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 892/1811] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:00 2022] GET /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d => generated 1496 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:01.802576 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-24194bdc-b6ee-4e5b-be15-73a338ff5b65 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:01.804336 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-24194bdc-b6ee-4e5b-be15-73a338ff5b65 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 923d2401-f860-4284-a580-37ed478720f6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:01.805275 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4cdbf2f2-1373-426d-9bd5-23d405bc8735 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29" status: 200 len: 1391 microversion: 2.1 time: 0.539917 Sep 08 10:45:01.806074 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 920/1812] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:01 2022] GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29 => generated 1391 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:45:01.816453 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-426b31c9-2689-4740-8537-33e75ea4e260 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:01.817417 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-24194bdc-b6ee-4e5b-be15-73a338ff5b65 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:01.818455 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-24194bdc-b6ee-4e5b-be15-73a338ff5b65 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:01.821665 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-426b31c9-2689-4740-8537-33e75ea4e260 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: cf3b6c0e-d390-44d6-91e5-09b389dff551] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:01.822005 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-24194bdc-b6ee-4e5b-be15-73a338ff5b65 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:01.823608 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-24194bdc-b6ee-4e5b-be15-73a338ff5b65 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:01.828089 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-24194bdc-b6ee-4e5b-be15-73a338ff5b65 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:01.828985 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-24194bdc-b6ee-4e5b-be15-73a338ff5b65 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:01.837485 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-426b31c9-2689-4740-8537-33e75ea4e260 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:01.840556 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-426b31c9-2689-4740-8537-33e75ea4e260 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:01.841264 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-426b31c9-2689-4740-8537-33e75ea4e260 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:01.843408 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-426b31c9-2689-4740-8537-33e75ea4e260 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:01.846149 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-426b31c9-2689-4740-8537-33e75ea4e260 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:01.846607 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-426b31c9-2689-4740-8537-33e75ea4e260 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:02.231292 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-24194bdc-b6ee-4e5b-be15-73a338ff5b65 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:02.244950 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-24194bdc-b6ee-4e5b-be15-73a338ff5b65 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6" status: 200 len: 1469 microversion: 2.1 time: 0.454859 Sep 08 10:45:02.247011 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 893/1813] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:01 2022] GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6 => generated 1469 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:02.252810 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4385fd30-2913-4711-98c9-5cdec57a4e6a tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '.version_select at 0x7f68e8b5faf0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:02.343194 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4385fd30-2913-4711-98c9-5cdec57a4e6a tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/images/42339e5a-aebb-4b85-90de-86145010398d" status: 200 len: 1452 microversion: 2.1 time: 0.093923 Sep 08 10:45:02.345620 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 894/1814] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:45:02 2022] GET /compute/v2.1/images/42339e5a-aebb-4b85-90de-86145010398d => generated 1452 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:02.368650 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e4151a4a-b16f-4a78-8243-04024bc7e9f3 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:02.369765 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e4151a4a-b16f-4a78-8243-04024bc7e9f3 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: f9f308fa-d4a6-4ac9-8c64-927e082b0b4a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:02.377610 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e4151a4a-b16f-4a78-8243-04024bc7e9f3 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:02.378581 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e4151a4a-b16f-4a78-8243-04024bc7e9f3 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:02.379450 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e4151a4a-b16f-4a78-8243-04024bc7e9f3 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:02.380726 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e4151a4a-b16f-4a78-8243-04024bc7e9f3 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:02.382079 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e4151a4a-b16f-4a78-8243-04024bc7e9f3 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:02.382812 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e4151a4a-b16f-4a78-8243-04024bc7e9f3 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:02.499085 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-426b31c9-2689-4740-8537-33e75ea4e260 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:02.528437 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-426b31c9-2689-4740-8537-33e75ea4e260 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:02.530034 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-426b31c9-2689-4740-8537-33e75ea4e260 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:02.531387 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-426b31c9-2689-4740-8537-33e75ea4e260 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551" status: 200 len: 1487 microversion: 2.25 time: 0.724011 Sep 08 10:45:02.531936 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 921/1815] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:45:01 2022] GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551 => generated 1487 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:45:02.821180 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0886a538-2a6e-4ed6-95cf-ca0f30073796 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:02.822587 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0886a538-2a6e-4ed6-95cf-ca0f30073796 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 64c88fa0-6a01-42fc-b0e9-98b9e84a199d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:02.845604 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0886a538-2a6e-4ed6-95cf-ca0f30073796 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:02.846211 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0886a538-2a6e-4ed6-95cf-ca0f30073796 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:02.846703 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0886a538-2a6e-4ed6-95cf-ca0f30073796 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:02.847679 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0886a538-2a6e-4ed6-95cf-ca0f30073796 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:02.860291 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0886a538-2a6e-4ed6-95cf-ca0f30073796 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:02.861555 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0886a538-2a6e-4ed6-95cf-ca0f30073796 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:03.074105 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e4151a4a-b16f-4a78-8243-04024bc7e9f3 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:03.095555 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e4151a4a-b16f-4a78-8243-04024bc7e9f3 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a" status: 200 len: 1508 microversion: 2.1 time: 0.740672 Sep 08 10:45:03.096679 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 895/1816] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:02 2022] GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a => generated 1508 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:03.102624 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-58b84e6e-eda6-4e3d-b692-c5ce32597760 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:03.103755 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-58b84e6e-eda6-4e3d-b692-c5ce32597760 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 90974422-0d77-4970-9e94-ed6b3376ed29] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:03.113438 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-58b84e6e-eda6-4e3d-b692-c5ce32597760 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:03.115015 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-58b84e6e-eda6-4e3d-b692-c5ce32597760 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:03.117301 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-58b84e6e-eda6-4e3d-b692-c5ce32597760 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:03.119225 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-58b84e6e-eda6-4e3d-b692-c5ce32597760 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:03.120515 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-58b84e6e-eda6-4e3d-b692-c5ce32597760 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:03.121889 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-58b84e6e-eda6-4e3d-b692-c5ce32597760 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:03.466960 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-58b84e6e-eda6-4e3d-b692-c5ce32597760 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:03.481509 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-58b84e6e-eda6-4e3d-b692-c5ce32597760 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29" status: 200 len: 1391 microversion: 2.1 time: 0.383217 Sep 08 10:45:03.484729 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 896/1817] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:03 2022] GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29 => generated 1391 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:03.510817 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-d9a707c9-4090-48a7-b121-cd4a4679403f req-31d2968e-a434-47aa-bc64-674bfd14fd06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "923d2401-f860-4284-a580-37ed478720f6", "name": "network-vif-deleted", "tag": "bec27b4a-f6d6-449e-854b-1e502a76de67"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:45:03.524336 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d9a707c9-4090-48a7-b121-cd4a4679403f req-31d2968e-a434-47aa-bc64-674bfd14fd06 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:03.525193 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d9a707c9-4090-48a7-b121-cd4a4679403f req-31d2968e-a434-47aa-bc64-674bfd14fd06 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:03.525996 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d9a707c9-4090-48a7-b121-cd4a4679403f req-31d2968e-a434-47aa-bc64-674bfd14fd06 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:03.547359 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-d9a707c9-4090-48a7-b121-cd4a4679403f req-31d2968e-a434-47aa-bc64-674bfd14fd06 service nova] Creating event network-vif-deleted:bec27b4a-f6d6-449e-854b-1e502a76de67 for instance 923d2401-f860-4284-a580-37ed478720f6 on n-h1-850501-12 Sep 08 10:45:03.553750 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-d9a707c9-4090-48a7-b121-cd4a4679403f req-31d2968e-a434-47aa-bc64-674bfd14fd06 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052132 Sep 08 10:45:03.559155 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 897/1818] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:45:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:45:03.566102 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9c5001ed-a6f6-4b76-a63b-99dfbc3a2cdb tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:03.569247 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9c5001ed-a6f6-4b76-a63b-99dfbc3a2cdb tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 923d2401-f860-4284-a580-37ed478720f6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:03.579876 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9c5001ed-a6f6-4b76-a63b-99dfbc3a2cdb tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:03.581099 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9c5001ed-a6f6-4b76-a63b-99dfbc3a2cdb tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:03.582065 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9c5001ed-a6f6-4b76-a63b-99dfbc3a2cdb tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:03.582999 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9c5001ed-a6f6-4b76-a63b-99dfbc3a2cdb tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:03.583611 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9c5001ed-a6f6-4b76-a63b-99dfbc3a2cdb tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:03.585228 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9c5001ed-a6f6-4b76-a63b-99dfbc3a2cdb tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:03.627199 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9c5001ed-a6f6-4b76-a63b-99dfbc3a2cdb tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:03.628166 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9c5001ed-a6f6-4b76-a63b-99dfbc3a2cdb tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:03.628814 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9c5001ed-a6f6-4b76-a63b-99dfbc3a2cdb tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:03.629857 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-9c5001ed-a6f6-4b76-a63b-99dfbc3a2cdb tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lazy-loading 'fault' on Instance uuid 923d2401-f860-4284-a580-37ed478720f6 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:45:03.735137 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9c5001ed-a6f6-4b76-a63b-99dfbc3a2cdb tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:03.756570 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9c5001ed-a6f6-4b76-a63b-99dfbc3a2cdb tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6" status: 200 len: 1303 microversion: 2.1 time: 0.195069 Sep 08 10:45:03.773057 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 898/1819] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:03 2022] GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6 => generated 1303 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:03.773057 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e224472d-5b11-4bf7-b5d6-924399e2f531 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '.version_select at 0x7f68e469e670>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:03.852539 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e224472d-5b11-4bf7-b5d6-924399e2f531 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/images/42339e5a-aebb-4b85-90de-86145010398d" status: 200 len: 1452 microversion: 2.1 time: 0.091296 Sep 08 10:45:03.861154 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 899/1820] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:45:03 2022] GET /compute/v2.1/images/42339e5a-aebb-4b85-90de-86145010398d => generated 1452 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:03.864307 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0886a538-2a6e-4ed6-95cf-ca0f30073796 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:03.868806 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3da5b1ab-92d0-4dfb-859f-dcc6f66abed7 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:03.870097 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3da5b1ab-92d0-4dfb-859f-dcc6f66abed7 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: cf3b6c0e-d390-44d6-91e5-09b389dff551] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:03.877514 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3da5b1ab-92d0-4dfb-859f-dcc6f66abed7 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:03.878415 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3da5b1ab-92d0-4dfb-859f-dcc6f66abed7 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:03.879171 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3da5b1ab-92d0-4dfb-859f-dcc6f66abed7 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:03.880304 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3da5b1ab-92d0-4dfb-859f-dcc6f66abed7 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:03.881951 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3da5b1ab-92d0-4dfb-859f-dcc6f66abed7 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:03.882571 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3da5b1ab-92d0-4dfb-859f-dcc6f66abed7 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:03.883826 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0886a538-2a6e-4ed6-95cf-ca0f30073796 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d" status: 200 len: 1496 microversion: 2.1 time: 1.064322 Sep 08 10:45:03.884647 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 922/1821] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:02 2022] GET /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d => generated 1496 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:45:04.081990 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3da5b1ab-92d0-4dfb-859f-dcc6f66abed7 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:04.094379 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3da5b1ab-92d0-4dfb-859f-dcc6f66abed7 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:04.096143 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3da5b1ab-92d0-4dfb-859f-dcc6f66abed7 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:04.097503 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3da5b1ab-92d0-4dfb-859f-dcc6f66abed7 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551" status: 200 len: 1487 microversion: 2.25 time: 0.234834 Sep 08 10:45:04.117871 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 900/1822] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:45:03 2022] GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551 => generated 1487 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:45:04.133868 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-477061c4-1a3d-4f8e-ba2c-a1b0c4f02e8a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:04.134612 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-477061c4-1a3d-4f8e-ba2c-a1b0c4f02e8a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: f9f308fa-d4a6-4ac9-8c64-927e082b0b4a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:04.145913 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-477061c4-1a3d-4f8e-ba2c-a1b0c4f02e8a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:04.149109 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-477061c4-1a3d-4f8e-ba2c-a1b0c4f02e8a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:04.152048 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-477061c4-1a3d-4f8e-ba2c-a1b0c4f02e8a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:04.153124 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-477061c4-1a3d-4f8e-ba2c-a1b0c4f02e8a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:04.154258 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-477061c4-1a3d-4f8e-ba2c-a1b0c4f02e8a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:04.161634 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-477061c4-1a3d-4f8e-ba2c-a1b0c4f02e8a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:04.514334 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c56196d4-203e-41b1-b889-20dfaa9bdbdf tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:04.515465 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c56196d4-203e-41b1-b889-20dfaa9bdbdf tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 90974422-0d77-4970-9e94-ed6b3376ed29] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:04.527054 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c56196d4-203e-41b1-b889-20dfaa9bdbdf tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:04.529121 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c56196d4-203e-41b1-b889-20dfaa9bdbdf tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:04.530020 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c56196d4-203e-41b1-b889-20dfaa9bdbdf tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:04.531743 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c56196d4-203e-41b1-b889-20dfaa9bdbdf tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:04.533644 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c56196d4-203e-41b1-b889-20dfaa9bdbdf tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:04.536460 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c56196d4-203e-41b1-b889-20dfaa9bdbdf tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:04.572572 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-477061c4-1a3d-4f8e-ba2c-a1b0c4f02e8a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:04.596570 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-477061c4-1a3d-4f8e-ba2c-a1b0c4f02e8a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a" status: 200 len: 1508 microversion: 2.1 time: 0.459939 Sep 08 10:45:04.599613 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 923/1823] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:04 2022] GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a => generated 1508 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:04.787031 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5cb1c58e-70ab-4633-923b-e96c9a8a319d tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:04.794092 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5cb1c58e-70ab-4633-923b-e96c9a8a319d tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 923d2401-f860-4284-a580-37ed478720f6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:04.799705 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c56196d4-203e-41b1-b889-20dfaa9bdbdf tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:04.804780 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5cb1c58e-70ab-4633-923b-e96c9a8a319d tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:04.805520 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5cb1c58e-70ab-4633-923b-e96c9a8a319d tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:04.806151 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5cb1c58e-70ab-4633-923b-e96c9a8a319d tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:04.807018 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5cb1c58e-70ab-4633-923b-e96c9a8a319d tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:04.810540 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c56196d4-203e-41b1-b889-20dfaa9bdbdf tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29" status: 200 len: 1391 microversion: 2.1 time: 0.299057 Sep 08 10:45:04.811143 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5cb1c58e-70ab-4633-923b-e96c9a8a319d tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:04.811985 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5cb1c58e-70ab-4633-923b-e96c9a8a319d tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:04.821763 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 901/1824] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:04 2022] GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29 => generated 1391 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:45:04.830417 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-5cb1c58e-70ab-4633-923b-e96c9a8a319d tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] HTTP exception thrown: Instance 923d2401-f860-4284-a580-37ed478720f6 could not be found. Sep 08 10:45:04.837680 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5cb1c58e-70ab-4633-923b-e96c9a8a319d tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Request method failure captured: Sep 08 10:45:04.837680 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6 HTTP/1.1 Sep 08 10:45:04.837680 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:45:04.837680 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:45:04.837680 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:45:04.837680 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:45:04.837680 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:45:04.837680 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:45:04.837680 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:45:04.837680 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:45:04.837680 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcYGgRkKVHRzVR9niOGjhwqpirZaCWJcRqqRBFlhL1VmFuxdG98PboRets-mDW1eiOn1mBTQzWopbf0-ncuece0UY9n3HH2MGNmaq7bojLbCqCyMZSM43Ty75CqX6jnN2RpnAuia-0vhvf6ydgpmghVLux4c6nabv9yseF4tgJm4EqM Sep 08 10:45:04.837680 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:45:04.837680 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:45:04.837680 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:45:04.837680 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:45:04.837680 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:45:04.837680 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:45:04.837680 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: a52c0b4a043445df94dab4dd4292607a Sep 08 10:45:04.837680 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-MigrationsAdminTest-381365870 Sep 08 10:45:04.837680 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:45:04.837680 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:45:04.837680 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a52c0b4a043445df94dab4dd4292607a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a52c0b4a043445df94dab4dd4292607a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a52c0b4a043445df94dab4dd4292607a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a52c0b4a043445df94dab4dd4292607a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:45:04.837680 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-MigrationsAdminTest-381365870 Sep 08 10:45:04.837680 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: a52c0b4a043445df94dab4dd4292607a Sep 08 10:45:04.837680 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-MigrationsAdminTest-381365870 Sep 08 10:45:04.837680 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-MigrationsAdminTest-381365870-project Sep 08 10:45:04.837680 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:45:04.837680 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:45:04.837680 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 5450284cb50b4f75be0915074bf8fe78 Sep 08 10:45:04.837680 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-MigrationsAdminTest-381365870-project Sep 08 10:45:04.837680 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:45:04.837680 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 923d2401-f860-4284-a580-37ed478720f6 could not be found. Sep 08 10:45:04.837680 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '923d2401-f860-4284-a580-37ed478720f6'} Sep 08 10:45:04.837680 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:45:04.837680 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:45:04.837680 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:45:04.837680 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:45:04.837680 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:45:04.837680 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:45:04.837680 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:45:04.837680 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:45:04.837680 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:45:04.837680 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:45:04.837680 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 923d2401-f860-4284-a580-37ed478720f6 could not be found. Sep 08 10:45:04.837680 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:45:04.837680 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:45:04.837680 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:45:04.837680 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:45:04.837680 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:45:04.837680 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:45:04.837680 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:45:04.837680 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:45:04.837680 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:45:04.837680 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:45:04.837680 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:45:04.837680 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:45:04.837680 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:45:04.837680 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:45:04.837680 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:45:04.837680 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:45:04.837680 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 923d2401-f860-4284-a580-37ed478720f6 could not be found. Sep 08 10:45:04.837680 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:45:04.837680 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:45:04.837680 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:45:04.843952 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:45:04.843952 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:45:04.843952 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:45:04.843952 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:45:04.843952 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:45:04.843952 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 923d2401-f860-4284-a580-37ed478720f6 could not be found. Sep 08 10:45:04.843952 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:45:04.848667 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5cb1c58e-70ab-4633-923b-e96c9a8a319d tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Returning 404 to user: Instance 923d2401-f860-4284-a580-37ed478720f6 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:45:04.850591 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5cb1c58e-70ab-4633-923b-e96c9a8a319d tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6" status: 404 len: 111 microversion: 2.1 time: 0.067953 Sep 08 10:45:04.852377 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 924/1825] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:04 2022] GET /compute/v2.1/servers/923d2401-f860-4284-a580-37ed478720f6 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:45:04.860294 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-72c2e0f7-e4f8-441c-9b3f-62e7e824f0bd tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:04.861776 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-72c2e0f7-e4f8-441c-9b3f-62e7e824f0bd tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 815705bc-e49e-47a1-864b-9cc550464808] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:04.884892 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-72c2e0f7-e4f8-441c-9b3f-62e7e824f0bd tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:04.886859 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5a3a69be-a6ae-400a-9724-c022a24afb80 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '.version_select at 0x7f68e4959d30>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:04.888074 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-72c2e0f7-e4f8-441c-9b3f-62e7e824f0bd tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:04.888757 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-72c2e0f7-e4f8-441c-9b3f-62e7e824f0bd tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:04.889692 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-72c2e0f7-e4f8-441c-9b3f-62e7e824f0bd tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:04.893806 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-72c2e0f7-e4f8-441c-9b3f-62e7e824f0bd tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:04.895947 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-72c2e0f7-e4f8-441c-9b3f-62e7e824f0bd tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:05.001271 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5a3a69be-a6ae-400a-9724-c022a24afb80 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/images/42339e5a-aebb-4b85-90de-86145010398d" status: 200 len: 1452 microversion: 2.1 time: 0.127258 Sep 08 10:45:05.002486 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 925/1826] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:45:04 2022] GET /compute/v2.1/images/42339e5a-aebb-4b85-90de-86145010398d => generated 1452 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:05.010444 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-721d84c8-f065-4e50-ba5b-3cb936338172 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:05.021669 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-721d84c8-f065-4e50-ba5b-3cb936338172 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 64c88fa0-6a01-42fc-b0e9-98b9e84a199d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:05.025093 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-72c2e0f7-e4f8-441c-9b3f-62e7e824f0bd tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 815705bc-e49e-47a1-864b-9cc550464808] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:45:05.038986 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-721d84c8-f065-4e50-ba5b-3cb936338172 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:05.040797 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-721d84c8-f065-4e50-ba5b-3cb936338172 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:05.041688 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-721d84c8-f065-4e50-ba5b-3cb936338172 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:05.046257 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-721d84c8-f065-4e50-ba5b-3cb936338172 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:05.047163 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-721d84c8-f065-4e50-ba5b-3cb936338172 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:05.047774 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-721d84c8-f065-4e50-ba5b-3cb936338172 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:05.241502 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-72c2e0f7-e4f8-441c-9b3f-62e7e824f0bd tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "DELETE /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808" status: 204 len: 0 microversion: 2.1 time: 0.384505 Sep 08 10:45:05.243355 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 902/1827] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:45:04 2022] DELETE /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 10:45:05.250252 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-15534e82-ee1a-42dd-b645-13ca29ab9a6f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:05.251297 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-15534e82-ee1a-42dd-b645-13ca29ab9a6f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: cf3b6c0e-d390-44d6-91e5-09b389dff551] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:05.260001 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15534e82-ee1a-42dd-b645-13ca29ab9a6f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:05.260797 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15534e82-ee1a-42dd-b645-13ca29ab9a6f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:05.261481 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15534e82-ee1a-42dd-b645-13ca29ab9a6f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:05.262915 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15534e82-ee1a-42dd-b645-13ca29ab9a6f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:05.269999 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15534e82-ee1a-42dd-b645-13ca29ab9a6f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:05.271431 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15534e82-ee1a-42dd-b645-13ca29ab9a6f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:05.471857 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-15534e82-ee1a-42dd-b645-13ca29ab9a6f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:05.511393 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-15534e82-ee1a-42dd-b645-13ca29ab9a6f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:05.512685 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-15534e82-ee1a-42dd-b645-13ca29ab9a6f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:05.513269 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-15534e82-ee1a-42dd-b645-13ca29ab9a6f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551" status: 200 len: 1477 microversion: 2.25 time: 0.268432 Sep 08 10:45:05.514363 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 903/1828] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:45:05 2022] GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551 => generated 1477 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:45:05.525801 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5c26a976-d24f-4de0-b875-ee34eabd391e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:05.529264 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5c26a976-d24f-4de0-b875-ee34eabd391e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 815705bc-e49e-47a1-864b-9cc550464808] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:05.533491 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c26a976-d24f-4de0-b875-ee34eabd391e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:05.533989 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c26a976-d24f-4de0-b875-ee34eabd391e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:05.534481 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c26a976-d24f-4de0-b875-ee34eabd391e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:05.535210 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c26a976-d24f-4de0-b875-ee34eabd391e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:05.535707 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c26a976-d24f-4de0-b875-ee34eabd391e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:05.536135 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c26a976-d24f-4de0-b875-ee34eabd391e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:05.793115 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-721d84c8-f065-4e50-ba5b-3cb936338172 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:05.803619 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-721d84c8-f065-4e50-ba5b-3cb936338172 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d" status: 200 len: 1496 microversion: 2.1 time: 0.799493 Sep 08 10:45:05.810602 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 926/1829] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:05 2022] GET /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d => generated 1496 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:05.824661 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5c26a976-d24f-4de0-b875-ee34eabd391e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:05.840319 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5fc3fea0-be76-424c-ba0c-d37d019c551e tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Calling method '.version_select at 0x7f68e461f550>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:05.849695 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5fc3fea0-be76-424c-ba0c-d37d019c551e tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:05.861486 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5fc3fea0-be76-424c-ba0c-d37d019c551e tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:05.868652 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5fc3fea0-be76-424c-ba0c-d37d019c551e tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:05.871868 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5c26a976-d24f-4de0-b875-ee34eabd391e tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808" status: 200 len: 1469 microversion: 2.1 time: 0.355081 Sep 08 10:45:05.880556 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 904/1830] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:05 2022] GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808 => generated 1469 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:05.893459 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1f2b1e7c-6bb4-47e9-a2c2-a13169e12de3 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:05.894667 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5fc3fea0-be76-424c-ba0c-d37d019c551e tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 4329 microversion: 2.25 time: 0.081246 Sep 08 10:45:05.895138 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1f2b1e7c-6bb4-47e9-a2c2-a13169e12de3 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: f9f308fa-d4a6-4ac9-8c64-927e082b0b4a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:05.896363 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 927/1831] 10.222.0.27 () {60 vars in 1184 bytes} [Thu Sep 8 10:45:05 2022] GET /compute/v2.1/os-migrations => generated 4329 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:45:05.910003 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f2b1e7c-6bb4-47e9-a2c2-a13169e12de3 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:05.910511 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f2b1e7c-6bb4-47e9-a2c2-a13169e12de3 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:05.910955 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f2b1e7c-6bb4-47e9-a2c2-a13169e12de3 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:05.916659 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f2b1e7c-6bb4-47e9-a2c2-a13169e12de3 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:05.917445 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f2b1e7c-6bb4-47e9-a2c2-a13169e12de3 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:05.918093 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f2b1e7c-6bb4-47e9-a2c2-a13169e12de3 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:05.929774 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f728bdc3-8a30-483b-837f-a7b877fcb661 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:05.930706 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f728bdc3-8a30-483b-837f-a7b877fcb661 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 90974422-0d77-4970-9e94-ed6b3376ed29] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:05.947691 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f728bdc3-8a30-483b-837f-a7b877fcb661 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:05.948489 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f728bdc3-8a30-483b-837f-a7b877fcb661 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:05.949117 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f728bdc3-8a30-483b-837f-a7b877fcb661 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:05.950155 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f728bdc3-8a30-483b-837f-a7b877fcb661 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:05.950826 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f728bdc3-8a30-483b-837f-a7b877fcb661 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:05.951413 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f728bdc3-8a30-483b-837f-a7b877fcb661 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:06.368121 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1f2b1e7c-6bb4-47e9-a2c2-a13169e12de3 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:06.382166 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f728bdc3-8a30-483b-837f-a7b877fcb661 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:06.383160 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1f2b1e7c-6bb4-47e9-a2c2-a13169e12de3 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a" status: 200 len: 1508 microversion: 2.1 time: 0.496262 Sep 08 10:45:06.383968 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 905/1832] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:05 2022] GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a => generated 1508 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:06.391141 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-37552bdf-2faa-486a-b34d-e46c3d60b59a tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:06.402961 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-37552bdf-2faa-486a-b34d-e46c3d60b59a tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] [instance: cf3b6c0e-d390-44d6-91e5-09b389dff551] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:06.418335 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-37552bdf-2faa-486a-b34d-e46c3d60b59a tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:06.419326 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-37552bdf-2faa-486a-b34d-e46c3d60b59a tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:06.421267 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-37552bdf-2faa-486a-b34d-e46c3d60b59a tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:06.423252 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f728bdc3-8a30-483b-837f-a7b877fcb661 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29" status: 200 len: 1391 microversion: 2.1 time: 0.501223 Sep 08 10:45:06.423432 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-37552bdf-2faa-486a-b34d-e46c3d60b59a tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:06.426122 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-37552bdf-2faa-486a-b34d-e46c3d60b59a tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:06.426948 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-37552bdf-2faa-486a-b34d-e46c3d60b59a tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:06.429657 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 928/1833] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:05 2022] GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29 => generated 1391 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:06.452313 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cc5c739c-a4fe-4706-aa64-ab68c6876c99 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '.version_select at 0x7f68e4959a60>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:06.584377 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cc5c739c-a4fe-4706-aa64-ab68c6876c99 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/images/42339e5a-aebb-4b85-90de-86145010398d" status: 200 len: 1452 microversion: 2.1 time: 0.152483 Sep 08 10:45:06.586116 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 929/1834] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:45:06 2022] GET /compute/v2.1/images/42339e5a-aebb-4b85-90de-86145010398d => generated 1452 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:06.838812 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1eb26c4b-0048-4ee3-b9e6-65292c8ab05a tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:06.839818 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1eb26c4b-0048-4ee3-b9e6-65292c8ab05a tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 64c88fa0-6a01-42fc-b0e9-98b9e84a199d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:06.875321 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1eb26c4b-0048-4ee3-b9e6-65292c8ab05a tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:06.876233 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1eb26c4b-0048-4ee3-b9e6-65292c8ab05a tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:06.877343 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1eb26c4b-0048-4ee3-b9e6-65292c8ab05a tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:06.881746 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1eb26c4b-0048-4ee3-b9e6-65292c8ab05a tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:06.894625 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1eb26c4b-0048-4ee3-b9e6-65292c8ab05a tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:06.900809 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1eb26c4b-0048-4ee3-b9e6-65292c8ab05a tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:07.045185 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-37552bdf-2faa-486a-b34d-e46c3d60b59a tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] Lazy-loading 'services' on Instance uuid cf3b6c0e-d390-44d6-91e5-09b389dff551 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:45:07.070226 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-37552bdf-2faa-486a-b34d-e46c3d60b59a tempest-LiveAutoBlockMigrationV225Test-1918741875 tempest-LiveAutoBlockMigrationV225Test-1918741875-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551" status: 200 len: 1971 microversion: 2.25 time: 0.684646 Sep 08 10:45:07.071112 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 906/1835] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:45:06 2022] GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551 => generated 1971 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:45:07.078226 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f1a0d913-9d3f-4510-943c-fe100423fa79 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:07.079081 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f1a0d913-9d3f-4510-943c-fe100423fa79 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 815705bc-e49e-47a1-864b-9cc550464808] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:07.092104 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1a0d913-9d3f-4510-943c-fe100423fa79 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:07.096623 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1a0d913-9d3f-4510-943c-fe100423fa79 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:07.098856 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1a0d913-9d3f-4510-943c-fe100423fa79 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:07.101322 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1a0d913-9d3f-4510-943c-fe100423fa79 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:07.101812 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1a0d913-9d3f-4510-943c-fe100423fa79 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:07.104215 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1a0d913-9d3f-4510-943c-fe100423fa79 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:07.325604 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f1a0d913-9d3f-4510-943c-fe100423fa79 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5450284cb50b4f75be0915074bf8fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c0b4a043445df94dab4dd4292607a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:07.360133 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f1a0d913-9d3f-4510-943c-fe100423fa79 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808" status: 200 len: 1427 microversion: 2.1 time: 0.287421 Sep 08 10:45:07.364758 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 907/1836] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:07 2022] GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808 => generated 1427 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:07.372716 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-98ed3083-9289-466c-906f-c1ba28c83500 req-3f07a111-7c11-4708-a50c-73a6c1f0da48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "815705bc-e49e-47a1-864b-9cc550464808", "name": "network-vif-deleted", "tag": "9c8702f3-cdfe-4a4b-9877-3df5412c0e8d"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:45:07.402610 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-98ed3083-9289-466c-906f-c1ba28c83500 req-3f07a111-7c11-4708-a50c-73a6c1f0da48 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:07.405303 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-98ed3083-9289-466c-906f-c1ba28c83500 req-3f07a111-7c11-4708-a50c-73a6c1f0da48 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:07.406153 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-98ed3083-9289-466c-906f-c1ba28c83500 req-3f07a111-7c11-4708-a50c-73a6c1f0da48 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:07.447044 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-98ed3083-9289-466c-906f-c1ba28c83500 req-3f07a111-7c11-4708-a50c-73a6c1f0da48 service nova] Creating event network-vif-deleted:9c8702f3-cdfe-4a4b-9877-3df5412c0e8d for instance 815705bc-e49e-47a1-864b-9cc550464808 on n-h2-850501-12 Sep 08 10:45:07.471039 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-98ed3083-9289-466c-906f-c1ba28c83500 req-3f07a111-7c11-4708-a50c-73a6c1f0da48 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098454 Sep 08 10:45:07.472333 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 908/1837] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:45:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:45:07.485806 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6a0335b6-7b57-4fc0-9fe1-6bed37e1254f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:07.488668 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6a0335b6-7b57-4fc0-9fe1-6bed37e1254f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: cf3b6c0e-d390-44d6-91e5-09b389dff551] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:07.511683 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a0335b6-7b57-4fc0-9fe1-6bed37e1254f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:07.512240 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a0335b6-7b57-4fc0-9fe1-6bed37e1254f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:07.515324 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a0335b6-7b57-4fc0-9fe1-6bed37e1254f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:07.516174 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a0335b6-7b57-4fc0-9fe1-6bed37e1254f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:07.516841 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a0335b6-7b57-4fc0-9fe1-6bed37e1254f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:07.518849 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a0335b6-7b57-4fc0-9fe1-6bed37e1254f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:07.631666 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:45:07.653649 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6a0335b6-7b57-4fc0-9fe1-6bed37e1254f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: cf3b6c0e-d390-44d6-91e5-09b389dff551] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:45:07.889643 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6a0335b6-7b57-4fc0-9fe1-6bed37e1254f tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "DELETE /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551" status: 204 len: 0 microversion: 2.25 time: 0.411289 Sep 08 10:45:07.899044 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 909/1838] 10.222.0.27 () {60 vars in 1280 bytes} [Thu Sep 8 10:45:07 2022] DELETE /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 10:45:07.938076 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-79f3b589-e1fa-4626-8f60-e08dcac5b86a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:07.940978 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-79f3b589-e1fa-4626-8f60-e08dcac5b86a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: f9f308fa-d4a6-4ac9-8c64-927e082b0b4a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:07.964002 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-79f3b589-e1fa-4626-8f60-e08dcac5b86a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:07.969327 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-79f3b589-e1fa-4626-8f60-e08dcac5b86a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:07.973190 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-79f3b589-e1fa-4626-8f60-e08dcac5b86a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:07.975803 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-79f3b589-e1fa-4626-8f60-e08dcac5b86a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:07.977309 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-79f3b589-e1fa-4626-8f60-e08dcac5b86a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:07.977897 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-79f3b589-e1fa-4626-8f60-e08dcac5b86a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:08.172293 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1eb26c4b-0048-4ee3-b9e6-65292c8ab05a tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:08.197158 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1eb26c4b-0048-4ee3-b9e6-65292c8ab05a tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d" status: 200 len: 1496 microversion: 2.1 time: 1.364225 Sep 08 10:45:08.200904 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 930/1839] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:06 2022] GET /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d => generated 1496 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:45:08.210136 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fc2eb62e-8124-44f9-b4d5-4dda644c435f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:08.222286 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fc2eb62e-8124-44f9-b4d5-4dda644c435f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 90974422-0d77-4970-9e94-ed6b3376ed29] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:08.237695 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fc2eb62e-8124-44f9-b4d5-4dda644c435f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:08.245720 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fc2eb62e-8124-44f9-b4d5-4dda644c435f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:08.246920 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fc2eb62e-8124-44f9-b4d5-4dda644c435f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:08.251781 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fc2eb62e-8124-44f9-b4d5-4dda644c435f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:08.253437 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fc2eb62e-8124-44f9-b4d5-4dda644c435f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:08.263948 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fc2eb62e-8124-44f9-b4d5-4dda644c435f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:08.367546 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-79f3b589-e1fa-4626-8f60-e08dcac5b86a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:08.384100 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-79f3b589-e1fa-4626-8f60-e08dcac5b86a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a" status: 200 len: 1508 microversion: 2.1 time: 0.482766 Sep 08 10:45:08.386415 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 910/1840] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:07 2022] GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a => generated 1508 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:08.392915 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7c9e8d15-5fdb-4c3d-b571-21a53ae09a6f tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '.version_select at 0x7f68e45cbd30>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:08.474391 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7c9e8d15-5fdb-4c3d-b571-21a53ae09a6f tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/images/42339e5a-aebb-4b85-90de-86145010398d" status: 200 len: 1452 microversion: 2.1 time: 0.086350 Sep 08 10:45:08.476507 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 911/1841] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:45:08 2022] GET /compute/v2.1/images/42339e5a-aebb-4b85-90de-86145010398d => generated 1452 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:08.484808 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c1f7b792-4368-41f8-93f7-b699efaf2977 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:08.485944 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c1f7b792-4368-41f8-93f7-b699efaf2977 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: cf3b6c0e-d390-44d6-91e5-09b389dff551] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:08.497378 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c1f7b792-4368-41f8-93f7-b699efaf2977 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:08.498921 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c1f7b792-4368-41f8-93f7-b699efaf2977 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:08.499954 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c1f7b792-4368-41f8-93f7-b699efaf2977 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:08.501562 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c1f7b792-4368-41f8-93f7-b699efaf2977 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:08.502685 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c1f7b792-4368-41f8-93f7-b699efaf2977 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:08.503681 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c1f7b792-4368-41f8-93f7-b699efaf2977 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:08.968554 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c1f7b792-4368-41f8-93f7-b699efaf2977 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:08.991040 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c1f7b792-4368-41f8-93f7-b699efaf2977 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:08.998144 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c1f7b792-4368-41f8-93f7-b699efaf2977 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:09.005761 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c1f7b792-4368-41f8-93f7-b699efaf2977 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551" status: 200 len: 1483 microversion: 2.25 time: 0.526224 Sep 08 10:45:09.007210 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 912/1842] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:45:08 2022] GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551 => generated 1483 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:45:09.039231 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a8c4c488-34c5-455d-8943-b6c72464e822 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:09.040811 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a8c4c488-34c5-455d-8943-b6c72464e822 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] [instance: 815705bc-e49e-47a1-864b-9cc550464808] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:09.056140 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a8c4c488-34c5-455d-8943-b6c72464e822 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:09.057139 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a8c4c488-34c5-455d-8943-b6c72464e822 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:09.057987 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a8c4c488-34c5-455d-8943-b6c72464e822 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:09.058904 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a8c4c488-34c5-455d-8943-b6c72464e822 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:09.059666 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a8c4c488-34c5-455d-8943-b6c72464e822 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:09.060512 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a8c4c488-34c5-455d-8943-b6c72464e822 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:09.102834 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-a8c4c488-34c5-455d-8943-b6c72464e822 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] HTTP exception thrown: Instance 815705bc-e49e-47a1-864b-9cc550464808 could not be found. Sep 08 10:45:09.104833 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a8c4c488-34c5-455d-8943-b6c72464e822 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Request method failure captured: Sep 08 10:45:09.104833 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808 HTTP/1.1 Sep 08 10:45:09.104833 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:45:09.104833 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:45:09.104833 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:45:09.104833 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:45:09.104833 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:45:09.104833 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:45:09.104833 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:45:09.104833 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:45:09.104833 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcYGgRkKVHRzVR9niOGjhwqpirZaCWJcRqqRBFlhL1VmFuxdG98PboRets-mDW1eiOn1mBTQzWopbf0-ncuece0UY9n3HH2MGNmaq7bojLbCqCyMZSM43Ty75CqX6jnN2RpnAuia-0vhvf6ydgpmghVLux4c6nabv9yseF4tgJm4EqM Sep 08 10:45:09.104833 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:45:09.104833 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:45:09.104833 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:45:09.104833 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:45:09.104833 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:45:09.104833 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:45:09.104833 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: a52c0b4a043445df94dab4dd4292607a Sep 08 10:45:09.104833 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-MigrationsAdminTest-381365870 Sep 08 10:45:09.104833 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:45:09.104833 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:45:09.104833 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a52c0b4a043445df94dab4dd4292607a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a52c0b4a043445df94dab4dd4292607a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a52c0b4a043445df94dab4dd4292607a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a52c0b4a043445df94dab4dd4292607a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:45:09.104833 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-MigrationsAdminTest-381365870 Sep 08 10:45:09.104833 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: a52c0b4a043445df94dab4dd4292607a Sep 08 10:45:09.104833 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-MigrationsAdminTest-381365870 Sep 08 10:45:09.104833 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-MigrationsAdminTest-381365870-project Sep 08 10:45:09.104833 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:45:09.104833 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:45:09.104833 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 5450284cb50b4f75be0915074bf8fe78 Sep 08 10:45:09.104833 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-MigrationsAdminTest-381365870-project Sep 08 10:45:09.104833 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:45:09.104833 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 815705bc-e49e-47a1-864b-9cc550464808 could not be found. Sep 08 10:45:09.104833 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '815705bc-e49e-47a1-864b-9cc550464808'} Sep 08 10:45:09.104833 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:45:09.104833 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:45:09.104833 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:45:09.104833 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:45:09.104833 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:45:09.104833 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:45:09.104833 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:45:09.104833 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:45:09.104833 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:45:09.104833 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:45:09.104833 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 815705bc-e49e-47a1-864b-9cc550464808 could not be found. Sep 08 10:45:09.104833 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:45:09.104833 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:45:09.104833 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:45:09.104833 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:45:09.104833 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:45:09.104833 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:45:09.104833 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:45:09.104833 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:45:09.104833 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:45:09.104833 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:45:09.104833 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:45:09.104833 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:45:09.104833 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:45:09.104833 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:45:09.104833 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:45:09.104833 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:45:09.104833 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 815705bc-e49e-47a1-864b-9cc550464808 could not be found. Sep 08 10:45:09.104833 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:45:09.104833 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:45:09.104833 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:45:09.110329 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:45:09.110329 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:45:09.110329 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:45:09.110329 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:45:09.110329 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:45:09.110329 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 815705bc-e49e-47a1-864b-9cc550464808 could not be found. Sep 08 10:45:09.110329 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:45:09.112180 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a8c4c488-34c5-455d-8943-b6c72464e822 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] Returning 404 to user: Instance 815705bc-e49e-47a1-864b-9cc550464808 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:45:09.113332 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a8c4c488-34c5-455d-8943-b6c72464e822 tempest-MigrationsAdminTest-381365870 tempest-MigrationsAdminTest-381365870-project] 10.222.0.27 "GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808" status: 404 len: 111 microversion: 2.1 time: 0.086272 Sep 08 10:45:09.122021 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 913/1843] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:09 2022] GET /compute/v2.1/servers/815705bc-e49e-47a1-864b-9cc550464808 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:45:09.231256 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6670fdf4-5a43-42ce-9450-c4aad7e4c248 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:09.232523 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6670fdf4-5a43-42ce-9450-c4aad7e4c248 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 64c88fa0-6a01-42fc-b0e9-98b9e84a199d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:09.252419 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6670fdf4-5a43-42ce-9450-c4aad7e4c248 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:09.258231 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6670fdf4-5a43-42ce-9450-c4aad7e4c248 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:09.259166 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6670fdf4-5a43-42ce-9450-c4aad7e4c248 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:09.262958 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6670fdf4-5a43-42ce-9450-c4aad7e4c248 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:09.264143 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6670fdf4-5a43-42ce-9450-c4aad7e4c248 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:09.265870 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6670fdf4-5a43-42ce-9450-c4aad7e4c248 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:09.341529 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-fc2eb62e-8124-44f9-b4d5-4dda644c435f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:09.354832 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fc2eb62e-8124-44f9-b4d5-4dda644c435f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29" status: 200 len: 1391 microversion: 2.1 time: 1.152079 Sep 08 10:45:09.373105 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 931/1844] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:08 2022] GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29 => generated 1391 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:09.415815 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-58aa8a52-d03c-485a-badf-3439f9f0a211 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:09.415815 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-58aa8a52-d03c-485a-badf-3439f9f0a211 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: f9f308fa-d4a6-4ac9-8c64-927e082b0b4a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:09.439412 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-58aa8a52-d03c-485a-badf-3439f9f0a211 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:09.440130 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-58aa8a52-d03c-485a-badf-3439f9f0a211 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:09.440819 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-58aa8a52-d03c-485a-badf-3439f9f0a211 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:09.445593 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-58aa8a52-d03c-485a-badf-3439f9f0a211 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:09.448098 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-58aa8a52-d03c-485a-badf-3439f9f0a211 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:09.449480 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-58aa8a52-d03c-485a-badf-3439f9f0a211 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:10.138019 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6670fdf4-5a43-42ce-9450-c4aad7e4c248 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:10.169303 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6670fdf4-5a43-42ce-9450-c4aad7e4c248 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d" status: 200 len: 1496 microversion: 2.1 time: 0.943301 Sep 08 10:45:10.191808 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 914/1845] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:09 2022] GET /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d => generated 1496 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:10.211140 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e33f3309-6d15-40c8-b296-c1a22c1eedea tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '.version_select at 0x7f68e4350ee0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:10.235861 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-58aa8a52-d03c-485a-badf-3439f9f0a211 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:10.247333 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-58aa8a52-d03c-485a-badf-3439f9f0a211 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a" status: 200 len: 1508 microversion: 2.1 time: 0.839197 Sep 08 10:45:10.261694 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 932/1846] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:09 2022] GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a => generated 1508 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:45:10.282624 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-911f101b-0014-4e1b-b09c-402d34922807 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:10.283271 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-911f101b-0014-4e1b-b09c-402d34922807 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: cf3b6c0e-d390-44d6-91e5-09b389dff551] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:10.298842 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e33f3309-6d15-40c8-b296-c1a22c1eedea tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/images/42339e5a-aebb-4b85-90de-86145010398d" status: 200 len: 1452 microversion: 2.1 time: 0.099441 Sep 08 10:45:10.299805 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 915/1847] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:45:10 2022] GET /compute/v2.1/images/42339e5a-aebb-4b85-90de-86145010398d => generated 1452 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:10.308748 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-8357922a-d924-451a-83dc-a0014908a0ec req-a2d967d8-b06d-4535-9efa-00b2522ee72a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf3b6c0e-d390-44d6-91e5-09b389dff551", "name": "network-vif-deleted", "tag": "1744beb8-80b4-4c92-8ebb-bb2e04113c75"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:45:10.312786 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-911f101b-0014-4e1b-b09c-402d34922807 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:10.347621 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:UPDATE=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:45:10.354520 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-911f101b-0014-4e1b-b09c-402d34922807 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:10.355163 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-911f101b-0014-4e1b-b09c-402d34922807 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.042s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:10.355847 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-911f101b-0014-4e1b-b09c-402d34922807 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:10.356342 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-911f101b-0014-4e1b-b09c-402d34922807 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:10.356776 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-911f101b-0014-4e1b-b09c-402d34922807 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:10.373359 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-8357922a-d924-451a-83dc-a0014908a0ec req-a2d967d8-b06d-4535-9efa-00b2522ee72a service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:10.373776 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-8357922a-d924-451a-83dc-a0014908a0ec req-a2d967d8-b06d-4535-9efa-00b2522ee72a service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:10.374260 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-8357922a-d924-451a-83dc-a0014908a0ec req-a2d967d8-b06d-4535-9efa-00b2522ee72a service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:10.440064 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-8357922a-d924-451a-83dc-a0014908a0ec req-a2d967d8-b06d-4535-9efa-00b2522ee72a service nova] Creating event network-vif-deleted:1744beb8-80b4-4c92-8ebb-bb2e04113c75 for instance cf3b6c0e-d390-44d6-91e5-09b389dff551 on n-h1-850501-12 Sep 08 10:45:10.483099 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-8357922a-d924-451a-83dc-a0014908a0ec req-a2d967d8-b06d-4535-9efa-00b2522ee72a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171250 Sep 08 10:45:10.485436 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 916/1848] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:45:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:45:10.516193 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-124b6245-5ffa-44de-b6a8-829cac0bbf3e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:10.522563 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-124b6245-5ffa-44de-b6a8-829cac0bbf3e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 90974422-0d77-4970-9e94-ed6b3376ed29] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:10.588354 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-124b6245-5ffa-44de-b6a8-829cac0bbf3e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:10.589194 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-124b6245-5ffa-44de-b6a8-829cac0bbf3e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:10.600603 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-124b6245-5ffa-44de-b6a8-829cac0bbf3e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:10.601552 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-124b6245-5ffa-44de-b6a8-829cac0bbf3e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:10.602042 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-124b6245-5ffa-44de-b6a8-829cac0bbf3e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:10.606270 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-124b6245-5ffa-44de-b6a8-829cac0bbf3e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:10.703075 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-911f101b-0014-4e1b-b09c-402d34922807 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:10.718661 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-911f101b-0014-4e1b-b09c-402d34922807 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:10.720501 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-911f101b-0014-4e1b-b09c-402d34922807 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:10.726293 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-911f101b-0014-4e1b-b09c-402d34922807 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551" status: 200 len: 1265 microversion: 2.25 time: 0.463481 Sep 08 10:45:10.729202 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 933/1849] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:45:10 2022] GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551 => generated 1265 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:45:11.013686 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-124b6245-5ffa-44de-b6a8-829cac0bbf3e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:11.024100 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-124b6245-5ffa-44de-b6a8-829cac0bbf3e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29" status: 200 len: 1391 microversion: 2.1 time: 0.535530 Sep 08 10:45:11.033080 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 917/1850] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:10 2022] GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29 => generated 1391 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:11.201838 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4c6250d2-2859-47c9-a2e9-bab3af95d1e8 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:11.202454 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4c6250d2-2859-47c9-a2e9-bab3af95d1e8 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 64c88fa0-6a01-42fc-b0e9-98b9e84a199d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:11.211006 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4c6250d2-2859-47c9-a2e9-bab3af95d1e8 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:11.211490 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4c6250d2-2859-47c9-a2e9-bab3af95d1e8 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:11.211936 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4c6250d2-2859-47c9-a2e9-bab3af95d1e8 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:11.212659 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4c6250d2-2859-47c9-a2e9-bab3af95d1e8 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:11.213137 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4c6250d2-2859-47c9-a2e9-bab3af95d1e8 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:11.213565 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4c6250d2-2859-47c9-a2e9-bab3af95d1e8 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:11.289305 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-411d1afa-c3f1-4a83-bf0b-94a7a0331a72 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:11.291434 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-411d1afa-c3f1-4a83-bf0b-94a7a0331a72 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: f9f308fa-d4a6-4ac9-8c64-927e082b0b4a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:11.310941 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-411d1afa-c3f1-4a83-bf0b-94a7a0331a72 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:11.311493 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-411d1afa-c3f1-4a83-bf0b-94a7a0331a72 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:11.311954 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-411d1afa-c3f1-4a83-bf0b-94a7a0331a72 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:11.312705 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-411d1afa-c3f1-4a83-bf0b-94a7a0331a72 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:11.320632 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-411d1afa-c3f1-4a83-bf0b-94a7a0331a72 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:11.320981 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-411d1afa-c3f1-4a83-bf0b-94a7a0331a72 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:11.658410 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-411d1afa-c3f1-4a83-bf0b-94a7a0331a72 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:11.670057 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-411d1afa-c3f1-4a83-bf0b-94a7a0331a72 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a" status: 200 len: 1508 microversion: 2.1 time: 0.386033 Sep 08 10:45:11.671362 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 918/1851] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:11 2022] GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a => generated 1508 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:45:11.676227 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-30cb8795-5fa4-408f-9c07-83376fa02ce9 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '.version_select at 0x7f68e8b32700>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:11.744415 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-30cb8795-5fa4-408f-9c07-83376fa02ce9 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/images/42339e5a-aebb-4b85-90de-86145010398d" status: 200 len: 1452 microversion: 2.1 time: 0.071146 Sep 08 10:45:11.765060 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4c6250d2-2859-47c9-a2e9-bab3af95d1e8 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:11.766520 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 919/1852] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:45:11 2022] GET /compute/v2.1/images/42339e5a-aebb-4b85-90de-86145010398d => generated 1452 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:11.774770 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4c6250d2-2859-47c9-a2e9-bab3af95d1e8 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d" status: 200 len: 1496 microversion: 2.1 time: 0.576690 Sep 08 10:45:11.782940 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 934/1853] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:11 2022] GET /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d => generated 1496 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:11.795169 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b8896082-09e4-4913-a6f9-a2cde2913c00 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:11.795815 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b8896082-09e4-4913-a6f9-a2cde2913c00 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: cf3b6c0e-d390-44d6-91e5-09b389dff551] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:11.810922 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8896082-09e4-4913-a6f9-a2cde2913c00 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:11.812077 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8896082-09e4-4913-a6f9-a2cde2913c00 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:11.812689 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8896082-09e4-4913-a6f9-a2cde2913c00 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:11.813613 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8896082-09e4-4913-a6f9-a2cde2913c00 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:11.814090 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8896082-09e4-4913-a6f9-a2cde2913c00 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:11.814851 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8896082-09e4-4913-a6f9-a2cde2913c00 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:11.974781 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b8896082-09e4-4913-a6f9-a2cde2913c00 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:11.985602 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b8896082-09e4-4913-a6f9-a2cde2913c00 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:11.987115 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b8896082-09e4-4913-a6f9-a2cde2913c00 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:11.988419 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b8896082-09e4-4913-a6f9-a2cde2913c00 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551" status: 200 len: 1265 microversion: 2.25 time: 0.219887 Sep 08 10:45:12.001060 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 920/1854] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:45:11 2022] GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551 => generated 1265 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:45:12.060171 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c19ee960-715c-4332-b5ea-26c18ae9c93e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:12.060930 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c19ee960-715c-4332-b5ea-26c18ae9c93e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 90974422-0d77-4970-9e94-ed6b3376ed29] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:12.073117 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c19ee960-715c-4332-b5ea-26c18ae9c93e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:12.073585 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c19ee960-715c-4332-b5ea-26c18ae9c93e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:12.074029 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c19ee960-715c-4332-b5ea-26c18ae9c93e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:12.074739 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c19ee960-715c-4332-b5ea-26c18ae9c93e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:12.075190 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c19ee960-715c-4332-b5ea-26c18ae9c93e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:12.078553 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c19ee960-715c-4332-b5ea-26c18ae9c93e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:12.697282 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a570b39a-5f28-4a8a-a4b0-945b6a06e211 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:12.698100 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a570b39a-5f28-4a8a-a4b0-945b6a06e211 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: f9f308fa-d4a6-4ac9-8c64-927e082b0b4a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:12.722217 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a570b39a-5f28-4a8a-a4b0-945b6a06e211 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:12.724155 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a570b39a-5f28-4a8a-a4b0-945b6a06e211 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:12.725406 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a570b39a-5f28-4a8a-a4b0-945b6a06e211 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:12.731182 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a570b39a-5f28-4a8a-a4b0-945b6a06e211 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:12.735338 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a570b39a-5f28-4a8a-a4b0-945b6a06e211 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:12.739965 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a570b39a-5f28-4a8a-a4b0-945b6a06e211 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:13.029594 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c19ee960-715c-4332-b5ea-26c18ae9c93e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:13.033653 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=100 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:45:13.050802 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c19ee960-715c-4332-b5ea-26c18ae9c93e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29" status: 200 len: 1391 microversion: 2.1 time: 0.994389 Sep 08 10:45:13.054705 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 935/1855] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:12 2022] GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29 => generated 1391 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:13.068989 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d5901df2-4d4a-4d46-be59-aab8a869ab2a tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '.version_select at 0x7f68e4522670>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:13.151268 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d5901df2-4d4a-4d46-be59-aab8a869ab2a tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/images/42339e5a-aebb-4b85-90de-86145010398d" status: 200 len: 1452 microversion: 2.1 time: 0.094404 Sep 08 10:45:13.152269 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 936/1856] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:45:13 2022] GET /compute/v2.1/images/42339e5a-aebb-4b85-90de-86145010398d => generated 1452 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:13.159258 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6459a715-5711-47ae-b86a-41aa4c62c979 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:13.160167 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6459a715-5711-47ae-b86a-41aa4c62c979 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 64c88fa0-6a01-42fc-b0e9-98b9e84a199d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:13.186867 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6459a715-5711-47ae-b86a-41aa4c62c979 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:13.190457 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6459a715-5711-47ae-b86a-41aa4c62c979 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:13.197637 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6459a715-5711-47ae-b86a-41aa4c62c979 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:13.198089 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6459a715-5711-47ae-b86a-41aa4c62c979 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:13.198575 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6459a715-5711-47ae-b86a-41aa4c62c979 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:13.202756 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6459a715-5711-47ae-b86a-41aa4c62c979 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:13.470660 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a570b39a-5f28-4a8a-a4b0-945b6a06e211 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:13.499031 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a570b39a-5f28-4a8a-a4b0-945b6a06e211 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a" status: 200 len: 1508 microversion: 2.1 time: 0.806181 Sep 08 10:45:13.529724 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 921/1857] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:12 2022] GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a => generated 1508 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:45:13.541996 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d86116a9-d4b3-47a7-b1c2-79004c0e6871 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:13.542967 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d86116a9-d4b3-47a7-b1c2-79004c0e6871 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: cf3b6c0e-d390-44d6-91e5-09b389dff551] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:13.565675 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d86116a9-d4b3-47a7-b1c2-79004c0e6871 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:13.570324 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d86116a9-d4b3-47a7-b1c2-79004c0e6871 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:13.572079 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d86116a9-d4b3-47a7-b1c2-79004c0e6871 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:13.576192 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d86116a9-d4b3-47a7-b1c2-79004c0e6871 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:13.577690 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d86116a9-d4b3-47a7-b1c2-79004c0e6871 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:13.580489 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d86116a9-d4b3-47a7-b1c2-79004c0e6871 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:13.765400 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6459a715-5711-47ae-b86a-41aa4c62c979 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:13.783399 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d86116a9-d4b3-47a7-b1c2-79004c0e6871 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:13.801144 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d86116a9-d4b3-47a7-b1c2-79004c0e6871 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:13.806431 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d86116a9-d4b3-47a7-b1c2-79004c0e6871 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:13.814373 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d86116a9-d4b3-47a7-b1c2-79004c0e6871 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551" status: 200 len: 1265 microversion: 2.25 time: 0.282459 Sep 08 10:45:13.816272 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 922/1858] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:45:13 2022] GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551 => generated 1265 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:45:13.869631 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6459a715-5711-47ae-b86a-41aa4c62c979 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d" status: 200 len: 1496 microversion: 2.1 time: 0.715153 Sep 08 10:45:13.879227 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 937/1859] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:13 2022] GET /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d => generated 1496 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:14.080381 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1037626c-3de7-496e-9944-72abd46ca2ab tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:14.080874 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1037626c-3de7-496e-9944-72abd46ca2ab tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 90974422-0d77-4970-9e94-ed6b3376ed29] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:14.091104 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1037626c-3de7-496e-9944-72abd46ca2ab tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:14.100256 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1037626c-3de7-496e-9944-72abd46ca2ab tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:14.101485 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1037626c-3de7-496e-9944-72abd46ca2ab tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:14.103385 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1037626c-3de7-496e-9944-72abd46ca2ab tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:14.105854 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1037626c-3de7-496e-9944-72abd46ca2ab tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:14.110329 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1037626c-3de7-496e-9944-72abd46ca2ab tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:14.169433 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6822116c-daa8-49f7-ba26-173f3f8dec8d tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '.version_select at 0x7f68e4522670>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:14.280681 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6822116c-daa8-49f7-ba26-173f3f8dec8d tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/images/42339e5a-aebb-4b85-90de-86145010398d" status: 200 len: 1452 microversion: 2.1 time: 0.115279 Sep 08 10:45:14.282254 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 938/1860] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:45:14 2022] GET /compute/v2.1/images/42339e5a-aebb-4b85-90de-86145010398d => generated 1452 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:45:14.537831 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-967266e3-c5a4-41e1-b27d-0f91cb53d20c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:14.538498 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-967266e3-c5a4-41e1-b27d-0f91cb53d20c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: f9f308fa-d4a6-4ac9-8c64-927e082b0b4a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:14.565538 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-967266e3-c5a4-41e1-b27d-0f91cb53d20c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:14.568248 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-967266e3-c5a4-41e1-b27d-0f91cb53d20c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:14.568611 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-967266e3-c5a4-41e1-b27d-0f91cb53d20c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:14.569375 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-967266e3-c5a4-41e1-b27d-0f91cb53d20c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:14.569839 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-967266e3-c5a4-41e1-b27d-0f91cb53d20c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:14.570275 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-967266e3-c5a4-41e1-b27d-0f91cb53d20c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:14.620758 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1037626c-3de7-496e-9944-72abd46ca2ab tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:14.635981 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1037626c-3de7-496e-9944-72abd46ca2ab tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29" status: 200 len: 1391 microversion: 2.1 time: 0.554321 Sep 08 10:45:14.638398 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 923/1861] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:14 2022] GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29 => generated 1391 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:45:14.862266 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-35e06e48-10b0-440f-9a46-c3482579980d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:14.862933 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-35e06e48-10b0-440f-9a46-c3482579980d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: cf3b6c0e-d390-44d6-91e5-09b389dff551] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:14.881968 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35e06e48-10b0-440f-9a46-c3482579980d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:14.887319 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35e06e48-10b0-440f-9a46-c3482579980d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:14.888174 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35e06e48-10b0-440f-9a46-c3482579980d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:14.889334 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35e06e48-10b0-440f-9a46-c3482579980d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:14.892578 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35e06e48-10b0-440f-9a46-c3482579980d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:14.893328 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35e06e48-10b0-440f-9a46-c3482579980d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:15.158894 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-35e06e48-10b0-440f-9a46-c3482579980d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:15.179518 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-35e06e48-10b0-440f-9a46-c3482579980d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:15.186486 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-35e06e48-10b0-440f-9a46-c3482579980d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:15.187832 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-35e06e48-10b0-440f-9a46-c3482579980d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551" status: 200 len: 1265 microversion: 2.25 time: 0.331638 Sep 08 10:45:15.188417 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 924/1862] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:45:14 2022] GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551 => generated 1265 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:45:15.220246 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-967266e3-c5a4-41e1-b27d-0f91cb53d20c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:15.229011 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-967266e3-c5a4-41e1-b27d-0f91cb53d20c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a" status: 200 len: 1508 microversion: 2.1 time: 0.697078 Sep 08 10:45:15.230281 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-efe2cc63-5de7-47cb-9961-a27a43f16a88 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:15.235902 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-efe2cc63-5de7-47cb-9961-a27a43f16a88 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 64c88fa0-6a01-42fc-b0e9-98b9e84a199d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:15.251859 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 939/1863] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:14 2022] GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a => generated 1508 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:45:15.259646 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-efe2cc63-5de7-47cb-9961-a27a43f16a88 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:15.263078 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-efe2cc63-5de7-47cb-9961-a27a43f16a88 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:15.263713 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-efe2cc63-5de7-47cb-9961-a27a43f16a88 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:15.269089 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-efe2cc63-5de7-47cb-9961-a27a43f16a88 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:15.269861 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-efe2cc63-5de7-47cb-9961-a27a43f16a88 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:15.270480 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-efe2cc63-5de7-47cb-9961-a27a43f16a88 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:15.303247 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2d782f54-0c12-4b4e-87b7-0846e5b2b50d tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '.version_select at 0x7f68e5802f70>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:15.387311 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2d782f54-0c12-4b4e-87b7-0846e5b2b50d tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/images/42339e5a-aebb-4b85-90de-86145010398d" status: 200 len: 1452 microversion: 2.1 time: 0.087697 Sep 08 10:45:15.387793 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 940/1864] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:45:15 2022] GET /compute/v2.1/images/42339e5a-aebb-4b85-90de-86145010398d => generated 1452 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:45:15.665206 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d46260ee-ceae-45d3-8b58-2eb2f7dd05e8 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:15.665824 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d46260ee-ceae-45d3-8b58-2eb2f7dd05e8 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 90974422-0d77-4970-9e94-ed6b3376ed29] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:15.678152 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d46260ee-ceae-45d3-8b58-2eb2f7dd05e8 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:15.685321 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d46260ee-ceae-45d3-8b58-2eb2f7dd05e8 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:15.688473 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d46260ee-ceae-45d3-8b58-2eb2f7dd05e8 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:15.693926 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d46260ee-ceae-45d3-8b58-2eb2f7dd05e8 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:15.697688 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d46260ee-ceae-45d3-8b58-2eb2f7dd05e8 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:15.701482 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d46260ee-ceae-45d3-8b58-2eb2f7dd05e8 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:16.167969 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-efe2cc63-5de7-47cb-9961-a27a43f16a88 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:16.210777 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-efe2cc63-5de7-47cb-9961-a27a43f16a88 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d" status: 200 len: 1496 microversion: 2.1 time: 0.997511 Sep 08 10:45:16.212152 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 925/1865] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:15 2022] GET /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d => generated 1496 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:16.222259 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a0e2f515-615b-4490-a61b-a97794f72033 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:16.226354 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a0e2f515-615b-4490-a61b-a97794f72033 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: cf3b6c0e-d390-44d6-91e5-09b389dff551] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:16.246256 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a0e2f515-615b-4490-a61b-a97794f72033 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:16.247118 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a0e2f515-615b-4490-a61b-a97794f72033 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:16.252084 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a0e2f515-615b-4490-a61b-a97794f72033 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:16.253254 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a0e2f515-615b-4490-a61b-a97794f72033 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:16.253957 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a0e2f515-615b-4490-a61b-a97794f72033 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:16.254612 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a0e2f515-615b-4490-a61b-a97794f72033 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:16.478484 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a0e2f515-615b-4490-a61b-a97794f72033 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:16.490473 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a0e2f515-615b-4490-a61b-a97794f72033 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:16.494181 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a0e2f515-615b-4490-a61b-a97794f72033 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:16.496210 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a0e2f515-615b-4490-a61b-a97794f72033 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551" status: 200 len: 1265 microversion: 2.25 time: 0.282207 Sep 08 10:45:16.496917 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d46260ee-ceae-45d3-8b58-2eb2f7dd05e8 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:16.499401 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 926/1866] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:45:16 2022] GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551 => generated 1265 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:45:16.522354 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d46260ee-ceae-45d3-8b58-2eb2f7dd05e8 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29" status: 200 len: 1391 microversion: 2.1 time: 0.861286 Sep 08 10:45:16.534574 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 941/1867] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:15 2022] GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29 => generated 1391 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:45:16.558711 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-63ae1de4-998d-4049-8290-b4b32718a2f8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:16.559950 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-63ae1de4-998d-4049-8290-b4b32718a2f8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: f9f308fa-d4a6-4ac9-8c64-927e082b0b4a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:16.564474 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e1d428a1-0eb4-49cf-b350-d0d5b858c5e4 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '.version_select at 0x7f68e48c99d0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:16.599074 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63ae1de4-998d-4049-8290-b4b32718a2f8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:16.612413 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63ae1de4-998d-4049-8290-b4b32718a2f8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:16.614544 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63ae1de4-998d-4049-8290-b4b32718a2f8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:16.616269 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63ae1de4-998d-4049-8290-b4b32718a2f8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:16.625876 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63ae1de4-998d-4049-8290-b4b32718a2f8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:16.627797 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63ae1de4-998d-4049-8290-b4b32718a2f8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:16.702941 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e1d428a1-0eb4-49cf-b350-d0d5b858c5e4 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/images/42339e5a-aebb-4b85-90de-86145010398d" status: 200 len: 1452 microversion: 2.1 time: 0.155413 Sep 08 10:45:16.703527 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 942/1868] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:45:16 2022] GET /compute/v2.1/images/42339e5a-aebb-4b85-90de-86145010398d => generated 1452 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:17.004613 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-63ae1de4-998d-4049-8290-b4b32718a2f8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:17.018868 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-63ae1de4-998d-4049-8290-b4b32718a2f8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a" status: 200 len: 1508 microversion: 2.1 time: 0.507812 Sep 08 10:45:17.019976 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 927/1869] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:16 2022] GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a => generated 1508 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:17.240900 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-82af87d2-840f-4c64-869b-589bb0adfce7 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:17.240900 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-82af87d2-840f-4c64-869b-589bb0adfce7 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 64c88fa0-6a01-42fc-b0e9-98b9e84a199d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:17.259215 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-82af87d2-840f-4c64-869b-589bb0adfce7 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:17.259613 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-82af87d2-840f-4c64-869b-589bb0adfce7 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:17.260445 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-82af87d2-840f-4c64-869b-589bb0adfce7 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:17.261401 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-82af87d2-840f-4c64-869b-589bb0adfce7 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:17.262202 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-82af87d2-840f-4c64-869b-589bb0adfce7 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:17.263584 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-82af87d2-840f-4c64-869b-589bb0adfce7 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:17.703668 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1175adc0-f786-4dbf-a6c4-0d278d0ea126 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-2054490107", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:45:17.798695 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-1175adc0-f786-4dbf-a6c4-0d278d0ea126 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] validate_networks() for None {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:45:18.297759 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-1175adc0-f786-4dbf-a6c4-0d278d0ea126 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:45:18.298393 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-1175adc0-f786-4dbf-a6c4-0d278d0ea126 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:45:18.299049 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-1175adc0-f786-4dbf-a6c4-0d278d0ea126 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:45:18.299669 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-1175adc0-f786-4dbf-a6c4-0d278d0ea126 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:45:18.300257 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-1175adc0-f786-4dbf-a6c4-0d278d0ea126 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:45:18.316432 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1175adc0-f786-4dbf-a6c4-0d278d0ea126 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:18.319104 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1175adc0-f786-4dbf-a6c4-0d278d0ea126 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:18.322835 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1175adc0-f786-4dbf-a6c4-0d278d0ea126 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:18.325924 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1175adc0-f786-4dbf-a6c4-0d278d0ea126 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:18.326782 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1175adc0-f786-4dbf-a6c4-0d278d0ea126 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:18.327956 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1175adc0-f786-4dbf-a6c4-0d278d0ea126 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:18.362790 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-1175adc0-f786-4dbf-a6c4-0d278d0ea126 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Getting quotas for project eb93f8524768458a974c348b981921d5. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:45:18.376616 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-1175adc0-f786-4dbf-a6c4-0d278d0ea126 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Getting quotas for user c1c083657f0a4cebbc0804cd5d5ea4ad and project eb93f8524768458a974c348b981921d5. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:45:18.397713 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1175adc0-f786-4dbf-a6c4-0d278d0ea126 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:45:18.401278 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1175adc0-f786-4dbf-a6c4-0d278d0ea126 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: 3766b195-ace4-4563-a24e-dca72941251e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:45:18.473953 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1175adc0-f786-4dbf-a6c4-0d278d0ea126 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.231263 Sep 08 10:45:18.476570 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 928/1870] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:45:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1234 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 10:45:18.484097 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-32c78351-93a7-41cf-95a0-dd4ed9803e77 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:18.485158 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-32c78351-93a7-41cf-95a0-dd4ed9803e77 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: cf3b6c0e-d390-44d6-91e5-09b389dff551] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:18.498789 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-32c78351-93a7-41cf-95a0-dd4ed9803e77 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:18.499719 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-32c78351-93a7-41cf-95a0-dd4ed9803e77 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:18.500340 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-32c78351-93a7-41cf-95a0-dd4ed9803e77 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:18.501357 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-32c78351-93a7-41cf-95a0-dd4ed9803e77 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:18.502174 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-32c78351-93a7-41cf-95a0-dd4ed9803e77 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:18.502787 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-32c78351-93a7-41cf-95a0-dd4ed9803e77 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:18.580970 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:45:18.723639 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-32c78351-93a7-41cf-95a0-dd4ed9803e77 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:18.759924 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-32c78351-93a7-41cf-95a0-dd4ed9803e77 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:18.763067 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-32c78351-93a7-41cf-95a0-dd4ed9803e77 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:18.767099 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-32c78351-93a7-41cf-95a0-dd4ed9803e77 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551" status: 200 len: 1265 microversion: 2.25 time: 0.288160 Sep 08 10:45:18.781059 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 929/1871] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:45:18 2022] GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551 => generated 1265 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:45:18.791519 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cd157d79-4bc4-4609-b651-26131875515b tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:18.796189 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cd157d79-4bc4-4609-b651-26131875515b tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 90974422-0d77-4970-9e94-ed6b3376ed29] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:18.811198 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd157d79-4bc4-4609-b651-26131875515b tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:18.812200 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd157d79-4bc4-4609-b651-26131875515b tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:18.813254 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd157d79-4bc4-4609-b651-26131875515b tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:18.814459 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd157d79-4bc4-4609-b651-26131875515b tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:18.815140 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd157d79-4bc4-4609-b651-26131875515b tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:18.816065 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd157d79-4bc4-4609-b651-26131875515b tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:19.029837 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-82af87d2-840f-4c64-869b-589bb0adfce7 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:19.042139 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-82af87d2-840f-4c64-869b-589bb0adfce7 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d" status: 200 len: 1496 microversion: 2.1 time: 1.808300 Sep 08 10:45:19.051505 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 943/1872] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:17 2022] GET /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d => generated 1496 bytes in 1818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:45:19.062081 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f55170f5-d3ca-4bb3-bb56-e52dcf23377c tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '.version_select at 0x7f68e44cb4c0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:19.188182 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f55170f5-d3ca-4bb3-bb56-e52dcf23377c tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/images/42339e5a-aebb-4b85-90de-86145010398d" status: 200 len: 1452 microversion: 2.1 time: 0.135160 Sep 08 10:45:19.188994 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 944/1873] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:45:19 2022] GET /compute/v2.1/images/42339e5a-aebb-4b85-90de-86145010398d => generated 1452 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:19.203412 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-be50b6ad-e48d-4cdf-8031-5c26adfc9e00 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:19.204479 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-be50b6ad-e48d-4cdf-8031-5c26adfc9e00 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: f9f308fa-d4a6-4ac9-8c64-927e082b0b4a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:19.231669 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-be50b6ad-e48d-4cdf-8031-5c26adfc9e00 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:19.232736 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-be50b6ad-e48d-4cdf-8031-5c26adfc9e00 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:19.241001 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-be50b6ad-e48d-4cdf-8031-5c26adfc9e00 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:19.242521 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-be50b6ad-e48d-4cdf-8031-5c26adfc9e00 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:19.243539 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-be50b6ad-e48d-4cdf-8031-5c26adfc9e00 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:19.245372 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-be50b6ad-e48d-4cdf-8031-5c26adfc9e00 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:19.252936 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cd157d79-4bc4-4609-b651-26131875515b tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:19.269586 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cd157d79-4bc4-4609-b651-26131875515b tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29" status: 200 len: 1391 microversion: 2.1 time: 0.491722 Sep 08 10:45:19.281205 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 930/1874] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:18 2022] GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29 => generated 1391 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:19.286725 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-24df7203-8d8e-48b9-ad3c-5f470087e3d0 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-826217606", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:45:19.432462 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-24df7203-8d8e-48b9-ad3c-5f470087e3d0 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] validate_networks() for None {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:45:19.769978 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-be50b6ad-e48d-4cdf-8031-5c26adfc9e00 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:19.780963 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-be50b6ad-e48d-4cdf-8031-5c26adfc9e00 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a" status: 200 len: 1508 microversion: 2.1 time: 0.590498 Sep 08 10:45:19.784605 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 945/1875] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:19 2022] GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a => generated 1508 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:19.815269 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d266da3b-d215-4ab0-a348-89e498032c32 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:19.816698 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d266da3b-d215-4ab0-a348-89e498032c32 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: cf3b6c0e-d390-44d6-91e5-09b389dff551] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:19.836689 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d266da3b-d215-4ab0-a348-89e498032c32 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:19.850274 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d266da3b-d215-4ab0-a348-89e498032c32 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:19.852624 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d266da3b-d215-4ab0-a348-89e498032c32 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:19.853720 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d266da3b-d215-4ab0-a348-89e498032c32 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:19.855216 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d266da3b-d215-4ab0-a348-89e498032c32 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:19.856344 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d266da3b-d215-4ab0-a348-89e498032c32 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:19.906243 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-24df7203-8d8e-48b9-ad3c-5f470087e3d0 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:45:19.906726 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-24df7203-8d8e-48b9-ad3c-5f470087e3d0 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:45:19.908006 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-24df7203-8d8e-48b9-ad3c-5f470087e3d0 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:45:19.908435 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-24df7203-8d8e-48b9-ad3c-5f470087e3d0 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:45:19.908860 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-24df7203-8d8e-48b9-ad3c-5f470087e3d0 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:45:19.935883 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-24df7203-8d8e-48b9-ad3c-5f470087e3d0 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:19.936531 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-24df7203-8d8e-48b9-ad3c-5f470087e3d0 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:19.936986 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-24df7203-8d8e-48b9-ad3c-5f470087e3d0 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:19.937997 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-24df7203-8d8e-48b9-ad3c-5f470087e3d0 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:19.938635 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-24df7203-8d8e-48b9-ad3c-5f470087e3d0 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:19.939144 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-24df7203-8d8e-48b9-ad3c-5f470087e3d0 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:20.007786 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-24df7203-8d8e-48b9-ad3c-5f470087e3d0 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Getting quotas for project eb93f8524768458a974c348b981921d5. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:45:20.029072 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-24df7203-8d8e-48b9-ad3c-5f470087e3d0 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Getting quotas for user c1c083657f0a4cebbc0804cd5d5ea4ad and project eb93f8524768458a974c348b981921d5. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:45:20.101386 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-24df7203-8d8e-48b9-ad3c-5f470087e3d0 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:45:20.116578 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-24df7203-8d8e-48b9-ad3c-5f470087e3d0 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:45:20.294790 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-24df7203-8d8e-48b9-ad3c-5f470087e3d0 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.011227 Sep 08 10:45:20.295468 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 931/1876] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:45:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1014 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:45:20.303655 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-00b69330-085e-49f1-921e-d1b5f731b334 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:20.304906 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-00b69330-085e-49f1-921e-d1b5f731b334 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 64c88fa0-6a01-42fc-b0e9-98b9e84a199d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:20.315685 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00b69330-085e-49f1-921e-d1b5f731b334 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:20.316867 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00b69330-085e-49f1-921e-d1b5f731b334 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:20.317620 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00b69330-085e-49f1-921e-d1b5f731b334 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:20.329693 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00b69330-085e-49f1-921e-d1b5f731b334 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:20.330894 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00b69330-085e-49f1-921e-d1b5f731b334 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:20.333306 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00b69330-085e-49f1-921e-d1b5f731b334 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:20.707208 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d266da3b-d215-4ab0-a348-89e498032c32 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:20.745600 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d266da3b-d215-4ab0-a348-89e498032c32 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:20.759030 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d266da3b-d215-4ab0-a348-89e498032c32 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:20.773362 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d266da3b-d215-4ab0-a348-89e498032c32 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551" status: 200 len: 1265 microversion: 2.25 time: 0.966271 Sep 08 10:45:20.782613 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 946/1877] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:45:19 2022] GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551 => generated 1265 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:45:20.808660 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-832d4a32-37d4-4af4-90c7-0aa57f1037f3 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '.version_select at 0x7f68e8a34160>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:20.905551 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-00b69330-085e-49f1-921e-d1b5f731b334 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:20.957875 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-00b69330-085e-49f1-921e-d1b5f731b334 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d" status: 200 len: 1496 microversion: 2.1 time: 0.661224 Sep 08 10:45:20.965079 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 932/1878] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:20 2022] GET /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d => generated 1496 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:21.001305 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-65fb51dc-fa7b-4e60-8e17-581a9a38ba4f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:21.007573 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-65fb51dc-fa7b-4e60-8e17-581a9a38ba4f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 90974422-0d77-4970-9e94-ed6b3376ed29] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:21.029775 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-65fb51dc-fa7b-4e60-8e17-581a9a38ba4f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:21.034760 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-65fb51dc-fa7b-4e60-8e17-581a9a38ba4f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:21.035545 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-65fb51dc-fa7b-4e60-8e17-581a9a38ba4f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:21.039870 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-65fb51dc-fa7b-4e60-8e17-581a9a38ba4f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:21.042149 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-832d4a32-37d4-4af4-90c7-0aa57f1037f3 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/images/42339e5a-aebb-4b85-90de-86145010398d" status: 200 len: 1452 microversion: 2.1 time: 0.254729 Sep 08 10:45:21.043275 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-65fb51dc-fa7b-4e60-8e17-581a9a38ba4f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:21.043737 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-65fb51dc-fa7b-4e60-8e17-581a9a38ba4f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:21.079477 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 947/1879] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:45:20 2022] GET /compute/v2.1/images/42339e5a-aebb-4b85-90de-86145010398d => generated 1452 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:21.088200 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-658f18f1-732e-4982-bd1a-26a3d017859c tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:21.089628 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-658f18f1-732e-4982-bd1a-26a3d017859c tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:21.598105 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-65fb51dc-fa7b-4e60-8e17-581a9a38ba4f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:21.613288 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-65fb51dc-fa7b-4e60-8e17-581a9a38ba4f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29" status: 200 len: 1391 microversion: 2.1 time: 0.646316 Sep 08 10:45:21.617064 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 933/1880] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:20 2022] GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29 => generated 1391 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:21.622372 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f0081a77-260d-4fe5-928b-9dda6ce1ceb1 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:21.631874 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f0081a77-260d-4fe5-928b-9dda6ce1ceb1 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: f9f308fa-d4a6-4ac9-8c64-927e082b0b4a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:21.649389 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0081a77-260d-4fe5-928b-9dda6ce1ceb1 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:21.660002 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0081a77-260d-4fe5-928b-9dda6ce1ceb1 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:21.660586 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0081a77-260d-4fe5-928b-9dda6ce1ceb1 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:21.669954 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0081a77-260d-4fe5-928b-9dda6ce1ceb1 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:21.672164 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0081a77-260d-4fe5-928b-9dda6ce1ceb1 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:21.674880 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0081a77-260d-4fe5-928b-9dda6ce1ceb1 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:21.875953 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-658f18f1-732e-4982-bd1a-26a3d017859c tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:21.931045 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-658f18f1-732e-4982-bd1a-26a3d017859c tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447" status: 200 len: 1213 microversion: 2.1 time: 0.849567 Sep 08 10:45:21.933738 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 948/1881] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:21 2022] GET /compute/v2.1/servers/e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447 => generated 1213 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:21.940971 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ad99d0c1-1af9-4696-856b-e2b9117f3e70 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:21.950442 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ad99d0c1-1af9-4696-856b-e2b9117f3e70 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: cf3b6c0e-d390-44d6-91e5-09b389dff551] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:21.963554 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ad99d0c1-1af9-4696-856b-e2b9117f3e70 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:21.964476 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ad99d0c1-1af9-4696-856b-e2b9117f3e70 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:21.965178 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ad99d0c1-1af9-4696-856b-e2b9117f3e70 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:21.966551 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ad99d0c1-1af9-4696-856b-e2b9117f3e70 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:21.968183 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ad99d0c1-1af9-4696-856b-e2b9117f3e70 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:21.969011 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ad99d0c1-1af9-4696-856b-e2b9117f3e70 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:22.042793 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-ad99d0c1-1af9-4696-856b-e2b9117f3e70 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] HTTP exception thrown: Instance cf3b6c0e-d390-44d6-91e5-09b389dff551 could not be found. Sep 08 10:45:22.046510 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ad99d0c1-1af9-4696-856b-e2b9117f3e70 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Request method failure captured: Sep 08 10:45:22.046510 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551 HTTP/1.1 Sep 08 10:45:22.046510 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:45:22.046510 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:45:22.046510 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:45:22.046510 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:45:22.046510 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:45:22.046510 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:45:22.046510 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:45:22.046510 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:45:22.046510 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcXZt42mIM6otq6VWkhIIA96oZXavtoZmbqhqPMc80NVSsiJRHHpYnYGGzEhUVoRyhAcs8Hwl3L1suVGPpViQRvBrgcN-bOUeRDMIOnFanMQUyO3LgHh8xb8i8vD5c0S9_Vu-2OsRoz_mmLSl8OWaahD1PakjyKG5z1Mn4YpkZj5tYE Sep 08 10:45:22.046510 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:45:22.046510 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:45:22.046510 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:45:22.046510 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:45:22.046510 n-d-850501-12 devstack@n-api.service[128861]: X-Openstack-Nova-Api-Version: 2.25 Sep 08 10:45:22.046510 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:45:22.046510 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:45:22.046510 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 57d64134da60477da24b7fde4e1b9680 Sep 08 10:45:22.046510 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1806613506 Sep 08 10:45:22.046510 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:45:22.046510 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:45:22.046510 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/57d64134da60477da24b7fde4e1b9680"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/57d64134da60477da24b7fde4e1b9680"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_57d64134da60477da24b7fde4e1b9680"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/57d64134da60477da24b7fde4e1b9680"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:45:22.046510 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1806613506 Sep 08 10:45:22.046510 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 57d64134da60477da24b7fde4e1b9680 Sep 08 10:45:22.046510 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1806613506 Sep 08 10:45:22.046510 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-LiveAutoBlockMigrationV225Test-1806613506-project Sep 08 10:45:22.046510 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:45:22.046510 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:45:22.046510 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 27456dd9f49540b09f2e8addd1045a94 Sep 08 10:45:22.046510 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1806613506-project Sep 08 10:45:22.046510 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:45:22.046510 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance cf3b6c0e-d390-44d6-91e5-09b389dff551 could not be found. Sep 08 10:45:22.046510 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': 'cf3b6c0e-d390-44d6-91e5-09b389dff551'} Sep 08 10:45:22.046510 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:45:22.046510 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:45:22.046510 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:45:22.046510 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:45:22.046510 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:45:22.046510 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:45:22.046510 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:45:22.046510 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:45:22.046510 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:45:22.046510 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:45:22.046510 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf3b6c0e-d390-44d6-91e5-09b389dff551 could not be found. Sep 08 10:45:22.046510 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:45:22.046510 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:45:22.046510 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:45:22.046510 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:45:22.046510 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:45:22.046510 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:45:22.046510 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:45:22.046510 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:45:22.046510 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:45:22.046510 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:45:22.046510 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:45:22.046510 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:45:22.046510 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:45:22.046510 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:45:22.046510 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:45:22.046510 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:45:22.046510 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf3b6c0e-d390-44d6-91e5-09b389dff551 could not be found. Sep 08 10:45:22.046510 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:45:22.053272 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:45:22.053272 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:45:22.053272 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:45:22.053272 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:45:22.053272 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:45:22.053272 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:45:22.053272 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:45:22.053272 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf3b6c0e-d390-44d6-91e5-09b389dff551 could not be found. Sep 08 10:45:22.053272 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:45:22.062441 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ad99d0c1-1af9-4696-856b-e2b9117f3e70 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Returning 404 to user: Instance cf3b6c0e-d390-44d6-91e5-09b389dff551 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:45:22.067428 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ad99d0c1-1af9-4696-856b-e2b9117f3e70 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551" status: 404 len: 111 microversion: 2.25 time: 0.132293 Sep 08 10:45:22.082789 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 949/1882] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:45:21 2022] GET /compute/v2.1/servers/cf3b6c0e-d390-44d6-91e5-09b389dff551 => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:45:22.088991 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-298d6162-8935-4440-97cc-d4dd61d48752 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:22.090221 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-298d6162-8935-4440-97cc-d4dd61d48752 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 64c88fa0-6a01-42fc-b0e9-98b9e84a199d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:22.101898 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-298d6162-8935-4440-97cc-d4dd61d48752 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:22.102398 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-298d6162-8935-4440-97cc-d4dd61d48752 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:22.102838 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-298d6162-8935-4440-97cc-d4dd61d48752 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:22.108692 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-298d6162-8935-4440-97cc-d4dd61d48752 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:22.114849 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-298d6162-8935-4440-97cc-d4dd61d48752 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:22.115927 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-298d6162-8935-4440-97cc-d4dd61d48752 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:22.704502 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-298d6162-8935-4440-97cc-d4dd61d48752 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:22.720015 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-298d6162-8935-4440-97cc-d4dd61d48752 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d" status: 200 len: 1496 microversion: 2.1 time: 0.630182 Sep 08 10:45:22.720726 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 950/1883] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:22 2022] GET /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d => generated 1496 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:22.728607 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-85cfc966-5a5d-48b9-afce-ff83257feb33 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '.version_select at 0x7f68e4575af0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:22.862842 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-85cfc966-5a5d-48b9-afce-ff83257feb33 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/images/42339e5a-aebb-4b85-90de-86145010398d" status: 200 len: 1452 microversion: 2.1 time: 0.140571 Sep 08 10:45:22.870644 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 951/1884] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:45:22 2022] GET /compute/v2.1/images/42339e5a-aebb-4b85-90de-86145010398d => generated 1452 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:22.884795 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f5f714e1-09f7-4bbe-a700-f3111024deaf tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:22.890749 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f5f714e1-09f7-4bbe-a700-f3111024deaf tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 90974422-0d77-4970-9e94-ed6b3376ed29] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:22.917765 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f5f714e1-09f7-4bbe-a700-f3111024deaf tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:22.919762 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f5f714e1-09f7-4bbe-a700-f3111024deaf tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:22.928379 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f5f714e1-09f7-4bbe-a700-f3111024deaf tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:22.931976 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f5f714e1-09f7-4bbe-a700-f3111024deaf tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:22.934984 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f5f714e1-09f7-4bbe-a700-f3111024deaf tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:22.935464 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f5f714e1-09f7-4bbe-a700-f3111024deaf tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:23.080929 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f0081a77-260d-4fe5-928b-9dda6ce1ceb1 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:23.124673 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f0081a77-260d-4fe5-928b-9dda6ce1ceb1 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a" status: 200 len: 1508 microversion: 2.1 time: 1.502764 Sep 08 10:45:23.129373 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 934/1885] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:21 2022] GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a => generated 1508 bytes in 1509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:23.149757 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-05d21acb-f3cd-4ecd-8b6d-6def4cfb6f07 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:23.154231 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-05d21acb-f3cd-4ecd-8b6d-6def4cfb6f07 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:23.176136 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-05d21acb-f3cd-4ecd-8b6d-6def4cfb6f07 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:23.181224 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-05d21acb-f3cd-4ecd-8b6d-6def4cfb6f07 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:23.182473 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-05d21acb-f3cd-4ecd-8b6d-6def4cfb6f07 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:23.184983 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-05d21acb-f3cd-4ecd-8b6d-6def4cfb6f07 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:23.187558 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-05d21acb-f3cd-4ecd-8b6d-6def4cfb6f07 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:23.189827 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-05d21acb-f3cd-4ecd-8b6d-6def4cfb6f07 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:23.423558 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-05d21acb-f3cd-4ecd-8b6d-6def4cfb6f07 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:23.463817 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-05d21acb-f3cd-4ecd-8b6d-6def4cfb6f07 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447" status: 200 len: 1265 microversion: 2.1 time: 0.332103 Sep 08 10:45:23.470527 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 935/1886] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:23 2022] GET /compute/v2.1/servers/e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447 => generated 1265 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:23.750229 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c2fdb0fd-6184-4315-948c-ea42a935d8ac tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:23.751560 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c2fdb0fd-6184-4315-948c-ea42a935d8ac tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 64c88fa0-6a01-42fc-b0e9-98b9e84a199d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:23.766670 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2fdb0fd-6184-4315-948c-ea42a935d8ac tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:23.768884 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2fdb0fd-6184-4315-948c-ea42a935d8ac tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:23.772594 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2fdb0fd-6184-4315-948c-ea42a935d8ac tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:23.775568 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2fdb0fd-6184-4315-948c-ea42a935d8ac tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:23.776423 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2fdb0fd-6184-4315-948c-ea42a935d8ac tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:23.777291 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2fdb0fd-6184-4315-948c-ea42a935d8ac tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:23.906282 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f5f714e1-09f7-4bbe-a700-f3111024deaf tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:23.922579 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f5f714e1-09f7-4bbe-a700-f3111024deaf tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29" status: 200 len: 1391 microversion: 2.1 time: 1.050775 Sep 08 10:45:23.923743 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 952/1887] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:22 2022] GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29 => generated 1391 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:23.940393 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7bd1b60a-445d-4a61-aeab-469adcb56f55 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '.version_select at 0x7f68e4575550>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:24.071048 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7bd1b60a-445d-4a61-aeab-469adcb56f55 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/images/42339e5a-aebb-4b85-90de-86145010398d" status: 200 len: 1452 microversion: 2.1 time: 0.146005 Sep 08 10:45:24.080681 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 953/1888] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:45:23 2022] GET /compute/v2.1/images/42339e5a-aebb-4b85-90de-86145010398d => generated 1452 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:24.166554 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-864356c0-1440-4785-ad86-dee582b6362a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:24.167475 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-864356c0-1440-4785-ad86-dee582b6362a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: f9f308fa-d4a6-4ac9-8c64-927e082b0b4a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:24.196983 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-864356c0-1440-4785-ad86-dee582b6362a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:24.203162 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-864356c0-1440-4785-ad86-dee582b6362a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:24.204183 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-864356c0-1440-4785-ad86-dee582b6362a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:24.208656 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-864356c0-1440-4785-ad86-dee582b6362a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:24.209826 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-864356c0-1440-4785-ad86-dee582b6362a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:24.210609 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-864356c0-1440-4785-ad86-dee582b6362a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:24.755753 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-864356c0-1440-4785-ad86-dee582b6362a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:24.767429 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-864356c0-1440-4785-ad86-dee582b6362a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a" status: 200 len: 1508 microversion: 2.1 time: 0.610831 Sep 08 10:45:24.773174 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 954/1889] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:24 2022] GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a => generated 1508 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:24.792309 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-506df15b-9b02-409a-b87e-4cf0f889efe8 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:24.793302 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c2fdb0fd-6184-4315-948c-ea42a935d8ac tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:24.793849 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-506df15b-9b02-409a-b87e-4cf0f889efe8 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:24.800384 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-506df15b-9b02-409a-b87e-4cf0f889efe8 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:24.804332 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-506df15b-9b02-409a-b87e-4cf0f889efe8 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:24.805017 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-506df15b-9b02-409a-b87e-4cf0f889efe8 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:24.814203 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-506df15b-9b02-409a-b87e-4cf0f889efe8 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:24.814938 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-506df15b-9b02-409a-b87e-4cf0f889efe8 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:24.815555 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-506df15b-9b02-409a-b87e-4cf0f889efe8 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:24.818413 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c2fdb0fd-6184-4315-948c-ea42a935d8ac tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d" status: 200 len: 1496 microversion: 2.1 time: 1.073986 Sep 08 10:45:24.819158 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 936/1890] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:23 2022] GET /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d => generated 1496 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:45:24.954951 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f818cbdf-e725-4a67-98f5-bd79495e3c2b tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:24.955943 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f818cbdf-e725-4a67-98f5-bd79495e3c2b tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 90974422-0d77-4970-9e94-ed6b3376ed29] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:24.968744 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f818cbdf-e725-4a67-98f5-bd79495e3c2b tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:24.980158 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-506df15b-9b02-409a-b87e-4cf0f889efe8 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:24.986219 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f818cbdf-e725-4a67-98f5-bd79495e3c2b tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:24.994811 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f818cbdf-e725-4a67-98f5-bd79495e3c2b tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:24.996935 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f818cbdf-e725-4a67-98f5-bd79495e3c2b tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:24.997898 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f818cbdf-e725-4a67-98f5-bd79495e3c2b tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:24.998421 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-506df15b-9b02-409a-b87e-4cf0f889efe8 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447" status: 200 len: 1271 microversion: 2.1 time: 0.222527 Sep 08 10:45:24.999081 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f818cbdf-e725-4a67-98f5-bd79495e3c2b tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:25.001517 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 955/1891] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:24 2022] GET /compute/v2.1/servers/e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447 => generated 1271 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:25.088812 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a9c33048-b2e5-4af1-a500-d9ce66815bb9 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '.version_select at 0x7f68e4471ca0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:25.181154 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a9c33048-b2e5-4af1-a500-d9ce66815bb9 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/images/42339e5a-aebb-4b85-90de-86145010398d" status: 200 len: 1452 microversion: 2.1 time: 0.097858 Sep 08 10:45:25.182078 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 956/1892] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:45:25 2022] GET /compute/v2.1/images/42339e5a-aebb-4b85-90de-86145010398d => generated 1452 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:25.811097 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b0afa956-34ed-44bd-916b-c733c0f8efef tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:25.812462 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b0afa956-34ed-44bd-916b-c733c0f8efef tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: f9f308fa-d4a6-4ac9-8c64-927e082b0b4a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:25.827861 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b0afa956-34ed-44bd-916b-c733c0f8efef tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:25.831935 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b0afa956-34ed-44bd-916b-c733c0f8efef tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:25.834261 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b0afa956-34ed-44bd-916b-c733c0f8efef tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:25.836497 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b0afa956-34ed-44bd-916b-c733c0f8efef tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:25.838616 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b0afa956-34ed-44bd-916b-c733c0f8efef tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:25.843207 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b0afa956-34ed-44bd-916b-c733c0f8efef tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:26.520658 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f818cbdf-e725-4a67-98f5-bd79495e3c2b tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:26.543744 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f818cbdf-e725-4a67-98f5-bd79495e3c2b tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29" status: 200 len: 1391 microversion: 2.1 time: 1.593146 Sep 08 10:45:26.562196 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 937/1893] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:24 2022] GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29 => generated 1391 bytes in 1609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:45:26.572227 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9ea5da40-220e-4525-afbe-c06734f0a158 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:26.572227 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9ea5da40-220e-4525-afbe-c06734f0a158 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 64c88fa0-6a01-42fc-b0e9-98b9e84a199d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:26.578875 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9ea5da40-220e-4525-afbe-c06734f0a158 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:26.581243 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9ea5da40-220e-4525-afbe-c06734f0a158 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:26.582149 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9ea5da40-220e-4525-afbe-c06734f0a158 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:26.583412 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9ea5da40-220e-4525-afbe-c06734f0a158 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:26.585333 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9ea5da40-220e-4525-afbe-c06734f0a158 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:26.586642 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9ea5da40-220e-4525-afbe-c06734f0a158 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:26.693434 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b0afa956-34ed-44bd-916b-c733c0f8efef tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:26.705413 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b0afa956-34ed-44bd-916b-c733c0f8efef tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a" status: 200 len: 1508 microversion: 2.1 time: 0.904676 Sep 08 10:45:26.707531 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 957/1894] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:25 2022] GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a => generated 1508 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:26.738699 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6eaa8e25-4786-4890-ad93-f889e4a5c4eb tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:26.750062 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6eaa8e25-4786-4890-ad93-f889e4a5c4eb tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:26.759138 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6eaa8e25-4786-4890-ad93-f889e4a5c4eb tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:26.759917 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6eaa8e25-4786-4890-ad93-f889e4a5c4eb tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:26.760518 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6eaa8e25-4786-4890-ad93-f889e4a5c4eb tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:26.761598 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6eaa8e25-4786-4890-ad93-f889e4a5c4eb tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:26.762164 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6eaa8e25-4786-4890-ad93-f889e4a5c4eb tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:26.764585 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6eaa8e25-4786-4890-ad93-f889e4a5c4eb tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:27.183115 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9ea5da40-220e-4525-afbe-c06734f0a158 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:27.229064 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9ea5da40-220e-4525-afbe-c06734f0a158 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d" status: 200 len: 1473 microversion: 2.1 time: 0.661697 Sep 08 10:45:27.230461 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 938/1895] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:26 2022] GET /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d => generated 1473 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:27.249450 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3eef1d3c-ec40-4c3d-a775-63101da914a5 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '.version_select at 0x7f68e8b5fb80>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:27.384659 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3eef1d3c-ec40-4c3d-a775-63101da914a5 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/images/42339e5a-aebb-4b85-90de-86145010398d" status: 200 len: 1461 microversion: 2.1 time: 0.149706 Sep 08 10:45:27.385352 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 939/1896] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:45:27 2022] GET /compute/v2.1/images/42339e5a-aebb-4b85-90de-86145010398d => generated 1461 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:27.410377 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c9ebbc8d-74ff-4f51-80c5-4631c6ffd4e6 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1658938529"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:45:27.419488 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c9ebbc8d-74ff-4f51-80c5-4631c6ffd4e6 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 64c88fa0-6a01-42fc-b0e9-98b9e84a199d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:27.453051 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c9ebbc8d-74ff-4f51-80c5-4631c6ffd4e6 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:27.453687 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c9ebbc8d-74ff-4f51-80c5-4631c6ffd4e6 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:27.454344 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c9ebbc8d-74ff-4f51-80c5-4631c6ffd4e6 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:27.454771 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c9ebbc8d-74ff-4f51-80c5-4631c6ffd4e6 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:27.455246 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c9ebbc8d-74ff-4f51-80c5-4631c6ffd4e6 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:27.455653 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c9ebbc8d-74ff-4f51-80c5-4631c6ffd4e6 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:27.630934 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6eaa8e25-4786-4890-ad93-f889e4a5c4eb tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:27.646314 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6eaa8e25-4786-4890-ad93-f889e4a5c4eb tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447" status: 200 len: 1313 microversion: 2.1 time: 0.917740 Sep 08 10:45:27.647709 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 958/1897] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:26 2022] GET /compute/v2.1/servers/e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447 => generated 1313 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:27.652756 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8d5e6ae3-dfe9-4cea-8571-d529bbf44100 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '.version_select at 0x7f68e4923310>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:27.730721 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8d5e6ae3-dfe9-4cea-8571-d529bbf44100 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/images/42339e5a-aebb-4b85-90de-86145010398d" status: 200 len: 1461 microversion: 2.1 time: 0.081731 Sep 08 10:45:27.759805 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 959/1898] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:45:27 2022] GET /compute/v2.1/images/42339e5a-aebb-4b85-90de-86145010398d => generated 1461 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:27.792029 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0e427ae2-efdb-4e39-84c3-95ebf00eb45a tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:27.793558 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0e427ae2-efdb-4e39-84c3-95ebf00eb45a tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 90974422-0d77-4970-9e94-ed6b3376ed29] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:27.800921 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=71 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:45:27.823634 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e427ae2-efdb-4e39-84c3-95ebf00eb45a tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:27.824061 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e427ae2-efdb-4e39-84c3-95ebf00eb45a tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:27.824502 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e427ae2-efdb-4e39-84c3-95ebf00eb45a tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:27.825266 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e427ae2-efdb-4e39-84c3-95ebf00eb45a tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:27.829642 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e427ae2-efdb-4e39-84c3-95ebf00eb45a tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:27.830353 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e427ae2-efdb-4e39-84c3-95ebf00eb45a tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:27.974423 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c9ebbc8d-74ff-4f51-80c5-4631c6ffd4e6 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "POST /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d/action" status: 202 len: 0 microversion: 2.1 time: 0.570227 Sep 08 10:45:27.980385 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 940/1899] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:45:27 2022] POST /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d/action => generated 0 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 08 10:45:27.998986 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ba012b70-178a-4e1e-a087-149cffb9820a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:28.002212 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ba012b70-178a-4e1e-a087-149cffb9820a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: f9f308fa-d4a6-4ac9-8c64-927e082b0b4a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:28.013221 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba012b70-178a-4e1e-a087-149cffb9820a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:28.014087 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba012b70-178a-4e1e-a087-149cffb9820a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:28.014774 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba012b70-178a-4e1e-a087-149cffb9820a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:28.015925 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba012b70-178a-4e1e-a087-149cffb9820a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:28.016970 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba012b70-178a-4e1e-a087-149cffb9820a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:28.017772 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba012b70-178a-4e1e-a087-149cffb9820a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:28.663481 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0e427ae2-efdb-4e39-84c3-95ebf00eb45a tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:28.672962 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0e427ae2-efdb-4e39-84c3-95ebf00eb45a tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29" status: 200 len: 1391 microversion: 2.1 time: 0.911982 Sep 08 10:45:28.679686 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 960/1900] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:27 2022] GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29 => generated 1391 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:28.697656 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b2fe3655-203d-48bd-b019-49b3d307c176 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:28.698473 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b2fe3655-203d-48bd-b019-49b3d307c176 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] [instance: 3e6be670-294f-417f-a909-57c481faaf40] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:28.705362 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b2fe3655-203d-48bd-b019-49b3d307c176 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:28.706055 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b2fe3655-203d-48bd-b019-49b3d307c176 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:28.706787 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b2fe3655-203d-48bd-b019-49b3d307c176 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:28.714885 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b2fe3655-203d-48bd-b019-49b3d307c176 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:28.715809 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b2fe3655-203d-48bd-b019-49b3d307c176 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:28.716545 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b2fe3655-203d-48bd-b019-49b3d307c176 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:28.866550 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ba012b70-178a-4e1e-a087-149cffb9820a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:28.891306 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ba012b70-178a-4e1e-a087-149cffb9820a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a" status: 200 len: 1508 microversion: 2.1 time: 0.909253 Sep 08 10:45:28.913630 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 941/1901] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:27 2022] GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a => generated 1508 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:28.933398 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4135dc91-c1ed-4537-b131-772bc0aed274 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '.version_select at 0x7f68e4361ee0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:29.017616 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4135dc91-c1ed-4537-b131-772bc0aed274 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/images/6ca320eb-4ec1-4390-b737-c4ed16dbfe81" status: 200 len: 1414 microversion: 2.1 time: 0.102372 Sep 08 10:45:29.019986 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 942/1902] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:45:28 2022] GET /compute/v2.1/images/6ca320eb-4ec1-4390-b737-c4ed16dbfe81 => generated 1414 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:29.033365 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4b719123-bed0-40c2-bfd4-99239565fdad tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:29.034791 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4b719123-bed0-40c2-bfd4-99239565fdad tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:29.066559 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4b719123-bed0-40c2-bfd4-99239565fdad tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:29.067109 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4b719123-bed0-40c2-bfd4-99239565fdad tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:29.067825 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4b719123-bed0-40c2-bfd4-99239565fdad tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:29.068483 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4b719123-bed0-40c2-bfd4-99239565fdad tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:29.073472 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4b719123-bed0-40c2-bfd4-99239565fdad tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:29.074212 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4b719123-bed0-40c2-bfd4-99239565fdad tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:29.443506 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b2fe3655-203d-48bd-b019-49b3d307c176 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7415a5b46c4587a8806661b70e3913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604588959944720923ec2d5e0bf81c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:29.454934 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b2fe3655-203d-48bd-b019-49b3d307c176 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/servers/3e6be670-294f-417f-a909-57c481faaf40" status: 200 len: 1466 microversion: 2.1 time: 0.773697 Sep 08 10:45:29.469912 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 961/1903] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:28 2022] GET /compute/v2.1/servers/3e6be670-294f-417f-a909-57c481faaf40 => generated 1466 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:29.506507 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3fb0228e-2945-40af-8841-e535093d12f0 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '.version_select at 0x7f68e4641ee0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:29.813353 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3fb0228e-2945-40af-8841-e535093d12f0 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/images?changes-since=2022-09-08T10%3A43%3A06Z" status: 200 len: 1901 microversion: 2.1 time: 0.312412 Sep 08 10:45:29.841312 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 962/1904] 10.222.0.27 () {58 vars in 1199 bytes} [Thu Sep 8 10:45:29 2022] GET /compute/v2.1/images?changes-since=2022-09-08T10%3A43%3A06Z => generated 1901 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:45:29.848055 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-57307380-9e27-4e10-b29b-eb84715afa1c tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:29.848898 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-57307380-9e27-4e10-b29b-eb84715afa1c tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 90974422-0d77-4970-9e94-ed6b3376ed29] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:29.868553 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-57307380-9e27-4e10-b29b-eb84715afa1c tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:29.869890 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-57307380-9e27-4e10-b29b-eb84715afa1c tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:29.876051 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-57307380-9e27-4e10-b29b-eb84715afa1c tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:29.877012 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-57307380-9e27-4e10-b29b-eb84715afa1c tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:29.878171 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-57307380-9e27-4e10-b29b-eb84715afa1c tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:29.886065 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-57307380-9e27-4e10-b29b-eb84715afa1c tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:29.946497 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4b719123-bed0-40c2-bfd4-99239565fdad tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:29.973812 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4b719123-bed0-40c2-bfd4-99239565fdad tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447" status: 200 len: 1313 microversion: 2.1 time: 0.947290 Sep 08 10:45:29.975169 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 943/1905] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:29 2022] GET /compute/v2.1/servers/e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447 => generated 1313 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:29.987428 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-df486bfc-610f-4df1-a9a5-2e6c4eb34037 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '.version_select at 0x7f68e4361ca0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:30.024961 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=4 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:45:30.057253 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=12 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:45:30.148671 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-df486bfc-610f-4df1-a9a5-2e6c4eb34037 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1117923846" status: 200 len: 485 microversion: 2.1 time: 0.172119 Sep 08 10:45:30.157358 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 944/1906] 10.222.0.27 () {58 vars in 1231 bytes} [Thu Sep 8 10:45:29 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1117923846 => generated 485 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:45:30.168244 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c19db077-f82e-44d1-ac0e-225d732580aa tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:30.177608 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c19db077-f82e-44d1-ac0e-225d732580aa tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: f9f308fa-d4a6-4ac9-8c64-927e082b0b4a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:30.194624 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c19db077-f82e-44d1-ac0e-225d732580aa tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:30.206694 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c19db077-f82e-44d1-ac0e-225d732580aa tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:30.207153 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c19db077-f82e-44d1-ac0e-225d732580aa tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:30.208480 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c19db077-f82e-44d1-ac0e-225d732580aa tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:30.225967 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c19db077-f82e-44d1-ac0e-225d732580aa tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:30.226458 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c19db077-f82e-44d1-ac0e-225d732580aa tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:30.563909 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-57307380-9e27-4e10-b29b-eb84715afa1c tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:30.575265 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-57307380-9e27-4e10-b29b-eb84715afa1c tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29" status: 200 len: 1391 microversion: 2.1 time: 0.732377 Sep 08 10:45:30.575836 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 963/1907] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:29 2022] GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29 => generated 1391 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:30.594158 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-34160f86-9bc0-4202-aaf5-7d3e0b13642e tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '.version_select at 0x7f68e4641f70>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:30.698674 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-34160f86-9bc0-4202-aaf5-7d3e0b13642e tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/images/6ca320eb-4ec1-4390-b737-c4ed16dbfe81" status: 200 len: 1414 microversion: 2.1 time: 0.108276 Sep 08 10:45:30.708259 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 964/1908] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:45:30 2022] GET /compute/v2.1/images/6ca320eb-4ec1-4390-b737-c4ed16dbfe81 => generated 1414 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:30.714230 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a32a90ca-c7fe-4b98-967d-77818de76b6d tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '.version_select at 0x7f68e44cbca0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:30.975275 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a32a90ca-c7fe-4b98-967d-77818de76b6d tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/images?server=3e6be670-294f-417f-a909-57c481faaf40" status: 200 len: 956 microversion: 2.1 time: 0.264957 Sep 08 10:45:30.991686 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 965/1909] 10.222.0.27 () {58 vars in 1209 bytes} [Thu Sep 8 10:45:30 2022] GET /compute/v2.1/images?server=3e6be670-294f-417f-a909-57c481faaf40 => generated 956 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:45:31.016770 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-afa5e3cd-914c-4f06-8d03-8b8c72e6f782 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '.version_select at 0x7f68e44cb8b0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:31.031140 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c19db077-f82e-44d1-ac0e-225d732580aa tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:31.059292 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c19db077-f82e-44d1-ac0e-225d732580aa tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a" status: 200 len: 1508 microversion: 2.1 time: 0.899730 Sep 08 10:45:31.060351 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 945/1910] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:30 2022] GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a => generated 1508 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:31.107790 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fb509b29-0785-4b1a-a8c9-9b92fb706e27 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:31.108785 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fb509b29-0785-4b1a-a8c9-9b92fb706e27 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:31.134413 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-afa5e3cd-914c-4f06-8d03-8b8c72e6f782 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fv2.1%2Fservers%2Fdac27157-b08e-4f13-b97e-3c5b653bd0b3" status: 200 len: 485 microversion: 2.1 time: 0.140993 Sep 08 10:45:31.135457 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 966/1911] 10.222.0.27 () {58 vars in 1317 bytes} [Thu Sep 8 10:45:30 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fv2.1%2Fservers%2Fdac27157-b08e-4f13-b97e-3c5b653bd0b3 => generated 485 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:45:31.154558 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-bee5f505-376b-4ced-9db5-07dbabc08641 req-029ac6a2-e433-49eb-9e0e-4d038fde1620 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3766b195-ace4-4563-a24e-dca72941251e", "tag": "67c1a6b2-cd91-4a27-a9a4-731db0f530a7"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:45:31.164140 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb509b29-0785-4b1a-a8c9-9b92fb706e27 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:31.165014 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb509b29-0785-4b1a-a8c9-9b92fb706e27 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:31.165821 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb509b29-0785-4b1a-a8c9-9b92fb706e27 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:31.170156 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb509b29-0785-4b1a-a8c9-9b92fb706e27 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:31.170861 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb509b29-0785-4b1a-a8c9-9b92fb706e27 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:31.171487 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb509b29-0785-4b1a-a8c9-9b92fb706e27 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:31.207481 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-bee5f505-376b-4ced-9db5-07dbabc08641 req-029ac6a2-e433-49eb-9e0e-4d038fde1620 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:31.208462 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-bee5f505-376b-4ced-9db5-07dbabc08641 req-029ac6a2-e433-49eb-9e0e-4d038fde1620 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:31.209398 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-bee5f505-376b-4ced-9db5-07dbabc08641 req-029ac6a2-e433-49eb-9e0e-4d038fde1620 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:31.255774 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-bee5f505-376b-4ced-9db5-07dbabc08641 req-029ac6a2-e433-49eb-9e0e-4d038fde1620 service nova] Creating event network-changed:67c1a6b2-cd91-4a27-a9a4-731db0f530a7 for instance 3766b195-ace4-4563-a24e-dca72941251e on n-h2-850501-12 Sep 08 10:45:31.276486 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-bee5f505-376b-4ced-9db5-07dbabc08641 req-029ac6a2-e433-49eb-9e0e-4d038fde1620 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125564 Sep 08 10:45:31.277680 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 967/1912] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:45:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:45:31.291038 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1c72c953-14b3-4f6b-91b5-6491a6b1c1bb tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '.version_select at 0x7f68e45758b0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:31.488698 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1c72c953-14b3-4f6b-91b5-6491a6b1c1bb tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fservers%2Fdac27157-b08e-4f13-b97e-3c5b653bd0b3" status: 200 len: 485 microversion: 2.1 time: 0.209231 Sep 08 10:45:31.490095 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 968/1913] 10.222.0.27 () {58 vars in 1303 bytes} [Thu Sep 8 10:45:31 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fservers%2Fdac27157-b08e-4f13-b97e-3c5b653bd0b3 => generated 485 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:45:31.541444 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cb7d6df3-86b5-4f2f-abea-c332e4be0a5b tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '.version_select at 0x7f68e4613700>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:31.908956 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:45:32.070195 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cb7d6df3-86b5-4f2f-abea-c332e4be0a5b tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3279 microversion: 2.1 time: 0.558826 Sep 08 10:45:32.074069 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 969/1914] 10.222.0.27 () {58 vars in 1149 bytes} [Thu Sep 8 10:45:31 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3279 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:45:32.085721 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-a69a45a6-6522-4839-8507-017e5e4f7489 req-daf946aa-e9cb-4b5c-8a2b-4f5d510cbcd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447", "tag": "41bf8ea0-de68-4df3-97ef-2656e5d1ec8b"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:45:32.117449 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-a69a45a6-6522-4839-8507-017e5e4f7489 req-daf946aa-e9cb-4b5c-8a2b-4f5d510cbcd9 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:32.118452 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-a69a45a6-6522-4839-8507-017e5e4f7489 req-daf946aa-e9cb-4b5c-8a2b-4f5d510cbcd9 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:32.119302 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-a69a45a6-6522-4839-8507-017e5e4f7489 req-daf946aa-e9cb-4b5c-8a2b-4f5d510cbcd9 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:32.191899 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-a69a45a6-6522-4839-8507-017e5e4f7489 req-daf946aa-e9cb-4b5c-8a2b-4f5d510cbcd9 service nova] Creating event network-changed:41bf8ea0-de68-4df3-97ef-2656e5d1ec8b for instance e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447 on n-h1-850501-12 Sep 08 10:45:32.233485 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-a69a45a6-6522-4839-8507-017e5e4f7489 req-daf946aa-e9cb-4b5c-8a2b-4f5d510cbcd9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154552 Sep 08 10:45:32.244881 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 970/1915] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:45:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:45:32.287168 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-627b2ffa-ae02-4f0c-8b74-5fcd4c11f6e4 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:32.293142 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-627b2ffa-ae02-4f0c-8b74-5fcd4c11f6e4 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 90974422-0d77-4970-9e94-ed6b3376ed29] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:32.338117 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-627b2ffa-ae02-4f0c-8b74-5fcd4c11f6e4 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:32.352688 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-627b2ffa-ae02-4f0c-8b74-5fcd4c11f6e4 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:32.353527 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-627b2ffa-ae02-4f0c-8b74-5fcd4c11f6e4 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:32.357253 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-627b2ffa-ae02-4f0c-8b74-5fcd4c11f6e4 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:32.359728 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-627b2ffa-ae02-4f0c-8b74-5fcd4c11f6e4 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:32.360596 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-627b2ffa-ae02-4f0c-8b74-5fcd4c11f6e4 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:32.421222 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=100 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:45:32.843781 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fb509b29-0785-4b1a-a8c9-9b92fb706e27 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:32.878278 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fb509b29-0785-4b1a-a8c9-9b92fb706e27 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447" status: 200 len: 1313 microversion: 2.1 time: 1.775882 Sep 08 10:45:32.880908 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 946/1916] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:31 2022] GET /compute/v2.1/servers/e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447 => generated 1313 bytes in 1779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:32.888637 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3c9c1fa4-8b4e-4136-92e4-3c489b2085f5 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '.version_select at 0x7f68e8b675e0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:32.975926 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3c9c1fa4-8b4e-4136-92e4-3c489b2085f5 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/images/6ca320eb-4ec1-4390-b737-c4ed16dbfe81" status: 200 len: 1414 microversion: 2.1 time: 0.089827 Sep 08 10:45:32.982028 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 947/1917] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:45:32 2022] GET /compute/v2.1/images/6ca320eb-4ec1-4390-b737-c4ed16dbfe81 => generated 1414 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:32.995996 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9625a352-7c36-453a-a2b6-959062059964 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '.version_select at 0x7f68e8b43430>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:33.305729 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9625a352-7c36-453a-a2b6-959062059964 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1429 microversion: 2.1 time: 0.319223 Sep 08 10:45:33.320158 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 948/1918] 10.222.0.27 () {58 vars in 1149 bytes} [Thu Sep 8 10:45:32 2022] GET /compute/v2.1/images?type=snapshot => generated 1429 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:33.331188 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e9e05d75-ffc6-405b-a03a-f9bccbf8a956 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:33.334304 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e9e05d75-ffc6-405b-a03a-f9bccbf8a956 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: f9f308fa-d4a6-4ac9-8c64-927e082b0b4a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:33.354244 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9e05d75-ffc6-405b-a03a-f9bccbf8a956 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:33.354844 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9e05d75-ffc6-405b-a03a-f9bccbf8a956 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:33.355295 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9e05d75-ffc6-405b-a03a-f9bccbf8a956 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:33.356424 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9e05d75-ffc6-405b-a03a-f9bccbf8a956 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:33.359123 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9e05d75-ffc6-405b-a03a-f9bccbf8a956 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:33.359603 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9e05d75-ffc6-405b-a03a-f9bccbf8a956 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:33.729762 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e9e05d75-ffc6-405b-a03a-f9bccbf8a956 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:33.744747 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e9e05d75-ffc6-405b-a03a-f9bccbf8a956 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a" status: 200 len: 1508 microversion: 2.1 time: 0.423424 Sep 08 10:45:33.746067 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 949/1919] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:33 2022] GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a => generated 1508 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:33.766953 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-7bd6cc30-d6b7-4983-b6bd-2a4d0cfbbe2c req-10c9072b-fb6b-4223-ac00-5eba93025869 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e6be670-294f-417f-a909-57c481faaf40", "name": "network-vif-unplugged", "status": "completed", "tag": "2dc5c573-e6fe-4942-be41-259b760efba3"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:45:33.834152 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-7bd6cc30-d6b7-4983-b6bd-2a4d0cfbbe2c req-10c9072b-fb6b-4223-ac00-5eba93025869 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:33.837651 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-7bd6cc30-d6b7-4983-b6bd-2a4d0cfbbe2c req-10c9072b-fb6b-4223-ac00-5eba93025869 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:33.838409 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-7bd6cc30-d6b7-4983-b6bd-2a4d0cfbbe2c req-10c9072b-fb6b-4223-ac00-5eba93025869 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:33.887382 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-7bd6cc30-d6b7-4983-b6bd-2a4d0cfbbe2c req-10c9072b-fb6b-4223-ac00-5eba93025869 service nova] Creating event network-vif-unplugged:2dc5c573-e6fe-4942-be41-259b760efba3 for instance 3e6be670-294f-417f-a909-57c481faaf40 on n-h1-850501-12 Sep 08 10:45:33.897745 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-7bd6cc30-d6b7-4983-b6bd-2a4d0cfbbe2c req-10c9072b-fb6b-4223-ac00-5eba93025869 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.147521 Sep 08 10:45:33.898369 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 950/1920] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:45:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:45:33.901168 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-627b2ffa-ae02-4f0c-8b74-5fcd4c11f6e4 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:33.916902 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d4234373-f636-4a6d-ad39-dd23a4f2c4e7 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '.version_select at 0x7f68e8b32280>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:33.922271 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-627b2ffa-ae02-4f0c-8b74-5fcd4c11f6e4 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29" status: 200 len: 1391 microversion: 2.1 time: 1.672361 Sep 08 10:45:33.923131 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 971/1921] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:32 2022] GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29 => generated 1391 bytes in 1678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:33.928909 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3c5c4ac5-755a-4686-8910-e08aea9a1b9a tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:33.949499 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3c5c4ac5-755a-4686-8910-e08aea9a1b9a tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:33.974327 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3c5c4ac5-755a-4686-8910-e08aea9a1b9a tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:33.981943 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3c5c4ac5-755a-4686-8910-e08aea9a1b9a tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:33.982846 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3c5c4ac5-755a-4686-8910-e08aea9a1b9a tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:33.983893 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3c5c4ac5-755a-4686-8910-e08aea9a1b9a tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:33.984608 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3c5c4ac5-755a-4686-8910-e08aea9a1b9a tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:33.985306 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3c5c4ac5-755a-4686-8910-e08aea9a1b9a tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:34.182467 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d4234373-f636-4a6d-ad39-dd23a4f2c4e7 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.282664 Sep 08 10:45:34.187345 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 951/1922] 10.222.0.27 () {58 vars in 1137 bytes} [Thu Sep 8 10:45:33 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:45:34.195913 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7076c7f6-66f2-4414-b1cd-7ade83ed8916 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '.version_select at 0x7f68e8b19550>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:34.285622 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7076c7f6-66f2-4414-b1cd-7ade83ed8916 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/images/6ca320eb-4ec1-4390-b737-c4ed16dbfe81" status: 200 len: 1414 microversion: 2.1 time: 0.096688 Sep 08 10:45:34.293377 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 952/1923] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:45:34 2022] GET /compute/v2.1/images/6ca320eb-4ec1-4390-b737-c4ed16dbfe81 => generated 1414 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:34.298653 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a0ea8b09-d032-4ce6-bd86-7834dea08742 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '.version_select at 0x7f68e8b86ca0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:34.465251 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a0ea8b09-d032-4ce6-bd86-7834dea08742 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/images/detail?changes-since=2022-09-08T10%3A42%3A51Z" status: 200 len: 6326 microversion: 2.1 time: 0.170159 Sep 08 10:45:34.470707 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 953/1924] 10.222.0.27 () {58 vars in 1220 bytes} [Thu Sep 8 10:45:34 2022] GET /compute/v2.1/images/detail?changes-since=2022-09-08T10%3A42%3A51Z => generated 6326 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:34.526255 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-898142a9-cf63-4c3b-9015-1e07bfd0d374 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '.version_select at 0x7f68e8adeaf0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:34.658434 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-898142a9-cf63-4c3b-9015-1e07bfd0d374 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1117923846" status: 200 len: 665 microversion: 2.1 time: 0.164057 Sep 08 10:45:34.664085 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 954/1925] 10.222.0.27 () {58 vars in 1252 bytes} [Thu Sep 8 10:45:34 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1117923846 => generated 665 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:45:34.690102 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7411b51f-557a-4db5-9906-cc089f8b958c tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '.version_select at 0x7f68e8b32b80>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:34.847663 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7411b51f-557a-4db5-9906-cc089f8b958c tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fv2.1%2Fservers%2Fdac27157-b08e-4f13-b97e-3c5b653bd0b3" status: 200 len: 1465 microversion: 2.1 time: 0.172587 Sep 08 10:45:34.853606 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 955/1926] 10.222.0.27 () {58 vars in 1338 bytes} [Thu Sep 8 10:45:34 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fv2.1%2Fservers%2Fdac27157-b08e-4f13-b97e-3c5b653bd0b3 => generated 1465 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:34.863493 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-143fa3f1-6214-4864-8be4-321c5656b10a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:34.863987 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-143fa3f1-6214-4864-8be4-321c5656b10a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: f9f308fa-d4a6-4ac9-8c64-927e082b0b4a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:34.879703 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-143fa3f1-6214-4864-8be4-321c5656b10a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:34.881834 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-143fa3f1-6214-4864-8be4-321c5656b10a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:34.885322 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-143fa3f1-6214-4864-8be4-321c5656b10a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:34.886350 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-143fa3f1-6214-4864-8be4-321c5656b10a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:34.887884 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-143fa3f1-6214-4864-8be4-321c5656b10a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:34.889824 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-143fa3f1-6214-4864-8be4-321c5656b10a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:34.905078 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:45:35.131130 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-3c5c4ac5-755a-4686-8910-e08aea9a1b9a tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:35.150606 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3c5c4ac5-755a-4686-8910-e08aea9a1b9a tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447" status: 200 len: 1313 microversion: 2.1 time: 1.225911 Sep 08 10:45:35.153404 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 972/1927] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:33 2022] GET /compute/v2.1/servers/e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447 => generated 1313 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:35.171425 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0f7f83e8-af4d-4143-a304-48afbb9a03ef tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '.version_select at 0x7f68e4575820>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:35.354081 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0f7f83e8-af4d-4143-a304-48afbb9a03ef tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fservers%2Fdac27157-b08e-4f13-b97e-3c5b653bd0b3" status: 200 len: 1465 microversion: 2.1 time: 0.197224 Sep 08 10:45:35.376808 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 973/1928] 10.222.0.27 () {58 vars in 1324 bytes} [Thu Sep 8 10:45:35 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fservers%2Fdac27157-b08e-4f13-b97e-3c5b653bd0b3 => generated 1465 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:35.400101 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-04c79da5-5304-4f82-be8e-4095fe58ef7f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:35.404321 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-04c79da5-5304-4f82-be8e-4095fe58ef7f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 90974422-0d77-4970-9e94-ed6b3376ed29] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:35.459144 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-04c79da5-5304-4f82-be8e-4095fe58ef7f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:35.460283 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-04c79da5-5304-4f82-be8e-4095fe58ef7f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:35.461621 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-04c79da5-5304-4f82-be8e-4095fe58ef7f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:35.466433 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-04c79da5-5304-4f82-be8e-4095fe58ef7f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:35.471985 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-04c79da5-5304-4f82-be8e-4095fe58ef7f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:35.475569 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-04c79da5-5304-4f82-be8e-4095fe58ef7f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:35.810328 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-143fa3f1-6214-4864-8be4-321c5656b10a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:35.821089 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-143fa3f1-6214-4864-8be4-321c5656b10a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a" status: 200 len: 1508 microversion: 2.1 time: 0.966003 Sep 08 10:45:35.841067 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 956/1929] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:34 2022] GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a => generated 1508 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:35.862103 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5bce0381-37c3-40e8-a9cd-1dcd9a21cb83 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '.version_select at 0x7f68e8b5fb80>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:35.956371 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5bce0381-37c3-40e8-a9cd-1dcd9a21cb83 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/images/6ca320eb-4ec1-4390-b737-c4ed16dbfe81" status: 200 len: 1414 microversion: 2.1 time: 0.126281 Sep 08 10:45:35.957967 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 957/1930] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:45:35 2022] GET /compute/v2.1/images/6ca320eb-4ec1-4390-b737-c4ed16dbfe81 => generated 1414 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:35.970453 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4929ffc0-f7fa-4871-ad66-ae3f5728f355 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '.version_select at 0x7f68e4cf3dc0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:36.141451 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-04c79da5-5304-4f82-be8e-4095fe58ef7f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:36.158633 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-04c79da5-5304-4f82-be8e-4095fe58ef7f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29" status: 200 len: 1391 microversion: 2.1 time: 0.779613 Sep 08 10:45:36.166622 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 974/1931] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:35 2022] GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29 => generated 1391 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:36.182828 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3f50d978-6df7-4b80-bb47-18f9bfc418b5 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:36.198801 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3f50d978-6df7-4b80-bb47-18f9bfc418b5 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:36.229349 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3f50d978-6df7-4b80-bb47-18f9bfc418b5 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:36.230562 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3f50d978-6df7-4b80-bb47-18f9bfc418b5 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:36.237996 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3f50d978-6df7-4b80-bb47-18f9bfc418b5 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:36.241461 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3f50d978-6df7-4b80-bb47-18f9bfc418b5 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:36.242217 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3f50d978-6df7-4b80-bb47-18f9bfc418b5 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:36.242786 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3f50d978-6df7-4b80-bb47-18f9bfc418b5 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:36.326622 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4929ffc0-f7fa-4871-ad66-ae3f5728f355 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7101 microversion: 2.1 time: 0.366545 Sep 08 10:45:36.328230 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 958/1932] 10.222.0.27 () {58 vars in 1170 bytes} [Thu Sep 8 10:45:35 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7101 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:36.349988 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a515ef70-a45c-45bd-bfb7-87cde70bac18 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '.version_select at 0x7f68e8b32280>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:36.603325 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a515ef70-a45c-45bd-bfb7-87cde70bac18 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4369 microversion: 2.1 time: 0.257964 Sep 08 10:45:36.619557 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 959/1933] 10.222.0.27 () {58 vars in 1170 bytes} [Thu Sep 8 10:45:36 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4369 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:45:36.636140 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5a734b8c-a4f7-453a-a381-a809cbca4bf1 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '.version_select at 0x7f68e469e1f0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:36.752402 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5a734b8c-a4f7-453a-a381-a809cbca4bf1 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/images/503f4a0f-e18f-47fd-ad12-0289e3463117" status: 200 len: 784 microversion: 2.1 time: 0.129257 Sep 08 10:45:36.755545 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 960/1934] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:45:36 2022] GET /compute/v2.1/images/503f4a0f-e18f-47fd-ad12-0289e3463117 => generated 784 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:45:36.773857 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-255c238e-c1dd-4a4e-b600-c39d760b9945 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '.version_select at 0x7f68e8b304c0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:36.868038 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-255c238e-c1dd-4a4e-b600-c39d760b9945 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1608 microversion: 2.1 time: 0.100035 Sep 08 10:45:36.870483 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 961/1935] 10.222.0.27 () {58 vars in 1158 bytes} [Thu Sep 8 10:45:36 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1608 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:45:36.877352 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2e9493f1-361c-443c-a7c4-d3558191eaa8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:36.878421 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2e9493f1-361c-443c-a7c4-d3558191eaa8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: f9f308fa-d4a6-4ac9-8c64-927e082b0b4a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:36.887867 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e9493f1-361c-443c-a7c4-d3558191eaa8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:36.890788 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e9493f1-361c-443c-a7c4-d3558191eaa8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:36.892697 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e9493f1-361c-443c-a7c4-d3558191eaa8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:36.901516 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e9493f1-361c-443c-a7c4-d3558191eaa8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:36.903692 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e9493f1-361c-443c-a7c4-d3558191eaa8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:36.905757 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e9493f1-361c-443c-a7c4-d3558191eaa8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:37.002090 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-3f50d978-6df7-4b80-bb47-18f9bfc418b5 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:37.042284 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3f50d978-6df7-4b80-bb47-18f9bfc418b5 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447" status: 200 len: 1313 microversion: 2.1 time: 0.860970 Sep 08 10:45:37.044688 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 975/1936] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:36 2022] GET /compute/v2.1/servers/e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447 => generated 1313 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:37.065190 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-238048f5-2447-4180-9867-368bd28e8097 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '.version_select at 0x7f68e4a32550>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:38.048823 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2e9493f1-361c-443c-a7c4-d3558191eaa8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:38.081931 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2e9493f1-361c-443c-a7c4-d3558191eaa8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a" status: 200 len: 1529 microversion: 2.1 time: 1.209529 Sep 08 10:45:38.088806 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 962/1937] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:36 2022] GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a => generated 1529 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:38.110599 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b6030603-bd77-4fde-ace7-5ccf9d1adf74 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '.version_select at 0x7f68e8b30f70>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:39.257818 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-238048f5-2447-4180-9867-368bd28e8097 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "DELETE /compute/v2.1/images/42339e5a-aebb-4b85-90de-86145010398d" status: 204 len: 0 microversion: 2.1 time: 2.207890 Sep 08 10:45:39.259587 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 976/1938] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:37 2022] DELETE /compute/v2.1/images/42339e5a-aebb-4b85-90de-86145010398d => generated 0 bytes in 2211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:45:39.278772 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0d00b568-d155-497b-848c-fb9e967b5255 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:39.282635 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0d00b568-d155-497b-848c-fb9e967b5255 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 90974422-0d77-4970-9e94-ed6b3376ed29] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:39.303157 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d00b568-d155-497b-848c-fb9e967b5255 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:39.304339 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d00b568-d155-497b-848c-fb9e967b5255 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:39.306736 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d00b568-d155-497b-848c-fb9e967b5255 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:39.311097 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d00b568-d155-497b-848c-fb9e967b5255 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:39.311932 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d00b568-d155-497b-848c-fb9e967b5255 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:39.313129 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d00b568-d155-497b-848c-fb9e967b5255 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:39.456598 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b6030603-bd77-4fde-ace7-5ccf9d1adf74 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/images/6ca320eb-4ec1-4390-b737-c4ed16dbfe81" status: 200 len: 1414 microversion: 2.1 time: 1.358635 Sep 08 10:45:39.458741 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 963/1939] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:45:38 2022] GET /compute/v2.1/images/6ca320eb-4ec1-4390-b737-c4ed16dbfe81 => generated 1414 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:39.488239 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-89c7c2d2-ee6f-4a65-a72f-3f1cead9dc62 req-dfc26fd9-9f5d-48c7-b0ec-d8ecc129931c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64c88fa0-6a01-42fc-b0e9-98b9e84a199d", "name": "network-vif-plugged", "status": "completed", "tag": "2a441d6d-9009-42c2-a8aa-1b70f9d6ee7f"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:45:39.541538 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-89c7c2d2-ee6f-4a65-a72f-3f1cead9dc62 req-dfc26fd9-9f5d-48c7-b0ec-d8ecc129931c service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:39.542922 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-89c7c2d2-ee6f-4a65-a72f-3f1cead9dc62 req-dfc26fd9-9f5d-48c7-b0ec-d8ecc129931c service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:39.544817 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-89c7c2d2-ee6f-4a65-a72f-3f1cead9dc62 req-dfc26fd9-9f5d-48c7-b0ec-d8ecc129931c service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:39.608214 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-89c7c2d2-ee6f-4a65-a72f-3f1cead9dc62 req-dfc26fd9-9f5d-48c7-b0ec-d8ecc129931c service nova] Creating event network-vif-plugged:2a441d6d-9009-42c2-a8aa-1b70f9d6ee7f for instance 64c88fa0-6a01-42fc-b0e9-98b9e84a199d on n-h1-850501-12 Sep 08 10:45:39.635854 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-89c7c2d2-ee6f-4a65-a72f-3f1cead9dc62 req-dfc26fd9-9f5d-48c7-b0ec-d8ecc129931c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.172891 Sep 08 10:45:39.638967 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 964/1940] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:45:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:45:39.657829 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9d96434d-f9f2-4c56-9886-b1a6e26bfbc2 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:39.662817 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9d96434d-f9f2-4c56-9886-b1a6e26bfbc2 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:39.684265 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d96434d-f9f2-4c56-9886-b1a6e26bfbc2 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:39.685073 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d96434d-f9f2-4c56-9886-b1a6e26bfbc2 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:39.688484 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d96434d-f9f2-4c56-9886-b1a6e26bfbc2 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:39.690248 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d96434d-f9f2-4c56-9886-b1a6e26bfbc2 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:39.692123 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d96434d-f9f2-4c56-9886-b1a6e26bfbc2 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:39.695480 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d96434d-f9f2-4c56-9886-b1a6e26bfbc2 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:39.771555 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9d96434d-f9f2-4c56-9886-b1a6e26bfbc2 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:45:39.786615 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0d00b568-d155-497b-848c-fb9e967b5255 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:39.800291 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0d00b568-d155-497b-848c-fb9e967b5255 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29" status: 200 len: 1391 microversion: 2.1 time: 0.536322 Sep 08 10:45:39.801389 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 977/1941] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:39 2022] GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29 => generated 1391 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:39.813711 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-93204c0b-2c30-4bf6-b735-ea059b77c49e tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:39.814622 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-93204c0b-2c30-4bf6-b735-ea059b77c49e tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:39.828702 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-93204c0b-2c30-4bf6-b735-ea059b77c49e tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:39.830633 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-93204c0b-2c30-4bf6-b735-ea059b77c49e tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:39.833268 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-93204c0b-2c30-4bf6-b735-ea059b77c49e tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:39.834246 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-93204c0b-2c30-4bf6-b735-ea059b77c49e tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:39.834930 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-93204c0b-2c30-4bf6-b735-ea059b77c49e tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:39.837108 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-93204c0b-2c30-4bf6-b735-ea059b77c49e tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:40.085061 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9d96434d-f9f2-4c56-9886-b1a6e26bfbc2 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e" status: 204 len: 0 microversion: 2.25 time: 0.436757 Sep 08 10:45:40.087828 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 965/1942] 10.222.0.27 () {60 vars in 1280 bytes} [Thu Sep 8 10:45:39 2022] DELETE /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e => generated 0 bytes in 448 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 10:45:40.119880 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-861092e0-c206-4428-a5e3-2f4e8aa2c509 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:40.126349 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-861092e0-c206-4428-a5e3-2f4e8aa2c509 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: f9f308fa-d4a6-4ac9-8c64-927e082b0b4a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:40.147905 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:45:40.154547 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-861092e0-c206-4428-a5e3-2f4e8aa2c509 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:40.155535 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-861092e0-c206-4428-a5e3-2f4e8aa2c509 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:40.156177 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-861092e0-c206-4428-a5e3-2f4e8aa2c509 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:40.158337 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-861092e0-c206-4428-a5e3-2f4e8aa2c509 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:40.163042 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-861092e0-c206-4428-a5e3-2f4e8aa2c509 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:40.164111 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-861092e0-c206-4428-a5e3-2f4e8aa2c509 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:40.348985 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-93204c0b-2c30-4bf6-b735-ea059b77c49e tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:40.384902 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-93204c0b-2c30-4bf6-b735-ea059b77c49e tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447" status: 200 len: 1313 microversion: 2.1 time: 0.576727 Sep 08 10:45:40.385611 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 978/1943] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:39 2022] GET /compute/v2.1/servers/e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447 => generated 1313 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:40.398715 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-355cb40f-3d84-435c-998a-38825d672c78 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '.version_select at 0x7f68e461f550>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:40.822220 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-861092e0-c206-4428-a5e3-2f4e8aa2c509 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:40.836873 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-861092e0-c206-4428-a5e3-2f4e8aa2c509 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a" status: 200 len: 1524 microversion: 2.1 time: 0.745533 Sep 08 10:45:40.843968 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 966/1944] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:40 2022] GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a => generated 1524 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:40.855692 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c6a71d54-7fcc-4556-a046-3fb3090c6e6b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:40.860107 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c6a71d54-7fcc-4556-a046-3fb3090c6e6b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:40.883890 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c6a71d54-7fcc-4556-a046-3fb3090c6e6b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:40.891576 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c6a71d54-7fcc-4556-a046-3fb3090c6e6b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:40.893450 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c6a71d54-7fcc-4556-a046-3fb3090c6e6b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:40.896122 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c6a71d54-7fcc-4556-a046-3fb3090c6e6b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:40.900622 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c6a71d54-7fcc-4556-a046-3fb3090c6e6b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:40.902402 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c6a71d54-7fcc-4556-a046-3fb3090c6e6b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:41.396843 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c6a71d54-7fcc-4556-a046-3fb3090c6e6b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:41.411371 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c6a71d54-7fcc-4556-a046-3fb3090c6e6b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:41.419047 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c6a71d54-7fcc-4556-a046-3fb3090c6e6b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:41.422394 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c6a71d54-7fcc-4556-a046-3fb3090c6e6b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e" status: 200 len: 1728 microversion: 2.25 time: 0.575377 Sep 08 10:45:41.427471 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 967/1945] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:45:40 2022] GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e => generated 1728 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:45:41.438177 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8cafa5be-ca06-46cf-96aa-7219cce527a3 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '.version_select at 0x7f68e8b40160>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:49.827694 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=21 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:45:50.379539 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=33 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:45:50.876545 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:45:51.401450 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:45:56.113213 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-355cb40f-3d84-435c-998a-38825d672c78 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "DELETE /compute/v2.1/images/ef654b65-07f7-425a-b46d-ccc7e6f6fb53" status: 204 len: 0 microversion: 2.1 time: 15.725824 Sep 08 10:45:56.118092 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 979/1946] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:40 2022] DELETE /compute/v2.1/images/ef654b65-07f7-425a-b46d-ccc7e6f6fb53 => generated 0 bytes in 15728 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:45:56.125736 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fac45e96-4b0b-4aa6-9cbd-716d5c6f810e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:56.126692 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fac45e96-4b0b-4aa6-9cbd-716d5c6f810e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 90974422-0d77-4970-9e94-ed6b3376ed29] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:56.144294 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fac45e96-4b0b-4aa6-9cbd-716d5c6f810e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:56.144801 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fac45e96-4b0b-4aa6-9cbd-716d5c6f810e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:56.145278 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fac45e96-4b0b-4aa6-9cbd-716d5c6f810e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:56.146297 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fac45e96-4b0b-4aa6-9cbd-716d5c6f810e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:56.146937 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fac45e96-4b0b-4aa6-9cbd-716d5c6f810e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:56.147534 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fac45e96-4b0b-4aa6-9cbd-716d5c6f810e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:56.184504 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8cafa5be-ca06-46cf-96aa-7219cce527a3 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/images/6ca320eb-4ec1-4390-b737-c4ed16dbfe81" status: 200 len: 1423 microversion: 2.1 time: 14.755563 Sep 08 10:45:56.194989 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 968/1947] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:45:41 2022] GET /compute/v2.1/images/6ca320eb-4ec1-4390-b737-c4ed16dbfe81 => generated 1423 bytes in 14767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:56.335254 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-fac45e96-4b0b-4aa6-9cbd-716d5c6f810e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:56.351163 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fac45e96-4b0b-4aa6-9cbd-716d5c6f810e tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29" status: 200 len: 1391 microversion: 2.1 time: 0.231730 Sep 08 10:45:56.352070 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 980/1948] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:56 2022] GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29 => generated 1391 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:56.378027 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-31c89018-a445-4fb9-acce-06ae52931be2 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:56.379975 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-31c89018-a445-4fb9-acce-06ae52931be2 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:56.383438 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a0ae7d6b-dc0c-46ec-8be9-de3ef84a1225 tempest-QuotasTestJSON-2091651584 tempest-QuotasTestJSON-2091651584-project] Calling method '.version_select at 0x7f68e8b86f70>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:56.387247 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-31c89018-a445-4fb9-acce-06ae52931be2 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:56.387986 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-31c89018-a445-4fb9-acce-06ae52931be2 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:56.388639 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-31c89018-a445-4fb9-acce-06ae52931be2 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:56.389659 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-31c89018-a445-4fb9-acce-06ae52931be2 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:56.390329 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-31c89018-a445-4fb9-acce-06ae52931be2 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:56.391083 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-31c89018-a445-4fb9-acce-06ae52931be2 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:56.490086 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a0ae7d6b-dc0c-46ec-8be9-de3ef84a1225 tempest-QuotasTestJSON-2091651584 tempest-QuotasTestJSON-2091651584-project] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/1dbde5ec7cce46c5a37264d0f9029b22/defaults" status: 200 len: 371 microversion: 2.1 time: 0.293816 Sep 08 10:45:56.492670 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 969/1949] 10.222.0.27 () {58 vars in 1269 bytes} [Thu Sep 8 10:45:56 2022] GET /compute/v2.1/os-quota-sets/1dbde5ec7cce46c5a37264d0f9029b22/defaults => generated 371 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:45:56.500440 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ac4f1183-5a8e-4e6a-bb0a-a668eea6c712 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:56.501330 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ac4f1183-5a8e-4e6a-bb0a-a668eea6c712 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: f9f308fa-d4a6-4ac9-8c64-927e082b0b4a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:56.508719 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ac4f1183-5a8e-4e6a-bb0a-a668eea6c712 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:56.509261 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ac4f1183-5a8e-4e6a-bb0a-a668eea6c712 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:56.509714 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ac4f1183-5a8e-4e6a-bb0a-a668eea6c712 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:56.510441 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ac4f1183-5a8e-4e6a-bb0a-a668eea6c712 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:56.510907 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ac4f1183-5a8e-4e6a-bb0a-a668eea6c712 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:56.511366 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ac4f1183-5a8e-4e6a-bb0a-a668eea6c712 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:56.589121 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-31c89018-a445-4fb9-acce-06ae52931be2 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:56.604490 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-31c89018-a445-4fb9-acce-06ae52931be2 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447" status: 200 len: 1313 microversion: 2.1 time: 0.232779 Sep 08 10:45:56.606063 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 981/1950] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:56 2022] GET /compute/v2.1/servers/e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447 => generated 1313 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:56.610956 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-93be9fed-f90d-41ea-949a-0a1369d7ecf9 req-6da28bc2-c1b5-4cf7-9201-eff73750efdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3766b195-ace4-4563-a24e-dca72941251e", "name": "network-vif-plugged", "status": "completed", "tag": "67c1a6b2-cd91-4a27-a9a4-731db0f530a7"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:45:56.646788 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-93be9fed-f90d-41ea-949a-0a1369d7ecf9 req-6da28bc2-c1b5-4cf7-9201-eff73750efdd service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:56.647582 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-93be9fed-f90d-41ea-949a-0a1369d7ecf9 req-6da28bc2-c1b5-4cf7-9201-eff73750efdd service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:56.648201 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-93be9fed-f90d-41ea-949a-0a1369d7ecf9 req-6da28bc2-c1b5-4cf7-9201-eff73750efdd service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:56.683604 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-93be9fed-f90d-41ea-949a-0a1369d7ecf9 req-6da28bc2-c1b5-4cf7-9201-eff73750efdd service nova] Creating event network-vif-plugged:67c1a6b2-cd91-4a27-a9a4-731db0f530a7 for instance 3766b195-ace4-4563-a24e-dca72941251e on n-h2-850501-12 Sep 08 10:45:56.691055 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-93be9fed-f90d-41ea-949a-0a1369d7ecf9 req-6da28bc2-c1b5-4cf7-9201-eff73750efdd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082553 Sep 08 10:45:56.692498 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 982/1951] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:45:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:45:56.703078 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4f7916df-1d2c-46d6-8cd0-97d0b766bb3d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:56.705726 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4f7916df-1d2c-46d6-8cd0-97d0b766bb3d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:56.714765 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4f7916df-1d2c-46d6-8cd0-97d0b766bb3d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:56.715506 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4f7916df-1d2c-46d6-8cd0-97d0b766bb3d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:56.716195 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4f7916df-1d2c-46d6-8cd0-97d0b766bb3d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:56.717173 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4f7916df-1d2c-46d6-8cd0-97d0b766bb3d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:56.717880 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4f7916df-1d2c-46d6-8cd0-97d0b766bb3d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:56.718510 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4f7916df-1d2c-46d6-8cd0-97d0b766bb3d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:56.749000 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-4f7916df-1d2c-46d6-8cd0-97d0b766bb3d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] HTTP exception thrown: Instance 4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e could not be found. Sep 08 10:45:56.751310 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4f7916df-1d2c-46d6-8cd0-97d0b766bb3d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Request method failure captured: Sep 08 10:45:56.751310 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e HTTP/1.1 Sep 08 10:45:56.751310 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:45:56.751310 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:45:56.751310 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:45:56.751310 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:45:56.751310 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:45:56.751310 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:45:56.751310 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:45:56.751310 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:45:56.751310 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcXZt42mIM6otq6VWkhIIA96oZXavtoZmbqhqPMc80NVSsiJRHHpYnYGGzEhUVoRyhAcs8Hwl3L1suVGPpViQRvBrgcN-bOUeRDMIOnFanMQUyO3LgHh8xb8i8vD5c0S9_Vu-2OsRoz_mmLSl8OWaahD1PakjyKG5z1Mn4YpkZj5tYE Sep 08 10:45:56.751310 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:45:56.751310 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:45:56.751310 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:45:56.751310 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:45:56.751310 n-d-850501-12 devstack@n-api.service[128861]: X-Openstack-Nova-Api-Version: 2.25 Sep 08 10:45:56.751310 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:45:56.751310 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:45:56.751310 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 57d64134da60477da24b7fde4e1b9680 Sep 08 10:45:56.751310 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1806613506 Sep 08 10:45:56.751310 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:45:56.751310 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:45:56.751310 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/57d64134da60477da24b7fde4e1b9680"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/57d64134da60477da24b7fde4e1b9680"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_57d64134da60477da24b7fde4e1b9680"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/57d64134da60477da24b7fde4e1b9680"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:45:56.751310 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1806613506 Sep 08 10:45:56.751310 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 57d64134da60477da24b7fde4e1b9680 Sep 08 10:45:56.751310 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1806613506 Sep 08 10:45:56.751310 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-LiveAutoBlockMigrationV225Test-1806613506-project Sep 08 10:45:56.751310 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:45:56.751310 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:45:56.751310 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 27456dd9f49540b09f2e8addd1045a94 Sep 08 10:45:56.751310 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1806613506-project Sep 08 10:45:56.751310 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:45:56.751310 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e could not be found. Sep 08 10:45:56.751310 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e'} Sep 08 10:45:56.751310 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:45:56.751310 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:45:56.751310 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:45:56.751310 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:45:56.751310 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:45:56.751310 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:45:56.751310 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:45:56.751310 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:45:56.751310 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:45:56.751310 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:45:56.751310 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e could not be found. Sep 08 10:45:56.751310 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:45:56.751310 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:45:56.751310 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:45:56.751310 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:45:56.751310 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:45:56.751310 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:45:56.751310 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:45:56.751310 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:45:56.751310 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:45:56.751310 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:45:56.751310 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:45:56.751310 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:45:56.751310 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:45:56.751310 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:45:56.751310 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:45:56.751310 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:45:56.751310 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e could not be found. Sep 08 10:45:56.751310 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:45:56.758950 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:45:56.758950 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:45:56.758950 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:45:56.758950 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:45:56.758950 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:45:56.758950 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:45:56.758950 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:45:56.758950 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e could not be found. Sep 08 10:45:56.758950 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:45:56.758950 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4f7916df-1d2c-46d6-8cd0-97d0b766bb3d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Returning 404 to user: Instance 4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:45:56.758950 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4f7916df-1d2c-46d6-8cd0-97d0b766bb3d tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e" status: 404 len: 111 microversion: 2.25 time: 0.059383 Sep 08 10:45:56.758950 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 983/1952] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:45:56 2022] GET /compute/v2.1/servers/4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:45:56.763599 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-d1828a59-3d2e-477a-a34f-25f2b13ae505 req-609d2bb7-e0fc-4062-b510-ea7f537fcbdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90974422-0d77-4970-9e94-ed6b3376ed29", "name": "network-vif-unplugged", "status": "completed", "tag": "4f14c555-3049-4edc-a15e-3ce8f070bbe0"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:45:56.775486 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-d1828a59-3d2e-477a-a34f-25f2b13ae505 req-609d2bb7-e0fc-4062-b510-ea7f537fcbdc service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:56.775981 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-d1828a59-3d2e-477a-a34f-25f2b13ae505 req-609d2bb7-e0fc-4062-b510-ea7f537fcbdc service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:56.776972 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-d1828a59-3d2e-477a-a34f-25f2b13ae505 req-609d2bb7-e0fc-4062-b510-ea7f537fcbdc service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:56.792965 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-d1828a59-3d2e-477a-a34f-25f2b13ae505 req-609d2bb7-e0fc-4062-b510-ea7f537fcbdc service nova] Creating event network-vif-unplugged:4f14c555-3049-4edc-a15e-3ce8f070bbe0 for instance 90974422-0d77-4970-9e94-ed6b3376ed29 on n-h2-850501-12 Sep 08 10:45:56.800319 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-d1828a59-3d2e-477a-a34f-25f2b13ae505 req-609d2bb7-e0fc-4062-b510-ea7f537fcbdc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040263 Sep 08 10:45:56.801453 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 984/1953] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:45:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:45:56.807439 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-0713bcf7-1d3a-43ca-ae8f-9fb6ab37b7ad req-1d75e5b9-bff0-4241-bc27-5645c468b9f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e", "name": "network-vif-deleted", "tag": "1db6620e-f793-4486-a97c-149109663837"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:45:56.825153 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-0713bcf7-1d3a-43ca-ae8f-9fb6ab37b7ad req-1d75e5b9-bff0-4241-bc27-5645c468b9f7 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:56.825651 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-0713bcf7-1d3a-43ca-ae8f-9fb6ab37b7ad req-1d75e5b9-bff0-4241-bc27-5645c468b9f7 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:56.826087 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-0713bcf7-1d3a-43ca-ae8f-9fb6ab37b7ad req-1d75e5b9-bff0-4241-bc27-5645c468b9f7 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:56.838723 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-0713bcf7-1d3a-43ca-ae8f-9fb6ab37b7ad req-1d75e5b9-bff0-4241-bc27-5645c468b9f7 service nova] Creating event network-vif-deleted:1db6620e-f793-4486-a97c-149109663837 for instance 4e2b1868-a5e4-4cea-acc5-4a4d30eb3a2e on n-h2-850501-12 Sep 08 10:45:56.843673 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-0713bcf7-1d3a-43ca-ae8f-9fb6ab37b7ad req-1d75e5b9-bff0-4241-bc27-5645c468b9f7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040041 Sep 08 10:45:56.844505 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 985/1954] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:45:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:45:56.930567 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ac4f1183-5a8e-4e6a-bb0a-a668eea6c712 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:56.941390 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ac4f1183-5a8e-4e6a-bb0a-a668eea6c712 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a" status: 200 len: 1524 microversion: 2.1 time: 0.446174 Sep 08 10:45:56.942089 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 970/1955] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:56 2022] GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a => generated 1524 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:56.947066 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f4881778-36f7-4ac1-bd1e-881adba1bff3 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '.version_select at 0x7f68e4361820>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:57.041432 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-eb1eddac-0e11-4295-9461-b3e63884af5d tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Action: 'create', calling method: .version_select at 0x7f68e4a32550>, body: {"keypair": {"name": "tempest-keypair-1381255960", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAyOuC2HkoOn/sgtJxqSxJryDgqWZmuBTpFS10KBKxCsfx5jVhzO25p0wSCPNV2ob+CW7hI9Xw7qftlVFYRg3cSL2pYXZI0YFtOaA2WD19qYX4u5axSetdO4J19QA2lFTA=="}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:45:57.066809 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-eb1eddac-0e11-4295-9461-b3e63884af5d tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Getting quotas for project 68a768a3863448bca0c6cda11afdd955. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:45:57.073769 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-eb1eddac-0e11-4295-9461-b3e63884af5d tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Getting quotas for user 03ff38511b484fbcb7817a56076cf4b7 and project 68a768a3863448bca0c6cda11afdd955. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:45:57.113581 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-eb1eddac-0e11-4295-9461-b3e63884af5d tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.266651 Sep 08 10:45:57.114234 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 986/1956] 10.222.0.27 () {60 vars in 1159 bytes} [Thu Sep 8 10:45:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:45:57.121577 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c674e868-a1e9-48e9-829c-36682a7e0d54 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '.version_select at 0x7f68e44cbee0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:57.199218 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c674e868-a1e9-48e9-829c-36682a7e0d54 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/images/6ca320eb-4ec1-4390-b737-c4ed16dbfe81" status: 200 len: 1423 microversion: 2.1 time: 0.083664 Sep 08 10:45:57.200239 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 987/1957] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:45:57 2022] GET /compute/v2.1/images/6ca320eb-4ec1-4390-b737-c4ed16dbfe81 => generated 1423 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:57.205313 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0074c29f-ba26-4576-ad61-a20abd3fc7ec tempest-QuotasTestJSON-2091651584 tempest-QuotasTestJSON-2091651584-project] Calling method '.version_select at 0x7f68e8a43280>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:57.308510 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0074c29f-ba26-4576-ad61-a20abd3fc7ec tempest-QuotasTestJSON-2091651584 tempest-QuotasTestJSON-2091651584-project] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/1dbde5ec7cce46c5a37264d0f9029b22" status: 200 len: 371 microversion: 2.1 time: 0.106765 Sep 08 10:45:57.309254 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 988/1958] 10.222.0.27 () {58 vars in 1242 bytes} [Thu Sep 8 10:45:57 2022] GET /compute/v2.1/os-quota-sets/1dbde5ec7cce46c5a37264d0f9029b22 => generated 371 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:45:57.317412 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b942adea-4af1-4dbb-bd93-001048228d17 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '.version_select at 0x7f68e4a57280>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:57.348606 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b942adea-4af1-4dbb-bd93-001048228d17 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-143108311" status: 204 len: 0 microversion: 2.25 time: 0.037239 Sep 08 10:45:57.353841 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 989/1959] 10.222.0.27 () {60 vars in 1259 bytes} [Thu Sep 8 10:45:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-143108311 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 10:45:57.359715 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a6accda0-f317-40d4-8224-27e5e651da3d tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '.version_select at 0x7f68e48c99d0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:57.663612 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f4881778-36f7-4ac1-bd1e-881adba1bff3 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "DELETE /compute/v2.1/images/8ca5d5cf-e00d-4aad-9d69-6851cbd20fce" status: 204 len: 0 microversion: 2.1 time: 0.720361 Sep 08 10:45:57.665520 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 971/1960] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:56 2022] DELETE /compute/v2.1/images/8ca5d5cf-e00d-4aad-9d69-6851cbd20fce => generated 0 bytes in 722 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:45:57.691389 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7f869bfc-2304-4f67-b1be-eb6ffb343d1e tempest-QuotasTestJSON-2091651584 tempest-QuotasTestJSON-2091651584-project] Calling method '.version_select at 0x7f68e8b19d30>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:57.815413 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7f869bfc-2304-4f67-b1be-eb6ffb343d1e tempest-QuotasTestJSON-2091651584 tempest-QuotasTestJSON-2091651584-project] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/1dbde5ec7cce46c5a37264d0f9029b22/defaults" status: 200 len: 371 microversion: 2.1 time: 0.148279 Sep 08 10:45:57.826331 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 972/1961] 10.222.0.27 () {58 vars in 1269 bytes} [Thu Sep 8 10:45:57 2022] GET /compute/v2.1/os-quota-sets/1dbde5ec7cce46c5a37264d0f9029b22/defaults => generated 371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:45:57.838260 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c76bcf61-c049-4f8b-a48a-e802705de50c tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:57.838769 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c76bcf61-c049-4f8b-a48a-e802705de50c tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 90974422-0d77-4970-9e94-ed6b3376ed29] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:57.849682 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c76bcf61-c049-4f8b-a48a-e802705de50c tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:57.850483 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c76bcf61-c049-4f8b-a48a-e802705de50c tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:57.850885 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c76bcf61-c049-4f8b-a48a-e802705de50c tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:57.851767 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c76bcf61-c049-4f8b-a48a-e802705de50c tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:57.852475 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c76bcf61-c049-4f8b-a48a-e802705de50c tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:57.853099 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c76bcf61-c049-4f8b-a48a-e802705de50c tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:58.053417 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a6accda0-f317-40d4-8224-27e5e651da3d tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "DELETE /compute/v2.1/images/6ca320eb-4ec1-4390-b737-c4ed16dbfe81" status: 204 len: 0 microversion: 2.1 time: 0.698431 Sep 08 10:45:58.054302 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 990/1962] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:57 2022] DELETE /compute/v2.1/images/6ca320eb-4ec1-4390-b737-c4ed16dbfe81 => generated 0 bytes in 700 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:45:58.060046 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cb12dc03-fc75-4bf7-b146-8aa4c376e145 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:58.061214 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cb12dc03-fc75-4bf7-b146-8aa4c376e145 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:58.068714 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb12dc03-fc75-4bf7-b146-8aa4c376e145 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:58.069635 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb12dc03-fc75-4bf7-b146-8aa4c376e145 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:58.070164 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb12dc03-fc75-4bf7-b146-8aa4c376e145 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:58.071105 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb12dc03-fc75-4bf7-b146-8aa4c376e145 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:58.071784 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb12dc03-fc75-4bf7-b146-8aa4c376e145 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:58.072560 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb12dc03-fc75-4bf7-b146-8aa4c376e145 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:58.242449 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c76bcf61-c049-4f8b-a48a-e802705de50c tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:58.250830 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c76bcf61-c049-4f8b-a48a-e802705de50c tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29" status: 200 len: 1381 microversion: 2.1 time: 0.423243 Sep 08 10:45:58.251673 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 973/1963] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:57 2022] GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29 => generated 1381 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:58.257058 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1d2626ad-5941-4810-915c-b0875b80fc95 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:58.258038 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1d2626ad-5941-4810-915c-b0875b80fc95 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] [instance: dac27157-b08e-4f13-b97e-3c5b653bd0b3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:58.264502 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1d2626ad-5941-4810-915c-b0875b80fc95 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:58.265083 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1d2626ad-5941-4810-915c-b0875b80fc95 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:58.266816 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1d2626ad-5941-4810-915c-b0875b80fc95 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:58.267811 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1d2626ad-5941-4810-915c-b0875b80fc95 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:58.268458 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1d2626ad-5941-4810-915c-b0875b80fc95 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:58.269807 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1d2626ad-5941-4810-915c-b0875b80fc95 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:58.301458 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1d2626ad-5941-4810-915c-b0875b80fc95 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] [instance: dac27157-b08e-4f13-b97e-3c5b653bd0b3] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:45:58.388130 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-cb12dc03-fc75-4bf7-b146-8aa4c376e145 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:58.402149 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cb12dc03-fc75-4bf7-b146-8aa4c376e145 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447" status: 200 len: 1313 microversion: 2.1 time: 0.346340 Sep 08 10:45:58.402865 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 991/1964] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:58 2022] GET /compute/v2.1/servers/e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447 => generated 1313 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:58.416036 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-83d94830-0ee5-428c-84a6-30bd3328c3db tempest-QuotasTestJSON-2091651584 tempest-QuotasTestJSON-2091651584-project] Calling method '.version_select at 0x7f68e89d13a0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:58.469535 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1d2626ad-5941-4810-915c-b0875b80fc95 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "DELETE /compute/v2.1/servers/dac27157-b08e-4f13-b97e-3c5b653bd0b3" status: 204 len: 0 microversion: 2.1 time: 0.215941 Sep 08 10:45:58.472627 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 974/1965] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:45:58 2022] DELETE /compute/v2.1/servers/dac27157-b08e-4f13-b97e-3c5b653bd0b3 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:45:58.482413 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e4bd5574-772c-4ecb-8c89-cd92bea817a9 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:58.483506 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e4bd5574-772c-4ecb-8c89-cd92bea817a9 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: f9f308fa-d4a6-4ac9-8c64-927e082b0b4a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:58.495875 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-83d94830-0ee5-428c-84a6-30bd3328c3db tempest-QuotasTestJSON-2091651584 tempest-QuotasTestJSON-2091651584-project] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/1dbde5ec7cce46c5a37264d0f9029b22" status: 200 len: 371 microversion: 2.1 time: 0.091851 Sep 08 10:45:58.496471 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 992/1966] 10.222.0.27 () {58 vars in 1242 bytes} [Thu Sep 8 10:45:58 2022] GET /compute/v2.1/os-quota-sets/1dbde5ec7cce46c5a37264d0f9029b22 => generated 371 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:45:58.502799 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e4bd5574-772c-4ecb-8c89-cd92bea817a9 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:58.503962 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e4bd5574-772c-4ecb-8c89-cd92bea817a9 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:58.504426 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e4bd5574-772c-4ecb-8c89-cd92bea817a9 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:58.505465 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e4bd5574-772c-4ecb-8c89-cd92bea817a9 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:58.506181 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e4bd5574-772c-4ecb-8c89-cd92bea817a9 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:58.506681 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e4bd5574-772c-4ecb-8c89-cd92bea817a9 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:58.514162 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cd021827-1a2f-4d76-9fbb-439660a4543a tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:58.514839 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cd021827-1a2f-4d76-9fbb-439660a4543a tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 64c88fa0-6a01-42fc-b0e9-98b9e84a199d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:58.522693 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cd021827-1a2f-4d76-9fbb-439660a4543a tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:58.523335 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cd021827-1a2f-4d76-9fbb-439660a4543a tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:58.523732 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cd021827-1a2f-4d76-9fbb-439660a4543a tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:58.524451 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cd021827-1a2f-4d76-9fbb-439660a4543a tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:58.524904 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cd021827-1a2f-4d76-9fbb-439660a4543a tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:58.525366 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cd021827-1a2f-4d76-9fbb-439660a4543a tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:58.554343 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cd021827-1a2f-4d76-9fbb-439660a4543a tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 64c88fa0-6a01-42fc-b0e9-98b9e84a199d] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:45:58.655086 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cd021827-1a2f-4d76-9fbb-439660a4543a tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "DELETE /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d" status: 204 len: 0 microversion: 2.1 time: 0.157066 Sep 08 10:45:58.656309 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 993/1967] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:45:58 2022] DELETE /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:45:58.662673 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-414cac84-5e60-4167-8c68-3654d9ecacca tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Calling method '.version_select at 0x7f68e4be84c0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:58.666995 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-414cac84-5e60-4167-8c68-3654d9ecacca tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:58.667687 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-414cac84-5e60-4167-8c68-3654d9ecacca tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:58.668369 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-414cac84-5e60-4167-8c68-3654d9ecacca tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:58.698578 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-414cac84-5e60-4167-8c68-3654d9ecacca tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 2343 microversion: 2.1 time: 0.040657 Sep 08 10:45:58.705018 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 994/1968] 10.222.0.27 () {58 vars in 1143 bytes} [Thu Sep 8 10:45:58 2022] GET /compute/v2.1/os-migrations => generated 2343 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:58.717443 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-46f02d04-ac2a-4f96-a29f-954ec701514f tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:58.718212 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-46f02d04-ac2a-4f96-a29f-954ec701514f tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] [instance: dac27157-b08e-4f13-b97e-3c5b653bd0b3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:58.725370 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-46f02d04-ac2a-4f96-a29f-954ec701514f tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:58.725907 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-46f02d04-ac2a-4f96-a29f-954ec701514f tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:58.726348 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-46f02d04-ac2a-4f96-a29f-954ec701514f tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:58.727061 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-46f02d04-ac2a-4f96-a29f-954ec701514f tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:58.727721 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-46f02d04-ac2a-4f96-a29f-954ec701514f tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:58.728325 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-46f02d04-ac2a-4f96-a29f-954ec701514f tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:58.874211 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e4bd5574-772c-4ecb-8c89-cd92bea817a9 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:58.885743 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e4bd5574-772c-4ecb-8c89-cd92bea817a9 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a" status: 200 len: 1506 microversion: 2.1 time: 0.411146 Sep 08 10:45:58.886686 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 975/1969] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:58 2022] GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a => generated 1506 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:58.891822 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d7e6a37b-8476-4a4c-b877-b57d24da0009 tempest-QuotasTestJSON-2091651584 tempest-QuotasTestJSON-2091651584-project] Calling method '.version_select at 0x7f68e8b5fb80>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:58.987022 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d7e6a37b-8476-4a4c-b877-b57d24da0009 tempest-QuotasTestJSON-2091651584 tempest-QuotasTestJSON-2091651584-project] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/1dbde5ec7cce46c5a37264d0f9029b22?user_id=4b9a8ee4181e40228b260ea8ac3f43f8" status: 200 len: 371 microversion: 2.1 time: 0.098688 Sep 08 10:45:58.989541 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 976/1970] 10.222.0.27 () {58 vars in 1323 bytes} [Thu Sep 8 10:45:58 2022] GET /compute/v2.1/os-quota-sets/1dbde5ec7cce46c5a37264d0f9029b22?user_id=4b9a8ee4181e40228b260ea8ac3f43f8 => generated 371 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:45:58.995953 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-ae6f8f6c-4727-4b50-8240-24c20edfc932 req-26ec82ba-828e-4ee1-b61d-e625b38c59ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447", "name": "network-vif-plugged", "status": "completed", "tag": "41bf8ea0-de68-4df3-97ef-2656e5d1ec8b"}, {"server_uuid": "f9f308fa-d4a6-4ac9-8c64-927e082b0b4a", "name": "network-vif-plugged", "status": "completed", "tag": "113493e8-8f02-4099-b529-0616d267ed77"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:45:59.012961 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ae6f8f6c-4727-4b50-8240-24c20edfc932 req-26ec82ba-828e-4ee1-b61d-e625b38c59ec service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:59.013555 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ae6f8f6c-4727-4b50-8240-24c20edfc932 req-26ec82ba-828e-4ee1-b61d-e625b38c59ec service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:59.014060 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ae6f8f6c-4727-4b50-8240-24c20edfc932 req-26ec82ba-828e-4ee1-b61d-e625b38c59ec service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:59.037973 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-ae6f8f6c-4727-4b50-8240-24c20edfc932 req-26ec82ba-828e-4ee1-b61d-e625b38c59ec service nova] Creating event network-vif-plugged:41bf8ea0-de68-4df3-97ef-2656e5d1ec8b for instance e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447 on n-h1-850501-12 Sep 08 10:45:59.039418 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-ae6f8f6c-4727-4b50-8240-24c20edfc932 req-26ec82ba-828e-4ee1-b61d-e625b38c59ec service nova] Creating event network-vif-plugged:113493e8-8f02-4099-b529-0616d267ed77 for instance f9f308fa-d4a6-4ac9-8c64-927e082b0b4a on n-h1-850501-12 Sep 08 10:45:59.047806 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-ae6f8f6c-4727-4b50-8240-24c20edfc932 req-26ec82ba-828e-4ee1-b61d-e625b38c59ec service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.055712 Sep 08 10:45:59.048300 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 977/1971] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:45:58 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:45:59.054893 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9771152b-f46a-4a6a-8803-acbdc84b3b9b tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:59.055603 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9771152b-f46a-4a6a-8803-acbdc84b3b9b tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] [instance: 90974422-0d77-4970-9e94-ed6b3376ed29] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:59.062054 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9771152b-f46a-4a6a-8803-acbdc84b3b9b tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:59.062581 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9771152b-f46a-4a6a-8803-acbdc84b3b9b tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:59.063072 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9771152b-f46a-4a6a-8803-acbdc84b3b9b tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:59.063787 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9771152b-f46a-4a6a-8803-acbdc84b3b9b tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:59.064247 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9771152b-f46a-4a6a-8803-acbdc84b3b9b tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:59.064670 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9771152b-f46a-4a6a-8803-acbdc84b3b9b tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:59.218557 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-46f02d04-ac2a-4f96-a29f-954ec701514f tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7415a5b46c4587a8806661b70e3913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604588959944720923ec2d5e0bf81c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:59.239270 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-46f02d04-ac2a-4f96-a29f-954ec701514f tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/servers/dac27157-b08e-4f13-b97e-3c5b653bd0b3" status: 200 len: 1472 microversion: 2.1 time: 0.532973 Sep 08 10:45:59.242212 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9771152b-f46a-4a6a-8803-acbdc84b3b9b tempest-LiveMigrationTest-698430362 tempest-LiveMigrationTest-698430362-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29" status: 200 len: 1534 microversion: 2.1 time: 0.192207 Sep 08 10:45:59.242923 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 978/1972] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:59 2022] GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29 => generated 1534 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:59.245244 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 995/1973] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:58 2022] GET /compute/v2.1/servers/dac27157-b08e-4f13-b97e-3c5b653bd0b3 => generated 1472 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:59.267240 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bad19658-82b9-4c76-95df-b24729c3137e tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1902765075", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "c5773ac9-6cb1-4d96-9195-6fd6adb76930"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:45:59.288375 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-3baf732b-0e05-4085-ba5e-c1a039c81464 req-c8bad90f-2246-4bfe-a81a-8e7f9310fc67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90974422-0d77-4970-9e94-ed6b3376ed29", "tag": "4f14c555-3049-4edc-a15e-3ce8f070bbe0"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:45:59.299114 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-3baf732b-0e05-4085-ba5e-c1a039c81464 req-c8bad90f-2246-4bfe-a81a-8e7f9310fc67 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:59.299861 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-3baf732b-0e05-4085-ba5e-c1a039c81464 req-c8bad90f-2246-4bfe-a81a-8e7f9310fc67 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:59.300756 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-3baf732b-0e05-4085-ba5e-c1a039c81464 req-c8bad90f-2246-4bfe-a81a-8e7f9310fc67 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:59.314911 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-3baf732b-0e05-4085-ba5e-c1a039c81464 req-c8bad90f-2246-4bfe-a81a-8e7f9310fc67 service nova] Creating event network-changed:4f14c555-3049-4edc-a15e-3ce8f070bbe0 for instance 90974422-0d77-4970-9e94-ed6b3376ed29 on n-h1-850501-12 Sep 08 10:45:59.321576 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-3baf732b-0e05-4085-ba5e-c1a039c81464 req-c8bad90f-2246-4bfe-a81a-8e7f9310fc67 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050554 Sep 08 10:45:59.323361 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 996/1974] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:45:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:45:59.329967 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b8579679-1f11-4be2-8937-a6809f44ea29 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:59.332057 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b8579679-1f11-4be2-8937-a6809f44ea29 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 422ceb5f-740f-45e5-9596-6796719adf27] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:59.344365 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b8579679-1f11-4be2-8937-a6809f44ea29 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:59.344921 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b8579679-1f11-4be2-8937-a6809f44ea29 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:59.345484 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b8579679-1f11-4be2-8937-a6809f44ea29 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:59.347792 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b8579679-1f11-4be2-8937-a6809f44ea29 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:59.348452 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b8579679-1f11-4be2-8937-a6809f44ea29 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:59.349015 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b8579679-1f11-4be2-8937-a6809f44ea29 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:59.351369 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-bad19658-82b9-4c76-95df-b24729c3137e tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] validate_networks() for [('c5773ac9-6cb1-4d96-9195-6fd6adb76930', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:45:59.382903 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b8579679-1f11-4be2-8937-a6809f44ea29 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 422ceb5f-740f-45e5-9596-6796719adf27] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:45:59.500143 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b8579679-1f11-4be2-8937-a6809f44ea29 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "DELETE /compute/v2.1/servers/422ceb5f-740f-45e5-9596-6796719adf27" status: 204 len: 0 microversion: 2.25 time: 0.173857 Sep 08 10:45:59.502084 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 997/1975] 10.222.0.27 () {60 vars in 1280 bytes} [Thu Sep 8 10:45:59 2022] DELETE /compute/v2.1/servers/422ceb5f-740f-45e5-9596-6796719adf27 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 10:45:59.512349 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b4ade292-570d-4724-bfa7-0f4621af33b2 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:59.513512 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b4ade292-570d-4724-bfa7-0f4621af33b2 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 90974422-0d77-4970-9e94-ed6b3376ed29] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:59.522588 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b4ade292-570d-4724-bfa7-0f4621af33b2 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:59.523150 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b4ade292-570d-4724-bfa7-0f4621af33b2 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:59.523650 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b4ade292-570d-4724-bfa7-0f4621af33b2 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:59.524379 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b4ade292-570d-4724-bfa7-0f4621af33b2 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:59.525575 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b4ade292-570d-4724-bfa7-0f4621af33b2 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:59.526231 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b4ade292-570d-4724-bfa7-0f4621af33b2 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:59.556885 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b4ade292-570d-4724-bfa7-0f4621af33b2 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 90974422-0d77-4970-9e94-ed6b3376ed29] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:45:59.667217 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b4ade292-570d-4724-bfa7-0f4621af33b2 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "DELETE /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29" status: 204 len: 0 microversion: 2.1 time: 0.162109 Sep 08 10:45:59.668330 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 998/1976] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:45:59 2022] DELETE /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:45:59.675734 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-03c52a94-beb4-48fd-9e5d-87c1b4dee6d5 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:59.676567 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-03c52a94-beb4-48fd-9e5d-87c1b4dee6d5 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:59.684725 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-03c52a94-beb4-48fd-9e5d-87c1b4dee6d5 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:59.685257 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-03c52a94-beb4-48fd-9e5d-87c1b4dee6d5 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:59.685690 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-03c52a94-beb4-48fd-9e5d-87c1b4dee6d5 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:59.688399 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-03c52a94-beb4-48fd-9e5d-87c1b4dee6d5 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:59.689256 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-03c52a94-beb4-48fd-9e5d-87c1b4dee6d5 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:59.689758 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-03c52a94-beb4-48fd-9e5d-87c1b4dee6d5 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:59.844690 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-03c52a94-beb4-48fd-9e5d-87c1b4dee6d5 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:59.853831 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-03c52a94-beb4-48fd-9e5d-87c1b4dee6d5 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447" status: 200 len: 1313 microversion: 2.1 time: 0.183890 Sep 08 10:45:59.857198 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 999/1977] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:59 2022] GET /compute/v2.1/servers/e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447 => generated 1313 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:59.863134 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5d95f088-ca9d-4f86-a1e9-14f40b0d4b64 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:59.864144 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5d95f088-ca9d-4f86-a1e9-14f40b0d4b64 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 422ceb5f-740f-45e5-9596-6796719adf27] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:59.874152 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5d95f088-ca9d-4f86-a1e9-14f40b0d4b64 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:59.874655 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5d95f088-ca9d-4f86-a1e9-14f40b0d4b64 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:59.875091 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5d95f088-ca9d-4f86-a1e9-14f40b0d4b64 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:59.875807 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5d95f088-ca9d-4f86-a1e9-14f40b0d4b64 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:59.876442 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5d95f088-ca9d-4f86-a1e9-14f40b0d4b64 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:59.876853 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5d95f088-ca9d-4f86-a1e9-14f40b0d4b64 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:00.044913 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-bad19658-82b9-4c76-95df-b24729c3137e tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:46:00.045831 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-bad19658-82b9-4c76-95df-b24729c3137e tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:46:00.046571 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-bad19658-82b9-4c76-95df-b24729c3137e tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:46:00.047428 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-bad19658-82b9-4c76-95df-b24729c3137e tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:46:00.048282 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-bad19658-82b9-4c76-95df-b24729c3137e tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:46:00.062973 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bad19658-82b9-4c76-95df-b24729c3137e tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:00.063614 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bad19658-82b9-4c76-95df-b24729c3137e tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:00.064227 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bad19658-82b9-4c76-95df-b24729c3137e tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:00.065138 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bad19658-82b9-4c76-95df-b24729c3137e tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:00.065766 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bad19658-82b9-4c76-95df-b24729c3137e tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:00.066306 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bad19658-82b9-4c76-95df-b24729c3137e tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:00.088521 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-bad19658-82b9-4c76-95df-b24729c3137e tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Getting quotas for project eeeb450420314221bd2469816e2995d1. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:46:00.094648 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-bad19658-82b9-4c76-95df-b24729c3137e tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Getting quotas for user ce8c8c85354d46aeb786c8049b81e04d and project eeeb450420314221bd2469816e2995d1. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:46:00.113944 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bad19658-82b9-4c76-95df-b24729c3137e tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:46:00.116631 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bad19658-82b9-4c76-95df-b24729c3137e tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 7d251638-b28f-4137-a81a-ce1a21cd7418] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:46:00.137317 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5d95f088-ca9d-4f86-a1e9-14f40b0d4b64 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:00.147545 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5d95f088-ca9d-4f86-a1e9-14f40b0d4b64 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:00.149951 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5d95f088-ca9d-4f86-a1e9-14f40b0d4b64 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:00.151332 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5d95f088-ca9d-4f86-a1e9-14f40b0d4b64 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/422ceb5f-740f-45e5-9596-6796719adf27" status: 200 len: 1547 microversion: 2.25 time: 0.292805 Sep 08 10:46:00.152347 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1000/1978] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:45:59 2022] GET /compute/v2.1/servers/422ceb5f-740f-45e5-9596-6796719adf27 => generated 1547 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:46:00.158602 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6ab991bb-4efe-464f-a2ed-ea3d9e5592c2 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:00.159426 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6ab991bb-4efe-464f-a2ed-ea3d9e5592c2 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 90974422-0d77-4970-9e94-ed6b3376ed29] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:00.178977 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6ab991bb-4efe-464f-a2ed-ea3d9e5592c2 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:00.178977 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6ab991bb-4efe-464f-a2ed-ea3d9e5592c2 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:00.180772 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6ab991bb-4efe-464f-a2ed-ea3d9e5592c2 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:00.181702 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6ab991bb-4efe-464f-a2ed-ea3d9e5592c2 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:00.182284 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6ab991bb-4efe-464f-a2ed-ea3d9e5592c2 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:00.183199 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6ab991bb-4efe-464f-a2ed-ea3d9e5592c2 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:00.184814 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bad19658-82b9-4c76-95df-b24729c3137e tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.921498 Sep 08 10:46:00.185543 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 979/1979] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:45:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 923 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:46:00.193863 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-71de0378-4eea-49d7-88cf-6464b331a03e tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-495740450", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "d95e49f0-b609-40de-a984-83ccfd7750c4"}], "security_groups": [{"name": "tempest-securitygroup--871164067"}], "key_name": "tempest-keypair-1381255960", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:46:00.235876 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:46:00.427441 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-71de0378-4eea-49d7-88cf-6464b331a03e tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] validate_networks() for [('d95e49f0-b609-40de-a984-83ccfd7750c4', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:46:00.445191 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6ab991bb-4efe-464f-a2ed-ea3d9e5592c2 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:00.461976 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6ab991bb-4efe-464f-a2ed-ea3d9e5592c2 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29" status: 200 len: 1387 microversion: 2.1 time: 0.308285 Sep 08 10:46:00.463563 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1001/1980] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:00 2022] GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29 => generated 1387 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:00.477260 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b7baa716-502c-4c98-a581-5b6248104504 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:00.478527 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b7baa716-502c-4c98-a581-5b6248104504 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: f9f308fa-d4a6-4ac9-8c64-927e082b0b4a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:00.491351 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b7baa716-502c-4c98-a581-5b6248104504 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:00.491917 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b7baa716-502c-4c98-a581-5b6248104504 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:00.493177 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b7baa716-502c-4c98-a581-5b6248104504 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:00.493977 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b7baa716-502c-4c98-a581-5b6248104504 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:00.494474 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b7baa716-502c-4c98-a581-5b6248104504 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:00.495294 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b7baa716-502c-4c98-a581-5b6248104504 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:00.701616 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b7baa716-502c-4c98-a581-5b6248104504 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:00.729987 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b7baa716-502c-4c98-a581-5b6248104504 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a" status: 200 len: 1506 microversion: 2.1 time: 0.262849 Sep 08 10:46:00.732666 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1002/1981] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:00 2022] GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a => generated 1506 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:00.740275 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8690f0c3-c3b4-4a68-ab86-37deb1710da8 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:00.741302 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8690f0c3-c3b4-4a68-ab86-37deb1710da8 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 7d251638-b28f-4137-a81a-ce1a21cd7418] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:00.816959 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8690f0c3-c3b4-4a68-ab86-37deb1710da8 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:00.834976 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8690f0c3-c3b4-4a68-ab86-37deb1710da8 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/7d251638-b28f-4137-a81a-ce1a21cd7418" status: 200 len: 1208 microversion: 2.1 time: 0.099628 Sep 08 10:46:00.858217 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1003/1982] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:00 2022] GET /compute/v2.1/servers/7d251638-b28f-4137-a81a-ce1a21cd7418 => generated 1208 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:00.865248 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a3612e7a-b1b6-46e7-a85c-33d09b9db4d5 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:00.866321 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a3612e7a-b1b6-46e7-a85c-33d09b9db4d5 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] [instance: dac27157-b08e-4f13-b97e-3c5b653bd0b3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:00.881588 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a3612e7a-b1b6-46e7-a85c-33d09b9db4d5 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:00.883172 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a3612e7a-b1b6-46e7-a85c-33d09b9db4d5 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:00.898043 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a3612e7a-b1b6-46e7-a85c-33d09b9db4d5 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:00.902498 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a3612e7a-b1b6-46e7-a85c-33d09b9db4d5 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:00.903151 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a3612e7a-b1b6-46e7-a85c-33d09b9db4d5 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:00.905189 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a3612e7a-b1b6-46e7-a85c-33d09b9db4d5 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:01.179274 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a3612e7a-b1b6-46e7-a85c-33d09b9db4d5 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7415a5b46c4587a8806661b70e3913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604588959944720923ec2d5e0bf81c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:01.188634 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a3612e7a-b1b6-46e7-a85c-33d09b9db4d5 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/servers/dac27157-b08e-4f13-b97e-3c5b653bd0b3" status: 200 len: 1472 microversion: 2.1 time: 0.328897 Sep 08 10:46:01.189338 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1004/1983] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:00 2022] GET /compute/v2.1/servers/dac27157-b08e-4f13-b97e-3c5b653bd0b3 => generated 1472 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:01.212162 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d75aed8a-9307-4820-bc0b-0cd83ee6764e tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:01.213211 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d75aed8a-9307-4820-bc0b-0cd83ee6764e tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:01.220729 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d75aed8a-9307-4820-bc0b-0cd83ee6764e tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:01.222251 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d75aed8a-9307-4820-bc0b-0cd83ee6764e tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:01.223360 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d75aed8a-9307-4820-bc0b-0cd83ee6764e tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:01.224344 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d75aed8a-9307-4820-bc0b-0cd83ee6764e tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:01.225007 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d75aed8a-9307-4820-bc0b-0cd83ee6764e tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:01.225690 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d75aed8a-9307-4820-bc0b-0cd83ee6764e tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:01.232733 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-71de0378-4eea-49d7-88cf-6464b331a03e tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:46:01.233434 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-71de0378-4eea-49d7-88cf-6464b331a03e tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:46:01.234554 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-71de0378-4eea-49d7-88cf-6464b331a03e tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:46:01.235183 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-71de0378-4eea-49d7-88cf-6464b331a03e tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:46:01.235765 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-71de0378-4eea-49d7-88cf-6464b331a03e tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:46:01.265629 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71de0378-4eea-49d7-88cf-6464b331a03e tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:01.267290 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71de0378-4eea-49d7-88cf-6464b331a03e tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:01.267800 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71de0378-4eea-49d7-88cf-6464b331a03e tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:01.271899 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71de0378-4eea-49d7-88cf-6464b331a03e tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:01.273491 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71de0378-4eea-49d7-88cf-6464b331a03e tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:01.281244 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71de0378-4eea-49d7-88cf-6464b331a03e tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:01.337101 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-71de0378-4eea-49d7-88cf-6464b331a03e tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Getting quotas for project 68a768a3863448bca0c6cda11afdd955. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:46:01.345512 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-71de0378-4eea-49d7-88cf-6464b331a03e tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Getting quotas for user 03ff38511b484fbcb7817a56076cf4b7 and project 68a768a3863448bca0c6cda11afdd955. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:46:01.366828 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-71de0378-4eea-49d7-88cf-6464b331a03e tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:46:01.380627 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-71de0378-4eea-49d7-88cf-6464b331a03e tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] [instance: 72eb7387-3f16-4b4f-ab9a-89076f169fc1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:46:01.440001 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-71de0378-4eea-49d7-88cf-6464b331a03e tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.253376 Sep 08 10:46:01.442099 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 980/1984] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:46:00 2022] POST /compute/v2.1/servers => generated 405 bytes in 1256 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:46:01.451063 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-9a172cf9-2c8a-4423-810e-6c1bfa209221 req-d7c05e5e-78fc-44fc-b2ad-ef326fe0b8c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "422ceb5f-740f-45e5-9596-6796719adf27", "name": "network-vif-deleted", "tag": "9dcf1823-c8b6-4d30-88b4-559bc9d90002"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:46:01.465416 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-9a172cf9-2c8a-4423-810e-6c1bfa209221 req-d7c05e5e-78fc-44fc-b2ad-ef326fe0b8c8 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:01.466228 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-9a172cf9-2c8a-4423-810e-6c1bfa209221 req-d7c05e5e-78fc-44fc-b2ad-ef326fe0b8c8 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:01.467067 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-9a172cf9-2c8a-4423-810e-6c1bfa209221 req-d7c05e5e-78fc-44fc-b2ad-ef326fe0b8c8 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:01.490406 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-9a172cf9-2c8a-4423-810e-6c1bfa209221 req-d7c05e5e-78fc-44fc-b2ad-ef326fe0b8c8 service nova] Creating event network-vif-deleted:9dcf1823-c8b6-4d30-88b4-559bc9d90002 for instance 422ceb5f-740f-45e5-9596-6796719adf27 on n-h2-850501-12 Sep 08 10:46:01.501714 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-9a172cf9-2c8a-4423-810e-6c1bfa209221 req-d7c05e5e-78fc-44fc-b2ad-ef326fe0b8c8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058120 Sep 08 10:46:01.503929 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 981/1985] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:46:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:46:01.527106 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-bf7d8761-020e-466c-957d-a661955e285b req-14902ae1-2142-4510-a977-c4f137dcbde9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64c88fa0-6a01-42fc-b0e9-98b9e84a199d", "name": "network-vif-unplugged", "status": "completed", "tag": "2a441d6d-9009-42c2-a8aa-1b70f9d6ee7f"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:46:01.538295 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d75aed8a-9307-4820-bc0b-0cd83ee6764e tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:01.551612 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-bf7d8761-020e-466c-957d-a661955e285b req-14902ae1-2142-4510-a977-c4f137dcbde9 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:01.552376 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-bf7d8761-020e-466c-957d-a661955e285b req-14902ae1-2142-4510-a977-c4f137dcbde9 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:01.553538 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-bf7d8761-020e-466c-957d-a661955e285b req-14902ae1-2142-4510-a977-c4f137dcbde9 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:01.557675 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d75aed8a-9307-4820-bc0b-0cd83ee6764e tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447" status: 200 len: 1313 microversion: 2.1 time: 0.354181 Sep 08 10:46:01.576943 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1005/1986] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:01 2022] GET /compute/v2.1/servers/e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447 => generated 1313 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:01.582807 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-595c1c4b-55aa-4451-bd62-72a1a9c384bb tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:01.583841 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-595c1c4b-55aa-4451-bd62-72a1a9c384bb tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 422ceb5f-740f-45e5-9596-6796719adf27] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:01.588396 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-bf7d8761-020e-466c-957d-a661955e285b req-14902ae1-2142-4510-a977-c4f137dcbde9 service nova] Creating event network-vif-unplugged:2a441d6d-9009-42c2-a8aa-1b70f9d6ee7f for instance 64c88fa0-6a01-42fc-b0e9-98b9e84a199d on n-h1-850501-12 Sep 08 10:46:01.596919 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-bf7d8761-020e-466c-957d-a661955e285b req-14902ae1-2142-4510-a977-c4f137dcbde9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078056 Sep 08 10:46:01.606243 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 982/1987] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:46:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:46:01.624557 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-595c1c4b-55aa-4451-bd62-72a1a9c384bb tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:01.625253 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-595c1c4b-55aa-4451-bd62-72a1a9c384bb tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:01.625719 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-595c1c4b-55aa-4451-bd62-72a1a9c384bb tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:01.630205 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-595c1c4b-55aa-4451-bd62-72a1a9c384bb tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:01.630923 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-595c1c4b-55aa-4451-bd62-72a1a9c384bb tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:01.631445 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-595c1c4b-55aa-4451-bd62-72a1a9c384bb tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:01.638603 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ee4ef171-b381-43bc-b166-d0159e380b65 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:01.645372 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ee4ef171-b381-43bc-b166-d0159e380b65 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] [instance: 72eb7387-3f16-4b4f-ab9a-89076f169fc1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:01.804945 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-595c1c4b-55aa-4451-bd62-72a1a9c384bb tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:01.805575 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-595c1c4b-55aa-4451-bd62-72a1a9c384bb tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:01.805978 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-595c1c4b-55aa-4451-bd62-72a1a9c384bb tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:01.808484 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-595c1c4b-55aa-4451-bd62-72a1a9c384bb tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lazy-loading 'fault' on Instance uuid 422ceb5f-740f-45e5-9596-6796719adf27 {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:46:01.881055 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ee4ef171-b381-43bc-b166-d0159e380b65 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ff38511b484fbcb7817a56076cf4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a768a3863448bca0c6cda11afdd955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:01.890265 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-595c1c4b-55aa-4451-bd62-72a1a9c384bb tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:01.891453 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ee4ef171-b381-43bc-b166-d0159e380b65 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] 10.222.0.27 "GET /compute/v2.1/servers/72eb7387-3f16-4b4f-ab9a-89076f169fc1" status: 200 len: 1241 microversion: 2.1 time: 0.282699 Sep 08 10:46:01.892707 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 983/1988] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:01 2022] GET /compute/v2.1/servers/72eb7387-3f16-4b4f-ab9a-89076f169fc1 => generated 1241 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:01.901699 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8f558933-ec6b-4792-884d-40d18bec329b tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:01.902698 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8f558933-ec6b-4792-884d-40d18bec329b tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 90974422-0d77-4970-9e94-ed6b3376ed29] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:01.912705 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f558933-ec6b-4792-884d-40d18bec329b tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:01.913570 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f558933-ec6b-4792-884d-40d18bec329b tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:01.914192 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f558933-ec6b-4792-884d-40d18bec329b tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:01.916528 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f558933-ec6b-4792-884d-40d18bec329b tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:01.917436 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f558933-ec6b-4792-884d-40d18bec329b tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:01.918111 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f558933-ec6b-4792-884d-40d18bec329b tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:01.922403 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-595c1c4b-55aa-4451-bd62-72a1a9c384bb tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:01.923902 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-595c1c4b-55aa-4451-bd62-72a1a9c384bb tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:01.925705 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-595c1c4b-55aa-4451-bd62-72a1a9c384bb tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/422ceb5f-740f-45e5-9596-6796719adf27" status: 200 len: 1350 microversion: 2.25 time: 0.346697 Sep 08 10:46:01.930851 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1006/1989] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:46:01 2022] GET /compute/v2.1/servers/422ceb5f-740f-45e5-9596-6796719adf27 => generated 1350 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:46:01.948772 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6449d2ce-c12b-4c3e-8a80-64ae57ad8ad2 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:01.957482 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6449d2ce-c12b-4c3e-8a80-64ae57ad8ad2 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: f9f308fa-d4a6-4ac9-8c64-927e082b0b4a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:01.985956 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6449d2ce-c12b-4c3e-8a80-64ae57ad8ad2 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:01.986785 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6449d2ce-c12b-4c3e-8a80-64ae57ad8ad2 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:01.992017 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6449d2ce-c12b-4c3e-8a80-64ae57ad8ad2 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:01.993896 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6449d2ce-c12b-4c3e-8a80-64ae57ad8ad2 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:01.994959 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6449d2ce-c12b-4c3e-8a80-64ae57ad8ad2 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:01.995942 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6449d2ce-c12b-4c3e-8a80-64ae57ad8ad2 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:02.365757 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6449d2ce-c12b-4c3e-8a80-64ae57ad8ad2 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:02.379226 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6449d2ce-c12b-4c3e-8a80-64ae57ad8ad2 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a" status: 200 len: 1506 microversion: 2.1 time: 0.445428 Sep 08 10:46:02.383463 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1007/1990] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:01 2022] GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a => generated 1506 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:02.391684 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6c1f50ab-2ff2-4591-93e3-f13b58e14c42 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:02.392409 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6c1f50ab-2ff2-4591-93e3-f13b58e14c42 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 7d251638-b28f-4137-a81a-ce1a21cd7418] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:02.400620 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6c1f50ab-2ff2-4591-93e3-f13b58e14c42 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:02.401410 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6c1f50ab-2ff2-4591-93e3-f13b58e14c42 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:02.402091 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6c1f50ab-2ff2-4591-93e3-f13b58e14c42 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:02.403131 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6c1f50ab-2ff2-4591-93e3-f13b58e14c42 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:02.403804 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6c1f50ab-2ff2-4591-93e3-f13b58e14c42 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:02.404453 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6c1f50ab-2ff2-4591-93e3-f13b58e14c42 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:02.576464 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6c1f50ab-2ff2-4591-93e3-f13b58e14c42 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:02.585459 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6c1f50ab-2ff2-4591-93e3-f13b58e14c42 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/7d251638-b28f-4137-a81a-ce1a21cd7418" status: 200 len: 1278 microversion: 2.1 time: 0.200430 Sep 08 10:46:02.586176 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1008/1991] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:02 2022] GET /compute/v2.1/servers/7d251638-b28f-4137-a81a-ce1a21cd7418 => generated 1278 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:02.599734 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c9768149-aeed-46a5-ac32-0ae2dc248a7f tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:02.600661 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c9768149-aeed-46a5-ac32-0ae2dc248a7f tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] [instance: dac27157-b08e-4f13-b97e-3c5b653bd0b3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:02.607927 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c9768149-aeed-46a5-ac32-0ae2dc248a7f tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:02.608714 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c9768149-aeed-46a5-ac32-0ae2dc248a7f tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:02.609407 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c9768149-aeed-46a5-ac32-0ae2dc248a7f tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:02.610530 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c9768149-aeed-46a5-ac32-0ae2dc248a7f tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:02.611166 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c9768149-aeed-46a5-ac32-0ae2dc248a7f tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:02.611919 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c9768149-aeed-46a5-ac32-0ae2dc248a7f tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:02.774706 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c9768149-aeed-46a5-ac32-0ae2dc248a7f tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7415a5b46c4587a8806661b70e3913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604588959944720923ec2d5e0bf81c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:02.783001 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c9768149-aeed-46a5-ac32-0ae2dc248a7f tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/servers/dac27157-b08e-4f13-b97e-3c5b653bd0b3" status: 200 len: 1472 microversion: 2.1 time: 0.195566 Sep 08 10:46:02.783943 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1009/1992] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:02 2022] GET /compute/v2.1/servers/dac27157-b08e-4f13-b97e-3c5b653bd0b3 => generated 1472 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:02.790221 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e1a2cb5a-1b0f-4c73-b630-df9170e7203a tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:02.791081 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e1a2cb5a-1b0f-4c73-b630-df9170e7203a tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:02.798625 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e1a2cb5a-1b0f-4c73-b630-df9170e7203a tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:02.799374 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e1a2cb5a-1b0f-4c73-b630-df9170e7203a tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:02.800133 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e1a2cb5a-1b0f-4c73-b630-df9170e7203a tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:02.801303 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e1a2cb5a-1b0f-4c73-b630-df9170e7203a tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:02.801943 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e1a2cb5a-1b0f-4c73-b630-df9170e7203a tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:02.802584 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e1a2cb5a-1b0f-4c73-b630-df9170e7203a tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:02.875548 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8f558933-ec6b-4792-884d-40d18bec329b tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:02.888065 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8f558933-ec6b-4792-884d-40d18bec329b tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29" status: 200 len: 1387 microversion: 2.1 time: 0.991487 Sep 08 10:46:02.888977 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 984/1993] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:01 2022] GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29 => generated 1387 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:02.925524 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-af2eccc0-29b8-4727-a7ce-1e8f4fd589a4 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:02.926618 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-af2eccc0-29b8-4727-a7ce-1e8f4fd589a4 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] [instance: 72eb7387-3f16-4b4f-ab9a-89076f169fc1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:02.933913 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af2eccc0-29b8-4727-a7ce-1e8f4fd589a4 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:02.934703 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af2eccc0-29b8-4727-a7ce-1e8f4fd589a4 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:02.935316 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af2eccc0-29b8-4727-a7ce-1e8f4fd589a4 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:02.936243 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af2eccc0-29b8-4727-a7ce-1e8f4fd589a4 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:02.936910 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af2eccc0-29b8-4727-a7ce-1e8f4fd589a4 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:02.937539 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af2eccc0-29b8-4727-a7ce-1e8f4fd589a4 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:02.989301 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e1a2cb5a-1b0f-4c73-b630-df9170e7203a tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:02.998205 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e1a2cb5a-1b0f-4c73-b630-df9170e7203a tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447" status: 200 len: 1313 microversion: 2.1 time: 0.211818 Sep 08 10:46:03.000502 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1010/1994] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:02 2022] GET /compute/v2.1/servers/e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447 => generated 1313 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:03.009835 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5282ebe0-fe21-4fd4-8af0-4b4dc194078e tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:03.009835 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5282ebe0-fe21-4fd4-8af0-4b4dc194078e tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 422ceb5f-740f-45e5-9596-6796719adf27] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:03.017711 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5282ebe0-fe21-4fd4-8af0-4b4dc194078e tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:03.018208 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5282ebe0-fe21-4fd4-8af0-4b4dc194078e tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:03.019339 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5282ebe0-fe21-4fd4-8af0-4b4dc194078e tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:03.020172 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5282ebe0-fe21-4fd4-8af0-4b4dc194078e tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:03.020629 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5282ebe0-fe21-4fd4-8af0-4b4dc194078e tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:03.021071 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5282ebe0-fe21-4fd4-8af0-4b4dc194078e tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:03.056690 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5282ebe0-fe21-4fd4-8af0-4b4dc194078e tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:03.057298 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5282ebe0-fe21-4fd4-8af0-4b4dc194078e tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:03.057883 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5282ebe0-fe21-4fd4-8af0-4b4dc194078e tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:03.058338 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-5282ebe0-fe21-4fd4-8af0-4b4dc194078e tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lazy-loading 'fault' on Instance uuid 422ceb5f-740f-45e5-9596-6796719adf27 {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:46:03.110974 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5282ebe0-fe21-4fd4-8af0-4b4dc194078e tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:03.128183 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-af2eccc0-29b8-4727-a7ce-1e8f4fd589a4 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ff38511b484fbcb7817a56076cf4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a768a3863448bca0c6cda11afdd955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:03.129050 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5282ebe0-fe21-4fd4-8af0-4b4dc194078e tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:03.130536 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5282ebe0-fe21-4fd4-8af0-4b4dc194078e tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:03.131867 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5282ebe0-fe21-4fd4-8af0-4b4dc194078e tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/422ceb5f-740f-45e5-9596-6796719adf27" status: 200 len: 1350 microversion: 2.25 time: 0.130267 Sep 08 10:46:03.145256 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1011/1995] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:46:03 2022] GET /compute/v2.1/servers/422ceb5f-740f-45e5-9596-6796719adf27 => generated 1350 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:46:03.156237 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-af2eccc0-29b8-4727-a7ce-1e8f4fd589a4 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] 10.222.0.27 "GET /compute/v2.1/servers/72eb7387-3f16-4b4f-ab9a-89076f169fc1" status: 200 len: 1237 microversion: 2.1 time: 0.239461 Sep 08 10:46:03.160743 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 985/1996] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:02 2022] GET /compute/v2.1/servers/72eb7387-3f16-4b4f-ab9a-89076f169fc1 => generated 1237 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:46:03.407410 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d44b5c74-e519-4114-96c0-2e53bae7b7eb tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:03.408132 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d44b5c74-e519-4114-96c0-2e53bae7b7eb tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: f9f308fa-d4a6-4ac9-8c64-927e082b0b4a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:03.411611 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=1,nova_api:DELETE=1,nova_api:UPDATE=3 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:46:03.419944 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d44b5c74-e519-4114-96c0-2e53bae7b7eb tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:03.420777 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d44b5c74-e519-4114-96c0-2e53bae7b7eb tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:03.423111 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d44b5c74-e519-4114-96c0-2e53bae7b7eb tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:03.424213 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d44b5c74-e519-4114-96c0-2e53bae7b7eb tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:03.425315 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d44b5c74-e519-4114-96c0-2e53bae7b7eb tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:03.425931 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d44b5c74-e519-4114-96c0-2e53bae7b7eb tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:03.580676 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d44b5c74-e519-4114-96c0-2e53bae7b7eb tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:03.594223 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d44b5c74-e519-4114-96c0-2e53bae7b7eb tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a" status: 200 len: 1506 microversion: 2.1 time: 0.190763 Sep 08 10:46:03.594828 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1012/1997] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:03 2022] GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a => generated 1506 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:46:03.618618 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-cdafeb3a-11b7-482f-9704-c2ac4c08b2dc req-8b8f2c43-7bd6-4fb3-a630-d1b21d941ab0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9f308fa-d4a6-4ac9-8c64-927e082b0b4a", "name": "network-vif-unplugged", "status": "completed", "tag": "113493e8-8f02-4099-b529-0616d267ed77"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:46:03.626970 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-edc2cb42-db48-4ae3-8524-2c66a7973e57 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:03.631257 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-edc2cb42-db48-4ae3-8524-2c66a7973e57 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 7d251638-b28f-4137-a81a-ce1a21cd7418] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:03.637276 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-cdafeb3a-11b7-482f-9704-c2ac4c08b2dc req-8b8f2c43-7bd6-4fb3-a630-d1b21d941ab0 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:03.637781 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-cdafeb3a-11b7-482f-9704-c2ac4c08b2dc req-8b8f2c43-7bd6-4fb3-a630-d1b21d941ab0 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:03.638219 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-cdafeb3a-11b7-482f-9704-c2ac4c08b2dc req-8b8f2c43-7bd6-4fb3-a630-d1b21d941ab0 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:03.640430 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-edc2cb42-db48-4ae3-8524-2c66a7973e57 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:03.640973 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-edc2cb42-db48-4ae3-8524-2c66a7973e57 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:03.641421 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-edc2cb42-db48-4ae3-8524-2c66a7973e57 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:03.642304 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-edc2cb42-db48-4ae3-8524-2c66a7973e57 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:03.642659 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-edc2cb42-db48-4ae3-8524-2c66a7973e57 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:03.643188 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-edc2cb42-db48-4ae3-8524-2c66a7973e57 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:03.651343 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-cdafeb3a-11b7-482f-9704-c2ac4c08b2dc req-8b8f2c43-7bd6-4fb3-a630-d1b21d941ab0 service nova] Creating event network-vif-unplugged:113493e8-8f02-4099-b529-0616d267ed77 for instance f9f308fa-d4a6-4ac9-8c64-927e082b0b4a on n-h1-850501-12 Sep 08 10:46:03.656810 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-cdafeb3a-11b7-482f-9704-c2ac4c08b2dc req-8b8f2c43-7bd6-4fb3-a630-d1b21d941ab0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041345 Sep 08 10:46:03.657262 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 986/1998] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:46:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:46:03.730991 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-edc2cb42-db48-4ae3-8524-2c66a7973e57 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:03.748337 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-edc2cb42-db48-4ae3-8524-2c66a7973e57 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/7d251638-b28f-4137-a81a-ce1a21cd7418" status: 200 len: 1266 microversion: 2.1 time: 0.127172 Sep 08 10:46:03.749542 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1013/1999] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:03 2022] GET /compute/v2.1/servers/7d251638-b28f-4137-a81a-ce1a21cd7418 => generated 1266 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:03.811496 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4ded4975-55b9-4994-afde-e279cfdf0117 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:03.812207 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4ded4975-55b9-4994-afde-e279cfdf0117 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] [instance: dac27157-b08e-4f13-b97e-3c5b653bd0b3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:03.821107 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ded4975-55b9-4994-afde-e279cfdf0117 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:03.821878 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ded4975-55b9-4994-afde-e279cfdf0117 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:03.822615 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ded4975-55b9-4994-afde-e279cfdf0117 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:03.823528 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ded4975-55b9-4994-afde-e279cfdf0117 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:03.824318 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ded4975-55b9-4994-afde-e279cfdf0117 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:03.824916 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ded4975-55b9-4994-afde-e279cfdf0117 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:03.915675 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5b5b20b1-f773-4b2e-8e7a-ed3f22c5ffb8 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:03.916425 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5b5b20b1-f773-4b2e-8e7a-ed3f22c5ffb8 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 90974422-0d77-4970-9e94-ed6b3376ed29] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:03.935152 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5b5b20b1-f773-4b2e-8e7a-ed3f22c5ffb8 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:03.936218 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5b5b20b1-f773-4b2e-8e7a-ed3f22c5ffb8 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:03.937307 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5b5b20b1-f773-4b2e-8e7a-ed3f22c5ffb8 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:03.938216 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5b5b20b1-f773-4b2e-8e7a-ed3f22c5ffb8 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:03.939579 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5b5b20b1-f773-4b2e-8e7a-ed3f22c5ffb8 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:03.940794 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5b5b20b1-f773-4b2e-8e7a-ed3f22c5ffb8 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:04.186211 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5b5b20b1-f773-4b2e-8e7a-ed3f22c5ffb8 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:04.214282 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5b5b20b1-f773-4b2e-8e7a-ed3f22c5ffb8 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29" status: 200 len: 1387 microversion: 2.1 time: 0.305198 Sep 08 10:46:04.214282 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1014/2000] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:03 2022] GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29 => generated 1387 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:46:04.218639 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b04a2b3b-4501-4151-bb47-e402a3d7cf09 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:04.219228 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b04a2b3b-4501-4151-bb47-e402a3d7cf09 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:04.236419 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b04a2b3b-4501-4151-bb47-e402a3d7cf09 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:04.242231 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b04a2b3b-4501-4151-bb47-e402a3d7cf09 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:04.242758 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b04a2b3b-4501-4151-bb47-e402a3d7cf09 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:04.243525 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b04a2b3b-4501-4151-bb47-e402a3d7cf09 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:04.244004 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b04a2b3b-4501-4151-bb47-e402a3d7cf09 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:04.244434 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b04a2b3b-4501-4151-bb47-e402a3d7cf09 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:04.282353 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4ded4975-55b9-4994-afde-e279cfdf0117 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7415a5b46c4587a8806661b70e3913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604588959944720923ec2d5e0bf81c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:04.294166 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4ded4975-55b9-4994-afde-e279cfdf0117 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/servers/dac27157-b08e-4f13-b97e-3c5b653bd0b3" status: 200 len: 1472 microversion: 2.1 time: 0.487109 Sep 08 10:46:04.298955 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 987/2001] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:03 2022] GET /compute/v2.1/servers/dac27157-b08e-4f13-b97e-3c5b653bd0b3 => generated 1472 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:04.320592 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-930b155c-5f59-4616-a4d0-6e7240e04f9b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:04.321950 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-930b155c-5f59-4616-a4d0-6e7240e04f9b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 422ceb5f-740f-45e5-9596-6796719adf27] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:04.330716 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-930b155c-5f59-4616-a4d0-6e7240e04f9b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:04.331601 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-930b155c-5f59-4616-a4d0-6e7240e04f9b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:04.332279 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-930b155c-5f59-4616-a4d0-6e7240e04f9b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:04.333288 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-930b155c-5f59-4616-a4d0-6e7240e04f9b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:04.334593 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-930b155c-5f59-4616-a4d0-6e7240e04f9b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:04.335303 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-930b155c-5f59-4616-a4d0-6e7240e04f9b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:04.355040 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-930b155c-5f59-4616-a4d0-6e7240e04f9b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] HTTP exception thrown: Instance 422ceb5f-740f-45e5-9596-6796719adf27 could not be found. Sep 08 10:46:04.361552 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-930b155c-5f59-4616-a4d0-6e7240e04f9b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Request method failure captured: Sep 08 10:46:04.361552 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/422ceb5f-740f-45e5-9596-6796719adf27 HTTP/1.1 Sep 08 10:46:04.361552 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:46:04.361552 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:46:04.361552 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:46:04.361552 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:46:04.361552 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:46:04.361552 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:46:04.361552 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:46:04.361552 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:46:04.361552 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcXZt42mIM6otq6VWkhIIA96oZXavtoZmbqhqPMc80NVSsiJRHHpYnYGGzEhUVoRyhAcs8Hwl3L1suVGPpViQRvBrgcN-bOUeRDMIOnFanMQUyO3LgHh8xb8i8vD5c0S9_Vu-2OsRoz_mmLSl8OWaahD1PakjyKG5z1Mn4YpkZj5tYE Sep 08 10:46:04.361552 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:46:04.361552 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:46:04.361552 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:46:04.361552 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:46:04.361552 n-d-850501-12 devstack@n-api.service[128862]: X-Openstack-Nova-Api-Version: 2.25 Sep 08 10:46:04.361552 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:46:04.361552 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:46:04.361552 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 57d64134da60477da24b7fde4e1b9680 Sep 08 10:46:04.361552 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1806613506 Sep 08 10:46:04.361552 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:46:04.361552 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:46:04.361552 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/57d64134da60477da24b7fde4e1b9680"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/57d64134da60477da24b7fde4e1b9680"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_57d64134da60477da24b7fde4e1b9680"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/57d64134da60477da24b7fde4e1b9680"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:46:04.361552 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1806613506 Sep 08 10:46:04.361552 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 57d64134da60477da24b7fde4e1b9680 Sep 08 10:46:04.361552 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1806613506 Sep 08 10:46:04.361552 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-LiveAutoBlockMigrationV225Test-1806613506-project Sep 08 10:46:04.361552 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:46:04.361552 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:46:04.361552 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 27456dd9f49540b09f2e8addd1045a94 Sep 08 10:46:04.361552 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1806613506-project Sep 08 10:46:04.361552 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:46:04.361552 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 422ceb5f-740f-45e5-9596-6796719adf27 could not be found. Sep 08 10:46:04.361552 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '422ceb5f-740f-45e5-9596-6796719adf27'} Sep 08 10:46:04.361552 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:46:04.361552 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:46:04.361552 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:46:04.361552 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:46:04.361552 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:46:04.361552 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:46:04.361552 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:46:04.361552 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:46:04.361552 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:46:04.361552 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:46:04.361552 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 422ceb5f-740f-45e5-9596-6796719adf27 could not be found. Sep 08 10:46:04.361552 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:46:04.361552 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:46:04.361552 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:46:04.361552 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:46:04.361552 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:46:04.361552 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:46:04.361552 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:46:04.361552 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:46:04.361552 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:46:04.361552 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:46:04.361552 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:46:04.361552 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:46:04.361552 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:46:04.361552 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:46:04.361552 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:46:04.361552 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:46:04.361552 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 422ceb5f-740f-45e5-9596-6796719adf27 could not be found. Sep 08 10:46:04.361552 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:46:04.368278 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:46:04.368278 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:46:04.368278 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:46:04.368278 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:46:04.368278 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:46:04.368278 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:46:04.368278 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:46:04.368278 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 422ceb5f-740f-45e5-9596-6796719adf27 could not be found. Sep 08 10:46:04.368278 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:46:04.370006 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-930b155c-5f59-4616-a4d0-6e7240e04f9b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Returning 404 to user: Instance 422ceb5f-740f-45e5-9596-6796719adf27 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:46:04.374404 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-930b155c-5f59-4616-a4d0-6e7240e04f9b tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/422ceb5f-740f-45e5-9596-6796719adf27" status: 404 len: 111 microversion: 2.25 time: 0.059857 Sep 08 10:46:04.375546 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 988/2002] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:46:04 2022] GET /compute/v2.1/servers/422ceb5f-740f-45e5-9596-6796719adf27 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:46:04.385394 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b1a3c2ce-38e6-4bee-8db2-61c87daa0123 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:04.387293 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b1a3c2ce-38e6-4bee-8db2-61c87daa0123 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] [instance: 72eb7387-3f16-4b4f-ab9a-89076f169fc1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:04.403824 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1a3c2ce-38e6-4bee-8db2-61c87daa0123 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:04.404689 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1a3c2ce-38e6-4bee-8db2-61c87daa0123 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:04.405356 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1a3c2ce-38e6-4bee-8db2-61c87daa0123 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:04.406323 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1a3c2ce-38e6-4bee-8db2-61c87daa0123 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:04.406956 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1a3c2ce-38e6-4bee-8db2-61c87daa0123 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:04.412151 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1a3c2ce-38e6-4bee-8db2-61c87daa0123 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:04.713613 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b1a3c2ce-38e6-4bee-8db2-61c87daa0123 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ff38511b484fbcb7817a56076cf4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a768a3863448bca0c6cda11afdd955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:04.726325 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b1a3c2ce-38e6-4bee-8db2-61c87daa0123 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] 10.222.0.27 "GET /compute/v2.1/servers/72eb7387-3f16-4b4f-ab9a-89076f169fc1" status: 200 len: 1237 microversion: 2.1 time: 0.349481 Sep 08 10:46:04.741444 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 989/2003] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:04 2022] GET /compute/v2.1/servers/72eb7387-3f16-4b4f-ab9a-89076f169fc1 => generated 1237 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:04.747888 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1ebcd69a-9e9b-424c-a762-f927a965536e tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:04.748611 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1ebcd69a-9e9b-424c-a762-f927a965536e tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 292d240e-1176-4875-8f87-9ca911437fbe] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:04.757916 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ebcd69a-9e9b-424c-a762-f927a965536e tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:04.758819 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ebcd69a-9e9b-424c-a762-f927a965536e tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:04.759528 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ebcd69a-9e9b-424c-a762-f927a965536e tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:04.760771 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ebcd69a-9e9b-424c-a762-f927a965536e tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:04.761497 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ebcd69a-9e9b-424c-a762-f927a965536e tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:04.762156 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ebcd69a-9e9b-424c-a762-f927a965536e tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:04.799117 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b04a2b3b-4501-4151-bb47-e402a3d7cf09 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:04.804368 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1ebcd69a-9e9b-424c-a762-f927a965536e tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 292d240e-1176-4875-8f87-9ca911437fbe] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:46:04.811283 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b04a2b3b-4501-4151-bb47-e402a3d7cf09 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447" status: 200 len: 1313 microversion: 2.1 time: 0.596200 Sep 08 10:46:04.812954 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1015/2004] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:04 2022] GET /compute/v2.1/servers/e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447 => generated 1313 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:04.817907 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-dd2b0f58-57be-4499-8cc2-d63626c91011 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:04.818521 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-dd2b0f58-57be-4499-8cc2-d63626c91011 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: f9f308fa-d4a6-4ac9-8c64-927e082b0b4a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:04.847868 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd2b0f58-57be-4499-8cc2-d63626c91011 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:04.849717 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd2b0f58-57be-4499-8cc2-d63626c91011 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:04.850410 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd2b0f58-57be-4499-8cc2-d63626c91011 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:04.854634 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd2b0f58-57be-4499-8cc2-d63626c91011 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:04.855414 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd2b0f58-57be-4499-8cc2-d63626c91011 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:04.856136 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd2b0f58-57be-4499-8cc2-d63626c91011 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:05.066289 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1ebcd69a-9e9b-424c-a762-f927a965536e tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "DELETE /compute/v2.1/servers/292d240e-1176-4875-8f87-9ca911437fbe" status: 204 len: 0 microversion: 2.25 time: 0.322101 Sep 08 10:46:05.073915 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 990/2005] 10.222.0.27 () {60 vars in 1280 bytes} [Thu Sep 8 10:46:04 2022] DELETE /compute/v2.1/servers/292d240e-1176-4875-8f87-9ca911437fbe => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 10:46:05.080654 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-1fc72bd0-4251-4544-b81a-b2bed0cae42c req-d8c212f4-5cb8-4c3c-bd6e-e2261d001ac8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64c88fa0-6a01-42fc-b0e9-98b9e84a199d", "name": "network-vif-deleted", "tag": "2a441d6d-9009-42c2-a8aa-1b70f9d6ee7f"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:46:05.099560 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-1fc72bd0-4251-4544-b81a-b2bed0cae42c req-d8c212f4-5cb8-4c3c-bd6e-e2261d001ac8 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:05.100331 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-1fc72bd0-4251-4544-b81a-b2bed0cae42c req-d8c212f4-5cb8-4c3c-bd6e-e2261d001ac8 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:05.100977 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-1fc72bd0-4251-4544-b81a-b2bed0cae42c req-d8c212f4-5cb8-4c3c-bd6e-e2261d001ac8 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:05.117670 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-1fc72bd0-4251-4544-b81a-b2bed0cae42c req-d8c212f4-5cb8-4c3c-bd6e-e2261d001ac8 service nova] Creating event network-vif-deleted:2a441d6d-9009-42c2-a8aa-1b70f9d6ee7f for instance 64c88fa0-6a01-42fc-b0e9-98b9e84a199d on n-h1-850501-12 Sep 08 10:46:05.125436 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-1fc72bd0-4251-4544-b81a-b2bed0cae42c req-d8c212f4-5cb8-4c3c-bd6e-e2261d001ac8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050949 Sep 08 10:46:05.128335 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 991/2006] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:46:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:46:05.138766 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d12a1b6e-1d2a-431f-bc58-5e09b1d750b6 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:05.140530 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d12a1b6e-1d2a-431f-bc58-5e09b1d750b6 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 7d251638-b28f-4137-a81a-ce1a21cd7418] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:05.148985 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d12a1b6e-1d2a-431f-bc58-5e09b1d750b6 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:05.150050 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d12a1b6e-1d2a-431f-bc58-5e09b1d750b6 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:05.150789 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d12a1b6e-1d2a-431f-bc58-5e09b1d750b6 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:05.151827 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d12a1b6e-1d2a-431f-bc58-5e09b1d750b6 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:05.152514 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d12a1b6e-1d2a-431f-bc58-5e09b1d750b6 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:05.153205 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d12a1b6e-1d2a-431f-bc58-5e09b1d750b6 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:05.183618 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:46:05.754718 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d12a1b6e-1d2a-431f-bc58-5e09b1d750b6 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:05.779323 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d12a1b6e-1d2a-431f-bc58-5e09b1d750b6 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/7d251638-b28f-4137-a81a-ce1a21cd7418" status: 200 len: 1308 microversion: 2.1 time: 0.647855 Sep 08 10:46:05.797485 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 992/2007] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:05 2022] GET /compute/v2.1/servers/7d251638-b28f-4137-a81a-ce1a21cd7418 => generated 1308 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:05.814899 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9fd45d4c-1932-4ff1-9788-27082126de09 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:05.818030 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-dd2b0f58-57be-4499-8cc2-d63626c91011 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:05.828937 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9fd45d4c-1932-4ff1-9788-27082126de09 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 292d240e-1176-4875-8f87-9ca911437fbe] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:05.833557 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-dd2b0f58-57be-4499-8cc2-d63626c91011 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a" status: 200 len: 1509 microversion: 2.1 time: 1.014142 Sep 08 10:46:05.834654 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1016/2008] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:04 2022] GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a => generated 1509 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:05.859013 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9fd45d4c-1932-4ff1-9788-27082126de09 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:05.859358 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9fd45d4c-1932-4ff1-9788-27082126de09 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:05.859788 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9fd45d4c-1932-4ff1-9788-27082126de09 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:05.860506 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9fd45d4c-1932-4ff1-9788-27082126de09 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:05.862222 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-999bd49d-109e-44bb-99d9-807abe790f81 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:05.863982 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-999bd49d-109e-44bb-99d9-807abe790f81 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 90974422-0d77-4970-9e94-ed6b3376ed29] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:05.864746 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9fd45d4c-1932-4ff1-9788-27082126de09 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:05.866266 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9fd45d4c-1932-4ff1-9788-27082126de09 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:05.892728 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-999bd49d-109e-44bb-99d9-807abe790f81 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:05.896471 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-999bd49d-109e-44bb-99d9-807abe790f81 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:05.897546 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-999bd49d-109e-44bb-99d9-807abe790f81 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:05.900924 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-999bd49d-109e-44bb-99d9-807abe790f81 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:05.902463 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-999bd49d-109e-44bb-99d9-807abe790f81 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:05.903324 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-999bd49d-109e-44bb-99d9-807abe790f81 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:06.072603 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-999bd49d-109e-44bb-99d9-807abe790f81 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:06.136974 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-999bd49d-109e-44bb-99d9-807abe790f81 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29" status: 200 len: 1345 microversion: 2.1 time: 0.294477 Sep 08 10:46:06.137640 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1017/2009] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:05 2022] GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29 => generated 1345 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:06.152751 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5fe8f0f8-5a10-49b1-bf7a-ebcc3092cf16 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:06.153528 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5fe8f0f8-5a10-49b1-bf7a-ebcc3092cf16 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] [instance: dac27157-b08e-4f13-b97e-3c5b653bd0b3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:06.170713 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5fe8f0f8-5a10-49b1-bf7a-ebcc3092cf16 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:06.171528 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5fe8f0f8-5a10-49b1-bf7a-ebcc3092cf16 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:06.172161 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5fe8f0f8-5a10-49b1-bf7a-ebcc3092cf16 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:06.173151 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5fe8f0f8-5a10-49b1-bf7a-ebcc3092cf16 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:06.174149 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5fe8f0f8-5a10-49b1-bf7a-ebcc3092cf16 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:06.177136 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5fe8f0f8-5a10-49b1-bf7a-ebcc3092cf16 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:06.256326 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=100 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:46:06.310865 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5fe8f0f8-5a10-49b1-bf7a-ebcc3092cf16 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:06.318084 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5fe8f0f8-5a10-49b1-bf7a-ebcc3092cf16 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:06.321549 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5fe8f0f8-5a10-49b1-bf7a-ebcc3092cf16 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:06.322374 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-5fe8f0f8-5a10-49b1-bf7a-ebcc3092cf16 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lazy-loading 'fault' on Instance uuid dac27157-b08e-4f13-b97e-3c5b653bd0b3 {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:46:06.408654 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9fd45d4c-1932-4ff1-9788-27082126de09 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:06.420308 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9fd45d4c-1932-4ff1-9788-27082126de09 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:06.423048 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9fd45d4c-1932-4ff1-9788-27082126de09 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:06.427604 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9fd45d4c-1932-4ff1-9788-27082126de09 tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/292d240e-1176-4875-8f87-9ca911437fbe" status: 200 len: 1565 microversion: 2.25 time: 0.628210 Sep 08 10:46:06.439715 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 993/2010] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:46:05 2022] GET /compute/v2.1/servers/292d240e-1176-4875-8f87-9ca911437fbe => generated 1565 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:46:06.454191 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-80538dc0-7f1a-4572-ae60-64dbf743e9a8 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:06.457187 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-80538dc0-7f1a-4572-ae60-64dbf743e9a8 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] [instance: 72eb7387-3f16-4b4f-ab9a-89076f169fc1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:06.466573 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80538dc0-7f1a-4572-ae60-64dbf743e9a8 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:06.467360 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80538dc0-7f1a-4572-ae60-64dbf743e9a8 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:06.467979 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80538dc0-7f1a-4572-ae60-64dbf743e9a8 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:06.469125 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80538dc0-7f1a-4572-ae60-64dbf743e9a8 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:06.470038 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80538dc0-7f1a-4572-ae60-64dbf743e9a8 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:06.470540 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80538dc0-7f1a-4572-ae60-64dbf743e9a8 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:06.658723 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-80538dc0-7f1a-4572-ae60-64dbf743e9a8 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ff38511b484fbcb7817a56076cf4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a768a3863448bca0c6cda11afdd955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:06.669085 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-80538dc0-7f1a-4572-ae60-64dbf743e9a8 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] 10.222.0.27 "GET /compute/v2.1/servers/72eb7387-3f16-4b4f-ab9a-89076f169fc1" status: 200 len: 1299 microversion: 2.1 time: 0.225494 Sep 08 10:46:06.670683 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 994/2011] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:06 2022] GET /compute/v2.1/servers/72eb7387-3f16-4b4f-ab9a-89076f169fc1 => generated 1299 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:06.676382 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3969f53e-9807-4657-b173-7eba11f18936 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:06.680321 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3969f53e-9807-4657-b173-7eba11f18936 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:06.687563 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:46:06.702354 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5fe8f0f8-5a10-49b1-bf7a-ebcc3092cf16 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7415a5b46c4587a8806661b70e3913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604588959944720923ec2d5e0bf81c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:06.706069 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3969f53e-9807-4657-b173-7eba11f18936 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:06.716314 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3969f53e-9807-4657-b173-7eba11f18936 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:06.716618 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5fe8f0f8-5a10-49b1-bf7a-ebcc3092cf16 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/servers/dac27157-b08e-4f13-b97e-3c5b653bd0b3" status: 200 len: 1307 microversion: 2.1 time: 0.573115 Sep 08 10:46:06.721086 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3969f53e-9807-4657-b173-7eba11f18936 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:06.721086 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3969f53e-9807-4657-b173-7eba11f18936 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:06.721086 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3969f53e-9807-4657-b173-7eba11f18936 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:06.721086 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3969f53e-9807-4657-b173-7eba11f18936 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:06.722537 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1018/2012] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:06 2022] GET /compute/v2.1/servers/dac27157-b08e-4f13-b97e-3c5b653bd0b3 => generated 1307 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:06.734427 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-522d8246-aaa2-4ae5-a714-46161c267885 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:06.736273 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-522d8246-aaa2-4ae5-a714-46161c267885 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: f9f308fa-d4a6-4ac9-8c64-927e082b0b4a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:06.748204 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-522d8246-aaa2-4ae5-a714-46161c267885 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:06.748978 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-522d8246-aaa2-4ae5-a714-46161c267885 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:06.750296 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-522d8246-aaa2-4ae5-a714-46161c267885 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:06.751348 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-522d8246-aaa2-4ae5-a714-46161c267885 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:06.751995 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-522d8246-aaa2-4ae5-a714-46161c267885 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:06.753870 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-522d8246-aaa2-4ae5-a714-46161c267885 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:06.811086 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-522d8246-aaa2-4ae5-a714-46161c267885 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: f9f308fa-d4a6-4ac9-8c64-927e082b0b4a] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:46:06.831658 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.compute.api [None req-522d8246-aaa2-4ae5-a714-46161c267885 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: f9f308fa-d4a6-4ac9-8c64-927e082b0b4a] Working on deleting snapshot ea25addd-c00d-4b7b-9049-988c90c5268c from shelved instance... Sep 08 10:46:07.588697 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3969f53e-9807-4657-b173-7eba11f18936 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:07.602017 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3969f53e-9807-4657-b173-7eba11f18936 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447" status: 200 len: 1463 microversion: 2.1 time: 0.929995 Sep 08 10:46:07.606467 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 995/2013] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:06 2022] GET /compute/v2.1/servers/e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447 => generated 1463 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:07.617772 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7e4949a6-ad8a-4d40-8272-9bb1c7874eb3 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:07.618674 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7e4949a6-ad8a-4d40-8272-9bb1c7874eb3 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 7d251638-b28f-4137-a81a-ce1a21cd7418] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:07.633294 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e4949a6-ad8a-4d40-8272-9bb1c7874eb3 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:07.633814 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e4949a6-ad8a-4d40-8272-9bb1c7874eb3 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:07.638045 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e4949a6-ad8a-4d40-8272-9bb1c7874eb3 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:07.638799 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e4949a6-ad8a-4d40-8272-9bb1c7874eb3 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:07.640542 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e4949a6-ad8a-4d40-8272-9bb1c7874eb3 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:07.641528 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e4949a6-ad8a-4d40-8272-9bb1c7874eb3 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:08.039306 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7e4949a6-ad8a-4d40-8272-9bb1c7874eb3 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:08.057855 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7e4949a6-ad8a-4d40-8272-9bb1c7874eb3 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/7d251638-b28f-4137-a81a-ce1a21cd7418" status: 200 len: 1308 microversion: 2.1 time: 0.448942 Sep 08 10:46:08.076238 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 996/2014] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:07 2022] GET /compute/v2.1/servers/7d251638-b28f-4137-a81a-ce1a21cd7418 => generated 1308 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:08.094071 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-72817071-ba70-4fd3-872b-3ec7b27b49ce tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:08.097615 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-72817071-ba70-4fd3-872b-3ec7b27b49ce tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 90974422-0d77-4970-9e94-ed6b3376ed29] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:08.114204 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-72817071-ba70-4fd3-872b-3ec7b27b49ce tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:08.114712 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-72817071-ba70-4fd3-872b-3ec7b27b49ce tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:08.117672 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-72817071-ba70-4fd3-872b-3ec7b27b49ce tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:08.120059 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-72817071-ba70-4fd3-872b-3ec7b27b49ce tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:08.121665 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-72817071-ba70-4fd3-872b-3ec7b27b49ce tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:08.122913 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-72817071-ba70-4fd3-872b-3ec7b27b49ce tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:08.419136 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-72817071-ba70-4fd3-872b-3ec7b27b49ce tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:08.435760 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-72817071-ba70-4fd3-872b-3ec7b27b49ce tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29" status: 200 len: 1184 microversion: 2.1 time: 0.351864 Sep 08 10:46:08.438531 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 997/2015] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:08 2022] GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29 => generated 1184 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:08.457069 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-b8acd721-66ff-42ba-80da-f3db3dfbdc18 req-66cf4453-0170-4c23-96df-76696d5d4f4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dac27157-b08e-4f13-b97e-3c5b653bd0b3", "name": "network-vif-deleted", "tag": "0ad27959-ff24-48b6-9469-c1b114584c1e"}, {"server_uuid": "90974422-0d77-4970-9e94-ed6b3376ed29", "name": "network-vif-deleted", "tag": "4f14c555-3049-4edc-a15e-3ce8f070bbe0"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:46:08.507791 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b8acd721-66ff-42ba-80da-f3db3dfbdc18 req-66cf4453-0170-4c23-96df-76696d5d4f4d service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:08.508379 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b8acd721-66ff-42ba-80da-f3db3dfbdc18 req-66cf4453-0170-4c23-96df-76696d5d4f4d service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:08.508909 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b8acd721-66ff-42ba-80da-f3db3dfbdc18 req-66cf4453-0170-4c23-96df-76696d5d4f4d service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:08.545268 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-b8acd721-66ff-42ba-80da-f3db3dfbdc18 req-66cf4453-0170-4c23-96df-76696d5d4f4d service nova] Creating event network-vif-deleted:0ad27959-ff24-48b6-9469-c1b114584c1e for instance dac27157-b08e-4f13-b97e-3c5b653bd0b3 on n-h1-850501-12 Sep 08 10:46:08.560869 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-b8acd721-66ff-42ba-80da-f3db3dfbdc18 req-66cf4453-0170-4c23-96df-76696d5d4f4d service nova] Creating event network-vif-deleted:4f14c555-3049-4edc-a15e-3ce8f070bbe0 for instance 90974422-0d77-4970-9e94-ed6b3376ed29 on n-h1-850501-12 Sep 08 10:46:08.579707 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-b8acd721-66ff-42ba-80da-f3db3dfbdc18 req-66cf4453-0170-4c23-96df-76696d5d4f4d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.130823 Sep 08 10:46:08.581922 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 998/2016] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:46:08 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:46:08.610291 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f76d434b-b2c5-4cfd-afee-6bc5475332cd tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:08.611016 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f76d434b-b2c5-4cfd-afee-6bc5475332cd tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 292d240e-1176-4875-8f87-9ca911437fbe] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:08.623295 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-522d8246-aaa2-4ae5-a714-46161c267885 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: f9f308fa-d4a6-4ac9-8c64-927e082b0b4a] Doing local delete in cell 2785b110-f847-4739-9d30-5b571c6d79f4(cell1) {{(pid=128861) _delete /opt/stack/nova/nova/compute/api.py:2546}} Sep 08 10:46:08.624695 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-522d8246-aaa2-4ae5-a714-46161c267885 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:08.625246 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-522d8246-aaa2-4ae5-a714-46161c267885 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:08.633181 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-522d8246-aaa2-4ae5-a714-46161c267885 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:08.636339 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.compute.api [None req-522d8246-aaa2-4ae5-a714-46161c267885 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: f9f308fa-d4a6-4ac9-8c64-927e082b0b4a] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Sep 08 10:46:08.637718 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f76d434b-b2c5-4cfd-afee-6bc5475332cd tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:08.638300 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f76d434b-b2c5-4cfd-afee-6bc5475332cd tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:08.638748 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f76d434b-b2c5-4cfd-afee-6bc5475332cd tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:08.639487 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f76d434b-b2c5-4cfd-afee-6bc5475332cd tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:08.639954 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f76d434b-b2c5-4cfd-afee-6bc5475332cd tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:08.648558 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f76d434b-b2c5-4cfd-afee-6bc5475332cd tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:08.664801 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-522d8246-aaa2-4ae5-a714-46161c267885 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: f9f308fa-d4a6-4ac9-8c64-927e082b0b4a] deallocate_for_instance() {{(pid=128861) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Sep 08 10:46:08.760074 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f76d434b-b2c5-4cfd-afee-6bc5475332cd tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:08.761154 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f76d434b-b2c5-4cfd-afee-6bc5475332cd tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:08.761513 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f76d434b-b2c5-4cfd-afee-6bc5475332cd tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:08.762209 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-f76d434b-b2c5-4cfd-afee-6bc5475332cd tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lazy-loading 'fault' on Instance uuid 292d240e-1176-4875-8f87-9ca911437fbe {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:46:08.851976 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f76d434b-b2c5-4cfd-afee-6bc5475332cd tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:08.870119 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f76d434b-b2c5-4cfd-afee-6bc5475332cd tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:08.871926 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f76d434b-b2c5-4cfd-afee-6bc5475332cd tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27456dd9f49540b09f2e8addd1045a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d64134da60477da24b7fde4e1b9680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:08.873481 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f76d434b-b2c5-4cfd-afee-6bc5475332cd tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/292d240e-1176-4875-8f87-9ca911437fbe" status: 200 len: 1352 microversion: 2.25 time: 0.289356 Sep 08 10:46:08.874292 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 999/2017] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:46:08 2022] GET /compute/v2.1/servers/292d240e-1176-4875-8f87-9ca911437fbe => generated 1352 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:46:08.879771 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-78331293-5c9e-4109-a600-025cfc2c5dde tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:08.880695 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-78331293-5c9e-4109-a600-025cfc2c5dde tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: 3766b195-ace4-4563-a24e-dca72941251e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:08.893464 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-78331293-5c9e-4109-a600-025cfc2c5dde tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:08.894307 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-78331293-5c9e-4109-a600-025cfc2c5dde tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:08.905312 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-78331293-5c9e-4109-a600-025cfc2c5dde tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:08.906931 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-78331293-5c9e-4109-a600-025cfc2c5dde tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:08.907736 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-78331293-5c9e-4109-a600-025cfc2c5dde tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:08.912514 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-78331293-5c9e-4109-a600-025cfc2c5dde tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:09.318222 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-78331293-5c9e-4109-a600-025cfc2c5dde tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:09.331139 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-78331293-5c9e-4109-a600-025cfc2c5dde tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e" status: 200 len: 1463 microversion: 2.1 time: 0.454630 Sep 08 10:46:09.335593 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1000/2018] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:08 2022] GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e => generated 1463 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:09.352348 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f05b5e6e-2ed9-4b41-8c19-8481db452773 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:09.353719 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f05b5e6e-2ed9-4b41-8c19-8481db452773 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] [instance: 72eb7387-3f16-4b4f-ab9a-89076f169fc1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:09.383285 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f05b5e6e-2ed9-4b41-8c19-8481db452773 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:09.385620 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f05b5e6e-2ed9-4b41-8c19-8481db452773 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:09.386898 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f05b5e6e-2ed9-4b41-8c19-8481db452773 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:09.388090 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f05b5e6e-2ed9-4b41-8c19-8481db452773 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:09.388810 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f05b5e6e-2ed9-4b41-8c19-8481db452773 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:09.389505 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f05b5e6e-2ed9-4b41-8c19-8481db452773 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:09.565988 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f05b5e6e-2ed9-4b41-8c19-8481db452773 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ff38511b484fbcb7817a56076cf4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a768a3863448bca0c6cda11afdd955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:09.574557 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f05b5e6e-2ed9-4b41-8c19-8481db452773 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] 10.222.0.27 "GET /compute/v2.1/servers/72eb7387-3f16-4b4f-ab9a-89076f169fc1" status: 200 len: 1299 microversion: 2.1 time: 0.237542 Sep 08 10:46:09.575145 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1001/2019] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:09 2022] GET /compute/v2.1/servers/72eb7387-3f16-4b4f-ab9a-89076f169fc1 => generated 1299 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:09.598139 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-08a4b8d8-4a00-40ab-9f7a-f1c05d30b390 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:09.598774 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-08a4b8d8-4a00-40ab-9f7a-f1c05d30b390 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] [instance: dac27157-b08e-4f13-b97e-3c5b653bd0b3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:09.605181 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08a4b8d8-4a00-40ab-9f7a-f1c05d30b390 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:09.605905 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08a4b8d8-4a00-40ab-9f7a-f1c05d30b390 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:09.606345 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08a4b8d8-4a00-40ab-9f7a-f1c05d30b390 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:09.607056 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08a4b8d8-4a00-40ab-9f7a-f1c05d30b390 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:09.607512 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08a4b8d8-4a00-40ab-9f7a-f1c05d30b390 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:09.607934 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08a4b8d8-4a00-40ab-9f7a-f1c05d30b390 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:09.623002 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-08a4b8d8-4a00-40ab-9f7a-f1c05d30b390 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] HTTP exception thrown: Instance dac27157-b08e-4f13-b97e-3c5b653bd0b3 could not be found. Sep 08 10:46:09.625504 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-08a4b8d8-4a00-40ab-9f7a-f1c05d30b390 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Request method failure captured: Sep 08 10:46:09.625504 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/dac27157-b08e-4f13-b97e-3c5b653bd0b3 HTTP/1.1 Sep 08 10:46:09.625504 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:46:09.625504 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:46:09.625504 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:46:09.625504 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:46:09.625504 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:46:09.625504 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:46:09.625504 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:46:09.625504 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:46:09.625504 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGccq4RXL2fIGL5lcjFo97J6tfkuLUiY3Nh7bNifCZKFDYoDqR0YP7RMMXwq3JhnrUOhcHtz4k4QmybJ-ut1PCO2KMs6muxbt_nXpRa9XEf8CF3kLCce3-hzBCJJczrVPj8XT77m-UIaYnjkOY6ASciv301mJyrAXnbwGp3nQik8CYO4 Sep 08 10:46:09.625504 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:46:09.625504 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:46:09.625504 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:46:09.625504 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:46:09.625504 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:46:09.625504 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:46:09.625504 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 2604588959944720923ec2d5e0bf81c0 Sep 08 10:46:09.625504 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ListImageFiltersTestJSON-221384243 Sep 08 10:46:09.625504 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:46:09.625504 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:46:09.625504 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2604588959944720923ec2d5e0bf81c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2604588959944720923ec2d5e0bf81c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2604588959944720923ec2d5e0bf81c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2604588959944720923ec2d5e0bf81c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:46:09.625504 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ListImageFiltersTestJSON-221384243 Sep 08 10:46:09.625504 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 2604588959944720923ec2d5e0bf81c0 Sep 08 10:46:09.625504 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-221384243 Sep 08 10:46:09.625504 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ListImageFiltersTestJSON-221384243-project Sep 08 10:46:09.625504 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:46:09.625504 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:46:09.625504 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: ff7415a5b46c4587a8806661b70e3913 Sep 08 10:46:09.625504 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ListImageFiltersTestJSON-221384243-project Sep 08 10:46:09.625504 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:46:09.625504 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance dac27157-b08e-4f13-b97e-3c5b653bd0b3 could not be found. Sep 08 10:46:09.625504 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'dac27157-b08e-4f13-b97e-3c5b653bd0b3'} Sep 08 10:46:09.625504 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:46:09.625504 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:46:09.625504 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:46:09.625504 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:46:09.625504 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:46:09.625504 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:46:09.625504 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:46:09.625504 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:46:09.625504 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:46:09.625504 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:46:09.625504 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dac27157-b08e-4f13-b97e-3c5b653bd0b3 could not be found. Sep 08 10:46:09.625504 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:46:09.625504 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:46:09.625504 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:46:09.625504 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:46:09.625504 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:46:09.625504 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:46:09.625504 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:46:09.625504 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:46:09.625504 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:46:09.625504 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:46:09.625504 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:46:09.625504 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:46:09.625504 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:46:09.625504 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:46:09.625504 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:46:09.625504 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:46:09.625504 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dac27157-b08e-4f13-b97e-3c5b653bd0b3 could not be found. Sep 08 10:46:09.625504 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:46:09.625504 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:46:09.625504 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:46:09.633781 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:46:09.633781 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:46:09.633781 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:46:09.633781 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:46:09.633781 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:46:09.633781 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dac27157-b08e-4f13-b97e-3c5b653bd0b3 could not be found. Sep 08 10:46:09.633781 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:46:09.633781 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-08a4b8d8-4a00-40ab-9f7a-f1c05d30b390 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Returning 404 to user: Instance dac27157-b08e-4f13-b97e-3c5b653bd0b3 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:46:09.633781 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-08a4b8d8-4a00-40ab-9f7a-f1c05d30b390 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/servers/dac27157-b08e-4f13-b97e-3c5b653bd0b3" status: 404 len: 111 microversion: 2.1 time: 0.050863 Sep 08 10:46:09.633781 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1002/2020] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:09 2022] GET /compute/v2.1/servers/dac27157-b08e-4f13-b97e-3c5b653bd0b3 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:46:09.633781 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-aca8e026-9cd7-47c8-8a78-458c3d0cacd4 req-82d2a4e9-041c-44ce-8782-46c0fe77b7ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "292d240e-1176-4875-8f87-9ca911437fbe", "name": "network-vif-deleted", "tag": "73b84527-1c36-4494-857a-3c9441bb8f82"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:46:09.642726 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-aca8e026-9cd7-47c8-8a78-458c3d0cacd4 req-82d2a4e9-041c-44ce-8782-46c0fe77b7ed service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:09.643397 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-aca8e026-9cd7-47c8-8a78-458c3d0cacd4 req-82d2a4e9-041c-44ce-8782-46c0fe77b7ed service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:09.643831 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-aca8e026-9cd7-47c8-8a78-458c3d0cacd4 req-82d2a4e9-041c-44ce-8782-46c0fe77b7ed service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:09.658413 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-aca8e026-9cd7-47c8-8a78-458c3d0cacd4 req-82d2a4e9-041c-44ce-8782-46c0fe77b7ed service nova] Creating event network-vif-deleted:73b84527-1c36-4494-857a-3c9441bb8f82 for instance 292d240e-1176-4875-8f87-9ca911437fbe on n-h2-850501-12 Sep 08 10:46:09.664032 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-aca8e026-9cd7-47c8-8a78-458c3d0cacd4 req-82d2a4e9-041c-44ce-8782-46c0fe77b7ed service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034750 Sep 08 10:46:09.665177 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1003/2021] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:46:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:46:09.670344 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f95e9593-a365-43ab-a349-42178d6fa6bd tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:09.671104 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f95e9593-a365-43ab-a349-42178d6fa6bd tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 7d251638-b28f-4137-a81a-ce1a21cd7418] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:09.678932 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f95e9593-a365-43ab-a349-42178d6fa6bd tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:09.679430 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f95e9593-a365-43ab-a349-42178d6fa6bd tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:09.679872 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f95e9593-a365-43ab-a349-42178d6fa6bd tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:09.680583 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f95e9593-a365-43ab-a349-42178d6fa6bd tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:09.681053 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f95e9593-a365-43ab-a349-42178d6fa6bd tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:09.681698 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f95e9593-a365-43ab-a349-42178d6fa6bd tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:09.850088 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f95e9593-a365-43ab-a349-42178d6fa6bd tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:09.863566 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f95e9593-a365-43ab-a349-42178d6fa6bd tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/7d251638-b28f-4137-a81a-ce1a21cd7418" status: 200 len: 1308 microversion: 2.1 time: 0.195997 Sep 08 10:46:09.864754 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1004/2022] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:09 2022] GET /compute/v2.1/servers/7d251638-b28f-4137-a81a-ce1a21cd7418 => generated 1308 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:09.884417 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8fb20fc0-f2ee-489c-9e62-0f8582d19806 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:09.888705 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8fb20fc0-f2ee-489c-9e62-0f8582d19806 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 90974422-0d77-4970-9e94-ed6b3376ed29] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:09.899932 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8fb20fc0-f2ee-489c-9e62-0f8582d19806 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:09.900544 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8fb20fc0-f2ee-489c-9e62-0f8582d19806 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:09.901067 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8fb20fc0-f2ee-489c-9e62-0f8582d19806 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:09.901879 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8fb20fc0-f2ee-489c-9e62-0f8582d19806 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:09.902412 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8fb20fc0-f2ee-489c-9e62-0f8582d19806 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:09.902910 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8fb20fc0-f2ee-489c-9e62-0f8582d19806 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:09.970693 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8fb20fc0-f2ee-489c-9e62-0f8582d19806 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:09.981857 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8fb20fc0-f2ee-489c-9e62-0f8582d19806 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29" status: 200 len: 1184 microversion: 2.1 time: 0.115514 Sep 08 10:46:09.982609 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1005/2023] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:09 2022] GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29 => generated 1184 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:09.999954 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b21b4f94-b7b7-41ea-91b2-775cb871e006 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-525784643", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "3766b195-ace4-4563-a24e-dca72941251e"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:46:10.062176 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-b21b4f94-b7b7-41ea-91b2-775cb871e006 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] validate_networks() for None {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:46:10.341788 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-b21b4f94-b7b7-41ea-91b2-775cb871e006 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:46:10.343622 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-b21b4f94-b7b7-41ea-91b2-775cb871e006 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:46:10.344291 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-b21b4f94-b7b7-41ea-91b2-775cb871e006 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:46:10.345593 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-b21b4f94-b7b7-41ea-91b2-775cb871e006 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:46:10.346556 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-b21b4f94-b7b7-41ea-91b2-775cb871e006 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:46:10.357409 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b21b4f94-b7b7-41ea-91b2-775cb871e006 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:10.357905 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b21b4f94-b7b7-41ea-91b2-775cb871e006 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:10.358438 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b21b4f94-b7b7-41ea-91b2-775cb871e006 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:10.359215 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b21b4f94-b7b7-41ea-91b2-775cb871e006 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:10.359675 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b21b4f94-b7b7-41ea-91b2-775cb871e006 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:10.360119 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b21b4f94-b7b7-41ea-91b2-775cb871e006 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:10.380041 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-b21b4f94-b7b7-41ea-91b2-775cb871e006 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Getting quotas for project eb93f8524768458a974c348b981921d5. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:46:10.385422 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-b21b4f94-b7b7-41ea-91b2-775cb871e006 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Getting quotas for user c1c083657f0a4cebbc0804cd5d5ea4ad and project eb93f8524768458a974c348b981921d5. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:46:10.398821 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b21b4f94-b7b7-41ea-91b2-775cb871e006 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:46:10.401233 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b21b4f94-b7b7-41ea-91b2-775cb871e006 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: e84298ea-b5e7-473b-8597-2b469d09023e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:46:10.450233 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b21b4f94-b7b7-41ea-91b2-775cb871e006 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.465896 Sep 08 10:46:10.451381 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1006/2024] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:46:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 468 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:46:10.456151 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-51dff56f-c7dc-4bf5-bdd5-8833c48802e0 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:10.456656 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-51dff56f-c7dc-4bf5-bdd5-8833c48802e0 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] [instance: 3e6be670-294f-417f-a909-57c481faaf40] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:10.466420 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51dff56f-c7dc-4bf5-bdd5-8833c48802e0 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:10.467243 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51dff56f-c7dc-4bf5-bdd5-8833c48802e0 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:10.467905 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51dff56f-c7dc-4bf5-bdd5-8833c48802e0 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:10.469213 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51dff56f-c7dc-4bf5-bdd5-8833c48802e0 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:10.469924 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51dff56f-c7dc-4bf5-bdd5-8833c48802e0 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:10.470590 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51dff56f-c7dc-4bf5-bdd5-8833c48802e0 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:10.510995 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-51dff56f-c7dc-4bf5-bdd5-8833c48802e0 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] [instance: 3e6be670-294f-417f-a909-57c481faaf40] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:46:10.640875 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-51dff56f-c7dc-4bf5-bdd5-8833c48802e0 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3e6be670-294f-417f-a909-57c481faaf40" status: 204 len: 0 microversion: 2.1 time: 0.187941 Sep 08 10:46:10.641965 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1007/2025] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:46:10 2022] DELETE /compute/v2.1/servers/3e6be670-294f-417f-a909-57c481faaf40 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:46:10.647846 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ea43eb81-2c5d-42be-9eb9-c176e91d517e tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:10.648721 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ea43eb81-2c5d-42be-9eb9-c176e91d517e tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] [instance: 292d240e-1176-4875-8f87-9ca911437fbe] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:10.649001 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-522d8246-aaa2-4ae5-a714-46161c267885 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: f9f308fa-d4a6-4ac9-8c64-927e082b0b4a] Updating instance_info_cache with network_info: [] {{(pid=128861) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 08 10:46:10.662818 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea43eb81-2c5d-42be-9eb9-c176e91d517e tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:10.663590 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea43eb81-2c5d-42be-9eb9-c176e91d517e tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:10.664147 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea43eb81-2c5d-42be-9eb9-c176e91d517e tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:10.664954 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea43eb81-2c5d-42be-9eb9-c176e91d517e tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:10.665500 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea43eb81-2c5d-42be-9eb9-c176e91d517e tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:10.665998 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea43eb81-2c5d-42be-9eb9-c176e91d517e tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:10.688939 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-ea43eb81-2c5d-42be-9eb9-c176e91d517e tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] HTTP exception thrown: Instance 292d240e-1176-4875-8f87-9ca911437fbe could not be found. Sep 08 10:46:10.692707 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ea43eb81-2c5d-42be-9eb9-c176e91d517e tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Request method failure captured: Sep 08 10:46:10.692707 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/292d240e-1176-4875-8f87-9ca911437fbe HTTP/1.1 Sep 08 10:46:10.692707 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:46:10.692707 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:46:10.692707 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:46:10.692707 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:46:10.692707 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:46:10.692707 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:46:10.692707 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:46:10.692707 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:46:10.692707 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcXZt42mIM6otq6VWkhIIA96oZXavtoZmbqhqPMc80NVSsiJRHHpYnYGGzEhUVoRyhAcs8Hwl3L1suVGPpViQRvBrgcN-bOUeRDMIOnFanMQUyO3LgHh8xb8i8vD5c0S9_Vu-2OsRoz_mmLSl8OWaahD1PakjyKG5z1Mn4YpkZj5tYE Sep 08 10:46:10.692707 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:46:10.692707 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:46:10.692707 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:46:10.692707 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:46:10.692707 n-d-850501-12 devstack@n-api.service[128862]: X-Openstack-Nova-Api-Version: 2.25 Sep 08 10:46:10.692707 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:46:10.692707 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:46:10.692707 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 57d64134da60477da24b7fde4e1b9680 Sep 08 10:46:10.692707 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1806613506 Sep 08 10:46:10.692707 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:46:10.692707 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:46:10.692707 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/57d64134da60477da24b7fde4e1b9680"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/57d64134da60477da24b7fde4e1b9680"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_57d64134da60477da24b7fde4e1b9680"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/57d64134da60477da24b7fde4e1b9680"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:46:10.692707 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1806613506 Sep 08 10:46:10.692707 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 57d64134da60477da24b7fde4e1b9680 Sep 08 10:46:10.692707 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1806613506 Sep 08 10:46:10.692707 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-LiveAutoBlockMigrationV225Test-1806613506-project Sep 08 10:46:10.692707 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:46:10.692707 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:46:10.692707 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 27456dd9f49540b09f2e8addd1045a94 Sep 08 10:46:10.692707 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1806613506-project Sep 08 10:46:10.692707 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:46:10.692707 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 292d240e-1176-4875-8f87-9ca911437fbe could not be found. Sep 08 10:46:10.692707 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '292d240e-1176-4875-8f87-9ca911437fbe'} Sep 08 10:46:10.692707 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:46:10.692707 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:46:10.692707 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:46:10.692707 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:46:10.692707 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:46:10.692707 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:46:10.692707 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:46:10.692707 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:46:10.692707 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:46:10.692707 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:46:10.692707 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 292d240e-1176-4875-8f87-9ca911437fbe could not be found. Sep 08 10:46:10.692707 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:46:10.692707 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:46:10.692707 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:46:10.692707 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:46:10.692707 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:46:10.692707 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:46:10.692707 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:46:10.692707 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:46:10.692707 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:46:10.692707 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:46:10.692707 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:46:10.692707 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:46:10.692707 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:46:10.692707 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:46:10.692707 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:46:10.692707 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:46:10.692707 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 292d240e-1176-4875-8f87-9ca911437fbe could not be found. Sep 08 10:46:10.692707 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:46:10.698034 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:46:10.698034 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:46:10.698034 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:46:10.698034 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:46:10.698034 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:46:10.698034 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:46:10.698034 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:46:10.698034 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 292d240e-1176-4875-8f87-9ca911437fbe could not be found. Sep 08 10:46:10.698034 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:46:10.698034 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ea43eb81-2c5d-42be-9eb9-c176e91d517e tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] Returning 404 to user: Instance 292d240e-1176-4875-8f87-9ca911437fbe could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:46:10.698034 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ea43eb81-2c5d-42be-9eb9-c176e91d517e tempest-LiveAutoBlockMigrationV225Test-1806613506 tempest-LiveAutoBlockMigrationV225Test-1806613506-project] 10.222.0.27 "GET /compute/v2.1/servers/292d240e-1176-4875-8f87-9ca911437fbe" status: 404 len: 111 microversion: 2.25 time: 0.051174 Sep 08 10:46:10.701787 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1008/2026] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:46:10 2022] GET /compute/v2.1/servers/292d240e-1176-4875-8f87-9ca911437fbe => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:46:10.708954 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-88a3f18f-17a6-4269-bd88-e00a6ed4a913 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:10.712089 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-88a3f18f-17a6-4269-bd88-e00a6ed4a913 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: e84298ea-b5e7-473b-8597-2b469d09023e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:10.793671 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-88a3f18f-17a6-4269-bd88-e00a6ed4a913 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:10.802617 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-88a3f18f-17a6-4269-bd88-e00a6ed4a913 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/e84298ea-b5e7-473b-8597-2b469d09023e" status: 200 len: 1213 microversion: 2.1 time: 0.099916 Sep 08 10:46:10.817060 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1009/2027] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:10 2022] GET /compute/v2.1/servers/e84298ea-b5e7-473b-8597-2b469d09023e => generated 1213 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:10.817060 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ff9bc365-002b-4d6a-85ac-85d0b54971c7 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:10.817060 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ff9bc365-002b-4d6a-85ac-85d0b54971c7 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] [instance: 72eb7387-3f16-4b4f-ab9a-89076f169fc1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:10.822472 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=10 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:46:10.824799 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff9bc365-002b-4d6a-85ac-85d0b54971c7 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:10.825747 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff9bc365-002b-4d6a-85ac-85d0b54971c7 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:10.826774 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff9bc365-002b-4d6a-85ac-85d0b54971c7 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:10.829422 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff9bc365-002b-4d6a-85ac-85d0b54971c7 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:10.830809 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff9bc365-002b-4d6a-85ac-85d0b54971c7 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:10.831986 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff9bc365-002b-4d6a-85ac-85d0b54971c7 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:11.053346 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-522d8246-aaa2-4ae5-a714-46161c267885 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a" status: 204 len: 0 microversion: 2.1 time: 4.332516 Sep 08 10:46:11.054324 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1019/2028] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:46:06 2022] DELETE /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a => generated 0 bytes in 4334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:46:11.067830 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-85bd4249-fe40-414c-9835-f0dd190a236a req-48660f3d-ca6c-4fc4-a9b1-6113d9dad248 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d251638-b28f-4137-a81a-ce1a21cd7418", "tag": "c673f801-080b-42df-a05e-1dfffd8802bd"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:46:11.106482 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-85bd4249-fe40-414c-9835-f0dd190a236a req-48660f3d-ca6c-4fc4-a9b1-6113d9dad248 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:11.107894 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-85bd4249-fe40-414c-9835-f0dd190a236a req-48660f3d-ca6c-4fc4-a9b1-6113d9dad248 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:11.108348 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-85bd4249-fe40-414c-9835-f0dd190a236a req-48660f3d-ca6c-4fc4-a9b1-6113d9dad248 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:11.123968 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-85bd4249-fe40-414c-9835-f0dd190a236a req-48660f3d-ca6c-4fc4-a9b1-6113d9dad248 service nova] Creating event network-changed:c673f801-080b-42df-a05e-1dfffd8802bd for instance 7d251638-b28f-4137-a81a-ce1a21cd7418 on n-h2-850501-12 Sep 08 10:46:11.149980 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-85bd4249-fe40-414c-9835-f0dd190a236a req-48660f3d-ca6c-4fc4-a9b1-6113d9dad248 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091358 Sep 08 10:46:11.152628 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1020/2029] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:46:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:46:11.175646 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9757441b-46ff-4b86-b9fa-21f6f742e807 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:11.181882 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9757441b-46ff-4b86-b9fa-21f6f742e807 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] [instance: 3e6be670-294f-417f-a909-57c481faaf40] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:11.199212 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9757441b-46ff-4b86-b9fa-21f6f742e807 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:11.200002 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9757441b-46ff-4b86-b9fa-21f6f742e807 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:11.200610 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9757441b-46ff-4b86-b9fa-21f6f742e807 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:11.201570 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9757441b-46ff-4b86-b9fa-21f6f742e807 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:11.202963 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9757441b-46ff-4b86-b9fa-21f6f742e807 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:11.204855 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9757441b-46ff-4b86-b9fa-21f6f742e807 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:11.680393 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9757441b-46ff-4b86-b9fa-21f6f742e807 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7415a5b46c4587a8806661b70e3913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604588959944720923ec2d5e0bf81c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:11.692663 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9757441b-46ff-4b86-b9fa-21f6f742e807 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/servers/3e6be670-294f-417f-a909-57c481faaf40" status: 200 len: 1472 microversion: 2.1 time: 0.538069 Sep 08 10:46:11.699970 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1021/2030] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:11 2022] GET /compute/v2.1/servers/3e6be670-294f-417f-a909-57c481faaf40 => generated 1472 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:11.711526 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5db2cf1c-b9fd-41ad-996d-5376bed2bbfa tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:11.714398 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5db2cf1c-b9fd-41ad-996d-5376bed2bbfa tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 7d251638-b28f-4137-a81a-ce1a21cd7418] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:11.740697 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5db2cf1c-b9fd-41ad-996d-5376bed2bbfa tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:11.742722 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5db2cf1c-b9fd-41ad-996d-5376bed2bbfa tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:11.743414 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5db2cf1c-b9fd-41ad-996d-5376bed2bbfa tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:11.745365 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5db2cf1c-b9fd-41ad-996d-5376bed2bbfa tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:11.748342 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5db2cf1c-b9fd-41ad-996d-5376bed2bbfa tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:11.748794 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5db2cf1c-b9fd-41ad-996d-5376bed2bbfa tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:11.842043 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ff9bc365-002b-4d6a-85ac-85d0b54971c7 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ff38511b484fbcb7817a56076cf4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a768a3863448bca0c6cda11afdd955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:11.854779 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ff9bc365-002b-4d6a-85ac-85d0b54971c7 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] 10.222.0.27 "GET /compute/v2.1/servers/72eb7387-3f16-4b4f-ab9a-89076f169fc1" status: 200 len: 1366 microversion: 2.1 time: 1.049601 Sep 08 10:46:11.858673 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1010/2031] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:10 2022] GET /compute/v2.1/servers/72eb7387-3f16-4b4f-ab9a-89076f169fc1 => generated 1366 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:11.873849 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1e584b70-29d0-45fb-b1b0-2014beec7161 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:11.876903 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1e584b70-29d0-45fb-b1b0-2014beec7161 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 90974422-0d77-4970-9e94-ed6b3376ed29] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:11.901373 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e584b70-29d0-45fb-b1b0-2014beec7161 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:11.902290 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e584b70-29d0-45fb-b1b0-2014beec7161 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:11.903686 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e584b70-29d0-45fb-b1b0-2014beec7161 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:11.904680 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e584b70-29d0-45fb-b1b0-2014beec7161 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:11.905672 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e584b70-29d0-45fb-b1b0-2014beec7161 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:11.906378 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e584b70-29d0-45fb-b1b0-2014beec7161 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:11.956295 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:46:12.098400 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1e584b70-29d0-45fb-b1b0-2014beec7161 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:12.113346 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1e584b70-29d0-45fb-b1b0-2014beec7161 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29" status: 200 len: 1184 microversion: 2.1 time: 0.250955 Sep 08 10:46:12.114277 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1011/2032] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:11 2022] GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29 => generated 1184 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:12.125271 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-037001e6-7a8e-4155-97b2-6eab11124d9a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:12.130008 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-037001e6-7a8e-4155-97b2-6eab11124d9a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: f9f308fa-d4a6-4ac9-8c64-927e082b0b4a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:12.148304 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-037001e6-7a8e-4155-97b2-6eab11124d9a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:12.149197 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-037001e6-7a8e-4155-97b2-6eab11124d9a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:12.150027 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-037001e6-7a8e-4155-97b2-6eab11124d9a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:12.152183 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-037001e6-7a8e-4155-97b2-6eab11124d9a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:12.153466 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-037001e6-7a8e-4155-97b2-6eab11124d9a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:12.154645 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-037001e6-7a8e-4155-97b2-6eab11124d9a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:12.191316 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-037001e6-7a8e-4155-97b2-6eab11124d9a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] HTTP exception thrown: Instance f9f308fa-d4a6-4ac9-8c64-927e082b0b4a could not be found. Sep 08 10:46:12.194744 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-037001e6-7a8e-4155-97b2-6eab11124d9a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Request method failure captured: Sep 08 10:46:12.194744 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a HTTP/1.1 Sep 08 10:46:12.194744 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:46:12.194744 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:46:12.194744 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:46:12.194744 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:46:12.194744 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:46:12.194744 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:46:12.194744 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:46:12.194744 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:46:12.194744 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcbOYaOup_Ia1bHuprOxxP_LkfdCzYSX9xstQr2GVmRBueUQ0e967rlioz5jpJV566ZCuz_bYy_us0o8_CIFlOGOVfrC9_e_1_vEhZ3YdgjG89HBhaIJ_lG7Uv4nQrC-nfHrMx_LNyd0rOd4Blcm801SOcX7oe5VDxGTE8KVTDSeMPw Sep 08 10:46:12.194744 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:46:12.194744 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:46:12.194744 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:46:12.194744 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:46:12.194744 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:46:12.194744 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:46:12.194744 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 998378cc815344ba8a107d1cd61f40fd Sep 08 10:46:12.194744 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-DeleteServersTestJSON-69164830 Sep 08 10:46:12.194744 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:46:12.194744 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:46:12.194744 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:46:12.194744 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-DeleteServersTestJSON-69164830 Sep 08 10:46:12.194744 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 998378cc815344ba8a107d1cd61f40fd Sep 08 10:46:12.194744 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-DeleteServersTestJSON-69164830 Sep 08 10:46:12.194744 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-DeleteServersTestJSON-69164830-project Sep 08 10:46:12.194744 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:46:12.194744 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:46:12.194744 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: d08269c53bcb41c88953e7c79f5ad185 Sep 08 10:46:12.194744 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-DeleteServersTestJSON-69164830-project Sep 08 10:46:12.194744 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:46:12.194744 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance f9f308fa-d4a6-4ac9-8c64-927e082b0b4a could not be found. Sep 08 10:46:12.194744 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'f9f308fa-d4a6-4ac9-8c64-927e082b0b4a'} Sep 08 10:46:12.194744 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:46:12.194744 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:46:12.194744 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:46:12.194744 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:46:12.194744 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:46:12.194744 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:46:12.194744 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:46:12.194744 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:46:12.194744 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:46:12.194744 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:46:12.194744 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9f308fa-d4a6-4ac9-8c64-927e082b0b4a could not be found. Sep 08 10:46:12.194744 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:46:12.194744 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:46:12.194744 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:46:12.194744 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:46:12.194744 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:46:12.194744 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:46:12.194744 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:46:12.194744 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:46:12.194744 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:46:12.194744 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:46:12.194744 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:46:12.194744 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:46:12.194744 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:46:12.194744 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:46:12.194744 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:46:12.194744 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:46:12.194744 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9f308fa-d4a6-4ac9-8c64-927e082b0b4a could not be found. Sep 08 10:46:12.194744 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:46:12.194744 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:46:12.194744 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:46:12.201939 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:46:12.201939 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:46:12.201939 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:46:12.201939 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:46:12.201939 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:46:12.201939 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9f308fa-d4a6-4ac9-8c64-927e082b0b4a could not be found. Sep 08 10:46:12.201939 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:46:12.203494 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-037001e6-7a8e-4155-97b2-6eab11124d9a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Returning 404 to user: Instance f9f308fa-d4a6-4ac9-8c64-927e082b0b4a could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:46:12.204663 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-037001e6-7a8e-4155-97b2-6eab11124d9a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a" status: 404 len: 111 microversion: 2.1 time: 0.088139 Sep 08 10:46:12.214331 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1012/2033] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:12 2022] GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:46:12.221450 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-06e34fde-6628-4158-aa83-5b3b0b5cd522 req-9cc6e533-2301-4448-b21f-2660d0498ef5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9f308fa-d4a6-4ac9-8c64-927e082b0b4a", "name": "network-vif-deleted", "tag": "113493e8-8f02-4099-b529-0616d267ed77"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:46:12.259382 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-06e34fde-6628-4158-aa83-5b3b0b5cd522 req-9cc6e533-2301-4448-b21f-2660d0498ef5 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:12.264490 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-06e34fde-6628-4158-aa83-5b3b0b5cd522 req-9cc6e533-2301-4448-b21f-2660d0498ef5 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:12.265319 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-06e34fde-6628-4158-aa83-5b3b0b5cd522 req-9cc6e533-2301-4448-b21f-2660d0498ef5 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:12.298404 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.compute.server_external_events [req-06e34fde-6628-4158-aa83-5b3b0b5cd522 req-9cc6e533-2301-4448-b21f-2660d0498ef5 service nova] Unable to find a host for instance f9f308fa-d4a6-4ac9-8c64-927e082b0b4a. Dropping event network-vif-deleted {{(pid=128862) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 08 10:46:12.302409 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-06e34fde-6628-4158-aa83-5b3b0b5cd522 req-9cc6e533-2301-4448-b21f-2660d0498ef5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.085697 Sep 08 10:46:12.305289 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1013/2034] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:46:12 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 90 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 08 10:46:12.313202 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-657908ab-65d9-4de8-a899-581f7a78f59f tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:12.317383 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-657908ab-65d9-4de8-a899-581f7a78f59f tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: e84298ea-b5e7-473b-8597-2b469d09023e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:12.334635 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-657908ab-65d9-4de8-a899-581f7a78f59f tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:12.337863 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-657908ab-65d9-4de8-a899-581f7a78f59f tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:12.340302 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-657908ab-65d9-4de8-a899-581f7a78f59f tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:12.341398 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-657908ab-65d9-4de8-a899-581f7a78f59f tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:12.345781 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-657908ab-65d9-4de8-a899-581f7a78f59f tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:12.348747 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-657908ab-65d9-4de8-a899-581f7a78f59f tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:12.370146 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5db2cf1c-b9fd-41ad-996d-5376bed2bbfa tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:12.381425 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5db2cf1c-b9fd-41ad-996d-5376bed2bbfa tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/7d251638-b28f-4137-a81a-ce1a21cd7418" status: 200 len: 1308 microversion: 2.1 time: 0.679979 Sep 08 10:46:12.383767 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1022/2035] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:11 2022] GET /compute/v2.1/servers/7d251638-b28f-4137-a81a-ce1a21cd7418 => generated 1308 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:12.503821 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-79871407-cb73-43a5-a8ee-cc33f294a8b6 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-22978425", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "cf032a39-d4e2-476c-8052-c76f4ee567c9"}]}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:46:12.561874 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-657908ab-65d9-4de8-a899-581f7a78f59f tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:12.573651 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-657908ab-65d9-4de8-a899-581f7a78f59f tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/e84298ea-b5e7-473b-8597-2b469d09023e" status: 200 len: 1265 microversion: 2.1 time: 0.265997 Sep 08 10:46:12.587510 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1014/2036] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:12 2022] GET /compute/v2.1/servers/e84298ea-b5e7-473b-8597-2b469d09023e => generated 1265 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:12.621402 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-79871407-cb73-43a5-a8ee-cc33f294a8b6 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] validate_networks() for [('cf032a39-d4e2-476c-8052-c76f4ee567c9', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:46:12.730896 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b3c465a4-de89-4a42-8cb4-644a72b1fbd7 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:12.732068 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b3c465a4-de89-4a42-8cb4-644a72b1fbd7 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] [instance: 3e6be670-294f-417f-a909-57c481faaf40] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:12.776677 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3c465a4-de89-4a42-8cb4-644a72b1fbd7 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:12.782364 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3c465a4-de89-4a42-8cb4-644a72b1fbd7 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:12.783894 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3c465a4-de89-4a42-8cb4-644a72b1fbd7 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:12.785388 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3c465a4-de89-4a42-8cb4-644a72b1fbd7 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:12.786540 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3c465a4-de89-4a42-8cb4-644a72b1fbd7 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:12.787494 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3c465a4-de89-4a42-8cb4-644a72b1fbd7 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:14.025363 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b3c465a4-de89-4a42-8cb4-644a72b1fbd7 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7415a5b46c4587a8806661b70e3913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604588959944720923ec2d5e0bf81c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:14.047696 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b3c465a4-de89-4a42-8cb4-644a72b1fbd7 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/servers/3e6be670-294f-417f-a909-57c481faaf40" status: 200 len: 1472 microversion: 2.1 time: 1.321547 Sep 08 10:46:14.066845 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1015/2037] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:12 2022] GET /compute/v2.1/servers/3e6be670-294f-417f-a909-57c481faaf40 => generated 1472 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:14.085433 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8ae12389-e23e-485c-92e0-6cf584de435b tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:14.086080 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8ae12389-e23e-485c-92e0-6cf584de435b tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] [instance: 72eb7387-3f16-4b4f-ab9a-89076f169fc1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:14.100002 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ae12389-e23e-485c-92e0-6cf584de435b tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:14.100509 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ae12389-e23e-485c-92e0-6cf584de435b tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:14.100954 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ae12389-e23e-485c-92e0-6cf584de435b tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:14.101728 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ae12389-e23e-485c-92e0-6cf584de435b tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:14.102196 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ae12389-e23e-485c-92e0-6cf584de435b tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:14.102628 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ae12389-e23e-485c-92e0-6cf584de435b tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:14.855069 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8ae12389-e23e-485c-92e0-6cf584de435b tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ff38511b484fbcb7817a56076cf4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a768a3863448bca0c6cda11afdd955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:14.907848 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8ae12389-e23e-485c-92e0-6cf584de435b tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] 10.222.0.27 "GET /compute/v2.1/servers/72eb7387-3f16-4b4f-ab9a-89076f169fc1" status: 200 len: 1366 microversion: 2.1 time: 0.838696 Sep 08 10:46:14.919155 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1016/2038] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:14 2022] GET /compute/v2.1/servers/72eb7387-3f16-4b4f-ab9a-89076f169fc1 => generated 1366 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:14.932600 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-79871407-cb73-43a5-a8ee-cc33f294a8b6 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:46:14.933308 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-79871407-cb73-43a5-a8ee-cc33f294a8b6 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:46:14.933770 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-79871407-cb73-43a5-a8ee-cc33f294a8b6 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:46:14.934175 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-79871407-cb73-43a5-a8ee-cc33f294a8b6 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:46:14.934586 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-79871407-cb73-43a5-a8ee-cc33f294a8b6 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:46:14.948648 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-79871407-cb73-43a5-a8ee-cc33f294a8b6 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:14.949703 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-79871407-cb73-43a5-a8ee-cc33f294a8b6 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:14.950749 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-79871407-cb73-43a5-a8ee-cc33f294a8b6 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:14.950895 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cdec107c-8cd9-4a99-a99e-4d3489462d4f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:14.951391 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cdec107c-8cd9-4a99-a99e-4d3489462d4f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 90974422-0d77-4970-9e94-ed6b3376ed29] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:14.955231 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-79871407-cb73-43a5-a8ee-cc33f294a8b6 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:14.956426 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-79871407-cb73-43a5-a8ee-cc33f294a8b6 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:14.957208 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-79871407-cb73-43a5-a8ee-cc33f294a8b6 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:14.967302 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cdec107c-8cd9-4a99-a99e-4d3489462d4f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:14.969587 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cdec107c-8cd9-4a99-a99e-4d3489462d4f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:14.972246 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cdec107c-8cd9-4a99-a99e-4d3489462d4f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:14.973670 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cdec107c-8cd9-4a99-a99e-4d3489462d4f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:14.974157 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cdec107c-8cd9-4a99-a99e-4d3489462d4f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:14.976575 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cdec107c-8cd9-4a99-a99e-4d3489462d4f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:14.984862 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-79871407-cb73-43a5-a8ee-cc33f294a8b6 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Getting quotas for project 998378cc815344ba8a107d1cd61f40fd. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:46:14.995694 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-79871407-cb73-43a5-a8ee-cc33f294a8b6 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Getting quotas for user d08269c53bcb41c88953e7c79f5ad185 and project 998378cc815344ba8a107d1cd61f40fd. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:46:15.014940 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-79871407-cb73-43a5-a8ee-cc33f294a8b6 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:46:15.015379 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-cdec107c-8cd9-4a99-a99e-4d3489462d4f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] HTTP exception thrown: Instance 90974422-0d77-4970-9e94-ed6b3376ed29 could not be found. Sep 08 10:46:15.018571 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-79871407-cb73-43a5-a8ee-cc33f294a8b6 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: eca1ed67-f21d-46e3-8557-014bc6b63953] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:46:15.019964 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cdec107c-8cd9-4a99-a99e-4d3489462d4f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Request method failure captured: Sep 08 10:46:15.019964 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29 HTTP/1.1 Sep 08 10:46:15.019964 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:46:15.019964 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:46:15.019964 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:46:15.019964 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:46:15.019964 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:46:15.019964 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:46:15.019964 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:46:15.019964 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:46:15.019964 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcX1wX6Qpf7IbEqK0znrUx8_LbU5RhxRt5QNO93yuGvepmmaO-HjP1nf79OOPUBjHW9MdcmnWuHxmJt_3mvzs2zsnsyhxC4842HKcCGy7uo7GyYhZnwsl7Op8-00YUPftmtBMh7Wps_XoCaQJPMiFlN-aLHQbjYqshHN9g8uR4tdIhI Sep 08 10:46:15.019964 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:46:15.019964 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:46:15.019964 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:46:15.019964 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:46:15.019964 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:46:15.019964 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:46:15.019964 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: c7f9807a4eb2473e87377097b0544d0e Sep 08 10:46:15.019964 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-LiveMigrationTest-49407157 Sep 08 10:46:15.019964 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:46:15.019964 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:46:15.019964 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c7f9807a4eb2473e87377097b0544d0e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c7f9807a4eb2473e87377097b0544d0e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c7f9807a4eb2473e87377097b0544d0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c7f9807a4eb2473e87377097b0544d0e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:46:15.019964 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-LiveMigrationTest-49407157 Sep 08 10:46:15.019964 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: c7f9807a4eb2473e87377097b0544d0e Sep 08 10:46:15.019964 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-LiveMigrationTest-49407157 Sep 08 10:46:15.019964 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-LiveMigrationTest-49407157-project Sep 08 10:46:15.019964 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:46:15.019964 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:46:15.019964 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 3ecf9924d86b4fd38a6f31430e9d3418 Sep 08 10:46:15.019964 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-LiveMigrationTest-49407157-project Sep 08 10:46:15.019964 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:46:15.019964 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 90974422-0d77-4970-9e94-ed6b3376ed29 could not be found. Sep 08 10:46:15.019964 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '90974422-0d77-4970-9e94-ed6b3376ed29'} Sep 08 10:46:15.019964 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:46:15.019964 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:46:15.019964 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:46:15.019964 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:46:15.019964 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:46:15.019964 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:46:15.019964 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:46:15.019964 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:46:15.019964 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:46:15.019964 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:46:15.019964 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90974422-0d77-4970-9e94-ed6b3376ed29 could not be found. Sep 08 10:46:15.019964 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:46:15.019964 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:46:15.019964 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:46:15.019964 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:46:15.019964 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:46:15.019964 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:46:15.019964 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:46:15.019964 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:46:15.019964 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:46:15.019964 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:46:15.019964 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:46:15.019964 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:46:15.019964 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:46:15.019964 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:46:15.019964 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:46:15.019964 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:46:15.019964 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90974422-0d77-4970-9e94-ed6b3376ed29 could not be found. Sep 08 10:46:15.019964 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:46:15.019964 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:46:15.019964 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:46:15.028975 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:46:15.028975 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:46:15.028975 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:46:15.028975 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:46:15.028975 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:46:15.028975 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90974422-0d77-4970-9e94-ed6b3376ed29 could not be found. Sep 08 10:46:15.028975 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:46:15.028975 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cdec107c-8cd9-4a99-a99e-4d3489462d4f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Returning 404 to user: Instance 90974422-0d77-4970-9e94-ed6b3376ed29 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:46:15.028975 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cdec107c-8cd9-4a99-a99e-4d3489462d4f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29" status: 404 len: 111 microversion: 2.1 time: 0.098898 Sep 08 10:46:15.055134 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1017/2039] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:14 2022] GET /compute/v2.1/servers/90974422-0d77-4970-9e94-ed6b3376ed29 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:46:15.081817 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c665b67a-cd1e-4524-8a6c-0044e45129f0 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:15.088802 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c665b67a-cd1e-4524-8a6c-0044e45129f0 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 7d251638-b28f-4137-a81a-ce1a21cd7418] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:15.118696 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c665b67a-cd1e-4524-8a6c-0044e45129f0 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:15.119462 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c665b67a-cd1e-4524-8a6c-0044e45129f0 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:15.120130 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c665b67a-cd1e-4524-8a6c-0044e45129f0 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:15.121056 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c665b67a-cd1e-4524-8a6c-0044e45129f0 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:15.123089 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c665b67a-cd1e-4524-8a6c-0044e45129f0 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:15.124381 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c665b67a-cd1e-4524-8a6c-0044e45129f0 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:15.144491 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-79871407-cb73-43a5-a8ee-cc33f294a8b6 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.648942 Sep 08 10:46:15.158977 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1023/2040] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:46:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 2664 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 10:46:15.172846 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bcce1936-caf5-46a4-bcf8-6fe294f86547 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:15.175944 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bcce1936-caf5-46a4-bcf8-6fe294f86547 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: e84298ea-b5e7-473b-8597-2b469d09023e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:15.208208 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bcce1936-caf5-46a4-bcf8-6fe294f86547 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:15.209820 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bcce1936-caf5-46a4-bcf8-6fe294f86547 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:15.261583 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bcce1936-caf5-46a4-bcf8-6fe294f86547 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:15.264268 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bcce1936-caf5-46a4-bcf8-6fe294f86547 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:15.265274 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bcce1936-caf5-46a4-bcf8-6fe294f86547 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:15.265274 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bcce1936-caf5-46a4-bcf8-6fe294f86547 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:15.884125 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c665b67a-cd1e-4524-8a6c-0044e45129f0 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:15.908645 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c665b67a-cd1e-4524-8a6c-0044e45129f0 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/7d251638-b28f-4137-a81a-ce1a21cd7418" status: 200 len: 1308 microversion: 2.1 time: 0.850478 Sep 08 10:46:15.909299 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1018/2041] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:15 2022] GET /compute/v2.1/servers/7d251638-b28f-4137-a81a-ce1a21cd7418 => generated 1308 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:15.931530 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-993d3cdc-c400-4964-9d7e-d54d922fa3ed tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:15.945673 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-993d3cdc-c400-4964-9d7e-d54d922fa3ed tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] [instance: 3e6be670-294f-417f-a909-57c481faaf40] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:15.959887 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-993d3cdc-c400-4964-9d7e-d54d922fa3ed tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:15.967945 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-993d3cdc-c400-4964-9d7e-d54d922fa3ed tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:15.968664 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-993d3cdc-c400-4964-9d7e-d54d922fa3ed tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:15.977453 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-993d3cdc-c400-4964-9d7e-d54d922fa3ed tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:15.978240 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-993d3cdc-c400-4964-9d7e-d54d922fa3ed tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:15.979090 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-993d3cdc-c400-4964-9d7e-d54d922fa3ed tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:16.105261 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-993d3cdc-c400-4964-9d7e-d54d922fa3ed tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:16.105926 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-993d3cdc-c400-4964-9d7e-d54d922fa3ed tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:16.106197 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-993d3cdc-c400-4964-9d7e-d54d922fa3ed tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:16.106658 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-993d3cdc-c400-4964-9d7e-d54d922fa3ed tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lazy-loading 'fault' on Instance uuid 3e6be670-294f-417f-a909-57c481faaf40 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:46:16.247896 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-993d3cdc-c400-4964-9d7e-d54d922fa3ed tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7415a5b46c4587a8806661b70e3913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604588959944720923ec2d5e0bf81c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:16.268226 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-993d3cdc-c400-4964-9d7e-d54d922fa3ed tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/servers/3e6be670-294f-417f-a909-57c481faaf40" status: 200 len: 1307 microversion: 2.1 time: 0.339848 Sep 08 10:46:16.294188 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1019/2042] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:15 2022] GET /compute/v2.1/servers/3e6be670-294f-417f-a909-57c481faaf40 => generated 1307 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:16.315156 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7da13a0b-9069-4e00-aabd-827d3480b862 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:16.316218 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7da13a0b-9069-4e00-aabd-827d3480b862 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: eca1ed67-f21d-46e3-8557-014bc6b63953] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:16.342113 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7da13a0b-9069-4e00-aabd-827d3480b862 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:16.342701 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7da13a0b-9069-4e00-aabd-827d3480b862 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:16.343134 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7da13a0b-9069-4e00-aabd-827d3480b862 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:16.358749 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7da13a0b-9069-4e00-aabd-827d3480b862 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:16.359770 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7da13a0b-9069-4e00-aabd-827d3480b862 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:16.360793 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7da13a0b-9069-4e00-aabd-827d3480b862 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:16.653165 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7da13a0b-9069-4e00-aabd-827d3480b862 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:16.661562 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7da13a0b-9069-4e00-aabd-827d3480b862 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/eca1ed67-f21d-46e3-8557-014bc6b63953" status: 200 len: 1217 microversion: 2.1 time: 0.365901 Sep 08 10:46:16.672705 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1020/2043] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:16 2022] GET /compute/v2.1/servers/eca1ed67-f21d-46e3-8557-014bc6b63953 => generated 1217 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:16.683162 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-7ee2156d-4ec2-42eb-8b83-65c2f8837cf9 req-52460a8e-c63d-41fd-826e-8571a46febe0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e6be670-294f-417f-a909-57c481faaf40", "name": "network-vif-deleted", "tag": "2dc5c573-e6fe-4942-be41-259b760efba3"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:46:16.727161 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-7ee2156d-4ec2-42eb-8b83-65c2f8837cf9 req-52460a8e-c63d-41fd-826e-8571a46febe0 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:16.727676 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-7ee2156d-4ec2-42eb-8b83-65c2f8837cf9 req-52460a8e-c63d-41fd-826e-8571a46febe0 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:16.728120 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-7ee2156d-4ec2-42eb-8b83-65c2f8837cf9 req-52460a8e-c63d-41fd-826e-8571a46febe0 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:16.758604 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-7ee2156d-4ec2-42eb-8b83-65c2f8837cf9 req-52460a8e-c63d-41fd-826e-8571a46febe0 service nova] Creating event network-vif-deleted:2dc5c573-e6fe-4942-be41-259b760efba3 for instance 3e6be670-294f-417f-a909-57c481faaf40 on n-h1-850501-12 Sep 08 10:46:16.778467 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-7ee2156d-4ec2-42eb-8b83-65c2f8837cf9 req-52460a8e-c63d-41fd-826e-8571a46febe0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094753 Sep 08 10:46:16.779775 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1021/2044] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:46:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:46:16.786144 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-85550acc-d8e2-4f2c-aeee-13ae12f0ec5e tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:16.794772 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-85550acc-d8e2-4f2c-aeee-13ae12f0ec5e tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] [instance: 72eb7387-3f16-4b4f-ab9a-89076f169fc1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:16.807491 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-85550acc-d8e2-4f2c-aeee-13ae12f0ec5e tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:16.814014 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-85550acc-d8e2-4f2c-aeee-13ae12f0ec5e tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:16.814772 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-85550acc-d8e2-4f2c-aeee-13ae12f0ec5e tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:16.815966 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-85550acc-d8e2-4f2c-aeee-13ae12f0ec5e tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:16.816634 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-85550acc-d8e2-4f2c-aeee-13ae12f0ec5e tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:16.817279 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-85550acc-d8e2-4f2c-aeee-13ae12f0ec5e tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:17.307691 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-85550acc-d8e2-4f2c-aeee-13ae12f0ec5e tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ff38511b484fbcb7817a56076cf4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a768a3863448bca0c6cda11afdd955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:17.317191 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-85550acc-d8e2-4f2c-aeee-13ae12f0ec5e tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] 10.222.0.27 "GET /compute/v2.1/servers/72eb7387-3f16-4b4f-ab9a-89076f169fc1" status: 200 len: 1366 microversion: 2.1 time: 0.535912 Sep 08 10:46:17.327166 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1022/2045] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:16 2022] GET /compute/v2.1/servers/72eb7387-3f16-4b4f-ab9a-89076f169fc1 => generated 1366 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:17.344085 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-661b053d-e839-470c-9cbd-0d1e3bc43c38 req-c0235eb3-e82e-45dc-ac5b-ad80feb09b75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d251638-b28f-4137-a81a-ce1a21cd7418", "name": "network-vif-plugged", "status": "completed", "tag": "c673f801-080b-42df-a05e-1dfffd8802bd"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:46:17.368257 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-661b053d-e839-470c-9cbd-0d1e3bc43c38 req-c0235eb3-e82e-45dc-ac5b-ad80feb09b75 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:17.368747 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-661b053d-e839-470c-9cbd-0d1e3bc43c38 req-c0235eb3-e82e-45dc-ac5b-ad80feb09b75 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:17.369211 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-661b053d-e839-470c-9cbd-0d1e3bc43c38 req-c0235eb3-e82e-45dc-ac5b-ad80feb09b75 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:17.389948 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-bcce1936-caf5-46a4-bcf8-6fe294f86547 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:17.396039 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-661b053d-e839-470c-9cbd-0d1e3bc43c38 req-c0235eb3-e82e-45dc-ac5b-ad80feb09b75 service nova] Creating event network-vif-plugged:c673f801-080b-42df-a05e-1dfffd8802bd for instance 7d251638-b28f-4137-a81a-ce1a21cd7418 on n-h2-850501-12 Sep 08 10:46:17.409061 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-661b053d-e839-470c-9cbd-0d1e3bc43c38 req-c0235eb3-e82e-45dc-ac5b-ad80feb09b75 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077543 Sep 08 10:46:17.410803 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1023/2046] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:46:17.418724 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bcce1936-caf5-46a4-bcf8-6fe294f86547 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/e84298ea-b5e7-473b-8597-2b469d09023e" status: 200 len: 1313 microversion: 2.1 time: 2.258032 Sep 08 10:46:17.419623 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1024/2047] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:15 2022] GET /compute/v2.1/servers/e84298ea-b5e7-473b-8597-2b469d09023e => generated 1313 bytes in 2260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:17.438152 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a0c19d38-b733-40d5-92f5-7fbe946b31bc tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:17.440112 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a0c19d38-b733-40d5-92f5-7fbe946b31bc tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 7d251638-b28f-4137-a81a-ce1a21cd7418] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:17.448580 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a0c19d38-b733-40d5-92f5-7fbe946b31bc tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:17.455077 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a0c19d38-b733-40d5-92f5-7fbe946b31bc tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:17.455973 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a0c19d38-b733-40d5-92f5-7fbe946b31bc tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:17.456921 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a0c19d38-b733-40d5-92f5-7fbe946b31bc tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:17.458498 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a0c19d38-b733-40d5-92f5-7fbe946b31bc tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:17.461578 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a0c19d38-b733-40d5-92f5-7fbe946b31bc tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:17.466890 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e3e0d2d7-c6d4-425e-8083-82796642dc60 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:17.470473 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e3e0d2d7-c6d4-425e-8083-82796642dc60 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] [instance: 3e6be670-294f-417f-a909-57c481faaf40] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:17.511733 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e3e0d2d7-c6d4-425e-8083-82796642dc60 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:17.525725 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e3e0d2d7-c6d4-425e-8083-82796642dc60 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:17.527026 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e3e0d2d7-c6d4-425e-8083-82796642dc60 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:17.530788 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e3e0d2d7-c6d4-425e-8083-82796642dc60 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:17.533167 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e3e0d2d7-c6d4-425e-8083-82796642dc60 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:17.534307 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e3e0d2d7-c6d4-425e-8083-82796642dc60 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:17.578295 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-e3e0d2d7-c6d4-425e-8083-82796642dc60 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] HTTP exception thrown: Instance 3e6be670-294f-417f-a909-57c481faaf40 could not be found. Sep 08 10:46:17.583803 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e3e0d2d7-c6d4-425e-8083-82796642dc60 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Request method failure captured: Sep 08 10:46:17.583803 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/3e6be670-294f-417f-a909-57c481faaf40 HTTP/1.1 Sep 08 10:46:17.583803 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:46:17.583803 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:46:17.583803 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:46:17.583803 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:46:17.583803 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:46:17.583803 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:46:17.583803 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:46:17.583803 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:46:17.583803 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGccq4RXL2fIGL5lcjFo97J6tfkuLUiY3Nh7bNifCZKFDYoDqR0YP7RMMXwq3JhnrUOhcHtz4k4QmybJ-ut1PCO2KMs6muxbt_nXpRa9XEf8CF3kLCce3-hzBCJJczrVPj8XT77m-UIaYnjkOY6ASciv301mJyrAXnbwGp3nQik8CYO4 Sep 08 10:46:17.583803 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:46:17.583803 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:46:17.583803 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:46:17.583803 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:46:17.583803 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:46:17.583803 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:46:17.583803 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 2604588959944720923ec2d5e0bf81c0 Sep 08 10:46:17.583803 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ListImageFiltersTestJSON-221384243 Sep 08 10:46:17.583803 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:46:17.583803 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:46:17.583803 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2604588959944720923ec2d5e0bf81c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2604588959944720923ec2d5e0bf81c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2604588959944720923ec2d5e0bf81c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2604588959944720923ec2d5e0bf81c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:46:17.583803 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ListImageFiltersTestJSON-221384243 Sep 08 10:46:17.583803 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 2604588959944720923ec2d5e0bf81c0 Sep 08 10:46:17.583803 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-221384243 Sep 08 10:46:17.583803 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ListImageFiltersTestJSON-221384243-project Sep 08 10:46:17.583803 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:46:17.583803 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:46:17.583803 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: ff7415a5b46c4587a8806661b70e3913 Sep 08 10:46:17.583803 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ListImageFiltersTestJSON-221384243-project Sep 08 10:46:17.583803 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:46:17.583803 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 3e6be670-294f-417f-a909-57c481faaf40 could not be found. Sep 08 10:46:17.583803 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '3e6be670-294f-417f-a909-57c481faaf40'} Sep 08 10:46:17.583803 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:46:17.583803 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:46:17.583803 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:46:17.583803 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:46:17.583803 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:46:17.583803 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:46:17.583803 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:46:17.583803 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:46:17.583803 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:46:17.583803 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:46:17.583803 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e6be670-294f-417f-a909-57c481faaf40 could not be found. Sep 08 10:46:17.583803 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:46:17.583803 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:46:17.583803 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:46:17.583803 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:46:17.583803 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:46:17.583803 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:46:17.583803 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:46:17.583803 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:46:17.583803 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:46:17.583803 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:46:17.583803 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:46:17.583803 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:46:17.583803 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:46:17.583803 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:46:17.583803 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:46:17.583803 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:46:17.583803 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e6be670-294f-417f-a909-57c481faaf40 could not be found. Sep 08 10:46:17.583803 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:46:17.583803 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:46:17.583803 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:46:17.589279 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:46:17.589279 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:46:17.589279 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:46:17.589279 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:46:17.589279 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:46:17.589279 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e6be670-294f-417f-a909-57c481faaf40 could not be found. Sep 08 10:46:17.589279 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:46:17.589279 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e3e0d2d7-c6d4-425e-8083-82796642dc60 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Returning 404 to user: Instance 3e6be670-294f-417f-a909-57c481faaf40 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:46:17.590022 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e3e0d2d7-c6d4-425e-8083-82796642dc60 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "GET /compute/v2.1/servers/3e6be670-294f-417f-a909-57c481faaf40" status: 404 len: 111 microversion: 2.1 time: 0.168070 Sep 08 10:46:17.590164 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1025/2048] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:17 2022] GET /compute/v2.1/servers/3e6be670-294f-417f-a909-57c481faaf40 => generated 111 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:46:17.607796 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9243f630-f21d-4e9f-b7fb-7a19b8309a95 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '.version_select at 0x7f68e895b5e0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:18.088726 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9243f630-f21d-4e9f-b7fb-7a19b8309a95 tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "DELETE /compute/v2.1/images/ed56d622-7fec-4a54-9346-fb3684f044f6" status: 204 len: 0 microversion: 2.1 time: 0.493869 Sep 08 10:46:18.092294 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1026/2049] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:17 2022] DELETE /compute/v2.1/images/ed56d622-7fec-4a54-9346-fb3684f044f6 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:46:18.098986 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-665cfe01-3092-45ee-8a19-51771de4bf40 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:18.099621 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-665cfe01-3092-45ee-8a19-51771de4bf40 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: eca1ed67-f21d-46e3-8557-014bc6b63953] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:18.128024 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-665cfe01-3092-45ee-8a19-51771de4bf40 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:18.128846 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-665cfe01-3092-45ee-8a19-51771de4bf40 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:18.129500 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-665cfe01-3092-45ee-8a19-51771de4bf40 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:18.130405 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-665cfe01-3092-45ee-8a19-51771de4bf40 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:18.131044 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-665cfe01-3092-45ee-8a19-51771de4bf40 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:18.132167 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-665cfe01-3092-45ee-8a19-51771de4bf40 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:18.377387 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-665cfe01-3092-45ee-8a19-51771de4bf40 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:18.394211 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-665cfe01-3092-45ee-8a19-51771de4bf40 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/eca1ed67-f21d-46e3-8557-014bc6b63953" status: 200 len: 1283 microversion: 2.1 time: 0.300699 Sep 08 10:46:18.394959 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1027/2050] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:18 2022] GET /compute/v2.1/servers/eca1ed67-f21d-46e3-8557-014bc6b63953 => generated 1283 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:18.405501 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a4f57da8-252b-48bd-bc6f-bb008183573f tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '.version_select at 0x7f68e8a1fa60>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:18.786442 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a4f57da8-252b-48bd-bc6f-bb008183573f tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "DELETE /compute/v2.1/images/c2b844c1-5006-4cd0-a338-c22c553491a1" status: 204 len: 0 microversion: 2.1 time: 0.389995 Sep 08 10:46:18.787422 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1028/2051] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:18 2022] DELETE /compute/v2.1/images/c2b844c1-5006-4cd0-a338-c22c553491a1 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:46:18.795207 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e1b4f20e-c440-4d6c-b32c-fe3231ce9c62 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:18.801210 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e1b4f20e-c440-4d6c-b32c-fe3231ce9c62 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] [instance: 72eb7387-3f16-4b4f-ab9a-89076f169fc1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:18.823417 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e1b4f20e-c440-4d6c-b32c-fe3231ce9c62 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:18.825293 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e1b4f20e-c440-4d6c-b32c-fe3231ce9c62 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:18.825982 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e1b4f20e-c440-4d6c-b32c-fe3231ce9c62 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:18.829178 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e1b4f20e-c440-4d6c-b32c-fe3231ce9c62 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:18.832551 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e1b4f20e-c440-4d6c-b32c-fe3231ce9c62 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:18.833091 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e1b4f20e-c440-4d6c-b32c-fe3231ce9c62 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:18.838945 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a0c19d38-b733-40d5-92f5-7fbe946b31bc tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:18.858882 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a0c19d38-b733-40d5-92f5-7fbe946b31bc tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/7d251638-b28f-4137-a81a-ce1a21cd7418" status: 200 len: 1308 microversion: 2.1 time: 1.434258 Sep 08 10:46:18.865923 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1024/2052] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:17 2022] GET /compute/v2.1/servers/7d251638-b28f-4137-a81a-ce1a21cd7418 => generated 1308 bytes in 1453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:18.887669 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-628c6e69-3430-4b7b-8459-3c6a8fe46151 req-6d1b8740-01f6-4001-a05b-a71c16765e25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72eb7387-3f16-4b4f-ab9a-89076f169fc1", "tag": "64d36b81-597c-4cd5-8290-49272ddcb61d"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:46:18.916382 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-628c6e69-3430-4b7b-8459-3c6a8fe46151 req-6d1b8740-01f6-4001-a05b-a71c16765e25 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:18.917486 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-628c6e69-3430-4b7b-8459-3c6a8fe46151 req-6d1b8740-01f6-4001-a05b-a71c16765e25 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:18.918531 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-628c6e69-3430-4b7b-8459-3c6a8fe46151 req-6d1b8740-01f6-4001-a05b-a71c16765e25 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:18.951248 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-628c6e69-3430-4b7b-8459-3c6a8fe46151 req-6d1b8740-01f6-4001-a05b-a71c16765e25 service nova] Creating event network-changed:64d36b81-597c-4cd5-8290-49272ddcb61d for instance 72eb7387-3f16-4b4f-ab9a-89076f169fc1 on n-h1-850501-12 Sep 08 10:46:18.965291 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-628c6e69-3430-4b7b-8459-3c6a8fe46151 req-6d1b8740-01f6-4001-a05b-a71c16765e25 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097043 Sep 08 10:46:18.968161 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1025/2053] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:46:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:46:18.979387 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b34ec87e-b2a2-428e-884e-bd75ad56ed76 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:18.980983 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b34ec87e-b2a2-428e-884e-bd75ad56ed76 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: e84298ea-b5e7-473b-8597-2b469d09023e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:18.992883 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b34ec87e-b2a2-428e-884e-bd75ad56ed76 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:18.994255 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b34ec87e-b2a2-428e-884e-bd75ad56ed76 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:18.998262 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b34ec87e-b2a2-428e-884e-bd75ad56ed76 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:18.999870 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b34ec87e-b2a2-428e-884e-bd75ad56ed76 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:19.000790 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b34ec87e-b2a2-428e-884e-bd75ad56ed76 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:19.002058 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b34ec87e-b2a2-428e-884e-bd75ad56ed76 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:19.311095 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b34ec87e-b2a2-428e-884e-bd75ad56ed76 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:19.334095 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b34ec87e-b2a2-428e-884e-bd75ad56ed76 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/e84298ea-b5e7-473b-8597-2b469d09023e" status: 200 len: 1313 microversion: 2.1 time: 0.363867 Sep 08 10:46:19.345106 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1026/2054] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:18 2022] GET /compute/v2.1/servers/e84298ea-b5e7-473b-8597-2b469d09023e => generated 1313 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:19.345106 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4fdca50b-0b6c-4290-b56c-5202aa14d75a tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] Calling method '.version_select at 0x7f68e8a92700>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:19.836356 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4fdca50b-0b6c-4290-b56c-5202aa14d75a tempest-ListImageFiltersTestJSON-221384243 tempest-ListImageFiltersTestJSON-221384243-project] 10.222.0.27 "DELETE /compute/v2.1/images/2525acfc-1c8e-46b2-a4bd-a7c498d332fe" status: 204 len: 0 microversion: 2.1 time: 0.496760 Sep 08 10:46:19.837257 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1027/2055] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:19 2022] DELETE /compute/v2.1/images/2525acfc-1c8e-46b2-a4bd-a7c498d332fe => generated 0 bytes in 502 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:46:19.850343 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-eb214d46-94aa-40d8-8afc-9b02064f36e5 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:19.857777 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-eb214d46-94aa-40d8-8afc-9b02064f36e5 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: eca1ed67-f21d-46e3-8557-014bc6b63953] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:19.884431 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb214d46-94aa-40d8-8afc-9b02064f36e5 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:19.895314 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb214d46-94aa-40d8-8afc-9b02064f36e5 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:19.897116 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb214d46-94aa-40d8-8afc-9b02064f36e5 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:19.897116 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb214d46-94aa-40d8-8afc-9b02064f36e5 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:19.897116 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb214d46-94aa-40d8-8afc-9b02064f36e5 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:19.897653 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb214d46-94aa-40d8-8afc-9b02064f36e5 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:20.011070 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e1b4f20e-c440-4d6c-b32c-fe3231ce9c62 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ff38511b484fbcb7817a56076cf4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a768a3863448bca0c6cda11afdd955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:20.021306 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e1b4f20e-c440-4d6c-b32c-fe3231ce9c62 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] 10.222.0.27 "GET /compute/v2.1/servers/72eb7387-3f16-4b4f-ab9a-89076f169fc1" status: 200 len: 1366 microversion: 2.1 time: 1.231983 Sep 08 10:46:20.041341 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1029/2056] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:18 2022] GET /compute/v2.1/servers/72eb7387-3f16-4b4f-ab9a-89076f169fc1 => generated 1366 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:20.070633 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b665867d-7989-46e2-8057-c77340a23689 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:20.077785 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b665867d-7989-46e2-8057-c77340a23689 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 7d251638-b28f-4137-a81a-ce1a21cd7418] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:20.100388 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b665867d-7989-46e2-8057-c77340a23689 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:20.101966 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b665867d-7989-46e2-8057-c77340a23689 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:20.103216 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b665867d-7989-46e2-8057-c77340a23689 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:20.106354 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b665867d-7989-46e2-8057-c77340a23689 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:20.113652 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b665867d-7989-46e2-8057-c77340a23689 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:20.114145 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b665867d-7989-46e2-8057-c77340a23689 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:20.329798 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-eb214d46-94aa-40d8-8afc-9b02064f36e5 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:20.337747 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-eb214d46-94aa-40d8-8afc-9b02064f36e5 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/eca1ed67-f21d-46e3-8557-014bc6b63953" status: 200 len: 1271 microversion: 2.1 time: 0.499367 Sep 08 10:46:20.362168 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1028/2057] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:19 2022] GET /compute/v2.1/servers/eca1ed67-f21d-46e3-8557-014bc6b63953 => generated 1271 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:20.369686 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b1e6bae0-7c61-47fb-9882-e51b334a4530 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:20.370559 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b1e6bae0-7c61-47fb-9882-e51b334a4530 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: e84298ea-b5e7-473b-8597-2b469d09023e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:20.372773 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:46:20.390325 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1e6bae0-7c61-47fb-9882-e51b334a4530 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:20.394250 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1e6bae0-7c61-47fb-9882-e51b334a4530 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:20.395471 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1e6bae0-7c61-47fb-9882-e51b334a4530 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:20.397999 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1e6bae0-7c61-47fb-9882-e51b334a4530 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:20.398736 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1e6bae0-7c61-47fb-9882-e51b334a4530 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:20.401412 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1e6bae0-7c61-47fb-9882-e51b334a4530 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:20.798728 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=26 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:46:20.820975 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b665867d-7989-46e2-8057-c77340a23689 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:20.833093 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b665867d-7989-46e2-8057-c77340a23689 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/7d251638-b28f-4137-a81a-ce1a21cd7418" status: 200 len: 1487 microversion: 2.1 time: 0.781561 Sep 08 10:46:20.843983 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1030/2058] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:20 2022] GET /compute/v2.1/servers/7d251638-b28f-4137-a81a-ce1a21cd7418 => generated 1487 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:20.868891 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-dff0f259-da56-412a-a535-c1a2de197693 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:46:20.869984 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-dff0f259-da56-412a-a535-c1a2de197693 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 7d251638-b28f-4137-a81a-ce1a21cd7418] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:20.883521 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dff0f259-da56-412a-a535-c1a2de197693 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:20.896785 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dff0f259-da56-412a-a535-c1a2de197693 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:20.904947 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dff0f259-da56-412a-a535-c1a2de197693 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:20.922576 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dff0f259-da56-412a-a535-c1a2de197693 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:20.923192 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dff0f259-da56-412a-a535-c1a2de197693 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:20.924340 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dff0f259-da56-412a-a535-c1a2de197693 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:20.991599 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-dff0f259-da56-412a-a535-c1a2de197693 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lazy-loading 'flavor' on Instance uuid 7d251638-b28f-4137-a81a-ce1a21cd7418 {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:46:21.044771 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:46:21.136827 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-dff0f259-da56-412a-a535-c1a2de197693 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "POST /compute/v2.1/servers/7d251638-b28f-4137-a81a-ce1a21cd7418/action" status: 202 len: 0 microversion: 2.1 time: 0.272058 Sep 08 10:46:21.153471 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1031/2059] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:46:20 2022] POST /compute/v2.1/servers/7d251638-b28f-4137-a81a-ce1a21cd7418/action => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 10:46:21.164295 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b1e6bae0-7c61-47fb-9882-e51b334a4530 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:21.192919 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b1e6bae0-7c61-47fb-9882-e51b334a4530 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/e84298ea-b5e7-473b-8597-2b469d09023e" status: 200 len: 1313 microversion: 2.1 time: 0.827250 Sep 08 10:46:21.209519 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1029/2060] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:20 2022] GET /compute/v2.1/servers/e84298ea-b5e7-473b-8597-2b469d09023e => generated 1313 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:21.242807 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5c72c12c-9415-44dd-9f29-769b28a30994 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:21.249566 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5c72c12c-9415-44dd-9f29-769b28a30994 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] [instance: 72eb7387-3f16-4b4f-ab9a-89076f169fc1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:21.261152 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c72c12c-9415-44dd-9f29-769b28a30994 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:21.264453 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c72c12c-9415-44dd-9f29-769b28a30994 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:21.265501 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c72c12c-9415-44dd-9f29-769b28a30994 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:21.269371 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c72c12c-9415-44dd-9f29-769b28a30994 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:21.282123 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c72c12c-9415-44dd-9f29-769b28a30994 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:21.282123 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c72c12c-9415-44dd-9f29-769b28a30994 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:21.600114 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7788182f-386c-43ca-8a34-0502ebd5b061 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Action: 'create', calling method: .version_select at 0x7f68e896e280>, body: {"keypair": {"name": "tempest-keypair-838495828", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL5nQSyz4jNiWOjfWbY+dVjkwb6xDflZgkD+Xl/uMqxvqM0PLf2EOiKXN69jrSPMTn7Ez5OuOGUzrd0IGV0yH6yb2dDiRYOfgVg4rlt8S8/3PqpipLA9JDZbINxhSswEHw=="}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:46:21.638713 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-7788182f-386c-43ca-8a34-0502ebd5b061 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Getting quotas for project 20f9a24cad014d7f827e8f3236dd5bae. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:46:21.654762 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-7788182f-386c-43ca-8a34-0502ebd5b061 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Getting quotas for user 5c291cbe955b4ee5abc98132dda0255e and project 20f9a24cad014d7f827e8f3236dd5bae. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:46:21.710179 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7788182f-386c-43ca-8a34-0502ebd5b061 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.555818 Sep 08 10:46:21.711327 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1032/2061] 10.222.0.27 () {60 vars in 1159 bytes} [Thu Sep 8 10:46:21 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:46:21.725130 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-417b3e27-3bd4-4de1-ae6f-6c66a91ae3b1 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:21.726225 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-417b3e27-3bd4-4de1-ae6f-6c66a91ae3b1 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 7d251638-b28f-4137-a81a-ce1a21cd7418] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:21.743655 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-417b3e27-3bd4-4de1-ae6f-6c66a91ae3b1 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:21.747427 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-417b3e27-3bd4-4de1-ae6f-6c66a91ae3b1 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:21.748249 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-417b3e27-3bd4-4de1-ae6f-6c66a91ae3b1 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:21.797398 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-417b3e27-3bd4-4de1-ae6f-6c66a91ae3b1 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:21.802506 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-417b3e27-3bd4-4de1-ae6f-6c66a91ae3b1 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.050s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:21.804796 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-417b3e27-3bd4-4de1-ae6f-6c66a91ae3b1 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:22.129861 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5c72c12c-9415-44dd-9f29-769b28a30994 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ff38511b484fbcb7817a56076cf4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a768a3863448bca0c6cda11afdd955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:22.150688 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5c72c12c-9415-44dd-9f29-769b28a30994 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] 10.222.0.27 "GET /compute/v2.1/servers/72eb7387-3f16-4b4f-ab9a-89076f169fc1" status: 200 len: 1366 microversion: 2.1 time: 0.928216 Sep 08 10:46:22.159587 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1030/2062] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:21 2022] GET /compute/v2.1/servers/72eb7387-3f16-4b4f-ab9a-89076f169fc1 => generated 1366 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:22.164820 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cee27f17-1c39-48cc-ae43-e045ebf64c3e tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:22.175869 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cee27f17-1c39-48cc-ae43-e045ebf64c3e tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: eca1ed67-f21d-46e3-8557-014bc6b63953] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:22.203411 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cee27f17-1c39-48cc-ae43-e045ebf64c3e tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:22.205726 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cee27f17-1c39-48cc-ae43-e045ebf64c3e tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:22.206183 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cee27f17-1c39-48cc-ae43-e045ebf64c3e tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:22.220357 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cee27f17-1c39-48cc-ae43-e045ebf64c3e tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:22.221810 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cee27f17-1c39-48cc-ae43-e045ebf64c3e tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:22.222982 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cee27f17-1c39-48cc-ae43-e045ebf64c3e tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:22.902975 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cee27f17-1c39-48cc-ae43-e045ebf64c3e tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:22.915798 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cee27f17-1c39-48cc-ae43-e045ebf64c3e tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/eca1ed67-f21d-46e3-8557-014bc6b63953" status: 200 len: 1313 microversion: 2.1 time: 0.754774 Sep 08 10:46:22.918815 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1031/2063] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:22 2022] GET /compute/v2.1/servers/eca1ed67-f21d-46e3-8557-014bc6b63953 => generated 1313 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:22.926885 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-35d04517-c745-4e8f-a3d1-a139ee5a046b req-26cd74e9-be28-41fb-8ab0-a94e26e66c4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e84298ea-b5e7-473b-8597-2b469d09023e", "tag": "4cd6fa00-47a5-485c-844f-23c7cb5f2d9d"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:46:22.956750 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-35d04517-c745-4e8f-a3d1-a139ee5a046b req-26cd74e9-be28-41fb-8ab0-a94e26e66c4d service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:22.957758 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-35d04517-c745-4e8f-a3d1-a139ee5a046b req-26cd74e9-be28-41fb-8ab0-a94e26e66c4d service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:22.958649 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-35d04517-c745-4e8f-a3d1-a139ee5a046b req-26cd74e9-be28-41fb-8ab0-a94e26e66c4d service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:22.988010 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-35d04517-c745-4e8f-a3d1-a139ee5a046b req-26cd74e9-be28-41fb-8ab0-a94e26e66c4d service nova] Creating event network-changed:4cd6fa00-47a5-485c-844f-23c7cb5f2d9d for instance e84298ea-b5e7-473b-8597-2b469d09023e on n-h2-850501-12 Sep 08 10:46:23.014252 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-35d04517-c745-4e8f-a3d1-a139ee5a046b req-26cd74e9-be28-41fb-8ab0-a94e26e66c4d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076686 Sep 08 10:46:23.016102 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1032/2064] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:46:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:46:23.032665 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e9d63637-9006-472f-a19b-0fd1baeb32ac tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:23.051385 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e9d63637-9006-472f-a19b-0fd1baeb32ac tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: e84298ea-b5e7-473b-8597-2b469d09023e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:23.060825 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:46:23.084447 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9d63637-9006-472f-a19b-0fd1baeb32ac tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:23.085064 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9d63637-9006-472f-a19b-0fd1baeb32ac tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:23.085670 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9d63637-9006-472f-a19b-0fd1baeb32ac tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:23.086437 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9d63637-9006-472f-a19b-0fd1baeb32ac tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:23.086900 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9d63637-9006-472f-a19b-0fd1baeb32ac tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:23.087334 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9d63637-9006-472f-a19b-0fd1baeb32ac tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:23.144986 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-417b3e27-3bd4-4de1-ae6f-6c66a91ae3b1 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:23.154606 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:46:23.160214 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-417b3e27-3bd4-4de1-ae6f-6c66a91ae3b1 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/7d251638-b28f-4137-a81a-ce1a21cd7418" status: 200 len: 1478 microversion: 2.1 time: 1.443565 Sep 08 10:46:23.161629 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1033/2065] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:21 2022] GET /compute/v2.1/servers/7d251638-b28f-4137-a81a-ce1a21cd7418 => generated 1478 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:23.184461 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1f390240-bada-4016-9e2f-0bcb68e7e2fc tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:23.185332 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1f390240-bada-4016-9e2f-0bcb68e7e2fc tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] [instance: 72eb7387-3f16-4b4f-ab9a-89076f169fc1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:23.200838 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1f390240-bada-4016-9e2f-0bcb68e7e2fc tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:23.201499 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1f390240-bada-4016-9e2f-0bcb68e7e2fc tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:23.202302 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1f390240-bada-4016-9e2f-0bcb68e7e2fc tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:23.205818 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1f390240-bada-4016-9e2f-0bcb68e7e2fc tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:23.206443 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1f390240-bada-4016-9e2f-0bcb68e7e2fc tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:23.210301 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1f390240-bada-4016-9e2f-0bcb68e7e2fc tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:23.737673 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1f390240-bada-4016-9e2f-0bcb68e7e2fc tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ff38511b484fbcb7817a56076cf4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a768a3863448bca0c6cda11afdd955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:23.747220 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1f390240-bada-4016-9e2f-0bcb68e7e2fc tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] 10.222.0.27 "GET /compute/v2.1/servers/72eb7387-3f16-4b4f-ab9a-89076f169fc1" status: 200 len: 1366 microversion: 2.1 time: 0.567674 Sep 08 10:46:23.749264 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e9d63637-9006-472f-a19b-0fd1baeb32ac tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:23.759269 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e9d63637-9006-472f-a19b-0fd1baeb32ac tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/e84298ea-b5e7-473b-8597-2b469d09023e" status: 200 len: 1313 microversion: 2.1 time: 0.732177 Sep 08 10:46:23.762465 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1034/2066] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:23 2022] GET /compute/v2.1/servers/72eb7387-3f16-4b4f-ab9a-89076f169fc1 => generated 1366 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:46:23.765451 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1033/2067] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:23 2022] GET /compute/v2.1/servers/e84298ea-b5e7-473b-8597-2b469d09023e => generated 1313 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:23.772428 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-05ca07f0-778a-4136-9d72-92c4567e3246 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-147758445"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:46:23.776190 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-05ca07f0-778a-4136-9d72-92c4567e3246 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 7d251638-b28f-4137-a81a-ce1a21cd7418] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:23.782534 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b7ef7af1-7a80-4502-b15c-97a87e21fa37 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:23.783090 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b7ef7af1-7a80-4502-b15c-97a87e21fa37 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 133a5f12-39e5-4e0f-81dc-b1948c073f15] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:23.784058 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-05ca07f0-778a-4136-9d72-92c4567e3246 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:23.785472 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-05ca07f0-778a-4136-9d72-92c4567e3246 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:23.786191 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-05ca07f0-778a-4136-9d72-92c4567e3246 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:23.787163 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-05ca07f0-778a-4136-9d72-92c4567e3246 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:23.787899 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-05ca07f0-778a-4136-9d72-92c4567e3246 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:23.788554 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-05ca07f0-778a-4136-9d72-92c4567e3246 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:23.800143 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b7ef7af1-7a80-4502-b15c-97a87e21fa37 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:23.801556 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b7ef7af1-7a80-4502-b15c-97a87e21fa37 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:23.802037 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b7ef7af1-7a80-4502-b15c-97a87e21fa37 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:23.802876 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b7ef7af1-7a80-4502-b15c-97a87e21fa37 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:23.803347 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b7ef7af1-7a80-4502-b15c-97a87e21fa37 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:23.803899 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b7ef7af1-7a80-4502-b15c-97a87e21fa37 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:23.880787 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b7ef7af1-7a80-4502-b15c-97a87e21fa37 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 133a5f12-39e5-4e0f-81dc-b1948c073f15] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:46:24.057850 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b7ef7af1-7a80-4502-b15c-97a87e21fa37 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "DELETE /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15" status: 204 len: 0 microversion: 2.1 time: 0.286333 Sep 08 10:46:24.087689 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1034/2068] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:46:23 2022] DELETE /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:46:24.104497 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ef5861bf-7c82-4caa-84d1-97695321ab4a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:24.109538 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ef5861bf-7c82-4caa-84d1-97695321ab4a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: eca1ed67-f21d-46e3-8557-014bc6b63953] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:24.149452 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef5861bf-7c82-4caa-84d1-97695321ab4a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:24.153260 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef5861bf-7c82-4caa-84d1-97695321ab4a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:24.158253 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef5861bf-7c82-4caa-84d1-97695321ab4a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:24.162309 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef5861bf-7c82-4caa-84d1-97695321ab4a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:24.165544 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef5861bf-7c82-4caa-84d1-97695321ab4a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:24.171631 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef5861bf-7c82-4caa-84d1-97695321ab4a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:24.307725 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-05ca07f0-778a-4136-9d72-92c4567e3246 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "POST /compute/v2.1/servers/7d251638-b28f-4137-a81a-ce1a21cd7418/action" status: 202 len: 0 microversion: 2.1 time: 0.534145 Sep 08 10:46:24.307725 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1035/2069] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:46:23 2022] POST /compute/v2.1/servers/7d251638-b28f-4137-a81a-ce1a21cd7418/action => generated 0 bytes in 540 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 08 10:46:24.316175 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5388e023-55b9-45e2-9ebe-55f07a2c52e6 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:24.317065 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5388e023-55b9-45e2-9ebe-55f07a2c52e6 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 133a5f12-39e5-4e0f-81dc-b1948c073f15] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:24.326021 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5388e023-55b9-45e2-9ebe-55f07a2c52e6 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:24.327507 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5388e023-55b9-45e2-9ebe-55f07a2c52e6 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:24.328138 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5388e023-55b9-45e2-9ebe-55f07a2c52e6 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:24.330709 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5388e023-55b9-45e2-9ebe-55f07a2c52e6 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:24.331149 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5388e023-55b9-45e2-9ebe-55f07a2c52e6 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:24.331757 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5388e023-55b9-45e2-9ebe-55f07a2c52e6 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:24.794625 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5388e023-55b9-45e2-9ebe-55f07a2c52e6 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:24.804654 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5388e023-55b9-45e2-9ebe-55f07a2c52e6 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15" status: 200 len: 1668 microversion: 2.1 time: 0.499538 Sep 08 10:46:24.805269 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1036/2070] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:24 2022] GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15 => generated 1668 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:24.817566 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9e47308e-2f43-457b-bc35-c2d0ff81a5cc tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '.version_select at 0x7f68e89b8e50>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:24.902655 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ef5861bf-7c82-4caa-84d1-97695321ab4a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:24.909614 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9e47308e-2f43-457b-bc35-c2d0ff81a5cc tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/images/28783cea-dde6-431e-a46e-b87625b47518" status: 200 len: 1439 microversion: 2.1 time: 0.103061 Sep 08 10:46:24.917790 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1037/2071] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:46:24 2022] GET /compute/v2.1/images/28783cea-dde6-431e-a46e-b87625b47518 => generated 1439 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:24.922570 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ef5861bf-7c82-4caa-84d1-97695321ab4a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/eca1ed67-f21d-46e3-8557-014bc6b63953" status: 200 len: 1313 microversion: 2.1 time: 0.833400 Sep 08 10:46:24.923154 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-17c9255a-0c81-4e28-a050-d99ee16e7145 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:24.923384 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1035/2072] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:24 2022] GET /compute/v2.1/servers/eca1ed67-f21d-46e3-8557-014bc6b63953 => generated 1313 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:24.925355 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-17c9255a-0c81-4e28-a050-d99ee16e7145 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] [instance: 72eb7387-3f16-4b4f-ab9a-89076f169fc1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:24.938489 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-17c9255a-0c81-4e28-a050-d99ee16e7145 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:24.940124 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-17c9255a-0c81-4e28-a050-d99ee16e7145 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:24.940679 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-17c9255a-0c81-4e28-a050-d99ee16e7145 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:24.941621 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-17c9255a-0c81-4e28-a050-d99ee16e7145 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:24.942197 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-17c9255a-0c81-4e28-a050-d99ee16e7145 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:24.942747 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-17c9255a-0c81-4e28-a050-d99ee16e7145 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:24.951906 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-51cb7222-e955-40f7-a29e-a9a24e104cd4 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:24.952542 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-51cb7222-e955-40f7-a29e-a9a24e104cd4 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: e84298ea-b5e7-473b-8597-2b469d09023e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:24.975598 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:46:24.991817 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51cb7222-e955-40f7-a29e-a9a24e104cd4 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:24.992338 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51cb7222-e955-40f7-a29e-a9a24e104cd4 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:24.992786 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51cb7222-e955-40f7-a29e-a9a24e104cd4 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:25.011405 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51cb7222-e955-40f7-a29e-a9a24e104cd4 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:25.015189 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51cb7222-e955-40f7-a29e-a9a24e104cd4 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:25.015824 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51cb7222-e955-40f7-a29e-a9a24e104cd4 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:25.323888 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-17c9255a-0c81-4e28-a050-d99ee16e7145 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ff38511b484fbcb7817a56076cf4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a768a3863448bca0c6cda11afdd955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:25.343853 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-17c9255a-0c81-4e28-a050-d99ee16e7145 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] 10.222.0.27 "GET /compute/v2.1/servers/72eb7387-3f16-4b4f-ab9a-89076f169fc1" status: 200 len: 1366 microversion: 2.1 time: 0.431174 Sep 08 10:46:25.349587 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1038/2073] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:24 2022] GET /compute/v2.1/servers/72eb7387-3f16-4b4f-ab9a-89076f169fc1 => generated 1366 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:25.830386 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-25729cc3-bb48-4ade-933d-b054d6b61153 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:25.831138 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-25729cc3-bb48-4ade-933d-b054d6b61153 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 133a5f12-39e5-4e0f-81dc-b1948c073f15] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:25.845669 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-25729cc3-bb48-4ade-933d-b054d6b61153 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:25.846421 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-25729cc3-bb48-4ade-933d-b054d6b61153 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:25.847098 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-25729cc3-bb48-4ade-933d-b054d6b61153 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:25.848038 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-25729cc3-bb48-4ade-933d-b054d6b61153 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:25.848761 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-25729cc3-bb48-4ade-933d-b054d6b61153 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:25.849398 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-25729cc3-bb48-4ade-933d-b054d6b61153 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:26.255268 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-25729cc3-bb48-4ade-933d-b054d6b61153 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:26.278367 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-51cb7222-e955-40f7-a29e-a9a24e104cd4 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:26.281471 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-25729cc3-bb48-4ade-933d-b054d6b61153 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15" status: 200 len: 1668 microversion: 2.1 time: 0.455690 Sep 08 10:46:26.292922 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-51cb7222-e955-40f7-a29e-a9a24e104cd4 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/e84298ea-b5e7-473b-8597-2b469d09023e" status: 200 len: 1313 microversion: 2.1 time: 1.346449 Sep 08 10:46:26.305800 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1039/2074] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:25 2022] GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15 => generated 1668 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:26.313777 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-358c48ff-5330-407a-9568-9676126ca0e0 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '.version_select at 0x7f68e8a439d0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:26.339713 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1036/2075] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:24 2022] GET /compute/v2.1/servers/e84298ea-b5e7-473b-8597-2b469d09023e => generated 1313 bytes in 1416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:26.351673 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3c8fd23c-205a-49da-bd4d-c291bc6dfd2f tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:26.352887 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3c8fd23c-205a-49da-bd4d-c291bc6dfd2f tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: eca1ed67-f21d-46e3-8557-014bc6b63953] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:26.363714 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c8fd23c-205a-49da-bd4d-c291bc6dfd2f tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:26.364827 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c8fd23c-205a-49da-bd4d-c291bc6dfd2f tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:26.366220 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c8fd23c-205a-49da-bd4d-c291bc6dfd2f tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:26.368872 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c8fd23c-205a-49da-bd4d-c291bc6dfd2f tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:26.369860 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c8fd23c-205a-49da-bd4d-c291bc6dfd2f tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:26.370802 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c8fd23c-205a-49da-bd4d-c291bc6dfd2f tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:26.391323 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-358c48ff-5330-407a-9568-9676126ca0e0 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/images/28783cea-dde6-431e-a46e-b87625b47518" status: 200 len: 1439 microversion: 2.1 time: 0.085744 Sep 08 10:46:26.392411 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1040/2076] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:46:26 2022] GET /compute/v2.1/images/28783cea-dde6-431e-a46e-b87625b47518 => generated 1439 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:26.401507 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9b0fc312-a62e-4b3a-b551-9ddbfc3ea6f3 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:26.402624 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9b0fc312-a62e-4b3a-b551-9ddbfc3ea6f3 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] [instance: 72eb7387-3f16-4b4f-ab9a-89076f169fc1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:26.426994 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9b0fc312-a62e-4b3a-b551-9ddbfc3ea6f3 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:26.428010 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9b0fc312-a62e-4b3a-b551-9ddbfc3ea6f3 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:26.428642 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9b0fc312-a62e-4b3a-b551-9ddbfc3ea6f3 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:26.429592 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9b0fc312-a62e-4b3a-b551-9ddbfc3ea6f3 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:26.430944 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9b0fc312-a62e-4b3a-b551-9ddbfc3ea6f3 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:26.431553 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9b0fc312-a62e-4b3a-b551-9ddbfc3ea6f3 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:26.842403 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9b0fc312-a62e-4b3a-b551-9ddbfc3ea6f3 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ff38511b484fbcb7817a56076cf4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a768a3863448bca0c6cda11afdd955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:26.857730 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9b0fc312-a62e-4b3a-b551-9ddbfc3ea6f3 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] 10.222.0.27 "GET /compute/v2.1/servers/72eb7387-3f16-4b4f-ab9a-89076f169fc1" status: 200 len: 1366 microversion: 2.1 time: 0.462932 Sep 08 10:46:26.860877 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1041/2077] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:26 2022] GET /compute/v2.1/servers/72eb7387-3f16-4b4f-ab9a-89076f169fc1 => generated 1366 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:26.869785 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-f5da7130-f551-4f5c-8fe2-cf3a5977bca2 req-4453e0af-436d-434d-9999-08df04696227 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eca1ed67-f21d-46e3-8557-014bc6b63953", "tag": "63cb3c01-9673-46f6-8e43-73cf71b3f687"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:46:26.879601 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-f5da7130-f551-4f5c-8fe2-cf3a5977bca2 req-4453e0af-436d-434d-9999-08df04696227 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:26.880149 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-f5da7130-f551-4f5c-8fe2-cf3a5977bca2 req-4453e0af-436d-434d-9999-08df04696227 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:26.880573 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-f5da7130-f551-4f5c-8fe2-cf3a5977bca2 req-4453e0af-436d-434d-9999-08df04696227 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:26.895243 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-f5da7130-f551-4f5c-8fe2-cf3a5977bca2 req-4453e0af-436d-434d-9999-08df04696227 service nova] Creating event network-changed:63cb3c01-9673-46f6-8e43-73cf71b3f687 for instance eca1ed67-f21d-46e3-8557-014bc6b63953 on n-h1-850501-12 Sep 08 10:46:26.902707 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-f5da7130-f551-4f5c-8fe2-cf3a5977bca2 req-4453e0af-436d-434d-9999-08df04696227 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039530 Sep 08 10:46:26.903332 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1042/2078] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:46:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:46:27.052858 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3c8fd23c-205a-49da-bd4d-c291bc6dfd2f tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:27.062920 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3c8fd23c-205a-49da-bd4d-c291bc6dfd2f tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/eca1ed67-f21d-46e3-8557-014bc6b63953" status: 200 len: 1313 microversion: 2.1 time: 0.720426 Sep 08 10:46:27.090715 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1037/2079] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:26 2022] GET /compute/v2.1/servers/eca1ed67-f21d-46e3-8557-014bc6b63953 => generated 1313 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:27.244714 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-8c779695-3d8f-46a2-807d-6d21b97bd1d6 req-cefc9526-9258-4894-85cd-30f091f1daf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72eb7387-3f16-4b4f-ab9a-89076f169fc1", "name": "network-vif-plugged", "status": "completed", "tag": "64d36b81-597c-4cd5-8290-49272ddcb61d"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:46:27.265540 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-8c779695-3d8f-46a2-807d-6d21b97bd1d6 req-cefc9526-9258-4894-85cd-30f091f1daf7 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:27.266231 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-8c779695-3d8f-46a2-807d-6d21b97bd1d6 req-cefc9526-9258-4894-85cd-30f091f1daf7 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:27.266904 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-8c779695-3d8f-46a2-807d-6d21b97bd1d6 req-cefc9526-9258-4894-85cd-30f091f1daf7 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:27.287144 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-8c779695-3d8f-46a2-807d-6d21b97bd1d6 req-cefc9526-9258-4894-85cd-30f091f1daf7 service nova] Creating event network-vif-plugged:64d36b81-597c-4cd5-8290-49272ddcb61d for instance 72eb7387-3f16-4b4f-ab9a-89076f169fc1 on n-h1-850501-12 Sep 08 10:46:27.294343 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-8c779695-3d8f-46a2-807d-6d21b97bd1d6 req-cefc9526-9258-4894-85cd-30f091f1daf7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054156 Sep 08 10:46:27.295502 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1043/2080] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:46:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Sep 08 10:46:27.317364 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ffaf1486-17ee-4821-90fd-00fc6f5e5241 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:27.319604 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ffaf1486-17ee-4821-90fd-00fc6f5e5241 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 133a5f12-39e5-4e0f-81dc-b1948c073f15] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:27.329207 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1365f3f2-98ae-4598-a465-13495bf811b7 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:27.333149 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ffaf1486-17ee-4821-90fd-00fc6f5e5241 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:27.333974 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1365f3f2-98ae-4598-a465-13495bf811b7 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: e84298ea-b5e7-473b-8597-2b469d09023e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:27.336071 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ffaf1486-17ee-4821-90fd-00fc6f5e5241 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:27.336835 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ffaf1486-17ee-4821-90fd-00fc6f5e5241 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:27.341042 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ffaf1486-17ee-4821-90fd-00fc6f5e5241 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:27.341562 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ffaf1486-17ee-4821-90fd-00fc6f5e5241 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:27.342014 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ffaf1486-17ee-4821-90fd-00fc6f5e5241 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:27.358426 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1365f3f2-98ae-4598-a465-13495bf811b7 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:27.361583 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1365f3f2-98ae-4598-a465-13495bf811b7 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:27.362152 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1365f3f2-98ae-4598-a465-13495bf811b7 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:27.365508 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1365f3f2-98ae-4598-a465-13495bf811b7 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:27.367227 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1365f3f2-98ae-4598-a465-13495bf811b7 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:27.372659 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1365f3f2-98ae-4598-a465-13495bf811b7 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:27.979454 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ffaf1486-17ee-4821-90fd-00fc6f5e5241 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:27.989078 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ffaf1486-17ee-4821-90fd-00fc6f5e5241 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15" status: 200 len: 1668 microversion: 2.1 time: 0.685111 Sep 08 10:46:27.994889 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1038/2081] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:27 2022] GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15 => generated 1668 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:28.001108 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ebe9f4ac-7a1e-4898-9b25-9a85c485395c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1897264067", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "93bd2ec4-37bd-4a29-88fa-5a2d674d25ec"}], "security_groups": [{"name": "tempest-securitygroup--304897071"}], "key_name": "tempest-keypair-838495828", "user_data": "}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:46:28.364132 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-ebe9f4ac-7a1e-4898-9b25-9a85c485395c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] validate_networks() for [('93bd2ec4-37bd-4a29-88fa-5a2d674d25ec', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:46:28.544494 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1365f3f2-98ae-4598-a465-13495bf811b7 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:28.574077 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1365f3f2-98ae-4598-a465-13495bf811b7 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/e84298ea-b5e7-473b-8597-2b469d09023e" status: 200 len: 1313 microversion: 2.1 time: 1.247806 Sep 08 10:46:28.577431 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1044/2082] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:27 2022] GET /compute/v2.1/servers/e84298ea-b5e7-473b-8597-2b469d09023e => generated 1313 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:28.597095 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2d80c41b-2d15-4a62-b690-b947c70e83b2 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '.version_select at 0x7f68e8984310>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:28.708612 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2d80c41b-2d15-4a62-b690-b947c70e83b2 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/images/28783cea-dde6-431e-a46e-b87625b47518" status: 200 len: 1439 microversion: 2.1 time: 0.127734 Sep 08 10:46:28.719755 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1045/2083] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:46:28 2022] GET /compute/v2.1/images/28783cea-dde6-431e-a46e-b87625b47518 => generated 1439 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:28.738033 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-002bb7c5-a778-4bde-9e27-ea6f37afb79c tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:28.740641 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-002bb7c5-a778-4bde-9e27-ea6f37afb79c tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] [instance: 72eb7387-3f16-4b4f-ab9a-89076f169fc1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:28.759613 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-002bb7c5-a778-4bde-9e27-ea6f37afb79c tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:28.760306 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-002bb7c5-a778-4bde-9e27-ea6f37afb79c tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:28.763837 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-002bb7c5-a778-4bde-9e27-ea6f37afb79c tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:28.764895 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-002bb7c5-a778-4bde-9e27-ea6f37afb79c tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:28.765657 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-002bb7c5-a778-4bde-9e27-ea6f37afb79c tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:28.766426 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-002bb7c5-a778-4bde-9e27-ea6f37afb79c tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:29.613552 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-002bb7c5-a778-4bde-9e27-ea6f37afb79c tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ff38511b484fbcb7817a56076cf4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a768a3863448bca0c6cda11afdd955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:29.628759 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-002bb7c5-a778-4bde-9e27-ea6f37afb79c tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] 10.222.0.27 "GET /compute/v2.1/servers/72eb7387-3f16-4b4f-ab9a-89076f169fc1" status: 200 len: 1366 microversion: 2.1 time: 0.906442 Sep 08 10:46:29.633427 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1046/2084] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:28 2022] GET /compute/v2.1/servers/72eb7387-3f16-4b4f-ab9a-89076f169fc1 => generated 1366 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:29.648636 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e0ada454-1583-4ae4-8808-96984d970aba tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:29.649744 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e0ada454-1583-4ae4-8808-96984d970aba tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: eca1ed67-f21d-46e3-8557-014bc6b63953] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:29.671657 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e0ada454-1583-4ae4-8808-96984d970aba tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:29.672560 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e0ada454-1583-4ae4-8808-96984d970aba tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:29.673940 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e0ada454-1583-4ae4-8808-96984d970aba tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:29.675300 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e0ada454-1583-4ae4-8808-96984d970aba tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:29.676183 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e0ada454-1583-4ae4-8808-96984d970aba tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:29.676859 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e0ada454-1583-4ae4-8808-96984d970aba tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:29.989580 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e0ada454-1583-4ae4-8808-96984d970aba tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:30.006540 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e0ada454-1583-4ae4-8808-96984d970aba tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/eca1ed67-f21d-46e3-8557-014bc6b63953" status: 200 len: 1313 microversion: 2.1 time: 0.371732 Sep 08 10:46:30.013855 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1047/2085] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:29 2022] GET /compute/v2.1/servers/eca1ed67-f21d-46e3-8557-014bc6b63953 => generated 1313 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:30.022774 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4a6e2632-f267-4588-8be2-cb53d6d1888f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:30.030758 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4a6e2632-f267-4588-8be2-cb53d6d1888f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 133a5f12-39e5-4e0f-81dc-b1948c073f15] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:30.052829 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a6e2632-f267-4588-8be2-cb53d6d1888f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:30.056127 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a6e2632-f267-4588-8be2-cb53d6d1888f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:30.057736 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a6e2632-f267-4588-8be2-cb53d6d1888f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:30.063473 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a6e2632-f267-4588-8be2-cb53d6d1888f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:30.068254 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a6e2632-f267-4588-8be2-cb53d6d1888f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:30.072460 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a6e2632-f267-4588-8be2-cb53d6d1888f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:30.219579 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-ebe9f4ac-7a1e-4898-9b25-9a85c485395c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:46:30.220442 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-ebe9f4ac-7a1e-4898-9b25-9a85c485395c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:46:30.220876 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-ebe9f4ac-7a1e-4898-9b25-9a85c485395c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:46:30.221467 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-ebe9f4ac-7a1e-4898-9b25-9a85c485395c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:46:30.222322 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-ebe9f4ac-7a1e-4898-9b25-9a85c485395c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:46:30.260380 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ebe9f4ac-7a1e-4898-9b25-9a85c485395c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:30.260895 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ebe9f4ac-7a1e-4898-9b25-9a85c485395c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:30.261373 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ebe9f4ac-7a1e-4898-9b25-9a85c485395c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:30.262898 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a6e2632-f267-4588-8be2-cb53d6d1888f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:30.270553 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ebe9f4ac-7a1e-4898-9b25-9a85c485395c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:30.271129 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a6e2632-f267-4588-8be2-cb53d6d1888f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:30.273331 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ebe9f4ac-7a1e-4898-9b25-9a85c485395c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:30.274122 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ebe9f4ac-7a1e-4898-9b25-9a85c485395c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:30.274928 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a6e2632-f267-4588-8be2-cb53d6d1888f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:30.284610 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-4a6e2632-f267-4588-8be2-cb53d6d1888f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lazy-loading 'fault' on Instance uuid 133a5f12-39e5-4e0f-81dc-b1948c073f15 {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:46:30.340232 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-ebe9f4ac-7a1e-4898-9b25-9a85c485395c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Getting quotas for project 20f9a24cad014d7f827e8f3236dd5bae. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:46:30.359511 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-ebe9f4ac-7a1e-4898-9b25-9a85c485395c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Getting quotas for user 5c291cbe955b4ee5abc98132dda0255e and project 20f9a24cad014d7f827e8f3236dd5bae. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:46:30.434446 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4a6e2632-f267-4588-8be2-cb53d6d1888f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:30.434863 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ebe9f4ac-7a1e-4898-9b25-9a85c485395c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:46:30.446536 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4a6e2632-f267-4588-8be2-cb53d6d1888f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15" status: 200 len: 1325 microversion: 2.1 time: 0.427561 Sep 08 10:46:30.447406 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1048/2086] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:30 2022] GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15 => generated 1325 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:30.462021 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-9ba68fac-a8e4-4330-a916-2f37fabb0cc8 req-25296512-4247-41eb-b7e2-30ebdfaea2e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "133a5f12-39e5-4e0f-81dc-b1948c073f15", "name": "network-vif-deleted", "tag": "f7bbb779-b8ca-4ca2-b84e-e3203ed8de69"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:46:30.464262 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ebe9f4ac-7a1e-4898-9b25-9a85c485395c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: bace4c1a-2c38-42b3-962d-ca87a3bfb7ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:46:30.492699 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:46:30.507925 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-9ba68fac-a8e4-4330-a916-2f37fabb0cc8 req-25296512-4247-41eb-b7e2-30ebdfaea2e3 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:30.512704 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-9ba68fac-a8e4-4330-a916-2f37fabb0cc8 req-25296512-4247-41eb-b7e2-30ebdfaea2e3 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:30.513405 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-9ba68fac-a8e4-4330-a916-2f37fabb0cc8 req-25296512-4247-41eb-b7e2-30ebdfaea2e3 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:30.552389 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-9ba68fac-a8e4-4330-a916-2f37fabb0cc8 req-25296512-4247-41eb-b7e2-30ebdfaea2e3 service nova] Creating event network-vif-deleted:f7bbb779-b8ca-4ca2-b84e-e3203ed8de69 for instance 133a5f12-39e5-4e0f-81dc-b1948c073f15 on n-h1-850501-12 Sep 08 10:46:30.600013 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-9ba68fac-a8e4-4330-a916-2f37fabb0cc8 req-25296512-4247-41eb-b7e2-30ebdfaea2e3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125098 Sep 08 10:46:30.602574 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1049/2087] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:46:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:46:30.632624 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ebe9f4ac-7a1e-4898-9b25-9a85c485395c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.635873 Sep 08 10:46:30.641119 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1039/2088] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:46:27 2022] POST /compute/v2.1/servers => generated 401 bytes in 2645 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:46:30.674066 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1b843f21-d5bf-44ca-b328-262ad85d49a0 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '.version_select at 0x7f68e8ae7550>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:30.696388 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5505f57a-c9c8-4e1a-ade1-0074a8f506c6 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:30.718889 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5505f57a-c9c8-4e1a-ade1-0074a8f506c6 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: e84298ea-b5e7-473b-8597-2b469d09023e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:30.768062 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5505f57a-c9c8-4e1a-ade1-0074a8f506c6 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:30.770218 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5505f57a-c9c8-4e1a-ade1-0074a8f506c6 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:30.776927 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5505f57a-c9c8-4e1a-ade1-0074a8f506c6 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:30.787697 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5505f57a-c9c8-4e1a-ade1-0074a8f506c6 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:30.789072 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5505f57a-c9c8-4e1a-ade1-0074a8f506c6 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:30.799546 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5505f57a-c9c8-4e1a-ade1-0074a8f506c6 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:30.834786 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1b843f21-d5bf-44ca-b328-262ad85d49a0 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/images/28783cea-dde6-431e-a46e-b87625b47518" status: 200 len: 1439 microversion: 2.1 time: 0.191370 Sep 08 10:46:30.844741 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1040/2089] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:46:30 2022] GET /compute/v2.1/images/28783cea-dde6-431e-a46e-b87625b47518 => generated 1439 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:30.856667 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b7425f0c-8ad2-4a46-89e8-1b092835c3c9 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:30.862230 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b7425f0c-8ad2-4a46-89e8-1b092835c3c9 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: bace4c1a-2c38-42b3-962d-ca87a3bfb7ba] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:30.978326 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b7425f0c-8ad2-4a46-89e8-1b092835c3c9 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c291cbe955b4ee5abc98132dda0255e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f9a24cad014d7f827e8f3236dd5bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:30.995954 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b7425f0c-8ad2-4a46-89e8-1b092835c3c9 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/bace4c1a-2c38-42b3-962d-ca87a3bfb7ba" status: 200 len: 1241 microversion: 2.1 time: 0.146548 Sep 08 10:46:31.003056 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1041/2090] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:30 2022] GET /compute/v2.1/servers/bace4c1a-2c38-42b3-962d-ca87a3bfb7ba => generated 1241 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:31.015442 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c229d523-4eed-4b27-ad6d-403c67431e23 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:31.019514 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c229d523-4eed-4b27-ad6d-403c67431e23 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] [instance: 72eb7387-3f16-4b4f-ab9a-89076f169fc1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:31.044651 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c229d523-4eed-4b27-ad6d-403c67431e23 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:31.045196 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c229d523-4eed-4b27-ad6d-403c67431e23 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:31.045641 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c229d523-4eed-4b27-ad6d-403c67431e23 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:31.046654 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c229d523-4eed-4b27-ad6d-403c67431e23 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:31.047122 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c229d523-4eed-4b27-ad6d-403c67431e23 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:31.047565 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c229d523-4eed-4b27-ad6d-403c67431e23 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:31.671106 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=10 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:46:31.957309 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c229d523-4eed-4b27-ad6d-403c67431e23 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ff38511b484fbcb7817a56076cf4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a768a3863448bca0c6cda11afdd955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:31.978224 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c229d523-4eed-4b27-ad6d-403c67431e23 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] 10.222.0.27 "GET /compute/v2.1/servers/72eb7387-3f16-4b4f-ab9a-89076f169fc1" status: 200 len: 1556 microversion: 2.1 time: 0.970597 Sep 08 10:46:31.983150 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1042/2091] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:31 2022] GET /compute/v2.1/servers/72eb7387-3f16-4b4f-ab9a-89076f169fc1 => generated 1556 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:32.014848 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f0f741bb-668b-4a14-9f41-bfb7bf1893d0 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:32.018679 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f0f741bb-668b-4a14-9f41-bfb7bf1893d0 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: eca1ed67-f21d-46e3-8557-014bc6b63953] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:32.035468 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0f741bb-668b-4a14-9f41-bfb7bf1893d0 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:32.039034 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0f741bb-668b-4a14-9f41-bfb7bf1893d0 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:32.039784 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0f741bb-668b-4a14-9f41-bfb7bf1893d0 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:32.041677 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5505f57a-c9c8-4e1a-ade1-0074a8f506c6 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:32.043594 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0f741bb-668b-4a14-9f41-bfb7bf1893d0 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:32.044698 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0f741bb-668b-4a14-9f41-bfb7bf1893d0 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:32.047011 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0f741bb-668b-4a14-9f41-bfb7bf1893d0 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:32.055303 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5505f57a-c9c8-4e1a-ade1-0074a8f506c6 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/e84298ea-b5e7-473b-8597-2b469d09023e" status: 200 len: 1313 microversion: 2.1 time: 1.443687 Sep 08 10:46:32.072944 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1050/2092] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:30 2022] GET /compute/v2.1/servers/e84298ea-b5e7-473b-8597-2b469d09023e => generated 1313 bytes in 1468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:32.104615 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e7dc6770-8e2c-40bd-b5ab-4443a56e7999 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:32.108165 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e7dc6770-8e2c-40bd-b5ab-4443a56e7999 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 133a5f12-39e5-4e0f-81dc-b1948c073f15] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:32.131043 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e7dc6770-8e2c-40bd-b5ab-4443a56e7999 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:32.131551 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e7dc6770-8e2c-40bd-b5ab-4443a56e7999 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:32.131989 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e7dc6770-8e2c-40bd-b5ab-4443a56e7999 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:32.132710 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e7dc6770-8e2c-40bd-b5ab-4443a56e7999 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:32.145010 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e7dc6770-8e2c-40bd-b5ab-4443a56e7999 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:32.146009 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e7dc6770-8e2c-40bd-b5ab-4443a56e7999 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:32.190206 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-e7dc6770-8e2c-40bd-b5ab-4443a56e7999 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] HTTP exception thrown: Instance 133a5f12-39e5-4e0f-81dc-b1948c073f15 could not be found. Sep 08 10:46:32.197461 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e7dc6770-8e2c-40bd-b5ab-4443a56e7999 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Request method failure captured: Sep 08 10:46:32.197461 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15 HTTP/1.1 Sep 08 10:46:32.197461 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:46:32.197461 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:46:32.197461 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:46:32.197461 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:46:32.197461 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:46:32.197461 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:46:32.197461 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:46:32.197461 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:46:32.197461 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcX1wX6Qpf7IbEqK0znrUx8_LbU5RhxRt5QNO93yuGvepmmaO-HjP1nf79OOPUBjHW9MdcmnWuHxmJt_3mvzs2zsnsyhxC4842HKcCGy7uo7GyYhZnwsl7Op8-00YUPftmtBMh7Wps_XoCaQJPMiFlN-aLHQbjYqshHN9g8uR4tdIhI Sep 08 10:46:32.197461 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:46:32.197461 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:46:32.197461 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:46:32.197461 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:46:32.197461 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:46:32.197461 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:46:32.197461 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: c7f9807a4eb2473e87377097b0544d0e Sep 08 10:46:32.197461 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-LiveMigrationTest-49407157 Sep 08 10:46:32.197461 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:46:32.197461 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:46:32.197461 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c7f9807a4eb2473e87377097b0544d0e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c7f9807a4eb2473e87377097b0544d0e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c7f9807a4eb2473e87377097b0544d0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c7f9807a4eb2473e87377097b0544d0e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:46:32.197461 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-LiveMigrationTest-49407157 Sep 08 10:46:32.197461 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: c7f9807a4eb2473e87377097b0544d0e Sep 08 10:46:32.197461 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-LiveMigrationTest-49407157 Sep 08 10:46:32.197461 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-LiveMigrationTest-49407157-project Sep 08 10:46:32.197461 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:46:32.197461 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:46:32.197461 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 3ecf9924d86b4fd38a6f31430e9d3418 Sep 08 10:46:32.197461 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-LiveMigrationTest-49407157-project Sep 08 10:46:32.197461 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:46:32.197461 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 133a5f12-39e5-4e0f-81dc-b1948c073f15 could not be found. Sep 08 10:46:32.197461 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '133a5f12-39e5-4e0f-81dc-b1948c073f15'} Sep 08 10:46:32.197461 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:46:32.197461 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:46:32.197461 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:46:32.197461 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:46:32.197461 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:46:32.197461 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:46:32.197461 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:46:32.197461 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:46:32.197461 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:46:32.197461 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:46:32.197461 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 133a5f12-39e5-4e0f-81dc-b1948c073f15 could not be found. Sep 08 10:46:32.197461 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:46:32.197461 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:46:32.197461 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:46:32.197461 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:46:32.197461 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:46:32.197461 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:46:32.197461 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:46:32.197461 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:46:32.197461 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:46:32.197461 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:46:32.197461 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:46:32.197461 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:46:32.197461 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:46:32.197461 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:46:32.197461 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:46:32.197461 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:46:32.197461 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 133a5f12-39e5-4e0f-81dc-b1948c073f15 could not be found. Sep 08 10:46:32.197461 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:46:32.197461 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:46:32.197461 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:46:32.204152 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:46:32.204152 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:46:32.204152 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:46:32.204152 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:46:32.204152 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:46:32.204152 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 133a5f12-39e5-4e0f-81dc-b1948c073f15 could not be found. Sep 08 10:46:32.204152 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:46:32.204152 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e7dc6770-8e2c-40bd-b5ab-4443a56e7999 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Returning 404 to user: Instance 133a5f12-39e5-4e0f-81dc-b1948c073f15 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:46:32.204152 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e7dc6770-8e2c-40bd-b5ab-4443a56e7999 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15" status: 404 len: 111 microversion: 2.1 time: 0.127075 Sep 08 10:46:32.204152 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1051/2093] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:32 2022] GET /compute/v2.1/servers/133a5f12-39e5-4e0f-81dc-b1948c073f15 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:46:32.213476 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-59394340-359e-44f9-a586-4dc9bce61e81 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '.version_select at 0x7f68e8976e50>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:32.352386 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-59394340-359e-44f9-a586-4dc9bce61e81 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/images/28783cea-dde6-431e-a46e-b87625b47518" status: 200 len: 1439 microversion: 2.1 time: 0.146022 Sep 08 10:46:32.362638 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1052/2094] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:46:32 2022] GET /compute/v2.1/images/28783cea-dde6-431e-a46e-b87625b47518 => generated 1439 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:32.374703 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f9120da3-8e99-4372-9e3d-1ed01482e7b6 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:32.375092 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f9120da3-8e99-4372-9e3d-1ed01482e7b6 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] [instance: 72eb7387-3f16-4b4f-ab9a-89076f169fc1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:32.395721 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f9120da3-8e99-4372-9e3d-1ed01482e7b6 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:32.396223 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f9120da3-8e99-4372-9e3d-1ed01482e7b6 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:32.400427 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f9120da3-8e99-4372-9e3d-1ed01482e7b6 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:32.401434 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f9120da3-8e99-4372-9e3d-1ed01482e7b6 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:32.402548 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f9120da3-8e99-4372-9e3d-1ed01482e7b6 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:32.402999 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f9120da3-8e99-4372-9e3d-1ed01482e7b6 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:32.450618 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:46:32.870072 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f9120da3-8e99-4372-9e3d-1ed01482e7b6 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] 10.222.0.27 "GET /compute/v2.1/servers/72eb7387-3f16-4b4f-ab9a-89076f169fc1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.505057 Sep 08 10:46:32.870670 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1053/2095] 10.222.0.27 () {58 vars in 1275 bytes} [Thu Sep 8 10:46:32 2022] GET /compute/v2.1/servers/72eb7387-3f16-4b4f-ab9a-89076f169fc1/os-interface => generated 284 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:46:32.875834 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4695d5d7-4e60-4415-ac60-94fe7c931f07 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:32.876844 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4695d5d7-4e60-4415-ac60-94fe7c931f07 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: bace4c1a-2c38-42b3-962d-ca87a3bfb7ba] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:32.884289 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4695d5d7-4e60-4415-ac60-94fe7c931f07 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:32.884783 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4695d5d7-4e60-4415-ac60-94fe7c931f07 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:32.892671 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4695d5d7-4e60-4415-ac60-94fe7c931f07 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:32.893782 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4695d5d7-4e60-4415-ac60-94fe7c931f07 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:32.894470 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4695d5d7-4e60-4415-ac60-94fe7c931f07 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:32.895079 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4695d5d7-4e60-4415-ac60-94fe7c931f07 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:32.977680 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f0f741bb-668b-4a14-9f41-bfb7bf1893d0 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:33.005437 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f0f741bb-668b-4a14-9f41-bfb7bf1893d0 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/eca1ed67-f21d-46e3-8557-014bc6b63953" status: 200 len: 1313 microversion: 2.1 time: 1.016912 Sep 08 10:46:33.017397 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1043/2096] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:31 2022] GET /compute/v2.1/servers/eca1ed67-f21d-46e3-8557-014bc6b63953 => generated 1313 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:33.023398 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b3cabebd-6f08-4bac-980d-3c2599aec94f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '.version_select at 0x7f68e8a56550>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:33.111125 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b3cabebd-6f08-4bac-980d-3c2599aec94f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2018570631" status: 202 len: 0 microversion: 2.1 time: 0.098803 Sep 08 10:46:33.112025 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1044/2097] 10.222.0.27 () {58 vars in 1221 bytes} [Thu Sep 8 10:46:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2018570631 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:46:33.135146 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-99a59d7f-472b-4029-be01-cd416bfc78ca tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:33.137980 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-99a59d7f-472b-4029-be01-cd416bfc78ca tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: e84298ea-b5e7-473b-8597-2b469d09023e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:33.161581 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-99a59d7f-472b-4029-be01-cd416bfc78ca tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:33.162250 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-99a59d7f-472b-4029-be01-cd416bfc78ca tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:33.162816 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-99a59d7f-472b-4029-be01-cd416bfc78ca tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:33.163989 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-99a59d7f-472b-4029-be01-cd416bfc78ca tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:33.164852 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-99a59d7f-472b-4029-be01-cd416bfc78ca tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:33.167427 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-99a59d7f-472b-4029-be01-cd416bfc78ca tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:33.588544 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4695d5d7-4e60-4415-ac60-94fe7c931f07 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c291cbe955b4ee5abc98132dda0255e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f9a24cad014d7f827e8f3236dd5bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:33.637470 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4695d5d7-4e60-4415-ac60-94fe7c931f07 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/bace4c1a-2c38-42b3-962d-ca87a3bfb7ba" status: 200 len: 1293 microversion: 2.1 time: 0.753749 Sep 08 10:46:33.664538 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1054/2098] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:32 2022] GET /compute/v2.1/servers/bace4c1a-2c38-42b3-962d-ca87a3bfb7ba => generated 1293 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:33.701869 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-a52660d2-5a70-4d07-bf21-00b341e234c1 req-118feb47-8450-4895-8a50-28ed264726c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e84298ea-b5e7-473b-8597-2b469d09023e", "name": "network-vif-plugged", "status": "completed", "tag": "4cd6fa00-47a5-485c-844f-23c7cb5f2d9d"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:46:33.747145 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-a52660d2-5a70-4d07-bf21-00b341e234c1 req-118feb47-8450-4895-8a50-28ed264726c8 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:33.747999 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-a52660d2-5a70-4d07-bf21-00b341e234c1 req-118feb47-8450-4895-8a50-28ed264726c8 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:33.748764 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-a52660d2-5a70-4d07-bf21-00b341e234c1 req-118feb47-8450-4895-8a50-28ed264726c8 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:33.806934 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-a52660d2-5a70-4d07-bf21-00b341e234c1 req-118feb47-8450-4895-8a50-28ed264726c8 service nova] Creating event network-vif-plugged:4cd6fa00-47a5-485c-844f-23c7cb5f2d9d for instance e84298ea-b5e7-473b-8597-2b469d09023e on n-h2-850501-12 Sep 08 10:46:33.822283 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-a52660d2-5a70-4d07-bf21-00b341e234c1 req-118feb47-8450-4895-8a50-28ed264726c8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147714 Sep 08 10:46:33.823382 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1055/2099] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:46:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:46:33.834444 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9def3a8b-2e46-4301-8383-fef15199138f tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '.version_select at 0x7f68e4710ee0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:33.958352 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9def3a8b-2e46-4301-8383-fef15199138f tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/images/28783cea-dde6-431e-a46e-b87625b47518" status: 200 len: 1439 microversion: 2.1 time: 0.133289 Sep 08 10:46:33.973015 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1056/2100] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:46:33 2022] GET /compute/v2.1/images/28783cea-dde6-431e-a46e-b87625b47518 => generated 1439 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:34.034440 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-26b92182-9f40-4dd2-b201-7cf79887ba4c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:34.036397 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-26b92182-9f40-4dd2-b201-7cf79887ba4c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: eca1ed67-f21d-46e3-8557-014bc6b63953] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:34.055063 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-26b92182-9f40-4dd2-b201-7cf79887ba4c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:34.059002 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-26b92182-9f40-4dd2-b201-7cf79887ba4c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:34.059590 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-26b92182-9f40-4dd2-b201-7cf79887ba4c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:34.060465 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-26b92182-9f40-4dd2-b201-7cf79887ba4c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:34.061093 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-26b92182-9f40-4dd2-b201-7cf79887ba4c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:34.064350 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-26b92182-9f40-4dd2-b201-7cf79887ba4c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:34.452615 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-99a59d7f-472b-4029-be01-cd416bfc78ca tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:34.463555 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-99a59d7f-472b-4029-be01-cd416bfc78ca tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/e84298ea-b5e7-473b-8597-2b469d09023e" status: 200 len: 1313 microversion: 2.1 time: 1.350137 Sep 08 10:46:34.467945 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1045/2101] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:33 2022] GET /compute/v2.1/servers/e84298ea-b5e7-473b-8597-2b469d09023e => generated 1313 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:34.688581 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f0948d6b-aea2-450c-8d9e-5c3e84d97a40 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:34.689238 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f0948d6b-aea2-450c-8d9e-5c3e84d97a40 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: bace4c1a-2c38-42b3-962d-ca87a3bfb7ba] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:34.708018 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0948d6b-aea2-450c-8d9e-5c3e84d97a40 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:34.708580 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0948d6b-aea2-450c-8d9e-5c3e84d97a40 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:34.709067 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0948d6b-aea2-450c-8d9e-5c3e84d97a40 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:34.711508 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0948d6b-aea2-450c-8d9e-5c3e84d97a40 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:34.712059 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0948d6b-aea2-450c-8d9e-5c3e84d97a40 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:34.715225 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0948d6b-aea2-450c-8d9e-5c3e84d97a40 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:34.858846 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f0948d6b-aea2-450c-8d9e-5c3e84d97a40 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c291cbe955b4ee5abc98132dda0255e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f9a24cad014d7f827e8f3236dd5bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:34.871213 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f0948d6b-aea2-450c-8d9e-5c3e84d97a40 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/bace4c1a-2c38-42b3-962d-ca87a3bfb7ba" status: 200 len: 1299 microversion: 2.1 time: 0.186925 Sep 08 10:46:34.873758 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1046/2102] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:34 2022] GET /compute/v2.1/servers/bace4c1a-2c38-42b3-962d-ca87a3bfb7ba => generated 1299 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:46:34.996749 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b1df4ece-7cc9-4b73-9b4c-8adbd4f2ec41 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '.version_select at 0x7f68e8a61940>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:35.075690 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b1df4ece-7cc9-4b73-9b4c-8adbd4f2ec41 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/images/28783cea-dde6-431e-a46e-b87625b47518" status: 200 len: 1439 microversion: 2.1 time: 0.081753 Sep 08 10:46:35.076415 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1047/2103] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:46:34 2022] GET /compute/v2.1/images/28783cea-dde6-431e-a46e-b87625b47518 => generated 1439 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:46:35.226412 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-26b92182-9f40-4dd2-b201-7cf79887ba4c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:35.242294 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-26b92182-9f40-4dd2-b201-7cf79887ba4c tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/eca1ed67-f21d-46e3-8557-014bc6b63953" status: 200 len: 1313 microversion: 2.1 time: 1.211941 Sep 08 10:46:35.248969 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1057/2104] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:34 2022] GET /compute/v2.1/servers/eca1ed67-f21d-46e3-8557-014bc6b63953 => generated 1313 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:35.500016 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8efb3aa8-7505-4628-bf7b-44411704a1b1 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:35.502088 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8efb3aa8-7505-4628-bf7b-44411704a1b1 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: e84298ea-b5e7-473b-8597-2b469d09023e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:35.519882 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8efb3aa8-7505-4628-bf7b-44411704a1b1 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:35.524479 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8efb3aa8-7505-4628-bf7b-44411704a1b1 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:35.525674 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8efb3aa8-7505-4628-bf7b-44411704a1b1 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:35.528440 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8efb3aa8-7505-4628-bf7b-44411704a1b1 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:35.533224 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8efb3aa8-7505-4628-bf7b-44411704a1b1 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:35.534114 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8efb3aa8-7505-4628-bf7b-44411704a1b1 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:35.849114 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7fa029e7-e71a-4123-8816-479b8c7ce1b4 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:35.849615 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7fa029e7-e71a-4123-8816-479b8c7ce1b4 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 1fc866b1-81ac-4c09-86ab-6d8a4a580294] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:35.857050 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7fa029e7-e71a-4123-8816-479b8c7ce1b4 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:35.867425 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7fa029e7-e71a-4123-8816-479b8c7ce1b4 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:35.868164 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7fa029e7-e71a-4123-8816-479b8c7ce1b4 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:35.870521 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7fa029e7-e71a-4123-8816-479b8c7ce1b4 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:35.871185 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7fa029e7-e71a-4123-8816-479b8c7ce1b4 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:35.871782 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7fa029e7-e71a-4123-8816-479b8c7ce1b4 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:35.938908 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7fa029e7-e71a-4123-8816-479b8c7ce1b4 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 1fc866b1-81ac-4c09-86ab-6d8a4a580294] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:46:35.973109 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8efb3aa8-7505-4628-bf7b-44411704a1b1 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:35.982092 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8efb3aa8-7505-4628-bf7b-44411704a1b1 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/e84298ea-b5e7-473b-8597-2b469d09023e" status: 200 len: 1313 microversion: 2.1 time: 0.489877 Sep 08 10:46:35.982996 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1048/2105] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:35 2022] GET /compute/v2.1/servers/e84298ea-b5e7-473b-8597-2b469d09023e => generated 1313 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:36.000609 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-06613f30-6c73-4ca1-aac0-75c4294baedc tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:36.016018 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-06613f30-6c73-4ca1-aac0-75c4294baedc tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: bace4c1a-2c38-42b3-962d-ca87a3bfb7ba] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:36.038849 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-06613f30-6c73-4ca1-aac0-75c4294baedc tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:36.039372 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-06613f30-6c73-4ca1-aac0-75c4294baedc tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:36.045947 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-06613f30-6c73-4ca1-aac0-75c4294baedc tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:36.046730 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-06613f30-6c73-4ca1-aac0-75c4294baedc tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:36.047208 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-06613f30-6c73-4ca1-aac0-75c4294baedc tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:36.048174 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-06613f30-6c73-4ca1-aac0-75c4294baedc tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:36.151480 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7fa029e7-e71a-4123-8816-479b8c7ce1b4 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1fc866b1-81ac-4c09-86ab-6d8a4a580294" status: 204 len: 0 microversion: 2.1 time: 0.305375 Sep 08 10:46:36.152674 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1058/2106] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:46:35 2022] DELETE /compute/v2.1/servers/1fc866b1-81ac-4c09-86ab-6d8a4a580294 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 10:46:36.161061 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-a362ed81-22b7-42c4-b253-78180d919b89 req-9f822a70-dc6c-435b-9113-99c33e0badba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d251638-b28f-4137-a81a-ce1a21cd7418", "name": "network-vif-plugged", "status": "completed", "tag": "c673f801-080b-42df-a05e-1dfffd8802bd"}, {"server_uuid": "eca1ed67-f21d-46e3-8557-014bc6b63953", "name": "network-vif-plugged", "status": "completed", "tag": "63cb3c01-9673-46f6-8e43-73cf71b3f687"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:46:36.176738 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-a362ed81-22b7-42c4-b253-78180d919b89 req-9f822a70-dc6c-435b-9113-99c33e0badba service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:36.177473 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-a362ed81-22b7-42c4-b253-78180d919b89 req-9f822a70-dc6c-435b-9113-99c33e0badba service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:36.177907 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-a362ed81-22b7-42c4-b253-78180d919b89 req-9f822a70-dc6c-435b-9113-99c33e0badba service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:36.199184 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-a362ed81-22b7-42c4-b253-78180d919b89 req-9f822a70-dc6c-435b-9113-99c33e0badba service nova] Creating event network-vif-plugged:c673f801-080b-42df-a05e-1dfffd8802bd for instance 7d251638-b28f-4137-a81a-ce1a21cd7418 on n-h2-850501-12 Sep 08 10:46:36.200192 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-a362ed81-22b7-42c4-b253-78180d919b89 req-9f822a70-dc6c-435b-9113-99c33e0badba service nova] Creating event network-vif-plugged:63cb3c01-9673-46f6-8e43-73cf71b3f687 for instance eca1ed67-f21d-46e3-8557-014bc6b63953 on n-h1-850501-12 Sep 08 10:46:36.214051 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-a362ed81-22b7-42c4-b253-78180d919b89 req-9f822a70-dc6c-435b-9113-99c33e0badba service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.059297 Sep 08 10:46:36.215853 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1059/2107] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:46:36 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:46:36.224188 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d4508675-251f-4bf9-ac89-1d6e78d34867 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '.version_select at 0x7f68e8962f70>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:36.336286 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d4508675-251f-4bf9-ac89-1d6e78d34867 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/images/28783cea-dde6-431e-a46e-b87625b47518" status: 200 len: 1439 microversion: 2.1 time: 0.118612 Sep 08 10:46:36.358856 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1060/2108] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:46:36 2022] GET /compute/v2.1/images/28783cea-dde6-431e-a46e-b87625b47518 => generated 1439 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:36.363519 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-06613f30-6c73-4ca1-aac0-75c4294baedc tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c291cbe955b4ee5abc98132dda0255e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f9a24cad014d7f827e8f3236dd5bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:36.363998 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-05a24226-b280-44fd-8847-e07d5ee301b8 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:36.364755 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-05a24226-b280-44fd-8847-e07d5ee301b8 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 1fc866b1-81ac-4c09-86ab-6d8a4a580294] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:36.378082 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-06613f30-6c73-4ca1-aac0-75c4294baedc tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/bace4c1a-2c38-42b3-962d-ca87a3bfb7ba" status: 200 len: 1299 microversion: 2.1 time: 0.392692 Sep 08 10:46:36.390366 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-05a24226-b280-44fd-8847-e07d5ee301b8 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:36.390860 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-05a24226-b280-44fd-8847-e07d5ee301b8 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:36.391314 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-05a24226-b280-44fd-8847-e07d5ee301b8 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:36.392045 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-05a24226-b280-44fd-8847-e07d5ee301b8 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:36.392498 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-05a24226-b280-44fd-8847-e07d5ee301b8 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:36.392919 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-05a24226-b280-44fd-8847-e07d5ee301b8 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:36.397798 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1049/2109] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:35 2022] GET /compute/v2.1/servers/bace4c1a-2c38-42b3-962d-ca87a3bfb7ba => generated 1299 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:36.408093 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ca8858cc-f200-4f53-8379-1364a56525b4 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:36.408777 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ca8858cc-f200-4f53-8379-1364a56525b4 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: eca1ed67-f21d-46e3-8557-014bc6b63953] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:36.422343 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ca8858cc-f200-4f53-8379-1364a56525b4 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:36.424931 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ca8858cc-f200-4f53-8379-1364a56525b4 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:36.425531 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ca8858cc-f200-4f53-8379-1364a56525b4 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:36.427399 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ca8858cc-f200-4f53-8379-1364a56525b4 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:36.429777 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ca8858cc-f200-4f53-8379-1364a56525b4 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:36.430320 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ca8858cc-f200-4f53-8379-1364a56525b4 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:36.980015 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-05a24226-b280-44fd-8847-e07d5ee301b8 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:36.988944 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-05a24226-b280-44fd-8847-e07d5ee301b8 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/1fc866b1-81ac-4c09-86ab-6d8a4a580294" status: 200 len: 1485 microversion: 2.1 time: 0.636556 Sep 08 10:46:36.995875 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1061/2110] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:36 2022] GET /compute/v2.1/servers/1fc866b1-81ac-4c09-86ab-6d8a4a580294 => generated 1485 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:37.019477 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e23b62a5-6829-4f53-a758-132e0776c4d2 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:37.026275 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e23b62a5-6829-4f53-a758-132e0776c4d2 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: e84298ea-b5e7-473b-8597-2b469d09023e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:37.040749 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e23b62a5-6829-4f53-a758-132e0776c4d2 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:37.041626 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e23b62a5-6829-4f53-a758-132e0776c4d2 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:37.047008 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e23b62a5-6829-4f53-a758-132e0776c4d2 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:37.048506 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e23b62a5-6829-4f53-a758-132e0776c4d2 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:37.049476 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e23b62a5-6829-4f53-a758-132e0776c4d2 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:37.051518 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e23b62a5-6829-4f53-a758-132e0776c4d2 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:37.658375 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e23b62a5-6829-4f53-a758-132e0776c4d2 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:37.674432 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e23b62a5-6829-4f53-a758-132e0776c4d2 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/e84298ea-b5e7-473b-8597-2b469d09023e" status: 200 len: 1463 microversion: 2.1 time: 0.667679 Sep 08 10:46:37.685056 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1062/2111] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:37 2022] GET /compute/v2.1/servers/e84298ea-b5e7-473b-8597-2b469d09023e => generated 1463 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:37.696872 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7f8067fe-30e0-46fd-9874-9eefb06b9d24 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '.version_select at 0x7f68e89bfc10>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:37.713909 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ca8858cc-f200-4f53-8379-1364a56525b4 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:37.758639 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ca8858cc-f200-4f53-8379-1364a56525b4 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/eca1ed67-f21d-46e3-8557-014bc6b63953" status: 200 len: 1313 microversion: 2.1 time: 1.353297 Sep 08 10:46:37.760199 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1050/2112] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:36 2022] GET /compute/v2.1/servers/eca1ed67-f21d-46e3-8557-014bc6b63953 => generated 1313 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:37.778043 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0f8a8569-ec19-42b0-b671-e0aa2d733b9a tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:37.779435 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0f8a8569-ec19-42b0-b671-e0aa2d733b9a tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: bace4c1a-2c38-42b3-962d-ca87a3bfb7ba] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:37.799736 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7f8067fe-30e0-46fd-9874-9eefb06b9d24 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/images/28783cea-dde6-431e-a46e-b87625b47518" status: 200 len: 1439 microversion: 2.1 time: 0.118496 Sep 08 10:46:37.800785 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1063/2113] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:46:37 2022] GET /compute/v2.1/images/28783cea-dde6-431e-a46e-b87625b47518 => generated 1439 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:37.841772 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f8a8569-ec19-42b0-b671-e0aa2d733b9a tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:37.842440 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f8a8569-ec19-42b0-b671-e0aa2d733b9a tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:37.843393 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f8a8569-ec19-42b0-b671-e0aa2d733b9a tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:37.857502 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f8a8569-ec19-42b0-b671-e0aa2d733b9a tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:37.858450 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f8a8569-ec19-42b0-b671-e0aa2d733b9a tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:37.861530 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f8a8569-ec19-42b0-b671-e0aa2d733b9a tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:38.148741 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0f8a8569-ec19-42b0-b671-e0aa2d733b9a tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c291cbe955b4ee5abc98132dda0255e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f9a24cad014d7f827e8f3236dd5bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:38.162259 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0f8a8569-ec19-42b0-b671-e0aa2d733b9a tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/bace4c1a-2c38-42b3-962d-ca87a3bfb7ba" status: 200 len: 1299 microversion: 2.1 time: 0.397811 Sep 08 10:46:38.163042 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1051/2114] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:37 2022] GET /compute/v2.1/servers/bace4c1a-2c38-42b3-962d-ca87a3bfb7ba => generated 1299 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:38.173178 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-e71d6a39-f209-4cc0-b881-3ab93a731235 req-f2e011c2-cf5f-4a1d-8482-8029d0336cf6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72eb7387-3f16-4b4f-ab9a-89076f169fc1", "tag": "64d36b81-597c-4cd5-8290-49272ddcb61d"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:46:38.200574 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e71d6a39-f209-4cc0-b881-3ab93a731235 req-f2e011c2-cf5f-4a1d-8482-8029d0336cf6 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:38.200574 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e71d6a39-f209-4cc0-b881-3ab93a731235 req-f2e011c2-cf5f-4a1d-8482-8029d0336cf6 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:38.200574 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e71d6a39-f209-4cc0-b881-3ab93a731235 req-f2e011c2-cf5f-4a1d-8482-8029d0336cf6 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:38.233673 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-e71d6a39-f209-4cc0-b881-3ab93a731235 req-f2e011c2-cf5f-4a1d-8482-8029d0336cf6 service nova] Creating event network-changed:64d36b81-597c-4cd5-8290-49272ddcb61d for instance 72eb7387-3f16-4b4f-ab9a-89076f169fc1 on n-h1-850501-12 Sep 08 10:46:38.245429 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-e71d6a39-f209-4cc0-b881-3ab93a731235 req-f2e011c2-cf5f-4a1d-8482-8029d0336cf6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080844 Sep 08 10:46:38.251616 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1052/2115] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:46:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:46:38.258632 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f9ddd63e-e9e9-43bb-b46e-c495102bc384 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:38.259346 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f9ddd63e-e9e9-43bb-b46e-c495102bc384 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 1fc866b1-81ac-4c09-86ab-6d8a4a580294] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:38.278246 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f9ddd63e-e9e9-43bb-b46e-c495102bc384 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:38.280163 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f9ddd63e-e9e9-43bb-b46e-c495102bc384 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:38.280163 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f9ddd63e-e9e9-43bb-b46e-c495102bc384 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:38.280163 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f9ddd63e-e9e9-43bb-b46e-c495102bc384 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:38.280684 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f9ddd63e-e9e9-43bb-b46e-c495102bc384 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:38.280850 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f9ddd63e-e9e9-43bb-b46e-c495102bc384 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:38.685173 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-dba02846-581f-48a6-810a-43cc1b56e7a7 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:38.707116 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-dba02846-581f-48a6-810a-43cc1b56e7a7 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Searching by: {'deleted': False, 'project_id': '5844ddb81d464eb696d7badefd6ec4d6'} {{(pid=128861) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:46:38.764620 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dba02846-581f-48a6-810a-43cc1b56e7a7 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:38.790962 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dba02846-581f-48a6-810a-43cc1b56e7a7 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:38.792171 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dba02846-581f-48a6-810a-43cc1b56e7a7 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:38.793296 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dba02846-581f-48a6-810a-43cc1b56e7a7 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:38.797240 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dba02846-581f-48a6-810a-43cc1b56e7a7 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:38.802004 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dba02846-581f-48a6-810a-43cc1b56e7a7 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:39.140117 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-dba02846-581f-48a6-810a-43cc1b56e7a7 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 1.336995 Sep 08 10:46:39.176353 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1064/2116] 10.222.0.27 () {58 vars in 1146 bytes} [Thu Sep 8 10:46:37 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:46:39.189926 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-68354253-9a9c-4078-aa00-781aa2c88ccc tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:39.191530 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-68354253-9a9c-4078-aa00-781aa2c88ccc tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: eca1ed67-f21d-46e3-8557-014bc6b63953] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:39.207875 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-68354253-9a9c-4078-aa00-781aa2c88ccc tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:39.211702 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-68354253-9a9c-4078-aa00-781aa2c88ccc tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:39.213704 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-68354253-9a9c-4078-aa00-781aa2c88ccc tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:39.214721 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-68354253-9a9c-4078-aa00-781aa2c88ccc tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:39.215342 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-68354253-9a9c-4078-aa00-781aa2c88ccc tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:39.215939 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-68354253-9a9c-4078-aa00-781aa2c88ccc tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:39.234884 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f9ddd63e-e9e9-43bb-b46e-c495102bc384 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:39.239445 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:46:39.252373 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f9ddd63e-e9e9-43bb-b46e-c495102bc384 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/1fc866b1-81ac-4c09-86ab-6d8a4a580294" status: 200 len: 1485 microversion: 2.1 time: 0.999406 Sep 08 10:46:39.273242 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1053/2117] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:38 2022] GET /compute/v2.1/servers/1fc866b1-81ac-4c09-86ab-6d8a4a580294 => generated 1485 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:39.295192 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7bb2ad02-8fa5-427a-b705-5e916590682c tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '.version_select at 0x7f68e8a56b80>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:39.429840 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7bb2ad02-8fa5-427a-b705-5e916590682c tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/images/28783cea-dde6-431e-a46e-b87625b47518" status: 200 len: 1439 microversion: 2.1 time: 0.153272 Sep 08 10:46:39.438710 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1054/2118] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:46:39 2022] GET /compute/v2.1/images/28783cea-dde6-431e-a46e-b87625b47518 => generated 1439 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:39.448445 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-041bc5d3-6a8e-4d70-becf-a0353dab8130 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:39.455888 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-041bc5d3-6a8e-4d70-becf-a0353dab8130 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Searching by: {'deleted': False} {{(pid=128862) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:46:39.494479 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-041bc5d3-6a8e-4d70-becf-a0353dab8130 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:39.495376 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-041bc5d3-6a8e-4d70-becf-a0353dab8130 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:39.497594 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-041bc5d3-6a8e-4d70-becf-a0353dab8130 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:39.502658 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-041bc5d3-6a8e-4d70-becf-a0353dab8130 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:39.503454 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-041bc5d3-6a8e-4d70-becf-a0353dab8130 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:39.504068 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-041bc5d3-6a8e-4d70-becf-a0353dab8130 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:39.858525 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.multi_cell_list [None req-041bc5d3-6a8e-4d70-becf-a0353dab8130 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Listed batch of 9 results from cell out of 1000 limit. Returned 9 total so far. {{(pid=128862) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 10:46:40.003821 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-041bc5d3-6a8e-4d70-becf-a0353dab8130 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:40.004321 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-041bc5d3-6a8e-4d70-becf-a0353dab8130 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:40.004764 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-041bc5d3-6a8e-4d70-becf-a0353dab8130 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:40.361425 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-68354253-9a9c-4078-aa00-781aa2c88ccc tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:40.381688 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-68354253-9a9c-4078-aa00-781aa2c88ccc tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/eca1ed67-f21d-46e3-8557-014bc6b63953" status: 200 len: 1500 microversion: 2.1 time: 1.199206 Sep 08 10:46:40.382514 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1065/2119] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:39 2022] GET /compute/v2.1/servers/eca1ed67-f21d-46e3-8557-014bc6b63953 => generated 1500 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:40.406514 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-92e8e8c1-5f37-4868-a6da-8423543a6861 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:40.406514 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-92e8e8c1-5f37-4868-a6da-8423543a6861 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: bace4c1a-2c38-42b3-962d-ca87a3bfb7ba] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:40.448865 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-92e8e8c1-5f37-4868-a6da-8423543a6861 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:40.448865 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-92e8e8c1-5f37-4868-a6da-8423543a6861 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:40.448865 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-92e8e8c1-5f37-4868-a6da-8423543a6861 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:40.448865 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-92e8e8c1-5f37-4868-a6da-8423543a6861 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:40.448865 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-92e8e8c1-5f37-4868-a6da-8423543a6861 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:40.448865 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-92e8e8c1-5f37-4868-a6da-8423543a6861 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:41.503024 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-92e8e8c1-5f37-4868-a6da-8423543a6861 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c291cbe955b4ee5abc98132dda0255e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f9a24cad014d7f827e8f3236dd5bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:41.535799 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-92e8e8c1-5f37-4868-a6da-8423543a6861 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/bace4c1a-2c38-42b3-962d-ca87a3bfb7ba" status: 200 len: 1366 microversion: 2.1 time: 1.144072 Sep 08 10:46:41.544085 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1066/2120] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:40 2022] GET /compute/v2.1/servers/bace4c1a-2c38-42b3-962d-ca87a3bfb7ba => generated 1366 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:41.558414 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-61bd9890-67ec-4f50-b418-a59a5d2f4d4a tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:41.574538 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-61bd9890-67ec-4f50-b418-a59a5d2f4d4a tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 1fc866b1-81ac-4c09-86ab-6d8a4a580294] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:41.589370 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-61bd9890-67ec-4f50-b418-a59a5d2f4d4a tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:41.590131 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-61bd9890-67ec-4f50-b418-a59a5d2f4d4a tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:41.607914 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-61bd9890-67ec-4f50-b418-a59a5d2f4d4a tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:41.618971 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-61bd9890-67ec-4f50-b418-a59a5d2f4d4a tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:41.619692 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-61bd9890-67ec-4f50-b418-a59a5d2f4d4a tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:41.620337 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-61bd9890-67ec-4f50-b418-a59a5d2f4d4a tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:41.774330 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-61bd9890-67ec-4f50-b418-a59a5d2f4d4a tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:41.775307 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-61bd9890-67ec-4f50-b418-a59a5d2f4d4a tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:41.779384 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-61bd9890-67ec-4f50-b418-a59a5d2f4d4a tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:41.780548 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-61bd9890-67ec-4f50-b418-a59a5d2f4d4a tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lazy-loading 'fault' on Instance uuid 1fc866b1-81ac-4c09-86ab-6d8a4a580294 {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:46:41.992271 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-61bd9890-67ec-4f50-b418-a59a5d2f4d4a tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:42.019193 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-61bd9890-67ec-4f50-b418-a59a5d2f4d4a tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/1fc866b1-81ac-4c09-86ab-6d8a4a580294" status: 200 len: 1301 microversion: 2.1 time: 0.473400 Sep 08 10:46:42.020441 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1067/2121] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:41 2022] GET /compute/v2.1/servers/1fc866b1-81ac-4c09-86ab-6d8a4a580294 => generated 1301 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:42.031656 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1ce277a2-53f3-4fa4-97d2-4e0b695aecc9 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:46:42.064292 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1ce277a2-53f3-4fa4-97d2-4e0b695aecc9 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:42.065621 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1ce277a2-53f3-4fa4-97d2-4e0b695aecc9 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:42.066450 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1ce277a2-53f3-4fa4-97d2-4e0b695aecc9 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:42.152269 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1ce277a2-53f3-4fa4-97d2-4e0b695aecc9 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: eca1ed67-f21d-46e3-8557-014bc6b63953] Going to try to stop instance {{(pid=128861) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 08 10:46:42.338535 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1ce277a2-53f3-4fa4-97d2-4e0b695aecc9 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "POST /compute/v2.1/servers/eca1ed67-f21d-46e3-8557-014bc6b63953/action" status: 202 len: 0 microversion: 2.1 time: 0.288249 Sep 08 10:46:42.345238 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1068/2122] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:46:42 2022] POST /compute/v2.1/servers/eca1ed67-f21d-46e3-8557-014bc6b63953/action => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:46:42.373272 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c5fe71ac-f6b3-48ce-be48-0db195996eff tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '.version_select at 0x7f68e892ff70>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:42.391699 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-041bc5d3-6a8e-4d70-becf-a0353dab8130 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 14538 microversion: 2.1 time: 2.959502 Sep 08 10:46:42.392424 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1055/2123] 10.222.0.27 () {58 vars in 1171 bytes} [Thu Sep 8 10:46:39 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 14538 bytes in 2961 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:46:42.397824 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-96bb73fd-631f-4f6d-8c58-0610933a1ffe req-582d1d9e-fc71-4e4b-8d19-a05d21c911f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fc866b1-81ac-4c09-86ab-6d8a4a580294", "name": "network-vif-deleted", "tag": "db9922aa-1490-4e6a-9ed5-89cbee224339"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:46:42.430197 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-96bb73fd-631f-4f6d-8c58-0610933a1ffe req-582d1d9e-fc71-4e4b-8d19-a05d21c911f8 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:42.430766 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-96bb73fd-631f-4f6d-8c58-0610933a1ffe req-582d1d9e-fc71-4e4b-8d19-a05d21c911f8 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:42.431217 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-96bb73fd-631f-4f6d-8c58-0610933a1ffe req-582d1d9e-fc71-4e4b-8d19-a05d21c911f8 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:42.505252 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-96bb73fd-631f-4f6d-8c58-0610933a1ffe req-582d1d9e-fc71-4e4b-8d19-a05d21c911f8 service nova] Creating event network-vif-deleted:db9922aa-1490-4e6a-9ed5-89cbee224339 for instance 1fc866b1-81ac-4c09-86ab-6d8a4a580294 on n-h2-850501-12 Sep 08 10:46:42.537927 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-96bb73fd-631f-4f6d-8c58-0610933a1ffe req-582d1d9e-fc71-4e4b-8d19-a05d21c911f8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142060 Sep 08 10:46:42.542829 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1056/2124] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:46:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:46:42.564222 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0ae43968-3f87-45a6-89f0-49bc9f72203d tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:42.591435 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0ae43968-3f87-45a6-89f0-49bc9f72203d tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: eca1ed67-f21d-46e3-8557-014bc6b63953] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:42.597003 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c5fe71ac-f6b3-48ce-be48-0db195996eff tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/images/28783cea-dde6-431e-a46e-b87625b47518" status: 200 len: 1439 microversion: 2.1 time: 0.249731 Sep 08 10:46:42.605441 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1069/2125] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:46:42 2022] GET /compute/v2.1/images/28783cea-dde6-431e-a46e-b87625b47518 => generated 1439 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:42.616583 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ba7af9bc-6e0e-4b5f-96c7-01ecd13d6e86 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:42.631235 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ae43968-3f87-45a6-89f0-49bc9f72203d tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:42.631972 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ae43968-3f87-45a6-89f0-49bc9f72203d tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:42.632500 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ae43968-3f87-45a6-89f0-49bc9f72203d tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:42.634040 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ae43968-3f87-45a6-89f0-49bc9f72203d tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:42.634697 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ae43968-3f87-45a6-89f0-49bc9f72203d tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:42.635283 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ae43968-3f87-45a6-89f0-49bc9f72203d tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:42.655883 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ba7af9bc-6e0e-4b5f-96c7-01ecd13d6e86 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Searching by: {'deleted': False, 'project_id': '5844ddb81d464eb696d7badefd6ec4d6'} {{(pid=128861) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:46:42.701050 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ba7af9bc-6e0e-4b5f-96c7-01ecd13d6e86 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:42.715342 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ba7af9bc-6e0e-4b5f-96c7-01ecd13d6e86 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:42.716170 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ba7af9bc-6e0e-4b5f-96c7-01ecd13d6e86 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:42.722177 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ba7af9bc-6e0e-4b5f-96c7-01ecd13d6e86 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:42.724523 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ba7af9bc-6e0e-4b5f-96c7-01ecd13d6e86 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:42.725236 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ba7af9bc-6e0e-4b5f-96c7-01ecd13d6e86 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:42.849664 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ba7af9bc-6e0e-4b5f-96c7-01ecd13d6e86 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/detail?tenant_id=eb93f8524768458a974c348b981921d5" status: 200 len: 15 microversion: 2.1 time: 0.242495 Sep 08 10:46:42.850286 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1070/2126] 10.222.0.27 () {58 vars in 1231 bytes} [Thu Sep 8 10:46:42 2022] GET /compute/v2.1/servers/detail?tenant_id=eb93f8524768458a974c348b981921d5 => generated 15 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:46:42.869929 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4ca872fb-e1c0-4ff6-bfaf-dd6d0d2fc309 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:42.870936 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4ca872fb-e1c0-4ff6-bfaf-dd6d0d2fc309 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: bace4c1a-2c38-42b3-962d-ca87a3bfb7ba] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:42.891234 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ca872fb-e1c0-4ff6-bfaf-dd6d0d2fc309 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:42.896197 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ca872fb-e1c0-4ff6-bfaf-dd6d0d2fc309 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:42.896849 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ca872fb-e1c0-4ff6-bfaf-dd6d0d2fc309 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:42.898653 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ca872fb-e1c0-4ff6-bfaf-dd6d0d2fc309 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:42.900083 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ca872fb-e1c0-4ff6-bfaf-dd6d0d2fc309 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:42.903582 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ca872fb-e1c0-4ff6-bfaf-dd6d0d2fc309 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:43.329545 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4ca872fb-e1c0-4ff6-bfaf-dd6d0d2fc309 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c291cbe955b4ee5abc98132dda0255e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f9a24cad014d7f827e8f3236dd5bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:43.360557 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4ca872fb-e1c0-4ff6-bfaf-dd6d0d2fc309 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/bace4c1a-2c38-42b3-962d-ca87a3bfb7ba" status: 200 len: 1366 microversion: 2.1 time: 0.506392 Sep 08 10:46:43.378142 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1071/2127] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:42 2022] GET /compute/v2.1/servers/bace4c1a-2c38-42b3-962d-ca87a3bfb7ba => generated 1366 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:43.396764 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0e8e9829-2182-4339-adde-ed6a9a9705e5 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:43.419072 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0e8e9829-2182-4339-adde-ed6a9a9705e5 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Searching by: {'tenant_id': 'eb93f8524768458a974c348b981921d5', 'deleted': False} {{(pid=128861) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:46:43.435605 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e8e9829-2182-4339-adde-ed6a9a9705e5 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:43.438680 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e8e9829-2182-4339-adde-ed6a9a9705e5 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:43.441447 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e8e9829-2182-4339-adde-ed6a9a9705e5 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:43.445146 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e8e9829-2182-4339-adde-ed6a9a9705e5 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:43.445984 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e8e9829-2182-4339-adde-ed6a9a9705e5 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:43.446581 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e8e9829-2182-4339-adde-ed6a9a9705e5 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:43.560468 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.multi_cell_list [None req-0e8e9829-2182-4339-adde-ed6a9a9705e5 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128861) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 10:46:43.785064 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e8e9829-2182-4339-adde-ed6a9a9705e5 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:43.789239 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e8e9829-2182-4339-adde-ed6a9a9705e5 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:43.789850 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e8e9829-2182-4339-adde-ed6a9a9705e5 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:43.790969 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0ae43968-3f87-45a6-89f0-49bc9f72203d tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:43.799538 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0ae43968-3f87-45a6-89f0-49bc9f72203d tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/eca1ed67-f21d-46e3-8557-014bc6b63953" status: 200 len: 1510 microversion: 2.1 time: 1.253025 Sep 08 10:46:43.800108 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1057/2128] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:42 2022] GET /compute/v2.1/servers/eca1ed67-f21d-46e3-8557-014bc6b63953 => generated 1510 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:43.827072 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e0a61c78-34f2-4e14-a5c6-6200e210ee73 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:43.828090 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e0a61c78-34f2-4e14-a5c6-6200e210ee73 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: 1fc866b1-81ac-4c09-86ab-6d8a4a580294] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:43.845801 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0a61c78-34f2-4e14-a5c6-6200e210ee73 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:43.846528 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0a61c78-34f2-4e14-a5c6-6200e210ee73 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:43.847379 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0a61c78-34f2-4e14-a5c6-6200e210ee73 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:43.848259 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0a61c78-34f2-4e14-a5c6-6200e210ee73 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:43.849015 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0a61c78-34f2-4e14-a5c6-6200e210ee73 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:43.849704 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0a61c78-34f2-4e14-a5c6-6200e210ee73 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:43.878740 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-e0a61c78-34f2-4e14-a5c6-6200e210ee73 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] HTTP exception thrown: Instance 1fc866b1-81ac-4c09-86ab-6d8a4a580294 could not be found. Sep 08 10:46:43.881725 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e0a61c78-34f2-4e14-a5c6-6200e210ee73 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Request method failure captured: Sep 08 10:46:43.881725 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/1fc866b1-81ac-4c09-86ab-6d8a4a580294 HTTP/1.1 Sep 08 10:46:43.881725 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:46:43.881725 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:46:43.881725 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:46:43.881725 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:46:43.881725 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:46:43.881725 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:46:43.881725 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:46:43.881725 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:46:43.881725 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcX1wX6Qpf7IbEqK0znrUx8_LbU5RhxRt5QNO93yuGvepmmaO-HjP1nf79OOPUBjHW9MdcmnWuHxmJt_3mvzs2zsnsyhxC4842HKcCGy7uo7GyYhZnwsl7Op8-00YUPftmtBMh7Wps_XoCaQJPMiFlN-aLHQbjYqshHN9g8uR4tdIhI Sep 08 10:46:43.881725 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:46:43.881725 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:46:43.881725 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:46:43.881725 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:46:43.881725 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:46:43.881725 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:46:43.881725 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: c7f9807a4eb2473e87377097b0544d0e Sep 08 10:46:43.881725 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-LiveMigrationTest-49407157 Sep 08 10:46:43.881725 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:46:43.881725 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:46:43.881725 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c7f9807a4eb2473e87377097b0544d0e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c7f9807a4eb2473e87377097b0544d0e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c7f9807a4eb2473e87377097b0544d0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c7f9807a4eb2473e87377097b0544d0e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:46:43.881725 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-LiveMigrationTest-49407157 Sep 08 10:46:43.881725 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: c7f9807a4eb2473e87377097b0544d0e Sep 08 10:46:43.881725 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-LiveMigrationTest-49407157 Sep 08 10:46:43.881725 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-LiveMigrationTest-49407157-project Sep 08 10:46:43.881725 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:46:43.881725 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:46:43.881725 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 3ecf9924d86b4fd38a6f31430e9d3418 Sep 08 10:46:43.881725 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-LiveMigrationTest-49407157-project Sep 08 10:46:43.881725 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:46:43.881725 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 1fc866b1-81ac-4c09-86ab-6d8a4a580294 could not be found. Sep 08 10:46:43.881725 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '1fc866b1-81ac-4c09-86ab-6d8a4a580294'} Sep 08 10:46:43.881725 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:46:43.881725 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:46:43.881725 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:46:43.881725 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:46:43.881725 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:46:43.881725 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:46:43.881725 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:46:43.881725 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:46:43.881725 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:46:43.881725 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:46:43.881725 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fc866b1-81ac-4c09-86ab-6d8a4a580294 could not be found. Sep 08 10:46:43.881725 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:46:43.881725 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:46:43.881725 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:46:43.881725 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:46:43.881725 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:46:43.881725 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:46:43.881725 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:46:43.881725 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:46:43.881725 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:46:43.881725 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:46:43.881725 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:46:43.881725 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:46:43.881725 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:46:43.881725 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:46:43.881725 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:46:43.881725 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:46:43.881725 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fc866b1-81ac-4c09-86ab-6d8a4a580294 could not be found. Sep 08 10:46:43.881725 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:46:43.881725 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:46:43.881725 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:46:43.887065 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:46:43.887065 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:46:43.887065 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:46:43.887065 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:46:43.887065 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:46:43.887065 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fc866b1-81ac-4c09-86ab-6d8a4a580294 could not be found. Sep 08 10:46:43.887065 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:46:43.887065 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e0a61c78-34f2-4e14-a5c6-6200e210ee73 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Returning 404 to user: Instance 1fc866b1-81ac-4c09-86ab-6d8a4a580294 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:46:43.887065 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e0a61c78-34f2-4e14-a5c6-6200e210ee73 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/1fc866b1-81ac-4c09-86ab-6d8a4a580294" status: 404 len: 111 microversion: 2.1 time: 0.072523 Sep 08 10:46:43.887065 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1058/2129] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:43 2022] GET /compute/v2.1/servers/1fc866b1-81ac-4c09-86ab-6d8a4a580294 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:46:43.897923 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-184810ca-b0b0-4b94-813c-79d492d16f91 req-92822a0d-85f4-44c3-9d5b-1910a6ee8cf8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bace4c1a-2c38-42b3-962d-ca87a3bfb7ba", "tag": "b523e95a-b010-42e0-aa5e-9e3222767ffb"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:46:43.921611 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-184810ca-b0b0-4b94-813c-79d492d16f91 req-92822a0d-85f4-44c3-9d5b-1910a6ee8cf8 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:43.922071 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-184810ca-b0b0-4b94-813c-79d492d16f91 req-92822a0d-85f4-44c3-9d5b-1910a6ee8cf8 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:43.923018 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-184810ca-b0b0-4b94-813c-79d492d16f91 req-92822a0d-85f4-44c3-9d5b-1910a6ee8cf8 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:43.950971 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-184810ca-b0b0-4b94-813c-79d492d16f91 req-92822a0d-85f4-44c3-9d5b-1910a6ee8cf8 service nova] Creating event network-changed:b523e95a-b010-42e0-aa5e-9e3222767ffb for instance bace4c1a-2c38-42b3-962d-ca87a3bfb7ba on n-h2-850501-12 Sep 08 10:46:43.957273 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-184810ca-b0b0-4b94-813c-79d492d16f91 req-92822a0d-85f4-44c3-9d5b-1910a6ee8cf8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070156 Sep 08 10:46:43.958391 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1059/2130] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:46:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:46:43.965673 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-982f8269-8210-481c-8fc7-0518272e7397 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '.version_select at 0x7f68e8a88160>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:44.076330 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-982f8269-8210-481c-8fc7-0518272e7397 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/images/28783cea-dde6-431e-a46e-b87625b47518" status: 200 len: 1439 microversion: 2.1 time: 0.115260 Sep 08 10:46:44.077475 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1060/2131] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:46:43 2022] GET /compute/v2.1/images/28783cea-dde6-431e-a46e-b87625b47518 => generated 1439 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:44.083116 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e0e82348-30a7-4496-ba5b-598c3658cd2f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:44.084620 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e0e82348-30a7-4496-ba5b-598c3658cd2f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: ec8a85b1-636c-4699-8042-4dbefbc881f3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:44.093553 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0e82348-30a7-4496-ba5b-598c3658cd2f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:44.094874 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0e82348-30a7-4496-ba5b-598c3658cd2f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:44.096241 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0e82348-30a7-4496-ba5b-598c3658cd2f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:44.097209 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0e82348-30a7-4496-ba5b-598c3658cd2f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:44.097845 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0e82348-30a7-4496-ba5b-598c3658cd2f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:44.098421 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0e82348-30a7-4496-ba5b-598c3658cd2f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:44.147239 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e0e82348-30a7-4496-ba5b-598c3658cd2f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: ec8a85b1-636c-4699-8042-4dbefbc881f3] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:46:44.268370 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0e8e9829-2182-4339-adde-ed6a9a9705e5 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=eb93f8524768458a974c348b981921d5" status: 200 len: 4831 microversion: 2.1 time: 0.888292 Sep 08 10:46:44.269232 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1072/2132] 10.222.0.27 () {58 vars in 1257 bytes} [Thu Sep 8 10:46:43 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=eb93f8524768458a974c348b981921d5 => generated 4831 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:44.326712 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fea55339-58ca-45c4-909b-78e1ed73d701 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:44.351068 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fea55339-58ca-45c4-909b-78e1ed73d701 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Searching by: {'tenant_id': '5844ddb81d464eb696d7badefd6ec4d6', 'deleted': False} {{(pid=128861) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:46:44.356810 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e0e82348-30a7-4496-ba5b-598c3658cd2f tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ec8a85b1-636c-4699-8042-4dbefbc881f3" status: 204 len: 0 microversion: 2.1 time: 0.275026 Sep 08 10:46:44.358673 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1061/2133] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:46:44 2022] DELETE /compute/v2.1/servers/ec8a85b1-636c-4699-8042-4dbefbc881f3 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:46:44.363996 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fea55339-58ca-45c4-909b-78e1ed73d701 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:44.371205 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fea55339-58ca-45c4-909b-78e1ed73d701 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:44.372059 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fea55339-58ca-45c4-909b-78e1ed73d701 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:44.374170 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fea55339-58ca-45c4-909b-78e1ed73d701 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:44.376284 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fea55339-58ca-45c4-909b-78e1ed73d701 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:44.376950 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fea55339-58ca-45c4-909b-78e1ed73d701 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:44.388604 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-52d985b3-9f89-4151-be60-c314e66c29c7 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:44.399777 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-52d985b3-9f89-4151-be60-c314e66c29c7 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: ec8a85b1-636c-4699-8042-4dbefbc881f3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:44.418328 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-52d985b3-9f89-4151-be60-c314e66c29c7 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:44.419346 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-52d985b3-9f89-4151-be60-c314e66c29c7 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:44.420459 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-52d985b3-9f89-4151-be60-c314e66c29c7 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:44.423053 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-52d985b3-9f89-4151-be60-c314e66c29c7 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:44.424386 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-52d985b3-9f89-4151-be60-c314e66c29c7 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:44.425479 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-52d985b3-9f89-4151-be60-c314e66c29c7 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:44.527709 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fea55339-58ca-45c4-909b-78e1ed73d701 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=5844ddb81d464eb696d7badefd6ec4d6" status: 200 len: 15 microversion: 2.1 time: 0.214472 Sep 08 10:46:44.533675 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1073/2134] 10.222.0.27 () {58 vars in 1257 bytes} [Thu Sep 8 10:46:44 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=5844ddb81d464eb696d7badefd6ec4d6 => generated 15 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:46:44.572602 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-eaa2be38-cfa3-42d6-98ed-90012824df0b tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:44.574122 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-eaa2be38-cfa3-42d6-98ed-90012824df0b tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: bace4c1a-2c38-42b3-962d-ca87a3bfb7ba] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:44.585255 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eaa2be38-cfa3-42d6-98ed-90012824df0b tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:44.586076 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eaa2be38-cfa3-42d6-98ed-90012824df0b tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:44.586687 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eaa2be38-cfa3-42d6-98ed-90012824df0b tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:44.587502 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eaa2be38-cfa3-42d6-98ed-90012824df0b tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:44.587740 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eaa2be38-cfa3-42d6-98ed-90012824df0b tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:44.588322 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eaa2be38-cfa3-42d6-98ed-90012824df0b tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:44.608500 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:46:44.990922 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-eaa2be38-cfa3-42d6-98ed-90012824df0b tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c291cbe955b4ee5abc98132dda0255e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f9a24cad014d7f827e8f3236dd5bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:45.013018 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-eaa2be38-cfa3-42d6-98ed-90012824df0b tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/bace4c1a-2c38-42b3-962d-ca87a3bfb7ba" status: 200 len: 1366 microversion: 2.1 time: 0.460650 Sep 08 10:46:45.019115 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1074/2135] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:44 2022] GET /compute/v2.1/servers/bace4c1a-2c38-42b3-962d-ca87a3bfb7ba => generated 1366 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:45.028795 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-45e50855-235a-4f60-aacc-269e9ccffdab tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:45.055578 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-45e50855-235a-4f60-aacc-269e9ccffdab tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.033347 Sep 08 10:46:45.061065 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1075/2136] 10.222.0.27 () {58 vars in 1189 bytes} [Thu Sep 8 10:46:45 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:46:45.073504 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-494f0d32-21eb-4bf8-add4-06e7286482c3 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:45.074647 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-494f0d32-21eb-4bf8-add4-06e7286482c3 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: eca1ed67-f21d-46e3-8557-014bc6b63953] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:45.102922 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-494f0d32-21eb-4bf8-add4-06e7286482c3 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:45.103771 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-494f0d32-21eb-4bf8-add4-06e7286482c3 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:45.104545 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-494f0d32-21eb-4bf8-add4-06e7286482c3 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:45.105861 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-494f0d32-21eb-4bf8-add4-06e7286482c3 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:45.106713 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-494f0d32-21eb-4bf8-add4-06e7286482c3 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:45.115928 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-494f0d32-21eb-4bf8-add4-06e7286482c3 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:45.417296 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-52d985b3-9f89-4151-be60-c314e66c29c7 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:45.429894 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-52d985b3-9f89-4151-be60-c314e66c29c7 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/ec8a85b1-636c-4699-8042-4dbefbc881f3" status: 200 len: 1499 microversion: 2.1 time: 1.061199 Sep 08 10:46:45.431289 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1062/2137] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:44 2022] GET /compute/v2.1/servers/ec8a85b1-636c-4699-8042-4dbefbc881f3 => generated 1499 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:45.436781 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5a14dce4-5fde-43f6-8b0a-2b6e33969926 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '.version_select at 0x7f68e8b401f0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:45.498280 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-494f0d32-21eb-4bf8-add4-06e7286482c3 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:45.506697 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-494f0d32-21eb-4bf8-add4-06e7286482c3 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/eca1ed67-f21d-46e3-8557-014bc6b63953" status: 200 len: 1510 microversion: 2.1 time: 0.444029 Sep 08 10:46:45.508059 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5a14dce4-5fde-43f6-8b0a-2b6e33969926 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/images/28783cea-dde6-431e-a46e-b87625b47518" status: 200 len: 1439 microversion: 2.1 time: 0.075262 Sep 08 10:46:45.508342 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1076/2138] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:45 2022] GET /compute/v2.1/servers/eca1ed67-f21d-46e3-8557-014bc6b63953 => generated 1510 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:45.512991 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fd27ab90-886b-413a-9b8e-8030bc3ecbf7 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:46:45.515609 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fd27ab90-886b-413a-9b8e-8030bc3ecbf7 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] [instance: 3766b195-ace4-4563-a24e-dca72941251e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:45.522799 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fd27ab90-886b-413a-9b8e-8030bc3ecbf7 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:45.524641 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fd27ab90-886b-413a-9b8e-8030bc3ecbf7 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:45.525107 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fd27ab90-886b-413a-9b8e-8030bc3ecbf7 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:45.525982 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fd27ab90-886b-413a-9b8e-8030bc3ecbf7 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:45.526592 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fd27ab90-886b-413a-9b8e-8030bc3ecbf7 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:45.527091 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fd27ab90-886b-413a-9b8e-8030bc3ecbf7 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:45.527575 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1063/2139] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:46:45 2022] GET /compute/v2.1/images/28783cea-dde6-431e-a46e-b87625b47518 => generated 1439 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:45.723609 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fd27ab90-886b-413a-9b8e-8030bc3ecbf7 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e/action" status: 202 len: 0 microversion: 2.1 time: 0.208117 Sep 08 10:46:45.729365 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1077/2140] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:46:45 2022] POST /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:46:45.749299 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6d939bbd-43c3-43c6-af2e-4f7266ffe56b tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:45.773360 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6d939bbd-43c3-43c6-af2e-4f7266ffe56b tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:45.777610 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6d939bbd-43c3-43c6-af2e-4f7266ffe56b tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': 'eb93f8524768458a974c348b981921d5'} {{(pid=128861) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:46:45.812229 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6d939bbd-43c3-43c6-af2e-4f7266ffe56b tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:45.813602 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6d939bbd-43c3-43c6-af2e-4f7266ffe56b tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:45.814395 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6d939bbd-43c3-43c6-af2e-4f7266ffe56b tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:45.817781 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6d939bbd-43c3-43c6-af2e-4f7266ffe56b tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:45.823413 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6d939bbd-43c3-43c6-af2e-4f7266ffe56b tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:45.824326 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6d939bbd-43c3-43c6-af2e-4f7266ffe56b tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:46.144682 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.multi_cell_list [None req-6d939bbd-43c3-43c6-af2e-4f7266ffe56b tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128861) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 10:46:46.349064 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6d7fe25b-858d-40b6-ae64-e38f8b2f3186 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Action: 'create', calling method: .version_select at 0x7f68e8a615e0>, body: {"keypair": {"name": "tempest-keypair-928070625", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPh/6XXlkx0tdpudtV2YHFgulk0cDCVm4z5p8z9pxmjhszIewsYisd95h7jnnSc7pO94p2RMu+yjCU0qauuOMtG8lRXpwjaCyYOdMah5+qaBd+eE4Dw03GG7Q5QXKj0HHQ=="}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:46:46.380511 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-6d7fe25b-858d-40b6-ae64-e38f8b2f3186 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Getting quotas for project effe8e6c23114b8ab80e76bec365de60. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:46:46.392725 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-6d7fe25b-858d-40b6-ae64-e38f8b2f3186 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Getting quotas for user 528fc9fbb57149c9a9c755c6497f5c3a and project effe8e6c23114b8ab80e76bec365de60. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:46:46.433195 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6d7fe25b-858d-40b6-ae64-e38f8b2f3186 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.895665 Sep 08 10:46:46.442505 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1064/2141] 10.222.0.27 () {60 vars in 1159 bytes} [Thu Sep 8 10:46:45 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:46:46.454107 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-938c035c-ccd5-4016-b757-82f5e9cd6eb1 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:46.456264 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-938c035c-ccd5-4016-b757-82f5e9cd6eb1 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: bace4c1a-2c38-42b3-962d-ca87a3bfb7ba] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:46.469100 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-938c035c-ccd5-4016-b757-82f5e9cd6eb1 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:46.470571 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6d939bbd-43c3-43c6-af2e-4f7266ffe56b tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.738879 Sep 08 10:46:46.471555 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-938c035c-ccd5-4016-b757-82f5e9cd6eb1 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:46.473404 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-938c035c-ccd5-4016-b757-82f5e9cd6eb1 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:46.476527 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-938c035c-ccd5-4016-b757-82f5e9cd6eb1 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:46.477838 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-938c035c-ccd5-4016-b757-82f5e9cd6eb1 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:46.479254 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-938c035c-ccd5-4016-b757-82f5e9cd6eb1 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:46.489090 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1078/2142] 10.222.0.27 () {58 vars in 1150 bytes} [Thu Sep 8 10:46:45 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:46:46.508011 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f7c6e3bf-fafc-452c-aed7-465d58e3b103 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:46.508995 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f7c6e3bf-fafc-452c-aed7-465d58e3b103 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: ec8a85b1-636c-4699-8042-4dbefbc881f3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:46.540215 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f7c6e3bf-fafc-452c-aed7-465d58e3b103 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:46.541111 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f7c6e3bf-fafc-452c-aed7-465d58e3b103 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:46.541905 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f7c6e3bf-fafc-452c-aed7-465d58e3b103 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:46.543136 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f7c6e3bf-fafc-452c-aed7-465d58e3b103 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:46.554986 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f7c6e3bf-fafc-452c-aed7-465d58e3b103 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:46.556117 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f7c6e3bf-fafc-452c-aed7-465d58e3b103 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:47.224060 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f7c6e3bf-fafc-452c-aed7-465d58e3b103 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:47.246284 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f7c6e3bf-fafc-452c-aed7-465d58e3b103 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/ec8a85b1-636c-4699-8042-4dbefbc881f3" status: 200 len: 1499 microversion: 2.1 time: 0.760741 Sep 08 10:46:47.247654 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1079/2143] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:46 2022] GET /compute/v2.1/servers/ec8a85b1-636c-4699-8042-4dbefbc881f3 => generated 1499 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:47.265222 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bc5e57fd-06ca-4f07-b7c5-3e3cc2f1ecb9 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:46:47.277425 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bc5e57fd-06ca-4f07-b7c5-3e3cc2f1ecb9 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] [instance: 3766b195-ace4-4563-a24e-dca72941251e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:47.287033 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-938c035c-ccd5-4016-b757-82f5e9cd6eb1 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c291cbe955b4ee5abc98132dda0255e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f9a24cad014d7f827e8f3236dd5bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:47.292183 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bc5e57fd-06ca-4f07-b7c5-3e3cc2f1ecb9 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:47.295172 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bc5e57fd-06ca-4f07-b7c5-3e3cc2f1ecb9 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:47.296432 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bc5e57fd-06ca-4f07-b7c5-3e3cc2f1ecb9 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:47.300851 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bc5e57fd-06ca-4f07-b7c5-3e3cc2f1ecb9 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:47.302289 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bc5e57fd-06ca-4f07-b7c5-3e3cc2f1ecb9 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:47.302929 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bc5e57fd-06ca-4f07-b7c5-3e3cc2f1ecb9 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:47.303815 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-938c035c-ccd5-4016-b757-82f5e9cd6eb1 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/bace4c1a-2c38-42b3-962d-ca87a3bfb7ba" status: 200 len: 1366 microversion: 2.1 time: 0.858853 Sep 08 10:46:47.345617 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1065/2144] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:46 2022] GET /compute/v2.1/servers/bace4c1a-2c38-42b3-962d-ca87a3bfb7ba => generated 1366 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:47.361568 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3149affe-252f-4d50-8270-fb417c109187 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:47.362845 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3149affe-252f-4d50-8270-fb417c109187 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: eca1ed67-f21d-46e3-8557-014bc6b63953] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:47.370845 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:46:47.379013 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3149affe-252f-4d50-8270-fb417c109187 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:47.385174 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3149affe-252f-4d50-8270-fb417c109187 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:47.387916 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3149affe-252f-4d50-8270-fb417c109187 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:47.393613 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3149affe-252f-4d50-8270-fb417c109187 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:47.396523 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3149affe-252f-4d50-8270-fb417c109187 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:47.398767 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3149affe-252f-4d50-8270-fb417c109187 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:47.555672 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bc5e57fd-06ca-4f07-b7c5-3e3cc2f1ecb9 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e/action" status: 202 len: 0 microversion: 2.1 time: 0.304219 Sep 08 10:46:47.561569 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1080/2145] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:46:47 2022] POST /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e/action => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:46:47.607746 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7dbc5fe8-49e7-48da-8ed9-f3d49cd5b65b tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '.version_select at 0x7f68e892fe50>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:48.148235 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3149affe-252f-4d50-8270-fb417c109187 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:48.162717 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3149affe-252f-4d50-8270-fb417c109187 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/eca1ed67-f21d-46e3-8557-014bc6b63953" status: 200 len: 1510 microversion: 2.1 time: 0.813715 Sep 08 10:46:48.163634 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1066/2146] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:47 2022] GET /compute/v2.1/servers/eca1ed67-f21d-46e3-8557-014bc6b63953 => generated 1510 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:48.181603 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-0f7b98f1-12b1-4e75-baa9-b882c73d7f3b req-a67f5ec0-abca-4fd4-ab85-99eca2a915a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec8a85b1-636c-4699-8042-4dbefbc881f3", "name": "network-vif-deleted", "tag": "820cda60-30f4-4974-ab85-eee32186c6c0"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:46:48.214896 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-0f7b98f1-12b1-4e75-baa9-b882c73d7f3b req-a67f5ec0-abca-4fd4-ab85-99eca2a915a6 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:48.216263 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-0f7b98f1-12b1-4e75-baa9-b882c73d7f3b req-a67f5ec0-abca-4fd4-ab85-99eca2a915a6 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:48.217282 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-0f7b98f1-12b1-4e75-baa9-b882c73d7f3b req-a67f5ec0-abca-4fd4-ab85-99eca2a915a6 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:48.267717 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-0f7b98f1-12b1-4e75-baa9-b882c73d7f3b req-a67f5ec0-abca-4fd4-ab85-99eca2a915a6 service nova] Creating event network-vif-deleted:820cda60-30f4-4974-ab85-eee32186c6c0 for instance ec8a85b1-636c-4699-8042-4dbefbc881f3 on n-h2-850501-12 Sep 08 10:46:48.308413 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-0f7b98f1-12b1-4e75-baa9-b882c73d7f3b req-a67f5ec0-abca-4fd4-ab85-99eca2a915a6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140960 Sep 08 10:46:48.309052 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1067/2147] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:46:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:46:48.329518 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7dbc5fe8-49e7-48da-8ed9-f3d49cd5b65b tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/images/28783cea-dde6-431e-a46e-b87625b47518" status: 200 len: 1439 microversion: 2.1 time: 0.752858 Sep 08 10:46:48.334279 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1081/2148] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:46:47 2022] GET /compute/v2.1/images/28783cea-dde6-431e-a46e-b87625b47518 => generated 1439 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:48.355484 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c996f155-0d1b-45f3-8643-e8e8fb9c9b5c tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:48.356457 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c996f155-0d1b-45f3-8643-e8e8fb9c9b5c tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] [instance: 3766b195-ace4-4563-a24e-dca72941251e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:48.357403 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-71ca1fd7-0238-4793-a5c8-ab735bd4c374 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:48.358821 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-71ca1fd7-0238-4793-a5c8-ab735bd4c374 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: ec8a85b1-636c-4699-8042-4dbefbc881f3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:48.380556 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-71ca1fd7-0238-4793-a5c8-ab735bd4c374 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:48.382098 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-71ca1fd7-0238-4793-a5c8-ab735bd4c374 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:48.384948 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-71ca1fd7-0238-4793-a5c8-ab735bd4c374 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:48.387167 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-71ca1fd7-0238-4793-a5c8-ab735bd4c374 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:48.387842 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-71ca1fd7-0238-4793-a5c8-ab735bd4c374 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:48.389983 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-71ca1fd7-0238-4793-a5c8-ab735bd4c374 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:48.404644 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c996f155-0d1b-45f3-8643-e8e8fb9c9b5c tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:48.405464 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c996f155-0d1b-45f3-8643-e8e8fb9c9b5c tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:48.412509 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c996f155-0d1b-45f3-8643-e8e8fb9c9b5c tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:48.423500 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c996f155-0d1b-45f3-8643-e8e8fb9c9b5c tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:48.434738 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c996f155-0d1b-45f3-8643-e8e8fb9c9b5c tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:48.435802 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c996f155-0d1b-45f3-8643-e8e8fb9c9b5c tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:48.454837 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-71ca1fd7-0238-4793-a5c8-ab735bd4c374 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:48.462007 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-71ca1fd7-0238-4793-a5c8-ab735bd4c374 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:48.463171 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-71ca1fd7-0238-4793-a5c8-ab735bd4c374 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:48.468493 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-71ca1fd7-0238-4793-a5c8-ab735bd4c374 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lazy-loading 'fault' on Instance uuid ec8a85b1-636c-4699-8042-4dbefbc881f3 {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:46:48.582322 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-71ca1fd7-0238-4793-a5c8-ab735bd4c374 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ecf9924d86b4fd38a6f31430e9d3418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f9807a4eb2473e87377097b0544d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:48.599747 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-71ca1fd7-0238-4793-a5c8-ab735bd4c374 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/ec8a85b1-636c-4699-8042-4dbefbc881f3" status: 200 len: 1300 microversion: 2.1 time: 0.255868 Sep 08 10:46:48.603668 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1082/2149] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:48 2022] GET /compute/v2.1/servers/ec8a85b1-636c-4699-8042-4dbefbc881f3 => generated 1300 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:48.608796 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-72d84782-b8bb-42b2-9308-bd16e4e507be tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:48.609974 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-72d84782-b8bb-42b2-9308-bd16e4e507be tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: bace4c1a-2c38-42b3-962d-ca87a3bfb7ba] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:48.655206 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-72d84782-b8bb-42b2-9308-bd16e4e507be tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:48.658037 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-72d84782-b8bb-42b2-9308-bd16e4e507be tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:48.659574 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-72d84782-b8bb-42b2-9308-bd16e4e507be tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:48.662451 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-72d84782-b8bb-42b2-9308-bd16e4e507be tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:48.662943 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-72d84782-b8bb-42b2-9308-bd16e4e507be tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:48.663390 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-72d84782-b8bb-42b2-9308-bd16e4e507be tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:48.972821 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c996f155-0d1b-45f3-8643-e8e8fb9c9b5c tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e" status: 200 len: 1616 microversion: 2.1 time: 0.645017 Sep 08 10:46:48.983332 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1068/2150] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:48 2022] GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e => generated 1616 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:48.993392 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-72d84782-b8bb-42b2-9308-bd16e4e507be tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c291cbe955b4ee5abc98132dda0255e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f9a24cad014d7f827e8f3236dd5bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:49.003417 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-72d84782-b8bb-42b2-9308-bd16e4e507be tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/bace4c1a-2c38-42b3-962d-ca87a3bfb7ba" status: 200 len: 1366 microversion: 2.1 time: 0.398412 Sep 08 10:46:49.004851 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1083/2151] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:48 2022] GET /compute/v2.1/servers/bace4c1a-2c38-42b3-962d-ca87a3bfb7ba => generated 1366 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:49.026724 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-24049d38-642b-4618-8276-eb2b5f8f09c3 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:49.026724 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-24049d38-642b-4618-8276-eb2b5f8f09c3 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] [instance: 3766b195-ace4-4563-a24e-dca72941251e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:49.048770 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24049d38-642b-4618-8276-eb2b5f8f09c3 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:49.049380 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24049d38-642b-4618-8276-eb2b5f8f09c3 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:49.049838 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24049d38-642b-4618-8276-eb2b5f8f09c3 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:49.050589 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24049d38-642b-4618-8276-eb2b5f8f09c3 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:49.051067 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24049d38-642b-4618-8276-eb2b5f8f09c3 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:49.051501 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24049d38-642b-4618-8276-eb2b5f8f09c3 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:49.227305 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4e51f382-7c27-4c49-ad80-2c23a234eca0 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1527809420", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:46:49.316610 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-24049d38-642b-4618-8276-eb2b5f8f09c3 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e" status: 200 len: 1616 microversion: 2.1 time: 0.297906 Sep 08 10:46:49.317174 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1084/2152] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:49 2022] GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e => generated 1616 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:49.331756 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-4e51f382-7c27-4c49-ad80-2c23a234eca0 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] validate_networks() for None {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:46:49.337945 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-411f3302-2c82-423b-9440-331b0ff895ad tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:49.338584 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-411f3302-2c82-423b-9440-331b0ff895ad tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: eca1ed67-f21d-46e3-8557-014bc6b63953] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:49.360881 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-411f3302-2c82-423b-9440-331b0ff895ad tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:49.361782 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-411f3302-2c82-423b-9440-331b0ff895ad tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:49.362337 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-411f3302-2c82-423b-9440-331b0ff895ad tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:49.363166 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-411f3302-2c82-423b-9440-331b0ff895ad tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:49.364047 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-411f3302-2c82-423b-9440-331b0ff895ad tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:49.364613 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-411f3302-2c82-423b-9440-331b0ff895ad tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:49.638006 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-411f3302-2c82-423b-9440-331b0ff895ad tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:49.653517 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-411f3302-2c82-423b-9440-331b0ff895ad tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/eca1ed67-f21d-46e3-8557-014bc6b63953" status: 200 len: 1510 microversion: 2.1 time: 0.326985 Sep 08 10:46:49.654468 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1085/2153] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:49 2022] GET /compute/v2.1/servers/eca1ed67-f21d-46e3-8557-014bc6b63953 => generated 1510 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:49.660538 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-07928197-14a0-4a4a-8145-2de1ced45982 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '.version_select at 0x7f68e89b8e50>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:49.689792 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=4 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:46:49.719217 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-4e51f382-7c27-4c49-ad80-2c23a234eca0 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:46:49.719647 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-4e51f382-7c27-4c49-ad80-2c23a234eca0 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:46:49.720370 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-4e51f382-7c27-4c49-ad80-2c23a234eca0 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:46:49.720930 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-4e51f382-7c27-4c49-ad80-2c23a234eca0 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:46:49.721682 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-4e51f382-7c27-4c49-ad80-2c23a234eca0 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:46:49.741231 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-07928197-14a0-4a4a-8145-2de1ced45982 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/images/28783cea-dde6-431e-a46e-b87625b47518" status: 200 len: 1439 microversion: 2.1 time: 0.085113 Sep 08 10:46:49.742622 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1086/2154] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:46:49 2022] GET /compute/v2.1/images/28783cea-dde6-431e-a46e-b87625b47518 => generated 1439 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:49.748792 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e51f382-7c27-4c49-ad80-2c23a234eca0 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:49.749325 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e51f382-7c27-4c49-ad80-2c23a234eca0 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:49.749784 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e51f382-7c27-4c49-ad80-2c23a234eca0 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:49.751167 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e51f382-7c27-4c49-ad80-2c23a234eca0 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:49.751648 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e51f382-7c27-4c49-ad80-2c23a234eca0 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:49.752059 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e51f382-7c27-4c49-ad80-2c23a234eca0 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:49.754371 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2bb49e84-ff5c-442d-974b-d6f58570b855 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:49.776779 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2bb49e84-ff5c-442d-974b-d6f58570b855 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Searching by: {'host': 'n-h2-850501-12', 'deleted': False} {{(pid=128861) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:46:49.787449 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2bb49e84-ff5c-442d-974b-d6f58570b855 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:49.788498 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2bb49e84-ff5c-442d-974b-d6f58570b855 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:49.789368 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2bb49e84-ff5c-442d-974b-d6f58570b855 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:49.790725 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2bb49e84-ff5c-442d-974b-d6f58570b855 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:49.791610 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2bb49e84-ff5c-442d-974b-d6f58570b855 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:49.792449 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2bb49e84-ff5c-442d-974b-d6f58570b855 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:49.800213 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-4e51f382-7c27-4c49-ad80-2c23a234eca0 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Getting quotas for project 7cfab473734f4b63aaa78508ef460a9f. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:46:49.820631 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-4e51f382-7c27-4c49-ad80-2c23a234eca0 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Getting quotas for user 416642c1ee664b4d9e0fb14d02266b37 and project 7cfab473734f4b63aaa78508ef460a9f. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:46:49.854674 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4e51f382-7c27-4c49-ad80-2c23a234eca0 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:46:49.864167 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4e51f382-7c27-4c49-ad80-2c23a234eca0 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] [instance: 33157107-6744-4177-9c29-3822a7d34ff9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:46:49.979468 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4e51f382-7c27-4c49-ad80-2c23a234eca0 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.969270 Sep 08 10:46:49.984112 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1069/2155] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:46:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 974 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:46:50.005680 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1e3f3e78-4380-4064-9c4a-c111a9c5e904 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:50.008721 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1e3f3e78-4380-4064-9c4a-c111a9c5e904 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] [instance: ec8a85b1-636c-4699-8042-4dbefbc881f3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:50.020854 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.multi_cell_list [None req-2bb49e84-ff5c-442d-974b-d6f58570b855 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Listed batch of 4 results from cell out of 1000 limit. Returned 4 total so far. {{(pid=128861) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 10:46:50.025370 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e3f3e78-4380-4064-9c4a-c111a9c5e904 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:50.025873 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e3f3e78-4380-4064-9c4a-c111a9c5e904 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:50.026310 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e3f3e78-4380-4064-9c4a-c111a9c5e904 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:50.027030 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e3f3e78-4380-4064-9c4a-c111a9c5e904 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:50.027483 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e3f3e78-4380-4064-9c4a-c111a9c5e904 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:50.027905 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e3f3e78-4380-4064-9c4a-c111a9c5e904 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:50.069658 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-1e3f3e78-4380-4064-9c4a-c111a9c5e904 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] HTTP exception thrown: Instance ec8a85b1-636c-4699-8042-4dbefbc881f3 could not be found. Sep 08 10:46:50.074933 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1e3f3e78-4380-4064-9c4a-c111a9c5e904 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Request method failure captured: Sep 08 10:46:50.074933 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/ec8a85b1-636c-4699-8042-4dbefbc881f3 HTTP/1.1 Sep 08 10:46:50.074933 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:46:50.074933 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:46:50.074933 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:46:50.074933 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:46:50.074933 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:46:50.074933 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:46:50.074933 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:46:50.074933 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:46:50.074933 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcX1wX6Qpf7IbEqK0znrUx8_LbU5RhxRt5QNO93yuGvepmmaO-HjP1nf79OOPUBjHW9MdcmnWuHxmJt_3mvzs2zsnsyhxC4842HKcCGy7uo7GyYhZnwsl7Op8-00YUPftmtBMh7Wps_XoCaQJPMiFlN-aLHQbjYqshHN9g8uR4tdIhI Sep 08 10:46:50.074933 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:46:50.074933 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:46:50.074933 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:46:50.074933 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:46:50.074933 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:46:50.074933 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:46:50.074933 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: c7f9807a4eb2473e87377097b0544d0e Sep 08 10:46:50.074933 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-LiveMigrationTest-49407157 Sep 08 10:46:50.074933 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:46:50.074933 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:46:50.074933 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c7f9807a4eb2473e87377097b0544d0e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c7f9807a4eb2473e87377097b0544d0e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c7f9807a4eb2473e87377097b0544d0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c7f9807a4eb2473e87377097b0544d0e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:46:50.074933 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-LiveMigrationTest-49407157 Sep 08 10:46:50.074933 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: c7f9807a4eb2473e87377097b0544d0e Sep 08 10:46:50.074933 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-LiveMigrationTest-49407157 Sep 08 10:46:50.074933 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-LiveMigrationTest-49407157-project Sep 08 10:46:50.074933 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:46:50.074933 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:46:50.074933 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 3ecf9924d86b4fd38a6f31430e9d3418 Sep 08 10:46:50.074933 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-LiveMigrationTest-49407157-project Sep 08 10:46:50.074933 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:46:50.074933 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance ec8a85b1-636c-4699-8042-4dbefbc881f3 could not be found. Sep 08 10:46:50.074933 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'ec8a85b1-636c-4699-8042-4dbefbc881f3'} Sep 08 10:46:50.074933 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:46:50.074933 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:46:50.074933 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:46:50.074933 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:46:50.074933 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:46:50.074933 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:46:50.074933 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:46:50.074933 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:46:50.074933 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:46:50.074933 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:46:50.074933 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec8a85b1-636c-4699-8042-4dbefbc881f3 could not be found. Sep 08 10:46:50.074933 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:46:50.074933 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:46:50.074933 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:46:50.074933 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:46:50.074933 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:46:50.074933 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:46:50.074933 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:46:50.074933 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:46:50.074933 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:46:50.074933 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:46:50.074933 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:46:50.074933 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:46:50.074933 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:46:50.074933 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:46:50.074933 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:46:50.074933 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:46:50.074933 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec8a85b1-636c-4699-8042-4dbefbc881f3 could not be found. Sep 08 10:46:50.074933 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:46:50.074933 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:46:50.074933 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:46:50.079229 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:46:50.079229 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:46:50.079229 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:46:50.079229 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:46:50.079229 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:46:50.079229 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec8a85b1-636c-4699-8042-4dbefbc881f3 could not be found. Sep 08 10:46:50.079229 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:46:50.082432 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1e3f3e78-4380-4064-9c4a-c111a9c5e904 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] Returning 404 to user: Instance ec8a85b1-636c-4699-8042-4dbefbc881f3 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:46:50.084460 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1e3f3e78-4380-4064-9c4a-c111a9c5e904 tempest-LiveMigrationTest-49407157 tempest-LiveMigrationTest-49407157-project] 10.222.0.27 "GET /compute/v2.1/servers/ec8a85b1-636c-4699-8042-4dbefbc881f3" status: 404 len: 111 microversion: 2.1 time: 0.097748 Sep 08 10:46:50.087319 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1070/2156] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:49 2022] GET /compute/v2.1/servers/ec8a85b1-636c-4699-8042-4dbefbc881f3 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:46:50.111597 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-610a19ce-9c0a-4c3b-a242-01b997a0d904 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:50.122441 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-610a19ce-9c0a-4c3b-a242-01b997a0d904 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] [instance: 33157107-6744-4177-9c29-3822a7d34ff9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:50.462415 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-610a19ce-9c0a-4c3b-a242-01b997a0d904 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416642c1ee664b4d9e0fb14d02266b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cfab473734f4b63aaa78508ef460a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:50.469597 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2bb49e84-ff5c-442d-974b-d6f58570b855 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] 10.222.0.27 "GET /compute/v2.1/servers?host=n-h2-850501-12&all_tenants=1" status: 200 len: 1314 microversion: 2.1 time: 0.713540 Sep 08 10:46:50.470506 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1087/2157] 10.222.0.27 () {58 vars in 1192 bytes} [Thu Sep 8 10:46:49 2022] GET /compute/v2.1/servers?host=n-h2-850501-12&all_tenants=1 => generated 1314 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:50.475415 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-610a19ce-9c0a-4c3b-a242-01b997a0d904 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] 10.222.0.27 "GET /compute/v2.1/servers/33157107-6744-4177-9c29-3822a7d34ff9" status: 200 len: 1219 microversion: 2.1 time: 0.386816 Sep 08 10:46:50.480152 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1071/2158] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:50 2022] GET /compute/v2.1/servers/33157107-6744-4177-9c29-3822a7d34ff9 => generated 1219 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:50.483230 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-92a29c99-4119-418f-971f-9200d34f3099 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:50.491993 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-a49952a5-9e2c-4e21-a365-64dac437d42d req-5b21f7a6-2567-49c3-8d4e-9ae5b6179608 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bace4c1a-2c38-42b3-962d-ca87a3bfb7ba", "name": "network-vif-plugged", "status": "completed", "tag": "b523e95a-b010-42e0-aa5e-9e3222767ffb"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:46:50.508570 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-92a29c99-4119-418f-971f-9200d34f3099 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: bace4c1a-2c38-42b3-962d-ca87a3bfb7ba] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:50.556296 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a49952a5-9e2c-4e21-a365-64dac437d42d req-5b21f7a6-2567-49c3-8d4e-9ae5b6179608 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:50.556794 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a49952a5-9e2c-4e21-a365-64dac437d42d req-5b21f7a6-2567-49c3-8d4e-9ae5b6179608 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:50.557259 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a49952a5-9e2c-4e21-a365-64dac437d42d req-5b21f7a6-2567-49c3-8d4e-9ae5b6179608 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:50.566777 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-92a29c99-4119-418f-971f-9200d34f3099 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:50.573367 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-92a29c99-4119-418f-971f-9200d34f3099 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:50.574075 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-92a29c99-4119-418f-971f-9200d34f3099 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:50.575652 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-92a29c99-4119-418f-971f-9200d34f3099 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:50.580380 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-92a29c99-4119-418f-971f-9200d34f3099 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:50.582889 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-92a29c99-4119-418f-971f-9200d34f3099 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:50.602031 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-a49952a5-9e2c-4e21-a365-64dac437d42d req-5b21f7a6-2567-49c3-8d4e-9ae5b6179608 service nova] Creating event network-vif-plugged:b523e95a-b010-42e0-aa5e-9e3222767ffb for instance bace4c1a-2c38-42b3-962d-ca87a3bfb7ba on n-h2-850501-12 Sep 08 10:46:50.612339 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-a49952a5-9e2c-4e21-a365-64dac437d42d req-5b21f7a6-2567-49c3-8d4e-9ae5b6179608 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123703 Sep 08 10:46:50.617556 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1072/2159] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:46:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:46:50.636899 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-39957552-5a9e-4a70-abad-ccc1aa2ca384 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:50.664392 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-39957552-5a9e-4a70-abad-ccc1aa2ca384 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=128862) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:46:50.705803 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-39957552-5a9e-4a70-abad-ccc1aa2ca384 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:50.706445 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-39957552-5a9e-4a70-abad-ccc1aa2ca384 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:50.707195 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-39957552-5a9e-4a70-abad-ccc1aa2ca384 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:50.708507 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-39957552-5a9e-4a70-abad-ccc1aa2ca384 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:50.711323 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-39957552-5a9e-4a70-abad-ccc1aa2ca384 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:50.714002 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-39957552-5a9e-4a70-abad-ccc1aa2ca384 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:51.037827 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-39957552-5a9e-4a70-abad-ccc1aa2ca384 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] 10.222.0.27 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.416817 Sep 08 10:46:51.039295 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1073/2160] 10.222.0.27 () {58 vars in 1196 bytes} [Thu Sep 8 10:46:50 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:46:51.055763 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-afbad729-e27c-4430-a991-0a9547f61747 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:51.060237 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-afbad729-e27c-4430-a991-0a9547f61747 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: eca1ed67-f21d-46e3-8557-014bc6b63953] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:51.072956 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-afbad729-e27c-4430-a991-0a9547f61747 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:51.074631 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-afbad729-e27c-4430-a991-0a9547f61747 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:51.075700 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-afbad729-e27c-4430-a991-0a9547f61747 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:51.077286 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-afbad729-e27c-4430-a991-0a9547f61747 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:51.078918 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-afbad729-e27c-4430-a991-0a9547f61747 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:51.079938 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-afbad729-e27c-4430-a991-0a9547f61747 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:51.490984 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-92a29c99-4119-418f-971f-9200d34f3099 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c291cbe955b4ee5abc98132dda0255e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f9a24cad014d7f827e8f3236dd5bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:51.518200 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-92a29c99-4119-418f-971f-9200d34f3099 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/bace4c1a-2c38-42b3-962d-ca87a3bfb7ba" status: 200 len: 1366 microversion: 2.1 time: 1.038992 Sep 08 10:46:51.518706 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1088/2161] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:50 2022] GET /compute/v2.1/servers/bace4c1a-2c38-42b3-962d-ca87a3bfb7ba => generated 1366 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:51.537751 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9cb2effc-3a22-4d09-b294-ebddd4bb9f38 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '.version_select at 0x7f68e8a05f70>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:51.655588 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9cb2effc-3a22-4d09-b294-ebddd4bb9f38 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/images/28783cea-dde6-431e-a46e-b87625b47518" status: 200 len: 1439 microversion: 2.1 time: 0.131109 Sep 08 10:46:51.658272 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1089/2162] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:46:51 2022] GET /compute/v2.1/images/28783cea-dde6-431e-a46e-b87625b47518 => generated 1439 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:51.680352 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9f482171-3259-49ae-b8db-6e1f56a72cc0 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:46:51.695944 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9f482171-3259-49ae-b8db-6e1f56a72cc0 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] [instance: 3766b195-ace4-4563-a24e-dca72941251e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:51.757209 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f482171-3259-49ae-b8db-6e1f56a72cc0 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:51.758096 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f482171-3259-49ae-b8db-6e1f56a72cc0 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:51.758876 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f482171-3259-49ae-b8db-6e1f56a72cc0 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:51.760177 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f482171-3259-49ae-b8db-6e1f56a72cc0 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:51.761009 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f482171-3259-49ae-b8db-6e1f56a72cc0 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:51.792450 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f482171-3259-49ae-b8db-6e1f56a72cc0 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:51.909369 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:46:52.069959 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9f482171-3259-49ae-b8db-6e1f56a72cc0 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e/action" status: 202 len: 0 microversion: 2.1 time: 0.405007 Sep 08 10:46:52.078751 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1090/2163] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:46:51 2022] POST /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e/action => generated 0 bytes in 415 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:46:52.092479 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cd457530-78fb-4033-af72-d21280619e6f tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:52.095957 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cd457530-78fb-4033-af72-d21280619e6f tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] [instance: 33157107-6744-4177-9c29-3822a7d34ff9] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:52.121894 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cd457530-78fb-4033-af72-d21280619e6f tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:52.122966 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cd457530-78fb-4033-af72-d21280619e6f tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:52.123791 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cd457530-78fb-4033-af72-d21280619e6f tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:52.129662 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cd457530-78fb-4033-af72-d21280619e6f tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:52.131818 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cd457530-78fb-4033-af72-d21280619e6f tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:52.133903 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cd457530-78fb-4033-af72-d21280619e6f tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:52.376546 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-afbad729-e27c-4430-a991-0a9547f61747 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:52.405738 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-afbad729-e27c-4430-a991-0a9547f61747 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/eca1ed67-f21d-46e3-8557-014bc6b63953" status: 200 len: 1510 microversion: 2.1 time: 1.360236 Sep 08 10:46:52.407055 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1074/2164] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:51 2022] GET /compute/v2.1/servers/eca1ed67-f21d-46e3-8557-014bc6b63953 => generated 1510 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:52.420737 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-390180e1-0139-4d73-8bbc-598fd4d41dfa tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:46:52.428560 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-390180e1-0139-4d73-8bbc-598fd4d41dfa tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: 3766b195-ace4-4563-a24e-dca72941251e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:52.442347 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-390180e1-0139-4d73-8bbc-598fd4d41dfa tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:52.443659 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-390180e1-0139-4d73-8bbc-598fd4d41dfa tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:52.445308 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-390180e1-0139-4d73-8bbc-598fd4d41dfa tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:52.446330 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-390180e1-0139-4d73-8bbc-598fd4d41dfa tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:52.446943 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-390180e1-0139-4d73-8bbc-598fd4d41dfa tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:52.447529 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-390180e1-0139-4d73-8bbc-598fd4d41dfa tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:52.481018 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-cd457530-78fb-4033-af72-d21280619e6f tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416642c1ee664b4d9e0fb14d02266b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cfab473734f4b63aaa78508ef460a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:52.509756 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cd457530-78fb-4033-af72-d21280619e6f tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] 10.222.0.27 "GET /compute/v2.1/servers/33157107-6744-4177-9c29-3822a7d34ff9" status: 200 len: 1215 microversion: 2.1 time: 0.428720 Sep 08 10:46:52.512653 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1091/2165] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:52 2022] GET /compute/v2.1/servers/33157107-6744-4177-9c29-3822a7d34ff9 => generated 1215 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:52.565364 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7ca3c833-09c4-4f24-9254-8e04a79c6119 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:52.568405 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7ca3c833-09c4-4f24-9254-8e04a79c6119 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: bace4c1a-2c38-42b3-962d-ca87a3bfb7ba] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:52.595762 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7ca3c833-09c4-4f24-9254-8e04a79c6119 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:52.597112 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7ca3c833-09c4-4f24-9254-8e04a79c6119 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:52.603373 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7ca3c833-09c4-4f24-9254-8e04a79c6119 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:52.605303 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7ca3c833-09c4-4f24-9254-8e04a79c6119 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:52.606265 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7ca3c833-09c4-4f24-9254-8e04a79c6119 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:52.610188 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7ca3c833-09c4-4f24-9254-8e04a79c6119 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:52.713161 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-390180e1-0139-4d73-8bbc-598fd4d41dfa tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:46:52.713805 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-390180e1-0139-4d73-8bbc-598fd4d41dfa tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:46:52.714403 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-390180e1-0139-4d73-8bbc-598fd4d41dfa tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:46:52.714900 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-390180e1-0139-4d73-8bbc-598fd4d41dfa tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:46:52.719772 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-390180e1-0139-4d73-8bbc-598fd4d41dfa tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:46:52.926416 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-390180e1-0139-4d73-8bbc-598fd4d41dfa tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: 3766b195-ace4-4563-a24e-dca72941251e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:52.943908 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-390180e1-0139-4d73-8bbc-598fd4d41dfa tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:52.944951 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-390180e1-0139-4d73-8bbc-598fd4d41dfa tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:52.945820 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-390180e1-0139-4d73-8bbc-598fd4d41dfa tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:52.947166 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-390180e1-0139-4d73-8bbc-598fd4d41dfa tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:52.948000 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-390180e1-0139-4d73-8bbc-598fd4d41dfa tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:52.948805 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-390180e1-0139-4d73-8bbc-598fd4d41dfa tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:53.036188 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-390180e1-0139-4d73-8bbc-598fd4d41dfa tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "POST /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e/action" status: 202 len: 1067 microversion: 2.1 time: 0.625121 Sep 08 10:46:53.048407 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1075/2166] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:46:52 2022] POST /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e/action => generated 1067 bytes in 639 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 08 10:46:53.088142 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d126ea95-ae20-43d5-9f68-758a73d8d33d tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '.version_select at 0x7f68e8b40280>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:53.226041 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d126ea95-ae20-43d5-9f68-758a73d8d33d tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/images/28783cea-dde6-431e-a46e-b87625b47518" status: 200 len: 1439 microversion: 2.1 time: 0.175861 Sep 08 10:46:53.235282 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1076/2167] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:46:53 2022] GET /compute/v2.1/images/28783cea-dde6-431e-a46e-b87625b47518 => generated 1439 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:53.257622 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c621dfa4-9421-4028-918d-db266a03297b tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:53.267064 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c621dfa4-9421-4028-918d-db266a03297b tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: 3766b195-ace4-4563-a24e-dca72941251e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:53.292002 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c621dfa4-9421-4028-918d-db266a03297b tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:53.294545 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c621dfa4-9421-4028-918d-db266a03297b tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:53.299304 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c621dfa4-9421-4028-918d-db266a03297b tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:53.300710 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c621dfa4-9421-4028-918d-db266a03297b tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:53.301994 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c621dfa4-9421-4028-918d-db266a03297b tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:53.302527 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c621dfa4-9421-4028-918d-db266a03297b tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:53.392381 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:46:53.679368 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c621dfa4-9421-4028-918d-db266a03297b tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:53.697751 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c621dfa4-9421-4028-918d-db266a03297b tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e" status: 200 len: 1471 microversion: 2.1 time: 0.460280 Sep 08 10:46:53.702413 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1077/2168] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:53 2022] GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e => generated 1471 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:53.717957 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3e6b6e85-84bb-4b3d-a663-e87336bd146a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:53.719615 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3e6b6e85-84bb-4b3d-a663-e87336bd146a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: eca1ed67-f21d-46e3-8557-014bc6b63953] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:53.740440 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e6b6e85-84bb-4b3d-a663-e87336bd146a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:53.741505 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e6b6e85-84bb-4b3d-a663-e87336bd146a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:53.751310 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e6b6e85-84bb-4b3d-a663-e87336bd146a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:53.756133 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e6b6e85-84bb-4b3d-a663-e87336bd146a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:53.757280 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e6b6e85-84bb-4b3d-a663-e87336bd146a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:53.758116 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e6b6e85-84bb-4b3d-a663-e87336bd146a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:53.764786 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:46:54.112821 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3e6b6e85-84bb-4b3d-a663-e87336bd146a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:54.130667 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3e6b6e85-84bb-4b3d-a663-e87336bd146a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/eca1ed67-f21d-46e3-8557-014bc6b63953" status: 200 len: 1510 microversion: 2.1 time: 0.425495 Sep 08 10:46:54.131474 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1078/2169] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:53 2022] GET /compute/v2.1/servers/eca1ed67-f21d-46e3-8557-014bc6b63953 => generated 1510 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:54.151006 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cff7faef-db32-4f46-99bf-6388f8ac89c1 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:54.151638 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cff7faef-db32-4f46-99bf-6388f8ac89c1 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] [instance: 33157107-6744-4177-9c29-3822a7d34ff9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:54.170567 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cff7faef-db32-4f46-99bf-6388f8ac89c1 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:54.171174 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cff7faef-db32-4f46-99bf-6388f8ac89c1 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:54.172437 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cff7faef-db32-4f46-99bf-6388f8ac89c1 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:54.184598 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cff7faef-db32-4f46-99bf-6388f8ac89c1 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:54.185202 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cff7faef-db32-4f46-99bf-6388f8ac89c1 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:54.185699 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cff7faef-db32-4f46-99bf-6388f8ac89c1 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:54.360902 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7ca3c833-09c4-4f24-9254-8e04a79c6119 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c291cbe955b4ee5abc98132dda0255e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f9a24cad014d7f827e8f3236dd5bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:54.380040 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7ca3c833-09c4-4f24-9254-8e04a79c6119 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/bace4c1a-2c38-42b3-962d-ca87a3bfb7ba" status: 200 len: 1366 microversion: 2.1 time: 1.821038 Sep 08 10:46:54.381003 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1092/2170] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:52 2022] GET /compute/v2.1/servers/bace4c1a-2c38-42b3-962d-ca87a3bfb7ba => generated 1366 bytes in 1824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:54.386088 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-651eb5d0-ac0a-453f-be9d-78c5e09a3545 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '.version_select at 0x7f68e4641550>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:54.445774 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cff7faef-db32-4f46-99bf-6388f8ac89c1 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416642c1ee664b4d9e0fb14d02266b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cfab473734f4b63aaa78508ef460a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:54.456754 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cff7faef-db32-4f46-99bf-6388f8ac89c1 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] 10.222.0.27 "GET /compute/v2.1/servers/33157107-6744-4177-9c29-3822a7d34ff9" status: 200 len: 1277 microversion: 2.1 time: 0.324033 Sep 08 10:46:54.459115 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1079/2171] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:54 2022] GET /compute/v2.1/servers/33157107-6744-4177-9c29-3822a7d34ff9 => generated 1277 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:54.736230 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d1ae2b2f-79fe-4836-92d6-2063029542e1 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:54.737070 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d1ae2b2f-79fe-4836-92d6-2063029542e1 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: 3766b195-ace4-4563-a24e-dca72941251e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:54.745937 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d1ae2b2f-79fe-4836-92d6-2063029542e1 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:54.747290 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d1ae2b2f-79fe-4836-92d6-2063029542e1 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:54.748644 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d1ae2b2f-79fe-4836-92d6-2063029542e1 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:54.750580 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d1ae2b2f-79fe-4836-92d6-2063029542e1 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:54.751572 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d1ae2b2f-79fe-4836-92d6-2063029542e1 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:54.752267 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d1ae2b2f-79fe-4836-92d6-2063029542e1 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:55.027774 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d1ae2b2f-79fe-4836-92d6-2063029542e1 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:55.045073 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d1ae2b2f-79fe-4836-92d6-2063029542e1 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e" status: 200 len: 1471 microversion: 2.1 time: 0.313300 Sep 08 10:46:55.046105 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1080/2172] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:54 2022] GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e => generated 1471 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:46:55.160315 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a08c4112-7abb-4256-a319-6bf1a4cfaa13 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:55.169741 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a08c4112-7abb-4256-a319-6bf1a4cfaa13 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: eca1ed67-f21d-46e3-8557-014bc6b63953] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:55.184961 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a08c4112-7abb-4256-a319-6bf1a4cfaa13 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:55.185523 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a08c4112-7abb-4256-a319-6bf1a4cfaa13 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:55.186025 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a08c4112-7abb-4256-a319-6bf1a4cfaa13 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:55.186800 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a08c4112-7abb-4256-a319-6bf1a4cfaa13 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:55.187304 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a08c4112-7abb-4256-a319-6bf1a4cfaa13 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:55.187773 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a08c4112-7abb-4256-a319-6bf1a4cfaa13 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:55.491397 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a08c4112-7abb-4256-a319-6bf1a4cfaa13 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:55.509656 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a08c4112-7abb-4256-a319-6bf1a4cfaa13 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/eca1ed67-f21d-46e3-8557-014bc6b63953" status: 200 len: 1510 microversion: 2.1 time: 0.358622 Sep 08 10:46:55.511159 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1081/2173] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:55 2022] GET /compute/v2.1/servers/eca1ed67-f21d-46e3-8557-014bc6b63953 => generated 1510 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:46:55.520212 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f1bfeabc-892a-4baf-8f2f-af5f6610c315 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:55.521111 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f1bfeabc-892a-4baf-8f2f-af5f6610c315 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: bace4c1a-2c38-42b3-962d-ca87a3bfb7ba] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:55.554271 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1bfeabc-892a-4baf-8f2f-af5f6610c315 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:55.554806 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1bfeabc-892a-4baf-8f2f-af5f6610c315 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:55.555996 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1bfeabc-892a-4baf-8f2f-af5f6610c315 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:55.558612 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1bfeabc-892a-4baf-8f2f-af5f6610c315 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:55.559905 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1bfeabc-892a-4baf-8f2f-af5f6610c315 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:55.564300 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1bfeabc-892a-4baf-8f2f-af5f6610c315 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:55.831823 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f1bfeabc-892a-4baf-8f2f-af5f6610c315 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c291cbe955b4ee5abc98132dda0255e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f9a24cad014d7f827e8f3236dd5bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:55.842344 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f1bfeabc-892a-4baf-8f2f-af5f6610c315 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/bace4c1a-2c38-42b3-962d-ca87a3bfb7ba" status: 200 len: 1556 microversion: 2.1 time: 0.326314 Sep 08 10:46:55.858986 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1082/2174] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:55 2022] GET /compute/v2.1/servers/bace4c1a-2c38-42b3-962d-ca87a3bfb7ba => generated 1556 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:55.865077 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-86d8f3e5-0ef3-45b6-b033-7a71fd6005ba tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:55.866291 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-86d8f3e5-0ef3-45b6-b033-7a71fd6005ba tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] [instance: 33157107-6744-4177-9c29-3822a7d34ff9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:55.883810 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-86d8f3e5-0ef3-45b6-b033-7a71fd6005ba tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:55.886994 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-86d8f3e5-0ef3-45b6-b033-7a71fd6005ba tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:55.896682 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-86d8f3e5-0ef3-45b6-b033-7a71fd6005ba tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:55.917077 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-86d8f3e5-0ef3-45b6-b033-7a71fd6005ba tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:55.918022 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-86d8f3e5-0ef3-45b6-b033-7a71fd6005ba tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:55.918707 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-86d8f3e5-0ef3-45b6-b033-7a71fd6005ba tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:56.075522 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-86d8f3e5-0ef3-45b6-b033-7a71fd6005ba tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416642c1ee664b4d9e0fb14d02266b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cfab473734f4b63aaa78508ef460a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:56.087485 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-86d8f3e5-0ef3-45b6-b033-7a71fd6005ba tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] 10.222.0.27 "GET /compute/v2.1/servers/33157107-6744-4177-9c29-3822a7d34ff9" status: 200 len: 1277 microversion: 2.1 time: 0.226302 Sep 08 10:46:56.087485 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1083/2175] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:55 2022] GET /compute/v2.1/servers/33157107-6744-4177-9c29-3822a7d34ff9 => generated 1277 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:56.092901 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8aa822da-c643-40f3-8d27-3852084f73f6 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:56.099801 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8aa822da-c643-40f3-8d27-3852084f73f6 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: bace4c1a-2c38-42b3-962d-ca87a3bfb7ba] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:56.112359 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8aa822da-c643-40f3-8d27-3852084f73f6 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:56.112359 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8aa822da-c643-40f3-8d27-3852084f73f6 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:56.112359 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8aa822da-c643-40f3-8d27-3852084f73f6 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:56.112866 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8aa822da-c643-40f3-8d27-3852084f73f6 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:56.113416 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8aa822da-c643-40f3-8d27-3852084f73f6 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:56.113853 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8aa822da-c643-40f3-8d27-3852084f73f6 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:56.275215 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8aa822da-c643-40f3-8d27-3852084f73f6 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/bace4c1a-2c38-42b3-962d-ca87a3bfb7ba/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.185938 Sep 08 10:46:56.288735 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1084/2176] 10.222.0.27 () {58 vars in 1275 bytes} [Thu Sep 8 10:46:56 2022] GET /compute/v2.1/servers/bace4c1a-2c38-42b3-962d-ca87a3bfb7ba/os-interface => generated 284 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:46:56.288735 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b488ad94-c38e-4726-8fc7-de7f79e62cf2 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:56.288735 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b488ad94-c38e-4726-8fc7-de7f79e62cf2 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: 3766b195-ace4-4563-a24e-dca72941251e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:56.300438 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b488ad94-c38e-4726-8fc7-de7f79e62cf2 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:56.301368 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b488ad94-c38e-4726-8fc7-de7f79e62cf2 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:56.302100 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b488ad94-c38e-4726-8fc7-de7f79e62cf2 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:56.305885 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b488ad94-c38e-4726-8fc7-de7f79e62cf2 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:56.306385 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b488ad94-c38e-4726-8fc7-de7f79e62cf2 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:56.306851 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b488ad94-c38e-4726-8fc7-de7f79e62cf2 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:56.854497 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b488ad94-c38e-4726-8fc7-de7f79e62cf2 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:56.873249 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b488ad94-c38e-4726-8fc7-de7f79e62cf2 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e" status: 200 len: 1471 microversion: 2.1 time: 0.589362 Sep 08 10:46:56.877449 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1085/2177] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:56 2022] GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e => generated 1471 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:56.893402 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2b6565b3-9b30-4c6b-aaba-5a7ffab004ce tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:56.894253 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2b6565b3-9b30-4c6b-aaba-5a7ffab004ce tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: eca1ed67-f21d-46e3-8557-014bc6b63953] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:56.912772 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b6565b3-9b30-4c6b-aaba-5a7ffab004ce tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:56.913316 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b6565b3-9b30-4c6b-aaba-5a7ffab004ce tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:56.913755 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b6565b3-9b30-4c6b-aaba-5a7ffab004ce tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:56.923166 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b6565b3-9b30-4c6b-aaba-5a7ffab004ce tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:56.923166 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b6565b3-9b30-4c6b-aaba-5a7ffab004ce tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:56.923166 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b6565b3-9b30-4c6b-aaba-5a7ffab004ce tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:57.950445 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2b6565b3-9b30-4c6b-aaba-5a7ffab004ce tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:57.973164 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2b6565b3-9b30-4c6b-aaba-5a7ffab004ce tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/eca1ed67-f21d-46e3-8557-014bc6b63953" status: 200 len: 1510 microversion: 2.1 time: 1.090165 Sep 08 10:46:57.975070 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1086/2178] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:56 2022] GET /compute/v2.1/servers/eca1ed67-f21d-46e3-8557-014bc6b63953 => generated 1510 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:57.984434 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2c222962-50c4-4727-a6cc-66f70741b90d tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:57.985613 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2c222962-50c4-4727-a6cc-66f70741b90d tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] [instance: 33157107-6744-4177-9c29-3822a7d34ff9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:58.013334 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2c222962-50c4-4727-a6cc-66f70741b90d tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:58.014463 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2c222962-50c4-4727-a6cc-66f70741b90d tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:58.015244 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2c222962-50c4-4727-a6cc-66f70741b90d tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:58.018510 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2c222962-50c4-4727-a6cc-66f70741b90d tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:58.021379 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2c222962-50c4-4727-a6cc-66f70741b90d tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:58.022867 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2c222962-50c4-4727-a6cc-66f70741b90d tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:58.644522 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2c222962-50c4-4727-a6cc-66f70741b90d tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416642c1ee664b4d9e0fb14d02266b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cfab473734f4b63aaa78508ef460a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:58.656457 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2c222962-50c4-4727-a6cc-66f70741b90d tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] 10.222.0.27 "GET /compute/v2.1/servers/33157107-6744-4177-9c29-3822a7d34ff9" status: 200 len: 1319 microversion: 2.1 time: 0.678688 Sep 08 10:46:58.662051 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1087/2179] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:57 2022] GET /compute/v2.1/servers/33157107-6744-4177-9c29-3822a7d34ff9 => generated 1319 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:58.667166 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-633ba55e-8535-41f6-9ed6-4a42a998261c tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:58.667778 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-633ba55e-8535-41f6-9ed6-4a42a998261c tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: 3766b195-ace4-4563-a24e-dca72941251e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:58.688494 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-633ba55e-8535-41f6-9ed6-4a42a998261c tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:58.689003 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-633ba55e-8535-41f6-9ed6-4a42a998261c tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:58.689461 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-633ba55e-8535-41f6-9ed6-4a42a998261c tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:58.690186 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-633ba55e-8535-41f6-9ed6-4a42a998261c tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:58.690643 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-633ba55e-8535-41f6-9ed6-4a42a998261c tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:58.691091 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-633ba55e-8535-41f6-9ed6-4a42a998261c tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:59.152738 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-633ba55e-8535-41f6-9ed6-4a42a998261c tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:59.181630 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-633ba55e-8535-41f6-9ed6-4a42a998261c tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e" status: 200 len: 1471 microversion: 2.1 time: 0.516972 Sep 08 10:46:59.183327 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1088/2180] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:58 2022] GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e => generated 1471 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:59.204331 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-6b1a9754-dc31-4129-a04b-89563c96bfc9 req-8700d4db-7664-489d-bbb4-4441f569ce13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33157107-6744-4177-9c29-3822a7d34ff9", "tag": "02aac401-313a-432e-9e68-b39f63c14e09"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:46:59.224727 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-6b1a9754-dc31-4129-a04b-89563c96bfc9 req-8700d4db-7664-489d-bbb4-4441f569ce13 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:59.225246 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-6b1a9754-dc31-4129-a04b-89563c96bfc9 req-8700d4db-7664-489d-bbb4-4441f569ce13 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:59.225695 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-6b1a9754-dc31-4129-a04b-89563c96bfc9 req-8700d4db-7664-489d-bbb4-4441f569ce13 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:59.251254 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-6b1a9754-dc31-4129-a04b-89563c96bfc9 req-8700d4db-7664-489d-bbb4-4441f569ce13 service nova] Creating event network-changed:02aac401-313a-432e-9e68-b39f63c14e09 for instance 33157107-6744-4177-9c29-3822a7d34ff9 on n-h1-850501-12 Sep 08 10:46:59.257880 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-6b1a9754-dc31-4129-a04b-89563c96bfc9 req-8700d4db-7664-489d-bbb4-4441f569ce13 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072506 Sep 08 10:46:59.259147 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1089/2181] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:46:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:46:59.269229 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-866ac2e4-1914-4bcd-82cb-c362759e99a8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:59.270431 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-866ac2e4-1914-4bcd-82cb-c362759e99a8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: eca1ed67-f21d-46e3-8557-014bc6b63953] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:59.287837 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-866ac2e4-1914-4bcd-82cb-c362759e99a8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:59.288412 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-866ac2e4-1914-4bcd-82cb-c362759e99a8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:59.288876 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-866ac2e4-1914-4bcd-82cb-c362759e99a8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:59.289963 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-866ac2e4-1914-4bcd-82cb-c362759e99a8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:59.290689 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-866ac2e4-1914-4bcd-82cb-c362759e99a8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:59.291189 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-866ac2e4-1914-4bcd-82cb-c362759e99a8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:59.687254 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-866ac2e4-1914-4bcd-82cb-c362759e99a8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:59.701558 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-866ac2e4-1914-4bcd-82cb-c362759e99a8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/eca1ed67-f21d-46e3-8557-014bc6b63953" status: 200 len: 1510 microversion: 2.1 time: 0.440179 Sep 08 10:46:59.703602 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1090/2182] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:59 2022] GET /compute/v2.1/servers/eca1ed67-f21d-46e3-8557-014bc6b63953 => generated 1510 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:59.712315 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e05834cb-50ea-4dec-b916-361820cfb3c9 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:59.714143 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e05834cb-50ea-4dec-b916-361820cfb3c9 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] [instance: 33157107-6744-4177-9c29-3822a7d34ff9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:59.726989 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e05834cb-50ea-4dec-b916-361820cfb3c9 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:59.728364 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e05834cb-50ea-4dec-b916-361820cfb3c9 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:59.729378 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e05834cb-50ea-4dec-b916-361820cfb3c9 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:59.730725 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e05834cb-50ea-4dec-b916-361820cfb3c9 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:59.732432 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e05834cb-50ea-4dec-b916-361820cfb3c9 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:59.733401 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e05834cb-50ea-4dec-b916-361820cfb3c9 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:59.871620 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=12 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:47:00.006253 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-651eb5d0-ac0a-453f-be9d-78c5e09a3545 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/images/28783cea-dde6-431e-a46e-b87625b47518" status: 200 len: 1448 microversion: 2.1 time: 5.623529 Sep 08 10:47:00.007315 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1093/2183] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:46:54 2022] GET /compute/v2.1/images/28783cea-dde6-431e-a46e-b87625b47518 => generated 1448 bytes in 5626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:00.023171 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1aefbffb-40a4-4532-95b1-8f88e1c3ac58 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '.version_select at 0x7f68e44cbd30>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:00.059144 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e05834cb-50ea-4dec-b916-361820cfb3c9 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416642c1ee664b4d9e0fb14d02266b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cfab473734f4b63aaa78508ef460a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:00.075140 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e05834cb-50ea-4dec-b916-361820cfb3c9 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] 10.222.0.27 "GET /compute/v2.1/servers/33157107-6744-4177-9c29-3822a7d34ff9" status: 200 len: 1319 microversion: 2.1 time: 0.369883 Sep 08 10:47:00.076003 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1091/2184] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:59 2022] GET /compute/v2.1/servers/33157107-6744-4177-9c29-3822a7d34ff9 => generated 1319 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:00.082214 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-9bad10f3-1e55-495a-bb05-b7903ac2590f req-3429dde0-99ea-40ad-b941-d6f2431f91fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bace4c1a-2c38-42b3-962d-ca87a3bfb7ba", "tag": "b523e95a-b010-42e0-aa5e-9e3222767ffb"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:47:00.093779 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-9bad10f3-1e55-495a-bb05-b7903ac2590f req-3429dde0-99ea-40ad-b941-d6f2431f91fd service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:00.094540 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-9bad10f3-1e55-495a-bb05-b7903ac2590f req-3429dde0-99ea-40ad-b941-d6f2431f91fd service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:00.095425 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-9bad10f3-1e55-495a-bb05-b7903ac2590f req-3429dde0-99ea-40ad-b941-d6f2431f91fd service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:00.116048 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-9bad10f3-1e55-495a-bb05-b7903ac2590f req-3429dde0-99ea-40ad-b941-d6f2431f91fd service nova] Creating event network-changed:b523e95a-b010-42e0-aa5e-9e3222767ffb for instance bace4c1a-2c38-42b3-962d-ca87a3bfb7ba on n-h2-850501-12 Sep 08 10:47:00.126898 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-9bad10f3-1e55-495a-bb05-b7903ac2590f req-3429dde0-99ea-40ad-b941-d6f2431f91fd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049418 Sep 08 10:47:00.134530 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1092/2185] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:47:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:47:00.146419 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1aefbffb-40a4-4532-95b1-8f88e1c3ac58 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/images/28783cea-dde6-431e-a46e-b87625b47518" status: 200 len: 1448 microversion: 2.1 time: 0.127048 Sep 08 10:47:00.149559 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1094/2186] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:47:00 2022] GET /compute/v2.1/images/28783cea-dde6-431e-a46e-b87625b47518 => generated 1448 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:00.169303 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f61b61ca-49f2-4d2e-b7ae-92aece2dea66 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '.version_select at 0x7f68e4312d30>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:00.210744 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b5ebced4-3006-40a3-83cd-63640310cb5a tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:00.211477 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b5ebced4-3006-40a3-83cd-63640310cb5a tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: 3766b195-ace4-4563-a24e-dca72941251e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:00.226687 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b5ebced4-3006-40a3-83cd-63640310cb5a tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:00.228174 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b5ebced4-3006-40a3-83cd-63640310cb5a tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:00.230128 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b5ebced4-3006-40a3-83cd-63640310cb5a tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:00.234652 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b5ebced4-3006-40a3-83cd-63640310cb5a tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:00.235288 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b5ebced4-3006-40a3-83cd-63640310cb5a tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:00.236727 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b5ebced4-3006-40a3-83cd-63640310cb5a tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:00.467951 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=22 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:47:00.847635 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=4 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:47:00.879530 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b5ebced4-3006-40a3-83cd-63640310cb5a tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:00.892306 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b5ebced4-3006-40a3-83cd-63640310cb5a tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e" status: 200 len: 1471 microversion: 2.1 time: 0.685651 Sep 08 10:47:00.893385 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1095/2187] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:00 2022] GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e => generated 1471 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:47:00.910632 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e1303a1a-2500-454e-8a64-089d31c1139d tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:00.911250 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e1303a1a-2500-454e-8a64-089d31c1139d tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: eca1ed67-f21d-46e3-8557-014bc6b63953] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:00.917256 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:47:00.918720 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e1303a1a-2500-454e-8a64-089d31c1139d tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:00.919315 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e1303a1a-2500-454e-8a64-089d31c1139d tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:00.920146 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e1303a1a-2500-454e-8a64-089d31c1139d tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:00.920369 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e1303a1a-2500-454e-8a64-089d31c1139d tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:00.932364 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e1303a1a-2500-454e-8a64-089d31c1139d tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:00.932685 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e1303a1a-2500-454e-8a64-089d31c1139d tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:01.383751 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f61b61ca-49f2-4d2e-b7ae-92aece2dea66 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "DELETE /compute/v2.1/images/28783cea-dde6-431e-a46e-b87625b47518" status: 204 len: 0 microversion: 2.1 time: 1.220396 Sep 08 10:47:01.384395 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1093/2188] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:00 2022] DELETE /compute/v2.1/images/28783cea-dde6-431e-a46e-b87625b47518 => generated 0 bytes in 1222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:47:01.393787 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1532eb5f-c612-4876-ac8a-318889d0587c tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:01.396890 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1532eb5f-c612-4876-ac8a-318889d0587c tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] [instance: 33157107-6744-4177-9c29-3822a7d34ff9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:01.408543 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1532eb5f-c612-4876-ac8a-318889d0587c tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:01.409872 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1532eb5f-c612-4876-ac8a-318889d0587c tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:01.410635 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1532eb5f-c612-4876-ac8a-318889d0587c tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:01.417878 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1532eb5f-c612-4876-ac8a-318889d0587c tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:01.418682 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1532eb5f-c612-4876-ac8a-318889d0587c tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:01.419287 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1532eb5f-c612-4876-ac8a-318889d0587c tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:01.811311 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e1303a1a-2500-454e-8a64-089d31c1139d tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:01.827017 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e1303a1a-2500-454e-8a64-089d31c1139d tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/eca1ed67-f21d-46e3-8557-014bc6b63953" status: 200 len: 1510 microversion: 2.1 time: 0.920111 Sep 08 10:47:01.827833 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1096/2189] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:00 2022] GET /compute/v2.1/servers/eca1ed67-f21d-46e3-8557-014bc6b63953 => generated 1510 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:01.838588 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-65311412-3fa8-41f2-bb32-6e7b790905c4 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:01.844496 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-65311412-3fa8-41f2-bb32-6e7b790905c4 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 7d251638-b28f-4137-a81a-ce1a21cd7418] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:01.859620 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-65311412-3fa8-41f2-bb32-6e7b790905c4 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:01.860256 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-65311412-3fa8-41f2-bb32-6e7b790905c4 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:01.860757 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-65311412-3fa8-41f2-bb32-6e7b790905c4 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:01.861597 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-65311412-3fa8-41f2-bb32-6e7b790905c4 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:01.864732 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-65311412-3fa8-41f2-bb32-6e7b790905c4 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:01.865463 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-65311412-3fa8-41f2-bb32-6e7b790905c4 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:01.953004 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-65311412-3fa8-41f2-bb32-6e7b790905c4 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 7d251638-b28f-4137-a81a-ce1a21cd7418] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:47:02.080654 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-65311412-3fa8-41f2-bb32-6e7b790905c4 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7d251638-b28f-4137-a81a-ce1a21cd7418" status: 204 len: 0 microversion: 2.1 time: 0.245726 Sep 08 10:47:02.081808 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1097/2190] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:47:01 2022] DELETE /compute/v2.1/servers/7d251638-b28f-4137-a81a-ce1a21cd7418 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:47:02.088053 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ed389338-03a1-4558-a3cf-a180883c5846 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:02.089091 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ed389338-03a1-4558-a3cf-a180883c5846 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: 3766b195-ace4-4563-a24e-dca72941251e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:02.097688 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed389338-03a1-4558-a3cf-a180883c5846 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:02.098473 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed389338-03a1-4558-a3cf-a180883c5846 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:02.099105 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed389338-03a1-4558-a3cf-a180883c5846 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:02.100055 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed389338-03a1-4558-a3cf-a180883c5846 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:02.100668 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed389338-03a1-4558-a3cf-a180883c5846 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:02.101413 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed389338-03a1-4558-a3cf-a180883c5846 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:02.437682 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1532eb5f-c612-4876-ac8a-318889d0587c tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416642c1ee664b4d9e0fb14d02266b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cfab473734f4b63aaa78508ef460a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:02.474909 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1532eb5f-c612-4876-ac8a-318889d0587c tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] 10.222.0.27 "GET /compute/v2.1/servers/33157107-6744-4177-9c29-3822a7d34ff9" status: 200 len: 1319 microversion: 2.1 time: 1.074934 Sep 08 10:47:02.477567 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1094/2191] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:01 2022] GET /compute/v2.1/servers/33157107-6744-4177-9c29-3822a7d34ff9 => generated 1319 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:02.490583 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0fedf83c-4a2a-4f5e-a835-d2dccdf578e9 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-849883383", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "c5773ac9-6cb1-4d96-9195-6fd6adb76930"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:47:02.600751 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-0fedf83c-4a2a-4f5e-a835-d2dccdf578e9 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] validate_networks() for [('c5773ac9-6cb1-4d96-9195-6fd6adb76930', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:47:02.675758 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ed389338-03a1-4558-a3cf-a180883c5846 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:02.686005 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ed389338-03a1-4558-a3cf-a180883c5846 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e" status: 200 len: 1471 microversion: 2.1 time: 0.602838 Sep 08 10:47:02.701300 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1098/2192] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:02 2022] GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e => generated 1471 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:02.875218 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-979c267d-a873-49fe-9e96-ca3dbc05560e tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:02.877748 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-979c267d-a873-49fe-9e96-ca3dbc05560e tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: eca1ed67-f21d-46e3-8557-014bc6b63953] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:02.896954 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-979c267d-a873-49fe-9e96-ca3dbc05560e tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:02.898102 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-979c267d-a873-49fe-9e96-ca3dbc05560e tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:02.898744 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-979c267d-a873-49fe-9e96-ca3dbc05560e tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:02.899878 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-979c267d-a873-49fe-9e96-ca3dbc05560e tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:02.900517 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-979c267d-a873-49fe-9e96-ca3dbc05560e tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:02.901332 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-979c267d-a873-49fe-9e96-ca3dbc05560e tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:03.115046 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-979c267d-a873-49fe-9e96-ca3dbc05560e tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:03.129700 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-979c267d-a873-49fe-9e96-ca3dbc05560e tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/eca1ed67-f21d-46e3-8557-014bc6b63953" status: 200 len: 1510 microversion: 2.1 time: 0.280286 Sep 08 10:47:03.143499 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1099/2193] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:02 2022] GET /compute/v2.1/servers/eca1ed67-f21d-46e3-8557-014bc6b63953 => generated 1510 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:47:03.445593 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-0fedf83c-4a2a-4f5e-a835-d2dccdf578e9 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:47:03.447331 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-0fedf83c-4a2a-4f5e-a835-d2dccdf578e9 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:47:03.448617 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-0fedf83c-4a2a-4f5e-a835-d2dccdf578e9 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:47:03.449394 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-0fedf83c-4a2a-4f5e-a835-d2dccdf578e9 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:47:03.449998 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-0fedf83c-4a2a-4f5e-a835-d2dccdf578e9 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:47:03.470204 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0fedf83c-4a2a-4f5e-a835-d2dccdf578e9 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:03.472512 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0fedf83c-4a2a-4f5e-a835-d2dccdf578e9 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:03.474789 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0fedf83c-4a2a-4f5e-a835-d2dccdf578e9 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:03.475760 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0fedf83c-4a2a-4f5e-a835-d2dccdf578e9 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:03.476242 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0fedf83c-4a2a-4f5e-a835-d2dccdf578e9 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:03.476674 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0fedf83c-4a2a-4f5e-a835-d2dccdf578e9 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:03.521353 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3a5cf08a-cec3-4400-8ea3-57339805a6e8 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:03.523130 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3a5cf08a-cec3-4400-8ea3-57339805a6e8 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] [instance: 33157107-6744-4177-9c29-3822a7d34ff9] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:03.523585 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-0fedf83c-4a2a-4f5e-a835-d2dccdf578e9 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Getting quotas for project eeeb450420314221bd2469816e2995d1. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:47:03.531245 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-0fedf83c-4a2a-4f5e-a835-d2dccdf578e9 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Getting quotas for user ce8c8c85354d46aeb786c8049b81e04d and project eeeb450420314221bd2469816e2995d1. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:47:03.537813 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3a5cf08a-cec3-4400-8ea3-57339805a6e8 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:03.539943 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3a5cf08a-cec3-4400-8ea3-57339805a6e8 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:03.541630 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3a5cf08a-cec3-4400-8ea3-57339805a6e8 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:03.543305 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3a5cf08a-cec3-4400-8ea3-57339805a6e8 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:03.544546 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3a5cf08a-cec3-4400-8ea3-57339805a6e8 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:03.545808 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3a5cf08a-cec3-4400-8ea3-57339805a6e8 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:03.546036 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0fedf83c-4a2a-4f5e-a835-d2dccdf578e9 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:47:03.548851 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0fedf83c-4a2a-4f5e-a835-d2dccdf578e9 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: e052494d-6c34-4e3a-adac-4c7ed14f87c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:47:03.600399 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0fedf83c-4a2a-4f5e-a835-d2dccdf578e9 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.121524 Sep 08 10:47:03.601089 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1095/2194] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:47:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1123 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:47:03.620840 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-267c90a7-c440-4082-8ff8-b406cb24ea49 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:03.622362 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-267c90a7-c440-4082-8ff8-b406cb24ea49 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: e052494d-6c34-4e3a-adac-4c7ed14f87c9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:03.750939 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-267c90a7-c440-4082-8ff8-b406cb24ea49 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:03.764125 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-267c90a7-c440-4082-8ff8-b406cb24ea49 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/e052494d-6c34-4e3a-adac-4c7ed14f87c9" status: 200 len: 1207 microversion: 2.1 time: 0.151662 Sep 08 10:47:03.783786 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1096/2195] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:03 2022] GET /compute/v2.1/servers/e052494d-6c34-4e3a-adac-4c7ed14f87c9 => generated 1207 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:03.789162 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1ac8a227-e78a-4b8b-a32b-1496cdcd7136 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:03.790163 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1ac8a227-e78a-4b8b-a32b-1496cdcd7136 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: 3766b195-ace4-4563-a24e-dca72941251e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:03.800396 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ac8a227-e78a-4b8b-a32b-1496cdcd7136 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:03.801388 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ac8a227-e78a-4b8b-a32b-1496cdcd7136 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:03.802100 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ac8a227-e78a-4b8b-a32b-1496cdcd7136 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:03.803940 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ac8a227-e78a-4b8b-a32b-1496cdcd7136 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:03.804687 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ac8a227-e78a-4b8b-a32b-1496cdcd7136 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:03.805622 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ac8a227-e78a-4b8b-a32b-1496cdcd7136 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:03.996444 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-3a5cf08a-cec3-4400-8ea3-57339805a6e8 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416642c1ee664b4d9e0fb14d02266b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cfab473734f4b63aaa78508ef460a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:04.010188 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3a5cf08a-cec3-4400-8ea3-57339805a6e8 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] 10.222.0.27 "GET /compute/v2.1/servers/33157107-6744-4177-9c29-3822a7d34ff9" status: 200 len: 1319 microversion: 2.1 time: 0.510794 Sep 08 10:47:04.011378 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1100/2196] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:03 2022] GET /compute/v2.1/servers/33157107-6744-4177-9c29-3822a7d34ff9 => generated 1319 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:47:04.135851 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1ac8a227-e78a-4b8b-a32b-1496cdcd7136 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:04.149575 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1ac8a227-e78a-4b8b-a32b-1496cdcd7136 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e" status: 200 len: 1471 microversion: 2.1 time: 0.364293 Sep 08 10:47:04.165063 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1097/2197] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:03 2022] GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e => generated 1471 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:04.180662 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9f3efab1-1055-45de-a035-9dc0bdafed1a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:04.182478 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9f3efab1-1055-45de-a035-9dc0bdafed1a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: eca1ed67-f21d-46e3-8557-014bc6b63953] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:04.190705 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f3efab1-1055-45de-a035-9dc0bdafed1a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:04.191549 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f3efab1-1055-45de-a035-9dc0bdafed1a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:04.192212 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f3efab1-1055-45de-a035-9dc0bdafed1a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:04.193765 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f3efab1-1055-45de-a035-9dc0bdafed1a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:04.194429 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f3efab1-1055-45de-a035-9dc0bdafed1a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:04.195057 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f3efab1-1055-45de-a035-9dc0bdafed1a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:04.239758 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-a7ea37df-5eb6-46b9-a80e-99134e9c0fde req-31c2c784-3abe-4ab3-b0ff-1fa0791cc1af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d251638-b28f-4137-a81a-ce1a21cd7418", "name": "network-vif-unplugged", "status": "completed", "tag": "c673f801-080b-42df-a05e-1dfffd8802bd"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:47:04.275432 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a7ea37df-5eb6-46b9-a80e-99134e9c0fde req-31c2c784-3abe-4ab3-b0ff-1fa0791cc1af service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:04.276313 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a7ea37df-5eb6-46b9-a80e-99134e9c0fde req-31c2c784-3abe-4ab3-b0ff-1fa0791cc1af service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:04.276426 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a7ea37df-5eb6-46b9-a80e-99134e9c0fde req-31c2c784-3abe-4ab3-b0ff-1fa0791cc1af service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:04.302959 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-a7ea37df-5eb6-46b9-a80e-99134e9c0fde req-31c2c784-3abe-4ab3-b0ff-1fa0791cc1af service nova] Creating event network-vif-unplugged:c673f801-080b-42df-a05e-1dfffd8802bd for instance 7d251638-b28f-4137-a81a-ce1a21cd7418 on n-h2-850501-12 Sep 08 10:47:04.317214 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-a7ea37df-5eb6-46b9-a80e-99134e9c0fde req-31c2c784-3abe-4ab3-b0ff-1fa0791cc1af service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083436 Sep 08 10:47:04.319636 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1098/2198] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:47:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:47:04.560094 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9f3efab1-1055-45de-a035-9dc0bdafed1a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:04.575223 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9f3efab1-1055-45de-a035-9dc0bdafed1a tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/eca1ed67-f21d-46e3-8557-014bc6b63953" status: 200 len: 1510 microversion: 2.1 time: 0.425295 Sep 08 10:47:04.589652 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1101/2199] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:04 2022] GET /compute/v2.1/servers/eca1ed67-f21d-46e3-8557-014bc6b63953 => generated 1510 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:47:04.794066 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6183daf0-5e62-4472-8203-118abafa48b8 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:04.797629 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6183daf0-5e62-4472-8203-118abafa48b8 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: e052494d-6c34-4e3a-adac-4c7ed14f87c9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:04.810685 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6183daf0-5e62-4472-8203-118abafa48b8 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:04.812444 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6183daf0-5e62-4472-8203-118abafa48b8 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:04.815198 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6183daf0-5e62-4472-8203-118abafa48b8 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:04.817672 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6183daf0-5e62-4472-8203-118abafa48b8 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:04.818966 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6183daf0-5e62-4472-8203-118abafa48b8 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:04.824548 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6183daf0-5e62-4472-8203-118abafa48b8 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:04.834491 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:47:04.912084 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6183daf0-5e62-4472-8203-118abafa48b8 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:04.923048 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6183daf0-5e62-4472-8203-118abafa48b8 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/e052494d-6c34-4e3a-adac-4c7ed14f87c9" status: 200 len: 1259 microversion: 2.1 time: 0.136700 Sep 08 10:47:04.939466 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1099/2200] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:04 2022] GET /compute/v2.1/servers/e052494d-6c34-4e3a-adac-4c7ed14f87c9 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:47:05.047902 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-add9e1af-524f-4771-b4ad-14b55a891408 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:05.048855 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-add9e1af-524f-4771-b4ad-14b55a891408 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] [instance: 33157107-6744-4177-9c29-3822a7d34ff9] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:05.056250 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-add9e1af-524f-4771-b4ad-14b55a891408 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:05.057305 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-add9e1af-524f-4771-b4ad-14b55a891408 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:05.058310 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-add9e1af-524f-4771-b4ad-14b55a891408 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:05.059282 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-add9e1af-524f-4771-b4ad-14b55a891408 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:05.060113 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-add9e1af-524f-4771-b4ad-14b55a891408 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:05.060746 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-add9e1af-524f-4771-b4ad-14b55a891408 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:05.184306 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7d220dd1-690f-4d91-864b-f8aca7ebaa74 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:05.185649 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7d220dd1-690f-4d91-864b-f8aca7ebaa74 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: 3766b195-ace4-4563-a24e-dca72941251e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:05.193597 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:47:05.197602 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d220dd1-690f-4d91-864b-f8aca7ebaa74 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:05.197877 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d220dd1-690f-4d91-864b-f8aca7ebaa74 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:05.198662 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d220dd1-690f-4d91-864b-f8aca7ebaa74 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:05.199467 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d220dd1-690f-4d91-864b-f8aca7ebaa74 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:05.199940 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d220dd1-690f-4d91-864b-f8aca7ebaa74 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:05.200369 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d220dd1-690f-4d91-864b-f8aca7ebaa74 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:05.423265 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-add9e1af-524f-4771-b4ad-14b55a891408 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416642c1ee664b4d9e0fb14d02266b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cfab473734f4b63aaa78508ef460a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:05.443459 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-add9e1af-524f-4771-b4ad-14b55a891408 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] 10.222.0.27 "GET /compute/v2.1/servers/33157107-6744-4177-9c29-3822a7d34ff9" status: 200 len: 1319 microversion: 2.1 time: 0.399971 Sep 08 10:47:05.449847 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1102/2201] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:05 2022] GET /compute/v2.1/servers/33157107-6744-4177-9c29-3822a7d34ff9 => generated 1319 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:05.463133 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-fadf91da-2397-429d-a68d-fcae8a399a21 req-3297e4e8-aed0-49de-88c4-8b08d53cf877 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d251638-b28f-4137-a81a-ce1a21cd7418", "name": "network-vif-deleted", "tag": "c673f801-080b-42df-a05e-1dfffd8802bd"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:47:05.471519 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7d220dd1-690f-4d91-864b-f8aca7ebaa74 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:05.487221 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-fadf91da-2397-429d-a68d-fcae8a399a21 req-3297e4e8-aed0-49de-88c4-8b08d53cf877 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:05.487723 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-fadf91da-2397-429d-a68d-fcae8a399a21 req-3297e4e8-aed0-49de-88c4-8b08d53cf877 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:05.488169 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-fadf91da-2397-429d-a68d-fcae8a399a21 req-3297e4e8-aed0-49de-88c4-8b08d53cf877 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:05.492559 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7d220dd1-690f-4d91-864b-f8aca7ebaa74 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e" status: 200 len: 1471 microversion: 2.1 time: 0.312593 Sep 08 10:47:05.498337 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1100/2202] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:05 2022] GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e => generated 1471 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:05.521436 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-fadf91da-2397-429d-a68d-fcae8a399a21 req-3297e4e8-aed0-49de-88c4-8b08d53cf877 service nova] Creating event network-vif-deleted:c673f801-080b-42df-a05e-1dfffd8802bd for instance 7d251638-b28f-4137-a81a-ce1a21cd7418 on n-h2-850501-12 Sep 08 10:47:05.544880 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-fadf91da-2397-429d-a68d-fcae8a399a21 req-3297e4e8-aed0-49de-88c4-8b08d53cf877 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091727 Sep 08 10:47:05.550474 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1103/2203] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:47:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:47:05.612273 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f3e3d5c7-64d0-4b39-b021-401f709ecf3e tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:05.614857 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f3e3d5c7-64d0-4b39-b021-401f709ecf3e tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: eca1ed67-f21d-46e3-8557-014bc6b63953] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:05.626842 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f3e3d5c7-64d0-4b39-b021-401f709ecf3e tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:05.627414 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f3e3d5c7-64d0-4b39-b021-401f709ecf3e tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:05.627863 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f3e3d5c7-64d0-4b39-b021-401f709ecf3e tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:05.628696 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f3e3d5c7-64d0-4b39-b021-401f709ecf3e tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:05.629207 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f3e3d5c7-64d0-4b39-b021-401f709ecf3e tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:05.629860 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f3e3d5c7-64d0-4b39-b021-401f709ecf3e tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:05.889322 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f3e3d5c7-64d0-4b39-b021-401f709ecf3e tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:05.904008 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f3e3d5c7-64d0-4b39-b021-401f709ecf3e tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/eca1ed67-f21d-46e3-8557-014bc6b63953" status: 200 len: 1510 microversion: 2.1 time: 0.303108 Sep 08 10:47:05.917815 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1101/2204] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:05 2022] GET /compute/v2.1/servers/eca1ed67-f21d-46e3-8557-014bc6b63953 => generated 1510 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:05.955009 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-aeec2d7c-487b-487f-92dd-2e8305950492 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:05.956340 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-aeec2d7c-487b-487f-92dd-2e8305950492 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: e052494d-6c34-4e3a-adac-4c7ed14f87c9] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:05.966999 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aeec2d7c-487b-487f-92dd-2e8305950492 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:05.973308 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aeec2d7c-487b-487f-92dd-2e8305950492 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:05.973765 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aeec2d7c-487b-487f-92dd-2e8305950492 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:05.974514 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aeec2d7c-487b-487f-92dd-2e8305950492 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:05.974983 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aeec2d7c-487b-487f-92dd-2e8305950492 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:05.975412 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aeec2d7c-487b-487f-92dd-2e8305950492 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:06.086664 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-aeec2d7c-487b-487f-92dd-2e8305950492 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:06.098239 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-aeec2d7c-487b-487f-92dd-2e8305950492 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/e052494d-6c34-4e3a-adac-4c7ed14f87c9" status: 200 len: 1265 microversion: 2.1 time: 0.154697 Sep 08 10:47:06.099471 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1104/2205] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:05 2022] GET /compute/v2.1/servers/e052494d-6c34-4e3a-adac-4c7ed14f87c9 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:06.337345 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-2259b5bf-db66-4e77-a619-122ba5b89031 req-cb72dd5d-f518-478d-ab00-dc151b84632d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33157107-6744-4177-9c29-3822a7d34ff9", "name": "network-vif-plugged", "status": "completed", "tag": "02aac401-313a-432e-9e68-b39f63c14e09"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:47:06.351448 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-2259b5bf-db66-4e77-a619-122ba5b89031 req-cb72dd5d-f518-478d-ab00-dc151b84632d service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:06.352051 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-2259b5bf-db66-4e77-a619-122ba5b89031 req-cb72dd5d-f518-478d-ab00-dc151b84632d service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:06.352346 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-2259b5bf-db66-4e77-a619-122ba5b89031 req-cb72dd5d-f518-478d-ab00-dc151b84632d service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:06.370684 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-2259b5bf-db66-4e77-a619-122ba5b89031 req-cb72dd5d-f518-478d-ab00-dc151b84632d service nova] Creating event network-vif-plugged:02aac401-313a-432e-9e68-b39f63c14e09 for instance 33157107-6744-4177-9c29-3822a7d34ff9 on n-h1-850501-12 Sep 08 10:47:06.378963 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-2259b5bf-db66-4e77-a619-122ba5b89031 req-cb72dd5d-f518-478d-ab00-dc151b84632d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045511 Sep 08 10:47:06.380143 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1102/2206] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:47:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:47:06.479978 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3e6b0eeb-1086-461b-964e-0a3ff3513d74 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:06.481614 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3e6b0eeb-1086-461b-964e-0a3ff3513d74 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] [instance: 33157107-6744-4177-9c29-3822a7d34ff9] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:06.498449 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3e6b0eeb-1086-461b-964e-0a3ff3513d74 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:06.502371 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3e6b0eeb-1086-461b-964e-0a3ff3513d74 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:06.504465 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3e6b0eeb-1086-461b-964e-0a3ff3513d74 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:06.506024 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3e6b0eeb-1086-461b-964e-0a3ff3513d74 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:06.508641 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3e6b0eeb-1086-461b-964e-0a3ff3513d74 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:06.512442 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3e6b0eeb-1086-461b-964e-0a3ff3513d74 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:06.524964 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-93c154f9-9f88-454a-9db8-1f9cb2562d16 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:06.525722 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-93c154f9-9f88-454a-9db8-1f9cb2562d16 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: 3766b195-ace4-4563-a24e-dca72941251e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:06.554157 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-93c154f9-9f88-454a-9db8-1f9cb2562d16 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:06.554650 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-93c154f9-9f88-454a-9db8-1f9cb2562d16 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:06.555083 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-93c154f9-9f88-454a-9db8-1f9cb2562d16 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:06.559254 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-93c154f9-9f88-454a-9db8-1f9cb2562d16 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:06.562700 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-93c154f9-9f88-454a-9db8-1f9cb2562d16 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:06.564335 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-93c154f9-9f88-454a-9db8-1f9cb2562d16 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:06.836450 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-93c154f9-9f88-454a-9db8-1f9cb2562d16 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:06.849809 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-93c154f9-9f88-454a-9db8-1f9cb2562d16 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e" status: 200 len: 1471 microversion: 2.1 time: 0.337352 Sep 08 10:47:06.850736 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1103/2207] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:06 2022] GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e => generated 1471 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:47:06.931685 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6fcb1de2-0b79-458c-8411-01ee50069854 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:06.932782 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6fcb1de2-0b79-458c-8411-01ee50069854 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: eca1ed67-f21d-46e3-8557-014bc6b63953] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:06.944155 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6fcb1de2-0b79-458c-8411-01ee50069854 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:06.944872 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6fcb1de2-0b79-458c-8411-01ee50069854 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:06.945652 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6fcb1de2-0b79-458c-8411-01ee50069854 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:06.946646 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6fcb1de2-0b79-458c-8411-01ee50069854 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:06.947186 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6fcb1de2-0b79-458c-8411-01ee50069854 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:06.947688 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6fcb1de2-0b79-458c-8411-01ee50069854 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:07.082496 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-3e6b0eeb-1086-461b-964e-0a3ff3513d74 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416642c1ee664b4d9e0fb14d02266b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cfab473734f4b63aaa78508ef460a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:07.095066 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3e6b0eeb-1086-461b-964e-0a3ff3513d74 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] 10.222.0.27 "GET /compute/v2.1/servers/33157107-6744-4177-9c29-3822a7d34ff9" status: 200 len: 1319 microversion: 2.1 time: 0.621975 Sep 08 10:47:07.095656 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1105/2208] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:06 2022] GET /compute/v2.1/servers/33157107-6744-4177-9c29-3822a7d34ff9 => generated 1319 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:07.135469 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8f52d5db-4de5-4bf7-bce2-96323a3b4207 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:07.136566 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8f52d5db-4de5-4bf7-bce2-96323a3b4207 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: e052494d-6c34-4e3a-adac-4c7ed14f87c9] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:07.146450 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f52d5db-4de5-4bf7-bce2-96323a3b4207 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:07.147351 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f52d5db-4de5-4bf7-bce2-96323a3b4207 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:07.148023 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f52d5db-4de5-4bf7-bce2-96323a3b4207 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:07.149503 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f52d5db-4de5-4bf7-bce2-96323a3b4207 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:07.150200 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f52d5db-4de5-4bf7-bce2-96323a3b4207 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:07.150760 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f52d5db-4de5-4bf7-bce2-96323a3b4207 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:07.154634 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6fcb1de2-0b79-458c-8411-01ee50069854 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:07.165963 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6fcb1de2-0b79-458c-8411-01ee50069854 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/eca1ed67-f21d-46e3-8557-014bc6b63953" status: 200 len: 1510 microversion: 2.1 time: 0.239350 Sep 08 10:47:07.166940 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1104/2209] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:06 2022] GET /compute/v2.1/servers/eca1ed67-f21d-46e3-8557-014bc6b63953 => generated 1510 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:07.243176 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8f52d5db-4de5-4bf7-bce2-96323a3b4207 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:07.272307 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8f52d5db-4de5-4bf7-bce2-96323a3b4207 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/e052494d-6c34-4e3a-adac-4c7ed14f87c9" status: 200 len: 1265 microversion: 2.1 time: 0.143162 Sep 08 10:47:07.275323 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1106/2210] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:07 2022] GET /compute/v2.1/servers/e052494d-6c34-4e3a-adac-4c7ed14f87c9 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:47:07.875113 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8d9878bd-6b5f-4642-8bf7-a4a66ae9f814 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:07.875909 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8d9878bd-6b5f-4642-8bf7-a4a66ae9f814 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: 3766b195-ace4-4563-a24e-dca72941251e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:07.899250 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d9878bd-6b5f-4642-8bf7-a4a66ae9f814 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:07.899542 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d9878bd-6b5f-4642-8bf7-a4a66ae9f814 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:07.899994 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d9878bd-6b5f-4642-8bf7-a4a66ae9f814 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:07.903021 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d9878bd-6b5f-4642-8bf7-a4a66ae9f814 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:07.903503 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d9878bd-6b5f-4642-8bf7-a4a66ae9f814 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:07.903941 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d9878bd-6b5f-4642-8bf7-a4a66ae9f814 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:08.129326 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1312a8e5-67c2-4ed5-bdcf-e2a382af07da tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:08.131028 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1312a8e5-67c2-4ed5-bdcf-e2a382af07da tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] [instance: 33157107-6744-4177-9c29-3822a7d34ff9] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:08.146089 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1312a8e5-67c2-4ed5-bdcf-e2a382af07da tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:08.146594 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1312a8e5-67c2-4ed5-bdcf-e2a382af07da tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:08.147068 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1312a8e5-67c2-4ed5-bdcf-e2a382af07da tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:08.147875 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1312a8e5-67c2-4ed5-bdcf-e2a382af07da tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:08.148410 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1312a8e5-67c2-4ed5-bdcf-e2a382af07da tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:08.148878 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1312a8e5-67c2-4ed5-bdcf-e2a382af07da tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:08.180505 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:47:08.252753 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8d9878bd-6b5f-4642-8bf7-a4a66ae9f814 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:08.267128 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8d9878bd-6b5f-4642-8bf7-a4a66ae9f814 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e" status: 200 len: 1471 microversion: 2.1 time: 0.396050 Sep 08 10:47:08.272317 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1105/2211] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:07 2022] GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e => generated 1471 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:08.291411 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-97e76fb1-61a0-49e2-8b64-5f1ae9ac4f60 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:08.293980 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-97e76fb1-61a0-49e2-8b64-5f1ae9ac4f60 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: eca1ed67-f21d-46e3-8557-014bc6b63953] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:08.323246 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-97e76fb1-61a0-49e2-8b64-5f1ae9ac4f60 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:08.323868 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-97e76fb1-61a0-49e2-8b64-5f1ae9ac4f60 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:08.324420 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-97e76fb1-61a0-49e2-8b64-5f1ae9ac4f60 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:08.326545 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-97e76fb1-61a0-49e2-8b64-5f1ae9ac4f60 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:08.327266 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-97e76fb1-61a0-49e2-8b64-5f1ae9ac4f60 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:08.327918 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-97e76fb1-61a0-49e2-8b64-5f1ae9ac4f60 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:08.564900 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-97e76fb1-61a0-49e2-8b64-5f1ae9ac4f60 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:08.574749 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-97e76fb1-61a0-49e2-8b64-5f1ae9ac4f60 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/eca1ed67-f21d-46e3-8557-014bc6b63953" status: 200 len: 1510 microversion: 2.1 time: 0.301173 Sep 08 10:47:08.592275 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1106/2212] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:08 2022] GET /compute/v2.1/servers/eca1ed67-f21d-46e3-8557-014bc6b63953 => generated 1510 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:08.600787 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1312a8e5-67c2-4ed5-bdcf-e2a382af07da tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416642c1ee664b4d9e0fb14d02266b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cfab473734f4b63aaa78508ef460a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:08.608073 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a8412ceb-37c8-473c-91b1-241f85c25a2c tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:08.609704 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a8412ceb-37c8-473c-91b1-241f85c25a2c tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: e052494d-6c34-4e3a-adac-4c7ed14f87c9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:08.611142 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1312a8e5-67c2-4ed5-bdcf-e2a382af07da tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] 10.222.0.27 "GET /compute/v2.1/servers/33157107-6744-4177-9c29-3822a7d34ff9" status: 200 len: 1319 microversion: 2.1 time: 0.488782 Sep 08 10:47:08.619090 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a8412ceb-37c8-473c-91b1-241f85c25a2c tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:08.619817 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a8412ceb-37c8-473c-91b1-241f85c25a2c tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:08.620257 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a8412ceb-37c8-473c-91b1-241f85c25a2c tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:08.620942 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a8412ceb-37c8-473c-91b1-241f85c25a2c tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:08.621432 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a8412ceb-37c8-473c-91b1-241f85c25a2c tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:08.622048 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a8412ceb-37c8-473c-91b1-241f85c25a2c tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:08.629433 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1107/2213] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:08 2022] GET /compute/v2.1/servers/33157107-6744-4177-9c29-3822a7d34ff9 => generated 1319 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:08.822718 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a8412ceb-37c8-473c-91b1-241f85c25a2c tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:08.831905 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a8412ceb-37c8-473c-91b1-241f85c25a2c tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/e052494d-6c34-4e3a-adac-4c7ed14f87c9" status: 200 len: 1307 microversion: 2.1 time: 0.237437 Sep 08 10:47:08.846407 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1107/2214] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:08 2022] GET /compute/v2.1/servers/e052494d-6c34-4e3a-adac-4c7ed14f87c9 => generated 1307 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:09.294828 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-34aff3a0-feb6-4631-aa60-65246b0971a3 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:09.295619 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-34aff3a0-feb6-4631-aa60-65246b0971a3 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: 3766b195-ace4-4563-a24e-dca72941251e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:09.316939 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-34aff3a0-feb6-4631-aa60-65246b0971a3 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:09.317639 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-34aff3a0-feb6-4631-aa60-65246b0971a3 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:09.318266 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-34aff3a0-feb6-4631-aa60-65246b0971a3 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:09.319625 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-34aff3a0-feb6-4631-aa60-65246b0971a3 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:09.323479 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-34aff3a0-feb6-4631-aa60-65246b0971a3 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:09.328216 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-34aff3a0-feb6-4631-aa60-65246b0971a3 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:09.601670 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-64d25e95-192b-4d6b-b31f-51af7c726709 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:09.602367 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-64d25e95-192b-4d6b-b31f-51af7c726709 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: eca1ed67-f21d-46e3-8557-014bc6b63953] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:09.611712 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64d25e95-192b-4d6b-b31f-51af7c726709 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:09.612411 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64d25e95-192b-4d6b-b31f-51af7c726709 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:09.613067 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64d25e95-192b-4d6b-b31f-51af7c726709 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:09.614016 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64d25e95-192b-4d6b-b31f-51af7c726709 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:09.614671 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64d25e95-192b-4d6b-b31f-51af7c726709 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:09.615365 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64d25e95-192b-4d6b-b31f-51af7c726709 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:09.620104 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-34aff3a0-feb6-4631-aa60-65246b0971a3 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:09.634568 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-34aff3a0-feb6-4631-aa60-65246b0971a3 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e" status: 200 len: 1471 microversion: 2.1 time: 0.343967 Sep 08 10:47:09.646898 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1108/2215] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:09 2022] GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e => generated 1471 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:09.663325 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e77e4918-21e7-46be-af04-892b3c213ac0 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:09.671128 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e77e4918-21e7-46be-af04-892b3c213ac0 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] [instance: 33157107-6744-4177-9c29-3822a7d34ff9] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:09.690160 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e77e4918-21e7-46be-af04-892b3c213ac0 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:09.693182 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e77e4918-21e7-46be-af04-892b3c213ac0 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:09.694340 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e77e4918-21e7-46be-af04-892b3c213ac0 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:09.695633 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e77e4918-21e7-46be-af04-892b3c213ac0 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:09.697935 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e77e4918-21e7-46be-af04-892b3c213ac0 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:09.700689 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e77e4918-21e7-46be-af04-892b3c213ac0 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:09.982523 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-64d25e95-192b-4d6b-b31f-51af7c726709 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:09.998413 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-64d25e95-192b-4d6b-b31f-51af7c726709 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/eca1ed67-f21d-46e3-8557-014bc6b63953" status: 200 len: 1510 microversion: 2.1 time: 0.401703 Sep 08 10:47:10.019917 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1108/2216] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:09 2022] GET /compute/v2.1/servers/eca1ed67-f21d-46e3-8557-014bc6b63953 => generated 1510 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:47:10.025557 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-d1b223a5-0852-483a-bf6a-90811856db89 req-b1578d95-abd2-4b69-a504-3e5f88183c8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e052494d-6c34-4e3a-adac-4c7ed14f87c9", "tag": "0c1068a7-4057-4dd1-a50f-10422d722659"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:47:10.043166 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d1b223a5-0852-483a-bf6a-90811856db89 req-b1578d95-abd2-4b69-a504-3e5f88183c8e service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:10.043935 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d1b223a5-0852-483a-bf6a-90811856db89 req-b1578d95-abd2-4b69-a504-3e5f88183c8e service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:10.044807 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d1b223a5-0852-483a-bf6a-90811856db89 req-b1578d95-abd2-4b69-a504-3e5f88183c8e service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:10.067591 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-d1b223a5-0852-483a-bf6a-90811856db89 req-b1578d95-abd2-4b69-a504-3e5f88183c8e service nova] Creating event network-changed:0c1068a7-4057-4dd1-a50f-10422d722659 for instance e052494d-6c34-4e3a-adac-4c7ed14f87c9 on n-h1-850501-12 Sep 08 10:47:10.078185 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-d1b223a5-0852-483a-bf6a-90811856db89 req-b1578d95-abd2-4b69-a504-3e5f88183c8e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054771 Sep 08 10:47:10.079763 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1109/2217] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:47:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:47:10.090078 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c33739d5-e288-4526-9e99-b26a9c5d5e7d tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:10.092128 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c33739d5-e288-4526-9e99-b26a9c5d5e7d tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: e052494d-6c34-4e3a-adac-4c7ed14f87c9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:10.103167 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c33739d5-e288-4526-9e99-b26a9c5d5e7d tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:10.104671 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c33739d5-e288-4526-9e99-b26a9c5d5e7d tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:10.105676 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c33739d5-e288-4526-9e99-b26a9c5d5e7d tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:10.107268 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c33739d5-e288-4526-9e99-b26a9c5d5e7d tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:10.108857 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c33739d5-e288-4526-9e99-b26a9c5d5e7d tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:10.109680 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c33739d5-e288-4526-9e99-b26a9c5d5e7d tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:10.146961 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e77e4918-21e7-46be-af04-892b3c213ac0 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416642c1ee664b4d9e0fb14d02266b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cfab473734f4b63aaa78508ef460a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:10.165735 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e77e4918-21e7-46be-af04-892b3c213ac0 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] 10.222.0.27 "GET /compute/v2.1/servers/33157107-6744-4177-9c29-3822a7d34ff9" status: 200 len: 1468 microversion: 2.1 time: 0.517364 Sep 08 10:47:10.166931 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1109/2218] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:09 2022] GET /compute/v2.1/servers/33157107-6744-4177-9c29-3822a7d34ff9 => generated 1468 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:10.327616 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3829ca11-265b-4c3a-a28b-ada2070c853f tempest-LiveMigrationNegativeTest-317868421 tempest-LiveMigrationNegativeTest-317868421-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-404315401", "block_migration": true, "disk_over_commit": false}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:47:10.333911 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3829ca11-265b-4c3a-a28b-ada2070c853f tempest-LiveMigrationNegativeTest-317868421 tempest-LiveMigrationNegativeTest-317868421-project-admin] [instance: 33157107-6744-4177-9c29-3822a7d34ff9] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:10.345436 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3829ca11-265b-4c3a-a28b-ada2070c853f tempest-LiveMigrationNegativeTest-317868421 tempest-LiveMigrationNegativeTest-317868421-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:10.347019 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3829ca11-265b-4c3a-a28b-ada2070c853f tempest-LiveMigrationNegativeTest-317868421 tempest-LiveMigrationNegativeTest-317868421-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:10.347652 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3829ca11-265b-4c3a-a28b-ada2070c853f tempest-LiveMigrationNegativeTest-317868421 tempest-LiveMigrationNegativeTest-317868421-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:10.351919 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3829ca11-265b-4c3a-a28b-ada2070c853f tempest-LiveMigrationNegativeTest-317868421 tempest-LiveMigrationNegativeTest-317868421-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:10.355451 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3829ca11-265b-4c3a-a28b-ada2070c853f tempest-LiveMigrationNegativeTest-317868421 tempest-LiveMigrationNegativeTest-317868421-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:10.358549 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3829ca11-265b-4c3a-a28b-ada2070c853f tempest-LiveMigrationNegativeTest-317868421 tempest-LiveMigrationNegativeTest-317868421-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:10.433070 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-3829ca11-265b-4c3a-a28b-ada2070c853f tempest-LiveMigrationNegativeTest-317868421 tempest-LiveMigrationNegativeTest-317868421-project-admin] Lazy-loading 'flavor' on Instance uuid 33157107-6744-4177-9c29-3822a7d34ff9 {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:47:10.532951 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c33739d5-e288-4526-9e99-b26a9c5d5e7d tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:10.539939 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3829ca11-265b-4c3a-a28b-ada2070c853f tempest-LiveMigrationNegativeTest-317868421 tempest-LiveMigrationNegativeTest-317868421-project-admin] [instance: 33157107-6744-4177-9c29-3822a7d34ff9] Going to try to live migrate instance to tempest-host-404315401 {{(pid=128861) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 08 10:47:10.559987 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-3829ca11-265b-4c3a-a28b-ada2070c853f tempest-LiveMigrationNegativeTest-317868421 tempest-LiveMigrationNegativeTest-317868421-project-admin] HTTP exception thrown: Compute host tempest-host-404315401 could not be found. Sep 08 10:47:10.561915 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c33739d5-e288-4526-9e99-b26a9c5d5e7d tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/e052494d-6c34-4e3a-adac-4c7ed14f87c9" status: 200 len: 1307 microversion: 2.1 time: 0.477319 Sep 08 10:47:10.566632 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1110/2219] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:10 2022] GET /compute/v2.1/servers/e052494d-6c34-4e3a-adac-4c7ed14f87c9 => generated 1307 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:10.594925 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3829ca11-265b-4c3a-a28b-ada2070c853f tempest-LiveMigrationNegativeTest-317868421 tempest-LiveMigrationNegativeTest-317868421-project-admin] Request method failure captured: Sep 08 10:47:10.594925 n-d-850501-12 devstack@n-api.service[128861]: request: POST /compute/v2.1/servers/33157107-6744-4177-9c29-3822a7d34ff9/action HTTP/1.1 Sep 08 10:47:10.594925 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:47:10.594925 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:47:10.594925 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:47:10.594925 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 106 Sep 08 10:47:10.594925 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:47:10.594925 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:47:10.594925 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:47:10.594925 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:47:10.594925 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcgY56IllxMl8Z9zdzY820RX5UUdBVxbalCTFA3X70KUTmxwzxJLYA623fAuqPF3t7s9fApQU1mahyLTgmM3Rdyp_Tevfbz0lHNIHGPH1DJd7jKs2d7Hmssv2itwsmZvw4m2s9WRE1bOq9QQOGRtXi0-K2ma__siqmh6A-2iGh2wDnk Sep 08 10:47:10.594925 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:47:10.594925 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:47:10.594925 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:47:10.594925 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:47:10.594925 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:47:10.594925 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:47:10.594925 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 86ac5a8772494672b8ed15db1ebed0a8 Sep 08 10:47:10.594925 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-LiveMigrationNegativeTest-317868421 Sep 08 10:47:10.594925 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,admin,member Sep 08 10:47:10.594925 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,admin,member Sep 08 10:47:10.594925 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/86ac5a8772494672b8ed15db1ebed0a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/86ac5a8772494672b8ed15db1ebed0a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_86ac5a8772494672b8ed15db1ebed0a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/86ac5a8772494672b8ed15db1ebed0a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:47:10.594925 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-LiveMigrationNegativeTest-317868421 Sep 08 10:47:10.594925 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 86ac5a8772494672b8ed15db1ebed0a8 Sep 08 10:47:10.594925 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-317868421 Sep 08 10:47:10.594925 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-LiveMigrationNegativeTest-317868421-project-admin Sep 08 10:47:10.594925 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:47:10.594925 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:47:10.594925 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 8a4c775129e44f7795e275761e2c5396 Sep 08 10:47:10.594925 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-LiveMigrationNegativeTest-317868421-project-admin Sep 08 10:47:10.594925 n-d-850501-12 devstack@n-api.service[128861]: Sep 08 10:47:10.594925 n-d-850501-12 devstack@n-api.service[128861]: {"os-migrateLive": {"host": "tempest-host-404315401", "block_migration": true, "disk_over_commit": false}} Sep 08 10:47:10.594925 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:47:10.594925 n-d-850501-12 devstack@n-api.service[128861]: exception: Compute host tempest-host-404315401 could not be found. Sep 08 10:47:10.594925 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '33157107-6744-4177-9c29-3822a7d34ff9', 'body': {'os-migrateLive': {'host': 'tempest-host-404315401', 'block_migration': True, 'disk_over_commit': False}}} Sep 08 10:47:10.594925 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:47:10.594925 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:10.594925 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Sep 08 10:47:10.594925 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Sep 08 10:47:10.594925 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 08 10:47:10.594925 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 10:47:10.594925 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 08 10:47:10.594925 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 08 10:47:10.594925 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 08 10:47:10.594925 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 08 10:47:10.594925 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 08 10:47:10.594925 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 08 10:47:10.594925 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 08 10:47:10.594925 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 08 10:47:10.594925 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Sep 08 10:47:10.594925 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 08 10:47:10.594925 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 10:47:10.594925 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 10:47:10.594925 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 08 10:47:10.594925 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 08 10:47:10.594925 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Sep 08 10:47:10.594925 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Sep 08 10:47:10.594925 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 10:47:10.594925 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 10:47:10.594925 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Sep 08 10:47:10.594925 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Sep 08 10:47:10.600379 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Sep 08 10:47:10.600379 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:47:10.600379 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Sep 08 10:47:10.600379 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Sep 08 10:47:10.600379 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Sep 08 10:47:10.600379 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Sep 08 10:47:10.600379 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Sep 08 10:47:10.600379 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Sep 08 10:47:10.600379 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-404315401 could not be found. Sep 08 10:47:10.600379 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:10.600379 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:10.600379 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:10.600379 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:10.600379 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:47:10.600379 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:47:10.600379 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:47:10.600379 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:47:10.600379 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:47:10.600379 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:47:10.600379 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:47:10.600379 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:47:10.600379 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:47:10.600379 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:47:10.600379 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:47:10.600379 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:47:10.600379 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 08 10:47:10.600379 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Sep 08 10:47:10.600379 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 08 10:47:10.600379 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-404315401 could not be found. Sep 08 10:47:10.600379 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:10.600379 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:10.600379 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:10.600379 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:10.600379 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:47:10.600379 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:47:10.600379 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:47:10.600379 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:47:10.600379 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-404315401 could not be found. Sep 08 10:47:10.600379 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:10.600379 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3829ca11-265b-4c3a-a28b-ada2070c853f tempest-LiveMigrationNegativeTest-317868421 tempest-LiveMigrationNegativeTest-317868421-project-admin] Returning 400 to user: Compute host tempest-host-404315401 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:47:10.600379 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3829ca11-265b-4c3a-a28b-ada2070c853f tempest-LiveMigrationNegativeTest-317868421 tempest-LiveMigrationNegativeTest-317868421-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/33157107-6744-4177-9c29-3822a7d34ff9/action" status: 400 len: 99 microversion: 2.1 time: 0.402812 Sep 08 10:47:10.610153 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cd7de57c-51d4-48f5-9380-33cbd7072ab7 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:10.610153 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cd7de57c-51d4-48f5-9380-33cbd7072ab7 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] [instance: 33157107-6744-4177-9c29-3822a7d34ff9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:10.614262 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1110/2220] 10.222.0.27 () {60 vars in 1279 bytes} [Thu Sep 8 10:47:10 2022] POST /compute/v2.1/servers/33157107-6744-4177-9c29-3822a7d34ff9/action => generated 99 bytes in 420 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Sep 08 10:47:10.628441 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd7de57c-51d4-48f5-9380-33cbd7072ab7 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:10.629353 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd7de57c-51d4-48f5-9380-33cbd7072ab7 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:10.630128 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd7de57c-51d4-48f5-9380-33cbd7072ab7 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:10.631410 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd7de57c-51d4-48f5-9380-33cbd7072ab7 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:10.639753 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd7de57c-51d4-48f5-9380-33cbd7072ab7 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:10.641094 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd7de57c-51d4-48f5-9380-33cbd7072ab7 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:10.679296 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-15c9b5cb-34b9-45c4-9487-324e3f97e8f7 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:10.680822 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-15c9b5cb-34b9-45c4-9487-324e3f97e8f7 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: 3766b195-ace4-4563-a24e-dca72941251e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:10.716033 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-15c9b5cb-34b9-45c4-9487-324e3f97e8f7 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:10.726268 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-15c9b5cb-34b9-45c4-9487-324e3f97e8f7 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:10.728936 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-15c9b5cb-34b9-45c4-9487-324e3f97e8f7 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:10.730330 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-15c9b5cb-34b9-45c4-9487-324e3f97e8f7 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:10.733274 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-15c9b5cb-34b9-45c4-9487-324e3f97e8f7 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:10.734832 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-15c9b5cb-34b9-45c4-9487-324e3f97e8f7 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:10.973157 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-15c9b5cb-34b9-45c4-9487-324e3f97e8f7 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:10.994277 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-15c9b5cb-34b9-45c4-9487-324e3f97e8f7 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e" status: 200 len: 1477 microversion: 2.1 time: 0.329443 Sep 08 10:47:10.995348 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1111/2221] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:10 2022] GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e => generated 1477 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:11.010567 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cd7de57c-51d4-48f5-9380-33cbd7072ab7 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416642c1ee664b4d9e0fb14d02266b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cfab473734f4b63aaa78508ef460a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:11.024006 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cd7de57c-51d4-48f5-9380-33cbd7072ab7 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] 10.222.0.27 "GET /compute/v2.1/servers/33157107-6744-4177-9c29-3822a7d34ff9" status: 200 len: 1468 microversion: 2.1 time: 0.420702 Sep 08 10:47:11.024624 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1111/2222] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:10 2022] GET /compute/v2.1/servers/33157107-6744-4177-9c29-3822a7d34ff9 => generated 1468 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:47:11.046650 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bfc468f4-93c7-48a8-9e6d-4fe79029b1a6 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:11.050505 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bfc468f4-93c7-48a8-9e6d-4fe79029b1a6 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: eca1ed67-f21d-46e3-8557-014bc6b63953] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:11.066349 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bfc468f4-93c7-48a8-9e6d-4fe79029b1a6 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:11.068197 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bfc468f4-93c7-48a8-9e6d-4fe79029b1a6 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:11.070076 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bfc468f4-93c7-48a8-9e6d-4fe79029b1a6 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:11.071426 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bfc468f4-93c7-48a8-9e6d-4fe79029b1a6 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:11.072404 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bfc468f4-93c7-48a8-9e6d-4fe79029b1a6 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:11.074111 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bfc468f4-93c7-48a8-9e6d-4fe79029b1a6 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:11.111244 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-63355f3b-4558-43d2-947c-c4f4942e8ecb tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1627209451", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:47:11.269299 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-63355f3b-4558-43d2-947c-c4f4942e8ecb tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] validate_networks() for None {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:47:11.368900 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-bfc468f4-93c7-48a8-9e6d-4fe79029b1a6 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:11.382587 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bfc468f4-93c7-48a8-9e6d-4fe79029b1a6 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/eca1ed67-f21d-46e3-8557-014bc6b63953" status: 200 len: 1510 microversion: 2.1 time: 0.357994 Sep 08 10:47:11.398069 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1112/2223] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:11 2022] GET /compute/v2.1/servers/eca1ed67-f21d-46e3-8557-014bc6b63953 => generated 1510 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:11.583403 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-63355f3b-4558-43d2-947c-c4f4942e8ecb tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:47:11.583881 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-63355f3b-4558-43d2-947c-c4f4942e8ecb tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:47:11.585454 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-63355f3b-4558-43d2-947c-c4f4942e8ecb tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:47:11.585454 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-63355f3b-4558-43d2-947c-c4f4942e8ecb tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:47:11.585454 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-63355f3b-4558-43d2-947c-c4f4942e8ecb tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:47:11.598042 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63355f3b-4558-43d2-947c-c4f4942e8ecb tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:11.598331 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2e088801-d953-4568-8f05-286e24e68131 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:11.599105 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63355f3b-4558-43d2-947c-c4f4942e8ecb tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:11.599614 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2e088801-d953-4568-8f05-286e24e68131 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: e052494d-6c34-4e3a-adac-4c7ed14f87c9] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:11.599894 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63355f3b-4558-43d2-947c-c4f4942e8ecb tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:11.600891 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63355f3b-4558-43d2-947c-c4f4942e8ecb tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:11.601962 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63355f3b-4558-43d2-947c-c4f4942e8ecb tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:11.603049 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63355f3b-4558-43d2-947c-c4f4942e8ecb tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:11.611727 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2e088801-d953-4568-8f05-286e24e68131 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:11.612230 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2e088801-d953-4568-8f05-286e24e68131 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:11.612673 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2e088801-d953-4568-8f05-286e24e68131 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:11.613633 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2e088801-d953-4568-8f05-286e24e68131 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:11.614669 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2e088801-d953-4568-8f05-286e24e68131 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:11.615015 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2e088801-d953-4568-8f05-286e24e68131 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:11.637000 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-63355f3b-4558-43d2-947c-c4f4942e8ecb tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Getting quotas for project 7cfab473734f4b63aaa78508ef460a9f. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:47:11.648452 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-63355f3b-4558-43d2-947c-c4f4942e8ecb tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Getting quotas for user 416642c1ee664b4d9e0fb14d02266b37 and project 7cfab473734f4b63aaa78508ef460a9f. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:47:11.667522 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-63355f3b-4558-43d2-947c-c4f4942e8ecb tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:47:11.672610 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-63355f3b-4558-43d2-947c-c4f4942e8ecb tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] [instance: c937afd2-1699-4699-809d-20cfcead412c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:47:11.752439 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-63355f3b-4558-43d2-947c-c4f4942e8ecb tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.649061 Sep 08 10:47:11.753447 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1112/2224] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:47:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 652 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:47:11.766718 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-26662086-b69c-455d-ab23-451e621dc5f2 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:11.767403 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-26662086-b69c-455d-ab23-451e621dc5f2 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] [instance: c937afd2-1699-4699-809d-20cfcead412c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:11.863474 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-26662086-b69c-455d-ab23-451e621dc5f2 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416642c1ee664b4d9e0fb14d02266b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cfab473734f4b63aaa78508ef460a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:11.875035 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-26662086-b69c-455d-ab23-451e621dc5f2 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] 10.222.0.27 "GET /compute/v2.1/servers/c937afd2-1699-4699-809d-20cfcead412c" status: 200 len: 1219 microversion: 2.1 time: 0.113384 Sep 08 10:47:11.879585 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1113/2225] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:11 2022] GET /compute/v2.1/servers/c937afd2-1699-4699-809d-20cfcead412c => generated 1219 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:47:11.927253 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2e088801-d953-4568-8f05-286e24e68131 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:11.945400 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2e088801-d953-4568-8f05-286e24e68131 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/e052494d-6c34-4e3a-adac-4c7ed14f87c9" status: 200 len: 1307 microversion: 2.1 time: 0.354877 Sep 08 10:47:11.947436 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1113/2226] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:11 2022] GET /compute/v2.1/servers/e052494d-6c34-4e3a-adac-4c7ed14f87c9 => generated 1307 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:12.027318 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bd277e05-84e1-442d-9692-424df6dc192e tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:12.028350 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bd277e05-84e1-442d-9692-424df6dc192e tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: 3766b195-ace4-4563-a24e-dca72941251e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:12.047162 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bd277e05-84e1-442d-9692-424df6dc192e tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:12.047943 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bd277e05-84e1-442d-9692-424df6dc192e tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:12.048495 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bd277e05-84e1-442d-9692-424df6dc192e tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:12.049532 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bd277e05-84e1-442d-9692-424df6dc192e tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:12.050308 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bd277e05-84e1-442d-9692-424df6dc192e tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:12.051014 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bd277e05-84e1-442d-9692-424df6dc192e tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:12.431077 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d302b72c-8cb2-4fcd-b6b2-b015737a8acc tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:12.432160 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d302b72c-8cb2-4fcd-b6b2-b015737a8acc tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: eca1ed67-f21d-46e3-8557-014bc6b63953] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:12.457855 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bd277e05-84e1-442d-9692-424df6dc192e tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:12.466127 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d302b72c-8cb2-4fcd-b6b2-b015737a8acc tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:12.468526 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d302b72c-8cb2-4fcd-b6b2-b015737a8acc tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:12.471047 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d302b72c-8cb2-4fcd-b6b2-b015737a8acc tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:12.472486 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d302b72c-8cb2-4fcd-b6b2-b015737a8acc tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:12.478272 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d302b72c-8cb2-4fcd-b6b2-b015737a8acc tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:12.479317 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d302b72c-8cb2-4fcd-b6b2-b015737a8acc tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:12.501402 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bd277e05-84e1-442d-9692-424df6dc192e tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e" status: 200 len: 1477 microversion: 2.1 time: 0.480597 Sep 08 10:47:12.503638 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1114/2227] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:12 2022] GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e => generated 1477 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:12.759477 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d302b72c-8cb2-4fcd-b6b2-b015737a8acc tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:12.803118 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d302b72c-8cb2-4fcd-b6b2-b015737a8acc tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/eca1ed67-f21d-46e3-8557-014bc6b63953" status: 200 len: 1510 microversion: 2.1 time: 0.379911 Sep 08 10:47:12.810373 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1114/2228] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:12 2022] GET /compute/v2.1/servers/eca1ed67-f21d-46e3-8557-014bc6b63953 => generated 1510 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:12.911065 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-da2949fb-16ee-4fa7-ac3c-ec3144d361b0 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:12.912999 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-da2949fb-16ee-4fa7-ac3c-ec3144d361b0 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] [instance: c937afd2-1699-4699-809d-20cfcead412c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:12.927489 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-da2949fb-16ee-4fa7-ac3c-ec3144d361b0 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:12.932103 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-da2949fb-16ee-4fa7-ac3c-ec3144d361b0 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:12.935715 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-da2949fb-16ee-4fa7-ac3c-ec3144d361b0 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:12.937281 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-da2949fb-16ee-4fa7-ac3c-ec3144d361b0 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:12.937906 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-da2949fb-16ee-4fa7-ac3c-ec3144d361b0 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:12.938668 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-da2949fb-16ee-4fa7-ac3c-ec3144d361b0 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:12.978209 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-812708ca-a4d6-4e0d-9e68-f9f3ff04db36 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:12.980244 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-812708ca-a4d6-4e0d-9e68-f9f3ff04db36 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: e052494d-6c34-4e3a-adac-4c7ed14f87c9] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:13.026620 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-812708ca-a4d6-4e0d-9e68-f9f3ff04db36 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:13.027136 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-812708ca-a4d6-4e0d-9e68-f9f3ff04db36 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:13.027579 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-812708ca-a4d6-4e0d-9e68-f9f3ff04db36 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:13.032779 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-812708ca-a4d6-4e0d-9e68-f9f3ff04db36 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:13.033325 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-812708ca-a4d6-4e0d-9e68-f9f3ff04db36 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:13.034825 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-812708ca-a4d6-4e0d-9e68-f9f3ff04db36 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:13.080142 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-da2949fb-16ee-4fa7-ac3c-ec3144d361b0 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416642c1ee664b4d9e0fb14d02266b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cfab473734f4b63aaa78508ef460a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:13.099605 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-da2949fb-16ee-4fa7-ac3c-ec3144d361b0 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] 10.222.0.27 "GET /compute/v2.1/servers/c937afd2-1699-4699-809d-20cfcead412c" status: 200 len: 1223 microversion: 2.1 time: 0.187006 Sep 08 10:47:13.100420 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1115/2229] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:12 2022] GET /compute/v2.1/servers/c937afd2-1699-4699-809d-20cfcead412c => generated 1223 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:13.533365 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e2181deb-c1f2-4061-95e0-a473d0976a18 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:13.534517 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e2181deb-c1f2-4061-95e0-a473d0976a18 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: 3766b195-ace4-4563-a24e-dca72941251e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:13.549186 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e2181deb-c1f2-4061-95e0-a473d0976a18 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:13.549743 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e2181deb-c1f2-4061-95e0-a473d0976a18 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:13.550186 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e2181deb-c1f2-4061-95e0-a473d0976a18 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:13.551077 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e2181deb-c1f2-4061-95e0-a473d0976a18 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:13.551834 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e2181deb-c1f2-4061-95e0-a473d0976a18 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:13.552271 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e2181deb-c1f2-4061-95e0-a473d0976a18 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:13.690311 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-812708ca-a4d6-4e0d-9e68-f9f3ff04db36 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:13.705603 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-812708ca-a4d6-4e0d-9e68-f9f3ff04db36 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/e052494d-6c34-4e3a-adac-4c7ed14f87c9" status: 200 len: 1307 microversion: 2.1 time: 0.737505 Sep 08 10:47:13.707268 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1115/2230] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:12 2022] GET /compute/v2.1/servers/e052494d-6c34-4e3a-adac-4c7ed14f87c9 => generated 1307 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:13.774585 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e2181deb-c1f2-4061-95e0-a473d0976a18 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:13.791803 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e2181deb-c1f2-4061-95e0-a473d0976a18 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e" status: 200 len: 1477 microversion: 2.1 time: 0.268043 Sep 08 10:47:13.805053 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1116/2231] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:13 2022] GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e => generated 1477 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:13.839941 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d6710458-3fa4-4a26-bce5-f5f481267d08 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:13.840552 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d6710458-3fa4-4a26-bce5-f5f481267d08 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: eca1ed67-f21d-46e3-8557-014bc6b63953] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:13.849107 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d6710458-3fa4-4a26-bce5-f5f481267d08 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:13.849869 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d6710458-3fa4-4a26-bce5-f5f481267d08 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:13.850877 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d6710458-3fa4-4a26-bce5-f5f481267d08 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:13.851950 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d6710458-3fa4-4a26-bce5-f5f481267d08 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:13.852600 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d6710458-3fa4-4a26-bce5-f5f481267d08 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:13.857484 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d6710458-3fa4-4a26-bce5-f5f481267d08 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:14.282331 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d6710458-3fa4-4a26-bce5-f5f481267d08 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:14.312457 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d6710458-3fa4-4a26-bce5-f5f481267d08 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/eca1ed67-f21d-46e3-8557-014bc6b63953" status: 200 len: 1487 microversion: 2.1 time: 0.482880 Sep 08 10:47:14.327429 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1116/2232] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:13 2022] GET /compute/v2.1/servers/eca1ed67-f21d-46e3-8557-014bc6b63953 => generated 1487 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:14.336534 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-73203a56-4ad4-4a88-b377-a2f01ee31cf5 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:14.337424 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-73203a56-4ad4-4a88-b377-a2f01ee31cf5 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] [instance: c937afd2-1699-4699-809d-20cfcead412c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:14.345998 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-73203a56-4ad4-4a88-b377-a2f01ee31cf5 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:14.346720 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-73203a56-4ad4-4a88-b377-a2f01ee31cf5 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:14.347313 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-73203a56-4ad4-4a88-b377-a2f01ee31cf5 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:14.348176 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-73203a56-4ad4-4a88-b377-a2f01ee31cf5 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:14.348772 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-73203a56-4ad4-4a88-b377-a2f01ee31cf5 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:14.349921 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-73203a56-4ad4-4a88-b377-a2f01ee31cf5 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:14.421065 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-b94eed62-c020-4558-b846-b44d4146f33b req-a577db0f-becb-483b-b661-12f24663efd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3766b195-ace4-4563-a24e-dca72941251e", "name": "network-vif-unplugged", "status": "completed", "tag": "67c1a6b2-cd91-4a27-a9a4-731db0f530a7"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:47:14.435121 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b94eed62-c020-4558-b846-b44d4146f33b req-a577db0f-becb-483b-b661-12f24663efd2 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:14.438800 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b94eed62-c020-4558-b846-b44d4146f33b req-a577db0f-becb-483b-b661-12f24663efd2 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:14.441602 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b94eed62-c020-4558-b846-b44d4146f33b req-a577db0f-becb-483b-b661-12f24663efd2 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:14.470062 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-b94eed62-c020-4558-b846-b44d4146f33b req-a577db0f-becb-483b-b661-12f24663efd2 service nova] Creating event network-vif-unplugged:67c1a6b2-cd91-4a27-a9a4-731db0f530a7 for instance 3766b195-ace4-4563-a24e-dca72941251e on n-h2-850501-12 Sep 08 10:47:14.476978 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-b94eed62-c020-4558-b846-b44d4146f33b req-a577db0f-becb-483b-b661-12f24663efd2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.410501 Sep 08 10:47:14.479908 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1117/2233] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:47:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:47:14.490760 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-41ee2368-e1e5-4bbd-94d9-52f760822fca tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:14.491737 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-41ee2368-e1e5-4bbd-94d9-52f760822fca tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: eca1ed67-f21d-46e3-8557-014bc6b63953] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:14.492720 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-73203a56-4ad4-4a88-b377-a2f01ee31cf5 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416642c1ee664b4d9e0fb14d02266b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cfab473734f4b63aaa78508ef460a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:14.500659 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-41ee2368-e1e5-4bbd-94d9-52f760822fca tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:14.501505 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-41ee2368-e1e5-4bbd-94d9-52f760822fca tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:14.502176 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-41ee2368-e1e5-4bbd-94d9-52f760822fca tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:14.503117 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-41ee2368-e1e5-4bbd-94d9-52f760822fca tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:14.503984 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-41ee2368-e1e5-4bbd-94d9-52f760822fca tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:14.504675 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-41ee2368-e1e5-4bbd-94d9-52f760822fca tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:14.507570 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-73203a56-4ad4-4a88-b377-a2f01ee31cf5 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] 10.222.0.27 "GET /compute/v2.1/servers/c937afd2-1699-4699-809d-20cfcead412c" status: 200 len: 1277 microversion: 2.1 time: 0.179072 Sep 08 10:47:14.525302 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1117/2234] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:14 2022] GET /compute/v2.1/servers/c937afd2-1699-4699-809d-20cfcead412c => generated 1277 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:14.587333 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-41ee2368-e1e5-4bbd-94d9-52f760822fca tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: eca1ed67-f21d-46e3-8557-014bc6b63953] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:47:14.688520 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:47:14.749593 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-565ee9d1-7488-4f25-ae43-bd7a2879246e tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:14.750478 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-565ee9d1-7488-4f25-ae43-bd7a2879246e tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: e052494d-6c34-4e3a-adac-4c7ed14f87c9] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:14.758410 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-565ee9d1-7488-4f25-ae43-bd7a2879246e tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:14.758913 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-565ee9d1-7488-4f25-ae43-bd7a2879246e tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:14.759354 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-565ee9d1-7488-4f25-ae43-bd7a2879246e tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:14.760060 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-565ee9d1-7488-4f25-ae43-bd7a2879246e tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:14.761050 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-565ee9d1-7488-4f25-ae43-bd7a2879246e tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:14.761673 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-565ee9d1-7488-4f25-ae43-bd7a2879246e tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:14.804542 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-41ee2368-e1e5-4bbd-94d9-52f760822fca tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "DELETE /compute/v2.1/servers/eca1ed67-f21d-46e3-8557-014bc6b63953" status: 204 len: 0 microversion: 2.1 time: 0.321758 Sep 08 10:47:14.805543 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1118/2235] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:47:14 2022] DELETE /compute/v2.1/servers/eca1ed67-f21d-46e3-8557-014bc6b63953 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:47:14.828572 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a1785170-79e2-4b95-bc73-dc3f00d85c7f tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:14.830107 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a1785170-79e2-4b95-bc73-dc3f00d85c7f tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: eca1ed67-f21d-46e3-8557-014bc6b63953] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:14.839548 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a1785170-79e2-4b95-bc73-dc3f00d85c7f tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:14.840375 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a1785170-79e2-4b95-bc73-dc3f00d85c7f tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:14.840960 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a1785170-79e2-4b95-bc73-dc3f00d85c7f tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:14.841742 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a1785170-79e2-4b95-bc73-dc3f00d85c7f tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:14.842196 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a1785170-79e2-4b95-bc73-dc3f00d85c7f tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:14.842824 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a1785170-79e2-4b95-bc73-dc3f00d85c7f tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:15.131259 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a1785170-79e2-4b95-bc73-dc3f00d85c7f tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:15.143048 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a1785170-79e2-4b95-bc73-dc3f00d85c7f tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/eca1ed67-f21d-46e3-8557-014bc6b63953" status: 200 len: 1493 microversion: 2.1 time: 0.325508 Sep 08 10:47:15.147331 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1119/2236] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:14 2022] GET /compute/v2.1/servers/eca1ed67-f21d-46e3-8557-014bc6b63953 => generated 1493 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:47:15.158208 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2abb7635-3ad9-4bb4-be77-8275ba388af8 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:15.159215 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2abb7635-3ad9-4bb4-be77-8275ba388af8 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: 3766b195-ace4-4563-a24e-dca72941251e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:15.166127 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2abb7635-3ad9-4bb4-be77-8275ba388af8 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:15.166873 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2abb7635-3ad9-4bb4-be77-8275ba388af8 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:15.167590 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2abb7635-3ad9-4bb4-be77-8275ba388af8 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:15.168772 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2abb7635-3ad9-4bb4-be77-8275ba388af8 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:15.169784 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2abb7635-3ad9-4bb4-be77-8275ba388af8 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:15.170531 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2abb7635-3ad9-4bb4-be77-8275ba388af8 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:15.199697 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-565ee9d1-7488-4f25-ae43-bd7a2879246e tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:15.213062 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-565ee9d1-7488-4f25-ae43-bd7a2879246e tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/e052494d-6c34-4e3a-adac-4c7ed14f87c9" status: 200 len: 1307 microversion: 2.1 time: 0.468100 Sep 08 10:47:15.230889 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1118/2237] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:14 2022] GET /compute/v2.1/servers/e052494d-6c34-4e3a-adac-4c7ed14f87c9 => generated 1307 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:47:15.423110 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2abb7635-3ad9-4bb4-be77-8275ba388af8 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:15.453908 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2abb7635-3ad9-4bb4-be77-8275ba388af8 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e" status: 200 len: 1477 microversion: 2.1 time: 0.298373 Sep 08 10:47:15.460178 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1120/2238] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:15 2022] GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e => generated 1477 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:15.536487 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-74981eae-2797-4fbf-b687-e6c9774e2ef3 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:15.539061 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-74981eae-2797-4fbf-b687-e6c9774e2ef3 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] [instance: c937afd2-1699-4699-809d-20cfcead412c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:15.566463 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-74981eae-2797-4fbf-b687-e6c9774e2ef3 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:15.567724 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-74981eae-2797-4fbf-b687-e6c9774e2ef3 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:15.578801 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-74981eae-2797-4fbf-b687-e6c9774e2ef3 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:15.580420 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-74981eae-2797-4fbf-b687-e6c9774e2ef3 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:15.581296 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-74981eae-2797-4fbf-b687-e6c9774e2ef3 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:15.582124 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-74981eae-2797-4fbf-b687-e6c9774e2ef3 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:15.982283 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-74981eae-2797-4fbf-b687-e6c9774e2ef3 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416642c1ee664b4d9e0fb14d02266b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cfab473734f4b63aaa78508ef460a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:15.992321 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-74981eae-2797-4fbf-b687-e6c9774e2ef3 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] 10.222.0.27 "GET /compute/v2.1/servers/c937afd2-1699-4699-809d-20cfcead412c" status: 200 len: 1319 microversion: 2.1 time: 0.463405 Sep 08 10:47:16.004275 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1119/2239] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:15 2022] GET /compute/v2.1/servers/c937afd2-1699-4699-809d-20cfcead412c => generated 1319 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:16.178285 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e41888b4-71ed-448c-8eca-b0bd4279a3f2 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:16.178911 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e41888b4-71ed-448c-8eca-b0bd4279a3f2 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: eca1ed67-f21d-46e3-8557-014bc6b63953] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:16.195527 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e41888b4-71ed-448c-8eca-b0bd4279a3f2 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:16.197178 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e41888b4-71ed-448c-8eca-b0bd4279a3f2 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:16.200739 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e41888b4-71ed-448c-8eca-b0bd4279a3f2 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:16.204069 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e41888b4-71ed-448c-8eca-b0bd4279a3f2 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:16.205130 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e41888b4-71ed-448c-8eca-b0bd4279a3f2 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:16.205810 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e41888b4-71ed-448c-8eca-b0bd4279a3f2 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:16.257950 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1664a57a-d73f-426f-8bba-2b15345b1260 tempest-QuotaClassesAdmin257Test-1165382423 tempest-QuotaClassesAdmin257Test-1165382423-project-admin] Calling method '.version_select at 0x7f68e892c160>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:16.294002 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1664a57a-d73f-426f-8bba-2b15345b1260 tempest-QuotaClassesAdmin257Test-1165382423 tempest-QuotaClassesAdmin257Test-1165382423-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.279663 Sep 08 10:47:16.294970 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1121/2240] 10.222.0.27 () {60 vars in 1226 bytes} [Thu Sep 8 10:47:16 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:47:16.300372 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6e5f1d2d-a202-4388-9755-206ceb8d78e0 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:16.300988 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6e5f1d2d-a202-4388-9755-206ceb8d78e0 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: e052494d-6c34-4e3a-adac-4c7ed14f87c9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:16.317486 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6e5f1d2d-a202-4388-9755-206ceb8d78e0 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:16.318262 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6e5f1d2d-a202-4388-9755-206ceb8d78e0 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:16.318926 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6e5f1d2d-a202-4388-9755-206ceb8d78e0 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:16.320150 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6e5f1d2d-a202-4388-9755-206ceb8d78e0 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:16.321183 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6e5f1d2d-a202-4388-9755-206ceb8d78e0 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:16.321922 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6e5f1d2d-a202-4388-9755-206ceb8d78e0 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:16.544491 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e41888b4-71ed-448c-8eca-b0bd4279a3f2 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:16.558530 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e41888b4-71ed-448c-8eca-b0bd4279a3f2 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/eca1ed67-f21d-46e3-8557-014bc6b63953" status: 200 len: 1493 microversion: 2.1 time: 0.383642 Sep 08 10:47:16.559918 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1120/2241] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:16 2022] GET /compute/v2.1/servers/eca1ed67-f21d-46e3-8557-014bc6b63953 => generated 1493 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:47:16.564469 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6e5f1d2d-a202-4388-9755-206ceb8d78e0 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:16.574327 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6e5f1d2d-a202-4388-9755-206ceb8d78e0 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/e052494d-6c34-4e3a-adac-4c7ed14f87c9" status: 200 len: 1307 microversion: 2.1 time: 0.277680 Sep 08 10:47:16.575730 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1122/2242] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:16 2022] GET /compute/v2.1/servers/e052494d-6c34-4e3a-adac-4c7ed14f87c9 => generated 1307 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:16.581899 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3dcdef5d-4446-4882-af9d-c18ae1c5b3bc tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:16.582710 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3dcdef5d-4446-4882-af9d-c18ae1c5b3bc tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: 3766b195-ace4-4563-a24e-dca72941251e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:16.583059 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3643eb8c-7af0-4352-91d8-a30858c94e7d tempest-QuotaClassesAdmin257Test-1165382423 tempest-QuotaClassesAdmin257Test-1165382423-project-admin] Action: 'update', calling method: .version_select at 0x7f68e49cbaf0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:47:16.591324 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3dcdef5d-4446-4882-af9d-c18ae1c5b3bc tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:16.591611 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3dcdef5d-4446-4882-af9d-c18ae1c5b3bc tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:16.592829 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3dcdef5d-4446-4882-af9d-c18ae1c5b3bc tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:16.593999 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3dcdef5d-4446-4882-af9d-c18ae1c5b3bc tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:16.594997 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3dcdef5d-4446-4882-af9d-c18ae1c5b3bc tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:16.594997 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3dcdef5d-4446-4882-af9d-c18ae1c5b3bc tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:16.775051 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3643eb8c-7af0-4352-91d8-a30858c94e7d tempest-QuotaClassesAdmin257Test-1165382423 tempest-QuotaClassesAdmin257Test-1165382423-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.213298 Sep 08 10:47:16.781820 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1121/2243] 10.222.0.27 () {62 vars in 1247 bytes} [Thu Sep 8 10:47:16 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:47:16.792782 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-b8c40842-ff45-4c17-86c5-6d17471fa7a6 req-4d67084d-fa83-45d3-9cda-2a5d79f96dc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e052494d-6c34-4e3a-adac-4c7ed14f87c9", "name": "network-vif-plugged", "status": "completed", "tag": "0c1068a7-4057-4dd1-a50f-10422d722659"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:47:16.813325 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-b8c40842-ff45-4c17-86c5-6d17471fa7a6 req-4d67084d-fa83-45d3-9cda-2a5d79f96dc2 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:16.814418 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-b8c40842-ff45-4c17-86c5-6d17471fa7a6 req-4d67084d-fa83-45d3-9cda-2a5d79f96dc2 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:16.816113 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-b8c40842-ff45-4c17-86c5-6d17471fa7a6 req-4d67084d-fa83-45d3-9cda-2a5d79f96dc2 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:16.835856 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-b8c40842-ff45-4c17-86c5-6d17471fa7a6 req-4d67084d-fa83-45d3-9cda-2a5d79f96dc2 service nova] Creating event network-vif-plugged:0c1068a7-4057-4dd1-a50f-10422d722659 for instance e052494d-6c34-4e3a-adac-4c7ed14f87c9 on n-h1-850501-12 Sep 08 10:47:16.838653 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3dcdef5d-4446-4882-af9d-c18ae1c5b3bc tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:16.845762 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-b8c40842-ff45-4c17-86c5-6d17471fa7a6 req-4d67084d-fa83-45d3-9cda-2a5d79f96dc2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061028 Sep 08 10:47:16.846933 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1122/2244] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:47:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:47:16.852359 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3dcdef5d-4446-4882-af9d-c18ae1c5b3bc tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e" status: 200 len: 1477 microversion: 2.1 time: 0.274624 Sep 08 10:47:16.853641 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1123/2245] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:16 2022] GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e => generated 1477 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:16.861655 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3da7a99c-b517-4d72-b4ea-ea95db074286 tempest-QuotaClassesAdmin257Test-1165382423 tempest-QuotaClassesAdmin257Test-1165382423-project-admin] Calling method '.version_select at 0x7f68e8a34280>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:16.888208 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3da7a99c-b517-4d72-b4ea-ea95db074286 tempest-QuotaClassesAdmin257Test-1165382423 tempest-QuotaClassesAdmin257Test-1165382423-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.033854 Sep 08 10:47:16.891171 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1123/2246] 10.222.0.27 () {60 vars in 1226 bytes} [Thu Sep 8 10:47:16 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:47:16.907075 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f55338a2-7199-425e-9104-0afbe1ef34af tempest-QuotaClassesAdmin257Test-1165382423 tempest-QuotaClassesAdmin257Test-1165382423-project-admin] Action: 'update', calling method: .version_select at 0x7f68e8913280>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:47:17.021939 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-64a4cdd3-39e2-4ca4-9914-c80bf43a500e tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:17.022702 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-64a4cdd3-39e2-4ca4-9914-c80bf43a500e tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] [instance: c937afd2-1699-4699-809d-20cfcead412c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:17.048251 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64a4cdd3-39e2-4ca4-9914-c80bf43a500e tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:17.048956 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64a4cdd3-39e2-4ca4-9914-c80bf43a500e tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:17.049587 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64a4cdd3-39e2-4ca4-9914-c80bf43a500e tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:17.053371 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64a4cdd3-39e2-4ca4-9914-c80bf43a500e tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:17.053900 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64a4cdd3-39e2-4ca4-9914-c80bf43a500e tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:17.054527 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64a4cdd3-39e2-4ca4-9914-c80bf43a500e tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:17.059184 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f55338a2-7199-425e-9104-0afbe1ef34af tempest-QuotaClassesAdmin257Test-1165382423 tempest-QuotaClassesAdmin257Test-1165382423-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.160466 Sep 08 10:47:17.068480 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1124/2247] 10.222.0.27 () {62 vars in 1247 bytes} [Thu Sep 8 10:47:16 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:47:17.423042 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-35df49d1-a7c7-45f8-8859-7e3d848fa77e req-5b71d3fa-fbf2-4eb8-a9f7-80bd8856f8dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c937afd2-1699-4699-809d-20cfcead412c", "tag": "adcc26d9-b793-4b1b-9cf8-5a561707352d"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:47:17.444598 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-35df49d1-a7c7-45f8-8859-7e3d848fa77e req-5b71d3fa-fbf2-4eb8-a9f7-80bd8856f8dd service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:17.444989 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-35df49d1-a7c7-45f8-8859-7e3d848fa77e req-5b71d3fa-fbf2-4eb8-a9f7-80bd8856f8dd service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:17.445458 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-35df49d1-a7c7-45f8-8859-7e3d848fa77e req-5b71d3fa-fbf2-4eb8-a9f7-80bd8856f8dd service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:17.468533 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-35df49d1-a7c7-45f8-8859-7e3d848fa77e req-5b71d3fa-fbf2-4eb8-a9f7-80bd8856f8dd service nova] Creating event network-changed:adcc26d9-b793-4b1b-9cf8-5a561707352d for instance c937afd2-1699-4699-809d-20cfcead412c on n-h2-850501-12 Sep 08 10:47:17.478033 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-35df49d1-a7c7-45f8-8859-7e3d848fa77e req-5b71d3fa-fbf2-4eb8-a9f7-80bd8856f8dd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061827 Sep 08 10:47:17.480451 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1125/2248] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:47:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:47:17.524081 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-64a4cdd3-39e2-4ca4-9914-c80bf43a500e tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416642c1ee664b4d9e0fb14d02266b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cfab473734f4b63aaa78508ef460a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:17.534210 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-64a4cdd3-39e2-4ca4-9914-c80bf43a500e tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] 10.222.0.27 "GET /compute/v2.1/servers/c937afd2-1699-4699-809d-20cfcead412c" status: 200 len: 1319 microversion: 2.1 time: 0.521000 Sep 08 10:47:17.535477 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1124/2249] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:17 2022] GET /compute/v2.1/servers/c937afd2-1699-4699-809d-20cfcead412c => generated 1319 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:17.603918 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-01e84d53-76cd-43b1-9074-66960069c7d4 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:17.605557 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-01e84d53-76cd-43b1-9074-66960069c7d4 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: e052494d-6c34-4e3a-adac-4c7ed14f87c9] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:17.614960 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-17031b9b-bc60-4f56-8505-308e2d9b28af tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:17.618956 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-17031b9b-bc60-4f56-8505-308e2d9b28af tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: eca1ed67-f21d-46e3-8557-014bc6b63953] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:17.629990 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-01e84d53-76cd-43b1-9074-66960069c7d4 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:17.642650 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-01e84d53-76cd-43b1-9074-66960069c7d4 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:17.643696 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-01e84d53-76cd-43b1-9074-66960069c7d4 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:17.645218 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-01e84d53-76cd-43b1-9074-66960069c7d4 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:17.646222 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-01e84d53-76cd-43b1-9074-66960069c7d4 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:17.648155 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-17031b9b-bc60-4f56-8505-308e2d9b28af tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:17.649001 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-17031b9b-bc60-4f56-8505-308e2d9b28af tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:17.649355 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-01e84d53-76cd-43b1-9074-66960069c7d4 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:17.649908 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-17031b9b-bc60-4f56-8505-308e2d9b28af tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:17.651016 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-17031b9b-bc60-4f56-8505-308e2d9b28af tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:17.651868 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-17031b9b-bc60-4f56-8505-308e2d9b28af tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:17.652463 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-17031b9b-bc60-4f56-8505-308e2d9b28af tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:18.010460 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-17031b9b-bc60-4f56-8505-308e2d9b28af tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:18.025211 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-17031b9b-bc60-4f56-8505-308e2d9b28af tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/eca1ed67-f21d-46e3-8557-014bc6b63953" status: 200 len: 1493 microversion: 2.1 time: 0.434206 Sep 08 10:47:18.038930 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1126/2250] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:17 2022] GET /compute/v2.1/servers/eca1ed67-f21d-46e3-8557-014bc6b63953 => generated 1493 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:18.064850 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-15f201e4-5a80-46f2-b531-e0d4542d69b6 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:18.065805 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-15f201e4-5a80-46f2-b531-e0d4542d69b6 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: 3766b195-ace4-4563-a24e-dca72941251e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:18.117289 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15f201e4-5a80-46f2-b531-e0d4542d69b6 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:18.118467 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15f201e4-5a80-46f2-b531-e0d4542d69b6 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:18.121070 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15f201e4-5a80-46f2-b531-e0d4542d69b6 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:18.125503 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15f201e4-5a80-46f2-b531-e0d4542d69b6 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:18.128629 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15f201e4-5a80-46f2-b531-e0d4542d69b6 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:18.131883 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15f201e4-5a80-46f2-b531-e0d4542d69b6 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:18.275540 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-01e84d53-76cd-43b1-9074-66960069c7d4 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:18.287878 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-01e84d53-76cd-43b1-9074-66960069c7d4 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/e052494d-6c34-4e3a-adac-4c7ed14f87c9" status: 200 len: 1307 microversion: 2.1 time: 0.691345 Sep 08 10:47:18.289074 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1125/2251] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:17 2022] GET /compute/v2.1/servers/e052494d-6c34-4e3a-adac-4c7ed14f87c9 => generated 1307 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:18.529316 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-15f201e4-5a80-46f2-b531-e0d4542d69b6 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:18.542763 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-15f201e4-5a80-46f2-b531-e0d4542d69b6 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e" status: 200 len: 1477 microversion: 2.1 time: 0.502530 Sep 08 10:47:18.544103 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1127/2252] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:18 2022] GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e => generated 1477 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:18.569600 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-416e4d45-d7d7-461c-af4a-f5d1a78d87f7 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:18.570878 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-416e4d45-d7d7-461c-af4a-f5d1a78d87f7 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] [instance: c937afd2-1699-4699-809d-20cfcead412c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:18.581854 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-416e4d45-d7d7-461c-af4a-f5d1a78d87f7 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:18.583008 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-416e4d45-d7d7-461c-af4a-f5d1a78d87f7 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:18.583603 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-416e4d45-d7d7-461c-af4a-f5d1a78d87f7 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:18.584585 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-416e4d45-d7d7-461c-af4a-f5d1a78d87f7 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:18.585257 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-416e4d45-d7d7-461c-af4a-f5d1a78d87f7 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:18.586104 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-416e4d45-d7d7-461c-af4a-f5d1a78d87f7 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:18.589678 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=100 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:47:18.876180 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-32a13c45-952c-461b-9118-4dc8a1792781 req-e1089cef-cb1e-4359-8399-4eaa63314baa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3766b195-ace4-4563-a24e-dca72941251e", "name": "network-vif-plugged", "status": "completed", "tag": "67c1a6b2-cd91-4a27-a9a4-731db0f530a7"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:47:18.892604 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-32a13c45-952c-461b-9118-4dc8a1792781 req-e1089cef-cb1e-4359-8399-4eaa63314baa service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:18.893716 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-32a13c45-952c-461b-9118-4dc8a1792781 req-e1089cef-cb1e-4359-8399-4eaa63314baa service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:18.894778 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-32a13c45-952c-461b-9118-4dc8a1792781 req-e1089cef-cb1e-4359-8399-4eaa63314baa service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:18.920289 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-416e4d45-d7d7-461c-af4a-f5d1a78d87f7 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416642c1ee664b4d9e0fb14d02266b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cfab473734f4b63aaa78508ef460a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:18.944748 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-416e4d45-d7d7-461c-af4a-f5d1a78d87f7 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] 10.222.0.27 "GET /compute/v2.1/servers/c937afd2-1699-4699-809d-20cfcead412c" status: 200 len: 1319 microversion: 2.1 time: 0.385369 Sep 08 10:47:18.945465 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1126/2253] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:18 2022] GET /compute/v2.1/servers/c937afd2-1699-4699-809d-20cfcead412c => generated 1319 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:18.946829 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-32a13c45-952c-461b-9118-4dc8a1792781 req-e1089cef-cb1e-4359-8399-4eaa63314baa service nova] Creating event network-vif-plugged:67c1a6b2-cd91-4a27-a9a4-731db0f530a7 for instance 3766b195-ace4-4563-a24e-dca72941251e on n-h2-850501-12 Sep 08 10:47:18.952999 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-32a13c45-952c-461b-9118-4dc8a1792781 req-e1089cef-cb1e-4359-8399-4eaa63314baa service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087832 Sep 08 10:47:18.953638 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1128/2254] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:47:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:47:19.055773 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bd6b7fe2-34d4-4395-8dcf-4117fdc02acb tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:19.057371 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bd6b7fe2-34d4-4395-8dcf-4117fdc02acb tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: eca1ed67-f21d-46e3-8557-014bc6b63953] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:19.076353 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bd6b7fe2-34d4-4395-8dcf-4117fdc02acb tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:19.077627 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bd6b7fe2-34d4-4395-8dcf-4117fdc02acb tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:19.078576 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bd6b7fe2-34d4-4395-8dcf-4117fdc02acb tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:19.079965 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bd6b7fe2-34d4-4395-8dcf-4117fdc02acb tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:19.080849 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bd6b7fe2-34d4-4395-8dcf-4117fdc02acb tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:19.081600 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bd6b7fe2-34d4-4395-8dcf-4117fdc02acb tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:19.136565 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bd6b7fe2-34d4-4395-8dcf-4117fdc02acb tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:19.137435 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bd6b7fe2-34d4-4395-8dcf-4117fdc02acb tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:19.138179 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bd6b7fe2-34d4-4395-8dcf-4117fdc02acb tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:19.139061 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-bd6b7fe2-34d4-4395-8dcf-4117fdc02acb tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lazy-loading 'fault' on Instance uuid eca1ed67-f21d-46e3-8557-014bc6b63953 {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:47:19.200349 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-bd6b7fe2-34d4-4395-8dcf-4117fdc02acb tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:19.209809 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bd6b7fe2-34d4-4395-8dcf-4117fdc02acb tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/eca1ed67-f21d-46e3-8557-014bc6b63953" status: 200 len: 1303 microversion: 2.1 time: 0.160609 Sep 08 10:47:19.210742 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1127/2255] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:19 2022] GET /compute/v2.1/servers/eca1ed67-f21d-46e3-8557-014bc6b63953 => generated 1303 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:19.315837 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-224dd564-20fa-4934-94d5-2f14c968f50c tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:19.316363 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-224dd564-20fa-4934-94d5-2f14c968f50c tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: e052494d-6c34-4e3a-adac-4c7ed14f87c9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:19.346827 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-224dd564-20fa-4934-94d5-2f14c968f50c tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:19.347800 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-224dd564-20fa-4934-94d5-2f14c968f50c tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:19.348643 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-224dd564-20fa-4934-94d5-2f14c968f50c tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:19.349890 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-224dd564-20fa-4934-94d5-2f14c968f50c tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:19.350720 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-224dd564-20fa-4934-94d5-2f14c968f50c tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:19.351477 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-224dd564-20fa-4934-94d5-2f14c968f50c tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:19.526293 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-6639a2c7-465e-42f9-95cc-71d54728b000 req-d008549b-e9e1-4957-aa3f-9322c7016f44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eca1ed67-f21d-46e3-8557-014bc6b63953", "name": "network-vif-deleted", "tag": "63cb3c01-9673-46f6-8e43-73cf71b3f687"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:47:19.562907 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-6639a2c7-465e-42f9-95cc-71d54728b000 req-d008549b-e9e1-4957-aa3f-9322c7016f44 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:19.569424 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-6639a2c7-465e-42f9-95cc-71d54728b000 req-d008549b-e9e1-4957-aa3f-9322c7016f44 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:19.585298 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-6639a2c7-465e-42f9-95cc-71d54728b000 req-d008549b-e9e1-4957-aa3f-9322c7016f44 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:19.607167 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-6639a2c7-465e-42f9-95cc-71d54728b000 req-d008549b-e9e1-4957-aa3f-9322c7016f44 service nova] Creating event network-vif-deleted:63cb3c01-9673-46f6-8e43-73cf71b3f687 for instance eca1ed67-f21d-46e3-8557-014bc6b63953 on n-h1-850501-12 Sep 08 10:47:19.616673 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-6639a2c7-465e-42f9-95cc-71d54728b000 req-d008549b-e9e1-4957-aa3f-9322c7016f44 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099876 Sep 08 10:47:19.617817 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1128/2256] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:47:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:47:19.628739 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-718b17b3-4250-4f13-9b9c-794f144cf7b3 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:19.630278 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-718b17b3-4250-4f13-9b9c-794f144cf7b3 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: 3766b195-ace4-4563-a24e-dca72941251e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:19.642868 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-718b17b3-4250-4f13-9b9c-794f144cf7b3 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:19.644035 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-718b17b3-4250-4f13-9b9c-794f144cf7b3 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:19.645113 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-718b17b3-4250-4f13-9b9c-794f144cf7b3 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:19.646556 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-718b17b3-4250-4f13-9b9c-794f144cf7b3 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:19.647633 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-718b17b3-4250-4f13-9b9c-794f144cf7b3 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:19.648567 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-718b17b3-4250-4f13-9b9c-794f144cf7b3 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:19.749611 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-224dd564-20fa-4934-94d5-2f14c968f50c tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:19.767802 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-224dd564-20fa-4934-94d5-2f14c968f50c tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/e052494d-6c34-4e3a-adac-4c7ed14f87c9" status: 200 len: 1487 microversion: 2.1 time: 0.458383 Sep 08 10:47:19.769065 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1129/2257] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:19 2022] GET /compute/v2.1/servers/e052494d-6c34-4e3a-adac-4c7ed14f87c9 => generated 1487 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:47:19.808498 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-41b141e1-fc61-49e1-b8c9-aced0e421621 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1861064008"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:47:19.814307 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-41b141e1-fc61-49e1-b8c9-aced0e421621 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: e052494d-6c34-4e3a-adac-4c7ed14f87c9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:19.829337 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-41b141e1-fc61-49e1-b8c9-aced0e421621 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:19.839278 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-41b141e1-fc61-49e1-b8c9-aced0e421621 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:19.840251 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-41b141e1-fc61-49e1-b8c9-aced0e421621 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:19.842543 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-41b141e1-fc61-49e1-b8c9-aced0e421621 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:19.843413 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-41b141e1-fc61-49e1-b8c9-aced0e421621 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:19.844208 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-41b141e1-fc61-49e1-b8c9-aced0e421621 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:20.175744 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-718b17b3-4250-4f13-9b9c-794f144cf7b3 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:20.195479 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-718b17b3-4250-4f13-9b9c-794f144cf7b3 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e" status: 200 len: 1477 microversion: 2.1 time: 0.575119 Sep 08 10:47:20.200405 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1129/2258] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:19 2022] GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e => generated 1477 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:20.234267 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a7664a43-fd24-4f35-a4f0-b84a5c627f6d tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:20.235087 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a7664a43-fd24-4f35-a4f0-b84a5c627f6d tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] [instance: c937afd2-1699-4699-809d-20cfcead412c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:20.242383 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a7664a43-fd24-4f35-a4f0-b84a5c627f6d tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:20.243153 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a7664a43-fd24-4f35-a4f0-b84a5c627f6d tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:20.243756 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a7664a43-fd24-4f35-a4f0-b84a5c627f6d tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:20.244742 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a7664a43-fd24-4f35-a4f0-b84a5c627f6d tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:20.245494 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a7664a43-fd24-4f35-a4f0-b84a5c627f6d tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:20.246094 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a7664a43-fd24-4f35-a4f0-b84a5c627f6d tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:20.433975 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-41b141e1-fc61-49e1-b8c9-aced0e421621 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "POST /compute/v2.1/servers/e052494d-6c34-4e3a-adac-4c7ed14f87c9/action" status: 202 len: 0 microversion: 2.1 time: 0.622766 Sep 08 10:47:20.445317 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1130/2259] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:47:19 2022] POST /compute/v2.1/servers/e052494d-6c34-4e3a-adac-4c7ed14f87c9/action => generated 0 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Sep 08 10:47:20.461676 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8ae7ab4f-fc75-4aeb-b034-1769c76e60dd tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:20.463363 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8ae7ab4f-fc75-4aeb-b034-1769c76e60dd tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: eca1ed67-f21d-46e3-8557-014bc6b63953] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:20.475265 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ae7ab4f-fc75-4aeb-b034-1769c76e60dd tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:20.476716 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ae7ab4f-fc75-4aeb-b034-1769c76e60dd tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:20.477839 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ae7ab4f-fc75-4aeb-b034-1769c76e60dd tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:20.479497 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ae7ab4f-fc75-4aeb-b034-1769c76e60dd tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:20.480586 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ae7ab4f-fc75-4aeb-b034-1769c76e60dd tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:20.481607 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ae7ab4f-fc75-4aeb-b034-1769c76e60dd tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:20.568080 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-8ae7ab4f-fc75-4aeb-b034-1769c76e60dd tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] HTTP exception thrown: Instance eca1ed67-f21d-46e3-8557-014bc6b63953 could not be found. Sep 08 10:47:20.572715 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8ae7ab4f-fc75-4aeb-b034-1769c76e60dd tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Request method failure captured: Sep 08 10:47:20.572715 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/eca1ed67-f21d-46e3-8557-014bc6b63953 HTTP/1.1 Sep 08 10:47:20.572715 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:47:20.572715 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:47:20.572715 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:47:20.572715 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:47:20.572715 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:47:20.572715 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:47:20.572715 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:47:20.572715 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:47:20.572715 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcbOYaOup_Ia1bHuprOxxP_LkfdCzYSX9xstQr2GVmRBueUQ0e967rlioz5jpJV566ZCuz_bYy_us0o8_CIFlOGOVfrC9_e_1_vEhZ3YdgjG89HBhaIJ_lG7Uv4nQrC-nfHrMx_LNyd0rOd4Blcm801SOcX7oe5VDxGTE8KVTDSeMPw Sep 08 10:47:20.572715 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:47:20.572715 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:47:20.572715 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:47:20.572715 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:47:20.572715 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:47:20.572715 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:47:20.572715 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 998378cc815344ba8a107d1cd61f40fd Sep 08 10:47:20.572715 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-DeleteServersTestJSON-69164830 Sep 08 10:47:20.572715 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:47:20.572715 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:47:20.572715 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:47:20.572715 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-DeleteServersTestJSON-69164830 Sep 08 10:47:20.572715 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 998378cc815344ba8a107d1cd61f40fd Sep 08 10:47:20.572715 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-DeleteServersTestJSON-69164830 Sep 08 10:47:20.572715 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-DeleteServersTestJSON-69164830-project Sep 08 10:47:20.572715 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:47:20.572715 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:47:20.572715 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: d08269c53bcb41c88953e7c79f5ad185 Sep 08 10:47:20.572715 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-DeleteServersTestJSON-69164830-project Sep 08 10:47:20.572715 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:47:20.572715 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance eca1ed67-f21d-46e3-8557-014bc6b63953 could not be found. Sep 08 10:47:20.572715 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'eca1ed67-f21d-46e3-8557-014bc6b63953'} Sep 08 10:47:20.572715 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:47:20.572715 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:20.572715 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:47:20.572715 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:47:20.572715 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:47:20.572715 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:47:20.572715 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:47:20.572715 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:47:20.572715 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:47:20.572715 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:47:20.572715 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eca1ed67-f21d-46e3-8557-014bc6b63953 could not be found. Sep 08 10:47:20.572715 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:20.572715 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:20.572715 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:20.572715 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:20.572715 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:47:20.572715 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:47:20.572715 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:47:20.572715 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:47:20.572715 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:47:20.572715 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:47:20.572715 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:47:20.572715 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:47:20.572715 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:47:20.572715 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:47:20.572715 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:47:20.572715 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:47:20.572715 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eca1ed67-f21d-46e3-8557-014bc6b63953 could not be found. Sep 08 10:47:20.572715 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:20.572715 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:20.572715 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:20.581226 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:20.581226 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:47:20.581226 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:47:20.581226 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:47:20.581226 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:47:20.581226 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eca1ed67-f21d-46e3-8557-014bc6b63953 could not be found. Sep 08 10:47:20.581226 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:20.581226 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8ae7ab4f-fc75-4aeb-b034-1769c76e60dd tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Returning 404 to user: Instance eca1ed67-f21d-46e3-8557-014bc6b63953 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:47:20.585800 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8ae7ab4f-fc75-4aeb-b034-1769c76e60dd tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/eca1ed67-f21d-46e3-8557-014bc6b63953" status: 404 len: 111 microversion: 2.1 time: 0.133444 Sep 08 10:47:20.587934 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1131/2260] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:20 2022] GET /compute/v2.1/servers/eca1ed67-f21d-46e3-8557-014bc6b63953 => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:47:20.616905 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a7664a43-fd24-4f35-a4f0-b84a5c627f6d tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416642c1ee664b4d9e0fb14d02266b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cfab473734f4b63aaa78508ef460a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:20.638060 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a7664a43-fd24-4f35-a4f0-b84a5c627f6d tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] 10.222.0.27 "GET /compute/v2.1/servers/c937afd2-1699-4699-809d-20cfcead412c" status: 200 len: 1319 microversion: 2.1 time: 0.422036 Sep 08 10:47:20.638819 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1130/2261] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:20 2022] GET /compute/v2.1/servers/c937afd2-1699-4699-809d-20cfcead412c => generated 1319 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:20.653153 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-21753526-e89f-447e-938e-2f2038f0c7b8 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '.version_select at 0x7f68e42f2af0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:20.798573 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-21753526-e89f-447e-938e-2f2038f0c7b8 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/images/c1c6dc49-82fd-4aca-8c14-26e168d845e4" status: 200 len: 1414 microversion: 2.1 time: 0.190141 Sep 08 10:47:20.821942 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1132/2262] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:47:20 2022] GET /compute/v2.1/images/c1c6dc49-82fd-4aca-8c14-26e168d845e4 => generated 1414 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:20.834250 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1885f8a6-4e02-4814-8073-c728c9604351 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '.version_select at 0x7f68e4a77dc0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:20.883155 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2f545683-356f-413a-8ca0-74330d5de5a9 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1468793876", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "cf032a39-d4e2-476c-8052-c76f4ee567c9"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:47:21.004572 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1885f8a6-4e02-4814-8073-c728c9604351 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/images/c1c6dc49-82fd-4aca-8c14-26e168d845e4" status: 200 len: 1414 microversion: 2.1 time: 0.177078 Sep 08 10:47:21.006073 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1131/2263] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:47:20 2022] GET /compute/v2.1/images/c1c6dc49-82fd-4aca-8c14-26e168d845e4 => generated 1414 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:21.011808 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3,nova_api:UPDATE=8 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:47:21.022806 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-daf154d0-580f-459d-b494-b427718f967a tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '.version_select at 0x7f68e4923790>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:21.071212 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-2f545683-356f-413a-8ca0-74330d5de5a9 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] validate_networks() for [('cf032a39-d4e2-476c-8052-c76f4ee567c9', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:47:21.439546 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-daf154d0-580f-459d-b494-b427718f967a tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "DELETE /compute/v2.1/images/c1c6dc49-82fd-4aca-8c14-26e168d845e4" status: 204 len: 0 microversion: 2.1 time: 0.421906 Sep 08 10:47:21.441918 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1132/2264] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:21 2022] DELETE /compute/v2.1/images/c1c6dc49-82fd-4aca-8c14-26e168d845e4 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:47:21.470832 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d6d19be8-723a-410d-93b8-e43c819789d1 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:21.473084 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d6d19be8-723a-410d-93b8-e43c819789d1 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: 3766b195-ace4-4563-a24e-dca72941251e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:21.536922 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d6d19be8-723a-410d-93b8-e43c819789d1 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:21.542325 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d6d19be8-723a-410d-93b8-e43c819789d1 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:21.543350 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d6d19be8-723a-410d-93b8-e43c819789d1 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:21.547732 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d6d19be8-723a-410d-93b8-e43c819789d1 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:21.551436 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d6d19be8-723a-410d-93b8-e43c819789d1 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:21.557760 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d6d19be8-723a-410d-93b8-e43c819789d1 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:21.619344 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=4 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:47:22.017657 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d6d19be8-723a-410d-93b8-e43c819789d1 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:22.082768 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d6d19be8-723a-410d-93b8-e43c819789d1 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e" status: 200 len: 1463 microversion: 2.1 time: 0.631460 Sep 08 10:47:22.097060 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1133/2265] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:21 2022] GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e => generated 1463 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:22.100598 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-30c3399d-6185-48fe-93aa-4f4d885945ce tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '.version_select at 0x7f68e8a345e0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:22.150878 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-30c3399d-6185-48fe-93aa-4f4d885945ce tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] HTTP exception thrown: Image not found. Sep 08 10:47:22.205298 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-30c3399d-6185-48fe-93aa-4f4d885945ce tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Request method failure captured: Sep 08 10:47:22.205298 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/images/c1c6dc49-82fd-4aca-8c14-26e168d845e4 HTTP/1.1 Sep 08 10:47:22.205298 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:47:22.205298 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:47:22.205298 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:47:22.205298 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:47:22.205298 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:47:22.205298 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:47:22.205298 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:47:22.205298 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:47:22.205298 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcc0sSj3x0sBidV4prTXv00UAP3lriFd9bSf6ARsE1ekKVmlGukpstC35qUsWPJmY1lsjsjExO-iqH_QnZHhexPCbL7rQ87usxEHhLxbNbIFKv-QG5rcjHdmQtO5f0_wSj_rlzeH-S-tFvmDK4BhyOKoPTI_CkViDwssV_47VejAgTw Sep 08 10:47:22.205298 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:47:22.205298 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:47:22.205298 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:47:22.205298 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:47:22.205298 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:47:22.205298 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:47:22.205298 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: eeeb450420314221bd2469816e2995d1 Sep 08 10:47:22.205298 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ImagesTestJSON-2041705293 Sep 08 10:47:22.205298 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:47:22.205298 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:47:22.205298 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/eeeb450420314221bd2469816e2995d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eeeb450420314221bd2469816e2995d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_eeeb450420314221bd2469816e2995d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eeeb450420314221bd2469816e2995d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:47:22.205298 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ImagesTestJSON-2041705293 Sep 08 10:47:22.205298 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: eeeb450420314221bd2469816e2995d1 Sep 08 10:47:22.205298 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ImagesTestJSON-2041705293 Sep 08 10:47:22.205298 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ImagesTestJSON-2041705293-project Sep 08 10:47:22.205298 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:47:22.205298 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:47:22.205298 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: ce8c8c85354d46aeb786c8049b81e04d Sep 08 10:47:22.205298 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ImagesTestJSON-2041705293-project Sep 08 10:47:22.205298 n-d-850501-12 devstack@n-api.service[128861]: method: Sep 08 10:47:22.205298 n-d-850501-12 devstack@n-api.service[128861]: exception: Image not found. Sep 08 10:47:22.205298 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': 'c1c6dc49-82fd-4aca-8c14-26e168d845e4'} Sep 08 10:47:22.205298 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:47:22.205298 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:22.205298 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 08 10:47:22.205298 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 08 10:47:22.205298 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 10:47:22.205298 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 10:47:22.205298 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 08 10:47:22.205298 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 08 10:47:22.205298 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 10:47:22.205298 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 10:47:22.205298 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 08 10:47:22.205298 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 08 10:47:22.205298 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 08 10:47:22.205298 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 08 10:47:22.205298 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 10:47:22.205298 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 10:47:22.205298 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 10:47:22.205298 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 10:47:22.205298 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID c1c6dc49-82fd-4aca-8c14-26e168d845e4 Sep 08 10:47:22.205298 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:22.205298 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:22.205298 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:22.205298 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:22.205298 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 08 10:47:22.205298 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 08 10:47:22.205298 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 08 10:47:22.205298 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 08 10:47:22.205298 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 08 10:47:22.205298 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 08 10:47:22.205298 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 08 10:47:22.205298 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 08 10:47:22.214695 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 08 10:47:22.214695 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 08 10:47:22.214695 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 10:47:22.214695 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 10:47:22.214695 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 08 10:47:22.214695 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 08 10:47:22.214695 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 10:47:22.214695 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 10:47:22.214695 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 08 10:47:22.214695 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 08 10:47:22.214695 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 08 10:47:22.214695 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 08 10:47:22.214695 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 10:47:22.214695 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 10:47:22.214695 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 10:47:22.214695 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 10:47:22.214695 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c1c6dc49-82fd-4aca-8c14-26e168d845e4 could not be found. Sep 08 10:47:22.214695 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:22.214695 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:22.214695 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:22.214695 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:22.214695 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:47:22.214695 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:47:22.214695 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:47:22.214695 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:47:22.214695 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:47:22.214695 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:47:22.214695 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:47:22.214695 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:47:22.214695 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 08 10:47:22.214695 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 08 10:47:22.214695 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 08 10:47:22.214695 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:22.214695 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:22.214695 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:22.214695 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:22.214695 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:47:22.214695 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:47:22.214695 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:47:22.214695 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:47:22.214695 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 08 10:47:22.214695 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:22.214695 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-30c3399d-6185-48fe-93aa-4f4d885945ce tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Returning 404 to user: Image not found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:47:22.214695 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-30c3399d-6185-48fe-93aa-4f4d885945ce tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/images/c1c6dc49-82fd-4aca-8c14-26e168d845e4" status: 404 len: 62 microversion: 2.1 time: 0.117435 Sep 08 10:47:22.214695 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1134/2266] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:47:22 2022] GET /compute/v2.1/images/c1c6dc49-82fd-4aca-8c14-26e168d845e4 => generated 62 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:47:22.225945 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d8d9c7e6-a9a6-407e-8776-f0593870abb4 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:22.225945 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d8d9c7e6-a9a6-407e-8776-f0593870abb4 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] [instance: c937afd2-1699-4699-809d-20cfcead412c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:22.225945 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=8,nova_api:INSERT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:47:22.245728 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d8d9c7e6-a9a6-407e-8776-f0593870abb4 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:22.247400 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d8d9c7e6-a9a6-407e-8776-f0593870abb4 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:22.247400 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d8d9c7e6-a9a6-407e-8776-f0593870abb4 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:22.248822 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d8d9c7e6-a9a6-407e-8776-f0593870abb4 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:22.249839 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d8d9c7e6-a9a6-407e-8776-f0593870abb4 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:22.250320 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d8d9c7e6-a9a6-407e-8776-f0593870abb4 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:22.335694 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-2f545683-356f-413a-8ca0-74330d5de5a9 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:47:22.336783 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-2f545683-356f-413a-8ca0-74330d5de5a9 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:47:22.338910 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-2f545683-356f-413a-8ca0-74330d5de5a9 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:47:22.340125 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-2f545683-356f-413a-8ca0-74330d5de5a9 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:47:22.341139 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-2f545683-356f-413a-8ca0-74330d5de5a9 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:47:22.360576 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2f545683-356f-413a-8ca0-74330d5de5a9 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:22.361887 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2f545683-356f-413a-8ca0-74330d5de5a9 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:22.366402 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2f545683-356f-413a-8ca0-74330d5de5a9 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:22.367904 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2f545683-356f-413a-8ca0-74330d5de5a9 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:22.369317 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2f545683-356f-413a-8ca0-74330d5de5a9 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:22.370056 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2f545683-356f-413a-8ca0-74330d5de5a9 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:22.409469 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-2f545683-356f-413a-8ca0-74330d5de5a9 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Getting quotas for project 998378cc815344ba8a107d1cd61f40fd. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:47:22.423691 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-2f545683-356f-413a-8ca0-74330d5de5a9 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Getting quotas for user d08269c53bcb41c88953e7c79f5ad185 and project 998378cc815344ba8a107d1cd61f40fd. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:47:22.485420 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2f545683-356f-413a-8ca0-74330d5de5a9 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:47:22.496530 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2f545683-356f-413a-8ca0-74330d5de5a9 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 23007ef9-a0d3-42ff-b687-0f53086c8bcb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:47:22.587852 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d8d9c7e6-a9a6-407e-8776-f0593870abb4 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416642c1ee664b4d9e0fb14d02266b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cfab473734f4b63aaa78508ef460a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:22.614832 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d8d9c7e6-a9a6-407e-8776-f0593870abb4 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] 10.222.0.27 "GET /compute/v2.1/servers/c937afd2-1699-4699-809d-20cfcead412c" status: 200 len: 1319 microversion: 2.1 time: 0.405706 Sep 08 10:47:22.617278 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1135/2267] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:22 2022] GET /compute/v2.1/servers/c937afd2-1699-4699-809d-20cfcead412c => generated 1319 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:22.633679 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0b3f04bc-9024-4232-b044-504d2d954e1f tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:22.647306 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0b3f04bc-9024-4232-b044-504d2d954e1f tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: 3766b195-ace4-4563-a24e-dca72941251e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:22.651391 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2f545683-356f-413a-8ca0-74330d5de5a9 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.783566 Sep 08 10:47:22.657181 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1133/2268] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:47:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1786 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:47:22.669569 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f2984fe9-5de5-4ebf-9be1-3e40a01fa004 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:22.671460 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f2984fe9-5de5-4ebf-9be1-3e40a01fa004 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: e052494d-6c34-4e3a-adac-4c7ed14f87c9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:22.685329 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f2984fe9-5de5-4ebf-9be1-3e40a01fa004 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:22.702087 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0b3f04bc-9024-4232-b044-504d2d954e1f tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:22.703121 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0b3f04bc-9024-4232-b044-504d2d954e1f tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:22.703612 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0b3f04bc-9024-4232-b044-504d2d954e1f tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:22.704461 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0b3f04bc-9024-4232-b044-504d2d954e1f tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:22.704570 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f2984fe9-5de5-4ebf-9be1-3e40a01fa004 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:22.704928 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0b3f04bc-9024-4232-b044-504d2d954e1f tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:22.707868 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f2984fe9-5de5-4ebf-9be1-3e40a01fa004 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:22.713416 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f2984fe9-5de5-4ebf-9be1-3e40a01fa004 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:22.714294 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0b3f04bc-9024-4232-b044-504d2d954e1f tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:22.720167 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f2984fe9-5de5-4ebf-9be1-3e40a01fa004 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:22.721052 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f2984fe9-5de5-4ebf-9be1-3e40a01fa004 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:23.141424 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0b3f04bc-9024-4232-b044-504d2d954e1f tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:23.143935 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f2984fe9-5de5-4ebf-9be1-3e40a01fa004 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:23.157209 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0b3f04bc-9024-4232-b044-504d2d954e1f tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e" status: 200 len: 1463 microversion: 2.1 time: 0.538067 Sep 08 10:47:23.162074 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f2984fe9-5de5-4ebf-9be1-3e40a01fa004 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/e052494d-6c34-4e3a-adac-4c7ed14f87c9" status: 200 len: 1505 microversion: 2.1 time: 0.507697 Sep 08 10:47:23.163428 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1134/2269] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:22 2022] GET /compute/v2.1/servers/e052494d-6c34-4e3a-adac-4c7ed14f87c9 => generated 1505 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:23.163600 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1136/2270] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:22 2022] GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e => generated 1463 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:23.169606 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ad41e62e-3cd9-42fd-9056-ff8fe7b23837 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:23.171436 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ad41e62e-3cd9-42fd-9056-ff8fe7b23837 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 23007ef9-a0d3-42ff-b687-0f53086c8bcb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:23.187487 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b6cbe3d0-d07f-417a-9016-559573d80cb6 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:47:23.198892 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b6cbe3d0-d07f-417a-9016-559573d80cb6 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: 3766b195-ace4-4563-a24e-dca72941251e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:23.223851 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b6cbe3d0-d07f-417a-9016-559573d80cb6 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:23.230598 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b6cbe3d0-d07f-417a-9016-559573d80cb6 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:23.233147 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b6cbe3d0-d07f-417a-9016-559573d80cb6 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:23.235653 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b6cbe3d0-d07f-417a-9016-559573d80cb6 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:23.237938 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b6cbe3d0-d07f-417a-9016-559573d80cb6 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:23.238734 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b6cbe3d0-d07f-417a-9016-559573d80cb6 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:23.265998 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ad41e62e-3cd9-42fd-9056-ff8fe7b23837 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:23.285288 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ad41e62e-3cd9-42fd-9056-ff8fe7b23837 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/23007ef9-a0d3-42ff-b687-0f53086c8bcb" status: 200 len: 1215 microversion: 2.1 time: 0.119862 Sep 08 10:47:23.287203 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1135/2271] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:23 2022] GET /compute/v2.1/servers/23007ef9-a0d3-42ff-b687-0f53086c8bcb => generated 1215 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:23.421687 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-b6cbe3d0-d07f-417a-9016-559573d80cb6 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:47:23.422891 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-b6cbe3d0-d07f-417a-9016-559573d80cb6 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:47:23.423920 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-b6cbe3d0-d07f-417a-9016-559573d80cb6 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:47:23.425125 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-b6cbe3d0-d07f-417a-9016-559573d80cb6 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:47:23.425898 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-b6cbe3d0-d07f-417a-9016-559573d80cb6 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:47:23.573727 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b6cbe3d0-d07f-417a-9016-559573d80cb6 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: 3766b195-ace4-4563-a24e-dca72941251e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:23.585808 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b6cbe3d0-d07f-417a-9016-559573d80cb6 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:23.586515 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b6cbe3d0-d07f-417a-9016-559573d80cb6 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:23.587144 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b6cbe3d0-d07f-417a-9016-559573d80cb6 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:23.588132 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b6cbe3d0-d07f-417a-9016-559573d80cb6 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:23.589282 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b6cbe3d0-d07f-417a-9016-559573d80cb6 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:23.590067 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b6cbe3d0-d07f-417a-9016-559573d80cb6 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:23.643654 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-76bc6183-7d98-42ec-aa59-3fed6b3bcf3f tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:23.644280 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-76bc6183-7d98-42ec-aa59-3fed6b3bcf3f tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] [instance: c937afd2-1699-4699-809d-20cfcead412c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:23.668393 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b6cbe3d0-d07f-417a-9016-559573d80cb6 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "POST /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e/action" status: 202 len: 1067 microversion: 2.1 time: 0.487229 Sep 08 10:47:23.681109 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1137/2272] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:47:23 2022] POST /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e/action => generated 1067 bytes in 497 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Sep 08 10:47:23.682735 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76bc6183-7d98-42ec-aa59-3fed6b3bcf3f tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:23.684006 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76bc6183-7d98-42ec-aa59-3fed6b3bcf3f tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:23.684701 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76bc6183-7d98-42ec-aa59-3fed6b3bcf3f tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:23.686225 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76bc6183-7d98-42ec-aa59-3fed6b3bcf3f tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:23.687960 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76bc6183-7d98-42ec-aa59-3fed6b3bcf3f tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:23.688793 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76bc6183-7d98-42ec-aa59-3fed6b3bcf3f tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:23.701741 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d3054c5a-810d-4f18-8ba0-77da639e8bcd tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8ee9149a-f2d2-4d35-a01a-d5e55edacb51"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:47:23.713973 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d3054c5a-810d-4f18-8ba0-77da639e8bcd tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] [instance: 72eb7387-3f16-4b4f-ab9a-89076f169fc1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:23.752858 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d3054c5a-810d-4f18-8ba0-77da639e8bcd tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:23.755885 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d3054c5a-810d-4f18-8ba0-77da639e8bcd tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:23.759557 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d3054c5a-810d-4f18-8ba0-77da639e8bcd tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:23.763276 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d3054c5a-810d-4f18-8ba0-77da639e8bcd tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:23.767642 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d3054c5a-810d-4f18-8ba0-77da639e8bcd tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:23.770805 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d3054c5a-810d-4f18-8ba0-77da639e8bcd tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:24.013393 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-76bc6183-7d98-42ec-aa59-3fed6b3bcf3f tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416642c1ee664b4d9e0fb14d02266b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cfab473734f4b63aaa78508ef460a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:24.045653 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-76bc6183-7d98-42ec-aa59-3fed6b3bcf3f tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] 10.222.0.27 "GET /compute/v2.1/servers/c937afd2-1699-4699-809d-20cfcead412c" status: 200 len: 1319 microversion: 2.1 time: 0.401620 Sep 08 10:47:24.051192 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1136/2273] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:23 2022] GET /compute/v2.1/servers/c937afd2-1699-4699-809d-20cfcead412c => generated 1319 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:47:24.073691 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-901136e0-e170-424f-9a23-a4e0e1004350 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:24.074084 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-901136e0-e170-424f-9a23-a4e0e1004350 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: 3766b195-ace4-4563-a24e-dca72941251e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:24.096560 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-901136e0-e170-424f-9a23-a4e0e1004350 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:24.097848 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-901136e0-e170-424f-9a23-a4e0e1004350 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:24.098304 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-901136e0-e170-424f-9a23-a4e0e1004350 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:24.099042 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-901136e0-e170-424f-9a23-a4e0e1004350 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:24.102591 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-901136e0-e170-424f-9a23-a4e0e1004350 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:24.104590 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-901136e0-e170-424f-9a23-a4e0e1004350 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:24.395472 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-901136e0-e170-424f-9a23-a4e0e1004350 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:24.403937 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-901136e0-e170-424f-9a23-a4e0e1004350 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e" status: 200 len: 1472 microversion: 2.1 time: 0.351483 Sep 08 10:47:24.424315 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1137/2274] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:24 2022] GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e => generated 1472 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:24.439372 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-69ff936d-342f-4275-a14f-ee8a0a426409 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:24.440316 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-69ff936d-342f-4275-a14f-ee8a0a426409 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: e052494d-6c34-4e3a-adac-4c7ed14f87c9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:24.456539 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-69ff936d-342f-4275-a14f-ee8a0a426409 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:24.458803 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-69ff936d-342f-4275-a14f-ee8a0a426409 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:24.459481 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-69ff936d-342f-4275-a14f-ee8a0a426409 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:24.461386 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-69ff936d-342f-4275-a14f-ee8a0a426409 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:24.465368 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-69ff936d-342f-4275-a14f-ee8a0a426409 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:24.466313 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-69ff936d-342f-4275-a14f-ee8a0a426409 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:24.649306 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d3054c5a-810d-4f18-8ba0-77da639e8bcd tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] 10.222.0.27 "POST /compute/v2.1/servers/72eb7387-3f16-4b4f-ab9a-89076f169fc1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.967624 Sep 08 10:47:24.662733 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1138/2275] 10.222.0.27 () {60 vars in 1323 bytes} [Thu Sep 8 10:47:23 2022] POST /compute/v2.1/servers/72eb7387-3f16-4b4f-ab9a-89076f169fc1/os-volume_attachments => generated 194 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:47:24.676241 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bece35e4-7ac3-4dfd-a055-514b989047ef tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:24.677293 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bece35e4-7ac3-4dfd-a055-514b989047ef tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 23007ef9-a0d3-42ff-b687-0f53086c8bcb] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:24.688741 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bece35e4-7ac3-4dfd-a055-514b989047ef tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:24.689357 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bece35e4-7ac3-4dfd-a055-514b989047ef tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:24.690579 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bece35e4-7ac3-4dfd-a055-514b989047ef tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:24.691622 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bece35e4-7ac3-4dfd-a055-514b989047ef tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:24.692118 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bece35e4-7ac3-4dfd-a055-514b989047ef tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:24.692958 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bece35e4-7ac3-4dfd-a055-514b989047ef tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:24.702505 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-69ff936d-342f-4275-a14f-ee8a0a426409 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:24.716709 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-69ff936d-342f-4275-a14f-ee8a0a426409 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/e052494d-6c34-4e3a-adac-4c7ed14f87c9" status: 200 len: 1505 microversion: 2.1 time: 0.290699 Sep 08 10:47:24.725610 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1138/2276] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:24 2022] GET /compute/v2.1/servers/e052494d-6c34-4e3a-adac-4c7ed14f87c9 => generated 1505 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:24.830645 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-bece35e4-7ac3-4dfd-a055-514b989047ef tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:24.840778 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bece35e4-7ac3-4dfd-a055-514b989047ef tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/23007ef9-a0d3-42ff-b687-0f53086c8bcb" status: 200 len: 1267 microversion: 2.1 time: 0.174135 Sep 08 10:47:24.842388 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1139/2277] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:24 2022] GET /compute/v2.1/servers/23007ef9-a0d3-42ff-b687-0f53086c8bcb => generated 1267 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:24.862471 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-8178d5d5-ad91-4f2c-ba32-97b55952d713 req-c0c356cd-a121-41ee-955c-2d2545fdd2e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c937afd2-1699-4699-809d-20cfcead412c", "name": "network-vif-plugged", "status": "completed", "tag": "adcc26d9-b793-4b1b-9cf8-5a561707352d"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:47:24.875222 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-8178d5d5-ad91-4f2c-ba32-97b55952d713 req-c0c356cd-a121-41ee-955c-2d2545fdd2e1 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:24.876005 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-8178d5d5-ad91-4f2c-ba32-97b55952d713 req-c0c356cd-a121-41ee-955c-2d2545fdd2e1 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:24.876434 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-8178d5d5-ad91-4f2c-ba32-97b55952d713 req-c0c356cd-a121-41ee-955c-2d2545fdd2e1 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:24.893857 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-8178d5d5-ad91-4f2c-ba32-97b55952d713 req-c0c356cd-a121-41ee-955c-2d2545fdd2e1 service nova] Creating event network-vif-plugged:adcc26d9-b793-4b1b-9cf8-5a561707352d for instance c937afd2-1699-4699-809d-20cfcead412c on n-h2-850501-12 Sep 08 10:47:24.901524 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-8178d5d5-ad91-4f2c-ba32-97b55952d713 req-c0c356cd-a121-41ee-955c-2d2545fdd2e1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042702 Sep 08 10:47:24.902155 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1140/2278] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:47:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:47:24.958994 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f73e1887-313a-4280-9752-9a5ffd2f6df7 tempest-QuotasAdminTestV257-1906763017 tempest-QuotasAdminTestV257-1906763017-project-admin] Action: 'update', calling method: .version_select at 0x7f68e8a94820>, body: {"quota_set": {"ram": "5120"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:47:25.066007 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f73e1887-313a-4280-9752-9a5ffd2f6df7 tempest-QuotasAdminTestV257-1906763017 tempest-QuotasAdminTestV257-1906763017-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:25.066885 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f73e1887-313a-4280-9752-9a5ffd2f6df7 tempest-QuotasAdminTestV257-1906763017 tempest-QuotasAdminTestV257-1906763017-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:25.067625 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f73e1887-313a-4280-9752-9a5ffd2f6df7 tempest-QuotasAdminTestV257-1906763017 tempest-QuotasAdminTestV257-1906763017-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:25.068870 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f73e1887-313a-4280-9752-9a5ffd2f6df7 tempest-QuotasAdminTestV257-1906763017 tempest-QuotasAdminTestV257-1906763017-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:25.072880 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f73e1887-313a-4280-9752-9a5ffd2f6df7 tempest-QuotasAdminTestV257-1906763017 tempest-QuotasAdminTestV257-1906763017-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:25.073947 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f73e1887-313a-4280-9752-9a5ffd2f6df7 tempest-QuotasAdminTestV257-1906763017 tempest-QuotasAdminTestV257-1906763017-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:25.087130 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e32c9dc8-78a3-42b5-9e00-847a4dcceb9f tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:25.087993 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e32c9dc8-78a3-42b5-9e00-847a4dcceb9f tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] [instance: c937afd2-1699-4699-809d-20cfcead412c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:25.115401 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e32c9dc8-78a3-42b5-9e00-847a4dcceb9f tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:25.115924 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e32c9dc8-78a3-42b5-9e00-847a4dcceb9f tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:25.116364 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e32c9dc8-78a3-42b5-9e00-847a4dcceb9f tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:25.117095 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e32c9dc8-78a3-42b5-9e00-847a4dcceb9f tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:25.117556 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e32c9dc8-78a3-42b5-9e00-847a4dcceb9f tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:25.118302 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e32c9dc8-78a3-42b5-9e00-847a4dcceb9f tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:25.194532 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f73e1887-313a-4280-9752-9a5ffd2f6df7 tempest-QuotasAdminTestV257-1906763017 tempest-QuotasAdminTestV257-1906763017-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/f45e525f802b4da999bdc27620b3b05a" status: 200 len: 148 microversion: 2.57 time: 0.475491 Sep 08 10:47:25.195479 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1139/2279] 10.222.0.27 () {62 vars in 1303 bytes} [Thu Sep 8 10:47:24 2022] PUT /compute/v2.1/os-quota-sets/f45e525f802b4da999bdc27620b3b05a => generated 148 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:47:25.207960 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c148b115-e914-4896-bc9b-21e8fe8b10d2 tempest-QuotasAdminTestV257-1906763017 tempest-QuotasAdminTestV257-1906763017-project-admin] Calling method '.version_select at 0x7f68e42f2e50>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:25.345475 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c148b115-e914-4896-bc9b-21e8fe8b10d2 tempest-QuotasAdminTestV257-1906763017 tempest-QuotasAdminTestV257-1906763017-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:25.346167 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c148b115-e914-4896-bc9b-21e8fe8b10d2 tempest-QuotasAdminTestV257-1906763017 tempest-QuotasAdminTestV257-1906763017-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:25.347066 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c148b115-e914-4896-bc9b-21e8fe8b10d2 tempest-QuotasAdminTestV257-1906763017 tempest-QuotasAdminTestV257-1906763017-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:25.347872 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c148b115-e914-4896-bc9b-21e8fe8b10d2 tempest-QuotasAdminTestV257-1906763017 tempest-QuotasAdminTestV257-1906763017-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:25.348357 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c148b115-e914-4896-bc9b-21e8fe8b10d2 tempest-QuotasAdminTestV257-1906763017 tempest-QuotasAdminTestV257-1906763017-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:25.348995 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c148b115-e914-4896-bc9b-21e8fe8b10d2 tempest-QuotasAdminTestV257-1906763017 tempest-QuotasAdminTestV257-1906763017-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:25.391597 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e32c9dc8-78a3-42b5-9e00-847a4dcceb9f tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416642c1ee664b4d9e0fb14d02266b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cfab473734f4b63aaa78508ef460a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:25.396171 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c148b115-e914-4896-bc9b-21e8fe8b10d2 tempest-QuotasAdminTestV257-1906763017 tempest-QuotasAdminTestV257-1906763017-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/f45e525f802b4da999bdc27620b3b05a/detail" status: 200 len: 463 microversion: 2.57 time: 0.192269 Sep 08 10:47:25.401641 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1140/2280] 10.222.0.27 () {60 vars in 1304 bytes} [Thu Sep 8 10:47:25 2022] GET /compute/v2.1/os-quota-sets/f45e525f802b4da999bdc27620b3b05a/detail => generated 463 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 10:47:25.414614 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e32c9dc8-78a3-42b5-9e00-847a4dcceb9f tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] 10.222.0.27 "GET /compute/v2.1/servers/c937afd2-1699-4699-809d-20cfcead412c" status: 200 len: 1319 microversion: 2.1 time: 0.332772 Sep 08 10:47:25.415036 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1141/2281] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:25 2022] GET /compute/v2.1/servers/c937afd2-1699-4699-809d-20cfcead412c => generated 1319 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:25.429905 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6cb0aae5-26e8-4f24-ac7c-70389c293d5d tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:25.430596 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6cb0aae5-26e8-4f24-ac7c-70389c293d5d tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: 3766b195-ace4-4563-a24e-dca72941251e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:25.460689 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6cb0aae5-26e8-4f24-ac7c-70389c293d5d tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:25.461722 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6cb0aae5-26e8-4f24-ac7c-70389c293d5d tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:25.462589 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6cb0aae5-26e8-4f24-ac7c-70389c293d5d tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:25.463773 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6cb0aae5-26e8-4f24-ac7c-70389c293d5d tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:25.465076 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6cb0aae5-26e8-4f24-ac7c-70389c293d5d tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:25.466770 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6cb0aae5-26e8-4f24-ac7c-70389c293d5d tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:25.477310 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:47:25.724566 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e8483e94-045b-41c5-a502-9b01114394ed tempest-QuotasAdminTestV257-1906763017 tempest-QuotasAdminTestV257-1906763017-project-admin] Action: 'update', calling method: .version_select at 0x7f68e4555af0>, body: {"quota_set": {"ram": "2048"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:47:25.822573 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6cb0aae5-26e8-4f24-ac7c-70389c293d5d tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:25.833063 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6cb0aae5-26e8-4f24-ac7c-70389c293d5d tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e" status: 200 len: 1472 microversion: 2.1 time: 0.408022 Sep 08 10:47:25.834100 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1141/2282] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:25 2022] GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e => generated 1472 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:25.848058 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f046cca2-9b6f-46fc-a47b-37e461c0520b tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:25.850918 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f046cca2-9b6f-46fc-a47b-37e461c0520b tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: e052494d-6c34-4e3a-adac-4c7ed14f87c9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:25.869307 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f046cca2-9b6f-46fc-a47b-37e461c0520b tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:25.870956 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f046cca2-9b6f-46fc-a47b-37e461c0520b tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:25.872265 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f046cca2-9b6f-46fc-a47b-37e461c0520b tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:25.875158 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f046cca2-9b6f-46fc-a47b-37e461c0520b tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:25.878372 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f046cca2-9b6f-46fc-a47b-37e461c0520b tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:25.879096 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f046cca2-9b6f-46fc-a47b-37e461c0520b tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:25.952628 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e8483e94-045b-41c5-a502-9b01114394ed tempest-QuotasAdminTestV257-1906763017 tempest-QuotasAdminTestV257-1906763017-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:25.953854 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e8483e94-045b-41c5-a502-9b01114394ed tempest-QuotasAdminTestV257-1906763017 tempest-QuotasAdminTestV257-1906763017-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:25.954964 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e8483e94-045b-41c5-a502-9b01114394ed tempest-QuotasAdminTestV257-1906763017 tempest-QuotasAdminTestV257-1906763017-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:25.956436 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e8483e94-045b-41c5-a502-9b01114394ed tempest-QuotasAdminTestV257-1906763017 tempest-QuotasAdminTestV257-1906763017-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:25.957584 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e8483e94-045b-41c5-a502-9b01114394ed tempest-QuotasAdminTestV257-1906763017 tempest-QuotasAdminTestV257-1906763017-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:25.958312 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e8483e94-045b-41c5-a502-9b01114394ed tempest-QuotasAdminTestV257-1906763017 tempest-QuotasAdminTestV257-1906763017-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:26.011060 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e8483e94-045b-41c5-a502-9b01114394ed tempest-QuotasAdminTestV257-1906763017 tempest-QuotasAdminTestV257-1906763017-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:26.011926 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e8483e94-045b-41c5-a502-9b01114394ed tempest-QuotasAdminTestV257-1906763017 tempest-QuotasAdminTestV257-1906763017-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:26.012974 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e8483e94-045b-41c5-a502-9b01114394ed tempest-QuotasAdminTestV257-1906763017 tempest-QuotasAdminTestV257-1906763017-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:26.014863 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e8483e94-045b-41c5-a502-9b01114394ed tempest-QuotasAdminTestV257-1906763017 tempest-QuotasAdminTestV257-1906763017-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:26.016688 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e8483e94-045b-41c5-a502-9b01114394ed tempest-QuotasAdminTestV257-1906763017 tempest-QuotasAdminTestV257-1906763017-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:26.017497 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e8483e94-045b-41c5-a502-9b01114394ed tempest-QuotasAdminTestV257-1906763017 tempest-QuotasAdminTestV257-1906763017-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:26.150814 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f046cca2-9b6f-46fc-a47b-37e461c0520b tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:26.170303 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f046cca2-9b6f-46fc-a47b-37e461c0520b tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/e052494d-6c34-4e3a-adac-4c7ed14f87c9" status: 200 len: 1500 microversion: 2.1 time: 0.333648 Sep 08 10:47:26.177417 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e8483e94-045b-41c5-a502-9b01114394ed tempest-QuotasAdminTestV257-1906763017 tempest-QuotasAdminTestV257-1906763017-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/f45e525f802b4da999bdc27620b3b05a?user_id=dfbbe816cd6643e8ab91d36172d65989" status: 200 len: 148 microversion: 2.57 time: 0.456460 Sep 08 10:47:26.187256 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1142/2283] 10.222.0.27 () {62 vars in 1384 bytes} [Thu Sep 8 10:47:25 2022] PUT /compute/v2.1/os-quota-sets/f45e525f802b4da999bdc27620b3b05a?user_id=dfbbe816cd6643e8ab91d36172d65989 => generated 148 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:47:26.199612 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a20b6587-1953-4a36-af41-15e993e19a01 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:26.200940 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a20b6587-1953-4a36-af41-15e993e19a01 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 23007ef9-a0d3-42ff-b687-0f53086c8bcb] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:26.209538 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1142/2284] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:25 2022] GET /compute/v2.1/servers/e052494d-6c34-4e3a-adac-4c7ed14f87c9 => generated 1500 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:26.216420 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a20b6587-1953-4a36-af41-15e993e19a01 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:26.220280 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f19a71aa-f187-498b-9aa5-ae6c5285598f tempest-QuotasAdminTestV257-1906763017 tempest-QuotasAdminTestV257-1906763017-project-admin] Calling method '.version_select at 0x7f68e43014c0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:26.221300 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a20b6587-1953-4a36-af41-15e993e19a01 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:26.221864 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a20b6587-1953-4a36-af41-15e993e19a01 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:26.222843 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a20b6587-1953-4a36-af41-15e993e19a01 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:26.223445 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a20b6587-1953-4a36-af41-15e993e19a01 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:26.224056 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a20b6587-1953-4a36-af41-15e993e19a01 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:26.271890 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:47:26.339500 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f19a71aa-f187-498b-9aa5-ae6c5285598f tempest-QuotasAdminTestV257-1906763017 tempest-QuotasAdminTestV257-1906763017-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/f45e525f802b4da999bdc27620b3b05a?user_id=dfbbe816cd6643e8ab91d36172d65989" status: 200 len: 190 microversion: 2.57 time: 0.123904 Sep 08 10:47:26.340767 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1143/2285] 10.222.0.27 () {60 vars in 1364 bytes} [Thu Sep 8 10:47:26 2022] GET /compute/v2.1/os-quota-sets/f45e525f802b4da999bdc27620b3b05a?user_id=dfbbe816cd6643e8ab91d36172d65989 => generated 190 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:47:26.347231 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c759daef-c9a8-43ff-8ff4-94f5b56e5f1c tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1534517570", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "b83085a4-cdec-4f25-9fb8-15f995b4b9b9"}], "security_groups": [{"name": "tempest-securitygroup--218091107"}], "key_name": "tempest-keypair-928070625", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "16769579-6f85-43e8-abdd-53dcf506bffb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:47:26.361701 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a20b6587-1953-4a36-af41-15e993e19a01 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:26.382608 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a20b6587-1953-4a36-af41-15e993e19a01 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/23007ef9-a0d3-42ff-b687-0f53086c8bcb" status: 200 len: 1273 microversion: 2.1 time: 0.192615 Sep 08 10:47:26.386365 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1143/2286] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:26 2022] GET /compute/v2.1/servers/23007ef9-a0d3-42ff-b687-0f53086c8bcb => generated 1273 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:26.450751 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0ecda1d0-bebd-49d1-92bd-9b989c06e641 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:26.452672 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0ecda1d0-bebd-49d1-92bd-9b989c06e641 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] [instance: c937afd2-1699-4699-809d-20cfcead412c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:26.471414 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0ecda1d0-bebd-49d1-92bd-9b989c06e641 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:26.473390 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0ecda1d0-bebd-49d1-92bd-9b989c06e641 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:26.474417 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0ecda1d0-bebd-49d1-92bd-9b989c06e641 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:26.476118 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0ecda1d0-bebd-49d1-92bd-9b989c06e641 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:26.476785 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0ecda1d0-bebd-49d1-92bd-9b989c06e641 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:26.477597 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0ecda1d0-bebd-49d1-92bd-9b989c06e641 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:26.552328 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-c759daef-c9a8-43ff-8ff4-94f5b56e5f1c tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] validate_networks() for [('b83085a4-cdec-4f25-9fb8-15f995b4b9b9', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:47:27.195074 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0ecda1d0-bebd-49d1-92bd-9b989c06e641 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416642c1ee664b4d9e0fb14d02266b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cfab473734f4b63aaa78508ef460a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:27.204546 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0ecda1d0-bebd-49d1-92bd-9b989c06e641 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] 10.222.0.27 "GET /compute/v2.1/servers/c937afd2-1699-4699-809d-20cfcead412c" status: 200 len: 1469 microversion: 2.1 time: 0.757922 Sep 08 10:47:27.208485 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1144/2287] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:26 2022] GET /compute/v2.1/servers/c937afd2-1699-4699-809d-20cfcead412c => generated 1469 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:27.215183 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6e25d3f8-2c87-4cb1-8fd9-230978ba6cf5 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:27.219347 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6e25d3f8-2c87-4cb1-8fd9-230978ba6cf5 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: 3766b195-ace4-4563-a24e-dca72941251e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:27.230217 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6e25d3f8-2c87-4cb1-8fd9-230978ba6cf5 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:27.230824 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-c759daef-c9a8-43ff-8ff4-94f5b56e5f1c tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Getting quotas for project effe8e6c23114b8ab80e76bec365de60. Resources: dict_keys(['metadata_items']) {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:47:27.231468 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6e25d3f8-2c87-4cb1-8fd9-230978ba6cf5 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:27.235350 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6e25d3f8-2c87-4cb1-8fd9-230978ba6cf5 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:27.236335 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6e25d3f8-2c87-4cb1-8fd9-230978ba6cf5 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:27.242781 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-c759daef-c9a8-43ff-8ff4-94f5b56e5f1c tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Getting quotas for user 528fc9fbb57149c9a9c755c6497f5c3a and project effe8e6c23114b8ab80e76bec365de60. Resources: dict_keys(['metadata_items']) {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:47:27.249832 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6e25d3f8-2c87-4cb1-8fd9-230978ba6cf5 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:27.250292 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6e25d3f8-2c87-4cb1-8fd9-230978ba6cf5 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:27.262699 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-c759daef-c9a8-43ff-8ff4-94f5b56e5f1c tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:47:27.264590 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-c759daef-c9a8-43ff-8ff4-94f5b56e5f1c tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:47:27.265435 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-c759daef-c9a8-43ff-8ff4-94f5b56e5f1c tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:47:27.266018 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-c759daef-c9a8-43ff-8ff4-94f5b56e5f1c tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:47:27.266626 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-c759daef-c9a8-43ff-8ff4-94f5b56e5f1c tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:47:27.277097 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c759daef-c9a8-43ff-8ff4-94f5b56e5f1c tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:27.277894 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c759daef-c9a8-43ff-8ff4-94f5b56e5f1c tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:27.278488 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c759daef-c9a8-43ff-8ff4-94f5b56e5f1c tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:27.279656 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c759daef-c9a8-43ff-8ff4-94f5b56e5f1c tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:27.280549 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c759daef-c9a8-43ff-8ff4-94f5b56e5f1c tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:27.281233 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c759daef-c9a8-43ff-8ff4-94f5b56e5f1c tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:27.303866 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-c759daef-c9a8-43ff-8ff4-94f5b56e5f1c tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Getting quotas for project effe8e6c23114b8ab80e76bec365de60. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:47:27.311042 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-c759daef-c9a8-43ff-8ff4-94f5b56e5f1c tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Getting quotas for user 528fc9fbb57149c9a9c755c6497f5c3a and project effe8e6c23114b8ab80e76bec365de60. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:47:27.402843 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c759daef-c9a8-43ff-8ff4-94f5b56e5f1c tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:47:27.410625 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c759daef-c9a8-43ff-8ff4-94f5b56e5f1c tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] [instance: 4703a7bf-a1ba-4bba-8928-3c403f3f3f21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='16769579-6f85-43e8-abdd-53dcf506bffb',volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:47:27.595495 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6e25d3f8-2c87-4cb1-8fd9-230978ba6cf5 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:27.610901 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6e25d3f8-2c87-4cb1-8fd9-230978ba6cf5 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e" status: 200 len: 1472 microversion: 2.1 time: 0.401229 Sep 08 10:47:27.611498 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1145/2288] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:27 2022] GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e => generated 1472 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:27.621502 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-099418d0-9efc-40f6-b9e3-992bef6331b4 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:27.622119 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-099418d0-9efc-40f6-b9e3-992bef6331b4 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: e052494d-6c34-4e3a-adac-4c7ed14f87c9] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:27.659075 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-099418d0-9efc-40f6-b9e3-992bef6331b4 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:27.659503 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-099418d0-9efc-40f6-b9e3-992bef6331b4 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:27.659939 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-099418d0-9efc-40f6-b9e3-992bef6331b4 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:27.660659 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-099418d0-9efc-40f6-b9e3-992bef6331b4 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:27.661189 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-099418d0-9efc-40f6-b9e3-992bef6331b4 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:27.661619 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-099418d0-9efc-40f6-b9e3-992bef6331b4 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:27.740795 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c759daef-c9a8-43ff-8ff4-94f5b56e5f1c tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.394342 Sep 08 10:47:27.754507 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1144/2289] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:47:26 2022] POST /compute/v2.1/servers => generated 406 bytes in 1413 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:47:27.760414 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f451f4b2-9132-48b6-8ca0-37a5ae0fabbe tempest-LiveMigrationNegativeTest-317868421 tempest-LiveMigrationNegativeTest-317868421-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:47:27.768792 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f451f4b2-9132-48b6-8ca0-37a5ae0fabbe tempest-LiveMigrationNegativeTest-317868421 tempest-LiveMigrationNegativeTest-317868421-project-admin] [instance: c937afd2-1699-4699-809d-20cfcead412c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:27.795996 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f451f4b2-9132-48b6-8ca0-37a5ae0fabbe tempest-LiveMigrationNegativeTest-317868421 tempest-LiveMigrationNegativeTest-317868421-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:27.799920 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f451f4b2-9132-48b6-8ca0-37a5ae0fabbe tempest-LiveMigrationNegativeTest-317868421 tempest-LiveMigrationNegativeTest-317868421-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:27.800831 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f451f4b2-9132-48b6-8ca0-37a5ae0fabbe tempest-LiveMigrationNegativeTest-317868421 tempest-LiveMigrationNegativeTest-317868421-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:27.805677 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f451f4b2-9132-48b6-8ca0-37a5ae0fabbe tempest-LiveMigrationNegativeTest-317868421 tempest-LiveMigrationNegativeTest-317868421-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:27.808882 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f451f4b2-9132-48b6-8ca0-37a5ae0fabbe tempest-LiveMigrationNegativeTest-317868421 tempest-LiveMigrationNegativeTest-317868421-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:27.811860 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f451f4b2-9132-48b6-8ca0-37a5ae0fabbe tempest-LiveMigrationNegativeTest-317868421 tempest-LiveMigrationNegativeTest-317868421-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:27.906558 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-f451f4b2-9132-48b6-8ca0-37a5ae0fabbe tempest-LiveMigrationNegativeTest-317868421 tempest-LiveMigrationNegativeTest-317868421-project-admin] Lazy-loading 'flavor' on Instance uuid c937afd2-1699-4699-809d-20cfcead412c {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:47:28.073348 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-099418d0-9efc-40f6-b9e3-992bef6331b4 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:28.096835 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-099418d0-9efc-40f6-b9e3-992bef6331b4 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/e052494d-6c34-4e3a-adac-4c7ed14f87c9" status: 200 len: 1487 microversion: 2.1 time: 0.484261 Sep 08 10:47:28.097470 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1146/2290] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:27 2022] GET /compute/v2.1/servers/e052494d-6c34-4e3a-adac-4c7ed14f87c9 => generated 1487 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:28.116659 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ffd55e67-1306-4e27-a8bf-1a069d5e903e tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:28.117162 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ffd55e67-1306-4e27-a8bf-1a069d5e903e tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 23007ef9-a0d3-42ff-b687-0f53086c8bcb] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:28.134787 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ffd55e67-1306-4e27-a8bf-1a069d5e903e tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:28.136372 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ffd55e67-1306-4e27-a8bf-1a069d5e903e tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:28.137079 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ffd55e67-1306-4e27-a8bf-1a069d5e903e tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:28.142737 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ffd55e67-1306-4e27-a8bf-1a069d5e903e tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:28.147212 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ffd55e67-1306-4e27-a8bf-1a069d5e903e tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:28.147669 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ffd55e67-1306-4e27-a8bf-1a069d5e903e tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:28.158221 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f451f4b2-9132-48b6-8ca0-37a5ae0fabbe tempest-LiveMigrationNegativeTest-317868421 tempest-LiveMigrationNegativeTest-317868421-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/c937afd2-1699-4699-809d-20cfcead412c/action" status: 202 len: 0 microversion: 2.1 time: 0.402105 Sep 08 10:47:28.176706 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1145/2291] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:47:27 2022] POST /compute/v2.1/servers/c937afd2-1699-4699-809d-20cfcead412c/action => generated 0 bytes in 421 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:47:28.198047 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-90b81b69-2387-474e-b6ee-c74297accaf6 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:28.200456 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-90b81b69-2387-474e-b6ee-c74297accaf6 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] [instance: 4703a7bf-a1ba-4bba-8928-3c403f3f3f21] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:28.359245 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-90b81b69-2387-474e-b6ee-c74297accaf6 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528fc9fbb57149c9a9c755c6497f5c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effe8e6c23114b8ab80e76bec365de60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:28.374559 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-90b81b69-2387-474e-b6ee-c74297accaf6 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] 10.222.0.27 "GET /compute/v2.1/servers/4703a7bf-a1ba-4bba-8928-3c403f3f3f21" status: 200 len: 1121 microversion: 2.1 time: 0.196097 Sep 08 10:47:28.389063 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1146/2292] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:28 2022] GET /compute/v2.1/servers/4703a7bf-a1ba-4bba-8928-3c403f3f3f21 => generated 1121 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:28.389063 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8d079918-9322-46ee-a84e-35e84049cd4a tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:28.389063 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8d079918-9322-46ee-a84e-35e84049cd4a tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: e052494d-6c34-4e3a-adac-4c7ed14f87c9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:28.398465 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d079918-9322-46ee-a84e-35e84049cd4a tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:28.398962 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d079918-9322-46ee-a84e-35e84049cd4a tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:28.399400 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d079918-9322-46ee-a84e-35e84049cd4a tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:28.400118 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d079918-9322-46ee-a84e-35e84049cd4a tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:28.400576 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d079918-9322-46ee-a84e-35e84049cd4a tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:28.401005 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d079918-9322-46ee-a84e-35e84049cd4a tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:28.500302 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ffd55e67-1306-4e27-a8bf-1a069d5e903e tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:28.515121 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ffd55e67-1306-4e27-a8bf-1a069d5e903e tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/23007ef9-a0d3-42ff-b687-0f53086c8bcb" status: 200 len: 1315 microversion: 2.1 time: 0.412908 Sep 08 10:47:28.516367 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1147/2293] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:28 2022] GET /compute/v2.1/servers/23007ef9-a0d3-42ff-b687-0f53086c8bcb => generated 1315 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:28.535586 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f6feed94-d334-4f3c-8bd0-1ea2fdeb9ddd tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:28.543551 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f6feed94-d334-4f3c-8bd0-1ea2fdeb9ddd tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] [instance: c937afd2-1699-4699-809d-20cfcead412c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:28.566541 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f6feed94-d334-4f3c-8bd0-1ea2fdeb9ddd tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:28.566951 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f6feed94-d334-4f3c-8bd0-1ea2fdeb9ddd tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:28.567209 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f6feed94-d334-4f3c-8bd0-1ea2fdeb9ddd tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:28.582664 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f6feed94-d334-4f3c-8bd0-1ea2fdeb9ddd tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:28.586947 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f6feed94-d334-4f3c-8bd0-1ea2fdeb9ddd tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:28.587422 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f6feed94-d334-4f3c-8bd0-1ea2fdeb9ddd tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:28.845719 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8d079918-9322-46ee-a84e-35e84049cd4a tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: e052494d-6c34-4e3a-adac-4c7ed14f87c9] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:47:29.015600 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8d079918-9322-46ee-a84e-35e84049cd4a tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e052494d-6c34-4e3a-adac-4c7ed14f87c9" status: 204 len: 0 microversion: 2.1 time: 0.636347 Sep 08 10:47:29.017574 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1147/2294] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:47:28 2022] DELETE /compute/v2.1/servers/e052494d-6c34-4e3a-adac-4c7ed14f87c9 => generated 0 bytes in 641 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:47:29.046566 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-da2376a7-90c7-4876-a418-cbf7e6853e6f tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:29.049257 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-da2376a7-90c7-4876-a418-cbf7e6853e6f tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: 3766b195-ace4-4563-a24e-dca72941251e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:29.066367 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-da2376a7-90c7-4876-a418-cbf7e6853e6f tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:29.067387 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-da2376a7-90c7-4876-a418-cbf7e6853e6f tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:29.069222 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-da2376a7-90c7-4876-a418-cbf7e6853e6f tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:29.072751 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-da2376a7-90c7-4876-a418-cbf7e6853e6f tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:29.075585 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-da2376a7-90c7-4876-a418-cbf7e6853e6f tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:29.078315 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-da2376a7-90c7-4876-a418-cbf7e6853e6f tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:29.112041 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f6feed94-d334-4f3c-8bd0-1ea2fdeb9ddd tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416642c1ee664b4d9e0fb14d02266b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cfab473734f4b63aaa78508ef460a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:29.129180 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f6feed94-d334-4f3c-8bd0-1ea2fdeb9ddd tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] 10.222.0.27 "GET /compute/v2.1/servers/c937afd2-1699-4699-809d-20cfcead412c" status: 200 len: 1477 microversion: 2.1 time: 0.610780 Sep 08 10:47:29.130741 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1148/2295] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:28 2022] GET /compute/v2.1/servers/c937afd2-1699-4699-809d-20cfcead412c => generated 1477 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:29.137571 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3245f77e-5f9b-4a5d-b068-7cd180336826 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '.version_select at 0x7f68e4923430>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:29.221866 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-3245f77e-5f9b-4a5d-b068-7cd180336826 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] HTTP exception thrown: Image not found. Sep 08 10:47:29.224723 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3245f77e-5f9b-4a5d-b068-7cd180336826 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Request method failure captured: Sep 08 10:47:29.224723 n-d-850501-12 devstack@n-api.service[128861]: request: DELETE /compute/v2.1/images/c1c6dc49-82fd-4aca-8c14-26e168d845e4 HTTP/1.1 Sep 08 10:47:29.224723 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:47:29.224723 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:47:29.224723 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:47:29.224723 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:47:29.224723 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:47:29.224723 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:47:29.224723 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:47:29.224723 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:47:29.224723 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcc0sSj3x0sBidV4prTXv00UAP3lriFd9bSf6ARsE1ekKVmlGukpstC35qUsWPJmY1lsjsjExO-iqH_QnZHhexPCbL7rQ87usxEHhLxbNbIFKv-QG5rcjHdmQtO5f0_wSj_rlzeH-S-tFvmDK4BhyOKoPTI_CkViDwssV_47VejAgTw Sep 08 10:47:29.224723 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:47:29.224723 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:47:29.224723 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:47:29.224723 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:47:29.224723 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:47:29.224723 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:47:29.224723 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: eeeb450420314221bd2469816e2995d1 Sep 08 10:47:29.224723 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ImagesTestJSON-2041705293 Sep 08 10:47:29.224723 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:47:29.224723 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:47:29.224723 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/eeeb450420314221bd2469816e2995d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eeeb450420314221bd2469816e2995d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_eeeb450420314221bd2469816e2995d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eeeb450420314221bd2469816e2995d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:47:29.224723 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ImagesTestJSON-2041705293 Sep 08 10:47:29.224723 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: eeeb450420314221bd2469816e2995d1 Sep 08 10:47:29.224723 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ImagesTestJSON-2041705293 Sep 08 10:47:29.224723 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ImagesTestJSON-2041705293-project Sep 08 10:47:29.224723 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:47:29.224723 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:47:29.224723 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: ce8c8c85354d46aeb786c8049b81e04d Sep 08 10:47:29.224723 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ImagesTestJSON-2041705293-project Sep 08 10:47:29.224723 n-d-850501-12 devstack@n-api.service[128861]: method: Sep 08 10:47:29.224723 n-d-850501-12 devstack@n-api.service[128861]: exception: Image not found. Sep 08 10:47:29.224723 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': 'c1c6dc49-82fd-4aca-8c14-26e168d845e4'} Sep 08 10:47:29.224723 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:47:29.224723 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:29.224723 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 08 10:47:29.224723 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 08 10:47:29.224723 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 10:47:29.224723 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 10:47:29.224723 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 10:47:29.224723 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 10:47:29.224723 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 08 10:47:29.224723 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 08 10:47:29.224723 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 08 10:47:29.224723 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 08 10:47:29.224723 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 10:47:29.224723 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 10:47:29.224723 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 10:47:29.224723 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 10:47:29.224723 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image c1c6dc49-82fd-4aca-8c14-26e168d845e4 to delete Sep 08 10:47:29.224723 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:29.224723 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:29.224723 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:29.224723 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:29.224723 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 08 10:47:29.224723 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 08 10:47:29.224723 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 08 10:47:29.224723 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 08 10:47:29.224723 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 08 10:47:29.224723 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 08 10:47:29.224723 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c1c6dc49-82fd-4aca-8c14-26e168d845e4 could not be found. Sep 08 10:47:29.224723 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:29.224723 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:29.224723 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:29.224723 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:29.230301 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:47:29.230301 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:47:29.230301 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:47:29.230301 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:47:29.230301 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:47:29.230301 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:47:29.230301 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:47:29.230301 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:47:29.230301 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 08 10:47:29.230301 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 08 10:47:29.230301 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 08 10:47:29.230301 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:29.230301 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:29.230301 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:29.230301 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:29.230301 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:47:29.230301 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:47:29.230301 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:47:29.230301 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:47:29.230301 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 08 10:47:29.230301 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:29.230301 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3245f77e-5f9b-4a5d-b068-7cd180336826 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Returning 404 to user: Image not found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:47:29.230301 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3245f77e-5f9b-4a5d-b068-7cd180336826 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "DELETE /compute/v2.1/images/c1c6dc49-82fd-4aca-8c14-26e168d845e4" status: 404 len: 62 microversion: 2.1 time: 0.094648 Sep 08 10:47:29.233686 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1149/2296] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:29 2022] DELETE /compute/v2.1/images/c1c6dc49-82fd-4aca-8c14-26e168d845e4 => generated 62 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:47:29.247753 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e6af719e-f206-4ef1-b8c5-259d6362dc7f tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:29.248242 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e6af719e-f206-4ef1-b8c5-259d6362dc7f tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: e052494d-6c34-4e3a-adac-4c7ed14f87c9] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:29.269832 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e6af719e-f206-4ef1-b8c5-259d6362dc7f tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:29.272285 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e6af719e-f206-4ef1-b8c5-259d6362dc7f tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:29.272886 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e6af719e-f206-4ef1-b8c5-259d6362dc7f tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:29.273767 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e6af719e-f206-4ef1-b8c5-259d6362dc7f tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:29.276819 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e6af719e-f206-4ef1-b8c5-259d6362dc7f tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:29.279004 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e6af719e-f206-4ef1-b8c5-259d6362dc7f tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:29.322915 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-da2376a7-90c7-4876-a418-cbf7e6853e6f tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:29.333251 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e6af719e-f206-4ef1-b8c5-259d6362dc7f tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: e052494d-6c34-4e3a-adac-4c7ed14f87c9] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:47:29.333439 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-da2376a7-90c7-4876-a418-cbf7e6853e6f tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e" status: 200 len: 1472 microversion: 2.1 time: 0.300930 Sep 08 10:47:29.334376 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1148/2297] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:29 2022] GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e => generated 1472 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:29.403519 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-09df4506-41e2-46ce-a6dd-5d72bf994ed4 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:29.405276 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-09df4506-41e2-46ce-a6dd-5d72bf994ed4 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] [instance: 4703a7bf-a1ba-4bba-8928-3c403f3f3f21] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:29.412650 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:47:29.422246 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-09df4506-41e2-46ce-a6dd-5d72bf994ed4 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:29.422788 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-09df4506-41e2-46ce-a6dd-5d72bf994ed4 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:29.423244 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-09df4506-41e2-46ce-a6dd-5d72bf994ed4 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:29.427306 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-09df4506-41e2-46ce-a6dd-5d72bf994ed4 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:29.438234 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-09df4506-41e2-46ce-a6dd-5d72bf994ed4 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:29.439563 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-09df4506-41e2-46ce-a6dd-5d72bf994ed4 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:29.459778 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.compute.api [None req-e6af719e-f206-4ef1-b8c5-259d6362dc7f tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: e052494d-6c34-4e3a-adac-4c7ed14f87c9] Instance is already in deleting state, ignoring this request Sep 08 10:47:29.460635 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e6af719e-f206-4ef1-b8c5-259d6362dc7f tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e052494d-6c34-4e3a-adac-4c7ed14f87c9" status: 204 len: 0 microversion: 2.1 time: 0.225907 Sep 08 10:47:29.462356 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1150/2298] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:47:29 2022] DELETE /compute/v2.1/servers/e052494d-6c34-4e3a-adac-4c7ed14f87c9 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:47:29.488076 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-45da42dd-59cb-4d36-9e42-be3843c268ee tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:29.489228 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-45da42dd-59cb-4d36-9e42-be3843c268ee tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: e052494d-6c34-4e3a-adac-4c7ed14f87c9] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:29.510388 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-45da42dd-59cb-4d36-9e42-be3843c268ee tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:29.511390 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-45da42dd-59cb-4d36-9e42-be3843c268ee tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:29.511390 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-45da42dd-59cb-4d36-9e42-be3843c268ee tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:29.511988 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-45da42dd-59cb-4d36-9e42-be3843c268ee tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:29.514929 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-45da42dd-59cb-4d36-9e42-be3843c268ee tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:29.517259 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-45da42dd-59cb-4d36-9e42-be3843c268ee tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:29.621053 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-09df4506-41e2-46ce-a6dd-5d72bf994ed4 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528fc9fbb57149c9a9c755c6497f5c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effe8e6c23114b8ab80e76bec365de60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:29.631784 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-09df4506-41e2-46ce-a6dd-5d72bf994ed4 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] 10.222.0.27 "GET /compute/v2.1/servers/4703a7bf-a1ba-4bba-8928-3c403f3f3f21" status: 200 len: 1219 microversion: 2.1 time: 0.233108 Sep 08 10:47:29.648364 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1149/2299] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:29 2022] GET /compute/v2.1/servers/4703a7bf-a1ba-4bba-8928-3c403f3f3f21 => generated 1219 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:29.648364 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bd897480-f44a-49f7-933b-8edcb03fd08f tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:29.648364 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bd897480-f44a-49f7-933b-8edcb03fd08f tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 23007ef9-a0d3-42ff-b687-0f53086c8bcb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:29.648931 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bd897480-f44a-49f7-933b-8edcb03fd08f tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:29.649493 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bd897480-f44a-49f7-933b-8edcb03fd08f tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:29.650576 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bd897480-f44a-49f7-933b-8edcb03fd08f tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:29.651734 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bd897480-f44a-49f7-933b-8edcb03fd08f tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:29.652324 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bd897480-f44a-49f7-933b-8edcb03fd08f tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:29.652849 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bd897480-f44a-49f7-933b-8edcb03fd08f tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:29.856092 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bd897480-f44a-49f7-933b-8edcb03fd08f tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:29.867443 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bd897480-f44a-49f7-933b-8edcb03fd08f tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/23007ef9-a0d3-42ff-b687-0f53086c8bcb" status: 200 len: 1315 microversion: 2.1 time: 0.233481 Sep 08 10:47:29.870082 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-45da42dd-59cb-4d36-9e42-be3843c268ee tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:29.885971 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-45da42dd-59cb-4d36-9e42-be3843c268ee tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/e052494d-6c34-4e3a-adac-4c7ed14f87c9" status: 200 len: 1493 microversion: 2.1 time: 0.405427 Sep 08 10:47:29.887802 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1151/2300] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:29 2022] GET /compute/v2.1/servers/e052494d-6c34-4e3a-adac-4c7ed14f87c9 => generated 1493 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:29.898233 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1150/2301] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:29 2022] GET /compute/v2.1/servers/23007ef9-a0d3-42ff-b687-0f53086c8bcb => generated 1315 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:30.162731 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fca9dba8-aab3-47ae-82c7-d7dc23d787f9 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:30.163350 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fca9dba8-aab3-47ae-82c7-d7dc23d787f9 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] [instance: c937afd2-1699-4699-809d-20cfcead412c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:30.174960 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fca9dba8-aab3-47ae-82c7-d7dc23d787f9 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:30.175466 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fca9dba8-aab3-47ae-82c7-d7dc23d787f9 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:30.177629 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fca9dba8-aab3-47ae-82c7-d7dc23d787f9 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:30.179173 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fca9dba8-aab3-47ae-82c7-d7dc23d787f9 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:30.179976 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fca9dba8-aab3-47ae-82c7-d7dc23d787f9 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:30.182785 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fca9dba8-aab3-47ae-82c7-d7dc23d787f9 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:30.461495 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-20b965a1-5bf0-458c-bbd2-f7e0659a9cb4 req-5ae6b78f-86a0-4962-96b3-8c24c7ce7a26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23007ef9-a0d3-42ff-b687-0f53086c8bcb", "tag": "b375f03c-5802-4839-89db-d315a32c03c3"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:47:30.488409 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-20b965a1-5bf0-458c-bbd2-f7e0659a9cb4 req-5ae6b78f-86a0-4962-96b3-8c24c7ce7a26 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:30.489754 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-20b965a1-5bf0-458c-bbd2-f7e0659a9cb4 req-5ae6b78f-86a0-4962-96b3-8c24c7ce7a26 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:30.491923 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-20b965a1-5bf0-458c-bbd2-f7e0659a9cb4 req-5ae6b78f-86a0-4962-96b3-8c24c7ce7a26 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:30.494021 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fca9dba8-aab3-47ae-82c7-d7dc23d787f9 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416642c1ee664b4d9e0fb14d02266b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cfab473734f4b63aaa78508ef460a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:30.508649 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fca9dba8-aab3-47ae-82c7-d7dc23d787f9 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] 10.222.0.27 "GET /compute/v2.1/servers/c937afd2-1699-4699-809d-20cfcead412c" status: 200 len: 1460 microversion: 2.1 time: 0.351670 Sep 08 10:47:30.509882 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1151/2302] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:30 2022] GET /compute/v2.1/servers/c937afd2-1699-4699-809d-20cfcead412c => generated 1460 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:30.518029 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4e0566c1-f3c3-4560-ab95-a8a73c59023a tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:30.518938 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4e0566c1-f3c3-4560-ab95-a8a73c59023a tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: 3766b195-ace4-4563-a24e-dca72941251e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:30.527942 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e0566c1-f3c3-4560-ab95-a8a73c59023a tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:30.528806 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e0566c1-f3c3-4560-ab95-a8a73c59023a tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:30.530064 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e0566c1-f3c3-4560-ab95-a8a73c59023a tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:30.532313 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e0566c1-f3c3-4560-ab95-a8a73c59023a tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:30.533292 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e0566c1-f3c3-4560-ab95-a8a73c59023a tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:30.533947 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e0566c1-f3c3-4560-ab95-a8a73c59023a tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:30.553378 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-20b965a1-5bf0-458c-bbd2-f7e0659a9cb4 req-5ae6b78f-86a0-4962-96b3-8c24c7ce7a26 service nova] Creating event network-changed:b375f03c-5802-4839-89db-d315a32c03c3 for instance 23007ef9-a0d3-42ff-b687-0f53086c8bcb on n-h1-850501-12 Sep 08 10:47:30.579529 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-20b965a1-5bf0-458c-bbd2-f7e0659a9cb4 req-5ae6b78f-86a0-4962-96b3-8c24c7ce7a26 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.689502 Sep 08 10:47:30.580301 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1152/2303] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:47:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:47:30.588713 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c17efc77-d92d-4d77-b7f5-c784f133b1e3 tempest-LiveMigrationNegativeTest-317868421 tempest-LiveMigrationNegativeTest-317868421-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:30.590344 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c17efc77-d92d-4d77-b7f5-c784f133b1e3 tempest-LiveMigrationNegativeTest-317868421 tempest-LiveMigrationNegativeTest-317868421-project-admin] [instance: c937afd2-1699-4699-809d-20cfcead412c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:30.605395 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c17efc77-d92d-4d77-b7f5-c784f133b1e3 tempest-LiveMigrationNegativeTest-317868421 tempest-LiveMigrationNegativeTest-317868421-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:30.605813 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c17efc77-d92d-4d77-b7f5-c784f133b1e3 tempest-LiveMigrationNegativeTest-317868421 tempest-LiveMigrationNegativeTest-317868421-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:30.606187 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c17efc77-d92d-4d77-b7f5-c784f133b1e3 tempest-LiveMigrationNegativeTest-317868421 tempest-LiveMigrationNegativeTest-317868421-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:30.607108 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c17efc77-d92d-4d77-b7f5-c784f133b1e3 tempest-LiveMigrationNegativeTest-317868421 tempest-LiveMigrationNegativeTest-317868421-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:30.608403 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c17efc77-d92d-4d77-b7f5-c784f133b1e3 tempest-LiveMigrationNegativeTest-317868421 tempest-LiveMigrationNegativeTest-317868421-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:30.613191 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c17efc77-d92d-4d77-b7f5-c784f133b1e3 tempest-LiveMigrationNegativeTest-317868421 tempest-LiveMigrationNegativeTest-317868421-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:30.725719 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4e0566c1-f3c3-4560-ab95-a8a73c59023a tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:30.740797 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4e0566c1-f3c3-4560-ab95-a8a73c59023a tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e" status: 200 len: 1472 microversion: 2.1 time: 0.224436 Sep 08 10:47:30.741662 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1152/2304] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:30 2022] GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e => generated 1472 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:30.747924 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5228833e-f57d-43ee-b49a-ae4522d80186 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:30.749569 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5228833e-f57d-43ee-b49a-ae4522d80186 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] [instance: 4703a7bf-a1ba-4bba-8928-3c403f3f3f21] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:30.771885 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5228833e-f57d-43ee-b49a-ae4522d80186 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:30.772405 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5228833e-f57d-43ee-b49a-ae4522d80186 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:30.772863 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5228833e-f57d-43ee-b49a-ae4522d80186 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:30.781488 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5228833e-f57d-43ee-b49a-ae4522d80186 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:30.782142 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5228833e-f57d-43ee-b49a-ae4522d80186 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:30.782609 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5228833e-f57d-43ee-b49a-ae4522d80186 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:30.918609 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5228833e-f57d-43ee-b49a-ae4522d80186 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528fc9fbb57149c9a9c755c6497f5c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effe8e6c23114b8ab80e76bec365de60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:30.940617 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5228833e-f57d-43ee-b49a-ae4522d80186 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] 10.222.0.27 "GET /compute/v2.1/servers/4703a7bf-a1ba-4bba-8928-3c403f3f3f21" status: 200 len: 1237 microversion: 2.1 time: 0.197342 Sep 08 10:47:30.958920 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1153/2305] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:30 2022] GET /compute/v2.1/servers/4703a7bf-a1ba-4bba-8928-3c403f3f3f21 => generated 1237 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:30.984083 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-19c38471-e609-418c-98ad-b42068ce8158 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:30.985849 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-19c38471-e609-418c-98ad-b42068ce8158 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 23007ef9-a0d3-42ff-b687-0f53086c8bcb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:30.995347 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-19c38471-e609-418c-98ad-b42068ce8158 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:30.996279 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-19c38471-e609-418c-98ad-b42068ce8158 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:30.997166 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-19c38471-e609-418c-98ad-b42068ce8158 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:30.998892 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-19c38471-e609-418c-98ad-b42068ce8158 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:30.999977 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-19c38471-e609-418c-98ad-b42068ce8158 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:31.000746 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-19c38471-e609-418c-98ad-b42068ce8158 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:31.215662 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-19c38471-e609-418c-98ad-b42068ce8158 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:31.225535 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-19c38471-e609-418c-98ad-b42068ce8158 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/23007ef9-a0d3-42ff-b687-0f53086c8bcb" status: 200 len: 1315 microversion: 2.1 time: 0.265013 Sep 08 10:47:31.233519 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1154/2306] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:30 2022] GET /compute/v2.1/servers/23007ef9-a0d3-42ff-b687-0f53086c8bcb => generated 1315 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:31.243527 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-019e1f46-c406-431c-b287-fed9e5c4ffdf tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:31.246662 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-019e1f46-c406-431c-b287-fed9e5c4ffdf tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: e052494d-6c34-4e3a-adac-4c7ed14f87c9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:31.262077 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-019e1f46-c406-431c-b287-fed9e5c4ffdf tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:31.266955 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-019e1f46-c406-431c-b287-fed9e5c4ffdf tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:31.270698 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-019e1f46-c406-431c-b287-fed9e5c4ffdf tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:31.271506 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-019e1f46-c406-431c-b287-fed9e5c4ffdf tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:31.271983 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-019e1f46-c406-431c-b287-fed9e5c4ffdf tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:31.272417 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-019e1f46-c406-431c-b287-fed9e5c4ffdf tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:31.640612 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-019e1f46-c406-431c-b287-fed9e5c4ffdf tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:31.651408 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-019e1f46-c406-431c-b287-fed9e5c4ffdf tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/e052494d-6c34-4e3a-adac-4c7ed14f87c9" status: 200 len: 1493 microversion: 2.1 time: 0.416461 Sep 08 10:47:31.654191 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1155/2307] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:31 2022] GET /compute/v2.1/servers/e052494d-6c34-4e3a-adac-4c7ed14f87c9 => generated 1493 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:31.722575 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c17efc77-d92d-4d77-b7f5-c784f133b1e3 tempest-LiveMigrationNegativeTest-317868421 tempest-LiveMigrationNegativeTest-317868421-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/c937afd2-1699-4699-809d-20cfcead412c" status: 200 len: 1613 microversion: 2.1 time: 1.137926 Sep 08 10:47:31.726940 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1153/2308] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:30 2022] GET /compute/v2.1/servers/c937afd2-1699-4699-809d-20cfcead412c => generated 1613 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:31.754000 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f3b46dc4-2410-4518-a06c-7ec7318624b5 tempest-LiveMigrationNegativeTest-317868421 tempest-LiveMigrationNegativeTest-317868421-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:31.759966 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f3b46dc4-2410-4518-a06c-7ec7318624b5 tempest-LiveMigrationNegativeTest-317868421 tempest-LiveMigrationNegativeTest-317868421-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:31.762139 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f3b46dc4-2410-4518-a06c-7ec7318624b5 tempest-LiveMigrationNegativeTest-317868421 tempest-LiveMigrationNegativeTest-317868421-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:31.762139 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f3b46dc4-2410-4518-a06c-7ec7318624b5 tempest-LiveMigrationNegativeTest-317868421 tempest-LiveMigrationNegativeTest-317868421-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:31.764996 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f3b46dc4-2410-4518-a06c-7ec7318624b5 tempest-LiveMigrationNegativeTest-317868421 tempest-LiveMigrationNegativeTest-317868421-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:31.765516 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f3b46dc4-2410-4518-a06c-7ec7318624b5 tempest-LiveMigrationNegativeTest-317868421 tempest-LiveMigrationNegativeTest-317868421-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:31.773527 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-897e02dd-f1d1-411a-b26d-482de9e651ec tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:31.777610 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-897e02dd-f1d1-411a-b26d-482de9e651ec tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: 3766b195-ace4-4563-a24e-dca72941251e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:31.790237 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f3b46dc4-2410-4518-a06c-7ec7318624b5 tempest-LiveMigrationNegativeTest-317868421 tempest-LiveMigrationNegativeTest-317868421-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:31.796655 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-897e02dd-f1d1-411a-b26d-482de9e651ec tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:31.797766 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-897e02dd-f1d1-411a-b26d-482de9e651ec tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:31.798234 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-897e02dd-f1d1-411a-b26d-482de9e651ec tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:31.802714 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-897e02dd-f1d1-411a-b26d-482de9e651ec tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:31.806448 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-897e02dd-f1d1-411a-b26d-482de9e651ec tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:31.807095 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-897e02dd-f1d1-411a-b26d-482de9e651ec tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:31.833107 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f3b46dc4-2410-4518-a06c-7ec7318624b5 tempest-LiveMigrationNegativeTest-317868421 tempest-LiveMigrationNegativeTest-317868421-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.083455 Sep 08 10:47:31.833744 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1156/2309] 10.222.0.27 () {58 vars in 1176 bytes} [Thu Sep 8 10:47:31 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:47:31.849513 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c99dbfa0-64e1-4a0b-a5b0-e624fc0f79a8 tempest-LiveMigrationNegativeTest-317868421 tempest-LiveMigrationNegativeTest-317868421-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-850501-12", "block_migration": true, "disk_over_commit": false}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:47:31.852832 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c99dbfa0-64e1-4a0b-a5b0-e624fc0f79a8 tempest-LiveMigrationNegativeTest-317868421 tempest-LiveMigrationNegativeTest-317868421-project-admin] [instance: c937afd2-1699-4699-809d-20cfcead412c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:31.862092 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c99dbfa0-64e1-4a0b-a5b0-e624fc0f79a8 tempest-LiveMigrationNegativeTest-317868421 tempest-LiveMigrationNegativeTest-317868421-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:31.863547 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c99dbfa0-64e1-4a0b-a5b0-e624fc0f79a8 tempest-LiveMigrationNegativeTest-317868421 tempest-LiveMigrationNegativeTest-317868421-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:31.864084 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c99dbfa0-64e1-4a0b-a5b0-e624fc0f79a8 tempest-LiveMigrationNegativeTest-317868421 tempest-LiveMigrationNegativeTest-317868421-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:31.865075 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c99dbfa0-64e1-4a0b-a5b0-e624fc0f79a8 tempest-LiveMigrationNegativeTest-317868421 tempest-LiveMigrationNegativeTest-317868421-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:31.865736 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c99dbfa0-64e1-4a0b-a5b0-e624fc0f79a8 tempest-LiveMigrationNegativeTest-317868421 tempest-LiveMigrationNegativeTest-317868421-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:31.866668 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c99dbfa0-64e1-4a0b-a5b0-e624fc0f79a8 tempest-LiveMigrationNegativeTest-317868421 tempest-LiveMigrationNegativeTest-317868421-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:31.907790 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-c99dbfa0-64e1-4a0b-a5b0-e624fc0f79a8 tempest-LiveMigrationNegativeTest-317868421 tempest-LiveMigrationNegativeTest-317868421-project-admin] Lazy-loading 'flavor' on Instance uuid c937afd2-1699-4699-809d-20cfcead412c {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:47:31.918990 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:47:31.934007 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-c99dbfa0-64e1-4a0b-a5b0-e624fc0f79a8 tempest-LiveMigrationNegativeTest-317868421 tempest-LiveMigrationNegativeTest-317868421-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance c937afd2-1699-4699-809d-20cfcead412c while it is in vm_state suspended Sep 08 10:47:31.938620 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c99dbfa0-64e1-4a0b-a5b0-e624fc0f79a8 tempest-LiveMigrationNegativeTest-317868421 tempest-LiveMigrationNegativeTest-317868421-project-admin] Request method failure captured: Sep 08 10:47:31.938620 n-d-850501-12 devstack@n-api.service[128862]: request: POST /compute/v2.1/servers/c937afd2-1699-4699-809d-20cfcead412c/action HTTP/1.1 Sep 08 10:47:31.938620 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:47:31.938620 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:47:31.938620 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:47:31.938620 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 98 Sep 08 10:47:31.938620 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:47:31.938620 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:47:31.938620 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:47:31.938620 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:47:31.938620 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcgY56IllxMl8Z9zdzY820RX5UUdBVxbalCTFA3X70KUTmxwzxJLYA623fAuqPF3t7s9fApQU1mahyLTgmM3Rdyp_Tevfbz0lHNIHGPH1DJd7jKs2d7Hmssv2itwsmZvw4m2s9WRE1bOq9QQOGRtXi0-K2ma__siqmh6A-2iGh2wDnk Sep 08 10:47:31.938620 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:47:31.938620 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:47:31.938620 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:47:31.938620 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:47:31.938620 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:47:31.938620 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:47:31.938620 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 86ac5a8772494672b8ed15db1ebed0a8 Sep 08 10:47:31.938620 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-LiveMigrationNegativeTest-317868421 Sep 08 10:47:31.938620 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,admin,member Sep 08 10:47:31.938620 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,admin,member Sep 08 10:47:31.938620 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/86ac5a8772494672b8ed15db1ebed0a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/86ac5a8772494672b8ed15db1ebed0a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_86ac5a8772494672b8ed15db1ebed0a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/86ac5a8772494672b8ed15db1ebed0a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:47:31.938620 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-LiveMigrationNegativeTest-317868421 Sep 08 10:47:31.938620 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 86ac5a8772494672b8ed15db1ebed0a8 Sep 08 10:47:31.938620 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-317868421 Sep 08 10:47:31.938620 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-LiveMigrationNegativeTest-317868421-project-admin Sep 08 10:47:31.938620 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:47:31.938620 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:47:31.938620 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 8a4c775129e44f7795e275761e2c5396 Sep 08 10:47:31.938620 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-LiveMigrationNegativeTest-317868421-project-admin Sep 08 10:47:31.938620 n-d-850501-12 devstack@n-api.service[128862]: Sep 08 10:47:31.938620 n-d-850501-12 devstack@n-api.service[128862]: {"os-migrateLive": {"host": "n-h1-850501-12", "block_migration": true, "disk_over_commit": false}} Sep 08 10:47:31.938620 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:47:31.938620 n-d-850501-12 devstack@n-api.service[128862]: exception: Cannot 'os-migrateLive' instance c937afd2-1699-4699-809d-20cfcead412c while it is in vm_state suspended Sep 08 10:47:31.938620 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'c937afd2-1699-4699-809d-20cfcead412c', 'body': {'os-migrateLive': {'host': 'n-h1-850501-12', 'block_migration': True, 'disk_over_commit': False}}} Sep 08 10:47:31.938620 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:47:31.938620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:31.938620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Sep 08 10:47:31.938620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Sep 08 10:47:31.938620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 08 10:47:31.938620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 10:47:31.938620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 08 10:47:31.938620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 08 10:47:31.938620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 08 10:47:31.938620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 08 10:47:31.938620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 08 10:47:31.938620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 08 10:47:31.938620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 08 10:47:31.938620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 08 10:47:31.938620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Sep 08 10:47:31.938620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 08 10:47:31.938620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 10:47:31.938620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 10:47:31.938620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 08 10:47:31.938620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 08 10:47:31.938620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c937afd2-1699-4699-809d-20cfcead412c in vm_state suspended. Cannot live_migrate while the instance is in this state. Sep 08 10:47:31.938620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:31.938620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:31.938620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:31.938620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:31.938620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:47:31.942617 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:47:31.942617 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:47:31.942617 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:47:31.942617 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:47:31.942617 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:47:31.942617 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:47:31.942617 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:47:31.942617 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:47:31.942617 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:47:31.942617 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:47:31.942617 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:47:31.942617 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 08 10:47:31.942617 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Sep 08 10:47:31.942617 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 08 10:47:31.942617 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 08 10:47:31.942617 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 08 10:47:31.942617 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance c937afd2-1699-4699-809d-20cfcead412c while it is in vm_state suspended Sep 08 10:47:31.942617 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:31.942617 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:31.942617 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:31.942617 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:31.942617 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:47:31.942617 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:47:31.942617 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:47:31.942617 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:47:31.942617 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance c937afd2-1699-4699-809d-20cfcead412c while it is in vm_state suspended Sep 08 10:47:31.942617 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:31.946804 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c99dbfa0-64e1-4a0b-a5b0-e624fc0f79a8 tempest-LiveMigrationNegativeTest-317868421 tempest-LiveMigrationNegativeTest-317868421-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance c937afd2-1699-4699-809d-20cfcead412c while it is in vm_state suspended {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:47:31.947853 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c99dbfa0-64e1-4a0b-a5b0-e624fc0f79a8 tempest-LiveMigrationNegativeTest-317868421 tempest-LiveMigrationNegativeTest-317868421-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/c937afd2-1699-4699-809d-20cfcead412c/action" status: 409 len: 155 microversion: 2.1 time: 0.103953 Sep 08 10:47:31.948587 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1157/2310] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:47:31 2022] POST /compute/v2.1/servers/c937afd2-1699-4699-809d-20cfcead412c/action => generated 155 bytes in 106 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:47:31.963949 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0a319d00-7199-4a89-a6aa-3c2e82bdd3f6 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:31.964980 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0a319d00-7199-4a89-a6aa-3c2e82bdd3f6 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] [instance: c937afd2-1699-4699-809d-20cfcead412c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:31.983034 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0a319d00-7199-4a89-a6aa-3c2e82bdd3f6 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:31.984522 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0a319d00-7199-4a89-a6aa-3c2e82bdd3f6 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:31.985302 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0a319d00-7199-4a89-a6aa-3c2e82bdd3f6 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:31.986211 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0a319d00-7199-4a89-a6aa-3c2e82bdd3f6 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:31.987741 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0a319d00-7199-4a89-a6aa-3c2e82bdd3f6 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:31.988238 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0a319d00-7199-4a89-a6aa-3c2e82bdd3f6 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:32.076399 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0a319d00-7199-4a89-a6aa-3c2e82bdd3f6 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] [instance: c937afd2-1699-4699-809d-20cfcead412c] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:47:32.226552 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0a319d00-7199-4a89-a6aa-3c2e82bdd3f6 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c937afd2-1699-4699-809d-20cfcead412c" status: 204 len: 0 microversion: 2.1 time: 0.268129 Sep 08 10:47:32.232619 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1158/2311] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:47:31 2022] DELETE /compute/v2.1/servers/c937afd2-1699-4699-809d-20cfcead412c => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:47:32.251629 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-06a312ed-0ba8-4690-89b1-add3698a8550 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:32.255412 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-06a312ed-0ba8-4690-89b1-add3698a8550 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] [instance: 4703a7bf-a1ba-4bba-8928-3c403f3f3f21] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:32.273756 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-06a312ed-0ba8-4690-89b1-add3698a8550 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:32.274892 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-06a312ed-0ba8-4690-89b1-add3698a8550 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:32.280479 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-06a312ed-0ba8-4690-89b1-add3698a8550 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:32.281568 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-06a312ed-0ba8-4690-89b1-add3698a8550 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:32.282253 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-06a312ed-0ba8-4690-89b1-add3698a8550 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:32.282877 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-06a312ed-0ba8-4690-89b1-add3698a8550 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:32.331813 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-897e02dd-f1d1-411a-b26d-482de9e651ec tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:32.340712 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-897e02dd-f1d1-411a-b26d-482de9e651ec tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e" status: 200 len: 1472 microversion: 2.1 time: 0.576648 Sep 08 10:47:32.344884 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1154/2312] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:31 2022] GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e => generated 1472 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:32.362670 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2317f4e6-5fb2-407e-8a03-bbc2473f061c tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:32.363312 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2317f4e6-5fb2-407e-8a03-bbc2473f061c tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] [instance: c937afd2-1699-4699-809d-20cfcead412c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:32.380997 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2317f4e6-5fb2-407e-8a03-bbc2473f061c tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:32.389286 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2317f4e6-5fb2-407e-8a03-bbc2473f061c tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:32.389789 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2317f4e6-5fb2-407e-8a03-bbc2473f061c tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:32.390688 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2317f4e6-5fb2-407e-8a03-bbc2473f061c tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:32.391164 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2317f4e6-5fb2-407e-8a03-bbc2473f061c tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:32.391599 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2317f4e6-5fb2-407e-8a03-bbc2473f061c tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:32.767285 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-06a312ed-0ba8-4690-89b1-add3698a8550 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528fc9fbb57149c9a9c755c6497f5c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effe8e6c23114b8ab80e76bec365de60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:32.799900 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-06a312ed-0ba8-4690-89b1-add3698a8550 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] 10.222.0.27 "GET /compute/v2.1/servers/4703a7bf-a1ba-4bba-8928-3c403f3f3f21" status: 200 len: 1304 microversion: 2.1 time: 0.561958 Sep 08 10:47:32.800808 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1159/2313] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:32 2022] GET /compute/v2.1/servers/4703a7bf-a1ba-4bba-8928-3c403f3f3f21 => generated 1304 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:32.820916 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cf3e2e3f-44f0-44b6-9abb-8c34208dc650 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:32.821582 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cf3e2e3f-44f0-44b6-9abb-8c34208dc650 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 23007ef9-a0d3-42ff-b687-0f53086c8bcb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:32.833951 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cf3e2e3f-44f0-44b6-9abb-8c34208dc650 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:32.834451 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cf3e2e3f-44f0-44b6-9abb-8c34208dc650 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:32.838490 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cf3e2e3f-44f0-44b6-9abb-8c34208dc650 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:32.844235 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cf3e2e3f-44f0-44b6-9abb-8c34208dc650 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:32.844742 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cf3e2e3f-44f0-44b6-9abb-8c34208dc650 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:32.847271 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cf3e2e3f-44f0-44b6-9abb-8c34208dc650 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:32.876846 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2317f4e6-5fb2-407e-8a03-bbc2473f061c tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416642c1ee664b4d9e0fb14d02266b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cfab473734f4b63aaa78508ef460a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:32.894941 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2317f4e6-5fb2-407e-8a03-bbc2473f061c tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] 10.222.0.27 "GET /compute/v2.1/servers/c937afd2-1699-4699-809d-20cfcead412c" status: 200 len: 1466 microversion: 2.1 time: 0.548903 Sep 08 10:47:32.895787 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1155/2314] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:32 2022] GET /compute/v2.1/servers/c937afd2-1699-4699-809d-20cfcead412c => generated 1466 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:33.148902 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cf3e2e3f-44f0-44b6-9abb-8c34208dc650 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:33.161616 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cf3e2e3f-44f0-44b6-9abb-8c34208dc650 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/23007ef9-a0d3-42ff-b687-0f53086c8bcb" status: 200 len: 1315 microversion: 2.1 time: 0.346849 Sep 08 10:47:33.180890 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1160/2315] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:32 2022] GET /compute/v2.1/servers/23007ef9-a0d3-42ff-b687-0f53086c8bcb => generated 1315 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:33.186856 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-29dc2c3f-96a5-4ff8-97f9-66b9b85a27ad tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:33.187494 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-29dc2c3f-96a5-4ff8-97f9-66b9b85a27ad tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: e052494d-6c34-4e3a-adac-4c7ed14f87c9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:33.194079 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-29dc2c3f-96a5-4ff8-97f9-66b9b85a27ad tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:33.195798 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-29dc2c3f-96a5-4ff8-97f9-66b9b85a27ad tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:33.195798 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-29dc2c3f-96a5-4ff8-97f9-66b9b85a27ad tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:33.195798 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-29dc2c3f-96a5-4ff8-97f9-66b9b85a27ad tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:33.196272 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-29dc2c3f-96a5-4ff8-97f9-66b9b85a27ad tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:33.196569 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-29dc2c3f-96a5-4ff8-97f9-66b9b85a27ad tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:33.226993 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-9fae2751-c733-4575-a4d4-996da0d885e3 req-903099e0-3095-46c2-9bbe-9c91c8ca7a27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e052494d-6c34-4e3a-adac-4c7ed14f87c9", "name": "network-vif-deleted", "tag": "0c1068a7-4057-4dd1-a50f-10422d722659"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:47:33.236022 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-29dc2c3f-96a5-4ff8-97f9-66b9b85a27ad tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:33.236830 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-29dc2c3f-96a5-4ff8-97f9-66b9b85a27ad tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:33.237346 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-29dc2c3f-96a5-4ff8-97f9-66b9b85a27ad tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:33.237914 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-29dc2c3f-96a5-4ff8-97f9-66b9b85a27ad tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lazy-loading 'fault' on Instance uuid e052494d-6c34-4e3a-adac-4c7ed14f87c9 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:47:33.238071 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-9fae2751-c733-4575-a4d4-996da0d885e3 req-903099e0-3095-46c2-9bbe-9c91c8ca7a27 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:33.238531 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-9fae2751-c733-4575-a4d4-996da0d885e3 req-903099e0-3095-46c2-9bbe-9c91c8ca7a27 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:33.238946 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-9fae2751-c733-4575-a4d4-996da0d885e3 req-903099e0-3095-46c2-9bbe-9c91c8ca7a27 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:33.256651 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-9fae2751-c733-4575-a4d4-996da0d885e3 req-903099e0-3095-46c2-9bbe-9c91c8ca7a27 service nova] Creating event network-vif-deleted:0c1068a7-4057-4dd1-a50f-10422d722659 for instance e052494d-6c34-4e3a-adac-4c7ed14f87c9 on n-h1-850501-12 Sep 08 10:47:33.262188 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-9fae2751-c733-4575-a4d4-996da0d885e3 req-903099e0-3095-46c2-9bbe-9c91c8ca7a27 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.364720 Sep 08 10:47:33.262909 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1156/2316] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:47:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:47:33.294681 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-29dc2c3f-96a5-4ff8-97f9-66b9b85a27ad tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8c8c85354d46aeb786c8049b81e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb450420314221bd2469816e2995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:33.304082 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-29dc2c3f-96a5-4ff8-97f9-66b9b85a27ad tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/e052494d-6c34-4e3a-adac-4c7ed14f87c9" status: 200 len: 1297 microversion: 2.1 time: 0.121737 Sep 08 10:47:33.304688 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1161/2317] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:33 2022] GET /compute/v2.1/servers/e052494d-6c34-4e3a-adac-4c7ed14f87c9 => generated 1297 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:33.369739 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2917b804-c8e6-4c72-b428-e82c328ab159 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:33.370391 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2917b804-c8e6-4c72-b428-e82c328ab159 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: 3766b195-ace4-4563-a24e-dca72941251e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:33.382096 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2917b804-c8e6-4c72-b428-e82c328ab159 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:33.384311 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2917b804-c8e6-4c72-b428-e82c328ab159 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:33.386374 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2917b804-c8e6-4c72-b428-e82c328ab159 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:33.388644 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2917b804-c8e6-4c72-b428-e82c328ab159 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:33.389991 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2917b804-c8e6-4c72-b428-e82c328ab159 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:33.390811 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2917b804-c8e6-4c72-b428-e82c328ab159 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:33.436844 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f7074c8e-4b09-4101-b05f-23ad7aa0ffdc tempest-SecurityGroupsTestAdminJSON-618746154 tempest-SecurityGroupsTestAdminJSON-618746154-project] Action: 'create', calling method: .version_select at 0x7f68e4a32ca0>, body: {"security_group": {"name": "tempest-securitygroup-374112723", "description": "tempest-description-850737151"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:47:33.622852 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2917b804-c8e6-4c72-b428-e82c328ab159 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:33.636325 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2917b804-c8e6-4c72-b428-e82c328ab159 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e" status: 200 len: 1472 microversion: 2.1 time: 0.267928 Sep 08 10:47:33.639226 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1162/2318] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:33 2022] GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e => generated 1472 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:47:33.828309 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c1e0e460-2298-44d8-97a0-20e024b90002 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:33.829243 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c1e0e460-2298-44d8-97a0-20e024b90002 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] [instance: 4703a7bf-a1ba-4bba-8928-3c403f3f3f21] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:33.837638 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c1e0e460-2298-44d8-97a0-20e024b90002 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:33.839151 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c1e0e460-2298-44d8-97a0-20e024b90002 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:33.839750 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c1e0e460-2298-44d8-97a0-20e024b90002 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:33.840868 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c1e0e460-2298-44d8-97a0-20e024b90002 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:33.841962 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c1e0e460-2298-44d8-97a0-20e024b90002 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:33.842659 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c1e0e460-2298-44d8-97a0-20e024b90002 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:34.097529 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f7074c8e-4b09-4101-b05f-23ad7aa0ffdc tempest-SecurityGroupsTestAdminJSON-618746154 tempest-SecurityGroupsTestAdminJSON-618746154-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.832439 Sep 08 10:47:34.115406 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1157/2319] 10.222.0.27 () {60 vars in 1180 bytes} [Thu Sep 8 10:47:33 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:47:34.125082 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-097b3c14-865d-46d5-bd66-0275d9b37283 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:34.131923 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-097b3c14-865d-46d5-bd66-0275d9b37283 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] [instance: c937afd2-1699-4699-809d-20cfcead412c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:34.147393 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-097b3c14-865d-46d5-bd66-0275d9b37283 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:34.148541 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-097b3c14-865d-46d5-bd66-0275d9b37283 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:34.150335 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-097b3c14-865d-46d5-bd66-0275d9b37283 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:34.151307 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-097b3c14-865d-46d5-bd66-0275d9b37283 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:34.152142 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-097b3c14-865d-46d5-bd66-0275d9b37283 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:34.153423 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-097b3c14-865d-46d5-bd66-0275d9b37283 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:34.166710 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c1e0e460-2298-44d8-97a0-20e024b90002 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528fc9fbb57149c9a9c755c6497f5c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effe8e6c23114b8ab80e76bec365de60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:34.184544 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c1e0e460-2298-44d8-97a0-20e024b90002 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] 10.222.0.27 "GET /compute/v2.1/servers/4703a7bf-a1ba-4bba-8928-3c403f3f3f21" status: 200 len: 1304 microversion: 2.1 time: 0.360138 Sep 08 10:47:34.188714 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1163/2320] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:33 2022] GET /compute/v2.1/servers/4703a7bf-a1ba-4bba-8928-3c403f3f3f21 => generated 1304 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:47:34.206423 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8ba61a35-3d35-4454-8a26-35db0045d3d4 tempest-SecurityGroupsTestAdminJSON-618746154 tempest-SecurityGroupsTestAdminJSON-618746154-project] Action: 'create', calling method: .version_select at 0x7f68e8af0af0>, body: {"security_group": {"name": "tempest-securitygroup-2132756184", "description": "tempest-description-1807611696"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:47:34.505788 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-097b3c14-865d-46d5-bd66-0275d9b37283 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416642c1ee664b4d9e0fb14d02266b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cfab473734f4b63aaa78508ef460a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:34.523482 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-097b3c14-865d-46d5-bd66-0275d9b37283 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] 10.222.0.27 "GET /compute/v2.1/servers/c937afd2-1699-4699-809d-20cfcead412c" status: 200 len: 1466 microversion: 2.1 time: 0.403496 Sep 08 10:47:34.528788 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1158/2321] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:34 2022] GET /compute/v2.1/servers/c937afd2-1699-4699-809d-20cfcead412c => generated 1466 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:34.543548 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-84dc39ec-55c1-4ca7-a14f-5247ddbde549 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:34.544284 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-84dc39ec-55c1-4ca7-a14f-5247ddbde549 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 23007ef9-a0d3-42ff-b687-0f53086c8bcb] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:34.560262 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-84dc39ec-55c1-4ca7-a14f-5247ddbde549 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:34.561395 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-84dc39ec-55c1-4ca7-a14f-5247ddbde549 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:34.562343 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-84dc39ec-55c1-4ca7-a14f-5247ddbde549 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:34.567319 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-84dc39ec-55c1-4ca7-a14f-5247ddbde549 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:34.568563 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-84dc39ec-55c1-4ca7-a14f-5247ddbde549 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:34.569481 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-84dc39ec-55c1-4ca7-a14f-5247ddbde549 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:34.581942 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8ba61a35-3d35-4454-8a26-35db0045d3d4 tempest-SecurityGroupsTestAdminJSON-618746154 tempest-SecurityGroupsTestAdminJSON-618746154-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.391877 Sep 08 10:47:34.582882 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1164/2322] 10.222.0.27 () {60 vars in 1180 bytes} [Thu Sep 8 10:47:34 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:47:34.603660 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a2dc5b17-e8ce-4e1f-9fb9-b446587eb3f2 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:34.606200 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a2dc5b17-e8ce-4e1f-9fb9-b446587eb3f2 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: e052494d-6c34-4e3a-adac-4c7ed14f87c9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:34.646804 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2dc5b17-e8ce-4e1f-9fb9-b446587eb3f2 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:34.647556 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2dc5b17-e8ce-4e1f-9fb9-b446587eb3f2 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:34.648229 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2dc5b17-e8ce-4e1f-9fb9-b446587eb3f2 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:34.650688 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2dc5b17-e8ce-4e1f-9fb9-b446587eb3f2 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:34.651512 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2dc5b17-e8ce-4e1f-9fb9-b446587eb3f2 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:34.653233 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2dc5b17-e8ce-4e1f-9fb9-b446587eb3f2 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:34.711863 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-a2dc5b17-e8ce-4e1f-9fb9-b446587eb3f2 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] HTTP exception thrown: Instance e052494d-6c34-4e3a-adac-4c7ed14f87c9 could not be found. Sep 08 10:47:34.720620 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a2dc5b17-e8ce-4e1f-9fb9-b446587eb3f2 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Request method failure captured: Sep 08 10:47:34.720620 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/e052494d-6c34-4e3a-adac-4c7ed14f87c9 HTTP/1.1 Sep 08 10:47:34.720620 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:47:34.720620 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:47:34.720620 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:47:34.720620 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:47:34.720620 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:47:34.720620 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:47:34.720620 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:47:34.720620 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:47:34.720620 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcc0sSj3x0sBidV4prTXv00UAP3lriFd9bSf6ARsE1ekKVmlGukpstC35qUsWPJmY1lsjsjExO-iqH_QnZHhexPCbL7rQ87usxEHhLxbNbIFKv-QG5rcjHdmQtO5f0_wSj_rlzeH-S-tFvmDK4BhyOKoPTI_CkViDwssV_47VejAgTw Sep 08 10:47:34.720620 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:47:34.720620 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:47:34.720620 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:47:34.720620 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:47:34.720620 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:47:34.720620 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:47:34.720620 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: eeeb450420314221bd2469816e2995d1 Sep 08 10:47:34.720620 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ImagesTestJSON-2041705293 Sep 08 10:47:34.720620 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:47:34.720620 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:47:34.720620 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/eeeb450420314221bd2469816e2995d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eeeb450420314221bd2469816e2995d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_eeeb450420314221bd2469816e2995d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eeeb450420314221bd2469816e2995d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:47:34.720620 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ImagesTestJSON-2041705293 Sep 08 10:47:34.720620 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: eeeb450420314221bd2469816e2995d1 Sep 08 10:47:34.720620 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ImagesTestJSON-2041705293 Sep 08 10:47:34.720620 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ImagesTestJSON-2041705293-project Sep 08 10:47:34.720620 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:47:34.720620 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:47:34.720620 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: ce8c8c85354d46aeb786c8049b81e04d Sep 08 10:47:34.720620 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ImagesTestJSON-2041705293-project Sep 08 10:47:34.720620 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:47:34.720620 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance e052494d-6c34-4e3a-adac-4c7ed14f87c9 could not be found. Sep 08 10:47:34.720620 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'e052494d-6c34-4e3a-adac-4c7ed14f87c9'} Sep 08 10:47:34.720620 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:47:34.720620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:34.720620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:47:34.720620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:47:34.720620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:47:34.720620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:47:34.720620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:47:34.720620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:47:34.720620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:47:34.720620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:47:34.720620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e052494d-6c34-4e3a-adac-4c7ed14f87c9 could not be found. Sep 08 10:47:34.720620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:34.720620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:34.720620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:34.720620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:34.720620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:47:34.720620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:47:34.720620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:47:34.720620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:47:34.720620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:47:34.720620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:47:34.720620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:47:34.720620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:47:34.720620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:47:34.720620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:47:34.720620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:47:34.720620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:47:34.720620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e052494d-6c34-4e3a-adac-4c7ed14f87c9 could not be found. Sep 08 10:47:34.720620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:34.720620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:34.720620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:34.720620 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:34.726813 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:47:34.726813 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:47:34.726813 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:47:34.726813 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:47:34.726813 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e052494d-6c34-4e3a-adac-4c7ed14f87c9 could not be found. Sep 08 10:47:34.726813 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:34.730060 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a2dc5b17-e8ce-4e1f-9fb9-b446587eb3f2 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Returning 404 to user: Instance e052494d-6c34-4e3a-adac-4c7ed14f87c9 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:47:34.731144 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a2dc5b17-e8ce-4e1f-9fb9-b446587eb3f2 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/e052494d-6c34-4e3a-adac-4c7ed14f87c9" status: 404 len: 111 microversion: 2.1 time: 0.147127 Sep 08 10:47:34.733863 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1165/2323] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:34 2022] GET /compute/v2.1/servers/e052494d-6c34-4e3a-adac-4c7ed14f87c9 => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:47:34.740865 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2ef28f38-dd77-4883-95eb-54f5e6d5f848 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:34.746018 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2ef28f38-dd77-4883-95eb-54f5e6d5f848 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: bace4c1a-2c38-42b3-962d-ca87a3bfb7ba] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:34.762599 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2ef28f38-dd77-4883-95eb-54f5e6d5f848 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:34.764877 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2ef28f38-dd77-4883-95eb-54f5e6d5f848 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:34.774158 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2ef28f38-dd77-4883-95eb-54f5e6d5f848 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:34.775197 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2ef28f38-dd77-4883-95eb-54f5e6d5f848 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:34.777222 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2ef28f38-dd77-4883-95eb-54f5e6d5f848 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:34.777829 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2ef28f38-dd77-4883-95eb-54f5e6d5f848 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:34.859690 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2ef28f38-dd77-4883-95eb-54f5e6d5f848 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/bace4c1a-2c38-42b3-962d-ca87a3bfb7ba/ips" status: 200 len: 149 microversion: 2.1 time: 0.124185 Sep 08 10:47:34.869317 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1166/2324] 10.222.0.27 () {58 vars in 1248 bytes} [Thu Sep 8 10:47:34 2022] GET /compute/v2.1/servers/bace4c1a-2c38-42b3-962d-ca87a3bfb7ba/ips => generated 149 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:47:35.000104 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-805a4027-c5b6-4ffb-89a8-9b2d52cc2e9e tempest-SecurityGroupsTestAdminJSON-759946194 tempest-SecurityGroupsTestAdminJSON-759946194-project-admin] Action: 'create', calling method: .version_select at 0x7f68e89131f0>, body: {"security_group": {"name": "tempest-securitygroup-649462964", "description": "tempest-description-194649179"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:47:35.053582 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-84dc39ec-55c1-4ca7-a14f-5247ddbde549 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:35.072599 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-84dc39ec-55c1-4ca7-a14f-5247ddbde549 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/23007ef9-a0d3-42ff-b687-0f53086c8bcb" status: 200 len: 1315 microversion: 2.1 time: 0.541515 Sep 08 10:47:35.078608 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1159/2325] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:34 2022] GET /compute/v2.1/servers/23007ef9-a0d3-42ff-b687-0f53086c8bcb => generated 1315 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:35.097940 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-68c75d3e-3ea7-4c18-8ddc-733e75a3bf93 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:35.098600 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-68c75d3e-3ea7-4c18-8ddc-733e75a3bf93 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: 3766b195-ace4-4563-a24e-dca72941251e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:35.122921 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-68c75d3e-3ea7-4c18-8ddc-733e75a3bf93 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:35.123825 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-68c75d3e-3ea7-4c18-8ddc-733e75a3bf93 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:35.126619 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-68c75d3e-3ea7-4c18-8ddc-733e75a3bf93 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:35.128225 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-68c75d3e-3ea7-4c18-8ddc-733e75a3bf93 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:35.129385 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-68c75d3e-3ea7-4c18-8ddc-733e75a3bf93 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:35.132066 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-68c75d3e-3ea7-4c18-8ddc-733e75a3bf93 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:35.870770 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-68c75d3e-3ea7-4c18-8ddc-733e75a3bf93 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:35.883618 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-68c75d3e-3ea7-4c18-8ddc-733e75a3bf93 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e" status: 200 len: 1472 microversion: 2.1 time: 0.804045 Sep 08 10:47:35.885168 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1160/2326] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:35 2022] GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e => generated 1472 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:35.893784 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-95642583-18db-4579-a917-a2e59ab06428 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '.version_select at 0x7f68e4b65a60>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:35.944822 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-95642583-18db-4579-a917-a2e59ab06428 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] HTTP exception thrown: Image not found. Sep 08 10:47:35.948210 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-95642583-18db-4579-a917-a2e59ab06428 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Request method failure captured: Sep 08 10:47:35.948210 n-d-850501-12 devstack@n-api.service[128861]: request: DELETE /compute/v2.1/images/28783cea-dde6-431e-a46e-b87625b47518 HTTP/1.1 Sep 08 10:47:35.948210 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:47:35.948210 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:47:35.948210 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:47:35.948210 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:47:35.948210 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:47:35.948210 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:47:35.948210 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:47:35.948210 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:47:35.948210 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcc0sSj3x0sBidV4prTXv00UAP3lriFd9bSf6ARsE1ekKVmlGukpstC35qUsWPJmY1lsjsjExO-iqH_QnZHhexPCbL7rQ87usxEHhLxbNbIFKv-QG5rcjHdmQtO5f0_wSj_rlzeH-S-tFvmDK4BhyOKoPTI_CkViDwssV_47VejAgTw Sep 08 10:47:35.948210 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:47:35.948210 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:47:35.948210 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:47:35.948210 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:47:35.948210 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:47:35.948210 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:47:35.948210 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: eeeb450420314221bd2469816e2995d1 Sep 08 10:47:35.948210 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ImagesTestJSON-2041705293 Sep 08 10:47:35.948210 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:47:35.948210 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:47:35.948210 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/eeeb450420314221bd2469816e2995d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eeeb450420314221bd2469816e2995d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_eeeb450420314221bd2469816e2995d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eeeb450420314221bd2469816e2995d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:47:35.948210 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ImagesTestJSON-2041705293 Sep 08 10:47:35.948210 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: eeeb450420314221bd2469816e2995d1 Sep 08 10:47:35.948210 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ImagesTestJSON-2041705293 Sep 08 10:47:35.948210 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ImagesTestJSON-2041705293-project Sep 08 10:47:35.948210 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:47:35.948210 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:47:35.948210 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: ce8c8c85354d46aeb786c8049b81e04d Sep 08 10:47:35.948210 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ImagesTestJSON-2041705293-project Sep 08 10:47:35.948210 n-d-850501-12 devstack@n-api.service[128861]: method: Sep 08 10:47:35.948210 n-d-850501-12 devstack@n-api.service[128861]: exception: Image not found. Sep 08 10:47:35.948210 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '28783cea-dde6-431e-a46e-b87625b47518'} Sep 08 10:47:35.948210 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:47:35.948210 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:35.948210 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 08 10:47:35.948210 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 08 10:47:35.948210 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 10:47:35.948210 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 10:47:35.948210 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 10:47:35.948210 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 10:47:35.948210 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 08 10:47:35.948210 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 08 10:47:35.948210 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 08 10:47:35.948210 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 08 10:47:35.948210 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 10:47:35.948210 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 10:47:35.948210 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 10:47:35.948210 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 10:47:35.948210 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 28783cea-dde6-431e-a46e-b87625b47518 to delete Sep 08 10:47:35.948210 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:35.948210 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:35.948210 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:35.948210 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:35.948210 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 08 10:47:35.948210 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 08 10:47:35.948210 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 08 10:47:35.948210 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 08 10:47:35.948210 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 08 10:47:35.948210 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 08 10:47:35.948210 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 28783cea-dde6-431e-a46e-b87625b47518 could not be found. Sep 08 10:47:35.948210 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:35.948210 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:35.948210 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:35.948210 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:35.953404 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:47:35.953404 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:47:35.953404 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:47:35.953404 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:47:35.953404 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:47:35.953404 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:47:35.953404 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:47:35.953404 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:47:35.953404 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 08 10:47:35.953404 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 08 10:47:35.953404 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 08 10:47:35.953404 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:35.953404 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:35.953404 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:35.953404 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:35.953404 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:47:35.953404 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:47:35.953404 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:47:35.953404 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:47:35.953404 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 08 10:47:35.953404 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:35.953404 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-95642583-18db-4579-a917-a2e59ab06428 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Returning 404 to user: Image not found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:47:35.953404 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-95642583-18db-4579-a917-a2e59ab06428 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "DELETE /compute/v2.1/images/28783cea-dde6-431e-a46e-b87625b47518" status: 404 len: 62 microversion: 2.1 time: 0.063176 Sep 08 10:47:35.957795 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1161/2327] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:35 2022] DELETE /compute/v2.1/images/28783cea-dde6-431e-a46e-b87625b47518 => generated 62 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:47:35.963587 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-55586b08-c054-41a7-98d2-b53d0ecd5255 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:35.964216 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-55586b08-c054-41a7-98d2-b53d0ecd5255 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] [instance: 4703a7bf-a1ba-4bba-8928-3c403f3f3f21] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:36.000198 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-55586b08-c054-41a7-98d2-b53d0ecd5255 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:36.009007 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-55586b08-c054-41a7-98d2-b53d0ecd5255 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:36.009855 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-55586b08-c054-41a7-98d2-b53d0ecd5255 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:36.012252 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-55586b08-c054-41a7-98d2-b53d0ecd5255 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:36.015055 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-55586b08-c054-41a7-98d2-b53d0ecd5255 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:36.016799 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-55586b08-c054-41a7-98d2-b53d0ecd5255 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:36.030213 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-805a4027-c5b6-4ffb-89a8-9b2d52cc2e9e tempest-SecurityGroupsTestAdminJSON-759946194 tempest-SecurityGroupsTestAdminJSON-759946194-project-admin] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 1.159409 Sep 08 10:47:36.031419 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1167/2328] 10.222.0.27 () {60 vars in 1180 bytes} [Thu Sep 8 10:47:34 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:47:36.041275 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-dab901ef-6d75-4400-9830-239139bdbe2b req-e21b219c-429c-47ce-a619-836c94b14415 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4703a7bf-a1ba-4bba-8928-3c403f3f3f21", "tag": "7692ba07-fea3-4d35-b24e-98c3a269cb03"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:47:36.047502 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=5 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:47:36.060464 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-dab901ef-6d75-4400-9830-239139bdbe2b req-e21b219c-429c-47ce-a619-836c94b14415 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:36.060962 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-dab901ef-6d75-4400-9830-239139bdbe2b req-e21b219c-429c-47ce-a619-836c94b14415 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:36.068408 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-dab901ef-6d75-4400-9830-239139bdbe2b req-e21b219c-429c-47ce-a619-836c94b14415 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:36.086096 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-dab901ef-6d75-4400-9830-239139bdbe2b req-e21b219c-429c-47ce-a619-836c94b14415 service nova] Creating event network-changed:7692ba07-fea3-4d35-b24e-98c3a269cb03 for instance 4703a7bf-a1ba-4bba-8928-3c403f3f3f21 on n-h2-850501-12 Sep 08 10:47:36.096883 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-dab901ef-6d75-4400-9830-239139bdbe2b req-e21b219c-429c-47ce-a619-836c94b14415 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062780 Sep 08 10:47:36.100675 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1168/2329] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:47:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:47:36.106626 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-23583275-c4f7-4636-b20e-ebf571c16806 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:36.107466 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-23583275-c4f7-4636-b20e-ebf571c16806 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] [instance: c937afd2-1699-4699-809d-20cfcead412c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:36.115011 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23583275-c4f7-4636-b20e-ebf571c16806 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:36.115512 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23583275-c4f7-4636-b20e-ebf571c16806 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:36.115962 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23583275-c4f7-4636-b20e-ebf571c16806 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:36.116684 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23583275-c4f7-4636-b20e-ebf571c16806 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:36.117357 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23583275-c4f7-4636-b20e-ebf571c16806 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:36.117799 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23583275-c4f7-4636-b20e-ebf571c16806 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:36.135203 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-23583275-c4f7-4636-b20e-ebf571c16806 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] HTTP exception thrown: Instance c937afd2-1699-4699-809d-20cfcead412c could not be found. Sep 08 10:47:36.138840 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-23583275-c4f7-4636-b20e-ebf571c16806 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Request method failure captured: Sep 08 10:47:36.138840 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/c937afd2-1699-4699-809d-20cfcead412c HTTP/1.1 Sep 08 10:47:36.138840 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:47:36.138840 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:47:36.138840 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:47:36.138840 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:47:36.138840 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:47:36.138840 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:47:36.138840 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:47:36.138840 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:47:36.138840 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcgWHS8g8HfDzaCOR6R6omIsB-27l2SkfMDEmK8Ej90qbGG8BruWXQXq3HDTw5GnOnmHs2XMMprhqGeS-qMVHxJGv2bdLnMpi3Q8hAuDnSPAlqqP_PYqIFKMxTyNyLy5nLvA3TUg5iAkloX7pt2JntWkhM9bUJ_i3M8PGtSXwHgCoBM Sep 08 10:47:36.138840 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:47:36.138840 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:47:36.138840 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:47:36.138840 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:47:36.138840 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:47:36.138840 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:47:36.138840 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 7cfab473734f4b63aaa78508ef460a9f Sep 08 10:47:36.138840 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-LiveMigrationNegativeTest-1586069410 Sep 08 10:47:36.138840 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:47:36.138840 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:47:36.138840 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7cfab473734f4b63aaa78508ef460a9f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7cfab473734f4b63aaa78508ef460a9f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7cfab473734f4b63aaa78508ef460a9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7cfab473734f4b63aaa78508ef460a9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:47:36.138840 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-LiveMigrationNegativeTest-1586069410 Sep 08 10:47:36.138840 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 7cfab473734f4b63aaa78508ef460a9f Sep 08 10:47:36.138840 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1586069410 Sep 08 10:47:36.138840 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-LiveMigrationNegativeTest-1586069410-project Sep 08 10:47:36.138840 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:47:36.138840 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:47:36.138840 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 416642c1ee664b4d9e0fb14d02266b37 Sep 08 10:47:36.138840 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-LiveMigrationNegativeTest-1586069410-project Sep 08 10:47:36.138840 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:47:36.138840 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance c937afd2-1699-4699-809d-20cfcead412c could not be found. Sep 08 10:47:36.138840 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'c937afd2-1699-4699-809d-20cfcead412c'} Sep 08 10:47:36.138840 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:47:36.138840 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:36.138840 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:47:36.138840 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:47:36.138840 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:47:36.138840 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:47:36.138840 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:47:36.138840 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:47:36.138840 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:47:36.138840 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:47:36.138840 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c937afd2-1699-4699-809d-20cfcead412c could not be found. Sep 08 10:47:36.138840 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:36.138840 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:36.138840 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:36.138840 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:36.138840 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:47:36.138840 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:47:36.138840 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:47:36.138840 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:47:36.138840 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:47:36.138840 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:47:36.138840 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:47:36.138840 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:47:36.138840 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:47:36.138840 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:47:36.138840 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:47:36.138840 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:47:36.138840 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c937afd2-1699-4699-809d-20cfcead412c could not be found. Sep 08 10:47:36.138840 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:36.138840 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:36.138840 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:36.144432 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:36.144432 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:47:36.144432 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:47:36.144432 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:47:36.144432 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:47:36.144432 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c937afd2-1699-4699-809d-20cfcead412c could not be found. Sep 08 10:47:36.144432 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:36.144432 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-23583275-c4f7-4636-b20e-ebf571c16806 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Returning 404 to user: Instance c937afd2-1699-4699-809d-20cfcead412c could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:47:36.144432 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-23583275-c4f7-4636-b20e-ebf571c16806 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] 10.222.0.27 "GET /compute/v2.1/servers/c937afd2-1699-4699-809d-20cfcead412c" status: 404 len: 111 microversion: 2.1 time: 0.038578 Sep 08 10:47:36.144432 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1169/2330] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:36 2022] GET /compute/v2.1/servers/c937afd2-1699-4699-809d-20cfcead412c => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:47:36.146078 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-f3d29576-a56a-4532-b179-49219c7e4c4c req-55c83c45-0fc3-4697-b573-0d085d157e5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c937afd2-1699-4699-809d-20cfcead412c", "name": "network-vif-deleted", "tag": "adcc26d9-b793-4b1b-9cf8-5a561707352d"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:47:36.156442 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-f3d29576-a56a-4532-b179-49219c7e4c4c req-55c83c45-0fc3-4697-b573-0d085d157e5c service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:36.156932 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-f3d29576-a56a-4532-b179-49219c7e4c4c req-55c83c45-0fc3-4697-b573-0d085d157e5c service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:36.157537 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-f3d29576-a56a-4532-b179-49219c7e4c4c req-55c83c45-0fc3-4697-b573-0d085d157e5c service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:36.160876 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=22,nova_cell0:UPDATE=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:47:36.172596 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-f3d29576-a56a-4532-b179-49219c7e4c4c req-55c83c45-0fc3-4697-b573-0d085d157e5c service nova] Creating event network-vif-deleted:adcc26d9-b793-4b1b-9cf8-5a561707352d for instance c937afd2-1699-4699-809d-20cfcead412c on n-h2-850501-12 Sep 08 10:47:36.178522 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-f3d29576-a56a-4532-b179-49219c7e4c4c req-55c83c45-0fc3-4697-b573-0d085d157e5c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035886 Sep 08 10:47:36.179175 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1170/2331] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:47:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:47:36.187096 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9dac7095-0a78-47f0-9819-756d0479ef49 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:36.187941 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9dac7095-0a78-47f0-9819-756d0479ef49 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 7d251638-b28f-4137-a81a-ce1a21cd7418] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:36.195263 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9dac7095-0a78-47f0-9819-756d0479ef49 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:36.195958 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9dac7095-0a78-47f0-9819-756d0479ef49 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:36.196574 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9dac7095-0a78-47f0-9819-756d0479ef49 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:36.197478 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9dac7095-0a78-47f0-9819-756d0479ef49 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:36.198131 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9dac7095-0a78-47f0-9819-756d0479ef49 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:36.198813 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9dac7095-0a78-47f0-9819-756d0479ef49 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:36.215922 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-9dac7095-0a78-47f0-9819-756d0479ef49 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] HTTP exception thrown: Instance 7d251638-b28f-4137-a81a-ce1a21cd7418 could not be found. Sep 08 10:47:36.217955 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9dac7095-0a78-47f0-9819-756d0479ef49 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Request method failure captured: Sep 08 10:47:36.217955 n-d-850501-12 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/servers/7d251638-b28f-4137-a81a-ce1a21cd7418 HTTP/1.1 Sep 08 10:47:36.217955 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:47:36.217955 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:47:36.217955 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:47:36.217955 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:47:36.217955 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:47:36.217955 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:47:36.217955 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:47:36.217955 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:47:36.217955 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcc0sSj3x0sBidV4prTXv00UAP3lriFd9bSf6ARsE1ekKVmlGukpstC35qUsWPJmY1lsjsjExO-iqH_QnZHhexPCbL7rQ87usxEHhLxbNbIFKv-QG5rcjHdmQtO5f0_wSj_rlzeH-S-tFvmDK4BhyOKoPTI_CkViDwssV_47VejAgTw Sep 08 10:47:36.217955 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:47:36.217955 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:47:36.217955 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:47:36.217955 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:47:36.217955 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:47:36.217955 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:47:36.217955 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: eeeb450420314221bd2469816e2995d1 Sep 08 10:47:36.217955 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ImagesTestJSON-2041705293 Sep 08 10:47:36.217955 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:47:36.217955 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:47:36.217955 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/eeeb450420314221bd2469816e2995d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eeeb450420314221bd2469816e2995d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_eeeb450420314221bd2469816e2995d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eeeb450420314221bd2469816e2995d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:47:36.217955 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ImagesTestJSON-2041705293 Sep 08 10:47:36.217955 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: eeeb450420314221bd2469816e2995d1 Sep 08 10:47:36.217955 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ImagesTestJSON-2041705293 Sep 08 10:47:36.217955 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ImagesTestJSON-2041705293-project Sep 08 10:47:36.217955 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:47:36.217955 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:47:36.217955 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: ce8c8c85354d46aeb786c8049b81e04d Sep 08 10:47:36.217955 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ImagesTestJSON-2041705293-project Sep 08 10:47:36.217955 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:47:36.217955 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 7d251638-b28f-4137-a81a-ce1a21cd7418 could not be found. Sep 08 10:47:36.217955 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '7d251638-b28f-4137-a81a-ce1a21cd7418'} Sep 08 10:47:36.217955 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:47:36.217955 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:36.217955 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:47:36.217955 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:47:36.217955 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:47:36.217955 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:47:36.217955 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:47:36.217955 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:47:36.217955 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:47:36.217955 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:47:36.217955 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d251638-b28f-4137-a81a-ce1a21cd7418 could not be found. Sep 08 10:47:36.217955 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:36.217955 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:36.217955 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:36.217955 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:36.217955 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:47:36.217955 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:47:36.217955 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:47:36.217955 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:47:36.217955 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:47:36.217955 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:47:36.217955 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:47:36.217955 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:47:36.217955 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:47:36.217955 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:47:36.217955 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:47:36.217955 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:47:36.217955 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:47:36.217955 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:47:36.217955 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d251638-b28f-4137-a81a-ce1a21cd7418 could not be found. Sep 08 10:47:36.222440 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:36.222440 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:36.222440 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:36.222440 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:36.222440 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:47:36.222440 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:47:36.222440 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:47:36.222440 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:47:36.222440 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d251638-b28f-4137-a81a-ce1a21cd7418 could not be found. Sep 08 10:47:36.222440 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:36.224114 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9dac7095-0a78-47f0-9819-756d0479ef49 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Returning 404 to user: Instance 7d251638-b28f-4137-a81a-ce1a21cd7418 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:47:36.225345 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9dac7095-0a78-47f0-9819-756d0479ef49 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7d251638-b28f-4137-a81a-ce1a21cd7418" status: 404 len: 111 microversion: 2.1 time: 0.044496 Sep 08 10:47:36.226377 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1171/2332] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:47:36 2022] DELETE /compute/v2.1/servers/7d251638-b28f-4137-a81a-ce1a21cd7418 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:47:36.231408 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dedbde14-8bb3-4391-a47f-c63b79dc0a80 tempest-SecurityGroupsTestAdminJSON-759946194 tempest-SecurityGroupsTestAdminJSON-759946194-project-admin] Action: 'create', calling method: .version_select at 0x7f68e8ae7430>, body: {"security_group": {"name": "tempest-securitygroup-658030839", "description": "tempest-description-1750804030"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:47:36.431878 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-dedbde14-8bb3-4391-a47f-c63b79dc0a80 tempest-SecurityGroupsTestAdminJSON-759946194 tempest-SecurityGroupsTestAdminJSON-759946194-project-admin] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.203607 Sep 08 10:47:36.433191 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1172/2333] 10.222.0.27 () {60 vars in 1180 bytes} [Thu Sep 8 10:47:36 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:47:36.441296 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-710338e1-cbf1-477b-946a-760219fc9091 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:36.443259 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-710338e1-cbf1-477b-946a-760219fc9091 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 23007ef9-a0d3-42ff-b687-0f53086c8bcb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:36.456009 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-710338e1-cbf1-477b-946a-760219fc9091 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:36.456491 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-710338e1-cbf1-477b-946a-760219fc9091 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:36.457114 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-710338e1-cbf1-477b-946a-760219fc9091 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:36.458033 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-710338e1-cbf1-477b-946a-760219fc9091 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:36.458695 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-710338e1-cbf1-477b-946a-760219fc9091 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:36.459432 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-710338e1-cbf1-477b-946a-760219fc9091 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:36.478144 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-55586b08-c054-41a7-98d2-b53d0ecd5255 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528fc9fbb57149c9a9c755c6497f5c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effe8e6c23114b8ab80e76bec365de60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:36.492894 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-55586b08-c054-41a7-98d2-b53d0ecd5255 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] 10.222.0.27 "GET /compute/v2.1/servers/4703a7bf-a1ba-4bba-8928-3c403f3f3f21" status: 200 len: 1304 microversion: 2.1 time: 0.532063 Sep 08 10:47:36.493644 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1162/2334] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:35 2022] GET /compute/v2.1/servers/4703a7bf-a1ba-4bba-8928-3c403f3f3f21 => generated 1304 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:36.511558 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-857d452d-2e31-4ef7-97b5-523de3c8068f tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:36.516225 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-857d452d-2e31-4ef7-97b5-523de3c8068f tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] [instance: 33157107-6744-4177-9c29-3822a7d34ff9] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:36.533301 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-857d452d-2e31-4ef7-97b5-523de3c8068f tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:36.535622 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-857d452d-2e31-4ef7-97b5-523de3c8068f tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:36.536302 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-857d452d-2e31-4ef7-97b5-523de3c8068f tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:36.537958 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-857d452d-2e31-4ef7-97b5-523de3c8068f tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:36.541942 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-857d452d-2e31-4ef7-97b5-523de3c8068f tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:36.548246 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-857d452d-2e31-4ef7-97b5-523de3c8068f tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:36.557354 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:47:36.597149 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-857d452d-2e31-4ef7-97b5-523de3c8068f tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] [instance: 33157107-6744-4177-9c29-3822a7d34ff9] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:47:36.701936 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-710338e1-cbf1-477b-946a-760219fc9091 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:36.710331 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-710338e1-cbf1-477b-946a-760219fc9091 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/23007ef9-a0d3-42ff-b687-0f53086c8bcb" status: 200 len: 1315 microversion: 2.1 time: 0.275801 Sep 08 10:47:36.725476 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1173/2335] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:36 2022] GET /compute/v2.1/servers/23007ef9-a0d3-42ff-b687-0f53086c8bcb => generated 1315 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:36.734920 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1cd538ab-565d-4072-b427-7a4767aaf591 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:36.735800 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1cd538ab-565d-4072-b427-7a4767aaf591 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 7d251638-b28f-4137-a81a-ce1a21cd7418] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:36.745466 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1cd538ab-565d-4072-b427-7a4767aaf591 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:36.745987 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1cd538ab-565d-4072-b427-7a4767aaf591 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:36.746435 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1cd538ab-565d-4072-b427-7a4767aaf591 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:36.747208 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1cd538ab-565d-4072-b427-7a4767aaf591 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:36.747950 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1cd538ab-565d-4072-b427-7a4767aaf591 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:36.748676 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1cd538ab-565d-4072-b427-7a4767aaf591 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:36.757719 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-857d452d-2e31-4ef7-97b5-523de3c8068f tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] 10.222.0.27 "DELETE /compute/v2.1/servers/33157107-6744-4177-9c29-3822a7d34ff9" status: 204 len: 0 microversion: 2.1 time: 0.256672 Sep 08 10:47:36.759029 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1163/2336] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:47:36 2022] DELETE /compute/v2.1/servers/33157107-6744-4177-9c29-3822a7d34ff9 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:47:36.767629 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-1cd538ab-565d-4072-b427-7a4767aaf591 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] HTTP exception thrown: Instance 7d251638-b28f-4137-a81a-ce1a21cd7418 could not be found. Sep 08 10:47:36.770494 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1cd538ab-565d-4072-b427-7a4767aaf591 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Request method failure captured: Sep 08 10:47:36.770494 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/7d251638-b28f-4137-a81a-ce1a21cd7418 HTTP/1.1 Sep 08 10:47:36.770494 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:47:36.770494 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:47:36.770494 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:47:36.770494 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:47:36.770494 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:47:36.770494 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:47:36.770494 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:47:36.770494 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:47:36.770494 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcc0sSj3x0sBidV4prTXv00UAP3lriFd9bSf6ARsE1ekKVmlGukpstC35qUsWPJmY1lsjsjExO-iqH_QnZHhexPCbL7rQ87usxEHhLxbNbIFKv-QG5rcjHdmQtO5f0_wSj_rlzeH-S-tFvmDK4BhyOKoPTI_CkViDwssV_47VejAgTw Sep 08 10:47:36.770494 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:47:36.770494 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:47:36.770494 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:47:36.770494 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:47:36.770494 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:47:36.770494 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:47:36.770494 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: eeeb450420314221bd2469816e2995d1 Sep 08 10:47:36.770494 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ImagesTestJSON-2041705293 Sep 08 10:47:36.770494 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:47:36.770494 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:47:36.770494 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/eeeb450420314221bd2469816e2995d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eeeb450420314221bd2469816e2995d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_eeeb450420314221bd2469816e2995d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eeeb450420314221bd2469816e2995d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:47:36.770494 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ImagesTestJSON-2041705293 Sep 08 10:47:36.770494 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: eeeb450420314221bd2469816e2995d1 Sep 08 10:47:36.770494 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ImagesTestJSON-2041705293 Sep 08 10:47:36.770494 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ImagesTestJSON-2041705293-project Sep 08 10:47:36.770494 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:47:36.770494 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:47:36.770494 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: ce8c8c85354d46aeb786c8049b81e04d Sep 08 10:47:36.770494 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ImagesTestJSON-2041705293-project Sep 08 10:47:36.770494 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:47:36.770494 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 7d251638-b28f-4137-a81a-ce1a21cd7418 could not be found. Sep 08 10:47:36.770494 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '7d251638-b28f-4137-a81a-ce1a21cd7418'} Sep 08 10:47:36.770494 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:47:36.770494 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:36.770494 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:47:36.770494 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:47:36.770494 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:47:36.770494 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:47:36.770494 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:47:36.770494 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:47:36.770494 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:47:36.770494 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:47:36.770494 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d251638-b28f-4137-a81a-ce1a21cd7418 could not be found. Sep 08 10:47:36.770494 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:36.770494 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:36.770494 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:36.770494 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:36.770494 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:47:36.770494 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:47:36.770494 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:47:36.770494 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:47:36.770494 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:47:36.770494 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:47:36.770494 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:47:36.770494 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:47:36.770494 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:47:36.770494 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:47:36.770494 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:47:36.770494 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:47:36.770494 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d251638-b28f-4137-a81a-ce1a21cd7418 could not be found. Sep 08 10:47:36.770494 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:36.770494 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:36.770494 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:36.770494 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:36.776781 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:47:36.776781 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:47:36.776781 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:47:36.776781 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:47:36.776781 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d251638-b28f-4137-a81a-ce1a21cd7418 could not be found. Sep 08 10:47:36.776781 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:36.776781 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1cd538ab-565d-4072-b427-7a4767aaf591 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Returning 404 to user: Instance 7d251638-b28f-4137-a81a-ce1a21cd7418 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:47:36.776781 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1cd538ab-565d-4072-b427-7a4767aaf591 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/7d251638-b28f-4137-a81a-ce1a21cd7418" status: 404 len: 111 microversion: 2.1 time: 0.045958 Sep 08 10:47:36.776781 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1174/2337] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:36 2022] GET /compute/v2.1/servers/7d251638-b28f-4137-a81a-ce1a21cd7418 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:47:36.781317 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-00e686df-bcba-4c1a-892a-00d1530c4c92 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:36.781934 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-00e686df-bcba-4c1a-892a-00d1530c4c92 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] [instance: 33157107-6744-4177-9c29-3822a7d34ff9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:36.788846 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-83d33613-497a-44bf-9652-2afa4e05cde4 tempest-SecurityGroupsTestAdminJSON-759946194 tempest-SecurityGroupsTestAdminJSON-759946194-project-admin] Calling method '.version_select at 0x7f68e4bab940>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:36.792005 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00e686df-bcba-4c1a-892a-00d1530c4c92 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:36.792930 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00e686df-bcba-4c1a-892a-00d1530c4c92 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:36.793745 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00e686df-bcba-4c1a-892a-00d1530c4c92 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:36.795480 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00e686df-bcba-4c1a-892a-00d1530c4c92 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:36.796225 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00e686df-bcba-4c1a-892a-00d1530c4c92 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:36.796790 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00e686df-bcba-4c1a-892a-00d1530c4c92 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:37.074588 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-00e686df-bcba-4c1a-892a-00d1530c4c92 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416642c1ee664b4d9e0fb14d02266b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cfab473734f4b63aaa78508ef460a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:37.090070 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-00e686df-bcba-4c1a-892a-00d1530c4c92 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] 10.222.0.27 "GET /compute/v2.1/servers/33157107-6744-4177-9c29-3822a7d34ff9" status: 200 len: 1474 microversion: 2.1 time: 0.313965 Sep 08 10:47:37.092735 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1175/2338] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:36 2022] GET /compute/v2.1/servers/33157107-6744-4177-9c29-3822a7d34ff9 => generated 1474 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:37.103570 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ce06153a-a752-4031-9059-17a04621638b tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '.version_select at 0x7f68e8af0e50>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:37.141535 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-ce06153a-a752-4031-9059-17a04621638b tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] HTTP exception thrown: Image not found. Sep 08 10:47:37.147222 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ce06153a-a752-4031-9059-17a04621638b tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Request method failure captured: Sep 08 10:47:37.147222 n-d-850501-12 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/images/6ca320eb-4ec1-4390-b737-c4ed16dbfe81 HTTP/1.1 Sep 08 10:47:37.147222 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:47:37.147222 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:47:37.147222 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:47:37.147222 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:47:37.147222 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:47:37.147222 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:47:37.147222 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:47:37.147222 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:47:37.147222 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcc0sSj3x0sBidV4prTXv00UAP3lriFd9bSf6ARsE1ekKVmlGukpstC35qUsWPJmY1lsjsjExO-iqH_QnZHhexPCbL7rQ87usxEHhLxbNbIFKv-QG5rcjHdmQtO5f0_wSj_rlzeH-S-tFvmDK4BhyOKoPTI_CkViDwssV_47VejAgTw Sep 08 10:47:37.147222 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:47:37.147222 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:47:37.147222 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:47:37.147222 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:47:37.147222 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:47:37.147222 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:47:37.147222 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: eeeb450420314221bd2469816e2995d1 Sep 08 10:47:37.147222 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ImagesTestJSON-2041705293 Sep 08 10:47:37.147222 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:47:37.147222 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:47:37.147222 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/eeeb450420314221bd2469816e2995d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eeeb450420314221bd2469816e2995d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_eeeb450420314221bd2469816e2995d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eeeb450420314221bd2469816e2995d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:47:37.147222 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ImagesTestJSON-2041705293 Sep 08 10:47:37.147222 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: eeeb450420314221bd2469816e2995d1 Sep 08 10:47:37.147222 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ImagesTestJSON-2041705293 Sep 08 10:47:37.147222 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ImagesTestJSON-2041705293-project Sep 08 10:47:37.147222 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:47:37.147222 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:47:37.147222 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: ce8c8c85354d46aeb786c8049b81e04d Sep 08 10:47:37.147222 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ImagesTestJSON-2041705293-project Sep 08 10:47:37.147222 n-d-850501-12 devstack@n-api.service[128862]: method: Sep 08 10:47:37.147222 n-d-850501-12 devstack@n-api.service[128862]: exception: Image not found. Sep 08 10:47:37.147222 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '6ca320eb-4ec1-4390-b737-c4ed16dbfe81'} Sep 08 10:47:37.147222 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:47:37.147222 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:37.147222 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 08 10:47:37.147222 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 08 10:47:37.147222 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 10:47:37.147222 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 10:47:37.147222 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 10:47:37.147222 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 10:47:37.147222 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 08 10:47:37.147222 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 08 10:47:37.147222 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 08 10:47:37.147222 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 08 10:47:37.147222 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 10:47:37.147222 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 10:47:37.147222 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 10:47:37.147222 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 10:47:37.147222 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 6ca320eb-4ec1-4390-b737-c4ed16dbfe81 to delete Sep 08 10:47:37.147222 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:37.147222 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:37.147222 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:37.147222 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:37.147222 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 08 10:47:37.147222 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 08 10:47:37.147222 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 08 10:47:37.147222 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 08 10:47:37.147222 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 08 10:47:37.147222 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 08 10:47:37.147222 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6ca320eb-4ec1-4390-b737-c4ed16dbfe81 could not be found. Sep 08 10:47:37.147222 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:37.147222 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:37.147222 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:37.147222 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:37.158075 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:47:37.158075 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:47:37.158075 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:47:37.158075 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:47:37.158075 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:47:37.158075 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:47:37.158075 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:47:37.158075 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:47:37.158075 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 08 10:47:37.158075 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 08 10:47:37.158075 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 08 10:47:37.158075 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:37.158075 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:37.158075 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:37.158075 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:37.158075 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:47:37.158075 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:47:37.158075 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:47:37.158075 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:47:37.158075 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 08 10:47:37.158075 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:37.158075 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ce06153a-a752-4031-9059-17a04621638b tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Returning 404 to user: Image not found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:47:37.158075 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ce06153a-a752-4031-9059-17a04621638b tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "DELETE /compute/v2.1/images/6ca320eb-4ec1-4390-b737-c4ed16dbfe81" status: 404 len: 62 microversion: 2.1 time: 0.053700 Sep 08 10:47:37.158075 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1176/2339] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:37 2022] DELETE /compute/v2.1/images/6ca320eb-4ec1-4390-b737-c4ed16dbfe81 => generated 62 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:47:37.159883 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6b00d7e1-8f3b-4a1e-a85a-543061810110 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:37.159883 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6b00d7e1-8f3b-4a1e-a85a-543061810110 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: 3766b195-ace4-4563-a24e-dca72941251e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:37.179850 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b00d7e1-8f3b-4a1e-a85a-543061810110 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:37.180354 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b00d7e1-8f3b-4a1e-a85a-543061810110 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:37.180797 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b00d7e1-8f3b-4a1e-a85a-543061810110 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:37.181565 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b00d7e1-8f3b-4a1e-a85a-543061810110 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:37.182289 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b00d7e1-8f3b-4a1e-a85a-543061810110 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:37.182793 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b00d7e1-8f3b-4a1e-a85a-543061810110 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:37.382617 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6b00d7e1-8f3b-4a1e-a85a-543061810110 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:37.394089 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6b00d7e1-8f3b-4a1e-a85a-543061810110 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e" status: 200 len: 1472 microversion: 2.1 time: 0.242112 Sep 08 10:47:37.394674 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1177/2340] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:37 2022] GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e => generated 1472 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:37.399926 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b41fe4af-2dbc-4909-82cb-422e4dfb994d tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:37.400819 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b41fe4af-2dbc-4909-82cb-422e4dfb994d tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 64c88fa0-6a01-42fc-b0e9-98b9e84a199d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:37.407661 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b41fe4af-2dbc-4909-82cb-422e4dfb994d tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:37.408474 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b41fe4af-2dbc-4909-82cb-422e4dfb994d tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:37.409295 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b41fe4af-2dbc-4909-82cb-422e4dfb994d tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:37.414503 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b41fe4af-2dbc-4909-82cb-422e4dfb994d tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:37.415454 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b41fe4af-2dbc-4909-82cb-422e4dfb994d tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:37.416120 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b41fe4af-2dbc-4909-82cb-422e4dfb994d tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:37.432539 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-b41fe4af-2dbc-4909-82cb-422e4dfb994d tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] HTTP exception thrown: Instance 64c88fa0-6a01-42fc-b0e9-98b9e84a199d could not be found. Sep 08 10:47:37.434293 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b41fe4af-2dbc-4909-82cb-422e4dfb994d tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Request method failure captured: Sep 08 10:47:37.434293 n-d-850501-12 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d HTTP/1.1 Sep 08 10:47:37.434293 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:47:37.434293 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:47:37.434293 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:47:37.434293 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:47:37.434293 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:47:37.434293 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:47:37.434293 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:47:37.434293 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:47:37.434293 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcc0sSj3x0sBidV4prTXv00UAP3lriFd9bSf6ARsE1ekKVmlGukpstC35qUsWPJmY1lsjsjExO-iqH_QnZHhexPCbL7rQ87usxEHhLxbNbIFKv-QG5rcjHdmQtO5f0_wSj_rlzeH-S-tFvmDK4BhyOKoPTI_CkViDwssV_47VejAgTw Sep 08 10:47:37.434293 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:47:37.434293 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:47:37.434293 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:47:37.434293 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:47:37.434293 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:47:37.434293 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:47:37.434293 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: eeeb450420314221bd2469816e2995d1 Sep 08 10:47:37.434293 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ImagesTestJSON-2041705293 Sep 08 10:47:37.434293 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:47:37.434293 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:47:37.434293 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/eeeb450420314221bd2469816e2995d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eeeb450420314221bd2469816e2995d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_eeeb450420314221bd2469816e2995d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eeeb450420314221bd2469816e2995d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:47:37.434293 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ImagesTestJSON-2041705293 Sep 08 10:47:37.434293 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: eeeb450420314221bd2469816e2995d1 Sep 08 10:47:37.434293 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ImagesTestJSON-2041705293 Sep 08 10:47:37.434293 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ImagesTestJSON-2041705293-project Sep 08 10:47:37.434293 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:47:37.434293 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:47:37.434293 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: ce8c8c85354d46aeb786c8049b81e04d Sep 08 10:47:37.434293 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ImagesTestJSON-2041705293-project Sep 08 10:47:37.434293 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:47:37.434293 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 64c88fa0-6a01-42fc-b0e9-98b9e84a199d could not be found. Sep 08 10:47:37.434293 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '64c88fa0-6a01-42fc-b0e9-98b9e84a199d'} Sep 08 10:47:37.434293 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:47:37.434293 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:37.434293 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:47:37.434293 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:47:37.434293 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:47:37.434293 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:47:37.434293 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:47:37.434293 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:47:37.434293 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:47:37.434293 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:47:37.434293 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64c88fa0-6a01-42fc-b0e9-98b9e84a199d could not be found. Sep 08 10:47:37.434293 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:37.434293 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:37.434293 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:37.434293 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:37.434293 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:47:37.434293 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:47:37.434293 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:47:37.434293 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:47:37.434293 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:47:37.434293 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:47:37.434293 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:47:37.434293 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:47:37.434293 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:47:37.434293 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:47:37.434293 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:47:37.434293 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:47:37.434293 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:47:37.434293 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:47:37.434293 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64c88fa0-6a01-42fc-b0e9-98b9e84a199d could not be found. Sep 08 10:47:37.439298 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:37.439298 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:37.439298 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:37.439298 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:37.439298 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:47:37.439298 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:47:37.439298 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:47:37.439298 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:47:37.439298 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64c88fa0-6a01-42fc-b0e9-98b9e84a199d could not be found. Sep 08 10:47:37.439298 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:37.439298 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b41fe4af-2dbc-4909-82cb-422e4dfb994d tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Returning 404 to user: Instance 64c88fa0-6a01-42fc-b0e9-98b9e84a199d could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:47:37.439298 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b41fe4af-2dbc-4909-82cb-422e4dfb994d tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "DELETE /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d" status: 404 len: 111 microversion: 2.1 time: 0.040444 Sep 08 10:47:37.441094 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1178/2341] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:47:37 2022] DELETE /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:47:37.445712 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b84488a7-6ca2-450f-8e3e-7d3ee46ee465 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:37.446422 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b84488a7-6ca2-450f-8e3e-7d3ee46ee465 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 64c88fa0-6a01-42fc-b0e9-98b9e84a199d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:37.454611 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b84488a7-6ca2-450f-8e3e-7d3ee46ee465 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:37.455283 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b84488a7-6ca2-450f-8e3e-7d3ee46ee465 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:37.456057 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b84488a7-6ca2-450f-8e3e-7d3ee46ee465 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:37.457309 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b84488a7-6ca2-450f-8e3e-7d3ee46ee465 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:37.458360 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b84488a7-6ca2-450f-8e3e-7d3ee46ee465 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:37.458941 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b84488a7-6ca2-450f-8e3e-7d3ee46ee465 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:37.475962 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-b84488a7-6ca2-450f-8e3e-7d3ee46ee465 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] HTTP exception thrown: Instance 64c88fa0-6a01-42fc-b0e9-98b9e84a199d could not be found. Sep 08 10:47:37.477670 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b84488a7-6ca2-450f-8e3e-7d3ee46ee465 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Request method failure captured: Sep 08 10:47:37.477670 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d HTTP/1.1 Sep 08 10:47:37.477670 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:47:37.477670 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:47:37.477670 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:47:37.477670 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:47:37.477670 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:47:37.477670 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:47:37.477670 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:47:37.477670 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:47:37.477670 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcc0sSj3x0sBidV4prTXv00UAP3lriFd9bSf6ARsE1ekKVmlGukpstC35qUsWPJmY1lsjsjExO-iqH_QnZHhexPCbL7rQ87usxEHhLxbNbIFKv-QG5rcjHdmQtO5f0_wSj_rlzeH-S-tFvmDK4BhyOKoPTI_CkViDwssV_47VejAgTw Sep 08 10:47:37.477670 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:47:37.477670 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:47:37.477670 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:47:37.477670 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:47:37.477670 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:47:37.477670 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:47:37.477670 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: eeeb450420314221bd2469816e2995d1 Sep 08 10:47:37.477670 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ImagesTestJSON-2041705293 Sep 08 10:47:37.477670 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:47:37.477670 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:47:37.477670 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/eeeb450420314221bd2469816e2995d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eeeb450420314221bd2469816e2995d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_eeeb450420314221bd2469816e2995d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eeeb450420314221bd2469816e2995d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:47:37.477670 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ImagesTestJSON-2041705293 Sep 08 10:47:37.477670 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: eeeb450420314221bd2469816e2995d1 Sep 08 10:47:37.477670 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ImagesTestJSON-2041705293 Sep 08 10:47:37.477670 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ImagesTestJSON-2041705293-project Sep 08 10:47:37.477670 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:47:37.477670 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:47:37.477670 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: ce8c8c85354d46aeb786c8049b81e04d Sep 08 10:47:37.477670 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ImagesTestJSON-2041705293-project Sep 08 10:47:37.477670 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:47:37.477670 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 64c88fa0-6a01-42fc-b0e9-98b9e84a199d could not be found. Sep 08 10:47:37.477670 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '64c88fa0-6a01-42fc-b0e9-98b9e84a199d'} Sep 08 10:47:37.477670 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:47:37.477670 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:37.477670 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:47:37.477670 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:47:37.477670 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:47:37.477670 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:47:37.477670 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:47:37.477670 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:47:37.477670 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:47:37.477670 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:47:37.477670 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64c88fa0-6a01-42fc-b0e9-98b9e84a199d could not be found. Sep 08 10:47:37.477670 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:37.477670 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:37.477670 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:37.477670 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:37.477670 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:47:37.477670 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:47:37.477670 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:47:37.477670 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:47:37.477670 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:47:37.477670 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:47:37.477670 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:47:37.477670 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:47:37.477670 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:47:37.477670 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:47:37.477670 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:47:37.477670 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:47:37.477670 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64c88fa0-6a01-42fc-b0e9-98b9e84a199d could not be found. Sep 08 10:47:37.477670 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:37.477670 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:37.477670 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:37.477670 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:37.484173 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:47:37.484173 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:47:37.484173 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:47:37.484173 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:47:37.484173 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64c88fa0-6a01-42fc-b0e9-98b9e84a199d could not be found. Sep 08 10:47:37.484173 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:37.484173 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b84488a7-6ca2-450f-8e3e-7d3ee46ee465 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Returning 404 to user: Instance 64c88fa0-6a01-42fc-b0e9-98b9e84a199d could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:47:37.484173 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b84488a7-6ca2-450f-8e3e-7d3ee46ee465 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d" status: 404 len: 111 microversion: 2.1 time: 0.037096 Sep 08 10:47:37.484173 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1179/2342] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:37 2022] GET /compute/v2.1/servers/64c88fa0-6a01-42fc-b0e9-98b9e84a199d => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:47:37.490538 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d489a9dc-4455-4ea7-bc64-faeb5947dcc2 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '.version_select at 0x7f68e8af0ee0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:37.518850 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-d489a9dc-4455-4ea7-bc64-faeb5947dcc2 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] HTTP exception thrown: Image not found. Sep 08 10:47:37.521953 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d489a9dc-4455-4ea7-bc64-faeb5947dcc2 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Request method failure captured: Sep 08 10:47:37.521953 n-d-850501-12 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/images/9a0f08f6-d8f6-4a73-8e9c-e267129f62dc HTTP/1.1 Sep 08 10:47:37.521953 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:47:37.521953 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:47:37.521953 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:47:37.521953 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:47:37.521953 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:47:37.521953 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:47:37.521953 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:47:37.521953 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:47:37.521953 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcc0sSj3x0sBidV4prTXv00UAP3lriFd9bSf6ARsE1ekKVmlGukpstC35qUsWPJmY1lsjsjExO-iqH_QnZHhexPCbL7rQ87usxEHhLxbNbIFKv-QG5rcjHdmQtO5f0_wSj_rlzeH-S-tFvmDK4BhyOKoPTI_CkViDwssV_47VejAgTw Sep 08 10:47:37.521953 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:47:37.521953 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:47:37.521953 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:47:37.521953 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:47:37.521953 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:47:37.521953 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:47:37.521953 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: eeeb450420314221bd2469816e2995d1 Sep 08 10:47:37.521953 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ImagesTestJSON-2041705293 Sep 08 10:47:37.521953 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:47:37.521953 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:47:37.521953 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/eeeb450420314221bd2469816e2995d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eeeb450420314221bd2469816e2995d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_eeeb450420314221bd2469816e2995d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eeeb450420314221bd2469816e2995d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:47:37.521953 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ImagesTestJSON-2041705293 Sep 08 10:47:37.521953 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: eeeb450420314221bd2469816e2995d1 Sep 08 10:47:37.521953 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ImagesTestJSON-2041705293 Sep 08 10:47:37.521953 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ImagesTestJSON-2041705293-project Sep 08 10:47:37.521953 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:47:37.521953 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:47:37.521953 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: ce8c8c85354d46aeb786c8049b81e04d Sep 08 10:47:37.521953 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ImagesTestJSON-2041705293-project Sep 08 10:47:37.521953 n-d-850501-12 devstack@n-api.service[128862]: method: Sep 08 10:47:37.521953 n-d-850501-12 devstack@n-api.service[128862]: exception: Image not found. Sep 08 10:47:37.521953 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '9a0f08f6-d8f6-4a73-8e9c-e267129f62dc'} Sep 08 10:47:37.521953 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:47:37.521953 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:37.521953 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 08 10:47:37.521953 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 08 10:47:37.521953 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 10:47:37.521953 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 10:47:37.521953 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 10:47:37.521953 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 10:47:37.521953 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 08 10:47:37.521953 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 08 10:47:37.521953 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 08 10:47:37.521953 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 08 10:47:37.521953 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 10:47:37.521953 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 10:47:37.521953 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 10:47:37.521953 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 10:47:37.521953 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 9a0f08f6-d8f6-4a73-8e9c-e267129f62dc to delete Sep 08 10:47:37.521953 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:37.521953 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:37.521953 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:37.521953 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:37.521953 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 08 10:47:37.521953 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 08 10:47:37.521953 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 08 10:47:37.521953 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 08 10:47:37.521953 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 08 10:47:37.521953 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 08 10:47:37.521953 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9a0f08f6-d8f6-4a73-8e9c-e267129f62dc could not be found. Sep 08 10:47:37.521953 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:37.521953 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:37.521953 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:37.521953 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:37.525671 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:47:37.525671 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:47:37.525671 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:47:37.525671 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:47:37.525671 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:47:37.525671 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:47:37.525671 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:47:37.525671 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:47:37.525671 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 08 10:47:37.525671 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 08 10:47:37.525671 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 08 10:47:37.525671 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:37.525671 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:37.525671 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:37.525671 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:37.525671 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:47:37.525671 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:47:37.525671 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:47:37.525671 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:47:37.525671 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 08 10:47:37.525671 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:37.528153 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d489a9dc-4455-4ea7-bc64-faeb5947dcc2 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Returning 404 to user: Image not found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:47:37.529810 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d489a9dc-4455-4ea7-bc64-faeb5947dcc2 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "DELETE /compute/v2.1/images/9a0f08f6-d8f6-4a73-8e9c-e267129f62dc" status: 404 len: 62 microversion: 2.1 time: 0.044621 Sep 08 10:47:37.533558 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1180/2343] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:37 2022] DELETE /compute/v2.1/images/9a0f08f6-d8f6-4a73-8e9c-e267129f62dc => generated 62 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:47:37.543979 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ad81d63e-ada2-4776-97ce-19b6981cdc10 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:37.545425 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ad81d63e-ada2-4776-97ce-19b6981cdc10 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] [instance: 4703a7bf-a1ba-4bba-8928-3c403f3f3f21] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:37.554443 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad81d63e-ada2-4776-97ce-19b6981cdc10 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:37.555298 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad81d63e-ada2-4776-97ce-19b6981cdc10 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:37.556144 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad81d63e-ada2-4776-97ce-19b6981cdc10 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:37.557860 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad81d63e-ada2-4776-97ce-19b6981cdc10 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:37.558708 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad81d63e-ada2-4776-97ce-19b6981cdc10 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:37.560101 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad81d63e-ada2-4776-97ce-19b6981cdc10 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:37.806456 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ad81d63e-ada2-4776-97ce-19b6981cdc10 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528fc9fbb57149c9a9c755c6497f5c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effe8e6c23114b8ab80e76bec365de60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:37.821210 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ad81d63e-ada2-4776-97ce-19b6981cdc10 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] 10.222.0.27 "GET /compute/v2.1/servers/4703a7bf-a1ba-4bba-8928-3c403f3f3f21" status: 200 len: 1304 microversion: 2.1 time: 0.286196 Sep 08 10:47:37.836951 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1181/2344] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:37 2022] GET /compute/v2.1/servers/4703a7bf-a1ba-4bba-8928-3c403f3f3f21 => generated 1304 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:37.854063 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a790b8f5-f93a-4532-b693-29d60ae1a823 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:37.854993 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a790b8f5-f93a-4532-b693-29d60ae1a823 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 5a9072eb-573f-4576-b922-57245258445e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:37.867848 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a790b8f5-f93a-4532-b693-29d60ae1a823 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:37.868524 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a790b8f5-f93a-4532-b693-29d60ae1a823 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:37.869071 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a790b8f5-f93a-4532-b693-29d60ae1a823 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:37.869833 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a790b8f5-f93a-4532-b693-29d60ae1a823 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:37.870308 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a790b8f5-f93a-4532-b693-29d60ae1a823 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:37.870744 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a790b8f5-f93a-4532-b693-29d60ae1a823 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:37.891084 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-a790b8f5-f93a-4532-b693-29d60ae1a823 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] HTTP exception thrown: Instance 5a9072eb-573f-4576-b922-57245258445e could not be found. Sep 08 10:47:37.893178 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a790b8f5-f93a-4532-b693-29d60ae1a823 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Request method failure captured: Sep 08 10:47:37.893178 n-d-850501-12 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/servers/5a9072eb-573f-4576-b922-57245258445e HTTP/1.1 Sep 08 10:47:37.893178 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:47:37.893178 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:47:37.893178 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:47:37.893178 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:47:37.893178 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:47:37.893178 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:47:37.893178 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:47:37.893178 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:47:37.893178 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcc0sSj3x0sBidV4prTXv00UAP3lriFd9bSf6ARsE1ekKVmlGukpstC35qUsWPJmY1lsjsjExO-iqH_QnZHhexPCbL7rQ87usxEHhLxbNbIFKv-QG5rcjHdmQtO5f0_wSj_rlzeH-S-tFvmDK4BhyOKoPTI_CkViDwssV_47VejAgTw Sep 08 10:47:37.893178 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:47:37.893178 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:47:37.893178 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:47:37.893178 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:47:37.893178 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:47:37.893178 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:47:37.893178 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: eeeb450420314221bd2469816e2995d1 Sep 08 10:47:37.893178 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ImagesTestJSON-2041705293 Sep 08 10:47:37.893178 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:47:37.893178 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:47:37.893178 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/eeeb450420314221bd2469816e2995d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eeeb450420314221bd2469816e2995d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_eeeb450420314221bd2469816e2995d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eeeb450420314221bd2469816e2995d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:47:37.893178 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ImagesTestJSON-2041705293 Sep 08 10:47:37.893178 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: eeeb450420314221bd2469816e2995d1 Sep 08 10:47:37.893178 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ImagesTestJSON-2041705293 Sep 08 10:47:37.893178 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ImagesTestJSON-2041705293-project Sep 08 10:47:37.893178 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:47:37.893178 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:47:37.893178 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: ce8c8c85354d46aeb786c8049b81e04d Sep 08 10:47:37.893178 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ImagesTestJSON-2041705293-project Sep 08 10:47:37.893178 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:47:37.893178 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 5a9072eb-573f-4576-b922-57245258445e could not be found. Sep 08 10:47:37.893178 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '5a9072eb-573f-4576-b922-57245258445e'} Sep 08 10:47:37.893178 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:47:37.893178 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:37.893178 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:47:37.893178 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:47:37.893178 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:47:37.893178 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:47:37.893178 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:47:37.893178 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:47:37.893178 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:47:37.893178 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:47:37.893178 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a9072eb-573f-4576-b922-57245258445e could not be found. Sep 08 10:47:37.893178 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:37.893178 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:37.893178 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:37.893178 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:37.893178 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:47:37.893178 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:47:37.893178 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:47:37.893178 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:47:37.893178 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:47:37.893178 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:47:37.893178 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:47:37.893178 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:47:37.893178 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:47:37.893178 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:47:37.893178 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:47:37.893178 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:47:37.893178 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:47:37.893178 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:47:37.893178 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a9072eb-573f-4576-b922-57245258445e could not be found. Sep 08 10:47:37.896765 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:37.896765 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:37.896765 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:37.896765 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:37.896765 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:47:37.896765 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:47:37.896765 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:47:37.896765 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:47:37.896765 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a9072eb-573f-4576-b922-57245258445e could not be found. Sep 08 10:47:37.896765 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:37.896765 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a790b8f5-f93a-4532-b693-29d60ae1a823 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Returning 404 to user: Instance 5a9072eb-573f-4576-b922-57245258445e could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:47:37.896765 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a790b8f5-f93a-4532-b693-29d60ae1a823 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5a9072eb-573f-4576-b922-57245258445e" status: 404 len: 111 microversion: 2.1 time: 0.056221 Sep 08 10:47:37.896765 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1182/2345] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:47:37 2022] DELETE /compute/v2.1/servers/5a9072eb-573f-4576-b922-57245258445e => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:47:37.903140 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f1622ab4-aad6-465d-80c4-cf779b6c8df0 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:37.904897 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f1622ab4-aad6-465d-80c4-cf779b6c8df0 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 23007ef9-a0d3-42ff-b687-0f53086c8bcb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:37.910563 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1622ab4-aad6-465d-80c4-cf779b6c8df0 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:37.911075 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1622ab4-aad6-465d-80c4-cf779b6c8df0 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:37.911547 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1622ab4-aad6-465d-80c4-cf779b6c8df0 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:37.921849 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1622ab4-aad6-465d-80c4-cf779b6c8df0 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:37.921849 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1622ab4-aad6-465d-80c4-cf779b6c8df0 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:37.921849 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1622ab4-aad6-465d-80c4-cf779b6c8df0 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:38.182235 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f1622ab4-aad6-465d-80c4-cf779b6c8df0 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:38.198674 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:47:38.204472 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f1622ab4-aad6-465d-80c4-cf779b6c8df0 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/23007ef9-a0d3-42ff-b687-0f53086c8bcb" status: 200 len: 1315 microversion: 2.1 time: 0.307507 Sep 08 10:47:38.211704 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1183/2346] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:37 2022] GET /compute/v2.1/servers/23007ef9-a0d3-42ff-b687-0f53086c8bcb => generated 1315 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:38.220050 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8ca1c057-fe6f-4f89-877e-4c6700cd13e0 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c0f5912d-82b3-48ce-8193-eedef0b441ae"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:47:38.226857 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8ca1c057-fe6f-4f89-877e-4c6700cd13e0 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: bace4c1a-2c38-42b3-962d-ca87a3bfb7ba] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:38.242894 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ca1c057-fe6f-4f89-877e-4c6700cd13e0 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:38.244591 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ca1c057-fe6f-4f89-877e-4c6700cd13e0 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:38.245535 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ca1c057-fe6f-4f89-877e-4c6700cd13e0 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:38.246945 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ca1c057-fe6f-4f89-877e-4c6700cd13e0 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:38.248234 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ca1c057-fe6f-4f89-877e-4c6700cd13e0 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:38.248964 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ca1c057-fe6f-4f89-877e-4c6700cd13e0 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:38.375578 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=54 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:47:38.599550 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8ca1c057-fe6f-4f89-877e-4c6700cd13e0 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "POST /compute/v2.1/servers/bace4c1a-2c38-42b3-962d-ca87a3bfb7ba/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.386448 Sep 08 10:47:38.600971 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1184/2347] 10.222.0.27 () {60 vars in 1323 bytes} [Thu Sep 8 10:47:38 2022] POST /compute/v2.1/servers/bace4c1a-2c38-42b3-962d-ca87a3bfb7ba/os-volume_attachments => generated 194 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:47:38.620787 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-aa8f2a2d-382e-4ee6-b958-b8ca0715f3a6 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:38.623148 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-aa8f2a2d-382e-4ee6-b958-b8ca0715f3a6 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] [instance: 5a9072eb-573f-4576-b922-57245258445e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:38.634552 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa8f2a2d-382e-4ee6-b958-b8ca0715f3a6 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:38.635213 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa8f2a2d-382e-4ee6-b958-b8ca0715f3a6 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:38.635733 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa8f2a2d-382e-4ee6-b958-b8ca0715f3a6 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:38.636554 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa8f2a2d-382e-4ee6-b958-b8ca0715f3a6 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:38.637487 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa8f2a2d-382e-4ee6-b958-b8ca0715f3a6 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:38.638621 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa8f2a2d-382e-4ee6-b958-b8ca0715f3a6 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:38.658318 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-aa8f2a2d-382e-4ee6-b958-b8ca0715f3a6 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] HTTP exception thrown: Instance 5a9072eb-573f-4576-b922-57245258445e could not be found. Sep 08 10:47:38.673121 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-aa8f2a2d-382e-4ee6-b958-b8ca0715f3a6 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Request method failure captured: Sep 08 10:47:38.673121 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/5a9072eb-573f-4576-b922-57245258445e HTTP/1.1 Sep 08 10:47:38.673121 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:47:38.673121 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:47:38.673121 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:47:38.673121 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:47:38.673121 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:47:38.673121 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:47:38.673121 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:47:38.673121 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:47:38.673121 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcc0sSj3x0sBidV4prTXv00UAP3lriFd9bSf6ARsE1ekKVmlGukpstC35qUsWPJmY1lsjsjExO-iqH_QnZHhexPCbL7rQ87usxEHhLxbNbIFKv-QG5rcjHdmQtO5f0_wSj_rlzeH-S-tFvmDK4BhyOKoPTI_CkViDwssV_47VejAgTw Sep 08 10:47:38.673121 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:47:38.673121 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:47:38.673121 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:47:38.673121 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:47:38.673121 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:47:38.673121 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:47:38.673121 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: eeeb450420314221bd2469816e2995d1 Sep 08 10:47:38.673121 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ImagesTestJSON-2041705293 Sep 08 10:47:38.673121 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:47:38.673121 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:47:38.673121 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/eeeb450420314221bd2469816e2995d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eeeb450420314221bd2469816e2995d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_eeeb450420314221bd2469816e2995d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eeeb450420314221bd2469816e2995d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:47:38.673121 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ImagesTestJSON-2041705293 Sep 08 10:47:38.673121 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: eeeb450420314221bd2469816e2995d1 Sep 08 10:47:38.673121 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ImagesTestJSON-2041705293 Sep 08 10:47:38.673121 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ImagesTestJSON-2041705293-project Sep 08 10:47:38.673121 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:47:38.673121 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:47:38.673121 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: ce8c8c85354d46aeb786c8049b81e04d Sep 08 10:47:38.673121 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ImagesTestJSON-2041705293-project Sep 08 10:47:38.673121 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:47:38.673121 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 5a9072eb-573f-4576-b922-57245258445e could not be found. Sep 08 10:47:38.673121 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '5a9072eb-573f-4576-b922-57245258445e'} Sep 08 10:47:38.673121 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:47:38.673121 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:38.673121 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:47:38.673121 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:47:38.673121 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:47:38.673121 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:47:38.673121 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:47:38.673121 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:47:38.673121 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:47:38.673121 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:47:38.673121 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a9072eb-573f-4576-b922-57245258445e could not be found. Sep 08 10:47:38.673121 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:38.673121 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:38.673121 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:38.673121 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:38.673121 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:47:38.673121 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:47:38.673121 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:47:38.673121 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:47:38.673121 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:47:38.673121 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:47:38.673121 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:47:38.673121 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:47:38.673121 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:47:38.673121 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:47:38.673121 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:47:38.673121 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:47:38.673121 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a9072eb-573f-4576-b922-57245258445e could not be found. Sep 08 10:47:38.673121 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:38.673121 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:38.673121 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:38.673121 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:38.676730 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:47:38.676730 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:47:38.676730 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:47:38.676730 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:47:38.676730 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a9072eb-573f-4576-b922-57245258445e could not be found. Sep 08 10:47:38.676730 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:38.676730 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-aa8f2a2d-382e-4ee6-b958-b8ca0715f3a6 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] Returning 404 to user: Instance 5a9072eb-573f-4576-b922-57245258445e could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:47:38.676730 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-aa8f2a2d-382e-4ee6-b958-b8ca0715f3a6 tempest-ImagesTestJSON-2041705293 tempest-ImagesTestJSON-2041705293-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9072eb-573f-4576-b922-57245258445e" status: 404 len: 111 microversion: 2.1 time: 0.059424 Sep 08 10:47:38.676730 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1185/2348] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:38 2022] GET /compute/v2.1/servers/5a9072eb-573f-4576-b922-57245258445e => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:47:38.676730 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b167b49d-e5c8-488c-8a1d-a287c85c7a5f tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:38.676730 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b167b49d-e5c8-488c-8a1d-a287c85c7a5f tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] [instance: 33157107-6744-4177-9c29-3822a7d34ff9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:38.682064 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b167b49d-e5c8-488c-8a1d-a287c85c7a5f tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:38.682945 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b167b49d-e5c8-488c-8a1d-a287c85c7a5f tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:38.683487 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b167b49d-e5c8-488c-8a1d-a287c85c7a5f tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:38.684385 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b167b49d-e5c8-488c-8a1d-a287c85c7a5f tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:38.685910 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b167b49d-e5c8-488c-8a1d-a287c85c7a5f tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:38.687743 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b167b49d-e5c8-488c-8a1d-a287c85c7a5f tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:38.946993 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b167b49d-e5c8-488c-8a1d-a287c85c7a5f tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416642c1ee664b4d9e0fb14d02266b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cfab473734f4b63aaa78508ef460a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:38.956957 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b167b49d-e5c8-488c-8a1d-a287c85c7a5f tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] 10.222.0.27 "GET /compute/v2.1/servers/33157107-6744-4177-9c29-3822a7d34ff9" status: 200 len: 1474 microversion: 2.1 time: 0.289629 Sep 08 10:47:38.968650 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1186/2349] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:38 2022] GET /compute/v2.1/servers/33157107-6744-4177-9c29-3822a7d34ff9 => generated 1474 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:38.989298 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8e1172f9-542a-43f0-a7b4-49adbbee4ae7 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:38.989298 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8e1172f9-542a-43f0-a7b4-49adbbee4ae7 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: 3766b195-ace4-4563-a24e-dca72941251e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:38.989298 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e1172f9-542a-43f0-a7b4-49adbbee4ae7 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:38.989681 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e1172f9-542a-43f0-a7b4-49adbbee4ae7 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:38.999515 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e1172f9-542a-43f0-a7b4-49adbbee4ae7 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:38.999515 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e1172f9-542a-43f0-a7b4-49adbbee4ae7 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:38.999515 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e1172f9-542a-43f0-a7b4-49adbbee4ae7 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:38.999515 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e1172f9-542a-43f0-a7b4-49adbbee4ae7 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:39.276620 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8e1172f9-542a-43f0-a7b4-49adbbee4ae7 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:39.286018 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8e1172f9-542a-43f0-a7b4-49adbbee4ae7 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e" status: 200 len: 1472 microversion: 2.1 time: 0.315672 Sep 08 10:47:39.286682 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1187/2350] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:38 2022] GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e => generated 1472 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:39.319176 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0584bc36-1d37-47c7-bcde-c2831eb289ef tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:39.322021 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0584bc36-1d37-47c7-bcde-c2831eb289ef tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] [instance: 4703a7bf-a1ba-4bba-8928-3c403f3f3f21] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:39.337211 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0584bc36-1d37-47c7-bcde-c2831eb289ef tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:39.340042 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0584bc36-1d37-47c7-bcde-c2831eb289ef tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:39.340609 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0584bc36-1d37-47c7-bcde-c2831eb289ef tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:39.342716 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0584bc36-1d37-47c7-bcde-c2831eb289ef tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:39.344397 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0584bc36-1d37-47c7-bcde-c2831eb289ef tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:39.348371 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0584bc36-1d37-47c7-bcde-c2831eb289ef tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:39.759280 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0584bc36-1d37-47c7-bcde-c2831eb289ef tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528fc9fbb57149c9a9c755c6497f5c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effe8e6c23114b8ab80e76bec365de60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:39.773891 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0584bc36-1d37-47c7-bcde-c2831eb289ef tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] 10.222.0.27 "GET /compute/v2.1/servers/4703a7bf-a1ba-4bba-8928-3c403f3f3f21" status: 200 len: 1304 microversion: 2.1 time: 0.469208 Sep 08 10:47:39.791152 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1188/2351] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:39 2022] GET /compute/v2.1/servers/4703a7bf-a1ba-4bba-8928-3c403f3f3f21 => generated 1304 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:39.796447 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-722e6f05-c6e3-4b86-87d2-caa3c01a3b52 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:39.797042 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-722e6f05-c6e3-4b86-87d2-caa3c01a3b52 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 23007ef9-a0d3-42ff-b687-0f53086c8bcb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:39.803806 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-722e6f05-c6e3-4b86-87d2-caa3c01a3b52 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:39.804319 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-722e6f05-c6e3-4b86-87d2-caa3c01a3b52 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:39.804766 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-722e6f05-c6e3-4b86-87d2-caa3c01a3b52 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:39.805531 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-722e6f05-c6e3-4b86-87d2-caa3c01a3b52 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:39.806005 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-722e6f05-c6e3-4b86-87d2-caa3c01a3b52 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:39.806444 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-722e6f05-c6e3-4b86-87d2-caa3c01a3b52 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:40.103461 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-722e6f05-c6e3-4b86-87d2-caa3c01a3b52 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:40.113151 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-722e6f05-c6e3-4b86-87d2-caa3c01a3b52 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/23007ef9-a0d3-42ff-b687-0f53086c8bcb" status: 200 len: 1315 microversion: 2.1 time: 0.320634 Sep 08 10:47:40.128243 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1189/2352] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:39 2022] GET /compute/v2.1/servers/23007ef9-a0d3-42ff-b687-0f53086c8bcb => generated 1315 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:40.128243 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-e1750e04-e538-4a5a-a197-5afe4c4fc807 req-ea7161b3-97e7-49e0-be77-2386028919e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33157107-6744-4177-9c29-3822a7d34ff9", "name": "network-vif-deleted", "tag": "02aac401-313a-432e-9e68-b39f63c14e09"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:47:40.137265 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e1750e04-e538-4a5a-a197-5afe4c4fc807 req-ea7161b3-97e7-49e0-be77-2386028919e8 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:40.137265 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e1750e04-e538-4a5a-a197-5afe4c4fc807 req-ea7161b3-97e7-49e0-be77-2386028919e8 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:40.138776 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e1750e04-e538-4a5a-a197-5afe4c4fc807 req-ea7161b3-97e7-49e0-be77-2386028919e8 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:40.152545 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-e1750e04-e538-4a5a-a197-5afe4c4fc807 req-ea7161b3-97e7-49e0-be77-2386028919e8 service nova] Creating event network-vif-deleted:02aac401-313a-432e-9e68-b39f63c14e09 for instance 33157107-6744-4177-9c29-3822a7d34ff9 on n-h1-850501-12 Sep 08 10:47:40.159227 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-e1750e04-e538-4a5a-a197-5afe4c4fc807 req-ea7161b3-97e7-49e0-be77-2386028919e8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043408 Sep 08 10:47:40.160441 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1190/2353] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:47:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:47:40.169952 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3ca12f5d-e17d-4384-87a2-eaf114b9b176 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:40.173668 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3ca12f5d-e17d-4384-87a2-eaf114b9b176 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] [instance: 33157107-6744-4177-9c29-3822a7d34ff9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:40.183002 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3ca12f5d-e17d-4384-87a2-eaf114b9b176 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:40.183920 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3ca12f5d-e17d-4384-87a2-eaf114b9b176 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:40.184060 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3ca12f5d-e17d-4384-87a2-eaf114b9b176 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:40.185302 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3ca12f5d-e17d-4384-87a2-eaf114b9b176 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:40.185833 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3ca12f5d-e17d-4384-87a2-eaf114b9b176 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:40.186266 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3ca12f5d-e17d-4384-87a2-eaf114b9b176 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:40.227935 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3ca12f5d-e17d-4384-87a2-eaf114b9b176 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:40.228536 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3ca12f5d-e17d-4384-87a2-eaf114b9b176 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:40.228984 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3ca12f5d-e17d-4384-87a2-eaf114b9b176 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:40.229484 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-3ca12f5d-e17d-4384-87a2-eaf114b9b176 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lazy-loading 'fault' on Instance uuid 33157107-6744-4177-9c29-3822a7d34ff9 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:47:40.337482 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3ca12f5d-e17d-4384-87a2-eaf114b9b176 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416642c1ee664b4d9e0fb14d02266b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cfab473734f4b63aaa78508ef460a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:40.351390 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3ca12f5d-e17d-4384-87a2-eaf114b9b176 tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] 10.222.0.27 "GET /compute/v2.1/servers/33157107-6744-4177-9c29-3822a7d34ff9" status: 200 len: 1309 microversion: 2.1 time: 0.189550 Sep 08 10:47:40.355299 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1191/2354] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:40 2022] GET /compute/v2.1/servers/33157107-6744-4177-9c29-3822a7d34ff9 => generated 1309 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:40.365622 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-d9e180b4-255c-4925-a7fb-380ec494e42d req-abb21e94-1481-446a-8906-2cae52bb913b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23007ef9-a0d3-42ff-b687-0f53086c8bcb", "name": "network-vif-plugged", "status": "completed", "tag": "b375f03c-5802-4839-89db-d315a32c03c3"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:47:40.384170 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d9e180b4-255c-4925-a7fb-380ec494e42d req-abb21e94-1481-446a-8906-2cae52bb913b service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:40.384870 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d9e180b4-255c-4925-a7fb-380ec494e42d req-abb21e94-1481-446a-8906-2cae52bb913b service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:40.393580 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d9e180b4-255c-4925-a7fb-380ec494e42d req-abb21e94-1481-446a-8906-2cae52bb913b service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:40.416448 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-d9e180b4-255c-4925-a7fb-380ec494e42d req-abb21e94-1481-446a-8906-2cae52bb913b service nova] Creating event network-vif-plugged:b375f03c-5802-4839-89db-d315a32c03c3 for instance 23007ef9-a0d3-42ff-b687-0f53086c8bcb on n-h1-850501-12 Sep 08 10:47:40.423413 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-d9e180b4-255c-4925-a7fb-380ec494e42d req-abb21e94-1481-446a-8906-2cae52bb913b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064683 Sep 08 10:47:40.424475 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1192/2355] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:47:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:47:40.434256 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f153aeeb-cd08-4df6-b9b0-0003e8938d7b tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:40.435045 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f153aeeb-cd08-4df6-b9b0-0003e8938d7b tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: 3766b195-ace4-4563-a24e-dca72941251e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:40.441586 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f153aeeb-cd08-4df6-b9b0-0003e8938d7b tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:40.442328 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f153aeeb-cd08-4df6-b9b0-0003e8938d7b tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:40.442772 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f153aeeb-cd08-4df6-b9b0-0003e8938d7b tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:40.443484 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f153aeeb-cd08-4df6-b9b0-0003e8938d7b tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:40.443943 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f153aeeb-cd08-4df6-b9b0-0003e8938d7b tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:40.445065 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f153aeeb-cd08-4df6-b9b0-0003e8938d7b tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:40.584868 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-83d33613-497a-44bf-9652-2afa4e05cde4 tempest-SecurityGroupsTestAdminJSON-759946194 tempest-SecurityGroupsTestAdminJSON-759946194-project-admin] 10.222.0.27 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 12978 microversion: 2.1 time: 3.818394 Sep 08 10:47:40.586986 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1164/2356] 10.222.0.27 () {58 vars in 1191 bytes} [Thu Sep 8 10:47:36 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 12978 bytes in 3827 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:47:40.610860 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8aaaf31a-4e95-4196-bf01-e9772ea9c2ee tempest-SecurityGroupsTestAdminJSON-618746154 tempest-SecurityGroupsTestAdminJSON-618746154-project] Calling method '.version_select at 0x7f68e4babc10>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:40.707260 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f153aeeb-cd08-4df6-b9b0-0003e8938d7b tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:40.723725 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f153aeeb-cd08-4df6-b9b0-0003e8938d7b tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e" status: 200 len: 1472 microversion: 2.1 time: 0.297808 Sep 08 10:47:40.724326 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1193/2357] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:40 2022] GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e => generated 1472 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:40.799842 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-70c346f9-ef9b-4bb4-87a3-2f5649e914f7 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:40.800740 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-70c346f9-ef9b-4bb4-87a3-2f5649e914f7 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] [instance: 4703a7bf-a1ba-4bba-8928-3c403f3f3f21] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:40.844676 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70c346f9-ef9b-4bb4-87a3-2f5649e914f7 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:40.850988 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70c346f9-ef9b-4bb4-87a3-2f5649e914f7 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:40.851689 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70c346f9-ef9b-4bb4-87a3-2f5649e914f7 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:40.859377 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70c346f9-ef9b-4bb4-87a3-2f5649e914f7 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:40.862863 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70c346f9-ef9b-4bb4-87a3-2f5649e914f7 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:40.864317 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70c346f9-ef9b-4bb4-87a3-2f5649e914f7 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:41.074167 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8aaaf31a-4e95-4196-bf01-e9772ea9c2ee tempest-SecurityGroupsTestAdminJSON-618746154 tempest-SecurityGroupsTestAdminJSON-618746154-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1111 microversion: 2.1 time: 0.467494 Sep 08 10:47:41.075984 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1165/2358] 10.222.0.27 () {58 vars in 1191 bytes} [Thu Sep 8 10:47:40 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1111 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:47:41.253388 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-70c346f9-ef9b-4bb4-87a3-2f5649e914f7 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528fc9fbb57149c9a9c755c6497f5c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effe8e6c23114b8ab80e76bec365de60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:41.253888 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f0a9d429-d4f9-4d47-b93f-e144456f9fcc tempest-VolumesAdminNegativeTest-59402182 tempest-VolumesAdminNegativeTest-59402182-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "05a22eb2-342d-425c-84ac-0a8e16828fb8"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:47:41.257567 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f0a9d429-d4f9-4d47-b93f-e144456f9fcc tempest-VolumesAdminNegativeTest-59402182 tempest-VolumesAdminNegativeTest-59402182-project-admin] [instance: 72eb7387-3f16-4b4f-ab9a-89076f169fc1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:41.263486 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-70c346f9-ef9b-4bb4-87a3-2f5649e914f7 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] 10.222.0.27 "GET /compute/v2.1/servers/4703a7bf-a1ba-4bba-8928-3c403f3f3f21" status: 200 len: 1292 microversion: 2.1 time: 0.467984 Sep 08 10:47:41.269153 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f0a9d429-d4f9-4d47-b93f-e144456f9fcc tempest-VolumesAdminNegativeTest-59402182 tempest-VolumesAdminNegativeTest-59402182-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:41.269648 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f0a9d429-d4f9-4d47-b93f-e144456f9fcc tempest-VolumesAdminNegativeTest-59402182 tempest-VolumesAdminNegativeTest-59402182-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:41.270079 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f0a9d429-d4f9-4d47-b93f-e144456f9fcc tempest-VolumesAdminNegativeTest-59402182 tempest-VolumesAdminNegativeTest-59402182-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:41.270792 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f0a9d429-d4f9-4d47-b93f-e144456f9fcc tempest-VolumesAdminNegativeTest-59402182 tempest-VolumesAdminNegativeTest-59402182-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:41.271344 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f0a9d429-d4f9-4d47-b93f-e144456f9fcc tempest-VolumesAdminNegativeTest-59402182 tempest-VolumesAdminNegativeTest-59402182-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:41.271859 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f0a9d429-d4f9-4d47-b93f-e144456f9fcc tempest-VolumesAdminNegativeTest-59402182 tempest-VolumesAdminNegativeTest-59402182-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:41.279607 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1194/2359] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:40 2022] GET /compute/v2.1/servers/4703a7bf-a1ba-4bba-8928-3c403f3f3f21 => generated 1292 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:41.291062 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8c8edd08-8b0d-4093-8047-e34c6f320290 tempest-SecurityGroupsTestAdminJSON-759946194 tempest-SecurityGroupsTestAdminJSON-759946194-project-admin] Calling method '.version_select at 0x7f68e8aac550>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:41.393970 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-f0a9d429-d4f9-4d47-b93f-e144456f9fcc tempest-VolumesAdminNegativeTest-59402182 tempest-VolumesAdminNegativeTest-59402182-project-admin] HTTP exception thrown: Volume 05a22eb2-342d-425c-84ac-0a8e16828fb8 could not be found. Sep 08 10:47:41.431358 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f0a9d429-d4f9-4d47-b93f-e144456f9fcc tempest-VolumesAdminNegativeTest-59402182 tempest-VolumesAdminNegativeTest-59402182-project-admin] Request method failure captured: Sep 08 10:47:41.431358 n-d-850501-12 devstack@n-api.service[128861]: request: PUT /compute/v2.1/servers/72eb7387-3f16-4b4f-ab9a-89076f169fc1/os-volume_attachments/8ee9149a-f2d2-4d35-a01a-d5e55edacb51 HTTP/1.1 Sep 08 10:47:41.431358 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:47:41.431358 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:47:41.431358 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:47:41.431358 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 74 Sep 08 10:47:41.431358 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:47:41.431358 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:47:41.431358 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:47:41.431358 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:47:41.431358 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcfbFKlTCwWHFFOPmAUVuB82aWk1Htj_6lKieD2Sy7DL2r5XmOnqg5vW_y8nWtU3tRSX4w9iie5mdl0tZ3_CcCwv7gN58HTXqBZyM1qqfJbbLyEPnyuKmYuE6npubLeP0__n-4IcYql9yG3RKzRCrp5Wl556SZBc3tGFaCPZzt5HBbw Sep 08 10:47:41.431358 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:47:41.431358 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:47:41.431358 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:47:41.431358 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:47:41.431358 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:47:41.431358 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:47:41.431358 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: f470cdc994754253aac92469aec47c71 Sep 08 10:47:41.431358 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-VolumesAdminNegativeTest-59402182 Sep 08 10:47:41.431358 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,admin,member Sep 08 10:47:41.431358 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,admin,member Sep 08 10:47:41.431358 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f470cdc994754253aac92469aec47c71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f470cdc994754253aac92469aec47c71"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f470cdc994754253aac92469aec47c71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f470cdc994754253aac92469aec47c71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:47:41.431358 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-VolumesAdminNegativeTest-59402182 Sep 08 10:47:41.431358 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: f470cdc994754253aac92469aec47c71 Sep 08 10:47:41.431358 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-59402182 Sep 08 10:47:41.431358 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-VolumesAdminNegativeTest-59402182-project-admin Sep 08 10:47:41.431358 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:47:41.431358 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:47:41.431358 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 3904f480b7de47c68f779bebbff9889d Sep 08 10:47:41.431358 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-VolumesAdminNegativeTest-59402182-project-admin Sep 08 10:47:41.431358 n-d-850501-12 devstack@n-api.service[128861]: Sep 08 10:47:41.431358 n-d-850501-12 devstack@n-api.service[128861]: {"volumeAttachment": {"volumeId": "05a22eb2-342d-425c-84ac-0a8e16828fb8"}} Sep 08 10:47:41.431358 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:47:41.431358 n-d-850501-12 devstack@n-api.service[128861]: exception: Volume 05a22eb2-342d-425c-84ac-0a8e16828fb8 could not be found. Sep 08 10:47:41.431358 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'server_id': '72eb7387-3f16-4b4f-ab9a-89076f169fc1', 'id': '8ee9149a-f2d2-4d35-a01a-d5e55edacb51', 'body': {'volumeAttachment': {'volumeId': '05a22eb2-342d-425c-84ac-0a8e16828fb8'}}} Sep 08 10:47:41.431358 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:47:41.431358 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:41.431358 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 10:47:41.431358 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 10:47:41.431358 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 10:47:41.431358 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 10:47:41.431358 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 10:47:41.431358 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 10:47:41.431358 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 10:47:41.431358 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 10:47:41.431358 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 10:47:41.431358 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 10:47:41.431358 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 10:47:41.431358 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 10:47:41.431358 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 10:47:41.431358 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 10:47:41.431358 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 05a22eb2-342d-425c-84ac-0a8e16828fb8 could not be found. (HTTP 404) (Request-ID: req-6d96269a-7ece-482c-a774-be073796e670) Sep 08 10:47:41.431358 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:41.431358 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:41.431358 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:41.431358 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:41.431358 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Sep 08 10:47:41.431358 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Sep 08 10:47:41.431358 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 08 10:47:41.431358 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 08 10:47:41.431358 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 08 10:47:41.441007 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 08 10:47:41.441007 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 08 10:47:41.441007 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 08 10:47:41.441007 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 10:47:41.441007 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 10:47:41.441007 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 10:47:41.441007 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 10:47:41.441007 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 10:47:41.441007 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 10:47:41.441007 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 10:47:41.441007 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 10:47:41.441007 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 10:47:41.441007 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 10:47:41.441007 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 10:47:41.441007 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 10:47:41.441007 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 10:47:41.441007 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 10:47:41.441007 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 05a22eb2-342d-425c-84ac-0a8e16828fb8 could not be found. Sep 08 10:47:41.441007 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:41.441007 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:41.441007 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:41.441007 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:41.441007 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:47:41.441007 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:47:41.441007 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:47:41.441007 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:47:41.441007 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:47:41.441007 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:47:41.441007 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:47:41.441007 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:47:41.441007 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:47:41.441007 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:47:41.441007 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Sep 08 10:47:41.441007 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Sep 08 10:47:41.441007 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Sep 08 10:47:41.441007 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 08 10:47:41.441007 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 05a22eb2-342d-425c-84ac-0a8e16828fb8 could not be found. Sep 08 10:47:41.441007 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:41.441007 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:41.441007 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:41.441007 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:41.441007 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:47:41.441007 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:47:41.441007 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:47:41.441007 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:47:41.441007 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 05a22eb2-342d-425c-84ac-0a8e16828fb8 could not be found. Sep 08 10:47:41.441007 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:41.451027 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f0a9d429-d4f9-4d47-b93f-e144456f9fcc tempest-VolumesAdminNegativeTest-59402182 tempest-VolumesAdminNegativeTest-59402182-project-admin] Returning 400 to user: Volume 05a22eb2-342d-425c-84ac-0a8e16828fb8 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:47:41.451027 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f0a9d429-d4f9-4d47-b93f-e144456f9fcc tempest-VolumesAdminNegativeTest-59402182 tempest-VolumesAdminNegativeTest-59402182-project-admin] 10.222.0.27 "PUT /compute/v2.1/servers/72eb7387-3f16-4b4f-ab9a-89076f169fc1/os-volume_attachments/8ee9149a-f2d2-4d35-a01a-d5e55edacb51" status: 400 len: 107 microversion: 2.1 time: 0.371788 Sep 08 10:47:41.451027 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1166/2360] 10.222.0.27 () {60 vars in 1433 bytes} [Thu Sep 8 10:47:41 2022] PUT /compute/v2.1/servers/72eb7387-3f16-4b4f-ab9a-89076f169fc1/os-volume_attachments/8ee9149a-f2d2-4d35-a01a-d5e55edacb51 => generated 107 bytes in 374 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:47:41.460744 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-30411cce-64c4-4ebf-b3a7-cecde016d825 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:41.468144 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-30411cce-64c4-4ebf-b3a7-cecde016d825 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 23007ef9-a0d3-42ff-b687-0f53086c8bcb] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:41.478921 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-30411cce-64c4-4ebf-b3a7-cecde016d825 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:41.479417 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-30411cce-64c4-4ebf-b3a7-cecde016d825 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:41.480033 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-30411cce-64c4-4ebf-b3a7-cecde016d825 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:41.481774 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-30411cce-64c4-4ebf-b3a7-cecde016d825 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:41.482241 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-30411cce-64c4-4ebf-b3a7-cecde016d825 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:41.483190 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-30411cce-64c4-4ebf-b3a7-cecde016d825 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:41.658791 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-30411cce-64c4-4ebf-b3a7-cecde016d825 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:41.669649 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-30411cce-64c4-4ebf-b3a7-cecde016d825 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/23007ef9-a0d3-42ff-b687-0f53086c8bcb" status: 200 len: 1315 microversion: 2.1 time: 0.218342 Sep 08 10:47:41.670290 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1167/2361] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:41 2022] GET /compute/v2.1/servers/23007ef9-a0d3-42ff-b687-0f53086c8bcb => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:41.687844 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e5b2831c-f215-408c-9635-586a8624fe4f tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:41.688468 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e5b2831c-f215-408c-9635-586a8624fe4f tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] [instance: 33157107-6744-4177-9c29-3822a7d34ff9] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:41.695260 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e5b2831c-f215-408c-9635-586a8624fe4f tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:41.695742 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e5b2831c-f215-408c-9635-586a8624fe4f tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:41.697293 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e5b2831c-f215-408c-9635-586a8624fe4f tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:41.697508 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e5b2831c-f215-408c-9635-586a8624fe4f tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:41.697954 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e5b2831c-f215-408c-9635-586a8624fe4f tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:41.698627 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e5b2831c-f215-408c-9635-586a8624fe4f tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:41.713213 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8c8edd08-8b0d-4093-8047-e34c6f320290 tempest-SecurityGroupsTestAdminJSON-759946194 tempest-SecurityGroupsTestAdminJSON-759946194-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/79309bf7-7e39-4b7e-8eb1-9afb3d82614e" status: 202 len: 0 microversion: 2.1 time: 0.431345 Sep 08 10:47:41.715297 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1195/2362] 10.222.0.27 () {58 vars in 1272 bytes} [Thu Sep 8 10:47:41 2022] DELETE /compute/v2.1/os-security-groups/79309bf7-7e39-4b7e-8eb1-9afb3d82614e => generated 0 bytes in 435 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:47:41.716320 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-e5b2831c-f215-408c-9635-586a8624fe4f tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] HTTP exception thrown: Instance 33157107-6744-4177-9c29-3822a7d34ff9 could not be found. Sep 08 10:47:41.718209 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e5b2831c-f215-408c-9635-586a8624fe4f tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Request method failure captured: Sep 08 10:47:41.718209 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/33157107-6744-4177-9c29-3822a7d34ff9 HTTP/1.1 Sep 08 10:47:41.718209 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:47:41.718209 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:47:41.718209 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:47:41.718209 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:47:41.718209 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:47:41.718209 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:47:41.718209 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:47:41.718209 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:47:41.718209 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcgWHS8g8HfDzaCOR6R6omIsB-27l2SkfMDEmK8Ej90qbGG8BruWXQXq3HDTw5GnOnmHs2XMMprhqGeS-qMVHxJGv2bdLnMpi3Q8hAuDnSPAlqqP_PYqIFKMxTyNyLy5nLvA3TUg5iAkloX7pt2JntWkhM9bUJ_i3M8PGtSXwHgCoBM Sep 08 10:47:41.718209 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:47:41.718209 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:47:41.718209 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:47:41.718209 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:47:41.718209 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:47:41.718209 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:47:41.718209 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 7cfab473734f4b63aaa78508ef460a9f Sep 08 10:47:41.718209 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-LiveMigrationNegativeTest-1586069410 Sep 08 10:47:41.718209 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:47:41.718209 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:47:41.718209 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7cfab473734f4b63aaa78508ef460a9f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7cfab473734f4b63aaa78508ef460a9f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7cfab473734f4b63aaa78508ef460a9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7cfab473734f4b63aaa78508ef460a9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:47:41.718209 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-LiveMigrationNegativeTest-1586069410 Sep 08 10:47:41.718209 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 7cfab473734f4b63aaa78508ef460a9f Sep 08 10:47:41.718209 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1586069410 Sep 08 10:47:41.718209 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-LiveMigrationNegativeTest-1586069410-project Sep 08 10:47:41.718209 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:47:41.718209 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:47:41.718209 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 416642c1ee664b4d9e0fb14d02266b37 Sep 08 10:47:41.718209 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-LiveMigrationNegativeTest-1586069410-project Sep 08 10:47:41.718209 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:47:41.718209 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 33157107-6744-4177-9c29-3822a7d34ff9 could not be found. Sep 08 10:47:41.718209 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '33157107-6744-4177-9c29-3822a7d34ff9'} Sep 08 10:47:41.718209 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:47:41.718209 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:41.718209 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:47:41.718209 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:47:41.718209 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:47:41.718209 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:47:41.718209 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:47:41.718209 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:47:41.718209 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:47:41.718209 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:47:41.718209 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33157107-6744-4177-9c29-3822a7d34ff9 could not be found. Sep 08 10:47:41.718209 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:41.718209 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:41.718209 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:41.718209 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:41.718209 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:47:41.718209 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:47:41.718209 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:47:41.718209 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:47:41.718209 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:47:41.718209 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:47:41.718209 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:47:41.718209 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:47:41.718209 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:47:41.718209 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:47:41.718209 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:47:41.718209 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:47:41.718209 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33157107-6744-4177-9c29-3822a7d34ff9 could not be found. Sep 08 10:47:41.718209 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:41.718209 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:41.718209 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:41.722115 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:41.722115 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:47:41.722115 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:47:41.722115 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:47:41.722115 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:47:41.722115 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33157107-6744-4177-9c29-3822a7d34ff9 could not be found. Sep 08 10:47:41.722115 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:41.722115 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e5b2831c-f215-408c-9635-586a8624fe4f tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] Returning 404 to user: Instance 33157107-6744-4177-9c29-3822a7d34ff9 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:47:41.722115 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e5b2831c-f215-408c-9635-586a8624fe4f tempest-LiveMigrationNegativeTest-1586069410 tempest-LiveMigrationNegativeTest-1586069410-project] 10.222.0.27 "GET /compute/v2.1/servers/33157107-6744-4177-9c29-3822a7d34ff9" status: 404 len: 111 microversion: 2.1 time: 0.048728 Sep 08 10:47:41.722115 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1168/2363] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:41 2022] GET /compute/v2.1/servers/33157107-6744-4177-9c29-3822a7d34ff9 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:47:41.727705 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-dd01b4a9-7d69-4102-be38-5fcd679b5049 tempest-SecurityGroupsTestAdminJSON-759946194 tempest-SecurityGroupsTestAdminJSON-759946194-project-admin] Calling method '.version_select at 0x7f68e4ba3940>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:41.738123 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f81e3fc5-c071-4adc-8910-f1948de1058a tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:41.740854 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f81e3fc5-c071-4adc-8910-f1948de1058a tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] [instance: 72eb7387-3f16-4b4f-ab9a-89076f169fc1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:41.760991 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f81e3fc5-c071-4adc-8910-f1948de1058a tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:41.763676 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f81e3fc5-c071-4adc-8910-f1948de1058a tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:41.766432 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f81e3fc5-c071-4adc-8910-f1948de1058a tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:41.767445 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f81e3fc5-c071-4adc-8910-f1948de1058a tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:41.769055 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f81e3fc5-c071-4adc-8910-f1948de1058a tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:41.771603 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f81e3fc5-c071-4adc-8910-f1948de1058a tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:41.809942 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=10 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:47:41.911752 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-f81e3fc5-c071-4adc-8910-f1948de1058a tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lazy-loading 'services' on Instance uuid 72eb7387-3f16-4b4f-ab9a-89076f169fc1 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:47:42.005245 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-dd01b4a9-7d69-4102-be38-5fcd679b5049 tempest-SecurityGroupsTestAdminJSON-759946194 tempest-SecurityGroupsTestAdminJSON-759946194-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/d4a46a82-b783-47e5-9eaa-1abffa22c9b5" status: 202 len: 0 microversion: 2.1 time: 0.281001 Sep 08 10:47:42.006111 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1169/2364] 10.222.0.27 () {58 vars in 1272 bytes} [Thu Sep 8 10:47:41 2022] DELETE /compute/v2.1/os-security-groups/d4a46a82-b783-47e5-9eaa-1abffa22c9b5 => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:47:42.026930 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7d9f7c7b-1f39-42a7-9580-7941b903f913 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:42.027943 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7d9f7c7b-1f39-42a7-9580-7941b903f913 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: 3766b195-ace4-4563-a24e-dca72941251e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:42.031157 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f81e3fc5-c071-4adc-8910-f1948de1058a tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] 10.222.0.27 "DELETE /compute/v2.1/servers/72eb7387-3f16-4b4f-ab9a-89076f169fc1/os-volume_attachments/8ee9149a-f2d2-4d35-a01a-d5e55edacb51" status: 202 len: 0 microversion: 2.1 time: 0.313026 Sep 08 10:47:42.033418 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1196/2365] 10.222.0.27 () {58 vars in 1416 bytes} [Thu Sep 8 10:47:41 2022] DELETE /compute/v2.1/servers/72eb7387-3f16-4b4f-ab9a-89076f169fc1/os-volume_attachments/8ee9149a-f2d2-4d35-a01a-d5e55edacb51 => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:47:42.058759 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7d9f7c7b-1f39-42a7-9580-7941b903f913 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:42.060082 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7d9f7c7b-1f39-42a7-9580-7941b903f913 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:42.060776 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7d9f7c7b-1f39-42a7-9580-7941b903f913 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:42.061874 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7d9f7c7b-1f39-42a7-9580-7941b903f913 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:42.062841 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7d9f7c7b-1f39-42a7-9580-7941b903f913 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:42.063665 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7d9f7c7b-1f39-42a7-9580-7941b903f913 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:42.068228 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-831b77ab-4051-4758-9039-ae0289989122 tempest-SecurityGroupsTestAdminJSON-618746154 tempest-SecurityGroupsTestAdminJSON-618746154-project] Calling method '.version_select at 0x7f68e8ae7820>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:42.284360 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7d9f7c7b-1f39-42a7-9580-7941b903f913 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:42.315652 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7d9f7c7b-1f39-42a7-9580-7941b903f913 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e" status: 200 len: 1472 microversion: 2.1 time: 0.306017 Sep 08 10:47:42.344253 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1170/2366] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:42 2022] GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e => generated 1472 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:42.358617 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-83a7d301-047b-4ba2-8c1f-2ba3aac53c8b tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:42.370078 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-83a7d301-047b-4ba2-8c1f-2ba3aac53c8b tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] [instance: 72eb7387-3f16-4b4f-ab9a-89076f169fc1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:42.384072 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-83a7d301-047b-4ba2-8c1f-2ba3aac53c8b tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:42.384583 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-83a7d301-047b-4ba2-8c1f-2ba3aac53c8b tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:42.385044 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-83a7d301-047b-4ba2-8c1f-2ba3aac53c8b tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:42.385788 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-83a7d301-047b-4ba2-8c1f-2ba3aac53c8b tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:42.386255 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-83a7d301-047b-4ba2-8c1f-2ba3aac53c8b tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:42.386688 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-83a7d301-047b-4ba2-8c1f-2ba3aac53c8b tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:42.440852 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-83a7d301-047b-4ba2-8c1f-2ba3aac53c8b tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] 10.222.0.27 "GET /compute/v2.1/servers/72eb7387-3f16-4b4f-ab9a-89076f169fc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091758 Sep 08 10:47:42.442691 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1171/2367] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 10:47:42 2022] GET /compute/v2.1/servers/72eb7387-3f16-4b4f-ab9a-89076f169fc1/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:47:42.447955 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-93b53859-a16f-4a16-bfd2-c60973a421fd tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:42.448578 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-93b53859-a16f-4a16-bfd2-c60973a421fd tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] [instance: 4703a7bf-a1ba-4bba-8928-3c403f3f3f21] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:42.456339 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-93b53859-a16f-4a16-bfd2-c60973a421fd tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:42.456853 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-93b53859-a16f-4a16-bfd2-c60973a421fd tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:42.457352 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-93b53859-a16f-4a16-bfd2-c60973a421fd tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:42.458076 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-93b53859-a16f-4a16-bfd2-c60973a421fd tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:42.458543 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-93b53859-a16f-4a16-bfd2-c60973a421fd tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:42.458974 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-93b53859-a16f-4a16-bfd2-c60973a421fd tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:42.740368 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-831b77ab-4051-4758-9039-ae0289989122 tempest-SecurityGroupsTestAdminJSON-618746154 tempest-SecurityGroupsTestAdminJSON-618746154-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/425492d3-fc24-4684-a40f-9b165673bd23" status: 202 len: 0 microversion: 2.1 time: 0.683856 Sep 08 10:47:42.741973 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1197/2368] 10.222.0.27 () {58 vars in 1272 bytes} [Thu Sep 8 10:47:42 2022] DELETE /compute/v2.1/os-security-groups/425492d3-fc24-4684-a40f-9b165673bd23 => generated 0 bytes in 706 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:47:42.747493 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5adf206a-e966-40f6-bfaf-1d2bbd7d3429 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:42.749853 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5adf206a-e966-40f6-bfaf-1d2bbd7d3429 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 23007ef9-a0d3-42ff-b687-0f53086c8bcb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:42.764771 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5adf206a-e966-40f6-bfaf-1d2bbd7d3429 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:42.769902 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5adf206a-e966-40f6-bfaf-1d2bbd7d3429 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:42.770602 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5adf206a-e966-40f6-bfaf-1d2bbd7d3429 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:42.771580 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5adf206a-e966-40f6-bfaf-1d2bbd7d3429 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:42.774160 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5adf206a-e966-40f6-bfaf-1d2bbd7d3429 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:42.779239 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5adf206a-e966-40f6-bfaf-1d2bbd7d3429 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:42.806384 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-93b53859-a16f-4a16-bfd2-c60973a421fd tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528fc9fbb57149c9a9c755c6497f5c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effe8e6c23114b8ab80e76bec365de60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:42.815706 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-93b53859-a16f-4a16-bfd2-c60973a421fd tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] 10.222.0.27 "GET /compute/v2.1/servers/4703a7bf-a1ba-4bba-8928-3c403f3f3f21" status: 200 len: 1292 microversion: 2.1 time: 0.371919 Sep 08 10:47:42.819716 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1172/2369] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:42 2022] GET /compute/v2.1/servers/4703a7bf-a1ba-4bba-8928-3c403f3f3f21 => generated 1292 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:42.838128 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0a0ce6f4-3c98-4309-8aca-bc7ad7637517 tempest-SecurityGroupsTestAdminJSON-618746154 tempest-SecurityGroupsTestAdminJSON-618746154-project] Calling method '.version_select at 0x7f68e4d14e50>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:43.141218 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5adf206a-e966-40f6-bfaf-1d2bbd7d3429 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:43.154650 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5adf206a-e966-40f6-bfaf-1d2bbd7d3429 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/23007ef9-a0d3-42ff-b687-0f53086c8bcb" status: 200 len: 1502 microversion: 2.1 time: 0.411133 Sep 08 10:47:43.155261 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1198/2370] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:42 2022] GET /compute/v2.1/servers/23007ef9-a0d3-42ff-b687-0f53086c8bcb => generated 1502 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:43.186690 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8b8b6454-7760-4361-a60b-d38802ea7953 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:47:43.187275 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8b8b6454-7760-4361-a60b-d38802ea7953 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 23007ef9-a0d3-42ff-b687-0f53086c8bcb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:43.208383 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8b8b6454-7760-4361-a60b-d38802ea7953 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:43.210466 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8b8b6454-7760-4361-a60b-d38802ea7953 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:43.211715 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8b8b6454-7760-4361-a60b-d38802ea7953 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:43.213391 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8b8b6454-7760-4361-a60b-d38802ea7953 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:43.214075 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8b8b6454-7760-4361-a60b-d38802ea7953 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:43.215108 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8b8b6454-7760-4361-a60b-d38802ea7953 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:43.218864 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0a0ce6f4-3c98-4309-8aca-bc7ad7637517 tempest-SecurityGroupsTestAdminJSON-618746154 tempest-SecurityGroupsTestAdminJSON-618746154-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/9f10e6ba-52b4-46d0-a70b-e6e79d03050b" status: 202 len: 0 microversion: 2.1 time: 0.397615 Sep 08 10:47:43.220738 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1173/2371] 10.222.0.27 () {58 vars in 1272 bytes} [Thu Sep 8 10:47:42 2022] DELETE /compute/v2.1/os-security-groups/9f10e6ba-52b4-46d0-a70b-e6e79d03050b => generated 0 bytes in 400 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:47:43.300062 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-8b8b6454-7760-4361-a60b-d38802ea7953 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lazy-loading 'flavor' on Instance uuid 23007ef9-a0d3-42ff-b687-0f53086c8bcb {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:47:43.350411 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-392b7f27-e392-4a9b-a644-8c9aff2711e1 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:43.357595 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-392b7f27-e392-4a9b-a644-8c9aff2711e1 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: 3766b195-ace4-4563-a24e-dca72941251e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:43.379765 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-392b7f27-e392-4a9b-a644-8c9aff2711e1 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:43.381938 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-392b7f27-e392-4a9b-a644-8c9aff2711e1 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:43.382645 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-392b7f27-e392-4a9b-a644-8c9aff2711e1 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:43.396338 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-392b7f27-e392-4a9b-a644-8c9aff2711e1 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:43.396830 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-392b7f27-e392-4a9b-a644-8c9aff2711e1 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:43.397898 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-392b7f27-e392-4a9b-a644-8c9aff2711e1 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:43.574874 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8b8b6454-7760-4361-a60b-d38802ea7953 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "POST /compute/v2.1/servers/23007ef9-a0d3-42ff-b687-0f53086c8bcb/action" status: 202 len: 0 microversion: 2.1 time: 0.393095 Sep 08 10:47:43.595681 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1199/2372] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:47:43 2022] POST /compute/v2.1/servers/23007ef9-a0d3-42ff-b687-0f53086c8bcb/action => generated 0 bytes in 414 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:47:43.632070 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-43dca319-76f9-4c42-a8bc-d97f8b80c379 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:43.638039 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-43dca319-76f9-4c42-a8bc-d97f8b80c379 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] [instance: 72eb7387-3f16-4b4f-ab9a-89076f169fc1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:43.648881 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:47:43.651956 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-43dca319-76f9-4c42-a8bc-d97f8b80c379 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:43.653625 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-43dca319-76f9-4c42-a8bc-d97f8b80c379 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:43.654878 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-43dca319-76f9-4c42-a8bc-d97f8b80c379 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:43.656330 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-43dca319-76f9-4c42-a8bc-d97f8b80c379 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:43.656967 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-43dca319-76f9-4c42-a8bc-d97f8b80c379 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:43.658499 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-43dca319-76f9-4c42-a8bc-d97f8b80c379 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:43.690657 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:47:43.694125 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-392b7f27-e392-4a9b-a644-8c9aff2711e1 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:43.710865 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-392b7f27-e392-4a9b-a644-8c9aff2711e1 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e" status: 200 len: 1472 microversion: 2.1 time: 0.363927 Sep 08 10:47:43.713851 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1174/2373] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:43 2022] GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e => generated 1472 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:47:43.726892 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a6d3f670-ba45-4054-bad6-b3f052440a5d tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:43.729255 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a6d3f670-ba45-4054-bad6-b3f052440a5d tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 23007ef9-a0d3-42ff-b687-0f53086c8bcb] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:43.743795 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a6d3f670-ba45-4054-bad6-b3f052440a5d tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:43.744955 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a6d3f670-ba45-4054-bad6-b3f052440a5d tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:43.745869 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a6d3f670-ba45-4054-bad6-b3f052440a5d tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:43.759275 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a6d3f670-ba45-4054-bad6-b3f052440a5d tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:43.764837 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a6d3f670-ba45-4054-bad6-b3f052440a5d tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:43.765814 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a6d3f670-ba45-4054-bad6-b3f052440a5d tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:43.795350 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-43dca319-76f9-4c42-a8bc-d97f8b80c379 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] 10.222.0.27 "GET /compute/v2.1/servers/72eb7387-3f16-4b4f-ab9a-89076f169fc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.195561 Sep 08 10:47:43.797055 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1200/2374] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 10:47:43 2022] GET /compute/v2.1/servers/72eb7387-3f16-4b4f-ab9a-89076f169fc1/os-volume_attachments => generated 197 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:47:43.850496 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7a8cbfbd-f5c2-4f80-ac49-5b8ca7032850 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:43.851580 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7a8cbfbd-f5c2-4f80-ac49-5b8ca7032850 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] [instance: 4703a7bf-a1ba-4bba-8928-3c403f3f3f21] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:43.881765 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7a8cbfbd-f5c2-4f80-ac49-5b8ca7032850 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:43.886168 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7a8cbfbd-f5c2-4f80-ac49-5b8ca7032850 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:43.891060 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7a8cbfbd-f5c2-4f80-ac49-5b8ca7032850 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:43.891778 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7a8cbfbd-f5c2-4f80-ac49-5b8ca7032850 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:43.894632 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7a8cbfbd-f5c2-4f80-ac49-5b8ca7032850 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:43.896198 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7a8cbfbd-f5c2-4f80-ac49-5b8ca7032850 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:44.186390 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a6d3f670-ba45-4054-bad6-b3f052440a5d tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:44.207787 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a6d3f670-ba45-4054-bad6-b3f052440a5d tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/23007ef9-a0d3-42ff-b687-0f53086c8bcb" status: 200 len: 1510 microversion: 2.1 time: 0.491546 Sep 08 10:47:44.208397 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1175/2375] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:43 2022] GET /compute/v2.1/servers/23007ef9-a0d3-42ff-b687-0f53086c8bcb => generated 1510 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:44.515938 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7a8cbfbd-f5c2-4f80-ac49-5b8ca7032850 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528fc9fbb57149c9a9c755c6497f5c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effe8e6c23114b8ab80e76bec365de60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:44.538044 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7a8cbfbd-f5c2-4f80-ac49-5b8ca7032850 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] 10.222.0.27 "GET /compute/v2.1/servers/4703a7bf-a1ba-4bba-8928-3c403f3f3f21" status: 200 len: 1292 microversion: 2.1 time: 0.697032 Sep 08 10:47:44.545099 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1201/2376] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:43 2022] GET /compute/v2.1/servers/4703a7bf-a1ba-4bba-8928-3c403f3f3f21 => generated 1292 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:47:44.745653 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f9e0725d-49ec-4f43-a530-2d64214ec79c tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:44.746843 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f9e0725d-49ec-4f43-a530-2d64214ec79c tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: 3766b195-ace4-4563-a24e-dca72941251e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:44.766781 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:47:44.783173 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f9e0725d-49ec-4f43-a530-2d64214ec79c tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:44.783880 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f9e0725d-49ec-4f43-a530-2d64214ec79c tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:44.789579 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f9e0725d-49ec-4f43-a530-2d64214ec79c tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:44.790745 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f9e0725d-49ec-4f43-a530-2d64214ec79c tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:44.794912 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f9e0725d-49ec-4f43-a530-2d64214ec79c tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:44.795704 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f9e0725d-49ec-4f43-a530-2d64214ec79c tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:44.814373 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1253f9ca-e07f-4247-bc29-af35c2d3ac77 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:44.817342 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1253f9ca-e07f-4247-bc29-af35c2d3ac77 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] [instance: 72eb7387-3f16-4b4f-ab9a-89076f169fc1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:44.844831 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1253f9ca-e07f-4247-bc29-af35c2d3ac77 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:44.845621 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1253f9ca-e07f-4247-bc29-af35c2d3ac77 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:44.849695 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1253f9ca-e07f-4247-bc29-af35c2d3ac77 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:44.852254 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1253f9ca-e07f-4247-bc29-af35c2d3ac77 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:44.860115 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1253f9ca-e07f-4247-bc29-af35c2d3ac77 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:44.860115 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1253f9ca-e07f-4247-bc29-af35c2d3ac77 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:44.934803 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1253f9ca-e07f-4247-bc29-af35c2d3ac77 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] 10.222.0.27 "GET /compute/v2.1/servers/72eb7387-3f16-4b4f-ab9a-89076f169fc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.126131 Sep 08 10:47:44.935837 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1202/2377] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 10:47:44 2022] GET /compute/v2.1/servers/72eb7387-3f16-4b4f-ab9a-89076f169fc1/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:47:45.080686 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f9e0725d-49ec-4f43-a530-2d64214ec79c tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:45.095709 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f9e0725d-49ec-4f43-a530-2d64214ec79c tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e" status: 200 len: 1472 microversion: 2.1 time: 0.354334 Sep 08 10:47:45.098344 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1176/2378] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:44 2022] GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e => generated 1472 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:45.235595 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ea768976-5429-4938-a7ed-907015c61593 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:45.236227 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ea768976-5429-4938-a7ed-907015c61593 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 23007ef9-a0d3-42ff-b687-0f53086c8bcb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:45.254990 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea768976-5429-4938-a7ed-907015c61593 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:45.255550 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea768976-5429-4938-a7ed-907015c61593 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:45.256002 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea768976-5429-4938-a7ed-907015c61593 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:45.256761 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea768976-5429-4938-a7ed-907015c61593 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:45.257372 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea768976-5429-4938-a7ed-907015c61593 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:45.284020 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea768976-5429-4938-a7ed-907015c61593 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:45.565776 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-79538678-4b10-4d28-a698-ba271b50bff1 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:45.566412 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-79538678-4b10-4d28-a698-ba271b50bff1 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] [instance: 4703a7bf-a1ba-4bba-8928-3c403f3f3f21] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:45.589182 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-79538678-4b10-4d28-a698-ba271b50bff1 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:45.589813 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-79538678-4b10-4d28-a698-ba271b50bff1 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:45.590269 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-79538678-4b10-4d28-a698-ba271b50bff1 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:45.591845 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-79538678-4b10-4d28-a698-ba271b50bff1 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:45.592574 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-79538678-4b10-4d28-a698-ba271b50bff1 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:45.593228 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-79538678-4b10-4d28-a698-ba271b50bff1 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:45.785942 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ea768976-5429-4938-a7ed-907015c61593 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:45.798243 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ea768976-5429-4938-a7ed-907015c61593 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/23007ef9-a0d3-42ff-b687-0f53086c8bcb" status: 200 len: 1493 microversion: 2.1 time: 0.567297 Sep 08 10:47:45.802720 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1203/2379] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:45 2022] GET /compute/v2.1/servers/23007ef9-a0d3-42ff-b687-0f53086c8bcb => generated 1493 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:45.860055 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dba802c7-9107-42d7-a573-15c7347bbea4 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:45.860624 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-dba802c7-9107-42d7-a573-15c7347bbea4 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 23007ef9-a0d3-42ff-b687-0f53086c8bcb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:45.884416 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dba802c7-9107-42d7-a573-15c7347bbea4 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:45.906651 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-79538678-4b10-4d28-a698-ba271b50bff1 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528fc9fbb57149c9a9c755c6497f5c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effe8e6c23114b8ab80e76bec365de60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:45.920878 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-79538678-4b10-4d28-a698-ba271b50bff1 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] 10.222.0.27 "GET /compute/v2.1/servers/4703a7bf-a1ba-4bba-8928-3c403f3f3f21" status: 200 len: 1292 microversion: 2.1 time: 0.360404 Sep 08 10:47:45.922319 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1177/2380] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:45 2022] GET /compute/v2.1/servers/4703a7bf-a1ba-4bba-8928-3c403f3f3f21 => generated 1292 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:47:45.924265 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dba802c7-9107-42d7-a573-15c7347bbea4 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:45.925341 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dba802c7-9107-42d7-a573-15c7347bbea4 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.040s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:45.929335 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dba802c7-9107-42d7-a573-15c7347bbea4 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:45.934221 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dba802c7-9107-42d7-a573-15c7347bbea4 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:45.941216 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dba802c7-9107-42d7-a573-15c7347bbea4 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:45.948819 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-19d32975-90f2-4dd1-9aba-6a399e4bd296 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:45.956389 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-19d32975-90f2-4dd1-9aba-6a399e4bd296 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] [instance: 72eb7387-3f16-4b4f-ab9a-89076f169fc1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:45.965122 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-19d32975-90f2-4dd1-9aba-6a399e4bd296 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:45.966546 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-19d32975-90f2-4dd1-9aba-6a399e4bd296 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:45.968788 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-19d32975-90f2-4dd1-9aba-6a399e4bd296 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:45.973408 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-19d32975-90f2-4dd1-9aba-6a399e4bd296 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:45.974166 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-19d32975-90f2-4dd1-9aba-6a399e4bd296 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:45.974711 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-19d32975-90f2-4dd1-9aba-6a399e4bd296 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:45.995243 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-dba802c7-9107-42d7-a573-15c7347bbea4 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 23007ef9-a0d3-42ff-b687-0f53086c8bcb] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:47:46.082428 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-19d32975-90f2-4dd1-9aba-6a399e4bd296 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] 10.222.0.27 "GET /compute/v2.1/servers/72eb7387-3f16-4b4f-ab9a-89076f169fc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.138019 Sep 08 10:47:46.088552 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1178/2381] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 10:47:45 2022] GET /compute/v2.1/servers/72eb7387-3f16-4b4f-ab9a-89076f169fc1/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:47:46.112319 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-dba802c7-9107-42d7-a573-15c7347bbea4 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "DELETE /compute/v2.1/servers/23007ef9-a0d3-42ff-b687-0f53086c8bcb" status: 204 len: 0 microversion: 2.1 time: 0.287538 Sep 08 10:47:46.116485 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1204/2382] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:47:45 2022] DELETE /compute/v2.1/servers/23007ef9-a0d3-42ff-b687-0f53086c8bcb => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:47:46.122760 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-871cf129-3a56-4081-a94a-6e9858261366 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:46.123714 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-871cf129-3a56-4081-a94a-6e9858261366 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 23007ef9-a0d3-42ff-b687-0f53086c8bcb] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:46.132405 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-871cf129-3a56-4081-a94a-6e9858261366 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:46.138144 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-871cf129-3a56-4081-a94a-6e9858261366 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:46.138572 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-871cf129-3a56-4081-a94a-6e9858261366 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:46.139341 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-871cf129-3a56-4081-a94a-6e9858261366 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:46.139827 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-871cf129-3a56-4081-a94a-6e9858261366 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:46.140259 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-871cf129-3a56-4081-a94a-6e9858261366 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:46.140806 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-88110def-8a77-4382-b6b1-add58cb1b720 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:46.141603 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-88110def-8a77-4382-b6b1-add58cb1b720 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: 3766b195-ace4-4563-a24e-dca72941251e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:46.162274 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-88110def-8a77-4382-b6b1-add58cb1b720 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:46.162728 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-88110def-8a77-4382-b6b1-add58cb1b720 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:46.163179 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-88110def-8a77-4382-b6b1-add58cb1b720 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:46.163941 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-88110def-8a77-4382-b6b1-add58cb1b720 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:46.164798 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-88110def-8a77-4382-b6b1-add58cb1b720 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:46.165268 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-88110def-8a77-4382-b6b1-add58cb1b720 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:46.396569 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-88110def-8a77-4382-b6b1-add58cb1b720 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:46.404661 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-871cf129-3a56-4081-a94a-6e9858261366 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:46.408464 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-88110def-8a77-4382-b6b1-add58cb1b720 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e" status: 200 len: 1472 microversion: 2.1 time: 0.279742 Sep 08 10:47:46.409879 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1205/2383] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:46 2022] GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e => generated 1472 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:46.416310 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-871cf129-3a56-4081-a94a-6e9858261366 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/23007ef9-a0d3-42ff-b687-0f53086c8bcb" status: 200 len: 1499 microversion: 2.1 time: 0.298044 Sep 08 10:47:46.427986 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1179/2384] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:46 2022] GET /compute/v2.1/servers/23007ef9-a0d3-42ff-b687-0f53086c8bcb => generated 1499 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:46.945430 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f8f57142-3e60-4607-ae3b-7a91804a3f0a tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:46.946060 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f8f57142-3e60-4607-ae3b-7a91804a3f0a tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] [instance: 4703a7bf-a1ba-4bba-8928-3c403f3f3f21] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:46.954288 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f8f57142-3e60-4607-ae3b-7a91804a3f0a tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:46.955184 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f8f57142-3e60-4607-ae3b-7a91804a3f0a tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:46.955792 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f8f57142-3e60-4607-ae3b-7a91804a3f0a tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:46.956684 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f8f57142-3e60-4607-ae3b-7a91804a3f0a tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:46.957212 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f8f57142-3e60-4607-ae3b-7a91804a3f0a tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:46.957648 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f8f57142-3e60-4607-ae3b-7a91804a3f0a tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:47.098401 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8d0864fd-4423-4ece-ad1d-a78537a26354 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:47.101810 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8d0864fd-4423-4ece-ad1d-a78537a26354 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] [instance: 72eb7387-3f16-4b4f-ab9a-89076f169fc1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:47.121619 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8d0864fd-4423-4ece-ad1d-a78537a26354 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:47.122666 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8d0864fd-4423-4ece-ad1d-a78537a26354 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:47.125273 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8d0864fd-4423-4ece-ad1d-a78537a26354 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:47.126186 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8d0864fd-4423-4ece-ad1d-a78537a26354 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:47.129647 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8d0864fd-4423-4ece-ad1d-a78537a26354 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:47.131050 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8d0864fd-4423-4ece-ad1d-a78537a26354 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:47.148922 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f8f57142-3e60-4607-ae3b-7a91804a3f0a tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528fc9fbb57149c9a9c755c6497f5c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effe8e6c23114b8ab80e76bec365de60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:47.159990 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f8f57142-3e60-4607-ae3b-7a91804a3f0a tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] 10.222.0.27 "GET /compute/v2.1/servers/4703a7bf-a1ba-4bba-8928-3c403f3f3f21" status: 200 len: 1292 microversion: 2.1 time: 0.218396 Sep 08 10:47:47.161162 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1206/2385] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:46 2022] GET /compute/v2.1/servers/4703a7bf-a1ba-4bba-8928-3c403f3f3f21 => generated 1292 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:47.205958 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8d0864fd-4423-4ece-ad1d-a78537a26354 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] 10.222.0.27 "GET /compute/v2.1/servers/72eb7387-3f16-4b4f-ab9a-89076f169fc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113430 Sep 08 10:47:47.210993 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1180/2386] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 10:47:47 2022] GET /compute/v2.1/servers/72eb7387-3f16-4b4f-ab9a-89076f169fc1/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:47:47.432685 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-135303d2-5b81-43ea-af0f-5558e96ca509 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:47.432996 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-135303d2-5b81-43ea-af0f-5558e96ca509 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: 3766b195-ace4-4563-a24e-dca72941251e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:47.443304 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-135303d2-5b81-43ea-af0f-5558e96ca509 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:47.443810 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-135303d2-5b81-43ea-af0f-5558e96ca509 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:47.445746 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-135303d2-5b81-43ea-af0f-5558e96ca509 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:47.448573 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-135303d2-5b81-43ea-af0f-5558e96ca509 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:47.461814 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-135303d2-5b81-43ea-af0f-5558e96ca509 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:47.462276 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-135303d2-5b81-43ea-af0f-5558e96ca509 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:47.463175 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-783b21b7-adb4-4997-af91-ec8234004b04 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:47.470414 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-783b21b7-adb4-4997-af91-ec8234004b04 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 23007ef9-a0d3-42ff-b687-0f53086c8bcb] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:47.493744 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-783b21b7-adb4-4997-af91-ec8234004b04 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:47.497339 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-783b21b7-adb4-4997-af91-ec8234004b04 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:47.497588 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-783b21b7-adb4-4997-af91-ec8234004b04 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:47.499559 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-783b21b7-adb4-4997-af91-ec8234004b04 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:47.501436 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-783b21b7-adb4-4997-af91-ec8234004b04 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:47.502503 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-783b21b7-adb4-4997-af91-ec8234004b04 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:47.716841 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-783b21b7-adb4-4997-af91-ec8234004b04 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:47.729780 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-783b21b7-adb4-4997-af91-ec8234004b04 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/23007ef9-a0d3-42ff-b687-0f53086c8bcb" status: 200 len: 1499 microversion: 2.1 time: 0.285957 Sep 08 10:47:47.744751 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1181/2387] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:47 2022] GET /compute/v2.1/servers/23007ef9-a0d3-42ff-b687-0f53086c8bcb => generated 1499 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:47:47.764198 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-135303d2-5b81-43ea-af0f-5558e96ca509 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:47.776425 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-135303d2-5b81-43ea-af0f-5558e96ca509 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e" status: 200 len: 1472 microversion: 2.1 time: 0.347424 Sep 08 10:47:47.777447 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1207/2388] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:47 2022] GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e => generated 1472 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:48.150969 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8ee0b2b5-0fe5-4ca8-91c7-dcfe897a484e tempest-ServicesAdminNegativeV253TestJSON-2067962234 tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin] Action: 'update', calling method: .version_select at 0x7f68e4bdeca0>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:47:48.158400 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8ee0b2b5-0fe5-4ca8-91c7-dcfe897a484e tempest-ServicesAdminNegativeV253TestJSON-2067962234 tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:48.163253 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8ee0b2b5-0fe5-4ca8-91c7-dcfe897a484e tempest-ServicesAdminNegativeV253TestJSON-2067962234 tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:48.164953 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8ee0b2b5-0fe5-4ca8-91c7-dcfe897a484e tempest-ServicesAdminNegativeV253TestJSON-2067962234 tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:48.184851 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8ee0b2b5-0fe5-4ca8-91c7-dcfe897a484e tempest-ServicesAdminNegativeV253TestJSON-2067962234 tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:48.186040 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8ee0b2b5-0fe5-4ca8-91c7-dcfe897a484e tempest-ServicesAdminNegativeV253TestJSON-2067962234 tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:48.186751 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8ee0b2b5-0fe5-4ca8-91c7-dcfe897a484e tempest-ServicesAdminNegativeV253TestJSON-2067962234 tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:48.192867 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fc99e495-1786-4947-aee5-0810ea0dd8c3 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:48.195655 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fc99e495-1786-4947-aee5-0810ea0dd8c3 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] [instance: 4703a7bf-a1ba-4bba-8928-3c403f3f3f21] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:48.198459 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-8ee0b2b5-0fe5-4ca8-91c7-dcfe897a484e tempest-ServicesAdminNegativeV253TestJSON-2067962234 tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin] HTTP exception thrown: Service 896d0366-6519-4115-af1e-7fa14db729dc could not be found. Sep 08 10:47:48.201344 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8ee0b2b5-0fe5-4ca8-91c7-dcfe897a484e tempest-ServicesAdminNegativeV253TestJSON-2067962234 tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin] Request method failure captured: Sep 08 10:47:48.201344 n-d-850501-12 devstack@n-api.service[128861]: request: PUT /compute/v2.1/os-services/896d0366-6519-4115-af1e-7fa14db729dc HTTP/1.1 Sep 08 10:47:48.201344 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:47:48.201344 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:47:48.201344 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:47:48.201344 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 56 Sep 08 10:47:48.201344 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:47:48.201344 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:47:48.201344 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:47:48.201344 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:47:48.201344 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGchTJv_m0kHZeJ72iL3mvHbot7syBbkAtdfIfLlKZ9_gVugEMsRquMHoplLqxnjcpPBWkuuPKekfdr9jxNiMLbhHwLdmfGoUlf65ZBAJawWiTp3X4f6dYa3mS8MmSwbmBKRfTppKfIRrcCsBlV9SqqcHojPPlx-H8P2TclcyyVbLb9Y Sep 08 10:47:48.201344 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:47:48.201344 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:47:48.201344 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:47:48.201344 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:47:48.201344 n-d-850501-12 devstack@n-api.service[128861]: X-Openstack-Nova-Api-Version: 2.53 Sep 08 10:47:48.201344 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:47:48.201344 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:47:48.201344 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 74a12066be354795857a1596b8aaf8f1 Sep 08 10:47:48.201344 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-2067962234 Sep 08 10:47:48.201344 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,admin,member Sep 08 10:47:48.201344 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,admin,member Sep 08 10:47:48.201344 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/74a12066be354795857a1596b8aaf8f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/74a12066be354795857a1596b8aaf8f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_74a12066be354795857a1596b8aaf8f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/74a12066be354795857a1596b8aaf8f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:47:48.201344 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-2067962234 Sep 08 10:47:48.201344 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 74a12066be354795857a1596b8aaf8f1 Sep 08 10:47:48.201344 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-2067962234 Sep 08 10:47:48.201344 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin Sep 08 10:47:48.201344 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:47:48.201344 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:47:48.201344 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 42fbd19dec014539bd7882fc7af6a9bf Sep 08 10:47:48.201344 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin Sep 08 10:47:48.201344 n-d-850501-12 devstack@n-api.service[128861]: Sep 08 10:47:48.201344 n-d-850501-12 devstack@n-api.service[128861]: {"status": "disabled", "disabled_reason": "maintenance"} Sep 08 10:47:48.201344 n-d-850501-12 devstack@n-api.service[128861]: method: Sep 08 10:47:48.201344 n-d-850501-12 devstack@n-api.service[128861]: exception: Service 896d0366-6519-4115-af1e-7fa14db729dc could not be found. Sep 08 10:47:48.201344 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '896d0366-6519-4115-af1e-7fa14db729dc', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Sep 08 10:47:48.201344 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:47:48.201344 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:48.201344 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Sep 08 10:47:48.201344 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Sep 08 10:47:48.201344 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 08 10:47:48.201344 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 08 10:47:48.201344 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 08 10:47:48.201344 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:48.201344 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:48.201344 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:48.201344 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:48.201344 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Sep 08 10:47:48.201344 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Sep 08 10:47:48.201344 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Sep 08 10:47:48.201344 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Sep 08 10:47:48.201344 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 896d0366-6519-4115-af1e-7fa14db729dc could not be found. Sep 08 10:47:48.201344 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:48.201344 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:48.201344 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:48.201344 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:48.201344 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:47:48.201344 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:47:48.201344 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:47:48.201344 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:47:48.201344 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:47:48.201344 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:47:48.201344 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:47:48.201344 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:47:48.201344 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:47:48.201344 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:47:48.206786 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Sep 08 10:47:48.206786 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:47:48.206786 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 896d0366-6519-4115-af1e-7fa14db729dc could not be found. Sep 08 10:47:48.206786 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:48.206786 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:48.206786 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:48.206786 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:48.206786 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:47:48.206786 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:47:48.206786 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:47:48.206786 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:47:48.206786 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 896d0366-6519-4115-af1e-7fa14db729dc could not be found. Sep 08 10:47:48.206786 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:48.210199 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8ee0b2b5-0fe5-4ca8-91c7-dcfe897a484e tempest-ServicesAdminNegativeV253TestJSON-2067962234 tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin] Returning 404 to user: Service 896d0366-6519-4115-af1e-7fa14db729dc could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:47:48.211373 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8ee0b2b5-0fe5-4ca8-91c7-dcfe897a484e tempest-ServicesAdminNegativeV253TestJSON-2067962234 tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-services/896d0366-6519-4115-af1e-7fa14db729dc" status: 404 len: 110 microversion: 2.53 time: 0.475701 Sep 08 10:47:48.212533 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1182/2389] 10.222.0.27 () {62 vars in 1309 bytes} [Thu Sep 8 10:47:47 2022] PUT /compute/v2.1/os-services/896d0366-6519-4115-af1e-7fa14db729dc => generated 110 bytes in 477 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:47:48.215817 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fc99e495-1786-4947-aee5-0810ea0dd8c3 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:48.222178 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fc99e495-1786-4947-aee5-0810ea0dd8c3 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:48.223387 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fc99e495-1786-4947-aee5-0810ea0dd8c3 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:48.225881 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-610a13bb-a656-4742-818c-daf567dee1a8 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:48.226203 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fc99e495-1786-4947-aee5-0810ea0dd8c3 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:48.226876 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fc99e495-1786-4947-aee5-0810ea0dd8c3 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:48.228812 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fc99e495-1786-4947-aee5-0810ea0dd8c3 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:48.234288 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-610a13bb-a656-4742-818c-daf567dee1a8 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] [instance: 72eb7387-3f16-4b4f-ab9a-89076f169fc1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:48.248865 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-610a13bb-a656-4742-818c-daf567dee1a8 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:48.250190 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-610a13bb-a656-4742-818c-daf567dee1a8 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:48.250849 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-610a13bb-a656-4742-818c-daf567dee1a8 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:48.252499 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-610a13bb-a656-4742-818c-daf567dee1a8 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:48.255536 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-610a13bb-a656-4742-818c-daf567dee1a8 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:48.256238 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-610a13bb-a656-4742-818c-daf567dee1a8 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:48.341904 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:47:48.360312 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-610a13bb-a656-4742-818c-daf567dee1a8 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] 10.222.0.27 "GET /compute/v2.1/servers/72eb7387-3f16-4b4f-ab9a-89076f169fc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.142306 Sep 08 10:47:48.362214 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1183/2390] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 10:47:48 2022] GET /compute/v2.1/servers/72eb7387-3f16-4b4f-ab9a-89076f169fc1/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:47:48.367403 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ba3da176-ab5c-4811-b7d1-ab318882b3df tempest-ServicesAdminNegativeV253TestJSON-2067962234 tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin] Action: 'update', calling method: .version_select at 0x7f68e4d68700>, body: {"status": "disabled"} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:47:48.372446 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ba3da176-ab5c-4811-b7d1-ab318882b3df tempest-ServicesAdminNegativeV253TestJSON-2067962234 tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:48.373245 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ba3da176-ab5c-4811-b7d1-ab318882b3df tempest-ServicesAdminNegativeV253TestJSON-2067962234 tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:48.374056 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ba3da176-ab5c-4811-b7d1-ab318882b3df tempest-ServicesAdminNegativeV253TestJSON-2067962234 tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:48.381376 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ba3da176-ab5c-4811-b7d1-ab318882b3df tempest-ServicesAdminNegativeV253TestJSON-2067962234 tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:48.382469 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ba3da176-ab5c-4811-b7d1-ab318882b3df tempest-ServicesAdminNegativeV253TestJSON-2067962234 tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:48.383284 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ba3da176-ab5c-4811-b7d1-ab318882b3df tempest-ServicesAdminNegativeV253TestJSON-2067962234 tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:48.391532 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-ba3da176-ab5c-4811-b7d1-ab318882b3df tempest-ServicesAdminNegativeV253TestJSON-2067962234 tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin] HTTP exception thrown: Service 896d0366-6519-4115-af1e-7fa14db729dc could not be found. Sep 08 10:47:48.394371 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ba3da176-ab5c-4811-b7d1-ab318882b3df tempest-ServicesAdminNegativeV253TestJSON-2067962234 tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin] Request method failure captured: Sep 08 10:47:48.394371 n-d-850501-12 devstack@n-api.service[128861]: request: PUT /compute/v2.1/os-services/896d0366-6519-4115-af1e-7fa14db729dc HTTP/1.1 Sep 08 10:47:48.394371 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:47:48.394371 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:47:48.394371 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:47:48.394371 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 22 Sep 08 10:47:48.394371 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:47:48.394371 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:47:48.394371 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:47:48.394371 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:47:48.394371 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGchTJv_m0kHZeJ72iL3mvHbot7syBbkAtdfIfLlKZ9_gVugEMsRquMHoplLqxnjcpPBWkuuPKekfdr9jxNiMLbhHwLdmfGoUlf65ZBAJawWiTp3X4f6dYa3mS8MmSwbmBKRfTppKfIRrcCsBlV9SqqcHojPPlx-H8P2TclcyyVbLb9Y Sep 08 10:47:48.394371 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:47:48.394371 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:47:48.394371 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:47:48.394371 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:47:48.394371 n-d-850501-12 devstack@n-api.service[128861]: X-Openstack-Nova-Api-Version: 2.53 Sep 08 10:47:48.394371 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:47:48.394371 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:47:48.394371 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 74a12066be354795857a1596b8aaf8f1 Sep 08 10:47:48.394371 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-2067962234 Sep 08 10:47:48.394371 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,admin,member Sep 08 10:47:48.394371 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,admin,member Sep 08 10:47:48.394371 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/74a12066be354795857a1596b8aaf8f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/74a12066be354795857a1596b8aaf8f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_74a12066be354795857a1596b8aaf8f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/74a12066be354795857a1596b8aaf8f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:47:48.394371 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-2067962234 Sep 08 10:47:48.394371 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 74a12066be354795857a1596b8aaf8f1 Sep 08 10:47:48.394371 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-2067962234 Sep 08 10:47:48.394371 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin Sep 08 10:47:48.394371 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:47:48.394371 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:47:48.394371 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 42fbd19dec014539bd7882fc7af6a9bf Sep 08 10:47:48.394371 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin Sep 08 10:47:48.394371 n-d-850501-12 devstack@n-api.service[128861]: Sep 08 10:47:48.394371 n-d-850501-12 devstack@n-api.service[128861]: {"status": "disabled"} Sep 08 10:47:48.394371 n-d-850501-12 devstack@n-api.service[128861]: method: Sep 08 10:47:48.394371 n-d-850501-12 devstack@n-api.service[128861]: exception: Service 896d0366-6519-4115-af1e-7fa14db729dc could not be found. Sep 08 10:47:48.394371 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '896d0366-6519-4115-af1e-7fa14db729dc', 'body': {'status': 'disabled'}} Sep 08 10:47:48.394371 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:47:48.394371 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:48.394371 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Sep 08 10:47:48.394371 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Sep 08 10:47:48.394371 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 08 10:47:48.394371 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 08 10:47:48.394371 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 08 10:47:48.394371 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:48.394371 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:48.394371 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:48.394371 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:48.394371 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Sep 08 10:47:48.394371 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Sep 08 10:47:48.394371 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Sep 08 10:47:48.394371 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Sep 08 10:47:48.394371 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 896d0366-6519-4115-af1e-7fa14db729dc could not be found. Sep 08 10:47:48.394371 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:48.394371 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:48.394371 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:48.394371 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:48.394371 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:47:48.394371 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:47:48.394371 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:47:48.394371 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:47:48.394371 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:47:48.394371 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:47:48.394371 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:47:48.394371 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:47:48.394371 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:47:48.394371 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:47:48.398564 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Sep 08 10:47:48.398564 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:47:48.398564 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 896d0366-6519-4115-af1e-7fa14db729dc could not be found. Sep 08 10:47:48.398564 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:48.398564 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:48.398564 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:48.398564 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:48.398564 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:47:48.398564 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:47:48.398564 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:47:48.398564 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:47:48.398564 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 896d0366-6519-4115-af1e-7fa14db729dc could not be found. Sep 08 10:47:48.398564 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:48.400566 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ba3da176-ab5c-4811-b7d1-ab318882b3df tempest-ServicesAdminNegativeV253TestJSON-2067962234 tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin] Returning 404 to user: Service 896d0366-6519-4115-af1e-7fa14db729dc could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:47:48.401693 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ba3da176-ab5c-4811-b7d1-ab318882b3df tempest-ServicesAdminNegativeV253TestJSON-2067962234 tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-services/896d0366-6519-4115-af1e-7fa14db729dc" status: 404 len: 110 microversion: 2.53 time: 0.038363 Sep 08 10:47:48.408564 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1184/2391] 10.222.0.27 () {62 vars in 1309 bytes} [Thu Sep 8 10:47:48 2022] PUT /compute/v2.1/os-services/896d0366-6519-4115-af1e-7fa14db729dc => generated 110 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:47:48.416034 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8f9d42fe-a606-4663-b405-fd8e62905dd5 tempest-ServicesAdminNegativeV253TestJSON-2067962234 tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin] Action: 'update', calling method: .version_select at 0x7f68e4a77160>, body: {"status": "enabled"} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:47:48.421210 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f9d42fe-a606-4663-b405-fd8e62905dd5 tempest-ServicesAdminNegativeV253TestJSON-2067962234 tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:48.422010 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f9d42fe-a606-4663-b405-fd8e62905dd5 tempest-ServicesAdminNegativeV253TestJSON-2067962234 tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:48.422806 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f9d42fe-a606-4663-b405-fd8e62905dd5 tempest-ServicesAdminNegativeV253TestJSON-2067962234 tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:48.432105 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f9d42fe-a606-4663-b405-fd8e62905dd5 tempest-ServicesAdminNegativeV253TestJSON-2067962234 tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:48.433152 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f9d42fe-a606-4663-b405-fd8e62905dd5 tempest-ServicesAdminNegativeV253TestJSON-2067962234 tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:48.433811 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f9d42fe-a606-4663-b405-fd8e62905dd5 tempest-ServicesAdminNegativeV253TestJSON-2067962234 tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:48.440766 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-8f9d42fe-a606-4663-b405-fd8e62905dd5 tempest-ServicesAdminNegativeV253TestJSON-2067962234 tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin] HTTP exception thrown: Service 896d0366-6519-4115-af1e-7fa14db729dc could not be found. Sep 08 10:47:48.443108 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8f9d42fe-a606-4663-b405-fd8e62905dd5 tempest-ServicesAdminNegativeV253TestJSON-2067962234 tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin] Request method failure captured: Sep 08 10:47:48.443108 n-d-850501-12 devstack@n-api.service[128861]: request: PUT /compute/v2.1/os-services/896d0366-6519-4115-af1e-7fa14db729dc HTTP/1.1 Sep 08 10:47:48.443108 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:47:48.443108 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:47:48.443108 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:47:48.443108 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 21 Sep 08 10:47:48.443108 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:47:48.443108 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:47:48.443108 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:47:48.443108 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:47:48.443108 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGchTJv_m0kHZeJ72iL3mvHbot7syBbkAtdfIfLlKZ9_gVugEMsRquMHoplLqxnjcpPBWkuuPKekfdr9jxNiMLbhHwLdmfGoUlf65ZBAJawWiTp3X4f6dYa3mS8MmSwbmBKRfTppKfIRrcCsBlV9SqqcHojPPlx-H8P2TclcyyVbLb9Y Sep 08 10:47:48.443108 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:47:48.443108 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:47:48.443108 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:47:48.443108 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:47:48.443108 n-d-850501-12 devstack@n-api.service[128861]: X-Openstack-Nova-Api-Version: 2.53 Sep 08 10:47:48.443108 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:47:48.443108 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:47:48.443108 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 74a12066be354795857a1596b8aaf8f1 Sep 08 10:47:48.443108 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-2067962234 Sep 08 10:47:48.443108 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,admin,member Sep 08 10:47:48.443108 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,admin,member Sep 08 10:47:48.443108 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/74a12066be354795857a1596b8aaf8f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/74a12066be354795857a1596b8aaf8f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_74a12066be354795857a1596b8aaf8f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/74a12066be354795857a1596b8aaf8f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:47:48.443108 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-2067962234 Sep 08 10:47:48.443108 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 74a12066be354795857a1596b8aaf8f1 Sep 08 10:47:48.443108 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-2067962234 Sep 08 10:47:48.443108 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin Sep 08 10:47:48.443108 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:47:48.443108 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:47:48.443108 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 42fbd19dec014539bd7882fc7af6a9bf Sep 08 10:47:48.443108 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin Sep 08 10:47:48.443108 n-d-850501-12 devstack@n-api.service[128861]: Sep 08 10:47:48.443108 n-d-850501-12 devstack@n-api.service[128861]: {"status": "enabled"} Sep 08 10:47:48.443108 n-d-850501-12 devstack@n-api.service[128861]: method: Sep 08 10:47:48.443108 n-d-850501-12 devstack@n-api.service[128861]: exception: Service 896d0366-6519-4115-af1e-7fa14db729dc could not be found. Sep 08 10:47:48.443108 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '896d0366-6519-4115-af1e-7fa14db729dc', 'body': {'status': 'enabled'}} Sep 08 10:47:48.443108 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:47:48.443108 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:48.443108 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Sep 08 10:47:48.443108 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Sep 08 10:47:48.443108 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 08 10:47:48.443108 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 08 10:47:48.443108 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 08 10:47:48.443108 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:48.443108 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:48.443108 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:48.443108 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:48.443108 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Sep 08 10:47:48.443108 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Sep 08 10:47:48.443108 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Sep 08 10:47:48.443108 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Sep 08 10:47:48.443108 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 896d0366-6519-4115-af1e-7fa14db729dc could not be found. Sep 08 10:47:48.443108 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:48.443108 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:48.443108 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:48.443108 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:48.443108 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:47:48.443108 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:47:48.443108 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:47:48.443108 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:47:48.443108 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:47:48.443108 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:47:48.443108 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:47:48.443108 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:47:48.443108 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:47:48.443108 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:47:48.446765 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Sep 08 10:47:48.446765 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:47:48.446765 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 896d0366-6519-4115-af1e-7fa14db729dc could not be found. Sep 08 10:47:48.446765 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:48.446765 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:48.446765 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:48.446765 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:48.446765 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:47:48.446765 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:47:48.446765 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:47:48.446765 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:47:48.446765 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 896d0366-6519-4115-af1e-7fa14db729dc could not be found. Sep 08 10:47:48.446765 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:48.447456 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8f9d42fe-a606-4663-b405-fd8e62905dd5 tempest-ServicesAdminNegativeV253TestJSON-2067962234 tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin] Returning 404 to user: Service 896d0366-6519-4115-af1e-7fa14db729dc could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:47:48.448434 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8f9d42fe-a606-4663-b405-fd8e62905dd5 tempest-ServicesAdminNegativeV253TestJSON-2067962234 tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-services/896d0366-6519-4115-af1e-7fa14db729dc" status: 404 len: 110 microversion: 2.53 time: 0.037147 Sep 08 10:47:48.458069 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1185/2392] 10.222.0.27 () {62 vars in 1309 bytes} [Thu Sep 8 10:47:48 2022] PUT /compute/v2.1/os-services/896d0366-6519-4115-af1e-7fa14db729dc => generated 110 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:47:48.484841 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d08b356b-6617-4da4-a342-9da28016b43d tempest-ServicesAdminNegativeV253TestJSON-2067962234 tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:48.488551 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d08b356b-6617-4da4-a342-9da28016b43d tempest-ServicesAdminNegativeV253TestJSON-2067962234 tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:48.494822 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d08b356b-6617-4da4-a342-9da28016b43d tempest-ServicesAdminNegativeV253TestJSON-2067962234 tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:48.495384 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d08b356b-6617-4da4-a342-9da28016b43d tempest-ServicesAdminNegativeV253TestJSON-2067962234 tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:48.497534 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d08b356b-6617-4da4-a342-9da28016b43d tempest-ServicesAdminNegativeV253TestJSON-2067962234 tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:48.499215 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d08b356b-6617-4da4-a342-9da28016b43d tempest-ServicesAdminNegativeV253TestJSON-2067962234 tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:48.499768 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d08b356b-6617-4da4-a342-9da28016b43d tempest-ServicesAdminNegativeV253TestJSON-2067962234 tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:48.566367 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d08b356b-6617-4da4-a342-9da28016b43d tempest-ServicesAdminNegativeV253TestJSON-2067962234 tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.098373 Sep 08 10:47:48.567041 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1186/2393] 10.222.0.27 () {60 vars in 1178 bytes} [Thu Sep 8 10:47:48 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:47:48.589394 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-75305ac9-b749-4aab-8e2a-1cfe57f6e930 tempest-ServicesAdminNegativeV253TestJSON-2067962234 tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:48.602502 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-75305ac9-b749-4aab-8e2a-1cfe57f6e930 tempest-ServicesAdminNegativeV253TestJSON-2067962234 tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:48.605436 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-75305ac9-b749-4aab-8e2a-1cfe57f6e930 tempest-ServicesAdminNegativeV253TestJSON-2067962234 tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:48.606821 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-75305ac9-b749-4aab-8e2a-1cfe57f6e930 tempest-ServicesAdminNegativeV253TestJSON-2067962234 tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:48.610720 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-75305ac9-b749-4aab-8e2a-1cfe57f6e930 tempest-ServicesAdminNegativeV253TestJSON-2067962234 tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:48.611826 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-75305ac9-b749-4aab-8e2a-1cfe57f6e930 tempest-ServicesAdminNegativeV253TestJSON-2067962234 tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:48.613885 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-75305ac9-b749-4aab-8e2a-1cfe57f6e930 tempest-ServicesAdminNegativeV253TestJSON-2067962234 tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:48.702126 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-75305ac9-b749-4aab-8e2a-1cfe57f6e930 tempest-ServicesAdminNegativeV253TestJSON-2067962234 tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.120388 Sep 08 10:47:48.702802 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1187/2394] 10.222.0.27 () {60 vars in 1211 bytes} [Thu Sep 8 10:47:48 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1244 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:47:48.703817 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fc99e495-1786-4947-aee5-0810ea0dd8c3 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528fc9fbb57149c9a9c755c6497f5c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effe8e6c23114b8ab80e76bec365de60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:48.725861 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fc99e495-1786-4947-aee5-0810ea0dd8c3 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] 10.222.0.27 "GET /compute/v2.1/servers/4703a7bf-a1ba-4bba-8928-3c403f3f3f21" status: 200 len: 1292 microversion: 2.1 time: 0.530707 Sep 08 10:47:48.728501 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f73b886e-f7ff-4eb9-8ae2-19b7b8f4ca62 tempest-ServicesAdminNegativeV253TestJSON-2067962234 tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:48.742100 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f73b886e-f7ff-4eb9-8ae2-19b7b8f4ca62 tempest-ServicesAdminNegativeV253TestJSON-2067962234 tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:48.742511 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f73b886e-f7ff-4eb9-8ae2-19b7b8f4ca62 tempest-ServicesAdminNegativeV253TestJSON-2067962234 tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:48.744746 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f73b886e-f7ff-4eb9-8ae2-19b7b8f4ca62 tempest-ServicesAdminNegativeV253TestJSON-2067962234 tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:48.749914 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f73b886e-f7ff-4eb9-8ae2-19b7b8f4ca62 tempest-ServicesAdminNegativeV253TestJSON-2067962234 tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:48.751616 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1208/2395] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:48 2022] GET /compute/v2.1/servers/4703a7bf-a1ba-4bba-8928-3c403f3f3f21 => generated 1292 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:47:48.752047 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f73b886e-f7ff-4eb9-8ae2-19b7b8f4ca62 tempest-ServicesAdminNegativeV253TestJSON-2067962234 tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:48.754845 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f73b886e-f7ff-4eb9-8ae2-19b7b8f4ca62 tempest-ServicesAdminNegativeV253TestJSON-2067962234 tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:48.772188 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dd0e4f17-9b48-42b3-9b70-2cb7dfa09b8d tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:48.774216 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-dd0e4f17-9b48-42b3-9b70-2cb7dfa09b8d tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 23007ef9-a0d3-42ff-b687-0f53086c8bcb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:48.793051 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f73b886e-f7ff-4eb9-8ae2-19b7b8f4ca62 tempest-ServicesAdminNegativeV253TestJSON-2067962234 tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.078487 Sep 08 10:47:48.795662 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1188/2396] 10.222.0.27 () {60 vars in 1178 bytes} [Thu Sep 8 10:47:48 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:47:48.801287 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-aa046e04-b7b7-4154-b7b8-600d9095778c req-b90859f6-db24-41be-90db-61dd227a104e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23007ef9-a0d3-42ff-b687-0f53086c8bcb", "name": "network-vif-deleted", "tag": "b375f03c-5802-4839-89db-d315a32c03c3"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:47:48.813989 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-aa046e04-b7b7-4154-b7b8-600d9095778c req-b90859f6-db24-41be-90db-61dd227a104e service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:48.814539 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-aa046e04-b7b7-4154-b7b8-600d9095778c req-b90859f6-db24-41be-90db-61dd227a104e service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:48.814982 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-aa046e04-b7b7-4154-b7b8-600d9095778c req-b90859f6-db24-41be-90db-61dd227a104e service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:48.819680 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd0e4f17-9b48-42b3-9b70-2cb7dfa09b8d tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:48.823478 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd0e4f17-9b48-42b3-9b70-2cb7dfa09b8d tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:48.824428 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd0e4f17-9b48-42b3-9b70-2cb7dfa09b8d tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:48.828272 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd0e4f17-9b48-42b3-9b70-2cb7dfa09b8d tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:48.833080 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd0e4f17-9b48-42b3-9b70-2cb7dfa09b8d tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:48.834043 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd0e4f17-9b48-42b3-9b70-2cb7dfa09b8d tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:48.850061 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-aa046e04-b7b7-4154-b7b8-600d9095778c req-b90859f6-db24-41be-90db-61dd227a104e service nova] Creating event network-vif-deleted:b375f03c-5802-4839-89db-d315a32c03c3 for instance 23007ef9-a0d3-42ff-b687-0f53086c8bcb on n-h1-850501-12 Sep 08 10:47:48.861416 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-aa046e04-b7b7-4154-b7b8-600d9095778c req-b90859f6-db24-41be-90db-61dd227a104e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064331 Sep 08 10:47:48.866614 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1189/2397] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:47:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:47:48.884945 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7f9fb8f0-4170-46d0-affe-011db0082421 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:48.888141 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7f9fb8f0-4170-46d0-affe-011db0082421 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: 3766b195-ace4-4563-a24e-dca72941251e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:48.904391 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7f9fb8f0-4170-46d0-affe-011db0082421 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:48.904895 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7f9fb8f0-4170-46d0-affe-011db0082421 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:48.905360 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7f9fb8f0-4170-46d0-affe-011db0082421 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:48.909015 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7f9fb8f0-4170-46d0-affe-011db0082421 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:48.909699 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7f9fb8f0-4170-46d0-affe-011db0082421 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:48.910041 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7f9fb8f0-4170-46d0-affe-011db0082421 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:49.109094 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-dd0e4f17-9b48-42b3-9b70-2cb7dfa09b8d tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08269c53bcb41c88953e7c79f5ad185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998378cc815344ba8a107d1cd61f40fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:49.124785 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-dd0e4f17-9b48-42b3-9b70-2cb7dfa09b8d tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/23007ef9-a0d3-42ff-b687-0f53086c8bcb" status: 200 len: 1291 microversion: 2.1 time: 0.371977 Sep 08 10:47:49.129086 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1209/2398] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:48 2022] GET /compute/v2.1/servers/23007ef9-a0d3-42ff-b687-0f53086c8bcb => generated 1291 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:49.141385 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ab56dd93-9bfb-475d-af66-3d2e2f19a725 tempest-ServicesAdminNegativeV253TestJSON-2067962234 tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:49.149811 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab56dd93-9bfb-475d-af66-3d2e2f19a725 tempest-ServicesAdminNegativeV253TestJSON-2067962234 tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:49.151102 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab56dd93-9bfb-475d-af66-3d2e2f19a725 tempest-ServicesAdminNegativeV253TestJSON-2067962234 tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:49.153891 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab56dd93-9bfb-475d-af66-3d2e2f19a725 tempest-ServicesAdminNegativeV253TestJSON-2067962234 tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:49.156801 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab56dd93-9bfb-475d-af66-3d2e2f19a725 tempest-ServicesAdminNegativeV253TestJSON-2067962234 tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:49.157549 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab56dd93-9bfb-475d-af66-3d2e2f19a725 tempest-ServicesAdminNegativeV253TestJSON-2067962234 tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:49.159394 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab56dd93-9bfb-475d-af66-3d2e2f19a725 tempest-ServicesAdminNegativeV253TestJSON-2067962234 tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:49.239943 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ab56dd93-9bfb-475d-af66-3d2e2f19a725 tempest-ServicesAdminNegativeV253TestJSON-2067962234 tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?host=n-d-850501-12&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.105326 Sep 08 10:47:49.240970 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1210/2399] 10.222.0.27 () {60 vars in 1237 bytes} [Thu Sep 8 10:47:49 2022] GET /compute/v2.1/os-services?host=n-d-850501-12&binary=xxx => generated 16 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:49.262931 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7f9fb8f0-4170-46d0-affe-011db0082421 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:49.263714 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a8a6a998-b510-48df-8527-3bce28b79553 tempest-ServicesAdminNegativeV253TestJSON-2067962234 tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:49.268582 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a8a6a998-b510-48df-8527-3bce28b79553 tempest-ServicesAdminNegativeV253TestJSON-2067962234 tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:49.269537 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a8a6a998-b510-48df-8527-3bce28b79553 tempest-ServicesAdminNegativeV253TestJSON-2067962234 tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:49.270242 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a8a6a998-b510-48df-8527-3bce28b79553 tempest-ServicesAdminNegativeV253TestJSON-2067962234 tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:49.271218 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a8a6a998-b510-48df-8527-3bce28b79553 tempest-ServicesAdminNegativeV253TestJSON-2067962234 tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:49.271984 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a8a6a998-b510-48df-8527-3bce28b79553 tempest-ServicesAdminNegativeV253TestJSON-2067962234 tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:49.272710 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a8a6a998-b510-48df-8527-3bce28b79553 tempest-ServicesAdminNegativeV253TestJSON-2067962234 tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:49.276357 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7f9fb8f0-4170-46d0-affe-011db0082421 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e" status: 200 len: 1472 microversion: 2.1 time: 0.408409 Sep 08 10:47:49.280613 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1190/2400] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:48 2022] GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e => generated 1472 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:49.304226 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a8a6a998-b510-48df-8527-3bce28b79553 tempest-ServicesAdminNegativeV253TestJSON-2067962234 tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.053666 Sep 08 10:47:49.305676 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1211/2401] 10.222.0.27 () {60 vars in 1178 bytes} [Thu Sep 8 10:47:49 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:47:49.320612 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1f751e75-10f5-4764-8e9e-a6ba620bc7cc tempest-ServicesAdminNegativeV253TestJSON-2067962234 tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:49.324734 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1f751e75-10f5-4764-8e9e-a6ba620bc7cc tempest-ServicesAdminNegativeV253TestJSON-2067962234 tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:49.325565 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1f751e75-10f5-4764-8e9e-a6ba620bc7cc tempest-ServicesAdminNegativeV253TestJSON-2067962234 tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:49.326212 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1f751e75-10f5-4764-8e9e-a6ba620bc7cc tempest-ServicesAdminNegativeV253TestJSON-2067962234 tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:49.327139 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1f751e75-10f5-4764-8e9e-a6ba620bc7cc tempest-ServicesAdminNegativeV253TestJSON-2067962234 tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:49.327964 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1f751e75-10f5-4764-8e9e-a6ba620bc7cc tempest-ServicesAdminNegativeV253TestJSON-2067962234 tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:49.328462 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1f751e75-10f5-4764-8e9e-a6ba620bc7cc tempest-ServicesAdminNegativeV253TestJSON-2067962234 tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:49.360257 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1f751e75-10f5-4764-8e9e-a6ba620bc7cc tempest-ServicesAdminNegativeV253TestJSON-2067962234 tempest-ServicesAdminNegativeV253TestJSON-2067962234-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor" status: 200 len: 16 microversion: 2.53 time: 0.043996 Sep 08 10:47:49.361550 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1191/2402] 10.222.0.27 () {60 vars in 1239 bytes} [Thu Sep 8 10:47:49 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor => generated 16 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:49.375374 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-66277208-c024-477c-afa9-1305198b77b5 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:49.378231 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-66277208-c024-477c-afa9-1305198b77b5 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] [instance: 72eb7387-3f16-4b4f-ab9a-89076f169fc1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:49.405397 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-66277208-c024-477c-afa9-1305198b77b5 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:49.409148 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-66277208-c024-477c-afa9-1305198b77b5 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:49.409541 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-66277208-c024-477c-afa9-1305198b77b5 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:49.412124 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-66277208-c024-477c-afa9-1305198b77b5 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:49.412660 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-66277208-c024-477c-afa9-1305198b77b5 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:49.414254 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-66277208-c024-477c-afa9-1305198b77b5 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:49.459045 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-66277208-c024-477c-afa9-1305198b77b5 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] 10.222.0.27 "GET /compute/v2.1/servers/72eb7387-3f16-4b4f-ab9a-89076f169fc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088382 Sep 08 10:47:49.465933 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1212/2403] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 10:47:49 2022] GET /compute/v2.1/servers/72eb7387-3f16-4b4f-ab9a-89076f169fc1/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:47:49.648144 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a50957c9-52bc-45c2-af3c-43e6af02a661 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1753855471", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:47:49.719007 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-dccad78f-e2c2-4b89-9217-e55b4cbdf376 tempest-ServicesAdminNegativeV253TestJSON-751510220 tempest-ServicesAdminNegativeV253TestJSON-751510220-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:49.727641 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-dccad78f-e2c2-4b89-9217-e55b4cbdf376 tempest-ServicesAdminNegativeV253TestJSON-751510220 tempest-ServicesAdminNegativeV253TestJSON-751510220-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'fababe02be24445b8e5a06ca79cd6367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db47e59b1854db9ba1e8fd7e27e8cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:49.733988 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-dccad78f-e2c2-4b89-9217-e55b4cbdf376 tempest-ServicesAdminNegativeV253TestJSON-751510220 tempest-ServicesAdminNegativeV253TestJSON-751510220-project] Request method failure captured: Sep 08 10:47:49.733988 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/os-services HTTP/1.1 Sep 08 10:47:49.733988 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:47:49.733988 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:47:49.733988 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:47:49.733988 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:47:49.733988 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:47:49.733988 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:47:49.733988 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:47:49.733988 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:47:49.733988 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGchRxudfuvfH6_64Ov9RxLAmm0uldKGrO4CivG9C1yOPq5F-50JoeU_k9NXd_LiPQu4pekI4HeQpxNxL6lhjUyevHkZgkLY6ZdxntGUSxQmshkGakujD52LpMBHhH-KasRHAt6jEiNEuHpReTSu8ldAWa4XWxjw38gUqov5rVeMJE0E Sep 08 10:47:49.733988 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:47:49.733988 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:47:49.733988 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:47:49.733988 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:47:49.733988 n-d-850501-12 devstack@n-api.service[128861]: X-Openstack-Nova-Api-Version: 2.53 Sep 08 10:47:49.733988 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:47:49.733988 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:47:49.733988 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 7db47e59b1854db9ba1e8fd7e27e8cc4 Sep 08 10:47:49.733988 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-751510220 Sep 08 10:47:49.733988 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:47:49.733988 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:47:49.733988 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7db47e59b1854db9ba1e8fd7e27e8cc4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7db47e59b1854db9ba1e8fd7e27e8cc4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7db47e59b1854db9ba1e8fd7e27e8cc4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7db47e59b1854db9ba1e8fd7e27e8cc4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:47:49.733988 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-751510220 Sep 08 10:47:49.733988 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 7db47e59b1854db9ba1e8fd7e27e8cc4 Sep 08 10:47:49.733988 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-751510220 Sep 08 10:47:49.733988 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServicesAdminNegativeV253TestJSON-751510220-project Sep 08 10:47:49.733988 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:47:49.733988 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:47:49.733988 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: fababe02be24445b8e5a06ca79cd6367 Sep 08 10:47:49.733988 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-751510220-project Sep 08 10:47:49.733988 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:47:49.733988 n-d-850501-12 devstack@n-api.service[128861]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 08 10:47:49.733988 n-d-850501-12 devstack@n-api.service[128861]: action_args: {} Sep 08 10:47:49.733988 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:47:49.733988 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:49.733988 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:47:49.733988 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:47:49.733988 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:47:49.733988 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:47:49.733988 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 08 10:47:49.733988 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:47:49.733988 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 08 10:47:49.733988 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:47:49.733988 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:47:49.733988 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:47:49.733988 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Sep 08 10:47:49.733988 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Sep 08 10:47:49.733988 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 10:47:49.733988 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 10:47:49.733988 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 10:47:49.733988 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 10:47:49.733988 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:47:49.733988 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:47:49.733988 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:47:49.733988 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:47:49.733988 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 10:47:49.733988 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 10:47:49.733988 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 10:47:49.733988 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 10:47:49.733988 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 10:47:49.733988 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 10:47:49.733988 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 08 10:47:49.738291 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:49.738291 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:49.738291 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:49.738291 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:49.738291 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:47:49.738291 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:47:49.738291 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 10:47:49.738291 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 10:47:49.738291 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 08 10:47:49.738291 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:49.742662 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-dccad78f-e2c2-4b89-9217-e55b4cbdf376 tempest-ServicesAdminNegativeV253TestJSON-751510220 tempest-ServicesAdminNegativeV253TestJSON-751510220-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:47:49.743591 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-dccad78f-e2c2-4b89-9217-e55b4cbdf376 tempest-ServicesAdminNegativeV253TestJSON-751510220 tempest-ServicesAdminNegativeV253TestJSON-751510220-project] 10.222.0.27 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.362993 Sep 08 10:47:49.744171 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1192/2404] 10.222.0.27 () {60 vars in 1178 bytes} [Thu Sep 8 10:47:49 2022] GET /compute/v2.1/os-services => generated 112 bytes in 364 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:47:49.783533 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2056e696-b1d9-4c16-95f6-f7152fc07aba tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:49.785561 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2056e696-b1d9-4c16-95f6-f7152fc07aba tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] [instance: 4703a7bf-a1ba-4bba-8928-3c403f3f3f21] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:49.787079 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-a50957c9-52bc-45c2-af3c-43e6af02a661 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] validate_networks() for None {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:47:49.807016 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2056e696-b1d9-4c16-95f6-f7152fc07aba tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:49.807518 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2056e696-b1d9-4c16-95f6-f7152fc07aba tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:49.810537 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2056e696-b1d9-4c16-95f6-f7152fc07aba tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:49.811304 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2056e696-b1d9-4c16-95f6-f7152fc07aba tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:49.811811 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2056e696-b1d9-4c16-95f6-f7152fc07aba tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:49.812212 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2056e696-b1d9-4c16-95f6-f7152fc07aba tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:50.152875 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2056e696-b1d9-4c16-95f6-f7152fc07aba tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528fc9fbb57149c9a9c755c6497f5c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effe8e6c23114b8ab80e76bec365de60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:50.173604 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2056e696-b1d9-4c16-95f6-f7152fc07aba tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] 10.222.0.27 "GET /compute/v2.1/servers/4703a7bf-a1ba-4bba-8928-3c403f3f3f21" status: 200 len: 1292 microversion: 2.1 time: 0.416745 Sep 08 10:47:50.190453 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1193/2405] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:49 2022] GET /compute/v2.1/servers/4703a7bf-a1ba-4bba-8928-3c403f3f3f21 => generated 1292 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:50.191907 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-a50957c9-52bc-45c2-af3c-43e6af02a661 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:47:50.192603 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-a50957c9-52bc-45c2-af3c-43e6af02a661 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:47:50.193306 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-a50957c9-52bc-45c2-af3c-43e6af02a661 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:47:50.194237 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-a50957c9-52bc-45c2-af3c-43e6af02a661 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:47:50.195040 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-a50957c9-52bc-45c2-af3c-43e6af02a661 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:47:50.199137 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-90db6262-f446-4e91-8167-faaa6f4ea531 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:50.203723 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-90db6262-f446-4e91-8167-faaa6f4ea531 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 23007ef9-a0d3-42ff-b687-0f53086c8bcb] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:50.211045 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a50957c9-52bc-45c2-af3c-43e6af02a661 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:50.211891 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a50957c9-52bc-45c2-af3c-43e6af02a661 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:50.212661 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a50957c9-52bc-45c2-af3c-43e6af02a661 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:50.213725 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a50957c9-52bc-45c2-af3c-43e6af02a661 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:50.214694 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a50957c9-52bc-45c2-af3c-43e6af02a661 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:50.215790 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a50957c9-52bc-45c2-af3c-43e6af02a661 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:50.215991 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90db6262-f446-4e91-8167-faaa6f4ea531 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:50.216660 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90db6262-f446-4e91-8167-faaa6f4ea531 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:50.217131 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90db6262-f446-4e91-8167-faaa6f4ea531 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:50.217868 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90db6262-f446-4e91-8167-faaa6f4ea531 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:50.218333 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90db6262-f446-4e91-8167-faaa6f4ea531 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:50.219022 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90db6262-f446-4e91-8167-faaa6f4ea531 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:50.248024 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-a50957c9-52bc-45c2-af3c-43e6af02a661 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Getting quotas for project bb9a5f2a2b4f460dad3731b0ce6ecebc. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:47:50.264562 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-90db6262-f446-4e91-8167-faaa6f4ea531 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] HTTP exception thrown: Instance 23007ef9-a0d3-42ff-b687-0f53086c8bcb could not be found. Sep 08 10:47:50.266604 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-a50957c9-52bc-45c2-af3c-43e6af02a661 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Getting quotas for user 7d6f265811ad4ccf866fb8094782dd38 and project bb9a5f2a2b4f460dad3731b0ce6ecebc. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:47:50.270260 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-90db6262-f446-4e91-8167-faaa6f4ea531 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Request method failure captured: Sep 08 10:47:50.270260 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/23007ef9-a0d3-42ff-b687-0f53086c8bcb HTTP/1.1 Sep 08 10:47:50.270260 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:47:50.270260 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:47:50.270260 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:47:50.270260 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:47:50.270260 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:47:50.270260 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:47:50.270260 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:47:50.270260 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:47:50.270260 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcbOYaOup_Ia1bHuprOxxP_LkfdCzYSX9xstQr2GVmRBueUQ0e967rlioz5jpJV566ZCuz_bYy_us0o8_CIFlOGOVfrC9_e_1_vEhZ3YdgjG89HBhaIJ_lG7Uv4nQrC-nfHrMx_LNyd0rOd4Blcm801SOcX7oe5VDxGTE8KVTDSeMPw Sep 08 10:47:50.270260 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:47:50.270260 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:47:50.270260 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:47:50.270260 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:47:50.270260 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:47:50.270260 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:47:50.270260 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 998378cc815344ba8a107d1cd61f40fd Sep 08 10:47:50.270260 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-DeleteServersTestJSON-69164830 Sep 08 10:47:50.270260 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:47:50.270260 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:47:50.270260 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:47:50.270260 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-DeleteServersTestJSON-69164830 Sep 08 10:47:50.270260 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 998378cc815344ba8a107d1cd61f40fd Sep 08 10:47:50.270260 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-DeleteServersTestJSON-69164830 Sep 08 10:47:50.270260 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-DeleteServersTestJSON-69164830-project Sep 08 10:47:50.270260 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:47:50.270260 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:47:50.270260 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: d08269c53bcb41c88953e7c79f5ad185 Sep 08 10:47:50.270260 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-DeleteServersTestJSON-69164830-project Sep 08 10:47:50.270260 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:47:50.270260 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 23007ef9-a0d3-42ff-b687-0f53086c8bcb could not be found. Sep 08 10:47:50.270260 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '23007ef9-a0d3-42ff-b687-0f53086c8bcb'} Sep 08 10:47:50.270260 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:47:50.270260 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:50.270260 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:47:50.270260 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:47:50.270260 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:47:50.270260 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:47:50.270260 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:47:50.270260 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:47:50.270260 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:47:50.270260 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:47:50.270260 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23007ef9-a0d3-42ff-b687-0f53086c8bcb could not be found. Sep 08 10:47:50.270260 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:50.270260 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:50.270260 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:50.270260 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:50.270260 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:47:50.270260 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:47:50.270260 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:47:50.270260 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:47:50.270260 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:47:50.270260 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:47:50.270260 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:47:50.270260 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:47:50.270260 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:47:50.270260 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:47:50.270260 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:47:50.270260 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:47:50.270260 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23007ef9-a0d3-42ff-b687-0f53086c8bcb could not be found. Sep 08 10:47:50.270260 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:50.270260 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:50.270260 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:50.274437 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:50.274437 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:47:50.274437 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:47:50.274437 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:47:50.274437 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:47:50.274437 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23007ef9-a0d3-42ff-b687-0f53086c8bcb could not be found. Sep 08 10:47:50.274437 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:50.274437 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-90db6262-f446-4e91-8167-faaa6f4ea531 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Returning 404 to user: Instance 23007ef9-a0d3-42ff-b687-0f53086c8bcb could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:47:50.274437 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-90db6262-f446-4e91-8167-faaa6f4ea531 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/23007ef9-a0d3-42ff-b687-0f53086c8bcb" status: 404 len: 111 microversion: 2.1 time: 0.080065 Sep 08 10:47:50.274437 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1194/2406] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:50 2022] GET /compute/v2.1/servers/23007ef9-a0d3-42ff-b687-0f53086c8bcb => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:47:50.286720 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0e5f2e33-37e0-49ce-95c9-7029858ae76b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:50.287223 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0e5f2e33-37e0-49ce-95c9-7029858ae76b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 23007ef9-a0d3-42ff-b687-0f53086c8bcb] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:50.295350 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e5f2e33-37e0-49ce-95c9-7029858ae76b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:50.296012 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e5f2e33-37e0-49ce-95c9-7029858ae76b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:50.296607 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e5f2e33-37e0-49ce-95c9-7029858ae76b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:50.298149 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e5f2e33-37e0-49ce-95c9-7029858ae76b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:50.299419 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e5f2e33-37e0-49ce-95c9-7029858ae76b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:50.300075 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e5f2e33-37e0-49ce-95c9-7029858ae76b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:50.307922 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a50957c9-52bc-45c2-af3c-43e6af02a661 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:47:50.323327 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a50957c9-52bc-45c2-af3c-43e6af02a661 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] [instance: 5134b057-ca4f-4ec8-8dd7-435d4e3d1279] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:47:50.328262 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-0e5f2e33-37e0-49ce-95c9-7029858ae76b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] HTTP exception thrown: Instance 23007ef9-a0d3-42ff-b687-0f53086c8bcb could not be found. Sep 08 10:47:50.330106 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0e5f2e33-37e0-49ce-95c9-7029858ae76b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Request method failure captured: Sep 08 10:47:50.330106 n-d-850501-12 devstack@n-api.service[128861]: request: DELETE /compute/v2.1/servers/23007ef9-a0d3-42ff-b687-0f53086c8bcb HTTP/1.1 Sep 08 10:47:50.330106 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:47:50.330106 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:47:50.330106 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:47:50.330106 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:47:50.330106 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:47:50.330106 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:47:50.330106 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:47:50.330106 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:47:50.330106 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcbOYaOup_Ia1bHuprOxxP_LkfdCzYSX9xstQr2GVmRBueUQ0e967rlioz5jpJV566ZCuz_bYy_us0o8_CIFlOGOVfrC9_e_1_vEhZ3YdgjG89HBhaIJ_lG7Uv4nQrC-nfHrMx_LNyd0rOd4Blcm801SOcX7oe5VDxGTE8KVTDSeMPw Sep 08 10:47:50.330106 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:47:50.330106 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:47:50.330106 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:47:50.330106 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:47:50.330106 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:47:50.330106 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:47:50.330106 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 998378cc815344ba8a107d1cd61f40fd Sep 08 10:47:50.330106 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-DeleteServersTestJSON-69164830 Sep 08 10:47:50.330106 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:47:50.330106 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:47:50.330106 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:47:50.330106 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-DeleteServersTestJSON-69164830 Sep 08 10:47:50.330106 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 998378cc815344ba8a107d1cd61f40fd Sep 08 10:47:50.330106 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-DeleteServersTestJSON-69164830 Sep 08 10:47:50.330106 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-DeleteServersTestJSON-69164830-project Sep 08 10:47:50.330106 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:47:50.330106 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:47:50.330106 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: d08269c53bcb41c88953e7c79f5ad185 Sep 08 10:47:50.330106 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-DeleteServersTestJSON-69164830-project Sep 08 10:47:50.330106 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:47:50.330106 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 23007ef9-a0d3-42ff-b687-0f53086c8bcb could not be found. Sep 08 10:47:50.330106 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '23007ef9-a0d3-42ff-b687-0f53086c8bcb'} Sep 08 10:47:50.330106 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:47:50.330106 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:50.330106 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:47:50.330106 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:47:50.330106 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:47:50.330106 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:47:50.330106 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:47:50.330106 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:47:50.330106 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:47:50.330106 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:47:50.330106 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23007ef9-a0d3-42ff-b687-0f53086c8bcb could not be found. Sep 08 10:47:50.330106 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:50.330106 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:50.330106 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:50.330106 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:50.330106 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:47:50.330106 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:47:50.330106 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:47:50.330106 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:47:50.330106 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:47:50.330106 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:47:50.330106 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:47:50.330106 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:47:50.330106 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:47:50.330106 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:47:50.330106 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:47:50.330106 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:47:50.330106 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:47:50.330106 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:47:50.333775 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23007ef9-a0d3-42ff-b687-0f53086c8bcb could not be found. Sep 08 10:47:50.333775 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:50.333775 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:50.333775 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:50.333775 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:50.333775 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:47:50.333775 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:47:50.333775 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:47:50.333775 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:47:50.333775 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23007ef9-a0d3-42ff-b687-0f53086c8bcb could not be found. Sep 08 10:47:50.333775 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:50.336010 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0e5f2e33-37e0-49ce-95c9-7029858ae76b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Returning 404 to user: Instance 23007ef9-a0d3-42ff-b687-0f53086c8bcb could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:47:50.337225 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0e5f2e33-37e0-49ce-95c9-7029858ae76b tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "DELETE /compute/v2.1/servers/23007ef9-a0d3-42ff-b687-0f53086c8bcb" status: 404 len: 111 microversion: 2.1 time: 0.054298 Sep 08 10:47:50.338010 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1195/2407] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:47:50 2022] DELETE /compute/v2.1/servers/23007ef9-a0d3-42ff-b687-0f53086c8bcb => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:47:50.344968 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7b93240f-438b-4e69-9ce0-0de18eb7bbde tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:50.346282 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7b93240f-438b-4e69-9ce0-0de18eb7bbde tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: 3766b195-ace4-4563-a24e-dca72941251e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:50.353292 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7b93240f-438b-4e69-9ce0-0de18eb7bbde tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:50.354204 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7b93240f-438b-4e69-9ce0-0de18eb7bbde tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:50.354884 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7b93240f-438b-4e69-9ce0-0de18eb7bbde tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:50.356979 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7b93240f-438b-4e69-9ce0-0de18eb7bbde tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:50.357799 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7b93240f-438b-4e69-9ce0-0de18eb7bbde tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:50.358455 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7b93240f-438b-4e69-9ce0-0de18eb7bbde tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:50.439386 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a50957c9-52bc-45c2-af3c-43e6af02a661 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.971849 Sep 08 10:47:50.440839 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1213/2408] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:47:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 974 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:47:50.445981 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7eaaf9bd-3598-4f83-89ce-ef8729b97642 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:50.448781 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7eaaf9bd-3598-4f83-89ce-ef8729b97642 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 23007ef9-a0d3-42ff-b687-0f53086c8bcb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:50.460624 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7eaaf9bd-3598-4f83-89ce-ef8729b97642 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:50.461523 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7eaaf9bd-3598-4f83-89ce-ef8729b97642 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:50.462420 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7eaaf9bd-3598-4f83-89ce-ef8729b97642 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:50.463395 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7eaaf9bd-3598-4f83-89ce-ef8729b97642 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:50.464080 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7eaaf9bd-3598-4f83-89ce-ef8729b97642 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:50.466790 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7eaaf9bd-3598-4f83-89ce-ef8729b97642 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:50.499146 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-7eaaf9bd-3598-4f83-89ce-ef8729b97642 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] HTTP exception thrown: Instance 23007ef9-a0d3-42ff-b687-0f53086c8bcb could not be found. Sep 08 10:47:50.502701 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7eaaf9bd-3598-4f83-89ce-ef8729b97642 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Request method failure captured: Sep 08 10:47:50.502701 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/23007ef9-a0d3-42ff-b687-0f53086c8bcb HTTP/1.1 Sep 08 10:47:50.502701 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:47:50.502701 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:47:50.502701 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:47:50.502701 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:47:50.502701 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:47:50.502701 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:47:50.502701 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:47:50.502701 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:47:50.502701 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcbOYaOup_Ia1bHuprOxxP_LkfdCzYSX9xstQr2GVmRBueUQ0e967rlioz5jpJV566ZCuz_bYy_us0o8_CIFlOGOVfrC9_e_1_vEhZ3YdgjG89HBhaIJ_lG7Uv4nQrC-nfHrMx_LNyd0rOd4Blcm801SOcX7oe5VDxGTE8KVTDSeMPw Sep 08 10:47:50.502701 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:47:50.502701 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:47:50.502701 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:47:50.502701 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:47:50.502701 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:47:50.502701 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:47:50.502701 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 998378cc815344ba8a107d1cd61f40fd Sep 08 10:47:50.502701 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-DeleteServersTestJSON-69164830 Sep 08 10:47:50.502701 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:47:50.502701 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:47:50.502701 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:47:50.502701 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-DeleteServersTestJSON-69164830 Sep 08 10:47:50.502701 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 998378cc815344ba8a107d1cd61f40fd Sep 08 10:47:50.502701 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-DeleteServersTestJSON-69164830 Sep 08 10:47:50.502701 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-DeleteServersTestJSON-69164830-project Sep 08 10:47:50.502701 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:47:50.502701 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:47:50.502701 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: d08269c53bcb41c88953e7c79f5ad185 Sep 08 10:47:50.502701 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-DeleteServersTestJSON-69164830-project Sep 08 10:47:50.502701 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:47:50.502701 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 23007ef9-a0d3-42ff-b687-0f53086c8bcb could not be found. Sep 08 10:47:50.502701 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '23007ef9-a0d3-42ff-b687-0f53086c8bcb'} Sep 08 10:47:50.502701 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:47:50.502701 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:50.502701 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:47:50.502701 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:47:50.502701 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:47:50.502701 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:47:50.502701 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:47:50.502701 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:47:50.502701 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:47:50.502701 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:47:50.502701 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23007ef9-a0d3-42ff-b687-0f53086c8bcb could not be found. Sep 08 10:47:50.502701 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:50.502701 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:50.502701 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:50.502701 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:50.502701 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:47:50.502701 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:47:50.502701 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:47:50.502701 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:47:50.502701 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:47:50.502701 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:47:50.502701 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:47:50.502701 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:47:50.502701 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:47:50.502701 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:47:50.502701 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:47:50.502701 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:47:50.502701 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23007ef9-a0d3-42ff-b687-0f53086c8bcb could not be found. Sep 08 10:47:50.502701 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:50.502701 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:50.502701 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:50.507817 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:50.507817 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:47:50.507817 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:47:50.507817 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:47:50.507817 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:47:50.507817 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23007ef9-a0d3-42ff-b687-0f53086c8bcb could not be found. Sep 08 10:47:50.507817 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:50.510719 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7eaaf9bd-3598-4f83-89ce-ef8729b97642 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Returning 404 to user: Instance 23007ef9-a0d3-42ff-b687-0f53086c8bcb could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:47:50.513211 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7eaaf9bd-3598-4f83-89ce-ef8729b97642 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/23007ef9-a0d3-42ff-b687-0f53086c8bcb" status: 404 len: 111 microversion: 2.1 time: 0.070053 Sep 08 10:47:50.514788 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1214/2409] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:50 2022] GET /compute/v2.1/servers/23007ef9-a0d3-42ff-b687-0f53086c8bcb => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:47:50.521614 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-9f9f1142-f460-4efe-bd84-65809a116087 req-bd183c36-48cc-422b-8b14-40b765b8c655 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4703a7bf-a1ba-4bba-8928-3c403f3f3f21", "name": "network-vif-plugged", "status": "completed", "tag": "7692ba07-fea3-4d35-b24e-98c3a269cb03"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:47:50.534819 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-9f9f1142-f460-4efe-bd84-65809a116087 req-bd183c36-48cc-422b-8b14-40b765b8c655 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:50.535501 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-9f9f1142-f460-4efe-bd84-65809a116087 req-bd183c36-48cc-422b-8b14-40b765b8c655 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:50.536125 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-9f9f1142-f460-4efe-bd84-65809a116087 req-bd183c36-48cc-422b-8b14-40b765b8c655 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:50.558743 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-9f9f1142-f460-4efe-bd84-65809a116087 req-bd183c36-48cc-422b-8b14-40b765b8c655 service nova] Creating event network-vif-plugged:7692ba07-fea3-4d35-b24e-98c3a269cb03 for instance 4703a7bf-a1ba-4bba-8928-3c403f3f3f21 on n-h2-850501-12 Sep 08 10:47:50.567253 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-9f9f1142-f460-4efe-bd84-65809a116087 req-bd183c36-48cc-422b-8b14-40b765b8c655 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050998 Sep 08 10:47:50.568738 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1215/2410] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:47:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:47:50.604349 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0ad06345-9d7f-4091-ac18-0c1fbbc48eb9 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:50.606612 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0ad06345-9d7f-4091-ac18-0c1fbbc48eb9 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] [instance: 5134b057-ca4f-4ec8-8dd7-435d4e3d1279] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:50.791293 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0ad06345-9d7f-4091-ac18-0c1fbbc48eb9 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6f265811ad4ccf866fb8094782dd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9a5f2a2b4f460dad3731b0ce6ecebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:50.804826 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0ad06345-9d7f-4091-ac18-0c1fbbc48eb9 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] 10.222.0.27 "GET /compute/v2.1/servers/5134b057-ca4f-4ec8-8dd7-435d4e3d1279" status: 200 len: 1222 microversion: 2.1 time: 0.234713 Sep 08 10:47:50.818054 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1216/2411] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:50 2022] GET /compute/v2.1/servers/5134b057-ca4f-4ec8-8dd7-435d4e3d1279 => generated 1222 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:50.845921 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-197ad2ad-bf2a-4fa1-9e83-45ae8640204c tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:50.852225 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-197ad2ad-bf2a-4fa1-9e83-45ae8640204c tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] [instance: 72eb7387-3f16-4b4f-ab9a-89076f169fc1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:50.869089 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-197ad2ad-bf2a-4fa1-9e83-45ae8640204c tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:50.869573 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-197ad2ad-bf2a-4fa1-9e83-45ae8640204c tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:50.870017 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-197ad2ad-bf2a-4fa1-9e83-45ae8640204c tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:50.870746 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-197ad2ad-bf2a-4fa1-9e83-45ae8640204c tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:50.871209 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-197ad2ad-bf2a-4fa1-9e83-45ae8640204c tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:50.872181 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-197ad2ad-bf2a-4fa1-9e83-45ae8640204c tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:50.964065 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-197ad2ad-bf2a-4fa1-9e83-45ae8640204c tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] 10.222.0.27 "GET /compute/v2.1/servers/72eb7387-3f16-4b4f-ab9a-89076f169fc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.144114 Sep 08 10:47:50.966510 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1217/2412] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 10:47:50 2022] GET /compute/v2.1/servers/72eb7387-3f16-4b4f-ab9a-89076f169fc1/os-volume_attachments => generated 197 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:47:50.991133 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b779004a-5c3c-4846-8056-ba821862f3d6 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:50.995739 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b779004a-5c3c-4846-8056-ba821862f3d6 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: eca1ed67-f21d-46e3-8557-014bc6b63953] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:51.017650 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b779004a-5c3c-4846-8056-ba821862f3d6 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:51.018160 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b779004a-5c3c-4846-8056-ba821862f3d6 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:51.018599 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b779004a-5c3c-4846-8056-ba821862f3d6 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:51.019328 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b779004a-5c3c-4846-8056-ba821862f3d6 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:51.019785 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b779004a-5c3c-4846-8056-ba821862f3d6 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:51.020209 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b779004a-5c3c-4846-8056-ba821862f3d6 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:51.058597 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-b779004a-5c3c-4846-8056-ba821862f3d6 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] HTTP exception thrown: Instance eca1ed67-f21d-46e3-8557-014bc6b63953 could not be found. Sep 08 10:47:51.063056 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b779004a-5c3c-4846-8056-ba821862f3d6 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Request method failure captured: Sep 08 10:47:51.063056 n-d-850501-12 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/servers/eca1ed67-f21d-46e3-8557-014bc6b63953 HTTP/1.1 Sep 08 10:47:51.063056 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:47:51.063056 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:47:51.063056 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:47:51.063056 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:47:51.063056 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:47:51.063056 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:47:51.063056 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:47:51.063056 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:47:51.063056 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcbOYaOup_Ia1bHuprOxxP_LkfdCzYSX9xstQr2GVmRBueUQ0e967rlioz5jpJV566ZCuz_bYy_us0o8_CIFlOGOVfrC9_e_1_vEhZ3YdgjG89HBhaIJ_lG7Uv4nQrC-nfHrMx_LNyd0rOd4Blcm801SOcX7oe5VDxGTE8KVTDSeMPw Sep 08 10:47:51.063056 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:47:51.063056 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:47:51.063056 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:47:51.063056 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:47:51.063056 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:47:51.063056 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:47:51.063056 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 998378cc815344ba8a107d1cd61f40fd Sep 08 10:47:51.063056 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-DeleteServersTestJSON-69164830 Sep 08 10:47:51.063056 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:47:51.063056 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:47:51.063056 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:47:51.063056 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-DeleteServersTestJSON-69164830 Sep 08 10:47:51.063056 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 998378cc815344ba8a107d1cd61f40fd Sep 08 10:47:51.063056 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-DeleteServersTestJSON-69164830 Sep 08 10:47:51.063056 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-DeleteServersTestJSON-69164830-project Sep 08 10:47:51.063056 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:47:51.063056 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:47:51.063056 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: d08269c53bcb41c88953e7c79f5ad185 Sep 08 10:47:51.063056 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-DeleteServersTestJSON-69164830-project Sep 08 10:47:51.063056 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:47:51.063056 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance eca1ed67-f21d-46e3-8557-014bc6b63953 could not be found. Sep 08 10:47:51.063056 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'eca1ed67-f21d-46e3-8557-014bc6b63953'} Sep 08 10:47:51.063056 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:47:51.063056 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:51.063056 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:47:51.063056 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:47:51.063056 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:47:51.063056 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:47:51.063056 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:47:51.063056 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:47:51.063056 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:47:51.063056 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:47:51.063056 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eca1ed67-f21d-46e3-8557-014bc6b63953 could not be found. Sep 08 10:47:51.063056 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:51.063056 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:51.063056 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:51.063056 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:51.063056 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:47:51.063056 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:47:51.063056 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:47:51.063056 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:47:51.063056 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:47:51.063056 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:47:51.063056 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:47:51.063056 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:47:51.063056 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:47:51.063056 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:47:51.063056 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:47:51.063056 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:47:51.063056 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:47:51.063056 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:47:51.071306 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eca1ed67-f21d-46e3-8557-014bc6b63953 could not be found. Sep 08 10:47:51.071306 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:51.071306 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:51.071306 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:51.071306 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:51.071306 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:47:51.071306 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:47:51.071306 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:47:51.071306 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:47:51.071306 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eca1ed67-f21d-46e3-8557-014bc6b63953 could not be found. Sep 08 10:47:51.071306 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:51.071306 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b779004a-5c3c-4846-8056-ba821862f3d6 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Returning 404 to user: Instance eca1ed67-f21d-46e3-8557-014bc6b63953 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:47:51.071306 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b779004a-5c3c-4846-8056-ba821862f3d6 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "DELETE /compute/v2.1/servers/eca1ed67-f21d-46e3-8557-014bc6b63953" status: 404 len: 111 microversion: 2.1 time: 0.096162 Sep 08 10:47:51.071306 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1218/2413] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:47:50 2022] DELETE /compute/v2.1/servers/eca1ed67-f21d-46e3-8557-014bc6b63953 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:47:51.100067 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c3338a9c-dac5-417f-9c02-a1110f13d75f tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:51.100700 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c3338a9c-dac5-417f-9c02-a1110f13d75f tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: eca1ed67-f21d-46e3-8557-014bc6b63953] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:51.119459 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c3338a9c-dac5-417f-9c02-a1110f13d75f tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:51.120046 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c3338a9c-dac5-417f-9c02-a1110f13d75f tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:51.120506 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c3338a9c-dac5-417f-9c02-a1110f13d75f tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:51.121846 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c3338a9c-dac5-417f-9c02-a1110f13d75f tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:51.122312 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c3338a9c-dac5-417f-9c02-a1110f13d75f tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:51.122753 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c3338a9c-dac5-417f-9c02-a1110f13d75f tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:51.129106 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7b93240f-438b-4e69-9ce0-0de18eb7bbde tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:51.140272 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7b93240f-438b-4e69-9ce0-0de18eb7bbde tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e" status: 200 len: 1472 microversion: 2.1 time: 0.800954 Sep 08 10:47:51.145521 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1196/2414] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:50 2022] GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e => generated 1472 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:51.188965 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-c3338a9c-dac5-417f-9c02-a1110f13d75f tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] HTTP exception thrown: Instance eca1ed67-f21d-46e3-8557-014bc6b63953 could not be found. Sep 08 10:47:51.195032 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c3338a9c-dac5-417f-9c02-a1110f13d75f tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Request method failure captured: Sep 08 10:47:51.195032 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/eca1ed67-f21d-46e3-8557-014bc6b63953 HTTP/1.1 Sep 08 10:47:51.195032 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:47:51.195032 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:47:51.195032 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:47:51.195032 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:47:51.195032 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:47:51.195032 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:47:51.195032 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:47:51.195032 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:47:51.195032 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcbOYaOup_Ia1bHuprOxxP_LkfdCzYSX9xstQr2GVmRBueUQ0e967rlioz5jpJV566ZCuz_bYy_us0o8_CIFlOGOVfrC9_e_1_vEhZ3YdgjG89HBhaIJ_lG7Uv4nQrC-nfHrMx_LNyd0rOd4Blcm801SOcX7oe5VDxGTE8KVTDSeMPw Sep 08 10:47:51.195032 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:47:51.195032 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:47:51.195032 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:47:51.195032 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:47:51.195032 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:47:51.195032 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:47:51.195032 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 998378cc815344ba8a107d1cd61f40fd Sep 08 10:47:51.195032 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-DeleteServersTestJSON-69164830 Sep 08 10:47:51.195032 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:47:51.195032 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:47:51.195032 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:47:51.195032 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-DeleteServersTestJSON-69164830 Sep 08 10:47:51.195032 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 998378cc815344ba8a107d1cd61f40fd Sep 08 10:47:51.195032 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-DeleteServersTestJSON-69164830 Sep 08 10:47:51.195032 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-DeleteServersTestJSON-69164830-project Sep 08 10:47:51.195032 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:47:51.195032 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:47:51.195032 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: d08269c53bcb41c88953e7c79f5ad185 Sep 08 10:47:51.195032 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-DeleteServersTestJSON-69164830-project Sep 08 10:47:51.195032 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:47:51.195032 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance eca1ed67-f21d-46e3-8557-014bc6b63953 could not be found. Sep 08 10:47:51.195032 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'eca1ed67-f21d-46e3-8557-014bc6b63953'} Sep 08 10:47:51.195032 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:47:51.195032 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:51.195032 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:47:51.195032 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:47:51.195032 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:47:51.195032 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:47:51.195032 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:47:51.195032 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:47:51.195032 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:47:51.195032 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:47:51.195032 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eca1ed67-f21d-46e3-8557-014bc6b63953 could not be found. Sep 08 10:47:51.195032 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:51.195032 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:51.195032 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:51.195032 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:51.195032 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:47:51.195032 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:47:51.195032 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:47:51.195032 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:47:51.195032 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:47:51.195032 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:47:51.195032 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:47:51.195032 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:47:51.195032 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:47:51.195032 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:47:51.195032 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:47:51.195032 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:47:51.195032 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eca1ed67-f21d-46e3-8557-014bc6b63953 could not be found. Sep 08 10:47:51.195032 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:51.195032 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:51.195032 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:51.199977 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:51.199977 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:47:51.199977 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:47:51.199977 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:47:51.199977 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:47:51.199977 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eca1ed67-f21d-46e3-8557-014bc6b63953 could not be found. Sep 08 10:47:51.199977 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:51.208445 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bc105629-4688-4723-b7be-bcd77ccb865e tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:51.209402 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bc105629-4688-4723-b7be-bcd77ccb865e tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] [instance: 4703a7bf-a1ba-4bba-8928-3c403f3f3f21] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:51.217425 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c3338a9c-dac5-417f-9c02-a1110f13d75f tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Returning 404 to user: Instance eca1ed67-f21d-46e3-8557-014bc6b63953 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:47:51.223710 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c3338a9c-dac5-417f-9c02-a1110f13d75f tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/eca1ed67-f21d-46e3-8557-014bc6b63953" status: 404 len: 111 microversion: 2.1 time: 0.145322 Sep 08 10:47:51.225622 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1219/2415] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:51 2022] GET /compute/v2.1/servers/eca1ed67-f21d-46e3-8557-014bc6b63953 => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:47:51.229945 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bc105629-4688-4723-b7be-bcd77ccb865e tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:51.236839 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bc105629-4688-4723-b7be-bcd77ccb865e tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:51.238686 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bc105629-4688-4723-b7be-bcd77ccb865e tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:51.240503 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bc105629-4688-4723-b7be-bcd77ccb865e tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:51.244351 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0b4b5408-487a-4687-8d6e-bef7ed082fd8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:51.245764 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bc105629-4688-4723-b7be-bcd77ccb865e tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:51.247581 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bc105629-4688-4723-b7be-bcd77ccb865e tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:51.251181 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0b4b5408-487a-4687-8d6e-bef7ed082fd8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: f9f308fa-d4a6-4ac9-8c64-927e082b0b4a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:51.282368 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0b4b5408-487a-4687-8d6e-bef7ed082fd8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:51.284225 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0b4b5408-487a-4687-8d6e-bef7ed082fd8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:51.284891 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0b4b5408-487a-4687-8d6e-bef7ed082fd8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:51.286933 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0b4b5408-487a-4687-8d6e-bef7ed082fd8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:51.288167 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0b4b5408-487a-4687-8d6e-bef7ed082fd8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:51.291293 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0b4b5408-487a-4687-8d6e-bef7ed082fd8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:51.329258 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-0b4b5408-487a-4687-8d6e-bef7ed082fd8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] HTTP exception thrown: Instance f9f308fa-d4a6-4ac9-8c64-927e082b0b4a could not be found. Sep 08 10:47:51.332836 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0b4b5408-487a-4687-8d6e-bef7ed082fd8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Request method failure captured: Sep 08 10:47:51.332836 n-d-850501-12 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a HTTP/1.1 Sep 08 10:47:51.332836 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:47:51.332836 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:47:51.332836 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:47:51.332836 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:47:51.332836 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:47:51.332836 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:47:51.332836 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:47:51.332836 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:47:51.332836 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcbOYaOup_Ia1bHuprOxxP_LkfdCzYSX9xstQr2GVmRBueUQ0e967rlioz5jpJV566ZCuz_bYy_us0o8_CIFlOGOVfrC9_e_1_vEhZ3YdgjG89HBhaIJ_lG7Uv4nQrC-nfHrMx_LNyd0rOd4Blcm801SOcX7oe5VDxGTE8KVTDSeMPw Sep 08 10:47:51.332836 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:47:51.332836 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:47:51.332836 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:47:51.332836 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:47:51.332836 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:47:51.332836 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:47:51.332836 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 998378cc815344ba8a107d1cd61f40fd Sep 08 10:47:51.332836 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-DeleteServersTestJSON-69164830 Sep 08 10:47:51.332836 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:47:51.332836 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:47:51.332836 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:47:51.332836 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-DeleteServersTestJSON-69164830 Sep 08 10:47:51.332836 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 998378cc815344ba8a107d1cd61f40fd Sep 08 10:47:51.332836 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-DeleteServersTestJSON-69164830 Sep 08 10:47:51.332836 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-DeleteServersTestJSON-69164830-project Sep 08 10:47:51.332836 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:47:51.332836 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:47:51.332836 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: d08269c53bcb41c88953e7c79f5ad185 Sep 08 10:47:51.332836 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-DeleteServersTestJSON-69164830-project Sep 08 10:47:51.332836 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:47:51.332836 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance f9f308fa-d4a6-4ac9-8c64-927e082b0b4a could not be found. Sep 08 10:47:51.332836 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'f9f308fa-d4a6-4ac9-8c64-927e082b0b4a'} Sep 08 10:47:51.332836 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:47:51.332836 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:51.332836 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:47:51.332836 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:47:51.332836 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:47:51.332836 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:47:51.332836 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:47:51.332836 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:47:51.332836 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:47:51.332836 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:47:51.332836 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9f308fa-d4a6-4ac9-8c64-927e082b0b4a could not be found. Sep 08 10:47:51.332836 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:51.332836 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:51.332836 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:51.332836 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:51.332836 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:47:51.332836 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:47:51.332836 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:47:51.332836 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:47:51.332836 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:47:51.332836 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:47:51.332836 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:47:51.332836 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:47:51.332836 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:47:51.332836 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:47:51.332836 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:47:51.332836 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:47:51.332836 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:47:51.332836 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:47:51.337178 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9f308fa-d4a6-4ac9-8c64-927e082b0b4a could not be found. Sep 08 10:47:51.337178 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:51.337178 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:51.337178 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:51.337178 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:51.337178 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:47:51.337178 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:47:51.337178 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:47:51.337178 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:47:51.337178 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9f308fa-d4a6-4ac9-8c64-927e082b0b4a could not be found. Sep 08 10:47:51.337178 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:51.339419 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0b4b5408-487a-4687-8d6e-bef7ed082fd8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Returning 404 to user: Instance f9f308fa-d4a6-4ac9-8c64-927e082b0b4a could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:47:51.343263 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0b4b5408-487a-4687-8d6e-bef7ed082fd8 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a" status: 404 len: 111 microversion: 2.1 time: 0.110595 Sep 08 10:47:51.346458 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1220/2416] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:47:51 2022] DELETE /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:47:51.364311 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-01d33083-c7c6-4c03-ab40-f63977d0c48e tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:51.366632 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-01d33083-c7c6-4c03-ab40-f63977d0c48e tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: f9f308fa-d4a6-4ac9-8c64-927e082b0b4a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:51.381694 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01d33083-c7c6-4c03-ab40-f63977d0c48e tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:51.385350 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01d33083-c7c6-4c03-ab40-f63977d0c48e tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:51.386754 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01d33083-c7c6-4c03-ab40-f63977d0c48e tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:51.388481 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01d33083-c7c6-4c03-ab40-f63977d0c48e tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:51.391322 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01d33083-c7c6-4c03-ab40-f63977d0c48e tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:51.394916 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01d33083-c7c6-4c03-ab40-f63977d0c48e tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:51.463218 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-01d33083-c7c6-4c03-ab40-f63977d0c48e tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] HTTP exception thrown: Instance f9f308fa-d4a6-4ac9-8c64-927e082b0b4a could not be found. Sep 08 10:47:51.466925 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-01d33083-c7c6-4c03-ab40-f63977d0c48e tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Request method failure captured: Sep 08 10:47:51.466925 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a HTTP/1.1 Sep 08 10:47:51.466925 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:47:51.466925 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:47:51.466925 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:47:51.466925 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:47:51.466925 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:47:51.466925 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:47:51.466925 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:47:51.466925 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:47:51.466925 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcbOYaOup_Ia1bHuprOxxP_LkfdCzYSX9xstQr2GVmRBueUQ0e967rlioz5jpJV566ZCuz_bYy_us0o8_CIFlOGOVfrC9_e_1_vEhZ3YdgjG89HBhaIJ_lG7Uv4nQrC-nfHrMx_LNyd0rOd4Blcm801SOcX7oe5VDxGTE8KVTDSeMPw Sep 08 10:47:51.466925 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:47:51.466925 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:47:51.466925 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:47:51.466925 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:47:51.466925 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:47:51.466925 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:47:51.466925 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 998378cc815344ba8a107d1cd61f40fd Sep 08 10:47:51.466925 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-DeleteServersTestJSON-69164830 Sep 08 10:47:51.466925 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:47:51.466925 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:47:51.466925 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:47:51.466925 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-DeleteServersTestJSON-69164830 Sep 08 10:47:51.466925 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 998378cc815344ba8a107d1cd61f40fd Sep 08 10:47:51.466925 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-DeleteServersTestJSON-69164830 Sep 08 10:47:51.466925 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-DeleteServersTestJSON-69164830-project Sep 08 10:47:51.466925 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:47:51.466925 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:47:51.466925 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: d08269c53bcb41c88953e7c79f5ad185 Sep 08 10:47:51.466925 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-DeleteServersTestJSON-69164830-project Sep 08 10:47:51.466925 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:47:51.466925 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance f9f308fa-d4a6-4ac9-8c64-927e082b0b4a could not be found. Sep 08 10:47:51.466925 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'f9f308fa-d4a6-4ac9-8c64-927e082b0b4a'} Sep 08 10:47:51.466925 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:47:51.466925 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:51.466925 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:47:51.466925 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:47:51.466925 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:47:51.466925 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:47:51.466925 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:47:51.466925 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:47:51.466925 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:47:51.466925 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:47:51.466925 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9f308fa-d4a6-4ac9-8c64-927e082b0b4a could not be found. Sep 08 10:47:51.466925 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:51.466925 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:51.466925 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:51.466925 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:51.466925 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:47:51.466925 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:47:51.466925 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:47:51.466925 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:47:51.466925 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:47:51.466925 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:47:51.466925 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:47:51.466925 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:47:51.466925 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:47:51.466925 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:47:51.466925 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:47:51.466925 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:47:51.466925 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9f308fa-d4a6-4ac9-8c64-927e082b0b4a could not be found. Sep 08 10:47:51.466925 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:51.466925 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:51.466925 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:51.470910 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:51.470910 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:47:51.470910 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:47:51.470910 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:47:51.470910 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:47:51.470910 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9f308fa-d4a6-4ac9-8c64-927e082b0b4a could not be found. Sep 08 10:47:51.470910 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:51.470910 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-01d33083-c7c6-4c03-ab40-f63977d0c48e tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Returning 404 to user: Instance f9f308fa-d4a6-4ac9-8c64-927e082b0b4a could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:47:51.470910 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-01d33083-c7c6-4c03-ab40-f63977d0c48e tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a" status: 404 len: 111 microversion: 2.1 time: 0.117977 Sep 08 10:47:51.481594 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1221/2417] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:51 2022] GET /compute/v2.1/servers/f9f308fa-d4a6-4ac9-8c64-927e082b0b4a => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:47:51.496283 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d9a990b9-3534-4f37-9d50-0380bd392a87 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:51.498468 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d9a990b9-3534-4f37-9d50-0380bd392a87 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 82f0d3c4-fc81-428a-9141-2cc36da8b1b2] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:51.512750 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d9a990b9-3534-4f37-9d50-0380bd392a87 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:51.513242 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d9a990b9-3534-4f37-9d50-0380bd392a87 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:51.513692 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d9a990b9-3534-4f37-9d50-0380bd392a87 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:51.516261 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d9a990b9-3534-4f37-9d50-0380bd392a87 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:51.517065 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d9a990b9-3534-4f37-9d50-0380bd392a87 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:51.517538 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d9a990b9-3534-4f37-9d50-0380bd392a87 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:51.545600 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-d9a990b9-3534-4f37-9d50-0380bd392a87 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] HTTP exception thrown: Instance 82f0d3c4-fc81-428a-9141-2cc36da8b1b2 could not be found. Sep 08 10:47:51.545600 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d9a990b9-3534-4f37-9d50-0380bd392a87 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Request method failure captured: Sep 08 10:47:51.545600 n-d-850501-12 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/servers/82f0d3c4-fc81-428a-9141-2cc36da8b1b2 HTTP/1.1 Sep 08 10:47:51.545600 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:47:51.545600 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:47:51.545600 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:47:51.545600 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:47:51.545600 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:47:51.545600 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:47:51.545600 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:47:51.545600 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:47:51.545600 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcbOYaOup_Ia1bHuprOxxP_LkfdCzYSX9xstQr2GVmRBueUQ0e967rlioz5jpJV566ZCuz_bYy_us0o8_CIFlOGOVfrC9_e_1_vEhZ3YdgjG89HBhaIJ_lG7Uv4nQrC-nfHrMx_LNyd0rOd4Blcm801SOcX7oe5VDxGTE8KVTDSeMPw Sep 08 10:47:51.545600 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:47:51.545600 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:47:51.545600 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:47:51.545600 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:47:51.545600 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:47:51.545600 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:47:51.545600 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 998378cc815344ba8a107d1cd61f40fd Sep 08 10:47:51.545600 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-DeleteServersTestJSON-69164830 Sep 08 10:47:51.545600 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:47:51.545600 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:47:51.545600 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:47:51.545600 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-DeleteServersTestJSON-69164830 Sep 08 10:47:51.545600 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 998378cc815344ba8a107d1cd61f40fd Sep 08 10:47:51.545600 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-DeleteServersTestJSON-69164830 Sep 08 10:47:51.545600 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-DeleteServersTestJSON-69164830-project Sep 08 10:47:51.545600 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:47:51.545600 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:47:51.545600 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: d08269c53bcb41c88953e7c79f5ad185 Sep 08 10:47:51.545600 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-DeleteServersTestJSON-69164830-project Sep 08 10:47:51.545600 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:47:51.545600 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 82f0d3c4-fc81-428a-9141-2cc36da8b1b2 could not be found. Sep 08 10:47:51.545600 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '82f0d3c4-fc81-428a-9141-2cc36da8b1b2'} Sep 08 10:47:51.545600 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:47:51.545600 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:51.545600 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:47:51.545600 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:47:51.545600 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:47:51.545600 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:47:51.545600 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:47:51.545600 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:47:51.545600 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:47:51.545600 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:47:51.545600 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82f0d3c4-fc81-428a-9141-2cc36da8b1b2 could not be found. Sep 08 10:47:51.545600 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:51.545600 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:51.545600 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:51.545600 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:51.545600 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:47:51.545600 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:47:51.545600 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:47:51.545600 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:47:51.545600 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:47:51.545600 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:47:51.545600 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:47:51.545600 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:47:51.545600 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:47:51.545600 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:47:51.545600 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:47:51.545600 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:47:51.550786 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:47:51.550786 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:47:51.550786 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82f0d3c4-fc81-428a-9141-2cc36da8b1b2 could not be found. Sep 08 10:47:51.550786 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:51.550786 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:51.550786 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:51.550786 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:51.550786 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:47:51.550786 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:47:51.550786 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:47:51.550786 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:47:51.550786 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82f0d3c4-fc81-428a-9141-2cc36da8b1b2 could not be found. Sep 08 10:47:51.550786 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:51.550786 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d9a990b9-3534-4f37-9d50-0380bd392a87 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Returning 404 to user: Instance 82f0d3c4-fc81-428a-9141-2cc36da8b1b2 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:47:51.550786 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d9a990b9-3534-4f37-9d50-0380bd392a87 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "DELETE /compute/v2.1/servers/82f0d3c4-fc81-428a-9141-2cc36da8b1b2" status: 404 len: 111 microversion: 2.1 time: 0.060249 Sep 08 10:47:51.550786 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1222/2418] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:47:51 2022] DELETE /compute/v2.1/servers/82f0d3c4-fc81-428a-9141-2cc36da8b1b2 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:47:51.558381 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1898bca2-1925-448c-82db-52b62f3456cd tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:51.561720 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1898bca2-1925-448c-82db-52b62f3456cd tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 82f0d3c4-fc81-428a-9141-2cc36da8b1b2] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:51.569600 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1898bca2-1925-448c-82db-52b62f3456cd tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:51.570769 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1898bca2-1925-448c-82db-52b62f3456cd tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:51.571322 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1898bca2-1925-448c-82db-52b62f3456cd tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:51.573240 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1898bca2-1925-448c-82db-52b62f3456cd tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:51.573787 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1898bca2-1925-448c-82db-52b62f3456cd tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:51.574230 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1898bca2-1925-448c-82db-52b62f3456cd tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:51.580360 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:47:51.599136 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-1898bca2-1925-448c-82db-52b62f3456cd tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] HTTP exception thrown: Instance 82f0d3c4-fc81-428a-9141-2cc36da8b1b2 could not be found. Sep 08 10:47:51.601632 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1898bca2-1925-448c-82db-52b62f3456cd tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Request method failure captured: Sep 08 10:47:51.601632 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/82f0d3c4-fc81-428a-9141-2cc36da8b1b2 HTTP/1.1 Sep 08 10:47:51.601632 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:47:51.601632 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:47:51.601632 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:47:51.601632 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:47:51.601632 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:47:51.601632 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:47:51.601632 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:47:51.601632 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:47:51.601632 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcbOYaOup_Ia1bHuprOxxP_LkfdCzYSX9xstQr2GVmRBueUQ0e967rlioz5jpJV566ZCuz_bYy_us0o8_CIFlOGOVfrC9_e_1_vEhZ3YdgjG89HBhaIJ_lG7Uv4nQrC-nfHrMx_LNyd0rOd4Blcm801SOcX7oe5VDxGTE8KVTDSeMPw Sep 08 10:47:51.601632 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:47:51.601632 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:47:51.601632 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:47:51.601632 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:47:51.601632 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:47:51.601632 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:47:51.601632 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 998378cc815344ba8a107d1cd61f40fd Sep 08 10:47:51.601632 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-DeleteServersTestJSON-69164830 Sep 08 10:47:51.601632 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:47:51.601632 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:47:51.601632 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:47:51.601632 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-DeleteServersTestJSON-69164830 Sep 08 10:47:51.601632 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 998378cc815344ba8a107d1cd61f40fd Sep 08 10:47:51.601632 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-DeleteServersTestJSON-69164830 Sep 08 10:47:51.601632 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-DeleteServersTestJSON-69164830-project Sep 08 10:47:51.601632 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:47:51.601632 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:47:51.601632 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: d08269c53bcb41c88953e7c79f5ad185 Sep 08 10:47:51.601632 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-DeleteServersTestJSON-69164830-project Sep 08 10:47:51.601632 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:47:51.601632 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 82f0d3c4-fc81-428a-9141-2cc36da8b1b2 could not be found. Sep 08 10:47:51.601632 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '82f0d3c4-fc81-428a-9141-2cc36da8b1b2'} Sep 08 10:47:51.601632 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:47:51.601632 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:51.601632 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:47:51.601632 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:47:51.601632 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:47:51.601632 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:47:51.601632 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:47:51.601632 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:47:51.601632 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:47:51.601632 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:47:51.601632 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82f0d3c4-fc81-428a-9141-2cc36da8b1b2 could not be found. Sep 08 10:47:51.601632 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:51.601632 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:51.601632 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:51.601632 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:51.601632 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:47:51.601632 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:47:51.601632 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:47:51.601632 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:47:51.601632 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:47:51.601632 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:47:51.601632 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:47:51.601632 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:47:51.601632 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:47:51.601632 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:47:51.601632 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:47:51.601632 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:47:51.601632 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82f0d3c4-fc81-428a-9141-2cc36da8b1b2 could not be found. Sep 08 10:47:51.601632 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:51.601632 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:51.601632 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:51.607511 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:51.607511 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:47:51.607511 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:47:51.607511 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:47:51.607511 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:47:51.607511 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82f0d3c4-fc81-428a-9141-2cc36da8b1b2 could not be found. Sep 08 10:47:51.607511 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:51.607511 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1898bca2-1925-448c-82db-52b62f3456cd tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Returning 404 to user: Instance 82f0d3c4-fc81-428a-9141-2cc36da8b1b2 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:47:51.607511 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1898bca2-1925-448c-82db-52b62f3456cd tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/82f0d3c4-fc81-428a-9141-2cc36da8b1b2" status: 404 len: 111 microversion: 2.1 time: 0.051010 Sep 08 10:47:51.607511 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1223/2419] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:51 2022] GET /compute/v2.1/servers/82f0d3c4-fc81-428a-9141-2cc36da8b1b2 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:47:51.614163 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2949ed3a-0ed1-4764-889b-a02a7ec5d111 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:51.615547 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2949ed3a-0ed1-4764-889b-a02a7ec5d111 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 2748dac9-3592-45b6-afe2-03a226e1026a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:51.627011 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-2949ed3a-0ed1-4764-889b-a02a7ec5d111 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] HTTP exception thrown: Instance 2748dac9-3592-45b6-afe2-03a226e1026a could not be found. Sep 08 10:47:51.628814 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2949ed3a-0ed1-4764-889b-a02a7ec5d111 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Request method failure captured: Sep 08 10:47:51.628814 n-d-850501-12 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/servers/2748dac9-3592-45b6-afe2-03a226e1026a HTTP/1.1 Sep 08 10:47:51.628814 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:47:51.628814 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:47:51.628814 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:47:51.628814 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:47:51.628814 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:47:51.628814 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:47:51.628814 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:47:51.628814 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:47:51.628814 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcbOYaOup_Ia1bHuprOxxP_LkfdCzYSX9xstQr2GVmRBueUQ0e967rlioz5jpJV566ZCuz_bYy_us0o8_CIFlOGOVfrC9_e_1_vEhZ3YdgjG89HBhaIJ_lG7Uv4nQrC-nfHrMx_LNyd0rOd4Blcm801SOcX7oe5VDxGTE8KVTDSeMPw Sep 08 10:47:51.628814 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:47:51.628814 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:47:51.628814 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:47:51.628814 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:47:51.628814 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:47:51.628814 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:47:51.628814 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 998378cc815344ba8a107d1cd61f40fd Sep 08 10:47:51.628814 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-DeleteServersTestJSON-69164830 Sep 08 10:47:51.628814 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:47:51.628814 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:47:51.628814 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:47:51.628814 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-DeleteServersTestJSON-69164830 Sep 08 10:47:51.628814 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 998378cc815344ba8a107d1cd61f40fd Sep 08 10:47:51.628814 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-DeleteServersTestJSON-69164830 Sep 08 10:47:51.628814 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-DeleteServersTestJSON-69164830-project Sep 08 10:47:51.628814 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:47:51.628814 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:47:51.628814 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: d08269c53bcb41c88953e7c79f5ad185 Sep 08 10:47:51.628814 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-DeleteServersTestJSON-69164830-project Sep 08 10:47:51.628814 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:47:51.628814 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 2748dac9-3592-45b6-afe2-03a226e1026a could not be found. Sep 08 10:47:51.628814 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '2748dac9-3592-45b6-afe2-03a226e1026a'} Sep 08 10:47:51.628814 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:47:51.628814 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:51.628814 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:47:51.628814 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:47:51.628814 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:47:51.628814 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:47:51.628814 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 08 10:47:51.628814 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 08 10:47:51.628814 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2748dac9-3592-45b6-afe2-03a226e1026a could not be found. Sep 08 10:47:51.628814 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:51.628814 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:51.628814 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:51.628814 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:51.628814 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:47:51.628814 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:47:51.628814 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:47:51.628814 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:47:51.628814 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:47:51.628814 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:47:51.628814 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:47:51.628814 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:47:51.628814 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:47:51.628814 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:47:51.628814 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:47:51.628814 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:47:51.628814 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:47:51.628814 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:47:51.628814 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2748dac9-3592-45b6-afe2-03a226e1026a could not be found. Sep 08 10:47:51.628814 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:51.628814 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:51.628814 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:51.632697 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:51.632697 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:47:51.632697 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:47:51.632697 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:47:51.632697 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:47:51.632697 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2748dac9-3592-45b6-afe2-03a226e1026a could not be found. Sep 08 10:47:51.632697 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:51.632697 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2949ed3a-0ed1-4764-889b-a02a7ec5d111 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Returning 404 to user: Instance 2748dac9-3592-45b6-afe2-03a226e1026a could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:47:51.632697 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2949ed3a-0ed1-4764-889b-a02a7ec5d111 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2748dac9-3592-45b6-afe2-03a226e1026a" status: 404 len: 111 microversion: 2.1 time: 0.021080 Sep 08 10:47:51.636330 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1224/2420] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:47:51 2022] DELETE /compute/v2.1/servers/2748dac9-3592-45b6-afe2-03a226e1026a => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:47:51.642380 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bc2fd2bf-8c54-4e1f-bec8-1cfbf8844412 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:51.643000 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bc2fd2bf-8c54-4e1f-bec8-1cfbf8844412 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 2748dac9-3592-45b6-afe2-03a226e1026a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:51.651588 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-bc2fd2bf-8c54-4e1f-bec8-1cfbf8844412 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] HTTP exception thrown: Instance 2748dac9-3592-45b6-afe2-03a226e1026a could not be found. Sep 08 10:47:51.653903 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bc2fd2bf-8c54-4e1f-bec8-1cfbf8844412 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Request method failure captured: Sep 08 10:47:51.653903 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/2748dac9-3592-45b6-afe2-03a226e1026a HTTP/1.1 Sep 08 10:47:51.653903 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:47:51.653903 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:47:51.653903 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:47:51.653903 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:47:51.653903 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:47:51.653903 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:47:51.653903 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:47:51.653903 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:47:51.653903 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcbOYaOup_Ia1bHuprOxxP_LkfdCzYSX9xstQr2GVmRBueUQ0e967rlioz5jpJV566ZCuz_bYy_us0o8_CIFlOGOVfrC9_e_1_vEhZ3YdgjG89HBhaIJ_lG7Uv4nQrC-nfHrMx_LNyd0rOd4Blcm801SOcX7oe5VDxGTE8KVTDSeMPw Sep 08 10:47:51.653903 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:47:51.653903 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:47:51.653903 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:47:51.653903 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:47:51.653903 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:47:51.653903 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:47:51.653903 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 998378cc815344ba8a107d1cd61f40fd Sep 08 10:47:51.653903 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-DeleteServersTestJSON-69164830 Sep 08 10:47:51.653903 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:47:51.653903 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:47:51.653903 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:47:51.653903 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-DeleteServersTestJSON-69164830 Sep 08 10:47:51.653903 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 998378cc815344ba8a107d1cd61f40fd Sep 08 10:47:51.653903 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-DeleteServersTestJSON-69164830 Sep 08 10:47:51.653903 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-DeleteServersTestJSON-69164830-project Sep 08 10:47:51.653903 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:47:51.653903 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:47:51.653903 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: d08269c53bcb41c88953e7c79f5ad185 Sep 08 10:47:51.653903 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-DeleteServersTestJSON-69164830-project Sep 08 10:47:51.653903 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:47:51.653903 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 2748dac9-3592-45b6-afe2-03a226e1026a could not be found. Sep 08 10:47:51.653903 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '2748dac9-3592-45b6-afe2-03a226e1026a'} Sep 08 10:47:51.653903 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:47:51.653903 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:51.653903 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:47:51.653903 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:47:51.653903 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:47:51.653903 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:47:51.653903 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 08 10:47:51.653903 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 08 10:47:51.653903 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2748dac9-3592-45b6-afe2-03a226e1026a could not be found. Sep 08 10:47:51.653903 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:51.653903 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:51.653903 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:51.653903 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:51.653903 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:47:51.653903 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:47:51.653903 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:47:51.653903 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:47:51.653903 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:47:51.653903 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:47:51.653903 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:47:51.653903 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:47:51.653903 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:47:51.653903 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:47:51.653903 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:47:51.653903 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:47:51.653903 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2748dac9-3592-45b6-afe2-03a226e1026a could not be found. Sep 08 10:47:51.653903 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:51.653903 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:51.653903 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:51.653903 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:51.653903 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:47:51.657953 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:47:51.657953 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:47:51.657953 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:47:51.657953 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2748dac9-3592-45b6-afe2-03a226e1026a could not be found. Sep 08 10:47:51.657953 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:51.657953 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bc2fd2bf-8c54-4e1f-bec8-1cfbf8844412 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Returning 404 to user: Instance 2748dac9-3592-45b6-afe2-03a226e1026a could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:47:51.657953 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bc2fd2bf-8c54-4e1f-bec8-1cfbf8844412 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/2748dac9-3592-45b6-afe2-03a226e1026a" status: 404 len: 111 microversion: 2.1 time: 0.017890 Sep 08 10:47:51.660509 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1225/2421] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:51 2022] GET /compute/v2.1/servers/2748dac9-3592-45b6-afe2-03a226e1026a => generated 111 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:47:51.770236 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-bc105629-4688-4723-b7be-bcd77ccb865e tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528fc9fbb57149c9a9c755c6497f5c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effe8e6c23114b8ab80e76bec365de60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:51.804873 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bc105629-4688-4723-b7be-bcd77ccb865e tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] 10.222.0.27 "GET /compute/v2.1/servers/4703a7bf-a1ba-4bba-8928-3c403f3f3f21" status: 200 len: 1292 microversion: 2.1 time: 0.599987 Sep 08 10:47:51.809924 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1197/2422] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:51 2022] GET /compute/v2.1/servers/4703a7bf-a1ba-4bba-8928-3c403f3f3f21 => generated 1292 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:51.831877 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-65172864-885d-4da4-a5f6-d3fedac771e4 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:51.832502 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-65172864-885d-4da4-a5f6-d3fedac771e4 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] [instance: 5134b057-ca4f-4ec8-8dd7-435d4e3d1279] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:51.845162 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-65172864-885d-4da4-a5f6-d3fedac771e4 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:51.845679 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-65172864-885d-4da4-a5f6-d3fedac771e4 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:51.846127 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-65172864-885d-4da4-a5f6-d3fedac771e4 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:51.846854 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-65172864-885d-4da4-a5f6-d3fedac771e4 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:51.847314 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-65172864-885d-4da4-a5f6-d3fedac771e4 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:51.853452 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-65172864-885d-4da4-a5f6-d3fedac771e4 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:51.983029 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-60060dc8-532c-41da-8589-b6759fbde60a tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:51.985469 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-60060dc8-532c-41da-8589-b6759fbde60a tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] [instance: 72eb7387-3f16-4b4f-ab9a-89076f169fc1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:51.998944 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-60060dc8-532c-41da-8589-b6759fbde60a tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:51.999452 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-60060dc8-532c-41da-8589-b6759fbde60a tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:51.999890 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-60060dc8-532c-41da-8589-b6759fbde60a tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:52.001317 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-60060dc8-532c-41da-8589-b6759fbde60a tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:52.002187 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-60060dc8-532c-41da-8589-b6759fbde60a tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:52.002812 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-60060dc8-532c-41da-8589-b6759fbde60a tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:52.098049 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-60060dc8-532c-41da-8589-b6759fbde60a tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] 10.222.0.27 "GET /compute/v2.1/servers/72eb7387-3f16-4b4f-ab9a-89076f169fc1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.121850 Sep 08 10:47:52.106725 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1198/2423] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 10:47:51 2022] GET /compute/v2.1/servers/72eb7387-3f16-4b4f-ab9a-89076f169fc1/os-volume_attachments => generated 25 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:47:52.132310 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-65172864-885d-4da4-a5f6-d3fedac771e4 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6f265811ad4ccf866fb8094782dd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9a5f2a2b4f460dad3731b0ce6ecebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:52.171307 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-99f14663-c288-43f9-b971-24addc782799 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:52.172059 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-99f14663-c288-43f9-b971-24addc782799 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: 3766b195-ace4-4563-a24e-dca72941251e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:52.179728 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-65172864-885d-4da4-a5f6-d3fedac771e4 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] 10.222.0.27 "GET /compute/v2.1/servers/5134b057-ca4f-4ec8-8dd7-435d4e3d1279" status: 200 len: 1218 microversion: 2.1 time: 0.335353 Sep 08 10:47:52.203167 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1226/2424] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:51 2022] GET /compute/v2.1/servers/5134b057-ca4f-4ec8-8dd7-435d4e3d1279 => generated 1218 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:52.217065 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-99f14663-c288-43f9-b971-24addc782799 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:52.222820 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-99f14663-c288-43f9-b971-24addc782799 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:52.234813 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-99f14663-c288-43f9-b971-24addc782799 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:52.235823 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-99f14663-c288-43f9-b971-24addc782799 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:52.236829 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-99f14663-c288-43f9-b971-24addc782799 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:52.237462 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-99f14663-c288-43f9-b971-24addc782799 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:52.534772 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-94d50d7c-672b-46f5-a882-147af93122f7 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1751380363", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "d95e49f0-b609-40de-a984-83ccfd7750c4"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:47:52.638422 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-99f14663-c288-43f9-b971-24addc782799 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:52.661339 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-99f14663-c288-43f9-b971-24addc782799 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e" status: 200 len: 1472 microversion: 2.1 time: 0.494660 Sep 08 10:47:52.664735 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1199/2425] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:52 2022] GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e => generated 1472 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:47:52.679135 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-94d50d7c-672b-46f5-a882-147af93122f7 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] validate_networks() for [('d95e49f0-b609-40de-a984-83ccfd7750c4', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:47:52.831388 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a26557cc-c519-4caf-9e32-6404ae8f39b8 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:52.832015 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a26557cc-c519-4caf-9e32-6404ae8f39b8 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] [instance: 4703a7bf-a1ba-4bba-8928-3c403f3f3f21] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:52.841714 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a26557cc-c519-4caf-9e32-6404ae8f39b8 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:52.847974 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a26557cc-c519-4caf-9e32-6404ae8f39b8 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:52.850113 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a26557cc-c519-4caf-9e32-6404ae8f39b8 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:52.853875 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a26557cc-c519-4caf-9e32-6404ae8f39b8 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:52.855010 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a26557cc-c519-4caf-9e32-6404ae8f39b8 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:52.857065 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a26557cc-c519-4caf-9e32-6404ae8f39b8 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:53.416739 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a26557cc-c519-4caf-9e32-6404ae8f39b8 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528fc9fbb57149c9a9c755c6497f5c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effe8e6c23114b8ab80e76bec365de60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:53.432459 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a26557cc-c519-4caf-9e32-6404ae8f39b8 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] 10.222.0.27 "GET /compute/v2.1/servers/4703a7bf-a1ba-4bba-8928-3c403f3f3f21" status: 200 len: 1482 microversion: 2.1 time: 0.605278 Sep 08 10:47:53.455834 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1200/2426] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:52 2022] GET /compute/v2.1/servers/4703a7bf-a1ba-4bba-8928-3c403f3f3f21 => generated 1482 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:47:53.463398 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-90f0890d-3ea8-48e4-8718-046f94cc9918 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:53.474487 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-90f0890d-3ea8-48e4-8718-046f94cc9918 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] [instance: 5134b057-ca4f-4ec8-8dd7-435d4e3d1279] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:53.491194 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90f0890d-3ea8-48e4-8718-046f94cc9918 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:53.492593 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90f0890d-3ea8-48e4-8718-046f94cc9918 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:53.493116 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90f0890d-3ea8-48e4-8718-046f94cc9918 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:53.496453 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90f0890d-3ea8-48e4-8718-046f94cc9918 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:53.497354 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90f0890d-3ea8-48e4-8718-046f94cc9918 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:53.497846 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90f0890d-3ea8-48e4-8718-046f94cc9918 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:53.677896 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-90f0890d-3ea8-48e4-8718-046f94cc9918 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6f265811ad4ccf866fb8094782dd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9a5f2a2b4f460dad3731b0ce6ecebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:53.691006 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-90f0890d-3ea8-48e4-8718-046f94cc9918 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] 10.222.0.27 "GET /compute/v2.1/servers/5134b057-ca4f-4ec8-8dd7-435d4e3d1279" status: 200 len: 1280 microversion: 2.1 time: 0.233623 Sep 08 10:47:53.710347 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1201/2427] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:53 2022] GET /compute/v2.1/servers/5134b057-ca4f-4ec8-8dd7-435d4e3d1279 => generated 1280 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:53.725691 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-337d0e0e-f1a2-4ded-8551-6a962ec5d6a5 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:53.726442 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-337d0e0e-f1a2-4ded-8551-6a962ec5d6a5 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] [instance: 4703a7bf-a1ba-4bba-8928-3c403f3f3f21] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:53.745623 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-337d0e0e-f1a2-4ded-8551-6a962ec5d6a5 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:53.746156 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-337d0e0e-f1a2-4ded-8551-6a962ec5d6a5 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:53.746789 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-337d0e0e-f1a2-4ded-8551-6a962ec5d6a5 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:53.748096 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-337d0e0e-f1a2-4ded-8551-6a962ec5d6a5 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:53.748691 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-337d0e0e-f1a2-4ded-8551-6a962ec5d6a5 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:53.749325 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-337d0e0e-f1a2-4ded-8551-6a962ec5d6a5 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:53.908116 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-337d0e0e-f1a2-4ded-8551-6a962ec5d6a5 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] 10.222.0.27 "GET /compute/v2.1/servers/4703a7bf-a1ba-4bba-8928-3c403f3f3f21/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.196258 Sep 08 10:47:53.917334 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1202/2428] 10.222.0.27 () {58 vars in 1275 bytes} [Thu Sep 8 10:47:53 2022] GET /compute/v2.1/servers/4703a7bf-a1ba-4bba-8928-3c403f3f3f21/os-interface => generated 284 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:47:53.926108 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a95a0acd-0024-4f81-bfe8-bb803443bfbb tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:53.927285 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a95a0acd-0024-4f81-bfe8-bb803443bfbb tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: 3766b195-ace4-4563-a24e-dca72941251e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:53.942108 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a95a0acd-0024-4f81-bfe8-bb803443bfbb tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:53.942486 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a95a0acd-0024-4f81-bfe8-bb803443bfbb tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:53.944054 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a95a0acd-0024-4f81-bfe8-bb803443bfbb tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:53.946109 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a95a0acd-0024-4f81-bfe8-bb803443bfbb tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:53.948301 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a95a0acd-0024-4f81-bfe8-bb803443bfbb tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:53.948767 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a95a0acd-0024-4f81-bfe8-bb803443bfbb tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:54.027999 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-94d50d7c-672b-46f5-a882-147af93122f7 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:47:54.029101 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-94d50d7c-672b-46f5-a882-147af93122f7 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:47:54.029736 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-94d50d7c-672b-46f5-a882-147af93122f7 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:47:54.030296 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-94d50d7c-672b-46f5-a882-147af93122f7 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:47:54.030863 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-94d50d7c-672b-46f5-a882-147af93122f7 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:47:54.049887 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94d50d7c-672b-46f5-a882-147af93122f7 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:54.050385 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94d50d7c-672b-46f5-a882-147af93122f7 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:54.050819 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94d50d7c-672b-46f5-a882-147af93122f7 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:54.059574 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94d50d7c-672b-46f5-a882-147af93122f7 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:54.064520 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94d50d7c-672b-46f5-a882-147af93122f7 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:54.067274 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94d50d7c-672b-46f5-a882-147af93122f7 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:54.144909 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-94d50d7c-672b-46f5-a882-147af93122f7 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Getting quotas for project 68a768a3863448bca0c6cda11afdd955. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:47:54.158623 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-94d50d7c-672b-46f5-a882-147af93122f7 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Getting quotas for user 03ff38511b484fbcb7817a56076cf4b7 and project 68a768a3863448bca0c6cda11afdd955. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:47:54.181468 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-94d50d7c-672b-46f5-a882-147af93122f7 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:47:54.185209 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-94d50d7c-672b-46f5-a882-147af93122f7 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] [instance: b7c9f2aa-8e8c-4200-89ee-a107ea59256a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:47:54.298824 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-94d50d7c-672b-46f5-a882-147af93122f7 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.770616 Sep 08 10:47:54.305434 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1227/2429] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:47:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1778 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 10:47:54.312413 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fb3f382c-4353-4e44-81b3-1f073d10e37c tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:54.314779 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fb3f382c-4353-4e44-81b3-1f073d10e37c tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] [instance: b7c9f2aa-8e8c-4200-89ee-a107ea59256a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:54.332240 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a95a0acd-0024-4f81-bfe8-bb803443bfbb tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:54.373275 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a95a0acd-0024-4f81-bfe8-bb803443bfbb tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e" status: 200 len: 1472 microversion: 2.1 time: 0.452613 Sep 08 10:47:54.376661 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1203/2430] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:53 2022] GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e => generated 1472 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:54.518346 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fb3f382c-4353-4e44-81b3-1f073d10e37c tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ff38511b484fbcb7817a56076cf4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a768a3863448bca0c6cda11afdd955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:54.527208 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fb3f382c-4353-4e44-81b3-1f073d10e37c tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] 10.222.0.27 "GET /compute/v2.1/servers/b7c9f2aa-8e8c-4200-89ee-a107ea59256a" status: 200 len: 1218 microversion: 2.1 time: 0.220564 Sep 08 10:47:54.533228 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1228/2431] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:54 2022] GET /compute/v2.1/servers/b7c9f2aa-8e8c-4200-89ee-a107ea59256a => generated 1218 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:54.716844 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-19a6f310-b1b6-4a3c-97a8-1811648db679 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:54.717913 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-19a6f310-b1b6-4a3c-97a8-1811648db679 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] [instance: 5134b057-ca4f-4ec8-8dd7-435d4e3d1279] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:54.730157 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-19a6f310-b1b6-4a3c-97a8-1811648db679 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:54.735555 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-19a6f310-b1b6-4a3c-97a8-1811648db679 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:54.738707 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-19a6f310-b1b6-4a3c-97a8-1811648db679 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:54.760212 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-19a6f310-b1b6-4a3c-97a8-1811648db679 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:54.762865 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-19a6f310-b1b6-4a3c-97a8-1811648db679 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:54.764914 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-19a6f310-b1b6-4a3c-97a8-1811648db679 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:55.019682 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-19a6f310-b1b6-4a3c-97a8-1811648db679 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6f265811ad4ccf866fb8094782dd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9a5f2a2b4f460dad3731b0ce6ecebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:55.034161 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-19a6f310-b1b6-4a3c-97a8-1811648db679 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] 10.222.0.27 "GET /compute/v2.1/servers/5134b057-ca4f-4ec8-8dd7-435d4e3d1279" status: 200 len: 1280 microversion: 2.1 time: 0.321850 Sep 08 10:47:55.057158 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1204/2432] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:54 2022] GET /compute/v2.1/servers/5134b057-ca4f-4ec8-8dd7-435d4e3d1279 => generated 1280 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:55.399994 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e1c531d8-6f18-41ea-a694-06873bb2f636 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:55.401336 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e1c531d8-6f18-41ea-a694-06873bb2f636 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: 3766b195-ace4-4563-a24e-dca72941251e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:55.407533 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:47:55.425263 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e1c531d8-6f18-41ea-a694-06873bb2f636 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:55.425841 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e1c531d8-6f18-41ea-a694-06873bb2f636 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:55.426300 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e1c531d8-6f18-41ea-a694-06873bb2f636 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:55.430319 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e1c531d8-6f18-41ea-a694-06873bb2f636 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:55.430819 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e1c531d8-6f18-41ea-a694-06873bb2f636 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:55.434109 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e1c531d8-6f18-41ea-a694-06873bb2f636 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:55.560203 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-62ae3512-bf33-4473-b575-cec797ffa8dc tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:55.560824 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-62ae3512-bf33-4473-b575-cec797ffa8dc tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] [instance: b7c9f2aa-8e8c-4200-89ee-a107ea59256a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:55.567830 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-62ae3512-bf33-4473-b575-cec797ffa8dc tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:55.568324 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-62ae3512-bf33-4473-b575-cec797ffa8dc tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:55.568752 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-62ae3512-bf33-4473-b575-cec797ffa8dc tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:55.576118 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-62ae3512-bf33-4473-b575-cec797ffa8dc tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:55.577891 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-62ae3512-bf33-4473-b575-cec797ffa8dc tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:55.579895 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-62ae3512-bf33-4473-b575-cec797ffa8dc tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:55.818257 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-62ae3512-bf33-4473-b575-cec797ffa8dc tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ff38511b484fbcb7817a56076cf4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a768a3863448bca0c6cda11afdd955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:55.828954 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-62ae3512-bf33-4473-b575-cec797ffa8dc tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] 10.222.0.27 "GET /compute/v2.1/servers/b7c9f2aa-8e8c-4200-89ee-a107ea59256a" status: 200 len: 1214 microversion: 2.1 time: 0.272800 Sep 08 10:47:55.857435 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1205/2433] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:55 2022] GET /compute/v2.1/servers/b7c9f2aa-8e8c-4200-89ee-a107ea59256a => generated 1214 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:47:55.948855 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e1c531d8-6f18-41ea-a694-06873bb2f636 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:55.971409 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e1c531d8-6f18-41ea-a694-06873bb2f636 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e" status: 200 len: 1472 microversion: 2.1 time: 0.571514 Sep 08 10:47:55.975306 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1229/2434] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:55 2022] GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e => generated 1472 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:56.061560 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-079700bb-8ff5-4839-b2a7-e8a930780f5c tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:56.062244 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-079700bb-8ff5-4839-b2a7-e8a930780f5c tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] [instance: 5134b057-ca4f-4ec8-8dd7-435d4e3d1279] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:56.072034 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-079700bb-8ff5-4839-b2a7-e8a930780f5c tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:56.076231 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-079700bb-8ff5-4839-b2a7-e8a930780f5c tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:56.078218 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-079700bb-8ff5-4839-b2a7-e8a930780f5c tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:56.079095 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-079700bb-8ff5-4839-b2a7-e8a930780f5c tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:56.079573 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-079700bb-8ff5-4839-b2a7-e8a930780f5c tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:56.080008 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-079700bb-8ff5-4839-b2a7-e8a930780f5c tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:56.253064 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-079700bb-8ff5-4839-b2a7-e8a930780f5c tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6f265811ad4ccf866fb8094782dd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9a5f2a2b4f460dad3731b0ce6ecebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:56.268842 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-079700bb-8ff5-4839-b2a7-e8a930780f5c tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] 10.222.0.27 "GET /compute/v2.1/servers/5134b057-ca4f-4ec8-8dd7-435d4e3d1279" status: 200 len: 1280 microversion: 2.1 time: 0.211173 Sep 08 10:47:56.270070 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1206/2435] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:56 2022] GET /compute/v2.1/servers/5134b057-ca4f-4ec8-8dd7-435d4e3d1279 => generated 1280 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:56.591630 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6cb99aaf-132f-440d-b9ca-2e5cdc81763f tempest-ImagesDeleteNegativeTestJSON-2047064614 tempest-ImagesDeleteNegativeTestJSON-2047064614-project] 10.222.0.27 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.383963 Sep 08 10:47:56.592824 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1230/2436] 10.222.0.27 () {58 vars in 1128 bytes} [Thu Sep 8 10:47:56 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 386 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 08 10:47:56.606055 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4fc3c237-eb7e-4ef3-8a28-491167308bc6 tempest-ImagesDeleteNegativeTestJSON-2047064614 tempest-ImagesDeleteNegativeTestJSON-2047064614-project] Calling method '.version_select at 0x7f68e4cf1790>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:56.647160 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-4fc3c237-eb7e-4ef3-8a28-491167308bc6 tempest-ImagesDeleteNegativeTestJSON-2047064614 tempest-ImagesDeleteNegativeTestJSON-2047064614-project] HTTP exception thrown: Image not found. Sep 08 10:47:56.650524 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4fc3c237-eb7e-4ef3-8a28-491167308bc6 tempest-ImagesDeleteNegativeTestJSON-2047064614 tempest-ImagesDeleteNegativeTestJSON-2047064614-project] Request method failure captured: Sep 08 10:47:56.650524 n-d-850501-12 devstack@n-api.service[128861]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Sep 08 10:47:56.650524 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:47:56.650524 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:47:56.650524 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:47:56.650524 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:47:56.650524 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:47:56.650524 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:47:56.650524 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:47:56.650524 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:47:56.650524 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGchc4PhHL4fjXXmw5qX-skyz490FGZPPdhKueaU650dYCte1QuuWX_VgmsGbGi5gzlatJmStdCvwIbX_HAObo4Xvb6tOl54qHWsP10CFx47IMHAEvd9xGOkFphBrXAhFFUlmJSbIpkcliz7PQu4muZM0QdVCE6dbReUEfhK4jZ_GPBc Sep 08 10:47:56.650524 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:47:56.650524 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:47:56.650524 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:47:56.650524 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:47:56.650524 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:47:56.650524 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:47:56.650524 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: f55a9a9ac1644cf9a6359e6a1d6ee4fd Sep 08 10:47:56.650524 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-2047064614 Sep 08 10:47:56.650524 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:47:56.650524 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:47:56.650524 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f55a9a9ac1644cf9a6359e6a1d6ee4fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f55a9a9ac1644cf9a6359e6a1d6ee4fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f55a9a9ac1644cf9a6359e6a1d6ee4fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f55a9a9ac1644cf9a6359e6a1d6ee4fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:47:56.650524 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-2047064614 Sep 08 10:47:56.650524 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: f55a9a9ac1644cf9a6359e6a1d6ee4fd Sep 08 10:47:56.650524 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-2047064614 Sep 08 10:47:56.650524 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ImagesDeleteNegativeTestJSON-2047064614-project Sep 08 10:47:56.650524 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:47:56.650524 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:47:56.650524 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 24297426aa9d484fa42f0012687f8b78 Sep 08 10:47:56.650524 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-2047064614-project Sep 08 10:47:56.650524 n-d-850501-12 devstack@n-api.service[128861]: method: Sep 08 10:47:56.650524 n-d-850501-12 devstack@n-api.service[128861]: exception: Image not found. Sep 08 10:47:56.650524 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '-1'} Sep 08 10:47:56.650524 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:47:56.650524 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:56.650524 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 08 10:47:56.650524 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 08 10:47:56.650524 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 10:47:56.650524 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 10:47:56.650524 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 10:47:56.650524 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 10:47:56.650524 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 08 10:47:56.650524 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 08 10:47:56.650524 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 08 10:47:56.650524 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 08 10:47:56.650524 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 10:47:56.650524 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 10:47:56.650524 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 10:47:56.650524 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 10:47:56.650524 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Sep 08 10:47:56.650524 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:56.650524 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:56.650524 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:56.650524 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:56.650524 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 08 10:47:56.650524 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 08 10:47:56.650524 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 08 10:47:56.650524 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 08 10:47:56.650524 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 08 10:47:56.650524 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 08 10:47:56.650524 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Sep 08 10:47:56.650524 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:56.650524 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:56.650524 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:56.650524 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:56.655852 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:47:56.655852 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:47:56.655852 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:47:56.655852 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:47:56.655852 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:47:56.655852 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:47:56.655852 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:47:56.655852 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:47:56.655852 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 08 10:47:56.655852 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 08 10:47:56.655852 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 08 10:47:56.655852 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:56.655852 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:56.655852 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:56.655852 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:56.655852 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:47:56.655852 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:47:56.655852 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:47:56.655852 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:47:56.655852 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 08 10:47:56.655852 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:56.658476 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4fc3c237-eb7e-4ef3-8a28-491167308bc6 tempest-ImagesDeleteNegativeTestJSON-2047064614 tempest-ImagesDeleteNegativeTestJSON-2047064614-project] Returning 404 to user: Image not found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:47:56.659538 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4fc3c237-eb7e-4ef3-8a28-491167308bc6 tempest-ImagesDeleteNegativeTestJSON-2047064614 tempest-ImagesDeleteNegativeTestJSON-2047064614-project] 10.222.0.27 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.057754 Sep 08 10:47:56.660576 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1207/2437] 10.222.0.27 () {58 vars in 1134 bytes} [Thu Sep 8 10:47:56 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:47:56.671690 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2d9057a1-f02f-430b-92e8-db4964d9d8b0 tempest-ImagesDeleteNegativeTestJSON-2047064614 tempest-ImagesDeleteNegativeTestJSON-2047064614-project] Calling method '.version_select at 0x7f68e8b86af0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:56.728289 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-2d9057a1-f02f-430b-92e8-db4964d9d8b0 tempest-ImagesDeleteNegativeTestJSON-2047064614 tempest-ImagesDeleteNegativeTestJSON-2047064614-project] HTTP exception thrown: Image not found. Sep 08 10:47:56.731356 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2d9057a1-f02f-430b-92e8-db4964d9d8b0 tempest-ImagesDeleteNegativeTestJSON-2047064614 tempest-ImagesDeleteNegativeTestJSON-2047064614-project] Request method failure captured: Sep 08 10:47:56.731356 n-d-850501-12 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/images/949d251a-e1ad-480a-bf54-5615187875aj HTTP/1.1 Sep 08 10:47:56.731356 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:47:56.731356 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:47:56.731356 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:47:56.731356 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:47:56.731356 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:47:56.731356 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:47:56.731356 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:47:56.731356 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:47:56.731356 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGchc4PhHL4fjXXmw5qX-skyz490FGZPPdhKueaU650dYCte1QuuWX_VgmsGbGi5gzlatJmStdCvwIbX_HAObo4Xvb6tOl54qHWsP10CFx47IMHAEvd9xGOkFphBrXAhFFUlmJSbIpkcliz7PQu4muZM0QdVCE6dbReUEfhK4jZ_GPBc Sep 08 10:47:56.731356 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:47:56.731356 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:47:56.731356 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:47:56.731356 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:47:56.731356 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:47:56.731356 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:47:56.731356 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: f55a9a9ac1644cf9a6359e6a1d6ee4fd Sep 08 10:47:56.731356 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-2047064614 Sep 08 10:47:56.731356 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:47:56.731356 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:47:56.731356 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f55a9a9ac1644cf9a6359e6a1d6ee4fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f55a9a9ac1644cf9a6359e6a1d6ee4fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f55a9a9ac1644cf9a6359e6a1d6ee4fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f55a9a9ac1644cf9a6359e6a1d6ee4fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:47:56.731356 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-2047064614 Sep 08 10:47:56.731356 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: f55a9a9ac1644cf9a6359e6a1d6ee4fd Sep 08 10:47:56.731356 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-2047064614 Sep 08 10:47:56.731356 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ImagesDeleteNegativeTestJSON-2047064614-project Sep 08 10:47:56.731356 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:47:56.731356 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:47:56.731356 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 24297426aa9d484fa42f0012687f8b78 Sep 08 10:47:56.731356 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-2047064614-project Sep 08 10:47:56.731356 n-d-850501-12 devstack@n-api.service[128862]: method: Sep 08 10:47:56.731356 n-d-850501-12 devstack@n-api.service[128862]: exception: Image not found. Sep 08 10:47:56.731356 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '949d251a-e1ad-480a-bf54-5615187875aj'} Sep 08 10:47:56.731356 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:47:56.731356 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:56.731356 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 08 10:47:56.731356 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 08 10:47:56.731356 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 10:47:56.731356 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 10:47:56.731356 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 10:47:56.731356 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 10:47:56.731356 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 08 10:47:56.731356 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 08 10:47:56.731356 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 08 10:47:56.731356 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 08 10:47:56.731356 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 10:47:56.731356 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 10:47:56.731356 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 10:47:56.731356 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 10:47:56.731356 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 949d251a-e1ad-480a-bf54-5615187875aj to delete Sep 08 10:47:56.731356 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:56.731356 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:56.731356 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:56.731356 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:56.731356 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 08 10:47:56.731356 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 08 10:47:56.731356 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 08 10:47:56.731356 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 08 10:47:56.731356 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 08 10:47:56.731356 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 08 10:47:56.731356 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 949d251a-e1ad-480a-bf54-5615187875aj could not be found. Sep 08 10:47:56.731356 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:56.731356 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:56.731356 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:56.735601 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:56.735601 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:47:56.735601 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:47:56.735601 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:47:56.735601 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:47:56.735601 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:47:56.735601 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:47:56.735601 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:47:56.735601 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:47:56.735601 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 08 10:47:56.735601 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 08 10:47:56.735601 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 08 10:47:56.735601 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:56.735601 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:56.735601 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:56.735601 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:56.735601 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:47:56.735601 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:47:56.735601 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:47:56.735601 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:47:56.735601 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 08 10:47:56.735601 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:56.739343 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2d9057a1-f02f-430b-92e8-db4964d9d8b0 tempest-ImagesDeleteNegativeTestJSON-2047064614 tempest-ImagesDeleteNegativeTestJSON-2047064614-project] Returning 404 to user: Image not found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:47:56.741216 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2d9057a1-f02f-430b-92e8-db4964d9d8b0 tempest-ImagesDeleteNegativeTestJSON-2047064614 tempest-ImagesDeleteNegativeTestJSON-2047064614-project] 10.222.0.27 "DELETE /compute/v2.1/images/949d251a-e1ad-480a-bf54-5615187875aj" status: 404 len: 62 microversion: 2.1 time: 0.073782 Sep 08 10:47:56.742276 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1231/2438] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:56 2022] DELETE /compute/v2.1/images/949d251a-e1ad-480a-bf54-5615187875aj => generated 62 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:47:56.754372 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cbb43916-5baf-49a8-88e1-96b1a67627ea tempest-ImagesDeleteNegativeTestJSON-2047064614 tempest-ImagesDeleteNegativeTestJSON-2047064614-project] Calling method '.version_select at 0x7f68e5296310>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:56.780536 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-cbb43916-5baf-49a8-88e1-96b1a67627ea tempest-ImagesDeleteNegativeTestJSON-2047064614 tempest-ImagesDeleteNegativeTestJSON-2047064614-project] HTTP exception thrown: Image not found. Sep 08 10:47:56.782458 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cbb43916-5baf-49a8-88e1-96b1a67627ea tempest-ImagesDeleteNegativeTestJSON-2047064614 tempest-ImagesDeleteNegativeTestJSON-2047064614-project] Request method failure captured: Sep 08 10:47:56.782458 n-d-850501-12 devstack@n-api.service[128861]: request: DELETE /compute/v2.1/images/162de38b-beb9-439f-b798-624efb7db5641 HTTP/1.1 Sep 08 10:47:56.782458 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:47:56.782458 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:47:56.782458 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:47:56.782458 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:47:56.782458 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:47:56.782458 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:47:56.782458 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:47:56.782458 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:47:56.782458 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGchc4PhHL4fjXXmw5qX-skyz490FGZPPdhKueaU650dYCte1QuuWX_VgmsGbGi5gzlatJmStdCvwIbX_HAObo4Xvb6tOl54qHWsP10CFx47IMHAEvd9xGOkFphBrXAhFFUlmJSbIpkcliz7PQu4muZM0QdVCE6dbReUEfhK4jZ_GPBc Sep 08 10:47:56.782458 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:47:56.782458 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:47:56.782458 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:47:56.782458 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:47:56.782458 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:47:56.782458 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:47:56.782458 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: f55a9a9ac1644cf9a6359e6a1d6ee4fd Sep 08 10:47:56.782458 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-2047064614 Sep 08 10:47:56.782458 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:47:56.782458 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:47:56.782458 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f55a9a9ac1644cf9a6359e6a1d6ee4fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f55a9a9ac1644cf9a6359e6a1d6ee4fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f55a9a9ac1644cf9a6359e6a1d6ee4fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f55a9a9ac1644cf9a6359e6a1d6ee4fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:47:56.782458 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-2047064614 Sep 08 10:47:56.782458 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: f55a9a9ac1644cf9a6359e6a1d6ee4fd Sep 08 10:47:56.782458 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-2047064614 Sep 08 10:47:56.782458 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ImagesDeleteNegativeTestJSON-2047064614-project Sep 08 10:47:56.782458 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:47:56.782458 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:47:56.782458 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 24297426aa9d484fa42f0012687f8b78 Sep 08 10:47:56.782458 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-2047064614-project Sep 08 10:47:56.782458 n-d-850501-12 devstack@n-api.service[128861]: method: Sep 08 10:47:56.782458 n-d-850501-12 devstack@n-api.service[128861]: exception: Image not found. Sep 08 10:47:56.782458 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '162de38b-beb9-439f-b798-624efb7db5641'} Sep 08 10:47:56.782458 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:47:56.782458 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:56.782458 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 08 10:47:56.782458 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 08 10:47:56.782458 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 10:47:56.782458 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 10:47:56.782458 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 10:47:56.782458 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 10:47:56.782458 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 08 10:47:56.782458 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 08 10:47:56.782458 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 08 10:47:56.782458 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 08 10:47:56.782458 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 10:47:56.782458 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 10:47:56.782458 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 10:47:56.782458 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 10:47:56.782458 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 162de38b-beb9-439f-b798-624efb7db5641 to delete Sep 08 10:47:56.782458 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:56.782458 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:56.782458 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:56.782458 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:56.782458 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 08 10:47:56.782458 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 08 10:47:56.782458 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 08 10:47:56.782458 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 08 10:47:56.782458 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 08 10:47:56.782458 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 08 10:47:56.782458 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 162de38b-beb9-439f-b798-624efb7db5641 could not be found. Sep 08 10:47:56.782458 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:56.782458 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:56.782458 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:56.786797 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:56.786797 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:47:56.786797 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:47:56.786797 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:47:56.786797 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:47:56.786797 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:47:56.786797 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:47:56.786797 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:47:56.786797 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:47:56.786797 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 08 10:47:56.786797 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 08 10:47:56.786797 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 08 10:47:56.786797 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:56.786797 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:56.786797 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:56.786797 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:56.786797 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:47:56.786797 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:47:56.786797 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:47:56.786797 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:47:56.786797 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 08 10:47:56.786797 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:56.786797 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cbb43916-5baf-49a8-88e1-96b1a67627ea tempest-ImagesDeleteNegativeTestJSON-2047064614 tempest-ImagesDeleteNegativeTestJSON-2047064614-project] Returning 404 to user: Image not found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:47:56.786797 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cbb43916-5baf-49a8-88e1-96b1a67627ea tempest-ImagesDeleteNegativeTestJSON-2047064614 tempest-ImagesDeleteNegativeTestJSON-2047064614-project] 10.222.0.27 "DELETE /compute/v2.1/images/162de38b-beb9-439f-b798-624efb7db5641" status: 404 len: 62 microversion: 2.1 time: 0.035243 Sep 08 10:47:56.786797 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1208/2439] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:47:56 2022] DELETE /compute/v2.1/images/162de38b-beb9-439f-b798-624efb7db5641 => generated 62 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:47:56.797255 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ade17e6d-4092-403a-bfe6-d53a765a521e tempest-ImagesDeleteNegativeTestJSON-2047064614 tempest-ImagesDeleteNegativeTestJSON-2047064614-project] Calling method '.version_select at 0x7f68e8b30430>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:56.844695 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-ade17e6d-4092-403a-bfe6-d53a765a521e tempest-ImagesDeleteNegativeTestJSON-2047064614 tempest-ImagesDeleteNegativeTestJSON-2047064614-project] HTTP exception thrown: Image not found. Sep 08 10:47:56.847125 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ade17e6d-4092-403a-bfe6-d53a765a521e tempest-ImagesDeleteNegativeTestJSON-2047064614 tempest-ImagesDeleteNegativeTestJSON-2047064614-project] Request method failure captured: Sep 08 10:47:56.847125 n-d-850501-12 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/images/tempest-invalid-426886935 HTTP/1.1 Sep 08 10:47:56.847125 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:47:56.847125 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:47:56.847125 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:47:56.847125 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:47:56.847125 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:47:56.847125 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:47:56.847125 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:47:56.847125 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:47:56.847125 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGchc4PhHL4fjXXmw5qX-skyz490FGZPPdhKueaU650dYCte1QuuWX_VgmsGbGi5gzlatJmStdCvwIbX_HAObo4Xvb6tOl54qHWsP10CFx47IMHAEvd9xGOkFphBrXAhFFUlmJSbIpkcliz7PQu4muZM0QdVCE6dbReUEfhK4jZ_GPBc Sep 08 10:47:56.847125 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:47:56.847125 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:47:56.847125 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:47:56.847125 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:47:56.847125 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:47:56.847125 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:47:56.847125 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: f55a9a9ac1644cf9a6359e6a1d6ee4fd Sep 08 10:47:56.847125 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-2047064614 Sep 08 10:47:56.847125 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:47:56.847125 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:47:56.847125 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f55a9a9ac1644cf9a6359e6a1d6ee4fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f55a9a9ac1644cf9a6359e6a1d6ee4fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f55a9a9ac1644cf9a6359e6a1d6ee4fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f55a9a9ac1644cf9a6359e6a1d6ee4fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:47:56.847125 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-2047064614 Sep 08 10:47:56.847125 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: f55a9a9ac1644cf9a6359e6a1d6ee4fd Sep 08 10:47:56.847125 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-2047064614 Sep 08 10:47:56.847125 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ImagesDeleteNegativeTestJSON-2047064614-project Sep 08 10:47:56.847125 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:47:56.847125 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:47:56.847125 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 24297426aa9d484fa42f0012687f8b78 Sep 08 10:47:56.847125 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-2047064614-project Sep 08 10:47:56.847125 n-d-850501-12 devstack@n-api.service[128862]: method: Sep 08 10:47:56.847125 n-d-850501-12 devstack@n-api.service[128862]: exception: Image not found. Sep 08 10:47:56.847125 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'tempest-invalid-426886935'} Sep 08 10:47:56.847125 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:47:56.847125 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:56.847125 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 08 10:47:56.847125 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 08 10:47:56.847125 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 10:47:56.847125 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 10:47:56.847125 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 10:47:56.847125 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 10:47:56.847125 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 08 10:47:56.847125 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 08 10:47:56.847125 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 08 10:47:56.847125 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 08 10:47:56.847125 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 10:47:56.847125 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 10:47:56.847125 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 10:47:56.847125 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 10:47:56.847125 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-426886935 to delete Sep 08 10:47:56.847125 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:56.847125 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:56.847125 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:56.847125 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:56.847125 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 08 10:47:56.847125 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 08 10:47:56.847125 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 08 10:47:56.847125 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 08 10:47:56.847125 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 08 10:47:56.847125 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 08 10:47:56.847125 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-426886935 could not be found. Sep 08 10:47:56.847125 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:56.847125 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:56.847125 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:56.847125 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:56.851705 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:47:56.851705 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:47:56.851705 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:47:56.851705 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:47:56.851705 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:47:56.851705 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:47:56.851705 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:47:56.851705 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:47:56.851705 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 08 10:47:56.851705 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 08 10:47:56.851705 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 08 10:47:56.851705 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:56.851705 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:56.851705 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:56.851705 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:56.851705 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:47:56.851705 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:47:56.851705 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:47:56.851705 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:47:56.851705 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 08 10:47:56.851705 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:47:56.851705 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ade17e6d-4092-403a-bfe6-d53a765a521e tempest-ImagesDeleteNegativeTestJSON-2047064614 tempest-ImagesDeleteNegativeTestJSON-2047064614-project] Returning 404 to user: Image not found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:47:56.851705 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ade17e6d-4092-403a-bfe6-d53a765a521e tempest-ImagesDeleteNegativeTestJSON-2047064614 tempest-ImagesDeleteNegativeTestJSON-2047064614-project] 10.222.0.27 "DELETE /compute/v2.1/images/tempest-invalid-426886935" status: 404 len: 62 microversion: 2.1 time: 0.057813 Sep 08 10:47:56.851705 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1232/2440] 10.222.0.27 () {58 vars in 1203 bytes} [Thu Sep 8 10:47:56 2022] DELETE /compute/v2.1/images/tempest-invalid-426886935 => generated 62 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:47:56.860873 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9d552e31-7bf0-4bd1-b9a9-d148fda8958d tempest-ImagesDeleteNegativeTestJSON-2047064614 tempest-ImagesDeleteNegativeTestJSON-2047064614-project] Calling method '.version_select at 0x7f68e4cf19d0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:56.894204 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-08722db5-5f86-41db-9d64-dce6746f3c40 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:56.895638 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-08722db5-5f86-41db-9d64-dce6746f3c40 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] [instance: b7c9f2aa-8e8c-4200-89ee-a107ea59256a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:56.914658 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-9d552e31-7bf0-4bd1-b9a9-d148fda8958d tempest-ImagesDeleteNegativeTestJSON-2047064614 tempest-ImagesDeleteNegativeTestJSON-2047064614-project] HTTP exception thrown: Image not found. Sep 08 10:47:56.916934 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9d552e31-7bf0-4bd1-b9a9-d148fda8958d tempest-ImagesDeleteNegativeTestJSON-2047064614 tempest-ImagesDeleteNegativeTestJSON-2047064614-project] Request method failure captured: Sep 08 10:47:56.916934 n-d-850501-12 devstack@n-api.service[128861]: request: DELETE /compute/v2.1/images/195a2135-ff0d-4a13-ad03-5fbab4a2dddd HTTP/1.1 Sep 08 10:47:56.916934 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:47:56.916934 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:47:56.916934 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:47:56.916934 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:47:56.916934 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:47:56.916934 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:47:56.916934 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:47:56.916934 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:47:56.916934 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGchc4PhHL4fjXXmw5qX-skyz490FGZPPdhKueaU650dYCte1QuuWX_VgmsGbGi5gzlatJmStdCvwIbX_HAObo4Xvb6tOl54qHWsP10CFx47IMHAEvd9xGOkFphBrXAhFFUlmJSbIpkcliz7PQu4muZM0QdVCE6dbReUEfhK4jZ_GPBc Sep 08 10:47:56.916934 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:47:56.916934 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:47:56.916934 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:47:56.916934 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:47:56.916934 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:47:56.916934 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:47:56.916934 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: f55a9a9ac1644cf9a6359e6a1d6ee4fd Sep 08 10:47:56.916934 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-2047064614 Sep 08 10:47:56.916934 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:47:56.916934 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:47:56.916934 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f55a9a9ac1644cf9a6359e6a1d6ee4fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f55a9a9ac1644cf9a6359e6a1d6ee4fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f55a9a9ac1644cf9a6359e6a1d6ee4fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f55a9a9ac1644cf9a6359e6a1d6ee4fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:47:56.916934 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-2047064614 Sep 08 10:47:56.916934 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: f55a9a9ac1644cf9a6359e6a1d6ee4fd Sep 08 10:47:56.916934 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-2047064614 Sep 08 10:47:56.916934 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ImagesDeleteNegativeTestJSON-2047064614-project Sep 08 10:47:56.916934 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:47:56.916934 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:47:56.916934 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 24297426aa9d484fa42f0012687f8b78 Sep 08 10:47:56.916934 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-2047064614-project Sep 08 10:47:56.916934 n-d-850501-12 devstack@n-api.service[128861]: method: Sep 08 10:47:56.916934 n-d-850501-12 devstack@n-api.service[128861]: exception: Image not found. Sep 08 10:47:56.916934 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '195a2135-ff0d-4a13-ad03-5fbab4a2dddd'} Sep 08 10:47:56.916934 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:47:56.916934 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:56.916934 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 08 10:47:56.916934 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 08 10:47:56.916934 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 10:47:56.916934 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 10:47:56.916934 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 10:47:56.916934 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 10:47:56.916934 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 08 10:47:56.916934 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 08 10:47:56.916934 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 08 10:47:56.916934 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 08 10:47:56.916934 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 10:47:56.916934 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 10:47:56.916934 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 10:47:56.916934 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 10:47:56.916934 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 195a2135-ff0d-4a13-ad03-5fbab4a2dddd to delete Sep 08 10:47:56.916934 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:56.916934 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:56.916934 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:56.916934 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:56.916934 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 08 10:47:56.916934 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 08 10:47:56.916934 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 08 10:47:56.916934 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 08 10:47:56.916934 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 08 10:47:56.916934 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 08 10:47:56.916934 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 195a2135-ff0d-4a13-ad03-5fbab4a2dddd could not be found. Sep 08 10:47:56.916934 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:56.916934 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:56.916934 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:56.922194 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:56.922194 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:47:56.922194 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:47:56.922194 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:47:56.922194 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:47:56.922194 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:47:56.922194 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:47:56.922194 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:47:56.922194 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:47:56.922194 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 08 10:47:56.922194 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 08 10:47:56.922194 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 08 10:47:56.922194 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:56.922194 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:47:56.922194 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:56.922194 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:47:56.922194 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:47:56.922194 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:47:56.922194 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:47:56.922194 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:47:56.922194 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 08 10:47:56.922194 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:47:56.922194 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9d552e31-7bf0-4bd1-b9a9-d148fda8958d tempest-ImagesDeleteNegativeTestJSON-2047064614 tempest-ImagesDeleteNegativeTestJSON-2047064614-project] Returning 404 to user: Image not found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:47:56.922194 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9d552e31-7bf0-4bd1-b9a9-d148fda8958d tempest-ImagesDeleteNegativeTestJSON-2047064614 tempest-ImagesDeleteNegativeTestJSON-2047064614-project] 10.222.0.27 "DELETE /compute/v2.1/images/195a2135-ff0d-4a13-ad03-5fbab4a2dddd" status: 404 len: 62 microversion: 2.1 time: 0.064932 Sep 08 10:47:56.927053 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1209/2441] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:56 2022] DELETE /compute/v2.1/images/195a2135-ff0d-4a13-ad03-5fbab4a2dddd => generated 62 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:47:56.931242 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08722db5-5f86-41db-9d64-dce6746f3c40 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:56.931758 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08722db5-5f86-41db-9d64-dce6746f3c40 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:56.933187 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08722db5-5f86-41db-9d64-dce6746f3c40 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:56.936769 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08722db5-5f86-41db-9d64-dce6746f3c40 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:56.939086 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08722db5-5f86-41db-9d64-dce6746f3c40 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:56.939593 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08722db5-5f86-41db-9d64-dce6746f3c40 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:57.008362 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-308f3957-184d-4918-90af-99a80c7f15e8 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:57.009211 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-308f3957-184d-4918-90af-99a80c7f15e8 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: 3766b195-ace4-4563-a24e-dca72941251e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:57.035818 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-308f3957-184d-4918-90af-99a80c7f15e8 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:57.038169 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-308f3957-184d-4918-90af-99a80c7f15e8 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:57.043126 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-308f3957-184d-4918-90af-99a80c7f15e8 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:57.044433 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-308f3957-184d-4918-90af-99a80c7f15e8 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:57.047357 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-308f3957-184d-4918-90af-99a80c7f15e8 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:57.051078 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-308f3957-184d-4918-90af-99a80c7f15e8 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:57.551033 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-08722db5-5f86-41db-9d64-dce6746f3c40 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ff38511b484fbcb7817a56076cf4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a768a3863448bca0c6cda11afdd955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:57.561048 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-08722db5-5f86-41db-9d64-dce6746f3c40 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] 10.222.0.27 "GET /compute/v2.1/servers/b7c9f2aa-8e8c-4200-89ee-a107ea59256a" status: 200 len: 1276 microversion: 2.1 time: 0.692106 Sep 08 10:47:57.564526 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1233/2442] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:56 2022] GET /compute/v2.1/servers/b7c9f2aa-8e8c-4200-89ee-a107ea59256a => generated 1276 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:57.599016 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1a1e4a7b-4aca-4ddf-8dd3-1a205f961c09 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:57.599680 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1a1e4a7b-4aca-4ddf-8dd3-1a205f961c09 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] [instance: 5134b057-ca4f-4ec8-8dd7-435d4e3d1279] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:57.611773 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1a1e4a7b-4aca-4ddf-8dd3-1a205f961c09 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:57.612357 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1a1e4a7b-4aca-4ddf-8dd3-1a205f961c09 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:57.613003 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1a1e4a7b-4aca-4ddf-8dd3-1a205f961c09 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:57.615175 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1a1e4a7b-4aca-4ddf-8dd3-1a205f961c09 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:57.615657 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1a1e4a7b-4aca-4ddf-8dd3-1a205f961c09 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:57.616101 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1a1e4a7b-4aca-4ddf-8dd3-1a205f961c09 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:58.270410 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1a1e4a7b-4aca-4ddf-8dd3-1a205f961c09 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6f265811ad4ccf866fb8094782dd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9a5f2a2b4f460dad3731b0ce6ecebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:58.291861 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1a1e4a7b-4aca-4ddf-8dd3-1a205f961c09 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] 10.222.0.27 "GET /compute/v2.1/servers/5134b057-ca4f-4ec8-8dd7-435d4e3d1279" status: 200 len: 1322 microversion: 2.1 time: 0.704636 Sep 08 10:47:58.295514 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1234/2443] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:57 2022] GET /compute/v2.1/servers/5134b057-ca4f-4ec8-8dd7-435d4e3d1279 => generated 1322 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:58.334042 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8d400c0e-9684-428b-912f-2a99e67dd0d2 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:58.335418 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8d400c0e-9684-428b-912f-2a99e67dd0d2 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] [instance: 4703a7bf-a1ba-4bba-8928-3c403f3f3f21] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:58.353893 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d400c0e-9684-428b-912f-2a99e67dd0d2 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:58.375757 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d400c0e-9684-428b-912f-2a99e67dd0d2 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:58.378410 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d400c0e-9684-428b-912f-2a99e67dd0d2 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:58.381974 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d400c0e-9684-428b-912f-2a99e67dd0d2 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:58.383884 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d400c0e-9684-428b-912f-2a99e67dd0d2 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:58.389936 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d400c0e-9684-428b-912f-2a99e67dd0d2 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:58.697499 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-308f3957-184d-4918-90af-99a80c7f15e8 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:58.705327 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=100 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:47:58.719088 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-308f3957-184d-4918-90af-99a80c7f15e8 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e" status: 200 len: 1478 microversion: 2.1 time: 1.718524 Sep 08 10:47:58.736625 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1210/2444] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:56 2022] GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e => generated 1478 bytes in 1737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:58.747460 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-4b3fb385-73c4-43e6-9d24-5131ebebe739 req-23964e00-2ec8-416f-a472-e1a10e16b6e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4703a7bf-a1ba-4bba-8928-3c403f3f3f21", "tag": "7692ba07-fea3-4d35-b24e-98c3a269cb03"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:47:58.771705 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-4b3fb385-73c4-43e6-9d24-5131ebebe739 req-23964e00-2ec8-416f-a472-e1a10e16b6e3 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:58.772207 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-4b3fb385-73c4-43e6-9d24-5131ebebe739 req-23964e00-2ec8-416f-a472-e1a10e16b6e3 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:58.772659 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-4b3fb385-73c4-43e6-9d24-5131ebebe739 req-23964e00-2ec8-416f-a472-e1a10e16b6e3 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:58.805496 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-4b3fb385-73c4-43e6-9d24-5131ebebe739 req-23964e00-2ec8-416f-a472-e1a10e16b6e3 service nova] Creating event network-changed:7692ba07-fea3-4d35-b24e-98c3a269cb03 for instance 4703a7bf-a1ba-4bba-8928-3c403f3f3f21 on n-h2-850501-12 Sep 08 10:47:58.818401 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-4b3fb385-73c4-43e6-9d24-5131ebebe739 req-23964e00-2ec8-416f-a472-e1a10e16b6e3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079926 Sep 08 10:47:58.825474 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1211/2445] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:47:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:47:58.838175 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-64ae1047-b56d-473d-aa51-bd2c15efc654 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:58.839170 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-64ae1047-b56d-473d-aa51-bd2c15efc654 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] [instance: b7c9f2aa-8e8c-4200-89ee-a107ea59256a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:58.853484 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64ae1047-b56d-473d-aa51-bd2c15efc654 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:58.858059 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64ae1047-b56d-473d-aa51-bd2c15efc654 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:58.862242 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64ae1047-b56d-473d-aa51-bd2c15efc654 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:58.864728 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64ae1047-b56d-473d-aa51-bd2c15efc654 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:58.869817 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64ae1047-b56d-473d-aa51-bd2c15efc654 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:58.874462 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64ae1047-b56d-473d-aa51-bd2c15efc654 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:58.906413 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8d400c0e-9684-428b-912f-2a99e67dd0d2 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528fc9fbb57149c9a9c755c6497f5c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effe8e6c23114b8ab80e76bec365de60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:58.928687 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8d400c0e-9684-428b-912f-2a99e67dd0d2 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] 10.222.0.27 "GET /compute/v2.1/servers/4703a7bf-a1ba-4bba-8928-3c403f3f3f21" status: 200 len: 1482 microversion: 2.1 time: 0.598379 Sep 08 10:47:58.936083 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1235/2446] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:58 2022] GET /compute/v2.1/servers/4703a7bf-a1ba-4bba-8928-3c403f3f3f21 => generated 1482 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:59.117284 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-64ae1047-b56d-473d-aa51-bd2c15efc654 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ff38511b484fbcb7817a56076cf4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a768a3863448bca0c6cda11afdd955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:59.126430 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-64ae1047-b56d-473d-aa51-bd2c15efc654 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] 10.222.0.27 "GET /compute/v2.1/servers/b7c9f2aa-8e8c-4200-89ee-a107ea59256a" status: 200 len: 1276 microversion: 2.1 time: 0.299333 Sep 08 10:47:59.136491 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1212/2447] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:58 2022] GET /compute/v2.1/servers/b7c9f2aa-8e8c-4200-89ee-a107ea59256a => generated 1276 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:59.321757 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fdb58934-7db1-4aa6-8a9e-e83e0e3c5276 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:59.323071 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fdb58934-7db1-4aa6-8a9e-e83e0e3c5276 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] [instance: 5134b057-ca4f-4ec8-8dd7-435d4e3d1279] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:59.339531 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fdb58934-7db1-4aa6-8a9e-e83e0e3c5276 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:59.344504 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fdb58934-7db1-4aa6-8a9e-e83e0e3c5276 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:59.350968 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fdb58934-7db1-4aa6-8a9e-e83e0e3c5276 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:59.352069 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fdb58934-7db1-4aa6-8a9e-e83e0e3c5276 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:59.352752 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fdb58934-7db1-4aa6-8a9e-e83e0e3c5276 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:59.361853 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fdb58934-7db1-4aa6-8a9e-e83e0e3c5276 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:59.743235 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1e5b87a6-926a-412e-ab8d-c32ef8c4611c tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:59.743996 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1e5b87a6-926a-412e-ab8d-c32ef8c4611c tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: 3766b195-ace4-4563-a24e-dca72941251e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:59.753767 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=14 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:47:59.758635 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e5b87a6-926a-412e-ab8d-c32ef8c4611c tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:59.759151 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e5b87a6-926a-412e-ab8d-c32ef8c4611c tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:59.759591 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e5b87a6-926a-412e-ab8d-c32ef8c4611c tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:59.763444 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e5b87a6-926a-412e-ab8d-c32ef8c4611c tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:59.768599 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e5b87a6-926a-412e-ab8d-c32ef8c4611c tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:59.769358 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e5b87a6-926a-412e-ab8d-c32ef8c4611c tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:00.272349 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fdb58934-7db1-4aa6-8a9e-e83e0e3c5276 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6f265811ad4ccf866fb8094782dd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9a5f2a2b4f460dad3731b0ce6ecebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:00.297016 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fdb58934-7db1-4aa6-8a9e-e83e0e3c5276 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] 10.222.0.27 "GET /compute/v2.1/servers/5134b057-ca4f-4ec8-8dd7-435d4e3d1279" status: 200 len: 1322 microversion: 2.1 time: 0.979015 Sep 08 10:48:00.300128 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1236/2448] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:59 2022] GET /compute/v2.1/servers/5134b057-ca4f-4ec8-8dd7-435d4e3d1279 => generated 1322 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:48:00.325000 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f146cf20-7177-4714-a6ab-1eaf04af61a8 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:00.327907 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f146cf20-7177-4714-a6ab-1eaf04af61a8 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] [instance: b7c9f2aa-8e8c-4200-89ee-a107ea59256a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:00.350206 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f146cf20-7177-4714-a6ab-1eaf04af61a8 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:00.359954 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f146cf20-7177-4714-a6ab-1eaf04af61a8 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:00.360334 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f146cf20-7177-4714-a6ab-1eaf04af61a8 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:00.371338 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f146cf20-7177-4714-a6ab-1eaf04af61a8 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:00.378422 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f146cf20-7177-4714-a6ab-1eaf04af61a8 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:00.379097 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f146cf20-7177-4714-a6ab-1eaf04af61a8 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:00.877912 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1e5b87a6-926a-412e-ab8d-c32ef8c4611c tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:00.888202 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1e5b87a6-926a-412e-ab8d-c32ef8c4611c tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e" status: 200 len: 1478 microversion: 2.1 time: 1.148555 Sep 08 10:48:00.894934 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1213/2449] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:59 2022] GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e => generated 1478 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:48:00.989470 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-81217e5e-ec87-49a3-96f1-6d4a6aaad9a1 req-200f9f83-8755-4a7f-af0a-cf838eccd12b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3766b195-ace4-4563-a24e-dca72941251e", "name": "network-vif-unplugged", "status": "completed", "tag": "67c1a6b2-cd91-4a27-a9a4-731db0f530a7"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:48:01.009260 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-81217e5e-ec87-49a3-96f1-6d4a6aaad9a1 req-200f9f83-8755-4a7f-af0a-cf838eccd12b service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:01.010021 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-81217e5e-ec87-49a3-96f1-6d4a6aaad9a1 req-200f9f83-8755-4a7f-af0a-cf838eccd12b service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:01.010652 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-81217e5e-ec87-49a3-96f1-6d4a6aaad9a1 req-200f9f83-8755-4a7f-af0a-cf838eccd12b service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:01.037773 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-81217e5e-ec87-49a3-96f1-6d4a6aaad9a1 req-200f9f83-8755-4a7f-af0a-cf838eccd12b service nova] Creating event network-vif-unplugged:67c1a6b2-cd91-4a27-a9a4-731db0f530a7 for instance 3766b195-ace4-4563-a24e-dca72941251e on n-h2-850501-12 Sep 08 10:48:01.053944 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-81217e5e-ec87-49a3-96f1-6d4a6aaad9a1 req-200f9f83-8755-4a7f-af0a-cf838eccd12b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067229 Sep 08 10:48:01.054984 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1214/2450] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:48:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:48:01.088437 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-6e655377-35d2-4534-94be-d583ccffd47f req-93257701-a31e-45b4-8311-500187a7e4bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5134b057-ca4f-4ec8-8dd7-435d4e3d1279", "tag": "1cb6d044-b419-4afe-ab6f-99a07098ebb9"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:48:01.117674 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-6e655377-35d2-4534-94be-d583ccffd47f req-93257701-a31e-45b4-8311-500187a7e4bb service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:01.118444 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-6e655377-35d2-4534-94be-d583ccffd47f req-93257701-a31e-45b4-8311-500187a7e4bb service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:01.119090 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-6e655377-35d2-4534-94be-d583ccffd47f req-93257701-a31e-45b4-8311-500187a7e4bb service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:01.151470 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-6e655377-35d2-4534-94be-d583ccffd47f req-93257701-a31e-45b4-8311-500187a7e4bb service nova] Creating event network-changed:1cb6d044-b419-4afe-ab6f-99a07098ebb9 for instance 5134b057-ca4f-4ec8-8dd7-435d4e3d1279 on n-h1-850501-12 Sep 08 10:48:01.163052 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-6e655377-35d2-4534-94be-d583ccffd47f req-93257701-a31e-45b4-8311-500187a7e4bb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079032 Sep 08 10:48:01.165722 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1215/2451] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:48:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:48:01.320197 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2ca7cdce-16c5-42f4-aea5-5d2a968aba43 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:01.321189 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2ca7cdce-16c5-42f4-aea5-5d2a968aba43 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] [instance: 5134b057-ca4f-4ec8-8dd7-435d4e3d1279] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:01.338282 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2ca7cdce-16c5-42f4-aea5-5d2a968aba43 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:01.338904 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2ca7cdce-16c5-42f4-aea5-5d2a968aba43 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:01.339342 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2ca7cdce-16c5-42f4-aea5-5d2a968aba43 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:01.350704 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2ca7cdce-16c5-42f4-aea5-5d2a968aba43 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:01.352429 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2ca7cdce-16c5-42f4-aea5-5d2a968aba43 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:01.357488 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2ca7cdce-16c5-42f4-aea5-5d2a968aba43 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:01.650180 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f146cf20-7177-4714-a6ab-1eaf04af61a8 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ff38511b484fbcb7817a56076cf4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a768a3863448bca0c6cda11afdd955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:01.669736 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f146cf20-7177-4714-a6ab-1eaf04af61a8 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] 10.222.0.27 "GET /compute/v2.1/servers/b7c9f2aa-8e8c-4200-89ee-a107ea59256a" status: 200 len: 1318 microversion: 2.1 time: 1.364652 Sep 08 10:48:01.670919 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1237/2452] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:00 2022] GET /compute/v2.1/servers/b7c9f2aa-8e8c-4200-89ee-a107ea59256a => generated 1318 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:01.851039 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f7b0626b-8a5a-4ee9-aa8f-7348d0bb46bd tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:01.851902 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f7b0626b-8a5a-4ee9-aa8f-7348d0bb46bd tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: c1406c0f-748a-4dae-9392-6957d4092c9f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:01.861570 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f7b0626b-8a5a-4ee9-aa8f-7348d0bb46bd tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:01.862337 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f7b0626b-8a5a-4ee9-aa8f-7348d0bb46bd tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:01.862930 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f7b0626b-8a5a-4ee9-aa8f-7348d0bb46bd tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:01.863809 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f7b0626b-8a5a-4ee9-aa8f-7348d0bb46bd tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:01.864566 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f7b0626b-8a5a-4ee9-aa8f-7348d0bb46bd tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:01.865173 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f7b0626b-8a5a-4ee9-aa8f-7348d0bb46bd tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:01.917399 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-f7b0626b-8a5a-4ee9-aa8f-7348d0bb46bd tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] HTTP exception thrown: Instance c1406c0f-748a-4dae-9392-6957d4092c9f could not be found. Sep 08 10:48:01.930175 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f7b0626b-8a5a-4ee9-aa8f-7348d0bb46bd tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Request method failure captured: Sep 08 10:48:01.930175 n-d-850501-12 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/servers/c1406c0f-748a-4dae-9392-6957d4092c9f HTTP/1.1 Sep 08 10:48:01.930175 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:48:01.930175 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:48:01.930175 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:48:01.930175 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:48:01.930175 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:48:01.930175 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:48:01.930175 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:48:01.930175 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:48:01.930175 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcbOYaOup_Ia1bHuprOxxP_LkfdCzYSX9xstQr2GVmRBueUQ0e967rlioz5jpJV566ZCuz_bYy_us0o8_CIFlOGOVfrC9_e_1_vEhZ3YdgjG89HBhaIJ_lG7Uv4nQrC-nfHrMx_LNyd0rOd4Blcm801SOcX7oe5VDxGTE8KVTDSeMPw Sep 08 10:48:01.930175 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:48:01.930175 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:48:01.930175 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:48:01.930175 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:48:01.930175 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:48:01.930175 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:48:01.930175 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 998378cc815344ba8a107d1cd61f40fd Sep 08 10:48:01.930175 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-DeleteServersTestJSON-69164830 Sep 08 10:48:01.930175 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:48:01.930175 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:48:01.930175 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:48:01.930175 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-DeleteServersTestJSON-69164830 Sep 08 10:48:01.930175 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 998378cc815344ba8a107d1cd61f40fd Sep 08 10:48:01.930175 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-DeleteServersTestJSON-69164830 Sep 08 10:48:01.930175 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-DeleteServersTestJSON-69164830-project Sep 08 10:48:01.930175 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:48:01.930175 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:48:01.930175 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: d08269c53bcb41c88953e7c79f5ad185 Sep 08 10:48:01.930175 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-DeleteServersTestJSON-69164830-project Sep 08 10:48:01.930175 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:48:01.930175 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance c1406c0f-748a-4dae-9392-6957d4092c9f could not be found. Sep 08 10:48:01.930175 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'c1406c0f-748a-4dae-9392-6957d4092c9f'} Sep 08 10:48:01.930175 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:48:01.930175 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:48:01.930175 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:48:01.930175 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:48:01.930175 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:48:01.930175 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:48:01.930175 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:48:01.930175 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:48:01.930175 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:48:01.930175 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:48:01.930175 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1406c0f-748a-4dae-9392-6957d4092c9f could not be found. Sep 08 10:48:01.930175 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:48:01.930175 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:48:01.930175 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:48:01.930175 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:48:01.930175 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:48:01.930175 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:48:01.930175 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:48:01.930175 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:48:01.930175 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:48:01.930175 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:48:01.930175 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:48:01.930175 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:48:01.930175 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:48:01.930175 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:48:01.930175 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:48:01.930175 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:48:01.930175 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:48:01.930175 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:48:01.935205 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1406c0f-748a-4dae-9392-6957d4092c9f could not be found. Sep 08 10:48:01.935205 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:48:01.935205 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:48:01.935205 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:48:01.935205 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:48:01.935205 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:48:01.935205 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:48:01.935205 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:48:01.935205 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:48:01.935205 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1406c0f-748a-4dae-9392-6957d4092c9f could not be found. Sep 08 10:48:01.935205 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:48:01.939515 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f7b0626b-8a5a-4ee9-aa8f-7348d0bb46bd tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Returning 404 to user: Instance c1406c0f-748a-4dae-9392-6957d4092c9f could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:48:01.940626 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f7b0626b-8a5a-4ee9-aa8f-7348d0bb46bd tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c1406c0f-748a-4dae-9392-6957d4092c9f" status: 404 len: 111 microversion: 2.1 time: 0.096782 Sep 08 10:48:01.944714 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1238/2453] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:48:01 2022] DELETE /compute/v2.1/servers/c1406c0f-748a-4dae-9392-6957d4092c9f => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:48:01.958465 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2003884c-af66-4b94-8b93-6fc38727229e tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:01.959550 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2003884c-af66-4b94-8b93-6fc38727229e tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: 3766b195-ace4-4563-a24e-dca72941251e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:01.979346 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2003884c-af66-4b94-8b93-6fc38727229e tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:01.984905 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2003884c-af66-4b94-8b93-6fc38727229e tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:01.986246 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2003884c-af66-4b94-8b93-6fc38727229e tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:01.990427 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2003884c-af66-4b94-8b93-6fc38727229e tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:01.991223 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2003884c-af66-4b94-8b93-6fc38727229e tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:01.994350 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2003884c-af66-4b94-8b93-6fc38727229e tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:02.049234 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2ca7cdce-16c5-42f4-aea5-5d2a968aba43 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6f265811ad4ccf866fb8094782dd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9a5f2a2b4f460dad3731b0ce6ecebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:02.063584 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2ca7cdce-16c5-42f4-aea5-5d2a968aba43 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] 10.222.0.27 "GET /compute/v2.1/servers/5134b057-ca4f-4ec8-8dd7-435d4e3d1279" status: 200 len: 1322 microversion: 2.1 time: 0.747258 Sep 08 10:48:02.064493 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1216/2454] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:01 2022] GET /compute/v2.1/servers/5134b057-ca4f-4ec8-8dd7-435d4e3d1279 => generated 1322 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:48:02.074401 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6f754f2c-41eb-458f-b061-d3d3f498d687 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:02.075157 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6f754f2c-41eb-458f-b061-d3d3f498d687 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: c1406c0f-748a-4dae-9392-6957d4092c9f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:02.083662 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6f754f2c-41eb-458f-b061-d3d3f498d687 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:02.086270 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6f754f2c-41eb-458f-b061-d3d3f498d687 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:02.086974 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6f754f2c-41eb-458f-b061-d3d3f498d687 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:02.087724 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6f754f2c-41eb-458f-b061-d3d3f498d687 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:02.088340 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6f754f2c-41eb-458f-b061-d3d3f498d687 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:02.090221 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6f754f2c-41eb-458f-b061-d3d3f498d687 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:02.113880 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-6f754f2c-41eb-458f-b061-d3d3f498d687 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] HTTP exception thrown: Instance c1406c0f-748a-4dae-9392-6957d4092c9f could not be found. Sep 08 10:48:02.117710 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6f754f2c-41eb-458f-b061-d3d3f498d687 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Request method failure captured: Sep 08 10:48:02.117710 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/c1406c0f-748a-4dae-9392-6957d4092c9f HTTP/1.1 Sep 08 10:48:02.117710 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:48:02.117710 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:48:02.117710 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:48:02.117710 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:48:02.117710 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:48:02.117710 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:48:02.117710 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:48:02.117710 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:48:02.117710 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcbOYaOup_Ia1bHuprOxxP_LkfdCzYSX9xstQr2GVmRBueUQ0e967rlioz5jpJV566ZCuz_bYy_us0o8_CIFlOGOVfrC9_e_1_vEhZ3YdgjG89HBhaIJ_lG7Uv4nQrC-nfHrMx_LNyd0rOd4Blcm801SOcX7oe5VDxGTE8KVTDSeMPw Sep 08 10:48:02.117710 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:48:02.117710 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:48:02.117710 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:48:02.117710 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:48:02.117710 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:48:02.117710 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:48:02.117710 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 998378cc815344ba8a107d1cd61f40fd Sep 08 10:48:02.117710 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-DeleteServersTestJSON-69164830 Sep 08 10:48:02.117710 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:48:02.117710 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:48:02.117710 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:48:02.117710 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-DeleteServersTestJSON-69164830 Sep 08 10:48:02.117710 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 998378cc815344ba8a107d1cd61f40fd Sep 08 10:48:02.117710 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-DeleteServersTestJSON-69164830 Sep 08 10:48:02.117710 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-DeleteServersTestJSON-69164830-project Sep 08 10:48:02.117710 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:48:02.117710 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:48:02.117710 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: d08269c53bcb41c88953e7c79f5ad185 Sep 08 10:48:02.117710 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-DeleteServersTestJSON-69164830-project Sep 08 10:48:02.117710 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:48:02.117710 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance c1406c0f-748a-4dae-9392-6957d4092c9f could not be found. Sep 08 10:48:02.117710 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': 'c1406c0f-748a-4dae-9392-6957d4092c9f'} Sep 08 10:48:02.117710 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:48:02.117710 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:48:02.117710 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:48:02.117710 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:48:02.117710 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:48:02.117710 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:48:02.117710 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:48:02.117710 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:48:02.117710 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:48:02.117710 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:48:02.117710 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1406c0f-748a-4dae-9392-6957d4092c9f could not be found. Sep 08 10:48:02.117710 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:48:02.117710 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:48:02.117710 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:48:02.117710 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:48:02.117710 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:48:02.117710 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:48:02.117710 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:48:02.117710 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:48:02.117710 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:48:02.117710 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:48:02.117710 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:48:02.117710 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:48:02.117710 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:48:02.117710 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:48:02.117710 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:48:02.117710 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:48:02.117710 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1406c0f-748a-4dae-9392-6957d4092c9f could not be found. Sep 08 10:48:02.117710 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:48:02.117710 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:48:02.117710 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:48:02.123175 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:48:02.123175 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:48:02.123175 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:48:02.123175 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:48:02.123175 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:48:02.123175 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1406c0f-748a-4dae-9392-6957d4092c9f could not be found. Sep 08 10:48:02.123175 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:48:02.124203 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6f754f2c-41eb-458f-b061-d3d3f498d687 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Returning 404 to user: Instance c1406c0f-748a-4dae-9392-6957d4092c9f could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:48:02.126638 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6f754f2c-41eb-458f-b061-d3d3f498d687 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/c1406c0f-748a-4dae-9392-6957d4092c9f" status: 404 len: 111 microversion: 2.1 time: 0.060985 Sep 08 10:48:02.128122 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1217/2455] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:02 2022] GET /compute/v2.1/servers/c1406c0f-748a-4dae-9392-6957d4092c9f => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:48:02.135837 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3dc02bc7-cec8-4126-a110-9f1bfa994b5b tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Action: 'create', calling method: .version_select at 0x7f68e4b74310>, body: {"keypair": {"name": "tempest-keypair-1934086094", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJvpnTEoSmM35pFz2W6toPaS31sCB0LaMK4m4GbLUd+Mt1Rqf7Nj99G3YZqsDa7aQbAgIcc8C81xTQljcO838B1xmFegiPQhqLKws8M1xbxoXS2HWVg/gM3BKW0YIGYJyg=="}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:48:02.162095 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-3dc02bc7-cec8-4126-a110-9f1bfa994b5b tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Getting quotas for project 20f9a24cad014d7f827e8f3236dd5bae. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:48:02.173869 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-3dc02bc7-cec8-4126-a110-9f1bfa994b5b tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Getting quotas for user 5c291cbe955b4ee5abc98132dda0255e and project 20f9a24cad014d7f827e8f3236dd5bae. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:48:02.232966 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3dc02bc7-cec8-4126-a110-9f1bfa994b5b tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.102504 Sep 08 10:48:02.240556 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1218/2456] 10.222.0.27 () {60 vars in 1159 bytes} [Thu Sep 8 10:48:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:48:02.452178 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-58d3d7b2-c089-4789-b379-27dfa464934a tempest-ListImageFiltersNegativeTestJSON-1038238796 tempest-ListImageFiltersNegativeTestJSON-1038238796-project] Calling method '.version_select at 0x7f68e4a544c0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:02.453540 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2003884c-af66-4b94-8b93-6fc38727229e tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:02.468320 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2003884c-af66-4b94-8b93-6fc38727229e tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e" status: 200 len: 1478 microversion: 2.1 time: 0.521998 Sep 08 10:48:02.475418 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-58d3d7b2-c089-4789-b379-27dfa464934a tempest-ListImageFiltersNegativeTestJSON-1038238796 tempest-ListImageFiltersNegativeTestJSON-1038238796-project] HTTP exception thrown: Image not found. Sep 08 10:48:02.477526 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-58d3d7b2-c089-4789-b379-27dfa464934a tempest-ListImageFiltersNegativeTestJSON-1038238796 tempest-ListImageFiltersNegativeTestJSON-1038238796-project] Request method failure captured: Sep 08 10:48:02.477526 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/images/adec2459-3c69-437c-ac38-b2df2c29a389 HTTP/1.1 Sep 08 10:48:02.477526 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:48:02.477526 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:48:02.477526 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:48:02.477526 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:48:02.477526 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:48:02.477526 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:48:02.477526 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:48:02.477526 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:48:02.477526 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGchhNPwa_EHONMnfvxYfWweN9ym4i_Fddc3zBPiG8AFZgrL-6Yh4nz2BGncscYOFhAfZubTTopAAGU20_budscccTTp5f1-SatdwWhyQOUuW60XOMvssoH39SygcNeeCL92XX7YEhe0Ct6HjXX3RJ-cbYMv6ybBN3D-8liFTzJR0Q20 Sep 08 10:48:02.477526 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:48:02.477526 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:48:02.477526 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:48:02.477526 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:48:02.477526 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:48:02.477526 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:48:02.477526 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 790c72f0a0ea45918c23a214963a9a3c Sep 08 10:48:02.477526 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1038238796 Sep 08 10:48:02.477526 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:48:02.477526 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:48:02.477526 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/790c72f0a0ea45918c23a214963a9a3c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/790c72f0a0ea45918c23a214963a9a3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_790c72f0a0ea45918c23a214963a9a3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/790c72f0a0ea45918c23a214963a9a3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:48:02.477526 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1038238796 Sep 08 10:48:02.477526 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 790c72f0a0ea45918c23a214963a9a3c Sep 08 10:48:02.477526 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1038238796 Sep 08 10:48:02.477526 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ListImageFiltersNegativeTestJSON-1038238796-project Sep 08 10:48:02.477526 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:48:02.477526 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:48:02.477526 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: cc96353aa8af4219b2a272fba375232f Sep 08 10:48:02.477526 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1038238796-project Sep 08 10:48:02.477526 n-d-850501-12 devstack@n-api.service[128861]: method: Sep 08 10:48:02.477526 n-d-850501-12 devstack@n-api.service[128861]: exception: Image not found. Sep 08 10:48:02.477526 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': 'adec2459-3c69-437c-ac38-b2df2c29a389'} Sep 08 10:48:02.477526 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:48:02.477526 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:48:02.477526 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 08 10:48:02.477526 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 08 10:48:02.477526 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 10:48:02.477526 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 10:48:02.477526 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 08 10:48:02.477526 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 08 10:48:02.477526 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 10:48:02.477526 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 10:48:02.477526 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 08 10:48:02.477526 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 08 10:48:02.477526 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 08 10:48:02.477526 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 08 10:48:02.477526 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 10:48:02.477526 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 10:48:02.477526 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 10:48:02.477526 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 10:48:02.477526 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID adec2459-3c69-437c-ac38-b2df2c29a389 Sep 08 10:48:02.477526 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:48:02.477526 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:48:02.477526 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:48:02.477526 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:48:02.477526 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 08 10:48:02.477526 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 08 10:48:02.477526 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 08 10:48:02.477526 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 08 10:48:02.477526 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 08 10:48:02.477526 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 08 10:48:02.477526 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 08 10:48:02.483034 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 08 10:48:02.483034 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 08 10:48:02.483034 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 08 10:48:02.483034 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 10:48:02.483034 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 10:48:02.483034 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 08 10:48:02.483034 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 08 10:48:02.483034 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 10:48:02.483034 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 10:48:02.483034 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 08 10:48:02.483034 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 08 10:48:02.483034 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 08 10:48:02.483034 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 08 10:48:02.483034 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 10:48:02.483034 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 10:48:02.483034 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 10:48:02.483034 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 10:48:02.483034 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image adec2459-3c69-437c-ac38-b2df2c29a389 could not be found. Sep 08 10:48:02.483034 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:48:02.483034 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:48:02.483034 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:48:02.483034 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:48:02.483034 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:48:02.483034 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:48:02.483034 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:48:02.483034 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:48:02.483034 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:48:02.483034 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:48:02.483034 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:48:02.483034 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:48:02.483034 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 08 10:48:02.483034 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 08 10:48:02.483034 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 08 10:48:02.483034 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:48:02.483034 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:48:02.483034 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:48:02.483034 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:48:02.483034 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:48:02.483034 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:48:02.483034 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:48:02.483034 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:48:02.483034 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 08 10:48:02.483034 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:48:02.491783 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1239/2457] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:01 2022] GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e => generated 1478 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:02.493185 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-58d3d7b2-c089-4789-b379-27dfa464934a tempest-ListImageFiltersNegativeTestJSON-1038238796 tempest-ListImageFiltersNegativeTestJSON-1038238796-project] Returning 404 to user: Image not found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:48:02.493491 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cbc2824d-9d86-40c2-92c1-862741074f3e tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:02.493655 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-58d3d7b2-c089-4789-b379-27dfa464934a tempest-ListImageFiltersNegativeTestJSON-1038238796 tempest-ListImageFiltersNegativeTestJSON-1038238796-project] 10.222.0.27 "GET /compute/v2.1/images/adec2459-3c69-437c-ac38-b2df2c29a389" status: 404 len: 62 microversion: 2.1 time: 0.248708 Sep 08 10:48:02.493816 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cbc2824d-9d86-40c2-92c1-862741074f3e tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 2f4552b5-2e31-458b-b0f3-5bd551cc9ced] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:02.493966 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1219/2458] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:48:02 2022] GET /compute/v2.1/images/adec2459-3c69-437c-ac38-b2df2c29a389 => generated 62 bytes in 250 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:48:02.499766 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cbc2824d-9d86-40c2-92c1-862741074f3e tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:02.500761 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cbc2824d-9d86-40c2-92c1-862741074f3e tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:02.501451 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cbc2824d-9d86-40c2-92c1-862741074f3e tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:02.502403 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cbc2824d-9d86-40c2-92c1-862741074f3e tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:02.503080 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cbc2824d-9d86-40c2-92c1-862741074f3e tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:02.503723 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cbc2824d-9d86-40c2-92c1-862741074f3e tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:02.522907 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-cbc2824d-9d86-40c2-92c1-862741074f3e tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] HTTP exception thrown: Instance 2f4552b5-2e31-458b-b0f3-5bd551cc9ced could not be found. Sep 08 10:48:02.527902 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cbc2824d-9d86-40c2-92c1-862741074f3e tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Request method failure captured: Sep 08 10:48:02.527902 n-d-850501-12 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/servers/2f4552b5-2e31-458b-b0f3-5bd551cc9ced HTTP/1.1 Sep 08 10:48:02.527902 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:48:02.527902 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:48:02.527902 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:48:02.527902 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:48:02.527902 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:48:02.527902 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:48:02.527902 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:48:02.527902 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:48:02.527902 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcbOYaOup_Ia1bHuprOxxP_LkfdCzYSX9xstQr2GVmRBueUQ0e967rlioz5jpJV566ZCuz_bYy_us0o8_CIFlOGOVfrC9_e_1_vEhZ3YdgjG89HBhaIJ_lG7Uv4nQrC-nfHrMx_LNyd0rOd4Blcm801SOcX7oe5VDxGTE8KVTDSeMPw Sep 08 10:48:02.527902 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:48:02.527902 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:48:02.527902 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:48:02.527902 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:48:02.527902 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:48:02.527902 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:48:02.527902 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 998378cc815344ba8a107d1cd61f40fd Sep 08 10:48:02.527902 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-DeleteServersTestJSON-69164830 Sep 08 10:48:02.527902 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:48:02.527902 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:48:02.527902 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:48:02.527902 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-DeleteServersTestJSON-69164830 Sep 08 10:48:02.527902 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 998378cc815344ba8a107d1cd61f40fd Sep 08 10:48:02.527902 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-DeleteServersTestJSON-69164830 Sep 08 10:48:02.527902 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-DeleteServersTestJSON-69164830-project Sep 08 10:48:02.527902 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:48:02.527902 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:48:02.527902 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: d08269c53bcb41c88953e7c79f5ad185 Sep 08 10:48:02.527902 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-DeleteServersTestJSON-69164830-project Sep 08 10:48:02.527902 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:48:02.527902 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 2f4552b5-2e31-458b-b0f3-5bd551cc9ced could not be found. Sep 08 10:48:02.527902 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '2f4552b5-2e31-458b-b0f3-5bd551cc9ced'} Sep 08 10:48:02.527902 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:48:02.527902 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:48:02.527902 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:48:02.527902 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:48:02.527902 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:48:02.527902 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:48:02.527902 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:48:02.527902 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:48:02.527902 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:48:02.527902 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:48:02.527902 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f4552b5-2e31-458b-b0f3-5bd551cc9ced could not be found. Sep 08 10:48:02.527902 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:48:02.527902 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:48:02.527902 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:48:02.527902 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:48:02.527902 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:48:02.527902 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:48:02.527902 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:48:02.527902 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:48:02.527902 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:48:02.527902 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:48:02.527902 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:48:02.527902 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:48:02.527902 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:48:02.527902 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:48:02.527902 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:48:02.527902 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:48:02.527902 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:48:02.527902 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:48:02.531780 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f4552b5-2e31-458b-b0f3-5bd551cc9ced could not be found. Sep 08 10:48:02.531780 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:48:02.531780 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:48:02.531780 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:48:02.531780 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:48:02.531780 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:48:02.531780 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:48:02.531780 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:48:02.531780 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:48:02.531780 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f4552b5-2e31-458b-b0f3-5bd551cc9ced could not be found. Sep 08 10:48:02.531780 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:48:02.534733 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cbc2824d-9d86-40c2-92c1-862741074f3e tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Returning 404 to user: Instance 2f4552b5-2e31-458b-b0f3-5bd551cc9ced could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:48:02.535855 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cbc2824d-9d86-40c2-92c1-862741074f3e tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2f4552b5-2e31-458b-b0f3-5bd551cc9ced" status: 404 len: 111 microversion: 2.1 time: 0.052937 Sep 08 10:48:02.547405 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7dc43b0e-41a0-4d98-bad6-4366c6f40cf5 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:02.548493 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7dc43b0e-41a0-4d98-bad6-4366c6f40cf5 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] [instance: 2f4552b5-2e31-458b-b0f3-5bd551cc9ced] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:02.551503 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1240/2459] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:48:02 2022] DELETE /compute/v2.1/servers/2f4552b5-2e31-458b-b0f3-5bd551cc9ced => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:48:02.556179 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7dc43b0e-41a0-4d98-bad6-4366c6f40cf5 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:02.557002 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7dc43b0e-41a0-4d98-bad6-4366c6f40cf5 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:02.557682 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7dc43b0e-41a0-4d98-bad6-4366c6f40cf5 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:02.559036 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7dc43b0e-41a0-4d98-bad6-4366c6f40cf5 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:02.562876 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7dc43b0e-41a0-4d98-bad6-4366c6f40cf5 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:02.563685 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7dc43b0e-41a0-4d98-bad6-4366c6f40cf5 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:02.601127 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-7dc43b0e-41a0-4d98-bad6-4366c6f40cf5 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] HTTP exception thrown: Instance 2f4552b5-2e31-458b-b0f3-5bd551cc9ced could not be found. Sep 08 10:48:02.604192 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7dc43b0e-41a0-4d98-bad6-4366c6f40cf5 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Request method failure captured: Sep 08 10:48:02.604192 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/2f4552b5-2e31-458b-b0f3-5bd551cc9ced HTTP/1.1 Sep 08 10:48:02.604192 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:48:02.604192 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:48:02.604192 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:48:02.604192 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:48:02.604192 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:48:02.604192 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:48:02.604192 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:48:02.604192 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:48:02.604192 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcbOYaOup_Ia1bHuprOxxP_LkfdCzYSX9xstQr2GVmRBueUQ0e967rlioz5jpJV566ZCuz_bYy_us0o8_CIFlOGOVfrC9_e_1_vEhZ3YdgjG89HBhaIJ_lG7Uv4nQrC-nfHrMx_LNyd0rOd4Blcm801SOcX7oe5VDxGTE8KVTDSeMPw Sep 08 10:48:02.604192 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:48:02.604192 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:48:02.604192 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:48:02.604192 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:48:02.604192 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:48:02.604192 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:48:02.604192 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 998378cc815344ba8a107d1cd61f40fd Sep 08 10:48:02.604192 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-DeleteServersTestJSON-69164830 Sep 08 10:48:02.604192 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:48:02.604192 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:48:02.604192 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/998378cc815344ba8a107d1cd61f40fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:48:02.604192 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-DeleteServersTestJSON-69164830 Sep 08 10:48:02.604192 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 998378cc815344ba8a107d1cd61f40fd Sep 08 10:48:02.604192 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-DeleteServersTestJSON-69164830 Sep 08 10:48:02.604192 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-DeleteServersTestJSON-69164830-project Sep 08 10:48:02.604192 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:48:02.604192 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:48:02.604192 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: d08269c53bcb41c88953e7c79f5ad185 Sep 08 10:48:02.604192 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-DeleteServersTestJSON-69164830-project Sep 08 10:48:02.604192 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:48:02.604192 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 2f4552b5-2e31-458b-b0f3-5bd551cc9ced could not be found. Sep 08 10:48:02.604192 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '2f4552b5-2e31-458b-b0f3-5bd551cc9ced'} Sep 08 10:48:02.604192 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:48:02.604192 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:48:02.604192 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:48:02.604192 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:48:02.604192 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:48:02.604192 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:48:02.604192 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:48:02.604192 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:48:02.604192 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:48:02.604192 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:48:02.604192 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f4552b5-2e31-458b-b0f3-5bd551cc9ced could not be found. Sep 08 10:48:02.604192 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:48:02.604192 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:48:02.604192 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:48:02.604192 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:48:02.604192 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:48:02.604192 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:48:02.604192 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:48:02.604192 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:48:02.604192 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:48:02.604192 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:48:02.604192 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:48:02.604192 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:48:02.604192 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:48:02.604192 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:48:02.604192 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:48:02.604192 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:48:02.604192 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f4552b5-2e31-458b-b0f3-5bd551cc9ced could not be found. Sep 08 10:48:02.604192 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:48:02.604192 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:48:02.604192 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:48:02.608863 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:48:02.608863 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:48:02.608863 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:48:02.608863 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:48:02.608863 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:48:02.608863 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f4552b5-2e31-458b-b0f3-5bd551cc9ced could not be found. Sep 08 10:48:02.608863 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:48:02.613513 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7dc43b0e-41a0-4d98-bad6-4366c6f40cf5 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] Returning 404 to user: Instance 2f4552b5-2e31-458b-b0f3-5bd551cc9ced could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:48:02.619104 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7dc43b0e-41a0-4d98-bad6-4366c6f40cf5 tempest-DeleteServersTestJSON-69164830 tempest-DeleteServersTestJSON-69164830-project] 10.222.0.27 "GET /compute/v2.1/servers/2f4552b5-2e31-458b-b0f3-5bd551cc9ced" status: 404 len: 111 microversion: 2.1 time: 0.077475 Sep 08 10:48:02.631697 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1220/2460] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:02 2022] GET /compute/v2.1/servers/2f4552b5-2e31-458b-b0f3-5bd551cc9ced => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:48:02.695258 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1928ebfd-4f6d-47e8-b331-baa8ef6d5378 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:02.696111 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1928ebfd-4f6d-47e8-b331-baa8ef6d5378 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] [instance: b7c9f2aa-8e8c-4200-89ee-a107ea59256a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:02.721140 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1928ebfd-4f6d-47e8-b331-baa8ef6d5378 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:02.722059 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1928ebfd-4f6d-47e8-b331-baa8ef6d5378 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:02.722686 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1928ebfd-4f6d-47e8-b331-baa8ef6d5378 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:02.725223 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1928ebfd-4f6d-47e8-b331-baa8ef6d5378 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:02.725899 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1928ebfd-4f6d-47e8-b331-baa8ef6d5378 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:02.727093 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1928ebfd-4f6d-47e8-b331-baa8ef6d5378 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:03.094245 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-65677638-100a-432f-a95f-4d11b4e832fe tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:03.095224 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-65677638-100a-432f-a95f-4d11b4e832fe tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] [instance: 5134b057-ca4f-4ec8-8dd7-435d4e3d1279] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:03.110874 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-65677638-100a-432f-a95f-4d11b4e832fe tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:03.111586 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-65677638-100a-432f-a95f-4d11b4e832fe tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:03.112293 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-65677638-100a-432f-a95f-4d11b4e832fe tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:03.114434 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-65677638-100a-432f-a95f-4d11b4e832fe tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:03.115691 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-65677638-100a-432f-a95f-4d11b4e832fe tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:03.116296 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-65677638-100a-432f-a95f-4d11b4e832fe tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:03.648109 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-65677638-100a-432f-a95f-4d11b4e832fe tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6f265811ad4ccf866fb8094782dd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9a5f2a2b4f460dad3731b0ce6ecebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:03.659822 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-65677638-100a-432f-a95f-4d11b4e832fe tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] 10.222.0.27 "GET /compute/v2.1/servers/5134b057-ca4f-4ec8-8dd7-435d4e3d1279" status: 200 len: 1322 microversion: 2.1 time: 0.572333 Sep 08 10:48:03.671889 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1221/2461] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:03 2022] GET /compute/v2.1/servers/5134b057-ca4f-4ec8-8dd7-435d4e3d1279 => generated 1322 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:48:03.677584 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-60e661bd-e386-46b2-b167-0845b0fb62ce req-3e7546c0-ef16-4c1b-8d5d-71d8243c8bf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3766b195-ace4-4563-a24e-dca72941251e", "name": "network-vif-plugged", "status": "completed", "tag": "67c1a6b2-cd91-4a27-a9a4-731db0f530a7"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:48:03.699707 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-60e661bd-e386-46b2-b167-0845b0fb62ce req-3e7546c0-ef16-4c1b-8d5d-71d8243c8bf5 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:03.701240 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-60e661bd-e386-46b2-b167-0845b0fb62ce req-3e7546c0-ef16-4c1b-8d5d-71d8243c8bf5 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:03.701916 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-60e661bd-e386-46b2-b167-0845b0fb62ce req-3e7546c0-ef16-4c1b-8d5d-71d8243c8bf5 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:03.718386 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-60e661bd-e386-46b2-b167-0845b0fb62ce req-3e7546c0-ef16-4c1b-8d5d-71d8243c8bf5 service nova] Creating event network-vif-plugged:67c1a6b2-cd91-4a27-a9a4-731db0f530a7 for instance 3766b195-ace4-4563-a24e-dca72941251e on n-h2-850501-12 Sep 08 10:48:03.725605 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-60e661bd-e386-46b2-b167-0845b0fb62ce req-3e7546c0-ef16-4c1b-8d5d-71d8243c8bf5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061758 Sep 08 10:48:03.726833 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1222/2462] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:48:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:48:03.741292 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1928ebfd-4f6d-47e8-b331-baa8ef6d5378 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ff38511b484fbcb7817a56076cf4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a768a3863448bca0c6cda11afdd955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:03.745445 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4a4f2f3d-8b88-4f4f-ad50-67e4889190bf tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:03.755147 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4a4f2f3d-8b88-4f4f-ad50-67e4889190bf tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: 3766b195-ace4-4563-a24e-dca72941251e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:03.763376 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1928ebfd-4f6d-47e8-b331-baa8ef6d5378 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] 10.222.0.27 "GET /compute/v2.1/servers/b7c9f2aa-8e8c-4200-89ee-a107ea59256a" status: 200 len: 1318 microversion: 2.1 time: 1.072546 Sep 08 10:48:03.765078 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1241/2463] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:02 2022] GET /compute/v2.1/servers/b7c9f2aa-8e8c-4200-89ee-a107ea59256a => generated 1318 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:03.772557 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a4f2f3d-8b88-4f4f-ad50-67e4889190bf tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:03.773274 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a4f2f3d-8b88-4f4f-ad50-67e4889190bf tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:03.774447 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a4f2f3d-8b88-4f4f-ad50-67e4889190bf tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:03.775333 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a4f2f3d-8b88-4f4f-ad50-67e4889190bf tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:03.775955 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a4f2f3d-8b88-4f4f-ad50-67e4889190bf tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:03.776389 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a4f2f3d-8b88-4f4f-ad50-67e4889190bf tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:04.105971 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-1d327302-730a-4e00-882f-632432adf014 req-cd3e11de-c275-4dd7-a633-542117c79f2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7c9f2aa-8e8c-4200-89ee-a107ea59256a", "tag": "c9d7159a-535c-438e-a67b-db24af373413"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:48:04.117840 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=8 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:48:04.126532 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-1d327302-730a-4e00-882f-632432adf014 req-cd3e11de-c275-4dd7-a633-542117c79f2b service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:04.127919 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-1d327302-730a-4e00-882f-632432adf014 req-cd3e11de-c275-4dd7-a633-542117c79f2b service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:04.128534 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-1d327302-730a-4e00-882f-632432adf014 req-cd3e11de-c275-4dd7-a633-542117c79f2b service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:04.147397 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-1d327302-730a-4e00-882f-632432adf014 req-cd3e11de-c275-4dd7-a633-542117c79f2b service nova] Creating event network-changed:c9d7159a-535c-438e-a67b-db24af373413 for instance b7c9f2aa-8e8c-4200-89ee-a107ea59256a on n-h1-850501-12 Sep 08 10:48:04.164834 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-1d327302-730a-4e00-882f-632432adf014 req-cd3e11de-c275-4dd7-a633-542117c79f2b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064967 Sep 08 10:48:04.167254 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1242/2464] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:48:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:48:04.448127 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a9c4335a-2560-46b1-bc78-731796eb6582 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-527009240", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "0e0f8f7d-d286-4d35-937a-c23deb3ccfdb"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:48:04.522270 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-a9c4335a-2560-46b1-bc78-731796eb6582 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] validate_networks() for [('0e0f8f7d-d286-4d35-937a-c23deb3ccfdb', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:48:04.530679 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=16 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:48:04.735822 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4a4f2f3d-8b88-4f4f-ad50-67e4889190bf tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:04.757039 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4a4f2f3d-8b88-4f4f-ad50-67e4889190bf tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e" status: 200 len: 1478 microversion: 2.1 time: 1.027611 Sep 08 10:48:04.758741 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1223/2465] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:03 2022] GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e => generated 1478 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:04.768502 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f1919d68-b800-4b5e-ba53-6fc097783646 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:04.769394 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f1919d68-b800-4b5e-ba53-6fc097783646 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] [instance: 5134b057-ca4f-4ec8-8dd7-435d4e3d1279] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:04.781260 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f1919d68-b800-4b5e-ba53-6fc097783646 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:04.781996 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f1919d68-b800-4b5e-ba53-6fc097783646 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:04.782980 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f1919d68-b800-4b5e-ba53-6fc097783646 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:04.785460 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f1919d68-b800-4b5e-ba53-6fc097783646 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:04.786115 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f1919d68-b800-4b5e-ba53-6fc097783646 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:04.786708 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f1919d68-b800-4b5e-ba53-6fc097783646 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:05.294101 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f1919d68-b800-4b5e-ba53-6fc097783646 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6f265811ad4ccf866fb8094782dd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9a5f2a2b4f460dad3731b0ce6ecebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:05.306367 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f1919d68-b800-4b5e-ba53-6fc097783646 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] 10.222.0.27 "GET /compute/v2.1/servers/5134b057-ca4f-4ec8-8dd7-435d4e3d1279" status: 200 len: 1322 microversion: 2.1 time: 0.545967 Sep 08 10:48:05.309559 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1224/2466] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:04 2022] GET /compute/v2.1/servers/5134b057-ca4f-4ec8-8dd7-435d4e3d1279 => generated 1322 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:05.328778 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f68dd343-f2eb-4123-98b9-7e1681a2a9d9 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:05.329960 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f68dd343-f2eb-4123-98b9-7e1681a2a9d9 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] [instance: b7c9f2aa-8e8c-4200-89ee-a107ea59256a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:05.333731 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:48:05.346259 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f68dd343-f2eb-4123-98b9-7e1681a2a9d9 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:05.346876 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f68dd343-f2eb-4123-98b9-7e1681a2a9d9 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:05.347326 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f68dd343-f2eb-4123-98b9-7e1681a2a9d9 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:05.351014 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f68dd343-f2eb-4123-98b9-7e1681a2a9d9 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:05.351624 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f68dd343-f2eb-4123-98b9-7e1681a2a9d9 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:05.352116 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f68dd343-f2eb-4123-98b9-7e1681a2a9d9 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:05.498196 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-a9c4335a-2560-46b1-bc78-731796eb6582 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:48:05.500849 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-a9c4335a-2560-46b1-bc78-731796eb6582 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:48:05.501372 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-a9c4335a-2560-46b1-bc78-731796eb6582 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:48:05.506369 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-a9c4335a-2560-46b1-bc78-731796eb6582 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:48:05.506865 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-a9c4335a-2560-46b1-bc78-731796eb6582 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:48:05.531273 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a9c4335a-2560-46b1-bc78-731796eb6582 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:05.531766 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a9c4335a-2560-46b1-bc78-731796eb6582 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:05.532204 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a9c4335a-2560-46b1-bc78-731796eb6582 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:05.533510 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a9c4335a-2560-46b1-bc78-731796eb6582 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:05.538625 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a9c4335a-2560-46b1-bc78-731796eb6582 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:05.540321 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a9c4335a-2560-46b1-bc78-731796eb6582 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:05.591315 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-a9c4335a-2560-46b1-bc78-731796eb6582 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Getting quotas for project 07e481d7d8204631b72aaef2d6279c49. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:48:05.598061 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-a9c4335a-2560-46b1-bc78-731796eb6582 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Getting quotas for user 0fd975c3a56545fa938752d2b72be872 and project 07e481d7d8204631b72aaef2d6279c49. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:48:05.613834 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a9c4335a-2560-46b1-bc78-731796eb6582 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:48:05.617371 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a9c4335a-2560-46b1-bc78-731796eb6582 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] [instance: 83d65df7-eb49-46ce-815a-54fbb3725661] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:48:05.706062 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a9c4335a-2560-46b1-bc78-731796eb6582 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.447287 Sep 08 10:48:05.716943 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1243/2467] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:48:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1459 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:48:05.723891 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8b3c3c06-dd87-4f9e-9644-9d4eb492d718 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:05.724526 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8b3c3c06-dd87-4f9e-9644-9d4eb492d718 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] [instance: 83d65df7-eb49-46ce-815a-54fbb3725661] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:05.786824 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f68dd343-f2eb-4123-98b9-7e1681a2a9d9 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ff38511b484fbcb7817a56076cf4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a768a3863448bca0c6cda11afdd955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:05.801652 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f68dd343-f2eb-4123-98b9-7e1681a2a9d9 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] 10.222.0.27 "GET /compute/v2.1/servers/b7c9f2aa-8e8c-4200-89ee-a107ea59256a" status: 200 len: 1318 microversion: 2.1 time: 0.487241 Sep 08 10:48:05.802267 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1225/2468] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:05 2022] GET /compute/v2.1/servers/b7c9f2aa-8e8c-4200-89ee-a107ea59256a => generated 1318 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:05.847091 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f2baf697-1585-47c6-928e-f0db7810b314 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:05.849778 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f2baf697-1585-47c6-928e-f0db7810b314 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: 3766b195-ace4-4563-a24e-dca72941251e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:05.877268 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f2baf697-1585-47c6-928e-f0db7810b314 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:05.877851 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f2baf697-1585-47c6-928e-f0db7810b314 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:05.878301 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f2baf697-1585-47c6-928e-f0db7810b314 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:05.882655 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f2baf697-1585-47c6-928e-f0db7810b314 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:05.883154 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f2baf697-1585-47c6-928e-f0db7810b314 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:05.883600 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f2baf697-1585-47c6-928e-f0db7810b314 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:05.892808 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8b3c3c06-dd87-4f9e-9644-9d4eb492d718 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd975c3a56545fa938752d2b72be872', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e481d7d8204631b72aaef2d6279c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:05.906803 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8b3c3c06-dd87-4f9e-9644-9d4eb492d718 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] 10.222.0.27 "GET /compute/v2.1/servers/83d65df7-eb49-46ce-815a-54fbb3725661" status: 200 len: 1215 microversion: 2.1 time: 0.188217 Sep 08 10:48:05.907095 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1244/2469] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:05 2022] GET /compute/v2.1/servers/83d65df7-eb49-46ce-815a-54fbb3725661 => generated 1215 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:06.342270 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5324663c-14d9-4aa9-a1f3-52c3ddd643af tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:06.346917 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5324663c-14d9-4aa9-a1f3-52c3ddd643af tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] [instance: 5134b057-ca4f-4ec8-8dd7-435d4e3d1279] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:06.395802 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5324663c-14d9-4aa9-a1f3-52c3ddd643af tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:06.396707 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5324663c-14d9-4aa9-a1f3-52c3ddd643af tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:06.402425 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5324663c-14d9-4aa9-a1f3-52c3ddd643af tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:06.403810 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5324663c-14d9-4aa9-a1f3-52c3ddd643af tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:06.408647 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5324663c-14d9-4aa9-a1f3-52c3ddd643af tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:06.410105 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5324663c-14d9-4aa9-a1f3-52c3ddd643af tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:06.412277 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f2baf697-1585-47c6-928e-f0db7810b314 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:06.429318 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f2baf697-1585-47c6-928e-f0db7810b314 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e" status: 200 len: 1478 microversion: 2.1 time: 0.596810 Sep 08 10:48:06.430509 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1226/2470] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:05 2022] GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e => generated 1478 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:06.792229 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-72e2d61c-857c-4e19-8004-7fc0fd4e4a6e tempest-ListImagesTestJSON-451827677 tempest-ListImagesTestJSON-451827677-project] Calling method '.version_select at 0x7f68e4d23430>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:06.863454 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-72e2d61c-857c-4e19-8004-7fc0fd4e4a6e tempest-ListImagesTestJSON-451827677 tempest-ListImagesTestJSON-451827677-project] 10.222.0.27 "GET /compute/v2.1/images/503f4a0f-e18f-47fd-ad12-0289e3463117" status: 200 len: 784 microversion: 2.1 time: 0.392617 Sep 08 10:48:06.864720 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1227/2471] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:48:06 2022] GET /compute/v2.1/images/503f4a0f-e18f-47fd-ad12-0289e3463117 => generated 784 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:48:06.880361 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-dae12aa3-cc45-4e7d-a55a-68b024728605 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:06.881560 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-dae12aa3-cc45-4e7d-a55a-68b024728605 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] [instance: b7c9f2aa-8e8c-4200-89ee-a107ea59256a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:06.895598 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dae12aa3-cc45-4e7d-a55a-68b024728605 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:06.896938 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dae12aa3-cc45-4e7d-a55a-68b024728605 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:06.898364 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dae12aa3-cc45-4e7d-a55a-68b024728605 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:06.900042 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dae12aa3-cc45-4e7d-a55a-68b024728605 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:06.900773 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dae12aa3-cc45-4e7d-a55a-68b024728605 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:06.901706 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dae12aa3-cc45-4e7d-a55a-68b024728605 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:06.984137 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5324663c-14d9-4aa9-a1f3-52c3ddd643af tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6f265811ad4ccf866fb8094782dd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9a5f2a2b4f460dad3731b0ce6ecebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:07.018257 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5324663c-14d9-4aa9-a1f3-52c3ddd643af tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] 10.222.0.27 "GET /compute/v2.1/servers/5134b057-ca4f-4ec8-8dd7-435d4e3d1279" status: 200 len: 1322 microversion: 2.1 time: 0.685771 Sep 08 10:48:07.037056 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1245/2472] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:06 2022] GET /compute/v2.1/servers/5134b057-ca4f-4ec8-8dd7-435d4e3d1279 => generated 1322 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:07.044319 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9b0dea66-94b9-49a0-a5a8-b147f6c89299 tempest-ListImagesTestJSON-451827677 tempest-ListImagesTestJSON-451827677-project] Calling method '.version_select at 0x7f68e509b1f0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:07.150696 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9b0dea66-94b9-49a0-a5a8-b147f6c89299 tempest-ListImagesTestJSON-451827677 tempest-ListImagesTestJSON-451827677-project] 10.222.0.27 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.117723 Sep 08 10:48:07.153262 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1246/2473] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Sep 8 10:48:07 2022] GET /compute/v2.1/images => generated 445 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:48:07.216215 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f05833c2-ef80-4878-a9e8-68b11c87c86c tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:07.222152 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f05833c2-ef80-4878-a9e8-68b11c87c86c tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] [instance: 83d65df7-eb49-46ce-815a-54fbb3725661] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:07.239219 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f05833c2-ef80-4878-a9e8-68b11c87c86c tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:07.239732 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f05833c2-ef80-4878-a9e8-68b11c87c86c tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:07.240206 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f05833c2-ef80-4878-a9e8-68b11c87c86c tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:07.240938 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f05833c2-ef80-4878-a9e8-68b11c87c86c tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:07.241465 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f05833c2-ef80-4878-a9e8-68b11c87c86c tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:07.241893 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f05833c2-ef80-4878-a9e8-68b11c87c86c tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:07.365901 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f05833c2-ef80-4878-a9e8-68b11c87c86c tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd975c3a56545fa938752d2b72be872', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e481d7d8204631b72aaef2d6279c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:07.375286 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f05833c2-ef80-4878-a9e8-68b11c87c86c tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] 10.222.0.27 "GET /compute/v2.1/servers/83d65df7-eb49-46ce-815a-54fbb3725661" status: 200 len: 1211 microversion: 2.1 time: 0.220840 Sep 08 10:48:07.376456 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1247/2474] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:07 2022] GET /compute/v2.1/servers/83d65df7-eb49-46ce-815a-54fbb3725661 => generated 1211 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:07.382192 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-081f0ddf-526b-4e9c-b2ab-4b44ecbeee27 tempest-ListImagesTestJSON-451827677 tempest-ListImagesTestJSON-451827677-project] Calling method '.version_select at 0x7f68e8b5f4c0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:07.438324 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-dae12aa3-cc45-4e7d-a55a-68b024728605 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ff38511b484fbcb7817a56076cf4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a768a3863448bca0c6cda11afdd955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:07.453886 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-dae12aa3-cc45-4e7d-a55a-68b024728605 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] 10.222.0.27 "GET /compute/v2.1/servers/b7c9f2aa-8e8c-4200-89ee-a107ea59256a" status: 200 len: 1318 microversion: 2.1 time: 0.587383 Sep 08 10:48:07.454968 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1228/2475] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:06 2022] GET /compute/v2.1/servers/b7c9f2aa-8e8c-4200-89ee-a107ea59256a => generated 1318 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:07.462006 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-305e77df-e46e-4af1-9aba-911638e4e68a tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-350490790", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "93bd2ec4-37bd-4a29-88fa-5a2d674d25ec"}], "security_groups": [{"name": "tempest-securitygroup--907091418"}], "key_name": "tempest-keypair-1934086094", "user_data": "}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:48:07.478625 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-081f0ddf-526b-4e9c-b2ab-4b44ecbeee27 tempest-ListImagesTestJSON-451827677 tempest-ListImagesTestJSON-451827677-project] 10.222.0.27 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.100721 Sep 08 10:48:07.479148 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1248/2476] 10.222.0.27 () {58 vars in 1143 bytes} [Thu Sep 8 10:48:07 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:48:07.506823 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-016ff8cc-7252-486d-9d70-543a1cb4bef7 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:07.510873 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-016ff8cc-7252-486d-9d70-543a1cb4bef7 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: 3766b195-ace4-4563-a24e-dca72941251e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:07.535073 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-016ff8cc-7252-486d-9d70-543a1cb4bef7 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:07.537352 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-016ff8cc-7252-486d-9d70-543a1cb4bef7 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:07.538464 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-016ff8cc-7252-486d-9d70-543a1cb4bef7 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:07.544779 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-016ff8cc-7252-486d-9d70-543a1cb4bef7 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:07.546999 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-016ff8cc-7252-486d-9d70-543a1cb4bef7 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:07.548354 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-016ff8cc-7252-486d-9d70-543a1cb4bef7 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:07.753158 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-305e77df-e46e-4af1-9aba-911638e4e68a tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] validate_networks() for [('93bd2ec4-37bd-4a29-88fa-5a2d674d25ec', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:48:07.803713 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-016ff8cc-7252-486d-9d70-543a1cb4bef7 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:07.840027 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-016ff8cc-7252-486d-9d70-543a1cb4bef7 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e" status: 200 len: 1463 microversion: 2.1 time: 0.357258 Sep 08 10:48:07.842735 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1249/2477] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:07 2022] GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e => generated 1463 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:07.905017 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6b968beb-c959-4ea9-a25f-d65e2ed5ea09 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:48:07.909600 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6b968beb-c959-4ea9-a25f-d65e2ed5ea09 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] [instance: 3766b195-ace4-4563-a24e-dca72941251e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:07.934409 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b968beb-c959-4ea9-a25f-d65e2ed5ea09 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:07.937358 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b968beb-c959-4ea9-a25f-d65e2ed5ea09 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:07.938841 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b968beb-c959-4ea9-a25f-d65e2ed5ea09 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:07.940564 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b968beb-c959-4ea9-a25f-d65e2ed5ea09 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:07.943852 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b968beb-c959-4ea9-a25f-d65e2ed5ea09 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:07.944662 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b968beb-c959-4ea9-a25f-d65e2ed5ea09 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:08.110485 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6b968beb-c959-4ea9-a25f-d65e2ed5ea09 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e/action" status: 202 len: 0 microversion: 2.1 time: 0.211823 Sep 08 10:48:08.113584 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1250/2478] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:48:07 2022] POST /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 10:48:08.129165 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ba833a4b-e8c3-482f-932c-81e43a199d55 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:08.130242 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ba833a4b-e8c3-482f-932c-81e43a199d55 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] [instance: 5134b057-ca4f-4ec8-8dd7-435d4e3d1279] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:08.142957 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba833a4b-e8c3-482f-932c-81e43a199d55 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:08.143989 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba833a4b-e8c3-482f-932c-81e43a199d55 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:08.144636 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba833a4b-e8c3-482f-932c-81e43a199d55 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:08.145665 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba833a4b-e8c3-482f-932c-81e43a199d55 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:08.146336 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba833a4b-e8c3-482f-932c-81e43a199d55 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:08.146927 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba833a4b-e8c3-482f-932c-81e43a199d55 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:08.200339 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:48:08.502374 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ba833a4b-e8c3-482f-932c-81e43a199d55 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6f265811ad4ccf866fb8094782dd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9a5f2a2b4f460dad3731b0ce6ecebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:08.527039 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ba833a4b-e8c3-482f-932c-81e43a199d55 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] 10.222.0.27 "GET /compute/v2.1/servers/5134b057-ca4f-4ec8-8dd7-435d4e3d1279" status: 200 len: 1322 microversion: 2.1 time: 0.409944 Sep 08 10:48:08.556443 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1251/2479] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:08 2022] GET /compute/v2.1/servers/5134b057-ca4f-4ec8-8dd7-435d4e3d1279 => generated 1322 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:08.593951 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d7858910-4629-4bda-a395-75cce14d8d25 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:08.597141 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d7858910-4629-4bda-a395-75cce14d8d25 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] [instance: 3766b195-ace4-4563-a24e-dca72941251e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:08.608146 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d7858910-4629-4bda-a395-75cce14d8d25 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:08.608867 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d7858910-4629-4bda-a395-75cce14d8d25 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:08.609565 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d7858910-4629-4bda-a395-75cce14d8d25 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:08.610534 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d7858910-4629-4bda-a395-75cce14d8d25 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:08.611244 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d7858910-4629-4bda-a395-75cce14d8d25 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:08.611898 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d7858910-4629-4bda-a395-75cce14d8d25 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:08.706112 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d7858910-4629-4bda-a395-75cce14d8d25 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:08.706689 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d7858910-4629-4bda-a395-75cce14d8d25 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:08.707536 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d7858910-4629-4bda-a395-75cce14d8d25 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:08.708152 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-d7858910-4629-4bda-a395-75cce14d8d25 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Lazy-loading 'fault' on Instance uuid 3766b195-ace4-4563-a24e-dca72941251e {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:48:09.107763 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d7858910-4629-4bda-a395-75cce14d8d25 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e" status: 200 len: 1599 microversion: 2.1 time: 0.540642 Sep 08 10:48:09.112816 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1252/2480] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:08 2022] GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e => generated 1599 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:09.137634 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e767b130-dabe-4649-9730-2fc438b5d0ab tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:09.141612 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e767b130-dabe-4649-9730-2fc438b5d0ab tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] [instance: 83d65df7-eb49-46ce-815a-54fbb3725661] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:09.155333 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e767b130-dabe-4649-9730-2fc438b5d0ab tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:09.157345 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e767b130-dabe-4649-9730-2fc438b5d0ab tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:09.158362 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e767b130-dabe-4649-9730-2fc438b5d0ab tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:09.162173 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e767b130-dabe-4649-9730-2fc438b5d0ab tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:09.163912 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e767b130-dabe-4649-9730-2fc438b5d0ab tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:09.164589 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e767b130-dabe-4649-9730-2fc438b5d0ab tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:09.337716 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e767b130-dabe-4649-9730-2fc438b5d0ab tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd975c3a56545fa938752d2b72be872', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e481d7d8204631b72aaef2d6279c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:09.348916 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e767b130-dabe-4649-9730-2fc438b5d0ab tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] 10.222.0.27 "GET /compute/v2.1/servers/83d65df7-eb49-46ce-815a-54fbb3725661" status: 200 len: 1273 microversion: 2.1 time: 0.233787 Sep 08 10:48:09.376691 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1253/2481] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:09 2022] GET /compute/v2.1/servers/83d65df7-eb49-46ce-815a-54fbb3725661 => generated 1273 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:09.388336 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cc2d1e0e-110e-4fcc-ac98-f30ef754f926 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:09.388985 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cc2d1e0e-110e-4fcc-ac98-f30ef754f926 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] [instance: b7c9f2aa-8e8c-4200-89ee-a107ea59256a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:09.423173 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc2d1e0e-110e-4fcc-ac98-f30ef754f926 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:09.423699 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc2d1e0e-110e-4fcc-ac98-f30ef754f926 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:09.424162 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc2d1e0e-110e-4fcc-ac98-f30ef754f926 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:09.424910 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc2d1e0e-110e-4fcc-ac98-f30ef754f926 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:09.425405 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc2d1e0e-110e-4fcc-ac98-f30ef754f926 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:09.425844 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc2d1e0e-110e-4fcc-ac98-f30ef754f926 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:09.647405 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cc2d1e0e-110e-4fcc-ac98-f30ef754f926 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ff38511b484fbcb7817a56076cf4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a768a3863448bca0c6cda11afdd955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:09.656837 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cc2d1e0e-110e-4fcc-ac98-f30ef754f926 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] 10.222.0.27 "GET /compute/v2.1/servers/b7c9f2aa-8e8c-4200-89ee-a107ea59256a" status: 200 len: 1318 microversion: 2.1 time: 0.280468 Sep 08 10:48:09.657438 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1254/2482] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:09 2022] GET /compute/v2.1/servers/b7c9f2aa-8e8c-4200-89ee-a107ea59256a => generated 1318 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:09.672108 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-9bacd2bb-0e20-4e27-a9b6-235a2748ec51 req-01bc1242-1668-4282-9d6e-ee85bfcd9eaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5134b057-ca4f-4ec8-8dd7-435d4e3d1279", "name": "network-vif-plugged", "status": "completed", "tag": "1cb6d044-b419-4afe-ab6f-99a07098ebb9"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:48:09.687632 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-9bacd2bb-0e20-4e27-a9b6-235a2748ec51 req-01bc1242-1668-4282-9d6e-ee85bfcd9eaa service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:09.688279 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-9bacd2bb-0e20-4e27-a9b6-235a2748ec51 req-01bc1242-1668-4282-9d6e-ee85bfcd9eaa service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:09.688726 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-9bacd2bb-0e20-4e27-a9b6-235a2748ec51 req-01bc1242-1668-4282-9d6e-ee85bfcd9eaa service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:09.702984 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-9bacd2bb-0e20-4e27-a9b6-235a2748ec51 req-01bc1242-1668-4282-9d6e-ee85bfcd9eaa service nova] Creating event network-vif-plugged:1cb6d044-b419-4afe-ab6f-99a07098ebb9 for instance 5134b057-ca4f-4ec8-8dd7-435d4e3d1279 on n-h1-850501-12 Sep 08 10:48:09.709576 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-9bacd2bb-0e20-4e27-a9b6-235a2748ec51 req-01bc1242-1668-4282-9d6e-ee85bfcd9eaa service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048297 Sep 08 10:48:09.710322 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1255/2483] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:48:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:48:09.718803 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0af8261b-61a3-49ac-94dc-4a95a273adda tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:48:09.723447 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0af8261b-61a3-49ac-94dc-4a95a273adda tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] [instance: 3766b195-ace4-4563-a24e-dca72941251e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:09.731848 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0af8261b-61a3-49ac-94dc-4a95a273adda tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:09.732698 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0af8261b-61a3-49ac-94dc-4a95a273adda tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:09.734725 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0af8261b-61a3-49ac-94dc-4a95a273adda tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:09.735892 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0af8261b-61a3-49ac-94dc-4a95a273adda tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:09.736547 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0af8261b-61a3-49ac-94dc-4a95a273adda tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:09.737160 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0af8261b-61a3-49ac-94dc-4a95a273adda tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:09.844509 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0af8261b-61a3-49ac-94dc-4a95a273adda tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e/action" status: 202 len: 0 microversion: 2.1 time: 0.132823 Sep 08 10:48:09.846487 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1256/2484] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:48:09 2022] POST /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:48:09.852468 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-305e77df-e46e-4af1-9aba-911638e4e68a tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:48:09.853870 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-305e77df-e46e-4af1-9aba-911638e4e68a tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:48:09.855546 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-305e77df-e46e-4af1-9aba-911638e4e68a tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:48:09.856330 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-305e77df-e46e-4af1-9aba-911638e4e68a tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:48:09.856868 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6248378e-f352-44f8-80a0-035a9c513da1 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:09.857153 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-305e77df-e46e-4af1-9aba-911638e4e68a tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:48:09.858077 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6248378e-f352-44f8-80a0-035a9c513da1 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] [instance: 5134b057-ca4f-4ec8-8dd7-435d4e3d1279] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:09.866745 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6248378e-f352-44f8-80a0-035a9c513da1 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:09.867778 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6248378e-f352-44f8-80a0-035a9c513da1 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:09.868241 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6248378e-f352-44f8-80a0-035a9c513da1 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:09.869185 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6248378e-f352-44f8-80a0-035a9c513da1 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:09.870827 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6248378e-f352-44f8-80a0-035a9c513da1 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:09.871678 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6248378e-f352-44f8-80a0-035a9c513da1 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:09.875329 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-305e77df-e46e-4af1-9aba-911638e4e68a tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:09.877778 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-305e77df-e46e-4af1-9aba-911638e4e68a tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:09.878354 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-305e77df-e46e-4af1-9aba-911638e4e68a tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:09.880741 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-305e77df-e46e-4af1-9aba-911638e4e68a tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:09.881325 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-305e77df-e46e-4af1-9aba-911638e4e68a tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:09.881774 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-305e77df-e46e-4af1-9aba-911638e4e68a tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:09.931428 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-305e77df-e46e-4af1-9aba-911638e4e68a tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Getting quotas for project 20f9a24cad014d7f827e8f3236dd5bae. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:48:09.949997 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-305e77df-e46e-4af1-9aba-911638e4e68a tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Getting quotas for user 5c291cbe955b4ee5abc98132dda0255e and project 20f9a24cad014d7f827e8f3236dd5bae. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:48:09.968704 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-305e77df-e46e-4af1-9aba-911638e4e68a tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:48:09.972399 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-305e77df-e46e-4af1-9aba-911638e4e68a tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: 272b4680-9e7e-41dd-afa5-3116aa92665b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:48:10.066256 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-305e77df-e46e-4af1-9aba-911638e4e68a tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.609205 Sep 08 10:48:10.067391 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1229/2485] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:48:07 2022] POST /compute/v2.1/servers => generated 401 bytes in 2611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:48:10.072786 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c396f8ca-da56-48ae-b8ff-1e77631f3399 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:10.073986 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c396f8ca-da56-48ae-b8ff-1e77631f3399 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] [instance: 3766b195-ace4-4563-a24e-dca72941251e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:10.081777 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c396f8ca-da56-48ae-b8ff-1e77631f3399 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:10.082657 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c396f8ca-da56-48ae-b8ff-1e77631f3399 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:10.083566 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c396f8ca-da56-48ae-b8ff-1e77631f3399 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:10.084279 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c396f8ca-da56-48ae-b8ff-1e77631f3399 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:10.084943 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c396f8ca-da56-48ae-b8ff-1e77631f3399 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:10.085423 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c396f8ca-da56-48ae-b8ff-1e77631f3399 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:10.086033 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6248378e-f352-44f8-80a0-035a9c513da1 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6f265811ad4ccf866fb8094782dd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9a5f2a2b4f460dad3731b0ce6ecebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:10.103205 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6248378e-f352-44f8-80a0-035a9c513da1 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] 10.222.0.27 "GET /compute/v2.1/servers/5134b057-ca4f-4ec8-8dd7-435d4e3d1279" status: 200 len: 1322 microversion: 2.1 time: 0.255389 Sep 08 10:48:10.103811 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1257/2486] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:09 2022] GET /compute/v2.1/servers/5134b057-ca4f-4ec8-8dd7-435d4e3d1279 => generated 1322 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:10.145986 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-98ddb60a-9461-43c1-a440-9ece4bec7b4c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:10.146614 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-98ddb60a-9461-43c1-a440-9ece4bec7b4c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: 272b4680-9e7e-41dd-afa5-3116aa92665b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:10.251213 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-98ddb60a-9461-43c1-a440-9ece4bec7b4c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c291cbe955b4ee5abc98132dda0255e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f9a24cad014d7f827e8f3236dd5bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:10.264301 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-98ddb60a-9461-43c1-a440-9ece4bec7b4c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/272b4680-9e7e-41dd-afa5-3116aa92665b" status: 200 len: 1241 microversion: 2.1 time: 0.147450 Sep 08 10:48:10.281665 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1258/2487] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:10 2022] GET /compute/v2.1/servers/272b4680-9e7e-41dd-afa5-3116aa92665b => generated 1241 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:10.387366 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c5949fcc-1521-4a00-b189-9de3bacffab7 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:10.399547 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c5949fcc-1521-4a00-b189-9de3bacffab7 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] [instance: 83d65df7-eb49-46ce-815a-54fbb3725661] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:10.424757 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5949fcc-1521-4a00-b189-9de3bacffab7 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:10.425633 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5949fcc-1521-4a00-b189-9de3bacffab7 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:10.426393 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5949fcc-1521-4a00-b189-9de3bacffab7 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:10.429960 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5949fcc-1521-4a00-b189-9de3bacffab7 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:10.430914 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5949fcc-1521-4a00-b189-9de3bacffab7 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:10.439423 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5949fcc-1521-4a00-b189-9de3bacffab7 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:10.665058 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c396f8ca-da56-48ae-b8ff-1e77631f3399 tempest-ServersAdminTestJSON-1408286026 tempest-ServersAdminTestJSON-1408286026-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e" status: 200 len: 1616 microversion: 2.1 time: 0.595994 Sep 08 10:48:10.671679 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1230/2488] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:10 2022] GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e => generated 1616 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:10.687770 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c5949fcc-1521-4a00-b189-9de3bacffab7 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd975c3a56545fa938752d2b72be872', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e481d7d8204631b72aaef2d6279c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:10.699168 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c5949fcc-1521-4a00-b189-9de3bacffab7 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] 10.222.0.27 "GET /compute/v2.1/servers/83d65df7-eb49-46ce-815a-54fbb3725661" status: 200 len: 1273 microversion: 2.1 time: 0.321607 Sep 08 10:48:10.707221 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1259/2489] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:10 2022] GET /compute/v2.1/servers/83d65df7-eb49-46ce-815a-54fbb3725661 => generated 1273 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:48:10.737239 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-77cae9a7-962e-46ec-8adb-ddca0c847827 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:10.738102 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-77cae9a7-962e-46ec-8adb-ddca0c847827 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] [instance: b7c9f2aa-8e8c-4200-89ee-a107ea59256a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:10.748546 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-77cae9a7-962e-46ec-8adb-ddca0c847827 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:10.750154 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-77cae9a7-962e-46ec-8adb-ddca0c847827 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:10.750801 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-77cae9a7-962e-46ec-8adb-ddca0c847827 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:10.751716 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-77cae9a7-962e-46ec-8adb-ddca0c847827 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:10.752427 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-77cae9a7-962e-46ec-8adb-ddca0c847827 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:10.753431 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-77cae9a7-962e-46ec-8adb-ddca0c847827 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:11.068683 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e058332b-f56c-4336-9272-62a207efc20d tempest-AZV2TestJSON-1474987391 tempest-AZV2TestJSON-1474987391-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:11.075719 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e058332b-f56c-4336-9272-62a207efc20d tempest-AZV2TestJSON-1474987391 tempest-AZV2TestJSON-1474987391-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:11.076699 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e058332b-f56c-4336-9272-62a207efc20d tempest-AZV2TestJSON-1474987391 tempest-AZV2TestJSON-1474987391-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:11.098870 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e058332b-f56c-4336-9272-62a207efc20d tempest-AZV2TestJSON-1474987391 tempest-AZV2TestJSON-1474987391-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:11.101645 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e058332b-f56c-4336-9272-62a207efc20d tempest-AZV2TestJSON-1474987391 tempest-AZV2TestJSON-1474987391-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:11.104381 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e058332b-f56c-4336-9272-62a207efc20d tempest-AZV2TestJSON-1474987391 tempest-AZV2TestJSON-1474987391-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:11.109057 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e058332b-f56c-4336-9272-62a207efc20d tempest-AZV2TestJSON-1474987391 tempest-AZV2TestJSON-1474987391-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:11.171198 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-77cae9a7-962e-46ec-8adb-ddca0c847827 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ff38511b484fbcb7817a56076cf4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a768a3863448bca0c6cda11afdd955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:11.183581 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-77cae9a7-962e-46ec-8adb-ddca0c847827 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] 10.222.0.27 "GET /compute/v2.1/servers/b7c9f2aa-8e8c-4200-89ee-a107ea59256a" status: 200 len: 1318 microversion: 2.1 time: 0.474122 Sep 08 10:48:11.190599 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1260/2490] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:10 2022] GET /compute/v2.1/servers/b7c9f2aa-8e8c-4200-89ee-a107ea59256a => generated 1318 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:11.204336 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c8a676fd-9fc5-4402-b19d-16df408e14bc tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:11.204839 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c8a676fd-9fc5-4402-b19d-16df408e14bc tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: e84298ea-b5e7-473b-8597-2b469d09023e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:11.207304 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e058332b-f56c-4336-9272-62a207efc20d tempest-AZV2TestJSON-1474987391 tempest-AZV2TestJSON-1474987391-project] 10.222.0.27 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.530977 Sep 08 10:48:11.218703 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1231/2491] 10.222.0.27 () {58 vars in 1164 bytes} [Thu Sep 8 10:48:10 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:48:11.224402 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bd69ae95-0855-49ce-8794-eefa4da21913 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:11.227254 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bd69ae95-0855-49ce-8794-eefa4da21913 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] [instance: 5134b057-ca4f-4ec8-8dd7-435d4e3d1279] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:11.234375 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c8a676fd-9fc5-4402-b19d-16df408e14bc tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:11.239959 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bd69ae95-0855-49ce-8794-eefa4da21913 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:11.241756 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c8a676fd-9fc5-4402-b19d-16df408e14bc tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:11.242535 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c8a676fd-9fc5-4402-b19d-16df408e14bc tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:11.247144 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bd69ae95-0855-49ce-8794-eefa4da21913 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:11.247638 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bd69ae95-0855-49ce-8794-eefa4da21913 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:11.249366 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bd69ae95-0855-49ce-8794-eefa4da21913 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:11.250102 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bd69ae95-0855-49ce-8794-eefa4da21913 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:11.254490 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bd69ae95-0855-49ce-8794-eefa4da21913 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:11.262255 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c8a676fd-9fc5-4402-b19d-16df408e14bc tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:11.264181 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c8a676fd-9fc5-4402-b19d-16df408e14bc tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:11.265860 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c8a676fd-9fc5-4402-b19d-16df408e14bc tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:11.358207 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c8a676fd-9fc5-4402-b19d-16df408e14bc tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: e84298ea-b5e7-473b-8597-2b469d09023e] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:48:11.530529 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c8a676fd-9fc5-4402-b19d-16df408e14bc tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e84298ea-b5e7-473b-8597-2b469d09023e" status: 204 len: 0 microversion: 2.1 time: 0.336945 Sep 08 10:48:11.538048 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1261/2492] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:48:11 2022] DELETE /compute/v2.1/servers/e84298ea-b5e7-473b-8597-2b469d09023e => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:48:11.554739 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1f11e6ee-3bad-49fa-96be-be5d92669149 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:11.558583 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1f11e6ee-3bad-49fa-96be-be5d92669149 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: 272b4680-9e7e-41dd-afa5-3116aa92665b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:11.574254 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f11e6ee-3bad-49fa-96be-be5d92669149 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:11.577720 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f11e6ee-3bad-49fa-96be-be5d92669149 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:11.578210 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f11e6ee-3bad-49fa-96be-be5d92669149 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:11.579231 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f11e6ee-3bad-49fa-96be-be5d92669149 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:11.579670 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f11e6ee-3bad-49fa-96be-be5d92669149 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:11.580107 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f11e6ee-3bad-49fa-96be-be5d92669149 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:11.679732 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1f11e6ee-3bad-49fa-96be-be5d92669149 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c291cbe955b4ee5abc98132dda0255e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f9a24cad014d7f827e8f3236dd5bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:11.693796 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1f11e6ee-3bad-49fa-96be-be5d92669149 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/272b4680-9e7e-41dd-afa5-3116aa92665b" status: 200 len: 1293 microversion: 2.1 time: 0.155271 Sep 08 10:48:11.722522 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1262/2493] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:11 2022] GET /compute/v2.1/servers/272b4680-9e7e-41dd-afa5-3116aa92665b => generated 1293 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:11.732599 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-edccb5d5-ed9f-487b-9e5e-8b698c000439 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:11.733341 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-edccb5d5-ed9f-487b-9e5e-8b698c000439 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: e84298ea-b5e7-473b-8597-2b469d09023e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:11.740440 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-edccb5d5-ed9f-487b-9e5e-8b698c000439 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:11.740942 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-edccb5d5-ed9f-487b-9e5e-8b698c000439 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:11.741412 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-edccb5d5-ed9f-487b-9e5e-8b698c000439 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:11.743065 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-edccb5d5-ed9f-487b-9e5e-8b698c000439 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:11.743616 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-edccb5d5-ed9f-487b-9e5e-8b698c000439 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:11.744052 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-edccb5d5-ed9f-487b-9e5e-8b698c000439 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:11.823070 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-bd69ae95-0855-49ce-8794-eefa4da21913 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6f265811ad4ccf866fb8094782dd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9a5f2a2b4f460dad3731b0ce6ecebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:11.835987 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bd69ae95-0855-49ce-8794-eefa4da21913 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] 10.222.0.27 "GET /compute/v2.1/servers/5134b057-ca4f-4ec8-8dd7-435d4e3d1279" status: 200 len: 1322 microversion: 2.1 time: 0.615879 Sep 08 10:48:11.849276 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1232/2494] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:11 2022] GET /compute/v2.1/servers/5134b057-ca4f-4ec8-8dd7-435d4e3d1279 => generated 1322 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:11.860928 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-cde46a79-aa3a-4c74-a2fb-9b8495623a93 req-b3af3088-d4b1-4880-88b1-502171f65cf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7c9f2aa-8e8c-4200-89ee-a107ea59256a", "name": "network-vif-plugged", "status": "completed", "tag": "c9d7159a-535c-438e-a67b-db24af373413"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:48:11.872862 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-cde46a79-aa3a-4c74-a2fb-9b8495623a93 req-b3af3088-d4b1-4880-88b1-502171f65cf1 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:11.873485 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-cde46a79-aa3a-4c74-a2fb-9b8495623a93 req-b3af3088-d4b1-4880-88b1-502171f65cf1 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:11.873924 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-cde46a79-aa3a-4c74-a2fb-9b8495623a93 req-b3af3088-d4b1-4880-88b1-502171f65cf1 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:11.903551 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-cde46a79-aa3a-4c74-a2fb-9b8495623a93 req-b3af3088-d4b1-4880-88b1-502171f65cf1 service nova] Creating event network-vif-plugged:c9d7159a-535c-438e-a67b-db24af373413 for instance b7c9f2aa-8e8c-4200-89ee-a107ea59256a on n-h1-850501-12 Sep 08 10:48:11.913317 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-cde46a79-aa3a-4c74-a2fb-9b8495623a93 req-b3af3088-d4b1-4880-88b1-502171f65cf1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062693 Sep 08 10:48:11.916681 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1233/2495] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:48:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:48:11.926313 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-50f0a0bf-5f49-47be-8199-51a5b774f0bf tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:11.927261 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-50f0a0bf-5f49-47be-8199-51a5b774f0bf tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] [instance: 83d65df7-eb49-46ce-815a-54fbb3725661] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:11.940962 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-50f0a0bf-5f49-47be-8199-51a5b774f0bf tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:11.942088 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-50f0a0bf-5f49-47be-8199-51a5b774f0bf tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:11.942613 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-50f0a0bf-5f49-47be-8199-51a5b774f0bf tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:11.958820 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-50f0a0bf-5f49-47be-8199-51a5b774f0bf tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:11.960769 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-50f0a0bf-5f49-47be-8199-51a5b774f0bf tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:11.962695 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-50f0a0bf-5f49-47be-8199-51a5b774f0bf tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:12.175509 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-edccb5d5-ed9f-487b-9e5e-8b698c000439 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:12.186725 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-edccb5d5-ed9f-487b-9e5e-8b698c000439 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/e84298ea-b5e7-473b-8597-2b469d09023e" status: 200 len: 1469 microversion: 2.1 time: 0.469006 Sep 08 10:48:12.187443 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1263/2496] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:11 2022] GET /compute/v2.1/servers/e84298ea-b5e7-473b-8597-2b469d09023e => generated 1469 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:12.208173 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-35bebc52-f191-479d-8ef3-bf4dc29343d7 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:12.208797 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-35bebc52-f191-479d-8ef3-bf4dc29343d7 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] [instance: b7c9f2aa-8e8c-4200-89ee-a107ea59256a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:12.215211 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35bebc52-f191-479d-8ef3-bf4dc29343d7 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:12.215712 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35bebc52-f191-479d-8ef3-bf4dc29343d7 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:12.216150 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35bebc52-f191-479d-8ef3-bf4dc29343d7 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:12.216871 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35bebc52-f191-479d-8ef3-bf4dc29343d7 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:12.217354 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35bebc52-f191-479d-8ef3-bf4dc29343d7 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:12.218032 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35bebc52-f191-479d-8ef3-bf4dc29343d7 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:12.314296 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-50f0a0bf-5f49-47be-8199-51a5b774f0bf tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd975c3a56545fa938752d2b72be872', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e481d7d8204631b72aaef2d6279c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:12.330897 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-50f0a0bf-5f49-47be-8199-51a5b774f0bf tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] 10.222.0.27 "GET /compute/v2.1/servers/83d65df7-eb49-46ce-815a-54fbb3725661" status: 200 len: 1315 microversion: 2.1 time: 0.411423 Sep 08 10:48:12.332259 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1234/2497] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:11 2022] GET /compute/v2.1/servers/83d65df7-eb49-46ce-815a-54fbb3725661 => generated 1315 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:12.601980 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-35bebc52-f191-479d-8ef3-bf4dc29343d7 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ff38511b484fbcb7817a56076cf4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a768a3863448bca0c6cda11afdd955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:12.618315 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-35bebc52-f191-479d-8ef3-bf4dc29343d7 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] 10.222.0.27 "GET /compute/v2.1/servers/b7c9f2aa-8e8c-4200-89ee-a107ea59256a" status: 200 len: 1318 microversion: 2.1 time: 0.411035 Sep 08 10:48:12.619065 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1264/2498] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:12 2022] GET /compute/v2.1/servers/b7c9f2aa-8e8c-4200-89ee-a107ea59256a => generated 1318 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:12.736120 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9a7a6cd1-9a9b-4f92-8ed5-82e61dbddaa7 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:12.738943 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9a7a6cd1-9a9b-4f92-8ed5-82e61dbddaa7 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: 272b4680-9e7e-41dd-afa5-3116aa92665b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:12.761493 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9a7a6cd1-9a9b-4f92-8ed5-82e61dbddaa7 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:12.762058 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9a7a6cd1-9a9b-4f92-8ed5-82e61dbddaa7 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:12.764577 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9a7a6cd1-9a9b-4f92-8ed5-82e61dbddaa7 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:12.767416 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9a7a6cd1-9a9b-4f92-8ed5-82e61dbddaa7 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:12.768238 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9a7a6cd1-9a9b-4f92-8ed5-82e61dbddaa7 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:12.768959 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9a7a6cd1-9a9b-4f92-8ed5-82e61dbddaa7 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:12.872951 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-77759042-bbbf-407f-8e0e-9ef86f4f2daa tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:12.873878 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-77759042-bbbf-407f-8e0e-9ef86f4f2daa tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] [instance: 5134b057-ca4f-4ec8-8dd7-435d4e3d1279] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:12.901152 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-77759042-bbbf-407f-8e0e-9ef86f4f2daa tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:12.903303 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-77759042-bbbf-407f-8e0e-9ef86f4f2daa tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:12.903914 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-77759042-bbbf-407f-8e0e-9ef86f4f2daa tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:12.904826 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-77759042-bbbf-407f-8e0e-9ef86f4f2daa tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:12.905596 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9a7a6cd1-9a9b-4f92-8ed5-82e61dbddaa7 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c291cbe955b4ee5abc98132dda0255e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f9a24cad014d7f827e8f3236dd5bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:12.906986 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-77759042-bbbf-407f-8e0e-9ef86f4f2daa tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:12.907594 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-77759042-bbbf-407f-8e0e-9ef86f4f2daa tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:12.923943 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9a7a6cd1-9a9b-4f92-8ed5-82e61dbddaa7 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/272b4680-9e7e-41dd-afa5-3116aa92665b" status: 200 len: 1293 microversion: 2.1 time: 0.196597 Sep 08 10:48:12.926129 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1235/2499] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:12 2022] GET /compute/v2.1/servers/272b4680-9e7e-41dd-afa5-3116aa92665b => generated 1293 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:12.993838 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-d145d2df-c52c-4d50-a647-ab063db89a74 req-833f7f6e-9698-4c6c-adf0-0171ebf5df89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83d65df7-eb49-46ce-815a-54fbb3725661", "tag": "f161d99b-33c5-4181-874f-078895df4a10"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:48:13.024804 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-d145d2df-c52c-4d50-a647-ab063db89a74 req-833f7f6e-9698-4c6c-adf0-0171ebf5df89 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:13.026457 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-d145d2df-c52c-4d50-a647-ab063db89a74 req-833f7f6e-9698-4c6c-adf0-0171ebf5df89 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:13.027812 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-d145d2df-c52c-4d50-a647-ab063db89a74 req-833f7f6e-9698-4c6c-adf0-0171ebf5df89 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:13.058488 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-d145d2df-c52c-4d50-a647-ab063db89a74 req-833f7f6e-9698-4c6c-adf0-0171ebf5df89 service nova] Creating event network-changed:f161d99b-33c5-4181-874f-078895df4a10 for instance 83d65df7-eb49-46ce-815a-54fbb3725661 on n-h1-850501-12 Sep 08 10:48:13.083826 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-d145d2df-c52c-4d50-a647-ab063db89a74 req-833f7f6e-9698-4c6c-adf0-0171ebf5df89 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093536 Sep 08 10:48:13.085571 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1236/2500] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:48:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:48:13.220964 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-53a954d0-4d70-404b-873c-c2a59e7b98c1 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:13.221737 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-53a954d0-4d70-404b-873c-c2a59e7b98c1 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: e84298ea-b5e7-473b-8597-2b469d09023e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:13.234622 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-53a954d0-4d70-404b-873c-c2a59e7b98c1 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:13.235134 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-53a954d0-4d70-404b-873c-c2a59e7b98c1 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:13.235576 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-53a954d0-4d70-404b-873c-c2a59e7b98c1 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:13.236296 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-53a954d0-4d70-404b-873c-c2a59e7b98c1 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:13.236754 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-53a954d0-4d70-404b-873c-c2a59e7b98c1 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:13.237945 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-53a954d0-4d70-404b-873c-c2a59e7b98c1 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:13.242724 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=100 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:48:13.619138 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-53a954d0-4d70-404b-873c-c2a59e7b98c1 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:13.634220 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-53a954d0-4d70-404b-873c-c2a59e7b98c1 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/e84298ea-b5e7-473b-8597-2b469d09023e" status: 200 len: 1469 microversion: 2.1 time: 0.426556 Sep 08 10:48:13.634822 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1237/2501] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:13 2022] GET /compute/v2.1/servers/e84298ea-b5e7-473b-8597-2b469d09023e => generated 1469 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:13.660738 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8df3e933-c242-4f45-b276-80ede3033a0b tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:13.661406 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8df3e933-c242-4f45-b276-80ede3033a0b tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] [instance: 83d65df7-eb49-46ce-815a-54fbb3725661] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:13.683601 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8df3e933-c242-4f45-b276-80ede3033a0b tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:13.684107 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8df3e933-c242-4f45-b276-80ede3033a0b tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:13.684546 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8df3e933-c242-4f45-b276-80ede3033a0b tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:13.685282 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8df3e933-c242-4f45-b276-80ede3033a0b tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:13.685731 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8df3e933-c242-4f45-b276-80ede3033a0b tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:13.697932 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8df3e933-c242-4f45-b276-80ede3033a0b tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:13.813349 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-77759042-bbbf-407f-8e0e-9ef86f4f2daa tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6f265811ad4ccf866fb8094782dd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9a5f2a2b4f460dad3731b0ce6ecebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:13.821322 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-77759042-bbbf-407f-8e0e-9ef86f4f2daa tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] 10.222.0.27 "GET /compute/v2.1/servers/5134b057-ca4f-4ec8-8dd7-435d4e3d1279" status: 200 len: 1472 microversion: 2.1 time: 0.958296 Sep 08 10:48:13.843838 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1265/2502] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:12 2022] GET /compute/v2.1/servers/5134b057-ca4f-4ec8-8dd7-435d4e3d1279 => generated 1472 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:48:13.850118 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b6cda49f-cbd0-4631-b281-0a6fd2d2e07a tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:13.851018 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b6cda49f-cbd0-4631-b281-0a6fd2d2e07a tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] [instance: b7c9f2aa-8e8c-4200-89ee-a107ea59256a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:13.858828 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b6cda49f-cbd0-4631-b281-0a6fd2d2e07a tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:13.859603 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b6cda49f-cbd0-4631-b281-0a6fd2d2e07a tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:13.860672 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b6cda49f-cbd0-4631-b281-0a6fd2d2e07a tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:13.861669 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b6cda49f-cbd0-4631-b281-0a6fd2d2e07a tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:13.862721 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b6cda49f-cbd0-4631-b281-0a6fd2d2e07a tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:13.863371 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b6cda49f-cbd0-4631-b281-0a6fd2d2e07a tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:13.869275 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:48:14.062875 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8df3e933-c242-4f45-b276-80ede3033a0b tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd975c3a56545fa938752d2b72be872', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e481d7d8204631b72aaef2d6279c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:14.087397 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8df3e933-c242-4f45-b276-80ede3033a0b tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] 10.222.0.27 "GET /compute/v2.1/servers/83d65df7-eb49-46ce-815a-54fbb3725661" status: 200 len: 1315 microversion: 2.1 time: 0.448596 Sep 08 10:48:14.088432 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1238/2503] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:13 2022] GET /compute/v2.1/servers/83d65df7-eb49-46ce-815a-54fbb3725661 => generated 1315 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:14.322004 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b6cda49f-cbd0-4631-b281-0a6fd2d2e07a tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ff38511b484fbcb7817a56076cf4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a768a3863448bca0c6cda11afdd955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:14.337735 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b6cda49f-cbd0-4631-b281-0a6fd2d2e07a tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] 10.222.0.27 "GET /compute/v2.1/servers/b7c9f2aa-8e8c-4200-89ee-a107ea59256a" status: 200 len: 1508 microversion: 2.1 time: 0.492422 Sep 08 10:48:14.338554 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1266/2504] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:13 2022] GET /compute/v2.1/servers/b7c9f2aa-8e8c-4200-89ee-a107ea59256a => generated 1508 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:14.361675 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-290cd604-f5c2-4024-af33-221ba3eee7d4 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:14.364908 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-290cd604-f5c2-4024-af33-221ba3eee7d4 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: 272b4680-9e7e-41dd-afa5-3116aa92665b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:14.378040 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-290cd604-f5c2-4024-af33-221ba3eee7d4 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:14.381431 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-290cd604-f5c2-4024-af33-221ba3eee7d4 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:14.382082 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-290cd604-f5c2-4024-af33-221ba3eee7d4 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:14.383772 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-290cd604-f5c2-4024-af33-221ba3eee7d4 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:14.390656 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d82a22e6-f2ac-469f-ad82-439abe885ddb tempest-ServersAdminNegativeTestJSON-680255960 tempest-ServersAdminNegativeTestJSON-680255960-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:48:14.390889 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-290cd604-f5c2-4024-af33-221ba3eee7d4 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:14.391388 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d82a22e6-f2ac-469f-ad82-439abe885ddb tempest-ServersAdminNegativeTestJSON-680255960 tempest-ServersAdminNegativeTestJSON-680255960-project-admin] [instance: 5999d0a8-796b-458b-94f8-df589199016c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:14.391812 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-290cd604-f5c2-4024-af33-221ba3eee7d4 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:14.404833 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-d82a22e6-f2ac-469f-ad82-439abe885ddb tempest-ServersAdminNegativeTestJSON-680255960 tempest-ServersAdminNegativeTestJSON-680255960-project-admin] HTTP exception thrown: Instance 5999d0a8-796b-458b-94f8-df589199016c could not be found. Sep 08 10:48:14.412947 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d82a22e6-f2ac-469f-ad82-439abe885ddb tempest-ServersAdminNegativeTestJSON-680255960 tempest-ServersAdminNegativeTestJSON-680255960-project-admin] Request method failure captured: Sep 08 10:48:14.412947 n-d-850501-12 devstack@n-api.service[128861]: request: POST /compute/v2.1/servers/5999d0a8-796b-458b-94f8-df589199016c/action HTTP/1.1 Sep 08 10:48:14.412947 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:48:14.412947 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:48:14.412947 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:48:14.412947 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 15 Sep 08 10:48:14.412947 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:48:14.412947 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:48:14.412947 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:48:14.412947 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:48:14.412947 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGchVmowXga0Pwgb-Yh1WV3I0GGSvt1R377adW3v9XaMI2djVu740XN-GCcbXdZv8mYdrNgQOo0WXcd8zmHZQ5N-W_JUEHlGT4vkGKYk0iV9v16mBJ97WdG27nApgHAbq_QhH2HBdW3AkM03od5RR3ibuARqvDhSaYE1GEcAcA99YjGU Sep 08 10:48:14.412947 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:48:14.412947 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:48:14.412947 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:48:14.412947 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:48:14.412947 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:48:14.412947 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:48:14.412947 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: d1756642795843229031d4d076b67295 Sep 08 10:48:14.412947 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-680255960 Sep 08 10:48:14.412947 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,admin,member Sep 08 10:48:14.412947 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,admin,member Sep 08 10:48:14.412947 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d1756642795843229031d4d076b67295"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d1756642795843229031d4d076b67295"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d1756642795843229031d4d076b67295"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d1756642795843229031d4d076b67295"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:48:14.412947 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServersAdminNegativeTestJSON-680255960 Sep 08 10:48:14.412947 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: d1756642795843229031d4d076b67295 Sep 08 10:48:14.412947 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-680255960 Sep 08 10:48:14.412947 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServersAdminNegativeTestJSON-680255960-project-admin Sep 08 10:48:14.412947 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:48:14.412947 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:48:14.412947 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 9de7e8611c4848cc9a1e9942b490a383 Sep 08 10:48:14.412947 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServersAdminNegativeTestJSON-680255960-project-admin Sep 08 10:48:14.412947 n-d-850501-12 devstack@n-api.service[128861]: Sep 08 10:48:14.412947 n-d-850501-12 devstack@n-api.service[128861]: {"migrate": {}} Sep 08 10:48:14.412947 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:48:14.412947 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 5999d0a8-796b-458b-94f8-df589199016c could not be found. Sep 08 10:48:14.412947 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '5999d0a8-796b-458b-94f8-df589199016c', 'body': {'migrate': {}}} Sep 08 10:48:14.412947 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:48:14.412947 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:48:14.412947 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:48:14.412947 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:48:14.412947 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:48:14.412947 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:48:14.412947 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 08 10:48:14.412947 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 08 10:48:14.412947 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5999d0a8-796b-458b-94f8-df589199016c could not be found. Sep 08 10:48:14.412947 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:48:14.412947 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:48:14.412947 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:48:14.412947 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:48:14.412947 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:48:14.412947 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:48:14.412947 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:48:14.412947 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:48:14.412947 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:48:14.412947 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:48:14.412947 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:48:14.412947 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:48:14.412947 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Sep 08 10:48:14.412947 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Sep 08 10:48:14.412947 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:48:14.412947 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:48:14.412947 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5999d0a8-796b-458b-94f8-df589199016c could not be found. Sep 08 10:48:14.412947 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:48:14.412947 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:48:14.412947 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:48:14.412947 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:48:14.417623 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:48:14.417623 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:48:14.417623 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:48:14.417623 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:48:14.417623 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5999d0a8-796b-458b-94f8-df589199016c could not be found. Sep 08 10:48:14.417623 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:48:14.417623 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d82a22e6-f2ac-469f-ad82-439abe885ddb tempest-ServersAdminNegativeTestJSON-680255960 tempest-ServersAdminNegativeTestJSON-680255960-project-admin] Returning 404 to user: Instance 5999d0a8-796b-458b-94f8-df589199016c could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:48:14.417623 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d82a22e6-f2ac-469f-ad82-439abe885ddb tempest-ServersAdminNegativeTestJSON-680255960 tempest-ServersAdminNegativeTestJSON-680255960-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/5999d0a8-796b-458b-94f8-df589199016c/action" status: 404 len: 111 microversion: 2.1 time: 0.323828 Sep 08 10:48:14.429728 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1239/2505] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:48:14 2022] POST /compute/v2.1/servers/5999d0a8-796b-458b-94f8-df589199016c/action => generated 111 bytes in 340 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:48:14.599638 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-290cd604-f5c2-4024-af33-221ba3eee7d4 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c291cbe955b4ee5abc98132dda0255e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f9a24cad014d7f827e8f3236dd5bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:14.612049 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-290cd604-f5c2-4024-af33-221ba3eee7d4 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/272b4680-9e7e-41dd-afa5-3116aa92665b" status: 200 len: 1299 microversion: 2.1 time: 0.256709 Sep 08 10:48:14.612816 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1267/2506] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:14 2022] GET /compute/v2.1/servers/272b4680-9e7e-41dd-afa5-3116aa92665b => generated 1299 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:14.668242 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-40c639c9-3353-457c-9812-103c73595088 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:14.668907 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-40c639c9-3353-457c-9812-103c73595088 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: e84298ea-b5e7-473b-8597-2b469d09023e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:14.670037 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-af31e95f-659d-4839-85ca-776ac9a2b445 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-15953117", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:48:14.686060 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-40c639c9-3353-457c-9812-103c73595088 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:14.686569 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-40c639c9-3353-457c-9812-103c73595088 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:14.687006 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-40c639c9-3353-457c-9812-103c73595088 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:14.687723 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-40c639c9-3353-457c-9812-103c73595088 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:14.688181 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-40c639c9-3353-457c-9812-103c73595088 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:14.688607 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-40c639c9-3353-457c-9812-103c73595088 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:14.772335 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-af31e95f-659d-4839-85ca-776ac9a2b445 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] validate_networks() for None {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:48:14.945202 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-40c639c9-3353-457c-9812-103c73595088 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:14.983381 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-40c639c9-3353-457c-9812-103c73595088 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/e84298ea-b5e7-473b-8597-2b469d09023e" status: 200 len: 1427 microversion: 2.1 time: 0.325730 Sep 08 10:48:15.006363 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1240/2507] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:14 2022] GET /compute/v2.1/servers/e84298ea-b5e7-473b-8597-2b469d09023e => generated 1427 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:15.116976 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1e35efb6-a777-4006-8c68-355b227a5069 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:15.118404 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1e35efb6-a777-4006-8c68-355b227a5069 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] [instance: 83d65df7-eb49-46ce-815a-54fbb3725661] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:15.132960 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e35efb6-a777-4006-8c68-355b227a5069 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:15.134015 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e35efb6-a777-4006-8c68-355b227a5069 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:15.134644 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e35efb6-a777-4006-8c68-355b227a5069 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:15.136279 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e35efb6-a777-4006-8c68-355b227a5069 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:15.137146 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e35efb6-a777-4006-8c68-355b227a5069 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:15.137759 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e35efb6-a777-4006-8c68-355b227a5069 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:15.565469 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:48:15.743848 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-af31e95f-659d-4839-85ca-776ac9a2b445 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:48:15.744274 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-af31e95f-659d-4839-85ca-776ac9a2b445 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:48:15.745241 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-af31e95f-659d-4839-85ca-776ac9a2b445 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:48:15.746222 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-af31e95f-659d-4839-85ca-776ac9a2b445 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:48:15.746655 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-af31e95f-659d-4839-85ca-776ac9a2b445 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:48:15.758885 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af31e95f-659d-4839-85ca-776ac9a2b445 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:15.759745 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af31e95f-659d-4839-85ca-776ac9a2b445 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:15.760358 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af31e95f-659d-4839-85ca-776ac9a2b445 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:15.762022 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af31e95f-659d-4839-85ca-776ac9a2b445 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:15.762977 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af31e95f-659d-4839-85ca-776ac9a2b445 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:15.763684 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af31e95f-659d-4839-85ca-776ac9a2b445 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:15.796251 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-af31e95f-659d-4839-85ca-776ac9a2b445 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Getting quotas for project bb9a5f2a2b4f460dad3731b0ce6ecebc. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:48:15.806193 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:48:15.808888 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-af31e95f-659d-4839-85ca-776ac9a2b445 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Getting quotas for user 7d6f265811ad4ccf866fb8094782dd38 and project bb9a5f2a2b4f460dad3731b0ce6ecebc. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:48:15.827536 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-af31e95f-659d-4839-85ca-776ac9a2b445 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:48:15.830564 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-af31e95f-659d-4839-85ca-776ac9a2b445 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] [instance: 814d8327-fc0e-4846-a449-598e482d71c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:48:15.895487 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-af31e95f-659d-4839-85ca-776ac9a2b445 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.231068 Sep 08 10:48:15.905813 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1268/2508] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:48:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1242 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:48:15.911934 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-9c97296e-0f7a-4347-b900-f0644f2656d4 req-53a0def6-6284-4aae-92d8-a9816077ad74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e84298ea-b5e7-473b-8597-2b469d09023e", "name": "network-vif-deleted", "tag": "4cd6fa00-47a5-485c-844f-23c7cb5f2d9d"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:48:15.932180 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-9c97296e-0f7a-4347-b900-f0644f2656d4 req-53a0def6-6284-4aae-92d8-a9816077ad74 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:15.933679 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-9c97296e-0f7a-4347-b900-f0644f2656d4 req-53a0def6-6284-4aae-92d8-a9816077ad74 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:15.935303 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-9c97296e-0f7a-4347-b900-f0644f2656d4 req-53a0def6-6284-4aae-92d8-a9816077ad74 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:15.964285 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-9c97296e-0f7a-4347-b900-f0644f2656d4 req-53a0def6-6284-4aae-92d8-a9816077ad74 service nova] Creating event network-vif-deleted:4cd6fa00-47a5-485c-844f-23c7cb5f2d9d for instance e84298ea-b5e7-473b-8597-2b469d09023e on n-h2-850501-12 Sep 08 10:48:15.972957 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-9c97296e-0f7a-4347-b900-f0644f2656d4 req-53a0def6-6284-4aae-92d8-a9816077ad74 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065544 Sep 08 10:48:15.974752 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1269/2509] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:48:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:48:15.984160 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-432c2aff-f2b8-4418-bb06-18608a48211e tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:15.987242 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-432c2aff-f2b8-4418-bb06-18608a48211e tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: 272b4680-9e7e-41dd-afa5-3116aa92665b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:16.024663 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-432c2aff-f2b8-4418-bb06-18608a48211e tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:16.025540 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-432c2aff-f2b8-4418-bb06-18608a48211e tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:16.028742 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-432c2aff-f2b8-4418-bb06-18608a48211e tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:16.031546 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-432c2aff-f2b8-4418-bb06-18608a48211e tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:16.032584 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-432c2aff-f2b8-4418-bb06-18608a48211e tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:16.033226 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-432c2aff-f2b8-4418-bb06-18608a48211e tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:16.122963 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1e35efb6-a777-4006-8c68-355b227a5069 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd975c3a56545fa938752d2b72be872', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e481d7d8204631b72aaef2d6279c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:16.141800 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1e35efb6-a777-4006-8c68-355b227a5069 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] 10.222.0.27 "GET /compute/v2.1/servers/83d65df7-eb49-46ce-815a-54fbb3725661" status: 200 len: 1315 microversion: 2.1 time: 1.031353 Sep 08 10:48:16.150922 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1241/2510] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:15 2022] GET /compute/v2.1/servers/83d65df7-eb49-46ce-815a-54fbb3725661 => generated 1315 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:48:16.156558 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-97c99d86-6bc1-4fc8-ad70-ae47fff52f5f tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:16.170500 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-97c99d86-6bc1-4fc8-ad70-ae47fff52f5f tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] [instance: 814d8327-fc0e-4846-a449-598e482d71c6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:16.453256 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-97c99d86-6bc1-4fc8-ad70-ae47fff52f5f tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6f265811ad4ccf866fb8094782dd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9a5f2a2b4f460dad3731b0ce6ecebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:16.466696 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-97c99d86-6bc1-4fc8-ad70-ae47fff52f5f tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] 10.222.0.27 "GET /compute/v2.1/servers/814d8327-fc0e-4846-a449-598e482d71c6" status: 200 len: 1220 microversion: 2.1 time: 0.313905 Sep 08 10:48:16.469073 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1242/2511] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:16 2022] GET /compute/v2.1/servers/814d8327-fc0e-4846-a449-598e482d71c6 => generated 1220 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:16.480637 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0b9e0167-1e6f-4d48-b9f4-5be53c9ece30 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:16.482158 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0b9e0167-1e6f-4d48-b9f4-5be53c9ece30 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: e84298ea-b5e7-473b-8597-2b469d09023e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:16.534933 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0b9e0167-1e6f-4d48-b9f4-5be53c9ece30 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:16.536550 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0b9e0167-1e6f-4d48-b9f4-5be53c9ece30 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:16.539529 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0b9e0167-1e6f-4d48-b9f4-5be53c9ece30 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:16.544401 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0b9e0167-1e6f-4d48-b9f4-5be53c9ece30 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:16.548239 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0b9e0167-1e6f-4d48-b9f4-5be53c9ece30 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:16.550832 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0b9e0167-1e6f-4d48-b9f4-5be53c9ece30 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:16.578857 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-432c2aff-f2b8-4418-bb06-18608a48211e tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c291cbe955b4ee5abc98132dda0255e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f9a24cad014d7f827e8f3236dd5bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:16.590249 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-432c2aff-f2b8-4418-bb06-18608a48211e tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/272b4680-9e7e-41dd-afa5-3116aa92665b" status: 200 len: 1366 microversion: 2.1 time: 0.612942 Sep 08 10:48:16.591520 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1270/2512] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:15 2022] GET /compute/v2.1/servers/272b4680-9e7e-41dd-afa5-3116aa92665b => generated 1366 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:16.598523 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-0b9e0167-1e6f-4d48-b9f4-5be53c9ece30 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] HTTP exception thrown: Instance e84298ea-b5e7-473b-8597-2b469d09023e could not be found. Sep 08 10:48:16.600861 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0b9e0167-1e6f-4d48-b9f4-5be53c9ece30 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Request method failure captured: Sep 08 10:48:16.600861 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/e84298ea-b5e7-473b-8597-2b469d09023e HTTP/1.1 Sep 08 10:48:16.600861 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:48:16.600861 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:48:16.600861 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:48:16.600861 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:48:16.600861 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:48:16.600861 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:48:16.600861 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:48:16.600861 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:48:16.600861 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGce62zDaM5lK2luTZl9BOLMK0pc_-xKbcmjRS_RkIBRZFFByYFOX29rDKNzb-L9mtn_MAYtDYWpNXjR0dCrd1CjlTMFVc7r1o5XcWzpGXaSZivOMeHxuMBcso5JKK7QW9nLFbnuS4n9lRSqYoy521PhzBqJN1Lhkb_6A_JTVZ9UGgBI Sep 08 10:48:16.600861 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:48:16.600861 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:48:16.600861 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:48:16.600861 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:48:16.600861 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:48:16.600861 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:48:16.600861 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: eb93f8524768458a974c348b981921d5 Sep 08 10:48:16.600861 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServersAdminTestJSON-318045889 Sep 08 10:48:16.600861 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:48:16.600861 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:48:16.600861 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/eb93f8524768458a974c348b981921d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eb93f8524768458a974c348b981921d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_eb93f8524768458a974c348b981921d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eb93f8524768458a974c348b981921d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:48:16.600861 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServersAdminTestJSON-318045889 Sep 08 10:48:16.600861 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: eb93f8524768458a974c348b981921d5 Sep 08 10:48:16.600861 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServersAdminTestJSON-318045889 Sep 08 10:48:16.600861 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServersAdminTestJSON-318045889-project Sep 08 10:48:16.600861 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:48:16.600861 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:48:16.600861 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: c1c083657f0a4cebbc0804cd5d5ea4ad Sep 08 10:48:16.600861 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServersAdminTestJSON-318045889-project Sep 08 10:48:16.600861 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:48:16.600861 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance e84298ea-b5e7-473b-8597-2b469d09023e could not be found. Sep 08 10:48:16.600861 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': 'e84298ea-b5e7-473b-8597-2b469d09023e'} Sep 08 10:48:16.600861 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:48:16.600861 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:48:16.600861 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:48:16.600861 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:48:16.600861 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:48:16.600861 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:48:16.600861 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:48:16.600861 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:48:16.600861 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:48:16.600861 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:48:16.600861 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e84298ea-b5e7-473b-8597-2b469d09023e could not be found. Sep 08 10:48:16.600861 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:48:16.600861 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:48:16.600861 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:48:16.600861 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:48:16.600861 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:48:16.600861 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:48:16.600861 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:48:16.600861 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:48:16.600861 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:48:16.600861 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:48:16.600861 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:48:16.600861 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:48:16.600861 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:48:16.600861 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:48:16.600861 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:48:16.600861 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:48:16.600861 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e84298ea-b5e7-473b-8597-2b469d09023e could not be found. Sep 08 10:48:16.600861 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:48:16.600861 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:48:16.600861 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:48:16.604691 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:48:16.604691 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:48:16.604691 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:48:16.604691 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:48:16.604691 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:48:16.604691 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e84298ea-b5e7-473b-8597-2b469d09023e could not be found. Sep 08 10:48:16.604691 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:48:16.608506 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0b9e0167-1e6f-4d48-b9f4-5be53c9ece30 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Returning 404 to user: Instance e84298ea-b5e7-473b-8597-2b469d09023e could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:48:16.610195 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0b9e0167-1e6f-4d48-b9f4-5be53c9ece30 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/e84298ea-b5e7-473b-8597-2b469d09023e" status: 404 len: 111 microversion: 2.1 time: 0.139515 Sep 08 10:48:16.611192 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1243/2513] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:16 2022] GET /compute/v2.1/servers/e84298ea-b5e7-473b-8597-2b469d09023e => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:48:16.626749 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0f78d3f2-734b-48a1-8ef3-55a066e5c62b tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:16.627716 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0f78d3f2-734b-48a1-8ef3-55a066e5c62b tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:16.639195 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f78d3f2-734b-48a1-8ef3-55a066e5c62b tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:16.640149 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f78d3f2-734b-48a1-8ef3-55a066e5c62b tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:16.641132 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f78d3f2-734b-48a1-8ef3-55a066e5c62b tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:16.642499 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f78d3f2-734b-48a1-8ef3-55a066e5c62b tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:16.644092 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f78d3f2-734b-48a1-8ef3-55a066e5c62b tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:16.646207 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f78d3f2-734b-48a1-8ef3-55a066e5c62b tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:16.709618 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0f78d3f2-734b-48a1-8ef3-55a066e5c62b tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:48:16.852514 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0f78d3f2-734b-48a1-8ef3-55a066e5c62b tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447" status: 204 len: 0 microversion: 2.1 time: 0.234914 Sep 08 10:48:16.856812 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1271/2514] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:48:16 2022] DELETE /compute/v2.1/servers/e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:48:16.863416 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8e91cec1-e884-4d28-96f1-0c42c3909f99 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:16.864418 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8e91cec1-e884-4d28-96f1-0c42c3909f99 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:16.879685 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8e91cec1-e884-4d28-96f1-0c42c3909f99 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:16.881722 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8e91cec1-e884-4d28-96f1-0c42c3909f99 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:16.882763 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8e91cec1-e884-4d28-96f1-0c42c3909f99 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:16.883777 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8e91cec1-e884-4d28-96f1-0c42c3909f99 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:16.884354 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8e91cec1-e884-4d28-96f1-0c42c3909f99 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:16.885051 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8e91cec1-e884-4d28-96f1-0c42c3909f99 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:17.186530 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-64ae1dab-350a-4571-acdf-04989f70bf12 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:17.187753 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-64ae1dab-350a-4571-acdf-04989f70bf12 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] [instance: 83d65df7-eb49-46ce-815a-54fbb3725661] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:17.203975 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64ae1dab-350a-4571-acdf-04989f70bf12 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:17.205360 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64ae1dab-350a-4571-acdf-04989f70bf12 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:17.205827 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64ae1dab-350a-4571-acdf-04989f70bf12 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:17.206571 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64ae1dab-350a-4571-acdf-04989f70bf12 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:17.207035 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64ae1dab-350a-4571-acdf-04989f70bf12 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:17.210026 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64ae1dab-350a-4571-acdf-04989f70bf12 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:17.286782 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8e91cec1-e884-4d28-96f1-0c42c3909f99 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:17.297876 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8e91cec1-e884-4d28-96f1-0c42c3909f99 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447" status: 200 len: 1469 microversion: 2.1 time: 0.439601 Sep 08 10:48:17.319645 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1244/2515] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:16 2022] GET /compute/v2.1/servers/e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447 => generated 1469 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:17.389308 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e297bd2e-af3e-4d75-b983-d92b1b5310c3 tempest-VolumesAdminNegativeTest-59402182 tempest-VolumesAdminNegativeTest-59402182-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "8d10f556-b928-4245-85f8-32d42441369f"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:48:17.393195 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e297bd2e-af3e-4d75-b983-d92b1b5310c3 tempest-VolumesAdminNegativeTest-59402182 tempest-VolumesAdminNegativeTest-59402182-project-admin] [instance: b7c9f2aa-8e8c-4200-89ee-a107ea59256a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:17.404329 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e297bd2e-af3e-4d75-b983-d92b1b5310c3 tempest-VolumesAdminNegativeTest-59402182 tempest-VolumesAdminNegativeTest-59402182-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:17.405284 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e297bd2e-af3e-4d75-b983-d92b1b5310c3 tempest-VolumesAdminNegativeTest-59402182 tempest-VolumesAdminNegativeTest-59402182-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:17.406034 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e297bd2e-af3e-4d75-b983-d92b1b5310c3 tempest-VolumesAdminNegativeTest-59402182 tempest-VolumesAdminNegativeTest-59402182-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:17.407012 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e297bd2e-af3e-4d75-b983-d92b1b5310c3 tempest-VolumesAdminNegativeTest-59402182 tempest-VolumesAdminNegativeTest-59402182-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:17.407633 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e297bd2e-af3e-4d75-b983-d92b1b5310c3 tempest-VolumesAdminNegativeTest-59402182 tempest-VolumesAdminNegativeTest-59402182-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:17.408400 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e297bd2e-af3e-4d75-b983-d92b1b5310c3 tempest-VolumesAdminNegativeTest-59402182 tempest-VolumesAdminNegativeTest-59402182-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:17.512974 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-e297bd2e-af3e-4d75-b983-d92b1b5310c3 tempest-VolumesAdminNegativeTest-59402182 tempest-VolumesAdminNegativeTest-59402182-project-admin] HTTP exception thrown: Volume c7a59c60-ba4b-49f0-b454-c53c993f7386 could not be found. Sep 08 10:48:17.515061 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e297bd2e-af3e-4d75-b983-d92b1b5310c3 tempest-VolumesAdminNegativeTest-59402182 tempest-VolumesAdminNegativeTest-59402182-project-admin] Request method failure captured: Sep 08 10:48:17.515061 n-d-850501-12 devstack@n-api.service[128861]: request: PUT /compute/v2.1/servers/b7c9f2aa-8e8c-4200-89ee-a107ea59256a/os-volume_attachments/c7a59c60-ba4b-49f0-b454-c53c993f7386 HTTP/1.1 Sep 08 10:48:17.515061 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:48:17.515061 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:48:17.515061 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:48:17.515061 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 74 Sep 08 10:48:17.515061 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:48:17.515061 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:48:17.515061 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:48:17.515061 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:48:17.515061 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcfbFKlTCwWHFFOPmAUVuB82aWk1Htj_6lKieD2Sy7DL2r5XmOnqg5vW_y8nWtU3tRSX4w9iie5mdl0tZ3_CcCwv7gN58HTXqBZyM1qqfJbbLyEPnyuKmYuE6npubLeP0__n-4IcYql9yG3RKzRCrp5Wl556SZBc3tGFaCPZzt5HBbw Sep 08 10:48:17.515061 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:48:17.515061 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:48:17.515061 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:48:17.515061 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:48:17.515061 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:48:17.515061 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:48:17.515061 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: f470cdc994754253aac92469aec47c71 Sep 08 10:48:17.515061 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-VolumesAdminNegativeTest-59402182 Sep 08 10:48:17.515061 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,admin,member Sep 08 10:48:17.515061 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,admin,member Sep 08 10:48:17.515061 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f470cdc994754253aac92469aec47c71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f470cdc994754253aac92469aec47c71"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f470cdc994754253aac92469aec47c71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f470cdc994754253aac92469aec47c71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:48:17.515061 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-VolumesAdminNegativeTest-59402182 Sep 08 10:48:17.515061 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: f470cdc994754253aac92469aec47c71 Sep 08 10:48:17.515061 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-59402182 Sep 08 10:48:17.515061 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-VolumesAdminNegativeTest-59402182-project-admin Sep 08 10:48:17.515061 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:48:17.515061 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:48:17.515061 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 3904f480b7de47c68f779bebbff9889d Sep 08 10:48:17.515061 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-VolumesAdminNegativeTest-59402182-project-admin Sep 08 10:48:17.515061 n-d-850501-12 devstack@n-api.service[128861]: Sep 08 10:48:17.515061 n-d-850501-12 devstack@n-api.service[128861]: {"volumeAttachment": {"volumeId": "8d10f556-b928-4245-85f8-32d42441369f"}} Sep 08 10:48:17.515061 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:48:17.515061 n-d-850501-12 devstack@n-api.service[128861]: exception: Volume c7a59c60-ba4b-49f0-b454-c53c993f7386 could not be found. Sep 08 10:48:17.515061 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'server_id': 'b7c9f2aa-8e8c-4200-89ee-a107ea59256a', 'id': 'c7a59c60-ba4b-49f0-b454-c53c993f7386', 'body': {'volumeAttachment': {'volumeId': '8d10f556-b928-4245-85f8-32d42441369f'}}} Sep 08 10:48:17.515061 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:48:17.515061 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:48:17.515061 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 10:48:17.515061 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 10:48:17.515061 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 10:48:17.515061 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 10:48:17.515061 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 10:48:17.515061 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 10:48:17.515061 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 10:48:17.515061 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 10:48:17.515061 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 10:48:17.515061 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 10:48:17.515061 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 10:48:17.515061 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 10:48:17.515061 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 10:48:17.515061 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 10:48:17.515061 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c7a59c60-ba4b-49f0-b454-c53c993f7386 could not be found. (HTTP 404) (Request-ID: req-59d5c396-7d14-4344-be91-4bde16622d34) Sep 08 10:48:17.515061 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:48:17.515061 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:48:17.515061 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:48:17.515061 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:48:17.515061 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Sep 08 10:48:17.515061 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Sep 08 10:48:17.515061 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 08 10:48:17.515061 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 08 10:48:17.515061 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 08 10:48:17.530223 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 08 10:48:17.530223 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 08 10:48:17.530223 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 08 10:48:17.530223 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 10:48:17.530223 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 10:48:17.530223 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 10:48:17.530223 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 10:48:17.530223 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 10:48:17.530223 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 10:48:17.530223 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 10:48:17.530223 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 10:48:17.530223 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 10:48:17.530223 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 10:48:17.530223 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 10:48:17.530223 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 10:48:17.530223 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 10:48:17.530223 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 10:48:17.530223 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c7a59c60-ba4b-49f0-b454-c53c993f7386 could not be found. Sep 08 10:48:17.530223 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:48:17.530223 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:48:17.530223 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:48:17.530223 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:48:17.530223 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:48:17.530223 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:48:17.530223 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:48:17.530223 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:48:17.530223 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:48:17.530223 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:48:17.530223 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:48:17.530223 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:48:17.530223 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:48:17.530223 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:48:17.530223 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Sep 08 10:48:17.530223 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Sep 08 10:48:17.530223 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Sep 08 10:48:17.530223 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:48:17.530223 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c7a59c60-ba4b-49f0-b454-c53c993f7386 could not be found. Sep 08 10:48:17.530223 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:48:17.530223 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:48:17.530223 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:48:17.530223 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:48:17.530223 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:48:17.530223 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:48:17.530223 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:48:17.530223 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:48:17.530223 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c7a59c60-ba4b-49f0-b454-c53c993f7386 could not be found. Sep 08 10:48:17.530223 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:48:17.530223 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e297bd2e-af3e-4d75-b983-d92b1b5310c3 tempest-VolumesAdminNegativeTest-59402182 tempest-VolumesAdminNegativeTest-59402182-project-admin] Returning 404 to user: Volume c7a59c60-ba4b-49f0-b454-c53c993f7386 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:48:17.530223 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e297bd2e-af3e-4d75-b983-d92b1b5310c3 tempest-VolumesAdminNegativeTest-59402182 tempest-VolumesAdminNegativeTest-59402182-project-admin] 10.222.0.27 "PUT /compute/v2.1/servers/b7c9f2aa-8e8c-4200-89ee-a107ea59256a/os-volume_attachments/c7a59c60-ba4b-49f0-b454-c53c993f7386" status: 404 len: 109 microversion: 2.1 time: 0.134623 Sep 08 10:48:17.530223 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1245/2516] 10.222.0.27 () {60 vars in 1433 bytes} [Thu Sep 8 10:48:17 2022] PUT /compute/v2.1/servers/b7c9f2aa-8e8c-4200-89ee-a107ea59256a/os-volume_attachments/c7a59c60-ba4b-49f0-b454-c53c993f7386 => generated 109 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 10:48:17.540229 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f9c4516e-6a9c-4372-944b-48b86baac569 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:17.540229 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f9c4516e-6a9c-4372-944b-48b86baac569 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] [instance: 814d8327-fc0e-4846-a449-598e482d71c6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:17.555945 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f9c4516e-6a9c-4372-944b-48b86baac569 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:17.556791 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f9c4516e-6a9c-4372-944b-48b86baac569 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:17.557706 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f9c4516e-6a9c-4372-944b-48b86baac569 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:17.559156 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f9c4516e-6a9c-4372-944b-48b86baac569 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:17.559683 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f9c4516e-6a9c-4372-944b-48b86baac569 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:17.560122 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f9c4516e-6a9c-4372-944b-48b86baac569 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:17.702948 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-64ae1dab-350a-4571-acdf-04989f70bf12 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd975c3a56545fa938752d2b72be872', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e481d7d8204631b72aaef2d6279c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:17.712108 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-64ae1dab-350a-4571-acdf-04989f70bf12 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] 10.222.0.27 "GET /compute/v2.1/servers/83d65df7-eb49-46ce-815a-54fbb3725661" status: 200 len: 1315 microversion: 2.1 time: 0.536536 Sep 08 10:48:17.717318 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1272/2517] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:17 2022] GET /compute/v2.1/servers/83d65df7-eb49-46ce-815a-54fbb3725661 => generated 1315 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:48:17.757477 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5577fe03-7494-4c5f-a095-6b05a5995d2f tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:17.758625 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5577fe03-7494-4c5f-a095-6b05a5995d2f tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: 272b4680-9e7e-41dd-afa5-3116aa92665b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:17.793525 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5577fe03-7494-4c5f-a095-6b05a5995d2f tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:17.796312 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5577fe03-7494-4c5f-a095-6b05a5995d2f tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:17.799175 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5577fe03-7494-4c5f-a095-6b05a5995d2f tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:17.802438 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5577fe03-7494-4c5f-a095-6b05a5995d2f tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:17.804650 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5577fe03-7494-4c5f-a095-6b05a5995d2f tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:17.807058 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5577fe03-7494-4c5f-a095-6b05a5995d2f tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:18.013885 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f9c4516e-6a9c-4372-944b-48b86baac569 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6f265811ad4ccf866fb8094782dd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9a5f2a2b4f460dad3731b0ce6ecebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:18.025810 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f9c4516e-6a9c-4372-944b-48b86baac569 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] 10.222.0.27 "GET /compute/v2.1/servers/814d8327-fc0e-4846-a449-598e482d71c6" status: 200 len: 1272 microversion: 2.1 time: 0.502303 Sep 08 10:48:18.031872 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1246/2518] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:17 2022] GET /compute/v2.1/servers/814d8327-fc0e-4846-a449-598e482d71c6 => generated 1272 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:18.335363 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-183e4ae2-b3a4-4726-a3af-ea350ab6a37b tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:18.337139 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-183e4ae2-b3a4-4726-a3af-ea350ab6a37b tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:18.357104 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-183e4ae2-b3a4-4726-a3af-ea350ab6a37b tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:18.362255 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-183e4ae2-b3a4-4726-a3af-ea350ab6a37b tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:18.363163 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-183e4ae2-b3a4-4726-a3af-ea350ab6a37b tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:18.367912 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-183e4ae2-b3a4-4726-a3af-ea350ab6a37b tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:18.372227 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-183e4ae2-b3a4-4726-a3af-ea350ab6a37b tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:18.373324 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-183e4ae2-b3a4-4726-a3af-ea350ab6a37b tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:18.570631 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5577fe03-7494-4c5f-a095-6b05a5995d2f tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c291cbe955b4ee5abc98132dda0255e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f9a24cad014d7f827e8f3236dd5bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:18.587340 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5577fe03-7494-4c5f-a095-6b05a5995d2f tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/272b4680-9e7e-41dd-afa5-3116aa92665b" status: 200 len: 1366 microversion: 2.1 time: 0.867964 Sep 08 10:48:18.599277 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1273/2519] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:17 2022] GET /compute/v2.1/servers/272b4680-9e7e-41dd-afa5-3116aa92665b => generated 1366 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:18.746588 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fbfa664f-f710-45f1-8553-d87c056b4a44 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:18.748221 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fbfa664f-f710-45f1-8553-d87c056b4a44 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] [instance: 83d65df7-eb49-46ce-815a-54fbb3725661] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:18.769508 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fbfa664f-f710-45f1-8553-d87c056b4a44 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:18.784291 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fbfa664f-f710-45f1-8553-d87c056b4a44 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:18.786721 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fbfa664f-f710-45f1-8553-d87c056b4a44 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:18.787511 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fbfa664f-f710-45f1-8553-d87c056b4a44 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:18.788030 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fbfa664f-f710-45f1-8553-d87c056b4a44 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:18.788523 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fbfa664f-f710-45f1-8553-d87c056b4a44 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:19.286296 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-183e4ae2-b3a4-4726-a3af-ea350ab6a37b tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:19.300836 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-183e4ae2-b3a4-4726-a3af-ea350ab6a37b tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447" status: 200 len: 1469 microversion: 2.1 time: 0.970006 Sep 08 10:48:19.306089 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1247/2520] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:18 2022] GET /compute/v2.1/servers/e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447 => generated 1469 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:19.315806 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8caff5a4-0707-4433-8dfe-78b5414f0475 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:19.319771 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8caff5a4-0707-4433-8dfe-78b5414f0475 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] [instance: 814d8327-fc0e-4846-a449-598e482d71c6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:19.335289 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8caff5a4-0707-4433-8dfe-78b5414f0475 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:19.337604 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8caff5a4-0707-4433-8dfe-78b5414f0475 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:19.339690 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8caff5a4-0707-4433-8dfe-78b5414f0475 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:19.340521 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8caff5a4-0707-4433-8dfe-78b5414f0475 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:19.343527 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8caff5a4-0707-4433-8dfe-78b5414f0475 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:19.344010 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8caff5a4-0707-4433-8dfe-78b5414f0475 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:19.436506 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fbfa664f-f710-45f1-8553-d87c056b4a44 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd975c3a56545fa938752d2b72be872', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e481d7d8204631b72aaef2d6279c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:19.449648 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fbfa664f-f710-45f1-8553-d87c056b4a44 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] 10.222.0.27 "GET /compute/v2.1/servers/83d65df7-eb49-46ce-815a-54fbb3725661" status: 200 len: 1315 microversion: 2.1 time: 0.709476 Sep 08 10:48:19.451247 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1274/2521] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:18 2022] GET /compute/v2.1/servers/83d65df7-eb49-46ce-815a-54fbb3725661 => generated 1315 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:48:19.456438 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-de5bb7cc-b35c-4bd7-9370-4e3ed3def432 req-e697c4dd-f9ce-483e-93ca-fc31b7020a7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "272b4680-9e7e-41dd-afa5-3116aa92665b", "tag": "722660b6-51c7-4a26-9625-53b4b04f69d8"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:48:19.477930 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-de5bb7cc-b35c-4bd7-9370-4e3ed3def432 req-e697c4dd-f9ce-483e-93ca-fc31b7020a7f service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:19.478960 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-de5bb7cc-b35c-4bd7-9370-4e3ed3def432 req-e697c4dd-f9ce-483e-93ca-fc31b7020a7f service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:19.479619 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-de5bb7cc-b35c-4bd7-9370-4e3ed3def432 req-e697c4dd-f9ce-483e-93ca-fc31b7020a7f service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:19.500678 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-de5bb7cc-b35c-4bd7-9370-4e3ed3def432 req-e697c4dd-f9ce-483e-93ca-fc31b7020a7f service nova] Creating event network-changed:722660b6-51c7-4a26-9625-53b4b04f69d8 for instance 272b4680-9e7e-41dd-afa5-3116aa92665b on n-h2-850501-12 Sep 08 10:48:19.512660 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-de5bb7cc-b35c-4bd7-9370-4e3ed3def432 req-e697c4dd-f9ce-483e-93ca-fc31b7020a7f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059712 Sep 08 10:48:19.516509 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1275/2522] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:48:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:48:19.556372 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8caff5a4-0707-4433-8dfe-78b5414f0475 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6f265811ad4ccf866fb8094782dd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9a5f2a2b4f460dad3731b0ce6ecebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:19.574813 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8caff5a4-0707-4433-8dfe-78b5414f0475 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] 10.222.0.27 "GET /compute/v2.1/servers/814d8327-fc0e-4846-a449-598e482d71c6" status: 200 len: 1278 microversion: 2.1 time: 0.267021 Sep 08 10:48:19.578351 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1248/2523] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:19 2022] GET /compute/v2.1/servers/814d8327-fc0e-4846-a449-598e482d71c6 => generated 1278 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:19.625322 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3a8550b4-4a79-4d8e-bbc9-3ad573e4c3e7 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:19.642175 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3a8550b4-4a79-4d8e-bbc9-3ad573e4c3e7 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: 272b4680-9e7e-41dd-afa5-3116aa92665b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:19.671156 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a8550b4-4a79-4d8e-bbc9-3ad573e4c3e7 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:19.672243 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a8550b4-4a79-4d8e-bbc9-3ad573e4c3e7 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:19.673681 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a8550b4-4a79-4d8e-bbc9-3ad573e4c3e7 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:19.675513 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a8550b4-4a79-4d8e-bbc9-3ad573e4c3e7 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:19.676711 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a8550b4-4a79-4d8e-bbc9-3ad573e4c3e7 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:19.677671 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a8550b4-4a79-4d8e-bbc9-3ad573e4c3e7 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:20.047541 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3a8550b4-4a79-4d8e-bbc9-3ad573e4c3e7 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c291cbe955b4ee5abc98132dda0255e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f9a24cad014d7f827e8f3236dd5bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:20.079618 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3a8550b4-4a79-4d8e-bbc9-3ad573e4c3e7 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/272b4680-9e7e-41dd-afa5-3116aa92665b" status: 200 len: 1366 microversion: 2.1 time: 0.463365 Sep 08 10:48:20.091628 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1276/2524] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:19 2022] GET /compute/v2.1/servers/272b4680-9e7e-41dd-afa5-3116aa92665b => generated 1366 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:20.327590 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-47e6fb8b-c950-42c1-a583-faf7de38729b tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:20.328457 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-47e6fb8b-c950-42c1-a583-faf7de38729b tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:20.335732 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-47e6fb8b-c950-42c1-a583-faf7de38729b tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:20.337171 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-47e6fb8b-c950-42c1-a583-faf7de38729b tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:20.337950 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-47e6fb8b-c950-42c1-a583-faf7de38729b tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:20.339637 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-47e6fb8b-c950-42c1-a583-faf7de38729b tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:20.341058 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-47e6fb8b-c950-42c1-a583-faf7de38729b tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:20.341887 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-47e6fb8b-c950-42c1-a583-faf7de38729b tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:20.478709 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4c2c1c75-72d2-4f89-a36c-760b9aaad00b tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:20.480170 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4c2c1c75-72d2-4f89-a36c-760b9aaad00b tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] [instance: 83d65df7-eb49-46ce-815a-54fbb3725661] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:20.492963 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c2c1c75-72d2-4f89-a36c-760b9aaad00b tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:20.494701 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c2c1c75-72d2-4f89-a36c-760b9aaad00b tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:20.496120 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c2c1c75-72d2-4f89-a36c-760b9aaad00b tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:20.497905 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c2c1c75-72d2-4f89-a36c-760b9aaad00b tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:20.498651 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c2c1c75-72d2-4f89-a36c-760b9aaad00b tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:20.499543 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c2c1c75-72d2-4f89-a36c-760b9aaad00b tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:21.040428 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-47e6fb8b-c950-42c1-a583-faf7de38729b tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:21.050552 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-47e6fb8b-c950-42c1-a583-faf7de38729b tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447" status: 200 len: 1469 microversion: 2.1 time: 0.727533 Sep 08 10:48:21.070945 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1249/2525] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:20 2022] GET /compute/v2.1/servers/e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447 => generated 1469 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:21.078142 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e0a19e87-a1f4-4954-bd7b-792f0ba93fb1 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:21.083472 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e0a19e87-a1f4-4954-bd7b-792f0ba93fb1 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] [instance: 814d8327-fc0e-4846-a449-598e482d71c6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:21.093855 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e0a19e87-a1f4-4954-bd7b-792f0ba93fb1 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:21.095210 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e0a19e87-a1f4-4954-bd7b-792f0ba93fb1 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:21.095865 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e0a19e87-a1f4-4954-bd7b-792f0ba93fb1 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:21.096866 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e0a19e87-a1f4-4954-bd7b-792f0ba93fb1 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:21.097599 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e0a19e87-a1f4-4954-bd7b-792f0ba93fb1 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:21.098256 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e0a19e87-a1f4-4954-bd7b-792f0ba93fb1 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:21.146358 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=4 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:48:21.269680 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4c2c1c75-72d2-4f89-a36c-760b9aaad00b tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd975c3a56545fa938752d2b72be872', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e481d7d8204631b72aaef2d6279c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:21.278816 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4c2c1c75-72d2-4f89-a36c-760b9aaad00b tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] 10.222.0.27 "GET /compute/v2.1/servers/83d65df7-eb49-46ce-815a-54fbb3725661" status: 200 len: 1315 microversion: 2.1 time: 0.804231 Sep 08 10:48:21.280126 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1277/2526] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:20 2022] GET /compute/v2.1/servers/83d65df7-eb49-46ce-815a-54fbb3725661 => generated 1315 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:48:21.285494 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a78e9c55-3967-41b1-863b-19c464697509 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:21.286285 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a78e9c55-3967-41b1-863b-19c464697509 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: 272b4680-9e7e-41dd-afa5-3116aa92665b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:21.303251 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a78e9c55-3967-41b1-863b-19c464697509 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:21.304317 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a78e9c55-3967-41b1-863b-19c464697509 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:21.305274 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a78e9c55-3967-41b1-863b-19c464697509 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:21.306791 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a78e9c55-3967-41b1-863b-19c464697509 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:21.308590 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a78e9c55-3967-41b1-863b-19c464697509 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:21.309633 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a78e9c55-3967-41b1-863b-19c464697509 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:21.407598 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e0a19e87-a1f4-4954-bd7b-792f0ba93fb1 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6f265811ad4ccf866fb8094782dd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9a5f2a2b4f460dad3731b0ce6ecebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:21.424395 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e0a19e87-a1f4-4954-bd7b-792f0ba93fb1 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] 10.222.0.27 "GET /compute/v2.1/servers/814d8327-fc0e-4846-a449-598e482d71c6" status: 200 len: 1278 microversion: 2.1 time: 0.344023 Sep 08 10:48:21.425270 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1250/2527] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:21 2022] GET /compute/v2.1/servers/814d8327-fc0e-4846-a449-598e482d71c6 => generated 1278 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:21.758839 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a78e9c55-3967-41b1-863b-19c464697509 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c291cbe955b4ee5abc98132dda0255e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f9a24cad014d7f827e8f3236dd5bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:21.786184 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a78e9c55-3967-41b1-863b-19c464697509 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/272b4680-9e7e-41dd-afa5-3116aa92665b" status: 200 len: 1366 microversion: 2.1 time: 0.500324 Sep 08 10:48:21.787042 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1278/2528] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:21 2022] GET /compute/v2.1/servers/272b4680-9e7e-41dd-afa5-3116aa92665b => generated 1366 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:22.079058 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-06eb99f2-3207-415d-b7cc-d1b486ee937a tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:22.079693 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-06eb99f2-3207-415d-b7cc-d1b486ee937a tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:22.093500 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06eb99f2-3207-415d-b7cc-d1b486ee937a tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:22.094005 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06eb99f2-3207-415d-b7cc-d1b486ee937a tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:22.094436 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06eb99f2-3207-415d-b7cc-d1b486ee937a tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:22.095362 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06eb99f2-3207-415d-b7cc-d1b486ee937a tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:22.100937 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06eb99f2-3207-415d-b7cc-d1b486ee937a tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:22.101664 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06eb99f2-3207-415d-b7cc-d1b486ee937a tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:22.292226 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f1190e3a-e78e-47bb-b304-8a5df1835d46 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:22.293089 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f1190e3a-e78e-47bb-b304-8a5df1835d46 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] [instance: b7c9f2aa-8e8c-4200-89ee-a107ea59256a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:22.303768 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1190e3a-e78e-47bb-b304-8a5df1835d46 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:22.308133 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1190e3a-e78e-47bb-b304-8a5df1835d46 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:22.308913 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1190e3a-e78e-47bb-b304-8a5df1835d46 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:22.309914 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1190e3a-e78e-47bb-b304-8a5df1835d46 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:22.310765 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1190e3a-e78e-47bb-b304-8a5df1835d46 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:22.313426 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1190e3a-e78e-47bb-b304-8a5df1835d46 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:22.372704 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f1190e3a-e78e-47bb-b304-8a5df1835d46 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] [instance: b7c9f2aa-8e8c-4200-89ee-a107ea59256a] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:48:22.474422 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-06eb99f2-3207-415d-b7cc-d1b486ee937a tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:22.497340 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-06eb99f2-3207-415d-b7cc-d1b486ee937a tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447" status: 200 len: 1427 microversion: 2.1 time: 0.421083 Sep 08 10:48:22.498950 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1251/2529] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:22 2022] GET /compute/v2.1/servers/e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447 => generated 1427 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:22.514855 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-504e4088-da6a-49a5-87eb-e96731166b2c tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:22.516314 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-504e4088-da6a-49a5-87eb-e96731166b2c tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] [instance: 83d65df7-eb49-46ce-815a-54fbb3725661] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:22.536858 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-504e4088-da6a-49a5-87eb-e96731166b2c tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:22.538612 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-504e4088-da6a-49a5-87eb-e96731166b2c tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:22.540615 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-504e4088-da6a-49a5-87eb-e96731166b2c tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:22.545050 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-504e4088-da6a-49a5-87eb-e96731166b2c tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:22.562105 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-504e4088-da6a-49a5-87eb-e96731166b2c tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:22.565786 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-504e4088-da6a-49a5-87eb-e96731166b2c tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:22.611671 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f1190e3a-e78e-47bb-b304-8a5df1835d46 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b7c9f2aa-8e8c-4200-89ee-a107ea59256a" status: 204 len: 0 microversion: 2.1 time: 0.322346 Sep 08 10:48:22.614020 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1279/2530] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:48:22 2022] DELETE /compute/v2.1/servers/b7c9f2aa-8e8c-4200-89ee-a107ea59256a => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:48:22.634376 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-07300733-03c9-4529-a20d-98112ec7b2a1 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:22.636377 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-07300733-03c9-4529-a20d-98112ec7b2a1 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] [instance: 814d8327-fc0e-4846-a449-598e482d71c6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:22.654089 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-07300733-03c9-4529-a20d-98112ec7b2a1 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:22.654829 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-07300733-03c9-4529-a20d-98112ec7b2a1 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:22.655420 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-07300733-03c9-4529-a20d-98112ec7b2a1 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:22.656338 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-07300733-03c9-4529-a20d-98112ec7b2a1 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:22.657105 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-07300733-03c9-4529-a20d-98112ec7b2a1 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:22.657698 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-07300733-03c9-4529-a20d-98112ec7b2a1 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:23.181135 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-504e4088-da6a-49a5-87eb-e96731166b2c tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd975c3a56545fa938752d2b72be872', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e481d7d8204631b72aaef2d6279c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:23.194169 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-504e4088-da6a-49a5-87eb-e96731166b2c tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] 10.222.0.27 "GET /compute/v2.1/servers/83d65df7-eb49-46ce-815a-54fbb3725661" status: 200 len: 1315 microversion: 2.1 time: 0.692602 Sep 08 10:48:23.196578 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1252/2531] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:22 2022] GET /compute/v2.1/servers/83d65df7-eb49-46ce-815a-54fbb3725661 => generated 1315 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:23.214648 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d4821025-a87c-4340-850a-57229fb7af29 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:23.215445 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d4821025-a87c-4340-850a-57229fb7af29 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] [instance: b7c9f2aa-8e8c-4200-89ee-a107ea59256a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:23.229490 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d4821025-a87c-4340-850a-57229fb7af29 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:23.231247 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d4821025-a87c-4340-850a-57229fb7af29 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:23.231715 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d4821025-a87c-4340-850a-57229fb7af29 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:23.233900 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d4821025-a87c-4340-850a-57229fb7af29 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:23.235451 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d4821025-a87c-4340-850a-57229fb7af29 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:23.236327 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d4821025-a87c-4340-850a-57229fb7af29 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:23.657576 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-07300733-03c9-4529-a20d-98112ec7b2a1 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6f265811ad4ccf866fb8094782dd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9a5f2a2b4f460dad3731b0ce6ecebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:23.673544 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-07300733-03c9-4529-a20d-98112ec7b2a1 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] 10.222.0.27 "GET /compute/v2.1/servers/814d8327-fc0e-4846-a449-598e482d71c6" status: 200 len: 1320 microversion: 2.1 time: 1.055670 Sep 08 10:48:23.674276 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1280/2532] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:22 2022] GET /compute/v2.1/servers/814d8327-fc0e-4846-a449-598e482d71c6 => generated 1320 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:23.694851 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-108157d7-aff8-4468-98c2-92a829835277 req-6c3a8161-28c8-4311-9294-17b29508b915 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447", "name": "network-vif-deleted", "tag": "41bf8ea0-de68-4df3-97ef-2656e5d1ec8b"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:48:23.718285 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-108157d7-aff8-4468-98c2-92a829835277 req-6c3a8161-28c8-4311-9294-17b29508b915 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:23.720975 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-108157d7-aff8-4468-98c2-92a829835277 req-6c3a8161-28c8-4311-9294-17b29508b915 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:23.721686 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-108157d7-aff8-4468-98c2-92a829835277 req-6c3a8161-28c8-4311-9294-17b29508b915 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:23.754114 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-108157d7-aff8-4468-98c2-92a829835277 req-6c3a8161-28c8-4311-9294-17b29508b915 service nova] Creating event network-vif-deleted:41bf8ea0-de68-4df3-97ef-2656e5d1ec8b for instance e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447 on n-h1-850501-12 Sep 08 10:48:23.768263 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-108157d7-aff8-4468-98c2-92a829835277 req-6c3a8161-28c8-4311-9294-17b29508b915 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086200 Sep 08 10:48:23.769531 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1281/2533] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:48:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:48:23.784962 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c815729c-c9a5-424b-863b-acae2c15ba23 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:23.787379 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c815729c-c9a5-424b-863b-acae2c15ba23 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: 272b4680-9e7e-41dd-afa5-3116aa92665b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:23.807802 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c815729c-c9a5-424b-863b-acae2c15ba23 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:23.810228 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c815729c-c9a5-424b-863b-acae2c15ba23 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:23.811679 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c815729c-c9a5-424b-863b-acae2c15ba23 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:23.814805 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c815729c-c9a5-424b-863b-acae2c15ba23 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:23.816799 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c815729c-c9a5-424b-863b-acae2c15ba23 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:23.819242 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c815729c-c9a5-424b-863b-acae2c15ba23 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:23.869560 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:48:23.888313 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d4821025-a87c-4340-850a-57229fb7af29 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ff38511b484fbcb7817a56076cf4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a768a3863448bca0c6cda11afdd955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:23.924660 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d4821025-a87c-4340-850a-57229fb7af29 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] 10.222.0.27 "GET /compute/v2.1/servers/b7c9f2aa-8e8c-4200-89ee-a107ea59256a" status: 200 len: 1514 microversion: 2.1 time: 0.726229 Sep 08 10:48:23.925788 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1253/2534] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:23 2022] GET /compute/v2.1/servers/b7c9f2aa-8e8c-4200-89ee-a107ea59256a => generated 1514 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:23.942185 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b1d3835c-ab79-46ae-9d9d-c6c8cd618736 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:23.943178 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b1d3835c-ab79-46ae-9d9d-c6c8cd618736 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:23.958494 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b1d3835c-ab79-46ae-9d9d-c6c8cd618736 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:23.959393 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b1d3835c-ab79-46ae-9d9d-c6c8cd618736 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:23.960360 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b1d3835c-ab79-46ae-9d9d-c6c8cd618736 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:23.967932 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b1d3835c-ab79-46ae-9d9d-c6c8cd618736 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:23.969317 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b1d3835c-ab79-46ae-9d9d-c6c8cd618736 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:23.987331 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b1d3835c-ab79-46ae-9d9d-c6c8cd618736 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:24.222847 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b1d3835c-ab79-46ae-9d9d-c6c8cd618736 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:24.239438 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b1d3835c-ab79-46ae-9d9d-c6c8cd618736 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447" status: 200 len: 1427 microversion: 2.1 time: 0.311285 Sep 08 10:48:24.240657 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1254/2535] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:23 2022] GET /compute/v2.1/servers/e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447 => generated 1427 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:24.250055 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-3a58cae6-2093-4dc4-9f9c-f7f9a421eb81 req-1ea84750-bfc2-47f5-8e9e-40dbc1495632 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83d65df7-eb49-46ce-815a-54fbb3725661", "name": "network-vif-plugged", "status": "completed", "tag": "f161d99b-33c5-4181-874f-078895df4a10"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:48:24.275249 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-3a58cae6-2093-4dc4-9f9c-f7f9a421eb81 req-1ea84750-bfc2-47f5-8e9e-40dbc1495632 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:24.277894 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-3a58cae6-2093-4dc4-9f9c-f7f9a421eb81 req-1ea84750-bfc2-47f5-8e9e-40dbc1495632 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:24.280159 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-3a58cae6-2093-4dc4-9f9c-f7f9a421eb81 req-1ea84750-bfc2-47f5-8e9e-40dbc1495632 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:24.325970 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-3a58cae6-2093-4dc4-9f9c-f7f9a421eb81 req-1ea84750-bfc2-47f5-8e9e-40dbc1495632 service nova] Creating event network-vif-plugged:f161d99b-33c5-4181-874f-078895df4a10 for instance 83d65df7-eb49-46ce-815a-54fbb3725661 on n-h1-850501-12 Sep 08 10:48:24.345732 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-3a58cae6-2093-4dc4-9f9c-f7f9a421eb81 req-1ea84750-bfc2-47f5-8e9e-40dbc1495632 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101727 Sep 08 10:48:24.348007 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1255/2536] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:48:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:48:24.373923 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9c1ad835-b2ae-4563-8868-9bae9b7920f4 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:24.376090 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9c1ad835-b2ae-4563-8868-9bae9b7920f4 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] [instance: 83d65df7-eb49-46ce-815a-54fbb3725661] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:24.389958 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9c1ad835-b2ae-4563-8868-9bae9b7920f4 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:24.390758 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9c1ad835-b2ae-4563-8868-9bae9b7920f4 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:24.391506 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9c1ad835-b2ae-4563-8868-9bae9b7920f4 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:24.392659 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9c1ad835-b2ae-4563-8868-9bae9b7920f4 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:24.394046 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9c1ad835-b2ae-4563-8868-9bae9b7920f4 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:24.394259 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9c1ad835-b2ae-4563-8868-9bae9b7920f4 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:24.514365 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c815729c-c9a5-424b-863b-acae2c15ba23 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c291cbe955b4ee5abc98132dda0255e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f9a24cad014d7f827e8f3236dd5bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:24.558795 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c815729c-c9a5-424b-863b-acae2c15ba23 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/272b4680-9e7e-41dd-afa5-3116aa92665b" status: 200 len: 1366 microversion: 2.1 time: 0.785051 Sep 08 10:48:24.562956 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1282/2537] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:23 2022] GET /compute/v2.1/servers/272b4680-9e7e-41dd-afa5-3116aa92665b => generated 1366 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:24.732125 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e6f062e1-6434-4b48-8916-fdb2d2ba0cf7 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:24.739349 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e6f062e1-6434-4b48-8916-fdb2d2ba0cf7 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] [instance: 814d8327-fc0e-4846-a449-598e482d71c6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:24.767519 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e6f062e1-6434-4b48-8916-fdb2d2ba0cf7 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:24.769468 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e6f062e1-6434-4b48-8916-fdb2d2ba0cf7 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:24.770884 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e6f062e1-6434-4b48-8916-fdb2d2ba0cf7 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:24.773396 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e6f062e1-6434-4b48-8916-fdb2d2ba0cf7 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:24.774808 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e6f062e1-6434-4b48-8916-fdb2d2ba0cf7 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:24.776980 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e6f062e1-6434-4b48-8916-fdb2d2ba0cf7 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:25.095411 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9c1ad835-b2ae-4563-8868-9bae9b7920f4 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd975c3a56545fa938752d2b72be872', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e481d7d8204631b72aaef2d6279c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:25.103172 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9c1ad835-b2ae-4563-8868-9bae9b7920f4 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] 10.222.0.27 "GET /compute/v2.1/servers/83d65df7-eb49-46ce-815a-54fbb3725661" status: 200 len: 1315 microversion: 2.1 time: 0.753127 Sep 08 10:48:25.103790 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1256/2538] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:24 2022] GET /compute/v2.1/servers/83d65df7-eb49-46ce-815a-54fbb3725661 => generated 1315 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:25.108494 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-18df9094-1ad2-4a2f-938f-e0bf6adf8485 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:25.109143 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-18df9094-1ad2-4a2f-938f-e0bf6adf8485 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] [instance: b7c9f2aa-8e8c-4200-89ee-a107ea59256a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:25.137370 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-18df9094-1ad2-4a2f-938f-e0bf6adf8485 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:25.138265 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-18df9094-1ad2-4a2f-938f-e0bf6adf8485 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:25.138880 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-18df9094-1ad2-4a2f-938f-e0bf6adf8485 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:25.139773 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-18df9094-1ad2-4a2f-938f-e0bf6adf8485 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:25.140390 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-18df9094-1ad2-4a2f-938f-e0bf6adf8485 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:25.140975 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-18df9094-1ad2-4a2f-938f-e0bf6adf8485 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:25.189221 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=100 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:48:25.310495 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e6f062e1-6434-4b48-8916-fdb2d2ba0cf7 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6f265811ad4ccf866fb8094782dd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9a5f2a2b4f460dad3731b0ce6ecebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:25.318712 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e6f062e1-6434-4b48-8916-fdb2d2ba0cf7 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] 10.222.0.27 "GET /compute/v2.1/servers/814d8327-fc0e-4846-a449-598e482d71c6" status: 200 len: 1320 microversion: 2.1 time: 0.602467 Sep 08 10:48:25.335715 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1283/2539] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:24 2022] GET /compute/v2.1/servers/814d8327-fc0e-4846-a449-598e482d71c6 => generated 1320 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:25.342234 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9219f7a3-c72d-4816-8cf6-3c606946fb45 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:25.342234 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9219f7a3-c72d-4816-8cf6-3c606946fb45 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:25.356116 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9219f7a3-c72d-4816-8cf6-3c606946fb45 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:25.356908 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9219f7a3-c72d-4816-8cf6-3c606946fb45 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:25.357257 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9219f7a3-c72d-4816-8cf6-3c606946fb45 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:25.358048 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9219f7a3-c72d-4816-8cf6-3c606946fb45 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:25.358473 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9219f7a3-c72d-4816-8cf6-3c606946fb45 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:25.358906 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9219f7a3-c72d-4816-8cf6-3c606946fb45 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:25.445146 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9219f7a3-c72d-4816-8cf6-3c606946fb45 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:25.451474 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9219f7a3-c72d-4816-8cf6-3c606946fb45 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:25.452383 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9219f7a3-c72d-4816-8cf6-3c606946fb45 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:25.452980 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-9219f7a3-c72d-4816-8cf6-3c606946fb45 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lazy-loading 'fault' on Instance uuid e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:48:25.558683 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9219f7a3-c72d-4816-8cf6-3c606946fb45 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:25.578527 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9219f7a3-c72d-4816-8cf6-3c606946fb45 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447" status: 200 len: 1303 microversion: 2.1 time: 0.243347 Sep 08 10:48:25.582286 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1284/2540] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:25 2022] GET /compute/v2.1/servers/e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447 => generated 1303 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:25.605186 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-de261a05-dcf3-48ab-82de-94989a975d42 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:25.605948 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-de261a05-dcf3-48ab-82de-94989a975d42 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: 272b4680-9e7e-41dd-afa5-3116aa92665b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:25.613694 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de261a05-dcf3-48ab-82de-94989a975d42 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:25.614655 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de261a05-dcf3-48ab-82de-94989a975d42 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:25.615576 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de261a05-dcf3-48ab-82de-94989a975d42 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:25.616743 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de261a05-dcf3-48ab-82de-94989a975d42 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:25.617423 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de261a05-dcf3-48ab-82de-94989a975d42 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:25.618067 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de261a05-dcf3-48ab-82de-94989a975d42 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:25.788610 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:48:25.820691 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=16 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:48:26.022173 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-de261a05-dcf3-48ab-82de-94989a975d42 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c291cbe955b4ee5abc98132dda0255e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f9a24cad014d7f827e8f3236dd5bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:26.048045 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-de261a05-dcf3-48ab-82de-94989a975d42 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/272b4680-9e7e-41dd-afa5-3116aa92665b" status: 200 len: 1366 microversion: 2.1 time: 0.459487 Sep 08 10:48:26.050086 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1285/2541] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:25 2022] GET /compute/v2.1/servers/272b4680-9e7e-41dd-afa5-3116aa92665b => generated 1366 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:26.151611 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-23715b8b-1e7b-4db4-959d-d94bd89187f6 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:26.157824 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-23715b8b-1e7b-4db4-959d-d94bd89187f6 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] [instance: 83d65df7-eb49-46ce-815a-54fbb3725661] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:26.178757 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23715b8b-1e7b-4db4-959d-d94bd89187f6 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:26.180677 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23715b8b-1e7b-4db4-959d-d94bd89187f6 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:26.183308 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23715b8b-1e7b-4db4-959d-d94bd89187f6 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:26.185617 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23715b8b-1e7b-4db4-959d-d94bd89187f6 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:26.187434 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23715b8b-1e7b-4db4-959d-d94bd89187f6 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:26.188824 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23715b8b-1e7b-4db4-959d-d94bd89187f6 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:26.394339 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-18df9094-1ad2-4a2f-938f-e0bf6adf8485 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ff38511b484fbcb7817a56076cf4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a768a3863448bca0c6cda11afdd955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:26.436415 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-18df9094-1ad2-4a2f-938f-e0bf6adf8485 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] 10.222.0.27 "GET /compute/v2.1/servers/b7c9f2aa-8e8c-4200-89ee-a107ea59256a" status: 200 len: 1514 microversion: 2.1 time: 1.330309 Sep 08 10:48:26.439604 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1257/2542] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:25 2022] GET /compute/v2.1/servers/b7c9f2aa-8e8c-4200-89ee-a107ea59256a => generated 1514 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:26.462371 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-069422da-a206-4607-88e6-f3972ef88ea8 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:26.464253 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-069422da-a206-4607-88e6-f3972ef88ea8 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] [instance: 814d8327-fc0e-4846-a449-598e482d71c6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:26.480215 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=12 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:48:26.482168 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-069422da-a206-4607-88e6-f3972ef88ea8 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:26.482876 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-069422da-a206-4607-88e6-f3972ef88ea8 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:26.483331 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-069422da-a206-4607-88e6-f3972ef88ea8 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:26.484082 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-069422da-a206-4607-88e6-f3972ef88ea8 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:26.484553 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-069422da-a206-4607-88e6-f3972ef88ea8 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:26.484991 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-069422da-a206-4607-88e6-f3972ef88ea8 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:26.705890 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-23715b8b-1e7b-4db4-959d-d94bd89187f6 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd975c3a56545fa938752d2b72be872', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e481d7d8204631b72aaef2d6279c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:26.737227 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-23715b8b-1e7b-4db4-959d-d94bd89187f6 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] 10.222.0.27 "GET /compute/v2.1/servers/83d65df7-eb49-46ce-815a-54fbb3725661" status: 200 len: 1315 microversion: 2.1 time: 0.603964 Sep 08 10:48:26.737946 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1286/2543] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:26 2022] GET /compute/v2.1/servers/83d65df7-eb49-46ce-815a-54fbb3725661 => generated 1315 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:48:26.748014 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3c8ef092-0f36-4371-a379-c0cbc2b6c481 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:26.762675 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3c8ef092-0f36-4371-a379-c0cbc2b6c481 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:26.779497 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c8ef092-0f36-4371-a379-c0cbc2b6c481 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:26.781088 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c8ef092-0f36-4371-a379-c0cbc2b6c481 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:26.785757 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c8ef092-0f36-4371-a379-c0cbc2b6c481 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:26.787546 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c8ef092-0f36-4371-a379-c0cbc2b6c481 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:26.793048 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c8ef092-0f36-4371-a379-c0cbc2b6c481 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:26.795903 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c8ef092-0f36-4371-a379-c0cbc2b6c481 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:26.857663 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-3c8ef092-0f36-4371-a379-c0cbc2b6c481 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] HTTP exception thrown: Instance e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447 could not be found. Sep 08 10:48:26.866881 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3c8ef092-0f36-4371-a379-c0cbc2b6c481 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Request method failure captured: Sep 08 10:48:26.866881 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447 HTTP/1.1 Sep 08 10:48:26.866881 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:48:26.866881 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:48:26.866881 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:48:26.866881 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:48:26.866881 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:48:26.866881 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:48:26.866881 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:48:26.866881 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:48:26.866881 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGce62zDaM5lK2luTZl9BOLMK0pc_-xKbcmjRS_RkIBRZFFByYFOX29rDKNzb-L9mtn_MAYtDYWpNXjR0dCrd1CjlTMFVc7r1o5XcWzpGXaSZivOMeHxuMBcso5JKK7QW9nLFbnuS4n9lRSqYoy521PhzBqJN1Lhkb_6A_JTVZ9UGgBI Sep 08 10:48:26.866881 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:48:26.866881 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:48:26.866881 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:48:26.866881 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:48:26.866881 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:48:26.866881 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:48:26.866881 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: eb93f8524768458a974c348b981921d5 Sep 08 10:48:26.866881 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersAdminTestJSON-318045889 Sep 08 10:48:26.866881 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:48:26.866881 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:48:26.866881 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/eb93f8524768458a974c348b981921d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eb93f8524768458a974c348b981921d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_eb93f8524768458a974c348b981921d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eb93f8524768458a974c348b981921d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:48:26.866881 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServersAdminTestJSON-318045889 Sep 08 10:48:26.866881 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: eb93f8524768458a974c348b981921d5 Sep 08 10:48:26.866881 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersAdminTestJSON-318045889 Sep 08 10:48:26.866881 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServersAdminTestJSON-318045889-project Sep 08 10:48:26.866881 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:48:26.866881 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:48:26.866881 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: c1c083657f0a4cebbc0804cd5d5ea4ad Sep 08 10:48:26.866881 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServersAdminTestJSON-318045889-project Sep 08 10:48:26.866881 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:48:26.866881 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447 could not be found. Sep 08 10:48:26.866881 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447'} Sep 08 10:48:26.866881 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:48:26.866881 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:48:26.866881 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:48:26.866881 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:48:26.866881 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:48:26.866881 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:48:26.866881 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:48:26.866881 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:48:26.866881 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:48:26.866881 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:48:26.866881 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447 could not be found. Sep 08 10:48:26.866881 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:48:26.866881 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:48:26.866881 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:48:26.866881 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:48:26.866881 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:48:26.866881 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:48:26.866881 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:48:26.866881 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:48:26.866881 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:48:26.866881 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:48:26.866881 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:48:26.866881 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:48:26.866881 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:48:26.866881 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:48:26.866881 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:48:26.866881 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:48:26.866881 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447 could not be found. Sep 08 10:48:26.866881 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:48:26.866881 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:48:26.866881 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:48:26.872346 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:48:26.872346 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:48:26.872346 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:48:26.872346 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:48:26.872346 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:48:26.872346 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447 could not be found. Sep 08 10:48:26.872346 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:48:26.877941 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3c8ef092-0f36-4371-a379-c0cbc2b6c481 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Returning 404 to user: Instance e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:48:26.885264 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3c8ef092-0f36-4371-a379-c0cbc2b6c481 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447" status: 404 len: 111 microversion: 2.1 time: 0.145826 Sep 08 10:48:26.891066 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1287/2544] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:26 2022] GET /compute/v2.1/servers/e06d0ed3-2ba1-47b8-bf2c-1e6ff99a8447 => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:48:26.903148 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-344c0710-a716-4d8a-977f-2704434fd913 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:26.905847 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-344c0710-a716-4d8a-977f-2704434fd913 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: 3766b195-ace4-4563-a24e-dca72941251e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:26.924107 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-344c0710-a716-4d8a-977f-2704434fd913 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:26.924984 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-344c0710-a716-4d8a-977f-2704434fd913 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:26.925921 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-344c0710-a716-4d8a-977f-2704434fd913 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:26.927659 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-344c0710-a716-4d8a-977f-2704434fd913 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:26.928823 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-344c0710-a716-4d8a-977f-2704434fd913 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:26.929471 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-344c0710-a716-4d8a-977f-2704434fd913 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:27.034151 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-344c0710-a716-4d8a-977f-2704434fd913 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: 3766b195-ace4-4563-a24e-dca72941251e] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:48:27.228004 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-344c0710-a716-4d8a-977f-2704434fd913 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e" status: 204 len: 0 microversion: 2.1 time: 0.333971 Sep 08 10:48:27.232204 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1288/2545] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:48:26 2022] DELETE /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:48:27.249650 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-caff417d-c260-46e6-aa59-702f0d9522fb req-430a5553-37be-4282-bc51-6275c34af08d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "814d8327-fc0e-4846-a449-598e482d71c6", "tag": "b1d66584-8d5f-420b-abef-c3ed821e4f57"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:48:27.255087 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-069422da-a206-4607-88e6-f3972ef88ea8 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6f265811ad4ccf866fb8094782dd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9a5f2a2b4f460dad3731b0ce6ecebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:27.267139 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-069422da-a206-4607-88e6-f3972ef88ea8 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] 10.222.0.27 "GET /compute/v2.1/servers/814d8327-fc0e-4846-a449-598e482d71c6" status: 200 len: 1320 microversion: 2.1 time: 0.812905 Sep 08 10:48:27.270792 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1258/2546] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:26 2022] GET /compute/v2.1/servers/814d8327-fc0e-4846-a449-598e482d71c6 => generated 1320 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:27.288339 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2ce5fab2-a0e5-47c4-80f3-bac09fd955c3 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:27.291591 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-caff417d-c260-46e6-aa59-702f0d9522fb req-430a5553-37be-4282-bc51-6275c34af08d service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:27.292588 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2ce5fab2-a0e5-47c4-80f3-bac09fd955c3 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: 272b4680-9e7e-41dd-afa5-3116aa92665b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:27.295323 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-caff417d-c260-46e6-aa59-702f0d9522fb req-430a5553-37be-4282-bc51-6275c34af08d service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:27.297363 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-caff417d-c260-46e6-aa59-702f0d9522fb req-430a5553-37be-4282-bc51-6275c34af08d service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:27.303779 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2ce5fab2-a0e5-47c4-80f3-bac09fd955c3 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:27.305696 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2ce5fab2-a0e5-47c4-80f3-bac09fd955c3 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:27.306293 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2ce5fab2-a0e5-47c4-80f3-bac09fd955c3 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:27.308734 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2ce5fab2-a0e5-47c4-80f3-bac09fd955c3 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:27.311296 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2ce5fab2-a0e5-47c4-80f3-bac09fd955c3 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:27.311938 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2ce5fab2-a0e5-47c4-80f3-bac09fd955c3 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:27.332190 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-caff417d-c260-46e6-aa59-702f0d9522fb req-430a5553-37be-4282-bc51-6275c34af08d service nova] Creating event network-changed:b1d66584-8d5f-420b-abef-c3ed821e4f57 for instance 814d8327-fc0e-4846-a449-598e482d71c6 on n-h2-850501-12 Sep 08 10:48:27.347467 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-caff417d-c260-46e6-aa59-702f0d9522fb req-430a5553-37be-4282-bc51-6275c34af08d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112569 Sep 08 10:48:27.348491 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1289/2547] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:48:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:48:27.368958 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-410158f1-3b7c-44e6-95d5-87a361634448 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:27.373261 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-410158f1-3b7c-44e6-95d5-87a361634448 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: 3766b195-ace4-4563-a24e-dca72941251e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:27.382718 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-410158f1-3b7c-44e6-95d5-87a361634448 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:27.384195 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-410158f1-3b7c-44e6-95d5-87a361634448 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:27.385781 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-410158f1-3b7c-44e6-95d5-87a361634448 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:27.388921 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-410158f1-3b7c-44e6-95d5-87a361634448 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:27.389901 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-410158f1-3b7c-44e6-95d5-87a361634448 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:27.391156 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-410158f1-3b7c-44e6-95d5-87a361634448 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:27.743027 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-410158f1-3b7c-44e6-95d5-87a361634448 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:27.767225 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-410158f1-3b7c-44e6-95d5-87a361634448 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e" status: 200 len: 1469 microversion: 2.1 time: 0.413704 Sep 08 10:48:27.769527 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2ce5fab2-a0e5-47c4-80f3-bac09fd955c3 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c291cbe955b4ee5abc98132dda0255e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f9a24cad014d7f827e8f3236dd5bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:27.773468 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1290/2548] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:27 2022] GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e => generated 1469 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:27.786878 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-106b2cab-7bf6-4db7-8886-e59922690bb4 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:27.786878 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-106b2cab-7bf6-4db7-8886-e59922690bb4 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] [instance: b7c9f2aa-8e8c-4200-89ee-a107ea59256a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:27.788268 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2ce5fab2-a0e5-47c4-80f3-bac09fd955c3 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/272b4680-9e7e-41dd-afa5-3116aa92665b" status: 200 len: 1366 microversion: 2.1 time: 0.507928 Sep 08 10:48:27.801173 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1259/2549] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:27 2022] GET /compute/v2.1/servers/272b4680-9e7e-41dd-afa5-3116aa92665b => generated 1366 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:27.806205 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-106b2cab-7bf6-4db7-8886-e59922690bb4 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:27.808734 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-106b2cab-7bf6-4db7-8886-e59922690bb4 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:27.811012 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-106b2cab-7bf6-4db7-8886-e59922690bb4 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:27.811890 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-106b2cab-7bf6-4db7-8886-e59922690bb4 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:27.814739 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-106b2cab-7bf6-4db7-8886-e59922690bb4 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:27.816411 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-106b2cab-7bf6-4db7-8886-e59922690bb4 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:27.820625 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-39e85673-a4a4-401a-a3ae-05f33badd5f8 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:27.825321 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-39e85673-a4a4-401a-a3ae-05f33badd5f8 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] [instance: 83d65df7-eb49-46ce-815a-54fbb3725661] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:27.837756 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-39e85673-a4a4-401a-a3ae-05f33badd5f8 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:27.838975 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-39e85673-a4a4-401a-a3ae-05f33badd5f8 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:27.839811 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-39e85673-a4a4-401a-a3ae-05f33badd5f8 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:27.841119 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-39e85673-a4a4-401a-a3ae-05f33badd5f8 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:27.842149 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-39e85673-a4a4-401a-a3ae-05f33badd5f8 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:27.843261 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-39e85673-a4a4-401a-a3ae-05f33badd5f8 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:27.936586 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-106b2cab-7bf6-4db7-8886-e59922690bb4 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ff38511b484fbcb7817a56076cf4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a768a3863448bca0c6cda11afdd955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:27.954099 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-106b2cab-7bf6-4db7-8886-e59922690bb4 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] 10.222.0.27 "GET /compute/v2.1/servers/b7c9f2aa-8e8c-4200-89ee-a107ea59256a" status: 200 len: 1303 microversion: 2.1 time: 0.178491 Sep 08 10:48:27.955797 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1291/2550] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:27 2022] GET /compute/v2.1/servers/b7c9f2aa-8e8c-4200-89ee-a107ea59256a => generated 1303 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:28.227638 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-39e85673-a4a4-401a-a3ae-05f33badd5f8 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd975c3a56545fa938752d2b72be872', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e481d7d8204631b72aaef2d6279c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:28.254195 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-39e85673-a4a4-401a-a3ae-05f33badd5f8 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] 10.222.0.27 "GET /compute/v2.1/servers/83d65df7-eb49-46ce-815a-54fbb3725661" status: 200 len: 1503 microversion: 2.1 time: 0.450821 Sep 08 10:48:28.262495 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1260/2551] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:27 2022] GET /compute/v2.1/servers/83d65df7-eb49-46ce-815a-54fbb3725661 => generated 1503 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:28.289536 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3335a064-9c1e-4888-ac35-5ebca4f14037 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:28.290474 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3335a064-9c1e-4888-ac35-5ebca4f14037 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] [instance: 83d65df7-eb49-46ce-815a-54fbb3725661] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:28.320597 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3a99f307-b3ea-4ffa-b152-cf3d96da273d tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:28.321350 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3a99f307-b3ea-4ffa-b152-cf3d96da273d tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] [instance: 814d8327-fc0e-4846-a449-598e482d71c6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:28.338795 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3335a064-9c1e-4888-ac35-5ebca4f14037 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:28.341188 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3335a064-9c1e-4888-ac35-5ebca4f14037 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:28.343659 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3a99f307-b3ea-4ffa-b152-cf3d96da273d tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:28.346626 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3335a064-9c1e-4888-ac35-5ebca4f14037 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:28.347816 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3335a064-9c1e-4888-ac35-5ebca4f14037 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:28.350224 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3a99f307-b3ea-4ffa-b152-cf3d96da273d tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:28.352487 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3335a064-9c1e-4888-ac35-5ebca4f14037 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:28.355465 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3a99f307-b3ea-4ffa-b152-cf3d96da273d tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:28.358711 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3a99f307-b3ea-4ffa-b152-cf3d96da273d tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:28.359289 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3335a064-9c1e-4888-ac35-5ebca4f14037 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:28.366352 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3a99f307-b3ea-4ffa-b152-cf3d96da273d tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:28.366942 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3a99f307-b3ea-4ffa-b152-cf3d96da273d tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:28.482039 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3335a064-9c1e-4888-ac35-5ebca4f14037 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] [instance: 83d65df7-eb49-46ce-815a-54fbb3725661] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:48:28.755540 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3335a064-9c1e-4888-ac35-5ebca4f14037 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] 10.222.0.27 "DELETE /compute/v2.1/servers/83d65df7-eb49-46ce-815a-54fbb3725661" status: 204 len: 0 microversion: 2.1 time: 0.469768 Sep 08 10:48:28.756499 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1292/2552] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:48:28 2022] DELETE /compute/v2.1/servers/83d65df7-eb49-46ce-815a-54fbb3725661 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:48:28.774357 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d4abfbad-9fd2-425f-bdf9-0f9fbdcee583 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:28.776560 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d4abfbad-9fd2-425f-bdf9-0f9fbdcee583 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] [instance: 83d65df7-eb49-46ce-815a-54fbb3725661] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:28.784858 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d4abfbad-9fd2-425f-bdf9-0f9fbdcee583 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:28.785735 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d4abfbad-9fd2-425f-bdf9-0f9fbdcee583 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:28.786347 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d4abfbad-9fd2-425f-bdf9-0f9fbdcee583 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:28.787246 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d4abfbad-9fd2-425f-bdf9-0f9fbdcee583 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:28.787887 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d4abfbad-9fd2-425f-bdf9-0f9fbdcee583 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:28.788462 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d4abfbad-9fd2-425f-bdf9-0f9fbdcee583 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:29.330081 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d4abfbad-9fd2-425f-bdf9-0f9fbdcee583 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd975c3a56545fa938752d2b72be872', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e481d7d8204631b72aaef2d6279c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:29.403516 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d4abfbad-9fd2-425f-bdf9-0f9fbdcee583 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] 10.222.0.27 "GET /compute/v2.1/servers/83d65df7-eb49-46ce-815a-54fbb3725661" status: 200 len: 1509 microversion: 2.1 time: 0.641231 Sep 08 10:48:29.404736 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1293/2553] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:28 2022] GET /compute/v2.1/servers/83d65df7-eb49-46ce-815a-54fbb3725661 => generated 1509 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:29.425627 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-34be217c-7346-428b-b8bf-feb95cccde5e tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:29.430130 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-34be217c-7346-428b-b8bf-feb95cccde5e tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: 3766b195-ace4-4563-a24e-dca72941251e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:29.446282 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-34be217c-7346-428b-b8bf-feb95cccde5e tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:29.446906 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-34be217c-7346-428b-b8bf-feb95cccde5e tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:29.448280 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-34be217c-7346-428b-b8bf-feb95cccde5e tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:29.448991 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-34be217c-7346-428b-b8bf-feb95cccde5e tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:29.449415 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-34be217c-7346-428b-b8bf-feb95cccde5e tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:29.449855 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-34be217c-7346-428b-b8bf-feb95cccde5e tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:29.673944 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-3a99f307-b3ea-4ffa-b152-cf3d96da273d tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6f265811ad4ccf866fb8094782dd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9a5f2a2b4f460dad3731b0ce6ecebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:29.692893 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3a99f307-b3ea-4ffa-b152-cf3d96da273d tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] 10.222.0.27 "GET /compute/v2.1/servers/814d8327-fc0e-4846-a449-598e482d71c6" status: 200 len: 1320 microversion: 2.1 time: 1.377357 Sep 08 10:48:29.698256 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1261/2554] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:28 2022] GET /compute/v2.1/servers/814d8327-fc0e-4846-a449-598e482d71c6 => generated 1320 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:48:29.716587 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a1a10f56-4b2b-40c8-b7c0-d1f2ebe821b6 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:29.717887 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a1a10f56-4b2b-40c8-b7c0-d1f2ebe821b6 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: 272b4680-9e7e-41dd-afa5-3116aa92665b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:29.731292 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a1a10f56-4b2b-40c8-b7c0-d1f2ebe821b6 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:29.732412 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a1a10f56-4b2b-40c8-b7c0-d1f2ebe821b6 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:29.733513 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a1a10f56-4b2b-40c8-b7c0-d1f2ebe821b6 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:29.735868 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a1a10f56-4b2b-40c8-b7c0-d1f2ebe821b6 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:29.736898 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a1a10f56-4b2b-40c8-b7c0-d1f2ebe821b6 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:29.737888 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a1a10f56-4b2b-40c8-b7c0-d1f2ebe821b6 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:30.289205 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a1a10f56-4b2b-40c8-b7c0-d1f2ebe821b6 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c291cbe955b4ee5abc98132dda0255e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f9a24cad014d7f827e8f3236dd5bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:30.303018 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a1a10f56-4b2b-40c8-b7c0-d1f2ebe821b6 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/272b4680-9e7e-41dd-afa5-3116aa92665b" status: 200 len: 1366 microversion: 2.1 time: 0.603117 Sep 08 10:48:30.303917 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1262/2555] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:29 2022] GET /compute/v2.1/servers/272b4680-9e7e-41dd-afa5-3116aa92665b => generated 1366 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:30.317378 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ef42ba8c-7d68-4365-b928-eb60f0399f82 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:30.318556 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ef42ba8c-7d68-4365-b928-eb60f0399f82 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] [instance: b7c9f2aa-8e8c-4200-89ee-a107ea59256a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:30.339794 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ef42ba8c-7d68-4365-b928-eb60f0399f82 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:30.340581 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ef42ba8c-7d68-4365-b928-eb60f0399f82 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:30.341251 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ef42ba8c-7d68-4365-b928-eb60f0399f82 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:30.342681 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ef42ba8c-7d68-4365-b928-eb60f0399f82 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:30.343493 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ef42ba8c-7d68-4365-b928-eb60f0399f82 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:30.344106 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ef42ba8c-7d68-4365-b928-eb60f0399f82 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:30.436104 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ef42ba8c-7d68-4365-b928-eb60f0399f82 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:30.436595 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ef42ba8c-7d68-4365-b928-eb60f0399f82 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:30.441149 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ef42ba8c-7d68-4365-b928-eb60f0399f82 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:30.441833 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-ef42ba8c-7d68-4365-b928-eb60f0399f82 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lazy-loading 'fault' on Instance uuid b7c9f2aa-8e8c-4200-89ee-a107ea59256a {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:48:30.727122 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ef42ba8c-7d68-4365-b928-eb60f0399f82 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ff38511b484fbcb7817a56076cf4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a768a3863448bca0c6cda11afdd955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:30.743293 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ef42ba8c-7d68-4365-b928-eb60f0399f82 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] 10.222.0.27 "GET /compute/v2.1/servers/b7c9f2aa-8e8c-4200-89ee-a107ea59256a" status: 200 len: 1308 microversion: 2.1 time: 0.437073 Sep 08 10:48:30.754929 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1263/2556] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:30 2022] GET /compute/v2.1/servers/b7c9f2aa-8e8c-4200-89ee-a107ea59256a => generated 1308 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:30.763219 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-f02de97c-2b3d-45af-84ae-3aba95492afd req-78b823a2-e879-462c-ab9c-fb69b57b9046 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "272b4680-9e7e-41dd-afa5-3116aa92665b", "name": "network-vif-plugged", "status": "completed", "tag": "722660b6-51c7-4a26-9625-53b4b04f69d8"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:48:30.808535 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-f02de97c-2b3d-45af-84ae-3aba95492afd req-78b823a2-e879-462c-ab9c-fb69b57b9046 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:30.811207 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-f02de97c-2b3d-45af-84ae-3aba95492afd req-78b823a2-e879-462c-ab9c-fb69b57b9046 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:30.813945 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-f02de97c-2b3d-45af-84ae-3aba95492afd req-78b823a2-e879-462c-ab9c-fb69b57b9046 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:30.870837 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-f02de97c-2b3d-45af-84ae-3aba95492afd req-78b823a2-e879-462c-ab9c-fb69b57b9046 service nova] Creating event network-vif-plugged:722660b6-51c7-4a26-9625-53b4b04f69d8 for instance 272b4680-9e7e-41dd-afa5-3116aa92665b on n-h2-850501-12 Sep 08 10:48:30.892992 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-f02de97c-2b3d-45af-84ae-3aba95492afd req-78b823a2-e879-462c-ab9c-fb69b57b9046 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136278 Sep 08 10:48:30.897799 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1264/2557] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:48:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:48:30.914312 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-da7536e9-d23c-4144-a2bf-8461a0b4b731 req-7b9e28b0-27a1-4ed1-a90b-5f62d30f6cbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7c9f2aa-8e8c-4200-89ee-a107ea59256a", "name": "network-vif-deleted", "tag": "c9d7159a-535c-438e-a67b-db24af373413"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:48:30.942639 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:48:30.950792 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-da7536e9-d23c-4144-a2bf-8461a0b4b731 req-7b9e28b0-27a1-4ed1-a90b-5f62d30f6cbb service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:30.953110 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-da7536e9-d23c-4144-a2bf-8461a0b4b731 req-7b9e28b0-27a1-4ed1-a90b-5f62d30f6cbb service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:30.953774 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-da7536e9-d23c-4144-a2bf-8461a0b4b731 req-7b9e28b0-27a1-4ed1-a90b-5f62d30f6cbb service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:30.990337 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-da7536e9-d23c-4144-a2bf-8461a0b4b731 req-7b9e28b0-27a1-4ed1-a90b-5f62d30f6cbb service nova] Creating event network-vif-deleted:c9d7159a-535c-438e-a67b-db24af373413 for instance b7c9f2aa-8e8c-4200-89ee-a107ea59256a on n-h1-850501-12 Sep 08 10:48:31.008297 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-da7536e9-d23c-4144-a2bf-8461a0b4b731 req-7b9e28b0-27a1-4ed1-a90b-5f62d30f6cbb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104764 Sep 08 10:48:31.009359 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1265/2558] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:48:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:48:31.022225 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3bec7f4b-73f0-4b68-a70f-b65b0ad6f408 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:31.023182 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3bec7f4b-73f0-4b68-a70f-b65b0ad6f408 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] [instance: 83d65df7-eb49-46ce-815a-54fbb3725661] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:31.039722 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3bec7f4b-73f0-4b68-a70f-b65b0ad6f408 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:31.041556 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3bec7f4b-73f0-4b68-a70f-b65b0ad6f408 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:31.044146 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3bec7f4b-73f0-4b68-a70f-b65b0ad6f408 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:31.051130 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3bec7f4b-73f0-4b68-a70f-b65b0ad6f408 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:31.051848 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3bec7f4b-73f0-4b68-a70f-b65b0ad6f408 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:31.052475 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3bec7f4b-73f0-4b68-a70f-b65b0ad6f408 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:31.065054 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-34be217c-7346-428b-b8bf-feb95cccde5e tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:31.082635 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-34be217c-7346-428b-b8bf-feb95cccde5e tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e" status: 200 len: 1469 microversion: 2.1 time: 1.676043 Sep 08 10:48:31.085678 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1294/2559] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:29 2022] GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e => generated 1469 bytes in 1681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:31.100046 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-86b36042-b84e-467c-8a33-4f7698a1780c tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:31.101257 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-86b36042-b84e-467c-8a33-4f7698a1780c tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] [instance: 814d8327-fc0e-4846-a449-598e482d71c6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:31.117097 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-86b36042-b84e-467c-8a33-4f7698a1780c tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:31.117799 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-86b36042-b84e-467c-8a33-4f7698a1780c tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:31.118436 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-86b36042-b84e-467c-8a33-4f7698a1780c tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:31.121985 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-86b36042-b84e-467c-8a33-4f7698a1780c tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:31.124294 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-86b36042-b84e-467c-8a33-4f7698a1780c tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:31.124919 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-86b36042-b84e-467c-8a33-4f7698a1780c tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:31.503683 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-3bec7f4b-73f0-4b68-a70f-b65b0ad6f408 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd975c3a56545fa938752d2b72be872', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e481d7d8204631b72aaef2d6279c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:31.514810 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3bec7f4b-73f0-4b68-a70f-b65b0ad6f408 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] 10.222.0.27 "GET /compute/v2.1/servers/83d65df7-eb49-46ce-815a-54fbb3725661" status: 200 len: 1509 microversion: 2.1 time: 0.501601 Sep 08 10:48:31.516349 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1266/2560] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:31 2022] GET /compute/v2.1/servers/83d65df7-eb49-46ce-815a-54fbb3725661 => generated 1509 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:31.532142 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8264ee5b-a6f7-428e-8c32-ab707a34784e tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:31.533413 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8264ee5b-a6f7-428e-8c32-ab707a34784e tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: 272b4680-9e7e-41dd-afa5-3116aa92665b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:31.544593 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8264ee5b-a6f7-428e-8c32-ab707a34784e tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:31.545477 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8264ee5b-a6f7-428e-8c32-ab707a34784e tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:31.546245 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8264ee5b-a6f7-428e-8c32-ab707a34784e tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:31.547190 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8264ee5b-a6f7-428e-8c32-ab707a34784e tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:31.547721 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8264ee5b-a6f7-428e-8c32-ab707a34784e tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:31.548862 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8264ee5b-a6f7-428e-8c32-ab707a34784e tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:31.733056 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-86b36042-b84e-467c-8a33-4f7698a1780c tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6f265811ad4ccf866fb8094782dd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9a5f2a2b4f460dad3731b0ce6ecebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:31.754366 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-86b36042-b84e-467c-8a33-4f7698a1780c tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] 10.222.0.27 "GET /compute/v2.1/servers/814d8327-fc0e-4846-a449-598e482d71c6" status: 200 len: 1320 microversion: 2.1 time: 0.665215 Sep 08 10:48:31.758806 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1295/2561] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:31 2022] GET /compute/v2.1/servers/814d8327-fc0e-4846-a449-598e482d71c6 => generated 1320 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:32.067359 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8264ee5b-a6f7-428e-8c32-ab707a34784e tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c291cbe955b4ee5abc98132dda0255e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f9a24cad014d7f827e8f3236dd5bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:32.088460 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8264ee5b-a6f7-428e-8c32-ab707a34784e tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/272b4680-9e7e-41dd-afa5-3116aa92665b" status: 200 len: 1366 microversion: 2.1 time: 0.569954 Sep 08 10:48:32.089111 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1267/2562] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:31 2022] GET /compute/v2.1/servers/272b4680-9e7e-41dd-afa5-3116aa92665b => generated 1366 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:32.102925 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b62a01ba-b180-46f1-9a4b-249e14dfeb83 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Action: 'create', calling method: .version_select at 0x7f68e46df0d0>, body: {"keypair": {"name": "tempest-keypair-1259443957", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPWAU7JUFegdLLjsF5s+BEEhTJhlZ4htf2g10jNLtTtzZG++kvaE6Olk8NtG1RQesYjOFCPk/p+G7tVpzXklW64lKtBq4YQngCZnXoYaP1CL5nrxFD6ISZN2oTTpu7smxw=="}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:48:32.116497 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-957c5c19-b616-4bf7-a07d-68b545e328c2 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:32.117328 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-957c5c19-b616-4bf7-a07d-68b545e328c2 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] [instance: b7c9f2aa-8e8c-4200-89ee-a107ea59256a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:32.135150 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-957c5c19-b616-4bf7-a07d-68b545e328c2 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:32.138840 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-957c5c19-b616-4bf7-a07d-68b545e328c2 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:32.139652 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-b62a01ba-b180-46f1-9a4b-249e14dfeb83 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Getting quotas for project 065d7179ebd6460cb039bd1624296b57. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:48:32.142716 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-957c5c19-b616-4bf7-a07d-68b545e328c2 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:32.144259 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-957c5c19-b616-4bf7-a07d-68b545e328c2 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:32.145335 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-957c5c19-b616-4bf7-a07d-68b545e328c2 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:32.146598 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-957c5c19-b616-4bf7-a07d-68b545e328c2 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:32.153237 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-b62a01ba-b180-46f1-9a4b-249e14dfeb83 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Getting quotas for user 54fb4a7dae3346d39f70c51055cfd455 and project 065d7179ebd6460cb039bd1624296b57. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:48:32.188200 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-957c5c19-b616-4bf7-a07d-68b545e328c2 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] HTTP exception thrown: Instance b7c9f2aa-8e8c-4200-89ee-a107ea59256a could not be found. Sep 08 10:48:32.192414 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-957c5c19-b616-4bf7-a07d-68b545e328c2 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Request method failure captured: Sep 08 10:48:32.192414 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/b7c9f2aa-8e8c-4200-89ee-a107ea59256a HTTP/1.1 Sep 08 10:48:32.192414 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:48:32.192414 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:48:32.192414 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:48:32.192414 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:48:32.192414 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:48:32.192414 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:48:32.192414 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:48:32.192414 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:48:32.192414 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcfC0AOBXxzazv4hEBAdYoM_Zbqqj2H_wNroumzxYEDQ59KbVVIhiVsq_ZdBUOleK08-DHWosiz_6D_FLUXzKrz5xqX68yP4vI2t0s-XLFo1bTp5Id4PjVGkWeLJls9pXMIAjFMP1OXr2jxOU5q6Qs2X8JpZxS8mL5BS5bD9v1xEYTE Sep 08 10:48:32.192414 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:48:32.192414 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:48:32.192414 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:48:32.192414 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:48:32.192414 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:48:32.192414 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:48:32.192414 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 68a768a3863448bca0c6cda11afdd955 Sep 08 10:48:32.192414 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-VolumesAdminNegativeTest-1725475126 Sep 08 10:48:32.192414 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:48:32.192414 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:48:32.192414 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/68a768a3863448bca0c6cda11afdd955"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/68a768a3863448bca0c6cda11afdd955"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_68a768a3863448bca0c6cda11afdd955"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/68a768a3863448bca0c6cda11afdd955"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:48:32.192414 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-VolumesAdminNegativeTest-1725475126 Sep 08 10:48:32.192414 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 68a768a3863448bca0c6cda11afdd955 Sep 08 10:48:32.192414 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1725475126 Sep 08 10:48:32.192414 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-VolumesAdminNegativeTest-1725475126-project Sep 08 10:48:32.192414 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:48:32.192414 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:48:32.192414 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 03ff38511b484fbcb7817a56076cf4b7 Sep 08 10:48:32.192414 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-VolumesAdminNegativeTest-1725475126-project Sep 08 10:48:32.192414 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:48:32.192414 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance b7c9f2aa-8e8c-4200-89ee-a107ea59256a could not be found. Sep 08 10:48:32.192414 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': 'b7c9f2aa-8e8c-4200-89ee-a107ea59256a'} Sep 08 10:48:32.192414 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:48:32.192414 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:48:32.192414 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:48:32.192414 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:48:32.192414 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:48:32.192414 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:48:32.192414 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:48:32.192414 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:48:32.192414 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:48:32.192414 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:48:32.192414 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7c9f2aa-8e8c-4200-89ee-a107ea59256a could not be found. Sep 08 10:48:32.192414 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:48:32.192414 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:48:32.192414 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:48:32.192414 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:48:32.192414 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:48:32.192414 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:48:32.192414 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:48:32.192414 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:48:32.192414 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:48:32.192414 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:48:32.192414 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:48:32.192414 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:48:32.192414 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:48:32.192414 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:48:32.192414 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:48:32.192414 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:48:32.192414 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7c9f2aa-8e8c-4200-89ee-a107ea59256a could not be found. Sep 08 10:48:32.192414 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:48:32.192414 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:48:32.192414 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:48:32.198642 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:48:32.198642 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:48:32.198642 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:48:32.198642 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:48:32.198642 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:48:32.198642 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7c9f2aa-8e8c-4200-89ee-a107ea59256a could not be found. Sep 08 10:48:32.198642 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:48:32.200058 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:UPDATE=4 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:48:32.201066 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-957c5c19-b616-4bf7-a07d-68b545e328c2 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Returning 404 to user: Instance b7c9f2aa-8e8c-4200-89ee-a107ea59256a could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:48:32.202908 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-957c5c19-b616-4bf7-a07d-68b545e328c2 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] 10.222.0.27 "GET /compute/v2.1/servers/b7c9f2aa-8e8c-4200-89ee-a107ea59256a" status: 404 len: 111 microversion: 2.1 time: 0.095048 Sep 08 10:48:32.204065 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1268/2563] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:32 2022] GET /compute/v2.1/servers/b7c9f2aa-8e8c-4200-89ee-a107ea59256a => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:48:32.211028 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-37dbcfbb-26fc-46a3-9bb1-18e7a2c188d3 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:32.212853 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-37dbcfbb-26fc-46a3-9bb1-18e7a2c188d3 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: 3766b195-ace4-4563-a24e-dca72941251e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:32.221910 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b62a01ba-b180-46f1-9a4b-249e14dfeb83 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.457099 Sep 08 10:48:32.222318 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-37dbcfbb-26fc-46a3-9bb1-18e7a2c188d3 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:32.223107 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-37dbcfbb-26fc-46a3-9bb1-18e7a2c188d3 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:32.223982 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-37dbcfbb-26fc-46a3-9bb1-18e7a2c188d3 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:32.224929 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-37dbcfbb-26fc-46a3-9bb1-18e7a2c188d3 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:32.225653 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-37dbcfbb-26fc-46a3-9bb1-18e7a2c188d3 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:32.226397 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-37dbcfbb-26fc-46a3-9bb1-18e7a2c188d3 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:32.230559 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1296/2564] 10.222.0.27 () {60 vars in 1159 bytes} [Thu Sep 8 10:48:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:48:32.316566 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-e573c3ef-cb8c-4642-9ddf-787851879f45 req-d10e1ed6-5d7f-44dd-ad58-830594484778 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3766b195-ace4-4563-a24e-dca72941251e", "name": "network-vif-deleted", "tag": "67c1a6b2-cd91-4a27-a9a4-731db0f530a7"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:48:32.346402 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e573c3ef-cb8c-4642-9ddf-787851879f45 req-d10e1ed6-5d7f-44dd-ad58-830594484778 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:32.347133 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e573c3ef-cb8c-4642-9ddf-787851879f45 req-d10e1ed6-5d7f-44dd-ad58-830594484778 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:32.347787 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e573c3ef-cb8c-4642-9ddf-787851879f45 req-d10e1ed6-5d7f-44dd-ad58-830594484778 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:32.400965 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-e573c3ef-cb8c-4642-9ddf-787851879f45 req-d10e1ed6-5d7f-44dd-ad58-830594484778 service nova] Creating event network-vif-deleted:67c1a6b2-cd91-4a27-a9a4-731db0f530a7 for instance 3766b195-ace4-4563-a24e-dca72941251e on n-h2-850501-12 Sep 08 10:48:32.419218 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-e573c3ef-cb8c-4642-9ddf-787851879f45 req-d10e1ed6-5d7f-44dd-ad58-830594484778 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106313 Sep 08 10:48:32.420526 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1297/2565] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:48:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:48:32.549750 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7c99e764-0970-407c-b1ea-70ddbd24d7bd tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:32.552317 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7c99e764-0970-407c-b1ea-70ddbd24d7bd tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] [instance: 83d65df7-eb49-46ce-815a-54fbb3725661] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:32.564784 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c99e764-0970-407c-b1ea-70ddbd24d7bd tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:32.568279 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c99e764-0970-407c-b1ea-70ddbd24d7bd tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:32.568862 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c99e764-0970-407c-b1ea-70ddbd24d7bd tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:32.570554 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c99e764-0970-407c-b1ea-70ddbd24d7bd tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:32.571437 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c99e764-0970-407c-b1ea-70ddbd24d7bd tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:32.576411 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c99e764-0970-407c-b1ea-70ddbd24d7bd tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:32.582649 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:48:32.667948 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-37dbcfbb-26fc-46a3-9bb1-18e7a2c188d3 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c083657f0a4cebbc0804cd5d5ea4ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb93f8524768458a974c348b981921d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:32.687847 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-37dbcfbb-26fc-46a3-9bb1-18e7a2c188d3 tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e" status: 200 len: 1427 microversion: 2.1 time: 0.481987 Sep 08 10:48:32.689565 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1269/2566] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:32 2022] GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e => generated 1427 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:32.794077 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bc879be8-d9d0-4247-967e-7629b00c0543 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:32.794729 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bc879be8-d9d0-4247-967e-7629b00c0543 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] [instance: 814d8327-fc0e-4846-a449-598e482d71c6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:32.811599 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bc879be8-d9d0-4247-967e-7629b00c0543 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:32.815196 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bc879be8-d9d0-4247-967e-7629b00c0543 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:32.815731 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bc879be8-d9d0-4247-967e-7629b00c0543 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:32.819990 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bc879be8-d9d0-4247-967e-7629b00c0543 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:32.820828 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bc879be8-d9d0-4247-967e-7629b00c0543 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:32.821493 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bc879be8-d9d0-4247-967e-7629b00c0543 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:33.100699 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7c99e764-0970-407c-b1ea-70ddbd24d7bd tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd975c3a56545fa938752d2b72be872', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e481d7d8204631b72aaef2d6279c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:33.122929 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7c99e764-0970-407c-b1ea-70ddbd24d7bd tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] 10.222.0.27 "GET /compute/v2.1/servers/83d65df7-eb49-46ce-815a-54fbb3725661" status: 200 len: 1509 microversion: 2.1 time: 0.580588 Sep 08 10:48:33.148187 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1298/2567] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:32 2022] GET /compute/v2.1/servers/83d65df7-eb49-46ce-815a-54fbb3725661 => generated 1509 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:33.169812 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0ac9a940-acfb-49a7-8f01-a480a08e08ee tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:33.170541 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0ac9a940-acfb-49a7-8f01-a480a08e08ee tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: 272b4680-9e7e-41dd-afa5-3116aa92665b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:33.189339 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ac9a940-acfb-49a7-8f01-a480a08e08ee tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:33.190100 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ac9a940-acfb-49a7-8f01-a480a08e08ee tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:33.190701 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ac9a940-acfb-49a7-8f01-a480a08e08ee tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:33.192314 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ac9a940-acfb-49a7-8f01-a480a08e08ee tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:33.193116 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ac9a940-acfb-49a7-8f01-a480a08e08ee tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:33.194227 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ac9a940-acfb-49a7-8f01-a480a08e08ee tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:33.607748 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0ac9a940-acfb-49a7-8f01-a480a08e08ee tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c291cbe955b4ee5abc98132dda0255e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f9a24cad014d7f827e8f3236dd5bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:33.616601 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0ac9a940-acfb-49a7-8f01-a480a08e08ee tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/272b4680-9e7e-41dd-afa5-3116aa92665b" status: 200 len: 1366 microversion: 2.1 time: 0.466852 Sep 08 10:48:33.617446 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1299/2568] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:33 2022] GET /compute/v2.1/servers/272b4680-9e7e-41dd-afa5-3116aa92665b => generated 1366 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:33.721191 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b60a81b2-cec1-418b-88e9-8bd43b300ccd tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:33.722671 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b60a81b2-cec1-418b-88e9-8bd43b300ccd tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] [instance: 3766b195-ace4-4563-a24e-dca72941251e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:33.737701 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b60a81b2-cec1-418b-88e9-8bd43b300ccd tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:33.739438 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b60a81b2-cec1-418b-88e9-8bd43b300ccd tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:33.741628 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b60a81b2-cec1-418b-88e9-8bd43b300ccd tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:33.743142 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b60a81b2-cec1-418b-88e9-8bd43b300ccd tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:33.744463 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b60a81b2-cec1-418b-88e9-8bd43b300ccd tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:33.745168 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b60a81b2-cec1-418b-88e9-8bd43b300ccd tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:33.799646 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-b60a81b2-cec1-418b-88e9-8bd43b300ccd tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] HTTP exception thrown: Instance 3766b195-ace4-4563-a24e-dca72941251e could not be found. Sep 08 10:48:33.802012 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b60a81b2-cec1-418b-88e9-8bd43b300ccd tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Request method failure captured: Sep 08 10:48:33.802012 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e HTTP/1.1 Sep 08 10:48:33.802012 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:48:33.802012 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:48:33.802012 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:48:33.802012 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:48:33.802012 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:48:33.802012 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:48:33.802012 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:48:33.802012 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:48:33.802012 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGce62zDaM5lK2luTZl9BOLMK0pc_-xKbcmjRS_RkIBRZFFByYFOX29rDKNzb-L9mtn_MAYtDYWpNXjR0dCrd1CjlTMFVc7r1o5XcWzpGXaSZivOMeHxuMBcso5JKK7QW9nLFbnuS4n9lRSqYoy521PhzBqJN1Lhkb_6A_JTVZ9UGgBI Sep 08 10:48:33.802012 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:48:33.802012 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:48:33.802012 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:48:33.802012 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:48:33.802012 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:48:33.802012 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:48:33.802012 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: eb93f8524768458a974c348b981921d5 Sep 08 10:48:33.802012 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersAdminTestJSON-318045889 Sep 08 10:48:33.802012 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:48:33.802012 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:48:33.802012 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/eb93f8524768458a974c348b981921d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eb93f8524768458a974c348b981921d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_eb93f8524768458a974c348b981921d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eb93f8524768458a974c348b981921d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:48:33.802012 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServersAdminTestJSON-318045889 Sep 08 10:48:33.802012 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: eb93f8524768458a974c348b981921d5 Sep 08 10:48:33.802012 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersAdminTestJSON-318045889 Sep 08 10:48:33.802012 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServersAdminTestJSON-318045889-project Sep 08 10:48:33.802012 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:48:33.802012 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:48:33.802012 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: c1c083657f0a4cebbc0804cd5d5ea4ad Sep 08 10:48:33.802012 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServersAdminTestJSON-318045889-project Sep 08 10:48:33.802012 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:48:33.802012 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 3766b195-ace4-4563-a24e-dca72941251e could not be found. Sep 08 10:48:33.802012 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '3766b195-ace4-4563-a24e-dca72941251e'} Sep 08 10:48:33.802012 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:48:33.802012 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:48:33.802012 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:48:33.802012 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:48:33.802012 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:48:33.802012 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:48:33.802012 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:48:33.802012 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:48:33.802012 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:48:33.802012 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:48:33.802012 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3766b195-ace4-4563-a24e-dca72941251e could not be found. Sep 08 10:48:33.802012 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:48:33.802012 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:48:33.802012 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:48:33.802012 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:48:33.802012 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:48:33.802012 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:48:33.802012 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:48:33.802012 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:48:33.802012 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:48:33.802012 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:48:33.802012 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:48:33.802012 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:48:33.802012 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:48:33.802012 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:48:33.802012 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:48:33.802012 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:48:33.802012 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3766b195-ace4-4563-a24e-dca72941251e could not be found. Sep 08 10:48:33.802012 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:48:33.802012 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:48:33.802012 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:48:33.807063 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:48:33.807063 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:48:33.807063 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:48:33.807063 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:48:33.807063 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:48:33.807063 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3766b195-ace4-4563-a24e-dca72941251e could not be found. Sep 08 10:48:33.807063 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:48:33.810180 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b60a81b2-cec1-418b-88e9-8bd43b300ccd tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] Returning 404 to user: Instance 3766b195-ace4-4563-a24e-dca72941251e could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:48:33.811309 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b60a81b2-cec1-418b-88e9-8bd43b300ccd tempest-ServersAdminTestJSON-318045889 tempest-ServersAdminTestJSON-318045889-project] 10.222.0.27 "GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e" status: 404 len: 111 microversion: 2.1 time: 0.097028 Sep 08 10:48:33.815557 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1300/2569] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:33 2022] GET /compute/v2.1/servers/3766b195-ace4-4563-a24e-dca72941251e => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 10:48:33.928071 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-bc879be8-d9d0-4247-967e-7629b00c0543 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6f265811ad4ccf866fb8094782dd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9a5f2a2b4f460dad3731b0ce6ecebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:33.938828 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bc879be8-d9d0-4247-967e-7629b00c0543 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] 10.222.0.27 "GET /compute/v2.1/servers/814d8327-fc0e-4846-a449-598e482d71c6" status: 200 len: 1320 microversion: 2.1 time: 1.150667 Sep 08 10:48:33.961213 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1270/2570] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:32 2022] GET /compute/v2.1/servers/814d8327-fc0e-4846-a449-598e482d71c6 => generated 1320 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:34.155062 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-05a55a15-0a86-4956-aafe-379f24e051a6 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:34.155687 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-05a55a15-0a86-4956-aafe-379f24e051a6 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] [instance: 83d65df7-eb49-46ce-815a-54fbb3725661] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:34.169797 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-05a55a15-0a86-4956-aafe-379f24e051a6 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:34.174317 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-05a55a15-0a86-4956-aafe-379f24e051a6 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:34.176208 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-05a55a15-0a86-4956-aafe-379f24e051a6 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:34.177517 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-05a55a15-0a86-4956-aafe-379f24e051a6 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:34.182726 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-05a55a15-0a86-4956-aafe-379f24e051a6 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:34.184620 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-05a55a15-0a86-4956-aafe-379f24e051a6 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:34.343485 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-2716b456-3996-4f9c-871a-798a05112f46 req-27660aa1-d488-49b0-83c6-3f01428be268 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83d65df7-eb49-46ce-815a-54fbb3725661", "name": "network-vif-deleted", "tag": "f161d99b-33c5-4181-874f-078895df4a10"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:48:34.371772 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-2716b456-3996-4f9c-871a-798a05112f46 req-27660aa1-d488-49b0-83c6-3f01428be268 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:34.378558 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-2716b456-3996-4f9c-871a-798a05112f46 req-27660aa1-d488-49b0-83c6-3f01428be268 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:34.379294 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-2716b456-3996-4f9c-871a-798a05112f46 req-27660aa1-d488-49b0-83c6-3f01428be268 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:34.427042 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-05a55a15-0a86-4956-aafe-379f24e051a6 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd975c3a56545fa938752d2b72be872', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e481d7d8204631b72aaef2d6279c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:34.438054 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-2716b456-3996-4f9c-871a-798a05112f46 req-27660aa1-d488-49b0-83c6-3f01428be268 service nova] Creating event network-vif-deleted:f161d99b-33c5-4181-874f-078895df4a10 for instance 83d65df7-eb49-46ce-815a-54fbb3725661 on n-h1-850501-12 Sep 08 10:48:34.445184 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-05a55a15-0a86-4956-aafe-379f24e051a6 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] 10.222.0.27 "GET /compute/v2.1/servers/83d65df7-eb49-46ce-815a-54fbb3725661" status: 200 len: 1300 microversion: 2.1 time: 0.295824 Sep 08 10:48:34.470726 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1301/2571] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:34 2022] GET /compute/v2.1/servers/83d65df7-eb49-46ce-815a-54fbb3725661 => generated 1300 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:34.483903 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-2716b456-3996-4f9c-871a-798a05112f46 req-27660aa1-d488-49b0-83c6-3f01428be268 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158576 Sep 08 10:48:34.486319 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1271/2572] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:48:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Sep 08 10:48:34.645330 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9a4ef03b-620c-41ff-b250-825fa3764af1 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:34.646163 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9a4ef03b-620c-41ff-b250-825fa3764af1 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: 272b4680-9e7e-41dd-afa5-3116aa92665b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:34.665687 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9a4ef03b-620c-41ff-b250-825fa3764af1 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:34.667370 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9a4ef03b-620c-41ff-b250-825fa3764af1 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:34.670106 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9a4ef03b-620c-41ff-b250-825fa3764af1 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:34.680901 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9a4ef03b-620c-41ff-b250-825fa3764af1 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:34.681653 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9a4ef03b-620c-41ff-b250-825fa3764af1 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:34.682294 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9a4ef03b-620c-41ff-b250-825fa3764af1 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:34.983597 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-79ef62be-0cf0-4bd8-81a3-d580f070a6e6 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:34.984524 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-79ef62be-0cf0-4bd8-81a3-d580f070a6e6 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] [instance: 814d8327-fc0e-4846-a449-598e482d71c6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:35.002565 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-79ef62be-0cf0-4bd8-81a3-d580f070a6e6 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:35.003200 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-79ef62be-0cf0-4bd8-81a3-d580f070a6e6 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:35.005414 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-79ef62be-0cf0-4bd8-81a3-d580f070a6e6 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:35.008577 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-79ef62be-0cf0-4bd8-81a3-d580f070a6e6 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:35.010304 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-79ef62be-0cf0-4bd8-81a3-d580f070a6e6 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:35.013043 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-79ef62be-0cf0-4bd8-81a3-d580f070a6e6 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:35.484574 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9a4ef03b-620c-41ff-b250-825fa3764af1 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c291cbe955b4ee5abc98132dda0255e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f9a24cad014d7f827e8f3236dd5bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:35.505426 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9a4ef03b-620c-41ff-b250-825fa3764af1 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/272b4680-9e7e-41dd-afa5-3116aa92665b" status: 200 len: 1556 microversion: 2.1 time: 0.864363 Sep 08 10:48:35.508954 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1302/2573] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:34 2022] GET /compute/v2.1/servers/272b4680-9e7e-41dd-afa5-3116aa92665b => generated 1556 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:35.520801 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-50d41e5f-8599-46bd-b14c-c31607fb18ed tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:35.522192 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-50d41e5f-8599-46bd-b14c-c31607fb18ed tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] [instance: 83d65df7-eb49-46ce-815a-54fbb3725661] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:35.542977 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-50d41e5f-8599-46bd-b14c-c31607fb18ed tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:35.544791 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-50d41e5f-8599-46bd-b14c-c31607fb18ed tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:35.550768 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-50d41e5f-8599-46bd-b14c-c31607fb18ed tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:35.554826 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-50d41e5f-8599-46bd-b14c-c31607fb18ed tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:35.560501 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-50d41e5f-8599-46bd-b14c-c31607fb18ed tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:35.562465 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-50d41e5f-8599-46bd-b14c-c31607fb18ed tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:35.605593 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-50d41e5f-8599-46bd-b14c-c31607fb18ed tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] HTTP exception thrown: Instance 83d65df7-eb49-46ce-815a-54fbb3725661 could not be found. Sep 08 10:48:35.610592 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-50d41e5f-8599-46bd-b14c-c31607fb18ed tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Request method failure captured: Sep 08 10:48:35.610592 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/83d65df7-eb49-46ce-815a-54fbb3725661 HTTP/1.1 Sep 08 10:48:35.610592 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:48:35.610592 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:48:35.610592 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:48:35.610592 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:48:35.610592 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:48:35.610592 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:48:35.610592 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:48:35.610592 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:48:35.610592 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGchkff2SnN5d2S3HeLY9eyheF9Wkx9o6CaRhYxRkZ_O6ARZq9sT0R9G10ozyjAihMa17JpmK3XMKIeg9kqlWUShrNs2kyFtoEqxoOTluAgxyQf2s7hMsHsSaEfHhNvThAFOO0a_m69p6Jz5Z4qwWeGz0b6v5XQhkYmC-pkZgPUzxVvg Sep 08 10:48:35.610592 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:48:35.610592 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:48:35.610592 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:48:35.610592 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:48:35.610592 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:48:35.610592 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:48:35.610592 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 07e481d7d8204631b72aaef2d6279c49 Sep 08 10:48:35.610592 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ImagesNegativeTestJSON-535395489 Sep 08 10:48:35.610592 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:48:35.610592 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:48:35.610592 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/07e481d7d8204631b72aaef2d6279c49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/07e481d7d8204631b72aaef2d6279c49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_07e481d7d8204631b72aaef2d6279c49"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/07e481d7d8204631b72aaef2d6279c49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:48:35.610592 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ImagesNegativeTestJSON-535395489 Sep 08 10:48:35.610592 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 07e481d7d8204631b72aaef2d6279c49 Sep 08 10:48:35.610592 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-535395489 Sep 08 10:48:35.610592 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ImagesNegativeTestJSON-535395489-project Sep 08 10:48:35.610592 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:48:35.610592 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:48:35.610592 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 0fd975c3a56545fa938752d2b72be872 Sep 08 10:48:35.610592 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ImagesNegativeTestJSON-535395489-project Sep 08 10:48:35.610592 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:48:35.610592 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 83d65df7-eb49-46ce-815a-54fbb3725661 could not be found. Sep 08 10:48:35.610592 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '83d65df7-eb49-46ce-815a-54fbb3725661'} Sep 08 10:48:35.610592 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:48:35.610592 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:48:35.610592 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:48:35.610592 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:48:35.610592 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:48:35.610592 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:48:35.610592 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:48:35.610592 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:48:35.610592 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:48:35.610592 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:48:35.610592 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83d65df7-eb49-46ce-815a-54fbb3725661 could not be found. Sep 08 10:48:35.610592 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:48:35.610592 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:48:35.610592 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:48:35.610592 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:48:35.610592 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:48:35.610592 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:48:35.610592 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:48:35.610592 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:48:35.610592 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:48:35.610592 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:48:35.610592 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:48:35.610592 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:48:35.610592 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:48:35.610592 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:48:35.610592 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:48:35.610592 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:48:35.610592 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83d65df7-eb49-46ce-815a-54fbb3725661 could not be found. Sep 08 10:48:35.610592 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:48:35.610592 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:48:35.610592 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:48:35.614282 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:48:35.614282 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:48:35.614282 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:48:35.614282 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:48:35.614282 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:48:35.614282 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83d65df7-eb49-46ce-815a-54fbb3725661 could not be found. Sep 08 10:48:35.614282 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:48:35.618559 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-50d41e5f-8599-46bd-b14c-c31607fb18ed tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Returning 404 to user: Instance 83d65df7-eb49-46ce-815a-54fbb3725661 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:48:35.624929 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-50d41e5f-8599-46bd-b14c-c31607fb18ed tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] 10.222.0.27 "GET /compute/v2.1/servers/83d65df7-eb49-46ce-815a-54fbb3725661" status: 404 len: 111 microversion: 2.1 time: 0.113744 Sep 08 10:48:35.628782 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1303/2574] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:35 2022] GET /compute/v2.1/servers/83d65df7-eb49-46ce-815a-54fbb3725661 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:48:35.635625 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-063677a7-c083-425b-a888-2a0fd4df7831 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:35.637123 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-063677a7-c083-425b-a888-2a0fd4df7831 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: 272b4680-9e7e-41dd-afa5-3116aa92665b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:35.656094 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-063677a7-c083-425b-a888-2a0fd4df7831 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:35.656615 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-063677a7-c083-425b-a888-2a0fd4df7831 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:35.658978 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-063677a7-c083-425b-a888-2a0fd4df7831 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:35.662319 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-063677a7-c083-425b-a888-2a0fd4df7831 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:35.663042 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-063677a7-c083-425b-a888-2a0fd4df7831 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:35.664114 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-063677a7-c083-425b-a888-2a0fd4df7831 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:35.732194 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-79ef62be-0cf0-4bd8-81a3-d580f070a6e6 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6f265811ad4ccf866fb8094782dd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9a5f2a2b4f460dad3731b0ce6ecebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:35.774889 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-79ef62be-0cf0-4bd8-81a3-d580f070a6e6 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] 10.222.0.27 "GET /compute/v2.1/servers/814d8327-fc0e-4846-a449-598e482d71c6" status: 200 len: 1320 microversion: 2.1 time: 0.778886 Sep 08 10:48:35.781363 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1272/2575] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:34 2022] GET /compute/v2.1/servers/814d8327-fc0e-4846-a449-598e482d71c6 => generated 1320 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:48:35.795080 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-59f791c1-0df1-45c7-b940-a918c7ac4938 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1439991863", "metadata": {"image_type": "test"}}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:48:35.804785 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-59f791c1-0df1-45c7-b940-a918c7ac4938 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] [instance: 83d65df7-eb49-46ce-815a-54fbb3725661] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:35.835735 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-59f791c1-0df1-45c7-b940-a918c7ac4938 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:35.841684 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-59f791c1-0df1-45c7-b940-a918c7ac4938 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:35.842636 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-59f791c1-0df1-45c7-b940-a918c7ac4938 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:35.848927 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-59f791c1-0df1-45c7-b940-a918c7ac4938 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:35.851047 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-59f791c1-0df1-45c7-b940-a918c7ac4938 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:35.852622 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-59f791c1-0df1-45c7-b940-a918c7ac4938 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:35.905778 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-59f791c1-0df1-45c7-b940-a918c7ac4938 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] HTTP exception thrown: Instance 83d65df7-eb49-46ce-815a-54fbb3725661 could not be found. Sep 08 10:48:35.907557 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-59f791c1-0df1-45c7-b940-a918c7ac4938 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Request method failure captured: Sep 08 10:48:35.907557 n-d-850501-12 devstack@n-api.service[128861]: request: POST /compute/v2.1/servers/83d65df7-eb49-46ce-815a-54fbb3725661/action HTTP/1.1 Sep 08 10:48:35.907557 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:48:35.907557 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:48:35.907557 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:48:35.907557 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 112 Sep 08 10:48:35.907557 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:48:35.907557 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:48:35.907557 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:48:35.907557 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:48:35.907557 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGchkff2SnN5d2S3HeLY9eyheF9Wkx9o6CaRhYxRkZ_O6ARZq9sT0R9G10ozyjAihMa17JpmK3XMKIeg9kqlWUShrNs2kyFtoEqxoOTluAgxyQf2s7hMsHsSaEfHhNvThAFOO0a_m69p6Jz5Z4qwWeGz0b6v5XQhkYmC-pkZgPUzxVvg Sep 08 10:48:35.907557 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:48:35.907557 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:48:35.907557 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:48:35.907557 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:48:35.907557 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:48:35.907557 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:48:35.907557 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 07e481d7d8204631b72aaef2d6279c49 Sep 08 10:48:35.907557 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ImagesNegativeTestJSON-535395489 Sep 08 10:48:35.907557 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:48:35.907557 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:48:35.907557 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/07e481d7d8204631b72aaef2d6279c49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/07e481d7d8204631b72aaef2d6279c49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_07e481d7d8204631b72aaef2d6279c49"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/07e481d7d8204631b72aaef2d6279c49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:48:35.907557 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ImagesNegativeTestJSON-535395489 Sep 08 10:48:35.907557 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 07e481d7d8204631b72aaef2d6279c49 Sep 08 10:48:35.907557 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-535395489 Sep 08 10:48:35.907557 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ImagesNegativeTestJSON-535395489-project Sep 08 10:48:35.907557 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:48:35.907557 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:48:35.907557 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 0fd975c3a56545fa938752d2b72be872 Sep 08 10:48:35.907557 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ImagesNegativeTestJSON-535395489-project Sep 08 10:48:35.907557 n-d-850501-12 devstack@n-api.service[128861]: Sep 08 10:48:35.907557 n-d-850501-12 devstack@n-api.service[128861]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1439991863", "metadata": {"image_type": "test"}}} Sep 08 10:48:35.907557 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:48:35.907557 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 83d65df7-eb49-46ce-815a-54fbb3725661 could not be found. Sep 08 10:48:35.907557 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '83d65df7-eb49-46ce-815a-54fbb3725661', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1439991863', 'metadata': {'image_type': 'test'}}}} Sep 08 10:48:35.907557 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:48:35.907557 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:48:35.907557 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:48:35.907557 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:48:35.907557 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:48:35.907557 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:48:35.907557 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:48:35.907557 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:48:35.907557 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:48:35.907557 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:48:35.907557 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83d65df7-eb49-46ce-815a-54fbb3725661 could not be found. Sep 08 10:48:35.907557 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:48:35.907557 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:48:35.907557 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:48:35.907557 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:48:35.907557 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:48:35.907557 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:48:35.907557 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:48:35.907557 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:48:35.907557 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:48:35.907557 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:48:35.907557 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:48:35.907557 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:48:35.907557 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:48:35.907557 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:48:35.907557 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 08 10:48:35.907557 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 08 10:48:35.907557 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:48:35.912006 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:48:35.912006 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:48:35.912006 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:48:35.912006 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83d65df7-eb49-46ce-815a-54fbb3725661 could not be found. Sep 08 10:48:35.912006 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:48:35.912006 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:48:35.912006 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:48:35.912006 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:48:35.912006 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:48:35.912006 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:48:35.912006 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:48:35.912006 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:48:35.912006 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83d65df7-eb49-46ce-815a-54fbb3725661 could not be found. Sep 08 10:48:35.912006 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:48:35.920750 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-59f791c1-0df1-45c7-b940-a918c7ac4938 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Returning 404 to user: Instance 83d65df7-eb49-46ce-815a-54fbb3725661 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:48:35.923613 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-59f791c1-0df1-45c7-b940-a918c7ac4938 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] 10.222.0.27 "POST /compute/v2.1/servers/83d65df7-eb49-46ce-815a-54fbb3725661/action" status: 404 len: 111 microversion: 2.1 time: 0.140749 Sep 08 10:48:35.927230 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1273/2576] 10.222.0.27 () {60 vars in 1279 bytes} [Thu Sep 8 10:48:35 2022] POST /compute/v2.1/servers/83d65df7-eb49-46ce-815a-54fbb3725661/action => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:48:35.937938 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-43f3b1ed-0cca-4580-a4ac-ec440b1f0e79 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:35.950559 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-43f3b1ed-0cca-4580-a4ac-ec440b1f0e79 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '528fc9fbb57149c9a9c755c6497f5c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effe8e6c23114b8ab80e76bec365de60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:35.951791 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-43f3b1ed-0cca-4580-a4ac-ec440b1f0e79 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Searching by: {'deleted': False, 'project_id': 'effe8e6c23114b8ab80e76bec365de60'} {{(pid=128861) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:48:35.967063 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-43f3b1ed-0cca-4580-a4ac-ec440b1f0e79 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:35.968207 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-43f3b1ed-0cca-4580-a4ac-ec440b1f0e79 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:35.968857 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-43f3b1ed-0cca-4580-a4ac-ec440b1f0e79 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:35.969840 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-43f3b1ed-0cca-4580-a4ac-ec440b1f0e79 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:35.970507 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-43f3b1ed-0cca-4580-a4ac-ec440b1f0e79 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:35.971168 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-43f3b1ed-0cca-4580-a4ac-ec440b1f0e79 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:36.000195 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-063677a7-c083-425b-a888-2a0fd4df7831 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/272b4680-9e7e-41dd-afa5-3116aa92665b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.369873 Sep 08 10:48:36.001059 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1304/2577] 10.222.0.27 () {58 vars in 1275 bytes} [Thu Sep 8 10:48:35 2022] GET /compute/v2.1/servers/272b4680-9e7e-41dd-afa5-3116aa92665b/os-interface => generated 284 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:48:36.006165 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-796051cf-0c37-415c-9000-c7ab5f1ea5a5 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-989911644", "metadata": {"image_type": "test"}}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:48:36.018215 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-796051cf-0c37-415c-9000-c7ab5f1ea5a5 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Failed to fetch instance by id tempest-invalid-1573020094 {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 08 10:48:36.019155 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-796051cf-0c37-415c-9000-c7ab5f1ea5a5 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] HTTP exception thrown: Instance tempest-invalid-1573020094 could not be found. Sep 08 10:48:36.022184 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-796051cf-0c37-415c-9000-c7ab5f1ea5a5 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Request method failure captured: Sep 08 10:48:36.022184 n-d-850501-12 devstack@n-api.service[128862]: request: POST /compute/v2.1/servers/tempest-invalid-1573020094/action HTTP/1.1 Sep 08 10:48:36.022184 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:48:36.022184 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:48:36.022184 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:48:36.022184 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 111 Sep 08 10:48:36.022184 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:48:36.022184 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:48:36.022184 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:48:36.022184 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:48:36.022184 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGchkff2SnN5d2S3HeLY9eyheF9Wkx9o6CaRhYxRkZ_O6ARZq9sT0R9G10ozyjAihMa17JpmK3XMKIeg9kqlWUShrNs2kyFtoEqxoOTluAgxyQf2s7hMsHsSaEfHhNvThAFOO0a_m69p6Jz5Z4qwWeGz0b6v5XQhkYmC-pkZgPUzxVvg Sep 08 10:48:36.022184 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:48:36.022184 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:48:36.022184 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:48:36.022184 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:48:36.022184 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:48:36.022184 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:48:36.022184 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 07e481d7d8204631b72aaef2d6279c49 Sep 08 10:48:36.022184 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ImagesNegativeTestJSON-535395489 Sep 08 10:48:36.022184 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:48:36.022184 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:48:36.022184 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/07e481d7d8204631b72aaef2d6279c49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/07e481d7d8204631b72aaef2d6279c49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_07e481d7d8204631b72aaef2d6279c49"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/07e481d7d8204631b72aaef2d6279c49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:48:36.022184 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ImagesNegativeTestJSON-535395489 Sep 08 10:48:36.022184 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 07e481d7d8204631b72aaef2d6279c49 Sep 08 10:48:36.022184 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-535395489 Sep 08 10:48:36.022184 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ImagesNegativeTestJSON-535395489-project Sep 08 10:48:36.022184 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:48:36.022184 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:48:36.022184 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 0fd975c3a56545fa938752d2b72be872 Sep 08 10:48:36.022184 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ImagesNegativeTestJSON-535395489-project Sep 08 10:48:36.022184 n-d-850501-12 devstack@n-api.service[128862]: Sep 08 10:48:36.022184 n-d-850501-12 devstack@n-api.service[128862]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-989911644", "metadata": {"image_type": "test"}}} Sep 08 10:48:36.022184 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:48:36.022184 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance tempest-invalid-1573020094 could not be found. Sep 08 10:48:36.022184 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'tempest-invalid-1573020094', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-989911644', 'metadata': {'image_type': 'test'}}}} Sep 08 10:48:36.022184 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:48:36.022184 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:48:36.022184 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:48:36.022184 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:48:36.022184 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 08 10:48:36.022184 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 08 10:48:36.022184 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1573020094 could not be found. Sep 08 10:48:36.022184 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:48:36.022184 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:48:36.022184 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:48:36.022184 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:48:36.022184 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:48:36.022184 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:48:36.022184 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:48:36.022184 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:48:36.022184 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:48:36.022184 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:48:36.022184 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:48:36.022184 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:48:36.022184 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:48:36.022184 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:48:36.022184 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 08 10:48:36.022184 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 08 10:48:36.022184 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:48:36.022184 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:48:36.022184 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:48:36.022184 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:48:36.022184 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1573020094 could not be found. Sep 08 10:48:36.026238 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:48:36.026238 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:48:36.026238 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:48:36.026238 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:48:36.026238 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:48:36.026238 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:48:36.026238 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:48:36.026238 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:48:36.026238 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1573020094 could not be found. Sep 08 10:48:36.026238 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:48:36.029903 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-796051cf-0c37-415c-9000-c7ab5f1ea5a5 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Returning 404 to user: Instance tempest-invalid-1573020094 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:48:36.036786 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-796051cf-0c37-415c-9000-c7ab5f1ea5a5 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] 10.222.0.27 "POST /compute/v2.1/servers/tempest-invalid-1573020094/action" status: 404 len: 101 microversion: 2.1 time: 0.034396 Sep 08 10:48:36.039317 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1305/2578] 10.222.0.27 () {60 vars in 1249 bytes} [Thu Sep 8 10:48:36 2022] POST /compute/v2.1/servers/tempest-invalid-1573020094/action => generated 101 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:48:36.051566 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.multi_cell_list [None req-43f3b1ed-0cca-4580-a4ac-ec440b1f0e79 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128861) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 10:48:36.062851 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e60818c3-9431-434e-aad1-fe413f6cf965 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1509869160"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:48:36.075179 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e60818c3-9431-434e-aad1-fe413f6cf965 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 08 10:48:36.085480 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-e60818c3-9431-434e-aad1-fe413f6cf965 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 08 10:48:36.088028 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e60818c3-9431-434e-aad1-fe413f6cf965 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Request method failure captured: Sep 08 10:48:36.088028 n-d-850501-12 devstack@n-api.service[128862]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Sep 08 10:48:36.088028 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:48:36.088028 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:48:36.088028 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:48:36.088028 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 57 Sep 08 10:48:36.088028 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:48:36.088028 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:48:36.088028 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:48:36.088028 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:48:36.088028 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGchkff2SnN5d2S3HeLY9eyheF9Wkx9o6CaRhYxRkZ_O6ARZq9sT0R9G10ozyjAihMa17JpmK3XMKIeg9kqlWUShrNs2kyFtoEqxoOTluAgxyQf2s7hMsHsSaEfHhNvThAFOO0a_m69p6Jz5Z4qwWeGz0b6v5XQhkYmC-pkZgPUzxVvg Sep 08 10:48:36.088028 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:48:36.088028 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:48:36.088028 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:48:36.088028 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:48:36.088028 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:48:36.088028 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:48:36.088028 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 07e481d7d8204631b72aaef2d6279c49 Sep 08 10:48:36.088028 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ImagesNegativeTestJSON-535395489 Sep 08 10:48:36.088028 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:48:36.088028 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:48:36.088028 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/07e481d7d8204631b72aaef2d6279c49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/07e481d7d8204631b72aaef2d6279c49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_07e481d7d8204631b72aaef2d6279c49"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/07e481d7d8204631b72aaef2d6279c49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:48:36.088028 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ImagesNegativeTestJSON-535395489 Sep 08 10:48:36.088028 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 07e481d7d8204631b72aaef2d6279c49 Sep 08 10:48:36.088028 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-535395489 Sep 08 10:48:36.088028 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ImagesNegativeTestJSON-535395489-project Sep 08 10:48:36.088028 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:48:36.088028 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:48:36.088028 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 0fd975c3a56545fa938752d2b72be872 Sep 08 10:48:36.088028 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ImagesNegativeTestJSON-535395489-project Sep 08 10:48:36.088028 n-d-850501-12 devstack@n-api.service[128862]: Sep 08 10:48:36.088028 n-d-850501-12 devstack@n-api.service[128862]: {"createImage": {"name": "tempest-test-snap-1509869160"}} Sep 08 10:48:36.088028 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:48:36.088028 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 08 10:48:36.088028 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1509869160'}}} Sep 08 10:48:36.088028 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:48:36.088028 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:48:36.088028 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:48:36.088028 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:48:36.088028 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 08 10:48:36.088028 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 08 10:48:36.088028 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 08 10:48:36.088028 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:48:36.088028 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:48:36.088028 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:48:36.088028 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:48:36.088028 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:48:36.088028 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:48:36.088028 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:48:36.088028 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:48:36.088028 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:48:36.088028 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:48:36.088028 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:48:36.088028 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:48:36.088028 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:48:36.088028 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:48:36.088028 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 08 10:48:36.088028 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 08 10:48:36.088028 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:48:36.088028 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:48:36.088028 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:48:36.088028 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:48:36.088028 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 08 10:48:36.088028 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:48:36.092082 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:48:36.092082 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:48:36.092082 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:48:36.092082 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:48:36.092082 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:48:36.092082 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:48:36.092082 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:48:36.092082 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 08 10:48:36.092082 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:48:36.100065 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e60818c3-9431-434e-aad1-fe413f6cf965 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:48:36.101271 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e60818c3-9431-434e-aad1-fe413f6cf965 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] 10.222.0.27 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.054865 Sep 08 10:48:36.111664 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1306/2579] 10.222.0.27 () {60 vars in 1275 bytes} [Thu Sep 8 10:48:36 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:48:36.124385 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c9880a67-7a64-4710-a32b-4eabea23fcb1 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1653954641"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:48:36.145017 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c9880a67-7a64-4710-a32b-4eabea23fcb1 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 08 10:48:36.159917 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-c9880a67-7a64-4710-a32b-4eabea23fcb1 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 08 10:48:36.161781 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c9880a67-7a64-4710-a32b-4eabea23fcb1 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Request method failure captured: Sep 08 10:48:36.161781 n-d-850501-12 devstack@n-api.service[128862]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Sep 08 10:48:36.161781 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:48:36.161781 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:48:36.161781 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:48:36.161781 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 57 Sep 08 10:48:36.161781 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:48:36.161781 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:48:36.161781 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:48:36.161781 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:48:36.161781 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGchkff2SnN5d2S3HeLY9eyheF9Wkx9o6CaRhYxRkZ_O6ARZq9sT0R9G10ozyjAihMa17JpmK3XMKIeg9kqlWUShrNs2kyFtoEqxoOTluAgxyQf2s7hMsHsSaEfHhNvThAFOO0a_m69p6Jz5Z4qwWeGz0b6v5XQhkYmC-pkZgPUzxVvg Sep 08 10:48:36.161781 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:48:36.161781 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:48:36.161781 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:48:36.161781 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:48:36.161781 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:48:36.161781 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:48:36.161781 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 07e481d7d8204631b72aaef2d6279c49 Sep 08 10:48:36.161781 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ImagesNegativeTestJSON-535395489 Sep 08 10:48:36.161781 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:48:36.161781 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:48:36.161781 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/07e481d7d8204631b72aaef2d6279c49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/07e481d7d8204631b72aaef2d6279c49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_07e481d7d8204631b72aaef2d6279c49"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/07e481d7d8204631b72aaef2d6279c49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:48:36.161781 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ImagesNegativeTestJSON-535395489 Sep 08 10:48:36.161781 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 07e481d7d8204631b72aaef2d6279c49 Sep 08 10:48:36.161781 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-535395489 Sep 08 10:48:36.161781 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ImagesNegativeTestJSON-535395489-project Sep 08 10:48:36.161781 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:48:36.161781 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:48:36.161781 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 0fd975c3a56545fa938752d2b72be872 Sep 08 10:48:36.161781 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ImagesNegativeTestJSON-535395489-project Sep 08 10:48:36.161781 n-d-850501-12 devstack@n-api.service[128862]: Sep 08 10:48:36.161781 n-d-850501-12 devstack@n-api.service[128862]: {"createImage": {"name": "tempest-test-snap-1653954641"}} Sep 08 10:48:36.161781 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:48:36.161781 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 08 10:48:36.161781 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1653954641'}}} Sep 08 10:48:36.161781 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:48:36.161781 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:48:36.161781 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:48:36.161781 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:48:36.161781 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 08 10:48:36.161781 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 08 10:48:36.161781 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 08 10:48:36.161781 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:48:36.161781 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:48:36.161781 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:48:36.161781 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:48:36.161781 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:48:36.161781 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:48:36.161781 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:48:36.161781 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:48:36.161781 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:48:36.161781 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:48:36.161781 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:48:36.161781 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:48:36.161781 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:48:36.161781 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:48:36.161781 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 08 10:48:36.161781 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 08 10:48:36.161781 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:48:36.161781 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:48:36.161781 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:48:36.161781 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:48:36.161781 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 08 10:48:36.161781 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:48:36.166184 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:48:36.166184 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:48:36.166184 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:48:36.166184 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:48:36.166184 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:48:36.166184 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:48:36.166184 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:48:36.166184 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 08 10:48:36.166184 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:48:36.170150 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c9880a67-7a64-4710-a32b-4eabea23fcb1 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:48:36.171227 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c9880a67-7a64-4710-a32b-4eabea23fcb1 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] 10.222.0.27 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.053036 Sep 08 10:48:36.178402 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1307/2580] 10.222.0.27 () {60 vars in 1281 bytes} [Thu Sep 8 10:48:36 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:48:36.188750 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-43f3b1ed-0cca-4580-a4ac-ec440b1f0e79 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.260129 Sep 08 10:48:36.193773 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1274/2581] 10.222.0.27 () {58 vars in 1125 bytes} [Thu Sep 8 10:48:35 2022] GET /compute/v2.1/servers => generated 344 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:48:36.212015 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3e871a85-d620-424a-8ef6-fab67a2624d2 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:36.213353 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3e871a85-d620-424a-8ef6-fab67a2624d2 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] [instance: 83d65df7-eb49-46ce-815a-54fbb3725661] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:36.233238 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-50b664bb-ff0b-426f-84fc-a76b430cc76c tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:36.246679 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-50b664bb-ff0b-426f-84fc-a76b430cc76c tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '528fc9fbb57149c9a9c755c6497f5c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effe8e6c23114b8ab80e76bec365de60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:36.251709 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e871a85-d620-424a-8ef6-fab67a2624d2 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:36.252489 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e871a85-d620-424a-8ef6-fab67a2624d2 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:36.253181 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e871a85-d620-424a-8ef6-fab67a2624d2 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:36.255191 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-50b664bb-ff0b-426f-84fc-a76b430cc76c tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Searching by: {'deleted': False, 'project_id': 'effe8e6c23114b8ab80e76bec365de60'} {{(pid=128861) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:48:36.256230 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e871a85-d620-424a-8ef6-fab67a2624d2 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:36.257604 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e871a85-d620-424a-8ef6-fab67a2624d2 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:36.260896 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e871a85-d620-424a-8ef6-fab67a2624d2 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:36.271627 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-50b664bb-ff0b-426f-84fc-a76b430cc76c tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:36.277376 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-50b664bb-ff0b-426f-84fc-a76b430cc76c tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:36.278359 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-50b664bb-ff0b-426f-84fc-a76b430cc76c tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:36.286346 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-50b664bb-ff0b-426f-84fc-a76b430cc76c tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:36.287597 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-50b664bb-ff0b-426f-84fc-a76b430cc76c tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:36.290023 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-50b664bb-ff0b-426f-84fc-a76b430cc76c tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:36.307465 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-3e871a85-d620-424a-8ef6-fab67a2624d2 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] HTTP exception thrown: Instance 83d65df7-eb49-46ce-815a-54fbb3725661 could not be found. Sep 08 10:48:36.315191 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3e871a85-d620-424a-8ef6-fab67a2624d2 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Request method failure captured: Sep 08 10:48:36.315191 n-d-850501-12 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/servers/83d65df7-eb49-46ce-815a-54fbb3725661 HTTP/1.1 Sep 08 10:48:36.315191 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:48:36.315191 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:48:36.315191 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:48:36.315191 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:48:36.315191 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:48:36.315191 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:48:36.315191 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:48:36.315191 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:48:36.315191 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGchkff2SnN5d2S3HeLY9eyheF9Wkx9o6CaRhYxRkZ_O6ARZq9sT0R9G10ozyjAihMa17JpmK3XMKIeg9kqlWUShrNs2kyFtoEqxoOTluAgxyQf2s7hMsHsSaEfHhNvThAFOO0a_m69p6Jz5Z4qwWeGz0b6v5XQhkYmC-pkZgPUzxVvg Sep 08 10:48:36.315191 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:48:36.315191 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:48:36.315191 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:48:36.315191 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:48:36.315191 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:48:36.315191 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:48:36.315191 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 07e481d7d8204631b72aaef2d6279c49 Sep 08 10:48:36.315191 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ImagesNegativeTestJSON-535395489 Sep 08 10:48:36.315191 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:48:36.315191 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:48:36.315191 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/07e481d7d8204631b72aaef2d6279c49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/07e481d7d8204631b72aaef2d6279c49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_07e481d7d8204631b72aaef2d6279c49"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/07e481d7d8204631b72aaef2d6279c49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:48:36.315191 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ImagesNegativeTestJSON-535395489 Sep 08 10:48:36.315191 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 07e481d7d8204631b72aaef2d6279c49 Sep 08 10:48:36.315191 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-535395489 Sep 08 10:48:36.315191 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ImagesNegativeTestJSON-535395489-project Sep 08 10:48:36.315191 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:48:36.315191 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:48:36.315191 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 0fd975c3a56545fa938752d2b72be872 Sep 08 10:48:36.315191 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ImagesNegativeTestJSON-535395489-project Sep 08 10:48:36.315191 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:48:36.315191 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 83d65df7-eb49-46ce-815a-54fbb3725661 could not be found. Sep 08 10:48:36.315191 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '83d65df7-eb49-46ce-815a-54fbb3725661'} Sep 08 10:48:36.315191 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:48:36.315191 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:48:36.315191 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:48:36.315191 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:48:36.315191 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:48:36.315191 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:48:36.315191 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:48:36.315191 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:48:36.315191 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:48:36.315191 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:48:36.315191 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83d65df7-eb49-46ce-815a-54fbb3725661 could not be found. Sep 08 10:48:36.315191 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:48:36.315191 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:48:36.315191 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:48:36.315191 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:48:36.315191 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:48:36.315191 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:48:36.315191 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:48:36.315191 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:48:36.315191 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:48:36.315191 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:48:36.315191 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:48:36.315191 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:48:36.315191 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:48:36.315191 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:48:36.315191 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:48:36.315191 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:48:36.315191 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:48:36.315191 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:48:36.318868 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83d65df7-eb49-46ce-815a-54fbb3725661 could not be found. Sep 08 10:48:36.318868 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:48:36.318868 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:48:36.318868 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:48:36.318868 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:48:36.318868 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:48:36.318868 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:48:36.318868 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:48:36.318868 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:48:36.318868 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83d65df7-eb49-46ce-815a-54fbb3725661 could not be found. Sep 08 10:48:36.318868 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:48:36.321203 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3e871a85-d620-424a-8ef6-fab67a2624d2 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Returning 404 to user: Instance 83d65df7-eb49-46ce-815a-54fbb3725661 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:48:36.326444 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3e871a85-d620-424a-8ef6-fab67a2624d2 tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] 10.222.0.27 "DELETE /compute/v2.1/servers/83d65df7-eb49-46ce-815a-54fbb3725661" status: 404 len: 111 microversion: 2.1 time: 0.137048 Sep 08 10:48:36.327647 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1308/2582] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:48:36 2022] DELETE /compute/v2.1/servers/83d65df7-eb49-46ce-815a-54fbb3725661 => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:48:36.339973 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3dfd7b29-5510-4d48-b873-4f4e9f1a773f tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:36.349462 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3dfd7b29-5510-4d48-b873-4f4e9f1a773f tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] [instance: 83d65df7-eb49-46ce-815a-54fbb3725661] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:36.352077 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.multi_cell_list [None req-50b664bb-ff0b-426f-84fc-a76b430cc76c tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128861) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 10:48:36.364195 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3dfd7b29-5510-4d48-b873-4f4e9f1a773f tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:36.367736 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3dfd7b29-5510-4d48-b873-4f4e9f1a773f tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:36.371752 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3dfd7b29-5510-4d48-b873-4f4e9f1a773f tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:36.373338 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3dfd7b29-5510-4d48-b873-4f4e9f1a773f tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:36.375161 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3dfd7b29-5510-4d48-b873-4f4e9f1a773f tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:36.376186 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3dfd7b29-5510-4d48-b873-4f4e9f1a773f tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:36.396034 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-50b664bb-ff0b-426f-84fc-a76b430cc76c tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528fc9fbb57149c9a9c755c6497f5c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effe8e6c23114b8ab80e76bec365de60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:36.405192 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-50b664bb-ff0b-426f-84fc-a76b430cc76c tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:36.406048 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-50b664bb-ff0b-426f-84fc-a76b430cc76c tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:36.406652 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-50b664bb-ff0b-426f-84fc-a76b430cc76c tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:36.414054 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-3dfd7b29-5510-4d48-b873-4f4e9f1a773f tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] HTTP exception thrown: Instance 83d65df7-eb49-46ce-815a-54fbb3725661 could not be found. Sep 08 10:48:36.416534 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3dfd7b29-5510-4d48-b873-4f4e9f1a773f tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Request method failure captured: Sep 08 10:48:36.416534 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/83d65df7-eb49-46ce-815a-54fbb3725661 HTTP/1.1 Sep 08 10:48:36.416534 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:48:36.416534 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:48:36.416534 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:48:36.416534 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:48:36.416534 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:48:36.416534 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:48:36.416534 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:48:36.416534 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:48:36.416534 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGchkff2SnN5d2S3HeLY9eyheF9Wkx9o6CaRhYxRkZ_O6ARZq9sT0R9G10ozyjAihMa17JpmK3XMKIeg9kqlWUShrNs2kyFtoEqxoOTluAgxyQf2s7hMsHsSaEfHhNvThAFOO0a_m69p6Jz5Z4qwWeGz0b6v5XQhkYmC-pkZgPUzxVvg Sep 08 10:48:36.416534 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:48:36.416534 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:48:36.416534 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:48:36.416534 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:48:36.416534 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:48:36.416534 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:48:36.416534 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 07e481d7d8204631b72aaef2d6279c49 Sep 08 10:48:36.416534 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ImagesNegativeTestJSON-535395489 Sep 08 10:48:36.416534 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:48:36.416534 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:48:36.416534 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/07e481d7d8204631b72aaef2d6279c49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/07e481d7d8204631b72aaef2d6279c49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_07e481d7d8204631b72aaef2d6279c49"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/07e481d7d8204631b72aaef2d6279c49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:48:36.416534 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ImagesNegativeTestJSON-535395489 Sep 08 10:48:36.416534 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 07e481d7d8204631b72aaef2d6279c49 Sep 08 10:48:36.416534 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-535395489 Sep 08 10:48:36.416534 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ImagesNegativeTestJSON-535395489-project Sep 08 10:48:36.416534 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:48:36.416534 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:48:36.416534 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 0fd975c3a56545fa938752d2b72be872 Sep 08 10:48:36.416534 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ImagesNegativeTestJSON-535395489-project Sep 08 10:48:36.416534 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:48:36.416534 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 83d65df7-eb49-46ce-815a-54fbb3725661 could not be found. Sep 08 10:48:36.416534 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '83d65df7-eb49-46ce-815a-54fbb3725661'} Sep 08 10:48:36.416534 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:48:36.416534 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:48:36.416534 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:48:36.416534 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:48:36.416534 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:48:36.416534 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:48:36.416534 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:48:36.416534 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:48:36.416534 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:48:36.416534 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:48:36.416534 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83d65df7-eb49-46ce-815a-54fbb3725661 could not be found. Sep 08 10:48:36.416534 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:48:36.416534 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:48:36.416534 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:48:36.416534 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:48:36.416534 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:48:36.416534 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:48:36.416534 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:48:36.416534 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:48:36.416534 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:48:36.416534 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:48:36.416534 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:48:36.416534 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:48:36.416534 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:48:36.416534 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:48:36.416534 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:48:36.416534 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:48:36.416534 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83d65df7-eb49-46ce-815a-54fbb3725661 could not be found. Sep 08 10:48:36.416534 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:48:36.416534 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:48:36.416534 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:48:36.421272 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:48:36.421272 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:48:36.421272 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:48:36.421272 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:48:36.421272 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:48:36.421272 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83d65df7-eb49-46ce-815a-54fbb3725661 could not be found. Sep 08 10:48:36.421272 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:48:36.427413 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3dfd7b29-5510-4d48-b873-4f4e9f1a773f tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] Returning 404 to user: Instance 83d65df7-eb49-46ce-815a-54fbb3725661 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:48:36.429346 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3dfd7b29-5510-4d48-b873-4f4e9f1a773f tempest-ImagesNegativeTestJSON-535395489 tempest-ImagesNegativeTestJSON-535395489-project] 10.222.0.27 "GET /compute/v2.1/servers/83d65df7-eb49-46ce-815a-54fbb3725661" status: 404 len: 111 microversion: 2.1 time: 0.097152 Sep 08 10:48:36.435442 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1309/2583] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:36 2022] GET /compute/v2.1/servers/83d65df7-eb49-46ce-815a-54fbb3725661 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:48:36.809662 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d5b24e78-f21f-4995-a3ca-177c4ef838e2 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:36.811151 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d5b24e78-f21f-4995-a3ca-177c4ef838e2 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] [instance: 814d8327-fc0e-4846-a449-598e482d71c6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:36.825477 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d5b24e78-f21f-4995-a3ca-177c4ef838e2 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:36.826441 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d5b24e78-f21f-4995-a3ca-177c4ef838e2 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:36.827149 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d5b24e78-f21f-4995-a3ca-177c4ef838e2 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:36.828153 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d5b24e78-f21f-4995-a3ca-177c4ef838e2 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:36.830901 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d5b24e78-f21f-4995-a3ca-177c4ef838e2 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:36.831639 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d5b24e78-f21f-4995-a3ca-177c4ef838e2 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:37.128830 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-50b664bb-ff0b-426f-84fc-a76b430cc76c tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] 10.222.0.27 "GET /compute/v2.1/servers/detail" status: 200 len: 1604 microversion: 2.1 time: 0.924312 Sep 08 10:48:37.129840 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1275/2584] 10.222.0.27 () {58 vars in 1146 bytes} [Thu Sep 8 10:48:36 2022] GET /compute/v2.1/servers/detail => generated 1604 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:37.155884 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-73aa6df8-9572-497b-bfa3-e2086a46ce0c tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:37.168767 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-73aa6df8-9572-497b-bfa3-e2086a46ce0c tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016670 Sep 08 10:48:37.184438 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1276/2585] 10.222.0.27 () {58 vars in 1137 bytes} [Thu Sep 8 10:48:37 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:48:37.557491 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5c8c7a91-14ab-4227-b7ef-010c31d224ec tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:37.559421 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5c8c7a91-14ab-4227-b7ef-010c31d224ec tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] [instance: 4703a7bf-a1ba-4bba-8928-3c403f3f3f21] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:37.576139 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5c8c7a91-14ab-4227-b7ef-010c31d224ec tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:37.578300 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5c8c7a91-14ab-4227-b7ef-010c31d224ec tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:37.578912 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5c8c7a91-14ab-4227-b7ef-010c31d224ec tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:37.588728 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5c8c7a91-14ab-4227-b7ef-010c31d224ec tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:37.590009 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5c8c7a91-14ab-4227-b7ef-010c31d224ec tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:37.590950 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5c8c7a91-14ab-4227-b7ef-010c31d224ec tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:37.601405 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=100 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:48:37.657675 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5c8c7a91-14ab-4227-b7ef-010c31d224ec tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] [instance: 4703a7bf-a1ba-4bba-8928-3c403f3f3f21] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:48:37.923563 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5c8c7a91-14ab-4227-b7ef-010c31d224ec tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4703a7bf-a1ba-4bba-8928-3c403f3f3f21" status: 204 len: 0 microversion: 2.1 time: 0.376823 Sep 08 10:48:37.924342 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1277/2586] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:48:37 2022] DELETE /compute/v2.1/servers/4703a7bf-a1ba-4bba-8928-3c403f3f3f21 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:48:37.936927 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-56d918f1-99e1-4962-b9b7-8b5f81c75d0d tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:37.944375 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-56d918f1-99e1-4962-b9b7-8b5f81c75d0d tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] [instance: 4703a7bf-a1ba-4bba-8928-3c403f3f3f21] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:37.962605 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-56d918f1-99e1-4962-b9b7-8b5f81c75d0d tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:37.963390 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-56d918f1-99e1-4962-b9b7-8b5f81c75d0d tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:37.964053 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-56d918f1-99e1-4962-b9b7-8b5f81c75d0d tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:37.969983 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-56d918f1-99e1-4962-b9b7-8b5f81c75d0d tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:37.973298 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-56d918f1-99e1-4962-b9b7-8b5f81c75d0d tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:37.977709 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-56d918f1-99e1-4962-b9b7-8b5f81c75d0d tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:38.144536 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d5b24e78-f21f-4995-a3ca-177c4ef838e2 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6f265811ad4ccf866fb8094782dd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9a5f2a2b4f460dad3731b0ce6ecebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:38.164970 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d5b24e78-f21f-4995-a3ca-177c4ef838e2 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] 10.222.0.27 "GET /compute/v2.1/servers/814d8327-fc0e-4846-a449-598e482d71c6" status: 200 len: 1320 microversion: 2.1 time: 1.359985 Sep 08 10:48:38.177314 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1310/2587] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:36 2022] GET /compute/v2.1/servers/814d8327-fc0e-4846-a449-598e482d71c6 => generated 1320 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:38.493140 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-56d918f1-99e1-4962-b9b7-8b5f81c75d0d tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528fc9fbb57149c9a9c755c6497f5c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effe8e6c23114b8ab80e76bec365de60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:38.505254 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-56d918f1-99e1-4962-b9b7-8b5f81c75d0d tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] 10.222.0.27 "GET /compute/v2.1/servers/4703a7bf-a1ba-4bba-8928-3c403f3f3f21" status: 200 len: 1607 microversion: 2.1 time: 0.576256 Sep 08 10:48:38.509934 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1278/2588] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:37 2022] GET /compute/v2.1/servers/4703a7bf-a1ba-4bba-8928-3c403f3f3f21 => generated 1607 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:38.960513 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b2452cf0-2041-4725-803d-d1251ea88997 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1034131841", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "1ba9f101-4ece-4bc4-83f1-5d613330eede"}], "security_groups": [{"name": "tempest-securitygroup--1195061666"}], "key_name": "tempest-keypair-1259443957", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:48:39.179930 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e4b32061-d394-450c-a913-2c8962809cdc tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:39.180435 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e4b32061-d394-450c-a913-2c8962809cdc tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] [instance: 72eb7387-3f16-4b4f-ab9a-89076f169fc1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:39.196398 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e4b32061-d394-450c-a913-2c8962809cdc tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:39.201282 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e4b32061-d394-450c-a913-2c8962809cdc tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:39.202006 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e4b32061-d394-450c-a913-2c8962809cdc tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:39.204540 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e4b32061-d394-450c-a913-2c8962809cdc tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:39.205082 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e4b32061-d394-450c-a913-2c8962809cdc tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:39.205528 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e4b32061-d394-450c-a913-2c8962809cdc tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:39.272309 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e4b32061-d394-450c-a913-2c8962809cdc tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] [instance: 72eb7387-3f16-4b4f-ab9a-89076f169fc1] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:48:39.489908 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e4b32061-d394-450c-a913-2c8962809cdc tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] 10.222.0.27 "DELETE /compute/v2.1/servers/72eb7387-3f16-4b4f-ab9a-89076f169fc1" status: 204 len: 0 microversion: 2.1 time: 0.308823 Sep 08 10:48:39.493528 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1279/2589] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:48:39 2022] DELETE /compute/v2.1/servers/72eb7387-3f16-4b4f-ab9a-89076f169fc1 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:48:39.507859 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-794d18b1-1577-479e-b880-a5c1832c4ace tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:39.508607 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-794d18b1-1577-479e-b880-a5c1832c4ace tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] [instance: 814d8327-fc0e-4846-a449-598e482d71c6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:39.529973 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-794d18b1-1577-479e-b880-a5c1832c4ace tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:39.535135 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-794d18b1-1577-479e-b880-a5c1832c4ace tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:39.536326 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-794d18b1-1577-479e-b880-a5c1832c4ace tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:39.537319 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-794d18b1-1577-479e-b880-a5c1832c4ace tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:39.537816 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-794d18b1-1577-479e-b880-a5c1832c4ace tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:39.538264 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-794d18b1-1577-479e-b880-a5c1832c4ace tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:39.888604 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-b2452cf0-2041-4725-803d-d1251ea88997 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] validate_networks() for [('1ba9f101-4ece-4bc4-83f1-5d613330eede', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:48:40.367315 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-794d18b1-1577-479e-b880-a5c1832c4ace tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6f265811ad4ccf866fb8094782dd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9a5f2a2b4f460dad3731b0ce6ecebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:40.375681 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-794d18b1-1577-479e-b880-a5c1832c4ace tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] 10.222.0.27 "GET /compute/v2.1/servers/814d8327-fc0e-4846-a449-598e482d71c6" status: 200 len: 1320 microversion: 2.1 time: 0.879840 Sep 08 10:48:40.397474 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1280/2590] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:39 2022] GET /compute/v2.1/servers/814d8327-fc0e-4846-a449-598e482d71c6 => generated 1320 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:40.416710 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-694cbcad-d107-420f-8bb7-d5aa60eaa821 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:40.419046 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-694cbcad-d107-420f-8bb7-d5aa60eaa821 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] [instance: 72eb7387-3f16-4b4f-ab9a-89076f169fc1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:40.434066 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-694cbcad-d107-420f-8bb7-d5aa60eaa821 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:40.437116 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-694cbcad-d107-420f-8bb7-d5aa60eaa821 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:40.438476 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-694cbcad-d107-420f-8bb7-d5aa60eaa821 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:40.439441 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-694cbcad-d107-420f-8bb7-d5aa60eaa821 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:40.445175 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-694cbcad-d107-420f-8bb7-d5aa60eaa821 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:40.446035 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-694cbcad-d107-420f-8bb7-d5aa60eaa821 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:41.585562 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-b2452cf0-2041-4725-803d-d1251ea88997 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Getting quotas for project 065d7179ebd6460cb039bd1624296b57. Resources: dict_keys(['metadata_items']) {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:48:41.625411 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-b2452cf0-2041-4725-803d-d1251ea88997 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Getting quotas for user 54fb4a7dae3346d39f70c51055cfd455 and project 065d7179ebd6460cb039bd1624296b57. Resources: dict_keys(['metadata_items']) {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:48:41.673215 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-b2452cf0-2041-4725-803d-d1251ea88997 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:48:41.673653 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-b2452cf0-2041-4725-803d-d1251ea88997 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:48:41.674145 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-b2452cf0-2041-4725-803d-d1251ea88997 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:48:41.674565 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-b2452cf0-2041-4725-803d-d1251ea88997 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:48:41.674983 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-b2452cf0-2041-4725-803d-d1251ea88997 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:48:41.705972 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b2452cf0-2041-4725-803d-d1251ea88997 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:41.706881 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b2452cf0-2041-4725-803d-d1251ea88997 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:41.708974 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b2452cf0-2041-4725-803d-d1251ea88997 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:41.709942 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b2452cf0-2041-4725-803d-d1251ea88997 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:41.714814 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b2452cf0-2041-4725-803d-d1251ea88997 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:41.715396 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b2452cf0-2041-4725-803d-d1251ea88997 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:41.777569 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-b2452cf0-2041-4725-803d-d1251ea88997 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Getting quotas for project 065d7179ebd6460cb039bd1624296b57. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:48:41.809377 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-b2452cf0-2041-4725-803d-d1251ea88997 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Getting quotas for user 54fb4a7dae3346d39f70c51055cfd455 and project 065d7179ebd6460cb039bd1624296b57. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:48:41.845218 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b2452cf0-2041-4725-803d-d1251ea88997 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:48:41.851424 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b2452cf0-2041-4725-803d-d1251ea88997 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] [instance: a2469f0a-d6bc-46ae-8905-049f2123dc0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:48:41.987439 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b2452cf0-2041-4725-803d-d1251ea88997 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 3.034681 Sep 08 10:48:41.988766 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1311/2591] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:48:38 2022] POST /compute/v2.1/servers => generated 409 bytes in 3038 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:48:41.995918 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f4381855-5fb8-473d-a9c5-724461c0a1c0 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:41.998314 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f4381855-5fb8-473d-a9c5-724461c0a1c0 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] [instance: 4703a7bf-a1ba-4bba-8928-3c403f3f3f21] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:42.010795 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f4381855-5fb8-473d-a9c5-724461c0a1c0 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:42.011591 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f4381855-5fb8-473d-a9c5-724461c0a1c0 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:42.012895 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f4381855-5fb8-473d-a9c5-724461c0a1c0 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:42.013922 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f4381855-5fb8-473d-a9c5-724461c0a1c0 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:42.015005 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f4381855-5fb8-473d-a9c5-724461c0a1c0 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:42.015813 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f4381855-5fb8-473d-a9c5-724461c0a1c0 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:42.316819 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-694cbcad-d107-420f-8bb7-d5aa60eaa821 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ff38511b484fbcb7817a56076cf4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a768a3863448bca0c6cda11afdd955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:42.333146 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-694cbcad-d107-420f-8bb7-d5aa60eaa821 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] 10.222.0.27 "GET /compute/v2.1/servers/72eb7387-3f16-4b4f-ab9a-89076f169fc1" status: 200 len: 1681 microversion: 2.1 time: 1.932301 Sep 08 10:48:42.334711 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1281/2592] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:40 2022] GET /compute/v2.1/servers/72eb7387-3f16-4b4f-ab9a-89076f169fc1 => generated 1681 bytes in 1936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:42.341430 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-19d20564-fad3-4c50-8413-33df96ecdcd1 req-c04cc01b-1dcb-4dc0-b1d2-8d6e1a2f34fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "814d8327-fc0e-4846-a449-598e482d71c6", "name": "network-vif-plugged", "status": "completed", "tag": "b1d66584-8d5f-420b-abef-c3ed821e4f57"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:48:42.377622 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-19d20564-fad3-4c50-8413-33df96ecdcd1 req-c04cc01b-1dcb-4dc0-b1d2-8d6e1a2f34fa service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:42.379157 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-19d20564-fad3-4c50-8413-33df96ecdcd1 req-c04cc01b-1dcb-4dc0-b1d2-8d6e1a2f34fa service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:42.380687 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-19d20564-fad3-4c50-8413-33df96ecdcd1 req-c04cc01b-1dcb-4dc0-b1d2-8d6e1a2f34fa service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:42.435726 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-19d20564-fad3-4c50-8413-33df96ecdcd1 req-c04cc01b-1dcb-4dc0-b1d2-8d6e1a2f34fa service nova] Creating event network-vif-plugged:b1d66584-8d5f-420b-abef-c3ed821e4f57 for instance 814d8327-fc0e-4846-a449-598e482d71c6 on n-h2-850501-12 Sep 08 10:48:42.466176 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-19d20564-fad3-4c50-8413-33df96ecdcd1 req-c04cc01b-1dcb-4dc0-b1d2-8d6e1a2f34fa service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129718 Sep 08 10:48:42.488206 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1282/2593] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:48:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:48:42.502223 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f4381855-5fb8-473d-a9c5-724461c0a1c0 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528fc9fbb57149c9a9c755c6497f5c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effe8e6c23114b8ab80e76bec365de60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:42.539072 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1d389b63-44c1-4787-aaf8-88ad71abe3ae tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:42.539657 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f4381855-5fb8-473d-a9c5-724461c0a1c0 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] 10.222.0.27 "GET /compute/v2.1/servers/4703a7bf-a1ba-4bba-8928-3c403f3f3f21" status: 200 len: 1607 microversion: 2.1 time: 0.547751 Sep 08 10:48:42.540428 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1312/2594] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:41 2022] GET /compute/v2.1/servers/4703a7bf-a1ba-4bba-8928-3c403f3f3f21 => generated 1607 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:42.542021 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1d389b63-44c1-4787-aaf8-88ad71abe3ae tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] [instance: 814d8327-fc0e-4846-a449-598e482d71c6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:42.557641 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1d389b63-44c1-4787-aaf8-88ad71abe3ae tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:42.558580 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1d389b63-44c1-4787-aaf8-88ad71abe3ae tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:42.560601 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1d389b63-44c1-4787-aaf8-88ad71abe3ae tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:42.562912 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1d389b63-44c1-4787-aaf8-88ad71abe3ae tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:42.564595 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1d389b63-44c1-4787-aaf8-88ad71abe3ae tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:42.565330 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1d389b63-44c1-4787-aaf8-88ad71abe3ae tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:42.568873 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-75e31f30-8198-4c6e-9d85-e15de10ac576 req-91f1555d-fcc7-45a7-9a9f-909205dbdc29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "272b4680-9e7e-41dd-afa5-3116aa92665b", "tag": "722660b6-51c7-4a26-9625-53b4b04f69d8"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:48:42.620182 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-75e31f30-8198-4c6e-9d85-e15de10ac576 req-91f1555d-fcc7-45a7-9a9f-909205dbdc29 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:42.620838 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-75e31f30-8198-4c6e-9d85-e15de10ac576 req-91f1555d-fcc7-45a7-9a9f-909205dbdc29 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:42.621270 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-75e31f30-8198-4c6e-9d85-e15de10ac576 req-91f1555d-fcc7-45a7-9a9f-909205dbdc29 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:42.687062 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-75e31f30-8198-4c6e-9d85-e15de10ac576 req-91f1555d-fcc7-45a7-9a9f-909205dbdc29 service nova] Creating event network-changed:722660b6-51c7-4a26-9625-53b4b04f69d8 for instance 272b4680-9e7e-41dd-afa5-3116aa92665b on n-h2-850501-12 Sep 08 10:48:42.704221 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-75e31f30-8198-4c6e-9d85-e15de10ac576 req-91f1555d-fcc7-45a7-9a9f-909205dbdc29 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154178 Sep 08 10:48:42.708387 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1313/2595] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:48:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:48:42.740587 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-272cd3f7-2969-4c2a-bd8b-fa2881c24724 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:42.743171 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-272cd3f7-2969-4c2a-bd8b-fa2881c24724 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] [instance: a2469f0a-d6bc-46ae-8905-049f2123dc0c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:42.989232 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-272cd3f7-2969-4c2a-bd8b-fa2881c24724 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fb4a7dae3346d39f70c51055cfd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065d7179ebd6460cb039bd1624296b57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:43.008290 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-272cd3f7-2969-4c2a-bd8b-fa2881c24724 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] 10.222.0.27 "GET /compute/v2.1/servers/a2469f0a-d6bc-46ae-8905-049f2123dc0c" status: 200 len: 1278 microversion: 2.1 time: 0.297523 Sep 08 10:48:43.009944 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1314/2596] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:42 2022] GET /compute/v2.1/servers/a2469f0a-d6bc-46ae-8905-049f2123dc0c => generated 1278 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:43.302253 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-16ff276b-506c-4c6d-a52f-d5eef3b8b7d1 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-1241194006", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": "none"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:48:43.429514 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-16ff276b-506c-4c6d-a52f-d5eef3b8b7d1 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:48:43.430201 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-16ff276b-506c-4c6d-a52f-d5eef3b8b7d1 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:48:43.432353 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-16ff276b-506c-4c6d-a52f-d5eef3b8b7d1 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:48:43.433339 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-16ff276b-506c-4c6d-a52f-d5eef3b8b7d1 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:48:43.433944 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-16ff276b-506c-4c6d-a52f-d5eef3b8b7d1 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:48:43.446141 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-16ff276b-506c-4c6d-a52f-d5eef3b8b7d1 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:43.447592 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-16ff276b-506c-4c6d-a52f-d5eef3b8b7d1 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:43.448198 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-16ff276b-506c-4c6d-a52f-d5eef3b8b7d1 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:43.449351 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-16ff276b-506c-4c6d-a52f-d5eef3b8b7d1 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:43.449972 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-16ff276b-506c-4c6d-a52f-d5eef3b8b7d1 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:43.450926 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-16ff276b-506c-4c6d-a52f-d5eef3b8b7d1 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:43.497624 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-16ff276b-506c-4c6d-a52f-d5eef3b8b7d1 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Getting quotas for project c42be5dfd0dc4b13804883115d00368f. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:48:43.506970 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-16ff276b-506c-4c6d-a52f-d5eef3b8b7d1 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Getting quotas for user 97fc0451cafe4481a3f2d8bff575226c and project c42be5dfd0dc4b13804883115d00368f. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:48:43.525898 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-16ff276b-506c-4c6d-a52f-d5eef3b8b7d1 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:48:43.528904 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-16ff276b-506c-4c6d-a52f-d5eef3b8b7d1 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:48:43.614542 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-16ff276b-506c-4c6d-a52f-d5eef3b8b7d1 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.602876 Sep 08 10:48:43.615793 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1315/2597] 10.222.0.27 () {62 vars in 1188 bytes} [Thu Sep 8 10:48:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 605 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 08 10:48:43.621926 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ba1a3cc5-b078-4174-bdf6-f2f4faff0c79 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:43.622603 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ba1a3cc5-b078-4174-bdf6-f2f4faff0c79 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] [instance: 72eb7387-3f16-4b4f-ab9a-89076f169fc1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:43.631947 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba1a3cc5-b078-4174-bdf6-f2f4faff0c79 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:43.632318 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba1a3cc5-b078-4174-bdf6-f2f4faff0c79 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:43.632939 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba1a3cc5-b078-4174-bdf6-f2f4faff0c79 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:43.635120 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba1a3cc5-b078-4174-bdf6-f2f4faff0c79 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:43.636002 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba1a3cc5-b078-4174-bdf6-f2f4faff0c79 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:43.636456 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba1a3cc5-b078-4174-bdf6-f2f4faff0c79 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:43.866221 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1d389b63-44c1-4787-aaf8-88ad71abe3ae tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6f265811ad4ccf866fb8094782dd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9a5f2a2b4f460dad3731b0ce6ecebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:43.878522 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1d389b63-44c1-4787-aaf8-88ad71abe3ae tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] 10.222.0.27 "GET /compute/v2.1/servers/814d8327-fc0e-4846-a449-598e482d71c6" status: 200 len: 1320 microversion: 2.1 time: 1.361787 Sep 08 10:48:43.883052 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1283/2598] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:42 2022] GET /compute/v2.1/servers/814d8327-fc0e-4846-a449-598e482d71c6 => generated 1320 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:43.912309 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-730101be-bde5-4f9d-a7a8-8460ce10058c tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:43.916541 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-730101be-bde5-4f9d-a7a8-8460ce10058c tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] [instance: 4703a7bf-a1ba-4bba-8928-3c403f3f3f21] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:43.930644 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-730101be-bde5-4f9d-a7a8-8460ce10058c tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:43.936251 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-730101be-bde5-4f9d-a7a8-8460ce10058c tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:43.937405 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-730101be-bde5-4f9d-a7a8-8460ce10058c tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:43.938686 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-730101be-bde5-4f9d-a7a8-8460ce10058c tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:43.939584 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-730101be-bde5-4f9d-a7a8-8460ce10058c tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:43.940203 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-730101be-bde5-4f9d-a7a8-8460ce10058c tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:44.723097 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ba1a3cc5-b078-4174-bdf6-f2f4faff0c79 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ff38511b484fbcb7817a56076cf4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a768a3863448bca0c6cda11afdd955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:44.739584 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ba1a3cc5-b078-4174-bdf6-f2f4faff0c79 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] 10.222.0.27 "GET /compute/v2.1/servers/72eb7387-3f16-4b4f-ab9a-89076f169fc1" status: 200 len: 1681 microversion: 2.1 time: 1.122362 Sep 08 10:48:44.740639 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1316/2599] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:43 2022] GET /compute/v2.1/servers/72eb7387-3f16-4b4f-ab9a-89076f169fc1 => generated 1681 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:44.755880 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-97b91492-995c-4c9f-b270-a557e924e022 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:44.756769 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-97b91492-995c-4c9f-b270-a557e924e022 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:44.770301 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-97b91492-995c-4c9f-b270-a557e924e022 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:44.770821 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-97b91492-995c-4c9f-b270-a557e924e022 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:44.771272 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-97b91492-995c-4c9f-b270-a557e924e022 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:44.772036 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-97b91492-995c-4c9f-b270-a557e924e022 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:44.772514 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-97b91492-995c-4c9f-b270-a557e924e022 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:44.777249 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-97b91492-995c-4c9f-b270-a557e924e022 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:44.918382 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-97b91492-995c-4c9f-b270-a557e924e022 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:44.938013 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-97b91492-995c-4c9f-b270-a557e924e022 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:44.940517 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-97b91492-995c-4c9f-b270-a557e924e022 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:44.950113 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-97b91492-995c-4c9f-b270-a557e924e022 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1458 microversion: 2.91 time: 0.207114 Sep 08 10:48:44.952554 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1317/2600] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:48:44 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1458 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:48:44.966853 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0a78696a-8b37-4f66-8b3b-f1100a157b57 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:44.966853 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0a78696a-8b37-4f66-8b3b-f1100a157b57 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] [instance: a2469f0a-d6bc-46ae-8905-049f2123dc0c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:44.987152 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0a78696a-8b37-4f66-8b3b-f1100a157b57 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:44.987759 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0a78696a-8b37-4f66-8b3b-f1100a157b57 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:44.988220 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0a78696a-8b37-4f66-8b3b-f1100a157b57 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:44.988993 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0a78696a-8b37-4f66-8b3b-f1100a157b57 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:44.989637 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0a78696a-8b37-4f66-8b3b-f1100a157b57 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:44.990086 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0a78696a-8b37-4f66-8b3b-f1100a157b57 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:45.077309 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-730101be-bde5-4f9d-a7a8-8460ce10058c tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528fc9fbb57149c9a9c755c6497f5c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effe8e6c23114b8ab80e76bec365de60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:45.095037 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-730101be-bde5-4f9d-a7a8-8460ce10058c tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] 10.222.0.27 "GET /compute/v2.1/servers/4703a7bf-a1ba-4bba-8928-3c403f3f3f21" status: 200 len: 1607 microversion: 2.1 time: 1.191833 Sep 08 10:48:45.111997 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1284/2601] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:43 2022] GET /compute/v2.1/servers/4703a7bf-a1ba-4bba-8928-3c403f3f3f21 => generated 1607 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:45.132509 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5c63c4d4-7b79-4f97-be21-09cab6a7c8c1 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:45.137584 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5c63c4d4-7b79-4f97-be21-09cab6a7c8c1 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] [instance: 814d8327-fc0e-4846-a449-598e482d71c6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:45.148573 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5c63c4d4-7b79-4f97-be21-09cab6a7c8c1 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:45.149210 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5c63c4d4-7b79-4f97-be21-09cab6a7c8c1 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:45.150511 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5c63c4d4-7b79-4f97-be21-09cab6a7c8c1 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:45.153406 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5c63c4d4-7b79-4f97-be21-09cab6a7c8c1 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:45.154189 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5c63c4d4-7b79-4f97-be21-09cab6a7c8c1 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:45.155074 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5c63c4d4-7b79-4f97-be21-09cab6a7c8c1 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:45.232612 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0a78696a-8b37-4f66-8b3b-f1100a157b57 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fb4a7dae3346d39f70c51055cfd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065d7179ebd6460cb039bd1624296b57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:45.244888 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0a78696a-8b37-4f66-8b3b-f1100a157b57 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] 10.222.0.27 "GET /compute/v2.1/servers/a2469f0a-d6bc-46ae-8905-049f2123dc0c" status: 200 len: 1336 microversion: 2.1 time: 0.289207 Sep 08 10:48:45.248902 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1318/2602] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:44 2022] GET /compute/v2.1/servers/a2469f0a-d6bc-46ae-8905-049f2123dc0c => generated 1336 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:45.771204 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4d7bc98a-ad56-4c9d-bde2-a330c9996ff3 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:45.771897 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4d7bc98a-ad56-4c9d-bde2-a330c9996ff3 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] [instance: 72eb7387-3f16-4b4f-ab9a-89076f169fc1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:45.791879 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d7bc98a-ad56-4c9d-bde2-a330c9996ff3 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:45.792546 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d7bc98a-ad56-4c9d-bde2-a330c9996ff3 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:45.793011 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d7bc98a-ad56-4c9d-bde2-a330c9996ff3 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:45.793986 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d7bc98a-ad56-4c9d-bde2-a330c9996ff3 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:45.795296 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d7bc98a-ad56-4c9d-bde2-a330c9996ff3 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:45.795735 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d7bc98a-ad56-4c9d-bde2-a330c9996ff3 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:46.297180 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=4 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:48:46.391924 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:48:46.441544 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4d7bc98a-ad56-4c9d-bde2-a330c9996ff3 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ff38511b484fbcb7817a56076cf4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a768a3863448bca0c6cda11afdd955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:46.453626 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4d7bc98a-ad56-4c9d-bde2-a330c9996ff3 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] 10.222.0.27 "GET /compute/v2.1/servers/72eb7387-3f16-4b4f-ab9a-89076f169fc1" status: 200 len: 1681 microversion: 2.1 time: 0.686806 Sep 08 10:48:46.474387 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1319/2603] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:45 2022] GET /compute/v2.1/servers/72eb7387-3f16-4b4f-ab9a-89076f169fc1 => generated 1681 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:48:46.496537 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8c9c6bbe-a32e-4265-aa4c-f81d42c27c4c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:46.497654 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8c9c6bbe-a32e-4265-aa4c-f81d42c27c4c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:46.511064 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c9c6bbe-a32e-4265-aa4c-f81d42c27c4c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:46.513533 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c9c6bbe-a32e-4265-aa4c-f81d42c27c4c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:46.516046 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c9c6bbe-a32e-4265-aa4c-f81d42c27c4c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:46.517602 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c9c6bbe-a32e-4265-aa4c-f81d42c27c4c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:46.520840 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c9c6bbe-a32e-4265-aa4c-f81d42c27c4c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:46.521590 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c9c6bbe-a32e-4265-aa4c-f81d42c27c4c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:46.629501 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5c63c4d4-7b79-4f97-be21-09cab6a7c8c1 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6f265811ad4ccf866fb8094782dd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9a5f2a2b4f460dad3731b0ce6ecebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:46.659238 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8c9c6bbe-a32e-4265-aa4c-f81d42c27c4c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:46.685651 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5c63c4d4-7b79-4f97-be21-09cab6a7c8c1 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] 10.222.0.27 "GET /compute/v2.1/servers/814d8327-fc0e-4846-a449-598e482d71c6" status: 200 len: 1320 microversion: 2.1 time: 1.571814 Sep 08 10:48:46.692489 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1285/2604] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:45 2022] GET /compute/v2.1/servers/814d8327-fc0e-4846-a449-598e482d71c6 => generated 1320 bytes in 1581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:46.705419 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8c9c6bbe-a32e-4265-aa4c-f81d42c27c4c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:46.707553 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8c9c6bbe-a32e-4265-aa4c-f81d42c27c4c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:46.730993 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-daba65b1-3d6f-4e35-b742-927bcad55dc7 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:46.735200 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-daba65b1-3d6f-4e35-b742-927bcad55dc7 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] [instance: 4703a7bf-a1ba-4bba-8928-3c403f3f3f21] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:46.745487 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8c9c6bbe-a32e-4265-aa4c-f81d42c27c4c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1512 microversion: 2.91 time: 0.269465 Sep 08 10:48:46.746176 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1320/2605] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:48:46 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1512 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:48:46.762119 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-daba65b1-3d6f-4e35-b742-927bcad55dc7 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:46.762633 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-daba65b1-3d6f-4e35-b742-927bcad55dc7 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:46.763089 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-daba65b1-3d6f-4e35-b742-927bcad55dc7 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:46.766713 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-913a1178-ac0d-4d08-8813-d46e0e069e04 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:46.768341 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-daba65b1-3d6f-4e35-b742-927bcad55dc7 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:46.768846 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-daba65b1-3d6f-4e35-b742-927bcad55dc7 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:46.769399 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-daba65b1-3d6f-4e35-b742-927bcad55dc7 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:46.775555 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-913a1178-ac0d-4d08-8813-d46e0e069e04 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] [instance: a2469f0a-d6bc-46ae-8905-049f2123dc0c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:46.802618 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-913a1178-ac0d-4d08-8813-d46e0e069e04 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:46.803159 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-913a1178-ac0d-4d08-8813-d46e0e069e04 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:46.803619 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-913a1178-ac0d-4d08-8813-d46e0e069e04 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:46.804451 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-913a1178-ac0d-4d08-8813-d46e0e069e04 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:46.804927 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-913a1178-ac0d-4d08-8813-d46e0e069e04 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:46.805580 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-913a1178-ac0d-4d08-8813-d46e0e069e04 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:47.063734 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-daba65b1-3d6f-4e35-b742-927bcad55dc7 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528fc9fbb57149c9a9c755c6497f5c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effe8e6c23114b8ab80e76bec365de60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:47.088675 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-daba65b1-3d6f-4e35-b742-927bcad55dc7 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] 10.222.0.27 "GET /compute/v2.1/servers/4703a7bf-a1ba-4bba-8928-3c403f3f3f21" status: 200 len: 1540 microversion: 2.1 time: 0.394712 Sep 08 10:48:47.095733 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1286/2606] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:46 2022] GET /compute/v2.1/servers/4703a7bf-a1ba-4bba-8928-3c403f3f3f21 => generated 1540 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:47.109567 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-7aeea2f4-aff0-404c-8dde-26fb4f0c4eab req-88cbf5eb-4aa5-4794-ba5a-1bd6aa9c83f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72eb7387-3f16-4b4f-ab9a-89076f169fc1", "name": "network-vif-unplugged", "status": "completed", "tag": "64d36b81-597c-4cd5-8290-49272ddcb61d"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:48:47.137273 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-7aeea2f4-aff0-404c-8dde-26fb4f0c4eab req-88cbf5eb-4aa5-4794-ba5a-1bd6aa9c83f1 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:47.137777 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-7aeea2f4-aff0-404c-8dde-26fb4f0c4eab req-88cbf5eb-4aa5-4794-ba5a-1bd6aa9c83f1 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:47.138236 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-7aeea2f4-aff0-404c-8dde-26fb4f0c4eab req-88cbf5eb-4aa5-4794-ba5a-1bd6aa9c83f1 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:47.169791 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-7aeea2f4-aff0-404c-8dde-26fb4f0c4eab req-88cbf5eb-4aa5-4794-ba5a-1bd6aa9c83f1 service nova] Creating event network-vif-unplugged:64d36b81-597c-4cd5-8290-49272ddcb61d for instance 72eb7387-3f16-4b4f-ab9a-89076f169fc1 on n-h1-850501-12 Sep 08 10:48:47.192512 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-7aeea2f4-aff0-404c-8dde-26fb4f0c4eab req-88cbf5eb-4aa5-4794-ba5a-1bd6aa9c83f1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.093100 Sep 08 10:48:47.195361 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1287/2607] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:48:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:48:47.486282 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-d4a10c38-4f9d-4ec5-ba22-2ed11e90d7ed req-7cd00611-db65-454c-8c90-09373224e35a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4703a7bf-a1ba-4bba-8928-3c403f3f3f21", "name": "network-vif-deleted", "tag": "7692ba07-fea3-4d35-b24e-98c3a269cb03"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:48:47.526091 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-d4a10c38-4f9d-4ec5-ba22-2ed11e90d7ed req-7cd00611-db65-454c-8c90-09373224e35a service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:47.530784 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-d4a10c38-4f9d-4ec5-ba22-2ed11e90d7ed req-7cd00611-db65-454c-8c90-09373224e35a service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:47.531576 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-d4a10c38-4f9d-4ec5-ba22-2ed11e90d7ed req-7cd00611-db65-454c-8c90-09373224e35a service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:47.586144 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-d4a10c38-4f9d-4ec5-ba22-2ed11e90d7ed req-7cd00611-db65-454c-8c90-09373224e35a service nova] Creating event network-vif-deleted:7692ba07-fea3-4d35-b24e-98c3a269cb03 for instance 4703a7bf-a1ba-4bba-8928-3c403f3f3f21 on n-h2-850501-12 Sep 08 10:48:47.601621 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-d4a10c38-4f9d-4ec5-ba22-2ed11e90d7ed req-7cd00611-db65-454c-8c90-09373224e35a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120525 Sep 08 10:48:47.619101 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1288/2608] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:48:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:48:47.632912 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a0cbe1fc-98dc-4e1d-8eb9-3f188e4f528b tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:47.634687 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a0cbe1fc-98dc-4e1d-8eb9-3f188e4f528b tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] [instance: 72eb7387-3f16-4b4f-ab9a-89076f169fc1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:47.643621 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a0cbe1fc-98dc-4e1d-8eb9-3f188e4f528b tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:47.644865 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a0cbe1fc-98dc-4e1d-8eb9-3f188e4f528b tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:47.645622 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a0cbe1fc-98dc-4e1d-8eb9-3f188e4f528b tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:47.646660 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-913a1178-ac0d-4d08-8813-d46e0e069e04 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fb4a7dae3346d39f70c51055cfd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065d7179ebd6460cb039bd1624296b57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:47.646819 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a0cbe1fc-98dc-4e1d-8eb9-3f188e4f528b tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:47.647531 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a0cbe1fc-98dc-4e1d-8eb9-3f188e4f528b tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:47.648342 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a0cbe1fc-98dc-4e1d-8eb9-3f188e4f528b tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:47.673349 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-913a1178-ac0d-4d08-8813-d46e0e069e04 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] 10.222.0.27 "GET /compute/v2.1/servers/a2469f0a-d6bc-46ae-8905-049f2123dc0c" status: 200 len: 1404 microversion: 2.1 time: 0.905890 Sep 08 10:48:47.674338 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1321/2609] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:46 2022] GET /compute/v2.1/servers/a2469f0a-d6bc-46ae-8905-049f2123dc0c => generated 1404 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:47.723743 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dea5e662-9a69-4698-9140-172d7801bf94 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:47.724593 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-dea5e662-9a69-4698-9140-172d7801bf94 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] [instance: 814d8327-fc0e-4846-a449-598e482d71c6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:47.739361 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dea5e662-9a69-4698-9140-172d7801bf94 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:47.740032 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dea5e662-9a69-4698-9140-172d7801bf94 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:47.740496 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dea5e662-9a69-4698-9140-172d7801bf94 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:47.741299 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dea5e662-9a69-4698-9140-172d7801bf94 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:47.741874 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dea5e662-9a69-4698-9140-172d7801bf94 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:47.742310 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dea5e662-9a69-4698-9140-172d7801bf94 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:48.486054 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a0cbe1fc-98dc-4e1d-8eb9-3f188e4f528b tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ff38511b484fbcb7817a56076cf4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a768a3863448bca0c6cda11afdd955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:48.504851 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a0cbe1fc-98dc-4e1d-8eb9-3f188e4f528b tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] 10.222.0.27 "GET /compute/v2.1/servers/72eb7387-3f16-4b4f-ab9a-89076f169fc1" status: 200 len: 1614 microversion: 2.1 time: 0.879555 Sep 08 10:48:48.512159 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1289/2610] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:47 2022] GET /compute/v2.1/servers/72eb7387-3f16-4b4f-ab9a-89076f169fc1 => generated 1614 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:48.532066 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-375e5034-601d-4a80-b293-7898dc1f1e71 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:48.533388 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-375e5034-601d-4a80-b293-7898dc1f1e71 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:48.549013 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-375e5034-601d-4a80-b293-7898dc1f1e71 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:48.552905 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-375e5034-601d-4a80-b293-7898dc1f1e71 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:48.556023 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-375e5034-601d-4a80-b293-7898dc1f1e71 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:48.557312 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-375e5034-601d-4a80-b293-7898dc1f1e71 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:48.558575 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-375e5034-601d-4a80-b293-7898dc1f1e71 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:48.559456 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-375e5034-601d-4a80-b293-7898dc1f1e71 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:48.676151 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-dea5e662-9a69-4698-9140-172d7801bf94 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6f265811ad4ccf866fb8094782dd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9a5f2a2b4f460dad3731b0ce6ecebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:48.693716 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-dea5e662-9a69-4698-9140-172d7801bf94 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] 10.222.0.27 "GET /compute/v2.1/servers/814d8327-fc0e-4846-a449-598e482d71c6" status: 200 len: 1468 microversion: 2.1 time: 0.974031 Sep 08 10:48:48.699165 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1322/2611] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:47 2022] GET /compute/v2.1/servers/814d8327-fc0e-4846-a449-598e482d71c6 => generated 1468 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:48:48.710703 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dbc97af4-e12b-407f-a5ea-5f7cd855aa44 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:48.716667 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-dbc97af4-e12b-407f-a5ea-5f7cd855aa44 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] [instance: 4703a7bf-a1ba-4bba-8928-3c403f3f3f21] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:48.745767 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dbc97af4-e12b-407f-a5ea-5f7cd855aa44 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:48.750264 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dbc97af4-e12b-407f-a5ea-5f7cd855aa44 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:48.751285 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dbc97af4-e12b-407f-a5ea-5f7cd855aa44 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:48.754632 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dbc97af4-e12b-407f-a5ea-5f7cd855aa44 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:48.780109 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dbc97af4-e12b-407f-a5ea-5f7cd855aa44 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:48.781121 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dbc97af4-e12b-407f-a5ea-5f7cd855aa44 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:49.225770 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-375e5034-601d-4a80-b293-7898dc1f1e71 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:49.237383 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-375e5034-601d-4a80-b293-7898dc1f1e71 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:49.246130 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-375e5034-601d-4a80-b293-7898dc1f1e71 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:49.285981 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-dbc97af4-e12b-407f-a5ea-5f7cd855aa44 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528fc9fbb57149c9a9c755c6497f5c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effe8e6c23114b8ab80e76bec365de60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:49.289879 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:48:49.325811 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-dbc97af4-e12b-407f-a5ea-5f7cd855aa44 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] 10.222.0.27 "GET /compute/v2.1/servers/4703a7bf-a1ba-4bba-8928-3c403f3f3f21" status: 200 len: 1252 microversion: 2.1 time: 0.624215 Sep 08 10:48:49.326434 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1323/2612] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:48 2022] GET /compute/v2.1/servers/4703a7bf-a1ba-4bba-8928-3c403f3f3f21 => generated 1252 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:49.335285 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-375e5034-601d-4a80-b293-7898dc1f1e71 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1512 microversion: 2.91 time: 0.821932 Sep 08 10:48:49.336168 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1290/2613] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:48:48 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1512 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:48:49.355557 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a855611b-acc0-4efc-87ee-d24bd1d07925 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:49.359970 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-45466fb6-5458-4d6c-b98f-78dcef2f6aa7 tempest-ServersAdminNegativeTestJSON-680255960 tempest-ServersAdminNegativeTestJSON-680255960-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:48:49.364167 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a855611b-acc0-4efc-87ee-d24bd1d07925 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] [instance: a2469f0a-d6bc-46ae-8905-049f2123dc0c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:49.370700 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-45466fb6-5458-4d6c-b98f-78dcef2f6aa7 tempest-ServersAdminNegativeTestJSON-680255960 tempest-ServersAdminNegativeTestJSON-680255960-project-admin] [instance: 814d8327-fc0e-4846-a449-598e482d71c6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:49.388367 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a855611b-acc0-4efc-87ee-d24bd1d07925 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:49.388877 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a855611b-acc0-4efc-87ee-d24bd1d07925 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:49.389346 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a855611b-acc0-4efc-87ee-d24bd1d07925 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:49.394151 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a855611b-acc0-4efc-87ee-d24bd1d07925 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:49.395043 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-45466fb6-5458-4d6c-b98f-78dcef2f6aa7 tempest-ServersAdminNegativeTestJSON-680255960 tempest-ServersAdminNegativeTestJSON-680255960-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:49.395555 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-45466fb6-5458-4d6c-b98f-78dcef2f6aa7 tempest-ServersAdminNegativeTestJSON-680255960 tempest-ServersAdminNegativeTestJSON-680255960-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:49.396231 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a855611b-acc0-4efc-87ee-d24bd1d07925 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:49.399496 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-45466fb6-5458-4d6c-b98f-78dcef2f6aa7 tempest-ServersAdminNegativeTestJSON-680255960 tempest-ServersAdminNegativeTestJSON-680255960-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:49.400228 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-45466fb6-5458-4d6c-b98f-78dcef2f6aa7 tempest-ServersAdminNegativeTestJSON-680255960 tempest-ServersAdminNegativeTestJSON-680255960-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:49.400703 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-45466fb6-5458-4d6c-b98f-78dcef2f6aa7 tempest-ServersAdminNegativeTestJSON-680255960 tempest-ServersAdminNegativeTestJSON-680255960-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:49.401178 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-45466fb6-5458-4d6c-b98f-78dcef2f6aa7 tempest-ServersAdminNegativeTestJSON-680255960 tempest-ServersAdminNegativeTestJSON-680255960-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:49.413584 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a855611b-acc0-4efc-87ee-d24bd1d07925 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:49.460745 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-45466fb6-5458-4d6c-b98f-78dcef2f6aa7 tempest-ServersAdminNegativeTestJSON-680255960 tempest-ServersAdminNegativeTestJSON-680255960-project-admin] Lazy-loading 'flavor' on Instance uuid 814d8327-fc0e-4846-a449-598e482d71c6 {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:48:49.588285 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:48:49.719851 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-45466fb6-5458-4d6c-b98f-78dcef2f6aa7 tempest-ServersAdminNegativeTestJSON-680255960 tempest-ServersAdminNegativeTestJSON-680255960-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/814d8327-fc0e-4846-a449-598e482d71c6/action" status: 202 len: 0 microversion: 2.1 time: 0.381527 Sep 08 10:48:49.734630 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1291/2614] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:48:49 2022] POST /compute/v2.1/servers/814d8327-fc0e-4846-a449-598e482d71c6/action => generated 0 bytes in 397 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:48:49.755770 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-df485152-c8ea-4a62-a760-8c48848bc9c2 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:49.757135 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-df485152-c8ea-4a62-a760-8c48848bc9c2 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] [instance: 72eb7387-3f16-4b4f-ab9a-89076f169fc1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:49.781381 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-df485152-c8ea-4a62-a760-8c48848bc9c2 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:49.782038 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-df485152-c8ea-4a62-a760-8c48848bc9c2 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:49.782579 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-df485152-c8ea-4a62-a760-8c48848bc9c2 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:49.783401 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-df485152-c8ea-4a62-a760-8c48848bc9c2 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:49.784073 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-df485152-c8ea-4a62-a760-8c48848bc9c2 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:49.784607 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-df485152-c8ea-4a62-a760-8c48848bc9c2 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:49.870634 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-df485152-c8ea-4a62-a760-8c48848bc9c2 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:49.871284 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-df485152-c8ea-4a62-a760-8c48848bc9c2 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:49.871831 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-df485152-c8ea-4a62-a760-8c48848bc9c2 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:49.872402 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-df485152-c8ea-4a62-a760-8c48848bc9c2 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lazy-loading 'fault' on Instance uuid 72eb7387-3f16-4b4f-ab9a-89076f169fc1 {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:48:50.000983 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-df485152-c8ea-4a62-a760-8c48848bc9c2 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ff38511b484fbcb7817a56076cf4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a768a3863448bca0c6cda11afdd955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:50.017018 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-df485152-c8ea-4a62-a760-8c48848bc9c2 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] 10.222.0.27 "GET /compute/v2.1/servers/72eb7387-3f16-4b4f-ab9a-89076f169fc1" status: 200 len: 1331 microversion: 2.1 time: 0.280631 Sep 08 10:48:50.026937 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1292/2615] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:49 2022] GET /compute/v2.1/servers/72eb7387-3f16-4b4f-ab9a-89076f169fc1 => generated 1331 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:50.059364 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-618cd855-d8f6-45f7-a75d-da5bf895ab6c tempest-ServersAdminNegativeTestJSON-680255960 tempest-ServersAdminNegativeTestJSON-680255960-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:50.060518 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-618cd855-d8f6-45f7-a75d-da5bf895ab6c tempest-ServersAdminNegativeTestJSON-680255960 tempest-ServersAdminNegativeTestJSON-680255960-project-admin] [instance: 814d8327-fc0e-4846-a449-598e482d71c6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:50.078071 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-618cd855-d8f6-45f7-a75d-da5bf895ab6c tempest-ServersAdminNegativeTestJSON-680255960 tempest-ServersAdminNegativeTestJSON-680255960-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:50.078826 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-618cd855-d8f6-45f7-a75d-da5bf895ab6c tempest-ServersAdminNegativeTestJSON-680255960 tempest-ServersAdminNegativeTestJSON-680255960-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:50.079557 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-618cd855-d8f6-45f7-a75d-da5bf895ab6c tempest-ServersAdminNegativeTestJSON-680255960 tempest-ServersAdminNegativeTestJSON-680255960-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:50.080529 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-618cd855-d8f6-45f7-a75d-da5bf895ab6c tempest-ServersAdminNegativeTestJSON-680255960 tempest-ServersAdminNegativeTestJSON-680255960-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:50.081248 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-618cd855-d8f6-45f7-a75d-da5bf895ab6c tempest-ServersAdminNegativeTestJSON-680255960 tempest-ServersAdminNegativeTestJSON-680255960-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:50.086335 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-618cd855-d8f6-45f7-a75d-da5bf895ab6c tempest-ServersAdminNegativeTestJSON-680255960 tempest-ServersAdminNegativeTestJSON-680255960-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:50.691003 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a855611b-acc0-4efc-87ee-d24bd1d07925 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fb4a7dae3346d39f70c51055cfd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065d7179ebd6460cb039bd1624296b57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:50.721382 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a855611b-acc0-4efc-87ee-d24bd1d07925 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] 10.222.0.27 "GET /compute/v2.1/servers/a2469f0a-d6bc-46ae-8905-049f2123dc0c" status: 200 len: 1404 microversion: 2.1 time: 1.373986 Sep 08 10:48:50.723259 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1324/2616] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:49 2022] GET /compute/v2.1/servers/a2469f0a-d6bc-46ae-8905-049f2123dc0c => generated 1404 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:50.739260 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-ca10e9cb-dbd8-4e0f-b79a-b19c32bf94f6 req-9d32a36c-b11e-441c-9034-fcd1b82783b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72eb7387-3f16-4b4f-ab9a-89076f169fc1", "name": "network-vif-deleted", "tag": "64d36b81-597c-4cd5-8290-49272ddcb61d"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:48:50.772473 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ca10e9cb-dbd8-4e0f-b79a-b19c32bf94f6 req-9d32a36c-b11e-441c-9034-fcd1b82783b7 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:50.773819 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ca10e9cb-dbd8-4e0f-b79a-b19c32bf94f6 req-9d32a36c-b11e-441c-9034-fcd1b82783b7 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:50.774268 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ca10e9cb-dbd8-4e0f-b79a-b19c32bf94f6 req-9d32a36c-b11e-441c-9034-fcd1b82783b7 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:50.820414 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-ca10e9cb-dbd8-4e0f-b79a-b19c32bf94f6 req-9d32a36c-b11e-441c-9034-fcd1b82783b7 service nova] Creating event network-vif-deleted:64d36b81-597c-4cd5-8290-49272ddcb61d for instance 72eb7387-3f16-4b4f-ab9a-89076f169fc1 on n-h1-850501-12 Sep 08 10:48:50.850733 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-ca10e9cb-dbd8-4e0f-b79a-b19c32bf94f6 req-9d32a36c-b11e-441c-9034-fcd1b82783b7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117343 Sep 08 10:48:50.851736 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1325/2617] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:48:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:48:50.879526 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fd6d5afc-5ecc-4e31-a4be-52f1f981195c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:50.881702 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fd6d5afc-5ecc-4e31-a4be-52f1f981195c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:50.928698 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd6d5afc-5ecc-4e31-a4be-52f1f981195c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:50.929533 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd6d5afc-5ecc-4e31-a4be-52f1f981195c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:50.930177 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd6d5afc-5ecc-4e31-a4be-52f1f981195c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:50.937149 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd6d5afc-5ecc-4e31-a4be-52f1f981195c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:50.937899 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd6d5afc-5ecc-4e31-a4be-52f1f981195c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:50.939045 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd6d5afc-5ecc-4e31-a4be-52f1f981195c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:51.316605 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-618cd855-d8f6-45f7-a75d-da5bf895ab6c tempest-ServersAdminNegativeTestJSON-680255960 tempest-ServersAdminNegativeTestJSON-680255960-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/814d8327-fc0e-4846-a449-598e482d71c6" status: 200 len: 1629 microversion: 2.1 time: 1.280593 Sep 08 10:48:51.337167 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1293/2618] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:50 2022] GET /compute/v2.1/servers/814d8327-fc0e-4846-a449-598e482d71c6 => generated 1629 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:51.338945 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-962f6d33-17d6-4a54-90c2-18b47a3c9b18 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:51.342069 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-962f6d33-17d6-4a54-90c2-18b47a3c9b18 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] [instance: 4703a7bf-a1ba-4bba-8928-3c403f3f3f21] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:51.369781 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-962f6d33-17d6-4a54-90c2-18b47a3c9b18 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:51.375605 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-962f6d33-17d6-4a54-90c2-18b47a3c9b18 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:51.378019 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-962f6d33-17d6-4a54-90c2-18b47a3c9b18 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:51.379746 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-962f6d33-17d6-4a54-90c2-18b47a3c9b18 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:51.380641 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-962f6d33-17d6-4a54-90c2-18b47a3c9b18 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:51.387748 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-962f6d33-17d6-4a54-90c2-18b47a3c9b18 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:51.514632 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fd6d5afc-5ecc-4e31-a4be-52f1f981195c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:51.527474 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-962f6d33-17d6-4a54-90c2-18b47a3c9b18 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528fc9fbb57149c9a9c755c6497f5c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effe8e6c23114b8ab80e76bec365de60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:51.527667 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fd6d5afc-5ecc-4e31-a4be-52f1f981195c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:51.530743 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fd6d5afc-5ecc-4e31-a4be-52f1f981195c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:51.533881 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:48:51.548444 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-962f6d33-17d6-4a54-90c2-18b47a3c9b18 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] 10.222.0.27 "GET /compute/v2.1/servers/4703a7bf-a1ba-4bba-8928-3c403f3f3f21" status: 200 len: 1252 microversion: 2.1 time: 0.218420 Sep 08 10:48:51.561055 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1294/2619] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:51 2022] GET /compute/v2.1/servers/4703a7bf-a1ba-4bba-8928-3c403f3f3f21 => generated 1252 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:51.561253 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fd6d5afc-5ecc-4e31-a4be-52f1f981195c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1533 microversion: 2.91 time: 0.689880 Sep 08 10:48:51.561355 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-97f30a92-dd63-4116-a7d6-ae15dff1c879 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:51.561355 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-97f30a92-dd63-4116-a7d6-ae15dff1c879 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] [instance: 72eb7387-3f16-4b4f-ab9a-89076f169fc1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:51.567824 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1326/2620] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:48:50 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1533 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:48:51.589120 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-97f30a92-dd63-4116-a7d6-ae15dff1c879 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:51.607510 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-97f30a92-dd63-4116-a7d6-ae15dff1c879 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:51.608338 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-97f30a92-dd63-4116-a7d6-ae15dff1c879 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:51.609834 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-97f30a92-dd63-4116-a7d6-ae15dff1c879 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:51.615452 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-97f30a92-dd63-4116-a7d6-ae15dff1c879 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:51.616160 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-97f30a92-dd63-4116-a7d6-ae15dff1c879 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:51.638076 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-97f30a92-dd63-4116-a7d6-ae15dff1c879 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] HTTP exception thrown: Instance 72eb7387-3f16-4b4f-ab9a-89076f169fc1 could not be found. Sep 08 10:48:51.639935 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-97f30a92-dd63-4116-a7d6-ae15dff1c879 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Request method failure captured: Sep 08 10:48:51.639935 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/72eb7387-3f16-4b4f-ab9a-89076f169fc1 HTTP/1.1 Sep 08 10:48:51.639935 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:48:51.639935 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:48:51.639935 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:48:51.639935 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:48:51.639935 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:48:51.639935 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:48:51.639935 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:48:51.639935 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:48:51.639935 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcfC0AOBXxzazv4hEBAdYoM_Zbqqj2H_wNroumzxYEDQ59KbVVIhiVsq_ZdBUOleK08-DHWosiz_6D_FLUXzKrz5xqX68yP4vI2t0s-XLFo1bTp5Id4PjVGkWeLJls9pXMIAjFMP1OXr2jxOU5q6Qs2X8JpZxS8mL5BS5bD9v1xEYTE Sep 08 10:48:51.639935 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:48:51.639935 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:48:51.639935 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:48:51.639935 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:48:51.639935 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:48:51.639935 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:48:51.639935 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 68a768a3863448bca0c6cda11afdd955 Sep 08 10:48:51.639935 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-VolumesAdminNegativeTest-1725475126 Sep 08 10:48:51.639935 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:48:51.639935 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:48:51.639935 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/68a768a3863448bca0c6cda11afdd955"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/68a768a3863448bca0c6cda11afdd955"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_68a768a3863448bca0c6cda11afdd955"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/68a768a3863448bca0c6cda11afdd955"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:48:51.639935 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-VolumesAdminNegativeTest-1725475126 Sep 08 10:48:51.639935 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 68a768a3863448bca0c6cda11afdd955 Sep 08 10:48:51.639935 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1725475126 Sep 08 10:48:51.639935 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-VolumesAdminNegativeTest-1725475126-project Sep 08 10:48:51.639935 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:48:51.639935 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:48:51.639935 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 03ff38511b484fbcb7817a56076cf4b7 Sep 08 10:48:51.639935 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-VolumesAdminNegativeTest-1725475126-project Sep 08 10:48:51.639935 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:48:51.639935 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 72eb7387-3f16-4b4f-ab9a-89076f169fc1 could not be found. Sep 08 10:48:51.639935 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '72eb7387-3f16-4b4f-ab9a-89076f169fc1'} Sep 08 10:48:51.639935 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:48:51.639935 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:48:51.639935 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:48:51.639935 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:48:51.639935 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:48:51.639935 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:48:51.639935 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:48:51.639935 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:48:51.639935 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:48:51.639935 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:48:51.639935 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72eb7387-3f16-4b4f-ab9a-89076f169fc1 could not be found. Sep 08 10:48:51.639935 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:48:51.639935 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:48:51.639935 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:48:51.639935 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:48:51.639935 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:48:51.639935 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:48:51.639935 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:48:51.639935 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:48:51.639935 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:48:51.639935 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:48:51.639935 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:48:51.639935 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:48:51.639935 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:48:51.639935 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:48:51.639935 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:48:51.639935 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:48:51.639935 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72eb7387-3f16-4b4f-ab9a-89076f169fc1 could not be found. Sep 08 10:48:51.639935 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:48:51.639935 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:48:51.639935 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:48:51.644210 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:48:51.644210 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:48:51.644210 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:48:51.644210 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:48:51.644210 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:48:51.644210 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72eb7387-3f16-4b4f-ab9a-89076f169fc1 could not be found. Sep 08 10:48:51.644210 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:48:51.646467 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-97f30a92-dd63-4116-a7d6-ae15dff1c879 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Returning 404 to user: Instance 72eb7387-3f16-4b4f-ab9a-89076f169fc1 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:48:51.647623 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-97f30a92-dd63-4116-a7d6-ae15dff1c879 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] 10.222.0.27 "GET /compute/v2.1/servers/72eb7387-3f16-4b4f-ab9a-89076f169fc1" status: 404 len: 111 microversion: 2.1 time: 0.094739 Sep 08 10:48:51.648726 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1295/2621] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:51 2022] GET /compute/v2.1/servers/72eb7387-3f16-4b4f-ab9a-89076f169fc1 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:48:51.659324 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ea724a44-41ef-4414-90f5-033e9e6f6f62 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] Calling method '.version_select at 0x7f68e4503c10>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:51.687352 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ea724a44-41ef-4414-90f5-033e9e6f6f62 tempest-VolumesAdminNegativeTest-1725475126 tempest-VolumesAdminNegativeTest-1725475126-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1381255960" status: 202 len: 0 microversion: 2.1 time: 0.032667 Sep 08 10:48:51.687942 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1296/2622] 10.222.0.27 () {58 vars in 1221 bytes} [Thu Sep 8 10:48:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1381255960 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 10:48:51.707218 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-66352c6d-09f1-4485-9302-62fe440996fc tempest-UnshelveToHostMultiNodesTest-1667251479 tempest-UnshelveToHostMultiNodesTest-1667251479-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:51.708580 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-66352c6d-09f1-4485-9302-62fe440996fc tempest-UnshelveToHostMultiNodesTest-1667251479 tempest-UnshelveToHostMultiNodesTest-1667251479-project-admin] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:51.718825 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-66352c6d-09f1-4485-9302-62fe440996fc tempest-UnshelveToHostMultiNodesTest-1667251479 tempest-UnshelveToHostMultiNodesTest-1667251479-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:51.719607 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-66352c6d-09f1-4485-9302-62fe440996fc tempest-UnshelveToHostMultiNodesTest-1667251479 tempest-UnshelveToHostMultiNodesTest-1667251479-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:51.720262 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-66352c6d-09f1-4485-9302-62fe440996fc tempest-UnshelveToHostMultiNodesTest-1667251479 tempest-UnshelveToHostMultiNodesTest-1667251479-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:51.721202 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-66352c6d-09f1-4485-9302-62fe440996fc tempest-UnshelveToHostMultiNodesTest-1667251479 tempest-UnshelveToHostMultiNodesTest-1667251479-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:51.721826 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-66352c6d-09f1-4485-9302-62fe440996fc tempest-UnshelveToHostMultiNodesTest-1667251479 tempest-UnshelveToHostMultiNodesTest-1667251479-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:51.722442 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-66352c6d-09f1-4485-9302-62fe440996fc tempest-UnshelveToHostMultiNodesTest-1667251479 tempest-UnshelveToHostMultiNodesTest-1667251479-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:51.751955 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-17661bc2-1255-4f73-bc85-5e77417bb891 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:51.752641 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-17661bc2-1255-4f73-bc85-5e77417bb891 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] [instance: a2469f0a-d6bc-46ae-8905-049f2123dc0c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:51.763297 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-17661bc2-1255-4f73-bc85-5e77417bb891 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:51.764789 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-17661bc2-1255-4f73-bc85-5e77417bb891 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:51.766785 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-17661bc2-1255-4f73-bc85-5e77417bb891 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:51.767898 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-17661bc2-1255-4f73-bc85-5e77417bb891 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:51.768804 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-17661bc2-1255-4f73-bc85-5e77417bb891 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:51.770884 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-17661bc2-1255-4f73-bc85-5e77417bb891 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:51.949148 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-66352c6d-09f1-4485-9302-62fe440996fc tempest-UnshelveToHostMultiNodesTest-1667251479 tempest-UnshelveToHostMultiNodesTest-1667251479-project-admin] Lazy-loading 'services' on Instance uuid 0b71abe8-cfe5-4b57-8860-7861810d9c7b {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:48:51.999406 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-66352c6d-09f1-4485-9302-62fe440996fc tempest-UnshelveToHostMultiNodesTest-1667251479 tempest-UnshelveToHostMultiNodesTest-1667251479-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1940 microversion: 2.91 time: 0.418241 Sep 08 10:48:52.002901 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1327/2623] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:48:51 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1940 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:48:52.042800 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-17661bc2-1255-4f73-bc85-5e77417bb891 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fb4a7dae3346d39f70c51055cfd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065d7179ebd6460cb039bd1624296b57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:52.046194 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6c843461-f2fb-4f1c-87b5-49b0ccb9bfcf tempest-UnshelveToHostMultiNodesTest-1667251479 tempest-UnshelveToHostMultiNodesTest-1667251479-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:52.049788 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6c843461-f2fb-4f1c-87b5-49b0ccb9bfcf tempest-UnshelveToHostMultiNodesTest-1667251479 tempest-UnshelveToHostMultiNodesTest-1667251479-project-admin] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:52.052259 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-17661bc2-1255-4f73-bc85-5e77417bb891 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] 10.222.0.27 "GET /compute/v2.1/servers/a2469f0a-d6bc-46ae-8905-049f2123dc0c" status: 200 len: 1404 microversion: 2.1 time: 0.304415 Sep 08 10:48:52.058135 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6c843461-f2fb-4f1c-87b5-49b0ccb9bfcf tempest-UnshelveToHostMultiNodesTest-1667251479 tempest-UnshelveToHostMultiNodesTest-1667251479-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:52.059086 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6c843461-f2fb-4f1c-87b5-49b0ccb9bfcf tempest-UnshelveToHostMultiNodesTest-1667251479 tempest-UnshelveToHostMultiNodesTest-1667251479-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:52.059740 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6c843461-f2fb-4f1c-87b5-49b0ccb9bfcf tempest-UnshelveToHostMultiNodesTest-1667251479 tempest-UnshelveToHostMultiNodesTest-1667251479-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:52.061542 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6c843461-f2fb-4f1c-87b5-49b0ccb9bfcf tempest-UnshelveToHostMultiNodesTest-1667251479 tempest-UnshelveToHostMultiNodesTest-1667251479-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:52.062293 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6c843461-f2fb-4f1c-87b5-49b0ccb9bfcf tempest-UnshelveToHostMultiNodesTest-1667251479 tempest-UnshelveToHostMultiNodesTest-1667251479-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:52.063024 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6c843461-f2fb-4f1c-87b5-49b0ccb9bfcf tempest-UnshelveToHostMultiNodesTest-1667251479 tempest-UnshelveToHostMultiNodesTest-1667251479-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:52.070858 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1297/2624] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:51 2022] GET /compute/v2.1/servers/a2469f0a-d6bc-46ae-8905-049f2123dc0c => generated 1404 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:52.334251 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-6c843461-f2fb-4f1c-87b5-49b0ccb9bfcf tempest-UnshelveToHostMultiNodesTest-1667251479 tempest-UnshelveToHostMultiNodesTest-1667251479-project-admin] Lazy-loading 'services' on Instance uuid 0b71abe8-cfe5-4b57-8860-7861810d9c7b {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:48:52.360734 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-09304cc8-ac8d-4597-add0-2955379c839e tempest-ServersAdminNegativeTestJSON-680255960 tempest-ServersAdminNegativeTestJSON-680255960-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:52.367316 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-09304cc8-ac8d-4597-add0-2955379c839e tempest-ServersAdminNegativeTestJSON-680255960 tempest-ServersAdminNegativeTestJSON-680255960-project-admin] [instance: 814d8327-fc0e-4846-a449-598e482d71c6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:52.372582 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6c843461-f2fb-4f1c-87b5-49b0ccb9bfcf tempest-UnshelveToHostMultiNodesTest-1667251479 tempest-UnshelveToHostMultiNodesTest-1667251479-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1940 microversion: 2.91 time: 0.344910 Sep 08 10:48:52.373785 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1328/2625] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:48:52 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1940 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:48:52.394492 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-09304cc8-ac8d-4597-add0-2955379c839e tempest-ServersAdminNegativeTestJSON-680255960 tempest-ServersAdminNegativeTestJSON-680255960-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:52.397186 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-09304cc8-ac8d-4597-add0-2955379c839e tempest-ServersAdminNegativeTestJSON-680255960 tempest-ServersAdminNegativeTestJSON-680255960-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:52.398279 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-09304cc8-ac8d-4597-add0-2955379c839e tempest-ServersAdminNegativeTestJSON-680255960 tempest-ServersAdminNegativeTestJSON-680255960-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:52.424091 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-09304cc8-ac8d-4597-add0-2955379c839e tempest-ServersAdminNegativeTestJSON-680255960 tempest-ServersAdminNegativeTestJSON-680255960-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:52.424926 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-09304cc8-ac8d-4597-add0-2955379c839e tempest-ServersAdminNegativeTestJSON-680255960 tempest-ServersAdminNegativeTestJSON-680255960-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:52.425674 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-54cdcfc5-333a-4df6-883c-312b6b056918 tempest-UnshelveToHostMultiNodesTest-1667251479 tempest-UnshelveToHostMultiNodesTest-1667251479-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:52.426327 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-09304cc8-ac8d-4597-add0-2955379c839e tempest-ServersAdminNegativeTestJSON-680255960 tempest-ServersAdminNegativeTestJSON-680255960-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:52.432083 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54cdcfc5-333a-4df6-883c-312b6b056918 tempest-UnshelveToHostMultiNodesTest-1667251479 tempest-UnshelveToHostMultiNodesTest-1667251479-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:52.432595 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54cdcfc5-333a-4df6-883c-312b6b056918 tempest-UnshelveToHostMultiNodesTest-1667251479 tempest-UnshelveToHostMultiNodesTest-1667251479-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:52.433051 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54cdcfc5-333a-4df6-883c-312b6b056918 tempest-UnshelveToHostMultiNodesTest-1667251479 tempest-UnshelveToHostMultiNodesTest-1667251479-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:52.433812 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54cdcfc5-333a-4df6-883c-312b6b056918 tempest-UnshelveToHostMultiNodesTest-1667251479 tempest-UnshelveToHostMultiNodesTest-1667251479-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:52.437837 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54cdcfc5-333a-4df6-883c-312b6b056918 tempest-UnshelveToHostMultiNodesTest-1667251479 tempest-UnshelveToHostMultiNodesTest-1667251479-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:52.439618 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54cdcfc5-333a-4df6-883c-312b6b056918 tempest-UnshelveToHostMultiNodesTest-1667251479 tempest-UnshelveToHostMultiNodesTest-1667251479-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:52.510661 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-54cdcfc5-333a-4df6-883c-312b6b056918 tempest-UnshelveToHostMultiNodesTest-1667251479 tempest-UnshelveToHostMultiNodesTest-1667251479-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 500 microversion: 2.91 time: 0.088326 Sep 08 10:48:52.515865 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1329/2626] 10.222.0.27 () {60 vars in 1217 bytes} [Thu Sep 8 10:48:52 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 500 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:48:52.531127 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9981a2e5-cc31-4703-bdc6-730be24a040f tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:48:52.531675 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9981a2e5-cc31-4703-bdc6-730be24a040f tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:52.559259 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9981a2e5-cc31-4703-bdc6-730be24a040f tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:52.559986 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9981a2e5-cc31-4703-bdc6-730be24a040f tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:52.560630 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9981a2e5-cc31-4703-bdc6-730be24a040f tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:52.561690 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9981a2e5-cc31-4703-bdc6-730be24a040f tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:52.562194 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9981a2e5-cc31-4703-bdc6-730be24a040f tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:52.562835 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9981a2e5-cc31-4703-bdc6-730be24a040f tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:52.642405 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-9981a2e5-cc31-4703-bdc6-730be24a040f tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lazy-loading 'flavor' on Instance uuid 0b71abe8-cfe5-4b57-8860-7861810d9c7b {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:48:53.056769 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-09304cc8-ac8d-4597-add0-2955379c839e tempest-ServersAdminNegativeTestJSON-680255960 tempest-ServersAdminNegativeTestJSON-680255960-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/814d8327-fc0e-4846-a449-598e482d71c6" status: 200 len: 1612 microversion: 2.1 time: 0.706427 Sep 08 10:48:53.059949 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1298/2627] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:52 2022] GET /compute/v2.1/servers/814d8327-fc0e-4846-a449-598e482d71c6 => generated 1612 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:53.068589 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e91742fa-d270-4f83-847f-21bfc5301e96 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:53.072091 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e91742fa-d270-4f83-847f-21bfc5301e96 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] [instance: 4703a7bf-a1ba-4bba-8928-3c403f3f3f21] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:53.091352 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e91742fa-d270-4f83-847f-21bfc5301e96 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:53.092110 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e91742fa-d270-4f83-847f-21bfc5301e96 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:53.092807 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e91742fa-d270-4f83-847f-21bfc5301e96 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:53.098045 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e91742fa-d270-4f83-847f-21bfc5301e96 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:53.098541 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e91742fa-d270-4f83-847f-21bfc5301e96 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:53.098980 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e91742fa-d270-4f83-847f-21bfc5301e96 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:53.190744 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9981a2e5-cc31-4703-bdc6-730be24a040f tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "POST /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b/action" status: 202 len: 0 microversion: 2.91 time: 0.664537 Sep 08 10:48:53.192028 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1330/2628] 10.222.0.27 () {62 vars in 1319 bytes} [Thu Sep 8 10:48:52 2022] POST /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b/action => generated 0 bytes in 667 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 08 10:48:53.215997 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ebc2feb9-9200-4b7e-9f24-d7c0a8c867d0 tempest-ServersAdminNegativeTestJSON-680255960 tempest-ServersAdminNegativeTestJSON-680255960-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:48:53.218473 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ebc2feb9-9200-4b7e-9f24-d7c0a8c867d0 tempest-ServersAdminNegativeTestJSON-680255960 tempest-ServersAdminNegativeTestJSON-680255960-project-admin] [instance: 814d8327-fc0e-4846-a449-598e482d71c6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:53.258166 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ebc2feb9-9200-4b7e-9f24-d7c0a8c867d0 tempest-ServersAdminNegativeTestJSON-680255960 tempest-ServersAdminNegativeTestJSON-680255960-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:53.261886 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ebc2feb9-9200-4b7e-9f24-d7c0a8c867d0 tempest-ServersAdminNegativeTestJSON-680255960 tempest-ServersAdminNegativeTestJSON-680255960-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:53.263319 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ebc2feb9-9200-4b7e-9f24-d7c0a8c867d0 tempest-ServersAdminNegativeTestJSON-680255960 tempest-ServersAdminNegativeTestJSON-680255960-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:53.264320 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ebc2feb9-9200-4b7e-9f24-d7c0a8c867d0 tempest-ServersAdminNegativeTestJSON-680255960 tempest-ServersAdminNegativeTestJSON-680255960-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:53.267351 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ebc2feb9-9200-4b7e-9f24-d7c0a8c867d0 tempest-ServersAdminNegativeTestJSON-680255960 tempest-ServersAdminNegativeTestJSON-680255960-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:53.268172 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ebc2feb9-9200-4b7e-9f24-d7c0a8c867d0 tempest-ServersAdminNegativeTestJSON-680255960 tempest-ServersAdminNegativeTestJSON-680255960-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:53.382314 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-ebc2feb9-9200-4b7e-9f24-d7c0a8c867d0 tempest-ServersAdminNegativeTestJSON-680255960 tempest-ServersAdminNegativeTestJSON-680255960-project-admin] HTTP exception thrown: Cannot 'migrate' instance 814d8327-fc0e-4846-a449-598e482d71c6 while it is in vm_state suspended Sep 08 10:48:53.385546 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ebc2feb9-9200-4b7e-9f24-d7c0a8c867d0 tempest-ServersAdminNegativeTestJSON-680255960 tempest-ServersAdminNegativeTestJSON-680255960-project-admin] Request method failure captured: Sep 08 10:48:53.385546 n-d-850501-12 devstack@n-api.service[128862]: request: POST /compute/v2.1/servers/814d8327-fc0e-4846-a449-598e482d71c6/action HTTP/1.1 Sep 08 10:48:53.385546 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:48:53.385546 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:48:53.385546 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:48:53.385546 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 15 Sep 08 10:48:53.385546 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:48:53.385546 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:48:53.385546 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:48:53.385546 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:48:53.385546 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGchVmowXga0Pwgb-Yh1WV3I0GGSvt1R377adW3v9XaMI2djVu740XN-GCcbXdZv8mYdrNgQOo0WXcd8zmHZQ5N-W_JUEHlGT4vkGKYk0iV9v16mBJ97WdG27nApgHAbq_QhH2HBdW3AkM03od5RR3ibuARqvDhSaYE1GEcAcA99YjGU Sep 08 10:48:53.385546 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:48:53.385546 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:48:53.385546 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:48:53.385546 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:48:53.385546 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:48:53.385546 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:48:53.385546 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: d1756642795843229031d4d076b67295 Sep 08 10:48:53.385546 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-680255960 Sep 08 10:48:53.385546 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,admin,member Sep 08 10:48:53.385546 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,admin,member Sep 08 10:48:53.385546 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d1756642795843229031d4d076b67295"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d1756642795843229031d4d076b67295"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d1756642795843229031d4d076b67295"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d1756642795843229031d4d076b67295"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:48:53.385546 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServersAdminNegativeTestJSON-680255960 Sep 08 10:48:53.385546 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: d1756642795843229031d4d076b67295 Sep 08 10:48:53.385546 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-680255960 Sep 08 10:48:53.385546 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServersAdminNegativeTestJSON-680255960-project-admin Sep 08 10:48:53.385546 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:48:53.385546 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:48:53.385546 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 9de7e8611c4848cc9a1e9942b490a383 Sep 08 10:48:53.385546 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServersAdminNegativeTestJSON-680255960-project-admin Sep 08 10:48:53.385546 n-d-850501-12 devstack@n-api.service[128862]: Sep 08 10:48:53.385546 n-d-850501-12 devstack@n-api.service[128862]: {"migrate": {}} Sep 08 10:48:53.385546 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:48:53.385546 n-d-850501-12 devstack@n-api.service[128862]: exception: Cannot 'migrate' instance 814d8327-fc0e-4846-a449-598e482d71c6 while it is in vm_state suspended Sep 08 10:48:53.385546 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '814d8327-fc0e-4846-a449-598e482d71c6', 'body': {'migrate': {}}} Sep 08 10:48:53.385546 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:48:53.385546 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:48:53.385546 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Sep 08 10:48:53.385546 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Sep 08 10:48:53.385546 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 08 10:48:53.385546 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 10:48:53.385546 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 08 10:48:53.385546 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 08 10:48:53.385546 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 08 10:48:53.385546 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 08 10:48:53.385546 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 10:48:53.385546 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 10:48:53.385546 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 08 10:48:53.385546 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 08 10:48:53.385546 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 814d8327-fc0e-4846-a449-598e482d71c6 in vm_state suspended. Cannot resize while the instance is in this state. Sep 08 10:48:53.385546 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:48:53.385546 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:48:53.385546 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:48:53.385546 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:48:53.385546 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:48:53.385546 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:48:53.385546 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:48:53.385546 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:48:53.385546 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:48:53.385546 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:48:53.385546 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:48:53.385546 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:48:53.385546 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Sep 08 10:48:53.389378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 08 10:48:53.389378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 08 10:48:53.389378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 08 10:48:53.389378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 814d8327-fc0e-4846-a449-598e482d71c6 while it is in vm_state suspended Sep 08 10:48:53.389378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:48:53.389378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:48:53.389378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:48:53.389378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:48:53.389378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:48:53.389378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:48:53.389378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:48:53.389378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:48:53.389378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 814d8327-fc0e-4846-a449-598e482d71c6 while it is in vm_state suspended Sep 08 10:48:53.389378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:48:53.398742 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ebc2feb9-9200-4b7e-9f24-d7c0a8c867d0 tempest-ServersAdminNegativeTestJSON-680255960 tempest-ServersAdminNegativeTestJSON-680255960-project-admin] Returning 409 to user: Cannot 'migrate' instance 814d8327-fc0e-4846-a449-598e482d71c6 while it is in vm_state suspended {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:48:53.402600 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ebc2feb9-9200-4b7e-9f24-d7c0a8c867d0 tempest-ServersAdminNegativeTestJSON-680255960 tempest-ServersAdminNegativeTestJSON-680255960-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/814d8327-fc0e-4846-a449-598e482d71c6/action" status: 409 len: 148 microversion: 2.1 time: 0.206878 Sep 08 10:48:53.406260 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1331/2629] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:48:53 2022] POST /compute/v2.1/servers/814d8327-fc0e-4846-a449-598e482d71c6/action => generated 148 bytes in 213 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:48:53.432538 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b17b4d21-7b2c-4a9a-8db3-d9c41b556cd1 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:53.437824 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e91742fa-d270-4f83-847f-21bfc5301e96 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528fc9fbb57149c9a9c755c6497f5c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effe8e6c23114b8ab80e76bec365de60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:53.452222 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e91742fa-d270-4f83-847f-21bfc5301e96 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] 10.222.0.27 "GET /compute/v2.1/servers/4703a7bf-a1ba-4bba-8928-3c403f3f3f21" status: 200 len: 1252 microversion: 2.1 time: 0.391160 Sep 08 10:48:53.456729 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b17b4d21-7b2c-4a9a-8db3-d9c41b556cd1 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] [instance: a2469f0a-d6bc-46ae-8905-049f2123dc0c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:53.463590 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1299/2630] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:53 2022] GET /compute/v2.1/servers/4703a7bf-a1ba-4bba-8928-3c403f3f3f21 => generated 1252 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:53.478718 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1d888d7c-03b6-4c81-a1da-0fbd1a0e60a8 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:53.487977 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1d888d7c-03b6-4c81-a1da-0fbd1a0e60a8 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:53.488453 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b17b4d21-7b2c-4a9a-8db3-d9c41b556cd1 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:53.490990 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b17b4d21-7b2c-4a9a-8db3-d9c41b556cd1 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:53.492308 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b17b4d21-7b2c-4a9a-8db3-d9c41b556cd1 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:53.496308 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b17b4d21-7b2c-4a9a-8db3-d9c41b556cd1 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:53.508829 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1d888d7c-03b6-4c81-a1da-0fbd1a0e60a8 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:53.517293 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1d888d7c-03b6-4c81-a1da-0fbd1a0e60a8 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:53.518222 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b17b4d21-7b2c-4a9a-8db3-d9c41b556cd1 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:53.519031 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1d888d7c-03b6-4c81-a1da-0fbd1a0e60a8 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:53.519840 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b17b4d21-7b2c-4a9a-8db3-d9c41b556cd1 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:53.523829 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=22 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:48:53.531592 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1d888d7c-03b6-4c81-a1da-0fbd1a0e60a8 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:53.543679 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1d888d7c-03b6-4c81-a1da-0fbd1a0e60a8 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:53.546269 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1d888d7c-03b6-4c81-a1da-0fbd1a0e60a8 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:53.794654 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1d888d7c-03b6-4c81-a1da-0fbd1a0e60a8 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:53.806984 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1d888d7c-03b6-4c81-a1da-0fbd1a0e60a8 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:53.808516 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1d888d7c-03b6-4c81-a1da-0fbd1a0e60a8 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:53.830110 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1d888d7c-03b6-4c81-a1da-0fbd1a0e60a8 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1539 microversion: 2.91 time: 0.364525 Sep 08 10:48:53.831389 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1300/2631] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:48:53 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1539 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:48:53.848181 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fb247f64-09a1-46c4-9597-d8353d73d2da tempest-ServersAdminNegativeTestJSON-680255960 tempest-ServersAdminNegativeTestJSON-680255960-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:48:53.864619 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fb247f64-09a1-46c4-9597-d8353d73d2da tempest-ServersAdminNegativeTestJSON-680255960 tempest-ServersAdminNegativeTestJSON-680255960-project-admin] Request method failure captured: Sep 08 10:48:53.864619 n-d-850501-12 devstack@n-api.service[128861]: request: POST /compute/v2.1/servers/5134b057-ca4f-4ec8-8dd7-435d4e3d1279/action HTTP/1.1 Sep 08 10:48:53.864619 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:48:53.864619 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:48:53.864619 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:48:53.864619 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 39 Sep 08 10:48:53.864619 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:48:53.864619 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:48:53.864619 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:48:53.864619 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:48:53.864619 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGchVmowXga0Pwgb-Yh1WV3I0GGSvt1R377adW3v9XaMI2djVu740XN-GCcbXdZv8mYdrNgQOo0WXcd8zmHZQ5N-W_JUEHlGT4vkGKYk0iV9v16mBJ97WdG27nApgHAbq_QhH2HBdW3AkM03od5RR3ibuARqvDhSaYE1GEcAcA99YjGU Sep 08 10:48:53.864619 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:48:53.864619 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:48:53.864619 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:48:53.864619 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:48:53.864619 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:48:53.864619 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:48:53.864619 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: d1756642795843229031d4d076b67295 Sep 08 10:48:53.864619 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-680255960 Sep 08 10:48:53.864619 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,admin,member Sep 08 10:48:53.864619 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,admin,member Sep 08 10:48:53.864619 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d1756642795843229031d4d076b67295"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d1756642795843229031d4d076b67295"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d1756642795843229031d4d076b67295"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d1756642795843229031d4d076b67295"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:48:53.864619 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServersAdminNegativeTestJSON-680255960 Sep 08 10:48:53.864619 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: d1756642795843229031d4d076b67295 Sep 08 10:48:53.864619 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-680255960 Sep 08 10:48:53.864619 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServersAdminNegativeTestJSON-680255960-project-admin Sep 08 10:48:53.864619 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:48:53.864619 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:48:53.864619 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 9de7e8611c4848cc9a1e9942b490a383 Sep 08 10:48:53.864619 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServersAdminNegativeTestJSON-680255960-project-admin Sep 08 10:48:53.864619 n-d-850501-12 devstack@n-api.service[128861]: Sep 08 10:48:53.864619 n-d-850501-12 devstack@n-api.service[128861]: {"os-resetState": {"state": "invalid"}} Sep 08 10:48:53.864619 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:48:53.864619 n-d-850501-12 devstack@n-api.service[128861]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Sep 08 10:48:53.864619 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '5134b057-ca4f-4ec8-8dd7-435d4e3d1279', 'body': {'os-resetState': {'state': 'invalid'}}} Sep 08 10:48:53.864619 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:48:53.864619 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:48:53.864619 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 10:48:53.864619 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 10:48:53.864619 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 10:48:53.864619 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise error Sep 08 10:48:53.864619 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Sep 08 10:48:53.864619 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:48:53.864619 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Sep 08 10:48:53.864619 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Sep 08 10:48:53.864619 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:48:53.864619 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Sep 08 10:48:53.864619 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi 'invalid' Sep 08 10:48:53.864619 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:48:53.864619 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:48:53.864619 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:48:53.864619 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:48:53.864619 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:48:53.864619 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:48:53.864619 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:48:53.864619 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:48:53.864619 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:48:53.864619 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:48:53.864619 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 10:48:53.864619 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 10:48:53.864619 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 10:48:53.864619 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 10:48:53.864619 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 10:48:53.864619 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 10:48:53.872563 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Sep 08 10:48:53.872563 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:48:53.872563 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:48:53.872563 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:48:53.872563 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:48:53.872563 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:48:53.872563 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:48:53.872563 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 10:48:53.872563 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 10:48:53.872563 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Sep 08 10:48:53.872563 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:48:53.872563 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fb247f64-09a1-46c4-9597-d8353d73d2da tempest-ServersAdminNegativeTestJSON-680255960 tempest-ServersAdminNegativeTestJSON-680255960-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:48:53.872563 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fb247f64-09a1-46c4-9597-d8353d73d2da tempest-ServersAdminNegativeTestJSON-680255960 tempest-ServersAdminNegativeTestJSON-680255960-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/5134b057-ca4f-4ec8-8dd7-435d4e3d1279/action" status: 400 len: 144 microversion: 2.1 time: 0.033037 Sep 08 10:48:53.878132 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1301/2632] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:48:53 2022] POST /compute/v2.1/servers/5134b057-ca4f-4ec8-8dd7-435d4e3d1279/action => generated 144 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:48:53.889062 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5002b549-c8dd-4132-9528-58fbaafe063d tempest-ServersAdminNegativeTestJSON-680255960 tempest-ServersAdminNegativeTestJSON-680255960-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:48:53.894779 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5002b549-c8dd-4132-9528-58fbaafe063d tempest-ServersAdminNegativeTestJSON-680255960 tempest-ServersAdminNegativeTestJSON-680255960-project-admin] Request method failure captured: Sep 08 10:48:53.894779 n-d-850501-12 devstack@n-api.service[128861]: request: POST /compute/v2.1/servers/5134b057-ca4f-4ec8-8dd7-435d4e3d1279/action HTTP/1.1 Sep 08 10:48:53.894779 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:48:53.894779 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:48:53.894779 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:48:53.894779 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 31 Sep 08 10:48:53.894779 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:48:53.894779 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:48:53.894779 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:48:53.894779 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:48:53.894779 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGchVmowXga0Pwgb-Yh1WV3I0GGSvt1R377adW3v9XaMI2djVu740XN-GCcbXdZv8mYdrNgQOo0WXcd8zmHZQ5N-W_JUEHlGT4vkGKYk0iV9v16mBJ97WdG27nApgHAbq_QhH2HBdW3AkM03od5RR3ibuARqvDhSaYE1GEcAcA99YjGU Sep 08 10:48:53.894779 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:48:53.894779 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:48:53.894779 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:48:53.894779 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:48:53.894779 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:48:53.894779 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:48:53.894779 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: d1756642795843229031d4d076b67295 Sep 08 10:48:53.894779 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-680255960 Sep 08 10:48:53.894779 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,admin,member Sep 08 10:48:53.894779 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,admin,member Sep 08 10:48:53.894779 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d1756642795843229031d4d076b67295"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d1756642795843229031d4d076b67295"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d1756642795843229031d4d076b67295"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d1756642795843229031d4d076b67295"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:48:53.894779 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServersAdminNegativeTestJSON-680255960 Sep 08 10:48:53.894779 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: d1756642795843229031d4d076b67295 Sep 08 10:48:53.894779 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-680255960 Sep 08 10:48:53.894779 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServersAdminNegativeTestJSON-680255960-project-admin Sep 08 10:48:53.894779 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:48:53.894779 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:48:53.894779 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 9de7e8611c4848cc9a1e9942b490a383 Sep 08 10:48:53.894779 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServersAdminNegativeTestJSON-680255960-project-admin Sep 08 10:48:53.894779 n-d-850501-12 devstack@n-api.service[128861]: Sep 08 10:48:53.894779 n-d-850501-12 devstack@n-api.service[128861]: {"os-resetState": {"state": 1}} Sep 08 10:48:53.894779 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:48:53.894779 n-d-850501-12 devstack@n-api.service[128861]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Sep 08 10:48:53.894779 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '5134b057-ca4f-4ec8-8dd7-435d4e3d1279', 'body': {'os-resetState': {'state': 1}}} Sep 08 10:48:53.894779 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:48:53.894779 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:48:53.894779 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 10:48:53.894779 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 10:48:53.894779 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 10:48:53.894779 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise error Sep 08 10:48:53.894779 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Sep 08 10:48:53.894779 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:48:53.894779 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Sep 08 10:48:53.894779 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Sep 08 10:48:53.894779 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:48:53.894779 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Sep 08 10:48:53.894779 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi 1 Sep 08 10:48:53.894779 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:48:53.894779 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:48:53.894779 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:48:53.894779 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:48:53.894779 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:48:53.894779 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:48:53.894779 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:48:53.894779 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:48:53.894779 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:48:53.894779 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:48:53.894779 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 10:48:53.894779 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 10:48:53.894779 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 10:48:53.894779 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 10:48:53.894779 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 10:48:53.894779 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 10:48:53.894779 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Sep 08 10:48:53.894779 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:48:53.902015 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:48:53.902015 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:48:53.902015 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:48:53.902015 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:48:53.902015 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:48:53.902015 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 10:48:53.902015 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 10:48:53.902015 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Sep 08 10:48:53.902015 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:48:53.902015 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5002b549-c8dd-4132-9528-58fbaafe063d tempest-ServersAdminNegativeTestJSON-680255960 tempest-ServersAdminNegativeTestJSON-680255960-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:48:53.902015 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5002b549-c8dd-4132-9528-58fbaafe063d tempest-ServersAdminNegativeTestJSON-680255960 tempest-ServersAdminNegativeTestJSON-680255960-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/5134b057-ca4f-4ec8-8dd7-435d4e3d1279/action" status: 400 len: 120 microversion: 2.1 time: 0.020649 Sep 08 10:48:53.902902 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1302/2633] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:48:53 2022] POST /compute/v2.1/servers/5134b057-ca4f-4ec8-8dd7-435d4e3d1279/action => generated 120 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:48:53.923103 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1db00b54-4d3c-441b-ac0b-b9996ba49dd1 tempest-ServersAdminNegativeTestJSON-680255960 tempest-ServersAdminNegativeTestJSON-680255960-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:48:53.946519 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1db00b54-4d3c-441b-ac0b-b9996ba49dd1 tempest-ServersAdminNegativeTestJSON-680255960 tempest-ServersAdminNegativeTestJSON-680255960-project-admin] Failed to fetch instance by id 999 {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 08 10:48:53.953187 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-1db00b54-4d3c-441b-ac0b-b9996ba49dd1 tempest-ServersAdminNegativeTestJSON-680255960 tempest-ServersAdminNegativeTestJSON-680255960-project-admin] HTTP exception thrown: Instance 999 could not be found. Sep 08 10:48:53.963180 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1db00b54-4d3c-441b-ac0b-b9996ba49dd1 tempest-ServersAdminNegativeTestJSON-680255960 tempest-ServersAdminNegativeTestJSON-680255960-project-admin] Request method failure captured: Sep 08 10:48:53.963180 n-d-850501-12 devstack@n-api.service[128861]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Sep 08 10:48:53.963180 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:48:53.963180 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:48:53.963180 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:48:53.963180 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 37 Sep 08 10:48:53.963180 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:48:53.963180 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:48:53.963180 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:48:53.963180 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:48:53.963180 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGchVmowXga0Pwgb-Yh1WV3I0GGSvt1R377adW3v9XaMI2djVu740XN-GCcbXdZv8mYdrNgQOo0WXcd8zmHZQ5N-W_JUEHlGT4vkGKYk0iV9v16mBJ97WdG27nApgHAbq_QhH2HBdW3AkM03od5RR3ibuARqvDhSaYE1GEcAcA99YjGU Sep 08 10:48:53.963180 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:48:53.963180 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:48:53.963180 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:48:53.963180 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:48:53.963180 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:48:53.963180 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:48:53.963180 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: d1756642795843229031d4d076b67295 Sep 08 10:48:53.963180 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-680255960 Sep 08 10:48:53.963180 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,admin,member Sep 08 10:48:53.963180 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,admin,member Sep 08 10:48:53.963180 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d1756642795843229031d4d076b67295"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d1756642795843229031d4d076b67295"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d1756642795843229031d4d076b67295"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d1756642795843229031d4d076b67295"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:48:53.963180 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServersAdminNegativeTestJSON-680255960 Sep 08 10:48:53.963180 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: d1756642795843229031d4d076b67295 Sep 08 10:48:53.963180 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-680255960 Sep 08 10:48:53.963180 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServersAdminNegativeTestJSON-680255960-project-admin Sep 08 10:48:53.963180 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:48:53.963180 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:48:53.963180 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 9de7e8611c4848cc9a1e9942b490a383 Sep 08 10:48:53.963180 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServersAdminNegativeTestJSON-680255960-project-admin Sep 08 10:48:53.963180 n-d-850501-12 devstack@n-api.service[128861]: Sep 08 10:48:53.963180 n-d-850501-12 devstack@n-api.service[128861]: {"os-resetState": {"state": "error"}} Sep 08 10:48:53.963180 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:48:53.963180 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 999 could not be found. Sep 08 10:48:53.963180 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Sep 08 10:48:53.963180 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:48:53.963180 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:48:53.963180 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:48:53.963180 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:48:53.963180 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 08 10:48:53.963180 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 08 10:48:53.963180 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Sep 08 10:48:53.963180 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:48:53.963180 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:48:53.963180 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:48:53.963180 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:48:53.963180 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:48:53.963180 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:48:53.963180 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:48:53.963180 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:48:53.963180 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:48:53.963180 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:48:53.963180 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:48:53.963180 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:48:53.963180 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Sep 08 10:48:53.963180 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 08 10:48:53.963180 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:48:53.963180 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:48:53.963180 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Sep 08 10:48:53.963180 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:48:53.963180 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:48:53.963180 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:48:53.963180 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:48:53.963180 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:48:53.963180 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:48:53.963180 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:48:53.969698 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:48:53.969698 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Sep 08 10:48:53.969698 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:48:53.969698 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1db00b54-4d3c-441b-ac0b-b9996ba49dd1 tempest-ServersAdminNegativeTestJSON-680255960 tempest-ServersAdminNegativeTestJSON-680255960-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:48:53.969698 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1db00b54-4d3c-441b-ac0b-b9996ba49dd1 tempest-ServersAdminNegativeTestJSON-680255960 tempest-ServersAdminNegativeTestJSON-680255960-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.060964 Sep 08 10:48:53.970400 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1303/2634] 10.222.0.27 () {60 vars in 1179 bytes} [Thu Sep 8 10:48:53 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:48:53.977393 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ca5d72d0-b500-4b51-b3af-1fd851567e5c tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:53.977393 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ca5d72d0-b500-4b51-b3af-1fd851567e5c tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] [instance: 814d8327-fc0e-4846-a449-598e482d71c6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:53.998992 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ca5d72d0-b500-4b51-b3af-1fd851567e5c tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:54.001923 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ca5d72d0-b500-4b51-b3af-1fd851567e5c tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:54.002453 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ca5d72d0-b500-4b51-b3af-1fd851567e5c tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:54.004274 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ca5d72d0-b500-4b51-b3af-1fd851567e5c tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:54.004773 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ca5d72d0-b500-4b51-b3af-1fd851567e5c tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:54.005268 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ca5d72d0-b500-4b51-b3af-1fd851567e5c tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:54.085578 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ca5d72d0-b500-4b51-b3af-1fd851567e5c tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] [instance: 814d8327-fc0e-4846-a449-598e482d71c6] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:48:54.286854 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:48:54.295172 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ca5d72d0-b500-4b51-b3af-1fd851567e5c tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] 10.222.0.27 "DELETE /compute/v2.1/servers/814d8327-fc0e-4846-a449-598e482d71c6" status: 204 len: 0 microversion: 2.1 time: 0.323396 Sep 08 10:48:54.299585 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1304/2635] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:48:53 2022] DELETE /compute/v2.1/servers/814d8327-fc0e-4846-a449-598e482d71c6 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:48:54.311709 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-593b2b7e-aca3-4c9e-9034-7acca7abf144 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:54.314095 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-593b2b7e-aca3-4c9e-9034-7acca7abf144 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] [instance: 814d8327-fc0e-4846-a449-598e482d71c6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:54.339185 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-593b2b7e-aca3-4c9e-9034-7acca7abf144 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:54.340397 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-593b2b7e-aca3-4c9e-9034-7acca7abf144 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:54.343014 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-593b2b7e-aca3-4c9e-9034-7acca7abf144 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:54.344376 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-593b2b7e-aca3-4c9e-9034-7acca7abf144 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:54.345557 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-593b2b7e-aca3-4c9e-9034-7acca7abf144 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:54.347027 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-593b2b7e-aca3-4c9e-9034-7acca7abf144 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:54.592455 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-593b2b7e-aca3-4c9e-9034-7acca7abf144 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6f265811ad4ccf866fb8094782dd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9a5f2a2b4f460dad3731b0ce6ecebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:54.612989 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-593b2b7e-aca3-4c9e-9034-7acca7abf144 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] 10.222.0.27 "GET /compute/v2.1/servers/814d8327-fc0e-4846-a449-598e482d71c6" status: 200 len: 1465 microversion: 2.1 time: 0.305349 Sep 08 10:48:54.613766 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1305/2636] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:54 2022] GET /compute/v2.1/servers/814d8327-fc0e-4846-a449-598e482d71c6 => generated 1465 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:54.639127 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-776e582b-2fc2-465b-95eb-3735f6007e64 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:54.641692 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-776e582b-2fc2-465b-95eb-3735f6007e64 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] [instance: 4703a7bf-a1ba-4bba-8928-3c403f3f3f21] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:54.658852 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-776e582b-2fc2-465b-95eb-3735f6007e64 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:54.660098 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-776e582b-2fc2-465b-95eb-3735f6007e64 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:54.661278 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-776e582b-2fc2-465b-95eb-3735f6007e64 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:54.662876 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-776e582b-2fc2-465b-95eb-3735f6007e64 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:54.663921 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-776e582b-2fc2-465b-95eb-3735f6007e64 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:54.664720 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-776e582b-2fc2-465b-95eb-3735f6007e64 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:54.821166 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b17b4d21-7b2c-4a9a-8db3-d9c41b556cd1 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fb4a7dae3346d39f70c51055cfd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065d7179ebd6460cb039bd1624296b57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:54.840528 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b17b4d21-7b2c-4a9a-8db3-d9c41b556cd1 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] 10.222.0.27 "GET /compute/v2.1/servers/a2469f0a-d6bc-46ae-8905-049f2123dc0c" status: 200 len: 1404 microversion: 2.1 time: 1.432639 Sep 08 10:48:54.858690 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1332/2637] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:53 2022] GET /compute/v2.1/servers/a2469f0a-d6bc-46ae-8905-049f2123dc0c => generated 1404 bytes in 1436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:54.883583 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-74302830-9ddf-4b66-a933-cc628ab6b1a4 req-eee6c12d-ba04-4d62-9f1d-4154dee84c0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2469f0a-d6bc-46ae-8905-049f2123dc0c", "tag": "f2d328aa-1a87-4e45-9e61-2691302ceff1"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:48:54.887076 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-776e582b-2fc2-465b-95eb-3735f6007e64 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528fc9fbb57149c9a9c755c6497f5c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effe8e6c23114b8ab80e76bec365de60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:54.919437 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-74302830-9ddf-4b66-a933-cc628ab6b1a4 req-eee6c12d-ba04-4d62-9f1d-4154dee84c0d service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:54.919944 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-74302830-9ddf-4b66-a933-cc628ab6b1a4 req-eee6c12d-ba04-4d62-9f1d-4154dee84c0d service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:54.920386 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-74302830-9ddf-4b66-a933-cc628ab6b1a4 req-eee6c12d-ba04-4d62-9f1d-4154dee84c0d service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:54.935098 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-776e582b-2fc2-465b-95eb-3735f6007e64 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] 10.222.0.27 "GET /compute/v2.1/servers/4703a7bf-a1ba-4bba-8928-3c403f3f3f21" status: 200 len: 1252 microversion: 2.1 time: 0.317589 Sep 08 10:48:54.941841 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1306/2638] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:54 2022] GET /compute/v2.1/servers/4703a7bf-a1ba-4bba-8928-3c403f3f3f21 => generated 1252 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:54.949422 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2ea78261-1279-4883-b95a-5965a7989285 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:54.953057 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-74302830-9ddf-4b66-a933-cc628ab6b1a4 req-eee6c12d-ba04-4d62-9f1d-4154dee84c0d service nova] Creating event network-changed:f2d328aa-1a87-4e45-9e61-2691302ceff1 for instance a2469f0a-d6bc-46ae-8905-049f2123dc0c on n-h1-850501-12 Sep 08 10:48:54.953923 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2ea78261-1279-4883-b95a-5965a7989285 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:54.963241 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-74302830-9ddf-4b66-a933-cc628ab6b1a4 req-eee6c12d-ba04-4d62-9f1d-4154dee84c0d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097263 Sep 08 10:48:54.966051 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1333/2639] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:48:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:48:54.974320 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2ea78261-1279-4883-b95a-5965a7989285 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:54.976168 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2ea78261-1279-4883-b95a-5965a7989285 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:54.977553 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2ea78261-1279-4883-b95a-5965a7989285 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:54.981004 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2ea78261-1279-4883-b95a-5965a7989285 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:54.981753 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2ea78261-1279-4883-b95a-5965a7989285 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:54.983941 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2ea78261-1279-4883-b95a-5965a7989285 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:55.272176 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2ea78261-1279-4883-b95a-5965a7989285 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:55.294651 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2ea78261-1279-4883-b95a-5965a7989285 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:55.297167 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2ea78261-1279-4883-b95a-5965a7989285 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:55.304027 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2ea78261-1279-4883-b95a-5965a7989285 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1539 microversion: 2.91 time: 0.360211 Sep 08 10:48:55.306605 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1307/2640] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:48:54 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1539 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:48:55.640118 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6cd6c64d-f347-4f59-88af-ea8c0521c06a tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:55.642181 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6cd6c64d-f347-4f59-88af-ea8c0521c06a tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] [instance: 814d8327-fc0e-4846-a449-598e482d71c6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:55.663458 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6cd6c64d-f347-4f59-88af-ea8c0521c06a tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:55.667068 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6cd6c64d-f347-4f59-88af-ea8c0521c06a tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:55.670014 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6cd6c64d-f347-4f59-88af-ea8c0521c06a tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:55.672390 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6cd6c64d-f347-4f59-88af-ea8c0521c06a tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:55.673559 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6cd6c64d-f347-4f59-88af-ea8c0521c06a tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:55.676231 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6cd6c64d-f347-4f59-88af-ea8c0521c06a tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:55.879885 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-29165bd5-144e-45cf-9a9d-b597d3cd773e tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:55.880499 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-29165bd5-144e-45cf-9a9d-b597d3cd773e tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] [instance: a2469f0a-d6bc-46ae-8905-049f2123dc0c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:55.891161 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-29165bd5-144e-45cf-9a9d-b597d3cd773e tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:55.891723 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-29165bd5-144e-45cf-9a9d-b597d3cd773e tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:55.896608 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-29165bd5-144e-45cf-9a9d-b597d3cd773e tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:55.897540 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-29165bd5-144e-45cf-9a9d-b597d3cd773e tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:55.898044 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-29165bd5-144e-45cf-9a9d-b597d3cd773e tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:55.901942 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-29165bd5-144e-45cf-9a9d-b597d3cd773e tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:55.975468 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6cd6c64d-f347-4f59-88af-ea8c0521c06a tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6f265811ad4ccf866fb8094782dd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9a5f2a2b4f460dad3731b0ce6ecebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:55.988727 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6cd6c64d-f347-4f59-88af-ea8c0521c06a tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] 10.222.0.27 "GET /compute/v2.1/servers/814d8327-fc0e-4846-a449-598e482d71c6" status: 200 len: 1465 microversion: 2.1 time: 0.354219 Sep 08 10:48:55.989814 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1334/2641] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:55 2022] GET /compute/v2.1/servers/814d8327-fc0e-4846-a449-598e482d71c6 => generated 1465 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:56.304737 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b41261de-eb9f-4500-86b1-aff6aa6c32ff tempest-KeyPairsV22TestJSON-412997229 tempest-KeyPairsV22TestJSON-412997229-project] Action: 'create', calling method: .version_select at 0x7f68e4748160>, body: {"keypair": {"name": "tempest-keypair-2124511418", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA6i2/mJldmQLBt+Gc4f5HfktMsGEIWp4tzKdoRUEGIk1+Vb6jUNrITpIyXf8bQ7YU2XdWrfLjjALs3TINfoiKqcVvR8nieNmLJoB7YfcBdedq6/erLbkRd2DrcdAQwaEw=="}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:48:56.340137 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-b41261de-eb9f-4500-86b1-aff6aa6c32ff tempest-KeyPairsV22TestJSON-412997229 tempest-KeyPairsV22TestJSON-412997229-project] Getting quotas for project 1e720d9aecdd45bc85b4c93882d4889f. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:48:56.349355 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-b41261de-eb9f-4500-86b1-aff6aa6c32ff tempest-KeyPairsV22TestJSON-412997229 tempest-KeyPairsV22TestJSON-412997229-project] Getting quotas for user 709bf266cebc4ca0ba8cef958b339906 and project 1e720d9aecdd45bc85b4c93882d4889f. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:48:56.382153 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b41261de-eb9f-4500-86b1-aff6aa6c32ff tempest-KeyPairsV22TestJSON-412997229 tempest-KeyPairsV22TestJSON-412997229-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.390390 Sep 08 10:48:56.382964 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1335/2642] 10.222.0.27 () {62 vars in 1199 bytes} [Thu Sep 8 10:48:55 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 392 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 08 10:48:56.390014 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1045403d-9908-4972-b62b-89f5c48da8c7 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:56.391082 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1045403d-9908-4972-b62b-89f5c48da8c7 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] [instance: 4703a7bf-a1ba-4bba-8928-3c403f3f3f21] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:56.400776 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1045403d-9908-4972-b62b-89f5c48da8c7 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:56.401691 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1045403d-9908-4972-b62b-89f5c48da8c7 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:56.402361 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1045403d-9908-4972-b62b-89f5c48da8c7 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:56.403402 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1045403d-9908-4972-b62b-89f5c48da8c7 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:56.404090 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1045403d-9908-4972-b62b-89f5c48da8c7 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:56.404723 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1045403d-9908-4972-b62b-89f5c48da8c7 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:56.502442 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-29165bd5-144e-45cf-9a9d-b597d3cd773e tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fb4a7dae3346d39f70c51055cfd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065d7179ebd6460cb039bd1624296b57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:56.503384 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1045403d-9908-4972-b62b-89f5c48da8c7 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528fc9fbb57149c9a9c755c6497f5c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effe8e6c23114b8ab80e76bec365de60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:56.511331 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-29165bd5-144e-45cf-9a9d-b597d3cd773e tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] 10.222.0.27 "GET /compute/v2.1/servers/a2469f0a-d6bc-46ae-8905-049f2123dc0c" status: 200 len: 1404 microversion: 2.1 time: 0.637077 Sep 08 10:48:56.514464 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1045403d-9908-4972-b62b-89f5c48da8c7 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] 10.222.0.27 "GET /compute/v2.1/servers/4703a7bf-a1ba-4bba-8928-3c403f3f3f21" status: 200 len: 1252 microversion: 2.1 time: 0.130165 Sep 08 10:48:56.515538 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1336/2643] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:56 2022] GET /compute/v2.1/servers/4703a7bf-a1ba-4bba-8928-3c403f3f3f21 => generated 1252 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:56.516062 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1308/2644] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:55 2022] GET /compute/v2.1/servers/a2469f0a-d6bc-46ae-8905-049f2123dc0c => generated 1404 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:56.525171 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-26010645-b2d8-4a0e-88df-106711e1d446 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:56.525953 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-26010645-b2d8-4a0e-88df-106711e1d446 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:56.529222 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fc368b89-cf5d-4d36-afdf-553d0690a5ea tempest-KeyPairsV22TestJSON-412997229 tempest-KeyPairsV22TestJSON-412997229-project] Calling method '.version_select at 0x7f68e466d5e0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:56.540871 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-26010645-b2d8-4a0e-88df-106711e1d446 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:56.541313 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-26010645-b2d8-4a0e-88df-106711e1d446 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:56.544247 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-26010645-b2d8-4a0e-88df-106711e1d446 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:56.545308 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-26010645-b2d8-4a0e-88df-106711e1d446 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:56.545925 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-26010645-b2d8-4a0e-88df-106711e1d446 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:56.546517 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-26010645-b2d8-4a0e-88df-106711e1d446 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:56.549757 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fc368b89-cf5d-4d36-afdf-553d0690a5ea tempest-KeyPairsV22TestJSON-412997229 tempest-KeyPairsV22TestJSON-412997229-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs/tempest-keypair-2124511418" status: 200 len: 513 microversion: 2.2 time: 0.032465 Sep 08 10:48:56.562557 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1309/2645] 10.222.0.27 () {60 vars in 1258 bytes} [Thu Sep 8 10:48:56 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2124511418 => generated 513 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:48:56.573846 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-02be69a2-0090-40d6-806c-c335ebd1ff02 tempest-KeyPairsV22TestJSON-412997229 tempest-KeyPairsV22TestJSON-412997229-project] Calling method '.version_select at 0x7f68e458a670>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:56.620658 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-02be69a2-0090-40d6-806c-c335ebd1ff02 tempest-KeyPairsV22TestJSON-412997229 tempest-KeyPairsV22TestJSON-412997229-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2124511418" status: 204 len: 0 microversion: 2.2 time: 0.056620 Sep 08 10:48:56.624125 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1310/2646] 10.222.0.27 () {60 vars in 1261 bytes} [Thu Sep 8 10:48:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2124511418 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:48:56.644179 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6b663a57-6486-471f-86fe-a853d86cb1e1 tempest-KeyPairsV22TestJSON-412997229 tempest-KeyPairsV22TestJSON-412997229-project] Action: 'create', calling method: .version_select at 0x7f68e49dc940>, body: {"keypair": {"name": "tempest-keypair-1214006168", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEhQ1f4jNsfLdXZzWi4cg/MzO27l+XhdEP7v0z/A5GQL04Hi+Lk5n7+Zw2vzMdo0XJ0+OlFuVdbGcgINxvhd6CRoIZjPHiDHebNRxd60OA1U1aMCyMHL84UZO1p+rA34Jg=="}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:48:56.689925 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-6b663a57-6486-471f-86fe-a853d86cb1e1 tempest-KeyPairsV22TestJSON-412997229 tempest-KeyPairsV22TestJSON-412997229-project] Getting quotas for project 1e720d9aecdd45bc85b4c93882d4889f. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:48:56.708069 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-6b663a57-6486-471f-86fe-a853d86cb1e1 tempest-KeyPairsV22TestJSON-412997229 tempest-KeyPairsV22TestJSON-412997229-project] Getting quotas for user 709bf266cebc4ca0ba8cef958b339906 and project 1e720d9aecdd45bc85b4c93882d4889f. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:48:56.708740 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-26010645-b2d8-4a0e-88df-106711e1d446 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:56.721406 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-26010645-b2d8-4a0e-88df-106711e1d446 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:56.724852 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-26010645-b2d8-4a0e-88df-106711e1d446 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:56.732630 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-26010645-b2d8-4a0e-88df-106711e1d446 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1539 microversion: 2.91 time: 0.215821 Sep 08 10:48:56.760279 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1337/2647] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:48:56 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1539 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:48:56.797692 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6b663a57-6486-471f-86fe-a853d86cb1e1 tempest-KeyPairsV22TestJSON-412997229 tempest-KeyPairsV22TestJSON-412997229-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.161502 Sep 08 10:48:56.798738 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1311/2648] 10.222.0.27 () {62 vars in 1199 bytes} [Thu Sep 8 10:48:56 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 166 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Sep 08 10:48:56.822243 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4d16e7f0-9406-4904-96f7-dca764887e93 tempest-KeyPairsV22TestJSON-412997229 tempest-KeyPairsV22TestJSON-412997229-project] Calling method '.version_select at 0x7f68e4350310>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:56.868846 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4d16e7f0-9406-4904-96f7-dca764887e93 tempest-KeyPairsV22TestJSON-412997229 tempest-KeyPairsV22TestJSON-412997229-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1214006168" status: 204 len: 0 microversion: 2.2 time: 0.060651 Sep 08 10:48:56.884521 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1338/2649] 10.222.0.27 () {60 vars in 1261 bytes} [Thu Sep 8 10:48:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1214006168 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:48:56.894579 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1ca23220-285a-4389-a37b-8e83995a31a7 tempest-KeyPairsV22TestJSON-412997229 tempest-KeyPairsV22TestJSON-412997229-project] Action: 'create', calling method: .version_select at 0x7f68e44fb1f0>, body: {"keypair": {"name": "tempest-keypair-1946817850", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:48:56.934963 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-1ca23220-285a-4389-a37b-8e83995a31a7 tempest-KeyPairsV22TestJSON-412997229 tempest-KeyPairsV22TestJSON-412997229-project] Getting quotas for project 1e720d9aecdd45bc85b4c93882d4889f. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:48:56.940954 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-1ca23220-285a-4389-a37b-8e83995a31a7 tempest-KeyPairsV22TestJSON-412997229 tempest-KeyPairsV22TestJSON-412997229-project] Getting quotas for user 709bf266cebc4ca0ba8cef958b339906 and project 1e720d9aecdd45bc85b4c93882d4889f. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:48:56.971993 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1ca23220-285a-4389-a37b-8e83995a31a7 tempest-KeyPairsV22TestJSON-412997229 tempest-KeyPairsV22TestJSON-412997229-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.082358 Sep 08 10:48:56.982529 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1312/2650] 10.222.0.27 () {62 vars in 1199 bytes} [Thu Sep 8 10:48:56 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 94 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Sep 08 10:48:56.992674 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c5a59230-1ba1-40af-9215-15356f1b833d tempest-KeyPairsV22TestJSON-412997229 tempest-KeyPairsV22TestJSON-412997229-project] Calling method '.version_select at 0x7f68e46700d0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:57.021359 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-26695b4f-6e86-4db6-8589-d1bd748adec3 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:57.021983 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-26695b4f-6e86-4db6-8589-d1bd748adec3 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] [instance: 814d8327-fc0e-4846-a449-598e482d71c6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:57.023182 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c5a59230-1ba1-40af-9215-15356f1b833d tempest-KeyPairsV22TestJSON-412997229 tempest-KeyPairsV22TestJSON-412997229-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1946817850" status: 204 len: 0 microversion: 2.2 time: 0.039463 Sep 08 10:48:57.025749 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1339/2651] 10.222.0.27 () {60 vars in 1261 bytes} [Thu Sep 8 10:48:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1946817850 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 10:48:57.045488 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-26695b4f-6e86-4db6-8589-d1bd748adec3 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:57.046156 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-26695b4f-6e86-4db6-8589-d1bd748adec3 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:57.049914 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-26695b4f-6e86-4db6-8589-d1bd748adec3 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:57.050790 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e752b4fa-9c0d-496c-9968-b03d4fe2a723 tempest-KeyPairsV22TestJSON-412997229 tempest-KeyPairsV22TestJSON-412997229-project] Action: 'create', calling method: .version_select at 0x7f68e46c90d0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1166540279", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEfjgP+8lOhz/1OBm6nggP+iCjyDtKwIdj/7hMKvVgo04oWASCqNe85PlWv0bwmLzdOwINrW2GbtqoDvGoIrUJpkJTyxI+C2vaH8b4Fs2uSTfK2ugGxCjWsuqs0A2PkVew=="}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:48:57.051461 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-26695b4f-6e86-4db6-8589-d1bd748adec3 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:57.051951 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-26695b4f-6e86-4db6-8589-d1bd748adec3 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:57.053699 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-26695b4f-6e86-4db6-8589-d1bd748adec3 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:57.093244 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-e752b4fa-9c0d-496c-9968-b03d4fe2a723 tempest-KeyPairsV22TestJSON-412997229 tempest-KeyPairsV22TestJSON-412997229-project] Getting quotas for project 1e720d9aecdd45bc85b4c93882d4889f. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:48:57.109631 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-e752b4fa-9c0d-496c-9968-b03d4fe2a723 tempest-KeyPairsV22TestJSON-412997229 tempest-KeyPairsV22TestJSON-412997229-project] Getting quotas for user 709bf266cebc4ca0ba8cef958b339906 and project 1e720d9aecdd45bc85b4c93882d4889f. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:48:57.179029 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e752b4fa-9c0d-496c-9968-b03d4fe2a723 tempest-KeyPairsV22TestJSON-412997229 tempest-KeyPairsV22TestJSON-412997229-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.141452 Sep 08 10:48:57.187578 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1340/2652] 10.222.0.27 () {62 vars in 1199 bytes} [Thu Sep 8 10:48:57 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 152 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 08 10:48:57.205478 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c56fd140-ed0b-4028-91c9-70f2ef99dfb4 tempest-KeyPairsV22TestJSON-412997229 tempest-KeyPairsV22TestJSON-412997229-project] Action: 'create', calling method: .version_select at 0x7f68e4350d30>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-2105341072", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMPyZ52sz+wzR2KLrQhsrCf79uRACQV2c8fbRW928FyeLPWicsNU1bmLtF8FjI3bZFULGho9jhQiHP6/Rw7b1Ss7Rd7KHljSC/vMZUAHHc0Do9bwClEUaiu4jJpNd+o4eQ=="}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:48:57.299696 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-c56fd140-ed0b-4028-91c9-70f2ef99dfb4 tempest-KeyPairsV22TestJSON-412997229 tempest-KeyPairsV22TestJSON-412997229-project] Getting quotas for project 1e720d9aecdd45bc85b4c93882d4889f. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:48:57.312334 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-c56fd140-ed0b-4028-91c9-70f2ef99dfb4 tempest-KeyPairsV22TestJSON-412997229 tempest-KeyPairsV22TestJSON-412997229-project] Getting quotas for user 709bf266cebc4ca0ba8cef958b339906 and project 1e720d9aecdd45bc85b4c93882d4889f. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:48:57.405004 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c56fd140-ed0b-4028-91c9-70f2ef99dfb4 tempest-KeyPairsV22TestJSON-412997229 tempest-KeyPairsV22TestJSON-412997229-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.207173 Sep 08 10:48:57.408430 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1341/2653] 10.222.0.27 () {62 vars in 1199 bytes} [Thu Sep 8 10:48:57 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 211 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Sep 08 10:48:57.453601 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6515ef88-2963-4db9-a041-9c64977693a2 tempest-KeyPairsV22TestJSON-412997229 tempest-KeyPairsV22TestJSON-412997229-project] Action: 'create', calling method: .version_select at 0x7f68e47315e0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1365933856", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKDElsRiC1sSjEsTmrXVl1U9atuVwXEcowGgtSZfAYXu7WupyxzOyjBaETY9C6AiTBTSXDQWgvtSgSS+tuSfB4I6FDLf75sH3gMavieBkSM3dkeN4euhmxaxpHSX5/8ooA=="}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:48:57.465744 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-26695b4f-6e86-4db6-8589-d1bd748adec3 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6f265811ad4ccf866fb8094782dd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9a5f2a2b4f460dad3731b0ce6ecebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:57.479904 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-26695b4f-6e86-4db6-8589-d1bd748adec3 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] 10.222.0.27 "GET /compute/v2.1/servers/814d8327-fc0e-4846-a449-598e482d71c6" status: 200 len: 1465 microversion: 2.1 time: 0.462645 Sep 08 10:48:57.481610 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1313/2654] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:57 2022] GET /compute/v2.1/servers/814d8327-fc0e-4846-a449-598e482d71c6 => generated 1465 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:48:57.497994 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-6515ef88-2963-4db9-a041-9c64977693a2 tempest-KeyPairsV22TestJSON-412997229 tempest-KeyPairsV22TestJSON-412997229-project] Getting quotas for project 1e720d9aecdd45bc85b4c93882d4889f. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:48:57.513096 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-6515ef88-2963-4db9-a041-9c64977693a2 tempest-KeyPairsV22TestJSON-412997229 tempest-KeyPairsV22TestJSON-412997229-project] Getting quotas for user 709bf266cebc4ca0ba8cef958b339906 and project 1e720d9aecdd45bc85b4c93882d4889f. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:48:57.569182 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6515ef88-2963-4db9-a041-9c64977693a2 tempest-KeyPairsV22TestJSON-412997229 tempest-KeyPairsV22TestJSON-412997229-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.149397 Sep 08 10:48:57.583016 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-09771df1-a63d-4849-926a-e9575cfa1060 tempest-KeyPairsV22TestJSON-412997229 tempest-KeyPairsV22TestJSON-412997229-project] Calling method '.version_select at 0x7f68e4d23430>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:57.592143 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1342/2655] 10.222.0.27 () {62 vars in 1199 bytes} [Thu Sep 8 10:48:57 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 174 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Sep 08 10:48:57.593064 n-d-850501-12 devstack@n-api.service[128861]: WARNING oslo_db.sqlalchemy.utils [None req-09771df1-a63d-4849-926a-e9575cfa1060 tempest-KeyPairsV22TestJSON-412997229 tempest-KeyPairsV22TestJSON-412997229-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 08 10:48:57.604088 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-09771df1-a63d-4849-926a-e9575cfa1060 tempest-KeyPairsV22TestJSON-412997229 tempest-KeyPairsV22TestJSON-412997229-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs" status: 200 len: 1142 microversion: 2.2 time: 0.025771 Sep 08 10:48:57.605536 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-70e5321a-0587-446b-b1c5-6035d1224fe0 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:57.606311 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-70e5321a-0587-446b-b1c5-6035d1224fe0 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] [instance: 4703a7bf-a1ba-4bba-8928-3c403f3f3f21] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:57.616067 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1314/2656] 10.222.0.27 () {60 vars in 1177 bytes} [Thu Sep 8 10:48:57 2022] GET /compute/v2.1/os-keypairs => generated 1142 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:48:57.629151 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70e5321a-0587-446b-b1c5-6035d1224fe0 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:57.629767 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70e5321a-0587-446b-b1c5-6035d1224fe0 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:57.630314 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70e5321a-0587-446b-b1c5-6035d1224fe0 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:57.634708 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70e5321a-0587-446b-b1c5-6035d1224fe0 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:57.635358 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70e5321a-0587-446b-b1c5-6035d1224fe0 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:57.635902 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70e5321a-0587-446b-b1c5-6035d1224fe0 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:57.640796 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a139646c-b5b7-4e33-a281-fc27084346ce tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:57.641913 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a139646c-b5b7-4e33-a281-fc27084346ce tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] [instance: a2469f0a-d6bc-46ae-8905-049f2123dc0c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:57.654965 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a139646c-b5b7-4e33-a281-fc27084346ce tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:57.655829 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a139646c-b5b7-4e33-a281-fc27084346ce tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:57.656508 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a139646c-b5b7-4e33-a281-fc27084346ce tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:57.657555 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a139646c-b5b7-4e33-a281-fc27084346ce tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:57.658362 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a139646c-b5b7-4e33-a281-fc27084346ce tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:57.658999 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a139646c-b5b7-4e33-a281-fc27084346ce tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:57.716131 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:48:57.720469 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70e5321a-0587-446b-b1c5-6035d1224fe0 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:57.725579 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70e5321a-0587-446b-b1c5-6035d1224fe0 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:57.726326 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70e5321a-0587-446b-b1c5-6035d1224fe0 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:57.727649 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-70e5321a-0587-446b-b1c5-6035d1224fe0 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lazy-loading 'fault' on Instance uuid 4703a7bf-a1ba-4bba-8928-3c403f3f3f21 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:48:57.814225 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-70e5321a-0587-446b-b1c5-6035d1224fe0 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528fc9fbb57149c9a9c755c6497f5c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effe8e6c23114b8ab80e76bec365de60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:57.824420 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-70e5321a-0587-446b-b1c5-6035d1224fe0 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] 10.222.0.27 "GET /compute/v2.1/servers/4703a7bf-a1ba-4bba-8928-3c403f3f3f21" status: 200 len: 1257 microversion: 2.1 time: 0.227625 Sep 08 10:48:57.831585 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1343/2657] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:57 2022] GET /compute/v2.1/servers/4703a7bf-a1ba-4bba-8928-3c403f3f3f21 => generated 1257 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:57.842190 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1248b43f-49fe-452c-bff0-cf5e5472a126 tempest-KeyPairsV22TestJSON-412997229 tempest-KeyPairsV22TestJSON-412997229-project] Calling method '.version_select at 0x7f68e469e3a0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:57.894679 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1248b43f-49fe-452c-bff0-cf5e5472a126 tempest-KeyPairsV22TestJSON-412997229 tempest-KeyPairsV22TestJSON-412997229-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1365933856" status: 204 len: 0 microversion: 2.2 time: 0.061249 Sep 08 10:48:57.900929 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1344/2658] 10.222.0.27 () {60 vars in 1321 bytes} [Thu Sep 8 10:48:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1365933856 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:48:57.916470 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9e0e9f38-eda2-4e09-ad31-327544fb51ae tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:57.921456 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9e0e9f38-eda2-4e09-ad31-327544fb51ae tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:57.950973 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9e0e9f38-eda2-4e09-ad31-327544fb51ae tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:57.955610 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9e0e9f38-eda2-4e09-ad31-327544fb51ae tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:57.958625 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9e0e9f38-eda2-4e09-ad31-327544fb51ae tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:57.959746 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9e0e9f38-eda2-4e09-ad31-327544fb51ae tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:57.961599 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9e0e9f38-eda2-4e09-ad31-327544fb51ae tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:57.962156 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9e0e9f38-eda2-4e09-ad31-327544fb51ae tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:58.140918 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9e0e9f38-eda2-4e09-ad31-327544fb51ae tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:58.155777 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9e0e9f38-eda2-4e09-ad31-327544fb51ae tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:58.164261 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9e0e9f38-eda2-4e09-ad31-327544fb51ae tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:58.182130 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9e0e9f38-eda2-4e09-ad31-327544fb51ae tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1539 microversion: 2.91 time: 0.278202 Sep 08 10:48:58.183352 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1345/2659] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:48:57 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1539 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:48:58.192406 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-986a2ce6-867d-480f-9c2a-be30389413b7 tempest-KeyPairsV22TestJSON-412997229 tempest-KeyPairsV22TestJSON-412997229-project] Calling method '.version_select at 0x7f68e4350820>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:58.232107 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:DELETE=4 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:48:58.250249 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-986a2ce6-867d-480f-9c2a-be30389413b7 tempest-KeyPairsV22TestJSON-412997229 tempest-KeyPairsV22TestJSON-412997229-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2105341072" status: 204 len: 0 microversion: 2.2 time: 0.065201 Sep 08 10:48:58.254790 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1346/2660] 10.222.0.27 () {60 vars in 1321 bytes} [Thu Sep 8 10:48:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2105341072 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:48:58.272052 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-963d755d-3044-4723-ac3f-1c4f2e73201d tempest-KeyPairsV22TestJSON-412997229 tempest-KeyPairsV22TestJSON-412997229-project] Calling method '.version_select at 0x7f68e4563940>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:58.335761 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-963d755d-3044-4723-ac3f-1c4f2e73201d tempest-KeyPairsV22TestJSON-412997229 tempest-KeyPairsV22TestJSON-412997229-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1166540279" status: 204 len: 0 microversion: 2.2 time: 0.073866 Sep 08 10:48:58.340167 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1347/2661] 10.222.0.27 () {60 vars in 1321 bytes} [Thu Sep 8 10:48:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1166540279 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:48:58.343564 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a139646c-b5b7-4e33-a281-fc27084346ce tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fb4a7dae3346d39f70c51055cfd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065d7179ebd6460cb039bd1624296b57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:58.346568 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-a4519f28-1e31-4348-acec-4a21c23567de req-1400054e-8915-47d7-80c9-62b584c8aefd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "814d8327-fc0e-4846-a449-598e482d71c6", "name": "network-vif-deleted", "tag": "b1d66584-8d5f-420b-abef-c3ed821e4f57"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:48:58.361795 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a139646c-b5b7-4e33-a281-fc27084346ce tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] 10.222.0.27 "GET /compute/v2.1/servers/a2469f0a-d6bc-46ae-8905-049f2123dc0c" status: 200 len: 1404 microversion: 2.1 time: 0.742013 Sep 08 10:48:58.367054 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1315/2662] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:57 2022] GET /compute/v2.1/servers/a2469f0a-d6bc-46ae-8905-049f2123dc0c => generated 1404 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:58.384714 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-909616f9-d742-4214-a860-c84014545e11 tempest-KeyPairsV22TestJSON-412997229 tempest-KeyPairsV22TestJSON-412997229-project] Action: 'create', calling method: .version_select at 0x7f68e4463dc0>, body: {"keypair": {"name": "tempest-keypair-1208784033", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJo4NUehvxETvCtMwP2NZ4BeYVfPAffwMhbr05XxVN0OhJVmAlDU849NeIZAwJi0aTZN/te9s9nGSdRFD5zDfs/9ol8bs6IQlLSy+Ai8i8bjavenfY/7eFTC7uALVwPZzA=="}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:48:58.385615 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a4519f28-1e31-4348-acec-4a21c23567de req-1400054e-8915-47d7-80c9-62b584c8aefd service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:58.386450 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a4519f28-1e31-4348-acec-4a21c23567de req-1400054e-8915-47d7-80c9-62b584c8aefd service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:58.387113 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a4519f28-1e31-4348-acec-4a21c23567de req-1400054e-8915-47d7-80c9-62b584c8aefd service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:58.414299 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-a4519f28-1e31-4348-acec-4a21c23567de req-1400054e-8915-47d7-80c9-62b584c8aefd service nova] Creating event network-vif-deleted:b1d66584-8d5f-420b-abef-c3ed821e4f57 for instance 814d8327-fc0e-4846-a449-598e482d71c6 on n-h2-850501-12 Sep 08 10:48:58.431441 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-a4519f28-1e31-4348-acec-4a21c23567de req-1400054e-8915-47d7-80c9-62b584c8aefd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087673 Sep 08 10:48:58.433004 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1348/2663] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:48:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:48:58.444690 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-909616f9-d742-4214-a860-c84014545e11 tempest-KeyPairsV22TestJSON-412997229 tempest-KeyPairsV22TestJSON-412997229-project] Getting quotas for project 1e720d9aecdd45bc85b4c93882d4889f. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:48:58.467369 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-909616f9-d742-4214-a860-c84014545e11 tempest-KeyPairsV22TestJSON-412997229 tempest-KeyPairsV22TestJSON-412997229-project] Getting quotas for user 709bf266cebc4ca0ba8cef958b339906 and project 1e720d9aecdd45bc85b4c93882d4889f. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:48:58.509159 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-09f163f6-6aa1-4b61-8763-4162ddd8615f tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:58.510068 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-09f163f6-6aa1-4b61-8763-4162ddd8615f tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] [instance: 814d8327-fc0e-4846-a449-598e482d71c6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:58.529841 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-09f163f6-6aa1-4b61-8763-4162ddd8615f tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:58.530736 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-09f163f6-6aa1-4b61-8763-4162ddd8615f tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:58.532571 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-09f163f6-6aa1-4b61-8763-4162ddd8615f tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:58.533825 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-909616f9-d742-4214-a860-c84014545e11 tempest-KeyPairsV22TestJSON-412997229 tempest-KeyPairsV22TestJSON-412997229-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.163314 Sep 08 10:48:58.534982 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-09f163f6-6aa1-4b61-8763-4162ddd8615f tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:58.537699 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-09f163f6-6aa1-4b61-8763-4162ddd8615f tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:58.538419 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-09f163f6-6aa1-4b61-8763-4162ddd8615f tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:58.542971 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1316/2664] 10.222.0.27 () {62 vars in 1199 bytes} [Thu Sep 8 10:48:58 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 175 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 08 10:48:58.550239 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1b303cc5-c80b-4ced-bf04-ea82ff10d8ef tempest-KeyPairsV22TestJSON-412997229 tempest-KeyPairsV22TestJSON-412997229-project] Calling method '.version_select at 0x7f68e44d6d30>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:58.562295 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1b303cc5-c80b-4ced-bf04-ea82ff10d8ef tempest-KeyPairsV22TestJSON-412997229 tempest-KeyPairsV22TestJSON-412997229-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs/tempest-keypair-1208784033" status: 200 len: 513 microversion: 2.2 time: 0.017587 Sep 08 10:48:58.574776 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1317/2665] 10.222.0.27 () {60 vars in 1258 bytes} [Thu Sep 8 10:48:58 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1208784033 => generated 513 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:48:58.581211 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e90f72b0-5e6d-466c-9cc4-a05ab8095f5f tempest-KeyPairsV22TestJSON-412997229 tempest-KeyPairsV22TestJSON-412997229-project] Calling method '.version_select at 0x7f68e44f0820>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:58.588247 n-d-850501-12 devstack@n-api.service[128861]: WARNING oslo_db.sqlalchemy.utils [None req-e90f72b0-5e6d-466c-9cc4-a05ab8095f5f tempest-KeyPairsV22TestJSON-412997229 tempest-KeyPairsV22TestJSON-412997229-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 08 10:48:58.596406 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e90f72b0-5e6d-466c-9cc4-a05ab8095f5f tempest-KeyPairsV22TestJSON-412997229 tempest-KeyPairsV22TestJSON-412997229-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.020152 Sep 08 10:48:58.605297 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1318/2666] 10.222.0.27 () {60 vars in 1177 bytes} [Thu Sep 8 10:48:58 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:48:58.611399 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b3790f29-5e3a-4d48-8ef2-9a4f6b27a324 tempest-KeyPairsV22TestJSON-412997229 tempest-KeyPairsV22TestJSON-412997229-project] Calling method '.version_select at 0x7f68e466d820>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:58.612297 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:48:58.638933 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b3790f29-5e3a-4d48-8ef2-9a4f6b27a324 tempest-KeyPairsV22TestJSON-412997229 tempest-KeyPairsV22TestJSON-412997229-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1208784033" status: 204 len: 0 microversion: 2.2 time: 0.031072 Sep 08 10:48:58.640447 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1319/2667] 10.222.0.27 () {60 vars in 1261 bytes} [Thu Sep 8 10:48:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1208784033 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:48:58.657803 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f540a0ee-4483-4ca2-9e0c-0e8983d7110c tempest-KeyPairsV22TestJSON-412997229 tempest-KeyPairsV22TestJSON-412997229-project] Action: 'create', calling method: .version_select at 0x7f68e4533430>, body: {"keypair": {"name": "tempest-keypair-888224046", "type": "x509"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:48:58.708702 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-f540a0ee-4483-4ca2-9e0c-0e8983d7110c tempest-KeyPairsV22TestJSON-412997229 tempest-KeyPairsV22TestJSON-412997229-project] Getting quotas for project 1e720d9aecdd45bc85b4c93882d4889f. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:48:58.724621 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-f540a0ee-4483-4ca2-9e0c-0e8983d7110c tempest-KeyPairsV22TestJSON-412997229 tempest-KeyPairsV22TestJSON-412997229-project] Getting quotas for user 709bf266cebc4ca0ba8cef958b339906 and project 1e720d9aecdd45bc85b4c93882d4889f. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:48:58.787252 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.processutils [None req-f540a0ee-4483-4ca2-9e0c-0e8983d7110c tempest-KeyPairsV22TestJSON-412997229 tempest-KeyPairsV22TestJSON-412997229-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmppbadphy0/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmppbadphy0/temp.key -subj /CN=709bf266cebc4ca0ba8cef958b339906 -extensions v3_req_client {{(pid=128861) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Sep 08 10:48:58.800338 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-09f163f6-6aa1-4b61-8763-4162ddd8615f tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6f265811ad4ccf866fb8094782dd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9a5f2a2b4f460dad3731b0ce6ecebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:58.819655 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-09f163f6-6aa1-4b61-8763-4162ddd8615f tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] 10.222.0.27 "GET /compute/v2.1/servers/814d8327-fc0e-4846-a449-598e482d71c6" status: 200 len: 1296 microversion: 2.1 time: 0.306139 Sep 08 10:48:58.821753 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1349/2668] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:58 2022] GET /compute/v2.1/servers/814d8327-fc0e-4846-a449-598e482d71c6 => generated 1296 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:58.853745 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4bbf5909-3c8b-44a2-ad6f-8d77af40e3a5 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:58.855110 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4bbf5909-3c8b-44a2-ad6f-8d77af40e3a5 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] [instance: 4703a7bf-a1ba-4bba-8928-3c403f3f3f21] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:58.893916 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4bbf5909-3c8b-44a2-ad6f-8d77af40e3a5 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:58.896557 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4bbf5909-3c8b-44a2-ad6f-8d77af40e3a5 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:58.897763 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4bbf5909-3c8b-44a2-ad6f-8d77af40e3a5 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:58.898630 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4bbf5909-3c8b-44a2-ad6f-8d77af40e3a5 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:58.903273 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4bbf5909-3c8b-44a2-ad6f-8d77af40e3a5 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:58.903729 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4bbf5909-3c8b-44a2-ad6f-8d77af40e3a5 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:58.945461 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-4bbf5909-3c8b-44a2-ad6f-8d77af40e3a5 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] HTTP exception thrown: Instance 4703a7bf-a1ba-4bba-8928-3c403f3f3f21 could not be found. Sep 08 10:48:58.951209 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4bbf5909-3c8b-44a2-ad6f-8d77af40e3a5 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Request method failure captured: Sep 08 10:48:58.951209 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/4703a7bf-a1ba-4bba-8928-3c403f3f3f21 HTTP/1.1 Sep 08 10:48:58.951209 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:48:58.951209 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:48:58.951209 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:48:58.951209 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:48:58.951209 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:48:58.951209 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:48:58.951209 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:48:58.951209 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:48:58.951209 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcgVANtobSC1FCGeijIXk8gZr3DpkSa1SZotiWlzG_e5IiFVnFfBldJYTTotJ9JNeoZhbp3Jr7mlN3GguOAPaJZ0KpfgVlT3a92Fx7gLUaKhK41_cuWAsrNhbtGxGGDViapW9OrM2Swq81nAa9ZwnK8ZSNLCy5AgRLp5mzqcGA7ZPWA Sep 08 10:48:58.951209 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:48:58.951209 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:48:58.951209 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:48:58.951209 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:48:58.951209 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:48:58.951209 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:48:58.951209 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: effe8e6c23114b8ab80e76bec365de60 Sep 08 10:48:58.951209 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersTestBootFromVolume-45351653 Sep 08 10:48:58.951209 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:48:58.951209 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:48:58.951209 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/effe8e6c23114b8ab80e76bec365de60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/effe8e6c23114b8ab80e76bec365de60"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_effe8e6c23114b8ab80e76bec365de60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/effe8e6c23114b8ab80e76bec365de60"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:48:58.951209 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServersTestBootFromVolume-45351653 Sep 08 10:48:58.951209 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: effe8e6c23114b8ab80e76bec365de60 Sep 08 10:48:58.951209 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersTestBootFromVolume-45351653 Sep 08 10:48:58.951209 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServersTestBootFromVolume-45351653-project Sep 08 10:48:58.951209 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:48:58.951209 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:48:58.951209 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 528fc9fbb57149c9a9c755c6497f5c3a Sep 08 10:48:58.951209 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServersTestBootFromVolume-45351653-project Sep 08 10:48:58.951209 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:48:58.951209 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 4703a7bf-a1ba-4bba-8928-3c403f3f3f21 could not be found. Sep 08 10:48:58.951209 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '4703a7bf-a1ba-4bba-8928-3c403f3f3f21'} Sep 08 10:48:58.951209 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:48:58.951209 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:48:58.951209 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:48:58.951209 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:48:58.951209 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:48:58.951209 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:48:58.951209 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:48:58.951209 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:48:58.951209 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:48:58.951209 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:48:58.951209 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4703a7bf-a1ba-4bba-8928-3c403f3f3f21 could not be found. Sep 08 10:48:58.951209 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:48:58.951209 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:48:58.951209 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:48:58.951209 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:48:58.951209 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:48:58.951209 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:48:58.951209 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:48:58.951209 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:48:58.951209 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:48:58.951209 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:48:58.951209 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:48:58.951209 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:48:58.951209 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:48:58.951209 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:48:58.951209 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:48:58.951209 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:48:58.951209 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4703a7bf-a1ba-4bba-8928-3c403f3f3f21 could not be found. Sep 08 10:48:58.951209 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:48:58.951209 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:48:58.951209 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:48:58.957669 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:48:58.957669 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:48:58.957669 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:48:58.957669 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:48:58.957669 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:48:58.957669 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4703a7bf-a1ba-4bba-8928-3c403f3f3f21 could not be found. Sep 08 10:48:58.957669 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:48:58.962131 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4bbf5909-3c8b-44a2-ad6f-8d77af40e3a5 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Returning 404 to user: Instance 4703a7bf-a1ba-4bba-8928-3c403f3f3f21 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:48:58.963929 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4bbf5909-3c8b-44a2-ad6f-8d77af40e3a5 tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] 10.222.0.27 "GET /compute/v2.1/servers/4703a7bf-a1ba-4bba-8928-3c403f3f3f21" status: 404 len: 111 microversion: 2.1 time: 0.116660 Sep 08 10:48:58.971849 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1350/2669] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:58 2022] GET /compute/v2.1/servers/4703a7bf-a1ba-4bba-8928-3c403f3f3f21 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 10:48:58.992192 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ed50e665-b2d3-4f8d-a23f-c3239594d31e tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] Calling method '.version_select at 0x7f68e4670280>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:59.032206 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ed50e665-b2d3-4f8d-a23f-c3239594d31e tempest-ServersTestBootFromVolume-45351653 tempest-ServersTestBootFromVolume-45351653-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-928070625" status: 202 len: 0 microversion: 2.1 time: 0.058395 Sep 08 10:48:59.033170 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1351/2670] 10.222.0.27 () {58 vars in 1218 bytes} [Thu Sep 8 10:48:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-928070625 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:48:59.222472 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ca49f132-8fa3-4e7c-9c7b-753e8b086c39 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:59.224042 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ca49f132-8fa3-4e7c-9c7b-753e8b086c39 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:59.239933 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ca49f132-8fa3-4e7c-9c7b-753e8b086c39 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:59.245298 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ca49f132-8fa3-4e7c-9c7b-753e8b086c39 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:59.246409 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ca49f132-8fa3-4e7c-9c7b-753e8b086c39 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:59.247631 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ca49f132-8fa3-4e7c-9c7b-753e8b086c39 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:59.248623 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ca49f132-8fa3-4e7c-9c7b-753e8b086c39 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:59.249820 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ca49f132-8fa3-4e7c-9c7b-753e8b086c39 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:59.434784 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.processutils [None req-f540a0ee-4483-4ca2-9e0c-0e8983d7110c tempest-KeyPairsV22TestJSON-412997229 tempest-KeyPairsV22TestJSON-412997229-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmppbadphy0/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmppbadphy0/temp.key -subj /CN=709bf266cebc4ca0ba8cef958b339906 -extensions v3_req_client" returned: 0 in 0.641s {{(pid=128861) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Sep 08 10:48:59.442668 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.processutils [None req-f540a0ee-4483-4ca2-9e0c-0e8983d7110c tempest-KeyPairsV22TestJSON-412997229 tempest-KeyPairsV22TestJSON-412997229-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmppbadphy0/temp.key -password pass: {{(pid=128861) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Sep 08 10:48:59.539032 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.processutils [None req-f540a0ee-4483-4ca2-9e0c-0e8983d7110c tempest-KeyPairsV22TestJSON-412997229 tempest-KeyPairsV22TestJSON-412997229-project] CMD "openssl pkcs12 -export -inkey /tmp/tmppbadphy0/temp.key -password pass:" returned: 0 in 0.096s {{(pid=128861) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Sep 08 10:48:59.607704 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ca49f132-8fa3-4e7c-9c7b-753e8b086c39 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:59.613118 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-f540a0ee-4483-4ca2-9e0c-0e8983d7110c tempest-KeyPairsV22TestJSON-412997229 tempest-KeyPairsV22TestJSON-412997229-project] Getting quotas for project 1e720d9aecdd45bc85b4c93882d4889f. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:48:59.631836 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-f540a0ee-4483-4ca2-9e0c-0e8983d7110c tempest-KeyPairsV22TestJSON-412997229 tempest-KeyPairsV22TestJSON-412997229-project] Getting quotas for user 709bf266cebc4ca0ba8cef958b339906 and project 1e720d9aecdd45bc85b4c93882d4889f. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:48:59.640456 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ca49f132-8fa3-4e7c-9c7b-753e8b086c39 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:59.643179 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ca49f132-8fa3-4e7c-9c7b-753e8b086c39 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:59.671538 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ca49f132-8fa3-4e7c-9c7b-753e8b086c39 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1539 microversion: 2.91 time: 0.445753 Sep 08 10:48:59.674220 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1352/2671] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:48:59 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1539 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:48:59.686533 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-27201503-26b4-4428-b9ad-b4b2dd6e8996 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:59.687852 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f540a0ee-4483-4ca2-9e0c-0e8983d7110c tempest-KeyPairsV22TestJSON-412997229 tempest-KeyPairsV22TestJSON-412997229-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 1.038736 Sep 08 10:48:59.689608 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-27201503-26b4-4428-b9ad-b4b2dd6e8996 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] [instance: a2469f0a-d6bc-46ae-8905-049f2123dc0c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:59.698274 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1320/2672] 10.222.0.27 () {62 vars in 1198 bytes} [Thu Sep 8 10:48:58 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 1045 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:48:59.708714 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8257ef6b-55d9-4f91-b64a-b7063dda0548 tempest-KeyPairsV22TestJSON-412997229 tempest-KeyPairsV22TestJSON-412997229-project] Calling method '.version_select at 0x7f68e44fb040>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:59.713627 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27201503-26b4-4428-b9ad-b4b2dd6e8996 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:59.714141 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27201503-26b4-4428-b9ad-b4b2dd6e8996 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:59.714746 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27201503-26b4-4428-b9ad-b4b2dd6e8996 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:59.715565 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27201503-26b4-4428-b9ad-b4b2dd6e8996 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:59.716036 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27201503-26b4-4428-b9ad-b4b2dd6e8996 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:59.716714 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27201503-26b4-4428-b9ad-b4b2dd6e8996 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:59.731071 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8257ef6b-55d9-4f91-b64a-b7063dda0548 tempest-KeyPairsV22TestJSON-412997229 tempest-KeyPairsV22TestJSON-412997229-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs/tempest-keypair-888224046" status: 200 len: 1533 microversion: 2.2 time: 0.030598 Sep 08 10:48:59.733339 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1321/2673] 10.222.0.27 () {60 vars in 1255 bytes} [Thu Sep 8 10:48:59 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-888224046 => generated 1533 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:48:59.744174 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3ede353b-72eb-4661-a415-3a991a229dcc tempest-KeyPairsV22TestJSON-412997229 tempest-KeyPairsV22TestJSON-412997229-project] Calling method '.version_select at 0x7f68e44f0f70>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:59.750944 n-d-850501-12 devstack@n-api.service[128861]: WARNING oslo_db.sqlalchemy.utils [None req-3ede353b-72eb-4661-a415-3a991a229dcc tempest-KeyPairsV22TestJSON-412997229 tempest-KeyPairsV22TestJSON-412997229-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 08 10:48:59.769780 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3ede353b-72eb-4661-a415-3a991a229dcc tempest-KeyPairsV22TestJSON-412997229 tempest-KeyPairsV22TestJSON-412997229-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.029840 Sep 08 10:48:59.770901 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1322/2674] 10.222.0.27 () {60 vars in 1177 bytes} [Thu Sep 8 10:48:59 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:48:59.784224 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7bd3f76a-3b8c-4baa-9356-5cc7c1cbad77 tempest-KeyPairsV22TestJSON-412997229 tempest-KeyPairsV22TestJSON-412997229-project] Calling method '.version_select at 0x7f68e466dc10>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:59.845266 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7bd3f76a-3b8c-4baa-9356-5cc7c1cbad77 tempest-KeyPairsV22TestJSON-412997229 tempest-KeyPairsV22TestJSON-412997229-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-888224046" status: 204 len: 0 microversion: 2.2 time: 0.066355 Sep 08 10:48:59.850265 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1323/2675] 10.222.0.27 () {60 vars in 1258 bytes} [Thu Sep 8 10:48:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-888224046 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:48:59.858802 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-29d674f5-e414-4b33-807f-0c20533713c3 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:59.861658 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-29d674f5-e414-4b33-807f-0c20533713c3 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] [instance: 814d8327-fc0e-4846-a449-598e482d71c6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:59.877322 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-29d674f5-e414-4b33-807f-0c20533713c3 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:59.878791 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-29d674f5-e414-4b33-807f-0c20533713c3 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:59.880673 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-29d674f5-e414-4b33-807f-0c20533713c3 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:59.884494 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-29d674f5-e414-4b33-807f-0c20533713c3 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:59.884494 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-29d674f5-e414-4b33-807f-0c20533713c3 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:59.884494 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-29d674f5-e414-4b33-807f-0c20533713c3 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:59.940960 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-29d674f5-e414-4b33-807f-0c20533713c3 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] HTTP exception thrown: Instance 814d8327-fc0e-4846-a449-598e482d71c6 could not be found. Sep 08 10:48:59.954159 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-29d674f5-e414-4b33-807f-0c20533713c3 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Request method failure captured: Sep 08 10:48:59.954159 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/814d8327-fc0e-4846-a449-598e482d71c6 HTTP/1.1 Sep 08 10:48:59.954159 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:48:59.954159 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:48:59.954159 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:48:59.954159 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:48:59.954159 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:48:59.954159 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:48:59.954159 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:48:59.954159 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:48:59.954159 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGchTMVsih6AdxTefKHNijPzVdUvZBRXqGNEPm-fid4j_j82jizk32CMrDnucIcc9evzaSIB09wB6InjwnzLKUITI356qRbYAtRApNN9Z7bS078MbVF6Ug4ecZb-IVf48L7Cjx-DHHxzf8D8m1YRc3twcMYMj1MrMmK9Qz2R_nVhCM2U Sep 08 10:48:59.954159 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:48:59.954159 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:48:59.954159 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:48:59.954159 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:48:59.954159 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:48:59.954159 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:48:59.954159 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: bb9a5f2a2b4f460dad3731b0ce6ecebc Sep 08 10:48:59.954159 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-319363265 Sep 08 10:48:59.954159 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:48:59.954159 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:48:59.954159 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bb9a5f2a2b4f460dad3731b0ce6ecebc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bb9a5f2a2b4f460dad3731b0ce6ecebc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bb9a5f2a2b4f460dad3731b0ce6ecebc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bb9a5f2a2b4f460dad3731b0ce6ecebc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:48:59.954159 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServersAdminNegativeTestJSON-319363265 Sep 08 10:48:59.954159 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: bb9a5f2a2b4f460dad3731b0ce6ecebc Sep 08 10:48:59.954159 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-319363265 Sep 08 10:48:59.954159 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServersAdminNegativeTestJSON-319363265-project Sep 08 10:48:59.954159 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:48:59.954159 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:48:59.954159 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 7d6f265811ad4ccf866fb8094782dd38 Sep 08 10:48:59.954159 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServersAdminNegativeTestJSON-319363265-project Sep 08 10:48:59.954159 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:48:59.954159 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 814d8327-fc0e-4846-a449-598e482d71c6 could not be found. Sep 08 10:48:59.954159 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '814d8327-fc0e-4846-a449-598e482d71c6'} Sep 08 10:48:59.954159 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:48:59.954159 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:48:59.954159 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:48:59.954159 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:48:59.954159 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:48:59.954159 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:48:59.954159 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:48:59.954159 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:48:59.954159 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:48:59.954159 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:48:59.954159 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 814d8327-fc0e-4846-a449-598e482d71c6 could not be found. Sep 08 10:48:59.954159 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:48:59.954159 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:48:59.954159 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:48:59.954159 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:48:59.954159 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:48:59.954159 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:48:59.954159 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:48:59.954159 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:48:59.954159 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:48:59.954159 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:48:59.954159 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:48:59.954159 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:48:59.954159 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:48:59.954159 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:48:59.954159 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:48:59.954159 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:48:59.954159 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 814d8327-fc0e-4846-a449-598e482d71c6 could not be found. Sep 08 10:48:59.954159 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:48:59.954159 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:48:59.958581 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:48:59.958581 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:48:59.958581 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:48:59.958581 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:48:59.958581 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:48:59.958581 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:48:59.958581 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 814d8327-fc0e-4846-a449-598e482d71c6 could not be found. Sep 08 10:48:59.958581 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:48:59.958581 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-29d674f5-e414-4b33-807f-0c20533713c3 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Returning 404 to user: Instance 814d8327-fc0e-4846-a449-598e482d71c6 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:48:59.958581 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-29d674f5-e414-4b33-807f-0c20533713c3 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] 10.222.0.27 "GET /compute/v2.1/servers/814d8327-fc0e-4846-a449-598e482d71c6" status: 404 len: 111 microversion: 2.1 time: 0.108157 Sep 08 10:48:59.959442 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1324/2676] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:59 2022] GET /compute/v2.1/servers/814d8327-fc0e-4846-a449-598e482d71c6 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:48:59.973511 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0c758734-e5be-478c-a419-d9306c919013 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:59.974043 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0c758734-e5be-478c-a419-d9306c919013 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] [instance: 5134b057-ca4f-4ec8-8dd7-435d4e3d1279] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:59.979133 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:INSERT=4 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:49:00.002587 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0c758734-e5be-478c-a419-d9306c919013 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:00.003096 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0c758734-e5be-478c-a419-d9306c919013 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:00.003545 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0c758734-e5be-478c-a419-d9306c919013 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:00.004267 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0c758734-e5be-478c-a419-d9306c919013 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:00.004731 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0c758734-e5be-478c-a419-d9306c919013 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:00.009610 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0c758734-e5be-478c-a419-d9306c919013 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:00.090343 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0c758734-e5be-478c-a419-d9306c919013 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] [instance: 5134b057-ca4f-4ec8-8dd7-435d4e3d1279] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:49:00.323888 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0c758734-e5be-478c-a419-d9306c919013 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5134b057-ca4f-4ec8-8dd7-435d4e3d1279" status: 204 len: 0 microversion: 2.1 time: 0.359385 Sep 08 10:49:00.339499 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1325/2677] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:48:59 2022] DELETE /compute/v2.1/servers/5134b057-ca4f-4ec8-8dd7-435d4e3d1279 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:49:00.363137 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-825887b0-ef32-4c58-8046-814cf579f7d5 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:00.374234 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-825887b0-ef32-4c58-8046-814cf579f7d5 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] [instance: 5134b057-ca4f-4ec8-8dd7-435d4e3d1279] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:00.403291 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-825887b0-ef32-4c58-8046-814cf579f7d5 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:00.414528 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-825887b0-ef32-4c58-8046-814cf579f7d5 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:00.415511 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-825887b0-ef32-4c58-8046-814cf579f7d5 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:00.434080 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-825887b0-ef32-4c58-8046-814cf579f7d5 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:00.434853 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-825887b0-ef32-4c58-8046-814cf579f7d5 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:00.435482 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-825887b0-ef32-4c58-8046-814cf579f7d5 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:00.583226 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-27201503-26b4-4428-b9ad-b4b2dd6e8996 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fb4a7dae3346d39f70c51055cfd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065d7179ebd6460cb039bd1624296b57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:00.614311 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-27201503-26b4-4428-b9ad-b4b2dd6e8996 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] 10.222.0.27 "GET /compute/v2.1/servers/a2469f0a-d6bc-46ae-8905-049f2123dc0c" status: 200 len: 1404 microversion: 2.1 time: 0.923672 Sep 08 10:49:00.629651 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1353/2678] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:59 2022] GET /compute/v2.1/servers/a2469f0a-d6bc-46ae-8905-049f2123dc0c => generated 1404 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:00.710032 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1da7d042-b29c-4f87-817e-97053365f9f3 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:00.711630 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1da7d042-b29c-4f87-817e-97053365f9f3 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:00.714282 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-825887b0-ef32-4c58-8046-814cf579f7d5 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6f265811ad4ccf866fb8094782dd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9a5f2a2b4f460dad3731b0ce6ecebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:00.736260 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-825887b0-ef32-4c58-8046-814cf579f7d5 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] 10.222.0.27 "GET /compute/v2.1/servers/5134b057-ca4f-4ec8-8dd7-435d4e3d1279" status: 200 len: 1478 microversion: 2.1 time: 0.390133 Sep 08 10:49:00.738512 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1da7d042-b29c-4f87-817e-97053365f9f3 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:00.740181 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1da7d042-b29c-4f87-817e-97053365f9f3 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:00.741392 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1da7d042-b29c-4f87-817e-97053365f9f3 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:00.742740 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1da7d042-b29c-4f87-817e-97053365f9f3 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:00.761070 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1326/2679] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:00 2022] GET /compute/v2.1/servers/5134b057-ca4f-4ec8-8dd7-435d4e3d1279 => generated 1478 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:00.761885 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1da7d042-b29c-4f87-817e-97053365f9f3 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:00.761885 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1da7d042-b29c-4f87-817e-97053365f9f3 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:01.112874 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1da7d042-b29c-4f87-817e-97053365f9f3 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:01.135029 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1da7d042-b29c-4f87-817e-97053365f9f3 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:01.138683 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1da7d042-b29c-4f87-817e-97053365f9f3 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:01.157968 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1da7d042-b29c-4f87-817e-97053365f9f3 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1539 microversion: 2.91 time: 0.454674 Sep 08 10:49:01.158876 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1354/2680] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:49:00 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1539 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:49:01.652172 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ce4d9b1a-c0df-4b43-951b-e6fedd232558 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:01.659216 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ce4d9b1a-c0df-4b43-951b-e6fedd232558 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] [instance: a2469f0a-d6bc-46ae-8905-049f2123dc0c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:01.693532 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ce4d9b1a-c0df-4b43-951b-e6fedd232558 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:01.694732 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ce4d9b1a-c0df-4b43-951b-e6fedd232558 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:01.696322 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ce4d9b1a-c0df-4b43-951b-e6fedd232558 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:01.697851 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ce4d9b1a-c0df-4b43-951b-e6fedd232558 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:01.698805 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ce4d9b1a-c0df-4b43-951b-e6fedd232558 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:01.699779 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ce4d9b1a-c0df-4b43-951b-e6fedd232558 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:01.786350 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2c460820-ddd7-4ede-94ea-fb172d3ca094 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:01.787470 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2c460820-ddd7-4ede-94ea-fb172d3ca094 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] [instance: 5134b057-ca4f-4ec8-8dd7-435d4e3d1279] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:01.824555 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2c460820-ddd7-4ede-94ea-fb172d3ca094 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:01.825823 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2c460820-ddd7-4ede-94ea-fb172d3ca094 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:01.826459 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2c460820-ddd7-4ede-94ea-fb172d3ca094 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:01.827412 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2c460820-ddd7-4ede-94ea-fb172d3ca094 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:01.829898 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2c460820-ddd7-4ede-94ea-fb172d3ca094 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:01.830862 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2c460820-ddd7-4ede-94ea-fb172d3ca094 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:02.173235 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ce4d9b1a-c0df-4b43-951b-e6fedd232558 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fb4a7dae3346d39f70c51055cfd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065d7179ebd6460cb039bd1624296b57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:02.206368 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ce4d9b1a-c0df-4b43-951b-e6fedd232558 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] 10.222.0.27 "GET /compute/v2.1/servers/a2469f0a-d6bc-46ae-8905-049f2123dc0c" status: 200 len: 1404 microversion: 2.1 time: 0.557592 Sep 08 10:49:02.207520 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1327/2681] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:01 2022] GET /compute/v2.1/servers/a2469f0a-d6bc-46ae-8905-049f2123dc0c => generated 1404 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:02.228951 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-53636781-acbe-414e-b503-27ac071811c6 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:02.235002 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-53636781-acbe-414e-b503-27ac071811c6 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:02.260774 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-53636781-acbe-414e-b503-27ac071811c6 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:02.261626 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-53636781-acbe-414e-b503-27ac071811c6 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:02.262338 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-53636781-acbe-414e-b503-27ac071811c6 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:02.263487 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-53636781-acbe-414e-b503-27ac071811c6 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:02.267874 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-53636781-acbe-414e-b503-27ac071811c6 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:02.268373 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-53636781-acbe-414e-b503-27ac071811c6 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:02.404414 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-53636781-acbe-414e-b503-27ac071811c6 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:02.415983 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-53636781-acbe-414e-b503-27ac071811c6 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:02.418061 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-53636781-acbe-414e-b503-27ac071811c6 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:02.424764 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-53636781-acbe-414e-b503-27ac071811c6 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1539 microversion: 2.91 time: 0.212333 Sep 08 10:49:02.426254 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1328/2682] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:49:02 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1539 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:49:02.456199 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:49:02.756086 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2c460820-ddd7-4ede-94ea-fb172d3ca094 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6f265811ad4ccf866fb8094782dd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9a5f2a2b4f460dad3731b0ce6ecebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:02.778197 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2c460820-ddd7-4ede-94ea-fb172d3ca094 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] 10.222.0.27 "GET /compute/v2.1/servers/5134b057-ca4f-4ec8-8dd7-435d4e3d1279" status: 200 len: 1478 microversion: 2.1 time: 1.003862 Sep 08 10:49:02.781677 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1355/2683] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:01 2022] GET /compute/v2.1/servers/5134b057-ca4f-4ec8-8dd7-435d4e3d1279 => generated 1478 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:03.247588 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9350aabf-0188-488f-8359-e89deca58fc6 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:03.252525 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9350aabf-0188-488f-8359-e89deca58fc6 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] [instance: a2469f0a-d6bc-46ae-8905-049f2123dc0c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:03.276661 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9350aabf-0188-488f-8359-e89deca58fc6 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:03.282549 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9350aabf-0188-488f-8359-e89deca58fc6 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:03.288243 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9350aabf-0188-488f-8359-e89deca58fc6 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:03.294700 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9350aabf-0188-488f-8359-e89deca58fc6 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:03.300922 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9350aabf-0188-488f-8359-e89deca58fc6 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:03.307614 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9350aabf-0188-488f-8359-e89deca58fc6 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:03.477968 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2dd408dc-9bfd-46c4-b2cc-bf725a014e45 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:03.479169 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2dd408dc-9bfd-46c4-b2cc-bf725a014e45 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:03.528817 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2dd408dc-9bfd-46c4-b2cc-bf725a014e45 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:03.534658 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2dd408dc-9bfd-46c4-b2cc-bf725a014e45 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:03.537800 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2dd408dc-9bfd-46c4-b2cc-bf725a014e45 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:03.540943 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2dd408dc-9bfd-46c4-b2cc-bf725a014e45 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:03.543201 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2dd408dc-9bfd-46c4-b2cc-bf725a014e45 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:03.543964 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2dd408dc-9bfd-46c4-b2cc-bf725a014e45 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:03.729609 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2dd408dc-9bfd-46c4-b2cc-bf725a014e45 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:03.761150 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2dd408dc-9bfd-46c4-b2cc-bf725a014e45 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:03.770150 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2dd408dc-9bfd-46c4-b2cc-bf725a014e45 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:03.783801 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2dd408dc-9bfd-46c4-b2cc-bf725a014e45 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1539 microversion: 2.91 time: 0.326921 Sep 08 10:49:03.807827 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1356/2684] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:49:03 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1539 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:49:03.822449 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a7aa1366-2f96-403c-bfb6-63826fc17def tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:03.828650 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a7aa1366-2f96-403c-bfb6-63826fc17def tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] [instance: 5134b057-ca4f-4ec8-8dd7-435d4e3d1279] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:03.851070 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a7aa1366-2f96-403c-bfb6-63826fc17def tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:03.853307 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a7aa1366-2f96-403c-bfb6-63826fc17def tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:03.853937 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a7aa1366-2f96-403c-bfb6-63826fc17def tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:03.856095 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a7aa1366-2f96-403c-bfb6-63826fc17def tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:03.857007 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a7aa1366-2f96-403c-bfb6-63826fc17def tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:03.858371 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a7aa1366-2f96-403c-bfb6-63826fc17def tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:03.875087 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9350aabf-0188-488f-8359-e89deca58fc6 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fb4a7dae3346d39f70c51055cfd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065d7179ebd6460cb039bd1624296b57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:03.887943 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9350aabf-0188-488f-8359-e89deca58fc6 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] 10.222.0.27 "GET /compute/v2.1/servers/a2469f0a-d6bc-46ae-8905-049f2123dc0c" status: 200 len: 1404 microversion: 2.1 time: 0.655569 Sep 08 10:49:03.889058 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1329/2685] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:03 2022] GET /compute/v2.1/servers/a2469f0a-d6bc-46ae-8905-049f2123dc0c => generated 1404 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:04.182375 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a7aa1366-2f96-403c-bfb6-63826fc17def tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6f265811ad4ccf866fb8094782dd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9a5f2a2b4f460dad3731b0ce6ecebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:04.201641 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a7aa1366-2f96-403c-bfb6-63826fc17def tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] 10.222.0.27 "GET /compute/v2.1/servers/5134b057-ca4f-4ec8-8dd7-435d4e3d1279" status: 200 len: 1478 microversion: 2.1 time: 0.392668 Sep 08 10:49:04.202533 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1357/2686] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:03 2022] GET /compute/v2.1/servers/5134b057-ca4f-4ec8-8dd7-435d4e3d1279 => generated 1478 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:04.555554 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-01dcc70e-208c-4b66-adba-4b28ed952269 req-0aabfc6c-f44b-4899-80fc-8d09748e1acc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5134b057-ca4f-4ec8-8dd7-435d4e3d1279", "name": "network-vif-deleted", "tag": "1cb6d044-b419-4afe-ab6f-99a07098ebb9"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:49:04.573411 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-01dcc70e-208c-4b66-adba-4b28ed952269 req-0aabfc6c-f44b-4899-80fc-8d09748e1acc service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:04.574118 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-01dcc70e-208c-4b66-adba-4b28ed952269 req-0aabfc6c-f44b-4899-80fc-8d09748e1acc service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:04.575456 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-01dcc70e-208c-4b66-adba-4b28ed952269 req-0aabfc6c-f44b-4899-80fc-8d09748e1acc service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:04.599175 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-01dcc70e-208c-4b66-adba-4b28ed952269 req-0aabfc6c-f44b-4899-80fc-8d09748e1acc service nova] Creating event network-vif-deleted:1cb6d044-b419-4afe-ab6f-99a07098ebb9 for instance 5134b057-ca4f-4ec8-8dd7-435d4e3d1279 on n-h1-850501-12 Sep 08 10:49:04.607198 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-01dcc70e-208c-4b66-adba-4b28ed952269 req-0aabfc6c-f44b-4899-80fc-8d09748e1acc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057541 Sep 08 10:49:04.612201 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1330/2687] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:49:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:49:04.741525 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-aa978476-a241-48b4-ac6e-461ac283818b req-cbac757b-4efd-4481-9476-59054aa0f57a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2469f0a-d6bc-46ae-8905-049f2123dc0c", "name": "network-vif-plugged", "status": "completed", "tag": "f2d328aa-1a87-4e45-9e61-2691302ceff1"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:49:04.775365 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-aa978476-a241-48b4-ac6e-461ac283818b req-cbac757b-4efd-4481-9476-59054aa0f57a service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:04.776379 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-aa978476-a241-48b4-ac6e-461ac283818b req-cbac757b-4efd-4481-9476-59054aa0f57a service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:04.782071 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-aa978476-a241-48b4-ac6e-461ac283818b req-cbac757b-4efd-4481-9476-59054aa0f57a service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:04.836670 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-aa978476-a241-48b4-ac6e-461ac283818b req-cbac757b-4efd-4481-9476-59054aa0f57a service nova] Creating event network-vif-plugged:f2d328aa-1a87-4e45-9e61-2691302ceff1 for instance a2469f0a-d6bc-46ae-8905-049f2123dc0c on n-h1-850501-12 Sep 08 10:49:04.870554 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-aa978476-a241-48b4-ac6e-461ac283818b req-cbac757b-4efd-4481-9476-59054aa0f57a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134194 Sep 08 10:49:04.871399 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1358/2688] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:49:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:49:04.878019 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fe3979f0-b900-4432-bc08-f7e03a80d4cc tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:04.878752 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fe3979f0-b900-4432-bc08-f7e03a80d4cc tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:04.886922 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fe3979f0-b900-4432-bc08-f7e03a80d4cc tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:04.887428 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fe3979f0-b900-4432-bc08-f7e03a80d4cc tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:04.887874 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fe3979f0-b900-4432-bc08-f7e03a80d4cc tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:04.905441 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fe3979f0-b900-4432-bc08-f7e03a80d4cc tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:04.906195 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fe3979f0-b900-4432-bc08-f7e03a80d4cc tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:04.908456 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fe3979f0-b900-4432-bc08-f7e03a80d4cc tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:05.145326 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fe3979f0-b900-4432-bc08-f7e03a80d4cc tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:05.158940 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fe3979f0-b900-4432-bc08-f7e03a80d4cc tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:05.162061 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fe3979f0-b900-4432-bc08-f7e03a80d4cc tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:05.166450 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e8b1b3ec-b742-43e2-b60e-d224f12e73fa tempest-AbsoluteLimitsTestJSON-1386515612 tempest-AbsoluteLimitsTestJSON-1386515612-project] Calling method '.version_select at 0x7f68e45d0430>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:05.180781 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e8b1b3ec-b742-43e2-b60e-d224f12e73fa tempest-AbsoluteLimitsTestJSON-1386515612 tempest-AbsoluteLimitsTestJSON-1386515612-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:05.181714 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e8b1b3ec-b742-43e2-b60e-d224f12e73fa tempest-AbsoluteLimitsTestJSON-1386515612 tempest-AbsoluteLimitsTestJSON-1386515612-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:05.182524 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e8b1b3ec-b742-43e2-b60e-d224f12e73fa tempest-AbsoluteLimitsTestJSON-1386515612 tempest-AbsoluteLimitsTestJSON-1386515612-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:05.183641 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e8b1b3ec-b742-43e2-b60e-d224f12e73fa tempest-AbsoluteLimitsTestJSON-1386515612 tempest-AbsoluteLimitsTestJSON-1386515612-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:05.184375 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e8b1b3ec-b742-43e2-b60e-d224f12e73fa tempest-AbsoluteLimitsTestJSON-1386515612 tempest-AbsoluteLimitsTestJSON-1386515612-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:05.184558 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fe3979f0-b900-4432-bc08-f7e03a80d4cc tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1539 microversion: 2.91 time: 0.311075 Sep 08 10:49:05.185604 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1359/2689] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:49:04 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1539 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:49:05.185949 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e8b1b3ec-b742-43e2-b60e-d224f12e73fa tempest-AbsoluteLimitsTestJSON-1386515612 tempest-AbsoluteLimitsTestJSON-1386515612-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:05.194482 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bb570e31-cec3-4620-8339-f1291c8f179c tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:05.195208 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bb570e31-cec3-4620-8339-f1291c8f179c tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] [instance: a2469f0a-d6bc-46ae-8905-049f2123dc0c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:05.209484 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb570e31-cec3-4620-8339-f1291c8f179c tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:05.210261 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb570e31-cec3-4620-8339-f1291c8f179c tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:05.211671 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e8b1b3ec-b742-43e2-b60e-d224f12e73fa tempest-AbsoluteLimitsTestJSON-1386515612 tempest-AbsoluteLimitsTestJSON-1386515612-project] 10.222.0.27 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.469163 Sep 08 10:49:05.212003 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb570e31-cec3-4620-8339-f1291c8f179c tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:05.212905 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb570e31-cec3-4620-8339-f1291c8f179c tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:05.213124 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1331/2690] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Sep 8 10:49:04 2022] GET /compute/v2.1/limits => generated 511 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:49:05.213741 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb570e31-cec3-4620-8339-f1291c8f179c tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:05.214238 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb570e31-cec3-4620-8339-f1291c8f179c tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:05.230559 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-816f63a8-f2b7-4ecd-b62c-1872f40f81a4 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:05.231309 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-816f63a8-f2b7-4ecd-b62c-1872f40f81a4 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] [instance: 5134b057-ca4f-4ec8-8dd7-435d4e3d1279] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:05.237759 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-816f63a8-f2b7-4ecd-b62c-1872f40f81a4 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:05.238276 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-816f63a8-f2b7-4ecd-b62c-1872f40f81a4 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:05.238713 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-816f63a8-f2b7-4ecd-b62c-1872f40f81a4 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:05.239602 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-816f63a8-f2b7-4ecd-b62c-1872f40f81a4 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:05.240074 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-816f63a8-f2b7-4ecd-b62c-1872f40f81a4 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:05.240568 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-816f63a8-f2b7-4ecd-b62c-1872f40f81a4 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:05.278730 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-816f63a8-f2b7-4ecd-b62c-1872f40f81a4 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:05.279237 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-816f63a8-f2b7-4ecd-b62c-1872f40f81a4 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:05.279679 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-816f63a8-f2b7-4ecd-b62c-1872f40f81a4 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:05.280582 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-816f63a8-f2b7-4ecd-b62c-1872f40f81a4 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lazy-loading 'fault' on Instance uuid 5134b057-ca4f-4ec8-8dd7-435d4e3d1279 {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:49:05.562020 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-816f63a8-f2b7-4ecd-b62c-1872f40f81a4 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6f265811ad4ccf866fb8094782dd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9a5f2a2b4f460dad3731b0ce6ecebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:05.577938 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-816f63a8-f2b7-4ecd-b62c-1872f40f81a4 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] 10.222.0.27 "GET /compute/v2.1/servers/5134b057-ca4f-4ec8-8dd7-435d4e3d1279" status: 200 len: 1312 microversion: 2.1 time: 0.352051 Sep 08 10:49:05.583907 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1332/2691] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:05 2022] GET /compute/v2.1/servers/5134b057-ca4f-4ec8-8dd7-435d4e3d1279 => generated 1312 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:49:05.608161 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bb570e31-cec3-4620-8339-f1291c8f179c tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fb4a7dae3346d39f70c51055cfd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065d7179ebd6460cb039bd1624296b57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:05.619844 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bb570e31-cec3-4620-8339-f1291c8f179c tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] 10.222.0.27 "GET /compute/v2.1/servers/a2469f0a-d6bc-46ae-8905-049f2123dc0c" status: 200 len: 1404 microversion: 2.1 time: 0.432966 Sep 08 10:49:05.623822 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1360/2692] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:05 2022] GET /compute/v2.1/servers/a2469f0a-d6bc-46ae-8905-049f2123dc0c => generated 1404 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:06.220694 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-49c94a54-6132-4c04-822c-2ebed74f33fa tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:06.221514 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-49c94a54-6132-4c04-822c-2ebed74f33fa tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:06.230600 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-49c94a54-6132-4c04-822c-2ebed74f33fa tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:06.231113 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-49c94a54-6132-4c04-822c-2ebed74f33fa tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:06.242667 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-49c94a54-6132-4c04-822c-2ebed74f33fa tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:06.243641 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-49c94a54-6132-4c04-822c-2ebed74f33fa tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:06.244142 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-49c94a54-6132-4c04-822c-2ebed74f33fa tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:06.244592 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-49c94a54-6132-4c04-822c-2ebed74f33fa tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:06.386362 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-49c94a54-6132-4c04-822c-2ebed74f33fa tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:06.403976 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-49c94a54-6132-4c04-822c-2ebed74f33fa tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:06.412906 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-49c94a54-6132-4c04-822c-2ebed74f33fa tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:06.450687 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-49c94a54-6132-4c04-822c-2ebed74f33fa tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1539 microversion: 2.91 time: 0.234410 Sep 08 10:49:06.469058 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1333/2693] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:49:06 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1539 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:49:06.611441 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-833718fd-5c4d-462d-832d-8b23cdb862c3 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:06.612336 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-833718fd-5c4d-462d-832d-8b23cdb862c3 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] [instance: 5134b057-ca4f-4ec8-8dd7-435d4e3d1279] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:06.626817 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-833718fd-5c4d-462d-832d-8b23cdb862c3 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:06.627372 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-833718fd-5c4d-462d-832d-8b23cdb862c3 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:06.627907 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-833718fd-5c4d-462d-832d-8b23cdb862c3 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:06.628993 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-833718fd-5c4d-462d-832d-8b23cdb862c3 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:06.636581 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-833718fd-5c4d-462d-832d-8b23cdb862c3 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:06.636581 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-833718fd-5c4d-462d-832d-8b23cdb862c3 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:06.651849 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bfc4f355-0cee-4d52-b69f-b55caeed9d4a tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:06.652484 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bfc4f355-0cee-4d52-b69f-b55caeed9d4a tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] [instance: a2469f0a-d6bc-46ae-8905-049f2123dc0c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:06.684114 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bfc4f355-0cee-4d52-b69f-b55caeed9d4a tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:06.688648 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bfc4f355-0cee-4d52-b69f-b55caeed9d4a tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:06.689226 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bfc4f355-0cee-4d52-b69f-b55caeed9d4a tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:06.689996 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bfc4f355-0cee-4d52-b69f-b55caeed9d4a tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:06.694225 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bfc4f355-0cee-4d52-b69f-b55caeed9d4a tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:06.696465 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bfc4f355-0cee-4d52-b69f-b55caeed9d4a tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:06.705373 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-833718fd-5c4d-462d-832d-8b23cdb862c3 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] HTTP exception thrown: Instance 5134b057-ca4f-4ec8-8dd7-435d4e3d1279 could not be found. Sep 08 10:49:06.714392 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-833718fd-5c4d-462d-832d-8b23cdb862c3 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Request method failure captured: Sep 08 10:49:06.714392 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/5134b057-ca4f-4ec8-8dd7-435d4e3d1279 HTTP/1.1 Sep 08 10:49:06.714392 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:49:06.714392 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:49:06.714392 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:49:06.714392 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:49:06.714392 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:49:06.714392 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:49:06.714392 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:49:06.714392 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:49:06.714392 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGchTMVsih6AdxTefKHNijPzVdUvZBRXqGNEPm-fid4j_j82jizk32CMrDnucIcc9evzaSIB09wB6InjwnzLKUITI356qRbYAtRApNN9Z7bS078MbVF6Ug4ecZb-IVf48L7Cjx-DHHxzf8D8m1YRc3twcMYMj1MrMmK9Qz2R_nVhCM2U Sep 08 10:49:06.714392 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:49:06.714392 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:49:06.714392 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:49:06.714392 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:49:06.714392 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:49:06.714392 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:49:06.714392 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: bb9a5f2a2b4f460dad3731b0ce6ecebc Sep 08 10:49:06.714392 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-319363265 Sep 08 10:49:06.714392 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:49:06.714392 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:49:06.714392 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bb9a5f2a2b4f460dad3731b0ce6ecebc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bb9a5f2a2b4f460dad3731b0ce6ecebc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bb9a5f2a2b4f460dad3731b0ce6ecebc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bb9a5f2a2b4f460dad3731b0ce6ecebc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:49:06.714392 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServersAdminNegativeTestJSON-319363265 Sep 08 10:49:06.714392 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: bb9a5f2a2b4f460dad3731b0ce6ecebc Sep 08 10:49:06.714392 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-319363265 Sep 08 10:49:06.714392 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServersAdminNegativeTestJSON-319363265-project Sep 08 10:49:06.714392 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:49:06.714392 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:49:06.714392 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 7d6f265811ad4ccf866fb8094782dd38 Sep 08 10:49:06.714392 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServersAdminNegativeTestJSON-319363265-project Sep 08 10:49:06.714392 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:49:06.714392 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 5134b057-ca4f-4ec8-8dd7-435d4e3d1279 could not be found. Sep 08 10:49:06.714392 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '5134b057-ca4f-4ec8-8dd7-435d4e3d1279'} Sep 08 10:49:06.714392 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:49:06.714392 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:49:06.714392 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:49:06.714392 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:49:06.714392 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:49:06.714392 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:49:06.714392 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:49:06.714392 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:49:06.714392 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:49:06.714392 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:49:06.714392 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5134b057-ca4f-4ec8-8dd7-435d4e3d1279 could not be found. Sep 08 10:49:06.714392 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:49:06.714392 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:49:06.714392 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:49:06.714392 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:49:06.714392 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:49:06.714392 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:49:06.714392 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:49:06.714392 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:49:06.714392 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:49:06.714392 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:49:06.714392 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:49:06.714392 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:49:06.714392 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:49:06.714392 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:49:06.714392 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:49:06.714392 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:49:06.714392 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5134b057-ca4f-4ec8-8dd7-435d4e3d1279 could not be found. Sep 08 10:49:06.714392 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:49:06.714392 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:49:06.718521 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:49:06.718521 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:49:06.718521 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:49:06.718521 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:49:06.718521 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:49:06.718521 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:49:06.718521 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5134b057-ca4f-4ec8-8dd7-435d4e3d1279 could not be found. Sep 08 10:49:06.718521 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:49:06.718521 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-833718fd-5c4d-462d-832d-8b23cdb862c3 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] Returning 404 to user: Instance 5134b057-ca4f-4ec8-8dd7-435d4e3d1279 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:49:06.718521 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-833718fd-5c4d-462d-832d-8b23cdb862c3 tempest-ServersAdminNegativeTestJSON-319363265 tempest-ServersAdminNegativeTestJSON-319363265-project] 10.222.0.27 "GET /compute/v2.1/servers/5134b057-ca4f-4ec8-8dd7-435d4e3d1279" status: 404 len: 111 microversion: 2.1 time: 0.109467 Sep 08 10:49:06.724918 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1361/2694] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:06 2022] GET /compute/v2.1/servers/5134b057-ca4f-4ec8-8dd7-435d4e3d1279 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:49:07.486463 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5477b01e-e922-49da-b0e4-f8436de83c65 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:07.487280 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5477b01e-e922-49da-b0e4-f8436de83c65 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:07.500403 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5477b01e-e922-49da-b0e4-f8436de83c65 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:07.501204 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5477b01e-e922-49da-b0e4-f8436de83c65 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:07.503375 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5477b01e-e922-49da-b0e4-f8436de83c65 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:07.504328 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5477b01e-e922-49da-b0e4-f8436de83c65 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:07.505272 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5477b01e-e922-49da-b0e4-f8436de83c65 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:07.508079 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5477b01e-e922-49da-b0e4-f8436de83c65 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:07.608407 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=16 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:49:07.620056 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-bfc4f355-0cee-4d52-b69f-b55caeed9d4a tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fb4a7dae3346d39f70c51055cfd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065d7179ebd6460cb039bd1624296b57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:07.637146 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bfc4f355-0cee-4d52-b69f-b55caeed9d4a tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] 10.222.0.27 "GET /compute/v2.1/servers/a2469f0a-d6bc-46ae-8905-049f2123dc0c" status: 200 len: 1404 microversion: 2.1 time: 0.988048 Sep 08 10:49:07.638571 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1334/2695] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:06 2022] GET /compute/v2.1/servers/a2469f0a-d6bc-46ae-8905-049f2123dc0c => generated 1404 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:07.743918 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5477b01e-e922-49da-b0e4-f8436de83c65 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:07.757735 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5477b01e-e922-49da-b0e4-f8436de83c65 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:07.765382 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5477b01e-e922-49da-b0e4-f8436de83c65 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:07.779971 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5477b01e-e922-49da-b0e4-f8436de83c65 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1539 microversion: 2.91 time: 0.298114 Sep 08 10:49:07.780877 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1362/2696] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:49:07 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1539 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:49:08.689338 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6775b816-03e6-4b13-9bd1-fb1fad40c03b tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:08.712437 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6775b816-03e6-4b13-9bd1-fb1fad40c03b tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] [instance: a2469f0a-d6bc-46ae-8905-049f2123dc0c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:08.736563 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6775b816-03e6-4b13-9bd1-fb1fad40c03b tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:08.743904 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6775b816-03e6-4b13-9bd1-fb1fad40c03b tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:08.747640 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6775b816-03e6-4b13-9bd1-fb1fad40c03b tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:08.754347 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6775b816-03e6-4b13-9bd1-fb1fad40c03b tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:08.757260 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6775b816-03e6-4b13-9bd1-fb1fad40c03b tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:08.759140 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6775b816-03e6-4b13-9bd1-fb1fad40c03b tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:08.814172 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-52cb9a1c-085b-48ed-a0fc-3a3601d8c68a tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:08.815259 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-52cb9a1c-085b-48ed-a0fc-3a3601d8c68a tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:08.863903 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-52cb9a1c-085b-48ed-a0fc-3a3601d8c68a tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:08.864774 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-52cb9a1c-085b-48ed-a0fc-3a3601d8c68a tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:08.889090 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-52cb9a1c-085b-48ed-a0fc-3a3601d8c68a tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:08.901410 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-52cb9a1c-085b-48ed-a0fc-3a3601d8c68a tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:08.903480 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-52cb9a1c-085b-48ed-a0fc-3a3601d8c68a tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:08.905950 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-52cb9a1c-085b-48ed-a0fc-3a3601d8c68a tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:09.042354 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-52cb9a1c-085b-48ed-a0fc-3a3601d8c68a tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:09.059448 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-52cb9a1c-085b-48ed-a0fc-3a3601d8c68a tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:09.063341 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-52cb9a1c-085b-48ed-a0fc-3a3601d8c68a tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:09.075200 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-52cb9a1c-085b-48ed-a0fc-3a3601d8c68a tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1539 microversion: 2.91 time: 0.267577 Sep 08 10:49:09.090063 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1363/2697] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:49:08 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1539 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:49:09.466740 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6775b816-03e6-4b13-9bd1-fb1fad40c03b tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fb4a7dae3346d39f70c51055cfd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065d7179ebd6460cb039bd1624296b57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:09.490989 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6775b816-03e6-4b13-9bd1-fb1fad40c03b tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] 10.222.0.27 "GET /compute/v2.1/servers/a2469f0a-d6bc-46ae-8905-049f2123dc0c" status: 200 len: 1591 microversion: 2.1 time: 0.819662 Sep 08 10:49:09.504093 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1335/2698] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:08 2022] GET /compute/v2.1/servers/a2469f0a-d6bc-46ae-8905-049f2123dc0c => generated 1591 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:09.516479 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-efaf022c-b05e-4aca-9dfb-b8b7dd16309c tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:09.517223 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-efaf022c-b05e-4aca-9dfb-b8b7dd16309c tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] [instance: a2469f0a-d6bc-46ae-8905-049f2123dc0c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:09.523923 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-efaf022c-b05e-4aca-9dfb-b8b7dd16309c tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:09.524867 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-efaf022c-b05e-4aca-9dfb-b8b7dd16309c tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:09.525488 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-efaf022c-b05e-4aca-9dfb-b8b7dd16309c tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:09.526356 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-efaf022c-b05e-4aca-9dfb-b8b7dd16309c tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:09.527849 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-efaf022c-b05e-4aca-9dfb-b8b7dd16309c tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:09.528612 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-efaf022c-b05e-4aca-9dfb-b8b7dd16309c tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:09.708504 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-efaf022c-b05e-4aca-9dfb-b8b7dd16309c tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] 10.222.0.27 "GET /compute/v2.1/servers/a2469f0a-d6bc-46ae-8905-049f2123dc0c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.196420 Sep 08 10:49:09.709818 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1364/2699] 10.222.0.27 () {58 vars in 1275 bytes} [Thu Sep 8 10:49:09 2022] GET /compute/v2.1/servers/a2469f0a-d6bc-46ae-8905-049f2123dc0c/os-interface => generated 284 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:49:10.115458 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-aa873e11-6825-49ac-a0f1-33895e9c68c5 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:10.116041 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-aa873e11-6825-49ac-a0f1-33895e9c68c5 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:10.146645 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aa873e11-6825-49ac-a0f1-33895e9c68c5 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:10.153787 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aa873e11-6825-49ac-a0f1-33895e9c68c5 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:10.154611 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aa873e11-6825-49ac-a0f1-33895e9c68c5 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:10.155564 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aa873e11-6825-49ac-a0f1-33895e9c68c5 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:10.156209 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aa873e11-6825-49ac-a0f1-33895e9c68c5 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:10.156653 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aa873e11-6825-49ac-a0f1-33895e9c68c5 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:10.371429 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-aa873e11-6825-49ac-a0f1-33895e9c68c5 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:10.385195 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-aa873e11-6825-49ac-a0f1-33895e9c68c5 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:10.386684 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-aa873e11-6825-49ac-a0f1-33895e9c68c5 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:10.403226 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-aa873e11-6825-49ac-a0f1-33895e9c68c5 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1539 microversion: 2.91 time: 0.299177 Sep 08 10:49:10.404177 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1336/2700] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:49:10 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1539 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:49:11.449835 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2dad51a9-1536-4198-b66c-a3072c335296 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:11.452082 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2dad51a9-1536-4198-b66c-a3072c335296 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:11.464614 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2dad51a9-1536-4198-b66c-a3072c335296 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:11.470323 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2dad51a9-1536-4198-b66c-a3072c335296 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:11.471043 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2dad51a9-1536-4198-b66c-a3072c335296 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:11.472608 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2dad51a9-1536-4198-b66c-a3072c335296 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:11.475001 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2dad51a9-1536-4198-b66c-a3072c335296 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:11.476984 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2dad51a9-1536-4198-b66c-a3072c335296 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:11.668344 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2dad51a9-1536-4198-b66c-a3072c335296 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:11.682401 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2dad51a9-1536-4198-b66c-a3072c335296 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:11.686054 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2dad51a9-1536-4198-b66c-a3072c335296 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:11.705560 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2dad51a9-1536-4198-b66c-a3072c335296 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1539 microversion: 2.91 time: 0.270880 Sep 08 10:49:11.706556 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1365/2701] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:49:11 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1539 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:49:12.031283 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-be208fe3-90e9-4544-85ed-2e78480e4cfd tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:12.032042 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-be208fe3-90e9-4544-85ed-2e78480e4cfd tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] [instance: a2469f0a-d6bc-46ae-8905-049f2123dc0c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:12.039150 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-6c9f180a-4c7c-41d0-8a78-c2f8b642a7c2 req-8eb4efff-a0ed-41c3-8d86-1687c2f6769f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2469f0a-d6bc-46ae-8905-049f2123dc0c", "tag": "f2d328aa-1a87-4e45-9e61-2691302ceff1"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:49:12.049486 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-be208fe3-90e9-4544-85ed-2e78480e4cfd tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:12.050885 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-be208fe3-90e9-4544-85ed-2e78480e4cfd tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:12.055131 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-be208fe3-90e9-4544-85ed-2e78480e4cfd tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:12.058403 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-be208fe3-90e9-4544-85ed-2e78480e4cfd tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:12.059688 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-6c9f180a-4c7c-41d0-8a78-c2f8b642a7c2 req-8eb4efff-a0ed-41c3-8d86-1687c2f6769f service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:12.060257 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-6c9f180a-4c7c-41d0-8a78-c2f8b642a7c2 req-8eb4efff-a0ed-41c3-8d86-1687c2f6769f service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:12.060983 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-6c9f180a-4c7c-41d0-8a78-c2f8b642a7c2 req-8eb4efff-a0ed-41c3-8d86-1687c2f6769f service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:12.062081 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-be208fe3-90e9-4544-85ed-2e78480e4cfd tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:12.064746 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-be208fe3-90e9-4544-85ed-2e78480e4cfd tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:12.081850 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-6c9f180a-4c7c-41d0-8a78-c2f8b642a7c2 req-8eb4efff-a0ed-41c3-8d86-1687c2f6769f service nova] Creating event network-changed:f2d328aa-1a87-4e45-9e61-2691302ceff1 for instance a2469f0a-d6bc-46ae-8905-049f2123dc0c on n-h1-850501-12 Sep 08 10:49:12.096521 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-6c9f180a-4c7c-41d0-8a78-c2f8b642a7c2 req-8eb4efff-a0ed-41c3-8d86-1687c2f6769f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061807 Sep 08 10:49:12.102286 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1366/2702] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:49:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:49:12.738793 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a73afff5-4a1f-4971-868d-821c88ab3848 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:12.740303 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a73afff5-4a1f-4971-868d-821c88ab3848 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:12.755328 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a73afff5-4a1f-4971-868d-821c88ab3848 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:12.756242 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a73afff5-4a1f-4971-868d-821c88ab3848 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:12.759101 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a73afff5-4a1f-4971-868d-821c88ab3848 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:12.760179 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a73afff5-4a1f-4971-868d-821c88ab3848 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:12.760888 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a73afff5-4a1f-4971-868d-821c88ab3848 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:12.764091 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a73afff5-4a1f-4971-868d-821c88ab3848 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:12.996575 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a73afff5-4a1f-4971-868d-821c88ab3848 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:13.006708 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a73afff5-4a1f-4971-868d-821c88ab3848 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:13.010906 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a73afff5-4a1f-4971-868d-821c88ab3848 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:13.037837 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a73afff5-4a1f-4971-868d-821c88ab3848 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1539 microversion: 2.91 time: 0.290856 Sep 08 10:49:13.039289 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1367/2703] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:49:12 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1539 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:49:13.238498 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-be208fe3-90e9-4544-85ed-2e78480e4cfd tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fb4a7dae3346d39f70c51055cfd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065d7179ebd6460cb039bd1624296b57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:13.252088 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-be208fe3-90e9-4544-85ed-2e78480e4cfd tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] 10.222.0.27 "GET /compute/v2.1/servers/a2469f0a-d6bc-46ae-8905-049f2123dc0c" status: 200 len: 1591 microversion: 2.1 time: 1.225208 Sep 08 10:49:13.257277 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1337/2704] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:12 2022] GET /compute/v2.1/servers/a2469f0a-d6bc-46ae-8905-049f2123dc0c => generated 1591 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:14.075800 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b35ed500-0cf0-4989-9cde-d87ead9c1b7d tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:14.076929 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b35ed500-0cf0-4989-9cde-d87ead9c1b7d tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:14.106482 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b35ed500-0cf0-4989-9cde-d87ead9c1b7d tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:14.107411 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b35ed500-0cf0-4989-9cde-d87ead9c1b7d tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:14.108269 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b35ed500-0cf0-4989-9cde-d87ead9c1b7d tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:14.109575 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b35ed500-0cf0-4989-9cde-d87ead9c1b7d tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:14.110432 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b35ed500-0cf0-4989-9cde-d87ead9c1b7d tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:14.115032 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b35ed500-0cf0-4989-9cde-d87ead9c1b7d tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:14.297449 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b35ed500-0cf0-4989-9cde-d87ead9c1b7d tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:14.321245 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b35ed500-0cf0-4989-9cde-d87ead9c1b7d tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:14.324919 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b35ed500-0cf0-4989-9cde-d87ead9c1b7d tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:14.342137 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b35ed500-0cf0-4989-9cde-d87ead9c1b7d tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1539 microversion: 2.91 time: 0.275787 Sep 08 10:49:14.343046 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1368/2705] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:49:14 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1539 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:49:14.856627 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4a366c28-e6fd-4c43-9671-4c0afd61e323 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:14.857196 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4a366c28-e6fd-4c43-9671-4c0afd61e323 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: 272b4680-9e7e-41dd-afa5-3116aa92665b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:14.870450 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a366c28-e6fd-4c43-9671-4c0afd61e323 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:14.870972 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a366c28-e6fd-4c43-9671-4c0afd61e323 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:14.873664 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a366c28-e6fd-4c43-9671-4c0afd61e323 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:14.876151 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a366c28-e6fd-4c43-9671-4c0afd61e323 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:14.876729 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a366c28-e6fd-4c43-9671-4c0afd61e323 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:14.878129 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a366c28-e6fd-4c43-9671-4c0afd61e323 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:14.941850 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4a366c28-e6fd-4c43-9671-4c0afd61e323 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/272b4680-9e7e-41dd-afa5-3116aa92665b/ips" status: 200 len: 150 microversion: 2.1 time: 0.089153 Sep 08 10:49:14.943133 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1338/2706] 10.222.0.27 () {58 vars in 1248 bytes} [Thu Sep 8 10:49:14 2022] GET /compute/v2.1/servers/272b4680-9e7e-41dd-afa5-3116aa92665b/ips => generated 150 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:49:14.961199 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-980abc66-b228-416e-b870-0d4e86fe4837 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c0f5912d-82b3-48ce-8193-eedef0b441ae"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:49:14.965212 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-980abc66-b228-416e-b870-0d4e86fe4837 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: 272b4680-9e7e-41dd-afa5-3116aa92665b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:14.973452 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-980abc66-b228-416e-b870-0d4e86fe4837 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:14.974298 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-980abc66-b228-416e-b870-0d4e86fe4837 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:14.975083 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-980abc66-b228-416e-b870-0d4e86fe4837 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:14.976326 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-980abc66-b228-416e-b870-0d4e86fe4837 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:14.977005 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-980abc66-b228-416e-b870-0d4e86fe4837 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:14.977666 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-980abc66-b228-416e-b870-0d4e86fe4837 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:15.141176 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-980abc66-b228-416e-b870-0d4e86fe4837 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] HTTP exception thrown: Invalid volume: volume c0f5912d-82b3-48ce-8193-eedef0b441ae is already attached to instances: bace4c1a-2c38-42b3-962d-ca87a3bfb7ba Sep 08 10:49:15.146109 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-980abc66-b228-416e-b870-0d4e86fe4837 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Request method failure captured: Sep 08 10:49:15.146109 n-d-850501-12 devstack@n-api.service[128862]: request: POST /compute/v2.1/servers/272b4680-9e7e-41dd-afa5-3116aa92665b/os-volume_attachments HTTP/1.1 Sep 08 10:49:15.146109 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:49:15.146109 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:49:15.146109 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:49:15.146109 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 74 Sep 08 10:49:15.146109 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:49:15.146109 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:49:15.146109 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:49:15.146109 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:49:15.146109 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcf85nxlXglNpNUDafAex8bEd4FqCO21NTPeXDX2uUnTAK4RtQmB0Zln5OyfaDsL03XE7NxjFWJINQM-4CVmZPvJMmjswkfAMS-LTodBU21IQa_AJm8NdfZKIu9JkoC4h7calajGQneT5j1jgUkjySqAUeFvWcq2xoj6sNreqExg8K8 Sep 08 10:49:15.146109 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:49:15.146109 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:49:15.146109 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:49:15.146109 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:49:15.146109 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:49:15.146109 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:49:15.146109 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 20f9a24cad014d7f827e8f3236dd5bae Sep 08 10:49:15.146109 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-AttachVolumeNegativeTest-20693983 Sep 08 10:49:15.146109 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:49:15.146109 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:49:15.146109 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/20f9a24cad014d7f827e8f3236dd5bae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/20f9a24cad014d7f827e8f3236dd5bae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_20f9a24cad014d7f827e8f3236dd5bae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/20f9a24cad014d7f827e8f3236dd5bae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:49:15.146109 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-AttachVolumeNegativeTest-20693983 Sep 08 10:49:15.146109 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 20f9a24cad014d7f827e8f3236dd5bae Sep 08 10:49:15.146109 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-20693983 Sep 08 10:49:15.146109 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-AttachVolumeNegativeTest-20693983-project Sep 08 10:49:15.146109 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:49:15.146109 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:49:15.146109 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 5c291cbe955b4ee5abc98132dda0255e Sep 08 10:49:15.146109 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-AttachVolumeNegativeTest-20693983-project Sep 08 10:49:15.146109 n-d-850501-12 devstack@n-api.service[128862]: Sep 08 10:49:15.146109 n-d-850501-12 devstack@n-api.service[128862]: {"volumeAttachment": {"volumeId": "c0f5912d-82b3-48ce-8193-eedef0b441ae"}} Sep 08 10:49:15.146109 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:49:15.146109 n-d-850501-12 devstack@n-api.service[128862]: exception: Invalid volume: volume c0f5912d-82b3-48ce-8193-eedef0b441ae is already attached to instances: bace4c1a-2c38-42b3-962d-ca87a3bfb7ba Sep 08 10:49:15.146109 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'server_id': '272b4680-9e7e-41dd-afa5-3116aa92665b', 'body': {'volumeAttachment': {'volumeId': 'c0f5912d-82b3-48ce-8193-eedef0b441ae'}}} Sep 08 10:49:15.146109 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:49:15.146109 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:49:15.146109 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 08 10:49:15.146109 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 08 10:49:15.146109 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 10:49:15.146109 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 10:49:15.146109 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 08 10:49:15.146109 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 08 10:49:15.146109 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 08 10:49:15.146109 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 08 10:49:15.146109 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 08 10:49:15.146109 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 08 10:49:15.146109 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume c0f5912d-82b3-48ce-8193-eedef0b441ae is already attached to instances: bace4c1a-2c38-42b3-962d-ca87a3bfb7ba Sep 08 10:49:15.146109 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:49:15.146109 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:49:15.146109 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:49:15.146109 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:49:15.146109 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:49:15.146109 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:49:15.146109 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:49:15.146109 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:49:15.146109 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:49:15.146109 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:49:15.146109 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:49:15.146109 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:49:15.146109 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:49:15.146109 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:49:15.150733 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:49:15.150733 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:49:15.150733 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 08 10:49:15.150733 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 08 10:49:15.150733 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume c0f5912d-82b3-48ce-8193-eedef0b441ae is already attached to instances: bace4c1a-2c38-42b3-962d-ca87a3bfb7ba Sep 08 10:49:15.150733 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:49:15.150733 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:49:15.150733 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:49:15.150733 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:49:15.150733 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:49:15.150733 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:49:15.150733 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:49:15.150733 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:49:15.150733 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume c0f5912d-82b3-48ce-8193-eedef0b441ae is already attached to instances: bace4c1a-2c38-42b3-962d-ca87a3bfb7ba Sep 08 10:49:15.150733 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:49:15.150733 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-980abc66-b228-416e-b870-0d4e86fe4837 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Returning 400 to user: Invalid volume: volume c0f5912d-82b3-48ce-8193-eedef0b441ae is already attached to instances: bace4c1a-2c38-42b3-962d-ca87a3bfb7ba {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:49:15.153560 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-980abc66-b228-416e-b870-0d4e86fe4837 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "POST /compute/v2.1/servers/272b4680-9e7e-41dd-afa5-3116aa92665b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.201627 Sep 08 10:49:15.154200 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1369/2707] 10.222.0.27 () {60 vars in 1323 bytes} [Thu Sep 8 10:49:14 2022] POST /compute/v2.1/servers/272b4680-9e7e-41dd-afa5-3116aa92665b/os-volume_attachments => generated 174 bytes in 203 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:49:15.166726 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-100a3a45-b809-48ad-bf7c-98315d86843d tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:15.166726 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-100a3a45-b809-48ad-bf7c-98315d86843d tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: 272b4680-9e7e-41dd-afa5-3116aa92665b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:15.176984 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-100a3a45-b809-48ad-bf7c-98315d86843d tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:15.178142 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-100a3a45-b809-48ad-bf7c-98315d86843d tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:15.178587 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-100a3a45-b809-48ad-bf7c-98315d86843d tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:15.179844 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-100a3a45-b809-48ad-bf7c-98315d86843d tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:15.180311 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-100a3a45-b809-48ad-bf7c-98315d86843d tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:15.180727 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-100a3a45-b809-48ad-bf7c-98315d86843d tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:15.182924 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=22 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:49:15.229770 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:49:15.246380 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-100a3a45-b809-48ad-bf7c-98315d86843d tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: 272b4680-9e7e-41dd-afa5-3116aa92665b] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:49:15.291952 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:49:15.380039 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-989b1848-2bf7-40ed-a7b3-c4280068e85e tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:15.381226 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-989b1848-2bf7-40ed-a7b3-c4280068e85e tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:15.408279 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-989b1848-2bf7-40ed-a7b3-c4280068e85e tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:15.408809 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-989b1848-2bf7-40ed-a7b3-c4280068e85e tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:15.410285 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-100a3a45-b809-48ad-bf7c-98315d86843d tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "DELETE /compute/v2.1/servers/272b4680-9e7e-41dd-afa5-3116aa92665b" status: 204 len: 0 microversion: 2.1 time: 0.249427 Sep 08 10:49:15.410617 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-989b1848-2bf7-40ed-a7b3-c4280068e85e tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:15.411547 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-989b1848-2bf7-40ed-a7b3-c4280068e85e tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:15.412229 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1339/2708] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:49:15 2022] DELETE /compute/v2.1/servers/272b4680-9e7e-41dd-afa5-3116aa92665b => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:49:15.412646 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-989b1848-2bf7-40ed-a7b3-c4280068e85e tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:15.413484 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-989b1848-2bf7-40ed-a7b3-c4280068e85e tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:15.419038 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:49:15.437171 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8ef3b62f-1933-4a78-908e-07187d8dfccc tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:15.440922 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8ef3b62f-1933-4a78-908e-07187d8dfccc tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: 272b4680-9e7e-41dd-afa5-3116aa92665b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:15.454828 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8ef3b62f-1933-4a78-908e-07187d8dfccc tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:15.455618 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8ef3b62f-1933-4a78-908e-07187d8dfccc tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:15.456925 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8ef3b62f-1933-4a78-908e-07187d8dfccc tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:15.461605 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8ef3b62f-1933-4a78-908e-07187d8dfccc tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:15.462312 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8ef3b62f-1933-4a78-908e-07187d8dfccc tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:15.463144 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8ef3b62f-1933-4a78-908e-07187d8dfccc tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:15.575669 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-989b1848-2bf7-40ed-a7b3-c4280068e85e tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:15.587923 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-989b1848-2bf7-40ed-a7b3-c4280068e85e tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:15.596015 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-989b1848-2bf7-40ed-a7b3-c4280068e85e tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:15.611014 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-989b1848-2bf7-40ed-a7b3-c4280068e85e tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1539 microversion: 2.91 time: 0.237265 Sep 08 10:49:15.625265 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1370/2709] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:49:15 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1539 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:49:16.143375 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8ef3b62f-1933-4a78-908e-07187d8dfccc tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c291cbe955b4ee5abc98132dda0255e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f9a24cad014d7f827e8f3236dd5bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:16.157437 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8ef3b62f-1933-4a78-908e-07187d8dfccc tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/272b4680-9e7e-41dd-afa5-3116aa92665b" status: 200 len: 1681 microversion: 2.1 time: 0.733597 Sep 08 10:49:16.158052 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1340/2710] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:15 2022] GET /compute/v2.1/servers/272b4680-9e7e-41dd-afa5-3116aa92665b => generated 1681 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:16.651660 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a897ccee-05de-4b48-aca3-2f87539d34ca tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:16.652838 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a897ccee-05de-4b48-aca3-2f87539d34ca tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:16.731293 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a897ccee-05de-4b48-aca3-2f87539d34ca tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:16.733680 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a897ccee-05de-4b48-aca3-2f87539d34ca tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:16.734316 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a897ccee-05de-4b48-aca3-2f87539d34ca tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:16.735246 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a897ccee-05de-4b48-aca3-2f87539d34ca tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:16.735854 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a897ccee-05de-4b48-aca3-2f87539d34ca tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:16.736489 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a897ccee-05de-4b48-aca3-2f87539d34ca tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:17.047482 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a897ccee-05de-4b48-aca3-2f87539d34ca tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:17.077328 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a897ccee-05de-4b48-aca3-2f87539d34ca tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:17.084590 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a897ccee-05de-4b48-aca3-2f87539d34ca tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:17.105368 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a897ccee-05de-4b48-aca3-2f87539d34ca tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1539 microversion: 2.91 time: 0.459252 Sep 08 10:49:17.129880 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1371/2711] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:49:16 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1539 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:49:17.188338 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a63343ab-718f-4c4e-a773-fbca9137dcfa tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:17.188965 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a63343ab-718f-4c4e-a773-fbca9137dcfa tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: 272b4680-9e7e-41dd-afa5-3116aa92665b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:17.212964 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a63343ab-718f-4c4e-a773-fbca9137dcfa tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:17.214344 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a63343ab-718f-4c4e-a773-fbca9137dcfa tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:17.217793 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a63343ab-718f-4c4e-a773-fbca9137dcfa tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:17.218928 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a63343ab-718f-4c4e-a773-fbca9137dcfa tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:17.222447 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a63343ab-718f-4c4e-a773-fbca9137dcfa tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:17.223907 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a63343ab-718f-4c4e-a773-fbca9137dcfa tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:18.145543 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bb4c71db-6114-460d-932e-7e8fbf0f6055 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:18.146287 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bb4c71db-6114-460d-932e-7e8fbf0f6055 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:18.162538 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb4c71db-6114-460d-932e-7e8fbf0f6055 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:18.163183 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb4c71db-6114-460d-932e-7e8fbf0f6055 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:18.169807 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb4c71db-6114-460d-932e-7e8fbf0f6055 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:18.171720 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb4c71db-6114-460d-932e-7e8fbf0f6055 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:18.174797 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb4c71db-6114-460d-932e-7e8fbf0f6055 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:18.176418 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb4c71db-6114-460d-932e-7e8fbf0f6055 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:18.468601 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bb4c71db-6114-460d-932e-7e8fbf0f6055 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:18.484861 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bb4c71db-6114-460d-932e-7e8fbf0f6055 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:18.487020 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bb4c71db-6114-460d-932e-7e8fbf0f6055 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:18.519925 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bb4c71db-6114-460d-932e-7e8fbf0f6055 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1539 microversion: 2.91 time: 0.377589 Sep 08 10:49:18.522016 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1372/2712] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:49:18 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1539 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:49:18.747797 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a63343ab-718f-4c4e-a773-fbca9137dcfa tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c291cbe955b4ee5abc98132dda0255e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f9a24cad014d7f827e8f3236dd5bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:18.796892 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a63343ab-718f-4c4e-a773-fbca9137dcfa tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/272b4680-9e7e-41dd-afa5-3116aa92665b" status: 200 len: 1681 microversion: 2.1 time: 1.606222 Sep 08 10:49:18.802713 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1341/2713] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:17 2022] GET /compute/v2.1/servers/272b4680-9e7e-41dd-afa5-3116aa92665b => generated 1681 bytes in 1620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:19.559325 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ae4fda20-8636-49ba-b692-1579e6c50093 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:19.561230 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ae4fda20-8636-49ba-b692-1579e6c50093 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:19.573964 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae4fda20-8636-49ba-b692-1579e6c50093 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:19.580048 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae4fda20-8636-49ba-b692-1579e6c50093 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:19.580707 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae4fda20-8636-49ba-b692-1579e6c50093 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:19.587413 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae4fda20-8636-49ba-b692-1579e6c50093 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:19.587915 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae4fda20-8636-49ba-b692-1579e6c50093 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:19.588445 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae4fda20-8636-49ba-b692-1579e6c50093 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:19.813581 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ae4fda20-8636-49ba-b692-1579e6c50093 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:19.826746 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ae4fda20-8636-49ba-b692-1579e6c50093 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:19.828059 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e63b0d42-c99c-47ab-91c1-961910112f70 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:19.829328 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e63b0d42-c99c-47ab-91c1-961910112f70 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: 272b4680-9e7e-41dd-afa5-3116aa92665b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:19.838346 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ae4fda20-8636-49ba-b692-1579e6c50093 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:19.849902 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e63b0d42-c99c-47ab-91c1-961910112f70 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:19.850927 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e63b0d42-c99c-47ab-91c1-961910112f70 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:19.851383 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e63b0d42-c99c-47ab-91c1-961910112f70 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:19.852125 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e63b0d42-c99c-47ab-91c1-961910112f70 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:19.852595 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e63b0d42-c99c-47ab-91c1-961910112f70 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:19.853058 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e63b0d42-c99c-47ab-91c1-961910112f70 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:19.873134 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ae4fda20-8636-49ba-b692-1579e6c50093 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1539 microversion: 2.91 time: 0.312488 Sep 08 10:49:19.875866 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1373/2714] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:49:19 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1539 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:49:20.573874 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e63b0d42-c99c-47ab-91c1-961910112f70 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c291cbe955b4ee5abc98132dda0255e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f9a24cad014d7f827e8f3236dd5bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:20.586241 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e63b0d42-c99c-47ab-91c1-961910112f70 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/272b4680-9e7e-41dd-afa5-3116aa92665b" status: 200 len: 1681 microversion: 2.1 time: 0.760842 Sep 08 10:49:20.588348 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1342/2715] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:19 2022] GET /compute/v2.1/servers/272b4680-9e7e-41dd-afa5-3116aa92665b => generated 1681 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:49:20.910594 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-97acf35e-a045-4af6-b97a-4cd020908cb8 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:20.911256 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-97acf35e-a045-4af6-b97a-4cd020908cb8 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:20.925569 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-97acf35e-a045-4af6-b97a-4cd020908cb8 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:20.931216 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-97acf35e-a045-4af6-b97a-4cd020908cb8 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:20.931762 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-97acf35e-a045-4af6-b97a-4cd020908cb8 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:20.933152 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-97acf35e-a045-4af6-b97a-4cd020908cb8 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:20.934680 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-97acf35e-a045-4af6-b97a-4cd020908cb8 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:20.935762 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-97acf35e-a045-4af6-b97a-4cd020908cb8 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:21.518270 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-97acf35e-a045-4af6-b97a-4cd020908cb8 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:21.536124 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-97acf35e-a045-4af6-b97a-4cd020908cb8 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:21.543315 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-97acf35e-a045-4af6-b97a-4cd020908cb8 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:21.554883 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-97acf35e-a045-4af6-b97a-4cd020908cb8 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1539 microversion: 2.91 time: 0.648486 Sep 08 10:49:21.559266 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1374/2716] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:49:20 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1539 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:49:21.612093 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-73268020-602f-42a1-8b03-256de1c50970 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:21.612881 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-73268020-602f-42a1-8b03-256de1c50970 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: 272b4680-9e7e-41dd-afa5-3116aa92665b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:21.635751 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-73268020-602f-42a1-8b03-256de1c50970 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:21.637290 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-73268020-602f-42a1-8b03-256de1c50970 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:21.637852 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-73268020-602f-42a1-8b03-256de1c50970 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:21.650885 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-73268020-602f-42a1-8b03-256de1c50970 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:21.654105 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-73268020-602f-42a1-8b03-256de1c50970 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:21.654700 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-73268020-602f-42a1-8b03-256de1c50970 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:21.983348 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-73268020-602f-42a1-8b03-256de1c50970 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c291cbe955b4ee5abc98132dda0255e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f9a24cad014d7f827e8f3236dd5bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:21.992206 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-73268020-602f-42a1-8b03-256de1c50970 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/272b4680-9e7e-41dd-afa5-3116aa92665b" status: 200 len: 1614 microversion: 2.1 time: 0.384414 Sep 08 10:49:21.997892 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1343/2717] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:21 2022] GET /compute/v2.1/servers/272b4680-9e7e-41dd-afa5-3116aa92665b => generated 1614 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:22.593400 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-17ab43aa-7a9b-4804-81fc-9578edc1b02b tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:22.594752 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-17ab43aa-7a9b-4804-81fc-9578edc1b02b tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:22.614365 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-17ab43aa-7a9b-4804-81fc-9578edc1b02b tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:22.615159 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-17ab43aa-7a9b-4804-81fc-9578edc1b02b tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:22.618688 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-17ab43aa-7a9b-4804-81fc-9578edc1b02b tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:22.621872 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-17ab43aa-7a9b-4804-81fc-9578edc1b02b tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:22.622387 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-17ab43aa-7a9b-4804-81fc-9578edc1b02b tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:22.622836 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-17ab43aa-7a9b-4804-81fc-9578edc1b02b tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:22.967045 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-17ab43aa-7a9b-4804-81fc-9578edc1b02b tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:22.987243 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-17ab43aa-7a9b-4804-81fc-9578edc1b02b tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:22.995114 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-17ab43aa-7a9b-4804-81fc-9578edc1b02b tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:23.014922 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-17ab43aa-7a9b-4804-81fc-9578edc1b02b tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1539 microversion: 2.91 time: 0.428213 Sep 08 10:49:23.038987 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ad0b4d4d-b01d-4d54-990a-6e4e2989038d tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:23.039631 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ad0b4d4d-b01d-4d54-990a-6e4e2989038d tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: 272b4680-9e7e-41dd-afa5-3116aa92665b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:23.045203 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1375/2718] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:49:22 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1539 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:49:23.060928 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ad0b4d4d-b01d-4d54-990a-6e4e2989038d tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:23.061463 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ad0b4d4d-b01d-4d54-990a-6e4e2989038d tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:23.061900 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ad0b4d4d-b01d-4d54-990a-6e4e2989038d tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:23.062617 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ad0b4d4d-b01d-4d54-990a-6e4e2989038d tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:23.070102 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ad0b4d4d-b01d-4d54-990a-6e4e2989038d tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:23.070795 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ad0b4d4d-b01d-4d54-990a-6e4e2989038d tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:23.212674 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-a743f9f1-acd1-4e66-ab0f-a2feebff023e req-fe186ab2-7759-42cc-995f-9aa92d429804 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "272b4680-9e7e-41dd-afa5-3116aa92665b", "name": "network-vif-deleted", "tag": "722660b6-51c7-4a26-9625-53b4b04f69d8"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:49:23.289486 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a743f9f1-acd1-4e66-ab0f-a2feebff023e req-fe186ab2-7759-42cc-995f-9aa92d429804 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:23.290029 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a743f9f1-acd1-4e66-ab0f-a2feebff023e req-fe186ab2-7759-42cc-995f-9aa92d429804 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:23.292985 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a743f9f1-acd1-4e66-ab0f-a2feebff023e req-fe186ab2-7759-42cc-995f-9aa92d429804 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:23.366051 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-a743f9f1-acd1-4e66-ab0f-a2feebff023e req-fe186ab2-7759-42cc-995f-9aa92d429804 service nova] Creating event network-vif-deleted:722660b6-51c7-4a26-9625-53b4b04f69d8 for instance 272b4680-9e7e-41dd-afa5-3116aa92665b on n-h2-850501-12 Sep 08 10:49:23.383838 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ad0b4d4d-b01d-4d54-990a-6e4e2989038d tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c291cbe955b4ee5abc98132dda0255e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f9a24cad014d7f827e8f3236dd5bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:23.403877 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-a743f9f1-acd1-4e66-ab0f-a2feebff023e req-fe186ab2-7759-42cc-995f-9aa92d429804 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.201241 Sep 08 10:49:23.404465 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1376/2719] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:49:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:49:23.426196 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ad0b4d4d-b01d-4d54-990a-6e4e2989038d tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/272b4680-9e7e-41dd-afa5-3116aa92665b" status: 200 len: 1614 microversion: 2.1 time: 0.392268 Sep 08 10:49:23.427417 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1344/2720] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:23 2022] GET /compute/v2.1/servers/272b4680-9e7e-41dd-afa5-3116aa92665b => generated 1614 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:49:24.055621 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a3bc5547-7723-4a1c-899c-989a1ab5b7cb tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:24.057638 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a3bc5547-7723-4a1c-899c-989a1ab5b7cb tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:24.074003 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a3bc5547-7723-4a1c-899c-989a1ab5b7cb tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:24.074847 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a3bc5547-7723-4a1c-899c-989a1ab5b7cb tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:24.075831 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a3bc5547-7723-4a1c-899c-989a1ab5b7cb tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:24.077393 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a3bc5547-7723-4a1c-899c-989a1ab5b7cb tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:24.078431 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a3bc5547-7723-4a1c-899c-989a1ab5b7cb tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:24.079062 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a3bc5547-7723-4a1c-899c-989a1ab5b7cb tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:24.456341 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8482bace-c738-4f29-9760-5316153c63f5 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:24.457755 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8482bace-c738-4f29-9760-5316153c63f5 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: 272b4680-9e7e-41dd-afa5-3116aa92665b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:24.479934 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8482bace-c738-4f29-9760-5316153c63f5 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:24.480464 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8482bace-c738-4f29-9760-5316153c63f5 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:24.481226 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8482bace-c738-4f29-9760-5316153c63f5 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:24.482206 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8482bace-c738-4f29-9760-5316153c63f5 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:24.485849 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8482bace-c738-4f29-9760-5316153c63f5 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:24.486593 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8482bace-c738-4f29-9760-5316153c63f5 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:24.534108 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-8482bace-c738-4f29-9760-5316153c63f5 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] HTTP exception thrown: Instance 272b4680-9e7e-41dd-afa5-3116aa92665b could not be found. Sep 08 10:49:24.542224 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8482bace-c738-4f29-9760-5316153c63f5 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Request method failure captured: Sep 08 10:49:24.542224 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/272b4680-9e7e-41dd-afa5-3116aa92665b HTTP/1.1 Sep 08 10:49:24.542224 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:49:24.542224 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:49:24.542224 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:49:24.542224 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:49:24.542224 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:49:24.542224 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:49:24.542224 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:49:24.542224 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:49:24.542224 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcf85nxlXglNpNUDafAex8bEd4FqCO21NTPeXDX2uUnTAK4RtQmB0Zln5OyfaDsL03XE7NxjFWJINQM-4CVmZPvJMmjswkfAMS-LTodBU21IQa_AJm8NdfZKIu9JkoC4h7calajGQneT5j1jgUkjySqAUeFvWcq2xoj6sNreqExg8K8 Sep 08 10:49:24.542224 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:49:24.542224 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:49:24.542224 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:49:24.542224 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:49:24.542224 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:49:24.542224 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:49:24.542224 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 20f9a24cad014d7f827e8f3236dd5bae Sep 08 10:49:24.542224 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-AttachVolumeNegativeTest-20693983 Sep 08 10:49:24.542224 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:49:24.542224 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:49:24.542224 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/20f9a24cad014d7f827e8f3236dd5bae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/20f9a24cad014d7f827e8f3236dd5bae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_20f9a24cad014d7f827e8f3236dd5bae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/20f9a24cad014d7f827e8f3236dd5bae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:49:24.542224 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-AttachVolumeNegativeTest-20693983 Sep 08 10:49:24.542224 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 20f9a24cad014d7f827e8f3236dd5bae Sep 08 10:49:24.542224 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-20693983 Sep 08 10:49:24.542224 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-AttachVolumeNegativeTest-20693983-project Sep 08 10:49:24.542224 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:49:24.542224 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:49:24.542224 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 5c291cbe955b4ee5abc98132dda0255e Sep 08 10:49:24.542224 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-AttachVolumeNegativeTest-20693983-project Sep 08 10:49:24.542224 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:49:24.542224 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 272b4680-9e7e-41dd-afa5-3116aa92665b could not be found. Sep 08 10:49:24.542224 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '272b4680-9e7e-41dd-afa5-3116aa92665b'} Sep 08 10:49:24.542224 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:49:24.542224 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:49:24.542224 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:49:24.542224 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:49:24.542224 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:49:24.542224 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:49:24.542224 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:49:24.542224 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:49:24.542224 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:49:24.542224 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:49:24.542224 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 272b4680-9e7e-41dd-afa5-3116aa92665b could not be found. Sep 08 10:49:24.542224 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:49:24.542224 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:49:24.542224 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:49:24.542224 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:49:24.542224 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:49:24.542224 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:49:24.542224 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:49:24.542224 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:49:24.542224 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:49:24.542224 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:49:24.542224 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:49:24.542224 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:49:24.542224 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:49:24.542224 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:49:24.542224 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:49:24.542224 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:49:24.542224 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 272b4680-9e7e-41dd-afa5-3116aa92665b could not be found. Sep 08 10:49:24.542224 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:49:24.542224 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:49:24.542224 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:49:24.547512 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:49:24.547512 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:49:24.547512 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:49:24.547512 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:49:24.547512 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:49:24.547512 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 272b4680-9e7e-41dd-afa5-3116aa92665b could not be found. Sep 08 10:49:24.547512 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:49:24.548987 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8482bace-c738-4f29-9760-5316153c63f5 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Returning 404 to user: Instance 272b4680-9e7e-41dd-afa5-3116aa92665b could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:49:24.554643 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8482bace-c738-4f29-9760-5316153c63f5 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/272b4680-9e7e-41dd-afa5-3116aa92665b" status: 404 len: 111 microversion: 2.1 time: 0.106138 Sep 08 10:49:24.557808 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1345/2721] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:24 2022] GET /compute/v2.1/servers/272b4680-9e7e-41dd-afa5-3116aa92665b => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:49:24.580387 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-54d964da-14fe-47bf-b6cf-3c092b4c13c8 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '.version_select at 0x7f68e458a310>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:24.638789 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-54d964da-14fe-47bf-b6cf-3c092b4c13c8 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1934086094" status: 202 len: 0 microversion: 2.1 time: 0.075322 Sep 08 10:49:24.640120 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1346/2722] 10.222.0.27 () {58 vars in 1221 bytes} [Thu Sep 8 10:49:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1934086094 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:49:24.931972 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a3bc5547-7723-4a1c-899c-989a1ab5b7cb tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:24.948424 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a3bc5547-7723-4a1c-899c-989a1ab5b7cb tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:24.952973 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a3bc5547-7723-4a1c-899c-989a1ab5b7cb tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:24.976812 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a3bc5547-7723-4a1c-899c-989a1ab5b7cb tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1560 microversion: 2.91 time: 0.923068 Sep 08 10:49:24.977954 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1377/2723] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:49:24 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1560 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:49:26.022727 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-93d1eacd-1e92-4bf8-8d32-08f060c02cdb tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:26.025217 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-93d1eacd-1e92-4bf8-8d32-08f060c02cdb tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:26.068642 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-93d1eacd-1e92-4bf8-8d32-08f060c02cdb tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:26.070735 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-93d1eacd-1e92-4bf8-8d32-08f060c02cdb tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:26.071629 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-93d1eacd-1e92-4bf8-8d32-08f060c02cdb tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:26.076520 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-93d1eacd-1e92-4bf8-8d32-08f060c02cdb tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:26.102733 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-93d1eacd-1e92-4bf8-8d32-08f060c02cdb tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:26.107439 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-93d1eacd-1e92-4bf8-8d32-08f060c02cdb tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:26.597270 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-93d1eacd-1e92-4bf8-8d32-08f060c02cdb tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:26.606101 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-93d1eacd-1e92-4bf8-8d32-08f060c02cdb tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:26.622611 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-93d1eacd-1e92-4bf8-8d32-08f060c02cdb tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:26.656371 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-93d1eacd-1e92-4bf8-8d32-08f060c02cdb tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1555 microversion: 2.91 time: 0.641568 Sep 08 10:49:26.665795 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1347/2724] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:49:26 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1555 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:49:26.970343 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-284d36fb-1e53-4a72-b795-65cf5dc4b0b7 tempest-FloatingIPsNegativeTestJSON-315653609 tempest-FloatingIPsNegativeTestJSON-315653609-project] Calling method '.version_select at 0x7f68e45638b0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:27.277489 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-284d36fb-1e53-4a72-b795-65cf5dc4b0b7 tempest-FloatingIPsNegativeTestJSON-315653609 tempest-FloatingIPsNegativeTestJSON-315653609-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.735643 Sep 08 10:49:27.286247 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1378/2725] 10.222.0.27 () {58 vars in 1149 bytes} [Thu Sep 8 10:49:26 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:49:27.291909 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3fb7272a-ac58-4981-9203-cd07fca97438 tempest-FloatingIPsNegativeTestJSON-315653609 tempest-FloatingIPsNegativeTestJSON-315653609-project] Action: 'create', calling method: .version_select at 0x7f68e4463940>, body: {"pool": "non_exist_pool"} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:49:27.698248 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fce1ff53-6750-447b-aa21-05f1ecce3564 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:27.698880 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fce1ff53-6750-447b-aa21-05f1ecce3564 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:27.704702 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:49:27.744450 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fce1ff53-6750-447b-aa21-05f1ecce3564 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:27.744976 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fce1ff53-6750-447b-aa21-05f1ecce3564 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:27.745474 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fce1ff53-6750-447b-aa21-05f1ecce3564 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:27.746312 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fce1ff53-6750-447b-aa21-05f1ecce3564 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:27.760035 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fce1ff53-6750-447b-aa21-05f1ecce3564 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:27.760505 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fce1ff53-6750-447b-aa21-05f1ecce3564 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:27.954650 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-3fb7272a-ac58-4981-9203-cd07fca97438 tempest-FloatingIPsNegativeTestJSON-315653609 tempest-FloatingIPsNegativeTestJSON-315653609-project] HTTP exception thrown: Floating IP pool not found. Sep 08 10:49:27.958227 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3fb7272a-ac58-4981-9203-cd07fca97438 tempest-FloatingIPsNegativeTestJSON-315653609 tempest-FloatingIPsNegativeTestJSON-315653609-project] Request method failure captured: Sep 08 10:49:27.958227 n-d-850501-12 devstack@n-api.service[128861]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Sep 08 10:49:27.958227 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:49:27.958227 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:49:27.958227 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:49:27.958227 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 26 Sep 08 10:49:27.958227 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:49:27.958227 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:49:27.958227 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:49:27.958227 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:49:27.958227 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGci26jNwkWqWTvLrlQ6kypIPLALx0xzvfXV3w24PmyVRAlL4Qld6bl2rjTuWAH7jzQSsBzc2WkM9psw_abtp38DyAruudGfJkebkjvFP1rggMH8W9wGiFnTjLwYSlchA9wp_51l2wZ3vZk_jIXIh1pwjXCWwcOxaTiJmCrjLoCLJBd0 Sep 08 10:49:27.958227 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:49:27.958227 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:49:27.958227 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:49:27.958227 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:49:27.958227 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:49:27.958227 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:49:27.958227 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 819e493cf2d0405dbd5ee01c18aa4fd7 Sep 08 10:49:27.958227 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-315653609 Sep 08 10:49:27.958227 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:49:27.958227 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:49:27.958227 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/819e493cf2d0405dbd5ee01c18aa4fd7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/819e493cf2d0405dbd5ee01c18aa4fd7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_819e493cf2d0405dbd5ee01c18aa4fd7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/819e493cf2d0405dbd5ee01c18aa4fd7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:49:27.958227 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-315653609 Sep 08 10:49:27.958227 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 819e493cf2d0405dbd5ee01c18aa4fd7 Sep 08 10:49:27.958227 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-315653609 Sep 08 10:49:27.958227 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-FloatingIPsNegativeTestJSON-315653609-project Sep 08 10:49:27.958227 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:49:27.958227 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:49:27.958227 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 5fc607af9a6149429fa191793c78b31f Sep 08 10:49:27.958227 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-315653609-project Sep 08 10:49:27.958227 n-d-850501-12 devstack@n-api.service[128861]: Sep 08 10:49:27.958227 n-d-850501-12 devstack@n-api.service[128861]: {"pool": "non_exist_pool"} Sep 08 10:49:27.958227 n-d-850501-12 devstack@n-api.service[128861]: method: Sep 08 10:49:27.958227 n-d-850501-12 devstack@n-api.service[128861]: exception: Floating IP pool not found. Sep 08 10:49:27.958227 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'body': {'pool': 'non_exist_pool'}} Sep 08 10:49:27.958227 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:49:27.958227 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:49:27.958227 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Sep 08 10:49:27.958227 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Sep 08 10:49:27.958227 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Sep 08 10:49:27.958227 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Sep 08 10:49:27.958227 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Sep 08 10:49:27.958227 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Sep 08 10:49:27.958227 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Sep 08 10:49:27.958227 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:49:27.958227 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:49:27.958227 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:49:27.958227 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:49:27.958227 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:49:27.958227 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:49:27.958227 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:49:27.958227 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:49:27.958227 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:49:27.958227 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:49:27.958227 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:49:27.958227 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:49:27.958227 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Sep 08 10:49:27.958227 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:49:27.958227 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Sep 08 10:49:27.958227 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:49:27.958227 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:49:27.958227 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:49:27.958227 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:49:27.958227 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:49:27.958227 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:49:27.958227 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:49:27.958227 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:49:27.966073 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Sep 08 10:49:27.966073 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:49:27.967242 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3fb7272a-ac58-4981-9203-cd07fca97438 tempest-FloatingIPsNegativeTestJSON-315653609 tempest-FloatingIPsNegativeTestJSON-315653609-project] Returning 404 to user: Floating IP pool not found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:49:27.969056 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3fb7272a-ac58-4981-9203-cd07fca97438 tempest-FloatingIPsNegativeTestJSON-315653609 tempest-FloatingIPsNegativeTestJSON-315653609-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.681560 Sep 08 10:49:27.969895 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1348/2726] 10.222.0.27 () {60 vars in 1170 bytes} [Thu Sep 8 10:49:27 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 684 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 08 10:49:27.986096 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7fe9e7c9-cea7-4672-ac06-b55194456dfb tempest-FloatingIPsNegativeTestJSON-315653609 tempest-FloatingIPsNegativeTestJSON-315653609-project] Calling method '.version_select at 0x7f68e891f040>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:28.082547 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fce1ff53-6750-447b-aa21-05f1ecce3564 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:28.095645 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fce1ff53-6750-447b-aa21-05f1ecce3564 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:28.110352 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fce1ff53-6750-447b-aa21-05f1ecce3564 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:28.158043 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fce1ff53-6750-447b-aa21-05f1ecce3564 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1555 microversion: 2.91 time: 0.465286 Sep 08 10:49:28.159220 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1379/2727] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:49:27 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1555 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:49:28.561531 n-d-850501-12 devstack@n-api.service[128861]: DEBUG neutronclient.v2_0.client [None req-7fe9e7c9-cea7-4672-ac06-b55194456dfb tempest-FloatingIPsNegativeTestJSON-315653609 tempest-FloatingIPsNegativeTestJSON-315653609-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 0b31e45a-2792-4c9e-8a32-8b8687fed60c could not be found", "detail": ""}} {{(pid=128861) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 08 10:49:28.562397 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-7fe9e7c9-cea7-4672-ac06-b55194456dfb tempest-FloatingIPsNegativeTestJSON-315653609 tempest-FloatingIPsNegativeTestJSON-315653609-project] HTTP exception thrown: Floating IP not found for ID 0b31e45a-2792-4c9e-8a32-8b8687fed60c Sep 08 10:49:28.564363 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7fe9e7c9-cea7-4672-ac06-b55194456dfb tempest-FloatingIPsNegativeTestJSON-315653609 tempest-FloatingIPsNegativeTestJSON-315653609-project] Request method failure captured: Sep 08 10:49:28.564363 n-d-850501-12 devstack@n-api.service[128861]: request: DELETE /compute/v2.1/os-floating-ips/0b31e45a-2792-4c9e-8a32-8b8687fed60c HTTP/1.1 Sep 08 10:49:28.564363 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:49:28.564363 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:49:28.564363 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:49:28.564363 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:49:28.564363 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:49:28.564363 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:49:28.564363 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:49:28.564363 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:49:28.564363 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGci26jNwkWqWTvLrlQ6kypIPLALx0xzvfXV3w24PmyVRAlL4Qld6bl2rjTuWAH7jzQSsBzc2WkM9psw_abtp38DyAruudGfJkebkjvFP1rggMH8W9wGiFnTjLwYSlchA9wp_51l2wZ3vZk_jIXIh1pwjXCWwcOxaTiJmCrjLoCLJBd0 Sep 08 10:49:28.564363 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:49:28.564363 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:49:28.564363 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:49:28.564363 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:49:28.564363 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:49:28.564363 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:49:28.564363 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 819e493cf2d0405dbd5ee01c18aa4fd7 Sep 08 10:49:28.564363 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-315653609 Sep 08 10:49:28.564363 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:49:28.564363 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:49:28.564363 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/819e493cf2d0405dbd5ee01c18aa4fd7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/819e493cf2d0405dbd5ee01c18aa4fd7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_819e493cf2d0405dbd5ee01c18aa4fd7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/819e493cf2d0405dbd5ee01c18aa4fd7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:49:28.564363 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-315653609 Sep 08 10:49:28.564363 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 819e493cf2d0405dbd5ee01c18aa4fd7 Sep 08 10:49:28.564363 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-315653609 Sep 08 10:49:28.564363 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-FloatingIPsNegativeTestJSON-315653609-project Sep 08 10:49:28.564363 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:49:28.564363 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:49:28.564363 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 5fc607af9a6149429fa191793c78b31f Sep 08 10:49:28.564363 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-315653609-project Sep 08 10:49:28.564363 n-d-850501-12 devstack@n-api.service[128861]: method: Sep 08 10:49:28.564363 n-d-850501-12 devstack@n-api.service[128861]: exception: Floating IP not found for ID 0b31e45a-2792-4c9e-8a32-8b8687fed60c Sep 08 10:49:28.564363 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '0b31e45a-2792-4c9e-8a32-8b8687fed60c'} Sep 08 10:49:28.564363 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:49:28.564363 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:49:28.564363 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 08 10:49:28.564363 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 08 10:49:28.564363 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:49:28.564363 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:49:28.564363 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 08 10:49:28.564363 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 08 10:49:28.564363 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:49:28.564363 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:49:28.564363 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 08 10:49:28.564363 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 08 10:49:28.564363 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:49:28.564363 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:49:28.564363 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 08 10:49:28.564363 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 08 10:49:28.564363 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:49:28.564363 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:49:28.564363 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 08 10:49:28.564363 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 08 10:49:28.564363 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:49:28.564363 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:49:28.564363 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 08 10:49:28.564363 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 08 10:49:28.564363 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 08 10:49:28.564363 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 08 10:49:28.564363 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 0b31e45a-2792-4c9e-8a32-8b8687fed60c could not be found Sep 08 10:49:28.564363 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-606155c0-9ab8-4d7c-a7ab-aecbe118b16c'] Sep 08 10:49:28.569847 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:49:28.569847 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:49:28.569847 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:49:28.569847 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:49:28.569847 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Sep 08 10:49:28.569847 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 08 10:49:28.569847 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 08 10:49:28.569847 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 08 10:49:28.569847 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 0b31e45a-2792-4c9e-8a32-8b8687fed60c. Sep 08 10:49:28.569847 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:49:28.569847 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:49:28.569847 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:49:28.569847 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:49:28.569847 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:49:28.569847 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:49:28.569847 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:49:28.569847 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:49:28.569847 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:49:28.569847 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:49:28.569847 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:49:28.569847 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:49:28.569847 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Sep 08 10:49:28.569847 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 08 10:49:28.569847 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 0b31e45a-2792-4c9e-8a32-8b8687fed60c Sep 08 10:49:28.569847 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:49:28.569847 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:49:28.569847 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:49:28.569847 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:49:28.569847 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:49:28.569847 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:49:28.569847 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:49:28.569847 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:49:28.569847 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 0b31e45a-2792-4c9e-8a32-8b8687fed60c Sep 08 10:49:28.569847 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:49:28.569847 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7fe9e7c9-cea7-4672-ac06-b55194456dfb tempest-FloatingIPsNegativeTestJSON-315653609 tempest-FloatingIPsNegativeTestJSON-315653609-project] Returning 404 to user: Floating IP not found for ID 0b31e45a-2792-4c9e-8a32-8b8687fed60c {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:49:28.574563 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7fe9e7c9-cea7-4672-ac06-b55194456dfb tempest-FloatingIPsNegativeTestJSON-315653609 tempest-FloatingIPsNegativeTestJSON-315653609-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/0b31e45a-2792-4c9e-8a32-8b8687fed60c" status: 404 len: 111 microversion: 2.1 time: 0.596375 Sep 08 10:49:28.580243 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1349/2728] 10.222.0.27 () {58 vars in 1263 bytes} [Thu Sep 8 10:49:27 2022] DELETE /compute/v2.1/os-floating-ips/0b31e45a-2792-4c9e-8a32-8b8687fed60c => generated 111 bytes in 605 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 10:49:29.195803 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7abfe979-7f4b-4fbb-bef0-c7c5d9e37c12 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:29.196585 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7abfe979-7f4b-4fbb-bef0-c7c5d9e37c12 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:29.219740 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7abfe979-7f4b-4fbb-bef0-c7c5d9e37c12 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:29.220974 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7abfe979-7f4b-4fbb-bef0-c7c5d9e37c12 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:29.221760 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7abfe979-7f4b-4fbb-bef0-c7c5d9e37c12 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:29.222771 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7abfe979-7f4b-4fbb-bef0-c7c5d9e37c12 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:29.223473 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7abfe979-7f4b-4fbb-bef0-c7c5d9e37c12 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:29.226017 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7abfe979-7f4b-4fbb-bef0-c7c5d9e37c12 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:29.634654 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7abfe979-7f4b-4fbb-bef0-c7c5d9e37c12 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:29.655502 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7abfe979-7f4b-4fbb-bef0-c7c5d9e37c12 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:29.661786 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7abfe979-7f4b-4fbb-bef0-c7c5d9e37c12 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:29.680334 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7abfe979-7f4b-4fbb-bef0-c7c5d9e37c12 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1555 microversion: 2.91 time: 0.493151 Sep 08 10:49:29.682696 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1380/2729] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:49:29 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1555 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:49:30.718292 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-24c95ac5-233c-4e31-80e2-ad0c5a76afb8 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:30.718967 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-24c95ac5-233c-4e31-80e2-ad0c5a76afb8 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:30.739248 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-24c95ac5-233c-4e31-80e2-ad0c5a76afb8 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:30.743932 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-24c95ac5-233c-4e31-80e2-ad0c5a76afb8 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:30.745549 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-24c95ac5-233c-4e31-80e2-ad0c5a76afb8 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:30.749459 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-24c95ac5-233c-4e31-80e2-ad0c5a76afb8 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:30.749958 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-24c95ac5-233c-4e31-80e2-ad0c5a76afb8 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:30.750406 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-24c95ac5-233c-4e31-80e2-ad0c5a76afb8 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:30.861613 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-53012bb1-8eb7-4a68-87cf-887a8f86f07f tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1586459224", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "877dfa5c-585b-4b8b-af6a-031c2193c56b"}]}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:49:30.910243 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:49:31.047068 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-24c95ac5-233c-4e31-80e2-ad0c5a76afb8 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:31.079678 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-24c95ac5-233c-4e31-80e2-ad0c5a76afb8 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:31.087927 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-24c95ac5-233c-4e31-80e2-ad0c5a76afb8 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:31.111714 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-24c95ac5-233c-4e31-80e2-ad0c5a76afb8 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1555 microversion: 2.91 time: 0.397551 Sep 08 10:49:31.119892 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1381/2730] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:49:30 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1555 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:49:31.327268 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ac9aeff9-8ca3-4e79-a476-115eda4b7011 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Action: 'create', calling method: .version_select at 0x7f68e469e940>, body: {"keypair": {"name": "tempest-keypair-1662192616", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBComuXGmwwAkO6naeSG2k/RG18RQINjVhUTs1oHMOB+1tjMyRWc2Pbaxz1SuZnVg3tPIRhNrOLzpZBrsoRxwSe7mVrMWm49G2kdGCeab3PPSc68CrzY8JN3DmtMt1IGDxA=="}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:49:31.374450 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-ac9aeff9-8ca3-4e79-a476-115eda4b7011 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Getting quotas for project 63eba712ae82439ba53b37b774c332dd. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:49:31.396040 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-ac9aeff9-8ca3-4e79-a476-115eda4b7011 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Getting quotas for user 8f58dabb2db74cedba25f856ad1a7df2 and project 63eba712ae82439ba53b37b774c332dd. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:49:31.460948 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ac9aeff9-8ca3-4e79-a476-115eda4b7011 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.335733 Sep 08 10:49:31.463627 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1382/2731] 10.222.0.27 () {60 vars in 1159 bytes} [Thu Sep 8 10:49:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:49:31.501492 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f7196954-eda8-4b11-b236-95cdb4f6faad tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:31.502059 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f7196954-eda8-4b11-b236-95cdb4f6faad tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: bace4c1a-2c38-42b3-962d-ca87a3bfb7ba] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:31.535131 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f7196954-eda8-4b11-b236-95cdb4f6faad tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:31.539424 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f7196954-eda8-4b11-b236-95cdb4f6faad tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:31.542239 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f7196954-eda8-4b11-b236-95cdb4f6faad tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:31.543043 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f7196954-eda8-4b11-b236-95cdb4f6faad tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:31.549819 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f7196954-eda8-4b11-b236-95cdb4f6faad tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:31.550321 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f7196954-eda8-4b11-b236-95cdb4f6faad tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:31.575620 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-53012bb1-8eb7-4a68-87cf-887a8f86f07f tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] validate_networks() for [('877dfa5c-585b-4b8b-af6a-031c2193c56b', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:49:31.848756 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-f7196954-eda8-4b11-b236-95cdb4f6faad tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lazy-loading 'services' on Instance uuid bace4c1a-2c38-42b3-962d-ca87a3bfb7ba {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:49:32.102982 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f7196954-eda8-4b11-b236-95cdb4f6faad tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "DELETE /compute/v2.1/servers/bace4c1a-2c38-42b3-962d-ca87a3bfb7ba/os-volume_attachments/c0f5912d-82b3-48ce-8193-eedef0b441ae" status: 202 len: 0 microversion: 2.1 time: 0.633951 Sep 08 10:49:32.103899 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1383/2732] 10.222.0.27 () {58 vars in 1416 bytes} [Thu Sep 8 10:49:31 2022] DELETE /compute/v2.1/servers/bace4c1a-2c38-42b3-962d-ca87a3bfb7ba/os-volume_attachments/c0f5912d-82b3-48ce-8193-eedef0b441ae => generated 0 bytes in 636 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:49:32.111444 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3a8bf243-e20c-4ed3-90eb-70cc7ebbcdc7 tempest-ImagesMetadataTestJSON-1420798859 tempest-ImagesMetadataTestJSON-1420798859-project] Calling method '.version_select at 0x7f68e458c280>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:32.208101 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3a8bf243-e20c-4ed3-90eb-70cc7ebbcdc7 tempest-ImagesMetadataTestJSON-1420798859 tempest-ImagesMetadataTestJSON-1420798859-project] 10.222.0.27 "GET /compute/v2.1/images/8fcf886e-29a7-418a-98f3-6beb90dc5a0d" status: 200 len: 637 microversion: 2.1 time: 0.102720 Sep 08 10:49:32.210448 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1384/2733] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:49:32 2022] GET /compute/v2.1/images/8fcf886e-29a7-418a-98f3-6beb90dc5a0d => generated 637 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:49:32.217207 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b75be915-c975-4784-ae6f-1877d89d1a49 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:32.238678 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b75be915-c975-4784-ae6f-1877d89d1a49 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: bace4c1a-2c38-42b3-962d-ca87a3bfb7ba] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:32.264191 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b75be915-c975-4784-ae6f-1877d89d1a49 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:32.264692 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b75be915-c975-4784-ae6f-1877d89d1a49 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:32.265405 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b75be915-c975-4784-ae6f-1877d89d1a49 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:32.266316 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b75be915-c975-4784-ae6f-1877d89d1a49 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:32.266946 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b75be915-c975-4784-ae6f-1877d89d1a49 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:32.267542 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b75be915-c975-4784-ae6f-1877d89d1a49 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:32.354219 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b75be915-c975-4784-ae6f-1877d89d1a49 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/bace4c1a-2c38-42b3-962d-ca87a3bfb7ba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.140046 Sep 08 10:49:32.355869 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1385/2734] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 10:49:32 2022] GET /compute/v2.1/servers/bace4c1a-2c38-42b3-962d-ca87a3bfb7ba/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:49:32.368842 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-523367dd-bf35-4f2f-91fb-9097af95081e tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:32.373492 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-523367dd-bf35-4f2f-91fb-9097af95081e tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:32.386840 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-523367dd-bf35-4f2f-91fb-9097af95081e tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:32.395339 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-523367dd-bf35-4f2f-91fb-9097af95081e tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:32.397363 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-523367dd-bf35-4f2f-91fb-9097af95081e tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:32.398334 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-523367dd-bf35-4f2f-91fb-9097af95081e tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:32.401393 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-523367dd-bf35-4f2f-91fb-9097af95081e tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:32.405723 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-523367dd-bf35-4f2f-91fb-9097af95081e tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:32.570812 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-523367dd-bf35-4f2f-91fb-9097af95081e tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:32.584907 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-523367dd-bf35-4f2f-91fb-9097af95081e tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:32.588796 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-523367dd-bf35-4f2f-91fb-9097af95081e tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:32.609682 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-523367dd-bf35-4f2f-91fb-9097af95081e tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1555 microversion: 2.91 time: 0.252388 Sep 08 10:49:32.614965 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1386/2735] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:49:32 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1555 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:49:32.622363 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dd118fab-5e33-45b7-8c0a-2ee84522cab4 tempest-ImagesMetadataTestJSON-1420798859 tempest-ImagesMetadataTestJSON-1420798859-project] Action: 'update_all', calling method: .version_select at 0x7f68e458cee0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:49:32.820601 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-dd118fab-5e33-45b7-8c0a-2ee84522cab4 tempest-ImagesMetadataTestJSON-1420798859 tempest-ImagesMetadataTestJSON-1420798859-project] Getting quotas for project b0e84d29c8aa49cda40ae42b9b77b3ec. Resources: dict_keys(['metadata_items']) {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:49:32.846870 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-dd118fab-5e33-45b7-8c0a-2ee84522cab4 tempest-ImagesMetadataTestJSON-1420798859 tempest-ImagesMetadataTestJSON-1420798859-project] Getting quotas for user d80fe45bec844d379724d192040fc3fe and project b0e84d29c8aa49cda40ae42b9b77b3ec. Resources: dict_keys(['metadata_items']) {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:49:33.921941 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-dd118fab-5e33-45b7-8c0a-2ee84522cab4 tempest-ImagesMetadataTestJSON-1420798859 tempest-ImagesMetadataTestJSON-1420798859-project] 10.222.0.27 "PUT /compute/v2.1/images/8fcf886e-29a7-418a-98f3-6beb90dc5a0d/metadata" status: 200 len: 61 microversion: 2.1 time: 1.292698 Sep 08 10:49:33.921941 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1387/2736] 10.222.0.27 () {60 vars in 1280 bytes} [Thu Sep 8 10:49:32 2022] PUT /compute/v2.1/images/8fcf886e-29a7-418a-98f3-6beb90dc5a0d/metadata => generated 61 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:49:33.921941 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-edd8c32b-30ab-48ec-b46b-378240f1d8b8 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:33.925358 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-edd8c32b-30ab-48ec-b46b-378240f1d8b8 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: bace4c1a-2c38-42b3-962d-ca87a3bfb7ba] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:33.950001 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-edd8c32b-30ab-48ec-b46b-378240f1d8b8 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:33.950903 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-edd8c32b-30ab-48ec-b46b-378240f1d8b8 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:33.952651 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-edd8c32b-30ab-48ec-b46b-378240f1d8b8 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:33.955891 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-edd8c32b-30ab-48ec-b46b-378240f1d8b8 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:33.958434 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-edd8c32b-30ab-48ec-b46b-378240f1d8b8 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:33.959796 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-edd8c32b-30ab-48ec-b46b-378240f1d8b8 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:34.103526 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-edd8c32b-30ab-48ec-b46b-378240f1d8b8 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/bace4c1a-2c38-42b3-962d-ca87a3bfb7ba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.187899 Sep 08 10:49:34.110145 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1388/2737] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 10:49:33 2022] GET /compute/v2.1/servers/bace4c1a-2c38-42b3-962d-ca87a3bfb7ba/os-volume_attachments => generated 197 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:49:34.134942 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-68b6ea38-edf3-4d94-96a4-ec3913f925f4 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:34.135572 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-68b6ea38-edf3-4d94-96a4-ec3913f925f4 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:34.168105 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68b6ea38-edf3-4d94-96a4-ec3913f925f4 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:34.171583 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68b6ea38-edf3-4d94-96a4-ec3913f925f4 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:34.172228 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68b6ea38-edf3-4d94-96a4-ec3913f925f4 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:34.175482 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68b6ea38-edf3-4d94-96a4-ec3913f925f4 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:34.176885 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68b6ea38-edf3-4d94-96a4-ec3913f925f4 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:34.177382 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68b6ea38-edf3-4d94-96a4-ec3913f925f4 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:34.354860 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-68b6ea38-edf3-4d94-96a4-ec3913f925f4 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:34.372547 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-68b6ea38-edf3-4d94-96a4-ec3913f925f4 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:34.380126 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-68b6ea38-edf3-4d94-96a4-ec3913f925f4 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:34.393386 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-68b6ea38-edf3-4d94-96a4-ec3913f925f4 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1555 microversion: 2.91 time: 0.279585 Sep 08 10:49:34.409063 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1389/2738] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:49:34 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1555 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:49:34.409063 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2ae5490a-84f2-4220-a495-1fecff928094 tempest-ImagesMetadataTestJSON-1420798859 tempest-ImagesMetadataTestJSON-1420798859-project] Calling method '.version_select at 0x7f68e454a160>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:34.613366 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-53012bb1-8eb7-4a68-87cf-887a8f86f07f tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:49:34.614571 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-53012bb1-8eb7-4a68-87cf-887a8f86f07f tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:49:34.615428 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-53012bb1-8eb7-4a68-87cf-887a8f86f07f tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:49:34.616063 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-53012bb1-8eb7-4a68-87cf-887a8f86f07f tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:49:34.618065 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-53012bb1-8eb7-4a68-87cf-887a8f86f07f tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:49:34.642661 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-53012bb1-8eb7-4a68-87cf-887a8f86f07f tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:34.644247 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-53012bb1-8eb7-4a68-87cf-887a8f86f07f tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:34.647758 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-53012bb1-8eb7-4a68-87cf-887a8f86f07f tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:34.650124 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-53012bb1-8eb7-4a68-87cf-887a8f86f07f tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:34.654966 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-53012bb1-8eb7-4a68-87cf-887a8f86f07f tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:34.655674 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-53012bb1-8eb7-4a68-87cf-887a8f86f07f tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:34.739538 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-53012bb1-8eb7-4a68-87cf-887a8f86f07f tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Getting quotas for project 7bc5f459e4a143d1b8bf1c5c64153644. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:49:34.769037 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-53012bb1-8eb7-4a68-87cf-887a8f86f07f tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Getting quotas for user 53c0c66b5a004df886b3d973a978c132 and project 7bc5f459e4a143d1b8bf1c5c64153644. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:49:34.822284 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-53012bb1-8eb7-4a68-87cf-887a8f86f07f tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Going to run 2 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:49:34.831067 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-53012bb1-8eb7-4a68-87cf-887a8f86f07f tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] [instance: 7ef65322-ccb1-4703-b15f-4ab8306b32de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:49:35.003784 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-53012bb1-8eb7-4a68-87cf-887a8f86f07f tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] [instance: f96451ab-896c-4652-8e89-ba210495b5e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=7ef65322-ccb1-4703-b15f-4ab8306b32de,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:49:35.155596 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2ae5490a-84f2-4220-a495-1fecff928094 tempest-ImagesMetadataTestJSON-1420798859 tempest-ImagesMetadataTestJSON-1420798859-project] 10.222.0.27 "DELETE /compute/v2.1/images/8fcf886e-29a7-418a-98f3-6beb90dc5a0d/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.755853 Sep 08 10:49:35.159712 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1390/2739] 10.222.0.27 () {58 vars in 1296 bytes} [Thu Sep 8 10:49:34 2022] DELETE /compute/v2.1/images/8fcf886e-29a7-418a-98f3-6beb90dc5a0d/metadata/os_version => generated 0 bytes in 760 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:49:35.163281 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-10be7fed-69dc-4040-b14b-667a72acc4a4 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:35.174314 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-10be7fed-69dc-4040-b14b-667a72acc4a4 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: bace4c1a-2c38-42b3-962d-ca87a3bfb7ba] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:35.196274 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10be7fed-69dc-4040-b14b-667a72acc4a4 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:35.196923 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10be7fed-69dc-4040-b14b-667a72acc4a4 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:35.197411 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10be7fed-69dc-4040-b14b-667a72acc4a4 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:35.202095 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10be7fed-69dc-4040-b14b-667a72acc4a4 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:35.204390 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10be7fed-69dc-4040-b14b-667a72acc4a4 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:35.204390 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10be7fed-69dc-4040-b14b-667a72acc4a4 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:35.254915 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-53012bb1-8eb7-4a68-87cf-887a8f86f07f tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.850009 Sep 08 10:49:35.268593 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1350/2740] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:49:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 4865 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:49:35.300124 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cb353034-406e-4528-ab5f-8f4be38a6c52 tempest-ImagesMetadataTestJSON-1420798859 tempest-ImagesMetadataTestJSON-1420798859-project] Calling method '.version_select at 0x7f68e41669d0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:35.323541 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:49:35.335198 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-10be7fed-69dc-4040-b14b-667a72acc4a4 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/bace4c1a-2c38-42b3-962d-ca87a3bfb7ba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.175565 Sep 08 10:49:35.346136 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1391/2741] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 10:49:35 2022] GET /compute/v2.1/servers/bace4c1a-2c38-42b3-962d-ca87a3bfb7ba/os-volume_attachments => generated 197 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:49:35.367224 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1fe59d26-5af4-4eff-8533-2edd0395ffdd tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:35.389495 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1fe59d26-5af4-4eff-8533-2edd0395ffdd tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '53c0c66b5a004df886b3d973a978c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc5f459e4a143d1b8bf1c5c64153644', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:35.390019 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1fe59d26-5af4-4eff-8533-2edd0395ffdd tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Searching by: {'deleted': False, 'project_id': '7bc5f459e4a143d1b8bf1c5c64153644'} {{(pid=128862) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:49:35.418054 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cb353034-406e-4528-ab5f-8f4be38a6c52 tempest-ImagesMetadataTestJSON-1420798859 tempest-ImagesMetadataTestJSON-1420798859-project] 10.222.0.27 "GET /compute/v2.1/images/8fcf886e-29a7-418a-98f3-6beb90dc5a0d/metadata" status: 200 len: 37 microversion: 2.1 time: 0.147361 Sep 08 10:49:35.420861 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1351/2742] 10.222.0.27 () {58 vars in 1260 bytes} [Thu Sep 8 10:49:35 2022] GET /compute/v2.1/images/8fcf886e-29a7-418a-98f3-6beb90dc5a0d/metadata => generated 37 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:49:35.429726 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cf70cbf2-360a-4c33-9a55-be8029da4850 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:35.439126 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cf70cbf2-360a-4c33-9a55-be8029da4850 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:35.464607 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cf70cbf2-360a-4c33-9a55-be8029da4850 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:35.465847 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1fe59d26-5af4-4eff-8533-2edd0395ffdd tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:35.470060 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1fe59d26-5af4-4eff-8533-2edd0395ffdd tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:35.470639 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1fe59d26-5af4-4eff-8533-2edd0395ffdd tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:35.471504 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1fe59d26-5af4-4eff-8533-2edd0395ffdd tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:35.472004 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1fe59d26-5af4-4eff-8533-2edd0395ffdd tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:35.472313 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cf70cbf2-360a-4c33-9a55-be8029da4850 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:35.476200 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1fe59d26-5af4-4eff-8533-2edd0395ffdd tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:35.476773 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cf70cbf2-360a-4c33-9a55-be8029da4850 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:35.478021 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cf70cbf2-360a-4c33-9a55-be8029da4850 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:35.482360 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cf70cbf2-360a-4c33-9a55-be8029da4850 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:35.486382 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cf70cbf2-360a-4c33-9a55-be8029da4850 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:35.594539 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1fe59d26-5af4-4eff-8533-2edd0395ffdd tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.244613 Sep 08 10:49:35.602692 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1392/2743] 10.222.0.27 () {58 vars in 1125 bytes} [Thu Sep 8 10:49:35 2022] GET /compute/v2.1/servers => generated 677 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:49:35.614251 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6bbb0f83-374b-4dd3-9965-1b446483bdf8 tempest-ImagesMetadataTestJSON-1420798859 tempest-ImagesMetadataTestJSON-1420798859-project] Action: 'update_all', calling method: .version_select at 0x7f68e4350d30>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:49:35.754635 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-6bbb0f83-374b-4dd3-9965-1b446483bdf8 tempest-ImagesMetadataTestJSON-1420798859 tempest-ImagesMetadataTestJSON-1420798859-project] Getting quotas for project b0e84d29c8aa49cda40ae42b9b77b3ec. Resources: dict_keys(['metadata_items']) {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:49:35.780935 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-6bbb0f83-374b-4dd3-9965-1b446483bdf8 tempest-ImagesMetadataTestJSON-1420798859 tempest-ImagesMetadataTestJSON-1420798859-project] Getting quotas for user d80fe45bec844d379724d192040fc3fe and project b0e84d29c8aa49cda40ae42b9b77b3ec. Resources: dict_keys(['metadata_items']) {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:49:35.807505 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-cf70cbf2-360a-4c33-9a55-be8029da4850 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:35.848621 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-cf70cbf2-360a-4c33-9a55-be8029da4850 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:35.863758 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-cf70cbf2-360a-4c33-9a55-be8029da4850 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:35.902028 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cf70cbf2-360a-4c33-9a55-be8029da4850 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1555 microversion: 2.91 time: 0.479786 Sep 08 10:49:35.911281 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1352/2744] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:49:35 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1555 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:49:35.926514 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-119e4eb8-c5c6-4356-8837-81fae3d16c91 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:35.934557 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-119e4eb8-c5c6-4356-8837-81fae3d16c91 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] [instance: f96451ab-896c-4652-8e89-ba210495b5e8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:36.357832 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-119e4eb8-c5c6-4356-8837-81fae3d16c91 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0c66b5a004df886b3d973a978c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc5f459e4a143d1b8bf1c5c64153644', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:36.369106 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-119e4eb8-c5c6-4356-8837-81fae3d16c91 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] 10.222.0.27 "GET /compute/v2.1/servers/f96451ab-896c-4652-8e89-ba210495b5e8" status: 200 len: 1220 microversion: 2.1 time: 0.450140 Sep 08 10:49:36.372775 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1353/2745] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:35 2022] GET /compute/v2.1/servers/f96451ab-896c-4652-8e89-ba210495b5e8 => generated 1220 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:36.385293 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-aedb2cc4-0c88-4368-8003-f87e8f5f9487 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:36.396314 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-aedb2cc4-0c88-4368-8003-f87e8f5f9487 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: bace4c1a-2c38-42b3-962d-ca87a3bfb7ba] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:36.416352 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aedb2cc4-0c88-4368-8003-f87e8f5f9487 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:36.417254 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aedb2cc4-0c88-4368-8003-f87e8f5f9487 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:36.423451 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aedb2cc4-0c88-4368-8003-f87e8f5f9487 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:36.424469 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aedb2cc4-0c88-4368-8003-f87e8f5f9487 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:36.430070 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aedb2cc4-0c88-4368-8003-f87e8f5f9487 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:36.431001 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aedb2cc4-0c88-4368-8003-f87e8f5f9487 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:36.571171 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-aedb2cc4-0c88-4368-8003-f87e8f5f9487 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/bace4c1a-2c38-42b3-962d-ca87a3bfb7ba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.196755 Sep 08 10:49:36.573117 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1354/2746] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 10:49:36 2022] GET /compute/v2.1/servers/bace4c1a-2c38-42b3-962d-ca87a3bfb7ba/os-volume_attachments => generated 197 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:49:36.663394 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6bbb0f83-374b-4dd3-9965-1b446483bdf8 tempest-ImagesMetadataTestJSON-1420798859 tempest-ImagesMetadataTestJSON-1420798859-project] 10.222.0.27 "PUT /compute/v2.1/images/8fcf886e-29a7-418a-98f3-6beb90dc5a0d/metadata" status: 200 len: 61 microversion: 2.1 time: 1.052899 Sep 08 10:49:36.664413 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1393/2747] 10.222.0.27 () {60 vars in 1280 bytes} [Thu Sep 8 10:49:35 2022] PUT /compute/v2.1/images/8fcf886e-29a7-418a-98f3-6beb90dc5a0d/metadata => generated 61 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:49:36.678225 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2825850d-f16e-4037-b287-b691de99d151 tempest-ImagesMetadataTestJSON-1420798859 tempest-ImagesMetadataTestJSON-1420798859-project] Calling method '.version_select at 0x7f68e40f2040>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:36.777400 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2825850d-f16e-4037-b287-b691de99d151 tempest-ImagesMetadataTestJSON-1420798859 tempest-ImagesMetadataTestJSON-1420798859-project] 10.222.0.27 "GET /compute/v2.1/images/8fcf886e-29a7-418a-98f3-6beb90dc5a0d/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.107040 Sep 08 10:49:36.778170 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1355/2748] 10.222.0.27 () {58 vars in 1290 bytes} [Thu Sep 8 10:49:36 2022] GET /compute/v2.1/images/8fcf886e-29a7-418a-98f3-6beb90dc5a0d/metadata/os_distro => generated 33 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 08 10:49:36.796802 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cd762578-cac5-4e13-8cc3-62b14b45f0a9 tempest-ImagesMetadataTestJSON-1420798859 tempest-ImagesMetadataTestJSON-1420798859-project] Action: 'update_all', calling method: .version_select at 0x7f68e4586dc0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:49:36.943035 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7c093252-13ac-49d2-bbbc-7d8c927966e7 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:36.944775 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7c093252-13ac-49d2-bbbc-7d8c927966e7 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:36.966740 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-cd762578-cac5-4e13-8cc3-62b14b45f0a9 tempest-ImagesMetadataTestJSON-1420798859 tempest-ImagesMetadataTestJSON-1420798859-project] Getting quotas for project b0e84d29c8aa49cda40ae42b9b77b3ec. Resources: dict_keys(['metadata_items']) {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:49:36.968905 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c093252-13ac-49d2-bbbc-7d8c927966e7 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:36.973974 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c093252-13ac-49d2-bbbc-7d8c927966e7 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:36.975237 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c093252-13ac-49d2-bbbc-7d8c927966e7 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:36.978494 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c093252-13ac-49d2-bbbc-7d8c927966e7 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:36.981094 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c093252-13ac-49d2-bbbc-7d8c927966e7 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:36.984495 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c093252-13ac-49d2-bbbc-7d8c927966e7 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:36.993527 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-cd762578-cac5-4e13-8cc3-62b14b45f0a9 tempest-ImagesMetadataTestJSON-1420798859 tempest-ImagesMetadataTestJSON-1420798859-project] Getting quotas for user d80fe45bec844d379724d192040fc3fe and project b0e84d29c8aa49cda40ae42b9b77b3ec. Resources: dict_keys(['metadata_items']) {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:49:37.299131 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7c093252-13ac-49d2-bbbc-7d8c927966e7 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:37.337499 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7c093252-13ac-49d2-bbbc-7d8c927966e7 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:37.343209 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7c093252-13ac-49d2-bbbc-7d8c927966e7 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:37.397351 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7c093252-13ac-49d2-bbbc-7d8c927966e7 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1555 microversion: 2.91 time: 0.451138 Sep 08 10:49:37.417257 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1356/2749] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:49:36 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1555 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:49:37.446969 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1aa1274b-1857-4115-afc8-acf8a2d765ca tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:37.452749 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1aa1274b-1857-4115-afc8-acf8a2d765ca tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] [instance: f96451ab-896c-4652-8e89-ba210495b5e8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:37.499124 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cd762578-cac5-4e13-8cc3-62b14b45f0a9 tempest-ImagesMetadataTestJSON-1420798859 tempest-ImagesMetadataTestJSON-1420798859-project] 10.222.0.27 "PUT /compute/v2.1/images/8fcf886e-29a7-418a-98f3-6beb90dc5a0d/metadata" status: 200 len: 61 microversion: 2.1 time: 0.713983 Sep 08 10:49:37.500361 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1394/2750] 10.222.0.27 () {60 vars in 1280 bytes} [Thu Sep 8 10:49:36 2022] PUT /compute/v2.1/images/8fcf886e-29a7-418a-98f3-6beb90dc5a0d/metadata => generated 61 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:49:37.511889 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-41808e8f-9699-4616-8744-fa22b4b4b38f tempest-ImagesMetadataTestJSON-1420798859 tempest-ImagesMetadataTestJSON-1420798859-project] Calling method '.version_select at 0x7f68e8b19dc0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:37.650509 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-41808e8f-9699-4616-8744-fa22b4b4b38f tempest-ImagesMetadataTestJSON-1420798859 tempest-ImagesMetadataTestJSON-1420798859-project] 10.222.0.27 "GET /compute/v2.1/images/8fcf886e-29a7-418a-98f3-6beb90dc5a0d/metadata" status: 200 len: 61 microversion: 2.1 time: 0.144532 Sep 08 10:49:37.651289 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1395/2751] 10.222.0.27 () {58 vars in 1260 bytes} [Thu Sep 8 10:49:37 2022] GET /compute/v2.1/images/8fcf886e-29a7-418a-98f3-6beb90dc5a0d/metadata => generated 61 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 08 10:49:37.660938 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1aa1274b-1857-4115-afc8-acf8a2d765ca tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0c66b5a004df886b3d973a978c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc5f459e4a143d1b8bf1c5c64153644', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:37.676403 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-251a32f2-1be9-43d3-8aaa-b910d031acaf tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:37.678822 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1aa1274b-1857-4115-afc8-acf8a2d765ca tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] 10.222.0.27 "GET /compute/v2.1/servers/f96451ab-896c-4652-8e89-ba210495b5e8" status: 200 len: 1220 microversion: 2.1 time: 0.250070 Sep 08 10:49:37.691393 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-251a32f2-1be9-43d3-8aaa-b910d031acaf tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: bace4c1a-2c38-42b3-962d-ca87a3bfb7ba] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:37.694420 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1357/2752] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:37 2022] GET /compute/v2.1/servers/f96451ab-896c-4652-8e89-ba210495b5e8 => generated 1220 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:37.706725 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2a42dd00-d2fa-4a29-9137-894bdef6c4d1 tempest-ImagesMetadataTestJSON-1420798859 tempest-ImagesMetadataTestJSON-1420798859-project] Action: 'update_all', calling method: .version_select at 0x7f68e41699d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:49:37.724078 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-251a32f2-1be9-43d3-8aaa-b910d031acaf tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:37.753417 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-251a32f2-1be9-43d3-8aaa-b910d031acaf tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:37.763372 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-251a32f2-1be9-43d3-8aaa-b910d031acaf tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:37.769239 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-251a32f2-1be9-43d3-8aaa-b910d031acaf tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:37.770062 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-251a32f2-1be9-43d3-8aaa-b910d031acaf tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:37.771827 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-251a32f2-1be9-43d3-8aaa-b910d031acaf tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:37.845400 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-2a42dd00-d2fa-4a29-9137-894bdef6c4d1 tempest-ImagesMetadataTestJSON-1420798859 tempest-ImagesMetadataTestJSON-1420798859-project] Getting quotas for project b0e84d29c8aa49cda40ae42b9b77b3ec. Resources: dict_keys(['metadata_items']) {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:49:37.887008 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-2a42dd00-d2fa-4a29-9137-894bdef6c4d1 tempest-ImagesMetadataTestJSON-1420798859 tempest-ImagesMetadataTestJSON-1420798859-project] Getting quotas for user d80fe45bec844d379724d192040fc3fe and project b0e84d29c8aa49cda40ae42b9b77b3ec. Resources: dict_keys(['metadata_items']) {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:49:37.939527 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-251a32f2-1be9-43d3-8aaa-b910d031acaf tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/bace4c1a-2c38-42b3-962d-ca87a3bfb7ba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.282201 Sep 08 10:49:37.940886 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1396/2753] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 10:49:37 2022] GET /compute/v2.1/servers/bace4c1a-2c38-42b3-962d-ca87a3bfb7ba/os-volume_attachments => generated 197 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:49:38.321192 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2a42dd00-d2fa-4a29-9137-894bdef6c4d1 tempest-ImagesMetadataTestJSON-1420798859 tempest-ImagesMetadataTestJSON-1420798859-project] 10.222.0.27 "PUT /compute/v2.1/images/8fcf886e-29a7-418a-98f3-6beb90dc5a0d/metadata" status: 200 len: 61 microversion: 2.1 time: 0.619092 Sep 08 10:49:38.321824 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1358/2754] 10.222.0.27 () {60 vars in 1280 bytes} [Thu Sep 8 10:49:37 2022] PUT /compute/v2.1/images/8fcf886e-29a7-418a-98f3-6beb90dc5a0d/metadata => generated 61 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:49:38.331862 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-13a154ca-6117-4447-a197-1754f3b04425 tempest-ImagesMetadataTestJSON-1420798859 tempest-ImagesMetadataTestJSON-1420798859-project] Action: 'update_all', calling method: .version_select at 0x7f68e4361820>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:49:38.429593 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c1118eb9-21b5-4a6d-a133-8644772c7f03 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:38.430243 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c1118eb9-21b5-4a6d-a133-8644772c7f03 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:38.450031 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c1118eb9-21b5-4a6d-a133-8644772c7f03 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:38.450543 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c1118eb9-21b5-4a6d-a133-8644772c7f03 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:38.450985 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c1118eb9-21b5-4a6d-a133-8644772c7f03 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:38.451713 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c1118eb9-21b5-4a6d-a133-8644772c7f03 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:38.452384 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c1118eb9-21b5-4a6d-a133-8644772c7f03 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:38.452581 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c1118eb9-21b5-4a6d-a133-8644772c7f03 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:38.456145 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-13a154ca-6117-4447-a197-1754f3b04425 tempest-ImagesMetadataTestJSON-1420798859 tempest-ImagesMetadataTestJSON-1420798859-project] Getting quotas for project b0e84d29c8aa49cda40ae42b9b77b3ec. Resources: dict_keys(['metadata_items']) {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:49:38.482111 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-13a154ca-6117-4447-a197-1754f3b04425 tempest-ImagesMetadataTestJSON-1420798859 tempest-ImagesMetadataTestJSON-1420798859-project] Getting quotas for user d80fe45bec844d379724d192040fc3fe and project b0e84d29c8aa49cda40ae42b9b77b3ec. Resources: dict_keys(['metadata_items']) {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:49:39.007644 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c1118eb9-21b5-4a6d-a133-8644772c7f03 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:39.033641 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c1118eb9-21b5-4a6d-a133-8644772c7f03 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:39.035501 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c1118eb9-21b5-4a6d-a133-8644772c7f03 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:39.057456 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c1118eb9-21b5-4a6d-a133-8644772c7f03 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1555 microversion: 2.91 time: 0.632571 Sep 08 10:49:39.062584 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1359/2755] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:49:38 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1555 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:49:39.078145 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-43bfde63-37f1-4796-8363-41df11bc6e72 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "b64cbf08-82b2-48a4-a9bb-1a0062117b8d"}], "security_groups": [{"name": "tempest-securitygroup--272513449"}], "key_name": "tempest-keypair-1662192616", "user_data": "}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:49:39.595080 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-13a154ca-6117-4447-a197-1754f3b04425 tempest-ImagesMetadataTestJSON-1420798859 tempest-ImagesMetadataTestJSON-1420798859-project] 10.222.0.27 "PUT /compute/v2.1/images/8fcf886e-29a7-418a-98f3-6beb90dc5a0d/metadata" status: 200 len: 64 microversion: 2.1 time: 1.267162 Sep 08 10:49:39.596697 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1397/2756] 10.222.0.27 () {60 vars in 1280 bytes} [Thu Sep 8 10:49:38 2022] PUT /compute/v2.1/images/8fcf886e-29a7-418a-98f3-6beb90dc5a0d/metadata => generated 64 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:49:39.605258 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6e1d401e-01f0-4b0c-b3b3-70f55a121444 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:39.606172 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6e1d401e-01f0-4b0c-b3b3-70f55a121444 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] [instance: f96451ab-896c-4652-8e89-ba210495b5e8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:39.637955 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6e1d401e-01f0-4b0c-b3b3-70f55a121444 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:39.639859 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6e1d401e-01f0-4b0c-b3b3-70f55a121444 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:39.641833 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6e1d401e-01f0-4b0c-b3b3-70f55a121444 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:39.644311 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6e1d401e-01f0-4b0c-b3b3-70f55a121444 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:39.648863 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6e1d401e-01f0-4b0c-b3b3-70f55a121444 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:39.650593 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6e1d401e-01f0-4b0c-b3b3-70f55a121444 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:39.904627 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6e1d401e-01f0-4b0c-b3b3-70f55a121444 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0c66b5a004df886b3d973a978c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc5f459e4a143d1b8bf1c5c64153644', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:39.927965 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6e1d401e-01f0-4b0c-b3b3-70f55a121444 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] 10.222.0.27 "GET /compute/v2.1/servers/f96451ab-896c-4652-8e89-ba210495b5e8" status: 200 len: 1272 microversion: 2.1 time: 0.329339 Sep 08 10:49:39.953436 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1398/2757] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:39 2022] GET /compute/v2.1/servers/f96451ab-896c-4652-8e89-ba210495b5e8 => generated 1272 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:39.967584 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7a6dbb7e-2cb9-4f99-8bc8-84c778cb79f8 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:39.978104 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7a6dbb7e-2cb9-4f99-8bc8-84c778cb79f8 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: bace4c1a-2c38-42b3-962d-ca87a3bfb7ba] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:40.008648 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7a6dbb7e-2cb9-4f99-8bc8-84c778cb79f8 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:40.014155 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7a6dbb7e-2cb9-4f99-8bc8-84c778cb79f8 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:40.015079 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7a6dbb7e-2cb9-4f99-8bc8-84c778cb79f8 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:40.016117 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7a6dbb7e-2cb9-4f99-8bc8-84c778cb79f8 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:40.016993 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7a6dbb7e-2cb9-4f99-8bc8-84c778cb79f8 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:40.017998 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7a6dbb7e-2cb9-4f99-8bc8-84c778cb79f8 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:40.103673 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7a6dbb7e-2cb9-4f99-8bc8-84c778cb79f8 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/bace4c1a-2c38-42b3-962d-ca87a3bfb7ba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.145435 Sep 08 10:49:40.107808 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1399/2758] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 10:49:39 2022] GET /compute/v2.1/servers/bace4c1a-2c38-42b3-962d-ca87a3bfb7ba/os-volume_attachments => generated 197 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:49:40.118670 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a0594d06-c5c6-4d26-bcdf-9f4b9e792370 tempest-ImagesMetadataTestJSON-1420798859 tempest-ImagesMetadataTestJSON-1420798859-project] Calling method '.version_select at 0x7f68e469e1f0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:40.231293 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a0594d06-c5c6-4d26-bcdf-9f4b9e792370 tempest-ImagesMetadataTestJSON-1420798859 tempest-ImagesMetadataTestJSON-1420798859-project] 10.222.0.27 "GET /compute/v2.1/images/8fcf886e-29a7-418a-98f3-6beb90dc5a0d/metadata" status: 200 len: 64 microversion: 2.1 time: 0.121843 Sep 08 10:49:40.237186 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1400/2759] 10.222.0.27 () {58 vars in 1260 bytes} [Thu Sep 8 10:49:40 2022] GET /compute/v2.1/images/8fcf886e-29a7-418a-98f3-6beb90dc5a0d/metadata => generated 64 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:49:40.239374 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e41848ef-b7b0-4d1b-a497-2bfd3402d980 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:40.242702 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e41848ef-b7b0-4d1b-a497-2bfd3402d980 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:40.264696 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e41848ef-b7b0-4d1b-a497-2bfd3402d980 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:40.268595 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e41848ef-b7b0-4d1b-a497-2bfd3402d980 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:40.271737 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e41848ef-b7b0-4d1b-a497-2bfd3402d980 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:40.274586 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e41848ef-b7b0-4d1b-a497-2bfd3402d980 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:40.275089 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e41848ef-b7b0-4d1b-a497-2bfd3402d980 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:40.275541 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e41848ef-b7b0-4d1b-a497-2bfd3402d980 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:40.506394 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e41848ef-b7b0-4d1b-a497-2bfd3402d980 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:40.512797 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-43bfde63-37f1-4796-8363-41df11bc6e72 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] validate_networks() for [('b64cbf08-82b2-48a4-a9bb-1a0062117b8d', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:49:40.524931 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e41848ef-b7b0-4d1b-a497-2bfd3402d980 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:40.529186 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e41848ef-b7b0-4d1b-a497-2bfd3402d980 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:40.558565 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e41848ef-b7b0-4d1b-a497-2bfd3402d980 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1555 microversion: 2.91 time: 0.318936 Sep 08 10:49:40.559263 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1401/2760] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:49:40 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1555 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:49:40.576756 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cbf77fc8-afd9-4538-a631-3c0f6282bb60 tempest-ImagesMetadataTestJSON-1420798859 tempest-ImagesMetadataTestJSON-1420798859-project] Action: 'update_all', calling method: .version_select at 0x7f68e4563040>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:49:40.722202 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-cbf77fc8-afd9-4538-a631-3c0f6282bb60 tempest-ImagesMetadataTestJSON-1420798859 tempest-ImagesMetadataTestJSON-1420798859-project] Getting quotas for project b0e84d29c8aa49cda40ae42b9b77b3ec. Resources: dict_keys(['metadata_items']) {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:49:40.744066 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-cbf77fc8-afd9-4538-a631-3c0f6282bb60 tempest-ImagesMetadataTestJSON-1420798859 tempest-ImagesMetadataTestJSON-1420798859-project] Getting quotas for user d80fe45bec844d379724d192040fc3fe and project b0e84d29c8aa49cda40ae42b9b77b3ec. Resources: dict_keys(['metadata_items']) {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:49:41.534865 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cbf77fc8-afd9-4538-a631-3c0f6282bb60 tempest-ImagesMetadataTestJSON-1420798859 tempest-ImagesMetadataTestJSON-1420798859-project] 10.222.0.27 "PUT /compute/v2.1/images/8fcf886e-29a7-418a-98f3-6beb90dc5a0d/metadata" status: 200 len: 61 microversion: 2.1 time: 0.971531 Sep 08 10:49:41.535854 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1402/2761] 10.222.0.27 () {60 vars in 1280 bytes} [Thu Sep 8 10:49:40 2022] PUT /compute/v2.1/images/8fcf886e-29a7-418a-98f3-6beb90dc5a0d/metadata => generated 61 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:49:41.553583 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-16c5069c-adb4-4f32-9e66-0e08197c1ce6 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:41.554594 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-16c5069c-adb4-4f32-9e66-0e08197c1ce6 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] [instance: f96451ab-896c-4652-8e89-ba210495b5e8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:41.598345 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-16c5069c-adb4-4f32-9e66-0e08197c1ce6 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:41.598966 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-16c5069c-adb4-4f32-9e66-0e08197c1ce6 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:41.600187 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-16c5069c-adb4-4f32-9e66-0e08197c1ce6 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:41.601011 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-16c5069c-adb4-4f32-9e66-0e08197c1ce6 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:41.601505 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-16c5069c-adb4-4f32-9e66-0e08197c1ce6 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:41.601973 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-16c5069c-adb4-4f32-9e66-0e08197c1ce6 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:41.984696 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-16c5069c-adb4-4f32-9e66-0e08197c1ce6 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0c66b5a004df886b3d973a978c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc5f459e4a143d1b8bf1c5c64153644', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:41.995588 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-16c5069c-adb4-4f32-9e66-0e08197c1ce6 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] 10.222.0.27 "GET /compute/v2.1/servers/f96451ab-896c-4652-8e89-ba210495b5e8" status: 200 len: 1278 microversion: 2.1 time: 0.457781 Sep 08 10:49:42.003852 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1403/2762] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:41 2022] GET /compute/v2.1/servers/f96451ab-896c-4652-8e89-ba210495b5e8 => generated 1278 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:42.018984 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4e6a1a97-0ee1-4994-bc7b-dc3834e07c94 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:42.043675 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4e6a1a97-0ee1-4994-bc7b-dc3834e07c94 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: bace4c1a-2c38-42b3-962d-ca87a3bfb7ba] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:42.071455 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e6a1a97-0ee1-4994-bc7b-dc3834e07c94 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:42.081699 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e6a1a97-0ee1-4994-bc7b-dc3834e07c94 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:42.082329 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e6a1a97-0ee1-4994-bc7b-dc3834e07c94 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:42.085901 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e6a1a97-0ee1-4994-bc7b-dc3834e07c94 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:42.086393 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e6a1a97-0ee1-4994-bc7b-dc3834e07c94 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:42.086841 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e6a1a97-0ee1-4994-bc7b-dc3834e07c94 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:42.219073 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-43bfde63-37f1-4796-8363-41df11bc6e72 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:49:42.221783 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-43bfde63-37f1-4796-8363-41df11bc6e72 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:49:42.222561 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-43bfde63-37f1-4796-8363-41df11bc6e72 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:49:42.223202 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-43bfde63-37f1-4796-8363-41df11bc6e72 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:49:42.223862 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-43bfde63-37f1-4796-8363-41df11bc6e72 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:49:42.226947 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4e6a1a97-0ee1-4994-bc7b-dc3834e07c94 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/bace4c1a-2c38-42b3-962d-ca87a3bfb7ba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.221137 Sep 08 10:49:42.234045 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1404/2763] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 10:49:42 2022] GET /compute/v2.1/servers/bace4c1a-2c38-42b3-962d-ca87a3bfb7ba/os-volume_attachments => generated 197 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:49:42.248207 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-43bfde63-37f1-4796-8363-41df11bc6e72 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:42.253255 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-43bfde63-37f1-4796-8363-41df11bc6e72 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:42.254033 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-43bfde63-37f1-4796-8363-41df11bc6e72 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:42.258094 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-43bfde63-37f1-4796-8363-41df11bc6e72 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:42.259224 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0324c8c3-e154-4f88-893a-eb345fbd1dab tempest-ImagesMetadataTestJSON-1420798859 tempest-ImagesMetadataTestJSON-1420798859-project] Action: 'update', calling method: .version_select at 0x7f68e44bb550>, body: {"meta": {"os_version": "alt"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:49:42.261217 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-43bfde63-37f1-4796-8363-41df11bc6e72 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:42.263409 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-43bfde63-37f1-4796-8363-41df11bc6e72 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:42.321887 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-43bfde63-37f1-4796-8363-41df11bc6e72 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Getting quotas for project 63eba712ae82439ba53b37b774c332dd. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:49:42.335981 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-43bfde63-37f1-4796-8363-41df11bc6e72 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Getting quotas for user 8f58dabb2db74cedba25f856ad1a7df2 and project 63eba712ae82439ba53b37b774c332dd. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:49:42.396603 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-43bfde63-37f1-4796-8363-41df11bc6e72 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:49:42.405695 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-43bfde63-37f1-4796-8363-41df11bc6e72 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] [instance: e522775b-9d4f-4fee-beaa-61e1b0452ead] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:49:42.426382 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-0324c8c3-e154-4f88-893a-eb345fbd1dab tempest-ImagesMetadataTestJSON-1420798859 tempest-ImagesMetadataTestJSON-1420798859-project] Getting quotas for project b0e84d29c8aa49cda40ae42b9b77b3ec. Resources: dict_keys(['metadata_items']) {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:49:42.452207 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-0324c8c3-e154-4f88-893a-eb345fbd1dab tempest-ImagesMetadataTestJSON-1420798859 tempest-ImagesMetadataTestJSON-1420798859-project] Getting quotas for user d80fe45bec844d379724d192040fc3fe and project b0e84d29c8aa49cda40ae42b9b77b3ec. Resources: dict_keys(['metadata_items']) {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:49:42.468826 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:49:42.540144 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-43bfde63-37f1-4796-8363-41df11bc6e72 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 3.473922 Sep 08 10:49:42.548255 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1360/2764] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:49:39 2022] POST /compute/v2.1/servers => generated 408 bytes in 3478 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:49:42.556295 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7691f6e8-490f-44d1-b438-fd9b1533284a tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:42.557017 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7691f6e8-490f-44d1-b438-fd9b1533284a tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:42.575943 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7691f6e8-490f-44d1-b438-fd9b1533284a tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:42.577585 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7691f6e8-490f-44d1-b438-fd9b1533284a tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:42.578050 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7691f6e8-490f-44d1-b438-fd9b1533284a tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:42.579201 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7691f6e8-490f-44d1-b438-fd9b1533284a tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:42.581369 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7691f6e8-490f-44d1-b438-fd9b1533284a tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:42.581902 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7691f6e8-490f-44d1-b438-fd9b1533284a tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:42.828715 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7691f6e8-490f-44d1-b438-fd9b1533284a tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:42.863901 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7691f6e8-490f-44d1-b438-fd9b1533284a tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:42.865993 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7691f6e8-490f-44d1-b438-fd9b1533284a tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:42.892844 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7691f6e8-490f-44d1-b438-fd9b1533284a tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1555 microversion: 2.91 time: 0.350472 Sep 08 10:49:42.898610 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1361/2765] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:49:42 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1555 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:49:42.944237 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4a2a5479-60fc-4ddb-8c86-235798b775b2 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:42.954722 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4a2a5479-60fc-4ddb-8c86-235798b775b2 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] [instance: e522775b-9d4f-4fee-beaa-61e1b0452ead] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:43.236258 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4a2a5479-60fc-4ddb-8c86-235798b775b2 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f58dabb2db74cedba25f856ad1a7df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63eba712ae82439ba53b37b774c332dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:43.249112 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4a2a5479-60fc-4ddb-8c86-235798b775b2 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] 10.222.0.27 "GET /compute/v2.1/servers/e522775b-9d4f-4fee-beaa-61e1b0452ead" status: 200 len: 1226 microversion: 2.1 time: 0.318674 Sep 08 10:49:43.252879 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1362/2766] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:42 2022] GET /compute/v2.1/servers/e522775b-9d4f-4fee-beaa-61e1b0452ead => generated 1226 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:43.267840 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8dcd7ce3-007c-4122-aaf4-710779e0f99f tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:43.282006 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8dcd7ce3-007c-4122-aaf4-710779e0f99f tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] [instance: f96451ab-896c-4652-8e89-ba210495b5e8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:43.303523 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8dcd7ce3-007c-4122-aaf4-710779e0f99f tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:43.305134 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8dcd7ce3-007c-4122-aaf4-710779e0f99f tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:43.312955 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8dcd7ce3-007c-4122-aaf4-710779e0f99f tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:43.316453 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8dcd7ce3-007c-4122-aaf4-710779e0f99f tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:43.322703 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8dcd7ce3-007c-4122-aaf4-710779e0f99f tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:43.326407 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8dcd7ce3-007c-4122-aaf4-710779e0f99f tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:43.397583 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0324c8c3-e154-4f88-893a-eb345fbd1dab tempest-ImagesMetadataTestJSON-1420798859 tempest-ImagesMetadataTestJSON-1420798859-project] 10.222.0.27 "PUT /compute/v2.1/images/8fcf886e-29a7-418a-98f3-6beb90dc5a0d/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 1.161979 Sep 08 10:49:43.398132 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1405/2767] 10.222.0.27 () {60 vars in 1313 bytes} [Thu Sep 8 10:49:42 2022] PUT /compute/v2.1/images/8fcf886e-29a7-418a-98f3-6beb90dc5a0d/metadata/os_version => generated 31 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:49:43.403250 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-573d5d37-9c04-4c50-9801-bbdeb8b2877e tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:43.426783 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-573d5d37-9c04-4c50-9801-bbdeb8b2877e tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: bace4c1a-2c38-42b3-962d-ca87a3bfb7ba] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:43.447978 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-573d5d37-9c04-4c50-9801-bbdeb8b2877e tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:43.450717 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-573d5d37-9c04-4c50-9801-bbdeb8b2877e tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:43.451531 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-573d5d37-9c04-4c50-9801-bbdeb8b2877e tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:43.453442 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-573d5d37-9c04-4c50-9801-bbdeb8b2877e tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:43.455060 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-573d5d37-9c04-4c50-9801-bbdeb8b2877e tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:43.460341 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-573d5d37-9c04-4c50-9801-bbdeb8b2877e tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:43.632574 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-573d5d37-9c04-4c50-9801-bbdeb8b2877e tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/bace4c1a-2c38-42b3-962d-ca87a3bfb7ba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.228014 Sep 08 10:49:43.643757 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1406/2768] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 10:49:43 2022] GET /compute/v2.1/servers/bace4c1a-2c38-42b3-962d-ca87a3bfb7ba/os-volume_attachments => generated 197 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:49:43.658685 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8dcd7ce3-007c-4122-aaf4-710779e0f99f tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0c66b5a004df886b3d973a978c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc5f459e4a143d1b8bf1c5c64153644', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:43.675976 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5dc6344b-5414-4df1-92e2-e58d3419e83f tempest-ImagesMetadataTestJSON-1420798859 tempest-ImagesMetadataTestJSON-1420798859-project] Calling method '.version_select at 0x7f68e49b9670>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:43.678476 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8dcd7ce3-007c-4122-aaf4-710779e0f99f tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] 10.222.0.27 "GET /compute/v2.1/servers/f96451ab-896c-4652-8e89-ba210495b5e8" status: 200 len: 1278 microversion: 2.1 time: 0.418101 Sep 08 10:49:43.697565 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1363/2769] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:43 2022] GET /compute/v2.1/servers/f96451ab-896c-4652-8e89-ba210495b5e8 => generated 1278 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:43.789545 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5dc6344b-5414-4df1-92e2-e58d3419e83f tempest-ImagesMetadataTestJSON-1420798859 tempest-ImagesMetadataTestJSON-1420798859-project] 10.222.0.27 "GET /compute/v2.1/images/8fcf886e-29a7-418a-98f3-6beb90dc5a0d/metadata" status: 200 len: 58 microversion: 2.1 time: 0.140886 Sep 08 10:49:43.796880 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1407/2770] 10.222.0.27 () {58 vars in 1260 bytes} [Thu Sep 8 10:49:43 2022] GET /compute/v2.1/images/8fcf886e-29a7-418a-98f3-6beb90dc5a0d/metadata => generated 58 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:49:43.807806 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-630aba4c-dca7-4074-a205-1d17cb78f6ec tempest-ImagesMetadataTestJSON-1420798859 tempest-ImagesMetadataTestJSON-1420798859-project] Action: 'update_all', calling method: .version_select at 0x7f68e44fb3a0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:49:43.937662 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-43ca71ef-ab02-41eb-ad59-643978d5d2bb tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:43.938355 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-43ca71ef-ab02-41eb-ad59-643978d5d2bb tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:43.957906 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-43ca71ef-ab02-41eb-ad59-643978d5d2bb tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:43.966381 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-43ca71ef-ab02-41eb-ad59-643978d5d2bb tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:43.976508 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-43ca71ef-ab02-41eb-ad59-643978d5d2bb tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:43.978872 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-43ca71ef-ab02-41eb-ad59-643978d5d2bb tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:43.979513 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-43ca71ef-ab02-41eb-ad59-643978d5d2bb tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:43.980111 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-43ca71ef-ab02-41eb-ad59-643978d5d2bb tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:43.994662 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-630aba4c-dca7-4074-a205-1d17cb78f6ec tempest-ImagesMetadataTestJSON-1420798859 tempest-ImagesMetadataTestJSON-1420798859-project] Getting quotas for project b0e84d29c8aa49cda40ae42b9b77b3ec. Resources: dict_keys(['metadata_items']) {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:49:44.009759 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-630aba4c-dca7-4074-a205-1d17cb78f6ec tempest-ImagesMetadataTestJSON-1420798859 tempest-ImagesMetadataTestJSON-1420798859-project] Getting quotas for user d80fe45bec844d379724d192040fc3fe and project b0e84d29c8aa49cda40ae42b9b77b3ec. Resources: dict_keys(['metadata_items']) {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:49:44.532419 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-43ca71ef-ab02-41eb-ad59-643978d5d2bb tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:44.545833 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-43ca71ef-ab02-41eb-ad59-643978d5d2bb tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:44.551499 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-43ca71ef-ab02-41eb-ad59-643978d5d2bb tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:44.576642 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-43ca71ef-ab02-41eb-ad59-643978d5d2bb tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1555 microversion: 2.91 time: 0.644113 Sep 08 10:49:44.602485 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1408/2771] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:49:43 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1555 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:49:44.628121 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d8c7437b-4c71-4894-a35d-933b0249d510 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:44.637086 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d8c7437b-4c71-4894-a35d-933b0249d510 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] [instance: e522775b-9d4f-4fee-beaa-61e1b0452ead] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:44.676180 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d8c7437b-4c71-4894-a35d-933b0249d510 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:44.677823 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d8c7437b-4c71-4894-a35d-933b0249d510 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:44.679993 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d8c7437b-4c71-4894-a35d-933b0249d510 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:44.685761 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d8c7437b-4c71-4894-a35d-933b0249d510 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:44.687836 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d8c7437b-4c71-4894-a35d-933b0249d510 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:44.691344 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d8c7437b-4c71-4894-a35d-933b0249d510 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:44.995502 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-630aba4c-dca7-4074-a205-1d17cb78f6ec tempest-ImagesMetadataTestJSON-1420798859 tempest-ImagesMetadataTestJSON-1420798859-project] 10.222.0.27 "PUT /compute/v2.1/images/8fcf886e-29a7-418a-98f3-6beb90dc5a0d/metadata" status: 200 len: 61 microversion: 2.1 time: 1.197355 Sep 08 10:49:44.997927 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1364/2772] 10.222.0.27 () {60 vars in 1280 bytes} [Thu Sep 8 10:49:43 2022] PUT /compute/v2.1/images/8fcf886e-29a7-418a-98f3-6beb90dc5a0d/metadata => generated 61 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:49:45.003447 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-078cac28-cd2b-495f-b089-f804442f069e tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:45.009985 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-078cac28-cd2b-495f-b089-f804442f069e tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: bace4c1a-2c38-42b3-962d-ca87a3bfb7ba] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:45.031784 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-078cac28-cd2b-495f-b089-f804442f069e tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:45.035801 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-078cac28-cd2b-495f-b089-f804442f069e tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:45.040446 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-078cac28-cd2b-495f-b089-f804442f069e tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:45.044396 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-078cac28-cd2b-495f-b089-f804442f069e tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:45.045260 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-078cac28-cd2b-495f-b089-f804442f069e tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:45.045874 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-078cac28-cd2b-495f-b089-f804442f069e tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:45.135446 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d8c7437b-4c71-4894-a35d-933b0249d510 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f58dabb2db74cedba25f856ad1a7df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63eba712ae82439ba53b37b774c332dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:45.153576 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-078cac28-cd2b-495f-b089-f804442f069e tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/bace4c1a-2c38-42b3-962d-ca87a3bfb7ba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.154322 Sep 08 10:49:45.155491 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1365/2773] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 10:49:44 2022] GET /compute/v2.1/servers/bace4c1a-2c38-42b3-962d-ca87a3bfb7ba/os-volume_attachments => generated 197 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:49:45.161462 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d8c7437b-4c71-4894-a35d-933b0249d510 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] 10.222.0.27 "GET /compute/v2.1/servers/e522775b-9d4f-4fee-beaa-61e1b0452ead" status: 200 len: 1222 microversion: 2.1 time: 0.557653 Sep 08 10:49:45.166168 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1409/2774] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:44 2022] GET /compute/v2.1/servers/e522775b-9d4f-4fee-beaa-61e1b0452ead => generated 1222 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:45.167146 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-687a20ec-8d56-4e4c-a9ef-5d2b1281029f tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:45.169161 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-687a20ec-8d56-4e4c-a9ef-5d2b1281029f tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] [instance: f96451ab-896c-4652-8e89-ba210495b5e8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:45.181189 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-28c7a0dd-add3-4632-979f-410e9683d462 tempest-ImagesMetadataTestJSON-1420798859 tempest-ImagesMetadataTestJSON-1420798859-project] Action: 'create', calling method: .version_select at 0x7f68e8acf3a0>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:49:45.182734 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-687a20ec-8d56-4e4c-a9ef-5d2b1281029f tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:45.184270 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-687a20ec-8d56-4e4c-a9ef-5d2b1281029f tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:45.189454 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-687a20ec-8d56-4e4c-a9ef-5d2b1281029f tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:45.190527 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-687a20ec-8d56-4e4c-a9ef-5d2b1281029f tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:45.191241 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-687a20ec-8d56-4e4c-a9ef-5d2b1281029f tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:45.191923 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-687a20ec-8d56-4e4c-a9ef-5d2b1281029f tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:45.344316 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-28c7a0dd-add3-4632-979f-410e9683d462 tempest-ImagesMetadataTestJSON-1420798859 tempest-ImagesMetadataTestJSON-1420798859-project] Getting quotas for project b0e84d29c8aa49cda40ae42b9b77b3ec. Resources: dict_keys(['metadata_items']) {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:49:45.384743 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-28c7a0dd-add3-4632-979f-410e9683d462 tempest-ImagesMetadataTestJSON-1420798859 tempest-ImagesMetadataTestJSON-1420798859-project] Getting quotas for user d80fe45bec844d379724d192040fc3fe and project b0e84d29c8aa49cda40ae42b9b77b3ec. Resources: dict_keys(['metadata_items']) {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:49:45.546993 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:49:46.133693 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-28c7a0dd-add3-4632-979f-410e9683d462 tempest-ImagesMetadataTestJSON-1420798859 tempest-ImagesMetadataTestJSON-1420798859-project] 10.222.0.27 "POST /compute/v2.1/images/8fcf886e-29a7-418a-98f3-6beb90dc5a0d/metadata" status: 200 len: 85 microversion: 2.1 time: 0.966075 Sep 08 10:49:46.141208 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1410/2775] 10.222.0.27 () {60 vars in 1281 bytes} [Thu Sep 8 10:49:45 2022] POST /compute/v2.1/images/8fcf886e-29a7-418a-98f3-6beb90dc5a0d/metadata => generated 85 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:49:46.160250 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ed3ae9d7-bc69-4f8a-a7ee-d30979a24a67 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:46.164630 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ed3ae9d7-bc69-4f8a-a7ee-d30979a24a67 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:46.187140 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ed3ae9d7-bc69-4f8a-a7ee-d30979a24a67 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:46.187963 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ed3ae9d7-bc69-4f8a-a7ee-d30979a24a67 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:46.189639 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ed3ae9d7-bc69-4f8a-a7ee-d30979a24a67 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:46.191290 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ed3ae9d7-bc69-4f8a-a7ee-d30979a24a67 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:46.197554 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ed3ae9d7-bc69-4f8a-a7ee-d30979a24a67 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:46.198264 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ed3ae9d7-bc69-4f8a-a7ee-d30979a24a67 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:46.479987 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ed3ae9d7-bc69-4f8a-a7ee-d30979a24a67 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:46.489787 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-687a20ec-8d56-4e4c-a9ef-5d2b1281029f tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0c66b5a004df886b3d973a978c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc5f459e4a143d1b8bf1c5c64153644', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:46.494496 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:49:46.514214 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ed3ae9d7-bc69-4f8a-a7ee-d30979a24a67 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:46.520318 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-687a20ec-8d56-4e4c-a9ef-5d2b1281029f tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] 10.222.0.27 "GET /compute/v2.1/servers/f96451ab-896c-4652-8e89-ba210495b5e8" status: 200 len: 1278 microversion: 2.1 time: 1.363454 Sep 08 10:49:46.522940 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1366/2776] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:45 2022] GET /compute/v2.1/servers/f96451ab-896c-4652-8e89-ba210495b5e8 => generated 1278 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:46.540594 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ed3ae9d7-bc69-4f8a-a7ee-d30979a24a67 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:46.546065 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c51840f6-9b6d-47b1-bdcc-0b2ea13458cd tempest-ImagesMetadataTestJSON-1420798859 tempest-ImagesMetadataTestJSON-1420798859-project] Calling method '.version_select at 0x7f68e4e0f790>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:46.558734 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ed3ae9d7-bc69-4f8a-a7ee-d30979a24a67 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1555 microversion: 2.91 time: 0.415734 Sep 08 10:49:46.559344 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1411/2777] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:49:46 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1555 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:49:46.588053 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3c7a7082-4bf8-46a3-92b9-3732ad62aff9 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:46.594662 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3c7a7082-4bf8-46a3-92b9-3732ad62aff9 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: bace4c1a-2c38-42b3-962d-ca87a3bfb7ba] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:46.619602 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c7a7082-4bf8-46a3-92b9-3732ad62aff9 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:46.626120 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c7a7082-4bf8-46a3-92b9-3732ad62aff9 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:46.629890 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c7a7082-4bf8-46a3-92b9-3732ad62aff9 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:46.631180 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c7a7082-4bf8-46a3-92b9-3732ad62aff9 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:46.635550 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c7a7082-4bf8-46a3-92b9-3732ad62aff9 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:46.639865 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c7a7082-4bf8-46a3-92b9-3732ad62aff9 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:46.669983 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c51840f6-9b6d-47b1-bdcc-0b2ea13458cd tempest-ImagesMetadataTestJSON-1420798859 tempest-ImagesMetadataTestJSON-1420798859-project] 10.222.0.27 "GET /compute/v2.1/images/8fcf886e-29a7-418a-98f3-6beb90dc5a0d/metadata" status: 200 len: 85 microversion: 2.1 time: 0.144543 Sep 08 10:49:46.671365 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1367/2778] 10.222.0.27 () {58 vars in 1260 bytes} [Thu Sep 8 10:49:46 2022] GET /compute/v2.1/images/8fcf886e-29a7-418a-98f3-6beb90dc5a0d/metadata => generated 85 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:49:46.681935 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-356b1081-169a-4e62-8129-2a6d97b4705a tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:46.685342 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-356b1081-169a-4e62-8129-2a6d97b4705a tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] [instance: e522775b-9d4f-4fee-beaa-61e1b0452ead] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:46.698185 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-356b1081-169a-4e62-8129-2a6d97b4705a tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:46.703751 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-356b1081-169a-4e62-8129-2a6d97b4705a tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:46.704610 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-356b1081-169a-4e62-8129-2a6d97b4705a tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:46.705871 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-356b1081-169a-4e62-8129-2a6d97b4705a tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:46.706591 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-356b1081-169a-4e62-8129-2a6d97b4705a tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:46.707465 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-356b1081-169a-4e62-8129-2a6d97b4705a tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:46.757226 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3c7a7082-4bf8-46a3-92b9-3732ad62aff9 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/bace4c1a-2c38-42b3-962d-ca87a3bfb7ba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.178095 Sep 08 10:49:46.761598 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1412/2779] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 10:49:46 2022] GET /compute/v2.1/servers/bace4c1a-2c38-42b3-962d-ca87a3bfb7ba/os-volume_attachments => generated 197 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:49:46.899157 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-356b1081-169a-4e62-8129-2a6d97b4705a tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f58dabb2db74cedba25f856ad1a7df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63eba712ae82439ba53b37b774c332dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:46.932362 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-356b1081-169a-4e62-8129-2a6d97b4705a tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] 10.222.0.27 "GET /compute/v2.1/servers/e522775b-9d4f-4fee-beaa-61e1b0452ead" status: 200 len: 1278 microversion: 2.1 time: 0.259574 Sep 08 10:49:46.940137 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1368/2780] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:46 2022] GET /compute/v2.1/servers/e522775b-9d4f-4fee-beaa-61e1b0452ead => generated 1278 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:47.550858 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9ea83a95-b8dc-4a17-9b96-c77204c4e447 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:47.551750 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9ea83a95-b8dc-4a17-9b96-c77204c4e447 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] [instance: f96451ab-896c-4652-8e89-ba210495b5e8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:47.573545 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9ea83a95-b8dc-4a17-9b96-c77204c4e447 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:47.578065 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9ea83a95-b8dc-4a17-9b96-c77204c4e447 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:47.579573 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9ea83a95-b8dc-4a17-9b96-c77204c4e447 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:47.589180 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9ea83a95-b8dc-4a17-9b96-c77204c4e447 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:47.596534 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9ea83a95-b8dc-4a17-9b96-c77204c4e447 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:47.597426 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9ea83a95-b8dc-4a17-9b96-c77204c4e447 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:47.606375 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-eed1f001-2374-4f51-8bea-b0781a67c6cb tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:47.607973 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-eed1f001-2374-4f51-8bea-b0781a67c6cb tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:47.623839 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eed1f001-2374-4f51-8bea-b0781a67c6cb tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:47.624438 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eed1f001-2374-4f51-8bea-b0781a67c6cb tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:47.624879 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eed1f001-2374-4f51-8bea-b0781a67c6cb tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:47.631336 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eed1f001-2374-4f51-8bea-b0781a67c6cb tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:47.632116 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eed1f001-2374-4f51-8bea-b0781a67c6cb tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:47.632572 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eed1f001-2374-4f51-8bea-b0781a67c6cb tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:47.867847 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-eed1f001-2374-4f51-8bea-b0781a67c6cb tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:47.886121 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-eed1f001-2374-4f51-8bea-b0781a67c6cb tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:47.898923 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-eed1f001-2374-4f51-8bea-b0781a67c6cb tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:47.924904 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-eed1f001-2374-4f51-8bea-b0781a67c6cb tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1555 microversion: 2.91 time: 0.322863 Sep 08 10:49:47.937154 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1369/2781] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:49:47 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1555 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:49:47.945607 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-76aa056c-04a8-41dc-a798-31e148f98417 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:47.950037 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-76aa056c-04a8-41dc-a798-31e148f98417 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: bace4c1a-2c38-42b3-962d-ca87a3bfb7ba] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:47.978380 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-76aa056c-04a8-41dc-a798-31e148f98417 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:47.979234 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-76aa056c-04a8-41dc-a798-31e148f98417 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:47.980208 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-76aa056c-04a8-41dc-a798-31e148f98417 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:47.981339 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-76aa056c-04a8-41dc-a798-31e148f98417 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:47.983691 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-76aa056c-04a8-41dc-a798-31e148f98417 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:47.985369 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-76aa056c-04a8-41dc-a798-31e148f98417 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:47.987260 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9ea83a95-b8dc-4a17-9b96-c77204c4e447 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0c66b5a004df886b3d973a978c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc5f459e4a143d1b8bf1c5c64153644', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:48.006313 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9ea83a95-b8dc-4a17-9b96-c77204c4e447 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] 10.222.0.27 "GET /compute/v2.1/servers/f96451ab-896c-4652-8e89-ba210495b5e8" status: 200 len: 1320 microversion: 2.1 time: 0.458089 Sep 08 10:49:48.008912 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1413/2782] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:47 2022] GET /compute/v2.1/servers/f96451ab-896c-4652-8e89-ba210495b5e8 => generated 1320 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:48.043169 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-71c202ce-308d-4c7b-b57a-89d000523cfd tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:48.046124 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-71c202ce-308d-4c7b-b57a-89d000523cfd tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] [instance: e522775b-9d4f-4fee-beaa-61e1b0452ead] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:48.058622 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71c202ce-308d-4c7b-b57a-89d000523cfd tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:48.059719 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71c202ce-308d-4c7b-b57a-89d000523cfd tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:48.060852 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71c202ce-308d-4c7b-b57a-89d000523cfd tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:48.062384 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71c202ce-308d-4c7b-b57a-89d000523cfd tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:48.063143 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71c202ce-308d-4c7b-b57a-89d000523cfd tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:48.063859 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71c202ce-308d-4c7b-b57a-89d000523cfd tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:48.119677 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-76aa056c-04a8-41dc-a798-31e148f98417 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/bace4c1a-2c38-42b3-962d-ca87a3bfb7ba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.181020 Sep 08 10:49:48.120617 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1370/2783] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 10:49:47 2022] GET /compute/v2.1/servers/bace4c1a-2c38-42b3-962d-ca87a3bfb7ba/os-volume_attachments => generated 197 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:49:48.281841 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-71c202ce-308d-4c7b-b57a-89d000523cfd tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f58dabb2db74cedba25f856ad1a7df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63eba712ae82439ba53b37b774c332dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:48.318568 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-71c202ce-308d-4c7b-b57a-89d000523cfd tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] 10.222.0.27 "GET /compute/v2.1/servers/e522775b-9d4f-4fee-beaa-61e1b0452ead" status: 200 len: 1284 microversion: 2.1 time: 0.307064 Sep 08 10:49:48.321130 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1414/2784] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:48 2022] GET /compute/v2.1/servers/e522775b-9d4f-4fee-beaa-61e1b0452ead => generated 1284 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:48.962595 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5d9a882f-12b8-4666-8666-1e262abe3734 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:48.963360 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5d9a882f-12b8-4666-8666-1e262abe3734 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:48.998712 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5d9a882f-12b8-4666-8666-1e262abe3734 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:48.999259 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5d9a882f-12b8-4666-8666-1e262abe3734 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:48.999735 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5d9a882f-12b8-4666-8666-1e262abe3734 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:49.007639 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5d9a882f-12b8-4666-8666-1e262abe3734 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:49.008340 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5d9a882f-12b8-4666-8666-1e262abe3734 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:49.008848 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5d9a882f-12b8-4666-8666-1e262abe3734 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:49.038308 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c71b48d3-a4af-46f4-b4ec-b3756fc234d1 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:49.039048 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c71b48d3-a4af-46f4-b4ec-b3756fc234d1 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] [instance: f96451ab-896c-4652-8e89-ba210495b5e8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:49.072140 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c71b48d3-a4af-46f4-b4ec-b3756fc234d1 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:49.072648 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c71b48d3-a4af-46f4-b4ec-b3756fc234d1 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:49.073104 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c71b48d3-a4af-46f4-b4ec-b3756fc234d1 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:49.082193 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c71b48d3-a4af-46f4-b4ec-b3756fc234d1 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:49.082728 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c71b48d3-a4af-46f4-b4ec-b3756fc234d1 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:49.086760 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c71b48d3-a4af-46f4-b4ec-b3756fc234d1 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:49.418472 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c71b48d3-a4af-46f4-b4ec-b3756fc234d1 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0c66b5a004df886b3d973a978c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc5f459e4a143d1b8bf1c5c64153644', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:49.428052 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c71b48d3-a4af-46f4-b4ec-b3756fc234d1 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] 10.222.0.27 "GET /compute/v2.1/servers/f96451ab-896c-4652-8e89-ba210495b5e8" status: 200 len: 1320 microversion: 2.1 time: 0.395661 Sep 08 10:49:49.446174 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1415/2785] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:49 2022] GET /compute/v2.1/servers/f96451ab-896c-4652-8e89-ba210495b5e8 => generated 1320 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:49.453345 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ab50403b-3e54-4b44-a394-4ba89bbf9548 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:49.465417 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ab50403b-3e54-4b44-a394-4ba89bbf9548 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: bace4c1a-2c38-42b3-962d-ca87a3bfb7ba] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:49.491610 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab50403b-3e54-4b44-a394-4ba89bbf9548 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:49.492135 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab50403b-3e54-4b44-a394-4ba89bbf9548 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:49.492565 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab50403b-3e54-4b44-a394-4ba89bbf9548 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:49.493315 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab50403b-3e54-4b44-a394-4ba89bbf9548 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:49.493778 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab50403b-3e54-4b44-a394-4ba89bbf9548 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:49.494207 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab50403b-3e54-4b44-a394-4ba89bbf9548 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:49.537371 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5d9a882f-12b8-4666-8666-1e262abe3734 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:49.549354 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ab50403b-3e54-4b44-a394-4ba89bbf9548 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/bace4c1a-2c38-42b3-962d-ca87a3bfb7ba/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.101675 Sep 08 10:49:49.551617 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5d9a882f-12b8-4666-8666-1e262abe3734 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:49.552789 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5d9a882f-12b8-4666-8666-1e262abe3734 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:49.556004 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1416/2786] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 10:49:49 2022] GET /compute/v2.1/servers/bace4c1a-2c38-42b3-962d-ca87a3bfb7ba/os-volume_attachments => generated 25 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:49:49.561856 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f647eeca-f2f6-437d-9b45-21d99a92ed7d tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:49.562654 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f647eeca-f2f6-437d-9b45-21d99a92ed7d tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] [instance: e522775b-9d4f-4fee-beaa-61e1b0452ead] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:49.571201 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f647eeca-f2f6-437d-9b45-21d99a92ed7d tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:49.571939 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f647eeca-f2f6-437d-9b45-21d99a92ed7d tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:49.572538 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f647eeca-f2f6-437d-9b45-21d99a92ed7d tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:49.573478 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f647eeca-f2f6-437d-9b45-21d99a92ed7d tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:49.574097 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f647eeca-f2f6-437d-9b45-21d99a92ed7d tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:49.574687 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f647eeca-f2f6-437d-9b45-21d99a92ed7d tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:49.578178 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:49:49.581379 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5d9a882f-12b8-4666-8666-1e262abe3734 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1555 microversion: 2.91 time: 0.627258 Sep 08 10:49:49.582014 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1371/2787] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:49:48 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1555 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:49:49.713611 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0ceb8180-79e8-43bf-a319-d0df171f43c8 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:49.713978 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0ceb8180-79e8-43bf-a319-d0df171f43c8 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: bace4c1a-2c38-42b3-962d-ca87a3bfb7ba] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:49.736558 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0ceb8180-79e8-43bf-a319-d0df171f43c8 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:49.739056 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0ceb8180-79e8-43bf-a319-d0df171f43c8 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:49.742272 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0ceb8180-79e8-43bf-a319-d0df171f43c8 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:49.746554 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0ceb8180-79e8-43bf-a319-d0df171f43c8 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:49.748673 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0ceb8180-79e8-43bf-a319-d0df171f43c8 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:49.749797 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0ceb8180-79e8-43bf-a319-d0df171f43c8 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:49.871436 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0ceb8180-79e8-43bf-a319-d0df171f43c8 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: bace4c1a-2c38-42b3-962d-ca87a3bfb7ba] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:49:50.135221 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0ceb8180-79e8-43bf-a319-d0df171f43c8 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "DELETE /compute/v2.1/servers/bace4c1a-2c38-42b3-962d-ca87a3bfb7ba" status: 204 len: 0 microversion: 2.1 time: 0.427585 Sep 08 10:49:50.142038 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1372/2788] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:49:49 2022] DELETE /compute/v2.1/servers/bace4c1a-2c38-42b3-962d-ca87a3bfb7ba => generated 0 bytes in 432 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 10:49:50.167712 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-a1dbbba6-e07e-4319-9bd2-e46a4be81c66 req-fa383dc9-8898-4650-88cc-16097cbbf4d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ef65322-ccb1-4703-b15f-4ab8306b32de", "tag": "01beadcd-0dc7-47e2-9884-a66d9958f0e8"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:49:50.190956 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-a1dbbba6-e07e-4319-9bd2-e46a4be81c66 req-fa383dc9-8898-4650-88cc-16097cbbf4d4 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:50.191305 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-a1dbbba6-e07e-4319-9bd2-e46a4be81c66 req-fa383dc9-8898-4650-88cc-16097cbbf4d4 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:50.191741 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-a1dbbba6-e07e-4319-9bd2-e46a4be81c66 req-fa383dc9-8898-4650-88cc-16097cbbf4d4 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:50.205058 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-a1dbbba6-e07e-4319-9bd2-e46a4be81c66 req-fa383dc9-8898-4650-88cc-16097cbbf4d4 service nova] Creating event network-changed:01beadcd-0dc7-47e2-9884-a66d9958f0e8 for instance 7ef65322-ccb1-4703-b15f-4ab8306b32de on n-h2-850501-12 Sep 08 10:49:50.211796 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-a1dbbba6-e07e-4319-9bd2-e46a4be81c66 req-fa383dc9-8898-4650-88cc-16097cbbf4d4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070499 Sep 08 10:49:50.212847 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1373/2789] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:49:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:49:50.220283 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bfb949fe-987b-4ae5-bfec-87a92c8520ae tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:50.221500 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bfb949fe-987b-4ae5-bfec-87a92c8520ae tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: bace4c1a-2c38-42b3-962d-ca87a3bfb7ba] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:50.230263 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bfb949fe-987b-4ae5-bfec-87a92c8520ae tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:50.230796 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bfb949fe-987b-4ae5-bfec-87a92c8520ae tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:50.231497 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bfb949fe-987b-4ae5-bfec-87a92c8520ae tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:50.241909 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bfb949fe-987b-4ae5-bfec-87a92c8520ae tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:50.245360 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bfb949fe-987b-4ae5-bfec-87a92c8520ae tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:50.246355 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bfb949fe-987b-4ae5-bfec-87a92c8520ae tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:50.330172 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f647eeca-f2f6-437d-9b45-21d99a92ed7d tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f58dabb2db74cedba25f856ad1a7df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63eba712ae82439ba53b37b774c332dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:50.349364 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f647eeca-f2f6-437d-9b45-21d99a92ed7d tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] 10.222.0.27 "GET /compute/v2.1/servers/e522775b-9d4f-4fee-beaa-61e1b0452ead" status: 200 len: 1351 microversion: 2.1 time: 0.791195 Sep 08 10:49:50.357671 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1417/2790] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:49 2022] GET /compute/v2.1/servers/e522775b-9d4f-4fee-beaa-61e1b0452ead => generated 1351 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:50.463723 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-34ec3efc-ef3a-40f5-b0cb-02705d9ad796 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:50.464814 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-34ec3efc-ef3a-40f5-b0cb-02705d9ad796 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] [instance: f96451ab-896c-4652-8e89-ba210495b5e8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:50.479525 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-34ec3efc-ef3a-40f5-b0cb-02705d9ad796 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:50.480028 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-34ec3efc-ef3a-40f5-b0cb-02705d9ad796 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:50.480462 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-34ec3efc-ef3a-40f5-b0cb-02705d9ad796 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:50.481522 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-34ec3efc-ef3a-40f5-b0cb-02705d9ad796 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:50.482308 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-34ec3efc-ef3a-40f5-b0cb-02705d9ad796 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:50.483156 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-34ec3efc-ef3a-40f5-b0cb-02705d9ad796 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:50.497449 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:49:50.940739 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-bfb949fe-987b-4ae5-bfec-87a92c8520ae tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c291cbe955b4ee5abc98132dda0255e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f9a24cad014d7f827e8f3236dd5bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:50.953072 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bfb949fe-987b-4ae5-bfec-87a92c8520ae tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/bace4c1a-2c38-42b3-962d-ca87a3bfb7ba" status: 200 len: 1680 microversion: 2.1 time: 0.738911 Sep 08 10:49:50.953929 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1374/2791] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:50 2022] GET /compute/v2.1/servers/bace4c1a-2c38-42b3-962d-ca87a3bfb7ba => generated 1680 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:50.959842 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-314f40fd-5232-4dfe-a550-cd8d9c91f771 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:50.960701 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-314f40fd-5232-4dfe-a550-cd8d9c91f771 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:50.967409 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-314f40fd-5232-4dfe-a550-cd8d9c91f771 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:50.968207 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-314f40fd-5232-4dfe-a550-cd8d9c91f771 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:50.968854 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-314f40fd-5232-4dfe-a550-cd8d9c91f771 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:50.969815 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-314f40fd-5232-4dfe-a550-cd8d9c91f771 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:50.970479 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-314f40fd-5232-4dfe-a550-cd8d9c91f771 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:50.971173 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-314f40fd-5232-4dfe-a550-cd8d9c91f771 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:51.138049 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-314f40fd-5232-4dfe-a550-cd8d9c91f771 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:51.159664 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-314f40fd-5232-4dfe-a550-cd8d9c91f771 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:51.166143 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-314f40fd-5232-4dfe-a550-cd8d9c91f771 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:51.185051 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-314f40fd-5232-4dfe-a550-cd8d9c91f771 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1555 microversion: 2.91 time: 0.228441 Sep 08 10:49:51.186106 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1375/2792] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:49:50 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1555 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:49:51.195122 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2a8d89bc-f45f-41e9-8636-88533b690782 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:51.209009 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2a8d89bc-f45f-41e9-8636-88533b690782 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '54fb4a7dae3346d39f70c51055cfd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065d7179ebd6460cb039bd1624296b57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:51.211940 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2a8d89bc-f45f-41e9-8636-88533b690782 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Searching by: {'deleted': False, 'project_id': '065d7179ebd6460cb039bd1624296b57'} {{(pid=128861) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:49:51.217682 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-34ec3efc-ef3a-40f5-b0cb-02705d9ad796 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0c66b5a004df886b3d973a978c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc5f459e4a143d1b8bf1c5c64153644', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:51.220692 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2a8d89bc-f45f-41e9-8636-88533b690782 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:51.221585 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2a8d89bc-f45f-41e9-8636-88533b690782 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:51.222397 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2a8d89bc-f45f-41e9-8636-88533b690782 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:51.226233 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2a8d89bc-f45f-41e9-8636-88533b690782 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:51.227334 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2a8d89bc-f45f-41e9-8636-88533b690782 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:51.228284 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2a8d89bc-f45f-41e9-8636-88533b690782 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:51.242745 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-34ec3efc-ef3a-40f5-b0cb-02705d9ad796 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] 10.222.0.27 "GET /compute/v2.1/servers/f96451ab-896c-4652-8e89-ba210495b5e8" status: 200 len: 1320 microversion: 2.1 time: 0.772537 Sep 08 10:49:51.246464 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1418/2793] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:50 2022] GET /compute/v2.1/servers/f96451ab-896c-4652-8e89-ba210495b5e8 => generated 1320 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:49:51.307246 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.multi_cell_list [None req-2a8d89bc-f45f-41e9-8636-88533b690782 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128861) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 10:49:51.378418 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ce2e8658-bdc4-40d1-a37e-6e49c1e72f6e tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:51.379687 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ce2e8658-bdc4-40d1-a37e-6e49c1e72f6e tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] [instance: e522775b-9d4f-4fee-beaa-61e1b0452ead] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:51.387379 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2a8d89bc-f45f-41e9-8636-88533b690782 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.199456 Sep 08 10:49:51.387596 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ce2e8658-bdc4-40d1-a37e-6e49c1e72f6e tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:51.388070 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ce2e8658-bdc4-40d1-a37e-6e49c1e72f6e tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:51.388191 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1376/2794] 10.222.0.27 () {58 vars in 1125 bytes} [Thu Sep 8 10:49:51 2022] GET /compute/v2.1/servers => generated 340 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:49:51.388738 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ce2e8658-bdc4-40d1-a37e-6e49c1e72f6e tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:51.389498 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ce2e8658-bdc4-40d1-a37e-6e49c1e72f6e tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:51.391071 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ce2e8658-bdc4-40d1-a37e-6e49c1e72f6e tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:51.391071 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ce2e8658-bdc4-40d1-a37e-6e49c1e72f6e tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:51.402805 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4c2d0ec5-18d8-45d7-9c41-114dad2b9950 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:51.408035 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4c2d0ec5-18d8-45d7-9c41-114dad2b9950 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '54fb4a7dae3346d39f70c51055cfd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065d7179ebd6460cb039bd1624296b57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:51.413658 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4c2d0ec5-18d8-45d7-9c41-114dad2b9950 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Searching by: {'deleted': False, 'project_id': '065d7179ebd6460cb039bd1624296b57'} {{(pid=128861) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:49:51.424405 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4c2d0ec5-18d8-45d7-9c41-114dad2b9950 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:51.424405 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4c2d0ec5-18d8-45d7-9c41-114dad2b9950 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:51.424931 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4c2d0ec5-18d8-45d7-9c41-114dad2b9950 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:51.425800 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4c2d0ec5-18d8-45d7-9c41-114dad2b9950 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:51.426282 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4c2d0ec5-18d8-45d7-9c41-114dad2b9950 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:51.426840 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4c2d0ec5-18d8-45d7-9c41-114dad2b9950 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:51.500984 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.multi_cell_list [None req-4c2d0ec5-18d8-45d7-9c41-114dad2b9950 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128861) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 10:49:51.623098 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4c2d0ec5-18d8-45d7-9c41-114dad2b9950 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fb4a7dae3346d39f70c51055cfd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065d7179ebd6460cb039bd1624296b57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:51.634729 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4c2d0ec5-18d8-45d7-9c41-114dad2b9950 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:51.636124 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4c2d0ec5-18d8-45d7-9c41-114dad2b9950 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:51.637186 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4c2d0ec5-18d8-45d7-9c41-114dad2b9950 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:52.224241 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4c2d0ec5-18d8-45d7-9c41-114dad2b9950 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] 10.222.0.27 "GET /compute/v2.1/servers/detail" status: 200 len: 1712 microversion: 2.1 time: 0.825588 Sep 08 10:49:52.226400 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1377/2795] 10.222.0.27 () {58 vars in 1146 bytes} [Thu Sep 8 10:49:51 2022] GET /compute/v2.1/servers/detail => generated 1712 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:49:52.235757 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0be43020-6f27-4dbd-9ef6-5fde52acec6f tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:52.237823 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0be43020-6f27-4dbd-9ef6-5fde52acec6f tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: bace4c1a-2c38-42b3-962d-ca87a3bfb7ba] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:52.249944 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0be43020-6f27-4dbd-9ef6-5fde52acec6f tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:52.250708 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0be43020-6f27-4dbd-9ef6-5fde52acec6f tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:52.251789 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0be43020-6f27-4dbd-9ef6-5fde52acec6f tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:52.252821 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0be43020-6f27-4dbd-9ef6-5fde52acec6f tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:52.253535 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0be43020-6f27-4dbd-9ef6-5fde52acec6f tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:52.254190 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0be43020-6f27-4dbd-9ef6-5fde52acec6f tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:52.382078 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ce2e8658-bdc4-40d1-a37e-6e49c1e72f6e tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f58dabb2db74cedba25f856ad1a7df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63eba712ae82439ba53b37b774c332dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:52.408100 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ce2e8658-bdc4-40d1-a37e-6e49c1e72f6e tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] 10.222.0.27 "GET /compute/v2.1/servers/e522775b-9d4f-4fee-beaa-61e1b0452ead" status: 200 len: 1351 microversion: 2.1 time: 1.031705 Sep 08 10:49:52.422873 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1419/2796] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:51 2022] GET /compute/v2.1/servers/e522775b-9d4f-4fee-beaa-61e1b0452ead => generated 1351 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:49:52.437902 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dda97411-88be-4bf6-b16f-38a588841e82 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:52.439706 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-dda97411-88be-4bf6-b16f-38a588841e82 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:52.453368 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dda97411-88be-4bf6-b16f-38a588841e82 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:52.453877 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dda97411-88be-4bf6-b16f-38a588841e82 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:52.454323 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dda97411-88be-4bf6-b16f-38a588841e82 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:52.455054 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dda97411-88be-4bf6-b16f-38a588841e82 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:52.455521 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dda97411-88be-4bf6-b16f-38a588841e82 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:52.455951 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dda97411-88be-4bf6-b16f-38a588841e82 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:52.863678 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-dda97411-88be-4bf6-b16f-38a588841e82 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:52.905359 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-dda97411-88be-4bf6-b16f-38a588841e82 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:52.909081 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-dda97411-88be-4bf6-b16f-38a588841e82 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:52.927524 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-dda97411-88be-4bf6-b16f-38a588841e82 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1555 microversion: 2.91 time: 0.502618 Sep 08 10:49:52.935270 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1420/2797] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:49:52 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1555 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:49:52.951193 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3ce426fb-c327-41e7-950c-81351a215ae4 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:52.956922 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0be43020-6f27-4dbd-9ef6-5fde52acec6f tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c291cbe955b4ee5abc98132dda0255e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f9a24cad014d7f827e8f3236dd5bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:52.970663 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3ce426fb-c327-41e7-950c-81351a215ae4 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.033625 Sep 08 10:49:52.972363 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1421/2798] 10.222.0.27 () {58 vars in 1137 bytes} [Thu Sep 8 10:49:52 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:49:52.981859 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0be43020-6f27-4dbd-9ef6-5fde52acec6f tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/bace4c1a-2c38-42b3-962d-ca87a3bfb7ba" status: 200 len: 1680 microversion: 2.1 time: 0.746803 Sep 08 10:49:52.981859 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1378/2799] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:52 2022] GET /compute/v2.1/servers/bace4c1a-2c38-42b3-962d-ca87a3bfb7ba => generated 1680 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:52.985301 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-58f77ed1-9963-4535-a524-fcce6f9be8aa req-7c80ad35-ab62-41c1-9d8e-5af52b034585 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f96451ab-896c-4652-8e89-ba210495b5e8", "tag": "751325a8-3cbf-4a63-b10a-17bb26abb89f"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:49:52.988700 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1fa78c70-08f3-4746-bf74-395bcc24a9a7 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:52.989877 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1fa78c70-08f3-4746-bf74-395bcc24a9a7 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] [instance: f96451ab-896c-4652-8e89-ba210495b5e8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:52.997242 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1fa78c70-08f3-4746-bf74-395bcc24a9a7 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:52.998111 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1fa78c70-08f3-4746-bf74-395bcc24a9a7 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:52.998821 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1fa78c70-08f3-4746-bf74-395bcc24a9a7 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:52.999950 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1fa78c70-08f3-4746-bf74-395bcc24a9a7 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:53.000630 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1fa78c70-08f3-4746-bf74-395bcc24a9a7 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:53.001582 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1fa78c70-08f3-4746-bf74-395bcc24a9a7 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:53.039557 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-58f77ed1-9963-4535-a524-fcce6f9be8aa req-7c80ad35-ab62-41c1-9d8e-5af52b034585 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:53.040047 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-58f77ed1-9963-4535-a524-fcce6f9be8aa req-7c80ad35-ab62-41c1-9d8e-5af52b034585 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:53.040559 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-58f77ed1-9963-4535-a524-fcce6f9be8aa req-7c80ad35-ab62-41c1-9d8e-5af52b034585 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:53.088965 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-58f77ed1-9963-4535-a524-fcce6f9be8aa req-7c80ad35-ab62-41c1-9d8e-5af52b034585 service nova] Creating event network-changed:751325a8-3cbf-4a63-b10a-17bb26abb89f for instance f96451ab-896c-4652-8e89-ba210495b5e8 on n-h2-850501-12 Sep 08 10:49:53.124477 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-58f77ed1-9963-4535-a524-fcce6f9be8aa req-7c80ad35-ab62-41c1-9d8e-5af52b034585 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147360 Sep 08 10:49:53.146004 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1379/2800] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:49:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:49:53.571544 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1b50ee0d-c2a5-4bfa-9414-59793eff7de0 tempest-ImagesMetadataNegativeTestJSON-1843733466 tempest-ImagesMetadataNegativeTestJSON-1843733466-project] Calling method '.version_select at 0x7f68e8976820>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:53.618880 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-1b50ee0d-c2a5-4bfa-9414-59793eff7de0 tempest-ImagesMetadataNegativeTestJSON-1843733466 tempest-ImagesMetadataNegativeTestJSON-1843733466-project] HTTP exception thrown: Image not found. Sep 08 10:49:53.626394 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1b50ee0d-c2a5-4bfa-9414-59793eff7de0 tempest-ImagesMetadataNegativeTestJSON-1843733466 tempest-ImagesMetadataNegativeTestJSON-1843733466-project] Request method failure captured: Sep 08 10:49:53.626394 n-d-850501-12 devstack@n-api.service[128861]: request: DELETE /compute/v2.1/images/2e9bd5b3-aea0-4c25-88e1-fd4b2413833e/metadata/os_distro HTTP/1.1 Sep 08 10:49:53.626394 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:49:53.626394 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:49:53.626394 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:49:53.626394 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:49:53.626394 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:49:53.626394 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:49:53.626394 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:49:53.626394 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:49:53.626394 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcjRh3I1xqK88DfAGIwALNx3uoeDaBQW2Acj_lCNjPsyzDoU_a4KNLSGYcVuOrn3wPaqvSlaxAwX5ErfNxGSll58su7ouhXNRvHsVKF0QldoVheEvtVSs0hGJcGI2l3jYspJVhCocqfhGYBlbJN9VXSA7N2UARcbObp128Bv5XgFdnQ Sep 08 10:49:53.626394 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:49:53.626394 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:49:53.626394 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:49:53.626394 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:49:53.626394 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:49:53.626394 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:49:53.626394 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: b98b0e493e5749a2b280cfcd5cfb3638 Sep 08 10:49:53.626394 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1843733466 Sep 08 10:49:53.626394 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:49:53.626394 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:49:53.626394 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b98b0e493e5749a2b280cfcd5cfb3638"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b98b0e493e5749a2b280cfcd5cfb3638"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b98b0e493e5749a2b280cfcd5cfb3638"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b98b0e493e5749a2b280cfcd5cfb3638"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:49:53.626394 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1843733466 Sep 08 10:49:53.626394 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: b98b0e493e5749a2b280cfcd5cfb3638 Sep 08 10:49:53.626394 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1843733466 Sep 08 10:49:53.626394 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ImagesMetadataNegativeTestJSON-1843733466-project Sep 08 10:49:53.626394 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:49:53.626394 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:49:53.626394 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 2ae0b8b62beb4b47b0a6085a1c764b83 Sep 08 10:49:53.626394 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1843733466-project Sep 08 10:49:53.626394 n-d-850501-12 devstack@n-api.service[128861]: method: Sep 08 10:49:53.626394 n-d-850501-12 devstack@n-api.service[128861]: exception: Image not found. Sep 08 10:49:53.626394 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'image_id': '2e9bd5b3-aea0-4c25-88e1-fd4b2413833e', 'id': 'os_distro'} Sep 08 10:49:53.626394 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:49:53.626394 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:49:53.626394 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 08 10:49:53.626394 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 08 10:49:53.626394 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 10:49:53.626394 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 10:49:53.626394 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 08 10:49:53.626394 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 08 10:49:53.626394 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 10:49:53.626394 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 10:49:53.626394 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 08 10:49:53.626394 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 08 10:49:53.626394 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 08 10:49:53.626394 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 08 10:49:53.626394 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 10:49:53.626394 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 10:49:53.626394 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 10:49:53.626394 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 10:49:53.626394 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 2e9bd5b3-aea0-4c25-88e1-fd4b2413833e Sep 08 10:49:53.626394 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:49:53.626394 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:49:53.626394 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:49:53.626394 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:49:53.626394 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 08 10:49:53.626394 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 08 10:49:53.626394 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 08 10:49:53.626394 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 08 10:49:53.626394 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 08 10:49:53.626394 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 08 10:49:53.630664 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 08 10:49:53.630664 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 08 10:49:53.630664 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 08 10:49:53.630664 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 08 10:49:53.630664 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 10:49:53.630664 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 10:49:53.630664 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 08 10:49:53.630664 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 08 10:49:53.630664 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 10:49:53.630664 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 10:49:53.630664 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 08 10:49:53.630664 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 08 10:49:53.630664 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 08 10:49:53.630664 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 08 10:49:53.630664 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 10:49:53.630664 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 10:49:53.630664 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 10:49:53.630664 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 10:49:53.630664 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2e9bd5b3-aea0-4c25-88e1-fd4b2413833e could not be found. Sep 08 10:49:53.630664 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:49:53.630664 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:49:53.630664 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:49:53.630664 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:49:53.630664 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:49:53.630664 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:49:53.630664 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:49:53.630664 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:49:53.630664 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:49:53.630664 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:49:53.630664 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:49:53.630664 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:49:53.630664 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Sep 08 10:49:53.630664 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 08 10:49:53.630664 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 08 10:49:53.630664 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 08 10:49:53.630664 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 08 10:49:53.630664 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:49:53.630664 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:49:53.630664 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:49:53.630664 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:49:53.630664 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:49:53.630664 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:49:53.630664 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:49:53.630664 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:49:53.630664 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 08 10:49:53.630664 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:49:53.639865 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1b50ee0d-c2a5-4bfa-9414-59793eff7de0 tempest-ImagesMetadataNegativeTestJSON-1843733466 tempest-ImagesMetadataNegativeTestJSON-1843733466-project] Returning 404 to user: Image not found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:49:53.640909 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1b50ee0d-c2a5-4bfa-9414-59793eff7de0 tempest-ImagesMetadataNegativeTestJSON-1843733466 tempest-ImagesMetadataNegativeTestJSON-1843733466-project] 10.222.0.27 "DELETE /compute/v2.1/images/2e9bd5b3-aea0-4c25-88e1-fd4b2413833e/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.369225 Sep 08 10:49:53.642444 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1380/2801] 10.222.0.27 () {58 vars in 1293 bytes} [Thu Sep 8 10:49:53 2022] DELETE /compute/v2.1/images/2e9bd5b3-aea0-4c25-88e1-fd4b2413833e/metadata/os_distro => generated 62 bytes in 372 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 08 10:49:53.651504 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6cdca79f-dc3f-4291-82ea-a29d7b0c95f2 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:53.652894 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6cdca79f-dc3f-4291-82ea-a29d7b0c95f2 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] [instance: a2469f0a-d6bc-46ae-8905-049f2123dc0c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:53.665388 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6cdca79f-dc3f-4291-82ea-a29d7b0c95f2 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:53.673562 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6cdca79f-dc3f-4291-82ea-a29d7b0c95f2 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:53.674249 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6cdca79f-dc3f-4291-82ea-a29d7b0c95f2 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:53.675193 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6cdca79f-dc3f-4291-82ea-a29d7b0c95f2 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:53.678884 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6cdca79f-dc3f-4291-82ea-a29d7b0c95f2 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:53.679590 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6cdca79f-dc3f-4291-82ea-a29d7b0c95f2 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:53.742508 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6cdca79f-dc3f-4291-82ea-a29d7b0c95f2 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] [instance: a2469f0a-d6bc-46ae-8905-049f2123dc0c] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:49:53.942256 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6cdca79f-dc3f-4291-82ea-a29d7b0c95f2 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a2469f0a-d6bc-46ae-8905-049f2123dc0c" status: 204 len: 0 microversion: 2.1 time: 0.298227 Sep 08 10:49:53.946175 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1381/2802] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:49:53 2022] DELETE /compute/v2.1/servers/a2469f0a-d6bc-46ae-8905-049f2123dc0c => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:49:53.952286 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a3f23c9a-9467-42ba-8c00-28c4351b07a9 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:53.954968 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a3f23c9a-9467-42ba-8c00-28c4351b07a9 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] [instance: e522775b-9d4f-4fee-beaa-61e1b0452ead] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:53.971017 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a3f23c9a-9467-42ba-8c00-28c4351b07a9 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:53.971740 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a3f23c9a-9467-42ba-8c00-28c4351b07a9 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:53.972405 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a3f23c9a-9467-42ba-8c00-28c4351b07a9 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:53.973329 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a3f23c9a-9467-42ba-8c00-28c4351b07a9 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:53.977778 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a3f23c9a-9467-42ba-8c00-28c4351b07a9 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:53.979101 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a3f23c9a-9467-42ba-8c00-28c4351b07a9 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:54.008782 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:49:54.305050 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a3f23c9a-9467-42ba-8c00-28c4351b07a9 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f58dabb2db74cedba25f856ad1a7df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63eba712ae82439ba53b37b774c332dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:54.323117 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a3f23c9a-9467-42ba-8c00-28c4351b07a9 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] 10.222.0.27 "GET /compute/v2.1/servers/e522775b-9d4f-4fee-beaa-61e1b0452ead" status: 200 len: 1351 microversion: 2.1 time: 0.375393 Sep 08 10:49:54.323969 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1382/2803] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:53 2022] GET /compute/v2.1/servers/e522775b-9d4f-4fee-beaa-61e1b0452ead => generated 1351 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:54.332388 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-081ea36a-81c7-4408-9b55-4993c0bfa21a tempest-ImagesMetadataNegativeTestJSON-1843733466 tempest-ImagesMetadataNegativeTestJSON-1843733466-project] Calling method '.version_select at 0x7f68e41665e0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:54.368961 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-081ea36a-81c7-4408-9b55-4993c0bfa21a tempest-ImagesMetadataNegativeTestJSON-1843733466 tempest-ImagesMetadataNegativeTestJSON-1843733466-project] HTTP exception thrown: Image not found. Sep 08 10:49:54.371439 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-081ea36a-81c7-4408-9b55-4993c0bfa21a tempest-ImagesMetadataNegativeTestJSON-1843733466 tempest-ImagesMetadataNegativeTestJSON-1843733466-project] Request method failure captured: Sep 08 10:49:54.371439 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/images/d0edb2d1-5510-466f-bfba-eb2ddd596d53/metadata/os_version HTTP/1.1 Sep 08 10:49:54.371439 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:49:54.371439 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:49:54.371439 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:49:54.371439 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:49:54.371439 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:49:54.371439 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:49:54.371439 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:49:54.371439 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:49:54.371439 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcjRh3I1xqK88DfAGIwALNx3uoeDaBQW2Acj_lCNjPsyzDoU_a4KNLSGYcVuOrn3wPaqvSlaxAwX5ErfNxGSll58su7ouhXNRvHsVKF0QldoVheEvtVSs0hGJcGI2l3jYspJVhCocqfhGYBlbJN9VXSA7N2UARcbObp128Bv5XgFdnQ Sep 08 10:49:54.371439 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:49:54.371439 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:49:54.371439 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:49:54.371439 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:49:54.371439 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:49:54.371439 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:49:54.371439 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: b98b0e493e5749a2b280cfcd5cfb3638 Sep 08 10:49:54.371439 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1843733466 Sep 08 10:49:54.371439 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:49:54.371439 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:49:54.371439 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b98b0e493e5749a2b280cfcd5cfb3638"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b98b0e493e5749a2b280cfcd5cfb3638"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b98b0e493e5749a2b280cfcd5cfb3638"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b98b0e493e5749a2b280cfcd5cfb3638"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:49:54.371439 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1843733466 Sep 08 10:49:54.371439 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: b98b0e493e5749a2b280cfcd5cfb3638 Sep 08 10:49:54.371439 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1843733466 Sep 08 10:49:54.371439 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ImagesMetadataNegativeTestJSON-1843733466-project Sep 08 10:49:54.371439 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:49:54.371439 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:49:54.371439 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 2ae0b8b62beb4b47b0a6085a1c764b83 Sep 08 10:49:54.371439 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1843733466-project Sep 08 10:49:54.371439 n-d-850501-12 devstack@n-api.service[128861]: method: Sep 08 10:49:54.371439 n-d-850501-12 devstack@n-api.service[128861]: exception: Image not found. Sep 08 10:49:54.371439 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'image_id': 'd0edb2d1-5510-466f-bfba-eb2ddd596d53', 'id': 'os_version'} Sep 08 10:49:54.371439 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:49:54.371439 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:49:54.371439 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 08 10:49:54.371439 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 08 10:49:54.371439 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 10:49:54.371439 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 10:49:54.371439 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 08 10:49:54.371439 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 08 10:49:54.371439 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 10:49:54.371439 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 10:49:54.371439 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 08 10:49:54.371439 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 08 10:49:54.371439 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 08 10:49:54.371439 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 08 10:49:54.371439 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 10:49:54.371439 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 10:49:54.371439 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 10:49:54.371439 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 10:49:54.371439 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID d0edb2d1-5510-466f-bfba-eb2ddd596d53 Sep 08 10:49:54.371439 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:49:54.371439 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:49:54.371439 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:49:54.371439 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:49:54.371439 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 08 10:49:54.371439 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 08 10:49:54.371439 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 08 10:49:54.371439 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 08 10:49:54.371439 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 08 10:49:54.371439 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 08 10:49:54.376137 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 08 10:49:54.376137 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 08 10:49:54.376137 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 08 10:49:54.376137 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 08 10:49:54.376137 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 10:49:54.376137 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 10:49:54.376137 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 08 10:49:54.376137 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 08 10:49:54.376137 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 10:49:54.376137 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 10:49:54.376137 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 08 10:49:54.376137 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 08 10:49:54.376137 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 08 10:49:54.376137 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 08 10:49:54.376137 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 10:49:54.376137 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 10:49:54.376137 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 10:49:54.376137 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 10:49:54.376137 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d0edb2d1-5510-466f-bfba-eb2ddd596d53 could not be found. Sep 08 10:49:54.376137 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:49:54.376137 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:49:54.376137 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:49:54.376137 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:49:54.376137 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:49:54.376137 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:49:54.376137 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:49:54.376137 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:49:54.376137 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:49:54.376137 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:49:54.376137 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:49:54.376137 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:49:54.376137 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Sep 08 10:49:54.376137 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Sep 08 10:49:54.376137 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 08 10:49:54.376137 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 08 10:49:54.376137 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 08 10:49:54.376137 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:49:54.376137 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:49:54.376137 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:49:54.376137 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:49:54.376137 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:49:54.376137 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:49:54.376137 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:49:54.376137 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:49:54.376137 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 08 10:49:54.376137 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:49:54.376137 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-081ea36a-81c7-4408-9b55-4993c0bfa21a tempest-ImagesMetadataNegativeTestJSON-1843733466 tempest-ImagesMetadataNegativeTestJSON-1843733466-project] Returning 404 to user: Image not found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:49:54.376137 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-081ea36a-81c7-4408-9b55-4993c0bfa21a tempest-ImagesMetadataNegativeTestJSON-1843733466 tempest-ImagesMetadataNegativeTestJSON-1843733466-project] 10.222.0.27 "GET /compute/v2.1/images/d0edb2d1-5510-466f-bfba-eb2ddd596d53/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.047819 Sep 08 10:49:54.376137 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1383/2804] 10.222.0.27 () {58 vars in 1293 bytes} [Thu Sep 8 10:49:54 2022] GET /compute/v2.1/images/d0edb2d1-5510-466f-bfba-eb2ddd596d53/metadata/os_version => generated 62 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:49:54.400842 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-50fdc427-90ed-49b6-a4a0-2133f4c91d1d tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:54.409929 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-50fdc427-90ed-49b6-a4a0-2133f4c91d1d tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] [instance: a2469f0a-d6bc-46ae-8905-049f2123dc0c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:54.432560 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-50fdc427-90ed-49b6-a4a0-2133f4c91d1d tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:54.438786 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-50fdc427-90ed-49b6-a4a0-2133f4c91d1d tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:54.439486 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-50fdc427-90ed-49b6-a4a0-2133f4c91d1d tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:54.440484 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-50fdc427-90ed-49b6-a4a0-2133f4c91d1d tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:54.441290 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-50fdc427-90ed-49b6-a4a0-2133f4c91d1d tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:54.441896 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-50fdc427-90ed-49b6-a4a0-2133f4c91d1d tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:54.892758 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-50fdc427-90ed-49b6-a4a0-2133f4c91d1d tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fb4a7dae3346d39f70c51055cfd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065d7179ebd6460cb039bd1624296b57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:54.898583 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1fa78c70-08f3-4746-bf74-395bcc24a9a7 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0c66b5a004df886b3d973a978c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc5f459e4a143d1b8bf1c5c64153644', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:54.928150 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1fa78c70-08f3-4746-bf74-395bcc24a9a7 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] 10.222.0.27 "GET /compute/v2.1/servers/f96451ab-896c-4652-8e89-ba210495b5e8" status: 200 len: 1320 microversion: 2.1 time: 1.944975 Sep 08 10:49:54.940697 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1422/2805] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:52 2022] GET /compute/v2.1/servers/f96451ab-896c-4652-8e89-ba210495b5e8 => generated 1320 bytes in 1966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:54.940886 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-50fdc427-90ed-49b6-a4a0-2133f4c91d1d tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] 10.222.0.27 "GET /compute/v2.1/servers/a2469f0a-d6bc-46ae-8905-049f2123dc0c" status: 200 len: 1715 microversion: 2.1 time: 0.563618 Sep 08 10:49:54.944767 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1384/2806] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:54 2022] GET /compute/v2.1/servers/a2469f0a-d6bc-46ae-8905-049f2123dc0c => generated 1715 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:54.957159 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e0919037-009d-48b0-8fd9-41991ab33252 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:54.964694 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e0919037-009d-48b0-8fd9-41991ab33252 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:54.976375 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6df7303f-c495-4fe8-8e13-339faf009b67 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:54.978107 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6df7303f-c495-4fe8-8e13-339faf009b67 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: bace4c1a-2c38-42b3-962d-ca87a3bfb7ba] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:54.987405 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0919037-009d-48b0-8fd9-41991ab33252 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:54.987915 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0919037-009d-48b0-8fd9-41991ab33252 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:54.988804 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6df7303f-c495-4fe8-8e13-339faf009b67 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:54.990102 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6df7303f-c495-4fe8-8e13-339faf009b67 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:54.990550 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6df7303f-c495-4fe8-8e13-339faf009b67 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:54.991302 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6df7303f-c495-4fe8-8e13-339faf009b67 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:54.991786 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6df7303f-c495-4fe8-8e13-339faf009b67 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:54.992259 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6df7303f-c495-4fe8-8e13-339faf009b67 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:54.992843 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0919037-009d-48b0-8fd9-41991ab33252 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:54.993900 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0919037-009d-48b0-8fd9-41991ab33252 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:54.999422 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0919037-009d-48b0-8fd9-41991ab33252 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:55.000620 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0919037-009d-48b0-8fd9-41991ab33252 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:55.216562 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e0919037-009d-48b0-8fd9-41991ab33252 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:55.235886 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e0919037-009d-48b0-8fd9-41991ab33252 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:55.237415 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e0919037-009d-48b0-8fd9-41991ab33252 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:55.255187 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e0919037-009d-48b0-8fd9-41991ab33252 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1555 microversion: 2.91 time: 0.310440 Sep 08 10:49:55.259789 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1423/2807] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:49:54 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1555 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:49:55.272864 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6d11bfd2-a363-4d23-b3e9-fab715995707 tempest-ImagesMetadataNegativeTestJSON-1843733466 tempest-ImagesMetadataNegativeTestJSON-1843733466-project] Calling method '.version_select at 0x7f68e454a160>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:55.306516 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-6d11bfd2-a363-4d23-b3e9-fab715995707 tempest-ImagesMetadataNegativeTestJSON-1843733466 tempest-ImagesMetadataNegativeTestJSON-1843733466-project] HTTP exception thrown: Image not found. Sep 08 10:49:55.309971 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6d11bfd2-a363-4d23-b3e9-fab715995707 tempest-ImagesMetadataNegativeTestJSON-1843733466 tempest-ImagesMetadataNegativeTestJSON-1843733466-project] Request method failure captured: Sep 08 10:49:55.309971 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/images/e1991f70-a114-4c44-a972-8d04170d1617/metadata HTTP/1.1 Sep 08 10:49:55.309971 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:49:55.309971 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:49:55.309971 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:49:55.309971 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:49:55.309971 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:49:55.309971 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:49:55.309971 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:49:55.309971 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:49:55.309971 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcjRh3I1xqK88DfAGIwALNx3uoeDaBQW2Acj_lCNjPsyzDoU_a4KNLSGYcVuOrn3wPaqvSlaxAwX5ErfNxGSll58su7ouhXNRvHsVKF0QldoVheEvtVSs0hGJcGI2l3jYspJVhCocqfhGYBlbJN9VXSA7N2UARcbObp128Bv5XgFdnQ Sep 08 10:49:55.309971 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:49:55.309971 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:49:55.309971 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:49:55.309971 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:49:55.309971 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:49:55.309971 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:49:55.309971 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: b98b0e493e5749a2b280cfcd5cfb3638 Sep 08 10:49:55.309971 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1843733466 Sep 08 10:49:55.309971 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:49:55.309971 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:49:55.309971 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b98b0e493e5749a2b280cfcd5cfb3638"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b98b0e493e5749a2b280cfcd5cfb3638"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b98b0e493e5749a2b280cfcd5cfb3638"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b98b0e493e5749a2b280cfcd5cfb3638"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:49:55.309971 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1843733466 Sep 08 10:49:55.309971 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: b98b0e493e5749a2b280cfcd5cfb3638 Sep 08 10:49:55.309971 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1843733466 Sep 08 10:49:55.309971 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ImagesMetadataNegativeTestJSON-1843733466-project Sep 08 10:49:55.309971 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:49:55.309971 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:49:55.309971 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 2ae0b8b62beb4b47b0a6085a1c764b83 Sep 08 10:49:55.309971 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1843733466-project Sep 08 10:49:55.309971 n-d-850501-12 devstack@n-api.service[128862]: method: Sep 08 10:49:55.309971 n-d-850501-12 devstack@n-api.service[128862]: exception: Image not found. Sep 08 10:49:55.309971 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'image_id': 'e1991f70-a114-4c44-a972-8d04170d1617'} Sep 08 10:49:55.309971 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:49:55.309971 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:49:55.309971 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 08 10:49:55.309971 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 08 10:49:55.309971 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 10:49:55.309971 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 10:49:55.309971 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 08 10:49:55.309971 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 08 10:49:55.309971 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 10:49:55.309971 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 10:49:55.309971 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 08 10:49:55.309971 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 08 10:49:55.309971 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 08 10:49:55.309971 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 08 10:49:55.309971 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 10:49:55.309971 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 10:49:55.309971 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 10:49:55.309971 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 10:49:55.309971 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID e1991f70-a114-4c44-a972-8d04170d1617 Sep 08 10:49:55.309971 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:49:55.309971 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:49:55.309971 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:49:55.309971 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:49:55.309971 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 08 10:49:55.309971 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 08 10:49:55.309971 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 08 10:49:55.309971 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 08 10:49:55.309971 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 08 10:49:55.309971 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 08 10:49:55.315499 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 08 10:49:55.315499 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 08 10:49:55.315499 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 08 10:49:55.315499 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 08 10:49:55.315499 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 10:49:55.315499 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 10:49:55.315499 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 08 10:49:55.315499 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 08 10:49:55.315499 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 10:49:55.315499 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 10:49:55.315499 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 08 10:49:55.315499 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 08 10:49:55.315499 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 08 10:49:55.315499 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 08 10:49:55.315499 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 10:49:55.315499 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 10:49:55.315499 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 10:49:55.315499 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 10:49:55.315499 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e1991f70-a114-4c44-a972-8d04170d1617 could not be found. Sep 08 10:49:55.315499 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:49:55.315499 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:49:55.315499 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:49:55.315499 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:49:55.315499 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:49:55.315499 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:49:55.315499 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:49:55.315499 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:49:55.315499 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:49:55.315499 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:49:55.315499 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:49:55.315499 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:49:55.315499 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Sep 08 10:49:55.315499 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Sep 08 10:49:55.315499 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 08 10:49:55.315499 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 08 10:49:55.315499 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 08 10:49:55.315499 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:49:55.315499 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:49:55.315499 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:49:55.315499 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:49:55.315499 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:49:55.315499 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:49:55.315499 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:49:55.315499 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:49:55.315499 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 08 10:49:55.315499 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:49:55.331998 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6d11bfd2-a363-4d23-b3e9-fab715995707 tempest-ImagesMetadataNegativeTestJSON-1843733466 tempest-ImagesMetadataNegativeTestJSON-1843733466-project] Returning 404 to user: Image not found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:49:55.331998 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6d11bfd2-a363-4d23-b3e9-fab715995707 tempest-ImagesMetadataNegativeTestJSON-1843733466 tempest-ImagesMetadataNegativeTestJSON-1843733466-project] 10.222.0.27 "GET /compute/v2.1/images/e1991f70-a114-4c44-a972-8d04170d1617/metadata" status: 404 len: 62 microversion: 2.1 time: 0.062448 Sep 08 10:49:55.332962 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1424/2808] 10.222.0.27 () {58 vars in 1260 bytes} [Thu Sep 8 10:49:55 2022] GET /compute/v2.1/images/e1991f70-a114-4c44-a972-8d04170d1617/metadata => generated 62 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:49:55.346521 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6143582e-a949-47c6-b58e-665680b6292b tempest-ImagesMetadataNegativeTestJSON-1843733466 tempest-ImagesMetadataNegativeTestJSON-1843733466-project] Action: 'update_all', calling method: .version_select at 0x7f68e454ab80>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:49:55.397574 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-6143582e-a949-47c6-b58e-665680b6292b tempest-ImagesMetadataNegativeTestJSON-1843733466 tempest-ImagesMetadataNegativeTestJSON-1843733466-project] HTTP exception thrown: Image not found. Sep 08 10:49:55.404958 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6143582e-a949-47c6-b58e-665680b6292b tempest-ImagesMetadataNegativeTestJSON-1843733466 tempest-ImagesMetadataNegativeTestJSON-1843733466-project] Request method failure captured: Sep 08 10:49:55.404958 n-d-850501-12 devstack@n-api.service[128862]: request: PUT /compute/v2.1/images/d7c99502-bdd6-4389-be0e-364b64d0360d/metadata HTTP/1.1 Sep 08 10:49:55.404958 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:49:55.404958 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:49:55.404958 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:49:55.404958 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 57 Sep 08 10:49:55.404958 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:49:55.404958 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:49:55.404958 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:49:55.404958 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:49:55.404958 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcjRh3I1xqK88DfAGIwALNx3uoeDaBQW2Acj_lCNjPsyzDoU_a4KNLSGYcVuOrn3wPaqvSlaxAwX5ErfNxGSll58su7ouhXNRvHsVKF0QldoVheEvtVSs0hGJcGI2l3jYspJVhCocqfhGYBlbJN9VXSA7N2UARcbObp128Bv5XgFdnQ Sep 08 10:49:55.404958 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:49:55.404958 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:49:55.404958 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:49:55.404958 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:49:55.404958 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:49:55.404958 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:49:55.404958 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: b98b0e493e5749a2b280cfcd5cfb3638 Sep 08 10:49:55.404958 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1843733466 Sep 08 10:49:55.404958 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:49:55.404958 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:49:55.404958 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b98b0e493e5749a2b280cfcd5cfb3638"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b98b0e493e5749a2b280cfcd5cfb3638"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b98b0e493e5749a2b280cfcd5cfb3638"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b98b0e493e5749a2b280cfcd5cfb3638"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:49:55.404958 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1843733466 Sep 08 10:49:55.404958 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: b98b0e493e5749a2b280cfcd5cfb3638 Sep 08 10:49:55.404958 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1843733466 Sep 08 10:49:55.404958 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ImagesMetadataNegativeTestJSON-1843733466-project Sep 08 10:49:55.404958 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:49:55.404958 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:49:55.404958 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 2ae0b8b62beb4b47b0a6085a1c764b83 Sep 08 10:49:55.404958 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1843733466-project Sep 08 10:49:55.404958 n-d-850501-12 devstack@n-api.service[128862]: Sep 08 10:49:55.404958 n-d-850501-12 devstack@n-api.service[128862]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Sep 08 10:49:55.404958 n-d-850501-12 devstack@n-api.service[128862]: method: Sep 08 10:49:55.404958 n-d-850501-12 devstack@n-api.service[128862]: exception: Image not found. Sep 08 10:49:55.404958 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'image_id': 'd7c99502-bdd6-4389-be0e-364b64d0360d', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Sep 08 10:49:55.404958 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:49:55.404958 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:49:55.404958 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 08 10:49:55.404958 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 08 10:49:55.404958 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 10:49:55.404958 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 10:49:55.404958 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 08 10:49:55.404958 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 08 10:49:55.404958 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 10:49:55.404958 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 10:49:55.404958 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 08 10:49:55.404958 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 08 10:49:55.404958 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 08 10:49:55.404958 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 08 10:49:55.404958 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 10:49:55.404958 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 10:49:55.404958 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 10:49:55.404958 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 10:49:55.404958 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID d7c99502-bdd6-4389-be0e-364b64d0360d Sep 08 10:49:55.404958 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:49:55.404958 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:49:55.404958 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:49:55.404958 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:49:55.404958 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 08 10:49:55.404958 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 08 10:49:55.404958 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 08 10:49:55.404958 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 08 10:49:55.404958 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 08 10:49:55.409502 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 08 10:49:55.409502 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 08 10:49:55.409502 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 08 10:49:55.409502 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 08 10:49:55.409502 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 08 10:49:55.409502 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 10:49:55.409502 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 10:49:55.409502 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 08 10:49:55.409502 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 08 10:49:55.409502 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 10:49:55.409502 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 10:49:55.409502 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 08 10:49:55.409502 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 08 10:49:55.409502 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 08 10:49:55.409502 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 08 10:49:55.409502 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 10:49:55.409502 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 10:49:55.409502 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 10:49:55.409502 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 10:49:55.409502 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d7c99502-bdd6-4389-be0e-364b64d0360d could not be found. Sep 08 10:49:55.409502 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:49:55.409502 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:49:55.409502 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:49:55.409502 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:49:55.409502 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:49:55.409502 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:49:55.409502 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:49:55.409502 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:49:55.409502 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:49:55.409502 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:49:55.409502 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:49:55.409502 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:49:55.409502 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:49:55.409502 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:49:55.409502 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Sep 08 10:49:55.409502 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 08 10:49:55.409502 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 08 10:49:55.409502 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 08 10:49:55.409502 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 08 10:49:55.409502 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:49:55.409502 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:49:55.409502 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:49:55.409502 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:49:55.409502 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:49:55.409502 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:49:55.409502 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:49:55.409502 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:49:55.409502 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 08 10:49:55.409502 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:49:55.423432 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6143582e-a949-47c6-b58e-665680b6292b tempest-ImagesMetadataNegativeTestJSON-1843733466 tempest-ImagesMetadataNegativeTestJSON-1843733466-project] Returning 404 to user: Image not found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:49:55.423432 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6143582e-a949-47c6-b58e-665680b6292b tempest-ImagesMetadataNegativeTestJSON-1843733466 tempest-ImagesMetadataNegativeTestJSON-1843733466-project] 10.222.0.27 "PUT /compute/v2.1/images/d7c99502-bdd6-4389-be0e-364b64d0360d/metadata" status: 404 len: 62 microversion: 2.1 time: 0.083180 Sep 08 10:49:55.423432 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1425/2809] 10.222.0.27 () {60 vars in 1280 bytes} [Thu Sep 8 10:49:55 2022] PUT /compute/v2.1/images/d7c99502-bdd6-4389-be0e-364b64d0360d/metadata => generated 62 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:49:55.449179 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ccd90531-b4b7-43b6-869a-0c7d2c25c72f tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:55.450244 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ccd90531-b4b7-43b6-869a-0c7d2c25c72f tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] [instance: e522775b-9d4f-4fee-beaa-61e1b0452ead] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:55.457327 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=32 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:49:55.460813 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ccd90531-b4b7-43b6-869a-0c7d2c25c72f tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:55.461750 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ccd90531-b4b7-43b6-869a-0c7d2c25c72f tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:55.462426 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ccd90531-b4b7-43b6-869a-0c7d2c25c72f tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:55.463696 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ccd90531-b4b7-43b6-869a-0c7d2c25c72f tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:55.467271 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ccd90531-b4b7-43b6-869a-0c7d2c25c72f tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:55.469374 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ccd90531-b4b7-43b6-869a-0c7d2c25c72f tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:55.746737 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6df7303f-c495-4fe8-8e13-339faf009b67 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c291cbe955b4ee5abc98132dda0255e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f9a24cad014d7f827e8f3236dd5bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:55.787027 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6df7303f-c495-4fe8-8e13-339faf009b67 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/bace4c1a-2c38-42b3-962d-ca87a3bfb7ba" status: 200 len: 1613 microversion: 2.1 time: 0.838078 Sep 08 10:49:55.803800 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1385/2810] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:54 2022] GET /compute/v2.1/servers/bace4c1a-2c38-42b3-962d-ca87a3bfb7ba => generated 1613 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:55.807148 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2a2fe523-e931-4b74-81af-83644ffb6df2 tempest-ImagesMetadataNegativeTestJSON-1843733466 tempest-ImagesMetadataNegativeTestJSON-1843733466-project] Action: 'update', calling method: .version_select at 0x7f68e4169f70>, body: {"meta": {"os_distro": "alt"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:49:55.867903 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-2a2fe523-e931-4b74-81af-83644ffb6df2 tempest-ImagesMetadataNegativeTestJSON-1843733466 tempest-ImagesMetadataNegativeTestJSON-1843733466-project] HTTP exception thrown: Image not found. Sep 08 10:49:55.870483 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2a2fe523-e931-4b74-81af-83644ffb6df2 tempest-ImagesMetadataNegativeTestJSON-1843733466 tempest-ImagesMetadataNegativeTestJSON-1843733466-project] Request method failure captured: Sep 08 10:49:55.870483 n-d-850501-12 devstack@n-api.service[128861]: request: PUT /compute/v2.1/images/cc12c19b-a14d-40d7-9c55-57a03c986242/metadata/os_distro HTTP/1.1 Sep 08 10:49:55.870483 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:49:55.870483 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:49:55.870483 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:49:55.870483 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 30 Sep 08 10:49:55.870483 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:49:55.870483 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:49:55.870483 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:49:55.870483 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:49:55.870483 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcjRh3I1xqK88DfAGIwALNx3uoeDaBQW2Acj_lCNjPsyzDoU_a4KNLSGYcVuOrn3wPaqvSlaxAwX5ErfNxGSll58su7ouhXNRvHsVKF0QldoVheEvtVSs0hGJcGI2l3jYspJVhCocqfhGYBlbJN9VXSA7N2UARcbObp128Bv5XgFdnQ Sep 08 10:49:55.870483 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:49:55.870483 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:49:55.870483 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:49:55.870483 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:49:55.870483 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:49:55.870483 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:49:55.870483 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: b98b0e493e5749a2b280cfcd5cfb3638 Sep 08 10:49:55.870483 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1843733466 Sep 08 10:49:55.870483 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:49:55.870483 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:49:55.870483 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b98b0e493e5749a2b280cfcd5cfb3638"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b98b0e493e5749a2b280cfcd5cfb3638"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b98b0e493e5749a2b280cfcd5cfb3638"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b98b0e493e5749a2b280cfcd5cfb3638"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:49:55.870483 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1843733466 Sep 08 10:49:55.870483 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: b98b0e493e5749a2b280cfcd5cfb3638 Sep 08 10:49:55.870483 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1843733466 Sep 08 10:49:55.870483 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ImagesMetadataNegativeTestJSON-1843733466-project Sep 08 10:49:55.870483 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:49:55.870483 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:49:55.870483 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 2ae0b8b62beb4b47b0a6085a1c764b83 Sep 08 10:49:55.870483 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1843733466-project Sep 08 10:49:55.870483 n-d-850501-12 devstack@n-api.service[128861]: Sep 08 10:49:55.870483 n-d-850501-12 devstack@n-api.service[128861]: {"meta": {"os_distro": "alt"}} Sep 08 10:49:55.870483 n-d-850501-12 devstack@n-api.service[128861]: method: Sep 08 10:49:55.870483 n-d-850501-12 devstack@n-api.service[128861]: exception: Image not found. Sep 08 10:49:55.870483 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'image_id': 'cc12c19b-a14d-40d7-9c55-57a03c986242', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Sep 08 10:49:55.870483 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:49:55.870483 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:49:55.870483 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 08 10:49:55.870483 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 08 10:49:55.870483 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 10:49:55.870483 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 10:49:55.870483 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 08 10:49:55.870483 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 08 10:49:55.870483 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 10:49:55.870483 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 10:49:55.870483 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 08 10:49:55.870483 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 08 10:49:55.870483 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 08 10:49:55.870483 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 08 10:49:55.870483 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 10:49:55.870483 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 10:49:55.870483 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 10:49:55.870483 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 10:49:55.870483 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID cc12c19b-a14d-40d7-9c55-57a03c986242 Sep 08 10:49:55.870483 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:49:55.870483 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:49:55.870483 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:49:55.870483 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:49:55.870483 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 08 10:49:55.870483 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 08 10:49:55.870483 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 08 10:49:55.870483 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 08 10:49:55.870483 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 08 10:49:55.870483 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 08 10:49:55.887642 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 08 10:49:55.887642 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 08 10:49:55.887642 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 08 10:49:55.887642 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 08 10:49:55.887642 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 10:49:55.887642 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 10:49:55.887642 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 08 10:49:55.887642 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 08 10:49:55.887642 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 10:49:55.887642 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 10:49:55.887642 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 08 10:49:55.887642 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 08 10:49:55.887642 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 08 10:49:55.887642 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 08 10:49:55.887642 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 10:49:55.887642 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 10:49:55.887642 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 10:49:55.887642 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 10:49:55.887642 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image cc12c19b-a14d-40d7-9c55-57a03c986242 could not be found. Sep 08 10:49:55.887642 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:49:55.887642 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:49:55.887642 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:49:55.887642 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:49:55.887642 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:49:55.887642 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:49:55.887642 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:49:55.887642 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:49:55.887642 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:49:55.887642 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:49:55.887642 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:49:55.887642 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:49:55.887642 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:49:55.887642 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:49:55.887642 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Sep 08 10:49:55.887642 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 08 10:49:55.887642 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 08 10:49:55.887642 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 08 10:49:55.887642 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 08 10:49:55.887642 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:49:55.887642 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:49:55.887642 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:49:55.887642 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:49:55.887642 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:49:55.887642 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:49:55.887642 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:49:55.887642 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:49:55.887642 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 08 10:49:55.887642 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:49:55.887642 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2a2fe523-e931-4b74-81af-83644ffb6df2 tempest-ImagesMetadataNegativeTestJSON-1843733466 tempest-ImagesMetadataNegativeTestJSON-1843733466-project] Returning 404 to user: Image not found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:49:55.887642 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2a2fe523-e931-4b74-81af-83644ffb6df2 tempest-ImagesMetadataNegativeTestJSON-1843733466 tempest-ImagesMetadataNegativeTestJSON-1843733466-project] 10.222.0.27 "PUT /compute/v2.1/images/cc12c19b-a14d-40d7-9c55-57a03c986242/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.082183 Sep 08 10:49:55.887642 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1386/2811] 10.222.0.27 () {60 vars in 1310 bytes} [Thu Sep 8 10:49:55 2022] PUT /compute/v2.1/images/cc12c19b-a14d-40d7-9c55-57a03c986242/metadata/os_distro => generated 62 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:49:55.891537 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-e0cf6be8-6ce9-484b-bf01-ab71a20b7887 req-2a0cb0b6-da8f-41b3-9d1c-29af8cd2cc3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e522775b-9d4f-4fee-beaa-61e1b0452ead", "tag": "002ad59a-75f1-4c84-828c-d70e98fdeb3a"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:49:55.921951 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-e0cf6be8-6ce9-484b-bf01-ab71a20b7887 req-2a0cb0b6-da8f-41b3-9d1c-29af8cd2cc3e service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:55.922575 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-e0cf6be8-6ce9-484b-bf01-ab71a20b7887 req-2a0cb0b6-da8f-41b3-9d1c-29af8cd2cc3e service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:55.928816 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-e0cf6be8-6ce9-484b-bf01-ab71a20b7887 req-2a0cb0b6-da8f-41b3-9d1c-29af8cd2cc3e service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:55.980264 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-e0cf6be8-6ce9-484b-bf01-ab71a20b7887 req-2a0cb0b6-da8f-41b3-9d1c-29af8cd2cc3e service nova] Creating event network-changed:002ad59a-75f1-4c84-828c-d70e98fdeb3a for instance e522775b-9d4f-4fee-beaa-61e1b0452ead on n-h1-850501-12 Sep 08 10:49:55.995195 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-e0cf6be8-6ce9-484b-bf01-ab71a20b7887 req-2a0cb0b6-da8f-41b3-9d1c-29af8cd2cc3e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120595 Sep 08 10:49:55.999634 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1387/2812] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:49:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:49:56.019960 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1a454691-5c71-4c39-87be-465a5b9af698 tempest-ImagesMetadataNegativeTestJSON-1843733466 tempest-ImagesMetadataNegativeTestJSON-1843733466-project] Action: 'create', calling method: .version_select at 0x7f68e41491f0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:49:56.081428 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-1a454691-5c71-4c39-87be-465a5b9af698 tempest-ImagesMetadataNegativeTestJSON-1843733466 tempest-ImagesMetadataNegativeTestJSON-1843733466-project] HTTP exception thrown: Image not found. Sep 08 10:49:56.091690 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1a454691-5c71-4c39-87be-465a5b9af698 tempest-ImagesMetadataNegativeTestJSON-1843733466 tempest-ImagesMetadataNegativeTestJSON-1843733466-project] Request method failure captured: Sep 08 10:49:56.091690 n-d-850501-12 devstack@n-api.service[128861]: request: POST /compute/v2.1/images/fa403ca5-1b39-4210-b4ab-a375ce91f53c/metadata HTTP/1.1 Sep 08 10:49:56.091690 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:49:56.091690 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:49:56.091690 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:49:56.091690 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 57 Sep 08 10:49:56.091690 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:49:56.091690 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:49:56.091690 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:49:56.091690 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:49:56.091690 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcjRh3I1xqK88DfAGIwALNx3uoeDaBQW2Acj_lCNjPsyzDoU_a4KNLSGYcVuOrn3wPaqvSlaxAwX5ErfNxGSll58su7ouhXNRvHsVKF0QldoVheEvtVSs0hGJcGI2l3jYspJVhCocqfhGYBlbJN9VXSA7N2UARcbObp128Bv5XgFdnQ Sep 08 10:49:56.091690 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:49:56.091690 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:49:56.091690 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:49:56.091690 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:49:56.091690 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:49:56.091690 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:49:56.091690 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: b98b0e493e5749a2b280cfcd5cfb3638 Sep 08 10:49:56.091690 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1843733466 Sep 08 10:49:56.091690 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:49:56.091690 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:49:56.091690 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b98b0e493e5749a2b280cfcd5cfb3638"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b98b0e493e5749a2b280cfcd5cfb3638"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b98b0e493e5749a2b280cfcd5cfb3638"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b98b0e493e5749a2b280cfcd5cfb3638"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:49:56.091690 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1843733466 Sep 08 10:49:56.091690 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: b98b0e493e5749a2b280cfcd5cfb3638 Sep 08 10:49:56.091690 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1843733466 Sep 08 10:49:56.091690 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ImagesMetadataNegativeTestJSON-1843733466-project Sep 08 10:49:56.091690 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:49:56.091690 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:49:56.091690 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 2ae0b8b62beb4b47b0a6085a1c764b83 Sep 08 10:49:56.091690 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1843733466-project Sep 08 10:49:56.091690 n-d-850501-12 devstack@n-api.service[128861]: Sep 08 10:49:56.091690 n-d-850501-12 devstack@n-api.service[128861]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Sep 08 10:49:56.091690 n-d-850501-12 devstack@n-api.service[128861]: method: Sep 08 10:49:56.091690 n-d-850501-12 devstack@n-api.service[128861]: exception: Image not found. Sep 08 10:49:56.091690 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'image_id': 'fa403ca5-1b39-4210-b4ab-a375ce91f53c', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Sep 08 10:49:56.091690 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:49:56.091690 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:49:56.091690 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 08 10:49:56.091690 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 08 10:49:56.091690 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 10:49:56.091690 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 10:49:56.091690 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 08 10:49:56.091690 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 08 10:49:56.091690 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 10:49:56.091690 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 10:49:56.091690 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 08 10:49:56.091690 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 08 10:49:56.091690 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 08 10:49:56.091690 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 08 10:49:56.091690 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 10:49:56.091690 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 10:49:56.091690 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 10:49:56.091690 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 10:49:56.091690 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID fa403ca5-1b39-4210-b4ab-a375ce91f53c Sep 08 10:49:56.091690 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:49:56.091690 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:49:56.091690 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:49:56.091690 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:49:56.091690 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 08 10:49:56.091690 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 08 10:49:56.091690 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 08 10:49:56.091690 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 08 10:49:56.091690 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 08 10:49:56.097348 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 08 10:49:56.097348 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 08 10:49:56.097348 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 08 10:49:56.097348 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 08 10:49:56.097348 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 08 10:49:56.097348 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 10:49:56.097348 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 10:49:56.097348 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 08 10:49:56.097348 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 08 10:49:56.097348 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 10:49:56.097348 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 10:49:56.097348 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 08 10:49:56.097348 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 08 10:49:56.097348 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 08 10:49:56.097348 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 08 10:49:56.097348 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 10:49:56.097348 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 10:49:56.097348 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 10:49:56.097348 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 10:49:56.097348 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image fa403ca5-1b39-4210-b4ab-a375ce91f53c could not be found. Sep 08 10:49:56.097348 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:49:56.097348 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:49:56.097348 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:49:56.097348 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:49:56.097348 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:49:56.097348 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:49:56.097348 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:49:56.097348 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:49:56.097348 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:49:56.097348 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:49:56.097348 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:49:56.097348 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:49:56.097348 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:49:56.097348 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:49:56.097348 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Sep 08 10:49:56.097348 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 08 10:49:56.097348 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 08 10:49:56.097348 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 08 10:49:56.097348 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 08 10:49:56.097348 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:49:56.097348 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:49:56.097348 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:49:56.097348 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:49:56.097348 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:49:56.097348 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:49:56.097348 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:49:56.097348 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:49:56.097348 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 08 10:49:56.097348 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:49:56.097348 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1a454691-5c71-4c39-87be-465a5b9af698 tempest-ImagesMetadataNegativeTestJSON-1843733466 tempest-ImagesMetadataNegativeTestJSON-1843733466-project] Returning 404 to user: Image not found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:49:56.105612 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1a454691-5c71-4c39-87be-465a5b9af698 tempest-ImagesMetadataNegativeTestJSON-1843733466 tempest-ImagesMetadataNegativeTestJSON-1843733466-project] 10.222.0.27 "POST /compute/v2.1/images/fa403ca5-1b39-4210-b4ab-a375ce91f53c/metadata" status: 404 len: 62 microversion: 2.1 time: 0.093307 Sep 08 10:49:56.117335 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1388/2813] 10.222.0.27 () {60 vars in 1281 bytes} [Thu Sep 8 10:49:55 2022] POST /compute/v2.1/images/fa403ca5-1b39-4210-b4ab-a375ce91f53c/metadata => generated 62 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:49:56.153068 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c447da0e-76f8-41d6-8afb-45e4fdbee22c tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:56.155246 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c447da0e-76f8-41d6-8afb-45e4fdbee22c tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] [instance: f96451ab-896c-4652-8e89-ba210495b5e8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:56.176028 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c447da0e-76f8-41d6-8afb-45e4fdbee22c tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:56.177686 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c447da0e-76f8-41d6-8afb-45e4fdbee22c tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:56.182437 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c447da0e-76f8-41d6-8afb-45e4fdbee22c tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:56.185015 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c447da0e-76f8-41d6-8afb-45e4fdbee22c tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:56.186471 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c447da0e-76f8-41d6-8afb-45e4fdbee22c tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:56.187149 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c447da0e-76f8-41d6-8afb-45e4fdbee22c tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:56.416172 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ccd90531-b4b7-43b6-869a-0c7d2c25c72f tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f58dabb2db74cedba25f856ad1a7df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63eba712ae82439ba53b37b774c332dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:56.430530 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ccd90531-b4b7-43b6-869a-0c7d2c25c72f tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] 10.222.0.27 "GET /compute/v2.1/servers/e522775b-9d4f-4fee-beaa-61e1b0452ead" status: 200 len: 1351 microversion: 2.1 time: 1.000778 Sep 08 10:49:56.447086 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1426/2814] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:55 2022] GET /compute/v2.1/servers/e522775b-9d4f-4fee-beaa-61e1b0452ead => generated 1351 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:56.459698 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-943684bb-c784-4172-a1f3-81d3cebe8c06 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:56.461901 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-943684bb-c784-4172-a1f3-81d3cebe8c06 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] [instance: a2469f0a-d6bc-46ae-8905-049f2123dc0c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:56.478827 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-943684bb-c784-4172-a1f3-81d3cebe8c06 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:56.479797 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-943684bb-c784-4172-a1f3-81d3cebe8c06 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:56.483412 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-943684bb-c784-4172-a1f3-81d3cebe8c06 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:56.484905 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-943684bb-c784-4172-a1f3-81d3cebe8c06 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:56.485630 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-943684bb-c784-4172-a1f3-81d3cebe8c06 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:56.486592 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-943684bb-c784-4172-a1f3-81d3cebe8c06 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:57.312149 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-943684bb-c784-4172-a1f3-81d3cebe8c06 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fb4a7dae3346d39f70c51055cfd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065d7179ebd6460cb039bd1624296b57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:57.336256 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-943684bb-c784-4172-a1f3-81d3cebe8c06 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] 10.222.0.27 "GET /compute/v2.1/servers/a2469f0a-d6bc-46ae-8905-049f2123dc0c" status: 200 len: 1715 microversion: 2.1 time: 0.882952 Sep 08 10:49:57.358846 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1427/2815] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:56 2022] GET /compute/v2.1/servers/a2469f0a-d6bc-46ae-8905-049f2123dc0c => generated 1715 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:57.411239 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d428a403-1d55-4a2f-8d42-8efd89d9c3b1 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:57.415615 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d428a403-1d55-4a2f-8d42-8efd89d9c3b1 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:57.445600 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d428a403-1d55-4a2f-8d42-8efd89d9c3b1 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:57.449018 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d428a403-1d55-4a2f-8d42-8efd89d9c3b1 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:57.450280 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d428a403-1d55-4a2f-8d42-8efd89d9c3b1 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:57.455393 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d428a403-1d55-4a2f-8d42-8efd89d9c3b1 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:57.459837 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d428a403-1d55-4a2f-8d42-8efd89d9c3b1 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:57.460825 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d428a403-1d55-4a2f-8d42-8efd89d9c3b1 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:57.899003 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c447da0e-76f8-41d6-8afb-45e4fdbee22c tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0c66b5a004df886b3d973a978c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc5f459e4a143d1b8bf1c5c64153644', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:57.912375 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c447da0e-76f8-41d6-8afb-45e4fdbee22c tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] 10.222.0.27 "GET /compute/v2.1/servers/f96451ab-896c-4652-8e89-ba210495b5e8" status: 200 len: 1320 microversion: 2.1 time: 1.792474 Sep 08 10:49:57.913269 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1389/2816] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:56 2022] GET /compute/v2.1/servers/f96451ab-896c-4652-8e89-ba210495b5e8 => generated 1320 bytes in 1795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:57.939272 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c559dfd7-e575-4b22-8c00-a8061114f635 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:57.940160 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c559dfd7-e575-4b22-8c00-a8061114f635 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: bace4c1a-2c38-42b3-962d-ca87a3bfb7ba] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:57.947642 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c559dfd7-e575-4b22-8c00-a8061114f635 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:57.948380 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c559dfd7-e575-4b22-8c00-a8061114f635 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:57.954734 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c559dfd7-e575-4b22-8c00-a8061114f635 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:57.955895 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c559dfd7-e575-4b22-8c00-a8061114f635 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:57.956537 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c559dfd7-e575-4b22-8c00-a8061114f635 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:57.960757 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c559dfd7-e575-4b22-8c00-a8061114f635 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:58.033913 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d428a403-1d55-4a2f-8d42-8efd89d9c3b1 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:58.052212 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d428a403-1d55-4a2f-8d42-8efd89d9c3b1 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:58.054229 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d428a403-1d55-4a2f-8d42-8efd89d9c3b1 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:58.076591 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d428a403-1d55-4a2f-8d42-8efd89d9c3b1 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1555 microversion: 2.91 time: 0.711568 Sep 08 10:49:58.077226 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1428/2817] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:49:57 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1555 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:49:58.081762 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c559dfd7-e575-4b22-8c00-a8061114f635 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:58.083034 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c559dfd7-e575-4b22-8c00-a8061114f635 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:58.088584 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d01a9da0-8f7b-4d42-90e4-3df624e9bb3a tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:58.089407 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c559dfd7-e575-4b22-8c00-a8061114f635 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:58.090294 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-c559dfd7-e575-4b22-8c00-a8061114f635 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lazy-loading 'fault' on Instance uuid bace4c1a-2c38-42b3-962d-ca87a3bfb7ba {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:49:58.103295 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d01a9da0-8f7b-4d42-90e4-3df624e9bb3a tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] [instance: e522775b-9d4f-4fee-beaa-61e1b0452ead] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:58.117396 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d01a9da0-8f7b-4d42-90e4-3df624e9bb3a tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:58.118159 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d01a9da0-8f7b-4d42-90e4-3df624e9bb3a tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:58.118790 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d01a9da0-8f7b-4d42-90e4-3df624e9bb3a tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:58.119786 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d01a9da0-8f7b-4d42-90e4-3df624e9bb3a tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:58.120405 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d01a9da0-8f7b-4d42-90e4-3df624e9bb3a tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:58.120983 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d01a9da0-8f7b-4d42-90e4-3df624e9bb3a tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:58.284864 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c559dfd7-e575-4b22-8c00-a8061114f635 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c291cbe955b4ee5abc98132dda0255e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f9a24cad014d7f827e8f3236dd5bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:58.296243 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c559dfd7-e575-4b22-8c00-a8061114f635 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/bace4c1a-2c38-42b3-962d-ca87a3bfb7ba" status: 200 len: 1331 microversion: 2.1 time: 0.361691 Sep 08 10:49:58.298434 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1390/2818] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:57 2022] GET /compute/v2.1/servers/bace4c1a-2c38-42b3-962d-ca87a3bfb7ba => generated 1331 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:58.313188 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-af80cdf8-6f40-40a3-b2ce-93d1234e65f3 req-ae899499-64d0-4d4a-bbcd-05a3782edc98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bace4c1a-2c38-42b3-962d-ca87a3bfb7ba", "name": "network-vif-deleted", "tag": "b523e95a-b010-42e0-aa5e-9e3222767ffb"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:49:58.331710 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-af80cdf8-6f40-40a3-b2ce-93d1234e65f3 req-ae899499-64d0-4d4a-bbcd-05a3782edc98 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:58.332258 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-af80cdf8-6f40-40a3-b2ce-93d1234e65f3 req-ae899499-64d0-4d4a-bbcd-05a3782edc98 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:58.333174 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-af80cdf8-6f40-40a3-b2ce-93d1234e65f3 req-ae899499-64d0-4d4a-bbcd-05a3782edc98 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:58.389841 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-af80cdf8-6f40-40a3-b2ce-93d1234e65f3 req-ae899499-64d0-4d4a-bbcd-05a3782edc98 service nova] Creating event network-vif-deleted:b523e95a-b010-42e0-aa5e-9e3222767ffb for instance bace4c1a-2c38-42b3-962d-ca87a3bfb7ba on n-h2-850501-12 Sep 08 10:49:58.416033 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-af80cdf8-6f40-40a3-b2ce-93d1234e65f3 req-ae899499-64d0-4d4a-bbcd-05a3782edc98 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116317 Sep 08 10:49:58.427273 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1391/2819] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:49:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:49:58.433166 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-66a93294-0715-48b5-b12b-74c97cf9a4c6 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:58.441631 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-66a93294-0715-48b5-b12b-74c97cf9a4c6 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] [instance: a2469f0a-d6bc-46ae-8905-049f2123dc0c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:58.462545 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-66a93294-0715-48b5-b12b-74c97cf9a4c6 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:58.468252 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-66a93294-0715-48b5-b12b-74c97cf9a4c6 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:58.469678 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-66a93294-0715-48b5-b12b-74c97cf9a4c6 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:58.470608 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-66a93294-0715-48b5-b12b-74c97cf9a4c6 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:58.478203 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-66a93294-0715-48b5-b12b-74c97cf9a4c6 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:58.479062 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-66a93294-0715-48b5-b12b-74c97cf9a4c6 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:58.796410 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d01a9da0-8f7b-4d42-90e4-3df624e9bb3a tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f58dabb2db74cedba25f856ad1a7df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63eba712ae82439ba53b37b774c332dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:58.811106 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d01a9da0-8f7b-4d42-90e4-3df624e9bb3a tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] 10.222.0.27 "GET /compute/v2.1/servers/e522775b-9d4f-4fee-beaa-61e1b0452ead" status: 200 len: 1351 microversion: 2.1 time: 0.726269 Sep 08 10:49:58.811978 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1429/2820] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:58 2022] GET /compute/v2.1/servers/e522775b-9d4f-4fee-beaa-61e1b0452ead => generated 1351 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:58.940298 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cad043f5-4162-4458-b1e9-2bb5d9367e1c tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:58.940545 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-66a93294-0715-48b5-b12b-74c97cf9a4c6 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fb4a7dae3346d39f70c51055cfd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065d7179ebd6460cb039bd1624296b57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:58.942558 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cad043f5-4162-4458-b1e9-2bb5d9367e1c tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] [instance: f96451ab-896c-4652-8e89-ba210495b5e8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:58.955756 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-66a93294-0715-48b5-b12b-74c97cf9a4c6 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] 10.222.0.27 "GET /compute/v2.1/servers/a2469f0a-d6bc-46ae-8905-049f2123dc0c" status: 200 len: 1647 microversion: 2.1 time: 0.526649 Sep 08 10:49:58.956257 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cad043f5-4162-4458-b1e9-2bb5d9367e1c tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:58.956950 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cad043f5-4162-4458-b1e9-2bb5d9367e1c tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:58.959937 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cad043f5-4162-4458-b1e9-2bb5d9367e1c tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:58.961276 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cad043f5-4162-4458-b1e9-2bb5d9367e1c tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:58.965178 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cad043f5-4162-4458-b1e9-2bb5d9367e1c tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:58.966391 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cad043f5-4162-4458-b1e9-2bb5d9367e1c tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:58.981222 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1392/2821] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:58 2022] GET /compute/v2.1/servers/a2469f0a-d6bc-46ae-8905-049f2123dc0c => generated 1647 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:59.110802 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-31f132a2-d8ed-4327-97bb-56f6dd94389c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:59.111774 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-31f132a2-d8ed-4327-97bb-56f6dd94389c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:59.124703 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-31f132a2-d8ed-4327-97bb-56f6dd94389c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:59.125549 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-31f132a2-d8ed-4327-97bb-56f6dd94389c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:59.126164 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-31f132a2-d8ed-4327-97bb-56f6dd94389c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:59.127015 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-31f132a2-d8ed-4327-97bb-56f6dd94389c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:59.127648 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-31f132a2-d8ed-4327-97bb-56f6dd94389c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:59.128321 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-31f132a2-d8ed-4327-97bb-56f6dd94389c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:59.321869 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cad043f5-4162-4458-b1e9-2bb5d9367e1c tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0c66b5a004df886b3d973a978c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc5f459e4a143d1b8bf1c5c64153644', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:59.335313 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cad043f5-4162-4458-b1e9-2bb5d9367e1c tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] 10.222.0.27 "GET /compute/v2.1/servers/f96451ab-896c-4652-8e89-ba210495b5e8" status: 200 len: 1320 microversion: 2.1 time: 0.399036 Sep 08 10:49:59.337846 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1430/2822] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:58 2022] GET /compute/v2.1/servers/f96451ab-896c-4652-8e89-ba210495b5e8 => generated 1320 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:59.351932 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c90a4c54-deda-415d-88d2-d5d85d45679f tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:59.352553 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c90a4c54-deda-415d-88d2-d5d85d45679f tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: bace4c1a-2c38-42b3-962d-ca87a3bfb7ba] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:59.387654 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c90a4c54-deda-415d-88d2-d5d85d45679f tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:59.388349 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c90a4c54-deda-415d-88d2-d5d85d45679f tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:59.388805 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c90a4c54-deda-415d-88d2-d5d85d45679f tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:59.394109 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c90a4c54-deda-415d-88d2-d5d85d45679f tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:59.394607 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c90a4c54-deda-415d-88d2-d5d85d45679f tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:59.398046 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c90a4c54-deda-415d-88d2-d5d85d45679f tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:59.511264 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-c90a4c54-deda-415d-88d2-d5d85d45679f tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] HTTP exception thrown: Instance bace4c1a-2c38-42b3-962d-ca87a3bfb7ba could not be found. Sep 08 10:49:59.518376 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c90a4c54-deda-415d-88d2-d5d85d45679f tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Request method failure captured: Sep 08 10:49:59.518376 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/bace4c1a-2c38-42b3-962d-ca87a3bfb7ba HTTP/1.1 Sep 08 10:49:59.518376 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:49:59.518376 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:49:59.518376 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:49:59.518376 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:49:59.518376 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:49:59.518376 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:49:59.518376 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:49:59.518376 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:49:59.518376 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcf85nxlXglNpNUDafAex8bEd4FqCO21NTPeXDX2uUnTAK4RtQmB0Zln5OyfaDsL03XE7NxjFWJINQM-4CVmZPvJMmjswkfAMS-LTodBU21IQa_AJm8NdfZKIu9JkoC4h7calajGQneT5j1jgUkjySqAUeFvWcq2xoj6sNreqExg8K8 Sep 08 10:49:59.518376 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:49:59.518376 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:49:59.518376 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:49:59.518376 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:49:59.518376 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:49:59.518376 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:49:59.518376 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 20f9a24cad014d7f827e8f3236dd5bae Sep 08 10:49:59.518376 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-AttachVolumeNegativeTest-20693983 Sep 08 10:49:59.518376 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:49:59.518376 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:49:59.518376 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/20f9a24cad014d7f827e8f3236dd5bae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/20f9a24cad014d7f827e8f3236dd5bae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_20f9a24cad014d7f827e8f3236dd5bae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/20f9a24cad014d7f827e8f3236dd5bae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:49:59.518376 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-AttachVolumeNegativeTest-20693983 Sep 08 10:49:59.518376 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 20f9a24cad014d7f827e8f3236dd5bae Sep 08 10:49:59.518376 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-20693983 Sep 08 10:49:59.518376 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-AttachVolumeNegativeTest-20693983-project Sep 08 10:49:59.518376 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:49:59.518376 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:49:59.518376 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 5c291cbe955b4ee5abc98132dda0255e Sep 08 10:49:59.518376 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-AttachVolumeNegativeTest-20693983-project Sep 08 10:49:59.518376 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:49:59.518376 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance bace4c1a-2c38-42b3-962d-ca87a3bfb7ba could not be found. Sep 08 10:49:59.518376 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'bace4c1a-2c38-42b3-962d-ca87a3bfb7ba'} Sep 08 10:49:59.518376 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:49:59.518376 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:49:59.518376 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:49:59.518376 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:49:59.518376 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:49:59.518376 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:49:59.518376 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:49:59.518376 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:49:59.518376 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:49:59.518376 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:49:59.518376 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bace4c1a-2c38-42b3-962d-ca87a3bfb7ba could not be found. Sep 08 10:49:59.518376 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:49:59.518376 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:49:59.518376 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:49:59.518376 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:49:59.518376 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:49:59.518376 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:49:59.518376 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:49:59.518376 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:49:59.518376 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:49:59.518376 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:49:59.518376 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:49:59.518376 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:49:59.518376 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:49:59.518376 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:49:59.518376 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:49:59.518376 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:49:59.518376 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bace4c1a-2c38-42b3-962d-ca87a3bfb7ba could not be found. Sep 08 10:49:59.518376 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:49:59.518376 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:49:59.518376 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:49:59.523013 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:49:59.523013 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:49:59.523013 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:49:59.523013 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:49:59.523013 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:49:59.523013 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bace4c1a-2c38-42b3-962d-ca87a3bfb7ba could not be found. Sep 08 10:49:59.523013 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:49:59.523013 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c90a4c54-deda-415d-88d2-d5d85d45679f tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Returning 404 to user: Instance bace4c1a-2c38-42b3-962d-ca87a3bfb7ba could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:49:59.523013 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c90a4c54-deda-415d-88d2-d5d85d45679f tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/bace4c1a-2c38-42b3-962d-ca87a3bfb7ba" status: 404 len: 111 microversion: 2.1 time: 0.183334 Sep 08 10:49:59.524285 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1431/2823] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:59 2022] GET /compute/v2.1/servers/bace4c1a-2c38-42b3-962d-ca87a3bfb7ba => generated 111 bytes in 186 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:49:59.537247 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-738d9f8f-9af3-44e4-9820-11859c562888 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '.version_select at 0x7f68e42dd160>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:59.655669 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-738d9f8f-9af3-44e4-9820-11859c562888 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-838495828" status: 202 len: 0 microversion: 2.1 time: 0.126882 Sep 08 10:49:59.664630 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-31f132a2-d8ed-4327-97bb-56f6dd94389c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:59.668092 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1432/2824] 10.222.0.27 () {58 vars in 1218 bytes} [Thu Sep 8 10:49:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-838495828 => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:49:59.674040 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-31f132a2-d8ed-4327-97bb-56f6dd94389c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:59.675886 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-31f132a2-d8ed-4327-97bb-56f6dd94389c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:59.682945 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-31f132a2-d8ed-4327-97bb-56f6dd94389c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1555 microversion: 2.91 time: 0.576130 Sep 08 10:49:59.702070 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1393/2825] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:49:59 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1555 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:49:59.836561 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c56ed064-4cc6-4c38-bd35-fcf0b921999f tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:59.837050 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c56ed064-4cc6-4c38-bd35-fcf0b921999f tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] [instance: e522775b-9d4f-4fee-beaa-61e1b0452ead] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:59.850419 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c56ed064-4cc6-4c38-bd35-fcf0b921999f tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:59.854981 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c56ed064-4cc6-4c38-bd35-fcf0b921999f tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:59.854981 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c56ed064-4cc6-4c38-bd35-fcf0b921999f tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:59.858201 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c56ed064-4cc6-4c38-bd35-fcf0b921999f tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:59.858952 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c56ed064-4cc6-4c38-bd35-fcf0b921999f tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:59.868533 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c56ed064-4cc6-4c38-bd35-fcf0b921999f tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:59.988463 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c534dac9-0796-48cd-98e2-3deb0355d7f2 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:59.989980 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c534dac9-0796-48cd-98e2-3deb0355d7f2 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] [instance: a2469f0a-d6bc-46ae-8905-049f2123dc0c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:00.002868 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c534dac9-0796-48cd-98e2-3deb0355d7f2 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:00.003442 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c534dac9-0796-48cd-98e2-3deb0355d7f2 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:00.005508 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c534dac9-0796-48cd-98e2-3deb0355d7f2 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:00.006316 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c534dac9-0796-48cd-98e2-3deb0355d7f2 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:00.006998 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c534dac9-0796-48cd-98e2-3deb0355d7f2 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:00.011124 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c534dac9-0796-48cd-98e2-3deb0355d7f2 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:00.976400 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c56ed064-4cc6-4c38-bd35-fcf0b921999f tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f58dabb2db74cedba25f856ad1a7df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63eba712ae82439ba53b37b774c332dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:00.992930 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c56ed064-4cc6-4c38-bd35-fcf0b921999f tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] 10.222.0.27 "GET /compute/v2.1/servers/e522775b-9d4f-4fee-beaa-61e1b0452ead" status: 200 len: 1351 microversion: 2.1 time: 1.155077 Sep 08 10:50:00.994603 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1433/2826] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:59 2022] GET /compute/v2.1/servers/e522775b-9d4f-4fee-beaa-61e1b0452ead => generated 1351 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:01.003390 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d796a06b-7e9e-4abd-b196-47b85824a699 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:01.011855 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d796a06b-7e9e-4abd-b196-47b85824a699 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] [instance: f96451ab-896c-4652-8e89-ba210495b5e8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:01.025067 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d796a06b-7e9e-4abd-b196-47b85824a699 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:01.028030 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d796a06b-7e9e-4abd-b196-47b85824a699 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:01.032106 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d796a06b-7e9e-4abd-b196-47b85824a699 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:01.033298 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d796a06b-7e9e-4abd-b196-47b85824a699 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:01.036415 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d796a06b-7e9e-4abd-b196-47b85824a699 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:01.037194 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d796a06b-7e9e-4abd-b196-47b85824a699 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:01.224615 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c534dac9-0796-48cd-98e2-3deb0355d7f2 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fb4a7dae3346d39f70c51055cfd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065d7179ebd6460cb039bd1624296b57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:01.237012 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c534dac9-0796-48cd-98e2-3deb0355d7f2 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] 10.222.0.27 "GET /compute/v2.1/servers/a2469f0a-d6bc-46ae-8905-049f2123dc0c" status: 200 len: 1647 microversion: 2.1 time: 1.249310 Sep 08 10:50:01.240019 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1394/2827] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:59 2022] GET /compute/v2.1/servers/a2469f0a-d6bc-46ae-8905-049f2123dc0c => generated 1647 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:50:01.252973 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-399b7707-fa6b-4d78-8bd8-13c61db0f22d tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:01.257599 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-399b7707-fa6b-4d78-8bd8-13c61db0f22d tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:01.276169 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-399b7707-fa6b-4d78-8bd8-13c61db0f22d tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:01.278594 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-399b7707-fa6b-4d78-8bd8-13c61db0f22d tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:01.280546 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-399b7707-fa6b-4d78-8bd8-13c61db0f22d tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:01.283593 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-399b7707-fa6b-4d78-8bd8-13c61db0f22d tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:01.285993 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-399b7707-fa6b-4d78-8bd8-13c61db0f22d tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:01.288596 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-399b7707-fa6b-4d78-8bd8-13c61db0f22d tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:01.437362 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=8 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:50:01.595429 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-399b7707-fa6b-4d78-8bd8-13c61db0f22d tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:01.619011 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-399b7707-fa6b-4d78-8bd8-13c61db0f22d tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:01.633281 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-399b7707-fa6b-4d78-8bd8-13c61db0f22d tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:01.650847 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=28 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:50:01.678117 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-399b7707-fa6b-4d78-8bd8-13c61db0f22d tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1555 microversion: 2.91 time: 0.430175 Sep 08 10:50:01.679092 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1395/2828] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:50:01 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1555 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:50:01.814353 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d796a06b-7e9e-4abd-b196-47b85824a699 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0c66b5a004df886b3d973a978c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc5f459e4a143d1b8bf1c5c64153644', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:01.828046 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d796a06b-7e9e-4abd-b196-47b85824a699 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] 10.222.0.27 "GET /compute/v2.1/servers/f96451ab-896c-4652-8e89-ba210495b5e8" status: 200 len: 1320 microversion: 2.1 time: 0.832025 Sep 08 10:50:01.845060 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1434/2829] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:00 2022] GET /compute/v2.1/servers/f96451ab-896c-4652-8e89-ba210495b5e8 => generated 1320 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:01.859885 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-09340f9a-57e1-4fca-a416-dcd193f7f639 req-fb2e19b2-a22d-4eee-88f1-c8839ebf1856 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2469f0a-d6bc-46ae-8905-049f2123dc0c", "name": "network-vif-deleted", "tag": "f2d328aa-1a87-4e45-9e61-2691302ceff1"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:50:01.929934 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-09340f9a-57e1-4fca-a416-dcd193f7f639 req-fb2e19b2-a22d-4eee-88f1-c8839ebf1856 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:01.930441 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-09340f9a-57e1-4fca-a416-dcd193f7f639 req-fb2e19b2-a22d-4eee-88f1-c8839ebf1856 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:01.930873 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-09340f9a-57e1-4fca-a416-dcd193f7f639 req-fb2e19b2-a22d-4eee-88f1-c8839ebf1856 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:02.004117 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-09340f9a-57e1-4fca-a416-dcd193f7f639 req-fb2e19b2-a22d-4eee-88f1-c8839ebf1856 service nova] Creating event network-vif-deleted:f2d328aa-1a87-4e45-9e61-2691302ceff1 for instance a2469f0a-d6bc-46ae-8905-049f2123dc0c on n-h1-850501-12 Sep 08 10:50:02.029731 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-09340f9a-57e1-4fca-a416-dcd193f7f639 req-fb2e19b2-a22d-4eee-88f1-c8839ebf1856 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.191557 Sep 08 10:50:02.033260 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1435/2830] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:50:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:50:02.046674 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8350800c-b826-431c-975f-e9d3a3b763e8 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:02.050531 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8350800c-b826-431c-975f-e9d3a3b763e8 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] [instance: e522775b-9d4f-4fee-beaa-61e1b0452ead] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:02.093564 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8350800c-b826-431c-975f-e9d3a3b763e8 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:02.094088 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8350800c-b826-431c-975f-e9d3a3b763e8 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:02.094586 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8350800c-b826-431c-975f-e9d3a3b763e8 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:02.095323 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8350800c-b826-431c-975f-e9d3a3b763e8 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:02.101316 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8350800c-b826-431c-975f-e9d3a3b763e8 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:02.101884 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8350800c-b826-431c-975f-e9d3a3b763e8 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:02.264339 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-74298d4d-aa03-48dc-b882-331fba633365 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-118421985", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:50:02.402410 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-74298d4d-aa03-48dc-b882-331fba633365 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] validate_networks() for None {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:50:02.909237 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-74298d4d-aa03-48dc-b882-331fba633365 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:50:02.909675 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-74298d4d-aa03-48dc-b882-331fba633365 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:50:02.910201 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-74298d4d-aa03-48dc-b882-331fba633365 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:50:02.910822 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-74298d4d-aa03-48dc-b882-331fba633365 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:50:02.911314 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-74298d4d-aa03-48dc-b882-331fba633365 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:50:02.938014 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-74298d4d-aa03-48dc-b882-331fba633365 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:02.938670 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-74298d4d-aa03-48dc-b882-331fba633365 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:02.939170 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-74298d4d-aa03-48dc-b882-331fba633365 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:02.939929 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-74298d4d-aa03-48dc-b882-331fba633365 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:02.940393 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-74298d4d-aa03-48dc-b882-331fba633365 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:02.940825 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-74298d4d-aa03-48dc-b882-331fba633365 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:02.996813 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-74298d4d-aa03-48dc-b882-331fba633365 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Getting quotas for project 8737f6bb9629491d958debd24aa6f9a0. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:50:03.007069 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-74298d4d-aa03-48dc-b882-331fba633365 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Getting quotas for user 3db1b83d2b924ed4855ebe9360c9b46f and project 8737f6bb9629491d958debd24aa6f9a0. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:50:03.034769 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-74298d4d-aa03-48dc-b882-331fba633365 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:50:03.040176 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-74298d4d-aa03-48dc-b882-331fba633365 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] [instance: 9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:50:03.126476 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-74298d4d-aa03-48dc-b882-331fba633365 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.446118 Sep 08 10:50:03.134739 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1396/2831] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:50:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1455 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:50:03.139938 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cc29efda-1d1a-477b-b663-cdf63eb2c5f5 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:03.140655 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cc29efda-1d1a-477b-b663-cdf63eb2c5f5 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] [instance: a2469f0a-d6bc-46ae-8905-049f2123dc0c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:03.165838 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc29efda-1d1a-477b-b663-cdf63eb2c5f5 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:03.166737 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc29efda-1d1a-477b-b663-cdf63eb2c5f5 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:03.167490 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc29efda-1d1a-477b-b663-cdf63eb2c5f5 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:03.168797 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc29efda-1d1a-477b-b663-cdf63eb2c5f5 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:03.172309 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc29efda-1d1a-477b-b663-cdf63eb2c5f5 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:03.173077 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc29efda-1d1a-477b-b663-cdf63eb2c5f5 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:03.217346 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-cc29efda-1d1a-477b-b663-cdf63eb2c5f5 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] HTTP exception thrown: Instance a2469f0a-d6bc-46ae-8905-049f2123dc0c could not be found. Sep 08 10:50:03.219059 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cc29efda-1d1a-477b-b663-cdf63eb2c5f5 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Request method failure captured: Sep 08 10:50:03.219059 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/a2469f0a-d6bc-46ae-8905-049f2123dc0c HTTP/1.1 Sep 08 10:50:03.219059 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:50:03.219059 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:50:03.219059 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:50:03.219059 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:50:03.219059 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:50:03.219059 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:50:03.219059 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:50:03.219059 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:50:03.219059 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGch_nZ8lA6jzUdA__pVeubAfLPLZLfWeBiEuGQVPK0Y137NLp-iu8VfoWNWM0eD-6CxQagh9VjnJBOjFq9m1ETbs9_9ROW2svn9EqasQKx2d0mUqin1RXmMIXFp2uoqIyGJO79LeATMKNYe_GxT8u_vbudCemg2EUJ6laZZ2C02JbZI Sep 08 10:50:03.219059 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:50:03.219059 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:50:03.219059 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:50:03.219059 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:50:03.219059 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:50:03.219059 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:50:03.219059 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 065d7179ebd6460cb039bd1624296b57 Sep 08 10:50:03.219059 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServersTestManualDisk-1364258002 Sep 08 10:50:03.219059 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:50:03.219059 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:50:03.219059 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/065d7179ebd6460cb039bd1624296b57"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/065d7179ebd6460cb039bd1624296b57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_065d7179ebd6460cb039bd1624296b57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/065d7179ebd6460cb039bd1624296b57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:50:03.219059 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServersTestManualDisk-1364258002 Sep 08 10:50:03.219059 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 065d7179ebd6460cb039bd1624296b57 Sep 08 10:50:03.219059 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServersTestManualDisk-1364258002 Sep 08 10:50:03.219059 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServersTestManualDisk-1364258002-project Sep 08 10:50:03.219059 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:50:03.219059 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:50:03.219059 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 54fb4a7dae3346d39f70c51055cfd455 Sep 08 10:50:03.219059 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServersTestManualDisk-1364258002-project Sep 08 10:50:03.219059 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:50:03.219059 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance a2469f0a-d6bc-46ae-8905-049f2123dc0c could not be found. Sep 08 10:50:03.219059 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': 'a2469f0a-d6bc-46ae-8905-049f2123dc0c'} Sep 08 10:50:03.219059 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:50:03.219059 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:50:03.219059 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:50:03.219059 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:50:03.219059 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:50:03.219059 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:50:03.219059 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:50:03.219059 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:50:03.219059 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:50:03.219059 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:50:03.219059 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2469f0a-d6bc-46ae-8905-049f2123dc0c could not be found. Sep 08 10:50:03.219059 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:50:03.219059 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:50:03.219059 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:50:03.219059 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:50:03.219059 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:50:03.219059 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:50:03.219059 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:50:03.219059 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:50:03.219059 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:50:03.219059 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:50:03.219059 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:50:03.219059 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:50:03.219059 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:50:03.219059 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:50:03.219059 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:50:03.219059 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:50:03.219059 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2469f0a-d6bc-46ae-8905-049f2123dc0c could not be found. Sep 08 10:50:03.219059 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:50:03.219059 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:50:03.219059 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:50:03.225541 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:50:03.225541 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:50:03.225541 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:50:03.225541 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:50:03.225541 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:50:03.225541 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2469f0a-d6bc-46ae-8905-049f2123dc0c could not be found. Sep 08 10:50:03.225541 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:50:03.225541 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cc29efda-1d1a-477b-b663-cdf63eb2c5f5 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Returning 404 to user: Instance a2469f0a-d6bc-46ae-8905-049f2123dc0c could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:50:03.225541 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cc29efda-1d1a-477b-b663-cdf63eb2c5f5 tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] 10.222.0.27 "GET /compute/v2.1/servers/a2469f0a-d6bc-46ae-8905-049f2123dc0c" status: 404 len: 111 microversion: 2.1 time: 0.084921 Sep 08 10:50:03.225541 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1397/2832] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:03 2022] GET /compute/v2.1/servers/a2469f0a-d6bc-46ae-8905-049f2123dc0c => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:50:03.231199 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-59e39742-1f91-44dd-9fee-1e03785fc6af tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:03.234227 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-59e39742-1f91-44dd-9fee-1e03785fc6af tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:03.248315 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-59e39742-1f91-44dd-9fee-1e03785fc6af tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:03.251708 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-59e39742-1f91-44dd-9fee-1e03785fc6af tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:03.252190 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-59e39742-1f91-44dd-9fee-1e03785fc6af tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:03.252947 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-59e39742-1f91-44dd-9fee-1e03785fc6af tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:03.256316 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-59e39742-1f91-44dd-9fee-1e03785fc6af tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:03.256796 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-59e39742-1f91-44dd-9fee-1e03785fc6af tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:03.402088 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-59e39742-1f91-44dd-9fee-1e03785fc6af tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:03.443861 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-59e39742-1f91-44dd-9fee-1e03785fc6af tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:03.448269 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-59e39742-1f91-44dd-9fee-1e03785fc6af tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:03.470435 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-59e39742-1f91-44dd-9fee-1e03785fc6af tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1555 microversion: 2.91 time: 0.242142 Sep 08 10:50:03.472425 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1398/2833] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:50:03 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1555 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:50:03.496760 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-05aca88e-2a0b-4e7e-bdb1-ea39a9fc59bd tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:03.501360 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-05aca88e-2a0b-4e7e-bdb1-ea39a9fc59bd tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] [instance: f96451ab-896c-4652-8e89-ba210495b5e8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:03.523722 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-05aca88e-2a0b-4e7e-bdb1-ea39a9fc59bd tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:03.525369 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-05aca88e-2a0b-4e7e-bdb1-ea39a9fc59bd tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:03.527385 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-05aca88e-2a0b-4e7e-bdb1-ea39a9fc59bd tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:03.528226 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-05aca88e-2a0b-4e7e-bdb1-ea39a9fc59bd tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:03.528712 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-05aca88e-2a0b-4e7e-bdb1-ea39a9fc59bd tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:03.531963 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-05aca88e-2a0b-4e7e-bdb1-ea39a9fc59bd tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:03.625333 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8350800c-b826-431c-975f-e9d3a3b763e8 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f58dabb2db74cedba25f856ad1a7df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63eba712ae82439ba53b37b774c332dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:03.669663 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8350800c-b826-431c-975f-e9d3a3b763e8 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] 10.222.0.27 "GET /compute/v2.1/servers/e522775b-9d4f-4fee-beaa-61e1b0452ead" status: 200 len: 1351 microversion: 2.1 time: 1.634506 Sep 08 10:50:03.682361 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1436/2834] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:02 2022] GET /compute/v2.1/servers/e522775b-9d4f-4fee-beaa-61e1b0452ead => generated 1351 bytes in 1648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:03.694939 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3a7cedb1-d470-4b17-a206-9a8c8d6073df tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:03.695895 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3a7cedb1-d470-4b17-a206-9a8c8d6073df tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] [instance: 9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:03.848868 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-05aca88e-2a0b-4e7e-bdb1-ea39a9fc59bd tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0c66b5a004df886b3d973a978c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc5f459e4a143d1b8bf1c5c64153644', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:03.861336 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-05aca88e-2a0b-4e7e-bdb1-ea39a9fc59bd tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] 10.222.0.27 "GET /compute/v2.1/servers/f96451ab-896c-4652-8e89-ba210495b5e8" status: 200 len: 1320 microversion: 2.1 time: 0.382659 Sep 08 10:50:03.864213 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1399/2835] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:03 2022] GET /compute/v2.1/servers/f96451ab-896c-4652-8e89-ba210495b5e8 => generated 1320 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:03.872348 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-41267a75-27d7-4be0-a9f7-6fb56c5020ff tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] Calling method '.version_select at 0x7f68e40ad280>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:03.956826 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-41267a75-27d7-4be0-a9f7-6fb56c5020ff tempest-ServersTestManualDisk-1364258002 tempest-ServersTestManualDisk-1364258002-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1259443957" status: 202 len: 0 microversion: 2.1 time: 0.090994 Sep 08 10:50:03.961775 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1400/2836] 10.222.0.27 () {58 vars in 1221 bytes} [Thu Sep 8 10:50:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1259443957 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:50:03.967981 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-40a5c52b-1bee-4d64-8c71-145d2950602d tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Action: 'create', calling method: .version_select at 0x7f68e40f28b0>, body: {"keypair": {"name": "tempest-keypair-1285015287", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEEZB1n5uvN4UyVYPhuwi8XkND9l9a8w9MgQ2S3OUUU0iRpMMF1a4H1p84SRqW3gpb2GLBewCZbITY8rGZod+oaRlDoOb9AaMUkPeOa7F43Nxqm8Tid1XWfNeWZtU7C6sA=="}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:50:03.990351 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-40a5c52b-1bee-4d64-8c71-145d2950602d tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Getting quotas for project 20f9a24cad014d7f827e8f3236dd5bae. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:50:03.999344 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-40a5c52b-1bee-4d64-8c71-145d2950602d tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Getting quotas for user 5c291cbe955b4ee5abc98132dda0255e and project 20f9a24cad014d7f827e8f3236dd5bae. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:50:04.013545 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:50:04.051858 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-40a5c52b-1bee-4d64-8c71-145d2950602d tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.088386 Sep 08 10:50:04.066467 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1401/2837] 10.222.0.27 () {60 vars in 1159 bytes} [Thu Sep 8 10:50:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:50:04.203615 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3a7cedb1-d470-4b17-a206-9a8c8d6073df tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db1b83d2b924ed4855ebe9360c9b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8737f6bb9629491d958debd24aa6f9a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:04.224582 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3a7cedb1-d470-4b17-a206-9a8c8d6073df tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] 10.222.0.27 "GET /compute/v2.1/servers/9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf" status: 200 len: 1216 microversion: 2.1 time: 0.536952 Sep 08 10:50:04.225227 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1437/2838] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:03 2022] GET /compute/v2.1/servers/9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf => generated 1216 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:04.463376 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-2fbf9cc1-bc97-4816-8b3a-2244a1994717 req-93468cf7-c94c-4349-8ad1-99d88bef1d16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ef65322-ccb1-4703-b15f-4ab8306b32de", "name": "network-vif-plugged", "status": "completed", "tag": "01beadcd-0dc7-47e2-9884-a66d9958f0e8"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:50:04.500422 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-2fbf9cc1-bc97-4816-8b3a-2244a1994717 req-93468cf7-c94c-4349-8ad1-99d88bef1d16 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:04.501524 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-2fbf9cc1-bc97-4816-8b3a-2244a1994717 req-93468cf7-c94c-4349-8ad1-99d88bef1d16 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:04.502201 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-2fbf9cc1-bc97-4816-8b3a-2244a1994717 req-93468cf7-c94c-4349-8ad1-99d88bef1d16 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:04.502324 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-36902458-910f-4374-a78b-bd63b688b79b tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:04.502930 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-36902458-910f-4374-a78b-bd63b688b79b tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:04.519256 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36902458-910f-4374-a78b-bd63b688b79b tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:04.520399 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36902458-910f-4374-a78b-bd63b688b79b tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:04.520809 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36902458-910f-4374-a78b-bd63b688b79b tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:04.521806 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36902458-910f-4374-a78b-bd63b688b79b tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:04.522385 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36902458-910f-4374-a78b-bd63b688b79b tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:04.523137 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36902458-910f-4374-a78b-bd63b688b79b tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:04.526215 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-2fbf9cc1-bc97-4816-8b3a-2244a1994717 req-93468cf7-c94c-4349-8ad1-99d88bef1d16 service nova] Creating event network-vif-plugged:01beadcd-0dc7-47e2-9884-a66d9958f0e8 for instance 7ef65322-ccb1-4703-b15f-4ab8306b32de on n-h2-850501-12 Sep 08 10:50:04.539567 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-2fbf9cc1-bc97-4816-8b3a-2244a1994717 req-93468cf7-c94c-4349-8ad1-99d88bef1d16 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093181 Sep 08 10:50:04.541869 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1402/2839] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:50:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:50:04.705090 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-36902458-910f-4374-a78b-bd63b688b79b tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:04.705779 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a21b845a-662b-41eb-8f5f-00079750fd9d tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:04.708484 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a21b845a-662b-41eb-8f5f-00079750fd9d tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] [instance: e522775b-9d4f-4fee-beaa-61e1b0452ead] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:04.726250 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-36902458-910f-4374-a78b-bd63b688b79b tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:04.733724 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-36902458-910f-4374-a78b-bd63b688b79b tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:04.737003 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a21b845a-662b-41eb-8f5f-00079750fd9d tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:04.739754 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a21b845a-662b-41eb-8f5f-00079750fd9d tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:04.740196 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a21b845a-662b-41eb-8f5f-00079750fd9d tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:04.743990 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a21b845a-662b-41eb-8f5f-00079750fd9d tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:04.744952 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a21b845a-662b-41eb-8f5f-00079750fd9d tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:04.748438 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a21b845a-662b-41eb-8f5f-00079750fd9d tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:04.750703 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-36902458-910f-4374-a78b-bd63b688b79b tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1537 microversion: 2.91 time: 0.252175 Sep 08 10:50:04.757548 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1438/2840] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:50:04 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1537 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:50:04.890440 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c0dd3c7a-430b-4f14-ad9b-53759263a16d tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:04.891553 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c0dd3c7a-430b-4f14-ad9b-53759263a16d tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] [instance: f96451ab-896c-4652-8e89-ba210495b5e8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:04.902605 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c0dd3c7a-430b-4f14-ad9b-53759263a16d tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:04.913902 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c0dd3c7a-430b-4f14-ad9b-53759263a16d tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:04.914363 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c0dd3c7a-430b-4f14-ad9b-53759263a16d tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:04.915482 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c0dd3c7a-430b-4f14-ad9b-53759263a16d tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:04.915976 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c0dd3c7a-430b-4f14-ad9b-53759263a16d tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:04.916411 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c0dd3c7a-430b-4f14-ad9b-53759263a16d tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:05.172746 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a21b845a-662b-41eb-8f5f-00079750fd9d tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f58dabb2db74cedba25f856ad1a7df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63eba712ae82439ba53b37b774c332dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:05.200789 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a21b845a-662b-41eb-8f5f-00079750fd9d tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] 10.222.0.27 "GET /compute/v2.1/servers/e522775b-9d4f-4fee-beaa-61e1b0452ead" status: 200 len: 1351 microversion: 2.1 time: 0.499157 Sep 08 10:50:05.201464 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1403/2841] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:04 2022] GET /compute/v2.1/servers/e522775b-9d4f-4fee-beaa-61e1b0452ead => generated 1351 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:50:05.251539 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-96fbfc3c-601f-4d31-8be5-95901360ebd0 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:05.252283 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-96fbfc3c-601f-4d31-8be5-95901360ebd0 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] [instance: 9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:05.273146 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-96fbfc3c-601f-4d31-8be5-95901360ebd0 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:05.273663 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-96fbfc3c-601f-4d31-8be5-95901360ebd0 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:05.274649 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-96fbfc3c-601f-4d31-8be5-95901360ebd0 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:05.276011 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-96fbfc3c-601f-4d31-8be5-95901360ebd0 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:05.278730 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-96fbfc3c-601f-4d31-8be5-95901360ebd0 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:05.279433 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-96fbfc3c-601f-4d31-8be5-95901360ebd0 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:05.453690 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-96fbfc3c-601f-4d31-8be5-95901360ebd0 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db1b83d2b924ed4855ebe9360c9b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8737f6bb9629491d958debd24aa6f9a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:05.471085 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-96fbfc3c-601f-4d31-8be5-95901360ebd0 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] 10.222.0.27 "GET /compute/v2.1/servers/9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf" status: 200 len: 1212 microversion: 2.1 time: 0.222668 Sep 08 10:50:05.473990 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1404/2842] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:05 2022] GET /compute/v2.1/servers/9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf => generated 1212 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:05.655233 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c0dd3c7a-430b-4f14-ad9b-53759263a16d tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0c66b5a004df886b3d973a978c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc5f459e4a143d1b8bf1c5c64153644', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:05.671832 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c0dd3c7a-430b-4f14-ad9b-53759263a16d tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] 10.222.0.27 "GET /compute/v2.1/servers/f96451ab-896c-4652-8e89-ba210495b5e8" status: 200 len: 1320 microversion: 2.1 time: 0.782690 Sep 08 10:50:05.672525 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1439/2843] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:04 2022] GET /compute/v2.1/servers/f96451ab-896c-4652-8e89-ba210495b5e8 => generated 1320 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:05.807614 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5161f471-6a6f-46cb-b4b3-9d23bed529b8 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:05.812271 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5161f471-6a6f-46cb-b4b3-9d23bed529b8 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:05.844205 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5161f471-6a6f-46cb-b4b3-9d23bed529b8 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:05.844887 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5161f471-6a6f-46cb-b4b3-9d23bed529b8 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:05.845771 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5161f471-6a6f-46cb-b4b3-9d23bed529b8 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:05.852080 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5161f471-6a6f-46cb-b4b3-9d23bed529b8 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:05.852588 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5161f471-6a6f-46cb-b4b3-9d23bed529b8 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:05.853056 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5161f471-6a6f-46cb-b4b3-9d23bed529b8 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:06.152067 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5161f471-6a6f-46cb-b4b3-9d23bed529b8 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:06.170668 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5161f471-6a6f-46cb-b4b3-9d23bed529b8 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:06.172168 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5161f471-6a6f-46cb-b4b3-9d23bed529b8 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:06.205720 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5161f471-6a6f-46cb-b4b3-9d23bed529b8 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1537 microversion: 2.91 time: 0.397368 Sep 08 10:50:06.228388 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1405/2844] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:50:05 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1537 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:50:06.232876 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-091bcd68-bdd4-49b3-8e71-1fe5bb6416a4 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:06.233818 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-091bcd68-bdd4-49b3-8e71-1fe5bb6416a4 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] [instance: e522775b-9d4f-4fee-beaa-61e1b0452ead] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:06.251654 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-091bcd68-bdd4-49b3-8e71-1fe5bb6416a4 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:06.252367 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-091bcd68-bdd4-49b3-8e71-1fe5bb6416a4 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:06.258821 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-091bcd68-bdd4-49b3-8e71-1fe5bb6416a4 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:06.263588 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-091bcd68-bdd4-49b3-8e71-1fe5bb6416a4 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:06.266834 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-091bcd68-bdd4-49b3-8e71-1fe5bb6416a4 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:06.267605 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-091bcd68-bdd4-49b3-8e71-1fe5bb6416a4 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:06.508284 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3bffd0d4-7f47-4347-bb53-a4702591b5a7 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:06.510072 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3bffd0d4-7f47-4347-bb53-a4702591b5a7 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] [instance: 9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:06.528972 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3bffd0d4-7f47-4347-bb53-a4702591b5a7 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:06.540236 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3bffd0d4-7f47-4347-bb53-a4702591b5a7 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:06.542520 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3bffd0d4-7f47-4347-bb53-a4702591b5a7 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:06.543869 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3bffd0d4-7f47-4347-bb53-a4702591b5a7 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:06.548066 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3bffd0d4-7f47-4347-bb53-a4702591b5a7 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:06.548878 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3bffd0d4-7f47-4347-bb53-a4702591b5a7 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:06.677756 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-3bffd0d4-7f47-4347-bb53-a4702591b5a7 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db1b83d2b924ed4855ebe9360c9b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8737f6bb9629491d958debd24aa6f9a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:06.688939 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3bffd0d4-7f47-4347-bb53-a4702591b5a7 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] 10.222.0.27 "GET /compute/v2.1/servers/9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf" status: 200 len: 1268 microversion: 2.1 time: 0.187800 Sep 08 10:50:06.690731 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1406/2845] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:06 2022] GET /compute/v2.1/servers/9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf => generated 1268 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:50:06.696820 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-95e6e405-e222-4486-9195-90e9dbed290c req-e330dac2-b1b1-4e21-8fe0-852b3f9095bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f96451ab-896c-4652-8e89-ba210495b5e8", "name": "network-vif-plugged", "status": "completed", "tag": "751325a8-3cbf-4a63-b10a-17bb26abb89f"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:50:06.709793 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-95e6e405-e222-4486-9195-90e9dbed290c req-e330dac2-b1b1-4e21-8fe0-852b3f9095bd service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:06.710936 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-95e6e405-e222-4486-9195-90e9dbed290c req-e330dac2-b1b1-4e21-8fe0-852b3f9095bd service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:06.711633 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-95e6e405-e222-4486-9195-90e9dbed290c req-e330dac2-b1b1-4e21-8fe0-852b3f9095bd service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:06.718650 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=100 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:50:06.737264 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-091bcd68-bdd4-49b3-8e71-1fe5bb6416a4 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f58dabb2db74cedba25f856ad1a7df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63eba712ae82439ba53b37b774c332dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:06.744239 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-95e6e405-e222-4486-9195-90e9dbed290c req-e330dac2-b1b1-4e21-8fe0-852b3f9095bd service nova] Creating event network-vif-plugged:751325a8-3cbf-4a63-b10a-17bb26abb89f for instance f96451ab-896c-4652-8e89-ba210495b5e8 on n-h2-850501-12 Sep 08 10:50:06.760734 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-091bcd68-bdd4-49b3-8e71-1fe5bb6416a4 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] 10.222.0.27 "GET /compute/v2.1/servers/e522775b-9d4f-4fee-beaa-61e1b0452ead" status: 200 len: 1351 microversion: 2.1 time: 0.539217 Sep 08 10:50:06.773066 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1440/2846] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:06 2022] GET /compute/v2.1/servers/e522775b-9d4f-4fee-beaa-61e1b0452ead => generated 1351 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:50:06.779647 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-95e6e405-e222-4486-9195-90e9dbed290c req-e330dac2-b1b1-4e21-8fe0-852b3f9095bd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082068 Sep 08 10:50:06.779647 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1407/2847] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:50:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:50:06.783543 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d0037314-132c-4ad5-9f11-d46f4b5b1763 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:06.783543 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d0037314-132c-4ad5-9f11-d46f4b5b1763 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] [instance: f96451ab-896c-4652-8e89-ba210495b5e8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:06.794788 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d0037314-132c-4ad5-9f11-d46f4b5b1763 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:06.795495 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d0037314-132c-4ad5-9f11-d46f4b5b1763 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:06.796073 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d0037314-132c-4ad5-9f11-d46f4b5b1763 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:06.797285 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d0037314-132c-4ad5-9f11-d46f4b5b1763 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:06.797945 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d0037314-132c-4ad5-9f11-d46f4b5b1763 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:06.798536 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d0037314-132c-4ad5-9f11-d46f4b5b1763 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:06.842338 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:50:07.247927 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e656247f-a3ec-4cdd-8672-cbb61eaf08ab tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:07.248522 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e656247f-a3ec-4cdd-8672-cbb61eaf08ab tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:07.264572 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e656247f-a3ec-4cdd-8672-cbb61eaf08ab tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:07.265572 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e656247f-a3ec-4cdd-8672-cbb61eaf08ab tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:07.266409 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e656247f-a3ec-4cdd-8672-cbb61eaf08ab tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:07.269605 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e656247f-a3ec-4cdd-8672-cbb61eaf08ab tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:07.270110 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e656247f-a3ec-4cdd-8672-cbb61eaf08ab tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:07.270931 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e656247f-a3ec-4cdd-8672-cbb61eaf08ab tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:07.478514 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d0037314-132c-4ad5-9f11-d46f4b5b1763 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0c66b5a004df886b3d973a978c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc5f459e4a143d1b8bf1c5c64153644', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:07.493642 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d0037314-132c-4ad5-9f11-d46f4b5b1763 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] 10.222.0.27 "GET /compute/v2.1/servers/f96451ab-896c-4652-8e89-ba210495b5e8" status: 200 len: 1320 microversion: 2.1 time: 0.728917 Sep 08 10:50:07.494853 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1441/2848] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:06 2022] GET /compute/v2.1/servers/f96451ab-896c-4652-8e89-ba210495b5e8 => generated 1320 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:07.719268 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-aa6a75a0-7c66-4e25-a095-18033382f265 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:07.719907 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-aa6a75a0-7c66-4e25-a095-18033382f265 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] [instance: 9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:07.738905 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa6a75a0-7c66-4e25-a095-18033382f265 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:07.739553 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa6a75a0-7c66-4e25-a095-18033382f265 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:07.742536 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa6a75a0-7c66-4e25-a095-18033382f265 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:07.743555 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa6a75a0-7c66-4e25-a095-18033382f265 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:07.744239 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa6a75a0-7c66-4e25-a095-18033382f265 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:07.745047 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa6a75a0-7c66-4e25-a095-18033382f265 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:07.748654 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e656247f-a3ec-4cdd-8672-cbb61eaf08ab tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:07.758219 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e656247f-a3ec-4cdd-8672-cbb61eaf08ab tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:07.759676 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e656247f-a3ec-4cdd-8672-cbb61eaf08ab tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:07.797742 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e656247f-a3ec-4cdd-8672-cbb61eaf08ab tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1540 microversion: 2.91 time: 0.550587 Sep 08 10:50:07.798681 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1408/2849] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:50:07 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1540 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:50:07.819820 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7aa272b6-c89f-40b9-86e7-3c7de7f4eb43 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:07.820580 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7aa272b6-c89f-40b9-86e7-3c7de7f4eb43 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] [instance: e522775b-9d4f-4fee-beaa-61e1b0452ead] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:07.831152 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7aa272b6-c89f-40b9-86e7-3c7de7f4eb43 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:07.831768 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7aa272b6-c89f-40b9-86e7-3c7de7f4eb43 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:07.839050 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7aa272b6-c89f-40b9-86e7-3c7de7f4eb43 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:07.840222 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7aa272b6-c89f-40b9-86e7-3c7de7f4eb43 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:07.840828 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7aa272b6-c89f-40b9-86e7-3c7de7f4eb43 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:07.841415 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7aa272b6-c89f-40b9-86e7-3c7de7f4eb43 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:08.100638 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-aa6a75a0-7c66-4e25-a095-18033382f265 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db1b83d2b924ed4855ebe9360c9b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8737f6bb9629491d958debd24aa6f9a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:08.121610 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-aa6a75a0-7c66-4e25-a095-18033382f265 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] 10.222.0.27 "GET /compute/v2.1/servers/9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf" status: 200 len: 1274 microversion: 2.1 time: 0.409794 Sep 08 10:50:08.122445 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1442/2850] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:07 2022] GET /compute/v2.1/servers/9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf => generated 1274 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:08.146023 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0d764d46-079b-4370-91dc-2ebabc0013f3 tempest-UnshelveToHostMultiNodesTest-1667251479 tempest-UnshelveToHostMultiNodesTest-1667251479-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-850501-12"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:50:08.150220 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0d764d46-079b-4370-91dc-2ebabc0013f3 tempest-UnshelveToHostMultiNodesTest-1667251479 tempest-UnshelveToHostMultiNodesTest-1667251479-project-admin] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:08.157595 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d764d46-079b-4370-91dc-2ebabc0013f3 tempest-UnshelveToHostMultiNodesTest-1667251479 tempest-UnshelveToHostMultiNodesTest-1667251479-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:08.158469 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d764d46-079b-4370-91dc-2ebabc0013f3 tempest-UnshelveToHostMultiNodesTest-1667251479 tempest-UnshelveToHostMultiNodesTest-1667251479-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:08.159083 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d764d46-079b-4370-91dc-2ebabc0013f3 tempest-UnshelveToHostMultiNodesTest-1667251479 tempest-UnshelveToHostMultiNodesTest-1667251479-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:08.160394 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d764d46-079b-4370-91dc-2ebabc0013f3 tempest-UnshelveToHostMultiNodesTest-1667251479 tempest-UnshelveToHostMultiNodesTest-1667251479-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:08.161468 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d764d46-079b-4370-91dc-2ebabc0013f3 tempest-UnshelveToHostMultiNodesTest-1667251479 tempest-UnshelveToHostMultiNodesTest-1667251479-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:08.162097 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d764d46-079b-4370-91dc-2ebabc0013f3 tempest-UnshelveToHostMultiNodesTest-1667251479 tempest-UnshelveToHostMultiNodesTest-1667251479-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:08.248230 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0d764d46-079b-4370-91dc-2ebabc0013f3 tempest-UnshelveToHostMultiNodesTest-1667251479 tempest-UnshelveToHostMultiNodesTest-1667251479-project-admin] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-850501-12". {{(pid=128862) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 08 10:50:08.355005 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7aa272b6-c89f-40b9-86e7-3c7de7f4eb43 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f58dabb2db74cedba25f856ad1a7df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63eba712ae82439ba53b37b774c332dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:08.369707 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7aa272b6-c89f-40b9-86e7-3c7de7f4eb43 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] 10.222.0.27 "GET /compute/v2.1/servers/e522775b-9d4f-4fee-beaa-61e1b0452ead" status: 200 len: 1351 microversion: 2.1 time: 0.567129 Sep 08 10:50:08.370756 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1409/2851] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:07 2022] GET /compute/v2.1/servers/e522775b-9d4f-4fee-beaa-61e1b0452ead => generated 1351 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:08.415406 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0d764d46-079b-4370-91dc-2ebabc0013f3 tempest-UnshelveToHostMultiNodesTest-1667251479 tempest-UnshelveToHostMultiNodesTest-1667251479-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b/action" status: 202 len: 0 microversion: 2.91 time: 0.276252 Sep 08 10:50:08.416040 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1443/2852] 10.222.0.27 () {62 vars in 1319 bytes} [Thu Sep 8 10:50:08 2022] POST /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b/action => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:50:08.425250 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-642ca42e-3b2f-4de3-8b01-92a14fa81582 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:08.428730 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-642ca42e-3b2f-4de3-8b01-92a14fa81582 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:08.447630 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-642ca42e-3b2f-4de3-8b01-92a14fa81582 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:08.451022 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-642ca42e-3b2f-4de3-8b01-92a14fa81582 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:08.456709 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-642ca42e-3b2f-4de3-8b01-92a14fa81582 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:08.459553 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-642ca42e-3b2f-4de3-8b01-92a14fa81582 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:08.461393 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-642ca42e-3b2f-4de3-8b01-92a14fa81582 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:08.464386 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-642ca42e-3b2f-4de3-8b01-92a14fa81582 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:08.521704 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e97972e1-b693-4f52-8349-4301ce7c2b7b tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:08.522331 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e97972e1-b693-4f52-8349-4301ce7c2b7b tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] [instance: f96451ab-896c-4652-8e89-ba210495b5e8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:08.524453 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:50:08.540450 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e97972e1-b693-4f52-8349-4301ce7c2b7b tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:08.542831 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e97972e1-b693-4f52-8349-4301ce7c2b7b tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:08.543588 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e97972e1-b693-4f52-8349-4301ce7c2b7b tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:08.544522 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e97972e1-b693-4f52-8349-4301ce7c2b7b tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:08.550282 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e97972e1-b693-4f52-8349-4301ce7c2b7b tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:08.551066 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e97972e1-b693-4f52-8349-4301ce7c2b7b tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:08.644062 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-642ca42e-3b2f-4de3-8b01-92a14fa81582 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:08.662711 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-642ca42e-3b2f-4de3-8b01-92a14fa81582 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:08.664165 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-642ca42e-3b2f-4de3-8b01-92a14fa81582 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:08.682400 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-642ca42e-3b2f-4de3-8b01-92a14fa81582 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1488 microversion: 2.91 time: 0.262038 Sep 08 10:50:08.685526 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1410/2853] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:50:08 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1488 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:50:08.800338 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-e3bbbe3e-da9b-400b-8eaa-825ac2df24ad req-d5ef33cd-d9df-461b-968a-db1882c6cc37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e522775b-9d4f-4fee-beaa-61e1b0452ead", "name": "network-vif-plugged", "status": "completed", "tag": "002ad59a-75f1-4c84-828c-d70e98fdeb3a"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:50:08.823137 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-e3bbbe3e-da9b-400b-8eaa-825ac2df24ad req-d5ef33cd-d9df-461b-968a-db1882c6cc37 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:08.830948 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-e3bbbe3e-da9b-400b-8eaa-825ac2df24ad req-d5ef33cd-d9df-461b-968a-db1882c6cc37 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:08.831507 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-e3bbbe3e-da9b-400b-8eaa-825ac2df24ad req-d5ef33cd-d9df-461b-968a-db1882c6cc37 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:08.851041 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-e3bbbe3e-da9b-400b-8eaa-825ac2df24ad req-d5ef33cd-d9df-461b-968a-db1882c6cc37 service nova] Creating event network-vif-plugged:002ad59a-75f1-4c84-828c-d70e98fdeb3a for instance e522775b-9d4f-4fee-beaa-61e1b0452ead on n-h1-850501-12 Sep 08 10:50:08.859187 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-e3bbbe3e-da9b-400b-8eaa-825ac2df24ad req-d5ef33cd-d9df-461b-968a-db1882c6cc37 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062006 Sep 08 10:50:08.860287 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1411/2854] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:50:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:50:09.151730 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-052f234b-7ffe-43bd-a5a8-db7975da2b4b tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:09.152450 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-052f234b-7ffe-43bd-a5a8-db7975da2b4b tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] [instance: 9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:09.162865 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-052f234b-7ffe-43bd-a5a8-db7975da2b4b tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:09.163689 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-052f234b-7ffe-43bd-a5a8-db7975da2b4b tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:09.164766 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-052f234b-7ffe-43bd-a5a8-db7975da2b4b tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:09.165813 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-052f234b-7ffe-43bd-a5a8-db7975da2b4b tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:09.168198 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-052f234b-7ffe-43bd-a5a8-db7975da2b4b tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:09.168634 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-052f234b-7ffe-43bd-a5a8-db7975da2b4b tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:09.281778 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-052f234b-7ffe-43bd-a5a8-db7975da2b4b tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db1b83d2b924ed4855ebe9360c9b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8737f6bb9629491d958debd24aa6f9a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:09.299742 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-052f234b-7ffe-43bd-a5a8-db7975da2b4b tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] 10.222.0.27 "GET /compute/v2.1/servers/9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf" status: 200 len: 1274 microversion: 2.1 time: 0.152400 Sep 08 10:50:09.310000 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1412/2855] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:09 2022] GET /compute/v2.1/servers/9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf => generated 1274 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:09.394498 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e97972e1-b693-4f52-8349-4301ce7c2b7b tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0c66b5a004df886b3d973a978c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc5f459e4a143d1b8bf1c5c64153644', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:09.397152 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4ad131f2-fba4-4e59-85eb-d1e1d59bb20b tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:09.398003 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4ad131f2-fba4-4e59-85eb-d1e1d59bb20b tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] [instance: e522775b-9d4f-4fee-beaa-61e1b0452ead] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:09.404269 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e97972e1-b693-4f52-8349-4301ce7c2b7b tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] 10.222.0.27 "GET /compute/v2.1/servers/f96451ab-896c-4652-8e89-ba210495b5e8" status: 200 len: 1320 microversion: 2.1 time: 0.887314 Sep 08 10:50:09.423450 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1444/2856] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:08 2022] GET /compute/v2.1/servers/f96451ab-896c-4652-8e89-ba210495b5e8 => generated 1320 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:50:09.430432 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ad131f2-fba4-4e59-85eb-d1e1d59bb20b tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:09.432018 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ad131f2-fba4-4e59-85eb-d1e1d59bb20b tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:09.448970 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ad131f2-fba4-4e59-85eb-d1e1d59bb20b tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:09.456682 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ad131f2-fba4-4e59-85eb-d1e1d59bb20b tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:09.459223 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ad131f2-fba4-4e59-85eb-d1e1d59bb20b tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:09.461255 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ad131f2-fba4-4e59-85eb-d1e1d59bb20b tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:09.720595 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-908e9e15-d4e1-4bf7-8f28-15c45997f44f tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:09.724874 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-908e9e15-d4e1-4bf7-8f28-15c45997f44f tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:09.743660 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-908e9e15-d4e1-4bf7-8f28-15c45997f44f tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:09.760263 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-908e9e15-d4e1-4bf7-8f28-15c45997f44f tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:09.761641 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-908e9e15-d4e1-4bf7-8f28-15c45997f44f tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:09.763273 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-908e9e15-d4e1-4bf7-8f28-15c45997f44f tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:09.766075 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-908e9e15-d4e1-4bf7-8f28-15c45997f44f tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:09.767185 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-908e9e15-d4e1-4bf7-8f28-15c45997f44f tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:09.791106 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4ad131f2-fba4-4e59-85eb-d1e1d59bb20b tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f58dabb2db74cedba25f856ad1a7df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63eba712ae82439ba53b37b774c332dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:09.798975 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4ad131f2-fba4-4e59-85eb-d1e1d59bb20b tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] 10.222.0.27 "GET /compute/v2.1/servers/e522775b-9d4f-4fee-beaa-61e1b0452ead" status: 200 len: 1351 microversion: 2.1 time: 0.407960 Sep 08 10:50:09.804111 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1413/2857] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:09 2022] GET /compute/v2.1/servers/e522775b-9d4f-4fee-beaa-61e1b0452ead => generated 1351 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:10.329688 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8d58c3e2-6db2-4836-be1d-1721cc68c389 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:10.330463 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8d58c3e2-6db2-4836-be1d-1721cc68c389 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] [instance: 9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:10.346245 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8d58c3e2-6db2-4836-be1d-1721cc68c389 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:10.346827 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8d58c3e2-6db2-4836-be1d-1721cc68c389 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:10.351318 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8d58c3e2-6db2-4836-be1d-1721cc68c389 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:10.353497 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8d58c3e2-6db2-4836-be1d-1721cc68c389 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:10.355459 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8d58c3e2-6db2-4836-be1d-1721cc68c389 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:10.356238 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8d58c3e2-6db2-4836-be1d-1721cc68c389 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:10.576786 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8d58c3e2-6db2-4836-be1d-1721cc68c389 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db1b83d2b924ed4855ebe9360c9b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8737f6bb9629491d958debd24aa6f9a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:10.588731 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8d58c3e2-6db2-4836-be1d-1721cc68c389 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] 10.222.0.27 "GET /compute/v2.1/servers/9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf" status: 200 len: 1274 microversion: 2.1 time: 0.263766 Sep 08 10:50:10.591414 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1414/2858] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:10 2022] GET /compute/v2.1/servers/9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf => generated 1274 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:50:10.604744 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ebd9f076-ba74-463b-ac44-8ba365006097 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:10.605671 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ebd9f076-ba74-463b-ac44-8ba365006097 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] [instance: f96451ab-896c-4652-8e89-ba210495b5e8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:10.618764 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ebd9f076-ba74-463b-ac44-8ba365006097 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:10.619253 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ebd9f076-ba74-463b-ac44-8ba365006097 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:10.619689 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ebd9f076-ba74-463b-ac44-8ba365006097 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:10.620402 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ebd9f076-ba74-463b-ac44-8ba365006097 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:10.620861 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ebd9f076-ba74-463b-ac44-8ba365006097 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:10.621315 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ebd9f076-ba74-463b-ac44-8ba365006097 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:10.667951 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-908e9e15-d4e1-4bf7-8f28-15c45997f44f tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:10.686049 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-908e9e15-d4e1-4bf7-8f28-15c45997f44f tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:10.687607 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-908e9e15-d4e1-4bf7-8f28-15c45997f44f tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:10.694780 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-908e9e15-d4e1-4bf7-8f28-15c45997f44f tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1488 microversion: 2.91 time: 0.984636 Sep 08 10:50:10.712520 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1445/2859] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:50:09 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1488 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:50:10.811252 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0d6f0ea9-b4df-4ee3-b5ae-67795ee2331a tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-797290622", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "741076e7-778f-402b-9838-e16de110a735"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:50:10.958506 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-0d6f0ea9-b4df-4ee3-b5ae-67795ee2331a tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] validate_networks() for [('741076e7-778f-402b-9838-e16de110a735', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:50:11.154845 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ebd9f076-ba74-463b-ac44-8ba365006097 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0c66b5a004df886b3d973a978c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc5f459e4a143d1b8bf1c5c64153644', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:11.172397 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ebd9f076-ba74-463b-ac44-8ba365006097 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] 10.222.0.27 "GET /compute/v2.1/servers/f96451ab-896c-4652-8e89-ba210495b5e8" status: 200 len: 1508 microversion: 2.1 time: 0.578343 Sep 08 10:50:11.173967 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1415/2860] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:10 2022] GET /compute/v2.1/servers/f96451ab-896c-4652-8e89-ba210495b5e8 => generated 1508 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:11.183605 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a84c9f82-977e-4435-b044-9805518422b2 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Action: 'create', calling method: .version_select at 0x7f68e40ad670>, body: {"keypair": {"name": "tempest-keypair-1695367385", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCRdH6PERR0SFC3xAP7mAexpbg5Io7MEbeMiiw5QGOzZ2rGCh/FD+kk+r8LPE+MacF8/JtDyGkMXVf3Ir6iKzwlSYNAriTlHktVM7rKLydrT2M57s012xFH+nmF+thTsCA=="}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:50:11.219035 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-a84c9f82-977e-4435-b044-9805518422b2 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Getting quotas for project bf115ce61d864726b0e6e6b28c6ac69a. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:50:11.249571 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-a84c9f82-977e-4435-b044-9805518422b2 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Getting quotas for user 72c4838df30441628becfb4e61778366 and project bf115ce61d864726b0e6e6b28c6ac69a. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:50:11.314915 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a84c9f82-977e-4435-b044-9805518422b2 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.139074 Sep 08 10:50:11.317758 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1416/2861] 10.222.0.27 () {62 vars in 1200 bytes} [Thu Sep 8 10:50:11 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 143 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 08 10:50:11.326768 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-192662f9-8ec1-464b-b4c4-978c6106ee99 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:11.328273 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-192662f9-8ec1-464b-b4c4-978c6106ee99 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] [instance: e522775b-9d4f-4fee-beaa-61e1b0452ead] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:11.338941 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-192662f9-8ec1-464b-b4c4-978c6106ee99 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:11.340264 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-192662f9-8ec1-464b-b4c4-978c6106ee99 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:11.340927 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-192662f9-8ec1-464b-b4c4-978c6106ee99 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:11.342223 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-192662f9-8ec1-464b-b4c4-978c6106ee99 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:11.342961 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-192662f9-8ec1-464b-b4c4-978c6106ee99 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:11.344205 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-192662f9-8ec1-464b-b4c4-978c6106ee99 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:11.900675 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-192662f9-8ec1-464b-b4c4-978c6106ee99 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f58dabb2db74cedba25f856ad1a7df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63eba712ae82439ba53b37b774c332dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:11.922139 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-192662f9-8ec1-464b-b4c4-978c6106ee99 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] 10.222.0.27 "GET /compute/v2.1/servers/e522775b-9d4f-4fee-beaa-61e1b0452ead" status: 200 len: 1540 microversion: 2.1 time: 0.601572 Sep 08 10:50:11.926539 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1417/2862] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:11 2022] GET /compute/v2.1/servers/e522775b-9d4f-4fee-beaa-61e1b0452ead => generated 1540 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:11.937008 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fb4fdbd7-4ee2-4df3-a8e6-b1b97552eaaa tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:11.938885 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fb4fdbd7-4ee2-4df3-a8e6-b1b97552eaaa tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] [instance: 7ef65322-ccb1-4703-b15f-4ab8306b32de] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:11.956169 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb4fdbd7-4ee2-4df3-a8e6-b1b97552eaaa tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:11.958825 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb4fdbd7-4ee2-4df3-a8e6-b1b97552eaaa tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:11.960082 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb4fdbd7-4ee2-4df3-a8e6-b1b97552eaaa tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:11.964130 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb4fdbd7-4ee2-4df3-a8e6-b1b97552eaaa tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:11.966378 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb4fdbd7-4ee2-4df3-a8e6-b1b97552eaaa tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:11.969359 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb4fdbd7-4ee2-4df3-a8e6-b1b97552eaaa tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:12.304316 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-fb4fdbd7-4ee2-4df3-a8e6-b1b97552eaaa tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0c66b5a004df886b3d973a978c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc5f459e4a143d1b8bf1c5c64153644', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:12.322941 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fb4fdbd7-4ee2-4df3-a8e6-b1b97552eaaa tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] 10.222.0.27 "GET /compute/v2.1/servers/7ef65322-ccb1-4703-b15f-4ab8306b32de" status: 200 len: 1507 microversion: 2.1 time: 0.393205 Sep 08 10:50:12.325773 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1418/2863] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:11 2022] GET /compute/v2.1/servers/7ef65322-ccb1-4703-b15f-4ab8306b32de => generated 1507 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:12.338159 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-82ac3740-8919-47f8-8d17-3ac7e8416b38 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1795115589", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "93bd2ec4-37bd-4a29-88fa-5a2d674d25ec"}], "security_groups": [{"name": "tempest-securitygroup--845333558"}], "key_name": "tempest-keypair-1285015287", "user_data": "}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:50:12.405133 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-0d6f0ea9-b4df-4ee3-b5ae-67795ee2331a tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:50:12.405630 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-0d6f0ea9-b4df-4ee3-b5ae-67795ee2331a tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:50:12.406030 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-0d6f0ea9-b4df-4ee3-b5ae-67795ee2331a tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:50:12.406753 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-0d6f0ea9-b4df-4ee3-b5ae-67795ee2331a tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:50:12.407623 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-0d6f0ea9-b4df-4ee3-b5ae-67795ee2331a tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:50:12.429161 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d6f0ea9-b4df-4ee3-b5ae-67795ee2331a tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:12.429993 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d6f0ea9-b4df-4ee3-b5ae-67795ee2331a tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:12.433199 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d6f0ea9-b4df-4ee3-b5ae-67795ee2331a tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:12.434232 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d6f0ea9-b4df-4ee3-b5ae-67795ee2331a tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:12.434701 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d6f0ea9-b4df-4ee3-b5ae-67795ee2331a tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:12.435126 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d6f0ea9-b4df-4ee3-b5ae-67795ee2331a tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:12.484530 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-0d6f0ea9-b4df-4ee3-b5ae-67795ee2331a tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Getting quotas for project 50c3752f739b47a296a5b88948fe7f7f. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:50:12.491928 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-0d6f0ea9-b4df-4ee3-b5ae-67795ee2331a tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Getting quotas for user 7c86e8bd6f9048ce8718f432e51128a5 and project 50c3752f739b47a296a5b88948fe7f7f. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:50:12.509379 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0d6f0ea9-b4df-4ee3-b5ae-67795ee2331a tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:50:12.512261 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0d6f0ea9-b4df-4ee3-b5ae-67795ee2331a tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: 13b25df0-d58e-4da2-bcea-6dac80800bab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:50:12.594868 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0d6f0ea9-b4df-4ee3-b5ae-67795ee2331a tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.881328 Sep 08 10:50:12.595752 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1446/2864] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:50:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1883 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:50:12.621207 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-183e0ffb-3b61-4028-ac1c-73a02c3323ea tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:12.621914 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-183e0ffb-3b61-4028-ac1c-73a02c3323ea tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] [instance: 9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:12.639191 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-183e0ffb-3b61-4028-ac1c-73a02c3323ea tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:12.641738 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-183e0ffb-3b61-4028-ac1c-73a02c3323ea tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:12.642248 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-183e0ffb-3b61-4028-ac1c-73a02c3323ea tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:12.645122 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-183e0ffb-3b61-4028-ac1c-73a02c3323ea tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:12.645810 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-183e0ffb-3b61-4028-ac1c-73a02c3323ea tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:12.646072 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-183e0ffb-3b61-4028-ac1c-73a02c3323ea tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:12.974701 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:50:13.271376 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-183e0ffb-3b61-4028-ac1c-73a02c3323ea tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db1b83d2b924ed4855ebe9360c9b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8737f6bb9629491d958debd24aa6f9a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:13.274501 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-82ac3740-8919-47f8-8d17-3ac7e8416b38 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] validate_networks() for [('93bd2ec4-37bd-4a29-88fa-5a2d674d25ec', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:50:13.287255 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-183e0ffb-3b61-4028-ac1c-73a02c3323ea tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] 10.222.0.27 "GET /compute/v2.1/servers/9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf" status: 200 len: 1316 microversion: 2.1 time: 0.687244 Sep 08 10:50:13.291443 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1447/2865] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:12 2022] GET /compute/v2.1/servers/9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf => generated 1316 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:13.299338 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-07456e03-89d8-4e8b-9f8c-11782315c121 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:13.311054 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-07456e03-89d8-4e8b-9f8c-11782315c121 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:13.328501 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-07456e03-89d8-4e8b-9f8c-11782315c121 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:13.331565 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-07456e03-89d8-4e8b-9f8c-11782315c121 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:13.332292 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-07456e03-89d8-4e8b-9f8c-11782315c121 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:13.338049 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-07456e03-89d8-4e8b-9f8c-11782315c121 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:13.338900 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-07456e03-89d8-4e8b-9f8c-11782315c121 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:13.340582 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-07456e03-89d8-4e8b-9f8c-11782315c121 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:13.698666 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-07456e03-89d8-4e8b-9f8c-11782315c121 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:13.729250 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-07456e03-89d8-4e8b-9f8c-11782315c121 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:13.740595 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-07456e03-89d8-4e8b-9f8c-11782315c121 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:13.780919 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-07456e03-89d8-4e8b-9f8c-11782315c121 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1546 microversion: 2.91 time: 0.485277 Sep 08 10:50:13.783609 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1448/2866] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:50:13 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1546 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:50:13.807946 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-04cb1611-6fa3-4a2b-bab2-7ac02cefb915 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:13.808755 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-04cb1611-6fa3-4a2b-bab2-7ac02cefb915 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] [instance: e522775b-9d4f-4fee-beaa-61e1b0452ead] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:13.839013 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04cb1611-6fa3-4a2b-bab2-7ac02cefb915 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:13.839895 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04cb1611-6fa3-4a2b-bab2-7ac02cefb915 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:13.841576 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04cb1611-6fa3-4a2b-bab2-7ac02cefb915 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:13.856897 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04cb1611-6fa3-4a2b-bab2-7ac02cefb915 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:13.858686 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04cb1611-6fa3-4a2b-bab2-7ac02cefb915 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:13.860747 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04cb1611-6fa3-4a2b-bab2-7ac02cefb915 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:14.147677 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-04cb1611-6fa3-4a2b-bab2-7ac02cefb915 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] 10.222.0.27 "GET /compute/v2.1/servers/e522775b-9d4f-4fee-beaa-61e1b0452ead/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.360543 Sep 08 10:50:14.167103 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1449/2867] 10.222.0.27 () {58 vars in 1275 bytes} [Thu Sep 8 10:50:13 2022] GET /compute/v2.1/servers/e522775b-9d4f-4fee-beaa-61e1b0452ead/os-interface => generated 284 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:50:14.175857 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4eef1cb8-d6ab-4367-ac58-a2723a390fda tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:14.185913 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4eef1cb8-d6ab-4367-ac58-a2723a390fda tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] [instance: 7ef65322-ccb1-4703-b15f-4ab8306b32de] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:14.219350 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4eef1cb8-d6ab-4367-ac58-a2723a390fda tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:14.220752 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4eef1cb8-d6ab-4367-ac58-a2723a390fda tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:14.223678 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4eef1cb8-d6ab-4367-ac58-a2723a390fda tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:14.227678 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4eef1cb8-d6ab-4367-ac58-a2723a390fda tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:14.233800 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4eef1cb8-d6ab-4367-ac58-a2723a390fda tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:14.234631 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4eef1cb8-d6ab-4367-ac58-a2723a390fda tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:14.335813 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4eef1cb8-d6ab-4367-ac58-a2723a390fda tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] [instance: 7ef65322-ccb1-4703-b15f-4ab8306b32de] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:50:14.593899 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4eef1cb8-d6ab-4367-ac58-a2723a390fda tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7ef65322-ccb1-4703-b15f-4ab8306b32de" status: 204 len: 0 microversion: 2.1 time: 0.424424 Sep 08 10:50:14.600260 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1450/2868] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:50:14 2022] DELETE /compute/v2.1/servers/7ef65322-ccb1-4703-b15f-4ab8306b32de => generated 0 bytes in 428 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:50:14.606709 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cd0e44aa-ecf5-48f1-8527-e9c85bde3b22 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:14.607693 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cd0e44aa-ecf5-48f1-8527-e9c85bde3b22 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: 13b25df0-d58e-4da2-bcea-6dac80800bab] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:14.617961 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd0e44aa-ecf5-48f1-8527-e9c85bde3b22 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:14.618640 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd0e44aa-ecf5-48f1-8527-e9c85bde3b22 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:14.619169 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd0e44aa-ecf5-48f1-8527-e9c85bde3b22 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:14.621737 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd0e44aa-ecf5-48f1-8527-e9c85bde3b22 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:14.622423 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd0e44aa-ecf5-48f1-8527-e9c85bde3b22 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:14.622942 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd0e44aa-ecf5-48f1-8527-e9c85bde3b22 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:14.838017 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cd0e44aa-ecf5-48f1-8527-e9c85bde3b22 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86e8bd6f9048ce8718f432e51128a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c3752f739b47a296a5b88948fe7f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:14.861335 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cd0e44aa-ecf5-48f1-8527-e9c85bde3b22 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "GET /compute/v2.1/servers/13b25df0-d58e-4da2-bcea-6dac80800bab" status: 200 len: 1276 microversion: 2.1 time: 0.259144 Sep 08 10:50:14.862077 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1451/2869] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:14 2022] GET /compute/v2.1/servers/13b25df0-d58e-4da2-bcea-6dac80800bab => generated 1276 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:14.882724 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-86b5ec5f-667d-4fe5-8318-499b4be4bafc tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:14.883435 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-86b5ec5f-667d-4fe5-8318-499b4be4bafc tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] [instance: 9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:14.922655 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-86b5ec5f-667d-4fe5-8318-499b4be4bafc tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:14.937135 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-86b5ec5f-667d-4fe5-8318-499b4be4bafc tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:14.937853 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-86b5ec5f-667d-4fe5-8318-499b4be4bafc tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:14.938792 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-86b5ec5f-667d-4fe5-8318-499b4be4bafc tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:14.939125 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-86b5ec5f-667d-4fe5-8318-499b4be4bafc tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:14.939554 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-86b5ec5f-667d-4fe5-8318-499b4be4bafc tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:16.532820 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-86b5ec5f-667d-4fe5-8318-499b4be4bafc tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db1b83d2b924ed4855ebe9360c9b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8737f6bb9629491d958debd24aa6f9a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:16.544885 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-86b5ec5f-667d-4fe5-8318-499b4be4bafc tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] 10.222.0.27 "GET /compute/v2.1/servers/9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf" status: 200 len: 1316 microversion: 2.1 time: 1.675844 Sep 08 10:50:16.553842 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1452/2870] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:14 2022] GET /compute/v2.1/servers/9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf => generated 1316 bytes in 1691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:16.564534 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-343005f5-73d6-4fb5-b078-11b12b9436c4 req-6172f48f-2853-47a5-9bce-387e4421507c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf", "tag": "036e4e77-856c-4b8c-9f28-cff6e87b1645"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:50:16.595948 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-343005f5-73d6-4fb5-b078-11b12b9436c4 req-6172f48f-2853-47a5-9bce-387e4421507c service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:16.599164 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-343005f5-73d6-4fb5-b078-11b12b9436c4 req-6172f48f-2853-47a5-9bce-387e4421507c service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:16.600090 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-343005f5-73d6-4fb5-b078-11b12b9436c4 req-6172f48f-2853-47a5-9bce-387e4421507c service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:16.633660 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-343005f5-73d6-4fb5-b078-11b12b9436c4 req-6172f48f-2853-47a5-9bce-387e4421507c service nova] Creating event network-changed:036e4e77-856c-4b8c-9f28-cff6e87b1645 for instance 9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf on n-h1-850501-12 Sep 08 10:50:16.639720 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-343005f5-73d6-4fb5-b078-11b12b9436c4 req-6172f48f-2853-47a5-9bce-387e4421507c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079052 Sep 08 10:50:16.643084 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1453/2871] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:50:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:50:16.657744 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-89badc3f-6eaa-43f1-864a-5bd77667f631 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:16.661339 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-89badc3f-6eaa-43f1-864a-5bd77667f631 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] [instance: f96451ab-896c-4652-8e89-ba210495b5e8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:16.670423 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89badc3f-6eaa-43f1-864a-5bd77667f631 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:16.675889 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89badc3f-6eaa-43f1-864a-5bd77667f631 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:16.681829 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89badc3f-6eaa-43f1-864a-5bd77667f631 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:16.683012 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89badc3f-6eaa-43f1-864a-5bd77667f631 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:16.683733 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89badc3f-6eaa-43f1-864a-5bd77667f631 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:16.684393 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89badc3f-6eaa-43f1-864a-5bd77667f631 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:16.762918 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-82ac3740-8919-47f8-8d17-3ac7e8416b38 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:50:16.769350 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-82ac3740-8919-47f8-8d17-3ac7e8416b38 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:50:16.771935 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-89badc3f-6eaa-43f1-864a-5bd77667f631 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] [instance: f96451ab-896c-4652-8e89-ba210495b5e8] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:50:16.777062 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-82ac3740-8919-47f8-8d17-3ac7e8416b38 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:50:16.781787 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-82ac3740-8919-47f8-8d17-3ac7e8416b38 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:50:16.784226 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-82ac3740-8919-47f8-8d17-3ac7e8416b38 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:50:16.872428 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-82ac3740-8919-47f8-8d17-3ac7e8416b38 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:16.876549 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-82ac3740-8919-47f8-8d17-3ac7e8416b38 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:16.879955 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-82ac3740-8919-47f8-8d17-3ac7e8416b38 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:16.937661 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:50:16.942000 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-82ac3740-8919-47f8-8d17-3ac7e8416b38 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:16.945455 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-82ac3740-8919-47f8-8d17-3ac7e8416b38 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.058s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:16.947682 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-82ac3740-8919-47f8-8d17-3ac7e8416b38 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:16.999456 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-89badc3f-6eaa-43f1-864a-5bd77667f631 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f96451ab-896c-4652-8e89-ba210495b5e8" status: 204 len: 0 microversion: 2.1 time: 0.353976 Sep 08 10:50:17.012255 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1454/2872] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:50:16 2022] DELETE /compute/v2.1/servers/f96451ab-896c-4652-8e89-ba210495b5e8 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:50:17.018118 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9cecc33d-dd3e-48b8-9940-42e07299c920 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:17.019594 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9cecc33d-dd3e-48b8-9940-42e07299c920 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:17.027583 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9cecc33d-dd3e-48b8-9940-42e07299c920 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:17.028102 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9cecc33d-dd3e-48b8-9940-42e07299c920 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:17.028542 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9cecc33d-dd3e-48b8-9940-42e07299c920 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:17.029284 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9cecc33d-dd3e-48b8-9940-42e07299c920 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:17.029886 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9cecc33d-dd3e-48b8-9940-42e07299c920 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:17.030320 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9cecc33d-dd3e-48b8-9940-42e07299c920 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:17.072351 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-82ac3740-8919-47f8-8d17-3ac7e8416b38 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Getting quotas for project 20f9a24cad014d7f827e8f3236dd5bae. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:50:17.100813 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-82ac3740-8919-47f8-8d17-3ac7e8416b38 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Getting quotas for user 5c291cbe955b4ee5abc98132dda0255e and project 20f9a24cad014d7f827e8f3236dd5bae. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:50:17.139938 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-82ac3740-8919-47f8-8d17-3ac7e8416b38 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:50:17.143022 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-82ac3740-8919-47f8-8d17-3ac7e8416b38 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: f182d52b-9650-44f2-bd28-f2ae1daa1438] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:50:17.239864 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-82ac3740-8919-47f8-8d17-3ac7e8416b38 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.912574 Sep 08 10:50:17.242489 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1419/2873] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:50:12 2022] POST /compute/v2.1/servers => generated 401 bytes in 4914 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:50:17.252229 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-53fbf563-4985-4196-98df-4b90189306a0 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:17.254376 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-53fbf563-4985-4196-98df-4b90189306a0 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: 13b25df0-d58e-4da2-bcea-6dac80800bab] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:17.262149 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-53fbf563-4985-4196-98df-4b90189306a0 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:17.262837 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-53fbf563-4985-4196-98df-4b90189306a0 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:17.263698 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-53fbf563-4985-4196-98df-4b90189306a0 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:17.265858 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-53fbf563-4985-4196-98df-4b90189306a0 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:17.266666 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-53fbf563-4985-4196-98df-4b90189306a0 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:17.267787 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-53fbf563-4985-4196-98df-4b90189306a0 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:17.434103 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-53fbf563-4985-4196-98df-4b90189306a0 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86e8bd6f9048ce8718f432e51128a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c3752f739b47a296a5b88948fe7f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:17.449474 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-53fbf563-4985-4196-98df-4b90189306a0 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "GET /compute/v2.1/servers/13b25df0-d58e-4da2-bcea-6dac80800bab" status: 200 len: 1282 microversion: 2.1 time: 0.204814 Sep 08 10:50:17.450138 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1420/2874] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:17 2022] GET /compute/v2.1/servers/13b25df0-d58e-4da2-bcea-6dac80800bab => generated 1282 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:17.452842 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9cecc33d-dd3e-48b8-9940-42e07299c920 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:17.463296 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-74b4544c-bf7a-422a-86bb-a6dd7b62d061 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:17.465863 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-74b4544c-bf7a-422a-86bb-a6dd7b62d061 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: f182d52b-9650-44f2-bd28-f2ae1daa1438] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:17.466605 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9cecc33d-dd3e-48b8-9940-42e07299c920 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:17.468064 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9cecc33d-dd3e-48b8-9940-42e07299c920 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:17.479748 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9cecc33d-dd3e-48b8-9940-42e07299c920 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1546 microversion: 2.91 time: 0.465887 Sep 08 10:50:17.494447 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1455/2875] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:50:17 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1546 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:50:17.508687 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6e025b60-4bdc-4793-aa85-b0b5aefa2995 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1668973131", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "877dfa5c-585b-4b8b-af6a-031c2193c56b"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:50:17.664843 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-6e025b60-4bdc-4793-aa85-b0b5aefa2995 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] validate_networks() for [('877dfa5c-585b-4b8b-af6a-031c2193c56b', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:50:17.750780 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-74b4544c-bf7a-422a-86bb-a6dd7b62d061 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c291cbe955b4ee5abc98132dda0255e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f9a24cad014d7f827e8f3236dd5bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:17.760191 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-74b4544c-bf7a-422a-86bb-a6dd7b62d061 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/f182d52b-9650-44f2-bd28-f2ae1daa1438" status: 200 len: 1242 microversion: 2.1 time: 0.307394 Sep 08 10:50:17.765062 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1421/2876] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:17 2022] GET /compute/v2.1/servers/f182d52b-9650-44f2-bd28-f2ae1daa1438 => generated 1242 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:17.794547 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4e79720f-d9f6-495f-b446-03c1fe7badaa tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:17.795408 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4e79720f-d9f6-495f-b446-03c1fe7badaa tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] [instance: 9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:17.814235 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4e79720f-d9f6-495f-b446-03c1fe7badaa tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:17.815131 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4e79720f-d9f6-495f-b446-03c1fe7badaa tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:17.816033 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4e79720f-d9f6-495f-b446-03c1fe7badaa tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:17.817473 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4e79720f-d9f6-495f-b446-03c1fe7badaa tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:17.818154 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4e79720f-d9f6-495f-b446-03c1fe7badaa tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:17.818781 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4e79720f-d9f6-495f-b446-03c1fe7badaa tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:18.642976 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4e79720f-d9f6-495f-b446-03c1fe7badaa tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db1b83d2b924ed4855ebe9360c9b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8737f6bb9629491d958debd24aa6f9a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:18.659869 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4e79720f-d9f6-495f-b446-03c1fe7badaa tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] 10.222.0.27 "GET /compute/v2.1/servers/9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf" status: 200 len: 1316 microversion: 2.1 time: 0.891670 Sep 08 10:50:18.662752 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1422/2877] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:17 2022] GET /compute/v2.1/servers/9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf => generated 1316 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:18.689274 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-379c264b-b7b3-441b-8d80-2903fba9fd91 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:18.690466 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-379c264b-b7b3-441b-8d80-2903fba9fd91 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: 13b25df0-d58e-4da2-bcea-6dac80800bab] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:18.699618 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-379c264b-b7b3-441b-8d80-2903fba9fd91 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:18.701120 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-379c264b-b7b3-441b-8d80-2903fba9fd91 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:18.701890 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-379c264b-b7b3-441b-8d80-2903fba9fd91 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:18.703002 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-379c264b-b7b3-441b-8d80-2903fba9fd91 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:18.704065 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-379c264b-b7b3-441b-8d80-2903fba9fd91 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:18.704720 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-379c264b-b7b3-441b-8d80-2903fba9fd91 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:19.035817 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-379c264b-b7b3-441b-8d80-2903fba9fd91 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86e8bd6f9048ce8718f432e51128a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c3752f739b47a296a5b88948fe7f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:19.051137 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-379c264b-b7b3-441b-8d80-2903fba9fd91 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "GET /compute/v2.1/servers/13b25df0-d58e-4da2-bcea-6dac80800bab" status: 200 len: 1282 microversion: 2.1 time: 0.366264 Sep 08 10:50:19.055887 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1423/2878] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:18 2022] GET /compute/v2.1/servers/13b25df0-d58e-4da2-bcea-6dac80800bab => generated 1282 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:19.063687 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-0bba06c8-227f-472f-99ad-181bc50c19d0 req-1cd20662-f861-4962-af64-1377578f9e1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ef65322-ccb1-4703-b15f-4ab8306b32de", "name": "network-vif-unplugged", "status": "completed", "tag": "01beadcd-0dc7-47e2-9884-a66d9958f0e8"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:50:19.093200 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-0bba06c8-227f-472f-99ad-181bc50c19d0 req-1cd20662-f861-4962-af64-1377578f9e1d service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:19.098460 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-0bba06c8-227f-472f-99ad-181bc50c19d0 req-1cd20662-f861-4962-af64-1377578f9e1d service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:19.099345 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-0bba06c8-227f-472f-99ad-181bc50c19d0 req-1cd20662-f861-4962-af64-1377578f9e1d service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:19.129000 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-0bba06c8-227f-472f-99ad-181bc50c19d0 req-1cd20662-f861-4962-af64-1377578f9e1d service nova] Creating event network-vif-unplugged:01beadcd-0dc7-47e2-9884-a66d9958f0e8 for instance 7ef65322-ccb1-4703-b15f-4ab8306b32de on n-h2-850501-12 Sep 08 10:50:19.151785 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-0bba06c8-227f-472f-99ad-181bc50c19d0 req-1cd20662-f861-4962-af64-1377578f9e1d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087517 Sep 08 10:50:19.152897 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1424/2879] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:50:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:50:19.168341 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-167e9be4-ff31-4308-984a-57109041b32f tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:19.169511 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-167e9be4-ff31-4308-984a-57109041b32f tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:19.183345 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-167e9be4-ff31-4308-984a-57109041b32f tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:19.189500 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-167e9be4-ff31-4308-984a-57109041b32f tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:19.190202 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-167e9be4-ff31-4308-984a-57109041b32f tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:19.191636 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-167e9be4-ff31-4308-984a-57109041b32f tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:19.192840 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-167e9be4-ff31-4308-984a-57109041b32f tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:19.194165 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-167e9be4-ff31-4308-984a-57109041b32f tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:19.264319 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-6e025b60-4bdc-4793-aa85-b0b5aefa2995 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:50:19.264929 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-6e025b60-4bdc-4793-aa85-b0b5aefa2995 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:50:19.265297 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-6e025b60-4bdc-4793-aa85-b0b5aefa2995 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:50:19.265720 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-6e025b60-4bdc-4793-aa85-b0b5aefa2995 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:50:19.266198 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-6e025b60-4bdc-4793-aa85-b0b5aefa2995 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:50:19.292102 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6e025b60-4bdc-4793-aa85-b0b5aefa2995 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:19.292988 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6e025b60-4bdc-4793-aa85-b0b5aefa2995 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:19.293674 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6e025b60-4bdc-4793-aa85-b0b5aefa2995 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:19.294608 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6e025b60-4bdc-4793-aa85-b0b5aefa2995 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:19.295245 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6e025b60-4bdc-4793-aa85-b0b5aefa2995 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:19.295913 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6e025b60-4bdc-4793-aa85-b0b5aefa2995 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:19.352251 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-6e025b60-4bdc-4793-aa85-b0b5aefa2995 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Getting quotas for project 7bc5f459e4a143d1b8bf1c5c64153644. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:50:19.371050 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-6e025b60-4bdc-4793-aa85-b0b5aefa2995 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Getting quotas for user 53c0c66b5a004df886b3d973a978c132 and project 7bc5f459e4a143d1b8bf1c5c64153644. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:50:19.402046 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-167e9be4-ff31-4308-984a-57109041b32f tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:19.405528 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6e025b60-4bdc-4793-aa85-b0b5aefa2995 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Going to run 2 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:50:19.414215 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6e025b60-4bdc-4793-aa85-b0b5aefa2995 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] [instance: a4e3b624-1ff1-4ee3-a6e1-d5da50a26d3f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:50:19.418732 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-167e9be4-ff31-4308-984a-57109041b32f tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:19.420295 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-167e9be4-ff31-4308-984a-57109041b32f tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:19.427939 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-167e9be4-ff31-4308-984a-57109041b32f tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1546 microversion: 2.91 time: 0.273286 Sep 08 10:50:19.449929 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1425/2880] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:50:19 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1546 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:50:19.475288 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-90c25709-6861-4e28-ba34-dc0e75a97c88 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:19.478250 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-90c25709-6861-4e28-ba34-dc0e75a97c88 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: f182d52b-9650-44f2-bd28-f2ae1daa1438] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:19.500468 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90c25709-6861-4e28-ba34-dc0e75a97c88 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:19.503299 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90c25709-6861-4e28-ba34-dc0e75a97c88 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:19.504260 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90c25709-6861-4e28-ba34-dc0e75a97c88 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:19.509468 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90c25709-6861-4e28-ba34-dc0e75a97c88 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:19.510082 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90c25709-6861-4e28-ba34-dc0e75a97c88 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:19.511531 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6e025b60-4bdc-4793-aa85-b0b5aefa2995 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] [instance: 2c34cf01-2cbf-4cf8-ad8f-d3c8f2c7c66f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=a4e3b624-1ff1-4ee3-a6e1-d5da50a26d3f,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:50:19.512852 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90c25709-6861-4e28-ba34-dc0e75a97c88 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:19.705542 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6e025b60-4bdc-4793-aa85-b0b5aefa2995 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.205539 Sep 08 10:50:19.711271 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1456/2881] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:50:17 2022] POST /compute/v2.1/servers => generated 32 bytes in 2215 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Sep 08 10:50:19.725372 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8d355e88-97a6-48f4-af03-b5dee22b26e1 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1565993155", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "65531cf0-0f1f-4e94-a8b7-fc0d1dd74f35"}, {"port": "87858844-1949-4224-96fe-9b4790f10cad", "tag": "port-1"}, {"port": "50649fb7-2e13-4d59-ad27-f52395856925", "tag": "port-2"}, {"uuid": "3fb23a71-63d6-4ff3-a7ec-73d908135c66", "tag": "net-1"}, {"uuid": "3fb23a71-63d6-4ff3-a7ec-73d908135c66"}, {"uuid": "687be2b0-91b8-4bff-afb3-b47296d44586", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "687be2b0-91b8-4bff-afb3-b47296d44586", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "ebff4de5-8f82-4a0a-a826-58fed3acf939", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "1fe08f80-705c-498b-8b61-0b087bf22faf", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "e52a1873-bdd8-4917-ab68-19c1194e2792", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--226832703"}], "key_name": "tempest-keypair-1695367385", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:50:19.766092 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-90c25709-6861-4e28-ba34-dc0e75a97c88 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c291cbe955b4ee5abc98132dda0255e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f9a24cad014d7f827e8f3236dd5bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:19.796933 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-90c25709-6861-4e28-ba34-dc0e75a97c88 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/f182d52b-9650-44f2-bd28-f2ae1daa1438" status: 200 len: 1294 microversion: 2.1 time: 0.337266 Sep 08 10:50:19.802219 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1426/2882] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:19 2022] GET /compute/v2.1/servers/f182d52b-9650-44f2-bd28-f2ae1daa1438 => generated 1294 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:19.809322 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7903e949-8f3f-4a59-ab75-b091de542351 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:19.814520 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7903e949-8f3f-4a59-ab75-b091de542351 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] [instance: 9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:19.834651 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7903e949-8f3f-4a59-ab75-b091de542351 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:19.835438 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7903e949-8f3f-4a59-ab75-b091de542351 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:19.836294 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7903e949-8f3f-4a59-ab75-b091de542351 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:19.837443 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7903e949-8f3f-4a59-ab75-b091de542351 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:19.838186 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7903e949-8f3f-4a59-ab75-b091de542351 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:19.842963 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7903e949-8f3f-4a59-ab75-b091de542351 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:20.097259 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-8d355e88-97a6-48f4-af03-b5dee22b26e1 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] validate_networks() for [('65531cf0-0f1f-4e94-a8b7-fc0d1dd74f35', None, None, None, None, None), (None, None, '87858844-1949-4224-96fe-9b4790f10cad', None, None, None), (None, None, '50649fb7-2e13-4d59-ad27-f52395856925', None, None, None), ('3fb23a71-63d6-4ff3-a7ec-73d908135c66', None, None, None, None, None), ('3fb23a71-63d6-4ff3-a7ec-73d908135c66', None, None, None, None, None), ('687be2b0-91b8-4bff-afb3-b47296d44586', '10.2.2.100', None, None, None, None), ('687be2b0-91b8-4bff-afb3-b47296d44586', '10.2.2.200', None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:50:20.786325 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7903e949-8f3f-4a59-ab75-b091de542351 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db1b83d2b924ed4855ebe9360c9b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8737f6bb9629491d958debd24aa6f9a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:20.800716 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7903e949-8f3f-4a59-ab75-b091de542351 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] 10.222.0.27 "GET /compute/v2.1/servers/9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf" status: 200 len: 1316 microversion: 2.1 time: 0.996478 Sep 08 10:50:20.803300 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1427/2883] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:19 2022] GET /compute/v2.1/servers/9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf => generated 1316 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:20.823744 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a85d1efa-78e2-4796-bda5-cb703efcb6a5 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:20.838157 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a85d1efa-78e2-4796-bda5-cb703efcb6a5 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '53c0c66b5a004df886b3d973a978c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc5f459e4a143d1b8bf1c5c64153644', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:20.842251 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a85d1efa-78e2-4796-bda5-cb703efcb6a5 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Searching by: {'deleted': False, 'project_id': '7bc5f459e4a143d1b8bf1c5c64153644'} {{(pid=128861) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:50:20.862838 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a85d1efa-78e2-4796-bda5-cb703efcb6a5 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:20.863797 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a85d1efa-78e2-4796-bda5-cb703efcb6a5 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:20.864503 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a85d1efa-78e2-4796-bda5-cb703efcb6a5 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:20.865631 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a85d1efa-78e2-4796-bda5-cb703efcb6a5 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:20.866355 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a85d1efa-78e2-4796-bda5-cb703efcb6a5 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:20.867054 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a85d1efa-78e2-4796-bda5-cb703efcb6a5 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:20.906990 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=100 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:50:20.926933 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.multi_cell_list [None req-a85d1efa-78e2-4796-bda5-cb703efcb6a5 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=128861) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 10:50:21.007004 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a85d1efa-78e2-4796-bda5-cb703efcb6a5 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 1337 microversion: 2.1 time: 0.198947 Sep 08 10:50:21.009207 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1428/2884] 10.222.0.27 () {58 vars in 1125 bytes} [Thu Sep 8 10:50:20 2022] GET /compute/v2.1/servers => generated 1337 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:21.022479 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-8eb252e0-cc6d-4921-b515-5efd7819f8cf req-d19e2b99-ea38-4402-99b0-ad60f00a22d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e522775b-9d4f-4fee-beaa-61e1b0452ead", "tag": "002ad59a-75f1-4c84-828c-d70e98fdeb3a"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:50:21.039781 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-8eb252e0-cc6d-4921-b515-5efd7819f8cf req-d19e2b99-ea38-4402-99b0-ad60f00a22d9 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:21.042140 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-8eb252e0-cc6d-4921-b515-5efd7819f8cf req-d19e2b99-ea38-4402-99b0-ad60f00a22d9 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:21.042949 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-8eb252e0-cc6d-4921-b515-5efd7819f8cf req-d19e2b99-ea38-4402-99b0-ad60f00a22d9 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:21.091413 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-8eb252e0-cc6d-4921-b515-5efd7819f8cf req-d19e2b99-ea38-4402-99b0-ad60f00a22d9 service nova] Creating event network-changed:002ad59a-75f1-4c84-828c-d70e98fdeb3a for instance e522775b-9d4f-4fee-beaa-61e1b0452ead on n-h1-850501-12 Sep 08 10:50:21.110497 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-8eb252e0-cc6d-4921-b515-5efd7819f8cf req-d19e2b99-ea38-4402-99b0-ad60f00a22d9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098431 Sep 08 10:50:21.111980 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1429/2885] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:50:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:50:21.119591 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9e723706-a89b-4fb8-bf55-85b54192130e tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:21.120930 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9e723706-a89b-4fb8-bf55-85b54192130e tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: 13b25df0-d58e-4da2-bcea-6dac80800bab] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:21.145125 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e723706-a89b-4fb8-bf55-85b54192130e tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:21.146106 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e723706-a89b-4fb8-bf55-85b54192130e tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:21.146811 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e723706-a89b-4fb8-bf55-85b54192130e tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:21.147843 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e723706-a89b-4fb8-bf55-85b54192130e tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:21.148819 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e723706-a89b-4fb8-bf55-85b54192130e tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:21.150724 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e723706-a89b-4fb8-bf55-85b54192130e tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:22.791193 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9e723706-a89b-4fb8-bf55-85b54192130e tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86e8bd6f9048ce8718f432e51128a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c3752f739b47a296a5b88948fe7f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:22.806597 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9e723706-a89b-4fb8-bf55-85b54192130e tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "GET /compute/v2.1/servers/13b25df0-d58e-4da2-bcea-6dac80800bab" status: 200 len: 1324 microversion: 2.1 time: 1.692157 Sep 08 10:50:22.817895 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1430/2886] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:21 2022] GET /compute/v2.1/servers/13b25df0-d58e-4da2-bcea-6dac80800bab => generated 1324 bytes in 1705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:22.831897 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c43c2b47-7268-4f45-b166-8caa37b02656 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:22.836933 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c43c2b47-7268-4f45-b166-8caa37b02656 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:22.857416 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c43c2b47-7268-4f45-b166-8caa37b02656 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:22.858301 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c43c2b47-7268-4f45-b166-8caa37b02656 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:22.858983 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c43c2b47-7268-4f45-b166-8caa37b02656 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:22.859914 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c43c2b47-7268-4f45-b166-8caa37b02656 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:22.860575 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c43c2b47-7268-4f45-b166-8caa37b02656 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:22.864340 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c43c2b47-7268-4f45-b166-8caa37b02656 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:23.169200 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c43c2b47-7268-4f45-b166-8caa37b02656 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:23.179389 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c43c2b47-7268-4f45-b166-8caa37b02656 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:23.180913 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c43c2b47-7268-4f45-b166-8caa37b02656 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:23.204513 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:50:23.215269 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c43c2b47-7268-4f45-b166-8caa37b02656 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1546 microversion: 2.91 time: 0.395690 Sep 08 10:50:23.223002 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1431/2887] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:50:22 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1546 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:50:23.241764 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-4c1bb9ee-75c5-48d7-8937-e2c04241612e req-7216cd3e-c574-41b0-a65f-429bffe38d0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ef65322-ccb1-4703-b15f-4ab8306b32de", "name": "network-vif-deleted", "tag": "01beadcd-0dc7-47e2-9884-a66d9958f0e8"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:50:23.295445 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-4c1bb9ee-75c5-48d7-8937-e2c04241612e req-7216cd3e-c574-41b0-a65f-429bffe38d0b service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:23.301812 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-4c1bb9ee-75c5-48d7-8937-e2c04241612e req-7216cd3e-c574-41b0-a65f-429bffe38d0b service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:23.302401 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-4c1bb9ee-75c5-48d7-8937-e2c04241612e req-7216cd3e-c574-41b0-a65f-429bffe38d0b service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:23.326691 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-4c1bb9ee-75c5-48d7-8937-e2c04241612e req-7216cd3e-c574-41b0-a65f-429bffe38d0b service nova] Creating event network-vif-deleted:01beadcd-0dc7-47e2-9884-a66d9958f0e8 for instance 7ef65322-ccb1-4703-b15f-4ab8306b32de on n-h2-850501-12 Sep 08 10:50:23.339740 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-4c1bb9ee-75c5-48d7-8937-e2c04241612e req-7216cd3e-c574-41b0-a65f-429bffe38d0b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111208 Sep 08 10:50:23.343670 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1432/2888] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:50:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:50:23.353807 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2ab716f9-474a-4a2b-b47b-ca86f71e16d6 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:23.355205 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2ab716f9-474a-4a2b-b47b-ca86f71e16d6 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: f182d52b-9650-44f2-bd28-f2ae1daa1438] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:23.389720 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2ab716f9-474a-4a2b-b47b-ca86f71e16d6 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:23.395597 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2ab716f9-474a-4a2b-b47b-ca86f71e16d6 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:23.401270 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2ab716f9-474a-4a2b-b47b-ca86f71e16d6 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:23.407138 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2ab716f9-474a-4a2b-b47b-ca86f71e16d6 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:23.413679 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2ab716f9-474a-4a2b-b47b-ca86f71e16d6 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:23.415099 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2ab716f9-474a-4a2b-b47b-ca86f71e16d6 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:23.930179 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2ab716f9-474a-4a2b-b47b-ca86f71e16d6 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c291cbe955b4ee5abc98132dda0255e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f9a24cad014d7f827e8f3236dd5bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:23.951491 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2ab716f9-474a-4a2b-b47b-ca86f71e16d6 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/f182d52b-9650-44f2-bd28-f2ae1daa1438" status: 200 len: 1300 microversion: 2.1 time: 0.606159 Sep 08 10:50:23.969083 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1433/2889] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:23 2022] GET /compute/v2.1/servers/f182d52b-9650-44f2-bd28-f2ae1daa1438 => generated 1300 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:23.980636 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c2b20da0-3aa1-40c9-9459-776681018e2d tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:23.980636 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c2b20da0-3aa1-40c9-9459-776681018e2d tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] [instance: 2c34cf01-2cbf-4cf8-ad8f-d3c8f2c7c66f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:23.999752 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c2b20da0-3aa1-40c9-9459-776681018e2d tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:24.002468 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c2b20da0-3aa1-40c9-9459-776681018e2d tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:24.003916 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c2b20da0-3aa1-40c9-9459-776681018e2d tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:24.007356 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c2b20da0-3aa1-40c9-9459-776681018e2d tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:24.011604 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c2b20da0-3aa1-40c9-9459-776681018e2d tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:24.012324 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c2b20da0-3aa1-40c9-9459-776681018e2d tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:24.460257 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c2b20da0-3aa1-40c9-9459-776681018e2d tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0c66b5a004df886b3d973a978c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc5f459e4a143d1b8bf1c5c64153644', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:24.476311 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c2b20da0-3aa1-40c9-9459-776681018e2d tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] 10.222.0.27 "GET /compute/v2.1/servers/2c34cf01-2cbf-4cf8-ad8f-d3c8f2c7c66f" status: 200 len: 1270 microversion: 2.1 time: 0.518550 Sep 08 10:50:24.477840 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1434/2890] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:23 2022] GET /compute/v2.1/servers/2c34cf01-2cbf-4cf8-ad8f-d3c8f2c7c66f => generated 1270 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:24.494188 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2275c0f2-deef-4fd5-91ad-a38437738f83 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:24.495161 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2275c0f2-deef-4fd5-91ad-a38437738f83 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] [instance: 9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:24.508134 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2275c0f2-deef-4fd5-91ad-a38437738f83 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:24.509089 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2275c0f2-deef-4fd5-91ad-a38437738f83 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:24.513666 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2275c0f2-deef-4fd5-91ad-a38437738f83 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:24.517683 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2275c0f2-deef-4fd5-91ad-a38437738f83 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:24.521284 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2275c0f2-deef-4fd5-91ad-a38437738f83 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:24.525331 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2275c0f2-deef-4fd5-91ad-a38437738f83 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:25.450600 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2275c0f2-deef-4fd5-91ad-a38437738f83 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db1b83d2b924ed4855ebe9360c9b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8737f6bb9629491d958debd24aa6f9a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:25.471066 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2275c0f2-deef-4fd5-91ad-a38437738f83 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] 10.222.0.27 "GET /compute/v2.1/servers/9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf" status: 200 len: 1316 microversion: 2.1 time: 0.991575 Sep 08 10:50:25.472672 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1435/2891] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:24 2022] GET /compute/v2.1/servers/9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf => generated 1316 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:25.489799 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0c66f5e1-7629-4947-b7fe-40599c1ed156 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:25.505810 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0c66f5e1-7629-4947-b7fe-40599c1ed156 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: 13b25df0-d58e-4da2-bcea-6dac80800bab] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:25.530039 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0c66f5e1-7629-4947-b7fe-40599c1ed156 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:25.536147 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0c66f5e1-7629-4947-b7fe-40599c1ed156 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:25.538872 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0c66f5e1-7629-4947-b7fe-40599c1ed156 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:25.545547 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0c66f5e1-7629-4947-b7fe-40599c1ed156 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:25.546794 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0c66f5e1-7629-4947-b7fe-40599c1ed156 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:25.547371 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0c66f5e1-7629-4947-b7fe-40599c1ed156 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:26.088221 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0c66f5e1-7629-4947-b7fe-40599c1ed156 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86e8bd6f9048ce8718f432e51128a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c3752f739b47a296a5b88948fe7f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:26.104967 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0c66f5e1-7629-4947-b7fe-40599c1ed156 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "GET /compute/v2.1/servers/13b25df0-d58e-4da2-bcea-6dac80800bab" status: 200 len: 1324 microversion: 2.1 time: 0.619875 Sep 08 10:50:26.105652 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1436/2892] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:25 2022] GET /compute/v2.1/servers/13b25df0-d58e-4da2-bcea-6dac80800bab => generated 1324 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:26.114824 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-389d3179-43cc-4d09-bbda-ea5e669aab83 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:26.118354 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-389d3179-43cc-4d09-bbda-ea5e669aab83 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:26.141826 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-389d3179-43cc-4d09-bbda-ea5e669aab83 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:26.142574 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-389d3179-43cc-4d09-bbda-ea5e669aab83 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:26.143393 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-389d3179-43cc-4d09-bbda-ea5e669aab83 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:26.145200 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-389d3179-43cc-4d09-bbda-ea5e669aab83 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:26.156450 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-389d3179-43cc-4d09-bbda-ea5e669aab83 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:26.157005 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-389d3179-43cc-4d09-bbda-ea5e669aab83 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:26.282210 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-389d3179-43cc-4d09-bbda-ea5e669aab83 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:26.295560 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-389d3179-43cc-4d09-bbda-ea5e669aab83 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:26.298880 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-389d3179-43cc-4d09-bbda-ea5e669aab83 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:26.308367 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-389d3179-43cc-4d09-bbda-ea5e669aab83 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1546 microversion: 2.91 time: 0.201286 Sep 08 10:50:26.309831 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1437/2893] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:50:26 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1546 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:50:26.316267 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-9a64e03f-0e13-46c7-b199-b7feb4c35e6c req-3a5447b8-a698-4680-8d17-728482e51158 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f96451ab-896c-4652-8e89-ba210495b5e8", "name": "network-vif-deleted", "tag": "751325a8-3cbf-4a63-b10a-17bb26abb89f"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:50:26.329355 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-9a64e03f-0e13-46c7-b199-b7feb4c35e6c req-3a5447b8-a698-4680-8d17-728482e51158 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:26.329847 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-9a64e03f-0e13-46c7-b199-b7feb4c35e6c req-3a5447b8-a698-4680-8d17-728482e51158 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:26.330281 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-9a64e03f-0e13-46c7-b199-b7feb4c35e6c req-3a5447b8-a698-4680-8d17-728482e51158 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:26.353506 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-9a64e03f-0e13-46c7-b199-b7feb4c35e6c req-3a5447b8-a698-4680-8d17-728482e51158 service nova] Creating event network-vif-deleted:751325a8-3cbf-4a63-b10a-17bb26abb89f for instance f96451ab-896c-4652-8e89-ba210495b5e8 on n-h2-850501-12 Sep 08 10:50:26.363474 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-9a64e03f-0e13-46c7-b199-b7feb4c35e6c req-3a5447b8-a698-4680-8d17-728482e51158 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051671 Sep 08 10:50:26.365384 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1438/2894] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:50:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:50:26.376037 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2ddf8147-afb1-4e37-a0b7-a5747433c847 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:26.376823 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2ddf8147-afb1-4e37-a0b7-a5747433c847 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: f182d52b-9650-44f2-bd28-f2ae1daa1438] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:26.385917 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2ddf8147-afb1-4e37-a0b7-a5747433c847 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:26.386171 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2ddf8147-afb1-4e37-a0b7-a5747433c847 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:26.386655 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2ddf8147-afb1-4e37-a0b7-a5747433c847 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:26.388046 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2ddf8147-afb1-4e37-a0b7-a5747433c847 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:26.388589 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2ddf8147-afb1-4e37-a0b7-a5747433c847 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:26.389113 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2ddf8147-afb1-4e37-a0b7-a5747433c847 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:26.505926 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2ddf8147-afb1-4e37-a0b7-a5747433c847 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c291cbe955b4ee5abc98132dda0255e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f9a24cad014d7f827e8f3236dd5bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:26.515216 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2ddf8147-afb1-4e37-a0b7-a5747433c847 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/f182d52b-9650-44f2-bd28-f2ae1daa1438" status: 200 len: 1300 microversion: 2.1 time: 0.147327 Sep 08 10:50:26.517219 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1439/2895] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:26 2022] GET /compute/v2.1/servers/f182d52b-9650-44f2-bd28-f2ae1daa1438 => generated 1300 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:26.531447 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d3c957a9-0fbb-4995-b147-2fe28585db3d tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:26.532735 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d3c957a9-0fbb-4995-b147-2fe28585db3d tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] [instance: 2c34cf01-2cbf-4cf8-ad8f-d3c8f2c7c66f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:26.542628 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d3c957a9-0fbb-4995-b147-2fe28585db3d tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:26.543489 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d3c957a9-0fbb-4995-b147-2fe28585db3d tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:26.544144 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d3c957a9-0fbb-4995-b147-2fe28585db3d tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:26.545176 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d3c957a9-0fbb-4995-b147-2fe28585db3d tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:26.546228 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d3c957a9-0fbb-4995-b147-2fe28585db3d tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:26.547072 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d3c957a9-0fbb-4995-b147-2fe28585db3d tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:26.662809 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d3c957a9-0fbb-4995-b147-2fe28585db3d tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0c66b5a004df886b3d973a978c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc5f459e4a143d1b8bf1c5c64153644', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:26.674151 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d3c957a9-0fbb-4995-b147-2fe28585db3d tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] 10.222.0.27 "GET /compute/v2.1/servers/2c34cf01-2cbf-4cf8-ad8f-d3c8f2c7c66f" status: 200 len: 1270 microversion: 2.1 time: 0.151801 Sep 08 10:50:26.685427 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1440/2896] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:26 2022] GET /compute/v2.1/servers/2c34cf01-2cbf-4cf8-ad8f-d3c8f2c7c66f => generated 1270 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:26.698546 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7d5e97fd-1463-417d-bfc4-8e93adb47584 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:26.699425 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7d5e97fd-1463-417d-bfc4-8e93adb47584 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] [instance: 9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:26.707196 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7d5e97fd-1463-417d-bfc4-8e93adb47584 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:26.710741 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7d5e97fd-1463-417d-bfc4-8e93adb47584 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:26.718883 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7d5e97fd-1463-417d-bfc4-8e93adb47584 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:26.719667 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7d5e97fd-1463-417d-bfc4-8e93adb47584 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:26.720356 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7d5e97fd-1463-417d-bfc4-8e93adb47584 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:26.723373 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7d5e97fd-1463-417d-bfc4-8e93adb47584 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:27.131570 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7d5e97fd-1463-417d-bfc4-8e93adb47584 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db1b83d2b924ed4855ebe9360c9b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8737f6bb9629491d958debd24aa6f9a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:27.141431 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7d5e97fd-1463-417d-bfc4-8e93adb47584 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] 10.222.0.27 "GET /compute/v2.1/servers/9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf" status: 200 len: 1316 microversion: 2.1 time: 0.454455 Sep 08 10:50:27.144639 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1441/2897] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:26 2022] GET /compute/v2.1/servers/9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf => generated 1316 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:27.151237 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-0567d899-f580-41be-b52d-35ef0c646b2f req-929260f6-1f4c-450e-9ef9-23da482ab75f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13b25df0-d58e-4da2-bcea-6dac80800bab", "tag": "4c8c0aef-65f1-4dab-aac2-76c85fdead87"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:50:27.183239 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-0567d899-f580-41be-b52d-35ef0c646b2f req-929260f6-1f4c-450e-9ef9-23da482ab75f service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:27.183723 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-0567d899-f580-41be-b52d-35ef0c646b2f req-929260f6-1f4c-450e-9ef9-23da482ab75f service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:27.184151 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-0567d899-f580-41be-b52d-35ef0c646b2f req-929260f6-1f4c-450e-9ef9-23da482ab75f service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:27.215230 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-0567d899-f580-41be-b52d-35ef0c646b2f req-929260f6-1f4c-450e-9ef9-23da482ab75f service nova] Creating event network-changed:4c8c0aef-65f1-4dab-aac2-76c85fdead87 for instance 13b25df0-d58e-4da2-bcea-6dac80800bab on n-h2-850501-12 Sep 08 10:50:27.233678 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-0567d899-f580-41be-b52d-35ef0c646b2f req-929260f6-1f4c-450e-9ef9-23da482ab75f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087425 Sep 08 10:50:27.236631 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1442/2898] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:50:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:50:27.249078 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-59e565d5-0a60-42c7-8a44-8e63c0988962 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:27.250980 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-59e565d5-0a60-42c7-8a44-8e63c0988962 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: 13b25df0-d58e-4da2-bcea-6dac80800bab] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:27.265669 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-59e565d5-0a60-42c7-8a44-8e63c0988962 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:27.269847 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-59e565d5-0a60-42c7-8a44-8e63c0988962 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:27.271499 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-59e565d5-0a60-42c7-8a44-8e63c0988962 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:27.272703 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-59e565d5-0a60-42c7-8a44-8e63c0988962 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:27.274673 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-59e565d5-0a60-42c7-8a44-8e63c0988962 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:27.275545 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-59e565d5-0a60-42c7-8a44-8e63c0988962 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:27.555881 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-59e565d5-0a60-42c7-8a44-8e63c0988962 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86e8bd6f9048ce8718f432e51128a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c3752f739b47a296a5b88948fe7f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:27.568994 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-59e565d5-0a60-42c7-8a44-8e63c0988962 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "GET /compute/v2.1/servers/13b25df0-d58e-4da2-bcea-6dac80800bab" status: 200 len: 1324 microversion: 2.1 time: 0.328833 Sep 08 10:50:27.569991 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1443/2899] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:27 2022] GET /compute/v2.1/servers/13b25df0-d58e-4da2-bcea-6dac80800bab => generated 1324 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:27.579706 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2b13e0cd-3401-4749-a2a4-20c9aa8a96bf tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:27.580324 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2b13e0cd-3401-4749-a2a4-20c9aa8a96bf tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:27.617049 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2b13e0cd-3401-4749-a2a4-20c9aa8a96bf tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:27.617049 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2b13e0cd-3401-4749-a2a4-20c9aa8a96bf tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:27.617049 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2b13e0cd-3401-4749-a2a4-20c9aa8a96bf tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:27.617049 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2b13e0cd-3401-4749-a2a4-20c9aa8a96bf tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:27.617049 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2b13e0cd-3401-4749-a2a4-20c9aa8a96bf tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:27.617049 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2b13e0cd-3401-4749-a2a4-20c9aa8a96bf tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:27.731857 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2b13e0cd-3401-4749-a2a4-20c9aa8a96bf tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:27.749170 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2b13e0cd-3401-4749-a2a4-20c9aa8a96bf tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:27.752096 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2b13e0cd-3401-4749-a2a4-20c9aa8a96bf tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:27.759456 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=22 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:50:27.767923 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2b13e0cd-3401-4749-a2a4-20c9aa8a96bf tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1546 microversion: 2.91 time: 0.194879 Sep 08 10:50:27.770240 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1444/2900] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:50:27 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1546 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:50:27.780742 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-d26fe7ec-5613-434f-b7d8-0a60d861b1ca req-63335eb1-537e-4235-84ee-a89b103f65aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf", "name": "network-vif-plugged", "status": "completed", "tag": "036e4e77-856c-4b8c-9f28-cff6e87b1645"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:50:27.796749 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-d26fe7ec-5613-434f-b7d8-0a60d861b1ca req-63335eb1-537e-4235-84ee-a89b103f65aa service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:27.797434 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-d26fe7ec-5613-434f-b7d8-0a60d861b1ca req-63335eb1-537e-4235-84ee-a89b103f65aa service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:27.798259 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-d26fe7ec-5613-434f-b7d8-0a60d861b1ca req-63335eb1-537e-4235-84ee-a89b103f65aa service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:27.838037 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-d26fe7ec-5613-434f-b7d8-0a60d861b1ca req-63335eb1-537e-4235-84ee-a89b103f65aa service nova] Creating event network-vif-plugged:036e4e77-856c-4b8c-9f28-cff6e87b1645 for instance 9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf on n-h1-850501-12 Sep 08 10:50:27.847031 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-d26fe7ec-5613-434f-b7d8-0a60d861b1ca req-63335eb1-537e-4235-84ee-a89b103f65aa service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074178 Sep 08 10:50:27.848174 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1445/2901] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:50:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:50:27.853957 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-934b905a-37f0-4068-89c6-30945300239c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:27.854671 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-934b905a-37f0-4068-89c6-30945300239c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: f182d52b-9650-44f2-bd28-f2ae1daa1438] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:27.863202 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-934b905a-37f0-4068-89c6-30945300239c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:27.863656 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-934b905a-37f0-4068-89c6-30945300239c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:27.864393 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-934b905a-37f0-4068-89c6-30945300239c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:27.864826 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-934b905a-37f0-4068-89c6-30945300239c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:27.865323 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-934b905a-37f0-4068-89c6-30945300239c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:27.866249 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-934b905a-37f0-4068-89c6-30945300239c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:27.978983 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-934b905a-37f0-4068-89c6-30945300239c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c291cbe955b4ee5abc98132dda0255e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f9a24cad014d7f827e8f3236dd5bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:27.989058 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-934b905a-37f0-4068-89c6-30945300239c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/f182d52b-9650-44f2-bd28-f2ae1daa1438" status: 200 len: 1300 microversion: 2.1 time: 0.139283 Sep 08 10:50:27.993221 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1446/2902] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:27 2022] GET /compute/v2.1/servers/f182d52b-9650-44f2-bd28-f2ae1daa1438 => generated 1300 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:27.999155 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8195694b-aa7a-449e-a86c-49d06b6c2aa3 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:28.000177 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8195694b-aa7a-449e-a86c-49d06b6c2aa3 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] [instance: 2c34cf01-2cbf-4cf8-ad8f-d3c8f2c7c66f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:28.009177 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8195694b-aa7a-449e-a86c-49d06b6c2aa3 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:28.009887 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8195694b-aa7a-449e-a86c-49d06b6c2aa3 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:28.010480 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8195694b-aa7a-449e-a86c-49d06b6c2aa3 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:28.011373 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8195694b-aa7a-449e-a86c-49d06b6c2aa3 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:28.011829 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8195694b-aa7a-449e-a86c-49d06b6c2aa3 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:28.012763 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8195694b-aa7a-449e-a86c-49d06b6c2aa3 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:28.097246 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8195694b-aa7a-449e-a86c-49d06b6c2aa3 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0c66b5a004df886b3d973a978c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc5f459e4a143d1b8bf1c5c64153644', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:28.109557 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8195694b-aa7a-449e-a86c-49d06b6c2aa3 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] 10.222.0.27 "GET /compute/v2.1/servers/2c34cf01-2cbf-4cf8-ad8f-d3c8f2c7c66f" status: 200 len: 1278 microversion: 2.1 time: 0.118200 Sep 08 10:50:28.110348 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1447/2903] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:27 2022] GET /compute/v2.1/servers/2c34cf01-2cbf-4cf8-ad8f-d3c8f2c7c66f => generated 1278 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:28.181982 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7ade5f3a-cf00-4590-b32e-9ab5834fc842 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:28.182605 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7ade5f3a-cf00-4590-b32e-9ab5834fc842 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] [instance: 9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:28.188675 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7ade5f3a-cf00-4590-b32e-9ab5834fc842 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:28.189201 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7ade5f3a-cf00-4590-b32e-9ab5834fc842 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:28.189894 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7ade5f3a-cf00-4590-b32e-9ab5834fc842 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:28.191381 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7ade5f3a-cf00-4590-b32e-9ab5834fc842 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:28.192039 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7ade5f3a-cf00-4590-b32e-9ab5834fc842 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:28.192693 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7ade5f3a-cf00-4590-b32e-9ab5834fc842 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:28.196020 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=100 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:50:28.459576 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7ade5f3a-cf00-4590-b32e-9ab5834fc842 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db1b83d2b924ed4855ebe9360c9b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8737f6bb9629491d958debd24aa6f9a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:28.475431 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7ade5f3a-cf00-4590-b32e-9ab5834fc842 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] 10.222.0.27 "GET /compute/v2.1/servers/9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf" status: 200 len: 1316 microversion: 2.1 time: 0.295602 Sep 08 10:50:28.489858 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1448/2904] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:28 2022] GET /compute/v2.1/servers/9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf => generated 1316 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:50:28.614252 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-dad71429-bd7c-48d9-adcf-83f4671eaabf tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:28.615590 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-dad71429-bd7c-48d9-adcf-83f4671eaabf tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: 13b25df0-d58e-4da2-bcea-6dac80800bab] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:28.630839 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dad71429-bd7c-48d9-adcf-83f4671eaabf tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:28.631512 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dad71429-bd7c-48d9-adcf-83f4671eaabf tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:28.631996 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dad71429-bd7c-48d9-adcf-83f4671eaabf tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:28.633219 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dad71429-bd7c-48d9-adcf-83f4671eaabf tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:28.633693 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dad71429-bd7c-48d9-adcf-83f4671eaabf tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:28.634324 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dad71429-bd7c-48d9-adcf-83f4671eaabf tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:28.933135 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-dad71429-bd7c-48d9-adcf-83f4671eaabf tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86e8bd6f9048ce8718f432e51128a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c3752f739b47a296a5b88948fe7f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:28.944647 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-dad71429-bd7c-48d9-adcf-83f4671eaabf tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "GET /compute/v2.1/servers/13b25df0-d58e-4da2-bcea-6dac80800bab" status: 200 len: 1324 microversion: 2.1 time: 0.352408 Sep 08 10:50:28.961702 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1449/2905] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:28 2022] GET /compute/v2.1/servers/13b25df0-d58e-4da2-bcea-6dac80800bab => generated 1324 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:28.974576 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f01bd41e-ec82-4953-ab08-58630c0f1c72 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:28.975557 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f01bd41e-ec82-4953-ab08-58630c0f1c72 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:28.985229 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f01bd41e-ec82-4953-ab08-58630c0f1c72 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:28.985748 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f01bd41e-ec82-4953-ab08-58630c0f1c72 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:28.986379 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f01bd41e-ec82-4953-ab08-58630c0f1c72 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:28.989363 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f01bd41e-ec82-4953-ab08-58630c0f1c72 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:28.989363 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f01bd41e-ec82-4953-ab08-58630c0f1c72 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:28.989363 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f01bd41e-ec82-4953-ab08-58630c0f1c72 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:29.119553 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f01bd41e-ec82-4953-ab08-58630c0f1c72 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:29.131311 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f01bd41e-ec82-4953-ab08-58630c0f1c72 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:29.133083 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f01bd41e-ec82-4953-ab08-58630c0f1c72 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:29.138554 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f01bd41e-ec82-4953-ab08-58630c0f1c72 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1546 microversion: 2.91 time: 0.175404 Sep 08 10:50:29.153320 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1450/2906] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:50:28 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1546 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:50:29.153320 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f94a08d7-e753-431a-88a0-be61e4abc753 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:29.153320 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f94a08d7-e753-431a-88a0-be61e4abc753 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: f182d52b-9650-44f2-bd28-f2ae1daa1438] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:29.153320 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f94a08d7-e753-431a-88a0-be61e4abc753 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:29.153320 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f94a08d7-e753-431a-88a0-be61e4abc753 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:29.153320 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f94a08d7-e753-431a-88a0-be61e4abc753 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:29.153892 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f94a08d7-e753-431a-88a0-be61e4abc753 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:29.154284 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f94a08d7-e753-431a-88a0-be61e4abc753 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:29.155102 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f94a08d7-e753-431a-88a0-be61e4abc753 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:29.308523 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f94a08d7-e753-431a-88a0-be61e4abc753 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c291cbe955b4ee5abc98132dda0255e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f9a24cad014d7f827e8f3236dd5bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:29.318072 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=4 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:50:29.321072 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=8 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:50:29.332588 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f94a08d7-e753-431a-88a0-be61e4abc753 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/f182d52b-9650-44f2-bd28-f2ae1daa1438" status: 200 len: 1300 microversion: 2.1 time: 0.191223 Sep 08 10:50:29.335195 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1451/2907] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:29 2022] GET /compute/v2.1/servers/f182d52b-9650-44f2-bd28-f2ae1daa1438 => generated 1300 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:29.347429 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7fa9ec27-e427-4eac-aa35-292f29ed2e94 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:29.349128 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7fa9ec27-e427-4eac-aa35-292f29ed2e94 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] [instance: 2c34cf01-2cbf-4cf8-ad8f-d3c8f2c7c66f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:29.361826 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7fa9ec27-e427-4eac-aa35-292f29ed2e94 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:29.362882 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7fa9ec27-e427-4eac-aa35-292f29ed2e94 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:29.363714 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7fa9ec27-e427-4eac-aa35-292f29ed2e94 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:29.364826 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7fa9ec27-e427-4eac-aa35-292f29ed2e94 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:29.365871 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7fa9ec27-e427-4eac-aa35-292f29ed2e94 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:29.367637 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7fa9ec27-e427-4eac-aa35-292f29ed2e94 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:29.387854 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=14 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:50:29.919907 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7fa9ec27-e427-4eac-aa35-292f29ed2e94 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0c66b5a004df886b3d973a978c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc5f459e4a143d1b8bf1c5c64153644', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:29.931637 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7fa9ec27-e427-4eac-aa35-292f29ed2e94 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] 10.222.0.27 "GET /compute/v2.1/servers/2c34cf01-2cbf-4cf8-ad8f-d3c8f2c7c66f" status: 200 len: 1276 microversion: 2.1 time: 0.594286 Sep 08 10:50:29.932525 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1452/2908] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:29 2022] GET /compute/v2.1/servers/2c34cf01-2cbf-4cf8-ad8f-d3c8f2c7c66f => generated 1276 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:29.942743 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bc58cccc-0c92-43d1-9f8c-ddf504bd8dd1 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:29.943372 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bc58cccc-0c92-43d1-9f8c-ddf504bd8dd1 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] [instance: 9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:29.956457 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bc58cccc-0c92-43d1-9f8c-ddf504bd8dd1 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:29.958273 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bc58cccc-0c92-43d1-9f8c-ddf504bd8dd1 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:29.958718 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bc58cccc-0c92-43d1-9f8c-ddf504bd8dd1 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:29.959467 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bc58cccc-0c92-43d1-9f8c-ddf504bd8dd1 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:29.959938 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bc58cccc-0c92-43d1-9f8c-ddf504bd8dd1 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:29.960377 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bc58cccc-0c92-43d1-9f8c-ddf504bd8dd1 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:30.018647 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-8d355e88-97a6-48f4-af03-b5dee22b26e1 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:50:30.019402 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-8d355e88-97a6-48f4-af03-b5dee22b26e1 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:50:30.020138 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-8d355e88-97a6-48f4-af03-b5dee22b26e1 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:50:30.020792 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-8d355e88-97a6-48f4-af03-b5dee22b26e1 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:50:30.021349 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-8d355e88-97a6-48f4-af03-b5dee22b26e1 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:50:30.036458 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d355e88-97a6-48f4-af03-b5dee22b26e1 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:30.037748 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d355e88-97a6-48f4-af03-b5dee22b26e1 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:30.038553 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d355e88-97a6-48f4-af03-b5dee22b26e1 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:30.039683 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d355e88-97a6-48f4-af03-b5dee22b26e1 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:30.040390 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d355e88-97a6-48f4-af03-b5dee22b26e1 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:30.041071 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d355e88-97a6-48f4-af03-b5dee22b26e1 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:30.077817 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-8d355e88-97a6-48f4-af03-b5dee22b26e1 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Getting quotas for project bf115ce61d864726b0e6e6b28c6ac69a. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:50:30.137062 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-8d355e88-97a6-48f4-af03-b5dee22b26e1 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Getting quotas for user 72c4838df30441628becfb4e61778366 and project bf115ce61d864726b0e6e6b28c6ac69a. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:50:30.532969 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-bc58cccc-0c92-43d1-9f8c-ddf504bd8dd1 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db1b83d2b924ed4855ebe9360c9b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8737f6bb9629491d958debd24aa6f9a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:30.552180 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bc58cccc-0c92-43d1-9f8c-ddf504bd8dd1 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] 10.222.0.27 "GET /compute/v2.1/servers/9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf" status: 200 len: 1316 microversion: 2.1 time: 0.618474 Sep 08 10:50:30.580204 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1453/2909] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:29 2022] GET /compute/v2.1/servers/9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf => generated 1316 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:30.598866 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f528b2cd-f7f1-411c-a80a-eddfbdc265cd tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:30.601184 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f528b2cd-f7f1-411c-a80a-eddfbdc265cd tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: 13b25df0-d58e-4da2-bcea-6dac80800bab] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:30.617954 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f528b2cd-f7f1-411c-a80a-eddfbdc265cd tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:30.619420 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f528b2cd-f7f1-411c-a80a-eddfbdc265cd tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:30.621438 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f528b2cd-f7f1-411c-a80a-eddfbdc265cd tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:30.623127 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f528b2cd-f7f1-411c-a80a-eddfbdc265cd tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:30.624281 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f528b2cd-f7f1-411c-a80a-eddfbdc265cd tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:30.625688 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f528b2cd-f7f1-411c-a80a-eddfbdc265cd tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:30.626868 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8d355e88-97a6-48f4-af03-b5dee22b26e1 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:50:30.631016 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8d355e88-97a6-48f4-af03-b5dee22b26e1 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='ebff4de5-8f82-4a0a-a826-58fed3acf939',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='1fe08f80-705c-498b-8b61-0b087bf22faf',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e52a1873-bdd8-4917-ab68-19c1194e2792',volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:50:30.873567 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=4 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:50:31.202986 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f528b2cd-f7f1-411c-a80a-eddfbdc265cd tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86e8bd6f9048ce8718f432e51128a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c3752f739b47a296a5b88948fe7f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:31.213444 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f528b2cd-f7f1-411c-a80a-eddfbdc265cd tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "GET /compute/v2.1/servers/13b25df0-d58e-4da2-bcea-6dac80800bab" status: 200 len: 1324 microversion: 2.1 time: 0.632471 Sep 08 10:50:31.214889 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1454/2910] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:30 2022] GET /compute/v2.1/servers/13b25df0-d58e-4da2-bcea-6dac80800bab => generated 1324 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:31.220340 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-dc584359-fc19-4012-8b76-5b11debe5eba tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:31.221399 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-dc584359-fc19-4012-8b76-5b11debe5eba tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:31.227737 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dc584359-fc19-4012-8b76-5b11debe5eba tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:31.228693 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dc584359-fc19-4012-8b76-5b11debe5eba tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:31.229363 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dc584359-fc19-4012-8b76-5b11debe5eba tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:31.230245 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dc584359-fc19-4012-8b76-5b11debe5eba tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:31.231066 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dc584359-fc19-4012-8b76-5b11debe5eba tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:31.231654 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dc584359-fc19-4012-8b76-5b11debe5eba tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:31.330190 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-dc584359-fc19-4012-8b76-5b11debe5eba tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:31.344600 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-dc584359-fc19-4012-8b76-5b11debe5eba tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:31.353561 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-dc584359-fc19-4012-8b76-5b11debe5eba tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:31.370127 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-dc584359-fc19-4012-8b76-5b11debe5eba tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1546 microversion: 2.91 time: 0.153551 Sep 08 10:50:31.371503 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1455/2911] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:50:31 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1546 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:50:31.376866 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f2b1f253-94a9-4a84-af66-8cf9e1ea8654 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:31.378353 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f2b1f253-94a9-4a84-af66-8cf9e1ea8654 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: f182d52b-9650-44f2-bd28-f2ae1daa1438] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:31.385879 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f2b1f253-94a9-4a84-af66-8cf9e1ea8654 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:31.386597 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f2b1f253-94a9-4a84-af66-8cf9e1ea8654 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:31.387225 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f2b1f253-94a9-4a84-af66-8cf9e1ea8654 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:31.388100 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f2b1f253-94a9-4a84-af66-8cf9e1ea8654 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:31.388774 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f2b1f253-94a9-4a84-af66-8cf9e1ea8654 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:31.389390 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f2b1f253-94a9-4a84-af66-8cf9e1ea8654 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:31.442286 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8d355e88-97a6-48f4-af03-b5dee22b26e1 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.32 time: 11.729187 Sep 08 10:50:31.444084 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1457/2912] 10.222.0.27 () {62 vars in 1189 bytes} [Thu Sep 8 10:50:19 2022] POST /compute/v2.1/servers => generated 405 bytes in 11732 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 08 10:50:31.456981 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-f2dd6afc-cb99-457c-8ed0-f04120d7647f req-83ba9b22-9c64-4e81-bc80-db4f057111c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4e3b624-1ff1-4ee3-a6e1-d5da50a26d3f", "tag": "60cd05e0-e70b-455b-8ae9-16cf57bae568"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:50:31.477077 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-f2dd6afc-cb99-457c-8ed0-f04120d7647f req-83ba9b22-9c64-4e81-bc80-db4f057111c3 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:31.478587 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-f2dd6afc-cb99-457c-8ed0-f04120d7647f req-83ba9b22-9c64-4e81-bc80-db4f057111c3 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:31.479593 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-f2dd6afc-cb99-457c-8ed0-f04120d7647f req-83ba9b22-9c64-4e81-bc80-db4f057111c3 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:31.516322 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-f2dd6afc-cb99-457c-8ed0-f04120d7647f req-83ba9b22-9c64-4e81-bc80-db4f057111c3 service nova] Creating event network-changed:60cd05e0-e70b-455b-8ae9-16cf57bae568 for instance a4e3b624-1ff1-4ee3-a6e1-d5da50a26d3f on n-h2-850501-12 Sep 08 10:50:31.526766 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-f2dd6afc-cb99-457c-8ed0-f04120d7647f req-83ba9b22-9c64-4e81-bc80-db4f057111c3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077521 Sep 08 10:50:31.531357 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1458/2913] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:50:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:50:31.559653 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c287faa2-5b63-4f4a-88e1-835371e6e0a8 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:31.560380 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c287faa2-5b63-4f4a-88e1-835371e6e0a8 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] [instance: 2c34cf01-2cbf-4cf8-ad8f-d3c8f2c7c66f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:31.571571 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c287faa2-5b63-4f4a-88e1-835371e6e0a8 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:31.572338 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c287faa2-5b63-4f4a-88e1-835371e6e0a8 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:31.572939 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c287faa2-5b63-4f4a-88e1-835371e6e0a8 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:31.574784 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c287faa2-5b63-4f4a-88e1-835371e6e0a8 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:31.575474 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c287faa2-5b63-4f4a-88e1-835371e6e0a8 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:31.576106 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c287faa2-5b63-4f4a-88e1-835371e6e0a8 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:31.740608 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f2b1f253-94a9-4a84-af66-8cf9e1ea8654 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c291cbe955b4ee5abc98132dda0255e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f9a24cad014d7f827e8f3236dd5bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:31.749593 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f2b1f253-94a9-4a84-af66-8cf9e1ea8654 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/f182d52b-9650-44f2-bd28-f2ae1daa1438" status: 200 len: 1367 microversion: 2.1 time: 0.376380 Sep 08 10:50:31.754501 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1456/2914] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:31 2022] GET /compute/v2.1/servers/f182d52b-9650-44f2-bd28-f2ae1daa1438 => generated 1367 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:31.770269 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5e54271a-b54f-4f01-95cd-9e46da02049f tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:31.770897 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5e54271a-b54f-4f01-95cd-9e46da02049f tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:31.883618 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5e54271a-b54f-4f01-95cd-9e46da02049f tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:31.893341 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5e54271a-b54f-4f01-95cd-9e46da02049f tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:31.894796 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5e54271a-b54f-4f01-95cd-9e46da02049f tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:31.903114 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5e54271a-b54f-4f01-95cd-9e46da02049f tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 200 len: 1286 microversion: 2.32 time: 0.137494 Sep 08 10:50:31.929539 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1457/2915] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:50:31 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 1286 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:50:31.935027 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d3fc85dd-4c98-42d2-b7b3-a581083738a3 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:31.935654 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d3fc85dd-4c98-42d2-b7b3-a581083738a3 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] [instance: 9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:31.953745 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d3fc85dd-4c98-42d2-b7b3-a581083738a3 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:31.955688 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d3fc85dd-4c98-42d2-b7b3-a581083738a3 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:31.956312 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d3fc85dd-4c98-42d2-b7b3-a581083738a3 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:31.957320 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d3fc85dd-4c98-42d2-b7b3-a581083738a3 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:31.958020 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d3fc85dd-4c98-42d2-b7b3-a581083738a3 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:31.958582 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d3fc85dd-4c98-42d2-b7b3-a581083738a3 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:32.177275 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d3fc85dd-4c98-42d2-b7b3-a581083738a3 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db1b83d2b924ed4855ebe9360c9b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8737f6bb9629491d958debd24aa6f9a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:32.193369 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d3fc85dd-4c98-42d2-b7b3-a581083738a3 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] 10.222.0.27 "GET /compute/v2.1/servers/9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf" status: 200 len: 1466 microversion: 2.1 time: 0.262114 Sep 08 10:50:32.211242 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1458/2916] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:31 2022] GET /compute/v2.1/servers/9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf => generated 1466 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:32.237976 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9a7ce01c-8867-4171-b948-84486910e181 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1090259065", "metadata": {"image_type": "test"}}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:50:32.241162 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9a7ce01c-8867-4171-b948-84486910e181 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] [instance: 9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:32.247770 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9a7ce01c-8867-4171-b948-84486910e181 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:32.249668 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9a7ce01c-8867-4171-b948-84486910e181 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:32.250710 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9a7ce01c-8867-4171-b948-84486910e181 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:32.252002 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9a7ce01c-8867-4171-b948-84486910e181 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:32.253749 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9a7ce01c-8867-4171-b948-84486910e181 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:32.254813 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9a7ce01c-8867-4171-b948-84486910e181 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:32.296972 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-9a7ce01c-8867-4171-b948-84486910e181 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Getting quotas for project 8737f6bb9629491d958debd24aa6f9a0. Resources: dict_keys(['metadata_items']) {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:50:32.304527 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-9a7ce01c-8867-4171-b948-84486910e181 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Getting quotas for user 3db1b83d2b924ed4855ebe9360c9b46f and project 8737f6bb9629491d958debd24aa6f9a0. Resources: dict_keys(['metadata_items']) {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:50:32.592123 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9a7ce01c-8867-4171-b948-84486910e181 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] 10.222.0.27 "POST /compute/v2.1/servers/9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf/action" status: 202 len: 0 microversion: 2.1 time: 0.361928 Sep 08 10:50:32.594392 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1459/2917] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:50:32 2022] POST /compute/v2.1/servers/9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf/action => generated 0 bytes in 366 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Sep 08 10:50:32.614860 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4fb6b9f4-0a7d-4b26-937d-a678af9d7e0c tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:32.616543 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4fb6b9f4-0a7d-4b26-937d-a678af9d7e0c tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: 13b25df0-d58e-4da2-bcea-6dac80800bab] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:32.633416 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4fb6b9f4-0a7d-4b26-937d-a678af9d7e0c tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:32.634864 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4fb6b9f4-0a7d-4b26-937d-a678af9d7e0c tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:32.635937 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4fb6b9f4-0a7d-4b26-937d-a678af9d7e0c tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:32.638342 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4fb6b9f4-0a7d-4b26-937d-a678af9d7e0c tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:32.640233 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4fb6b9f4-0a7d-4b26-937d-a678af9d7e0c tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:32.641654 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4fb6b9f4-0a7d-4b26-937d-a678af9d7e0c tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:32.655882 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c287faa2-5b63-4f4a-88e1-835371e6e0a8 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0c66b5a004df886b3d973a978c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc5f459e4a143d1b8bf1c5c64153644', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:32.672630 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c287faa2-5b63-4f4a-88e1-835371e6e0a8 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] 10.222.0.27 "GET /compute/v2.1/servers/2c34cf01-2cbf-4cf8-ad8f-d3c8f2c7c66f" status: 200 len: 1318 microversion: 2.1 time: 1.137452 Sep 08 10:50:32.673454 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1459/2918] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:31 2022] GET /compute/v2.1/servers/2c34cf01-2cbf-4cf8-ad8f-d3c8f2c7c66f => generated 1318 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:32.679959 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d2afc724-5158-4117-b3cd-08155fc2e03c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:32.680737 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d2afc724-5158-4117-b3cd-08155fc2e03c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:32.700140 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2afc724-5158-4117-b3cd-08155fc2e03c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:32.701064 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2afc724-5158-4117-b3cd-08155fc2e03c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:32.701309 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2afc724-5158-4117-b3cd-08155fc2e03c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:32.702314 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2afc724-5158-4117-b3cd-08155fc2e03c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:32.706277 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2afc724-5158-4117-b3cd-08155fc2e03c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:32.707012 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2afc724-5158-4117-b3cd-08155fc2e03c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:32.920987 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4fb6b9f4-0a7d-4b26-937d-a678af9d7e0c tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86e8bd6f9048ce8718f432e51128a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c3752f739b47a296a5b88948fe7f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:32.942536 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4fb6b9f4-0a7d-4b26-937d-a678af9d7e0c tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "GET /compute/v2.1/servers/13b25df0-d58e-4da2-bcea-6dac80800bab" status: 200 len: 1324 microversion: 2.1 time: 0.337667 Sep 08 10:50:32.942536 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1460/2919] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:32 2022] GET /compute/v2.1/servers/13b25df0-d58e-4da2-bcea-6dac80800bab => generated 1324 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:32.949872 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ca730396-7229-440f-8ac1-9de29df419e8 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Calling method '.version_select at 0x7f68e40d5c10>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:33.019041 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ca730396-7229-440f-8ac1-9de29df419e8 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] 10.222.0.27 "GET /compute/v2.1/images/d1109835-85cb-4a9f-996a-3ab19278e978" status: 200 len: 1422 microversion: 2.1 time: 0.082607 Sep 08 10:50:33.019944 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1461/2920] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:50:32 2022] GET /compute/v2.1/images/d1109835-85cb-4a9f-996a-3ab19278e978 => generated 1422 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:33.033164 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-687800ed-8805-47c0-b294-2d758d844c57 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:33.033841 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-687800ed-8805-47c0-b294-2d758d844c57 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: f182d52b-9650-44f2-bd28-f2ae1daa1438] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:33.045939 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-687800ed-8805-47c0-b294-2d758d844c57 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:33.046444 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-687800ed-8805-47c0-b294-2d758d844c57 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:33.046945 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-687800ed-8805-47c0-b294-2d758d844c57 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:33.047706 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-687800ed-8805-47c0-b294-2d758d844c57 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:33.048345 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-687800ed-8805-47c0-b294-2d758d844c57 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:33.061305 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-687800ed-8805-47c0-b294-2d758d844c57 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:33.093591 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d2afc724-5158-4117-b3cd-08155fc2e03c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:33.117229 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d2afc724-5158-4117-b3cd-08155fc2e03c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:33.120230 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d2afc724-5158-4117-b3cd-08155fc2e03c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:33.130487 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=12,nova_api:UPDATE=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:50:33.133780 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d2afc724-5158-4117-b3cd-08155fc2e03c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1533 microversion: 2.91 time: 0.458811 Sep 08 10:50:33.135211 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1460/2921] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:50:32 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1533 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:50:33.144148 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-74fd3d69-fd44-4753-a5b6-e2e3dfd7c0ef tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:33.147161 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-74fd3d69-fd44-4753-a5b6-e2e3dfd7c0ef tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:33.458227 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-74fd3d69-fd44-4753-a5b6-e2e3dfd7c0ef tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:33.470802 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-74fd3d69-fd44-4753-a5b6-e2e3dfd7c0ef tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:33.479923 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-74fd3d69-fd44-4753-a5b6-e2e3dfd7c0ef tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:33.486070 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-74fd3d69-fd44-4753-a5b6-e2e3dfd7c0ef tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 200 len: 1286 microversion: 2.32 time: 0.348473 Sep 08 10:50:33.489131 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-687800ed-8805-47c0-b294-2d758d844c57 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c291cbe955b4ee5abc98132dda0255e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f9a24cad014d7f827e8f3236dd5bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:33.493313 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1461/2922] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:50:33 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 1286 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:50:33.505311 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-687800ed-8805-47c0-b294-2d758d844c57 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/f182d52b-9650-44f2-bd28-f2ae1daa1438" status: 200 len: 1367 microversion: 2.1 time: 0.478873 Sep 08 10:50:33.507503 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1462/2923] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:33 2022] GET /compute/v2.1/servers/f182d52b-9650-44f2-bd28-f2ae1daa1438 => generated 1367 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:33.512702 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-988115bd-4cd5-4a1e-9c59-0db6bea1ef23 tempest-UnshelveToHostMultiNodesTest-1667251479 tempest-UnshelveToHostMultiNodesTest-1667251479-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:33.514821 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-518310d6-c6ef-4c50-8ce3-e8bcead02d2f req-bf89a12f-da34-46fe-af1e-dee4a2d3b7cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13b25df0-d58e-4da2-bcea-6dac80800bab", "name": "network-vif-plugged", "status": "completed", "tag": "4c8c0aef-65f1-4dab-aac2-76c85fdead87"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:50:33.520539 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-988115bd-4cd5-4a1e-9c59-0db6bea1ef23 tempest-UnshelveToHostMultiNodesTest-1667251479 tempest-UnshelveToHostMultiNodesTest-1667251479-project-admin] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:33.529084 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-988115bd-4cd5-4a1e-9c59-0db6bea1ef23 tempest-UnshelveToHostMultiNodesTest-1667251479 tempest-UnshelveToHostMultiNodesTest-1667251479-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:33.529582 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-988115bd-4cd5-4a1e-9c59-0db6bea1ef23 tempest-UnshelveToHostMultiNodesTest-1667251479 tempest-UnshelveToHostMultiNodesTest-1667251479-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:33.530057 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-988115bd-4cd5-4a1e-9c59-0db6bea1ef23 tempest-UnshelveToHostMultiNodesTest-1667251479 tempest-UnshelveToHostMultiNodesTest-1667251479-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:33.530836 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-988115bd-4cd5-4a1e-9c59-0db6bea1ef23 tempest-UnshelveToHostMultiNodesTest-1667251479 tempest-UnshelveToHostMultiNodesTest-1667251479-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:33.531307 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-988115bd-4cd5-4a1e-9c59-0db6bea1ef23 tempest-UnshelveToHostMultiNodesTest-1667251479 tempest-UnshelveToHostMultiNodesTest-1667251479-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:33.531732 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-988115bd-4cd5-4a1e-9c59-0db6bea1ef23 tempest-UnshelveToHostMultiNodesTest-1667251479 tempest-UnshelveToHostMultiNodesTest-1667251479-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:33.627195 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-518310d6-c6ef-4c50-8ce3-e8bcead02d2f req-bf89a12f-da34-46fe-af1e-dee4a2d3b7cb service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:33.628980 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-518310d6-c6ef-4c50-8ce3-e8bcead02d2f req-bf89a12f-da34-46fe-af1e-dee4a2d3b7cb service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:33.629461 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-518310d6-c6ef-4c50-8ce3-e8bcead02d2f req-bf89a12f-da34-46fe-af1e-dee4a2d3b7cb service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:33.655923 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-988115bd-4cd5-4a1e-9c59-0db6bea1ef23 tempest-UnshelveToHostMultiNodesTest-1667251479 tempest-UnshelveToHostMultiNodesTest-1667251479-project-admin] Lazy-loading 'services' on Instance uuid 0b71abe8-cfe5-4b57-8860-7861810d9c7b {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:50:33.672539 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-518310d6-c6ef-4c50-8ce3-e8bcead02d2f req-bf89a12f-da34-46fe-af1e-dee4a2d3b7cb service nova] Creating event network-vif-plugged:4c8c0aef-65f1-4dab-aac2-76c85fdead87 for instance 13b25df0-d58e-4da2-bcea-6dac80800bab on n-h2-850501-12 Sep 08 10:50:33.680862 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-518310d6-c6ef-4c50-8ce3-e8bcead02d2f req-bf89a12f-da34-46fe-af1e-dee4a2d3b7cb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.185330 Sep 08 10:50:33.682296 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1462/2924] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:50:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:50:33.704300 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-988115bd-4cd5-4a1e-9c59-0db6bea1ef23 tempest-UnshelveToHostMultiNodesTest-1667251479 tempest-UnshelveToHostMultiNodesTest-1667251479-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1940 microversion: 2.91 time: 0.195682 Sep 08 10:50:33.709298 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1463/2925] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:50:33 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1940 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:50:33.734174 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d7a331b4-794c-44a2-943b-af01cf0bb65a tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:33.735327 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d7a331b4-794c-44a2-943b-af01cf0bb65a tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] [instance: 2c34cf01-2cbf-4cf8-ad8f-d3c8f2c7c66f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:33.746143 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d7a331b4-794c-44a2-943b-af01cf0bb65a tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:33.747207 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d7a331b4-794c-44a2-943b-af01cf0bb65a tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:33.747901 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d7a331b4-794c-44a2-943b-af01cf0bb65a tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:33.748810 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d7a331b4-794c-44a2-943b-af01cf0bb65a tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:33.749496 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d7a331b4-794c-44a2-943b-af01cf0bb65a tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:33.750250 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d7a331b4-794c-44a2-943b-af01cf0bb65a tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:33.758911 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8f1ddf96-3e07-4bda-befe-11f4d1027e30 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:50:33.759741 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8f1ddf96-3e07-4bda-befe-11f4d1027e30 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:33.784487 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f1ddf96-3e07-4bda-befe-11f4d1027e30 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:33.795218 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f1ddf96-3e07-4bda-befe-11f4d1027e30 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:33.798258 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f1ddf96-3e07-4bda-befe-11f4d1027e30 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:33.800417 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f1ddf96-3e07-4bda-befe-11f4d1027e30 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:33.802349 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f1ddf96-3e07-4bda-befe-11f4d1027e30 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:33.803677 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f1ddf96-3e07-4bda-befe-11f4d1027e30 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:33.825963 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:50:33.845598 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-8f1ddf96-3e07-4bda-befe-11f4d1027e30 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lazy-loading 'flavor' on Instance uuid 0b71abe8-cfe5-4b57-8860-7861810d9c7b {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:50:34.149210 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8f1ddf96-3e07-4bda-befe-11f4d1027e30 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "POST /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b/action" status: 202 len: 0 microversion: 2.91 time: 0.405178 Sep 08 10:50:34.149916 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1464/2926] 10.222.0.27 () {62 vars in 1319 bytes} [Thu Sep 8 10:50:33 2022] POST /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b/action => generated 0 bytes in 407 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:50:34.160112 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9ce4a782-86b7-4eba-8fa1-be8c53a3bb27 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:34.161855 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9ce4a782-86b7-4eba-8fa1-be8c53a3bb27 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: 13b25df0-d58e-4da2-bcea-6dac80800bab] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:34.180615 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ce4a782-86b7-4eba-8fa1-be8c53a3bb27 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:34.181357 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ce4a782-86b7-4eba-8fa1-be8c53a3bb27 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:34.181678 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ce4a782-86b7-4eba-8fa1-be8c53a3bb27 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:34.182619 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ce4a782-86b7-4eba-8fa1-be8c53a3bb27 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:34.183297 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ce4a782-86b7-4eba-8fa1-be8c53a3bb27 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:34.183878 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ce4a782-86b7-4eba-8fa1-be8c53a3bb27 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:34.419746 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9ce4a782-86b7-4eba-8fa1-be8c53a3bb27 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86e8bd6f9048ce8718f432e51128a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c3752f739b47a296a5b88948fe7f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:34.431493 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9ce4a782-86b7-4eba-8fa1-be8c53a3bb27 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "GET /compute/v2.1/servers/13b25df0-d58e-4da2-bcea-6dac80800bab" status: 200 len: 1324 microversion: 2.1 time: 0.280182 Sep 08 10:50:34.432366 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1465/2927] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:34 2022] GET /compute/v2.1/servers/13b25df0-d58e-4da2-bcea-6dac80800bab => generated 1324 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:34.452762 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8c622a2e-c3ee-4388-a44d-fac2cb039963 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Calling method '.version_select at 0x7f68e466dd30>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:34.534285 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8c622a2e-c3ee-4388-a44d-fac2cb039963 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] 10.222.0.27 "GET /compute/v2.1/images/d1109835-85cb-4a9f-996a-3ab19278e978" status: 200 len: 1422 microversion: 2.1 time: 0.100430 Sep 08 10:50:34.535314 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1466/2928] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:50:34 2022] GET /compute/v2.1/images/d1109835-85cb-4a9f-996a-3ab19278e978 => generated 1422 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:34.540048 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-32b3dd5d-6b5b-4b18-96a8-8a97f1ceafd2 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:34.540658 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-32b3dd5d-6b5b-4b18-96a8-8a97f1ceafd2 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:34.547413 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-32b3dd5d-6b5b-4b18-96a8-8a97f1ceafd2 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:34.547954 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-32b3dd5d-6b5b-4b18-96a8-8a97f1ceafd2 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:34.548394 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-32b3dd5d-6b5b-4b18-96a8-8a97f1ceafd2 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:34.549162 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-32b3dd5d-6b5b-4b18-96a8-8a97f1ceafd2 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:34.549625 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-32b3dd5d-6b5b-4b18-96a8-8a97f1ceafd2 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:34.550050 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-32b3dd5d-6b5b-4b18-96a8-8a97f1ceafd2 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:34.649960 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-32b3dd5d-6b5b-4b18-96a8-8a97f1ceafd2 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:34.654907 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d7a331b4-794c-44a2-943b-af01cf0bb65a tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0c66b5a004df886b3d973a978c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc5f459e4a143d1b8bf1c5c64153644', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:34.665050 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d7a331b4-794c-44a2-943b-af01cf0bb65a tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] 10.222.0.27 "GET /compute/v2.1/servers/2c34cf01-2cbf-4cf8-ad8f-d3c8f2c7c66f" status: 200 len: 1318 microversion: 2.1 time: 0.941831 Sep 08 10:50:34.671134 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-32b3dd5d-6b5b-4b18-96a8-8a97f1ceafd2 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:34.671703 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1463/2929] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:33 2022] GET /compute/v2.1/servers/2c34cf01-2cbf-4cf8-ad8f-d3c8f2c7c66f => generated 1318 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:34.674363 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-32b3dd5d-6b5b-4b18-96a8-8a97f1ceafd2 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:34.688106 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e7d3474f-9f93-4c53-9330-5ee4b8cff34b tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:34.689244 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e7d3474f-9f93-4c53-9330-5ee4b8cff34b tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:34.689512 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-32b3dd5d-6b5b-4b18-96a8-8a97f1ceafd2 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1539 microversion: 2.91 time: 0.152379 Sep 08 10:50:34.691184 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1467/2930] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:50:34 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1539 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:50:34.699062 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7e4836fc-1479-4ab1-94f1-bb10e76ca3fa tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:34.700007 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7e4836fc-1479-4ab1-94f1-bb10e76ca3fa tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: f182d52b-9650-44f2-bd28-f2ae1daa1438] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:34.700885 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7d3474f-9f93-4c53-9330-5ee4b8cff34b tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:34.701777 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7d3474f-9f93-4c53-9330-5ee4b8cff34b tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:34.702449 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7d3474f-9f93-4c53-9330-5ee4b8cff34b tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:34.703566 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7d3474f-9f93-4c53-9330-5ee4b8cff34b tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:34.707081 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7d3474f-9f93-4c53-9330-5ee4b8cff34b tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:34.708270 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7d3474f-9f93-4c53-9330-5ee4b8cff34b tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:34.710910 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7e4836fc-1479-4ab1-94f1-bb10e76ca3fa tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:34.711398 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7e4836fc-1479-4ab1-94f1-bb10e76ca3fa tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:34.711908 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7e4836fc-1479-4ab1-94f1-bb10e76ca3fa tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:34.713166 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7e4836fc-1479-4ab1-94f1-bb10e76ca3fa tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:34.713635 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7e4836fc-1479-4ab1-94f1-bb10e76ca3fa tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:34.714893 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7e4836fc-1479-4ab1-94f1-bb10e76ca3fa tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:34.880094 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e7d3474f-9f93-4c53-9330-5ee4b8cff34b tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:34.918485 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e7d3474f-9f93-4c53-9330-5ee4b8cff34b tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:34.923123 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e7d3474f-9f93-4c53-9330-5ee4b8cff34b tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:34.928683 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e7d3474f-9f93-4c53-9330-5ee4b8cff34b tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 200 len: 1528 microversion: 2.32 time: 0.255112 Sep 08 10:50:34.931146 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1464/2931] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:50:34 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 1528 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:50:35.033598 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7e4836fc-1479-4ab1-94f1-bb10e76ca3fa tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c291cbe955b4ee5abc98132dda0255e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f9a24cad014d7f827e8f3236dd5bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:35.050822 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7e4836fc-1479-4ab1-94f1-bb10e76ca3fa tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/f182d52b-9650-44f2-bd28-f2ae1daa1438" status: 200 len: 1367 microversion: 2.1 time: 0.357678 Sep 08 10:50:35.052870 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1468/2932] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:34 2022] GET /compute/v2.1/servers/f182d52b-9650-44f2-bd28-f2ae1daa1438 => generated 1367 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:35.466925 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2c3580b2-6fec-4051-8283-ce62843caf4f tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:35.468041 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2c3580b2-6fec-4051-8283-ce62843caf4f tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: 13b25df0-d58e-4da2-bcea-6dac80800bab] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:35.480726 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2c3580b2-6fec-4051-8283-ce62843caf4f tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:35.481662 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2c3580b2-6fec-4051-8283-ce62843caf4f tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:35.482600 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2c3580b2-6fec-4051-8283-ce62843caf4f tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:35.484091 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2c3580b2-6fec-4051-8283-ce62843caf4f tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:35.484884 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2c3580b2-6fec-4051-8283-ce62843caf4f tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:35.485671 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2c3580b2-6fec-4051-8283-ce62843caf4f tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:35.553460 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1ad470c0-eea4-42e5-9ab4-15d42b32ca8c tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Calling method '.version_select at 0x7f68e40ad9d0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:35.625807 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1ad470c0-eea4-42e5-9ab4-15d42b32ca8c tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] 10.222.0.27 "GET /compute/v2.1/images/d1109835-85cb-4a9f-996a-3ab19278e978" status: 200 len: 1422 microversion: 2.1 time: 0.079564 Sep 08 10:50:35.633917 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1469/2933] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:50:35 2022] GET /compute/v2.1/images/d1109835-85cb-4a9f-996a-3ab19278e978 => generated 1422 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:35.723577 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6385ef97-8f49-4e24-a00b-fd1031bb05b9 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:35.724634 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6385ef97-8f49-4e24-a00b-fd1031bb05b9 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] [instance: 2c34cf01-2cbf-4cf8-ad8f-d3c8f2c7c66f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:35.736288 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6385ef97-8f49-4e24-a00b-fd1031bb05b9 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:35.737632 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6385ef97-8f49-4e24-a00b-fd1031bb05b9 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:35.738363 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6385ef97-8f49-4e24-a00b-fd1031bb05b9 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:35.739560 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6385ef97-8f49-4e24-a00b-fd1031bb05b9 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:35.740598 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6385ef97-8f49-4e24-a00b-fd1031bb05b9 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:35.741370 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6385ef97-8f49-4e24-a00b-fd1031bb05b9 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:35.963599 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6385ef97-8f49-4e24-a00b-fd1031bb05b9 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0c66b5a004df886b3d973a978c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc5f459e4a143d1b8bf1c5c64153644', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:35.977749 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6385ef97-8f49-4e24-a00b-fd1031bb05b9 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] 10.222.0.27 "GET /compute/v2.1/servers/2c34cf01-2cbf-4cf8-ad8f-d3c8f2c7c66f" status: 200 len: 1318 microversion: 2.1 time: 0.261952 Sep 08 10:50:35.978351 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1470/2934] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:35 2022] GET /compute/v2.1/servers/2c34cf01-2cbf-4cf8-ad8f-d3c8f2c7c66f => generated 1318 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:35.986594 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-db67f33f-a4f4-4230-ae8f-c1524eee575b tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:35.987715 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-db67f33f-a4f4-4230-ae8f-c1524eee575b tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:35.995052 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-db67f33f-a4f4-4230-ae8f-c1524eee575b tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:35.995550 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-db67f33f-a4f4-4230-ae8f-c1524eee575b tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:35.995996 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-db67f33f-a4f4-4230-ae8f-c1524eee575b tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:35.996709 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-db67f33f-a4f4-4230-ae8f-c1524eee575b tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:35.997206 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-db67f33f-a4f4-4230-ae8f-c1524eee575b tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:35.997645 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-db67f33f-a4f4-4230-ae8f-c1524eee575b tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:36.110985 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-db67f33f-a4f4-4230-ae8f-c1524eee575b tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:36.143812 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-db67f33f-a4f4-4230-ae8f-c1524eee575b tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:36.146885 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-db67f33f-a4f4-4230-ae8f-c1524eee575b tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:36.151649 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2c3580b2-6fec-4051-8283-ce62843caf4f tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86e8bd6f9048ce8718f432e51128a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c3752f739b47a296a5b88948fe7f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:36.164854 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2c3580b2-6fec-4051-8283-ce62843caf4f tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "GET /compute/v2.1/servers/13b25df0-d58e-4da2-bcea-6dac80800bab" status: 200 len: 1324 microversion: 2.1 time: 0.708421 Sep 08 10:50:36.166172 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-db67f33f-a4f4-4230-ae8f-c1524eee575b tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1539 microversion: 2.91 time: 0.186333 Sep 08 10:50:36.167144 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1471/2935] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:50:35 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1539 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:50:36.172428 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1465/2936] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:35 2022] GET /compute/v2.1/servers/13b25df0-d58e-4da2-bcea-6dac80800bab => generated 1324 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:36.179704 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-d43e8c4e-ef44-410f-9606-bf710b10df8d req-1fa99b86-c134-4276-9acc-0371a81ac1a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f182d52b-9650-44f2-bd28-f2ae1daa1438", "tag": "b9069650-6961-445f-8748-e1a4b9f65026"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:50:36.184672 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f34c6798-eea1-475e-b2e2-247a4104dae1 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:36.190231 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f34c6798-eea1-475e-b2e2-247a4104dae1 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:36.207988 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f34c6798-eea1-475e-b2e2-247a4104dae1 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:36.209058 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f34c6798-eea1-475e-b2e2-247a4104dae1 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:36.211715 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f34c6798-eea1-475e-b2e2-247a4104dae1 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:36.212340 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=100 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:50:36.216960 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f34c6798-eea1-475e-b2e2-247a4104dae1 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:36.217871 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f34c6798-eea1-475e-b2e2-247a4104dae1 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:36.218831 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f34c6798-eea1-475e-b2e2-247a4104dae1 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:36.218983 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-d43e8c4e-ef44-410f-9606-bf710b10df8d req-1fa99b86-c134-4276-9acc-0371a81ac1a9 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:36.219546 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-d43e8c4e-ef44-410f-9606-bf710b10df8d req-1fa99b86-c134-4276-9acc-0371a81ac1a9 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:36.219985 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-d43e8c4e-ef44-410f-9606-bf710b10df8d req-1fa99b86-c134-4276-9acc-0371a81ac1a9 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:36.239694 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-d43e8c4e-ef44-410f-9606-bf710b10df8d req-1fa99b86-c134-4276-9acc-0371a81ac1a9 service nova] Creating event network-changed:b9069650-6961-445f-8748-e1a4b9f65026 for instance f182d52b-9650-44f2-bd28-f2ae1daa1438 on n-h1-850501-12 Sep 08 10:50:36.244952 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-d43e8c4e-ef44-410f-9606-bf710b10df8d req-1fa99b86-c134-4276-9acc-0371a81ac1a9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074686 Sep 08 10:50:36.246503 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1472/2937] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:50:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:50:36.251800 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-517d47d3-b370-4bf2-9a24-8b2cb0a63265 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:36.252544 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-517d47d3-b370-4bf2-9a24-8b2cb0a63265 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: f182d52b-9650-44f2-bd28-f2ae1daa1438] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:36.260300 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-517d47d3-b370-4bf2-9a24-8b2cb0a63265 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:36.260829 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-517d47d3-b370-4bf2-9a24-8b2cb0a63265 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:36.261384 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-517d47d3-b370-4bf2-9a24-8b2cb0a63265 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:36.262375 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-517d47d3-b370-4bf2-9a24-8b2cb0a63265 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:36.262823 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-517d47d3-b370-4bf2-9a24-8b2cb0a63265 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:36.263251 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-517d47d3-b370-4bf2-9a24-8b2cb0a63265 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:36.549526 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f34c6798-eea1-475e-b2e2-247a4104dae1 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:36.562026 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f34c6798-eea1-475e-b2e2-247a4104dae1 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:36.568084 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f34c6798-eea1-475e-b2e2-247a4104dae1 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:36.571391 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f34c6798-eea1-475e-b2e2-247a4104dae1 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 200 len: 1576 microversion: 2.32 time: 0.397409 Sep 08 10:50:36.574222 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1466/2938] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:50:36 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 1576 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:50:36.654216 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-12c7fd0d-5f78-4ee6-8041-4bd205f7fcd1 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Calling method '.version_select at 0x7f68e45b9040>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:36.748352 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-12c7fd0d-5f78-4ee6-8041-4bd205f7fcd1 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] 10.222.0.27 "GET /compute/v2.1/images/d1109835-85cb-4a9f-996a-3ab19278e978" status: 200 len: 1422 microversion: 2.1 time: 0.107599 Sep 08 10:50:36.757683 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1467/2939] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:50:36 2022] GET /compute/v2.1/images/d1109835-85cb-4a9f-996a-3ab19278e978 => generated 1422 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:36.796875 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-517d47d3-b370-4bf2-9a24-8b2cb0a63265 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c291cbe955b4ee5abc98132dda0255e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f9a24cad014d7f827e8f3236dd5bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:36.822405 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-517d47d3-b370-4bf2-9a24-8b2cb0a63265 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/f182d52b-9650-44f2-bd28-f2ae1daa1438" status: 200 len: 1367 microversion: 2.1 time: 0.572238 Sep 08 10:50:36.831051 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1473/2940] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:36 2022] GET /compute/v2.1/servers/f182d52b-9650-44f2-bd28-f2ae1daa1438 => generated 1367 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:37.007002 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9cf830f6-99e4-45f2-89db-d57e66c2179c tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:37.008087 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9cf830f6-99e4-45f2-89db-d57e66c2179c tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] [instance: 2c34cf01-2cbf-4cf8-ad8f-d3c8f2c7c66f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:37.021828 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9cf830f6-99e4-45f2-89db-d57e66c2179c tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:37.024731 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9cf830f6-99e4-45f2-89db-d57e66c2179c tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:37.025360 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9cf830f6-99e4-45f2-89db-d57e66c2179c tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:37.030320 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9cf830f6-99e4-45f2-89db-d57e66c2179c tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:37.030921 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9cf830f6-99e4-45f2-89db-d57e66c2179c tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:37.031469 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9cf830f6-99e4-45f2-89db-d57e66c2179c tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:37.204418 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fbbc2ea9-a067-4d58-804b-74c59dea2ea3 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:37.207418 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fbbc2ea9-a067-4d58-804b-74c59dea2ea3 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:37.225559 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fbbc2ea9-a067-4d58-804b-74c59dea2ea3 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:37.227033 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fbbc2ea9-a067-4d58-804b-74c59dea2ea3 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:37.228132 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fbbc2ea9-a067-4d58-804b-74c59dea2ea3 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:37.231066 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fbbc2ea9-a067-4d58-804b-74c59dea2ea3 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:37.232223 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fbbc2ea9-a067-4d58-804b-74c59dea2ea3 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:37.232923 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fbbc2ea9-a067-4d58-804b-74c59dea2ea3 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:37.473408 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-fbbc2ea9-a067-4d58-804b-74c59dea2ea3 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:37.489649 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-fbbc2ea9-a067-4d58-804b-74c59dea2ea3 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:37.491806 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-fbbc2ea9-a067-4d58-804b-74c59dea2ea3 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:37.509263 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fbbc2ea9-a067-4d58-804b-74c59dea2ea3 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1539 microversion: 2.91 time: 0.311808 Sep 08 10:50:37.525666 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1474/2941] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:50:37 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1539 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:50:37.540906 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fd8297f5-9361-4f92-84ca-7b5c800fe253 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:37.542616 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fd8297f5-9361-4f92-84ca-7b5c800fe253 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: 13b25df0-d58e-4da2-bcea-6dac80800bab] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:37.550837 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fd8297f5-9361-4f92-84ca-7b5c800fe253 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:37.564379 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fd8297f5-9361-4f92-84ca-7b5c800fe253 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:37.565644 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fd8297f5-9361-4f92-84ca-7b5c800fe253 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:37.567307 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fd8297f5-9361-4f92-84ca-7b5c800fe253 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:37.573190 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fd8297f5-9361-4f92-84ca-7b5c800fe253 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:37.573891 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fd8297f5-9361-4f92-84ca-7b5c800fe253 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:37.918131 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9cf830f6-99e4-45f2-89db-d57e66c2179c tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0c66b5a004df886b3d973a978c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc5f459e4a143d1b8bf1c5c64153644', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:37.939135 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9cf830f6-99e4-45f2-89db-d57e66c2179c tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] 10.222.0.27 "GET /compute/v2.1/servers/2c34cf01-2cbf-4cf8-ad8f-d3c8f2c7c66f" status: 200 len: 1318 microversion: 2.1 time: 0.934487 Sep 08 10:50:37.942649 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1468/2942] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:36 2022] GET /compute/v2.1/servers/2c34cf01-2cbf-4cf8-ad8f-d3c8f2c7c66f => generated 1318 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:50:37.968320 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-33e87df4-a5ff-41c3-a0fc-884197cfc4d9 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:37.972265 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-33e87df4-a5ff-41c3-a0fc-884197cfc4d9 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:38.007574 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33e87df4-a5ff-41c3-a0fc-884197cfc4d9 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:38.011075 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33e87df4-a5ff-41c3-a0fc-884197cfc4d9 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:38.012031 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33e87df4-a5ff-41c3-a0fc-884197cfc4d9 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:38.015448 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33e87df4-a5ff-41c3-a0fc-884197cfc4d9 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:38.015983 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33e87df4-a5ff-41c3-a0fc-884197cfc4d9 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:38.016638 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33e87df4-a5ff-41c3-a0fc-884197cfc4d9 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:38.153314 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-fd8297f5-9361-4f92-84ca-7b5c800fe253 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86e8bd6f9048ce8718f432e51128a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c3752f739b47a296a5b88948fe7f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:38.163312 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fd8297f5-9361-4f92-84ca-7b5c800fe253 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "GET /compute/v2.1/servers/13b25df0-d58e-4da2-bcea-6dac80800bab" status: 200 len: 1521 microversion: 2.1 time: 0.635982 Sep 08 10:50:38.170396 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1475/2943] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:37 2022] GET /compute/v2.1/servers/13b25df0-d58e-4da2-bcea-6dac80800bab => generated 1521 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:38.180693 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0be1a0fb-97ff-42d1-a734-cbc0a6357748 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Calling method '.version_select at 0x7f68e4048280>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:38.257403 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0be1a0fb-97ff-42d1-a734-cbc0a6357748 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] 10.222.0.27 "GET /compute/v2.1/images/d1109835-85cb-4a9f-996a-3ab19278e978" status: 200 len: 1422 microversion: 2.1 time: 0.085630 Sep 08 10:50:38.258533 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1476/2944] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:50:38 2022] GET /compute/v2.1/images/d1109835-85cb-4a9f-996a-3ab19278e978 => generated 1422 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:38.265382 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b10d9fa2-10f1-47aa-b160-c95a09f07a79 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:38.266196 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b10d9fa2-10f1-47aa-b160-c95a09f07a79 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: f182d52b-9650-44f2-bd28-f2ae1daa1438] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:38.281717 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b10d9fa2-10f1-47aa-b160-c95a09f07a79 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:38.282232 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b10d9fa2-10f1-47aa-b160-c95a09f07a79 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:38.282672 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b10d9fa2-10f1-47aa-b160-c95a09f07a79 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:38.290502 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b10d9fa2-10f1-47aa-b160-c95a09f07a79 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:38.291123 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b10d9fa2-10f1-47aa-b160-c95a09f07a79 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:38.291587 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b10d9fa2-10f1-47aa-b160-c95a09f07a79 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:38.352608 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-33e87df4-a5ff-41c3-a0fc-884197cfc4d9 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:38.375321 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-33e87df4-a5ff-41c3-a0fc-884197cfc4d9 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:38.380286 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-33e87df4-a5ff-41c3-a0fc-884197cfc4d9 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:38.386091 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-33e87df4-a5ff-41c3-a0fc-884197cfc4d9 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 200 len: 1594 microversion: 2.32 time: 0.440193 Sep 08 10:50:38.390695 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1469/2945] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:50:37 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 1594 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:50:38.419468 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-68f0104c-d090-4edc-972e-2c9c2d5daf0b tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:38.426652 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-68f0104c-d090-4edc-972e-2c9c2d5daf0b tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: 13b25df0-d58e-4da2-bcea-6dac80800bab] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:38.457530 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68f0104c-d090-4edc-972e-2c9c2d5daf0b tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:38.463165 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68f0104c-d090-4edc-972e-2c9c2d5daf0b tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:38.464864 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68f0104c-d090-4edc-972e-2c9c2d5daf0b tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:38.467725 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68f0104c-d090-4edc-972e-2c9c2d5daf0b tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:38.472294 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68f0104c-d090-4edc-972e-2c9c2d5daf0b tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:38.474888 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68f0104c-d090-4edc-972e-2c9c2d5daf0b tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:38.942713 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b10d9fa2-10f1-47aa-b160-c95a09f07a79 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c291cbe955b4ee5abc98132dda0255e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f9a24cad014d7f827e8f3236dd5bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:38.959338 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b10d9fa2-10f1-47aa-b160-c95a09f07a79 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/f182d52b-9650-44f2-bd28-f2ae1daa1438" status: 200 len: 1367 microversion: 2.1 time: 0.699527 Sep 08 10:50:38.959948 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1477/2946] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:38 2022] GET /compute/v2.1/servers/f182d52b-9650-44f2-bd28-f2ae1daa1438 => generated 1367 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:38.996830 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-50977793-6344-4f15-b095-0fedad839508 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:38.997809 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-50977793-6344-4f15-b095-0fedad839508 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:39.018378 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-50977793-6344-4f15-b095-0fedad839508 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:39.020795 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-50977793-6344-4f15-b095-0fedad839508 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:39.021548 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-50977793-6344-4f15-b095-0fedad839508 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:39.023737 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-50977793-6344-4f15-b095-0fedad839508 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:39.028309 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-50977793-6344-4f15-b095-0fedad839508 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:39.028926 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-50977793-6344-4f15-b095-0fedad839508 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:39.247110 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-50977793-6344-4f15-b095-0fedad839508 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:39.280916 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-50977793-6344-4f15-b095-0fedad839508 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:39.292391 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-50977793-6344-4f15-b095-0fedad839508 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:39.311242 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-50977793-6344-4f15-b095-0fedad839508 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1539 microversion: 2.91 time: 0.344164 Sep 08 10:50:39.314915 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1478/2947] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:50:38 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1539 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:50:39.336724 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-2b91567d-9099-4a46-97ac-cbf0e470d078 req-cb4aa837-6bdf-43e4-ab16-f365bac9dce4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4e3b624-1ff1-4ee3-a6e1-d5da50a26d3f", "name": "network-vif-plugged", "status": "completed", "tag": "60cd05e0-e70b-455b-8ae9-16cf57bae568"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:50:39.373239 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-2b91567d-9099-4a46-97ac-cbf0e470d078 req-cb4aa837-6bdf-43e4-ab16-f365bac9dce4 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:39.374515 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-2b91567d-9099-4a46-97ac-cbf0e470d078 req-cb4aa837-6bdf-43e4-ab16-f365bac9dce4 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:39.375111 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-2b91567d-9099-4a46-97ac-cbf0e470d078 req-cb4aa837-6bdf-43e4-ab16-f365bac9dce4 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:39.400865 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-2b91567d-9099-4a46-97ac-cbf0e470d078 req-cb4aa837-6bdf-43e4-ab16-f365bac9dce4 service nova] Creating event network-vif-plugged:60cd05e0-e70b-455b-8ae9-16cf57bae568 for instance a4e3b624-1ff1-4ee3-a6e1-d5da50a26d3f on n-h2-850501-12 Sep 08 10:50:39.426324 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-2b91567d-9099-4a46-97ac-cbf0e470d078 req-cb4aa837-6bdf-43e4-ab16-f365bac9dce4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109070 Sep 08 10:50:39.428462 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1479/2948] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:50:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:50:39.440028 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3ca9b050-e472-4aeb-98d5-d90957d6aa05 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:39.440974 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3ca9b050-e472-4aeb-98d5-d90957d6aa05 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] [instance: 2c34cf01-2cbf-4cf8-ad8f-d3c8f2c7c66f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:39.463075 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3ca9b050-e472-4aeb-98d5-d90957d6aa05 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:39.463596 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3ca9b050-e472-4aeb-98d5-d90957d6aa05 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:39.464296 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3ca9b050-e472-4aeb-98d5-d90957d6aa05 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:39.469591 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3ca9b050-e472-4aeb-98d5-d90957d6aa05 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:39.474304 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3ca9b050-e472-4aeb-98d5-d90957d6aa05 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:39.476079 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3ca9b050-e472-4aeb-98d5-d90957d6aa05 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:40.031608 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-68f0104c-d090-4edc-972e-2c9c2d5daf0b tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86e8bd6f9048ce8718f432e51128a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c3752f739b47a296a5b88948fe7f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:40.067589 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:50:40.076983 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-68f0104c-d090-4edc-972e-2c9c2d5daf0b tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "GET /compute/v2.1/servers/13b25df0-d58e-4da2-bcea-6dac80800bab" status: 200 len: 1521 microversion: 2.1 time: 1.682214 Sep 08 10:50:40.086769 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1470/2949] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:38 2022] GET /compute/v2.1/servers/13b25df0-d58e-4da2-bcea-6dac80800bab => generated 1521 bytes in 1695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:40.104404 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-95ef5fbd-11e1-4ac2-bee0-ec592bd346f7 req-2c6a3018-c11b-4bf5-8ee8-843b9815de74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c34cf01-2cbf-4cf8-ad8f-d3c8f2c7c66f", "tag": "1c319e61-bdae-43af-9d9c-cedf56fc05d4"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:50:40.155426 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-95ef5fbd-11e1-4ac2-bee0-ec592bd346f7 req-2c6a3018-c11b-4bf5-8ee8-843b9815de74 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:40.156207 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-95ef5fbd-11e1-4ac2-bee0-ec592bd346f7 req-2c6a3018-c11b-4bf5-8ee8-843b9815de74 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:40.156835 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-95ef5fbd-11e1-4ac2-bee0-ec592bd346f7 req-2c6a3018-c11b-4bf5-8ee8-843b9815de74 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:40.189565 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-95ef5fbd-11e1-4ac2-bee0-ec592bd346f7 req-2c6a3018-c11b-4bf5-8ee8-843b9815de74 service nova] Creating event network-changed:1c319e61-bdae-43af-9d9c-cedf56fc05d4 for instance 2c34cf01-2cbf-4cf8-ad8f-d3c8f2c7c66f on n-h1-850501-12 Sep 08 10:50:40.196188 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-95ef5fbd-11e1-4ac2-bee0-ec592bd346f7 req-2c6a3018-c11b-4bf5-8ee8-843b9815de74 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107123 Sep 08 10:50:40.197529 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1471/2950] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:50:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:50:40.203746 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-192a26fd-ce55-48f7-98cd-c95a5abf72f0 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Calling method '.version_select at 0x7f68e44bb9d0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:40.280313 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-3ca9b050-e472-4aeb-98d5-d90957d6aa05 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0c66b5a004df886b3d973a978c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc5f459e4a143d1b8bf1c5c64153644', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:40.298768 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3ca9b050-e472-4aeb-98d5-d90957d6aa05 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] 10.222.0.27 "GET /compute/v2.1/servers/2c34cf01-2cbf-4cf8-ad8f-d3c8f2c7c66f" status: 200 len: 1318 microversion: 2.1 time: 0.868622 Sep 08 10:50:40.301086 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1480/2951] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:39 2022] GET /compute/v2.1/servers/2c34cf01-2cbf-4cf8-ad8f-d3c8f2c7c66f => generated 1318 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:40.305403 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-192a26fd-ce55-48f7-98cd-c95a5abf72f0 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] 10.222.0.27 "GET /compute/v2.1/images/d1109835-85cb-4a9f-996a-3ab19278e978" status: 200 len: 1422 microversion: 2.1 time: 0.106377 Sep 08 10:50:40.317673 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1472/2952] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:50:40 2022] GET /compute/v2.1/images/d1109835-85cb-4a9f-996a-3ab19278e978 => generated 1422 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:40.320820 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0f3395a9-4600-448a-a03f-aa183dfcdb1f tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:40.321531 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0f3395a9-4600-448a-a03f-aa183dfcdb1f tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:40.325399 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c15c9df7-068f-4e2b-b4b6-57f017d67065 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:40.326466 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c15c9df7-068f-4e2b-b4b6-57f017d67065 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: f182d52b-9650-44f2-bd28-f2ae1daa1438] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:40.340672 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0f3395a9-4600-448a-a03f-aa183dfcdb1f tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:40.342471 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c15c9df7-068f-4e2b-b4b6-57f017d67065 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:40.343328 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c15c9df7-068f-4e2b-b4b6-57f017d67065 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:40.343807 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0f3395a9-4600-448a-a03f-aa183dfcdb1f tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:40.344278 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0f3395a9-4600-448a-a03f-aa183dfcdb1f tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:40.344656 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c15c9df7-068f-4e2b-b4b6-57f017d67065 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:40.345667 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c15c9df7-068f-4e2b-b4b6-57f017d67065 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:40.347055 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c15c9df7-068f-4e2b-b4b6-57f017d67065 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:40.347801 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c15c9df7-068f-4e2b-b4b6-57f017d67065 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:40.351380 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0f3395a9-4600-448a-a03f-aa183dfcdb1f tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:40.351986 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0f3395a9-4600-448a-a03f-aa183dfcdb1f tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:40.352436 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0f3395a9-4600-448a-a03f-aa183dfcdb1f tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:40.931480 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0f3395a9-4600-448a-a03f-aa183dfcdb1f tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:40.950353 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0f3395a9-4600-448a-a03f-aa183dfcdb1f tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:40.958158 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0f3395a9-4600-448a-a03f-aa183dfcdb1f tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:40.959481 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0f3395a9-4600-448a-a03f-aa183dfcdb1f tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 200 len: 1707 microversion: 2.32 time: 0.656750 Sep 08 10:50:40.960213 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1481/2953] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:50:40 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 1707 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:50:40.970310 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2bcea9c6-8f63-4b56-93bd-f39005a2f016 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1498708284", "metadata": {"": ""}}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:50:40.985006 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2bcea9c6-8f63-4b56-93bd-f39005a2f016 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Request method failure captured: Sep 08 10:50:40.985006 n-d-850501-12 devstack@n-api.service[128861]: request: POST /compute/v2.1/servers/13b25df0-d58e-4da2-bcea-6dac80800bab/action HTTP/1.1 Sep 08 10:50:40.985006 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:50:40.985006 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:50:40.985006 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:50:40.985006 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 107 Sep 08 10:50:40.985006 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:50:40.985006 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:50:40.985006 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:50:40.985006 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:50:40.985006 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcjivLUY-NOpubj4piWQUE4YdjVoieEQ-G0L0ay9l2jNqBIueJ_eB4w8-Iohm-hEbdImfT6Vv0CotgGIogaerBRfcTAAw-NhjLbx2EjcqsYLMFxCPLjOPfzXaEWWRNcumoyYDLdNDrrGczsG7GBIlwK26oqS5wWNAPkM7DBSBKGgOFQ Sep 08 10:50:40.985006 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:50:40.985006 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:50:40.985006 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:50:40.985006 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:50:40.985006 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:50:40.985006 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:50:40.985006 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 50c3752f739b47a296a5b88948fe7f7f Sep 08 10:50:40.985006 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1836029851 Sep 08 10:50:40.985006 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:50:40.985006 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:50:40.985006 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/50c3752f739b47a296a5b88948fe7f7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/50c3752f739b47a296a5b88948fe7f7f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_50c3752f739b47a296a5b88948fe7f7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/50c3752f739b47a296a5b88948fe7f7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:50:40.985006 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1836029851 Sep 08 10:50:40.985006 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 50c3752f739b47a296a5b88948fe7f7f Sep 08 10:50:40.985006 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1836029851 Sep 08 10:50:40.985006 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ImagesOneServerNegativeTestJSON-1836029851-project Sep 08 10:50:40.985006 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:50:40.985006 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:50:40.985006 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 7c86e8bd6f9048ce8718f432e51128a5 Sep 08 10:50:40.985006 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1836029851-project Sep 08 10:50:40.985006 n-d-850501-12 devstack@n-api.service[128861]: Sep 08 10:50:40.985006 n-d-850501-12 devstack@n-api.service[128861]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1498708284", "metadata": {"": ""}}} Sep 08 10:50:40.985006 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:50:40.985006 n-d-850501-12 devstack@n-api.service[128861]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 10:50:40.985006 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '13b25df0-d58e-4da2-bcea-6dac80800bab', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1498708284', 'metadata': {'': ''}}}} Sep 08 10:50:40.985006 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:50:40.985006 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:50:40.985006 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 10:50:40.985006 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 10:50:40.985006 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 10:50:40.985006 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise error Sep 08 10:50:40.985006 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 10:50:40.985006 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:50:40.985006 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Sep 08 10:50:40.985006 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 08 10:50:40.985006 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 08 10:50:40.985006 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 08 10:50:40.985006 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 08 10:50:40.985006 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:50:40.985006 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi On instance['createImage']: Sep 08 10:50:40.985006 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi {'': ''} Sep 08 10:50:40.985006 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:50:40.985006 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:50:40.985006 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:50:40.985006 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:50:40.985006 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:50:40.985006 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:50:40.985006 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:50:40.985006 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:50:40.985006 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:50:40.985006 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:50:40.985006 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:50:40.985006 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:50:40.985006 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 10:50:40.991173 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 10:50:40.991173 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 10:50:40.991173 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 10:50:40.991173 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 10:50:40.991173 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 10:50:40.991173 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 10:50:40.991173 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:50:40.991173 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:50:40.991173 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:50:40.991173 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:50:40.991173 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:50:40.991173 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:50:40.991173 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 10:50:40.991173 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 10:50:40.991173 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 10:50:40.991173 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:50:40.992696 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2bcea9c6-8f63-4b56-93bd-f39005a2f016 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:50:41.000239 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2bcea9c6-8f63-4b56-93bd-f39005a2f016 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "POST /compute/v2.1/servers/13b25df0-d58e-4da2-bcea-6dac80800bab/action" status: 400 len: 170 microversion: 2.1 time: 0.038662 Sep 08 10:50:41.006359 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1482/2954] 10.222.0.27 () {60 vars in 1279 bytes} [Thu Sep 8 10:50:40 2022] POST /compute/v2.1/servers/13b25df0-d58e-4da2-bcea-6dac80800bab/action => generated 170 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:50:41.012287 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-37943cb2-383a-422e-b112-e79c9fa8cff0 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:41.017075 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-37943cb2-383a-422e-b112-e79c9fa8cff0 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:41.032524 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-37943cb2-383a-422e-b112-e79c9fa8cff0 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:41.035018 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-37943cb2-383a-422e-b112-e79c9fa8cff0 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:41.037209 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-37943cb2-383a-422e-b112-e79c9fa8cff0 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:41.040349 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-37943cb2-383a-422e-b112-e79c9fa8cff0 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:41.041263 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-37943cb2-383a-422e-b112-e79c9fa8cff0 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:41.044255 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-37943cb2-383a-422e-b112-e79c9fa8cff0 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:41.267360 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-37943cb2-383a-422e-b112-e79c9fa8cff0 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:41.302671 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-37943cb2-383a-422e-b112-e79c9fa8cff0 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:41.305213 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-37943cb2-383a-422e-b112-e79c9fa8cff0 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:41.322662 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-37943cb2-383a-422e-b112-e79c9fa8cff0 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1539 microversion: 2.91 time: 0.314687 Sep 08 10:50:41.326799 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1483/2955] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:50:41 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1539 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:50:41.340118 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b2544d57-94ee-4fd9-bab3-6ffd9a4e4074 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:41.341150 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b2544d57-94ee-4fd9-bab3-6ffd9a4e4074 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: 13b25df0-d58e-4da2-bcea-6dac80800bab] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:41.358550 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b2544d57-94ee-4fd9-bab3-6ffd9a4e4074 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:41.360583 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b2544d57-94ee-4fd9-bab3-6ffd9a4e4074 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:41.363303 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b2544d57-94ee-4fd9-bab3-6ffd9a4e4074 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:41.363574 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c15c9df7-068f-4e2b-b4b6-57f017d67065 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c291cbe955b4ee5abc98132dda0255e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f9a24cad014d7f827e8f3236dd5bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:41.364906 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b2544d57-94ee-4fd9-bab3-6ffd9a4e4074 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:41.365905 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b2544d57-94ee-4fd9-bab3-6ffd9a4e4074 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:41.366576 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b2544d57-94ee-4fd9-bab3-6ffd9a4e4074 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:41.375196 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c15c9df7-068f-4e2b-b4b6-57f017d67065 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/f182d52b-9650-44f2-bd28-f2ae1daa1438" status: 200 len: 1367 microversion: 2.1 time: 1.055576 Sep 08 10:50:41.392165 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1473/2956] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:40 2022] GET /compute/v2.1/servers/f182d52b-9650-44f2-bd28-f2ae1daa1438 => generated 1367 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:41.424611 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:50:41.440543 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-012e49e5-bf8f-48a9-9664-9c3748355ec5 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:41.440853 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-012e49e5-bf8f-48a9-9664-9c3748355ec5 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] [instance: 2c34cf01-2cbf-4cf8-ad8f-d3c8f2c7c66f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:41.461545 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-012e49e5-bf8f-48a9-9664-9c3748355ec5 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:41.464274 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-012e49e5-bf8f-48a9-9664-9c3748355ec5 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:41.467152 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-012e49e5-bf8f-48a9-9664-9c3748355ec5 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:41.469962 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-012e49e5-bf8f-48a9-9664-9c3748355ec5 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:41.471917 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-012e49e5-bf8f-48a9-9664-9c3748355ec5 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:41.472972 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-012e49e5-bf8f-48a9-9664-9c3748355ec5 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:41.888070 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:50:41.923290 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b2544d57-94ee-4fd9-bab3-6ffd9a4e4074 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86e8bd6f9048ce8718f432e51128a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c3752f739b47a296a5b88948fe7f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:41.952541 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b2544d57-94ee-4fd9-bab3-6ffd9a4e4074 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "GET /compute/v2.1/servers/13b25df0-d58e-4da2-bcea-6dac80800bab" status: 200 len: 1521 microversion: 2.1 time: 0.623637 Sep 08 10:50:41.954360 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1484/2957] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:41 2022] GET /compute/v2.1/servers/13b25df0-d58e-4da2-bcea-6dac80800bab => generated 1521 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:41.982037 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c9524a3d-d922-469c-9efc-7a419db11857 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Calling method '.version_select at 0x7f68e4063dc0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:41.989746 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-012e49e5-bf8f-48a9-9664-9c3748355ec5 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0c66b5a004df886b3d973a978c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc5f459e4a143d1b8bf1c5c64153644', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:41.999270 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-012e49e5-bf8f-48a9-9664-9c3748355ec5 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] 10.222.0.27 "GET /compute/v2.1/servers/2c34cf01-2cbf-4cf8-ad8f-d3c8f2c7c66f" status: 200 len: 1318 microversion: 2.1 time: 0.589562 Sep 08 10:50:42.017061 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1474/2958] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:41 2022] GET /compute/v2.1/servers/2c34cf01-2cbf-4cf8-ad8f-d3c8f2c7c66f => generated 1318 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:42.029546 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-99bc0bdc-3273-4ee8-890c-f61df3da2af4 req-d42c0b05-d8f9-42e8-80c5-0cd0d77bf1f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf", "name": "network-vif-plugged", "status": "completed", "tag": "036e4e77-856c-4b8c-9f28-cff6e87b1645"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:50:42.110000 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-99bc0bdc-3273-4ee8-890c-f61df3da2af4 req-d42c0b05-d8f9-42e8-80c5-0cd0d77bf1f6 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:42.113175 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-99bc0bdc-3273-4ee8-890c-f61df3da2af4 req-d42c0b05-d8f9-42e8-80c5-0cd0d77bf1f6 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:42.114070 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-99bc0bdc-3273-4ee8-890c-f61df3da2af4 req-d42c0b05-d8f9-42e8-80c5-0cd0d77bf1f6 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:42.124662 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c9524a3d-d922-469c-9efc-7a419db11857 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] 10.222.0.27 "GET /compute/v2.1/images/d1109835-85cb-4a9f-996a-3ab19278e978" status: 200 len: 1422 microversion: 2.1 time: 0.168425 Sep 08 10:50:42.133392 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1485/2959] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:50:41 2022] GET /compute/v2.1/images/d1109835-85cb-4a9f-996a-3ab19278e978 => generated 1422 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:42.139038 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4559430d-bfa3-4eb7-8764-b41328d42a20 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:42.139737 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4559430d-bfa3-4eb7-8764-b41328d42a20 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: 13b25df0-d58e-4da2-bcea-6dac80800bab] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:42.147624 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-99bc0bdc-3273-4ee8-890c-f61df3da2af4 req-d42c0b05-d8f9-42e8-80c5-0cd0d77bf1f6 service nova] Creating event network-vif-plugged:036e4e77-856c-4b8c-9f28-cff6e87b1645 for instance 9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf on n-h1-850501-12 Sep 08 10:50:42.148961 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4559430d-bfa3-4eb7-8764-b41328d42a20 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:42.153341 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4559430d-bfa3-4eb7-8764-b41328d42a20 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:42.153827 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4559430d-bfa3-4eb7-8764-b41328d42a20 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:42.154606 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4559430d-bfa3-4eb7-8764-b41328d42a20 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:42.155077 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4559430d-bfa3-4eb7-8764-b41328d42a20 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:42.157439 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4559430d-bfa3-4eb7-8764-b41328d42a20 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:42.161394 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-99bc0bdc-3273-4ee8-890c-f61df3da2af4 req-d42c0b05-d8f9-42e8-80c5-0cd0d77bf1f6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154441 Sep 08 10:50:42.162861 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1475/2960] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:50:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:50:42.173320 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1191fb47-7d40-46c1-a09e-6f0a981d137b tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:42.177058 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1191fb47-7d40-46c1-a09e-6f0a981d137b tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:42.184202 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1191fb47-7d40-46c1-a09e-6f0a981d137b tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:42.185294 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1191fb47-7d40-46c1-a09e-6f0a981d137b tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:42.186236 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1191fb47-7d40-46c1-a09e-6f0a981d137b tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:42.190869 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1191fb47-7d40-46c1-a09e-6f0a981d137b tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:42.191721 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1191fb47-7d40-46c1-a09e-6f0a981d137b tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:42.193470 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1191fb47-7d40-46c1-a09e-6f0a981d137b tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:42.515228 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1191fb47-7d40-46c1-a09e-6f0a981d137b tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:42.528702 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1191fb47-7d40-46c1-a09e-6f0a981d137b tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:42.540113 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1191fb47-7d40-46c1-a09e-6f0a981d137b tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:42.546945 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1191fb47-7d40-46c1-a09e-6f0a981d137b tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 200 len: 1707 microversion: 2.32 time: 0.382052 Sep 08 10:50:42.548085 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1476/2961] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:50:42 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 1707 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:50:42.567412 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b2255f3b-c487-4ed8-acf2-acbfc65a42e7 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:42.568450 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b2255f3b-c487-4ed8-acf2-acbfc65a42e7 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:42.575967 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b2255f3b-c487-4ed8-acf2-acbfc65a42e7 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:42.587346 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b2255f3b-c487-4ed8-acf2-acbfc65a42e7 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:42.588374 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b2255f3b-c487-4ed8-acf2-acbfc65a42e7 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:42.590122 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b2255f3b-c487-4ed8-acf2-acbfc65a42e7 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:42.591067 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b2255f3b-c487-4ed8-acf2-acbfc65a42e7 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:42.592005 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b2255f3b-c487-4ed8-acf2-acbfc65a42e7 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:42.766505 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b2255f3b-c487-4ed8-acf2-acbfc65a42e7 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:42.791187 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b2255f3b-c487-4ed8-acf2-acbfc65a42e7 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:42.793609 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b2255f3b-c487-4ed8-acf2-acbfc65a42e7 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:42.805990 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b2255f3b-c487-4ed8-acf2-acbfc65a42e7 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1539 microversion: 2.91 time: 0.250977 Sep 08 10:50:42.827124 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1477/2962] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:50:42 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1539 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:50:42.842446 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8ace784f-41c5-4271-a182-795f21d85945 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:42.843910 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8ace784f-41c5-4271-a182-795f21d85945 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: f182d52b-9650-44f2-bd28-f2ae1daa1438] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:42.857134 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ace784f-41c5-4271-a182-795f21d85945 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:42.858009 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ace784f-41c5-4271-a182-795f21d85945 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:42.858827 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ace784f-41c5-4271-a182-795f21d85945 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:42.859872 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ace784f-41c5-4271-a182-795f21d85945 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:42.860655 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ace784f-41c5-4271-a182-795f21d85945 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:42.863563 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ace784f-41c5-4271-a182-795f21d85945 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:43.175793 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8ace784f-41c5-4271-a182-795f21d85945 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c291cbe955b4ee5abc98132dda0255e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f9a24cad014d7f827e8f3236dd5bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:43.190756 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8ace784f-41c5-4271-a182-795f21d85945 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/f182d52b-9650-44f2-bd28-f2ae1daa1438" status: 200 len: 1367 microversion: 2.1 time: 0.360008 Sep 08 10:50:43.193497 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1478/2963] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:42 2022] GET /compute/v2.1/servers/f182d52b-9650-44f2-bd28-f2ae1daa1438 => generated 1367 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:43.201465 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fd8a571d-4fd1-4006-a223-e6f44aa20da8 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:43.203505 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fd8a571d-4fd1-4006-a223-e6f44aa20da8 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] [instance: 2c34cf01-2cbf-4cf8-ad8f-d3c8f2c7c66f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:43.216306 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd8a571d-4fd1-4006-a223-e6f44aa20da8 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:43.217245 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd8a571d-4fd1-4006-a223-e6f44aa20da8 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:43.217862 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd8a571d-4fd1-4006-a223-e6f44aa20da8 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:43.218788 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd8a571d-4fd1-4006-a223-e6f44aa20da8 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:43.219422 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd8a571d-4fd1-4006-a223-e6f44aa20da8 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:43.220272 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd8a571d-4fd1-4006-a223-e6f44aa20da8 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:43.464458 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=8 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:50:43.499593 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fd8a571d-4fd1-4006-a223-e6f44aa20da8 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0c66b5a004df886b3d973a978c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc5f459e4a143d1b8bf1c5c64153644', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:43.504910 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:50:43.511366 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fd8a571d-4fd1-4006-a223-e6f44aa20da8 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] 10.222.0.27 "GET /compute/v2.1/servers/2c34cf01-2cbf-4cf8-ad8f-d3c8f2c7c66f" status: 200 len: 1318 microversion: 2.1 time: 0.315788 Sep 08 10:50:43.525051 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1479/2964] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:43 2022] GET /compute/v2.1/servers/2c34cf01-2cbf-4cf8-ad8f-d3c8f2c7c66f => generated 1318 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:43.525051 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a6bed029-df7d-4e82-8e95-7bb21cb3c539 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Calling method '.version_select at 0x7f68e44fc1f0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:43.621402 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a6bed029-df7d-4e82-8e95-7bb21cb3c539 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] 10.222.0.27 "GET /compute/v2.1/images/d1109835-85cb-4a9f-996a-3ab19278e978" status: 200 len: 1422 microversion: 2.1 time: 0.107533 Sep 08 10:50:43.622764 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1480/2965] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:50:43 2022] GET /compute/v2.1/images/d1109835-85cb-4a9f-996a-3ab19278e978 => generated 1422 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:43.637664 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c4f7abf9-976a-4f53-ab32-66f2f6460d2f tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:43.639096 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c4f7abf9-976a-4f53-ab32-66f2f6460d2f tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:43.670588 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c4f7abf9-976a-4f53-ab32-66f2f6460d2f tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:43.671484 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c4f7abf9-976a-4f53-ab32-66f2f6460d2f tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:43.672672 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c4f7abf9-976a-4f53-ab32-66f2f6460d2f tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:43.676214 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c4f7abf9-976a-4f53-ab32-66f2f6460d2f tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:43.678069 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c4f7abf9-976a-4f53-ab32-66f2f6460d2f tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:43.678668 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c4f7abf9-976a-4f53-ab32-66f2f6460d2f tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:43.962290 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c4f7abf9-976a-4f53-ab32-66f2f6460d2f tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:43.978750 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c4f7abf9-976a-4f53-ab32-66f2f6460d2f tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:43.980566 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c4f7abf9-976a-4f53-ab32-66f2f6460d2f tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:43.983525 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c4f7abf9-976a-4f53-ab32-66f2f6460d2f tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 200 len: 1753 microversion: 2.32 time: 0.355951 Sep 08 10:50:43.984632 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1481/2966] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:50:43 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 1753 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:50:43.990778 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4e2780b4-01ec-4343-86db-18873d5ab0f8 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:43.996597 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4e2780b4-01ec-4343-86db-18873d5ab0f8 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:44.015258 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e2780b4-01ec-4343-86db-18873d5ab0f8 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:44.016073 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e2780b4-01ec-4343-86db-18873d5ab0f8 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:44.016748 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e2780b4-01ec-4343-86db-18873d5ab0f8 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:44.020561 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e2780b4-01ec-4343-86db-18873d5ab0f8 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:44.034590 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e2780b4-01ec-4343-86db-18873d5ab0f8 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:44.035313 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e2780b4-01ec-4343-86db-18873d5ab0f8 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:44.159568 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4559430d-bfa3-4eb7-8764-b41328d42a20 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86e8bd6f9048ce8718f432e51128a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c3752f739b47a296a5b88948fe7f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:44.226388 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4559430d-bfa3-4eb7-8764-b41328d42a20 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "GET /compute/v2.1/servers/13b25df0-d58e-4da2-bcea-6dac80800bab" status: 200 len: 1521 microversion: 2.1 time: 2.099490 Sep 08 10:50:44.227804 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1486/2967] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:42 2022] GET /compute/v2.1/servers/13b25df0-d58e-4da2-bcea-6dac80800bab => generated 1521 bytes in 2101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:44.242931 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a33eef3b-4d5f-445c-8ebe-9474df0b65cc tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:44.243900 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a33eef3b-4d5f-445c-8ebe-9474df0b65cc tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: f182d52b-9650-44f2-bd28-f2ae1daa1438] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:44.252475 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a33eef3b-4d5f-445c-8ebe-9474df0b65cc tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:44.253586 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a33eef3b-4d5f-445c-8ebe-9474df0b65cc tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:44.262643 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a33eef3b-4d5f-445c-8ebe-9474df0b65cc tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:44.263972 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a33eef3b-4d5f-445c-8ebe-9474df0b65cc tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:44.264694 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a33eef3b-4d5f-445c-8ebe-9474df0b65cc tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:44.265632 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a33eef3b-4d5f-445c-8ebe-9474df0b65cc tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:44.312139 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4e2780b4-01ec-4343-86db-18873d5ab0f8 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:44.327613 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4e2780b4-01ec-4343-86db-18873d5ab0f8 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:44.338167 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4e2780b4-01ec-4343-86db-18873d5ab0f8 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:44.378733 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4e2780b4-01ec-4343-86db-18873d5ab0f8 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1539 microversion: 2.91 time: 0.392252 Sep 08 10:50:44.393155 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1482/2968] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:50:43 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1539 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:50:44.393155 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-112032e9-1889-48f2-a751-d649587d1a86 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-215797909", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:50:44.394021 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-112032e9-1889-48f2-a751-d649587d1a86 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Request method failure captured: Sep 08 10:50:44.394021 n-d-850501-12 devstack@n-api.service[128862]: request: POST /compute/v2.1/servers/13b25df0-d58e-4da2-bcea-6dac80800bab/action HTTP/1.1 Sep 08 10:50:44.394021 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:50:44.394021 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:50:44.394021 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:50:44.394021 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 618 Sep 08 10:50:44.394021 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:50:44.394021 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:50:44.394021 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:50:44.394021 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:50:44.394021 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcjivLUY-NOpubj4piWQUE4YdjVoieEQ-G0L0ay9l2jNqBIueJ_eB4w8-Iohm-hEbdImfT6Vv0CotgGIogaerBRfcTAAw-NhjLbx2EjcqsYLMFxCPLjOPfzXaEWWRNcumoyYDLdNDrrGczsG7GBIlwK26oqS5wWNAPkM7DBSBKGgOFQ Sep 08 10:50:44.394021 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:50:44.394021 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:50:44.394021 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:50:44.394021 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:50:44.394021 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:50:44.394021 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:50:44.394021 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 50c3752f739b47a296a5b88948fe7f7f Sep 08 10:50:44.394021 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1836029851 Sep 08 10:50:44.394021 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:50:44.394021 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:50:44.394021 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/50c3752f739b47a296a5b88948fe7f7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/50c3752f739b47a296a5b88948fe7f7f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_50c3752f739b47a296a5b88948fe7f7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/50c3752f739b47a296a5b88948fe7f7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:50:44.394021 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1836029851 Sep 08 10:50:44.394021 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 50c3752f739b47a296a5b88948fe7f7f Sep 08 10:50:44.394021 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1836029851 Sep 08 10:50:44.394021 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ImagesOneServerNegativeTestJSON-1836029851-project Sep 08 10:50:44.394021 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:50:44.394021 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:50:44.394021 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 7c86e8bd6f9048ce8718f432e51128a5 Sep 08 10:50:44.394021 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1836029851-project Sep 08 10:50:44.394021 n-d-850501-12 devstack@n-api.service[128862]: Sep 08 10:50:44.394021 n-d-850501-12 devstack@n-api.service[128862]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-215797909", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Sep 08 10:50:44.394021 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:50:44.394021 n-d-850501-12 devstack@n-api.service[128862]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 10:50:44.394021 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '13b25df0-d58e-4da2-bcea-6dac80800bab', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-215797909', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Sep 08 10:50:44.394021 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:50:44.394021 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:50:44.394021 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 10:50:44.394021 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 10:50:44.394021 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 10:50:44.394021 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise error Sep 08 10:50:44.399446 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 10:50:44.399446 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:50:44.399446 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Sep 08 10:50:44.399446 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 08 10:50:44.399446 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 08 10:50:44.399446 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 08 10:50:44.399446 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 08 10:50:44.399446 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:50:44.399446 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi On instance['createImage']: Sep 08 10:50:44.399446 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Sep 08 10:50:44.399446 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:50:44.399446 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:50:44.399446 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:50:44.399446 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:50:44.399446 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:50:44.399446 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:50:44.399446 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:50:44.399446 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:50:44.399446 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:50:44.399446 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:50:44.399446 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:50:44.399446 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:50:44.399446 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 10:50:44.399446 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 10:50:44.399446 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 10:50:44.399446 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 10:50:44.399446 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 10:50:44.399446 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 10:50:44.399446 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 10:50:44.399446 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:50:44.399446 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:50:44.399446 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:50:44.399446 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:50:44.399446 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:50:44.399446 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:50:44.399446 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 10:50:44.399446 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 10:50:44.399446 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 10:50:44.399446 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:50:44.416800 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-112032e9-1889-48f2-a751-d649587d1a86 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:50:44.416800 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-112032e9-1889-48f2-a751-d649587d1a86 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "POST /compute/v2.1/servers/13b25df0-d58e-4da2-bcea-6dac80800bab/action" status: 400 len: 938 microversion: 2.1 time: 0.014551 Sep 08 10:50:44.416800 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1483/2969] 10.222.0.27 () {60 vars in 1279 bytes} [Thu Sep 8 10:50:44 2022] POST /compute/v2.1/servers/13b25df0-d58e-4da2-bcea-6dac80800bab/action => generated 938 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:50:44.416800 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-603d5038-723f-4c73-8f1c-36f443406605 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:44.416800 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-603d5038-723f-4c73-8f1c-36f443406605 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: 13b25df0-d58e-4da2-bcea-6dac80800bab] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:44.443366 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-603d5038-723f-4c73-8f1c-36f443406605 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:44.444216 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-603d5038-723f-4c73-8f1c-36f443406605 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:44.444766 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-603d5038-723f-4c73-8f1c-36f443406605 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:44.447040 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-603d5038-723f-4c73-8f1c-36f443406605 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:44.448170 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-603d5038-723f-4c73-8f1c-36f443406605 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:44.448473 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-603d5038-723f-4c73-8f1c-36f443406605 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:44.930108 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a33eef3b-4d5f-445c-8ebe-9474df0b65cc tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c291cbe955b4ee5abc98132dda0255e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f9a24cad014d7f827e8f3236dd5bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:44.949256 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a33eef3b-4d5f-445c-8ebe-9474df0b65cc tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/f182d52b-9650-44f2-bd28-f2ae1daa1438" status: 200 len: 1367 microversion: 2.1 time: 0.719910 Sep 08 10:50:44.950468 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1487/2970] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:44 2022] GET /compute/v2.1/servers/f182d52b-9650-44f2-bd28-f2ae1daa1438 => generated 1367 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:44.960103 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bc26cf77-ea68-45d8-97e1-ebb08d47cbd9 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:44.961065 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bc26cf77-ea68-45d8-97e1-ebb08d47cbd9 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] [instance: 2c34cf01-2cbf-4cf8-ad8f-d3c8f2c7c66f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:44.982694 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bc26cf77-ea68-45d8-97e1-ebb08d47cbd9 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:44.983562 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bc26cf77-ea68-45d8-97e1-ebb08d47cbd9 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:44.984299 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bc26cf77-ea68-45d8-97e1-ebb08d47cbd9 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:44.985522 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bc26cf77-ea68-45d8-97e1-ebb08d47cbd9 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:44.986833 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bc26cf77-ea68-45d8-97e1-ebb08d47cbd9 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:44.987427 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bc26cf77-ea68-45d8-97e1-ebb08d47cbd9 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:45.514466 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-603d5038-723f-4c73-8f1c-36f443406605 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86e8bd6f9048ce8718f432e51128a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c3752f739b47a296a5b88948fe7f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:45.545697 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-603d5038-723f-4c73-8f1c-36f443406605 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "GET /compute/v2.1/servers/13b25df0-d58e-4da2-bcea-6dac80800bab" status: 200 len: 1521 microversion: 2.1 time: 1.134484 Sep 08 10:50:45.547117 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1484/2971] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:44 2022] GET /compute/v2.1/servers/13b25df0-d58e-4da2-bcea-6dac80800bab => generated 1521 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:45.567215 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e8aa66f3-f0d2-4fb5-a2b3-ef7f68086ba0 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Calling method '.version_select at 0x7f68e8a92d30>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:45.720378 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e8aa66f3-f0d2-4fb5-a2b3-ef7f68086ba0 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] 10.222.0.27 "GET /compute/v2.1/images/d1109835-85cb-4a9f-996a-3ab19278e978" status: 200 len: 1422 microversion: 2.1 time: 0.163767 Sep 08 10:50:45.730248 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1485/2972] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:50:45 2022] GET /compute/v2.1/images/d1109835-85cb-4a9f-996a-3ab19278e978 => generated 1422 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:45.749322 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-28328658-2f7f-42f5-b703-4ebd17e70e7a tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:45.756246 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-28328658-2f7f-42f5-b703-4ebd17e70e7a tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:45.785803 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28328658-2f7f-42f5-b703-4ebd17e70e7a tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:45.786321 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28328658-2f7f-42f5-b703-4ebd17e70e7a tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:45.786759 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28328658-2f7f-42f5-b703-4ebd17e70e7a tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:45.791059 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28328658-2f7f-42f5-b703-4ebd17e70e7a tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:45.794513 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28328658-2f7f-42f5-b703-4ebd17e70e7a tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:45.795300 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28328658-2f7f-42f5-b703-4ebd17e70e7a tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:47.116775 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-bc26cf77-ea68-45d8-97e1-ebb08d47cbd9 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0c66b5a004df886b3d973a978c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc5f459e4a143d1b8bf1c5c64153644', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:47.130435 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bc26cf77-ea68-45d8-97e1-ebb08d47cbd9 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] 10.222.0.27 "GET /compute/v2.1/servers/2c34cf01-2cbf-4cf8-ad8f-d3c8f2c7c66f" status: 200 len: 1318 microversion: 2.1 time: 2.178458 Sep 08 10:50:47.142838 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1488/2973] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:44 2022] GET /compute/v2.1/servers/2c34cf01-2cbf-4cf8-ad8f-d3c8f2c7c66f => generated 1318 bytes in 2192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:47.154433 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2e68e406-dcf7-4eed-b5b4-38cfb1698e55 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:47.159808 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2e68e406-dcf7-4eed-b5b4-38cfb1698e55 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:47.204083 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2e68e406-dcf7-4eed-b5b4-38cfb1698e55 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:47.208887 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2e68e406-dcf7-4eed-b5b4-38cfb1698e55 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:47.213249 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2e68e406-dcf7-4eed-b5b4-38cfb1698e55 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:47.215151 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2e68e406-dcf7-4eed-b5b4-38cfb1698e55 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:47.218840 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2e68e406-dcf7-4eed-b5b4-38cfb1698e55 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:47.228126 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2e68e406-dcf7-4eed-b5b4-38cfb1698e55 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:47.452868 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-28328658-2f7f-42f5-b703-4ebd17e70e7a tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:47.480422 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-28328658-2f7f-42f5-b703-4ebd17e70e7a tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:47.485957 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-28328658-2f7f-42f5-b703-4ebd17e70e7a tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:47.491731 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-28328658-2f7f-42f5-b703-4ebd17e70e7a tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 200 len: 1753 microversion: 2.32 time: 1.753189 Sep 08 10:50:47.498123 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1486/2974] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:50:45 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 1753 bytes in 1767 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:50:47.510686 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-36b0b229-61af-4cc2-8e45-c7910ee53bfa tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:47.511582 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-36b0b229-61af-4cc2-8e45-c7910ee53bfa tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: 13b25df0-d58e-4da2-bcea-6dac80800bab] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:47.540671 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36b0b229-61af-4cc2-8e45-c7910ee53bfa tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:47.543563 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36b0b229-61af-4cc2-8e45-c7910ee53bfa tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:47.544523 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36b0b229-61af-4cc2-8e45-c7910ee53bfa tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:47.550810 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36b0b229-61af-4cc2-8e45-c7910ee53bfa tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:47.558032 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36b0b229-61af-4cc2-8e45-c7910ee53bfa tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:47.559467 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36b0b229-61af-4cc2-8e45-c7910ee53bfa tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:47.683724 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2e68e406-dcf7-4eed-b5b4-38cfb1698e55 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:47.696862 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2e68e406-dcf7-4eed-b5b4-38cfb1698e55 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:47.699671 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2e68e406-dcf7-4eed-b5b4-38cfb1698e55 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:47.734954 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2e68e406-dcf7-4eed-b5b4-38cfb1698e55 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1539 microversion: 2.91 time: 0.590160 Sep 08 10:50:47.749797 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1489/2975] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:50:47 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1539 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:50:47.789984 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-51d89296-c28d-415e-9d67-e5974e59b393 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:47.795477 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-51d89296-c28d-415e-9d67-e5974e59b393 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: f182d52b-9650-44f2-bd28-f2ae1daa1438] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:47.841904 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-51d89296-c28d-415e-9d67-e5974e59b393 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:47.842433 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-51d89296-c28d-415e-9d67-e5974e59b393 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:47.842875 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-51d89296-c28d-415e-9d67-e5974e59b393 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:47.843821 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-51d89296-c28d-415e-9d67-e5974e59b393 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:47.844297 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-51d89296-c28d-415e-9d67-e5974e59b393 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:47.844734 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-51d89296-c28d-415e-9d67-e5974e59b393 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:48.299625 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-36b0b229-61af-4cc2-8e45-c7910ee53bfa tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86e8bd6f9048ce8718f432e51128a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c3752f739b47a296a5b88948fe7f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:48.334923 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-36b0b229-61af-4cc2-8e45-c7910ee53bfa tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "GET /compute/v2.1/servers/13b25df0-d58e-4da2-bcea-6dac80800bab" status: 200 len: 1521 microversion: 2.1 time: 0.827868 Sep 08 10:50:48.338283 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1487/2976] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:47 2022] GET /compute/v2.1/servers/13b25df0-d58e-4da2-bcea-6dac80800bab => generated 1521 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:48.388195 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1f9f5428-94a6-4024-bfec-70ea5115853e tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Calling method '.version_select at 0x7f68e42ddee0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:48.459344 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-51d89296-c28d-415e-9d67-e5974e59b393 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c291cbe955b4ee5abc98132dda0255e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f9a24cad014d7f827e8f3236dd5bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:48.479526 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-51d89296-c28d-415e-9d67-e5974e59b393 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/f182d52b-9650-44f2-bd28-f2ae1daa1438" status: 200 len: 1367 microversion: 2.1 time: 0.726105 Sep 08 10:50:48.483154 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1490/2977] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:47 2022] GET /compute/v2.1/servers/f182d52b-9650-44f2-bd28-f2ae1daa1438 => generated 1367 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:48.516859 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bbc12447-febc-4dea-8412-245b5896e80b tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:48.518433 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bbc12447-febc-4dea-8412-245b5896e80b tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] [instance: 2c34cf01-2cbf-4cf8-ad8f-d3c8f2c7c66f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:48.527951 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bbc12447-febc-4dea-8412-245b5896e80b tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:48.528624 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bbc12447-febc-4dea-8412-245b5896e80b tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:48.529253 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bbc12447-febc-4dea-8412-245b5896e80b tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:48.530094 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bbc12447-febc-4dea-8412-245b5896e80b tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:48.530675 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bbc12447-febc-4dea-8412-245b5896e80b tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:48.531220 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bbc12447-febc-4dea-8412-245b5896e80b tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:48.552270 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1f9f5428-94a6-4024-bfec-70ea5115853e tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] 10.222.0.27 "GET /compute/v2.1/images/d1109835-85cb-4a9f-996a-3ab19278e978" status: 200 len: 1422 microversion: 2.1 time: 0.181011 Sep 08 10:50:48.565247 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1488/2978] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:50:48 2022] GET /compute/v2.1/images/d1109835-85cb-4a9f-996a-3ab19278e978 => generated 1422 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:48.576491 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-636d7cf8-ae7d-422c-888a-f8fa7a71aad2 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:50:48.581868 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-636d7cf8-ae7d-422c-888a-f8fa7a71aad2 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Request method failure captured: Sep 08 10:50:48.581868 n-d-850501-12 devstack@n-api.service[128862]: request: POST /compute/v2.1/servers/13b25df0-d58e-4da2-bcea-6dac80800bab/action HTTP/1.1 Sep 08 10:50:48.581868 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:50:48.581868 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:50:48.581868 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:50:48.581868 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 285 Sep 08 10:50:48.581868 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:50:48.581868 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:50:48.581868 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:50:48.581868 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:50:48.581868 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcjivLUY-NOpubj4piWQUE4YdjVoieEQ-G0L0ay9l2jNqBIueJ_eB4w8-Iohm-hEbdImfT6Vv0CotgGIogaerBRfcTAAw-NhjLbx2EjcqsYLMFxCPLjOPfzXaEWWRNcumoyYDLdNDrrGczsG7GBIlwK26oqS5wWNAPkM7DBSBKGgOFQ Sep 08 10:50:48.581868 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:50:48.581868 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:50:48.581868 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:50:48.581868 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:50:48.581868 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:50:48.581868 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:50:48.581868 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 50c3752f739b47a296a5b88948fe7f7f Sep 08 10:50:48.581868 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1836029851 Sep 08 10:50:48.581868 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:50:48.581868 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:50:48.581868 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/50c3752f739b47a296a5b88948fe7f7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/50c3752f739b47a296a5b88948fe7f7f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_50c3752f739b47a296a5b88948fe7f7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/50c3752f739b47a296a5b88948fe7f7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:50:48.581868 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1836029851 Sep 08 10:50:48.581868 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 50c3752f739b47a296a5b88948fe7f7f Sep 08 10:50:48.581868 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1836029851 Sep 08 10:50:48.581868 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ImagesOneServerNegativeTestJSON-1836029851-project Sep 08 10:50:48.581868 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:50:48.581868 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:50:48.581868 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 7c86e8bd6f9048ce8718f432e51128a5 Sep 08 10:50:48.581868 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1836029851-project Sep 08 10:50:48.581868 n-d-850501-12 devstack@n-api.service[128862]: Sep 08 10:50:48.581868 n-d-850501-12 devstack@n-api.service[128862]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Sep 08 10:50:48.581868 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:50:48.581868 n-d-850501-12 devstack@n-api.service[128862]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 08 10:50:48.581868 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '13b25df0-d58e-4da2-bcea-6dac80800bab', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Sep 08 10:50:48.581868 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:50:48.581868 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:50:48.581868 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 10:50:48.581868 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 10:50:48.581868 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 10:50:48.581868 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise error Sep 08 10:50:48.581868 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 08 10:50:48.581868 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:50:48.581868 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Sep 08 10:50:48.581868 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 08 10:50:48.581868 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:50:48.581868 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi On instance['createImage']: Sep 08 10:50:48.581868 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 08 10:50:48.581868 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:50:48.581868 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:50:48.581868 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:50:48.591167 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:50:48.591167 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:50:48.591167 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:50:48.591167 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:50:48.591167 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:50:48.591167 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:50:48.591167 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:50:48.591167 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:50:48.591167 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:50:48.591167 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 10:50:48.591167 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 10:50:48.591167 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 10:50:48.591167 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 10:50:48.591167 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 10:50:48.591167 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 10:50:48.591167 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 08 10:50:48.591167 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:50:48.591167 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:50:48.591167 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:50:48.591167 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:50:48.591167 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:50:48.591167 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:50:48.591167 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 10:50:48.591167 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 10:50:48.591167 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 08 10:50:48.591167 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:50:48.591167 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-636d7cf8-ae7d-422c-888a-f8fa7a71aad2 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:50:48.591167 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-636d7cf8-ae7d-422c-888a-f8fa7a71aad2 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "POST /compute/v2.1/servers/13b25df0-d58e-4da2-bcea-6dac80800bab/action" status: 400 len: 619 microversion: 2.1 time: 0.019133 Sep 08 10:50:48.598719 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1489/2979] 10.222.0.27 () {60 vars in 1279 bytes} [Thu Sep 8 10:50:48 2022] POST /compute/v2.1/servers/13b25df0-d58e-4da2-bcea-6dac80800bab/action => generated 619 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:50:48.600368 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-576430a1-ce26-4f9f-8e72-8dfbd12dce2d tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:48.601238 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-576430a1-ce26-4f9f-8e72-8dfbd12dce2d tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:48.619436 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-576430a1-ce26-4f9f-8e72-8dfbd12dce2d tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:48.620329 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-576430a1-ce26-4f9f-8e72-8dfbd12dce2d tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:48.621326 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-576430a1-ce26-4f9f-8e72-8dfbd12dce2d tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:48.622663 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-576430a1-ce26-4f9f-8e72-8dfbd12dce2d tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:48.624288 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-576430a1-ce26-4f9f-8e72-8dfbd12dce2d tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:48.625117 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-576430a1-ce26-4f9f-8e72-8dfbd12dce2d tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:49.038023 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-576430a1-ce26-4f9f-8e72-8dfbd12dce2d tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:49.062244 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-576430a1-ce26-4f9f-8e72-8dfbd12dce2d tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:49.072376 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-576430a1-ce26-4f9f-8e72-8dfbd12dce2d tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:49.085530 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-576430a1-ce26-4f9f-8e72-8dfbd12dce2d tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 200 len: 1799 microversion: 2.32 time: 0.492092 Sep 08 10:50:49.086824 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1490/2980] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:50:48 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 1799 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:50:49.094544 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-801b4294-0732-443b-b923-939006d238bf tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:49.096467 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-801b4294-0732-443b-b923-939006d238bf tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: 13b25df0-d58e-4da2-bcea-6dac80800bab] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:49.109264 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-801b4294-0732-443b-b923-939006d238bf tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:49.110605 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-801b4294-0732-443b-b923-939006d238bf tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:49.112367 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-801b4294-0732-443b-b923-939006d238bf tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:49.113902 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-801b4294-0732-443b-b923-939006d238bf tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:49.114696 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-801b4294-0732-443b-b923-939006d238bf tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:49.115432 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-801b4294-0732-443b-b923-939006d238bf tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:49.431512 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-801b4294-0732-443b-b923-939006d238bf tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86e8bd6f9048ce8718f432e51128a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c3752f739b47a296a5b88948fe7f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:49.451372 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-801b4294-0732-443b-b923-939006d238bf tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "GET /compute/v2.1/servers/13b25df0-d58e-4da2-bcea-6dac80800bab" status: 200 len: 1521 microversion: 2.1 time: 0.362722 Sep 08 10:50:49.453597 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1491/2981] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:49 2022] GET /compute/v2.1/servers/13b25df0-d58e-4da2-bcea-6dac80800bab => generated 1521 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:49.464428 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-933ff8d8-2f17-4762-b87a-62ed73996855 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:49.465973 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-933ff8d8-2f17-4762-b87a-62ed73996855 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:49.479523 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-933ff8d8-2f17-4762-b87a-62ed73996855 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:49.480764 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-933ff8d8-2f17-4762-b87a-62ed73996855 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:49.481901 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-933ff8d8-2f17-4762-b87a-62ed73996855 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:49.483650 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-933ff8d8-2f17-4762-b87a-62ed73996855 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:49.484865 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-933ff8d8-2f17-4762-b87a-62ed73996855 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:49.486871 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-933ff8d8-2f17-4762-b87a-62ed73996855 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:49.705524 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-933ff8d8-2f17-4762-b87a-62ed73996855 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:49.727052 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-933ff8d8-2f17-4762-b87a-62ed73996855 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:49.728796 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-933ff8d8-2f17-4762-b87a-62ed73996855 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:49.735884 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-933ff8d8-2f17-4762-b87a-62ed73996855 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1539 microversion: 2.91 time: 0.280429 Sep 08 10:50:49.737336 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1492/2982] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:50:49 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1539 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:50:49.742129 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-32864f27-7ecb-4826-a685-56a3cbc9634d req-dfbe8d0f-b003-4bec-aec4-72d5f072af7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f182d52b-9650-44f2-bd28-f2ae1daa1438", "name": "network-vif-plugged", "status": "completed", "tag": "b9069650-6961-445f-8748-e1a4b9f65026"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:50:49.747789 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-bbc12447-febc-4dea-8412-245b5896e80b tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0c66b5a004df886b3d973a978c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc5f459e4a143d1b8bf1c5c64153644', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:49.761178 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bbc12447-febc-4dea-8412-245b5896e80b tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] 10.222.0.27 "GET /compute/v2.1/servers/2c34cf01-2cbf-4cf8-ad8f-d3c8f2c7c66f" status: 200 len: 1318 microversion: 2.1 time: 1.258360 Sep 08 10:50:49.774173 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1491/2983] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:48 2022] GET /compute/v2.1/servers/2c34cf01-2cbf-4cf8-ad8f-d3c8f2c7c66f => generated 1318 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:49.788560 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-353a182a-d974-4ab4-be6e-1d21e3991ee0 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:49.792369 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-353a182a-d974-4ab4-be6e-1d21e3991ee0 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: 13b25df0-d58e-4da2-bcea-6dac80800bab] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:49.793378 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-32864f27-7ecb-4826-a685-56a3cbc9634d req-dfbe8d0f-b003-4bec-aec4-72d5f072af7b service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:49.797573 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-32864f27-7ecb-4826-a685-56a3cbc9634d req-dfbe8d0f-b003-4bec-aec4-72d5f072af7b service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:49.799003 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-32864f27-7ecb-4826-a685-56a3cbc9634d req-dfbe8d0f-b003-4bec-aec4-72d5f072af7b service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:49.808518 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-353a182a-d974-4ab4-be6e-1d21e3991ee0 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:49.809429 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-353a182a-d974-4ab4-be6e-1d21e3991ee0 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:49.815120 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-353a182a-d974-4ab4-be6e-1d21e3991ee0 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:49.816124 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-353a182a-d974-4ab4-be6e-1d21e3991ee0 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:49.816786 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-353a182a-d974-4ab4-be6e-1d21e3991ee0 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:49.817406 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-353a182a-d974-4ab4-be6e-1d21e3991ee0 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:49.823120 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-32864f27-7ecb-4826-a685-56a3cbc9634d req-dfbe8d0f-b003-4bec-aec4-72d5f072af7b service nova] Creating event network-vif-plugged:b9069650-6961-445f-8748-e1a4b9f65026 for instance f182d52b-9650-44f2-bd28-f2ae1daa1438 on n-h1-850501-12 Sep 08 10:50:49.843304 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-32864f27-7ecb-4826-a685-56a3cbc9634d req-dfbe8d0f-b003-4bec-aec4-72d5f072af7b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104527 Sep 08 10:50:49.844722 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1493/2984] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:50:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:50:49.858357 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a46cf6d3-0c89-43b0-a9e4-d5520b2ab2bf tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:49.862371 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a46cf6d3-0c89-43b0-a9e4-d5520b2ab2bf tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: f182d52b-9650-44f2-bd28-f2ae1daa1438] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:49.889229 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a46cf6d3-0c89-43b0-a9e4-d5520b2ab2bf tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:49.896144 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a46cf6d3-0c89-43b0-a9e4-d5520b2ab2bf tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:49.897473 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a46cf6d3-0c89-43b0-a9e4-d5520b2ab2bf tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:49.899500 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a46cf6d3-0c89-43b0-a9e4-d5520b2ab2bf tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:49.906821 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a46cf6d3-0c89-43b0-a9e4-d5520b2ab2bf tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:49.909250 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a46cf6d3-0c89-43b0-a9e4-d5520b2ab2bf tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:50.303836 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a46cf6d3-0c89-43b0-a9e4-d5520b2ab2bf tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c291cbe955b4ee5abc98132dda0255e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f9a24cad014d7f827e8f3236dd5bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:50.319080 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a46cf6d3-0c89-43b0-a9e4-d5520b2ab2bf tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/f182d52b-9650-44f2-bd28-f2ae1daa1438" status: 200 len: 1367 microversion: 2.1 time: 0.471876 Sep 08 10:50:50.344694 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1494/2985] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:49 2022] GET /compute/v2.1/servers/f182d52b-9650-44f2-bd28-f2ae1daa1438 => generated 1367 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:50.351926 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-af842bf7-c723-490e-a448-c414a3147684 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Calling method '.version_select at 0x7f68e4389f70>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:50.428334 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-353a182a-d974-4ab4-be6e-1d21e3991ee0 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86e8bd6f9048ce8718f432e51128a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c3752f739b47a296a5b88948fe7f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:50.458346 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-af842bf7-c723-490e-a448-c414a3147684 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] 10.222.0.27 "GET /compute/v2.1/images/d1109835-85cb-4a9f-996a-3ab19278e978" status: 200 len: 1422 microversion: 2.1 time: 0.113943 Sep 08 10:50:50.458582 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-353a182a-d974-4ab4-be6e-1d21e3991ee0 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "GET /compute/v2.1/servers/13b25df0-d58e-4da2-bcea-6dac80800bab" status: 200 len: 1521 microversion: 2.1 time: 0.680738 Sep 08 10:50:50.459587 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1495/2986] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:50:50 2022] GET /compute/v2.1/images/d1109835-85cb-4a9f-996a-3ab19278e978 => generated 1422 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:50.460734 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1492/2987] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:49 2022] GET /compute/v2.1/servers/13b25df0-d58e-4da2-bcea-6dac80800bab => generated 1521 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:50.465817 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2af52640-7a0d-4973-a713-93cff0e8d1e4 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:50.466672 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2af52640-7a0d-4973-a713-93cff0e8d1e4 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:50.474235 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2af52640-7a0d-4973-a713-93cff0e8d1e4 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:50.474998 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2af52640-7a0d-4973-a713-93cff0e8d1e4 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:50.475611 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2af52640-7a0d-4973-a713-93cff0e8d1e4 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:50.476566 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2af52640-7a0d-4973-a713-93cff0e8d1e4 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:50.477215 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2af52640-7a0d-4973-a713-93cff0e8d1e4 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:50.477829 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2af52640-7a0d-4973-a713-93cff0e8d1e4 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:50.515434 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5619cd49-7da7-4fba-b3ce-df95ce441371 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1373303336"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:50:50.519125 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5619cd49-7da7-4fba-b3ce-df95ce441371 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: 13b25df0-d58e-4da2-bcea-6dac80800bab] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:50.527524 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5619cd49-7da7-4fba-b3ce-df95ce441371 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:50.528023 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5619cd49-7da7-4fba-b3ce-df95ce441371 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:50.531869 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5619cd49-7da7-4fba-b3ce-df95ce441371 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:50.537929 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5619cd49-7da7-4fba-b3ce-df95ce441371 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:50.541647 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5619cd49-7da7-4fba-b3ce-df95ce441371 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:50.543027 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5619cd49-7da7-4fba-b3ce-df95ce441371 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:50.877511 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2af52640-7a0d-4973-a713-93cff0e8d1e4 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:50.893943 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2af52640-7a0d-4973-a713-93cff0e8d1e4 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:50.906440 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2af52640-7a0d-4973-a713-93cff0e8d1e4 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:50.909150 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2af52640-7a0d-4973-a713-93cff0e8d1e4 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 200 len: 1845 microversion: 2.32 time: 0.448160 Sep 08 10:50:50.916748 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1496/2988] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:50:50 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 1845 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:50:50.936361 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6dc814d6-10f5-474b-871f-0fd3602551fd tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:50.936993 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6dc814d6-10f5-474b-871f-0fd3602551fd tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:50.984499 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6dc814d6-10f5-474b-871f-0fd3602551fd tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:50.999111 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6dc814d6-10f5-474b-871f-0fd3602551fd tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:50.999972 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6dc814d6-10f5-474b-871f-0fd3602551fd tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:51.006761 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6dc814d6-10f5-474b-871f-0fd3602551fd tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:51.007722 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6dc814d6-10f5-474b-871f-0fd3602551fd tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:51.008487 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6dc814d6-10f5-474b-871f-0fd3602551fd tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:51.216282 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6dc814d6-10f5-474b-871f-0fd3602551fd tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:51.231660 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6dc814d6-10f5-474b-871f-0fd3602551fd tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:51.233411 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6dc814d6-10f5-474b-871f-0fd3602551fd tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:51.247506 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6dc814d6-10f5-474b-871f-0fd3602551fd tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1539 microversion: 2.91 time: 0.329024 Sep 08 10:50:51.248089 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1497/2989] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:50:50 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1539 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:50:51.261217 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-eba674db-e37c-417f-bd6a-1ba353026966 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:51.261844 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-eba674db-e37c-417f-bd6a-1ba353026966 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] [instance: 2c34cf01-2cbf-4cf8-ad8f-d3c8f2c7c66f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:51.281476 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eba674db-e37c-417f-bd6a-1ba353026966 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:51.282016 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eba674db-e37c-417f-bd6a-1ba353026966 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:51.282465 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eba674db-e37c-417f-bd6a-1ba353026966 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:51.286091 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eba674db-e37c-417f-bd6a-1ba353026966 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:51.288084 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eba674db-e37c-417f-bd6a-1ba353026966 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:51.288554 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eba674db-e37c-417f-bd6a-1ba353026966 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:51.583222 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-eba674db-e37c-417f-bd6a-1ba353026966 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0c66b5a004df886b3d973a978c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc5f459e4a143d1b8bf1c5c64153644', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:51.605801 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-eba674db-e37c-417f-bd6a-1ba353026966 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] 10.222.0.27 "GET /compute/v2.1/servers/2c34cf01-2cbf-4cf8-ad8f-d3c8f2c7c66f" status: 200 len: 1318 microversion: 2.1 time: 0.356522 Sep 08 10:50:51.647200 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1498/2990] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:51 2022] GET /compute/v2.1/servers/2c34cf01-2cbf-4cf8-ad8f-d3c8f2c7c66f => generated 1318 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:51.653173 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a120b740-4dc2-420b-a257-197375de535c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:51.654084 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a120b740-4dc2-420b-a257-197375de535c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: f182d52b-9650-44f2-bd28-f2ae1daa1438] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:51.675656 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a120b740-4dc2-420b-a257-197375de535c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:51.677734 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a120b740-4dc2-420b-a257-197375de535c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:51.681304 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a120b740-4dc2-420b-a257-197375de535c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:51.682331 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a120b740-4dc2-420b-a257-197375de535c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:51.682975 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a120b740-4dc2-420b-a257-197375de535c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:51.683579 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a120b740-4dc2-420b-a257-197375de535c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:51.837790 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5619cd49-7da7-4fba-b3ce-df95ce441371 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "POST /compute/v2.1/servers/13b25df0-d58e-4da2-bcea-6dac80800bab/action" status: 202 len: 0 microversion: 2.1 time: 1.335123 Sep 08 10:50:51.839912 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1493/2991] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:50:50 2022] POST /compute/v2.1/servers/13b25df0-d58e-4da2-bcea-6dac80800bab/action => generated 0 bytes in 1339 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 08 10:50:51.882311 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f1845138-6076-4143-835b-8451519aad84 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Calling method '.version_select at 0x7f68e40cb940>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:52.027493 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f1845138-6076-4143-835b-8451519aad84 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] 10.222.0.27 "GET /compute/v2.1/images/d1109835-85cb-4a9f-996a-3ab19278e978" status: 200 len: 1422 microversion: 2.1 time: 0.185228 Sep 08 10:50:52.034831 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1494/2992] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:50:51 2022] GET /compute/v2.1/images/d1109835-85cb-4a9f-996a-3ab19278e978 => generated 1422 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:52.044862 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-403761e2-73e6-47e7-87dc-3c90ed6a3029 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-423528530"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:50:52.052768 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-403761e2-73e6-47e7-87dc-3c90ed6a3029 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: 13b25df0-d58e-4da2-bcea-6dac80800bab] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:52.078304 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-403761e2-73e6-47e7-87dc-3c90ed6a3029 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:52.082491 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-403761e2-73e6-47e7-87dc-3c90ed6a3029 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:52.083217 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-403761e2-73e6-47e7-87dc-3c90ed6a3029 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:52.084470 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-403761e2-73e6-47e7-87dc-3c90ed6a3029 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:52.089959 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-403761e2-73e6-47e7-87dc-3c90ed6a3029 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:52.091247 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-403761e2-73e6-47e7-87dc-3c90ed6a3029 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:52.231446 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-403761e2-73e6-47e7-87dc-3c90ed6a3029 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] HTTP exception thrown: Cannot 'createImage' instance 13b25df0-d58e-4da2-bcea-6dac80800bab while it is in task_state image_snapshot Sep 08 10:50:52.240722 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-403761e2-73e6-47e7-87dc-3c90ed6a3029 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Request method failure captured: Sep 08 10:50:52.240722 n-d-850501-12 devstack@n-api.service[128861]: request: POST /compute/v2.1/servers/13b25df0-d58e-4da2-bcea-6dac80800bab/action HTTP/1.1 Sep 08 10:50:52.240722 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:50:52.240722 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:50:52.240722 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:50:52.240722 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 84 Sep 08 10:50:52.240722 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:50:52.240722 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:50:52.240722 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:50:52.240722 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:50:52.240722 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcjivLUY-NOpubj4piWQUE4YdjVoieEQ-G0L0ay9l2jNqBIueJ_eB4w8-Iohm-hEbdImfT6Vv0CotgGIogaerBRfcTAAw-NhjLbx2EjcqsYLMFxCPLjOPfzXaEWWRNcumoyYDLdNDrrGczsG7GBIlwK26oqS5wWNAPkM7DBSBKGgOFQ Sep 08 10:50:52.240722 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:50:52.240722 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:50:52.240722 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:50:52.240722 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:50:52.240722 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:50:52.240722 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:50:52.240722 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 50c3752f739b47a296a5b88948fe7f7f Sep 08 10:50:52.240722 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1836029851 Sep 08 10:50:52.240722 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:50:52.240722 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:50:52.240722 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/50c3752f739b47a296a5b88948fe7f7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/50c3752f739b47a296a5b88948fe7f7f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_50c3752f739b47a296a5b88948fe7f7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/50c3752f739b47a296a5b88948fe7f7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:50:52.240722 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1836029851 Sep 08 10:50:52.240722 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 50c3752f739b47a296a5b88948fe7f7f Sep 08 10:50:52.240722 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1836029851 Sep 08 10:50:52.240722 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ImagesOneServerNegativeTestJSON-1836029851-project Sep 08 10:50:52.240722 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:50:52.240722 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:50:52.240722 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 7c86e8bd6f9048ce8718f432e51128a5 Sep 08 10:50:52.240722 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1836029851-project Sep 08 10:50:52.240722 n-d-850501-12 devstack@n-api.service[128861]: Sep 08 10:50:52.240722 n-d-850501-12 devstack@n-api.service[128861]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-423528530"}} Sep 08 10:50:52.240722 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:50:52.240722 n-d-850501-12 devstack@n-api.service[128861]: exception: Cannot 'createImage' instance 13b25df0-d58e-4da2-bcea-6dac80800bab while it is in task_state image_snapshot Sep 08 10:50:52.240722 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '13b25df0-d58e-4da2-bcea-6dac80800bab', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-423528530'}}} Sep 08 10:50:52.240722 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:50:52.240722 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:50:52.240722 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Sep 08 10:50:52.240722 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Sep 08 10:50:52.240722 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Sep 08 10:50:52.240722 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 08 10:50:52.240722 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 13b25df0-d58e-4da2-bcea-6dac80800bab in task_state image_snapshot. Cannot snapshot while the instance is in this state. Sep 08 10:50:52.240722 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:50:52.240722 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:50:52.240722 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:50:52.240722 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:50:52.240722 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:50:52.240722 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:50:52.240722 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:50:52.240722 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:50:52.240722 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:50:52.240722 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:50:52.240722 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:50:52.240722 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:50:52.240722 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:50:52.240722 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:50:52.240722 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Sep 08 10:50:52.240722 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 08 10:50:52.240722 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 08 10:50:52.240722 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 08 10:50:52.240722 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 13b25df0-d58e-4da2-bcea-6dac80800bab while it is in task_state image_snapshot Sep 08 10:50:52.248948 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:50:52.248948 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:50:52.248948 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:50:52.248948 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:50:52.248948 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:50:52.248948 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:50:52.248948 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:50:52.248948 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:50:52.248948 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 13b25df0-d58e-4da2-bcea-6dac80800bab while it is in task_state image_snapshot Sep 08 10:50:52.248948 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:50:52.257757 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-403761e2-73e6-47e7-87dc-3c90ed6a3029 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Returning 409 to user: Cannot 'createImage' instance 13b25df0-d58e-4da2-bcea-6dac80800bab while it is in task_state image_snapshot {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:50:52.261486 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-403761e2-73e6-47e7-87dc-3c90ed6a3029 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "POST /compute/v2.1/servers/13b25df0-d58e-4da2-bcea-6dac80800bab/action" status: 409 len: 159 microversion: 2.1 time: 0.223318 Sep 08 10:50:52.265348 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1495/2993] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:50:52 2022] POST /compute/v2.1/servers/13b25df0-d58e-4da2-bcea-6dac80800bab/action => generated 159 bytes in 229 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:50:52.285677 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d65ead63-2043-4704-95d3-976780ec8169 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:52.291912 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a120b740-4dc2-420b-a257-197375de535c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c291cbe955b4ee5abc98132dda0255e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f9a24cad014d7f827e8f3236dd5bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:52.294735 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d65ead63-2043-4704-95d3-976780ec8169 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:52.317658 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d65ead63-2043-4704-95d3-976780ec8169 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:52.318623 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d65ead63-2043-4704-95d3-976780ec8169 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:52.320310 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d65ead63-2043-4704-95d3-976780ec8169 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:52.328861 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a120b740-4dc2-420b-a257-197375de535c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/f182d52b-9650-44f2-bd28-f2ae1daa1438" status: 200 len: 1367 microversion: 2.1 time: 0.672035 Sep 08 10:50:52.330200 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d65ead63-2043-4704-95d3-976780ec8169 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:52.332203 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1499/2994] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:51 2022] GET /compute/v2.1/servers/f182d52b-9650-44f2-bd28-f2ae1daa1438 => generated 1367 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:52.333758 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d65ead63-2043-4704-95d3-976780ec8169 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:52.335257 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d65ead63-2043-4704-95d3-976780ec8169 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:52.356129 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-9a5c1220-0b23-4dd7-8b55-6b4a00f2a3b3 req-10a3d769-7e25-4106-ba6f-2cd90c371c10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c34cf01-2cbf-4cf8-ad8f-d3c8f2c7c66f", "name": "network-vif-plugged", "status": "completed", "tag": "1c319e61-bdae-43af-9d9c-cedf56fc05d4"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:50:52.402068 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-9a5c1220-0b23-4dd7-8b55-6b4a00f2a3b3 req-10a3d769-7e25-4106-ba6f-2cd90c371c10 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:52.402574 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-9a5c1220-0b23-4dd7-8b55-6b4a00f2a3b3 req-10a3d769-7e25-4106-ba6f-2cd90c371c10 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:52.408256 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-9a5c1220-0b23-4dd7-8b55-6b4a00f2a3b3 req-10a3d769-7e25-4106-ba6f-2cd90c371c10 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:52.478963 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-9a5c1220-0b23-4dd7-8b55-6b4a00f2a3b3 req-10a3d769-7e25-4106-ba6f-2cd90c371c10 service nova] Creating event network-vif-plugged:1c319e61-bdae-43af-9d9c-cedf56fc05d4 for instance 2c34cf01-2cbf-4cf8-ad8f-d3c8f2c7c66f on n-h1-850501-12 Sep 08 10:50:52.499724 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-9a5c1220-0b23-4dd7-8b55-6b4a00f2a3b3 req-10a3d769-7e25-4106-ba6f-2cd90c371c10 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166008 Sep 08 10:50:52.506339 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1500/2995] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:50:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:50:52.522913 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1f0289d1-45db-4458-bb11-37cd53442e01 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Calling method '.version_select at 0x7f68e8a611f0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:52.993095 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1f0289d1-45db-4458-bb11-37cd53442e01 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "DELETE /compute/v2.1/images/9cb0d711-236c-40a1-bec2-41269d0365c2" status: 204 len: 0 microversion: 2.1 time: 0.484651 Sep 08 10:50:52.994052 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1501/2996] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:52 2022] DELETE /compute/v2.1/images/9cb0d711-236c-40a1-bec2-41269d0365c2 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:50:52.999589 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-103d8ae2-9adf-4e22-bbd9-85cf7b9c9c32 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:53.001080 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-103d8ae2-9adf-4e22-bbd9-85cf7b9c9c32 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:53.021241 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-103d8ae2-9adf-4e22-bbd9-85cf7b9c9c32 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:53.022143 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-103d8ae2-9adf-4e22-bbd9-85cf7b9c9c32 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:53.022784 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-103d8ae2-9adf-4e22-bbd9-85cf7b9c9c32 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:53.024645 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-103d8ae2-9adf-4e22-bbd9-85cf7b9c9c32 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:53.025407 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-103d8ae2-9adf-4e22-bbd9-85cf7b9c9c32 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:53.026048 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-103d8ae2-9adf-4e22-bbd9-85cf7b9c9c32 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:53.228713 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-103d8ae2-9adf-4e22-bbd9-85cf7b9c9c32 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:53.257371 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-103d8ae2-9adf-4e22-bbd9-85cf7b9c9c32 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:53.263197 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-103d8ae2-9adf-4e22-bbd9-85cf7b9c9c32 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:53.279269 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-103d8ae2-9adf-4e22-bbd9-85cf7b9c9c32 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1539 microversion: 2.91 time: 0.283764 Sep 08 10:50:53.295523 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1502/2997] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:50:52 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1539 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:50:53.295523 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f53b0102-3fdc-4ce9-97ad-bbdba8d5d9a1 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:53.295523 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f53b0102-3fdc-4ce9-97ad-bbdba8d5d9a1 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] [instance: 2c34cf01-2cbf-4cf8-ad8f-d3c8f2c7c66f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:53.295523 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f53b0102-3fdc-4ce9-97ad-bbdba8d5d9a1 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:53.295523 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f53b0102-3fdc-4ce9-97ad-bbdba8d5d9a1 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:53.295523 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f53b0102-3fdc-4ce9-97ad-bbdba8d5d9a1 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:53.295523 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f53b0102-3fdc-4ce9-97ad-bbdba8d5d9a1 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:53.297425 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f53b0102-3fdc-4ce9-97ad-bbdba8d5d9a1 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:53.299046 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f53b0102-3fdc-4ce9-97ad-bbdba8d5d9a1 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:53.348342 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d65ead63-2043-4704-95d3-976780ec8169 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:53.385567 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d65ead63-2043-4704-95d3-976780ec8169 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:53.390879 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d65ead63-2043-4704-95d3-976780ec8169 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:53.393677 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d65ead63-2043-4704-95d3-976780ec8169 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 200 len: 1845 microversion: 2.32 time: 1.126265 Sep 08 10:50:53.430273 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1496/2998] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:50:52 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 1845 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:50:53.535281 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f53b0102-3fdc-4ce9-97ad-bbdba8d5d9a1 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0c66b5a004df886b3d973a978c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc5f459e4a143d1b8bf1c5c64153644', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:53.546089 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f53b0102-3fdc-4ce9-97ad-bbdba8d5d9a1 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] 10.222.0.27 "GET /compute/v2.1/servers/2c34cf01-2cbf-4cf8-ad8f-d3c8f2c7c66f" status: 200 len: 1318 microversion: 2.1 time: 0.264043 Sep 08 10:50:53.558733 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1503/2999] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:53 2022] GET /compute/v2.1/servers/2c34cf01-2cbf-4cf8-ad8f-d3c8f2c7c66f => generated 1318 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:53.564845 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c21f1b1a-f7c3-47a7-b69c-db65d7469352 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:53.565750 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c21f1b1a-f7c3-47a7-b69c-db65d7469352 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: 13b25df0-d58e-4da2-bcea-6dac80800bab] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:53.582981 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c21f1b1a-f7c3-47a7-b69c-db65d7469352 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:53.583672 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c21f1b1a-f7c3-47a7-b69c-db65d7469352 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:53.584278 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c21f1b1a-f7c3-47a7-b69c-db65d7469352 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:53.585509 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c21f1b1a-f7c3-47a7-b69c-db65d7469352 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:53.586138 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c21f1b1a-f7c3-47a7-b69c-db65d7469352 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:53.586744 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c21f1b1a-f7c3-47a7-b69c-db65d7469352 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:53.698493 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c3c13335-c944-4575-8078-9ef70e56b81f tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-708161027", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "97b30e76-5fb4-47e1-99cf-7aa871a784d9"}]}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:50:53.866131 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-c3c13335-c944-4575-8078-9ef70e56b81f tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] validate_networks() for [('97b30e76-5fb4-47e1-99cf-7aa871a784d9', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:50:53.931403 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c21f1b1a-f7c3-47a7-b69c-db65d7469352 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86e8bd6f9048ce8718f432e51128a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c3752f739b47a296a5b88948fe7f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:53.948943 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:50:53.957009 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c21f1b1a-f7c3-47a7-b69c-db65d7469352 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "GET /compute/v2.1/servers/13b25df0-d58e-4da2-bcea-6dac80800bab" status: 200 len: 1533 microversion: 2.1 time: 0.406387 Sep 08 10:50:53.957895 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1504/3000] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:53 2022] GET /compute/v2.1/servers/13b25df0-d58e-4da2-bcea-6dac80800bab => generated 1533 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:53.968718 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f3a19e9f-245c-46e5-8131-3675c6979fa2 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Calling method '.version_select at 0x7f68e8a925e0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:54.052282 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f3a19e9f-245c-46e5-8131-3675c6979fa2 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] 10.222.0.27 "GET /compute/v2.1/images/d1109835-85cb-4a9f-996a-3ab19278e978" status: 200 len: 1422 microversion: 2.1 time: 0.093470 Sep 08 10:50:54.052879 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1505/3001] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:50:53 2022] GET /compute/v2.1/images/d1109835-85cb-4a9f-996a-3ab19278e978 => generated 1422 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:54.075378 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-53730913-4a2e-4192-b071-079b5b3b5706 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:54.076003 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-53730913-4a2e-4192-b071-079b5b3b5706 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: f182d52b-9650-44f2-bd28-f2ae1daa1438] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:54.098640 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53730913-4a2e-4192-b071-079b5b3b5706 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:54.099146 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53730913-4a2e-4192-b071-079b5b3b5706 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:54.099586 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53730913-4a2e-4192-b071-079b5b3b5706 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:54.100314 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53730913-4a2e-4192-b071-079b5b3b5706 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:54.100772 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53730913-4a2e-4192-b071-079b5b3b5706 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:54.101251 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53730913-4a2e-4192-b071-079b5b3b5706 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:54.405974 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-53730913-4a2e-4192-b071-079b5b3b5706 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c291cbe955b4ee5abc98132dda0255e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f9a24cad014d7f827e8f3236dd5bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:54.422673 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-53730913-4a2e-4192-b071-079b5b3b5706 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/f182d52b-9650-44f2-bd28-f2ae1daa1438" status: 200 len: 1558 microversion: 2.1 time: 0.358149 Sep 08 10:50:54.439563 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1506/3002] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:54 2022] GET /compute/v2.1/servers/f182d52b-9650-44f2-bd28-f2ae1daa1438 => generated 1558 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:54.453109 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3e3d38f0-fd7c-467b-b621-721ab0de6c97 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:54.453109 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3e3d38f0-fd7c-467b-b621-721ab0de6c97 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:54.466858 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e3d38f0-fd7c-467b-b621-721ab0de6c97 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:54.468034 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e3d38f0-fd7c-467b-b621-721ab0de6c97 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:54.470928 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e3d38f0-fd7c-467b-b621-721ab0de6c97 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:54.472368 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e3d38f0-fd7c-467b-b621-721ab0de6c97 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:54.477403 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e3d38f0-fd7c-467b-b621-721ab0de6c97 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:54.478023 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e3d38f0-fd7c-467b-b621-721ab0de6c97 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:54.709131 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3e3d38f0-fd7c-467b-b621-721ab0de6c97 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:54.728525 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3e3d38f0-fd7c-467b-b621-721ab0de6c97 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:54.730610 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3e3d38f0-fd7c-467b-b621-721ab0de6c97 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:54.744746 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3e3d38f0-fd7c-467b-b621-721ab0de6c97 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1539 microversion: 2.91 time: 0.312185 Sep 08 10:50:54.761131 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1507/3003] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:50:54 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1539 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:50:54.772755 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-042313a9-7b66-4764-bb5a-ecb11e00d5b6 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:54.772755 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-042313a9-7b66-4764-bb5a-ecb11e00d5b6 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:54.783333 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-042313a9-7b66-4764-bb5a-ecb11e00d5b6 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:54.785852 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-042313a9-7b66-4764-bb5a-ecb11e00d5b6 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:54.788595 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-042313a9-7b66-4764-bb5a-ecb11e00d5b6 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:54.789768 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-042313a9-7b66-4764-bb5a-ecb11e00d5b6 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:54.794009 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-042313a9-7b66-4764-bb5a-ecb11e00d5b6 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:54.794831 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-042313a9-7b66-4764-bb5a-ecb11e00d5b6 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:55.389828 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-042313a9-7b66-4764-bb5a-ecb11e00d5b6 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:55.414676 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-042313a9-7b66-4764-bb5a-ecb11e00d5b6 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:55.416172 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-042313a9-7b66-4764-bb5a-ecb11e00d5b6 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:55.419169 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-042313a9-7b66-4764-bb5a-ecb11e00d5b6 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 200 len: 1845 microversion: 2.32 time: 0.666826 Sep 08 10:50:55.419768 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1508/3004] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:50:54 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 1845 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:50:55.438149 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c7009a39-ed30-4453-a313-b79ba1af20b8 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:55.439871 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c7009a39-ed30-4453-a313-b79ba1af20b8 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: f182d52b-9650-44f2-bd28-f2ae1daa1438] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:55.462850 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c7009a39-ed30-4453-a313-b79ba1af20b8 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:55.463699 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c7009a39-ed30-4453-a313-b79ba1af20b8 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:55.464156 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c7009a39-ed30-4453-a313-b79ba1af20b8 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:55.464896 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c7009a39-ed30-4453-a313-b79ba1af20b8 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:55.466543 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c7009a39-ed30-4453-a313-b79ba1af20b8 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:55.467013 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c7009a39-ed30-4453-a313-b79ba1af20b8 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:55.761675 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c7009a39-ed30-4453-a313-b79ba1af20b8 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/f182d52b-9650-44f2-bd28-f2ae1daa1438/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.340456 Sep 08 10:50:55.762633 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1509/3005] 10.222.0.27 () {58 vars in 1275 bytes} [Thu Sep 8 10:50:55 2022] GET /compute/v2.1/servers/f182d52b-9650-44f2-bd28-f2ae1daa1438/os-interface => generated 285 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:50:55.769049 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-548d1d0d-8110-4786-9006-3ce11a493f4d tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:55.776216 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-548d1d0d-8110-4786-9006-3ce11a493f4d tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] [instance: 2c34cf01-2cbf-4cf8-ad8f-d3c8f2c7c66f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:55.809443 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-548d1d0d-8110-4786-9006-3ce11a493f4d tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:55.809951 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-548d1d0d-8110-4786-9006-3ce11a493f4d tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:55.810392 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-548d1d0d-8110-4786-9006-3ce11a493f4d tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:55.811116 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-548d1d0d-8110-4786-9006-3ce11a493f4d tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:55.820782 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-548d1d0d-8110-4786-9006-3ce11a493f4d tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:55.821267 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-548d1d0d-8110-4786-9006-3ce11a493f4d tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:55.841549 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-c3c13335-c944-4575-8078-9ef70e56b81f tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:50:55.842988 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-c3c13335-c944-4575-8078-9ef70e56b81f tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:50:55.843832 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-c3c13335-c944-4575-8078-9ef70e56b81f tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:50:55.844860 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-c3c13335-c944-4575-8078-9ef70e56b81f tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:50:55.848159 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-c3c13335-c944-4575-8078-9ef70e56b81f tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:50:55.916931 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c3c13335-c944-4575-8078-9ef70e56b81f tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:55.918299 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c3c13335-c944-4575-8078-9ef70e56b81f tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:55.931337 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c3c13335-c944-4575-8078-9ef70e56b81f tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:55.942895 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c3c13335-c944-4575-8078-9ef70e56b81f tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:55.943503 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c3c13335-c944-4575-8078-9ef70e56b81f tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:55.944158 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c3c13335-c944-4575-8078-9ef70e56b81f tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:56.085165 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-c3c13335-c944-4575-8078-9ef70e56b81f tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Getting quotas for project 181f4b3ff01740feb60d5b50056874cf. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:50:56.138578 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-c3c13335-c944-4575-8078-9ef70e56b81f tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Getting quotas for user f5947a1de1e44d87a601b5b5c8c2f1a9 and project 181f4b3ff01740feb60d5b50056874cf. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:50:56.205812 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c3c13335-c944-4575-8078-9ef70e56b81f tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:50:56.215433 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c3c13335-c944-4575-8078-9ef70e56b81f tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] [instance: e2f8b261-f29f-494e-a4f0-b37d8618f625] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:50:56.342356 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c3c13335-c944-4575-8078-9ef70e56b81f tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 2.909941 Sep 08 10:50:56.343400 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1497/3006] 10.222.0.27 () {62 vars in 1188 bytes} [Thu Sep 8 10:50:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 2912 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 08 10:50:56.348859 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-55c8be87-d077-42fd-8239-d4d811497df8 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:56.349803 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-55c8be87-d077-42fd-8239-d4d811497df8 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: 13b25df0-d58e-4da2-bcea-6dac80800bab] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:56.362991 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-55c8be87-d077-42fd-8239-d4d811497df8 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:56.365584 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-55c8be87-d077-42fd-8239-d4d811497df8 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:56.366763 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-55c8be87-d077-42fd-8239-d4d811497df8 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:56.368710 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-55c8be87-d077-42fd-8239-d4d811497df8 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:56.370336 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-55c8be87-d077-42fd-8239-d4d811497df8 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:56.371507 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-55c8be87-d077-42fd-8239-d4d811497df8 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:57.033467 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-55c8be87-d077-42fd-8239-d4d811497df8 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86e8bd6f9048ce8718f432e51128a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c3752f739b47a296a5b88948fe7f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:57.066319 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-55c8be87-d077-42fd-8239-d4d811497df8 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "GET /compute/v2.1/servers/13b25df0-d58e-4da2-bcea-6dac80800bab" status: 200 len: 1539 microversion: 2.1 time: 0.721579 Sep 08 10:50:57.082972 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1498/3007] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:56 2022] GET /compute/v2.1/servers/13b25df0-d58e-4da2-bcea-6dac80800bab => generated 1539 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:57.110322 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-767fee02-3563-43f4-8e59-2df00e8a494e tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Calling method '.version_select at 0x7f68e4605e50>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:57.303945 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-767fee02-3563-43f4-8e59-2df00e8a494e tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] 10.222.0.27 "GET /compute/v2.1/images/d1109835-85cb-4a9f-996a-3ab19278e978" status: 200 len: 1422 microversion: 2.1 time: 0.210015 Sep 08 10:50:57.312180 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1499/3008] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:50:57 2022] GET /compute/v2.1/images/d1109835-85cb-4a9f-996a-3ab19278e978 => generated 1422 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:57.335050 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a9e595d9-a029-4a1e-8048-2a8adcd8ff09 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:57.336286 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a9e595d9-a029-4a1e-8048-2a8adcd8ff09 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:57.395856 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a9e595d9-a029-4a1e-8048-2a8adcd8ff09 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:57.413067 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a9e595d9-a029-4a1e-8048-2a8adcd8ff09 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:57.415066 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a9e595d9-a029-4a1e-8048-2a8adcd8ff09 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:57.415066 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a9e595d9-a029-4a1e-8048-2a8adcd8ff09 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:57.415066 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a9e595d9-a029-4a1e-8048-2a8adcd8ff09 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:57.415577 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a9e595d9-a029-4a1e-8048-2a8adcd8ff09 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:57.796656 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a9e595d9-a029-4a1e-8048-2a8adcd8ff09 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:57.854006 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a9e595d9-a029-4a1e-8048-2a8adcd8ff09 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:57.860250 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a9e595d9-a029-4a1e-8048-2a8adcd8ff09 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:57.887378 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a9e595d9-a029-4a1e-8048-2a8adcd8ff09 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1539 microversion: 2.91 time: 0.568413 Sep 08 10:50:57.889504 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1500/3009] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:50:57 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1539 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:50:57.898210 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-dadbb14e-4113-416f-bfd2-ed878d8daeb0 req-bcccf8e2-4f71-4119-b8bb-adc862253110 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98277784-8e48-4a7b-8786-ce579e1d5ccf", "tag": "742e7fd9-9529-4661-8ad0-c2f50b7bb9d8"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:50:57.955939 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-dadbb14e-4113-416f-bfd2-ed878d8daeb0 req-bcccf8e2-4f71-4119-b8bb-adc862253110 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:57.963678 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-dadbb14e-4113-416f-bfd2-ed878d8daeb0 req-bcccf8e2-4f71-4119-b8bb-adc862253110 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:57.965017 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-dadbb14e-4113-416f-bfd2-ed878d8daeb0 req-bcccf8e2-4f71-4119-b8bb-adc862253110 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:58.005447 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-548d1d0d-8110-4786-9006-3ce11a493f4d tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0c66b5a004df886b3d973a978c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc5f459e4a143d1b8bf1c5c64153644', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:58.028632 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-dadbb14e-4113-416f-bfd2-ed878d8daeb0 req-bcccf8e2-4f71-4119-b8bb-adc862253110 service nova] Creating event network-changed:742e7fd9-9529-4661-8ad0-c2f50b7bb9d8 for instance 98277784-8e48-4a7b-8786-ce579e1d5ccf on n-h2-850501-12 Sep 08 10:50:58.039555 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-548d1d0d-8110-4786-9006-3ce11a493f4d tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] 10.222.0.27 "GET /compute/v2.1/servers/2c34cf01-2cbf-4cf8-ad8f-d3c8f2c7c66f" status: 200 len: 1505 microversion: 2.1 time: 2.274921 Sep 08 10:50:58.043507 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1510/3010] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:55 2022] GET /compute/v2.1/servers/2c34cf01-2cbf-4cf8-ad8f-d3c8f2c7c66f => generated 1505 bytes in 2280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:58.073918 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c10800df-84c1-43ac-9763-8ed360e58c65 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:58.074550 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c10800df-84c1-43ac-9763-8ed360e58c65 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] [instance: e2f8b261-f29f-494e-a4f0-b37d8618f625] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:58.077712 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-dadbb14e-4113-416f-bfd2-ed878d8daeb0 req-bcccf8e2-4f71-4119-b8bb-adc862253110 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.170492 Sep 08 10:50:58.087594 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1501/3011] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:50:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:50:58.134490 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f6ef6a22-0fc5-4812-b2f5-6218b589d60e tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:58.139590 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f6ef6a22-0fc5-4812-b2f5-6218b589d60e tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:58.163296 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f6ef6a22-0fc5-4812-b2f5-6218b589d60e tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:58.168326 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f6ef6a22-0fc5-4812-b2f5-6218b589d60e tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:58.169696 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f6ef6a22-0fc5-4812-b2f5-6218b589d60e tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:58.174062 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f6ef6a22-0fc5-4812-b2f5-6218b589d60e tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:58.175415 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f6ef6a22-0fc5-4812-b2f5-6218b589d60e tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:58.179245 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f6ef6a22-0fc5-4812-b2f5-6218b589d60e tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:58.879984 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c10800df-84c1-43ac-9763-8ed360e58c65 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5947a1de1e44d87a601b5b5c8c2f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181f4b3ff01740feb60d5b50056874cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:58.924912 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c10800df-84c1-43ac-9763-8ed360e58c65 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5947a1de1e44d87a601b5b5c8c2f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181f4b3ff01740feb60d5b50056874cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:58.934702 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c10800df-84c1-43ac-9763-8ed360e58c65 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5947a1de1e44d87a601b5b5c8c2f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181f4b3ff01740feb60d5b50056874cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:58.942169 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c10800df-84c1-43ac-9763-8ed360e58c65 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] 10.222.0.27 "GET /compute/v2.1/servers/e2f8b261-f29f-494e-a4f0-b37d8618f625" status: 200 len: 1258 microversion: 2.21 time: 0.891649 Sep 08 10:50:58.952586 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1511/3012] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:50:58 2022] GET /compute/v2.1/servers/e2f8b261-f29f-494e-a4f0-b37d8618f625 => generated 1258 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:50:58.972791 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-1ce2430b-8aa4-44c1-a5cc-2158af4a1c0b req-931c965b-9361-4007-a4e5-e17f2dc7b0b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13b25df0-d58e-4da2-bcea-6dac80800bab", "name": "network-vif-plugged", "status": "completed", "tag": "4c8c0aef-65f1-4dab-aac2-76c85fdead87"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:50:59.006378 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:50:59.039261 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-1ce2430b-8aa4-44c1-a5cc-2158af4a1c0b req-931c965b-9361-4007-a4e5-e17f2dc7b0b8 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:59.040118 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-1ce2430b-8aa4-44c1-a5cc-2158af4a1c0b req-931c965b-9361-4007-a4e5-e17f2dc7b0b8 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:59.046208 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-1ce2430b-8aa4-44c1-a5cc-2158af4a1c0b req-931c965b-9361-4007-a4e5-e17f2dc7b0b8 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:59.094416 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-1ce2430b-8aa4-44c1-a5cc-2158af4a1c0b req-931c965b-9361-4007-a4e5-e17f2dc7b0b8 service nova] Creating event network-vif-plugged:4c8c0aef-65f1-4dab-aac2-76c85fdead87 for instance 13b25df0-d58e-4da2-bcea-6dac80800bab on n-h2-850501-12 Sep 08 10:50:59.109781 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f6ef6a22-0fc5-4812-b2f5-6218b589d60e tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:59.150671 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-1ce2430b-8aa4-44c1-a5cc-2158af4a1c0b req-931c965b-9361-4007-a4e5-e17f2dc7b0b8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.195311 Sep 08 10:50:59.151709 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1512/3013] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:50:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:50:59.173825 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f6ef6a22-0fc5-4812-b2f5-6218b589d60e tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:59.209068 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f6ef6a22-0fc5-4812-b2f5-6218b589d60e tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:59.214964 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f6ef6a22-0fc5-4812-b2f5-6218b589d60e tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 200 len: 1845 microversion: 2.32 time: 1.113175 Sep 08 10:50:59.217163 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-466912b2-437a-4296-aefa-c1f8eba20d9c tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:59.218600 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-466912b2-437a-4296-aefa-c1f8eba20d9c tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] [instance: a4e3b624-1ff1-4ee3-a6e1-d5da50a26d3f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:59.250715 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-466912b2-437a-4296-aefa-c1f8eba20d9c tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:59.252612 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-466912b2-437a-4296-aefa-c1f8eba20d9c tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:59.253827 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-466912b2-437a-4296-aefa-c1f8eba20d9c tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:59.255400 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-466912b2-437a-4296-aefa-c1f8eba20d9c tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:59.256479 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-466912b2-437a-4296-aefa-c1f8eba20d9c tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:59.257591 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-466912b2-437a-4296-aefa-c1f8eba20d9c tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:59.260031 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1502/3014] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:50:58 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 1845 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:50:59.287409 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f489ee25-6a58-483e-a085-d7cf3f5605f6 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:59.302623 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f489ee25-6a58-483e-a085-d7cf3f5605f6 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: 13b25df0-d58e-4da2-bcea-6dac80800bab] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:59.330123 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f489ee25-6a58-483e-a085-d7cf3f5605f6 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:59.331361 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f489ee25-6a58-483e-a085-d7cf3f5605f6 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:59.334504 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f489ee25-6a58-483e-a085-d7cf3f5605f6 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:59.341072 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f489ee25-6a58-483e-a085-d7cf3f5605f6 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:59.342928 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f489ee25-6a58-483e-a085-d7cf3f5605f6 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:59.343944 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f489ee25-6a58-483e-a085-d7cf3f5605f6 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:00.200277 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-466912b2-437a-4296-aefa-c1f8eba20d9c tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0c66b5a004df886b3d973a978c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc5f459e4a143d1b8bf1c5c64153644', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:00.218040 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-466912b2-437a-4296-aefa-c1f8eba20d9c tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] 10.222.0.27 "GET /compute/v2.1/servers/a4e3b624-1ff1-4ee3-a6e1-d5da50a26d3f" status: 200 len: 1505 microversion: 2.1 time: 1.049822 Sep 08 10:51:00.260463 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1513/3015] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:59 2022] GET /compute/v2.1/servers/a4e3b624-1ff1-4ee3-a6e1-d5da50a26d3f => generated 1505 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:00.274183 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-56005a44-b1c7-434e-8096-2e16cd0d6ebb tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Calling method '.version_select at 0x7f68e4241040>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:00.317137 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f489ee25-6a58-483e-a085-d7cf3f5605f6 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86e8bd6f9048ce8718f432e51128a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c3752f739b47a296a5b88948fe7f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:00.351002 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f489ee25-6a58-483e-a085-d7cf3f5605f6 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "GET /compute/v2.1/servers/13b25df0-d58e-4da2-bcea-6dac80800bab" status: 200 len: 1521 microversion: 2.1 time: 1.088794 Sep 08 10:51:00.376494 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1503/3016] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:59 2022] GET /compute/v2.1/servers/13b25df0-d58e-4da2-bcea-6dac80800bab => generated 1521 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:00.420677 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bf64b929-f907-4c81-8cd2-b4e27d374bca tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:00.421911 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bf64b929-f907-4c81-8cd2-b4e27d374bca tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:00.448855 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-56005a44-b1c7-434e-8096-2e16cd0d6ebb tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] 10.222.0.27 "GET /compute/v2.1/images/d1109835-85cb-4a9f-996a-3ab19278e978" status: 200 len: 1422 microversion: 2.1 time: 0.183459 Sep 08 10:51:00.449934 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1514/3017] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:51:00 2022] GET /compute/v2.1/images/d1109835-85cb-4a9f-996a-3ab19278e978 => generated 1422 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:00.461325 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf64b929-f907-4c81-8cd2-b4e27d374bca tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:00.462280 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf64b929-f907-4c81-8cd2-b4e27d374bca tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:00.465280 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf64b929-f907-4c81-8cd2-b4e27d374bca tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:00.468833 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf64b929-f907-4c81-8cd2-b4e27d374bca tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:00.470625 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf64b929-f907-4c81-8cd2-b4e27d374bca tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:00.471338 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf64b929-f907-4c81-8cd2-b4e27d374bca tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:00.474302 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6c469beb-1a84-417b-9efd-5f29cb0e83ff tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:00.475225 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6c469beb-1a84-417b-9efd-5f29cb0e83ff tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] [instance: e2f8b261-f29f-494e-a4f0-b37d8618f625] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:00.484072 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:51:00.497542 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6c469beb-1a84-417b-9efd-5f29cb0e83ff tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:00.498816 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6c469beb-1a84-417b-9efd-5f29cb0e83ff tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:00.499529 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6c469beb-1a84-417b-9efd-5f29cb0e83ff tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:00.500490 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6c469beb-1a84-417b-9efd-5f29cb0e83ff tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:00.502697 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6c469beb-1a84-417b-9efd-5f29cb0e83ff tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:00.503688 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6c469beb-1a84-417b-9efd-5f29cb0e83ff tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:00.708366 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-bf64b929-f907-4c81-8cd2-b4e27d374bca tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:00.727286 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-bf64b929-f907-4c81-8cd2-b4e27d374bca tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:00.737494 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-bf64b929-f907-4c81-8cd2-b4e27d374bca tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:00.758538 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bf64b929-f907-4c81-8cd2-b4e27d374bca tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1539 microversion: 2.91 time: 0.379652 Sep 08 10:51:00.797934 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1504/3018] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:51:00 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1539 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:51:00.797934 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d80e8b6a-89cd-4ea5-a936-b8576011f438 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:00.797934 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d80e8b6a-89cd-4ea5-a936-b8576011f438 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] [instance: a4e3b624-1ff1-4ee3-a6e1-d5da50a26d3f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:00.824733 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d80e8b6a-89cd-4ea5-a936-b8576011f438 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:00.825634 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d80e8b6a-89cd-4ea5-a936-b8576011f438 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:00.827213 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d80e8b6a-89cd-4ea5-a936-b8576011f438 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:00.828703 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d80e8b6a-89cd-4ea5-a936-b8576011f438 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:00.830457 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d80e8b6a-89cd-4ea5-a936-b8576011f438 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:00.831337 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d80e8b6a-89cd-4ea5-a936-b8576011f438 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:00.908348 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d80e8b6a-89cd-4ea5-a936-b8576011f438 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] [instance: a4e3b624-1ff1-4ee3-a6e1-d5da50a26d3f] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:51:01.252428 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d80e8b6a-89cd-4ea5-a936-b8576011f438 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a4e3b624-1ff1-4ee3-a6e1-d5da50a26d3f" status: 204 len: 0 microversion: 2.1 time: 0.464929 Sep 08 10:51:01.268672 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1505/3019] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:51:00 2022] DELETE /compute/v2.1/servers/a4e3b624-1ff1-4ee3-a6e1-d5da50a26d3f => generated 0 bytes in 482 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:51:01.275822 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-933bfdf3-2acb-43b0-bc65-518ab68cb47b tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:01.277110 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-933bfdf3-2acb-43b0-bc65-518ab68cb47b tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:01.306784 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-933bfdf3-2acb-43b0-bc65-518ab68cb47b tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:01.308053 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-933bfdf3-2acb-43b0-bc65-518ab68cb47b tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:01.312561 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-933bfdf3-2acb-43b0-bc65-518ab68cb47b tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:01.314741 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-933bfdf3-2acb-43b0-bc65-518ab68cb47b tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:01.321720 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-933bfdf3-2acb-43b0-bc65-518ab68cb47b tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:01.324055 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-933bfdf3-2acb-43b0-bc65-518ab68cb47b tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:01.861919 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6c469beb-1a84-417b-9efd-5f29cb0e83ff tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5947a1de1e44d87a601b5b5c8c2f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181f4b3ff01740feb60d5b50056874cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:01.906268 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6c469beb-1a84-417b-9efd-5f29cb0e83ff tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5947a1de1e44d87a601b5b5c8c2f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181f4b3ff01740feb60d5b50056874cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:01.908407 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6c469beb-1a84-417b-9efd-5f29cb0e83ff tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5947a1de1e44d87a601b5b5c8c2f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181f4b3ff01740feb60d5b50056874cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:01.909594 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6c469beb-1a84-417b-9efd-5f29cb0e83ff tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] 10.222.0.27 "GET /compute/v2.1/servers/e2f8b261-f29f-494e-a4f0-b37d8618f625" status: 200 len: 1318 microversion: 2.21 time: 1.458064 Sep 08 10:51:01.910184 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1515/3020] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:51:00 2022] GET /compute/v2.1/servers/e2f8b261-f29f-494e-a4f0-b37d8618f625 => generated 1318 bytes in 1459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:51:01.961414 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-77b5749a-09c1-4756-b7f0-89cd433bf9be tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:01.975216 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-77b5749a-09c1-4756-b7f0-89cd433bf9be tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: 13b25df0-d58e-4da2-bcea-6dac80800bab] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:02.012738 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-77b5749a-09c1-4756-b7f0-89cd433bf9be tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:02.014433 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-77b5749a-09c1-4756-b7f0-89cd433bf9be tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:02.026074 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-77b5749a-09c1-4756-b7f0-89cd433bf9be tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:02.027706 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-77b5749a-09c1-4756-b7f0-89cd433bf9be tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:02.028754 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-77b5749a-09c1-4756-b7f0-89cd433bf9be tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:02.029526 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-77b5749a-09c1-4756-b7f0-89cd433bf9be tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:02.191779 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-77b5749a-09c1-4756-b7f0-89cd433bf9be tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: 13b25df0-d58e-4da2-bcea-6dac80800bab] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:51:02.336108 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-933bfdf3-2acb-43b0-bc65-518ab68cb47b tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:02.362273 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-933bfdf3-2acb-43b0-bc65-518ab68cb47b tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:02.370574 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-933bfdf3-2acb-43b0-bc65-518ab68cb47b tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:02.373678 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-933bfdf3-2acb-43b0-bc65-518ab68cb47b tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 200 len: 1866 microversion: 2.32 time: 1.105627 Sep 08 10:51:02.401084 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1506/3021] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:51:01 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 1866 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:51:02.410526 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-9a9d71be-4238-440a-b0a6-6d15431ef27c req-18170993-bfa0-443f-9bc8-c749531071cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98277784-8e48-4a7b-8786-ce579e1d5ccf", "tag": "87858844-1949-4224-96fe-9b4790f10cad"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:51:02.436107 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-9a9d71be-4238-440a-b0a6-6d15431ef27c req-18170993-bfa0-443f-9bc8-c749531071cc service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:02.436611 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-9a9d71be-4238-440a-b0a6-6d15431ef27c req-18170993-bfa0-443f-9bc8-c749531071cc service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:02.437074 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-9a9d71be-4238-440a-b0a6-6d15431ef27c req-18170993-bfa0-443f-9bc8-c749531071cc service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:02.464381 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-77b5749a-09c1-4756-b7f0-89cd433bf9be tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "DELETE /compute/v2.1/servers/13b25df0-d58e-4da2-bcea-6dac80800bab" status: 204 len: 0 microversion: 2.1 time: 0.522493 Sep 08 10:51:02.466516 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1516/3022] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:51:01 2022] DELETE /compute/v2.1/servers/13b25df0-d58e-4da2-bcea-6dac80800bab => generated 0 bytes in 527 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:51:02.485631 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-e1470f0d-a51f-4fad-8985-14291e0f57fb req-479c03a0-7f4a-451b-95c5-df8096498974 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13b25df0-d58e-4da2-bcea-6dac80800bab", "name": "network-vif-unplugged", "status": "completed", "tag": "4c8c0aef-65f1-4dab-aac2-76c85fdead87"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:51:02.507644 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e1470f0d-a51f-4fad-8985-14291e0f57fb req-479c03a0-7f4a-451b-95c5-df8096498974 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:02.508439 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-9a9d71be-4238-440a-b0a6-6d15431ef27c req-18170993-bfa0-443f-9bc8-c749531071cc service nova] Creating event network-changed:87858844-1949-4224-96fe-9b4790f10cad for instance 98277784-8e48-4a7b-8786-ce579e1d5ccf on n-h2-850501-12 Sep 08 10:51:02.511902 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e1470f0d-a51f-4fad-8985-14291e0f57fb req-479c03a0-7f4a-451b-95c5-df8096498974 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:02.517218 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e1470f0d-a51f-4fad-8985-14291e0f57fb req-479c03a0-7f4a-451b-95c5-df8096498974 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:02.530265 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-9a9d71be-4238-440a-b0a6-6d15431ef27c req-18170993-bfa0-443f-9bc8-c749531071cc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125772 Sep 08 10:51:02.534150 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1507/3023] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:51:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:51:02.544988 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f0e91869-8826-4a13-ba38-55db6a7ad7fd tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:02.551651 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-e1470f0d-a51f-4fad-8985-14291e0f57fb req-479c03a0-7f4a-451b-95c5-df8096498974 service nova] Creating event network-vif-unplugged:4c8c0aef-65f1-4dab-aac2-76c85fdead87 for instance 13b25df0-d58e-4da2-bcea-6dac80800bab on n-h2-850501-12 Sep 08 10:51:02.556471 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f0e91869-8826-4a13-ba38-55db6a7ad7fd tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] [instance: 2c34cf01-2cbf-4cf8-ad8f-d3c8f2c7c66f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:02.572496 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-e1470f0d-a51f-4fad-8985-14291e0f57fb req-479c03a0-7f4a-451b-95c5-df8096498974 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097762 Sep 08 10:51:02.573414 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1517/3024] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:51:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:51:02.590289 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f0e91869-8826-4a13-ba38-55db6a7ad7fd tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:02.591202 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f0e91869-8826-4a13-ba38-55db6a7ad7fd tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:02.596107 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d5df7222-e1ac-4b25-a068-cd40e49f265e tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Calling method '.version_select at 0x7f68e8a92af0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:02.617646 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f0e91869-8826-4a13-ba38-55db6a7ad7fd tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:02.617826 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f0e91869-8826-4a13-ba38-55db6a7ad7fd tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:02.618292 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f0e91869-8826-4a13-ba38-55db6a7ad7fd tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:02.618661 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f0e91869-8826-4a13-ba38-55db6a7ad7fd tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:02.672072 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f0e91869-8826-4a13-ba38-55db6a7ad7fd tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] [instance: 2c34cf01-2cbf-4cf8-ad8f-d3c8f2c7c66f] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:51:02.779757 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d5df7222-e1ac-4b25-a068-cd40e49f265e tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] 10.222.0.27 "GET /compute/v2.1/images/d1109835-85cb-4a9f-996a-3ab19278e978" status: 200 len: 1422 microversion: 2.1 time: 0.199527 Sep 08 10:51:02.790265 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1518/3025] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:51:02 2022] GET /compute/v2.1/images/d1109835-85cb-4a9f-996a-3ab19278e978 => generated 1422 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:02.803115 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6b568000-5e94-4f53-af32-4fdad4cfc286 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:02.806025 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6b568000-5e94-4f53-af32-4fdad4cfc286 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:02.829549 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b568000-5e94-4f53-af32-4fdad4cfc286 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:02.829549 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b568000-5e94-4f53-af32-4fdad4cfc286 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:02.830034 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b568000-5e94-4f53-af32-4fdad4cfc286 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:02.830794 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b568000-5e94-4f53-af32-4fdad4cfc286 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:02.831261 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b568000-5e94-4f53-af32-4fdad4cfc286 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:02.835290 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b568000-5e94-4f53-af32-4fdad4cfc286 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:02.981211 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:51:02.991823 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f0e91869-8826-4a13-ba38-55db6a7ad7fd tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2c34cf01-2cbf-4cf8-ad8f-d3c8f2c7c66f" status: 204 len: 0 microversion: 2.1 time: 0.450829 Sep 08 10:51:02.996707 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1508/3026] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:51:02 2022] DELETE /compute/v2.1/servers/2c34cf01-2cbf-4cf8-ad8f-d3c8f2c7c66f => generated 0 bytes in 461 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:51:03.003290 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6b568000-5e94-4f53-af32-4fdad4cfc286 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:03.004261 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-f4e0e4e1-6853-4a55-94b0-3afe65dad45f req-5b4a6728-b514-4684-8157-72d90daa0f38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f182d52b-9650-44f2-bd28-f2ae1daa1438", "tag": "b9069650-6961-445f-8748-e1a4b9f65026"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:51:03.018911 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6b568000-5e94-4f53-af32-4fdad4cfc286 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:03.020512 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6b568000-5e94-4f53-af32-4fdad4cfc286 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:03.037768 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6b568000-5e94-4f53-af32-4fdad4cfc286 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1539 microversion: 2.91 time: 0.246238 Sep 08 10:51:03.039330 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1519/3027] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:51:02 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1539 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:51:03.051571 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3b63963a-b483-4cd9-8f62-38bb37e0298f tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:03.052455 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3b63963a-b483-4cd9-8f62-38bb37e0298f tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: 13b25df0-d58e-4da2-bcea-6dac80800bab] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:03.069109 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-f4e0e4e1-6853-4a55-94b0-3afe65dad45f req-5b4a6728-b514-4684-8157-72d90daa0f38 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:03.070501 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-f4e0e4e1-6853-4a55-94b0-3afe65dad45f req-5b4a6728-b514-4684-8157-72d90daa0f38 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:03.071575 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-f4e0e4e1-6853-4a55-94b0-3afe65dad45f req-5b4a6728-b514-4684-8157-72d90daa0f38 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:03.075779 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b63963a-b483-4cd9-8f62-38bb37e0298f tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:03.077154 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b63963a-b483-4cd9-8f62-38bb37e0298f tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:03.081324 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b63963a-b483-4cd9-8f62-38bb37e0298f tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:03.082184 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b63963a-b483-4cd9-8f62-38bb37e0298f tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:03.082667 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b63963a-b483-4cd9-8f62-38bb37e0298f tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:03.083116 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b63963a-b483-4cd9-8f62-38bb37e0298f tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:03.103740 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-f4e0e4e1-6853-4a55-94b0-3afe65dad45f req-5b4a6728-b514-4684-8157-72d90daa0f38 service nova] Creating event network-changed:b9069650-6961-445f-8748-e1a4b9f65026 for instance f182d52b-9650-44f2-bd28-f2ae1daa1438 on n-h1-850501-12 Sep 08 10:51:03.113462 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-f4e0e4e1-6853-4a55-94b0-3afe65dad45f req-5b4a6728-b514-4684-8157-72d90daa0f38 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114080 Sep 08 10:51:03.115570 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1509/3028] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:51:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:51:03.124184 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0b7c1706-bf97-4933-b74d-a6aceb5a8736 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:03.125436 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0b7c1706-bf97-4933-b74d-a6aceb5a8736 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] [instance: e2f8b261-f29f-494e-a4f0-b37d8618f625] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:03.132857 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0b7c1706-bf97-4933-b74d-a6aceb5a8736 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:03.133748 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0b7c1706-bf97-4933-b74d-a6aceb5a8736 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:03.134437 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0b7c1706-bf97-4933-b74d-a6aceb5a8736 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:03.135385 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0b7c1706-bf97-4933-b74d-a6aceb5a8736 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:03.136069 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0b7c1706-bf97-4933-b74d-a6aceb5a8736 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:03.136713 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0b7c1706-bf97-4933-b74d-a6aceb5a8736 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:03.320861 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0b7c1706-bf97-4933-b74d-a6aceb5a8736 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5947a1de1e44d87a601b5b5c8c2f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181f4b3ff01740feb60d5b50056874cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:03.352950 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0b7c1706-bf97-4933-b74d-a6aceb5a8736 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5947a1de1e44d87a601b5b5c8c2f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181f4b3ff01740feb60d5b50056874cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:03.360816 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0b7c1706-bf97-4933-b74d-a6aceb5a8736 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5947a1de1e44d87a601b5b5c8c2f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181f4b3ff01740feb60d5b50056874cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:03.363845 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0b7c1706-bf97-4933-b74d-a6aceb5a8736 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] 10.222.0.27 "GET /compute/v2.1/servers/e2f8b261-f29f-494e-a4f0-b37d8618f625" status: 200 len: 1316 microversion: 2.21 time: 0.245387 Sep 08 10:51:03.365948 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1510/3029] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:51:03 2022] GET /compute/v2.1/servers/e2f8b261-f29f-494e-a4f0-b37d8618f625 => generated 1316 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:51:03.378372 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-02881825-7f28-45fe-979e-7b52edce7020 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:03.380222 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-02881825-7f28-45fe-979e-7b52edce7020 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] [instance: a4e3b624-1ff1-4ee3-a6e1-d5da50a26d3f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:03.401865 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-02881825-7f28-45fe-979e-7b52edce7020 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:03.402397 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-02881825-7f28-45fe-979e-7b52edce7020 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:03.403124 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-02881825-7f28-45fe-979e-7b52edce7020 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:03.404278 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-02881825-7f28-45fe-979e-7b52edce7020 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:03.405130 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-02881825-7f28-45fe-979e-7b52edce7020 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:03.405890 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-02881825-7f28-45fe-979e-7b52edce7020 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:03.585566 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3b63963a-b483-4cd9-8f62-38bb37e0298f tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86e8bd6f9048ce8718f432e51128a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c3752f739b47a296a5b88948fe7f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:03.630016 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3b63963a-b483-4cd9-8f62-38bb37e0298f tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "GET /compute/v2.1/servers/13b25df0-d58e-4da2-bcea-6dac80800bab" status: 200 len: 1527 microversion: 2.1 time: 0.586201 Sep 08 10:51:03.663360 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1520/3030] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:03 2022] GET /compute/v2.1/servers/13b25df0-d58e-4da2-bcea-6dac80800bab => generated 1527 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:03.679241 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0de6b78f-4935-4460-8ae9-eb82e3840f0a tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:03.680972 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0de6b78f-4935-4460-8ae9-eb82e3840f0a tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:03.698689 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0de6b78f-4935-4460-8ae9-eb82e3840f0a tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:03.699573 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0de6b78f-4935-4460-8ae9-eb82e3840f0a tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:03.701438 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0de6b78f-4935-4460-8ae9-eb82e3840f0a tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:03.706515 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0de6b78f-4935-4460-8ae9-eb82e3840f0a tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:03.706770 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0de6b78f-4935-4460-8ae9-eb82e3840f0a tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:03.707383 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0de6b78f-4935-4460-8ae9-eb82e3840f0a tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:03.819454 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-02881825-7f28-45fe-979e-7b52edce7020 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0c66b5a004df886b3d973a978c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc5f459e4a143d1b8bf1c5c64153644', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:03.835076 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-02881825-7f28-45fe-979e-7b52edce7020 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] 10.222.0.27 "GET /compute/v2.1/servers/a4e3b624-1ff1-4ee3-a6e1-d5da50a26d3f" status: 200 len: 1511 microversion: 2.1 time: 0.466931 Sep 08 10:51:03.837095 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1511/3031] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:03 2022] GET /compute/v2.1/servers/a4e3b624-1ff1-4ee3-a6e1-d5da50a26d3f => generated 1511 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:03.856734 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ea8f91c4-0332-40ad-ba6b-05c4fb4a6797 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Calling method '.version_select at 0x7f68e44d65e0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:03.946995 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ea8f91c4-0332-40ad-ba6b-05c4fb4a6797 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] 10.222.0.27 "GET /compute/v2.1/images/d1109835-85cb-4a9f-996a-3ab19278e978" status: 200 len: 1422 microversion: 2.1 time: 0.107797 Sep 08 10:51:03.958225 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1512/3032] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:51:03 2022] GET /compute/v2.1/images/d1109835-85cb-4a9f-996a-3ab19278e978 => generated 1422 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:04.076662 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-50ca00ac-6363-437f-8952-9be49d78df4a tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:04.077969 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-50ca00ac-6363-437f-8952-9be49d78df4a tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:04.098419 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-50ca00ac-6363-437f-8952-9be49d78df4a tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:04.099585 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-50ca00ac-6363-437f-8952-9be49d78df4a tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:04.131796 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-50ca00ac-6363-437f-8952-9be49d78df4a tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:04.136259 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-50ca00ac-6363-437f-8952-9be49d78df4a tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:04.140056 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-50ca00ac-6363-437f-8952-9be49d78df4a tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:04.141812 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-50ca00ac-6363-437f-8952-9be49d78df4a tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:04.449833 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0de6b78f-4935-4460-8ae9-eb82e3840f0a tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:04.477931 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0de6b78f-4935-4460-8ae9-eb82e3840f0a tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:04.482347 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0de6b78f-4935-4460-8ae9-eb82e3840f0a tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:04.488217 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0de6b78f-4935-4460-8ae9-eb82e3840f0a tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 200 len: 1887 microversion: 2.32 time: 0.823452 Sep 08 10:51:04.512727 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1521/3033] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:51:03 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 1887 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:51:04.531296 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b8d6090a-c7c2-4371-82ea-739677ffdcb2 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:04.532529 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b8d6090a-c7c2-4371-82ea-739677ffdcb2 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] [instance: e2f8b261-f29f-494e-a4f0-b37d8618f625] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:04.568052 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-50ca00ac-6363-437f-8952-9be49d78df4a tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:04.583832 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8d6090a-c7c2-4371-82ea-739677ffdcb2 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:04.584338 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8d6090a-c7c2-4371-82ea-739677ffdcb2 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:04.586243 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8d6090a-c7c2-4371-82ea-739677ffdcb2 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:04.587187 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8d6090a-c7c2-4371-82ea-739677ffdcb2 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:04.588289 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8d6090a-c7c2-4371-82ea-739677ffdcb2 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:04.588891 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8d6090a-c7c2-4371-82ea-739677ffdcb2 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:04.611217 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-50ca00ac-6363-437f-8952-9be49d78df4a tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:04.628699 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-50ca00ac-6363-437f-8952-9be49d78df4a tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:04.683964 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-50ca00ac-6363-437f-8952-9be49d78df4a tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1539 microversion: 2.91 time: 0.610960 Sep 08 10:51:04.684960 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1513/3034] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:51:04 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1539 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:51:04.762333 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-817c3a18-d858-4bd0-9dfd-d20c1f7483ba req-96eb84b9-a42c-4a29-9bfb-0d99cf6f93aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98277784-8e48-4a7b-8786-ce579e1d5ccf", "tag": "50649fb7-2e13-4d59-ad27-f52395856925"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:51:04.783239 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-817c3a18-d858-4bd0-9dfd-d20c1f7483ba req-96eb84b9-a42c-4a29-9bfb-0d99cf6f93aa service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:04.784173 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-817c3a18-d858-4bd0-9dfd-d20c1f7483ba req-96eb84b9-a42c-4a29-9bfb-0d99cf6f93aa service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:04.784833 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-817c3a18-d858-4bd0-9dfd-d20c1f7483ba req-96eb84b9-a42c-4a29-9bfb-0d99cf6f93aa service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:04.830364 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-817c3a18-d858-4bd0-9dfd-d20c1f7483ba req-96eb84b9-a42c-4a29-9bfb-0d99cf6f93aa service nova] Creating event network-changed:50649fb7-2e13-4d59-ad27-f52395856925 for instance 98277784-8e48-4a7b-8786-ce579e1d5ccf on n-h2-850501-12 Sep 08 10:51:04.867951 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-817c3a18-d858-4bd0-9dfd-d20c1f7483ba req-96eb84b9-a42c-4a29-9bfb-0d99cf6f93aa service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.162522 Sep 08 10:51:04.870228 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1514/3035] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:51:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:51:04.896750 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-01c68b4e-e506-41cf-a839-30a13a983e37 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:04.926744 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-01c68b4e-e506-41cf-a839-30a13a983e37 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: 13b25df0-d58e-4da2-bcea-6dac80800bab] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:04.953608 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-01c68b4e-e506-41cf-a839-30a13a983e37 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:04.971610 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-01c68b4e-e506-41cf-a839-30a13a983e37 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:04.975408 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-01c68b4e-e506-41cf-a839-30a13a983e37 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:04.979396 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-01c68b4e-e506-41cf-a839-30a13a983e37 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:04.985836 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-01c68b4e-e506-41cf-a839-30a13a983e37 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:04.993170 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-01c68b4e-e506-41cf-a839-30a13a983e37 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:05.993496 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:51:06.006521 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-01c68b4e-e506-41cf-a839-30a13a983e37 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86e8bd6f9048ce8718f432e51128a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c3752f739b47a296a5b88948fe7f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:06.034896 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-01c68b4e-e506-41cf-a839-30a13a983e37 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "GET /compute/v2.1/servers/13b25df0-d58e-4da2-bcea-6dac80800bab" status: 200 len: 1527 microversion: 2.1 time: 1.159904 Sep 08 10:51:06.042372 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1515/3036] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:04 2022] GET /compute/v2.1/servers/13b25df0-d58e-4da2-bcea-6dac80800bab => generated 1527 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:06.058821 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7a07ecb4-630d-4aee-a1be-40ca20b1e469 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:06.059848 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7a07ecb4-630d-4aee-a1be-40ca20b1e469 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] [instance: a4e3b624-1ff1-4ee3-a6e1-d5da50a26d3f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:06.077056 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a07ecb4-630d-4aee-a1be-40ca20b1e469 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:06.081720 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a07ecb4-630d-4aee-a1be-40ca20b1e469 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:06.082570 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a07ecb4-630d-4aee-a1be-40ca20b1e469 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:06.083602 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a07ecb4-630d-4aee-a1be-40ca20b1e469 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:06.084377 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a07ecb4-630d-4aee-a1be-40ca20b1e469 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:06.085067 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a07ecb4-630d-4aee-a1be-40ca20b1e469 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:06.190750 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=6 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:51:06.739944 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b8d6090a-c7c2-4371-82ea-739677ffdcb2 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5947a1de1e44d87a601b5b5c8c2f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181f4b3ff01740feb60d5b50056874cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:06.778823 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b8d6090a-c7c2-4371-82ea-739677ffdcb2 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5947a1de1e44d87a601b5b5c8c2f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181f4b3ff01740feb60d5b50056874cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:06.789480 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b8d6090a-c7c2-4371-82ea-739677ffdcb2 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5947a1de1e44d87a601b5b5c8c2f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181f4b3ff01740feb60d5b50056874cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:06.796513 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b8d6090a-c7c2-4371-82ea-739677ffdcb2 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] 10.222.0.27 "GET /compute/v2.1/servers/e2f8b261-f29f-494e-a4f0-b37d8618f625" status: 200 len: 1358 microversion: 2.21 time: 2.276818 Sep 08 10:51:06.802402 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1522/3037] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:51:04 2022] GET /compute/v2.1/servers/e2f8b261-f29f-494e-a4f0-b37d8618f625 => generated 1358 bytes in 2288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:51:06.853996 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-227443af-ffb8-4aeb-a346-b37ac77e2ce1 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Calling method '.version_select at 0x7f68e4246280>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:07.046516 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-227443af-ffb8-4aeb-a346-b37ac77e2ce1 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] 10.222.0.27 "GET /compute/v2.1/images/d1109835-85cb-4a9f-996a-3ab19278e978" status: 200 len: 1422 microversion: 2.1 time: 0.236383 Sep 08 10:51:07.053491 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1523/3038] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:51:06 2022] GET /compute/v2.1/images/d1109835-85cb-4a9f-996a-3ab19278e978 => generated 1422 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:07.096141 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-de6efce3-d611-457e-b129-f784f3e87d15 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:07.097059 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-de6efce3-d611-457e-b129-f784f3e87d15 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:07.100898 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7a07ecb4-630d-4aee-a1be-40ca20b1e469 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0c66b5a004df886b3d973a978c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc5f459e4a143d1b8bf1c5c64153644', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:07.120273 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7a07ecb4-630d-4aee-a1be-40ca20b1e469 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] 10.222.0.27 "GET /compute/v2.1/servers/a4e3b624-1ff1-4ee3-a6e1-d5da50a26d3f" status: 200 len: 1469 microversion: 2.1 time: 1.076170 Sep 08 10:51:07.145381 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1516/3039] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:06 2022] GET /compute/v2.1/servers/a4e3b624-1ff1-4ee3-a6e1-d5da50a26d3f => generated 1469 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:07.150968 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de6efce3-d611-457e-b129-f784f3e87d15 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:07.151471 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de6efce3-d611-457e-b129-f784f3e87d15 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:07.151906 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de6efce3-d611-457e-b129-f784f3e87d15 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:07.152636 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de6efce3-d611-457e-b129-f784f3e87d15 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:07.153117 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de6efce3-d611-457e-b129-f784f3e87d15 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:07.153580 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de6efce3-d611-457e-b129-f784f3e87d15 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:07.159043 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ea330e2f-5079-4c8e-a239-b2d7dcbb8c22 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:07.159663 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ea330e2f-5079-4c8e-a239-b2d7dcbb8c22 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:07.170979 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ea330e2f-5079-4c8e-a239-b2d7dcbb8c22 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:07.171478 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ea330e2f-5079-4c8e-a239-b2d7dcbb8c22 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:07.171916 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ea330e2f-5079-4c8e-a239-b2d7dcbb8c22 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:07.173208 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ea330e2f-5079-4c8e-a239-b2d7dcbb8c22 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:07.173729 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ea330e2f-5079-4c8e-a239-b2d7dcbb8c22 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:07.174163 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ea330e2f-5079-4c8e-a239-b2d7dcbb8c22 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:07.542244 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ea330e2f-5079-4c8e-a239-b2d7dcbb8c22 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:07.554924 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ea330e2f-5079-4c8e-a239-b2d7dcbb8c22 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:07.558857 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ea330e2f-5079-4c8e-a239-b2d7dcbb8c22 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:07.576349 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ea330e2f-5079-4c8e-a239-b2d7dcbb8c22 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1539 microversion: 2.91 time: 0.428158 Sep 08 10:51:07.578245 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1517/3040] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:51:07 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1539 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:51:07.585247 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-c5f5a8e8-cdb5-4e6d-b224-754d8da61ff1 req-b1691364-ce63-4d6b-a698-1d3b3eecf4a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4e3b624-1ff1-4ee3-a6e1-d5da50a26d3f", "name": "network-vif-deleted", "tag": "60cd05e0-e70b-455b-8ae9-16cf57bae568"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:51:07.629223 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-c5f5a8e8-cdb5-4e6d-b224-754d8da61ff1 req-b1691364-ce63-4d6b-a698-1d3b3eecf4a2 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:07.630240 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-c5f5a8e8-cdb5-4e6d-b224-754d8da61ff1 req-b1691364-ce63-4d6b-a698-1d3b3eecf4a2 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:07.632818 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-c5f5a8e8-cdb5-4e6d-b224-754d8da61ff1 req-b1691364-ce63-4d6b-a698-1d3b3eecf4a2 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:07.654725 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-c5f5a8e8-cdb5-4e6d-b224-754d8da61ff1 req-b1691364-ce63-4d6b-a698-1d3b3eecf4a2 service nova] Creating event network-vif-deleted:60cd05e0-e70b-455b-8ae9-16cf57bae568 for instance a4e3b624-1ff1-4ee3-a6e1-d5da50a26d3f on n-h2-850501-12 Sep 08 10:51:07.661354 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-c5f5a8e8-cdb5-4e6d-b224-754d8da61ff1 req-b1691364-ce63-4d6b-a698-1d3b3eecf4a2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080649 Sep 08 10:51:07.663895 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1518/3041] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:51:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:51:07.671597 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-abc6fb16-8e77-4d21-984e-8b7668869663 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:07.673121 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-abc6fb16-8e77-4d21-984e-8b7668869663 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: 13b25df0-d58e-4da2-bcea-6dac80800bab] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:07.681799 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-abc6fb16-8e77-4d21-984e-8b7668869663 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:07.682610 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-abc6fb16-8e77-4d21-984e-8b7668869663 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:07.683374 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-abc6fb16-8e77-4d21-984e-8b7668869663 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:07.686161 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-abc6fb16-8e77-4d21-984e-8b7668869663 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:07.686666 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-abc6fb16-8e77-4d21-984e-8b7668869663 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:07.687103 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-abc6fb16-8e77-4d21-984e-8b7668869663 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:07.934997 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-abc6fb16-8e77-4d21-984e-8b7668869663 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86e8bd6f9048ce8718f432e51128a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c3752f739b47a296a5b88948fe7f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:07.952113 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-abc6fb16-8e77-4d21-984e-8b7668869663 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "GET /compute/v2.1/servers/13b25df0-d58e-4da2-bcea-6dac80800bab" status: 200 len: 1485 microversion: 2.1 time: 0.285608 Sep 08 10:51:07.960910 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1519/3042] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:07 2022] GET /compute/v2.1/servers/13b25df0-d58e-4da2-bcea-6dac80800bab => generated 1485 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:07.974411 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-39db37f8-4108-4031-9d9e-3ded25c56cf9 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:07.975289 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-39db37f8-4108-4031-9d9e-3ded25c56cf9 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] [instance: e2f8b261-f29f-494e-a4f0-b37d8618f625] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:07.991681 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-39db37f8-4108-4031-9d9e-3ded25c56cf9 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:07.999519 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-39db37f8-4108-4031-9d9e-3ded25c56cf9 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:08.000281 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-39db37f8-4108-4031-9d9e-3ded25c56cf9 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:08.001771 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-39db37f8-4108-4031-9d9e-3ded25c56cf9 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:08.002399 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-39db37f8-4108-4031-9d9e-3ded25c56cf9 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:08.003010 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-39db37f8-4108-4031-9d9e-3ded25c56cf9 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:08.006876 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-de6efce3-d611-457e-b129-f784f3e87d15 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:08.025319 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-de6efce3-d611-457e-b129-f784f3e87d15 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:08.033135 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-de6efce3-d611-457e-b129-f784f3e87d15 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:08.045976 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-de6efce3-d611-457e-b129-f784f3e87d15 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 200 len: 1887 microversion: 2.32 time: 0.990932 Sep 08 10:51:08.046980 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1524/3043] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:51:07 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 1887 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:51:08.062470 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-30946096-fd4f-4041-8b9b-a35c9487ca9c tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Calling method '.version_select at 0x7f68e8a925e0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:08.143472 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-30946096-fd4f-4041-8b9b-a35c9487ca9c tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] 10.222.0.27 "GET /compute/v2.1/images/d1109835-85cb-4a9f-996a-3ab19278e978" status: 200 len: 1422 microversion: 2.1 time: 0.084961 Sep 08 10:51:08.160480 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1525/3044] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:51:08 2022] GET /compute/v2.1/images/d1109835-85cb-4a9f-996a-3ab19278e978 => generated 1422 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:51:08.177433 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a18dbda8-6570-404c-8551-b6710cdf9d2e tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:08.178164 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a18dbda8-6570-404c-8551-b6710cdf9d2e tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] [instance: a4e3b624-1ff1-4ee3-a6e1-d5da50a26d3f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:08.197224 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a18dbda8-6570-404c-8551-b6710cdf9d2e tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:08.197884 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a18dbda8-6570-404c-8551-b6710cdf9d2e tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:08.198334 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a18dbda8-6570-404c-8551-b6710cdf9d2e tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:08.201321 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a18dbda8-6570-404c-8551-b6710cdf9d2e tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:08.201863 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a18dbda8-6570-404c-8551-b6710cdf9d2e tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:08.202343 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a18dbda8-6570-404c-8551-b6710cdf9d2e tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:08.231627 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-a18dbda8-6570-404c-8551-b6710cdf9d2e tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] HTTP exception thrown: Instance a4e3b624-1ff1-4ee3-a6e1-d5da50a26d3f could not be found. Sep 08 10:51:08.233369 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a18dbda8-6570-404c-8551-b6710cdf9d2e tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Request method failure captured: Sep 08 10:51:08.233369 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/a4e3b624-1ff1-4ee3-a6e1-d5da50a26d3f HTTP/1.1 Sep 08 10:51:08.233369 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:51:08.233369 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:51:08.233369 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:51:08.233369 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:51:08.233369 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:51:08.233369 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:51:08.233369 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:51:08.233369 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:51:08.233369 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGci5QyHAQE6P6WEvYGK4b8ZqzRN-2gl_ewgJb8yGqON7T0IdqvsZ2FWeT54ilK-uX889hvOmBy0OAjxDFmav3LOHZavcHwckWH4l8LR1Omma7vusvj4eZ16lpYyx10HfgWeUrFD4pV2O9kvw-RnV2-sYHFtZ5YVmtvsxOHXXRx1IGuE Sep 08 10:51:08.233369 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:51:08.233369 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:51:08.233369 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:51:08.233369 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:51:08.233369 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:51:08.233369 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:51:08.233369 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 7bc5f459e4a143d1b8bf1c5c64153644 Sep 08 10:51:08.233369 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-MultipleCreateTestJSON-1231480370 Sep 08 10:51:08.233369 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:51:08.233369 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:51:08.233369 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7bc5f459e4a143d1b8bf1c5c64153644"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7bc5f459e4a143d1b8bf1c5c64153644"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7bc5f459e4a143d1b8bf1c5c64153644"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7bc5f459e4a143d1b8bf1c5c64153644"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:51:08.233369 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-MultipleCreateTestJSON-1231480370 Sep 08 10:51:08.233369 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 7bc5f459e4a143d1b8bf1c5c64153644 Sep 08 10:51:08.233369 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1231480370 Sep 08 10:51:08.233369 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-MultipleCreateTestJSON-1231480370-project Sep 08 10:51:08.233369 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:51:08.233369 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:51:08.233369 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 53c0c66b5a004df886b3d973a978c132 Sep 08 10:51:08.233369 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-MultipleCreateTestJSON-1231480370-project Sep 08 10:51:08.233369 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:51:08.233369 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance a4e3b624-1ff1-4ee3-a6e1-d5da50a26d3f could not be found. Sep 08 10:51:08.233369 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'a4e3b624-1ff1-4ee3-a6e1-d5da50a26d3f'} Sep 08 10:51:08.233369 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:51:08.233369 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:51:08.233369 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:51:08.233369 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:51:08.233369 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:51:08.233369 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:51:08.233369 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:51:08.233369 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:51:08.233369 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:51:08.233369 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:51:08.233369 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4e3b624-1ff1-4ee3-a6e1-d5da50a26d3f could not be found. Sep 08 10:51:08.233369 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:51:08.233369 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:51:08.233369 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:51:08.233369 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:51:08.233369 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:51:08.233369 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:51:08.233369 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:51:08.233369 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:51:08.233369 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:51:08.233369 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:51:08.233369 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:51:08.233369 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:51:08.233369 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:51:08.233369 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:51:08.233369 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:51:08.233369 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:51:08.233369 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4e3b624-1ff1-4ee3-a6e1-d5da50a26d3f could not be found. Sep 08 10:51:08.233369 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:51:08.233369 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:51:08.233369 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:51:08.238537 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:51:08.238537 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:51:08.238537 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:51:08.238537 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:51:08.238537 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:51:08.238537 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4e3b624-1ff1-4ee3-a6e1-d5da50a26d3f could not be found. Sep 08 10:51:08.238537 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:51:08.241363 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a18dbda8-6570-404c-8551-b6710cdf9d2e tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Returning 404 to user: Instance a4e3b624-1ff1-4ee3-a6e1-d5da50a26d3f could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:51:08.242508 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a18dbda8-6570-404c-8551-b6710cdf9d2e tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] 10.222.0.27 "GET /compute/v2.1/servers/a4e3b624-1ff1-4ee3-a6e1-d5da50a26d3f" status: 404 len: 111 microversion: 2.1 time: 0.071481 Sep 08 10:51:08.243571 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1526/3045] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:08 2022] GET /compute/v2.1/servers/a4e3b624-1ff1-4ee3-a6e1-d5da50a26d3f => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 10:51:08.256245 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a3352dd4-bcc5-41fc-955e-2341e32a90e5 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:08.257262 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a3352dd4-bcc5-41fc-955e-2341e32a90e5 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] [instance: 2c34cf01-2cbf-4cf8-ad8f-d3c8f2c7c66f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:08.265654 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a3352dd4-bcc5-41fc-955e-2341e32a90e5 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:08.266469 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a3352dd4-bcc5-41fc-955e-2341e32a90e5 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:08.271238 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a3352dd4-bcc5-41fc-955e-2341e32a90e5 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:08.280060 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a3352dd4-bcc5-41fc-955e-2341e32a90e5 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:08.281264 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a3352dd4-bcc5-41fc-955e-2341e32a90e5 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:08.282521 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a3352dd4-bcc5-41fc-955e-2341e32a90e5 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:08.724540 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-39db37f8-4108-4031-9d9e-3ded25c56cf9 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5947a1de1e44d87a601b5b5c8c2f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181f4b3ff01740feb60d5b50056874cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:08.738289 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-39db37f8-4108-4031-9d9e-3ded25c56cf9 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5947a1de1e44d87a601b5b5c8c2f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181f4b3ff01740feb60d5b50056874cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:08.740098 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-39db37f8-4108-4031-9d9e-3ded25c56cf9 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5947a1de1e44d87a601b5b5c8c2f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181f4b3ff01740feb60d5b50056874cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:08.741617 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-39db37f8-4108-4031-9d9e-3ded25c56cf9 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] 10.222.0.27 "GET /compute/v2.1/servers/e2f8b261-f29f-494e-a4f0-b37d8618f625" status: 200 len: 1358 microversion: 2.21 time: 0.775693 Sep 08 10:51:08.764560 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1520/3046] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:51:07 2022] GET /compute/v2.1/servers/e2f8b261-f29f-494e-a4f0-b37d8618f625 => generated 1358 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:51:08.772076 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-3fa162df-840b-4623-86f0-bd13744a60d9 req-60d2251e-13b3-4e6d-b2eb-3ccc54f37ed2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13b25df0-d58e-4da2-bcea-6dac80800bab", "name": "network-vif-deleted", "tag": "4c8c0aef-65f1-4dab-aac2-76c85fdead87"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:51:08.786236 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-3fa162df-840b-4623-86f0-bd13744a60d9 req-60d2251e-13b3-4e6d-b2eb-3ccc54f37ed2 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:08.786737 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-3fa162df-840b-4623-86f0-bd13744a60d9 req-60d2251e-13b3-4e6d-b2eb-3ccc54f37ed2 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:08.787175 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-3fa162df-840b-4623-86f0-bd13744a60d9 req-60d2251e-13b3-4e6d-b2eb-3ccc54f37ed2 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:08.792578 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:51:08.804874 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-3fa162df-840b-4623-86f0-bd13744a60d9 req-60d2251e-13b3-4e6d-b2eb-3ccc54f37ed2 service nova] Creating event network-vif-deleted:4c8c0aef-65f1-4dab-aac2-76c85fdead87 for instance 13b25df0-d58e-4da2-bcea-6dac80800bab on n-h2-850501-12 Sep 08 10:51:08.813944 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-3fa162df-840b-4623-86f0-bd13744a60d9 req-60d2251e-13b3-4e6d-b2eb-3ccc54f37ed2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046591 Sep 08 10:51:08.815342 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1521/3047] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:51:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:51:08.822445 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-287e6bba-d43b-4bff-8bc4-3b0a47071d24 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:08.823789 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-287e6bba-d43b-4bff-8bc4-3b0a47071d24 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:08.833955 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-287e6bba-d43b-4bff-8bc4-3b0a47071d24 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:08.835517 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-287e6bba-d43b-4bff-8bc4-3b0a47071d24 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:08.836269 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-287e6bba-d43b-4bff-8bc4-3b0a47071d24 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:08.837554 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-287e6bba-d43b-4bff-8bc4-3b0a47071d24 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:08.838907 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-287e6bba-d43b-4bff-8bc4-3b0a47071d24 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:08.841328 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-287e6bba-d43b-4bff-8bc4-3b0a47071d24 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:08.912795 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:51:08.994775 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-287e6bba-d43b-4bff-8bc4-3b0a47071d24 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:09.033248 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a3352dd4-bcc5-41fc-955e-2341e32a90e5 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0c66b5a004df886b3d973a978c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc5f459e4a143d1b8bf1c5c64153644', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:09.050036 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-287e6bba-d43b-4bff-8bc4-3b0a47071d24 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:09.053849 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-287e6bba-d43b-4bff-8bc4-3b0a47071d24 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:09.059425 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a3352dd4-bcc5-41fc-955e-2341e32a90e5 tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] 10.222.0.27 "GET /compute/v2.1/servers/2c34cf01-2cbf-4cf8-ad8f-d3c8f2c7c66f" status: 200 len: 1511 microversion: 2.1 time: 0.807180 Sep 08 10:51:09.063355 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1527/3048] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:08 2022] GET /compute/v2.1/servers/2c34cf01-2cbf-4cf8-ad8f-d3c8f2c7c66f => generated 1511 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:09.074294 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-287e6bba-d43b-4bff-8bc4-3b0a47071d24 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1539 microversion: 2.91 time: 0.257158 Sep 08 10:51:09.098908 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1522/3049] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:51:08 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1539 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:51:09.102119 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bf4e9d71-6d4b-46bd-82d9-460b8a5bb33d tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:09.120520 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ce025d0c-a5db-4ebc-9d34-c6e1e15485af tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:09.121556 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ce025d0c-a5db-4ebc-9d34-c6e1e15485af tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:09.122219 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bf4e9d71-6d4b-46bd-82d9-460b8a5bb33d tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: 13b25df0-d58e-4da2-bcea-6dac80800bab] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:09.137718 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf4e9d71-6d4b-46bd-82d9-460b8a5bb33d tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:09.139741 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf4e9d71-6d4b-46bd-82d9-460b8a5bb33d tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:09.142577 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf4e9d71-6d4b-46bd-82d9-460b8a5bb33d tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:09.144030 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf4e9d71-6d4b-46bd-82d9-460b8a5bb33d tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:09.144543 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf4e9d71-6d4b-46bd-82d9-460b8a5bb33d tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:09.146603 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf4e9d71-6d4b-46bd-82d9-460b8a5bb33d tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:09.150035 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ce025d0c-a5db-4ebc-9d34-c6e1e15485af tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:09.155992 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ce025d0c-a5db-4ebc-9d34-c6e1e15485af tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:09.157179 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ce025d0c-a5db-4ebc-9d34-c6e1e15485af tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:09.160184 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ce025d0c-a5db-4ebc-9d34-c6e1e15485af tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:09.160736 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ce025d0c-a5db-4ebc-9d34-c6e1e15485af tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:09.161798 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ce025d0c-a5db-4ebc-9d34-c6e1e15485af tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:09.207640 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:51:09.231161 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf4e9d71-6d4b-46bd-82d9-460b8a5bb33d tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:09.232989 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf4e9d71-6d4b-46bd-82d9-460b8a5bb33d tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:09.233573 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf4e9d71-6d4b-46bd-82d9-460b8a5bb33d tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:09.234584 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-bf4e9d71-6d4b-46bd-82d9-460b8a5bb33d tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lazy-loading 'fault' on Instance uuid 13b25df0-d58e-4da2-bcea-6dac80800bab {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:51:09.752852 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bf4e9d71-6d4b-46bd-82d9-460b8a5bb33d tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86e8bd6f9048ce8718f432e51128a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c3752f739b47a296a5b88948fe7f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:09.778860 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bf4e9d71-6d4b-46bd-82d9-460b8a5bb33d tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "GET /compute/v2.1/servers/13b25df0-d58e-4da2-bcea-6dac80800bab" status: 200 len: 1314 microversion: 2.1 time: 0.711343 Sep 08 10:51:09.782260 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1528/3050] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:09 2022] GET /compute/v2.1/servers/13b25df0-d58e-4da2-bcea-6dac80800bab => generated 1314 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:09.815400 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f5f90e35-07a0-41a8-83f5-5ab6fa4c19ef tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Calling method '.version_select at 0x7f68e440d670>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:09.937833 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f5f90e35-07a0-41a8-83f5-5ab6fa4c19ef tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] 10.222.0.27 "GET /compute/v2.1/images/d1109835-85cb-4a9f-996a-3ab19278e978" status: 200 len: 1422 microversion: 2.1 time: 0.152906 Sep 08 10:51:09.939266 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1529/3051] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:51:09 2022] GET /compute/v2.1/images/d1109835-85cb-4a9f-996a-3ab19278e978 => generated 1422 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:09.952346 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4cb3d0ae-4277-4622-90d1-97822ada2af6 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:09.954226 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4cb3d0ae-4277-4622-90d1-97822ada2af6 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] [instance: e2f8b261-f29f-494e-a4f0-b37d8618f625] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:09.966353 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4cb3d0ae-4277-4622-90d1-97822ada2af6 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:09.967946 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4cb3d0ae-4277-4622-90d1-97822ada2af6 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:09.972711 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4cb3d0ae-4277-4622-90d1-97822ada2af6 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:09.972711 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4cb3d0ae-4277-4622-90d1-97822ada2af6 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:09.974124 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4cb3d0ae-4277-4622-90d1-97822ada2af6 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:09.974124 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4cb3d0ae-4277-4622-90d1-97822ada2af6 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:10.114086 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ce025d0c-a5db-4ebc-9d34-c6e1e15485af tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:10.128484 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ce025d0c-a5db-4ebc-9d34-c6e1e15485af tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:10.141674 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ce025d0c-a5db-4ebc-9d34-c6e1e15485af tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:10.147502 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ce025d0c-a5db-4ebc-9d34-c6e1e15485af tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 200 len: 1887 microversion: 2.32 time: 1.043670 Sep 08 10:51:10.151087 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1523/3052] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:51:09 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 1887 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:51:10.160116 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-bf4c7928-a8b1-4577-bc81-7b93d9a3f26b req-eb9e6cfd-3a29-4284-b685-a8e7f64d4846 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c34cf01-2cbf-4cf8-ad8f-d3c8f2c7c66f", "name": "network-vif-deleted", "tag": "1c319e61-bdae-43af-9d9c-cedf56fc05d4"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:51:10.184012 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-bf4c7928-a8b1-4577-bc81-7b93d9a3f26b req-eb9e6cfd-3a29-4284-b685-a8e7f64d4846 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:10.187097 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-bf4c7928-a8b1-4577-bc81-7b93d9a3f26b req-eb9e6cfd-3a29-4284-b685-a8e7f64d4846 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:10.190195 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-bf4c7928-a8b1-4577-bc81-7b93d9a3f26b req-eb9e6cfd-3a29-4284-b685-a8e7f64d4846 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:10.220409 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-bf4c7928-a8b1-4577-bc81-7b93d9a3f26b req-eb9e6cfd-3a29-4284-b685-a8e7f64d4846 service nova] Creating event network-vif-deleted:1c319e61-bdae-43af-9d9c-cedf56fc05d4 for instance 2c34cf01-2cbf-4cf8-ad8f-d3c8f2c7c66f on n-h1-850501-12 Sep 08 10:51:10.230329 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-bf4c7928-a8b1-4577-bc81-7b93d9a3f26b req-eb9e6cfd-3a29-4284-b685-a8e7f64d4846 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077555 Sep 08 10:51:10.234298 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1524/3053] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:51:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:51:10.241109 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-adb8fb5b-a2e1-4cf0-b0d3-ce8156bf294e tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:10.242350 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-adb8fb5b-a2e1-4cf0-b0d3-ce8156bf294e tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] [instance: 2c34cf01-2cbf-4cf8-ad8f-d3c8f2c7c66f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:10.249644 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-adb8fb5b-a2e1-4cf0-b0d3-ce8156bf294e tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:10.254865 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-adb8fb5b-a2e1-4cf0-b0d3-ce8156bf294e tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:10.258043 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-adb8fb5b-a2e1-4cf0-b0d3-ce8156bf294e tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:10.262469 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-adb8fb5b-a2e1-4cf0-b0d3-ce8156bf294e tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:10.268946 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-adb8fb5b-a2e1-4cf0-b0d3-ce8156bf294e tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:10.269626 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-adb8fb5b-a2e1-4cf0-b0d3-ce8156bf294e tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:10.357435 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-adb8fb5b-a2e1-4cf0-b0d3-ce8156bf294e tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:10.360515 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-adb8fb5b-a2e1-4cf0-b0d3-ce8156bf294e tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:10.361560 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-adb8fb5b-a2e1-4cf0-b0d3-ce8156bf294e tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:10.363334 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-adb8fb5b-a2e1-4cf0-b0d3-ce8156bf294e tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lazy-loading 'fault' on Instance uuid 2c34cf01-2cbf-4cf8-ad8f-d3c8f2c7c66f {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:51:10.680269 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-adb8fb5b-a2e1-4cf0-b0d3-ce8156bf294e tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0c66b5a004df886b3d973a978c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc5f459e4a143d1b8bf1c5c64153644', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:10.694836 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-adb8fb5b-a2e1-4cf0-b0d3-ce8156bf294e tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] 10.222.0.27 "GET /compute/v2.1/servers/2c34cf01-2cbf-4cf8-ad8f-d3c8f2c7c66f" status: 200 len: 1308 microversion: 2.1 time: 0.454421 Sep 08 10:51:10.699835 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1525/3054] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:10 2022] GET /compute/v2.1/servers/2c34cf01-2cbf-4cf8-ad8f-d3c8f2c7c66f => generated 1308 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:10.714766 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c96a9bd9-abfc-4378-a153-47477703ccc1 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:10.718639 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c96a9bd9-abfc-4378-a153-47477703ccc1 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:10.741657 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c96a9bd9-abfc-4378-a153-47477703ccc1 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:10.746787 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c96a9bd9-abfc-4378-a153-47477703ccc1 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:10.748724 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c96a9bd9-abfc-4378-a153-47477703ccc1 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:10.751474 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c96a9bd9-abfc-4378-a153-47477703ccc1 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:10.756290 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c96a9bd9-abfc-4378-a153-47477703ccc1 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:10.760629 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c96a9bd9-abfc-4378-a153-47477703ccc1 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:10.780417 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4cb3d0ae-4277-4622-90d1-97822ada2af6 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5947a1de1e44d87a601b5b5c8c2f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181f4b3ff01740feb60d5b50056874cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:10.796344 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4cb3d0ae-4277-4622-90d1-97822ada2af6 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5947a1de1e44d87a601b5b5c8c2f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181f4b3ff01740feb60d5b50056874cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:10.799480 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4cb3d0ae-4277-4622-90d1-97822ada2af6 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5947a1de1e44d87a601b5b5c8c2f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181f4b3ff01740feb60d5b50056874cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:10.800810 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4cb3d0ae-4277-4622-90d1-97822ada2af6 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] 10.222.0.27 "GET /compute/v2.1/servers/e2f8b261-f29f-494e-a4f0-b37d8618f625" status: 200 len: 1358 microversion: 2.21 time: 0.860209 Sep 08 10:51:10.825075 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1530/3055] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:51:09 2022] GET /compute/v2.1/servers/e2f8b261-f29f-494e-a4f0-b37d8618f625 => generated 1358 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:51:10.825075 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-315db09a-b898-4020-ab2d-d3b2c300ca41 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:10.825075 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-315db09a-b898-4020-ab2d-d3b2c300ca41 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: 13b25df0-d58e-4da2-bcea-6dac80800bab] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:10.844567 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-315db09a-b898-4020-ab2d-d3b2c300ca41 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:10.845560 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-315db09a-b898-4020-ab2d-d3b2c300ca41 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:10.846183 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-315db09a-b898-4020-ab2d-d3b2c300ca41 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:10.847089 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-315db09a-b898-4020-ab2d-d3b2c300ca41 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:10.847802 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-315db09a-b898-4020-ab2d-d3b2c300ca41 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:10.848249 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-315db09a-b898-4020-ab2d-d3b2c300ca41 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:10.883506 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-315db09a-b898-4020-ab2d-d3b2c300ca41 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] HTTP exception thrown: Instance 13b25df0-d58e-4da2-bcea-6dac80800bab could not be found. Sep 08 10:51:10.885182 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-315db09a-b898-4020-ab2d-d3b2c300ca41 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Request method failure captured: Sep 08 10:51:10.885182 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/13b25df0-d58e-4da2-bcea-6dac80800bab HTTP/1.1 Sep 08 10:51:10.885182 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:51:10.885182 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:51:10.885182 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:51:10.885182 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:51:10.885182 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:51:10.885182 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:51:10.885182 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:51:10.885182 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:51:10.885182 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcjivLUY-NOpubj4piWQUE4YdjVoieEQ-G0L0ay9l2jNqBIueJ_eB4w8-Iohm-hEbdImfT6Vv0CotgGIogaerBRfcTAAw-NhjLbx2EjcqsYLMFxCPLjOPfzXaEWWRNcumoyYDLdNDrrGczsG7GBIlwK26oqS5wWNAPkM7DBSBKGgOFQ Sep 08 10:51:10.885182 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:51:10.885182 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:51:10.885182 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:51:10.885182 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:51:10.885182 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:51:10.885182 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:51:10.885182 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 50c3752f739b47a296a5b88948fe7f7f Sep 08 10:51:10.885182 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1836029851 Sep 08 10:51:10.885182 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:51:10.885182 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:51:10.885182 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/50c3752f739b47a296a5b88948fe7f7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/50c3752f739b47a296a5b88948fe7f7f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_50c3752f739b47a296a5b88948fe7f7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/50c3752f739b47a296a5b88948fe7f7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:51:10.885182 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1836029851 Sep 08 10:51:10.885182 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 50c3752f739b47a296a5b88948fe7f7f Sep 08 10:51:10.885182 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1836029851 Sep 08 10:51:10.885182 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ImagesOneServerNegativeTestJSON-1836029851-project Sep 08 10:51:10.885182 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:51:10.885182 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:51:10.885182 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 7c86e8bd6f9048ce8718f432e51128a5 Sep 08 10:51:10.885182 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1836029851-project Sep 08 10:51:10.885182 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:51:10.885182 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 13b25df0-d58e-4da2-bcea-6dac80800bab could not be found. Sep 08 10:51:10.885182 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '13b25df0-d58e-4da2-bcea-6dac80800bab'} Sep 08 10:51:10.885182 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:51:10.885182 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:51:10.885182 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:51:10.885182 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:51:10.885182 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:51:10.885182 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:51:10.885182 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:51:10.885182 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:51:10.885182 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:51:10.885182 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:51:10.885182 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13b25df0-d58e-4da2-bcea-6dac80800bab could not be found. Sep 08 10:51:10.885182 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:51:10.885182 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:51:10.885182 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:51:10.885182 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:51:10.885182 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:51:10.885182 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:51:10.885182 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:51:10.885182 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:51:10.885182 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:51:10.885182 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:51:10.885182 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:51:10.885182 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:51:10.885182 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:51:10.885182 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:51:10.885182 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:51:10.885182 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:51:10.885182 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13b25df0-d58e-4da2-bcea-6dac80800bab could not be found. Sep 08 10:51:10.885182 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:51:10.885182 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:51:10.889879 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:51:10.889879 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:51:10.889879 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:51:10.889879 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:51:10.889879 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:51:10.889879 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:51:10.889879 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13b25df0-d58e-4da2-bcea-6dac80800bab could not be found. Sep 08 10:51:10.889879 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:51:10.889879 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-315db09a-b898-4020-ab2d-d3b2c300ca41 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Returning 404 to user: Instance 13b25df0-d58e-4da2-bcea-6dac80800bab could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:51:10.889879 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-315db09a-b898-4020-ab2d-d3b2c300ca41 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "GET /compute/v2.1/servers/13b25df0-d58e-4da2-bcea-6dac80800bab" status: 404 len: 111 microversion: 2.1 time: 0.074219 Sep 08 10:51:10.895251 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1531/3056] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:10 2022] GET /compute/v2.1/servers/13b25df0-d58e-4da2-bcea-6dac80800bab => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:51:10.900473 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-c07732da-c1bc-41db-82d2-8203c71bdb05 req-6d22f30c-aa62-48b0-b7fb-b57b2fac4dfb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98277784-8e48-4a7b-8786-ce579e1d5ccf", "tag": "7dc4a9a8-b4a5-45bf-bf54-5e5e0cd4d54b"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:51:10.915247 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c07732da-c1bc-41db-82d2-8203c71bdb05 req-6d22f30c-aa62-48b0-b7fb-b57b2fac4dfb service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:10.916215 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c07732da-c1bc-41db-82d2-8203c71bdb05 req-6d22f30c-aa62-48b0-b7fb-b57b2fac4dfb service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:10.917170 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c07732da-c1bc-41db-82d2-8203c71bdb05 req-6d22f30c-aa62-48b0-b7fb-b57b2fac4dfb service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:10.947849 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-c07732da-c1bc-41db-82d2-8203c71bdb05 req-6d22f30c-aa62-48b0-b7fb-b57b2fac4dfb service nova] Creating event network-changed:7dc4a9a8-b4a5-45bf-bf54-5e5e0cd4d54b for instance 98277784-8e48-4a7b-8786-ce579e1d5ccf on n-h2-850501-12 Sep 08 10:51:10.957129 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-c07732da-c1bc-41db-82d2-8203c71bdb05 req-6d22f30c-aa62-48b0-b7fb-b57b2fac4dfb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060270 Sep 08 10:51:10.958571 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1532/3057] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:51:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:51:10.994818 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3ad0c462-8166-4883-aa84-b899705c978b tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Action: 'create', calling method: .version_select at 0x7f68e425c790>, body: {"keypair": {"name": "tempest-keypair-626763933", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJl0Coa53vZUNr9jvVhIMOh96RTrt3nM90Ugi75sld83EwbBVBCvKAs63RoKtskzUhNAT1xl3Cvipcp+oEFZ7vBPLq0UOqhOc3FfHQYieHyTrz6nEOH8Obn3TeAzZ5Ja4Q=="}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:51:11.048507 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-3ad0c462-8166-4883-aa84-b899705c978b tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Getting quotas for project 50c3752f739b47a296a5b88948fe7f7f. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:51:11.078530 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-3ad0c462-8166-4883-aa84-b899705c978b tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Getting quotas for user 7c86e8bd6f9048ce8718f432e51128a5 and project 50c3752f739b47a296a5b88948fe7f7f. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:51:11.129491 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c96a9bd9-abfc-4378-a153-47477703ccc1 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:11.139846 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c96a9bd9-abfc-4378-a153-47477703ccc1 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:11.143253 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3ad0c462-8166-4883-aa84-b899705c978b tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.161132 Sep 08 10:51:11.153723 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c96a9bd9-abfc-4378-a153-47477703ccc1 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:11.156198 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1533/3058] 10.222.0.27 () {60 vars in 1159 bytes} [Thu Sep 8 10:51:10 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:51:11.166481 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6540e1a6-989d-440e-8e57-f48abcadec74 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Calling method '.version_select at 0x7f68e4263430>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:11.175322 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c96a9bd9-abfc-4378-a153-47477703ccc1 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1560 microversion: 2.91 time: 0.473960 Sep 08 10:51:11.195355 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1526/3059] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:51:10 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1560 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:51:11.216560 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-43a4a5f5-43b0-4135-9984-b63b911a587a tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:11.219775 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-43a4a5f5-43b0-4135-9984-b63b911a587a tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:11.231448 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-43a4a5f5-43b0-4135-9984-b63b911a587a tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:11.232250 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-43a4a5f5-43b0-4135-9984-b63b911a587a tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:11.234180 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-43a4a5f5-43b0-4135-9984-b63b911a587a tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:11.236852 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-43a4a5f5-43b0-4135-9984-b63b911a587a tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:11.237732 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-43a4a5f5-43b0-4135-9984-b63b911a587a tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:11.238455 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-43a4a5f5-43b0-4135-9984-b63b911a587a tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:11.299430 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6540e1a6-989d-440e-8e57-f48abcadec74 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] 10.222.0.27 "GET /compute/v2.1/images/d1109835-85cb-4a9f-996a-3ab19278e978" status: 200 len: 1422 microversion: 2.1 time: 0.137190 Sep 08 10:51:11.300872 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1534/3060] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:51:11 2022] GET /compute/v2.1/images/d1109835-85cb-4a9f-996a-3ab19278e978 => generated 1422 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:11.743133 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9fa5932b-5845-41cd-af21-7ab71d9a106d tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:11.745741 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9fa5932b-5845-41cd-af21-7ab71d9a106d tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] [instance: 2c34cf01-2cbf-4cf8-ad8f-d3c8f2c7c66f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:11.775453 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9fa5932b-5845-41cd-af21-7ab71d9a106d tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:11.776443 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9fa5932b-5845-41cd-af21-7ab71d9a106d tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:11.777513 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9fa5932b-5845-41cd-af21-7ab71d9a106d tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:11.779099 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9fa5932b-5845-41cd-af21-7ab71d9a106d tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:11.783088 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9fa5932b-5845-41cd-af21-7ab71d9a106d tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:11.793195 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9fa5932b-5845-41cd-af21-7ab71d9a106d tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:11.841351 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-9fa5932b-5845-41cd-af21-7ab71d9a106d tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] HTTP exception thrown: Instance 2c34cf01-2cbf-4cf8-ad8f-d3c8f2c7c66f could not be found. Sep 08 10:51:11.845276 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9fa5932b-5845-41cd-af21-7ab71d9a106d tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Request method failure captured: Sep 08 10:51:11.845276 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/2c34cf01-2cbf-4cf8-ad8f-d3c8f2c7c66f HTTP/1.1 Sep 08 10:51:11.845276 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:51:11.845276 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:51:11.845276 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:51:11.845276 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:51:11.845276 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:51:11.845276 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:51:11.845276 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:51:11.845276 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:51:11.845276 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGci5QyHAQE6P6WEvYGK4b8ZqzRN-2gl_ewgJb8yGqON7T0IdqvsZ2FWeT54ilK-uX889hvOmBy0OAjxDFmav3LOHZavcHwckWH4l8LR1Omma7vusvj4eZ16lpYyx10HfgWeUrFD4pV2O9kvw-RnV2-sYHFtZ5YVmtvsxOHXXRx1IGuE Sep 08 10:51:11.845276 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:51:11.845276 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:51:11.845276 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:51:11.845276 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:51:11.845276 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:51:11.845276 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:51:11.845276 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 7bc5f459e4a143d1b8bf1c5c64153644 Sep 08 10:51:11.845276 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-MultipleCreateTestJSON-1231480370 Sep 08 10:51:11.845276 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:51:11.845276 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:51:11.845276 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7bc5f459e4a143d1b8bf1c5c64153644"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7bc5f459e4a143d1b8bf1c5c64153644"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7bc5f459e4a143d1b8bf1c5c64153644"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7bc5f459e4a143d1b8bf1c5c64153644"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:51:11.845276 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-MultipleCreateTestJSON-1231480370 Sep 08 10:51:11.845276 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 7bc5f459e4a143d1b8bf1c5c64153644 Sep 08 10:51:11.845276 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1231480370 Sep 08 10:51:11.845276 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-MultipleCreateTestJSON-1231480370-project Sep 08 10:51:11.845276 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:51:11.845276 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:51:11.845276 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 53c0c66b5a004df886b3d973a978c132 Sep 08 10:51:11.845276 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-MultipleCreateTestJSON-1231480370-project Sep 08 10:51:11.845276 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:51:11.845276 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 2c34cf01-2cbf-4cf8-ad8f-d3c8f2c7c66f could not be found. Sep 08 10:51:11.845276 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '2c34cf01-2cbf-4cf8-ad8f-d3c8f2c7c66f'} Sep 08 10:51:11.845276 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:51:11.845276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:51:11.845276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:51:11.845276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:51:11.845276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:51:11.845276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:51:11.845276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:51:11.845276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:51:11.845276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:51:11.845276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:51:11.845276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c34cf01-2cbf-4cf8-ad8f-d3c8f2c7c66f could not be found. Sep 08 10:51:11.845276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:51:11.845276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:51:11.845276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:51:11.845276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:51:11.845276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:51:11.845276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:51:11.845276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:51:11.845276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:51:11.845276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:51:11.845276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:51:11.845276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:51:11.845276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:51:11.845276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:51:11.845276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:51:11.845276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:51:11.845276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:51:11.845276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c34cf01-2cbf-4cf8-ad8f-d3c8f2c7c66f could not be found. Sep 08 10:51:11.845276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:51:11.845276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:51:11.845276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:51:11.852949 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:51:11.852949 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:51:11.852949 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:51:11.852949 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:51:11.852949 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:51:11.852949 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c34cf01-2cbf-4cf8-ad8f-d3c8f2c7c66f could not be found. Sep 08 10:51:11.852949 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:51:11.855039 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9fa5932b-5845-41cd-af21-7ab71d9a106d tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] Returning 404 to user: Instance 2c34cf01-2cbf-4cf8-ad8f-d3c8f2c7c66f could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:51:11.856168 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9fa5932b-5845-41cd-af21-7ab71d9a106d tempest-MultipleCreateTestJSON-1231480370 tempest-MultipleCreateTestJSON-1231480370-project] 10.222.0.27 "GET /compute/v2.1/servers/2c34cf01-2cbf-4cf8-ad8f-d3c8f2c7c66f" status: 404 len: 111 microversion: 2.1 time: 0.119920 Sep 08 10:51:11.863367 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1535/3061] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:11 2022] GET /compute/v2.1/servers/2c34cf01-2cbf-4cf8-ad8f-d3c8f2c7c66f => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:51:11.871690 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8902721c-8269-411a-ba22-7003b67aadaf tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:11.882063 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8902721c-8269-411a-ba22-7003b67aadaf tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] [instance: e2f8b261-f29f-494e-a4f0-b37d8618f625] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:11.888733 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8902721c-8269-411a-ba22-7003b67aadaf tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:11.889580 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8902721c-8269-411a-ba22-7003b67aadaf tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:11.890221 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8902721c-8269-411a-ba22-7003b67aadaf tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:11.899527 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8902721c-8269-411a-ba22-7003b67aadaf tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:11.900232 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8902721c-8269-411a-ba22-7003b67aadaf tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:11.900850 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8902721c-8269-411a-ba22-7003b67aadaf tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:11.922886 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-43a4a5f5-43b0-4135-9984-b63b911a587a tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:11.960464 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-43a4a5f5-43b0-4135-9984-b63b911a587a tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:11.970401 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-43a4a5f5-43b0-4135-9984-b63b911a587a tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:11.972648 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-43a4a5f5-43b0-4135-9984-b63b911a587a tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 200 len: 1887 microversion: 2.32 time: 0.773750 Sep 08 10:51:11.992211 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1527/3062] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:51:11 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 1887 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:51:12.230314 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6ae9a133-b8bd-43d0-988f-8cb99562403d tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:12.232726 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6ae9a133-b8bd-43d0-988f-8cb99562403d tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:12.251465 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6ae9a133-b8bd-43d0-988f-8cb99562403d tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:12.252396 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6ae9a133-b8bd-43d0-988f-8cb99562403d tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:12.253425 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6ae9a133-b8bd-43d0-988f-8cb99562403d tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:12.254641 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6ae9a133-b8bd-43d0-988f-8cb99562403d tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:12.255418 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6ae9a133-b8bd-43d0-988f-8cb99562403d tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:12.257096 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6ae9a133-b8bd-43d0-988f-8cb99562403d tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:12.319902 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8902721c-8269-411a-ba22-7003b67aadaf tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5947a1de1e44d87a601b5b5c8c2f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181f4b3ff01740feb60d5b50056874cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:12.346628 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8902721c-8269-411a-ba22-7003b67aadaf tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5947a1de1e44d87a601b5b5c8c2f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181f4b3ff01740feb60d5b50056874cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:12.348182 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8902721c-8269-411a-ba22-7003b67aadaf tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5947a1de1e44d87a601b5b5c8c2f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181f4b3ff01740feb60d5b50056874cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:12.361991 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8902721c-8269-411a-ba22-7003b67aadaf tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] 10.222.0.27 "GET /compute/v2.1/servers/e2f8b261-f29f-494e-a4f0-b37d8618f625" status: 200 len: 1358 microversion: 2.21 time: 0.497061 Sep 08 10:51:12.363674 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1536/3063] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:51:11 2022] GET /compute/v2.1/servers/e2f8b261-f29f-494e-a4f0-b37d8618f625 => generated 1358 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:51:12.369113 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-c74c9b63-3a9f-42ff-bc3f-408834a899e7 req-e386433b-601c-40e5-b2dc-254f6a7a6629 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2f8b261-f29f-494e-a4f0-b37d8618f625", "tag": "6823ef05-9226-42ff-bd4e-2f670c18dccc"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:51:12.392626 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c74c9b63-3a9f-42ff-bc3f-408834a899e7 req-e386433b-601c-40e5-b2dc-254f6a7a6629 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:12.393993 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c74c9b63-3a9f-42ff-bc3f-408834a899e7 req-e386433b-601c-40e5-b2dc-254f6a7a6629 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:12.395148 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c74c9b63-3a9f-42ff-bc3f-408834a899e7 req-e386433b-601c-40e5-b2dc-254f6a7a6629 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:12.427454 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-c74c9b63-3a9f-42ff-bc3f-408834a899e7 req-e386433b-601c-40e5-b2dc-254f6a7a6629 service nova] Creating event network-changed:6823ef05-9226-42ff-bd4e-2f670c18dccc for instance e2f8b261-f29f-494e-a4f0-b37d8618f625 on n-h2-850501-12 Sep 08 10:51:12.438965 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-c74c9b63-3a9f-42ff-bc3f-408834a899e7 req-e386433b-601c-40e5-b2dc-254f6a7a6629 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072199 Sep 08 10:51:12.441101 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1537/3064] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:51:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:51:12.452677 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fdaeb2ba-5932-4b05-9855-0b8f804efd30 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Calling method '.version_select at 0x7f68e440d670>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:12.568823 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fdaeb2ba-5932-4b05-9855-0b8f804efd30 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] 10.222.0.27 "GET /compute/v2.1/images/d1109835-85cb-4a9f-996a-3ab19278e978" status: 200 len: 1422 microversion: 2.1 time: 0.124530 Sep 08 10:51:12.579205 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1538/3065] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:51:12 2022] GET /compute/v2.1/images/d1109835-85cb-4a9f-996a-3ab19278e978 => generated 1422 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:12.598287 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6ae9a133-b8bd-43d0-988f-8cb99562403d tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:12.625254 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6ae9a133-b8bd-43d0-988f-8cb99562403d tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:12.627883 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6ae9a133-b8bd-43d0-988f-8cb99562403d tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:12.642530 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6ae9a133-b8bd-43d0-988f-8cb99562403d tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1560 microversion: 2.91 time: 0.417856 Sep 08 10:51:12.646008 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1528/3066] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:51:12 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1560 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:51:12.758350 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ec7bb18f-c315-48f9-b139-29ad896691bc tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:12.762672 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ec7bb18f-c315-48f9-b139-29ad896691bc tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] [instance: e522775b-9d4f-4fee-beaa-61e1b0452ead] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:12.802596 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec7bb18f-c315-48f9-b139-29ad896691bc tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:12.803614 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec7bb18f-c315-48f9-b139-29ad896691bc tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:12.804175 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec7bb18f-c315-48f9-b139-29ad896691bc tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:12.805371 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec7bb18f-c315-48f9-b139-29ad896691bc tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:12.821528 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec7bb18f-c315-48f9-b139-29ad896691bc tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:12.822055 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec7bb18f-c315-48f9-b139-29ad896691bc tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:12.884457 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ec7bb18f-c315-48f9-b139-29ad896691bc tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] [instance: e522775b-9d4f-4fee-beaa-61e1b0452ead] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:51:13.006424 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-de3aba7e-6271-4837-b3c5-12b2993fdbbf req-3d61c85a-10d8-489e-90e1-eedc1808fb36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98277784-8e48-4a7b-8786-ce579e1d5ccf", "tag": "c559d837-313a-4f2e-8c4a-0410f4b4fafd"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:51:13.048019 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-de3aba7e-6271-4837-b3c5-12b2993fdbbf req-3d61c85a-10d8-489e-90e1-eedc1808fb36 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:13.048790 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-de3aba7e-6271-4837-b3c5-12b2993fdbbf req-3d61c85a-10d8-489e-90e1-eedc1808fb36 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:13.049767 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-de3aba7e-6271-4837-b3c5-12b2993fdbbf req-3d61c85a-10d8-489e-90e1-eedc1808fb36 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:13.069451 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-de3aba7e-6271-4837-b3c5-12b2993fdbbf req-3d61c85a-10d8-489e-90e1-eedc1808fb36 service nova] Creating event network-changed:c559d837-313a-4f2e-8c4a-0410f4b4fafd for instance 98277784-8e48-4a7b-8786-ce579e1d5ccf on n-h2-850501-12 Sep 08 10:51:13.075639 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-de3aba7e-6271-4837-b3c5-12b2993fdbbf req-3d61c85a-10d8-489e-90e1-eedc1808fb36 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076719 Sep 08 10:51:13.078956 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1529/3067] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:51:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:51:13.090094 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6c1dce45-e2f2-421e-91c3-a1febf3e0579 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:13.091332 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6c1dce45-e2f2-421e-91c3-a1febf3e0579 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:13.112564 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ec7bb18f-c315-48f9-b139-29ad896691bc tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e522775b-9d4f-4fee-beaa-61e1b0452ead" status: 204 len: 0 microversion: 2.1 time: 0.365203 Sep 08 10:51:13.118606 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6c1dce45-e2f2-421e-91c3-a1febf3e0579 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:13.120442 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1539/3068] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:51:12 2022] DELETE /compute/v2.1/servers/e522775b-9d4f-4fee-beaa-61e1b0452ead => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:51:13.121730 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6c1dce45-e2f2-421e-91c3-a1febf3e0579 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:13.124742 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6c1dce45-e2f2-421e-91c3-a1febf3e0579 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:13.127669 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6c1dce45-e2f2-421e-91c3-a1febf3e0579 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:13.130915 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6c1dce45-e2f2-421e-91c3-a1febf3e0579 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:13.132097 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6c1dce45-e2f2-421e-91c3-a1febf3e0579 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:13.147467 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1aaf31f7-173d-465f-9e1c-5adaad682197 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:13.154726 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1aaf31f7-173d-465f-9e1c-5adaad682197 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] [instance: e522775b-9d4f-4fee-beaa-61e1b0452ead] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:13.169573 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1aaf31f7-173d-465f-9e1c-5adaad682197 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:13.170452 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1aaf31f7-173d-465f-9e1c-5adaad682197 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:13.171234 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1aaf31f7-173d-465f-9e1c-5adaad682197 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:13.174201 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1aaf31f7-173d-465f-9e1c-5adaad682197 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:13.175505 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1aaf31f7-173d-465f-9e1c-5adaad682197 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:13.176554 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1aaf31f7-173d-465f-9e1c-5adaad682197 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:13.622707 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6c1dce45-e2f2-421e-91c3-a1febf3e0579 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:13.638120 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6c1dce45-e2f2-421e-91c3-a1febf3e0579 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:13.645907 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6c1dce45-e2f2-421e-91c3-a1febf3e0579 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:13.647397 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6c1dce45-e2f2-421e-91c3-a1febf3e0579 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 200 len: 1887 microversion: 2.32 time: 0.565722 Sep 08 10:51:13.649520 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1530/3069] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:51:13 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 1887 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:51:13.657724 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-533f94a0-b50b-42da-8a0a-d386e438455e tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:13.663775 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-533f94a0-b50b-42da-8a0a-d386e438455e tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] [instance: e2f8b261-f29f-494e-a4f0-b37d8618f625] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:13.681593 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-533f94a0-b50b-42da-8a0a-d386e438455e tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:13.687035 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-533f94a0-b50b-42da-8a0a-d386e438455e tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:13.689868 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-533f94a0-b50b-42da-8a0a-d386e438455e tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:13.690906 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-533f94a0-b50b-42da-8a0a-d386e438455e tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:13.694685 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-533f94a0-b50b-42da-8a0a-d386e438455e tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:13.695506 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-533f94a0-b50b-42da-8a0a-d386e438455e tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:13.860588 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1aaf31f7-173d-465f-9e1c-5adaad682197 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f58dabb2db74cedba25f856ad1a7df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63eba712ae82439ba53b37b774c332dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:13.881778 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1aaf31f7-173d-465f-9e1c-5adaad682197 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] 10.222.0.27 "GET /compute/v2.1/servers/e522775b-9d4f-4fee-beaa-61e1b0452ead" status: 200 len: 1664 microversion: 2.1 time: 0.753694 Sep 08 10:51:13.883269 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1540/3070] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:13 2022] GET /compute/v2.1/servers/e522775b-9d4f-4fee-beaa-61e1b0452ead => generated 1664 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:13.888692 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5428a5e3-fbbc-456a-a448-42fd20bd0f40 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Calling method '.version_select at 0x7f68e4563940>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:13.958027 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5428a5e3-fbbc-456a-a448-42fd20bd0f40 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] 10.222.0.27 "GET /compute/v2.1/images/d1109835-85cb-4a9f-996a-3ab19278e978" status: 200 len: 1431 microversion: 2.1 time: 0.073612 Sep 08 10:51:13.970053 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1541/3071] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:51:13 2022] GET /compute/v2.1/images/d1109835-85cb-4a9f-996a-3ab19278e978 => generated 1431 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:13.975516 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-519bcf3d-90ed-41e4-9bf0-a5515515721e tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:13.976061 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-519bcf3d-90ed-41e4-9bf0-a5515515721e tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:13.983201 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-519bcf3d-90ed-41e4-9bf0-a5515515721e tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:13.983668 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-519bcf3d-90ed-41e4-9bf0-a5515515721e tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:13.984119 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-519bcf3d-90ed-41e4-9bf0-a5515515721e tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:13.984905 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-519bcf3d-90ed-41e4-9bf0-a5515515721e tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:13.985422 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-519bcf3d-90ed-41e4-9bf0-a5515515721e tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:13.985858 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-519bcf3d-90ed-41e4-9bf0-a5515515721e tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:14.146848 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-519bcf3d-90ed-41e4-9bf0-a5515515721e tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:14.164502 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-519bcf3d-90ed-41e4-9bf0-a5515515721e tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:14.166625 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-519bcf3d-90ed-41e4-9bf0-a5515515721e tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:14.181636 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-519bcf3d-90ed-41e4-9bf0-a5515515721e tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1560 microversion: 2.91 time: 0.210014 Sep 08 10:51:14.182557 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1542/3072] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:51:13 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1560 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:51:14.187473 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c31266f7-76a9-42e5-bb99-91ce00c212b4 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Calling method '.version_select at 0x7f68e4246940>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:14.244184 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c31266f7-76a9-42e5-bb99-91ce00c212b4 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] 10.222.0.27 "GET /compute/v2.1/images/d1109835-85cb-4a9f-996a-3ab19278e978" status: 200 len: 1431 microversion: 2.1 time: 0.060333 Sep 08 10:51:14.255090 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1543/3073] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:51:14 2022] GET /compute/v2.1/images/d1109835-85cb-4a9f-996a-3ab19278e978 => generated 1431 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:14.260601 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b57e24c9-c902-4286-a710-d8896abfb948 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:14.261699 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b57e24c9-c902-4286-a710-d8896abfb948 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] [instance: 9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:14.269532 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b57e24c9-c902-4286-a710-d8896abfb948 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:14.270579 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b57e24c9-c902-4286-a710-d8896abfb948 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:14.271329 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b57e24c9-c902-4286-a710-d8896abfb948 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:14.272374 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b57e24c9-c902-4286-a710-d8896abfb948 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:14.273147 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b57e24c9-c902-4286-a710-d8896abfb948 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:14.273835 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b57e24c9-c902-4286-a710-d8896abfb948 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:14.583590 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b57e24c9-c902-4286-a710-d8896abfb948 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db1b83d2b924ed4855ebe9360c9b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8737f6bb9629491d958debd24aa6f9a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:14.599878 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b57e24c9-c902-4286-a710-d8896abfb948 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] 10.222.0.27 "GET /compute/v2.1/servers/9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf" status: 200 len: 1479 microversion: 2.1 time: 0.343003 Sep 08 10:51:14.603737 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1544/3074] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:14 2022] GET /compute/v2.1/servers/9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf => generated 1479 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:14.686216 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a0189b20-2458-4efc-80ca-2f914531bf2f tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:14.687203 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a0189b20-2458-4efc-80ca-2f914531bf2f tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:14.710224 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a0189b20-2458-4efc-80ca-2f914531bf2f tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:14.715368 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a0189b20-2458-4efc-80ca-2f914531bf2f tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:14.716061 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a0189b20-2458-4efc-80ca-2f914531bf2f tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:14.717882 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a0189b20-2458-4efc-80ca-2f914531bf2f tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:14.718609 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-533f94a0-b50b-42da-8a0a-d386e438455e tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5947a1de1e44d87a601b5b5c8c2f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181f4b3ff01740feb60d5b50056874cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:14.720595 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a0189b20-2458-4efc-80ca-2f914531bf2f tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:14.722916 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a0189b20-2458-4efc-80ca-2f914531bf2f tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:14.740190 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-533f94a0-b50b-42da-8a0a-d386e438455e tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5947a1de1e44d87a601b5b5c8c2f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181f4b3ff01740feb60d5b50056874cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:14.745198 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-533f94a0-b50b-42da-8a0a-d386e438455e tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5947a1de1e44d87a601b5b5c8c2f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181f4b3ff01740feb60d5b50056874cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:14.747137 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-533f94a0-b50b-42da-8a0a-d386e438455e tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] 10.222.0.27 "GET /compute/v2.1/servers/e2f8b261-f29f-494e-a4f0-b37d8618f625" status: 200 len: 1358 microversion: 2.21 time: 1.096187 Sep 08 10:51:14.747712 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1531/3075] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:51:13 2022] GET /compute/v2.1/servers/e2f8b261-f29f-494e-a4f0-b37d8618f625 => generated 1358 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:51:14.918594 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8f03e388-bf9d-43cc-b648-706c2c28b9f4 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:14.919248 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8f03e388-bf9d-43cc-b648-706c2c28b9f4 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] [instance: e522775b-9d4f-4fee-beaa-61e1b0452ead] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:14.941015 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f03e388-bf9d-43cc-b648-706c2c28b9f4 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:14.942060 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f03e388-bf9d-43cc-b648-706c2c28b9f4 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:14.942675 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f03e388-bf9d-43cc-b648-706c2c28b9f4 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:14.943592 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f03e388-bf9d-43cc-b648-706c2c28b9f4 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:14.944289 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f03e388-bf9d-43cc-b648-706c2c28b9f4 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:14.944723 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f03e388-bf9d-43cc-b648-706c2c28b9f4 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:15.394621 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a0189b20-2458-4efc-80ca-2f914531bf2f tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:15.410070 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a0189b20-2458-4efc-80ca-2f914531bf2f tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:15.419829 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a0189b20-2458-4efc-80ca-2f914531bf2f tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:15.421426 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a0189b20-2458-4efc-80ca-2f914531bf2f tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 200 len: 1887 microversion: 2.32 time: 0.739386 Sep 08 10:51:15.433089 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1545/3076] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:51:14 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 1887 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:51:15.433089 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6a5e5a0c-4fe4-4087-9a64-b7c0d4973d56 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:15.441324 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6a5e5a0c-4fe4-4087-9a64-b7c0d4973d56 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:15.450373 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a5e5a0c-4fe4-4087-9a64-b7c0d4973d56 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:15.450876 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a5e5a0c-4fe4-4087-9a64-b7c0d4973d56 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:15.451344 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a5e5a0c-4fe4-4087-9a64-b7c0d4973d56 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:15.452081 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a5e5a0c-4fe4-4087-9a64-b7c0d4973d56 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:15.460436 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a5e5a0c-4fe4-4087-9a64-b7c0d4973d56 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:15.461358 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a5e5a0c-4fe4-4087-9a64-b7c0d4973d56 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:15.591001 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6a5e5a0c-4fe4-4087-9a64-b7c0d4973d56 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:15.602275 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6a5e5a0c-4fe4-4087-9a64-b7c0d4973d56 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:15.604302 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6a5e5a0c-4fe4-4087-9a64-b7c0d4973d56 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:15.610237 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6a5e5a0c-4fe4-4087-9a64-b7c0d4973d56 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1560 microversion: 2.91 time: 0.183058 Sep 08 10:51:15.611283 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1546/3077] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:51:15 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1560 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:51:15.633201 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4911d3c8-bfa5-4bf7-a0dc-f31d8c4ab4b2 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:15.639521 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4911d3c8-bfa5-4bf7-a0dc-f31d8c4ab4b2 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] [instance: 9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:15.655751 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4911d3c8-bfa5-4bf7-a0dc-f31d8c4ab4b2 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:15.655751 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4911d3c8-bfa5-4bf7-a0dc-f31d8c4ab4b2 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:15.655751 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4911d3c8-bfa5-4bf7-a0dc-f31d8c4ab4b2 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:15.655751 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4911d3c8-bfa5-4bf7-a0dc-f31d8c4ab4b2 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:15.655751 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4911d3c8-bfa5-4bf7-a0dc-f31d8c4ab4b2 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:15.655751 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4911d3c8-bfa5-4bf7-a0dc-f31d8c4ab4b2 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:15.706244 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8f03e388-bf9d-43cc-b648-706c2c28b9f4 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f58dabb2db74cedba25f856ad1a7df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63eba712ae82439ba53b37b774c332dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:15.721538 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8f03e388-bf9d-43cc-b648-706c2c28b9f4 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] 10.222.0.27 "GET /compute/v2.1/servers/e522775b-9d4f-4fee-beaa-61e1b0452ead" status: 200 len: 1664 microversion: 2.1 time: 0.805578 Sep 08 10:51:15.723054 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1532/3078] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:14 2022] GET /compute/v2.1/servers/e522775b-9d4f-4fee-beaa-61e1b0452ead => generated 1664 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:51:15.780219 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c0fda28c-5cbd-48e1-8ff3-7845e9ad2dc9 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:15.782730 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c0fda28c-5cbd-48e1-8ff3-7845e9ad2dc9 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] [instance: e2f8b261-f29f-494e-a4f0-b37d8618f625] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:15.799758 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c0fda28c-5cbd-48e1-8ff3-7845e9ad2dc9 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:15.800625 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c0fda28c-5cbd-48e1-8ff3-7845e9ad2dc9 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:15.801246 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c0fda28c-5cbd-48e1-8ff3-7845e9ad2dc9 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:15.805968 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c0fda28c-5cbd-48e1-8ff3-7845e9ad2dc9 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:15.806552 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c0fda28c-5cbd-48e1-8ff3-7845e9ad2dc9 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:15.807282 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c0fda28c-5cbd-48e1-8ff3-7845e9ad2dc9 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:16.083041 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4911d3c8-bfa5-4bf7-a0dc-f31d8c4ab4b2 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db1b83d2b924ed4855ebe9360c9b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8737f6bb9629491d958debd24aa6f9a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:16.100266 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4911d3c8-bfa5-4bf7-a0dc-f31d8c4ab4b2 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] 10.222.0.27 "GET /compute/v2.1/servers/9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf" status: 200 len: 1466 microversion: 2.1 time: 0.469811 Sep 08 10:51:16.101248 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1547/3079] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:15 2022] GET /compute/v2.1/servers/9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf => generated 1466 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:16.128657 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a2c2285b-f51d-4244-baff-9f9698efafb0 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Calling method '.version_select at 0x7f68e4389700>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:16.216098 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a2c2285b-f51d-4244-baff-9f9698efafb0 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] 10.222.0.27 "GET /compute/v2.1/images/503f4a0f-e18f-47fd-ad12-0289e3463117" status: 200 len: 784 microversion: 2.1 time: 0.094071 Sep 08 10:51:16.217200 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1548/3080] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:51:16 2022] GET /compute/v2.1/images/503f4a0f-e18f-47fd-ad12-0289e3463117 => generated 784 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:51:16.228828 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-be674ad5-49ac-4089-999e-85e7e9508bff tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1406513116", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:51:16.254639 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c0fda28c-5cbd-48e1-8ff3-7845e9ad2dc9 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5947a1de1e44d87a601b5b5c8c2f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181f4b3ff01740feb60d5b50056874cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:16.270705 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c0fda28c-5cbd-48e1-8ff3-7845e9ad2dc9 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5947a1de1e44d87a601b5b5c8c2f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181f4b3ff01740feb60d5b50056874cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:16.272798 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c0fda28c-5cbd-48e1-8ff3-7845e9ad2dc9 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5947a1de1e44d87a601b5b5c8c2f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181f4b3ff01740feb60d5b50056874cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:16.273557 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c0fda28c-5cbd-48e1-8ff3-7845e9ad2dc9 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] 10.222.0.27 "GET /compute/v2.1/servers/e2f8b261-f29f-494e-a4f0-b37d8618f625" status: 200 len: 1358 microversion: 2.21 time: 0.501153 Sep 08 10:51:16.274121 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1533/3081] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:51:15 2022] GET /compute/v2.1/servers/e2f8b261-f29f-494e-a4f0-b37d8618f625 => generated 1358 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:51:16.282748 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a6b9820f-a1ab-464b-a387-f46e1605206f tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:16.291981 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a6b9820f-a1ab-464b-a387-f46e1605206f tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016605 Sep 08 10:51:16.301968 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1534/3082] 10.222.0.27 () {58 vars in 1137 bytes} [Thu Sep 8 10:51:16 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:51:16.307701 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-320427d7-03d0-4cbc-b2e2-7bf2977cbb16 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Calling method '.version_select at 0x7f68e45d0160>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:16.326476 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-be674ad5-49ac-4089-999e-85e7e9508bff tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] validate_networks() for [('741076e7-778f-402b-9838-e16de110a735', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:51:17.016639 n-d-850501-12 devstack@n-api.service[128861]: Exception ignored in: . at 0x7f68e4533ee0> Sep 08 10:51:17.016639 n-d-850501-12 devstack@n-api.service[128861]: Traceback (most recent call last): Sep 08 10:51:17.016639 n-d-850501-12 devstack@n-api.service[128861]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 488, in Sep 08 10:51:17.021138 n-d-850501-12 devstack@n-api.service[128861]: and _finalize_fairy(None, rec, pool, ref, echo, True), Sep 08 10:51:17.021138 n-d-850501-12 devstack@n-api.service[128861]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 774, in _finalize_fairy Sep 08 10:51:17.035590 n-d-850501-12 devstack@n-api.service[128861]: connection_record.checkin() Sep 08 10:51:17.035590 n-d-850501-12 devstack@n-api.service[128861]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 521, in checkin Sep 08 10:51:17.036335 n-d-850501-12 devstack@n-api.service[128861]: pool.dispatch.checkin(connection, self) Sep 08 10:51:17.036607 n-d-850501-12 devstack@n-api.service[128861]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/event/attr.py", line 343, in __call__ Sep 08 10:51:17.039591 n-d-850501-12 devstack@n-api.service[128861]: fn(*args, **kw) Sep 08 10:51:17.039591 n-d-850501-12 devstack@n-api.service[128861]: File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py", line 51, in _thread_yield Sep 08 10:51:17.042076 n-d-850501-12 devstack@n-api.service[128861]: time.sleep(0) Sep 08 10:51:17.042076 n-d-850501-12 devstack@n-api.service[128861]: File "/usr/local/lib/python3.8/dist-packages/eventlet/greenthread.py", line 33, in sleep Sep 08 10:51:17.045495 n-d-850501-12 devstack@n-api.service[128861]: assert hub.greenlet is not current, 'do not call blocking functions from the mainloop' Sep 08 10:51:17.045495 n-d-850501-12 devstack@n-api.service[128861]: AssertionError: do not call blocking functions from the mainloop Sep 08 10:51:17.332749 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-320427d7-03d0-4cbc-b2e2-7bf2977cbb16 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] 10.222.0.27 "DELETE /compute/v2.1/images/d1109835-85cb-4a9f-996a-3ab19278e978" status: 204 len: 0 microversion: 2.1 time: 1.029201 Sep 08 10:51:17.333473 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1535/3083] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:16 2022] DELETE /compute/v2.1/images/d1109835-85cb-4a9f-996a-3ab19278e978 => generated 0 bytes in 1031 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:51:17.339714 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0a8b2418-1c9c-48f1-9471-ff5387d7799c tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:17.340633 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0a8b2418-1c9c-48f1-9471-ff5387d7799c tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:17.360188 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0a8b2418-1c9c-48f1-9471-ff5387d7799c tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:17.361234 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0a8b2418-1c9c-48f1-9471-ff5387d7799c tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:17.362400 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0a8b2418-1c9c-48f1-9471-ff5387d7799c tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:17.363905 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0a8b2418-1c9c-48f1-9471-ff5387d7799c tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:17.366980 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0a8b2418-1c9c-48f1-9471-ff5387d7799c tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:17.367747 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0a8b2418-1c9c-48f1-9471-ff5387d7799c tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:17.453705 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-be674ad5-49ac-4089-999e-85e7e9508bff tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:51:17.454472 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-be674ad5-49ac-4089-999e-85e7e9508bff tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:51:17.454697 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-be674ad5-49ac-4089-999e-85e7e9508bff tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:51:17.455316 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-be674ad5-49ac-4089-999e-85e7e9508bff tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:51:17.455964 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-be674ad5-49ac-4089-999e-85e7e9508bff tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:51:17.478664 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-be674ad5-49ac-4089-999e-85e7e9508bff tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:17.479189 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-be674ad5-49ac-4089-999e-85e7e9508bff tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:17.479857 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-be674ad5-49ac-4089-999e-85e7e9508bff tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:17.480817 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-be674ad5-49ac-4089-999e-85e7e9508bff tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:17.481559 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-be674ad5-49ac-4089-999e-85e7e9508bff tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:17.482955 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-be674ad5-49ac-4089-999e-85e7e9508bff tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:17.515174 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-be674ad5-49ac-4089-999e-85e7e9508bff tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Getting quotas for project 50c3752f739b47a296a5b88948fe7f7f. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:51:17.528412 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-be674ad5-49ac-4089-999e-85e7e9508bff tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Getting quotas for user 7c86e8bd6f9048ce8718f432e51128a5 and project 50c3752f739b47a296a5b88948fe7f7f. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:51:17.554042 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-be674ad5-49ac-4089-999e-85e7e9508bff tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:51:17.557011 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-be674ad5-49ac-4089-999e-85e7e9508bff tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: d21f2600-ca01-4d47-b1f6-c4e8fa28d571] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:51:17.652945 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-be674ad5-49ac-4089-999e-85e7e9508bff tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.434330 Sep 08 10:51:17.654036 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1549/3084] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:51:16 2022] POST /compute/v2.1/servers => generated 383 bytes in 1436 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:51:17.660515 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b6e0d355-8128-4d40-97bd-1c4699948eab tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:17.661839 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b6e0d355-8128-4d40-97bd-1c4699948eab tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:17.668793 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:51:17.672474 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b6e0d355-8128-4d40-97bd-1c4699948eab tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:17.673368 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b6e0d355-8128-4d40-97bd-1c4699948eab tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:17.674394 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b6e0d355-8128-4d40-97bd-1c4699948eab tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:17.675877 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b6e0d355-8128-4d40-97bd-1c4699948eab tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:17.677862 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b6e0d355-8128-4d40-97bd-1c4699948eab tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:17.678888 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b6e0d355-8128-4d40-97bd-1c4699948eab tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:17.821513 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b6e0d355-8128-4d40-97bd-1c4699948eab tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:17.834617 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b6e0d355-8128-4d40-97bd-1c4699948eab tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:17.839391 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b6e0d355-8128-4d40-97bd-1c4699948eab tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:17.851845 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b6e0d355-8128-4d40-97bd-1c4699948eab tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1555 microversion: 2.91 time: 0.196566 Sep 08 10:51:17.856095 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1550/3085] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:51:17 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1555 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:51:17.862016 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-89a97ed8-d877-4f4b-b30f-100e45bd59b2 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:17.864019 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-89a97ed8-d877-4f4b-b30f-100e45bd59b2 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] [instance: e522775b-9d4f-4fee-beaa-61e1b0452ead] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:17.877890 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89a97ed8-d877-4f4b-b30f-100e45bd59b2 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:17.879479 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89a97ed8-d877-4f4b-b30f-100e45bd59b2 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:17.880263 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89a97ed8-d877-4f4b-b30f-100e45bd59b2 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:17.881436 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89a97ed8-d877-4f4b-b30f-100e45bd59b2 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:17.882289 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89a97ed8-d877-4f4b-b30f-100e45bd59b2 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:17.883133 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89a97ed8-d877-4f4b-b30f-100e45bd59b2 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:18.058586 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-89a97ed8-d877-4f4b-b30f-100e45bd59b2 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f58dabb2db74cedba25f856ad1a7df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63eba712ae82439ba53b37b774c332dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:18.072093 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-89a97ed8-d877-4f4b-b30f-100e45bd59b2 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] 10.222.0.27 "GET /compute/v2.1/servers/e522775b-9d4f-4fee-beaa-61e1b0452ead" status: 200 len: 1597 microversion: 2.1 time: 0.214446 Sep 08 10:51:18.093268 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1551/3086] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:17 2022] GET /compute/v2.1/servers/e522775b-9d4f-4fee-beaa-61e1b0452ead => generated 1597 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:18.104734 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-8863a5ba-18f5-43cc-aa55-0fa2ec850a71 req-af8070b3-bc3d-4583-9e72-46e7afbb803d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98277784-8e48-4a7b-8786-ce579e1d5ccf", "tag": "576874d5-b1a3-4dba-862f-855bbc5a1c03"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:51:18.135521 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-8863a5ba-18f5-43cc-aa55-0fa2ec850a71 req-af8070b3-bc3d-4583-9e72-46e7afbb803d service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:18.136206 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-8863a5ba-18f5-43cc-aa55-0fa2ec850a71 req-af8070b3-bc3d-4583-9e72-46e7afbb803d service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:18.136918 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-8863a5ba-18f5-43cc-aa55-0fa2ec850a71 req-af8070b3-bc3d-4583-9e72-46e7afbb803d service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:18.165758 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-8863a5ba-18f5-43cc-aa55-0fa2ec850a71 req-af8070b3-bc3d-4583-9e72-46e7afbb803d service nova] Creating event network-changed:576874d5-b1a3-4dba-862f-855bbc5a1c03 for instance 98277784-8e48-4a7b-8786-ce579e1d5ccf on n-h2-850501-12 Sep 08 10:51:18.181484 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-8863a5ba-18f5-43cc-aa55-0fa2ec850a71 req-af8070b3-bc3d-4583-9e72-46e7afbb803d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086481 Sep 08 10:51:18.182972 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1552/3087] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:51:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:51:18.190152 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-93cc35d3-1ecb-41ac-aa8f-e4c9f6701b57 req-f2dc0435-f75e-43f4-8ec0-9da720a60c84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2f8b261-f29f-494e-a4f0-b37d8618f625", "name": "network-vif-plugged", "status": "completed", "tag": "6823ef05-9226-42ff-bd4e-2f670c18dccc"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:51:18.250462 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-93cc35d3-1ecb-41ac-aa8f-e4c9f6701b57 req-f2dc0435-f75e-43f4-8ec0-9da720a60c84 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:18.253122 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-93cc35d3-1ecb-41ac-aa8f-e4c9f6701b57 req-f2dc0435-f75e-43f4-8ec0-9da720a60c84 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:18.254094 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-93cc35d3-1ecb-41ac-aa8f-e4c9f6701b57 req-f2dc0435-f75e-43f4-8ec0-9da720a60c84 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:18.297892 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-93cc35d3-1ecb-41ac-aa8f-e4c9f6701b57 req-f2dc0435-f75e-43f4-8ec0-9da720a60c84 service nova] Creating event network-vif-plugged:6823ef05-9226-42ff-bd4e-2f670c18dccc for instance e2f8b261-f29f-494e-a4f0-b37d8618f625 on n-h2-850501-12 Sep 08 10:51:18.314382 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-93cc35d3-1ecb-41ac-aa8f-e4c9f6701b57 req-f2dc0435-f75e-43f4-8ec0-9da720a60c84 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127395 Sep 08 10:51:18.315324 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1553/3088] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:51:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:51:18.336948 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-aef26d70-1c7f-4a1f-a1e9-f8d36aa5f6cb tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:18.350229 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-aef26d70-1c7f-4a1f-a1e9-f8d36aa5f6cb tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] [instance: e2f8b261-f29f-494e-a4f0-b37d8618f625] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:18.363252 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aef26d70-1c7f-4a1f-a1e9-f8d36aa5f6cb tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:18.364263 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aef26d70-1c7f-4a1f-a1e9-f8d36aa5f6cb tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:18.364940 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aef26d70-1c7f-4a1f-a1e9-f8d36aa5f6cb tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:18.366112 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aef26d70-1c7f-4a1f-a1e9-f8d36aa5f6cb tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:18.367226 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aef26d70-1c7f-4a1f-a1e9-f8d36aa5f6cb tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:18.369267 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aef26d70-1c7f-4a1f-a1e9-f8d36aa5f6cb tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:18.398737 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:51:18.671286 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-aef26d70-1c7f-4a1f-a1e9-f8d36aa5f6cb tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5947a1de1e44d87a601b5b5c8c2f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181f4b3ff01740feb60d5b50056874cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:18.697970 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-aef26d70-1c7f-4a1f-a1e9-f8d36aa5f6cb tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5947a1de1e44d87a601b5b5c8c2f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181f4b3ff01740feb60d5b50056874cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:18.699820 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-aef26d70-1c7f-4a1f-a1e9-f8d36aa5f6cb tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5947a1de1e44d87a601b5b5c8c2f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181f4b3ff01740feb60d5b50056874cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:18.701001 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-aef26d70-1c7f-4a1f-a1e9-f8d36aa5f6cb tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] 10.222.0.27 "GET /compute/v2.1/servers/e2f8b261-f29f-494e-a4f0-b37d8618f625" status: 200 len: 1358 microversion: 2.21 time: 0.382118 Sep 08 10:51:18.708226 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1554/3089] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:51:18 2022] GET /compute/v2.1/servers/e2f8b261-f29f-494e-a4f0-b37d8618f625 => generated 1358 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:51:18.731031 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a7104d89-cfaf-4e33-b4df-0ea00f388e35 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Calling method '.version_select at 0x7f68e4246310>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:18.810119 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-a7104d89-cfaf-4e33-b4df-0ea00f388e35 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] HTTP exception thrown: Image not found. Sep 08 10:51:18.812926 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a7104d89-cfaf-4e33-b4df-0ea00f388e35 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Request method failure captured: Sep 08 10:51:18.812926 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/images/d1109835-85cb-4a9f-996a-3ab19278e978 HTTP/1.1 Sep 08 10:51:18.812926 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:51:18.812926 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:51:18.812926 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:51:18.812926 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:51:18.812926 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:51:18.812926 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:51:18.812926 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:51:18.812926 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:51:18.812926 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcjYZIt1uNuRIgcAxc17hT-7_F4OQhq8mc-vzCnhcNF7Hw1wzFQCr_vxJcZL7j-6ItUQnZdAIeDxJfxIvfp_52ifnYKHiSrG_upsONHIGGtyLNgr94RPtS9RN6dTo9us_evPqy4o600qo_vyrVbFF0TdSXMjkzyjvGZImEShKSKyCIk Sep 08 10:51:18.812926 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:51:18.812926 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:51:18.812926 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:51:18.812926 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:51:18.812926 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:51:18.812926 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:51:18.812926 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 8737f6bb9629491d958debd24aa6f9a0 Sep 08 10:51:18.812926 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ImagesOneServerTestJSON-965155818 Sep 08 10:51:18.812926 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:51:18.812926 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:51:18.812926 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8737f6bb9629491d958debd24aa6f9a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8737f6bb9629491d958debd24aa6f9a0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8737f6bb9629491d958debd24aa6f9a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8737f6bb9629491d958debd24aa6f9a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:51:18.812926 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ImagesOneServerTestJSON-965155818 Sep 08 10:51:18.812926 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 8737f6bb9629491d958debd24aa6f9a0 Sep 08 10:51:18.812926 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-965155818 Sep 08 10:51:18.812926 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ImagesOneServerTestJSON-965155818-project Sep 08 10:51:18.812926 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:51:18.812926 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:51:18.812926 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 3db1b83d2b924ed4855ebe9360c9b46f Sep 08 10:51:18.812926 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ImagesOneServerTestJSON-965155818-project Sep 08 10:51:18.812926 n-d-850501-12 devstack@n-api.service[128862]: method: Sep 08 10:51:18.812926 n-d-850501-12 devstack@n-api.service[128862]: exception: Image not found. Sep 08 10:51:18.812926 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'd1109835-85cb-4a9f-996a-3ab19278e978'} Sep 08 10:51:18.812926 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:51:18.812926 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:51:18.812926 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 08 10:51:18.812926 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 08 10:51:18.812926 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 10:51:18.812926 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 10:51:18.812926 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 08 10:51:18.812926 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 08 10:51:18.812926 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 10:51:18.812926 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 10:51:18.812926 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 08 10:51:18.812926 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 08 10:51:18.812926 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 08 10:51:18.812926 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 08 10:51:18.812926 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 10:51:18.812926 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 10:51:18.812926 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 10:51:18.812926 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 10:51:18.812926 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID d1109835-85cb-4a9f-996a-3ab19278e978 Sep 08 10:51:18.812926 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:51:18.812926 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:51:18.812926 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:51:18.812926 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:51:18.812926 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 08 10:51:18.812926 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 08 10:51:18.812926 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 08 10:51:18.812926 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 08 10:51:18.812926 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 08 10:51:18.812926 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 08 10:51:18.812926 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 08 10:51:18.820342 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 08 10:51:18.820342 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 08 10:51:18.820342 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 08 10:51:18.820342 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 10:51:18.820342 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 10:51:18.820342 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 08 10:51:18.820342 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 08 10:51:18.820342 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 10:51:18.820342 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 10:51:18.820342 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 08 10:51:18.820342 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 08 10:51:18.820342 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 08 10:51:18.820342 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 08 10:51:18.820342 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 10:51:18.820342 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 10:51:18.820342 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 10:51:18.820342 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 10:51:18.820342 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d1109835-85cb-4a9f-996a-3ab19278e978 could not be found. Sep 08 10:51:18.820342 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:51:18.820342 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:51:18.820342 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:51:18.820342 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:51:18.820342 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:51:18.820342 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:51:18.820342 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:51:18.820342 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:51:18.820342 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:51:18.820342 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:51:18.820342 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:51:18.820342 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:51:18.820342 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 08 10:51:18.820342 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 08 10:51:18.820342 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 08 10:51:18.820342 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:51:18.820342 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:51:18.820342 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:51:18.820342 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:51:18.820342 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:51:18.820342 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:51:18.820342 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:51:18.820342 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:51:18.820342 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 08 10:51:18.820342 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:51:18.820342 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a7104d89-cfaf-4e33-b4df-0ea00f388e35 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Returning 404 to user: Image not found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:51:18.820342 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a7104d89-cfaf-4e33-b4df-0ea00f388e35 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] 10.222.0.27 "GET /compute/v2.1/images/d1109835-85cb-4a9f-996a-3ab19278e978" status: 404 len: 62 microversion: 2.1 time: 0.105396 Sep 08 10:51:18.830873 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1555/3090] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:51:18 2022] GET /compute/v2.1/images/d1109835-85cb-4a9f-996a-3ab19278e978 => generated 62 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:51:18.851996 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f02a0b57-9777-42f0-97ab-b9122c76c797 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:18.852788 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f02a0b57-9777-42f0-97ab-b9122c76c797 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: d21f2600-ca01-4d47-b1f6-c4e8fa28d571] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:18.899559 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f02a0b57-9777-42f0-97ab-b9122c76c797 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:18.899868 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f02a0b57-9777-42f0-97ab-b9122c76c797 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:18.900303 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f02a0b57-9777-42f0-97ab-b9122c76c797 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:18.909187 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f02a0b57-9777-42f0-97ab-b9122c76c797 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:18.910465 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f02a0b57-9777-42f0-97ab-b9122c76c797 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:18.911093 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f02a0b57-9777-42f0-97ab-b9122c76c797 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:19.068215 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0a8b2418-1c9c-48f1-9471-ff5387d7799c tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:19.089143 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f02a0b57-9777-42f0-97ab-b9122c76c797 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86e8bd6f9048ce8718f432e51128a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c3752f739b47a296a5b88948fe7f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:19.101103 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0a8b2418-1c9c-48f1-9471-ff5387d7799c tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:19.104936 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f02a0b57-9777-42f0-97ab-b9122c76c797 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "GET /compute/v2.1/servers/d21f2600-ca01-4d47-b1f6-c4e8fa28d571" status: 200 len: 1221 microversion: 2.1 time: 0.277633 Sep 08 10:51:19.105742 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1556/3091] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:18 2022] GET /compute/v2.1/servers/d21f2600-ca01-4d47-b1f6-c4e8fa28d571 => generated 1221 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:19.111328 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-5f957252-4525-474a-83bb-e7c3e4ee7045 req-b59cf4d8-d591-4176-b04d-fd4a2f9f79aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e522775b-9d4f-4fee-beaa-61e1b0452ead", "name": "network-vif-deleted", "tag": "002ad59a-75f1-4c84-828c-d70e98fdeb3a"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:51:19.117468 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0a8b2418-1c9c-48f1-9471-ff5387d7799c tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:19.118937 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0a8b2418-1c9c-48f1-9471-ff5387d7799c tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 200 len: 1875 microversion: 2.32 time: 1.784155 Sep 08 10:51:19.152607 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1536/3092] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:51:17 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 1875 bytes in 1799 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:51:19.172333 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4e9421fa-8da9-4471-917f-3709d6d616cb tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-220593212"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:51:19.193524 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4e9421fa-8da9-4471-917f-3709d6d616cb tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] [instance: 9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:19.207919 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4e9421fa-8da9-4471-917f-3709d6d616cb tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:19.208777 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-5f957252-4525-474a-83bb-e7c3e4ee7045 req-b59cf4d8-d591-4176-b04d-fd4a2f9f79aa service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:19.210429 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-5f957252-4525-474a-83bb-e7c3e4ee7045 req-b59cf4d8-d591-4176-b04d-fd4a2f9f79aa service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:19.210904 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-5f957252-4525-474a-83bb-e7c3e4ee7045 req-b59cf4d8-d591-4176-b04d-fd4a2f9f79aa service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:19.211527 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4e9421fa-8da9-4471-917f-3709d6d616cb tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:19.212241 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4e9421fa-8da9-4471-917f-3709d6d616cb tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:19.214754 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4e9421fa-8da9-4471-917f-3709d6d616cb tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:19.218531 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4e9421fa-8da9-4471-917f-3709d6d616cb tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:19.219862 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4e9421fa-8da9-4471-917f-3709d6d616cb tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:19.256959 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-5f957252-4525-474a-83bb-e7c3e4ee7045 req-b59cf4d8-d591-4176-b04d-fd4a2f9f79aa service nova] Creating event network-vif-deleted:002ad59a-75f1-4c84-828c-d70e98fdeb3a for instance e522775b-9d4f-4fee-beaa-61e1b0452ead on n-h1-850501-12 Sep 08 10:51:19.274581 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-5f957252-4525-474a-83bb-e7c3e4ee7045 req-b59cf4d8-d591-4176-b04d-fd4a2f9f79aa service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167484 Sep 08 10:51:19.278823 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1557/3093] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:51:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:51:19.291358 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-83c3a433-ef12-457f-81be-a04da30c2535 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:19.299104 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-83c3a433-ef12-457f-81be-a04da30c2535 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:19.312990 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-83c3a433-ef12-457f-81be-a04da30c2535 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:19.316792 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-83c3a433-ef12-457f-81be-a04da30c2535 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:19.317592 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-83c3a433-ef12-457f-81be-a04da30c2535 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:19.318735 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-83c3a433-ef12-457f-81be-a04da30c2535 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:19.319472 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-83c3a433-ef12-457f-81be-a04da30c2535 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:19.320172 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-83c3a433-ef12-457f-81be-a04da30c2535 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:19.596037 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-83c3a433-ef12-457f-81be-a04da30c2535 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:19.613423 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-83c3a433-ef12-457f-81be-a04da30c2535 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:19.638370 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-83c3a433-ef12-457f-81be-a04da30c2535 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:19.670707 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-83c3a433-ef12-457f-81be-a04da30c2535 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1555 microversion: 2.91 time: 0.389664 Sep 08 10:51:19.676625 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1558/3094] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:51:19 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1555 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:51:19.694995 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1243f808-4d62-4ea7-b00e-6e84598bb85c tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:19.697241 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1243f808-4d62-4ea7-b00e-6e84598bb85c tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] [instance: e522775b-9d4f-4fee-beaa-61e1b0452ead] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:19.726518 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1243f808-4d62-4ea7-b00e-6e84598bb85c tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:19.734957 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1243f808-4d62-4ea7-b00e-6e84598bb85c tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:19.735862 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1243f808-4d62-4ea7-b00e-6e84598bb85c tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:19.738594 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1243f808-4d62-4ea7-b00e-6e84598bb85c tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:19.739583 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1243f808-4d62-4ea7-b00e-6e84598bb85c tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:19.740895 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1243f808-4d62-4ea7-b00e-6e84598bb85c tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:19.751638 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4e9421fa-8da9-4471-917f-3709d6d616cb tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] 10.222.0.27 "POST /compute/v2.1/servers/9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf/action" status: 202 len: 0 microversion: 2.1 time: 0.597426 Sep 08 10:51:19.753893 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1537/3095] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:51:19 2022] POST /compute/v2.1/servers/9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf/action => generated 0 bytes in 601 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 08 10:51:19.760363 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-930c5e03-e825-48ea-95a1-c65320701255 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:19.762182 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-930c5e03-e825-48ea-95a1-c65320701255 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] [instance: e2f8b261-f29f-494e-a4f0-b37d8618f625] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:19.771464 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-930c5e03-e825-48ea-95a1-c65320701255 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:19.772338 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-930c5e03-e825-48ea-95a1-c65320701255 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:19.773607 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-930c5e03-e825-48ea-95a1-c65320701255 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:19.774725 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-930c5e03-e825-48ea-95a1-c65320701255 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:19.775734 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-930c5e03-e825-48ea-95a1-c65320701255 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:19.776779 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-930c5e03-e825-48ea-95a1-c65320701255 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:19.908558 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1243f808-4d62-4ea7-b00e-6e84598bb85c tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:19.917341 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1243f808-4d62-4ea7-b00e-6e84598bb85c tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:19.917341 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1243f808-4d62-4ea7-b00e-6e84598bb85c tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:19.917341 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-1243f808-4d62-4ea7-b00e-6e84598bb85c tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lazy-loading 'fault' on Instance uuid e522775b-9d4f-4fee-beaa-61e1b0452ead {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:51:20.085181 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1243f808-4d62-4ea7-b00e-6e84598bb85c tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f58dabb2db74cedba25f856ad1a7df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63eba712ae82439ba53b37b774c332dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:20.099566 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1243f808-4d62-4ea7-b00e-6e84598bb85c tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] 10.222.0.27 "GET /compute/v2.1/servers/e522775b-9d4f-4fee-beaa-61e1b0452ead" status: 200 len: 1316 microversion: 2.1 time: 0.416457 Sep 08 10:51:20.115535 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1559/3096] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:19 2022] GET /compute/v2.1/servers/e522775b-9d4f-4fee-beaa-61e1b0452ead => generated 1316 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:20.139967 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7244604d-8cda-425a-b128-5fa1be56c94c tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Calling method '.version_select at 0x7f68e4241040>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:20.293901 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7244604d-8cda-425a-b128-5fa1be56c94c tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] 10.222.0.27 "GET /compute/v2.1/images/8e1292c9-d905-432c-8f62-957946f8cb15" status: 200 len: 1426 microversion: 2.1 time: 0.169606 Sep 08 10:51:20.294541 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1560/3097] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:51:20 2022] GET /compute/v2.1/images/8e1292c9-d905-432c-8f62-957946f8cb15 => generated 1426 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:20.320709 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d000034a-fd49-46b6-ba29-d3767133cca1 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:20.328251 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d000034a-fd49-46b6-ba29-d3767133cca1 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: d21f2600-ca01-4d47-b1f6-c4e8fa28d571] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:20.350886 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d000034a-fd49-46b6-ba29-d3767133cca1 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:20.351879 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d000034a-fd49-46b6-ba29-d3767133cca1 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:20.352433 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d000034a-fd49-46b6-ba29-d3767133cca1 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:20.353367 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d000034a-fd49-46b6-ba29-d3767133cca1 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:20.355778 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d000034a-fd49-46b6-ba29-d3767133cca1 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:20.358105 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d000034a-fd49-46b6-ba29-d3767133cca1 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:20.558415 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d000034a-fd49-46b6-ba29-d3767133cca1 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86e8bd6f9048ce8718f432e51128a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c3752f739b47a296a5b88948fe7f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:20.592419 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d000034a-fd49-46b6-ba29-d3767133cca1 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "GET /compute/v2.1/servers/d21f2600-ca01-4d47-b1f6-c4e8fa28d571" status: 200 len: 1277 microversion: 2.1 time: 0.293235 Sep 08 10:51:20.604687 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1561/3098] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:20 2022] GET /compute/v2.1/servers/d21f2600-ca01-4d47-b1f6-c4e8fa28d571 => generated 1277 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:20.627796 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6ee5b0a7-c0c5-4e81-af8e-15c128a57db4 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:20.629130 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6ee5b0a7-c0c5-4e81-af8e-15c128a57db4 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:20.648636 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ee5b0a7-c0c5-4e81-af8e-15c128a57db4 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:20.649530 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ee5b0a7-c0c5-4e81-af8e-15c128a57db4 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:20.650310 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ee5b0a7-c0c5-4e81-af8e-15c128a57db4 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:20.651201 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ee5b0a7-c0c5-4e81-af8e-15c128a57db4 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:20.651758 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ee5b0a7-c0c5-4e81-af8e-15c128a57db4 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:20.652297 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ee5b0a7-c0c5-4e81-af8e-15c128a57db4 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:21.008327 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-930c5e03-e825-48ea-95a1-c65320701255 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5947a1de1e44d87a601b5b5c8c2f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181f4b3ff01740feb60d5b50056874cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:21.032660 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-930c5e03-e825-48ea-95a1-c65320701255 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5947a1de1e44d87a601b5b5c8c2f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181f4b3ff01740feb60d5b50056874cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:21.034597 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-930c5e03-e825-48ea-95a1-c65320701255 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5947a1de1e44d87a601b5b5c8c2f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181f4b3ff01740feb60d5b50056874cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:21.035898 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-930c5e03-e825-48ea-95a1-c65320701255 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] 10.222.0.27 "GET /compute/v2.1/servers/e2f8b261-f29f-494e-a4f0-b37d8618f625" status: 200 len: 1358 microversion: 2.21 time: 1.280593 Sep 08 10:51:21.036720 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1538/3099] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:51:19 2022] GET /compute/v2.1/servers/e2f8b261-f29f-494e-a4f0-b37d8618f625 => generated 1358 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:51:21.060515 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-d5b3e9f6-0bdd-454a-926e-59ce026d58a0 req-254177cd-ec1f-44e6-aa09-9e9d5679c592 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98277784-8e48-4a7b-8786-ce579e1d5ccf", "tag": "ce9f8d6e-a5be-4a31-a377-ae93ebd5bedc"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:51:21.101366 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-d5b3e9f6-0bdd-454a-926e-59ce026d58a0 req-254177cd-ec1f-44e6-aa09-9e9d5679c592 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:21.101929 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-d5b3e9f6-0bdd-454a-926e-59ce026d58a0 req-254177cd-ec1f-44e6-aa09-9e9d5679c592 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:21.102390 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-d5b3e9f6-0bdd-454a-926e-59ce026d58a0 req-254177cd-ec1f-44e6-aa09-9e9d5679c592 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:21.143302 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-d5b3e9f6-0bdd-454a-926e-59ce026d58a0 req-254177cd-ec1f-44e6-aa09-9e9d5679c592 service nova] Creating event network-changed:ce9f8d6e-a5be-4a31-a377-ae93ebd5bedc for instance 98277784-8e48-4a7b-8786-ce579e1d5ccf on n-h2-850501-12 Sep 08 10:51:21.179250 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-d5b3e9f6-0bdd-454a-926e-59ce026d58a0 req-254177cd-ec1f-44e6-aa09-9e9d5679c592 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127295 Sep 08 10:51:21.180780 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1539/3100] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:51:21.210770 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-dd4fd6a2-f93c-401a-96ec-f992b6609631 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:21.216101 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-dd4fd6a2-f93c-401a-96ec-f992b6609631 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:21.279312 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd4fd6a2-f93c-401a-96ec-f992b6609631 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:21.284455 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd4fd6a2-f93c-401a-96ec-f992b6609631 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:21.286897 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd4fd6a2-f93c-401a-96ec-f992b6609631 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:21.288348 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd4fd6a2-f93c-401a-96ec-f992b6609631 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:21.289148 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd4fd6a2-f93c-401a-96ec-f992b6609631 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:21.289974 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd4fd6a2-f93c-401a-96ec-f992b6609631 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:21.498873 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-dd4fd6a2-f93c-401a-96ec-f992b6609631 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:21.511734 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:51:21.558525 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-dd4fd6a2-f93c-401a-96ec-f992b6609631 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:21.564802 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-dd4fd6a2-f93c-401a-96ec-f992b6609631 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:21.575233 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-dd4fd6a2-f93c-401a-96ec-f992b6609631 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1555 microversion: 2.91 time: 0.392704 Sep 08 10:51:21.586629 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1540/3101] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:51:21 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1555 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:51:21.597634 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-9a667544-a2c5-42b9-878e-a0b48487a54a req-aa668671-ab5a-4cd3-a24e-197f3a6c99ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf", "name": "network-vif-unplugged", "status": "completed", "tag": "036e4e77-856c-4b8c-9f28-cff6e87b1645"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:51:21.618656 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-9a667544-a2c5-42b9-878e-a0b48487a54a req-aa668671-ab5a-4cd3-a24e-197f3a6c99ee service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:21.620548 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-9a667544-a2c5-42b9-878e-a0b48487a54a req-aa668671-ab5a-4cd3-a24e-197f3a6c99ee service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:21.622140 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-9a667544-a2c5-42b9-878e-a0b48487a54a req-aa668671-ab5a-4cd3-a24e-197f3a6c99ee service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:21.662725 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-9a667544-a2c5-42b9-878e-a0b48487a54a req-aa668671-ab5a-4cd3-a24e-197f3a6c99ee service nova] Creating event network-vif-unplugged:036e4e77-856c-4b8c-9f28-cff6e87b1645 for instance 9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf on n-h1-850501-12 Sep 08 10:51:21.685915 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-9a667544-a2c5-42b9-878e-a0b48487a54a req-aa668671-ab5a-4cd3-a24e-197f3a6c99ee service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092801 Sep 08 10:51:21.703011 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1541/3102] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:51:21.729557 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b30f0b7c-a30a-4a31-9021-f84c7f392a58 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:21.732810 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b30f0b7c-a30a-4a31-9021-f84c7f392a58 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] [instance: e522775b-9d4f-4fee-beaa-61e1b0452ead] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:21.764095 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b30f0b7c-a30a-4a31-9021-f84c7f392a58 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:21.769428 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b30f0b7c-a30a-4a31-9021-f84c7f392a58 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:21.770485 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b30f0b7c-a30a-4a31-9021-f84c7f392a58 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:21.776642 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b30f0b7c-a30a-4a31-9021-f84c7f392a58 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:21.777985 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b30f0b7c-a30a-4a31-9021-f84c7f392a58 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:21.779015 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b30f0b7c-a30a-4a31-9021-f84c7f392a58 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:21.811617 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-b30f0b7c-a30a-4a31-9021-f84c7f392a58 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] HTTP exception thrown: Instance e522775b-9d4f-4fee-beaa-61e1b0452ead could not be found. Sep 08 10:51:21.822608 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b30f0b7c-a30a-4a31-9021-f84c7f392a58 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Request method failure captured: Sep 08 10:51:21.822608 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/e522775b-9d4f-4fee-beaa-61e1b0452ead HTTP/1.1 Sep 08 10:51:21.822608 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:51:21.822608 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:51:21.822608 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:51:21.822608 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:51:21.822608 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:51:21.822608 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:51:21.822608 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:51:21.822608 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:51:21.822608 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGci6BYMPR_2zjco3MV3t4Abk4llxCdgIVieSj5Brk-83VNe1YdsAC6TFh5l2pvQPJ5JcGZVUXoWqeTslNttceB39u4jJ3QSUllf1O8Ap1WDAAnvm2zaSMvb2uB14GR9mQD6C_Twj-EynvDU8j9-ZHLgl8yMjsUXUgryuMqo-p7uPxBo Sep 08 10:51:21.822608 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:51:21.822608 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:51:21.822608 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:51:21.822608 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:51:21.822608 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:51:21.822608 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:51:21.822608 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 63eba712ae82439ba53b37b774c332dd Sep 08 10:51:21.822608 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServersTestFqdnHostnames-447811748 Sep 08 10:51:21.822608 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:51:21.822608 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:51:21.822608 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/63eba712ae82439ba53b37b774c332dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/63eba712ae82439ba53b37b774c332dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_63eba712ae82439ba53b37b774c332dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/63eba712ae82439ba53b37b774c332dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:51:21.822608 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServersTestFqdnHostnames-447811748 Sep 08 10:51:21.822608 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 63eba712ae82439ba53b37b774c332dd Sep 08 10:51:21.822608 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-447811748 Sep 08 10:51:21.822608 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServersTestFqdnHostnames-447811748-project Sep 08 10:51:21.822608 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:51:21.822608 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:51:21.822608 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 8f58dabb2db74cedba25f856ad1a7df2 Sep 08 10:51:21.822608 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServersTestFqdnHostnames-447811748-project Sep 08 10:51:21.822608 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:51:21.822608 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance e522775b-9d4f-4fee-beaa-61e1b0452ead could not be found. Sep 08 10:51:21.822608 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': 'e522775b-9d4f-4fee-beaa-61e1b0452ead'} Sep 08 10:51:21.822608 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:51:21.822608 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:51:21.822608 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:51:21.822608 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:51:21.822608 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:51:21.822608 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:51:21.822608 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:51:21.822608 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:51:21.822608 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:51:21.822608 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:51:21.822608 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e522775b-9d4f-4fee-beaa-61e1b0452ead could not be found. Sep 08 10:51:21.822608 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:51:21.822608 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:51:21.822608 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:51:21.822608 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:51:21.822608 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:51:21.822608 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:51:21.822608 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:51:21.822608 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:51:21.822608 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:51:21.822608 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:51:21.822608 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:51:21.822608 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:51:21.822608 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:51:21.822608 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:51:21.822608 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:51:21.822608 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:51:21.822608 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e522775b-9d4f-4fee-beaa-61e1b0452ead could not be found. Sep 08 10:51:21.822608 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:51:21.822608 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:51:21.822608 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:51:21.828933 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:51:21.828933 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:51:21.828933 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:51:21.828933 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:51:21.828933 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:51:21.828933 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e522775b-9d4f-4fee-beaa-61e1b0452ead could not be found. Sep 08 10:51:21.828933 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:51:21.838081 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b30f0b7c-a30a-4a31-9021-f84c7f392a58 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Returning 404 to user: Instance e522775b-9d4f-4fee-beaa-61e1b0452ead could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:51:21.846118 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b30f0b7c-a30a-4a31-9021-f84c7f392a58 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] 10.222.0.27 "GET /compute/v2.1/servers/e522775b-9d4f-4fee-beaa-61e1b0452ead" status: 404 len: 111 microversion: 2.1 time: 0.133945 Sep 08 10:51:21.846972 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1542/3103] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:21 2022] GET /compute/v2.1/servers/e522775b-9d4f-4fee-beaa-61e1b0452ead => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:51:21.858076 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f7d142d5-7f00-4545-9321-ff97547b4777 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Calling method '.version_select at 0x7f68e4533280>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:21.972632 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f7d142d5-7f00-4545-9321-ff97547b4777 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] 10.222.0.27 "GET /compute/v2.1/images/8e1292c9-d905-432c-8f62-957946f8cb15" status: 200 len: 1426 microversion: 2.1 time: 0.123893 Sep 08 10:51:21.973620 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1543/3104] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:51:21 2022] GET /compute/v2.1/images/8e1292c9-d905-432c-8f62-957946f8cb15 => generated 1426 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:21.988252 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-492e6f62-b9b4-424e-985a-0067c09c16a0 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:21.992416 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-492e6f62-b9b4-424e-985a-0067c09c16a0 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: d21f2600-ca01-4d47-b1f6-c4e8fa28d571] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:22.018055 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-492e6f62-b9b4-424e-985a-0067c09c16a0 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:22.019137 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-492e6f62-b9b4-424e-985a-0067c09c16a0 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:22.019137 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-492e6f62-b9b4-424e-985a-0067c09c16a0 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:22.019765 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-492e6f62-b9b4-424e-985a-0067c09c16a0 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:22.020224 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-492e6f62-b9b4-424e-985a-0067c09c16a0 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:22.020647 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-492e6f62-b9b4-424e-985a-0067c09c16a0 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:22.143908 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6ee5b0a7-c0c5-4e81-af8e-15c128a57db4 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:22.176658 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6ee5b0a7-c0c5-4e81-af8e-15c128a57db4 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:22.181777 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6ee5b0a7-c0c5-4e81-af8e-15c128a57db4 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:22.185922 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6ee5b0a7-c0c5-4e81-af8e-15c128a57db4 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 200 len: 1875 microversion: 2.32 time: 1.577820 Sep 08 10:51:22.187623 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1562/3105] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:51:20 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 1875 bytes in 1581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:51:22.208753 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-492e6f62-b9b4-424e-985a-0067c09c16a0 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86e8bd6f9048ce8718f432e51128a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c3752f739b47a296a5b88948fe7f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:22.209301 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0766eb2c-4f8e-464e-9e19-0009b6a9ebb3 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] Calling method '.version_select at 0x7f68e440d700>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:22.223761 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-492e6f62-b9b4-424e-985a-0067c09c16a0 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "GET /compute/v2.1/servers/d21f2600-ca01-4d47-b1f6-c4e8fa28d571" status: 200 len: 1283 microversion: 2.1 time: 0.249024 Sep 08 10:51:22.237073 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1544/3106] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:21 2022] GET /compute/v2.1/servers/d21f2600-ca01-4d47-b1f6-c4e8fa28d571 => generated 1283 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:22.237073 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b69b06da-e101-4018-8421-7470a094e54a tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:22.237073 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b69b06da-e101-4018-8421-7470a094e54a tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] [instance: e2f8b261-f29f-494e-a4f0-b37d8618f625] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:22.261217 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b69b06da-e101-4018-8421-7470a094e54a tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:22.261787 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b69b06da-e101-4018-8421-7470a094e54a tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:22.262242 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b69b06da-e101-4018-8421-7470a094e54a tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:22.263940 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b69b06da-e101-4018-8421-7470a094e54a tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:22.264419 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b69b06da-e101-4018-8421-7470a094e54a tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:22.264857 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b69b06da-e101-4018-8421-7470a094e54a tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:22.265446 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0766eb2c-4f8e-464e-9e19-0009b6a9ebb3 tempest-ServersTestFqdnHostnames-447811748 tempest-ServersTestFqdnHostnames-447811748-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1662192616" status: 202 len: 0 microversion: 2.1 time: 0.073745 Sep 08 10:51:22.266354 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1563/3107] 10.222.0.27 () {58 vars in 1221 bytes} [Thu Sep 8 10:51:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1662192616 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:51:22.617816 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b69b06da-e101-4018-8421-7470a094e54a tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5947a1de1e44d87a601b5b5c8c2f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181f4b3ff01740feb60d5b50056874cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:22.629691 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a50fa395-75c9-48c0-80a9-69be8e38fe0a tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:22.631576 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a50fa395-75c9-48c0-80a9-69be8e38fe0a tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:22.634793 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b69b06da-e101-4018-8421-7470a094e54a tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5947a1de1e44d87a601b5b5c8c2f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181f4b3ff01740feb60d5b50056874cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:22.636675 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b69b06da-e101-4018-8421-7470a094e54a tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5947a1de1e44d87a601b5b5c8c2f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181f4b3ff01740feb60d5b50056874cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:22.638270 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b69b06da-e101-4018-8421-7470a094e54a tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] 10.222.0.27 "GET /compute/v2.1/servers/e2f8b261-f29f-494e-a4f0-b37d8618f625" status: 200 len: 1550 microversion: 2.21 time: 0.412486 Sep 08 10:51:22.644311 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1545/3108] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:51:22 2022] GET /compute/v2.1/servers/e2f8b261-f29f-494e-a4f0-b37d8618f625 => generated 1550 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:51:22.653601 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a50fa395-75c9-48c0-80a9-69be8e38fe0a tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:22.654115 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a50fa395-75c9-48c0-80a9-69be8e38fe0a tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:22.654568 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a50fa395-75c9-48c0-80a9-69be8e38fe0a tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:22.664433 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a50fa395-75c9-48c0-80a9-69be8e38fe0a tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:22.664948 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a50fa395-75c9-48c0-80a9-69be8e38fe0a tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:22.665611 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a50fa395-75c9-48c0-80a9-69be8e38fe0a tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:22.674577 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a5ea58fa-dc1c-439b-b3e8-0c18f4a2fcee tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:22.675713 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a5ea58fa-dc1c-439b-b3e8-0c18f4a2fcee tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] [instance: e2f8b261-f29f-494e-a4f0-b37d8618f625] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:22.686292 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a5ea58fa-dc1c-439b-b3e8-0c18f4a2fcee tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:22.687432 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a5ea58fa-dc1c-439b-b3e8-0c18f4a2fcee tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:22.688411 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a5ea58fa-dc1c-439b-b3e8-0c18f4a2fcee tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:22.689885 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a5ea58fa-dc1c-439b-b3e8-0c18f4a2fcee tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:22.690905 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a5ea58fa-dc1c-439b-b3e8-0c18f4a2fcee tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:22.691840 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a5ea58fa-dc1c-439b-b3e8-0c18f4a2fcee tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:22.769008 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a5ea58fa-dc1c-439b-b3e8-0c18f4a2fcee tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] [instance: e2f8b261-f29f-494e-a4f0-b37d8618f625] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:51:23.014361 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a5ea58fa-dc1c-439b-b3e8-0c18f4a2fcee tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e2f8b261-f29f-494e-a4f0-b37d8618f625" status: 204 len: 0 microversion: 2.21 time: 0.345022 Sep 08 10:51:23.016895 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1546/3109] 10.222.0.27 () {60 vars in 1280 bytes} [Thu Sep 8 10:51:22 2022] DELETE /compute/v2.1/servers/e2f8b261-f29f-494e-a4f0-b37d8618f625 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 08 10:51:23.036863 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-81bc0c81-185e-481b-ae7a-8e1fa396bdcd tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Calling method '.version_select at 0x7f68e40cbd30>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:23.051248 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a50fa395-75c9-48c0-80a9-69be8e38fe0a tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:23.070551 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a50fa395-75c9-48c0-80a9-69be8e38fe0a tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:23.072375 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a50fa395-75c9-48c0-80a9-69be8e38fe0a tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:23.088342 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a50fa395-75c9-48c0-80a9-69be8e38fe0a tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1555 microversion: 2.91 time: 0.464189 Sep 08 10:51:23.089692 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1564/3110] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:51:22 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1555 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:51:23.095276 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f5930b3b-3bed-4a67-91ad-9436393d85fe tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:23.096124 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f5930b3b-3bed-4a67-91ad-9436393d85fe tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] [instance: e2f8b261-f29f-494e-a4f0-b37d8618f625] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:23.119284 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f5930b3b-3bed-4a67-91ad-9436393d85fe tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:23.120105 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f5930b3b-3bed-4a67-91ad-9436393d85fe tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:23.120748 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f5930b3b-3bed-4a67-91ad-9436393d85fe tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:23.121734 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f5930b3b-3bed-4a67-91ad-9436393d85fe tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:23.122380 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f5930b3b-3bed-4a67-91ad-9436393d85fe tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:23.122976 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f5930b3b-3bed-4a67-91ad-9436393d85fe tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:23.194887 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-81bc0c81-185e-481b-ae7a-8e1fa396bdcd tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] 10.222.0.27 "GET /compute/v2.1/images/8e1292c9-d905-432c-8f62-957946f8cb15" status: 200 len: 1426 microversion: 2.1 time: 0.174213 Sep 08 10:51:23.195748 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1547/3111] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:51:23 2022] GET /compute/v2.1/images/8e1292c9-d905-432c-8f62-957946f8cb15 => generated 1426 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:23.216950 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-46ec916f-1990-4a2e-8002-64d4dd094b14 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:23.218197 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-46ec916f-1990-4a2e-8002-64d4dd094b14 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:23.232204 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-46ec916f-1990-4a2e-8002-64d4dd094b14 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:23.232722 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-46ec916f-1990-4a2e-8002-64d4dd094b14 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:23.234352 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-46ec916f-1990-4a2e-8002-64d4dd094b14 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:23.235149 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-46ec916f-1990-4a2e-8002-64d4dd094b14 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:23.236038 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-46ec916f-1990-4a2e-8002-64d4dd094b14 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:23.236695 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-46ec916f-1990-4a2e-8002-64d4dd094b14 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:23.546311 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-46ec916f-1990-4a2e-8002-64d4dd094b14 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:23.557427 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-46ec916f-1990-4a2e-8002-64d4dd094b14 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:23.559406 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-46ec916f-1990-4a2e-8002-64d4dd094b14 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:23.560839 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-46ec916f-1990-4a2e-8002-64d4dd094b14 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 200 len: 1875 microversion: 2.32 time: 0.348378 Sep 08 10:51:23.574285 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1548/3112] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:51:23 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 1875 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:51:23.586964 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-60f4d171-1b55-4ad5-9361-758dd917999b tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:23.587857 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-60f4d171-1b55-4ad5-9361-758dd917999b tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: d21f2600-ca01-4d47-b1f6-c4e8fa28d571] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:23.596527 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-60f4d171-1b55-4ad5-9361-758dd917999b tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:23.597519 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-60f4d171-1b55-4ad5-9361-758dd917999b tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:23.598150 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-60f4d171-1b55-4ad5-9361-758dd917999b tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:23.599616 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-60f4d171-1b55-4ad5-9361-758dd917999b tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:23.600247 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-60f4d171-1b55-4ad5-9361-758dd917999b tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:23.600839 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-60f4d171-1b55-4ad5-9361-758dd917999b tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:23.726936 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-60f4d171-1b55-4ad5-9361-758dd917999b tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86e8bd6f9048ce8718f432e51128a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c3752f739b47a296a5b88948fe7f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:23.735645 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-60f4d171-1b55-4ad5-9361-758dd917999b tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "GET /compute/v2.1/servers/d21f2600-ca01-4d47-b1f6-c4e8fa28d571" status: 200 len: 1283 microversion: 2.1 time: 0.160147 Sep 08 10:51:23.736501 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1549/3113] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:23 2022] GET /compute/v2.1/servers/d21f2600-ca01-4d47-b1f6-c4e8fa28d571 => generated 1283 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:23.847525 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f5930b3b-3bed-4a67-91ad-9436393d85fe tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5947a1de1e44d87a601b5b5c8c2f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181f4b3ff01740feb60d5b50056874cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:23.865790 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f5930b3b-3bed-4a67-91ad-9436393d85fe tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5947a1de1e44d87a601b5b5c8c2f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181f4b3ff01740feb60d5b50056874cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:23.868526 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f5930b3b-3bed-4a67-91ad-9436393d85fe tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5947a1de1e44d87a601b5b5c8c2f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181f4b3ff01740feb60d5b50056874cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:23.872092 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f5930b3b-3bed-4a67-91ad-9436393d85fe tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] 10.222.0.27 "GET /compute/v2.1/servers/e2f8b261-f29f-494e-a4f0-b37d8618f625" status: 200 len: 1556 microversion: 2.21 time: 0.779972 Sep 08 10:51:23.874526 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1565/3114] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:51:23 2022] GET /compute/v2.1/servers/e2f8b261-f29f-494e-a4f0-b37d8618f625 => generated 1556 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:51:24.122809 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-acc0bcce-8c7e-45e6-ba25-2ac00a73636c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:24.123618 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-acc0bcce-8c7e-45e6-ba25-2ac00a73636c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:24.136965 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-acc0bcce-8c7e-45e6-ba25-2ac00a73636c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:24.137516 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-acc0bcce-8c7e-45e6-ba25-2ac00a73636c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:24.137966 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-acc0bcce-8c7e-45e6-ba25-2ac00a73636c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:24.138701 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-acc0bcce-8c7e-45e6-ba25-2ac00a73636c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:24.139170 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-acc0bcce-8c7e-45e6-ba25-2ac00a73636c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:24.139609 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-acc0bcce-8c7e-45e6-ba25-2ac00a73636c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:24.225109 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-846dcbf0-cb2b-432b-96c9-d00f83b4ec65 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Calling method '.version_select at 0x7f68e4246310>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:24.281303 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-acc0bcce-8c7e-45e6-ba25-2ac00a73636c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:24.302085 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-acc0bcce-8c7e-45e6-ba25-2ac00a73636c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:24.306871 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-acc0bcce-8c7e-45e6-ba25-2ac00a73636c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:24.317219 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-acc0bcce-8c7e-45e6-ba25-2ac00a73636c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1555 microversion: 2.91 time: 0.198321 Sep 08 10:51:24.321412 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-846dcbf0-cb2b-432b-96c9-d00f83b4ec65 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] 10.222.0.27 "GET /compute/v2.1/images/8e1292c9-d905-432c-8f62-957946f8cb15" status: 200 len: 1426 microversion: 2.1 time: 0.102716 Sep 08 10:51:24.324018 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1566/3115] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:51:24 2022] GET /compute/v2.1/images/8e1292c9-d905-432c-8f62-957946f8cb15 => generated 1426 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:24.325432 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1550/3116] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:51:24 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1555 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:51:24.597660 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6d46baf3-0196-4381-a2ae-0c35d30d96eb tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:24.603008 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6d46baf3-0196-4381-a2ae-0c35d30d96eb tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:24.620019 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d46baf3-0196-4381-a2ae-0c35d30d96eb tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:24.621211 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d46baf3-0196-4381-a2ae-0c35d30d96eb tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:24.622272 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d46baf3-0196-4381-a2ae-0c35d30d96eb tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:24.624012 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d46baf3-0196-4381-a2ae-0c35d30d96eb tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:24.625140 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d46baf3-0196-4381-a2ae-0c35d30d96eb tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:24.626076 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d46baf3-0196-4381-a2ae-0c35d30d96eb tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:24.764874 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cbab8a6c-7e8e-4ae0-9c4d-57a3f0494182 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:24.767359 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cbab8a6c-7e8e-4ae0-9c4d-57a3f0494182 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: d21f2600-ca01-4d47-b1f6-c4e8fa28d571] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:24.772487 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:51:24.786619 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cbab8a6c-7e8e-4ae0-9c4d-57a3f0494182 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:24.787547 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cbab8a6c-7e8e-4ae0-9c4d-57a3f0494182 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:24.789280 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cbab8a6c-7e8e-4ae0-9c4d-57a3f0494182 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:24.790327 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cbab8a6c-7e8e-4ae0-9c4d-57a3f0494182 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:24.791010 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cbab8a6c-7e8e-4ae0-9c4d-57a3f0494182 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:24.793084 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cbab8a6c-7e8e-4ae0-9c4d-57a3f0494182 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:25.320801 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6d46baf3-0196-4381-a2ae-0c35d30d96eb tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:25.339123 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6d46baf3-0196-4381-a2ae-0c35d30d96eb tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:25.342972 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6d46baf3-0196-4381-a2ae-0c35d30d96eb tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:25.345775 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6d46baf3-0196-4381-a2ae-0c35d30d96eb tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 200 len: 1875 microversion: 2.32 time: 0.757523 Sep 08 10:51:25.362353 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1567/3117] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:51:24 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 1875 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:51:25.382201 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c5c6624b-5b77-4ac1-bfa7-5a916f6cebea tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:25.383103 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c5c6624b-5b77-4ac1-bfa7-5a916f6cebea tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] [instance: e2f8b261-f29f-494e-a4f0-b37d8618f625] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:25.392624 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5c6624b-5b77-4ac1-bfa7-5a916f6cebea tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:25.393376 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5c6624b-5b77-4ac1-bfa7-5a916f6cebea tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:25.397894 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5c6624b-5b77-4ac1-bfa7-5a916f6cebea tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:25.409108 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5c6624b-5b77-4ac1-bfa7-5a916f6cebea tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:25.418780 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5c6624b-5b77-4ac1-bfa7-5a916f6cebea tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:25.419927 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5c6624b-5b77-4ac1-bfa7-5a916f6cebea tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:25.774781 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c5c6624b-5b77-4ac1-bfa7-5a916f6cebea tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5947a1de1e44d87a601b5b5c8c2f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181f4b3ff01740feb60d5b50056874cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:25.805398 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c5c6624b-5b77-4ac1-bfa7-5a916f6cebea tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5947a1de1e44d87a601b5b5c8c2f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181f4b3ff01740feb60d5b50056874cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:25.809165 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c5c6624b-5b77-4ac1-bfa7-5a916f6cebea tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5947a1de1e44d87a601b5b5c8c2f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181f4b3ff01740feb60d5b50056874cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:25.810848 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c5c6624b-5b77-4ac1-bfa7-5a916f6cebea tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] 10.222.0.27 "GET /compute/v2.1/servers/e2f8b261-f29f-494e-a4f0-b37d8618f625" status: 200 len: 1556 microversion: 2.21 time: 0.447183 Sep 08 10:51:25.815546 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1568/3118] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:51:25 2022] GET /compute/v2.1/servers/e2f8b261-f29f-494e-a4f0-b37d8618f625 => generated 1556 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:51:25.821434 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ea71465e-90cb-42b9-abeb-1c1cc3d11745 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Calling method '.version_select at 0x7f68e4212430>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:25.938688 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ea71465e-90cb-42b9-abeb-1c1cc3d11745 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] 10.222.0.27 "GET /compute/v2.1/images/8e1292c9-d905-432c-8f62-957946f8cb15" status: 200 len: 1426 microversion: 2.1 time: 0.121650 Sep 08 10:51:25.941870 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1569/3119] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:51:25 2022] GET /compute/v2.1/images/8e1292c9-d905-432c-8f62-957946f8cb15 => generated 1426 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:25.948250 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-41a9f929-d91a-42a7-9637-6aba17a260b2 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:25.961068 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-41a9f929-d91a-42a7-9637-6aba17a260b2 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:25.983231 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-41a9f929-d91a-42a7-9637-6aba17a260b2 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:25.984495 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-41a9f929-d91a-42a7-9637-6aba17a260b2 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:25.985595 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-41a9f929-d91a-42a7-9637-6aba17a260b2 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:25.987111 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-41a9f929-d91a-42a7-9637-6aba17a260b2 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:25.987827 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-41a9f929-d91a-42a7-9637-6aba17a260b2 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:25.988440 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-41a9f929-d91a-42a7-9637-6aba17a260b2 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:26.082953 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-cbab8a6c-7e8e-4ae0-9c4d-57a3f0494182 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86e8bd6f9048ce8718f432e51128a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c3752f739b47a296a5b88948fe7f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:26.109130 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cbab8a6c-7e8e-4ae0-9c4d-57a3f0494182 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "GET /compute/v2.1/servers/d21f2600-ca01-4d47-b1f6-c4e8fa28d571" status: 200 len: 1325 microversion: 2.1 time: 1.347571 Sep 08 10:51:26.110227 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1551/3120] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:24 2022] GET /compute/v2.1/servers/d21f2600-ca01-4d47-b1f6-c4e8fa28d571 => generated 1325 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:51:26.171015 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-4f957456-a5ce-41d3-b703-0613762aadc6 req-fdaebb33-36c8-4b19-a5e1-eb28ba09769a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf", "name": "network-vif-plugged", "status": "completed", "tag": "036e4e77-856c-4b8c-9f28-cff6e87b1645"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:51:26.172304 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-41a9f929-d91a-42a7-9637-6aba17a260b2 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:26.187855 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-41a9f929-d91a-42a7-9637-6aba17a260b2 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:26.196600 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-41a9f929-d91a-42a7-9637-6aba17a260b2 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:26.206434 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-4f957456-a5ce-41d3-b703-0613762aadc6 req-fdaebb33-36c8-4b19-a5e1-eb28ba09769a service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:26.208001 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-4f957456-a5ce-41d3-b703-0613762aadc6 req-fdaebb33-36c8-4b19-a5e1-eb28ba09769a service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:26.208631 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-4f957456-a5ce-41d3-b703-0613762aadc6 req-fdaebb33-36c8-4b19-a5e1-eb28ba09769a service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:26.209818 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-41a9f929-d91a-42a7-9637-6aba17a260b2 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1555 microversion: 2.91 time: 0.265662 Sep 08 10:51:26.210462 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1570/3121] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:51:25 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1555 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:51:26.238969 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-4f957456-a5ce-41d3-b703-0613762aadc6 req-fdaebb33-36c8-4b19-a5e1-eb28ba09769a service nova] Creating event network-vif-plugged:036e4e77-856c-4b8c-9f28-cff6e87b1645 for instance 9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf on n-h1-850501-12 Sep 08 10:51:26.246277 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-4f957456-a5ce-41d3-b703-0613762aadc6 req-fdaebb33-36c8-4b19-a5e1-eb28ba09769a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083287 Sep 08 10:51:26.247737 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1552/3122] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:51:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:51:26.383286 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-df189f3e-e9c8-40f9-a450-d651cb9e0d94 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:26.384511 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-df189f3e-e9c8-40f9-a450-d651cb9e0d94 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:26.392930 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df189f3e-e9c8-40f9-a450-d651cb9e0d94 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:26.393970 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df189f3e-e9c8-40f9-a450-d651cb9e0d94 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:26.394605 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df189f3e-e9c8-40f9-a450-d651cb9e0d94 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:26.395904 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df189f3e-e9c8-40f9-a450-d651cb9e0d94 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:26.396523 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df189f3e-e9c8-40f9-a450-d651cb9e0d94 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:26.397152 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df189f3e-e9c8-40f9-a450-d651cb9e0d94 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:26.806208 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-df189f3e-e9c8-40f9-a450-d651cb9e0d94 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:26.847806 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-df189f3e-e9c8-40f9-a450-d651cb9e0d94 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:26.849884 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7bd31b72-b82a-43e1-8c9a-cac24b121db3 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:26.851043 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7bd31b72-b82a-43e1-8c9a-cac24b121db3 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] [instance: e2f8b261-f29f-494e-a4f0-b37d8618f625] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:26.869902 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7bd31b72-b82a-43e1-8c9a-cac24b121db3 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:26.873870 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-df189f3e-e9c8-40f9-a450-d651cb9e0d94 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:26.876275 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7bd31b72-b82a-43e1-8c9a-cac24b121db3 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:26.876916 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-df189f3e-e9c8-40f9-a450-d651cb9e0d94 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 200 len: 1875 microversion: 2.32 time: 0.497509 Sep 08 10:51:26.877894 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7bd31b72-b82a-43e1-8c9a-cac24b121db3 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:26.895932 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1571/3123] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:51:26 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 1875 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:51:26.896650 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7bd31b72-b82a-43e1-8c9a-cac24b121db3 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:26.897971 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7bd31b72-b82a-43e1-8c9a-cac24b121db3 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:26.898837 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7bd31b72-b82a-43e1-8c9a-cac24b121db3 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:26.974210 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8da5ef92-06ba-410e-8f59-c5b95f70ffda tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Calling method '.version_select at 0x7f68e4212c10>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:27.299343 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8da5ef92-06ba-410e-8f59-c5b95f70ffda tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] 10.222.0.27 "GET /compute/v2.1/images/8e1292c9-d905-432c-8f62-957946f8cb15" status: 200 len: 1426 microversion: 2.1 time: 0.331433 Sep 08 10:51:27.300319 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1572/3124] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:51:26 2022] GET /compute/v2.1/images/8e1292c9-d905-432c-8f62-957946f8cb15 => generated 1426 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:27.322176 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c0cc5223-fe10-4e9c-a698-2ca2c38d84e4 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:27.323752 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c0cc5223-fe10-4e9c-a698-2ca2c38d84e4 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: d21f2600-ca01-4d47-b1f6-c4e8fa28d571] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:27.355406 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c0cc5223-fe10-4e9c-a698-2ca2c38d84e4 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:27.357406 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c0cc5223-fe10-4e9c-a698-2ca2c38d84e4 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:27.360209 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c0cc5223-fe10-4e9c-a698-2ca2c38d84e4 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:27.363248 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c0cc5223-fe10-4e9c-a698-2ca2c38d84e4 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:27.364431 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c0cc5223-fe10-4e9c-a698-2ca2c38d84e4 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:27.368541 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c0cc5223-fe10-4e9c-a698-2ca2c38d84e4 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:27.500243 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:51:27.546259 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=10 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:51:27.738789 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7bd31b72-b82a-43e1-8c9a-cac24b121db3 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5947a1de1e44d87a601b5b5c8c2f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181f4b3ff01740feb60d5b50056874cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:27.767974 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7bd31b72-b82a-43e1-8c9a-cac24b121db3 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5947a1de1e44d87a601b5b5c8c2f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181f4b3ff01740feb60d5b50056874cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:27.774666 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7bd31b72-b82a-43e1-8c9a-cac24b121db3 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5947a1de1e44d87a601b5b5c8c2f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181f4b3ff01740feb60d5b50056874cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:27.780342 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7bd31b72-b82a-43e1-8c9a-cac24b121db3 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] 10.222.0.27 "GET /compute/v2.1/servers/e2f8b261-f29f-494e-a4f0-b37d8618f625" status: 200 len: 1556 microversion: 2.21 time: 0.935079 Sep 08 10:51:27.783083 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1553/3125] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:51:26 2022] GET /compute/v2.1/servers/e2f8b261-f29f-494e-a4f0-b37d8618f625 => generated 1556 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:51:27.793857 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-227e51f3-dead-4f41-973c-efd735960296 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:27.797532 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-227e51f3-dead-4f41-973c-efd735960296 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:27.824563 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-227e51f3-dead-4f41-973c-efd735960296 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:27.825361 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-227e51f3-dead-4f41-973c-efd735960296 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:27.827007 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-227e51f3-dead-4f41-973c-efd735960296 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:27.829568 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-227e51f3-dead-4f41-973c-efd735960296 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:27.830713 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-227e51f3-dead-4f41-973c-efd735960296 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:27.831387 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-227e51f3-dead-4f41-973c-efd735960296 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:27.954098 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-227e51f3-dead-4f41-973c-efd735960296 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:27.969536 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-227e51f3-dead-4f41-973c-efd735960296 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:27.971443 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-227e51f3-dead-4f41-973c-efd735960296 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:27.988060 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-227e51f3-dead-4f41-973c-efd735960296 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1555 microversion: 2.91 time: 0.201335 Sep 08 10:51:27.990344 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1554/3126] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:51:27 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1555 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:51:28.001883 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-b31ba6c4-6cd9-4fe4-8b98-2d48cfe2bdfb req-47b16143-fa99-4cb5-8c8c-5227e90cc893 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2f8b261-f29f-494e-a4f0-b37d8618f625", "name": "network-vif-deleted", "tag": "6823ef05-9226-42ff-bd4e-2f670c18dccc"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:51:28.038092 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-b31ba6c4-6cd9-4fe4-8b98-2d48cfe2bdfb req-47b16143-fa99-4cb5-8c8c-5227e90cc893 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:28.040168 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-b31ba6c4-6cd9-4fe4-8b98-2d48cfe2bdfb req-47b16143-fa99-4cb5-8c8c-5227e90cc893 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:28.043378 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-b31ba6c4-6cd9-4fe4-8b98-2d48cfe2bdfb req-47b16143-fa99-4cb5-8c8c-5227e90cc893 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:28.065527 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-b31ba6c4-6cd9-4fe4-8b98-2d48cfe2bdfb req-47b16143-fa99-4cb5-8c8c-5227e90cc893 service nova] Creating event network-vif-deleted:6823ef05-9226-42ff-bd4e-2f670c18dccc for instance e2f8b261-f29f-494e-a4f0-b37d8618f625 on n-h2-850501-12 Sep 08 10:51:28.076156 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-b31ba6c4-6cd9-4fe4-8b98-2d48cfe2bdfb req-47b16143-fa99-4cb5-8c8c-5227e90cc893 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082854 Sep 08 10:51:28.078060 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1555/3127] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:51:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:51:28.090012 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4f90a602-d558-404b-8026-40d80335a140 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:28.090952 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4f90a602-d558-404b-8026-40d80335a140 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:28.112888 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4f90a602-d558-404b-8026-40d80335a140 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:28.114094 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4f90a602-d558-404b-8026-40d80335a140 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:28.114719 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4f90a602-d558-404b-8026-40d80335a140 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:28.115722 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4f90a602-d558-404b-8026-40d80335a140 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:28.116587 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4f90a602-d558-404b-8026-40d80335a140 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:28.117598 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4f90a602-d558-404b-8026-40d80335a140 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:28.695244 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c0cc5223-fe10-4e9c-a698-2ca2c38d84e4 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86e8bd6f9048ce8718f432e51128a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c3752f739b47a296a5b88948fe7f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:28.715881 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c0cc5223-fe10-4e9c-a698-2ca2c38d84e4 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "GET /compute/v2.1/servers/d21f2600-ca01-4d47-b1f6-c4e8fa28d571" status: 200 len: 1325 microversion: 2.1 time: 1.409104 Sep 08 10:51:28.719822 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1573/3128] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:27 2022] GET /compute/v2.1/servers/d21f2600-ca01-4d47-b1f6-c4e8fa28d571 => generated 1325 bytes in 1417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:28.727923 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dd45f9d0-d5fb-45bb-9f66-24e8835c9605 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Calling method '.version_select at 0x7f68e4212af0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:29.273417 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4f90a602-d558-404b-8026-40d80335a140 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:29.305165 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4f90a602-d558-404b-8026-40d80335a140 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:29.321452 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4f90a602-d558-404b-8026-40d80335a140 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:29.322701 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4f90a602-d558-404b-8026-40d80335a140 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 200 len: 1875 microversion: 2.32 time: 1.243383 Sep 08 10:51:29.328286 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1556/3129] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:51:28 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 1875 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:51:29.340554 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4473c72f-96cd-428a-9137-36530c323525 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:29.349420 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4473c72f-96cd-428a-9137-36530c323525 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] [instance: e2f8b261-f29f-494e-a4f0-b37d8618f625] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:29.376661 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4473c72f-96cd-428a-9137-36530c323525 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:29.377207 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4473c72f-96cd-428a-9137-36530c323525 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:29.377659 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4473c72f-96cd-428a-9137-36530c323525 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:29.381797 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4473c72f-96cd-428a-9137-36530c323525 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:29.382391 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4473c72f-96cd-428a-9137-36530c323525 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:29.382859 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4473c72f-96cd-428a-9137-36530c323525 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:29.466581 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-4473c72f-96cd-428a-9137-36530c323525 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] HTTP exception thrown: Instance e2f8b261-f29f-494e-a4f0-b37d8618f625 could not be found. Sep 08 10:51:29.474371 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4473c72f-96cd-428a-9137-36530c323525 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Request method failure captured: Sep 08 10:51:29.474371 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/e2f8b261-f29f-494e-a4f0-b37d8618f625 HTTP/1.1 Sep 08 10:51:29.474371 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:51:29.474371 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:51:29.474371 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:51:29.474371 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:51:29.474371 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:51:29.474371 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:51:29.474371 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:51:29.474371 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:51:29.474371 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGckMf9vqIW4DTCqohzZvxJiIvSt1CKddfoCYJUXG0ekUlmxL3pkk-XK95I6OMsxmDbFWuQDOcknN_kuNfL4Y1ZQeWt_Y9GZ-P5RN5TgUWeIZmaL5WTuqODhPNP8G247jZ7ZPM1gtm2v9n1Au-FMXlqcjbzoWdlTDpJq1nTeRCe2MrsM Sep 08 10:51:29.474371 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:51:29.474371 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:51:29.474371 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:51:29.474371 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:51:29.474371 n-d-850501-12 devstack@n-api.service[128861]: X-Openstack-Nova-Api-Version: 2.21 Sep 08 10:51:29.474371 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:51:29.474371 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:51:29.474371 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 181f4b3ff01740feb60d5b50056874cf Sep 08 10:51:29.474371 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-InstanceActionsV221TestJSON-600867356 Sep 08 10:51:29.474371 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:51:29.474371 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:51:29.474371 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/181f4b3ff01740feb60d5b50056874cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/181f4b3ff01740feb60d5b50056874cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_181f4b3ff01740feb60d5b50056874cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/181f4b3ff01740feb60d5b50056874cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:51:29.474371 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-InstanceActionsV221TestJSON-600867356 Sep 08 10:51:29.474371 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 181f4b3ff01740feb60d5b50056874cf Sep 08 10:51:29.474371 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-600867356 Sep 08 10:51:29.474371 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-InstanceActionsV221TestJSON-600867356-project Sep 08 10:51:29.474371 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:51:29.474371 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:51:29.474371 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: f5947a1de1e44d87a601b5b5c8c2f1a9 Sep 08 10:51:29.474371 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-InstanceActionsV221TestJSON-600867356-project Sep 08 10:51:29.474371 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:51:29.474371 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance e2f8b261-f29f-494e-a4f0-b37d8618f625 could not be found. Sep 08 10:51:29.474371 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': 'e2f8b261-f29f-494e-a4f0-b37d8618f625'} Sep 08 10:51:29.474371 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:51:29.474371 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:51:29.474371 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:51:29.474371 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:51:29.474371 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:51:29.474371 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:51:29.474371 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:51:29.474371 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:51:29.474371 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:51:29.474371 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:51:29.474371 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2f8b261-f29f-494e-a4f0-b37d8618f625 could not be found. Sep 08 10:51:29.474371 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:51:29.474371 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:51:29.474371 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:51:29.474371 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:51:29.474371 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:51:29.474371 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:51:29.474371 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:51:29.474371 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:51:29.474371 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:51:29.474371 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:51:29.474371 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:51:29.474371 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:51:29.474371 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:51:29.474371 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:51:29.474371 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:51:29.474371 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:51:29.474371 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2f8b261-f29f-494e-a4f0-b37d8618f625 could not be found. Sep 08 10:51:29.474371 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:51:29.474371 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:51:29.479587 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:51:29.479587 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:51:29.479587 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:51:29.479587 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:51:29.479587 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:51:29.479587 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:51:29.479587 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2f8b261-f29f-494e-a4f0-b37d8618f625 could not be found. Sep 08 10:51:29.479587 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:51:29.479587 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4473c72f-96cd-428a-9137-36530c323525 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Returning 404 to user: Instance e2f8b261-f29f-494e-a4f0-b37d8618f625 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:51:29.479587 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4473c72f-96cd-428a-9137-36530c323525 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] 10.222.0.27 "GET /compute/v2.1/servers/e2f8b261-f29f-494e-a4f0-b37d8618f625" status: 404 len: 111 microversion: 2.21 time: 0.148179 Sep 08 10:51:29.484974 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1557/3130] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:51:29 2022] GET /compute/v2.1/servers/e2f8b261-f29f-494e-a4f0-b37d8618f625 => generated 111 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:51:29.492762 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-31a4cf88-320c-4269-9e9c-208f90cd0abc tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:29.509547 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-31a4cf88-320c-4269-9e9c-208f90cd0abc tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:29.530343 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-31a4cf88-320c-4269-9e9c-208f90cd0abc tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:29.531705 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-31a4cf88-320c-4269-9e9c-208f90cd0abc tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:29.532517 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-31a4cf88-320c-4269-9e9c-208f90cd0abc tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:29.533890 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-31a4cf88-320c-4269-9e9c-208f90cd0abc tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:29.534887 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-31a4cf88-320c-4269-9e9c-208f90cd0abc tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:29.536120 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-31a4cf88-320c-4269-9e9c-208f90cd0abc tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:30.417890 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-31a4cf88-320c-4269-9e9c-208f90cd0abc tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:30.453462 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-31a4cf88-320c-4269-9e9c-208f90cd0abc tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:30.459143 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-31a4cf88-320c-4269-9e9c-208f90cd0abc tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:30.482924 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-31a4cf88-320c-4269-9e9c-208f90cd0abc tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1555 microversion: 2.91 time: 0.994657 Sep 08 10:51:30.487576 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1558/3131] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:51:29 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1555 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:51:30.509313 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f97fe953-e710-4194-b50e-b48420ac5e8f tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Calling method '.version_select at 0x7f68e4533ee0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:30.510846 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f97fe953-e710-4194-b50e-b48420ac5e8f tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] [instance: e2f8b261-f29f-494e-a4f0-b37d8618f625] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:30.548187 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f97fe953-e710-4194-b50e-b48420ac5e8f tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:30.548714 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f97fe953-e710-4194-b50e-b48420ac5e8f tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:30.553662 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f97fe953-e710-4194-b50e-b48420ac5e8f tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:30.555324 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f97fe953-e710-4194-b50e-b48420ac5e8f tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:30.555906 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f97fe953-e710-4194-b50e-b48420ac5e8f tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:30.557266 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f97fe953-e710-4194-b50e-b48420ac5e8f tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:30.661071 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f97fe953-e710-4194-b50e-b48420ac5e8f tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] 10.222.0.27 "GET /compute/v2.1/servers/e2f8b261-f29f-494e-a4f0-b37d8618f625/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.171713 Sep 08 10:51:30.670918 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1559/3132] 10.222.0.27 () {60 vars in 1337 bytes} [Thu Sep 8 10:51:30 2022] GET /compute/v2.1/servers/e2f8b261-f29f-494e-a4f0-b37d8618f625/os-instance-actions => generated 611 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:51:30.677582 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f532074e-67da-43bb-8065-115a87ed2ee5 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:30.678566 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f532074e-67da-43bb-8065-115a87ed2ee5 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: d21f2600-ca01-4d47-b1f6-c4e8fa28d571] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:30.686185 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f532074e-67da-43bb-8065-115a87ed2ee5 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:30.687594 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f532074e-67da-43bb-8065-115a87ed2ee5 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:30.688216 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f532074e-67da-43bb-8065-115a87ed2ee5 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:30.689356 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f532074e-67da-43bb-8065-115a87ed2ee5 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:30.690045 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f532074e-67da-43bb-8065-115a87ed2ee5 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:30.690926 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f532074e-67da-43bb-8065-115a87ed2ee5 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:31.455594 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f532074e-67da-43bb-8065-115a87ed2ee5 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86e8bd6f9048ce8718f432e51128a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c3752f739b47a296a5b88948fe7f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:31.484895 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f532074e-67da-43bb-8065-115a87ed2ee5 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "GET /compute/v2.1/servers/d21f2600-ca01-4d47-b1f6-c4e8fa28d571" status: 200 len: 1325 microversion: 2.1 time: 0.812490 Sep 08 10:51:31.502754 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1560/3133] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:30 2022] GET /compute/v2.1/servers/d21f2600-ca01-4d47-b1f6-c4e8fa28d571 => generated 1325 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:31.510345 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bf048e3a-5eb8-474f-b548-96a718da496b tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:31.513099 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bf048e3a-5eb8-474f-b548-96a718da496b tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:31.540305 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf048e3a-5eb8-474f-b548-96a718da496b tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:31.541073 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf048e3a-5eb8-474f-b548-96a718da496b tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:31.541829 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf048e3a-5eb8-474f-b548-96a718da496b tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:31.544210 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf048e3a-5eb8-474f-b548-96a718da496b tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:31.545082 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf048e3a-5eb8-474f-b548-96a718da496b tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:31.546224 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf048e3a-5eb8-474f-b548-96a718da496b tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:31.550446 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:51:32.125338 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-bf048e3a-5eb8-474f-b548-96a718da496b tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:32.146949 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-bf048e3a-5eb8-474f-b548-96a718da496b tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:32.148429 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-bf048e3a-5eb8-474f-b548-96a718da496b tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:32.150065 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bf048e3a-5eb8-474f-b548-96a718da496b tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 200 len: 1875 microversion: 2.32 time: 0.645675 Sep 08 10:51:32.150964 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1561/3134] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:51:31 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 1875 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:51:32.163574 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c5af7239-32c1-4d18-a7f9-a457652432c7 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:32.164157 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c5af7239-32c1-4d18-a7f9-a457652432c7 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] [instance: e2f8b261-f29f-494e-a4f0-b37d8618f625] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:32.184870 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c5af7239-32c1-4d18-a7f9-a457652432c7 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:32.185421 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c5af7239-32c1-4d18-a7f9-a457652432c7 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:32.190076 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c5af7239-32c1-4d18-a7f9-a457652432c7 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:32.192490 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c5af7239-32c1-4d18-a7f9-a457652432c7 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:32.193115 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c5af7239-32c1-4d18-a7f9-a457652432c7 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:32.193605 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c5af7239-32c1-4d18-a7f9-a457652432c7 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:32.242584 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-c5af7239-32c1-4d18-a7f9-a457652432c7 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] HTTP exception thrown: Instance e2f8b261-f29f-494e-a4f0-b37d8618f625 could not be found. Sep 08 10:51:32.244553 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c5af7239-32c1-4d18-a7f9-a457652432c7 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Request method failure captured: Sep 08 10:51:32.244553 n-d-850501-12 devstack@n-api.service[128861]: request: DELETE /compute/v2.1/servers/e2f8b261-f29f-494e-a4f0-b37d8618f625 HTTP/1.1 Sep 08 10:51:32.244553 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:51:32.244553 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:51:32.244553 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:51:32.244553 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:51:32.244553 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:51:32.244553 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:51:32.244553 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:51:32.244553 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:51:32.244553 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGckMf9vqIW4DTCqohzZvxJiIvSt1CKddfoCYJUXG0ekUlmxL3pkk-XK95I6OMsxmDbFWuQDOcknN_kuNfL4Y1ZQeWt_Y9GZ-P5RN5TgUWeIZmaL5WTuqODhPNP8G247jZ7ZPM1gtm2v9n1Au-FMXlqcjbzoWdlTDpJq1nTeRCe2MrsM Sep 08 10:51:32.244553 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:51:32.244553 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:51:32.244553 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:51:32.244553 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:51:32.244553 n-d-850501-12 devstack@n-api.service[128861]: X-Openstack-Nova-Api-Version: 2.21 Sep 08 10:51:32.244553 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:51:32.244553 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:51:32.244553 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 181f4b3ff01740feb60d5b50056874cf Sep 08 10:51:32.244553 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-InstanceActionsV221TestJSON-600867356 Sep 08 10:51:32.244553 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:51:32.244553 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:51:32.244553 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/181f4b3ff01740feb60d5b50056874cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/181f4b3ff01740feb60d5b50056874cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_181f4b3ff01740feb60d5b50056874cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/181f4b3ff01740feb60d5b50056874cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:51:32.244553 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-InstanceActionsV221TestJSON-600867356 Sep 08 10:51:32.244553 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 181f4b3ff01740feb60d5b50056874cf Sep 08 10:51:32.244553 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-600867356 Sep 08 10:51:32.244553 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-InstanceActionsV221TestJSON-600867356-project Sep 08 10:51:32.244553 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:51:32.244553 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:51:32.244553 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: f5947a1de1e44d87a601b5b5c8c2f1a9 Sep 08 10:51:32.244553 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-InstanceActionsV221TestJSON-600867356-project Sep 08 10:51:32.244553 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:51:32.244553 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance e2f8b261-f29f-494e-a4f0-b37d8618f625 could not be found. Sep 08 10:51:32.244553 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': 'e2f8b261-f29f-494e-a4f0-b37d8618f625'} Sep 08 10:51:32.244553 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:51:32.244553 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:51:32.244553 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:51:32.244553 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:51:32.244553 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:51:32.244553 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:51:32.244553 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:51:32.244553 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:51:32.244553 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:51:32.244553 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:51:32.244553 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2f8b261-f29f-494e-a4f0-b37d8618f625 could not be found. Sep 08 10:51:32.244553 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:51:32.244553 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:51:32.244553 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:51:32.244553 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:51:32.244553 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:51:32.244553 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:51:32.244553 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:51:32.244553 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:51:32.244553 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:51:32.244553 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:51:32.244553 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:51:32.244553 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:51:32.244553 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:51:32.244553 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:51:32.244553 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:51:32.244553 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:51:32.244553 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:51:32.244553 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:51:32.250331 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2f8b261-f29f-494e-a4f0-b37d8618f625 could not be found. Sep 08 10:51:32.250331 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:51:32.250331 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:51:32.250331 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:51:32.250331 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:51:32.250331 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:51:32.250331 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:51:32.250331 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:51:32.250331 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:51:32.250331 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2f8b261-f29f-494e-a4f0-b37d8618f625 could not be found. Sep 08 10:51:32.250331 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:51:32.252708 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c5af7239-32c1-4d18-a7f9-a457652432c7 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Returning 404 to user: Instance e2f8b261-f29f-494e-a4f0-b37d8618f625 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:51:32.253823 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c5af7239-32c1-4d18-a7f9-a457652432c7 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e2f8b261-f29f-494e-a4f0-b37d8618f625" status: 404 len: 111 microversion: 2.21 time: 0.101782 Sep 08 10:51:32.254920 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1562/3135] 10.222.0.27 () {60 vars in 1280 bytes} [Thu Sep 8 10:51:32 2022] DELETE /compute/v2.1/servers/e2f8b261-f29f-494e-a4f0-b37d8618f625 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:51:32.260706 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-2ee54a74-9231-4b40-9a80-cda6eb18c149 req-679cd116-f1f5-486c-ba41-cd28ea1d040b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d21f2600-ca01-4d47-b1f6-c4e8fa28d571", "tag": "75359c42-7a36-4596-b8b7-328048472cc8"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:51:32.291147 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-2ee54a74-9231-4b40-9a80-cda6eb18c149 req-679cd116-f1f5-486c-ba41-cd28ea1d040b service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:32.292068 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-2ee54a74-9231-4b40-9a80-cda6eb18c149 req-679cd116-f1f5-486c-ba41-cd28ea1d040b service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:32.292734 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-2ee54a74-9231-4b40-9a80-cda6eb18c149 req-679cd116-f1f5-486c-ba41-cd28ea1d040b service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:32.315867 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-2ee54a74-9231-4b40-9a80-cda6eb18c149 req-679cd116-f1f5-486c-ba41-cd28ea1d040b service nova] Creating event network-changed:75359c42-7a36-4596-b8b7-328048472cc8 for instance d21f2600-ca01-4d47-b1f6-c4e8fa28d571 on n-h1-850501-12 Sep 08 10:51:32.345119 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-2ee54a74-9231-4b40-9a80-cda6eb18c149 req-679cd116-f1f5-486c-ba41-cd28ea1d040b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088511 Sep 08 10:51:32.348353 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1563/3136] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:51:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:51:32.357710 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ff38bf55-b840-423a-aa19-043a8b06983a tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:32.365808 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ff38bf55-b840-423a-aa19-043a8b06983a tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:32.384458 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ff38bf55-b840-423a-aa19-043a8b06983a tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:32.385925 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ff38bf55-b840-423a-aa19-043a8b06983a tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:32.387029 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ff38bf55-b840-423a-aa19-043a8b06983a tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:32.388663 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ff38bf55-b840-423a-aa19-043a8b06983a tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:32.397827 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ff38bf55-b840-423a-aa19-043a8b06983a tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:32.398568 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ff38bf55-b840-423a-aa19-043a8b06983a tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:32.542582 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ff38bf55-b840-423a-aa19-043a8b06983a tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:32.553968 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ff38bf55-b840-423a-aa19-043a8b06983a tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:32.557849 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ff38bf55-b840-423a-aa19-043a8b06983a tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:32.580742 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ff38bf55-b840-423a-aa19-043a8b06983a tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1555 microversion: 2.91 time: 0.229327 Sep 08 10:51:32.601740 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1564/3137] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:51:32 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1555 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:51:32.623020 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ac9ddd83-dc28-4048-9ea4-d7892c880029 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:32.628564 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ac9ddd83-dc28-4048-9ea4-d7892c880029 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] [instance: e2f8b261-f29f-494e-a4f0-b37d8618f625] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:32.646950 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ac9ddd83-dc28-4048-9ea4-d7892c880029 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:32.649337 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ac9ddd83-dc28-4048-9ea4-d7892c880029 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:32.650035 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ac9ddd83-dc28-4048-9ea4-d7892c880029 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:32.653433 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ac9ddd83-dc28-4048-9ea4-d7892c880029 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:32.654174 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ac9ddd83-dc28-4048-9ea4-d7892c880029 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:32.654866 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ac9ddd83-dc28-4048-9ea4-d7892c880029 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:32.715951 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-ac9ddd83-dc28-4048-9ea4-d7892c880029 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] HTTP exception thrown: Instance e2f8b261-f29f-494e-a4f0-b37d8618f625 could not be found. Sep 08 10:51:32.719942 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ac9ddd83-dc28-4048-9ea4-d7892c880029 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Request method failure captured: Sep 08 10:51:32.719942 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/e2f8b261-f29f-494e-a4f0-b37d8618f625 HTTP/1.1 Sep 08 10:51:32.719942 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:51:32.719942 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:51:32.719942 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:51:32.719942 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:51:32.719942 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:51:32.719942 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:51:32.719942 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:51:32.719942 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:51:32.719942 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGckMf9vqIW4DTCqohzZvxJiIvSt1CKddfoCYJUXG0ekUlmxL3pkk-XK95I6OMsxmDbFWuQDOcknN_kuNfL4Y1ZQeWt_Y9GZ-P5RN5TgUWeIZmaL5WTuqODhPNP8G247jZ7ZPM1gtm2v9n1Au-FMXlqcjbzoWdlTDpJq1nTeRCe2MrsM Sep 08 10:51:32.719942 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:51:32.719942 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:51:32.719942 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:51:32.719942 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:51:32.719942 n-d-850501-12 devstack@n-api.service[128861]: X-Openstack-Nova-Api-Version: 2.21 Sep 08 10:51:32.719942 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:51:32.719942 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:51:32.719942 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 181f4b3ff01740feb60d5b50056874cf Sep 08 10:51:32.719942 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-InstanceActionsV221TestJSON-600867356 Sep 08 10:51:32.719942 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:51:32.719942 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:51:32.719942 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/181f4b3ff01740feb60d5b50056874cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/181f4b3ff01740feb60d5b50056874cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_181f4b3ff01740feb60d5b50056874cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/181f4b3ff01740feb60d5b50056874cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:51:32.719942 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-InstanceActionsV221TestJSON-600867356 Sep 08 10:51:32.719942 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 181f4b3ff01740feb60d5b50056874cf Sep 08 10:51:32.719942 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-600867356 Sep 08 10:51:32.719942 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-InstanceActionsV221TestJSON-600867356-project Sep 08 10:51:32.719942 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:51:32.719942 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:51:32.719942 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: f5947a1de1e44d87a601b5b5c8c2f1a9 Sep 08 10:51:32.719942 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-InstanceActionsV221TestJSON-600867356-project Sep 08 10:51:32.719942 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:51:32.719942 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance e2f8b261-f29f-494e-a4f0-b37d8618f625 could not be found. Sep 08 10:51:32.719942 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': 'e2f8b261-f29f-494e-a4f0-b37d8618f625'} Sep 08 10:51:32.719942 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:51:32.719942 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:51:32.719942 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:51:32.719942 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:51:32.719942 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:51:32.719942 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:51:32.719942 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:51:32.719942 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:51:32.719942 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:51:32.719942 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:51:32.719942 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2f8b261-f29f-494e-a4f0-b37d8618f625 could not be found. Sep 08 10:51:32.719942 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:51:32.719942 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:51:32.719942 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:51:32.719942 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:51:32.719942 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:51:32.719942 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:51:32.719942 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:51:32.719942 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:51:32.719942 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:51:32.719942 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:51:32.719942 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:51:32.719942 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:51:32.719942 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:51:32.719942 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:51:32.719942 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:51:32.719942 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:51:32.719942 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2f8b261-f29f-494e-a4f0-b37d8618f625 could not be found. Sep 08 10:51:32.719942 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:51:32.719942 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:51:32.724469 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:51:32.724469 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:51:32.724469 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:51:32.724469 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:51:32.724469 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:51:32.724469 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:51:32.724469 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2f8b261-f29f-494e-a4f0-b37d8618f625 could not be found. Sep 08 10:51:32.724469 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:51:32.739397 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ac9ddd83-dc28-4048-9ea4-d7892c880029 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] Returning 404 to user: Instance e2f8b261-f29f-494e-a4f0-b37d8618f625 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:51:32.740842 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ac9ddd83-dc28-4048-9ea4-d7892c880029 tempest-InstanceActionsV221TestJSON-600867356 tempest-InstanceActionsV221TestJSON-600867356-project] 10.222.0.27 "GET /compute/v2.1/servers/e2f8b261-f29f-494e-a4f0-b37d8618f625" status: 404 len: 111 microversion: 2.21 time: 0.137536 Sep 08 10:51:32.746674 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1565/3138] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:51:32 2022] GET /compute/v2.1/servers/e2f8b261-f29f-494e-a4f0-b37d8618f625 => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:51:32.752619 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-72997c40-79cb-4747-bff7-cd6666e7dc68 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:32.753629 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-72997c40-79cb-4747-bff7-cd6666e7dc68 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: d21f2600-ca01-4d47-b1f6-c4e8fa28d571] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:32.771444 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-72997c40-79cb-4747-bff7-cd6666e7dc68 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:32.772265 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-72997c40-79cb-4747-bff7-cd6666e7dc68 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:32.772926 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-72997c40-79cb-4747-bff7-cd6666e7dc68 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:32.773971 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-72997c40-79cb-4747-bff7-cd6666e7dc68 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:32.774625 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-72997c40-79cb-4747-bff7-cd6666e7dc68 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:32.779843 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-72997c40-79cb-4747-bff7-cd6666e7dc68 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:33.618537 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-72997c40-79cb-4747-bff7-cd6666e7dc68 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86e8bd6f9048ce8718f432e51128a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c3752f739b47a296a5b88948fe7f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:33.667486 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-72997c40-79cb-4747-bff7-cd6666e7dc68 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "GET /compute/v2.1/servers/d21f2600-ca01-4d47-b1f6-c4e8fa28d571" status: 200 len: 1325 microversion: 2.1 time: 0.917015 Sep 08 10:51:33.670419 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1566/3139] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:32 2022] GET /compute/v2.1/servers/d21f2600-ca01-4d47-b1f6-c4e8fa28d571 => generated 1325 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:33.688478 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9ebfe2f7-4796-4ac6-b13e-9d70c6233972 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:33.690473 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9ebfe2f7-4796-4ac6-b13e-9d70c6233972 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:33.705978 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ebfe2f7-4796-4ac6-b13e-9d70c6233972 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:33.710641 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ebfe2f7-4796-4ac6-b13e-9d70c6233972 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:33.711966 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ebfe2f7-4796-4ac6-b13e-9d70c6233972 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:33.715233 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ebfe2f7-4796-4ac6-b13e-9d70c6233972 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:33.715969 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ebfe2f7-4796-4ac6-b13e-9d70c6233972 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:33.720646 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ebfe2f7-4796-4ac6-b13e-9d70c6233972 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:35.128874 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9ebfe2f7-4796-4ac6-b13e-9d70c6233972 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:35.170790 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9ebfe2f7-4796-4ac6-b13e-9d70c6233972 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:35.180774 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9ebfe2f7-4796-4ac6-b13e-9d70c6233972 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:35.182955 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9ebfe2f7-4796-4ac6-b13e-9d70c6233972 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 200 len: 1875 microversion: 2.32 time: 1.509300 Sep 08 10:51:35.203954 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1567/3140] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:51:33 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 1875 bytes in 1533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:51:35.213877 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d9f03972-6a2b-4151-8bd9-4731f4d5cf2e tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:35.215024 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d9f03972-6a2b-4151-8bd9-4731f4d5cf2e tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:35.224996 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d9f03972-6a2b-4151-8bd9-4731f4d5cf2e tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:35.226071 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d9f03972-6a2b-4151-8bd9-4731f4d5cf2e tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:35.226802 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d9f03972-6a2b-4151-8bd9-4731f4d5cf2e tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:35.228085 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d9f03972-6a2b-4151-8bd9-4731f4d5cf2e tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:35.228831 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d9f03972-6a2b-4151-8bd9-4731f4d5cf2e tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:35.229531 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d9f03972-6a2b-4151-8bd9-4731f4d5cf2e tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:35.410228 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d9f03972-6a2b-4151-8bd9-4731f4d5cf2e tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:35.435788 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d9f03972-6a2b-4151-8bd9-4731f4d5cf2e tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:35.447831 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d9f03972-6a2b-4151-8bd9-4731f4d5cf2e tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:35.478589 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d9f03972-6a2b-4151-8bd9-4731f4d5cf2e tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1555 microversion: 2.91 time: 0.273246 Sep 08 10:51:35.493077 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1568/3141] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:51:35 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1555 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:51:35.493077 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-07ac2322-fd01-44a9-8c46-5ac2d1ab3982 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:35.493077 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-07ac2322-fd01-44a9-8c46-5ac2d1ab3982 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: d21f2600-ca01-4d47-b1f6-c4e8fa28d571] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:35.524643 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-07ac2322-fd01-44a9-8c46-5ac2d1ab3982 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:35.525486 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-07ac2322-fd01-44a9-8c46-5ac2d1ab3982 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:35.537952 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-07ac2322-fd01-44a9-8c46-5ac2d1ab3982 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:35.538985 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-07ac2322-fd01-44a9-8c46-5ac2d1ab3982 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:35.539619 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-07ac2322-fd01-44a9-8c46-5ac2d1ab3982 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:35.540215 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-07ac2322-fd01-44a9-8c46-5ac2d1ab3982 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:36.618507 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-07ac2322-fd01-44a9-8c46-5ac2d1ab3982 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86e8bd6f9048ce8718f432e51128a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c3752f739b47a296a5b88948fe7f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:36.643484 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-07ac2322-fd01-44a9-8c46-5ac2d1ab3982 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "GET /compute/v2.1/servers/d21f2600-ca01-4d47-b1f6-c4e8fa28d571" status: 200 len: 1325 microversion: 2.1 time: 1.156664 Sep 08 10:51:36.657396 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1569/3142] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:35 2022] GET /compute/v2.1/servers/d21f2600-ca01-4d47-b1f6-c4e8fa28d571 => generated 1325 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:36.657396 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e551b28f-c1d8-44eb-aa57-160262219fac tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:36.657396 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e551b28f-c1d8-44eb-aa57-160262219fac tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:36.675244 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e551b28f-c1d8-44eb-aa57-160262219fac tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:36.675764 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e551b28f-c1d8-44eb-aa57-160262219fac tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:36.676200 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e551b28f-c1d8-44eb-aa57-160262219fac tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:36.676975 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e551b28f-c1d8-44eb-aa57-160262219fac tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:36.677498 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e551b28f-c1d8-44eb-aa57-160262219fac tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:36.677985 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e551b28f-c1d8-44eb-aa57-160262219fac tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:37.335224 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=48,nova_api:DELETE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:51:37.461470 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e551b28f-c1d8-44eb-aa57-160262219fac tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:37.493721 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e551b28f-c1d8-44eb-aa57-160262219fac tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:37.513086 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e551b28f-c1d8-44eb-aa57-160262219fac tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:37.516063 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e551b28f-c1d8-44eb-aa57-160262219fac tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 200 len: 1875 microversion: 2.32 time: 0.866116 Sep 08 10:51:37.534420 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1570/3143] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:51:36 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 1875 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:51:37.565938 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7503dce5-7009-499f-9fb0-d2ccdc65ef7f tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:37.567121 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7503dce5-7009-499f-9fb0-d2ccdc65ef7f tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:37.583445 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7503dce5-7009-499f-9fb0-d2ccdc65ef7f tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:37.585578 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7503dce5-7009-499f-9fb0-d2ccdc65ef7f tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:37.587881 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7503dce5-7009-499f-9fb0-d2ccdc65ef7f tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:37.588973 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7503dce5-7009-499f-9fb0-d2ccdc65ef7f tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:37.592059 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7503dce5-7009-499f-9fb0-d2ccdc65ef7f tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:37.593962 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7503dce5-7009-499f-9fb0-d2ccdc65ef7f tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:37.953472 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7503dce5-7009-499f-9fb0-d2ccdc65ef7f tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:37.971599 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7503dce5-7009-499f-9fb0-d2ccdc65ef7f tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:37.973354 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7503dce5-7009-499f-9fb0-d2ccdc65ef7f tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:37.982015 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7503dce5-7009-499f-9fb0-d2ccdc65ef7f tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1555 microversion: 2.91 time: 0.445014 Sep 08 10:51:37.983722 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1571/3144] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:51:37 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1555 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:51:37.991292 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f80cda91-a35d-4ef0-8f99-d2690d0cda3d tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:37.992299 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f80cda91-a35d-4ef0-8f99-d2690d0cda3d tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: d21f2600-ca01-4d47-b1f6-c4e8fa28d571] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:38.000066 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f80cda91-a35d-4ef0-8f99-d2690d0cda3d tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:38.000892 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f80cda91-a35d-4ef0-8f99-d2690d0cda3d tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:38.001600 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f80cda91-a35d-4ef0-8f99-d2690d0cda3d tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:38.002996 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f80cda91-a35d-4ef0-8f99-d2690d0cda3d tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:38.003703 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f80cda91-a35d-4ef0-8f99-d2690d0cda3d tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:38.004423 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f80cda91-a35d-4ef0-8f99-d2690d0cda3d tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:38.701481 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=78 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:51:39.399321 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-dd45f9d0-d5fb-45bb-9f66-24e8835c9605 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] 10.222.0.27 "GET /compute/v2.1/images/8e1292c9-d905-432c-8f62-957946f8cb15" status: 200 len: 1426 microversion: 2.1 time: 10.677995 Sep 08 10:51:39.399919 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1574/3145] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:51:28 2022] GET /compute/v2.1/images/8e1292c9-d905-432c-8f62-957946f8cb15 => generated 1426 bytes in 10679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:39.418166 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f80cda91-a35d-4ef0-8f99-d2690d0cda3d tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86e8bd6f9048ce8718f432e51128a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c3752f739b47a296a5b88948fe7f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:39.445970 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-25b85980-013a-4348-9f5f-00fe1a12d49c tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:39.446680 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f80cda91-a35d-4ef0-8f99-d2690d0cda3d tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "GET /compute/v2.1/servers/d21f2600-ca01-4d47-b1f6-c4e8fa28d571" status: 200 len: 1325 microversion: 2.1 time: 1.456326 Sep 08 10:51:39.447874 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1572/3146] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:37 2022] GET /compute/v2.1/servers/d21f2600-ca01-4d47-b1f6-c4e8fa28d571 => generated 1325 bytes in 1463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:39.450805 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-25b85980-013a-4348-9f5f-00fe1a12d49c tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:39.457913 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5f8b5af9-0c58-4186-af7f-c2f73fd9189c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:39.468317 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5f8b5af9-0c58-4186-af7f-c2f73fd9189c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:39.478968 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25b85980-013a-4348-9f5f-00fe1a12d49c tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:39.480067 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25b85980-013a-4348-9f5f-00fe1a12d49c tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:39.483863 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25b85980-013a-4348-9f5f-00fe1a12d49c tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:39.489181 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25b85980-013a-4348-9f5f-00fe1a12d49c tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:39.491683 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25b85980-013a-4348-9f5f-00fe1a12d49c tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:39.494657 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5f8b5af9-0c58-4186-af7f-c2f73fd9189c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:39.495587 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25b85980-013a-4348-9f5f-00fe1a12d49c tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:39.499019 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5f8b5af9-0c58-4186-af7f-c2f73fd9189c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:39.504833 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5f8b5af9-0c58-4186-af7f-c2f73fd9189c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:39.506269 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5f8b5af9-0c58-4186-af7f-c2f73fd9189c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:39.508094 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5f8b5af9-0c58-4186-af7f-c2f73fd9189c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:39.508939 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5f8b5af9-0c58-4186-af7f-c2f73fd9189c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:39.808591 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5f8b5af9-0c58-4186-af7f-c2f73fd9189c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:39.835573 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5f8b5af9-0c58-4186-af7f-c2f73fd9189c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:39.843694 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5f8b5af9-0c58-4186-af7f-c2f73fd9189c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:39.873400 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5f8b5af9-0c58-4186-af7f-c2f73fd9189c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1555 microversion: 2.91 time: 0.424029 Sep 08 10:51:39.929217 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1573/3147] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:51:39 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1555 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:51:40.119755 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-0f9aa1ec-6d3d-4a62-bcde-b76c50219765 req-1454bf44-f787-4e92-8d08-cbb3713a4ce7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d21f2600-ca01-4d47-b1f6-c4e8fa28d571", "name": "network-vif-plugged", "status": "completed", "tag": "75359c42-7a36-4596-b8b7-328048472cc8"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:51:40.148580 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-0f9aa1ec-6d3d-4a62-bcde-b76c50219765 req-1454bf44-f787-4e92-8d08-cbb3713a4ce7 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:40.149663 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-0f9aa1ec-6d3d-4a62-bcde-b76c50219765 req-1454bf44-f787-4e92-8d08-cbb3713a4ce7 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:40.151758 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-0f9aa1ec-6d3d-4a62-bcde-b76c50219765 req-1454bf44-f787-4e92-8d08-cbb3713a4ce7 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:40.197207 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-0f9aa1ec-6d3d-4a62-bcde-b76c50219765 req-1454bf44-f787-4e92-8d08-cbb3713a4ce7 service nova] Creating event network-vif-plugged:75359c42-7a36-4596-b8b7-328048472cc8 for instance d21f2600-ca01-4d47-b1f6-c4e8fa28d571 on n-h1-850501-12 Sep 08 10:51:40.229248 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-0f9aa1ec-6d3d-4a62-bcde-b76c50219765 req-1454bf44-f787-4e92-8d08-cbb3713a4ce7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116994 Sep 08 10:51:40.230028 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1574/3148] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:51:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:51:40.417342 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0370879c-adb0-4ddc-9b33-a1271b66d204 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Calling method '.version_select at 0x7f68e5326f70>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:40.507681 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0370879c-adb0-4ddc-9b33-a1271b66d204 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] 10.222.0.27 "GET /compute/v2.1/images/8e1292c9-d905-432c-8f62-957946f8cb15" status: 200 len: 1426 microversion: 2.1 time: 0.094123 Sep 08 10:51:40.535727 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1575/3149] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:51:40 2022] GET /compute/v2.1/images/8e1292c9-d905-432c-8f62-957946f8cb15 => generated 1426 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:40.541960 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6ba646d3-636b-4f50-a744-ef0ee0af7f74 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:40.550136 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6ba646d3-636b-4f50-a744-ef0ee0af7f74 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: d21f2600-ca01-4d47-b1f6-c4e8fa28d571] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:40.572287 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6ba646d3-636b-4f50-a744-ef0ee0af7f74 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:40.573801 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6ba646d3-636b-4f50-a744-ef0ee0af7f74 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:40.575246 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6ba646d3-636b-4f50-a744-ef0ee0af7f74 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:40.577769 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6ba646d3-636b-4f50-a744-ef0ee0af7f74 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:40.579209 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6ba646d3-636b-4f50-a744-ef0ee0af7f74 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:40.580080 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6ba646d3-636b-4f50-a744-ef0ee0af7f74 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:40.928821 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-25b85980-013a-4348-9f5f-00fe1a12d49c tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:40.962481 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-25b85980-013a-4348-9f5f-00fe1a12d49c tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:40.964606 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-25b85980-013a-4348-9f5f-00fe1a12d49c tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:40.970905 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-25b85980-013a-4348-9f5f-00fe1a12d49c tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 200 len: 1875 microversion: 2.32 time: 1.539855 Sep 08 10:51:40.977784 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1575/3150] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:51:39 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 1875 bytes in 1577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:51:40.989316 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4e3a34d5-2c69-4245-8fba-b271e4acda3c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:41.000849 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4e3a34d5-2c69-4245-8fba-b271e4acda3c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:41.028174 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e3a34d5-2c69-4245-8fba-b271e4acda3c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:41.028681 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e3a34d5-2c69-4245-8fba-b271e4acda3c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:41.034691 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e3a34d5-2c69-4245-8fba-b271e4acda3c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:41.035618 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e3a34d5-2c69-4245-8fba-b271e4acda3c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:41.036111 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e3a34d5-2c69-4245-8fba-b271e4acda3c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:41.038775 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e3a34d5-2c69-4245-8fba-b271e4acda3c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:41.234146 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6ba646d3-636b-4f50-a744-ef0ee0af7f74 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86e8bd6f9048ce8718f432e51128a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c3752f739b47a296a5b88948fe7f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:41.261495 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6ba646d3-636b-4f50-a744-ef0ee0af7f74 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "GET /compute/v2.1/servers/d21f2600-ca01-4d47-b1f6-c4e8fa28d571" status: 200 len: 1325 microversion: 2.1 time: 0.718179 Sep 08 10:51:41.267015 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1576/3151] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:40 2022] GET /compute/v2.1/servers/d21f2600-ca01-4d47-b1f6-c4e8fa28d571 => generated 1325 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:41.423786 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4e3a34d5-2c69-4245-8fba-b271e4acda3c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:41.437326 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4e3a34d5-2c69-4245-8fba-b271e4acda3c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:41.438648 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4e3a34d5-2c69-4245-8fba-b271e4acda3c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:41.464430 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4e3a34d5-2c69-4245-8fba-b271e4acda3c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1537 microversion: 2.91 time: 0.485207 Sep 08 10:51:41.465104 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1576/3152] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:51:40 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1537 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:51:41.539505 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d9a8a88e-c44a-4270-9a52-b252e7fdf777 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Calling method '.version_select at 0x7f68e49180d0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:41.744904 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d9a8a88e-c44a-4270-9a52-b252e7fdf777 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] 10.222.0.27 "GET /compute/v2.1/images/8e1292c9-d905-432c-8f62-957946f8cb15" status: 200 len: 1426 microversion: 2.1 time: 0.212981 Sep 08 10:51:41.745611 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1577/3153] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:51:41 2022] GET /compute/v2.1/images/8e1292c9-d905-432c-8f62-957946f8cb15 => generated 1426 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:42.004518 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-642bd460-9d7a-47c2-952d-2797d05c57b6 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:42.006735 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-642bd460-9d7a-47c2-952d-2797d05c57b6 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:42.028190 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-642bd460-9d7a-47c2-952d-2797d05c57b6 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:42.028696 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-642bd460-9d7a-47c2-952d-2797d05c57b6 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:42.034768 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-642bd460-9d7a-47c2-952d-2797d05c57b6 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:42.042080 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-642bd460-9d7a-47c2-952d-2797d05c57b6 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:42.042576 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-642bd460-9d7a-47c2-952d-2797d05c57b6 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:42.047120 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-642bd460-9d7a-47c2-952d-2797d05c57b6 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:42.297324 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6ebb92b7-0396-4cfe-8b88-b04c41161d82 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:42.299428 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6ebb92b7-0396-4cfe-8b88-b04c41161d82 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: d21f2600-ca01-4d47-b1f6-c4e8fa28d571] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:42.312961 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6ebb92b7-0396-4cfe-8b88-b04c41161d82 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:42.316425 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6ebb92b7-0396-4cfe-8b88-b04c41161d82 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:42.320796 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6ebb92b7-0396-4cfe-8b88-b04c41161d82 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:42.323041 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6ebb92b7-0396-4cfe-8b88-b04c41161d82 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:42.326472 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6ebb92b7-0396-4cfe-8b88-b04c41161d82 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:42.327138 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6ebb92b7-0396-4cfe-8b88-b04c41161d82 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:42.553746 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-642bd460-9d7a-47c2-952d-2797d05c57b6 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:42.598347 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-642bd460-9d7a-47c2-952d-2797d05c57b6 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:42.599846 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-642bd460-9d7a-47c2-952d-2797d05c57b6 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:42.627799 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-642bd460-9d7a-47c2-952d-2797d05c57b6 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 200 len: 1875 microversion: 2.32 time: 0.628697 Sep 08 10:51:42.637798 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1577/3154] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:51:41 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 1875 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:51:42.649302 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6055c3c0-9818-42e4-8c91-e0511c99cc64 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:42.649930 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6055c3c0-9818-42e4-8c91-e0511c99cc64 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:42.686838 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6ebb92b7-0396-4cfe-8b88-b04c41161d82 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86e8bd6f9048ce8718f432e51128a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c3752f739b47a296a5b88948fe7f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:42.705935 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6055c3c0-9818-42e4-8c91-e0511c99cc64 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:42.706468 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6055c3c0-9818-42e4-8c91-e0511c99cc64 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:42.706755 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6ebb92b7-0396-4cfe-8b88-b04c41161d82 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "GET /compute/v2.1/servers/d21f2600-ca01-4d47-b1f6-c4e8fa28d571" status: 200 len: 1325 microversion: 2.1 time: 0.414763 Sep 08 10:51:42.706917 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6055c3c0-9818-42e4-8c91-e0511c99cc64 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:42.717876 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6055c3c0-9818-42e4-8c91-e0511c99cc64 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:42.718926 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1578/3155] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:42 2022] GET /compute/v2.1/servers/d21f2600-ca01-4d47-b1f6-c4e8fa28d571 => generated 1325 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:42.728684 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6055c3c0-9818-42e4-8c91-e0511c99cc64 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:42.735445 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6055c3c0-9818-42e4-8c91-e0511c99cc64 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:42.767556 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bc2d7053-31d3-4eac-b9f2-5bd477810dde tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Calling method '.version_select at 0x7f68e44f01f0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:42.862738 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bc2d7053-31d3-4eac-b9f2-5bd477810dde tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] 10.222.0.27 "GET /compute/v2.1/images/8e1292c9-d905-432c-8f62-957946f8cb15" status: 200 len: 1426 microversion: 2.1 time: 0.103836 Sep 08 10:51:42.870071 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1579/3156] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:51:42 2022] GET /compute/v2.1/images/8e1292c9-d905-432c-8f62-957946f8cb15 => generated 1426 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:42.953512 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6055c3c0-9818-42e4-8c91-e0511c99cc64 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:42.976333 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6055c3c0-9818-42e4-8c91-e0511c99cc64 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:42.978851 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6055c3c0-9818-42e4-8c91-e0511c99cc64 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:42.992183 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6055c3c0-9818-42e4-8c91-e0511c99cc64 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1537 microversion: 2.91 time: 0.350528 Sep 08 10:51:43.007713 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1578/3157] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:51:42 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1537 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:51:43.679547 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1c0f43cc-c401-4642-b9f5-24e3d9ee5045 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:43.680522 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1c0f43cc-c401-4642-b9f5-24e3d9ee5045 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:43.723617 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1c0f43cc-c401-4642-b9f5-24e3d9ee5045 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:43.730037 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1c0f43cc-c401-4642-b9f5-24e3d9ee5045 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:43.733819 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1c0f43cc-c401-4642-b9f5-24e3d9ee5045 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:43.736198 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1c0f43cc-c401-4642-b9f5-24e3d9ee5045 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:43.742658 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1c0f43cc-c401-4642-b9f5-24e3d9ee5045 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:43.743648 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1c0f43cc-c401-4642-b9f5-24e3d9ee5045 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:43.745359 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-386a96b7-0488-4862-a408-1d7ca43b31c8 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:43.746656 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-386a96b7-0488-4862-a408-1d7ca43b31c8 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: d21f2600-ca01-4d47-b1f6-c4e8fa28d571] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:43.769865 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-386a96b7-0488-4862-a408-1d7ca43b31c8 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:43.770395 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-386a96b7-0488-4862-a408-1d7ca43b31c8 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:43.770841 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-386a96b7-0488-4862-a408-1d7ca43b31c8 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:43.771579 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-386a96b7-0488-4862-a408-1d7ca43b31c8 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:43.772036 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-386a96b7-0488-4862-a408-1d7ca43b31c8 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:43.772462 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-386a96b7-0488-4862-a408-1d7ca43b31c8 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:44.422042 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1c0f43cc-c401-4642-b9f5-24e3d9ee5045 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:44.437127 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1c0f43cc-c401-4642-b9f5-24e3d9ee5045 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:44.443003 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1c0f43cc-c401-4642-b9f5-24e3d9ee5045 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:44.445584 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1c0f43cc-c401-4642-b9f5-24e3d9ee5045 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 200 len: 1875 microversion: 2.32 time: 0.780666 Sep 08 10:51:44.449302 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1580/3158] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:51:43 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 1875 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:51:44.480238 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-acedaebf-683e-4ddb-b48c-f8cb25563a13 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Calling method '.version_select at 0x7f68e44f0ca0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:44.567967 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-acedaebf-683e-4ddb-b48c-f8cb25563a13 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] 10.222.0.27 "GET /compute/v2.1/images/8e1292c9-d905-432c-8f62-957946f8cb15" status: 200 len: 1426 microversion: 2.1 time: 0.116015 Sep 08 10:51:44.569074 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1581/3159] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:51:44 2022] GET /compute/v2.1/images/8e1292c9-d905-432c-8f62-957946f8cb15 => generated 1426 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:44.582868 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8f980869-54de-43f5-ac09-cbc0bafc6e0a tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:44.586662 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8f980869-54de-43f5-ac09-cbc0bafc6e0a tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:44.601526 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f980869-54de-43f5-ac09-cbc0bafc6e0a tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:44.602285 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f980869-54de-43f5-ac09-cbc0bafc6e0a tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:44.604226 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f980869-54de-43f5-ac09-cbc0bafc6e0a tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:44.605167 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f980869-54de-43f5-ac09-cbc0bafc6e0a tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:44.605806 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f980869-54de-43f5-ac09-cbc0bafc6e0a tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:44.606453 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f980869-54de-43f5-ac09-cbc0bafc6e0a tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:44.700139 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8f980869-54de-43f5-ac09-cbc0bafc6e0a tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:44.710958 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8f980869-54de-43f5-ac09-cbc0bafc6e0a tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:44.713630 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8f980869-54de-43f5-ac09-cbc0bafc6e0a tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:44.721451 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8f980869-54de-43f5-ac09-cbc0bafc6e0a tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1540 microversion: 2.91 time: 0.142239 Sep 08 10:51:44.722606 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1582/3160] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:51:44 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1540 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:51:44.760229 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-97da1e4c-83bd-49ad-9e83-d0eace2b4bb7 tempest-UnshelveToHostMultiNodesTest-1667251479 tempest-UnshelveToHostMultiNodesTest-1667251479-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-850501-12"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:51:44.768884 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-97da1e4c-83bd-49ad-9e83-d0eace2b4bb7 tempest-UnshelveToHostMultiNodesTest-1667251479 tempest-UnshelveToHostMultiNodesTest-1667251479-project-admin] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:44.784269 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-97da1e4c-83bd-49ad-9e83-d0eace2b4bb7 tempest-UnshelveToHostMultiNodesTest-1667251479 tempest-UnshelveToHostMultiNodesTest-1667251479-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:44.785075 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-97da1e4c-83bd-49ad-9e83-d0eace2b4bb7 tempest-UnshelveToHostMultiNodesTest-1667251479 tempest-UnshelveToHostMultiNodesTest-1667251479-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:44.785746 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-97da1e4c-83bd-49ad-9e83-d0eace2b4bb7 tempest-UnshelveToHostMultiNodesTest-1667251479 tempest-UnshelveToHostMultiNodesTest-1667251479-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:44.787158 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-97da1e4c-83bd-49ad-9e83-d0eace2b4bb7 tempest-UnshelveToHostMultiNodesTest-1667251479 tempest-UnshelveToHostMultiNodesTest-1667251479-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:44.788240 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-97da1e4c-83bd-49ad-9e83-d0eace2b4bb7 tempest-UnshelveToHostMultiNodesTest-1667251479 tempest-UnshelveToHostMultiNodesTest-1667251479-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:44.802428 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-97da1e4c-83bd-49ad-9e83-d0eace2b4bb7 tempest-UnshelveToHostMultiNodesTest-1667251479 tempest-UnshelveToHostMultiNodesTest-1667251479-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:44.886750 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-97da1e4c-83bd-49ad-9e83-d0eace2b4bb7 tempest-UnshelveToHostMultiNodesTest-1667251479 tempest-UnshelveToHostMultiNodesTest-1667251479-project-admin] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-850501-12". {{(pid=128861) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 08 10:51:44.932977 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=100 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:51:45.069251 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-97da1e4c-83bd-49ad-9e83-d0eace2b4bb7 tempest-UnshelveToHostMultiNodesTest-1667251479 tempest-UnshelveToHostMultiNodesTest-1667251479-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b/action" status: 202 len: 0 microversion: 2.91 time: 0.318398 Sep 08 10:51:45.070682 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1583/3161] 10.222.0.27 () {62 vars in 1319 bytes} [Thu Sep 8 10:51:44 2022] POST /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b/action => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 08 10:51:45.084627 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6f761713-4e05-457b-82dc-74f829b8a482 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:45.085573 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6f761713-4e05-457b-82dc-74f829b8a482 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:45.126556 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6f761713-4e05-457b-82dc-74f829b8a482 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:45.127397 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6f761713-4e05-457b-82dc-74f829b8a482 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:45.128041 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6f761713-4e05-457b-82dc-74f829b8a482 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:45.129744 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6f761713-4e05-457b-82dc-74f829b8a482 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:45.130757 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6f761713-4e05-457b-82dc-74f829b8a482 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:45.131085 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6f761713-4e05-457b-82dc-74f829b8a482 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:45.286313 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6f761713-4e05-457b-82dc-74f829b8a482 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:45.310060 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6f761713-4e05-457b-82dc-74f829b8a482 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:45.314200 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6f761713-4e05-457b-82dc-74f829b8a482 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:45.333768 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6f761713-4e05-457b-82dc-74f829b8a482 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1548 microversion: 2.91 time: 0.258939 Sep 08 10:51:45.334453 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1584/3162] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:51:45 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1548 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:51:45.351434 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-386a96b7-0488-4862-a408-1d7ca43b31c8 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86e8bd6f9048ce8718f432e51128a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c3752f739b47a296a5b88948fe7f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:45.365356 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-386a96b7-0488-4862-a408-1d7ca43b31c8 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "GET /compute/v2.1/servers/d21f2600-ca01-4d47-b1f6-c4e8fa28d571" status: 200 len: 1325 microversion: 2.1 time: 1.621921 Sep 08 10:51:45.366168 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1579/3163] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:43 2022] GET /compute/v2.1/servers/d21f2600-ca01-4d47-b1f6-c4e8fa28d571 => generated 1325 bytes in 1626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:51:45.500843 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6b910aad-3a35-4a0c-a073-0f9aae565306 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:45.501763 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6b910aad-3a35-4a0c-a073-0f9aae565306 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:45.508605 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6b910aad-3a35-4a0c-a073-0f9aae565306 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:45.509326 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6b910aad-3a35-4a0c-a073-0f9aae565306 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:45.509873 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6b910aad-3a35-4a0c-a073-0f9aae565306 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:45.510672 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6b910aad-3a35-4a0c-a073-0f9aae565306 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:45.511213 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6b910aad-3a35-4a0c-a073-0f9aae565306 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:45.512125 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6b910aad-3a35-4a0c-a073-0f9aae565306 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:45.586057 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5e3d3230-aacf-4805-9e5a-0617b062992b tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Calling method '.version_select at 0x7f68e424e5e0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:45.980860 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5e3d3230-aacf-4805-9e5a-0617b062992b tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] 10.222.0.27 "GET /compute/v2.1/images/8e1292c9-d905-432c-8f62-957946f8cb15" status: 200 len: 1426 microversion: 2.1 time: 0.399320 Sep 08 10:51:45.985388 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1580/3164] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:51:45 2022] GET /compute/v2.1/images/8e1292c9-d905-432c-8f62-957946f8cb15 => generated 1426 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:51:46.150408 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6b910aad-3a35-4a0c-a073-0f9aae565306 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:46.171073 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6b910aad-3a35-4a0c-a073-0f9aae565306 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:46.178517 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6b910aad-3a35-4a0c-a073-0f9aae565306 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:46.179760 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6b910aad-3a35-4a0c-a073-0f9aae565306 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 200 len: 1875 microversion: 2.32 time: 0.690530 Sep 08 10:51:46.189447 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1585/3165] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:51:45 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 1875 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:51:46.369972 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-85175f68-fe55-4c91-b340-9e984cf3d467 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:46.370529 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-85175f68-fe55-4c91-b340-9e984cf3d467 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:46.387399 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-85175f68-fe55-4c91-b340-9e984cf3d467 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:46.387953 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-85175f68-fe55-4c91-b340-9e984cf3d467 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:46.388400 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-85175f68-fe55-4c91-b340-9e984cf3d467 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:46.390703 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-85175f68-fe55-4c91-b340-9e984cf3d467 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:46.390703 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-85175f68-fe55-4c91-b340-9e984cf3d467 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:46.390703 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-85175f68-fe55-4c91-b340-9e984cf3d467 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:46.408329 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-10649af4-d577-464c-8a75-e9bdb1ced383 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:46.413757 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-10649af4-d577-464c-8a75-e9bdb1ced383 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: d21f2600-ca01-4d47-b1f6-c4e8fa28d571] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:46.449300 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-10649af4-d577-464c-8a75-e9bdb1ced383 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:46.449804 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-10649af4-d577-464c-8a75-e9bdb1ced383 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:46.450250 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-10649af4-d577-464c-8a75-e9bdb1ced383 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:46.450966 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-10649af4-d577-464c-8a75-e9bdb1ced383 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:46.451503 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-10649af4-d577-464c-8a75-e9bdb1ced383 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:46.452287 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-10649af4-d577-464c-8a75-e9bdb1ced383 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:46.868679 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-85175f68-fe55-4c91-b340-9e984cf3d467 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:46.903133 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-85175f68-fe55-4c91-b340-9e984cf3d467 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:46.906617 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-85175f68-fe55-4c91-b340-9e984cf3d467 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:46.933493 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-85175f68-fe55-4c91-b340-9e984cf3d467 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1488 microversion: 2.91 time: 0.567127 Sep 08 10:51:46.934634 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1581/3166] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:51:46 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1488 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:51:47.002393 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-968915f6-9a56-47dd-88e0-55e5d943a839 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Calling method '.version_select at 0x7f68e4217f70>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:47.154991 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-968915f6-9a56-47dd-88e0-55e5d943a839 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] 10.222.0.27 "GET /compute/v2.1/images/8e1292c9-d905-432c-8f62-957946f8cb15" status: 200 len: 1426 microversion: 2.1 time: 0.149221 Sep 08 10:51:47.158346 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1582/3167] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:51:46 2022] GET /compute/v2.1/images/8e1292c9-d905-432c-8f62-957946f8cb15 => generated 1426 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:47.218981 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f27a6176-7bc1-4aac-8e1c-6a0223cfe427 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:47.221475 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f27a6176-7bc1-4aac-8e1c-6a0223cfe427 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:47.243128 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f27a6176-7bc1-4aac-8e1c-6a0223cfe427 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:47.245273 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f27a6176-7bc1-4aac-8e1c-6a0223cfe427 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:47.248988 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f27a6176-7bc1-4aac-8e1c-6a0223cfe427 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:47.255112 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f27a6176-7bc1-4aac-8e1c-6a0223cfe427 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:47.255840 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f27a6176-7bc1-4aac-8e1c-6a0223cfe427 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:47.256525 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f27a6176-7bc1-4aac-8e1c-6a0223cfe427 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:47.387466 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-10649af4-d577-464c-8a75-e9bdb1ced383 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86e8bd6f9048ce8718f432e51128a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c3752f739b47a296a5b88948fe7f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:47.403642 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-10649af4-d577-464c-8a75-e9bdb1ced383 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "GET /compute/v2.1/servers/d21f2600-ca01-4d47-b1f6-c4e8fa28d571" status: 200 len: 1521 microversion: 2.1 time: 1.004302 Sep 08 10:51:47.405391 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1586/3168] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:46 2022] GET /compute/v2.1/servers/d21f2600-ca01-4d47-b1f6-c4e8fa28d571 => generated 1521 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:47.448243 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6dec754a-0ef1-4b92-9d0c-999796759ac8 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:47.449019 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6dec754a-0ef1-4b92-9d0c-999796759ac8 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: d21f2600-ca01-4d47-b1f6-c4e8fa28d571] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:47.470810 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6dec754a-0ef1-4b92-9d0c-999796759ac8 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:47.473470 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6dec754a-0ef1-4b92-9d0c-999796759ac8 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:47.474227 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6dec754a-0ef1-4b92-9d0c-999796759ac8 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:47.478074 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6dec754a-0ef1-4b92-9d0c-999796759ac8 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:47.486159 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6dec754a-0ef1-4b92-9d0c-999796759ac8 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:47.489357 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6dec754a-0ef1-4b92-9d0c-999796759ac8 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:48.059231 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f27a6176-7bc1-4aac-8e1c-6a0223cfe427 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:48.095781 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f27a6176-7bc1-4aac-8e1c-6a0223cfe427 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:48.114323 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f27a6176-7bc1-4aac-8e1c-6a0223cfe427 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:48.117845 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f27a6176-7bc1-4aac-8e1c-6a0223cfe427 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 200 len: 1875 microversion: 2.32 time: 0.904807 Sep 08 10:51:48.153957 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1583/3169] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:51:47 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 1875 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:51:48.442024 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6dec754a-0ef1-4b92-9d0c-999796759ac8 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86e8bd6f9048ce8718f432e51128a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c3752f739b47a296a5b88948fe7f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:48.462295 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6dec754a-0ef1-4b92-9d0c-999796759ac8 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "GET /compute/v2.1/servers/d21f2600-ca01-4d47-b1f6-c4e8fa28d571" status: 200 len: 1521 microversion: 2.1 time: 1.018404 Sep 08 10:51:48.468160 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1587/3170] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:47 2022] GET /compute/v2.1/servers/d21f2600-ca01-4d47-b1f6-c4e8fa28d571 => generated 1521 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:51:48.484258 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-18370ccb-8848-4f15-860e-56d2df5e026c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:48.485943 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-18370ccb-8848-4f15-860e-56d2df5e026c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:48.501610 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-18370ccb-8848-4f15-860e-56d2df5e026c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:48.502143 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-18370ccb-8848-4f15-860e-56d2df5e026c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:48.502599 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-18370ccb-8848-4f15-860e-56d2df5e026c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:48.503440 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-18370ccb-8848-4f15-860e-56d2df5e026c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:48.504043 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-18370ccb-8848-4f15-860e-56d2df5e026c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:48.515841 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-18370ccb-8848-4f15-860e-56d2df5e026c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:48.829553 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-61915342-572b-4de8-95d0-55fa39c5883e tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:48.830168 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-61915342-572b-4de8-95d0-55fa39c5883e tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: f182d52b-9650-44f2-bd28-f2ae1daa1438] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:48.839848 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-61915342-572b-4de8-95d0-55fa39c5883e tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:48.841499 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-61915342-572b-4de8-95d0-55fa39c5883e tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:48.845211 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-61915342-572b-4de8-95d0-55fa39c5883e tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:48.846526 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-61915342-572b-4de8-95d0-55fa39c5883e tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:48.849596 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-61915342-572b-4de8-95d0-55fa39c5883e tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:48.851727 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-61915342-572b-4de8-95d0-55fa39c5883e tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:48.954737 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-61915342-572b-4de8-95d0-55fa39c5883e tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/f182d52b-9650-44f2-bd28-f2ae1daa1438/ips" status: 200 len: 150 microversion: 2.1 time: 0.797578 Sep 08 10:51:48.959316 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1584/3171] 10.222.0.27 () {58 vars in 1248 bytes} [Thu Sep 8 10:51:48 2022] GET /compute/v2.1/servers/f182d52b-9650-44f2-bd28-f2ae1daa1438/ips => generated 150 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:51:48.987615 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1aae5002-dd6d-4db7-9655-7358c9c96e73 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Calling method '.version_select at 0x7f68e440d5e0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:49.105828 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1aae5002-dd6d-4db7-9655-7358c9c96e73 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] 10.222.0.27 "GET /compute/v2.1/images/8e1292c9-d905-432c-8f62-957946f8cb15" status: 200 len: 1426 microversion: 2.1 time: 0.139002 Sep 08 10:51:49.120472 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1585/3172] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:51:48 2022] GET /compute/v2.1/images/8e1292c9-d905-432c-8f62-957946f8cb15 => generated 1426 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:49.136669 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-26780be7-ca23-4288-ac7a-992a5ee3216a tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1882712811"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:51:49.142984 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-26780be7-ca23-4288-ac7a-992a5ee3216a tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: d21f2600-ca01-4d47-b1f6-c4e8fa28d571] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:49.168889 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-26780be7-ca23-4288-ac7a-992a5ee3216a tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:49.172788 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-26780be7-ca23-4288-ac7a-992a5ee3216a tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:49.175000 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-26780be7-ca23-4288-ac7a-992a5ee3216a tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:49.176021 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-26780be7-ca23-4288-ac7a-992a5ee3216a tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:49.177557 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-26780be7-ca23-4288-ac7a-992a5ee3216a tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:49.179152 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-26780be7-ca23-4288-ac7a-992a5ee3216a tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:49.614961 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-26780be7-ca23-4288-ac7a-992a5ee3216a tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "POST /compute/v2.1/servers/d21f2600-ca01-4d47-b1f6-c4e8fa28d571/action" status: 202 len: 0 microversion: 2.1 time: 0.490927 Sep 08 10:51:49.625092 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1586/3173] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:51:49 2022] POST /compute/v2.1/servers/d21f2600-ca01-4d47-b1f6-c4e8fa28d571/action => generated 0 bytes in 502 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 08 10:51:49.658179 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-17eb5559-41dd-4030-ba4f-1f77fa8d213b tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:49.659499 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-17eb5559-41dd-4030-ba4f-1f77fa8d213b tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:49.703058 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-17eb5559-41dd-4030-ba4f-1f77fa8d213b tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:49.704750 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-17eb5559-41dd-4030-ba4f-1f77fa8d213b tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:49.705434 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-17eb5559-41dd-4030-ba4f-1f77fa8d213b tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:49.708538 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-17eb5559-41dd-4030-ba4f-1f77fa8d213b tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:49.710340 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-17eb5559-41dd-4030-ba4f-1f77fa8d213b tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:49.711966 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-17eb5559-41dd-4030-ba4f-1f77fa8d213b tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:50.082477 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-18370ccb-8848-4f15-860e-56d2df5e026c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:50.093077 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-18370ccb-8848-4f15-860e-56d2df5e026c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:50.118774 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-18370ccb-8848-4f15-860e-56d2df5e026c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:50.152863 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-18370ccb-8848-4f15-860e-56d2df5e026c tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1546 microversion: 2.91 time: 1.683178 Sep 08 10:51:50.166676 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1588/3174] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:51:48 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1546 bytes in 1698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:51:50.925318 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-17eb5559-41dd-4030-ba4f-1f77fa8d213b tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:50.953209 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-17eb5559-41dd-4030-ba4f-1f77fa8d213b tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:50.956888 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-17eb5559-41dd-4030-ba4f-1f77fa8d213b tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:50.960489 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-17eb5559-41dd-4030-ba4f-1f77fa8d213b tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 200 len: 1875 microversion: 2.32 time: 1.335020 Sep 08 10:51:50.967327 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1587/3175] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:51:49 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 1875 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:51:50.978353 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3cfdba9c-8017-4e67-991e-b7582bec19d5 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Calling method '.version_select at 0x7f68e4222a60>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:51.064445 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2ce36359-810f-45ec-a8e4-b3f8bbd3588d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Action: 'create', calling method: .version_select at 0x7f68e4cf18b0>, body: {"keypair": {"name": "tempest-keypair-1982550133", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzYoReZOfCkeqWeCu0bUUZ8r4iMH00BiKJhKlckjx/XA9chMylX42i6tinulOnCA4FrYfcwd6NLjxYHHap7RcQ9geSgOc1Uvy0tHbbC3/MbEOt80VdbdWhUtA8jCE9ynw=="}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:51:51.143037 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-2ce36359-810f-45ec-a8e4-b3f8bbd3588d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Getting quotas for project 11b5d4706b2d43aca8290ccf07ee1ece. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:51:51.159344 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-2ce36359-810f-45ec-a8e4-b3f8bbd3588d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Getting quotas for user d68b017335c84d15becbdc7615498103 and project 11b5d4706b2d43aca8290ccf07ee1ece. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:51:51.199830 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=100 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:51:51.208267 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2ce36359-810f-45ec-a8e4-b3f8bbd3588d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.040152 Sep 08 10:51:51.229877 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1589/3176] 10.222.0.27 () {60 vars in 1159 bytes} [Thu Sep 8 10:51:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:51:51.243383 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ba902838-0f6c-4f80-8860-eb8c95a086de tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Calling method '.version_select at 0x7f68e493dee0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:51.585292 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3cfdba9c-8017-4e67-991e-b7582bec19d5 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "DELETE /compute/v2.1/images/aee7b4e9-1763-4199-826c-6b708d518e8e" status: 204 len: 0 microversion: 2.1 time: 0.614397 Sep 08 10:51:51.590127 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1588/3177] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:50 2022] DELETE /compute/v2.1/images/aee7b4e9-1763-4199-826c-6b708d518e8e => generated 0 bytes in 617 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:51:51.606077 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-33f5a34d-dff5-498d-9ebc-8373749a2e00 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:51.610391 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-33f5a34d-dff5-498d-9ebc-8373749a2e00 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:51.655831 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33f5a34d-dff5-498d-9ebc-8373749a2e00 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:51.660192 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33f5a34d-dff5-498d-9ebc-8373749a2e00 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:51.663741 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33f5a34d-dff5-498d-9ebc-8373749a2e00 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:51.669824 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33f5a34d-dff5-498d-9ebc-8373749a2e00 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:51.674692 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33f5a34d-dff5-498d-9ebc-8373749a2e00 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:51.679322 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33f5a34d-dff5-498d-9ebc-8373749a2e00 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:51.719418 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ba902838-0f6c-4f80-8860-eb8c95a086de tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] 10.222.0.27 "GET /compute/v2.1/images/8e1292c9-d905-432c-8f62-957946f8cb15" status: 200 len: 1426 microversion: 2.1 time: 0.488049 Sep 08 10:51:51.720018 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1590/3178] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:51:51 2022] GET /compute/v2.1/images/8e1292c9-d905-432c-8f62-957946f8cb15 => generated 1426 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:51.766879 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-aa3c8e33-4881-47db-b657-f4b61b847728 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Calling method '.version_select at 0x7f68e4918430>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:51.821199 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-aa3c8e33-4881-47db-b657-f4b61b847728 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] HTTP exception thrown: Image not found. Sep 08 10:51:51.823583 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-aa3c8e33-4881-47db-b657-f4b61b847728 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Request method failure captured: Sep 08 10:51:51.823583 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/images/aee7b4e9-1763-4199-826c-6b708d518e8e HTTP/1.1 Sep 08 10:51:51.823583 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:51:51.823583 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:51:51.823583 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:51:51.823583 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:51:51.823583 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:51:51.823583 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:51:51.823583 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:51:51.823583 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:51:51.823583 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcjivLUY-NOpubj4piWQUE4YdjVoieEQ-G0L0ay9l2jNqBIueJ_eB4w8-Iohm-hEbdImfT6Vv0CotgGIogaerBRfcTAAw-NhjLbx2EjcqsYLMFxCPLjOPfzXaEWWRNcumoyYDLdNDrrGczsG7GBIlwK26oqS5wWNAPkM7DBSBKGgOFQ Sep 08 10:51:51.823583 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:51:51.823583 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:51:51.823583 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:51:51.823583 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:51:51.823583 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:51:51.823583 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:51:51.823583 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 50c3752f739b47a296a5b88948fe7f7f Sep 08 10:51:51.823583 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1836029851 Sep 08 10:51:51.823583 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:51:51.823583 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:51:51.823583 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/50c3752f739b47a296a5b88948fe7f7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/50c3752f739b47a296a5b88948fe7f7f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_50c3752f739b47a296a5b88948fe7f7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/50c3752f739b47a296a5b88948fe7f7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:51:51.823583 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1836029851 Sep 08 10:51:51.823583 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 50c3752f739b47a296a5b88948fe7f7f Sep 08 10:51:51.823583 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1836029851 Sep 08 10:51:51.823583 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ImagesOneServerNegativeTestJSON-1836029851-project Sep 08 10:51:51.823583 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:51:51.823583 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:51:51.823583 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 7c86e8bd6f9048ce8718f432e51128a5 Sep 08 10:51:51.823583 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1836029851-project Sep 08 10:51:51.823583 n-d-850501-12 devstack@n-api.service[128861]: method: Sep 08 10:51:51.823583 n-d-850501-12 devstack@n-api.service[128861]: exception: Image not found. Sep 08 10:51:51.823583 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': 'aee7b4e9-1763-4199-826c-6b708d518e8e'} Sep 08 10:51:51.823583 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:51:51.823583 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:51:51.823583 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 08 10:51:51.823583 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 08 10:51:51.823583 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 10:51:51.823583 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 10:51:51.823583 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 08 10:51:51.823583 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 08 10:51:51.823583 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 10:51:51.823583 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 10:51:51.823583 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 08 10:51:51.823583 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 08 10:51:51.823583 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 08 10:51:51.823583 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 08 10:51:51.823583 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 10:51:51.823583 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 10:51:51.823583 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 10:51:51.823583 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 10:51:51.823583 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID aee7b4e9-1763-4199-826c-6b708d518e8e Sep 08 10:51:51.823583 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:51:51.823583 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:51:51.823583 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:51:51.823583 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:51:51.823583 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 08 10:51:51.823583 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 08 10:51:51.823583 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 08 10:51:51.823583 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 08 10:51:51.823583 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 08 10:51:51.823583 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 08 10:51:51.823583 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 08 10:51:51.828908 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 08 10:51:51.828908 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 08 10:51:51.828908 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 08 10:51:51.828908 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 10:51:51.828908 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 10:51:51.828908 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 08 10:51:51.828908 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 08 10:51:51.828908 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 10:51:51.828908 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 10:51:51.828908 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 08 10:51:51.828908 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 08 10:51:51.828908 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 08 10:51:51.828908 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 08 10:51:51.828908 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 10:51:51.828908 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 10:51:51.828908 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 10:51:51.828908 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 10:51:51.828908 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image aee7b4e9-1763-4199-826c-6b708d518e8e could not be found. Sep 08 10:51:51.828908 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:51:51.828908 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:51:51.828908 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:51:51.828908 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:51:51.828908 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:51:51.828908 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:51:51.828908 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:51:51.828908 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:51:51.828908 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:51:51.828908 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:51:51.828908 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:51:51.828908 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:51:51.828908 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 08 10:51:51.828908 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 08 10:51:51.828908 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 08 10:51:51.828908 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:51:51.828908 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:51:51.828908 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:51:51.828908 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:51:51.828908 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:51:51.828908 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:51:51.828908 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:51:51.828908 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:51:51.828908 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 08 10:51:51.828908 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:51:51.833885 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-aa3c8e33-4881-47db-b657-f4b61b847728 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Returning 404 to user: Image not found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:51:51.839499 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-aa3c8e33-4881-47db-b657-f4b61b847728 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "GET /compute/v2.1/images/aee7b4e9-1763-4199-826c-6b708d518e8e" status: 404 len: 62 microversion: 2.1 time: 0.110673 Sep 08 10:51:51.840569 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1591/3179] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:51:51 2022] GET /compute/v2.1/images/aee7b4e9-1763-4199-826c-6b708d518e8e => generated 62 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:51:51.879505 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3e9e258d-a874-4aaa-b962-13760b7737a6 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:51.888997 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3e9e258d-a874-4aaa-b962-13760b7737a6 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: d21f2600-ca01-4d47-b1f6-c4e8fa28d571] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:51.936121 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3e9e258d-a874-4aaa-b962-13760b7737a6 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:51.944661 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3e9e258d-a874-4aaa-b962-13760b7737a6 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:51.945365 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3e9e258d-a874-4aaa-b962-13760b7737a6 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:51.946599 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3e9e258d-a874-4aaa-b962-13760b7737a6 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:51.947094 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3e9e258d-a874-4aaa-b962-13760b7737a6 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:51.947562 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3e9e258d-a874-4aaa-b962-13760b7737a6 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:52.055842 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-33f5a34d-dff5-498d-9ebc-8373749a2e00 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:52.066560 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-33f5a34d-dff5-498d-9ebc-8373749a2e00 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:52.072734 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-33f5a34d-dff5-498d-9ebc-8373749a2e00 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:52.105852 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-33f5a34d-dff5-498d-9ebc-8373749a2e00 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1546 microversion: 2.91 time: 0.517037 Sep 08 10:51:52.106829 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1589/3180] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:51:51 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1546 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:51:52.112251 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-46a05555-026c-42cf-be88-94274c0ea118 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:52.124619 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-46a05555-026c-42cf-be88-94274c0ea118 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:52.139491 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-46a05555-026c-42cf-be88-94274c0ea118 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:52.164164 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-46a05555-026c-42cf-be88-94274c0ea118 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:52.168542 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-46a05555-026c-42cf-be88-94274c0ea118 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:52.170539 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-46a05555-026c-42cf-be88-94274c0ea118 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:52.177635 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-46a05555-026c-42cf-be88-94274c0ea118 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:52.182573 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-46a05555-026c-42cf-be88-94274c0ea118 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:53.355556 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-3e9e258d-a874-4aaa-b962-13760b7737a6 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86e8bd6f9048ce8718f432e51128a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c3752f739b47a296a5b88948fe7f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:53.373730 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-46a05555-026c-42cf-be88-94274c0ea118 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:53.384231 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3e9e258d-a874-4aaa-b962-13760b7737a6 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "GET /compute/v2.1/servers/d21f2600-ca01-4d47-b1f6-c4e8fa28d571" status: 200 len: 1539 microversion: 2.1 time: 1.536422 Sep 08 10:51:53.390055 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1592/3181] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:51 2022] GET /compute/v2.1/servers/d21f2600-ca01-4d47-b1f6-c4e8fa28d571 => generated 1539 bytes in 1543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:53.394645 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-46a05555-026c-42cf-be88-94274c0ea118 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:53.396158 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-46a05555-026c-42cf-be88-94274c0ea118 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:53.397393 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-46a05555-026c-42cf-be88-94274c0ea118 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 200 len: 1875 microversion: 2.32 time: 1.289277 Sep 08 10:51:53.397974 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1590/3182] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:51:52 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 1875 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:51:53.406560 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-74dde832-82f5-4b5b-91f6-1f2e89d311c0 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Calling method '.version_select at 0x7f68e4918b80>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:53.446462 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3b8c6fc2-f402-4d8d-8ce6-67a1a11470c2 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:53.447074 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3b8c6fc2-f402-4d8d-8ce6-67a1a11470c2 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:53.508673 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b8c6fc2-f402-4d8d-8ce6-67a1a11470c2 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:53.509211 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b8c6fc2-f402-4d8d-8ce6-67a1a11470c2 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:53.509651 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b8c6fc2-f402-4d8d-8ce6-67a1a11470c2 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:53.518324 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b8c6fc2-f402-4d8d-8ce6-67a1a11470c2 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:53.519014 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b8c6fc2-f402-4d8d-8ce6-67a1a11470c2 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:53.519470 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b8c6fc2-f402-4d8d-8ce6-67a1a11470c2 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:53.779635 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3b8c6fc2-f402-4d8d-8ce6-67a1a11470c2 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:53.801122 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3b8c6fc2-f402-4d8d-8ce6-67a1a11470c2 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:53.818800 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3b8c6fc2-f402-4d8d-8ce6-67a1a11470c2 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:53.850834 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3b8c6fc2-f402-4d8d-8ce6-67a1a11470c2 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1546 microversion: 2.91 time: 0.408614 Sep 08 10:51:53.861320 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1591/3183] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:51:53 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1546 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:51:53.900646 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5439a2e4-0a24-445f-afbb-154c0fc248f9 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ec103176-3e38-4182-89db-1b883022c1af"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:51:53.915036 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5439a2e4-0a24-445f-afbb-154c0fc248f9 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: f182d52b-9650-44f2-bd28-f2ae1daa1438] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:53.924014 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5439a2e4-0a24-445f-afbb-154c0fc248f9 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:53.937483 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5439a2e4-0a24-445f-afbb-154c0fc248f9 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:53.939182 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5439a2e4-0a24-445f-afbb-154c0fc248f9 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:53.945118 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5439a2e4-0a24-445f-afbb-154c0fc248f9 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:53.945884 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5439a2e4-0a24-445f-afbb-154c0fc248f9 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:53.946592 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5439a2e4-0a24-445f-afbb-154c0fc248f9 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:54.520503 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5439a2e4-0a24-445f-afbb-154c0fc248f9 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "POST /compute/v2.1/servers/f182d52b-9650-44f2-bd28-f2ae1daa1438/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.655293 Sep 08 10:51:54.521253 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1592/3184] 10.222.0.27 () {60 vars in 1323 bytes} [Thu Sep 8 10:51:53 2022] POST /compute/v2.1/servers/f182d52b-9650-44f2-bd28-f2ae1daa1438/os-volume_attachments => generated 194 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:51:54.546548 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8c3d0cbd-a418-4dac-b7f5-80adc6f9388d tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:54.552768 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8c3d0cbd-a418-4dac-b7f5-80adc6f9388d tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: d21f2600-ca01-4d47-b1f6-c4e8fa28d571] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:54.573868 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c3d0cbd-a418-4dac-b7f5-80adc6f9388d tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:54.579337 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c3d0cbd-a418-4dac-b7f5-80adc6f9388d tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:54.581288 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c3d0cbd-a418-4dac-b7f5-80adc6f9388d tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:54.582168 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c3d0cbd-a418-4dac-b7f5-80adc6f9388d tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:54.585579 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c3d0cbd-a418-4dac-b7f5-80adc6f9388d tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:54.586248 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c3d0cbd-a418-4dac-b7f5-80adc6f9388d tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:54.666095 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:51:55.108209 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8c3d0cbd-a418-4dac-b7f5-80adc6f9388d tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86e8bd6f9048ce8718f432e51128a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c3752f739b47a296a5b88948fe7f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:55.119659 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8c3d0cbd-a418-4dac-b7f5-80adc6f9388d tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "GET /compute/v2.1/servers/d21f2600-ca01-4d47-b1f6-c4e8fa28d571" status: 200 len: 1534 microversion: 2.1 time: 0.596258 Sep 08 10:51:55.120515 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1593/3185] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:54 2022] GET /compute/v2.1/servers/d21f2600-ca01-4d47-b1f6-c4e8fa28d571 => generated 1534 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:55.139362 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-666424c6-9034-4177-b414-9c77175db1e8 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:55.140297 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-666424c6-9034-4177-b414-9c77175db1e8 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:55.148223 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-666424c6-9034-4177-b414-9c77175db1e8 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:55.149276 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-666424c6-9034-4177-b414-9c77175db1e8 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:55.150558 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-666424c6-9034-4177-b414-9c77175db1e8 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:55.175688 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-666424c6-9034-4177-b414-9c77175db1e8 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:55.176621 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-666424c6-9034-4177-b414-9c77175db1e8 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:55.177303 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-666424c6-9034-4177-b414-9c77175db1e8 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:55.700019 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-74dde832-82f5-4b5b-91f6-1f2e89d311c0 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] 10.222.0.27 "GET /compute/v2.1/images/8e1292c9-d905-432c-8f62-957946f8cb15" status: 200 len: 1435 microversion: 2.1 time: 2.304104 Sep 08 10:51:55.708197 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1593/3186] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:51:53 2022] GET /compute/v2.1/images/8e1292c9-d905-432c-8f62-957946f8cb15 => generated 1435 bytes in 2317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:55.725213 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-666424c6-9034-4177-b414-9c77175db1e8 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:55.737250 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e855ae8d-7ad9-4064-845c-6eed7d3553da tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:55.746197 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e855ae8d-7ad9-4064-845c-6eed7d3553da tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:55.757994 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-666424c6-9034-4177-b414-9c77175db1e8 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:55.760274 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-666424c6-9034-4177-b414-9c77175db1e8 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:55.762967 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e855ae8d-7ad9-4064-845c-6eed7d3553da tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:55.763647 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e855ae8d-7ad9-4064-845c-6eed7d3553da tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:55.764281 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e855ae8d-7ad9-4064-845c-6eed7d3553da tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:55.765176 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e855ae8d-7ad9-4064-845c-6eed7d3553da tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:55.767170 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-666424c6-9034-4177-b414-9c77175db1e8 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 200 len: 1875 microversion: 2.32 time: 0.640624 Sep 08 10:51:55.781700 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e855ae8d-7ad9-4064-845c-6eed7d3553da tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:55.782385 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e855ae8d-7ad9-4064-845c-6eed7d3553da tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:55.792264 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1594/3187] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:51:55 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 1875 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:51:55.814040 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3e981912-2ff7-4a69-8a60-0d61edf60efd tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Calling method '.version_select at 0x7f68e41ba940>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:55.969067 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3e981912-2ff7-4a69-8a60-0d61edf60efd tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] 10.222.0.27 "GET /compute/v2.1/images/8e1292c9-d905-432c-8f62-957946f8cb15" status: 200 len: 1435 microversion: 2.1 time: 0.170705 Sep 08 10:51:55.975719 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1595/3188] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Sep 8 10:51:55 2022] GET /compute/v2.1/images/8e1292c9-d905-432c-8f62-957946f8cb15 => generated 1435 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:56.000802 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b99afcba-affc-4338-965b-c1cd61b4c268 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:56.007406 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b99afcba-affc-4338-965b-c1cd61b4c268 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] [instance: 9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:56.039637 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b99afcba-affc-4338-965b-c1cd61b4c268 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:56.058007 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b99afcba-affc-4338-965b-c1cd61b4c268 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:56.061224 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b99afcba-affc-4338-965b-c1cd61b4c268 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:56.063524 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b99afcba-affc-4338-965b-c1cd61b4c268 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:56.064679 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b99afcba-affc-4338-965b-c1cd61b4c268 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:56.069283 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b99afcba-affc-4338-965b-c1cd61b4c268 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:56.278499 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e855ae8d-7ad9-4064-845c-6eed7d3553da tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:56.298016 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e855ae8d-7ad9-4064-845c-6eed7d3553da tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:56.299825 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e855ae8d-7ad9-4064-845c-6eed7d3553da tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:56.363007 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e855ae8d-7ad9-4064-845c-6eed7d3553da tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1546 microversion: 2.91 time: 0.633573 Sep 08 10:51:56.367404 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1594/3189] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:51:55 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1546 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:51:56.372820 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-25389f8d-14c9-4235-bad3-1db1989448b8 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:56.392351 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-25389f8d-14c9-4235-bad3-1db1989448b8 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: d21f2600-ca01-4d47-b1f6-c4e8fa28d571] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:56.413268 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b99afcba-affc-4338-965b-c1cd61b4c268 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db1b83d2b924ed4855ebe9360c9b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8737f6bb9629491d958debd24aa6f9a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:56.415442 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-25389f8d-14c9-4235-bad3-1db1989448b8 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:56.416063 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-25389f8d-14c9-4235-bad3-1db1989448b8 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:56.421361 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-25389f8d-14c9-4235-bad3-1db1989448b8 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:56.422923 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-25389f8d-14c9-4235-bad3-1db1989448b8 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:56.423705 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-25389f8d-14c9-4235-bad3-1db1989448b8 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:56.424360 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-25389f8d-14c9-4235-bad3-1db1989448b8 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:56.433803 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b99afcba-affc-4338-965b-c1cd61b4c268 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] 10.222.0.27 "GET /compute/v2.1/servers/9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf" status: 200 len: 1479 microversion: 2.1 time: 0.445294 Sep 08 10:51:56.445182 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1596/3190] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:55 2022] GET /compute/v2.1/servers/9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf => generated 1479 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:56.805982 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bd99dd6a-aff5-495a-97f3-8c34421d4dfb tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:56.806672 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bd99dd6a-aff5-495a-97f3-8c34421d4dfb tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:56.824239 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bd99dd6a-aff5-495a-97f3-8c34421d4dfb tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:56.826210 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bd99dd6a-aff5-495a-97f3-8c34421d4dfb tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:56.828149 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bd99dd6a-aff5-495a-97f3-8c34421d4dfb tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:56.829328 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bd99dd6a-aff5-495a-97f3-8c34421d4dfb tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:56.829721 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bd99dd6a-aff5-495a-97f3-8c34421d4dfb tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:56.830174 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bd99dd6a-aff5-495a-97f3-8c34421d4dfb tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:57.434729 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bd99dd6a-aff5-495a-97f3-8c34421d4dfb tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:57.455740 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bd99dd6a-aff5-495a-97f3-8c34421d4dfb tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:57.459005 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bd99dd6a-aff5-495a-97f3-8c34421d4dfb tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:57.463084 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bd99dd6a-aff5-495a-97f3-8c34421d4dfb tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 200 len: 1875 microversion: 2.32 time: 0.662930 Sep 08 10:51:57.479466 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1597/3191] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:51:56 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 1875 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:51:57.495862 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-64049916-deb9-4c35-b5f7-d510f1555ac1 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:57.498690 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-64049916-deb9-4c35-b5f7-d510f1555ac1 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:57.508103 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64049916-deb9-4c35-b5f7-d510f1555ac1 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:57.508670 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64049916-deb9-4c35-b5f7-d510f1555ac1 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:57.509142 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64049916-deb9-4c35-b5f7-d510f1555ac1 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:57.509874 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64049916-deb9-4c35-b5f7-d510f1555ac1 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:57.510354 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64049916-deb9-4c35-b5f7-d510f1555ac1 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:57.510790 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64049916-deb9-4c35-b5f7-d510f1555ac1 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:57.708289 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-64049916-deb9-4c35-b5f7-d510f1555ac1 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:57.731459 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-64049916-deb9-4c35-b5f7-d510f1555ac1 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:57.737882 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-64049916-deb9-4c35-b5f7-d510f1555ac1 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:57.754335 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-64049916-deb9-4c35-b5f7-d510f1555ac1 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1546 microversion: 2.91 time: 0.271625 Sep 08 10:51:57.765061 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1598/3192] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:51:57 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1546 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:51:57.777063 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f8256d17-e807-4643-9dd3-c607781451cd tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:57.777063 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f8256d17-e807-4643-9dd3-c607781451cd tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] [instance: 9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:57.793060 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f8256d17-e807-4643-9dd3-c607781451cd tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:57.793273 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f8256d17-e807-4643-9dd3-c607781451cd tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:57.795041 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f8256d17-e807-4643-9dd3-c607781451cd tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:57.797580 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f8256d17-e807-4643-9dd3-c607781451cd tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:57.800023 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f8256d17-e807-4643-9dd3-c607781451cd tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:57.803556 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f8256d17-e807-4643-9dd3-c607781451cd tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:58.195038 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-25389f8d-14c9-4235-bad3-1db1989448b8 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86e8bd6f9048ce8718f432e51128a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c3752f739b47a296a5b88948fe7f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:58.210338 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-25389f8d-14c9-4235-bad3-1db1989448b8 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "GET /compute/v2.1/servers/d21f2600-ca01-4d47-b1f6-c4e8fa28d571" status: 200 len: 1521 microversion: 2.1 time: 1.841199 Sep 08 10:51:58.211453 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1595/3193] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:56 2022] GET /compute/v2.1/servers/d21f2600-ca01-4d47-b1f6-c4e8fa28d571 => generated 1521 bytes in 1843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:58.248154 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fd413155-7aa3-4a9d-b684-a17cb5b6b38c tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:58.262375 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fd413155-7aa3-4a9d-b684-a17cb5b6b38c tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: d21f2600-ca01-4d47-b1f6-c4e8fa28d571] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:58.281087 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f8256d17-e807-4643-9dd3-c607781451cd tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db1b83d2b924ed4855ebe9360c9b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8737f6bb9629491d958debd24aa6f9a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:58.298840 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f8256d17-e807-4643-9dd3-c607781451cd tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] 10.222.0.27 "GET /compute/v2.1/servers/9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf" status: 200 len: 1466 microversion: 2.1 time: 0.536464 Sep 08 10:51:58.301591 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1599/3194] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:57 2022] GET /compute/v2.1/servers/9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf => generated 1466 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:58.347571 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fd413155-7aa3-4a9d-b684-a17cb5b6b38c tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:58.348837 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b3e706da-345d-402b-b827-98a4dc2f9309 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Calling method '.version_select at 0x7f68e4254ca0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:58.350135 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fd413155-7aa3-4a9d-b684-a17cb5b6b38c tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:58.351988 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fd413155-7aa3-4a9d-b684-a17cb5b6b38c tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:58.358001 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fd413155-7aa3-4a9d-b684-a17cb5b6b38c tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:58.360522 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fd413155-7aa3-4a9d-b684-a17cb5b6b38c tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:58.364248 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fd413155-7aa3-4a9d-b684-a17cb5b6b38c tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:58.467185 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fd413155-7aa3-4a9d-b684-a17cb5b6b38c tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: d21f2600-ca01-4d47-b1f6-c4e8fa28d571] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:51:58.735758 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fd413155-7aa3-4a9d-b684-a17cb5b6b38c tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d21f2600-ca01-4d47-b1f6-c4e8fa28d571" status: 204 len: 0 microversion: 2.1 time: 0.494516 Sep 08 10:51:58.739513 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1596/3195] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:51:58 2022] DELETE /compute/v2.1/servers/d21f2600-ca01-4d47-b1f6-c4e8fa28d571 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:51:58.768193 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-caf7d5c5-f4aa-4135-ba9d-663d876fd970 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:58.769350 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-caf7d5c5-f4aa-4135-ba9d-663d876fd970 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:58.791856 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-caf7d5c5-f4aa-4135-ba9d-663d876fd970 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:58.796937 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-caf7d5c5-f4aa-4135-ba9d-663d876fd970 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:58.801078 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-caf7d5c5-f4aa-4135-ba9d-663d876fd970 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:58.808902 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-caf7d5c5-f4aa-4135-ba9d-663d876fd970 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:58.810630 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-caf7d5c5-f4aa-4135-ba9d-663d876fd970 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:58.811477 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-caf7d5c5-f4aa-4135-ba9d-663d876fd970 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:59.693769 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-caf7d5c5-f4aa-4135-ba9d-663d876fd970 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:59.694357 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b3e706da-345d-402b-b827-98a4dc2f9309 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] 10.222.0.27 "DELETE /compute/v2.1/images/8e1292c9-d905-432c-8f62-957946f8cb15" status: 204 len: 0 microversion: 2.1 time: 1.350846 Sep 08 10:51:59.695375 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1600/3196] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:58 2022] DELETE /compute/v2.1/images/8e1292c9-d905-432c-8f62-957946f8cb15 => generated 0 bytes in 1353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:51:59.702824 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f1e88f1f-b39a-4dd9-80c8-b9becba87c68 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-469677584", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b9022ed4-d5a1-4655-b50c-e8de49533ecf"}], "security_groups": [{"name": "tempest-securitygroup--2109155967"}], "key_name": "tempest-keypair-1982550133", "user_data": "}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:51:59.715553 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-caf7d5c5-f4aa-4135-ba9d-663d876fd970 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:59.719209 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-caf7d5c5-f4aa-4135-ba9d-663d876fd970 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:59.728208 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-caf7d5c5-f4aa-4135-ba9d-663d876fd970 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 200 len: 1875 microversion: 2.32 time: 0.984976 Sep 08 10:51:59.729719 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1597/3197] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:51:58 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 1875 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:51:59.749097 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5f44914b-b896-4236-b27e-e37beb8ed6a0 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:59.753420 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5f44914b-b896-4236-b27e-e37beb8ed6a0 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: d21f2600-ca01-4d47-b1f6-c4e8fa28d571] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:59.769730 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5f44914b-b896-4236-b27e-e37beb8ed6a0 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:59.771343 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5f44914b-b896-4236-b27e-e37beb8ed6a0 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:59.772411 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5f44914b-b896-4236-b27e-e37beb8ed6a0 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:59.778982 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5f44914b-b896-4236-b27e-e37beb8ed6a0 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:59.779779 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5f44914b-b896-4236-b27e-e37beb8ed6a0 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:59.780546 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5f44914b-b896-4236-b27e-e37beb8ed6a0 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:59.988985 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-f1e88f1f-b39a-4dd9-80c8-b9becba87c68 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] validate_networks() for [('b9022ed4-d5a1-4655-b50c-e8de49533ecf', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:52:01.172504 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=4 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:52:01.307995 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-f1e88f1f-b39a-4dd9-80c8-b9becba87c68 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:52:01.309528 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-f1e88f1f-b39a-4dd9-80c8-b9becba87c68 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:52:01.311445 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-f1e88f1f-b39a-4dd9-80c8-b9becba87c68 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:52:01.312097 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-f1e88f1f-b39a-4dd9-80c8-b9becba87c68 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:52:01.312670 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-f1e88f1f-b39a-4dd9-80c8-b9becba87c68 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:52:01.348323 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1e88f1f-b39a-4dd9-80c8-b9becba87c68 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:01.354247 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1e88f1f-b39a-4dd9-80c8-b9becba87c68 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:01.357242 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1e88f1f-b39a-4dd9-80c8-b9becba87c68 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:01.359106 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1e88f1f-b39a-4dd9-80c8-b9becba87c68 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:01.362263 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1e88f1f-b39a-4dd9-80c8-b9becba87c68 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:01.362914 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1e88f1f-b39a-4dd9-80c8-b9becba87c68 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:01.431620 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-f1e88f1f-b39a-4dd9-80c8-b9becba87c68 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Getting quotas for project 11b5d4706b2d43aca8290ccf07ee1ece. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:52:01.455427 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-f1e88f1f-b39a-4dd9-80c8-b9becba87c68 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Getting quotas for user d68b017335c84d15becbdc7615498103 and project 11b5d4706b2d43aca8290ccf07ee1ece. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:52:01.496322 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f1e88f1f-b39a-4dd9-80c8-b9becba87c68 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:52:01.505615 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f1e88f1f-b39a-4dd9-80c8-b9becba87c68 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:52:01.667782 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f1e88f1f-b39a-4dd9-80c8-b9becba87c68 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.968801 Sep 08 10:52:01.670513 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1601/3198] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:51:59 2022] POST /compute/v2.1/servers => generated 409 bytes in 1974 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:52:01.686912 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b8a2bc9a-2bcf-48cf-84e9-5de76deb6d57 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:01.687657 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b8a2bc9a-2bcf-48cf-84e9-5de76deb6d57 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:01.705530 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8a2bc9a-2bcf-48cf-84e9-5de76deb6d57 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:01.707515 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8a2bc9a-2bcf-48cf-84e9-5de76deb6d57 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:01.707964 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8a2bc9a-2bcf-48cf-84e9-5de76deb6d57 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:01.708775 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8a2bc9a-2bcf-48cf-84e9-5de76deb6d57 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:01.715712 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8a2bc9a-2bcf-48cf-84e9-5de76deb6d57 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:01.716363 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8a2bc9a-2bcf-48cf-84e9-5de76deb6d57 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:02.014490 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5f44914b-b896-4236-b27e-e37beb8ed6a0 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86e8bd6f9048ce8718f432e51128a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c3752f739b47a296a5b88948fe7f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:02.030590 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5f44914b-b896-4236-b27e-e37beb8ed6a0 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "GET /compute/v2.1/servers/d21f2600-ca01-4d47-b1f6-c4e8fa28d571" status: 200 len: 1527 microversion: 2.1 time: 2.298053 Sep 08 10:52:02.038118 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1598/3199] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:59 2022] GET /compute/v2.1/servers/d21f2600-ca01-4d47-b1f6-c4e8fa28d571 => generated 1527 bytes in 2307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:02.057451 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-399303d2-4db0-4850-84f2-18c64e0df826 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Calling method '.version_select at 0x7f68e476a3a0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:02.101164 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b8a2bc9a-2bcf-48cf-84e9-5de76deb6d57 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:02.121270 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b8a2bc9a-2bcf-48cf-84e9-5de76deb6d57 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:02.124149 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-399303d2-4db0-4850-84f2-18c64e0df826 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] HTTP exception thrown: Image not found. Sep 08 10:52:02.126753 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-399303d2-4db0-4850-84f2-18c64e0df826 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Request method failure captured: Sep 08 10:52:02.126753 n-d-850501-12 devstack@n-api.service[128861]: request: DELETE /compute/v2.1/images/d1109835-85cb-4a9f-996a-3ab19278e978 HTTP/1.1 Sep 08 10:52:02.126753 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:52:02.126753 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:52:02.126753 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:52:02.126753 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:52:02.126753 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:52:02.126753 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:52:02.126753 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:52:02.126753 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:52:02.126753 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcjYZIt1uNuRIgcAxc17hT-7_F4OQhq8mc-vzCnhcNF7Hw1wzFQCr_vxJcZL7j-6ItUQnZdAIeDxJfxIvfp_52ifnYKHiSrG_upsONHIGGtyLNgr94RPtS9RN6dTo9us_evPqy4o600qo_vyrVbFF0TdSXMjkzyjvGZImEShKSKyCIk Sep 08 10:52:02.126753 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:52:02.126753 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:52:02.126753 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:52:02.126753 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:52:02.126753 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:52:02.126753 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:52:02.126753 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 8737f6bb9629491d958debd24aa6f9a0 Sep 08 10:52:02.126753 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ImagesOneServerTestJSON-965155818 Sep 08 10:52:02.126753 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:52:02.126753 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:52:02.126753 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8737f6bb9629491d958debd24aa6f9a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8737f6bb9629491d958debd24aa6f9a0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8737f6bb9629491d958debd24aa6f9a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8737f6bb9629491d958debd24aa6f9a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:52:02.126753 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ImagesOneServerTestJSON-965155818 Sep 08 10:52:02.126753 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 8737f6bb9629491d958debd24aa6f9a0 Sep 08 10:52:02.126753 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-965155818 Sep 08 10:52:02.126753 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ImagesOneServerTestJSON-965155818-project Sep 08 10:52:02.126753 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:52:02.126753 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:52:02.126753 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 3db1b83d2b924ed4855ebe9360c9b46f Sep 08 10:52:02.126753 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ImagesOneServerTestJSON-965155818-project Sep 08 10:52:02.126753 n-d-850501-12 devstack@n-api.service[128861]: method: Sep 08 10:52:02.126753 n-d-850501-12 devstack@n-api.service[128861]: exception: Image not found. Sep 08 10:52:02.126753 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': 'd1109835-85cb-4a9f-996a-3ab19278e978'} Sep 08 10:52:02.126753 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:52:02.126753 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:02.126753 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 08 10:52:02.126753 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 08 10:52:02.126753 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 10:52:02.126753 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 10:52:02.126753 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 10:52:02.126753 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 10:52:02.126753 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 08 10:52:02.126753 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 08 10:52:02.126753 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 08 10:52:02.126753 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 08 10:52:02.126753 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 10:52:02.126753 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 10:52:02.126753 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 10:52:02.126753 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 10:52:02.126753 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image d1109835-85cb-4a9f-996a-3ab19278e978 to delete Sep 08 10:52:02.126753 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:52:02.126753 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:52:02.126753 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:52:02.126753 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:02.126753 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 08 10:52:02.126753 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 08 10:52:02.126753 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 08 10:52:02.126753 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 08 10:52:02.126753 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 08 10:52:02.126753 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 08 10:52:02.126753 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d1109835-85cb-4a9f-996a-3ab19278e978 could not be found. Sep 08 10:52:02.126753 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:52:02.126753 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:52:02.126753 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:52:02.126753 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:02.132838 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:52:02.132838 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:52:02.132838 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:52:02.132838 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:52:02.132838 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:52:02.132838 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:52:02.132838 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:52:02.132838 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:52:02.132838 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 08 10:52:02.132838 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 08 10:52:02.132838 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 08 10:52:02.132838 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:52:02.132838 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:52:02.132838 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:52:02.132838 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:02.132838 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:52:02.132838 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:52:02.132838 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:52:02.132838 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:52:02.132838 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 08 10:52:02.132838 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:52:02.136888 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-399303d2-4db0-4850-84f2-18c64e0df826 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Returning 404 to user: Image not found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:52:02.138699 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-399303d2-4db0-4850-84f2-18c64e0df826 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] 10.222.0.27 "DELETE /compute/v2.1/images/d1109835-85cb-4a9f-996a-3ab19278e978" status: 404 len: 62 microversion: 2.1 time: 0.098050 Sep 08 10:52:02.139531 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1599/3200] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:02 2022] DELETE /compute/v2.1/images/d1109835-85cb-4a9f-996a-3ab19278e978 => generated 62 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:52:02.143891 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b8a2bc9a-2bcf-48cf-84e9-5de76deb6d57 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:02.148890 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-64eac6dd-9e3b-4958-bb8e-510db382b478 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:02.155437 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-64eac6dd-9e3b-4958-bb8e-510db382b478 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:02.170532 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b8a2bc9a-2bcf-48cf-84e9-5de76deb6d57 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1546 microversion: 2.91 time: 0.494815 Sep 08 10:52:02.185125 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1602/3201] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:52:01 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1546 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:52:02.199096 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64eac6dd-9e3b-4958-bb8e-510db382b478 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:02.202541 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64eac6dd-9e3b-4958-bb8e-510db382b478 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:02.203756 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64eac6dd-9e3b-4958-bb8e-510db382b478 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:02.206313 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64eac6dd-9e3b-4958-bb8e-510db382b478 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:02.206565 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2e13ec00-1ea0-42a1-902a-31dd6dcd83fe tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:02.207309 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2e13ec00-1ea0-42a1-902a-31dd6dcd83fe tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:02.208896 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64eac6dd-9e3b-4958-bb8e-510db382b478 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:02.210283 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64eac6dd-9e3b-4958-bb8e-510db382b478 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:02.458738 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2e13ec00-1ea0-42a1-902a-31dd6dcd83fe tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:02.471219 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2e13ec00-1ea0-42a1-902a-31dd6dcd83fe tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1238 microversion: 2.1 time: 0.298223 Sep 08 10:52:02.481327 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1603/3202] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:02 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1238 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:02.492473 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b9782162-4a92-4c01-aed2-72b5bd9635f1 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:02.493576 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b9782162-4a92-4c01-aed2-72b5bd9635f1 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] [instance: 9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:02.526158 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b9782162-4a92-4c01-aed2-72b5bd9635f1 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:02.528078 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b9782162-4a92-4c01-aed2-72b5bd9635f1 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:02.530898 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b9782162-4a92-4c01-aed2-72b5bd9635f1 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:02.534863 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b9782162-4a92-4c01-aed2-72b5bd9635f1 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:02.535478 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b9782162-4a92-4c01-aed2-72b5bd9635f1 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:02.538964 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b9782162-4a92-4c01-aed2-72b5bd9635f1 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:02.647665 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b9782162-4a92-4c01-aed2-72b5bd9635f1 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] [instance: 9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:52:02.968461 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b9782162-4a92-4c01-aed2-72b5bd9635f1 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf" status: 204 len: 0 microversion: 2.1 time: 0.485352 Sep 08 10:52:02.975348 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1604/3203] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:52:02 2022] DELETE /compute/v2.1/servers/9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf => generated 0 bytes in 493 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:52:02.998842 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-e838f4bb-42c8-41e3-9f0d-bcee38147f2d req-7c43413e-6ad8-47ec-89f6-2340d0212a14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d21f2600-ca01-4d47-b1f6-c4e8fa28d571", "name": "network-vif-deleted", "tag": "75359c42-7a36-4596-b8b7-328048472cc8"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:52:03.047809 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e838f4bb-42c8-41e3-9f0d-bcee38147f2d req-7c43413e-6ad8-47ec-89f6-2340d0212a14 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:03.059167 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e838f4bb-42c8-41e3-9f0d-bcee38147f2d req-7c43413e-6ad8-47ec-89f6-2340d0212a14 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:03.070357 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e838f4bb-42c8-41e3-9f0d-bcee38147f2d req-7c43413e-6ad8-47ec-89f6-2340d0212a14 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:03.150343 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-e838f4bb-42c8-41e3-9f0d-bcee38147f2d req-7c43413e-6ad8-47ec-89f6-2340d0212a14 service nova] Creating event network-vif-deleted:75359c42-7a36-4596-b8b7-328048472cc8 for instance d21f2600-ca01-4d47-b1f6-c4e8fa28d571 on n-h1-850501-12 Sep 08 10:52:03.182864 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-e838f4bb-42c8-41e3-9f0d-bcee38147f2d req-7c43413e-6ad8-47ec-89f6-2340d0212a14 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.204481 Sep 08 10:52:03.194041 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1605/3204] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:52:03.220438 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d72936e9-48ab-4d94-807c-28db59273cc7 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:03.241307 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d72936e9-48ab-4d94-807c-28db59273cc7 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] [instance: 9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:03.271931 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d72936e9-48ab-4d94-807c-28db59273cc7 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:03.272824 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d72936e9-48ab-4d94-807c-28db59273cc7 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:03.273536 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d72936e9-48ab-4d94-807c-28db59273cc7 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:03.274414 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d72936e9-48ab-4d94-807c-28db59273cc7 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:03.275027 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d72936e9-48ab-4d94-807c-28db59273cc7 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:03.275608 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d72936e9-48ab-4d94-807c-28db59273cc7 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:03.696820 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d72936e9-48ab-4d94-807c-28db59273cc7 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db1b83d2b924ed4855ebe9360c9b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8737f6bb9629491d958debd24aa6f9a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:03.707589 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d72936e9-48ab-4d94-807c-28db59273cc7 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] 10.222.0.27 "GET /compute/v2.1/servers/9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf" status: 200 len: 1472 microversion: 2.1 time: 0.511245 Sep 08 10:52:03.725493 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1606/3205] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:03 2022] GET /compute/v2.1/servers/9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf => generated 1472 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:03.730615 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-557c26a4-ad15-48e3-88eb-06a3e5e75c73 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:03.731900 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-557c26a4-ad15-48e3-88eb-06a3e5e75c73 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: d21f2600-ca01-4d47-b1f6-c4e8fa28d571] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:03.746589 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-557c26a4-ad15-48e3-88eb-06a3e5e75c73 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:03.759154 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-557c26a4-ad15-48e3-88eb-06a3e5e75c73 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:03.760016 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-557c26a4-ad15-48e3-88eb-06a3e5e75c73 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:03.761066 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-557c26a4-ad15-48e3-88eb-06a3e5e75c73 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:03.761786 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-557c26a4-ad15-48e3-88eb-06a3e5e75c73 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:03.762461 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-557c26a4-ad15-48e3-88eb-06a3e5e75c73 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:03.861661 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-557c26a4-ad15-48e3-88eb-06a3e5e75c73 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:03.862453 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-557c26a4-ad15-48e3-88eb-06a3e5e75c73 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:03.863160 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-557c26a4-ad15-48e3-88eb-06a3e5e75c73 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:03.863887 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-557c26a4-ad15-48e3-88eb-06a3e5e75c73 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lazy-loading 'fault' on Instance uuid d21f2600-ca01-4d47-b1f6-c4e8fa28d571 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:52:03.954878 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-557c26a4-ad15-48e3-88eb-06a3e5e75c73 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86e8bd6f9048ce8718f432e51128a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c3752f739b47a296a5b88948fe7f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:03.967773 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-557c26a4-ad15-48e3-88eb-06a3e5e75c73 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "GET /compute/v2.1/servers/d21f2600-ca01-4d47-b1f6-c4e8fa28d571" status: 200 len: 1315 microversion: 2.1 time: 0.240650 Sep 08 10:52:03.977992 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1607/3206] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:03 2022] GET /compute/v2.1/servers/d21f2600-ca01-4d47-b1f6-c4e8fa28d571 => generated 1315 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:03.992284 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-54171f61-c34f-4342-a6a0-ad8f322eaf5b tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:03.993213 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-54171f61-c34f-4342-a6a0-ad8f322eaf5b tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:04.018586 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54171f61-c34f-4342-a6a0-ad8f322eaf5b tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:04.019607 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54171f61-c34f-4342-a6a0-ad8f322eaf5b tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:04.021418 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54171f61-c34f-4342-a6a0-ad8f322eaf5b tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:04.022383 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54171f61-c34f-4342-a6a0-ad8f322eaf5b tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:04.025214 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54171f61-c34f-4342-a6a0-ad8f322eaf5b tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:04.025700 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54171f61-c34f-4342-a6a0-ad8f322eaf5b tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:04.202426 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-54171f61-c34f-4342-a6a0-ad8f322eaf5b tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:04.216937 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-54171f61-c34f-4342-a6a0-ad8f322eaf5b tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:04.234658 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-54171f61-c34f-4342-a6a0-ad8f322eaf5b tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:04.245851 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-54171f61-c34f-4342-a6a0-ad8f322eaf5b tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1546 microversion: 2.91 time: 0.266699 Sep 08 10:52:04.261606 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1608/3207] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:52:03 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1546 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:52:04.303908 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9265169a-14f5-4495-a084-28524abb2cf2 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:04.304915 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9265169a-14f5-4495-a084-28524abb2cf2 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:04.311648 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:52:04.322999 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9265169a-14f5-4495-a084-28524abb2cf2 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:04.323918 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9265169a-14f5-4495-a084-28524abb2cf2 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:04.324599 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9265169a-14f5-4495-a084-28524abb2cf2 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:04.325641 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9265169a-14f5-4495-a084-28524abb2cf2 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:04.326353 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9265169a-14f5-4495-a084-28524abb2cf2 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:04.327014 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9265169a-14f5-4495-a084-28524abb2cf2 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:04.366120 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-64eac6dd-9e3b-4958-bb8e-510db382b478 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:04.393721 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-64eac6dd-9e3b-4958-bb8e-510db382b478 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:04.401321 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-64eac6dd-9e3b-4958-bb8e-510db382b478 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:04.404284 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-64eac6dd-9e3b-4958-bb8e-510db382b478 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 200 len: 1875 microversion: 2.32 time: 2.262024 Sep 08 10:52:04.419884 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1600/3208] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:52:02 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 1875 bytes in 2279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:52:04.492218 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9265169a-14f5-4495-a084-28524abb2cf2 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:04.512053 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9265169a-14f5-4495-a084-28524abb2cf2 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1242 microversion: 2.1 time: 0.239295 Sep 08 10:52:04.520601 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1609/3209] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:04 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1242 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:04.540636 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-15461b45-8c24-4658-8e46-cc40737498df req-15187a7d-0502-4265-9295-fda9a034b9e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf", "name": "network-vif-unplugged", "status": "completed", "tag": "036e4e77-856c-4b8c-9f28-cff6e87b1645"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:52:04.564709 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-15461b45-8c24-4658-8e46-cc40737498df req-15187a7d-0502-4265-9295-fda9a034b9e1 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:04.570718 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-15461b45-8c24-4658-8e46-cc40737498df req-15187a7d-0502-4265-9295-fda9a034b9e1 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:04.571203 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-15461b45-8c24-4658-8e46-cc40737498df req-15187a7d-0502-4265-9295-fda9a034b9e1 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:04.626905 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-15461b45-8c24-4658-8e46-cc40737498df req-15187a7d-0502-4265-9295-fda9a034b9e1 service nova] Creating event network-vif-unplugged:036e4e77-856c-4b8c-9f28-cff6e87b1645 for instance 9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf on n-h1-850501-12 Sep 08 10:52:04.647184 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-15461b45-8c24-4658-8e46-cc40737498df req-15187a7d-0502-4265-9295-fda9a034b9e1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.114951 Sep 08 10:52:04.648501 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1601/3210] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:52:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:52:04.751425 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4f5a6f2a-2a59-498e-9a7d-d0e0fe3065d5 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:04.752698 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4f5a6f2a-2a59-498e-9a7d-d0e0fe3065d5 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] [instance: 9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:04.767393 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f5a6f2a-2a59-498e-9a7d-d0e0fe3065d5 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:04.767950 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f5a6f2a-2a59-498e-9a7d-d0e0fe3065d5 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:04.823653 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f5a6f2a-2a59-498e-9a7d-d0e0fe3065d5 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.055s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:04.824885 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f5a6f2a-2a59-498e-9a7d-d0e0fe3065d5 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:04.826302 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f5a6f2a-2a59-498e-9a7d-d0e0fe3065d5 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:04.827006 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f5a6f2a-2a59-498e-9a7d-d0e0fe3065d5 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:05.029064 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4268d062-f7be-46fe-981b-6185e8977eaf tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:05.030109 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4268d062-f7be-46fe-981b-6185e8977eaf tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: d21f2600-ca01-4d47-b1f6-c4e8fa28d571] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:05.069759 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4268d062-f7be-46fe-981b-6185e8977eaf tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:05.070276 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4268d062-f7be-46fe-981b-6185e8977eaf tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:05.070774 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4268d062-f7be-46fe-981b-6185e8977eaf tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:05.071499 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4268d062-f7be-46fe-981b-6185e8977eaf tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:05.083431 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4268d062-f7be-46fe-981b-6185e8977eaf tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:05.084518 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4268d062-f7be-46fe-981b-6185e8977eaf tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:05.270776 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4268d062-f7be-46fe-981b-6185e8977eaf tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:05.272707 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4268d062-f7be-46fe-981b-6185e8977eaf tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:05.273636 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4268d062-f7be-46fe-981b-6185e8977eaf tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:05.275216 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-4268d062-f7be-46fe-981b-6185e8977eaf tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lazy-loading 'fault' on Instance uuid d21f2600-ca01-4d47-b1f6-c4e8fa28d571 {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:52:05.634485 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4f5a6f2a-2a59-498e-9a7d-d0e0fe3065d5 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db1b83d2b924ed4855ebe9360c9b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8737f6bb9629491d958debd24aa6f9a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:05.648589 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4f5a6f2a-2a59-498e-9a7d-d0e0fe3065d5 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] 10.222.0.27 "GET /compute/v2.1/servers/9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf" status: 200 len: 1472 microversion: 2.1 time: 0.902157 Sep 08 10:52:05.649214 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1610/3211] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:04 2022] GET /compute/v2.1/servers/9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf => generated 1472 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:05.672654 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-79870fb1-5a32-4793-ac0c-1b3cc460aafd tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:05.677084 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-79870fb1-5a32-4793-ac0c-1b3cc460aafd tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:05.687490 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-79870fb1-5a32-4793-ac0c-1b3cc460aafd tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:05.688293 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-79870fb1-5a32-4793-ac0c-1b3cc460aafd tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:05.694646 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-79870fb1-5a32-4793-ac0c-1b3cc460aafd tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:05.697148 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-79870fb1-5a32-4793-ac0c-1b3cc460aafd tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:05.698685 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-79870fb1-5a32-4793-ac0c-1b3cc460aafd tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:05.699437 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-79870fb1-5a32-4793-ac0c-1b3cc460aafd tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:05.923732 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-79870fb1-5a32-4793-ac0c-1b3cc460aafd tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:05.943301 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4268d062-f7be-46fe-981b-6185e8977eaf tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86e8bd6f9048ce8718f432e51128a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c3752f739b47a296a5b88948fe7f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:05.951291 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-79870fb1-5a32-4793-ac0c-1b3cc460aafd tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:05.958550 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-79870fb1-5a32-4793-ac0c-1b3cc460aafd tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:05.973089 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4268d062-f7be-46fe-981b-6185e8977eaf tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "GET /compute/v2.1/servers/d21f2600-ca01-4d47-b1f6-c4e8fa28d571" status: 200 len: 1315 microversion: 2.1 time: 0.947546 Sep 08 10:52:05.976732 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1602/3212] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:05 2022] GET /compute/v2.1/servers/d21f2600-ca01-4d47-b1f6-c4e8fa28d571 => generated 1315 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:52:05.999375 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-79870fb1-5a32-4793-ac0c-1b3cc460aafd tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1546 microversion: 2.91 time: 0.307388 Sep 08 10:52:06.016977 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-75ff13bd-5904-4e9e-9a63-9ebe83275deb tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:06.016977 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-75ff13bd-5904-4e9e-9a63-9ebe83275deb tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:06.017346 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1611/3213] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:52:05 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1546 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:52:06.025212 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c796be90-2089-436c-afd7-1033067c6172 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:06.028538 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c796be90-2089-436c-afd7-1033067c6172 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:06.038912 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-75ff13bd-5904-4e9e-9a63-9ebe83275deb tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:06.041883 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-75ff13bd-5904-4e9e-9a63-9ebe83275deb tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:06.046630 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-75ff13bd-5904-4e9e-9a63-9ebe83275deb tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:06.051497 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-75ff13bd-5904-4e9e-9a63-9ebe83275deb tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:06.053385 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c796be90-2089-436c-afd7-1033067c6172 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:06.055989 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-75ff13bd-5904-4e9e-9a63-9ebe83275deb tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:06.056592 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-75ff13bd-5904-4e9e-9a63-9ebe83275deb tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:06.062461 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c796be90-2089-436c-afd7-1033067c6172 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:06.063688 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c796be90-2089-436c-afd7-1033067c6172 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:06.079348 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c796be90-2089-436c-afd7-1033067c6172 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:06.080335 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c796be90-2089-436c-afd7-1033067c6172 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:06.081237 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c796be90-2089-436c-afd7-1033067c6172 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:06.137782 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:52:06.152284 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:52:06.385276 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c796be90-2089-436c-afd7-1033067c6172 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:06.394564 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c796be90-2089-436c-afd7-1033067c6172 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1234 microversion: 2.1 time: 0.386563 Sep 08 10:52:06.396611 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1612/3214] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:06 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1234 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:06.673456 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4d12f5e7-1b7a-4646-b995-74551fe901db tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:06.674258 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4d12f5e7-1b7a-4646-b995-74551fe901db tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] [instance: 9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:06.683368 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d12f5e7-1b7a-4646-b995-74551fe901db tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:06.688432 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d12f5e7-1b7a-4646-b995-74551fe901db tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:06.690579 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d12f5e7-1b7a-4646-b995-74551fe901db tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:06.691551 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d12f5e7-1b7a-4646-b995-74551fe901db tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:06.695044 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d12f5e7-1b7a-4646-b995-74551fe901db tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:06.696083 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d12f5e7-1b7a-4646-b995-74551fe901db tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:07.530057 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4d12f5e7-1b7a-4646-b995-74551fe901db tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db1b83d2b924ed4855ebe9360c9b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8737f6bb9629491d958debd24aa6f9a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:07.538639 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4d12f5e7-1b7a-4646-b995-74551fe901db tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] 10.222.0.27 "GET /compute/v2.1/servers/9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf" status: 200 len: 1472 microversion: 2.1 time: 0.870177 Sep 08 10:52:07.553802 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1613/3215] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:06 2022] GET /compute/v2.1/servers/9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf => generated 1472 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:07.558744 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-75ff13bd-5904-4e9e-9a63-9ebe83275deb tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:07.568997 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-23f09284-50ac-4987-97e3-fc122507ed43 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:07.569686 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-23f09284-50ac-4987-97e3-fc122507ed43 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: d21f2600-ca01-4d47-b1f6-c4e8fa28d571] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:07.578175 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-75ff13bd-5904-4e9e-9a63-9ebe83275deb tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:07.580386 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-75ff13bd-5904-4e9e-9a63-9ebe83275deb tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:07.583634 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-75ff13bd-5904-4e9e-9a63-9ebe83275deb tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 200 len: 1875 microversion: 2.32 time: 1.604106 Sep 08 10:52:07.587998 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23f09284-50ac-4987-97e3-fc122507ed43 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:07.588368 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1603/3216] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:52:05 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 1875 bytes in 1608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:52:07.593329 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23f09284-50ac-4987-97e3-fc122507ed43 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:07.593826 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23f09284-50ac-4987-97e3-fc122507ed43 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:07.594582 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23f09284-50ac-4987-97e3-fc122507ed43 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:07.595061 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23f09284-50ac-4987-97e3-fc122507ed43 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:07.595492 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23f09284-50ac-4987-97e3-fc122507ed43 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:07.599166 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ed6dedef-3804-475f-a81c-57d3c9e18633 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:07.603271 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ed6dedef-3804-475f-a81c-57d3c9e18633 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:07.632941 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed6dedef-3804-475f-a81c-57d3c9e18633 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:07.633603 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed6dedef-3804-475f-a81c-57d3c9e18633 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:07.634249 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed6dedef-3804-475f-a81c-57d3c9e18633 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:07.657284 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed6dedef-3804-475f-a81c-57d3c9e18633 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:07.658301 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-23f09284-50ac-4987-97e3-fc122507ed43 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] HTTP exception thrown: Instance d21f2600-ca01-4d47-b1f6-c4e8fa28d571 could not be found. Sep 08 10:52:07.658480 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed6dedef-3804-475f-a81c-57d3c9e18633 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:07.659025 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed6dedef-3804-475f-a81c-57d3c9e18633 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:07.668162 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-23f09284-50ac-4987-97e3-fc122507ed43 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Request method failure captured: Sep 08 10:52:07.668162 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/d21f2600-ca01-4d47-b1f6-c4e8fa28d571 HTTP/1.1 Sep 08 10:52:07.668162 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:52:07.668162 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:52:07.668162 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:52:07.668162 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:52:07.668162 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:52:07.668162 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:52:07.668162 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:52:07.668162 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:52:07.668162 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcjivLUY-NOpubj4piWQUE4YdjVoieEQ-G0L0ay9l2jNqBIueJ_eB4w8-Iohm-hEbdImfT6Vv0CotgGIogaerBRfcTAAw-NhjLbx2EjcqsYLMFxCPLjOPfzXaEWWRNcumoyYDLdNDrrGczsG7GBIlwK26oqS5wWNAPkM7DBSBKGgOFQ Sep 08 10:52:07.668162 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:52:07.668162 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:52:07.668162 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:52:07.668162 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:52:07.668162 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:52:07.668162 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:52:07.668162 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 50c3752f739b47a296a5b88948fe7f7f Sep 08 10:52:07.668162 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1836029851 Sep 08 10:52:07.668162 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:52:07.668162 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:52:07.668162 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/50c3752f739b47a296a5b88948fe7f7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/50c3752f739b47a296a5b88948fe7f7f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_50c3752f739b47a296a5b88948fe7f7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/50c3752f739b47a296a5b88948fe7f7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:52:07.668162 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1836029851 Sep 08 10:52:07.668162 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 50c3752f739b47a296a5b88948fe7f7f Sep 08 10:52:07.668162 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1836029851 Sep 08 10:52:07.668162 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ImagesOneServerNegativeTestJSON-1836029851-project Sep 08 10:52:07.668162 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:52:07.668162 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:52:07.668162 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 7c86e8bd6f9048ce8718f432e51128a5 Sep 08 10:52:07.668162 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1836029851-project Sep 08 10:52:07.668162 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:52:07.668162 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance d21f2600-ca01-4d47-b1f6-c4e8fa28d571 could not be found. Sep 08 10:52:07.668162 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'd21f2600-ca01-4d47-b1f6-c4e8fa28d571'} Sep 08 10:52:07.668162 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:52:07.668162 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:07.668162 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:52:07.668162 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:52:07.668162 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:52:07.668162 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:52:07.668162 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:52:07.668162 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:52:07.668162 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:52:07.668162 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:52:07.668162 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d21f2600-ca01-4d47-b1f6-c4e8fa28d571 could not be found. Sep 08 10:52:07.668162 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:07.668162 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:52:07.668162 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:07.668162 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:07.668162 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:52:07.668162 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:52:07.668162 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:52:07.668162 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:52:07.668162 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:52:07.668162 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:52:07.668162 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:52:07.668162 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:52:07.668162 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:52:07.668162 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:52:07.668162 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:52:07.668162 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:52:07.668162 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d21f2600-ca01-4d47-b1f6-c4e8fa28d571 could not be found. Sep 08 10:52:07.668162 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:07.668162 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:52:07.674029 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:07.674029 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:07.674029 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:52:07.674029 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:52:07.674029 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:52:07.674029 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:52:07.674029 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d21f2600-ca01-4d47-b1f6-c4e8fa28d571 could not be found. Sep 08 10:52:07.674029 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:07.676793 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-23f09284-50ac-4987-97e3-fc122507ed43 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Returning 404 to user: Instance d21f2600-ca01-4d47-b1f6-c4e8fa28d571 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:52:07.678011 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-23f09284-50ac-4987-97e3-fc122507ed43 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "GET /compute/v2.1/servers/d21f2600-ca01-4d47-b1f6-c4e8fa28d571" status: 404 len: 111 microversion: 2.1 time: 0.122758 Sep 08 10:52:07.680292 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1614/3217] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:07 2022] GET /compute/v2.1/servers/d21f2600-ca01-4d47-b1f6-c4e8fa28d571 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:52:07.715071 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-96cb7157-62f3-4420-b886-5817e6aebac4 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:07.724608 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-96cb7157-62f3-4420-b886-5817e6aebac4 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:07.758151 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-96cb7157-62f3-4420-b886-5817e6aebac4 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:07.760759 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-96cb7157-62f3-4420-b886-5817e6aebac4 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:07.761287 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-96cb7157-62f3-4420-b886-5817e6aebac4 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:07.762047 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-96cb7157-62f3-4420-b886-5817e6aebac4 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:07.763115 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-96cb7157-62f3-4420-b886-5817e6aebac4 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:07.763476 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-96cb7157-62f3-4420-b886-5817e6aebac4 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:07.847254 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ed6dedef-3804-475f-a81c-57d3c9e18633 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:07.859889 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ed6dedef-3804-475f-a81c-57d3c9e18633 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:07.867175 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ed6dedef-3804-475f-a81c-57d3c9e18633 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:07.900012 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ed6dedef-3804-475f-a81c-57d3c9e18633 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1546 microversion: 2.91 time: 0.310203 Sep 08 10:52:07.907137 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1604/3218] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:52:07 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1546 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:52:08.005381 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e8d21b47-f30b-4688-84bd-0a19487eab47 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-534678201", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:52:08.113665 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-96cb7157-62f3-4420-b886-5817e6aebac4 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:08.121751 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-96cb7157-62f3-4420-b886-5817e6aebac4 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1296 microversion: 2.1 time: 0.440143 Sep 08 10:52:08.122356 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1615/3219] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:07 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1296 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:08.138603 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-e8d21b47-f30b-4688-84bd-0a19487eab47 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] validate_networks() for [('741076e7-778f-402b-9838-e16de110a735', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:52:08.280499 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-6ad9de2d-2173-40f1-899e-0aba10df7377 req-20da3cd7-2dde-43b3-9dac-3d1393e44479 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf", "name": "network-vif-deleted", "tag": "036e4e77-856c-4b8c-9f28-cff6e87b1645"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:52:08.300087 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-6ad9de2d-2173-40f1-899e-0aba10df7377 req-20da3cd7-2dde-43b3-9dac-3d1393e44479 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:08.307447 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-6ad9de2d-2173-40f1-899e-0aba10df7377 req-20da3cd7-2dde-43b3-9dac-3d1393e44479 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:08.312574 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-6ad9de2d-2173-40f1-899e-0aba10df7377 req-20da3cd7-2dde-43b3-9dac-3d1393e44479 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:08.350481 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-6ad9de2d-2173-40f1-899e-0aba10df7377 req-20da3cd7-2dde-43b3-9dac-3d1393e44479 service nova] Creating event network-vif-deleted:036e4e77-856c-4b8c-9f28-cff6e87b1645 for instance 9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf on n-h1-850501-12 Sep 08 10:52:08.375412 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-6ad9de2d-2173-40f1-899e-0aba10df7377 req-20da3cd7-2dde-43b3-9dac-3d1393e44479 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103008 Sep 08 10:52:08.376664 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1616/3220] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:52:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:52:08.601074 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-606f0d63-8280-4721-817c-f794b2880659 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:08.604543 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-606f0d63-8280-4721-817c-f794b2880659 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] [instance: 9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:08.628581 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-606f0d63-8280-4721-817c-f794b2880659 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:08.629403 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-606f0d63-8280-4721-817c-f794b2880659 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:08.630128 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-606f0d63-8280-4721-817c-f794b2880659 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:08.631095 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-606f0d63-8280-4721-817c-f794b2880659 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:08.631757 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-606f0d63-8280-4721-817c-f794b2880659 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:08.632418 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-606f0d63-8280-4721-817c-f794b2880659 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:08.737405 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-606f0d63-8280-4721-817c-f794b2880659 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:08.738505 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-606f0d63-8280-4721-817c-f794b2880659 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:08.739757 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-606f0d63-8280-4721-817c-f794b2880659 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:08.741688 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-606f0d63-8280-4721-817c-f794b2880659 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lazy-loading 'fault' on Instance uuid 9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:52:09.085674 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-606f0d63-8280-4721-817c-f794b2880659 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db1b83d2b924ed4855ebe9360c9b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8737f6bb9629491d958debd24aa6f9a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:09.103345 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-606f0d63-8280-4721-817c-f794b2880659 tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] 10.222.0.27 "GET /compute/v2.1/servers/9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf" status: 200 len: 1306 microversion: 2.1 time: 0.516816 Sep 08 10:52:09.119109 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1617/3221] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:08 2022] GET /compute/v2.1/servers/9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf => generated 1306 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:09.152403 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cedf9ea6-0fdd-4496-bae1-ac57b31ce6e5 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:09.153355 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cedf9ea6-0fdd-4496-bae1-ac57b31ce6e5 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:09.164314 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cedf9ea6-0fdd-4496-bae1-ac57b31ce6e5 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:09.165217 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cedf9ea6-0fdd-4496-bae1-ac57b31ce6e5 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:09.165987 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cedf9ea6-0fdd-4496-bae1-ac57b31ce6e5 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:09.170288 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cedf9ea6-0fdd-4496-bae1-ac57b31ce6e5 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:09.170957 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cedf9ea6-0fdd-4496-bae1-ac57b31ce6e5 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:09.171746 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cedf9ea6-0fdd-4496-bae1-ac57b31ce6e5 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:09.740230 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cedf9ea6-0fdd-4496-bae1-ac57b31ce6e5 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:09.755310 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cedf9ea6-0fdd-4496-bae1-ac57b31ce6e5 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:09.757628 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cedf9ea6-0fdd-4496-bae1-ac57b31ce6e5 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:09.759024 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cedf9ea6-0fdd-4496-bae1-ac57b31ce6e5 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 200 len: 1875 microversion: 2.32 time: 0.633786 Sep 08 10:52:09.760172 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1618/3222] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:52:09 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 1875 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:52:09.767468 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-726896ac-3e34-4c63-bbde-064f26861f80 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:09.777632 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-726896ac-3e34-4c63-bbde-064f26861f80 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:09.786904 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-726896ac-3e34-4c63-bbde-064f26861f80 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:09.787921 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-726896ac-3e34-4c63-bbde-064f26861f80 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:09.788555 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-726896ac-3e34-4c63-bbde-064f26861f80 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:09.789481 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-726896ac-3e34-4c63-bbde-064f26861f80 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:09.790104 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-726896ac-3e34-4c63-bbde-064f26861f80 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:09.790713 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-726896ac-3e34-4c63-bbde-064f26861f80 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:09.930702 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-726896ac-3e34-4c63-bbde-064f26861f80 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:09.944732 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-726896ac-3e34-4c63-bbde-064f26861f80 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:09.949339 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-726896ac-3e34-4c63-bbde-064f26861f80 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:09.961800 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-726896ac-3e34-4c63-bbde-064f26861f80 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1546 microversion: 2.91 time: 0.198432 Sep 08 10:52:09.963435 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1619/3223] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:52:09 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1546 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:52:09.978536 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fe43cf1a-7c95-4400-b079-2a8deeb4acaa tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:09.983687 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fe43cf1a-7c95-4400-b079-2a8deeb4acaa tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:09.997978 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fe43cf1a-7c95-4400-b079-2a8deeb4acaa tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:09.999706 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fe43cf1a-7c95-4400-b079-2a8deeb4acaa tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:10.001931 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fe43cf1a-7c95-4400-b079-2a8deeb4acaa tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:10.002886 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fe43cf1a-7c95-4400-b079-2a8deeb4acaa tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:10.003523 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fe43cf1a-7c95-4400-b079-2a8deeb4acaa tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:10.005404 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fe43cf1a-7c95-4400-b079-2a8deeb4acaa tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:10.127217 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-e8d21b47-f30b-4688-84bd-0a19487eab47 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:52:10.128584 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-e8d21b47-f30b-4688-84bd-0a19487eab47 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:52:10.129292 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-e8d21b47-f30b-4688-84bd-0a19487eab47 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:52:10.130560 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-e8d21b47-f30b-4688-84bd-0a19487eab47 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:52:10.131111 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-e8d21b47-f30b-4688-84bd-0a19487eab47 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:52:10.156966 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e8d21b47-f30b-4688-84bd-0a19487eab47 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:10.165988 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e8d21b47-f30b-4688-84bd-0a19487eab47 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:10.172748 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e8d21b47-f30b-4688-84bd-0a19487eab47 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:10.175367 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e8d21b47-f30b-4688-84bd-0a19487eab47 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:10.176258 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e8d21b47-f30b-4688-84bd-0a19487eab47 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:10.184891 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e8d21b47-f30b-4688-84bd-0a19487eab47 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:10.266743 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-e8d21b47-f30b-4688-84bd-0a19487eab47 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Getting quotas for project 50c3752f739b47a296a5b88948fe7f7f. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:52:10.288247 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-e8d21b47-f30b-4688-84bd-0a19487eab47 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Getting quotas for user 7c86e8bd6f9048ce8718f432e51128a5 and project 50c3752f739b47a296a5b88948fe7f7f. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:52:10.334122 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e8d21b47-f30b-4688-84bd-0a19487eab47 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:52:10.338298 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e8d21b47-f30b-4688-84bd-0a19487eab47 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: d8071344-b39f-4b47-b77c-8afaf51d22a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:52:10.476459 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e8d21b47-f30b-4688-84bd-0a19487eab47 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.475672 Sep 08 10:52:10.487448 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1605/3224] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:52:07 2022] POST /compute/v2.1/servers => generated 383 bytes in 2487 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 10:52:10.492815 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b797fcb0-487d-44f7-99bd-f066f58d381c tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:10.493785 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b797fcb0-487d-44f7-99bd-f066f58d381c tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] [instance: 9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:10.502583 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b797fcb0-487d-44f7-99bd-f066f58d381c tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:10.503545 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b797fcb0-487d-44f7-99bd-f066f58d381c tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:10.504158 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b797fcb0-487d-44f7-99bd-f066f58d381c tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:10.505174 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b797fcb0-487d-44f7-99bd-f066f58d381c tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:10.506019 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b797fcb0-487d-44f7-99bd-f066f58d381c tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:10.506784 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b797fcb0-487d-44f7-99bd-f066f58d381c tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:10.553847 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-b797fcb0-487d-44f7-99bd-f066f58d381c tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] HTTP exception thrown: Instance 9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf could not be found. Sep 08 10:52:10.562350 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b797fcb0-487d-44f7-99bd-f066f58d381c tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Request method failure captured: Sep 08 10:52:10.562350 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf HTTP/1.1 Sep 08 10:52:10.562350 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:52:10.562350 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:52:10.562350 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:52:10.562350 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:52:10.562350 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:52:10.562350 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:52:10.562350 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:52:10.562350 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:52:10.562350 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcjYZIt1uNuRIgcAxc17hT-7_F4OQhq8mc-vzCnhcNF7Hw1wzFQCr_vxJcZL7j-6ItUQnZdAIeDxJfxIvfp_52ifnYKHiSrG_upsONHIGGtyLNgr94RPtS9RN6dTo9us_evPqy4o600qo_vyrVbFF0TdSXMjkzyjvGZImEShKSKyCIk Sep 08 10:52:10.562350 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:52:10.562350 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:52:10.562350 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:52:10.562350 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:52:10.562350 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:52:10.562350 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:52:10.562350 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 8737f6bb9629491d958debd24aa6f9a0 Sep 08 10:52:10.562350 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ImagesOneServerTestJSON-965155818 Sep 08 10:52:10.562350 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:52:10.562350 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:52:10.562350 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8737f6bb9629491d958debd24aa6f9a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8737f6bb9629491d958debd24aa6f9a0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8737f6bb9629491d958debd24aa6f9a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8737f6bb9629491d958debd24aa6f9a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:52:10.562350 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ImagesOneServerTestJSON-965155818 Sep 08 10:52:10.562350 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 8737f6bb9629491d958debd24aa6f9a0 Sep 08 10:52:10.562350 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-965155818 Sep 08 10:52:10.562350 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ImagesOneServerTestJSON-965155818-project Sep 08 10:52:10.562350 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:52:10.562350 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:52:10.562350 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 3db1b83d2b924ed4855ebe9360c9b46f Sep 08 10:52:10.562350 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ImagesOneServerTestJSON-965155818-project Sep 08 10:52:10.562350 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:52:10.562350 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf could not be found. Sep 08 10:52:10.562350 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf'} Sep 08 10:52:10.562350 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:52:10.562350 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:10.562350 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:52:10.562350 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:52:10.562350 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:52:10.562350 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:52:10.562350 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:52:10.562350 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:52:10.562350 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:52:10.562350 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:52:10.562350 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf could not be found. Sep 08 10:52:10.562350 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:52:10.562350 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:52:10.562350 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:52:10.562350 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:10.562350 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:52:10.562350 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:52:10.562350 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:52:10.562350 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:52:10.562350 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:52:10.562350 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:52:10.562350 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:52:10.562350 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:52:10.562350 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:52:10.562350 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:52:10.562350 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:52:10.562350 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:52:10.562350 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf could not be found. Sep 08 10:52:10.562350 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:52:10.562350 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:52:10.562350 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:52:10.567263 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:10.567263 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:52:10.567263 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:52:10.567263 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:52:10.567263 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:52:10.567263 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf could not be found. Sep 08 10:52:10.567263 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:52:10.570148 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b797fcb0-487d-44f7-99bd-f066f58d381c tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] Returning 404 to user: Instance 9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:52:10.571238 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b797fcb0-487d-44f7-99bd-f066f58d381c tempest-ImagesOneServerTestJSON-965155818 tempest-ImagesOneServerTestJSON-965155818-project] 10.222.0.27 "GET /compute/v2.1/servers/9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf" status: 404 len: 111 microversion: 2.1 time: 0.082442 Sep 08 10:52:10.577411 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1606/3225] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:10 2022] GET /compute/v2.1/servers/9d22a3bd-4ad2-40fa-8a0f-11152b4c24cf => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:52:10.763866 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7fb004a7-cf35-40bd-8051-d3cec0b37fb4 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2005255353", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:52:10.853860 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fe43cf1a-7c95-4400-b079-2a8deeb4acaa tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:10.863054 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fe43cf1a-7c95-4400-b079-2a8deeb4acaa tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1364 microversion: 2.1 time: 0.896168 Sep 08 10:52:10.873649 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1620/3226] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:09 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1364 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:10.889799 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-7fb004a7-cf35-40bd-8051-d3cec0b37fb4 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] validate_networks() for [('1d853fb2-5fbf-4c4a-82df-b80ef138d035', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:52:10.902160 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8a76900e-dddd-4cba-9692-80455b1e26fa tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:10.903866 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8a76900e-dddd-4cba-9692-80455b1e26fa tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: d8071344-b39f-4b47-b77c-8afaf51d22a2] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:11.280249 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8a76900e-dddd-4cba-9692-80455b1e26fa tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86e8bd6f9048ce8718f432e51128a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c3752f739b47a296a5b88948fe7f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:11.290595 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8a76900e-dddd-4cba-9692-80455b1e26fa tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "GET /compute/v2.1/servers/d8071344-b39f-4b47-b77c-8afaf51d22a2" status: 200 len: 1224 microversion: 2.1 time: 0.411760 Sep 08 10:52:11.291329 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1621/3227] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:10 2022] GET /compute/v2.1/servers/d8071344-b39f-4b47-b77c-8afaf51d22a2 => generated 1224 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:11.298003 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0c2422f2-0ec7-42f9-b9a4-0eb643f03813 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:11.298854 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0c2422f2-0ec7-42f9-b9a4-0eb643f03813 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:11.309347 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0c2422f2-0ec7-42f9-b9a4-0eb643f03813 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:11.310247 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0c2422f2-0ec7-42f9-b9a4-0eb643f03813 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:11.310850 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0c2422f2-0ec7-42f9-b9a4-0eb643f03813 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:11.311867 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0c2422f2-0ec7-42f9-b9a4-0eb643f03813 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:11.312493 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0c2422f2-0ec7-42f9-b9a4-0eb643f03813 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:11.313165 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0c2422f2-0ec7-42f9-b9a4-0eb643f03813 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:11.401710 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:52:11.990912 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0c2422f2-0ec7-42f9-b9a4-0eb643f03813 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:12.007692 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0c2422f2-0ec7-42f9-b9a4-0eb643f03813 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:12.015483 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0c2422f2-0ec7-42f9-b9a4-0eb643f03813 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:12.020393 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0c2422f2-0ec7-42f9-b9a4-0eb643f03813 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 200 len: 1875 microversion: 2.32 time: 0.727972 Sep 08 10:52:12.023038 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1622/3228] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:52:11 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 1875 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:52:12.049807 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8e19688a-6a53-436e-9758-90273fef9c39 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:12.050503 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8e19688a-6a53-436e-9758-90273fef9c39 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:12.067859 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e19688a-6a53-436e-9758-90273fef9c39 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:12.068363 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e19688a-6a53-436e-9758-90273fef9c39 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:12.068799 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e19688a-6a53-436e-9758-90273fef9c39 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:12.073997 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e19688a-6a53-436e-9758-90273fef9c39 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:12.074708 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e19688a-6a53-436e-9758-90273fef9c39 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:12.075668 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e19688a-6a53-436e-9758-90273fef9c39 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:12.130215 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-7fb004a7-cf35-40bd-8051-d3cec0b37fb4 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:52:12.130695 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-7fb004a7-cf35-40bd-8051-d3cec0b37fb4 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:52:12.131131 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-7fb004a7-cf35-40bd-8051-d3cec0b37fb4 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:52:12.131658 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-7fb004a7-cf35-40bd-8051-d3cec0b37fb4 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:52:12.132033 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-7fb004a7-cf35-40bd-8051-d3cec0b37fb4 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:52:12.150308 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7fb004a7-cf35-40bd-8051-d3cec0b37fb4 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:12.151787 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7fb004a7-cf35-40bd-8051-d3cec0b37fb4 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:12.153862 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7fb004a7-cf35-40bd-8051-d3cec0b37fb4 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:12.155817 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7fb004a7-cf35-40bd-8051-d3cec0b37fb4 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:12.157557 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7fb004a7-cf35-40bd-8051-d3cec0b37fb4 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:12.158777 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7fb004a7-cf35-40bd-8051-d3cec0b37fb4 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:12.227186 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-7fb004a7-cf35-40bd-8051-d3cec0b37fb4 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Getting quotas for project 33063b3b9e0543369c28ea918f52cf37. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:52:12.242079 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-7fb004a7-cf35-40bd-8051-d3cec0b37fb4 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Getting quotas for user 8f487f5d062e4ac3bf21c2416a7b50ee and project 33063b3b9e0543369c28ea918f52cf37. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:52:12.276486 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7fb004a7-cf35-40bd-8051-d3cec0b37fb4 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:52:12.280823 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7fb004a7-cf35-40bd-8051-d3cec0b37fb4 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: fafff8cb-0e6f-4243-a91c-ec559f656880] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:52:12.335173 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8e19688a-6a53-436e-9758-90273fef9c39 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:12.347694 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8e19688a-6a53-436e-9758-90273fef9c39 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:12.354826 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8e19688a-6a53-436e-9758-90273fef9c39 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:12.366688 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8e19688a-6a53-436e-9758-90273fef9c39 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1546 microversion: 2.91 time: 0.318371 Sep 08 10:52:12.368485 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1623/3229] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:52:12 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1546 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:52:12.377679 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d8ff5301-12a1-4eab-81b0-d57a430bc0aa tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:12.389967 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d8ff5301-12a1-4eab-81b0-d57a430bc0aa tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:12.416741 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d8ff5301-12a1-4eab-81b0-d57a430bc0aa tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:12.417776 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d8ff5301-12a1-4eab-81b0-d57a430bc0aa tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:12.419486 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d8ff5301-12a1-4eab-81b0-d57a430bc0aa tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:12.421469 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d8ff5301-12a1-4eab-81b0-d57a430bc0aa tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:12.422259 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d8ff5301-12a1-4eab-81b0-d57a430bc0aa tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:12.423059 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d8ff5301-12a1-4eab-81b0-d57a430bc0aa tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:12.427380 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7fb004a7-cf35-40bd-8051-d3cec0b37fb4 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.847963 Sep 08 10:52:12.451005 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1607/3230] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:52:10 2022] POST /compute/v2.1/servers => generated 383 bytes in 1872 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:52:12.477054 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-35eedb8c-2a7a-4e03-9b10-07b76a315f42 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:12.477888 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-35eedb8c-2a7a-4e03-9b10-07b76a315f42 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: d8071344-b39f-4b47-b77c-8afaf51d22a2] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:12.504382 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-35eedb8c-2a7a-4e03-9b10-07b76a315f42 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:12.507100 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-35eedb8c-2a7a-4e03-9b10-07b76a315f42 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:12.507565 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-35eedb8c-2a7a-4e03-9b10-07b76a315f42 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:12.508312 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-35eedb8c-2a7a-4e03-9b10-07b76a315f42 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:12.515836 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-35eedb8c-2a7a-4e03-9b10-07b76a315f42 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:12.516892 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-35eedb8c-2a7a-4e03-9b10-07b76a315f42 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:13.101340 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-35eedb8c-2a7a-4e03-9b10-07b76a315f42 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86e8bd6f9048ce8718f432e51128a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c3752f739b47a296a5b88948fe7f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:13.119553 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-35eedb8c-2a7a-4e03-9b10-07b76a315f42 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "GET /compute/v2.1/servers/d8071344-b39f-4b47-b77c-8afaf51d22a2" status: 200 len: 1276 microversion: 2.1 time: 0.666057 Sep 08 10:52:13.122437 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1608/3231] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:12 2022] GET /compute/v2.1/servers/d8071344-b39f-4b47-b77c-8afaf51d22a2 => generated 1276 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:13.138284 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5584e7a9-af33-4d0b-be8e-8c140c9aa080 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:13.140174 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5584e7a9-af33-4d0b-be8e-8c140c9aa080 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: fafff8cb-0e6f-4243-a91c-ec559f656880] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:13.337581 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d8ff5301-12a1-4eab-81b0-d57a430bc0aa tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:13.355152 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d8ff5301-12a1-4eab-81b0-d57a430bc0aa tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1364 microversion: 2.1 time: 0.981212 Sep 08 10:52:13.355786 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1624/3232] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:12 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1364 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:13.396127 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-ac3a99d9-8e61-4b61-a4b2-65e61fc38582 req-2d67e91f-56c5-4792-8d94-f1f8d707ab15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e81e0acc-0b96-4dbc-a5bb-89183f5204e7", "tag": "ff9d981d-5db2-425c-b066-f87540f6e91c"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:52:13.461867 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5584e7a9-af33-4d0b-be8e-8c140c9aa080 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:13.479089 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5584e7a9-af33-4d0b-be8e-8c140c9aa080 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/fafff8cb-0e6f-4243-a91c-ec559f656880" status: 200 len: 1222 microversion: 2.1 time: 0.348795 Sep 08 10:52:13.485734 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1609/3233] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:13 2022] GET /compute/v2.1/servers/fafff8cb-0e6f-4243-a91c-ec559f656880 => generated 1222 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:13.504173 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e7f46a30-a630-4e63-bfb1-ecc87356553a tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:13.504668 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ac3a99d9-8e61-4b61-a4b2-65e61fc38582 req-2d67e91f-56c5-4792-8d94-f1f8d707ab15 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:13.505551 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e7f46a30-a630-4e63-bfb1-ecc87356553a tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:13.505945 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ac3a99d9-8e61-4b61-a4b2-65e61fc38582 req-2d67e91f-56c5-4792-8d94-f1f8d707ab15 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:13.505945 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ac3a99d9-8e61-4b61-a4b2-65e61fc38582 req-2d67e91f-56c5-4792-8d94-f1f8d707ab15 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:13.518102 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e7f46a30-a630-4e63-bfb1-ecc87356553a tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:13.519829 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e7f46a30-a630-4e63-bfb1-ecc87356553a tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:13.528672 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e7f46a30-a630-4e63-bfb1-ecc87356553a tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:13.529702 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e7f46a30-a630-4e63-bfb1-ecc87356553a tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:13.531438 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e7f46a30-a630-4e63-bfb1-ecc87356553a tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:13.534566 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e7f46a30-a630-4e63-bfb1-ecc87356553a tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:13.594210 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-ac3a99d9-8e61-4b61-a4b2-65e61fc38582 req-2d67e91f-56c5-4792-8d94-f1f8d707ab15 service nova] Creating event network-changed:ff9d981d-5db2-425c-b066-f87540f6e91c for instance e81e0acc-0b96-4dbc-a5bb-89183f5204e7 on n-h1-850501-12 Sep 08 10:52:13.625370 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-ac3a99d9-8e61-4b61-a4b2-65e61fc38582 req-2d67e91f-56c5-4792-8d94-f1f8d707ab15 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.228397 Sep 08 10:52:13.630025 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1625/3234] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:52:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:52:13.659441 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-49da8447-a6b7-4e68-bb72-91f89bfaca3f tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:13.660049 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-49da8447-a6b7-4e68-bb72-91f89bfaca3f tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:13.673236 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49da8447-a6b7-4e68-bb72-91f89bfaca3f tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:13.676190 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49da8447-a6b7-4e68-bb72-91f89bfaca3f tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:13.678127 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49da8447-a6b7-4e68-bb72-91f89bfaca3f tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:13.679441 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49da8447-a6b7-4e68-bb72-91f89bfaca3f tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:13.680098 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49da8447-a6b7-4e68-bb72-91f89bfaca3f tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:13.680701 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49da8447-a6b7-4e68-bb72-91f89bfaca3f tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:13.994916 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-49da8447-a6b7-4e68-bb72-91f89bfaca3f tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:14.016429 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-49da8447-a6b7-4e68-bb72-91f89bfaca3f tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:14.023709 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-49da8447-a6b7-4e68-bb72-91f89bfaca3f tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:14.046611 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-49da8447-a6b7-4e68-bb72-91f89bfaca3f tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1546 microversion: 2.91 time: 0.407455 Sep 08 10:52:14.048450 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1626/3235] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:52:13 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1546 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:52:14.389019 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-b07d359d-d0d6-4d68-a3f0-77203eefe8e0 req-99ac9629-fabc-4ae4-94b7-32488cbc9174 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98277784-8e48-4a7b-8786-ce579e1d5ccf", "name": "network-vif-plugged", "status": "completed", "tag": "7dc4a9a8-b4a5-45bf-bf54-5e5e0cd4d54b"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:52:14.407573 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b07d359d-d0d6-4d68-a3f0-77203eefe8e0 req-99ac9629-fabc-4ae4-94b7-32488cbc9174 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:14.408071 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b07d359d-d0d6-4d68-a3f0-77203eefe8e0 req-99ac9629-fabc-4ae4-94b7-32488cbc9174 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:14.414490 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b07d359d-d0d6-4d68-a3f0-77203eefe8e0 req-99ac9629-fabc-4ae4-94b7-32488cbc9174 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:14.444809 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-b07d359d-d0d6-4d68-a3f0-77203eefe8e0 req-99ac9629-fabc-4ae4-94b7-32488cbc9174 service nova] Creating event network-vif-plugged:7dc4a9a8-b4a5-45bf-bf54-5e5e0cd4d54b for instance 98277784-8e48-4a7b-8786-ce579e1d5ccf on n-h2-850501-12 Sep 08 10:52:14.476010 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-b07d359d-d0d6-4d68-a3f0-77203eefe8e0 req-99ac9629-fabc-4ae4-94b7-32488cbc9174 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.425338 Sep 08 10:52:14.477601 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1627/3236] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:52:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:52:14.485847 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-79b33374-bb32-462b-95b6-e2fb93f2b7f1 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1914231080", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:52:14.598439 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-79b33374-bb32-462b-95b6-e2fb93f2b7f1 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] validate_networks() for [('1d853fb2-5fbf-4c4a-82df-b80ef138d035', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:52:15.162449 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e7f46a30-a630-4e63-bfb1-ecc87356553a tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:15.182895 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e7f46a30-a630-4e63-bfb1-ecc87356553a tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:15.185218 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e7f46a30-a630-4e63-bfb1-ecc87356553a tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:15.187948 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e7f46a30-a630-4e63-bfb1-ecc87356553a tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 200 len: 1875 microversion: 2.32 time: 1.698889 Sep 08 10:52:15.189274 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1610/3237] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:52:13 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 1875 bytes in 1703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:52:15.194914 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-399aadd7-abde-4b43-b433-a76baedbf8b6 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:15.195888 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-399aadd7-abde-4b43-b433-a76baedbf8b6 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: d8071344-b39f-4b47-b77c-8afaf51d22a2] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:15.252590 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-399aadd7-abde-4b43-b433-a76baedbf8b6 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:15.257272 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-399aadd7-abde-4b43-b433-a76baedbf8b6 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:15.259705 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-399aadd7-abde-4b43-b433-a76baedbf8b6 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:15.260498 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-399aadd7-abde-4b43-b433-a76baedbf8b6 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:15.260987 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-399aadd7-abde-4b43-b433-a76baedbf8b6 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:15.264869 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-399aadd7-abde-4b43-b433-a76baedbf8b6 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:15.513312 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-399aadd7-abde-4b43-b433-a76baedbf8b6 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86e8bd6f9048ce8718f432e51128a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c3752f739b47a296a5b88948fe7f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:15.538697 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-399aadd7-abde-4b43-b433-a76baedbf8b6 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "GET /compute/v2.1/servers/d8071344-b39f-4b47-b77c-8afaf51d22a2" status: 200 len: 1282 microversion: 2.1 time: 0.348170 Sep 08 10:52:15.564697 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1611/3238] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:15 2022] GET /compute/v2.1/servers/d8071344-b39f-4b47-b77c-8afaf51d22a2 => generated 1282 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:15.576001 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-15cca11b-3039-480b-93b1-6bed387c3679 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:15.582558 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-15cca11b-3039-480b-93b1-6bed387c3679 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:15.614106 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-15cca11b-3039-480b-93b1-6bed387c3679 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:15.617482 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-15cca11b-3039-480b-93b1-6bed387c3679 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:15.618867 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-15cca11b-3039-480b-93b1-6bed387c3679 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:15.619648 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-15cca11b-3039-480b-93b1-6bed387c3679 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:15.621920 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-15cca11b-3039-480b-93b1-6bed387c3679 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:15.623306 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-15cca11b-3039-480b-93b1-6bed387c3679 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:16.030293 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-79b33374-bb32-462b-95b6-e2fb93f2b7f1 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:52:16.030818 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-79b33374-bb32-462b-95b6-e2fb93f2b7f1 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:52:16.031205 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-79b33374-bb32-462b-95b6-e2fb93f2b7f1 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:52:16.031618 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-79b33374-bb32-462b-95b6-e2fb93f2b7f1 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:52:16.032036 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-79b33374-bb32-462b-95b6-e2fb93f2b7f1 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:52:16.047119 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-79b33374-bb32-462b-95b6-e2fb93f2b7f1 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:16.047620 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-79b33374-bb32-462b-95b6-e2fb93f2b7f1 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:16.048065 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-79b33374-bb32-462b-95b6-e2fb93f2b7f1 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:16.048808 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-79b33374-bb32-462b-95b6-e2fb93f2b7f1 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:16.051494 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-79b33374-bb32-462b-95b6-e2fb93f2b7f1 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:16.051995 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-79b33374-bb32-462b-95b6-e2fb93f2b7f1 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:16.088560 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-79b33374-bb32-462b-95b6-e2fb93f2b7f1 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Getting quotas for project 33063b3b9e0543369c28ea918f52cf37. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:52:16.095488 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-79b33374-bb32-462b-95b6-e2fb93f2b7f1 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Getting quotas for user 8f487f5d062e4ac3bf21c2416a7b50ee and project 33063b3b9e0543369c28ea918f52cf37. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:52:16.111913 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-79b33374-bb32-462b-95b6-e2fb93f2b7f1 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:52:16.114879 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-79b33374-bb32-462b-95b6-e2fb93f2b7f1 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: a882cf75-539a-45fa-ae2b-4e0f043b340d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:52:16.180053 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-79b33374-bb32-462b-95b6-e2fb93f2b7f1 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.700731 Sep 08 10:52:16.181922 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1628/3239] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:52:14 2022] POST /compute/v2.1/servers => generated 383 bytes in 1703 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:52:16.188035 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6738ad06-d3e8-4762-a5c3-871e0acc9e8b tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ec103176-3e38-4182-89db-1b883022c1af"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:52:16.191329 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6738ad06-d3e8-4762-a5c3-871e0acc9e8b tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: f182d52b-9650-44f2-bd28-f2ae1daa1438] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:16.199923 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6738ad06-d3e8-4762-a5c3-871e0acc9e8b tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:16.200639 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6738ad06-d3e8-4762-a5c3-871e0acc9e8b tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:16.201420 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6738ad06-d3e8-4762-a5c3-871e0acc9e8b tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:16.202448 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6738ad06-d3e8-4762-a5c3-871e0acc9e8b tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:16.203105 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6738ad06-d3e8-4762-a5c3-871e0acc9e8b tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:16.203838 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6738ad06-d3e8-4762-a5c3-871e0acc9e8b tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:16.401530 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-6738ad06-d3e8-4762-a5c3-871e0acc9e8b tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] HTTP exception thrown: Invalid volume: volume ec103176-3e38-4182-89db-1b883022c1af is already attached to instances: f182d52b-9650-44f2-bd28-f2ae1daa1438 Sep 08 10:52:16.404064 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6738ad06-d3e8-4762-a5c3-871e0acc9e8b tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Request method failure captured: Sep 08 10:52:16.404064 n-d-850501-12 devstack@n-api.service[128862]: request: POST /compute/v2.1/servers/f182d52b-9650-44f2-bd28-f2ae1daa1438/os-volume_attachments HTTP/1.1 Sep 08 10:52:16.404064 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:52:16.404064 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:52:16.404064 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:52:16.404064 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 74 Sep 08 10:52:16.404064 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:52:16.404064 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:52:16.404064 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:52:16.404064 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:52:16.404064 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcf85nxlXglNpNUDafAex8bEd4FqCO21NTPeXDX2uUnTAK4RtQmB0Zln5OyfaDsL03XE7NxjFWJINQM-4CVmZPvJMmjswkfAMS-LTodBU21IQa_AJm8NdfZKIu9JkoC4h7calajGQneT5j1jgUkjySqAUeFvWcq2xoj6sNreqExg8K8 Sep 08 10:52:16.404064 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:52:16.404064 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:52:16.404064 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:52:16.404064 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:52:16.404064 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:52:16.404064 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:52:16.404064 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 20f9a24cad014d7f827e8f3236dd5bae Sep 08 10:52:16.404064 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-AttachVolumeNegativeTest-20693983 Sep 08 10:52:16.404064 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:52:16.404064 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:52:16.404064 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/20f9a24cad014d7f827e8f3236dd5bae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/20f9a24cad014d7f827e8f3236dd5bae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_20f9a24cad014d7f827e8f3236dd5bae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/20f9a24cad014d7f827e8f3236dd5bae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:52:16.404064 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-AttachVolumeNegativeTest-20693983 Sep 08 10:52:16.404064 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 20f9a24cad014d7f827e8f3236dd5bae Sep 08 10:52:16.404064 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-20693983 Sep 08 10:52:16.404064 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-AttachVolumeNegativeTest-20693983-project Sep 08 10:52:16.404064 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:52:16.404064 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:52:16.404064 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 5c291cbe955b4ee5abc98132dda0255e Sep 08 10:52:16.404064 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-AttachVolumeNegativeTest-20693983-project Sep 08 10:52:16.404064 n-d-850501-12 devstack@n-api.service[128862]: Sep 08 10:52:16.404064 n-d-850501-12 devstack@n-api.service[128862]: {"volumeAttachment": {"volumeId": "ec103176-3e38-4182-89db-1b883022c1af"}} Sep 08 10:52:16.404064 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:52:16.404064 n-d-850501-12 devstack@n-api.service[128862]: exception: Invalid volume: volume ec103176-3e38-4182-89db-1b883022c1af is already attached to instances: f182d52b-9650-44f2-bd28-f2ae1daa1438 Sep 08 10:52:16.404064 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'server_id': 'f182d52b-9650-44f2-bd28-f2ae1daa1438', 'body': {'volumeAttachment': {'volumeId': 'ec103176-3e38-4182-89db-1b883022c1af'}}} Sep 08 10:52:16.404064 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:52:16.404064 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:16.404064 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 08 10:52:16.404064 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 08 10:52:16.404064 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 10:52:16.404064 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 10:52:16.404064 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 08 10:52:16.404064 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 08 10:52:16.404064 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 08 10:52:16.404064 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 08 10:52:16.404064 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 08 10:52:16.404064 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 08 10:52:16.404064 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ec103176-3e38-4182-89db-1b883022c1af is already attached to instances: f182d52b-9650-44f2-bd28-f2ae1daa1438 Sep 08 10:52:16.404064 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:16.404064 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:52:16.404064 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:16.404064 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:16.404064 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:52:16.404064 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:52:16.404064 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:52:16.404064 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:52:16.404064 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:52:16.404064 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:52:16.404064 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:52:16.404064 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:52:16.404064 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:52:16.404064 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:52:16.410358 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:52:16.410358 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:52:16.410358 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 08 10:52:16.410358 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 08 10:52:16.410358 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ec103176-3e38-4182-89db-1b883022c1af is already attached to instances: f182d52b-9650-44f2-bd28-f2ae1daa1438 Sep 08 10:52:16.410358 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:16.410358 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:52:16.410358 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:16.410358 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:16.410358 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:52:16.410358 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:52:16.410358 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:52:16.410358 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:52:16.410358 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ec103176-3e38-4182-89db-1b883022c1af is already attached to instances: f182d52b-9650-44f2-bd28-f2ae1daa1438 Sep 08 10:52:16.410358 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:16.415951 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6738ad06-d3e8-4762-a5c3-871e0acc9e8b tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Returning 400 to user: Invalid volume: volume ec103176-3e38-4182-89db-1b883022c1af is already attached to instances: f182d52b-9650-44f2-bd28-f2ae1daa1438 {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:52:16.417227 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6738ad06-d3e8-4762-a5c3-871e0acc9e8b tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "POST /compute/v2.1/servers/f182d52b-9650-44f2-bd28-f2ae1daa1438/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.233902 Sep 08 10:52:16.418985 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1629/3240] 10.222.0.27 () {60 vars in 1323 bytes} [Thu Sep 8 10:52:16 2022] POST /compute/v2.1/servers/f182d52b-9650-44f2-bd28-f2ae1daa1438/os-volume_attachments => generated 174 bytes in 236 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:52:16.424649 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8920d37a-199d-42a3-b521-7f739ad60b02 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:16.425387 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8920d37a-199d-42a3-b521-7f739ad60b02 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:16.433778 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8920d37a-199d-42a3-b521-7f739ad60b02 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:16.434543 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8920d37a-199d-42a3-b521-7f739ad60b02 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:16.435471 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8920d37a-199d-42a3-b521-7f739ad60b02 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:16.436558 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8920d37a-199d-42a3-b521-7f739ad60b02 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:16.437510 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8920d37a-199d-42a3-b521-7f739ad60b02 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:16.438174 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8920d37a-199d-42a3-b521-7f739ad60b02 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:16.694625 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8920d37a-199d-42a3-b521-7f739ad60b02 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:16.741066 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8920d37a-199d-42a3-b521-7f739ad60b02 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:16.763283 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8920d37a-199d-42a3-b521-7f739ad60b02 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:16.805783 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8920d37a-199d-42a3-b521-7f739ad60b02 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1533 microversion: 2.91 time: 0.380390 Sep 08 10:52:16.825919 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1630/3241] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:52:16 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1533 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:52:16.856254 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-16b924b2-aa26-49f0-a2e8-c1694860f6dc tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:16.857235 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-16b924b2-aa26-49f0-a2e8-c1694860f6dc tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: a882cf75-539a-45fa-ae2b-4e0f043b340d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:16.875556 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-15cca11b-3039-480b-93b1-6bed387c3679 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:16.889749 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-15cca11b-3039-480b-93b1-6bed387c3679 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1364 microversion: 2.1 time: 1.323539 Sep 08 10:52:16.897558 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1612/3242] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:15 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1364 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:16.913103 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-19f5a8f8-4f8f-4e7b-9c72-b9dbf6b9e76d tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:16.914098 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-19f5a8f8-4f8f-4e7b-9c72-b9dbf6b9e76d tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:16.924584 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-19f5a8f8-4f8f-4e7b-9c72-b9dbf6b9e76d tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:16.928811 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-19f5a8f8-4f8f-4e7b-9c72-b9dbf6b9e76d tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:16.930692 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-19f5a8f8-4f8f-4e7b-9c72-b9dbf6b9e76d tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:16.934777 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-19f5a8f8-4f8f-4e7b-9c72-b9dbf6b9e76d tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:16.937685 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-19f5a8f8-4f8f-4e7b-9c72-b9dbf6b9e76d tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:16.942005 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-19f5a8f8-4f8f-4e7b-9c72-b9dbf6b9e76d tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:16.974803 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-16b924b2-aa26-49f0-a2e8-c1694860f6dc tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:16.986214 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-16b924b2-aa26-49f0-a2e8-c1694860f6dc tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d" status: 200 len: 1222 microversion: 2.1 time: 0.157336 Sep 08 10:52:17.000720 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1631/3243] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:16 2022] GET /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d => generated 1222 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:17.009499 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c2a338bc-5bf8-4b56-8b98-008118c50ef6 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:17.011255 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c2a338bc-5bf8-4b56-8b98-008118c50ef6 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: d8071344-b39f-4b47-b77c-8afaf51d22a2] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:17.029077 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2a338bc-5bf8-4b56-8b98-008118c50ef6 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:17.032295 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2a338bc-5bf8-4b56-8b98-008118c50ef6 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:17.033680 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2a338bc-5bf8-4b56-8b98-008118c50ef6 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:17.037084 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2a338bc-5bf8-4b56-8b98-008118c50ef6 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:17.038666 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2a338bc-5bf8-4b56-8b98-008118c50ef6 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:17.039992 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2a338bc-5bf8-4b56-8b98-008118c50ef6 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:17.174853 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c2a338bc-5bf8-4b56-8b98-008118c50ef6 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86e8bd6f9048ce8718f432e51128a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c3752f739b47a296a5b88948fe7f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:17.184175 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c2a338bc-5bf8-4b56-8b98-008118c50ef6 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "GET /compute/v2.1/servers/d8071344-b39f-4b47-b77c-8afaf51d22a2" status: 200 len: 1282 microversion: 2.1 time: 0.182169 Sep 08 10:52:17.185282 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1632/3244] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:17 2022] GET /compute/v2.1/servers/d8071344-b39f-4b47-b77c-8afaf51d22a2 => generated 1282 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:17.204614 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-254171d9-636b-4340-9166-4e645a612661 req-20b88a2e-61cd-4658-a754-20a70605a207 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98277784-8e48-4a7b-8786-ce579e1d5ccf", "name": "network-vif-plugged", "status": "completed", "tag": "742e7fd9-9529-4661-8ad0-c2f50b7bb9d8"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:52:17.217483 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-254171d9-636b-4340-9166-4e645a612661 req-20b88a2e-61cd-4658-a754-20a70605a207 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:17.218428 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-254171d9-636b-4340-9166-4e645a612661 req-20b88a2e-61cd-4658-a754-20a70605a207 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:17.219507 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-254171d9-636b-4340-9166-4e645a612661 req-20b88a2e-61cd-4658-a754-20a70605a207 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:17.235155 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-254171d9-636b-4340-9166-4e645a612661 req-20b88a2e-61cd-4658-a754-20a70605a207 service nova] Creating event network-vif-plugged:742e7fd9-9529-4661-8ad0-c2f50b7bb9d8 for instance 98277784-8e48-4a7b-8786-ce579e1d5ccf on n-h2-850501-12 Sep 08 10:52:17.243279 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-254171d9-636b-4340-9166-4e645a612661 req-20b88a2e-61cd-4658-a754-20a70605a207 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055265 Sep 08 10:52:17.244141 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1633/3245] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:52:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:52:17.258594 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8f7314b8-2fcc-4c82-9b2f-04d48a5d8e1c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:17.259718 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8f7314b8-2fcc-4c82-9b2f-04d48a5d8e1c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: f182d52b-9650-44f2-bd28-f2ae1daa1438] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:17.278771 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f7314b8-2fcc-4c82-9b2f-04d48a5d8e1c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:17.282154 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f7314b8-2fcc-4c82-9b2f-04d48a5d8e1c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:17.284443 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f7314b8-2fcc-4c82-9b2f-04d48a5d8e1c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:17.285422 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f7314b8-2fcc-4c82-9b2f-04d48a5d8e1c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:17.286054 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f7314b8-2fcc-4c82-9b2f-04d48a5d8e1c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:17.288958 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f7314b8-2fcc-4c82-9b2f-04d48a5d8e1c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:17.321162 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:52:17.465723 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-8f7314b8-2fcc-4c82-9b2f-04d48a5d8e1c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lazy-loading 'services' on Instance uuid f182d52b-9650-44f2-bd28-f2ae1daa1438 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:52:17.624941 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8f7314b8-2fcc-4c82-9b2f-04d48a5d8e1c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f182d52b-9650-44f2-bd28-f2ae1daa1438/os-volume_attachments/ec103176-3e38-4182-89db-1b883022c1af" status: 202 len: 0 microversion: 2.1 time: 0.378884 Sep 08 10:52:17.628737 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1634/3246] 10.222.0.27 () {58 vars in 1416 bytes} [Thu Sep 8 10:52:17 2022] DELETE /compute/v2.1/servers/f182d52b-9650-44f2-bd28-f2ae1daa1438/os-volume_attachments/ec103176-3e38-4182-89db-1b883022c1af => generated 0 bytes in 381 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:52:17.659206 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b3ba3e1d-0221-4f77-81c2-51677439836d tempest-UnshelveToHostMultiNodesTest-1667251479 tempest-UnshelveToHostMultiNodesTest-1667251479-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:17.660419 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b3ba3e1d-0221-4f77-81c2-51677439836d tempest-UnshelveToHostMultiNodesTest-1667251479 tempest-UnshelveToHostMultiNodesTest-1667251479-project-admin] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:17.676643 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3ba3e1d-0221-4f77-81c2-51677439836d tempest-UnshelveToHostMultiNodesTest-1667251479 tempest-UnshelveToHostMultiNodesTest-1667251479-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:17.677192 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3ba3e1d-0221-4f77-81c2-51677439836d tempest-UnshelveToHostMultiNodesTest-1667251479 tempest-UnshelveToHostMultiNodesTest-1667251479-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:17.677839 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3ba3e1d-0221-4f77-81c2-51677439836d tempest-UnshelveToHostMultiNodesTest-1667251479 tempest-UnshelveToHostMultiNodesTest-1667251479-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:17.679322 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3ba3e1d-0221-4f77-81c2-51677439836d tempest-UnshelveToHostMultiNodesTest-1667251479 tempest-UnshelveToHostMultiNodesTest-1667251479-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:17.680412 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3ba3e1d-0221-4f77-81c2-51677439836d tempest-UnshelveToHostMultiNodesTest-1667251479 tempest-UnshelveToHostMultiNodesTest-1667251479-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:17.681058 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3ba3e1d-0221-4f77-81c2-51677439836d tempest-UnshelveToHostMultiNodesTest-1667251479 tempest-UnshelveToHostMultiNodesTest-1667251479-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:17.813288 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-b3ba3e1d-0221-4f77-81c2-51677439836d tempest-UnshelveToHostMultiNodesTest-1667251479 tempest-UnshelveToHostMultiNodesTest-1667251479-project-admin] Lazy-loading 'services' on Instance uuid 0b71abe8-cfe5-4b57-8860-7861810d9c7b {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:52:17.844205 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b3ba3e1d-0221-4f77-81c2-51677439836d tempest-UnshelveToHostMultiNodesTest-1667251479 tempest-UnshelveToHostMultiNodesTest-1667251479-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1940 microversion: 2.91 time: 0.216892 Sep 08 10:52:17.859073 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1635/3247] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:52:17 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1940 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:52:17.950440 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-19f5a8f8-4f8f-4e7b-9c72-b9dbf6b9e76d tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:17.969229 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-19f5a8f8-4f8f-4e7b-9c72-b9dbf6b9e76d tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:17.971071 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-19f5a8f8-4f8f-4e7b-9c72-b9dbf6b9e76d tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:17.972301 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-19f5a8f8-4f8f-4e7b-9c72-b9dbf6b9e76d tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 200 len: 1875 microversion: 2.32 time: 1.072357 Sep 08 10:52:17.988853 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8496bcbe-84c4-465d-bbac-35f381f416a1 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Action: 'create', calling method: .version_select at 0x7f68e4217550>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1421145113", "policies": ["affinity"]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:52:17.990746 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1613/3248] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:52:16 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 1875 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:52:18.007285 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-45b7e167-c75a-4b1a-9977-e257a2361e85 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:18.010787 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-45b7e167-c75a-4b1a-9977-e257a2361e85 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: f182d52b-9650-44f2-bd28-f2ae1daa1438] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:18.025658 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-8496bcbe-84c4-465d-bbac-35f381f416a1 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Getting quotas for project 1df398bd0b3f45e9b11fe4212d6b5729. Resources: {'server_groups'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:52:18.026094 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-45b7e167-c75a-4b1a-9977-e257a2361e85 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:18.026843 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-45b7e167-c75a-4b1a-9977-e257a2361e85 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:18.027795 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-45b7e167-c75a-4b1a-9977-e257a2361e85 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:18.029159 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-45b7e167-c75a-4b1a-9977-e257a2361e85 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:18.029993 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-45b7e167-c75a-4b1a-9977-e257a2361e85 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:18.030817 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-45b7e167-c75a-4b1a-9977-e257a2361e85 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:18.046657 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-8496bcbe-84c4-465d-bbac-35f381f416a1 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Getting quotas for user 4b1502b3b00c449399ac35378281d992 and project 1df398bd0b3f45e9b11fe4212d6b5729. Resources: {'server_groups'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:52:18.099064 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-45b7e167-c75a-4b1a-9977-e257a2361e85 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/f182d52b-9650-44f2-bd28-f2ae1daa1438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106878 Sep 08 10:52:18.100063 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1614/3249] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 10:52:17 2022] GET /compute/v2.1/servers/f182d52b-9650-44f2-bd28-f2ae1daa1438/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:52:18.105979 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e78e7f47-207b-4dfe-a07f-93e44f2a4c3b tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:18.107197 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e78e7f47-207b-4dfe-a07f-93e44f2a4c3b tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:18.116401 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e78e7f47-207b-4dfe-a07f-93e44f2a4c3b tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:18.117405 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e78e7f47-207b-4dfe-a07f-93e44f2a4c3b tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:18.118120 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e78e7f47-207b-4dfe-a07f-93e44f2a4c3b tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:18.119248 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e78e7f47-207b-4dfe-a07f-93e44f2a4c3b tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:18.119951 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e78e7f47-207b-4dfe-a07f-93e44f2a4c3b tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:18.122152 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e78e7f47-207b-4dfe-a07f-93e44f2a4c3b tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:18.130615 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:52:18.170253 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e78e7f47-207b-4dfe-a07f-93e44f2a4c3b tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:52:18.190268 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-8496bcbe-84c4-465d-bbac-35f381f416a1 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Getting quotas for project 1df398bd0b3f45e9b11fe4212d6b5729. Resources: {'server_groups'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:52:18.203075 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-8496bcbe-84c4-465d-bbac-35f381f416a1 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Getting quotas for user 4b1502b3b00c449399ac35378281d992 and project 1df398bd0b3f45e9b11fe4212d6b5729. Resources: {'server_groups'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:52:18.248099 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8496bcbe-84c4-465d-bbac-35f381f416a1 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.400756 Sep 08 10:52:18.254746 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1636/3250] 10.222.0.27 () {60 vars in 1174 bytes} [Thu Sep 8 10:52:17 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:52:18.262660 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-830c39c7-552d-4ded-86ad-ae6d5e43590b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:18.263676 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-830c39c7-552d-4ded-86ad-ae6d5e43590b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:18.277050 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-830c39c7-552d-4ded-86ad-ae6d5e43590b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:18.278310 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-830c39c7-552d-4ded-86ad-ae6d5e43590b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:18.288034 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-830c39c7-552d-4ded-86ad-ae6d5e43590b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:18.289844 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-830c39c7-552d-4ded-86ad-ae6d5e43590b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:18.290823 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-830c39c7-552d-4ded-86ad-ae6d5e43590b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:18.291803 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-830c39c7-552d-4ded-86ad-ae6d5e43590b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:18.317421 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e78e7f47-207b-4dfe-a07f-93e44f2a4c3b tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 204 len: 0 microversion: 2.91 time: 0.214819 Sep 08 10:52:18.325054 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1615/3251] 10.222.0.27 () {60 vars in 1280 bytes} [Thu Sep 8 10:52:18 2022] DELETE /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 10:52:18.335139 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-eda7123f-4e5f-483d-bf00-14a28ea09078 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:18.336488 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-eda7123f-4e5f-483d-bf00-14a28ea09078 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: a882cf75-539a-45fa-ae2b-4e0f043b340d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:18.344576 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eda7123f-4e5f-483d-bf00-14a28ea09078 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:18.346180 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eda7123f-4e5f-483d-bf00-14a28ea09078 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:18.346951 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eda7123f-4e5f-483d-bf00-14a28ea09078 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:18.348170 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eda7123f-4e5f-483d-bf00-14a28ea09078 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:18.349070 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eda7123f-4e5f-483d-bf00-14a28ea09078 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:18.349754 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eda7123f-4e5f-483d-bf00-14a28ea09078 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:18.559729 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-eda7123f-4e5f-483d-bf00-14a28ea09078 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:18.578458 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-eda7123f-4e5f-483d-bf00-14a28ea09078 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d" status: 200 len: 1282 microversion: 2.1 time: 0.251070 Sep 08 10:52:18.579271 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1616/3252] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:18 2022] GET /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d => generated 1282 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:18.598277 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-767a0802-ba63-4fce-9ec7-f15bba0d5e5b tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:18.599065 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-767a0802-ba63-4fce-9ec7-f15bba0d5e5b tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: d8071344-b39f-4b47-b77c-8afaf51d22a2] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:18.613518 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-767a0802-ba63-4fce-9ec7-f15bba0d5e5b tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:18.614147 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-767a0802-ba63-4fce-9ec7-f15bba0d5e5b tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:18.614669 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-767a0802-ba63-4fce-9ec7-f15bba0d5e5b tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:18.616619 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-767a0802-ba63-4fce-9ec7-f15bba0d5e5b tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:18.618542 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-767a0802-ba63-4fce-9ec7-f15bba0d5e5b tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:18.623344 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-767a0802-ba63-4fce-9ec7-f15bba0d5e5b tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:19.020366 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-767a0802-ba63-4fce-9ec7-f15bba0d5e5b tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86e8bd6f9048ce8718f432e51128a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c3752f739b47a296a5b88948fe7f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:19.037266 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-767a0802-ba63-4fce-9ec7-f15bba0d5e5b tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "GET /compute/v2.1/servers/d8071344-b39f-4b47-b77c-8afaf51d22a2" status: 200 len: 1324 microversion: 2.1 time: 0.452941 Sep 08 10:52:19.038238 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1617/3253] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:18 2022] GET /compute/v2.1/servers/d8071344-b39f-4b47-b77c-8afaf51d22a2 => generated 1324 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:19.053144 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ffe93efc-74d0-4cf2-9744-ab8194fa8ce9 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Action: 'create', calling method: .version_select at 0x7f68e46e1700>, body: {"server_group": {"name": "tempest-server-group-653925004", "policies": ["affinity"]}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:52:19.057878 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-830c39c7-552d-4ded-86ad-ae6d5e43590b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:19.073356 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-830c39c7-552d-4ded-86ad-ae6d5e43590b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1364 microversion: 2.1 time: 0.814551 Sep 08 10:52:19.073656 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=91,nova_api:UPDATE=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:52:19.075950 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1637/3254] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:18 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1364 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:19.086195 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-74bce63c-51fc-476d-bc73-10a6f2587577 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:19.095064 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-74bce63c-51fc-476d-bc73-10a6f2587577 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:19.109790 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-ffe93efc-74d0-4cf2-9744-ab8194fa8ce9 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Getting quotas for project 1df398bd0b3f45e9b11fe4212d6b5729. Resources: {'server_groups'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:52:19.111282 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-74bce63c-51fc-476d-bc73-10a6f2587577 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:19.116120 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-74bce63c-51fc-476d-bc73-10a6f2587577 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:19.116280 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-ffe93efc-74d0-4cf2-9744-ab8194fa8ce9 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Getting quotas for user 4b1502b3b00c449399ac35378281d992 and project 1df398bd0b3f45e9b11fe4212d6b5729. Resources: {'server_groups'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:52:19.118015 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-74bce63c-51fc-476d-bc73-10a6f2587577 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:19.122773 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-74bce63c-51fc-476d-bc73-10a6f2587577 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:19.123370 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-74bce63c-51fc-476d-bc73-10a6f2587577 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:19.123830 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-74bce63c-51fc-476d-bc73-10a6f2587577 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:19.215705 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-ffe93efc-74d0-4cf2-9744-ab8194fa8ce9 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Getting quotas for project 1df398bd0b3f45e9b11fe4212d6b5729. Resources: {'server_groups'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:52:19.229445 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-ffe93efc-74d0-4cf2-9744-ab8194fa8ce9 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Getting quotas for user 4b1502b3b00c449399ac35378281d992 and project 1df398bd0b3f45e9b11fe4212d6b5729. Resources: {'server_groups'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:52:19.262666 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ffe93efc-74d0-4cf2-9744-ab8194fa8ce9 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.223164 Sep 08 10:52:19.267393 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1618/3255] 10.222.0.27 () {60 vars in 1173 bytes} [Thu Sep 8 10:52:19 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:52:19.275103 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b5ab2b3a-69a7-4412-b9bd-b7ae4bef8ccb tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:19.281934 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b5ab2b3a-69a7-4412-b9bd-b7ae4bef8ccb tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:19.289263 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b5ab2b3a-69a7-4412-b9bd-b7ae4bef8ccb tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:19.289872 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b5ab2b3a-69a7-4412-b9bd-b7ae4bef8ccb tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:19.290389 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b5ab2b3a-69a7-4412-b9bd-b7ae4bef8ccb tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:19.291182 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b5ab2b3a-69a7-4412-b9bd-b7ae4bef8ccb tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:19.291742 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b5ab2b3a-69a7-4412-b9bd-b7ae4bef8ccb tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:19.292308 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b5ab2b3a-69a7-4412-b9bd-b7ae4bef8ccb tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:19.318186 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-74bce63c-51fc-476d-bc73-10a6f2587577 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:19.333506 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-74bce63c-51fc-476d-bc73-10a6f2587577 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:19.341230 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-74bce63c-51fc-476d-bc73-10a6f2587577 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:19.353245 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-74bce63c-51fc-476d-bc73-10a6f2587577 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1539 microversion: 2.91 time: 0.275193 Sep 08 10:52:19.353857 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1638/3256] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:52:19 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1539 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:52:19.369316 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ec37ded9-38cc-4d5f-bb37-277cd5d2176c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:19.380350 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ec37ded9-38cc-4d5f-bb37-277cd5d2176c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: f182d52b-9650-44f2-bd28-f2ae1daa1438] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:19.387284 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec37ded9-38cc-4d5f-bb37-277cd5d2176c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:19.388280 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec37ded9-38cc-4d5f-bb37-277cd5d2176c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:19.388976 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec37ded9-38cc-4d5f-bb37-277cd5d2176c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:19.389966 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec37ded9-38cc-4d5f-bb37-277cd5d2176c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:19.390673 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec37ded9-38cc-4d5f-bb37-277cd5d2176c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:19.391321 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec37ded9-38cc-4d5f-bb37-277cd5d2176c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:19.441417 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ec37ded9-38cc-4d5f-bb37-277cd5d2176c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/f182d52b-9650-44f2-bd28-f2ae1daa1438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083848 Sep 08 10:52:19.442363 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1639/3257] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 10:52:19 2022] GET /compute/v2.1/servers/f182d52b-9650-44f2-bd28-f2ae1daa1438/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:52:19.447556 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-b3c2dbee-8898-4b11-9aab-8ec22e17239a req-291240d6-646e-4e3c-8931-86f2b8def300 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98277784-8e48-4a7b-8786-ce579e1d5ccf", "name": "network-vif-plugged", "status": "completed", "tag": "87858844-1949-4224-96fe-9b4790f10cad"}, {"server_uuid": "98277784-8e48-4a7b-8786-ce579e1d5ccf", "name": "network-vif-plugged", "status": "completed", "tag": "c559d837-313a-4f2e-8c4a-0410f4b4fafd"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:52:19.458392 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b3c2dbee-8898-4b11-9aab-8ec22e17239a req-291240d6-646e-4e3c-8931-86f2b8def300 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:19.459238 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b3c2dbee-8898-4b11-9aab-8ec22e17239a req-291240d6-646e-4e3c-8931-86f2b8def300 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:19.459887 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b3c2dbee-8898-4b11-9aab-8ec22e17239a req-291240d6-646e-4e3c-8931-86f2b8def300 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:19.927323 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-b3c2dbee-8898-4b11-9aab-8ec22e17239a req-291240d6-646e-4e3c-8931-86f2b8def300 service nova] Creating event network-vif-plugged:87858844-1949-4224-96fe-9b4790f10cad for instance 98277784-8e48-4a7b-8786-ce579e1d5ccf on n-h2-850501-12 Sep 08 10:52:19.930247 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-b3c2dbee-8898-4b11-9aab-8ec22e17239a req-291240d6-646e-4e3c-8931-86f2b8def300 service nova] Creating event network-vif-plugged:c559d837-313a-4f2e-8c4a-0410f4b4fafd for instance 98277784-8e48-4a7b-8786-ce579e1d5ccf on n-h2-850501-12 Sep 08 10:52:19.942975 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-b3c2dbee-8898-4b11-9aab-8ec22e17239a req-291240d6-646e-4e3c-8931-86f2b8def300 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.498811 Sep 08 10:52:19.943606 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1640/3258] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:52:19 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:52:19.962660 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0dc74c2f-7d41-48ee-98ff-5e5fe452311f tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Action: 'create', calling method: .version_select at 0x7f68e416f040>, body: {"server_group": {"name": "tempest-server-group-653925004", "policies": ["affinity"]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:52:19.987545 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-0dc74c2f-7d41-48ee-98ff-5e5fe452311f tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Getting quotas for project 1df398bd0b3f45e9b11fe4212d6b5729. Resources: {'server_groups'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:52:19.994652 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-0dc74c2f-7d41-48ee-98ff-5e5fe452311f tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Getting quotas for user 4b1502b3b00c449399ac35378281d992 and project 1df398bd0b3f45e9b11fe4212d6b5729. Resources: {'server_groups'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:52:20.098083 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-0dc74c2f-7d41-48ee-98ff-5e5fe452311f tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Getting quotas for project 1df398bd0b3f45e9b11fe4212d6b5729. Resources: {'server_groups'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:52:20.114509 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-0dc74c2f-7d41-48ee-98ff-5e5fe452311f tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Getting quotas for user 4b1502b3b00c449399ac35378281d992 and project 1df398bd0b3f45e9b11fe4212d6b5729. Resources: {'server_groups'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:52:20.119910 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b5ab2b3a-69a7-4412-b9bd-b7ae4bef8ccb tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:20.152792 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b5ab2b3a-69a7-4412-b9bd-b7ae4bef8ccb tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:20.157176 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0dc74c2f-7d41-48ee-98ff-5e5fe452311f tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.212279 Sep 08 10:52:20.158240 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1641/3259] 10.222.0.27 () {60 vars in 1173 bytes} [Thu Sep 8 10:52:19 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:52:20.170836 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-772d9bcc-b1f3-4923-9595-a2a202f69361 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:20.171994 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-772d9bcc-b1f3-4923-9595-a2a202f69361 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: a882cf75-539a-45fa-ae2b-4e0f043b340d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:20.173946 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b5ab2b3a-69a7-4412-b9bd-b7ae4bef8ccb tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:20.175390 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b5ab2b3a-69a7-4412-b9bd-b7ae4bef8ccb tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 200 len: 1875 microversion: 2.32 time: 0.906649 Sep 08 10:52:20.175982 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1619/3260] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:52:19 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 1875 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:52:20.187186 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-772d9bcc-b1f3-4923-9595-a2a202f69361 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:20.187973 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-772d9bcc-b1f3-4923-9595-a2a202f69361 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:20.189164 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-772d9bcc-b1f3-4923-9595-a2a202f69361 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:20.191565 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-772d9bcc-b1f3-4923-9595-a2a202f69361 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:20.192286 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-772d9bcc-b1f3-4923-9595-a2a202f69361 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:20.193671 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-772d9bcc-b1f3-4923-9595-a2a202f69361 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:20.218044 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ee070f6c-b442-4e4a-b907-be9969e5620b tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:20.218708 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ee070f6c-b442-4e4a-b907-be9969e5620b tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: d8071344-b39f-4b47-b77c-8afaf51d22a2] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:20.233872 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ee070f6c-b442-4e4a-b907-be9969e5620b tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:20.234385 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ee070f6c-b442-4e4a-b907-be9969e5620b tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:20.234833 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ee070f6c-b442-4e4a-b907-be9969e5620b tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:20.235666 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ee070f6c-b442-4e4a-b907-be9969e5620b tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:20.236125 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ee070f6c-b442-4e4a-b907-be9969e5620b tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:20.236558 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ee070f6c-b442-4e4a-b907-be9969e5620b tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:20.365554 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-772d9bcc-b1f3-4923-9595-a2a202f69361 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:20.377373 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-772d9bcc-b1f3-4923-9595-a2a202f69361 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d" status: 200 len: 1280 microversion: 2.1 time: 0.209357 Sep 08 10:52:20.379364 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1642/3261] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:20 2022] GET /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d => generated 1280 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:20.390176 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-719c2334-d098-4a24-a8d6-3b1f2be83b6e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:20.393164 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-719c2334-d098-4a24-a8d6-3b1f2be83b6e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:20.409326 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-719c2334-d098-4a24-a8d6-3b1f2be83b6e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:20.411913 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-719c2334-d098-4a24-a8d6-3b1f2be83b6e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:20.412377 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-719c2334-d098-4a24-a8d6-3b1f2be83b6e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:20.415799 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-719c2334-d098-4a24-a8d6-3b1f2be83b6e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:20.417207 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-719c2334-d098-4a24-a8d6-3b1f2be83b6e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:20.417722 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-719c2334-d098-4a24-a8d6-3b1f2be83b6e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:20.736215 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ee070f6c-b442-4e4a-b907-be9969e5620b tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86e8bd6f9048ce8718f432e51128a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c3752f739b47a296a5b88948fe7f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:20.758380 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ee070f6c-b442-4e4a-b907-be9969e5620b tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "GET /compute/v2.1/servers/d8071344-b39f-4b47-b77c-8afaf51d22a2" status: 200 len: 1324 microversion: 2.1 time: 0.553987 Sep 08 10:52:20.759590 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1620/3262] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:20 2022] GET /compute/v2.1/servers/d8071344-b39f-4b47-b77c-8afaf51d22a2 => generated 1324 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:20.776483 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-802fce9e-8312-41d0-80bd-315930f7826f tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:20.932019 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-719c2334-d098-4a24-a8d6-3b1f2be83b6e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:20.943733 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-719c2334-d098-4a24-a8d6-3b1f2be83b6e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1364 microversion: 2.1 time: 0.563193 Sep 08 10:52:20.944324 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1643/3263] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:20 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1364 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:20.960518 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-802fce9e-8312-41d0-80bd-315930f7826f tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/d1ef628b-0ea7-4260-8100-a1f0831e05d9" status: 204 len: 0 microversion: 2.1 time: 0.199662 Sep 08 10:52:20.962227 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1621/3264] 10.222.0.27 () {58 vars in 1266 bytes} [Thu Sep 8 10:52:20 2022] DELETE /compute/v2.1/os-server-groups/d1ef628b-0ea7-4260-8100-a1f0831e05d9 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:52:20.971899 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-49532e9e-64a8-4093-a208-1d9c8d3272db tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:20.972513 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-49532e9e-64a8-4093-a208-1d9c8d3272db tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:20.984668 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4e4b19e7-6947-4097-a986-0e1bc093c049 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:20.986816 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49532e9e-64a8-4093-a208-1d9c8d3272db tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:20.987300 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49532e9e-64a8-4093-a208-1d9c8d3272db tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:20.987748 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49532e9e-64a8-4093-a208-1d9c8d3272db tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:20.988468 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49532e9e-64a8-4093-a208-1d9c8d3272db tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:20.988951 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49532e9e-64a8-4093-a208-1d9c8d3272db tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:20.989379 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49532e9e-64a8-4093-a208-1d9c8d3272db tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:20.990410 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4e4b19e7-6947-4097-a986-0e1bc093c049 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: f182d52b-9650-44f2-bd28-f2ae1daa1438] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:21.011046 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4e4b19e7-6947-4097-a986-0e1bc093c049 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:21.021825 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4e4b19e7-6947-4097-a986-0e1bc093c049 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:21.025475 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4e4b19e7-6947-4097-a986-0e1bc093c049 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:21.026618 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4e4b19e7-6947-4097-a986-0e1bc093c049 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:21.027366 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4e4b19e7-6947-4097-a986-0e1bc093c049 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:21.029602 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4e4b19e7-6947-4097-a986-0e1bc093c049 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:21.067053 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49532e9e-64a8-4093-a208-1d9c8d3272db tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:21.067404 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49532e9e-64a8-4093-a208-1d9c8d3272db tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:21.070430 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49532e9e-64a8-4093-a208-1d9c8d3272db tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:21.070956 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-49532e9e-64a8-4093-a208-1d9c8d3272db tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lazy-loading 'fault' on Instance uuid 0b71abe8-cfe5-4b57-8860-7861810d9c7b {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:52:21.126986 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4e4b19e7-6947-4097-a986-0e1bc093c049 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/f182d52b-9650-44f2-bd28-f2ae1daa1438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.160433 Sep 08 10:52:21.133313 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1622/3265] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 10:52:20 2022] GET /compute/v2.1/servers/f182d52b-9650-44f2-bd28-f2ae1daa1438/os-volume_attachments => generated 197 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:52:21.142619 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-76437688-71a5-403d-a940-29851ab97416 req-f358ce8a-45a2-48f9-b1ae-2d3bfd1861c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8071344-b39f-4b47-b77c-8afaf51d22a2", "tag": "dc6c944a-8056-468c-87ed-aaf5e01c9095"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:52:21.164595 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-76437688-71a5-403d-a940-29851ab97416 req-f358ce8a-45a2-48f9-b1ae-2d3bfd1861c6 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:21.165156 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-76437688-71a5-403d-a940-29851ab97416 req-f358ce8a-45a2-48f9-b1ae-2d3bfd1861c6 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:21.165590 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-76437688-71a5-403d-a940-29851ab97416 req-f358ce8a-45a2-48f9-b1ae-2d3bfd1861c6 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:21.192819 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-76437688-71a5-403d-a940-29851ab97416 req-f358ce8a-45a2-48f9-b1ae-2d3bfd1861c6 service nova] Creating event network-changed:dc6c944a-8056-468c-87ed-aaf5e01c9095 for instance d8071344-b39f-4b47-b77c-8afaf51d22a2 on n-h2-850501-12 Sep 08 10:52:21.208276 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-76437688-71a5-403d-a940-29851ab97416 req-f358ce8a-45a2-48f9-b1ae-2d3bfd1861c6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073493 Sep 08 10:52:21.211551 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1623/3266] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:52:21.217957 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-636e820f-3211-440f-996d-872cc7d95281 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:21.261558 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-636e820f-3211-440f-996d-872cc7d95281 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.048545 Sep 08 10:52:21.268704 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1624/3267] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Sep 8 10:52:21 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:52:21.273777 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bf571eb1-8777-4248-a861-9251c2d004ac tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:21.274520 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bf571eb1-8777-4248-a861-9251c2d004ac tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:21.288778 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-49532e9e-64a8-4093-a208-1d9c8d3272db tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:21.305456 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-49532e9e-64a8-4093-a208-1d9c8d3272db tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:21.308016 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-49532e9e-64a8-4093-a208-1d9c8d3272db tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc0451cafe4481a3f2d8bff575226c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42be5dfd0dc4b13804883115d00368f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:21.319217 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf571eb1-8777-4248-a861-9251c2d004ac tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:21.319816 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf571eb1-8777-4248-a861-9251c2d004ac tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:21.320242 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf571eb1-8777-4248-a861-9251c2d004ac tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:21.320976 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf571eb1-8777-4248-a861-9251c2d004ac tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:21.321485 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf571eb1-8777-4248-a861-9251c2d004ac tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:21.321911 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf571eb1-8777-4248-a861-9251c2d004ac tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:21.325666 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:52:21.355400 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-49532e9e-64a8-4093-a208-1d9c8d3272db tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 200 len: 1544 microversion: 2.91 time: 0.389430 Sep 08 10:52:21.356244 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1644/3268] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:52:20 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 1544 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:52:21.360914 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9716b64b-fabf-4ffc-a8dc-dfe710c6d13f tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:21.452791 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9716b64b-fabf-4ffc-a8dc-dfe710c6d13f tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/615dbeab-e4e0-4fe0-9f51-fa59a230d666" status: 204 len: 0 microversion: 2.1 time: 0.095510 Sep 08 10:52:21.460561 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1645/3269] 10.222.0.27 () {58 vars in 1266 bytes} [Thu Sep 8 10:52:21 2022] DELETE /compute/v2.1/os-server-groups/615dbeab-e4e0-4fe0-9f51-fa59a230d666 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:52:21.473402 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-277c03e7-8e54-4894-b7c5-aa315c42c9bf tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:21.473842 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-277c03e7-8e54-4894-b7c5-aa315c42c9bf tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: a882cf75-539a-45fa-ae2b-4e0f043b340d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:21.502735 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-277c03e7-8e54-4894-b7c5-aa315c42c9bf tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:21.503232 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-277c03e7-8e54-4894-b7c5-aa315c42c9bf tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:21.507599 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-277c03e7-8e54-4894-b7c5-aa315c42c9bf tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:21.511281 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-277c03e7-8e54-4894-b7c5-aa315c42c9bf tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:21.512130 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-277c03e7-8e54-4894-b7c5-aa315c42c9bf tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:21.515034 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-277c03e7-8e54-4894-b7c5-aa315c42c9bf tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:21.946018 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-bf571eb1-8777-4248-a861-9251c2d004ac tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:21.961390 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-bf571eb1-8777-4248-a861-9251c2d004ac tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:21.963189 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-bf571eb1-8777-4248-a861-9251c2d004ac tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:21.969187 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bf571eb1-8777-4248-a861-9251c2d004ac tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 200 len: 1875 microversion: 2.32 time: 0.699350 Sep 08 10:52:21.970310 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1625/3270] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:52:21 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 1875 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:52:21.985526 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-aac7c8e5-101e-4d5b-834a-a8836e120ad4 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:22.004171 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-aac7c8e5-101e-4d5b-834a-a8836e120ad4 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.032598 Sep 08 10:52:22.004943 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1626/3271] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Sep 8 10:52:21 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:52:22.016186 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-277c03e7-8e54-4894-b7c5-aa315c42c9bf tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:22.021282 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-277c03e7-8e54-4894-b7c5-aa315c42c9bf tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d" status: 200 len: 1322 microversion: 2.1 time: 0.559255 Sep 08 10:52:22.021873 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1646/3272] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:21 2022] GET /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d => generated 1322 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:22.023266 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8c6b7540-d42a-47a7-a34c-0216c8481bf7 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:22.024061 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8c6b7540-d42a-47a7-a34c-0216c8481bf7 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: d8071344-b39f-4b47-b77c-8afaf51d22a2] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:22.030803 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8c6b7540-d42a-47a7-a34c-0216c8481bf7 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:22.031520 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8c6b7540-d42a-47a7-a34c-0216c8481bf7 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:22.032126 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8c6b7540-d42a-47a7-a34c-0216c8481bf7 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:22.032997 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8c6b7540-d42a-47a7-a34c-0216c8481bf7 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:22.033637 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8c6b7540-d42a-47a7-a34c-0216c8481bf7 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:22.034351 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8c6b7540-d42a-47a7-a34c-0216c8481bf7 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:22.055362 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1d608d91-427f-4d96-ba50-ff3b5757557c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:22.059422 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1d608d91-427f-4d96-ba50-ff3b5757557c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:22.077439 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1d608d91-427f-4d96-ba50-ff3b5757557c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:22.078450 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1d608d91-427f-4d96-ba50-ff3b5757557c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:22.079055 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1d608d91-427f-4d96-ba50-ff3b5757557c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:22.079938 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1d608d91-427f-4d96-ba50-ff3b5757557c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:22.080583 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1d608d91-427f-4d96-ba50-ff3b5757557c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:22.081248 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1d608d91-427f-4d96-ba50-ff3b5757557c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:22.179321 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=4 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:52:22.378719 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8c6b7540-d42a-47a7-a34c-0216c8481bf7 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86e8bd6f9048ce8718f432e51128a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c3752f739b47a296a5b88948fe7f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:22.389623 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8c6b7540-d42a-47a7-a34c-0216c8481bf7 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "GET /compute/v2.1/servers/d8071344-b39f-4b47-b77c-8afaf51d22a2" status: 200 len: 1324 microversion: 2.1 time: 0.368148 Sep 08 10:52:22.392425 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1627/3273] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:22 2022] GET /compute/v2.1/servers/d8071344-b39f-4b47-b77c-8afaf51d22a2 => generated 1324 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:22.404054 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-9c2a17b3-3538-4592-bb78-019bd02bba01 req-eaa9ffd7-37d1-4329-ad97-06e29c0aa241 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98277784-8e48-4a7b-8786-ce579e1d5ccf", "name": "network-vif-plugged", "status": "completed", "tag": "50649fb7-2e13-4d59-ad27-f52395856925"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:52:22.418662 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-9c2a17b3-3538-4592-bb78-019bd02bba01 req-eaa9ffd7-37d1-4329-ad97-06e29c0aa241 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:22.420939 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-9c2a17b3-3538-4592-bb78-019bd02bba01 req-eaa9ffd7-37d1-4329-ad97-06e29c0aa241 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:22.421890 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-9c2a17b3-3538-4592-bb78-019bd02bba01 req-eaa9ffd7-37d1-4329-ad97-06e29c0aa241 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:22.502838 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-9c2a17b3-3538-4592-bb78-019bd02bba01 req-eaa9ffd7-37d1-4329-ad97-06e29c0aa241 service nova] Creating event network-vif-plugged:50649fb7-2e13-4d59-ad27-f52395856925 for instance 98277784-8e48-4a7b-8786-ce579e1d5ccf on n-h2-850501-12 Sep 08 10:52:22.528977 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-9c2a17b3-3538-4592-bb78-019bd02bba01 req-eaa9ffd7-37d1-4329-ad97-06e29c0aa241 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130393 Sep 08 10:52:22.532542 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1628/3274] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:52:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:52:22.542194 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-43dd058c-5a39-4ce0-87c3-7f9379d1fcdb tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Action: 'create', calling method: .version_select at 0x7f68e4a544c0>, body: {"server_group": {"name": "tempest-server-group-848286676", "policies": ["affinity"]}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:52:22.569734 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-43dd058c-5a39-4ce0-87c3-7f9379d1fcdb tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Getting quotas for project 1df398bd0b3f45e9b11fe4212d6b5729. Resources: {'server_groups'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:52:22.580354 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-43dd058c-5a39-4ce0-87c3-7f9379d1fcdb tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Getting quotas for user 4b1502b3b00c449399ac35378281d992 and project 1df398bd0b3f45e9b11fe4212d6b5729. Resources: {'server_groups'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:52:22.685456 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-43dd058c-5a39-4ce0-87c3-7f9379d1fcdb tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Getting quotas for project 1df398bd0b3f45e9b11fe4212d6b5729. Resources: {'server_groups'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:52:22.691402 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-43dd058c-5a39-4ce0-87c3-7f9379d1fcdb tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Getting quotas for user 4b1502b3b00c449399ac35378281d992 and project 1df398bd0b3f45e9b11fe4212d6b5729. Resources: {'server_groups'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:52:22.716941 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1d608d91-427f-4d96-ba50-ff3b5757557c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:22.733163 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-43dd058c-5a39-4ce0-87c3-7f9379d1fcdb tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.197449 Sep 08 10:52:22.733802 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1629/3275] 10.222.0.27 () {60 vars in 1173 bytes} [Thu Sep 8 10:52:22 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:52:22.736382 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1d608d91-427f-4d96-ba50-ff3b5757557c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1364 microversion: 2.1 time: 0.697742 Sep 08 10:52:22.738324 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1647/3276] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:22 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1364 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:22.748755 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-06364465-ea86-48e3-80db-edb94b47d057 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:22.751220 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-06364465-ea86-48e3-80db-edb94b47d057 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: f182d52b-9650-44f2-bd28-f2ae1daa1438] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:22.752017 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4068553a-ccda-485e-ac27-b3e72e1b2c86 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:22.756135 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4068553a-ccda-485e-ac27-b3e72e1b2c86 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] [instance: 0b71abe8-cfe5-4b57-8860-7861810d9c7b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:22.767533 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06364465-ea86-48e3-80db-edb94b47d057 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:22.772830 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06364465-ea86-48e3-80db-edb94b47d057 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:22.773418 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06364465-ea86-48e3-80db-edb94b47d057 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:22.774311 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4068553a-ccda-485e-ac27-b3e72e1b2c86 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:22.775565 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4068553a-ccda-485e-ac27-b3e72e1b2c86 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:22.776594 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06364465-ea86-48e3-80db-edb94b47d057 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:22.778642 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06364465-ea86-48e3-80db-edb94b47d057 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:22.779127 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06364465-ea86-48e3-80db-edb94b47d057 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:22.780615 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4068553a-ccda-485e-ac27-b3e72e1b2c86 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:22.784616 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4068553a-ccda-485e-ac27-b3e72e1b2c86 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:22.785698 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4068553a-ccda-485e-ac27-b3e72e1b2c86 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:22.786387 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4068553a-ccda-485e-ac27-b3e72e1b2c86 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:22.816979 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-4068553a-ccda-485e-ac27-b3e72e1b2c86 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] HTTP exception thrown: Instance 0b71abe8-cfe5-4b57-8860-7861810d9c7b could not be found. Sep 08 10:52:22.819984 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4068553a-ccda-485e-ac27-b3e72e1b2c86 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Request method failure captured: Sep 08 10:52:22.819984 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b HTTP/1.1 Sep 08 10:52:22.819984 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:52:22.819984 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:52:22.819984 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:52:22.819984 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:52:22.819984 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:52:22.819984 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:52:22.819984 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:52:22.819984 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:52:22.819984 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGciIcXDM_saMt06VSRr41HjQWEZVf62ZOT2ck2OWE_s5Ewsm826qN0Lt9Wosl4TVbJ4hAi42KERi9kf-4dPx7qZmO931Y816ESuUgqURR9dPZgLj0cF-aWRI_zQGfYT-34mmTB4RBmCfMPVducrfFytupjKi13PcDatiJDpSWmZDOxA Sep 08 10:52:22.819984 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:52:22.819984 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:52:22.819984 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:52:22.819984 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:52:22.819984 n-d-850501-12 devstack@n-api.service[128862]: X-Openstack-Nova-Api-Version: 2.91 Sep 08 10:52:22.819984 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:52:22.819984 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:52:22.819984 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: c42be5dfd0dc4b13804883115d00368f Sep 08 10:52:22.819984 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-930576139 Sep 08 10:52:22.819984 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:52:22.819984 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:52:22.819984 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c42be5dfd0dc4b13804883115d00368f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c42be5dfd0dc4b13804883115d00368f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c42be5dfd0dc4b13804883115d00368f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c42be5dfd0dc4b13804883115d00368f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:52:22.819984 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-930576139 Sep 08 10:52:22.819984 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: c42be5dfd0dc4b13804883115d00368f Sep 08 10:52:22.819984 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-930576139 Sep 08 10:52:22.819984 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-UnshelveToHostMultiNodesTest-930576139-project Sep 08 10:52:22.819984 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:52:22.819984 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:52:22.819984 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 97fc0451cafe4481a3f2d8bff575226c Sep 08 10:52:22.819984 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-930576139-project Sep 08 10:52:22.819984 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:52:22.819984 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 0b71abe8-cfe5-4b57-8860-7861810d9c7b could not be found. Sep 08 10:52:22.819984 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '0b71abe8-cfe5-4b57-8860-7861810d9c7b'} Sep 08 10:52:22.819984 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:52:22.819984 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:22.819984 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:52:22.819984 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:52:22.819984 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:52:22.819984 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:52:22.819984 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:52:22.819984 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:52:22.819984 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:52:22.819984 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:52:22.819984 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b71abe8-cfe5-4b57-8860-7861810d9c7b could not be found. Sep 08 10:52:22.819984 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:22.819984 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:52:22.819984 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:22.819984 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:22.819984 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:52:22.819984 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:52:22.819984 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:52:22.819984 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:52:22.819984 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:52:22.819984 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:52:22.819984 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:52:22.819984 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:52:22.819984 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:52:22.819984 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:52:22.819984 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:52:22.819984 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:52:22.819984 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b71abe8-cfe5-4b57-8860-7861810d9c7b could not be found. Sep 08 10:52:22.819984 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:22.819984 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:52:22.827269 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:22.827269 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:22.827269 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:52:22.827269 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:52:22.827269 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:52:22.827269 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:52:22.827269 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b71abe8-cfe5-4b57-8860-7861810d9c7b could not be found. Sep 08 10:52:22.827269 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:22.832238 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4068553a-ccda-485e-ac27-b3e72e1b2c86 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] Returning 404 to user: Instance 0b71abe8-cfe5-4b57-8860-7861810d9c7b could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:52:22.833571 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4068553a-ccda-485e-ac27-b3e72e1b2c86 tempest-UnshelveToHostMultiNodesTest-930576139 tempest-UnshelveToHostMultiNodesTest-930576139-project] 10.222.0.27 "GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b" status: 404 len: 111 microversion: 2.91 time: 0.092816 Sep 08 10:52:22.839243 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1648/3277] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:52:22 2022] GET /compute/v2.1/servers/0b71abe8-cfe5-4b57-8860-7861810d9c7b => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:52:22.847768 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-73a6b14e-50fa-4811-b24e-f08467ef6401 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:22.865955 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-06364465-ea86-48e3-80db-edb94b47d057 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/f182d52b-9650-44f2-bd28-f2ae1daa1438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.131010 Sep 08 10:52:22.868585 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1630/3278] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 10:52:22 2022] GET /compute/v2.1/servers/f182d52b-9650-44f2-bd28-f2ae1daa1438/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:52:22.931878 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-73a6b14e-50fa-4811-b24e-f08467ef6401 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/026b85ca-05d7-42ba-9811-4f0156e7cfed" status: 204 len: 0 microversion: 2.1 time: 0.085678 Sep 08 10:52:22.936890 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1649/3279] 10.222.0.27 () {58 vars in 1266 bytes} [Thu Sep 8 10:52:22 2022] DELETE /compute/v2.1/os-server-groups/026b85ca-05d7-42ba-9811-4f0156e7cfed => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:52:22.945011 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-be1d9c21-8a18-462f-b4b3-6bbf6f0fe1f5 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:22.981080 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-be1d9c21-8a18-462f-b4b3-6bbf6f0fe1f5 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.040336 Sep 08 10:52:22.991986 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1631/3280] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Sep 8 10:52:22 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:52:23.001930 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-05cc517f-98b5-469e-a0c5-55a2968cdf85 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:23.002717 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cc281312-35e8-4904-92e7-60c367d157b8 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Action: 'create', calling method: .version_select at 0x7f68e42123a0>, body: {"server_group": {"name": "tempest-server-group-507151160", "policies": ["anti-affinity"]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:52:23.003604 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-05cc517f-98b5-469e-a0c5-55a2968cdf85 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:23.018386 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-05cc517f-98b5-469e-a0c5-55a2968cdf85 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:23.019271 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-05cc517f-98b5-469e-a0c5-55a2968cdf85 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:23.019978 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-05cc517f-98b5-469e-a0c5-55a2968cdf85 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:23.020963 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-05cc517f-98b5-469e-a0c5-55a2968cdf85 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:23.021676 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-05cc517f-98b5-469e-a0c5-55a2968cdf85 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:23.022337 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-05cc517f-98b5-469e-a0c5-55a2968cdf85 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:23.065955 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-cc281312-35e8-4904-92e7-60c367d157b8 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Getting quotas for project 1df398bd0b3f45e9b11fe4212d6b5729. Resources: {'server_groups'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:52:23.082927 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-cc281312-35e8-4904-92e7-60c367d157b8 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Getting quotas for user 4b1502b3b00c449399ac35378281d992 and project 1df398bd0b3f45e9b11fe4212d6b5729. Resources: {'server_groups'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:52:23.176021 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4,nova_api:DELETE=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:52:23.192933 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-cc281312-35e8-4904-92e7-60c367d157b8 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Getting quotas for project 1df398bd0b3f45e9b11fe4212d6b5729. Resources: {'server_groups'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:52:23.212950 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-cc281312-35e8-4904-92e7-60c367d157b8 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Getting quotas for user 4b1502b3b00c449399ac35378281d992 and project 1df398bd0b3f45e9b11fe4212d6b5729. Resources: {'server_groups'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:52:23.246630 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cc281312-35e8-4904-92e7-60c367d157b8 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.251942 Sep 08 10:52:23.252157 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1650/3281] 10.222.0.27 () {60 vars in 1173 bytes} [Thu Sep 8 10:52:22 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:52:23.260943 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5705cae6-e18d-492b-a886-ba8baff90e17 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:23.262563 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5705cae6-e18d-492b-a886-ba8baff90e17 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: a882cf75-539a-45fa-ae2b-4e0f043b340d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:23.274158 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5705cae6-e18d-492b-a886-ba8baff90e17 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:23.279052 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5705cae6-e18d-492b-a886-ba8baff90e17 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:23.282663 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5705cae6-e18d-492b-a886-ba8baff90e17 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:23.284617 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5705cae6-e18d-492b-a886-ba8baff90e17 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:23.285153 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5705cae6-e18d-492b-a886-ba8baff90e17 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:23.289533 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5705cae6-e18d-492b-a886-ba8baff90e17 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:23.769551 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-05cc517f-98b5-469e-a0c5-55a2968cdf85 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:23.789010 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-05cc517f-98b5-469e-a0c5-55a2968cdf85 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:23.793474 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-05cc517f-98b5-469e-a0c5-55a2968cdf85 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:23.797631 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-05cc517f-98b5-469e-a0c5-55a2968cdf85 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 200 len: 1875 microversion: 2.32 time: 0.801035 Sep 08 10:52:23.800403 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1632/3282] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:52:22 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 1875 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:52:23.814333 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-06760c2a-09b8-4e3d-86a3-b1a818b77269 req-c4f1ff44-3234-49fc-9ddd-8e3e1d8ea98b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fafff8cb-0e6f-4243-a91c-ec559f656880", "tag": "e1da214d-9efc-406e-bdeb-34180a49fc95"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:52:23.836464 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-06760c2a-09b8-4e3d-86a3-b1a818b77269 req-c4f1ff44-3234-49fc-9ddd-8e3e1d8ea98b service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:23.838010 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-06760c2a-09b8-4e3d-86a3-b1a818b77269 req-c4f1ff44-3234-49fc-9ddd-8e3e1d8ea98b service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:23.842263 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-06760c2a-09b8-4e3d-86a3-b1a818b77269 req-c4f1ff44-3234-49fc-9ddd-8e3e1d8ea98b service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:23.905577 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-06760c2a-09b8-4e3d-86a3-b1a818b77269 req-c4f1ff44-3234-49fc-9ddd-8e3e1d8ea98b service nova] Creating event network-changed:e1da214d-9efc-406e-bdeb-34180a49fc95 for instance fafff8cb-0e6f-4243-a91c-ec559f656880 on n-h2-850501-12 Sep 08 10:52:23.927082 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-06760c2a-09b8-4e3d-86a3-b1a818b77269 req-c4f1ff44-3234-49fc-9ddd-8e3e1d8ea98b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121672 Sep 08 10:52:23.927980 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1633/3283] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:52:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:52:23.949704 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e73fc58a-9bba-43cb-ba77-47f373929dec tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:24.028441 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e73fc58a-9bba-43cb-ba77-47f373929dec tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/3baed203-b777-4198-b76b-419b7501bbf8" status: 204 len: 0 microversion: 2.1 time: 0.097406 Sep 08 10:52:24.029542 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1634/3284] 10.222.0.27 () {58 vars in 1266 bytes} [Thu Sep 8 10:52:23 2022] DELETE /compute/v2.1/os-server-groups/3baed203-b777-4198-b76b-419b7501bbf8 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:52:24.041766 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-96d59bab-9f1e-4992-821a-95521e829967 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:24.042991 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-96d59bab-9f1e-4992-821a-95521e829967 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: d8071344-b39f-4b47-b77c-8afaf51d22a2] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:24.051759 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-96d59bab-9f1e-4992-821a-95521e829967 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:24.052525 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-96d59bab-9f1e-4992-821a-95521e829967 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:24.053153 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-96d59bab-9f1e-4992-821a-95521e829967 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:24.054028 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-96d59bab-9f1e-4992-821a-95521e829967 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:24.054710 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-96d59bab-9f1e-4992-821a-95521e829967 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:24.055314 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-96d59bab-9f1e-4992-821a-95521e829967 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:24.696798 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5705cae6-e18d-492b-a886-ba8baff90e17 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:24.721888 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5705cae6-e18d-492b-a886-ba8baff90e17 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d" status: 200 len: 1322 microversion: 2.1 time: 1.467035 Sep 08 10:52:24.722527 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1651/3285] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:23 2022] GET /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d => generated 1322 bytes in 1470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:24.756169 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-96d59bab-9f1e-4992-821a-95521e829967 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86e8bd6f9048ce8718f432e51128a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c3752f739b47a296a5b88948fe7f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:24.773353 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-96d59bab-9f1e-4992-821a-95521e829967 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "GET /compute/v2.1/servers/d8071344-b39f-4b47-b77c-8afaf51d22a2" status: 200 len: 1324 microversion: 2.1 time: 0.739445 Sep 08 10:52:24.775002 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1635/3286] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:24 2022] GET /compute/v2.1/servers/d8071344-b39f-4b47-b77c-8afaf51d22a2 => generated 1324 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:24.795846 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fb68daaa-a522-4810-b73d-9cb2a83c35cd tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:24.799394 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fb68daaa-a522-4810-b73d-9cb2a83c35cd tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: f182d52b-9650-44f2-bd28-f2ae1daa1438] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:24.800878 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-983d9a1e-cd90-4e3d-87b3-ed4cbf60eb0c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:24.802581 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-983d9a1e-cd90-4e3d-87b3-ed4cbf60eb0c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:24.819130 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb68daaa-a522-4810-b73d-9cb2a83c35cd tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:24.819636 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb68daaa-a522-4810-b73d-9cb2a83c35cd tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:24.820072 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb68daaa-a522-4810-b73d-9cb2a83c35cd tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:24.820863 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb68daaa-a522-4810-b73d-9cb2a83c35cd tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:24.826376 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-983d9a1e-cd90-4e3d-87b3-ed4cbf60eb0c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:24.831740 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-983d9a1e-cd90-4e3d-87b3-ed4cbf60eb0c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:24.837793 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-983d9a1e-cd90-4e3d-87b3-ed4cbf60eb0c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:24.838020 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb68daaa-a522-4810-b73d-9cb2a83c35cd tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:24.838252 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb68daaa-a522-4810-b73d-9cb2a83c35cd tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:24.841217 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-983d9a1e-cd90-4e3d-87b3-ed4cbf60eb0c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:24.847547 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-983d9a1e-cd90-4e3d-87b3-ed4cbf60eb0c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:24.850502 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-983d9a1e-cd90-4e3d-87b3-ed4cbf60eb0c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:24.956005 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fb68daaa-a522-4810-b73d-9cb2a83c35cd tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/f182d52b-9650-44f2-bd28-f2ae1daa1438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.179852 Sep 08 10:52:24.961250 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1636/3287] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 10:52:24 2022] GET /compute/v2.1/servers/f182d52b-9650-44f2-bd28-f2ae1daa1438/os-volume_attachments => generated 197 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:52:24.967160 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0bc87d22-3c5b-438d-ab85-3cd59b2dc780 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:24.996460 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0bc87d22-3c5b-438d-ab85-3cd59b2dc780 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.032919 Sep 08 10:52:24.997927 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1637/3288] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Sep 8 10:52:24 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:52:25.003208 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-cca4b30e-b45b-4d74-a210-e8b9d51d7bc4 req-eb48e0ed-23bb-4a64-9954-3c4cfc29c882 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98277784-8e48-4a7b-8786-ce579e1d5ccf", "name": "network-vif-plugged", "status": "completed", "tag": "576874d5-b1a3-4dba-862f-855bbc5a1c03"}, {"server_uuid": "98277784-8e48-4a7b-8786-ce579e1d5ccf", "name": "network-vif-plugged", "status": "completed", "tag": "ce9f8d6e-a5be-4a31-a377-ae93ebd5bedc"}, {"server_uuid": "e81e0acc-0b96-4dbc-a5bb-89183f5204e7", "name": "network-vif-plugged", "status": "completed", "tag": "ff9d981d-5db2-425c-b066-f87540f6e91c"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:52:25.012825 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4,nova_api:DELETE=6 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:52:25.036592 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-cca4b30e-b45b-4d74-a210-e8b9d51d7bc4 req-eb48e0ed-23bb-4a64-9954-3c4cfc29c882 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:25.037422 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-cca4b30e-b45b-4d74-a210-e8b9d51d7bc4 req-eb48e0ed-23bb-4a64-9954-3c4cfc29c882 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:25.038049 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-cca4b30e-b45b-4d74-a210-e8b9d51d7bc4 req-eb48e0ed-23bb-4a64-9954-3c4cfc29c882 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:25.065503 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-cca4b30e-b45b-4d74-a210-e8b9d51d7bc4 req-eb48e0ed-23bb-4a64-9954-3c4cfc29c882 service nova] Creating event network-vif-plugged:576874d5-b1a3-4dba-862f-855bbc5a1c03 for instance 98277784-8e48-4a7b-8786-ce579e1d5ccf on n-h2-850501-12 Sep 08 10:52:25.068375 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-cca4b30e-b45b-4d74-a210-e8b9d51d7bc4 req-eb48e0ed-23bb-4a64-9954-3c4cfc29c882 service nova] Creating event network-vif-plugged:ce9f8d6e-a5be-4a31-a377-ae93ebd5bedc for instance 98277784-8e48-4a7b-8786-ce579e1d5ccf on n-h2-850501-12 Sep 08 10:52:25.069398 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-cca4b30e-b45b-4d74-a210-e8b9d51d7bc4 req-eb48e0ed-23bb-4a64-9954-3c4cfc29c882 service nova] Creating event network-vif-plugged:ff9d981d-5db2-425c-b066-f87540f6e91c for instance e81e0acc-0b96-4dbc-a5bb-89183f5204e7 on n-h1-850501-12 Sep 08 10:52:25.092992 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-cca4b30e-b45b-4d74-a210-e8b9d51d7bc4 req-eb48e0ed-23bb-4a64-9954-3c4cfc29c882 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.093208 Sep 08 10:52:25.094380 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1638/3289] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:52:24 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:52:25.101379 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6f48ef92-acf1-4b5d-b4f5-742688659565 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:25.112357 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6f48ef92-acf1-4b5d-b4f5-742688659565 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:25.122469 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6f48ef92-acf1-4b5d-b4f5-742688659565 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:25.130633 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6f48ef92-acf1-4b5d-b4f5-742688659565 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:25.131440 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6f48ef92-acf1-4b5d-b4f5-742688659565 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:25.132435 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6f48ef92-acf1-4b5d-b4f5-742688659565 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:25.133153 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6f48ef92-acf1-4b5d-b4f5-742688659565 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:25.133800 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6f48ef92-acf1-4b5d-b4f5-742688659565 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:25.837074 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-983d9a1e-cd90-4e3d-87b3-ed4cbf60eb0c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:25.850404 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-983d9a1e-cd90-4e3d-87b3-ed4cbf60eb0c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1364 microversion: 2.1 time: 1.102737 Sep 08 10:52:25.852000 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1652/3290] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:24 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1364 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:25.863793 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-edd5d548-bb3e-4e6a-9976-bcc9e75b42bc tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1034400933", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "147c404f-e5fc-4c26-ab03-42a1f82cce03"}]}, "os:scheduler_hints": {"group": "98578f2b-ffa3-452b-a365-f2d2ab6ae9c0"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:52:26.004232 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-edd5d548-bb3e-4e6a-9976-bcc9e75b42bc tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] validate_networks() for [('147c404f-e5fc-4c26-ab03-42a1f82cce03', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:52:26.078204 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:52:26.131157 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6f48ef92-acf1-4b5d-b4f5-742688659565 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:26.141712 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6f48ef92-acf1-4b5d-b4f5-742688659565 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:26.143521 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6f48ef92-acf1-4b5d-b4f5-742688659565 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:26.145140 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6f48ef92-acf1-4b5d-b4f5-742688659565 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 200 len: 1875 microversion: 2.32 time: 1.049167 Sep 08 10:52:26.146206 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1639/3291] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:52:25 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 1875 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:52:26.165869 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3ff2d56e-99b8-4141-b174-5f9b42a434fe tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:26.169624 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3ff2d56e-99b8-4141-b174-5f9b42a434fe tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: a882cf75-539a-45fa-ae2b-4e0f043b340d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:26.177481 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3ff2d56e-99b8-4141-b174-5f9b42a434fe tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:26.178091 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3ff2d56e-99b8-4141-b174-5f9b42a434fe tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:26.178730 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3ff2d56e-99b8-4141-b174-5f9b42a434fe tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:26.179840 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3ff2d56e-99b8-4141-b174-5f9b42a434fe tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:26.180771 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3ff2d56e-99b8-4141-b174-5f9b42a434fe tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:26.182005 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3ff2d56e-99b8-4141-b174-5f9b42a434fe tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:26.661212 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-3ff2d56e-99b8-4141-b174-5f9b42a434fe tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:26.682649 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3ff2d56e-99b8-4141-b174-5f9b42a434fe tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d" status: 200 len: 1322 microversion: 2.1 time: 0.535144 Sep 08 10:52:26.700691 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1640/3292] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:26 2022] GET /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d => generated 1322 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:26.719231 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a9409ce0-e6d3-4cf5-adc2-84f1e11e1c83 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:26.720328 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a9409ce0-e6d3-4cf5-adc2-84f1e11e1c83 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: d8071344-b39f-4b47-b77c-8afaf51d22a2] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:26.734808 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a9409ce0-e6d3-4cf5-adc2-84f1e11e1c83 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:26.736821 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a9409ce0-e6d3-4cf5-adc2-84f1e11e1c83 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:26.739362 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a9409ce0-e6d3-4cf5-adc2-84f1e11e1c83 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:26.746654 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a9409ce0-e6d3-4cf5-adc2-84f1e11e1c83 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:26.747864 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a9409ce0-e6d3-4cf5-adc2-84f1e11e1c83 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:26.748613 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a9409ce0-e6d3-4cf5-adc2-84f1e11e1c83 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:27.114781 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a9409ce0-e6d3-4cf5-adc2-84f1e11e1c83 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86e8bd6f9048ce8718f432e51128a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c3752f739b47a296a5b88948fe7f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:27.131398 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a9409ce0-e6d3-4cf5-adc2-84f1e11e1c83 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "GET /compute/v2.1/servers/d8071344-b39f-4b47-b77c-8afaf51d22a2" status: 200 len: 1324 microversion: 2.1 time: 0.429178 Sep 08 10:52:27.132136 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1641/3293] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:26 2022] GET /compute/v2.1/servers/d8071344-b39f-4b47-b77c-8afaf51d22a2 => generated 1324 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:27.152627 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c1063a7a-f8d8-4ff6-9163-3b326f62f5ea tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:27.159503 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c1063a7a-f8d8-4ff6-9163-3b326f62f5ea tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: f182d52b-9650-44f2-bd28-f2ae1daa1438] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:27.178692 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c1063a7a-f8d8-4ff6-9163-3b326f62f5ea tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:27.182446 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c1063a7a-f8d8-4ff6-9163-3b326f62f5ea tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:27.186107 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c1063a7a-f8d8-4ff6-9163-3b326f62f5ea tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:27.187358 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c1063a7a-f8d8-4ff6-9163-3b326f62f5ea tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:27.188194 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c1063a7a-f8d8-4ff6-9163-3b326f62f5ea tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:27.189838 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c1063a7a-f8d8-4ff6-9163-3b326f62f5ea tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:27.287040 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c1063a7a-f8d8-4ff6-9163-3b326f62f5ea tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/f182d52b-9650-44f2-bd28-f2ae1daa1438/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.151420 Sep 08 10:52:27.289004 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1642/3294] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 10:52:27 2022] GET /compute/v2.1/servers/f182d52b-9650-44f2-bd28-f2ae1daa1438/os-volume_attachments => generated 25 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:52:27.300689 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-31a202d7-7564-425f-a7ee-6fadab6a6198 req-2055615b-c7b2-4adb-9861-b078d93bb6be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a882cf75-539a-45fa-ae2b-4e0f043b340d", "tag": "077130a0-4e23-4573-8f49-5e525ae937fa"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:52:27.325347 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-31a202d7-7564-425f-a7ee-6fadab6a6198 req-2055615b-c7b2-4adb-9861-b078d93bb6be service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:27.328934 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-31a202d7-7564-425f-a7ee-6fadab6a6198 req-2055615b-c7b2-4adb-9861-b078d93bb6be service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:27.329522 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-31a202d7-7564-425f-a7ee-6fadab6a6198 req-2055615b-c7b2-4adb-9861-b078d93bb6be service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:27.361880 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-31a202d7-7564-425f-a7ee-6fadab6a6198 req-2055615b-c7b2-4adb-9861-b078d93bb6be service nova] Creating event network-changed:077130a0-4e23-4573-8f49-5e525ae937fa for instance a882cf75-539a-45fa-ae2b-4e0f043b340d on n-h1-850501-12 Sep 08 10:52:27.378983 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-31a202d7-7564-425f-a7ee-6fadab6a6198 req-2055615b-c7b2-4adb-9861-b078d93bb6be service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086025 Sep 08 10:52:27.381890 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1643/3295] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:52:27.414822 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-98dd74e3-9e84-45e9-8e4f-80cd40b1bbe5 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:27.415649 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-98dd74e3-9e84-45e9-8e4f-80cd40b1bbe5 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:27.428639 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-98dd74e3-9e84-45e9-8e4f-80cd40b1bbe5 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:27.429219 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-98dd74e3-9e84-45e9-8e4f-80cd40b1bbe5 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:27.429722 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-98dd74e3-9e84-45e9-8e4f-80cd40b1bbe5 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:27.430827 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-98dd74e3-9e84-45e9-8e4f-80cd40b1bbe5 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:27.431520 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-98dd74e3-9e84-45e9-8e4f-80cd40b1bbe5 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:27.432119 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-98dd74e3-9e84-45e9-8e4f-80cd40b1bbe5 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:27.684354 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-98dd74e3-9e84-45e9-8e4f-80cd40b1bbe5 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:27.716898 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-98dd74e3-9e84-45e9-8e4f-80cd40b1bbe5 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1552 microversion: 2.1 time: 0.333482 Sep 08 10:52:27.748279 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1644/3296] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:27 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1552 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:27.756116 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4b1cc839-2efe-4295-9904-03ab100ce7d9 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:27.756963 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4b1cc839-2efe-4295-9904-03ab100ce7d9 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:27.780687 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4b1cc839-2efe-4295-9904-03ab100ce7d9 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:27.781280 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4b1cc839-2efe-4295-9904-03ab100ce7d9 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:27.781751 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4b1cc839-2efe-4295-9904-03ab100ce7d9 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:27.782544 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4b1cc839-2efe-4295-9904-03ab100ce7d9 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:27.783006 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4b1cc839-2efe-4295-9904-03ab100ce7d9 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:27.783432 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4b1cc839-2efe-4295-9904-03ab100ce7d9 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:27.979199 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-edd5d548-bb3e-4e6a-9976-bcc9e75b42bc tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:52:27.979752 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-edd5d548-bb3e-4e6a-9976-bcc9e75b42bc tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:52:27.980861 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-edd5d548-bb3e-4e6a-9976-bcc9e75b42bc tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:52:27.981310 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-edd5d548-bb3e-4e6a-9976-bcc9e75b42bc tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:52:27.982399 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-edd5d548-bb3e-4e6a-9976-bcc9e75b42bc tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:52:28.011774 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=43 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:52:28.028125 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-edd5d548-bb3e-4e6a-9976-bcc9e75b42bc tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:28.029510 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-edd5d548-bb3e-4e6a-9976-bcc9e75b42bc tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:28.034736 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-edd5d548-bb3e-4e6a-9976-bcc9e75b42bc tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:28.040479 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-edd5d548-bb3e-4e6a-9976-bcc9e75b42bc tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:28.041215 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-edd5d548-bb3e-4e6a-9976-bcc9e75b42bc tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:28.041826 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-edd5d548-bb3e-4e6a-9976-bcc9e75b42bc tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:28.101130 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-edd5d548-bb3e-4e6a-9976-bcc9e75b42bc tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Getting quotas for project 1df398bd0b3f45e9b11fe4212d6b5729. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:52:28.123836 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-edd5d548-bb3e-4e6a-9976-bcc9e75b42bc tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Getting quotas for user 4b1502b3b00c449399ac35378281d992 and project 1df398bd0b3f45e9b11fe4212d6b5729. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:52:28.147898 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4b1cc839-2efe-4295-9904-03ab100ce7d9 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:28.153088 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-edd5d548-bb3e-4e6a-9976-bcc9e75b42bc tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:52:28.157623 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-edd5d548-bb3e-4e6a-9976-bcc9e75b42bc tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] [instance: 0a2deb39-1e14-4009-a813-70141de75879] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:52:28.164056 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4b1cc839-2efe-4295-9904-03ab100ce7d9 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:28.169536 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4b1cc839-2efe-4295-9904-03ab100ce7d9 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:28.172809 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4b1cc839-2efe-4295-9904-03ab100ce7d9 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 200 len: 1875 microversion: 2.32 time: 0.421098 Sep 08 10:52:28.186298 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1645/3297] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:52:27 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 1875 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:52:28.201288 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4b04d932-b3d3-40fb-8d43-309679faee8b tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:28.203341 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4b04d932-b3d3-40fb-8d43-309679faee8b tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: f182d52b-9650-44f2-bd28-f2ae1daa1438] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:28.218569 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4b04d932-b3d3-40fb-8d43-309679faee8b tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:28.224321 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4b04d932-b3d3-40fb-8d43-309679faee8b tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:28.224862 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4b04d932-b3d3-40fb-8d43-309679faee8b tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:28.225893 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4b04d932-b3d3-40fb-8d43-309679faee8b tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:28.227344 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4b04d932-b3d3-40fb-8d43-309679faee8b tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:28.227808 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4b04d932-b3d3-40fb-8d43-309679faee8b tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:28.232505 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-edd5d548-bb3e-4e6a-9976-bcc9e75b42bc tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Getting quotas for project 1df398bd0b3f45e9b11fe4212d6b5729. Resources: {'server_group_members'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:52:28.244812 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-edd5d548-bb3e-4e6a-9976-bcc9e75b42bc tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Getting quotas for user 4b1502b3b00c449399ac35378281d992 and project 1df398bd0b3f45e9b11fe4212d6b5729. Resources: {'server_group_members'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:52:28.280753 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4b04d932-b3d3-40fb-8d43-309679faee8b tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: f182d52b-9650-44f2-bd28-f2ae1daa1438] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:52:28.297536 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-edd5d548-bb3e-4e6a-9976-bcc9e75b42bc tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Getting quotas for project 1df398bd0b3f45e9b11fe4212d6b5729. Resources: {'server_group_members'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:52:28.305498 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-edd5d548-bb3e-4e6a-9976-bcc9e75b42bc tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Getting quotas for user 4b1502b3b00c449399ac35378281d992 and project 1df398bd0b3f45e9b11fe4212d6b5729. Resources: {'server_group_members'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:52:28.341267 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-edd5d548-bb3e-4e6a-9976-bcc9e75b42bc tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.487254 Sep 08 10:52:28.342218 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1653/3298] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:52:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 2489 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:52:28.348468 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-df446132-ff45-4269-bccd-0c96c0291f5d tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:28.349328 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-df446132-ff45-4269-bccd-0c96c0291f5d tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: a882cf75-539a-45fa-ae2b-4e0f043b340d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:28.359213 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df446132-ff45-4269-bccd-0c96c0291f5d tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:28.359939 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df446132-ff45-4269-bccd-0c96c0291f5d tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:28.360596 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df446132-ff45-4269-bccd-0c96c0291f5d tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:28.361527 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df446132-ff45-4269-bccd-0c96c0291f5d tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:28.362158 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df446132-ff45-4269-bccd-0c96c0291f5d tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:28.362758 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df446132-ff45-4269-bccd-0c96c0291f5d tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:28.437541 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4b04d932-b3d3-40fb-8d43-309679faee8b tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f182d52b-9650-44f2-bd28-f2ae1daa1438" status: 204 len: 0 microversion: 2.1 time: 0.248698 Sep 08 10:52:28.441368 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1646/3299] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:52:28 2022] DELETE /compute/v2.1/servers/f182d52b-9650-44f2-bd28-f2ae1daa1438 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:52:28.457763 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-16260779-d6a4-4790-88bc-8ff891d495f9 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:28.458429 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-16260779-d6a4-4790-88bc-8ff891d495f9 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:28.468021 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-16260779-d6a4-4790-88bc-8ff891d495f9 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:28.468529 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-16260779-d6a4-4790-88bc-8ff891d495f9 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:28.469040 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-16260779-d6a4-4790-88bc-8ff891d495f9 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:28.469764 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-16260779-d6a4-4790-88bc-8ff891d495f9 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:28.470421 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-16260779-d6a4-4790-88bc-8ff891d495f9 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:28.470855 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-16260779-d6a4-4790-88bc-8ff891d495f9 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:28.616737 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-16260779-d6a4-4790-88bc-8ff891d495f9 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.173067 Sep 08 10:52:28.617822 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1647/3300] 10.222.0.27 () {58 vars in 1275 bytes} [Thu Sep 8 10:52:28 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7/os-interface => generated 285 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:52:28.634550 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-12e812dc-656b-40f9-897a-4cb9cdbf9ad3 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:28.634961 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-12e812dc-656b-40f9-897a-4cb9cdbf9ad3 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: d8071344-b39f-4b47-b77c-8afaf51d22a2] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:28.659668 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-12e812dc-656b-40f9-897a-4cb9cdbf9ad3 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:28.660261 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-12e812dc-656b-40f9-897a-4cb9cdbf9ad3 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:28.660723 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-12e812dc-656b-40f9-897a-4cb9cdbf9ad3 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:28.661509 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-12e812dc-656b-40f9-897a-4cb9cdbf9ad3 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:28.662352 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-12e812dc-656b-40f9-897a-4cb9cdbf9ad3 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:28.662664 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-12e812dc-656b-40f9-897a-4cb9cdbf9ad3 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:28.671075 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:52:28.853520 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-df446132-ff45-4269-bccd-0c96c0291f5d tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:28.877640 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-df446132-ff45-4269-bccd-0c96c0291f5d tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d" status: 200 len: 1322 microversion: 2.1 time: 0.533852 Sep 08 10:52:28.881356 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1654/3301] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:28 2022] GET /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d => generated 1322 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:28.891695 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2ded6347-3d02-4df7-aa1e-5cf6b0ea6ae9 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:28.892946 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2ded6347-3d02-4df7-aa1e-5cf6b0ea6ae9 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] [instance: 0a2deb39-1e14-4009-a813-70141de75879] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:28.985631 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-12e812dc-656b-40f9-897a-4cb9cdbf9ad3 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86e8bd6f9048ce8718f432e51128a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c3752f739b47a296a5b88948fe7f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:29.002122 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-12e812dc-656b-40f9-897a-4cb9cdbf9ad3 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "GET /compute/v2.1/servers/d8071344-b39f-4b47-b77c-8afaf51d22a2" status: 200 len: 1324 microversion: 2.1 time: 0.382862 Sep 08 10:52:29.002730 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1648/3302] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:28 2022] GET /compute/v2.1/servers/d8071344-b39f-4b47-b77c-8afaf51d22a2 => generated 1324 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:29.013394 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-06d4e294-093f-445e-9a09-4ee0805fb8d9 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:29.013394 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-06d4e294-093f-445e-9a09-4ee0805fb8d9 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: f182d52b-9650-44f2-bd28-f2ae1daa1438] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:29.026864 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06d4e294-093f-445e-9a09-4ee0805fb8d9 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:29.027745 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06d4e294-093f-445e-9a09-4ee0805fb8d9 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:29.027876 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06d4e294-093f-445e-9a09-4ee0805fb8d9 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:29.028545 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06d4e294-093f-445e-9a09-4ee0805fb8d9 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:29.029111 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06d4e294-093f-445e-9a09-4ee0805fb8d9 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:29.035420 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06d4e294-093f-445e-9a09-4ee0805fb8d9 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:29.075835 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2ded6347-3d02-4df7-aa1e-5cf6b0ea6ae9 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1502b3b00c449399ac35378281d992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df398bd0b3f45e9b11fe4212d6b5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:29.089052 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2ded6347-3d02-4df7-aa1e-5cf6b0ea6ae9 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] 10.222.0.27 "GET /compute/v2.1/servers/0a2deb39-1e14-4009-a813-70141de75879" status: 200 len: 1213 microversion: 2.1 time: 0.204884 Sep 08 10:52:29.110180 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1655/3303] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:28 2022] GET /compute/v2.1/servers/0a2deb39-1e14-4009-a813-70141de75879 => generated 1213 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:29.200716 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1c7d56d0-e478-405e-91d8-67411902efb9 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:29.201458 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1c7d56d0-e478-405e-91d8-67411902efb9 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:29.215146 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c7d56d0-e478-405e-91d8-67411902efb9 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:29.215949 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c7d56d0-e478-405e-91d8-67411902efb9 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:29.216432 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c7d56d0-e478-405e-91d8-67411902efb9 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:29.217271 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c7d56d0-e478-405e-91d8-67411902efb9 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:29.217746 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c7d56d0-e478-405e-91d8-67411902efb9 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:29.227193 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c7d56d0-e478-405e-91d8-67411902efb9 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:29.327567 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-06d4e294-093f-445e-9a09-4ee0805fb8d9 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c291cbe955b4ee5abc98132dda0255e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f9a24cad014d7f827e8f3236dd5bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:29.342305 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-06d4e294-093f-445e-9a09-4ee0805fb8d9 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/f182d52b-9650-44f2-bd28-f2ae1daa1438" status: 200 len: 1682 microversion: 2.1 time: 0.338378 Sep 08 10:52:29.342914 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1649/3304] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:29 2022] GET /compute/v2.1/servers/f182d52b-9650-44f2-bd28-f2ae1daa1438 => generated 1682 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:29.907357 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-24337785-5cff-4a95-b202-3a47e9021b81 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:29.908313 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-24337785-5cff-4a95-b202-3a47e9021b81 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: a882cf75-539a-45fa-ae2b-4e0f043b340d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:29.928230 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24337785-5cff-4a95-b202-3a47e9021b81 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:29.929734 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24337785-5cff-4a95-b202-3a47e9021b81 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:29.930433 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24337785-5cff-4a95-b202-3a47e9021b81 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:29.931536 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24337785-5cff-4a95-b202-3a47e9021b81 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:29.932196 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24337785-5cff-4a95-b202-3a47e9021b81 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:29.932829 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24337785-5cff-4a95-b202-3a47e9021b81 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:30.179226 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1c7d56d0-e478-405e-91d8-67411902efb9 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:30.195209 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1c7d56d0-e478-405e-91d8-67411902efb9 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:30.196669 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1c7d56d0-e478-405e-91d8-67411902efb9 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:30.198018 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1c7d56d0-e478-405e-91d8-67411902efb9 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 200 len: 2829 microversion: 2.32 time: 1.002116 Sep 08 10:52:30.199036 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1656/3305] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:52:29 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 2829 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:52:30.209829 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b339f166-c2c6-48ed-ba9d-b2c9e1e802bc tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:30.221733 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b339f166-c2c6-48ed-ba9d-b2c9e1e802bc tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: d8071344-b39f-4b47-b77c-8afaf51d22a2] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:30.241642 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b339f166-c2c6-48ed-ba9d-b2c9e1e802bc tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:30.242436 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b339f166-c2c6-48ed-ba9d-b2c9e1e802bc tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:30.243068 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b339f166-c2c6-48ed-ba9d-b2c9e1e802bc tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:30.244004 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b339f166-c2c6-48ed-ba9d-b2c9e1e802bc tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:30.244730 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b339f166-c2c6-48ed-ba9d-b2c9e1e802bc tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:30.245522 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b339f166-c2c6-48ed-ba9d-b2c9e1e802bc tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:30.338821 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-24337785-5cff-4a95-b202-3a47e9021b81 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:30.351450 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-24337785-5cff-4a95-b202-3a47e9021b81 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d" status: 200 len: 1322 microversion: 2.1 time: 0.449858 Sep 08 10:52:30.352240 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1650/3306] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:29 2022] GET /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d => generated 1322 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:30.366681 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a5d4d2bd-53ee-4092-898b-7f0dfa97a4dc tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:30.373277 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a5d4d2bd-53ee-4092-898b-7f0dfa97a4dc tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] [instance: 0a2deb39-1e14-4009-a813-70141de75879] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:30.386867 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a5d4d2bd-53ee-4092-898b-7f0dfa97a4dc tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:30.387400 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a5d4d2bd-53ee-4092-898b-7f0dfa97a4dc tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:30.387849 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a5d4d2bd-53ee-4092-898b-7f0dfa97a4dc tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:30.388772 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a5d4d2bd-53ee-4092-898b-7f0dfa97a4dc tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:30.389295 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a5d4d2bd-53ee-4092-898b-7f0dfa97a4dc tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:30.389779 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a5d4d2bd-53ee-4092-898b-7f0dfa97a4dc tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:30.535950 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a5d4d2bd-53ee-4092-898b-7f0dfa97a4dc tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1502b3b00c449399ac35378281d992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df398bd0b3f45e9b11fe4212d6b5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:30.552209 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a5d4d2bd-53ee-4092-898b-7f0dfa97a4dc tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] 10.222.0.27 "GET /compute/v2.1/servers/0a2deb39-1e14-4009-a813-70141de75879" status: 200 len: 1217 microversion: 2.1 time: 0.192892 Sep 08 10:52:30.569111 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1651/3307] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:30 2022] GET /compute/v2.1/servers/0a2deb39-1e14-4009-a813-70141de75879 => generated 1217 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:30.575253 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-0f60bfd3-b2b6-4dec-ac5e-b484453a2284 req-1ea6ffaf-d100-4269-861d-bf93125ba23f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8071344-b39f-4b47-b77c-8afaf51d22a2", "name": "network-vif-plugged", "status": "completed", "tag": "dc6c944a-8056-468c-87ed-aaf5e01c9095"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:52:30.585926 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-0f60bfd3-b2b6-4dec-ac5e-b484453a2284 req-1ea6ffaf-d100-4269-861d-bf93125ba23f service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:30.586296 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-0f60bfd3-b2b6-4dec-ac5e-b484453a2284 req-1ea6ffaf-d100-4269-861d-bf93125ba23f service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:30.586954 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-0f60bfd3-b2b6-4dec-ac5e-b484453a2284 req-1ea6ffaf-d100-4269-861d-bf93125ba23f service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:30.604861 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-0f60bfd3-b2b6-4dec-ac5e-b484453a2284 req-1ea6ffaf-d100-4269-861d-bf93125ba23f service nova] Creating event network-vif-plugged:dc6c944a-8056-468c-87ed-aaf5e01c9095 for instance d8071344-b39f-4b47-b77c-8afaf51d22a2 on n-h2-850501-12 Sep 08 10:52:30.614623 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-0f60bfd3-b2b6-4dec-ac5e-b484453a2284 req-1ea6ffaf-d100-4269-861d-bf93125ba23f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041632 Sep 08 10:52:30.615759 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1652/3308] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:52:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:52:30.629007 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-19bb1a21-4754-497e-a014-fae24253b447 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:30.630102 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-19bb1a21-4754-497e-a014-fae24253b447 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:30.638399 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-19bb1a21-4754-497e-a014-fae24253b447 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:30.639379 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-19bb1a21-4754-497e-a014-fae24253b447 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:30.641395 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-19bb1a21-4754-497e-a014-fae24253b447 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:30.642527 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-19bb1a21-4754-497e-a014-fae24253b447 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:30.643180 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-19bb1a21-4754-497e-a014-fae24253b447 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:30.643813 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-19bb1a21-4754-497e-a014-fae24253b447 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:30.770526 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b339f166-c2c6-48ed-ba9d-b2c9e1e802bc tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86e8bd6f9048ce8718f432e51128a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c3752f739b47a296a5b88948fe7f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:30.775316 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:52:30.789572 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b339f166-c2c6-48ed-ba9d-b2c9e1e802bc tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "GET /compute/v2.1/servers/d8071344-b39f-4b47-b77c-8afaf51d22a2" status: 200 len: 1324 microversion: 2.1 time: 0.584098 Sep 08 10:52:30.795407 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1657/3309] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:30 2022] GET /compute/v2.1/servers/d8071344-b39f-4b47-b77c-8afaf51d22a2 => generated 1324 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:30.808641 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0ef0c449-a1cf-44d1-b717-49deeeda8ef2 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:30.815265 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0ef0c449-a1cf-44d1-b717-49deeeda8ef2 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: f182d52b-9650-44f2-bd28-f2ae1daa1438] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:30.830006 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ef0c449-a1cf-44d1-b717-49deeeda8ef2 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:30.832192 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ef0c449-a1cf-44d1-b717-49deeeda8ef2 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:30.832724 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ef0c449-a1cf-44d1-b717-49deeeda8ef2 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:30.833917 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ef0c449-a1cf-44d1-b717-49deeeda8ef2 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:30.834461 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ef0c449-a1cf-44d1-b717-49deeeda8ef2 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:30.836629 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ef0c449-a1cf-44d1-b717-49deeeda8ef2 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:30.994608 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-19bb1a21-4754-497e-a014-fae24253b447 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.377544 Sep 08 10:52:31.007755 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1653/3310] 10.222.0.27 () {60 vars in 1316 bytes} [Thu Sep 8 10:52:30 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf/os-interface => generated 1831 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:52:31.381258 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1e9def5d-e667-46c2-81d6-b14f0435e067 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:31.388409 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1e9def5d-e667-46c2-81d6-b14f0435e067 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: a882cf75-539a-45fa-ae2b-4e0f043b340d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:31.407141 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e9def5d-e667-46c2-81d6-b14f0435e067 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:31.413489 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e9def5d-e667-46c2-81d6-b14f0435e067 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:31.414372 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e9def5d-e667-46c2-81d6-b14f0435e067 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:31.415397 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e9def5d-e667-46c2-81d6-b14f0435e067 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:31.419082 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e9def5d-e667-46c2-81d6-b14f0435e067 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:31.422133 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e9def5d-e667-46c2-81d6-b14f0435e067 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:31.700533 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1e9def5d-e667-46c2-81d6-b14f0435e067 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:31.725121 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1e9def5d-e667-46c2-81d6-b14f0435e067 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d" status: 200 len: 1322 microversion: 2.1 time: 0.350636 Sep 08 10:52:31.730738 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1654/3311] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:31 2022] GET /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d => generated 1322 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:52:31.736928 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e061cb81-79bb-4fee-9aa5-152d3b81f8f9 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:31.738012 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e061cb81-79bb-4fee-9aa5-152d3b81f8f9 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] [instance: 0a2deb39-1e14-4009-a813-70141de75879] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:31.753656 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e061cb81-79bb-4fee-9aa5-152d3b81f8f9 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:31.754424 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e061cb81-79bb-4fee-9aa5-152d3b81f8f9 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:31.756425 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e061cb81-79bb-4fee-9aa5-152d3b81f8f9 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:31.757504 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e061cb81-79bb-4fee-9aa5-152d3b81f8f9 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:31.763477 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e061cb81-79bb-4fee-9aa5-152d3b81f8f9 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:31.764226 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e061cb81-79bb-4fee-9aa5-152d3b81f8f9 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:31.899168 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e061cb81-79bb-4fee-9aa5-152d3b81f8f9 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1502b3b00c449399ac35378281d992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df398bd0b3f45e9b11fe4212d6b5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:31.910068 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e061cb81-79bb-4fee-9aa5-152d3b81f8f9 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] 10.222.0.27 "GET /compute/v2.1/servers/0a2deb39-1e14-4009-a813-70141de75879" status: 200 len: 1265 microversion: 2.1 time: 0.177632 Sep 08 10:52:31.924849 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1655/3312] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:31 2022] GET /compute/v2.1/servers/0a2deb39-1e14-4009-a813-70141de75879 => generated 1265 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:31.937419 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-35e74000-9e58-4e47-bc60-b0fcaff1ae1a tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:31.939089 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-35e74000-9e58-4e47-bc60-b0fcaff1ae1a tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: d8071344-b39f-4b47-b77c-8afaf51d22a2] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:31.958978 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-35e74000-9e58-4e47-bc60-b0fcaff1ae1a tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:31.959800 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-35e74000-9e58-4e47-bc60-b0fcaff1ae1a tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:31.960432 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-35e74000-9e58-4e47-bc60-b0fcaff1ae1a tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:31.961846 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-35e74000-9e58-4e47-bc60-b0fcaff1ae1a tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:31.963784 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-35e74000-9e58-4e47-bc60-b0fcaff1ae1a tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:31.965246 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-35e74000-9e58-4e47-bc60-b0fcaff1ae1a tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:32.068793 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0ef0c449-a1cf-44d1-b717-49deeeda8ef2 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c291cbe955b4ee5abc98132dda0255e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f9a24cad014d7f827e8f3236dd5bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:32.079538 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0ef0c449-a1cf-44d1-b717-49deeeda8ef2 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/f182d52b-9650-44f2-bd28-f2ae1daa1438" status: 200 len: 1682 microversion: 2.1 time: 1.282559 Sep 08 10:52:32.083445 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1658/3313] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:30 2022] GET /compute/v2.1/servers/f182d52b-9650-44f2-bd28-f2ae1daa1438 => generated 1682 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:32.458693 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-35e74000-9e58-4e47-bc60-b0fcaff1ae1a tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86e8bd6f9048ce8718f432e51128a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c3752f739b47a296a5b88948fe7f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:32.471304 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-35e74000-9e58-4e47-bc60-b0fcaff1ae1a tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "GET /compute/v2.1/servers/d8071344-b39f-4b47-b77c-8afaf51d22a2" status: 200 len: 1324 microversion: 2.1 time: 0.542124 Sep 08 10:52:32.472291 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1656/3314] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:31 2022] GET /compute/v2.1/servers/d8071344-b39f-4b47-b77c-8afaf51d22a2 => generated 1324 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:32.632721 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-bca22126-0857-4287-8598-11c75f719f65 req-03c3522a-6a2b-4b44-9dba-e7bade01e77f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fafff8cb-0e6f-4243-a91c-ec559f656880", "name": "network-vif-plugged", "status": "completed", "tag": "e1da214d-9efc-406e-bdeb-34180a49fc95"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:52:32.644239 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-bca22126-0857-4287-8598-11c75f719f65 req-03c3522a-6a2b-4b44-9dba-e7bade01e77f service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:32.645412 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-bca22126-0857-4287-8598-11c75f719f65 req-03c3522a-6a2b-4b44-9dba-e7bade01e77f service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:32.646028 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-bca22126-0857-4287-8598-11c75f719f65 req-03c3522a-6a2b-4b44-9dba-e7bade01e77f service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:32.664032 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-bca22126-0857-4287-8598-11c75f719f65 req-03c3522a-6a2b-4b44-9dba-e7bade01e77f service nova] Creating event network-vif-plugged:e1da214d-9efc-406e-bdeb-34180a49fc95 for instance fafff8cb-0e6f-4243-a91c-ec559f656880 on n-h2-850501-12 Sep 08 10:52:32.677162 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-bca22126-0857-4287-8598-11c75f719f65 req-03c3522a-6a2b-4b44-9dba-e7bade01e77f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046007 Sep 08 10:52:32.682061 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1659/3315] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:52:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:52:32.756116 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-dbae9ba5-3ecd-4465-983f-8cc008da126a tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:32.757167 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-dbae9ba5-3ecd-4465-983f-8cc008da126a tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: a882cf75-539a-45fa-ae2b-4e0f043b340d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:32.759436 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=30 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:52:32.771165 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dbae9ba5-3ecd-4465-983f-8cc008da126a tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:32.773257 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dbae9ba5-3ecd-4465-983f-8cc008da126a tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:32.774284 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dbae9ba5-3ecd-4465-983f-8cc008da126a tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:32.775683 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dbae9ba5-3ecd-4465-983f-8cc008da126a tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:32.776936 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dbae9ba5-3ecd-4465-983f-8cc008da126a tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:32.778297 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dbae9ba5-3ecd-4465-983f-8cc008da126a tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:33.064872 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-dbae9ba5-3ecd-4465-983f-8cc008da126a tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:33.075089 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-dbae9ba5-3ecd-4465-983f-8cc008da126a tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d" status: 200 len: 1322 microversion: 2.1 time: 0.322594 Sep 08 10:52:33.076589 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1657/3316] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:32 2022] GET /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d => generated 1322 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:33.081943 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2aa9d848-63b4-4c89-9c1f-b9595baec80b tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:33.082766 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2aa9d848-63b4-4c89-9c1f-b9595baec80b tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] [instance: 0a2deb39-1e14-4009-a813-70141de75879] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:33.089419 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2aa9d848-63b4-4c89-9c1f-b9595baec80b tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:33.090197 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2aa9d848-63b4-4c89-9c1f-b9595baec80b tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:33.090870 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2aa9d848-63b4-4c89-9c1f-b9595baec80b tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:33.091986 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2aa9d848-63b4-4c89-9c1f-b9595baec80b tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:33.092652 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2aa9d848-63b4-4c89-9c1f-b9595baec80b tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:33.093344 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2aa9d848-63b4-4c89-9c1f-b9595baec80b tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:33.135346 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-e7c4a8bb-7cfc-4c63-9144-31091961d917 req-848519a4-9d2d-427f-b1fc-fec2bb32d0e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98277784-8e48-4a7b-8786-ce579e1d5ccf", "tag": "742e7fd9-9529-4661-8ad0-c2f50b7bb9d8"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:52:33.148173 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e7c4a8bb-7cfc-4c63-9144-31091961d917 req-848519a4-9d2d-427f-b1fc-fec2bb32d0e7 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:33.149421 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e7c4a8bb-7cfc-4c63-9144-31091961d917 req-848519a4-9d2d-427f-b1fc-fec2bb32d0e7 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:33.149977 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e7c4a8bb-7cfc-4c63-9144-31091961d917 req-848519a4-9d2d-427f-b1fc-fec2bb32d0e7 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:33.164869 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-e7c4a8bb-7cfc-4c63-9144-31091961d917 req-848519a4-9d2d-427f-b1fc-fec2bb32d0e7 service nova] Creating event network-changed:742e7fd9-9529-4661-8ad0-c2f50b7bb9d8 for instance 98277784-8e48-4a7b-8786-ce579e1d5ccf on n-h2-850501-12 Sep 08 10:52:33.172151 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-e7c4a8bb-7cfc-4c63-9144-31091961d917 req-848519a4-9d2d-427f-b1fc-fec2bb32d0e7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.296446 Sep 08 10:52:33.173194 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1660/3317] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:52:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:52:33.179446 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9a416d7b-a933-4ccf-ae56-e669d262c73f tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:33.181359 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9a416d7b-a933-4ccf-ae56-e669d262c73f tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: f182d52b-9650-44f2-bd28-f2ae1daa1438] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:33.190257 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9a416d7b-a933-4ccf-ae56-e669d262c73f tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:33.191212 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9a416d7b-a933-4ccf-ae56-e669d262c73f tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:33.191334 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2aa9d848-63b4-4c89-9c1f-b9595baec80b tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1502b3b00c449399ac35378281d992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df398bd0b3f45e9b11fe4212d6b5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:33.191976 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9a416d7b-a933-4ccf-ae56-e669d262c73f tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:33.192902 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9a416d7b-a933-4ccf-ae56-e669d262c73f tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:33.193605 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9a416d7b-a933-4ccf-ae56-e669d262c73f tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:33.194234 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9a416d7b-a933-4ccf-ae56-e669d262c73f tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:33.202262 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2aa9d848-63b4-4c89-9c1f-b9595baec80b tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] 10.222.0.27 "GET /compute/v2.1/servers/0a2deb39-1e14-4009-a813-70141de75879" status: 200 len: 1271 microversion: 2.1 time: 0.124141 Sep 08 10:52:33.202866 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1658/3318] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:33 2022] GET /compute/v2.1/servers/0a2deb39-1e14-4009-a813-70141de75879 => generated 1271 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:33.495140 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-985e2d03-eb8d-4f3a-8468-b4c1ba1d0397 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:33.497428 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-985e2d03-eb8d-4f3a-8468-b4c1ba1d0397 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: d8071344-b39f-4b47-b77c-8afaf51d22a2] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:33.512198 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-985e2d03-eb8d-4f3a-8468-b4c1ba1d0397 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:33.512979 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-985e2d03-eb8d-4f3a-8468-b4c1ba1d0397 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:33.513764 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-985e2d03-eb8d-4f3a-8468-b4c1ba1d0397 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:33.514812 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-985e2d03-eb8d-4f3a-8468-b4c1ba1d0397 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:33.516862 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-985e2d03-eb8d-4f3a-8468-b4c1ba1d0397 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:33.518113 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-985e2d03-eb8d-4f3a-8468-b4c1ba1d0397 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:33.847733 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9a416d7b-a933-4ccf-ae56-e669d262c73f tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c291cbe955b4ee5abc98132dda0255e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f9a24cad014d7f827e8f3236dd5bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:33.871317 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9a416d7b-a933-4ccf-ae56-e669d262c73f tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/f182d52b-9650-44f2-bd28-f2ae1daa1438" status: 200 len: 1682 microversion: 2.1 time: 0.694855 Sep 08 10:52:33.885262 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1661/3319] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:33 2022] GET /compute/v2.1/servers/f182d52b-9650-44f2-bd28-f2ae1daa1438 => generated 1682 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:33.885456 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-985e2d03-eb8d-4f3a-8468-b4c1ba1d0397 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86e8bd6f9048ce8718f432e51128a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c3752f739b47a296a5b88948fe7f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:33.902142 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-985e2d03-eb8d-4f3a-8468-b4c1ba1d0397 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "GET /compute/v2.1/servers/d8071344-b39f-4b47-b77c-8afaf51d22a2" status: 200 len: 1520 microversion: 2.1 time: 0.409762 Sep 08 10:52:33.903531 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1659/3320] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:33 2022] GET /compute/v2.1/servers/d8071344-b39f-4b47-b77c-8afaf51d22a2 => generated 1520 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:33.929786 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1736de20-a31f-4727-800e-b3e465cf998d tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:33.930598 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1736de20-a31f-4727-800e-b3e465cf998d tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: d8071344-b39f-4b47-b77c-8afaf51d22a2] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:33.944622 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1736de20-a31f-4727-800e-b3e465cf998d tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:33.945165 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1736de20-a31f-4727-800e-b3e465cf998d tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:33.945765 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1736de20-a31f-4727-800e-b3e465cf998d tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:33.947151 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1736de20-a31f-4727-800e-b3e465cf998d tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:33.947729 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1736de20-a31f-4727-800e-b3e465cf998d tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:33.948184 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1736de20-a31f-4727-800e-b3e465cf998d tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:33.984561 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1736de20-a31f-4727-800e-b3e465cf998d tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: d8071344-b39f-4b47-b77c-8afaf51d22a2] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:52:34.098896 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0400c2da-b1d2-40b3-a881-3f7c6b75f671 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:34.100061 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0400c2da-b1d2-40b3-a881-3f7c6b75f671 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: a882cf75-539a-45fa-ae2b-4e0f043b340d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:34.116467 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0400c2da-b1d2-40b3-a881-3f7c6b75f671 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:34.123237 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0400c2da-b1d2-40b3-a881-3f7c6b75f671 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:34.130124 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0400c2da-b1d2-40b3-a881-3f7c6b75f671 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:34.132941 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0400c2da-b1d2-40b3-a881-3f7c6b75f671 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:34.133961 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0400c2da-b1d2-40b3-a881-3f7c6b75f671 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:34.135820 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0400c2da-b1d2-40b3-a881-3f7c6b75f671 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:34.138528 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1736de20-a31f-4727-800e-b3e465cf998d tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d8071344-b39f-4b47-b77c-8afaf51d22a2" status: 204 len: 0 microversion: 2.1 time: 0.212891 Sep 08 10:52:34.143897 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1662/3321] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:52:33 2022] DELETE /compute/v2.1/servers/d8071344-b39f-4b47-b77c-8afaf51d22a2 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:52:34.159552 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-49d253f4-2dd8-4265-bfd2-41803104d233 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:34.160559 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-49d253f4-2dd8-4265-bfd2-41803104d233 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: d8071344-b39f-4b47-b77c-8afaf51d22a2] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:34.177829 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49d253f4-2dd8-4265-bfd2-41803104d233 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:34.178664 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49d253f4-2dd8-4265-bfd2-41803104d233 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:34.179323 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49d253f4-2dd8-4265-bfd2-41803104d233 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:34.180315 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49d253f4-2dd8-4265-bfd2-41803104d233 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:34.180956 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49d253f4-2dd8-4265-bfd2-41803104d233 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:34.181659 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49d253f4-2dd8-4265-bfd2-41803104d233 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:34.580630 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0400c2da-b1d2-40b3-a881-3f7c6b75f671 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:34.591314 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0400c2da-b1d2-40b3-a881-3f7c6b75f671 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d" status: 200 len: 1322 microversion: 2.1 time: 0.496468 Sep 08 10:52:34.596995 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1660/3322] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:34 2022] GET /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d => generated 1322 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:52:34.611636 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e1cf3935-a311-4ca2-ac1e-9d8c9d8d1efb tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:34.612587 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e1cf3935-a311-4ca2-ac1e-9d8c9d8d1efb tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] [instance: 0a2deb39-1e14-4009-a813-70141de75879] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:34.637115 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e1cf3935-a311-4ca2-ac1e-9d8c9d8d1efb tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:34.637857 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e1cf3935-a311-4ca2-ac1e-9d8c9d8d1efb tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:34.638924 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e1cf3935-a311-4ca2-ac1e-9d8c9d8d1efb tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:34.639939 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e1cf3935-a311-4ca2-ac1e-9d8c9d8d1efb tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:34.641534 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e1cf3935-a311-4ca2-ac1e-9d8c9d8d1efb tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:34.642178 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e1cf3935-a311-4ca2-ac1e-9d8c9d8d1efb tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:34.796793 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e1cf3935-a311-4ca2-ac1e-9d8c9d8d1efb tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1502b3b00c449399ac35378281d992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df398bd0b3f45e9b11fe4212d6b5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:34.821723 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e1cf3935-a311-4ca2-ac1e-9d8c9d8d1efb tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] 10.222.0.27 "GET /compute/v2.1/servers/0a2deb39-1e14-4009-a813-70141de75879" status: 200 len: 1271 microversion: 2.1 time: 0.223088 Sep 08 10:52:34.824787 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1661/3323] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:34 2022] GET /compute/v2.1/servers/0a2deb39-1e14-4009-a813-70141de75879 => generated 1271 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:34.911028 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-49d253f4-2dd8-4265-bfd2-41803104d233 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86e8bd6f9048ce8718f432e51128a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c3752f739b47a296a5b88948fe7f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:34.933278 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-49d253f4-2dd8-4265-bfd2-41803104d233 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "GET /compute/v2.1/servers/d8071344-b39f-4b47-b77c-8afaf51d22a2" status: 200 len: 1526 microversion: 2.1 time: 0.778598 Sep 08 10:52:34.952769 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1663/3324] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:34 2022] GET /compute/v2.1/servers/d8071344-b39f-4b47-b77c-8afaf51d22a2 => generated 1526 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:52:34.974942 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-2df40e02-21db-4cdc-bc74-9190fa68cbdb req-921a2937-183e-4a53-a42a-d0351fc2e34d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a882cf75-539a-45fa-ae2b-4e0f043b340d", "name": "network-vif-plugged", "status": "completed", "tag": "077130a0-4e23-4573-8f49-5e525ae937fa"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:52:34.997540 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-6ebe6a43-b757-4812-ba50-1e733b72910d req-61afefd7-c782-41ab-82bf-5645c1bad104 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e81e0acc-0b96-4dbc-a5bb-89183f5204e7", "tag": "ff9d981d-5db2-425c-b066-f87540f6e91c"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:52:35.007095 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-2df40e02-21db-4cdc-bc74-9190fa68cbdb req-921a2937-183e-4a53-a42a-d0351fc2e34d service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:35.008761 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-2df40e02-21db-4cdc-bc74-9190fa68cbdb req-921a2937-183e-4a53-a42a-d0351fc2e34d service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:35.010328 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-2df40e02-21db-4cdc-bc74-9190fa68cbdb req-921a2937-183e-4a53-a42a-d0351fc2e34d service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:35.018274 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-6ebe6a43-b757-4812-ba50-1e733b72910d req-61afefd7-c782-41ab-82bf-5645c1bad104 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:35.023101 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-6ebe6a43-b757-4812-ba50-1e733b72910d req-61afefd7-c782-41ab-82bf-5645c1bad104 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:35.023784 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-6ebe6a43-b757-4812-ba50-1e733b72910d req-61afefd7-c782-41ab-82bf-5645c1bad104 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:35.041707 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-2df40e02-21db-4cdc-bc74-9190fa68cbdb req-921a2937-183e-4a53-a42a-d0351fc2e34d service nova] Creating event network-vif-plugged:077130a0-4e23-4573-8f49-5e525ae937fa for instance a882cf75-539a-45fa-ae2b-4e0f043b340d on n-h1-850501-12 Sep 08 10:52:35.048199 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-6ebe6a43-b757-4812-ba50-1e733b72910d req-61afefd7-c782-41ab-82bf-5645c1bad104 service nova] Creating event network-changed:ff9d981d-5db2-425c-b066-f87540f6e91c for instance e81e0acc-0b96-4dbc-a5bb-89183f5204e7 on n-h1-850501-12 Sep 08 10:52:35.056178 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-2df40e02-21db-4cdc-bc74-9190fa68cbdb req-921a2937-183e-4a53-a42a-d0351fc2e34d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099046 Sep 08 10:52:35.060106 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1664/3325] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:52:35.076857 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-6ebe6a43-b757-4812-ba50-1e733b72910d req-61afefd7-c782-41ab-82bf-5645c1bad104 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.247310 Sep 08 10:52:35.077542 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f7f2ab8b-0ce3-4aee-bdcc-9a296382f5bb tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:35.081469 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1662/3326] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:52:35.087594 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f7f2ab8b-0ce3-4aee-bdcc-9a296382f5bb tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: f182d52b-9650-44f2-bd28-f2ae1daa1438] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:35.114264 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f7f2ab8b-0ce3-4aee-bdcc-9a296382f5bb tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:35.114807 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f7f2ab8b-0ce3-4aee-bdcc-9a296382f5bb tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:35.115243 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f7f2ab8b-0ce3-4aee-bdcc-9a296382f5bb tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:35.115982 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f7f2ab8b-0ce3-4aee-bdcc-9a296382f5bb tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:35.116446 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f7f2ab8b-0ce3-4aee-bdcc-9a296382f5bb tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:35.116979 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f7f2ab8b-0ce3-4aee-bdcc-9a296382f5bb tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:35.343817 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8cd8d662-7bde-4c9f-a79d-dc1c7c1cd78b tempest-SecurityGroupRulesNegativeTestJSON-1442261563 tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project] Action: 'create', calling method: .version_select at 0x7f68e4cf1700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-644018312", "description": "tempest-description-406376309"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:52:35.798444 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f7f2ab8b-0ce3-4aee-bdcc-9a296382f5bb tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c291cbe955b4ee5abc98132dda0255e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f9a24cad014d7f827e8f3236dd5bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:35.816002 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f7f2ab8b-0ce3-4aee-bdcc-9a296382f5bb tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/f182d52b-9650-44f2-bd28-f2ae1daa1438" status: 200 len: 1615 microversion: 2.1 time: 0.752743 Sep 08 10:52:35.816703 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1665/3327] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:35 2022] GET /compute/v2.1/servers/f182d52b-9650-44f2-bd28-f2ae1daa1438 => generated 1615 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:35.822065 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2aec4713-b5f3-4763-bce7-68577c7adb12 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:35.822890 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2aec4713-b5f3-4763-bce7-68577c7adb12 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: a882cf75-539a-45fa-ae2b-4e0f043b340d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:35.845686 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2aec4713-b5f3-4763-bce7-68577c7adb12 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:35.846652 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2aec4713-b5f3-4763-bce7-68577c7adb12 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:35.847348 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2aec4713-b5f3-4763-bce7-68577c7adb12 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:35.848300 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2aec4713-b5f3-4763-bce7-68577c7adb12 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:35.848933 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2aec4713-b5f3-4763-bce7-68577c7adb12 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:35.849576 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2aec4713-b5f3-4763-bce7-68577c7adb12 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:36.489542 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8cd8d662-7bde-4c9f-a79d-dc1c7c1cd78b tempest-SecurityGroupRulesNegativeTestJSON-1442261563 tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 1.250754 Sep 08 10:52:36.491222 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1663/3328] 10.222.0.27 () {60 vars in 1180 bytes} [Thu Sep 8 10:52:35 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:52:36.503169 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0040284c-a70e-441c-9bc3-a4f4d0a37861 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:36.506650 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0040284c-a70e-441c-9bc3-a4f4d0a37861 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] [instance: 0a2deb39-1e14-4009-a813-70141de75879] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:36.529329 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0040284c-a70e-441c-9bc3-a4f4d0a37861 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:36.532336 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0040284c-a70e-441c-9bc3-a4f4d0a37861 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:36.533081 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0040284c-a70e-441c-9bc3-a4f4d0a37861 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:36.534089 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0040284c-a70e-441c-9bc3-a4f4d0a37861 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:36.534765 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0040284c-a70e-441c-9bc3-a4f4d0a37861 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:36.535399 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0040284c-a70e-441c-9bc3-a4f4d0a37861 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:36.873356 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0040284c-a70e-441c-9bc3-a4f4d0a37861 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1502b3b00c449399ac35378281d992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df398bd0b3f45e9b11fe4212d6b5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:36.886853 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0040284c-a70e-441c-9bc3-a4f4d0a37861 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] 10.222.0.27 "GET /compute/v2.1/servers/0a2deb39-1e14-4009-a813-70141de75879" status: 200 len: 1313 microversion: 2.1 time: 0.394239 Sep 08 10:52:36.888022 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1664/3329] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:36 2022] GET /compute/v2.1/servers/0a2deb39-1e14-4009-a813-70141de75879 => generated 1313 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:36.909325 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c071b000-ae27-4298-ae19-6a92454da417 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:36.910825 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c071b000-ae27-4298-ae19-6a92454da417 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: d8071344-b39f-4b47-b77c-8afaf51d22a2] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:36.926884 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c071b000-ae27-4298-ae19-6a92454da417 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:36.927856 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c071b000-ae27-4298-ae19-6a92454da417 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:36.928889 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c071b000-ae27-4298-ae19-6a92454da417 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:36.931798 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c071b000-ae27-4298-ae19-6a92454da417 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:36.933992 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c071b000-ae27-4298-ae19-6a92454da417 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:36.935371 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c071b000-ae27-4298-ae19-6a92454da417 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:37.088751 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2aec4713-b5f3-4763-bce7-68577c7adb12 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:37.115857 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2aec4713-b5f3-4763-bce7-68577c7adb12 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d" status: 200 len: 1322 microversion: 2.1 time: 1.296498 Sep 08 10:52:37.115857 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1666/3330] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:35 2022] GET /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d => generated 1322 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:37.122925 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-09ba1d06-2edb-44f4-b745-db96fa66f79e tempest-SecurityGroupRulesNegativeTestJSON-1442261563 tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project] Action: 'create', calling method: .version_select at 0x7f68e4217280>, body: {"security_group_rule": {"parent_group_id": "84692ace-2819-4120-b48c-79ff0c44e228", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:52:37.350740 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c071b000-ae27-4298-ae19-6a92454da417 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86e8bd6f9048ce8718f432e51128a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c3752f739b47a296a5b88948fe7f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:37.368380 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c071b000-ae27-4298-ae19-6a92454da417 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "GET /compute/v2.1/servers/d8071344-b39f-4b47-b77c-8afaf51d22a2" status: 200 len: 1526 microversion: 2.1 time: 0.477453 Sep 08 10:52:37.371500 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1665/3331] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:36 2022] GET /compute/v2.1/servers/d8071344-b39f-4b47-b77c-8afaf51d22a2 => generated 1526 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:37.392979 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c4029636-80eb-4ad7-b12b-defa42883912 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:37.395349 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c4029636-80eb-4ad7-b12b-defa42883912 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: f182d52b-9650-44f2-bd28-f2ae1daa1438] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:37.420951 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c4029636-80eb-4ad7-b12b-defa42883912 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:37.421530 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c4029636-80eb-4ad7-b12b-defa42883912 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:37.427578 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c4029636-80eb-4ad7-b12b-defa42883912 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:37.429572 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c4029636-80eb-4ad7-b12b-defa42883912 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:37.431549 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c4029636-80eb-4ad7-b12b-defa42883912 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:37.432013 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c4029636-80eb-4ad7-b12b-defa42883912 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:37.644668 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c4029636-80eb-4ad7-b12b-defa42883912 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c291cbe955b4ee5abc98132dda0255e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f9a24cad014d7f827e8f3236dd5bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:37.656531 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c4029636-80eb-4ad7-b12b-defa42883912 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/f182d52b-9650-44f2-bd28-f2ae1daa1438" status: 200 len: 1615 microversion: 2.1 time: 0.281118 Sep 08 10:52:37.669505 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1666/3332] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:37 2022] GET /compute/v2.1/servers/f182d52b-9650-44f2-bd28-f2ae1daa1438 => generated 1615 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:37.798992 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-046e25bc-2551-4308-8be5-bbcc89ae7cbe req-134f4a1d-6fa4-4add-b249-ee7760342858 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f182d52b-9650-44f2-bd28-f2ae1daa1438", "name": "network-vif-deleted", "tag": "b9069650-6961-445f-8748-e1a4b9f65026"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:52:37.822958 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-046e25bc-2551-4308-8be5-bbcc89ae7cbe req-134f4a1d-6fa4-4add-b249-ee7760342858 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:37.824286 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-046e25bc-2551-4308-8be5-bbcc89ae7cbe req-134f4a1d-6fa4-4add-b249-ee7760342858 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:37.824286 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-046e25bc-2551-4308-8be5-bbcc89ae7cbe req-134f4a1d-6fa4-4add-b249-ee7760342858 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:37.840600 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-046e25bc-2551-4308-8be5-bbcc89ae7cbe req-134f4a1d-6fa4-4add-b249-ee7760342858 service nova] Creating event network-vif-deleted:b9069650-6961-445f-8748-e1a4b9f65026 for instance f182d52b-9650-44f2-bd28-f2ae1daa1438 on n-h1-850501-12 Sep 08 10:52:37.850228 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-046e25bc-2551-4308-8be5-bbcc89ae7cbe req-134f4a1d-6fa4-4add-b249-ee7760342858 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058408 Sep 08 10:52:37.852820 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1667/3333] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:52:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Sep 08 10:52:37.927549 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-69f6ecb3-214b-4d68-a591-4e52fe30cb15 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:37.928439 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-69f6ecb3-214b-4d68-a591-4e52fe30cb15 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] [instance: 0a2deb39-1e14-4009-a813-70141de75879] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:37.943404 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-69f6ecb3-214b-4d68-a591-4e52fe30cb15 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:37.947246 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-69f6ecb3-214b-4d68-a591-4e52fe30cb15 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:37.948382 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-69f6ecb3-214b-4d68-a591-4e52fe30cb15 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:37.949899 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-69f6ecb3-214b-4d68-a591-4e52fe30cb15 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:37.950400 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-69f6ecb3-214b-4d68-a591-4e52fe30cb15 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:37.952273 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-69f6ecb3-214b-4d68-a591-4e52fe30cb15 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:37.969429 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=100 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:52:38.074554 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:52:38.206047 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-69f6ecb3-214b-4d68-a591-4e52fe30cb15 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1502b3b00c449399ac35378281d992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df398bd0b3f45e9b11fe4212d6b5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:38.227529 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-69f6ecb3-214b-4d68-a591-4e52fe30cb15 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] 10.222.0.27 "GET /compute/v2.1/servers/0a2deb39-1e14-4009-a813-70141de75879" status: 200 len: 1313 microversion: 2.1 time: 0.305837 Sep 08 10:52:38.241914 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1668/3334] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:37 2022] GET /compute/v2.1/servers/0a2deb39-1e14-4009-a813-70141de75879 => generated 1313 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:38.257524 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b3cd2009-e1a3-4c88-9702-2cc2353a8fcd tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:38.260040 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b3cd2009-e1a3-4c88-9702-2cc2353a8fcd tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: a882cf75-539a-45fa-ae2b-4e0f043b340d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:38.274629 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b3cd2009-e1a3-4c88-9702-2cc2353a8fcd tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:38.288879 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b3cd2009-e1a3-4c88-9702-2cc2353a8fcd tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:38.289634 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b3cd2009-e1a3-4c88-9702-2cc2353a8fcd tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:38.290694 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b3cd2009-e1a3-4c88-9702-2cc2353a8fcd tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:38.292383 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b3cd2009-e1a3-4c88-9702-2cc2353a8fcd tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:38.293070 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b3cd2009-e1a3-4c88-9702-2cc2353a8fcd tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:38.713517 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b3cd2009-e1a3-4c88-9702-2cc2353a8fcd tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:38.758908 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b3cd2009-e1a3-4c88-9702-2cc2353a8fcd tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d" status: 200 len: 1516 microversion: 2.1 time: 0.515588 Sep 08 10:52:38.759779 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1669/3335] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:38 2022] GET /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d => generated 1516 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:38.768238 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a2d2dc1a-5a43-4483-a159-37846c653a5a tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:38.773574 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a2d2dc1a-5a43-4483-a159-37846c653a5a tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: d8071344-b39f-4b47-b77c-8afaf51d22a2] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:38.801947 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a2d2dc1a-5a43-4483-a159-37846c653a5a tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:38.802818 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a2d2dc1a-5a43-4483-a159-37846c653a5a tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:38.803531 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a2d2dc1a-5a43-4483-a159-37846c653a5a tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:38.804473 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a2d2dc1a-5a43-4483-a159-37846c653a5a tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:38.805190 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a2d2dc1a-5a43-4483-a159-37846c653a5a tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:38.805840 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a2d2dc1a-5a43-4483-a159-37846c653a5a tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:39.020247 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a2d2dc1a-5a43-4483-a159-37846c653a5a tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86e8bd6f9048ce8718f432e51128a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c3752f739b47a296a5b88948fe7f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:39.031375 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a2d2dc1a-5a43-4483-a159-37846c653a5a tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "GET /compute/v2.1/servers/d8071344-b39f-4b47-b77c-8afaf51d22a2" status: 200 len: 1484 microversion: 2.1 time: 0.269183 Sep 08 10:52:39.033750 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1670/3336] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:38 2022] GET /compute/v2.1/servers/d8071344-b39f-4b47-b77c-8afaf51d22a2 => generated 1484 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:39.043466 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c2741fa9-d37e-46ea-a11e-9c4b97bec114 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:39.046125 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c2741fa9-d37e-46ea-a11e-9c4b97bec114 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: f182d52b-9650-44f2-bd28-f2ae1daa1438] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:39.051675 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-09ba1d06-2edb-44f4-b745-db96fa66f79e tempest-SecurityGroupRulesNegativeTestJSON-1442261563 tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.934292 Sep 08 10:52:39.059876 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1667/3337] 10.222.0.27 () {60 vars in 1195 bytes} [Thu Sep 8 10:52:37 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1936 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:52:39.061509 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c2741fa9-d37e-46ea-a11e-9c4b97bec114 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:39.063175 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c2741fa9-d37e-46ea-a11e-9c4b97bec114 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:39.065731 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-640f9164-1145-4c7d-81b1-f6db44748b42 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:52:39.077494 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-640f9164-1145-4c7d-81b1-f6db44748b42 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: a882cf75-539a-45fa-ae2b-4e0f043b340d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:39.090403 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c2741fa9-d37e-46ea-a11e-9c4b97bec114 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:39.091496 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c2741fa9-d37e-46ea-a11e-9c4b97bec114 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:39.094642 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c2741fa9-d37e-46ea-a11e-9c4b97bec114 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:39.095647 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c2741fa9-d37e-46ea-a11e-9c4b97bec114 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:39.095771 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=15 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:52:39.112748 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-640f9164-1145-4c7d-81b1-f6db44748b42 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:39.113795 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-640f9164-1145-4c7d-81b1-f6db44748b42 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:39.114493 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-640f9164-1145-4c7d-81b1-f6db44748b42 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:39.116152 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-640f9164-1145-4c7d-81b1-f6db44748b42 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:39.117237 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-640f9164-1145-4c7d-81b1-f6db44748b42 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:39.117903 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-640f9164-1145-4c7d-81b1-f6db44748b42 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:39.164341 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-640f9164-1145-4c7d-81b1-f6db44748b42 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lazy-loading 'flavor' on Instance uuid a882cf75-539a-45fa-ae2b-4e0f043b340d {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:52:39.178518 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-c2741fa9-d37e-46ea-a11e-9c4b97bec114 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] HTTP exception thrown: Instance f182d52b-9650-44f2-bd28-f2ae1daa1438 could not be found. Sep 08 10:52:39.180424 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c2741fa9-d37e-46ea-a11e-9c4b97bec114 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Request method failure captured: Sep 08 10:52:39.180424 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/f182d52b-9650-44f2-bd28-f2ae1daa1438 HTTP/1.1 Sep 08 10:52:39.180424 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:52:39.180424 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:52:39.180424 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:52:39.180424 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:52:39.180424 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:52:39.180424 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:52:39.180424 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:52:39.180424 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:52:39.180424 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcf85nxlXglNpNUDafAex8bEd4FqCO21NTPeXDX2uUnTAK4RtQmB0Zln5OyfaDsL03XE7NxjFWJINQM-4CVmZPvJMmjswkfAMS-LTodBU21IQa_AJm8NdfZKIu9JkoC4h7calajGQneT5j1jgUkjySqAUeFvWcq2xoj6sNreqExg8K8 Sep 08 10:52:39.180424 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:52:39.180424 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:52:39.180424 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:52:39.180424 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:52:39.180424 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:52:39.180424 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:52:39.180424 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 20f9a24cad014d7f827e8f3236dd5bae Sep 08 10:52:39.180424 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-AttachVolumeNegativeTest-20693983 Sep 08 10:52:39.180424 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:52:39.180424 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:52:39.180424 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/20f9a24cad014d7f827e8f3236dd5bae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/20f9a24cad014d7f827e8f3236dd5bae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_20f9a24cad014d7f827e8f3236dd5bae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/20f9a24cad014d7f827e8f3236dd5bae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:52:39.180424 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-AttachVolumeNegativeTest-20693983 Sep 08 10:52:39.180424 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 20f9a24cad014d7f827e8f3236dd5bae Sep 08 10:52:39.180424 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-20693983 Sep 08 10:52:39.180424 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-AttachVolumeNegativeTest-20693983-project Sep 08 10:52:39.180424 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:52:39.180424 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:52:39.180424 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 5c291cbe955b4ee5abc98132dda0255e Sep 08 10:52:39.180424 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-AttachVolumeNegativeTest-20693983-project Sep 08 10:52:39.180424 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:52:39.180424 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance f182d52b-9650-44f2-bd28-f2ae1daa1438 could not be found. Sep 08 10:52:39.180424 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': 'f182d52b-9650-44f2-bd28-f2ae1daa1438'} Sep 08 10:52:39.180424 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:52:39.180424 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:39.180424 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:52:39.180424 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:52:39.180424 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:52:39.180424 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:52:39.180424 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:52:39.180424 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:52:39.180424 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:52:39.180424 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:52:39.180424 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f182d52b-9650-44f2-bd28-f2ae1daa1438 could not be found. Sep 08 10:52:39.180424 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:52:39.180424 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:52:39.180424 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:52:39.180424 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:39.180424 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:52:39.180424 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:52:39.180424 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:52:39.180424 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:52:39.180424 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:52:39.180424 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:52:39.180424 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:52:39.180424 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:52:39.180424 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:52:39.180424 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:52:39.180424 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:52:39.180424 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:52:39.180424 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f182d52b-9650-44f2-bd28-f2ae1daa1438 could not be found. Sep 08 10:52:39.180424 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:52:39.180424 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:52:39.180424 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:52:39.185362 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:39.185362 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:52:39.185362 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:52:39.185362 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:52:39.185362 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:52:39.185362 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f182d52b-9650-44f2-bd28-f2ae1daa1438 could not be found. Sep 08 10:52:39.185362 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:52:39.185362 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c2741fa9-d37e-46ea-a11e-9c4b97bec114 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Returning 404 to user: Instance f182d52b-9650-44f2-bd28-f2ae1daa1438 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:52:39.198404 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c2741fa9-d37e-46ea-a11e-9c4b97bec114 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/f182d52b-9650-44f2-bd28-f2ae1daa1438" status: 404 len: 111 microversion: 2.1 time: 0.157952 Sep 08 10:52:39.209158 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1671/3338] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:39 2022] GET /compute/v2.1/servers/f182d52b-9650-44f2-bd28-f2ae1daa1438 => generated 111 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:52:39.243707 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f2e3c4c6-7e61-4e89-85bb-db489c361a52 tempest-SecurityGroupRulesNegativeTestJSON-1442261563 tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project] Action: 'create', calling method: .version_select at 0x7f68e45b0f70>, body: {"security_group_rule": {"parent_group_id": "84692ace-2819-4120-b48c-79ff0c44e228", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:52:39.313058 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-640f9164-1145-4c7d-81b1-f6db44748b42 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "POST /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d/action" status: 200 len: 32 microversion: 2.1 time: 0.249940 Sep 08 10:52:39.316111 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1668/3339] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:52:39 2022] POST /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d/action => generated 32 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:52:39.343679 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b864c3d3-ff80-4339-82b5-e35c57e45581 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '.version_select at 0x7f68e416fa60>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:39.430713 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b864c3d3-ff80-4339-82b5-e35c57e45581 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1285015287" status: 202 len: 0 microversion: 2.1 time: 0.110863 Sep 08 10:52:39.432668 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1669/3340] 10.222.0.27 () {58 vars in 1221 bytes} [Thu Sep 8 10:52:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1285015287 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:52:39.448639 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-eac038ca-0a63-4510-889a-fc927a7f95fd tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:39.449532 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-eac038ca-0a63-4510-889a-fc927a7f95fd tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] [instance: 0a2deb39-1e14-4009-a813-70141de75879] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:39.470063 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eac038ca-0a63-4510-889a-fc927a7f95fd tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:39.478383 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eac038ca-0a63-4510-889a-fc927a7f95fd tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:39.479227 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eac038ca-0a63-4510-889a-fc927a7f95fd tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:39.480642 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eac038ca-0a63-4510-889a-fc927a7f95fd tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:39.481391 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eac038ca-0a63-4510-889a-fc927a7f95fd tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:39.482051 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eac038ca-0a63-4510-889a-fc927a7f95fd tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:39.634005 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-f2e3c4c6-7e61-4e89-85bb-db489c361a52 tempest-SecurityGroupRulesNegativeTestJSON-1442261563 tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project] HTTP exception thrown: This rule already exists in group 84692ace-2819-4120-b48c-79ff0c44e228 Sep 08 10:52:39.650699 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f2e3c4c6-7e61-4e89-85bb-db489c361a52 tempest-SecurityGroupRulesNegativeTestJSON-1442261563 tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project] Request method failure captured: Sep 08 10:52:39.650699 n-d-850501-12 devstack@n-api.service[128861]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 08 10:52:39.650699 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:52:39.650699 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:52:39.650699 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:52:39.650699 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 138 Sep 08 10:52:39.650699 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:52:39.650699 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:52:39.650699 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:52:39.650699 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:52:39.650699 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGclyAHM1CdE3uifryK7AYCqguA-SzzJIjV_K3jxBkp95zXKVXns1yyqrlpfBFYOGtnuKZHVLAPSpOvGRQERgiEdFsVHnDK6iQuMnpzAXwkv43kPoKS4Oypu5j2Kf2ml4CRSehBNNyJlPVILXoBjvCE3nlCjlkL2Lc5cm1Z9Z8sHbjw4 Sep 08 10:52:39.650699 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:52:39.650699 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:52:39.650699 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:52:39.650699 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:52:39.650699 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:52:39.650699 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:52:39.650699 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 8d0c595184ce4facb1e697088384222f Sep 08 10:52:39.650699 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1442261563 Sep 08 10:52:39.650699 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:52:39.650699 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:52:39.650699 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8d0c595184ce4facb1e697088384222f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8d0c595184ce4facb1e697088384222f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8d0c595184ce4facb1e697088384222f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8d0c595184ce4facb1e697088384222f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:52:39.650699 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1442261563 Sep 08 10:52:39.650699 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 8d0c595184ce4facb1e697088384222f Sep 08 10:52:39.650699 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1442261563 Sep 08 10:52:39.650699 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project Sep 08 10:52:39.650699 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:52:39.650699 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:52:39.650699 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 1a7f248d8b904818a5703501c1feeffb Sep 08 10:52:39.650699 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project Sep 08 10:52:39.650699 n-d-850501-12 devstack@n-api.service[128861]: Sep 08 10:52:39.650699 n-d-850501-12 devstack@n-api.service[128861]: {"security_group_rule": {"parent_group_id": "84692ace-2819-4120-b48c-79ff0c44e228", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Sep 08 10:52:39.650699 n-d-850501-12 devstack@n-api.service[128861]: method: Sep 08 10:52:39.650699 n-d-850501-12 devstack@n-api.service[128861]: exception: This rule already exists in group 84692ace-2819-4120-b48c-79ff0c44e228 Sep 08 10:52:39.650699 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'body': {'security_group_rule': {'parent_group_id': '84692ace-2819-4120-b48c-79ff0c44e228', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Sep 08 10:52:39.650699 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:52:39.650699 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:39.650699 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Sep 08 10:52:39.650699 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Sep 08 10:52:39.650699 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Sep 08 10:52:39.650699 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Sep 08 10:52:39.650699 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 84692ace-2819-4120-b48c-79ff0c44e228 Sep 08 10:52:39.650699 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:52:39.650699 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:52:39.650699 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:52:39.650699 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:39.650699 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:52:39.650699 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:52:39.650699 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:52:39.650699 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:52:39.650699 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:52:39.650699 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:52:39.650699 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:52:39.650699 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:52:39.650699 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Sep 08 10:52:39.650699 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 08 10:52:39.650699 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 84692ace-2819-4120-b48c-79ff0c44e228 Sep 08 10:52:39.650699 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:52:39.650699 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:52:39.650699 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:52:39.650699 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:39.650699 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:52:39.650699 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:52:39.667382 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:52:39.667382 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:52:39.667382 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 84692ace-2819-4120-b48c-79ff0c44e228 Sep 08 10:52:39.667382 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:52:39.682146 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f2e3c4c6-7e61-4e89-85bb-db489c361a52 tempest-SecurityGroupRulesNegativeTestJSON-1442261563 tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project] Returning 400 to user: This rule already exists in group 84692ace-2819-4120-b48c-79ff0c44e228 {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:52:39.709721 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f2e3c4c6-7e61-4e89-85bb-db489c361a52 tempest-SecurityGroupRulesNegativeTestJSON-1442261563 tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.491610 Sep 08 10:52:39.719111 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1672/3341] 10.222.0.27 () {60 vars in 1195 bytes} [Thu Sep 8 10:52:39 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 511 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:52:39.759299 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2ddf48b4-aae6-46be-a7b1-715c814a34dd tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:39.764227 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2ddf48b4-aae6-46be-a7b1-715c814a34dd tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: a882cf75-539a-45fa-ae2b-4e0f043b340d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:39.807125 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2ddf48b4-aae6-46be-a7b1-715c814a34dd tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:39.809159 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2ddf48b4-aae6-46be-a7b1-715c814a34dd tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:39.811121 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2ddf48b4-aae6-46be-a7b1-715c814a34dd tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:39.813815 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2ddf48b4-aae6-46be-a7b1-715c814a34dd tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:39.816041 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2ddf48b4-aae6-46be-a7b1-715c814a34dd tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:39.818750 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2ddf48b4-aae6-46be-a7b1-715c814a34dd tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:40.186871 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-eac038ca-0a63-4510-889a-fc927a7f95fd tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1502b3b00c449399ac35378281d992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df398bd0b3f45e9b11fe4212d6b5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:40.220845 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-eac038ca-0a63-4510-889a-fc927a7f95fd tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] 10.222.0.27 "GET /compute/v2.1/servers/0a2deb39-1e14-4009-a813-70141de75879" status: 200 len: 1313 microversion: 2.1 time: 0.780044 Sep 08 10:52:40.226069 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1670/3342] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:39 2022] GET /compute/v2.1/servers/0a2deb39-1e14-4009-a813-70141de75879 => generated 1313 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:40.235840 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f8b5cb43-c425-4b7d-9d9a-d5fb853ff36e tempest-SecurityGroupRulesNegativeTestJSON-1442261563 tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project] Calling method '.version_select at 0x7f68e416fee0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:40.458099 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2ddf48b4-aae6-46be-a7b1-715c814a34dd tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:40.496632 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2ddf48b4-aae6-46be-a7b1-715c814a34dd tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d" status: 200 len: 1522 microversion: 2.1 time: 0.758242 Sep 08 10:52:40.498344 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1673/3343] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:39 2022] GET /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d => generated 1522 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:40.504581 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-1911f316-2cf4-4861-adf6-92691afd5b6d req-b2abe99c-a6cc-4157-bd6a-4230878cf918 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8071344-b39f-4b47-b77c-8afaf51d22a2", "name": "network-vif-deleted", "tag": "dc6c944a-8056-468c-87ed-aaf5e01c9095"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:52:40.537298 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-1911f316-2cf4-4861-adf6-92691afd5b6d req-b2abe99c-a6cc-4157-bd6a-4230878cf918 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:40.538429 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-1911f316-2cf4-4861-adf6-92691afd5b6d req-b2abe99c-a6cc-4157-bd6a-4230878cf918 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:40.539202 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-1911f316-2cf4-4861-adf6-92691afd5b6d req-b2abe99c-a6cc-4157-bd6a-4230878cf918 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:40.575649 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-1911f316-2cf4-4861-adf6-92691afd5b6d req-b2abe99c-a6cc-4157-bd6a-4230878cf918 service nova] Creating event network-vif-deleted:dc6c944a-8056-468c-87ed-aaf5e01c9095 for instance d8071344-b39f-4b47-b77c-8afaf51d22a2 on n-h2-850501-12 Sep 08 10:52:40.598322 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-1911f316-2cf4-4861-adf6-92691afd5b6d req-b2abe99c-a6cc-4157-bd6a-4230878cf918 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098381 Sep 08 10:52:40.598958 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1674/3344] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:52:40.610288 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-25db97b1-2631-41f2-9fc7-79ae0b4726ee tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:40.618303 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-25db97b1-2631-41f2-9fc7-79ae0b4726ee tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: d8071344-b39f-4b47-b77c-8afaf51d22a2] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:40.646973 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-25db97b1-2631-41f2-9fc7-79ae0b4726ee tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:40.653622 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-25db97b1-2631-41f2-9fc7-79ae0b4726ee tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:40.654070 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-25db97b1-2631-41f2-9fc7-79ae0b4726ee tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:40.655169 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-25db97b1-2631-41f2-9fc7-79ae0b4726ee tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:40.657946 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-25db97b1-2631-41f2-9fc7-79ae0b4726ee tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:40.658641 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-25db97b1-2631-41f2-9fc7-79ae0b4726ee tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:40.696811 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-25db97b1-2631-41f2-9fc7-79ae0b4726ee tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] HTTP exception thrown: Instance d8071344-b39f-4b47-b77c-8afaf51d22a2 could not be found. Sep 08 10:52:40.707588 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-25db97b1-2631-41f2-9fc7-79ae0b4726ee tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Request method failure captured: Sep 08 10:52:40.707588 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/d8071344-b39f-4b47-b77c-8afaf51d22a2 HTTP/1.1 Sep 08 10:52:40.707588 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:52:40.707588 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:52:40.707588 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:52:40.707588 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:52:40.707588 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:52:40.707588 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:52:40.707588 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:52:40.707588 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:52:40.707588 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcjivLUY-NOpubj4piWQUE4YdjVoieEQ-G0L0ay9l2jNqBIueJ_eB4w8-Iohm-hEbdImfT6Vv0CotgGIogaerBRfcTAAw-NhjLbx2EjcqsYLMFxCPLjOPfzXaEWWRNcumoyYDLdNDrrGczsG7GBIlwK26oqS5wWNAPkM7DBSBKGgOFQ Sep 08 10:52:40.707588 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:52:40.707588 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:52:40.707588 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:52:40.707588 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:52:40.707588 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:52:40.707588 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:52:40.707588 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 50c3752f739b47a296a5b88948fe7f7f Sep 08 10:52:40.707588 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1836029851 Sep 08 10:52:40.707588 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:52:40.707588 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:52:40.707588 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/50c3752f739b47a296a5b88948fe7f7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/50c3752f739b47a296a5b88948fe7f7f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_50c3752f739b47a296a5b88948fe7f7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/50c3752f739b47a296a5b88948fe7f7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:52:40.707588 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1836029851 Sep 08 10:52:40.707588 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 50c3752f739b47a296a5b88948fe7f7f Sep 08 10:52:40.707588 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1836029851 Sep 08 10:52:40.707588 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ImagesOneServerNegativeTestJSON-1836029851-project Sep 08 10:52:40.707588 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:52:40.707588 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:52:40.707588 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 7c86e8bd6f9048ce8718f432e51128a5 Sep 08 10:52:40.707588 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1836029851-project Sep 08 10:52:40.707588 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:52:40.707588 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance d8071344-b39f-4b47-b77c-8afaf51d22a2 could not be found. Sep 08 10:52:40.707588 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': 'd8071344-b39f-4b47-b77c-8afaf51d22a2'} Sep 08 10:52:40.707588 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:52:40.707588 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:40.707588 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:52:40.707588 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:52:40.707588 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:52:40.707588 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:52:40.707588 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:52:40.707588 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:52:40.707588 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:52:40.707588 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:52:40.707588 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8071344-b39f-4b47-b77c-8afaf51d22a2 could not be found. Sep 08 10:52:40.707588 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:52:40.707588 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:52:40.707588 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:52:40.707588 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:40.707588 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:52:40.707588 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:52:40.707588 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:52:40.707588 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:52:40.707588 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:52:40.707588 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:52:40.707588 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:52:40.707588 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:52:40.707588 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:52:40.707588 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:52:40.707588 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:52:40.707588 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:52:40.707588 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8071344-b39f-4b47-b77c-8afaf51d22a2 could not be found. Sep 08 10:52:40.707588 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:52:40.707588 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:52:40.714962 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:52:40.714962 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:40.714962 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:52:40.714962 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:52:40.714962 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:52:40.714962 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:52:40.714962 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8071344-b39f-4b47-b77c-8afaf51d22a2 could not be found. Sep 08 10:52:40.714962 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:52:40.714962 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-25db97b1-2631-41f2-9fc7-79ae0b4726ee tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Returning 404 to user: Instance d8071344-b39f-4b47-b77c-8afaf51d22a2 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:52:40.717491 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-25db97b1-2631-41f2-9fc7-79ae0b4726ee tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "GET /compute/v2.1/servers/d8071344-b39f-4b47-b77c-8afaf51d22a2" status: 404 len: 111 microversion: 2.1 time: 0.111115 Sep 08 10:52:40.726054 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1675/3345] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:40 2022] GET /compute/v2.1/servers/d8071344-b39f-4b47-b77c-8afaf51d22a2 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:52:40.739382 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-888b289c-b219-407e-b5d2-23f4a30d002f tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Calling method '.version_select at 0x7f68e5343af0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:40.794514 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-888b289c-b219-407e-b5d2-23f4a30d002f tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] HTTP exception thrown: Image not found. Sep 08 10:52:40.796453 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-888b289c-b219-407e-b5d2-23f4a30d002f tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Request method failure captured: Sep 08 10:52:40.796453 n-d-850501-12 devstack@n-api.service[128861]: request: DELETE /compute/v2.1/images/aee7b4e9-1763-4199-826c-6b708d518e8e HTTP/1.1 Sep 08 10:52:40.796453 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:52:40.796453 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:52:40.796453 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:52:40.796453 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:52:40.796453 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:52:40.796453 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:52:40.796453 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:52:40.796453 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:52:40.796453 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcjivLUY-NOpubj4piWQUE4YdjVoieEQ-G0L0ay9l2jNqBIueJ_eB4w8-Iohm-hEbdImfT6Vv0CotgGIogaerBRfcTAAw-NhjLbx2EjcqsYLMFxCPLjOPfzXaEWWRNcumoyYDLdNDrrGczsG7GBIlwK26oqS5wWNAPkM7DBSBKGgOFQ Sep 08 10:52:40.796453 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:52:40.796453 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:52:40.796453 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:52:40.796453 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:52:40.796453 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:52:40.796453 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:52:40.796453 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 50c3752f739b47a296a5b88948fe7f7f Sep 08 10:52:40.796453 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1836029851 Sep 08 10:52:40.796453 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:52:40.796453 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:52:40.796453 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/50c3752f739b47a296a5b88948fe7f7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/50c3752f739b47a296a5b88948fe7f7f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_50c3752f739b47a296a5b88948fe7f7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/50c3752f739b47a296a5b88948fe7f7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:52:40.796453 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1836029851 Sep 08 10:52:40.796453 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 50c3752f739b47a296a5b88948fe7f7f Sep 08 10:52:40.796453 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1836029851 Sep 08 10:52:40.796453 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ImagesOneServerNegativeTestJSON-1836029851-project Sep 08 10:52:40.796453 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:52:40.796453 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:52:40.796453 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 7c86e8bd6f9048ce8718f432e51128a5 Sep 08 10:52:40.796453 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1836029851-project Sep 08 10:52:40.796453 n-d-850501-12 devstack@n-api.service[128861]: method: Sep 08 10:52:40.796453 n-d-850501-12 devstack@n-api.service[128861]: exception: Image not found. Sep 08 10:52:40.796453 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': 'aee7b4e9-1763-4199-826c-6b708d518e8e'} Sep 08 10:52:40.796453 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:52:40.796453 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:40.796453 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 08 10:52:40.796453 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 08 10:52:40.796453 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 10:52:40.796453 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 10:52:40.796453 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 10:52:40.796453 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 10:52:40.796453 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 08 10:52:40.796453 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 08 10:52:40.796453 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 08 10:52:40.796453 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 08 10:52:40.796453 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 10:52:40.796453 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 10:52:40.796453 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 10:52:40.796453 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 10:52:40.796453 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image aee7b4e9-1763-4199-826c-6b708d518e8e to delete Sep 08 10:52:40.796453 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:52:40.796453 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:52:40.796453 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:52:40.796453 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:40.796453 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 08 10:52:40.796453 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 08 10:52:40.796453 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 08 10:52:40.796453 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 08 10:52:40.796453 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 08 10:52:40.796453 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 08 10:52:40.796453 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image aee7b4e9-1763-4199-826c-6b708d518e8e could not be found. Sep 08 10:52:40.796453 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:52:40.796453 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:52:40.796453 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:52:40.801551 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:40.801551 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:52:40.801551 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:52:40.801551 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:52:40.801551 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:52:40.801551 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:52:40.801551 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:52:40.801551 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:52:40.801551 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:52:40.801551 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 08 10:52:40.801551 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 08 10:52:40.801551 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 08 10:52:40.801551 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:52:40.801551 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:52:40.801551 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:52:40.801551 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:40.801551 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:52:40.801551 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:52:40.801551 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:52:40.801551 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:52:40.801551 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 08 10:52:40.801551 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:52:40.801551 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-888b289c-b219-407e-b5d2-23f4a30d002f tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Returning 404 to user: Image not found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:52:40.803981 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-888b289c-b219-407e-b5d2-23f4a30d002f tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "DELETE /compute/v2.1/images/aee7b4e9-1763-4199-826c-6b708d518e8e" status: 404 len: 62 microversion: 2.1 time: 0.076610 Sep 08 10:52:40.804716 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1676/3346] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:40 2022] DELETE /compute/v2.1/images/aee7b4e9-1763-4199-826c-6b708d518e8e => generated 62 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:52:40.814575 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3714f2d3-bec2-46e5-8329-7c4c8e4e064e tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:40.821534 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3714f2d3-bec2-46e5-8329-7c4c8e4e064e tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: d21f2600-ca01-4d47-b1f6-c4e8fa28d571] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:40.837771 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3714f2d3-bec2-46e5-8329-7c4c8e4e064e tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:40.839740 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3714f2d3-bec2-46e5-8329-7c4c8e4e064e tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:40.840888 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3714f2d3-bec2-46e5-8329-7c4c8e4e064e tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:40.842158 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3714f2d3-bec2-46e5-8329-7c4c8e4e064e tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:40.843000 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3714f2d3-bec2-46e5-8329-7c4c8e4e064e tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:40.844745 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3714f2d3-bec2-46e5-8329-7c4c8e4e064e tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:40.868586 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-3714f2d3-bec2-46e5-8329-7c4c8e4e064e tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] HTTP exception thrown: Instance d21f2600-ca01-4d47-b1f6-c4e8fa28d571 could not be found. Sep 08 10:52:40.870934 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3714f2d3-bec2-46e5-8329-7c4c8e4e064e tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Request method failure captured: Sep 08 10:52:40.870934 n-d-850501-12 devstack@n-api.service[128861]: request: DELETE /compute/v2.1/servers/d21f2600-ca01-4d47-b1f6-c4e8fa28d571 HTTP/1.1 Sep 08 10:52:40.870934 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:52:40.870934 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:52:40.870934 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:52:40.870934 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:52:40.870934 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:52:40.870934 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:52:40.870934 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:52:40.870934 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:52:40.870934 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcjivLUY-NOpubj4piWQUE4YdjVoieEQ-G0L0ay9l2jNqBIueJ_eB4w8-Iohm-hEbdImfT6Vv0CotgGIogaerBRfcTAAw-NhjLbx2EjcqsYLMFxCPLjOPfzXaEWWRNcumoyYDLdNDrrGczsG7GBIlwK26oqS5wWNAPkM7DBSBKGgOFQ Sep 08 10:52:40.870934 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:52:40.870934 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:52:40.870934 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:52:40.870934 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:52:40.870934 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:52:40.870934 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:52:40.870934 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 50c3752f739b47a296a5b88948fe7f7f Sep 08 10:52:40.870934 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1836029851 Sep 08 10:52:40.870934 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:52:40.870934 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:52:40.870934 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/50c3752f739b47a296a5b88948fe7f7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/50c3752f739b47a296a5b88948fe7f7f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_50c3752f739b47a296a5b88948fe7f7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/50c3752f739b47a296a5b88948fe7f7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:52:40.870934 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1836029851 Sep 08 10:52:40.870934 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 50c3752f739b47a296a5b88948fe7f7f Sep 08 10:52:40.870934 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1836029851 Sep 08 10:52:40.870934 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ImagesOneServerNegativeTestJSON-1836029851-project Sep 08 10:52:40.870934 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:52:40.870934 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:52:40.870934 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 7c86e8bd6f9048ce8718f432e51128a5 Sep 08 10:52:40.870934 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1836029851-project Sep 08 10:52:40.870934 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:52:40.870934 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance d21f2600-ca01-4d47-b1f6-c4e8fa28d571 could not be found. Sep 08 10:52:40.870934 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': 'd21f2600-ca01-4d47-b1f6-c4e8fa28d571'} Sep 08 10:52:40.870934 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:52:40.870934 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:40.870934 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:52:40.870934 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:52:40.870934 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:52:40.870934 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:52:40.870934 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:52:40.870934 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:52:40.870934 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:52:40.870934 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:52:40.870934 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d21f2600-ca01-4d47-b1f6-c4e8fa28d571 could not be found. Sep 08 10:52:40.870934 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:52:40.870934 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:52:40.870934 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:52:40.870934 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:40.870934 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:52:40.870934 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:52:40.870934 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:52:40.870934 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:52:40.870934 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:52:40.870934 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:52:40.870934 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:52:40.870934 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:52:40.870934 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:52:40.870934 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:52:40.870934 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:52:40.870934 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:52:40.870934 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:52:40.870934 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:52:40.875279 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d21f2600-ca01-4d47-b1f6-c4e8fa28d571 could not be found. Sep 08 10:52:40.875279 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:52:40.875279 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:52:40.875279 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:52:40.875279 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:40.875279 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:52:40.875279 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:52:40.875279 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:52:40.875279 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:52:40.875279 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d21f2600-ca01-4d47-b1f6-c4e8fa28d571 could not be found. Sep 08 10:52:40.875279 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:52:40.881835 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3714f2d3-bec2-46e5-8329-7c4c8e4e064e tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Returning 404 to user: Instance d21f2600-ca01-4d47-b1f6-c4e8fa28d571 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:52:40.882860 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3714f2d3-bec2-46e5-8329-7c4c8e4e064e tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d21f2600-ca01-4d47-b1f6-c4e8fa28d571" status: 404 len: 111 microversion: 2.1 time: 0.072537 Sep 08 10:52:40.883893 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1677/3347] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:52:40 2022] DELETE /compute/v2.1/servers/d21f2600-ca01-4d47-b1f6-c4e8fa28d571 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:52:40.892917 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3fe29b79-a772-44bb-8bc5-2fc08e3bbfed tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:40.893738 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3fe29b79-a772-44bb-8bc5-2fc08e3bbfed tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: d21f2600-ca01-4d47-b1f6-c4e8fa28d571] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:40.913664 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3fe29b79-a772-44bb-8bc5-2fc08e3bbfed tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:40.914335 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3fe29b79-a772-44bb-8bc5-2fc08e3bbfed tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:40.914988 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3fe29b79-a772-44bb-8bc5-2fc08e3bbfed tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:40.915853 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3fe29b79-a772-44bb-8bc5-2fc08e3bbfed tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:40.916774 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3fe29b79-a772-44bb-8bc5-2fc08e3bbfed tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:40.918225 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3fe29b79-a772-44bb-8bc5-2fc08e3bbfed tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:40.941771 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-3fe29b79-a772-44bb-8bc5-2fc08e3bbfed tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] HTTP exception thrown: Instance d21f2600-ca01-4d47-b1f6-c4e8fa28d571 could not be found. Sep 08 10:52:40.943739 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3fe29b79-a772-44bb-8bc5-2fc08e3bbfed tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Request method failure captured: Sep 08 10:52:40.943739 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/d21f2600-ca01-4d47-b1f6-c4e8fa28d571 HTTP/1.1 Sep 08 10:52:40.943739 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:52:40.943739 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:52:40.943739 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:52:40.943739 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:52:40.943739 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:52:40.943739 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:52:40.943739 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:52:40.943739 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:52:40.943739 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcjivLUY-NOpubj4piWQUE4YdjVoieEQ-G0L0ay9l2jNqBIueJ_eB4w8-Iohm-hEbdImfT6Vv0CotgGIogaerBRfcTAAw-NhjLbx2EjcqsYLMFxCPLjOPfzXaEWWRNcumoyYDLdNDrrGczsG7GBIlwK26oqS5wWNAPkM7DBSBKGgOFQ Sep 08 10:52:40.943739 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:52:40.943739 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:52:40.943739 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:52:40.943739 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:52:40.943739 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:52:40.943739 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:52:40.943739 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 50c3752f739b47a296a5b88948fe7f7f Sep 08 10:52:40.943739 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1836029851 Sep 08 10:52:40.943739 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:52:40.943739 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:52:40.943739 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/50c3752f739b47a296a5b88948fe7f7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/50c3752f739b47a296a5b88948fe7f7f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_50c3752f739b47a296a5b88948fe7f7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/50c3752f739b47a296a5b88948fe7f7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:52:40.943739 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1836029851 Sep 08 10:52:40.943739 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 50c3752f739b47a296a5b88948fe7f7f Sep 08 10:52:40.943739 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1836029851 Sep 08 10:52:40.943739 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ImagesOneServerNegativeTestJSON-1836029851-project Sep 08 10:52:40.943739 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:52:40.943739 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:52:40.943739 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 7c86e8bd6f9048ce8718f432e51128a5 Sep 08 10:52:40.943739 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1836029851-project Sep 08 10:52:40.943739 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:52:40.943739 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance d21f2600-ca01-4d47-b1f6-c4e8fa28d571 could not be found. Sep 08 10:52:40.943739 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': 'd21f2600-ca01-4d47-b1f6-c4e8fa28d571'} Sep 08 10:52:40.943739 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:52:40.943739 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:40.943739 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:52:40.943739 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:52:40.943739 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:52:40.943739 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:52:40.943739 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:52:40.943739 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:52:40.943739 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:52:40.943739 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:52:40.943739 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d21f2600-ca01-4d47-b1f6-c4e8fa28d571 could not be found. Sep 08 10:52:40.943739 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:52:40.943739 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:52:40.943739 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:52:40.943739 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:40.943739 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:52:40.943739 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:52:40.943739 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:52:40.943739 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:52:40.943739 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:52:40.943739 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:52:40.943739 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:52:40.943739 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:52:40.943739 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:52:40.943739 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:52:40.943739 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:52:40.943739 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:52:40.943739 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d21f2600-ca01-4d47-b1f6-c4e8fa28d571 could not be found. Sep 08 10:52:40.943739 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:52:40.943739 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:52:40.951411 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:52:40.951411 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:40.951411 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:52:40.951411 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:52:40.951411 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:52:40.951411 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:52:40.951411 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d21f2600-ca01-4d47-b1f6-c4e8fa28d571 could not be found. Sep 08 10:52:40.951411 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:52:40.954506 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3fe29b79-a772-44bb-8bc5-2fc08e3bbfed tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Returning 404 to user: Instance d21f2600-ca01-4d47-b1f6-c4e8fa28d571 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:52:40.955780 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3fe29b79-a772-44bb-8bc5-2fc08e3bbfed tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "GET /compute/v2.1/servers/d21f2600-ca01-4d47-b1f6-c4e8fa28d571" status: 404 len: 111 microversion: 2.1 time: 0.067722 Sep 08 10:52:40.959956 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1678/3348] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:40 2022] GET /compute/v2.1/servers/d21f2600-ca01-4d47-b1f6-c4e8fa28d571 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:52:40.966998 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9a1c7c76-83df-4201-a77d-1d1bf756d40b tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Calling method '.version_select at 0x7f68e4bde160>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:40.996121 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9a1c7c76-83df-4201-a77d-1d1bf756d40b tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-626763933" status: 202 len: 0 microversion: 2.1 time: 0.034311 Sep 08 10:52:41.000427 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1679/3349] 10.222.0.27 () {58 vars in 1218 bytes} [Thu Sep 8 10:52:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-626763933 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:52:41.183109 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f8b5cb43-c425-4b7d-9d9a-d5fb853ff36e tempest-SecurityGroupRulesNegativeTestJSON-1442261563 tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-group-rules/95fdb53b-481b-4176-ae20-b5d952fe47af" status: 202 len: 0 microversion: 2.1 time: 0.954838 Sep 08 10:52:41.183910 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1671/3350] 10.222.0.27 () {58 vars in 1287 bytes} [Thu Sep 8 10:52:40 2022] DELETE /compute/v2.1/os-security-group-rules/95fdb53b-481b-4176-ae20-b5d952fe47af => generated 0 bytes in 957 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:52:41.194914 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9b4c2df5-c6de-4414-95bd-a8694742e76b tempest-SecurityGroupRulesNegativeTestJSON-1442261563 tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project] Action: 'create', calling method: .version_select at 0x7f68e5136a60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1236362387", "description": "tempest-description-781955566"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:52:41.260307 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cb2732c6-0f21-41fa-85fa-dad1e1f29159 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:41.261328 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cb2732c6-0f21-41fa-85fa-dad1e1f29159 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] [instance: 0a2deb39-1e14-4009-a813-70141de75879] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:41.280981 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb2732c6-0f21-41fa-85fa-dad1e1f29159 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:41.282216 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb2732c6-0f21-41fa-85fa-dad1e1f29159 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:41.285731 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb2732c6-0f21-41fa-85fa-dad1e1f29159 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:41.286863 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb2732c6-0f21-41fa-85fa-dad1e1f29159 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:41.287692 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb2732c6-0f21-41fa-85fa-dad1e1f29159 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:41.292466 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb2732c6-0f21-41fa-85fa-dad1e1f29159 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:41.968653 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cb2732c6-0f21-41fa-85fa-dad1e1f29159 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1502b3b00c449399ac35378281d992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df398bd0b3f45e9b11fe4212d6b5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:41.983164 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cb2732c6-0f21-41fa-85fa-dad1e1f29159 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] 10.222.0.27 "GET /compute/v2.1/servers/0a2deb39-1e14-4009-a813-70141de75879" status: 200 len: 1313 microversion: 2.1 time: 0.727110 Sep 08 10:52:42.001582 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1672/3351] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:41 2022] GET /compute/v2.1/servers/0a2deb39-1e14-4009-a813-70141de75879 => generated 1313 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:42.024431 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a09a9f68-5051-4787-bcef-c4b3020fcd77 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:42.026226 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a09a9f68-5051-4787-bcef-c4b3020fcd77 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: a882cf75-539a-45fa-ae2b-4e0f043b340d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:42.035634 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a09a9f68-5051-4787-bcef-c4b3020fcd77 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:42.036492 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a09a9f68-5051-4787-bcef-c4b3020fcd77 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:42.037135 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a09a9f68-5051-4787-bcef-c4b3020fcd77 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:42.038059 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a09a9f68-5051-4787-bcef-c4b3020fcd77 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:42.038684 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a09a9f68-5051-4787-bcef-c4b3020fcd77 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:42.039429 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a09a9f68-5051-4787-bcef-c4b3020fcd77 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:42.470344 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9b4c2df5-c6de-4414-95bd-a8694742e76b tempest-SecurityGroupRulesNegativeTestJSON-1442261563 tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.279260 Sep 08 10:52:42.481557 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1680/3352] 10.222.0.27 () {60 vars in 1180 bytes} [Thu Sep 8 10:52:41 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:52:42.495370 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6c9165e8-451a-4f3f-88a2-afc5bfe1803c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Action: 'create', calling method: .version_select at 0x7f68e4af1f70>, body: {"keypair": {"name": "tempest-keypair-530734782", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIV7a6yQVfBucFQZSYPV7KW+CMQyaBClI98TCMld8zjMlYGTFeUrIazXBkofzIGdYxRJ02sdRhOTAmmXrAHd5OkVal2/kNipt48rgBKvfVZCda5PkTDTVJ6aGi0GQwH3xA=="}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:52:42.566650 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-6c9165e8-451a-4f3f-88a2-afc5bfe1803c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Getting quotas for project 20f9a24cad014d7f827e8f3236dd5bae. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:52:42.583905 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-6c9165e8-451a-4f3f-88a2-afc5bfe1803c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Getting quotas for user 5c291cbe955b4ee5abc98132dda0255e and project 20f9a24cad014d7f827e8f3236dd5bae. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:52:42.646758 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6c9165e8-451a-4f3f-88a2-afc5bfe1803c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.162877 Sep 08 10:52:42.652226 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1681/3353] 10.222.0.27 () {60 vars in 1159 bytes} [Thu Sep 8 10:52:42 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:52:42.660583 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b31e71d0-d23e-4b30-a491-9ed8d6a852a4 tempest-SecurityGroupRulesNegativeTestJSON-1442261563 tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project] Action: 'create', calling method: .version_select at 0x7f68e4be84c0>, body: {"security_group_rule": {"parent_group_id": "44674375-df78-4906-9011-0f230e9c75b8", "ip_protocol": "tcp", "from_port": 1956576802, "to_port": 22}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:52:42.869133 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-b31e71d0-d23e-4b30-a491-9ed8d6a852a4 tempest-SecurityGroupRulesNegativeTestJSON-1442261563 tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project] HTTP exception thrown: Invalid port range 1956576802:22. Former value cannot be greater than the later Sep 08 10:52:42.873002 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b31e71d0-d23e-4b30-a491-9ed8d6a852a4 tempest-SecurityGroupRulesNegativeTestJSON-1442261563 tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project] Request method failure captured: Sep 08 10:52:42.873002 n-d-850501-12 devstack@n-api.service[128861]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 08 10:52:42.873002 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:52:42.873002 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:52:42.873002 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:52:42.873002 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 146 Sep 08 10:52:42.873002 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:52:42.873002 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:52:42.873002 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:52:42.873002 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:52:42.873002 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGclyAHM1CdE3uifryK7AYCqguA-SzzJIjV_K3jxBkp95zXKVXns1yyqrlpfBFYOGtnuKZHVLAPSpOvGRQERgiEdFsVHnDK6iQuMnpzAXwkv43kPoKS4Oypu5j2Kf2ml4CRSehBNNyJlPVILXoBjvCE3nlCjlkL2Lc5cm1Z9Z8sHbjw4 Sep 08 10:52:42.873002 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:52:42.873002 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:52:42.873002 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:52:42.873002 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:52:42.873002 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:52:42.873002 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:52:42.873002 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 8d0c595184ce4facb1e697088384222f Sep 08 10:52:42.873002 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1442261563 Sep 08 10:52:42.873002 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:52:42.873002 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:52:42.873002 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8d0c595184ce4facb1e697088384222f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8d0c595184ce4facb1e697088384222f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8d0c595184ce4facb1e697088384222f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8d0c595184ce4facb1e697088384222f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:52:42.873002 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1442261563 Sep 08 10:52:42.873002 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 8d0c595184ce4facb1e697088384222f Sep 08 10:52:42.873002 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1442261563 Sep 08 10:52:42.873002 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project Sep 08 10:52:42.873002 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:52:42.873002 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:52:42.873002 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 1a7f248d8b904818a5703501c1feeffb Sep 08 10:52:42.873002 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project Sep 08 10:52:42.873002 n-d-850501-12 devstack@n-api.service[128861]: Sep 08 10:52:42.873002 n-d-850501-12 devstack@n-api.service[128861]: {"security_group_rule": {"parent_group_id": "44674375-df78-4906-9011-0f230e9c75b8", "ip_protocol": "tcp", "from_port": 1956576802, "to_port": 22}} Sep 08 10:52:42.873002 n-d-850501-12 devstack@n-api.service[128861]: method: Sep 08 10:52:42.873002 n-d-850501-12 devstack@n-api.service[128861]: exception: Invalid port range 1956576802:22. Former value cannot be greater than the later Sep 08 10:52:42.873002 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'body': {'security_group_rule': {'parent_group_id': '44674375-df78-4906-9011-0f230e9c75b8', 'ip_protocol': 'tcp', 'from_port': 1956576802, 'to_port': 22}}} Sep 08 10:52:42.873002 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:52:42.873002 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:42.873002 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 08 10:52:42.873002 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 08 10:52:42.873002 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 08 10:52:42.873002 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 08 10:52:42.873002 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 08 10:52:42.873002 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 08 10:52:42.873002 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Sep 08 10:52:42.873002 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Sep 08 10:52:42.873002 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1956576802:22. Former value cannot be greater than the later Sep 08 10:52:42.873002 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:52:42.873002 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:52:42.873002 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:52:42.873002 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:42.873002 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:52:42.873002 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:52:42.873002 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:52:42.873002 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:52:42.873002 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:52:42.873002 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:52:42.873002 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:52:42.873002 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:52:42.873002 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 08 10:52:42.873002 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 08 10:52:42.873002 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1956576802:22. Former value cannot be greater than the later Sep 08 10:52:42.873002 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:52:42.877528 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:52:42.877528 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:52:42.877528 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:42.877528 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:52:42.877528 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:52:42.877528 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:52:42.877528 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:52:42.877528 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1956576802:22. Former value cannot be greater than the later Sep 08 10:52:42.877528 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:52:42.879084 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b31e71d0-d23e-4b30-a491-9ed8d6a852a4 tempest-SecurityGroupRulesNegativeTestJSON-1442261563 tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project] Returning 400 to user: Invalid port range 1956576802:22. Former value cannot be greater than the later {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:52:42.880145 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b31e71d0-d23e-4b30-a491-9ed8d6a852a4 tempest-SecurityGroupRulesNegativeTestJSON-1442261563 tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.226656 Sep 08 10:52:42.881886 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1682/3354] 10.222.0.27 () {60 vars in 1195 bytes} [Thu Sep 8 10:52:42 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 229 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:52:42.895551 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-62589eed-62ac-4c7d-8a08-f7fa35629532 tempest-SecurityGroupRulesNegativeTestJSON-1442261563 tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project] Action: 'create', calling method: .version_select at 0x7f68e4d37280>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1103060637", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:52:42.897977 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-62589eed-62ac-4c7d-8a08-f7fa35629532 tempest-SecurityGroupRulesNegativeTestJSON-1442261563 tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project] HTTP exception thrown: Security group id should be uuid Sep 08 10:52:42.899855 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-62589eed-62ac-4c7d-8a08-f7fa35629532 tempest-SecurityGroupRulesNegativeTestJSON-1442261563 tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project] Request method failure captured: Sep 08 10:52:42.899855 n-d-850501-12 devstack@n-api.service[128861]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 08 10:52:42.899855 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:52:42.899855 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:52:42.899855 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:52:42.899855 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 131 Sep 08 10:52:42.899855 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:52:42.899855 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:52:42.899855 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:52:42.899855 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:52:42.899855 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGclyAHM1CdE3uifryK7AYCqguA-SzzJIjV_K3jxBkp95zXKVXns1yyqrlpfBFYOGtnuKZHVLAPSpOvGRQERgiEdFsVHnDK6iQuMnpzAXwkv43kPoKS4Oypu5j2Kf2ml4CRSehBNNyJlPVILXoBjvCE3nlCjlkL2Lc5cm1Z9Z8sHbjw4 Sep 08 10:52:42.899855 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:52:42.899855 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:52:42.899855 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:52:42.899855 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:52:42.899855 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:52:42.899855 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:52:42.899855 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 8d0c595184ce4facb1e697088384222f Sep 08 10:52:42.899855 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1442261563 Sep 08 10:52:42.899855 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:52:42.899855 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:52:42.899855 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8d0c595184ce4facb1e697088384222f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8d0c595184ce4facb1e697088384222f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8d0c595184ce4facb1e697088384222f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8d0c595184ce4facb1e697088384222f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:52:42.899855 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1442261563 Sep 08 10:52:42.899855 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 8d0c595184ce4facb1e697088384222f Sep 08 10:52:42.899855 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1442261563 Sep 08 10:52:42.899855 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project Sep 08 10:52:42.899855 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:52:42.899855 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:52:42.899855 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 1a7f248d8b904818a5703501c1feeffb Sep 08 10:52:42.899855 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project Sep 08 10:52:42.899855 n-d-850501-12 devstack@n-api.service[128861]: Sep 08 10:52:42.899855 n-d-850501-12 devstack@n-api.service[128861]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1103060637", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Sep 08 10:52:42.899855 n-d-850501-12 devstack@n-api.service[128861]: method: Sep 08 10:52:42.899855 n-d-850501-12 devstack@n-api.service[128861]: exception: Security group id should be uuid Sep 08 10:52:42.899855 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1103060637', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Sep 08 10:52:42.899855 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:52:42.899855 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:42.899855 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Sep 08 10:52:42.899855 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Sep 08 10:52:42.899855 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Sep 08 10:52:42.899855 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Sep 08 10:52:42.899855 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Sep 08 10:52:42.899855 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:52:42.899855 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:52:42.899855 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:52:42.899855 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:42.899855 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:52:42.899855 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:52:42.899855 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:52:42.899855 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:52:42.899855 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:52:42.899855 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:52:42.899855 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:52:42.899855 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:52:42.899855 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 08 10:52:42.899855 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 08 10:52:42.899855 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Sep 08 10:52:42.899855 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:52:42.899855 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:52:42.899855 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:52:42.899855 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:42.899855 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:52:42.899855 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:52:42.899855 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:52:42.899855 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:52:42.907354 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Sep 08 10:52:42.907354 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:52:42.909191 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-62589eed-62ac-4c7d-8a08-f7fa35629532 tempest-SecurityGroupRulesNegativeTestJSON-1442261563 tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project] Returning 400 to user: Security group id should be uuid {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:52:42.910963 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-62589eed-62ac-4c7d-8a08-f7fa35629532 tempest-SecurityGroupRulesNegativeTestJSON-1442261563 tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.019916 Sep 08 10:52:42.921610 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1683/3355] 10.222.0.27 () {60 vars in 1195 bytes} [Thu Sep 8 10:52:42 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 08 10:52:42.931039 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-16531ee6-5866-4241-9722-6a4f76267d71 tempest-SecurityGroupRulesNegativeTestJSON-1442261563 tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project] Action: 'create', calling method: .version_select at 0x7f68e4e7f040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-841034732", "description": "tempest-description-473221687"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:52:43.061332 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a09a9f68-5051-4787-bcef-c4b3020fcd77 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:43.071181 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a09a9f68-5051-4787-bcef-c4b3020fcd77 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d" status: 200 len: 1522 microversion: 2.1 time: 1.066305 Sep 08 10:52:43.091465 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1673/3356] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:42 2022] GET /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d => generated 1522 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:43.102680 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-52de6c50-82a9-414a-bbf3-3a2dfdf87f04 req-0abfaaf6-b3a9-47fc-8200-d1bef608a142 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a2deb39-1e14-4009-a813-70141de75879", "tag": "d70fc082-1f91-4375-a1da-066df7bba089"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:52:43.119139 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:52:43.151922 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-52de6c50-82a9-414a-bbf3-3a2dfdf87f04 req-0abfaaf6-b3a9-47fc-8200-d1bef608a142 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:43.153775 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-52de6c50-82a9-414a-bbf3-3a2dfdf87f04 req-0abfaaf6-b3a9-47fc-8200-d1bef608a142 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:43.154980 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-52de6c50-82a9-414a-bbf3-3a2dfdf87f04 req-0abfaaf6-b3a9-47fc-8200-d1bef608a142 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:43.185896 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-52de6c50-82a9-414a-bbf3-3a2dfdf87f04 req-0abfaaf6-b3a9-47fc-8200-d1bef608a142 service nova] Creating event network-changed:d70fc082-1f91-4375-a1da-066df7bba089 for instance 0a2deb39-1e14-4009-a813-70141de75879 on n-h1-850501-12 Sep 08 10:52:43.192567 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-52de6c50-82a9-414a-bbf3-3a2dfdf87f04 req-0abfaaf6-b3a9-47fc-8200-d1bef608a142 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098778 Sep 08 10:52:43.193776 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1674/3357] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:52:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:52:43.200999 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-53e7528c-4c3f-469b-ae33-c02c8b3e947c tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:43.202075 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-53e7528c-4c3f-469b-ae33-c02c8b3e947c tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] [instance: 0a2deb39-1e14-4009-a813-70141de75879] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:43.217051 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53e7528c-4c3f-469b-ae33-c02c8b3e947c tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:43.220840 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53e7528c-4c3f-469b-ae33-c02c8b3e947c tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:43.223264 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53e7528c-4c3f-469b-ae33-c02c8b3e947c tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:43.225446 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53e7528c-4c3f-469b-ae33-c02c8b3e947c tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:43.225943 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53e7528c-4c3f-469b-ae33-c02c8b3e947c tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:43.230558 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53e7528c-4c3f-469b-ae33-c02c8b3e947c tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:43.552252 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-53e7528c-4c3f-469b-ae33-c02c8b3e947c tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1502b3b00c449399ac35378281d992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df398bd0b3f45e9b11fe4212d6b5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:43.568652 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-53e7528c-4c3f-469b-ae33-c02c8b3e947c tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] 10.222.0.27 "GET /compute/v2.1/servers/0a2deb39-1e14-4009-a813-70141de75879" status: 200 len: 1313 microversion: 2.1 time: 0.372521 Sep 08 10:52:43.569933 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1675/3358] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:43 2022] GET /compute/v2.1/servers/0a2deb39-1e14-4009-a813-70141de75879 => generated 1313 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:43.579696 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ea5d1f9b-e9fd-41af-ba3d-a8a8ff63ecb4 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Calling method '.version_select at 0x7f68e424e0d0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:43.584895 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-16531ee6-5866-4241-9722-6a4f76267d71 tempest-SecurityGroupRulesNegativeTestJSON-1442261563 tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.661754 Sep 08 10:52:43.589233 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1684/3359] 10.222.0.27 () {60 vars in 1180 bytes} [Thu Sep 8 10:52:42 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:52:43.600430 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-122bae03-e0b1-499c-9c51-e139373c5106 tempest-SecurityGroupRulesNegativeTestJSON-1442261563 tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project] Action: 'create', calling method: .version_select at 0x7f68e4be85e0>, body: {"security_group_rule": {"parent_group_id": "d64ff47b-9de0-4c7a-be2a-63b4126383e8", "ip_protocol": "tempest-999-81961075", "from_port": 22, "to_port": 22}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:52:43.620426 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-ea5d1f9b-e9fd-41af-ba3d-a8a8ff63ecb4 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] HTTP exception thrown: Image not found. Sep 08 10:52:43.622386 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ea5d1f9b-e9fd-41af-ba3d-a8a8ff63ecb4 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Request method failure captured: Sep 08 10:52:43.622386 n-d-850501-12 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/images/9cb0d711-236c-40a1-bec2-41269d0365c2 HTTP/1.1 Sep 08 10:52:43.622386 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:52:43.622386 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:52:43.622386 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:52:43.622386 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:52:43.622386 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:52:43.622386 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:52:43.622386 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:52:43.622386 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:52:43.622386 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcjivLUY-NOpubj4piWQUE4YdjVoieEQ-G0L0ay9l2jNqBIueJ_eB4w8-Iohm-hEbdImfT6Vv0CotgGIogaerBRfcTAAw-NhjLbx2EjcqsYLMFxCPLjOPfzXaEWWRNcumoyYDLdNDrrGczsG7GBIlwK26oqS5wWNAPkM7DBSBKGgOFQ Sep 08 10:52:43.622386 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:52:43.622386 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:52:43.622386 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:52:43.622386 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:52:43.622386 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:52:43.622386 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:52:43.622386 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 50c3752f739b47a296a5b88948fe7f7f Sep 08 10:52:43.622386 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1836029851 Sep 08 10:52:43.622386 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:52:43.622386 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:52:43.622386 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/50c3752f739b47a296a5b88948fe7f7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/50c3752f739b47a296a5b88948fe7f7f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_50c3752f739b47a296a5b88948fe7f7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/50c3752f739b47a296a5b88948fe7f7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:52:43.622386 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1836029851 Sep 08 10:52:43.622386 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 50c3752f739b47a296a5b88948fe7f7f Sep 08 10:52:43.622386 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1836029851 Sep 08 10:52:43.622386 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ImagesOneServerNegativeTestJSON-1836029851-project Sep 08 10:52:43.622386 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:52:43.622386 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:52:43.622386 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 7c86e8bd6f9048ce8718f432e51128a5 Sep 08 10:52:43.622386 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1836029851-project Sep 08 10:52:43.622386 n-d-850501-12 devstack@n-api.service[128862]: method: Sep 08 10:52:43.622386 n-d-850501-12 devstack@n-api.service[128862]: exception: Image not found. Sep 08 10:52:43.622386 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '9cb0d711-236c-40a1-bec2-41269d0365c2'} Sep 08 10:52:43.622386 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:52:43.622386 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:43.622386 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 08 10:52:43.622386 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 08 10:52:43.622386 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 10:52:43.622386 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 10:52:43.622386 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 10:52:43.622386 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 10:52:43.622386 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 08 10:52:43.622386 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 08 10:52:43.622386 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 08 10:52:43.622386 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 08 10:52:43.622386 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 10:52:43.622386 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 10:52:43.622386 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 10:52:43.622386 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 10:52:43.622386 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 9cb0d711-236c-40a1-bec2-41269d0365c2 to delete Sep 08 10:52:43.622386 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:43.622386 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:52:43.622386 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:43.622386 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:43.622386 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 08 10:52:43.622386 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 08 10:52:43.622386 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 08 10:52:43.622386 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 08 10:52:43.622386 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 08 10:52:43.622386 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 08 10:52:43.622386 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9cb0d711-236c-40a1-bec2-41269d0365c2 could not be found. Sep 08 10:52:43.622386 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:43.622386 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:52:43.622386 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:43.629186 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:43.629186 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:52:43.629186 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:52:43.629186 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:52:43.629186 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:52:43.629186 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:52:43.629186 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:52:43.629186 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:52:43.629186 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:52:43.629186 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 08 10:52:43.629186 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 08 10:52:43.629186 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 08 10:52:43.629186 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:43.629186 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:52:43.629186 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:43.629186 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:43.629186 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:52:43.629186 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:52:43.629186 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:52:43.629186 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:52:43.629186 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 08 10:52:43.629186 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:43.629186 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ea5d1f9b-e9fd-41af-ba3d-a8a8ff63ecb4 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Returning 404 to user: Image not found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:52:43.629186 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ea5d1f9b-e9fd-41af-ba3d-a8a8ff63ecb4 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "DELETE /compute/v2.1/images/9cb0d711-236c-40a1-bec2-41269d0365c2" status: 404 len: 62 microversion: 2.1 time: 0.053171 Sep 08 10:52:43.629186 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1676/3360] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:43 2022] DELETE /compute/v2.1/images/9cb0d711-236c-40a1-bec2-41269d0365c2 => generated 62 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:52:43.640458 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6275daac-f58b-46c3-930d-0b2a930accca tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:43.641593 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6275daac-f58b-46c3-930d-0b2a930accca tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: 13b25df0-d58e-4da2-bcea-6dac80800bab] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:43.653654 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6275daac-f58b-46c3-930d-0b2a930accca tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:43.654860 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6275daac-f58b-46c3-930d-0b2a930accca tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:43.655599 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6275daac-f58b-46c3-930d-0b2a930accca tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:43.656852 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6275daac-f58b-46c3-930d-0b2a930accca tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:43.658636 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6275daac-f58b-46c3-930d-0b2a930accca tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:43.659430 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6275daac-f58b-46c3-930d-0b2a930accca tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:43.686573 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-6275daac-f58b-46c3-930d-0b2a930accca tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] HTTP exception thrown: Instance 13b25df0-d58e-4da2-bcea-6dac80800bab could not be found. Sep 08 10:52:43.690612 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6275daac-f58b-46c3-930d-0b2a930accca tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Request method failure captured: Sep 08 10:52:43.690612 n-d-850501-12 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/servers/13b25df0-d58e-4da2-bcea-6dac80800bab HTTP/1.1 Sep 08 10:52:43.690612 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:52:43.690612 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:52:43.690612 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:52:43.690612 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:52:43.690612 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:52:43.690612 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:52:43.690612 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:52:43.690612 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:52:43.690612 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcjivLUY-NOpubj4piWQUE4YdjVoieEQ-G0L0ay9l2jNqBIueJ_eB4w8-Iohm-hEbdImfT6Vv0CotgGIogaerBRfcTAAw-NhjLbx2EjcqsYLMFxCPLjOPfzXaEWWRNcumoyYDLdNDrrGczsG7GBIlwK26oqS5wWNAPkM7DBSBKGgOFQ Sep 08 10:52:43.690612 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:52:43.690612 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:52:43.690612 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:52:43.690612 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:52:43.690612 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:52:43.690612 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:52:43.690612 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 50c3752f739b47a296a5b88948fe7f7f Sep 08 10:52:43.690612 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1836029851 Sep 08 10:52:43.690612 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:52:43.690612 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:52:43.690612 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/50c3752f739b47a296a5b88948fe7f7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/50c3752f739b47a296a5b88948fe7f7f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_50c3752f739b47a296a5b88948fe7f7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/50c3752f739b47a296a5b88948fe7f7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:52:43.690612 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1836029851 Sep 08 10:52:43.690612 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 50c3752f739b47a296a5b88948fe7f7f Sep 08 10:52:43.690612 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1836029851 Sep 08 10:52:43.690612 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ImagesOneServerNegativeTestJSON-1836029851-project Sep 08 10:52:43.690612 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:52:43.690612 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:52:43.690612 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 7c86e8bd6f9048ce8718f432e51128a5 Sep 08 10:52:43.690612 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1836029851-project Sep 08 10:52:43.690612 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:52:43.690612 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 13b25df0-d58e-4da2-bcea-6dac80800bab could not be found. Sep 08 10:52:43.690612 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '13b25df0-d58e-4da2-bcea-6dac80800bab'} Sep 08 10:52:43.690612 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:52:43.690612 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:43.690612 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:52:43.690612 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:52:43.690612 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:52:43.690612 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:52:43.690612 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:52:43.690612 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:52:43.690612 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:52:43.690612 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:52:43.690612 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13b25df0-d58e-4da2-bcea-6dac80800bab could not be found. Sep 08 10:52:43.690612 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:43.690612 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:52:43.690612 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:43.690612 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:43.690612 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:52:43.690612 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:52:43.690612 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:52:43.690612 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:52:43.690612 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:52:43.690612 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:52:43.690612 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:52:43.690612 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:52:43.690612 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:52:43.690612 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:52:43.690612 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:52:43.690612 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:52:43.690612 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:52:43.690612 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:52:43.699356 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13b25df0-d58e-4da2-bcea-6dac80800bab could not be found. Sep 08 10:52:43.699356 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:43.699356 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:52:43.699356 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:43.699356 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:43.699356 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:52:43.699356 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:52:43.699356 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:52:43.699356 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:52:43.699356 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13b25df0-d58e-4da2-bcea-6dac80800bab could not be found. Sep 08 10:52:43.699356 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:43.699356 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6275daac-f58b-46c3-930d-0b2a930accca tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Returning 404 to user: Instance 13b25df0-d58e-4da2-bcea-6dac80800bab could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:52:43.702519 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6275daac-f58b-46c3-930d-0b2a930accca tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "DELETE /compute/v2.1/servers/13b25df0-d58e-4da2-bcea-6dac80800bab" status: 404 len: 111 microversion: 2.1 time: 0.066543 Sep 08 10:52:43.702519 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1677/3361] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:52:43 2022] DELETE /compute/v2.1/servers/13b25df0-d58e-4da2-bcea-6dac80800bab => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:52:43.716078 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cb872f8c-787f-435f-9ecb-5c103a8f1cc9 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:43.716752 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cb872f8c-787f-435f-9ecb-5c103a8f1cc9 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] [instance: 13b25df0-d58e-4da2-bcea-6dac80800bab] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:43.723424 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb872f8c-787f-435f-9ecb-5c103a8f1cc9 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:43.724277 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb872f8c-787f-435f-9ecb-5c103a8f1cc9 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:43.724981 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb872f8c-787f-435f-9ecb-5c103a8f1cc9 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:43.725974 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb872f8c-787f-435f-9ecb-5c103a8f1cc9 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:43.726659 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb872f8c-787f-435f-9ecb-5c103a8f1cc9 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:43.727311 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb872f8c-787f-435f-9ecb-5c103a8f1cc9 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:43.733475 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:52:43.746186 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-cb872f8c-787f-435f-9ecb-5c103a8f1cc9 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] HTTP exception thrown: Instance 13b25df0-d58e-4da2-bcea-6dac80800bab could not be found. Sep 08 10:52:43.748266 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cb872f8c-787f-435f-9ecb-5c103a8f1cc9 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Request method failure captured: Sep 08 10:52:43.748266 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/13b25df0-d58e-4da2-bcea-6dac80800bab HTTP/1.1 Sep 08 10:52:43.748266 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:52:43.748266 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:52:43.748266 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:52:43.748266 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:52:43.748266 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:52:43.748266 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:52:43.748266 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:52:43.748266 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:52:43.748266 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcjivLUY-NOpubj4piWQUE4YdjVoieEQ-G0L0ay9l2jNqBIueJ_eB4w8-Iohm-hEbdImfT6Vv0CotgGIogaerBRfcTAAw-NhjLbx2EjcqsYLMFxCPLjOPfzXaEWWRNcumoyYDLdNDrrGczsG7GBIlwK26oqS5wWNAPkM7DBSBKGgOFQ Sep 08 10:52:43.748266 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:52:43.748266 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:52:43.748266 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:52:43.748266 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:52:43.748266 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:52:43.748266 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:52:43.748266 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 50c3752f739b47a296a5b88948fe7f7f Sep 08 10:52:43.748266 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1836029851 Sep 08 10:52:43.748266 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:52:43.748266 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:52:43.748266 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/50c3752f739b47a296a5b88948fe7f7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/50c3752f739b47a296a5b88948fe7f7f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_50c3752f739b47a296a5b88948fe7f7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/50c3752f739b47a296a5b88948fe7f7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:52:43.748266 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1836029851 Sep 08 10:52:43.748266 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 50c3752f739b47a296a5b88948fe7f7f Sep 08 10:52:43.748266 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1836029851 Sep 08 10:52:43.748266 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ImagesOneServerNegativeTestJSON-1836029851-project Sep 08 10:52:43.748266 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:52:43.748266 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:52:43.748266 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 7c86e8bd6f9048ce8718f432e51128a5 Sep 08 10:52:43.748266 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1836029851-project Sep 08 10:52:43.748266 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:52:43.748266 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 13b25df0-d58e-4da2-bcea-6dac80800bab could not be found. Sep 08 10:52:43.748266 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '13b25df0-d58e-4da2-bcea-6dac80800bab'} Sep 08 10:52:43.748266 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:52:43.748266 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:43.748266 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:52:43.748266 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:52:43.748266 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:52:43.748266 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:52:43.748266 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:52:43.748266 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:52:43.748266 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:52:43.748266 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:52:43.748266 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13b25df0-d58e-4da2-bcea-6dac80800bab could not be found. Sep 08 10:52:43.748266 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:43.748266 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:52:43.748266 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:43.748266 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:43.748266 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:52:43.748266 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:52:43.748266 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:52:43.748266 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:52:43.748266 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:52:43.748266 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:52:43.748266 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:52:43.748266 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:52:43.748266 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:52:43.748266 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:52:43.748266 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:52:43.748266 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:52:43.748266 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13b25df0-d58e-4da2-bcea-6dac80800bab could not be found. Sep 08 10:52:43.748266 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:43.748266 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:52:43.754319 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:43.754319 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:43.754319 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:52:43.754319 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:52:43.754319 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:52:43.754319 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:52:43.754319 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13b25df0-d58e-4da2-bcea-6dac80800bab could not be found. Sep 08 10:52:43.754319 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:43.754319 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cb872f8c-787f-435f-9ecb-5c103a8f1cc9 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] Returning 404 to user: Instance 13b25df0-d58e-4da2-bcea-6dac80800bab could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:52:43.755397 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cb872f8c-787f-435f-9ecb-5c103a8f1cc9 tempest-ImagesOneServerNegativeTestJSON-1836029851 tempest-ImagesOneServerNegativeTestJSON-1836029851-project] 10.222.0.27 "GET /compute/v2.1/servers/13b25df0-d58e-4da2-bcea-6dac80800bab" status: 404 len: 111 microversion: 2.1 time: 0.044136 Sep 08 10:52:43.757384 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1678/3362] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:43 2022] GET /compute/v2.1/servers/13b25df0-d58e-4da2-bcea-6dac80800bab => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:52:43.881973 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-122bae03-e0b1-499c-9c51-e139373c5106 tempest-SecurityGroupRulesNegativeTestJSON-1442261563 tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project] HTTP exception thrown: Invalid IP protocol tempest-999-81961075. Sep 08 10:52:43.884467 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-122bae03-e0b1-499c-9c51-e139373c5106 tempest-SecurityGroupRulesNegativeTestJSON-1442261563 tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project] Request method failure captured: Sep 08 10:52:43.884467 n-d-850501-12 devstack@n-api.service[128861]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 08 10:52:43.884467 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:52:43.884467 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:52:43.884467 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:52:43.884467 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 155 Sep 08 10:52:43.884467 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:52:43.884467 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:52:43.884467 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:52:43.884467 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:52:43.884467 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGclyAHM1CdE3uifryK7AYCqguA-SzzJIjV_K3jxBkp95zXKVXns1yyqrlpfBFYOGtnuKZHVLAPSpOvGRQERgiEdFsVHnDK6iQuMnpzAXwkv43kPoKS4Oypu5j2Kf2ml4CRSehBNNyJlPVILXoBjvCE3nlCjlkL2Lc5cm1Z9Z8sHbjw4 Sep 08 10:52:43.884467 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:52:43.884467 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:52:43.884467 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:52:43.884467 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:52:43.884467 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:52:43.884467 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:52:43.884467 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 8d0c595184ce4facb1e697088384222f Sep 08 10:52:43.884467 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1442261563 Sep 08 10:52:43.884467 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:52:43.884467 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:52:43.884467 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8d0c595184ce4facb1e697088384222f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8d0c595184ce4facb1e697088384222f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8d0c595184ce4facb1e697088384222f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8d0c595184ce4facb1e697088384222f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:52:43.884467 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1442261563 Sep 08 10:52:43.884467 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 8d0c595184ce4facb1e697088384222f Sep 08 10:52:43.884467 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1442261563 Sep 08 10:52:43.884467 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project Sep 08 10:52:43.884467 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:52:43.884467 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:52:43.884467 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 1a7f248d8b904818a5703501c1feeffb Sep 08 10:52:43.884467 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project Sep 08 10:52:43.884467 n-d-850501-12 devstack@n-api.service[128861]: Sep 08 10:52:43.884467 n-d-850501-12 devstack@n-api.service[128861]: {"security_group_rule": {"parent_group_id": "d64ff47b-9de0-4c7a-be2a-63b4126383e8", "ip_protocol": "tempest-999-81961075", "from_port": 22, "to_port": 22}} Sep 08 10:52:43.884467 n-d-850501-12 devstack@n-api.service[128861]: method: Sep 08 10:52:43.884467 n-d-850501-12 devstack@n-api.service[128861]: exception: Invalid IP protocol tempest-999-81961075. Sep 08 10:52:43.884467 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'd64ff47b-9de0-4c7a-be2a-63b4126383e8', 'ip_protocol': 'tempest-999-81961075', 'from_port': 22, 'to_port': 22}}} Sep 08 10:52:43.884467 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:52:43.884467 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:43.884467 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 08 10:52:43.884467 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 08 10:52:43.884467 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 08 10:52:43.884467 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 08 10:52:43.884467 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 08 10:52:43.884467 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 08 10:52:43.884467 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Sep 08 10:52:43.884467 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Sep 08 10:52:43.884467 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-81961075. Sep 08 10:52:43.884467 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:52:43.884467 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:52:43.884467 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:52:43.884467 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:43.884467 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:52:43.884467 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:52:43.884467 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:52:43.884467 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:52:43.884467 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:52:43.884467 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:52:43.884467 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:52:43.884467 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:52:43.884467 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 08 10:52:43.884467 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 08 10:52:43.884467 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-81961075. Sep 08 10:52:43.884467 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:52:43.884467 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:52:43.888716 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:52:43.888716 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:43.888716 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:52:43.888716 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:52:43.888716 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:52:43.888716 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:52:43.888716 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-81961075. Sep 08 10:52:43.888716 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:52:43.892129 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-122bae03-e0b1-499c-9c51-e139373c5106 tempest-SecurityGroupRulesNegativeTestJSON-1442261563 tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project] Returning 400 to user: Invalid IP protocol tempest-999-81961075. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:52:43.894069 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-122bae03-e0b1-499c-9c51-e139373c5106 tempest-SecurityGroupRulesNegativeTestJSON-1442261563 tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 85 microversion: 2.1 time: 0.297132 Sep 08 10:52:43.895475 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1685/3363] 10.222.0.27 () {60 vars in 1195 bytes} [Thu Sep 8 10:52:43 2022] POST /compute/v2.1/os-security-group-rules => generated 85 bytes in 300 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Sep 08 10:52:43.908553 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d9bd8846-41f0-4bdd-9428-cebe33aa220b tempest-SecurityGroupRulesNegativeTestJSON-1442261563 tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project] Action: 'create', calling method: .version_select at 0x7f68e8a92ee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-2132101697", "description": "tempest-description-1286261700"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:52:44.108250 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-08cd82e8-2f56-4977-bbde-dfd4214151fc tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:44.111259 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-08cd82e8-2f56-4977-bbde-dfd4214151fc tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: a882cf75-539a-45fa-ae2b-4e0f043b340d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:44.143691 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-08cd82e8-2f56-4977-bbde-dfd4214151fc tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:44.144644 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-08cd82e8-2f56-4977-bbde-dfd4214151fc tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:44.145608 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-08cd82e8-2f56-4977-bbde-dfd4214151fc tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:44.146507 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-08cd82e8-2f56-4977-bbde-dfd4214151fc tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:44.147141 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-08cd82e8-2f56-4977-bbde-dfd4214151fc tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:44.147845 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-08cd82e8-2f56-4977-bbde-dfd4214151fc tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:44.463320 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d9bd8846-41f0-4bdd-9428-cebe33aa220b tempest-SecurityGroupRulesNegativeTestJSON-1442261563 tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.560507 Sep 08 10:52:44.476132 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1679/3364] 10.222.0.27 () {60 vars in 1180 bytes} [Thu Sep 8 10:52:43 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:52:44.488287 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-406c637f-0a5f-4f58-9b16-2f39ab975151 tempest-SecurityGroupRulesNegativeTestJSON-1442261563 tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project] Action: 'create', calling method: .version_select at 0x7f68e8a92d30>, body: {"security_group_rule": {"parent_group_id": "2d32f428-15ff-4909-b426-50248cc01205", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:52:44.579705 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-406c637f-0a5f-4f58-9b16-2f39ab975151 tempest-SecurityGroupRulesNegativeTestJSON-1442261563 tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Sep 08 10:52:44.585792 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-406c637f-0a5f-4f58-9b16-2f39ab975151 tempest-SecurityGroupRulesNegativeTestJSON-1442261563 tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project] Request method failure captured: Sep 08 10:52:44.585792 n-d-850501-12 devstack@n-api.service[128862]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 08 10:52:44.585792 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:52:44.585792 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:52:44.585792 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:52:44.585792 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 138 Sep 08 10:52:44.585792 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:52:44.585792 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:52:44.585792 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:52:44.585792 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:52:44.585792 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGclyAHM1CdE3uifryK7AYCqguA-SzzJIjV_K3jxBkp95zXKVXns1yyqrlpfBFYOGtnuKZHVLAPSpOvGRQERgiEdFsVHnDK6iQuMnpzAXwkv43kPoKS4Oypu5j2Kf2ml4CRSehBNNyJlPVILXoBjvCE3nlCjlkL2Lc5cm1Z9Z8sHbjw4 Sep 08 10:52:44.585792 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:52:44.585792 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:52:44.585792 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:52:44.585792 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:52:44.585792 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:52:44.585792 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:52:44.585792 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 8d0c595184ce4facb1e697088384222f Sep 08 10:52:44.585792 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1442261563 Sep 08 10:52:44.585792 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:52:44.585792 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:52:44.585792 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8d0c595184ce4facb1e697088384222f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8d0c595184ce4facb1e697088384222f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8d0c595184ce4facb1e697088384222f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8d0c595184ce4facb1e697088384222f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:52:44.585792 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1442261563 Sep 08 10:52:44.585792 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 8d0c595184ce4facb1e697088384222f Sep 08 10:52:44.585792 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1442261563 Sep 08 10:52:44.585792 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project Sep 08 10:52:44.585792 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:52:44.585792 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:52:44.585792 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 1a7f248d8b904818a5703501c1feeffb Sep 08 10:52:44.585792 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project Sep 08 10:52:44.585792 n-d-850501-12 devstack@n-api.service[128862]: Sep 08 10:52:44.585792 n-d-850501-12 devstack@n-api.service[128862]: {"security_group_rule": {"parent_group_id": "2d32f428-15ff-4909-b426-50248cc01205", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Sep 08 10:52:44.585792 n-d-850501-12 devstack@n-api.service[128862]: method: Sep 08 10:52:44.585792 n-d-850501-12 devstack@n-api.service[128862]: exception: Invalid port range 22:21. Former value cannot be greater than the later Sep 08 10:52:44.585792 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'body': {'security_group_rule': {'parent_group_id': '2d32f428-15ff-4909-b426-50248cc01205', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Sep 08 10:52:44.585792 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:52:44.585792 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:44.585792 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 08 10:52:44.585792 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 08 10:52:44.585792 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 08 10:52:44.585792 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 08 10:52:44.585792 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 08 10:52:44.585792 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 08 10:52:44.585792 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Sep 08 10:52:44.585792 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Sep 08 10:52:44.585792 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Sep 08 10:52:44.585792 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:44.585792 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:52:44.585792 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:44.585792 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:44.585792 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:52:44.585792 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:52:44.585792 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:52:44.585792 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:52:44.585792 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:52:44.585792 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:52:44.585792 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:52:44.585792 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:52:44.585792 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 08 10:52:44.585792 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 08 10:52:44.585792 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Sep 08 10:52:44.585792 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:44.601626 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:52:44.601626 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:44.601626 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:44.601626 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:52:44.601626 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:52:44.601626 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:52:44.601626 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:52:44.601626 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Sep 08 10:52:44.601626 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:44.607693 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-08cd82e8-2f56-4977-bbde-dfd4214151fc tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:44.609867 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-406c637f-0a5f-4f58-9b16-2f39ab975151 tempest-SecurityGroupRulesNegativeTestJSON-1442261563 tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:52:44.611745 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-08cd82e8-2f56-4977-bbde-dfd4214151fc tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d" status: 200 len: 1522 microversion: 2.1 time: 0.510511 Sep 08 10:52:44.625469 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1686/3365] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:44 2022] GET /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d => generated 1522 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:44.625469 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c73f6147-c04c-4764-9100-3df1d592493d tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:44.625469 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c73f6147-c04c-4764-9100-3df1d592493d tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] [instance: 0a2deb39-1e14-4009-a813-70141de75879] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:44.625469 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:52:44.639665 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c73f6147-c04c-4764-9100-3df1d592493d tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:44.645372 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c73f6147-c04c-4764-9100-3df1d592493d tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:44.647178 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-406c637f-0a5f-4f58-9b16-2f39ab975151 tempest-SecurityGroupRulesNegativeTestJSON-1442261563 tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.162076 Sep 08 10:52:44.650268 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1680/3366] 10.222.0.27 () {60 vars in 1195 bytes} [Thu Sep 8 10:52:44 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 166 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:52:44.653989 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c73f6147-c04c-4764-9100-3df1d592493d tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:44.663939 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c73f6147-c04c-4764-9100-3df1d592493d tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:44.664699 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c73f6147-c04c-4764-9100-3df1d592493d tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:44.668564 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c73f6147-c04c-4764-9100-3df1d592493d tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:44.673906 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ccfd8edf-bf8e-43ad-a0e6-56d5fdd697dc tempest-SecurityGroupRulesNegativeTestJSON-1442261563 tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project] Action: 'create', calling method: .version_select at 0x7f68e424ec10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1805657268", "description": "tempest-description-1788325713"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:52:45.040756 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c73f6147-c04c-4764-9100-3df1d592493d tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1502b3b00c449399ac35378281d992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df398bd0b3f45e9b11fe4212d6b5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:45.050327 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c73f6147-c04c-4764-9100-3df1d592493d tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] 10.222.0.27 "GET /compute/v2.1/servers/0a2deb39-1e14-4009-a813-70141de75879" status: 200 len: 1313 microversion: 2.1 time: 0.437166 Sep 08 10:52:45.051522 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1687/3367] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:44 2022] GET /compute/v2.1/servers/0a2deb39-1e14-4009-a813-70141de75879 => generated 1313 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:45.266418 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-eb01dd0f-f2ad-4b8e-8429-327f6bd86b09 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-2140933666", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "9b985b6c-8cab-4bb8-8ec5-91dd022aec51"}]}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:52:45.300294 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ccfd8edf-bf8e-43ad-a0e6-56d5fdd697dc tempest-SecurityGroupRulesNegativeTestJSON-1442261563 tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.644005 Sep 08 10:52:45.313584 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1681/3368] 10.222.0.27 () {60 vars in 1180 bytes} [Thu Sep 8 10:52:44 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:52:45.330542 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fca82a67-2ec1-4c43-8254-aec34d1e256a tempest-SecurityGroupRulesNegativeTestJSON-1442261563 tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project] Action: 'create', calling method: .version_select at 0x7f68e4217280>, body: {"security_group_rule": {"parent_group_id": "a8050f18-e986-4228-8568-d9dd63c2084f", "ip_protocol": "tcp", "from_port": 22, "to_port": 472041875}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:52:45.351173 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-eb01dd0f-f2ad-4b8e-8429-327f6bd86b09 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] validate_networks() for [('9b985b6c-8cab-4bb8-8ec5-91dd022aec51', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:52:45.431158 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-fca82a67-2ec1-4c43-8254-aec34d1e256a tempest-SecurityGroupRulesNegativeTestJSON-1442261563 tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project] HTTP exception thrown: Invalid port range 22:472041875. Valid TCP ports should be between 1-65535 Sep 08 10:52:45.434698 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fca82a67-2ec1-4c43-8254-aec34d1e256a tempest-SecurityGroupRulesNegativeTestJSON-1442261563 tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project] Request method failure captured: Sep 08 10:52:45.434698 n-d-850501-12 devstack@n-api.service[128862]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 08 10:52:45.434698 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:52:45.434698 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:52:45.434698 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:52:45.434698 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 145 Sep 08 10:52:45.434698 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:52:45.434698 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:52:45.434698 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:52:45.434698 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:52:45.434698 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGclyAHM1CdE3uifryK7AYCqguA-SzzJIjV_K3jxBkp95zXKVXns1yyqrlpfBFYOGtnuKZHVLAPSpOvGRQERgiEdFsVHnDK6iQuMnpzAXwkv43kPoKS4Oypu5j2Kf2ml4CRSehBNNyJlPVILXoBjvCE3nlCjlkL2Lc5cm1Z9Z8sHbjw4 Sep 08 10:52:45.434698 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:52:45.434698 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:52:45.434698 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:52:45.434698 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:52:45.434698 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:52:45.434698 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:52:45.434698 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 8d0c595184ce4facb1e697088384222f Sep 08 10:52:45.434698 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1442261563 Sep 08 10:52:45.434698 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:52:45.434698 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:52:45.434698 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8d0c595184ce4facb1e697088384222f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8d0c595184ce4facb1e697088384222f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8d0c595184ce4facb1e697088384222f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8d0c595184ce4facb1e697088384222f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:52:45.434698 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1442261563 Sep 08 10:52:45.434698 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 8d0c595184ce4facb1e697088384222f Sep 08 10:52:45.434698 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1442261563 Sep 08 10:52:45.434698 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project Sep 08 10:52:45.434698 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:52:45.434698 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:52:45.434698 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 1a7f248d8b904818a5703501c1feeffb Sep 08 10:52:45.434698 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project Sep 08 10:52:45.434698 n-d-850501-12 devstack@n-api.service[128862]: Sep 08 10:52:45.434698 n-d-850501-12 devstack@n-api.service[128862]: {"security_group_rule": {"parent_group_id": "a8050f18-e986-4228-8568-d9dd63c2084f", "ip_protocol": "tcp", "from_port": 22, "to_port": 472041875}} Sep 08 10:52:45.434698 n-d-850501-12 devstack@n-api.service[128862]: method: Sep 08 10:52:45.434698 n-d-850501-12 devstack@n-api.service[128862]: exception: Invalid port range 22:472041875. Valid TCP ports should be between 1-65535 Sep 08 10:52:45.434698 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'a8050f18-e986-4228-8568-d9dd63c2084f', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 472041875}}} Sep 08 10:52:45.434698 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:52:45.434698 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:45.434698 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 08 10:52:45.434698 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 08 10:52:45.434698 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 08 10:52:45.434698 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 08 10:52:45.434698 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 08 10:52:45.434698 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 08 10:52:45.434698 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Sep 08 10:52:45.434698 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Sep 08 10:52:45.434698 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:472041875. Valid TCP ports should be between 1-65535 Sep 08 10:52:45.434698 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:45.434698 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:52:45.434698 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:45.434698 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:45.434698 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:52:45.434698 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:52:45.434698 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:52:45.434698 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:52:45.434698 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:52:45.434698 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:52:45.434698 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:52:45.434698 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:52:45.434698 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 08 10:52:45.434698 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 08 10:52:45.434698 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:472041875. Valid TCP ports should be between 1-65535 Sep 08 10:52:45.434698 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:45.439165 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:52:45.439165 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:45.439165 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:45.439165 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:52:45.439165 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:52:45.439165 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:52:45.439165 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:52:45.439165 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:472041875. Valid TCP ports should be between 1-65535 Sep 08 10:52:45.439165 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:45.441270 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fca82a67-2ec1-4c43-8254-aec34d1e256a tempest-SecurityGroupRulesNegativeTestJSON-1442261563 tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project] Returning 400 to user: Invalid port range 22:472041875. Valid TCP ports should be between 1-65535 {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:52:45.442371 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fca82a67-2ec1-4c43-8254-aec34d1e256a tempest-SecurityGroupRulesNegativeTestJSON-1442261563 tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.124559 Sep 08 10:52:45.449709 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1682/3369] 10.222.0.27 () {60 vars in 1195 bytes} [Thu Sep 8 10:52:45 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 133 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:52:45.455168 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f80e558a-ea62-43b3-89a8-352cce374ebf tempest-SecurityGroupRulesNegativeTestJSON-1442261563 tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project] Action: 'create', calling method: .version_select at 0x7f68e424e940>, body: {"security_group_rule": {"parent_group_id": "6dbd07e5-bc8c-45f0-b92c-fee27920ec85", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:52:45.484138 n-d-850501-12 devstack@n-api.service[128862]: DEBUG neutronclient.v2_0.client [None req-f80e558a-ea62-43b3-89a8-352cce374ebf tempest-SecurityGroupRulesNegativeTestJSON-1442261563 tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6dbd07e5-bc8c-45f0-b92c-fee27920ec85 does not exist", "detail": ""}} {{(pid=128862) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 08 10:52:45.485881 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.security_group_api [None req-f80e558a-ea62-43b3-89a8-352cce374ebf tempest-SecurityGroupRulesNegativeTestJSON-1442261563 tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project] Neutron security group 6dbd07e5-bc8c-45f0-b92c-fee27920ec85 not found {{(pid=128862) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 08 10:52:45.486664 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-f80e558a-ea62-43b3-89a8-352cce374ebf tempest-SecurityGroupRulesNegativeTestJSON-1442261563 tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project] HTTP exception thrown: Security group 6dbd07e5-bc8c-45f0-b92c-fee27920ec85 does not exist Sep 08 10:52:45.486664 n-d-850501-12 devstack@n-api.service[128862]: Neutron server returns request_ids: ['req-d2ab5a4b-cb03-4d18-b037-b64cc50ac446'] Sep 08 10:52:45.489276 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f80e558a-ea62-43b3-89a8-352cce374ebf tempest-SecurityGroupRulesNegativeTestJSON-1442261563 tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project] Request method failure captured: Sep 08 10:52:45.489276 n-d-850501-12 devstack@n-api.service[128862]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 08 10:52:45.489276 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:52:45.489276 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:52:45.489276 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:52:45.489276 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 138 Sep 08 10:52:45.489276 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:52:45.489276 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:52:45.489276 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:52:45.489276 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:52:45.489276 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGclyAHM1CdE3uifryK7AYCqguA-SzzJIjV_K3jxBkp95zXKVXns1yyqrlpfBFYOGtnuKZHVLAPSpOvGRQERgiEdFsVHnDK6iQuMnpzAXwkv43kPoKS4Oypu5j2Kf2ml4CRSehBNNyJlPVILXoBjvCE3nlCjlkL2Lc5cm1Z9Z8sHbjw4 Sep 08 10:52:45.489276 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:52:45.489276 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:52:45.489276 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:52:45.489276 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:52:45.489276 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:52:45.489276 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:52:45.489276 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 8d0c595184ce4facb1e697088384222f Sep 08 10:52:45.489276 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1442261563 Sep 08 10:52:45.489276 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:52:45.489276 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:52:45.489276 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8d0c595184ce4facb1e697088384222f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8d0c595184ce4facb1e697088384222f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8d0c595184ce4facb1e697088384222f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8d0c595184ce4facb1e697088384222f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:52:45.489276 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1442261563 Sep 08 10:52:45.489276 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 8d0c595184ce4facb1e697088384222f Sep 08 10:52:45.489276 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1442261563 Sep 08 10:52:45.489276 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project Sep 08 10:52:45.489276 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:52:45.489276 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:52:45.489276 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 1a7f248d8b904818a5703501c1feeffb Sep 08 10:52:45.489276 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project Sep 08 10:52:45.489276 n-d-850501-12 devstack@n-api.service[128862]: Sep 08 10:52:45.489276 n-d-850501-12 devstack@n-api.service[128862]: {"security_group_rule": {"parent_group_id": "6dbd07e5-bc8c-45f0-b92c-fee27920ec85", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Sep 08 10:52:45.489276 n-d-850501-12 devstack@n-api.service[128862]: method: Sep 08 10:52:45.489276 n-d-850501-12 devstack@n-api.service[128862]: exception: Security group 6dbd07e5-bc8c-45f0-b92c-fee27920ec85 does not exist Sep 08 10:52:45.489276 n-d-850501-12 devstack@n-api.service[128862]: Neutron server returns request_ids: ['req-d2ab5a4b-cb03-4d18-b037-b64cc50ac446'] Sep 08 10:52:45.489276 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'body': {'security_group_rule': {'parent_group_id': '6dbd07e5-bc8c-45f0-b92c-fee27920ec85', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Sep 08 10:52:45.489276 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:52:45.489276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:45.489276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 08 10:52:45.489276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 08 10:52:45.489276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:52:45.489276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:52:45.489276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 08 10:52:45.489276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 08 10:52:45.489276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:52:45.489276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:52:45.489276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 08 10:52:45.489276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 08 10:52:45.489276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:52:45.489276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:52:45.489276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 08 10:52:45.489276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 08 10:52:45.489276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:52:45.489276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:52:45.489276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 08 10:52:45.489276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 08 10:52:45.489276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:52:45.489276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:52:45.489276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 08 10:52:45.489276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 08 10:52:45.489276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 08 10:52:45.494899 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 08 10:52:45.494899 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6dbd07e5-bc8c-45f0-b92c-fee27920ec85 does not exist Sep 08 10:52:45.494899 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d2ab5a4b-cb03-4d18-b037-b64cc50ac446'] Sep 08 10:52:45.494899 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:45.494899 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:52:45.494899 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:45.494899 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:45.494899 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Sep 08 10:52:45.494899 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Sep 08 10:52:45.494899 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 08 10:52:45.494899 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 08 10:52:45.494899 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6dbd07e5-bc8c-45f0-b92c-fee27920ec85 does not exist Sep 08 10:52:45.494899 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d2ab5a4b-cb03-4d18-b037-b64cc50ac446'] Sep 08 10:52:45.494899 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:45.494899 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:52:45.494899 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:45.494899 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:45.494899 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:52:45.494899 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:52:45.494899 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:52:45.494899 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:52:45.494899 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:52:45.494899 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:52:45.494899 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:52:45.494899 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:52:45.494899 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Sep 08 10:52:45.494899 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 08 10:52:45.494899 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6dbd07e5-bc8c-45f0-b92c-fee27920ec85 does not exist Sep 08 10:52:45.494899 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d2ab5a4b-cb03-4d18-b037-b64cc50ac446'] Sep 08 10:52:45.494899 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:45.494899 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:52:45.494899 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:45.494899 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:45.494899 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:52:45.494899 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:52:45.494899 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:52:45.494899 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:52:45.494899 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6dbd07e5-bc8c-45f0-b92c-fee27920ec85 does not exist Sep 08 10:52:45.494899 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d2ab5a4b-cb03-4d18-b037-b64cc50ac446'] Sep 08 10:52:45.494899 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:45.504606 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f80e558a-ea62-43b3-89a8-352cce374ebf tempest-SecurityGroupRulesNegativeTestJSON-1442261563 tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project] Returning 404 to user: Security group 6dbd07e5-bc8c-45f0-b92c-fee27920ec85 does not exist Sep 08 10:52:45.504606 n-d-850501-12 devstack@n-api.service[128862]: Neutron server returns request_ids: ['req-d2ab5a4b-cb03-4d18-b037-b64cc50ac446'] {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:52:45.505475 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f80e558a-ea62-43b3-89a8-352cce374ebf tempest-SecurityGroupRulesNegativeTestJSON-1442261563 tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.052498 Sep 08 10:52:45.515055 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1683/3370] 10.222.0.27 () {60 vars in 1195 bytes} [Thu Sep 8 10:52:45 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:52:45.531628 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-364e50c6-5ada-45c2-98af-cd2c9f8224b5 tempest-SecurityGroupRulesNegativeTestJSON-1442261563 tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project] Calling method '.version_select at 0x7f68e424e940>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:45.603779 n-d-850501-12 devstack@n-api.service[128862]: DEBUG neutronclient.v2_0.client [None req-364e50c6-5ada-45c2-98af-cd2c9f8224b5 tempest-SecurityGroupRulesNegativeTestJSON-1442261563 tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 648c116a-2bda-44b2-b9e8-162096725dae does not exist", "detail": ""}} {{(pid=128862) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 08 10:52:45.604458 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.security_group_api [None req-364e50c6-5ada-45c2-98af-cd2c9f8224b5 tempest-SecurityGroupRulesNegativeTestJSON-1442261563 tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project] Neutron security group rule 648c116a-2bda-44b2-b9e8-162096725dae not found {{(pid=128862) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Sep 08 10:52:45.605071 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-364e50c6-5ada-45c2-98af-cd2c9f8224b5 tempest-SecurityGroupRulesNegativeTestJSON-1442261563 tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project] HTTP exception thrown: Security group rule 648c116a-2bda-44b2-b9e8-162096725dae does not exist Sep 08 10:52:45.605071 n-d-850501-12 devstack@n-api.service[128862]: Neutron server returns request_ids: ['req-564fff6b-e6ac-4ce0-8f72-25fd0300b66f'] Sep 08 10:52:45.607224 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-364e50c6-5ada-45c2-98af-cd2c9f8224b5 tempest-SecurityGroupRulesNegativeTestJSON-1442261563 tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project] Request method failure captured: Sep 08 10:52:45.607224 n-d-850501-12 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/os-security-group-rules/648c116a-2bda-44b2-b9e8-162096725dae HTTP/1.1 Sep 08 10:52:45.607224 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:52:45.607224 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:52:45.607224 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:52:45.607224 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:52:45.607224 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:52:45.607224 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:52:45.607224 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:52:45.607224 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:52:45.607224 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGclyAHM1CdE3uifryK7AYCqguA-SzzJIjV_K3jxBkp95zXKVXns1yyqrlpfBFYOGtnuKZHVLAPSpOvGRQERgiEdFsVHnDK6iQuMnpzAXwkv43kPoKS4Oypu5j2Kf2ml4CRSehBNNyJlPVILXoBjvCE3nlCjlkL2Lc5cm1Z9Z8sHbjw4 Sep 08 10:52:45.607224 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:52:45.607224 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:52:45.607224 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:52:45.607224 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:52:45.607224 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:52:45.607224 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:52:45.607224 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 8d0c595184ce4facb1e697088384222f Sep 08 10:52:45.607224 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1442261563 Sep 08 10:52:45.607224 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:52:45.607224 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:52:45.607224 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8d0c595184ce4facb1e697088384222f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8d0c595184ce4facb1e697088384222f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8d0c595184ce4facb1e697088384222f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8d0c595184ce4facb1e697088384222f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:52:45.607224 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1442261563 Sep 08 10:52:45.607224 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 8d0c595184ce4facb1e697088384222f Sep 08 10:52:45.607224 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1442261563 Sep 08 10:52:45.607224 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project Sep 08 10:52:45.607224 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:52:45.607224 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:52:45.607224 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 1a7f248d8b904818a5703501c1feeffb Sep 08 10:52:45.607224 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project Sep 08 10:52:45.607224 n-d-850501-12 devstack@n-api.service[128862]: method: Sep 08 10:52:45.607224 n-d-850501-12 devstack@n-api.service[128862]: exception: Security group rule 648c116a-2bda-44b2-b9e8-162096725dae does not exist Sep 08 10:52:45.607224 n-d-850501-12 devstack@n-api.service[128862]: Neutron server returns request_ids: ['req-564fff6b-e6ac-4ce0-8f72-25fd0300b66f'] Sep 08 10:52:45.607224 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '648c116a-2bda-44b2-b9e8-162096725dae'} Sep 08 10:52:45.607224 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:52:45.607224 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:45.607224 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Sep 08 10:52:45.607224 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Sep 08 10:52:45.607224 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:52:45.607224 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:52:45.607224 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Sep 08 10:52:45.607224 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Sep 08 10:52:45.607224 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:52:45.607224 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:52:45.607224 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 08 10:52:45.607224 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 08 10:52:45.607224 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:52:45.607224 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:52:45.607224 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 08 10:52:45.607224 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 08 10:52:45.607224 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:52:45.607224 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:52:45.607224 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 08 10:52:45.607224 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 08 10:52:45.607224 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:52:45.607224 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:52:45.607224 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 08 10:52:45.607224 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 08 10:52:45.607224 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 08 10:52:45.607224 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 08 10:52:45.611588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 648c116a-2bda-44b2-b9e8-162096725dae does not exist Sep 08 10:52:45.611588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-564fff6b-e6ac-4ce0-8f72-25fd0300b66f'] Sep 08 10:52:45.611588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:45.611588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:52:45.611588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:45.611588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:45.611588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Sep 08 10:52:45.611588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Sep 08 10:52:45.611588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Sep 08 10:52:45.611588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 08 10:52:45.611588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 648c116a-2bda-44b2-b9e8-162096725dae does not exist Sep 08 10:52:45.611588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-564fff6b-e6ac-4ce0-8f72-25fd0300b66f'] Sep 08 10:52:45.611588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:45.611588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:52:45.611588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:45.611588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:45.611588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:52:45.611588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:52:45.611588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:52:45.611588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:52:45.611588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:52:45.611588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:52:45.611588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:52:45.611588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:52:45.611588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Sep 08 10:52:45.611588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 08 10:52:45.611588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 648c116a-2bda-44b2-b9e8-162096725dae does not exist Sep 08 10:52:45.611588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-564fff6b-e6ac-4ce0-8f72-25fd0300b66f'] Sep 08 10:52:45.611588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:45.611588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:52:45.611588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:45.611588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:45.611588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:52:45.611588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:52:45.611588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:52:45.611588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:52:45.611588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 648c116a-2bda-44b2-b9e8-162096725dae does not exist Sep 08 10:52:45.611588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-564fff6b-e6ac-4ce0-8f72-25fd0300b66f'] Sep 08 10:52:45.611588 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:45.611588 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-364e50c6-5ada-45c2-98af-cd2c9f8224b5 tempest-SecurityGroupRulesNegativeTestJSON-1442261563 tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project] Returning 404 to user: Security group rule 648c116a-2bda-44b2-b9e8-162096725dae does not exist Sep 08 10:52:45.611588 n-d-850501-12 devstack@n-api.service[128862]: Neutron server returns request_ids: ['req-564fff6b-e6ac-4ce0-8f72-25fd0300b66f'] {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:52:45.611588 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-364e50c6-5ada-45c2-98af-cd2c9f8224b5 tempest-SecurityGroupRulesNegativeTestJSON-1442261563 tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-group-rules/648c116a-2bda-44b2-b9e8-162096725dae" status: 404 len: 199 microversion: 2.1 time: 0.092138 Sep 08 10:52:45.611588 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1684/3371] 10.222.0.27 () {58 vars in 1287 bytes} [Thu Sep 8 10:52:45 2022] DELETE /compute/v2.1/os-security-group-rules/648c116a-2bda-44b2-b9e8-162096725dae => generated 199 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:52:45.618799 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d0a392c8-d7a4-4347-b731-21ec736c4789 tempest-SecurityGroupRulesNegativeTestJSON-1442261563 tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project] Calling method '.version_select at 0x7f68e425ce50>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:46.059162 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d0a392c8-d7a4-4347-b731-21ec736c4789 tempest-SecurityGroupRulesNegativeTestJSON-1442261563 tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/a8050f18-e986-4228-8568-d9dd63c2084f" status: 202 len: 0 microversion: 2.1 time: 0.444619 Sep 08 10:52:46.059793 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1685/3372] 10.222.0.27 () {58 vars in 1272 bytes} [Thu Sep 8 10:52:45 2022] DELETE /compute/v2.1/os-security-groups/a8050f18-e986-4228-8568-d9dd63c2084f => generated 0 bytes in 446 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:52:46.067952 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-691ff386-9b48-47e6-bf89-ba9776bbea15 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:46.068851 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-691ff386-9b48-47e6-bf89-ba9776bbea15 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: a882cf75-539a-45fa-ae2b-4e0f043b340d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:46.095960 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-691ff386-9b48-47e6-bf89-ba9776bbea15 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:46.096472 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-691ff386-9b48-47e6-bf89-ba9776bbea15 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:46.096914 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-691ff386-9b48-47e6-bf89-ba9776bbea15 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:46.101199 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-691ff386-9b48-47e6-bf89-ba9776bbea15 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:46.101699 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-691ff386-9b48-47e6-bf89-ba9776bbea15 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:46.102946 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-691ff386-9b48-47e6-bf89-ba9776bbea15 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:46.326699 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-691ff386-9b48-47e6-bf89-ba9776bbea15 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:46.339186 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-691ff386-9b48-47e6-bf89-ba9776bbea15 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d" status: 200 len: 1522 microversion: 2.1 time: 0.277021 Sep 08 10:52:46.339785 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1686/3373] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:46 2022] GET /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d => generated 1522 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:46.346669 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f307adac-7403-4ed8-80f0-cd877e092d6b tempest-SecurityGroupRulesNegativeTestJSON-1442261563 tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project] Calling method '.version_select at 0x7f68e425cd30>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:46.577335 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f307adac-7403-4ed8-80f0-cd877e092d6b tempest-SecurityGroupRulesNegativeTestJSON-1442261563 tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/2d32f428-15ff-4909-b426-50248cc01205" status: 202 len: 0 microversion: 2.1 time: 0.236271 Sep 08 10:52:46.578636 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1687/3374] 10.222.0.27 () {58 vars in 1272 bytes} [Thu Sep 8 10:52:46 2022] DELETE /compute/v2.1/os-security-groups/2d32f428-15ff-4909-b426-50248cc01205 => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:52:46.598647 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1cff3997-69f3-47e7-888a-5bd9ca320062 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:46.600772 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1cff3997-69f3-47e7-888a-5bd9ca320062 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] [instance: 0a2deb39-1e14-4009-a813-70141de75879] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:46.611530 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-eb01dd0f-f2ad-4b8e-8429-327f6bd86b09 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:52:46.612809 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-eb01dd0f-f2ad-4b8e-8429-327f6bd86b09 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:52:46.613734 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-eb01dd0f-f2ad-4b8e-8429-327f6bd86b09 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:52:46.614415 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-eb01dd0f-f2ad-4b8e-8429-327f6bd86b09 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:52:46.615241 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-eb01dd0f-f2ad-4b8e-8429-327f6bd86b09 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:52:46.627467 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1cff3997-69f3-47e7-888a-5bd9ca320062 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:46.627979 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1cff3997-69f3-47e7-888a-5bd9ca320062 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:46.628424 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1cff3997-69f3-47e7-888a-5bd9ca320062 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:46.629209 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1cff3997-69f3-47e7-888a-5bd9ca320062 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:46.629684 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1cff3997-69f3-47e7-888a-5bd9ca320062 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:46.630129 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1cff3997-69f3-47e7-888a-5bd9ca320062 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:46.641818 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eb01dd0f-f2ad-4b8e-8429-327f6bd86b09 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:46.642330 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eb01dd0f-f2ad-4b8e-8429-327f6bd86b09 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:46.643396 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eb01dd0f-f2ad-4b8e-8429-327f6bd86b09 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:46.644170 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eb01dd0f-f2ad-4b8e-8429-327f6bd86b09 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:46.644645 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eb01dd0f-f2ad-4b8e-8429-327f6bd86b09 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:46.645101 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eb01dd0f-f2ad-4b8e-8429-327f6bd86b09 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:46.696005 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-eb01dd0f-f2ad-4b8e-8429-327f6bd86b09 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Getting quotas for project 44bb5f5b56a2402999719f0374228ed3. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:52:46.703204 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-eb01dd0f-f2ad-4b8e-8429-327f6bd86b09 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Getting quotas for user cb2c4b351a0a4ccabbfb5438b5c535e8 and project 44bb5f5b56a2402999719f0374228ed3. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:52:46.718098 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-eb01dd0f-f2ad-4b8e-8429-327f6bd86b09 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:52:46.721203 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-eb01dd0f-f2ad-4b8e-8429-327f6bd86b09 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] [instance: 50feb7c3-9282-44b6-ad37-bf09e2d3f5a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:52:46.785826 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-eb01dd0f-f2ad-4b8e-8429-327f6bd86b09 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.586048 Sep 08 10:52:46.786734 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1688/3375] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:52:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:52:46.794893 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-575b3884-4eab-4955-90a6-960a290f93ad tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-789729315", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "93bd2ec4-37bd-4a29-88fa-5a2d674d25ec"}], "security_groups": [{"name": "tempest-securitygroup--794740747"}], "key_name": "tempest-keypair-530734782", "user_data": "}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:52:46.927831 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1cff3997-69f3-47e7-888a-5bd9ca320062 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1502b3b00c449399ac35378281d992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df398bd0b3f45e9b11fe4212d6b5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:46.937124 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1cff3997-69f3-47e7-888a-5bd9ca320062 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] 10.222.0.27 "GET /compute/v2.1/servers/0a2deb39-1e14-4009-a813-70141de75879" status: 200 len: 1313 microversion: 2.1 time: 0.355384 Sep 08 10:52:46.937726 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1688/3376] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:46 2022] GET /compute/v2.1/servers/0a2deb39-1e14-4009-a813-70141de75879 => generated 1313 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:46.945622 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-60c63f0e-ff65-4d11-8214-50ff8349ae4b tempest-SecurityGroupRulesNegativeTestJSON-1442261563 tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project] Calling method '.version_select at 0x7f68e425c790>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:46.998654 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-575b3884-4eab-4955-90a6-960a290f93ad tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] validate_networks() for [('93bd2ec4-37bd-4a29-88fa-5a2d674d25ec', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:52:47.254791 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-60c63f0e-ff65-4d11-8214-50ff8349ae4b tempest-SecurityGroupRulesNegativeTestJSON-1442261563 tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/d64ff47b-9de0-4c7a-be2a-63b4126383e8" status: 202 len: 0 microversion: 2.1 time: 0.315645 Sep 08 10:52:47.256225 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1689/3377] 10.222.0.27 () {58 vars in 1272 bytes} [Thu Sep 8 10:52:46 2022] DELETE /compute/v2.1/os-security-groups/d64ff47b-9de0-4c7a-be2a-63b4126383e8 => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:52:47.262932 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7db2aa3d-224d-4b17-8c36-4e191314d47b tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:47.267988 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7db2aa3d-224d-4b17-8c36-4e191314d47b tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] [instance: 50feb7c3-9282-44b6-ad37-bf09e2d3f5a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:47.416088 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7db2aa3d-224d-4b17-8c36-4e191314d47b tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c4b351a0a4ccabbfb5438b5c535e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bb5f5b56a2402999719f0374228ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:47.436296 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7db2aa3d-224d-4b17-8c36-4e191314d47b tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] 10.222.0.27 "GET /compute/v2.1/servers/50feb7c3-9282-44b6-ad37-bf09e2d3f5a8" status: 200 len: 1224 microversion: 2.1 time: 0.177915 Sep 08 10:52:47.437753 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1690/3378] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:47 2022] GET /compute/v2.1/servers/50feb7c3-9282-44b6-ad37-bf09e2d3f5a8 => generated 1224 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:47.449566 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-304276c9-972f-4e28-82c6-6390c7bfc84c tempest-SecurityGroupRulesNegativeTestJSON-1442261563 tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project] Calling method '.version_select at 0x7f68e8a94820>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:47.752278 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-304276c9-972f-4e28-82c6-6390c7bfc84c tempest-SecurityGroupRulesNegativeTestJSON-1442261563 tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/44674375-df78-4906-9011-0f230e9c75b8" status: 202 len: 0 microversion: 2.1 time: 0.312505 Sep 08 10:52:47.755047 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1691/3379] 10.222.0.27 () {58 vars in 1272 bytes} [Thu Sep 8 10:52:47 2022] DELETE /compute/v2.1/os-security-groups/44674375-df78-4906-9011-0f230e9c75b8 => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:52:47.772477 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0b99c4e7-60e5-4f2c-9875-c9f6c22f5cef tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:47.778061 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0b99c4e7-60e5-4f2c-9875-c9f6c22f5cef tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: a882cf75-539a-45fa-ae2b-4e0f043b340d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:47.804548 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0b99c4e7-60e5-4f2c-9875-c9f6c22f5cef tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:47.805695 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0b99c4e7-60e5-4f2c-9875-c9f6c22f5cef tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:47.806403 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0b99c4e7-60e5-4f2c-9875-c9f6c22f5cef tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:47.807199 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0b99c4e7-60e5-4f2c-9875-c9f6c22f5cef tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:47.808523 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0b99c4e7-60e5-4f2c-9875-c9f6c22f5cef tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:47.808523 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0b99c4e7-60e5-4f2c-9875-c9f6c22f5cef tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:48.145695 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0b99c4e7-60e5-4f2c-9875-c9f6c22f5cef tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:48.157710 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0b99c4e7-60e5-4f2c-9875-c9f6c22f5cef tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d" status: 200 len: 1522 microversion: 2.1 time: 0.401126 Sep 08 10:52:48.158969 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1692/3380] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:47 2022] GET /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d => generated 1522 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:48.164137 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2df602db-f11a-465c-92ef-07e72c11bb54 tempest-SecurityGroupRulesNegativeTestJSON-1442261563 tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project] Calling method '.version_select at 0x7f68e42ffdc0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:48.316072 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-575b3884-4eab-4955-90a6-960a290f93ad tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:52:48.316665 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-575b3884-4eab-4955-90a6-960a290f93ad tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:52:48.316969 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-575b3884-4eab-4955-90a6-960a290f93ad tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:52:48.317624 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-575b3884-4eab-4955-90a6-960a290f93ad tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:52:48.318215 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-575b3884-4eab-4955-90a6-960a290f93ad tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:52:48.335637 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-575b3884-4eab-4955-90a6-960a290f93ad tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:48.336845 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-575b3884-4eab-4955-90a6-960a290f93ad tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:48.339255 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-575b3884-4eab-4955-90a6-960a290f93ad tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:48.341131 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-575b3884-4eab-4955-90a6-960a290f93ad tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:48.342001 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-575b3884-4eab-4955-90a6-960a290f93ad tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:48.342675 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-575b3884-4eab-4955-90a6-960a290f93ad tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:48.375936 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-575b3884-4eab-4955-90a6-960a290f93ad tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Getting quotas for project 20f9a24cad014d7f827e8f3236dd5bae. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:52:48.386563 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-575b3884-4eab-4955-90a6-960a290f93ad tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Getting quotas for user 5c291cbe955b4ee5abc98132dda0255e and project 20f9a24cad014d7f827e8f3236dd5bae. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:52:48.421460 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-575b3884-4eab-4955-90a6-960a290f93ad tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:52:48.423824 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-575b3884-4eab-4955-90a6-960a290f93ad tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: 19604289-6d42-403f-bf74-75335e1782cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:52:48.511297 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2df602db-f11a-465c-92ef-07e72c11bb54 tempest-SecurityGroupRulesNegativeTestJSON-1442261563 tempest-SecurityGroupRulesNegativeTestJSON-1442261563-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/84692ace-2819-4120-b48c-79ff0c44e228" status: 202 len: 0 microversion: 2.1 time: 0.350702 Sep 08 10:52:48.515953 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1693/3381] 10.222.0.27 () {58 vars in 1272 bytes} [Thu Sep 8 10:52:48 2022] DELETE /compute/v2.1/os-security-groups/84692ace-2819-4120-b48c-79ff0c44e228 => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:52:48.527324 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d26fd477-23dc-4210-a96e-414d7fb61790 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:48.544766 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d26fd477-23dc-4210-a96e-414d7fb61790 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] [instance: 0a2deb39-1e14-4009-a813-70141de75879] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:48.566757 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-575b3884-4eab-4955-90a6-960a290f93ad tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.774660 Sep 08 10:52:48.572012 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1689/3382] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:52:46 2022] POST /compute/v2.1/servers => generated 401 bytes in 1784 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:52:48.589534 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d26fd477-23dc-4210-a96e-414d7fb61790 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:48.590665 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-bd9a06ee-00c0-4229-bed3-3cc91a4efb03 req-060474ca-40ce-4640-9165-994d8c9faa32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a2deb39-1e14-4009-a813-70141de75879", "name": "network-vif-plugged", "status": "completed", "tag": "d70fc082-1f91-4375-a1da-066df7bba089"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:52:48.591430 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d26fd477-23dc-4210-a96e-414d7fb61790 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:48.592940 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d26fd477-23dc-4210-a96e-414d7fb61790 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:48.594396 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d26fd477-23dc-4210-a96e-414d7fb61790 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:48.595084 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d26fd477-23dc-4210-a96e-414d7fb61790 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:48.596365 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d26fd477-23dc-4210-a96e-414d7fb61790 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:48.610411 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-bd9a06ee-00c0-4229-bed3-3cc91a4efb03 req-060474ca-40ce-4640-9165-994d8c9faa32 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:48.611021 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-bd9a06ee-00c0-4229-bed3-3cc91a4efb03 req-060474ca-40ce-4640-9165-994d8c9faa32 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:48.611613 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-bd9a06ee-00c0-4229-bed3-3cc91a4efb03 req-060474ca-40ce-4640-9165-994d8c9faa32 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:48.626136 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-bd9a06ee-00c0-4229-bed3-3cc91a4efb03 req-060474ca-40ce-4640-9165-994d8c9faa32 service nova] Creating event network-vif-plugged:d70fc082-1f91-4375-a1da-066df7bba089 for instance 0a2deb39-1e14-4009-a813-70141de75879 on n-h1-850501-12 Sep 08 10:52:48.634720 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-bd9a06ee-00c0-4229-bed3-3cc91a4efb03 req-060474ca-40ce-4640-9165-994d8c9faa32 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058471 Sep 08 10:52:48.636242 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1690/3383] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:52:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:52:48.643854 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e1aebb43-638e-4c9a-bb74-9e436482b184 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:48.645183 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e1aebb43-638e-4c9a-bb74-9e436482b184 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] [instance: 50feb7c3-9282-44b6-ad37-bf09e2d3f5a8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:48.669651 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e1aebb43-638e-4c9a-bb74-9e436482b184 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:48.671138 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e1aebb43-638e-4c9a-bb74-9e436482b184 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:48.672308 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e1aebb43-638e-4c9a-bb74-9e436482b184 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:48.673993 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e1aebb43-638e-4c9a-bb74-9e436482b184 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:48.675178 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e1aebb43-638e-4c9a-bb74-9e436482b184 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:48.676300 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e1aebb43-638e-4c9a-bb74-9e436482b184 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:48.976742 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e1aebb43-638e-4c9a-bb74-9e436482b184 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c4b351a0a4ccabbfb5438b5c535e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bb5f5b56a2402999719f0374228ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:48.988389 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e1aebb43-638e-4c9a-bb74-9e436482b184 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] 10.222.0.27 "GET /compute/v2.1/servers/50feb7c3-9282-44b6-ad37-bf09e2d3f5a8" status: 200 len: 1276 microversion: 2.1 time: 0.350257 Sep 08 10:52:48.997427 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1691/3384] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:48 2022] GET /compute/v2.1/servers/50feb7c3-9282-44b6-ad37-bf09e2d3f5a8 => generated 1276 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:49.025285 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-76973306-92c2-49ad-bb29-c12f1c536ea3 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:49.032899 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-76973306-92c2-49ad-bb29-c12f1c536ea3 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: 19604289-6d42-403f-bf74-75335e1782cb] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:49.197759 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-76973306-92c2-49ad-bb29-c12f1c536ea3 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c291cbe955b4ee5abc98132dda0255e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f9a24cad014d7f827e8f3236dd5bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:49.205799 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-76973306-92c2-49ad-bb29-c12f1c536ea3 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/19604289-6d42-403f-bf74-75335e1782cb" status: 200 len: 1240 microversion: 2.1 time: 0.206684 Sep 08 10:52:49.210400 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1692/3385] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:48 2022] GET /compute/v2.1/servers/19604289-6d42-403f-bf74-75335e1782cb => generated 1240 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:49.217618 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d961fcde-330f-42d5-8452-b8b02103aa14 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:49.231221 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d961fcde-330f-42d5-8452-b8b02103aa14 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: a882cf75-539a-45fa-ae2b-4e0f043b340d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:49.239427 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d961fcde-330f-42d5-8452-b8b02103aa14 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:49.250384 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d961fcde-330f-42d5-8452-b8b02103aa14 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:49.251116 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d961fcde-330f-42d5-8452-b8b02103aa14 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:49.252380 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d961fcde-330f-42d5-8452-b8b02103aa14 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:49.253520 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d961fcde-330f-42d5-8452-b8b02103aa14 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:49.254381 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d961fcde-330f-42d5-8452-b8b02103aa14 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:49.480555 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d26fd477-23dc-4210-a96e-414d7fb61790 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1502b3b00c449399ac35378281d992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df398bd0b3f45e9b11fe4212d6b5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:49.498329 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d26fd477-23dc-4210-a96e-414d7fb61790 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] 10.222.0.27 "GET /compute/v2.1/servers/0a2deb39-1e14-4009-a813-70141de75879" status: 200 len: 1313 microversion: 2.1 time: 0.981022 Sep 08 10:52:49.498944 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1694/3386] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:48 2022] GET /compute/v2.1/servers/0a2deb39-1e14-4009-a813-70141de75879 => generated 1313 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:49.709103 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d961fcde-330f-42d5-8452-b8b02103aa14 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:49.730275 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d961fcde-330f-42d5-8452-b8b02103aa14 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d" status: 200 len: 1522 microversion: 2.1 time: 0.518057 Sep 08 10:52:49.737520 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1693/3387] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:49 2022] GET /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d => generated 1522 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:50.013452 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e7a8677f-74ce-4c4b-b051-57bbdf092b23 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:50.014724 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e7a8677f-74ce-4c4b-b051-57bbdf092b23 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] [instance: 50feb7c3-9282-44b6-ad37-bf09e2d3f5a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:50.024263 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7a8677f-74ce-4c4b-b051-57bbdf092b23 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:50.025227 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7a8677f-74ce-4c4b-b051-57bbdf092b23 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:50.026715 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7a8677f-74ce-4c4b-b051-57bbdf092b23 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:50.027891 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7a8677f-74ce-4c4b-b051-57bbdf092b23 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:50.028619 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7a8677f-74ce-4c4b-b051-57bbdf092b23 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:50.029484 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7a8677f-74ce-4c4b-b051-57bbdf092b23 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:50.246115 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d0443cb0-a63b-4510-bf5b-30498ffece9a tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:50.247669 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d0443cb0-a63b-4510-bf5b-30498ffece9a tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: 19604289-6d42-403f-bf74-75335e1782cb] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:50.254848 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e7a8677f-74ce-4c4b-b051-57bbdf092b23 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c4b351a0a4ccabbfb5438b5c535e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bb5f5b56a2402999719f0374228ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:50.285149 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d0443cb0-a63b-4510-bf5b-30498ffece9a tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:50.287641 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e7a8677f-74ce-4c4b-b051-57bbdf092b23 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] 10.222.0.27 "GET /compute/v2.1/servers/50feb7c3-9282-44b6-ad37-bf09e2d3f5a8" status: 200 len: 1282 microversion: 2.1 time: 0.279181 Sep 08 10:52:50.288857 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d0443cb0-a63b-4510-bf5b-30498ffece9a tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:50.298937 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d0443cb0-a63b-4510-bf5b-30498ffece9a tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:50.299983 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1695/3388] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:50 2022] GET /compute/v2.1/servers/50feb7c3-9282-44b6-ad37-bf09e2d3f5a8 => generated 1282 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:50.301358 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d0443cb0-a63b-4510-bf5b-30498ffece9a tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:50.302699 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d0443cb0-a63b-4510-bf5b-30498ffece9a tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:50.304142 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d0443cb0-a63b-4510-bf5b-30498ffece9a tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:50.481483 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d0443cb0-a63b-4510-bf5b-30498ffece9a tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c291cbe955b4ee5abc98132dda0255e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f9a24cad014d7f827e8f3236dd5bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:50.493867 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d0443cb0-a63b-4510-bf5b-30498ffece9a tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/19604289-6d42-403f-bf74-75335e1782cb" status: 200 len: 1292 microversion: 2.1 time: 0.261802 Sep 08 10:52:50.512569 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1694/3389] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:50 2022] GET /compute/v2.1/servers/19604289-6d42-403f-bf74-75335e1782cb => generated 1292 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:50.533118 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-698ce32a-0b46-4188-8f5b-0d97fc932b67 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:50.533892 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-698ce32a-0b46-4188-8f5b-0d97fc932b67 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] [instance: 0a2deb39-1e14-4009-a813-70141de75879] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:50.551032 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-698ce32a-0b46-4188-8f5b-0d97fc932b67 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:50.554330 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-698ce32a-0b46-4188-8f5b-0d97fc932b67 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:50.559083 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-698ce32a-0b46-4188-8f5b-0d97fc932b67 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:50.560493 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-698ce32a-0b46-4188-8f5b-0d97fc932b67 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:50.564475 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-698ce32a-0b46-4188-8f5b-0d97fc932b67 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:50.565361 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-698ce32a-0b46-4188-8f5b-0d97fc932b67 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:50.767425 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7a65f111-292b-4cde-87eb-0af0167f5b4f tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:50.774342 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7a65f111-292b-4cde-87eb-0af0167f5b4f tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: a882cf75-539a-45fa-ae2b-4e0f043b340d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:50.794788 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a65f111-292b-4cde-87eb-0af0167f5b4f tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:50.796499 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a65f111-292b-4cde-87eb-0af0167f5b4f tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:50.799124 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a65f111-292b-4cde-87eb-0af0167f5b4f tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:50.800198 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a65f111-292b-4cde-87eb-0af0167f5b4f tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:50.800490 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a65f111-292b-4cde-87eb-0af0167f5b4f tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:50.806866 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a65f111-292b-4cde-87eb-0af0167f5b4f tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:51.134805 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-698ce32a-0b46-4188-8f5b-0d97fc932b67 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1502b3b00c449399ac35378281d992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df398bd0b3f45e9b11fe4212d6b5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:51.164832 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-698ce32a-0b46-4188-8f5b-0d97fc932b67 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] 10.222.0.27 "GET /compute/v2.1/servers/0a2deb39-1e14-4009-a813-70141de75879" status: 200 len: 1313 microversion: 2.1 time: 0.637399 Sep 08 10:52:51.176761 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1696/3390] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:50 2022] GET /compute/v2.1/servers/0a2deb39-1e14-4009-a813-70141de75879 => generated 1313 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:51.333123 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ffccd2db-c8e0-4b62-a78a-9d6ec060dd82 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:51.334572 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ffccd2db-c8e0-4b62-a78a-9d6ec060dd82 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] [instance: 50feb7c3-9282-44b6-ad37-bf09e2d3f5a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:51.350846 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ffccd2db-c8e0-4b62-a78a-9d6ec060dd82 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:51.352437 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ffccd2db-c8e0-4b62-a78a-9d6ec060dd82 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:51.353740 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ffccd2db-c8e0-4b62-a78a-9d6ec060dd82 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:51.355519 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ffccd2db-c8e0-4b62-a78a-9d6ec060dd82 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:51.356651 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ffccd2db-c8e0-4b62-a78a-9d6ec060dd82 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:51.357642 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ffccd2db-c8e0-4b62-a78a-9d6ec060dd82 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:51.387439 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7a65f111-292b-4cde-87eb-0af0167f5b4f tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:51.405641 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7a65f111-292b-4cde-87eb-0af0167f5b4f tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d" status: 200 len: 1522 microversion: 2.1 time: 0.651370 Sep 08 10:52:51.422075 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1695/3391] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:50 2022] GET /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d => generated 1522 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:51.524054 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-539eafe5-52bc-4a9e-8e5f-676d4a64f1a7 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:51.525099 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-539eafe5-52bc-4a9e-8e5f-676d4a64f1a7 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: 19604289-6d42-403f-bf74-75335e1782cb] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:51.545547 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-539eafe5-52bc-4a9e-8e5f-676d4a64f1a7 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:51.547491 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-539eafe5-52bc-4a9e-8e5f-676d4a64f1a7 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:51.551265 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-539eafe5-52bc-4a9e-8e5f-676d4a64f1a7 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:51.553581 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-539eafe5-52bc-4a9e-8e5f-676d4a64f1a7 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:51.558811 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-539eafe5-52bc-4a9e-8e5f-676d4a64f1a7 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:51.561065 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-539eafe5-52bc-4a9e-8e5f-676d4a64f1a7 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:51.750601 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-539eafe5-52bc-4a9e-8e5f-676d4a64f1a7 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c291cbe955b4ee5abc98132dda0255e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f9a24cad014d7f827e8f3236dd5bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:51.762762 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-539eafe5-52bc-4a9e-8e5f-676d4a64f1a7 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/19604289-6d42-403f-bf74-75335e1782cb" status: 200 len: 1292 microversion: 2.1 time: 0.245812 Sep 08 10:52:51.764523 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1696/3392] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:51 2022] GET /compute/v2.1/servers/19604289-6d42-403f-bf74-75335e1782cb => generated 1292 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:52.204316 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2548d3e2-c126-43ec-af6a-fe325f43e4cd tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:52.205703 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2548d3e2-c126-43ec-af6a-fe325f43e4cd tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] [instance: 0a2deb39-1e14-4009-a813-70141de75879] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:52.226687 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2548d3e2-c126-43ec-af6a-fe325f43e4cd tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:52.227453 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2548d3e2-c126-43ec-af6a-fe325f43e4cd tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:52.228072 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2548d3e2-c126-43ec-af6a-fe325f43e4cd tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:52.229598 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2548d3e2-c126-43ec-af6a-fe325f43e4cd tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:52.230216 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2548d3e2-c126-43ec-af6a-fe325f43e4cd tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:52.230802 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2548d3e2-c126-43ec-af6a-fe325f43e4cd tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:52.356910 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ffccd2db-c8e0-4b62-a78a-9d6ec060dd82 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c4b351a0a4ccabbfb5438b5c535e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bb5f5b56a2402999719f0374228ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:52.370811 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ffccd2db-c8e0-4b62-a78a-9d6ec060dd82 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] 10.222.0.27 "GET /compute/v2.1/servers/50feb7c3-9282-44b6-ad37-bf09e2d3f5a8" status: 200 len: 1282 microversion: 2.1 time: 1.044327 Sep 08 10:52:52.386647 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1697/3393] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:51 2022] GET /compute/v2.1/servers/50feb7c3-9282-44b6-ad37-bf09e2d3f5a8 => generated 1282 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:52.433275 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-15c9acd5-f26a-4be0-8d7e-570c4b064672 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:52.435499 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-15c9acd5-f26a-4be0-8d7e-570c4b064672 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: a882cf75-539a-45fa-ae2b-4e0f043b340d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:52.451589 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15c9acd5-f26a-4be0-8d7e-570c4b064672 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:52.452847 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15c9acd5-f26a-4be0-8d7e-570c4b064672 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:52.454735 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15c9acd5-f26a-4be0-8d7e-570c4b064672 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:52.462485 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15c9acd5-f26a-4be0-8d7e-570c4b064672 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:52.463453 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15c9acd5-f26a-4be0-8d7e-570c4b064672 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:52.464444 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15c9acd5-f26a-4be0-8d7e-570c4b064672 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:52.735928 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2548d3e2-c126-43ec-af6a-fe325f43e4cd tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1502b3b00c449399ac35378281d992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df398bd0b3f45e9b11fe4212d6b5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:52.747160 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2548d3e2-c126-43ec-af6a-fe325f43e4cd tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] 10.222.0.27 "GET /compute/v2.1/servers/0a2deb39-1e14-4009-a813-70141de75879" status: 200 len: 1498 microversion: 2.1 time: 0.548378 Sep 08 10:52:52.751570 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1697/3394] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:52 2022] GET /compute/v2.1/servers/0a2deb39-1e14-4009-a813-70141de75879 => generated 1498 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:52:52.782112 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cc8f3ee9-151a-477b-b6ae-8c2480ca7b46 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:52.842788 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.compute.server_groups [None req-cc8f3ee9-151a-477b-b6ae-8c2480ca7b46 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Querying cell 2785b110-f847-4739-9d30-5b571c6d79f4(cell1) for 1 instances {{(pid=128861) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 08 10:52:52.846267 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc8f3ee9-151a-477b-b6ae-8c2480ca7b46 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:52.846676 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc8f3ee9-151a-477b-b6ae-8c2480ca7b46 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:52.847679 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc8f3ee9-151a-477b-b6ae-8c2480ca7b46 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:52.914259 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cc8f3ee9-151a-477b-b6ae-8c2480ca7b46 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups/98578f2b-ffa3-452b-a365-f2d2ab6ae9c0" status: 200 len: 222 microversion: 2.1 time: 0.136507 Sep 08 10:52:52.926791 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1698/3395] 10.222.0.27 () {58 vars in 1263 bytes} [Thu Sep 8 10:52:52 2022] GET /compute/v2.1/os-server-groups/98578f2b-ffa3-452b-a365-f2d2ab6ae9c0 => generated 222 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:52:52.934792 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d6b293ec-0ea0-4b28-ba81-60e5e6272bb0 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:52.935850 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d6b293ec-0ea0-4b28-ba81-60e5e6272bb0 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: 19604289-6d42-403f-bf74-75335e1782cb] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:52.943566 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d6b293ec-0ea0-4b28-ba81-60e5e6272bb0 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:52.944417 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d6b293ec-0ea0-4b28-ba81-60e5e6272bb0 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:52.945475 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d6b293ec-0ea0-4b28-ba81-60e5e6272bb0 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:52.946836 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d6b293ec-0ea0-4b28-ba81-60e5e6272bb0 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:52.947797 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d6b293ec-0ea0-4b28-ba81-60e5e6272bb0 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:52.948516 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d6b293ec-0ea0-4b28-ba81-60e5e6272bb0 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:53.109349 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d6b293ec-0ea0-4b28-ba81-60e5e6272bb0 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c291cbe955b4ee5abc98132dda0255e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f9a24cad014d7f827e8f3236dd5bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:53.140828 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d6b293ec-0ea0-4b28-ba81-60e5e6272bb0 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/19604289-6d42-403f-bf74-75335e1782cb" status: 200 len: 1298 microversion: 2.1 time: 0.211833 Sep 08 10:52:53.141594 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1699/3396] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:52 2022] GET /compute/v2.1/servers/19604289-6d42-403f-bf74-75335e1782cb => generated 1298 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:53.149684 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e8f06803-2c02-4d0c-85ad-d769257ca895 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:53.151980 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e8f06803-2c02-4d0c-85ad-d769257ca895 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] [instance: 0a2deb39-1e14-4009-a813-70141de75879] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:53.183832 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e8f06803-2c02-4d0c-85ad-d769257ca895 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:53.188780 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e8f06803-2c02-4d0c-85ad-d769257ca895 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:53.190213 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e8f06803-2c02-4d0c-85ad-d769257ca895 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:53.192831 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e8f06803-2c02-4d0c-85ad-d769257ca895 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:53.195637 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e8f06803-2c02-4d0c-85ad-d769257ca895 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:53.196620 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e8f06803-2c02-4d0c-85ad-d769257ca895 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:53.230775 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=100 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:52:53.267019 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e8f06803-2c02-4d0c-85ad-d769257ca895 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] [instance: 0a2deb39-1e14-4009-a813-70141de75879] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:52:53.487000 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e8f06803-2c02-4d0c-85ad-d769257ca895 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0a2deb39-1e14-4009-a813-70141de75879" status: 204 len: 0 microversion: 2.1 time: 0.340880 Sep 08 10:52:53.488223 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1700/3397] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:52:53 2022] DELETE /compute/v2.1/servers/0a2deb39-1e14-4009-a813-70141de75879 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:52:53.498852 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c40cb175-8a51-43df-998e-5c831b47247d tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:53.500810 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c40cb175-8a51-43df-998e-5c831b47247d tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] [instance: 50feb7c3-9282-44b6-ad37-bf09e2d3f5a8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:53.512857 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c40cb175-8a51-43df-998e-5c831b47247d tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:53.513919 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c40cb175-8a51-43df-998e-5c831b47247d tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:53.516291 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c40cb175-8a51-43df-998e-5c831b47247d tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:53.517866 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c40cb175-8a51-43df-998e-5c831b47247d tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:53.518762 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c40cb175-8a51-43df-998e-5c831b47247d tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:53.519587 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c40cb175-8a51-43df-998e-5c831b47247d tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:53.628397 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-15c9acd5-f26a-4be0-8d7e-570c4b064672 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:53.654454 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-15c9acd5-f26a-4be0-8d7e-570c4b064672 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d" status: 200 len: 1522 microversion: 2.1 time: 1.221556 Sep 08 10:52:53.658048 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1698/3398] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:52 2022] GET /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d => generated 1522 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:53.687470 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-378f3df6-10e1-4419-a2ac-b17a9fd626f6 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:53.690614 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-378f3df6-10e1-4419-a2ac-b17a9fd626f6 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] [instance: 0a2deb39-1e14-4009-a813-70141de75879] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:53.707015 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-378f3df6-10e1-4419-a2ac-b17a9fd626f6 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:53.708794 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-378f3df6-10e1-4419-a2ac-b17a9fd626f6 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:53.710911 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-378f3df6-10e1-4419-a2ac-b17a9fd626f6 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:53.712575 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-378f3df6-10e1-4419-a2ac-b17a9fd626f6 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:53.714304 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-378f3df6-10e1-4419-a2ac-b17a9fd626f6 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:53.715330 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-378f3df6-10e1-4419-a2ac-b17a9fd626f6 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:53.988872 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c40cb175-8a51-43df-998e-5c831b47247d tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c4b351a0a4ccabbfb5438b5c535e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bb5f5b56a2402999719f0374228ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:54.000822 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c40cb175-8a51-43df-998e-5c831b47247d tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] 10.222.0.27 "GET /compute/v2.1/servers/50feb7c3-9282-44b6-ad37-bf09e2d3f5a8" status: 200 len: 1324 microversion: 2.1 time: 0.510728 Sep 08 10:52:54.006624 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1701/3399] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:53 2022] GET /compute/v2.1/servers/50feb7c3-9282-44b6-ad37-bf09e2d3f5a8 => generated 1324 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:54.169555 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9933b2d0-9f65-463e-9b77-42bbcf4143f8 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:54.170601 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9933b2d0-9f65-463e-9b77-42bbcf4143f8 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: 19604289-6d42-403f-bf74-75335e1782cb] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:54.185456 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9933b2d0-9f65-463e-9b77-42bbcf4143f8 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:54.185456 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9933b2d0-9f65-463e-9b77-42bbcf4143f8 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:54.185921 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9933b2d0-9f65-463e-9b77-42bbcf4143f8 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:54.186656 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9933b2d0-9f65-463e-9b77-42bbcf4143f8 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:54.187122 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9933b2d0-9f65-463e-9b77-42bbcf4143f8 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:54.187556 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9933b2d0-9f65-463e-9b77-42bbcf4143f8 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:54.437693 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-378f3df6-10e1-4419-a2ac-b17a9fd626f6 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1502b3b00c449399ac35378281d992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df398bd0b3f45e9b11fe4212d6b5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:54.453593 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-378f3df6-10e1-4419-a2ac-b17a9fd626f6 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] 10.222.0.27 "GET /compute/v2.1/servers/0a2deb39-1e14-4009-a813-70141de75879" status: 200 len: 1504 microversion: 2.1 time: 0.791895 Sep 08 10:52:54.454677 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1699/3400] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:53 2022] GET /compute/v2.1/servers/0a2deb39-1e14-4009-a813-70141de75879 => generated 1504 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:54.563574 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9933b2d0-9f65-463e-9b77-42bbcf4143f8 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c291cbe955b4ee5abc98132dda0255e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f9a24cad014d7f827e8f3236dd5bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:54.581820 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9933b2d0-9f65-463e-9b77-42bbcf4143f8 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/19604289-6d42-403f-bf74-75335e1782cb" status: 200 len: 1298 microversion: 2.1 time: 0.417369 Sep 08 10:52:54.582748 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1702/3401] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:54 2022] GET /compute/v2.1/servers/19604289-6d42-403f-bf74-75335e1782cb => generated 1298 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:54.701919 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d44269dd-86a5-4948-ac15-3a723da2d8e9 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:54.703229 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d44269dd-86a5-4948-ac15-3a723da2d8e9 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: a882cf75-539a-45fa-ae2b-4e0f043b340d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:54.723758 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d44269dd-86a5-4948-ac15-3a723da2d8e9 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:54.726806 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d44269dd-86a5-4948-ac15-3a723da2d8e9 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:54.728868 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d44269dd-86a5-4948-ac15-3a723da2d8e9 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:54.735873 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d44269dd-86a5-4948-ac15-3a723da2d8e9 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:54.741531 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d44269dd-86a5-4948-ac15-3a723da2d8e9 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:54.742574 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d44269dd-86a5-4948-ac15-3a723da2d8e9 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:55.035915 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8ac302e4-1a6e-4b77-99a6-a2382096b9c1 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:55.038769 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8ac302e4-1a6e-4b77-99a6-a2382096b9c1 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] [instance: 50feb7c3-9282-44b6-ad37-bf09e2d3f5a8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:55.052807 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8ac302e4-1a6e-4b77-99a6-a2382096b9c1 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:55.054219 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8ac302e4-1a6e-4b77-99a6-a2382096b9c1 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:55.055312 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8ac302e4-1a6e-4b77-99a6-a2382096b9c1 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:55.057453 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8ac302e4-1a6e-4b77-99a6-a2382096b9c1 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:55.058576 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8ac302e4-1a6e-4b77-99a6-a2382096b9c1 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:55.059618 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8ac302e4-1a6e-4b77-99a6-a2382096b9c1 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:55.277662 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d44269dd-86a5-4948-ac15-3a723da2d8e9 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:55.288609 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d44269dd-86a5-4948-ac15-3a723da2d8e9 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d" status: 200 len: 1522 microversion: 2.1 time: 0.591043 Sep 08 10:52:55.289714 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1700/3402] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:54 2022] GET /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d => generated 1522 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:55.461936 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8ac302e4-1a6e-4b77-99a6-a2382096b9c1 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c4b351a0a4ccabbfb5438b5c535e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bb5f5b56a2402999719f0374228ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:55.477906 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8ac302e4-1a6e-4b77-99a6-a2382096b9c1 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] 10.222.0.27 "GET /compute/v2.1/servers/50feb7c3-9282-44b6-ad37-bf09e2d3f5a8" status: 200 len: 1324 microversion: 2.1 time: 0.452654 Sep 08 10:52:55.491698 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-601a0d4c-f3da-4927-913c-824efb7418b7 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:55.492323 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-601a0d4c-f3da-4927-913c-824efb7418b7 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] [instance: 0a2deb39-1e14-4009-a813-70141de75879] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:55.494170 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1703/3403] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:55 2022] GET /compute/v2.1/servers/50feb7c3-9282-44b6-ad37-bf09e2d3f5a8 => generated 1324 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:55.502977 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-601a0d4c-f3da-4927-913c-824efb7418b7 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:55.503728 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-601a0d4c-f3da-4927-913c-824efb7418b7 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:55.504339 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-601a0d4c-f3da-4927-913c-824efb7418b7 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:55.505268 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-601a0d4c-f3da-4927-913c-824efb7418b7 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:55.505928 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-601a0d4c-f3da-4927-913c-824efb7418b7 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:55.506520 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-601a0d4c-f3da-4927-913c-824efb7418b7 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:55.608177 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-48e5b875-1820-4465-8396-83b4a6d602f0 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:55.609135 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-48e5b875-1820-4465-8396-83b4a6d602f0 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: 19604289-6d42-403f-bf74-75335e1782cb] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:55.616447 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-48e5b875-1820-4465-8396-83b4a6d602f0 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:55.618031 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-48e5b875-1820-4465-8396-83b4a6d602f0 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:55.618771 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-48e5b875-1820-4465-8396-83b4a6d602f0 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:55.620583 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-48e5b875-1820-4465-8396-83b4a6d602f0 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:55.621527 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-48e5b875-1820-4465-8396-83b4a6d602f0 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:55.622335 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-48e5b875-1820-4465-8396-83b4a6d602f0 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:55.751349 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-48e5b875-1820-4465-8396-83b4a6d602f0 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c291cbe955b4ee5abc98132dda0255e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f9a24cad014d7f827e8f3236dd5bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:55.761654 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-48e5b875-1820-4465-8396-83b4a6d602f0 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/19604289-6d42-403f-bf74-75335e1782cb" status: 200 len: 1298 microversion: 2.1 time: 0.158137 Sep 08 10:52:55.776396 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1704/3404] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:55 2022] GET /compute/v2.1/servers/19604289-6d42-403f-bf74-75335e1782cb => generated 1298 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:56.319158 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-788ae8fc-e2b3-4a87-be55-0c0db86a54d2 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:56.319988 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-788ae8fc-e2b3-4a87-be55-0c0db86a54d2 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: a882cf75-539a-45fa-ae2b-4e0f043b340d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:56.330497 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-788ae8fc-e2b3-4a87-be55-0c0db86a54d2 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:56.331786 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-788ae8fc-e2b3-4a87-be55-0c0db86a54d2 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:56.332387 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-788ae8fc-e2b3-4a87-be55-0c0db86a54d2 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:56.333270 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-788ae8fc-e2b3-4a87-be55-0c0db86a54d2 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:56.333814 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-788ae8fc-e2b3-4a87-be55-0c0db86a54d2 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:56.334404 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-788ae8fc-e2b3-4a87-be55-0c0db86a54d2 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:56.500535 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-788ae8fc-e2b3-4a87-be55-0c0db86a54d2 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:56.530701 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-788ae8fc-e2b3-4a87-be55-0c0db86a54d2 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d" status: 200 len: 1522 microversion: 2.1 time: 0.218220 Sep 08 10:52:56.531831 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1705/3405] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:56 2022] GET /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:52:56.541263 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0b928be2-b4fe-4446-8d52-6114ca678a14 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:56.542637 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0b928be2-b4fe-4446-8d52-6114ca678a14 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] [instance: 50feb7c3-9282-44b6-ad37-bf09e2d3f5a8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:56.554833 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0b928be2-b4fe-4446-8d52-6114ca678a14 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:56.555923 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0b928be2-b4fe-4446-8d52-6114ca678a14 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:56.558858 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0b928be2-b4fe-4446-8d52-6114ca678a14 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:56.560789 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0b928be2-b4fe-4446-8d52-6114ca678a14 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:56.562364 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0b928be2-b4fe-4446-8d52-6114ca678a14 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:56.563360 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0b928be2-b4fe-4446-8d52-6114ca678a14 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:56.631439 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-601a0d4c-f3da-4927-913c-824efb7418b7 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1502b3b00c449399ac35378281d992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df398bd0b3f45e9b11fe4212d6b5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:56.647957 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-601a0d4c-f3da-4927-913c-824efb7418b7 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] 10.222.0.27 "GET /compute/v2.1/servers/0a2deb39-1e14-4009-a813-70141de75879" status: 200 len: 1504 microversion: 2.1 time: 1.161616 Sep 08 10:52:56.667140 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1701/3406] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:55 2022] GET /compute/v2.1/servers/0a2deb39-1e14-4009-a813-70141de75879 => generated 1504 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:56.788440 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-89e8aaaf-0a6a-459c-8b06-a28ca5e71e32 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:56.789646 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-89e8aaaf-0a6a-459c-8b06-a28ca5e71e32 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: 19604289-6d42-403f-bf74-75335e1782cb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:56.807347 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89e8aaaf-0a6a-459c-8b06-a28ca5e71e32 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:56.808098 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89e8aaaf-0a6a-459c-8b06-a28ca5e71e32 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:56.811801 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89e8aaaf-0a6a-459c-8b06-a28ca5e71e32 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:56.812682 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89e8aaaf-0a6a-459c-8b06-a28ca5e71e32 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:56.813757 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89e8aaaf-0a6a-459c-8b06-a28ca5e71e32 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:56.813885 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89e8aaaf-0a6a-459c-8b06-a28ca5e71e32 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:57.066077 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-89e8aaaf-0a6a-459c-8b06-a28ca5e71e32 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c291cbe955b4ee5abc98132dda0255e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f9a24cad014d7f827e8f3236dd5bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:57.097210 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-89e8aaaf-0a6a-459c-8b06-a28ca5e71e32 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/19604289-6d42-403f-bf74-75335e1782cb" status: 200 len: 1298 microversion: 2.1 time: 0.313897 Sep 08 10:52:57.099313 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1702/3407] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:56 2022] GET /compute/v2.1/servers/19604289-6d42-403f-bf74-75335e1782cb => generated 1298 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:52:57.108315 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0b928be2-b4fe-4446-8d52-6114ca678a14 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c4b351a0a4ccabbfb5438b5c535e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bb5f5b56a2402999719f0374228ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:57.122021 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0b928be2-b4fe-4446-8d52-6114ca678a14 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] 10.222.0.27 "GET /compute/v2.1/servers/50feb7c3-9282-44b6-ad37-bf09e2d3f5a8" status: 200 len: 1324 microversion: 2.1 time: 0.585992 Sep 08 10:52:57.123022 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1706/3408] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:56 2022] GET /compute/v2.1/servers/50feb7c3-9282-44b6-ad37-bf09e2d3f5a8 => generated 1324 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:57.341332 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-5c86a930-d730-4d8e-8a33-d1449df52ad4 req-bfac6f72-7e3d-40df-9cbf-25176d0257bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50feb7c3-9282-44b6-ad37-bf09e2d3f5a8", "tag": "ca13d9de-91b0-46ce-8809-9fde8d4724a3"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:52:57.356720 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-5c86a930-d730-4d8e-8a33-d1449df52ad4 req-bfac6f72-7e3d-40df-9cbf-25176d0257bd service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:57.358784 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-5c86a930-d730-4d8e-8a33-d1449df52ad4 req-bfac6f72-7e3d-40df-9cbf-25176d0257bd service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:57.359665 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-5c86a930-d730-4d8e-8a33-d1449df52ad4 req-bfac6f72-7e3d-40df-9cbf-25176d0257bd service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:57.380442 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-5c86a930-d730-4d8e-8a33-d1449df52ad4 req-bfac6f72-7e3d-40df-9cbf-25176d0257bd service nova] Creating event network-changed:ca13d9de-91b0-46ce-8809-9fde8d4724a3 for instance 50feb7c3-9282-44b6-ad37-bf09e2d3f5a8 on n-h2-850501-12 Sep 08 10:52:57.389469 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-5c86a930-d730-4d8e-8a33-d1449df52ad4 req-bfac6f72-7e3d-40df-9cbf-25176d0257bd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055303 Sep 08 10:52:57.390396 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1703/3409] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:52:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:52:57.557001 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0356de98-4b0a-44fe-b4d8-95d25eb981c9 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:57.562294 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0356de98-4b0a-44fe-b4d8-95d25eb981c9 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: a882cf75-539a-45fa-ae2b-4e0f043b340d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:57.578485 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0356de98-4b0a-44fe-b4d8-95d25eb981c9 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:57.579005 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0356de98-4b0a-44fe-b4d8-95d25eb981c9 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:57.579457 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0356de98-4b0a-44fe-b4d8-95d25eb981c9 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:57.580205 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0356de98-4b0a-44fe-b4d8-95d25eb981c9 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:57.581557 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0356de98-4b0a-44fe-b4d8-95d25eb981c9 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:57.582299 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0356de98-4b0a-44fe-b4d8-95d25eb981c9 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:57.672007 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:52:57.677437 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2e528914-d76a-4cfe-a62c-5619f602cd16 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:57.679118 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2e528914-d76a-4cfe-a62c-5619f602cd16 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] [instance: 0a2deb39-1e14-4009-a813-70141de75879] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:57.692663 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e528914-d76a-4cfe-a62c-5619f602cd16 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:57.694596 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e528914-d76a-4cfe-a62c-5619f602cd16 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:57.695287 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e528914-d76a-4cfe-a62c-5619f602cd16 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:57.696374 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e528914-d76a-4cfe-a62c-5619f602cd16 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:57.697879 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e528914-d76a-4cfe-a62c-5619f602cd16 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:57.698621 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e528914-d76a-4cfe-a62c-5619f602cd16 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:57.919190 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2e528914-d76a-4cfe-a62c-5619f602cd16 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1502b3b00c449399ac35378281d992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df398bd0b3f45e9b11fe4212d6b5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:57.942583 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2e528914-d76a-4cfe-a62c-5619f602cd16 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] 10.222.0.27 "GET /compute/v2.1/servers/0a2deb39-1e14-4009-a813-70141de75879" status: 200 len: 1462 microversion: 2.1 time: 0.270912 Sep 08 10:52:57.971081 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0356de98-4b0a-44fe-b4d8-95d25eb981c9 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:57.980106 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1704/3410] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:57 2022] GET /compute/v2.1/servers/0a2deb39-1e14-4009-a813-70141de75879 => generated 1462 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:57.984759 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0356de98-4b0a-44fe-b4d8-95d25eb981c9 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d" status: 200 len: 1522 microversion: 2.1 time: 0.432031 Sep 08 10:52:57.997808 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1707/3411] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:57 2022] GET /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d => generated 1522 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:52:58.135327 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-eb86ec82-b986-41eb-b1c6-0c51f55f532c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:58.138420 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-eb86ec82-b986-41eb-b1c6-0c51f55f532c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: 19604289-6d42-403f-bf74-75335e1782cb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:58.155465 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5e7ba1e0-fe92-44b3-b192-053e2af63cd5 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:58.156395 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5e7ba1e0-fe92-44b3-b192-053e2af63cd5 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] [instance: 50feb7c3-9282-44b6-ad37-bf09e2d3f5a8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:58.186656 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb86ec82-b986-41eb-b1c6-0c51f55f532c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:58.187442 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb86ec82-b986-41eb-b1c6-0c51f55f532c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:58.187963 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb86ec82-b986-41eb-b1c6-0c51f55f532c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:58.189381 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb86ec82-b986-41eb-b1c6-0c51f55f532c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:58.190238 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb86ec82-b986-41eb-b1c6-0c51f55f532c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:58.190965 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb86ec82-b986-41eb-b1c6-0c51f55f532c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:58.199605 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5e7ba1e0-fe92-44b3-b192-053e2af63cd5 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:58.199605 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5e7ba1e0-fe92-44b3-b192-053e2af63cd5 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:58.199605 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5e7ba1e0-fe92-44b3-b192-053e2af63cd5 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:58.199605 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5e7ba1e0-fe92-44b3-b192-053e2af63cd5 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:58.199605 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5e7ba1e0-fe92-44b3-b192-053e2af63cd5 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:58.200677 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5e7ba1e0-fe92-44b3-b192-053e2af63cd5 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:58.372843 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=4 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:52:58.823928 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-eb86ec82-b986-41eb-b1c6-0c51f55f532c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c291cbe955b4ee5abc98132dda0255e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f9a24cad014d7f827e8f3236dd5bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:58.831594 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5e7ba1e0-fe92-44b3-b192-053e2af63cd5 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c4b351a0a4ccabbfb5438b5c535e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bb5f5b56a2402999719f0374228ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:58.845330 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-eb86ec82-b986-41eb-b1c6-0c51f55f532c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/19604289-6d42-403f-bf74-75335e1782cb" status: 200 len: 1365 microversion: 2.1 time: 0.719837 Sep 08 10:52:58.846544 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1705/3412] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:58 2022] GET /compute/v2.1/servers/19604289-6d42-403f-bf74-75335e1782cb => generated 1365 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:58.868332 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5e7ba1e0-fe92-44b3-b192-053e2af63cd5 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] 10.222.0.27 "GET /compute/v2.1/servers/50feb7c3-9282-44b6-ad37-bf09e2d3f5a8" status: 200 len: 1324 microversion: 2.1 time: 0.719686 Sep 08 10:52:58.870369 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1708/3413] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:58 2022] GET /compute/v2.1/servers/50feb7c3-9282-44b6-ad37-bf09e2d3f5a8 => generated 1324 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:58.985985 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-de4fa375-d591-4f53-a04c-31c671571b4c tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:58.987181 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-de4fa375-d591-4f53-a04c-31c671571b4c tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] [instance: 0a2deb39-1e14-4009-a813-70141de75879] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:58.996314 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de4fa375-d591-4f53-a04c-31c671571b4c tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:58.997248 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de4fa375-d591-4f53-a04c-31c671571b4c tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:58.997937 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de4fa375-d591-4f53-a04c-31c671571b4c tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:58.998907 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de4fa375-d591-4f53-a04c-31c671571b4c tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:58.999600 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de4fa375-d591-4f53-a04c-31c671571b4c tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:59.000279 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de4fa375-d591-4f53-a04c-31c671571b4c tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:59.021730 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-de4fa375-d591-4f53-a04c-31c671571b4c tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] HTTP exception thrown: Instance 0a2deb39-1e14-4009-a813-70141de75879 could not be found. Sep 08 10:52:59.024681 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-de4fa375-d591-4f53-a04c-31c671571b4c tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Request method failure captured: Sep 08 10:52:59.024681 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/0a2deb39-1e14-4009-a813-70141de75879 HTTP/1.1 Sep 08 10:52:59.024681 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:52:59.024681 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:52:59.024681 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:52:59.024681 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:52:59.024681 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:52:59.024681 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:52:59.024681 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:52:59.024681 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:52:59.024681 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGclgwqelvO9cbcrdYeCMtNNdIXZpyOYufQbvJKY4OX691skfA9hTrHwgd21KQ6TcEcvC9ix29LtQqW1_QUWXwlSnObQSZvCCIB-27LSpNxBwFU2xCsd9yA3dvNH_Dg2uZRKmL75g85bDFgI3Ct1nITjwjnj10xAppViKIbNQNMWbp6s Sep 08 10:52:59.024681 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:52:59.024681 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:52:59.024681 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:52:59.024681 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:52:59.024681 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:52:59.024681 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:52:59.024681 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 1df398bd0b3f45e9b11fe4212d6b5729 Sep 08 10:52:59.024681 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServerGroupTestJSON-1684596102 Sep 08 10:52:59.024681 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:52:59.024681 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:52:59.024681 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1df398bd0b3f45e9b11fe4212d6b5729"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1df398bd0b3f45e9b11fe4212d6b5729"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1df398bd0b3f45e9b11fe4212d6b5729"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1df398bd0b3f45e9b11fe4212d6b5729"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:52:59.024681 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServerGroupTestJSON-1684596102 Sep 08 10:52:59.024681 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 1df398bd0b3f45e9b11fe4212d6b5729 Sep 08 10:52:59.024681 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServerGroupTestJSON-1684596102 Sep 08 10:52:59.024681 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServerGroupTestJSON-1684596102-project Sep 08 10:52:59.024681 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:52:59.024681 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:52:59.024681 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 4b1502b3b00c449399ac35378281d992 Sep 08 10:52:59.024681 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServerGroupTestJSON-1684596102-project Sep 08 10:52:59.024681 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:52:59.024681 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 0a2deb39-1e14-4009-a813-70141de75879 could not be found. Sep 08 10:52:59.024681 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '0a2deb39-1e14-4009-a813-70141de75879'} Sep 08 10:52:59.024681 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:52:59.024681 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:59.024681 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:52:59.024681 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:52:59.024681 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:52:59.024681 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:52:59.024681 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:52:59.024681 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:52:59.024681 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:52:59.024681 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:52:59.024681 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a2deb39-1e14-4009-a813-70141de75879 could not be found. Sep 08 10:52:59.024681 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:59.024681 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:52:59.024681 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:59.024681 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:59.024681 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:52:59.024681 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:52:59.024681 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:52:59.024681 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:52:59.024681 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:52:59.024681 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:52:59.024681 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:52:59.024681 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:52:59.024681 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:52:59.024681 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:52:59.024681 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:52:59.024681 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:52:59.024681 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a2deb39-1e14-4009-a813-70141de75879 could not be found. Sep 08 10:52:59.024681 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:59.024681 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:52:59.024681 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:59.033091 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:59.033091 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:52:59.033091 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:52:59.033091 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:52:59.033091 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:52:59.033091 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a2deb39-1e14-4009-a813-70141de75879 could not be found. Sep 08 10:52:59.033091 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:59.034931 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b6286ff2-7027-4f8a-9ee8-dc083bc2b1b3 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:59.034931 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b6286ff2-7027-4f8a-9ee8-dc083bc2b1b3 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: a882cf75-539a-45fa-ae2b-4e0f043b340d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:59.037221 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-de4fa375-d591-4f53-a04c-31c671571b4c tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Returning 404 to user: Instance 0a2deb39-1e14-4009-a813-70141de75879 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:52:59.039227 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-de4fa375-d591-4f53-a04c-31c671571b4c tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] 10.222.0.27 "GET /compute/v2.1/servers/0a2deb39-1e14-4009-a813-70141de75879" status: 404 len: 111 microversion: 2.1 time: 0.059290 Sep 08 10:52:59.040688 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1706/3414] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:58 2022] GET /compute/v2.1/servers/0a2deb39-1e14-4009-a813-70141de75879 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:52:59.051722 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b6286ff2-7027-4f8a-9ee8-dc083bc2b1b3 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:59.052491 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b6286ff2-7027-4f8a-9ee8-dc083bc2b1b3 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:59.053084 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b6286ff2-7027-4f8a-9ee8-dc083bc2b1b3 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:59.054300 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b6286ff2-7027-4f8a-9ee8-dc083bc2b1b3 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:59.055002 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b6286ff2-7027-4f8a-9ee8-dc083bc2b1b3 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:59.055648 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b6286ff2-7027-4f8a-9ee8-dc083bc2b1b3 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:59.059013 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ddb70d6a-d7f3-484b-9889-1c2e2f5beee7 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:59.115378 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.compute.server_groups [None req-ddb70d6a-d7f3-484b-9889-1c2e2f5beee7 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Querying cell 2785b110-f847-4739-9d30-5b571c6d79f4(cell1) for 1 instances {{(pid=128862) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 08 10:52:59.116627 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ddb70d6a-d7f3-484b-9889-1c2e2f5beee7 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:59.117309 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ddb70d6a-d7f3-484b-9889-1c2e2f5beee7 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:59.117828 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ddb70d6a-d7f3-484b-9889-1c2e2f5beee7 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:59.132483 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ddb70d6a-d7f3-484b-9889-1c2e2f5beee7 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.082963 Sep 08 10:52:59.141698 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1707/3415] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Sep 8 10:52:59 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:52:59.152493 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-782a6389-653a-450e-b714-e99563bf3c42 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:59.171061 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.compute.server_groups [None req-782a6389-653a-450e-b714-e99563bf3c42 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Querying cell 2785b110-f847-4739-9d30-5b571c6d79f4(cell1) for 1 instances {{(pid=128862) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 08 10:52:59.172147 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-782a6389-653a-450e-b714-e99563bf3c42 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:59.172646 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-782a6389-653a-450e-b714-e99563bf3c42 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:59.173120 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-782a6389-653a-450e-b714-e99563bf3c42 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:59.188352 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-782a6389-653a-450e-b714-e99563bf3c42 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups/98578f2b-ffa3-452b-a365-f2d2ab6ae9c0" status: 200 len: 184 microversion: 2.1 time: 0.045409 Sep 08 10:52:59.188952 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1708/3416] 10.222.0.27 () {58 vars in 1263 bytes} [Thu Sep 8 10:52:59 2022] GET /compute/v2.1/os-server-groups/98578f2b-ffa3-452b-a365-f2d2ab6ae9c0 => generated 184 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:52:59.202604 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=18 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:52:59.207858 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5babc0c1-9892-4550-8475-ee576b385291 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:59.208363 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5babc0c1-9892-4550-8475-ee576b385291 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] [instance: 0a2deb39-1e14-4009-a813-70141de75879] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:59.216774 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5babc0c1-9892-4550-8475-ee576b385291 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:59.217827 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5babc0c1-9892-4550-8475-ee576b385291 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:59.218433 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5babc0c1-9892-4550-8475-ee576b385291 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:59.219321 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5babc0c1-9892-4550-8475-ee576b385291 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:59.220107 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5babc0c1-9892-4550-8475-ee576b385291 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:59.221006 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5babc0c1-9892-4550-8475-ee576b385291 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:59.240162 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-5babc0c1-9892-4550-8475-ee576b385291 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] HTTP exception thrown: Instance 0a2deb39-1e14-4009-a813-70141de75879 could not be found. Sep 08 10:52:59.242504 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5babc0c1-9892-4550-8475-ee576b385291 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Request method failure captured: Sep 08 10:52:59.242504 n-d-850501-12 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/servers/0a2deb39-1e14-4009-a813-70141de75879 HTTP/1.1 Sep 08 10:52:59.242504 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:52:59.242504 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:52:59.242504 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:52:59.242504 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:52:59.242504 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:52:59.242504 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:52:59.242504 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:52:59.242504 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:52:59.242504 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGclgwqelvO9cbcrdYeCMtNNdIXZpyOYufQbvJKY4OX691skfA9hTrHwgd21KQ6TcEcvC9ix29LtQqW1_QUWXwlSnObQSZvCCIB-27LSpNxBwFU2xCsd9yA3dvNH_Dg2uZRKmL75g85bDFgI3Ct1nITjwjnj10xAppViKIbNQNMWbp6s Sep 08 10:52:59.242504 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:52:59.242504 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:52:59.242504 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:52:59.242504 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:52:59.242504 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:52:59.242504 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:52:59.242504 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 1df398bd0b3f45e9b11fe4212d6b5729 Sep 08 10:52:59.242504 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServerGroupTestJSON-1684596102 Sep 08 10:52:59.242504 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:52:59.242504 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:52:59.242504 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1df398bd0b3f45e9b11fe4212d6b5729"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1df398bd0b3f45e9b11fe4212d6b5729"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1df398bd0b3f45e9b11fe4212d6b5729"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1df398bd0b3f45e9b11fe4212d6b5729"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:52:59.242504 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServerGroupTestJSON-1684596102 Sep 08 10:52:59.242504 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 1df398bd0b3f45e9b11fe4212d6b5729 Sep 08 10:52:59.242504 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServerGroupTestJSON-1684596102 Sep 08 10:52:59.242504 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServerGroupTestJSON-1684596102-project Sep 08 10:52:59.242504 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:52:59.242504 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:52:59.242504 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 4b1502b3b00c449399ac35378281d992 Sep 08 10:52:59.242504 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServerGroupTestJSON-1684596102-project Sep 08 10:52:59.242504 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:52:59.242504 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 0a2deb39-1e14-4009-a813-70141de75879 could not be found. Sep 08 10:52:59.242504 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '0a2deb39-1e14-4009-a813-70141de75879'} Sep 08 10:52:59.242504 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:52:59.242504 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:59.242504 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:52:59.242504 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:52:59.242504 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:52:59.242504 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:52:59.242504 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:52:59.242504 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:52:59.242504 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:52:59.242504 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:52:59.242504 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a2deb39-1e14-4009-a813-70141de75879 could not be found. Sep 08 10:52:59.242504 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:59.242504 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:52:59.242504 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:59.242504 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:59.242504 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:52:59.242504 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:52:59.242504 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:52:59.242504 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:52:59.242504 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:52:59.242504 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:52:59.242504 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:52:59.242504 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:52:59.242504 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:52:59.242504 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:52:59.242504 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:52:59.242504 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:52:59.242504 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:52:59.242504 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:52:59.248359 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a2deb39-1e14-4009-a813-70141de75879 could not be found. Sep 08 10:52:59.248359 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:59.248359 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:52:59.248359 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:59.248359 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:59.248359 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:52:59.248359 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:52:59.248359 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:52:59.248359 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:52:59.248359 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a2deb39-1e14-4009-a813-70141de75879 could not be found. Sep 08 10:52:59.248359 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:59.250237 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5babc0c1-9892-4550-8475-ee576b385291 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Returning 404 to user: Instance 0a2deb39-1e14-4009-a813-70141de75879 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:52:59.251301 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5babc0c1-9892-4550-8475-ee576b385291 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0a2deb39-1e14-4009-a813-70141de75879" status: 404 len: 111 microversion: 2.1 time: 0.054821 Sep 08 10:52:59.252074 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1709/3417] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:52:59 2022] DELETE /compute/v2.1/servers/0a2deb39-1e14-4009-a813-70141de75879 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:52:59.264893 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-efdc5397-3db8-4fe9-b6c9-3f297a716183 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:59.265956 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-efdc5397-3db8-4fe9-b6c9-3f297a716183 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] [instance: 0a2deb39-1e14-4009-a813-70141de75879] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:59.272934 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-efdc5397-3db8-4fe9-b6c9-3f297a716183 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:59.273816 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-efdc5397-3db8-4fe9-b6c9-3f297a716183 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:59.274428 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-efdc5397-3db8-4fe9-b6c9-3f297a716183 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:59.275351 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-efdc5397-3db8-4fe9-b6c9-3f297a716183 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:59.275981 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-efdc5397-3db8-4fe9-b6c9-3f297a716183 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:59.276567 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-efdc5397-3db8-4fe9-b6c9-3f297a716183 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:59.299637 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-efdc5397-3db8-4fe9-b6c9-3f297a716183 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] HTTP exception thrown: Instance 0a2deb39-1e14-4009-a813-70141de75879 could not be found. Sep 08 10:52:59.302966 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-efdc5397-3db8-4fe9-b6c9-3f297a716183 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Request method failure captured: Sep 08 10:52:59.302966 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/0a2deb39-1e14-4009-a813-70141de75879 HTTP/1.1 Sep 08 10:52:59.302966 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:52:59.302966 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:52:59.302966 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:52:59.302966 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:52:59.302966 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:52:59.302966 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:52:59.302966 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:52:59.302966 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:52:59.302966 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGclgwqelvO9cbcrdYeCMtNNdIXZpyOYufQbvJKY4OX691skfA9hTrHwgd21KQ6TcEcvC9ix29LtQqW1_QUWXwlSnObQSZvCCIB-27LSpNxBwFU2xCsd9yA3dvNH_Dg2uZRKmL75g85bDFgI3Ct1nITjwjnj10xAppViKIbNQNMWbp6s Sep 08 10:52:59.302966 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:52:59.302966 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:52:59.302966 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:52:59.302966 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:52:59.302966 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:52:59.302966 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:52:59.302966 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 1df398bd0b3f45e9b11fe4212d6b5729 Sep 08 10:52:59.302966 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServerGroupTestJSON-1684596102 Sep 08 10:52:59.302966 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:52:59.302966 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:52:59.302966 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1df398bd0b3f45e9b11fe4212d6b5729"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1df398bd0b3f45e9b11fe4212d6b5729"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1df398bd0b3f45e9b11fe4212d6b5729"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1df398bd0b3f45e9b11fe4212d6b5729"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:52:59.302966 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServerGroupTestJSON-1684596102 Sep 08 10:52:59.302966 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 1df398bd0b3f45e9b11fe4212d6b5729 Sep 08 10:52:59.302966 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServerGroupTestJSON-1684596102 Sep 08 10:52:59.302966 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServerGroupTestJSON-1684596102-project Sep 08 10:52:59.302966 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:52:59.302966 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:52:59.302966 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 4b1502b3b00c449399ac35378281d992 Sep 08 10:52:59.302966 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServerGroupTestJSON-1684596102-project Sep 08 10:52:59.302966 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:52:59.302966 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 0a2deb39-1e14-4009-a813-70141de75879 could not be found. Sep 08 10:52:59.302966 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '0a2deb39-1e14-4009-a813-70141de75879'} Sep 08 10:52:59.302966 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:52:59.302966 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:59.302966 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:52:59.302966 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:52:59.302966 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:52:59.302966 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:52:59.302966 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:52:59.302966 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:52:59.302966 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:52:59.302966 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:52:59.302966 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a2deb39-1e14-4009-a813-70141de75879 could not be found. Sep 08 10:52:59.302966 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:59.302966 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:52:59.302966 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:59.302966 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:59.302966 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:52:59.302966 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:52:59.302966 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:52:59.302966 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:52:59.302966 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:52:59.302966 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:52:59.302966 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:52:59.302966 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:52:59.302966 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:52:59.302966 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:52:59.302966 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:52:59.302966 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:52:59.302966 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a2deb39-1e14-4009-a813-70141de75879 could not be found. Sep 08 10:52:59.302966 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:59.302966 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:52:59.302966 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:59.313280 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:59.313280 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:52:59.313280 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:52:59.313280 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:52:59.313280 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:52:59.313280 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a2deb39-1e14-4009-a813-70141de75879 could not be found. Sep 08 10:52:59.313280 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:59.313280 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-efdc5397-3db8-4fe9-b6c9-3f297a716183 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Returning 404 to user: Instance 0a2deb39-1e14-4009-a813-70141de75879 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:52:59.313280 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-efdc5397-3db8-4fe9-b6c9-3f297a716183 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] 10.222.0.27 "GET /compute/v2.1/servers/0a2deb39-1e14-4009-a813-70141de75879" status: 404 len: 111 microversion: 2.1 time: 0.047708 Sep 08 10:52:59.313280 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1710/3418] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:59 2022] GET /compute/v2.1/servers/0a2deb39-1e14-4009-a813-70141de75879 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 10:52:59.315745 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1e4171d9-94cb-4b0c-87fd-98e7e5b31183 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:59.324328 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-1e4171d9-94cb-4b0c-87fd-98e7e5b31183 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] HTTP exception thrown: Instance group 3baed203-b777-4198-b76b-419b7501bbf8 could not be found. Sep 08 10:52:59.337432 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1e4171d9-94cb-4b0c-87fd-98e7e5b31183 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Request method failure captured: Sep 08 10:52:59.337432 n-d-850501-12 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/os-server-groups/3baed203-b777-4198-b76b-419b7501bbf8 HTTP/1.1 Sep 08 10:52:59.337432 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:52:59.337432 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:52:59.337432 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:52:59.337432 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:52:59.337432 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:52:59.337432 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:52:59.337432 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:52:59.337432 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:52:59.337432 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGclgwqelvO9cbcrdYeCMtNNdIXZpyOYufQbvJKY4OX691skfA9hTrHwgd21KQ6TcEcvC9ix29LtQqW1_QUWXwlSnObQSZvCCIB-27LSpNxBwFU2xCsd9yA3dvNH_Dg2uZRKmL75g85bDFgI3Ct1nITjwjnj10xAppViKIbNQNMWbp6s Sep 08 10:52:59.337432 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:52:59.337432 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:52:59.337432 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:52:59.337432 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:52:59.337432 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:52:59.337432 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:52:59.337432 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 1df398bd0b3f45e9b11fe4212d6b5729 Sep 08 10:52:59.337432 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServerGroupTestJSON-1684596102 Sep 08 10:52:59.337432 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:52:59.337432 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:52:59.337432 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1df398bd0b3f45e9b11fe4212d6b5729"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1df398bd0b3f45e9b11fe4212d6b5729"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1df398bd0b3f45e9b11fe4212d6b5729"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1df398bd0b3f45e9b11fe4212d6b5729"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:52:59.337432 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServerGroupTestJSON-1684596102 Sep 08 10:52:59.337432 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 1df398bd0b3f45e9b11fe4212d6b5729 Sep 08 10:52:59.337432 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServerGroupTestJSON-1684596102 Sep 08 10:52:59.337432 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServerGroupTestJSON-1684596102-project Sep 08 10:52:59.337432 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:52:59.337432 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:52:59.337432 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 4b1502b3b00c449399ac35378281d992 Sep 08 10:52:59.337432 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServerGroupTestJSON-1684596102-project Sep 08 10:52:59.337432 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:52:59.337432 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance group 3baed203-b777-4198-b76b-419b7501bbf8 could not be found. Sep 08 10:52:59.337432 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '3baed203-b777-4198-b76b-419b7501bbf8'} Sep 08 10:52:59.337432 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:52:59.337432 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:59.337432 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 08 10:52:59.337432 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 08 10:52:59.337432 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 10:52:59.337432 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 10:52:59.337432 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 08 10:52:59.337432 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 08 10:52:59.337432 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 08 10:52:59.337432 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 08 10:52:59.337432 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 08 10:52:59.337432 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 08 10:52:59.337432 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 3baed203-b777-4198-b76b-419b7501bbf8 could not be found. Sep 08 10:52:59.337432 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:59.337432 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:52:59.337432 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:59.337432 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:59.337432 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:52:59.337432 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:52:59.337432 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:52:59.337432 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:52:59.337432 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:52:59.337432 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:52:59.337432 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 08 10:52:59.337432 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:52:59.337432 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 3baed203-b777-4198-b76b-419b7501bbf8 could not be found. Sep 08 10:52:59.337432 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:59.337432 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:52:59.337432 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:59.337432 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:59.341955 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:52:59.341955 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:52:59.341955 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:52:59.341955 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:52:59.341955 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 3baed203-b777-4198-b76b-419b7501bbf8 could not be found. Sep 08 10:52:59.341955 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:59.343651 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1e4171d9-94cb-4b0c-87fd-98e7e5b31183 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Returning 404 to user: Instance group 3baed203-b777-4198-b76b-419b7501bbf8 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:52:59.344714 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1e4171d9-94cb-4b0c-87fd-98e7e5b31183 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/3baed203-b777-4198-b76b-419b7501bbf8" status: 404 len: 117 microversion: 2.1 time: 0.034328 Sep 08 10:52:59.346011 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1711/3419] 10.222.0.27 () {58 vars in 1266 bytes} [Thu Sep 8 10:52:59 2022] DELETE /compute/v2.1/os-server-groups/3baed203-b777-4198-b76b-419b7501bbf8 => generated 117 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:52:59.360521 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f6e870e7-49df-4878-8d13-09beb4729630 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:59.374559 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-f6e870e7-49df-4878-8d13-09beb4729630 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] HTTP exception thrown: Instance group 026b85ca-05d7-42ba-9811-4f0156e7cfed could not be found. Sep 08 10:52:59.376848 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f6e870e7-49df-4878-8d13-09beb4729630 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Request method failure captured: Sep 08 10:52:59.376848 n-d-850501-12 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/os-server-groups/026b85ca-05d7-42ba-9811-4f0156e7cfed HTTP/1.1 Sep 08 10:52:59.376848 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:52:59.376848 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:52:59.376848 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:52:59.376848 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:52:59.376848 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:52:59.376848 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:52:59.376848 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:52:59.376848 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:52:59.376848 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGclgwqelvO9cbcrdYeCMtNNdIXZpyOYufQbvJKY4OX691skfA9hTrHwgd21KQ6TcEcvC9ix29LtQqW1_QUWXwlSnObQSZvCCIB-27LSpNxBwFU2xCsd9yA3dvNH_Dg2uZRKmL75g85bDFgI3Ct1nITjwjnj10xAppViKIbNQNMWbp6s Sep 08 10:52:59.376848 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:52:59.376848 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:52:59.376848 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:52:59.376848 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:52:59.376848 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:52:59.376848 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:52:59.376848 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 1df398bd0b3f45e9b11fe4212d6b5729 Sep 08 10:52:59.376848 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServerGroupTestJSON-1684596102 Sep 08 10:52:59.376848 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:52:59.376848 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:52:59.376848 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1df398bd0b3f45e9b11fe4212d6b5729"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1df398bd0b3f45e9b11fe4212d6b5729"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1df398bd0b3f45e9b11fe4212d6b5729"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1df398bd0b3f45e9b11fe4212d6b5729"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:52:59.376848 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServerGroupTestJSON-1684596102 Sep 08 10:52:59.376848 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 1df398bd0b3f45e9b11fe4212d6b5729 Sep 08 10:52:59.376848 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServerGroupTestJSON-1684596102 Sep 08 10:52:59.376848 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServerGroupTestJSON-1684596102-project Sep 08 10:52:59.376848 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:52:59.376848 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:52:59.376848 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 4b1502b3b00c449399ac35378281d992 Sep 08 10:52:59.376848 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServerGroupTestJSON-1684596102-project Sep 08 10:52:59.376848 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:52:59.376848 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance group 026b85ca-05d7-42ba-9811-4f0156e7cfed could not be found. Sep 08 10:52:59.376848 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '026b85ca-05d7-42ba-9811-4f0156e7cfed'} Sep 08 10:52:59.376848 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:52:59.376848 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:59.376848 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 08 10:52:59.376848 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 08 10:52:59.376848 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 10:52:59.376848 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 10:52:59.376848 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 08 10:52:59.376848 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 08 10:52:59.376848 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 08 10:52:59.376848 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 08 10:52:59.376848 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 08 10:52:59.376848 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 08 10:52:59.376848 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 026b85ca-05d7-42ba-9811-4f0156e7cfed could not be found. Sep 08 10:52:59.376848 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:59.376848 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:52:59.376848 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:59.376848 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:59.376848 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:52:59.376848 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:52:59.376848 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:52:59.376848 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:52:59.376848 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:52:59.376848 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:52:59.376848 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 08 10:52:59.376848 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:52:59.376848 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 026b85ca-05d7-42ba-9811-4f0156e7cfed could not be found. Sep 08 10:52:59.376848 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:59.376848 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:52:59.376848 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:59.376848 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:59.381278 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:52:59.381278 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:52:59.381278 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:52:59.381278 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:52:59.381278 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 026b85ca-05d7-42ba-9811-4f0156e7cfed could not be found. Sep 08 10:52:59.381278 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:59.383252 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f6e870e7-49df-4878-8d13-09beb4729630 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Returning 404 to user: Instance group 026b85ca-05d7-42ba-9811-4f0156e7cfed could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:52:59.384621 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f6e870e7-49df-4878-8d13-09beb4729630 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/026b85ca-05d7-42ba-9811-4f0156e7cfed" status: 404 len: 117 microversion: 2.1 time: 0.029379 Sep 08 10:52:59.386656 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1712/3420] 10.222.0.27 () {58 vars in 1266 bytes} [Thu Sep 8 10:52:59 2022] DELETE /compute/v2.1/os-server-groups/026b85ca-05d7-42ba-9811-4f0156e7cfed => generated 117 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 10:52:59.410727 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b6286ff2-7027-4f8a-9ee8-dc083bc2b1b3 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:59.412348 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fd775791-47d5-44d2-994b-40132ebd7565 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:59.428675 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-fd775791-47d5-44d2-994b-40132ebd7565 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] HTTP exception thrown: Instance group 615dbeab-e4e0-4fe0-9f51-fa59a230d666 could not be found. Sep 08 10:52:59.433256 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fd775791-47d5-44d2-994b-40132ebd7565 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Request method failure captured: Sep 08 10:52:59.433256 n-d-850501-12 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/os-server-groups/615dbeab-e4e0-4fe0-9f51-fa59a230d666 HTTP/1.1 Sep 08 10:52:59.433256 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:52:59.433256 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:52:59.433256 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:52:59.433256 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:52:59.433256 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:52:59.433256 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:52:59.433256 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:52:59.433256 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:52:59.433256 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGclgwqelvO9cbcrdYeCMtNNdIXZpyOYufQbvJKY4OX691skfA9hTrHwgd21KQ6TcEcvC9ix29LtQqW1_QUWXwlSnObQSZvCCIB-27LSpNxBwFU2xCsd9yA3dvNH_Dg2uZRKmL75g85bDFgI3Ct1nITjwjnj10xAppViKIbNQNMWbp6s Sep 08 10:52:59.433256 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:52:59.433256 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:52:59.433256 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:52:59.433256 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:52:59.433256 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:52:59.433256 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:52:59.433256 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 1df398bd0b3f45e9b11fe4212d6b5729 Sep 08 10:52:59.433256 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServerGroupTestJSON-1684596102 Sep 08 10:52:59.433256 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:52:59.433256 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:52:59.433256 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1df398bd0b3f45e9b11fe4212d6b5729"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1df398bd0b3f45e9b11fe4212d6b5729"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1df398bd0b3f45e9b11fe4212d6b5729"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1df398bd0b3f45e9b11fe4212d6b5729"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:52:59.433256 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServerGroupTestJSON-1684596102 Sep 08 10:52:59.433256 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 1df398bd0b3f45e9b11fe4212d6b5729 Sep 08 10:52:59.433256 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServerGroupTestJSON-1684596102 Sep 08 10:52:59.433256 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServerGroupTestJSON-1684596102-project Sep 08 10:52:59.433256 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:52:59.433256 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:52:59.433256 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 4b1502b3b00c449399ac35378281d992 Sep 08 10:52:59.433256 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServerGroupTestJSON-1684596102-project Sep 08 10:52:59.433256 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:52:59.433256 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance group 615dbeab-e4e0-4fe0-9f51-fa59a230d666 could not be found. Sep 08 10:52:59.433256 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '615dbeab-e4e0-4fe0-9f51-fa59a230d666'} Sep 08 10:52:59.433256 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:52:59.433256 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:59.433256 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 08 10:52:59.433256 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 08 10:52:59.433256 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 10:52:59.433256 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 10:52:59.433256 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 08 10:52:59.433256 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 08 10:52:59.433256 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 08 10:52:59.433256 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 08 10:52:59.433256 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 08 10:52:59.433256 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 08 10:52:59.433256 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 615dbeab-e4e0-4fe0-9f51-fa59a230d666 could not be found. Sep 08 10:52:59.433256 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:59.433256 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:52:59.433256 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:59.433256 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:59.433256 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:52:59.433256 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:52:59.433256 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:52:59.433256 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:52:59.433256 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:52:59.433256 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:52:59.433256 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 08 10:52:59.433256 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:52:59.433256 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 615dbeab-e4e0-4fe0-9f51-fa59a230d666 could not be found. Sep 08 10:52:59.433256 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:59.433256 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:52:59.433256 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:59.433256 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:59.438248 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:52:59.438248 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:52:59.438248 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:52:59.438248 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:52:59.438248 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 615dbeab-e4e0-4fe0-9f51-fa59a230d666 could not be found. Sep 08 10:52:59.438248 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:52:59.439045 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fd775791-47d5-44d2-994b-40132ebd7565 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Returning 404 to user: Instance group 615dbeab-e4e0-4fe0-9f51-fa59a230d666 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:52:59.440524 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fd775791-47d5-44d2-994b-40132ebd7565 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/615dbeab-e4e0-4fe0-9f51-fa59a230d666" status: 404 len: 117 microversion: 2.1 time: 0.049207 Sep 08 10:52:59.440524 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1713/3421] 10.222.0.27 () {58 vars in 1266 bytes} [Thu Sep 8 10:52:59 2022] DELETE /compute/v2.1/os-server-groups/615dbeab-e4e0-4fe0-9f51-fa59a230d666 => generated 117 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 10:52:59.445564 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b6286ff2-7027-4f8a-9ee8-dc083bc2b1b3 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d" status: 200 len: 1522 microversion: 2.1 time: 0.436615 Sep 08 10:52:59.457889 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-61d807f3-1650-431a-a8a9-ca85bd798e2f req-51a37d30-1bbd-47f0-a9fc-9e5f392ab605 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a2deb39-1e14-4009-a813-70141de75879", "name": "network-vif-deleted", "tag": "d70fc082-1f91-4375-a1da-066df7bba089"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:52:59.466896 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1709/3422] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:59 2022] GET /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d => generated 1522 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:59.483684 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a68d9011-104b-45e1-b731-7c36fd895d07 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:59.488980 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-61d807f3-1650-431a-a8a9-ca85bd798e2f req-51a37d30-1bbd-47f0-a9fc-9e5f392ab605 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:59.489530 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-61d807f3-1650-431a-a8a9-ca85bd798e2f req-51a37d30-1bbd-47f0-a9fc-9e5f392ab605 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:59.489974 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-61d807f3-1650-431a-a8a9-ca85bd798e2f req-51a37d30-1bbd-47f0-a9fc-9e5f392ab605 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:59.495476 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-a68d9011-104b-45e1-b731-7c36fd895d07 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] HTTP exception thrown: Instance group d1ef628b-0ea7-4260-8100-a1f0831e05d9 could not be found. Sep 08 10:52:59.500196 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a68d9011-104b-45e1-b731-7c36fd895d07 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Request method failure captured: Sep 08 10:52:59.500196 n-d-850501-12 devstack@n-api.service[128861]: request: DELETE /compute/v2.1/os-server-groups/d1ef628b-0ea7-4260-8100-a1f0831e05d9 HTTP/1.1 Sep 08 10:52:59.500196 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:52:59.500196 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:52:59.500196 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:52:59.500196 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:52:59.500196 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:52:59.500196 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:52:59.500196 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:52:59.500196 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:52:59.500196 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGclgwqelvO9cbcrdYeCMtNNdIXZpyOYufQbvJKY4OX691skfA9hTrHwgd21KQ6TcEcvC9ix29LtQqW1_QUWXwlSnObQSZvCCIB-27LSpNxBwFU2xCsd9yA3dvNH_Dg2uZRKmL75g85bDFgI3Ct1nITjwjnj10xAppViKIbNQNMWbp6s Sep 08 10:52:59.500196 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:52:59.500196 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:52:59.500196 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:52:59.500196 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:52:59.500196 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:52:59.500196 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:52:59.500196 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 1df398bd0b3f45e9b11fe4212d6b5729 Sep 08 10:52:59.500196 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServerGroupTestJSON-1684596102 Sep 08 10:52:59.500196 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:52:59.500196 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:52:59.500196 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1df398bd0b3f45e9b11fe4212d6b5729"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1df398bd0b3f45e9b11fe4212d6b5729"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1df398bd0b3f45e9b11fe4212d6b5729"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1df398bd0b3f45e9b11fe4212d6b5729"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:52:59.500196 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServerGroupTestJSON-1684596102 Sep 08 10:52:59.500196 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 1df398bd0b3f45e9b11fe4212d6b5729 Sep 08 10:52:59.500196 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServerGroupTestJSON-1684596102 Sep 08 10:52:59.500196 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServerGroupTestJSON-1684596102-project Sep 08 10:52:59.500196 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:52:59.500196 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:52:59.500196 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 4b1502b3b00c449399ac35378281d992 Sep 08 10:52:59.500196 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServerGroupTestJSON-1684596102-project Sep 08 10:52:59.500196 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:52:59.500196 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance group d1ef628b-0ea7-4260-8100-a1f0831e05d9 could not be found. Sep 08 10:52:59.500196 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': 'd1ef628b-0ea7-4260-8100-a1f0831e05d9'} Sep 08 10:52:59.500196 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:52:59.500196 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:59.500196 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 08 10:52:59.500196 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 08 10:52:59.500196 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 10:52:59.500196 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 10:52:59.500196 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 08 10:52:59.500196 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 08 10:52:59.500196 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 08 10:52:59.500196 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 08 10:52:59.500196 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 08 10:52:59.500196 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 08 10:52:59.500196 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group d1ef628b-0ea7-4260-8100-a1f0831e05d9 could not be found. Sep 08 10:52:59.500196 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:52:59.500196 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:52:59.500196 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:52:59.500196 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:59.500196 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:52:59.500196 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:52:59.500196 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:52:59.500196 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:52:59.500196 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:52:59.500196 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:52:59.500196 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 08 10:52:59.500196 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:52:59.500196 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group d1ef628b-0ea7-4260-8100-a1f0831e05d9 could not be found. Sep 08 10:52:59.500196 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:52:59.500196 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:52:59.500196 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:52:59.500196 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:59.504453 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:52:59.504453 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:52:59.504453 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:52:59.504453 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:52:59.504453 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group d1ef628b-0ea7-4260-8100-a1f0831e05d9 could not be found. Sep 08 10:52:59.504453 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:52:59.507297 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a68d9011-104b-45e1-b731-7c36fd895d07 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Returning 404 to user: Instance group d1ef628b-0ea7-4260-8100-a1f0831e05d9 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:52:59.508195 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a68d9011-104b-45e1-b731-7c36fd895d07 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/d1ef628b-0ea7-4260-8100-a1f0831e05d9" status: 404 len: 117 microversion: 2.1 time: 0.038500 Sep 08 10:52:59.511947 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1710/3423] 10.222.0.27 () {58 vars in 1266 bytes} [Thu Sep 8 10:52:59 2022] DELETE /compute/v2.1/os-server-groups/d1ef628b-0ea7-4260-8100-a1f0831e05d9 => generated 117 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:52:59.522174 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-82818755-2957-4914-879d-2e9d05ec47f6 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:59.528073 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-61d807f3-1650-431a-a8a9-ca85bd798e2f req-51a37d30-1bbd-47f0-a9fc-9e5f392ab605 service nova] Creating event network-vif-deleted:d70fc082-1f91-4375-a1da-066df7bba089 for instance 0a2deb39-1e14-4009-a813-70141de75879 on n-h1-850501-12 Sep 08 10:52:59.546701 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-61d807f3-1650-431a-a8a9-ca85bd798e2f req-51a37d30-1bbd-47f0-a9fc-9e5f392ab605 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105192 Sep 08 10:52:59.550647 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1714/3424] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:52:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:52:59.582602 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-82818755-2957-4914-879d-2e9d05ec47f6 tempest-ServerGroupTestJSON-1684596102 tempest-ServerGroupTestJSON-1684596102-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/98578f2b-ffa3-452b-a365-f2d2ab6ae9c0" status: 204 len: 0 microversion: 2.1 time: 0.068842 Sep 08 10:52:59.583215 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1711/3425] 10.222.0.27 () {58 vars in 1266 bytes} [Thu Sep 8 10:52:59 2022] DELETE /compute/v2.1/os-server-groups/98578f2b-ffa3-452b-a365-f2d2ab6ae9c0 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 10:52:59.874008 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-daa6c802-3619-4776-adb1-e77170cbb11c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:59.876088 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-daa6c802-3619-4776-adb1-e77170cbb11c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: 19604289-6d42-403f-bf74-75335e1782cb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:59.883878 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-daa6c802-3619-4776-adb1-e77170cbb11c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:59.884919 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-daa6c802-3619-4776-adb1-e77170cbb11c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:59.886899 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-daa6c802-3619-4776-adb1-e77170cbb11c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:59.889670 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-daa6c802-3619-4776-adb1-e77170cbb11c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:59.890451 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-daa6c802-3619-4776-adb1-e77170cbb11c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:59.891199 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-daa6c802-3619-4776-adb1-e77170cbb11c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:59.893976 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-133d0ac1-778e-4744-b599-abccfd7e0bb0 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:59.894605 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-133d0ac1-778e-4744-b599-abccfd7e0bb0 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] [instance: 50feb7c3-9282-44b6-ad37-bf09e2d3f5a8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:59.902588 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-133d0ac1-778e-4744-b599-abccfd7e0bb0 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:59.903292 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-133d0ac1-778e-4744-b599-abccfd7e0bb0 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:59.903756 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-133d0ac1-778e-4744-b599-abccfd7e0bb0 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:59.912878 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-133d0ac1-778e-4744-b599-abccfd7e0bb0 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:59.913541 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-133d0ac1-778e-4744-b599-abccfd7e0bb0 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:59.913997 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-133d0ac1-778e-4744-b599-abccfd7e0bb0 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:59.916693 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:53:00.945925 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-133d0ac1-778e-4744-b599-abccfd7e0bb0 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c4b351a0a4ccabbfb5438b5c535e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bb5f5b56a2402999719f0374228ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:00.966854 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-133d0ac1-778e-4744-b599-abccfd7e0bb0 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] 10.222.0.27 "GET /compute/v2.1/servers/50feb7c3-9282-44b6-ad37-bf09e2d3f5a8" status: 200 len: 1324 microversion: 2.1 time: 1.072376 Sep 08 10:53:00.968171 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1712/3426] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:59 2022] GET /compute/v2.1/servers/50feb7c3-9282-44b6-ad37-bf09e2d3f5a8 => generated 1324 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:00.975824 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-dcee3249-e993-4502-9506-77b2dbeed9cc tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:00.976941 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-dcee3249-e993-4502-9506-77b2dbeed9cc tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: a882cf75-539a-45fa-ae2b-4e0f043b340d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:00.995340 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dcee3249-e993-4502-9506-77b2dbeed9cc tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:00.996029 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dcee3249-e993-4502-9506-77b2dbeed9cc tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:00.996579 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dcee3249-e993-4502-9506-77b2dbeed9cc tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:00.997450 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dcee3249-e993-4502-9506-77b2dbeed9cc tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:00.998020 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dcee3249-e993-4502-9506-77b2dbeed9cc tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:00.998558 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dcee3249-e993-4502-9506-77b2dbeed9cc tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:01.178497 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-daa6c802-3619-4776-adb1-e77170cbb11c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c291cbe955b4ee5abc98132dda0255e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f9a24cad014d7f827e8f3236dd5bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:01.187292 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-daa6c802-3619-4776-adb1-e77170cbb11c tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/19604289-6d42-403f-bf74-75335e1782cb" status: 200 len: 1365 microversion: 2.1 time: 1.319041 Sep 08 10:53:01.188498 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1715/3427] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:59 2022] GET /compute/v2.1/servers/19604289-6d42-403f-bf74-75335e1782cb => generated 1365 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:01.403105 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-dcee3249-e993-4502-9506-77b2dbeed9cc tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:01.422744 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-dcee3249-e993-4502-9506-77b2dbeed9cc tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d" status: 200 len: 1522 microversion: 2.1 time: 0.452426 Sep 08 10:53:01.437087 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1713/3428] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:00 2022] GET /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d => generated 1522 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:01.593339 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-4e74a52e-cf73-42d0-a743-1a8ff73ffdf2 req-27727c37-3738-4178-8876-ed5d0b0c9983 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19604289-6d42-403f-bf74-75335e1782cb", "tag": "0ee5bff2-0477-4282-8e7e-4965352d2a29"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:53:01.613567 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-4e74a52e-cf73-42d0-a743-1a8ff73ffdf2 req-27727c37-3738-4178-8876-ed5d0b0c9983 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:01.614086 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-4e74a52e-cf73-42d0-a743-1a8ff73ffdf2 req-27727c37-3738-4178-8876-ed5d0b0c9983 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:01.614511 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-4e74a52e-cf73-42d0-a743-1a8ff73ffdf2 req-27727c37-3738-4178-8876-ed5d0b0c9983 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:01.642402 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-4e74a52e-cf73-42d0-a743-1a8ff73ffdf2 req-27727c37-3738-4178-8876-ed5d0b0c9983 service nova] Creating event network-changed:0ee5bff2-0477-4282-8e7e-4965352d2a29 for instance 19604289-6d42-403f-bf74-75335e1782cb on n-h1-850501-12 Sep 08 10:53:01.660570 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-4e74a52e-cf73-42d0-a743-1a8ff73ffdf2 req-27727c37-3738-4178-8876-ed5d0b0c9983 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069754 Sep 08 10:53:01.665309 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1716/3429] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:53:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:53:01.993618 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d9de645a-3c4e-4171-aa43-59f9907f8b3f tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:01.994199 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d9de645a-3c4e-4171-aa43-59f9907f8b3f tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] [instance: 50feb7c3-9282-44b6-ad37-bf09e2d3f5a8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:01.997872 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:53:02.030774 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d9de645a-3c4e-4171-aa43-59f9907f8b3f tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:02.031812 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d9de645a-3c4e-4171-aa43-59f9907f8b3f tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:02.032442 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d9de645a-3c4e-4171-aa43-59f9907f8b3f tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:02.033417 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d9de645a-3c4e-4171-aa43-59f9907f8b3f tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:02.034722 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d9de645a-3c4e-4171-aa43-59f9907f8b3f tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:02.035338 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d9de645a-3c4e-4171-aa43-59f9907f8b3f tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:02.219604 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-62b9682d-3551-463e-9c0e-8265bef257ef tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:02.222460 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-62b9682d-3551-463e-9c0e-8265bef257ef tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: 19604289-6d42-403f-bf74-75335e1782cb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:02.235591 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-62b9682d-3551-463e-9c0e-8265bef257ef tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:02.236680 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-62b9682d-3551-463e-9c0e-8265bef257ef tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:02.237789 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-62b9682d-3551-463e-9c0e-8265bef257ef tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:02.245544 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-62b9682d-3551-463e-9c0e-8265bef257ef tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:02.245544 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-62b9682d-3551-463e-9c0e-8265bef257ef tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:02.246343 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-62b9682d-3551-463e-9c0e-8265bef257ef tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:02.497380 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d9de645a-3c4e-4171-aa43-59f9907f8b3f tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c4b351a0a4ccabbfb5438b5c535e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bb5f5b56a2402999719f0374228ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:02.507378 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d9de645a-3c4e-4171-aa43-59f9907f8b3f tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] 10.222.0.27 "GET /compute/v2.1/servers/50feb7c3-9282-44b6-ad37-bf09e2d3f5a8" status: 200 len: 1324 microversion: 2.1 time: 0.518713 Sep 08 10:53:02.522391 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1714/3430] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:01 2022] GET /compute/v2.1/servers/50feb7c3-9282-44b6-ad37-bf09e2d3f5a8 => generated 1324 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:02.527934 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b21ebe1c-7600-4ca3-8654-12d10d5a7c93 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:02.528602 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b21ebe1c-7600-4ca3-8654-12d10d5a7c93 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: a882cf75-539a-45fa-ae2b-4e0f043b340d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:02.543777 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b21ebe1c-7600-4ca3-8654-12d10d5a7c93 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:02.544204 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b21ebe1c-7600-4ca3-8654-12d10d5a7c93 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:02.546664 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b21ebe1c-7600-4ca3-8654-12d10d5a7c93 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:02.547863 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b21ebe1c-7600-4ca3-8654-12d10d5a7c93 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:02.551756 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b21ebe1c-7600-4ca3-8654-12d10d5a7c93 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:02.552597 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b21ebe1c-7600-4ca3-8654-12d10d5a7c93 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:02.607185 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-62b9682d-3551-463e-9c0e-8265bef257ef tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c291cbe955b4ee5abc98132dda0255e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f9a24cad014d7f827e8f3236dd5bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:02.615352 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-62b9682d-3551-463e-9c0e-8265bef257ef tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/19604289-6d42-403f-bf74-75335e1782cb" status: 200 len: 1365 microversion: 2.1 time: 0.406993 Sep 08 10:53:02.620589 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1717/3431] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:02 2022] GET /compute/v2.1/servers/19604289-6d42-403f-bf74-75335e1782cb => generated 1365 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:03.065081 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b21ebe1c-7600-4ca3-8654-12d10d5a7c93 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:03.076561 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b21ebe1c-7600-4ca3-8654-12d10d5a7c93 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d" status: 200 len: 1522 microversion: 2.1 time: 0.563156 Sep 08 10:53:03.105154 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1715/3432] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:02 2022] GET /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d => generated 1522 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:03.541186 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ee6db8f6-1a16-477d-91af-7247edd378d6 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:03.542582 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ee6db8f6-1a16-477d-91af-7247edd378d6 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] [instance: 50feb7c3-9282-44b6-ad37-bf09e2d3f5a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:03.550153 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ee6db8f6-1a16-477d-91af-7247edd378d6 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:03.551214 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ee6db8f6-1a16-477d-91af-7247edd378d6 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:03.551947 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ee6db8f6-1a16-477d-91af-7247edd378d6 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:03.553244 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ee6db8f6-1a16-477d-91af-7247edd378d6 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:03.554146 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ee6db8f6-1a16-477d-91af-7247edd378d6 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:03.554844 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ee6db8f6-1a16-477d-91af-7247edd378d6 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:03.655242 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1780cf4f-4404-4048-9750-a96d8a73a565 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:03.657269 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1780cf4f-4404-4048-9750-a96d8a73a565 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: 19604289-6d42-403f-bf74-75335e1782cb] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:03.674601 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1780cf4f-4404-4048-9750-a96d8a73a565 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:03.676158 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1780cf4f-4404-4048-9750-a96d8a73a565 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:03.677678 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1780cf4f-4404-4048-9750-a96d8a73a565 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:03.681517 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1780cf4f-4404-4048-9750-a96d8a73a565 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:03.682963 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1780cf4f-4404-4048-9750-a96d8a73a565 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:03.684737 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1780cf4f-4404-4048-9750-a96d8a73a565 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:04.088082 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ee6db8f6-1a16-477d-91af-7247edd378d6 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c4b351a0a4ccabbfb5438b5c535e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bb5f5b56a2402999719f0374228ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:04.101972 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ee6db8f6-1a16-477d-91af-7247edd378d6 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] 10.222.0.27 "GET /compute/v2.1/servers/50feb7c3-9282-44b6-ad37-bf09e2d3f5a8" status: 200 len: 1324 microversion: 2.1 time: 0.565555 Sep 08 10:53:04.120504 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1718/3433] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:03 2022] GET /compute/v2.1/servers/50feb7c3-9282-44b6-ad37-bf09e2d3f5a8 => generated 1324 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:04.125640 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-91113065-9131-4548-9de4-4da533d80a21 req-c2647fa3-cb4e-4b34-8ee2-c6a813cdce3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50feb7c3-9282-44b6-ad37-bf09e2d3f5a8", "name": "network-vif-plugged", "status": "completed", "tag": "ca13d9de-91b0-46ce-8809-9fde8d4724a3"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:53:04.144757 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-91113065-9131-4548-9de4-4da533d80a21 req-c2647fa3-cb4e-4b34-8ee2-c6a813cdce3d service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:04.146140 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-91113065-9131-4548-9de4-4da533d80a21 req-c2647fa3-cb4e-4b34-8ee2-c6a813cdce3d service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:04.147242 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-91113065-9131-4548-9de4-4da533d80a21 req-c2647fa3-cb4e-4b34-8ee2-c6a813cdce3d service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:04.202199 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-91113065-9131-4548-9de4-4da533d80a21 req-c2647fa3-cb4e-4b34-8ee2-c6a813cdce3d service nova] Creating event network-vif-plugged:ca13d9de-91b0-46ce-8809-9fde8d4724a3 for instance 50feb7c3-9282-44b6-ad37-bf09e2d3f5a8 on n-h2-850501-12 Sep 08 10:53:04.209137 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-91113065-9131-4548-9de4-4da533d80a21 req-c2647fa3-cb4e-4b34-8ee2-c6a813cdce3d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086725 Sep 08 10:53:04.210884 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1719/3434] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:53:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:53:04.233041 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5f3d5394-1bfa-4604-a22d-eddb99d56ea1 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:04.236076 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5f3d5394-1bfa-4604-a22d-eddb99d56ea1 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: a882cf75-539a-45fa-ae2b-4e0f043b340d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:04.272868 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5f3d5394-1bfa-4604-a22d-eddb99d56ea1 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:04.280631 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5f3d5394-1bfa-4604-a22d-eddb99d56ea1 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:04.282113 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5f3d5394-1bfa-4604-a22d-eddb99d56ea1 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:04.283068 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5f3d5394-1bfa-4604-a22d-eddb99d56ea1 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:04.294229 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5f3d5394-1bfa-4604-a22d-eddb99d56ea1 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:04.295483 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5f3d5394-1bfa-4604-a22d-eddb99d56ea1 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:04.296995 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1780cf4f-4404-4048-9750-a96d8a73a565 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c291cbe955b4ee5abc98132dda0255e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f9a24cad014d7f827e8f3236dd5bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:04.328074 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1780cf4f-4404-4048-9750-a96d8a73a565 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/19604289-6d42-403f-bf74-75335e1782cb" status: 200 len: 1365 microversion: 2.1 time: 0.671186 Sep 08 10:53:04.331121 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1716/3435] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:03 2022] GET /compute/v2.1/servers/19604289-6d42-403f-bf74-75335e1782cb => generated 1365 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:04.689174 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5f3d5394-1bfa-4604-a22d-eddb99d56ea1 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:04.704117 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5f3d5394-1bfa-4604-a22d-eddb99d56ea1 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d" status: 200 len: 1522 microversion: 2.1 time: 0.491724 Sep 08 10:53:04.707213 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1720/3436] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:04 2022] GET /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d => generated 1522 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:05.127954 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9eae2a7f-49ac-46ea-abbf-62bfffccbe54 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:05.128720 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9eae2a7f-49ac-46ea-abbf-62bfffccbe54 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] [instance: 50feb7c3-9282-44b6-ad37-bf09e2d3f5a8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:05.140365 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9eae2a7f-49ac-46ea-abbf-62bfffccbe54 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:05.145749 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9eae2a7f-49ac-46ea-abbf-62bfffccbe54 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:05.146353 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9eae2a7f-49ac-46ea-abbf-62bfffccbe54 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:05.147351 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9eae2a7f-49ac-46ea-abbf-62bfffccbe54 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:05.153135 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9eae2a7f-49ac-46ea-abbf-62bfffccbe54 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:05.153958 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9eae2a7f-49ac-46ea-abbf-62bfffccbe54 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:05.183494 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:53:05.355253 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ed6e91c0-da90-4630-a99c-a9a69c3cfa88 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:05.355807 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ed6e91c0-da90-4630-a99c-a9a69c3cfa88 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: 19604289-6d42-403f-bf74-75335e1782cb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:05.366575 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ed6e91c0-da90-4630-a99c-a9a69c3cfa88 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:05.377844 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ed6e91c0-da90-4630-a99c-a9a69c3cfa88 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:05.378582 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ed6e91c0-da90-4630-a99c-a9a69c3cfa88 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:05.379873 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ed6e91c0-da90-4630-a99c-a9a69c3cfa88 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:05.380521 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ed6e91c0-da90-4630-a99c-a9a69c3cfa88 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:05.381273 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ed6e91c0-da90-4630-a99c-a9a69c3cfa88 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:05.961924 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9eae2a7f-49ac-46ea-abbf-62bfffccbe54 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c4b351a0a4ccabbfb5438b5c535e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bb5f5b56a2402999719f0374228ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:05.981054 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9eae2a7f-49ac-46ea-abbf-62bfffccbe54 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] 10.222.0.27 "GET /compute/v2.1/servers/50feb7c3-9282-44b6-ad37-bf09e2d3f5a8" status: 200 len: 1324 microversion: 2.1 time: 0.855446 Sep 08 10:53:05.981574 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ed6e91c0-da90-4630-a99c-a9a69c3cfa88 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c291cbe955b4ee5abc98132dda0255e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f9a24cad014d7f827e8f3236dd5bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:05.983795 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1717/3437] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:05 2022] GET /compute/v2.1/servers/50feb7c3-9282-44b6-ad37-bf09e2d3f5a8 => generated 1324 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:05.995232 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-baea1823-7094-41d1-99b4-b99a86809782 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:05.995980 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-baea1823-7094-41d1-99b4-b99a86809782 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: a882cf75-539a-45fa-ae2b-4e0f043b340d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:06.014987 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-baea1823-7094-41d1-99b4-b99a86809782 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:06.016722 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-baea1823-7094-41d1-99b4-b99a86809782 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:06.017261 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-baea1823-7094-41d1-99b4-b99a86809782 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:06.020328 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-baea1823-7094-41d1-99b4-b99a86809782 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:06.021919 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-baea1823-7094-41d1-99b4-b99a86809782 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:06.024110 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-baea1823-7094-41d1-99b4-b99a86809782 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:06.030183 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ed6e91c0-da90-4630-a99c-a9a69c3cfa88 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/19604289-6d42-403f-bf74-75335e1782cb" status: 200 len: 1365 microversion: 2.1 time: 0.675432 Sep 08 10:53:06.046974 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1721/3438] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:05 2022] GET /compute/v2.1/servers/19604289-6d42-403f-bf74-75335e1782cb => generated 1365 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:53:07.010553 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-996320b1-27b6-4ad0-bd26-d2d2dc5f1d67 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:07.013606 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-996320b1-27b6-4ad0-bd26-d2d2dc5f1d67 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] [instance: 50feb7c3-9282-44b6-ad37-bf09e2d3f5a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:07.049906 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-996320b1-27b6-4ad0-bd26-d2d2dc5f1d67 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:07.050460 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-996320b1-27b6-4ad0-bd26-d2d2dc5f1d67 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:07.050922 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-996320b1-27b6-4ad0-bd26-d2d2dc5f1d67 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:07.051680 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-996320b1-27b6-4ad0-bd26-d2d2dc5f1d67 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:07.054113 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-baea1823-7094-41d1-99b4-b99a86809782 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:07.055427 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-996320b1-27b6-4ad0-bd26-d2d2dc5f1d67 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:07.056502 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-996320b1-27b6-4ad0-bd26-d2d2dc5f1d67 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:07.066547 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-baea1823-7094-41d1-99b4-b99a86809782 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d" status: 200 len: 1522 microversion: 2.1 time: 1.080260 Sep 08 10:53:07.076123 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1718/3439] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:05 2022] GET /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d => generated 1522 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:07.105852 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1ba8d0b1-98c5-4bc4-b1bc-7ae3f74e43e0 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:07.106887 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1ba8d0b1-98c5-4bc4-b1bc-7ae3f74e43e0 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: 19604289-6d42-403f-bf74-75335e1782cb] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:07.135185 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1ba8d0b1-98c5-4bc4-b1bc-7ae3f74e43e0 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:07.140551 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1ba8d0b1-98c5-4bc4-b1bc-7ae3f74e43e0 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:07.141429 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1ba8d0b1-98c5-4bc4-b1bc-7ae3f74e43e0 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:07.143615 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1ba8d0b1-98c5-4bc4-b1bc-7ae3f74e43e0 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:07.145947 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1ba8d0b1-98c5-4bc4-b1bc-7ae3f74e43e0 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:07.146968 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1ba8d0b1-98c5-4bc4-b1bc-7ae3f74e43e0 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:07.720240 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1ba8d0b1-98c5-4bc4-b1bc-7ae3f74e43e0 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c291cbe955b4ee5abc98132dda0255e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f9a24cad014d7f827e8f3236dd5bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:07.723752 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-996320b1-27b6-4ad0-bd26-d2d2dc5f1d67 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c4b351a0a4ccabbfb5438b5c535e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bb5f5b56a2402999719f0374228ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:07.743087 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1ba8d0b1-98c5-4bc4-b1bc-7ae3f74e43e0 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/19604289-6d42-403f-bf74-75335e1782cb" status: 200 len: 1365 microversion: 2.1 time: 0.655692 Sep 08 10:53:07.748637 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1719/3440] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:07 2022] GET /compute/v2.1/servers/19604289-6d42-403f-bf74-75335e1782cb => generated 1365 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:07.751748 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-996320b1-27b6-4ad0-bd26-d2d2dc5f1d67 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] 10.222.0.27 "GET /compute/v2.1/servers/50feb7c3-9282-44b6-ad37-bf09e2d3f5a8" status: 200 len: 1520 microversion: 2.1 time: 0.751137 Sep 08 10:53:07.754713 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1722/3441] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:06 2022] GET /compute/v2.1/servers/50feb7c3-9282-44b6-ad37-bf09e2d3f5a8 => generated 1520 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:07.786402 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-74230575-158c-4fc7-8cf9-e6ec8b9598d3 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Action: 'create', calling method: .version_select at 0x7f68e4959820>, body: {"pool": null} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:53:08.102065 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b55b7ae8-62b2-4efa-9115-a22ad99e1174 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:08.103237 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b55b7ae8-62b2-4efa-9115-a22ad99e1174 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: a882cf75-539a-45fa-ae2b-4e0f043b340d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:08.120833 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b55b7ae8-62b2-4efa-9115-a22ad99e1174 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:08.121894 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b55b7ae8-62b2-4efa-9115-a22ad99e1174 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:08.122765 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b55b7ae8-62b2-4efa-9115-a22ad99e1174 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:08.125250 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b55b7ae8-62b2-4efa-9115-a22ad99e1174 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:08.126234 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b55b7ae8-62b2-4efa-9115-a22ad99e1174 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:08.126942 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b55b7ae8-62b2-4efa-9115-a22ad99e1174 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:09.169018 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b55b7ae8-62b2-4efa-9115-a22ad99e1174 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:09.228053 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b55b7ae8-62b2-4efa-9115-a22ad99e1174 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d" status: 200 len: 1522 microversion: 2.1 time: 1.131031 Sep 08 10:53:09.257662 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1723/3442] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:08 2022] GET /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d => generated 1522 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:53:09.269582 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-b9c69c09-5ec6-46f5-9e23-a09e62055bd9 req-3436664e-90e5-4d1b-a738-0d38fc782344 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19604289-6d42-403f-bf74-75335e1782cb", "name": "network-vif-plugged", "status": "completed", "tag": "0ee5bff2-0477-4282-8e7e-4965352d2a29"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:53:09.296809 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b9c69c09-5ec6-46f5-9e23-a09e62055bd9 req-3436664e-90e5-4d1b-a738-0d38fc782344 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:09.297347 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b9c69c09-5ec6-46f5-9e23-a09e62055bd9 req-3436664e-90e5-4d1b-a738-0d38fc782344 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:09.297782 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b9c69c09-5ec6-46f5-9e23-a09e62055bd9 req-3436664e-90e5-4d1b-a738-0d38fc782344 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:09.332534 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-b9c69c09-5ec6-46f5-9e23-a09e62055bd9 req-3436664e-90e5-4d1b-a738-0d38fc782344 service nova] Creating event network-vif-plugged:0ee5bff2-0477-4282-8e7e-4965352d2a29 for instance 19604289-6d42-403f-bf74-75335e1782cb on n-h1-850501-12 Sep 08 10:53:09.350495 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-b9c69c09-5ec6-46f5-9e23-a09e62055bd9 req-3436664e-90e5-4d1b-a738-0d38fc782344 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091369 Sep 08 10:53:09.351708 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1724/3443] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:53:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:53:09.365793 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-090d18f2-90e5-4ccb-8bc4-2453a899ae0e tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:09.372474 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-090d18f2-90e5-4ccb-8bc4-2453a899ae0e tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: 19604289-6d42-403f-bf74-75335e1782cb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:09.392231 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-090d18f2-90e5-4ccb-8bc4-2453a899ae0e tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:09.393070 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-090d18f2-90e5-4ccb-8bc4-2453a899ae0e tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:09.393528 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-090d18f2-90e5-4ccb-8bc4-2453a899ae0e tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:09.394442 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-090d18f2-90e5-4ccb-8bc4-2453a899ae0e tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:09.394940 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-090d18f2-90e5-4ccb-8bc4-2453a899ae0e tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:09.395391 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-090d18f2-90e5-4ccb-8bc4-2453a899ae0e tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:09.882034 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-090d18f2-90e5-4ccb-8bc4-2453a899ae0e tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c291cbe955b4ee5abc98132dda0255e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f9a24cad014d7f827e8f3236dd5bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:09.900294 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-090d18f2-90e5-4ccb-8bc4-2453a899ae0e tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/19604289-6d42-403f-bf74-75335e1782cb" status: 200 len: 1365 microversion: 2.1 time: 0.545819 Sep 08 10:53:09.901436 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1725/3444] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:09 2022] GET /compute/v2.1/servers/19604289-6d42-403f-bf74-75335e1782cb => generated 1365 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:10.281367 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-059cec5f-dbf7-42f8-b876-e9833d8ba519 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:10.282800 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-059cec5f-dbf7-42f8-b876-e9833d8ba519 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: a882cf75-539a-45fa-ae2b-4e0f043b340d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:10.300831 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-059cec5f-dbf7-42f8-b876-e9833d8ba519 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:10.302224 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-059cec5f-dbf7-42f8-b876-e9833d8ba519 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:10.302921 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-059cec5f-dbf7-42f8-b876-e9833d8ba519 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:10.307193 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-059cec5f-dbf7-42f8-b876-e9833d8ba519 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:10.307912 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-059cec5f-dbf7-42f8-b876-e9833d8ba519 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:10.309597 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-059cec5f-dbf7-42f8-b876-e9833d8ba519 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:10.702983 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-059cec5f-dbf7-42f8-b876-e9833d8ba519 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:10.723753 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-059cec5f-dbf7-42f8-b876-e9833d8ba519 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d" status: 200 len: 1522 microversion: 2.1 time: 0.447256 Sep 08 10:53:10.724703 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1726/3445] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:10 2022] GET /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d => generated 1522 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:53:11.059070 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-74230575-158c-4fc7-8cf9-e6ec8b9598d3 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.279413 Sep 08 10:53:11.060809 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1720/3446] 10.222.0.27 () {60 vars in 1170 bytes} [Thu Sep 8 10:53:07 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:53:11.062583 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3fa13e47-c0c3-4c18-9890-85695bc3d41f tempest-SecurityGroupRulesTestJSON-1282665663 tempest-SecurityGroupRulesTestJSON-1282665663-project] Action: 'create', calling method: .version_select at 0x7f68e4212310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1358471442", "description": "tempest-description-1272668883"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:53:11.066835 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-937f8215-aef8-4ff7-844f-32fd728d3e7e tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:11.068559 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-937f8215-aef8-4ff7-844f-32fd728d3e7e tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: 19604289-6d42-403f-bf74-75335e1782cb] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:11.077392 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-937f8215-aef8-4ff7-844f-32fd728d3e7e tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:11.078293 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-937f8215-aef8-4ff7-844f-32fd728d3e7e tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:11.078964 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-937f8215-aef8-4ff7-844f-32fd728d3e7e tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:11.079944 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-937f8215-aef8-4ff7-844f-32fd728d3e7e tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:11.080646 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-937f8215-aef8-4ff7-844f-32fd728d3e7e tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:11.081336 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-937f8215-aef8-4ff7-844f-32fd728d3e7e tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:11.369127 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-937f8215-aef8-4ff7-844f-32fd728d3e7e tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c291cbe955b4ee5abc98132dda0255e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f9a24cad014d7f827e8f3236dd5bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:11.381473 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-937f8215-aef8-4ff7-844f-32fd728d3e7e tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/19604289-6d42-403f-bf74-75335e1782cb" status: 200 len: 1365 microversion: 2.1 time: 0.319047 Sep 08 10:53:11.382359 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1721/3447] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:11 2022] GET /compute/v2.1/servers/19604289-6d42-403f-bf74-75335e1782cb => generated 1365 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:11.390198 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0c365fa9-ec40-4d08-96ab-58b782e987b0 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-750709323", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "9b985b6c-8cab-4bb8-8ec5-91dd022aec51"}]}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:53:11.509309 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-0c365fa9-ec40-4d08-96ab-58b782e987b0 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] validate_networks() for [('9b985b6c-8cab-4bb8-8ec5-91dd022aec51', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:53:12.150154 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3fa13e47-c0c3-4c18-9890-85695bc3d41f tempest-SecurityGroupRulesTestJSON-1282665663 tempest-SecurityGroupRulesTestJSON-1282665663-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 1.412977 Sep 08 10:53:12.151451 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1727/3448] 10.222.0.27 () {60 vars in 1180 bytes} [Thu Sep 8 10:53:10 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 1426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:53:12.156493 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-950990dd-04b8-44a8-91c1-a6cac2bc43cb tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:12.158193 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-950990dd-04b8-44a8-91c1-a6cac2bc43cb tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: a882cf75-539a-45fa-ae2b-4e0f043b340d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:12.174582 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-950990dd-04b8-44a8-91c1-a6cac2bc43cb tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:12.176646 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-950990dd-04b8-44a8-91c1-a6cac2bc43cb tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:12.179095 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-950990dd-04b8-44a8-91c1-a6cac2bc43cb tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:12.180881 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-950990dd-04b8-44a8-91c1-a6cac2bc43cb tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:12.182554 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-950990dd-04b8-44a8-91c1-a6cac2bc43cb tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:12.187036 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-950990dd-04b8-44a8-91c1-a6cac2bc43cb tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:12.632213 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-0c365fa9-ec40-4d08-96ab-58b782e987b0 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:53:12.633273 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-0c365fa9-ec40-4d08-96ab-58b782e987b0 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:53:12.634494 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-0c365fa9-ec40-4d08-96ab-58b782e987b0 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:53:12.634995 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-0c365fa9-ec40-4d08-96ab-58b782e987b0 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:53:12.639076 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-950990dd-04b8-44a8-91c1-a6cac2bc43cb tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:12.644454 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-0c365fa9-ec40-4d08-96ab-58b782e987b0 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:53:12.653905 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-950990dd-04b8-44a8-91c1-a6cac2bc43cb tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d" status: 200 len: 1522 microversion: 2.1 time: 0.501120 Sep 08 10:53:12.655002 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1728/3449] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:12 2022] GET /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d => generated 1522 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:12.662495 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c2ae0cce-610f-4ccb-bfea-ef59908489b6 tempest-SecurityGroupRulesTestJSON-1282665663 tempest-SecurityGroupRulesTestJSON-1282665663-project] Action: 'create', calling method: .version_select at 0x7f68e44d65e0>, body: {"security_group_rule": {"parent_group_id": "50e1f3e9-01da-4194-a85f-163a126a1416", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:53:12.712476 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0c365fa9-ec40-4d08-96ab-58b782e987b0 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:12.714034 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0c365fa9-ec40-4d08-96ab-58b782e987b0 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:12.714555 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0c365fa9-ec40-4d08-96ab-58b782e987b0 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:12.715865 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0c365fa9-ec40-4d08-96ab-58b782e987b0 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:12.725834 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0c365fa9-ec40-4d08-96ab-58b782e987b0 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:12.726330 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0c365fa9-ec40-4d08-96ab-58b782e987b0 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:12.749140 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-0c365fa9-ec40-4d08-96ab-58b782e987b0 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Getting quotas for project 44bb5f5b56a2402999719f0374228ed3. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:53:12.768285 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-0c365fa9-ec40-4d08-96ab-58b782e987b0 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Getting quotas for user cb2c4b351a0a4ccabbfb5438b5c535e8 and project 44bb5f5b56a2402999719f0374228ed3. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:53:12.785624 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0c365fa9-ec40-4d08-96ab-58b782e987b0 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:53:12.787973 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0c365fa9-ec40-4d08-96ab-58b782e987b0 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] [instance: 214ebb38-6f31-48bd-99a4-50ca64d78574] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:53:12.875363 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0c365fa9-ec40-4d08-96ab-58b782e987b0 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.491605 Sep 08 10:53:12.879447 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1722/3450] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:53:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1496 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:53:12.888254 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-78e134a4-9e06-4ac3-bf16-04b8a8688fab tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:12.890661 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-78e134a4-9e06-4ac3-bf16-04b8a8688fab tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: 19604289-6d42-403f-bf74-75335e1782cb] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:12.921927 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-78e134a4-9e06-4ac3-bf16-04b8a8688fab tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:12.923040 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-78e134a4-9e06-4ac3-bf16-04b8a8688fab tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:12.924807 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-78e134a4-9e06-4ac3-bf16-04b8a8688fab tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:12.925940 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-78e134a4-9e06-4ac3-bf16-04b8a8688fab tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:12.926724 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-78e134a4-9e06-4ac3-bf16-04b8a8688fab tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:12.927709 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-78e134a4-9e06-4ac3-bf16-04b8a8688fab tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:13.236702 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-78e134a4-9e06-4ac3-bf16-04b8a8688fab tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c291cbe955b4ee5abc98132dda0255e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f9a24cad014d7f827e8f3236dd5bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:13.248192 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-78e134a4-9e06-4ac3-bf16-04b8a8688fab tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/19604289-6d42-403f-bf74-75335e1782cb" status: 200 len: 1556 microversion: 2.1 time: 0.367219 Sep 08 10:53:13.260010 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1723/3451] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:12 2022] GET /compute/v2.1/servers/19604289-6d42-403f-bf74-75335e1782cb => generated 1556 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:13.270895 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-46f97136-e58d-45be-acf4-a7675407c9d1 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:13.271933 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-46f97136-e58d-45be-acf4-a7675407c9d1 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] [instance: 214ebb38-6f31-48bd-99a4-50ca64d78574] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:13.407358 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c2ae0cce-610f-4ccb-bfea-ef59908489b6 tempest-SecurityGroupRulesTestJSON-1282665663 tempest-SecurityGroupRulesTestJSON-1282665663-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.747949 Sep 08 10:53:13.408243 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-46f97136-e58d-45be-acf4-a7675407c9d1 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c4b351a0a4ccabbfb5438b5c535e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bb5f5b56a2402999719f0374228ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:13.411810 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1729/3452] 10.222.0.27 () {60 vars in 1195 bytes} [Thu Sep 8 10:53:12 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:53:13.423769 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c9041119-a9d2-488f-8281-bf6a2782f7b5 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:13.424293 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c9041119-a9d2-488f-8281-bf6a2782f7b5 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: 19604289-6d42-403f-bf74-75335e1782cb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:13.426472 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-46f97136-e58d-45be-acf4-a7675407c9d1 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] 10.222.0.27 "GET /compute/v2.1/servers/214ebb38-6f31-48bd-99a4-50ca64d78574" status: 200 len: 1223 microversion: 2.1 time: 0.163419 Sep 08 10:53:13.433390 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1724/3453] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:13 2022] GET /compute/v2.1/servers/214ebb38-6f31-48bd-99a4-50ca64d78574 => generated 1223 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:13.448847 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7b4a0322-d702-4271-95ba-edbbf5f3614f tempest-SecurityGroupRulesTestJSON-1282665663 tempest-SecurityGroupRulesTestJSON-1282665663-project] Action: 'create', calling method: .version_select at 0x7f68e44cbee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-929347423", "description": "tempest-description-464681396"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:53:13.492428 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=90 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:53:13.499260 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c9041119-a9d2-488f-8281-bf6a2782f7b5 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:13.504103 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c9041119-a9d2-488f-8281-bf6a2782f7b5 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:13.506150 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c9041119-a9d2-488f-8281-bf6a2782f7b5 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:13.511394 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c9041119-a9d2-488f-8281-bf6a2782f7b5 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:13.513291 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c9041119-a9d2-488f-8281-bf6a2782f7b5 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:13.514471 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c9041119-a9d2-488f-8281-bf6a2782f7b5 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:13.818476 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7b4a0322-d702-4271-95ba-edbbf5f3614f tempest-SecurityGroupRulesTestJSON-1282665663 tempest-SecurityGroupRulesTestJSON-1282665663-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.382942 Sep 08 10:53:13.829538 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1725/3454] 10.222.0.27 () {60 vars in 1180 bytes} [Thu Sep 8 10:53:13 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:53:13.836305 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-10a2dab7-a7e6-4ab0-b3c9-d50ab038b8e0 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:13.838819 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-10a2dab7-a7e6-4ab0-b3c9-d50ab038b8e0 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: a882cf75-539a-45fa-ae2b-4e0f043b340d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:13.872400 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-10a2dab7-a7e6-4ab0-b3c9-d50ab038b8e0 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:13.872933 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-10a2dab7-a7e6-4ab0-b3c9-d50ab038b8e0 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:13.873413 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-10a2dab7-a7e6-4ab0-b3c9-d50ab038b8e0 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:13.874137 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-10a2dab7-a7e6-4ab0-b3c9-d50ab038b8e0 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:13.874593 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-10a2dab7-a7e6-4ab0-b3c9-d50ab038b8e0 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:13.875020 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-10a2dab7-a7e6-4ab0-b3c9-d50ab038b8e0 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:13.988149 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c9041119-a9d2-488f-8281-bf6a2782f7b5 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/19604289-6d42-403f-bf74-75335e1782cb/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.574606 Sep 08 10:53:13.992125 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1730/3455] 10.222.0.27 () {58 vars in 1275 bytes} [Thu Sep 8 10:53:13 2022] GET /compute/v2.1/servers/19604289-6d42-403f-bf74-75335e1782cb/os-interface => generated 285 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:53:14.011994 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7c638d2e-3b8f-4030-91c5-00339c895198 tempest-SecurityGroupRulesTestJSON-1282665663 tempest-SecurityGroupRulesTestJSON-1282665663-project] Action: 'create', calling method: .version_select at 0x7f68e424e550>, body: {"security_group_rule": {"parent_group_id": "b95e78f4-a1e2-457e-9262-6004ce70a7dd", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:53:14.228838 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-10a2dab7-a7e6-4ab0-b3c9-d50ab038b8e0 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:14.244211 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-10a2dab7-a7e6-4ab0-b3c9-d50ab038b8e0 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d" status: 200 len: 1522 microversion: 2.1 time: 0.413229 Sep 08 10:53:14.248641 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1726/3456] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:13 2022] GET /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d => generated 1522 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:14.461879 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1e1d7047-b626-4c12-bcc7-cd95de73c926 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:14.463037 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1e1d7047-b626-4c12-bcc7-cd95de73c926 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] [instance: 214ebb38-6f31-48bd-99a4-50ca64d78574] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:14.470535 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e1d7047-b626-4c12-bcc7-cd95de73c926 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:14.471390 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e1d7047-b626-4c12-bcc7-cd95de73c926 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:14.472032 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e1d7047-b626-4c12-bcc7-cd95de73c926 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:14.472955 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e1d7047-b626-4c12-bcc7-cd95de73c926 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:14.473882 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e1d7047-b626-4c12-bcc7-cd95de73c926 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:14.474381 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e1d7047-b626-4c12-bcc7-cd95de73c926 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:14.623648 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1e1d7047-b626-4c12-bcc7-cd95de73c926 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c4b351a0a4ccabbfb5438b5c535e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bb5f5b56a2402999719f0374228ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:14.636292 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1e1d7047-b626-4c12-bcc7-cd95de73c926 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] 10.222.0.27 "GET /compute/v2.1/servers/214ebb38-6f31-48bd-99a4-50ca64d78574" status: 200 len: 1275 microversion: 2.1 time: 0.180875 Sep 08 10:53:14.658880 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1727/3457] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:14 2022] GET /compute/v2.1/servers/214ebb38-6f31-48bd-99a4-50ca64d78574 => generated 1275 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:53:15.284305 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f04ba6ec-b04b-49be-9d36-d75b0a8ee9ce tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:15.287761 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f04ba6ec-b04b-49be-9d36-d75b0a8ee9ce tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: a882cf75-539a-45fa-ae2b-4e0f043b340d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:15.300437 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f04ba6ec-b04b-49be-9d36-d75b0a8ee9ce tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:15.302953 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f04ba6ec-b04b-49be-9d36-d75b0a8ee9ce tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:15.304070 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f04ba6ec-b04b-49be-9d36-d75b0a8ee9ce tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:15.307179 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f04ba6ec-b04b-49be-9d36-d75b0a8ee9ce tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:15.308792 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f04ba6ec-b04b-49be-9d36-d75b0a8ee9ce tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:15.311339 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f04ba6ec-b04b-49be-9d36-d75b0a8ee9ce tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:15.716545 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7c638d2e-3b8f-4030-91c5-00339c895198 tempest-SecurityGroupRulesTestJSON-1282665663 tempest-SecurityGroupRulesTestJSON-1282665663-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 1.718299 Sep 08 10:53:15.718707 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1731/3458] 10.222.0.27 () {60 vars in 1195 bytes} [Thu Sep 8 10:53:13 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 1726 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:53:15.739184 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b03ffb1f-eff6-4f60-b38f-7a3649c5ac2a tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:15.739808 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b03ffb1f-eff6-4f60-b38f-7a3649c5ac2a tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] [instance: 214ebb38-6f31-48bd-99a4-50ca64d78574] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:15.757638 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b03ffb1f-eff6-4f60-b38f-7a3649c5ac2a tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:15.758132 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b03ffb1f-eff6-4f60-b38f-7a3649c5ac2a tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:15.759128 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b03ffb1f-eff6-4f60-b38f-7a3649c5ac2a tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:15.760068 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b03ffb1f-eff6-4f60-b38f-7a3649c5ac2a tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:15.763863 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b03ffb1f-eff6-4f60-b38f-7a3649c5ac2a tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:15.764624 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b03ffb1f-eff6-4f60-b38f-7a3649c5ac2a tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:15.806958 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f04ba6ec-b04b-49be-9d36-d75b0a8ee9ce tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:15.818948 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f04ba6ec-b04b-49be-9d36-d75b0a8ee9ce tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d" status: 200 len: 1522 microversion: 2.1 time: 0.541075 Sep 08 10:53:15.833058 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1728/3459] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:15 2022] GET /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d => generated 1522 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:15.833058 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-73907d06-8810-4ade-bf27-3b2922f5c0a5 tempest-SecurityGroupRulesTestJSON-1282665663 tempest-SecurityGroupRulesTestJSON-1282665663-project] Action: 'create', calling method: .version_select at 0x7f68e4e0f040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2139612537", "description": "tempest-description-867751256"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:53:15.997271 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b03ffb1f-eff6-4f60-b38f-7a3649c5ac2a tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c4b351a0a4ccabbfb5438b5c535e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bb5f5b56a2402999719f0374228ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:16.030039 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b03ffb1f-eff6-4f60-b38f-7a3649c5ac2a tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] 10.222.0.27 "GET /compute/v2.1/servers/214ebb38-6f31-48bd-99a4-50ca64d78574" status: 200 len: 1281 microversion: 2.1 time: 0.309109 Sep 08 10:53:16.035665 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1732/3460] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:15 2022] GET /compute/v2.1/servers/214ebb38-6f31-48bd-99a4-50ca64d78574 => generated 1281 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:16.083565 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a9f38071-cd3d-4626-9969-ac3c0c25af79 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:16.084195 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a9f38071-cd3d-4626-9969-ac3c0c25af79 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:16.094217 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a9f38071-cd3d-4626-9969-ac3c0c25af79 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:16.094718 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a9f38071-cd3d-4626-9969-ac3c0c25af79 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:16.097979 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a9f38071-cd3d-4626-9969-ac3c0c25af79 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:16.099032 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a9f38071-cd3d-4626-9969-ac3c0c25af79 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:16.102646 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a9f38071-cd3d-4626-9969-ac3c0c25af79 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:16.103397 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a9f38071-cd3d-4626-9969-ac3c0c25af79 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:16.347491 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-73907d06-8810-4ade-bf27-3b2922f5c0a5 tempest-SecurityGroupRulesTestJSON-1282665663 tempest-SecurityGroupRulesTestJSON-1282665663-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.522732 Sep 08 10:53:16.349116 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1729/3461] 10.222.0.27 () {60 vars in 1180 bytes} [Thu Sep 8 10:53:15 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:53:16.374973 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-85bfd15f-7a3e-4ef0-b281-61bb24c3cc31 tempest-SecurityGroupRulesTestJSON-1282665663 tempest-SecurityGroupRulesTestJSON-1282665663-project] Action: 'create', calling method: .version_select at 0x7f68e4471430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-424473781", "description": "tempest-description-2096469723"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:53:16.715477 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-85bfd15f-7a3e-4ef0-b281-61bb24c3cc31 tempest-SecurityGroupRulesTestJSON-1282665663 tempest-SecurityGroupRulesTestJSON-1282665663-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.344464 Sep 08 10:53:16.716628 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1730/3462] 10.222.0.27 () {60 vars in 1180 bytes} [Thu Sep 8 10:53:16 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:53:16.722336 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-87920e48-d256-4fcc-b837-d0f9cd175eb4 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:16.723231 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-87920e48-d256-4fcc-b837-d0f9cd175eb4 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:16.731923 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-87920e48-d256-4fcc-b837-d0f9cd175eb4 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:16.732737 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-87920e48-d256-4fcc-b837-d0f9cd175eb4 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:16.733282 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-87920e48-d256-4fcc-b837-d0f9cd175eb4 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:16.733991 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-87920e48-d256-4fcc-b837-d0f9cd175eb4 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:16.734978 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-87920e48-d256-4fcc-b837-d0f9cd175eb4 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:16.735343 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-87920e48-d256-4fcc-b837-d0f9cd175eb4 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:16.915866 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a9f38071-cd3d-4626-9969-ac3c0c25af79 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:16.952940 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a9f38071-cd3d-4626-9969-ac3c0c25af79 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:16.954711 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a9f38071-cd3d-4626-9969-ac3c0c25af79 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:16.956271 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a9f38071-cd3d-4626-9969-ac3c0c25af79 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 200 len: 2948 microversion: 2.32 time: 0.877901 Sep 08 10:53:16.958932 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1733/3463] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:53:16 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 2948 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:53:16.970060 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3abc192d-70ae-4ff2-9a3a-56dc2fb70e08 tempest-SecurityGroupRulesTestJSON-1282665663 tempest-SecurityGroupRulesTestJSON-1282665663-project] Action: 'create', calling method: .version_select at 0x7f68e44d6ca0>, body: {"security_group_rule": {"parent_group_id": "9f52b7f2-be8e-4f4a-8273-a9c446d1b945", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "8f6ad7b6-2e75-4043-b2d5-aa17909e7891"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:53:17.124246 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-87920e48-d256-4fcc-b837-d0f9cd175eb4 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:17.137082 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-87920e48-d256-4fcc-b837-d0f9cd175eb4 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1671 microversion: 2.1 time: 0.414954 Sep 08 10:53:17.149169 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1731/3464] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:16 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1671 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:17.161462 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-036e9b49-4b97-4ec2-8834-5eece9815bc1 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:17.161462 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-036e9b49-4b97-4ec2-8834-5eece9815bc1 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: a882cf75-539a-45fa-ae2b-4e0f043b340d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:17.162162 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-036e9b49-4b97-4ec2-8834-5eece9815bc1 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:17.163826 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-036e9b49-4b97-4ec2-8834-5eece9815bc1 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:17.166863 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-036e9b49-4b97-4ec2-8834-5eece9815bc1 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:17.168075 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-036e9b49-4b97-4ec2-8834-5eece9815bc1 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:17.168794 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-036e9b49-4b97-4ec2-8834-5eece9815bc1 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:17.174073 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-036e9b49-4b97-4ec2-8834-5eece9815bc1 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:17.445203 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-036e9b49-4b97-4ec2-8834-5eece9815bc1 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:17.459884 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-036e9b49-4b97-4ec2-8834-5eece9815bc1 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d" status: 200 len: 1502 microversion: 2.1 time: 0.319847 Sep 08 10:53:17.475513 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1732/3465] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:17 2022] GET /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d => generated 1502 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:17.496950 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4edeb62a-1e05-4592-993e-cbde28920a7e tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:17.500860 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4edeb62a-1e05-4592-993e-cbde28920a7e tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:17.515322 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4edeb62a-1e05-4592-993e-cbde28920a7e tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:17.516715 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4edeb62a-1e05-4592-993e-cbde28920a7e tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:17.517834 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4edeb62a-1e05-4592-993e-cbde28920a7e tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:17.519439 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4edeb62a-1e05-4592-993e-cbde28920a7e tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:17.520601 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4edeb62a-1e05-4592-993e-cbde28920a7e tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:17.521738 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4edeb62a-1e05-4592-993e-cbde28920a7e tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:17.781393 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4edeb62a-1e05-4592-993e-cbde28920a7e tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.301528 Sep 08 10:53:17.783377 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1733/3466] 10.222.0.27 () {60 vars in 1316 bytes} [Thu Sep 8 10:53:17 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf/os-interface => generated 1831 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:53:17.798297 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9af4f461-f0ae-4f44-a8ee-48393298bc41 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:17.799195 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9af4f461-f0ae-4f44-a8ee-48393298bc41 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] [instance: 214ebb38-6f31-48bd-99a4-50ca64d78574] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:17.814505 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9af4f461-f0ae-4f44-a8ee-48393298bc41 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:17.815322 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9af4f461-f0ae-4f44-a8ee-48393298bc41 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:17.815941 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9af4f461-f0ae-4f44-a8ee-48393298bc41 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:17.817002 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9af4f461-f0ae-4f44-a8ee-48393298bc41 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:17.817677 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9af4f461-f0ae-4f44-a8ee-48393298bc41 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:17.818299 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9af4f461-f0ae-4f44-a8ee-48393298bc41 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:18.342749 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9af4f461-f0ae-4f44-a8ee-48393298bc41 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c4b351a0a4ccabbfb5438b5c535e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bb5f5b56a2402999719f0374228ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:18.367178 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9af4f461-f0ae-4f44-a8ee-48393298bc41 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] 10.222.0.27 "GET /compute/v2.1/servers/214ebb38-6f31-48bd-99a4-50ca64d78574" status: 200 len: 1323 microversion: 2.1 time: 0.579789 Sep 08 10:53:18.378712 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1734/3467] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:17 2022] GET /compute/v2.1/servers/214ebb38-6f31-48bd-99a4-50ca64d78574 => generated 1323 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:18.384374 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-49cc59e4-4547-4f9a-9b1e-185a33003e3e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:18.385106 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-49cc59e4-4547-4f9a-9b1e-185a33003e3e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:18.435946 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-49cc59e4-4547-4f9a-9b1e-185a33003e3e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:18.439070 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-49cc59e4-4547-4f9a-9b1e-185a33003e3e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:18.440557 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-49cc59e4-4547-4f9a-9b1e-185a33003e3e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:18.441476 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-49cc59e4-4547-4f9a-9b1e-185a33003e3e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:18.442121 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-49cc59e4-4547-4f9a-9b1e-185a33003e3e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:18.442565 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-49cc59e4-4547-4f9a-9b1e-185a33003e3e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:19.232268 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-49cc59e4-4547-4f9a-9b1e-185a33003e3e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:19.247001 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-49cc59e4-4547-4f9a-9b1e-185a33003e3e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1671 microversion: 2.1 time: 0.874293 Sep 08 10:53:19.248445 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1735/3468] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:18 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1671 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:19.267982 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-da699ef3-8a2d-47fc-a826-20b82e7edf04 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:19.269715 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-da699ef3-8a2d-47fc-a826-20b82e7edf04 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: fafff8cb-0e6f-4243-a91c-ec559f656880] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:19.284155 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-da699ef3-8a2d-47fc-a826-20b82e7edf04 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:19.285596 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-da699ef3-8a2d-47fc-a826-20b82e7edf04 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:19.286352 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-da699ef3-8a2d-47fc-a826-20b82e7edf04 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:19.287441 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-da699ef3-8a2d-47fc-a826-20b82e7edf04 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:19.288374 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-da699ef3-8a2d-47fc-a826-20b82e7edf04 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:19.289175 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-da699ef3-8a2d-47fc-a826-20b82e7edf04 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:19.436962 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3abc192d-70ae-4ff2-9a3a-56dc2fb70e08 tempest-SecurityGroupRulesTestJSON-1282665663 tempest-SecurityGroupRulesTestJSON-1282665663-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 2.475977 Sep 08 10:53:19.445533 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1734/3469] 10.222.0.27 () {60 vars in 1195 bytes} [Thu Sep 8 10:53:16 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 2485 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:53:19.453446 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-817d115c-4c38-409b-9977-e6b3c199b9c6 req-5669522c-8cac-4a29-a75b-e3412f541b76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19604289-6d42-403f-bf74-75335e1782cb", "tag": "0ee5bff2-0477-4282-8e7e-4965352d2a29"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:53:19.479320 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-817d115c-4c38-409b-9977-e6b3c199b9c6 req-5669522c-8cac-4a29-a75b-e3412f541b76 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:19.481736 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-817d115c-4c38-409b-9977-e6b3c199b9c6 req-5669522c-8cac-4a29-a75b-e3412f541b76 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:19.482393 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-817d115c-4c38-409b-9977-e6b3c199b9c6 req-5669522c-8cac-4a29-a75b-e3412f541b76 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:19.502859 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-817d115c-4c38-409b-9977-e6b3c199b9c6 req-5669522c-8cac-4a29-a75b-e3412f541b76 service nova] Creating event network-changed:0ee5bff2-0477-4282-8e7e-4965352d2a29 for instance 19604289-6d42-403f-bf74-75335e1782cb on n-h1-850501-12 Sep 08 10:53:19.524990 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-817d115c-4c38-409b-9977-e6b3c199b9c6 req-5669522c-8cac-4a29-a75b-e3412f541b76 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074428 Sep 08 10:53:19.526326 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1735/3470] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:53:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:53:19.537980 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-93793d66-d3f0-4183-aedd-de11dbe7ec1c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:19.542074 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-93793d66-d3f0-4183-aedd-de11dbe7ec1c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:19.558164 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-93793d66-d3f0-4183-aedd-de11dbe7ec1c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:19.559154 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-93793d66-d3f0-4183-aedd-de11dbe7ec1c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:19.559767 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-93793d66-d3f0-4183-aedd-de11dbe7ec1c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:19.560654 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-93793d66-d3f0-4183-aedd-de11dbe7ec1c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:19.561561 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-93793d66-d3f0-4183-aedd-de11dbe7ec1c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:19.562192 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-93793d66-d3f0-4183-aedd-de11dbe7ec1c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:19.733156 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-da699ef3-8a2d-47fc-a826-20b82e7edf04 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:19.752708 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-da699ef3-8a2d-47fc-a826-20b82e7edf04 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/fafff8cb-0e6f-4243-a91c-ec559f656880" status: 200 len: 1516 microversion: 2.1 time: 0.498825 Sep 08 10:53:19.754045 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1736/3471] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:19 2022] GET /compute/v2.1/servers/fafff8cb-0e6f-4243-a91c-ec559f656880 => generated 1516 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:19.793076 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-acff94a4-57f6-470d-9402-c07b7369c3ab tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:19.794076 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-acff94a4-57f6-470d-9402-c07b7369c3ab tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] [instance: 214ebb38-6f31-48bd-99a4-50ca64d78574] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:19.803093 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-acff94a4-57f6-470d-9402-c07b7369c3ab tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:19.803739 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-acff94a4-57f6-470d-9402-c07b7369c3ab tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:19.804371 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-acff94a4-57f6-470d-9402-c07b7369c3ab tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:19.806131 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-acff94a4-57f6-470d-9402-c07b7369c3ab tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:19.806857 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-acff94a4-57f6-470d-9402-c07b7369c3ab tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:19.808487 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-acff94a4-57f6-470d-9402-c07b7369c3ab tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:20.127455 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-acff94a4-57f6-470d-9402-c07b7369c3ab tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c4b351a0a4ccabbfb5438b5c535e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bb5f5b56a2402999719f0374228ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:20.140698 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-acff94a4-57f6-470d-9402-c07b7369c3ab tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] 10.222.0.27 "GET /compute/v2.1/servers/214ebb38-6f31-48bd-99a4-50ca64d78574" status: 200 len: 1323 microversion: 2.1 time: 0.368922 Sep 08 10:53:20.141458 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1737/3472] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:19 2022] GET /compute/v2.1/servers/214ebb38-6f31-48bd-99a4-50ca64d78574 => generated 1323 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:20.153755 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fa7e8044-0acc-4e9a-bc2e-25c2fe9f9718 tempest-SecurityGroupRulesTestJSON-1282665663 tempest-SecurityGroupRulesTestJSON-1282665663-project] Action: 'create', calling method: .version_select at 0x7f68e4a57670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-156762753", "description": "tempest-description-1536708044"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:53:20.234001 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-93793d66-d3f0-4183-aedd-de11dbe7ec1c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:20.246335 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-93793d66-d3f0-4183-aedd-de11dbe7ec1c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1671 microversion: 2.1 time: 0.718612 Sep 08 10:53:20.250845 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1736/3473] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:19 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1671 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:20.257792 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7f981968-e1c8-40c7-b3ba-68235d474728 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:53:20.268435 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7f981968-e1c8-40c7-b3ba-68235d474728 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: 6c62da63-4fb5-4bca-88e7-66dd7a216e20] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:20.287188 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-7f981968-e1c8-40c7-b3ba-68235d474728 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] HTTP exception thrown: Instance 6c62da63-4fb5-4bca-88e7-66dd7a216e20 could not be found. Sep 08 10:53:20.296225 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7f981968-e1c8-40c7-b3ba-68235d474728 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Request method failure captured: Sep 08 10:53:20.296225 n-d-850501-12 devstack@n-api.service[128862]: request: POST /compute/v2.1/servers/6c62da63-4fb5-4bca-88e7-66dd7a216e20/action HTTP/1.1 Sep 08 10:53:20.296225 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:53:20.296225 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:53:20.296225 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:53:20.296225 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 14 Sep 08 10:53:20.296225 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:53:20.296225 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:53:20.296225 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:53:20.296225 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:53:20.296225 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGclZnrdHbcSspe2CSaO_gA2LIWMGtHJAKVo_u3dlzxs9JxAXcXCwrL-z-q8SJvnWUnwIz6KxjkLXp0jFFwIV3x5Qp_zUHQKWEwS-EZKwoM8W4-UxwLeQWJTnQ9cWOYmTzHY9djf2pYmuh6sOSJJezx_5s2ElCgN_L-D4iql7Pg9xGj8 Sep 08 10:53:20.296225 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:53:20.296225 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:53:20.296225 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:53:20.296225 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:53:20.296225 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:53:20.296225 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:53:20.296225 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 33063b3b9e0543369c28ea918f52cf37 Sep 08 10:53:20.296225 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1820338337 Sep 08 10:53:20.296225 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:53:20.296225 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:53:20.296225 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/33063b3b9e0543369c28ea918f52cf37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/33063b3b9e0543369c28ea918f52cf37"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_33063b3b9e0543369c28ea918f52cf37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/33063b3b9e0543369c28ea918f52cf37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:53:20.296225 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1820338337 Sep 08 10:53:20.296225 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 33063b3b9e0543369c28ea918f52cf37 Sep 08 10:53:20.296225 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1820338337 Sep 08 10:53:20.296225 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServerRescueNegativeTestJSON-1820338337-project Sep 08 10:53:20.296225 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:53:20.296225 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:53:20.296225 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 8f487f5d062e4ac3bf21c2416a7b50ee Sep 08 10:53:20.296225 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1820338337-project Sep 08 10:53:20.296225 n-d-850501-12 devstack@n-api.service[128862]: Sep 08 10:53:20.296225 n-d-850501-12 devstack@n-api.service[128862]: {"rescue": {}} Sep 08 10:53:20.296225 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:53:20.296225 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 6c62da63-4fb5-4bca-88e7-66dd7a216e20 could not be found. Sep 08 10:53:20.296225 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '6c62da63-4fb5-4bca-88e7-66dd7a216e20', 'body': {'rescue': {}}} Sep 08 10:53:20.296225 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:53:20.296225 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:53:20.296225 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:53:20.296225 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:53:20.296225 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:53:20.296225 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:53:20.296225 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 08 10:53:20.296225 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 08 10:53:20.296225 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c62da63-4fb5-4bca-88e7-66dd7a216e20 could not be found. Sep 08 10:53:20.296225 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:53:20.296225 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:53:20.296225 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:53:20.296225 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:53:20.296225 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:53:20.296225 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:53:20.296225 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:53:20.296225 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:53:20.296225 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:53:20.296225 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:53:20.296225 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:53:20.296225 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:53:20.296225 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Sep 08 10:53:20.296225 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 08 10:53:20.296225 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:53:20.296225 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:53:20.296225 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c62da63-4fb5-4bca-88e7-66dd7a216e20 could not be found. Sep 08 10:53:20.296225 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:53:20.296225 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:53:20.296225 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:53:20.296225 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:53:20.301954 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:53:20.301954 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:53:20.301954 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:53:20.301954 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:53:20.301954 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c62da63-4fb5-4bca-88e7-66dd7a216e20 could not be found. Sep 08 10:53:20.301954 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:53:20.303493 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7f981968-e1c8-40c7-b3ba-68235d474728 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Returning 404 to user: Instance 6c62da63-4fb5-4bca-88e7-66dd7a216e20 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:53:20.304546 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7f981968-e1c8-40c7-b3ba-68235d474728 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "POST /compute/v2.1/servers/6c62da63-4fb5-4bca-88e7-66dd7a216e20/action" status: 404 len: 111 microversion: 2.1 time: 0.052538 Sep 08 10:53:20.312376 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1737/3474] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:53:20 2022] POST /compute/v2.1/servers/6c62da63-4fb5-4bca-88e7-66dd7a216e20/action => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:53:20.317725 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-213bd142-6700-438f-a4fc-534f71280fb0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-536612060"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:53:20.327888 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-213bd142-6700-438f-a4fc-534f71280fb0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:20.351548 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-213bd142-6700-438f-a4fc-534f71280fb0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:20.352081 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-213bd142-6700-438f-a4fc-534f71280fb0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:20.352764 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-213bd142-6700-438f-a4fc-534f71280fb0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:20.353628 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-213bd142-6700-438f-a4fc-534f71280fb0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:20.354413 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-213bd142-6700-438f-a4fc-534f71280fb0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:20.355506 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-213bd142-6700-438f-a4fc-534f71280fb0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:20.762613 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fa7e8044-0acc-4e9a-bc2e-25c2fe9f9718 tempest-SecurityGroupRulesTestJSON-1282665663 tempest-SecurityGroupRulesTestJSON-1282665663-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.619685 Sep 08 10:53:20.764284 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1738/3475] 10.222.0.27 () {60 vars in 1180 bytes} [Thu Sep 8 10:53:20 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:53:20.779144 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-628e2bd7-d8e8-418a-ae26-100d8fdc1276 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:53:20.779815 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-628e2bd7-d8e8-418a-ae26-100d8fdc1276 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: fafff8cb-0e6f-4243-a91c-ec559f656880] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:20.800447 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:53:20.806018 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-628e2bd7-d8e8-418a-ae26-100d8fdc1276 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:20.807608 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-628e2bd7-d8e8-418a-ae26-100d8fdc1276 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:20.809750 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-628e2bd7-d8e8-418a-ae26-100d8fdc1276 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:20.812426 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-628e2bd7-d8e8-418a-ae26-100d8fdc1276 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:20.813113 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-628e2bd7-d8e8-418a-ae26-100d8fdc1276 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:20.816421 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-628e2bd7-d8e8-418a-ae26-100d8fdc1276 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:20.831434 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-213bd142-6700-438f-a4fc-534f71280fb0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "POST /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7/action" status: 202 len: 0 microversion: 2.1 time: 0.517105 Sep 08 10:53:20.831878 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1738/3476] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:53:20 2022] POST /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7/action => generated 0 bytes in 519 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Sep 08 10:53:20.874174 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b48def28-bd30-43e4-8c75-0ea622bf32d4 tempest-SecurityGroupRulesTestJSON-1282665663 tempest-SecurityGroupRulesTestJSON-1282665663-project] Action: 'create', calling method: .version_select at 0x7f68e44fce50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-652661561", "description": "tempest-description-237083058"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:53:21.031156 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-628e2bd7-d8e8-418a-ae26-100d8fdc1276 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "POST /compute/v2.1/servers/fafff8cb-0e6f-4243-a91c-ec559f656880/action" status: 202 len: 0 microversion: 2.1 time: 0.264961 Sep 08 10:53:21.035434 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1739/3477] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:53:20 2022] POST /compute/v2.1/servers/fafff8cb-0e6f-4243-a91c-ec559f656880/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:53:21.049242 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c782ce61-1eed-4d4b-947b-9a9369f30f5a tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:21.051352 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c782ce61-1eed-4d4b-947b-9a9369f30f5a tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: fafff8cb-0e6f-4243-a91c-ec559f656880] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:21.069667 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c782ce61-1eed-4d4b-947b-9a9369f30f5a tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:21.072749 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c782ce61-1eed-4d4b-947b-9a9369f30f5a tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:21.075030 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c782ce61-1eed-4d4b-947b-9a9369f30f5a tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:21.077297 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c782ce61-1eed-4d4b-947b-9a9369f30f5a tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:21.079098 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c782ce61-1eed-4d4b-947b-9a9369f30f5a tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:21.080415 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c782ce61-1eed-4d4b-947b-9a9369f30f5a tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:21.094479 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:53:21.585611 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c782ce61-1eed-4d4b-947b-9a9369f30f5a tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:21.599243 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c782ce61-1eed-4d4b-947b-9a9369f30f5a tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/fafff8cb-0e6f-4243-a91c-ec559f656880" status: 200 len: 1521 microversion: 2.1 time: 0.560380 Sep 08 10:53:21.599894 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1740/3478] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:21 2022] GET /compute/v2.1/servers/fafff8cb-0e6f-4243-a91c-ec559f656880 => generated 1521 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:21.631013 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0535f293-abc1-4fae-a23d-22f33eb8eccb tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:21.637110 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0535f293-abc1-4fae-a23d-22f33eb8eccb tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] [instance: 214ebb38-6f31-48bd-99a4-50ca64d78574] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:21.692811 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0535f293-abc1-4fae-a23d-22f33eb8eccb tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:21.697298 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0535f293-abc1-4fae-a23d-22f33eb8eccb tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:21.698684 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0535f293-abc1-4fae-a23d-22f33eb8eccb tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:21.701404 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0535f293-abc1-4fae-a23d-22f33eb8eccb tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:21.701961 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0535f293-abc1-4fae-a23d-22f33eb8eccb tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:21.702438 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0535f293-abc1-4fae-a23d-22f33eb8eccb tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:22.119362 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0535f293-abc1-4fae-a23d-22f33eb8eccb tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c4b351a0a4ccabbfb5438b5c535e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bb5f5b56a2402999719f0374228ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:22.132987 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0535f293-abc1-4fae-a23d-22f33eb8eccb tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] 10.222.0.27 "GET /compute/v2.1/servers/214ebb38-6f31-48bd-99a4-50ca64d78574" status: 200 len: 1323 microversion: 2.1 time: 0.527620 Sep 08 10:53:22.136652 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1741/3479] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:21 2022] GET /compute/v2.1/servers/214ebb38-6f31-48bd-99a4-50ca64d78574 => generated 1323 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:22.422400 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b48def28-bd30-43e4-8c75-0ea622bf32d4 tempest-SecurityGroupRulesTestJSON-1282665663 tempest-SecurityGroupRulesTestJSON-1282665663-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 1.566024 Sep 08 10:53:22.423022 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1739/3480] 10.222.0.27 () {60 vars in 1180 bytes} [Thu Sep 8 10:53:20 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 1570 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:53:22.442377 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8f1881aa-b422-43a5-9722-2d435f7c80c3 tempest-SecurityGroupRulesTestJSON-1282665663 tempest-SecurityGroupRulesTestJSON-1282665663-project] Action: 'create', calling method: .version_select at 0x7f68e4a77c10>, body: {"security_group_rule": {"parent_group_id": "98511dff-fc6c-4549-8356-c3e509f35965", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "a97d1a8a-fd16-41e0-b780-65c0fc0f15fc"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:53:22.628017 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-de5a2a14-bfa8-49c6-9a09-591a3a861fdb tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:22.628759 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-de5a2a14-bfa8-49c6-9a09-591a3a861fdb tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: fafff8cb-0e6f-4243-a91c-ec559f656880] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:22.649087 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de5a2a14-bfa8-49c6-9a09-591a3a861fdb tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:22.655142 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de5a2a14-bfa8-49c6-9a09-591a3a861fdb tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:22.657681 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de5a2a14-bfa8-49c6-9a09-591a3a861fdb tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:22.660420 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de5a2a14-bfa8-49c6-9a09-591a3a861fdb tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:22.663826 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de5a2a14-bfa8-49c6-9a09-591a3a861fdb tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:22.664999 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de5a2a14-bfa8-49c6-9a09-591a3a861fdb tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:22.735353 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:53:23.302492 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-de5a2a14-bfa8-49c6-9a09-591a3a861fdb tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:23.312959 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-de5a2a14-bfa8-49c6-9a09-591a3a861fdb tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/fafff8cb-0e6f-4243-a91c-ec559f656880" status: 200 len: 1501 microversion: 2.1 time: 0.689004 Sep 08 10:53:23.321160 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1740/3481] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:22 2022] GET /compute/v2.1/servers/fafff8cb-0e6f-4243-a91c-ec559f656880 => generated 1501 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:53:23.417580 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=8 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:53:23.528080 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8f1881aa-b422-43a5-9722-2d435f7c80c3 tempest-SecurityGroupRulesTestJSON-1282665663 tempest-SecurityGroupRulesTestJSON-1282665663-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 1.090141 Sep 08 10:53:23.529147 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1742/3482] 10.222.0.27 () {60 vars in 1195 bytes} [Thu Sep 8 10:53:22 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:53:23.547264 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-00080c48-b0f2-4e40-a508-95d274ed54e9 req-b6704b2a-d026-4ddf-a62f-1daa13820d16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "214ebb38-6f31-48bd-99a4-50ca64d78574", "tag": "3c6a80ed-ce3a-4b48-89dc-20fec3d919ea"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:53:23.599060 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-00080c48-b0f2-4e40-a508-95d274ed54e9 req-b6704b2a-d026-4ddf-a62f-1daa13820d16 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:23.604919 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-00080c48-b0f2-4e40-a508-95d274ed54e9 req-b6704b2a-d026-4ddf-a62f-1daa13820d16 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:23.605563 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-00080c48-b0f2-4e40-a508-95d274ed54e9 req-b6704b2a-d026-4ddf-a62f-1daa13820d16 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:23.639302 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-00080c48-b0f2-4e40-a508-95d274ed54e9 req-b6704b2a-d026-4ddf-a62f-1daa13820d16 service nova] Creating event network-changed:3c6a80ed-ce3a-4b48-89dc-20fec3d919ea for instance 214ebb38-6f31-48bd-99a4-50ca64d78574 on n-h2-850501-12 Sep 08 10:53:23.657806 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-00080c48-b0f2-4e40-a508-95d274ed54e9 req-b6704b2a-d026-4ddf-a62f-1daa13820d16 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118819 Sep 08 10:53:23.658881 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1743/3483] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:53:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:53:23.674969 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-151ba94a-d74b-404f-bffe-fa05181c6a7e tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:23.677088 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-151ba94a-d74b-404f-bffe-fa05181c6a7e tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] [instance: 214ebb38-6f31-48bd-99a4-50ca64d78574] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:23.698327 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a62438f4-cd9c-4c5c-b2b1-2d0e76ffd08e tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Action: 'create', calling method: .version_select at 0x7f68e44c91f0>, body: {"keypair": {"name": "tempest-keypair-1655933188", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE4QebqhJfJgAqArsKnqs4XJi5iUeT4wyMsvCq9Se96fOba6bps0ldBENqFocqcaPvkTSFbVUC/QVFxVmWSBDwd63jm+DzM0ixA3tHgU4WVMwzTB1QM8zLefu21NpcnNFQ=="}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:53:23.721727 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-151ba94a-d74b-404f-bffe-fa05181c6a7e tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:23.724731 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-151ba94a-d74b-404f-bffe-fa05181c6a7e tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:23.726068 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-151ba94a-d74b-404f-bffe-fa05181c6a7e tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:23.734693 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-151ba94a-d74b-404f-bffe-fa05181c6a7e tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:23.736690 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-151ba94a-d74b-404f-bffe-fa05181c6a7e tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:23.740359 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-151ba94a-d74b-404f-bffe-fa05181c6a7e tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:23.783454 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-a62438f4-cd9c-4c5c-b2b1-2d0e76ffd08e tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Getting quotas for project 3bd99a7d947e4ee4808db30f234d2c0f. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:53:23.808857 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-a62438f4-cd9c-4c5c-b2b1-2d0e76ffd08e tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Getting quotas for user eb64d1e0aabf4889a5515e4f89d9db0e and project 3bd99a7d947e4ee4808db30f234d2c0f. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:53:23.892094 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a62438f4-cd9c-4c5c-b2b1-2d0e76ffd08e tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.569406 Sep 08 10:53:23.894964 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1741/3484] 10.222.0.27 () {60 vars in 1159 bytes} [Thu Sep 8 10:53:23 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:53:23.922693 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f6268104-f083-4acd-9666-242e2852d989 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:53:23.926772 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f6268104-f083-4acd-9666-242e2852d989 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: fafff8cb-0e6f-4243-a91c-ec559f656880] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:23.954470 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f6268104-f083-4acd-9666-242e2852d989 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:23.956188 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f6268104-f083-4acd-9666-242e2852d989 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:23.956857 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f6268104-f083-4acd-9666-242e2852d989 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:23.957828 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f6268104-f083-4acd-9666-242e2852d989 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:23.958656 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f6268104-f083-4acd-9666-242e2852d989 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:23.959528 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f6268104-f083-4acd-9666-242e2852d989 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:24.056086 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-f6268104-f083-4acd-9666-242e2852d989 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lazy-loading 'flavor' on Instance uuid fafff8cb-0e6f-4243-a91c-ec559f656880 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:53:24.075000 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-f6268104-f083-4acd-9666-242e2852d989 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] HTTP exception thrown: Cannot 'rescue' instance fafff8cb-0e6f-4243-a91c-ec559f656880 while it is in vm_state paused Sep 08 10:53:24.078206 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f6268104-f083-4acd-9666-242e2852d989 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Request method failure captured: Sep 08 10:53:24.078206 n-d-850501-12 devstack@n-api.service[128862]: request: POST /compute/v2.1/servers/fafff8cb-0e6f-4243-a91c-ec559f656880/action HTTP/1.1 Sep 08 10:53:24.078206 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:53:24.078206 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:53:24.078206 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:53:24.078206 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 14 Sep 08 10:53:24.078206 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:53:24.078206 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:53:24.078206 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:53:24.078206 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:53:24.078206 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGclZnrdHbcSspe2CSaO_gA2LIWMGtHJAKVo_u3dlzxs9JxAXcXCwrL-z-q8SJvnWUnwIz6KxjkLXp0jFFwIV3x5Qp_zUHQKWEwS-EZKwoM8W4-UxwLeQWJTnQ9cWOYmTzHY9djf2pYmuh6sOSJJezx_5s2ElCgN_L-D4iql7Pg9xGj8 Sep 08 10:53:24.078206 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:53:24.078206 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:53:24.078206 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:53:24.078206 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:53:24.078206 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:53:24.078206 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:53:24.078206 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 33063b3b9e0543369c28ea918f52cf37 Sep 08 10:53:24.078206 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1820338337 Sep 08 10:53:24.078206 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:53:24.078206 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:53:24.078206 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/33063b3b9e0543369c28ea918f52cf37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/33063b3b9e0543369c28ea918f52cf37"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_33063b3b9e0543369c28ea918f52cf37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/33063b3b9e0543369c28ea918f52cf37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:53:24.078206 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1820338337 Sep 08 10:53:24.078206 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 33063b3b9e0543369c28ea918f52cf37 Sep 08 10:53:24.078206 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1820338337 Sep 08 10:53:24.078206 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServerRescueNegativeTestJSON-1820338337-project Sep 08 10:53:24.078206 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:53:24.078206 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:53:24.078206 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 8f487f5d062e4ac3bf21c2416a7b50ee Sep 08 10:53:24.078206 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1820338337-project Sep 08 10:53:24.078206 n-d-850501-12 devstack@n-api.service[128862]: Sep 08 10:53:24.078206 n-d-850501-12 devstack@n-api.service[128862]: {"rescue": {}} Sep 08 10:53:24.078206 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:53:24.078206 n-d-850501-12 devstack@n-api.service[128862]: exception: Cannot 'rescue' instance fafff8cb-0e6f-4243-a91c-ec559f656880 while it is in vm_state paused Sep 08 10:53:24.078206 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'fafff8cb-0e6f-4243-a91c-ec559f656880', 'body': {'rescue': {}}} Sep 08 10:53:24.078206 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:53:24.078206 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:53:24.078206 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Sep 08 10:53:24.078206 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Sep 08 10:53:24.078206 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 08 10:53:24.078206 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 08 10:53:24.078206 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 10:53:24.078206 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 10:53:24.078206 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 08 10:53:24.078206 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 08 10:53:24.078206 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance fafff8cb-0e6f-4243-a91c-ec559f656880 in vm_state paused. Cannot rescue while the instance is in this state. Sep 08 10:53:24.078206 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:53:24.078206 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:53:24.078206 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:53:24.078206 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:53:24.078206 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:53:24.078206 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:53:24.078206 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:53:24.078206 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:53:24.078206 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:53:24.078206 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:53:24.078206 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:53:24.078206 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:53:24.078206 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Sep 08 10:53:24.078206 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Sep 08 10:53:24.078206 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 08 10:53:24.078206 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 08 10:53:24.078206 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance fafff8cb-0e6f-4243-a91c-ec559f656880 while it is in vm_state paused Sep 08 10:53:24.078206 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:53:24.084548 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:53:24.084548 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:53:24.084548 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:53:24.084548 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:53:24.084548 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:53:24.084548 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:53:24.084548 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:53:24.084548 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance fafff8cb-0e6f-4243-a91c-ec559f656880 while it is in vm_state paused Sep 08 10:53:24.084548 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:53:24.086989 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f6268104-f083-4acd-9666-242e2852d989 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Returning 409 to user: Cannot 'rescue' instance fafff8cb-0e6f-4243-a91c-ec559f656880 while it is in vm_state paused {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:53:24.088885 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f6268104-f083-4acd-9666-242e2852d989 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "POST /compute/v2.1/servers/fafff8cb-0e6f-4243-a91c-ec559f656880/action" status: 409 len: 144 microversion: 2.1 time: 0.190689 Sep 08 10:53:24.090051 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1742/3485] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:53:23 2022] POST /compute/v2.1/servers/fafff8cb-0e6f-4243-a91c-ec559f656880/action => generated 144 bytes in 194 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:53:24.100669 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-50b87f5c-b3cc-467a-a2b2-ad3380b44322 tempest-SecurityGroupRulesTestJSON-1282665663 tempest-SecurityGroupRulesTestJSON-1282665663-project] Calling method '.version_select at 0x7f68e44c9dc0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:24.823337 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-151ba94a-d74b-404f-bffe-fa05181c6a7e tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c4b351a0a4ccabbfb5438b5c535e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bb5f5b56a2402999719f0374228ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:24.834476 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-151ba94a-d74b-404f-bffe-fa05181c6a7e tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] 10.222.0.27 "GET /compute/v2.1/servers/214ebb38-6f31-48bd-99a4-50ca64d78574" status: 200 len: 1323 microversion: 2.1 time: 1.172540 Sep 08 10:53:24.838035 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1744/3486] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:23 2022] GET /compute/v2.1/servers/214ebb38-6f31-48bd-99a4-50ca64d78574 => generated 1323 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:24.850488 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e58b63e3-634b-4cf0-b787-5b9693db1748 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:53:24.857936 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e58b63e3-634b-4cf0-b787-5b9693db1748 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: fafff8cb-0e6f-4243-a91c-ec559f656880] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:24.881084 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-50b87f5c-b3cc-467a-a2b2-ad3380b44322 tempest-SecurityGroupRulesTestJSON-1282665663 tempest-SecurityGroupRulesTestJSON-1282665663-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/a97d1a8a-fd16-41e0-b780-65c0fc0f15fc" status: 202 len: 0 microversion: 2.1 time: 0.789011 Sep 08 10:53:24.881919 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e58b63e3-634b-4cf0-b787-5b9693db1748 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:24.887906 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1743/3487] 10.222.0.27 () {58 vars in 1272 bytes} [Thu Sep 8 10:53:24 2022] DELETE /compute/v2.1/os-security-groups/a97d1a8a-fd16-41e0-b780-65c0fc0f15fc => generated 0 bytes in 791 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:53:24.888253 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e58b63e3-634b-4cf0-b787-5b9693db1748 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:24.888253 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e58b63e3-634b-4cf0-b787-5b9693db1748 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:24.893384 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dd70a5a8-7829-4a19-a77a-8d8d2f4e2dd1 tempest-SecurityGroupRulesTestJSON-1282665663 tempest-SecurityGroupRulesTestJSON-1282665663-project] Calling method '.version_select at 0x7f68e44c93a0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:24.900812 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e58b63e3-634b-4cf0-b787-5b9693db1748 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:24.901821 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e58b63e3-634b-4cf0-b787-5b9693db1748 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:24.903908 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e58b63e3-634b-4cf0-b787-5b9693db1748 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:25.024233 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-dd70a5a8-7829-4a19-a77a-8d8d2f4e2dd1 tempest-SecurityGroupRulesTestJSON-1282665663 tempest-SecurityGroupRulesTestJSON-1282665663-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/98511dff-fc6c-4549-8356-c3e509f35965" status: 200 len: 247 microversion: 2.1 time: 0.135328 Sep 08 10:53:25.026151 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1744/3488] 10.222.0.27 () {58 vars in 1269 bytes} [Thu Sep 8 10:53:24 2022] GET /compute/v2.1/os-security-groups/98511dff-fc6c-4549-8356-c3e509f35965 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:53:25.051883 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a21bf29f-5ac5-4350-ba36-4bb3b54ac1fb tempest-SecurityGroupRulesTestJSON-1282665663 tempest-SecurityGroupRulesTestJSON-1282665663-project] Action: 'create', calling method: .version_select at 0x7f68e424e1f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-348420240", "description": "tempest-description-297266106"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:53:25.139257 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e58b63e3-634b-4cf0-b787-5b9693db1748 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "POST /compute/v2.1/servers/fafff8cb-0e6f-4243-a91c-ec559f656880/action" status: 202 len: 0 microversion: 2.1 time: 0.299559 Sep 08 10:53:25.143766 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1745/3489] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:53:24 2022] POST /compute/v2.1/servers/fafff8cb-0e6f-4243-a91c-ec559f656880/action => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:53:25.154179 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-faec37c7-7fdf-4ca1-a7a1-25a9260bcb3f tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:25.155072 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-faec37c7-7fdf-4ca1-a7a1-25a9260bcb3f tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: fafff8cb-0e6f-4243-a91c-ec559f656880] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:25.178103 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-faec37c7-7fdf-4ca1-a7a1-25a9260bcb3f tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:25.178736 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-faec37c7-7fdf-4ca1-a7a1-25a9260bcb3f tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:25.179391 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-faec37c7-7fdf-4ca1-a7a1-25a9260bcb3f tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:25.181778 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-faec37c7-7fdf-4ca1-a7a1-25a9260bcb3f tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:25.183126 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-faec37c7-7fdf-4ca1-a7a1-25a9260bcb3f tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:25.183760 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-faec37c7-7fdf-4ca1-a7a1-25a9260bcb3f tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:25.405924 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a21bf29f-5ac5-4350-ba36-4bb3b54ac1fb tempest-SecurityGroupRulesTestJSON-1282665663 tempest-SecurityGroupRulesTestJSON-1282665663-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.365980 Sep 08 10:53:25.407555 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1745/3490] 10.222.0.27 () {60 vars in 1180 bytes} [Thu Sep 8 10:53:25 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:53:25.420196 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-64c535ca-54ef-4758-8e2b-f4b227c570df tempest-SecurityGroupRulesTestJSON-1282665663 tempest-SecurityGroupRulesTestJSON-1282665663-project] Action: 'create', calling method: .version_select at 0x7f68e8a615e0>, body: {"security_group_rule": {"parent_group_id": "c54f0f8a-2232-449f-a7d2-056eff127372", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:53:25.798824 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-faec37c7-7fdf-4ca1-a7a1-25a9260bcb3f tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:25.823262 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-faec37c7-7fdf-4ca1-a7a1-25a9260bcb3f tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/fafff8cb-0e6f-4243-a91c-ec559f656880" status: 200 len: 1508 microversion: 2.1 time: 0.673987 Sep 08 10:53:25.836261 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1746/3491] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:25 2022] GET /compute/v2.1/servers/fafff8cb-0e6f-4243-a91c-ec559f656880 => generated 1508 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:25.878077 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4d92af52-8ac6-4751-9701-2d8bb90fbc58 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:25.879060 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4d92af52-8ac6-4751-9701-2d8bb90fbc58 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] [instance: 214ebb38-6f31-48bd-99a4-50ca64d78574] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:25.889780 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4d92af52-8ac6-4751-9701-2d8bb90fbc58 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:25.891040 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4d92af52-8ac6-4751-9701-2d8bb90fbc58 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:25.891852 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4d92af52-8ac6-4751-9701-2d8bb90fbc58 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:25.892883 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4d92af52-8ac6-4751-9701-2d8bb90fbc58 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:25.893693 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4d92af52-8ac6-4751-9701-2d8bb90fbc58 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:25.894610 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4d92af52-8ac6-4751-9701-2d8bb90fbc58 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:26.296971 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4d92af52-8ac6-4751-9701-2d8bb90fbc58 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c4b351a0a4ccabbfb5438b5c535e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bb5f5b56a2402999719f0374228ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:26.332453 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4d92af52-8ac6-4751-9701-2d8bb90fbc58 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] 10.222.0.27 "GET /compute/v2.1/servers/214ebb38-6f31-48bd-99a4-50ca64d78574" status: 200 len: 1323 microversion: 2.1 time: 0.449857 Sep 08 10:53:26.337425 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1747/3492] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:25 2022] GET /compute/v2.1/servers/214ebb38-6f31-48bd-99a4-50ca64d78574 => generated 1323 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:53:26.366582 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-64c535ca-54ef-4758-8e2b-f4b227c570df tempest-SecurityGroupRulesTestJSON-1282665663 tempest-SecurityGroupRulesTestJSON-1282665663-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.950262 Sep 08 10:53:26.368811 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1746/3493] 10.222.0.27 () {60 vars in 1195 bytes} [Thu Sep 8 10:53:25 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:53:26.386246 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9e58e4b7-f6ce-49e1-8d90-d479bdf2e338 tempest-SecurityGroupRulesTestJSON-1282665663 tempest-SecurityGroupRulesTestJSON-1282665663-project] Action: 'create', calling method: .version_select at 0x7f68e4710e50>, body: {"security_group_rule": {"parent_group_id": "c54f0f8a-2232-449f-a7d2-056eff127372", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:53:26.864223 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-60d1af19-fd79-4864-a7f7-b31a5266bc97 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:26.867243 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-60d1af19-fd79-4864-a7f7-b31a5266bc97 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: fafff8cb-0e6f-4243-a91c-ec559f656880] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:26.928966 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-60d1af19-fd79-4864-a7f7-b31a5266bc97 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:26.932614 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-60d1af19-fd79-4864-a7f7-b31a5266bc97 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:26.933138 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-60d1af19-fd79-4864-a7f7-b31a5266bc97 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:26.933874 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-60d1af19-fd79-4864-a7f7-b31a5266bc97 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:26.936846 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-60d1af19-fd79-4864-a7f7-b31a5266bc97 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:26.937527 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-60d1af19-fd79-4864-a7f7-b31a5266bc97 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:27.261253 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-60d1af19-fd79-4864-a7f7-b31a5266bc97 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:27.301221 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-60d1af19-fd79-4864-a7f7-b31a5266bc97 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/fafff8cb-0e6f-4243-a91c-ec559f656880" status: 200 len: 1516 microversion: 2.1 time: 0.437949 Sep 08 10:53:27.321091 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1747/3494] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:26 2022] GET /compute/v2.1/servers/fafff8cb-0e6f-4243-a91c-ec559f656880 => generated 1516 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:27.376383 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-20bd4255-86e8-46e3-87db-82a2e36b7510 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:27.377311 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-20bd4255-86e8-46e3-87db-82a2e36b7510 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] [instance: 214ebb38-6f31-48bd-99a4-50ca64d78574] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:27.424641 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-20bd4255-86e8-46e3-87db-82a2e36b7510 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:27.427074 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-20bd4255-86e8-46e3-87db-82a2e36b7510 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:27.428586 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-20bd4255-86e8-46e3-87db-82a2e36b7510 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:27.430299 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-20bd4255-86e8-46e3-87db-82a2e36b7510 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:27.433234 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-20bd4255-86e8-46e3-87db-82a2e36b7510 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:27.434605 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-20bd4255-86e8-46e3-87db-82a2e36b7510 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:27.910091 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-20bd4255-86e8-46e3-87db-82a2e36b7510 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c4b351a0a4ccabbfb5438b5c535e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bb5f5b56a2402999719f0374228ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:27.931003 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-20bd4255-86e8-46e3-87db-82a2e36b7510 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] 10.222.0.27 "GET /compute/v2.1/servers/214ebb38-6f31-48bd-99a4-50ca64d78574" status: 200 len: 1323 microversion: 2.1 time: 0.576519 Sep 08 10:53:27.946163 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1748/3495] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:27 2022] GET /compute/v2.1/servers/214ebb38-6f31-48bd-99a4-50ca64d78574 => generated 1323 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:28.072747 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-df55197c-171d-46f4-8d85-94dcbf6a3afe tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-282293838", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "12aa0876-bb28-47d9-975a-2d76f1aa7c84"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:53:28.150074 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9e58e4b7-f6ce-49e1-8d90-d479bdf2e338 tempest-SecurityGroupRulesTestJSON-1282665663 tempest-SecurityGroupRulesTestJSON-1282665663-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 1.770059 Sep 08 10:53:28.158624 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1748/3496] 10.222.0.27 () {60 vars in 1195 bytes} [Thu Sep 8 10:53:26 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 1783 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:53:28.167612 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-58bcce6b-3d9a-42a0-972d-af5c7ca8591a tempest-SecurityGroupRulesTestJSON-1282665663 tempest-SecurityGroupRulesTestJSON-1282665663-project] Calling method '.version_select at 0x7f68e4b49670>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:28.221991 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-df55197c-171d-46f4-8d85-94dcbf6a3afe tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] validate_networks() for [('12aa0876-bb28-47d9-975a-2d76f1aa7c84', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:53:28.323817 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-58bcce6b-3d9a-42a0-972d-af5c7ca8591a tempest-SecurityGroupRulesTestJSON-1282665663 tempest-SecurityGroupRulesTestJSON-1282665663-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/c54f0f8a-2232-449f-a7d2-056eff127372" status: 200 len: 663 microversion: 2.1 time: 0.163731 Sep 08 10:53:28.333097 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1749/3497] 10.222.0.27 () {58 vars in 1269 bytes} [Thu Sep 8 10:53:28 2022] GET /compute/v2.1/os-security-groups/c54f0f8a-2232-449f-a7d2-056eff127372 => generated 663 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:53:28.339253 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a0078b9c-ddfb-4bad-a33c-3165ee2c1d9d tempest-SecurityGroupRulesTestJSON-1282665663 tempest-SecurityGroupRulesTestJSON-1282665663-project] Calling method '.version_select at 0x7f68e49591f0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:29.102459 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-df55197c-171d-46f4-8d85-94dcbf6a3afe tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:53:29.104608 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-df55197c-171d-46f4-8d85-94dcbf6a3afe tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:53:29.105270 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-df55197c-171d-46f4-8d85-94dcbf6a3afe tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:53:29.105903 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-df55197c-171d-46f4-8d85-94dcbf6a3afe tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:53:29.106322 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-df55197c-171d-46f4-8d85-94dcbf6a3afe tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:53:29.131683 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df55197c-171d-46f4-8d85-94dcbf6a3afe tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:29.132191 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df55197c-171d-46f4-8d85-94dcbf6a3afe tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:29.134407 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df55197c-171d-46f4-8d85-94dcbf6a3afe tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:29.135236 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df55197c-171d-46f4-8d85-94dcbf6a3afe tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:29.135707 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df55197c-171d-46f4-8d85-94dcbf6a3afe tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:29.142400 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df55197c-171d-46f4-8d85-94dcbf6a3afe tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:29.191423 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-df55197c-171d-46f4-8d85-94dcbf6a3afe tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Getting quotas for project 6150571a49ee49df9aebb749b57e7db5. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:53:29.205546 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-df55197c-171d-46f4-8d85-94dcbf6a3afe tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Getting quotas for user 7f551e6fe34243c290a25b57ab26af19 and project 6150571a49ee49df9aebb749b57e7db5. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:53:29.306097 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-df55197c-171d-46f4-8d85-94dcbf6a3afe tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:53:29.308640 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a0078b9c-ddfb-4bad-a33c-3165ee2c1d9d tempest-SecurityGroupRulesTestJSON-1282665663 tempest-SecurityGroupRulesTestJSON-1282665663-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-group-rules/61f3144a-4da3-48c0-add6-dc9230a7ca8d" status: 202 len: 0 microversion: 2.1 time: 0.973857 Sep 08 10:53:29.309010 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1750/3498] 10.222.0.27 () {58 vars in 1287 bytes} [Thu Sep 8 10:53:28 2022] DELETE /compute/v2.1/os-security-group-rules/61f3144a-4da3-48c0-add6-dc9230a7ca8d => generated 0 bytes in 975 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:53:29.318305 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-df55197c-171d-46f4-8d85-94dcbf6a3afe tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:53:29.325945 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bedd546c-effc-4a30-880b-209881e103ae tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:29.326574 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bedd546c-effc-4a30-880b-209881e103ae tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] [instance: 214ebb38-6f31-48bd-99a4-50ca64d78574] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:29.365353 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bedd546c-effc-4a30-880b-209881e103ae tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:29.371761 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bedd546c-effc-4a30-880b-209881e103ae tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:29.372378 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bedd546c-effc-4a30-880b-209881e103ae tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:29.373404 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bedd546c-effc-4a30-880b-209881e103ae tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:29.374101 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bedd546c-effc-4a30-880b-209881e103ae tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:29.374778 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bedd546c-effc-4a30-880b-209881e103ae tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:29.474777 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-df55197c-171d-46f4-8d85-94dcbf6a3afe tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.526016 Sep 08 10:53:29.483581 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1749/3499] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:53:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1536 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:53:29.493322 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-8cdca171-52b8-456a-8da8-5012f1a14659 req-5a729f42-263c-4de6-917d-a427f6c7a196 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e81e0acc-0b96-4dbc-a5bb-89183f5204e7", "name": "network-vif-plugged", "status": "completed", "tag": "ff9d981d-5db2-425c-b066-f87540f6e91c"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:53:29.511145 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-8cdca171-52b8-456a-8da8-5012f1a14659 req-5a729f42-263c-4de6-917d-a427f6c7a196 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:29.512049 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-8cdca171-52b8-456a-8da8-5012f1a14659 req-5a729f42-263c-4de6-917d-a427f6c7a196 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:29.512745 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-8cdca171-52b8-456a-8da8-5012f1a14659 req-5a729f42-263c-4de6-917d-a427f6c7a196 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:29.533623 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-8cdca171-52b8-456a-8da8-5012f1a14659 req-5a729f42-263c-4de6-917d-a427f6c7a196 service nova] Creating event network-vif-plugged:ff9d981d-5db2-425c-b066-f87540f6e91c for instance e81e0acc-0b96-4dbc-a5bb-89183f5204e7 on n-h1-850501-12 Sep 08 10:53:29.543294 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-8cdca171-52b8-456a-8da8-5012f1a14659 req-5a729f42-263c-4de6-917d-a427f6c7a196 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058114 Sep 08 10:53:29.551057 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1750/3500] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:53:29.567706 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-986360c3-3ee0-42ff-918b-79c728581646 tempest-SecurityGroupRulesTestJSON-1282665663 tempest-SecurityGroupRulesTestJSON-1282665663-project] Calling method '.version_select at 0x7f68e4570f70>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:29.822664 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-bedd546c-effc-4a30-880b-209881e103ae tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c4b351a0a4ccabbfb5438b5c535e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bb5f5b56a2402999719f0374228ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:29.840694 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bedd546c-effc-4a30-880b-209881e103ae tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] 10.222.0.27 "GET /compute/v2.1/servers/214ebb38-6f31-48bd-99a4-50ca64d78574" status: 200 len: 1323 microversion: 2.1 time: 0.528462 Sep 08 10:53:29.843070 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1751/3501] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:29 2022] GET /compute/v2.1/servers/214ebb38-6f31-48bd-99a4-50ca64d78574 => generated 1323 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:29.850626 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ce242a61-e2ae-482c-a574-465340b39e8b tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:29.853384 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ce242a61-e2ae-482c-a574-465340b39e8b tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:30.022303 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ce242a61-e2ae-482c-a574-465340b39e8b tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:30.040462 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ce242a61-e2ae-482c-a574-465340b39e8b tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1216 microversion: 2.1 time: 0.194156 Sep 08 10:53:30.044710 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1752/3502] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:29 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1216 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:30.080552 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e6f88dee-e137-4265-a9d0-2c32477a4c4d tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1444567821", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "51b3b441-3359-492a-a7da-bc1ab8260110"}], "security_groups": [{"name": "tempest-securitygroup--1050460106"}], "key_name": "tempest-keypair-1655933188", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:53:30.171982 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-986360c3-3ee0-42ff-918b-79c728581646 tempest-SecurityGroupRulesTestJSON-1282665663 tempest-SecurityGroupRulesTestJSON-1282665663-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/c54f0f8a-2232-449f-a7d2-056eff127372" status: 202 len: 0 microversion: 2.1 time: 0.618395 Sep 08 10:53:30.173835 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1751/3503] 10.222.0.27 () {58 vars in 1272 bytes} [Thu Sep 8 10:53:29 2022] DELETE /compute/v2.1/os-security-groups/c54f0f8a-2232-449f-a7d2-056eff127372 => generated 0 bytes in 622 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:53:30.194604 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-06700dd1-572e-4755-9e3e-887a522e8695 tempest-SecurityGroupRulesTestJSON-1282665663 tempest-SecurityGroupRulesTestJSON-1282665663-project] Calling method '.version_select at 0x7f68e44f2c10>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:30.333411 n-d-850501-12 devstack@n-api.service[128862]: DEBUG neutronclient.v2_0.client [None req-06700dd1-572e-4755-9e3e-887a522e8695 tempest-SecurityGroupRulesTestJSON-1282665663 tempest-SecurityGroupRulesTestJSON-1282665663-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a97d1a8a-fd16-41e0-b780-65c0fc0f15fc does not exist", "detail": ""}} {{(pid=128862) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 08 10:53:30.335219 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.security_group_api [None req-06700dd1-572e-4755-9e3e-887a522e8695 tempest-SecurityGroupRulesTestJSON-1282665663 tempest-SecurityGroupRulesTestJSON-1282665663-project] Neutron security group a97d1a8a-fd16-41e0-b780-65c0fc0f15fc not found {{(pid=128862) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 08 10:53:30.337348 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-06700dd1-572e-4755-9e3e-887a522e8695 tempest-SecurityGroupRulesTestJSON-1282665663 tempest-SecurityGroupRulesTestJSON-1282665663-project] HTTP exception thrown: Security group a97d1a8a-fd16-41e0-b780-65c0fc0f15fc does not exist Sep 08 10:53:30.337348 n-d-850501-12 devstack@n-api.service[128862]: Neutron server returns request_ids: ['req-418d75ad-d5a5-479f-888e-6d0322fef11f'] Sep 08 10:53:30.342085 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-06700dd1-572e-4755-9e3e-887a522e8695 tempest-SecurityGroupRulesTestJSON-1282665663 tempest-SecurityGroupRulesTestJSON-1282665663-project] Request method failure captured: Sep 08 10:53:30.342085 n-d-850501-12 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/os-security-groups/a97d1a8a-fd16-41e0-b780-65c0fc0f15fc HTTP/1.1 Sep 08 10:53:30.342085 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:53:30.342085 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:53:30.342085 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:53:30.342085 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:53:30.342085 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:53:30.342085 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:53:30.342085 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:53:30.342085 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:53:30.342085 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcmWTfheaQCWHCP3nnw3XBNlSxTR2ProIdx3Yjcn_0UYSAbvh-m6Z6Cc326PNOalSrtUxTVnkujj35hg2c_4tryuj_JEGGa8pgkymxuJT_tqU3zuElpL9UwTKjYu3rRoCpUdSjc7EAkBRD7uHHCg4zvkd_BvuDljpwUZ3NJ5-9yWAVQ Sep 08 10:53:30.342085 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:53:30.342085 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:53:30.342085 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:53:30.342085 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:53:30.342085 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:53:30.342085 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:53:30.342085 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 3d8145bb0211462f964dd40f943b3cbb Sep 08 10:53:30.342085 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1282665663 Sep 08 10:53:30.342085 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:53:30.342085 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:53:30.342085 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3d8145bb0211462f964dd40f943b3cbb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3d8145bb0211462f964dd40f943b3cbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3d8145bb0211462f964dd40f943b3cbb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3d8145bb0211462f964dd40f943b3cbb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:53:30.342085 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1282665663 Sep 08 10:53:30.342085 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 3d8145bb0211462f964dd40f943b3cbb Sep 08 10:53:30.342085 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1282665663 Sep 08 10:53:30.342085 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-SecurityGroupRulesTestJSON-1282665663-project Sep 08 10:53:30.342085 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:53:30.342085 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:53:30.342085 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: e3cfe142fb4f441eb3330ba470133e81 Sep 08 10:53:30.342085 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1282665663-project Sep 08 10:53:30.342085 n-d-850501-12 devstack@n-api.service[128862]: method: Sep 08 10:53:30.342085 n-d-850501-12 devstack@n-api.service[128862]: exception: Security group a97d1a8a-fd16-41e0-b780-65c0fc0f15fc does not exist Sep 08 10:53:30.342085 n-d-850501-12 devstack@n-api.service[128862]: Neutron server returns request_ids: ['req-418d75ad-d5a5-479f-888e-6d0322fef11f'] Sep 08 10:53:30.342085 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'a97d1a8a-fd16-41e0-b780-65c0fc0f15fc'} Sep 08 10:53:30.342085 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:53:30.342085 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:53:30.342085 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 08 10:53:30.342085 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 08 10:53:30.342085 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:53:30.342085 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:53:30.342085 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 08 10:53:30.342085 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 08 10:53:30.342085 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:53:30.342085 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:53:30.342085 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 08 10:53:30.342085 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 08 10:53:30.342085 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:53:30.342085 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:53:30.342085 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 08 10:53:30.342085 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 08 10:53:30.342085 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:53:30.342085 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:53:30.342085 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 08 10:53:30.342085 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 08 10:53:30.342085 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:53:30.342085 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:53:30.342085 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 08 10:53:30.342085 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 08 10:53:30.342085 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 08 10:53:30.342085 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 08 10:53:30.342085 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a97d1a8a-fd16-41e0-b780-65c0fc0f15fc does not exist Sep 08 10:53:30.346977 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-418d75ad-d5a5-479f-888e-6d0322fef11f'] Sep 08 10:53:30.346977 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:53:30.346977 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:53:30.346977 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:53:30.346977 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:53:30.346977 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 08 10:53:30.346977 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 08 10:53:30.346977 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 08 10:53:30.346977 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 08 10:53:30.346977 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a97d1a8a-fd16-41e0-b780-65c0fc0f15fc does not exist Sep 08 10:53:30.346977 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-418d75ad-d5a5-479f-888e-6d0322fef11f'] Sep 08 10:53:30.346977 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:53:30.346977 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:53:30.346977 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:53:30.346977 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:53:30.346977 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:53:30.346977 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:53:30.346977 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:53:30.346977 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:53:30.346977 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:53:30.346977 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:53:30.346977 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:53:30.346977 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:53:30.346977 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 08 10:53:30.346977 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 08 10:53:30.346977 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a97d1a8a-fd16-41e0-b780-65c0fc0f15fc does not exist Sep 08 10:53:30.346977 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-418d75ad-d5a5-479f-888e-6d0322fef11f'] Sep 08 10:53:30.346977 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:53:30.346977 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:53:30.346977 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:53:30.346977 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:53:30.346977 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:53:30.346977 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:53:30.346977 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:53:30.346977 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:53:30.346977 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a97d1a8a-fd16-41e0-b780-65c0fc0f15fc does not exist Sep 08 10:53:30.346977 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-418d75ad-d5a5-479f-888e-6d0322fef11f'] Sep 08 10:53:30.346977 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:53:30.354292 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-06700dd1-572e-4755-9e3e-887a522e8695 tempest-SecurityGroupRulesTestJSON-1282665663 tempest-SecurityGroupRulesTestJSON-1282665663-project] Returning 404 to user: Security group a97d1a8a-fd16-41e0-b780-65c0fc0f15fc does not exist Sep 08 10:53:30.354292 n-d-850501-12 devstack@n-api.service[128862]: Neutron server returns request_ids: ['req-418d75ad-d5a5-479f-888e-6d0322fef11f'] {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:53:30.357714 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-06700dd1-572e-4755-9e3e-887a522e8695 tempest-SecurityGroupRulesTestJSON-1282665663 tempest-SecurityGroupRulesTestJSON-1282665663-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/a97d1a8a-fd16-41e0-b780-65c0fc0f15fc" status: 404 len: 194 microversion: 2.1 time: 0.178360 Sep 08 10:53:30.359309 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1752/3504] 10.222.0.27 () {58 vars in 1272 bytes} [Thu Sep 8 10:53:30 2022] DELETE /compute/v2.1/os-security-groups/a97d1a8a-fd16-41e0-b780-65c0fc0f15fc => generated 194 bytes in 181 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:53:30.379691 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7374952a-8f64-44ef-b7a3-f014a508ed68 tempest-SecurityGroupRulesTestJSON-1282665663 tempest-SecurityGroupRulesTestJSON-1282665663-project] Calling method '.version_select at 0x7f68e454ae50>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:30.437004 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-e6f88dee-e137-4265-a9d0-2c32477a4c4d tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] validate_networks() for [('51b3b441-3359-492a-a7da-bc1ab8260110', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:53:30.975279 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7374952a-8f64-44ef-b7a3-f014a508ed68 tempest-SecurityGroupRulesTestJSON-1282665663 tempest-SecurityGroupRulesTestJSON-1282665663-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/98511dff-fc6c-4549-8356-c3e509f35965" status: 202 len: 0 microversion: 2.1 time: 0.612789 Sep 08 10:53:30.975935 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1753/3505] 10.222.0.27 () {58 vars in 1272 bytes} [Thu Sep 8 10:53:30 2022] DELETE /compute/v2.1/os-security-groups/98511dff-fc6c-4549-8356-c3e509f35965 => generated 0 bytes in 614 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:53:30.986636 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4b44e726-49cd-4ff5-aab7-53ab19b13550 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:30.992999 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4b44e726-49cd-4ff5-aab7-53ab19b13550 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] [instance: 214ebb38-6f31-48bd-99a4-50ca64d78574] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:31.011183 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4b44e726-49cd-4ff5-aab7-53ab19b13550 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:31.016669 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4b44e726-49cd-4ff5-aab7-53ab19b13550 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:31.017618 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4b44e726-49cd-4ff5-aab7-53ab19b13550 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:31.019463 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4b44e726-49cd-4ff5-aab7-53ab19b13550 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:31.023815 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4b44e726-49cd-4ff5-aab7-53ab19b13550 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:31.025577 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4b44e726-49cd-4ff5-aab7-53ab19b13550 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:31.410686 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-e6f88dee-e137-4265-a9d0-2c32477a4c4d tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Getting quotas for project 3bd99a7d947e4ee4808db30f234d2c0f. Resources: dict_keys(['metadata_items']) {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:53:31.418923 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-e6f88dee-e137-4265-a9d0-2c32477a4c4d tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Getting quotas for user eb64d1e0aabf4889a5515e4f89d9db0e and project 3bd99a7d947e4ee4808db30f234d2c0f. Resources: dict_keys(['metadata_items']) {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:53:31.451898 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-e6f88dee-e137-4265-a9d0-2c32477a4c4d tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:53:31.455201 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-e6f88dee-e137-4265-a9d0-2c32477a4c4d tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:53:31.455881 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-e6f88dee-e137-4265-a9d0-2c32477a4c4d tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:53:31.456460 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-e6f88dee-e137-4265-a9d0-2c32477a4c4d tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:53:31.456677 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4b44e726-49cd-4ff5-aab7-53ab19b13550 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c4b351a0a4ccabbfb5438b5c535e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bb5f5b56a2402999719f0374228ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:31.459363 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-e6f88dee-e137-4265-a9d0-2c32477a4c4d tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:53:31.467179 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4b44e726-49cd-4ff5-aab7-53ab19b13550 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] 10.222.0.27 "GET /compute/v2.1/servers/214ebb38-6f31-48bd-99a4-50ca64d78574" status: 200 len: 1323 microversion: 2.1 time: 0.489528 Sep 08 10:53:31.468154 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1754/3506] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:30 2022] GET /compute/v2.1/servers/214ebb38-6f31-48bd-99a4-50ca64d78574 => generated 1323 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:31.484460 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e6f88dee-e137-4265-a9d0-2c32477a4c4d tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:31.484964 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e6f88dee-e137-4265-a9d0-2c32477a4c4d tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:31.485434 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e6f88dee-e137-4265-a9d0-2c32477a4c4d tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:31.486177 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e6f88dee-e137-4265-a9d0-2c32477a4c4d tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:31.486638 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e6f88dee-e137-4265-a9d0-2c32477a4c4d tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:31.487069 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e6f88dee-e137-4265-a9d0-2c32477a4c4d tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:31.496715 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2768e356-05e5-4b17-a78a-e502390b794a tempest-SecurityGroupRulesTestJSON-1282665663 tempest-SecurityGroupRulesTestJSON-1282665663-project] Calling method '.version_select at 0x7f68e416fc10>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:31.512063 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-e6f88dee-e137-4265-a9d0-2c32477a4c4d tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Getting quotas for project 3bd99a7d947e4ee4808db30f234d2c0f. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:53:31.518948 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-e6f88dee-e137-4265-a9d0-2c32477a4c4d tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Getting quotas for user eb64d1e0aabf4889a5515e4f89d9db0e and project 3bd99a7d947e4ee4808db30f234d2c0f. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:53:31.535373 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e6f88dee-e137-4265-a9d0-2c32477a4c4d tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:53:31.539522 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e6f88dee-e137-4265-a9d0-2c32477a4c4d tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] [instance: 8540b5a8-bbfc-44e0-b10b-2fc0c316f842] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:53:31.557212 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:53:31.614956 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e6f88dee-e137-4265-a9d0-2c32477a4c4d tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.563812 Sep 08 10:53:31.616263 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1753/3507] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:53:30 2022] POST /compute/v2.1/servers => generated 407 bytes in 1571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:53:31.623051 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6bfe6d57-4e06-4e53-bcd7-2a8a468ba469 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:31.624467 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6bfe6d57-4e06-4e53-bcd7-2a8a468ba469 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:31.631492 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6bfe6d57-4e06-4e53-bcd7-2a8a468ba469 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:31.632273 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6bfe6d57-4e06-4e53-bcd7-2a8a468ba469 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:31.633557 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6bfe6d57-4e06-4e53-bcd7-2a8a468ba469 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:31.634555 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6bfe6d57-4e06-4e53-bcd7-2a8a468ba469 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:31.635571 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6bfe6d57-4e06-4e53-bcd7-2a8a468ba469 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:31.636983 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6bfe6d57-4e06-4e53-bcd7-2a8a468ba469 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:31.748110 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6bfe6d57-4e06-4e53-bcd7-2a8a468ba469 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:31.759677 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6bfe6d57-4e06-4e53-bcd7-2a8a468ba469 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1268 microversion: 2.1 time: 0.140827 Sep 08 10:53:31.777742 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1754/3508] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:31 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1268 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:31.783454 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4f456a83-e061-4b3a-8762-e63b2f923ffd tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:31.784399 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4f456a83-e061-4b3a-8762-e63b2f923ffd tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] [instance: 8540b5a8-bbfc-44e0-b10b-2fc0c316f842] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:31.922299 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4f456a83-e061-4b3a-8762-e63b2f923ffd tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb64d1e0aabf4889a5515e4f89d9db0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd99a7d947e4ee4808db30f234d2c0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:31.944155 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4f456a83-e061-4b3a-8762-e63b2f923ffd tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] 10.222.0.27 "GET /compute/v2.1/servers/8540b5a8-bbfc-44e0-b10b-2fc0c316f842" status: 200 len: 1270 microversion: 2.1 time: 0.164693 Sep 08 10:53:31.954741 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1755/3509] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:31 2022] GET /compute/v2.1/servers/8540b5a8-bbfc-44e0-b10b-2fc0c316f842 => generated 1270 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:31.964293 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-82d3d22a-372d-49c2-8daf-c1739e650a15 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:53:31.976104 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-82d3d22a-372d-49c2-8daf-c1739e650a15 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: fafff8cb-0e6f-4243-a91c-ec559f656880] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:31.989160 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-82d3d22a-372d-49c2-8daf-c1739e650a15 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:31.990220 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-82d3d22a-372d-49c2-8daf-c1739e650a15 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:31.991096 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-82d3d22a-372d-49c2-8daf-c1739e650a15 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:31.998022 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-82d3d22a-372d-49c2-8daf-c1739e650a15 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:32.002073 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-82d3d22a-372d-49c2-8daf-c1739e650a15 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:32.003114 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-82d3d22a-372d-49c2-8daf-c1739e650a15 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:32.094207 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-82d3d22a-372d-49c2-8daf-c1739e650a15 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lazy-loading 'flavor' on Instance uuid fafff8cb-0e6f-4243-a91c-ec559f656880 {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:53:32.365102 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-82d3d22a-372d-49c2-8daf-c1739e650a15 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "POST /compute/v2.1/servers/fafff8cb-0e6f-4243-a91c-ec559f656880/action" status: 200 len: 32 microversion: 2.1 time: 0.405046 Sep 08 10:53:32.366263 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1756/3510] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:53:31 2022] POST /compute/v2.1/servers/fafff8cb-0e6f-4243-a91c-ec559f656880/action => generated 32 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:53:32.405141 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9e76c9fe-12fb-44db-aeea-e59391f3fbb7 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:32.406611 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9e76c9fe-12fb-44db-aeea-e59391f3fbb7 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: fafff8cb-0e6f-4243-a91c-ec559f656880] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:32.446246 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e76c9fe-12fb-44db-aeea-e59391f3fbb7 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:32.447729 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e76c9fe-12fb-44db-aeea-e59391f3fbb7 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:32.449432 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e76c9fe-12fb-44db-aeea-e59391f3fbb7 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:32.451154 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e76c9fe-12fb-44db-aeea-e59391f3fbb7 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:32.452568 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e76c9fe-12fb-44db-aeea-e59391f3fbb7 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:32.453909 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e76c9fe-12fb-44db-aeea-e59391f3fbb7 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:32.840482 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9e76c9fe-12fb-44db-aeea-e59391f3fbb7 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:32.855930 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9e76c9fe-12fb-44db-aeea-e59391f3fbb7 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/fafff8cb-0e6f-4243-a91c-ec559f656880" status: 200 len: 1522 microversion: 2.1 time: 0.464008 Sep 08 10:53:32.857734 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1757/3511] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:32 2022] GET /compute/v2.1/servers/fafff8cb-0e6f-4243-a91c-ec559f656880 => generated 1522 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:32.876359 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5e8bdad9-2b19-47bb-b972-70b285b35fe1 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:32.879305 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5e8bdad9-2b19-47bb-b972-70b285b35fe1 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] [instance: 214ebb38-6f31-48bd-99a4-50ca64d78574] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:32.902021 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5e8bdad9-2b19-47bb-b972-70b285b35fe1 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:32.903643 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5e8bdad9-2b19-47bb-b972-70b285b35fe1 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:32.906894 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5e8bdad9-2b19-47bb-b972-70b285b35fe1 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:32.907766 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5e8bdad9-2b19-47bb-b972-70b285b35fe1 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:32.909968 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5e8bdad9-2b19-47bb-b972-70b285b35fe1 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:32.909968 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5e8bdad9-2b19-47bb-b972-70b285b35fe1 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:33.262873 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5e8bdad9-2b19-47bb-b972-70b285b35fe1 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c4b351a0a4ccabbfb5438b5c535e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bb5f5b56a2402999719f0374228ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:33.278535 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5e8bdad9-2b19-47bb-b972-70b285b35fe1 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] 10.222.0.27 "GET /compute/v2.1/servers/214ebb38-6f31-48bd-99a4-50ca64d78574" status: 200 len: 1323 microversion: 2.1 time: 0.417679 Sep 08 10:53:33.289343 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1758/3512] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:32 2022] GET /compute/v2.1/servers/214ebb38-6f31-48bd-99a4-50ca64d78574 => generated 1323 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:33.289343 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-afb12168-dc33-49c3-aad8-80b24281ea98 req-3afc0b8d-ae2d-4cbd-9168-59796cbb0a81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "214ebb38-6f31-48bd-99a4-50ca64d78574", "name": "network-vif-plugged", "status": "completed", "tag": "3c6a80ed-ce3a-4b48-89dc-20fec3d919ea"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:53:33.305417 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-afb12168-dc33-49c3-aad8-80b24281ea98 req-3afc0b8d-ae2d-4cbd-9168-59796cbb0a81 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:33.306097 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-afb12168-dc33-49c3-aad8-80b24281ea98 req-3afc0b8d-ae2d-4cbd-9168-59796cbb0a81 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:33.306998 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-afb12168-dc33-49c3-aad8-80b24281ea98 req-3afc0b8d-ae2d-4cbd-9168-59796cbb0a81 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:33.329222 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-afb12168-dc33-49c3-aad8-80b24281ea98 req-3afc0b8d-ae2d-4cbd-9168-59796cbb0a81 service nova] Creating event network-vif-plugged:3c6a80ed-ce3a-4b48-89dc-20fec3d919ea for instance 214ebb38-6f31-48bd-99a4-50ca64d78574 on n-h2-850501-12 Sep 08 10:53:33.337595 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-afb12168-dc33-49c3-aad8-80b24281ea98 req-3afc0b8d-ae2d-4cbd-9168-59796cbb0a81 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055489 Sep 08 10:53:33.342073 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1759/3513] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:53:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:53:33.353921 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f6a14b6c-5751-48a9-a9da-a51b45a8f88a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:33.355182 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f6a14b6c-5751-48a9-a9da-a51b45a8f88a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:33.370552 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f6a14b6c-5751-48a9-a9da-a51b45a8f88a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:33.370939 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f6a14b6c-5751-48a9-a9da-a51b45a8f88a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:33.371902 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f6a14b6c-5751-48a9-a9da-a51b45a8f88a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:33.372119 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f6a14b6c-5751-48a9-a9da-a51b45a8f88a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:33.372569 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f6a14b6c-5751-48a9-a9da-a51b45a8f88a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:33.373177 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f6a14b6c-5751-48a9-a9da-a51b45a8f88a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:33.579306 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f6a14b6c-5751-48a9-a9da-a51b45a8f88a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:33.592055 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f6a14b6c-5751-48a9-a9da-a51b45a8f88a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1274 microversion: 2.1 time: 0.248011 Sep 08 10:53:33.595405 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1760/3514] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:33 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1274 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:33.601510 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-318e03d5-214a-42c0-a96a-14c2f47b3f5c tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:33.602585 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-318e03d5-214a-42c0-a96a-14c2f47b3f5c tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] [instance: 8540b5a8-bbfc-44e0-b10b-2fc0c316f842] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:33.609593 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-318e03d5-214a-42c0-a96a-14c2f47b3f5c tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:33.610985 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-318e03d5-214a-42c0-a96a-14c2f47b3f5c tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:33.611621 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-318e03d5-214a-42c0-a96a-14c2f47b3f5c tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:33.617165 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-318e03d5-214a-42c0-a96a-14c2f47b3f5c tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:33.617804 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-318e03d5-214a-42c0-a96a-14c2f47b3f5c tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:33.618529 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-318e03d5-214a-42c0-a96a-14c2f47b3f5c tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:33.812431 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-318e03d5-214a-42c0-a96a-14c2f47b3f5c tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb64d1e0aabf4889a5515e4f89d9db0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd99a7d947e4ee4808db30f234d2c0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:33.814952 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:53:33.828545 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-318e03d5-214a-42c0-a96a-14c2f47b3f5c tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] 10.222.0.27 "GET /compute/v2.1/servers/8540b5a8-bbfc-44e0-b10b-2fc0c316f842" status: 200 len: 1322 microversion: 2.1 time: 0.231741 Sep 08 10:53:33.842906 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1761/3515] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:33 2022] GET /compute/v2.1/servers/8540b5a8-bbfc-44e0-b10b-2fc0c316f842 => generated 1322 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:33.901633 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4a60e7c9-693d-4ff0-9ceb-4e4d233cbcda tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:33.902583 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4a60e7c9-693d-4ff0-9ceb-4e4d233cbcda tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: fafff8cb-0e6f-4243-a91c-ec559f656880] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:33.926918 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a60e7c9-693d-4ff0-9ceb-4e4d233cbcda tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:33.927433 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a60e7c9-693d-4ff0-9ceb-4e4d233cbcda tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:33.927878 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a60e7c9-693d-4ff0-9ceb-4e4d233cbcda tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:33.929794 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a60e7c9-693d-4ff0-9ceb-4e4d233cbcda tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:33.930867 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a60e7c9-693d-4ff0-9ceb-4e4d233cbcda tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:33.931732 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a60e7c9-693d-4ff0-9ceb-4e4d233cbcda tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:34.193705 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4a60e7c9-693d-4ff0-9ceb-4e4d233cbcda tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:34.205510 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4a60e7c9-693d-4ff0-9ceb-4e4d233cbcda tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/fafff8cb-0e6f-4243-a91c-ec559f656880" status: 200 len: 1522 microversion: 2.1 time: 0.308640 Sep 08 10:53:34.221051 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1762/3516] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:33 2022] GET /compute/v2.1/servers/fafff8cb-0e6f-4243-a91c-ec559f656880 => generated 1522 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:53:34.264255 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2768e356-05e5-4b17-a78a-e502390b794a tempest-SecurityGroupRulesTestJSON-1282665663 tempest-SecurityGroupRulesTestJSON-1282665663-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/8f6ad7b6-2e75-4043-b2d5-aa17909e7891" status: 202 len: 0 microversion: 2.1 time: 2.794414 Sep 08 10:53:34.268970 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1755/3517] 10.222.0.27 () {58 vars in 1272 bytes} [Thu Sep 8 10:53:31 2022] DELETE /compute/v2.1/os-security-groups/8f6ad7b6-2e75-4043-b2d5-aa17909e7891 => generated 0 bytes in 2800 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:53:34.275594 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4145f2d0-39f5-4196-9c0f-9c57fd7e7a4c tempest-SecurityGroupRulesTestJSON-1282665663 tempest-SecurityGroupRulesTestJSON-1282665663-project] Calling method '.version_select at 0x7f68e48c9670>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:34.311450 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f197073e-8765-46e0-ad01-ada3905d53b4 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:34.312458 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f197073e-8765-46e0-ad01-ada3905d53b4 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] [instance: 214ebb38-6f31-48bd-99a4-50ca64d78574] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:34.339866 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f197073e-8765-46e0-ad01-ada3905d53b4 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:34.340373 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f197073e-8765-46e0-ad01-ada3905d53b4 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:34.340804 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f197073e-8765-46e0-ad01-ada3905d53b4 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:34.341563 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f197073e-8765-46e0-ad01-ada3905d53b4 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:34.342016 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f197073e-8765-46e0-ad01-ada3905d53b4 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:34.352535 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f197073e-8765-46e0-ad01-ada3905d53b4 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:34.588601 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4145f2d0-39f5-4196-9c0f-9c57fd7e7a4c tempest-SecurityGroupRulesTestJSON-1282665663 tempest-SecurityGroupRulesTestJSON-1282665663-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/9f52b7f2-be8e-4f4a-8273-a9c446d1b945" status: 202 len: 0 microversion: 2.1 time: 0.318894 Sep 08 10:53:34.590231 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1763/3518] 10.222.0.27 () {58 vars in 1272 bytes} [Thu Sep 8 10:53:34 2022] DELETE /compute/v2.1/os-security-groups/9f52b7f2-be8e-4f4a-8273-a9c446d1b945 => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:53:34.601139 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e195b3e5-4d09-4209-bbdb-5f773007aafa tempest-SecurityGroupRulesTestJSON-1282665663 tempest-SecurityGroupRulesTestJSON-1282665663-project] Calling method '.version_select at 0x7f68e89d73a0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:34.930114 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f197073e-8765-46e0-ad01-ada3905d53b4 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c4b351a0a4ccabbfb5438b5c535e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bb5f5b56a2402999719f0374228ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:34.943767 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f197073e-8765-46e0-ad01-ada3905d53b4 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] 10.222.0.27 "GET /compute/v2.1/servers/214ebb38-6f31-48bd-99a4-50ca64d78574" status: 200 len: 1323 microversion: 2.1 time: 0.636149 Sep 08 10:53:34.960891 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1756/3519] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:34 2022] GET /compute/v2.1/servers/214ebb38-6f31-48bd-99a4-50ca64d78574 => generated 1323 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:53:34.966245 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6d949c1c-ac08-4b24-900e-3d1054795cbc tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:34.967257 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6d949c1c-ac08-4b24-900e-3d1054795cbc tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:34.974444 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d949c1c-ac08-4b24-900e-3d1054795cbc tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:34.975370 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d949c1c-ac08-4b24-900e-3d1054795cbc tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:34.976164 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d949c1c-ac08-4b24-900e-3d1054795cbc tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:34.977163 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d949c1c-ac08-4b24-900e-3d1054795cbc tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:34.977901 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d949c1c-ac08-4b24-900e-3d1054795cbc tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:34.979057 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d949c1c-ac08-4b24-900e-3d1054795cbc tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:35.167140 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6d949c1c-ac08-4b24-900e-3d1054795cbc tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:35.186287 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6d949c1c-ac08-4b24-900e-3d1054795cbc tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1274 microversion: 2.1 time: 0.223605 Sep 08 10:53:35.198743 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1757/3520] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:34 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1274 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:35.219046 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5908f370-b1b1-4e53-9027-b6d084ceadc2 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:35.221194 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5908f370-b1b1-4e53-9027-b6d084ceadc2 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] [instance: 8540b5a8-bbfc-44e0-b10b-2fc0c316f842] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:35.236068 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5908f370-b1b1-4e53-9027-b6d084ceadc2 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:35.237077 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5908f370-b1b1-4e53-9027-b6d084ceadc2 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:35.237750 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5908f370-b1b1-4e53-9027-b6d084ceadc2 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:35.238697 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5908f370-b1b1-4e53-9027-b6d084ceadc2 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:35.240069 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5908f370-b1b1-4e53-9027-b6d084ceadc2 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:35.241060 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5908f370-b1b1-4e53-9027-b6d084ceadc2 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:35.414667 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e195b3e5-4d09-4209-bbdb-5f773007aafa tempest-SecurityGroupRulesTestJSON-1282665663 tempest-SecurityGroupRulesTestJSON-1282665663-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/b95e78f4-a1e2-457e-9262-6004ce70a7dd" status: 202 len: 0 microversion: 2.1 time: 0.818509 Sep 08 10:53:35.415712 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1764/3521] 10.222.0.27 () {58 vars in 1272 bytes} [Thu Sep 8 10:53:34 2022] DELETE /compute/v2.1/os-security-groups/b95e78f4-a1e2-457e-9262-6004ce70a7dd => generated 0 bytes in 820 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:53:35.420892 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-81d4f48d-bcac-479d-9e65-995318ae5151 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:35.421728 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-81d4f48d-bcac-479d-9e65-995318ae5151 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: fafff8cb-0e6f-4243-a91c-ec559f656880] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:35.437089 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-81d4f48d-bcac-479d-9e65-995318ae5151 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:35.439757 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-81d4f48d-bcac-479d-9e65-995318ae5151 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:35.442197 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-81d4f48d-bcac-479d-9e65-995318ae5151 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:35.450493 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-81d4f48d-bcac-479d-9e65-995318ae5151 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:35.451305 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-81d4f48d-bcac-479d-9e65-995318ae5151 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:35.451972 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-81d4f48d-bcac-479d-9e65-995318ae5151 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:35.569451 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5908f370-b1b1-4e53-9027-b6d084ceadc2 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb64d1e0aabf4889a5515e4f89d9db0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd99a7d947e4ee4808db30f234d2c0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:35.594647 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5908f370-b1b1-4e53-9027-b6d084ceadc2 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] 10.222.0.27 "GET /compute/v2.1/servers/8540b5a8-bbfc-44e0-b10b-2fc0c316f842" status: 200 len: 1340 microversion: 2.1 time: 0.392884 Sep 08 10:53:35.595937 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1758/3522] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:35 2022] GET /compute/v2.1/servers/8540b5a8-bbfc-44e0-b10b-2fc0c316f842 => generated 1340 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:35.604670 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-12e36cac-ee3a-41f2-a4c6-6cec86f58977 tempest-SecurityGroupRulesTestJSON-1282665663 tempest-SecurityGroupRulesTestJSON-1282665663-project] Calling method '.version_select at 0x7f68e4578af0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:35.799555 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-81d4f48d-bcac-479d-9e65-995318ae5151 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:35.810178 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-81d4f48d-bcac-479d-9e65-995318ae5151 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/fafff8cb-0e6f-4243-a91c-ec559f656880" status: 200 len: 1522 microversion: 2.1 time: 0.393072 Sep 08 10:53:35.837057 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1765/3523] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:35 2022] GET /compute/v2.1/servers/fafff8cb-0e6f-4243-a91c-ec559f656880 => generated 1522 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:35.968124 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-dc331dd3-0c94-4513-ad92-c23ab4612d07 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:35.969553 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-dc331dd3-0c94-4513-ad92-c23ab4612d07 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] [instance: 214ebb38-6f31-48bd-99a4-50ca64d78574] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:35.994294 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dc331dd3-0c94-4513-ad92-c23ab4612d07 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:35.996727 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dc331dd3-0c94-4513-ad92-c23ab4612d07 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:35.997501 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dc331dd3-0c94-4513-ad92-c23ab4612d07 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:35.998554 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dc331dd3-0c94-4513-ad92-c23ab4612d07 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:35.999181 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dc331dd3-0c94-4513-ad92-c23ab4612d07 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:36.000380 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dc331dd3-0c94-4513-ad92-c23ab4612d07 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:36.186386 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-12e36cac-ee3a-41f2-a4c6-6cec86f58977 tempest-SecurityGroupRulesTestJSON-1282665663 tempest-SecurityGroupRulesTestJSON-1282665663-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/50e1f3e9-01da-4194-a85f-163a126a1416" status: 202 len: 0 microversion: 2.1 time: 0.586854 Sep 08 10:53:36.193530 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1759/3524] 10.222.0.27 () {58 vars in 1272 bytes} [Thu Sep 8 10:53:35 2022] DELETE /compute/v2.1/os-security-groups/50e1f3e9-01da-4194-a85f-163a126a1416 => generated 0 bytes in 595 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:53:36.225358 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2d4ac2a7-e8cf-4079-b52e-0cc6c0e46af6 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:36.227088 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2d4ac2a7-e8cf-4079-b52e-0cc6c0e46af6 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:36.245150 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2d4ac2a7-e8cf-4079-b52e-0cc6c0e46af6 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:36.246002 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2d4ac2a7-e8cf-4079-b52e-0cc6c0e46af6 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:36.248035 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2d4ac2a7-e8cf-4079-b52e-0cc6c0e46af6 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:36.250777 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2d4ac2a7-e8cf-4079-b52e-0cc6c0e46af6 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:36.251621 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2d4ac2a7-e8cf-4079-b52e-0cc6c0e46af6 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:36.254307 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2d4ac2a7-e8cf-4079-b52e-0cc6c0e46af6 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:36.386265 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-dc331dd3-0c94-4513-ad92-c23ab4612d07 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c4b351a0a4ccabbfb5438b5c535e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bb5f5b56a2402999719f0374228ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:36.398458 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-dc331dd3-0c94-4513-ad92-c23ab4612d07 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] 10.222.0.27 "GET /compute/v2.1/servers/214ebb38-6f31-48bd-99a4-50ca64d78574" status: 200 len: 1518 microversion: 2.1 time: 0.434091 Sep 08 10:53:36.399334 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1766/3525] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:35 2022] GET /compute/v2.1/servers/214ebb38-6f31-48bd-99a4-50ca64d78574 => generated 1518 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:53:36.432847 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3a96d5d8-61ef-46eb-b8ce-e946caf85c50 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.7.28"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:53:36.436925 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3a96d5d8-61ef-46eb-b8ce-e946caf85c50 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] [instance: 50feb7c3-9282-44b6-ad37-bf09e2d3f5a8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:36.456464 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3a96d5d8-61ef-46eb-b8ce-e946caf85c50 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:36.460723 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3a96d5d8-61ef-46eb-b8ce-e946caf85c50 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:36.461818 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3a96d5d8-61ef-46eb-b8ce-e946caf85c50 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:36.467548 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3a96d5d8-61ef-46eb-b8ce-e946caf85c50 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:36.471875 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3a96d5d8-61ef-46eb-b8ce-e946caf85c50 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:36.472594 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3a96d5d8-61ef-46eb-b8ce-e946caf85c50 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:36.537954 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3a96d5d8-61ef-46eb-b8ce-e946caf85c50 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "refresh_cache-50feb7c3-9282-44b6-ad37-bf09e2d3f5a8" {{(pid=128861) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 08 10:53:36.539063 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3a96d5d8-61ef-46eb-b8ce-e946caf85c50 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquired lock "refresh_cache-50feb7c3-9282-44b6-ad37-bf09e2d3f5a8" {{(pid=128861) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 08 10:53:36.795526 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2d4ac2a7-e8cf-4079-b52e-0cc6c0e46af6 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:36.816833 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2d4ac2a7-e8cf-4079-b52e-0cc6c0e46af6 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1316 microversion: 2.1 time: 0.596857 Sep 08 10:53:36.828746 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1760/3526] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:36 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1316 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:53:36.838005 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8cceee61-c369-4233-90ce-945486a6aafa tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:36.846962 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8cceee61-c369-4233-90ce-945486a6aafa tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] [instance: 8540b5a8-bbfc-44e0-b10b-2fc0c316f842] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:36.870267 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8cceee61-c369-4233-90ce-945486a6aafa tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:36.871056 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8cceee61-c369-4233-90ce-945486a6aafa tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:36.871798 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8cceee61-c369-4233-90ce-945486a6aafa tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:36.873332 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8cceee61-c369-4233-90ce-945486a6aafa tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:36.877998 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8cceee61-c369-4233-90ce-945486a6aafa tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:36.878677 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8cceee61-c369-4233-90ce-945486a6aafa tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:37.474648 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8cceee61-c369-4233-90ce-945486a6aafa tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb64d1e0aabf4889a5515e4f89d9db0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd99a7d947e4ee4808db30f234d2c0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:37.498093 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8cceee61-c369-4233-90ce-945486a6aafa tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] 10.222.0.27 "GET /compute/v2.1/servers/8540b5a8-bbfc-44e0-b10b-2fc0c316f842" status: 200 len: 1396 microversion: 2.1 time: 0.666275 Sep 08 10:53:37.498888 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1761/3527] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:36 2022] GET /compute/v2.1/servers/8540b5a8-bbfc-44e0-b10b-2fc0c316f842 => generated 1396 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:37.506043 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8ecc326e-fe8b-4d57-9600-2ef133c30af3 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:37.523396 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8ecc326e-fe8b-4d57-9600-2ef133c30af3 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: fafff8cb-0e6f-4243-a91c-ec559f656880] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:37.555736 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ecc326e-fe8b-4d57-9600-2ef133c30af3 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:37.559817 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ecc326e-fe8b-4d57-9600-2ef133c30af3 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:37.569196 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ecc326e-fe8b-4d57-9600-2ef133c30af3 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:37.572647 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ecc326e-fe8b-4d57-9600-2ef133c30af3 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:37.574893 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ecc326e-fe8b-4d57-9600-2ef133c30af3 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:37.578045 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ecc326e-fe8b-4d57-9600-2ef133c30af3 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:38.078528 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8ecc326e-fe8b-4d57-9600-2ef133c30af3 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:38.092682 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8ecc326e-fe8b-4d57-9600-2ef133c30af3 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/fafff8cb-0e6f-4243-a91c-ec559f656880" status: 200 len: 1522 microversion: 2.1 time: 0.592407 Sep 08 10:53:38.094563 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1762/3528] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:37 2022] GET /compute/v2.1/servers/fafff8cb-0e6f-4243-a91c-ec559f656880 => generated 1522 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:38.099701 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ddf5c4cb-45d8-46bf-b119-4746f6815097 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:38.101301 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ddf5c4cb-45d8-46bf-b119-4746f6815097 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:38.109256 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ddf5c4cb-45d8-46bf-b119-4746f6815097 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:38.109855 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ddf5c4cb-45d8-46bf-b119-4746f6815097 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:38.110512 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ddf5c4cb-45d8-46bf-b119-4746f6815097 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:38.111586 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ddf5c4cb-45d8-46bf-b119-4746f6815097 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:38.112124 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ddf5c4cb-45d8-46bf-b119-4746f6815097 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:38.112927 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ddf5c4cb-45d8-46bf-b119-4746f6815097 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:38.514647 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ddf5c4cb-45d8-46bf-b119-4746f6815097 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:38.535827 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ddf5c4cb-45d8-46bf-b119-4746f6815097 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1316 microversion: 2.1 time: 0.436938 Sep 08 10:53:38.541530 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1763/3529] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:38 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1316 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:38.556331 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c554f338-d821-4ab0-9a30-3482cfc8f57a tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:38.560935 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c554f338-d821-4ab0-9a30-3482cfc8f57a tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] [instance: 8540b5a8-bbfc-44e0-b10b-2fc0c316f842] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:38.580911 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c554f338-d821-4ab0-9a30-3482cfc8f57a tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:38.582350 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c554f338-d821-4ab0-9a30-3482cfc8f57a tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:38.583217 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c554f338-d821-4ab0-9a30-3482cfc8f57a tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:38.585780 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c554f338-d821-4ab0-9a30-3482cfc8f57a tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:38.586874 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c554f338-d821-4ab0-9a30-3482cfc8f57a tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:38.587791 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c554f338-d821-4ab0-9a30-3482cfc8f57a tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:39.108317 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c554f338-d821-4ab0-9a30-3482cfc8f57a tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb64d1e0aabf4889a5515e4f89d9db0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd99a7d947e4ee4808db30f234d2c0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:39.129638 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c554f338-d821-4ab0-9a30-3482cfc8f57a tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] 10.222.0.27 "GET /compute/v2.1/servers/8540b5a8-bbfc-44e0-b10b-2fc0c316f842" status: 200 len: 1396 microversion: 2.1 time: 0.580059 Sep 08 10:53:39.139741 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1764/3530] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:38 2022] GET /compute/v2.1/servers/8540b5a8-bbfc-44e0-b10b-2fc0c316f842 => generated 1396 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:39.164070 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-bb0f71e9-56dd-4c50-b192-2120062966e1 req-4174197b-8bce-4739-a886-aeaa1fe3d80c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74eebde7-4328-4ddf-be14-bb9fba70ec03", "tag": "15f823c3-a4f6-4444-a294-abb10fd52df7"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:53:39.175037 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:53:39.177637 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-bb0f71e9-56dd-4c50-b192-2120062966e1 req-4174197b-8bce-4739-a886-aeaa1fe3d80c service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:39.178573 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-bb0f71e9-56dd-4c50-b192-2120062966e1 req-4174197b-8bce-4739-a886-aeaa1fe3d80c service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:39.179496 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-bb0f71e9-56dd-4c50-b192-2120062966e1 req-4174197b-8bce-4739-a886-aeaa1fe3d80c service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:39.193970 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-bb0f71e9-56dd-4c50-b192-2120062966e1 req-4174197b-8bce-4739-a886-aeaa1fe3d80c service nova] Creating event network-changed:15f823c3-a4f6-4444-a294-abb10fd52df7 for instance 74eebde7-4328-4ddf-be14-bb9fba70ec03 on n-h1-850501-12 Sep 08 10:53:39.203757 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-bb0f71e9-56dd-4c50-b192-2120062966e1 req-4174197b-8bce-4739-a886-aeaa1fe3d80c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061872 Sep 08 10:53:39.205288 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1765/3531] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:53:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:53:39.220490 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-46c09972-082f-498d-a54f-c3f5ba71f23c tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:39.221248 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-46c09972-082f-498d-a54f-c3f5ba71f23c tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: fafff8cb-0e6f-4243-a91c-ec559f656880] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:39.229201 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-46c09972-082f-498d-a54f-c3f5ba71f23c tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:39.229860 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-46c09972-082f-498d-a54f-c3f5ba71f23c tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:39.230066 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-46c09972-082f-498d-a54f-c3f5ba71f23c tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:39.230805 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-46c09972-082f-498d-a54f-c3f5ba71f23c tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:39.231277 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-46c09972-082f-498d-a54f-c3f5ba71f23c tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:39.231713 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-46c09972-082f-498d-a54f-c3f5ba71f23c tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:39.290349 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=10 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:53:39.608462 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-46c09972-082f-498d-a54f-c3f5ba71f23c tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:39.657256 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-46c09972-082f-498d-a54f-c3f5ba71f23c tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/fafff8cb-0e6f-4243-a91c-ec559f656880" status: 200 len: 1522 microversion: 2.1 time: 0.440844 Sep 08 10:53:39.659185 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1766/3532] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:39 2022] GET /compute/v2.1/servers/fafff8cb-0e6f-4243-a91c-ec559f656880 => generated 1522 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:39.678172 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fb5c9e00-a188-4ba5-b4bb-2ddad8152afe tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:39.679774 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fb5c9e00-a188-4ba5-b4bb-2ddad8152afe tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:39.707031 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb5c9e00-a188-4ba5-b4bb-2ddad8152afe tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:39.708194 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb5c9e00-a188-4ba5-b4bb-2ddad8152afe tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:39.711071 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb5c9e00-a188-4ba5-b4bb-2ddad8152afe tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:39.714048 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb5c9e00-a188-4ba5-b4bb-2ddad8152afe tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:39.714962 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb5c9e00-a188-4ba5-b4bb-2ddad8152afe tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:39.715574 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb5c9e00-a188-4ba5-b4bb-2ddad8152afe tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:39.818378 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-3a96d5d8-61ef-46eb-b8ce-e946caf85c50 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] [instance: 50feb7c3-9282-44b6-ad37-bf09e2d3f5a8] Building network info cache for instance {{(pid=128861) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 08 10:53:40.742885 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fb5c9e00-a188-4ba5-b4bb-2ddad8152afe tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:40.752684 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fb5c9e00-a188-4ba5-b4bb-2ddad8152afe tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1316 microversion: 2.1 time: 1.090181 Sep 08 10:53:40.759667 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1767/3533] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:39 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1316 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:40.763999 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-d22cf69b-d753-43d4-a5d0-63f66c21475b req-9cf34be9-5761-46dd-9350-0c2aaac18011 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8540b5a8-bbfc-44e0-b10b-2fc0c316f842", "tag": "909f79bb-7501-41db-ad7d-238a18a7493c"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:53:40.803267 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d22cf69b-d753-43d4-a5d0-63f66c21475b req-9cf34be9-5761-46dd-9350-0c2aaac18011 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:40.804477 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d22cf69b-d753-43d4-a5d0-63f66c21475b req-9cf34be9-5761-46dd-9350-0c2aaac18011 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:40.805611 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d22cf69b-d753-43d4-a5d0-63f66c21475b req-9cf34be9-5761-46dd-9350-0c2aaac18011 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:40.811373 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:53:40.847592 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-d22cf69b-d753-43d4-a5d0-63f66c21475b req-9cf34be9-5761-46dd-9350-0c2aaac18011 service nova] Creating event network-changed:909f79bb-7501-41db-ad7d-238a18a7493c for instance 8540b5a8-bbfc-44e0-b10b-2fc0c316f842 on n-h2-850501-12 Sep 08 10:53:40.864791 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-d22cf69b-d753-43d4-a5d0-63f66c21475b req-9cf34be9-5761-46dd-9350-0c2aaac18011 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104211 Sep 08 10:53:40.866610 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1768/3534] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:53:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:53:40.873110 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8fee8ac1-45bf-49d9-8470-90271c9128f8 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:40.874442 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8fee8ac1-45bf-49d9-8470-90271c9128f8 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] [instance: 8540b5a8-bbfc-44e0-b10b-2fc0c316f842] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:40.883180 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8fee8ac1-45bf-49d9-8470-90271c9128f8 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:40.899885 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8fee8ac1-45bf-49d9-8470-90271c9128f8 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:40.900807 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8fee8ac1-45bf-49d9-8470-90271c9128f8 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:40.901916 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8fee8ac1-45bf-49d9-8470-90271c9128f8 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:40.902880 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8fee8ac1-45bf-49d9-8470-90271c9128f8 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:40.903877 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8fee8ac1-45bf-49d9-8470-90271c9128f8 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:41.327973 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8fee8ac1-45bf-49d9-8470-90271c9128f8 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb64d1e0aabf4889a5515e4f89d9db0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd99a7d947e4ee4808db30f234d2c0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:41.351608 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8fee8ac1-45bf-49d9-8470-90271c9128f8 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] 10.222.0.27 "GET /compute/v2.1/servers/8540b5a8-bbfc-44e0-b10b-2fc0c316f842" status: 200 len: 1396 microversion: 2.1 time: 0.482289 Sep 08 10:53:41.366889 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1769/3535] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:40 2022] GET /compute/v2.1/servers/8540b5a8-bbfc-44e0-b10b-2fc0c316f842 => generated 1396 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:41.378669 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f4cbb4be-1a78-41a4-b9db-d8d9c6290f98 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:41.382570 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f4cbb4be-1a78-41a4-b9db-d8d9c6290f98 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: fafff8cb-0e6f-4243-a91c-ec559f656880] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:41.395357 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f4cbb4be-1a78-41a4-b9db-d8d9c6290f98 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:41.395357 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f4cbb4be-1a78-41a4-b9db-d8d9c6290f98 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:41.395816 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f4cbb4be-1a78-41a4-b9db-d8d9c6290f98 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:41.396617 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f4cbb4be-1a78-41a4-b9db-d8d9c6290f98 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:41.397106 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f4cbb4be-1a78-41a4-b9db-d8d9c6290f98 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:41.398076 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f4cbb4be-1a78-41a4-b9db-d8d9c6290f98 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:41.450394 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-3a96d5d8-61ef-46eb-b8ce-e946caf85c50 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] [instance: 50feb7c3-9282-44b6-ad37-bf09e2d3f5a8] Updating instance_info_cache with network_info: [{"id": "ca13d9de-91b0-46ce-8809-9fde8d4724a3", "address": "fa:16:3e:f9:0f:5c", "network": {"id": "9b985b6c-8cab-4bb8-8ec5-91dd022aec51", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-487710725-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.7.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "44bb5f5b56a2402999719f0374228ed3", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapca13d9de-91", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128861) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 08 10:53:41.474289 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3a96d5d8-61ef-46eb-b8ce-e946caf85c50 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Releasing lock "refresh_cache-50feb7c3-9282-44b6-ad37-bf09e2d3f5a8" {{(pid=128861) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 08 10:53:41.475394 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3a96d5d8-61ef-46eb-b8ce-e946caf85c50 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] 10.222.0.27 "POST /compute/v2.1/servers/50feb7c3-9282-44b6-ad37-bf09e2d3f5a8/action" status: 202 len: 0 microversion: 2.1 time: 5.049746 Sep 08 10:53:41.478623 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1767/3536] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:53:36 2022] POST /compute/v2.1/servers/50feb7c3-9282-44b6-ad37-bf09e2d3f5a8/action => generated 0 bytes in 5053 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 08 10:53:41.489481 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9cf4e39e-e6da-46af-9456-bf4671c716ce tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.7.28"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:53:41.495448 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9cf4e39e-e6da-46af-9456-bf4671c716ce tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] [instance: 214ebb38-6f31-48bd-99a4-50ca64d78574] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:41.498048 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:53:41.504532 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9cf4e39e-e6da-46af-9456-bf4671c716ce tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:41.505466 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9cf4e39e-e6da-46af-9456-bf4671c716ce tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:41.506079 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9cf4e39e-e6da-46af-9456-bf4671c716ce tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:41.507573 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9cf4e39e-e6da-46af-9456-bf4671c716ce tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:41.508421 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9cf4e39e-e6da-46af-9456-bf4671c716ce tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:41.508858 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9cf4e39e-e6da-46af-9456-bf4671c716ce tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:41.545380 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9cf4e39e-e6da-46af-9456-bf4671c716ce tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "refresh_cache-214ebb38-6f31-48bd-99a4-50ca64d78574" {{(pid=128861) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 08 10:53:41.546237 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9cf4e39e-e6da-46af-9456-bf4671c716ce tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquired lock "refresh_cache-214ebb38-6f31-48bd-99a4-50ca64d78574" {{(pid=128861) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 08 10:53:41.817623 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f4cbb4be-1a78-41a4-b9db-d8d9c6290f98 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:41.832580 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f4cbb4be-1a78-41a4-b9db-d8d9c6290f98 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/fafff8cb-0e6f-4243-a91c-ec559f656880" status: 200 len: 1522 microversion: 2.1 time: 0.464125 Sep 08 10:53:41.833224 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1770/3537] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:41 2022] GET /compute/v2.1/servers/fafff8cb-0e6f-4243-a91c-ec559f656880 => generated 1522 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:41.844036 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5d33e458-b79f-4927-8d0d-a9aabf827c80 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:41.855932 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5d33e458-b79f-4927-8d0d-a9aabf827c80 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:41.884891 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5d33e458-b79f-4927-8d0d-a9aabf827c80 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:41.891946 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5d33e458-b79f-4927-8d0d-a9aabf827c80 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:41.895909 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5d33e458-b79f-4927-8d0d-a9aabf827c80 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:41.902623 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5d33e458-b79f-4927-8d0d-a9aabf827c80 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:41.907906 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5d33e458-b79f-4927-8d0d-a9aabf827c80 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:41.911334 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5d33e458-b79f-4927-8d0d-a9aabf827c80 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:41.933911 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=14 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:53:42.501745 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5d33e458-b79f-4927-8d0d-a9aabf827c80 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:42.514589 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5d33e458-b79f-4927-8d0d-a9aabf827c80 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1316 microversion: 2.1 time: 0.679749 Sep 08 10:53:42.531544 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1771/3538] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:41 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1316 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:42.542435 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a9037110-6860-46f8-8641-ec92e55cff2a tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:42.543775 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a9037110-6860-46f8-8641-ec92e55cff2a tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] [instance: 8540b5a8-bbfc-44e0-b10b-2fc0c316f842] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:42.554142 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a9037110-6860-46f8-8641-ec92e55cff2a tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:42.554974 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a9037110-6860-46f8-8641-ec92e55cff2a tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:42.555586 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a9037110-6860-46f8-8641-ec92e55cff2a tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:42.557361 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a9037110-6860-46f8-8641-ec92e55cff2a tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:42.558199 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a9037110-6860-46f8-8641-ec92e55cff2a tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:42.561172 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a9037110-6860-46f8-8641-ec92e55cff2a tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:43.136410 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a9037110-6860-46f8-8641-ec92e55cff2a tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb64d1e0aabf4889a5515e4f89d9db0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd99a7d947e4ee4808db30f234d2c0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:43.154760 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a9037110-6860-46f8-8641-ec92e55cff2a tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] 10.222.0.27 "GET /compute/v2.1/servers/8540b5a8-bbfc-44e0-b10b-2fc0c316f842" status: 200 len: 1396 microversion: 2.1 time: 0.622240 Sep 08 10:53:43.155765 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1772/3539] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:42 2022] GET /compute/v2.1/servers/8540b5a8-bbfc-44e0-b10b-2fc0c316f842 => generated 1396 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:43.160673 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6f1d9b8b-f7b3-4f16-9431-8b94629c34a3 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:43.161344 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6f1d9b8b-f7b3-4f16-9431-8b94629c34a3 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: fafff8cb-0e6f-4243-a91c-ec559f656880] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:43.171408 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f1d9b8b-f7b3-4f16-9431-8b94629c34a3 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:43.171924 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f1d9b8b-f7b3-4f16-9431-8b94629c34a3 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:43.172527 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f1d9b8b-f7b3-4f16-9431-8b94629c34a3 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:43.181977 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f1d9b8b-f7b3-4f16-9431-8b94629c34a3 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:43.182482 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f1d9b8b-f7b3-4f16-9431-8b94629c34a3 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:43.182936 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f1d9b8b-f7b3-4f16-9431-8b94629c34a3 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:43.487581 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6f1d9b8b-f7b3-4f16-9431-8b94629c34a3 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:43.496487 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6f1d9b8b-f7b3-4f16-9431-8b94629c34a3 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/fafff8cb-0e6f-4243-a91c-ec559f656880" status: 200 len: 1522 microversion: 2.1 time: 0.339584 Sep 08 10:53:43.517965 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1773/3540] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:43 2022] GET /compute/v2.1/servers/fafff8cb-0e6f-4243-a91c-ec559f656880 => generated 1522 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:43.531513 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-bad77014-3499-498d-b128-5b29a7954e01 req-a08d31d9-f691-4e20-a1ec-e427abcf5c0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50feb7c3-9282-44b6-ad37-bf09e2d3f5a8", "tag": "ca13d9de-91b0-46ce-8809-9fde8d4724a3"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:53:43.543902 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=4 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:53:43.566169 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-bad77014-3499-498d-b128-5b29a7954e01 req-a08d31d9-f691-4e20-a1ec-e427abcf5c0f service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:43.567257 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-bad77014-3499-498d-b128-5b29a7954e01 req-a08d31d9-f691-4e20-a1ec-e427abcf5c0f service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:43.574271 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-bad77014-3499-498d-b128-5b29a7954e01 req-a08d31d9-f691-4e20-a1ec-e427abcf5c0f service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:43.607475 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-bad77014-3499-498d-b128-5b29a7954e01 req-a08d31d9-f691-4e20-a1ec-e427abcf5c0f service nova] Creating event network-changed:ca13d9de-91b0-46ce-8809-9fde8d4724a3 for instance 50feb7c3-9282-44b6-ad37-bf09e2d3f5a8 on n-h2-850501-12 Sep 08 10:53:43.619210 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-bad77014-3499-498d-b128-5b29a7954e01 req-a08d31d9-f691-4e20-a1ec-e427abcf5c0f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099424 Sep 08 10:53:43.628582 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1774/3541] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:53:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:53:43.644620 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4a0a92d2-985f-4e52-a8bf-8af32b9a541d tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:43.648729 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4a0a92d2-985f-4e52-a8bf-8af32b9a541d tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:43.667020 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a0a92d2-985f-4e52-a8bf-8af32b9a541d tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:43.667790 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a0a92d2-985f-4e52-a8bf-8af32b9a541d tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:43.668404 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a0a92d2-985f-4e52-a8bf-8af32b9a541d tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:43.671069 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a0a92d2-985f-4e52-a8bf-8af32b9a541d tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:43.681285 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a0a92d2-985f-4e52-a8bf-8af32b9a541d tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:43.682208 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a0a92d2-985f-4e52-a8bf-8af32b9a541d tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:44.302191 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4a0a92d2-985f-4e52-a8bf-8af32b9a541d tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:44.317373 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4a0a92d2-985f-4e52-a8bf-8af32b9a541d tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1316 microversion: 2.1 time: 0.685558 Sep 08 10:53:44.319691 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1775/3542] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:43 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1316 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:44.339950 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-38e12361-a2c2-4982-b3fd-c5e827d934b7 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:44.340989 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-38e12361-a2c2-4982-b3fd-c5e827d934b7 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] [instance: 8540b5a8-bbfc-44e0-b10b-2fc0c316f842] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:44.374739 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38e12361-a2c2-4982-b3fd-c5e827d934b7 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:44.374739 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38e12361-a2c2-4982-b3fd-c5e827d934b7 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:44.374739 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38e12361-a2c2-4982-b3fd-c5e827d934b7 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:44.376048 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38e12361-a2c2-4982-b3fd-c5e827d934b7 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:44.376567 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38e12361-a2c2-4982-b3fd-c5e827d934b7 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:44.377498 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38e12361-a2c2-4982-b3fd-c5e827d934b7 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:45.089457 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-38e12361-a2c2-4982-b3fd-c5e827d934b7 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb64d1e0aabf4889a5515e4f89d9db0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd99a7d947e4ee4808db30f234d2c0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:45.107266 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-38e12361-a2c2-4982-b3fd-c5e827d934b7 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] 10.222.0.27 "GET /compute/v2.1/servers/8540b5a8-bbfc-44e0-b10b-2fc0c316f842" status: 200 len: 1396 microversion: 2.1 time: 0.784307 Sep 08 10:53:45.109400 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1776/3543] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:44 2022] GET /compute/v2.1/servers/8540b5a8-bbfc-44e0-b10b-2fc0c316f842 => generated 1396 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:45.121573 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f60e27c9-2d8e-4cc9-b1c7-1c8f58068d2d tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:45.125732 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f60e27c9-2d8e-4cc9-b1c7-1c8f58068d2d tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: fafff8cb-0e6f-4243-a91c-ec559f656880] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:45.141501 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f60e27c9-2d8e-4cc9-b1c7-1c8f58068d2d tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:45.147648 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f60e27c9-2d8e-4cc9-b1c7-1c8f58068d2d tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:45.148979 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f60e27c9-2d8e-4cc9-b1c7-1c8f58068d2d tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:45.150077 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f60e27c9-2d8e-4cc9-b1c7-1c8f58068d2d tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:45.153302 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f60e27c9-2d8e-4cc9-b1c7-1c8f58068d2d tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:45.154072 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f60e27c9-2d8e-4cc9-b1c7-1c8f58068d2d tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:45.340918 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.network.neutron [None req-9cf4e39e-e6da-46af-9456-bf4671c716ce tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] [instance: 214ebb38-6f31-48bd-99a4-50ca64d78574] re-assign floating IP 172.25.7.28 from instance 50feb7c3-9282-44b6-ad37-bf09e2d3f5a8 Sep 08 10:53:45.418352 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-9cf4e39e-e6da-46af-9456-bf4671c716ce tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] [instance: 50feb7c3-9282-44b6-ad37-bf09e2d3f5a8] Building network info cache for instance {{(pid=128861) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 08 10:53:45.549348 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f60e27c9-2d8e-4cc9-b1c7-1c8f58068d2d tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:45.569984 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f60e27c9-2d8e-4cc9-b1c7-1c8f58068d2d tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/fafff8cb-0e6f-4243-a91c-ec559f656880" status: 200 len: 1522 microversion: 2.1 time: 0.449151 Sep 08 10:53:45.574786 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1777/3544] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:45 2022] GET /compute/v2.1/servers/fafff8cb-0e6f-4243-a91c-ec559f656880 => generated 1522 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:45.594753 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-57ba3f5e-f738-490a-82c1-3f9fdb1b70d3 req-229cc319-bdac-4939-a03c-882d675ae0d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74eebde7-4328-4ddf-be14-bb9fba70ec03", "name": "network-vif-plugged", "status": "completed", "tag": "15f823c3-a4f6-4444-a294-abb10fd52df7"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:53:45.630367 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-57ba3f5e-f738-490a-82c1-3f9fdb1b70d3 req-229cc319-bdac-4939-a03c-882d675ae0d2 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:45.633961 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-57ba3f5e-f738-490a-82c1-3f9fdb1b70d3 req-229cc319-bdac-4939-a03c-882d675ae0d2 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:45.635353 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-57ba3f5e-f738-490a-82c1-3f9fdb1b70d3 req-229cc319-bdac-4939-a03c-882d675ae0d2 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:45.667387 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-57ba3f5e-f738-490a-82c1-3f9fdb1b70d3 req-229cc319-bdac-4939-a03c-882d675ae0d2 service nova] Creating event network-vif-plugged:15f823c3-a4f6-4444-a294-abb10fd52df7 for instance 74eebde7-4328-4ddf-be14-bb9fba70ec03 on n-h1-850501-12 Sep 08 10:53:45.679464 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-57ba3f5e-f738-490a-82c1-3f9fdb1b70d3 req-229cc319-bdac-4939-a03c-882d675ae0d2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101430 Sep 08 10:53:45.680504 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1778/3545] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:53:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:53:45.753822 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d478af94-5fd4-4588-a2d9-640c6829cbc5 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:45.757894 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d478af94-5fd4-4588-a2d9-640c6829cbc5 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:45.771305 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d478af94-5fd4-4588-a2d9-640c6829cbc5 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:45.774516 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d478af94-5fd4-4588-a2d9-640c6829cbc5 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:45.775302 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d478af94-5fd4-4588-a2d9-640c6829cbc5 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:45.776290 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d478af94-5fd4-4588-a2d9-640c6829cbc5 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:45.777171 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d478af94-5fd4-4588-a2d9-640c6829cbc5 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:45.779174 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d478af94-5fd4-4588-a2d9-640c6829cbc5 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:46.496099 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-9cf4e39e-e6da-46af-9456-bf4671c716ce tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] [instance: 50feb7c3-9282-44b6-ad37-bf09e2d3f5a8] Updating instance_info_cache with network_info: [{"id": "ca13d9de-91b0-46ce-8809-9fde8d4724a3", "address": "fa:16:3e:f9:0f:5c", "network": {"id": "9b985b6c-8cab-4bb8-8ec5-91dd022aec51", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-487710725-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "44bb5f5b56a2402999719f0374228ed3", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapca13d9de-91", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128861) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 08 10:53:46.532900 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-9cf4e39e-e6da-46af-9456-bf4671c716ce tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] [instance: 214ebb38-6f31-48bd-99a4-50ca64d78574] Building network info cache for instance {{(pid=128861) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 08 10:53:47.141060 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d478af94-5fd4-4588-a2d9-640c6829cbc5 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:47.154677 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d478af94-5fd4-4588-a2d9-640c6829cbc5 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1316 microversion: 2.1 time: 1.471376 Sep 08 10:53:47.180305 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1779/3546] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:45 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1316 bytes in 1492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:47.189506 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-fd53c282-23b6-4c21-b1c5-fa7440e36a11 req-00932801-937e-4662-93f7-ceb1dc5e1d02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50feb7c3-9282-44b6-ad37-bf09e2d3f5a8", "tag": "ca13d9de-91b0-46ce-8809-9fde8d4724a3"}, {"name": "network-changed", "server_uuid": "214ebb38-6f31-48bd-99a4-50ca64d78574", "tag": "3c6a80ed-ce3a-4b48-89dc-20fec3d919ea"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:53:47.235900 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-fd53c282-23b6-4c21-b1c5-fa7440e36a11 req-00932801-937e-4662-93f7-ceb1dc5e1d02 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:47.236890 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-fd53c282-23b6-4c21-b1c5-fa7440e36a11 req-00932801-937e-4662-93f7-ceb1dc5e1d02 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:47.237659 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-fd53c282-23b6-4c21-b1c5-fa7440e36a11 req-00932801-937e-4662-93f7-ceb1dc5e1d02 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:47.268875 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-fd53c282-23b6-4c21-b1c5-fa7440e36a11 req-00932801-937e-4662-93f7-ceb1dc5e1d02 service nova] Creating event network-changed:ca13d9de-91b0-46ce-8809-9fde8d4724a3 for instance 50feb7c3-9282-44b6-ad37-bf09e2d3f5a8 on n-h2-850501-12 Sep 08 10:53:47.269757 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-fd53c282-23b6-4c21-b1c5-fa7440e36a11 req-00932801-937e-4662-93f7-ceb1dc5e1d02 service nova] Creating event network-changed:3c6a80ed-ce3a-4b48-89dc-20fec3d919ea for instance 214ebb38-6f31-48bd-99a4-50ca64d78574 on n-h2-850501-12 Sep 08 10:53:47.281606 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-fd53c282-23b6-4c21-b1c5-fa7440e36a11 req-00932801-937e-4662-93f7-ceb1dc5e1d02 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.099471 Sep 08 10:53:47.284804 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1780/3547] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:53:47 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:53:47.298960 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ad5e5023-3539-4235-8eb4-56b681ff6739 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:47.300640 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ad5e5023-3539-4235-8eb4-56b681ff6739 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] [instance: 8540b5a8-bbfc-44e0-b10b-2fc0c316f842] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:47.321081 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad5e5023-3539-4235-8eb4-56b681ff6739 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:47.326254 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad5e5023-3539-4235-8eb4-56b681ff6739 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:47.327310 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad5e5023-3539-4235-8eb4-56b681ff6739 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:47.330970 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad5e5023-3539-4235-8eb4-56b681ff6739 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:47.332066 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad5e5023-3539-4235-8eb4-56b681ff6739 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:47.333428 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad5e5023-3539-4235-8eb4-56b681ff6739 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:47.630765 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-9cf4e39e-e6da-46af-9456-bf4671c716ce tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] [instance: 214ebb38-6f31-48bd-99a4-50ca64d78574] Updating instance_info_cache with network_info: [{"id": "3c6a80ed-ce3a-4b48-89dc-20fec3d919ea", "address": "fa:16:3e:95:31:4b", "network": {"id": "9b985b6c-8cab-4bb8-8ec5-91dd022aec51", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-487710725-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.7.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "44bb5f5b56a2402999719f0374228ed3", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap3c6a80ed-ce", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128861) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 08 10:53:47.656021 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9cf4e39e-e6da-46af-9456-bf4671c716ce tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Releasing lock "refresh_cache-214ebb38-6f31-48bd-99a4-50ca64d78574" {{(pid=128861) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 08 10:53:47.659167 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9cf4e39e-e6da-46af-9456-bf4671c716ce tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] 10.222.0.27 "POST /compute/v2.1/servers/214ebb38-6f31-48bd-99a4-50ca64d78574/action" status: 202 len: 0 microversion: 2.1 time: 6.174403 Sep 08 10:53:47.666304 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1768/3548] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:53:41 2022] POST /compute/v2.1/servers/214ebb38-6f31-48bd-99a4-50ca64d78574/action => generated 0 bytes in 6184 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 08 10:53:47.682984 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-83081667-715d-4804-8b08-f58bb2b08df7 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:47.683883 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-83081667-715d-4804-8b08-f58bb2b08df7 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: fafff8cb-0e6f-4243-a91c-ec559f656880] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:47.707436 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-83081667-715d-4804-8b08-f58bb2b08df7 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:47.708309 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-83081667-715d-4804-8b08-f58bb2b08df7 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:47.712105 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-83081667-715d-4804-8b08-f58bb2b08df7 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:47.715853 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-83081667-715d-4804-8b08-f58bb2b08df7 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:47.718869 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-83081667-715d-4804-8b08-f58bb2b08df7 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:47.719619 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-83081667-715d-4804-8b08-f58bb2b08df7 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:47.917693 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ad5e5023-3539-4235-8eb4-56b681ff6739 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb64d1e0aabf4889a5515e4f89d9db0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd99a7d947e4ee4808db30f234d2c0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:47.935021 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ad5e5023-3539-4235-8eb4-56b681ff6739 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] 10.222.0.27 "GET /compute/v2.1/servers/8540b5a8-bbfc-44e0-b10b-2fc0c316f842" status: 200 len: 1396 microversion: 2.1 time: 0.647061 Sep 08 10:53:47.946933 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1781/3549] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:47 2022] GET /compute/v2.1/servers/8540b5a8-bbfc-44e0-b10b-2fc0c316f842 => generated 1396 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:47.955107 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8de963f4-ab65-4210-b451-6ee2324945ff tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.7.28"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:53:47.993804 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-83081667-715d-4804-8b08-f58bb2b08df7 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:48.015400 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-83081667-715d-4804-8b08-f58bb2b08df7 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/fafff8cb-0e6f-4243-a91c-ec559f656880" status: 200 len: 1522 microversion: 2.1 time: 0.347888 Sep 08 10:53:48.020194 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1769/3550] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:47 2022] GET /compute/v2.1/servers/fafff8cb-0e6f-4243-a91c-ec559f656880 => generated 1522 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:48.192505 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7da1639d-28d4-4bd3-ae06-cb7cc6082370 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:48.193984 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7da1639d-28d4-4bd3-ae06-cb7cc6082370 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:48.209325 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7da1639d-28d4-4bd3-ae06-cb7cc6082370 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:48.212790 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7da1639d-28d4-4bd3-ae06-cb7cc6082370 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:48.213772 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7da1639d-28d4-4bd3-ae06-cb7cc6082370 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:48.220189 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7da1639d-28d4-4bd3-ae06-cb7cc6082370 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:48.221251 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7da1639d-28d4-4bd3-ae06-cb7cc6082370 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:48.222062 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7da1639d-28d4-4bd3-ae06-cb7cc6082370 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:48.724983 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8de963f4-ab65-4210-b451-6ee2324945ff tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] [instance: 214ebb38-6f31-48bd-99a4-50ca64d78574] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:48.724983 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8de963f4-ab65-4210-b451-6ee2324945ff tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:48.724983 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8de963f4-ab65-4210-b451-6ee2324945ff tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:48.724983 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8de963f4-ab65-4210-b451-6ee2324945ff tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:48.724983 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8de963f4-ab65-4210-b451-6ee2324945ff tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:48.736509 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8de963f4-ab65-4210-b451-6ee2324945ff tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:48.736509 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8de963f4-ab65-4210-b451-6ee2324945ff tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:48.794977 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7da1639d-28d4-4bd3-ae06-cb7cc6082370 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:48.838432 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7da1639d-28d4-4bd3-ae06-cb7cc6082370 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1316 microversion: 2.1 time: 0.650108 Sep 08 10:53:48.842960 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1770/3551] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:48 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1316 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:53:48.851200 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-776fcd2a-04d2-47d1-be45-22d82d458b6c req-1d97ec06-9f62-4168-a983-05f61250d707 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8540b5a8-bbfc-44e0-b10b-2fc0c316f842", "name": "network-vif-plugged", "status": "completed", "tag": "909f79bb-7501-41db-ad7d-238a18a7493c"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:53:48.883338 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-776fcd2a-04d2-47d1-be45-22d82d458b6c req-1d97ec06-9f62-4168-a983-05f61250d707 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:48.884761 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-776fcd2a-04d2-47d1-be45-22d82d458b6c req-1d97ec06-9f62-4168-a983-05f61250d707 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:48.899301 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-776fcd2a-04d2-47d1-be45-22d82d458b6c req-1d97ec06-9f62-4168-a983-05f61250d707 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:48.933732 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-776fcd2a-04d2-47d1-be45-22d82d458b6c req-1d97ec06-9f62-4168-a983-05f61250d707 service nova] Creating event network-vif-plugged:909f79bb-7501-41db-ad7d-238a18a7493c for instance 8540b5a8-bbfc-44e0-b10b-2fc0c316f842 on n-h2-850501-12 Sep 08 10:53:48.942907 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-776fcd2a-04d2-47d1-be45-22d82d458b6c req-1d97ec06-9f62-4168-a983-05f61250d707 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095796 Sep 08 10:53:48.944047 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1771/3552] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:53:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:53:48.967210 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d9fb7d79-93e0-407f-b4e4-9dca067fd6bd tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:48.968657 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d9fb7d79-93e0-407f-b4e4-9dca067fd6bd tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] [instance: 8540b5a8-bbfc-44e0-b10b-2fc0c316f842] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:48.987169 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d9fb7d79-93e0-407f-b4e4-9dca067fd6bd tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:48.990243 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d9fb7d79-93e0-407f-b4e4-9dca067fd6bd tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:48.998081 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d9fb7d79-93e0-407f-b4e4-9dca067fd6bd tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:49.000442 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d9fb7d79-93e0-407f-b4e4-9dca067fd6bd tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:49.001625 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d9fb7d79-93e0-407f-b4e4-9dca067fd6bd tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:49.002632 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d9fb7d79-93e0-407f-b4e4-9dca067fd6bd tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:49.580061 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d9fb7d79-93e0-407f-b4e4-9dca067fd6bd tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb64d1e0aabf4889a5515e4f89d9db0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd99a7d947e4ee4808db30f234d2c0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:49.613184 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d9fb7d79-93e0-407f-b4e4-9dca067fd6bd tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] 10.222.0.27 "GET /compute/v2.1/servers/8540b5a8-bbfc-44e0-b10b-2fc0c316f842" status: 200 len: 1396 microversion: 2.1 time: 0.653321 Sep 08 10:53:49.637549 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1772/3553] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:48 2022] GET /compute/v2.1/servers/8540b5a8-bbfc-44e0-b10b-2fc0c316f842 => generated 1396 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:49.669330 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bf52f63a-45ff-4da0-af92-6f5949518245 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:49.680432 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bf52f63a-45ff-4da0-af92-6f5949518245 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: fafff8cb-0e6f-4243-a91c-ec559f656880] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:49.693197 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf52f63a-45ff-4da0-af92-6f5949518245 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:49.695284 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf52f63a-45ff-4da0-af92-6f5949518245 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:49.696830 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf52f63a-45ff-4da0-af92-6f5949518245 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:49.699894 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf52f63a-45ff-4da0-af92-6f5949518245 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:49.701194 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf52f63a-45ff-4da0-af92-6f5949518245 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:49.702329 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf52f63a-45ff-4da0-af92-6f5949518245 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:49.891017 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-8de963f4-ab65-4210-b451-6ee2324945ff tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] HTTP exception thrown: Floating IP 172.25.7.28 is not associated with instance 50feb7c3-9282-44b6-ad37-bf09e2d3f5a8. Sep 08 10:53:49.892549 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8de963f4-ab65-4210-b451-6ee2324945ff tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Request method failure captured: Sep 08 10:53:49.892549 n-d-850501-12 devstack@n-api.service[128862]: request: POST /compute/v2.1/servers/50feb7c3-9282-44b6-ad37-bf09e2d3f5a8/action HTTP/1.1 Sep 08 10:53:49.892549 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:53:49.892549 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:53:49.892549 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:53:49.892549 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 48 Sep 08 10:53:49.892549 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:53:49.892549 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:53:49.892549 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:53:49.892549 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:53:49.892549 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcl9oln5N_hWqWqJYDXk4M6MYiIrhCjnFRbncU28IJZlWuxi7DXNhG9UR93EHZZ0QBnqrj4DIOizLMKqZUTmRh6yOS1vV1KW35VBVQY1AxdKMMlN6TNkoulRHqvJcbQ5AGVOkQq9W4W3FaRTRTRZifilGnvaV6OaQniB_LveRuNkNLk Sep 08 10:53:49.892549 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:53:49.892549 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:53:49.892549 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:53:49.892549 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:53:49.892549 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:53:49.892549 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:53:49.892549 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 44bb5f5b56a2402999719f0374228ed3 Sep 08 10:53:49.892549 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1432818001 Sep 08 10:53:49.892549 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:53:49.892549 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:53:49.892549 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/44bb5f5b56a2402999719f0374228ed3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/44bb5f5b56a2402999719f0374228ed3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_44bb5f5b56a2402999719f0374228ed3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/44bb5f5b56a2402999719f0374228ed3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:53:49.892549 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1432818001 Sep 08 10:53:49.892549 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 44bb5f5b56a2402999719f0374228ed3 Sep 08 10:53:49.892549 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1432818001 Sep 08 10:53:49.892549 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-FloatingIPsAssociationTestJSON-1432818001-project Sep 08 10:53:49.892549 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:53:49.892549 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:53:49.892549 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: cb2c4b351a0a4ccabbfb5438b5c535e8 Sep 08 10:53:49.892549 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1432818001-project Sep 08 10:53:49.892549 n-d-850501-12 devstack@n-api.service[128862]: Sep 08 10:53:49.892549 n-d-850501-12 devstack@n-api.service[128862]: {"removeFloatingIp": {"address": "172.25.7.28"}} Sep 08 10:53:49.892549 n-d-850501-12 devstack@n-api.service[128862]: method: Sep 08 10:53:49.892549 n-d-850501-12 devstack@n-api.service[128862]: exception: Floating IP 172.25.7.28 is not associated with instance 50feb7c3-9282-44b6-ad37-bf09e2d3f5a8. Sep 08 10:53:49.892549 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '50feb7c3-9282-44b6-ad37-bf09e2d3f5a8', 'body': {'removeFloatingIp': {'address': '172.25.7.28'}}} Sep 08 10:53:49.892549 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:53:49.892549 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:53:49.892549 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:53:49.892549 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:53:49.892549 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:53:49.892549 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:53:49.892549 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:53:49.892549 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:53:49.892549 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:53:49.892549 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:53:49.892549 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:53:49.892549 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:53:49.892549 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Sep 08 10:53:49.892549 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 08 10:53:49.892549 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.7.28 is not associated with instance 50feb7c3-9282-44b6-ad37-bf09e2d3f5a8. Sep 08 10:53:49.892549 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:53:49.892549 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:53:49.892549 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:53:49.892549 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:53:49.892549 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:53:49.892549 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:53:49.892549 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:53:49.892549 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:53:49.892549 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.7.28 is not associated with instance 50feb7c3-9282-44b6-ad37-bf09e2d3f5a8. Sep 08 10:53:49.892549 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:53:49.918154 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8de963f4-ab65-4210-b451-6ee2324945ff tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Returning 409 to user: Floating IP 172.25.7.28 is not associated with instance 50feb7c3-9282-44b6-ad37-bf09e2d3f5a8. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:53:49.919607 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8de963f4-ab65-4210-b451-6ee2324945ff tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] 10.222.0.27 "POST /compute/v2.1/servers/50feb7c3-9282-44b6-ad37-bf09e2d3f5a8/action" status: 409 len: 145 microversion: 2.1 time: 1.970600 Sep 08 10:53:49.920308 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1782/3554] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:53:47 2022] POST /compute/v2.1/servers/50feb7c3-9282-44b6-ad37-bf09e2d3f5a8/action => generated 145 bytes in 1972 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:53:49.928444 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4d5a3c18-900d-486c-b344-f396bac8c2e4 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:49.930282 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4d5a3c18-900d-486c-b344-f396bac8c2e4 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:49.964123 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d5a3c18-900d-486c-b344-f396bac8c2e4 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:49.966192 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d5a3c18-900d-486c-b344-f396bac8c2e4 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:49.966821 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d5a3c18-900d-486c-b344-f396bac8c2e4 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:49.968680 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d5a3c18-900d-486c-b344-f396bac8c2e4 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:49.969856 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d5a3c18-900d-486c-b344-f396bac8c2e4 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:49.970821 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d5a3c18-900d-486c-b344-f396bac8c2e4 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:50.023986 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-bf52f63a-45ff-4da0-af92-6f5949518245 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:50.034912 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bf52f63a-45ff-4da0-af92-6f5949518245 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/fafff8cb-0e6f-4243-a91c-ec559f656880" status: 200 len: 1522 microversion: 2.1 time: 0.395305 Sep 08 10:53:50.035789 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1773/3555] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:49 2022] GET /compute/v2.1/servers/fafff8cb-0e6f-4243-a91c-ec559f656880 => generated 1522 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:50.045259 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7384b943-2408-4720-83b3-e6d7078e08f6 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.7.28"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:53:50.260074 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4d5a3c18-900d-486c-b344-f396bac8c2e4 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:50.299467 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4d5a3c18-900d-486c-b344-f396bac8c2e4 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 0.357986 Sep 08 10:53:50.299467 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1783/3556] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:49 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:50.332206 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7384b943-2408-4720-83b3-e6d7078e08f6 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] [instance: 214ebb38-6f31-48bd-99a4-50ca64d78574] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:50.337831 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7384b943-2408-4720-83b3-e6d7078e08f6 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:50.337831 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7384b943-2408-4720-83b3-e6d7078e08f6 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:50.337831 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7384b943-2408-4720-83b3-e6d7078e08f6 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:50.337831 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7384b943-2408-4720-83b3-e6d7078e08f6 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:50.337831 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7384b943-2408-4720-83b3-e6d7078e08f6 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:50.338677 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7384b943-2408-4720-83b3-e6d7078e08f6 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:50.483222 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1ab05de8-7924-470d-99b4-4afb6aa634c2 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-58904352", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "12aa0876-bb28-47d9-975a-2d76f1aa7c84"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:53:50.581302 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-1ab05de8-7924-470d-99b4-4afb6aa634c2 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] validate_networks() for [('12aa0876-bb28-47d9-975a-2d76f1aa7c84', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:53:50.721957 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7384b943-2408-4720-83b3-e6d7078e08f6 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "refresh_cache-214ebb38-6f31-48bd-99a4-50ca64d78574" {{(pid=128861) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 08 10:53:50.722529 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7384b943-2408-4720-83b3-e6d7078e08f6 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquired lock "refresh_cache-214ebb38-6f31-48bd-99a4-50ca64d78574" {{(pid=128861) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 08 10:53:51.625920 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-1ab05de8-7924-470d-99b4-4afb6aa634c2 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:53:51.626520 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-1ab05de8-7924-470d-99b4-4afb6aa634c2 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:53:51.627164 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-1ab05de8-7924-470d-99b4-4afb6aa634c2 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:53:51.627761 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-1ab05de8-7924-470d-99b4-4afb6aa634c2 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:53:51.628286 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-1ab05de8-7924-470d-99b4-4afb6aa634c2 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:53:51.642827 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ab05de8-7924-470d-99b4-4afb6aa634c2 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:51.643625 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ab05de8-7924-470d-99b4-4afb6aa634c2 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:51.644172 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ab05de8-7924-470d-99b4-4afb6aa634c2 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:51.645121 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ab05de8-7924-470d-99b4-4afb6aa634c2 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:51.645702 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ab05de8-7924-470d-99b4-4afb6aa634c2 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:51.646261 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ab05de8-7924-470d-99b4-4afb6aa634c2 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:51.668309 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-1ab05de8-7924-470d-99b4-4afb6aa634c2 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Getting quotas for project 6150571a49ee49df9aebb749b57e7db5. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:53:51.676699 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-1ab05de8-7924-470d-99b4-4afb6aa634c2 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Getting quotas for user 7f551e6fe34243c290a25b57ab26af19 and project 6150571a49ee49df9aebb749b57e7db5. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:53:51.694811 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1ab05de8-7924-470d-99b4-4afb6aa634c2 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:53:51.697920 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1ab05de8-7924-470d-99b4-4afb6aa634c2 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: a78d6e53-cc72-4cbd-95f5-e1f859062525] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:53:51.779489 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1ab05de8-7924-470d-99b4-4afb6aa634c2 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.302617 Sep 08 10:53:51.787118 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1784/3557] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:53:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1311 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 10:53:51.801177 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9f9b57b7-b71b-4d2a-ac3d-26afce7acc0b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:51.803800 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9f9b57b7-b71b-4d2a-ac3d-26afce7acc0b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:51.814089 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f9b57b7-b71b-4d2a-ac3d-26afce7acc0b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:51.814833 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f9b57b7-b71b-4d2a-ac3d-26afce7acc0b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:51.815517 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f9b57b7-b71b-4d2a-ac3d-26afce7acc0b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:51.816555 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f9b57b7-b71b-4d2a-ac3d-26afce7acc0b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:51.817317 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f9b57b7-b71b-4d2a-ac3d-26afce7acc0b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:51.817921 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f9b57b7-b71b-4d2a-ac3d-26afce7acc0b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:52.264821 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9f9b57b7-b71b-4d2a-ac3d-26afce7acc0b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:52.289537 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9f9b57b7-b71b-4d2a-ac3d-26afce7acc0b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1671 microversion: 2.1 time: 0.500162 Sep 08 10:53:52.293750 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1785/3558] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:51 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1671 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:52.313514 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-00343d02-2ea5-4e5c-bcaa-fc8bfcf7a422 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:52.314254 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-00343d02-2ea5-4e5c-bcaa-fc8bfcf7a422 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] [instance: 8540b5a8-bbfc-44e0-b10b-2fc0c316f842] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:52.335929 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00343d02-2ea5-4e5c-bcaa-fc8bfcf7a422 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:52.336600 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00343d02-2ea5-4e5c-bcaa-fc8bfcf7a422 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:52.337071 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00343d02-2ea5-4e5c-bcaa-fc8bfcf7a422 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:52.337796 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00343d02-2ea5-4e5c-bcaa-fc8bfcf7a422 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:52.338251 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00343d02-2ea5-4e5c-bcaa-fc8bfcf7a422 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:52.339310 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00343d02-2ea5-4e5c-bcaa-fc8bfcf7a422 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:52.442847 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-7384b943-2408-4720-83b3-e6d7078e08f6 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] [instance: 214ebb38-6f31-48bd-99a4-50ca64d78574] Building network info cache for instance {{(pid=128861) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 08 10:53:53.020210 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-00343d02-2ea5-4e5c-bcaa-fc8bfcf7a422 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb64d1e0aabf4889a5515e4f89d9db0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd99a7d947e4ee4808db30f234d2c0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:53.029406 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-00343d02-2ea5-4e5c-bcaa-fc8bfcf7a422 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] 10.222.0.27 "GET /compute/v2.1/servers/8540b5a8-bbfc-44e0-b10b-2fc0c316f842" status: 200 len: 1577 microversion: 2.1 time: 0.734210 Sep 08 10:53:53.041700 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1786/3559] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:52 2022] GET /compute/v2.1/servers/8540b5a8-bbfc-44e0-b10b-2fc0c316f842 => generated 1577 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:53.043842 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-93cecd3c-e450-4098-ac00-dae7acaff8be tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:53.047955 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-93cecd3c-e450-4098-ac00-dae7acaff8be tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: fafff8cb-0e6f-4243-a91c-ec559f656880] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:53.063443 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-93cecd3c-e450-4098-ac00-dae7acaff8be tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:53.064501 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-93cecd3c-e450-4098-ac00-dae7acaff8be tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:53.065164 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-93cecd3c-e450-4098-ac00-dae7acaff8be tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:53.066071 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-93cecd3c-e450-4098-ac00-dae7acaff8be tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:53.067347 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-93cecd3c-e450-4098-ac00-dae7acaff8be tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:53.072738 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-93cecd3c-e450-4098-ac00-dae7acaff8be tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:53.272695 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-93cecd3c-e450-4098-ac00-dae7acaff8be tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:53.289712 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-93cecd3c-e450-4098-ac00-dae7acaff8be tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/fafff8cb-0e6f-4243-a91c-ec559f656880" status: 200 len: 1522 microversion: 2.1 time: 0.253804 Sep 08 10:53:53.291055 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1787/3560] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:53 2022] GET /compute/v2.1/servers/fafff8cb-0e6f-4243-a91c-ec559f656880 => generated 1522 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:53.297621 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d81b8eb1-52ee-48c3-ae8a-a559d1e21e56 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:53.298608 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d81b8eb1-52ee-48c3-ae8a-a559d1e21e56 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: a78d6e53-cc72-4cbd-95f5-e1f859062525] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:53.313305 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d81b8eb1-52ee-48c3-ae8a-a559d1e21e56 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:53.320573 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d81b8eb1-52ee-48c3-ae8a-a559d1e21e56 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:53.321315 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d81b8eb1-52ee-48c3-ae8a-a559d1e21e56 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:53.322436 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d81b8eb1-52ee-48c3-ae8a-a559d1e21e56 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:53.325263 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d81b8eb1-52ee-48c3-ae8a-a559d1e21e56 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:53.325973 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d81b8eb1-52ee-48c3-ae8a-a559d1e21e56 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:53.364529 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:53:53.449069 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d81b8eb1-52ee-48c3-ae8a-a559d1e21e56 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:53.464000 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d81b8eb1-52ee-48c3-ae8a-a559d1e21e56 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/a78d6e53-cc72-4cbd-95f5-e1f859062525" status: 200 len: 1267 microversion: 2.1 time: 0.171016 Sep 08 10:53:53.465082 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1788/3561] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:53 2022] GET /compute/v2.1/servers/a78d6e53-cc72-4cbd-95f5-e1f859062525 => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:53.480314 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2b860685-546f-4074-9225-4da41ea7ec25 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1758094956"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:53:53.483063 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2b860685-546f-4074-9225-4da41ea7ec25 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:53.501587 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b860685-546f-4074-9225-4da41ea7ec25 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:53.502982 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b860685-546f-4074-9225-4da41ea7ec25 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:53.504820 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b860685-546f-4074-9225-4da41ea7ec25 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:53.508476 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b860685-546f-4074-9225-4da41ea7ec25 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:53.509888 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b860685-546f-4074-9225-4da41ea7ec25 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:53.511046 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b860685-546f-4074-9225-4da41ea7ec25 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:53.914219 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2b860685-546f-4074-9225-4da41ea7ec25 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "POST /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7/action" status: 202 len: 0 microversion: 2.1 time: 0.438216 Sep 08 10:53:53.921153 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1789/3562] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:53:53 2022] POST /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7/action => generated 0 bytes in 455 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Sep 08 10:53:53.929863 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-db128b62-3e76-4509-b742-9e1097b07be4 req-fe3ae2b7-efc2-4a3f-8516-1a30d48045b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "214ebb38-6f31-48bd-99a4-50ca64d78574", "tag": "3c6a80ed-ce3a-4b48-89dc-20fec3d919ea"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:53:53.947986 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-db128b62-3e76-4509-b742-9e1097b07be4 req-fe3ae2b7-efc2-4a3f-8516-1a30d48045b0 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:53.951254 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-db128b62-3e76-4509-b742-9e1097b07be4 req-fe3ae2b7-efc2-4a3f-8516-1a30d48045b0 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:53.954497 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-db128b62-3e76-4509-b742-9e1097b07be4 req-fe3ae2b7-efc2-4a3f-8516-1a30d48045b0 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:53.995817 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-db128b62-3e76-4509-b742-9e1097b07be4 req-fe3ae2b7-efc2-4a3f-8516-1a30d48045b0 service nova] Creating event network-changed:3c6a80ed-ce3a-4b48-89dc-20fec3d919ea for instance 214ebb38-6f31-48bd-99a4-50ca64d78574 on n-h2-850501-12 Sep 08 10:53:54.004934 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-db128b62-3e76-4509-b742-9e1097b07be4 req-fe3ae2b7-efc2-4a3f-8516-1a30d48045b0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077915 Sep 08 10:53:54.005819 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1790/3563] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:53:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:53:54.016513 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2c57460d-6c3e-4afd-985c-930db60fed22 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:54.025296 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2c57460d-6c3e-4afd-985c-930db60fed22 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] [instance: 8540b5a8-bbfc-44e0-b10b-2fc0c316f842] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:54.034824 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2c57460d-6c3e-4afd-985c-930db60fed22 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:54.035746 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2c57460d-6c3e-4afd-985c-930db60fed22 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:54.036429 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2c57460d-6c3e-4afd-985c-930db60fed22 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:54.037996 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2c57460d-6c3e-4afd-985c-930db60fed22 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:54.039455 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2c57460d-6c3e-4afd-985c-930db60fed22 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:54.040417 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2c57460d-6c3e-4afd-985c-930db60fed22 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:54.094123 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-7384b943-2408-4720-83b3-e6d7078e08f6 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] [instance: 214ebb38-6f31-48bd-99a4-50ca64d78574] Updating instance_info_cache with network_info: [{"id": "3c6a80ed-ce3a-4b48-89dc-20fec3d919ea", "address": "fa:16:3e:95:31:4b", "network": {"id": "9b985b6c-8cab-4bb8-8ec5-91dd022aec51", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-487710725-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "44bb5f5b56a2402999719f0374228ed3", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap3c6a80ed-ce", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128861) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 08 10:53:54.113298 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7384b943-2408-4720-83b3-e6d7078e08f6 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Releasing lock "refresh_cache-214ebb38-6f31-48bd-99a4-50ca64d78574" {{(pid=128861) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 08 10:53:54.114649 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7384b943-2408-4720-83b3-e6d7078e08f6 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] 10.222.0.27 "POST /compute/v2.1/servers/214ebb38-6f31-48bd-99a4-50ca64d78574/action" status: 202 len: 0 microversion: 2.1 time: 4.077745 Sep 08 10:53:54.120064 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1774/3564] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:53:50 2022] POST /compute/v2.1/servers/214ebb38-6f31-48bd-99a4-50ca64d78574/action => generated 0 bytes in 4084 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 08 10:53:54.130729 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0244eb79-7a45-4c2a-b98e-cec0c8ce7ed3 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:54.131485 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0244eb79-7a45-4c2a-b98e-cec0c8ce7ed3 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] [instance: 214ebb38-6f31-48bd-99a4-50ca64d78574] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:54.140399 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0244eb79-7a45-4c2a-b98e-cec0c8ce7ed3 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:54.141640 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0244eb79-7a45-4c2a-b98e-cec0c8ce7ed3 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:54.142249 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0244eb79-7a45-4c2a-b98e-cec0c8ce7ed3 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:54.143171 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0244eb79-7a45-4c2a-b98e-cec0c8ce7ed3 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:54.143803 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0244eb79-7a45-4c2a-b98e-cec0c8ce7ed3 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:54.144415 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0244eb79-7a45-4c2a-b98e-cec0c8ce7ed3 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:54.222422 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0244eb79-7a45-4c2a-b98e-cec0c8ce7ed3 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] [instance: 214ebb38-6f31-48bd-99a4-50ca64d78574] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:53:54.348989 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=87,nova_cell1:SAVEPOINT=4,nova_cell1:UPDATE=5,nova_cell1:RELEASE=4 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:53:54.403806 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0244eb79-7a45-4c2a-b98e-cec0c8ce7ed3 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] 10.222.0.27 "DELETE /compute/v2.1/servers/214ebb38-6f31-48bd-99a4-50ca64d78574" status: 204 len: 0 microversion: 2.1 time: 0.276806 Sep 08 10:53:54.411029 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1775/3565] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:53:54 2022] DELETE /compute/v2.1/servers/214ebb38-6f31-48bd-99a4-50ca64d78574 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:53:54.434337 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ccb60742-1819-4830-83ce-daaebfffd88b tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:54.435239 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ccb60742-1819-4830-83ce-daaebfffd88b tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: fafff8cb-0e6f-4243-a91c-ec559f656880] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:54.451703 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ccb60742-1819-4830-83ce-daaebfffd88b tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:54.452215 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ccb60742-1819-4830-83ce-daaebfffd88b tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:54.452718 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ccb60742-1819-4830-83ce-daaebfffd88b tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:54.456199 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ccb60742-1819-4830-83ce-daaebfffd88b tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:54.456709 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ccb60742-1819-4830-83ce-daaebfffd88b tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:54.457196 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ccb60742-1819-4830-83ce-daaebfffd88b tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:54.541241 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2c57460d-6c3e-4afd-985c-930db60fed22 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] 10.222.0.27 "GET /compute/v2.1/servers/8540b5a8-bbfc-44e0-b10b-2fc0c316f842/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.533047 Sep 08 10:53:54.550392 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1791/3566] 10.222.0.27 () {58 vars in 1275 bytes} [Thu Sep 8 10:53:54 2022] GET /compute/v2.1/servers/8540b5a8-bbfc-44e0-b10b-2fc0c316f842/os-interface => generated 284 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:53:54.556535 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-08de1769-effb-4dbc-9fac-cdf8d4576b62 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Action: 'action', calling method: .version_select at 0x7f68e6d9c550>, body: {"addFloatingIp": {"address": "172.25.7.28"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:53:54.559643 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-08de1769-effb-4dbc-9fac-cdf8d4576b62 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] [instance: 50feb7c3-9282-44b6-ad37-bf09e2d3f5a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:54.572900 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08de1769-effb-4dbc-9fac-cdf8d4576b62 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:54.573978 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08de1769-effb-4dbc-9fac-cdf8d4576b62 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:54.575089 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08de1769-effb-4dbc-9fac-cdf8d4576b62 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:54.577685 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08de1769-effb-4dbc-9fac-cdf8d4576b62 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:54.579328 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08de1769-effb-4dbc-9fac-cdf8d4576b62 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:54.580800 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08de1769-effb-4dbc-9fac-cdf8d4576b62 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:54.645904 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08de1769-effb-4dbc-9fac-cdf8d4576b62 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "refresh_cache-50feb7c3-9282-44b6-ad37-bf09e2d3f5a8" {{(pid=128862) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 08 10:53:54.647393 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08de1769-effb-4dbc-9fac-cdf8d4576b62 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquired lock "refresh_cache-50feb7c3-9282-44b6-ad37-bf09e2d3f5a8" {{(pid=128862) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 08 10:53:55.077819 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ccb60742-1819-4830-83ce-daaebfffd88b tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:55.106438 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ccb60742-1819-4830-83ce-daaebfffd88b tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/fafff8cb-0e6f-4243-a91c-ec559f656880" status: 200 len: 1502 microversion: 2.1 time: 0.690551 Sep 08 10:53:55.107990 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1776/3567] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:54 2022] GET /compute/v2.1/servers/fafff8cb-0e6f-4243-a91c-ec559f656880 => generated 1502 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:55.116260 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cc2f7ee6-44c4-47d4-a86d-491b52de9f29 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:55.120167 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cc2f7ee6-44c4-47d4-a86d-491b52de9f29 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: a78d6e53-cc72-4cbd-95f5-e1f859062525] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:55.137552 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc2f7ee6-44c4-47d4-a86d-491b52de9f29 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:55.149445 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc2f7ee6-44c4-47d4-a86d-491b52de9f29 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:55.154267 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc2f7ee6-44c4-47d4-a86d-491b52de9f29 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:55.155934 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc2f7ee6-44c4-47d4-a86d-491b52de9f29 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:55.157129 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc2f7ee6-44c4-47d4-a86d-491b52de9f29 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:55.168778 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc2f7ee6-44c4-47d4-a86d-491b52de9f29 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:55.291948 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-cc2f7ee6-44c4-47d4-a86d-491b52de9f29 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:55.306068 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cc2f7ee6-44c4-47d4-a86d-491b52de9f29 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/a78d6e53-cc72-4cbd-95f5-e1f859062525" status: 200 len: 1273 microversion: 2.1 time: 0.196245 Sep 08 10:53:55.307460 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1777/3568] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:55 2022] GET /compute/v2.1/servers/a78d6e53-cc72-4cbd-95f5-e1f859062525 => generated 1273 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:55.317102 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-48c55b5f-2b6f-4992-b2c5-0131c80228a2 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6d18505b-77ef-4e8d-b27f-db0ce55c1077"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:53:55.322174 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-48c55b5f-2b6f-4992-b2c5-0131c80228a2 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: fafff8cb-0e6f-4243-a91c-ec559f656880] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:55.333651 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-48c55b5f-2b6f-4992-b2c5-0131c80228a2 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:55.335487 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-48c55b5f-2b6f-4992-b2c5-0131c80228a2 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:55.336500 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-48c55b5f-2b6f-4992-b2c5-0131c80228a2 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:55.338241 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-48c55b5f-2b6f-4992-b2c5-0131c80228a2 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:55.339443 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-48c55b5f-2b6f-4992-b2c5-0131c80228a2 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:55.340490 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-48c55b5f-2b6f-4992-b2c5-0131c80228a2 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:55.376042 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-48c55b5f-2b6f-4992-b2c5-0131c80228a2 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] HTTP exception thrown: Cannot 'attach_volume' instance fafff8cb-0e6f-4243-a91c-ec559f656880 while it is in vm_state rescued Sep 08 10:53:55.378399 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-48c55b5f-2b6f-4992-b2c5-0131c80228a2 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Request method failure captured: Sep 08 10:53:55.378399 n-d-850501-12 devstack@n-api.service[128861]: request: POST /compute/v2.1/servers/fafff8cb-0e6f-4243-a91c-ec559f656880/os-volume_attachments HTTP/1.1 Sep 08 10:53:55.378399 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:53:55.378399 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:53:55.378399 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:53:55.378399 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 74 Sep 08 10:53:55.378399 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:53:55.378399 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:53:55.378399 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:53:55.378399 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:53:55.378399 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGclZnrdHbcSspe2CSaO_gA2LIWMGtHJAKVo_u3dlzxs9JxAXcXCwrL-z-q8SJvnWUnwIz6KxjkLXp0jFFwIV3x5Qp_zUHQKWEwS-EZKwoM8W4-UxwLeQWJTnQ9cWOYmTzHY9djf2pYmuh6sOSJJezx_5s2ElCgN_L-D4iql7Pg9xGj8 Sep 08 10:53:55.378399 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:53:55.378399 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:53:55.378399 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:53:55.378399 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:53:55.378399 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:53:55.378399 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:53:55.378399 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 33063b3b9e0543369c28ea918f52cf37 Sep 08 10:53:55.378399 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1820338337 Sep 08 10:53:55.378399 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:53:55.378399 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:53:55.378399 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/33063b3b9e0543369c28ea918f52cf37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/33063b3b9e0543369c28ea918f52cf37"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_33063b3b9e0543369c28ea918f52cf37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/33063b3b9e0543369c28ea918f52cf37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:53:55.378399 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1820338337 Sep 08 10:53:55.378399 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 33063b3b9e0543369c28ea918f52cf37 Sep 08 10:53:55.378399 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1820338337 Sep 08 10:53:55.378399 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServerRescueNegativeTestJSON-1820338337-project Sep 08 10:53:55.378399 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:53:55.378399 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:53:55.378399 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 8f487f5d062e4ac3bf21c2416a7b50ee Sep 08 10:53:55.378399 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1820338337-project Sep 08 10:53:55.378399 n-d-850501-12 devstack@n-api.service[128861]: Sep 08 10:53:55.378399 n-d-850501-12 devstack@n-api.service[128861]: {"volumeAttachment": {"volumeId": "6d18505b-77ef-4e8d-b27f-db0ce55c1077"}} Sep 08 10:53:55.378399 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:53:55.378399 n-d-850501-12 devstack@n-api.service[128861]: exception: Cannot 'attach_volume' instance fafff8cb-0e6f-4243-a91c-ec559f656880 while it is in vm_state rescued Sep 08 10:53:55.378399 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'server_id': 'fafff8cb-0e6f-4243-a91c-ec559f656880', 'body': {'volumeAttachment': {'volumeId': '6d18505b-77ef-4e8d-b27f-db0ce55c1077'}}} Sep 08 10:53:55.378399 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:53:55.378399 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:53:55.378399 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 08 10:53:55.378399 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 08 10:53:55.378399 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 10:53:55.378399 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 10:53:55.378399 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 08 10:53:55.378399 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 08 10:53:55.378399 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance fafff8cb-0e6f-4243-a91c-ec559f656880 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 08 10:53:55.378399 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:53:55.378399 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:53:55.378399 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:53:55.378399 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:53:55.378399 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:53:55.378399 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:53:55.378399 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:53:55.378399 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:53:55.378399 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:53:55.378399 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:53:55.378399 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:53:55.378399 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:53:55.378399 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:53:55.378399 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:53:55.378399 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:53:55.378399 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:53:55.378399 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 08 10:53:55.378399 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 08 10:53:55.386341 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 08 10:53:55.386341 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 08 10:53:55.386341 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance fafff8cb-0e6f-4243-a91c-ec559f656880 while it is in vm_state rescued Sep 08 10:53:55.386341 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:53:55.386341 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:53:55.386341 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:53:55.386341 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:53:55.386341 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:53:55.386341 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:53:55.386341 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:53:55.386341 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:53:55.386341 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance fafff8cb-0e6f-4243-a91c-ec559f656880 while it is in vm_state rescued Sep 08 10:53:55.386341 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:53:55.386341 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-48c55b5f-2b6f-4992-b2c5-0131c80228a2 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Returning 409 to user: Cannot 'attach_volume' instance fafff8cb-0e6f-4243-a91c-ec559f656880 while it is in vm_state rescued {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:53:55.389372 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-48c55b5f-2b6f-4992-b2c5-0131c80228a2 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "POST /compute/v2.1/servers/fafff8cb-0e6f-4243-a91c-ec559f656880/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.077314 Sep 08 10:53:55.389372 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1778/3569] 10.222.0.27 () {60 vars in 1323 bytes} [Thu Sep 8 10:53:55 2022] POST /compute/v2.1/servers/fafff8cb-0e6f-4243-a91c-ec559f656880/os-volume_attachments => generated 152 bytes in 80 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:53:55.407455 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-34a7444c-65d2-425c-838c-ec453739b75f req-c115a121-c2a8-4b15-a90b-516b6535b115 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e81e0acc-0b96-4dbc-a5bb-89183f5204e7", "name": "network-vif-unplugged", "status": "completed", "tag": "ff9d981d-5db2-425c-b066-f87540f6e91c"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:53:55.429868 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-34a7444c-65d2-425c-838c-ec453739b75f req-c115a121-c2a8-4b15-a90b-516b6535b115 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:55.431604 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-34a7444c-65d2-425c-838c-ec453739b75f req-c115a121-c2a8-4b15-a90b-516b6535b115 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:55.433352 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-34a7444c-65d2-425c-838c-ec453739b75f req-c115a121-c2a8-4b15-a90b-516b6535b115 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:55.457544 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-34a7444c-65d2-425c-838c-ec453739b75f req-c115a121-c2a8-4b15-a90b-516b6535b115 service nova] Creating event network-vif-unplugged:ff9d981d-5db2-425c-b066-f87540f6e91c for instance e81e0acc-0b96-4dbc-a5bb-89183f5204e7 on n-h1-850501-12 Sep 08 10:53:55.467344 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-34a7444c-65d2-425c-838c-ec453739b75f req-c115a121-c2a8-4b15-a90b-516b6535b115 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071486 Sep 08 10:53:55.468698 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1779/3570] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:53:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:53:55.480886 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ec0aff70-fa84-4008-b921-165c85158cc1 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:53:55.482268 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ec0aff70-fa84-4008-b921-165c85158cc1 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: fafff8cb-0e6f-4243-a91c-ec559f656880] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:55.492660 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ec0aff70-fa84-4008-b921-165c85158cc1 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:55.493951 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ec0aff70-fa84-4008-b921-165c85158cc1 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:55.495364 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ec0aff70-fa84-4008-b921-165c85158cc1 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:55.496925 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ec0aff70-fa84-4008-b921-165c85158cc1 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:55.498073 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ec0aff70-fa84-4008-b921-165c85158cc1 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:55.499028 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ec0aff70-fa84-4008-b921-165c85158cc1 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:55.589093 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ec0aff70-fa84-4008-b921-165c85158cc1 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "POST /compute/v2.1/servers/fafff8cb-0e6f-4243-a91c-ec559f656880/action" status: 202 len: 0 microversion: 2.1 time: 0.117516 Sep 08 10:53:55.590437 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1780/3571] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:53:55 2022] POST /compute/v2.1/servers/fafff8cb-0e6f-4243-a91c-ec559f656880/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:53:55.612976 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e932abc6-efd7-4ff9-a331-8bac05d3142d tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:55.614661 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e932abc6-efd7-4ff9-a331-8bac05d3142d tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: fafff8cb-0e6f-4243-a91c-ec559f656880] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:55.628483 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e932abc6-efd7-4ff9-a331-8bac05d3142d tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:55.629239 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e932abc6-efd7-4ff9-a331-8bac05d3142d tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:55.629859 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e932abc6-efd7-4ff9-a331-8bac05d3142d tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:55.630821 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e932abc6-efd7-4ff9-a331-8bac05d3142d tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:55.631625 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e932abc6-efd7-4ff9-a331-8bac05d3142d tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:55.632276 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e932abc6-efd7-4ff9-a331-8bac05d3142d tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:56.470678 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e932abc6-efd7-4ff9-a331-8bac05d3142d tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:56.488253 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e932abc6-efd7-4ff9-a331-8bac05d3142d tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/fafff8cb-0e6f-4243-a91c-ec559f656880" status: 200 len: 1510 microversion: 2.1 time: 0.890890 Sep 08 10:53:56.488849 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1781/3572] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:55 2022] GET /compute/v2.1/servers/fafff8cb-0e6f-4243-a91c-ec559f656880 => generated 1510 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:53:56.500574 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-01ef2bc6-9687-4a68-a320-303001f71f40 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:56.501240 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-01ef2bc6-9687-4a68-a320-303001f71f40 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: a78d6e53-cc72-4cbd-95f5-e1f859062525] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:56.520413 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-01ef2bc6-9687-4a68-a320-303001f71f40 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:56.520932 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-01ef2bc6-9687-4a68-a320-303001f71f40 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:56.521430 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-01ef2bc6-9687-4a68-a320-303001f71f40 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:56.523035 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-01ef2bc6-9687-4a68-a320-303001f71f40 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:56.523522 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-01ef2bc6-9687-4a68-a320-303001f71f40 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:56.523966 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-01ef2bc6-9687-4a68-a320-303001f71f40 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:56.672745 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-01ef2bc6-9687-4a68-a320-303001f71f40 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:56.694743 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-01ef2bc6-9687-4a68-a320-303001f71f40 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/a78d6e53-cc72-4cbd-95f5-e1f859062525" status: 200 len: 1273 microversion: 2.1 time: 0.198629 Sep 08 10:53:56.702234 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1782/3573] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:56 2022] GET /compute/v2.1/servers/a78d6e53-cc72-4cbd-95f5-e1f859062525 => generated 1273 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:57.522290 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3bbf7951-270f-40a6-b64e-ba69ae02afa4 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:57.528611 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3bbf7951-270f-40a6-b64e-ba69ae02afa4 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: fafff8cb-0e6f-4243-a91c-ec559f656880] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:57.554453 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3bbf7951-270f-40a6-b64e-ba69ae02afa4 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:57.555609 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3bbf7951-270f-40a6-b64e-ba69ae02afa4 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:57.556693 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3bbf7951-270f-40a6-b64e-ba69ae02afa4 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:57.558366 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3bbf7951-270f-40a6-b64e-ba69ae02afa4 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:57.559515 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3bbf7951-270f-40a6-b64e-ba69ae02afa4 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:57.560631 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3bbf7951-270f-40a6-b64e-ba69ae02afa4 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:58.513576 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-3bbf7951-270f-40a6-b64e-ba69ae02afa4 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:58.547185 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3bbf7951-270f-40a6-b64e-ba69ae02afa4 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/fafff8cb-0e6f-4243-a91c-ec559f656880" status: 200 len: 1510 microversion: 2.1 time: 1.036376 Sep 08 10:53:58.558043 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1783/3574] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:57 2022] GET /compute/v2.1/servers/fafff8cb-0e6f-4243-a91c-ec559f656880 => generated 1510 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:58.574792 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8011339e-bfee-4a3e-88c7-a7652c50a42a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:58.585790 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8011339e-bfee-4a3e-88c7-a7652c50a42a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: a78d6e53-cc72-4cbd-95f5-e1f859062525] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:58.612432 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8011339e-bfee-4a3e-88c7-a7652c50a42a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:58.613667 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8011339e-bfee-4a3e-88c7-a7652c50a42a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:58.614715 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8011339e-bfee-4a3e-88c7-a7652c50a42a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:58.616847 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8011339e-bfee-4a3e-88c7-a7652c50a42a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:58.629451 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8011339e-bfee-4a3e-88c7-a7652c50a42a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:58.630527 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8011339e-bfee-4a3e-88c7-a7652c50a42a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:58.857101 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8011339e-bfee-4a3e-88c7-a7652c50a42a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:58.906702 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8011339e-bfee-4a3e-88c7-a7652c50a42a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/a78d6e53-cc72-4cbd-95f5-e1f859062525" status: 200 len: 1273 microversion: 2.1 time: 0.346175 Sep 08 10:53:58.931355 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1784/3575] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:58 2022] GET /compute/v2.1/servers/a78d6e53-cc72-4cbd-95f5-e1f859062525 => generated 1273 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:58.948348 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-8b8809ce-225b-41e9-b43b-3d8bc2ecdd77 req-806780d7-7761-4ad9-8274-1552b3566ce7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "214ebb38-6f31-48bd-99a4-50ca64d78574", "name": "network-vif-deleted", "tag": "3c6a80ed-ce3a-4b48-89dc-20fec3d919ea"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:53:58.977138 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-8b8809ce-225b-41e9-b43b-3d8bc2ecdd77 req-806780d7-7761-4ad9-8274-1552b3566ce7 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:58.977944 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-8b8809ce-225b-41e9-b43b-3d8bc2ecdd77 req-806780d7-7761-4ad9-8274-1552b3566ce7 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:58.978399 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-8b8809ce-225b-41e9-b43b-3d8bc2ecdd77 req-806780d7-7761-4ad9-8274-1552b3566ce7 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:59.023185 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-8b8809ce-225b-41e9-b43b-3d8bc2ecdd77 req-806780d7-7761-4ad9-8274-1552b3566ce7 service nova] Creating event network-vif-deleted:3c6a80ed-ce3a-4b48-89dc-20fec3d919ea for instance 214ebb38-6f31-48bd-99a4-50ca64d78574 on n-h2-850501-12 Sep 08 10:53:59.043190 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-8b8809ce-225b-41e9-b43b-3d8bc2ecdd77 req-806780d7-7761-4ad9-8274-1552b3566ce7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110311 Sep 08 10:53:59.048932 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1785/3576] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:53:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:53:59.586625 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-430f5f3b-d6a9-49e0-8a9c-18dc93be8a1e tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:59.591347 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-430f5f3b-d6a9-49e0-8a9c-18dc93be8a1e tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: fafff8cb-0e6f-4243-a91c-ec559f656880] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:59.618933 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-430f5f3b-d6a9-49e0-8a9c-18dc93be8a1e tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:59.619816 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-430f5f3b-d6a9-49e0-8a9c-18dc93be8a1e tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:59.620551 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-430f5f3b-d6a9-49e0-8a9c-18dc93be8a1e tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:59.622296 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-430f5f3b-d6a9-49e0-8a9c-18dc93be8a1e tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:59.628320 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-430f5f3b-d6a9-49e0-8a9c-18dc93be8a1e tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:59.629853 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-430f5f3b-d6a9-49e0-8a9c-18dc93be8a1e tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:00.143820 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-430f5f3b-d6a9-49e0-8a9c-18dc93be8a1e tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:00.168829 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-430f5f3b-d6a9-49e0-8a9c-18dc93be8a1e tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/fafff8cb-0e6f-4243-a91c-ec559f656880" status: 200 len: 1510 microversion: 2.1 time: 0.587447 Sep 08 10:54:00.170894 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1786/3577] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:59 2022] GET /compute/v2.1/servers/fafff8cb-0e6f-4243-a91c-ec559f656880 => generated 1510 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:00.181567 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9f48ca8c-b592-4625-85ea-0c03ebd90fd2 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:00.183434 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9f48ca8c-b592-4625-85ea-0c03ebd90fd2 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: a78d6e53-cc72-4cbd-95f5-e1f859062525] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:00.195901 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f48ca8c-b592-4625-85ea-0c03ebd90fd2 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:00.197172 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f48ca8c-b592-4625-85ea-0c03ebd90fd2 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:00.198219 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f48ca8c-b592-4625-85ea-0c03ebd90fd2 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:00.200049 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f48ca8c-b592-4625-85ea-0c03ebd90fd2 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:00.202113 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f48ca8c-b592-4625-85ea-0c03ebd90fd2 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:00.203782 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f48ca8c-b592-4625-85ea-0c03ebd90fd2 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:00.415786 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9f48ca8c-b592-4625-85ea-0c03ebd90fd2 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:00.435041 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9f48ca8c-b592-4625-85ea-0c03ebd90fd2 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/a78d6e53-cc72-4cbd-95f5-e1f859062525" status: 200 len: 1273 microversion: 2.1 time: 0.261482 Sep 08 10:54:00.435573 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1787/3578] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:00 2022] GET /compute/v2.1/servers/a78d6e53-cc72-4cbd-95f5-e1f859062525 => generated 1273 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:01.204630 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d6f62d1e-876e-4fbb-9053-19255076a7c7 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:01.206280 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d6f62d1e-876e-4fbb-9053-19255076a7c7 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: fafff8cb-0e6f-4243-a91c-ec559f656880] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:01.234019 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d6f62d1e-876e-4fbb-9053-19255076a7c7 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:01.234820 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d6f62d1e-876e-4fbb-9053-19255076a7c7 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:01.235661 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d6f62d1e-876e-4fbb-9053-19255076a7c7 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:01.236532 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d6f62d1e-876e-4fbb-9053-19255076a7c7 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:01.237245 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d6f62d1e-876e-4fbb-9053-19255076a7c7 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:01.237876 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d6f62d1e-876e-4fbb-9053-19255076a7c7 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:01.552296 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d6f62d1e-876e-4fbb-9053-19255076a7c7 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:01.564914 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d6f62d1e-876e-4fbb-9053-19255076a7c7 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/fafff8cb-0e6f-4243-a91c-ec559f656880" status: 200 len: 1516 microversion: 2.1 time: 0.365487 Sep 08 10:54:01.581572 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1788/3579] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:01 2022] GET /compute/v2.1/servers/fafff8cb-0e6f-4243-a91c-ec559f656880 => generated 1516 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:54:01.599275 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-2b667e23-5da6-4141-a7c7-e0fe19b45357 req-7ec7760d-45d4-4f64-bc3c-a0f81bd006f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e81e0acc-0b96-4dbc-a5bb-89183f5204e7", "name": "network-vif-plugged", "status": "completed", "tag": "ff9d981d-5db2-425c-b066-f87540f6e91c"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:54:01.610539 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-2b667e23-5da6-4141-a7c7-e0fe19b45357 req-7ec7760d-45d4-4f64-bc3c-a0f81bd006f0 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:01.612362 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-2b667e23-5da6-4141-a7c7-e0fe19b45357 req-7ec7760d-45d4-4f64-bc3c-a0f81bd006f0 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:01.613887 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-2b667e23-5da6-4141-a7c7-e0fe19b45357 req-7ec7760d-45d4-4f64-bc3c-a0f81bd006f0 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:01.638916 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-2b667e23-5da6-4141-a7c7-e0fe19b45357 req-7ec7760d-45d4-4f64-bc3c-a0f81bd006f0 service nova] Creating event network-vif-plugged:ff9d981d-5db2-425c-b066-f87540f6e91c for instance e81e0acc-0b96-4dbc-a5bb-89183f5204e7 on n-h1-850501-12 Sep 08 10:54:01.645463 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-2b667e23-5da6-4141-a7c7-e0fe19b45357 req-7ec7760d-45d4-4f64-bc3c-a0f81bd006f0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061779 Sep 08 10:54:01.649634 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1789/3580] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:54:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:54:01.655352 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:54:01.655978 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6f2a4e18-a5dd-46ca-9ab0-cabf8894208e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:01.665693 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6f2a4e18-a5dd-46ca-9ab0-cabf8894208e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: a78d6e53-cc72-4cbd-95f5-e1f859062525] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:01.667985 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=76,nova_api:UPDATE=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:54:01.685178 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6f2a4e18-a5dd-46ca-9ab0-cabf8894208e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:01.685807 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6f2a4e18-a5dd-46ca-9ab0-cabf8894208e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:01.686346 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6f2a4e18-a5dd-46ca-9ab0-cabf8894208e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:01.687168 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6f2a4e18-a5dd-46ca-9ab0-cabf8894208e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:01.687336 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:54:01.687814 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6f2a4e18-a5dd-46ca-9ab0-cabf8894208e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:01.688453 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6f2a4e18-a5dd-46ca-9ab0-cabf8894208e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:01.993498 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6f2a4e18-a5dd-46ca-9ab0-cabf8894208e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:02.001595 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6f2a4e18-a5dd-46ca-9ab0-cabf8894208e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/a78d6e53-cc72-4cbd-95f5-e1f859062525" status: 200 len: 1315 microversion: 2.1 time: 0.350512 Sep 08 10:54:02.017150 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1790/3581] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:01 2022] GET /compute/v2.1/servers/a78d6e53-cc72-4cbd-95f5-e1f859062525 => generated 1315 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:02.017150 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-039d2b39-5b71-4bc1-8568-671f7d00c00d tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:02.017150 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-039d2b39-5b71-4bc1-8568-671f7d00c00d tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] [instance: 8540b5a8-bbfc-44e0-b10b-2fc0c316f842] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:02.017150 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-039d2b39-5b71-4bc1-8568-671f7d00c00d tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:02.017150 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-039d2b39-5b71-4bc1-8568-671f7d00c00d tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:02.017150 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-039d2b39-5b71-4bc1-8568-671f7d00c00d tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:02.017150 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-039d2b39-5b71-4bc1-8568-671f7d00c00d tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:02.018046 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-039d2b39-5b71-4bc1-8568-671f7d00c00d tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:02.018564 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-039d2b39-5b71-4bc1-8568-671f7d00c00d tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:02.356976 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-039d2b39-5b71-4bc1-8568-671f7d00c00d tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb64d1e0aabf4889a5515e4f89d9db0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd99a7d947e4ee4808db30f234d2c0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:02.369416 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-039d2b39-5b71-4bc1-8568-671f7d00c00d tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] 10.222.0.27 "GET /compute/v2.1/servers/8540b5a8-bbfc-44e0-b10b-2fc0c316f842" status: 200 len: 1577 microversion: 2.1 time: 0.365005 Sep 08 10:54:02.373507 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1791/3582] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:02 2022] GET /compute/v2.1/servers/8540b5a8-bbfc-44e0-b10b-2fc0c316f842 => generated 1577 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:02.401018 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-3241b2a3-b6a0-4f07-be3b-98bc523d2a0a req-0b188bbc-02ee-4e2e-b6bd-719f7beddaf8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8540b5a8-bbfc-44e0-b10b-2fc0c316f842", "tag": "909f79bb-7501-41db-ad7d-238a18a7493c"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:54:02.441762 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-3241b2a3-b6a0-4f07-be3b-98bc523d2a0a req-0b188bbc-02ee-4e2e-b6bd-719f7beddaf8 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:02.447322 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-3241b2a3-b6a0-4f07-be3b-98bc523d2a0a req-0b188bbc-02ee-4e2e-b6bd-719f7beddaf8 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:02.447743 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-3241b2a3-b6a0-4f07-be3b-98bc523d2a0a req-0b188bbc-02ee-4e2e-b6bd-719f7beddaf8 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:02.485581 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-3241b2a3-b6a0-4f07-be3b-98bc523d2a0a req-0b188bbc-02ee-4e2e-b6bd-719f7beddaf8 service nova] Creating event network-changed:909f79bb-7501-41db-ad7d-238a18a7493c for instance 8540b5a8-bbfc-44e0-b10b-2fc0c316f842 on n-h2-850501-12 Sep 08 10:54:02.509564 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-3241b2a3-b6a0-4f07-be3b-98bc523d2a0a req-0b188bbc-02ee-4e2e-b6bd-719f7beddaf8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122848 Sep 08 10:54:02.515849 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1792/3583] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:54:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:54:03.039573 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-36ddc712-cb12-481a-b05e-274b71199de3 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:03.040717 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-36ddc712-cb12-481a-b05e-274b71199de3 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: a78d6e53-cc72-4cbd-95f5-e1f859062525] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:03.053685 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-36ddc712-cb12-481a-b05e-274b71199de3 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:03.055003 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-36ddc712-cb12-481a-b05e-274b71199de3 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:03.056087 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-36ddc712-cb12-481a-b05e-274b71199de3 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:03.075077 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-36ddc712-cb12-481a-b05e-274b71199de3 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:03.075882 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-36ddc712-cb12-481a-b05e-274b71199de3 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:03.076588 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-36ddc712-cb12-481a-b05e-274b71199de3 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:03.835806 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-08de1769-effb-4dbc-9fac-cdf8d4576b62 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] [instance: 50feb7c3-9282-44b6-ad37-bf09e2d3f5a8] Building network info cache for instance {{(pid=128862) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 08 10:54:04.122064 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-36ddc712-cb12-481a-b05e-274b71199de3 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:04.147915 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-36ddc712-cb12-481a-b05e-274b71199de3 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/a78d6e53-cc72-4cbd-95f5-e1f859062525" status: 200 len: 1315 microversion: 2.1 time: 1.111353 Sep 08 10:54:04.173970 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1793/3584] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:03 2022] GET /compute/v2.1/servers/a78d6e53-cc72-4cbd-95f5-e1f859062525 => generated 1315 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:54:04.564908 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:54:04.949039 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d03db7f6-5c7f-4db4-98bb-9399c4cac1fc tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Action: 'create', calling method: .version_select at 0x7f68e442f820>, body: {"keypair": {"name": "tempest-keypair-844901694", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+1CeG8UEngJZk5yGQ1h4M/vZXHjvzBsWn+UNMBbE4vkTYtgLxVdPFbRMHwvayxYd6h9Pe/JkIOotVviqSjARj8cReD1HtLTSYyn3g9WC6upVufCcNQ4yxUUFQrbMBURQ=="}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:54:04.968778 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-d03db7f6-5c7f-4db4-98bb-9399c4cac1fc tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Getting quotas for project 33063b3b9e0543369c28ea918f52cf37. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:54:04.981059 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-d03db7f6-5c7f-4db4-98bb-9399c4cac1fc tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Getting quotas for user 8f487f5d062e4ac3bf21c2416a7b50ee and project 33063b3b9e0543369c28ea918f52cf37. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:54:05.032574 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d03db7f6-5c7f-4db4-98bb-9399c4cac1fc tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.087343 Sep 08 10:54:05.035589 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1794/3585] 10.222.0.27 () {60 vars in 1159 bytes} [Thu Sep 8 10:54:04 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:54:05.196457 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-29ba0d30-d55e-4fcd-8945-33ffb2c8339c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:05.199916 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-29ba0d30-d55e-4fcd-8945-33ffb2c8339c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: a78d6e53-cc72-4cbd-95f5-e1f859062525] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:05.221332 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-29ba0d30-d55e-4fcd-8945-33ffb2c8339c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:05.222758 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-29ba0d30-d55e-4fcd-8945-33ffb2c8339c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:05.226195 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-29ba0d30-d55e-4fcd-8945-33ffb2c8339c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:05.227640 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-29ba0d30-d55e-4fcd-8945-33ffb2c8339c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:05.230539 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-29ba0d30-d55e-4fcd-8945-33ffb2c8339c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:05.234183 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-29ba0d30-d55e-4fcd-8945-33ffb2c8339c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:05.247912 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:54:05.764085 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-29ba0d30-d55e-4fcd-8945-33ffb2c8339c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:05.795730 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-29ba0d30-d55e-4fcd-8945-33ffb2c8339c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/a78d6e53-cc72-4cbd-95f5-e1f859062525" status: 200 len: 1315 microversion: 2.1 time: 0.618402 Sep 08 10:54:05.804417 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1795/3586] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:05 2022] GET /compute/v2.1/servers/a78d6e53-cc72-4cbd-95f5-e1f859062525 => generated 1315 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:05.829556 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-61b838ce-f76e-43d5-bdb3-ba9ce415f5e4 req-65f67f97-eb55-4214-a19c-63b5a91e5cfe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50feb7c3-9282-44b6-ad37-bf09e2d3f5a8", "tag": "ca13d9de-91b0-46ce-8809-9fde8d4724a3"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:54:05.885732 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-61b838ce-f76e-43d5-bdb3-ba9ce415f5e4 req-65f67f97-eb55-4214-a19c-63b5a91e5cfe service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:05.906781 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-61b838ce-f76e-43d5-bdb3-ba9ce415f5e4 req-65f67f97-eb55-4214-a19c-63b5a91e5cfe service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:05.907239 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-61b838ce-f76e-43d5-bdb3-ba9ce415f5e4 req-65f67f97-eb55-4214-a19c-63b5a91e5cfe service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:05.938934 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-61b838ce-f76e-43d5-bdb3-ba9ce415f5e4 req-65f67f97-eb55-4214-a19c-63b5a91e5cfe service nova] Creating event network-changed:ca13d9de-91b0-46ce-8809-9fde8d4724a3 for instance 50feb7c3-9282-44b6-ad37-bf09e2d3f5a8 on n-h2-850501-12 Sep 08 10:54:05.946599 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-61b838ce-f76e-43d5-bdb3-ba9ce415f5e4 req-65f67f97-eb55-4214-a19c-63b5a91e5cfe service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139853 Sep 08 10:54:05.948605 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1796/3587] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:54:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:54:06.862356 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-80be0e88-5f24-47d0-97d5-e4650340bef7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:06.863261 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-80be0e88-5f24-47d0-97d5-e4650340bef7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: a78d6e53-cc72-4cbd-95f5-e1f859062525] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:06.872900 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-80be0e88-5f24-47d0-97d5-e4650340bef7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:06.883675 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-80be0e88-5f24-47d0-97d5-e4650340bef7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:06.884877 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-80be0e88-5f24-47d0-97d5-e4650340bef7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:06.886509 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-80be0e88-5f24-47d0-97d5-e4650340bef7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:06.892292 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-80be0e88-5f24-47d0-97d5-e4650340bef7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:06.897121 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-80be0e88-5f24-47d0-97d5-e4650340bef7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:07.276207 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-08de1769-effb-4dbc-9fac-cdf8d4576b62 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] [instance: 50feb7c3-9282-44b6-ad37-bf09e2d3f5a8] Updating instance_info_cache with network_info: [{"id": "ca13d9de-91b0-46ce-8809-9fde8d4724a3", "address": "fa:16:3e:f9:0f:5c", "network": {"id": "9b985b6c-8cab-4bb8-8ec5-91dd022aec51", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-487710725-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.7.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "44bb5f5b56a2402999719f0374228ed3", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapca13d9de-91", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128862) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 08 10:54:07.323652 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08de1769-effb-4dbc-9fac-cdf8d4576b62 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Releasing lock "refresh_cache-50feb7c3-9282-44b6-ad37-bf09e2d3f5a8" {{(pid=128862) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 08 10:54:07.325507 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-08de1769-effb-4dbc-9fac-cdf8d4576b62 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] 10.222.0.27 "POST /compute/v2.1/servers/50feb7c3-9282-44b6-ad37-bf09e2d3f5a8/action" status: 202 len: 0 microversion: 2.1 time: 12.773479 Sep 08 10:54:07.326780 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1792/3588] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:53:54 2022] POST /compute/v2.1/servers/50feb7c3-9282-44b6-ad37-bf09e2d3f5a8/action => generated 0 bytes in 12775 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 08 10:54:07.351068 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e550278d-36e0-46a3-aba8-50735652d22e tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Calling method '.version_select at 0x7f68e464b3a0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:07.785564 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-80be0e88-5f24-47d0-97d5-e4650340bef7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:07.799942 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-80be0e88-5f24-47d0-97d5-e4650340bef7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/a78d6e53-cc72-4cbd-95f5-e1f859062525" status: 200 len: 1315 microversion: 2.1 time: 0.964036 Sep 08 10:54:07.804100 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1797/3589] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:06 2022] GET /compute/v2.1/servers/a78d6e53-cc72-4cbd-95f5-e1f859062525 => generated 1315 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:54:08.128054 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-47dd2f65-236c-4971-8b7a-b63d786cb6ef req-0d069638-fafe-45d1-8fac-30db760e610f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a78d6e53-cc72-4cbd-95f5-e1f859062525", "tag": "5411fa09-8b7d-4e0d-8a68-d1b0486fdbf7"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:54:08.146748 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-47dd2f65-236c-4971-8b7a-b63d786cb6ef req-0d069638-fafe-45d1-8fac-30db760e610f service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:08.148420 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-47dd2f65-236c-4971-8b7a-b63d786cb6ef req-0d069638-fafe-45d1-8fac-30db760e610f service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:08.149532 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-47dd2f65-236c-4971-8b7a-b63d786cb6ef req-0d069638-fafe-45d1-8fac-30db760e610f service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:08.180512 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e550278d-36e0-46a3-aba8-50735652d22e tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips/9f645ded-7eb1-4ffa-b007-77310bc9071c" status: 200 len: 184 microversion: 2.1 time: 0.841522 Sep 08 10:54:08.190145 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1793/3590] 10.222.0.27 () {58 vars in 1260 bytes} [Thu Sep 8 10:54:07 2022] GET /compute/v2.1/os-floating-ips/9f645ded-7eb1-4ffa-b007-77310bc9071c => generated 184 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:54:08.196031 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-76c5b26c-faed-4417-9e27-9dad02a27669 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.7.28"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:54:08.216005 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-47dd2f65-236c-4971-8b7a-b63d786cb6ef req-0d069638-fafe-45d1-8fac-30db760e610f service nova] Creating event network-changed:5411fa09-8b7d-4e0d-8a68-d1b0486fdbf7 for instance a78d6e53-cc72-4cbd-95f5-e1f859062525 on n-h1-850501-12 Sep 08 10:54:08.237728 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-47dd2f65-236c-4971-8b7a-b63d786cb6ef req-0d069638-fafe-45d1-8fac-30db760e610f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114893 Sep 08 10:54:08.241799 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1798/3591] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:54:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:54:08.413264 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-76c5b26c-faed-4417-9e27-9dad02a27669 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] [instance: 50feb7c3-9282-44b6-ad37-bf09e2d3f5a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:08.420014 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76c5b26c-faed-4417-9e27-9dad02a27669 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:08.420517 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76c5b26c-faed-4417-9e27-9dad02a27669 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:08.420953 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76c5b26c-faed-4417-9e27-9dad02a27669 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:08.421698 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76c5b26c-faed-4417-9e27-9dad02a27669 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:08.422162 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76c5b26c-faed-4417-9e27-9dad02a27669 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:08.422594 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76c5b26c-faed-4417-9e27-9dad02a27669 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:08.857906 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-54330700-725c-431c-844f-6c98c790bcbb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:08.859571 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-54330700-725c-431c-844f-6c98c790bcbb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: a78d6e53-cc72-4cbd-95f5-e1f859062525] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:08.881146 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-54330700-725c-431c-844f-6c98c790bcbb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:08.882335 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-54330700-725c-431c-844f-6c98c790bcbb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:08.900447 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-54330700-725c-431c-844f-6c98c790bcbb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:08.902853 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-54330700-725c-431c-844f-6c98c790bcbb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:08.903719 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-54330700-725c-431c-844f-6c98c790bcbb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:08.904484 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-54330700-725c-431c-844f-6c98c790bcbb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:09.030275 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76c5b26c-faed-4417-9e27-9dad02a27669 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "refresh_cache-50feb7c3-9282-44b6-ad37-bf09e2d3f5a8" {{(pid=128862) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 08 10:54:09.031166 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76c5b26c-faed-4417-9e27-9dad02a27669 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquired lock "refresh_cache-50feb7c3-9282-44b6-ad37-bf09e2d3f5a8" {{(pid=128862) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 08 10:54:09.390212 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-54330700-725c-431c-844f-6c98c790bcbb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:09.401564 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-54330700-725c-431c-844f-6c98c790bcbb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/a78d6e53-cc72-4cbd-95f5-e1f859062525" status: 200 len: 1315 microversion: 2.1 time: 0.564903 Sep 08 10:54:09.420036 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1799/3592] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:08 2022] GET /compute/v2.1/servers/a78d6e53-cc72-4cbd-95f5-e1f859062525 => generated 1315 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:09.600014 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-475c2c56-f405-4a0b-a77d-55c40d3fb680 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1585273017", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1d853fb2-5fbf-4c4a-82df-b80ef138d035"}], "security_groups": [{"name": "tempest-securitygroup--1989229506"}], "key_name": "tempest-keypair-844901694", "user_data": "}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:54:09.789200 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-475c2c56-f405-4a0b-a77d-55c40d3fb680 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] validate_networks() for [('1d853fb2-5fbf-4c4a-82df-b80ef138d035', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:54:10.986023 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-475c2c56-f405-4a0b-a77d-55c40d3fb680 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:54:10.987831 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-475c2c56-f405-4a0b-a77d-55c40d3fb680 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:54:10.988488 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-475c2c56-f405-4a0b-a77d-55c40d3fb680 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:54:10.991246 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-475c2c56-f405-4a0b-a77d-55c40d3fb680 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:54:10.991927 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-475c2c56-f405-4a0b-a77d-55c40d3fb680 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:54:11.004677 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-475c2c56-f405-4a0b-a77d-55c40d3fb680 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:11.006828 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-475c2c56-f405-4a0b-a77d-55c40d3fb680 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:11.007495 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-475c2c56-f405-4a0b-a77d-55c40d3fb680 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:11.008764 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-475c2c56-f405-4a0b-a77d-55c40d3fb680 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:11.009837 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-475c2c56-f405-4a0b-a77d-55c40d3fb680 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:11.011372 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-475c2c56-f405-4a0b-a77d-55c40d3fb680 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:11.061424 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-475c2c56-f405-4a0b-a77d-55c40d3fb680 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Getting quotas for project 33063b3b9e0543369c28ea918f52cf37. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:54:11.087998 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-475c2c56-f405-4a0b-a77d-55c40d3fb680 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Getting quotas for user 8f487f5d062e4ac3bf21c2416a7b50ee and project 33063b3b9e0543369c28ea918f52cf37. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:54:11.127374 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-475c2c56-f405-4a0b-a77d-55c40d3fb680 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:54:11.136730 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-475c2c56-f405-4a0b-a77d-55c40d3fb680 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: 93d05d86-99b6-43f0-83c7-257ab64a12f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:54:11.278044 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-76c5b26c-faed-4417-9e27-9dad02a27669 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] [instance: 50feb7c3-9282-44b6-ad37-bf09e2d3f5a8] Building network info cache for instance {{(pid=128862) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 08 10:54:11.290931 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-475c2c56-f405-4a0b-a77d-55c40d3fb680 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.695636 Sep 08 10:54:11.301455 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1800/3593] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:54:09 2022] POST /compute/v2.1/servers => generated 409 bytes in 1707 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 10:54:11.320158 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-945c7251-bd56-44ff-baac-c63a3cce4e52 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:11.326386 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-945c7251-bd56-44ff-baac-c63a3cce4e52 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: 19604289-6d42-403f-bf74-75335e1782cb] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:11.338178 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-945c7251-bd56-44ff-baac-c63a3cce4e52 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:11.338897 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-945c7251-bd56-44ff-baac-c63a3cce4e52 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:11.339417 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-945c7251-bd56-44ff-baac-c63a3cce4e52 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:11.340198 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-945c7251-bd56-44ff-baac-c63a3cce4e52 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:11.340886 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-945c7251-bd56-44ff-baac-c63a3cce4e52 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:11.341869 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-945c7251-bd56-44ff-baac-c63a3cce4e52 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:11.376367 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-945c7251-bd56-44ff-baac-c63a3cce4e52 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/19604289-6d42-403f-bf74-75335e1782cb/ips" status: 200 len: 151 microversion: 2.1 time: 0.072628 Sep 08 10:54:11.377503 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1801/3594] 10.222.0.27 () {58 vars in 1248 bytes} [Thu Sep 8 10:54:11 2022] GET /compute/v2.1/servers/19604289-6d42-403f-bf74-75335e1782cb/ips => generated 151 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:54:11.382613 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ef3ebbbb-af4b-496c-8ce0-29f5f6ce2f54 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:11.383667 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ef3ebbbb-af4b-496c-8ce0-29f5f6ce2f54 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: a78d6e53-cc72-4cbd-95f5-e1f859062525] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:11.392410 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ef3ebbbb-af4b-496c-8ce0-29f5f6ce2f54 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:11.393458 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ef3ebbbb-af4b-496c-8ce0-29f5f6ce2f54 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:11.394275 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ef3ebbbb-af4b-496c-8ce0-29f5f6ce2f54 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:11.396950 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ef3ebbbb-af4b-496c-8ce0-29f5f6ce2f54 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:11.397997 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ef3ebbbb-af4b-496c-8ce0-29f5f6ce2f54 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:11.398670 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ef3ebbbb-af4b-496c-8ce0-29f5f6ce2f54 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:11.645587 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ef3ebbbb-af4b-496c-8ce0-29f5f6ce2f54 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:11.659297 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ef3ebbbb-af4b-496c-8ce0-29f5f6ce2f54 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/a78d6e53-cc72-4cbd-95f5-e1f859062525" status: 200 len: 1315 microversion: 2.1 time: 0.278254 Sep 08 10:54:11.680056 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1802/3595] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:11 2022] GET /compute/v2.1/servers/a78d6e53-cc72-4cbd-95f5-e1f859062525 => generated 1315 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:12.013382 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d5efea64-f859-46e7-950f-976ee5c95782 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Action: 'create', calling method: .version_select at 0x7f68e41668b0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-865134167", "description": "tempest-description-1631556833"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:54:12.685965 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d5efea64-f859-46e7-950f-976ee5c95782 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.023270 Sep 08 10:54:12.696807 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1803/3596] 10.222.0.27 () {60 vars in 1180 bytes} [Thu Sep 8 10:54:11 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:54:12.723981 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f893adb6-331c-4b5b-ac85-2545baced104 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:12.726962 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f893adb6-331c-4b5b-ac85-2545baced104 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: 93d05d86-99b6-43f0-83c7-257ab64a12f3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:12.762406 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f893adb6-331c-4b5b-ac85-2545baced104 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:12.764586 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f893adb6-331c-4b5b-ac85-2545baced104 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:12.766367 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f893adb6-331c-4b5b-ac85-2545baced104 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:12.770060 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f893adb6-331c-4b5b-ac85-2545baced104 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:12.772303 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f893adb6-331c-4b5b-ac85-2545baced104 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:12.773221 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f893adb6-331c-4b5b-ac85-2545baced104 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:12.903580 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-76c5b26c-faed-4417-9e27-9dad02a27669 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] [instance: 50feb7c3-9282-44b6-ad37-bf09e2d3f5a8] Updating instance_info_cache with network_info: [{"id": "ca13d9de-91b0-46ce-8809-9fde8d4724a3", "address": "fa:16:3e:f9:0f:5c", "network": {"id": "9b985b6c-8cab-4bb8-8ec5-91dd022aec51", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-487710725-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "44bb5f5b56a2402999719f0374228ed3", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapca13d9de-91", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128862) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 08 10:54:12.954099 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76c5b26c-faed-4417-9e27-9dad02a27669 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Releasing lock "refresh_cache-50feb7c3-9282-44b6-ad37-bf09e2d3f5a8" {{(pid=128862) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 08 10:54:12.955290 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-76c5b26c-faed-4417-9e27-9dad02a27669 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] 10.222.0.27 "POST /compute/v2.1/servers/50feb7c3-9282-44b6-ad37-bf09e2d3f5a8/action" status: 202 len: 0 microversion: 2.1 time: 4.763922 Sep 08 10:54:12.959310 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1794/3597] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:54:08 2022] POST /compute/v2.1/servers/50feb7c3-9282-44b6-ad37-bf09e2d3f5a8/action => generated 0 bytes in 4769 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 08 10:54:12.968632 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-5c085ed0-b547-460d-afe0-d51ef55e0f04 req-e265631d-6fd6-4757-8f74-047b4fae5668 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50feb7c3-9282-44b6-ad37-bf09e2d3f5a8", "tag": "ca13d9de-91b0-46ce-8809-9fde8d4724a3"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:54:13.017500 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-5c085ed0-b547-460d-afe0-d51ef55e0f04 req-e265631d-6fd6-4757-8f74-047b4fae5668 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:13.029986 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-5c085ed0-b547-460d-afe0-d51ef55e0f04 req-e265631d-6fd6-4757-8f74-047b4fae5668 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:13.032808 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-5c085ed0-b547-460d-afe0-d51ef55e0f04 req-e265631d-6fd6-4757-8f74-047b4fae5668 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:13.077116 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f893adb6-331c-4b5b-ac85-2545baced104 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:13.099252 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f893adb6-331c-4b5b-ac85-2545baced104 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3" status: 200 len: 1249 microversion: 2.1 time: 0.400747 Sep 08 10:54:13.102272 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1804/3598] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:12 2022] GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3 => generated 1249 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:13.123503 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c603b5a1-9449-47b5-a40e-40034c107db7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:13.124135 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c603b5a1-9449-47b5-a40e-40034c107db7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: a78d6e53-cc72-4cbd-95f5-e1f859062525] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:13.129822 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-5c085ed0-b547-460d-afe0-d51ef55e0f04 req-e265631d-6fd6-4757-8f74-047b4fae5668 service nova] Creating event network-changed:ca13d9de-91b0-46ce-8809-9fde8d4724a3 for instance 50feb7c3-9282-44b6-ad37-bf09e2d3f5a8 on n-h2-850501-12 Sep 08 10:54:13.154050 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-5c085ed0-b547-460d-afe0-d51ef55e0f04 req-e265631d-6fd6-4757-8f74-047b4fae5668 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.186558 Sep 08 10:54:13.154879 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c603b5a1-9449-47b5-a40e-40034c107db7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:13.155411 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c603b5a1-9449-47b5-a40e-40034c107db7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:13.155858 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c603b5a1-9449-47b5-a40e-40034c107db7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:13.156605 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c603b5a1-9449-47b5-a40e-40034c107db7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:13.157085 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c603b5a1-9449-47b5-a40e-40034c107db7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:13.157519 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c603b5a1-9449-47b5-a40e-40034c107db7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:13.158196 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1795/3599] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:54:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:54:13.181412 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f46100c5-913f-41c5-9018-a2ab99699fcc tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Action: 'create', calling method: .version_select at 0x7f68e44c9430>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2003803527", "description": "tempest-description-1221880865"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:54:13.746977 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f46100c5-913f-41c5-9018-a2ab99699fcc tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.584324 Sep 08 10:54:13.763767 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1796/3600] 10.222.0.27 () {60 vars in 1180 bytes} [Thu Sep 8 10:54:13 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:54:13.768992 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b3c80d39-b41e-46b6-ac7e-0384433df6a8 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:13.772800 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b3c80d39-b41e-46b6-ac7e-0384433df6a8 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] [instance: 214ebb38-6f31-48bd-99a4-50ca64d78574] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:13.803233 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3c80d39-b41e-46b6-ac7e-0384433df6a8 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:13.823089 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3c80d39-b41e-46b6-ac7e-0384433df6a8 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:13.824727 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3c80d39-b41e-46b6-ac7e-0384433df6a8 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:13.829363 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3c80d39-b41e-46b6-ac7e-0384433df6a8 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:13.834777 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3c80d39-b41e-46b6-ac7e-0384433df6a8 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:13.840650 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3c80d39-b41e-46b6-ac7e-0384433df6a8 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:13.940660 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-b3c80d39-b41e-46b6-ac7e-0384433df6a8 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] HTTP exception thrown: Instance 214ebb38-6f31-48bd-99a4-50ca64d78574 could not be found. Sep 08 10:54:13.946065 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b3c80d39-b41e-46b6-ac7e-0384433df6a8 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Request method failure captured: Sep 08 10:54:13.946065 n-d-850501-12 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/servers/214ebb38-6f31-48bd-99a4-50ca64d78574 HTTP/1.1 Sep 08 10:54:13.946065 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:54:13.946065 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:54:13.946065 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:54:13.946065 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:54:13.946065 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:54:13.946065 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:54:13.946065 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:54:13.946065 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:54:13.946065 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcl9oln5N_hWqWqJYDXk4M6MYiIrhCjnFRbncU28IJZlWuxi7DXNhG9UR93EHZZ0QBnqrj4DIOizLMKqZUTmRh6yOS1vV1KW35VBVQY1AxdKMMlN6TNkoulRHqvJcbQ5AGVOkQq9W4W3FaRTRTRZifilGnvaV6OaQniB_LveRuNkNLk Sep 08 10:54:13.946065 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:54:13.946065 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:54:13.946065 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:54:13.946065 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:54:13.946065 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:54:13.946065 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:54:13.946065 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 44bb5f5b56a2402999719f0374228ed3 Sep 08 10:54:13.946065 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1432818001 Sep 08 10:54:13.946065 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:54:13.946065 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:54:13.946065 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/44bb5f5b56a2402999719f0374228ed3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/44bb5f5b56a2402999719f0374228ed3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_44bb5f5b56a2402999719f0374228ed3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/44bb5f5b56a2402999719f0374228ed3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:54:13.946065 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1432818001 Sep 08 10:54:13.946065 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 44bb5f5b56a2402999719f0374228ed3 Sep 08 10:54:13.946065 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1432818001 Sep 08 10:54:13.946065 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-FloatingIPsAssociationTestJSON-1432818001-project Sep 08 10:54:13.946065 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:54:13.946065 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:54:13.946065 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: cb2c4b351a0a4ccabbfb5438b5c535e8 Sep 08 10:54:13.946065 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1432818001-project Sep 08 10:54:13.946065 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:54:13.946065 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 214ebb38-6f31-48bd-99a4-50ca64d78574 could not be found. Sep 08 10:54:13.946065 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '214ebb38-6f31-48bd-99a4-50ca64d78574'} Sep 08 10:54:13.946065 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:54:13.946065 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:13.946065 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:54:13.946065 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:54:13.946065 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:54:13.946065 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:54:13.946065 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:54:13.946065 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:54:13.946065 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:54:13.946065 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:54:13.946065 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 214ebb38-6f31-48bd-99a4-50ca64d78574 could not be found. Sep 08 10:54:13.946065 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:54:13.946065 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:54:13.946065 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:54:13.946065 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:13.946065 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:54:13.946065 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:54:13.946065 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:54:13.946065 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:54:13.946065 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:54:13.946065 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:54:13.946065 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:54:13.946065 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:54:13.946065 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:54:13.946065 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:54:13.946065 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:54:13.946065 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:54:13.946065 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:54:13.946065 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:54:13.952630 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 214ebb38-6f31-48bd-99a4-50ca64d78574 could not be found. Sep 08 10:54:13.952630 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:54:13.952630 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:54:13.952630 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:54:13.952630 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:13.952630 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:54:13.952630 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:54:13.952630 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:54:13.952630 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:54:13.952630 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 214ebb38-6f31-48bd-99a4-50ca64d78574 could not be found. Sep 08 10:54:13.952630 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:54:13.960180 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b3c80d39-b41e-46b6-ac7e-0384433df6a8 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Returning 404 to user: Instance 214ebb38-6f31-48bd-99a4-50ca64d78574 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:54:13.962775 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b3c80d39-b41e-46b6-ac7e-0384433df6a8 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] 10.222.0.27 "DELETE /compute/v2.1/servers/214ebb38-6f31-48bd-99a4-50ca64d78574" status: 404 len: 111 microversion: 2.1 time: 0.197783 Sep 08 10:54:13.970836 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1797/3601] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:54:13 2022] DELETE /compute/v2.1/servers/214ebb38-6f31-48bd-99a4-50ca64d78574 => generated 111 bytes in 206 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:54:14.007480 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4f26330e-fcfe-4e74-9282-cd6d77171187 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-213469840", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "ba142756-d4fb-44c5-af56-3ac50419b0bd"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:54:14.159667 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-4f26330e-fcfe-4e74-9282-cd6d77171187 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] validate_networks() for [('ba142756-d4fb-44c5-af56-3ac50419b0bd', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:54:14.463702 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c603b5a1-9449-47b5-a40e-40034c107db7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:14.472056 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c603b5a1-9449-47b5-a40e-40034c107db7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/a78d6e53-cc72-4cbd-95f5-e1f859062525" status: 200 len: 1315 microversion: 2.1 time: 1.368639 Sep 08 10:54:14.490957 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1805/3602] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:13 2022] GET /compute/v2.1/servers/a78d6e53-cc72-4cbd-95f5-e1f859062525 => generated 1315 bytes in 1388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:14.496499 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0c02a4eb-83a8-4d76-97f7-55b26b03cf69 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:14.508242 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0c02a4eb-83a8-4d76-97f7-55b26b03cf69 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] [instance: 214ebb38-6f31-48bd-99a4-50ca64d78574] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:14.527748 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0c02a4eb-83a8-4d76-97f7-55b26b03cf69 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:14.528262 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0c02a4eb-83a8-4d76-97f7-55b26b03cf69 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:14.528704 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0c02a4eb-83a8-4d76-97f7-55b26b03cf69 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:14.529453 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0c02a4eb-83a8-4d76-97f7-55b26b03cf69 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:14.529915 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0c02a4eb-83a8-4d76-97f7-55b26b03cf69 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:14.530538 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0c02a4eb-83a8-4d76-97f7-55b26b03cf69 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:14.587238 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-0c02a4eb-83a8-4d76-97f7-55b26b03cf69 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] HTTP exception thrown: Instance 214ebb38-6f31-48bd-99a4-50ca64d78574 could not be found. Sep 08 10:54:14.599157 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0c02a4eb-83a8-4d76-97f7-55b26b03cf69 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Request method failure captured: Sep 08 10:54:14.599157 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/214ebb38-6f31-48bd-99a4-50ca64d78574 HTTP/1.1 Sep 08 10:54:14.599157 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:54:14.599157 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:54:14.599157 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:54:14.599157 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:54:14.599157 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:54:14.599157 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:54:14.599157 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:54:14.599157 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:54:14.599157 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcl9oln5N_hWqWqJYDXk4M6MYiIrhCjnFRbncU28IJZlWuxi7DXNhG9UR93EHZZ0QBnqrj4DIOizLMKqZUTmRh6yOS1vV1KW35VBVQY1AxdKMMlN6TNkoulRHqvJcbQ5AGVOkQq9W4W3FaRTRTRZifilGnvaV6OaQniB_LveRuNkNLk Sep 08 10:54:14.599157 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:54:14.599157 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:54:14.599157 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:54:14.599157 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:54:14.599157 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:54:14.599157 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:54:14.599157 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 44bb5f5b56a2402999719f0374228ed3 Sep 08 10:54:14.599157 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1432818001 Sep 08 10:54:14.599157 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:54:14.599157 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:54:14.599157 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/44bb5f5b56a2402999719f0374228ed3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/44bb5f5b56a2402999719f0374228ed3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_44bb5f5b56a2402999719f0374228ed3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/44bb5f5b56a2402999719f0374228ed3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:54:14.599157 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1432818001 Sep 08 10:54:14.599157 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 44bb5f5b56a2402999719f0374228ed3 Sep 08 10:54:14.599157 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1432818001 Sep 08 10:54:14.599157 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-FloatingIPsAssociationTestJSON-1432818001-project Sep 08 10:54:14.599157 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:54:14.599157 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:54:14.599157 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: cb2c4b351a0a4ccabbfb5438b5c535e8 Sep 08 10:54:14.599157 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1432818001-project Sep 08 10:54:14.599157 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:54:14.599157 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 214ebb38-6f31-48bd-99a4-50ca64d78574 could not be found. Sep 08 10:54:14.599157 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '214ebb38-6f31-48bd-99a4-50ca64d78574'} Sep 08 10:54:14.599157 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:54:14.599157 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:14.599157 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:54:14.599157 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:54:14.599157 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:54:14.599157 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:54:14.599157 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:54:14.599157 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:54:14.599157 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:54:14.599157 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:54:14.599157 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 214ebb38-6f31-48bd-99a4-50ca64d78574 could not be found. Sep 08 10:54:14.599157 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:14.599157 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:54:14.599157 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:14.599157 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:14.599157 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:54:14.599157 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:54:14.599157 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:54:14.599157 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:54:14.599157 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:54:14.599157 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:54:14.599157 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:54:14.599157 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:54:14.599157 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:54:14.599157 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:54:14.599157 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:54:14.599157 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:54:14.599157 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 214ebb38-6f31-48bd-99a4-50ca64d78574 could not be found. Sep 08 10:54:14.599157 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:14.599157 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:54:14.604555 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:14.604555 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:14.604555 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:54:14.604555 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:54:14.604555 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:54:14.604555 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:54:14.604555 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 214ebb38-6f31-48bd-99a4-50ca64d78574 could not be found. Sep 08 10:54:14.604555 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:14.606744 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0c02a4eb-83a8-4d76-97f7-55b26b03cf69 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Returning 404 to user: Instance 214ebb38-6f31-48bd-99a4-50ca64d78574 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:54:14.608395 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0c02a4eb-83a8-4d76-97f7-55b26b03cf69 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] 10.222.0.27 "GET /compute/v2.1/servers/214ebb38-6f31-48bd-99a4-50ca64d78574" status: 404 len: 111 microversion: 2.1 time: 0.115782 Sep 08 10:54:14.627453 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1806/3603] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:14 2022] GET /compute/v2.1/servers/214ebb38-6f31-48bd-99a4-50ca64d78574 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:54:14.653247 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-77cf319c-6fb4-4ac2-bd26-e63e6ac36288 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:14.653247 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-77cf319c-6fb4-4ac2-bd26-e63e6ac36288 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: 93d05d86-99b6-43f0-83c7-257ab64a12f3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:14.670031 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-77cf319c-6fb4-4ac2-bd26-e63e6ac36288 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:14.671034 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-77cf319c-6fb4-4ac2-bd26-e63e6ac36288 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:14.671650 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-77cf319c-6fb4-4ac2-bd26-e63e6ac36288 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:14.672550 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-77cf319c-6fb4-4ac2-bd26-e63e6ac36288 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:14.673249 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-77cf319c-6fb4-4ac2-bd26-e63e6ac36288 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:14.674375 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-77cf319c-6fb4-4ac2-bd26-e63e6ac36288 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:14.807835 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-77cf319c-6fb4-4ac2-bd26-e63e6ac36288 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:14.816271 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-77cf319c-6fb4-4ac2-bd26-e63e6ac36288 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3" status: 200 len: 1303 microversion: 2.1 time: 0.187294 Sep 08 10:54:14.819991 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1807/3604] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:14 2022] GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3 => generated 1303 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:14.835800 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-56c1eeda-d96c-48f1-9cbb-6bf784a11172 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Calling method '.version_select at 0x7f68e5136dc0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:15.177345 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-4f26330e-fcfe-4e74-9282-cd6d77171187 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:54:15.178158 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-4f26330e-fcfe-4e74-9282-cd6d77171187 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:54:15.179227 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-4f26330e-fcfe-4e74-9282-cd6d77171187 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:54:15.179714 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-4f26330e-fcfe-4e74-9282-cd6d77171187 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:54:15.180148 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-4f26330e-fcfe-4e74-9282-cd6d77171187 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:54:15.208294 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f26330e-fcfe-4e74-9282-cd6d77171187 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:15.209148 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f26330e-fcfe-4e74-9282-cd6d77171187 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:15.209437 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f26330e-fcfe-4e74-9282-cd6d77171187 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:15.210184 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f26330e-fcfe-4e74-9282-cd6d77171187 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:15.210645 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f26330e-fcfe-4e74-9282-cd6d77171187 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:15.211070 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f26330e-fcfe-4e74-9282-cd6d77171187 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:15.275591 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-4f26330e-fcfe-4e74-9282-cd6d77171187 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Getting quotas for project 0958700fa94b42b2b6b47af40cf2f679. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:54:15.284421 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-4f26330e-fcfe-4e74-9282-cd6d77171187 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Getting quotas for user e1bec228c17647bba62ba7d57d28e4ed and project 0958700fa94b42b2b6b47af40cf2f679. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:54:15.309520 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4f26330e-fcfe-4e74-9282-cd6d77171187 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:54:15.313615 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4f26330e-fcfe-4e74-9282-cd6d77171187 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] [instance: 62784844-aa89-4715-a3e2-6346c45e0cdb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:54:15.398079 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4f26330e-fcfe-4e74-9282-cd6d77171187 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.425811 Sep 08 10:54:15.399359 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1798/3605] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:54:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1428 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:54:15.404603 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-cec566cd-dd5d-48e7-ab03-156d7b6db36e req-c3d6b6f2-ac2b-45af-887b-722d779a28c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a78d6e53-cc72-4cbd-95f5-e1f859062525", "name": "network-vif-plugged", "status": "completed", "tag": "5411fa09-8b7d-4e0d-8a68-d1b0486fdbf7"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:54:15.417365 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-cec566cd-dd5d-48e7-ab03-156d7b6db36e req-c3d6b6f2-ac2b-45af-887b-722d779a28c0 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:15.418171 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-cec566cd-dd5d-48e7-ab03-156d7b6db36e req-c3d6b6f2-ac2b-45af-887b-722d779a28c0 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:15.418785 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-cec566cd-dd5d-48e7-ab03-156d7b6db36e req-c3d6b6f2-ac2b-45af-887b-722d779a28c0 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:15.445233 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-cec566cd-dd5d-48e7-ab03-156d7b6db36e req-c3d6b6f2-ac2b-45af-887b-722d779a28c0 service nova] Creating event network-vif-plugged:5411fa09-8b7d-4e0d-8a68-d1b0486fdbf7 for instance a78d6e53-cc72-4cbd-95f5-e1f859062525 on n-h1-850501-12 Sep 08 10:54:15.452355 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-cec566cd-dd5d-48e7-ab03-156d7b6db36e req-c3d6b6f2-ac2b-45af-887b-722d779a28c0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051258 Sep 08 10:54:15.453274 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1799/3606] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:54:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:54:15.459652 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fe9daa14-25d0-472f-9fdf-5e11ecca6eca tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:15.460529 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fe9daa14-25d0-472f-9fdf-5e11ecca6eca tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] [instance: 62784844-aa89-4715-a3e2-6346c45e0cdb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:15.563624 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fe9daa14-25d0-472f-9fdf-5e11ecca6eca tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1bec228c17647bba62ba7d57d28e4ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0958700fa94b42b2b6b47af40cf2f679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:15.584583 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fe9daa14-25d0-472f-9fdf-5e11ecca6eca tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "GET /compute/v2.1/servers/62784844-aa89-4715-a3e2-6346c45e0cdb" status: 200 len: 1215 microversion: 2.1 time: 0.123936 Sep 08 10:54:15.586326 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1800/3607] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:15 2022] GET /compute/v2.1/servers/62784844-aa89-4715-a3e2-6346c45e0cdb => generated 1215 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:15.596484 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-52f1bc3a-7019-435c-892c-d67d9a43f83e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:15.597493 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-52f1bc3a-7019-435c-892c-d67d9a43f83e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: a78d6e53-cc72-4cbd-95f5-e1f859062525] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:15.611711 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-52f1bc3a-7019-435c-892c-d67d9a43f83e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:15.612459 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-52f1bc3a-7019-435c-892c-d67d9a43f83e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:15.613149 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-52f1bc3a-7019-435c-892c-d67d9a43f83e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:15.615199 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-52f1bc3a-7019-435c-892c-d67d9a43f83e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:15.616112 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-52f1bc3a-7019-435c-892c-d67d9a43f83e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:15.617676 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-52f1bc3a-7019-435c-892c-d67d9a43f83e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:15.967054 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-52f1bc3a-7019-435c-892c-d67d9a43f83e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:15.984614 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-52f1bc3a-7019-435c-892c-d67d9a43f83e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/a78d6e53-cc72-4cbd-95f5-e1f859062525" status: 200 len: 1315 microversion: 2.1 time: 0.396400 Sep 08 10:54:16.006390 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1801/3608] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:15 2022] GET /compute/v2.1/servers/a78d6e53-cc72-4cbd-95f5-e1f859062525 => generated 1315 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:16.023692 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b1537e94-e4e9-4e2c-8f14-9263ad793fc5 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:16.025413 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b1537e94-e4e9-4e2c-8f14-9263ad793fc5 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: 93d05d86-99b6-43f0-83c7-257ab64a12f3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:16.032390 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1537e94-e4e9-4e2c-8f14-9263ad793fc5 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:16.033270 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1537e94-e4e9-4e2c-8f14-9263ad793fc5 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:16.047192 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1537e94-e4e9-4e2c-8f14-9263ad793fc5 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:16.048009 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1537e94-e4e9-4e2c-8f14-9263ad793fc5 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:16.048505 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1537e94-e4e9-4e2c-8f14-9263ad793fc5 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:16.048956 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1537e94-e4e9-4e2c-8f14-9263ad793fc5 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:16.186524 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b1537e94-e4e9-4e2c-8f14-9263ad793fc5 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:16.198999 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b1537e94-e4e9-4e2c-8f14-9263ad793fc5 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3" status: 200 len: 1303 microversion: 2.1 time: 0.191364 Sep 08 10:54:16.210627 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1802/3609] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:16 2022] GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3 => generated 1303 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:16.245100 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-73101be2-ec95-443d-accb-2d4477cedb80 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4425dd95-e71e-413a-8436-785c4c78bdc7"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:54:16.250484 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-73101be2-ec95-443d-accb-2d4477cedb80 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: 19604289-6d42-403f-bf74-75335e1782cb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:16.277344 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-73101be2-ec95-443d-accb-2d4477cedb80 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:16.277818 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-73101be2-ec95-443d-accb-2d4477cedb80 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:16.278353 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-73101be2-ec95-443d-accb-2d4477cedb80 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:16.279073 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-73101be2-ec95-443d-accb-2d4477cedb80 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:16.283766 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-73101be2-ec95-443d-accb-2d4477cedb80 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:16.285335 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-73101be2-ec95-443d-accb-2d4477cedb80 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:17.190721 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-73101be2-ec95-443d-accb-2d4477cedb80 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "POST /compute/v2.1/servers/19604289-6d42-403f-bf74-75335e1782cb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.978004 Sep 08 10:54:17.201520 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1803/3610] 10.222.0.27 () {60 vars in 1323 bytes} [Thu Sep 8 10:54:16 2022] POST /compute/v2.1/servers/19604289-6d42-403f-bf74-75335e1782cb/os-volume_attachments => generated 194 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:54:17.220019 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-81441546-0d02-478c-8b30-a5f2ea715b95 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:17.229460 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-81441546-0d02-478c-8b30-a5f2ea715b95 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] [instance: 62784844-aa89-4715-a3e2-6346c45e0cdb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:17.252323 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81441546-0d02-478c-8b30-a5f2ea715b95 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:17.253472 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81441546-0d02-478c-8b30-a5f2ea715b95 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:17.254610 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81441546-0d02-478c-8b30-a5f2ea715b95 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:17.256345 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81441546-0d02-478c-8b30-a5f2ea715b95 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:17.257500 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81441546-0d02-478c-8b30-a5f2ea715b95 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:17.260462 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81441546-0d02-478c-8b30-a5f2ea715b95 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:17.470253 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-81441546-0d02-478c-8b30-a5f2ea715b95 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1bec228c17647bba62ba7d57d28e4ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0958700fa94b42b2b6b47af40cf2f679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:17.483000 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-81441546-0d02-478c-8b30-a5f2ea715b95 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "GET /compute/v2.1/servers/62784844-aa89-4715-a3e2-6346c45e0cdb" status: 200 len: 1267 microversion: 2.1 time: 0.278504 Sep 08 10:54:17.486158 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1804/3611] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:17 2022] GET /compute/v2.1/servers/62784844-aa89-4715-a3e2-6346c45e0cdb => generated 1267 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:17.492814 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5ce8b6a1-2f56-469f-8bea-9ebc0d221a83 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:17.493943 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5ce8b6a1-2f56-469f-8bea-9ebc0d221a83 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: a78d6e53-cc72-4cbd-95f5-e1f859062525] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:17.501678 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ce8b6a1-2f56-469f-8bea-9ebc0d221a83 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:17.502567 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ce8b6a1-2f56-469f-8bea-9ebc0d221a83 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:17.503330 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ce8b6a1-2f56-469f-8bea-9ebc0d221a83 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:17.504237 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ce8b6a1-2f56-469f-8bea-9ebc0d221a83 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:17.505613 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ce8b6a1-2f56-469f-8bea-9ebc0d221a83 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:17.506939 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ce8b6a1-2f56-469f-8bea-9ebc0d221a83 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:17.768560 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5ce8b6a1-2f56-469f-8bea-9ebc0d221a83 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:17.783692 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5ce8b6a1-2f56-469f-8bea-9ebc0d221a83 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/a78d6e53-cc72-4cbd-95f5-e1f859062525" status: 200 len: 1315 microversion: 2.1 time: 0.295839 Sep 08 10:54:17.784747 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1805/3612] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:17 2022] GET /compute/v2.1/servers/a78d6e53-cc72-4cbd-95f5-e1f859062525 => generated 1315 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:17.818043 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-00cb0369-4ef8-4849-8fcb-49854e370790 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:17.819715 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-00cb0369-4ef8-4849-8fcb-49854e370790 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: 93d05d86-99b6-43f0-83c7-257ab64a12f3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:17.863575 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00cb0369-4ef8-4849-8fcb-49854e370790 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:17.866265 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00cb0369-4ef8-4849-8fcb-49854e370790 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:17.868290 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00cb0369-4ef8-4849-8fcb-49854e370790 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:17.870185 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00cb0369-4ef8-4849-8fcb-49854e370790 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:17.873263 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00cb0369-4ef8-4849-8fcb-49854e370790 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:17.875996 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00cb0369-4ef8-4849-8fcb-49854e370790 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:17.917138 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-56c1eeda-d96c-48f1-9cbb-6bf784a11172 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/9f645ded-7eb1-4ffa-b007-77310bc9071c" status: 202 len: 0 microversion: 2.1 time: 3.094265 Sep 08 10:54:17.926619 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1808/3613] 10.222.0.27 () {58 vars in 1263 bytes} [Thu Sep 8 10:54:14 2022] DELETE /compute/v2.1/os-floating-ips/9f645ded-7eb1-4ffa-b007-77310bc9071c => generated 0 bytes in 3105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:54:17.936844 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4adfa613-6c56-41cc-b436-9573dcf646c4 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:17.937699 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4adfa613-6c56-41cc-b436-9573dcf646c4 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] [instance: 50feb7c3-9282-44b6-ad37-bf09e2d3f5a8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:17.960679 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4adfa613-6c56-41cc-b436-9573dcf646c4 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:17.962158 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4adfa613-6c56-41cc-b436-9573dcf646c4 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:17.962912 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4adfa613-6c56-41cc-b436-9573dcf646c4 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:17.963957 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4adfa613-6c56-41cc-b436-9573dcf646c4 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:17.964688 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4adfa613-6c56-41cc-b436-9573dcf646c4 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:17.965461 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4adfa613-6c56-41cc-b436-9573dcf646c4 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:18.072701 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4adfa613-6c56-41cc-b436-9573dcf646c4 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] [instance: 50feb7c3-9282-44b6-ad37-bf09e2d3f5a8] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:54:18.272993 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4adfa613-6c56-41cc-b436-9573dcf646c4 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] 10.222.0.27 "DELETE /compute/v2.1/servers/50feb7c3-9282-44b6-ad37-bf09e2d3f5a8" status: 204 len: 0 microversion: 2.1 time: 0.343390 Sep 08 10:54:18.277941 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1809/3614] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:54:17 2022] DELETE /compute/v2.1/servers/50feb7c3-9282-44b6-ad37-bf09e2d3f5a8 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:54:18.288502 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-09d2f8b0-158a-4746-9ccd-e2f83f86a7a9 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:18.292536 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-09d2f8b0-158a-4746-9ccd-e2f83f86a7a9 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] [instance: 50feb7c3-9282-44b6-ad37-bf09e2d3f5a8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:18.312990 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-09d2f8b0-158a-4746-9ccd-e2f83f86a7a9 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:18.314085 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-09d2f8b0-158a-4746-9ccd-e2f83f86a7a9 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:18.315014 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-09d2f8b0-158a-4746-9ccd-e2f83f86a7a9 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:18.316653 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-09d2f8b0-158a-4746-9ccd-e2f83f86a7a9 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:18.318066 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-09d2f8b0-158a-4746-9ccd-e2f83f86a7a9 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:18.330951 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-09d2f8b0-158a-4746-9ccd-e2f83f86a7a9 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:18.348878 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-00cb0369-4ef8-4849-8fcb-49854e370790 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:18.357980 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-00cb0369-4ef8-4849-8fcb-49854e370790 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3" status: 200 len: 1371 microversion: 2.1 time: 0.572208 Sep 08 10:54:18.361365 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1806/3615] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:17 2022] GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3 => generated 1371 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:18.512602 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bd6326f6-1664-4f71-9f90-da6312be3756 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:18.513706 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bd6326f6-1664-4f71-9f90-da6312be3756 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] [instance: 62784844-aa89-4715-a3e2-6346c45e0cdb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:18.528593 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bd6326f6-1664-4f71-9f90-da6312be3756 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:18.529136 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bd6326f6-1664-4f71-9f90-da6312be3756 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:18.529583 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bd6326f6-1664-4f71-9f90-da6312be3756 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:18.536290 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bd6326f6-1664-4f71-9f90-da6312be3756 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:18.541940 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bd6326f6-1664-4f71-9f90-da6312be3756 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:18.542788 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bd6326f6-1664-4f71-9f90-da6312be3756 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:18.620591 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=5,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:54:18.638532 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-09d2f8b0-158a-4746-9ccd-e2f83f86a7a9 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c4b351a0a4ccabbfb5438b5c535e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bb5f5b56a2402999719f0374228ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:18.651922 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-09d2f8b0-158a-4746-9ccd-e2f83f86a7a9 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] 10.222.0.27 "GET /compute/v2.1/servers/50feb7c3-9282-44b6-ad37-bf09e2d3f5a8" status: 200 len: 1526 microversion: 2.1 time: 0.372092 Sep 08 10:54:18.661467 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1810/3616] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:18 2022] GET /compute/v2.1/servers/50feb7c3-9282-44b6-ad37-bf09e2d3f5a8 => generated 1526 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:18.716224 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bd6326f6-1664-4f71-9f90-da6312be3756 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1bec228c17647bba62ba7d57d28e4ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0958700fa94b42b2b6b47af40cf2f679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:18.726300 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bd6326f6-1664-4f71-9f90-da6312be3756 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "GET /compute/v2.1/servers/62784844-aa89-4715-a3e2-6346c45e0cdb" status: 200 len: 1273 microversion: 2.1 time: 0.218223 Sep 08 10:54:18.727523 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1807/3617] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:18 2022] GET /compute/v2.1/servers/62784844-aa89-4715-a3e2-6346c45e0cdb => generated 1273 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:18.812133 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-82ebeb65-984e-49cb-8715-daafd16c4122 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:18.812740 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-82ebeb65-984e-49cb-8715-daafd16c4122 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: a78d6e53-cc72-4cbd-95f5-e1f859062525] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:18.819558 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-82ebeb65-984e-49cb-8715-daafd16c4122 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:18.823930 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-82ebeb65-984e-49cb-8715-daafd16c4122 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:18.824660 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-82ebeb65-984e-49cb-8715-daafd16c4122 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:18.825821 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-82ebeb65-984e-49cb-8715-daafd16c4122 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:18.826287 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-82ebeb65-984e-49cb-8715-daafd16c4122 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:18.826711 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-82ebeb65-984e-49cb-8715-daafd16c4122 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:19.026165 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-82ebeb65-984e-49cb-8715-daafd16c4122 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:19.036593 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-82ebeb65-984e-49cb-8715-daafd16c4122 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/a78d6e53-cc72-4cbd-95f5-e1f859062525" status: 200 len: 1504 microversion: 2.1 time: 0.228315 Sep 08 10:54:19.054030 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1811/3618] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:18 2022] GET /compute/v2.1/servers/a78d6e53-cc72-4cbd-95f5-e1f859062525 => generated 1504 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:19.063562 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e7817dfa-73e9-42db-931f-9c44a8d66513 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:19.064473 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e7817dfa-73e9-42db-931f-9c44a8d66513 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: a78d6e53-cc72-4cbd-95f5-e1f859062525] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:19.073179 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7817dfa-73e9-42db-931f-9c44a8d66513 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:19.074420 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7817dfa-73e9-42db-931f-9c44a8d66513 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:19.075053 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7817dfa-73e9-42db-931f-9c44a8d66513 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:19.076241 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7817dfa-73e9-42db-931f-9c44a8d66513 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:19.076957 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7817dfa-73e9-42db-931f-9c44a8d66513 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:19.077844 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7817dfa-73e9-42db-931f-9c44a8d66513 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:19.122676 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e7817dfa-73e9-42db-931f-9c44a8d66513 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: a78d6e53-cc72-4cbd-95f5-e1f859062525] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:54:19.274467 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e7817dfa-73e9-42db-931f-9c44a8d66513 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a78d6e53-cc72-4cbd-95f5-e1f859062525" status: 204 len: 0 microversion: 2.1 time: 0.214561 Sep 08 10:54:19.275783 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1808/3619] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:54:19 2022] DELETE /compute/v2.1/servers/a78d6e53-cc72-4cbd-95f5-e1f859062525 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 10:54:19.295522 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7d5d1fe4-bab1-4400-beb5-87a6bc28e5d7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:19.298541 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7d5d1fe4-bab1-4400-beb5-87a6bc28e5d7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: a78d6e53-cc72-4cbd-95f5-e1f859062525] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:19.311875 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7d5d1fe4-bab1-4400-beb5-87a6bc28e5d7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:19.312726 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7d5d1fe4-bab1-4400-beb5-87a6bc28e5d7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:19.313553 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7d5d1fe4-bab1-4400-beb5-87a6bc28e5d7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:19.315393 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7d5d1fe4-bab1-4400-beb5-87a6bc28e5d7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:19.316533 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7d5d1fe4-bab1-4400-beb5-87a6bc28e5d7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:19.317349 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7d5d1fe4-bab1-4400-beb5-87a6bc28e5d7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:19.393944 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2b19b1df-2751-41f4-8f91-85a645668f1e tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:19.397377 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2b19b1df-2751-41f4-8f91-85a645668f1e tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: 93d05d86-99b6-43f0-83c7-257ab64a12f3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:19.417194 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b19b1df-2751-41f4-8f91-85a645668f1e tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:19.430060 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b19b1df-2751-41f4-8f91-85a645668f1e tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:19.431603 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b19b1df-2751-41f4-8f91-85a645668f1e tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:19.434469 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b19b1df-2751-41f4-8f91-85a645668f1e tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:19.435777 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b19b1df-2751-41f4-8f91-85a645668f1e tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:19.437943 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b19b1df-2751-41f4-8f91-85a645668f1e tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:19.773951 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2b19b1df-2751-41f4-8f91-85a645668f1e tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:19.795207 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2b19b1df-2751-41f4-8f91-85a645668f1e tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3" status: 200 len: 1371 microversion: 2.1 time: 0.409764 Sep 08 10:54:19.798144 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1809/3620] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:19 2022] GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3 => generated 1371 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:19.807344 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-069cd7f8-0cbd-4337-9603-bd2773ed3195 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:19.810823 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-069cd7f8-0cbd-4337-9603-bd2773ed3195 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] [instance: 50feb7c3-9282-44b6-ad37-bf09e2d3f5a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:19.819793 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-069cd7f8-0cbd-4337-9603-bd2773ed3195 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:19.820695 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-069cd7f8-0cbd-4337-9603-bd2773ed3195 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:19.821402 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-069cd7f8-0cbd-4337-9603-bd2773ed3195 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:19.822386 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-069cd7f8-0cbd-4337-9603-bd2773ed3195 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:19.823084 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-069cd7f8-0cbd-4337-9603-bd2773ed3195 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:19.824137 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-069cd7f8-0cbd-4337-9603-bd2773ed3195 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:19.971496 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7d5d1fe4-bab1-4400-beb5-87a6bc28e5d7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:19.992671 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7d5d1fe4-bab1-4400-beb5-87a6bc28e5d7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/a78d6e53-cc72-4cbd-95f5-e1f859062525" status: 200 len: 1510 microversion: 2.1 time: 0.699430 Sep 08 10:54:19.994232 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1812/3621] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:19 2022] GET /compute/v2.1/servers/a78d6e53-cc72-4cbd-95f5-e1f859062525 => generated 1510 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:20.001326 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9974caab-151f-44c0-8841-476108c68d54 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:20.002943 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9974caab-151f-44c0-8841-476108c68d54 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] [instance: 62784844-aa89-4715-a3e2-6346c45e0cdb] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:20.030331 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9974caab-151f-44c0-8841-476108c68d54 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:20.032783 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9974caab-151f-44c0-8841-476108c68d54 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:20.033744 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9974caab-151f-44c0-8841-476108c68d54 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:20.035450 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9974caab-151f-44c0-8841-476108c68d54 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:20.037072 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9974caab-151f-44c0-8841-476108c68d54 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:20.037934 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9974caab-151f-44c0-8841-476108c68d54 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:20.319309 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-069cd7f8-0cbd-4337-9603-bd2773ed3195 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c4b351a0a4ccabbfb5438b5c535e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bb5f5b56a2402999719f0374228ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:20.328874 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-069cd7f8-0cbd-4337-9603-bd2773ed3195 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] 10.222.0.27 "GET /compute/v2.1/servers/50feb7c3-9282-44b6-ad37-bf09e2d3f5a8" status: 200 len: 1526 microversion: 2.1 time: 0.528714 Sep 08 10:54:20.334843 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1810/3622] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:19 2022] GET /compute/v2.1/servers/50feb7c3-9282-44b6-ad37-bf09e2d3f5a8 => generated 1526 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:20.834085 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5b909743-dba2-4ad4-b0d7-7b352da77a5c tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:20.836129 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5b909743-dba2-4ad4-b0d7-7b352da77a5c tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: 93d05d86-99b6-43f0-83c7-257ab64a12f3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:20.851022 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9974caab-151f-44c0-8841-476108c68d54 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1bec228c17647bba62ba7d57d28e4ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0958700fa94b42b2b6b47af40cf2f679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:20.859650 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b909743-dba2-4ad4-b0d7-7b352da77a5c tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:20.865560 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b909743-dba2-4ad4-b0d7-7b352da77a5c tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:20.866223 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b909743-dba2-4ad4-b0d7-7b352da77a5c tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:20.867245 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b909743-dba2-4ad4-b0d7-7b352da77a5c tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:20.871691 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b909743-dba2-4ad4-b0d7-7b352da77a5c tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:20.872337 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b909743-dba2-4ad4-b0d7-7b352da77a5c tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:20.878043 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9974caab-151f-44c0-8841-476108c68d54 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "GET /compute/v2.1/servers/62784844-aa89-4715-a3e2-6346c45e0cdb" status: 200 len: 1273 microversion: 2.1 time: 0.879094 Sep 08 10:54:20.889961 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1813/3623] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:19 2022] GET /compute/v2.1/servers/62784844-aa89-4715-a3e2-6346c45e0cdb => generated 1273 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:21.023759 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8d5e20a3-8dda-48d9-8528-1e6aa6ada0af tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:21.025294 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8d5e20a3-8dda-48d9-8528-1e6aa6ada0af tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: a78d6e53-cc72-4cbd-95f5-e1f859062525] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:21.049123 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:54:21.057752 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8d5e20a3-8dda-48d9-8528-1e6aa6ada0af tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:21.058950 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8d5e20a3-8dda-48d9-8528-1e6aa6ada0af tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:21.061351 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8d5e20a3-8dda-48d9-8528-1e6aa6ada0af tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:21.063287 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8d5e20a3-8dda-48d9-8528-1e6aa6ada0af tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:21.064287 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8d5e20a3-8dda-48d9-8528-1e6aa6ada0af tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:21.065406 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8d5e20a3-8dda-48d9-8528-1e6aa6ada0af tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:21.160224 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=10 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:54:21.306235 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5b909743-dba2-4ad4-b0d7-7b352da77a5c tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:21.327063 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5b909743-dba2-4ad4-b0d7-7b352da77a5c tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3" status: 200 len: 1371 microversion: 2.1 time: 0.500752 Sep 08 10:54:21.333919 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1811/3624] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:20 2022] GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3 => generated 1371 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:21.344769 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-ce0faa90-1c89-42c2-ac4b-0ec97f5c44ed req-cb7ea5a9-1042-411c-ac2d-4fdd05a3a52a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50feb7c3-9282-44b6-ad37-bf09e2d3f5a8", "name": "network-vif-deleted", "tag": "ca13d9de-91b0-46ce-8809-9fde8d4724a3"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:54:21.401829 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ce0faa90-1c89-42c2-ac4b-0ec97f5c44ed req-cb7ea5a9-1042-411c-ac2d-4fdd05a3a52a service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:21.406567 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ce0faa90-1c89-42c2-ac4b-0ec97f5c44ed req-cb7ea5a9-1042-411c-ac2d-4fdd05a3a52a service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:21.407364 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ce0faa90-1c89-42c2-ac4b-0ec97f5c44ed req-cb7ea5a9-1042-411c-ac2d-4fdd05a3a52a service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:21.454523 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-ce0faa90-1c89-42c2-ac4b-0ec97f5c44ed req-cb7ea5a9-1042-411c-ac2d-4fdd05a3a52a service nova] Creating event network-vif-deleted:ca13d9de-91b0-46ce-8809-9fde8d4724a3 for instance 50feb7c3-9282-44b6-ad37-bf09e2d3f5a8 on n-h2-850501-12 Sep 08 10:54:21.492573 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-ce0faa90-1c89-42c2-ac4b-0ec97f5c44ed req-cb7ea5a9-1042-411c-ac2d-4fdd05a3a52a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146064 Sep 08 10:54:21.496451 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1812/3625] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:54:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:54:21.524971 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-15c7b3f6-bf22-4c60-b017-4669dfe07727 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:21.527200 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-15c7b3f6-bf22-4c60-b017-4669dfe07727 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] [instance: 50feb7c3-9282-44b6-ad37-bf09e2d3f5a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:21.546284 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15c7b3f6-bf22-4c60-b017-4669dfe07727 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:21.547279 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15c7b3f6-bf22-4c60-b017-4669dfe07727 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:21.552861 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15c7b3f6-bf22-4c60-b017-4669dfe07727 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:21.554051 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15c7b3f6-bf22-4c60-b017-4669dfe07727 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:21.557707 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15c7b3f6-bf22-4c60-b017-4669dfe07727 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:21.558398 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15c7b3f6-bf22-4c60-b017-4669dfe07727 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:21.690083 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15c7b3f6-bf22-4c60-b017-4669dfe07727 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:21.690597 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15c7b3f6-bf22-4c60-b017-4669dfe07727 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:21.691131 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15c7b3f6-bf22-4c60-b017-4669dfe07727 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:21.691644 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-15c7b3f6-bf22-4c60-b017-4669dfe07727 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lazy-loading 'fault' on Instance uuid 50feb7c3-9282-44b6-ad37-bf09e2d3f5a8 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:54:21.792588 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-15c7b3f6-bf22-4c60-b017-4669dfe07727 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c4b351a0a4ccabbfb5438b5c535e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bb5f5b56a2402999719f0374228ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:21.808730 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-15c7b3f6-bf22-4c60-b017-4669dfe07727 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] 10.222.0.27 "GET /compute/v2.1/servers/50feb7c3-9282-44b6-ad37-bf09e2d3f5a8" status: 200 len: 1314 microversion: 2.1 time: 0.308155 Sep 08 10:54:21.825587 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1813/3626] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:21 2022] GET /compute/v2.1/servers/50feb7c3-9282-44b6-ad37-bf09e2d3f5a8 => generated 1314 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:21.922067 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-466ac6ba-14aa-49e0-84de-336534dfb459 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:21.923450 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-466ac6ba-14aa-49e0-84de-336534dfb459 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] [instance: 62784844-aa89-4715-a3e2-6346c45e0cdb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:21.935928 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-466ac6ba-14aa-49e0-84de-336534dfb459 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:21.936794 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-466ac6ba-14aa-49e0-84de-336534dfb459 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:21.937523 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-466ac6ba-14aa-49e0-84de-336534dfb459 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:21.938621 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-466ac6ba-14aa-49e0-84de-336534dfb459 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:21.939363 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-466ac6ba-14aa-49e0-84de-336534dfb459 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:21.940552 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-466ac6ba-14aa-49e0-84de-336534dfb459 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:22.164611 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-466ac6ba-14aa-49e0-84de-336534dfb459 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1bec228c17647bba62ba7d57d28e4ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0958700fa94b42b2b6b47af40cf2f679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:22.199129 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-466ac6ba-14aa-49e0-84de-336534dfb459 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "GET /compute/v2.1/servers/62784844-aa89-4715-a3e2-6346c45e0cdb" status: 200 len: 1273 microversion: 2.1 time: 0.280569 Sep 08 10:54:22.203217 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1814/3627] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:21 2022] GET /compute/v2.1/servers/62784844-aa89-4715-a3e2-6346c45e0cdb => generated 1273 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:22.385498 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-adf83458-3a60-475b-9049-ee1a4da60335 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:22.387541 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-adf83458-3a60-475b-9049-ee1a4da60335 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: 93d05d86-99b6-43f0-83c7-257ab64a12f3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:22.418452 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-adf83458-3a60-475b-9049-ee1a4da60335 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:22.419962 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-adf83458-3a60-475b-9049-ee1a4da60335 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:22.423616 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-adf83458-3a60-475b-9049-ee1a4da60335 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:22.428114 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-adf83458-3a60-475b-9049-ee1a4da60335 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:22.431907 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-adf83458-3a60-475b-9049-ee1a4da60335 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:22.433310 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-adf83458-3a60-475b-9049-ee1a4da60335 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:22.969367 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8d5e20a3-8dda-48d9-8528-1e6aa6ada0af tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:22.998245 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8d5e20a3-8dda-48d9-8528-1e6aa6ada0af tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/a78d6e53-cc72-4cbd-95f5-e1f859062525" status: 200 len: 1510 microversion: 2.1 time: 1.982264 Sep 08 10:54:23.016926 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1814/3628] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:21 2022] GET /compute/v2.1/servers/a78d6e53-cc72-4cbd-95f5-e1f859062525 => generated 1510 bytes in 2000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:23.042604 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6ee222b1-41e2-4bd5-93d4-73c1fbfac6a3 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:23.045918 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6ee222b1-41e2-4bd5-93d4-73c1fbfac6a3 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] [instance: 50feb7c3-9282-44b6-ad37-bf09e2d3f5a8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:23.110960 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6ee222b1-41e2-4bd5-93d4-73c1fbfac6a3 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:23.115081 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6ee222b1-41e2-4bd5-93d4-73c1fbfac6a3 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:23.119287 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6ee222b1-41e2-4bd5-93d4-73c1fbfac6a3 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:23.121079 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6ee222b1-41e2-4bd5-93d4-73c1fbfac6a3 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:23.122133 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6ee222b1-41e2-4bd5-93d4-73c1fbfac6a3 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:23.123023 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6ee222b1-41e2-4bd5-93d4-73c1fbfac6a3 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:23.156614 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:54:23.239848 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-6ee222b1-41e2-4bd5-93d4-73c1fbfac6a3 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] HTTP exception thrown: Instance 50feb7c3-9282-44b6-ad37-bf09e2d3f5a8 could not be found. Sep 08 10:54:23.247569 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6ee222b1-41e2-4bd5-93d4-73c1fbfac6a3 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Request method failure captured: Sep 08 10:54:23.247569 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/50feb7c3-9282-44b6-ad37-bf09e2d3f5a8 HTTP/1.1 Sep 08 10:54:23.247569 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:54:23.247569 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:54:23.247569 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:54:23.247569 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:54:23.247569 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:54:23.247569 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:54:23.247569 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:54:23.247569 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:54:23.247569 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcl9oln5N_hWqWqJYDXk4M6MYiIrhCjnFRbncU28IJZlWuxi7DXNhG9UR93EHZZ0QBnqrj4DIOizLMKqZUTmRh6yOS1vV1KW35VBVQY1AxdKMMlN6TNkoulRHqvJcbQ5AGVOkQq9W4W3FaRTRTRZifilGnvaV6OaQniB_LveRuNkNLk Sep 08 10:54:23.247569 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:54:23.247569 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:54:23.247569 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:54:23.247569 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:54:23.247569 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:54:23.247569 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:54:23.247569 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 44bb5f5b56a2402999719f0374228ed3 Sep 08 10:54:23.247569 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1432818001 Sep 08 10:54:23.247569 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:54:23.247569 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:54:23.247569 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/44bb5f5b56a2402999719f0374228ed3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/44bb5f5b56a2402999719f0374228ed3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_44bb5f5b56a2402999719f0374228ed3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/44bb5f5b56a2402999719f0374228ed3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:54:23.247569 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1432818001 Sep 08 10:54:23.247569 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 44bb5f5b56a2402999719f0374228ed3 Sep 08 10:54:23.247569 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1432818001 Sep 08 10:54:23.247569 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-FloatingIPsAssociationTestJSON-1432818001-project Sep 08 10:54:23.247569 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:54:23.247569 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:54:23.247569 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: cb2c4b351a0a4ccabbfb5438b5c535e8 Sep 08 10:54:23.247569 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1432818001-project Sep 08 10:54:23.247569 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:54:23.247569 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 50feb7c3-9282-44b6-ad37-bf09e2d3f5a8 could not be found. Sep 08 10:54:23.247569 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '50feb7c3-9282-44b6-ad37-bf09e2d3f5a8'} Sep 08 10:54:23.247569 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:54:23.247569 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:23.247569 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:54:23.247569 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:54:23.247569 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:54:23.247569 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:54:23.247569 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:54:23.247569 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:54:23.247569 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:54:23.247569 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:54:23.247569 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50feb7c3-9282-44b6-ad37-bf09e2d3f5a8 could not be found. Sep 08 10:54:23.247569 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:23.247569 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:54:23.247569 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:23.247569 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:23.247569 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:54:23.247569 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:54:23.247569 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:54:23.247569 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:54:23.247569 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:54:23.247569 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:54:23.247569 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:54:23.247569 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:54:23.247569 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:54:23.247569 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:54:23.247569 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:54:23.247569 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:54:23.247569 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50feb7c3-9282-44b6-ad37-bf09e2d3f5a8 could not be found. Sep 08 10:54:23.247569 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:23.247569 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:54:23.257896 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:23.257896 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:23.257896 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:54:23.257896 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:54:23.257896 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:54:23.257896 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:54:23.257896 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50feb7c3-9282-44b6-ad37-bf09e2d3f5a8 could not be found. Sep 08 10:54:23.257896 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:23.261741 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6ee222b1-41e2-4bd5-93d4-73c1fbfac6a3 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] Returning 404 to user: Instance 50feb7c3-9282-44b6-ad37-bf09e2d3f5a8 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:54:23.265184 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6ee222b1-41e2-4bd5-93d4-73c1fbfac6a3 tempest-FloatingIPsAssociationTestJSON-1432818001 tempest-FloatingIPsAssociationTestJSON-1432818001-project] 10.222.0.27 "GET /compute/v2.1/servers/50feb7c3-9282-44b6-ad37-bf09e2d3f5a8" status: 404 len: 111 microversion: 2.1 time: 0.236772 Sep 08 10:54:23.266506 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1815/3629] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:23 2022] GET /compute/v2.1/servers/50feb7c3-9282-44b6-ad37-bf09e2d3f5a8 => generated 111 bytes in 251 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:54:23.278002 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-17a82c55-72fc-4b3b-9cbe-7c003fa8a79c tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:23.297873 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-17a82c55-72fc-4b3b-9cbe-7c003fa8a79c tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] [instance: 62784844-aa89-4715-a3e2-6346c45e0cdb] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:23.315931 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-17a82c55-72fc-4b3b-9cbe-7c003fa8a79c tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:23.316597 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-17a82c55-72fc-4b3b-9cbe-7c003fa8a79c tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:23.317361 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-17a82c55-72fc-4b3b-9cbe-7c003fa8a79c tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:23.318470 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-17a82c55-72fc-4b3b-9cbe-7c003fa8a79c tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:23.319059 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-17a82c55-72fc-4b3b-9cbe-7c003fa8a79c tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:23.319618 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-17a82c55-72fc-4b3b-9cbe-7c003fa8a79c tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:23.452717 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-adf83458-3a60-475b-9049-ee1a4da60335 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:23.467818 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-adf83458-3a60-475b-9049-ee1a4da60335 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3" status: 200 len: 1371 microversion: 2.1 time: 1.095731 Sep 08 10:54:23.472050 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-17a82c55-72fc-4b3b-9cbe-7c003fa8a79c tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1bec228c17647bba62ba7d57d28e4ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0958700fa94b42b2b6b47af40cf2f679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:23.492444 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1815/3630] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:22 2022] GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3 => generated 1371 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:54:23.494641 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-17a82c55-72fc-4b3b-9cbe-7c003fa8a79c tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "GET /compute/v2.1/servers/62784844-aa89-4715-a3e2-6346c45e0cdb" status: 200 len: 1273 microversion: 2.1 time: 0.226159 Sep 08 10:54:23.516356 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1816/3631] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:23 2022] GET /compute/v2.1/servers/62784844-aa89-4715-a3e2-6346c45e0cdb => generated 1273 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:23.569144 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-ddc2d854-5883-4400-9835-d5f63fbe7c7b req-7e681011-a78c-474a-9c56-ac0394b613d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a78d6e53-cc72-4cbd-95f5-e1f859062525", "name": "network-vif-deleted", "tag": "5411fa09-8b7d-4e0d-8a68-d1b0486fdbf7"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:54:23.588087 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-218fdd6b-21b5-49e6-ac99-bb54a6573096 req-82dfab7d-493d-42da-a67e-db265504a524 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93d05d86-99b6-43f0-83c7-257ab64a12f3", "tag": "b7d2eec4-5d46-4733-a430-f161034305f1"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:54:23.607820 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ddc2d854-5883-4400-9835-d5f63fbe7c7b req-7e681011-a78c-474a-9c56-ac0394b613d3 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:23.608394 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ddc2d854-5883-4400-9835-d5f63fbe7c7b req-7e681011-a78c-474a-9c56-ac0394b613d3 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:23.608891 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ddc2d854-5883-4400-9835-d5f63fbe7c7b req-7e681011-a78c-474a-9c56-ac0394b613d3 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:23.630808 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-218fdd6b-21b5-49e6-ac99-bb54a6573096 req-82dfab7d-493d-42da-a67e-db265504a524 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:23.631788 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-218fdd6b-21b5-49e6-ac99-bb54a6573096 req-82dfab7d-493d-42da-a67e-db265504a524 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:23.632253 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-218fdd6b-21b5-49e6-ac99-bb54a6573096 req-82dfab7d-493d-42da-a67e-db265504a524 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:23.648071 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-218fdd6b-21b5-49e6-ac99-bb54a6573096 req-82dfab7d-493d-42da-a67e-db265504a524 service nova] Creating event network-changed:b7d2eec4-5d46-4733-a430-f161034305f1 for instance 93d05d86-99b6-43f0-83c7-257ab64a12f3 on n-h2-850501-12 Sep 08 10:54:23.669057 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-ddc2d854-5883-4400-9835-d5f63fbe7c7b req-7e681011-a78c-474a-9c56-ac0394b613d3 service nova] Creating event network-vif-deleted:5411fa09-8b7d-4e0d-8a68-d1b0486fdbf7 for instance a78d6e53-cc72-4cbd-95f5-e1f859062525 on n-h1-850501-12 Sep 08 10:54:23.676670 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-ddc2d854-5883-4400-9835-d5f63fbe7c7b req-7e681011-a78c-474a-9c56-ac0394b613d3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112362 Sep 08 10:54:23.678444 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1816/3632] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:54:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:54:23.679554 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-218fdd6b-21b5-49e6-ac99-bb54a6573096 req-82dfab7d-493d-42da-a67e-db265504a524 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100381 Sep 08 10:54:23.680188 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1817/3633] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:54:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:54:24.057688 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1d2ed395-4a1b-4498-a7a6-a78ebc426704 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:24.062696 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1d2ed395-4a1b-4498-a7a6-a78ebc426704 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: a78d6e53-cc72-4cbd-95f5-e1f859062525] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:24.094488 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1d2ed395-4a1b-4498-a7a6-a78ebc426704 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:24.097580 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1d2ed395-4a1b-4498-a7a6-a78ebc426704 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:24.102094 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1d2ed395-4a1b-4498-a7a6-a78ebc426704 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:24.103058 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1d2ed395-4a1b-4498-a7a6-a78ebc426704 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:24.104136 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1d2ed395-4a1b-4498-a7a6-a78ebc426704 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:24.107579 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1d2ed395-4a1b-4498-a7a6-a78ebc426704 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:24.221597 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1d2ed395-4a1b-4498-a7a6-a78ebc426704 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:24.228310 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1d2ed395-4a1b-4498-a7a6-a78ebc426704 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:24.229382 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1d2ed395-4a1b-4498-a7a6-a78ebc426704 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:24.231254 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-1d2ed395-4a1b-4498-a7a6-a78ebc426704 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lazy-loading 'fault' on Instance uuid a78d6e53-cc72-4cbd-95f5-e1f859062525 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:54:24.481749 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1d2ed395-4a1b-4498-a7a6-a78ebc426704 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:24.501115 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1d2ed395-4a1b-4498-a7a6-a78ebc426704 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/a78d6e53-cc72-4cbd-95f5-e1f859062525" status: 200 len: 1305 microversion: 2.1 time: 0.462237 Sep 08 10:54:24.502534 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1817/3634] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:24 2022] GET /compute/v2.1/servers/a78d6e53-cc72-4cbd-95f5-e1f859062525 => generated 1305 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:24.526374 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-315dcc3e-3e6f-4b7b-93ed-260ac7dac53a tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:24.531447 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-315dcc3e-3e6f-4b7b-93ed-260ac7dac53a tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: 93d05d86-99b6-43f0-83c7-257ab64a12f3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:24.533351 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c42035c3-e04d-46b8-972a-fba1c181d0dd tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:24.534389 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c42035c3-e04d-46b8-972a-fba1c181d0dd tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] [instance: 62784844-aa89-4715-a3e2-6346c45e0cdb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:24.554855 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-315dcc3e-3e6f-4b7b-93ed-260ac7dac53a tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:24.556289 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c42035c3-e04d-46b8-972a-fba1c181d0dd tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:24.561979 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c42035c3-e04d-46b8-972a-fba1c181d0dd tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:24.562492 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c42035c3-e04d-46b8-972a-fba1c181d0dd tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:24.564867 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-315dcc3e-3e6f-4b7b-93ed-260ac7dac53a tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:24.565359 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-315dcc3e-3e6f-4b7b-93ed-260ac7dac53a tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:24.566186 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-315dcc3e-3e6f-4b7b-93ed-260ac7dac53a tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:24.566594 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-315dcc3e-3e6f-4b7b-93ed-260ac7dac53a tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:24.567188 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-315dcc3e-3e6f-4b7b-93ed-260ac7dac53a tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:24.568617 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c42035c3-e04d-46b8-972a-fba1c181d0dd tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:24.571534 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c42035c3-e04d-46b8-972a-fba1c181d0dd tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:24.574361 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c42035c3-e04d-46b8-972a-fba1c181d0dd tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:24.907382 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c42035c3-e04d-46b8-972a-fba1c181d0dd tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1bec228c17647bba62ba7d57d28e4ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0958700fa94b42b2b6b47af40cf2f679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:24.921685 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c42035c3-e04d-46b8-972a-fba1c181d0dd tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "GET /compute/v2.1/servers/62784844-aa89-4715-a3e2-6346c45e0cdb" status: 200 len: 1315 microversion: 2.1 time: 0.394962 Sep 08 10:54:24.923058 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1818/3635] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:24 2022] GET /compute/v2.1/servers/62784844-aa89-4715-a3e2-6346c45e0cdb => generated 1315 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:25.051545 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-315dcc3e-3e6f-4b7b-93ed-260ac7dac53a tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:25.060368 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-315dcc3e-3e6f-4b7b-93ed-260ac7dac53a tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3" status: 200 len: 1371 microversion: 2.1 time: 0.545715 Sep 08 10:54:25.066325 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1818/3636] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:24 2022] GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3 => generated 1371 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:25.527779 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fe0b2ea5-dd36-4278-bfc1-e4b10b7db401 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:25.528359 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fe0b2ea5-dd36-4278-bfc1-e4b10b7db401 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: a78d6e53-cc72-4cbd-95f5-e1f859062525] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:25.531618 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:54:25.555547 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fe0b2ea5-dd36-4278-bfc1-e4b10b7db401 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:25.561841 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fe0b2ea5-dd36-4278-bfc1-e4b10b7db401 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:25.563007 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fe0b2ea5-dd36-4278-bfc1-e4b10b7db401 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:25.564003 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fe0b2ea5-dd36-4278-bfc1-e4b10b7db401 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:25.564655 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fe0b2ea5-dd36-4278-bfc1-e4b10b7db401 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:25.565343 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fe0b2ea5-dd36-4278-bfc1-e4b10b7db401 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:25.581600 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=8 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:54:25.606075 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-fe0b2ea5-dd36-4278-bfc1-e4b10b7db401 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] HTTP exception thrown: Instance a78d6e53-cc72-4cbd-95f5-e1f859062525 could not be found. Sep 08 10:54:25.618496 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fe0b2ea5-dd36-4278-bfc1-e4b10b7db401 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Request method failure captured: Sep 08 10:54:25.618496 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/a78d6e53-cc72-4cbd-95f5-e1f859062525 HTTP/1.1 Sep 08 10:54:25.618496 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:54:25.618496 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:54:25.618496 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:54:25.618496 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:54:25.618496 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:54:25.618496 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:54:25.618496 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:54:25.618496 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:54:25.618496 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcmnspi0cCT_Ts_s7jcB6HjtEcdULbQPd_krJniB9lBsXpm1cXSOD-YMaJoaapHCxuCXz0q6Qe4WXufr5At6SSPw8ov8Oz1eUk-fSNbVp7WlOPycfCf5I6xwH7tfbsoefVfbTiDOfU9mTBl0Vs74qdfTniErHfQlEG4cAvAQl1-wMrs Sep 08 10:54:25.618496 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:54:25.618496 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:54:25.618496 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:54:25.618496 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:54:25.618496 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:54:25.618496 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:54:25.618496 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:54:25.618496 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:54:25.618496 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:54:25.618496 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:54:25.618496 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:54:25.618496 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:54:25.618496 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:54:25.618496 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:54:25.618496 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:54:25.618496 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:54:25.618496 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:54:25.618496 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 7f551e6fe34243c290a25b57ab26af19 Sep 08 10:54:25.618496 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:54:25.618496 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:54:25.618496 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance a78d6e53-cc72-4cbd-95f5-e1f859062525 could not be found. Sep 08 10:54:25.618496 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'a78d6e53-cc72-4cbd-95f5-e1f859062525'} Sep 08 10:54:25.618496 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:54:25.618496 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:25.618496 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:54:25.618496 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:54:25.618496 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:54:25.618496 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:54:25.618496 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:54:25.618496 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:54:25.618496 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:54:25.618496 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:54:25.618496 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a78d6e53-cc72-4cbd-95f5-e1f859062525 could not be found. Sep 08 10:54:25.618496 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:54:25.618496 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:54:25.618496 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:54:25.618496 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:25.618496 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:54:25.618496 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:54:25.618496 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:54:25.618496 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:54:25.618496 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:54:25.618496 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:54:25.618496 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:54:25.618496 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:54:25.618496 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:54:25.618496 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:54:25.618496 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:54:25.618496 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:54:25.618496 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a78d6e53-cc72-4cbd-95f5-e1f859062525 could not be found. Sep 08 10:54:25.618496 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:54:25.618496 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:54:25.618496 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:54:25.625458 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:25.625458 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:54:25.625458 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:54:25.625458 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:54:25.625458 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:54:25.625458 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a78d6e53-cc72-4cbd-95f5-e1f859062525 could not be found. Sep 08 10:54:25.625458 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:54:25.632033 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fe0b2ea5-dd36-4278-bfc1-e4b10b7db401 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Returning 404 to user: Instance a78d6e53-cc72-4cbd-95f5-e1f859062525 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:54:25.633645 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fe0b2ea5-dd36-4278-bfc1-e4b10b7db401 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/a78d6e53-cc72-4cbd-95f5-e1f859062525" status: 404 len: 111 microversion: 2.1 time: 0.110351 Sep 08 10:54:25.634938 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1819/3637] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:25 2022] GET /compute/v2.1/servers/a78d6e53-cc72-4cbd-95f5-e1f859062525 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:54:25.646948 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8e92f8ee-9240-49ca-8139-711fa1694c99 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:25.648240 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8e92f8ee-9240-49ca-8139-711fa1694c99 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:25.668335 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8e92f8ee-9240-49ca-8139-711fa1694c99 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:25.669555 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8e92f8ee-9240-49ca-8139-711fa1694c99 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:25.670217 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8e92f8ee-9240-49ca-8139-711fa1694c99 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:25.672033 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8e92f8ee-9240-49ca-8139-711fa1694c99 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:25.682018 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8e92f8ee-9240-49ca-8139-711fa1694c99 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:25.682808 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8e92f8ee-9240-49ca-8139-711fa1694c99 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:25.950297 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-30a53614-1f1c-4848-b3e9-c0d16871eb9b tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:25.951040 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-30a53614-1f1c-4848-b3e9-c0d16871eb9b tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] [instance: 62784844-aa89-4715-a3e2-6346c45e0cdb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:25.962432 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-30a53614-1f1c-4848-b3e9-c0d16871eb9b tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:25.962938 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-30a53614-1f1c-4848-b3e9-c0d16871eb9b tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:25.963426 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-30a53614-1f1c-4848-b3e9-c0d16871eb9b tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:25.967497 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-30a53614-1f1c-4848-b3e9-c0d16871eb9b tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:25.971321 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-30a53614-1f1c-4848-b3e9-c0d16871eb9b tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:25.971787 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-30a53614-1f1c-4848-b3e9-c0d16871eb9b tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:26.014170 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8e92f8ee-9240-49ca-8139-711fa1694c99 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:26.032354 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8e92f8ee-9240-49ca-8139-711fa1694c99 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 0.392760 Sep 08 10:54:26.035212 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1819/3638] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:25 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:26.085629 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-423b343c-1262-407c-bd33-bc7394b5c33f tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:26.086770 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-423b343c-1262-407c-bd33-bc7394b5c33f tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: 93d05d86-99b6-43f0-83c7-257ab64a12f3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:26.100400 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-423b343c-1262-407c-bd33-bc7394b5c33f tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:26.101574 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-423b343c-1262-407c-bd33-bc7394b5c33f tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:26.102271 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-423b343c-1262-407c-bd33-bc7394b5c33f tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:26.106050 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-423b343c-1262-407c-bd33-bc7394b5c33f tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:26.106979 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-423b343c-1262-407c-bd33-bc7394b5c33f tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:26.108714 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-423b343c-1262-407c-bd33-bc7394b5c33f tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:26.402430 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-423b343c-1262-407c-bd33-bc7394b5c33f tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:26.417601 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-423b343c-1262-407c-bd33-bc7394b5c33f tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3" status: 200 len: 1371 microversion: 2.1 time: 0.337317 Sep 08 10:54:26.418203 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1820/3639] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:26 2022] GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3 => generated 1371 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:26.425552 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0781498c-1598-4fbc-8073-972954718591 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "12aa0876-bb28-47d9-975a-2d76f1aa7c84"}]}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:54:26.430390 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0781498c-1598-4fbc-8073-972954718591 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Request method failure captured: Sep 08 10:54:26.430390 n-d-850501-12 devstack@n-api.service[128861]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 10:54:26.430390 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:54:26.430390 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:54:26.430390 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:54:26.430390 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 163 Sep 08 10:54:26.430390 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:54:26.430390 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:54:26.430390 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:54:26.430390 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:54:26.430390 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcmnspi0cCT_Ts_s7jcB6HjtEcdULbQPd_krJniB9lBsXpm1cXSOD-YMaJoaapHCxuCXz0q6Qe4WXufr5At6SSPw8ov8Oz1eUk-fSNbVp7WlOPycfCf5I6xwH7tfbsoefVfbTiDOfU9mTBl0Vs74qdfTniErHfQlEG4cAvAQl1-wMrs Sep 08 10:54:26.430390 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:54:26.430390 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:54:26.430390 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:54:26.430390 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:54:26.430390 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:54:26.430390 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:54:26.430390 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:54:26.430390 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:54:26.430390 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:54:26.430390 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:54:26.430390 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:54:26.430390 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:54:26.430390 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:54:26.430390 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:54:26.430390 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:54:26.430390 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:54:26.430390 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:54:26.430390 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 7f551e6fe34243c290a25b57ab26af19 Sep 08 10:54:26.430390 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:54:26.430390 n-d-850501-12 devstack@n-api.service[128861]: Sep 08 10:54:26.430390 n-d-850501-12 devstack@n-api.service[128861]: {"server": {"name": 12345, "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "12aa0876-bb28-47d9-975a-2d76f1aa7c84"}]}} Sep 08 10:54:26.430390 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:54:26.430390 n-d-850501-12 devstack@n-api.service[128861]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Sep 08 10:54:26.430390 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '503f4a0f-e18f-47fd-ad12-0289e3463117', 'flavorRef': '452', 'networks': [{'uuid': '12aa0876-bb28-47d9-975a-2d76f1aa7c84'}]}}} Sep 08 10:54:26.430390 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:54:26.430390 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:26.430390 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 10:54:26.430390 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 10:54:26.430390 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 10:54:26.430390 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise error Sep 08 10:54:26.430390 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Sep 08 10:54:26.430390 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:26.430390 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Sep 08 10:54:26.430390 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 08 10:54:26.430390 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:26.430390 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 08 10:54:26.430390 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi 12345 Sep 08 10:54:26.430390 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:26.430390 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:54:26.430390 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:26.430390 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:26.430390 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:54:26.430390 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:54:26.430390 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:54:26.430390 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:54:26.430390 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:54:26.430390 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:54:26.430390 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:54:26.430390 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:54:26.430390 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 10:54:26.430390 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 10:54:26.430390 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 10:54:26.430390 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 10:54:26.430390 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 10:54:26.435152 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 10:54:26.435152 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Sep 08 10:54:26.435152 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:26.435152 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:54:26.435152 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:26.435152 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:26.435152 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:54:26.435152 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:54:26.435152 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 10:54:26.435152 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 10:54:26.435152 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Sep 08 10:54:26.435152 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:26.436837 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0781498c-1598-4fbc-8073-972954718591 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:54:26.449337 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0781498c-1598-4fbc-8073-972954718591 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.016916 Sep 08 10:54:26.450245 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1821/3640] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:54:26 2022] POST /compute/v2.1/servers => generated 127 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:54:26.456794 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-b0b9dc34-04eb-45b6-8b88-ceea9107002f req-9ad41edc-72c2-44cd-82c4-cbdd73e9b21d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62784844-aa89-4715-a3e2-6346c45e0cdb", "tag": "b935b113-3fd8-4c56-8353-221839b04fcc"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:54:26.488794 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-b0b9dc34-04eb-45b6-8b88-ceea9107002f req-9ad41edc-72c2-44cd-82c4-cbdd73e9b21d service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:26.489328 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-b0b9dc34-04eb-45b6-8b88-ceea9107002f req-9ad41edc-72c2-44cd-82c4-cbdd73e9b21d service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:26.489764 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-b0b9dc34-04eb-45b6-8b88-ceea9107002f req-9ad41edc-72c2-44cd-82c4-cbdd73e9b21d service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:26.515282 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-b0b9dc34-04eb-45b6-8b88-ceea9107002f req-9ad41edc-72c2-44cd-82c4-cbdd73e9b21d service nova] Creating event network-changed:b935b113-3fd8-4c56-8353-221839b04fcc for instance 62784844-aa89-4715-a3e2-6346c45e0cdb on n-h2-850501-12 Sep 08 10:54:26.521851 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-b0b9dc34-04eb-45b6-8b88-ceea9107002f req-9ad41edc-72c2-44cd-82c4-cbdd73e9b21d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069578 Sep 08 10:54:26.522713 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1822/3641] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:54:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:54:26.528580 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f09d66df-e72a-43ec-9ae8-b032a1f65d3e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:26.529587 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f09d66df-e72a-43ec-9ae8-b032a1f65d3e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:26.536452 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f09d66df-e72a-43ec-9ae8-b032a1f65d3e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:26.537234 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f09d66df-e72a-43ec-9ae8-b032a1f65d3e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:26.537844 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f09d66df-e72a-43ec-9ae8-b032a1f65d3e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:26.538892 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f09d66df-e72a-43ec-9ae8-b032a1f65d3e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:26.539541 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f09d66df-e72a-43ec-9ae8-b032a1f65d3e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:26.540127 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f09d66df-e72a-43ec-9ae8-b032a1f65d3e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:26.559407 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-30a53614-1f1c-4848-b3e9-c0d16871eb9b tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1bec228c17647bba62ba7d57d28e4ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0958700fa94b42b2b6b47af40cf2f679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:26.584641 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-30a53614-1f1c-4848-b3e9-c0d16871eb9b tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "GET /compute/v2.1/servers/62784844-aa89-4715-a3e2-6346c45e0cdb" status: 200 len: 1315 microversion: 2.1 time: 0.635204 Sep 08 10:54:26.607544 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1820/3642] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:25 2022] GET /compute/v2.1/servers/62784844-aa89-4715-a3e2-6346c45e0cdb => generated 1315 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:54:27.026435 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-61f5cd10-906f-4633-930a-87069c1ba6f3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:27.027348 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-61f5cd10-906f-4633-930a-87069c1ba6f3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:27.041295 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-61f5cd10-906f-4633-930a-87069c1ba6f3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:27.043270 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-61f5cd10-906f-4633-930a-87069c1ba6f3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:27.048116 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-61f5cd10-906f-4633-930a-87069c1ba6f3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:27.048986 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-61f5cd10-906f-4633-930a-87069c1ba6f3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:27.049512 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-61f5cd10-906f-4633-930a-87069c1ba6f3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:27.058693 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f09d66df-e72a-43ec-9ae8-b032a1f65d3e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:27.068051 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-61f5cd10-906f-4633-930a-87069c1ba6f3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:27.071185 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f09d66df-e72a-43ec-9ae8-b032a1f65d3e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 0.546446 Sep 08 10:54:27.076201 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1823/3643] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:26 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:27.101008 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-77fc8274-0641-4140-8b95-e98f906fca80 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:27.101645 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-77fc8274-0641-4140-8b95-e98f906fca80 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:27.122615 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-77fc8274-0641-4140-8b95-e98f906fca80 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:27.123123 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-77fc8274-0641-4140-8b95-e98f906fca80 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:27.123565 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-77fc8274-0641-4140-8b95-e98f906fca80 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:27.124599 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-77fc8274-0641-4140-8b95-e98f906fca80 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:27.125086 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-77fc8274-0641-4140-8b95-e98f906fca80 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:27.127007 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-77fc8274-0641-4140-8b95-e98f906fca80 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:27.420978 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-61f5cd10-906f-4633-930a-87069c1ba6f3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:27.443058 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-61f5cd10-906f-4633-930a-87069c1ba6f3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1671 microversion: 2.1 time: 0.417264 Sep 08 10:54:27.446456 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1821/3644] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:27 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1671 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:27.464521 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-41a9aefe-3d79-4f54-9155-f451ea42cf23 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:27.466620 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-41a9aefe-3d79-4f54-9155-f451ea42cf23 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: 93d05d86-99b6-43f0-83c7-257ab64a12f3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:27.480736 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-77fc8274-0641-4140-8b95-e98f906fca80 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:27.489977 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-41a9aefe-3d79-4f54-9155-f451ea42cf23 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:27.491516 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-41a9aefe-3d79-4f54-9155-f451ea42cf23 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:27.493720 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-77fc8274-0641-4140-8b95-e98f906fca80 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 0.396792 Sep 08 10:54:27.494397 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-41a9aefe-3d79-4f54-9155-f451ea42cf23 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:27.495294 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1824/3645] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:27 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:27.496680 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-41a9aefe-3d79-4f54-9155-f451ea42cf23 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:27.498731 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-41a9aefe-3d79-4f54-9155-f451ea42cf23 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:27.500122 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-41a9aefe-3d79-4f54-9155-f451ea42cf23 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:27.502850 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1b7805ce-e6ef-4e3b-957d-1084114d66fc tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1426506061"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:54:27.505331 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1b7805ce-e6ef-4e3b-957d-1084114d66fc tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:27.527792 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1b7805ce-e6ef-4e3b-957d-1084114d66fc tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:27.527792 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1b7805ce-e6ef-4e3b-957d-1084114d66fc tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:27.528188 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1b7805ce-e6ef-4e3b-957d-1084114d66fc tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:27.528780 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1b7805ce-e6ef-4e3b-957d-1084114d66fc tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:27.529265 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1b7805ce-e6ef-4e3b-957d-1084114d66fc tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:27.530630 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1b7805ce-e6ef-4e3b-957d-1084114d66fc tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:27.779300 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-41a9aefe-3d79-4f54-9155-f451ea42cf23 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:27.808370 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-41a9aefe-3d79-4f54-9155-f451ea42cf23 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3" status: 200 len: 1371 microversion: 2.1 time: 0.357217 Sep 08 10:54:27.811471 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1822/3646] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:27 2022] GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3 => generated 1371 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:27.838297 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ee1b217b-7eeb-4860-b4e4-5fe0819e276f tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:27.845283 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ee1b217b-7eeb-4860-b4e4-5fe0819e276f tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] [instance: 62784844-aa89-4715-a3e2-6346c45e0cdb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:27.883687 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ee1b217b-7eeb-4860-b4e4-5fe0819e276f tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:27.884517 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ee1b217b-7eeb-4860-b4e4-5fe0819e276f tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:27.893353 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ee1b217b-7eeb-4860-b4e4-5fe0819e276f tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:27.894069 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ee1b217b-7eeb-4860-b4e4-5fe0819e276f tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:27.894571 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ee1b217b-7eeb-4860-b4e4-5fe0819e276f tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:27.895581 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ee1b217b-7eeb-4860-b4e4-5fe0819e276f tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:27.955195 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1b7805ce-e6ef-4e3b-957d-1084114d66fc tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "POST /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7/action" status: 202 len: 0 microversion: 2.1 time: 0.457843 Sep 08 10:54:27.960913 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1825/3647] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:54:27 2022] POST /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7/action => generated 0 bytes in 460 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Sep 08 10:54:27.979535 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9793d526-5f3e-49f6-a572-815c917750fe tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:27.980983 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9793d526-5f3e-49f6-a572-815c917750fe tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:27.998407 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9793d526-5f3e-49f6-a572-815c917750fe tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:27.998921 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9793d526-5f3e-49f6-a572-815c917750fe tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:27.999374 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9793d526-5f3e-49f6-a572-815c917750fe tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:28.002472 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9793d526-5f3e-49f6-a572-815c917750fe tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:28.003470 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9793d526-5f3e-49f6-a572-815c917750fe tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:28.003951 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9793d526-5f3e-49f6-a572-815c917750fe tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:28.164419 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ee1b217b-7eeb-4860-b4e4-5fe0819e276f tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1bec228c17647bba62ba7d57d28e4ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0958700fa94b42b2b6b47af40cf2f679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:28.167902 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:54:28.176532 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ee1b217b-7eeb-4860-b4e4-5fe0819e276f tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "GET /compute/v2.1/servers/62784844-aa89-4715-a3e2-6346c45e0cdb" status: 200 len: 1315 microversion: 2.1 time: 0.357560 Sep 08 10:54:28.177934 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1823/3648] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:27 2022] GET /compute/v2.1/servers/62784844-aa89-4715-a3e2-6346c45e0cdb => generated 1315 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:28.328314 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9793d526-5f3e-49f6-a572-815c917750fe tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:28.339310 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9793d526-5f3e-49f6-a572-815c917750fe tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1681 microversion: 2.1 time: 0.368517 Sep 08 10:54:28.340202 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1826/3649] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:27 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1681 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:28.865612 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4250760e-b331-48ba-8502-54eb43402c04 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:28.866873 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4250760e-b331-48ba-8502-54eb43402c04 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: 93d05d86-99b6-43f0-83c7-257ab64a12f3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:28.886943 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4250760e-b331-48ba-8502-54eb43402c04 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:28.888406 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4250760e-b331-48ba-8502-54eb43402c04 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:28.889615 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4250760e-b331-48ba-8502-54eb43402c04 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:28.891437 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4250760e-b331-48ba-8502-54eb43402c04 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:28.893573 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4250760e-b331-48ba-8502-54eb43402c04 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:28.895962 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4250760e-b331-48ba-8502-54eb43402c04 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:29.190686 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4250760e-b331-48ba-8502-54eb43402c04 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:29.206526 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-81d39cb2-b3a5-4724-9317-e65178eb6c39 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:29.208274 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-81d39cb2-b3a5-4724-9317-e65178eb6c39 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] [instance: 62784844-aa89-4715-a3e2-6346c45e0cdb] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:29.210653 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4250760e-b331-48ba-8502-54eb43402c04 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3" status: 200 len: 1371 microversion: 2.1 time: 0.355070 Sep 08 10:54:29.221664 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1824/3650] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:28 2022] GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3 => generated 1371 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:29.224587 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:54:29.250662 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-81d39cb2-b3a5-4724-9317-e65178eb6c39 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:29.251443 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-81d39cb2-b3a5-4724-9317-e65178eb6c39 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:29.252060 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-81d39cb2-b3a5-4724-9317-e65178eb6c39 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:29.252966 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-81d39cb2-b3a5-4724-9317-e65178eb6c39 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:29.253662 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-81d39cb2-b3a5-4724-9317-e65178eb6c39 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:29.255638 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-81d39cb2-b3a5-4724-9317-e65178eb6c39 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:29.381243 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8a08e15f-a856-4359-add6-4cc5e201a389 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:29.382042 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8a08e15f-a856-4359-add6-4cc5e201a389 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:29.389288 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8a08e15f-a856-4359-add6-4cc5e201a389 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:29.390243 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8a08e15f-a856-4359-add6-4cc5e201a389 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:29.390891 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8a08e15f-a856-4359-add6-4cc5e201a389 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:29.391828 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8a08e15f-a856-4359-add6-4cc5e201a389 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:29.392487 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8a08e15f-a856-4359-add6-4cc5e201a389 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:29.393146 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8a08e15f-a856-4359-add6-4cc5e201a389 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:29.608587 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8a08e15f-a856-4359-add6-4cc5e201a389 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:29.619065 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8a08e15f-a856-4359-add6-4cc5e201a389 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1681 microversion: 2.1 time: 0.243534 Sep 08 10:54:29.620123 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1825/3651] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:29 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1681 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:54:29.900983 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-81d39cb2-b3a5-4724-9317-e65178eb6c39 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1bec228c17647bba62ba7d57d28e4ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0958700fa94b42b2b6b47af40cf2f679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:29.912423 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-81d39cb2-b3a5-4724-9317-e65178eb6c39 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "GET /compute/v2.1/servers/62784844-aa89-4715-a3e2-6346c45e0cdb" status: 200 len: 1315 microversion: 2.1 time: 0.713033 Sep 08 10:54:29.916977 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1827/3652] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:29 2022] GET /compute/v2.1/servers/62784844-aa89-4715-a3e2-6346c45e0cdb => generated 1315 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:30.252229 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9b9b5621-e8d3-4bc8-a3f5-7d49255686ea tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:30.256012 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9b9b5621-e8d3-4bc8-a3f5-7d49255686ea tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: 93d05d86-99b6-43f0-83c7-257ab64a12f3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:30.267249 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9b9b5621-e8d3-4bc8-a3f5-7d49255686ea tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:30.268458 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9b9b5621-e8d3-4bc8-a3f5-7d49255686ea tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:30.269207 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9b9b5621-e8d3-4bc8-a3f5-7d49255686ea tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:30.271177 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9b9b5621-e8d3-4bc8-a3f5-7d49255686ea tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:30.272166 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9b9b5621-e8d3-4bc8-a3f5-7d49255686ea tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:30.272793 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9b9b5621-e8d3-4bc8-a3f5-7d49255686ea tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:30.459987 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9b9b5621-e8d3-4bc8-a3f5-7d49255686ea tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:30.485058 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9b9b5621-e8d3-4bc8-a3f5-7d49255686ea tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3" status: 200 len: 1371 microversion: 2.1 time: 0.229768 Sep 08 10:54:30.485058 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1826/3653] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:30 2022] GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3 => generated 1371 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:30.651504 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fdbee766-31a7-476a-8bb1-5054367430d1 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:30.653156 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fdbee766-31a7-476a-8bb1-5054367430d1 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:30.664531 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fdbee766-31a7-476a-8bb1-5054367430d1 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:30.666115 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fdbee766-31a7-476a-8bb1-5054367430d1 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:30.666894 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fdbee766-31a7-476a-8bb1-5054367430d1 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:30.668961 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fdbee766-31a7-476a-8bb1-5054367430d1 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:30.670364 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fdbee766-31a7-476a-8bb1-5054367430d1 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:30.671157 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fdbee766-31a7-476a-8bb1-5054367430d1 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:30.712937 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f8caf99c-4086-435e-80bf-9ab344767586 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1304517643", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "5c68a234-4e16-40ca-9b73-ea4c588ac1c3", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "12aa0876-bb28-47d9-975a-2d76f1aa7c84"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:54:30.795660 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-f8caf99c-4086-435e-80bf-9ab344767586 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] HTTP exception thrown: Block Device 5c68a234-4e16-40ca-9b73-ea4c588ac1c3 is not bootable. Sep 08 10:54:30.806122 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f8caf99c-4086-435e-80bf-9ab344767586 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Request method failure captured: Sep 08 10:54:30.806122 n-d-850501-12 devstack@n-api.service[128862]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 10:54:30.806122 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:54:30.806122 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:54:30.806122 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:54:30.806122 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 358 Sep 08 10:54:30.806122 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:54:30.806122 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:54:30.806122 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:54:30.806122 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:54:30.806122 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcmnspi0cCT_Ts_s7jcB6HjtEcdULbQPd_krJniB9lBsXpm1cXSOD-YMaJoaapHCxuCXz0q6Qe4WXufr5At6SSPw8ov8Oz1eUk-fSNbVp7WlOPycfCf5I6xwH7tfbsoefVfbTiDOfU9mTBl0Vs74qdfTniErHfQlEG4cAvAQl1-wMrs Sep 08 10:54:30.806122 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:54:30.806122 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:54:30.806122 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:54:30.806122 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:54:30.806122 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:54:30.806122 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:54:30.806122 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:54:30.806122 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:54:30.806122 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:54:30.806122 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:54:30.806122 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:54:30.806122 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:54:30.806122 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:54:30.806122 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:54:30.806122 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:54:30.806122 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:54:30.806122 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:54:30.806122 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 7f551e6fe34243c290a25b57ab26af19 Sep 08 10:54:30.806122 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:54:30.806122 n-d-850501-12 devstack@n-api.service[128862]: Sep 08 10:54:30.806122 n-d-850501-12 devstack@n-api.service[128862]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1304517643", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "5c68a234-4e16-40ca-9b73-ea4c588ac1c3", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "12aa0876-bb28-47d9-975a-2d76f1aa7c84"}]}} Sep 08 10:54:30.806122 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:54:30.806122 n-d-850501-12 devstack@n-api.service[128862]: exception: Block Device 5c68a234-4e16-40ca-9b73-ea4c588ac1c3 is not bootable. Sep 08 10:54:30.806122 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1304517643', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '5c68a234-4e16-40ca-9b73-ea4c588ac1c3'}], 'networks': [{'uuid': '12aa0876-bb28-47d9-975a-2d76f1aa7c84'}]}}} Sep 08 10:54:30.806122 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:54:30.806122 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:30.806122 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 08 10:54:30.806122 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 08 10:54:30.806122 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 08 10:54:30.806122 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 08 10:54:30.806122 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Sep 08 10:54:30.806122 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Sep 08 10:54:30.806122 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Sep 08 10:54:30.806122 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Sep 08 10:54:30.806122 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 5c68a234-4e16-40ca-9b73-ea4c588ac1c3 is not bootable. Sep 08 10:54:30.806122 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:54:30.806122 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:54:30.806122 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:54:30.806122 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:30.806122 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:54:30.806122 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:54:30.806122 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:54:30.806122 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:54:30.806122 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:54:30.806122 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:54:30.806122 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:54:30.806122 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:54:30.806122 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:54:30.811906 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:54:30.811906 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:54:30.811906 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:54:30.811906 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 08 10:54:30.811906 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 08 10:54:30.811906 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 08 10:54:30.811906 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 5c68a234-4e16-40ca-9b73-ea4c588ac1c3 is not bootable. Sep 08 10:54:30.811906 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:54:30.811906 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:54:30.811906 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:54:30.811906 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:30.811906 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:54:30.811906 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:54:30.811906 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:54:30.811906 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:54:30.811906 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 5c68a234-4e16-40ca-9b73-ea4c588ac1c3 is not bootable. Sep 08 10:54:30.811906 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:54:30.814399 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f8caf99c-4086-435e-80bf-9ab344767586 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Returning 400 to user: Block Device 5c68a234-4e16-40ca-9b73-ea4c588ac1c3 is not bootable. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:54:30.814553 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f8caf99c-4086-435e-80bf-9ab344767586 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.107787 Sep 08 10:54:30.815886 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1827/3654] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:54:30 2022] POST /compute/v2.1/servers => generated 110 bytes in 110 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:54:30.824514 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d2cb6626-5131-4733-9f01-cd412ed571f7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:30.825249 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d2cb6626-5131-4733-9f01-cd412ed571f7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:30.834014 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2cb6626-5131-4733-9f01-cd412ed571f7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:30.834803 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2cb6626-5131-4733-9f01-cd412ed571f7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:30.836463 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2cb6626-5131-4733-9f01-cd412ed571f7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:30.836847 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2cb6626-5131-4733-9f01-cd412ed571f7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:30.837568 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2cb6626-5131-4733-9f01-cd412ed571f7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:30.838010 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2cb6626-5131-4733-9f01-cd412ed571f7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:30.920229 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-fdbee766-31a7-476a-8bb1-5054367430d1 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:30.936777 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fdbee766-31a7-476a-8bb1-5054367430d1 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1689 microversion: 2.1 time: 0.294238 Sep 08 10:54:30.949062 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1828/3655] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:30 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1689 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:30.949062 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-093b05a6-b557-4a29-884c-1a20d777907d req-b7d78cde-488e-4417-a368-5b51f74bd928 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93d05d86-99b6-43f0-83c7-257ab64a12f3", "name": "network-vif-plugged", "status": "completed", "tag": "b7d2eec4-5d46-4733-a430-f161034305f1"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:54:30.955245 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-093b05a6-b557-4a29-884c-1a20d777907d req-b7d78cde-488e-4417-a368-5b51f74bd928 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:30.956117 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-093b05a6-b557-4a29-884c-1a20d777907d req-b7d78cde-488e-4417-a368-5b51f74bd928 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:30.957190 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-093b05a6-b557-4a29-884c-1a20d777907d req-b7d78cde-488e-4417-a368-5b51f74bd928 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:30.972819 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-093b05a6-b557-4a29-884c-1a20d777907d req-b7d78cde-488e-4417-a368-5b51f74bd928 service nova] Creating event network-vif-plugged:b7d2eec4-5d46-4733-a430-f161034305f1 for instance 93d05d86-99b6-43f0-83c7-257ab64a12f3 on n-h2-850501-12 Sep 08 10:54:30.980586 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-093b05a6-b557-4a29-884c-1a20d777907d req-b7d78cde-488e-4417-a368-5b51f74bd928 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041376 Sep 08 10:54:30.981616 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1829/3656] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:54:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:54:30.987207 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5cba1cf9-9758-4f81-9695-74f1144feff1 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:30.988190 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5cba1cf9-9758-4f81-9695-74f1144feff1 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] [instance: 62784844-aa89-4715-a3e2-6346c45e0cdb] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:31.007393 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5cba1cf9-9758-4f81-9695-74f1144feff1 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:31.008446 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5cba1cf9-9758-4f81-9695-74f1144feff1 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:31.008886 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5cba1cf9-9758-4f81-9695-74f1144feff1 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:31.012729 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5cba1cf9-9758-4f81-9695-74f1144feff1 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:31.013523 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5cba1cf9-9758-4f81-9695-74f1144feff1 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:31.014925 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5cba1cf9-9758-4f81-9695-74f1144feff1 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:31.156738 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d2cb6626-5131-4733-9f01-cd412ed571f7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:31.166179 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d2cb6626-5131-4733-9f01-cd412ed571f7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 0.345567 Sep 08 10:54:31.191720 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1828/3657] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:30 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:31.200968 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-38da6da4-818f-4615-8b09-59c6fb1534fb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:31.202070 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-38da6da4-818f-4615-8b09-59c6fb1534fb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:31.214101 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38da6da4-818f-4615-8b09-59c6fb1534fb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:31.215010 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38da6da4-818f-4615-8b09-59c6fb1534fb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:31.216055 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38da6da4-818f-4615-8b09-59c6fb1534fb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:31.217630 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38da6da4-818f-4615-8b09-59c6fb1534fb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:31.218709 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38da6da4-818f-4615-8b09-59c6fb1534fb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:31.219446 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38da6da4-818f-4615-8b09-59c6fb1534fb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:31.404112 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5cba1cf9-9758-4f81-9695-74f1144feff1 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1bec228c17647bba62ba7d57d28e4ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0958700fa94b42b2b6b47af40cf2f679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:31.419015 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5cba1cf9-9758-4f81-9695-74f1144feff1 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "GET /compute/v2.1/servers/62784844-aa89-4715-a3e2-6346c45e0cdb" status: 200 len: 1315 microversion: 2.1 time: 0.435628 Sep 08 10:54:31.433330 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1830/3658] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:30 2022] GET /compute/v2.1/servers/62784844-aa89-4715-a3e2-6346c45e0cdb => generated 1315 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:31.477797 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-38da6da4-818f-4615-8b09-59c6fb1534fb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:31.486671 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-38da6da4-818f-4615-8b09-59c6fb1534fb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 0.292409 Sep 08 10:54:31.487576 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1829/3659] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:31 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:54:31.503628 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3c9d8603-e8c0-4ce4-936e-7f4dd8d0a279 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:31.504692 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3c9d8603-e8c0-4ce4-936e-7f4dd8d0a279 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: 93d05d86-99b6-43f0-83c7-257ab64a12f3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:31.511740 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3c9d8603-e8c0-4ce4-936e-7f4dd8d0a279 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:31.512725 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3c9d8603-e8c0-4ce4-936e-7f4dd8d0a279 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:31.512725 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3c9d8603-e8c0-4ce4-936e-7f4dd8d0a279 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:31.514155 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3c9d8603-e8c0-4ce4-936e-7f4dd8d0a279 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:31.514155 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3c9d8603-e8c0-4ce4-936e-7f4dd8d0a279 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:31.514487 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3c9d8603-e8c0-4ce4-936e-7f4dd8d0a279 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:31.772846 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-3c9d8603-e8c0-4ce4-936e-7f4dd8d0a279 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:31.787352 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3c9d8603-e8c0-4ce4-936e-7f4dd8d0a279 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3" status: 200 len: 1371 microversion: 2.1 time: 0.287188 Sep 08 10:54:31.806014 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1831/3660] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:31 2022] GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3 => generated 1371 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:31.965304 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7b310d75-9d9a-4040-ac77-9268396dd16e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:31.965782 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7b310d75-9d9a-4040-ac77-9268396dd16e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:31.976379 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7b310d75-9d9a-4040-ac77-9268396dd16e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:31.976890 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7b310d75-9d9a-4040-ac77-9268396dd16e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:31.977703 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7b310d75-9d9a-4040-ac77-9268396dd16e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:31.983812 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7b310d75-9d9a-4040-ac77-9268396dd16e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:31.991826 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7b310d75-9d9a-4040-ac77-9268396dd16e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:31.992331 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7b310d75-9d9a-4040-ac77-9268396dd16e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:32.254048 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7b310d75-9d9a-4040-ac77-9268396dd16e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:32.264416 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7b310d75-9d9a-4040-ac77-9268396dd16e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1689 microversion: 2.1 time: 0.303548 Sep 08 10:54:32.266506 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1830/3661] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:31 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1689 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:32.454571 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0b735942-2e4a-4a78-97f8-7598f339649b tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:32.456030 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0b735942-2e4a-4a78-97f8-7598f339649b tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] [instance: 62784844-aa89-4715-a3e2-6346c45e0cdb] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:32.463432 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0b735942-2e4a-4a78-97f8-7598f339649b tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:32.464599 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0b735942-2e4a-4a78-97f8-7598f339649b tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:32.465288 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0b735942-2e4a-4a78-97f8-7598f339649b tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:32.466161 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0b735942-2e4a-4a78-97f8-7598f339649b tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:32.466964 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0b735942-2e4a-4a78-97f8-7598f339649b tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:32.467394 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0b735942-2e4a-4a78-97f8-7598f339649b tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:32.672106 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0b735942-2e4a-4a78-97f8-7598f339649b tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1bec228c17647bba62ba7d57d28e4ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0958700fa94b42b2b6b47af40cf2f679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:32.683668 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0b735942-2e4a-4a78-97f8-7598f339649b tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "GET /compute/v2.1/servers/62784844-aa89-4715-a3e2-6346c45e0cdb" status: 200 len: 1315 microversion: 2.1 time: 0.233145 Sep 08 10:54:32.685173 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1832/3662] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:32 2022] GET /compute/v2.1/servers/62784844-aa89-4715-a3e2-6346c45e0cdb => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:32.847265 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ced89359-67d9-47b4-938e-5d725a0f88a4 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:32.848982 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ced89359-67d9-47b4-938e-5d725a0f88a4 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: 93d05d86-99b6-43f0-83c7-257ab64a12f3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:32.859955 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:54:32.869300 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ced89359-67d9-47b4-938e-5d725a0f88a4 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:32.870576 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ced89359-67d9-47b4-938e-5d725a0f88a4 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:32.874683 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ced89359-67d9-47b4-938e-5d725a0f88a4 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:32.875562 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ced89359-67d9-47b4-938e-5d725a0f88a4 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:32.876055 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ced89359-67d9-47b4-938e-5d725a0f88a4 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:32.876510 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ced89359-67d9-47b4-938e-5d725a0f88a4 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:33.047409 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-dd64315b-118b-4f02-9a8b-d703662358bb req-f51fe599-115c-4be1-b458-5c13b0805106 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e81e0acc-0b96-4dbc-a5bb-89183f5204e7", "name": "network-vif-unplugged", "status": "completed", "tag": "ff9d981d-5db2-425c-b066-f87540f6e91c"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:54:33.073962 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-dd64315b-118b-4f02-9a8b-d703662358bb req-f51fe599-115c-4be1-b458-5c13b0805106 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:33.074954 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-dd64315b-118b-4f02-9a8b-d703662358bb req-f51fe599-115c-4be1-b458-5c13b0805106 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:33.075693 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-dd64315b-118b-4f02-9a8b-d703662358bb req-f51fe599-115c-4be1-b458-5c13b0805106 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:33.120432 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-dd64315b-118b-4f02-9a8b-d703662358bb req-f51fe599-115c-4be1-b458-5c13b0805106 service nova] Creating event network-vif-unplugged:ff9d981d-5db2-425c-b066-f87540f6e91c for instance e81e0acc-0b96-4dbc-a5bb-89183f5204e7 on n-h1-850501-12 Sep 08 10:54:33.140217 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-dd64315b-118b-4f02-9a8b-d703662358bb req-f51fe599-115c-4be1-b458-5c13b0805106 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096987 Sep 08 10:54:33.146400 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1833/3663] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:54:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:54:33.256364 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ced89359-67d9-47b4-938e-5d725a0f88a4 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:33.266702 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ced89359-67d9-47b4-938e-5d725a0f88a4 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3" status: 200 len: 1565 microversion: 2.1 time: 0.426934 Sep 08 10:54:33.267285 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1831/3664] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:32 2022] GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3 => generated 1565 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:33.295799 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0863d4b0-d60c-4fcb-be06-b8f28ac18781 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:33.296379 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b63db013-cd27-419b-bdbb-a2da380bd4eb tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:33.297184 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b63db013-cd27-419b-bdbb-a2da380bd4eb tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: 93d05d86-99b6-43f0-83c7-257ab64a12f3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:33.300284 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0863d4b0-d60c-4fcb-be06-b8f28ac18781 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:33.312942 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b63db013-cd27-419b-bdbb-a2da380bd4eb tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:33.315682 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b63db013-cd27-419b-bdbb-a2da380bd4eb tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:33.316460 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b63db013-cd27-419b-bdbb-a2da380bd4eb tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:33.317131 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0863d4b0-d60c-4fcb-be06-b8f28ac18781 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:33.318345 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b63db013-cd27-419b-bdbb-a2da380bd4eb tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:33.319119 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0863d4b0-d60c-4fcb-be06-b8f28ac18781 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:33.320252 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b63db013-cd27-419b-bdbb-a2da380bd4eb tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:33.320711 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0863d4b0-d60c-4fcb-be06-b8f28ac18781 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:33.321613 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b63db013-cd27-419b-bdbb-a2da380bd4eb tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:33.322539 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0863d4b0-d60c-4fcb-be06-b8f28ac18781 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:33.327359 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0863d4b0-d60c-4fcb-be06-b8f28ac18781 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:33.327932 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0863d4b0-d60c-4fcb-be06-b8f28ac18781 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:33.457471 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b63db013-cd27-419b-bdbb-a2da380bd4eb tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.168303 Sep 08 10:54:33.458936 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1832/3665] 10.222.0.27 () {58 vars in 1275 bytes} [Thu Sep 8 10:54:33 2022] GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3/os-interface => generated 284 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:54:33.676779 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0863d4b0-d60c-4fcb-be06-b8f28ac18781 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:33.682275 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:54:33.706143 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0863d4b0-d60c-4fcb-be06-b8f28ac18781 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1684 microversion: 2.1 time: 0.421474 Sep 08 10:54:33.709763 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1834/3666] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:33 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1684 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:54:33.713412 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e1045092-c417-4c55-8189-c860c6cd12dd tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:33.714940 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e1045092-c417-4c55-8189-c860c6cd12dd tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] [instance: 62784844-aa89-4715-a3e2-6346c45e0cdb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:33.724394 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e1045092-c417-4c55-8189-c860c6cd12dd tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:33.725654 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e1045092-c417-4c55-8189-c860c6cd12dd tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:33.726495 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e1045092-c417-4c55-8189-c860c6cd12dd tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:33.727406 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e1045092-c417-4c55-8189-c860c6cd12dd tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:33.727964 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e1045092-c417-4c55-8189-c860c6cd12dd tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:33.728549 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e1045092-c417-4c55-8189-c860c6cd12dd tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:33.835909 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a557b696-0ae2-4ca7-adab-422b65fc85d4 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:33.836785 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a557b696-0ae2-4ca7-adab-422b65fc85d4 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: 19604289-6d42-403f-bf74-75335e1782cb] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:33.843303 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a557b696-0ae2-4ca7-adab-422b65fc85d4 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:33.844207 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a557b696-0ae2-4ca7-adab-422b65fc85d4 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:33.844887 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a557b696-0ae2-4ca7-adab-422b65fc85d4 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:33.848604 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a557b696-0ae2-4ca7-adab-422b65fc85d4 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:33.849621 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a557b696-0ae2-4ca7-adab-422b65fc85d4 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:33.850340 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a557b696-0ae2-4ca7-adab-422b65fc85d4 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:34.048848 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-a557b696-0ae2-4ca7-adab-422b65fc85d4 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lazy-loading 'services' on Instance uuid 19604289-6d42-403f-bf74-75335e1782cb {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:54:34.093037 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e1045092-c417-4c55-8189-c860c6cd12dd tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1bec228c17647bba62ba7d57d28e4ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0958700fa94b42b2b6b47af40cf2f679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:34.108632 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e1045092-c417-4c55-8189-c860c6cd12dd tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "GET /compute/v2.1/servers/62784844-aa89-4715-a3e2-6346c45e0cdb" status: 200 len: 1315 microversion: 2.1 time: 0.400175 Sep 08 10:54:34.114011 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1833/3667] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:33 2022] GET /compute/v2.1/servers/62784844-aa89-4715-a3e2-6346c45e0cdb => generated 1315 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:54:34.391274 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-33b44631-5c12-45fa-895f-361d04507f5f tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1270524414", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "503f4a0f-e18f-47fd-ad12-0289e3463117", "destination_type": "local"}, {"source_type": "volume", "uuid": "a62af1b8-249b-43fd-9eb4-fe49a5966a1b", "destination_type": "invalid"}], "networks": [{"uuid": "12aa0876-bb28-47d9-975a-2d76f1aa7c84"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:54:34.396745 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-33b44631-5c12-45fa-895f-361d04507f5f tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Request method failure captured: Sep 08 10:54:34.396745 n-d-850501-12 devstack@n-api.service[128862]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 10:54:34.396745 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:54:34.396745 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:54:34.396745 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:54:34.396745 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 495 Sep 08 10:54:34.396745 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:54:34.396745 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:54:34.396745 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:54:34.396745 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:54:34.396745 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcmnspi0cCT_Ts_s7jcB6HjtEcdULbQPd_krJniB9lBsXpm1cXSOD-YMaJoaapHCxuCXz0q6Qe4WXufr5At6SSPw8ov8Oz1eUk-fSNbVp7WlOPycfCf5I6xwH7tfbsoefVfbTiDOfU9mTBl0Vs74qdfTniErHfQlEG4cAvAQl1-wMrs Sep 08 10:54:34.396745 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:54:34.396745 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:54:34.396745 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:54:34.396745 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:54:34.396745 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:54:34.396745 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:54:34.396745 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:54:34.396745 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:54:34.396745 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:54:34.396745 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:54:34.396745 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:54:34.396745 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:54:34.396745 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:54:34.396745 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:54:34.396745 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:54:34.396745 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:54:34.396745 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:54:34.396745 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 7f551e6fe34243c290a25b57ab26af19 Sep 08 10:54:34.396745 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:54:34.396745 n-d-850501-12 devstack@n-api.service[128862]: Sep 08 10:54:34.396745 n-d-850501-12 devstack@n-api.service[128862]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1270524414", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "503f4a0f-e18f-47fd-ad12-0289e3463117", "destination_type": "local"}, {"source_type": "volume", "uuid": "a62af1b8-249b-43fd-9eb4-fe49a5966a1b", "destination_type": "invalid"}], "networks": [{"uuid": "12aa0876-bb28-47d9-975a-2d76f1aa7c84"}]}} Sep 08 10:54:34.396745 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:54:34.396745 n-d-850501-12 devstack@n-api.service[128862]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Sep 08 10:54:34.396745 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1270524414', 'imageRef': '503f4a0f-e18f-47fd-ad12-0289e3463117', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '503f4a0f-e18f-47fd-ad12-0289e3463117', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'a62af1b8-249b-43fd-9eb4-fe49a5966a1b', 'destination_type': 'invalid'}], 'networks': [{'uuid': '12aa0876-bb28-47d9-975a-2d76f1aa7c84'}]}}} Sep 08 10:54:34.396745 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:54:34.396745 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:34.396745 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 10:54:34.396745 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 10:54:34.396745 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 10:54:34.396745 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise error Sep 08 10:54:34.396745 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Sep 08 10:54:34.396745 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:54:34.396745 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Sep 08 10:54:34.396745 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Sep 08 10:54:34.396745 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:54:34.396745 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Sep 08 10:54:34.396745 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'invalid' Sep 08 10:54:34.396745 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:54:34.396745 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:54:34.396745 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:54:34.396745 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:34.396745 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:54:34.396745 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:54:34.396745 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:54:34.396745 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:54:34.396745 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:54:34.404310 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:54:34.404310 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:54:34.404310 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:54:34.404310 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 10:54:34.404310 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 10:54:34.404310 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 10:54:34.404310 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 10:54:34.404310 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 10:54:34.404310 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 10:54:34.404310 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Sep 08 10:54:34.404310 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:54:34.404310 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:54:34.404310 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:54:34.404310 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:34.404310 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:54:34.404310 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:54:34.404310 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 10:54:34.404310 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 10:54:34.404310 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Sep 08 10:54:34.404310 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:54:34.404310 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-33b44631-5c12-45fa-895f-361d04507f5f tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:54:34.404310 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-33b44631-5c12-45fa-895f-361d04507f5f tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.011050 Sep 08 10:54:34.409519 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a557b696-0ae2-4ca7-adab-422b65fc85d4 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "DELETE /compute/v2.1/servers/19604289-6d42-403f-bf74-75335e1782cb/os-volume_attachments/4425dd95-e71e-413a-8436-785c4c78bdc7" status: 202 len: 0 microversion: 2.1 time: 0.572041 Sep 08 10:54:34.413460 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1835/3668] 10.222.0.27 () {58 vars in 1416 bytes} [Thu Sep 8 10:54:33 2022] DELETE /compute/v2.1/servers/19604289-6d42-403f-bf74-75335e1782cb/os-volume_attachments/4425dd95-e71e-413a-8436-785c4c78bdc7 => generated 0 bytes in 583 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 10:54:34.415029 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1834/3669] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:54:34 2022] POST /compute/v2.1/servers => generated 155 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:54:34.420947 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-47199e25-5b30-4783-8b72-d4ba1cd3bc6e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:34.421901 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-47199e25-5b30-4783-8b72-d4ba1cd3bc6e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:34.425244 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a6d92ad5-67e6-4266-90cb-89a6df893c02 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:34.431715 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a6d92ad5-67e6-4266-90cb-89a6df893c02 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: 19604289-6d42-403f-bf74-75335e1782cb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:34.436230 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-47199e25-5b30-4783-8b72-d4ba1cd3bc6e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:34.438928 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-47199e25-5b30-4783-8b72-d4ba1cd3bc6e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:34.439588 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-47199e25-5b30-4783-8b72-d4ba1cd3bc6e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:34.440327 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-47199e25-5b30-4783-8b72-d4ba1cd3bc6e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:34.446053 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-47199e25-5b30-4783-8b72-d4ba1cd3bc6e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:34.446909 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-47199e25-5b30-4783-8b72-d4ba1cd3bc6e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:34.454171 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a6d92ad5-67e6-4266-90cb-89a6df893c02 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:34.455390 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a6d92ad5-67e6-4266-90cb-89a6df893c02 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:34.457647 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a6d92ad5-67e6-4266-90cb-89a6df893c02 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:34.463158 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a6d92ad5-67e6-4266-90cb-89a6df893c02 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:34.464076 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a6d92ad5-67e6-4266-90cb-89a6df893c02 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:34.464731 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a6d92ad5-67e6-4266-90cb-89a6df893c02 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:34.546186 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a6d92ad5-67e6-4266-90cb-89a6df893c02 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/19604289-6d42-403f-bf74-75335e1782cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.129433 Sep 08 10:54:34.547209 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1835/3670] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 10:54:34 2022] GET /compute/v2.1/servers/19604289-6d42-403f-bf74-75335e1782cb/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:54:34.744642 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5d690786-35cb-4d3c-b797-968112d9c531 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:34.749898 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5d690786-35cb-4d3c-b797-968112d9c531 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:34.758425 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-47199e25-5b30-4783-8b72-d4ba1cd3bc6e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:34.772027 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5d690786-35cb-4d3c-b797-968112d9c531 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:34.772679 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5d690786-35cb-4d3c-b797-968112d9c531 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:34.773143 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5d690786-35cb-4d3c-b797-968112d9c531 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:34.775099 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5d690786-35cb-4d3c-b797-968112d9c531 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:34.776272 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5d690786-35cb-4d3c-b797-968112d9c531 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:34.776740 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5d690786-35cb-4d3c-b797-968112d9c531 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:34.789419 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-47199e25-5b30-4783-8b72-d4ba1cd3bc6e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 0.370592 Sep 08 10:54:34.790055 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1836/3671] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:34 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:34.829556 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3236c713-5151-4fcc-8131-c296bcc143b0 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:34.830462 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3236c713-5151-4fcc-8131-c296bcc143b0 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:34.838113 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3236c713-5151-4fcc-8131-c296bcc143b0 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:34.839296 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3236c713-5151-4fcc-8131-c296bcc143b0 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:34.840304 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3236c713-5151-4fcc-8131-c296bcc143b0 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:34.841720 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3236c713-5151-4fcc-8131-c296bcc143b0 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:34.842671 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3236c713-5151-4fcc-8131-c296bcc143b0 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:34.843544 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3236c713-5151-4fcc-8131-c296bcc143b0 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:35.146005 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-3236c713-5151-4fcc-8131-c296bcc143b0 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:35.158921 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3236c713-5151-4fcc-8131-c296bcc143b0 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 0.331487 Sep 08 10:54:35.173066 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1837/3672] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:34 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:54:35.173066 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-39e955ba-ea92-44a9-8003-cb193c6da807 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:35.173066 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-39e955ba-ea92-44a9-8003-cb193c6da807 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] [instance: 62784844-aa89-4715-a3e2-6346c45e0cdb] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:35.177121 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-39e955ba-ea92-44a9-8003-cb193c6da807 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:35.177121 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-39e955ba-ea92-44a9-8003-cb193c6da807 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:35.177121 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-39e955ba-ea92-44a9-8003-cb193c6da807 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:35.178269 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-39e955ba-ea92-44a9-8003-cb193c6da807 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:35.182050 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-39e955ba-ea92-44a9-8003-cb193c6da807 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:35.182050 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-39e955ba-ea92-44a9-8003-cb193c6da807 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:35.309444 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5d690786-35cb-4d3c-b797-968112d9c531 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:35.320081 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5d690786-35cb-4d3c-b797-968112d9c531 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1684 microversion: 2.1 time: 0.588288 Sep 08 10:54:35.320692 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1836/3673] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:34 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1684 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:35.336167 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-8df84c4a-33bd-4ccc-92ff-8f16579aed80 req-580a01cb-5601-4877-b018-154465a96ce1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62784844-aa89-4715-a3e2-6346c45e0cdb", "name": "network-vif-plugged", "status": "completed", "tag": "b935b113-3fd8-4c56-8353-221839b04fcc"}, {"server_uuid": "e81e0acc-0b96-4dbc-a5bb-89183f5204e7", "name": "network-vif-plugged", "status": "completed", "tag": "ff9d981d-5db2-425c-b066-f87540f6e91c"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:54:35.369404 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-8df84c4a-33bd-4ccc-92ff-8f16579aed80 req-580a01cb-5601-4877-b018-154465a96ce1 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:35.372333 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-8df84c4a-33bd-4ccc-92ff-8f16579aed80 req-580a01cb-5601-4877-b018-154465a96ce1 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:35.374630 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-8df84c4a-33bd-4ccc-92ff-8f16579aed80 req-580a01cb-5601-4877-b018-154465a96ce1 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:35.393858 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-39e955ba-ea92-44a9-8003-cb193c6da807 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1bec228c17647bba62ba7d57d28e4ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0958700fa94b42b2b6b47af40cf2f679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:35.413201 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-39e955ba-ea92-44a9-8003-cb193c6da807 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "GET /compute/v2.1/servers/62784844-aa89-4715-a3e2-6346c45e0cdb" status: 200 len: 1315 microversion: 2.1 time: 0.251239 Sep 08 10:54:35.424809 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1838/3674] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:35 2022] GET /compute/v2.1/servers/62784844-aa89-4715-a3e2-6346c45e0cdb => generated 1315 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:35.428209 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-8df84c4a-33bd-4ccc-92ff-8f16579aed80 req-580a01cb-5601-4877-b018-154465a96ce1 service nova] Creating event network-vif-plugged:b935b113-3fd8-4c56-8353-221839b04fcc for instance 62784844-aa89-4715-a3e2-6346c45e0cdb on n-h2-850501-12 Sep 08 10:54:35.442355 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-8df84c4a-33bd-4ccc-92ff-8f16579aed80 req-580a01cb-5601-4877-b018-154465a96ce1 service nova] Creating event network-vif-plugged:ff9d981d-5db2-425c-b066-f87540f6e91c for instance e81e0acc-0b96-4dbc-a5bb-89183f5204e7 on n-h1-850501-12 Sep 08 10:54:35.446462 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d7d23b2f-1acf-4207-88b5-99783af87845 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-813742389", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "12aa0876-bb28-47d9-975a-2d76f1aa7c84"}]}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:54:35.459212 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-8df84c4a-33bd-4ccc-92ff-8f16579aed80 req-580a01cb-5601-4877-b018-154465a96ce1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.137230 Sep 08 10:54:35.465777 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1837/3675] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:54:35 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:54:35.492869 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d7d23b2f-1acf-4207-88b5-99783af87845 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Request method failure captured: Sep 08 10:54:35.492869 n-d-850501-12 devstack@n-api.service[128861]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 10:54:35.492869 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:54:35.492869 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:54:35.492869 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:54:35.492869 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 491 Sep 08 10:54:35.492869 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:54:35.492869 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:54:35.492869 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:54:35.492869 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:54:35.492869 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcmnspi0cCT_Ts_s7jcB6HjtEcdULbQPd_krJniB9lBsXpm1cXSOD-YMaJoaapHCxuCXz0q6Qe4WXufr5At6SSPw8ov8Oz1eUk-fSNbVp7WlOPycfCf5I6xwH7tfbsoefVfbTiDOfU9mTBl0Vs74qdfTniErHfQlEG4cAvAQl1-wMrs Sep 08 10:54:35.492869 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:54:35.492869 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:54:35.492869 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:54:35.492869 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:54:35.492869 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:54:35.492869 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:54:35.492869 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:54:35.492869 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:54:35.492869 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:54:35.492869 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:54:35.492869 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:54:35.492869 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:54:35.492869 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:54:35.492869 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:54:35.492869 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:54:35.492869 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:54:35.492869 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:54:35.492869 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 7f551e6fe34243c290a25b57ab26af19 Sep 08 10:54:35.492869 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:54:35.492869 n-d-850501-12 devstack@n-api.service[128861]: Sep 08 10:54:35.492869 n-d-850501-12 devstack@n-api.service[128861]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-813742389", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "12aa0876-bb28-47d9-975a-2d76f1aa7c84"}]}} Sep 08 10:54:35.492869 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:54:35.492869 n-d-850501-12 devstack@n-api.service[128861]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 08 10:54:35.492869 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-813742389', 'imageRef': '503f4a0f-e18f-47fd-ad12-0289e3463117', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '12aa0876-bb28-47d9-975a-2d76f1aa7c84'}]}}} Sep 08 10:54:35.492869 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:54:35.492869 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:35.492869 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 10:54:35.492869 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 10:54:35.492869 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 10:54:35.492869 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise error Sep 08 10:54:35.492869 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 08 10:54:35.492869 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:35.492869 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Sep 08 10:54:35.492869 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Sep 08 10:54:35.492869 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:35.492869 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Sep 08 10:54:35.497319 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Sep 08 10:54:35.497319 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:35.497319 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:54:35.497319 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:35.497319 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:35.497319 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:54:35.497319 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:54:35.497319 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:54:35.497319 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:54:35.497319 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:54:35.497319 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:54:35.497319 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:54:35.497319 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:54:35.497319 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 10:54:35.497319 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 10:54:35.497319 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 10:54:35.497319 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 10:54:35.497319 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 10:54:35.497319 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 10:54:35.497319 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 08 10:54:35.497319 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:35.497319 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:54:35.497319 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:35.497319 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:35.497319 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:54:35.497319 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:54:35.497319 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 10:54:35.497319 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 10:54:35.497319 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 08 10:54:35.497319 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:35.497319 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d7d23b2f-1acf-4207-88b5-99783af87845 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:54:35.501373 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d7d23b2f-1acf-4207-88b5-99783af87845 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.071203 Sep 08 10:54:35.517608 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1839/3676] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:54:35 2022] POST /compute/v2.1/servers => generated 624 bytes in 90 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:54:35.529241 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a14199ac-6bbe-4177-8da9-5353dc950c8e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:35.530939 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a14199ac-6bbe-4177-8da9-5353dc950c8e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:35.540038 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a14199ac-6bbe-4177-8da9-5353dc950c8e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:35.540894 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a14199ac-6bbe-4177-8da9-5353dc950c8e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:35.541897 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a14199ac-6bbe-4177-8da9-5353dc950c8e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:35.542859 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a14199ac-6bbe-4177-8da9-5353dc950c8e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:35.543834 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a14199ac-6bbe-4177-8da9-5353dc950c8e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:35.545194 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a14199ac-6bbe-4177-8da9-5353dc950c8e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:35.588471 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-27aae598-f126-4c96-be12-f6f1dd6e6588 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:35.591619 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-27aae598-f126-4c96-be12-f6f1dd6e6588 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: 19604289-6d42-403f-bf74-75335e1782cb] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:35.603719 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-27aae598-f126-4c96-be12-f6f1dd6e6588 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:35.604553 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-27aae598-f126-4c96-be12-f6f1dd6e6588 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:35.606293 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-27aae598-f126-4c96-be12-f6f1dd6e6588 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:35.607292 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-27aae598-f126-4c96-be12-f6f1dd6e6588 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:35.608226 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-27aae598-f126-4c96-be12-f6f1dd6e6588 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:35.609432 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-27aae598-f126-4c96-be12-f6f1dd6e6588 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:35.704295 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-27aae598-f126-4c96-be12-f6f1dd6e6588 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/19604289-6d42-403f-bf74-75335e1782cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.146900 Sep 08 10:54:35.710499 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1840/3677] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 10:54:35 2022] GET /compute/v2.1/servers/19604289-6d42-403f-bf74-75335e1782cb/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:54:35.714174 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-20191768-6be4-49b1-81c2-87c655bf7591 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:35.721251 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-20191768-6be4-49b1-81c2-87c655bf7591 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'eb64d1e0aabf4889a5515e4f89d9db0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd99a7d947e4ee4808db30f234d2c0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:35.721934 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-20191768-6be4-49b1-81c2-87c655bf7591 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Searching by: {'deleted': False, 'project_id': '3bd99a7d947e4ee4808db30f234d2c0f'} {{(pid=128861) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:54:35.736014 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-20191768-6be4-49b1-81c2-87c655bf7591 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:35.737680 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-20191768-6be4-49b1-81c2-87c655bf7591 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:35.740184 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-20191768-6be4-49b1-81c2-87c655bf7591 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:35.741400 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-20191768-6be4-49b1-81c2-87c655bf7591 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:35.742064 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-20191768-6be4-49b1-81c2-87c655bf7591 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:35.743781 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-20191768-6be4-49b1-81c2-87c655bf7591 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:35.795224 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.multi_cell_list [None req-20191768-6be4-49b1-81c2-87c655bf7591 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128861) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 10:54:35.848274 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-20191768-6be4-49b1-81c2-87c655bf7591 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.137415 Sep 08 10:54:35.854728 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1841/3678] 10.222.0.27 () {58 vars in 1125 bytes} [Thu Sep 8 10:54:35 2022] GET /compute/v2.1/servers => generated 334 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:54:35.873765 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b4ca5fab-392a-4a5c-86aa-8d5c72408fe3 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:35.879600 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b4ca5fab-392a-4a5c-86aa-8d5c72408fe3 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'eb64d1e0aabf4889a5515e4f89d9db0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd99a7d947e4ee4808db30f234d2c0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:35.884924 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b4ca5fab-392a-4a5c-86aa-8d5c72408fe3 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Searching by: {'deleted': False, 'project_id': '3bd99a7d947e4ee4808db30f234d2c0f'} {{(pid=128861) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:54:35.918280 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b4ca5fab-392a-4a5c-86aa-8d5c72408fe3 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:35.924513 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b4ca5fab-392a-4a5c-86aa-8d5c72408fe3 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:35.928941 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b4ca5fab-392a-4a5c-86aa-8d5c72408fe3 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:35.930662 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b4ca5fab-392a-4a5c-86aa-8d5c72408fe3 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:35.931637 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b4ca5fab-392a-4a5c-86aa-8d5c72408fe3 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:35.939053 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b4ca5fab-392a-4a5c-86aa-8d5c72408fe3 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:36.002568 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.multi_cell_list [None req-b4ca5fab-392a-4a5c-86aa-8d5c72408fe3 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128861) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 10:54:36.111920 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b4ca5fab-392a-4a5c-86aa-8d5c72408fe3 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb64d1e0aabf4889a5515e4f89d9db0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd99a7d947e4ee4808db30f234d2c0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:36.128229 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b4ca5fab-392a-4a5c-86aa-8d5c72408fe3 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:36.130037 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b4ca5fab-392a-4a5c-86aa-8d5c72408fe3 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:36.132298 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b4ca5fab-392a-4a5c-86aa-8d5c72408fe3 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:36.575825 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a14199ac-6bbe-4177-8da9-5353dc950c8e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:36.577549 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b4ca5fab-392a-4a5c-86aa-8d5c72408fe3 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] 10.222.0.27 "GET /compute/v2.1/servers/detail" status: 200 len: 1699 microversion: 2.1 time: 0.708765 Sep 08 10:54:36.578444 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1842/3679] 10.222.0.27 () {58 vars in 1146 bytes} [Thu Sep 8 10:54:35 2022] GET /compute/v2.1/servers/detail => generated 1699 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:54:36.593679 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-906d8bf3-0545-4543-877a-0dff0e8ff3ce tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:36.594046 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a14199ac-6bbe-4177-8da9-5353dc950c8e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 1.085045 Sep 08 10:54:36.594774 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-906d8bf3-0545-4543-877a-0dff0e8ff3ce tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:36.598235 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1838/3680] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:35 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:36.612856 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-906d8bf3-0545-4543-877a-0dff0e8ff3ce tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:36.614347 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4b0be299-ddda-45ce-b02d-678f19075a27 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:36.615204 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4b0be299-ddda-45ce-b02d-678f19075a27 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] [instance: 62784844-aa89-4715-a3e2-6346c45e0cdb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:36.616629 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-906d8bf3-0545-4543-877a-0dff0e8ff3ce tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:36.617323 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-906d8bf3-0545-4543-877a-0dff0e8ff3ce tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:36.618450 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-906d8bf3-0545-4543-877a-0dff0e8ff3ce tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:36.626321 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4b0be299-ddda-45ce-b02d-678f19075a27 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:36.627308 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-906d8bf3-0545-4543-877a-0dff0e8ff3ce tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:36.627952 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-906d8bf3-0545-4543-877a-0dff0e8ff3ce tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:36.629763 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4b0be299-ddda-45ce-b02d-678f19075a27 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:36.630211 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4b0be299-ddda-45ce-b02d-678f19075a27 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:36.631172 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4b0be299-ddda-45ce-b02d-678f19075a27 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:36.634814 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4b0be299-ddda-45ce-b02d-678f19075a27 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:36.635500 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4b0be299-ddda-45ce-b02d-678f19075a27 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:36.901998 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4b0be299-ddda-45ce-b02d-678f19075a27 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1bec228c17647bba62ba7d57d28e4ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0958700fa94b42b2b6b47af40cf2f679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:36.916347 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4b0be299-ddda-45ce-b02d-678f19075a27 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "GET /compute/v2.1/servers/62784844-aa89-4715-a3e2-6346c45e0cdb" status: 200 len: 1315 microversion: 2.1 time: 0.315953 Sep 08 10:54:36.927725 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1839/3681] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:36 2022] GET /compute/v2.1/servers/62784844-aa89-4715-a3e2-6346c45e0cdb => generated 1315 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:36.944237 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-31c2b71d-e770-4934-898a-ea15e99b1d23 req-da08b144-c958-48c4-aba2-1b7d1e44826d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93d05d86-99b6-43f0-83c7-257ab64a12f3", "tag": "b7d2eec4-5d46-4733-a430-f161034305f1"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:54:36.974327 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-31c2b71d-e770-4934-898a-ea15e99b1d23 req-da08b144-c958-48c4-aba2-1b7d1e44826d service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:36.975262 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-31c2b71d-e770-4934-898a-ea15e99b1d23 req-da08b144-c958-48c4-aba2-1b7d1e44826d service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:36.976183 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-31c2b71d-e770-4934-898a-ea15e99b1d23 req-da08b144-c958-48c4-aba2-1b7d1e44826d service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:37.011365 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-31c2b71d-e770-4934-898a-ea15e99b1d23 req-da08b144-c958-48c4-aba2-1b7d1e44826d service nova] Creating event network-changed:b7d2eec4-5d46-4733-a430-f161034305f1 for instance 93d05d86-99b6-43f0-83c7-257ab64a12f3 on n-h2-850501-12 Sep 08 10:54:37.036694 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-31c2b71d-e770-4934-898a-ea15e99b1d23 req-da08b144-c958-48c4-aba2-1b7d1e44826d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106919 Sep 08 10:54:37.045633 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1840/3682] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:54:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:54:37.067135 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ebc8dce4-4bf2-49ec-91ce-2a1d51d5a33a tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:37.106423 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ebc8dce4-4bf2-49ec-91ce-2a1d51d5a33a tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.052392 Sep 08 10:54:37.107692 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1841/3683] 10.222.0.27 () {58 vars in 1137 bytes} [Thu Sep 8 10:54:37 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:54:37.132159 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9613920e-8314-42dd-9ca7-fac7327e6c44 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:37.135610 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9613920e-8314-42dd-9ca7-fac7327e6c44 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:37.153562 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9613920e-8314-42dd-9ca7-fac7327e6c44 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:37.154656 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9613920e-8314-42dd-9ca7-fac7327e6c44 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:37.155329 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9613920e-8314-42dd-9ca7-fac7327e6c44 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:37.166657 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9613920e-8314-42dd-9ca7-fac7327e6c44 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:37.172003 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9613920e-8314-42dd-9ca7-fac7327e6c44 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:37.172647 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9613920e-8314-42dd-9ca7-fac7327e6c44 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:37.542227 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9613920e-8314-42dd-9ca7-fac7327e6c44 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:37.551524 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9613920e-8314-42dd-9ca7-fac7327e6c44 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 0.441962 Sep 08 10:54:37.552433 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1842/3684] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:37 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:37.567184 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-67d06ddb-80b5-480f-a61e-d300dc8ca179 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:37.571177 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-67d06ddb-80b5-480f-a61e-d300dc8ca179 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: 19604289-6d42-403f-bf74-75335e1782cb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:37.598101 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67d06ddb-80b5-480f-a61e-d300dc8ca179 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:37.600496 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67d06ddb-80b5-480f-a61e-d300dc8ca179 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:37.601200 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67d06ddb-80b5-480f-a61e-d300dc8ca179 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:37.604290 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67d06ddb-80b5-480f-a61e-d300dc8ca179 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:37.605006 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67d06ddb-80b5-480f-a61e-d300dc8ca179 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:37.606018 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67d06ddb-80b5-480f-a61e-d300dc8ca179 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:37.712496 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-67d06ddb-80b5-480f-a61e-d300dc8ca179 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/19604289-6d42-403f-bf74-75335e1782cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.149708 Sep 08 10:54:37.713597 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1843/3685] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 10:54:37 2022] GET /compute/v2.1/servers/19604289-6d42-403f-bf74-75335e1782cb/os-volume_attachments => generated 197 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:54:37.722499 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bed86a49-8fde-4ac4-b6d0-efc4bae6ac46 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:37.723125 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bed86a49-8fde-4ac4-b6d0-efc4bae6ac46 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] [instance: 8540b5a8-bbfc-44e0-b10b-2fc0c316f842] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:37.736540 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bed86a49-8fde-4ac4-b6d0-efc4bae6ac46 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:37.737160 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bed86a49-8fde-4ac4-b6d0-efc4bae6ac46 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:37.737525 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bed86a49-8fde-4ac4-b6d0-efc4bae6ac46 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:37.742502 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bed86a49-8fde-4ac4-b6d0-efc4bae6ac46 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:37.744886 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bed86a49-8fde-4ac4-b6d0-efc4bae6ac46 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:37.745402 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bed86a49-8fde-4ac4-b6d0-efc4bae6ac46 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:37.808470 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bed86a49-8fde-4ac4-b6d0-efc4bae6ac46 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] [instance: 8540b5a8-bbfc-44e0-b10b-2fc0c316f842] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:54:37.910454 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:54:37.983225 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bed86a49-8fde-4ac4-b6d0-efc4bae6ac46 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8540b5a8-bbfc-44e0-b10b-2fc0c316f842" status: 204 len: 0 microversion: 2.1 time: 0.267800 Sep 08 10:54:37.985589 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1844/3686] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:54:37 2022] DELETE /compute/v2.1/servers/8540b5a8-bbfc-44e0-b10b-2fc0c316f842 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:54:37.995531 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-63dfa033-aca4-42ab-aea8-29cff56967ea tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "12aa0876-bb28-47d9-975a-2d76f1aa7c84"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:54:38.001810 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-63dfa033-aca4-42ab-aea8-29cff56967ea tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Request method failure captured: Sep 08 10:54:38.001810 n-d-850501-12 devstack@n-api.service[128862]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 10:54:38.001810 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:54:38.001810 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:54:38.001810 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:54:38.001810 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 416 Sep 08 10:54:38.001810 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:54:38.001810 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:54:38.001810 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:54:38.001810 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:54:38.001810 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcmnspi0cCT_Ts_s7jcB6HjtEcdULbQPd_krJniB9lBsXpm1cXSOD-YMaJoaapHCxuCXz0q6Qe4WXufr5At6SSPw8ov8Oz1eUk-fSNbVp7WlOPycfCf5I6xwH7tfbsoefVfbTiDOfU9mTBl0Vs74qdfTniErHfQlEG4cAvAQl1-wMrs Sep 08 10:54:38.001810 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:54:38.001810 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:54:38.001810 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:54:38.001810 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:54:38.001810 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:54:38.001810 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:54:38.001810 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:54:38.001810 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:54:38.001810 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:54:38.001810 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:54:38.001810 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:54:38.001810 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:54:38.001810 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:54:38.001810 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:54:38.001810 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:54:38.001810 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:54:38.001810 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:54:38.001810 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 7f551e6fe34243c290a25b57ab26af19 Sep 08 10:54:38.001810 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:54:38.001810 n-d-850501-12 devstack@n-api.service[128862]: Sep 08 10:54:38.001810 n-d-850501-12 devstack@n-api.service[128862]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "12aa0876-bb28-47d9-975a-2d76f1aa7c84"}]}} Sep 08 10:54:38.001810 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:54:38.001810 n-d-850501-12 devstack@n-api.service[128862]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 08 10:54:38.001810 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '503f4a0f-e18f-47fd-ad12-0289e3463117', 'flavorRef': '452', 'networks': [{'uuid': '12aa0876-bb28-47d9-975a-2d76f1aa7c84'}]}}} Sep 08 10:54:38.001810 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:54:38.001810 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:38.001810 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 10:54:38.001810 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 10:54:38.001810 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 10:54:38.001810 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise error Sep 08 10:54:38.001810 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 08 10:54:38.001810 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:54:38.001810 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Sep 08 10:54:38.001810 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 08 10:54:38.001810 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:54:38.001810 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 08 10:54:38.001810 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 08 10:54:38.001810 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:54:38.001810 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:54:38.006223 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:54:38.006223 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:38.006223 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:54:38.006223 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:54:38.006223 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:54:38.006223 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:54:38.006223 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:54:38.006223 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:54:38.006223 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:54:38.006223 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:54:38.006223 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 10:54:38.006223 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 10:54:38.006223 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 10:54:38.006223 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 10:54:38.006223 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 10:54:38.006223 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 10:54:38.006223 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 08 10:54:38.006223 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:54:38.006223 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:54:38.006223 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:54:38.006223 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:38.006223 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:54:38.006223 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:54:38.006223 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 10:54:38.006223 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 10:54:38.006223 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 08 10:54:38.006223 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:54:38.006223 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-63dfa033-aca4-42ab-aea8-29cff56967ea tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:54:38.006223 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-63dfa033-aca4-42ab-aea8-29cff56967ea tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.017315 Sep 08 10:54:38.010586 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1845/3687] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:54:37 2022] POST /compute/v2.1/servers => generated 619 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:54:38.015765 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7b31c9fd-2f17-41e2-9047-c86f0ce155f5 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:38.016936 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7b31c9fd-2f17-41e2-9047-c86f0ce155f5 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] [instance: 62784844-aa89-4715-a3e2-6346c45e0cdb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:38.027091 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7b31c9fd-2f17-41e2-9047-c86f0ce155f5 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:38.027593 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7b31c9fd-2f17-41e2-9047-c86f0ce155f5 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:38.028032 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7b31c9fd-2f17-41e2-9047-c86f0ce155f5 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:38.028884 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7b31c9fd-2f17-41e2-9047-c86f0ce155f5 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:38.029736 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7b31c9fd-2f17-41e2-9047-c86f0ce155f5 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:38.030417 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7b31c9fd-2f17-41e2-9047-c86f0ce155f5 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:38.093705 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-906d8bf3-0545-4543-877a-0dff0e8ff3ce tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:38.105706 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-906d8bf3-0545-4543-877a-0dff0e8ff3ce tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1684 microversion: 2.1 time: 1.525789 Sep 08 10:54:38.106580 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1843/3688] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:36 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1684 bytes in 1527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:38.116942 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e84aed21-dae2-4d48-b36f-b321a9aabc39 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:38.140739 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e84aed21-dae2-4d48-b36f-b321a9aabc39 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] [instance: 8540b5a8-bbfc-44e0-b10b-2fc0c316f842] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:38.161642 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e84aed21-dae2-4d48-b36f-b321a9aabc39 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:38.162432 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e84aed21-dae2-4d48-b36f-b321a9aabc39 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:38.163735 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e84aed21-dae2-4d48-b36f-b321a9aabc39 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:38.165289 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e84aed21-dae2-4d48-b36f-b321a9aabc39 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:38.165934 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e84aed21-dae2-4d48-b36f-b321a9aabc39 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:38.166537 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e84aed21-dae2-4d48-b36f-b321a9aabc39 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:38.293604 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7b31c9fd-2f17-41e2-9047-c86f0ce155f5 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1bec228c17647bba62ba7d57d28e4ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0958700fa94b42b2b6b47af40cf2f679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:38.308087 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7b31c9fd-2f17-41e2-9047-c86f0ce155f5 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "GET /compute/v2.1/servers/62784844-aa89-4715-a3e2-6346c45e0cdb" status: 200 len: 1503 microversion: 2.1 time: 0.296346 Sep 08 10:54:38.308887 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1846/3689] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:38 2022] GET /compute/v2.1/servers/62784844-aa89-4715-a3e2-6346c45e0cdb => generated 1503 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:38.347797 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ec05208a-f858-4c69-9a56-e183a28c5873 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:38.348407 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ec05208a-f858-4c69-9a56-e183a28c5873 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:38.368180 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec05208a-f858-4c69-9a56-e183a28c5873 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:38.368699 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec05208a-f858-4c69-9a56-e183a28c5873 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:38.369189 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec05208a-f858-4c69-9a56-e183a28c5873 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:38.370016 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec05208a-f858-4c69-9a56-e183a28c5873 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:38.370402 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec05208a-f858-4c69-9a56-e183a28c5873 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:38.370832 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec05208a-f858-4c69-9a56-e183a28c5873 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:38.726793 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ec05208a-f858-4c69-9a56-e183a28c5873 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:38.737614 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ec05208a-f858-4c69-9a56-e183a28c5873 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 0.400479 Sep 08 10:54:38.739295 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1847/3690] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:38 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:38.760203 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-81643a39-4672-4fe9-8d80-45a607b06999 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-865134167"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:54:38.761809 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-81643a39-4672-4fe9-8d80-45a607b06999 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] [instance: 62784844-aa89-4715-a3e2-6346c45e0cdb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:38.780147 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81643a39-4672-4fe9-8d80-45a607b06999 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:38.780818 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81643a39-4672-4fe9-8d80-45a607b06999 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:38.781701 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81643a39-4672-4fe9-8d80-45a607b06999 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:38.782672 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81643a39-4672-4fe9-8d80-45a607b06999 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:38.783419 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81643a39-4672-4fe9-8d80-45a607b06999 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:38.783977 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81643a39-4672-4fe9-8d80-45a607b06999 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:38.874397 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e84aed21-dae2-4d48-b36f-b321a9aabc39 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb64d1e0aabf4889a5515e4f89d9db0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd99a7d947e4ee4808db30f234d2c0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:38.884147 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e84aed21-dae2-4d48-b36f-b321a9aabc39 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] 10.222.0.27 "GET /compute/v2.1/servers/8540b5a8-bbfc-44e0-b10b-2fc0c316f842" status: 200 len: 1702 microversion: 2.1 time: 0.774423 Sep 08 10:54:38.884748 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1844/3691] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:38 2022] GET /compute/v2.1/servers/8540b5a8-bbfc-44e0-b10b-2fc0c316f842 => generated 1702 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:38.913621 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-05d37e69-cf72-49e3-8c38-13dd22965599 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:38.916403 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-05d37e69-cf72-49e3-8c38-13dd22965599 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: 19604289-6d42-403f-bf74-75335e1782cb] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:38.932636 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-05d37e69-cf72-49e3-8c38-13dd22965599 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:38.934353 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-05d37e69-cf72-49e3-8c38-13dd22965599 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:38.935849 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-05d37e69-cf72-49e3-8c38-13dd22965599 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:38.936848 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-05d37e69-cf72-49e3-8c38-13dd22965599 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:38.937589 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-05d37e69-cf72-49e3-8c38-13dd22965599 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:38.938238 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-05d37e69-cf72-49e3-8c38-13dd22965599 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:39.036050 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-05d37e69-cf72-49e3-8c38-13dd22965599 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/19604289-6d42-403f-bf74-75335e1782cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.130152 Sep 08 10:54:39.037575 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1845/3692] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 10:54:38 2022] GET /compute/v2.1/servers/19604289-6d42-403f-bf74-75335e1782cb/os-volume_attachments => generated 197 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:54:39.048839 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0a3ffe98-e038-4413-943d-7e1051612e8e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:39.049915 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0a3ffe98-e038-4413-943d-7e1051612e8e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:39.058079 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0a3ffe98-e038-4413-943d-7e1051612e8e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:39.059651 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0a3ffe98-e038-4413-943d-7e1051612e8e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:39.060336 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0a3ffe98-e038-4413-943d-7e1051612e8e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:39.061437 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0a3ffe98-e038-4413-943d-7e1051612e8e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:39.062162 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0a3ffe98-e038-4413-943d-7e1051612e8e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:39.062897 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0a3ffe98-e038-4413-943d-7e1051612e8e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:39.080894 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.network.security_group_api [None req-81643a39-4672-4fe9-8d80-45a607b06999 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Adding security group 98cfc01d-d0f6-4876-b482-4fe1e2cc1feb to port b935b113-3fd8-4c56-8353-221839b04fcc Sep 08 10:54:39.925809 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-81643a39-4672-4fe9-8d80-45a607b06999 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "POST /compute/v2.1/servers/62784844-aa89-4715-a3e2-6346c45e0cdb/action" status: 202 len: 0 microversion: 2.1 time: 1.185035 Sep 08 10:54:39.927673 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1848/3693] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:54:38 2022] POST /compute/v2.1/servers/62784844-aa89-4715-a3e2-6346c45e0cdb/action => generated 0 bytes in 1187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:54:39.933224 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-778a3d0f-9810-4086-80bd-1065bbf61aaa tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:39.934510 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-778a3d0f-9810-4086-80bd-1065bbf61aaa tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:39.963521 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-778a3d0f-9810-4086-80bd-1065bbf61aaa tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:39.967160 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-778a3d0f-9810-4086-80bd-1065bbf61aaa tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:39.973624 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-778a3d0f-9810-4086-80bd-1065bbf61aaa tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:39.979522 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-778a3d0f-9810-4086-80bd-1065bbf61aaa tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:39.983119 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-778a3d0f-9810-4086-80bd-1065bbf61aaa tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:39.985164 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-778a3d0f-9810-4086-80bd-1065bbf61aaa tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:40.351519 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-778a3d0f-9810-4086-80bd-1065bbf61aaa tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:40.369247 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-778a3d0f-9810-4086-80bd-1065bbf61aaa tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1684 microversion: 2.1 time: 0.436299 Sep 08 10:54:40.372755 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0a3ffe98-e038-4413-943d-7e1051612e8e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:40.386829 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0a3ffe98-e038-4413-943d-7e1051612e8e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 1.347817 Sep 08 10:54:40.388273 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1846/3694] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:39 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:40.408252 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1849/3695] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:39 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1684 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:40.431801 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-33961706-2b7c-4e81-a5bf-72baf429ac16 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:40.432748 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-33961706-2b7c-4e81-a5bf-72baf429ac16 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] [instance: 8540b5a8-bbfc-44e0-b10b-2fc0c316f842] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:40.443465 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2767b387-f3ae-4d3e-8925-cc393736a39e tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2003803527"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:54:40.444355 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2767b387-f3ae-4d3e-8925-cc393736a39e tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] [instance: 62784844-aa89-4715-a3e2-6346c45e0cdb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:40.454453 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-33961706-2b7c-4e81-a5bf-72baf429ac16 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:40.458124 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-33961706-2b7c-4e81-a5bf-72baf429ac16 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:40.458823 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-33961706-2b7c-4e81-a5bf-72baf429ac16 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:40.459913 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-33961706-2b7c-4e81-a5bf-72baf429ac16 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:40.460536 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-33961706-2b7c-4e81-a5bf-72baf429ac16 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:40.469799 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-33961706-2b7c-4e81-a5bf-72baf429ac16 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:40.487586 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2767b387-f3ae-4d3e-8925-cc393736a39e tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:40.493015 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2767b387-f3ae-4d3e-8925-cc393736a39e tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:40.493934 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2767b387-f3ae-4d3e-8925-cc393736a39e tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:40.498432 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2767b387-f3ae-4d3e-8925-cc393736a39e tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:40.499263 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2767b387-f3ae-4d3e-8925-cc393736a39e tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:40.502467 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2767b387-f3ae-4d3e-8925-cc393736a39e tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:40.781713 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.network.security_group_api [None req-2767b387-f3ae-4d3e-8925-cc393736a39e tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Adding security group 97eb00bc-fe26-42f9-82f9-a30716b36096 to port b935b113-3fd8-4c56-8353-221839b04fcc Sep 08 10:54:41.107484 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-33961706-2b7c-4e81-a5bf-72baf429ac16 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb64d1e0aabf4889a5515e4f89d9db0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd99a7d947e4ee4808db30f234d2c0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:41.126734 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-33961706-2b7c-4e81-a5bf-72baf429ac16 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] 10.222.0.27 "GET /compute/v2.1/servers/8540b5a8-bbfc-44e0-b10b-2fc0c316f842" status: 200 len: 1702 microversion: 2.1 time: 0.738213 Sep 08 10:54:41.127618 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1847/3696] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:40 2022] GET /compute/v2.1/servers/8540b5a8-bbfc-44e0-b10b-2fc0c316f842 => generated 1702 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:41.163923 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bbf9754a-380c-4cd2-b690-4b96443ed2f2 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:41.166756 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bbf9754a-380c-4cd2-b690-4b96443ed2f2 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: 19604289-6d42-403f-bf74-75335e1782cb] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:41.187206 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bbf9754a-380c-4cd2-b690-4b96443ed2f2 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:41.188000 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bbf9754a-380c-4cd2-b690-4b96443ed2f2 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:41.188600 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bbf9754a-380c-4cd2-b690-4b96443ed2f2 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:41.189534 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bbf9754a-380c-4cd2-b690-4b96443ed2f2 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:41.190172 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bbf9754a-380c-4cd2-b690-4b96443ed2f2 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:41.190785 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bbf9754a-380c-4cd2-b690-4b96443ed2f2 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:41.258754 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bbf9754a-380c-4cd2-b690-4b96443ed2f2 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/19604289-6d42-403f-bf74-75335e1782cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.115890 Sep 08 10:54:41.265358 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1848/3697] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 10:54:41 2022] GET /compute/v2.1/servers/19604289-6d42-403f-bf74-75335e1782cb/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:54:41.277940 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-f01417dd-81d2-4fca-87f9-e0a91e0b2524 req-f8e0a51f-72b7-41c2-8dcc-dc774ee8d20d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62784844-aa89-4715-a3e2-6346c45e0cdb", "tag": "b935b113-3fd8-4c56-8353-221839b04fcc"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:54:41.311332 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-f01417dd-81d2-4fca-87f9-e0a91e0b2524 req-f8e0a51f-72b7-41c2-8dcc-dc774ee8d20d service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:41.312114 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-f01417dd-81d2-4fca-87f9-e0a91e0b2524 req-f8e0a51f-72b7-41c2-8dcc-dc774ee8d20d service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:41.312759 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-f01417dd-81d2-4fca-87f9-e0a91e0b2524 req-f8e0a51f-72b7-41c2-8dcc-dc774ee8d20d service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:41.372556 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2767b387-f3ae-4d3e-8925-cc393736a39e tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "POST /compute/v2.1/servers/62784844-aa89-4715-a3e2-6346c45e0cdb/action" status: 202 len: 0 microversion: 2.1 time: 0.962976 Sep 08 10:54:41.376176 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1850/3698] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:54:40 2022] POST /compute/v2.1/servers/62784844-aa89-4715-a3e2-6346c45e0cdb/action => generated 0 bytes in 965 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:54:41.379159 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-083b6dc6-0b77-4920-92bf-d4747d91c3cf tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1781519757", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": -1, "networks": [{"uuid": "12aa0876-bb28-47d9-975a-2d76f1aa7c84"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:54:41.386393 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-f01417dd-81d2-4fca-87f9-e0a91e0b2524 req-f8e0a51f-72b7-41c2-8dcc-dc774ee8d20d service nova] Creating event network-changed:b935b113-3fd8-4c56-8353-221839b04fcc for instance 62784844-aa89-4715-a3e2-6346c45e0cdb on n-h2-850501-12 Sep 08 10:54:41.409390 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-f01417dd-81d2-4fca-87f9-e0a91e0b2524 req-f8e0a51f-72b7-41c2-8dcc-dc774ee8d20d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141348 Sep 08 10:54:41.410695 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1849/3699] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:54:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:54:41.445288 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-083b6dc6-0b77-4920-92bf-d4747d91c3cf tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] HTTP exception thrown: Flavor -1 could not be found. Sep 08 10:54:41.455104 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-083b6dc6-0b77-4920-92bf-d4747d91c3cf tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Request method failure captured: Sep 08 10:54:41.455104 n-d-850501-12 devstack@n-api.service[128862]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 10:54:41.455104 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:54:41.455104 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:54:41.455104 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:54:41.455104 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 206 Sep 08 10:54:41.455104 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:54:41.455104 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:54:41.455104 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:54:41.455104 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:54:41.455104 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcmnspi0cCT_Ts_s7jcB6HjtEcdULbQPd_krJniB9lBsXpm1cXSOD-YMaJoaapHCxuCXz0q6Qe4WXufr5At6SSPw8ov8Oz1eUk-fSNbVp7WlOPycfCf5I6xwH7tfbsoefVfbTiDOfU9mTBl0Vs74qdfTniErHfQlEG4cAvAQl1-wMrs Sep 08 10:54:41.455104 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:54:41.455104 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:54:41.455104 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:54:41.455104 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:54:41.455104 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:54:41.455104 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:54:41.455104 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:54:41.455104 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:54:41.455104 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:54:41.455104 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:54:41.455104 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:54:41.455104 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:54:41.455104 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:54:41.455104 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:54:41.455104 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:54:41.455104 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:54:41.455104 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:54:41.455104 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 7f551e6fe34243c290a25b57ab26af19 Sep 08 10:54:41.455104 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:54:41.455104 n-d-850501-12 devstack@n-api.service[128862]: Sep 08 10:54:41.455104 n-d-850501-12 devstack@n-api.service[128862]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1781519757", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": -1, "networks": [{"uuid": "12aa0876-bb28-47d9-975a-2d76f1aa7c84"}]}} Sep 08 10:54:41.455104 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:54:41.455104 n-d-850501-12 devstack@n-api.service[128862]: exception: Flavor -1 could not be found. Sep 08 10:54:41.455104 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1781519757', 'imageRef': '503f4a0f-e18f-47fd-ad12-0289e3463117', 'flavorRef': -1, 'networks': [{'uuid': '12aa0876-bb28-47d9-975a-2d76f1aa7c84'}]}}} Sep 08 10:54:41.455104 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:54:41.455104 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:41.455104 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Sep 08 10:54:41.455104 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Sep 08 10:54:41.455104 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 08 10:54:41.455104 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 08 10:54:41.455104 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 10:54:41.455104 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 10:54:41.455104 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 08 10:54:41.455104 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 08 10:54:41.455104 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 08 10:54:41.455104 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:54:41.455104 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 08 10:54:41.455104 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 08 10:54:41.455104 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Sep 08 10:54:41.455104 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:54:41.455104 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:54:41.455104 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:54:41.455104 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:41.455104 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:54:41.455104 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:54:41.455104 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:54:41.455104 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:54:41.455104 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:54:41.455104 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:54:41.455104 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:54:41.455104 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:54:41.461159 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:54:41.461159 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:54:41.461159 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:54:41.461159 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:54:41.461159 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 08 10:54:41.461159 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 08 10:54:41.461159 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 08 10:54:41.461159 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Sep 08 10:54:41.461159 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:54:41.461159 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:54:41.461159 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:54:41.461159 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:41.461159 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:54:41.461159 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:54:41.461159 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:54:41.461159 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:54:41.461159 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Sep 08 10:54:41.461159 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:54:41.462645 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-05505c86-0057-47c6-8e46-a0fafb32a9c4 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:41.462645 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-05505c86-0057-47c6-8e46-a0fafb32a9c4 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] [instance: 62784844-aa89-4715-a3e2-6346c45e0cdb] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:41.468161 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-083b6dc6-0b77-4920-92bf-d4747d91c3cf tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:54:41.473945 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-083b6dc6-0b77-4920-92bf-d4747d91c3cf tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.098961 Sep 08 10:54:41.474863 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1851/3700] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:54:41 2022] POST /compute/v2.1/servers => generated 73 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 08 10:54:41.481570 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-05505c86-0057-47c6-8e46-a0fafb32a9c4 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:41.482074 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-05505c86-0057-47c6-8e46-a0fafb32a9c4 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:41.482510 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-05505c86-0057-47c6-8e46-a0fafb32a9c4 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:41.486436 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a2baaf1c-5a32-4cd7-b4ff-611d5ef6a1b2 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:41.487069 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a2baaf1c-5a32-4cd7-b4ff-611d5ef6a1b2 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:41.488921 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-05505c86-0057-47c6-8e46-a0fafb32a9c4 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:41.489775 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-05505c86-0057-47c6-8e46-a0fafb32a9c4 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:41.491252 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-05505c86-0057-47c6-8e46-a0fafb32a9c4 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:41.511402 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2baaf1c-5a32-4cd7-b4ff-611d5ef6a1b2 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:41.514014 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2baaf1c-5a32-4cd7-b4ff-611d5ef6a1b2 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:41.517550 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2baaf1c-5a32-4cd7-b4ff-611d5ef6a1b2 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:41.518564 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2baaf1c-5a32-4cd7-b4ff-611d5ef6a1b2 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:41.519746 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2baaf1c-5a32-4cd7-b4ff-611d5ef6a1b2 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:41.521560 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2baaf1c-5a32-4cd7-b4ff-611d5ef6a1b2 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:41.994569 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a2baaf1c-5a32-4cd7-b4ff-611d5ef6a1b2 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:42.032268 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a2baaf1c-5a32-4cd7-b4ff-611d5ef6a1b2 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1684 microversion: 2.1 time: 0.556013 Sep 08 10:54:42.033092 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1852/3701] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:41 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1684 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:42.047365 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-38d96725-c9e4-4588-90e9-f600bff059e6 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:42.047659 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-38d96725-c9e4-4588-90e9-f600bff059e6 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:42.069629 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38d96725-c9e4-4588-90e9-f600bff059e6 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:42.070148 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38d96725-c9e4-4588-90e9-f600bff059e6 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:42.070636 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38d96725-c9e4-4588-90e9-f600bff059e6 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:42.071380 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38d96725-c9e4-4588-90e9-f600bff059e6 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:42.072504 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38d96725-c9e4-4588-90e9-f600bff059e6 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:42.072504 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38d96725-c9e4-4588-90e9-f600bff059e6 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:42.350854 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-05505c86-0057-47c6-8e46-a0fafb32a9c4 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "GET /compute/v2.1/servers/62784844-aa89-4715-a3e2-6346c45e0cdb/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.938865 Sep 08 10:54:42.351873 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1850/3702] 10.222.0.27 () {58 vars in 1293 bytes} [Thu Sep 8 10:54:41 2022] GET /compute/v2.1/servers/62784844-aa89-4715-a3e2-6346c45e0cdb/os-security-groups => generated 1158 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:42.359590 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-010d520c-3211-4742-bcdd-6dbfa57a42dd tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:42.360227 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-010d520c-3211-4742-bcdd-6dbfa57a42dd tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] [instance: 8540b5a8-bbfc-44e0-b10b-2fc0c316f842] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:42.382176 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-010d520c-3211-4742-bcdd-6dbfa57a42dd tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:42.382686 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-010d520c-3211-4742-bcdd-6dbfa57a42dd tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:42.383135 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-010d520c-3211-4742-bcdd-6dbfa57a42dd tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:42.391168 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-010d520c-3211-4742-bcdd-6dbfa57a42dd tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:42.391797 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-010d520c-3211-4742-bcdd-6dbfa57a42dd tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:42.392137 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-010d520c-3211-4742-bcdd-6dbfa57a42dd tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:42.694025 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-010d520c-3211-4742-bcdd-6dbfa57a42dd tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb64d1e0aabf4889a5515e4f89d9db0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd99a7d947e4ee4808db30f234d2c0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:42.702828 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:54:42.713551 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-010d520c-3211-4742-bcdd-6dbfa57a42dd tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] 10.222.0.27 "GET /compute/v2.1/servers/8540b5a8-bbfc-44e0-b10b-2fc0c316f842" status: 200 len: 1634 microversion: 2.1 time: 0.359658 Sep 08 10:54:42.715476 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1851/3703] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:42 2022] GET /compute/v2.1/servers/8540b5a8-bbfc-44e0-b10b-2fc0c316f842 => generated 1634 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:42.722624 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-911ee357-1b9d-4f31-8902-70bf61d697d0 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:42.733075 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-911ee357-1b9d-4f31-8902-70bf61d697d0 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: 19604289-6d42-403f-bf74-75335e1782cb] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:42.771461 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-38d96725-c9e4-4588-90e9-f600bff059e6 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:42.805435 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-911ee357-1b9d-4f31-8902-70bf61d697d0 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:42.815503 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-911ee357-1b9d-4f31-8902-70bf61d697d0 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:42.825116 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-911ee357-1b9d-4f31-8902-70bf61d697d0 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:42.833485 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-38d96725-c9e4-4588-90e9-f600bff059e6 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 0.799123 Sep 08 10:54:42.834708 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-911ee357-1b9d-4f31-8902-70bf61d697d0 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:42.839290 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-911ee357-1b9d-4f31-8902-70bf61d697d0 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:42.843408 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-911ee357-1b9d-4f31-8902-70bf61d697d0 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:42.850722 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1853/3704] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:42 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:42.883912 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a9df5d56-1675-4153-8387-ed35a56f797d tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Action: 'create', calling method: .version_select at 0x7f68e8a92e50>, body: {"security_group": {"name": " tempest-securitygroup -338353626 ", "description": "tempest-description-1882344954"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:54:42.970527 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-911ee357-1b9d-4f31-8902-70bf61d697d0 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/19604289-6d42-403f-bf74-75335e1782cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.253110 Sep 08 10:54:42.975988 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1852/3705] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 10:54:42 2022] GET /compute/v2.1/servers/19604289-6d42-403f-bf74-75335e1782cb/os-volume_attachments => generated 197 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:54:42.982900 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1f22826b-848d-4b31-a0c4-360e4098f8ed tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:42.983528 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1f22826b-848d-4b31-a0c4-360e4098f8ed tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:43.004115 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1f22826b-848d-4b31-a0c4-360e4098f8ed tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:43.004616 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1f22826b-848d-4b31-a0c4-360e4098f8ed tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:43.005079 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1f22826b-848d-4b31-a0c4-360e4098f8ed tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:43.005812 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1f22826b-848d-4b31-a0c4-360e4098f8ed tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:43.006278 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1f22826b-848d-4b31-a0c4-360e4098f8ed tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:43.006761 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1f22826b-848d-4b31-a0c4-360e4098f8ed tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:43.363563 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1f22826b-848d-4b31-a0c4-360e4098f8ed tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:43.374337 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1f22826b-848d-4b31-a0c4-360e4098f8ed tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 0.397157 Sep 08 10:54:43.374922 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1853/3706] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:42 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:43.397991 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-8a683710-0c5a-4611-ad78-c9642eca9d92 req-23eee9f2-bbda-45ed-a7d4-4426cc1cb7d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8540b5a8-bbfc-44e0-b10b-2fc0c316f842", "name": "network-vif-deleted", "tag": "909f79bb-7501-41db-ad7d-238a18a7493c"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:54:43.420522 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-8a683710-0c5a-4611-ad78-c9642eca9d92 req-23eee9f2-bbda-45ed-a7d4-4426cc1cb7d4 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:43.421061 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-8a683710-0c5a-4611-ad78-c9642eca9d92 req-23eee9f2-bbda-45ed-a7d4-4426cc1cb7d4 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:43.421527 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-8a683710-0c5a-4611-ad78-c9642eca9d92 req-23eee9f2-bbda-45ed-a7d4-4426cc1cb7d4 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:43.439172 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-8a683710-0c5a-4611-ad78-c9642eca9d92 req-23eee9f2-bbda-45ed-a7d4-4426cc1cb7d4 service nova] Creating event network-vif-deleted:909f79bb-7501-41db-ad7d-238a18a7493c for instance 8540b5a8-bbfc-44e0-b10b-2fc0c316f842 on n-h2-850501-12 Sep 08 10:54:43.459887 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-8a683710-0c5a-4611-ad78-c9642eca9d92 req-23eee9f2-bbda-45ed-a7d4-4426cc1cb7d4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081713 Sep 08 10:54:43.460492 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1854/3707] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:54:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:54:43.478409 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-efc198c7-9637-446a-ab01-5acec95b01f7 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:43.479146 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-efc198c7-9637-446a-ab01-5acec95b01f7 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:43.486611 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-efc198c7-9637-446a-ab01-5acec95b01f7 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:43.487116 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-efc198c7-9637-446a-ab01-5acec95b01f7 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:43.487679 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-efc198c7-9637-446a-ab01-5acec95b01f7 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:43.488519 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-efc198c7-9637-446a-ab01-5acec95b01f7 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:43.489333 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-efc198c7-9637-446a-ab01-5acec95b01f7 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:43.489931 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-efc198c7-9637-446a-ab01-5acec95b01f7 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:43.767885 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-efc198c7-9637-446a-ab01-5acec95b01f7 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:43.779374 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-efc198c7-9637-446a-ab01-5acec95b01f7 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1684 microversion: 2.1 time: 0.312072 Sep 08 10:54:43.782113 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1855/3708] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:43 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1684 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:43.788834 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f4b42c25-2250-4b96-be5a-78932e5a1948 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2036498328", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "12aa0876-bb28-47d9-975a-2d76f1aa7c84"}]}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:54:43.797164 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f4b42c25-2250-4b96-be5a-78932e5a1948 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Request method failure captured: Sep 08 10:54:43.797164 n-d-850501-12 devstack@n-api.service[128861]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 10:54:43.797164 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:54:43.797164 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:54:43.797164 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:54:43.797164 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 173 Sep 08 10:54:43.797164 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:54:43.797164 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:54:43.797164 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:54:43.797164 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:54:43.797164 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcmnspi0cCT_Ts_s7jcB6HjtEcdULbQPd_krJniB9lBsXpm1cXSOD-YMaJoaapHCxuCXz0q6Qe4WXufr5At6SSPw8ov8Oz1eUk-fSNbVp7WlOPycfCf5I6xwH7tfbsoefVfbTiDOfU9mTBl0Vs74qdfTniErHfQlEG4cAvAQl1-wMrs Sep 08 10:54:43.797164 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:54:43.797164 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:54:43.797164 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:54:43.797164 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:54:43.797164 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:54:43.797164 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:54:43.797164 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:54:43.797164 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:54:43.797164 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:54:43.797164 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:54:43.797164 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:54:43.797164 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:54:43.797164 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:54:43.797164 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:54:43.797164 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:54:43.797164 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:54:43.797164 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:54:43.797164 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 7f551e6fe34243c290a25b57ab26af19 Sep 08 10:54:43.797164 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:54:43.797164 n-d-850501-12 devstack@n-api.service[128861]: Sep 08 10:54:43.797164 n-d-850501-12 devstack@n-api.service[128861]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2036498328", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "12aa0876-bb28-47d9-975a-2d76f1aa7c84"}]}} Sep 08 10:54:43.797164 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:54:43.797164 n-d-850501-12 devstack@n-api.service[128861]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Sep 08 10:54:43.797164 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2036498328', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '12aa0876-bb28-47d9-975a-2d76f1aa7c84'}]}}} Sep 08 10:54:43.797164 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:54:43.797164 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:43.797164 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 10:54:43.797164 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 10:54:43.797164 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 10:54:43.797164 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise error Sep 08 10:54:43.797164 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Sep 08 10:54:43.797164 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:43.797164 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Sep 08 10:54:43.797164 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Sep 08 10:54:43.797164 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Sep 08 10:54:43.797164 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:43.797164 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 08 10:54:43.797164 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi -1 Sep 08 10:54:43.797164 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:43.797164 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:54:43.797164 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:43.797164 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:43.797164 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:54:43.797164 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:54:43.797164 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:54:43.797164 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:54:43.797164 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:54:43.797164 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:54:43.797164 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:54:43.797164 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:54:43.797164 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 10:54:43.797164 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 10:54:43.797164 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 10:54:43.803659 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 10:54:43.803659 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 10:54:43.803659 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 10:54:43.803659 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Sep 08 10:54:43.803659 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:43.803659 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:54:43.803659 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:43.803659 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:43.803659 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:54:43.803659 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:54:43.803659 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 10:54:43.803659 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 10:54:43.803659 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Sep 08 10:54:43.803659 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:43.811746 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f4b42c25-2250-4b96-be5a-78932e5a1948 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:54:43.813584 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f4b42c25-2250-4b96-be5a-78932e5a1948 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.030037 Sep 08 10:54:43.815070 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1856/3709] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:54:43 2022] POST /compute/v2.1/servers => generated 145 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:54:43.840167 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-47837eab-75aa-41cb-9921-b332957a571b req-20f6afc2-538b-443d-ada5-6f02c921374c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62784844-aa89-4715-a3e2-6346c45e0cdb", "tag": "b935b113-3fd8-4c56-8353-221839b04fcc"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:54:43.856839 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-47837eab-75aa-41cb-9921-b332957a571b req-20f6afc2-538b-443d-ada5-6f02c921374c service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:43.858246 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-47837eab-75aa-41cb-9921-b332957a571b req-20f6afc2-538b-443d-ada5-6f02c921374c service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:43.859069 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-47837eab-75aa-41cb-9921-b332957a571b req-20f6afc2-538b-443d-ada5-6f02c921374c service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:43.874444 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-47837eab-75aa-41cb-9921-b332957a571b req-20f6afc2-538b-443d-ada5-6f02c921374c service nova] Creating event network-changed:b935b113-3fd8-4c56-8353-221839b04fcc for instance 62784844-aa89-4715-a3e2-6346c45e0cdb on n-h2-850501-12 Sep 08 10:54:43.882356 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-47837eab-75aa-41cb-9921-b332957a571b req-20f6afc2-538b-443d-ada5-6f02c921374c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060364 Sep 08 10:54:43.883767 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1857/3710] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:54:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:54:43.890691 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0e97c80f-c102-4c4e-9fc1-58fc2bdcb5ac tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:43.891788 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0e97c80f-c102-4c4e-9fc1-58fc2bdcb5ac tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] [instance: 8540b5a8-bbfc-44e0-b10b-2fc0c316f842] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:43.903083 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e97c80f-c102-4c4e-9fc1-58fc2bdcb5ac tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:43.904002 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e97c80f-c102-4c4e-9fc1-58fc2bdcb5ac tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:43.904654 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e97c80f-c102-4c4e-9fc1-58fc2bdcb5ac tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:43.905925 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e97c80f-c102-4c4e-9fc1-58fc2bdcb5ac tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:43.911615 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e97c80f-c102-4c4e-9fc1-58fc2bdcb5ac tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:43.912457 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e97c80f-c102-4c4e-9fc1-58fc2bdcb5ac tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:43.985277 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e97c80f-c102-4c4e-9fc1-58fc2bdcb5ac tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:43.986044 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e97c80f-c102-4c4e-9fc1-58fc2bdcb5ac tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:43.986787 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e97c80f-c102-4c4e-9fc1-58fc2bdcb5ac tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:43.988034 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-0e97c80f-c102-4c4e-9fc1-58fc2bdcb5ac tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lazy-loading 'fault' on Instance uuid 8540b5a8-bbfc-44e0-b10b-2fc0c316f842 {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:54:44.110289 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0e97c80f-c102-4c4e-9fc1-58fc2bdcb5ac tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb64d1e0aabf4889a5515e4f89d9db0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd99a7d947e4ee4808db30f234d2c0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:44.125627 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0e97c80f-c102-4c4e-9fc1-58fc2bdcb5ac tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] 10.222.0.27 "GET /compute/v2.1/servers/8540b5a8-bbfc-44e0-b10b-2fc0c316f842" status: 200 len: 1360 microversion: 2.1 time: 0.237652 Sep 08 10:54:44.129267 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1858/3711] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:43 2022] GET /compute/v2.1/servers/8540b5a8-bbfc-44e0-b10b-2fc0c316f842 => generated 1360 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:44.144801 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5cd1ad2b-d059-4313-822d-7f37ec02e5cb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:44.148738 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5cd1ad2b-d059-4313-822d-7f37ec02e5cb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:44.176006 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5cd1ad2b-d059-4313-822d-7f37ec02e5cb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:44.176950 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5cd1ad2b-d059-4313-822d-7f37ec02e5cb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:44.177742 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5cd1ad2b-d059-4313-822d-7f37ec02e5cb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:44.178445 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5cd1ad2b-d059-4313-822d-7f37ec02e5cb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:44.179038 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5cd1ad2b-d059-4313-822d-7f37ec02e5cb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:44.179480 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5cd1ad2b-d059-4313-822d-7f37ec02e5cb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:44.483250 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5cd1ad2b-d059-4313-822d-7f37ec02e5cb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:44.498332 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5cd1ad2b-d059-4313-822d-7f37ec02e5cb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 0.366870 Sep 08 10:54:44.499264 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1859/3712] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:44 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:44.512062 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-dc623b77-2bab-4005-a742-fe96d4ba44f3 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:44.521403 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-dc623b77-2bab-4005-a742-fe96d4ba44f3 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: 19604289-6d42-403f-bf74-75335e1782cb] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:44.535884 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dc623b77-2bab-4005-a742-fe96d4ba44f3 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:44.538850 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dc623b77-2bab-4005-a742-fe96d4ba44f3 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:44.539191 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dc623b77-2bab-4005-a742-fe96d4ba44f3 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:44.540108 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dc623b77-2bab-4005-a742-fe96d4ba44f3 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:44.542694 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dc623b77-2bab-4005-a742-fe96d4ba44f3 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:44.545136 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a9df5d56-1675-4153-8387-ed35a56f797d tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 1.692624 Sep 08 10:54:44.546141 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1854/3713] 10.222.0.27 () {60 vars in 1180 bytes} [Thu Sep 8 10:54:42 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 1694 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:54:44.551831 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8bde35b5-f0ae-4db7-abda-0ccab70a9afb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:44.552947 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8bde35b5-f0ae-4db7-abda-0ccab70a9afb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:44.553726 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dc623b77-2bab-4005-a742-fe96d4ba44f3 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:44.580214 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8bde35b5-f0ae-4db7-abda-0ccab70a9afb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:44.585598 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8bde35b5-f0ae-4db7-abda-0ccab70a9afb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:44.586094 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8bde35b5-f0ae-4db7-abda-0ccab70a9afb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:44.592628 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8bde35b5-f0ae-4db7-abda-0ccab70a9afb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:44.598467 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8bde35b5-f0ae-4db7-abda-0ccab70a9afb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:44.604952 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8bde35b5-f0ae-4db7-abda-0ccab70a9afb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:44.678571 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-dc623b77-2bab-4005-a742-fe96d4ba44f3 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/19604289-6d42-403f-bf74-75335e1782cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.175830 Sep 08 10:54:44.679444 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1860/3714] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 10:54:44 2022] GET /compute/v2.1/servers/19604289-6d42-403f-bf74-75335e1782cb/os-volume_attachments => generated 197 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:54:44.698646 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3a1f115c-3c4a-40b8-81dc-70121bc0ee21 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Calling method '.version_select at 0x7f68dfa33160>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:44.825192 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3a1f115c-3c4a-40b8-81dc-70121bc0ee21 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/3ac11542-baf3-446d-8bc0-0847f6550959" status: 200 len: 223 microversion: 2.1 time: 0.144757 Sep 08 10:54:44.826192 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1861/3715] 10.222.0.27 () {58 vars in 1269 bytes} [Thu Sep 8 10:54:44 2022] GET /compute/v2.1/os-security-groups/3ac11542-baf3-446d-8bc0-0847f6550959 => generated 223 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:54:44.831084 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9483825b-7613-4856-9a28-3f3e31ccd92f tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:44.831679 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9483825b-7613-4856-9a28-3f3e31ccd92f tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:44.849079 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9483825b-7613-4856-9a28-3f3e31ccd92f tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:44.849595 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9483825b-7613-4856-9a28-3f3e31ccd92f tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:44.850039 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9483825b-7613-4856-9a28-3f3e31ccd92f tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:44.850766 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9483825b-7613-4856-9a28-3f3e31ccd92f tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:44.851228 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9483825b-7613-4856-9a28-3f3e31ccd92f tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:44.851650 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9483825b-7613-4856-9a28-3f3e31ccd92f tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:45.062228 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9483825b-7613-4856-9a28-3f3e31ccd92f tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:45.084271 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9483825b-7613-4856-9a28-3f3e31ccd92f tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1684 microversion: 2.1 time: 0.250844 Sep 08 10:54:45.087456 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1862/3716] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:44 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1684 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:45.099527 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-699f5477-e81d-4b8d-96eb-c091f93f32a3 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Calling method '.version_select at 0x7f68e4063e50>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:45.429850 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-699f5477-e81d-4b8d-96eb-c091f93f32a3 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/3ac11542-baf3-446d-8bc0-0847f6550959" status: 202 len: 0 microversion: 2.1 time: 0.341044 Sep 08 10:54:45.430162 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8bde35b5-f0ae-4db7-abda-0ccab70a9afb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:45.430477 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1863/3717] 10.222.0.27 () {58 vars in 1272 bytes} [Thu Sep 8 10:54:45 2022] DELETE /compute/v2.1/os-security-groups/3ac11542-baf3-446d-8bc0-0847f6550959 => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:54:45.436415 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-99745e19-5b50-406a-9b9f-92f3f19963cc tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:45.437059 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-99745e19-5b50-406a-9b9f-92f3f19963cc tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] [instance: 8540b5a8-bbfc-44e0-b10b-2fc0c316f842] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:45.450839 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8bde35b5-f0ae-4db7-abda-0ccab70a9afb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 0.903149 Sep 08 10:54:45.459008 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1855/3718] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:44 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:45.459708 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-99745e19-5b50-406a-9b9f-92f3f19963cc tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:45.460184 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-99745e19-5b50-406a-9b9f-92f3f19963cc tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:45.461957 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-99745e19-5b50-406a-9b9f-92f3f19963cc tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:45.462673 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-99745e19-5b50-406a-9b9f-92f3f19963cc tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:45.463941 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-99745e19-5b50-406a-9b9f-92f3f19963cc tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:45.464375 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-99745e19-5b50-406a-9b9f-92f3f19963cc tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:45.470518 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1d7892e8-14d7-468a-806c-6e17c87e8831 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Calling method '.version_select at 0x7f68e44f2820>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:45.501265 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-99745e19-5b50-406a-9b9f-92f3f19963cc tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] HTTP exception thrown: Instance 8540b5a8-bbfc-44e0-b10b-2fc0c316f842 could not be found. Sep 08 10:54:45.504434 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-99745e19-5b50-406a-9b9f-92f3f19963cc tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Request method failure captured: Sep 08 10:54:45.504434 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/8540b5a8-bbfc-44e0-b10b-2fc0c316f842 HTTP/1.1 Sep 08 10:54:45.504434 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:54:45.504434 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:54:45.504434 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:54:45.504434 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:54:45.504434 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:54:45.504434 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:54:45.504434 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:54:45.504434 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:54:45.504434 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcmiWJrsbfKWJyUfqA7lJKGPCI7GhZKpKSRNgwVp1zw2ymIb2cTM-c9xaHX7DiqfQfHVaeuaAUhzx_jArJjhijsAGT2GOfSyt8_dIbYhxyB27ut30Fv08sfqkoq0DMTSF_zPgc433KGkRC11XUoRdglTUGzF2780QHFtQe6Qtg1Dxa8 Sep 08 10:54:45.504434 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:54:45.504434 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:54:45.504434 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:54:45.504434 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:54:45.504434 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:54:45.504434 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:54:45.504434 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 3bd99a7d947e4ee4808db30f234d2c0f Sep 08 10:54:45.504434 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServersTestJSON-1923322206 Sep 08 10:54:45.504434 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:54:45.504434 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:54:45.504434 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3bd99a7d947e4ee4808db30f234d2c0f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3bd99a7d947e4ee4808db30f234d2c0f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3bd99a7d947e4ee4808db30f234d2c0f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3bd99a7d947e4ee4808db30f234d2c0f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:54:45.504434 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServersTestJSON-1923322206 Sep 08 10:54:45.504434 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 3bd99a7d947e4ee4808db30f234d2c0f Sep 08 10:54:45.504434 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServersTestJSON-1923322206 Sep 08 10:54:45.504434 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServersTestJSON-1923322206-project Sep 08 10:54:45.504434 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:54:45.504434 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:54:45.504434 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: eb64d1e0aabf4889a5515e4f89d9db0e Sep 08 10:54:45.504434 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServersTestJSON-1923322206-project Sep 08 10:54:45.504434 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:54:45.504434 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 8540b5a8-bbfc-44e0-b10b-2fc0c316f842 could not be found. Sep 08 10:54:45.504434 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '8540b5a8-bbfc-44e0-b10b-2fc0c316f842'} Sep 08 10:54:45.504434 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:54:45.504434 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:45.504434 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:54:45.504434 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:54:45.504434 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:54:45.504434 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:54:45.504434 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:54:45.504434 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:54:45.504434 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:54:45.504434 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:54:45.504434 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8540b5a8-bbfc-44e0-b10b-2fc0c316f842 could not be found. Sep 08 10:54:45.504434 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:45.504434 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:54:45.504434 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:45.504434 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:45.504434 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:54:45.504434 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:54:45.504434 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:54:45.504434 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:54:45.504434 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:54:45.504434 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:54:45.504434 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:54:45.504434 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:54:45.504434 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:54:45.504434 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:54:45.504434 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:54:45.504434 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:54:45.504434 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8540b5a8-bbfc-44e0-b10b-2fc0c316f842 could not be found. Sep 08 10:54:45.504434 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:45.504434 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:54:45.504434 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:45.510939 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:45.510939 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:54:45.510939 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:54:45.510939 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:54:45.510939 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:54:45.510939 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8540b5a8-bbfc-44e0-b10b-2fc0c316f842 could not be found. Sep 08 10:54:45.510939 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:45.510939 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-99745e19-5b50-406a-9b9f-92f3f19963cc tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Returning 404 to user: Instance 8540b5a8-bbfc-44e0-b10b-2fc0c316f842 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:54:45.510939 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-99745e19-5b50-406a-9b9f-92f3f19963cc tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] 10.222.0.27 "GET /compute/v2.1/servers/8540b5a8-bbfc-44e0-b10b-2fc0c316f842" status: 404 len: 111 microversion: 2.1 time: 0.074612 Sep 08 10:54:45.510939 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1864/3719] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:45 2022] GET /compute/v2.1/servers/8540b5a8-bbfc-44e0-b10b-2fc0c316f842 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:54:45.515727 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-33d3ee86-a849-4b0c-9ed4-bb647e2c4eb9 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] Calling method '.version_select at 0x7f68e40e6dc0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:45.599094 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-33d3ee86-a849-4b0c-9ed4-bb647e2c4eb9 tempest-ServersTestJSON-1923322206 tempest-ServersTestJSON-1923322206-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1655933188" status: 202 len: 0 microversion: 2.1 time: 0.083897 Sep 08 10:54:45.608829 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1865/3720] 10.222.0.27 () {58 vars in 1221 bytes} [Thu Sep 8 10:54:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1655933188 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:54:45.701792 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9a974122-d4d9-473e-9010-27ce07297d47 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:45.711452 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9a974122-d4d9-473e-9010-27ce07297d47 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: 19604289-6d42-403f-bf74-75335e1782cb] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:45.757611 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9a974122-d4d9-473e-9010-27ce07297d47 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:45.759007 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9a974122-d4d9-473e-9010-27ce07297d47 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:45.767174 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9a974122-d4d9-473e-9010-27ce07297d47 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:45.769451 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9a974122-d4d9-473e-9010-27ce07297d47 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:45.770753 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9a974122-d4d9-473e-9010-27ce07297d47 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:45.771651 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9a974122-d4d9-473e-9010-27ce07297d47 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:45.854741 n-d-850501-12 devstack@n-api.service[128862]: DEBUG neutronclient.v2_0.client [None req-1d7892e8-14d7-468a-806c-6e17c87e8831 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3ac11542-baf3-446d-8bc0-0847f6550959 does not exist", "detail": ""}} {{(pid=128862) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 08 10:54:45.855397 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.security_group_api [None req-1d7892e8-14d7-468a-806c-6e17c87e8831 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Neutron security group 3ac11542-baf3-446d-8bc0-0847f6550959 not found {{(pid=128862) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 08 10:54:45.856027 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-1d7892e8-14d7-468a-806c-6e17c87e8831 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] HTTP exception thrown: Security group 3ac11542-baf3-446d-8bc0-0847f6550959 does not exist Sep 08 10:54:45.856027 n-d-850501-12 devstack@n-api.service[128862]: Neutron server returns request_ids: ['req-f05a7b5e-624e-4338-8b5f-792a9332ff89'] Sep 08 10:54:45.857935 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1d7892e8-14d7-468a-806c-6e17c87e8831 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Request method failure captured: Sep 08 10:54:45.857935 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/os-security-groups/3ac11542-baf3-446d-8bc0-0847f6550959 HTTP/1.1 Sep 08 10:54:45.857935 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:54:45.857935 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:54:45.857935 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:54:45.857935 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:54:45.857935 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:54:45.857935 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:54:45.857935 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:54:45.857935 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:54:45.857935 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcnTIBfdH5H0Q1rMlbnLYZQcAnuATI-6ncC0ETqGOy19nshWBWc6mMSPvOE_5zGIQBC9DCOSD4SaG9XyRLj03fab4bxuKCvYlxZzzB9WEeCTo5mGH1uU5x9CALWtC8B7Wu8ih4rvxppcLmpz4ET9xD3ym8uzzB22kwTIB3vo0v5dqyY Sep 08 10:54:45.857935 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:54:45.857935 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:54:45.857935 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:54:45.857935 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:54:45.857935 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:54:45.857935 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:54:45.857935 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 0958700fa94b42b2b6b47af40cf2f679 Sep 08 10:54:45.857935 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-SecurityGroupsTestJSON-353861575 Sep 08 10:54:45.857935 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:54:45.857935 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:54:45.857935 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0958700fa94b42b2b6b47af40cf2f679"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0958700fa94b42b2b6b47af40cf2f679"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0958700fa94b42b2b6b47af40cf2f679"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0958700fa94b42b2b6b47af40cf2f679"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:54:45.857935 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-SecurityGroupsTestJSON-353861575 Sep 08 10:54:45.857935 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 0958700fa94b42b2b6b47af40cf2f679 Sep 08 10:54:45.857935 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-353861575 Sep 08 10:54:45.857935 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-SecurityGroupsTestJSON-353861575-project Sep 08 10:54:45.857935 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:54:45.857935 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:54:45.857935 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: e1bec228c17647bba62ba7d57d28e4ed Sep 08 10:54:45.857935 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-SecurityGroupsTestJSON-353861575-project Sep 08 10:54:45.857935 n-d-850501-12 devstack@n-api.service[128862]: method: Sep 08 10:54:45.857935 n-d-850501-12 devstack@n-api.service[128862]: exception: Security group 3ac11542-baf3-446d-8bc0-0847f6550959 does not exist Sep 08 10:54:45.857935 n-d-850501-12 devstack@n-api.service[128862]: Neutron server returns request_ids: ['req-f05a7b5e-624e-4338-8b5f-792a9332ff89'] Sep 08 10:54:45.857935 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '3ac11542-baf3-446d-8bc0-0847f6550959'} Sep 08 10:54:45.857935 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:54:45.857935 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:45.857935 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 08 10:54:45.857935 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 08 10:54:45.857935 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:54:45.857935 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:54:45.857935 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 08 10:54:45.857935 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 08 10:54:45.857935 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:54:45.857935 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:54:45.857935 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 08 10:54:45.857935 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 08 10:54:45.857935 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:54:45.857935 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:54:45.857935 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 08 10:54:45.857935 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 08 10:54:45.857935 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:54:45.857935 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:54:45.857935 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 08 10:54:45.857935 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 08 10:54:45.857935 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:54:45.857935 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:54:45.857935 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 08 10:54:45.857935 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 08 10:54:45.857935 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 08 10:54:45.857935 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 08 10:54:45.857935 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 3ac11542-baf3-446d-8bc0-0847f6550959 does not exist Sep 08 10:54:45.871378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f05a7b5e-624e-4338-8b5f-792a9332ff89'] Sep 08 10:54:45.871378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:54:45.871378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:54:45.871378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:54:45.871378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:45.871378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 08 10:54:45.871378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 08 10:54:45.871378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 08 10:54:45.871378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 08 10:54:45.871378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 3ac11542-baf3-446d-8bc0-0847f6550959 does not exist Sep 08 10:54:45.871378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f05a7b5e-624e-4338-8b5f-792a9332ff89'] Sep 08 10:54:45.871378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:54:45.871378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:54:45.871378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:54:45.871378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:45.871378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:54:45.871378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:54:45.871378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:54:45.871378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:54:45.871378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:54:45.871378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:54:45.871378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:54:45.871378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:54:45.871378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 08 10:54:45.871378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 08 10:54:45.871378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 3ac11542-baf3-446d-8bc0-0847f6550959 does not exist Sep 08 10:54:45.871378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f05a7b5e-624e-4338-8b5f-792a9332ff89'] Sep 08 10:54:45.871378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:54:45.871378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:54:45.871378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:54:45.871378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:45.871378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:54:45.871378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:54:45.871378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:54:45.871378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:54:45.871378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 3ac11542-baf3-446d-8bc0-0847f6550959 does not exist Sep 08 10:54:45.871378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f05a7b5e-624e-4338-8b5f-792a9332ff89'] Sep 08 10:54:45.871378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:54:45.871378 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1d7892e8-14d7-468a-806c-6e17c87e8831 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Returning 404 to user: Security group 3ac11542-baf3-446d-8bc0-0847f6550959 does not exist Sep 08 10:54:45.871378 n-d-850501-12 devstack@n-api.service[128862]: Neutron server returns request_ids: ['req-f05a7b5e-624e-4338-8b5f-792a9332ff89'] {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:54:45.871378 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1d7892e8-14d7-468a-806c-6e17c87e8831 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/3ac11542-baf3-446d-8bc0-0847f6550959" status: 404 len: 194 microversion: 2.1 time: 0.399270 Sep 08 10:54:45.871378 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1856/3721] 10.222.0.27 () {58 vars in 1269 bytes} [Thu Sep 8 10:54:45 2022] GET /compute/v2.1/os-security-groups/3ac11542-baf3-446d-8bc0-0847f6550959 => generated 194 bytes in 401 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:54:45.874931 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-aa7cd266-4400-41cb-8740-7cd70366a38e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-712020126", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:54:45.889854 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-aa7cd266-4400-41cb-8740-7cd70366a38e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 08 10:54:45.892639 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-aa7cd266-4400-41cb-8740-7cd70366a38e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Request method failure captured: Sep 08 10:54:45.892639 n-d-850501-12 devstack@n-api.service[128862]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 10:54:45.892639 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:54:45.892639 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:54:45.892639 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:54:45.892639 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 215 Sep 08 10:54:45.892639 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:54:45.892639 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:54:45.892639 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:54:45.892639 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:54:45.892639 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcmnspi0cCT_Ts_s7jcB6HjtEcdULbQPd_krJniB9lBsXpm1cXSOD-YMaJoaapHCxuCXz0q6Qe4WXufr5At6SSPw8ov8Oz1eUk-fSNbVp7WlOPycfCf5I6xwH7tfbsoefVfbTiDOfU9mTBl0Vs74qdfTniErHfQlEG4cAvAQl1-wMrs Sep 08 10:54:45.892639 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:54:45.892639 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:54:45.892639 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:54:45.892639 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:54:45.892639 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:54:45.892639 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:54:45.892639 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:54:45.892639 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:54:45.892639 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:54:45.892639 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:54:45.892639 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:54:45.892639 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:54:45.892639 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:54:45.892639 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:54:45.892639 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:54:45.892639 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:54:45.892639 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:54:45.892639 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 7f551e6fe34243c290a25b57ab26af19 Sep 08 10:54:45.892639 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:54:45.892639 n-d-850501-12 devstack@n-api.service[128862]: Sep 08 10:54:45.892639 n-d-850501-12 devstack@n-api.service[128862]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-712020126", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Sep 08 10:54:45.892639 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:54:45.892639 n-d-850501-12 devstack@n-api.service[128862]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 08 10:54:45.892639 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-712020126', 'imageRef': '503f4a0f-e18f-47fd-ad12-0289e3463117', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Sep 08 10:54:45.892639 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:54:45.892639 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:45.892639 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:54:45.892639 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:54:45.892639 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:54:45.892639 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:54:45.892639 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:54:45.892639 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:54:45.892639 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:54:45.892639 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:54:45.892639 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:54:45.892639 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:54:45.892639 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:54:45.892639 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:54:45.892639 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 08 10:54:45.892639 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Sep 08 10:54:45.892639 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Sep 08 10:54:45.892639 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Sep 08 10:54:45.892639 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Sep 08 10:54:45.892639 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Sep 08 10:54:45.892639 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._validate_network_id( Sep 08 10:54:45.892639 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Sep 08 10:54:45.892639 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 08 10:54:45.892639 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 08 10:54:45.892639 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:54:45.892639 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:54:45.898059 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:54:45.898059 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:45.898059 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:54:45.898059 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:54:45.898059 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:54:45.898059 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:54:45.898059 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 08 10:54:45.898059 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:54:45.898059 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-aa7cd266-4400-41cb-8740-7cd70366a38e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:54:45.898059 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-aa7cd266-4400-41cb-8740-7cd70366a38e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.033253 Sep 08 10:54:45.898059 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1857/3722] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:54:45 2022] POST /compute/v2.1/servers => generated 123 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:54:45.913069 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5c4cc1b0-c433-4055-a351-06abced1692a tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Action: 'create', calling method: .version_select at 0x7f68e4748430>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-885761110", "description": "tempest-description-1464687224"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:54:45.938282 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9a974122-d4d9-473e-9010-27ce07297d47 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/19604289-6d42-403f-bf74-75335e1782cb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.249847 Sep 08 10:54:45.940095 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1866/3723] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 10:54:45 2022] GET /compute/v2.1/servers/19604289-6d42-403f-bf74-75335e1782cb/os-volume_attachments => generated 25 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:54:45.982274 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-334b24d6-b83f-468d-a5ca-1444dc7a7104 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:45.983503 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-334b24d6-b83f-468d-a5ca-1444dc7a7104 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:45.987213 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=4 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:54:46.000155 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-334b24d6-b83f-468d-a5ca-1444dc7a7104 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:46.000769 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-334b24d6-b83f-468d-a5ca-1444dc7a7104 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:46.003236 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-334b24d6-b83f-468d-a5ca-1444dc7a7104 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:46.004409 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-334b24d6-b83f-468d-a5ca-1444dc7a7104 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:46.006815 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-334b24d6-b83f-468d-a5ca-1444dc7a7104 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:46.009007 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-334b24d6-b83f-468d-a5ca-1444dc7a7104 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:46.110413 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:54:46.758323 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-334b24d6-b83f-468d-a5ca-1444dc7a7104 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:46.771857 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-334b24d6-b83f-468d-a5ca-1444dc7a7104 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 0.830141 Sep 08 10:54:46.775199 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1867/3724] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:45 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:46.795495 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5c4cc1b0-c433-4055-a351-06abced1692a tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.894026 Sep 08 10:54:46.800474 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1858/3725] 10.222.0.27 () {60 vars in 1180 bytes} [Thu Sep 8 10:54:45 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:54:46.804481 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9667f6eb-dd48-4370-b8bf-0d780a6563ed tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:46.806698 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9667f6eb-dd48-4370-b8bf-0d780a6563ed tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: 19604289-6d42-403f-bf74-75335e1782cb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:46.808292 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b6a80c39-568a-414d-9c5d-92643f59987b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:46.809741 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b6a80c39-568a-414d-9c5d-92643f59987b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:46.829785 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b6a80c39-568a-414d-9c5d-92643f59987b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:46.832246 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9667f6eb-dd48-4370-b8bf-0d780a6563ed tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:46.832875 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9667f6eb-dd48-4370-b8bf-0d780a6563ed tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:46.833038 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b6a80c39-568a-414d-9c5d-92643f59987b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:46.833354 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9667f6eb-dd48-4370-b8bf-0d780a6563ed tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:46.833639 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b6a80c39-568a-414d-9c5d-92643f59987b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:46.834105 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9667f6eb-dd48-4370-b8bf-0d780a6563ed tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:46.834564 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9667f6eb-dd48-4370-b8bf-0d780a6563ed tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:46.835082 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b6a80c39-568a-414d-9c5d-92643f59987b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:46.836975 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b6a80c39-568a-414d-9c5d-92643f59987b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:46.837533 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b6a80c39-568a-414d-9c5d-92643f59987b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:46.846472 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9667f6eb-dd48-4370-b8bf-0d780a6563ed tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:46.890530 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9667f6eb-dd48-4370-b8bf-0d780a6563ed tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: 19604289-6d42-403f-bf74-75335e1782cb] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:54:47.064133 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9667f6eb-dd48-4370-b8bf-0d780a6563ed tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "DELETE /compute/v2.1/servers/19604289-6d42-403f-bf74-75335e1782cb" status: 204 len: 0 microversion: 2.1 time: 0.266254 Sep 08 10:54:47.065121 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1859/3726] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:54:46 2022] DELETE /compute/v2.1/servers/19604289-6d42-403f-bf74-75335e1782cb => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:54:47.085167 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7cce52ed-e3c9-41a9-b2e7-9030629049e6 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:47.088080 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7cce52ed-e3c9-41a9-b2e7-9030629049e6 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:47.104418 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7cce52ed-e3c9-41a9-b2e7-9030629049e6 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:47.104913 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7cce52ed-e3c9-41a9-b2e7-9030629049e6 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:47.106043 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7cce52ed-e3c9-41a9-b2e7-9030629049e6 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:47.106781 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7cce52ed-e3c9-41a9-b2e7-9030629049e6 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:47.107242 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7cce52ed-e3c9-41a9-b2e7-9030629049e6 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:47.107882 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7cce52ed-e3c9-41a9-b2e7-9030629049e6 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:47.384156 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b6a80c39-568a-414d-9c5d-92643f59987b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:47.396354 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b6a80c39-568a-414d-9c5d-92643f59987b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1684 microversion: 2.1 time: 0.617938 Sep 08 10:54:47.399530 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1868/3727] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:46 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1684 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:47.404498 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bc282408-c6d7-4ea6-a79b-ffbe363b09da tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Action: 'create', calling method: .version_select at 0x7f68e4063310>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2089355175", "description": "tempest-description-1854148405"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:54:47.492352 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7cce52ed-e3c9-41a9-b2e7-9030629049e6 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:47.534817 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7cce52ed-e3c9-41a9-b2e7-9030629049e6 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 0.467680 Sep 08 10:54:47.539949 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1860/3728] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:47 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:47.545913 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4a8ac8d8-b8a1-4f2e-a4f2-da2d014d337d tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:47.546951 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4a8ac8d8-b8a1-4f2e-a4f2-da2d014d337d tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: 19604289-6d42-403f-bf74-75335e1782cb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:47.557294 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a8ac8d8-b8a1-4f2e-a4f2-da2d014d337d tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:47.558479 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a8ac8d8-b8a1-4f2e-a4f2-da2d014d337d tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:47.560018 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a8ac8d8-b8a1-4f2e-a4f2-da2d014d337d tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:47.561315 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a8ac8d8-b8a1-4f2e-a4f2-da2d014d337d tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:47.562180 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a8ac8d8-b8a1-4f2e-a4f2-da2d014d337d tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:47.563169 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a8ac8d8-b8a1-4f2e-a4f2-da2d014d337d tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:47.876547 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4a8ac8d8-b8a1-4f2e-a4f2-da2d014d337d tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c291cbe955b4ee5abc98132dda0255e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f9a24cad014d7f827e8f3236dd5bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:47.885383 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bc282408-c6d7-4ea6-a79b-ffbe363b09da tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.484678 Sep 08 10:54:47.885903 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4a8ac8d8-b8a1-4f2e-a4f2-da2d014d337d tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/19604289-6d42-403f-bf74-75335e1782cb" status: 200 len: 1681 microversion: 2.1 time: 0.343606 Sep 08 10:54:47.894974 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1861/3729] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:47 2022] GET /compute/v2.1/servers/19604289-6d42-403f-bf74-75335e1782cb => generated 1681 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:47.901513 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1869/3730] 10.222.0.27 () {60 vars in 1180 bytes} [Thu Sep 8 10:54:47 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:54:47.914228 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-32513ff8-610e-4972-8c9a-46655d994f28 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2018617397", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "key_name": "tempest-key-958996802", "networks": [{"uuid": "12aa0876-bb28-47d9-975a-2d76f1aa7c84"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:54:47.919058 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-65f877e8-49e6-49ef-ad5d-96c4daf11951 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Action: 'create', calling method: .version_select at 0x7f68df9d1af0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-444554297", "description": "tempest-description-420015925"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:54:48.034596 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-32513ff8-610e-4972-8c9a-46655d994f28 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] validate_networks() for [('12aa0876-bb28-47d9-975a-2d76f1aa7c84', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:54:48.346977 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-65f877e8-49e6-49ef-ad5d-96c4daf11951 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.444301 Sep 08 10:54:48.356316 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1870/3731] 10.222.0.27 () {60 vars in 1180 bytes} [Thu Sep 8 10:54:47 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:54:48.437043 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-32513ff8-610e-4972-8c9a-46655d994f28 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] HTTP exception thrown: Invalid key_name provided. Sep 08 10:54:48.439152 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-32513ff8-610e-4972-8c9a-46655d994f28 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Request method failure captured: Sep 08 10:54:48.439152 n-d-850501-12 devstack@n-api.service[128862]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 10:54:48.439152 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:54:48.439152 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:54:48.439152 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:54:48.439152 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 246 Sep 08 10:54:48.439152 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:54:48.439152 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:54:48.439152 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:54:48.439152 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:54:48.439152 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcmnspi0cCT_Ts_s7jcB6HjtEcdULbQPd_krJniB9lBsXpm1cXSOD-YMaJoaapHCxuCXz0q6Qe4WXufr5At6SSPw8ov8Oz1eUk-fSNbVp7WlOPycfCf5I6xwH7tfbsoefVfbTiDOfU9mTBl0Vs74qdfTniErHfQlEG4cAvAQl1-wMrs Sep 08 10:54:48.439152 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:54:48.439152 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:54:48.439152 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:54:48.439152 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:54:48.439152 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:54:48.439152 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:54:48.439152 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:54:48.439152 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:54:48.439152 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:54:48.439152 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:54:48.439152 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:54:48.439152 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:54:48.439152 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:54:48.439152 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:54:48.439152 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:54:48.439152 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:54:48.439152 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:54:48.439152 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 7f551e6fe34243c290a25b57ab26af19 Sep 08 10:54:48.439152 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:54:48.439152 n-d-850501-12 devstack@n-api.service[128862]: Sep 08 10:54:48.439152 n-d-850501-12 devstack@n-api.service[128862]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2018617397", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "key_name": "tempest-key-958996802", "networks": [{"uuid": "12aa0876-bb28-47d9-975a-2d76f1aa7c84"}]}} Sep 08 10:54:48.439152 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:54:48.439152 n-d-850501-12 devstack@n-api.service[128862]: exception: Invalid key_name provided. Sep 08 10:54:48.439152 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2018617397', 'imageRef': '503f4a0f-e18f-47fd-ad12-0289e3463117', 'flavorRef': '452', 'key_name': 'tempest-key-958996802', 'networks': [{'uuid': '12aa0876-bb28-47d9-975a-2d76f1aa7c84'}]}}} Sep 08 10:54:48.439152 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:54:48.439152 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:48.439152 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 08 10:54:48.439152 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 08 10:54:48.439152 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 08 10:54:48.439152 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 08 10:54:48.439152 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Sep 08 10:54:48.439152 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Sep 08 10:54:48.439152 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Sep 08 10:54:48.439152 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Sep 08 10:54:48.439152 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 10:54:48.439152 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 10:54:48.439152 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Sep 08 10:54:48.439152 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Sep 08 10:54:48.439152 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Sep 08 10:54:48.439152 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Sep 08 10:54:48.439152 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 08 10:54:48.439152 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 08 10:54:48.439152 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Sep 08 10:54:48.439152 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Sep 08 10:54:48.439152 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-958996802 not found for user 7f551e6fe34243c290a25b57ab26af19 Sep 08 10:54:48.439152 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:54:48.439152 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:54:48.439152 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:54:48.439152 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:48.439152 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:54:48.444866 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:54:48.444866 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:54:48.444866 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:54:48.444866 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:54:48.444866 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:54:48.444866 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:54:48.444866 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:54:48.444866 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:54:48.444866 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:54:48.444866 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:54:48.444866 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:54:48.444866 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 08 10:54:48.444866 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Sep 08 10:54:48.444866 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 08 10:54:48.444866 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Sep 08 10:54:48.444866 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:54:48.444866 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:54:48.444866 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:54:48.444866 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:48.444866 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:54:48.444866 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:54:48.444866 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:54:48.444866 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:54:48.444866 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Sep 08 10:54:48.444866 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:54:48.453728 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-32513ff8-610e-4972-8c9a-46655d994f28 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Returning 400 to user: Invalid key_name provided. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:54:48.453728 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-32513ff8-610e-4972-8c9a-46655d994f28 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.564867 Sep 08 10:54:48.453728 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1862/3732] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:54:47 2022] POST /compute/v2.1/servers => generated 70 bytes in 566 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 08 10:54:48.466773 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e6533b7b-9f53-4e58-9010-68fdcb309790 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Calling method '.version_select at 0x7f68e4217820>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:48.681436 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8772448b-e29b-4171-8797-ab7e4f5d269f tempest-SecurityGroupsNegativeTestJSON-820245764 tempest-SecurityGroupsNegativeTestJSON-820245764-project] Calling method '.version_select at 0x7f68df9d1430>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:48.734710 n-d-850501-12 devstack@n-api.service[128861]: DEBUG neutronclient.v2_0.client [None req-8772448b-e29b-4171-8797-ab7e4f5d269f tempest-SecurityGroupsNegativeTestJSON-820245764 tempest-SecurityGroupsNegativeTestJSON-820245764-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ce2bd34d-2173-4941-b8e6-902cea969220 does not exist", "detail": ""}} {{(pid=128861) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 08 10:54:48.735350 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.security_group_api [None req-8772448b-e29b-4171-8797-ab7e4f5d269f tempest-SecurityGroupsNegativeTestJSON-820245764 tempest-SecurityGroupsNegativeTestJSON-820245764-project] Neutron security group ce2bd34d-2173-4941-b8e6-902cea969220 not found {{(pid=128861) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 08 10:54:48.735899 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-8772448b-e29b-4171-8797-ab7e4f5d269f tempest-SecurityGroupsNegativeTestJSON-820245764 tempest-SecurityGroupsNegativeTestJSON-820245764-project] HTTP exception thrown: Security group ce2bd34d-2173-4941-b8e6-902cea969220 does not exist Sep 08 10:54:48.735899 n-d-850501-12 devstack@n-api.service[128861]: Neutron server returns request_ids: ['req-c634aaf0-5d6e-4108-91d4-6848aeab373b'] Sep 08 10:54:48.737877 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8772448b-e29b-4171-8797-ab7e4f5d269f tempest-SecurityGroupsNegativeTestJSON-820245764 tempest-SecurityGroupsNegativeTestJSON-820245764-project] Request method failure captured: Sep 08 10:54:48.737877 n-d-850501-12 devstack@n-api.service[128861]: request: DELETE /compute/v2.1/os-security-groups/ce2bd34d-2173-4941-b8e6-902cea969220 HTTP/1.1 Sep 08 10:54:48.737877 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:54:48.737877 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:54:48.737877 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:54:48.737877 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:54:48.737877 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:54:48.737877 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:54:48.737877 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:54:48.737877 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:54:48.737877 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcn3phMnbv6b_Q_cH5xB3ooRsX80WkrtpBJumOdV2xrX2Erbz7xOHk1KefXxj1DqTqzlx2sdFt3aTuhzT02-DaHHhlUCuwXicAeKSEQ1higIksS5Eq4RZKEvX1oZDkG_zmBMzoN9VU4YBbLKrTyGr7pPAeRqQIkNCky-ljlLTcly3Gs Sep 08 10:54:48.737877 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:54:48.737877 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:54:48.737877 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:54:48.737877 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:54:48.737877 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:54:48.737877 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:54:48.737877 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: c82a1948079241f9a11aa5679040e7ed Sep 08 10:54:48.737877 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-820245764 Sep 08 10:54:48.737877 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:54:48.737877 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:54:48.737877 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c82a1948079241f9a11aa5679040e7ed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c82a1948079241f9a11aa5679040e7ed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c82a1948079241f9a11aa5679040e7ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c82a1948079241f9a11aa5679040e7ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:54:48.737877 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-820245764 Sep 08 10:54:48.737877 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: c82a1948079241f9a11aa5679040e7ed Sep 08 10:54:48.737877 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-820245764 Sep 08 10:54:48.737877 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-SecurityGroupsNegativeTestJSON-820245764-project Sep 08 10:54:48.737877 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:54:48.737877 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:54:48.737877 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 11a9c884b67a4afaa983ec4e3597bac1 Sep 08 10:54:48.737877 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-820245764-project Sep 08 10:54:48.737877 n-d-850501-12 devstack@n-api.service[128861]: method: Sep 08 10:54:48.737877 n-d-850501-12 devstack@n-api.service[128861]: exception: Security group ce2bd34d-2173-4941-b8e6-902cea969220 does not exist Sep 08 10:54:48.737877 n-d-850501-12 devstack@n-api.service[128861]: Neutron server returns request_ids: ['req-c634aaf0-5d6e-4108-91d4-6848aeab373b'] Sep 08 10:54:48.737877 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': 'ce2bd34d-2173-4941-b8e6-902cea969220'} Sep 08 10:54:48.737877 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:54:48.737877 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:48.737877 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 08 10:54:48.737877 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 08 10:54:48.737877 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:54:48.737877 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:54:48.737877 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 08 10:54:48.737877 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 08 10:54:48.737877 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:54:48.737877 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:54:48.737877 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 08 10:54:48.737877 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 08 10:54:48.737877 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:54:48.737877 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:54:48.737877 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 08 10:54:48.737877 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 08 10:54:48.737877 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:54:48.737877 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:54:48.737877 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 08 10:54:48.737877 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 08 10:54:48.737877 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:54:48.737877 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:54:48.737877 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 08 10:54:48.737877 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 08 10:54:48.737877 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 08 10:54:48.737877 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 08 10:54:48.737877 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ce2bd34d-2173-4941-b8e6-902cea969220 does not exist Sep 08 10:54:48.743918 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c634aaf0-5d6e-4108-91d4-6848aeab373b'] Sep 08 10:54:48.743918 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:48.743918 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:54:48.743918 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:48.743918 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:48.743918 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 08 10:54:48.743918 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 08 10:54:48.743918 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 08 10:54:48.743918 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 08 10:54:48.743918 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ce2bd34d-2173-4941-b8e6-902cea969220 does not exist Sep 08 10:54:48.743918 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c634aaf0-5d6e-4108-91d4-6848aeab373b'] Sep 08 10:54:48.743918 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:48.743918 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:54:48.743918 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:48.743918 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:48.743918 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:54:48.743918 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:54:48.743918 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:54:48.743918 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:54:48.743918 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:54:48.743918 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:54:48.743918 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:54:48.743918 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:54:48.743918 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 08 10:54:48.743918 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 08 10:54:48.743918 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ce2bd34d-2173-4941-b8e6-902cea969220 does not exist Sep 08 10:54:48.743918 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c634aaf0-5d6e-4108-91d4-6848aeab373b'] Sep 08 10:54:48.743918 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:48.743918 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:54:48.743918 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:48.743918 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:48.743918 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:54:48.743918 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:54:48.743918 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:54:48.743918 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:54:48.743918 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ce2bd34d-2173-4941-b8e6-902cea969220 does not exist Sep 08 10:54:48.743918 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c634aaf0-5d6e-4108-91d4-6848aeab373b'] Sep 08 10:54:48.743918 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:48.743918 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8772448b-e29b-4171-8797-ab7e4f5d269f tempest-SecurityGroupsNegativeTestJSON-820245764 tempest-SecurityGroupsNegativeTestJSON-820245764-project] Returning 404 to user: Security group ce2bd34d-2173-4941-b8e6-902cea969220 does not exist Sep 08 10:54:48.743918 n-d-850501-12 devstack@n-api.service[128861]: Neutron server returns request_ids: ['req-c634aaf0-5d6e-4108-91d4-6848aeab373b'] {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:54:48.743918 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8772448b-e29b-4171-8797-ab7e4f5d269f tempest-SecurityGroupsNegativeTestJSON-820245764 tempest-SecurityGroupsNegativeTestJSON-820245764-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/ce2bd34d-2173-4941-b8e6-902cea969220" status: 404 len: 194 microversion: 2.1 time: 0.387329 Sep 08 10:54:48.743918 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1871/3733] 10.222.0.27 () {58 vars in 1272 bytes} [Thu Sep 8 10:54:48 2022] DELETE /compute/v2.1/os-security-groups/ce2bd34d-2173-4941-b8e6-902cea969220 => generated 194 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:54:48.755251 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3759f9bf-64a9-476b-b3b5-f298735785ec tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:48.756179 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3759f9bf-64a9-476b-b3b5-f298735785ec tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:48.780167 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3759f9bf-64a9-476b-b3b5-f298735785ec tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:48.780677 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3759f9bf-64a9-476b-b3b5-f298735785ec tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:48.781156 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3759f9bf-64a9-476b-b3b5-f298735785ec tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:48.781892 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3759f9bf-64a9-476b-b3b5-f298735785ec tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:48.782362 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3759f9bf-64a9-476b-b3b5-f298735785ec tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:48.782797 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3759f9bf-64a9-476b-b3b5-f298735785ec tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:49.061774 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-3759f9bf-64a9-476b-b3b5-f298735785ec tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:49.073383 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3759f9bf-64a9-476b-b3b5-f298735785ec tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1684 microversion: 2.1 time: 0.331828 Sep 08 10:54:49.074590 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1872/3734] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:48 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1684 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:49.090310 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c794e96b-985d-427d-a517-f4a7e56052cb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:49.091850 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c794e96b-985d-427d-a517-f4a7e56052cb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:49.112080 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c794e96b-985d-427d-a517-f4a7e56052cb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:49.113139 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c794e96b-985d-427d-a517-f4a7e56052cb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:49.113765 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c794e96b-985d-427d-a517-f4a7e56052cb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:49.114732 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c794e96b-985d-427d-a517-f4a7e56052cb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:49.115393 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c794e96b-985d-427d-a517-f4a7e56052cb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:49.116047 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c794e96b-985d-427d-a517-f4a7e56052cb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:49.352140 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c794e96b-985d-427d-a517-f4a7e56052cb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:49.371792 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c794e96b-985d-427d-a517-f4a7e56052cb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 0.295758 Sep 08 10:54:49.376473 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1873/3735] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:49 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:49.396560 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-66e7a840-1d79-4ea0-bea3-e9287d19fdb3 tempest-SecurityGroupsNegativeTestJSON-820245764 tempest-SecurityGroupsNegativeTestJSON-820245764-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.005584 Sep 08 10:54:49.405419 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1874/3736] 10.222.0.27 () {58 vars in 1164 bytes} [Thu Sep 8 10:54:49 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 27 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 08 10:54:49.411083 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-876e961e-7e0a-4fa6-b693-fea41e93a6e0 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:49.422117 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-876e961e-7e0a-4fa6-b693-fea41e93a6e0 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: 19604289-6d42-403f-bf74-75335e1782cb] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:49.438878 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-876e961e-7e0a-4fa6-b693-fea41e93a6e0 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:49.439375 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-876e961e-7e0a-4fa6-b693-fea41e93a6e0 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:49.439812 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-876e961e-7e0a-4fa6-b693-fea41e93a6e0 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:49.441083 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-876e961e-7e0a-4fa6-b693-fea41e93a6e0 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:49.441550 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-876e961e-7e0a-4fa6-b693-fea41e93a6e0 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:49.442083 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-876e961e-7e0a-4fa6-b693-fea41e93a6e0 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:49.721359 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-876e961e-7e0a-4fa6-b693-fea41e93a6e0 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c291cbe955b4ee5abc98132dda0255e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f9a24cad014d7f827e8f3236dd5bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:49.732898 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-876e961e-7e0a-4fa6-b693-fea41e93a6e0 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/19604289-6d42-403f-bf74-75335e1782cb" status: 200 len: 1681 microversion: 2.1 time: 0.326038 Sep 08 10:54:49.734694 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1875/3737] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:49 2022] GET /compute/v2.1/servers/19604289-6d42-403f-bf74-75335e1782cb => generated 1681 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:49.741884 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-144aecbe-4bb7-4475-aa8e-84bc5b3537d4 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:49.755016 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-144aecbe-4bb7-4475-aa8e-84bc5b3537d4 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:49.781823 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-144aecbe-4bb7-4475-aa8e-84bc5b3537d4 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:49.782306 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-144aecbe-4bb7-4475-aa8e-84bc5b3537d4 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:49.782746 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-144aecbe-4bb7-4475-aa8e-84bc5b3537d4 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:49.783474 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-144aecbe-4bb7-4475-aa8e-84bc5b3537d4 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:49.783932 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-144aecbe-4bb7-4475-aa8e-84bc5b3537d4 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:49.785008 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-144aecbe-4bb7-4475-aa8e-84bc5b3537d4 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:50.046747 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-144aecbe-4bb7-4475-aa8e-84bc5b3537d4 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:50.056649 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-144aecbe-4bb7-4475-aa8e-84bc5b3537d4 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 0.320150 Sep 08 10:54:50.057422 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1876/3738] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:49 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:50.063616 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0c7886bb-cf8a-447c-902e-cc3d0de8cd8f tempest-SecurityGroupsNegativeTestJSON-820245764 tempest-SecurityGroupsNegativeTestJSON-820245764-project] Calling method '.version_select at 0x7f68e4063e50>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:50.232610 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e6533b7b-9f53-4e58-9010-68fdcb309790 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups" status: 200 len: 1833 microversion: 2.1 time: 1.779143 Sep 08 10:54:50.233596 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1863/3739] 10.222.0.27 () {58 vars in 1158 bytes} [Thu Sep 8 10:54:48 2022] GET /compute/v2.1/os-security-groups => generated 1833 bytes in 1780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:50.248444 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-49e8d0df-9231-408c-b1fa-7bdb8b500911 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:50.249430 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-49e8d0df-9231-408c-b1fa-7bdb8b500911 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:50.269095 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49e8d0df-9231-408c-b1fa-7bdb8b500911 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:50.269993 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49e8d0df-9231-408c-b1fa-7bdb8b500911 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:50.270615 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49e8d0df-9231-408c-b1fa-7bdb8b500911 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:50.271531 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49e8d0df-9231-408c-b1fa-7bdb8b500911 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:50.272184 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49e8d0df-9231-408c-b1fa-7bdb8b500911 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:50.272788 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49e8d0df-9231-408c-b1fa-7bdb8b500911 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:50.275889 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0c7886bb-cf8a-447c-902e-cc3d0de8cd8f tempest-SecurityGroupsNegativeTestJSON-820245764 tempest-SecurityGroupsNegativeTestJSON-820245764-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.216445 Sep 08 10:54:50.276936 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1877/3740] 10.222.0.27 () {58 vars in 1158 bytes} [Thu Sep 8 10:54:50 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:54:50.293375 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f567e40a-5096-4eeb-8f74-6f1e21ffcc35 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-479478367", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "12aa0876-bb28-47d9-975a-2d76f1aa7c84"}]}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:54:50.417968 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.security_group_api [None req-f567e40a-5096-4eeb-8f74-6f1e21ffcc35 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Neutron security group does_not_exist not found {{(pid=128861) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Sep 08 10:54:50.418224 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-f567e40a-5096-4eeb-8f74-6f1e21ffcc35 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Sep 08 10:54:50.426715 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f567e40a-5096-4eeb-8f74-6f1e21ffcc35 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Request method failure captured: Sep 08 10:54:50.426715 n-d-850501-12 devstack@n-api.service[128861]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 10:54:50.426715 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:54:50.426715 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:54:50.426715 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:54:50.426715 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 257 Sep 08 10:54:50.426715 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:54:50.426715 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:54:50.426715 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:54:50.426715 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:54:50.426715 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcmnspi0cCT_Ts_s7jcB6HjtEcdULbQPd_krJniB9lBsXpm1cXSOD-YMaJoaapHCxuCXz0q6Qe4WXufr5At6SSPw8ov8Oz1eUk-fSNbVp7WlOPycfCf5I6xwH7tfbsoefVfbTiDOfU9mTBl0Vs74qdfTniErHfQlEG4cAvAQl1-wMrs Sep 08 10:54:50.426715 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:54:50.426715 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:54:50.426715 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:54:50.426715 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:54:50.426715 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:54:50.426715 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:54:50.426715 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:54:50.426715 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:54:50.426715 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:54:50.426715 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:54:50.426715 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:54:50.426715 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:54:50.426715 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:54:50.426715 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:54:50.426715 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:54:50.426715 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:54:50.426715 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:54:50.426715 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 7f551e6fe34243c290a25b57ab26af19 Sep 08 10:54:50.426715 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:54:50.426715 n-d-850501-12 devstack@n-api.service[128861]: Sep 08 10:54:50.426715 n-d-850501-12 devstack@n-api.service[128861]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-479478367", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "12aa0876-bb28-47d9-975a-2d76f1aa7c84"}]}} Sep 08 10:54:50.426715 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:54:50.426715 n-d-850501-12 devstack@n-api.service[128861]: exception: Unable to find security_group with name or id 'does_not_exist' Sep 08 10:54:50.426715 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-479478367', 'imageRef': '503f4a0f-e18f-47fd-ad12-0289e3463117', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '12aa0876-bb28-47d9-975a-2d76f1aa7c84'}]}}} Sep 08 10:54:50.426715 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:54:50.426715 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:50.426715 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Sep 08 10:54:50.426715 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Sep 08 10:54:50.426715 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:54:50.426715 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:54:50.426715 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Sep 08 10:54:50.426715 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Sep 08 10:54:50.426715 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Sep 08 10:54:50.426715 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:50.426715 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:54:50.426715 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:50.426715 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:50.426715 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Sep 08 10:54:50.426715 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Sep 08 10:54:50.426715 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:54:50.426715 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:54:50.426715 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Sep 08 10:54:50.426715 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Sep 08 10:54:50.426715 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Sep 08 10:54:50.426715 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:50.426715 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:54:50.426715 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:50.426715 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:50.426715 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Sep 08 10:54:50.426715 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Sep 08 10:54:50.433146 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Sep 08 10:54:50.433146 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Sep 08 10:54:50.433146 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Sep 08 10:54:50.433146 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Sep 08 10:54:50.433146 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:54:50.433146 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:54:50.433146 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Sep 08 10:54:50.433146 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Sep 08 10:54:50.433146 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Sep 08 10:54:50.433146 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:50.433146 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:54:50.433146 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:50.433146 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:50.433146 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 08 10:54:50.433146 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 08 10:54:50.433146 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 08 10:54:50.433146 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 08 10:54:50.433146 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Sep 08 10:54:50.433146 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Sep 08 10:54:50.433146 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Sep 08 10:54:50.433146 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Sep 08 10:54:50.433146 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Sep 08 10:54:50.433146 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Sep 08 10:54:50.433146 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Sep 08 10:54:50.433146 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 08 10:54:50.433146 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Sep 08 10:54:50.433146 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:50.433146 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:54:50.433146 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:50.433146 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:50.433146 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:54:50.433146 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:54:50.433146 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:54:50.433146 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:54:50.433146 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:54:50.433146 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:54:50.433146 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:54:50.433146 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:54:50.433146 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:54:50.433146 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:54:50.433146 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:54:50.433146 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:54:50.433146 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 08 10:54:50.433146 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 08 10:54:50.433146 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 08 10:54:50.433146 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Sep 08 10:54:50.433146 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:50.433146 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:54:50.433146 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:50.433146 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:50.433146 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:54:50.433146 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:54:50.433146 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:54:50.433146 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:54:50.433146 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Sep 08 10:54:50.433146 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:50.433146 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f567e40a-5096-4eeb-8f74-6f1e21ffcc35 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:54:50.446082 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f567e40a-5096-4eeb-8f74-6f1e21ffcc35 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.142541 Sep 08 10:54:50.446082 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1878/3741] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:54:50 2022] POST /compute/v2.1/servers => generated 106 bytes in 154 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:54:50.446082 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3e3f2c8e-46d4-4dff-aca5-cf2cdc307de8 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Calling method '.version_select at 0x7f68df9d1f70>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:50.729076 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-49e8d0df-9231-408c-b1fa-7bdb8b500911 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:50.741119 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-49e8d0df-9231-408c-b1fa-7bdb8b500911 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1684 microversion: 2.1 time: 0.506092 Sep 08 10:54:50.755141 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1864/3742] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:50 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1684 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:50.760311 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fe331b31-6167-4a1d-b771-53f165229198 tempest-SecurityGroupsNegativeTestJSON-820245764 tempest-SecurityGroupsNegativeTestJSON-820245764-project] Calling method '.version_select at 0x7f68e47480d0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:50.951138 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3e3f2c8e-46d4-4dff-aca5-cf2cdc307de8 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/540ef6b8-3e5b-4fdd-b2ef-f191f9f705fc" status: 202 len: 0 microversion: 2.1 time: 0.518167 Sep 08 10:54:50.955925 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1879/3743] 10.222.0.27 () {58 vars in 1272 bytes} [Thu Sep 8 10:54:50 2022] DELETE /compute/v2.1/os-security-groups/540ef6b8-3e5b-4fdd-b2ef-f191f9f705fc => generated 0 bytes in 523 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:54:50.971937 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6577bcf1-df23-4831-8e87-7fb85296ef4b tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:50.976993 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6577bcf1-df23-4831-8e87-7fb85296ef4b tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:50.997191 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6577bcf1-df23-4831-8e87-7fb85296ef4b tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:50.998337 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6577bcf1-df23-4831-8e87-7fb85296ef4b tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:50.999344 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6577bcf1-df23-4831-8e87-7fb85296ef4b tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:51.000358 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6577bcf1-df23-4831-8e87-7fb85296ef4b tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:51.001062 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6577bcf1-df23-4831-8e87-7fb85296ef4b tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:51.001718 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6577bcf1-df23-4831-8e87-7fb85296ef4b tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:51.144854 n-d-850501-12 devstack@n-api.service[128862]: DEBUG neutronclient.v2_0.client [None req-fe331b31-6167-4a1d-b771-53f165229198 tempest-SecurityGroupsNegativeTestJSON-820245764 tempest-SecurityGroupsNegativeTestJSON-820245764-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=128862) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 08 10:54:51.146055 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-fe331b31-6167-4a1d-b771-53f165229198 tempest-SecurityGroupsNegativeTestJSON-820245764 tempest-SecurityGroupsNegativeTestJSON-820245764-project] HTTP exception thrown: Insufficient rights for removing default security group. Sep 08 10:54:51.146055 n-d-850501-12 devstack@n-api.service[128862]: Neutron server returns request_ids: ['req-066e7572-e624-4f7c-9955-79a109323e11'] Sep 08 10:54:51.148265 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fe331b31-6167-4a1d-b771-53f165229198 tempest-SecurityGroupsNegativeTestJSON-820245764 tempest-SecurityGroupsNegativeTestJSON-820245764-project] Request method failure captured: Sep 08 10:54:51.148265 n-d-850501-12 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/os-security-groups/77f1071b-c7fc-4cec-a42d-9fc277644f4d HTTP/1.1 Sep 08 10:54:51.148265 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:54:51.148265 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:54:51.148265 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:54:51.148265 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:54:51.148265 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:54:51.148265 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:54:51.148265 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:54:51.148265 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:54:51.148265 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcn3phMnbv6b_Q_cH5xB3ooRsX80WkrtpBJumOdV2xrX2Erbz7xOHk1KefXxj1DqTqzlx2sdFt3aTuhzT02-DaHHhlUCuwXicAeKSEQ1higIksS5Eq4RZKEvX1oZDkG_zmBMzoN9VU4YBbLKrTyGr7pPAeRqQIkNCky-ljlLTcly3Gs Sep 08 10:54:51.148265 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:54:51.148265 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:54:51.148265 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:54:51.148265 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:54:51.148265 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:54:51.148265 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:54:51.148265 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: c82a1948079241f9a11aa5679040e7ed Sep 08 10:54:51.148265 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-820245764 Sep 08 10:54:51.148265 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:54:51.148265 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:54:51.148265 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c82a1948079241f9a11aa5679040e7ed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c82a1948079241f9a11aa5679040e7ed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c82a1948079241f9a11aa5679040e7ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c82a1948079241f9a11aa5679040e7ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:54:51.148265 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-820245764 Sep 08 10:54:51.148265 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: c82a1948079241f9a11aa5679040e7ed Sep 08 10:54:51.148265 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-820245764 Sep 08 10:54:51.148265 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-SecurityGroupsNegativeTestJSON-820245764-project Sep 08 10:54:51.148265 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:54:51.148265 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:54:51.148265 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 11a9c884b67a4afaa983ec4e3597bac1 Sep 08 10:54:51.148265 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-820245764-project Sep 08 10:54:51.148265 n-d-850501-12 devstack@n-api.service[128862]: method: Sep 08 10:54:51.148265 n-d-850501-12 devstack@n-api.service[128862]: exception: Insufficient rights for removing default security group. Sep 08 10:54:51.148265 n-d-850501-12 devstack@n-api.service[128862]: Neutron server returns request_ids: ['req-066e7572-e624-4f7c-9955-79a109323e11'] Sep 08 10:54:51.148265 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '77f1071b-c7fc-4cec-a42d-9fc277644f4d'} Sep 08 10:54:51.148265 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:54:51.148265 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:51.148265 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Sep 08 10:54:51.148265 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Sep 08 10:54:51.148265 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:54:51.148265 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:54:51.148265 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Sep 08 10:54:51.148265 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Sep 08 10:54:51.148265 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:54:51.148265 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:54:51.148265 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Sep 08 10:54:51.148265 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Sep 08 10:54:51.148265 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:54:51.148265 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:54:51.148265 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 08 10:54:51.148265 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 08 10:54:51.148265 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:54:51.148265 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:54:51.148265 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 08 10:54:51.148265 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 08 10:54:51.148265 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:54:51.148265 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:54:51.148265 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 08 10:54:51.148265 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 08 10:54:51.148265 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 08 10:54:51.148265 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 08 10:54:51.148265 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Sep 08 10:54:51.153668 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-066e7572-e624-4f7c-9955-79a109323e11'] Sep 08 10:54:51.153668 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:54:51.153668 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:54:51.153668 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:54:51.153668 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:51.153668 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Sep 08 10:54:51.153668 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Sep 08 10:54:51.153668 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Sep 08 10:54:51.153668 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Sep 08 10:54:51.153668 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Sep 08 10:54:51.153668 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-066e7572-e624-4f7c-9955-79a109323e11'] Sep 08 10:54:51.153668 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:54:51.153668 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:54:51.153668 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:54:51.153668 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:51.153668 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:54:51.153668 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:54:51.153668 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:54:51.153668 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:54:51.153668 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:54:51.153668 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:54:51.153668 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:54:51.153668 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:54:51.153668 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Sep 08 10:54:51.153668 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 08 10:54:51.153668 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Sep 08 10:54:51.153668 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-066e7572-e624-4f7c-9955-79a109323e11'] Sep 08 10:54:51.153668 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:54:51.153668 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:54:51.153668 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:54:51.153668 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:51.153668 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:54:51.153668 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:54:51.153668 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:54:51.153668 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:54:51.153668 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Sep 08 10:54:51.153668 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-066e7572-e624-4f7c-9955-79a109323e11'] Sep 08 10:54:51.153668 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:54:51.158619 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fe331b31-6167-4a1d-b771-53f165229198 tempest-SecurityGroupsNegativeTestJSON-820245764 tempest-SecurityGroupsNegativeTestJSON-820245764-project] Returning 400 to user: Insufficient rights for removing default security group. Sep 08 10:54:51.158619 n-d-850501-12 devstack@n-api.service[128862]: Neutron server returns request_ids: ['req-066e7572-e624-4f7c-9955-79a109323e11'] {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:54:51.160700 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fe331b31-6167-4a1d-b771-53f165229198 tempest-SecurityGroupsNegativeTestJSON-820245764 tempest-SecurityGroupsNegativeTestJSON-820245764-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/77f1071b-c7fc-4cec-a42d-9fc277644f4d" status: 400 len: 182 microversion: 2.1 time: 0.404147 Sep 08 10:54:51.161621 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1865/3744] 10.222.0.27 () {58 vars in 1272 bytes} [Thu Sep 8 10:54:50 2022] DELETE /compute/v2.1/os-security-groups/77f1071b-c7fc-4cec-a42d-9fc277644f4d => generated 182 bytes in 406 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:54:51.171375 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-77d6e322-a38e-41ec-a747-040b7ffaff0a tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:51.177119 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-77d6e322-a38e-41ec-a747-040b7ffaff0a tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: 19604289-6d42-403f-bf74-75335e1782cb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:51.208308 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-77d6e322-a38e-41ec-a747-040b7ffaff0a tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:51.208865 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-77d6e322-a38e-41ec-a747-040b7ffaff0a tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:51.212898 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-77d6e322-a38e-41ec-a747-040b7ffaff0a tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:51.218805 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-77d6e322-a38e-41ec-a747-040b7ffaff0a tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:51.219363 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-77d6e322-a38e-41ec-a747-040b7ffaff0a tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:51.219816 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-77d6e322-a38e-41ec-a747-040b7ffaff0a tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:51.368488 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6577bcf1-df23-4831-8e87-7fb85296ef4b tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:51.381973 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6577bcf1-df23-4831-8e87-7fb85296ef4b tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 0.423597 Sep 08 10:54:51.394745 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1880/3745] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:50 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:51.419977 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f9035ba1-5ab2-48d5-97aa-aadf876584e9 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Calling method '.version_select at 0x7f68e40d51f0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:51.462741 n-d-850501-12 devstack@n-api.service[128861]: DEBUG neutronclient.v2_0.client [None req-f9035ba1-5ab2-48d5-97aa-aadf876584e9 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 540ef6b8-3e5b-4fdd-b2ef-f191f9f705fc does not exist", "detail": ""}} {{(pid=128861) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 08 10:54:51.463558 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.security_group_api [None req-f9035ba1-5ab2-48d5-97aa-aadf876584e9 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Neutron security group 540ef6b8-3e5b-4fdd-b2ef-f191f9f705fc not found {{(pid=128861) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 08 10:54:51.465158 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-f9035ba1-5ab2-48d5-97aa-aadf876584e9 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] HTTP exception thrown: Security group 540ef6b8-3e5b-4fdd-b2ef-f191f9f705fc does not exist Sep 08 10:54:51.465158 n-d-850501-12 devstack@n-api.service[128861]: Neutron server returns request_ids: ['req-592e16e2-c20c-4856-8b11-c32da46aac3d'] Sep 08 10:54:51.467068 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f9035ba1-5ab2-48d5-97aa-aadf876584e9 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Request method failure captured: Sep 08 10:54:51.467068 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/os-security-groups/540ef6b8-3e5b-4fdd-b2ef-f191f9f705fc HTTP/1.1 Sep 08 10:54:51.467068 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:54:51.467068 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:54:51.467068 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:54:51.467068 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:54:51.467068 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:54:51.467068 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:54:51.467068 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:54:51.467068 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:54:51.467068 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcnTIBfdH5H0Q1rMlbnLYZQcAnuATI-6ncC0ETqGOy19nshWBWc6mMSPvOE_5zGIQBC9DCOSD4SaG9XyRLj03fab4bxuKCvYlxZzzB9WEeCTo5mGH1uU5x9CALWtC8B7Wu8ih4rvxppcLmpz4ET9xD3ym8uzzB22kwTIB3vo0v5dqyY Sep 08 10:54:51.467068 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:54:51.467068 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:54:51.467068 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:54:51.467068 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:54:51.467068 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:54:51.467068 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:54:51.467068 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 0958700fa94b42b2b6b47af40cf2f679 Sep 08 10:54:51.467068 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-SecurityGroupsTestJSON-353861575 Sep 08 10:54:51.467068 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:54:51.467068 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:54:51.467068 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0958700fa94b42b2b6b47af40cf2f679"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0958700fa94b42b2b6b47af40cf2f679"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0958700fa94b42b2b6b47af40cf2f679"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0958700fa94b42b2b6b47af40cf2f679"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:54:51.467068 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-SecurityGroupsTestJSON-353861575 Sep 08 10:54:51.467068 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 0958700fa94b42b2b6b47af40cf2f679 Sep 08 10:54:51.467068 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-353861575 Sep 08 10:54:51.467068 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-SecurityGroupsTestJSON-353861575-project Sep 08 10:54:51.467068 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:54:51.467068 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:54:51.467068 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: e1bec228c17647bba62ba7d57d28e4ed Sep 08 10:54:51.467068 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-SecurityGroupsTestJSON-353861575-project Sep 08 10:54:51.467068 n-d-850501-12 devstack@n-api.service[128861]: method: Sep 08 10:54:51.467068 n-d-850501-12 devstack@n-api.service[128861]: exception: Security group 540ef6b8-3e5b-4fdd-b2ef-f191f9f705fc does not exist Sep 08 10:54:51.467068 n-d-850501-12 devstack@n-api.service[128861]: Neutron server returns request_ids: ['req-592e16e2-c20c-4856-8b11-c32da46aac3d'] Sep 08 10:54:51.467068 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '540ef6b8-3e5b-4fdd-b2ef-f191f9f705fc'} Sep 08 10:54:51.467068 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:54:51.467068 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:51.467068 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 08 10:54:51.467068 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 08 10:54:51.467068 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:54:51.467068 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:54:51.467068 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 08 10:54:51.467068 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 08 10:54:51.467068 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:54:51.467068 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:54:51.467068 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 08 10:54:51.467068 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 08 10:54:51.467068 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:54:51.467068 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:54:51.467068 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 08 10:54:51.467068 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 08 10:54:51.467068 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:54:51.467068 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:54:51.467068 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 08 10:54:51.467068 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 08 10:54:51.467068 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:54:51.467068 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:54:51.467068 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 08 10:54:51.467068 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 08 10:54:51.467068 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 08 10:54:51.467068 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 08 10:54:51.467068 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 540ef6b8-3e5b-4fdd-b2ef-f191f9f705fc does not exist Sep 08 10:54:51.472951 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-592e16e2-c20c-4856-8b11-c32da46aac3d'] Sep 08 10:54:51.472951 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:51.472951 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:54:51.472951 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:51.472951 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:51.472951 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 08 10:54:51.472951 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 08 10:54:51.472951 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 08 10:54:51.472951 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 08 10:54:51.472951 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 540ef6b8-3e5b-4fdd-b2ef-f191f9f705fc does not exist Sep 08 10:54:51.472951 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-592e16e2-c20c-4856-8b11-c32da46aac3d'] Sep 08 10:54:51.472951 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:51.472951 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:54:51.472951 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:51.472951 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:51.472951 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:54:51.472951 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:54:51.472951 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:54:51.472951 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:54:51.472951 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:54:51.472951 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:54:51.472951 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:54:51.472951 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:54:51.472951 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 08 10:54:51.472951 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 08 10:54:51.472951 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 540ef6b8-3e5b-4fdd-b2ef-f191f9f705fc does not exist Sep 08 10:54:51.472951 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-592e16e2-c20c-4856-8b11-c32da46aac3d'] Sep 08 10:54:51.472951 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:51.472951 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:54:51.472951 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:51.472951 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:51.472951 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:54:51.472951 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:54:51.472951 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:54:51.472951 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:54:51.472951 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 540ef6b8-3e5b-4fdd-b2ef-f191f9f705fc does not exist Sep 08 10:54:51.472951 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-592e16e2-c20c-4856-8b11-c32da46aac3d'] Sep 08 10:54:51.472951 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:51.472951 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f9035ba1-5ab2-48d5-97aa-aadf876584e9 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Returning 404 to user: Security group 540ef6b8-3e5b-4fdd-b2ef-f191f9f705fc does not exist Sep 08 10:54:51.472951 n-d-850501-12 devstack@n-api.service[128861]: Neutron server returns request_ids: ['req-592e16e2-c20c-4856-8b11-c32da46aac3d'] {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:54:51.472951 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f9035ba1-5ab2-48d5-97aa-aadf876584e9 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/540ef6b8-3e5b-4fdd-b2ef-f191f9f705fc" status: 404 len: 194 microversion: 2.1 time: 0.072814 Sep 08 10:54:51.475941 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1881/3746] 10.222.0.27 () {58 vars in 1269 bytes} [Thu Sep 8 10:54:51 2022] GET /compute/v2.1/os-security-groups/540ef6b8-3e5b-4fdd-b2ef-f191f9f705fc => generated 194 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:54:51.482878 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5a7f3df6-53c3-4058-bbb6-73ef2379cebe tempest-SecurityGroupsNegativeTestJSON-820245764 tempest-SecurityGroupsNegativeTestJSON-820245764-project] Calling method '.version_select at 0x7f68dfad1280>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:51.522171 n-d-850501-12 devstack@n-api.service[128861]: DEBUG neutronclient.v2_0.client [None req-5a7f3df6-53c3-4058-bbb6-73ef2379cebe tempest-SecurityGroupsNegativeTestJSON-820245764 tempest-SecurityGroupsNegativeTestJSON-820245764-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 2597053e-5dc8-4385-9ee6-1b1c30cf7663 does not exist", "detail": ""}} {{(pid=128861) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 08 10:54:51.522877 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.security_group_api [None req-5a7f3df6-53c3-4058-bbb6-73ef2379cebe tempest-SecurityGroupsNegativeTestJSON-820245764 tempest-SecurityGroupsNegativeTestJSON-820245764-project] Neutron security group 2597053e-5dc8-4385-9ee6-1b1c30cf7663 not found {{(pid=128861) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 08 10:54:51.523401 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-5a7f3df6-53c3-4058-bbb6-73ef2379cebe tempest-SecurityGroupsNegativeTestJSON-820245764 tempest-SecurityGroupsNegativeTestJSON-820245764-project] HTTP exception thrown: Security group 2597053e-5dc8-4385-9ee6-1b1c30cf7663 does not exist Sep 08 10:54:51.523401 n-d-850501-12 devstack@n-api.service[128861]: Neutron server returns request_ids: ['req-fb2cc36f-ba9f-457f-a599-4fa4d7ac1e4a'] Sep 08 10:54:51.528367 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5a7f3df6-53c3-4058-bbb6-73ef2379cebe tempest-SecurityGroupsNegativeTestJSON-820245764 tempest-SecurityGroupsNegativeTestJSON-820245764-project] Request method failure captured: Sep 08 10:54:51.528367 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/os-security-groups/2597053e-5dc8-4385-9ee6-1b1c30cf7663 HTTP/1.1 Sep 08 10:54:51.528367 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:54:51.528367 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:54:51.528367 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:54:51.528367 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:54:51.528367 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:54:51.528367 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:54:51.528367 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:54:51.528367 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:54:51.528367 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcn3phMnbv6b_Q_cH5xB3ooRsX80WkrtpBJumOdV2xrX2Erbz7xOHk1KefXxj1DqTqzlx2sdFt3aTuhzT02-DaHHhlUCuwXicAeKSEQ1higIksS5Eq4RZKEvX1oZDkG_zmBMzoN9VU4YBbLKrTyGr7pPAeRqQIkNCky-ljlLTcly3Gs Sep 08 10:54:51.528367 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:54:51.528367 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:54:51.528367 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:54:51.528367 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:54:51.528367 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:54:51.528367 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:54:51.528367 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: c82a1948079241f9a11aa5679040e7ed Sep 08 10:54:51.528367 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-820245764 Sep 08 10:54:51.528367 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:54:51.528367 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:54:51.528367 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c82a1948079241f9a11aa5679040e7ed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c82a1948079241f9a11aa5679040e7ed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c82a1948079241f9a11aa5679040e7ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c82a1948079241f9a11aa5679040e7ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:54:51.528367 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-820245764 Sep 08 10:54:51.528367 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: c82a1948079241f9a11aa5679040e7ed Sep 08 10:54:51.528367 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-820245764 Sep 08 10:54:51.528367 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-SecurityGroupsNegativeTestJSON-820245764-project Sep 08 10:54:51.528367 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:54:51.528367 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:54:51.528367 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 11a9c884b67a4afaa983ec4e3597bac1 Sep 08 10:54:51.528367 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-820245764-project Sep 08 10:54:51.528367 n-d-850501-12 devstack@n-api.service[128861]: method: Sep 08 10:54:51.528367 n-d-850501-12 devstack@n-api.service[128861]: exception: Security group 2597053e-5dc8-4385-9ee6-1b1c30cf7663 does not exist Sep 08 10:54:51.528367 n-d-850501-12 devstack@n-api.service[128861]: Neutron server returns request_ids: ['req-fb2cc36f-ba9f-457f-a599-4fa4d7ac1e4a'] Sep 08 10:54:51.528367 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '2597053e-5dc8-4385-9ee6-1b1c30cf7663'} Sep 08 10:54:51.528367 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:54:51.528367 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:51.528367 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 08 10:54:51.528367 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 08 10:54:51.528367 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:54:51.528367 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:54:51.528367 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 08 10:54:51.528367 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 08 10:54:51.528367 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:54:51.528367 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:54:51.528367 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 08 10:54:51.528367 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 08 10:54:51.528367 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:54:51.528367 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:54:51.528367 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 08 10:54:51.528367 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 08 10:54:51.528367 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:54:51.528367 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:54:51.528367 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 08 10:54:51.528367 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 08 10:54:51.528367 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:54:51.528367 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:54:51.528367 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 08 10:54:51.528367 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 08 10:54:51.528367 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 08 10:54:51.528367 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 08 10:54:51.528367 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 2597053e-5dc8-4385-9ee6-1b1c30cf7663 does not exist Sep 08 10:54:51.532894 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fb2cc36f-ba9f-457f-a599-4fa4d7ac1e4a'] Sep 08 10:54:51.532894 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:51.532894 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:54:51.532894 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:51.532894 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:51.532894 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 08 10:54:51.532894 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 08 10:54:51.532894 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 08 10:54:51.532894 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 08 10:54:51.532894 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 2597053e-5dc8-4385-9ee6-1b1c30cf7663 does not exist Sep 08 10:54:51.532894 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fb2cc36f-ba9f-457f-a599-4fa4d7ac1e4a'] Sep 08 10:54:51.532894 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:51.532894 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:54:51.532894 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:51.532894 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:51.532894 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:54:51.532894 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:54:51.532894 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:54:51.532894 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:54:51.532894 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:54:51.532894 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:54:51.532894 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:54:51.532894 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:54:51.532894 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 08 10:54:51.532894 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 08 10:54:51.532894 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 2597053e-5dc8-4385-9ee6-1b1c30cf7663 does not exist Sep 08 10:54:51.532894 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fb2cc36f-ba9f-457f-a599-4fa4d7ac1e4a'] Sep 08 10:54:51.532894 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:51.532894 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:54:51.532894 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:51.532894 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:51.532894 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:54:51.532894 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:54:51.532894 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:54:51.532894 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:54:51.532894 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 2597053e-5dc8-4385-9ee6-1b1c30cf7663 does not exist Sep 08 10:54:51.532894 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fb2cc36f-ba9f-457f-a599-4fa4d7ac1e4a'] Sep 08 10:54:51.532894 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:51.532894 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5a7f3df6-53c3-4058-bbb6-73ef2379cebe tempest-SecurityGroupsNegativeTestJSON-820245764 tempest-SecurityGroupsNegativeTestJSON-820245764-project] Returning 404 to user: Security group 2597053e-5dc8-4385-9ee6-1b1c30cf7663 does not exist Sep 08 10:54:51.532894 n-d-850501-12 devstack@n-api.service[128861]: Neutron server returns request_ids: ['req-fb2cc36f-ba9f-457f-a599-4fa4d7ac1e4a'] {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:54:51.532894 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5a7f3df6-53c3-4058-bbb6-73ef2379cebe tempest-SecurityGroupsNegativeTestJSON-820245764 tempest-SecurityGroupsNegativeTestJSON-820245764-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/2597053e-5dc8-4385-9ee6-1b1c30cf7663" status: 404 len: 194 microversion: 2.1 time: 0.055296 Sep 08 10:54:51.532894 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1882/3747] 10.222.0.27 () {58 vars in 1269 bytes} [Thu Sep 8 10:54:51 2022] GET /compute/v2.1/os-security-groups/2597053e-5dc8-4385-9ee6-1b1c30cf7663 => generated 194 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:54:51.540192 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b747b1f2-df98-4900-a6e0-2bcf1a0846a4 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:51.540192 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b747b1f2-df98-4900-a6e0-2bcf1a0846a4 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:51.548292 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b747b1f2-df98-4900-a6e0-2bcf1a0846a4 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:51.548799 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b747b1f2-df98-4900-a6e0-2bcf1a0846a4 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:51.549288 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b747b1f2-df98-4900-a6e0-2bcf1a0846a4 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:51.551083 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b747b1f2-df98-4900-a6e0-2bcf1a0846a4 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:51.551591 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b747b1f2-df98-4900-a6e0-2bcf1a0846a4 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:51.552075 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b747b1f2-df98-4900-a6e0-2bcf1a0846a4 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:51.578300 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=100 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:54:51.817581 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b747b1f2-df98-4900-a6e0-2bcf1a0846a4 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:51.827896 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b747b1f2-df98-4900-a6e0-2bcf1a0846a4 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 0.294825 Sep 08 10:54:51.828479 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1883/3748] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:51 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:51.849864 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a0d33b7a-e3b3-416b-ad1f-c86c3dcbe2fc tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Calling method '.version_select at 0x7f68e4555790>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:51.963385 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-77d6e322-a38e-41ec-a747-040b7ffaff0a tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c291cbe955b4ee5abc98132dda0255e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f9a24cad014d7f827e8f3236dd5bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:51.977495 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-77d6e322-a38e-41ec-a747-040b7ffaff0a tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/19604289-6d42-403f-bf74-75335e1782cb" status: 200 len: 1681 microversion: 2.1 time: 0.814523 Sep 08 10:54:52.000738 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1866/3749] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:51 2022] GET /compute/v2.1/servers/19604289-6d42-403f-bf74-75335e1782cb => generated 1681 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:52.021013 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3afaa6a3-3acc-4006-8acf-8df03790e6b5 tempest-SecurityGroupsNegativeTestJSON-820245764 tempest-SecurityGroupsNegativeTestJSON-820245764-project] Action: 'update', calling method: .version_select at 0x7f68e478faf0>, body: {"security_group": {"name": "tempest-sg-1622308463", "description": "tempest-description-1536974770"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:54:52.096963 n-d-850501-12 devstack@n-api.service[128862]: DEBUG neutronclient.v2_0.client [None req-3afaa6a3-3acc-4006-8acf-8df03790e6b5 tempest-SecurityGroupsNegativeTestJSON-820245764 tempest-SecurityGroupsNegativeTestJSON-820245764-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 073b11bf-4f06-44c0-9f48-f316fd4e1f97 does not exist", "detail": ""}} {{(pid=128862) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 08 10:54:52.097922 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.security_group_api [None req-3afaa6a3-3acc-4006-8acf-8df03790e6b5 tempest-SecurityGroupsNegativeTestJSON-820245764 tempest-SecurityGroupsNegativeTestJSON-820245764-project] Neutron security group 073b11bf-4f06-44c0-9f48-f316fd4e1f97 not found {{(pid=128862) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 08 10:54:52.098628 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-3afaa6a3-3acc-4006-8acf-8df03790e6b5 tempest-SecurityGroupsNegativeTestJSON-820245764 tempest-SecurityGroupsNegativeTestJSON-820245764-project] HTTP exception thrown: Security group 073b11bf-4f06-44c0-9f48-f316fd4e1f97 does not exist Sep 08 10:54:52.098628 n-d-850501-12 devstack@n-api.service[128862]: Neutron server returns request_ids: ['req-f1b060f1-889c-4ed7-adf0-a26f1175a0fb'] Sep 08 10:54:52.100926 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3afaa6a3-3acc-4006-8acf-8df03790e6b5 tempest-SecurityGroupsNegativeTestJSON-820245764 tempest-SecurityGroupsNegativeTestJSON-820245764-project] Request method failure captured: Sep 08 10:54:52.100926 n-d-850501-12 devstack@n-api.service[128862]: request: PUT /compute/v2.1/os-security-groups/073b11bf-4f06-44c0-9f48-f316fd4e1f97 HTTP/1.1 Sep 08 10:54:52.100926 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:54:52.100926 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:54:52.100926 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:54:52.100926 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 102 Sep 08 10:54:52.100926 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:54:52.100926 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:54:52.100926 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:54:52.100926 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:54:52.100926 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcn3phMnbv6b_Q_cH5xB3ooRsX80WkrtpBJumOdV2xrX2Erbz7xOHk1KefXxj1DqTqzlx2sdFt3aTuhzT02-DaHHhlUCuwXicAeKSEQ1higIksS5Eq4RZKEvX1oZDkG_zmBMzoN9VU4YBbLKrTyGr7pPAeRqQIkNCky-ljlLTcly3Gs Sep 08 10:54:52.100926 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:54:52.100926 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:54:52.100926 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:54:52.100926 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:54:52.100926 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:54:52.100926 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:54:52.100926 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: c82a1948079241f9a11aa5679040e7ed Sep 08 10:54:52.100926 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-820245764 Sep 08 10:54:52.100926 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:54:52.100926 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:54:52.100926 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c82a1948079241f9a11aa5679040e7ed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c82a1948079241f9a11aa5679040e7ed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c82a1948079241f9a11aa5679040e7ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c82a1948079241f9a11aa5679040e7ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:54:52.100926 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-820245764 Sep 08 10:54:52.100926 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: c82a1948079241f9a11aa5679040e7ed Sep 08 10:54:52.100926 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-820245764 Sep 08 10:54:52.100926 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-SecurityGroupsNegativeTestJSON-820245764-project Sep 08 10:54:52.100926 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:54:52.100926 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:54:52.100926 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 11a9c884b67a4afaa983ec4e3597bac1 Sep 08 10:54:52.100926 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-820245764-project Sep 08 10:54:52.100926 n-d-850501-12 devstack@n-api.service[128862]: Sep 08 10:54:52.100926 n-d-850501-12 devstack@n-api.service[128862]: {"security_group": {"name": "tempest-sg-1622308463", "description": "tempest-description-1536974770"}} Sep 08 10:54:52.100926 n-d-850501-12 devstack@n-api.service[128862]: method: Sep 08 10:54:52.100926 n-d-850501-12 devstack@n-api.service[128862]: exception: Security group 073b11bf-4f06-44c0-9f48-f316fd4e1f97 does not exist Sep 08 10:54:52.100926 n-d-850501-12 devstack@n-api.service[128862]: Neutron server returns request_ids: ['req-f1b060f1-889c-4ed7-adf0-a26f1175a0fb'] Sep 08 10:54:52.100926 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '073b11bf-4f06-44c0-9f48-f316fd4e1f97', 'body': {'security_group': {'name': 'tempest-sg-1622308463', 'description': 'tempest-description-1536974770'}}} Sep 08 10:54:52.100926 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:54:52.100926 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:52.100926 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 08 10:54:52.100926 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 08 10:54:52.100926 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:54:52.100926 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:54:52.100926 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 08 10:54:52.100926 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 08 10:54:52.100926 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:54:52.100926 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:54:52.100926 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 08 10:54:52.100926 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 08 10:54:52.100926 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:54:52.100926 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:54:52.100926 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 08 10:54:52.100926 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 08 10:54:52.100926 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:54:52.100926 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:54:52.100926 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 08 10:54:52.100926 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 08 10:54:52.100926 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:54:52.100926 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:54:52.100926 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 08 10:54:52.100926 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 08 10:54:52.100926 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 08 10:54:52.106050 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 08 10:54:52.106050 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 073b11bf-4f06-44c0-9f48-f316fd4e1f97 does not exist Sep 08 10:54:52.106050 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f1b060f1-889c-4ed7-adf0-a26f1175a0fb'] Sep 08 10:54:52.106050 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:54:52.106050 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:54:52.106050 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:54:52.106050 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:52.106050 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Sep 08 10:54:52.106050 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 08 10:54:52.106050 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 08 10:54:52.106050 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 08 10:54:52.106050 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 073b11bf-4f06-44c0-9f48-f316fd4e1f97 does not exist Sep 08 10:54:52.106050 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f1b060f1-889c-4ed7-adf0-a26f1175a0fb'] Sep 08 10:54:52.106050 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:54:52.106050 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:54:52.106050 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:54:52.106050 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:52.106050 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:54:52.106050 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:54:52.106050 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:54:52.106050 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:54:52.106050 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:54:52.106050 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:54:52.106050 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:54:52.106050 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:54:52.106050 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Sep 08 10:54:52.106050 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 08 10:54:52.106050 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 073b11bf-4f06-44c0-9f48-f316fd4e1f97 does not exist Sep 08 10:54:52.106050 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f1b060f1-889c-4ed7-adf0-a26f1175a0fb'] Sep 08 10:54:52.106050 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:54:52.106050 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:54:52.106050 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:54:52.106050 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:52.106050 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:54:52.106050 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:54:52.106050 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:54:52.106050 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:54:52.106050 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 073b11bf-4f06-44c0-9f48-f316fd4e1f97 does not exist Sep 08 10:54:52.106050 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f1b060f1-889c-4ed7-adf0-a26f1175a0fb'] Sep 08 10:54:52.106050 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:54:52.110696 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3afaa6a3-3acc-4006-8acf-8df03790e6b5 tempest-SecurityGroupsNegativeTestJSON-820245764 tempest-SecurityGroupsNegativeTestJSON-820245764-project] Returning 404 to user: Security group 073b11bf-4f06-44c0-9f48-f316fd4e1f97 does not exist Sep 08 10:54:52.110696 n-d-850501-12 devstack@n-api.service[128862]: Neutron server returns request_ids: ['req-f1b060f1-889c-4ed7-adf0-a26f1175a0fb'] {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:54:52.113241 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3afaa6a3-3acc-4006-8acf-8df03790e6b5 tempest-SecurityGroupsNegativeTestJSON-820245764 tempest-SecurityGroupsNegativeTestJSON-820245764-project] 10.222.0.27 "PUT /compute/v2.1/os-security-groups/073b11bf-4f06-44c0-9f48-f316fd4e1f97" status: 404 len: 194 microversion: 2.1 time: 0.110825 Sep 08 10:54:52.134163 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1867/3750] 10.222.0.27 () {60 vars in 1290 bytes} [Thu Sep 8 10:54:52 2022] PUT /compute/v2.1/os-security-groups/073b11bf-4f06-44c0-9f48-f316fd4e1f97 => generated 194 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:54:52.140630 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bd351202-701f-4f68-9215-628d9410b478 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:52.141586 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bd351202-701f-4f68-9215-628d9410b478 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:52.150088 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bd351202-701f-4f68-9215-628d9410b478 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:52.151276 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bd351202-701f-4f68-9215-628d9410b478 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:52.151984 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bd351202-701f-4f68-9215-628d9410b478 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:52.152930 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bd351202-701f-4f68-9215-628d9410b478 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:52.153611 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bd351202-701f-4f68-9215-628d9410b478 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:52.154234 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bd351202-701f-4f68-9215-628d9410b478 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:52.380410 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a0d33b7a-e3b3-416b-ad1f-c86c3dcbe2fc tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/9ddb7c1d-4f44-4670-b703-506a13de29d8" status: 202 len: 0 microversion: 2.1 time: 0.547026 Sep 08 10:54:52.381360 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1884/3751] 10.222.0.27 () {58 vars in 1272 bytes} [Thu Sep 8 10:54:51 2022] DELETE /compute/v2.1/os-security-groups/9ddb7c1d-4f44-4670-b703-506a13de29d8 => generated 0 bytes in 548 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:54:52.386535 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-25fe0245-0e77-48a4-8aa6-2428caeaaf31 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:52.387291 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-25fe0245-0e77-48a4-8aa6-2428caeaaf31 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 10f94be2-6265-4f82-b13f-7fcc67ebec08] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:52.400412 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-25fe0245-0e77-48a4-8aa6-2428caeaaf31 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] HTTP exception thrown: Instance 10f94be2-6265-4f82-b13f-7fcc67ebec08 could not be found. Sep 08 10:54:52.401958 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-25fe0245-0e77-48a4-8aa6-2428caeaaf31 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Request method failure captured: Sep 08 10:54:52.401958 n-d-850501-12 devstack@n-api.service[128861]: request: DELETE /compute/v2.1/servers/10f94be2-6265-4f82-b13f-7fcc67ebec08 HTTP/1.1 Sep 08 10:54:52.401958 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:54:52.401958 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:54:52.401958 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:54:52.401958 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:54:52.401958 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:54:52.401958 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:54:52.401958 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:54:52.401958 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:54:52.401958 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcmnspi0cCT_Ts_s7jcB6HjtEcdULbQPd_krJniB9lBsXpm1cXSOD-YMaJoaapHCxuCXz0q6Qe4WXufr5At6SSPw8ov8Oz1eUk-fSNbVp7WlOPycfCf5I6xwH7tfbsoefVfbTiDOfU9mTBl0Vs74qdfTniErHfQlEG4cAvAQl1-wMrs Sep 08 10:54:52.401958 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:54:52.401958 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:54:52.401958 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:54:52.401958 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:54:52.401958 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:54:52.401958 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:54:52.401958 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:54:52.401958 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:54:52.401958 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:54:52.401958 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:54:52.401958 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:54:52.401958 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:54:52.401958 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:54:52.401958 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:54:52.401958 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:54:52.401958 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:54:52.401958 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:54:52.401958 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 7f551e6fe34243c290a25b57ab26af19 Sep 08 10:54:52.401958 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:54:52.401958 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:54:52.401958 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 10f94be2-6265-4f82-b13f-7fcc67ebec08 could not be found. Sep 08 10:54:52.401958 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '10f94be2-6265-4f82-b13f-7fcc67ebec08'} Sep 08 10:54:52.401958 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:54:52.401958 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:52.401958 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:54:52.401958 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:54:52.401958 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:54:52.401958 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:54:52.401958 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 08 10:54:52.401958 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 08 10:54:52.401958 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10f94be2-6265-4f82-b13f-7fcc67ebec08 could not be found. Sep 08 10:54:52.401958 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:52.401958 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:54:52.401958 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:52.401958 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:52.401958 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:54:52.401958 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:54:52.401958 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:54:52.401958 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:54:52.401958 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:54:52.401958 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:54:52.401958 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:54:52.401958 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:54:52.401958 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:54:52.401958 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:54:52.401958 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:54:52.401958 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:54:52.401958 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:54:52.401958 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:54:52.401958 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10f94be2-6265-4f82-b13f-7fcc67ebec08 could not be found. Sep 08 10:54:52.401958 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:52.401958 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:54:52.408158 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:52.408158 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:52.408158 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:54:52.408158 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:54:52.408158 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:54:52.408158 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:54:52.408158 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10f94be2-6265-4f82-b13f-7fcc67ebec08 could not be found. Sep 08 10:54:52.408158 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:52.408158 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-25fe0245-0e77-48a4-8aa6-2428caeaaf31 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Returning 404 to user: Instance 10f94be2-6265-4f82-b13f-7fcc67ebec08 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:54:52.409268 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-25fe0245-0e77-48a4-8aa6-2428caeaaf31 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "DELETE /compute/v2.1/servers/10f94be2-6265-4f82-b13f-7fcc67ebec08" status: 404 len: 111 microversion: 2.1 time: 0.026715 Sep 08 10:54:52.412644 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1885/3752] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:54:52 2022] DELETE /compute/v2.1/servers/10f94be2-6265-4f82-b13f-7fcc67ebec08 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:54:52.423660 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-13dea4a6-f48c-4c73-844e-60a487bb4337 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Calling method '.version_select at 0x7f68dfa33160>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:52.467370 n-d-850501-12 devstack@n-api.service[128861]: DEBUG neutronclient.v2_0.client [None req-13dea4a6-f48c-4c73-844e-60a487bb4337 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9ddb7c1d-4f44-4670-b703-506a13de29d8 does not exist", "detail": ""}} {{(pid=128861) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 08 10:54:52.468368 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.security_group_api [None req-13dea4a6-f48c-4c73-844e-60a487bb4337 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Neutron security group 9ddb7c1d-4f44-4670-b703-506a13de29d8 not found {{(pid=128861) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 08 10:54:52.469217 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-13dea4a6-f48c-4c73-844e-60a487bb4337 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] HTTP exception thrown: Security group 9ddb7c1d-4f44-4670-b703-506a13de29d8 does not exist Sep 08 10:54:52.469217 n-d-850501-12 devstack@n-api.service[128861]: Neutron server returns request_ids: ['req-2244da76-8344-4ce4-998f-ec6cf69525c2'] Sep 08 10:54:52.472293 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-13dea4a6-f48c-4c73-844e-60a487bb4337 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Request method failure captured: Sep 08 10:54:52.472293 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/os-security-groups/9ddb7c1d-4f44-4670-b703-506a13de29d8 HTTP/1.1 Sep 08 10:54:52.472293 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:54:52.472293 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:54:52.472293 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:54:52.472293 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:54:52.472293 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:54:52.472293 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:54:52.472293 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:54:52.472293 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:54:52.472293 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcnTIBfdH5H0Q1rMlbnLYZQcAnuATI-6ncC0ETqGOy19nshWBWc6mMSPvOE_5zGIQBC9DCOSD4SaG9XyRLj03fab4bxuKCvYlxZzzB9WEeCTo5mGH1uU5x9CALWtC8B7Wu8ih4rvxppcLmpz4ET9xD3ym8uzzB22kwTIB3vo0v5dqyY Sep 08 10:54:52.472293 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:54:52.472293 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:54:52.472293 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:54:52.472293 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:54:52.472293 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:54:52.472293 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:54:52.472293 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 0958700fa94b42b2b6b47af40cf2f679 Sep 08 10:54:52.472293 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-SecurityGroupsTestJSON-353861575 Sep 08 10:54:52.472293 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:54:52.472293 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:54:52.472293 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0958700fa94b42b2b6b47af40cf2f679"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0958700fa94b42b2b6b47af40cf2f679"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0958700fa94b42b2b6b47af40cf2f679"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0958700fa94b42b2b6b47af40cf2f679"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:54:52.472293 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-SecurityGroupsTestJSON-353861575 Sep 08 10:54:52.472293 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 0958700fa94b42b2b6b47af40cf2f679 Sep 08 10:54:52.472293 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-353861575 Sep 08 10:54:52.472293 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-SecurityGroupsTestJSON-353861575-project Sep 08 10:54:52.472293 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:54:52.472293 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:54:52.472293 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: e1bec228c17647bba62ba7d57d28e4ed Sep 08 10:54:52.472293 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-SecurityGroupsTestJSON-353861575-project Sep 08 10:54:52.472293 n-d-850501-12 devstack@n-api.service[128861]: method: Sep 08 10:54:52.472293 n-d-850501-12 devstack@n-api.service[128861]: exception: Security group 9ddb7c1d-4f44-4670-b703-506a13de29d8 does not exist Sep 08 10:54:52.472293 n-d-850501-12 devstack@n-api.service[128861]: Neutron server returns request_ids: ['req-2244da76-8344-4ce4-998f-ec6cf69525c2'] Sep 08 10:54:52.472293 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '9ddb7c1d-4f44-4670-b703-506a13de29d8'} Sep 08 10:54:52.472293 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:54:52.472293 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:52.472293 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 08 10:54:52.472293 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 08 10:54:52.472293 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:54:52.472293 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:54:52.472293 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 08 10:54:52.472293 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 08 10:54:52.472293 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:54:52.472293 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:54:52.472293 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 08 10:54:52.472293 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 08 10:54:52.472293 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:54:52.472293 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:54:52.472293 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 08 10:54:52.472293 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 08 10:54:52.472293 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:54:52.472293 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:54:52.472293 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 08 10:54:52.472293 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 08 10:54:52.472293 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:54:52.472293 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:54:52.472293 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 08 10:54:52.472293 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 08 10:54:52.472293 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 08 10:54:52.472293 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 08 10:54:52.472293 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9ddb7c1d-4f44-4670-b703-506a13de29d8 does not exist Sep 08 10:54:52.478220 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2244da76-8344-4ce4-998f-ec6cf69525c2'] Sep 08 10:54:52.478220 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:52.478220 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:54:52.478220 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:52.478220 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:52.478220 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 08 10:54:52.478220 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 08 10:54:52.478220 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 08 10:54:52.478220 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 08 10:54:52.478220 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9ddb7c1d-4f44-4670-b703-506a13de29d8 does not exist Sep 08 10:54:52.478220 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2244da76-8344-4ce4-998f-ec6cf69525c2'] Sep 08 10:54:52.478220 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:52.478220 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:54:52.478220 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:52.478220 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:52.478220 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:54:52.478220 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:54:52.478220 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:54:52.478220 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:54:52.478220 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:54:52.478220 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:54:52.478220 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:54:52.478220 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:54:52.478220 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 08 10:54:52.478220 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 08 10:54:52.478220 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9ddb7c1d-4f44-4670-b703-506a13de29d8 does not exist Sep 08 10:54:52.478220 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2244da76-8344-4ce4-998f-ec6cf69525c2'] Sep 08 10:54:52.478220 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:52.478220 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:54:52.478220 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:52.478220 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:52.478220 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:54:52.478220 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:54:52.478220 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:54:52.478220 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:54:52.478220 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9ddb7c1d-4f44-4670-b703-506a13de29d8 does not exist Sep 08 10:54:52.478220 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2244da76-8344-4ce4-998f-ec6cf69525c2'] Sep 08 10:54:52.478220 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:52.483850 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-13dea4a6-f48c-4c73-844e-60a487bb4337 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Returning 404 to user: Security group 9ddb7c1d-4f44-4670-b703-506a13de29d8 does not exist Sep 08 10:54:52.483850 n-d-850501-12 devstack@n-api.service[128861]: Neutron server returns request_ids: ['req-2244da76-8344-4ce4-998f-ec6cf69525c2'] {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:54:52.484233 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-13dea4a6-f48c-4c73-844e-60a487bb4337 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/9ddb7c1d-4f44-4670-b703-506a13de29d8" status: 404 len: 194 microversion: 2.1 time: 0.070022 Sep 08 10:54:52.485408 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1886/3753] 10.222.0.27 () {58 vars in 1269 bytes} [Thu Sep 8 10:54:52 2022] GET /compute/v2.1/os-security-groups/9ddb7c1d-4f44-4670-b703-506a13de29d8 => generated 194 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:54:52.496860 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-af446ea8-7e55-464d-a52a-cc4cce0764c7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:52.498179 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-af446ea8-7e55-464d-a52a-cc4cce0764c7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:52.507231 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-af446ea8-7e55-464d-a52a-cc4cce0764c7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:52.508037 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-af446ea8-7e55-464d-a52a-cc4cce0764c7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:52.508661 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-af446ea8-7e55-464d-a52a-cc4cce0764c7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:52.509620 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-af446ea8-7e55-464d-a52a-cc4cce0764c7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:52.510453 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-af446ea8-7e55-464d-a52a-cc4cce0764c7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:52.511085 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-af446ea8-7e55-464d-a52a-cc4cce0764c7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:52.798369 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-af446ea8-7e55-464d-a52a-cc4cce0764c7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:52.801150 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bd351202-701f-4f68-9215-628d9410b478 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:52.807659 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-af446ea8-7e55-464d-a52a-cc4cce0764c7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 0.321027 Sep 08 10:54:52.808820 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1887/3754] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:52 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:52.811368 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bd351202-701f-4f68-9215-628d9410b478 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1684 microversion: 2.1 time: 0.675667 Sep 08 10:54:52.812742 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1868/3755] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:52 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1684 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:52.827645 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e387f2d2-d8be-481f-a5c3-93b0c0b93c05 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Calling method '.version_select at 0x7f68dfad19d0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:52.832109 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-deaf5a7d-9b21-4598-93e8-3385901a6886 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:52.833194 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-deaf5a7d-9b21-4598-93e8-3385901a6886 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:52.852950 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-deaf5a7d-9b21-4598-93e8-3385901a6886 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:52.857637 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-deaf5a7d-9b21-4598-93e8-3385901a6886 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:52.862483 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-deaf5a7d-9b21-4598-93e8-3385901a6886 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:52.868861 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-deaf5a7d-9b21-4598-93e8-3385901a6886 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:52.869728 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-deaf5a7d-9b21-4598-93e8-3385901a6886 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:52.871038 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-deaf5a7d-9b21-4598-93e8-3385901a6886 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:52.902918 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:54:53.171575 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e387f2d2-d8be-481f-a5c3-93b0c0b93c05 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/2f2c8f0e-68e5-4516-8b75-9aa893598ed3" status: 202 len: 0 microversion: 2.1 time: 0.361106 Sep 08 10:54:53.173414 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1888/3756] 10.222.0.27 () {58 vars in 1272 bytes} [Thu Sep 8 10:54:52 2022] DELETE /compute/v2.1/os-security-groups/2f2c8f0e-68e5-4516-8b75-9aa893598ed3 => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:54:53.183424 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6f63b002-ade4-443b-862c-702402b34a00 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:53.185311 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6f63b002-ade4-443b-862c-702402b34a00 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: 19604289-6d42-403f-bf74-75335e1782cb] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:53.203138 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:54:53.211890 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6f63b002-ade4-443b-862c-702402b34a00 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:53.213147 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6f63b002-ade4-443b-862c-702402b34a00 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:53.213823 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6f63b002-ade4-443b-862c-702402b34a00 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:53.214969 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6f63b002-ade4-443b-862c-702402b34a00 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:53.216887 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6f63b002-ade4-443b-862c-702402b34a00 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:53.217791 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6f63b002-ade4-443b-862c-702402b34a00 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:53.349273 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6f63b002-ade4-443b-862c-702402b34a00 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c291cbe955b4ee5abc98132dda0255e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f9a24cad014d7f827e8f3236dd5bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:53.364144 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6f63b002-ade4-443b-862c-702402b34a00 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/19604289-6d42-403f-bf74-75335e1782cb" status: 200 len: 1614 microversion: 2.1 time: 0.189149 Sep 08 10:54:53.365511 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1889/3757] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:53 2022] GET /compute/v2.1/servers/19604289-6d42-403f-bf74-75335e1782cb => generated 1614 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:53.371149 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4dd3674f-7606-4c7c-a3fd-c4031c9dc723 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Calling method '.version_select at 0x7f68e40d5af0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:53.422061 n-d-850501-12 devstack@n-api.service[128861]: DEBUG neutronclient.v2_0.client [None req-4dd3674f-7606-4c7c-a3fd-c4031c9dc723 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 2f2c8f0e-68e5-4516-8b75-9aa893598ed3 does not exist", "detail": ""}} {{(pid=128861) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 08 10:54:53.423964 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.security_group_api [None req-4dd3674f-7606-4c7c-a3fd-c4031c9dc723 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Neutron security group 2f2c8f0e-68e5-4516-8b75-9aa893598ed3 not found {{(pid=128861) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 08 10:54:53.424921 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-4dd3674f-7606-4c7c-a3fd-c4031c9dc723 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] HTTP exception thrown: Security group 2f2c8f0e-68e5-4516-8b75-9aa893598ed3 does not exist Sep 08 10:54:53.424921 n-d-850501-12 devstack@n-api.service[128861]: Neutron server returns request_ids: ['req-7e517974-cd6b-41d6-886b-2abfd792888d'] Sep 08 10:54:53.427585 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4dd3674f-7606-4c7c-a3fd-c4031c9dc723 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Request method failure captured: Sep 08 10:54:53.427585 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/os-security-groups/2f2c8f0e-68e5-4516-8b75-9aa893598ed3 HTTP/1.1 Sep 08 10:54:53.427585 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:54:53.427585 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:54:53.427585 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:54:53.427585 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:54:53.427585 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:54:53.427585 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:54:53.427585 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:54:53.427585 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:54:53.427585 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcnTIBfdH5H0Q1rMlbnLYZQcAnuATI-6ncC0ETqGOy19nshWBWc6mMSPvOE_5zGIQBC9DCOSD4SaG9XyRLj03fab4bxuKCvYlxZzzB9WEeCTo5mGH1uU5x9CALWtC8B7Wu8ih4rvxppcLmpz4ET9xD3ym8uzzB22kwTIB3vo0v5dqyY Sep 08 10:54:53.427585 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:54:53.427585 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:54:53.427585 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:54:53.427585 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:54:53.427585 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:54:53.427585 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:54:53.427585 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 0958700fa94b42b2b6b47af40cf2f679 Sep 08 10:54:53.427585 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-SecurityGroupsTestJSON-353861575 Sep 08 10:54:53.427585 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:54:53.427585 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:54:53.427585 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0958700fa94b42b2b6b47af40cf2f679"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0958700fa94b42b2b6b47af40cf2f679"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0958700fa94b42b2b6b47af40cf2f679"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0958700fa94b42b2b6b47af40cf2f679"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:54:53.427585 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-SecurityGroupsTestJSON-353861575 Sep 08 10:54:53.427585 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 0958700fa94b42b2b6b47af40cf2f679 Sep 08 10:54:53.427585 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-353861575 Sep 08 10:54:53.427585 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-SecurityGroupsTestJSON-353861575-project Sep 08 10:54:53.427585 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:54:53.427585 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:54:53.427585 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: e1bec228c17647bba62ba7d57d28e4ed Sep 08 10:54:53.427585 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-SecurityGroupsTestJSON-353861575-project Sep 08 10:54:53.427585 n-d-850501-12 devstack@n-api.service[128861]: method: Sep 08 10:54:53.427585 n-d-850501-12 devstack@n-api.service[128861]: exception: Security group 2f2c8f0e-68e5-4516-8b75-9aa893598ed3 does not exist Sep 08 10:54:53.427585 n-d-850501-12 devstack@n-api.service[128861]: Neutron server returns request_ids: ['req-7e517974-cd6b-41d6-886b-2abfd792888d'] Sep 08 10:54:53.427585 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '2f2c8f0e-68e5-4516-8b75-9aa893598ed3'} Sep 08 10:54:53.427585 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:54:53.427585 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:53.427585 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 08 10:54:53.427585 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 08 10:54:53.427585 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:54:53.427585 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:54:53.427585 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 08 10:54:53.427585 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 08 10:54:53.427585 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:54:53.427585 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:54:53.427585 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 08 10:54:53.427585 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 08 10:54:53.427585 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:54:53.427585 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:54:53.427585 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 08 10:54:53.427585 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 08 10:54:53.427585 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:54:53.427585 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:54:53.427585 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 08 10:54:53.427585 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 08 10:54:53.427585 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:54:53.427585 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:54:53.427585 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 08 10:54:53.427585 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 08 10:54:53.427585 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 08 10:54:53.427585 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 08 10:54:53.427585 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 2f2c8f0e-68e5-4516-8b75-9aa893598ed3 does not exist Sep 08 10:54:53.432683 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7e517974-cd6b-41d6-886b-2abfd792888d'] Sep 08 10:54:53.432683 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:53.432683 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:54:53.432683 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:53.432683 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:53.432683 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 08 10:54:53.432683 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 08 10:54:53.432683 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 08 10:54:53.432683 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 08 10:54:53.432683 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 2f2c8f0e-68e5-4516-8b75-9aa893598ed3 does not exist Sep 08 10:54:53.432683 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7e517974-cd6b-41d6-886b-2abfd792888d'] Sep 08 10:54:53.432683 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:53.432683 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:54:53.432683 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:53.432683 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:53.432683 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:54:53.432683 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:54:53.432683 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:54:53.432683 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:54:53.432683 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:54:53.432683 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:54:53.432683 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:54:53.432683 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:54:53.432683 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 08 10:54:53.432683 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 08 10:54:53.432683 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 2f2c8f0e-68e5-4516-8b75-9aa893598ed3 does not exist Sep 08 10:54:53.432683 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7e517974-cd6b-41d6-886b-2abfd792888d'] Sep 08 10:54:53.432683 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:53.432683 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:54:53.432683 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:53.432683 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:53.432683 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:54:53.432683 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:54:53.432683 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:54:53.432683 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:54:53.432683 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 2f2c8f0e-68e5-4516-8b75-9aa893598ed3 does not exist Sep 08 10:54:53.432683 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7e517974-cd6b-41d6-886b-2abfd792888d'] Sep 08 10:54:53.432683 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:53.432683 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4dd3674f-7606-4c7c-a3fd-c4031c9dc723 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Returning 404 to user: Security group 2f2c8f0e-68e5-4516-8b75-9aa893598ed3 does not exist Sep 08 10:54:53.432683 n-d-850501-12 devstack@n-api.service[128861]: Neutron server returns request_ids: ['req-7e517974-cd6b-41d6-886b-2abfd792888d'] {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:54:53.438927 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4dd3674f-7606-4c7c-a3fd-c4031c9dc723 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/2f2c8f0e-68e5-4516-8b75-9aa893598ed3" status: 404 len: 194 microversion: 2.1 time: 0.070040 Sep 08 10:54:53.441428 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1890/3758] 10.222.0.27 () {58 vars in 1269 bytes} [Thu Sep 8 10:54:53 2022] GET /compute/v2.1/os-security-groups/2f2c8f0e-68e5-4516-8b75-9aa893598ed3 => generated 194 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:54:53.453421 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2f82bd33-c37f-4d64-9ab9-fb1a36cbf2fe tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Calling method '.version_select at 0x7f68df9e1e50>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:53.895223 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2f82bd33-c37f-4d64-9ab9-fb1a36cbf2fe tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.438601 Sep 08 10:54:53.895716 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1891/3759] 10.222.0.27 () {58 vars in 1158 bytes} [Thu Sep 8 10:54:53 2022] GET /compute/v2.1/os-security-groups => generated 1158 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:54:53.901206 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-212a9088-744d-498a-819b-2642afe87853 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:53.901502 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-212a9088-744d-498a-819b-2642afe87853 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:53.928381 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-212a9088-744d-498a-819b-2642afe87853 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:53.928936 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-212a9088-744d-498a-819b-2642afe87853 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:53.929414 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-212a9088-744d-498a-819b-2642afe87853 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:53.930142 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-212a9088-744d-498a-819b-2642afe87853 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:53.930619 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-212a9088-744d-498a-819b-2642afe87853 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:53.931031 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-212a9088-744d-498a-819b-2642afe87853 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:54.241666 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-212a9088-744d-498a-819b-2642afe87853 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:54.253906 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-212a9088-744d-498a-819b-2642afe87853 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1684 microversion: 2.1 time: 0.353766 Sep 08 10:54:54.258685 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1892/3760] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:53 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1684 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:54.269212 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4fe6a7f7-ec95-41b2-a334-5e6b6335b915 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Action: 'create', calling method: .version_select at 0x7f68df9c4790>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2006590114", "description": "tempest-description-79234781"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:54:54.497643 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4fe6a7f7-ec95-41b2-a334-5e6b6335b915 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.237299 Sep 08 10:54:54.500284 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1893/3761] 10.222.0.27 () {60 vars in 1180 bytes} [Thu Sep 8 10:54:54 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:54:54.506032 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c4b1cee1-6177-47c1-8fe3-0f0d4f26129b tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:54.506985 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c4b1cee1-6177-47c1-8fe3-0f0d4f26129b tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: 19604289-6d42-403f-bf74-75335e1782cb] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:54.527306 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c4b1cee1-6177-47c1-8fe3-0f0d4f26129b tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:54.531783 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c4b1cee1-6177-47c1-8fe3-0f0d4f26129b tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:54.532454 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c4b1cee1-6177-47c1-8fe3-0f0d4f26129b tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:54.534926 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c4b1cee1-6177-47c1-8fe3-0f0d4f26129b tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:54.535541 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c4b1cee1-6177-47c1-8fe3-0f0d4f26129b tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:54.536081 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c4b1cee1-6177-47c1-8fe3-0f0d4f26129b tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:54.556348 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-deaf5a7d-9b21-4598-93e8-3385901a6886 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:54.566079 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-deaf5a7d-9b21-4598-93e8-3385901a6886 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 1.738802 Sep 08 10:54:54.568207 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1869/3762] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:52 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 1741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:54:54.576668 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ccc3832c-0e44-434a-9dc4-f39f2bfa80d7 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Action: 'create', calling method: .version_select at 0x7f68e47480d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2025358095", "description": "tempest-description-1565475784"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:54:54.670170 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c4b1cee1-6177-47c1-8fe3-0f0d4f26129b tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c291cbe955b4ee5abc98132dda0255e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f9a24cad014d7f827e8f3236dd5bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:54.689042 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c4b1cee1-6177-47c1-8fe3-0f0d4f26129b tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/19604289-6d42-403f-bf74-75335e1782cb" status: 200 len: 1614 microversion: 2.1 time: 0.186476 Sep 08 10:54:54.701057 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1894/3763] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:54 2022] GET /compute/v2.1/servers/19604289-6d42-403f-bf74-75335e1782cb => generated 1614 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:54.713530 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-55b07dc6-95fa-45f8-8b3f-2c7d2cdf6854 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:54.717345 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-55b07dc6-95fa-45f8-8b3f-2c7d2cdf6854 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Failed to fetch instance by id 9223372036854775808 {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 08 10:54:54.717961 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-55b07dc6-95fa-45f8-8b3f-2c7d2cdf6854 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Sep 08 10:54:54.721273 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-55b07dc6-95fa-45f8-8b3f-2c7d2cdf6854 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Request method failure captured: Sep 08 10:54:54.721273 n-d-850501-12 devstack@n-api.service[128861]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Sep 08 10:54:54.721273 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:54:54.721273 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:54:54.721273 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:54:54.721273 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:54:54.721273 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:54:54.721273 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:54:54.721273 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:54:54.721273 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:54:54.721273 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcmnspi0cCT_Ts_s7jcB6HjtEcdULbQPd_krJniB9lBsXpm1cXSOD-YMaJoaapHCxuCXz0q6Qe4WXufr5At6SSPw8ov8Oz1eUk-fSNbVp7WlOPycfCf5I6xwH7tfbsoefVfbTiDOfU9mTBl0Vs74qdfTniErHfQlEG4cAvAQl1-wMrs Sep 08 10:54:54.721273 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:54:54.721273 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:54:54.721273 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:54:54.721273 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:54:54.721273 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:54:54.721273 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:54:54.721273 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:54:54.721273 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:54:54.721273 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:54:54.721273 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:54:54.721273 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:54:54.721273 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:54:54.721273 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:54:54.721273 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:54:54.721273 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:54:54.721273 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:54:54.721273 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:54:54.721273 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 7f551e6fe34243c290a25b57ab26af19 Sep 08 10:54:54.721273 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:54:54.721273 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:54:54.721273 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 9223372036854775808 could not be found. Sep 08 10:54:54.721273 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '9223372036854775808'} Sep 08 10:54:54.721273 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:54:54.721273 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:54.721273 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:54:54.721273 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:54:54.721273 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 08 10:54:54.721273 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 08 10:54:54.721273 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Sep 08 10:54:54.721273 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:54.721273 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:54:54.721273 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:54.721273 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:54.721273 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:54:54.721273 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:54:54.721273 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:54:54.721273 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:54:54.721273 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:54:54.721273 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:54:54.721273 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:54:54.721273 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:54:54.721273 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:54:54.721273 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:54:54.721273 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:54:54.721273 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:54:54.721273 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:54:54.721273 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:54:54.721273 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Sep 08 10:54:54.721273 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:54.721273 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:54:54.721273 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:54.721273 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:54.721273 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:54:54.727907 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:54:54.727907 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:54:54.727907 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:54:54.727907 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Sep 08 10:54:54.727907 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:54.727907 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-55b07dc6-95fa-45f8-8b3f-2c7d2cdf6854 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:54:54.727907 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-55b07dc6-95fa-45f8-8b3f-2c7d2cdf6854 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.020609 Sep 08 10:54:54.730677 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1895/3764] 10.222.0.27 () {58 vars in 1188 bytes} [Thu Sep 8 10:54:54 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:54:54.736294 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-266f16ba-605e-4d99-9287-2eeedc5f2b05 req-f2329ec1-f198-4fc9-bba9-75af7b75c956 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19604289-6d42-403f-bf74-75335e1782cb", "name": "network-vif-deleted", "tag": "0ee5bff2-0477-4282-8e7e-4965352d2a29"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:54:54.770165 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-266f16ba-605e-4d99-9287-2eeedc5f2b05 req-f2329ec1-f198-4fc9-bba9-75af7b75c956 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:54.771888 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-266f16ba-605e-4d99-9287-2eeedc5f2b05 req-f2329ec1-f198-4fc9-bba9-75af7b75c956 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:54.772318 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-266f16ba-605e-4d99-9287-2eeedc5f2b05 req-f2329ec1-f198-4fc9-bba9-75af7b75c956 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:54.797104 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-266f16ba-605e-4d99-9287-2eeedc5f2b05 req-f2329ec1-f198-4fc9-bba9-75af7b75c956 service nova] Creating event network-vif-deleted:0ee5bff2-0477-4282-8e7e-4965352d2a29 for instance 19604289-6d42-403f-bf74-75335e1782cb on n-h1-850501-12 Sep 08 10:54:54.829275 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-266f16ba-605e-4d99-9287-2eeedc5f2b05 req-f2329ec1-f198-4fc9-bba9-75af7b75c956 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097219 Sep 08 10:54:54.832690 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1896/3765] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:54:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:54:54.847635 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ba6e462e-2827-446a-ac01-168acdd38fa8 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:54.853571 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ba6e462e-2827-446a-ac01-168acdd38fa8 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:54.874484 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ba6e462e-2827-446a-ac01-168acdd38fa8 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:54.875003 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ba6e462e-2827-446a-ac01-168acdd38fa8 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:54.875447 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ba6e462e-2827-446a-ac01-168acdd38fa8 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:54.877230 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ba6e462e-2827-446a-ac01-168acdd38fa8 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:54.878628 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ba6e462e-2827-446a-ac01-168acdd38fa8 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:54.879131 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ba6e462e-2827-446a-ac01-168acdd38fa8 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:55.137196 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ba6e462e-2827-446a-ac01-168acdd38fa8 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:55.148334 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ba6e462e-2827-446a-ac01-168acdd38fa8 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 0.309745 Sep 08 10:54:55.149746 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1897/3766] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:54 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:55.175827 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7bd224ba-bfc8-4a31-a37d-081119eb4483 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:55.176613 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7bd224ba-bfc8-4a31-a37d-081119eb4483 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:55.184229 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7bd224ba-bfc8-4a31-a37d-081119eb4483 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:55.184723 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7bd224ba-bfc8-4a31-a37d-081119eb4483 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:55.185186 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7bd224ba-bfc8-4a31-a37d-081119eb4483 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:55.185895 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7bd224ba-bfc8-4a31-a37d-081119eb4483 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:55.186348 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7bd224ba-bfc8-4a31-a37d-081119eb4483 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:55.186770 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7bd224ba-bfc8-4a31-a37d-081119eb4483 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:55.285249 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ccc3832c-0e44-434a-9dc4-f39f2bfa80d7 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.715362 Sep 08 10:54:55.287346 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1870/3767] 10.222.0.27 () {60 vars in 1180 bytes} [Thu Sep 8 10:54:54 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:54:55.293982 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b836b361-2e64-4bb3-83db-f51ca797cf9f tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:55.296058 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b836b361-2e64-4bb3-83db-f51ca797cf9f tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:55.329058 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b836b361-2e64-4bb3-83db-f51ca797cf9f tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:55.335165 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b836b361-2e64-4bb3-83db-f51ca797cf9f tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:55.336675 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b836b361-2e64-4bb3-83db-f51ca797cf9f tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:55.337814 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b836b361-2e64-4bb3-83db-f51ca797cf9f tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:55.338827 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b836b361-2e64-4bb3-83db-f51ca797cf9f tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:55.341198 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b836b361-2e64-4bb3-83db-f51ca797cf9f tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:55.496009 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7bd224ba-bfc8-4a31-a37d-081119eb4483 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:55.506361 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7bd224ba-bfc8-4a31-a37d-081119eb4483 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 0.334053 Sep 08 10:54:55.524145 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1898/3768] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:55 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:55.532437 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-728174bd-ed13-4226-9b4c-6b9c61ffbeea tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-568864851", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "ba142756-d4fb-44c5-af56-3ac50419b0bd"}]}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:54:55.602860 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-728174bd-ed13-4226-9b4c-6b9c61ffbeea tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] validate_networks() for [('ba142756-d4fb-44c5-af56-3ac50419b0bd', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:54:55.759104 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b836b361-2e64-4bb3-83db-f51ca797cf9f tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:55.784788 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b836b361-2e64-4bb3-83db-f51ca797cf9f tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1684 microversion: 2.1 time: 0.492735 Sep 08 10:54:55.787658 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1871/3769] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:55 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1684 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:55.799252 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-02037737-1667-499c-89ed-4f0628443ada tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:55.804399 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-02037737-1667-499c-89ed-4f0628443ada tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Failed to fetch instance by id -1 {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 08 10:54:55.805834 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-02037737-1667-499c-89ed-4f0628443ada tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] HTTP exception thrown: Instance -1 could not be found. Sep 08 10:54:55.810453 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-02037737-1667-499c-89ed-4f0628443ada tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Request method failure captured: Sep 08 10:54:55.810453 n-d-850501-12 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Sep 08 10:54:55.810453 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:54:55.810453 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:54:55.810453 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:54:55.810453 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:54:55.810453 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:54:55.810453 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:54:55.810453 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:54:55.810453 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:54:55.810453 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcmnspi0cCT_Ts_s7jcB6HjtEcdULbQPd_krJniB9lBsXpm1cXSOD-YMaJoaapHCxuCXz0q6Qe4WXufr5At6SSPw8ov8Oz1eUk-fSNbVp7WlOPycfCf5I6xwH7tfbsoefVfbTiDOfU9mTBl0Vs74qdfTniErHfQlEG4cAvAQl1-wMrs Sep 08 10:54:55.810453 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:54:55.810453 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:54:55.810453 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:54:55.810453 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:54:55.810453 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:54:55.810453 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:54:55.810453 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:54:55.810453 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:54:55.810453 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:54:55.810453 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:54:55.810453 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:54:55.810453 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:54:55.810453 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:54:55.810453 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:54:55.810453 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:54:55.810453 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:54:55.810453 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:54:55.810453 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 7f551e6fe34243c290a25b57ab26af19 Sep 08 10:54:55.810453 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:54:55.810453 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:54:55.810453 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance -1 could not be found. Sep 08 10:54:55.810453 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '-1'} Sep 08 10:54:55.810453 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:54:55.810453 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:55.810453 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:54:55.810453 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:54:55.810453 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 08 10:54:55.810453 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 08 10:54:55.810453 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Sep 08 10:54:55.810453 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:54:55.810453 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:54:55.810453 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:54:55.810453 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:55.810453 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:54:55.810453 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:54:55.810453 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:54:55.810453 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:54:55.810453 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:54:55.810453 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:54:55.810453 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:54:55.810453 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:54:55.810453 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:54:55.810453 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:54:55.810453 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:54:55.810453 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:54:55.810453 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:54:55.810453 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:54:55.810453 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Sep 08 10:54:55.810453 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:54:55.810453 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:54:55.810453 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:54:55.810453 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:55.810453 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:54:55.810453 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:54:55.816920 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:54:55.816920 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:54:55.816920 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Sep 08 10:54:55.816920 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:54:55.819656 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-02037737-1667-499c-89ed-4f0628443ada tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Returning 404 to user: Instance -1 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:54:55.823908 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-02037737-1667-499c-89ed-4f0628443ada tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.034881 Sep 08 10:54:55.825368 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1872/3770] 10.222.0.27 () {58 vars in 1137 bytes} [Thu Sep 8 10:54:55 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:54:55.848585 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-40a35537-53ad-4f24-bcf1-e08211fa0a32 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:55.851357 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-40a35537-53ad-4f24-bcf1-e08211fa0a32 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: 19604289-6d42-403f-bf74-75335e1782cb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:55.875681 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-40a35537-53ad-4f24-bcf1-e08211fa0a32 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:55.876821 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-40a35537-53ad-4f24-bcf1-e08211fa0a32 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:55.878163 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-40a35537-53ad-4f24-bcf1-e08211fa0a32 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:55.886875 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-40a35537-53ad-4f24-bcf1-e08211fa0a32 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:55.887835 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-40a35537-53ad-4f24-bcf1-e08211fa0a32 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:55.888549 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-40a35537-53ad-4f24-bcf1-e08211fa0a32 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:55.936698 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-40a35537-53ad-4f24-bcf1-e08211fa0a32 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] HTTP exception thrown: Instance 19604289-6d42-403f-bf74-75335e1782cb could not be found. Sep 08 10:54:55.942378 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-40a35537-53ad-4f24-bcf1-e08211fa0a32 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Request method failure captured: Sep 08 10:54:55.942378 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/19604289-6d42-403f-bf74-75335e1782cb HTTP/1.1 Sep 08 10:54:55.942378 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:54:55.942378 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:54:55.942378 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:54:55.942378 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:54:55.942378 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:54:55.942378 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:54:55.942378 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:54:55.942378 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:54:55.942378 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcf85nxlXglNpNUDafAex8bEd4FqCO21NTPeXDX2uUnTAK4RtQmB0Zln5OyfaDsL03XE7NxjFWJINQM-4CVmZPvJMmjswkfAMS-LTodBU21IQa_AJm8NdfZKIu9JkoC4h7calajGQneT5j1jgUkjySqAUeFvWcq2xoj6sNreqExg8K8 Sep 08 10:54:55.942378 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:54:55.942378 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:54:55.942378 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:54:55.942378 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:54:55.942378 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:54:55.942378 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:54:55.942378 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 20f9a24cad014d7f827e8f3236dd5bae Sep 08 10:54:55.942378 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-AttachVolumeNegativeTest-20693983 Sep 08 10:54:55.942378 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:54:55.942378 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:54:55.942378 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/20f9a24cad014d7f827e8f3236dd5bae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/20f9a24cad014d7f827e8f3236dd5bae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_20f9a24cad014d7f827e8f3236dd5bae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/20f9a24cad014d7f827e8f3236dd5bae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:54:55.942378 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-AttachVolumeNegativeTest-20693983 Sep 08 10:54:55.942378 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 20f9a24cad014d7f827e8f3236dd5bae Sep 08 10:54:55.942378 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-20693983 Sep 08 10:54:55.942378 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-AttachVolumeNegativeTest-20693983-project Sep 08 10:54:55.942378 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:54:55.942378 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:54:55.942378 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 5c291cbe955b4ee5abc98132dda0255e Sep 08 10:54:55.942378 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-AttachVolumeNegativeTest-20693983-project Sep 08 10:54:55.942378 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:54:55.942378 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 19604289-6d42-403f-bf74-75335e1782cb could not be found. Sep 08 10:54:55.942378 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '19604289-6d42-403f-bf74-75335e1782cb'} Sep 08 10:54:55.942378 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:54:55.942378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:55.942378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:54:55.942378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:54:55.942378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:54:55.942378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:54:55.942378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:54:55.942378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:54:55.942378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:54:55.942378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:54:55.942378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19604289-6d42-403f-bf74-75335e1782cb could not be found. Sep 08 10:54:55.942378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:54:55.942378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:54:55.942378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:54:55.942378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:55.942378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:54:55.942378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:54:55.942378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:54:55.942378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:54:55.942378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:54:55.942378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:54:55.942378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:54:55.942378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:54:55.942378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:54:55.942378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:54:55.942378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:54:55.942378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:54:55.942378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19604289-6d42-403f-bf74-75335e1782cb could not be found. Sep 08 10:54:55.942378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:54:55.942378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:54:55.942378 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:54:55.947118 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:55.947118 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:54:55.947118 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:54:55.947118 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:54:55.947118 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:54:55.947118 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19604289-6d42-403f-bf74-75335e1782cb could not be found. Sep 08 10:54:55.947118 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:54:55.947118 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-40a35537-53ad-4f24-bcf1-e08211fa0a32 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Returning 404 to user: Instance 19604289-6d42-403f-bf74-75335e1782cb could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:54:55.947118 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-40a35537-53ad-4f24-bcf1-e08211fa0a32 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/19604289-6d42-403f-bf74-75335e1782cb" status: 404 len: 111 microversion: 2.1 time: 0.114375 Sep 08 10:54:55.951052 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1873/3771] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:55 2022] GET /compute/v2.1/servers/19604289-6d42-403f-bf74-75335e1782cb => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:54:55.958359 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d80ac7d8-37ce-49d5-b228-ccd12ccfb2be tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:55.962956 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d80ac7d8-37ce-49d5-b228-ccd12ccfb2be tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:55.992098 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d80ac7d8-37ce-49d5-b228-ccd12ccfb2be tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:55.994802 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d80ac7d8-37ce-49d5-b228-ccd12ccfb2be tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:55.995356 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d80ac7d8-37ce-49d5-b228-ccd12ccfb2be tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:55.996239 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d80ac7d8-37ce-49d5-b228-ccd12ccfb2be tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:56.001108 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d80ac7d8-37ce-49d5-b228-ccd12ccfb2be tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:56.002317 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d80ac7d8-37ce-49d5-b228-ccd12ccfb2be tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:56.338600 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d80ac7d8-37ce-49d5-b228-ccd12ccfb2be tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:56.349399 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d80ac7d8-37ce-49d5-b228-ccd12ccfb2be tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 0.397027 Sep 08 10:54:56.350772 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1874/3772] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:55 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:56.356978 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2812b7d9-efa6-47dd-a0d9-3833ffdc786a tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '.version_select at 0x7f68e4f6e550>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:56.399645 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2812b7d9-efa6-47dd-a0d9-3833ffdc786a tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-530734782" status: 202 len: 0 microversion: 2.1 time: 0.047480 Sep 08 10:54:56.404635 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1875/3773] 10.222.0.27 () {58 vars in 1218 bytes} [Thu Sep 8 10:54:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-530734782 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:54:56.413666 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-98730ca5-793f-47ad-b62b-2ea0d4337cdf tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:56.415008 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-98730ca5-793f-47ad-b62b-2ea0d4337cdf tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:56.427608 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-98730ca5-793f-47ad-b62b-2ea0d4337cdf tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:56.428483 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-98730ca5-793f-47ad-b62b-2ea0d4337cdf tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:56.429783 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-98730ca5-793f-47ad-b62b-2ea0d4337cdf tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:56.431011 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-98730ca5-793f-47ad-b62b-2ea0d4337cdf tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:56.431688 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-98730ca5-793f-47ad-b62b-2ea0d4337cdf tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:56.432328 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-98730ca5-793f-47ad-b62b-2ea0d4337cdf tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:56.936629 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-98730ca5-793f-47ad-b62b-2ea0d4337cdf tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:56.945160 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-98730ca5-793f-47ad-b62b-2ea0d4337cdf tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 0.538331 Sep 08 10:54:56.951007 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1876/3774] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:56 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:56.957294 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-53eb72a4-5915-429a-b189-d580e5c7c4e8 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:56.969804 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-53eb72a4-5915-429a-b189-d580e5c7c4e8 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:56.977168 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53eb72a4-5915-429a-b189-d580e5c7c4e8 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:56.977985 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53eb72a4-5915-429a-b189-d580e5c7c4e8 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:56.978683 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53eb72a4-5915-429a-b189-d580e5c7c4e8 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:56.979644 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53eb72a4-5915-429a-b189-d580e5c7c4e8 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:56.980342 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53eb72a4-5915-429a-b189-d580e5c7c4e8 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:56.981019 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53eb72a4-5915-429a-b189-d580e5c7c4e8 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:57.141856 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-728174bd-ed13-4226-9b4c-6b9c61ffbeea tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:54:57.142394 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-728174bd-ed13-4226-9b4c-6b9c61ffbeea tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:54:57.142651 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-728174bd-ed13-4226-9b4c-6b9c61ffbeea tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:54:57.143422 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-728174bd-ed13-4226-9b4c-6b9c61ffbeea tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:54:57.144047 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-728174bd-ed13-4226-9b4c-6b9c61ffbeea tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:54:57.162606 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-728174bd-ed13-4226-9b4c-6b9c61ffbeea tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:57.163120 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-728174bd-ed13-4226-9b4c-6b9c61ffbeea tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:57.163794 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-728174bd-ed13-4226-9b4c-6b9c61ffbeea tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:57.171613 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-728174bd-ed13-4226-9b4c-6b9c61ffbeea tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:57.172478 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-728174bd-ed13-4226-9b4c-6b9c61ffbeea tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:57.173153 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-728174bd-ed13-4226-9b4c-6b9c61ffbeea tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:57.195145 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-728174bd-ed13-4226-9b4c-6b9c61ffbeea tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Getting quotas for project 0958700fa94b42b2b6b47af40cf2f679. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:54:57.201631 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-728174bd-ed13-4226-9b4c-6b9c61ffbeea tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Getting quotas for user e1bec228c17647bba62ba7d57d28e4ed and project 0958700fa94b42b2b6b47af40cf2f679. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:54:57.228274 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-728174bd-ed13-4226-9b4c-6b9c61ffbeea tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:54:57.232354 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-728174bd-ed13-4226-9b4c-6b9c61ffbeea tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] [instance: b7e97718-dc14-4e93-b7b3-49a8d8e03bb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:54:57.341417 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-728174bd-ed13-4226-9b4c-6b9c61ffbeea tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.807822 Sep 08 10:54:57.341417 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1899/3775] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:54:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1816 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:54:57.352626 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f613092c-209c-4fc6-81f7-f0910fc0b0e4 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:54:57.354820 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f613092c-209c-4fc6-81f7-f0910fc0b0e4 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 108a72ba-04a0-40d7-b2ae-0a669699bbf3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:57.367697 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-f613092c-209c-4fc6-81f7-f0910fc0b0e4 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] HTTP exception thrown: Instance 108a72ba-04a0-40d7-b2ae-0a669699bbf3 could not be found. Sep 08 10:54:57.379587 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f613092c-209c-4fc6-81f7-f0910fc0b0e4 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Request method failure captured: Sep 08 10:54:57.379587 n-d-850501-12 devstack@n-api.service[128861]: request: POST /compute/v2.1/servers/108a72ba-04a0-40d7-b2ae-0a669699bbf3/action HTTP/1.1 Sep 08 10:54:57.379587 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:54:57.379587 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:54:57.379587 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:54:57.379587 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 19 Sep 08 10:54:57.379587 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:54:57.379587 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:54:57.379587 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:54:57.379587 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:54:57.379587 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcmnspi0cCT_Ts_s7jcB6HjtEcdULbQPd_krJniB9lBsXpm1cXSOD-YMaJoaapHCxuCXz0q6Qe4WXufr5At6SSPw8ov8Oz1eUk-fSNbVp7WlOPycfCf5I6xwH7tfbsoefVfbTiDOfU9mTBl0Vs74qdfTniErHfQlEG4cAvAQl1-wMrs Sep 08 10:54:57.379587 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:54:57.379587 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:54:57.379587 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:54:57.379587 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:54:57.379587 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:54:57.379587 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:54:57.379587 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:54:57.379587 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:54:57.379587 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:54:57.379587 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:54:57.379587 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:54:57.379587 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:54:57.379587 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:54:57.379587 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:54:57.379587 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:54:57.379587 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:54:57.379587 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:54:57.379587 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 7f551e6fe34243c290a25b57ab26af19 Sep 08 10:54:57.379587 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:54:57.379587 n-d-850501-12 devstack@n-api.service[128861]: Sep 08 10:54:57.379587 n-d-850501-12 devstack@n-api.service[128861]: {"forceDelete": {}} Sep 08 10:54:57.379587 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:54:57.379587 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 108a72ba-04a0-40d7-b2ae-0a669699bbf3 could not be found. Sep 08 10:54:57.379587 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '108a72ba-04a0-40d7-b2ae-0a669699bbf3', 'body': {'forceDelete': {}}} Sep 08 10:54:57.379587 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:54:57.379587 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:57.379587 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:54:57.379587 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:54:57.379587 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:54:57.379587 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:54:57.379587 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 08 10:54:57.379587 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 08 10:54:57.379587 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 108a72ba-04a0-40d7-b2ae-0a669699bbf3 could not be found. Sep 08 10:54:57.379587 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:57.379587 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:54:57.379587 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:57.379587 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:57.379587 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:54:57.379587 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:54:57.379587 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:54:57.379587 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:54:57.379587 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:54:57.379587 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:54:57.379587 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Sep 08 10:54:57.379587 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 08 10:54:57.379587 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:54:57.379587 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:54:57.379587 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 108a72ba-04a0-40d7-b2ae-0a669699bbf3 could not be found. Sep 08 10:54:57.379587 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:57.379587 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:54:57.379587 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:57.379587 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:57.379587 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:54:57.379587 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:54:57.384670 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:54:57.384670 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:54:57.384670 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 108a72ba-04a0-40d7-b2ae-0a669699bbf3 could not be found. Sep 08 10:54:57.384670 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:57.384670 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f613092c-209c-4fc6-81f7-f0910fc0b0e4 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Returning 404 to user: Instance 108a72ba-04a0-40d7-b2ae-0a669699bbf3 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:54:57.384670 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f613092c-209c-4fc6-81f7-f0910fc0b0e4 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "POST /compute/v2.1/servers/108a72ba-04a0-40d7-b2ae-0a669699bbf3/action" status: 404 len: 111 microversion: 2.1 time: 0.039823 Sep 08 10:54:57.384670 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1900/3776] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:54:57 2022] POST /compute/v2.1/servers/108a72ba-04a0-40d7-b2ae-0a669699bbf3/action => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:54:57.390874 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7cab1ac3-344f-4a7a-af03-351e6fd885dd tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:57.394229 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7cab1ac3-344f-4a7a-af03-351e6fd885dd tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] [instance: b7e97718-dc14-4e93-b7b3-49a8d8e03bb9] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:57.559225 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-53eb72a4-5915-429a-b189-d580e5c7c4e8 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:57.575265 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-53eb72a4-5915-429a-b189-d580e5c7c4e8 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1684 microversion: 2.1 time: 0.619801 Sep 08 10:54:57.576339 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1877/3777] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:56 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1684 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:57.585786 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1f9a3f5f-9c96-4ad5-97b7-64466a7de92e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:57.591139 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1f9a3f5f-9c96-4ad5-97b7-64466a7de92e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:57.605267 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f9a3f5f-9c96-4ad5-97b7-64466a7de92e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:57.629880 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f9a3f5f-9c96-4ad5-97b7-64466a7de92e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:57.636115 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f9a3f5f-9c96-4ad5-97b7-64466a7de92e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:57.637254 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f9a3f5f-9c96-4ad5-97b7-64466a7de92e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:57.637967 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f9a3f5f-9c96-4ad5-97b7-64466a7de92e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:57.638631 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f9a3f5f-9c96-4ad5-97b7-64466a7de92e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:57.666522 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7cab1ac3-344f-4a7a-af03-351e6fd885dd tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1bec228c17647bba62ba7d57d28e4ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0958700fa94b42b2b6b47af40cf2f679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:57.682275 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7cab1ac3-344f-4a7a-af03-351e6fd885dd tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "GET /compute/v2.1/servers/b7e97718-dc14-4e93-b7b3-49a8d8e03bb9" status: 200 len: 1215 microversion: 2.1 time: 0.297147 Sep 08 10:54:57.701161 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1901/3778] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:57 2022] GET /compute/v2.1/servers/b7e97718-dc14-4e93-b7b3-49a8d8e03bb9 => generated 1215 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:58.109274 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1f9a3f5f-9c96-4ad5-97b7-64466a7de92e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:58.121352 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1f9a3f5f-9c96-4ad5-97b7-64466a7de92e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 0.543521 Sep 08 10:54:58.130747 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1878/3779] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:57 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:58.154878 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bff8e891-73d0-4536-b39d-1f1a554b0757 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:58.155518 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bff8e891-73d0-4536-b39d-1f1a554b0757 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:58.166268 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bff8e891-73d0-4536-b39d-1f1a554b0757 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:58.166925 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bff8e891-73d0-4536-b39d-1f1a554b0757 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:58.167458 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bff8e891-73d0-4536-b39d-1f1a554b0757 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:58.168373 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bff8e891-73d0-4536-b39d-1f1a554b0757 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:58.168923 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bff8e891-73d0-4536-b39d-1f1a554b0757 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:58.169879 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bff8e891-73d0-4536-b39d-1f1a554b0757 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:58.601486 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e0c12097-488e-4518-a3ba-dce0a646c54c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:58.602119 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e0c12097-488e-4518-a3ba-dce0a646c54c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:58.615397 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0c12097-488e-4518-a3ba-dce0a646c54c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:58.622724 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0c12097-488e-4518-a3ba-dce0a646c54c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:58.623209 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0c12097-488e-4518-a3ba-dce0a646c54c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:58.625865 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0c12097-488e-4518-a3ba-dce0a646c54c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:58.629627 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0c12097-488e-4518-a3ba-dce0a646c54c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:58.632469 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0c12097-488e-4518-a3ba-dce0a646c54c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:58.823762 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-bff8e891-73d0-4536-b39d-1f1a554b0757 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:58.836493 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bff8e891-73d0-4536-b39d-1f1a554b0757 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 0.685749 Sep 08 10:54:58.867259 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1902/3780] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:58 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:58.878798 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e95424c2-1277-40c4-b181-630f952f00a5 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:58.885731 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e95424c2-1277-40c4-b181-630f952f00a5 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] [instance: b7e97718-dc14-4e93-b7b3-49a8d8e03bb9] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:58.927297 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e95424c2-1277-40c4-b181-630f952f00a5 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:58.934477 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e95424c2-1277-40c4-b181-630f952f00a5 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:58.935677 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e95424c2-1277-40c4-b181-630f952f00a5 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:58.939724 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e95424c2-1277-40c4-b181-630f952f00a5 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:58.940547 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e95424c2-1277-40c4-b181-630f952f00a5 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:58.941291 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e95424c2-1277-40c4-b181-630f952f00a5 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:59.168201 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e95424c2-1277-40c4-b181-630f952f00a5 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1bec228c17647bba62ba7d57d28e4ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0958700fa94b42b2b6b47af40cf2f679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:59.184861 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e95424c2-1277-40c4-b181-630f952f00a5 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "GET /compute/v2.1/servers/b7e97718-dc14-4e93-b7b3-49a8d8e03bb9" status: 200 len: 1267 microversion: 2.1 time: 0.315259 Sep 08 10:54:59.185737 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1903/3781] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:58 2022] GET /compute/v2.1/servers/b7e97718-dc14-4e93-b7b3-49a8d8e03bb9 => generated 1267 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:59.192753 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0df5f91f-70c4-48c0-b369-2a62fefdeebf tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:54:59.207785 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0df5f91f-70c4-48c0-b369-2a62fefdeebf tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: b3905a41-3dd5-4bc6-b0ac-c6a5169a0d7e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:59.221702 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-0df5f91f-70c4-48c0-b369-2a62fefdeebf tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] HTTP exception thrown: Instance b3905a41-3dd5-4bc6-b0ac-c6a5169a0d7e could not be found. Sep 08 10:54:59.224465 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0df5f91f-70c4-48c0-b369-2a62fefdeebf tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Request method failure captured: Sep 08 10:54:59.224465 n-d-850501-12 devstack@n-api.service[128861]: request: POST /compute/v2.1/servers/b3905a41-3dd5-4bc6-b0ac-c6a5169a0d7e/action HTTP/1.1 Sep 08 10:54:59.224465 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:54:59.224465 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:54:59.224465 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:54:59.224465 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 39 Sep 08 10:54:59.224465 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:54:59.224465 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:54:59.224465 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:54:59.224465 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:54:59.224465 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcmnspi0cCT_Ts_s7jcB6HjtEcdULbQPd_krJniB9lBsXpm1cXSOD-YMaJoaapHCxuCXz0q6Qe4WXufr5At6SSPw8ov8Oz1eUk-fSNbVp7WlOPycfCf5I6xwH7tfbsoefVfbTiDOfU9mTBl0Vs74qdfTniErHfQlEG4cAvAQl1-wMrs Sep 08 10:54:59.224465 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:54:59.224465 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:54:59.224465 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:54:59.224465 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:54:59.224465 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:54:59.224465 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:54:59.224465 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:54:59.224465 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:54:59.224465 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:54:59.224465 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:54:59.224465 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:54:59.224465 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:54:59.224465 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:54:59.224465 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:54:59.224465 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:54:59.224465 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:54:59.224465 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:54:59.224465 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 7f551e6fe34243c290a25b57ab26af19 Sep 08 10:54:59.224465 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:54:59.224465 n-d-850501-12 devstack@n-api.service[128861]: Sep 08 10:54:59.224465 n-d-850501-12 devstack@n-api.service[128861]: {"os-getConsoleOutput": {"length": 10}} Sep 08 10:54:59.224465 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:54:59.224465 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance b3905a41-3dd5-4bc6-b0ac-c6a5169a0d7e could not be found. Sep 08 10:54:59.224465 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': 'b3905a41-3dd5-4bc6-b0ac-c6a5169a0d7e', 'body': {'os-getConsoleOutput': {'length': 10}}} Sep 08 10:54:59.224465 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:54:59.224465 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:59.224465 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:54:59.224465 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:54:59.224465 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:54:59.224465 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:54:59.224465 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 08 10:54:59.224465 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 08 10:54:59.224465 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3905a41-3dd5-4bc6-b0ac-c6a5169a0d7e could not be found. Sep 08 10:54:59.224465 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:59.224465 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:54:59.224465 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:59.224465 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:59.224465 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:54:59.224465 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:54:59.224465 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:54:59.224465 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:54:59.224465 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:54:59.224465 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:54:59.224465 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:54:59.224465 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:54:59.224465 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Sep 08 10:54:59.224465 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 08 10:54:59.224465 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:54:59.224465 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:54:59.224465 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3905a41-3dd5-4bc6-b0ac-c6a5169a0d7e could not be found. Sep 08 10:54:59.224465 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:59.224465 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:54:59.224465 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:59.224465 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:54:59.229576 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:54:59.229576 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:54:59.229576 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:54:59.229576 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:54:59.229576 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3905a41-3dd5-4bc6-b0ac-c6a5169a0d7e could not be found. Sep 08 10:54:59.229576 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:54:59.231455 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0df5f91f-70c4-48c0-b369-2a62fefdeebf tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Returning 404 to user: Instance b3905a41-3dd5-4bc6-b0ac-c6a5169a0d7e could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:54:59.232575 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0df5f91f-70c4-48c0-b369-2a62fefdeebf tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "POST /compute/v2.1/servers/b3905a41-3dd5-4bc6-b0ac-c6a5169a0d7e/action" status: 404 len: 111 microversion: 2.1 time: 0.044943 Sep 08 10:54:59.233744 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1904/3782] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:54:59 2022] POST /compute/v2.1/servers/b3905a41-3dd5-4bc6-b0ac-c6a5169a0d7e/action => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:54:59.246873 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b7976287-473b-4301-a881-4cad661ff1c0 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:59.247744 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b7976287-473b-4301-a881-4cad661ff1c0 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:59.248657 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e0c12097-488e-4518-a3ba-dce0a646c54c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:59.266974 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b7976287-473b-4301-a881-4cad661ff1c0 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:59.268136 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b7976287-473b-4301-a881-4cad661ff1c0 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:59.268293 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e0c12097-488e-4518-a3ba-dce0a646c54c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1684 microversion: 2.1 time: 0.671052 Sep 08 10:54:59.269200 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b7976287-473b-4301-a881-4cad661ff1c0 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:59.274487 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b7976287-473b-4301-a881-4cad661ff1c0 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:59.275302 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b7976287-473b-4301-a881-4cad661ff1c0 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:59.275996 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b7976287-473b-4301-a881-4cad661ff1c0 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:59.293080 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1879/3783] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:58 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1684 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:59.690839 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b7976287-473b-4301-a881-4cad661ff1c0 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:59.699830 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b7976287-473b-4301-a881-4cad661ff1c0 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 0.461336 Sep 08 10:54:59.701468 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1905/3784] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:59 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:54:59.730198 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-21d0fee7-0fd9-4119-9552-3f120f74ef60 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:59.731147 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-21d0fee7-0fd9-4119-9552-3f120f74ef60 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:59.739116 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-21d0fee7-0fd9-4119-9552-3f120f74ef60 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:59.740150 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-21d0fee7-0fd9-4119-9552-3f120f74ef60 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:59.740876 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-21d0fee7-0fd9-4119-9552-3f120f74ef60 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:59.742180 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-21d0fee7-0fd9-4119-9552-3f120f74ef60 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:59.742850 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-21d0fee7-0fd9-4119-9552-3f120f74ef60 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:59.743909 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-21d0fee7-0fd9-4119-9552-3f120f74ef60 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:00.213704 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-01ccb85c-476f-4654-82c2-8d621fb0c207 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:00.215144 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-01ccb85c-476f-4654-82c2-8d621fb0c207 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] [instance: b7e97718-dc14-4e93-b7b3-49a8d8e03bb9] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:00.228791 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-01ccb85c-476f-4654-82c2-8d621fb0c207 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:00.232636 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-01ccb85c-476f-4654-82c2-8d621fb0c207 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:00.235214 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-01ccb85c-476f-4654-82c2-8d621fb0c207 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:00.238846 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-01ccb85c-476f-4654-82c2-8d621fb0c207 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:00.239740 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-01ccb85c-476f-4654-82c2-8d621fb0c207 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:00.240416 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-01ccb85c-476f-4654-82c2-8d621fb0c207 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:00.279685 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-21d0fee7-0fd9-4119-9552-3f120f74ef60 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:00.299398 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-21d0fee7-0fd9-4119-9552-3f120f74ef60 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 0.573798 Sep 08 10:55:00.305112 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1880/3785] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:59 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:00.342573 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-19713942-0711-46f7-90c0-e8c70201d922 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:00.347002 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-19713942-0711-46f7-90c0-e8c70201d922 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:00.386613 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-19713942-0711-46f7-90c0-e8c70201d922 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:00.387693 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-19713942-0711-46f7-90c0-e8c70201d922 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:00.390451 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-19713942-0711-46f7-90c0-e8c70201d922 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:00.394736 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-19713942-0711-46f7-90c0-e8c70201d922 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:00.395579 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-19713942-0711-46f7-90c0-e8c70201d922 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:00.396394 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-19713942-0711-46f7-90c0-e8c70201d922 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:00.585713 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-01ccb85c-476f-4654-82c2-8d621fb0c207 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1bec228c17647bba62ba7d57d28e4ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0958700fa94b42b2b6b47af40cf2f679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:00.603320 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-01ccb85c-476f-4654-82c2-8d621fb0c207 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "GET /compute/v2.1/servers/b7e97718-dc14-4e93-b7b3-49a8d8e03bb9" status: 200 len: 1273 microversion: 2.1 time: 0.393367 Sep 08 10:55:00.625391 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1906/3786] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:00 2022] GET /compute/v2.1/servers/b7e97718-dc14-4e93-b7b3-49a8d8e03bb9 => generated 1273 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:00.650913 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-dec4998a-a729-4334-a9bc-b579be044ef3 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:00.651553 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-dec4998a-a729-4334-a9bc-b579be044ef3 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: c71360c3-a432-4f97-a16f-3a351083a8fd] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:00.701938 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-dec4998a-a729-4334-a9bc-b579be044ef3 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] HTTP exception thrown: Instance c71360c3-a432-4f97-a16f-3a351083a8fd could not be found. Sep 08 10:55:00.710391 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-dec4998a-a729-4334-a9bc-b579be044ef3 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Request method failure captured: Sep 08 10:55:00.710391 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/c71360c3-a432-4f97-a16f-3a351083a8fd HTTP/1.1 Sep 08 10:55:00.710391 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:55:00.710391 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:55:00.710391 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:55:00.710391 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:55:00.710391 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:55:00.710391 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:55:00.710391 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:55:00.710391 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:55:00.710391 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcmnspi0cCT_Ts_s7jcB6HjtEcdULbQPd_krJniB9lBsXpm1cXSOD-YMaJoaapHCxuCXz0q6Qe4WXufr5At6SSPw8ov8Oz1eUk-fSNbVp7WlOPycfCf5I6xwH7tfbsoefVfbTiDOfU9mTBl0Vs74qdfTniErHfQlEG4cAvAQl1-wMrs Sep 08 10:55:00.710391 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:55:00.710391 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:55:00.710391 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:55:00.710391 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:55:00.710391 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:55:00.710391 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:55:00.710391 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:55:00.710391 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:55:00.710391 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:55:00.710391 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:55:00.710391 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:55:00.710391 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:55:00.710391 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:55:00.710391 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:55:00.710391 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:55:00.710391 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:55:00.710391 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:55:00.710391 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 7f551e6fe34243c290a25b57ab26af19 Sep 08 10:55:00.710391 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:55:00.710391 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:55:00.710391 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance c71360c3-a432-4f97-a16f-3a351083a8fd could not be found. Sep 08 10:55:00.710391 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': 'c71360c3-a432-4f97-a16f-3a351083a8fd'} Sep 08 10:55:00.710391 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:55:00.710391 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:00.710391 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:55:00.710391 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:55:00.710391 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:55:00.710391 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:55:00.710391 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 08 10:55:00.710391 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 08 10:55:00.710391 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c71360c3-a432-4f97-a16f-3a351083a8fd could not be found. Sep 08 10:55:00.710391 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:00.710391 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:00.710391 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:00.710391 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:00.710391 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:55:00.710391 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:55:00.710391 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:55:00.710391 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:55:00.710391 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:55:00.710391 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:55:00.710391 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:55:00.710391 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:55:00.710391 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:55:00.710391 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:55:00.710391 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:55:00.710391 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:55:00.710391 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c71360c3-a432-4f97-a16f-3a351083a8fd could not be found. Sep 08 10:55:00.710391 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:00.710391 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:00.710391 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:00.710391 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:00.710391 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:55:00.715883 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:55:00.715883 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:55:00.715883 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:55:00.715883 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c71360c3-a432-4f97-a16f-3a351083a8fd could not be found. Sep 08 10:55:00.715883 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:00.715883 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-dec4998a-a729-4334-a9bc-b579be044ef3 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Returning 404 to user: Instance c71360c3-a432-4f97-a16f-3a351083a8fd could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:55:00.715883 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-dec4998a-a729-4334-a9bc-b579be044ef3 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/c71360c3-a432-4f97-a16f-3a351083a8fd" status: 404 len: 111 microversion: 2.1 time: 0.082185 Sep 08 10:55:00.715883 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1907/3787] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:00 2022] GET /compute/v2.1/servers/c71360c3-a432-4f97-a16f-3a351083a8fd => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:55:00.737401 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a5bebb9b-3cd2-4041-ae73-01ec163c9a0b tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:00.738044 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a5bebb9b-3cd2-4041-ae73-01ec163c9a0b tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:00.763275 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a5bebb9b-3cd2-4041-ae73-01ec163c9a0b tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:00.763850 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a5bebb9b-3cd2-4041-ae73-01ec163c9a0b tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:00.764296 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a5bebb9b-3cd2-4041-ae73-01ec163c9a0b tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:00.765017 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a5bebb9b-3cd2-4041-ae73-01ec163c9a0b tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:00.765502 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a5bebb9b-3cd2-4041-ae73-01ec163c9a0b tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:00.765934 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a5bebb9b-3cd2-4041-ae73-01ec163c9a0b tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:00.983766 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-19713942-0711-46f7-90c0-e8c70201d922 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:00.999923 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-19713942-0711-46f7-90c0-e8c70201d922 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1671 microversion: 2.1 time: 0.678840 Sep 08 10:55:01.001066 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1881/3788] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:00 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1671 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:01.632739 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-27364d4e-6df7-409d-a217-b164b3f57054 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:01.633654 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-27364d4e-6df7-409d-a217-b164b3f57054 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] [instance: b7e97718-dc14-4e93-b7b3-49a8d8e03bb9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:01.654809 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a5bebb9b-3cd2-4041-ae73-01ec163c9a0b tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:01.671269 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27364d4e-6df7-409d-a217-b164b3f57054 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:01.682234 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27364d4e-6df7-409d-a217-b164b3f57054 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:01.682942 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27364d4e-6df7-409d-a217-b164b3f57054 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:01.691435 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27364d4e-6df7-409d-a217-b164b3f57054 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:01.693607 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a5bebb9b-3cd2-4041-ae73-01ec163c9a0b tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 0.959983 Sep 08 10:55:01.694523 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1908/3789] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:00 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:55:01.709395 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27364d4e-6df7-409d-a217-b164b3f57054 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:01.709395 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27364d4e-6df7-409d-a217-b164b3f57054 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:01.731605 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9231a87a-f605-4e94-8cb5-16ab8fda0047 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:01.732373 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9231a87a-f605-4e94-8cb5-16ab8fda0047 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:01.751517 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9231a87a-f605-4e94-8cb5-16ab8fda0047 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:01.755933 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9231a87a-f605-4e94-8cb5-16ab8fda0047 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:01.756691 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9231a87a-f605-4e94-8cb5-16ab8fda0047 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:01.757729 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9231a87a-f605-4e94-8cb5-16ab8fda0047 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:01.758457 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9231a87a-f605-4e94-8cb5-16ab8fda0047 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:01.759986 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9231a87a-f605-4e94-8cb5-16ab8fda0047 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:01.919835 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-27364d4e-6df7-409d-a217-b164b3f57054 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1bec228c17647bba62ba7d57d28e4ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0958700fa94b42b2b6b47af40cf2f679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:01.956664 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-27364d4e-6df7-409d-a217-b164b3f57054 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "GET /compute/v2.1/servers/b7e97718-dc14-4e93-b7b3-49a8d8e03bb9" status: 200 len: 1273 microversion: 2.1 time: 0.329422 Sep 08 10:55:01.957943 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1882/3790] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:01 2022] GET /compute/v2.1/servers/b7e97718-dc14-4e93-b7b3-49a8d8e03bb9 => generated 1273 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:02.216781 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-abb01457-34ac-4f6d-b2cf-311a82da0334 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:02.218294 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-abb01457-34ac-4f6d-b2cf-311a82da0334 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:02.219924 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9231a87a-f605-4e94-8cb5-16ab8fda0047 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:02.225852 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-abb01457-34ac-4f6d-b2cf-311a82da0334 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:02.227905 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-abb01457-34ac-4f6d-b2cf-311a82da0334 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:02.228626 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-abb01457-34ac-4f6d-b2cf-311a82da0334 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:02.229575 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-abb01457-34ac-4f6d-b2cf-311a82da0334 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:02.230375 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-abb01457-34ac-4f6d-b2cf-311a82da0334 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:02.230984 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-abb01457-34ac-4f6d-b2cf-311a82da0334 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:02.238237 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9231a87a-f605-4e94-8cb5-16ab8fda0047 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 0.510834 Sep 08 10:55:02.255624 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1909/3791] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:01 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:55:02.472058 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-13230978-df88-4065-b1ca-84e76090f84f tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-804021803", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "12aa0876-bb28-47d9-975a-2d76f1aa7c84"}]}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:55:02.506430 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-13230978-df88-4065-b1ca-84e76090f84f tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Request method failure captured: Sep 08 10:55:02.506430 n-d-850501-12 devstack@n-api.service[128861]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 10:55:02.506430 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:55:02.506430 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:55:02.506430 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:55:02.506430 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 237 Sep 08 10:55:02.506430 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:55:02.506430 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:55:02.506430 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:55:02.506430 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:55:02.506430 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcmnspi0cCT_Ts_s7jcB6HjtEcdULbQPd_krJniB9lBsXpm1cXSOD-YMaJoaapHCxuCXz0q6Qe4WXufr5At6SSPw8ov8Oz1eUk-fSNbVp7WlOPycfCf5I6xwH7tfbsoefVfbTiDOfU9mTBl0Vs74qdfTniErHfQlEG4cAvAQl1-wMrs Sep 08 10:55:02.506430 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:55:02.506430 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:55:02.506430 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:55:02.506430 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:55:02.506430 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:55:02.506430 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:55:02.506430 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:55:02.506430 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:55:02.506430 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:55:02.506430 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:55:02.506430 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:55:02.506430 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:55:02.506430 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:55:02.506430 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:55:02.506430 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:55:02.506430 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:55:02.506430 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:55:02.506430 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 7f551e6fe34243c290a25b57ab26af19 Sep 08 10:55:02.506430 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:55:02.506430 n-d-850501-12 devstack@n-api.service[128861]: Sep 08 10:55:02.506430 n-d-850501-12 devstack@n-api.service[128861]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-804021803", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "12aa0876-bb28-47d9-975a-2d76f1aa7c84"}]}} Sep 08 10:55:02.506430 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:55:02.506430 n-d-850501-12 devstack@n-api.service[128861]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Sep 08 10:55:02.506430 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-804021803', 'imageRef': '503f4a0f-e18f-47fd-ad12-0289e3463117', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '12aa0876-bb28-47d9-975a-2d76f1aa7c84'}]}}} Sep 08 10:55:02.506430 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:55:02.506430 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:02.506430 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Sep 08 10:55:02.506430 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi result = func(instance) Sep 08 10:55:02.506430 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Sep 08 10:55:02.506430 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Sep 08 10:55:02.506430 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Sep 08 10:55:02.506430 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Sep 08 10:55:02.506430 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Sep 08 10:55:02.506430 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Sep 08 10:55:02.506430 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Sep 08 10:55:02.506430 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:02.506430 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 08 10:55:02.506430 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:02.506430 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:02.506430 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 10:55:02.506430 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 10:55:02.506430 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 10:55:02.506430 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise error Sep 08 10:55:02.506430 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Sep 08 10:55:02.506430 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:02.506430 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Sep 08 10:55:02.506430 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Sep 08 10:55:02.506430 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:02.506430 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 08 10:55:02.506430 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Sep 08 10:55:02.506430 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:02.506430 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:02.506430 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:02.506430 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:02.516823 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:55:02.516823 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:55:02.516823 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:55:02.516823 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:55:02.516823 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:55:02.516823 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:55:02.516823 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:55:02.516823 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:55:02.516823 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 10:55:02.516823 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 10:55:02.516823 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 10:55:02.516823 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 10:55:02.516823 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 10:55:02.516823 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 10:55:02.516823 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Sep 08 10:55:02.516823 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:02.516823 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:02.516823 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:02.516823 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:02.516823 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:55:02.516823 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:55:02.516823 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 10:55:02.516823 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 10:55:02.516823 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Sep 08 10:55:02.516823 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:02.521858 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-13230978-df88-4065-b1ca-84e76090f84f tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:55:02.525309 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-13230978-df88-4065-b1ca-84e76090f84f tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.057824 Sep 08 10:55:02.528988 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1910/3792] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:55:02 2022] POST /compute/v2.1/servers => generated 139 bytes in 62 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 08 10:55:02.547532 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bdac489b-4216-4b6a-9499-d003a196303e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:02.551640 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bdac489b-4216-4b6a-9499-d003a196303e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:02.570793 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bdac489b-4216-4b6a-9499-d003a196303e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:02.574224 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bdac489b-4216-4b6a-9499-d003a196303e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:02.574935 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bdac489b-4216-4b6a-9499-d003a196303e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:02.575851 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bdac489b-4216-4b6a-9499-d003a196303e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:02.577013 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bdac489b-4216-4b6a-9499-d003a196303e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:02.578306 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bdac489b-4216-4b6a-9499-d003a196303e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:03.014115 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-abb01457-34ac-4f6d-b2cf-311a82da0334 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:03.028599 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-abb01457-34ac-4f6d-b2cf-311a82da0334 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1671 microversion: 2.1 time: 0.816673 Sep 08 10:55:03.034649 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1883/3793] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:02 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1671 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:03.044425 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b5af23bb-2f34-4f4f-ae48-494510f6c278 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:03.054347 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b5af23bb-2f34-4f4f-ae48-494510f6c278 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] [instance: b7e97718-dc14-4e93-b7b3-49a8d8e03bb9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:03.067516 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:55:03.082196 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b5af23bb-2f34-4f4f-ae48-494510f6c278 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:03.085765 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b5af23bb-2f34-4f4f-ae48-494510f6c278 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:03.088103 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b5af23bb-2f34-4f4f-ae48-494510f6c278 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:03.090283 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b5af23bb-2f34-4f4f-ae48-494510f6c278 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:03.091689 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b5af23bb-2f34-4f4f-ae48-494510f6c278 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:03.096855 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b5af23bb-2f34-4f4f-ae48-494510f6c278 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:03.100072 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-bdac489b-4216-4b6a-9499-d003a196303e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:03.143332 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bdac489b-4216-4b6a-9499-d003a196303e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 0.608640 Sep 08 10:55:03.143942 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1911/3794] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:02 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:03.178549 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ed0062c9-1c8f-4a30-b248-fea11b59b53e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:03.179446 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ed0062c9-1c8f-4a30-b248-fea11b59b53e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:03.191127 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed0062c9-1c8f-4a30-b248-fea11b59b53e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:03.196518 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed0062c9-1c8f-4a30-b248-fea11b59b53e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:03.200995 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed0062c9-1c8f-4a30-b248-fea11b59b53e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:03.203519 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed0062c9-1c8f-4a30-b248-fea11b59b53e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:03.204195 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed0062c9-1c8f-4a30-b248-fea11b59b53e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:03.210612 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed0062c9-1c8f-4a30-b248-fea11b59b53e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:03.635229 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ed0062c9-1c8f-4a30-b248-fea11b59b53e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:03.648061 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ed0062c9-1c8f-4a30-b248-fea11b59b53e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 0.475794 Sep 08 10:55:03.648649 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1912/3795] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:03 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:03.685012 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-0acf8136-ad5f-4bba-a24c-9da26f277be8 req-4c4c486a-07fc-4c04-8457-478582eeefa1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e81e0acc-0b96-4dbc-a5bb-89183f5204e7", "name": "network-vif-unplugged", "status": "completed", "tag": "ff9d981d-5db2-425c-b066-f87540f6e91c"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:55:03.715288 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-0acf8136-ad5f-4bba-a24c-9da26f277be8 req-4c4c486a-07fc-4c04-8457-478582eeefa1 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:03.715787 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-0acf8136-ad5f-4bba-a24c-9da26f277be8 req-4c4c486a-07fc-4c04-8457-478582eeefa1 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:03.716245 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-0acf8136-ad5f-4bba-a24c-9da26f277be8 req-4c4c486a-07fc-4c04-8457-478582eeefa1 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:03.742685 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-0acf8136-ad5f-4bba-a24c-9da26f277be8 req-4c4c486a-07fc-4c04-8457-478582eeefa1 service nova] Creating event network-vif-unplugged:ff9d981d-5db2-425c-b066-f87540f6e91c for instance e81e0acc-0b96-4dbc-a5bb-89183f5204e7 on n-h1-850501-12 Sep 08 10:55:03.762599 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-0acf8136-ad5f-4bba-a24c-9da26f277be8 req-4c4c486a-07fc-4c04-8457-478582eeefa1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079921 Sep 08 10:55:03.763415 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1913/3796] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:55:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:55:03.976419 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b94a5122-89df-444f-8c86-e812f9139268 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1450450832", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "12aa0876-bb28-47d9-975a-2d76f1aa7c84"}]}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:55:03.982603 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b94a5122-89df-444f-8c86-e812f9139268 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Request method failure captured: Sep 08 10:55:03.982603 n-d-850501-12 devstack@n-api.service[128861]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 10:55:03.982603 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:55:03.982603 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:55:03.982603 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:55:03.982603 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 235 Sep 08 10:55:03.982603 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:55:03.982603 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:55:03.982603 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:55:03.982603 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:55:03.982603 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcmnspi0cCT_Ts_s7jcB6HjtEcdULbQPd_krJniB9lBsXpm1cXSOD-YMaJoaapHCxuCXz0q6Qe4WXufr5At6SSPw8ov8Oz1eUk-fSNbVp7WlOPycfCf5I6xwH7tfbsoefVfbTiDOfU9mTBl0Vs74qdfTniErHfQlEG4cAvAQl1-wMrs Sep 08 10:55:03.982603 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:55:03.982603 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:55:03.982603 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:55:03.982603 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:55:03.982603 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:55:03.982603 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:55:03.982603 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:55:03.982603 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:55:03.982603 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:55:03.982603 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:55:03.982603 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:55:03.982603 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:55:03.982603 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:55:03.982603 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:55:03.982603 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:55:03.982603 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:55:03.982603 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:55:03.982603 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 7f551e6fe34243c290a25b57ab26af19 Sep 08 10:55:03.982603 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:55:03.982603 n-d-850501-12 devstack@n-api.service[128861]: Sep 08 10:55:03.982603 n-d-850501-12 devstack@n-api.service[128861]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1450450832", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "12aa0876-bb28-47d9-975a-2d76f1aa7c84"}]}} Sep 08 10:55:03.982603 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:55:03.982603 n-d-850501-12 devstack@n-api.service[128861]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Sep 08 10:55:03.982603 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1450450832', 'imageRef': '503f4a0f-e18f-47fd-ad12-0289e3463117', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '12aa0876-bb28-47d9-975a-2d76f1aa7c84'}]}}} Sep 08 10:55:03.982603 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:55:03.982603 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:03.982603 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Sep 08 10:55:03.982603 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi result = func(instance) Sep 08 10:55:03.982603 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Sep 08 10:55:03.982603 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Sep 08 10:55:03.982603 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Sep 08 10:55:03.982603 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Sep 08 10:55:03.982603 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Sep 08 10:55:03.982603 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Sep 08 10:55:03.982603 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Sep 08 10:55:03.982603 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:03.982603 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 08 10:55:03.982603 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:03.982603 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:03.982603 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 10:55:03.982603 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 10:55:03.982603 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 10:55:03.982603 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise error Sep 08 10:55:03.982603 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Sep 08 10:55:03.982603 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:03.982603 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Sep 08 10:55:03.982603 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Sep 08 10:55:03.982603 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:03.982603 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 08 10:55:03.982603 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi 'notvalid' Sep 08 10:55:03.982603 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:03.982603 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:03.982603 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:03.982603 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:03.989784 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:55:03.989784 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:55:03.989784 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:55:03.989784 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:55:03.989784 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:55:03.989784 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:55:03.989784 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:55:03.989784 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:55:03.989784 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 10:55:03.989784 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 10:55:03.989784 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 10:55:03.989784 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 10:55:03.989784 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 10:55:03.989784 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 10:55:03.989784 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Sep 08 10:55:03.989784 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:03.989784 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:03.989784 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:03.989784 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:03.989784 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:55:03.989784 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:55:03.989784 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 10:55:03.989784 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 10:55:03.989784 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Sep 08 10:55:03.989784 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:03.995253 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b94a5122-89df-444f-8c86-e812f9139268 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:55:03.995253 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b94a5122-89df-444f-8c86-e812f9139268 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.026487 Sep 08 10:55:03.999527 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1914/3797] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:55:03 2022] POST /compute/v2.1/servers => generated 133 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:55:04.005801 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d70b89f3-2a85-4890-97b5-54b331b811ae tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:04.007848 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d70b89f3-2a85-4890-97b5-54b331b811ae tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:04.018379 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d70b89f3-2a85-4890-97b5-54b331b811ae tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:04.021744 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d70b89f3-2a85-4890-97b5-54b331b811ae tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:04.024095 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d70b89f3-2a85-4890-97b5-54b331b811ae tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:04.025513 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d70b89f3-2a85-4890-97b5-54b331b811ae tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:04.026190 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d70b89f3-2a85-4890-97b5-54b331b811ae tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:04.026885 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d70b89f3-2a85-4890-97b5-54b331b811ae tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:04.242406 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b5af23bb-2f34-4f4f-ae48-494510f6c278 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1bec228c17647bba62ba7d57d28e4ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0958700fa94b42b2b6b47af40cf2f679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:04.256038 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b5af23bb-2f34-4f4f-ae48-494510f6c278 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "GET /compute/v2.1/servers/b7e97718-dc14-4e93-b7b3-49a8d8e03bb9" status: 200 len: 1315 microversion: 2.1 time: 1.219838 Sep 08 10:55:04.262542 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1884/3798] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:03 2022] GET /compute/v2.1/servers/b7e97718-dc14-4e93-b7b3-49a8d8e03bb9 => generated 1315 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:04.518655 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d70b89f3-2a85-4890-97b5-54b331b811ae tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:04.521691 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=100 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:55:04.536094 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d70b89f3-2a85-4890-97b5-54b331b811ae tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 0.534833 Sep 08 10:55:04.563249 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1881373a-bde5-443d-841e-ef008eedb8fc tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:04.563881 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1881373a-bde5-443d-841e-ef008eedb8fc tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:04.570930 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1915/3799] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:03 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:04.580002 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1881373a-bde5-443d-841e-ef008eedb8fc tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:04.582129 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1881373a-bde5-443d-841e-ef008eedb8fc tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:04.582754 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1881373a-bde5-443d-841e-ef008eedb8fc tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:04.585519 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1881373a-bde5-443d-841e-ef008eedb8fc tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:04.586929 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1881373a-bde5-443d-841e-ef008eedb8fc tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:04.591654 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1881373a-bde5-443d-841e-ef008eedb8fc tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:05.045364 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1881373a-bde5-443d-841e-ef008eedb8fc tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:05.057436 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1881373a-bde5-443d-841e-ef008eedb8fc tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 0.498214 Sep 08 10:55:05.063108 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1885/3800] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:04 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:05.093564 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7a107f32-fbc1-4b78-a464-f74eae40c54b tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:55:05.099646 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7a107f32-fbc1-4b78-a464-f74eae40c54b tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: d0b26865-2d9f-4427-94de-b88728641fbd] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:05.113282 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-7a107f32-fbc1-4b78-a464-f74eae40c54b tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] HTTP exception thrown: Instance d0b26865-2d9f-4427-94de-b88728641fbd could not be found. Sep 08 10:55:05.125862 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7a107f32-fbc1-4b78-a464-f74eae40c54b tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Request method failure captured: Sep 08 10:55:05.125862 n-d-850501-12 devstack@n-api.service[128861]: request: POST /compute/v2.1/servers/d0b26865-2d9f-4427-94de-b88728641fbd/action HTTP/1.1 Sep 08 10:55:05.125862 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:55:05.125862 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:55:05.125862 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:55:05.125862 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 13 Sep 08 10:55:05.125862 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:55:05.125862 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:55:05.125862 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:55:05.125862 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:55:05.125862 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcmnspi0cCT_Ts_s7jcB6HjtEcdULbQPd_krJniB9lBsXpm1cXSOD-YMaJoaapHCxuCXz0q6Qe4WXufr5At6SSPw8ov8Oz1eUk-fSNbVp7WlOPycfCf5I6xwH7tfbsoefVfbTiDOfU9mTBl0Vs74qdfTniErHfQlEG4cAvAQl1-wMrs Sep 08 10:55:05.125862 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:55:05.125862 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:55:05.125862 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:55:05.125862 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:55:05.125862 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:55:05.125862 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:55:05.125862 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:55:05.125862 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:55:05.125862 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:55:05.125862 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:55:05.125862 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:55:05.125862 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:55:05.125862 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:55:05.125862 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:55:05.125862 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:55:05.125862 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:55:05.125862 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:55:05.125862 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 7f551e6fe34243c290a25b57ab26af19 Sep 08 10:55:05.125862 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:55:05.125862 n-d-850501-12 devstack@n-api.service[128861]: Sep 08 10:55:05.125862 n-d-850501-12 devstack@n-api.service[128861]: {"pause": {}} Sep 08 10:55:05.125862 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:55:05.125862 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance d0b26865-2d9f-4427-94de-b88728641fbd could not be found. Sep 08 10:55:05.125862 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': 'd0b26865-2d9f-4427-94de-b88728641fbd', 'body': {'pause': {}}} Sep 08 10:55:05.125862 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:55:05.125862 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:05.125862 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:55:05.125862 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:55:05.125862 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:55:05.125862 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:55:05.125862 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 08 10:55:05.125862 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 08 10:55:05.125862 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0b26865-2d9f-4427-94de-b88728641fbd could not be found. Sep 08 10:55:05.125862 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:05.125862 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:05.125862 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:05.125862 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:05.125862 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:55:05.125862 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:55:05.125862 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:55:05.125862 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:55:05.125862 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:55:05.125862 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:55:05.125862 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Sep 08 10:55:05.125862 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Sep 08 10:55:05.125862 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:55:05.125862 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:55:05.125862 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0b26865-2d9f-4427-94de-b88728641fbd could not be found. Sep 08 10:55:05.125862 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:05.125862 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:05.125862 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:05.125862 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:05.125862 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:55:05.125862 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:55:05.135580 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:55:05.135580 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:55:05.135580 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0b26865-2d9f-4427-94de-b88728641fbd could not be found. Sep 08 10:55:05.135580 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:05.138805 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7a107f32-fbc1-4b78-a464-f74eae40c54b tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Returning 404 to user: Instance d0b26865-2d9f-4427-94de-b88728641fbd could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:55:05.139319 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7a107f32-fbc1-4b78-a464-f74eae40c54b tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "POST /compute/v2.1/servers/d0b26865-2d9f-4427-94de-b88728641fbd/action" status: 404 len: 111 microversion: 2.1 time: 0.053743 Sep 08 10:55:05.150867 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ffa0cafc-6dac-463e-9e8b-5a28d63fdca7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:05.152022 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ffa0cafc-6dac-463e-9e8b-5a28d63fdca7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:05.154374 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1916/3801] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:55:05 2022] POST /compute/v2.1/servers/d0b26865-2d9f-4427-94de-b88728641fbd/action => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:55:05.164607 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ffa0cafc-6dac-463e-9e8b-5a28d63fdca7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:05.168115 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ffa0cafc-6dac-463e-9e8b-5a28d63fdca7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:05.172630 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ffa0cafc-6dac-463e-9e8b-5a28d63fdca7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:05.175398 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ffa0cafc-6dac-463e-9e8b-5a28d63fdca7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:05.176834 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ffa0cafc-6dac-463e-9e8b-5a28d63fdca7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:05.176999 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ffa0cafc-6dac-463e-9e8b-5a28d63fdca7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:05.211286 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-75937111-f15f-41b6-b8c8-f184103b33ab tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:05.211925 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-75937111-f15f-41b6-b8c8-f184103b33ab tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: 19604289-6d42-403f-bf74-75335e1782cb] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:05.228235 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-75937111-f15f-41b6-b8c8-f184103b33ab tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:05.228235 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-75937111-f15f-41b6-b8c8-f184103b33ab tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:05.228235 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-75937111-f15f-41b6-b8c8-f184103b33ab tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:05.228235 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-75937111-f15f-41b6-b8c8-f184103b33ab tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:05.228235 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-75937111-f15f-41b6-b8c8-f184103b33ab tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:05.228235 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-75937111-f15f-41b6-b8c8-f184103b33ab tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:05.280911 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-75937111-f15f-41b6-b8c8-f184103b33ab tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] HTTP exception thrown: Instance 19604289-6d42-403f-bf74-75335e1782cb could not be found. Sep 08 10:55:05.285735 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-75937111-f15f-41b6-b8c8-f184103b33ab tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Request method failure captured: Sep 08 10:55:05.285735 n-d-850501-12 devstack@n-api.service[128861]: request: DELETE /compute/v2.1/servers/19604289-6d42-403f-bf74-75335e1782cb HTTP/1.1 Sep 08 10:55:05.285735 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:55:05.285735 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:55:05.285735 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:55:05.285735 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:55:05.285735 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:55:05.285735 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:55:05.285735 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:55:05.285735 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:55:05.285735 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcf85nxlXglNpNUDafAex8bEd4FqCO21NTPeXDX2uUnTAK4RtQmB0Zln5OyfaDsL03XE7NxjFWJINQM-4CVmZPvJMmjswkfAMS-LTodBU21IQa_AJm8NdfZKIu9JkoC4h7calajGQneT5j1jgUkjySqAUeFvWcq2xoj6sNreqExg8K8 Sep 08 10:55:05.285735 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:55:05.285735 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:55:05.285735 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:55:05.285735 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:55:05.285735 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:55:05.285735 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:55:05.285735 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 20f9a24cad014d7f827e8f3236dd5bae Sep 08 10:55:05.285735 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-AttachVolumeNegativeTest-20693983 Sep 08 10:55:05.285735 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:55:05.285735 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:55:05.285735 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/20f9a24cad014d7f827e8f3236dd5bae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/20f9a24cad014d7f827e8f3236dd5bae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_20f9a24cad014d7f827e8f3236dd5bae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/20f9a24cad014d7f827e8f3236dd5bae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:55:05.285735 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-AttachVolumeNegativeTest-20693983 Sep 08 10:55:05.285735 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 20f9a24cad014d7f827e8f3236dd5bae Sep 08 10:55:05.285735 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-20693983 Sep 08 10:55:05.285735 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-AttachVolumeNegativeTest-20693983-project Sep 08 10:55:05.285735 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:55:05.285735 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:55:05.285735 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 5c291cbe955b4ee5abc98132dda0255e Sep 08 10:55:05.285735 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-AttachVolumeNegativeTest-20693983-project Sep 08 10:55:05.285735 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:55:05.285735 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 19604289-6d42-403f-bf74-75335e1782cb could not be found. Sep 08 10:55:05.285735 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '19604289-6d42-403f-bf74-75335e1782cb'} Sep 08 10:55:05.285735 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:55:05.285735 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:05.285735 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:55:05.285735 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:55:05.285735 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:55:05.285735 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:55:05.285735 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:55:05.285735 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:55:05.285735 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:55:05.285735 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:55:05.285735 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19604289-6d42-403f-bf74-75335e1782cb could not be found. Sep 08 10:55:05.285735 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:05.285735 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:05.285735 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:05.285735 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:05.285735 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:55:05.285735 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:55:05.285735 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:55:05.285735 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:55:05.285735 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:55:05.285735 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:55:05.285735 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:55:05.285735 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:55:05.285735 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:55:05.285735 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:55:05.285735 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:55:05.285735 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:55:05.285735 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:55:05.285735 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:55:05.293002 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19604289-6d42-403f-bf74-75335e1782cb could not be found. Sep 08 10:55:05.293002 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:05.293002 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:05.293002 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:05.293002 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:05.293002 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:55:05.293002 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:55:05.293002 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:55:05.293002 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:55:05.293002 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19604289-6d42-403f-bf74-75335e1782cb could not be found. Sep 08 10:55:05.293002 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:05.302564 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-75937111-f15f-41b6-b8c8-f184103b33ab tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Returning 404 to user: Instance 19604289-6d42-403f-bf74-75335e1782cb could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:55:05.307669 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-75937111-f15f-41b6-b8c8-f184103b33ab tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "DELETE /compute/v2.1/servers/19604289-6d42-403f-bf74-75335e1782cb" status: 404 len: 111 microversion: 2.1 time: 0.099086 Sep 08 10:55:05.309478 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1917/3802] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:55:05 2022] DELETE /compute/v2.1/servers/19604289-6d42-403f-bf74-75335e1782cb => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:55:05.328275 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c9c864de-cee9-42b8-a903-d13c7ebd8b7a tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:05.329362 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c9c864de-cee9-42b8-a903-d13c7ebd8b7a tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] [instance: b7e97718-dc14-4e93-b7b3-49a8d8e03bb9] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:05.345639 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c9c864de-cee9-42b8-a903-d13c7ebd8b7a tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:05.346191 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c9c864de-cee9-42b8-a903-d13c7ebd8b7a tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:05.347064 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c9c864de-cee9-42b8-a903-d13c7ebd8b7a tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:05.349198 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c9c864de-cee9-42b8-a903-d13c7ebd8b7a tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:05.349722 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c9c864de-cee9-42b8-a903-d13c7ebd8b7a tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:05.350157 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c9c864de-cee9-42b8-a903-d13c7ebd8b7a tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:05.670008 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ffa0cafc-6dac-463e-9e8b-5a28d63fdca7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:05.691158 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ffa0cafc-6dac-463e-9e8b-5a28d63fdca7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 0.544085 Sep 08 10:55:05.708168 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1886/3803] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:05 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:05.712269 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2175569b-20ca-4f8f-ace9-4ab6f45d1ca4 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:05.712898 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2175569b-20ca-4f8f-ace9-4ab6f45d1ca4 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: 19604289-6d42-403f-bf74-75335e1782cb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:05.725062 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2175569b-20ca-4f8f-ace9-4ab6f45d1ca4 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:05.726042 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2175569b-20ca-4f8f-ace9-4ab6f45d1ca4 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:05.726684 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2175569b-20ca-4f8f-ace9-4ab6f45d1ca4 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:05.727604 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2175569b-20ca-4f8f-ace9-4ab6f45d1ca4 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:05.728260 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2175569b-20ca-4f8f-ace9-4ab6f45d1ca4 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:05.728889 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2175569b-20ca-4f8f-ace9-4ab6f45d1ca4 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:05.746655 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-2175569b-20ca-4f8f-ace9-4ab6f45d1ca4 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] HTTP exception thrown: Instance 19604289-6d42-403f-bf74-75335e1782cb could not be found. Sep 08 10:55:05.748413 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2175569b-20ca-4f8f-ace9-4ab6f45d1ca4 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Request method failure captured: Sep 08 10:55:05.748413 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/19604289-6d42-403f-bf74-75335e1782cb HTTP/1.1 Sep 08 10:55:05.748413 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:55:05.748413 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:55:05.748413 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:55:05.748413 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:55:05.748413 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:55:05.748413 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:55:05.748413 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:55:05.748413 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:55:05.748413 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcf85nxlXglNpNUDafAex8bEd4FqCO21NTPeXDX2uUnTAK4RtQmB0Zln5OyfaDsL03XE7NxjFWJINQM-4CVmZPvJMmjswkfAMS-LTodBU21IQa_AJm8NdfZKIu9JkoC4h7calajGQneT5j1jgUkjySqAUeFvWcq2xoj6sNreqExg8K8 Sep 08 10:55:05.748413 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:55:05.748413 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:55:05.748413 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:55:05.748413 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:55:05.748413 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:55:05.748413 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:55:05.748413 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 20f9a24cad014d7f827e8f3236dd5bae Sep 08 10:55:05.748413 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-AttachVolumeNegativeTest-20693983 Sep 08 10:55:05.748413 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:55:05.748413 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:55:05.748413 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/20f9a24cad014d7f827e8f3236dd5bae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/20f9a24cad014d7f827e8f3236dd5bae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_20f9a24cad014d7f827e8f3236dd5bae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/20f9a24cad014d7f827e8f3236dd5bae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:55:05.748413 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-AttachVolumeNegativeTest-20693983 Sep 08 10:55:05.748413 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 20f9a24cad014d7f827e8f3236dd5bae Sep 08 10:55:05.748413 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-20693983 Sep 08 10:55:05.748413 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-AttachVolumeNegativeTest-20693983-project Sep 08 10:55:05.748413 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:55:05.748413 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:55:05.748413 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 5c291cbe955b4ee5abc98132dda0255e Sep 08 10:55:05.748413 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-AttachVolumeNegativeTest-20693983-project Sep 08 10:55:05.748413 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:55:05.748413 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 19604289-6d42-403f-bf74-75335e1782cb could not be found. Sep 08 10:55:05.748413 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '19604289-6d42-403f-bf74-75335e1782cb'} Sep 08 10:55:05.748413 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:55:05.748413 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:05.748413 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:55:05.748413 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:55:05.748413 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:55:05.748413 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:55:05.748413 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:55:05.748413 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:55:05.748413 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:55:05.748413 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:55:05.748413 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19604289-6d42-403f-bf74-75335e1782cb could not be found. Sep 08 10:55:05.748413 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:05.748413 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:05.748413 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:05.748413 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:05.748413 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:55:05.748413 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:55:05.748413 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:55:05.748413 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:55:05.748413 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:55:05.748413 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:55:05.748413 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:55:05.748413 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:55:05.748413 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:55:05.748413 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:55:05.748413 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:55:05.748413 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:55:05.748413 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19604289-6d42-403f-bf74-75335e1782cb could not be found. Sep 08 10:55:05.748413 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:05.748413 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:05.748413 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:05.754857 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:05.754857 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:55:05.754857 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:55:05.754857 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:55:05.754857 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:55:05.754857 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19604289-6d42-403f-bf74-75335e1782cb could not be found. Sep 08 10:55:05.754857 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:05.754857 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2175569b-20ca-4f8f-ace9-4ab6f45d1ca4 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Returning 404 to user: Instance 19604289-6d42-403f-bf74-75335e1782cb could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:55:05.754857 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2175569b-20ca-4f8f-ace9-4ab6f45d1ca4 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/19604289-6d42-403f-bf74-75335e1782cb" status: 404 len: 111 microversion: 2.1 time: 0.048564 Sep 08 10:55:05.754857 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1887/3804] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:05 2022] GET /compute/v2.1/servers/19604289-6d42-403f-bf74-75335e1782cb => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:55:05.757326 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-f123c8f4-9d37-4ac3-8d7c-608685a00623 req-412f8414-6588-4b88-bc66-fe4557776246 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7e97718-dc14-4e93-b7b3-49a8d8e03bb9", "tag": "e2153ee7-b11d-41b7-b5fb-82f06d8cb9d0"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:55:05.767134 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-f123c8f4-9d37-4ac3-8d7c-608685a00623 req-412f8414-6588-4b88-bc66-fe4557776246 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:05.767999 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-f123c8f4-9d37-4ac3-8d7c-608685a00623 req-412f8414-6588-4b88-bc66-fe4557776246 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:05.768998 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-f123c8f4-9d37-4ac3-8d7c-608685a00623 req-412f8414-6588-4b88-bc66-fe4557776246 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:05.781370 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-f123c8f4-9d37-4ac3-8d7c-608685a00623 req-412f8414-6588-4b88-bc66-fe4557776246 service nova] Creating event network-changed:e2153ee7-b11d-41b7-b5fb-82f06d8cb9d0 for instance b7e97718-dc14-4e93-b7b3-49a8d8e03bb9 on n-h1-850501-12 Sep 08 10:55:05.786409 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-f123c8f4-9d37-4ac3-8d7c-608685a00623 req-412f8414-6588-4b88-bc66-fe4557776246 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033214 Sep 08 10:55:05.787450 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1888/3805] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:55:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:55:05.792823 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-311791a1-27db-4ca8-bb3a-1ccccf051390 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:05.793567 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-311791a1-27db-4ca8-bb3a-1ccccf051390 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:05.801153 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-311791a1-27db-4ca8-bb3a-1ccccf051390 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:05.801669 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-311791a1-27db-4ca8-bb3a-1ccccf051390 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:05.802111 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-311791a1-27db-4ca8-bb3a-1ccccf051390 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:05.802898 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-311791a1-27db-4ca8-bb3a-1ccccf051390 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:05.803369 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-311791a1-27db-4ca8-bb3a-1ccccf051390 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:05.803807 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-311791a1-27db-4ca8-bb3a-1ccccf051390 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:06.118555 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-311791a1-27db-4ca8-bb3a-1ccccf051390 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:06.135592 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-311791a1-27db-4ca8-bb3a-1ccccf051390 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1671 microversion: 2.1 time: 0.346714 Sep 08 10:55:06.138039 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1889/3806] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:05 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1671 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:06.149357 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fea197dc-a8be-428e-b690-34a866d9c32b tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:06.151285 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fea197dc-a8be-428e-b690-34a866d9c32b tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:06.182115 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fea197dc-a8be-428e-b690-34a866d9c32b tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:06.183571 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fea197dc-a8be-428e-b690-34a866d9c32b tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:06.184780 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fea197dc-a8be-428e-b690-34a866d9c32b tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:06.187459 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fea197dc-a8be-428e-b690-34a866d9c32b tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:06.191459 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fea197dc-a8be-428e-b690-34a866d9c32b tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:06.193087 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fea197dc-a8be-428e-b690-34a866d9c32b tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:06.240072 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c9c864de-cee9-42b8-a903-d13c7ebd8b7a tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1bec228c17647bba62ba7d57d28e4ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0958700fa94b42b2b6b47af40cf2f679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:06.251143 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c9c864de-cee9-42b8-a903-d13c7ebd8b7a tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "GET /compute/v2.1/servers/b7e97718-dc14-4e93-b7b3-49a8d8e03bb9" status: 200 len: 1315 microversion: 2.1 time: 0.936554 Sep 08 10:55:06.255872 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1918/3807] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:05 2022] GET /compute/v2.1/servers/b7e97718-dc14-4e93-b7b3-49a8d8e03bb9 => generated 1315 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:06.261289 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a09d8cc5-5d8d-43d2-9c46-67f7f8483a88 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:06.266007 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a09d8cc5-5d8d-43d2-9c46-67f7f8483a88 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:06.281576 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a09d8cc5-5d8d-43d2-9c46-67f7f8483a88 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:06.282237 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a09d8cc5-5d8d-43d2-9c46-67f7f8483a88 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:06.282802 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a09d8cc5-5d8d-43d2-9c46-67f7f8483a88 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:06.285132 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a09d8cc5-5d8d-43d2-9c46-67f7f8483a88 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:06.290000 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a09d8cc5-5d8d-43d2-9c46-67f7f8483a88 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:06.290645 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a09d8cc5-5d8d-43d2-9c46-67f7f8483a88 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:06.562731 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a09d8cc5-5d8d-43d2-9c46-67f7f8483a88 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:06.575338 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a09d8cc5-5d8d-43d2-9c46-67f7f8483a88 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1671 microversion: 2.1 time: 0.317648 Sep 08 10:55:06.581624 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1919/3808] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:06 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1671 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:06.609485 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9ebf73ac-aef6-409e-817c-9da0ea9dacf8 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:06.610616 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9ebf73ac-aef6-409e-817c-9da0ea9dacf8 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:06.629515 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ebf73ac-aef6-409e-817c-9da0ea9dacf8 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:06.634641 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ebf73ac-aef6-409e-817c-9da0ea9dacf8 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:06.635263 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ebf73ac-aef6-409e-817c-9da0ea9dacf8 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:06.636251 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ebf73ac-aef6-409e-817c-9da0ea9dacf8 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:06.637092 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ebf73ac-aef6-409e-817c-9da0ea9dacf8 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:06.638146 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ebf73ac-aef6-409e-817c-9da0ea9dacf8 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:06.651921 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fea197dc-a8be-428e-b690-34a866d9c32b tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:06.659534 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:55:06.665281 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fea197dc-a8be-428e-b690-34a866d9c32b tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 0.525030 Sep 08 10:55:06.667256 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1890/3809] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:06 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:06.692460 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a3f631f0-ac24-49c1-92d5-ae63b4c86120 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:55:06.693581 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a3f631f0-ac24-49c1-92d5-ae63b4c86120 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:06.707232 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a3f631f0-ac24-49c1-92d5-ae63b4c86120 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:06.707742 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a3f631f0-ac24-49c1-92d5-ae63b4c86120 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:06.714074 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a3f631f0-ac24-49c1-92d5-ae63b4c86120 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:06.715128 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a3f631f0-ac24-49c1-92d5-ae63b4c86120 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:06.715820 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a3f631f0-ac24-49c1-92d5-ae63b4c86120 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:06.716436 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a3f631f0-ac24-49c1-92d5-ae63b4c86120 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:06.870561 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a3f631f0-ac24-49c1-92d5-ae63b4c86120 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "POST /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03/action" status: 202 len: 0 microversion: 2.1 time: 0.182229 Sep 08 10:55:06.873542 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1891/3810] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:55:06 2022] POST /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:55:06.884605 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7ab76eaf-eea9-4027-adce-9cd79f877c3b tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:06.885666 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7ab76eaf-eea9-4027-adce-9cd79f877c3b tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:06.896043 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ab76eaf-eea9-4027-adce-9cd79f877c3b tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:06.897006 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ab76eaf-eea9-4027-adce-9cd79f877c3b tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:06.897832 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ab76eaf-eea9-4027-adce-9cd79f877c3b tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:06.898980 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ab76eaf-eea9-4027-adce-9cd79f877c3b tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:06.899891 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ab76eaf-eea9-4027-adce-9cd79f877c3b tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:06.900604 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ab76eaf-eea9-4027-adce-9cd79f877c3b tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:07.151285 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9ebf73ac-aef6-409e-817c-9da0ea9dacf8 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:07.168637 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9ebf73ac-aef6-409e-817c-9da0ea9dacf8 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1671 microversion: 2.1 time: 0.571617 Sep 08 10:55:07.187011 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1920/3811] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:06 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1671 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:07.207947 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-661ed796-b2cf-4d84-af05-908e1bbea411 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:55:07.218251 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-661ed796-b2cf-4d84-af05-908e1bbea411 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:07.234384 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:55:07.241178 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-661ed796-b2cf-4d84-af05-908e1bbea411 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:07.242441 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-661ed796-b2cf-4d84-af05-908e1bbea411 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:07.243533 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-661ed796-b2cf-4d84-af05-908e1bbea411 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:07.244942 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7ab76eaf-eea9-4027-adce-9cd79f877c3b tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:07.245976 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-661ed796-b2cf-4d84-af05-908e1bbea411 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:07.246635 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-661ed796-b2cf-4d84-af05-908e1bbea411 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:07.247779 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-661ed796-b2cf-4d84-af05-908e1bbea411 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:07.259440 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7ab76eaf-eea9-4027-adce-9cd79f877c3b tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1509 microversion: 2.1 time: 0.375814 Sep 08 10:55:07.261095 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1892/3812] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:06 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1509 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:55:07.295941 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e7c169d9-15df-466f-bc09-a08766214332 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:07.299134 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e7c169d9-15df-466f-bc09-a08766214332 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] [instance: b7e97718-dc14-4e93-b7b3-49a8d8e03bb9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:07.317753 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7c169d9-15df-466f-bc09-a08766214332 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:07.318727 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7c169d9-15df-466f-bc09-a08766214332 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:07.336772 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7c169d9-15df-466f-bc09-a08766214332 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:07.338078 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7c169d9-15df-466f-bc09-a08766214332 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:07.338829 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7c169d9-15df-466f-bc09-a08766214332 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:07.339511 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7c169d9-15df-466f-bc09-a08766214332 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:07.533563 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-661ed796-b2cf-4d84-af05-908e1bbea411 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "POST /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7/action" status: 202 len: 0 microversion: 2.1 time: 0.337496 Sep 08 10:55:07.542097 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1921/3813] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:55:07 2022] POST /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7/action => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:55:07.558648 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-19065837-0a81-4c9b-9331-7ab27a41764c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:07.561752 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-19065837-0a81-4c9b-9331-7ab27a41764c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:07.576231 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-19065837-0a81-4c9b-9331-7ab27a41764c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:07.587417 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-19065837-0a81-4c9b-9331-7ab27a41764c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:07.589542 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-19065837-0a81-4c9b-9331-7ab27a41764c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:07.590706 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-19065837-0a81-4c9b-9331-7ab27a41764c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:07.594427 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-19065837-0a81-4c9b-9331-7ab27a41764c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:07.597090 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-19065837-0a81-4c9b-9331-7ab27a41764c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:07.671100 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=8 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:55:07.816233 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e7c169d9-15df-466f-bc09-a08766214332 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1bec228c17647bba62ba7d57d28e4ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0958700fa94b42b2b6b47af40cf2f679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:07.831509 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e7c169d9-15df-466f-bc09-a08766214332 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "GET /compute/v2.1/servers/b7e97718-dc14-4e93-b7b3-49a8d8e03bb9" status: 200 len: 1315 microversion: 2.1 time: 0.548698 Sep 08 10:55:07.845053 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1893/3814] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:07 2022] GET /compute/v2.1/servers/b7e97718-dc14-4e93-b7b3-49a8d8e03bb9 => generated 1315 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:55:08.284622 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f4d7edfa-352a-40a1-8f09-81eb1f661bd2 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:08.285522 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f4d7edfa-352a-40a1-8f09-81eb1f661bd2 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:08.307145 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f4d7edfa-352a-40a1-8f09-81eb1f661bd2 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:08.307828 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f4d7edfa-352a-40a1-8f09-81eb1f661bd2 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:08.309572 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f4d7edfa-352a-40a1-8f09-81eb1f661bd2 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:08.314007 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f4d7edfa-352a-40a1-8f09-81eb1f661bd2 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:08.317274 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f4d7edfa-352a-40a1-8f09-81eb1f661bd2 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:08.320903 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f4d7edfa-352a-40a1-8f09-81eb1f661bd2 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:08.453873 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-19065837-0a81-4c9b-9331-7ab27a41764c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:08.464607 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-19065837-0a81-4c9b-9331-7ab27a41764c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1673 microversion: 2.1 time: 0.920803 Sep 08 10:55:08.465230 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1922/3815] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:07 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1673 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:08.860433 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a949f28a-309a-4cd6-9dfb-cea9772d8abe tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:08.862007 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a949f28a-309a-4cd6-9dfb-cea9772d8abe tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] [instance: b7e97718-dc14-4e93-b7b3-49a8d8e03bb9] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:08.869582 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a949f28a-309a-4cd6-9dfb-cea9772d8abe tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:08.870447 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a949f28a-309a-4cd6-9dfb-cea9772d8abe tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:08.871307 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a949f28a-309a-4cd6-9dfb-cea9772d8abe tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:08.872809 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a949f28a-309a-4cd6-9dfb-cea9772d8abe tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:08.873804 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a949f28a-309a-4cd6-9dfb-cea9772d8abe tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:08.874572 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a949f28a-309a-4cd6-9dfb-cea9772d8abe tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:09.152533 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f4d7edfa-352a-40a1-8f09-81eb1f661bd2 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:09.171034 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f4d7edfa-352a-40a1-8f09-81eb1f661bd2 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1489 microversion: 2.1 time: 0.888263 Sep 08 10:55:09.172500 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1894/3816] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:08 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1489 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:55:09.201904 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-eb2739f7-a0b6-49ec-acbc-cc56a75b17d5 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:55:09.202669 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-eb2739f7-a0b6-49ec-acbc-cc56a75b17d5 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:09.228972 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb2739f7-a0b6-49ec-acbc-cc56a75b17d5 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:09.229459 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb2739f7-a0b6-49ec-acbc-cc56a75b17d5 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:09.229925 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb2739f7-a0b6-49ec-acbc-cc56a75b17d5 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:09.230679 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb2739f7-a0b6-49ec-acbc-cc56a75b17d5 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:09.231146 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb2739f7-a0b6-49ec-acbc-cc56a75b17d5 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:09.231579 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb2739f7-a0b6-49ec-acbc-cc56a75b17d5 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:09.350384 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-eb2739f7-a0b6-49ec-acbc-cc56a75b17d5 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] HTTP exception thrown: Cannot 'pause' instance 74eebde7-4328-4ddf-be14-bb9fba70ec03 while it is in vm_state paused Sep 08 10:55:09.363186 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-eb2739f7-a0b6-49ec-acbc-cc56a75b17d5 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Request method failure captured: Sep 08 10:55:09.363186 n-d-850501-12 devstack@n-api.service[128862]: request: POST /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03/action HTTP/1.1 Sep 08 10:55:09.363186 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:55:09.363186 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:55:09.363186 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:55:09.363186 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 13 Sep 08 10:55:09.363186 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:55:09.363186 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:55:09.363186 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:55:09.363186 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:55:09.363186 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcmnspi0cCT_Ts_s7jcB6HjtEcdULbQPd_krJniB9lBsXpm1cXSOD-YMaJoaapHCxuCXz0q6Qe4WXufr5At6SSPw8ov8Oz1eUk-fSNbVp7WlOPycfCf5I6xwH7tfbsoefVfbTiDOfU9mTBl0Vs74qdfTniErHfQlEG4cAvAQl1-wMrs Sep 08 10:55:09.363186 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:55:09.363186 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:55:09.363186 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:55:09.363186 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:55:09.363186 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:55:09.363186 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:55:09.363186 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:55:09.363186 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:55:09.363186 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:55:09.363186 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:55:09.363186 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:55:09.363186 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:55:09.363186 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:55:09.363186 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:55:09.363186 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:55:09.363186 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:55:09.363186 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:55:09.363186 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 7f551e6fe34243c290a25b57ab26af19 Sep 08 10:55:09.363186 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:55:09.363186 n-d-850501-12 devstack@n-api.service[128862]: Sep 08 10:55:09.363186 n-d-850501-12 devstack@n-api.service[128862]: {"pause": {}} Sep 08 10:55:09.363186 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:55:09.363186 n-d-850501-12 devstack@n-api.service[128862]: exception: Cannot 'pause' instance 74eebde7-4328-4ddf-be14-bb9fba70ec03 while it is in vm_state paused Sep 08 10:55:09.363186 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '74eebde7-4328-4ddf-be14-bb9fba70ec03', 'body': {'pause': {}}} Sep 08 10:55:09.363186 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:55:09.363186 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:09.363186 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Sep 08 10:55:09.363186 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Sep 08 10:55:09.363186 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 10:55:09.363186 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 10:55:09.363186 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 08 10:55:09.363186 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 08 10:55:09.363186 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 74eebde7-4328-4ddf-be14-bb9fba70ec03 in vm_state paused. Cannot pause while the instance is in this state. Sep 08 10:55:09.363186 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:09.363186 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:09.363186 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:09.363186 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:09.363186 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:55:09.363186 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:55:09.363186 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:55:09.363186 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:55:09.363186 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:55:09.363186 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:55:09.363186 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Sep 08 10:55:09.363186 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 08 10:55:09.363186 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 08 10:55:09.363186 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 08 10:55:09.363186 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 74eebde7-4328-4ddf-be14-bb9fba70ec03 while it is in vm_state paused Sep 08 10:55:09.363186 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:09.363186 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:09.363186 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:09.363186 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:09.363186 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:55:09.370376 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:55:09.370376 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:55:09.370376 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:55:09.370376 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 74eebde7-4328-4ddf-be14-bb9fba70ec03 while it is in vm_state paused Sep 08 10:55:09.370376 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:09.370376 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-eb2739f7-a0b6-49ec-acbc-cc56a75b17d5 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Returning 409 to user: Cannot 'pause' instance 74eebde7-4328-4ddf-be14-bb9fba70ec03 while it is in vm_state paused {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:55:09.370376 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-eb2739f7-a0b6-49ec-acbc-cc56a75b17d5 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "POST /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03/action" status: 409 len: 143 microversion: 2.1 time: 0.166860 Sep 08 10:55:09.376434 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1895/3817] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:55:09 2022] POST /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03/action => generated 143 bytes in 180 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 08 10:55:09.387882 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-63ef299d-8514-4f25-88af-f6494be0b9a7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:55:09.388307 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-63ef299d-8514-4f25-88af-f6494be0b9a7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:09.408971 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63ef299d-8514-4f25-88af-f6494be0b9a7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:09.409564 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63ef299d-8514-4f25-88af-f6494be0b9a7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:09.410003 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63ef299d-8514-4f25-88af-f6494be0b9a7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:09.410738 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63ef299d-8514-4f25-88af-f6494be0b9a7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:09.411196 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63ef299d-8514-4f25-88af-f6494be0b9a7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:09.411621 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63ef299d-8514-4f25-88af-f6494be0b9a7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:09.480008 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a949f28a-309a-4cd6-9dfb-cea9772d8abe tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1bec228c17647bba62ba7d57d28e4ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0958700fa94b42b2b6b47af40cf2f679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:09.494517 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a949f28a-309a-4cd6-9dfb-cea9772d8abe tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "GET /compute/v2.1/servers/b7e97718-dc14-4e93-b7b3-49a8d8e03bb9" status: 200 len: 1315 microversion: 2.1 time: 0.638493 Sep 08 10:55:09.495148 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1923/3818] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:08 2022] GET /compute/v2.1/servers/b7e97718-dc14-4e93-b7b3-49a8d8e03bb9 => generated 1315 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:55:09.526309 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5e2af606-282a-4790-8d45-9950ec538db8 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:09.527135 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5e2af606-282a-4790-8d45-9950ec538db8 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:09.554326 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5e2af606-282a-4790-8d45-9950ec538db8 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:09.555754 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5e2af606-282a-4790-8d45-9950ec538db8 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:09.556253 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5e2af606-282a-4790-8d45-9950ec538db8 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:09.557011 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5e2af606-282a-4790-8d45-9950ec538db8 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:09.560243 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5e2af606-282a-4790-8d45-9950ec538db8 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:09.560701 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5e2af606-282a-4790-8d45-9950ec538db8 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:09.599801 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-63ef299d-8514-4f25-88af-f6494be0b9a7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "POST /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03/action" status: 202 len: 0 microversion: 2.1 time: 0.218030 Sep 08 10:55:09.603869 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1896/3819] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:55:09 2022] POST /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:55:09.627734 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-31d737c5-f986-4ba2-9039-c2317e83c424 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:09.629518 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-31d737c5-f986-4ba2-9039-c2317e83c424 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:09.648771 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-31d737c5-f986-4ba2-9039-c2317e83c424 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:09.649617 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-31d737c5-f986-4ba2-9039-c2317e83c424 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:09.650777 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-31d737c5-f986-4ba2-9039-c2317e83c424 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:09.651745 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-31d737c5-f986-4ba2-9039-c2317e83c424 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:09.652394 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-31d737c5-f986-4ba2-9039-c2317e83c424 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:09.653007 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-31d737c5-f986-4ba2-9039-c2317e83c424 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:09.916467 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-31d737c5-f986-4ba2-9039-c2317e83c424 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:09.924838 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-31d737c5-f986-4ba2-9039-c2317e83c424 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1496 microversion: 2.1 time: 0.307840 Sep 08 10:55:09.947403 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1897/3820] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:09 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1496 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:10.278291 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5e2af606-282a-4790-8d45-9950ec538db8 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:10.290588 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5e2af606-282a-4790-8d45-9950ec538db8 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1673 microversion: 2.1 time: 0.791471 Sep 08 10:55:10.291623 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1924/3821] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:09 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1673 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:10.522517 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-eb0b8fed-e67b-4d2f-b3d1-b124994d93f1 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:10.523308 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-eb0b8fed-e67b-4d2f-b3d1-b124994d93f1 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] [instance: b7e97718-dc14-4e93-b7b3-49a8d8e03bb9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:10.543174 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb0b8fed-e67b-4d2f-b3d1-b124994d93f1 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:10.546800 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb0b8fed-e67b-4d2f-b3d1-b124994d93f1 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:10.549940 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb0b8fed-e67b-4d2f-b3d1-b124994d93f1 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:10.551639 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb0b8fed-e67b-4d2f-b3d1-b124994d93f1 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:10.552448 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb0b8fed-e67b-4d2f-b3d1-b124994d93f1 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:10.553328 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb0b8fed-e67b-4d2f-b3d1-b124994d93f1 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:10.883806 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-eb0b8fed-e67b-4d2f-b3d1-b124994d93f1 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1bec228c17647bba62ba7d57d28e4ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0958700fa94b42b2b6b47af40cf2f679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:10.908675 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-eb0b8fed-e67b-4d2f-b3d1-b124994d93f1 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "GET /compute/v2.1/servers/b7e97718-dc14-4e93-b7b3-49a8d8e03bb9" status: 200 len: 1315 microversion: 2.1 time: 0.390478 Sep 08 10:55:10.911100 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1898/3822] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:10 2022] GET /compute/v2.1/servers/b7e97718-dc14-4e93-b7b3-49a8d8e03bb9 => generated 1315 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:10.959080 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5d834c8b-2a6e-4200-bce8-e45e07dfd2d2 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:10.960533 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5d834c8b-2a6e-4200-bce8-e45e07dfd2d2 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:10.970320 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5d834c8b-2a6e-4200-bce8-e45e07dfd2d2 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:10.971241 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5d834c8b-2a6e-4200-bce8-e45e07dfd2d2 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:10.972095 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5d834c8b-2a6e-4200-bce8-e45e07dfd2d2 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:10.973185 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5d834c8b-2a6e-4200-bce8-e45e07dfd2d2 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:10.974590 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5d834c8b-2a6e-4200-bce8-e45e07dfd2d2 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:10.975295 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5d834c8b-2a6e-4200-bce8-e45e07dfd2d2 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:11.214370 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5d834c8b-2a6e-4200-bce8-e45e07dfd2d2 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:11.225747 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5d834c8b-2a6e-4200-bce8-e45e07dfd2d2 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 0.271626 Sep 08 10:55:11.226353 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1925/3823] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:10 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:11.261283 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ccea1e2b-f190-4176-abd6-c95fe88cb738 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:11.262355 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ccea1e2b-f190-4176-abd6-c95fe88cb738 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:11.273175 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ccea1e2b-f190-4176-abd6-c95fe88cb738 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:11.274636 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ccea1e2b-f190-4176-abd6-c95fe88cb738 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:11.275331 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ccea1e2b-f190-4176-abd6-c95fe88cb738 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:11.279957 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ccea1e2b-f190-4176-abd6-c95fe88cb738 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:11.280904 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ccea1e2b-f190-4176-abd6-c95fe88cb738 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:11.281565 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ccea1e2b-f190-4176-abd6-c95fe88cb738 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:11.314608 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1ded7359-8309-4939-9a69-c16ded99d283 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:11.315489 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1ded7359-8309-4939-9a69-c16ded99d283 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:11.333945 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1ded7359-8309-4939-9a69-c16ded99d283 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:11.335352 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1ded7359-8309-4939-9a69-c16ded99d283 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:11.336200 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1ded7359-8309-4939-9a69-c16ded99d283 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:11.352021 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1ded7359-8309-4939-9a69-c16ded99d283 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:11.352460 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1ded7359-8309-4939-9a69-c16ded99d283 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:11.353038 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1ded7359-8309-4939-9a69-c16ded99d283 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:11.652677 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1ded7359-8309-4939-9a69-c16ded99d283 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:11.664867 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1ded7359-8309-4939-9a69-c16ded99d283 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1671 microversion: 2.1 time: 0.352201 Sep 08 10:55:11.667488 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1926/3824] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:11 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1671 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:11.683556 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a1a556b9-9019-489d-b1b2-8fea5a6e3b08 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "36d7bab8-c050-4496-aba4-395658e6e896"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:55:11.687711 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a1a556b9-9019-489d-b1b2-8fea5a6e3b08 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: 93d05d86-99b6-43f0-83c7-257ab64a12f3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:11.709397 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a1a556b9-9019-489d-b1b2-8fea5a6e3b08 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:11.710184 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a1a556b9-9019-489d-b1b2-8fea5a6e3b08 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:11.710802 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a1a556b9-9019-489d-b1b2-8fea5a6e3b08 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:11.711709 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a1a556b9-9019-489d-b1b2-8fea5a6e3b08 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:11.712336 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a1a556b9-9019-489d-b1b2-8fea5a6e3b08 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:11.712932 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a1a556b9-9019-489d-b1b2-8fea5a6e3b08 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:11.736176 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ccea1e2b-f190-4176-abd6-c95fe88cb738 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:11.747678 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ccea1e2b-f190-4176-abd6-c95fe88cb738 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 0.487939 Sep 08 10:55:11.748684 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1899/3825] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:11 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:11.756739 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-51ce2c18-da40-4111-8b87-907b14db4b53 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:11.758438 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-51ce2c18-da40-4111-8b87-907b14db4b53 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: f182d52b-9650-44f2-bd28-f2ae1daa1438] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:11.776350 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51ce2c18-da40-4111-8b87-907b14db4b53 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:11.780919 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51ce2c18-da40-4111-8b87-907b14db4b53 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:11.781882 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51ce2c18-da40-4111-8b87-907b14db4b53 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:11.783868 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51ce2c18-da40-4111-8b87-907b14db4b53 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:11.786645 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51ce2c18-da40-4111-8b87-907b14db4b53 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:11.788012 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51ce2c18-da40-4111-8b87-907b14db4b53 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:11.825350 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-51ce2c18-da40-4111-8b87-907b14db4b53 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] HTTP exception thrown: Instance f182d52b-9650-44f2-bd28-f2ae1daa1438 could not be found. Sep 08 10:55:11.829337 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-51ce2c18-da40-4111-8b87-907b14db4b53 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Request method failure captured: Sep 08 10:55:11.829337 n-d-850501-12 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/servers/f182d52b-9650-44f2-bd28-f2ae1daa1438 HTTP/1.1 Sep 08 10:55:11.829337 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:55:11.829337 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:55:11.829337 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:55:11.829337 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:55:11.829337 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:55:11.829337 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:55:11.829337 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:55:11.829337 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:55:11.829337 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcf85nxlXglNpNUDafAex8bEd4FqCO21NTPeXDX2uUnTAK4RtQmB0Zln5OyfaDsL03XE7NxjFWJINQM-4CVmZPvJMmjswkfAMS-LTodBU21IQa_AJm8NdfZKIu9JkoC4h7calajGQneT5j1jgUkjySqAUeFvWcq2xoj6sNreqExg8K8 Sep 08 10:55:11.829337 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:55:11.829337 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:55:11.829337 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:55:11.829337 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:55:11.829337 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:55:11.829337 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:55:11.829337 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 20f9a24cad014d7f827e8f3236dd5bae Sep 08 10:55:11.829337 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-AttachVolumeNegativeTest-20693983 Sep 08 10:55:11.829337 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:55:11.829337 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:55:11.829337 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/20f9a24cad014d7f827e8f3236dd5bae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/20f9a24cad014d7f827e8f3236dd5bae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_20f9a24cad014d7f827e8f3236dd5bae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/20f9a24cad014d7f827e8f3236dd5bae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:55:11.829337 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-AttachVolumeNegativeTest-20693983 Sep 08 10:55:11.829337 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 20f9a24cad014d7f827e8f3236dd5bae Sep 08 10:55:11.829337 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-20693983 Sep 08 10:55:11.829337 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-AttachVolumeNegativeTest-20693983-project Sep 08 10:55:11.829337 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:55:11.829337 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:55:11.829337 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 5c291cbe955b4ee5abc98132dda0255e Sep 08 10:55:11.829337 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-AttachVolumeNegativeTest-20693983-project Sep 08 10:55:11.829337 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:55:11.829337 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance f182d52b-9650-44f2-bd28-f2ae1daa1438 could not be found. Sep 08 10:55:11.829337 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'f182d52b-9650-44f2-bd28-f2ae1daa1438'} Sep 08 10:55:11.829337 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:55:11.829337 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:11.829337 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:55:11.829337 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:55:11.829337 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:55:11.829337 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:55:11.829337 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:55:11.829337 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:55:11.829337 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:55:11.829337 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:55:11.829337 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f182d52b-9650-44f2-bd28-f2ae1daa1438 could not be found. Sep 08 10:55:11.829337 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:11.829337 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:11.829337 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:11.829337 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:11.829337 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:55:11.829337 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:55:11.829337 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:55:11.829337 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:55:11.829337 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:55:11.829337 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:55:11.829337 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:55:11.829337 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:55:11.829337 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:55:11.829337 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:55:11.829337 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:55:11.829337 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:55:11.829337 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:55:11.829337 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:55:11.834936 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f182d52b-9650-44f2-bd28-f2ae1daa1438 could not be found. Sep 08 10:55:11.834936 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:11.834936 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:11.834936 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:11.834936 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:11.834936 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:55:11.834936 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:55:11.834936 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:55:11.834936 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:55:11.834936 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f182d52b-9650-44f2-bd28-f2ae1daa1438 could not be found. Sep 08 10:55:11.834936 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:11.843008 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-51ce2c18-da40-4111-8b87-907b14db4b53 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Returning 404 to user: Instance f182d52b-9650-44f2-bd28-f2ae1daa1438 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:55:11.844296 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-51ce2c18-da40-4111-8b87-907b14db4b53 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f182d52b-9650-44f2-bd28-f2ae1daa1438" status: 404 len: 111 microversion: 2.1 time: 0.094379 Sep 08 10:55:11.845974 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1900/3826] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:55:11 2022] DELETE /compute/v2.1/servers/f182d52b-9650-44f2-bd28-f2ae1daa1438 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:55:11.851727 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6e770707-7311-4bce-92be-f23e6de1f5e3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:55:11.860903 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6e770707-7311-4bce-92be-f23e6de1f5e3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:11.877898 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6e770707-7311-4bce-92be-f23e6de1f5e3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:11.878797 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6e770707-7311-4bce-92be-f23e6de1f5e3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:11.879471 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6e770707-7311-4bce-92be-f23e6de1f5e3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:11.880533 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6e770707-7311-4bce-92be-f23e6de1f5e3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:11.883468 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6e770707-7311-4bce-92be-f23e6de1f5e3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:11.884179 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6e770707-7311-4bce-92be-f23e6de1f5e3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:12.007683 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6e770707-7311-4bce-92be-f23e6de1f5e3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "POST /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7/action" status: 200 len: 323 microversion: 2.1 time: 0.159668 Sep 08 10:55:12.013348 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1901/3827] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:55:11 2022] POST /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7/action => generated 323 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:55:12.026011 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d78ec418-c321-4125-aef0-fcd484977083 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:55:12.037719 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d78ec418-c321-4125-aef0-fcd484977083 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: a78d6e53-cc72-4cbd-95f5-e1f859062525] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:12.062313 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d78ec418-c321-4125-aef0-fcd484977083 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:12.067402 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d78ec418-c321-4125-aef0-fcd484977083 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:12.071220 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d78ec418-c321-4125-aef0-fcd484977083 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:12.072816 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d78ec418-c321-4125-aef0-fcd484977083 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:12.075718 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d78ec418-c321-4125-aef0-fcd484977083 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:12.079037 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d78ec418-c321-4125-aef0-fcd484977083 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:12.116015 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-d78ec418-c321-4125-aef0-fcd484977083 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] HTTP exception thrown: Instance a78d6e53-cc72-4cbd-95f5-e1f859062525 could not be found. Sep 08 10:55:12.118093 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d78ec418-c321-4125-aef0-fcd484977083 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Request method failure captured: Sep 08 10:55:12.118093 n-d-850501-12 devstack@n-api.service[128862]: request: POST /compute/v2.1/servers/a78d6e53-cc72-4cbd-95f5-e1f859062525/action HTTP/1.1 Sep 08 10:55:12.118093 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:55:12.118093 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:55:12.118093 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:55:12.118093 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 28 Sep 08 10:55:12.118093 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:55:12.118093 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:55:12.118093 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:55:12.118093 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:55:12.118093 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcmnspi0cCT_Ts_s7jcB6HjtEcdULbQPd_krJniB9lBsXpm1cXSOD-YMaJoaapHCxuCXz0q6Qe4WXufr5At6SSPw8ov8Oz1eUk-fSNbVp7WlOPycfCf5I6xwH7tfbsoefVfbTiDOfU9mTBl0Vs74qdfTniErHfQlEG4cAvAQl1-wMrs Sep 08 10:55:12.118093 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:55:12.118093 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:55:12.118093 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:55:12.118093 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:55:12.118093 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:55:12.118093 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:55:12.118093 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:55:12.118093 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:55:12.118093 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:55:12.118093 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:55:12.118093 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:55:12.118093 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:55:12.118093 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:55:12.118093 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:55:12.118093 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:55:12.118093 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:55:12.118093 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:55:12.118093 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 7f551e6fe34243c290a25b57ab26af19 Sep 08 10:55:12.118093 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:55:12.118093 n-d-850501-12 devstack@n-api.service[128862]: Sep 08 10:55:12.118093 n-d-850501-12 devstack@n-api.service[128862]: {"reboot": {"type": "SOFT"}} Sep 08 10:55:12.118093 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:55:12.118093 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance a78d6e53-cc72-4cbd-95f5-e1f859062525 could not be found. Sep 08 10:55:12.118093 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'a78d6e53-cc72-4cbd-95f5-e1f859062525', 'body': {'reboot': {'type': 'SOFT'}}} Sep 08 10:55:12.118093 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:55:12.118093 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:12.118093 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:55:12.118093 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:55:12.118093 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:55:12.118093 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:55:12.118093 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:55:12.118093 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:55:12.118093 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:55:12.118093 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:55:12.118093 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a78d6e53-cc72-4cbd-95f5-e1f859062525 could not be found. Sep 08 10:55:12.118093 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:12.118093 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:12.118093 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:12.118093 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:12.118093 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:55:12.118093 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:55:12.118093 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:55:12.118093 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:55:12.118093 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:55:12.118093 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:55:12.118093 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:55:12.118093 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:55:12.118093 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Sep 08 10:55:12.118093 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 08 10:55:12.118093 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:55:12.118093 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:55:12.118093 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:55:12.118093 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:55:12.123537 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a78d6e53-cc72-4cbd-95f5-e1f859062525 could not be found. Sep 08 10:55:12.123537 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:12.123537 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:12.123537 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:12.123537 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:12.123537 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:55:12.123537 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:55:12.123537 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:55:12.123537 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:55:12.123537 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a78d6e53-cc72-4cbd-95f5-e1f859062525 could not be found. Sep 08 10:55:12.123537 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:12.125651 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d78ec418-c321-4125-aef0-fcd484977083 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Returning 404 to user: Instance a78d6e53-cc72-4cbd-95f5-e1f859062525 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:55:12.127344 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d78ec418-c321-4125-aef0-fcd484977083 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "POST /compute/v2.1/servers/a78d6e53-cc72-4cbd-95f5-e1f859062525/action" status: 404 len: 111 microversion: 2.1 time: 0.112116 Sep 08 10:55:12.128464 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1902/3828] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:55:12 2022] POST /compute/v2.1/servers/a78d6e53-cc72-4cbd-95f5-e1f859062525/action => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:55:12.133677 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bf8e663d-063c-468f-89b4-552250968e06 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:12.134578 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bf8e663d-063c-468f-89b4-552250968e06 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: f182d52b-9650-44f2-bd28-f2ae1daa1438] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:12.142514 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf8e663d-063c-468f-89b4-552250968e06 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:12.143491 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf8e663d-063c-468f-89b4-552250968e06 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:12.144682 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf8e663d-063c-468f-89b4-552250968e06 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:12.146030 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf8e663d-063c-468f-89b4-552250968e06 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:12.146771 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf8e663d-063c-468f-89b4-552250968e06 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:12.147388 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf8e663d-063c-468f-89b4-552250968e06 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:12.194846 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a1a556b9-9019-489d-b1b2-8fea5a6e3b08 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "POST /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.525828 Sep 08 10:55:12.196532 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-bf8e663d-063c-468f-89b4-552250968e06 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] HTTP exception thrown: Instance f182d52b-9650-44f2-bd28-f2ae1daa1438 could not be found. Sep 08 10:55:12.198436 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bf8e663d-063c-468f-89b4-552250968e06 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Request method failure captured: Sep 08 10:55:12.198436 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/f182d52b-9650-44f2-bd28-f2ae1daa1438 HTTP/1.1 Sep 08 10:55:12.198436 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:55:12.198436 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:55:12.198436 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:55:12.198436 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:55:12.198436 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:55:12.198436 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:55:12.198436 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:55:12.198436 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:55:12.198436 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcf85nxlXglNpNUDafAex8bEd4FqCO21NTPeXDX2uUnTAK4RtQmB0Zln5OyfaDsL03XE7NxjFWJINQM-4CVmZPvJMmjswkfAMS-LTodBU21IQa_AJm8NdfZKIu9JkoC4h7calajGQneT5j1jgUkjySqAUeFvWcq2xoj6sNreqExg8K8 Sep 08 10:55:12.198436 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:55:12.198436 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:55:12.198436 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:55:12.198436 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:55:12.198436 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:55:12.198436 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:55:12.198436 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 20f9a24cad014d7f827e8f3236dd5bae Sep 08 10:55:12.198436 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-AttachVolumeNegativeTest-20693983 Sep 08 10:55:12.198436 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:55:12.198436 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:55:12.198436 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/20f9a24cad014d7f827e8f3236dd5bae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/20f9a24cad014d7f827e8f3236dd5bae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_20f9a24cad014d7f827e8f3236dd5bae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/20f9a24cad014d7f827e8f3236dd5bae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:55:12.198436 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-AttachVolumeNegativeTest-20693983 Sep 08 10:55:12.198436 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 20f9a24cad014d7f827e8f3236dd5bae Sep 08 10:55:12.198436 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-20693983 Sep 08 10:55:12.198436 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-AttachVolumeNegativeTest-20693983-project Sep 08 10:55:12.198436 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:55:12.198436 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:55:12.198436 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 5c291cbe955b4ee5abc98132dda0255e Sep 08 10:55:12.198436 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-AttachVolumeNegativeTest-20693983-project Sep 08 10:55:12.198436 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:55:12.198436 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance f182d52b-9650-44f2-bd28-f2ae1daa1438 could not be found. Sep 08 10:55:12.198436 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'f182d52b-9650-44f2-bd28-f2ae1daa1438'} Sep 08 10:55:12.198436 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:55:12.198436 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:12.198436 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:55:12.198436 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:55:12.198436 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:55:12.198436 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:55:12.198436 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:55:12.198436 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:55:12.198436 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:55:12.198436 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:55:12.198436 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f182d52b-9650-44f2-bd28-f2ae1daa1438 could not be found. Sep 08 10:55:12.198436 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:12.198436 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:12.198436 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:12.198436 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:12.198436 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:55:12.198436 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:55:12.198436 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:55:12.198436 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:55:12.198436 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:55:12.198436 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:55:12.198436 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:55:12.198436 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:55:12.198436 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:55:12.198436 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:55:12.198436 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:55:12.198436 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:55:12.198436 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f182d52b-9650-44f2-bd28-f2ae1daa1438 could not be found. Sep 08 10:55:12.198436 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:12.198436 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:12.198436 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:12.203902 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:12.203902 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:55:12.203902 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:55:12.203902 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:55:12.203902 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:55:12.203902 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f182d52b-9650-44f2-bd28-f2ae1daa1438 could not be found. Sep 08 10:55:12.203902 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:12.206873 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bf8e663d-063c-468f-89b4-552250968e06 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Returning 404 to user: Instance f182d52b-9650-44f2-bd28-f2ae1daa1438 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:55:12.207343 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1927/3829] 10.222.0.27 () {60 vars in 1323 bytes} [Thu Sep 8 10:55:11 2022] POST /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3/os-volume_attachments => generated 194 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:55:12.210319 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bf8e663d-063c-468f-89b4-552250968e06 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/f182d52b-9650-44f2-bd28-f2ae1daa1438" status: 404 len: 111 microversion: 2.1 time: 0.080588 Sep 08 10:55:12.218407 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1903/3830] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:12 2022] GET /compute/v2.1/servers/f182d52b-9650-44f2-bd28-f2ae1daa1438 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:55:12.227374 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-adfe5a10-a3d8-48a3-a008-689b7a6cec71 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:12.228674 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-adfe5a10-a3d8-48a3-a008-689b7a6cec71 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] [instance: b7e97718-dc14-4e93-b7b3-49a8d8e03bb9] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:12.233497 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-676c8cbc-e7b4-4160-9d6c-8a31195ea6aa tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:12.235203 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-676c8cbc-e7b4-4160-9d6c-8a31195ea6aa tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:12.260564 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-676c8cbc-e7b4-4160-9d6c-8a31195ea6aa tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:12.262358 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-adfe5a10-a3d8-48a3-a008-689b7a6cec71 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:12.263126 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-adfe5a10-a3d8-48a3-a008-689b7a6cec71 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:12.263938 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-adfe5a10-a3d8-48a3-a008-689b7a6cec71 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:12.265161 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-adfe5a10-a3d8-48a3-a008-689b7a6cec71 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:12.266032 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-676c8cbc-e7b4-4160-9d6c-8a31195ea6aa tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:12.266726 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-adfe5a10-a3d8-48a3-a008-689b7a6cec71 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:12.267667 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-676c8cbc-e7b4-4160-9d6c-8a31195ea6aa tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:12.268612 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-adfe5a10-a3d8-48a3-a008-689b7a6cec71 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:12.272278 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-676c8cbc-e7b4-4160-9d6c-8a31195ea6aa tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:12.275140 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-676c8cbc-e7b4-4160-9d6c-8a31195ea6aa tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:12.286517 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-676c8cbc-e7b4-4160-9d6c-8a31195ea6aa tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:12.697795 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-676c8cbc-e7b4-4160-9d6c-8a31195ea6aa tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:12.741348 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-676c8cbc-e7b4-4160-9d6c-8a31195ea6aa tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1671 microversion: 2.1 time: 0.516597 Sep 08 10:55:12.742064 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1904/3831] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:12 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1671 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:12.774281 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e753b3b9-b204-48e6-8840-44770c37379a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:12.776172 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e753b3b9-b204-48e6-8840-44770c37379a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:12.794505 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e753b3b9-b204-48e6-8840-44770c37379a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:12.795018 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e753b3b9-b204-48e6-8840-44770c37379a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:12.803806 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e753b3b9-b204-48e6-8840-44770c37379a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:12.804608 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e753b3b9-b204-48e6-8840-44770c37379a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:12.805121 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e753b3b9-b204-48e6-8840-44770c37379a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:12.814674 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e753b3b9-b204-48e6-8840-44770c37379a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:13.332204 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e753b3b9-b204-48e6-8840-44770c37379a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:13.346694 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e753b3b9-b204-48e6-8840-44770c37379a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 0.603692 Sep 08 10:55:13.353248 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1905/3832] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:12 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:13.359613 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-b34a2b12-84b6-4fb2-a20b-48e62747196e req-d982a63c-b0cb-4b73-a582-4d56e1a362b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7e97718-dc14-4e93-b7b3-49a8d8e03bb9", "name": "network-vif-plugged", "status": "completed", "tag": "e2153ee7-b11d-41b7-b5fb-82f06d8cb9d0"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:55:13.404159 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-adfe5a10-a3d8-48a3-a008-689b7a6cec71 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1bec228c17647bba62ba7d57d28e4ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0958700fa94b42b2b6b47af40cf2f679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:13.421003 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-adfe5a10-a3d8-48a3-a008-689b7a6cec71 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "GET /compute/v2.1/servers/b7e97718-dc14-4e93-b7b3-49a8d8e03bb9" status: 200 len: 1315 microversion: 2.1 time: 1.212149 Sep 08 10:55:13.425456 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b34a2b12-84b6-4fb2-a20b-48e62747196e req-d982a63c-b0cb-4b73-a582-4d56e1a362b0 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:13.425704 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1928/3833] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:12 2022] GET /compute/v2.1/servers/b7e97718-dc14-4e93-b7b3-49a8d8e03bb9 => generated 1315 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:13.430912 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b34a2b12-84b6-4fb2-a20b-48e62747196e req-d982a63c-b0cb-4b73-a582-4d56e1a362b0 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:13.431745 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b34a2b12-84b6-4fb2-a20b-48e62747196e req-d982a63c-b0cb-4b73-a582-4d56e1a362b0 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:13.437600 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1f996c62-edbd-44b7-b3d9-0cbaa99a1a37 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:13.439656 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1f996c62-edbd-44b7-b3d9-0cbaa99a1a37 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: 272b4680-9e7e-41dd-afa5-3116aa92665b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:13.457255 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1f996c62-edbd-44b7-b3d9-0cbaa99a1a37 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:13.458072 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1f996c62-edbd-44b7-b3d9-0cbaa99a1a37 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:13.459063 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1f996c62-edbd-44b7-b3d9-0cbaa99a1a37 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:13.459954 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1f996c62-edbd-44b7-b3d9-0cbaa99a1a37 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:13.465740 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1f996c62-edbd-44b7-b3d9-0cbaa99a1a37 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:13.466588 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1f996c62-edbd-44b7-b3d9-0cbaa99a1a37 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:13.474201 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-b34a2b12-84b6-4fb2-a20b-48e62747196e req-d982a63c-b0cb-4b73-a582-4d56e1a362b0 service nova] Creating event network-vif-plugged:e2153ee7-b11d-41b7-b5fb-82f06d8cb9d0 for instance b7e97718-dc14-4e93-b7b3-49a8d8e03bb9 on n-h1-850501-12 Sep 08 10:55:13.483476 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-b34a2b12-84b6-4fb2-a20b-48e62747196e req-d982a63c-b0cb-4b73-a582-4d56e1a362b0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127535 Sep 08 10:55:13.487233 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1906/3834] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:55:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:55:13.497585 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-542dcf8e-470b-4f14-91a3-31e4f5eac277 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:13.500604 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-542dcf8e-470b-4f14-91a3-31e4f5eac277 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:13.514404 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-542dcf8e-470b-4f14-91a3-31e4f5eac277 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:13.524053 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-542dcf8e-470b-4f14-91a3-31e4f5eac277 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:13.526042 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-542dcf8e-470b-4f14-91a3-31e4f5eac277 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:13.527603 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-542dcf8e-470b-4f14-91a3-31e4f5eac277 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:13.529306 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-542dcf8e-470b-4f14-91a3-31e4f5eac277 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:13.530157 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-542dcf8e-470b-4f14-91a3-31e4f5eac277 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:13.551505 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-1f996c62-edbd-44b7-b3d9-0cbaa99a1a37 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] HTTP exception thrown: Instance 272b4680-9e7e-41dd-afa5-3116aa92665b could not be found. Sep 08 10:55:13.559547 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1f996c62-edbd-44b7-b3d9-0cbaa99a1a37 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Request method failure captured: Sep 08 10:55:13.559547 n-d-850501-12 devstack@n-api.service[128861]: request: DELETE /compute/v2.1/servers/272b4680-9e7e-41dd-afa5-3116aa92665b HTTP/1.1 Sep 08 10:55:13.559547 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:55:13.559547 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:55:13.559547 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:55:13.559547 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:55:13.559547 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:55:13.559547 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:55:13.559547 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:55:13.559547 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:55:13.559547 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcf85nxlXglNpNUDafAex8bEd4FqCO21NTPeXDX2uUnTAK4RtQmB0Zln5OyfaDsL03XE7NxjFWJINQM-4CVmZPvJMmjswkfAMS-LTodBU21IQa_AJm8NdfZKIu9JkoC4h7calajGQneT5j1jgUkjySqAUeFvWcq2xoj6sNreqExg8K8 Sep 08 10:55:13.559547 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:55:13.559547 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:55:13.559547 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:55:13.559547 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:55:13.559547 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:55:13.559547 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:55:13.559547 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 20f9a24cad014d7f827e8f3236dd5bae Sep 08 10:55:13.559547 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-AttachVolumeNegativeTest-20693983 Sep 08 10:55:13.559547 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:55:13.559547 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:55:13.559547 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/20f9a24cad014d7f827e8f3236dd5bae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/20f9a24cad014d7f827e8f3236dd5bae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_20f9a24cad014d7f827e8f3236dd5bae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/20f9a24cad014d7f827e8f3236dd5bae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:55:13.559547 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-AttachVolumeNegativeTest-20693983 Sep 08 10:55:13.559547 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 20f9a24cad014d7f827e8f3236dd5bae Sep 08 10:55:13.559547 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-20693983 Sep 08 10:55:13.559547 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-AttachVolumeNegativeTest-20693983-project Sep 08 10:55:13.559547 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:55:13.559547 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:55:13.559547 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 5c291cbe955b4ee5abc98132dda0255e Sep 08 10:55:13.559547 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-AttachVolumeNegativeTest-20693983-project Sep 08 10:55:13.559547 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:55:13.559547 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 272b4680-9e7e-41dd-afa5-3116aa92665b could not be found. Sep 08 10:55:13.559547 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '272b4680-9e7e-41dd-afa5-3116aa92665b'} Sep 08 10:55:13.559547 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:55:13.559547 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:13.559547 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:55:13.559547 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:55:13.559547 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:55:13.559547 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:55:13.559547 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:55:13.559547 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:55:13.559547 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:55:13.559547 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:55:13.559547 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 272b4680-9e7e-41dd-afa5-3116aa92665b could not be found. Sep 08 10:55:13.559547 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:13.559547 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:13.559547 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:13.559547 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:13.559547 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:55:13.559547 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:55:13.559547 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:55:13.559547 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:55:13.559547 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:55:13.559547 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:55:13.559547 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:55:13.559547 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:55:13.559547 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:55:13.559547 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:55:13.559547 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:55:13.559547 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:55:13.559547 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:55:13.559547 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:55:13.565148 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 272b4680-9e7e-41dd-afa5-3116aa92665b could not be found. Sep 08 10:55:13.565148 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:13.565148 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:13.565148 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:13.565148 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:13.565148 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:55:13.565148 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:55:13.565148 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:55:13.565148 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:55:13.565148 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 272b4680-9e7e-41dd-afa5-3116aa92665b could not be found. Sep 08 10:55:13.565148 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:13.566041 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1f996c62-edbd-44b7-b3d9-0cbaa99a1a37 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Returning 404 to user: Instance 272b4680-9e7e-41dd-afa5-3116aa92665b could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:55:13.567857 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1f996c62-edbd-44b7-b3d9-0cbaa99a1a37 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "DELETE /compute/v2.1/servers/272b4680-9e7e-41dd-afa5-3116aa92665b" status: 404 len: 111 microversion: 2.1 time: 0.140626 Sep 08 10:55:13.577703 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1929/3835] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:55:13 2022] DELETE /compute/v2.1/servers/272b4680-9e7e-41dd-afa5-3116aa92665b => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:55:13.598125 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4e0921d3-edab-4682-b86e-32bed8a32d02 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:13.607896 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4e0921d3-edab-4682-b86e-32bed8a32d02 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:13.622173 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4e0921d3-edab-4682-b86e-32bed8a32d02 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:13.625530 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4e0921d3-edab-4682-b86e-32bed8a32d02 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:13.626256 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4e0921d3-edab-4682-b86e-32bed8a32d02 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:13.629448 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4e0921d3-edab-4682-b86e-32bed8a32d02 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:13.629940 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4e0921d3-edab-4682-b86e-32bed8a32d02 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:13.630382 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4e0921d3-edab-4682-b86e-32bed8a32d02 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:13.978656 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4e0921d3-edab-4682-b86e-32bed8a32d02 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:14.024115 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4e0921d3-edab-4682-b86e-32bed8a32d02 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 0.434690 Sep 08 10:55:14.026748 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1930/3836] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:13 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:14.060390 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ed240b56-aa01-4dae-9e81-e75f319e1b6e tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:14.064726 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ed240b56-aa01-4dae-9e81-e75f319e1b6e tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: 272b4680-9e7e-41dd-afa5-3116aa92665b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:14.073757 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed240b56-aa01-4dae-9e81-e75f319e1b6e tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:14.074265 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed240b56-aa01-4dae-9e81-e75f319e1b6e tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:14.074854 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed240b56-aa01-4dae-9e81-e75f319e1b6e tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:14.075705 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed240b56-aa01-4dae-9e81-e75f319e1b6e tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:14.076435 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed240b56-aa01-4dae-9e81-e75f319e1b6e tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:14.076873 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed240b56-aa01-4dae-9e81-e75f319e1b6e tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:14.093698 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-ed240b56-aa01-4dae-9e81-e75f319e1b6e tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] HTTP exception thrown: Instance 272b4680-9e7e-41dd-afa5-3116aa92665b could not be found. Sep 08 10:55:14.096812 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ed240b56-aa01-4dae-9e81-e75f319e1b6e tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Request method failure captured: Sep 08 10:55:14.096812 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/272b4680-9e7e-41dd-afa5-3116aa92665b HTTP/1.1 Sep 08 10:55:14.096812 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:55:14.096812 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:55:14.096812 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:55:14.096812 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:55:14.096812 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:55:14.096812 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:55:14.096812 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:55:14.096812 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:55:14.096812 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcf85nxlXglNpNUDafAex8bEd4FqCO21NTPeXDX2uUnTAK4RtQmB0Zln5OyfaDsL03XE7NxjFWJINQM-4CVmZPvJMmjswkfAMS-LTodBU21IQa_AJm8NdfZKIu9JkoC4h7calajGQneT5j1jgUkjySqAUeFvWcq2xoj6sNreqExg8K8 Sep 08 10:55:14.096812 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:55:14.096812 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:55:14.096812 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:55:14.096812 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:55:14.096812 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:55:14.096812 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:55:14.096812 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 20f9a24cad014d7f827e8f3236dd5bae Sep 08 10:55:14.096812 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-AttachVolumeNegativeTest-20693983 Sep 08 10:55:14.096812 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:55:14.096812 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:55:14.096812 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/20f9a24cad014d7f827e8f3236dd5bae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/20f9a24cad014d7f827e8f3236dd5bae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_20f9a24cad014d7f827e8f3236dd5bae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/20f9a24cad014d7f827e8f3236dd5bae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:55:14.096812 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-AttachVolumeNegativeTest-20693983 Sep 08 10:55:14.096812 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 20f9a24cad014d7f827e8f3236dd5bae Sep 08 10:55:14.096812 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-20693983 Sep 08 10:55:14.096812 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-AttachVolumeNegativeTest-20693983-project Sep 08 10:55:14.096812 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:55:14.096812 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:55:14.096812 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 5c291cbe955b4ee5abc98132dda0255e Sep 08 10:55:14.096812 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-AttachVolumeNegativeTest-20693983-project Sep 08 10:55:14.096812 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:55:14.096812 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 272b4680-9e7e-41dd-afa5-3116aa92665b could not be found. Sep 08 10:55:14.096812 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '272b4680-9e7e-41dd-afa5-3116aa92665b'} Sep 08 10:55:14.096812 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:55:14.096812 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:14.096812 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:55:14.096812 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:55:14.096812 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:55:14.096812 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:55:14.096812 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:55:14.096812 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:55:14.096812 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:55:14.096812 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:55:14.096812 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 272b4680-9e7e-41dd-afa5-3116aa92665b could not be found. Sep 08 10:55:14.096812 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:14.096812 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:14.096812 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:14.096812 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:14.096812 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:55:14.096812 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:55:14.096812 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:55:14.096812 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:55:14.096812 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:55:14.096812 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:55:14.096812 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:55:14.096812 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:55:14.096812 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:55:14.096812 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:55:14.096812 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:55:14.096812 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:55:14.096812 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 272b4680-9e7e-41dd-afa5-3116aa92665b could not be found. Sep 08 10:55:14.096812 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:14.096812 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:14.096812 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:14.103441 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:14.103441 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:55:14.103441 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:55:14.103441 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:55:14.103441 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:55:14.103441 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 272b4680-9e7e-41dd-afa5-3116aa92665b could not be found. Sep 08 10:55:14.103441 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:14.105269 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ed240b56-aa01-4dae-9e81-e75f319e1b6e tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Returning 404 to user: Instance 272b4680-9e7e-41dd-afa5-3116aa92665b could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:55:14.106721 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ed240b56-aa01-4dae-9e81-e75f319e1b6e tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/272b4680-9e7e-41dd-afa5-3116aa92665b" status: 404 len: 111 microversion: 2.1 time: 0.059209 Sep 08 10:55:14.111797 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1931/3837] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:14 2022] GET /compute/v2.1/servers/272b4680-9e7e-41dd-afa5-3116aa92665b => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:55:14.118032 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b69039d9-d921-4f4f-92b0-473bb4936ffc tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:55:14.120407 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b69039d9-d921-4f4f-92b0-473bb4936ffc tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 230cb47c-5278-41d7-a434-c9b140853196] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:14.128858 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-b69039d9-d921-4f4f-92b0-473bb4936ffc tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] HTTP exception thrown: Instance 230cb47c-5278-41d7-a434-c9b140853196 could not be found. Sep 08 10:55:14.130873 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b69039d9-d921-4f4f-92b0-473bb4936ffc tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Request method failure captured: Sep 08 10:55:14.130873 n-d-850501-12 devstack@n-api.service[128861]: request: POST /compute/v2.1/servers/230cb47c-5278-41d7-a434-c9b140853196/action HTTP/1.1 Sep 08 10:55:14.130873 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:55:14.130873 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:55:14.130873 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:55:14.130873 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 28 Sep 08 10:55:14.130873 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:55:14.130873 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:55:14.130873 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:55:14.130873 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:55:14.130873 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcmnspi0cCT_Ts_s7jcB6HjtEcdULbQPd_krJniB9lBsXpm1cXSOD-YMaJoaapHCxuCXz0q6Qe4WXufr5At6SSPw8ov8Oz1eUk-fSNbVp7WlOPycfCf5I6xwH7tfbsoefVfbTiDOfU9mTBl0Vs74qdfTniErHfQlEG4cAvAQl1-wMrs Sep 08 10:55:14.130873 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:55:14.130873 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:55:14.130873 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:55:14.130873 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:55:14.130873 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:55:14.130873 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:55:14.130873 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:55:14.130873 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:55:14.130873 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:55:14.130873 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:55:14.130873 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:55:14.130873 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:55:14.130873 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:55:14.130873 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:55:14.130873 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:55:14.130873 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:55:14.130873 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:55:14.130873 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 7f551e6fe34243c290a25b57ab26af19 Sep 08 10:55:14.130873 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:55:14.130873 n-d-850501-12 devstack@n-api.service[128861]: Sep 08 10:55:14.130873 n-d-850501-12 devstack@n-api.service[128861]: {"reboot": {"type": "SOFT"}} Sep 08 10:55:14.130873 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:55:14.130873 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 230cb47c-5278-41d7-a434-c9b140853196 could not be found. Sep 08 10:55:14.130873 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '230cb47c-5278-41d7-a434-c9b140853196', 'body': {'reboot': {'type': 'SOFT'}}} Sep 08 10:55:14.130873 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:55:14.130873 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:14.130873 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:55:14.130873 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:55:14.130873 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:55:14.130873 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:55:14.130873 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 08 10:55:14.130873 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 08 10:55:14.130873 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 230cb47c-5278-41d7-a434-c9b140853196 could not be found. Sep 08 10:55:14.130873 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:14.130873 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:14.130873 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:14.130873 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:14.130873 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:55:14.130873 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:55:14.130873 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:55:14.130873 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:55:14.130873 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:55:14.130873 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:55:14.130873 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:55:14.130873 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:55:14.130873 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Sep 08 10:55:14.130873 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 08 10:55:14.130873 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:55:14.130873 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:55:14.130873 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:55:14.130873 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:55:14.130873 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 230cb47c-5278-41d7-a434-c9b140853196 could not be found. Sep 08 10:55:14.130873 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:14.135749 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:14.135749 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:14.135749 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:14.135749 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:55:14.135749 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:55:14.135749 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:55:14.135749 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:55:14.135749 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 230cb47c-5278-41d7-a434-c9b140853196 could not be found. Sep 08 10:55:14.135749 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:14.139399 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b69039d9-d921-4f4f-92b0-473bb4936ffc tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Returning 404 to user: Instance 230cb47c-5278-41d7-a434-c9b140853196 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:55:14.141317 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b69039d9-d921-4f4f-92b0-473bb4936ffc tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "POST /compute/v2.1/servers/230cb47c-5278-41d7-a434-c9b140853196/action" status: 404 len: 111 microversion: 2.1 time: 0.027257 Sep 08 10:55:14.147219 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1932/3838] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:55:14 2022] POST /compute/v2.1/servers/230cb47c-5278-41d7-a434-c9b140853196/action => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:55:14.157345 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-01947dd2-de1e-4e6b-a7d1-2df0d8c5c216 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:14.159152 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-01947dd2-de1e-4e6b-a7d1-2df0d8c5c216 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:14.169242 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-01947dd2-de1e-4e6b-a7d1-2df0d8c5c216 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:14.170146 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-01947dd2-de1e-4e6b-a7d1-2df0d8c5c216 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:14.170828 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-01947dd2-de1e-4e6b-a7d1-2df0d8c5c216 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:14.171808 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-01947dd2-de1e-4e6b-a7d1-2df0d8c5c216 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:14.172529 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-01947dd2-de1e-4e6b-a7d1-2df0d8c5c216 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:14.173263 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-01947dd2-de1e-4e6b-a7d1-2df0d8c5c216 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:14.225542 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-542dcf8e-470b-4f14-91a3-31e4f5eac277 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:14.239564 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-542dcf8e-470b-4f14-91a3-31e4f5eac277 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1671 microversion: 2.1 time: 0.749409 Sep 08 10:55:14.263982 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1907/3839] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:13 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1671 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:14.269617 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d033f803-21fc-48fa-a0de-5e0ff212b6c0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:14.270238 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d033f803-21fc-48fa-a0de-5e0ff212b6c0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:14.293326 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d033f803-21fc-48fa-a0de-5e0ff212b6c0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:14.293839 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d033f803-21fc-48fa-a0de-5e0ff212b6c0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:14.296541 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d033f803-21fc-48fa-a0de-5e0ff212b6c0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:14.297528 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d033f803-21fc-48fa-a0de-5e0ff212b6c0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:14.321518 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d033f803-21fc-48fa-a0de-5e0ff212b6c0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:14.321518 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d033f803-21fc-48fa-a0de-5e0ff212b6c0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:14.699687 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d033f803-21fc-48fa-a0de-5e0ff212b6c0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:14.717703 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:55:14.755806 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-01947dd2-de1e-4e6b-a7d1-2df0d8c5c216 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:14.766093 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-01947dd2-de1e-4e6b-a7d1-2df0d8c5c216 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 0.617341 Sep 08 10:55:14.795360 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1933/3840] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:14 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:14.798802 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d033f803-21fc-48fa-a0de-5e0ff212b6c0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1671 microversion: 2.1 time: 0.533046 Sep 08 10:55:14.799867 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1908/3841] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:14 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1671 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:14.821464 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1fb83d4e-e99e-40a0-b038-36431ec69af1 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:14.825263 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1fb83d4e-e99e-40a0-b038-36431ec69af1 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:14.838457 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-35865ebb-8da0-4eef-bb9f-a7ed775d1985 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:14.842372 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-35865ebb-8da0-4eef-bb9f-a7ed775d1985 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] [instance: b7e97718-dc14-4e93-b7b3-49a8d8e03bb9] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:14.863420 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1fb83d4e-e99e-40a0-b038-36431ec69af1 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:14.863925 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1fb83d4e-e99e-40a0-b038-36431ec69af1 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:14.864371 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1fb83d4e-e99e-40a0-b038-36431ec69af1 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:14.871353 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1fb83d4e-e99e-40a0-b038-36431ec69af1 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:14.872009 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1fb83d4e-e99e-40a0-b038-36431ec69af1 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:14.872583 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1fb83d4e-e99e-40a0-b038-36431ec69af1 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:14.872724 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-35865ebb-8da0-4eef-bb9f-a7ed775d1985 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:14.873422 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-35865ebb-8da0-4eef-bb9f-a7ed775d1985 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:14.878183 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-35865ebb-8da0-4eef-bb9f-a7ed775d1985 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:14.879412 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-35865ebb-8da0-4eef-bb9f-a7ed775d1985 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:14.880215 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-35865ebb-8da0-4eef-bb9f-a7ed775d1985 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:14.880979 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-35865ebb-8da0-4eef-bb9f-a7ed775d1985 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:14.884989 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:55:15.744904 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-35865ebb-8da0-4eef-bb9f-a7ed775d1985 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1bec228c17647bba62ba7d57d28e4ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0958700fa94b42b2b6b47af40cf2f679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:15.783720 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-35865ebb-8da0-4eef-bb9f-a7ed775d1985 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "GET /compute/v2.1/servers/b7e97718-dc14-4e93-b7b3-49a8d8e03bb9" status: 200 len: 1315 microversion: 2.1 time: 0.986922 Sep 08 10:55:15.784513 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1934/3842] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:14 2022] GET /compute/v2.1/servers/b7e97718-dc14-4e93-b7b3-49a8d8e03bb9 => generated 1315 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:15.789864 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f6759c5c-579b-4f6d-ba4d-a5723c9080fa tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:15.790573 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f6759c5c-579b-4f6d-ba4d-a5723c9080fa tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:15.818339 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f6759c5c-579b-4f6d-ba4d-a5723c9080fa tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:15.818849 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f6759c5c-579b-4f6d-ba4d-a5723c9080fa tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:15.819302 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f6759c5c-579b-4f6d-ba4d-a5723c9080fa tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:15.820033 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f6759c5c-579b-4f6d-ba4d-a5723c9080fa tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:15.820501 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f6759c5c-579b-4f6d-ba4d-a5723c9080fa tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:15.820931 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f6759c5c-579b-4f6d-ba4d-a5723c9080fa tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:16.267921 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f6759c5c-579b-4f6d-ba4d-a5723c9080fa tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:16.280025 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f6759c5c-579b-4f6d-ba4d-a5723c9080fa tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1671 microversion: 2.1 time: 0.494275 Sep 08 10:55:16.280614 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1935/3843] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:15 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1671 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:16.425730 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1fb83d4e-e99e-40a0-b038-36431ec69af1 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:16.459604 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1fb83d4e-e99e-40a0-b038-36431ec69af1 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 1.652271 Sep 08 10:55:16.482468 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1909/3844] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:14 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 1676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:16.508601 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-89b1c8d5-f914-4ea2-9878-fe93bee39e68 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:55:16.512879 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-89b1c8d5-f914-4ea2-9878-fe93bee39e68 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: a78d6e53-cc72-4cbd-95f5-e1f859062525] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:16.532915 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-89b1c8d5-f914-4ea2-9878-fe93bee39e68 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:16.533849 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-89b1c8d5-f914-4ea2-9878-fe93bee39e68 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:16.534375 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-89b1c8d5-f914-4ea2-9878-fe93bee39e68 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:16.535136 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-89b1c8d5-f914-4ea2-9878-fe93bee39e68 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:16.535632 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-89b1c8d5-f914-4ea2-9878-fe93bee39e68 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:16.536087 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-89b1c8d5-f914-4ea2-9878-fe93bee39e68 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:16.577184 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-89b1c8d5-f914-4ea2-9878-fe93bee39e68 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] HTTP exception thrown: Instance a78d6e53-cc72-4cbd-95f5-e1f859062525 could not be found. Sep 08 10:55:16.582990 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-89b1c8d5-f914-4ea2-9878-fe93bee39e68 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Request method failure captured: Sep 08 10:55:16.582990 n-d-850501-12 devstack@n-api.service[128861]: request: POST /compute/v2.1/servers/a78d6e53-cc72-4cbd-95f5-e1f859062525/action HTTP/1.1 Sep 08 10:55:16.582990 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:55:16.582990 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:55:16.582990 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:55:16.582990 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 65 Sep 08 10:55:16.582990 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:55:16.582990 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:55:16.582990 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:55:16.582990 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:55:16.582990 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcmnspi0cCT_Ts_s7jcB6HjtEcdULbQPd_krJniB9lBsXpm1cXSOD-YMaJoaapHCxuCXz0q6Qe4WXufr5At6SSPw8ov8Oz1eUk-fSNbVp7WlOPycfCf5I6xwH7tfbsoefVfbTiDOfU9mTBl0Vs74qdfTniErHfQlEG4cAvAQl1-wMrs Sep 08 10:55:16.582990 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:55:16.582990 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:55:16.582990 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:55:16.582990 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:55:16.582990 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:55:16.582990 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:55:16.582990 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:55:16.582990 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:55:16.582990 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:55:16.582990 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:55:16.582990 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:55:16.582990 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:55:16.582990 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:55:16.582990 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:55:16.582990 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:55:16.582990 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:55:16.582990 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:55:16.582990 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 7f551e6fe34243c290a25b57ab26af19 Sep 08 10:55:16.582990 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:55:16.582990 n-d-850501-12 devstack@n-api.service[128861]: Sep 08 10:55:16.582990 n-d-850501-12 devstack@n-api.service[128861]: {"rebuild": {"imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117"}} Sep 08 10:55:16.582990 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:55:16.582990 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance a78d6e53-cc72-4cbd-95f5-e1f859062525 could not be found. Sep 08 10:55:16.582990 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': 'a78d6e53-cc72-4cbd-95f5-e1f859062525', 'body': {'rebuild': {'imageRef': '503f4a0f-e18f-47fd-ad12-0289e3463117'}}} Sep 08 10:55:16.582990 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:55:16.582990 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:16.582990 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:55:16.582990 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:55:16.582990 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:55:16.582990 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:55:16.582990 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:55:16.582990 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:55:16.582990 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:55:16.582990 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:55:16.582990 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a78d6e53-cc72-4cbd-95f5-e1f859062525 could not be found. Sep 08 10:55:16.582990 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:16.582990 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:16.582990 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:16.582990 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:16.582990 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:55:16.582990 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:55:16.582990 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:55:16.582990 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:55:16.582990 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:55:16.582990 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:55:16.582990 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:55:16.582990 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:55:16.582990 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:55:16.582990 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:55:16.582990 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:55:16.582990 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:55:16.582990 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Sep 08 10:55:16.582990 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Sep 08 10:55:16.589493 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 08 10:55:16.589493 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:55:16.589493 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:55:16.589493 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:55:16.589493 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:55:16.589493 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a78d6e53-cc72-4cbd-95f5-e1f859062525 could not be found. Sep 08 10:55:16.589493 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:16.589493 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:16.589493 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:16.589493 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:16.589493 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:55:16.589493 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:55:16.589493 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:55:16.589493 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:55:16.589493 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a78d6e53-cc72-4cbd-95f5-e1f859062525 could not be found. Sep 08 10:55:16.589493 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:16.594260 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-89b1c8d5-f914-4ea2-9878-fe93bee39e68 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Returning 404 to user: Instance a78d6e53-cc72-4cbd-95f5-e1f859062525 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:55:16.598137 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-89b1c8d5-f914-4ea2-9878-fe93bee39e68 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "POST /compute/v2.1/servers/a78d6e53-cc72-4cbd-95f5-e1f859062525/action" status: 404 len: 111 microversion: 2.1 time: 0.094583 Sep 08 10:55:16.605796 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1936/3845] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:55:16 2022] POST /compute/v2.1/servers/a78d6e53-cc72-4cbd-95f5-e1f859062525/action => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 10:55:16.614168 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cbcd1cb4-7c79-47d7-8e8a-363c69463adb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:16.615283 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cbcd1cb4-7c79-47d7-8e8a-363c69463adb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:16.627972 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cbcd1cb4-7c79-47d7-8e8a-363c69463adb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:16.631509 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cbcd1cb4-7c79-47d7-8e8a-363c69463adb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:16.632414 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cbcd1cb4-7c79-47d7-8e8a-363c69463adb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:16.633777 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cbcd1cb4-7c79-47d7-8e8a-363c69463adb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:16.634698 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cbcd1cb4-7c79-47d7-8e8a-363c69463adb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:16.635618 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cbcd1cb4-7c79-47d7-8e8a-363c69463adb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:16.691293 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8f442880-5270-4b4a-90ee-24383b7f8f0b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-344822915", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "b9022ed4-d5a1-4655-b50c-e8de49533ecf"}]}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:55:16.778936 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:55:16.873339 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-8f442880-5270-4b4a-90ee-24383b7f8f0b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] validate_networks() for [('b9022ed4-d5a1-4655-b50c-e8de49533ecf', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:55:17.391364 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cbcd1cb4-7c79-47d7-8e8a-363c69463adb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:17.407377 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cbcd1cb4-7c79-47d7-8e8a-363c69463adb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 0.799426 Sep 08 10:55:17.408352 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1910/3846] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:16 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:17.417144 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8120abe2-eac4-4cf7-ad5d-f9afa97a9e86 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:17.418257 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8120abe2-eac4-4cf7-ad5d-f9afa97a9e86 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] [instance: b7e97718-dc14-4e93-b7b3-49a8d8e03bb9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:17.436721 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8120abe2-eac4-4cf7-ad5d-f9afa97a9e86 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:17.439279 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8120abe2-eac4-4cf7-ad5d-f9afa97a9e86 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:17.440096 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8120abe2-eac4-4cf7-ad5d-f9afa97a9e86 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:17.441275 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8120abe2-eac4-4cf7-ad5d-f9afa97a9e86 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:17.441970 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8120abe2-eac4-4cf7-ad5d-f9afa97a9e86 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:17.442792 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8120abe2-eac4-4cf7-ad5d-f9afa97a9e86 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:17.851541 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-8f442880-5270-4b4a-90ee-24383b7f8f0b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:55:17.851724 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-8f442880-5270-4b4a-90ee-24383b7f8f0b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:55:17.852223 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-8f442880-5270-4b4a-90ee-24383b7f8f0b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:55:17.852644 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-8f442880-5270-4b4a-90ee-24383b7f8f0b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:55:17.853108 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-8f442880-5270-4b4a-90ee-24383b7f8f0b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:55:17.872870 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f442880-5270-4b4a-90ee-24383b7f8f0b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:17.873561 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f442880-5270-4b4a-90ee-24383b7f8f0b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:17.874164 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f442880-5270-4b4a-90ee-24383b7f8f0b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:17.874756 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f442880-5270-4b4a-90ee-24383b7f8f0b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:17.875219 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f442880-5270-4b4a-90ee-24383b7f8f0b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:17.875654 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f442880-5270-4b4a-90ee-24383b7f8f0b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:17.933080 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-8f442880-5270-4b4a-90ee-24383b7f8f0b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Getting quotas for project 11b5d4706b2d43aca8290ccf07ee1ece. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:55:17.939752 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-8f442880-5270-4b4a-90ee-24383b7f8f0b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Getting quotas for user d68b017335c84d15becbdc7615498103 and project 11b5d4706b2d43aca8290ccf07ee1ece. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:55:17.956426 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8f442880-5270-4b4a-90ee-24383b7f8f0b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:55:17.962363 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8120abe2-eac4-4cf7-ad5d-f9afa97a9e86 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1bec228c17647bba62ba7d57d28e4ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0958700fa94b42b2b6b47af40cf2f679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:17.964872 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8f442880-5270-4b4a-90ee-24383b7f8f0b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 379a5e3e-0e59-4b53-a37e-f4e9d1000eaf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:55:17.972795 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8120abe2-eac4-4cf7-ad5d-f9afa97a9e86 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "GET /compute/v2.1/servers/b7e97718-dc14-4e93-b7b3-49a8d8e03bb9" status: 200 len: 1504 microversion: 2.1 time: 0.562237 Sep 08 10:55:17.978678 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1911/3847] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:17 2022] GET /compute/v2.1/servers/b7e97718-dc14-4e93-b7b3-49a8d8e03bb9 => generated 1504 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:18.144852 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8f442880-5270-4b4a-90ee-24383b7f8f0b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.459204 Sep 08 10:55:18.154478 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1937/3848] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:55:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1469 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 10:55:18.159892 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7ba0f9d2-2207-476f-8a28-454c6a075d6e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:18.163580 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7ba0f9d2-2207-476f-8a28-454c6a075d6e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:18.179137 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7ba0f9d2-2207-476f-8a28-454c6a075d6e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:18.180703 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7ba0f9d2-2207-476f-8a28-454c6a075d6e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:18.181566 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7ba0f9d2-2207-476f-8a28-454c6a075d6e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:18.183750 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7ba0f9d2-2207-476f-8a28-454c6a075d6e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:18.186137 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7ba0f9d2-2207-476f-8a28-454c6a075d6e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:18.186963 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7ba0f9d2-2207-476f-8a28-454c6a075d6e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:18.323491 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c00cc7ad-4c8f-411a-94cf-dc8a5b060a07 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-2032631933", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "c2101641-f8a1-4f1d-9b98-0f70415ebcad"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:55:18.459056 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-c00cc7ad-4c8f-411a-94cf-dc8a5b060a07 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] validate_networks() for [('c2101641-f8a1-4f1d-9b98-0f70415ebcad', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:55:18.537296 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7ba0f9d2-2207-476f-8a28-454c6a075d6e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:18.550361 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7ba0f9d2-2207-476f-8a28-454c6a075d6e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 0.389218 Sep 08 10:55:18.561480 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1938/3849] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:18 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:18.565959 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3ef4e978-ba68-4df6-9f96-c5f7f90b247c tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2006590114"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:55:18.568183 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3ef4e978-ba68-4df6-9f96-c5f7f90b247c tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] [instance: b7e97718-dc14-4e93-b7b3-49a8d8e03bb9] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:18.585211 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3ef4e978-ba68-4df6-9f96-c5f7f90b247c tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:18.587266 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3ef4e978-ba68-4df6-9f96-c5f7f90b247c tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:18.587924 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3ef4e978-ba68-4df6-9f96-c5f7f90b247c tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:18.588839 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3ef4e978-ba68-4df6-9f96-c5f7f90b247c tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:18.589498 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3ef4e978-ba68-4df6-9f96-c5f7f90b247c tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:18.590097 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3ef4e978-ba68-4df6-9f96-c5f7f90b247c tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:18.818356 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.network.security_group_api [None req-3ef4e978-ba68-4df6-9f96-c5f7f90b247c tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Adding security group 9abcfaa8-eed1-428d-a9ef-d3953e75ba6d to port e2153ee7-b11d-41b7-b5fb-82f06d8cb9d0 Sep 08 10:55:19.832925 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3ef4e978-ba68-4df6-9f96-c5f7f90b247c tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "POST /compute/v2.1/servers/b7e97718-dc14-4e93-b7b3-49a8d8e03bb9/action" status: 202 len: 0 microversion: 2.1 time: 1.278872 Sep 08 10:55:19.833569 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1939/3850] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:55:18 2022] POST /compute/v2.1/servers/b7e97718-dc14-4e93-b7b3-49a8d8e03bb9/action => generated 0 bytes in 1281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:55:19.838785 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4f90658c-424b-4570-ab53-52c44fb2a1cf tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:19.842345 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4f90658c-424b-4570-ab53-52c44fb2a1cf tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 379a5e3e-0e59-4b53-a37e-f4e9d1000eaf] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:19.867026 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4f90658c-424b-4570-ab53-52c44fb2a1cf tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:19.868323 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4f90658c-424b-4570-ab53-52c44fb2a1cf tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:19.871408 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4f90658c-424b-4570-ab53-52c44fb2a1cf tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:19.873008 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4f90658c-424b-4570-ab53-52c44fb2a1cf tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:19.876738 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4f90658c-424b-4570-ab53-52c44fb2a1cf tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:19.884668 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4f90658c-424b-4570-ab53-52c44fb2a1cf tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:20.138435 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4f90658c-424b-4570-ab53-52c44fb2a1cf tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:20.147655 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4f90658c-424b-4570-ab53-52c44fb2a1cf tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/379a5e3e-0e59-4b53-a37e-f4e9d1000eaf" status: 200 len: 1266 microversion: 2.1 time: 0.312793 Sep 08 10:55:20.157318 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1940/3851] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:19 2022] GET /compute/v2.1/servers/379a5e3e-0e59-4b53-a37e-f4e9d1000eaf => generated 1266 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:20.193315 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e5b187d2-9ecc-422e-8daf-9278d0446a88 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:55:20.200836 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e5b187d2-9ecc-422e-8daf-9278d0446a88 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 2f60f023-c64f-4c53-9f17-d8a15d4ca37e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:20.213916 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-e5b187d2-9ecc-422e-8daf-9278d0446a88 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] HTTP exception thrown: Instance 2f60f023-c64f-4c53-9f17-d8a15d4ca37e could not be found. Sep 08 10:55:20.215615 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e5b187d2-9ecc-422e-8daf-9278d0446a88 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Request method failure captured: Sep 08 10:55:20.215615 n-d-850501-12 devstack@n-api.service[128861]: request: POST /compute/v2.1/servers/2f60f023-c64f-4c53-9f17-d8a15d4ca37e/action HTTP/1.1 Sep 08 10:55:20.215615 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:55:20.215615 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:55:20.215615 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:55:20.215615 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 65 Sep 08 10:55:20.215615 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:55:20.215615 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:55:20.215615 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:55:20.215615 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:55:20.215615 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcmnspi0cCT_Ts_s7jcB6HjtEcdULbQPd_krJniB9lBsXpm1cXSOD-YMaJoaapHCxuCXz0q6Qe4WXufr5At6SSPw8ov8Oz1eUk-fSNbVp7WlOPycfCf5I6xwH7tfbsoefVfbTiDOfU9mTBl0Vs74qdfTniErHfQlEG4cAvAQl1-wMrs Sep 08 10:55:20.215615 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:55:20.215615 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:55:20.215615 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:55:20.215615 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:55:20.215615 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:55:20.215615 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:55:20.215615 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:55:20.215615 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:55:20.215615 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:55:20.215615 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:55:20.215615 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:55:20.215615 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:55:20.215615 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:55:20.215615 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:55:20.215615 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:55:20.215615 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:55:20.215615 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:55:20.215615 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 7f551e6fe34243c290a25b57ab26af19 Sep 08 10:55:20.215615 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:55:20.215615 n-d-850501-12 devstack@n-api.service[128861]: Sep 08 10:55:20.215615 n-d-850501-12 devstack@n-api.service[128861]: {"rebuild": {"imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117"}} Sep 08 10:55:20.215615 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:55:20.215615 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 2f60f023-c64f-4c53-9f17-d8a15d4ca37e could not be found. Sep 08 10:55:20.215615 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '2f60f023-c64f-4c53-9f17-d8a15d4ca37e', 'body': {'rebuild': {'imageRef': '503f4a0f-e18f-47fd-ad12-0289e3463117'}}} Sep 08 10:55:20.215615 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:55:20.215615 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:20.215615 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:55:20.215615 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:55:20.215615 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:55:20.215615 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:55:20.215615 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 08 10:55:20.215615 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 08 10:55:20.215615 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f60f023-c64f-4c53-9f17-d8a15d4ca37e could not be found. Sep 08 10:55:20.215615 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:20.215615 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:20.215615 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:20.215615 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:20.215615 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:55:20.215615 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:55:20.215615 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:55:20.215615 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:55:20.215615 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:55:20.215615 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:55:20.215615 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:55:20.215615 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:55:20.215615 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:55:20.215615 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:55:20.215615 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:55:20.215615 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:55:20.215615 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Sep 08 10:55:20.215615 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Sep 08 10:55:20.215615 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 08 10:55:20.215615 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:55:20.221584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:55:20.221584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:55:20.221584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:55:20.221584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f60f023-c64f-4c53-9f17-d8a15d4ca37e could not be found. Sep 08 10:55:20.221584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:20.221584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:20.221584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:20.221584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:20.221584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:55:20.221584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:55:20.221584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:55:20.221584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:55:20.221584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f60f023-c64f-4c53-9f17-d8a15d4ca37e could not be found. Sep 08 10:55:20.221584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:20.221584 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e5b187d2-9ecc-422e-8daf-9278d0446a88 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Returning 404 to user: Instance 2f60f023-c64f-4c53-9f17-d8a15d4ca37e could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:55:20.221584 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e5b187d2-9ecc-422e-8daf-9278d0446a88 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "POST /compute/v2.1/servers/2f60f023-c64f-4c53-9f17-d8a15d4ca37e/action" status: 404 len: 111 microversion: 2.1 time: 0.050221 Sep 08 10:55:20.239545 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1941/3852] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:55:20 2022] POST /compute/v2.1/servers/2f60f023-c64f-4c53-9f17-d8a15d4ca37e/action => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:55:20.244654 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e7a865f5-1539-47eb-aa19-f3a4ed3d8e2f tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Calling method '.version_select at 0x7f68df95e3a0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:20.438362 n-d-850501-12 devstack@n-api.service[128861]: DEBUG neutronclient.v2_0.client [None req-e7a865f5-1539-47eb-aa19-f3a4ed3d8e2f tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 9abcfaa8-eed1-428d-a9ef-d3953e75ba6d in use.", "detail": ""}} {{(pid=128861) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 08 10:55:20.440201 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-e7a865f5-1539-47eb-aa19-f3a4ed3d8e2f tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] HTTP exception thrown: Security Group 9abcfaa8-eed1-428d-a9ef-d3953e75ba6d in use. Sep 08 10:55:20.440201 n-d-850501-12 devstack@n-api.service[128861]: Neutron server returns request_ids: ['req-07194485-8785-4bd7-97ea-bf8936009d4a'] Sep 08 10:55:20.442468 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e7a865f5-1539-47eb-aa19-f3a4ed3d8e2f tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Request method failure captured: Sep 08 10:55:20.442468 n-d-850501-12 devstack@n-api.service[128861]: request: DELETE /compute/v2.1/os-security-groups/9abcfaa8-eed1-428d-a9ef-d3953e75ba6d HTTP/1.1 Sep 08 10:55:20.442468 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:55:20.442468 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:55:20.442468 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:55:20.442468 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:55:20.442468 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:55:20.442468 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:55:20.442468 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:55:20.442468 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:55:20.442468 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcnTIBfdH5H0Q1rMlbnLYZQcAnuATI-6ncC0ETqGOy19nshWBWc6mMSPvOE_5zGIQBC9DCOSD4SaG9XyRLj03fab4bxuKCvYlxZzzB9WEeCTo5mGH1uU5x9CALWtC8B7Wu8ih4rvxppcLmpz4ET9xD3ym8uzzB22kwTIB3vo0v5dqyY Sep 08 10:55:20.442468 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:55:20.442468 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:55:20.442468 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:55:20.442468 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:55:20.442468 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:55:20.442468 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:55:20.442468 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 0958700fa94b42b2b6b47af40cf2f679 Sep 08 10:55:20.442468 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-SecurityGroupsTestJSON-353861575 Sep 08 10:55:20.442468 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:55:20.442468 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:55:20.442468 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0958700fa94b42b2b6b47af40cf2f679"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0958700fa94b42b2b6b47af40cf2f679"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0958700fa94b42b2b6b47af40cf2f679"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0958700fa94b42b2b6b47af40cf2f679"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:55:20.442468 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-SecurityGroupsTestJSON-353861575 Sep 08 10:55:20.442468 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 0958700fa94b42b2b6b47af40cf2f679 Sep 08 10:55:20.442468 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-353861575 Sep 08 10:55:20.442468 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-SecurityGroupsTestJSON-353861575-project Sep 08 10:55:20.442468 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:55:20.442468 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:55:20.442468 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: e1bec228c17647bba62ba7d57d28e4ed Sep 08 10:55:20.442468 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-SecurityGroupsTestJSON-353861575-project Sep 08 10:55:20.442468 n-d-850501-12 devstack@n-api.service[128861]: method: Sep 08 10:55:20.442468 n-d-850501-12 devstack@n-api.service[128861]: exception: Security Group 9abcfaa8-eed1-428d-a9ef-d3953e75ba6d in use. Sep 08 10:55:20.442468 n-d-850501-12 devstack@n-api.service[128861]: Neutron server returns request_ids: ['req-07194485-8785-4bd7-97ea-bf8936009d4a'] Sep 08 10:55:20.442468 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '9abcfaa8-eed1-428d-a9ef-d3953e75ba6d'} Sep 08 10:55:20.442468 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:55:20.442468 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:20.442468 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Sep 08 10:55:20.442468 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Sep 08 10:55:20.442468 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:55:20.442468 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:55:20.442468 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Sep 08 10:55:20.442468 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Sep 08 10:55:20.442468 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:55:20.442468 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:55:20.442468 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Sep 08 10:55:20.442468 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Sep 08 10:55:20.442468 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:55:20.442468 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:55:20.442468 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 08 10:55:20.442468 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 08 10:55:20.442468 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:55:20.442468 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:55:20.442468 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 08 10:55:20.442468 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 08 10:55:20.442468 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:55:20.442468 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:55:20.442468 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 08 10:55:20.442468 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 08 10:55:20.442468 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 08 10:55:20.442468 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 08 10:55:20.442468 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 9abcfaa8-eed1-428d-a9ef-d3953e75ba6d in use. Sep 08 10:55:20.447813 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-07194485-8785-4bd7-97ea-bf8936009d4a'] Sep 08 10:55:20.447813 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:20.447813 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:20.447813 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:20.447813 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:20.447813 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Sep 08 10:55:20.447813 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Sep 08 10:55:20.447813 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Sep 08 10:55:20.447813 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Sep 08 10:55:20.447813 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 9abcfaa8-eed1-428d-a9ef-d3953e75ba6d in use. Sep 08 10:55:20.447813 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-07194485-8785-4bd7-97ea-bf8936009d4a'] Sep 08 10:55:20.447813 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:20.447813 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:20.447813 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:20.447813 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:20.447813 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:55:20.447813 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:55:20.447813 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:55:20.447813 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:55:20.447813 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:55:20.447813 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:55:20.447813 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:55:20.447813 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:55:20.447813 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Sep 08 10:55:20.447813 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 08 10:55:20.447813 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 9abcfaa8-eed1-428d-a9ef-d3953e75ba6d in use. Sep 08 10:55:20.447813 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-07194485-8785-4bd7-97ea-bf8936009d4a'] Sep 08 10:55:20.447813 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:20.447813 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:20.447813 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:20.447813 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:20.447813 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:55:20.447813 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:55:20.447813 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:55:20.447813 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:55:20.447813 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 9abcfaa8-eed1-428d-a9ef-d3953e75ba6d in use. Sep 08 10:55:20.447813 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-07194485-8785-4bd7-97ea-bf8936009d4a'] Sep 08 10:55:20.447813 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:20.452906 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e7a865f5-1539-47eb-aa19-f3a4ed3d8e2f tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Returning 400 to user: Security Group 9abcfaa8-eed1-428d-a9ef-d3953e75ba6d in use. Sep 08 10:55:20.452906 n-d-850501-12 devstack@n-api.service[128861]: Neutron server returns request_ids: ['req-07194485-8785-4bd7-97ea-bf8936009d4a'] {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:55:20.455848 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e7a865f5-1539-47eb-aa19-f3a4ed3d8e2f tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/9abcfaa8-eed1-428d-a9ef-d3953e75ba6d" status: 400 len: 185 microversion: 2.1 time: 0.214542 Sep 08 10:55:20.457256 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1942/3853] 10.222.0.27 () {58 vars in 1272 bytes} [Thu Sep 8 10:55:20 2022] DELETE /compute/v2.1/os-security-groups/9abcfaa8-eed1-428d-a9ef-d3953e75ba6d => generated 185 bytes in 217 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:55:20.468349 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-87c6bd1b-a8b0-46a9-b96f-49d3f9b4b178 req-e4d9debf-ae70-4de4-9bd2-45f058a37096 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7e97718-dc14-4e93-b7b3-49a8d8e03bb9", "tag": "e2153ee7-b11d-41b7-b5fb-82f06d8cb9d0"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:55:20.495199 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-87c6bd1b-a8b0-46a9-b96f-49d3f9b4b178 req-e4d9debf-ae70-4de4-9bd2-45f058a37096 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:20.495994 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-87c6bd1b-a8b0-46a9-b96f-49d3f9b4b178 req-e4d9debf-ae70-4de4-9bd2-45f058a37096 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:20.496623 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-87c6bd1b-a8b0-46a9-b96f-49d3f9b4b178 req-e4d9debf-ae70-4de4-9bd2-45f058a37096 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:20.529199 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-87c6bd1b-a8b0-46a9-b96f-49d3f9b4b178 req-e4d9debf-ae70-4de4-9bd2-45f058a37096 service nova] Creating event network-changed:e2153ee7-b11d-41b7-b5fb-82f06d8cb9d0 for instance b7e97718-dc14-4e93-b7b3-49a8d8e03bb9 on n-h1-850501-12 Sep 08 10:55:20.558904 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-87c6bd1b-a8b0-46a9-b96f-49d3f9b4b178 req-e4d9debf-ae70-4de4-9bd2-45f058a37096 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100199 Sep 08 10:55:20.560542 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1943/3854] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:55:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:55:20.578934 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-05977354-048c-409d-9a08-24f1a95b3abd tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:20.582437 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-05977354-048c-409d-9a08-24f1a95b3abd tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:20.600352 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-05977354-048c-409d-9a08-24f1a95b3abd tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:20.607245 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-05977354-048c-409d-9a08-24f1a95b3abd tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:20.609744 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-05977354-048c-409d-9a08-24f1a95b3abd tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:20.611757 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-05977354-048c-409d-9a08-24f1a95b3abd tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:20.612475 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-05977354-048c-409d-9a08-24f1a95b3abd tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:20.615334 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-05977354-048c-409d-9a08-24f1a95b3abd tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:20.884419 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-05977354-048c-409d-9a08-24f1a95b3abd tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:20.893930 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-05977354-048c-409d-9a08-24f1a95b3abd tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 0.331788 Sep 08 10:55:20.895037 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1944/3855] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:20 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:20.912075 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-25e43509-95af-4e47-bb4e-ae284b9b1baa tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:55:20.914688 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-25e43509-95af-4e47-bb4e-ae284b9b1baa tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] [instance: b7e97718-dc14-4e93-b7b3-49a8d8e03bb9] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:20.944447 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-25e43509-95af-4e47-bb4e-ae284b9b1baa tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:20.945102 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-25e43509-95af-4e47-bb4e-ae284b9b1baa tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:20.945534 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-25e43509-95af-4e47-bb4e-ae284b9b1baa tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:20.946505 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-25e43509-95af-4e47-bb4e-ae284b9b1baa tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:20.947144 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-25e43509-95af-4e47-bb4e-ae284b9b1baa tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:20.947895 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-25e43509-95af-4e47-bb4e-ae284b9b1baa tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:21.111410 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-c00cc7ad-4c8f-411a-94cf-dc8a5b060a07 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:55:21.113439 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-c00cc7ad-4c8f-411a-94cf-dc8a5b060a07 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:55:21.115201 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-c00cc7ad-4c8f-411a-94cf-dc8a5b060a07 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:55:21.119199 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-c00cc7ad-4c8f-411a-94cf-dc8a5b060a07 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:55:21.123108 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-c00cc7ad-4c8f-411a-94cf-dc8a5b060a07 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:55:21.183437 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-25e43509-95af-4e47-bb4e-ae284b9b1baa tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "POST /compute/v2.1/servers/b7e97718-dc14-4e93-b7b3-49a8d8e03bb9/action" status: 202 len: 0 microversion: 2.1 time: 0.273113 Sep 08 10:55:21.184467 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1945/3856] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:55:20 2022] POST /compute/v2.1/servers/b7e97718-dc14-4e93-b7b3-49a8d8e03bb9/action => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:55:21.193593 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b18c5ca0-65fe-420f-b537-5e3842466501 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:21.194625 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b18c5ca0-65fe-420f-b537-5e3842466501 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:21.204507 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b18c5ca0-65fe-420f-b537-5e3842466501 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:21.205432 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b18c5ca0-65fe-420f-b537-5e3842466501 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:21.205817 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c00cc7ad-4c8f-411a-94cf-dc8a5b060a07 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:21.206581 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c00cc7ad-4c8f-411a-94cf-dc8a5b060a07 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:21.206823 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b18c5ca0-65fe-420f-b537-5e3842466501 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:21.207712 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b18c5ca0-65fe-420f-b537-5e3842466501 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:21.208358 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b18c5ca0-65fe-420f-b537-5e3842466501 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:21.208958 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b18c5ca0-65fe-420f-b537-5e3842466501 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:21.229667 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c00cc7ad-4c8f-411a-94cf-dc8a5b060a07 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:21.230568 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c00cc7ad-4c8f-411a-94cf-dc8a5b060a07 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:21.238310 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c00cc7ad-4c8f-411a-94cf-dc8a5b060a07 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:21.238874 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c00cc7ad-4c8f-411a-94cf-dc8a5b060a07 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:21.354023 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-c00cc7ad-4c8f-411a-94cf-dc8a5b060a07 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Getting quotas for project 4da8b15686cd4d688a48e857fb16e4cf. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:55:21.368157 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-c00cc7ad-4c8f-411a-94cf-dc8a5b060a07 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Getting quotas for user ad89f6def8f54778b80b315f2eb0c9b5 and project 4da8b15686cd4d688a48e857fb16e4cf. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:55:21.404881 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c00cc7ad-4c8f-411a-94cf-dc8a5b060a07 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:55:21.408347 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c00cc7ad-4c8f-411a-94cf-dc8a5b060a07 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] [instance: b8edf980-3cac-4b70-bbf2-bad0e4681366] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:55:21.477445 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b18c5ca0-65fe-420f-b537-5e3842466501 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:21.489090 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b18c5ca0-65fe-420f-b537-5e3842466501 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 0.302926 Sep 08 10:55:21.490465 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1946/3857] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:21 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:21.515114 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c9e1ae35-9db6-4628-87b6-497daf0b2639 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:21.516431 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c9e1ae35-9db6-4628-87b6-497daf0b2639 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 379a5e3e-0e59-4b53-a37e-f4e9d1000eaf] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:21.523333 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c9e1ae35-9db6-4628-87b6-497daf0b2639 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:21.524099 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c9e1ae35-9db6-4628-87b6-497daf0b2639 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:21.524712 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c9e1ae35-9db6-4628-87b6-497daf0b2639 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:21.526425 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c9e1ae35-9db6-4628-87b6-497daf0b2639 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:21.527190 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c9e1ae35-9db6-4628-87b6-497daf0b2639 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:21.527810 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c9e1ae35-9db6-4628-87b6-497daf0b2639 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:21.540471 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c00cc7ad-4c8f-411a-94cf-dc8a5b060a07 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.551053 Sep 08 10:55:21.549815 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1912/3858] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:55:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 3570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:55:21.555081 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6094cf70-5dda-475f-b4d1-394b71411f79 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:21.556077 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6094cf70-5dda-475f-b4d1-394b71411f79 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] [instance: b7e97718-dc14-4e93-b7b3-49a8d8e03bb9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:21.564607 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6094cf70-5dda-475f-b4d1-394b71411f79 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:21.565689 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6094cf70-5dda-475f-b4d1-394b71411f79 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:21.566475 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6094cf70-5dda-475f-b4d1-394b71411f79 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:21.567516 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6094cf70-5dda-475f-b4d1-394b71411f79 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:21.568887 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6094cf70-5dda-475f-b4d1-394b71411f79 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:21.569887 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6094cf70-5dda-475f-b4d1-394b71411f79 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:21.663634 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c9e1ae35-9db6-4628-87b6-497daf0b2639 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:21.695124 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c9e1ae35-9db6-4628-87b6-497daf0b2639 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/379a5e3e-0e59-4b53-a37e-f4e9d1000eaf" status: 200 len: 1272 microversion: 2.1 time: 0.185344 Sep 08 10:55:21.723413 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1947/3859] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:21 2022] GET /compute/v2.1/servers/379a5e3e-0e59-4b53-a37e-f4e9d1000eaf => generated 1272 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:21.728783 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-155a3c6b-07d3-4891-b7b6-fa162a659426 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:55:21.746491 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-155a3c6b-07d3-4891-b7b6-fa162a659426 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 86493bbe-0c91-44cf-ae7a-db8b8e5efc18] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:21.765007 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-155a3c6b-07d3-4891-b7b6-fa162a659426 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] HTTP exception thrown: Instance 86493bbe-0c91-44cf-ae7a-db8b8e5efc18 could not be found. Sep 08 10:55:21.772114 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-155a3c6b-07d3-4891-b7b6-fa162a659426 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Request method failure captured: Sep 08 10:55:21.772114 n-d-850501-12 devstack@n-api.service[128861]: request: POST /compute/v2.1/servers/86493bbe-0c91-44cf-ae7a-db8b8e5efc18/action HTTP/1.1 Sep 08 10:55:21.772114 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:55:21.772114 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:55:21.772114 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:55:21.772114 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 15 Sep 08 10:55:21.772114 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:55:21.772114 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:55:21.772114 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:55:21.772114 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:55:21.772114 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcmnspi0cCT_Ts_s7jcB6HjtEcdULbQPd_krJniB9lBsXpm1cXSOD-YMaJoaapHCxuCXz0q6Qe4WXufr5At6SSPw8ov8Oz1eUk-fSNbVp7WlOPycfCf5I6xwH7tfbsoefVfbTiDOfU9mTBl0Vs74qdfTniErHfQlEG4cAvAQl1-wMrs Sep 08 10:55:21.772114 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:55:21.772114 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:55:21.772114 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:55:21.772114 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:55:21.772114 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:55:21.772114 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:55:21.772114 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:55:21.772114 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:55:21.772114 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:55:21.772114 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:55:21.772114 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:55:21.772114 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:55:21.772114 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:55:21.772114 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:55:21.772114 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:55:21.772114 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:55:21.772114 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:55:21.772114 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 7f551e6fe34243c290a25b57ab26af19 Sep 08 10:55:21.772114 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:55:21.772114 n-d-850501-12 devstack@n-api.service[128861]: Sep 08 10:55:21.772114 n-d-850501-12 devstack@n-api.service[128861]: {"restore": {}} Sep 08 10:55:21.772114 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:55:21.772114 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 86493bbe-0c91-44cf-ae7a-db8b8e5efc18 could not be found. Sep 08 10:55:21.772114 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '86493bbe-0c91-44cf-ae7a-db8b8e5efc18', 'body': {'restore': {}}} Sep 08 10:55:21.772114 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:55:21.772114 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:21.772114 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:55:21.772114 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:55:21.772114 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:55:21.772114 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:55:21.772114 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 08 10:55:21.772114 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 08 10:55:21.772114 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86493bbe-0c91-44cf-ae7a-db8b8e5efc18 could not be found. Sep 08 10:55:21.772114 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:21.772114 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:21.772114 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:21.772114 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:21.772114 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:55:21.772114 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:55:21.772114 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:55:21.772114 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:55:21.772114 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:55:21.772114 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:55:21.772114 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Sep 08 10:55:21.772114 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 08 10:55:21.772114 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:55:21.772114 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:55:21.772114 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86493bbe-0c91-44cf-ae7a-db8b8e5efc18 could not be found. Sep 08 10:55:21.772114 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:21.772114 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:21.772114 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:21.772114 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:21.772114 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:55:21.772114 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:55:21.777720 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:55:21.777720 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:55:21.777720 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86493bbe-0c91-44cf-ae7a-db8b8e5efc18 could not be found. Sep 08 10:55:21.777720 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:21.777720 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-155a3c6b-07d3-4891-b7b6-fa162a659426 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Returning 404 to user: Instance 86493bbe-0c91-44cf-ae7a-db8b8e5efc18 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:55:21.777720 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-155a3c6b-07d3-4891-b7b6-fa162a659426 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "POST /compute/v2.1/servers/86493bbe-0c91-44cf-ae7a-db8b8e5efc18/action" status: 404 len: 111 microversion: 2.1 time: 0.050896 Sep 08 10:55:21.790738 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1948/3860] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:55:21 2022] POST /compute/v2.1/servers/86493bbe-0c91-44cf-ae7a-db8b8e5efc18/action => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:55:21.803807 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1e7c09d9-00f3-4303-8a44-1253e0c4b68d tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:21.805623 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1e7c09d9-00f3-4303-8a44-1253e0c4b68d tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] [instance: b8edf980-3cac-4b70-bbf2-bad0e4681366] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:21.945478 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1e7c09d9-00f3-4303-8a44-1253e0c4b68d tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89f6def8f54778b80b315f2eb0c9b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da8b15686cd4d688a48e857fb16e4cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:21.961728 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1e7c09d9-00f3-4303-8a44-1253e0c4b68d tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] 10.222.0.27 "GET /compute/v2.1/servers/b8edf980-3cac-4b70-bbf2-bad0e4681366" status: 200 len: 1225 microversion: 2.1 time: 0.164502 Sep 08 10:55:21.962596 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1949/3861] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:21 2022] GET /compute/v2.1/servers/b8edf980-3cac-4b70-bbf2-bad0e4681366 => generated 1225 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:21.990690 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6ef00836-6195-4a88-b288-64db72484fe4 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:21.992370 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6ef00836-6195-4a88-b288-64db72484fe4 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:22.012963 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6ef00836-6195-4a88-b288-64db72484fe4 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:22.013751 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6ef00836-6195-4a88-b288-64db72484fe4 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:22.014227 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6ef00836-6195-4a88-b288-64db72484fe4 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:22.014950 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6ef00836-6195-4a88-b288-64db72484fe4 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:22.015408 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6ef00836-6195-4a88-b288-64db72484fe4 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:22.020375 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6ef00836-6195-4a88-b288-64db72484fe4 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:22.308330 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6ef00836-6195-4a88-b288-64db72484fe4 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:22.324051 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6ef00836-6195-4a88-b288-64db72484fe4 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 0.359175 Sep 08 10:55:22.325337 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1950/3862] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:21 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:22.354635 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b914f36d-648f-41db-b253-025f095684bc tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:22.355551 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b914f36d-648f-41db-b253-025f095684bc tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:22.364962 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b914f36d-648f-41db-b253-025f095684bc tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:22.365819 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b914f36d-648f-41db-b253-025f095684bc tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:22.370467 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b914f36d-648f-41db-b253-025f095684bc tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:22.371901 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b914f36d-648f-41db-b253-025f095684bc tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:22.372640 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b914f36d-648f-41db-b253-025f095684bc tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:22.373186 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b914f36d-648f-41db-b253-025f095684bc tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:22.680853 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b914f36d-648f-41db-b253-025f095684bc tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:22.691498 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b914f36d-648f-41db-b253-025f095684bc tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 0.341978 Sep 08 10:55:22.695881 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1951/3863] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:22 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:22.719353 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9dceec76-291c-4794-ba4d-84062699c564 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:55:22.722347 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9dceec76-291c-4794-ba4d-84062699c564 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:22.736741 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9dceec76-291c-4794-ba4d-84062699c564 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:22.737295 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9dceec76-291c-4794-ba4d-84062699c564 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:22.739983 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9dceec76-291c-4794-ba4d-84062699c564 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:22.742108 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9dceec76-291c-4794-ba4d-84062699c564 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:22.744364 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9dceec76-291c-4794-ba4d-84062699c564 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:22.745001 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9dceec76-291c-4794-ba4d-84062699c564 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:22.826152 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-9dceec76-291c-4794-ba4d-84062699c564 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] HTTP exception thrown: Cannot 'restore' instance 74eebde7-4328-4ddf-be14-bb9fba70ec03 while it is in vm_state active Sep 08 10:55:22.827658 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9dceec76-291c-4794-ba4d-84062699c564 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Request method failure captured: Sep 08 10:55:22.827658 n-d-850501-12 devstack@n-api.service[128861]: request: POST /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03/action HTTP/1.1 Sep 08 10:55:22.827658 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:55:22.827658 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:55:22.827658 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:55:22.827658 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 15 Sep 08 10:55:22.827658 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:55:22.827658 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:55:22.827658 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:55:22.827658 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:55:22.827658 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcmnspi0cCT_Ts_s7jcB6HjtEcdULbQPd_krJniB9lBsXpm1cXSOD-YMaJoaapHCxuCXz0q6Qe4WXufr5At6SSPw8ov8Oz1eUk-fSNbVp7WlOPycfCf5I6xwH7tfbsoefVfbTiDOfU9mTBl0Vs74qdfTniErHfQlEG4cAvAQl1-wMrs Sep 08 10:55:22.827658 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:55:22.827658 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:55:22.827658 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:55:22.827658 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:55:22.827658 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:55:22.827658 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:55:22.827658 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:55:22.827658 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:55:22.827658 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:55:22.827658 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:55:22.827658 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:55:22.827658 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:55:22.827658 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:55:22.827658 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:55:22.827658 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:55:22.827658 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:55:22.827658 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:55:22.827658 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 7f551e6fe34243c290a25b57ab26af19 Sep 08 10:55:22.827658 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:55:22.827658 n-d-850501-12 devstack@n-api.service[128861]: Sep 08 10:55:22.827658 n-d-850501-12 devstack@n-api.service[128861]: {"restore": {}} Sep 08 10:55:22.827658 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:55:22.827658 n-d-850501-12 devstack@n-api.service[128861]: exception: Cannot 'restore' instance 74eebde7-4328-4ddf-be14-bb9fba70ec03 while it is in vm_state active Sep 08 10:55:22.827658 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '74eebde7-4328-4ddf-be14-bb9fba70ec03', 'body': {'restore': {}}} Sep 08 10:55:22.827658 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:55:22.827658 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:22.827658 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Sep 08 10:55:22.827658 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Sep 08 10:55:22.827658 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 10:55:22.827658 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 10:55:22.827658 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 08 10:55:22.827658 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 08 10:55:22.827658 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 74eebde7-4328-4ddf-be14-bb9fba70ec03 in vm_state active. Cannot restore while the instance is in this state. Sep 08 10:55:22.827658 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:22.827658 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:22.827658 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:22.827658 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:22.827658 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:55:22.827658 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:55:22.827658 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:55:22.827658 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:55:22.827658 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:55:22.827658 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:55:22.827658 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Sep 08 10:55:22.827658 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 08 10:55:22.827658 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 08 10:55:22.827658 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 08 10:55:22.827658 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 74eebde7-4328-4ddf-be14-bb9fba70ec03 while it is in vm_state active Sep 08 10:55:22.827658 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:22.827658 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:22.827658 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:22.827658 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:22.827658 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:55:22.836353 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:55:22.836353 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:55:22.836353 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:55:22.836353 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 74eebde7-4328-4ddf-be14-bb9fba70ec03 while it is in vm_state active Sep 08 10:55:22.836353 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:22.836353 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9dceec76-291c-4794-ba4d-84062699c564 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Returning 409 to user: Cannot 'restore' instance 74eebde7-4328-4ddf-be14-bb9fba70ec03 while it is in vm_state active {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:55:22.852913 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9dceec76-291c-4794-ba4d-84062699c564 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "POST /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03/action" status: 409 len: 145 microversion: 2.1 time: 0.114393 Sep 08 10:55:22.856786 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1952/3864] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:55:22 2022] POST /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03/action => generated 145 bytes in 140 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:55:22.863388 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2159de2d-a9e9-494c-be9e-a5582b778095 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:22.864098 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2159de2d-a9e9-494c-be9e-a5582b778095 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 379a5e3e-0e59-4b53-a37e-f4e9d1000eaf] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:22.882694 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2159de2d-a9e9-494c-be9e-a5582b778095 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:22.883209 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2159de2d-a9e9-494c-be9e-a5582b778095 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:22.883662 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2159de2d-a9e9-494c-be9e-a5582b778095 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:22.884382 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2159de2d-a9e9-494c-be9e-a5582b778095 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:22.884847 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2159de2d-a9e9-494c-be9e-a5582b778095 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:22.885361 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2159de2d-a9e9-494c-be9e-a5582b778095 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:23.046961 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2159de2d-a9e9-494c-be9e-a5582b778095 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:23.074425 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2159de2d-a9e9-494c-be9e-a5582b778095 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/379a5e3e-0e59-4b53-a37e-f4e9d1000eaf" status: 200 len: 1272 microversion: 2.1 time: 0.218887 Sep 08 10:55:23.114926 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1953/3865] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:22 2022] GET /compute/v2.1/servers/379a5e3e-0e59-4b53-a37e-f4e9d1000eaf => generated 1272 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:23.129045 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9cc7a629-76f2-4ffe-a170-97e32888f694 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:23.129807 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9cc7a629-76f2-4ffe-a170-97e32888f694 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:23.146823 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9cc7a629-76f2-4ffe-a170-97e32888f694 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:23.149504 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9cc7a629-76f2-4ffe-a170-97e32888f694 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:23.150143 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9cc7a629-76f2-4ffe-a170-97e32888f694 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:23.151589 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9cc7a629-76f2-4ffe-a170-97e32888f694 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:23.152395 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9cc7a629-76f2-4ffe-a170-97e32888f694 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:23.155558 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9cc7a629-76f2-4ffe-a170-97e32888f694 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:23.438394 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9cc7a629-76f2-4ffe-a170-97e32888f694 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:23.462761 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9cc7a629-76f2-4ffe-a170-97e32888f694 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 0.346586 Sep 08 10:55:23.465199 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1954/3866] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:23 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:23.471991 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4ed956d7-6e57-4c96-9b74-c940f69e6c00 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:23.473048 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4ed956d7-6e57-4c96-9b74-c940f69e6c00 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] [instance: b8edf980-3cac-4b70-bbf2-bad0e4681366] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:23.480443 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ed956d7-6e57-4c96-9b74-c940f69e6c00 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:23.481376 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ed956d7-6e57-4c96-9b74-c940f69e6c00 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:23.482088 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ed956d7-6e57-4c96-9b74-c940f69e6c00 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:23.483236 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ed956d7-6e57-4c96-9b74-c940f69e6c00 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:23.483934 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ed956d7-6e57-4c96-9b74-c940f69e6c00 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:23.484648 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ed956d7-6e57-4c96-9b74-c940f69e6c00 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:23.682858 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4ed956d7-6e57-4c96-9b74-c940f69e6c00 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89f6def8f54778b80b315f2eb0c9b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da8b15686cd4d688a48e857fb16e4cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:23.692691 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4ed956d7-6e57-4c96-9b74-c940f69e6c00 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] 10.222.0.27 "GET /compute/v2.1/servers/b8edf980-3cac-4b70-bbf2-bad0e4681366" status: 200 len: 1277 microversion: 2.1 time: 0.225234 Sep 08 10:55:23.705060 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1955/3867] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:23 2022] GET /compute/v2.1/servers/b8edf980-3cac-4b70-bbf2-bad0e4681366 => generated 1277 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:23.705060 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9f694012-6905-41b4-8665-06d910c876b1 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:23.705060 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9f694012-6905-41b4-8665-06d910c876b1 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:23.719229 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f694012-6905-41b4-8665-06d910c876b1 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:23.722185 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f694012-6905-41b4-8665-06d910c876b1 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:23.722868 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f694012-6905-41b4-8665-06d910c876b1 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:23.723927 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f694012-6905-41b4-8665-06d910c876b1 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:23.727193 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f694012-6905-41b4-8665-06d910c876b1 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:23.727193 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f694012-6905-41b4-8665-06d910c876b1 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:23.748810 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:55:23.765354 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6094cf70-5dda-475f-b4d1-394b71411f79 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1bec228c17647bba62ba7d57d28e4ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0958700fa94b42b2b6b47af40cf2f679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:23.782211 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6094cf70-5dda-475f-b4d1-394b71411f79 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "GET /compute/v2.1/servers/b7e97718-dc14-4e93-b7b3-49a8d8e03bb9" status: 200 len: 1575 microversion: 2.1 time: 2.230742 Sep 08 10:55:23.786159 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1913/3868] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:21 2022] GET /compute/v2.1/servers/b7e97718-dc14-4e93-b7b3-49a8d8e03bb9 => generated 1575 bytes in 2235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:24.018805 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9f694012-6905-41b4-8665-06d910c876b1 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:24.029687 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9f694012-6905-41b4-8665-06d910c876b1 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 0.334189 Sep 08 10:55:24.034998 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1956/3869] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:23 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:24.068091 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e0300ad9-79ad-446f-827a-1bb4d8fea01f tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:55:24.068861 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e0300ad9-79ad-446f-827a-1bb4d8fea01f tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 80b98663-2f47-46c2-a0ea-1d670121b46e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:24.092259 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-e0300ad9-79ad-446f-827a-1bb4d8fea01f tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] HTTP exception thrown: Instance 80b98663-2f47-46c2-a0ea-1d670121b46e could not be found. Sep 08 10:55:24.099397 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e0300ad9-79ad-446f-827a-1bb4d8fea01f tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Request method failure captured: Sep 08 10:55:24.099397 n-d-850501-12 devstack@n-api.service[128862]: request: POST /compute/v2.1/servers/80b98663-2f47-46c2-a0ea-1d670121b46e/action HTTP/1.1 Sep 08 10:55:24.099397 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:55:24.099397 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:55:24.099397 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:55:24.099397 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 14 Sep 08 10:55:24.099397 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:55:24.099397 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:55:24.099397 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:55:24.099397 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:55:24.099397 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcmnspi0cCT_Ts_s7jcB6HjtEcdULbQPd_krJniB9lBsXpm1cXSOD-YMaJoaapHCxuCXz0q6Qe4WXufr5At6SSPw8ov8Oz1eUk-fSNbVp7WlOPycfCf5I6xwH7tfbsoefVfbTiDOfU9mTBl0Vs74qdfTniErHfQlEG4cAvAQl1-wMrs Sep 08 10:55:24.099397 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:55:24.099397 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:55:24.099397 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:55:24.099397 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:55:24.099397 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:55:24.099397 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:55:24.099397 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:55:24.099397 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:55:24.099397 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:55:24.099397 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:55:24.099397 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:55:24.099397 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:55:24.099397 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:55:24.099397 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:55:24.099397 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:55:24.099397 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:55:24.099397 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:55:24.099397 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 7f551e6fe34243c290a25b57ab26af19 Sep 08 10:55:24.099397 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:55:24.099397 n-d-850501-12 devstack@n-api.service[128862]: Sep 08 10:55:24.099397 n-d-850501-12 devstack@n-api.service[128862]: {"resume": {}} Sep 08 10:55:24.099397 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:55:24.099397 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 80b98663-2f47-46c2-a0ea-1d670121b46e could not be found. Sep 08 10:55:24.099397 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '80b98663-2f47-46c2-a0ea-1d670121b46e', 'body': {'resume': {}}} Sep 08 10:55:24.099397 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:55:24.099397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:24.099397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:55:24.099397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:55:24.099397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:55:24.099397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:55:24.099397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 08 10:55:24.099397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 08 10:55:24.099397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80b98663-2f47-46c2-a0ea-1d670121b46e could not be found. Sep 08 10:55:24.099397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:24.099397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:24.099397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:24.099397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:24.099397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:55:24.099397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:55:24.099397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:55:24.099397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:55:24.099397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:55:24.099397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:55:24.099397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Sep 08 10:55:24.099397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Sep 08 10:55:24.099397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:55:24.099397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:55:24.099397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80b98663-2f47-46c2-a0ea-1d670121b46e could not be found. Sep 08 10:55:24.099397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:24.099397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:24.099397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:24.099397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:24.099397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:55:24.099397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:55:24.114557 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:55:24.114557 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:55:24.114557 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80b98663-2f47-46c2-a0ea-1d670121b46e could not be found. Sep 08 10:55:24.114557 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:24.114557 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e0300ad9-79ad-446f-827a-1bb4d8fea01f tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Returning 404 to user: Instance 80b98663-2f47-46c2-a0ea-1d670121b46e could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:55:24.114557 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e0300ad9-79ad-446f-827a-1bb4d8fea01f tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "POST /compute/v2.1/servers/80b98663-2f47-46c2-a0ea-1d670121b46e/action" status: 404 len: 111 microversion: 2.1 time: 0.039065 Sep 08 10:55:24.114557 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1914/3870] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:55:24 2022] POST /compute/v2.1/servers/80b98663-2f47-46c2-a0ea-1d670121b46e/action => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:55:24.121850 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3769a028-ea17-428c-ae41-7a18b74cb9e3 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:24.123244 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3769a028-ea17-428c-ae41-7a18b74cb9e3 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:24.123824 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9ba09483-7bf9-4e93-8e84-98c7f40e7389 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:24.124898 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9ba09483-7bf9-4e93-8e84-98c7f40e7389 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 379a5e3e-0e59-4b53-a37e-f4e9d1000eaf] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:24.134906 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3769a028-ea17-428c-ae41-7a18b74cb9e3 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:24.135982 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3769a028-ea17-428c-ae41-7a18b74cb9e3 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:24.136741 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3769a028-ea17-428c-ae41-7a18b74cb9e3 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:24.138168 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3769a028-ea17-428c-ae41-7a18b74cb9e3 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:24.138878 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3769a028-ea17-428c-ae41-7a18b74cb9e3 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:24.139537 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3769a028-ea17-428c-ae41-7a18b74cb9e3 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:24.144462 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9ba09483-7bf9-4e93-8e84-98c7f40e7389 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:24.144987 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9ba09483-7bf9-4e93-8e84-98c7f40e7389 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:24.149284 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9ba09483-7bf9-4e93-8e84-98c7f40e7389 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:24.150068 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9ba09483-7bf9-4e93-8e84-98c7f40e7389 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:24.150548 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9ba09483-7bf9-4e93-8e84-98c7f40e7389 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:24.150986 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9ba09483-7bf9-4e93-8e84-98c7f40e7389 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:24.357467 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-3769a028-ea17-428c-ae41-7a18b74cb9e3 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:24.372898 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3769a028-ea17-428c-ae41-7a18b74cb9e3 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 0.255380 Sep 08 10:55:24.389740 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1957/3871] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:24 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:24.402914 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9c8360b6-fac8-4631-b3be-af4ea120976d tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:24.403952 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9c8360b6-fac8-4631-b3be-af4ea120976d tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:24.417260 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9c8360b6-fac8-4631-b3be-af4ea120976d tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:24.418154 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9c8360b6-fac8-4631-b3be-af4ea120976d tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:24.420241 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9c8360b6-fac8-4631-b3be-af4ea120976d tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:24.421302 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9c8360b6-fac8-4631-b3be-af4ea120976d tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:24.423581 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9c8360b6-fac8-4631-b3be-af4ea120976d tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:24.424355 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9c8360b6-fac8-4631-b3be-af4ea120976d tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:24.643600 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9c8360b6-fac8-4631-b3be-af4ea120976d tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:24.663636 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9c8360b6-fac8-4631-b3be-af4ea120976d tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 0.263609 Sep 08 10:55:24.665524 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1958/3872] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:24 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:24.987121 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-623d08cc-385f-485a-86d9-cfe378d2adca tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:24.987922 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-623d08cc-385f-485a-86d9-cfe378d2adca tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:25.004049 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-623d08cc-385f-485a-86d9-cfe378d2adca tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:25.004869 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-623d08cc-385f-485a-86d9-cfe378d2adca tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:25.005621 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-623d08cc-385f-485a-86d9-cfe378d2adca tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:25.009789 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-623d08cc-385f-485a-86d9-cfe378d2adca tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:25.010720 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-623d08cc-385f-485a-86d9-cfe378d2adca tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:25.013461 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-623d08cc-385f-485a-86d9-cfe378d2adca tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:25.139262 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-623d08cc-385f-485a-86d9-cfe378d2adca tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:55:25.275812 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9ba09483-7bf9-4e93-8e84-98c7f40e7389 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:25.288268 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9ba09483-7bf9-4e93-8e84-98c7f40e7389 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/379a5e3e-0e59-4b53-a37e-f4e9d1000eaf" status: 200 len: 1314 microversion: 2.1 time: 1.170640 Sep 08 10:55:25.288992 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1915/3873] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:24 2022] GET /compute/v2.1/servers/379a5e3e-0e59-4b53-a37e-f4e9d1000eaf => generated 1314 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:25.327639 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c417ac9a-1e0c-4900-9a18-7c80a1c110e5 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:55:25.328728 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c417ac9a-1e0c-4900-9a18-7c80a1c110e5 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:25.337115 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c417ac9a-1e0c-4900-9a18-7c80a1c110e5 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:25.338253 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c417ac9a-1e0c-4900-9a18-7c80a1c110e5 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:25.339329 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c417ac9a-1e0c-4900-9a18-7c80a1c110e5 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:25.340343 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c417ac9a-1e0c-4900-9a18-7c80a1c110e5 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:25.341084 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c417ac9a-1e0c-4900-9a18-7c80a1c110e5 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:25.341833 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c417ac9a-1e0c-4900-9a18-7c80a1c110e5 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:25.379847 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-c417ac9a-1e0c-4900-9a18-7c80a1c110e5 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] HTTP exception thrown: Cannot 'resume' instance 74eebde7-4328-4ddf-be14-bb9fba70ec03 while it is in vm_state active Sep 08 10:55:25.382210 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c417ac9a-1e0c-4900-9a18-7c80a1c110e5 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Request method failure captured: Sep 08 10:55:25.382210 n-d-850501-12 devstack@n-api.service[128862]: request: POST /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03/action HTTP/1.1 Sep 08 10:55:25.382210 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:55:25.382210 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:55:25.382210 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:55:25.382210 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 14 Sep 08 10:55:25.382210 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:55:25.382210 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:55:25.382210 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:55:25.382210 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:55:25.382210 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcmnspi0cCT_Ts_s7jcB6HjtEcdULbQPd_krJniB9lBsXpm1cXSOD-YMaJoaapHCxuCXz0q6Qe4WXufr5At6SSPw8ov8Oz1eUk-fSNbVp7WlOPycfCf5I6xwH7tfbsoefVfbTiDOfU9mTBl0Vs74qdfTniErHfQlEG4cAvAQl1-wMrs Sep 08 10:55:25.382210 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:55:25.382210 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:55:25.382210 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:55:25.382210 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:55:25.382210 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:55:25.382210 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:55:25.382210 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:55:25.382210 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:55:25.382210 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:55:25.382210 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:55:25.382210 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:55:25.382210 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:55:25.382210 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:55:25.382210 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:55:25.382210 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:55:25.382210 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:55:25.382210 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:55:25.382210 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 7f551e6fe34243c290a25b57ab26af19 Sep 08 10:55:25.382210 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:55:25.382210 n-d-850501-12 devstack@n-api.service[128862]: Sep 08 10:55:25.382210 n-d-850501-12 devstack@n-api.service[128862]: {"resume": {}} Sep 08 10:55:25.382210 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:55:25.382210 n-d-850501-12 devstack@n-api.service[128862]: exception: Cannot 'resume' instance 74eebde7-4328-4ddf-be14-bb9fba70ec03 while it is in vm_state active Sep 08 10:55:25.382210 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '74eebde7-4328-4ddf-be14-bb9fba70ec03', 'body': {'resume': {}}} Sep 08 10:55:25.382210 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:55:25.382210 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:25.382210 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Sep 08 10:55:25.382210 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Sep 08 10:55:25.382210 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 10:55:25.382210 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 10:55:25.382210 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 08 10:55:25.382210 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 08 10:55:25.382210 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 08 10:55:25.382210 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 08 10:55:25.382210 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 74eebde7-4328-4ddf-be14-bb9fba70ec03 in vm_state active. Cannot resume while the instance is in this state. Sep 08 10:55:25.382210 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:25.382210 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:25.382210 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:25.382210 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:25.382210 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:55:25.382210 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:55:25.382210 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:55:25.382210 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:55:25.382210 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:55:25.382210 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:55:25.382210 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Sep 08 10:55:25.382210 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 08 10:55:25.382210 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 08 10:55:25.382210 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 08 10:55:25.382210 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 74eebde7-4328-4ddf-be14-bb9fba70ec03 while it is in vm_state active Sep 08 10:55:25.382210 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:25.382210 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:25.382210 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:25.392170 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:25.392170 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:55:25.392170 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:55:25.392170 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:55:25.392170 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:55:25.392170 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 74eebde7-4328-4ddf-be14-bb9fba70ec03 while it is in vm_state active Sep 08 10:55:25.392170 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:25.395167 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c417ac9a-1e0c-4900-9a18-7c80a1c110e5 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Returning 409 to user: Cannot 'resume' instance 74eebde7-4328-4ddf-be14-bb9fba70ec03 while it is in vm_state active {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:55:25.396832 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c417ac9a-1e0c-4900-9a18-7c80a1c110e5 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "POST /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03/action" status: 409 len: 144 microversion: 2.1 time: 0.086309 Sep 08 10:55:25.398060 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1916/3874] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:55:25 2022] POST /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03/action => generated 144 bytes in 108 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:55:25.408675 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1ca67a5f-4613-4ea2-b666-8e2728b08d23 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:25.409824 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1ca67a5f-4613-4ea2-b666-8e2728b08d23 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] [instance: b8edf980-3cac-4b70-bbf2-bad0e4681366] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:25.419414 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ca67a5f-4613-4ea2-b666-8e2728b08d23 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:25.420344 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ca67a5f-4613-4ea2-b666-8e2728b08d23 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:25.421068 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ca67a5f-4613-4ea2-b666-8e2728b08d23 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:25.422129 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ca67a5f-4613-4ea2-b666-8e2728b08d23 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:25.423645 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ca67a5f-4613-4ea2-b666-8e2728b08d23 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:25.424512 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ca67a5f-4613-4ea2-b666-8e2728b08d23 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:25.442022 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-623d08cc-385f-485a-86d9-cfe378d2adca tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "DELETE /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 204 len: 0 microversion: 2.32 time: 0.770859 Sep 08 10:55:25.448295 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1959/3875] 10.222.0.27 () {60 vars in 1280 bytes} [Thu Sep 8 10:55:24 2022] DELETE /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 0 bytes in 782 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 10:55:25.486352 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7e3e1db4-6b82-4722-958b-0eedd7069fbc tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:25.487151 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7e3e1db4-6b82-4722-958b-0eedd7069fbc tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] [instance: b7e97718-dc14-4e93-b7b3-49a8d8e03bb9] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:25.512750 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7e3e1db4-6b82-4722-958b-0eedd7069fbc tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:25.517993 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7e3e1db4-6b82-4722-958b-0eedd7069fbc tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:25.519611 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7e3e1db4-6b82-4722-958b-0eedd7069fbc tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:25.522504 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7e3e1db4-6b82-4722-958b-0eedd7069fbc tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:25.526581 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7e3e1db4-6b82-4722-958b-0eedd7069fbc tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:25.527464 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7e3e1db4-6b82-4722-958b-0eedd7069fbc tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:25.608881 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1ca67a5f-4613-4ea2-b666-8e2728b08d23 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89f6def8f54778b80b315f2eb0c9b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da8b15686cd4d688a48e857fb16e4cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:25.634364 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1ca67a5f-4613-4ea2-b666-8e2728b08d23 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] 10.222.0.27 "GET /compute/v2.1/servers/b8edf980-3cac-4b70-bbf2-bad0e4681366" status: 200 len: 1283 microversion: 2.1 time: 0.234587 Sep 08 10:55:25.635538 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1917/3876] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:25 2022] GET /compute/v2.1/servers/b8edf980-3cac-4b70-bbf2-bad0e4681366 => generated 1283 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:25.668387 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-478ea4a3-1a0b-431b-a880-494acc090207 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:25.669827 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-478ea4a3-1a0b-431b-a880-494acc090207 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:25.695998 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-478ea4a3-1a0b-431b-a880-494acc090207 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:25.696870 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-478ea4a3-1a0b-431b-a880-494acc090207 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:25.697821 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-478ea4a3-1a0b-431b-a880-494acc090207 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:25.699091 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-478ea4a3-1a0b-431b-a880-494acc090207 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:25.699927 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-478ea4a3-1a0b-431b-a880-494acc090207 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:25.701147 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-478ea4a3-1a0b-431b-a880-494acc090207 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:25.881405 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7e3e1db4-6b82-4722-958b-0eedd7069fbc tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1bec228c17647bba62ba7d57d28e4ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0958700fa94b42b2b6b47af40cf2f679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:25.893349 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7e3e1db4-6b82-4722-958b-0eedd7069fbc tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "GET /compute/v2.1/servers/b7e97718-dc14-4e93-b7b3-49a8d8e03bb9" status: 200 len: 1575 microversion: 2.1 time: 0.426634 Sep 08 10:55:25.906169 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1960/3877] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:25 2022] GET /compute/v2.1/servers/b7e97718-dc14-4e93-b7b3-49a8d8e03bb9 => generated 1575 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:25.941692 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e10f160d-7953-457d-a07e-822f17d136a7 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:25.944650 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e10f160d-7953-457d-a07e-822f17d136a7 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:25.973813 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e10f160d-7953-457d-a07e-822f17d136a7 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:25.974701 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e10f160d-7953-457d-a07e-822f17d136a7 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:25.975539 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e10f160d-7953-457d-a07e-822f17d136a7 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:25.976862 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e10f160d-7953-457d-a07e-822f17d136a7 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:25.977798 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e10f160d-7953-457d-a07e-822f17d136a7 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:25.978572 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e10f160d-7953-457d-a07e-822f17d136a7 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:26.742356 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e10f160d-7953-457d-a07e-822f17d136a7 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:26.777558 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e10f160d-7953-457d-a07e-822f17d136a7 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:26.784581 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e10f160d-7953-457d-a07e-822f17d136a7 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:26.790711 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e10f160d-7953-457d-a07e-822f17d136a7 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 200 len: 2954 microversion: 2.32 time: 0.877466 Sep 08 10:55:26.798351 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1961/3878] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:55:25 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 2954 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:55:26.809471 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-28ffec6b-2cfa-49b0-a955-3a7c2567a1f6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:26.810565 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-28ffec6b-2cfa-49b0-a955-3a7c2567a1f6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 379a5e3e-0e59-4b53-a37e-f4e9d1000eaf] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:26.831258 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-28ffec6b-2cfa-49b0-a955-3a7c2567a1f6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:26.832075 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-28ffec6b-2cfa-49b0-a955-3a7c2567a1f6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:26.842032 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-28ffec6b-2cfa-49b0-a955-3a7c2567a1f6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:26.843458 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-28ffec6b-2cfa-49b0-a955-3a7c2567a1f6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:26.847401 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-28ffec6b-2cfa-49b0-a955-3a7c2567a1f6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:26.847401 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-28ffec6b-2cfa-49b0-a955-3a7c2567a1f6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:26.850394 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-478ea4a3-1a0b-431b-a880-494acc090207 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:26.873907 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-478ea4a3-1a0b-431b-a880-494acc090207 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 1.222297 Sep 08 10:55:26.875009 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1918/3879] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:25 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:26.889163 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-df64e962-5f2b-4e47-8451-e4b05d49f2c7 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:26.890823 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-df64e962-5f2b-4e47-8451-e4b05d49f2c7 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] [instance: b8edf980-3cac-4b70-bbf2-bad0e4681366] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:26.922274 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df64e962-5f2b-4e47-8451-e4b05d49f2c7 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:26.923326 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df64e962-5f2b-4e47-8451-e4b05d49f2c7 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:26.923774 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df64e962-5f2b-4e47-8451-e4b05d49f2c7 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:26.924600 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df64e962-5f2b-4e47-8451-e4b05d49f2c7 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:26.925168 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df64e962-5f2b-4e47-8451-e4b05d49f2c7 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:26.925512 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df64e962-5f2b-4e47-8451-e4b05d49f2c7 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:27.169964 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-28ffec6b-2cfa-49b0-a955-3a7c2567a1f6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:27.183532 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-28ffec6b-2cfa-49b0-a955-3a7c2567a1f6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/379a5e3e-0e59-4b53-a37e-f4e9d1000eaf" status: 200 len: 1314 microversion: 2.1 time: 0.383370 Sep 08 10:55:27.184743 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1962/3880] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:26 2022] GET /compute/v2.1/servers/379a5e3e-0e59-4b53-a37e-f4e9d1000eaf => generated 1314 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:27.191699 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-778c5478-5d94-456e-bb65-5a9ab2eb7641 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:27.192579 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-778c5478-5d94-456e-bb65-5a9ab2eb7641 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:27.201261 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-778c5478-5d94-456e-bb65-5a9ab2eb7641 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:27.201992 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-778c5478-5d94-456e-bb65-5a9ab2eb7641 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:27.202600 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-778c5478-5d94-456e-bb65-5a9ab2eb7641 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:27.203460 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-778c5478-5d94-456e-bb65-5a9ab2eb7641 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:27.204285 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-778c5478-5d94-456e-bb65-5a9ab2eb7641 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:27.218061 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-778c5478-5d94-456e-bb65-5a9ab2eb7641 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:27.259087 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-df64e962-5f2b-4e47-8451-e4b05d49f2c7 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89f6def8f54778b80b315f2eb0c9b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da8b15686cd4d688a48e857fb16e4cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:27.287300 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-df64e962-5f2b-4e47-8451-e4b05d49f2c7 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] 10.222.0.27 "GET /compute/v2.1/servers/b8edf980-3cac-4b70-bbf2-bad0e4681366" status: 200 len: 1283 microversion: 2.1 time: 0.404570 Sep 08 10:55:27.288876 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1919/3881] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:26 2022] GET /compute/v2.1/servers/b8edf980-3cac-4b70-bbf2-bad0e4681366 => generated 1283 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:27.307925 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d4b7c427-d53e-49cb-947f-e2caee0c635e tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:27.309047 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d4b7c427-d53e-49cb-947f-e2caee0c635e tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] [instance: b7e97718-dc14-4e93-b7b3-49a8d8e03bb9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:27.319987 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d4b7c427-d53e-49cb-947f-e2caee0c635e tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:27.321271 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d4b7c427-d53e-49cb-947f-e2caee0c635e tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:27.322164 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d4b7c427-d53e-49cb-947f-e2caee0c635e tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:27.323498 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d4b7c427-d53e-49cb-947f-e2caee0c635e tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:27.324424 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d4b7c427-d53e-49cb-947f-e2caee0c635e tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:27.325325 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d4b7c427-d53e-49cb-947f-e2caee0c635e tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:27.571962 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-778c5478-5d94-456e-bb65-5a9ab2eb7641 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:27.586354 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-778c5478-5d94-456e-bb65-5a9ab2eb7641 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 0.400156 Sep 08 10:55:27.588222 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1963/3882] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:27 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:27.621240 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a658a2e5-f584-4811-986b-54be710a2b06 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:27.621934 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a658a2e5-f584-4811-986b-54be710a2b06 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: bace4c1a-2c38-42b3-962d-ca87a3bfb7ba] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:27.630118 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a658a2e5-f584-4811-986b-54be710a2b06 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:27.630623 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a658a2e5-f584-4811-986b-54be710a2b06 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:27.631113 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a658a2e5-f584-4811-986b-54be710a2b06 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:27.631823 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a658a2e5-f584-4811-986b-54be710a2b06 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:27.632282 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a658a2e5-f584-4811-986b-54be710a2b06 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:27.632708 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a658a2e5-f584-4811-986b-54be710a2b06 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:27.655258 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-a658a2e5-f584-4811-986b-54be710a2b06 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] HTTP exception thrown: Instance bace4c1a-2c38-42b3-962d-ca87a3bfb7ba could not be found. Sep 08 10:55:27.661316 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a658a2e5-f584-4811-986b-54be710a2b06 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Request method failure captured: Sep 08 10:55:27.661316 n-d-850501-12 devstack@n-api.service[128861]: request: DELETE /compute/v2.1/servers/bace4c1a-2c38-42b3-962d-ca87a3bfb7ba HTTP/1.1 Sep 08 10:55:27.661316 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:55:27.661316 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:55:27.661316 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:55:27.661316 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:55:27.661316 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:55:27.661316 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:55:27.661316 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:55:27.661316 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:55:27.661316 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcf85nxlXglNpNUDafAex8bEd4FqCO21NTPeXDX2uUnTAK4RtQmB0Zln5OyfaDsL03XE7NxjFWJINQM-4CVmZPvJMmjswkfAMS-LTodBU21IQa_AJm8NdfZKIu9JkoC4h7calajGQneT5j1jgUkjySqAUeFvWcq2xoj6sNreqExg8K8 Sep 08 10:55:27.661316 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:55:27.661316 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:55:27.661316 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:55:27.661316 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:55:27.661316 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:55:27.661316 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:55:27.661316 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 20f9a24cad014d7f827e8f3236dd5bae Sep 08 10:55:27.661316 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-AttachVolumeNegativeTest-20693983 Sep 08 10:55:27.661316 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:55:27.661316 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:55:27.661316 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/20f9a24cad014d7f827e8f3236dd5bae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/20f9a24cad014d7f827e8f3236dd5bae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_20f9a24cad014d7f827e8f3236dd5bae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/20f9a24cad014d7f827e8f3236dd5bae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:55:27.661316 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-AttachVolumeNegativeTest-20693983 Sep 08 10:55:27.661316 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 20f9a24cad014d7f827e8f3236dd5bae Sep 08 10:55:27.661316 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-20693983 Sep 08 10:55:27.661316 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-AttachVolumeNegativeTest-20693983-project Sep 08 10:55:27.661316 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:55:27.661316 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:55:27.661316 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 5c291cbe955b4ee5abc98132dda0255e Sep 08 10:55:27.661316 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-AttachVolumeNegativeTest-20693983-project Sep 08 10:55:27.661316 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:55:27.661316 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance bace4c1a-2c38-42b3-962d-ca87a3bfb7ba could not be found. Sep 08 10:55:27.661316 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': 'bace4c1a-2c38-42b3-962d-ca87a3bfb7ba'} Sep 08 10:55:27.661316 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:55:27.661316 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:27.661316 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:55:27.661316 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:55:27.661316 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:55:27.661316 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:55:27.661316 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:55:27.661316 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:55:27.661316 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:55:27.661316 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:55:27.661316 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bace4c1a-2c38-42b3-962d-ca87a3bfb7ba could not be found. Sep 08 10:55:27.661316 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:27.661316 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:27.661316 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:27.661316 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:27.661316 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:55:27.661316 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:55:27.661316 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:55:27.661316 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:55:27.661316 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:55:27.661316 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:55:27.661316 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:55:27.661316 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:55:27.661316 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:55:27.661316 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:55:27.661316 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:55:27.661316 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:55:27.661316 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:55:27.661316 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:55:27.669211 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bace4c1a-2c38-42b3-962d-ca87a3bfb7ba could not be found. Sep 08 10:55:27.669211 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:27.669211 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:27.669211 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:27.669211 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:27.669211 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:55:27.669211 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:55:27.669211 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:55:27.669211 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:55:27.669211 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bace4c1a-2c38-42b3-962d-ca87a3bfb7ba could not be found. Sep 08 10:55:27.669211 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:27.669211 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a658a2e5-f584-4811-986b-54be710a2b06 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Returning 404 to user: Instance bace4c1a-2c38-42b3-962d-ca87a3bfb7ba could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:55:27.669211 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a658a2e5-f584-4811-986b-54be710a2b06 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "DELETE /compute/v2.1/servers/bace4c1a-2c38-42b3-962d-ca87a3bfb7ba" status: 404 len: 111 microversion: 2.1 time: 0.064570 Sep 08 10:55:27.676076 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1964/3883] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:55:27 2022] DELETE /compute/v2.1/servers/bace4c1a-2c38-42b3-962d-ca87a3bfb7ba => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:55:27.691396 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fed31d3b-a4a8-41c2-b38c-6b17a8840479 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:27.692178 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fed31d3b-a4a8-41c2-b38c-6b17a8840479 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] [instance: bace4c1a-2c38-42b3-962d-ca87a3bfb7ba] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:27.711569 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fed31d3b-a4a8-41c2-b38c-6b17a8840479 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:27.712090 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fed31d3b-a4a8-41c2-b38c-6b17a8840479 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:27.712574 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fed31d3b-a4a8-41c2-b38c-6b17a8840479 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:27.713301 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fed31d3b-a4a8-41c2-b38c-6b17a8840479 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:27.713764 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fed31d3b-a4a8-41c2-b38c-6b17a8840479 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:27.714188 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fed31d3b-a4a8-41c2-b38c-6b17a8840479 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:27.752872 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-fed31d3b-a4a8-41c2-b38c-6b17a8840479 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] HTTP exception thrown: Instance bace4c1a-2c38-42b3-962d-ca87a3bfb7ba could not be found. Sep 08 10:55:27.754466 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fed31d3b-a4a8-41c2-b38c-6b17a8840479 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Request method failure captured: Sep 08 10:55:27.754466 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/bace4c1a-2c38-42b3-962d-ca87a3bfb7ba HTTP/1.1 Sep 08 10:55:27.754466 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:55:27.754466 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:55:27.754466 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:55:27.754466 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:55:27.754466 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:55:27.754466 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:55:27.754466 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:55:27.754466 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:55:27.754466 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcf85nxlXglNpNUDafAex8bEd4FqCO21NTPeXDX2uUnTAK4RtQmB0Zln5OyfaDsL03XE7NxjFWJINQM-4CVmZPvJMmjswkfAMS-LTodBU21IQa_AJm8NdfZKIu9JkoC4h7calajGQneT5j1jgUkjySqAUeFvWcq2xoj6sNreqExg8K8 Sep 08 10:55:27.754466 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:55:27.754466 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:55:27.754466 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:55:27.754466 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:55:27.754466 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:55:27.754466 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:55:27.754466 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 20f9a24cad014d7f827e8f3236dd5bae Sep 08 10:55:27.754466 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-AttachVolumeNegativeTest-20693983 Sep 08 10:55:27.754466 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:55:27.754466 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:55:27.754466 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/20f9a24cad014d7f827e8f3236dd5bae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/20f9a24cad014d7f827e8f3236dd5bae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_20f9a24cad014d7f827e8f3236dd5bae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/20f9a24cad014d7f827e8f3236dd5bae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:55:27.754466 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-AttachVolumeNegativeTest-20693983 Sep 08 10:55:27.754466 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 20f9a24cad014d7f827e8f3236dd5bae Sep 08 10:55:27.754466 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-20693983 Sep 08 10:55:27.754466 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-AttachVolumeNegativeTest-20693983-project Sep 08 10:55:27.754466 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:55:27.754466 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:55:27.754466 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 5c291cbe955b4ee5abc98132dda0255e Sep 08 10:55:27.754466 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-AttachVolumeNegativeTest-20693983-project Sep 08 10:55:27.754466 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:55:27.754466 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance bace4c1a-2c38-42b3-962d-ca87a3bfb7ba could not be found. Sep 08 10:55:27.754466 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': 'bace4c1a-2c38-42b3-962d-ca87a3bfb7ba'} Sep 08 10:55:27.754466 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:55:27.754466 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:27.754466 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:55:27.754466 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:55:27.754466 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:55:27.754466 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:55:27.754466 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:55:27.754466 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:55:27.754466 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:55:27.754466 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:55:27.754466 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bace4c1a-2c38-42b3-962d-ca87a3bfb7ba could not be found. Sep 08 10:55:27.754466 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:27.754466 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:27.754466 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:27.754466 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:27.754466 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:55:27.754466 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:55:27.754466 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:55:27.754466 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:55:27.754466 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:55:27.754466 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:55:27.754466 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:55:27.754466 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:55:27.754466 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:55:27.754466 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:55:27.754466 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:55:27.754466 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:55:27.754466 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bace4c1a-2c38-42b3-962d-ca87a3bfb7ba could not be found. Sep 08 10:55:27.754466 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:27.754466 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:27.754466 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:27.759453 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:27.759453 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:55:27.759453 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:55:27.759453 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:55:27.759453 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:55:27.759453 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bace4c1a-2c38-42b3-962d-ca87a3bfb7ba could not be found. Sep 08 10:55:27.759453 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:27.759453 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fed31d3b-a4a8-41c2-b38c-6b17a8840479 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] Returning 404 to user: Instance bace4c1a-2c38-42b3-962d-ca87a3bfb7ba could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:55:27.759453 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fed31d3b-a4a8-41c2-b38c-6b17a8840479 tempest-AttachVolumeNegativeTest-20693983 tempest-AttachVolumeNegativeTest-20693983-project] 10.222.0.27 "GET /compute/v2.1/servers/bace4c1a-2c38-42b3-962d-ca87a3bfb7ba" status: 404 len: 111 microversion: 2.1 time: 0.078140 Sep 08 10:55:27.759453 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1965/3884] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:27 2022] GET /compute/v2.1/servers/bace4c1a-2c38-42b3-962d-ca87a3bfb7ba => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:55:27.856884 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-68586024-c246-446a-b0ca-4e6b224d5257 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:27.857795 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-68586024-c246-446a-b0ca-4e6b224d5257 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:27.872122 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-68586024-c246-446a-b0ca-4e6b224d5257 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:27.872871 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-68586024-c246-446a-b0ca-4e6b224d5257 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:27.874018 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-68586024-c246-446a-b0ca-4e6b224d5257 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:27.879169 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-68586024-c246-446a-b0ca-4e6b224d5257 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:27.880008 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-68586024-c246-446a-b0ca-4e6b224d5257 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:27.880672 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-68586024-c246-446a-b0ca-4e6b224d5257 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:27.912348 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:55:28.041986 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d4b7c427-d53e-49cb-947f-e2caee0c635e tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1bec228c17647bba62ba7d57d28e4ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0958700fa94b42b2b6b47af40cf2f679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:28.087672 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d4b7c427-d53e-49cb-947f-e2caee0c635e tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "GET /compute/v2.1/servers/b7e97718-dc14-4e93-b7b3-49a8d8e03bb9" status: 200 len: 1575 microversion: 2.1 time: 0.795363 Sep 08 10:55:28.104234 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1920/3885] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:27 2022] GET /compute/v2.1/servers/b7e97718-dc14-4e93-b7b3-49a8d8e03bb9 => generated 1575 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:28.108925 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-92764afb-776b-40e8-b571-ca5bad1856b1 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "12aa0876-bb28-47d9-975a-2d76f1aa7c84"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:55:28.113613 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-92764afb-776b-40e8-b571-ca5bad1856b1 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Request method failure captured: Sep 08 10:55:28.113613 n-d-850501-12 devstack@n-api.service[128862]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 10:55:28.113613 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:55:28.113613 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:55:28.113613 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:55:28.113613 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 160 Sep 08 10:55:28.113613 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:55:28.113613 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:55:28.113613 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:55:28.113613 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:55:28.113613 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcmnspi0cCT_Ts_s7jcB6HjtEcdULbQPd_krJniB9lBsXpm1cXSOD-YMaJoaapHCxuCXz0q6Qe4WXufr5At6SSPw8ov8Oz1eUk-fSNbVp7WlOPycfCf5I6xwH7tfbsoefVfbTiDOfU9mTBl0Vs74qdfTniErHfQlEG4cAvAQl1-wMrs Sep 08 10:55:28.113613 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:55:28.113613 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:55:28.113613 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:55:28.113613 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:55:28.113613 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:55:28.113613 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:55:28.113613 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:55:28.113613 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:55:28.113613 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:55:28.113613 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:55:28.113613 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:55:28.113613 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:55:28.113613 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:55:28.113613 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:55:28.113613 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:55:28.113613 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:55:28.113613 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:55:28.113613 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 7f551e6fe34243c290a25b57ab26af19 Sep 08 10:55:28.113613 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:55:28.113613 n-d-850501-12 devstack@n-api.service[128862]: Sep 08 10:55:28.113613 n-d-850501-12 devstack@n-api.service[128862]: {"server": {"name": "", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "12aa0876-bb28-47d9-975a-2d76f1aa7c84"}]}} Sep 08 10:55:28.113613 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:55:28.113613 n-d-850501-12 devstack@n-api.service[128862]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 08 10:55:28.113613 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'body': {'server': {'name': '', 'imageRef': '503f4a0f-e18f-47fd-ad12-0289e3463117', 'flavorRef': '452', 'networks': [{'uuid': '12aa0876-bb28-47d9-975a-2d76f1aa7c84'}]}}} Sep 08 10:55:28.113613 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:55:28.113613 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:28.113613 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 10:55:28.113613 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 10:55:28.113613 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 10:55:28.113613 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise error Sep 08 10:55:28.113613 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 08 10:55:28.113613 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:28.113613 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Sep 08 10:55:28.113613 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 08 10:55:28.113613 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:28.113613 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 08 10:55:28.113613 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi '' Sep 08 10:55:28.113613 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:28.113613 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:28.113613 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:28.113613 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:28.113613 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:55:28.113613 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:55:28.113613 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:55:28.113613 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:55:28.113613 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:55:28.113613 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:55:28.113613 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:55:28.113613 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:55:28.113613 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 10:55:28.113613 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 10:55:28.113613 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 10:55:28.113613 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 10:55:28.113613 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 10:55:28.118521 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 10:55:28.118521 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 08 10:55:28.118521 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:28.118521 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:28.118521 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:28.118521 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:28.118521 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:55:28.118521 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:55:28.118521 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 10:55:28.118521 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 10:55:28.118521 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 08 10:55:28.118521 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:28.118521 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-92764afb-776b-40e8-b571-ca5bad1856b1 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:55:28.118521 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-92764afb-776b-40e8-b571-ca5bad1856b1 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.024288 Sep 08 10:55:28.121546 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1921/3886] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:55:28 2022] POST /compute/v2.1/servers => generated 108 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:55:28.134988 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4bfcc5d9-9a84-4e1b-9d30-1987546d028c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:28.135814 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4bfcc5d9-9a84-4e1b-9d30-1987546d028c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:28.152650 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4bfcc5d9-9a84-4e1b-9d30-1987546d028c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:28.163486 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4bfcc5d9-9a84-4e1b-9d30-1987546d028c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:28.164069 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4bfcc5d9-9a84-4e1b-9d30-1987546d028c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:28.164938 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4bfcc5d9-9a84-4e1b-9d30-1987546d028c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:28.165462 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4bfcc5d9-9a84-4e1b-9d30-1987546d028c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:28.165943 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4bfcc5d9-9a84-4e1b-9d30-1987546d028c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:28.694902 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-68586024-c246-446a-b0ca-4e6b224d5257 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:28.707517 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-68586024-c246-446a-b0ca-4e6b224d5257 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:28.709568 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-68586024-c246-446a-b0ca-4e6b224d5257 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:28.711312 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-68586024-c246-446a-b0ca-4e6b224d5257 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 200 len: 2954 microversion: 2.32 time: 0.859472 Sep 08 10:55:28.712564 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1966/3887] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:55:27 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 2954 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:55:28.720177 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3d9224af-c49b-40de-a275-bccf4e0bd437 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:28.725796 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3d9224af-c49b-40de-a275-bccf4e0bd437 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 379a5e3e-0e59-4b53-a37e-f4e9d1000eaf] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:28.737663 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3d9224af-c49b-40de-a275-bccf4e0bd437 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:28.740598 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3d9224af-c49b-40de-a275-bccf4e0bd437 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:28.741415 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3d9224af-c49b-40de-a275-bccf4e0bd437 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:28.742408 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3d9224af-c49b-40de-a275-bccf4e0bd437 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:28.744905 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3d9224af-c49b-40de-a275-bccf4e0bd437 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:28.745751 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3d9224af-c49b-40de-a275-bccf4e0bd437 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:29.206515 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4bfcc5d9-9a84-4e1b-9d30-1987546d028c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:29.227441 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4bfcc5d9-9a84-4e1b-9d30-1987546d028c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 1.100853 Sep 08 10:55:29.240962 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1922/3888] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:28 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:55:29.246545 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-32ddb232-1b9a-4b61-bfcf-621925f2ebc4 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:29.247293 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-32ddb232-1b9a-4b61-bfcf-621925f2ebc4 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] [instance: b8edf980-3cac-4b70-bbf2-bad0e4681366] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:29.261795 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-32ddb232-1b9a-4b61-bfcf-621925f2ebc4 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:29.263241 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-32ddb232-1b9a-4b61-bfcf-621925f2ebc4 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:29.267489 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-32ddb232-1b9a-4b61-bfcf-621925f2ebc4 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:29.268545 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-32ddb232-1b9a-4b61-bfcf-621925f2ebc4 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:29.269229 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-32ddb232-1b9a-4b61-bfcf-621925f2ebc4 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:29.269791 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-32ddb232-1b9a-4b61-bfcf-621925f2ebc4 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:29.324750 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-3d9224af-c49b-40de-a275-bccf4e0bd437 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:29.340564 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3d9224af-c49b-40de-a275-bccf4e0bd437 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/379a5e3e-0e59-4b53-a37e-f4e9d1000eaf" status: 200 len: 1314 microversion: 2.1 time: 0.622330 Sep 08 10:55:29.342849 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1967/3889] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:28 2022] GET /compute/v2.1/servers/379a5e3e-0e59-4b53-a37e-f4e9d1000eaf => generated 1314 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:29.365199 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-41e71159-902b-4ff0-8b07-62c8f428183f req-185f4f3e-b02b-4430-9b6a-4f66b94030fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "379a5e3e-0e59-4b53-a37e-f4e9d1000eaf", "tag": "2e460d9c-8d3b-48a3-86c2-1bf47c800c37"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:55:29.389812 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-41e71159-902b-4ff0-8b07-62c8f428183f req-185f4f3e-b02b-4430-9b6a-4f66b94030fd service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:29.390577 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-41e71159-902b-4ff0-8b07-62c8f428183f req-185f4f3e-b02b-4430-9b6a-4f66b94030fd service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:29.391915 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-41e71159-902b-4ff0-8b07-62c8f428183f req-185f4f3e-b02b-4430-9b6a-4f66b94030fd service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:29.419229 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-41e71159-902b-4ff0-8b07-62c8f428183f req-185f4f3e-b02b-4430-9b6a-4f66b94030fd service nova] Creating event network-changed:2e460d9c-8d3b-48a3-86c2-1bf47c800c37 for instance 379a5e3e-0e59-4b53-a37e-f4e9d1000eaf on n-h2-850501-12 Sep 08 10:55:29.426051 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-41e71159-902b-4ff0-8b07-62c8f428183f req-185f4f3e-b02b-4430-9b6a-4f66b94030fd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080953 Sep 08 10:55:29.426947 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1968/3890] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:55:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:55:29.433494 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-45ba9f85-d6b9-4035-9e3d-599de448c7f0 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:29.436231 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-45ba9f85-d6b9-4035-9e3d-599de448c7f0 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] [instance: b7e97718-dc14-4e93-b7b3-49a8d8e03bb9] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:29.444128 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-45ba9f85-d6b9-4035-9e3d-599de448c7f0 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:29.445002 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-45ba9f85-d6b9-4035-9e3d-599de448c7f0 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:29.446234 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-45ba9f85-d6b9-4035-9e3d-599de448c7f0 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:29.447171 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-45ba9f85-d6b9-4035-9e3d-599de448c7f0 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:29.447946 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-45ba9f85-d6b9-4035-9e3d-599de448c7f0 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:29.448664 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-45ba9f85-d6b9-4035-9e3d-599de448c7f0 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:30.164593 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-45ba9f85-d6b9-4035-9e3d-599de448c7f0 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1bec228c17647bba62ba7d57d28e4ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0958700fa94b42b2b6b47af40cf2f679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:30.178223 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-45ba9f85-d6b9-4035-9e3d-599de448c7f0 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "GET /compute/v2.1/servers/b7e97718-dc14-4e93-b7b3-49a8d8e03bb9" status: 200 len: 1573 microversion: 2.1 time: 0.749463 Sep 08 10:55:30.193649 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1969/3891] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:29 2022] GET /compute/v2.1/servers/b7e97718-dc14-4e93-b7b3-49a8d8e03bb9 => generated 1573 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:30.206152 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9d9582f3-4453-4d30-b71f-53d83e44c447 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:30.214529 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9d9582f3-4453-4d30-b71f-53d83e44c447 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:30.223229 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9d9582f3-4453-4d30-b71f-53d83e44c447 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:30.224988 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9d9582f3-4453-4d30-b71f-53d83e44c447 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:30.229675 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9d9582f3-4453-4d30-b71f-53d83e44c447 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:30.230647 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9d9582f3-4453-4d30-b71f-53d83e44c447 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:30.231286 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9d9582f3-4453-4d30-b71f-53d83e44c447 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:30.231915 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9d9582f3-4453-4d30-b71f-53d83e44c447 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:30.566945 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-32ddb232-1b9a-4b61-bfcf-621925f2ebc4 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89f6def8f54778b80b315f2eb0c9b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da8b15686cd4d688a48e857fb16e4cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:30.624828 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9d9582f3-4453-4d30-b71f-53d83e44c447 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:30.648171 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-32ddb232-1b9a-4b61-bfcf-621925f2ebc4 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] 10.222.0.27 "GET /compute/v2.1/servers/b8edf980-3cac-4b70-bbf2-bad0e4681366" status: 200 len: 1325 microversion: 2.1 time: 1.405583 Sep 08 10:55:30.649738 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9d9582f3-4453-4d30-b71f-53d83e44c447 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 0.454540 Sep 08 10:55:30.649964 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1923/3892] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:29 2022] GET /compute/v2.1/servers/b8edf980-3cac-4b70-bbf2-bad0e4681366 => generated 1325 bytes in 1408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:30.651101 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1970/3893] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:30 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:30.662485 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bcc8b45b-3f71-4e49-88ff-6e1b8b16cdf3 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2025358095"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:55:30.663353 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bcc8b45b-3f71-4e49-88ff-6e1b8b16cdf3 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] [instance: b7e97718-dc14-4e93-b7b3-49a8d8e03bb9] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:30.671254 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ba63809d-adbd-41dc-a2de-6c69406ccaef tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:30.672117 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ba63809d-adbd-41dc-a2de-6c69406ccaef tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:30.686750 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bcc8b45b-3f71-4e49-88ff-6e1b8b16cdf3 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:30.687688 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bcc8b45b-3f71-4e49-88ff-6e1b8b16cdf3 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:30.688549 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bcc8b45b-3f71-4e49-88ff-6e1b8b16cdf3 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:30.692467 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba63809d-adbd-41dc-a2de-6c69406ccaef tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:30.693442 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bcc8b45b-3f71-4e49-88ff-6e1b8b16cdf3 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:30.693675 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba63809d-adbd-41dc-a2de-6c69406ccaef tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:30.694250 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bcc8b45b-3f71-4e49-88ff-6e1b8b16cdf3 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:30.694579 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba63809d-adbd-41dc-a2de-6c69406ccaef tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:30.694984 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bcc8b45b-3f71-4e49-88ff-6e1b8b16cdf3 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:30.695982 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba63809d-adbd-41dc-a2de-6c69406ccaef tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:30.696818 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba63809d-adbd-41dc-a2de-6c69406ccaef tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:30.697280 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba63809d-adbd-41dc-a2de-6c69406ccaef tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:30.892345 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.network.security_group_api [None req-bcc8b45b-3f71-4e49-88ff-6e1b8b16cdf3 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Adding security group 6f3b2b1f-362f-4566-a774-9c795703ef36 to port e2153ee7-b11d-41b7-b5fb-82f06d8cb9d0 Sep 08 10:55:31.323059 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:55:31.380391 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:55:31.422861 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bcc8b45b-3f71-4e49-88ff-6e1b8b16cdf3 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "POST /compute/v2.1/servers/b7e97718-dc14-4e93-b7b3-49a8d8e03bb9/action" status: 202 len: 0 microversion: 2.1 time: 0.769779 Sep 08 10:55:31.424083 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1971/3894] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:55:30 2022] POST /compute/v2.1/servers/b7e97718-dc14-4e93-b7b3-49a8d8e03bb9/action => generated 0 bytes in 772 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:55:31.432573 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e90e04bf-5a35-4fbf-8b55-1438c7508e95 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:31.433344 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e90e04bf-5a35-4fbf-8b55-1438c7508e95 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 379a5e3e-0e59-4b53-a37e-f4e9d1000eaf] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:31.442432 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e90e04bf-5a35-4fbf-8b55-1438c7508e95 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:31.443415 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e90e04bf-5a35-4fbf-8b55-1438c7508e95 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:31.444224 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e90e04bf-5a35-4fbf-8b55-1438c7508e95 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:31.453958 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e90e04bf-5a35-4fbf-8b55-1438c7508e95 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:31.456461 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e90e04bf-5a35-4fbf-8b55-1438c7508e95 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:31.456849 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e90e04bf-5a35-4fbf-8b55-1438c7508e95 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:31.770610 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ba63809d-adbd-41dc-a2de-6c69406ccaef tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:31.784544 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ba63809d-adbd-41dc-a2de-6c69406ccaef tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:31.788152 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ba63809d-adbd-41dc-a2de-6c69406ccaef tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:31.789821 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ba63809d-adbd-41dc-a2de-6c69406ccaef tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 200 len: 2954 microversion: 2.32 time: 1.138631 Sep 08 10:55:31.790968 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1924/3895] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:55:30 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 2954 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:55:31.810477 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dbf28f5d-4d99-44b1-8d1f-d2c43a9ffac3 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:55:31.811292 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-dbf28f5d-4d99-44b1-8d1f-d2c43a9ffac3 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 086f7893-ee9b-49ea-b37d-ddcaee28e4d2] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:31.821829 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-dbf28f5d-4d99-44b1-8d1f-d2c43a9ffac3 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] HTTP exception thrown: Instance 086f7893-ee9b-49ea-b37d-ddcaee28e4d2 could not be found. Sep 08 10:55:31.836239 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dbf28f5d-4d99-44b1-8d1f-d2c43a9ffac3 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Request method failure captured: Sep 08 10:55:31.836239 n-d-850501-12 devstack@n-api.service[128862]: request: POST /compute/v2.1/servers/086f7893-ee9b-49ea-b37d-ddcaee28e4d2/action HTTP/1.1 Sep 08 10:55:31.836239 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:55:31.836239 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:55:31.836239 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:55:31.836239 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 14 Sep 08 10:55:31.836239 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:55:31.836239 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:55:31.836239 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:55:31.836239 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:55:31.836239 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcmnspi0cCT_Ts_s7jcB6HjtEcdULbQPd_krJniB9lBsXpm1cXSOD-YMaJoaapHCxuCXz0q6Qe4WXufr5At6SSPw8ov8Oz1eUk-fSNbVp7WlOPycfCf5I6xwH7tfbsoefVfbTiDOfU9mTBl0Vs74qdfTniErHfQlEG4cAvAQl1-wMrs Sep 08 10:55:31.836239 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:55:31.836239 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:55:31.836239 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:55:31.836239 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:55:31.836239 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:55:31.836239 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:55:31.836239 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:55:31.836239 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:55:31.836239 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:55:31.836239 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:55:31.836239 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:55:31.836239 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:55:31.836239 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:55:31.836239 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:55:31.836239 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:55:31.836239 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:55:31.836239 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:55:31.836239 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 7f551e6fe34243c290a25b57ab26af19 Sep 08 10:55:31.836239 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:55:31.836239 n-d-850501-12 devstack@n-api.service[128862]: Sep 08 10:55:31.836239 n-d-850501-12 devstack@n-api.service[128862]: {"shelve": {}} Sep 08 10:55:31.836239 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:55:31.836239 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 086f7893-ee9b-49ea-b37d-ddcaee28e4d2 could not be found. Sep 08 10:55:31.836239 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '086f7893-ee9b-49ea-b37d-ddcaee28e4d2', 'body': {'shelve': {}}} Sep 08 10:55:31.836239 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:55:31.836239 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:31.836239 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:55:31.836239 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:55:31.836239 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:55:31.836239 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:55:31.836239 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 08 10:55:31.836239 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 08 10:55:31.836239 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 086f7893-ee9b-49ea-b37d-ddcaee28e4d2 could not be found. Sep 08 10:55:31.836239 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:31.836239 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:31.836239 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:31.836239 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:31.836239 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:55:31.836239 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:55:31.836239 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:55:31.836239 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:55:31.836239 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:55:31.836239 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:55:31.836239 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Sep 08 10:55:31.836239 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 08 10:55:31.836239 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:55:31.836239 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:55:31.836239 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 086f7893-ee9b-49ea-b37d-ddcaee28e4d2 could not be found. Sep 08 10:55:31.836239 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:31.836239 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:31.836239 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:31.836239 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:31.836239 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:55:31.836239 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:55:31.843404 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:55:31.843404 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:55:31.843404 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 086f7893-ee9b-49ea-b37d-ddcaee28e4d2 could not be found. Sep 08 10:55:31.843404 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:31.846249 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dbf28f5d-4d99-44b1-8d1f-d2c43a9ffac3 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Returning 404 to user: Instance 086f7893-ee9b-49ea-b37d-ddcaee28e4d2 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:55:31.847312 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-dbf28f5d-4d99-44b1-8d1f-d2c43a9ffac3 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "POST /compute/v2.1/servers/086f7893-ee9b-49ea-b37d-ddcaee28e4d2/action" status: 404 len: 111 microversion: 2.1 time: 0.054987 Sep 08 10:55:31.848070 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1925/3896] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:55:31 2022] POST /compute/v2.1/servers/086f7893-ee9b-49ea-b37d-ddcaee28e4d2/action => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:55:31.848509 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e90e04bf-5a35-4fbf-8b55-1438c7508e95 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:31.856053 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-80f19498-5b0e-421f-8411-e25694c99913 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Calling method '.version_select at 0x7f68e8b864c0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:31.864473 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e90e04bf-5a35-4fbf-8b55-1438c7508e95 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/379a5e3e-0e59-4b53-a37e-f4e9d1000eaf" status: 200 len: 1314 microversion: 2.1 time: 0.438242 Sep 08 10:55:31.865084 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1972/3897] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:31 2022] GET /compute/v2.1/servers/379a5e3e-0e59-4b53-a37e-f4e9d1000eaf => generated 1314 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:31.877998 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-5b9e85b5-09df-4327-b50d-82ff81e6d9a2 req-e33c67aa-237b-4c5a-a3bf-cfe7e5df96f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7e97718-dc14-4e93-b7b3-49a8d8e03bb9", "tag": "e2153ee7-b11d-41b7-b5fb-82f06d8cb9d0"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:55:31.911198 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-5b9e85b5-09df-4327-b50d-82ff81e6d9a2 req-e33c67aa-237b-4c5a-a3bf-cfe7e5df96f0 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:31.911705 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-5b9e85b5-09df-4327-b50d-82ff81e6d9a2 req-e33c67aa-237b-4c5a-a3bf-cfe7e5df96f0 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:31.912141 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-5b9e85b5-09df-4327-b50d-82ff81e6d9a2 req-e33c67aa-237b-4c5a-a3bf-cfe7e5df96f0 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:31.935300 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-5b9e85b5-09df-4327-b50d-82ff81e6d9a2 req-e33c67aa-237b-4c5a-a3bf-cfe7e5df96f0 service nova] Creating event network-changed:e2153ee7-b11d-41b7-b5fb-82f06d8cb9d0 for instance b7e97718-dc14-4e93-b7b3-49a8d8e03bb9 on n-h1-850501-12 Sep 08 10:55:31.941175 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-5b9e85b5-09df-4327-b50d-82ff81e6d9a2 req-e33c67aa-237b-4c5a-a3bf-cfe7e5df96f0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074388 Sep 08 10:55:31.942394 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1973/3898] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:55:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:55:31.948359 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0ce7a8fe-d1f0-40b1-bfa2-25eab59866dc tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:31.949388 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0ce7a8fe-d1f0-40b1-bfa2-25eab59866dc tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] [instance: b8edf980-3cac-4b70-bbf2-bad0e4681366] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:31.973998 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=8 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:55:31.977546 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0ce7a8fe-d1f0-40b1-bfa2-25eab59866dc tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:31.979030 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0ce7a8fe-d1f0-40b1-bfa2-25eab59866dc tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:31.979825 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0ce7a8fe-d1f0-40b1-bfa2-25eab59866dc tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:31.980836 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0ce7a8fe-d1f0-40b1-bfa2-25eab59866dc tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:31.981551 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0ce7a8fe-d1f0-40b1-bfa2-25eab59866dc tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:31.982231 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0ce7a8fe-d1f0-40b1-bfa2-25eab59866dc tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:32.011739 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:55:32.280158 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0ce7a8fe-d1f0-40b1-bfa2-25eab59866dc tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89f6def8f54778b80b315f2eb0c9b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da8b15686cd4d688a48e857fb16e4cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:32.300776 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0ce7a8fe-d1f0-40b1-bfa2-25eab59866dc tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] 10.222.0.27 "GET /compute/v2.1/servers/b8edf980-3cac-4b70-bbf2-bad0e4681366" status: 200 len: 1325 microversion: 2.1 time: 0.356797 Sep 08 10:55:32.306629 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1974/3899] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:31 2022] GET /compute/v2.1/servers/b8edf980-3cac-4b70-bbf2-bad0e4681366 => generated 1325 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:32.327635 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-dd583e26-77d4-459f-b693-deb38b33b7fe tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:32.332671 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-dd583e26-77d4-459f-b693-deb38b33b7fe tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:32.341984 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd583e26-77d4-459f-b693-deb38b33b7fe tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:32.344006 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd583e26-77d4-459f-b693-deb38b33b7fe tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:32.345280 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd583e26-77d4-459f-b693-deb38b33b7fe tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:32.346336 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd583e26-77d4-459f-b693-deb38b33b7fe tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:32.346987 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd583e26-77d4-459f-b693-deb38b33b7fe tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:32.347607 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd583e26-77d4-459f-b693-deb38b33b7fe tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:32.602813 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-dd583e26-77d4-459f-b693-deb38b33b7fe tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:32.614415 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-dd583e26-77d4-459f-b693-deb38b33b7fe tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 0.303238 Sep 08 10:55:32.617070 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1975/3900] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:32 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:32.648281 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cb03551b-b7c3-43ae-8559-cef3fdbbf5cb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:32.649127 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cb03551b-b7c3-43ae-8559-cef3fdbbf5cb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:32.657705 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb03551b-b7c3-43ae-8559-cef3fdbbf5cb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:32.658342 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb03551b-b7c3-43ae-8559-cef3fdbbf5cb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:32.659059 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb03551b-b7c3-43ae-8559-cef3fdbbf5cb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:32.660037 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb03551b-b7c3-43ae-8559-cef3fdbbf5cb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:32.660780 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb03551b-b7c3-43ae-8559-cef3fdbbf5cb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:32.661632 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb03551b-b7c3-43ae-8559-cef3fdbbf5cb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:33.004730 n-d-850501-12 devstack@n-api.service[128862]: DEBUG neutronclient.v2_0.client [None req-80f19498-5b0e-421f-8411-e25694c99913 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 6f3b2b1f-362f-4566-a774-9c795703ef36 in use.", "detail": ""}} {{(pid=128862) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 08 10:55:33.006508 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-80f19498-5b0e-421f-8411-e25694c99913 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] HTTP exception thrown: Security Group 6f3b2b1f-362f-4566-a774-9c795703ef36 in use. Sep 08 10:55:33.006508 n-d-850501-12 devstack@n-api.service[128862]: Neutron server returns request_ids: ['req-9e0c17ac-73a3-431d-a3f1-43ec3566f7be'] Sep 08 10:55:33.009056 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-80f19498-5b0e-421f-8411-e25694c99913 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Request method failure captured: Sep 08 10:55:33.009056 n-d-850501-12 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/os-security-groups/6f3b2b1f-362f-4566-a774-9c795703ef36 HTTP/1.1 Sep 08 10:55:33.009056 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:55:33.009056 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:55:33.009056 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:55:33.009056 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:55:33.009056 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:55:33.009056 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:55:33.009056 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:55:33.009056 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:55:33.009056 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcnTIBfdH5H0Q1rMlbnLYZQcAnuATI-6ncC0ETqGOy19nshWBWc6mMSPvOE_5zGIQBC9DCOSD4SaG9XyRLj03fab4bxuKCvYlxZzzB9WEeCTo5mGH1uU5x9CALWtC8B7Wu8ih4rvxppcLmpz4ET9xD3ym8uzzB22kwTIB3vo0v5dqyY Sep 08 10:55:33.009056 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:55:33.009056 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:55:33.009056 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:55:33.009056 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:55:33.009056 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:55:33.009056 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:55:33.009056 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 0958700fa94b42b2b6b47af40cf2f679 Sep 08 10:55:33.009056 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-SecurityGroupsTestJSON-353861575 Sep 08 10:55:33.009056 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:55:33.009056 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:55:33.009056 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0958700fa94b42b2b6b47af40cf2f679"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0958700fa94b42b2b6b47af40cf2f679"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0958700fa94b42b2b6b47af40cf2f679"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0958700fa94b42b2b6b47af40cf2f679"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:55:33.009056 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-SecurityGroupsTestJSON-353861575 Sep 08 10:55:33.009056 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 0958700fa94b42b2b6b47af40cf2f679 Sep 08 10:55:33.009056 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-353861575 Sep 08 10:55:33.009056 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-SecurityGroupsTestJSON-353861575-project Sep 08 10:55:33.009056 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:55:33.009056 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:55:33.009056 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: e1bec228c17647bba62ba7d57d28e4ed Sep 08 10:55:33.009056 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-SecurityGroupsTestJSON-353861575-project Sep 08 10:55:33.009056 n-d-850501-12 devstack@n-api.service[128862]: method: Sep 08 10:55:33.009056 n-d-850501-12 devstack@n-api.service[128862]: exception: Security Group 6f3b2b1f-362f-4566-a774-9c795703ef36 in use. Sep 08 10:55:33.009056 n-d-850501-12 devstack@n-api.service[128862]: Neutron server returns request_ids: ['req-9e0c17ac-73a3-431d-a3f1-43ec3566f7be'] Sep 08 10:55:33.009056 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '6f3b2b1f-362f-4566-a774-9c795703ef36'} Sep 08 10:55:33.009056 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:55:33.009056 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:33.009056 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Sep 08 10:55:33.009056 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Sep 08 10:55:33.009056 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:55:33.009056 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:55:33.009056 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Sep 08 10:55:33.009056 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Sep 08 10:55:33.009056 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:55:33.009056 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:55:33.009056 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Sep 08 10:55:33.009056 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Sep 08 10:55:33.009056 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:55:33.009056 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:55:33.009056 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 08 10:55:33.009056 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 08 10:55:33.009056 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:55:33.009056 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:55:33.009056 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 08 10:55:33.009056 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 08 10:55:33.009056 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:55:33.009056 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:55:33.009056 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 08 10:55:33.009056 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 08 10:55:33.009056 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 08 10:55:33.009056 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 08 10:55:33.009056 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 6f3b2b1f-362f-4566-a774-9c795703ef36 in use. Sep 08 10:55:33.017540 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9e0c17ac-73a3-431d-a3f1-43ec3566f7be'] Sep 08 10:55:33.017540 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:33.017540 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:33.017540 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:33.017540 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:33.017540 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Sep 08 10:55:33.017540 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Sep 08 10:55:33.017540 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Sep 08 10:55:33.017540 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Sep 08 10:55:33.017540 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 6f3b2b1f-362f-4566-a774-9c795703ef36 in use. Sep 08 10:55:33.017540 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9e0c17ac-73a3-431d-a3f1-43ec3566f7be'] Sep 08 10:55:33.017540 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:33.017540 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:33.017540 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:33.017540 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:33.017540 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:55:33.017540 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:55:33.017540 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:55:33.017540 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:55:33.017540 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:55:33.017540 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:55:33.017540 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:55:33.017540 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:55:33.017540 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Sep 08 10:55:33.017540 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 08 10:55:33.017540 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 6f3b2b1f-362f-4566-a774-9c795703ef36 in use. Sep 08 10:55:33.017540 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9e0c17ac-73a3-431d-a3f1-43ec3566f7be'] Sep 08 10:55:33.017540 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:33.017540 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:33.017540 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:33.017540 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:33.017540 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:55:33.017540 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:55:33.017540 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:55:33.017540 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:55:33.017540 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 6f3b2b1f-362f-4566-a774-9c795703ef36 in use. Sep 08 10:55:33.017540 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9e0c17ac-73a3-431d-a3f1-43ec3566f7be'] Sep 08 10:55:33.017540 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:33.026466 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-80f19498-5b0e-421f-8411-e25694c99913 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Returning 400 to user: Security Group 6f3b2b1f-362f-4566-a774-9c795703ef36 in use. Sep 08 10:55:33.026466 n-d-850501-12 devstack@n-api.service[128862]: Neutron server returns request_ids: ['req-9e0c17ac-73a3-431d-a3f1-43ec3566f7be'] {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:55:33.027644 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-80f19498-5b0e-421f-8411-e25694c99913 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/6f3b2b1f-362f-4566-a774-9c795703ef36" status: 400 len: 185 microversion: 2.1 time: 1.177805 Sep 08 10:55:33.028925 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1926/3901] 10.222.0.27 () {58 vars in 1272 bytes} [Thu Sep 8 10:55:31 2022] DELETE /compute/v2.1/os-security-groups/6f3b2b1f-362f-4566-a774-9c795703ef36 => generated 185 bytes in 1180 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:55:33.053774 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d1ee864c-8125-4242-ab97-f7e42414e33b tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-375867114", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "285f0883-8bd7-440a-bca1-f5c4c74ab4c2"}, {"uuid": "8a488719-08ce-4b92-adc4-5347d4144366"}, {"uuid": "285f0883-8bd7-440a-bca1-f5c4c74ab4c2"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:55:33.160597 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-cb03551b-b7c3-43ae-8559-cef3fdbbf5cb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:33.170754 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cb03551b-b7c3-43ae-8559-cef3fdbbf5cb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 0.528703 Sep 08 10:55:33.172015 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1976/3902] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:32 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:33.181208 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b44fade7-9c67-4d19-b4b4-bf35816b6c04 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:33.183425 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b44fade7-9c67-4d19-b4b4-bf35816b6c04 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:33.187083 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-d1ee864c-8125-4242-ab97-f7e42414e33b tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] validate_networks() for [('285f0883-8bd7-440a-bca1-f5c4c74ab4c2', None, None, None, None, None), ('8a488719-08ce-4b92-adc4-5347d4144366', None, None, None, None, None), ('285f0883-8bd7-440a-bca1-f5c4c74ab4c2', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:55:33.193208 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:55:33.197254 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b44fade7-9c67-4d19-b4b4-bf35816b6c04 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:33.198611 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b44fade7-9c67-4d19-b4b4-bf35816b6c04 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:33.199814 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b44fade7-9c67-4d19-b4b4-bf35816b6c04 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:33.201643 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b44fade7-9c67-4d19-b4b4-bf35816b6c04 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:33.202660 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b44fade7-9c67-4d19-b4b4-bf35816b6c04 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:33.204337 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b44fade7-9c67-4d19-b4b4-bf35816b6c04 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:33.529377 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b44fade7-9c67-4d19-b4b4-bf35816b6c04 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:33.545210 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b44fade7-9c67-4d19-b4b4-bf35816b6c04 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:33.552690 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b44fade7-9c67-4d19-b4b4-bf35816b6c04 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:33.554798 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b44fade7-9c67-4d19-b4b4-bf35816b6c04 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 200 len: 2933 microversion: 2.32 time: 0.379943 Sep 08 10:55:33.555718 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1977/3903] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:55:33 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 2933 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:55:33.564250 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-99b9124d-39e2-4ce7-9e90-64dd5cae1fb6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:33.565235 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-99b9124d-39e2-4ce7-9e90-64dd5cae1fb6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 379a5e3e-0e59-4b53-a37e-f4e9d1000eaf] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:33.577548 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-99b9124d-39e2-4ce7-9e90-64dd5cae1fb6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:33.579384 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-99b9124d-39e2-4ce7-9e90-64dd5cae1fb6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:33.581017 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-99b9124d-39e2-4ce7-9e90-64dd5cae1fb6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:33.582677 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-99b9124d-39e2-4ce7-9e90-64dd5cae1fb6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:33.583851 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-99b9124d-39e2-4ce7-9e90-64dd5cae1fb6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:33.586227 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-99b9124d-39e2-4ce7-9e90-64dd5cae1fb6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:33.829489 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-99b9124d-39e2-4ce7-9e90-64dd5cae1fb6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:33.851782 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-99b9124d-39e2-4ce7-9e90-64dd5cae1fb6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/379a5e3e-0e59-4b53-a37e-f4e9d1000eaf" status: 200 len: 1314 microversion: 2.1 time: 0.294120 Sep 08 10:55:33.858917 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1978/3904] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:33 2022] GET /compute/v2.1/servers/379a5e3e-0e59-4b53-a37e-f4e9d1000eaf => generated 1314 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:33.881636 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1e2e1c0f-56e6-4cc7-9c93-0abdfe46eeb0 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:33.882351 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1e2e1c0f-56e6-4cc7-9c93-0abdfe46eeb0 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] [instance: b7e97718-dc14-4e93-b7b3-49a8d8e03bb9] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:33.899026 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e2e1c0f-56e6-4cc7-9c93-0abdfe46eeb0 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:33.899542 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e2e1c0f-56e6-4cc7-9c93-0abdfe46eeb0 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:33.900174 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e2e1c0f-56e6-4cc7-9c93-0abdfe46eeb0 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:33.900880 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e2e1c0f-56e6-4cc7-9c93-0abdfe46eeb0 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:33.901374 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e2e1c0f-56e6-4cc7-9c93-0abdfe46eeb0 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:33.901811 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e2e1c0f-56e6-4cc7-9c93-0abdfe46eeb0 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:33.932267 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1e2e1c0f-56e6-4cc7-9c93-0abdfe46eeb0 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] [instance: b7e97718-dc14-4e93-b7b3-49a8d8e03bb9] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:55:34.040643 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1e2e1c0f-56e6-4cc7-9c93-0abdfe46eeb0 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b7e97718-dc14-4e93-b7b3-49a8d8e03bb9" status: 204 len: 0 microversion: 2.1 time: 0.176923 Sep 08 10:55:34.040643 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1979/3905] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:55:33 2022] DELETE /compute/v2.1/servers/b7e97718-dc14-4e93-b7b3-49a8d8e03bb9 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:55:34.052580 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c54da5a5-d950-4d4e-9056-c08dfbf302e7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:55:34.057960 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c54da5a5-d950-4d4e-9056-c08dfbf302e7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:34.066002 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c54da5a5-d950-4d4e-9056-c08dfbf302e7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:34.066900 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c54da5a5-d950-4d4e-9056-c08dfbf302e7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:34.067582 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c54da5a5-d950-4d4e-9056-c08dfbf302e7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:34.068647 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c54da5a5-d950-4d4e-9056-c08dfbf302e7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:34.069504 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c54da5a5-d950-4d4e-9056-c08dfbf302e7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:34.070260 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c54da5a5-d950-4d4e-9056-c08dfbf302e7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:34.115676 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-c54da5a5-d950-4d4e-9056-c08dfbf302e7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lazy-loading 'flavor' on Instance uuid 74eebde7-4328-4ddf-be14-bb9fba70ec03 {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:55:34.422783 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c54da5a5-d950-4d4e-9056-c08dfbf302e7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "POST /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03/action" status: 202 len: 0 microversion: 2.1 time: 0.381038 Sep 08 10:55:34.423962 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1980/3906] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:55:34 2022] POST /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03/action => generated 0 bytes in 384 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:55:34.431794 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c9b20650-a8de-4fad-b554-b751859bb05b tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:34.433224 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c9b20650-a8de-4fad-b554-b751859bb05b tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] [instance: b8edf980-3cac-4b70-bbf2-bad0e4681366] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:34.442498 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c9b20650-a8de-4fad-b554-b751859bb05b tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:34.443154 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c9b20650-a8de-4fad-b554-b751859bb05b tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:34.444324 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c9b20650-a8de-4fad-b554-b751859bb05b tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:34.445447 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c9b20650-a8de-4fad-b554-b751859bb05b tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:34.446112 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c9b20650-a8de-4fad-b554-b751859bb05b tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:34.447212 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c9b20650-a8de-4fad-b554-b751859bb05b tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:34.703816 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c9b20650-a8de-4fad-b554-b751859bb05b tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89f6def8f54778b80b315f2eb0c9b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da8b15686cd4d688a48e857fb16e4cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:34.715070 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c9b20650-a8de-4fad-b554-b751859bb05b tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] 10.222.0.27 "GET /compute/v2.1/servers/b8edf980-3cac-4b70-bbf2-bad0e4681366" status: 200 len: 1325 microversion: 2.1 time: 0.289307 Sep 08 10:55:34.719530 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1981/3907] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:34 2022] GET /compute/v2.1/servers/b8edf980-3cac-4b70-bbf2-bad0e4681366 => generated 1325 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:34.728220 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-49f76e12-d1b5-458a-a532-9151c16c7d47 req-620bc6ec-7b8d-4a43-a02d-cd0a793c326c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98277784-8e48-4a7b-8786-ce579e1d5ccf", "name": "network-vif-unplugged", "status": "completed", "tag": "742e7fd9-9529-4661-8ad0-c2f50b7bb9d8"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:55:34.741528 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-49f76e12-d1b5-458a-a532-9151c16c7d47 req-620bc6ec-7b8d-4a43-a02d-cd0a793c326c service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:34.742309 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-49f76e12-d1b5-458a-a532-9151c16c7d47 req-620bc6ec-7b8d-4a43-a02d-cd0a793c326c service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:34.742754 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-49f76e12-d1b5-458a-a532-9151c16c7d47 req-620bc6ec-7b8d-4a43-a02d-cd0a793c326c service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:34.760188 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-49f76e12-d1b5-458a-a532-9151c16c7d47 req-620bc6ec-7b8d-4a43-a02d-cd0a793c326c service nova] Creating event network-vif-unplugged:742e7fd9-9529-4661-8ad0-c2f50b7bb9d8 for instance 98277784-8e48-4a7b-8786-ce579e1d5ccf on n-h2-850501-12 Sep 08 10:55:34.769184 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-49f76e12-d1b5-458a-a532-9151c16c7d47 req-620bc6ec-7b8d-4a43-a02d-cd0a793c326c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047657 Sep 08 10:55:34.770419 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1982/3908] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:55:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:55:34.782321 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e147bb50-ff4b-4d77-9b3a-e4f9d74edff2 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:34.782321 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e147bb50-ff4b-4d77-9b3a-e4f9d74edff2 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] [instance: b7e97718-dc14-4e93-b7b3-49a8d8e03bb9] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:34.789854 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e147bb50-ff4b-4d77-9b3a-e4f9d74edff2 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:34.790972 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e147bb50-ff4b-4d77-9b3a-e4f9d74edff2 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:34.790972 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e147bb50-ff4b-4d77-9b3a-e4f9d74edff2 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:34.791767 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e147bb50-ff4b-4d77-9b3a-e4f9d74edff2 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:34.792217 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e147bb50-ff4b-4d77-9b3a-e4f9d74edff2 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:34.792803 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e147bb50-ff4b-4d77-9b3a-e4f9d74edff2 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:35.080307 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e147bb50-ff4b-4d77-9b3a-e4f9d74edff2 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1bec228c17647bba62ba7d57d28e4ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0958700fa94b42b2b6b47af40cf2f679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:35.114883 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e147bb50-ff4b-4d77-9b3a-e4f9d74edff2 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "GET /compute/v2.1/servers/b7e97718-dc14-4e93-b7b3-49a8d8e03bb9" status: 200 len: 1648 microversion: 2.1 time: 0.343102 Sep 08 10:55:35.121751 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1983/3909] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:34 2022] GET /compute/v2.1/servers/b7e97718-dc14-4e93-b7b3-49a8d8e03bb9 => generated 1648 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:35.138259 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a3a3ce5e-7d02-4977-82aa-b473d926d8f5 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:55:35.144006 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a3a3ce5e-7d02-4977-82aa-b473d926d8f5 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: 93d05d86-99b6-43f0-83c7-257ab64a12f3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:35.156413 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a3a3ce5e-7d02-4977-82aa-b473d926d8f5 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:35.157941 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a3a3ce5e-7d02-4977-82aa-b473d926d8f5 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:35.158623 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a3a3ce5e-7d02-4977-82aa-b473d926d8f5 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:35.159762 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a3a3ce5e-7d02-4977-82aa-b473d926d8f5 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:35.160702 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a3a3ce5e-7d02-4977-82aa-b473d926d8f5 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:35.161423 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a3a3ce5e-7d02-4977-82aa-b473d926d8f5 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:35.212624 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-a3a3ce5e-7d02-4977-82aa-b473d926d8f5 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lazy-loading 'flavor' on Instance uuid 93d05d86-99b6-43f0-83c7-257ab64a12f3 {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:55:35.490233 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a3a3ce5e-7d02-4977-82aa-b473d926d8f5 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "POST /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3/action" status: 200 len: 32 microversion: 2.1 time: 0.365831 Sep 08 10:55:35.490917 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1984/3910] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:55:35 2022] POST /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3/action => generated 32 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:55:35.514094 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-60426453-987a-4bb6-861d-8b3adf9bf67f tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:35.515408 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-60426453-987a-4bb6-861d-8b3adf9bf67f tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:35.530010 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-60426453-987a-4bb6-861d-8b3adf9bf67f tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:35.530601 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-60426453-987a-4bb6-861d-8b3adf9bf67f tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:35.530956 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-60426453-987a-4bb6-861d-8b3adf9bf67f tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:35.532213 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-60426453-987a-4bb6-861d-8b3adf9bf67f tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:35.532799 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-60426453-987a-4bb6-861d-8b3adf9bf67f tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:35.533286 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-60426453-987a-4bb6-861d-8b3adf9bf67f tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:35.877490 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-60426453-987a-4bb6-861d-8b3adf9bf67f tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:35.890538 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-60426453-987a-4bb6-861d-8b3adf9bf67f tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1510 microversion: 2.1 time: 0.398205 Sep 08 10:55:35.891094 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1985/3911] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:35 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1510 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:35.903991 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-990cf256-11c2-4569-a4cc-42b37a8392c4 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:35.905501 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-990cf256-11c2-4569-a4cc-42b37a8392c4 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:35.914239 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-990cf256-11c2-4569-a4cc-42b37a8392c4 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:35.915078 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-990cf256-11c2-4569-a4cc-42b37a8392c4 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:35.915926 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-990cf256-11c2-4569-a4cc-42b37a8392c4 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:35.916904 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-990cf256-11c2-4569-a4cc-42b37a8392c4 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:35.917602 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-990cf256-11c2-4569-a4cc-42b37a8392c4 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:35.918054 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-990cf256-11c2-4569-a4cc-42b37a8392c4 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:35.947002 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:55:36.275491 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-990cf256-11c2-4569-a4cc-42b37a8392c4 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:36.301367 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-990cf256-11c2-4569-a4cc-42b37a8392c4 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:36.306443 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-990cf256-11c2-4569-a4cc-42b37a8392c4 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:36.310222 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-990cf256-11c2-4569-a4cc-42b37a8392c4 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 200 len: 2912 microversion: 2.32 time: 0.416471 Sep 08 10:55:36.321595 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1986/3912] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:55:35 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 2912 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:55:36.375959 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-36383700-7df4-4f25-bc57-a043f24e2c19 req-78aa59b5-d99f-49fb-a0d0-65afdcd31b46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8edf980-3cac-4b70-bbf2-bad0e4681366", "tag": "1cfa6b3e-b72b-4178-b6f3-3e1870fd236b"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:55:36.411159 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-36383700-7df4-4f25-bc57-a043f24e2c19 req-78aa59b5-d99f-49fb-a0d0-65afdcd31b46 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:36.411914 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-36383700-7df4-4f25-bc57-a043f24e2c19 req-78aa59b5-d99f-49fb-a0d0-65afdcd31b46 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:36.412900 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-36383700-7df4-4f25-bc57-a043f24e2c19 req-78aa59b5-d99f-49fb-a0d0-65afdcd31b46 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:36.438358 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-36383700-7df4-4f25-bc57-a043f24e2c19 req-78aa59b5-d99f-49fb-a0d0-65afdcd31b46 service nova] Creating event network-changed:1cfa6b3e-b72b-4178-b6f3-3e1870fd236b for instance b8edf980-3cac-4b70-bbf2-bad0e4681366 on n-h1-850501-12 Sep 08 10:55:36.447055 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-36383700-7df4-4f25-bc57-a043f24e2c19 req-78aa59b5-d99f-49fb-a0d0-65afdcd31b46 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122973 Sep 08 10:55:36.456542 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1987/3913] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:55:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:55:36.463401 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4940b228-d82c-440c-8bf9-bd84501bfa90 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:36.466199 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4940b228-d82c-440c-8bf9-bd84501bfa90 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 379a5e3e-0e59-4b53-a37e-f4e9d1000eaf] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:36.485835 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4940b228-d82c-440c-8bf9-bd84501bfa90 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:36.486362 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4940b228-d82c-440c-8bf9-bd84501bfa90 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:36.488630 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4940b228-d82c-440c-8bf9-bd84501bfa90 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:36.494649 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4940b228-d82c-440c-8bf9-bd84501bfa90 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:36.495360 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4940b228-d82c-440c-8bf9-bd84501bfa90 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:36.496823 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4940b228-d82c-440c-8bf9-bd84501bfa90 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:36.848680 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4940b228-d82c-440c-8bf9-bd84501bfa90 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:36.859118 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4940b228-d82c-440c-8bf9-bd84501bfa90 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/379a5e3e-0e59-4b53-a37e-f4e9d1000eaf" status: 200 len: 1314 microversion: 2.1 time: 0.400626 Sep 08 10:55:36.860729 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1988/3914] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:36 2022] GET /compute/v2.1/servers/379a5e3e-0e59-4b53-a37e-f4e9d1000eaf => generated 1314 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:36.866497 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8ccd5106-6c24-4289-bc58-dcaba26ffc1f tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:36.867380 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8ccd5106-6c24-4289-bc58-dcaba26ffc1f tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: 93d05d86-99b6-43f0-83c7-257ab64a12f3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:36.874373 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8ccd5106-6c24-4289-bc58-dcaba26ffc1f tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:36.875815 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8ccd5106-6c24-4289-bc58-dcaba26ffc1f tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:36.876444 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8ccd5106-6c24-4289-bc58-dcaba26ffc1f tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:36.877424 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8ccd5106-6c24-4289-bc58-dcaba26ffc1f tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:36.878057 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8ccd5106-6c24-4289-bc58-dcaba26ffc1f tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:36.878665 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8ccd5106-6c24-4289-bc58-dcaba26ffc1f tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:37.190591 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8ccd5106-6c24-4289-bc58-dcaba26ffc1f tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:37.209779 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8ccd5106-6c24-4289-bc58-dcaba26ffc1f tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3" status: 200 len: 1735 microversion: 2.1 time: 0.345775 Sep 08 10:55:37.212553 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1989/3915] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:36 2022] GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3 => generated 1735 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:37.221599 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-704846bd-756c-4b48-8b51-5d6af5f3e21e tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:37.222514 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-704846bd-756c-4b48-8b51-5d6af5f3e21e tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] [instance: b8edf980-3cac-4b70-bbf2-bad0e4681366] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:37.229764 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-704846bd-756c-4b48-8b51-5d6af5f3e21e tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:37.230584 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-704846bd-756c-4b48-8b51-5d6af5f3e21e tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:37.231395 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-704846bd-756c-4b48-8b51-5d6af5f3e21e tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:37.232357 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-704846bd-756c-4b48-8b51-5d6af5f3e21e tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:37.235400 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-704846bd-756c-4b48-8b51-5d6af5f3e21e tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:37.236203 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-704846bd-756c-4b48-8b51-5d6af5f3e21e tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:37.626037 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-704846bd-756c-4b48-8b51-5d6af5f3e21e tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89f6def8f54778b80b315f2eb0c9b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da8b15686cd4d688a48e857fb16e4cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:37.644331 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-704846bd-756c-4b48-8b51-5d6af5f3e21e tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] 10.222.0.27 "GET /compute/v2.1/servers/b8edf980-3cac-4b70-bbf2-bad0e4681366" status: 200 len: 1325 microversion: 2.1 time: 0.428659 Sep 08 10:55:37.645290 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1990/3916] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:37 2022] GET /compute/v2.1/servers/b8edf980-3cac-4b70-bbf2-bad0e4681366 => generated 1325 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:37.650191 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-52307171-32e4-4faf-ae8d-9d846c5f1a85 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:37.650820 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-52307171-32e4-4faf-ae8d-9d846c5f1a85 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] [instance: b7e97718-dc14-4e93-b7b3-49a8d8e03bb9] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:37.665872 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-52307171-32e4-4faf-ae8d-9d846c5f1a85 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:37.666387 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-52307171-32e4-4faf-ae8d-9d846c5f1a85 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:37.666840 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-52307171-32e4-4faf-ae8d-9d846c5f1a85 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:37.667588 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-52307171-32e4-4faf-ae8d-9d846c5f1a85 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:37.668751 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-52307171-32e4-4faf-ae8d-9d846c5f1a85 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:37.668751 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-52307171-32e4-4faf-ae8d-9d846c5f1a85 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:37.902327 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-52307171-32e4-4faf-ae8d-9d846c5f1a85 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1bec228c17647bba62ba7d57d28e4ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0958700fa94b42b2b6b47af40cf2f679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:37.914263 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-52307171-32e4-4faf-ae8d-9d846c5f1a85 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "GET /compute/v2.1/servers/b7e97718-dc14-4e93-b7b3-49a8d8e03bb9" status: 200 len: 1648 microversion: 2.1 time: 0.266853 Sep 08 10:55:37.933357 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1991/3917] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:37 2022] GET /compute/v2.1/servers/b7e97718-dc14-4e93-b7b3-49a8d8e03bb9 => generated 1648 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:37.947938 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-47981537-f413-44a6-a0c1-4402b087a06a req-3b0a9407-61b1-4a00-aa59-9bb493dfcf06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98277784-8e48-4a7b-8786-ce579e1d5ccf", "name": "network-vif-unplugged", "status": "completed", "tag": "c559d837-313a-4f2e-8c4a-0410f4b4fafd"}, {"server_uuid": "98277784-8e48-4a7b-8786-ce579e1d5ccf", "name": "network-vif-unplugged", "status": "completed", "tag": "7dc4a9a8-b4a5-45bf-bf54-5e5e0cd4d54b"}, {"server_uuid": "98277784-8e48-4a7b-8786-ce579e1d5ccf", "name": "network-vif-unplugged", "status": "completed", "tag": "576874d5-b1a3-4dba-862f-855bbc5a1c03"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:55:37.962589 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-47981537-f413-44a6-a0c1-4402b087a06a req-3b0a9407-61b1-4a00-aa59-9bb493dfcf06 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:37.967977 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-47981537-f413-44a6-a0c1-4402b087a06a req-3b0a9407-61b1-4a00-aa59-9bb493dfcf06 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:37.968910 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-47981537-f413-44a6-a0c1-4402b087a06a req-3b0a9407-61b1-4a00-aa59-9bb493dfcf06 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:37.985664 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-47981537-f413-44a6-a0c1-4402b087a06a req-3b0a9407-61b1-4a00-aa59-9bb493dfcf06 service nova] Creating event network-vif-unplugged:c559d837-313a-4f2e-8c4a-0410f4b4fafd for instance 98277784-8e48-4a7b-8786-ce579e1d5ccf on n-h2-850501-12 Sep 08 10:55:37.986401 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-47981537-f413-44a6-a0c1-4402b087a06a req-3b0a9407-61b1-4a00-aa59-9bb493dfcf06 service nova] Creating event network-vif-unplugged:7dc4a9a8-b4a5-45bf-bf54-5e5e0cd4d54b for instance 98277784-8e48-4a7b-8786-ce579e1d5ccf on n-h2-850501-12 Sep 08 10:55:37.987069 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-47981537-f413-44a6-a0c1-4402b087a06a req-3b0a9407-61b1-4a00-aa59-9bb493dfcf06 service nova] Creating event network-vif-unplugged:576874d5-b1a3-4dba-862f-855bbc5a1c03 for instance 98277784-8e48-4a7b-8786-ce579e1d5ccf on n-h2-850501-12 Sep 08 10:55:37.997732 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-47981537-f413-44a6-a0c1-4402b087a06a req-3b0a9407-61b1-4a00-aa59-9bb493dfcf06 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.062167 Sep 08 10:55:38.001094 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1992/3918] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:55:37 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:55:38.013384 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-81fe35d6-8333-44ba-8e79-3afd6c17a786 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:38.014371 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-81fe35d6-8333-44ba-8e79-3afd6c17a786 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:38.026042 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-81fe35d6-8333-44ba-8e79-3afd6c17a786 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:38.026898 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-81fe35d6-8333-44ba-8e79-3afd6c17a786 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:38.027037 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-81fe35d6-8333-44ba-8e79-3afd6c17a786 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:38.027711 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-81fe35d6-8333-44ba-8e79-3afd6c17a786 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:38.028165 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-81fe35d6-8333-44ba-8e79-3afd6c17a786 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:38.028616 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-81fe35d6-8333-44ba-8e79-3afd6c17a786 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:38.113755 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-d1ee864c-8125-4242-ab97-f7e42414e33b tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:55:38.114841 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-d1ee864c-8125-4242-ab97-f7e42414e33b tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:55:38.115528 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-d1ee864c-8125-4242-ab97-f7e42414e33b tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:55:38.117119 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-d1ee864c-8125-4242-ab97-f7e42414e33b tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:55:38.117119 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-d1ee864c-8125-4242-ab97-f7e42414e33b tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:55:38.119263 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:55:38.142466 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d1ee864c-8125-4242-ab97-f7e42414e33b tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:38.145358 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d1ee864c-8125-4242-ab97-f7e42414e33b tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:38.146022 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d1ee864c-8125-4242-ab97-f7e42414e33b tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:38.152726 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d1ee864c-8125-4242-ab97-f7e42414e33b tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:38.155318 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d1ee864c-8125-4242-ab97-f7e42414e33b tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:38.156519 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d1ee864c-8125-4242-ab97-f7e42414e33b tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:38.213614 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-d1ee864c-8125-4242-ab97-f7e42414e33b tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Getting quotas for project 1f1c70903c3d42d790d9ef96adc1fdbd. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:55:38.221167 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-d1ee864c-8125-4242-ab97-f7e42414e33b tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Getting quotas for user 22145c653c804031ae233de6d84647fe and project 1f1c70903c3d42d790d9ef96adc1fdbd. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:55:38.238204 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d1ee864c-8125-4242-ab97-f7e42414e33b tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:55:38.240417 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d1ee864c-8125-4242-ab97-f7e42414e33b tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] [instance: 9e4282f7-daab-454b-93e5-7854754316c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:55:38.295723 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-81fe35d6-8333-44ba-8e79-3afd6c17a786 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:38.303714 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d1ee864c-8125-4242-ab97-f7e42414e33b tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.262121 Sep 08 10:55:38.305099 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1927/3919] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:55:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 5275 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:55:38.326330 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-81fe35d6-8333-44ba-8e79-3afd6c17a786 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1510 microversion: 2.1 time: 0.322750 Sep 08 10:55:38.330778 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1993/3920] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:38 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1510 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:38.332163 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cefdc6a0-cdd7-43eb-a96d-61395249e93e tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:38.333472 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cefdc6a0-cdd7-43eb-a96d-61395249e93e tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:38.342089 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c697f91a-f0e2-4460-8c0e-a60c100f038f tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:38.343042 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c697f91a-f0e2-4460-8c0e-a60c100f038f tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 379a5e3e-0e59-4b53-a37e-f4e9d1000eaf] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:38.352244 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cefdc6a0-cdd7-43eb-a96d-61395249e93e tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:38.352758 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cefdc6a0-cdd7-43eb-a96d-61395249e93e tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:38.353227 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cefdc6a0-cdd7-43eb-a96d-61395249e93e tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:38.355668 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cefdc6a0-cdd7-43eb-a96d-61395249e93e tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:38.356843 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cefdc6a0-cdd7-43eb-a96d-61395249e93e tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:38.357661 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cefdc6a0-cdd7-43eb-a96d-61395249e93e tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:38.371266 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c697f91a-f0e2-4460-8c0e-a60c100f038f tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:38.372465 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c697f91a-f0e2-4460-8c0e-a60c100f038f tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:38.373528 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c697f91a-f0e2-4460-8c0e-a60c100f038f tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:38.374300 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c697f91a-f0e2-4460-8c0e-a60c100f038f tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:38.374901 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c697f91a-f0e2-4460-8c0e-a60c100f038f tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:38.375697 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c697f91a-f0e2-4460-8c0e-a60c100f038f tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:38.590526 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c697f91a-f0e2-4460-8c0e-a60c100f038f tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:38.600023 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c697f91a-f0e2-4460-8c0e-a60c100f038f tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/379a5e3e-0e59-4b53-a37e-f4e9d1000eaf" status: 200 len: 1314 microversion: 2.1 time: 0.268092 Sep 08 10:55:38.600952 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1994/3921] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:38 2022] GET /compute/v2.1/servers/379a5e3e-0e59-4b53-a37e-f4e9d1000eaf => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:38.606254 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-24c0aa81-8919-40be-95d1-738aac4cd8d6 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:38.607607 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-24c0aa81-8919-40be-95d1-738aac4cd8d6 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: 93d05d86-99b6-43f0-83c7-257ab64a12f3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:38.617319 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24c0aa81-8919-40be-95d1-738aac4cd8d6 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:38.617880 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24c0aa81-8919-40be-95d1-738aac4cd8d6 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:38.618395 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24c0aa81-8919-40be-95d1-738aac4cd8d6 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:38.619243 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24c0aa81-8919-40be-95d1-738aac4cd8d6 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:38.619781 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24c0aa81-8919-40be-95d1-738aac4cd8d6 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:38.620308 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24c0aa81-8919-40be-95d1-738aac4cd8d6 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:38.832060 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-24c0aa81-8919-40be-95d1-738aac4cd8d6 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:38.855918 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-24c0aa81-8919-40be-95d1-738aac4cd8d6 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3" status: 200 len: 1735 microversion: 2.1 time: 0.253456 Sep 08 10:55:38.871510 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1995/3922] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:38 2022] GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3 => generated 1735 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:38.883448 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-91a30023-89fa-4be7-bfa4-f00d2808e755 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:38.883755 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-91a30023-89fa-4be7-bfa4-f00d2808e755 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] [instance: 9e4282f7-daab-454b-93e5-7854754316c8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:38.997817 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-91a30023-89fa-4be7-bfa4-f00d2808e755 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22145c653c804031ae233de6d84647fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1c70903c3d42d790d9ef96adc1fdbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:39.009472 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-91a30023-89fa-4be7-bfa4-f00d2808e755 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] 10.222.0.27 "GET /compute/v2.1/servers/9e4282f7-daab-454b-93e5-7854754316c8" status: 200 len: 1212 microversion: 2.1 time: 0.136749 Sep 08 10:55:39.010082 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1996/3923] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:38 2022] GET /compute/v2.1/servers/9e4282f7-daab-454b-93e5-7854754316c8 => generated 1212 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:39.021574 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-a56416f5-763d-4af5-a951-a9670a785e4b req-101827a8-4b95-492d-b060-8572e635f249 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98277784-8e48-4a7b-8786-ce579e1d5ccf", "name": "network-vif-deleted", "tag": "c559d837-313a-4f2e-8c4a-0410f4b4fafd"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:55:39.043801 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-a56416f5-763d-4af5-a951-a9670a785e4b req-101827a8-4b95-492d-b060-8572e635f249 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:39.044316 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-a56416f5-763d-4af5-a951-a9670a785e4b req-101827a8-4b95-492d-b060-8572e635f249 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:39.044758 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-a56416f5-763d-4af5-a951-a9670a785e4b req-101827a8-4b95-492d-b060-8572e635f249 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:39.076686 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-a56416f5-763d-4af5-a951-a9670a785e4b req-101827a8-4b95-492d-b060-8572e635f249 service nova] Creating event network-vif-deleted:c559d837-313a-4f2e-8c4a-0410f4b4fafd for instance 98277784-8e48-4a7b-8786-ce579e1d5ccf on n-h2-850501-12 Sep 08 10:55:39.085629 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-a56416f5-763d-4af5-a951-a9670a785e4b req-101827a8-4b95-492d-b060-8572e635f249 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074068 Sep 08 10:55:39.086565 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1997/3924] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:55:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:55:39.094680 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9cc4b590-523b-4910-b5f4-b54be82ff9f4 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:39.097946 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9cc4b590-523b-4910-b5f4-b54be82ff9f4 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] [instance: b8edf980-3cac-4b70-bbf2-bad0e4681366] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:39.106927 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9cc4b590-523b-4910-b5f4-b54be82ff9f4 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:39.107860 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9cc4b590-523b-4910-b5f4-b54be82ff9f4 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:39.108653 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9cc4b590-523b-4910-b5f4-b54be82ff9f4 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:39.110437 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9cc4b590-523b-4910-b5f4-b54be82ff9f4 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:39.111225 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9cc4b590-523b-4910-b5f4-b54be82ff9f4 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:39.112048 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9cc4b590-523b-4910-b5f4-b54be82ff9f4 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:39.117289 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cefdc6a0-cdd7-43eb-a96d-61395249e93e tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:39.149907 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cefdc6a0-cdd7-43eb-a96d-61395249e93e tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:39.158355 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cefdc6a0-cdd7-43eb-a96d-61395249e93e tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:39.164514 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cefdc6a0-cdd7-43eb-a96d-61395249e93e tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 200 len: 2866 microversion: 2.32 time: 0.854431 Sep 08 10:55:39.165799 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1928/3925] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:55:38 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 2866 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:55:39.188430 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-91480442-e441-4746-8c79-808caf3bd719 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:39.191685 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-91480442-e441-4746-8c79-808caf3bd719 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] [instance: b7e97718-dc14-4e93-b7b3-49a8d8e03bb9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:39.210515 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-91480442-e441-4746-8c79-808caf3bd719 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:39.211709 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-91480442-e441-4746-8c79-808caf3bd719 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:39.212439 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-91480442-e441-4746-8c79-808caf3bd719 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:39.213909 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-91480442-e441-4746-8c79-808caf3bd719 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:39.214643 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-91480442-e441-4746-8c79-808caf3bd719 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:39.229635 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-91480442-e441-4746-8c79-808caf3bd719 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:39.352971 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9cc4b590-523b-4910-b5f4-b54be82ff9f4 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89f6def8f54778b80b315f2eb0c9b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da8b15686cd4d688a48e857fb16e4cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:39.367143 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9cc4b590-523b-4910-b5f4-b54be82ff9f4 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] 10.222.0.27 "GET /compute/v2.1/servers/b8edf980-3cac-4b70-bbf2-bad0e4681366" status: 200 len: 1325 microversion: 2.1 time: 0.278188 Sep 08 10:55:39.382897 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1998/3926] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:39 2022] GET /compute/v2.1/servers/b8edf980-3cac-4b70-bbf2-bad0e4681366 => generated 1325 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:39.392780 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ffa5b023-6543-44c7-b5f6-744e46d106b5 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:39.393749 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ffa5b023-6543-44c7-b5f6-744e46d106b5 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:39.409156 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ffa5b023-6543-44c7-b5f6-744e46d106b5 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:39.409995 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ffa5b023-6543-44c7-b5f6-744e46d106b5 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:39.410656 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ffa5b023-6543-44c7-b5f6-744e46d106b5 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:39.420320 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ffa5b023-6543-44c7-b5f6-744e46d106b5 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:39.421351 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ffa5b023-6543-44c7-b5f6-744e46d106b5 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:39.423490 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ffa5b023-6543-44c7-b5f6-744e46d106b5 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:39.439952 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-91480442-e441-4746-8c79-808caf3bd719 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1bec228c17647bba62ba7d57d28e4ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0958700fa94b42b2b6b47af40cf2f679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:39.470648 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-91480442-e441-4746-8c79-808caf3bd719 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "GET /compute/v2.1/servers/b7e97718-dc14-4e93-b7b3-49a8d8e03bb9" status: 200 len: 1468 microversion: 2.1 time: 0.297655 Sep 08 10:55:39.471673 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1929/3927] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:39 2022] GET /compute/v2.1/servers/b7e97718-dc14-4e93-b7b3-49a8d8e03bb9 => generated 1468 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:39.624508 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6c108e92-afac-49d0-b3b4-c8fcbbe60aef tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:39.628237 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6c108e92-afac-49d0-b3b4-c8fcbbe60aef tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 379a5e3e-0e59-4b53-a37e-f4e9d1000eaf] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:39.644243 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6c108e92-afac-49d0-b3b4-c8fcbbe60aef tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:39.645124 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6c108e92-afac-49d0-b3b4-c8fcbbe60aef tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:39.649819 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6c108e92-afac-49d0-b3b4-c8fcbbe60aef tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:39.650878 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6c108e92-afac-49d0-b3b4-c8fcbbe60aef tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:39.651801 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6c108e92-afac-49d0-b3b4-c8fcbbe60aef tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:39.652435 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6c108e92-afac-49d0-b3b4-c8fcbbe60aef tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:39.743821 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ffa5b023-6543-44c7-b5f6-744e46d106b5 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:39.758872 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ffa5b023-6543-44c7-b5f6-744e46d106b5 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1510 microversion: 2.1 time: 0.374245 Sep 08 10:55:39.760652 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1999/3928] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:39 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1510 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:39.901385 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cbedd9cc-c175-4c3d-9d74-eb81d4d703d0 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:39.902049 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cbedd9cc-c175-4c3d-9d74-eb81d4d703d0 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: 93d05d86-99b6-43f0-83c7-257ab64a12f3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:39.913458 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cbedd9cc-c175-4c3d-9d74-eb81d4d703d0 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:39.914273 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cbedd9cc-c175-4c3d-9d74-eb81d4d703d0 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:39.914923 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cbedd9cc-c175-4c3d-9d74-eb81d4d703d0 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:39.915661 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cbedd9cc-c175-4c3d-9d74-eb81d4d703d0 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:39.916283 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cbedd9cc-c175-4c3d-9d74-eb81d4d703d0 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:39.916558 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cbedd9cc-c175-4c3d-9d74-eb81d4d703d0 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:40.087779 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-cbedd9cc-c175-4c3d-9d74-eb81d4d703d0 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:40.098434 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cbedd9cc-c175-4c3d-9d74-eb81d4d703d0 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3" status: 200 len: 1735 microversion: 2.1 time: 0.202507 Sep 08 10:55:40.099419 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2000/3929] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:39 2022] GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3 => generated 1735 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:55:40.105008 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-3a7dc67f-a5ce-47b7-9dcc-453d64f4ff4d req-2e96e351-0be2-405c-b494-bfad62bbab09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98277784-8e48-4a7b-8786-ce579e1d5ccf", "name": "network-vif-unplugged", "status": "completed", "tag": "ce9f8d6e-a5be-4a31-a377-ae93ebd5bedc"}, {"server_uuid": "379a5e3e-0e59-4b53-a37e-f4e9d1000eaf", "name": "network-vif-plugged", "status": "completed", "tag": "2e460d9c-8d3b-48a3-86c2-1bf47c800c37"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:55:40.107360 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6c108e92-afac-49d0-b3b4-c8fcbbe60aef tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:40.118455 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-3a7dc67f-a5ce-47b7-9dcc-453d64f4ff4d req-2e96e351-0be2-405c-b494-bfad62bbab09 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:40.119056 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-3a7dc67f-a5ce-47b7-9dcc-453d64f4ff4d req-2e96e351-0be2-405c-b494-bfad62bbab09 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:40.122174 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-3a7dc67f-a5ce-47b7-9dcc-453d64f4ff4d req-2e96e351-0be2-405c-b494-bfad62bbab09 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:40.130863 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6c108e92-afac-49d0-b3b4-c8fcbbe60aef tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/379a5e3e-0e59-4b53-a37e-f4e9d1000eaf" status: 200 len: 1314 microversion: 2.1 time: 0.510928 Sep 08 10:55:40.132053 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1930/3930] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:39 2022] GET /compute/v2.1/servers/379a5e3e-0e59-4b53-a37e-f4e9d1000eaf => generated 1314 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:55:40.138993 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-46341d32-03bb-4ce2-a705-2bf98387a421 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:40.139741 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-46341d32-03bb-4ce2-a705-2bf98387a421 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] [instance: 9e4282f7-daab-454b-93e5-7854754316c8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:40.146646 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-46341d32-03bb-4ce2-a705-2bf98387a421 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:40.147158 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-46341d32-03bb-4ce2-a705-2bf98387a421 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:40.147827 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-46341d32-03bb-4ce2-a705-2bf98387a421 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:40.148586 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-46341d32-03bb-4ce2-a705-2bf98387a421 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:40.149290 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-46341d32-03bb-4ce2-a705-2bf98387a421 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:40.149996 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-46341d32-03bb-4ce2-a705-2bf98387a421 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:40.160223 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-3a7dc67f-a5ce-47b7-9dcc-453d64f4ff4d req-2e96e351-0be2-405c-b494-bfad62bbab09 service nova] Creating event network-vif-unplugged:ce9f8d6e-a5be-4a31-a377-ae93ebd5bedc for instance 98277784-8e48-4a7b-8786-ce579e1d5ccf on n-h2-850501-12 Sep 08 10:55:40.161119 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-3a7dc67f-a5ce-47b7-9dcc-453d64f4ff4d req-2e96e351-0be2-405c-b494-bfad62bbab09 service nova] Creating event network-vif-plugged:2e460d9c-8d3b-48a3-86c2-1bf47c800c37 for instance 379a5e3e-0e59-4b53-a37e-f4e9d1000eaf on n-h2-850501-12 Sep 08 10:55:40.177188 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-3a7dc67f-a5ce-47b7-9dcc-453d64f4ff4d req-2e96e351-0be2-405c-b494-bfad62bbab09 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.068924 Sep 08 10:55:40.177339 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:55:40.183721 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2001/3931] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:55:40 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:55:40.216099 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6612febb-b60f-4fac-9028-42a6cd01a93a tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:40.216840 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6612febb-b60f-4fac-9028-42a6cd01a93a tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:40.226844 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6612febb-b60f-4fac-9028-42a6cd01a93a tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:40.227384 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6612febb-b60f-4fac-9028-42a6cd01a93a tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:40.228360 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6612febb-b60f-4fac-9028-42a6cd01a93a tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:40.230479 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6612febb-b60f-4fac-9028-42a6cd01a93a tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:40.231150 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6612febb-b60f-4fac-9028-42a6cd01a93a tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:40.232070 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6612febb-b60f-4fac-9028-42a6cd01a93a tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:40.340078 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-46341d32-03bb-4ce2-a705-2bf98387a421 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22145c653c804031ae233de6d84647fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1c70903c3d42d790d9ef96adc1fdbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:40.360896 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-46341d32-03bb-4ce2-a705-2bf98387a421 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] 10.222.0.27 "GET /compute/v2.1/servers/9e4282f7-daab-454b-93e5-7854754316c8" status: 200 len: 1264 microversion: 2.1 time: 0.225507 Sep 08 10:55:40.385128 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1931/3932] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:40 2022] GET /compute/v2.1/servers/9e4282f7-daab-454b-93e5-7854754316c8 => generated 1264 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:40.396075 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e3bc0c0b-2953-419f-aaa2-c5b3f43b051b tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:40.397337 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e3bc0c0b-2953-419f-aaa2-c5b3f43b051b tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] [instance: b8edf980-3cac-4b70-bbf2-bad0e4681366] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:40.404100 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e3bc0c0b-2953-419f-aaa2-c5b3f43b051b tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:40.404950 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e3bc0c0b-2953-419f-aaa2-c5b3f43b051b tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:40.405701 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e3bc0c0b-2953-419f-aaa2-c5b3f43b051b tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:40.407936 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e3bc0c0b-2953-419f-aaa2-c5b3f43b051b tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:40.408673 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e3bc0c0b-2953-419f-aaa2-c5b3f43b051b tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:40.409373 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e3bc0c0b-2953-419f-aaa2-c5b3f43b051b tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:40.784424 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6612febb-b60f-4fac-9028-42a6cd01a93a tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:40.815382 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6612febb-b60f-4fac-9028-42a6cd01a93a tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:40.818158 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6612febb-b60f-4fac-9028-42a6cd01a93a tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:40.822912 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6612febb-b60f-4fac-9028-42a6cd01a93a tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 200 len: 2706 microversion: 2.32 time: 0.616135 Sep 08 10:55:40.837054 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2002/3933] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:55:40 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 2706 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:55:40.840721 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-62669fa9-3b1f-4002-b2da-100f43664747 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:40.848109 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-62669fa9-3b1f-4002-b2da-100f43664747 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] [instance: b7e97718-dc14-4e93-b7b3-49a8d8e03bb9] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:40.859302 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-62669fa9-3b1f-4002-b2da-100f43664747 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:40.859513 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-62669fa9-3b1f-4002-b2da-100f43664747 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:40.860534 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-62669fa9-3b1f-4002-b2da-100f43664747 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:40.862069 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-62669fa9-3b1f-4002-b2da-100f43664747 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:40.862811 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-62669fa9-3b1f-4002-b2da-100f43664747 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:40.863999 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-62669fa9-3b1f-4002-b2da-100f43664747 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:40.933605 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-62669fa9-3b1f-4002-b2da-100f43664747 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:40.935136 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-62669fa9-3b1f-4002-b2da-100f43664747 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:40.935765 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-62669fa9-3b1f-4002-b2da-100f43664747 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:40.936498 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-62669fa9-3b1f-4002-b2da-100f43664747 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lazy-loading 'fault' on Instance uuid b7e97718-dc14-4e93-b7b3-49a8d8e03bb9 {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:55:40.944771 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e3bc0c0b-2953-419f-aaa2-c5b3f43b051b tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89f6def8f54778b80b315f2eb0c9b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da8b15686cd4d688a48e857fb16e4cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:40.958926 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e3bc0c0b-2953-419f-aaa2-c5b3f43b051b tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] 10.222.0.27 "GET /compute/v2.1/servers/b8edf980-3cac-4b70-bbf2-bad0e4681366" status: 200 len: 1325 microversion: 2.1 time: 0.566931 Sep 08 10:55:40.974253 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1932/3934] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:40 2022] GET /compute/v2.1/servers/b8edf980-3cac-4b70-bbf2-bad0e4681366 => generated 1325 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:55:40.981249 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-773bc183-dc01-40dd-a093-d6482cc4f599 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:40.982122 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-773bc183-dc01-40dd-a093-d6482cc4f599 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:40.997343 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-773bc183-dc01-40dd-a093-d6482cc4f599 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:40.997952 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-773bc183-dc01-40dd-a093-d6482cc4f599 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:40.998466 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-773bc183-dc01-40dd-a093-d6482cc4f599 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:40.999306 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-773bc183-dc01-40dd-a093-d6482cc4f599 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:41.001916 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-773bc183-dc01-40dd-a093-d6482cc4f599 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:41.002465 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-773bc183-dc01-40dd-a093-d6482cc4f599 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:41.089718 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-62669fa9-3b1f-4002-b2da-100f43664747 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1bec228c17647bba62ba7d57d28e4ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0958700fa94b42b2b6b47af40cf2f679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:41.105162 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-62669fa9-3b1f-4002-b2da-100f43664747 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "GET /compute/v2.1/servers/b7e97718-dc14-4e93-b7b3-49a8d8e03bb9" status: 200 len: 1305 microversion: 2.1 time: 0.277278 Sep 08 10:55:41.106738 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2003/3935] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:40 2022] GET /compute/v2.1/servers/b7e97718-dc14-4e93-b7b3-49a8d8e03bb9 => generated 1305 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:41.131090 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f516fab4-8ffe-48eb-9eda-d4177a193f92 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:41.131090 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f516fab4-8ffe-48eb-9eda-d4177a193f92 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: 93d05d86-99b6-43f0-83c7-257ab64a12f3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:41.142667 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f516fab4-8ffe-48eb-9eda-d4177a193f92 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:41.143348 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f516fab4-8ffe-48eb-9eda-d4177a193f92 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:41.144633 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f516fab4-8ffe-48eb-9eda-d4177a193f92 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:41.148548 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f516fab4-8ffe-48eb-9eda-d4177a193f92 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:41.150203 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f516fab4-8ffe-48eb-9eda-d4177a193f92 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:41.151661 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f516fab4-8ffe-48eb-9eda-d4177a193f92 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:41.497734 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-773bc183-dc01-40dd-a093-d6482cc4f599 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:41.510226 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-773bc183-dc01-40dd-a093-d6482cc4f599 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1510 microversion: 2.1 time: 0.534676 Sep 08 10:55:41.511036 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1933/3936] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:40 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1510 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:41.525272 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-a2d6b44b-24b6-4a7d-b61e-471c6959c4a5 req-61d78353-3695-4381-b9ae-be3353a8abfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7e97718-dc14-4e93-b7b3-49a8d8e03bb9", "name": "network-vif-deleted", "tag": "e2153ee7-b11d-41b7-b5fb-82f06d8cb9d0"}, {"server_uuid": "98277784-8e48-4a7b-8786-ce579e1d5ccf", "name": "network-vif-deleted", "tag": "7dc4a9a8-b4a5-45bf-bf54-5e5e0cd4d54b"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:55:41.567830 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a2d6b44b-24b6-4a7d-b61e-471c6959c4a5 req-61d78353-3695-4381-b9ae-be3353a8abfb service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:41.568401 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a2d6b44b-24b6-4a7d-b61e-471c6959c4a5 req-61d78353-3695-4381-b9ae-be3353a8abfb service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:41.570429 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a2d6b44b-24b6-4a7d-b61e-471c6959c4a5 req-61d78353-3695-4381-b9ae-be3353a8abfb service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:41.602202 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f516fab4-8ffe-48eb-9eda-d4177a193f92 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:41.612571 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f516fab4-8ffe-48eb-9eda-d4177a193f92 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3" status: 200 len: 1735 microversion: 2.1 time: 0.487015 Sep 08 10:55:41.620680 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2004/3937] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:41 2022] GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3 => generated 1735 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:41.630253 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cfa44c1c-b648-428b-ac68-77872a7bc7de tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:41.632530 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cfa44c1c-b648-428b-ac68-77872a7bc7de tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 379a5e3e-0e59-4b53-a37e-f4e9d1000eaf] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:41.636560 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-a2d6b44b-24b6-4a7d-b61e-471c6959c4a5 req-61d78353-3695-4381-b9ae-be3353a8abfb service nova] Creating event network-vif-deleted:e2153ee7-b11d-41b7-b5fb-82f06d8cb9d0 for instance b7e97718-dc14-4e93-b7b3-49a8d8e03bb9 on n-h1-850501-12 Sep 08 10:55:41.637464 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-a2d6b44b-24b6-4a7d-b61e-471c6959c4a5 req-61d78353-3695-4381-b9ae-be3353a8abfb service nova] Creating event network-vif-deleted:7dc4a9a8-b4a5-45bf-bf54-5e5e0cd4d54b for instance 98277784-8e48-4a7b-8786-ce579e1d5ccf on n-h2-850501-12 Sep 08 10:55:41.656148 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-a2d6b44b-24b6-4a7d-b61e-471c6959c4a5 req-61d78353-3695-4381-b9ae-be3353a8abfb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.141951 Sep 08 10:55:41.657436 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1934/3938] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:55:41 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:55:41.658786 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cfa44c1c-b648-428b-ac68-77872a7bc7de tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:41.659488 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cfa44c1c-b648-428b-ac68-77872a7bc7de tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:41.660021 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cfa44c1c-b648-428b-ac68-77872a7bc7de tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:41.660818 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cfa44c1c-b648-428b-ac68-77872a7bc7de tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:41.661403 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cfa44c1c-b648-428b-ac68-77872a7bc7de tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:41.661906 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cfa44c1c-b648-428b-ac68-77872a7bc7de tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:41.664172 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ba1b0a76-0eb2-4d0a-b2de-34984a9960dd tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:41.665291 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ba1b0a76-0eb2-4d0a-b2de-34984a9960dd tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] [instance: 9e4282f7-daab-454b-93e5-7854754316c8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:41.673431 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba1b0a76-0eb2-4d0a-b2de-34984a9960dd tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:41.674208 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba1b0a76-0eb2-4d0a-b2de-34984a9960dd tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:41.675354 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba1b0a76-0eb2-4d0a-b2de-34984a9960dd tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:41.676264 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba1b0a76-0eb2-4d0a-b2de-34984a9960dd tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:41.676893 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba1b0a76-0eb2-4d0a-b2de-34984a9960dd tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:41.677652 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba1b0a76-0eb2-4d0a-b2de-34984a9960dd tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:41.800306 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ba1b0a76-0eb2-4d0a-b2de-34984a9960dd tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22145c653c804031ae233de6d84647fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1c70903c3d42d790d9ef96adc1fdbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:41.812795 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ba1b0a76-0eb2-4d0a-b2de-34984a9960dd tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] 10.222.0.27 "GET /compute/v2.1/servers/9e4282f7-daab-454b-93e5-7854754316c8" status: 200 len: 1270 microversion: 2.1 time: 0.153254 Sep 08 10:55:41.825824 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1935/3939] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:41 2022] GET /compute/v2.1/servers/9e4282f7-daab-454b-93e5-7854754316c8 => generated 1270 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:41.874147 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8c04456c-fa3c-42ad-a896-0cd185af1e25 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:41.875606 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8c04456c-fa3c-42ad-a896-0cd185af1e25 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:41.884480 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c04456c-fa3c-42ad-a896-0cd185af1e25 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:41.885379 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c04456c-fa3c-42ad-a896-0cd185af1e25 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:41.886743 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c04456c-fa3c-42ad-a896-0cd185af1e25 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:41.887727 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c04456c-fa3c-42ad-a896-0cd185af1e25 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:41.888433 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c04456c-fa3c-42ad-a896-0cd185af1e25 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:41.889080 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c04456c-fa3c-42ad-a896-0cd185af1e25 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:41.940494 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-cfa44c1c-b648-428b-ac68-77872a7bc7de tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:41.949100 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cfa44c1c-b648-428b-ac68-77872a7bc7de tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/379a5e3e-0e59-4b53-a37e-f4e9d1000eaf" status: 200 len: 1314 microversion: 2.1 time: 0.326917 Sep 08 10:55:41.967384 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2005/3940] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:41 2022] GET /compute/v2.1/servers/379a5e3e-0e59-4b53-a37e-f4e9d1000eaf => generated 1314 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:42.002132 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-56dd2e7d-022c-461b-8c43-710cb6095e63 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:42.008618 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-56dd2e7d-022c-461b-8c43-710cb6095e63 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] [instance: b8edf980-3cac-4b70-bbf2-bad0e4681366] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:42.020014 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-56dd2e7d-022c-461b-8c43-710cb6095e63 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:42.020937 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-56dd2e7d-022c-461b-8c43-710cb6095e63 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:42.022444 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-56dd2e7d-022c-461b-8c43-710cb6095e63 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:42.023384 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-56dd2e7d-022c-461b-8c43-710cb6095e63 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:42.024357 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-56dd2e7d-022c-461b-8c43-710cb6095e63 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:42.024978 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-56dd2e7d-022c-461b-8c43-710cb6095e63 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:42.063556 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=100 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:55:42.548301 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-56dd2e7d-022c-461b-8c43-710cb6095e63 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89f6def8f54778b80b315f2eb0c9b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da8b15686cd4d688a48e857fb16e4cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:42.563954 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-56dd2e7d-022c-461b-8c43-710cb6095e63 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] 10.222.0.27 "GET /compute/v2.1/servers/b8edf980-3cac-4b70-bbf2-bad0e4681366" status: 200 len: 1325 microversion: 2.1 time: 0.580421 Sep 08 10:55:42.568066 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2006/3941] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:41 2022] GET /compute/v2.1/servers/b8edf980-3cac-4b70-bbf2-bad0e4681366 => generated 1325 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:42.574072 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2c28facb-d180-41fc-9ba8-9457e60e1aa3 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:42.574610 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2c28facb-d180-41fc-9ba8-9457e60e1aa3 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] [instance: b7e97718-dc14-4e93-b7b3-49a8d8e03bb9] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:42.584057 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2c28facb-d180-41fc-9ba8-9457e60e1aa3 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:42.584577 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2c28facb-d180-41fc-9ba8-9457e60e1aa3 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:42.585046 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2c28facb-d180-41fc-9ba8-9457e60e1aa3 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:42.585772 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2c28facb-d180-41fc-9ba8-9457e60e1aa3 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:42.586232 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2c28facb-d180-41fc-9ba8-9457e60e1aa3 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:42.586663 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2c28facb-d180-41fc-9ba8-9457e60e1aa3 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:42.603434 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-2c28facb-d180-41fc-9ba8-9457e60e1aa3 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] HTTP exception thrown: Instance b7e97718-dc14-4e93-b7b3-49a8d8e03bb9 could not be found. Sep 08 10:55:42.605505 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2c28facb-d180-41fc-9ba8-9457e60e1aa3 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Request method failure captured: Sep 08 10:55:42.605505 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/b7e97718-dc14-4e93-b7b3-49a8d8e03bb9 HTTP/1.1 Sep 08 10:55:42.605505 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:55:42.605505 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:55:42.605505 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:55:42.605505 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:55:42.605505 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:55:42.605505 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:55:42.605505 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:55:42.605505 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:55:42.605505 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcnTIBfdH5H0Q1rMlbnLYZQcAnuATI-6ncC0ETqGOy19nshWBWc6mMSPvOE_5zGIQBC9DCOSD4SaG9XyRLj03fab4bxuKCvYlxZzzB9WEeCTo5mGH1uU5x9CALWtC8B7Wu8ih4rvxppcLmpz4ET9xD3ym8uzzB22kwTIB3vo0v5dqyY Sep 08 10:55:42.605505 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:55:42.605505 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:55:42.605505 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:55:42.605505 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:55:42.605505 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:55:42.605505 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:55:42.605505 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 0958700fa94b42b2b6b47af40cf2f679 Sep 08 10:55:42.605505 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-SecurityGroupsTestJSON-353861575 Sep 08 10:55:42.605505 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:55:42.605505 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:55:42.605505 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0958700fa94b42b2b6b47af40cf2f679"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0958700fa94b42b2b6b47af40cf2f679"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0958700fa94b42b2b6b47af40cf2f679"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0958700fa94b42b2b6b47af40cf2f679"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:55:42.605505 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-SecurityGroupsTestJSON-353861575 Sep 08 10:55:42.605505 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 0958700fa94b42b2b6b47af40cf2f679 Sep 08 10:55:42.605505 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-353861575 Sep 08 10:55:42.605505 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-SecurityGroupsTestJSON-353861575-project Sep 08 10:55:42.605505 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:55:42.605505 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:55:42.605505 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: e1bec228c17647bba62ba7d57d28e4ed Sep 08 10:55:42.605505 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-SecurityGroupsTestJSON-353861575-project Sep 08 10:55:42.605505 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:55:42.605505 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance b7e97718-dc14-4e93-b7b3-49a8d8e03bb9 could not be found. Sep 08 10:55:42.605505 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': 'b7e97718-dc14-4e93-b7b3-49a8d8e03bb9'} Sep 08 10:55:42.605505 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:55:42.605505 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:42.605505 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:55:42.605505 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:55:42.605505 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:55:42.605505 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:55:42.605505 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:55:42.605505 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:55:42.605505 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:55:42.605505 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:55:42.605505 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7e97718-dc14-4e93-b7b3-49a8d8e03bb9 could not be found. Sep 08 10:55:42.605505 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:42.605505 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:42.605505 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:42.605505 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:42.605505 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:55:42.605505 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:55:42.605505 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:55:42.605505 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:55:42.605505 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:55:42.605505 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:55:42.605505 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:55:42.605505 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:55:42.605505 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:55:42.605505 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:55:42.605505 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:55:42.605505 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:55:42.605505 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7e97718-dc14-4e93-b7b3-49a8d8e03bb9 could not be found. Sep 08 10:55:42.605505 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:42.605505 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:42.605505 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:42.611725 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:42.611725 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:55:42.611725 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:55:42.611725 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:55:42.611725 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:55:42.611725 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7e97718-dc14-4e93-b7b3-49a8d8e03bb9 could not be found. Sep 08 10:55:42.611725 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:42.614466 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2c28facb-d180-41fc-9ba8-9457e60e1aa3 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Returning 404 to user: Instance b7e97718-dc14-4e93-b7b3-49a8d8e03bb9 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:55:42.615549 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2c28facb-d180-41fc-9ba8-9457e60e1aa3 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "GET /compute/v2.1/servers/b7e97718-dc14-4e93-b7b3-49a8d8e03bb9" status: 404 len: 111 microversion: 2.1 time: 0.045875 Sep 08 10:55:42.616465 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2007/3942] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:42 2022] GET /compute/v2.1/servers/b7e97718-dc14-4e93-b7b3-49a8d8e03bb9 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:55:42.626619 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2d099472-e264-4721-a172-0f5edc0d6dcb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:42.628135 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2d099472-e264-4721-a172-0f5edc0d6dcb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:42.641959 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2d099472-e264-4721-a172-0f5edc0d6dcb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:42.643247 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2d099472-e264-4721-a172-0f5edc0d6dcb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:42.644646 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2d099472-e264-4721-a172-0f5edc0d6dcb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:42.646394 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2d099472-e264-4721-a172-0f5edc0d6dcb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:42.647505 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2d099472-e264-4721-a172-0f5edc0d6dcb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:42.648523 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2d099472-e264-4721-a172-0f5edc0d6dcb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:42.793330 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8c04456c-fa3c-42ad-a896-0cd185af1e25 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:42.806892 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8c04456c-fa3c-42ad-a896-0cd185af1e25 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:42.808546 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8c04456c-fa3c-42ad-a896-0cd185af1e25 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:42.810134 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8c04456c-fa3c-42ad-a896-0cd185af1e25 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 200 len: 2547 microversion: 2.32 time: 0.942344 Sep 08 10:55:42.828480 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1936/3943] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:55:41 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 2547 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:55:42.837798 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8f5ba72c-f8bb-4b3f-954a-5877ff58ed2b tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Calling method '.version_select at 0x7f68e491bc10>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:42.960570 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2d099472-e264-4721-a172-0f5edc0d6dcb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:42.984656 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2d099472-e264-4721-a172-0f5edc0d6dcb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1510 microversion: 2.1 time: 0.366961 Sep 08 10:55:42.995083 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2008/3944] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:42 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1510 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:43.010360 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d182da59-fc0e-4276-9a1d-3d9222bf7c09 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:43.011195 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d182da59-fc0e-4276-9a1d-3d9222bf7c09 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: 93d05d86-99b6-43f0-83c7-257ab64a12f3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:43.028693 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d182da59-fc0e-4276-9a1d-3d9222bf7c09 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:43.030273 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d182da59-fc0e-4276-9a1d-3d9222bf7c09 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:43.031220 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d182da59-fc0e-4276-9a1d-3d9222bf7c09 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:43.032029 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d182da59-fc0e-4276-9a1d-3d9222bf7c09 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:43.032975 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d182da59-fc0e-4276-9a1d-3d9222bf7c09 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:43.033695 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d182da59-fc0e-4276-9a1d-3d9222bf7c09 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:43.266774 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d182da59-fc0e-4276-9a1d-3d9222bf7c09 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:43.289448 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d182da59-fc0e-4276-9a1d-3d9222bf7c09 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3" status: 200 len: 1735 microversion: 2.1 time: 0.292269 Sep 08 10:55:43.291018 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2009/3945] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:42 2022] GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3 => generated 1735 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:43.298937 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9f8788f2-6142-4d16-8bf5-b54fedadf531 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:43.299871 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9f8788f2-6142-4d16-8bf5-b54fedadf531 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] [instance: 9e4282f7-daab-454b-93e5-7854754316c8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:43.312840 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f8788f2-6142-4d16-8bf5-b54fedadf531 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:43.313601 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f8788f2-6142-4d16-8bf5-b54fedadf531 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:43.314078 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f8788f2-6142-4d16-8bf5-b54fedadf531 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:43.314941 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f8788f2-6142-4d16-8bf5-b54fedadf531 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:43.315700 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f8788f2-6142-4d16-8bf5-b54fedadf531 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:43.316156 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f8788f2-6142-4d16-8bf5-b54fedadf531 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:43.631996 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8f5ba72c-f8bb-4b3f-954a-5877ff58ed2b tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/9abcfaa8-eed1-428d-a9ef-d3953e75ba6d" status: 202 len: 0 microversion: 2.1 time: 0.802327 Sep 08 10:55:43.633304 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1937/3946] 10.222.0.27 () {58 vars in 1272 bytes} [Thu Sep 8 10:55:42 2022] DELETE /compute/v2.1/os-security-groups/9abcfaa8-eed1-428d-a9ef-d3953e75ba6d => generated 0 bytes in 804 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:55:43.639787 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9172791f-6472-4263-be60-56fe68295316 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:43.642206 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9172791f-6472-4263-be60-56fe68295316 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 379a5e3e-0e59-4b53-a37e-f4e9d1000eaf] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:43.650142 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9172791f-6472-4263-be60-56fe68295316 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:43.654268 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9172791f-6472-4263-be60-56fe68295316 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:43.657193 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9172791f-6472-4263-be60-56fe68295316 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:43.658447 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9172791f-6472-4263-be60-56fe68295316 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:43.659412 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9172791f-6472-4263-be60-56fe68295316 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:43.660287 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9172791f-6472-4263-be60-56fe68295316 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:43.762042 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9f8788f2-6142-4d16-8bf5-b54fedadf531 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22145c653c804031ae233de6d84647fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1c70903c3d42d790d9ef96adc1fdbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:43.778303 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9f8788f2-6142-4d16-8bf5-b54fedadf531 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] 10.222.0.27 "GET /compute/v2.1/servers/9e4282f7-daab-454b-93e5-7854754316c8" status: 200 len: 1333 microversion: 2.1 time: 0.485936 Sep 08 10:55:43.796198 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2010/3947] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:43 2022] GET /compute/v2.1/servers/9e4282f7-daab-454b-93e5-7854754316c8 => generated 1333 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:43.804366 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-ca0b8dfe-320a-43db-a34c-f2f5140c699a req-a82fb9c9-d333-4a0c-ba1a-3f8c1d88bc20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8edf980-3cac-4b70-bbf2-bad0e4681366", "name": "network-vif-plugged", "status": "completed", "tag": "1cfa6b3e-b72b-4178-b6f3-3e1870fd236b"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:55:43.817339 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-ca0b8dfe-320a-43db-a34c-f2f5140c699a req-a82fb9c9-d333-4a0c-ba1a-3f8c1d88bc20 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:43.818206 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-ca0b8dfe-320a-43db-a34c-f2f5140c699a req-a82fb9c9-d333-4a0c-ba1a-3f8c1d88bc20 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:43.818643 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-ca0b8dfe-320a-43db-a34c-f2f5140c699a req-a82fb9c9-d333-4a0c-ba1a-3f8c1d88bc20 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:43.832423 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-ca0b8dfe-320a-43db-a34c-f2f5140c699a req-a82fb9c9-d333-4a0c-ba1a-3f8c1d88bc20 service nova] Creating event network-vif-plugged:1cfa6b3e-b72b-4178-b6f3-3e1870fd236b for instance b8edf980-3cac-4b70-bbf2-bad0e4681366 on n-h1-850501-12 Sep 08 10:55:43.838212 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-ca0b8dfe-320a-43db-a34c-f2f5140c699a req-a82fb9c9-d333-4a0c-ba1a-3f8c1d88bc20 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040613 Sep 08 10:55:43.839261 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2011/3948] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:55:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:55:43.847190 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6b88f794-a82b-4991-8adf-228c24346bee tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:43.848061 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6b88f794-a82b-4991-8adf-228c24346bee tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] [instance: b8edf980-3cac-4b70-bbf2-bad0e4681366] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:43.855721 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6b88f794-a82b-4991-8adf-228c24346bee tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:43.856334 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6b88f794-a82b-4991-8adf-228c24346bee tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:43.856979 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6b88f794-a82b-4991-8adf-228c24346bee tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:43.858045 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6b88f794-a82b-4991-8adf-228c24346bee tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:43.858575 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6b88f794-a82b-4991-8adf-228c24346bee tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:43.859061 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6b88f794-a82b-4991-8adf-228c24346bee tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:44.046835 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9172791f-6472-4263-be60-56fe68295316 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:44.065698 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9172791f-6472-4263-be60-56fe68295316 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/379a5e3e-0e59-4b53-a37e-f4e9d1000eaf" status: 200 len: 1501 microversion: 2.1 time: 0.425465 Sep 08 10:55:44.066743 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1938/3949] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:43 2022] GET /compute/v2.1/servers/379a5e3e-0e59-4b53-a37e-f4e9d1000eaf => generated 1501 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:44.072417 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-73d78e57-191d-4172-b920-aec9b855d1c9 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Calling method '.version_select at 0x7f68e45cb700>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:44.482627 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6b88f794-a82b-4991-8adf-228c24346bee tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89f6def8f54778b80b315f2eb0c9b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da8b15686cd4d688a48e857fb16e4cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:44.496217 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6b88f794-a82b-4991-8adf-228c24346bee tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] 10.222.0.27 "GET /compute/v2.1/servers/b8edf980-3cac-4b70-bbf2-bad0e4681366" status: 200 len: 1325 microversion: 2.1 time: 0.655437 Sep 08 10:55:44.516564 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2012/3950] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:43 2022] GET /compute/v2.1/servers/b8edf980-3cac-4b70-bbf2-bad0e4681366 => generated 1325 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:44.522236 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-b46f8a40-59a6-416a-ae2f-f35b916faab6 req-01d9367f-9ad7-4d97-99c6-bb94ee2837c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98277784-8e48-4a7b-8786-ce579e1d5ccf", "name": "network-vif-deleted", "tag": "576874d5-b1a3-4dba-862f-855bbc5a1c03"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:55:44.532832 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-b46f8a40-59a6-416a-ae2f-f35b916faab6 req-01d9367f-9ad7-4d97-99c6-bb94ee2837c0 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:44.533641 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-b46f8a40-59a6-416a-ae2f-f35b916faab6 req-01d9367f-9ad7-4d97-99c6-bb94ee2837c0 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:44.534071 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-b46f8a40-59a6-416a-ae2f-f35b916faab6 req-01d9367f-9ad7-4d97-99c6-bb94ee2837c0 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:44.547746 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-b46f8a40-59a6-416a-ae2f-f35b916faab6 req-01d9367f-9ad7-4d97-99c6-bb94ee2837c0 service nova] Creating event network-vif-deleted:576874d5-b1a3-4dba-862f-855bbc5a1c03 for instance 98277784-8e48-4a7b-8786-ce579e1d5ccf on n-h2-850501-12 Sep 08 10:55:44.553554 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-b46f8a40-59a6-416a-ae2f-f35b916faab6 req-01d9367f-9ad7-4d97-99c6-bb94ee2837c0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035744 Sep 08 10:55:44.554331 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2013/3951] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:55:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:55:44.560824 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d47ae379-bcca-429c-aa70-869ee0287576 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:44.562225 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d47ae379-bcca-429c-aa70-869ee0287576 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:44.571704 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d47ae379-bcca-429c-aa70-869ee0287576 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:44.572550 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d47ae379-bcca-429c-aa70-869ee0287576 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:44.573272 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d47ae379-bcca-429c-aa70-869ee0287576 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:44.574240 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d47ae379-bcca-429c-aa70-869ee0287576 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:44.574924 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d47ae379-bcca-429c-aa70-869ee0287576 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:44.575589 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d47ae379-bcca-429c-aa70-869ee0287576 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:44.806525 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d47ae379-bcca-429c-aa70-869ee0287576 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:44.820204 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-73d78e57-191d-4172-b920-aec9b855d1c9 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/6f3b2b1f-362f-4566-a774-9c795703ef36" status: 202 len: 0 microversion: 2.1 time: 0.752069 Sep 08 10:55:44.820809 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1939/3952] 10.222.0.27 () {58 vars in 1272 bytes} [Thu Sep 8 10:55:44 2022] DELETE /compute/v2.1/os-security-groups/6f3b2b1f-362f-4566-a774-9c795703ef36 => generated 0 bytes in 753 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:55:44.826710 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f5c3de53-22c3-4171-a6dd-6f59eb00681d tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:44.828410 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f5c3de53-22c3-4171-a6dd-6f59eb00681d tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:44.836180 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f5c3de53-22c3-4171-a6dd-6f59eb00681d tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:44.837040 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f5c3de53-22c3-4171-a6dd-6f59eb00681d tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:44.837818 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d47ae379-bcca-429c-aa70-869ee0287576 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:44.838488 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f5c3de53-22c3-4171-a6dd-6f59eb00681d tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:44.839597 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f5c3de53-22c3-4171-a6dd-6f59eb00681d tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:44.840238 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f5c3de53-22c3-4171-a6dd-6f59eb00681d tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:44.841730 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f5c3de53-22c3-4171-a6dd-6f59eb00681d tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:44.844043 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d47ae379-bcca-429c-aa70-869ee0287576 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:44.857843 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d47ae379-bcca-429c-aa70-869ee0287576 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 200 len: 2501 microversion: 2.32 time: 0.300190 Sep 08 10:55:44.858481 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2014/3953] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:55:44 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 2501 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:55:44.870437 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-282a8b2f-c180-422d-b7e3-423fcecdd540 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:55:44.889154 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-282a8b2f-c180-422d-b7e3-423fcecdd540 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:44.893354 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-282a8b2f-c180-422d-b7e3-423fcecdd540 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:44.893354 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-282a8b2f-c180-422d-b7e3-423fcecdd540 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:44.947379 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-282a8b2f-c180-422d-b7e3-423fcecdd540 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 379a5e3e-0e59-4b53-a37e-f4e9d1000eaf] Going to try to stop instance {{(pid=128861) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 08 10:55:45.055846 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-282a8b2f-c180-422d-b7e3-423fcecdd540 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "POST /compute/v2.1/servers/379a5e3e-0e59-4b53-a37e-f4e9d1000eaf/action" status: 202 len: 0 microversion: 2.1 time: 0.193784 Sep 08 10:55:45.057179 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2015/3954] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:55:44 2022] POST /compute/v2.1/servers/379a5e3e-0e59-4b53-a37e-f4e9d1000eaf/action => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:55:45.066615 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-41305031-78ab-489e-9fb1-8a469e148e12 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:45.067974 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-41305031-78ab-489e-9fb1-8a469e148e12 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: 93d05d86-99b6-43f0-83c7-257ab64a12f3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:45.076733 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41305031-78ab-489e-9fb1-8a469e148e12 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:45.079767 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41305031-78ab-489e-9fb1-8a469e148e12 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:45.081420 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41305031-78ab-489e-9fb1-8a469e148e12 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:45.083559 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41305031-78ab-489e-9fb1-8a469e148e12 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:45.086956 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41305031-78ab-489e-9fb1-8a469e148e12 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:45.088220 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41305031-78ab-489e-9fb1-8a469e148e12 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:45.193504 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f5c3de53-22c3-4171-a6dd-6f59eb00681d tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:45.203158 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f5c3de53-22c3-4171-a6dd-6f59eb00681d tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1510 microversion: 2.1 time: 0.380307 Sep 08 10:55:45.226008 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1940/3955] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:44 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1510 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:45.231310 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-40706ece-c9b8-40e9-8b56-2465c666618d tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:45.231950 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-40706ece-c9b8-40e9-8b56-2465c666618d tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] [instance: 9e4282f7-daab-454b-93e5-7854754316c8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:45.255409 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-40706ece-c9b8-40e9-8b56-2465c666618d tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:45.255930 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-40706ece-c9b8-40e9-8b56-2465c666618d tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:45.256382 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-40706ece-c9b8-40e9-8b56-2465c666618d tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:45.257189 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-40706ece-c9b8-40e9-8b56-2465c666618d tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:45.257665 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-40706ece-c9b8-40e9-8b56-2465c666618d tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:45.258374 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-40706ece-c9b8-40e9-8b56-2465c666618d tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:45.403016 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-41305031-78ab-489e-9fb1-8a469e148e12 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:45.414839 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-41305031-78ab-489e-9fb1-8a469e148e12 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3" status: 200 len: 1735 microversion: 2.1 time: 0.355659 Sep 08 10:55:45.416111 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2016/3956] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:45 2022] GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3 => generated 1735 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:45.431743 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7f22d451-8291-4b72-ae54-28a82d83a690 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Action: 'create', calling method: .version_select at 0x7f68df9ebb80>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1973611472", "description": "tempest-description-371167101"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:55:45.567197 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-40706ece-c9b8-40e9-8b56-2465c666618d tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22145c653c804031ae233de6d84647fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1c70903c3d42d790d9ef96adc1fdbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:45.578433 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-40706ece-c9b8-40e9-8b56-2465c666618d tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] 10.222.0.27 "GET /compute/v2.1/servers/9e4282f7-daab-454b-93e5-7854754316c8" status: 200 len: 1354 microversion: 2.1 time: 0.350934 Sep 08 10:55:45.579765 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1941/3957] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:45 2022] GET /compute/v2.1/servers/9e4282f7-daab-454b-93e5-7854754316c8 => generated 1354 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:45.587015 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9738f5d4-d3f6-473e-a173-c4e3909e8fd6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:45.587734 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9738f5d4-d3f6-473e-a173-c4e3909e8fd6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 379a5e3e-0e59-4b53-a37e-f4e9d1000eaf] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:45.595535 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9738f5d4-d3f6-473e-a173-c4e3909e8fd6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:45.596240 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9738f5d4-d3f6-473e-a173-c4e3909e8fd6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:45.609837 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9738f5d4-d3f6-473e-a173-c4e3909e8fd6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:45.611087 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9738f5d4-d3f6-473e-a173-c4e3909e8fd6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:45.617840 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9738f5d4-d3f6-473e-a173-c4e3909e8fd6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:45.618761 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9738f5d4-d3f6-473e-a173-c4e3909e8fd6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:46.041481 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9738f5d4-d3f6-473e-a173-c4e3909e8fd6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:46.074243 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9738f5d4-d3f6-473e-a173-c4e3909e8fd6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/379a5e3e-0e59-4b53-a37e-f4e9d1000eaf" status: 200 len: 1511 microversion: 2.1 time: 0.492527 Sep 08 10:55:46.075986 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1942/3958] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:45 2022] GET /compute/v2.1/servers/379a5e3e-0e59-4b53-a37e-f4e9d1000eaf => generated 1511 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:46.085820 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e044499d-c76b-4688-b6ab-db1302266dfa tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:46.087135 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e044499d-c76b-4688-b6ab-db1302266dfa tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] [instance: b8edf980-3cac-4b70-bbf2-bad0e4681366] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:46.098687 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e044499d-c76b-4688-b6ab-db1302266dfa tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:46.099752 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e044499d-c76b-4688-b6ab-db1302266dfa tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:46.100665 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e044499d-c76b-4688-b6ab-db1302266dfa tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:46.101939 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e044499d-c76b-4688-b6ab-db1302266dfa tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:46.102695 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e044499d-c76b-4688-b6ab-db1302266dfa tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:46.103412 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e044499d-c76b-4688-b6ab-db1302266dfa tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:46.134707 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7f22d451-8291-4b72-ae54-28a82d83a690 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.717127 Sep 08 10:55:46.135936 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2017/3959] 10.222.0.27 () {60 vars in 1180 bytes} [Thu Sep 8 10:55:45 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:55:46.145329 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b53c3073-7557-47f9-839c-d618474d8a02 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:46.146619 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b53c3073-7557-47f9-839c-d618474d8a02 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:46.169766 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b53c3073-7557-47f9-839c-d618474d8a02 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:46.171679 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b53c3073-7557-47f9-839c-d618474d8a02 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:46.175247 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b53c3073-7557-47f9-839c-d618474d8a02 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:46.176738 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b53c3073-7557-47f9-839c-d618474d8a02 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:46.179376 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b53c3073-7557-47f9-839c-d618474d8a02 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:46.181253 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b53c3073-7557-47f9-839c-d618474d8a02 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:46.313994 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b53c3073-7557-47f9-839c-d618474d8a02 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:46.346898 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b53c3073-7557-47f9-839c-d618474d8a02 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:46.353874 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b53c3073-7557-47f9-839c-d618474d8a02 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:46.356452 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b53c3073-7557-47f9-839c-d618474d8a02 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 200 len: 1605 microversion: 2.32 time: 0.218194 Sep 08 10:55:46.357384 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2018/3960] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:55:46 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 1605 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:55:46.369837 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4be81acc-1d57-48d0-8c83-f8a819b2614b tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Action: 'update', calling method: .version_select at 0x7f68df9ebc10>, body: {"security_group": {"name": "tempest-sg-hth-551314277", "description": "tempest-description-hth-988119483"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:55:46.419135 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e044499d-c76b-4688-b6ab-db1302266dfa tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89f6def8f54778b80b315f2eb0c9b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da8b15686cd4d688a48e857fb16e4cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:46.433316 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e044499d-c76b-4688-b6ab-db1302266dfa tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] 10.222.0.27 "GET /compute/v2.1/servers/b8edf980-3cac-4b70-bbf2-bad0e4681366" status: 200 len: 1523 microversion: 2.1 time: 0.354901 Sep 08 10:55:46.442701 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1943/3961] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:46 2022] GET /compute/v2.1/servers/b8edf980-3cac-4b70-bbf2-bad0e4681366 => generated 1523 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:46.447784 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0db574b7-2b44-4184-90fc-ec49f69e119b tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:46.448523 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0db574b7-2b44-4184-90fc-ec49f69e119b tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:46.473549 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0db574b7-2b44-4184-90fc-ec49f69e119b tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:46.474310 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0db574b7-2b44-4184-90fc-ec49f69e119b tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:46.474900 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0db574b7-2b44-4184-90fc-ec49f69e119b tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:46.475748 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0db574b7-2b44-4184-90fc-ec49f69e119b tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:46.477154 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0db574b7-2b44-4184-90fc-ec49f69e119b tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:46.477943 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0db574b7-2b44-4184-90fc-ec49f69e119b tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:46.705787 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0db574b7-2b44-4184-90fc-ec49f69e119b tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:46.716603 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0db574b7-2b44-4184-90fc-ec49f69e119b tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1510 microversion: 2.1 time: 0.272877 Sep 08 10:55:46.723780 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1944/3962] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:46 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1510 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:46.739810 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ed9a93bb-1b10-48f4-88ad-73bc0c83a406 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:46.743919 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ed9a93bb-1b10-48f4-88ad-73bc0c83a406 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: 93d05d86-99b6-43f0-83c7-257ab64a12f3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:46.774164 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ed9a93bb-1b10-48f4-88ad-73bc0c83a406 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:46.774838 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ed9a93bb-1b10-48f4-88ad-73bc0c83a406 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:46.775451 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ed9a93bb-1b10-48f4-88ad-73bc0c83a406 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:46.779010 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ed9a93bb-1b10-48f4-88ad-73bc0c83a406 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:46.779722 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ed9a93bb-1b10-48f4-88ad-73bc0c83a406 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:46.781920 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4be81acc-1d57-48d0-8c83-f8a819b2614b tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "PUT /compute/v2.1/os-security-groups/29733b92-cc3b-4898-8789-defb06a8b325" status: 200 len: 216 microversion: 2.1 time: 0.422539 Sep 08 10:55:46.783134 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ed9a93bb-1b10-48f4-88ad-73bc0c83a406 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:46.784097 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2019/3963] 10.222.0.27 () {60 vars in 1290 bytes} [Thu Sep 8 10:55:46 2022] PUT /compute/v2.1/os-security-groups/29733b92-cc3b-4898-8789-defb06a8b325 => generated 216 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:55:46.805397 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-34268ff7-a1e8-4740-bd57-03305e4f595f tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:46.806295 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-34268ff7-a1e8-4740-bd57-03305e4f595f tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] [instance: b8edf980-3cac-4b70-bbf2-bad0e4681366] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:46.829425 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-34268ff7-a1e8-4740-bd57-03305e4f595f tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:46.832146 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-34268ff7-a1e8-4740-bd57-03305e4f595f tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:46.832604 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-34268ff7-a1e8-4740-bd57-03305e4f595f tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:46.835064 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-34268ff7-a1e8-4740-bd57-03305e4f595f tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:46.838246 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-34268ff7-a1e8-4740-bd57-03305e4f595f tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:46.839935 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-34268ff7-a1e8-4740-bd57-03305e4f595f tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:46.954630 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-34268ff7-a1e8-4740-bd57-03305e4f595f tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] HTTP exception thrown: Instance is not a member of specified network Sep 08 10:55:46.963964 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-34268ff7-a1e8-4740-bd57-03305e4f595f tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Request method failure captured: Sep 08 10:55:46.963964 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/b8edf980-3cac-4b70-bbf2-bad0e4681366/ips/invalid HTTP/1.1 Sep 08 10:55:46.963964 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:55:46.963964 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:55:46.963964 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:55:46.963964 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:55:46.963964 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:55:46.963964 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:55:46.963964 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:55:46.963964 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:55:46.963964 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcoVlcfMWzdVuDQg7vWFqQQFDtU3VeE8k9GtY9VXHJ5AO064Rinh5_6LtM43avMwWZAqAcmfs2dkE140ZBopWPpL6yY2E9XG-QcbU6IiQmkCSPig7329idCYmNEYxF4tkaqq-gf3RKzIRRUbriIA4nWBxRVw49p8wbYECrvlHwD682I Sep 08 10:55:46.963964 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:55:46.963964 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:55:46.963964 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:55:46.963964 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:55:46.963964 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:55:46.963964 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:55:46.963964 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 4da8b15686cd4d688a48e857fb16e4cf Sep 08 10:55:46.963964 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-869175413 Sep 08 10:55:46.963964 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:55:46.963964 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:55:46.963964 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4da8b15686cd4d688a48e857fb16e4cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4da8b15686cd4d688a48e857fb16e4cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4da8b15686cd4d688a48e857fb16e4cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4da8b15686cd4d688a48e857fb16e4cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:55:46.963964 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-869175413 Sep 08 10:55:46.963964 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 4da8b15686cd4d688a48e857fb16e4cf Sep 08 10:55:46.963964 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-869175413 Sep 08 10:55:46.963964 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServerAddressesNegativeTestJSON-869175413-project Sep 08 10:55:46.963964 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:55:46.963964 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:55:46.963964 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: ad89f6def8f54778b80b315f2eb0c9b5 Sep 08 10:55:46.963964 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-869175413-project Sep 08 10:55:46.963964 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:55:46.963964 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance is not a member of specified network Sep 08 10:55:46.963964 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'server_id': 'b8edf980-3cac-4b70-bbf2-bad0e4681366', 'id': 'invalid'} Sep 08 10:55:46.963964 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:55:46.963964 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:46.963964 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:55:46.963964 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:55:46.963964 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:55:46.963964 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:55:46.963964 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:55:46.963964 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:55:46.963964 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Sep 08 10:55:46.963964 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 08 10:55:46.963964 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Sep 08 10:55:46.963964 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:46.963964 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:46.963964 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:46.963964 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:46.963964 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:55:46.963964 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:55:46.963964 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:55:46.963964 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:55:46.963964 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Sep 08 10:55:46.963964 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:46.969951 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-34268ff7-a1e8-4740-bd57-03305e4f595f tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Returning 404 to user: Instance is not a member of specified network {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:55:46.969951 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-34268ff7-a1e8-4740-bd57-03305e4f595f tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] 10.222.0.27 "GET /compute/v2.1/servers/b8edf980-3cac-4b70-bbf2-bad0e4681366/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.179787 Sep 08 10:55:46.971092 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2020/3964] 10.222.0.27 () {58 vars in 1272 bytes} [Thu Sep 8 10:55:46 2022] GET /compute/v2.1/servers/b8edf980-3cac-4b70-bbf2-bad0e4681366/ips/invalid => generated 91 bytes in 186 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:55:46.983608 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-92e0021f-1964-4807-a75e-c73d962d5ed5 req-9b788434-10f4-4006-8761-e2ef52eca614 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98277784-8e48-4a7b-8786-ce579e1d5ccf", "name": "network-vif-deleted", "tag": "ce9f8d6e-a5be-4a31-a377-ae93ebd5bedc"}, {"server_uuid": "98277784-8e48-4a7b-8786-ce579e1d5ccf", "name": "network-vif-deleted", "tag": "742e7fd9-9529-4661-8ad0-c2f50b7bb9d8"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:55:47.009372 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-92e0021f-1964-4807-a75e-c73d962d5ed5 req-9b788434-10f4-4006-8761-e2ef52eca614 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:47.009922 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-92e0021f-1964-4807-a75e-c73d962d5ed5 req-9b788434-10f4-4006-8761-e2ef52eca614 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:47.010277 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-92e0021f-1964-4807-a75e-c73d962d5ed5 req-9b788434-10f4-4006-8761-e2ef52eca614 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:47.046463 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-92e0021f-1964-4807-a75e-c73d962d5ed5 req-9b788434-10f4-4006-8761-e2ef52eca614 service nova] Creating event network-vif-deleted:ce9f8d6e-a5be-4a31-a377-ae93ebd5bedc for instance 98277784-8e48-4a7b-8786-ce579e1d5ccf on n-h2-850501-12 Sep 08 10:55:47.047591 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-92e0021f-1964-4807-a75e-c73d962d5ed5 req-9b788434-10f4-4006-8761-e2ef52eca614 service nova] Creating event network-vif-deleted:742e7fd9-9529-4661-8ad0-c2f50b7bb9d8 for instance 98277784-8e48-4a7b-8786-ce579e1d5ccf on n-h2-850501-12 Sep 08 10:55:47.060075 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-92e0021f-1964-4807-a75e-c73d962d5ed5 req-9b788434-10f4-4006-8761-e2ef52eca614 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.087493 Sep 08 10:55:47.063285 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2021/3965] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:55:46 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:55:47.079436 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-39c71172-0e99-476e-9823-79c380a1cb46 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:47.083216 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-39c71172-0e99-476e-9823-79c380a1cb46 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] [instance: 9e4282f7-daab-454b-93e5-7854754316c8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:47.109975 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-39c71172-0e99-476e-9823-79c380a1cb46 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:47.113712 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-39c71172-0e99-476e-9823-79c380a1cb46 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:47.115142 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-39c71172-0e99-476e-9823-79c380a1cb46 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:47.118942 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-39c71172-0e99-476e-9823-79c380a1cb46 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:47.135377 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-39c71172-0e99-476e-9823-79c380a1cb46 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:47.137167 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-39c71172-0e99-476e-9823-79c380a1cb46 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:47.187101 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ed9a93bb-1b10-48f4-88ad-73bc0c83a406 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:47.199973 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ed9a93bb-1b10-48f4-88ad-73bc0c83a406 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3" status: 200 len: 1735 microversion: 2.1 time: 0.474633 Sep 08 10:55:47.216031 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1945/3966] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:46 2022] GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3 => generated 1735 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:47.231806 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ea130b3b-d431-4c45-abdf-3b7b629ff38a tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Calling method '.version_select at 0x7f68e8b30280>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:47.323646 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ea130b3b-d431-4c45-abdf-3b7b629ff38a tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/29733b92-cc3b-4898-8789-defb06a8b325" status: 200 len: 216 microversion: 2.1 time: 0.105204 Sep 08 10:55:47.330035 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1946/3967] 10.222.0.27 () {58 vars in 1269 bytes} [Thu Sep 8 10:55:47 2022] GET /compute/v2.1/os-security-groups/29733b92-cc3b-4898-8789-defb06a8b325 => generated 216 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:55:47.336444 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0f9f4662-0e9d-406b-b4c8-7d089814888f tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:47.337345 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0f9f4662-0e9d-406b-b4c8-7d089814888f tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Failed to fetch instance by id 999 {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 08 10:55:47.338054 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-0f9f4662-0e9d-406b-b4c8-7d089814888f tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] HTTP exception thrown: Instance 999 could not be found. Sep 08 10:55:47.342582 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0f9f4662-0e9d-406b-b4c8-7d089814888f tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Request method failure captured: Sep 08 10:55:47.342582 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Sep 08 10:55:47.342582 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:55:47.342582 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:55:47.342582 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:55:47.342582 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:55:47.342582 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:55:47.342582 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:55:47.342582 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:55:47.342582 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:55:47.342582 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcoVlcfMWzdVuDQg7vWFqQQFDtU3VeE8k9GtY9VXHJ5AO064Rinh5_6LtM43avMwWZAqAcmfs2dkE140ZBopWPpL6yY2E9XG-QcbU6IiQmkCSPig7329idCYmNEYxF4tkaqq-gf3RKzIRRUbriIA4nWBxRVw49p8wbYECrvlHwD682I Sep 08 10:55:47.342582 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:55:47.342582 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:55:47.342582 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:55:47.342582 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:55:47.342582 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:55:47.342582 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:55:47.342582 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 4da8b15686cd4d688a48e857fb16e4cf Sep 08 10:55:47.342582 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-869175413 Sep 08 10:55:47.342582 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:55:47.342582 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:55:47.342582 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4da8b15686cd4d688a48e857fb16e4cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4da8b15686cd4d688a48e857fb16e4cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4da8b15686cd4d688a48e857fb16e4cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4da8b15686cd4d688a48e857fb16e4cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:55:47.342582 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-869175413 Sep 08 10:55:47.342582 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 4da8b15686cd4d688a48e857fb16e4cf Sep 08 10:55:47.342582 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-869175413 Sep 08 10:55:47.342582 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServerAddressesNegativeTestJSON-869175413-project Sep 08 10:55:47.342582 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:55:47.342582 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:55:47.342582 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: ad89f6def8f54778b80b315f2eb0c9b5 Sep 08 10:55:47.342582 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-869175413-project Sep 08 10:55:47.342582 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:55:47.342582 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 999 could not be found. Sep 08 10:55:47.342582 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'server_id': '999'} Sep 08 10:55:47.342582 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:55:47.342582 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:47.342582 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:55:47.342582 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:55:47.342582 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 08 10:55:47.342582 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 08 10:55:47.342582 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Sep 08 10:55:47.342582 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:47.342582 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:47.342582 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:47.342582 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:47.342582 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:55:47.342582 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:55:47.342582 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:55:47.342582 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:55:47.342582 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:55:47.342582 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:55:47.342582 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Sep 08 10:55:47.342582 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Sep 08 10:55:47.342582 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:55:47.342582 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:55:47.342582 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Sep 08 10:55:47.342582 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:47.342582 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:47.342582 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:47.342582 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:47.342582 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:55:47.342582 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:55:47.342582 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:55:47.342582 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:55:47.342582 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Sep 08 10:55:47.342582 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:47.350532 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0f9f4662-0e9d-406b-b4c8-7d089814888f tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Returning 404 to user: Instance 999 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:55:47.351604 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0f9f4662-0e9d-406b-b4c8-7d089814888f tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] 10.222.0.27 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.020066 Sep 08 10:55:47.353360 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1947/3968] 10.222.0.27 () {58 vars in 1149 bytes} [Thu Sep 8 10:55:47 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:55:47.359117 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4c899709-7a7e-4026-a33c-0c2da0eb11d4 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:47.360266 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4c899709-7a7e-4026-a33c-0c2da0eb11d4 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 379a5e3e-0e59-4b53-a37e-f4e9d1000eaf] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:47.369102 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c899709-7a7e-4026-a33c-0c2da0eb11d4 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:47.370148 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c899709-7a7e-4026-a33c-0c2da0eb11d4 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:47.372072 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c899709-7a7e-4026-a33c-0c2da0eb11d4 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:47.373164 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c899709-7a7e-4026-a33c-0c2da0eb11d4 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:47.374291 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c899709-7a7e-4026-a33c-0c2da0eb11d4 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:47.375364 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c899709-7a7e-4026-a33c-0c2da0eb11d4 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:47.681933 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4c899709-7a7e-4026-a33c-0c2da0eb11d4 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:47.699717 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4c899709-7a7e-4026-a33c-0c2da0eb11d4 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/379a5e3e-0e59-4b53-a37e-f4e9d1000eaf" status: 200 len: 1511 microversion: 2.1 time: 0.344606 Sep 08 10:55:47.701333 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1948/3969] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:47 2022] GET /compute/v2.1/servers/379a5e3e-0e59-4b53-a37e-f4e9d1000eaf => generated 1511 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:47.710140 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-8afa5410-99bd-4372-9f6f-68a09e2f1b82 req-c4149600-0780-480a-b6bf-78bbbd539beb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e4282f7-daab-454b-93e5-7854754316c8", "tag": "cf3ab348-494e-468a-b277-a1c2300a402c"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:55:47.725325 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-8afa5410-99bd-4372-9f6f-68a09e2f1b82 req-c4149600-0780-480a-b6bf-78bbbd539beb service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:47.727388 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-8afa5410-99bd-4372-9f6f-68a09e2f1b82 req-c4149600-0780-480a-b6bf-78bbbd539beb service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:47.728753 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-8afa5410-99bd-4372-9f6f-68a09e2f1b82 req-c4149600-0780-480a-b6bf-78bbbd539beb service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:47.756120 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-39c71172-0e99-476e-9823-79c380a1cb46 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22145c653c804031ae233de6d84647fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1c70903c3d42d790d9ef96adc1fdbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:47.760578 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-8afa5410-99bd-4372-9f6f-68a09e2f1b82 req-c4149600-0780-480a-b6bf-78bbbd539beb service nova] Creating event network-changed:cf3ab348-494e-468a-b277-a1c2300a402c for instance 9e4282f7-daab-454b-93e5-7854754316c8 on n-h2-850501-12 Sep 08 10:55:47.778822 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-8afa5410-99bd-4372-9f6f-68a09e2f1b82 req-c4149600-0780-480a-b6bf-78bbbd539beb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075285 Sep 08 10:55:47.782249 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1949/3970] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:55:47.782992 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-39c71172-0e99-476e-9823-79c380a1cb46 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] 10.222.0.27 "GET /compute/v2.1/servers/9e4282f7-daab-454b-93e5-7854754316c8" status: 200 len: 1354 microversion: 2.1 time: 0.717974 Sep 08 10:55:47.788505 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5c069c60-21fc-4f52-ac88-1e4d7b301dda tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Calling method '.version_select at 0x7f68e8b30e50>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:47.807413 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2022/3971] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:47 2022] GET /compute/v2.1/servers/9e4282f7-daab-454b-93e5-7854754316c8 => generated 1354 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:47.823617 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e61af3bb-4ed8-4109-add1-ba2b8de2df9a tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:47.824857 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e61af3bb-4ed8-4109-add1-ba2b8de2df9a tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] [instance: b8edf980-3cac-4b70-bbf2-bad0e4681366] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:47.840857 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e61af3bb-4ed8-4109-add1-ba2b8de2df9a tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:47.842682 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e61af3bb-4ed8-4109-add1-ba2b8de2df9a tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:47.844434 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e61af3bb-4ed8-4109-add1-ba2b8de2df9a tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:47.846187 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e61af3bb-4ed8-4109-add1-ba2b8de2df9a tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:47.854100 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e61af3bb-4ed8-4109-add1-ba2b8de2df9a tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:47.855545 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e61af3bb-4ed8-4109-add1-ba2b8de2df9a tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:47.938706 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e61af3bb-4ed8-4109-add1-ba2b8de2df9a tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] [instance: b8edf980-3cac-4b70-bbf2-bad0e4681366] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:55:48.083681 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:55:48.132800 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e61af3bb-4ed8-4109-add1-ba2b8de2df9a tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b8edf980-3cac-4b70-bbf2-bad0e4681366" status: 204 len: 0 microversion: 2.1 time: 0.317264 Sep 08 10:55:48.139621 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2023/3972] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:55:47 2022] DELETE /compute/v2.1/servers/b8edf980-3cac-4b70-bbf2-bad0e4681366 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:55:48.152994 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-65e4d18d-9044-4e4b-9068-52b376503a64 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:48.155092 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-65e4d18d-9044-4e4b-9068-52b376503a64 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:48.162477 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-65e4d18d-9044-4e4b-9068-52b376503a64 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:48.163326 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-65e4d18d-9044-4e4b-9068-52b376503a64 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:48.164000 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-65e4d18d-9044-4e4b-9068-52b376503a64 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:48.164666 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-65e4d18d-9044-4e4b-9068-52b376503a64 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:48.165165 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-65e4d18d-9044-4e4b-9068-52b376503a64 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:48.165686 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-65e4d18d-9044-4e4b-9068-52b376503a64 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:48.182804 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:55:48.229706 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:55:48.320352 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-65e4d18d-9044-4e4b-9068-52b376503a64 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:48.342764 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-65e4d18d-9044-4e4b-9068-52b376503a64 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:48.349465 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-65e4d18d-9044-4e4b-9068-52b376503a64 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:48.352163 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-65e4d18d-9044-4e4b-9068-52b376503a64 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 200 len: 1605 microversion: 2.32 time: 0.210720 Sep 08 10:55:48.353307 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2024/3973] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:55:48 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 1605 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:55:48.363956 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3c419289-423e-4f05-b2e8-68c37354f9f4 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:48.365053 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3c419289-423e-4f05-b2e8-68c37354f9f4 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:48.373966 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3c419289-423e-4f05-b2e8-68c37354f9f4 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:48.378324 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3c419289-423e-4f05-b2e8-68c37354f9f4 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:48.382095 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3c419289-423e-4f05-b2e8-68c37354f9f4 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:48.383564 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3c419289-423e-4f05-b2e8-68c37354f9f4 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:48.385858 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3c419289-423e-4f05-b2e8-68c37354f9f4 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:48.387773 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3c419289-423e-4f05-b2e8-68c37354f9f4 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:48.395506 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:55:48.641166 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5c069c60-21fc-4f52-ac88-1e4d7b301dda tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/29733b92-cc3b-4898-8789-defb06a8b325" status: 202 len: 0 microversion: 2.1 time: 0.856686 Sep 08 10:55:48.645863 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1950/3974] 10.222.0.27 () {58 vars in 1272 bytes} [Thu Sep 8 10:55:47 2022] DELETE /compute/v2.1/os-security-groups/29733b92-cc3b-4898-8789-defb06a8b325 => generated 0 bytes in 860 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:55:48.664668 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8a6870c9-b3c0-4709-ab4a-6cc845a79402 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:48.666607 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8a6870c9-b3c0-4709-ab4a-6cc845a79402 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] [instance: b8edf980-3cac-4b70-bbf2-bad0e4681366] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:48.682185 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8a6870c9-b3c0-4709-ab4a-6cc845a79402 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:48.683531 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8a6870c9-b3c0-4709-ab4a-6cc845a79402 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:48.684402 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8a6870c9-b3c0-4709-ab4a-6cc845a79402 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:48.685644 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8a6870c9-b3c0-4709-ab4a-6cc845a79402 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:48.686295 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8a6870c9-b3c0-4709-ab4a-6cc845a79402 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:48.687498 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8a6870c9-b3c0-4709-ab4a-6cc845a79402 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:48.760752 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-3c419289-423e-4f05-b2e8-68c37354f9f4 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:48.778576 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3c419289-423e-4f05-b2e8-68c37354f9f4 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1510 microversion: 2.1 time: 0.422642 Sep 08 10:55:48.799713 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2025/3975] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:48 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1510 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:48.806295 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5493c674-37cd-409e-8e44-1c75f442c9db tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:48.807392 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5493c674-37cd-409e-8e44-1c75f442c9db tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: 93d05d86-99b6-43f0-83c7-257ab64a12f3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:48.815718 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5493c674-37cd-409e-8e44-1c75f442c9db tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:48.817223 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5493c674-37cd-409e-8e44-1c75f442c9db tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:48.817798 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5493c674-37cd-409e-8e44-1c75f442c9db tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:48.818618 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5493c674-37cd-409e-8e44-1c75f442c9db tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:48.819165 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5493c674-37cd-409e-8e44-1c75f442c9db tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:48.819847 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5493c674-37cd-409e-8e44-1c75f442c9db tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:49.002553 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8a6870c9-b3c0-4709-ab4a-6cc845a79402 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89f6def8f54778b80b315f2eb0c9b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da8b15686cd4d688a48e857fb16e4cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:49.003637 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:55:49.022320 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8a6870c9-b3c0-4709-ab4a-6cc845a79402 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] 10.222.0.27 "GET /compute/v2.1/servers/b8edf980-3cac-4b70-bbf2-bad0e4681366" status: 200 len: 1529 microversion: 2.1 time: 0.377396 Sep 08 10:55:49.023586 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1951/3976] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:48 2022] GET /compute/v2.1/servers/b8edf980-3cac-4b70-bbf2-bad0e4681366 => generated 1529 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:49.028431 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fe30ba62-8df7-4f24-bc49-1cff3a2d430f tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:49.029235 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fe30ba62-8df7-4f24-bc49-1cff3a2d430f tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] [instance: b7e97718-dc14-4e93-b7b3-49a8d8e03bb9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:49.037758 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fe30ba62-8df7-4f24-bc49-1cff3a2d430f tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:49.038537 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fe30ba62-8df7-4f24-bc49-1cff3a2d430f tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:49.039164 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fe30ba62-8df7-4f24-bc49-1cff3a2d430f tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:49.040242 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fe30ba62-8df7-4f24-bc49-1cff3a2d430f tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:49.041013 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fe30ba62-8df7-4f24-bc49-1cff3a2d430f tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:49.041492 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fe30ba62-8df7-4f24-bc49-1cff3a2d430f tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:49.058213 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-fe30ba62-8df7-4f24-bc49-1cff3a2d430f tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] HTTP exception thrown: Instance b7e97718-dc14-4e93-b7b3-49a8d8e03bb9 could not be found. Sep 08 10:55:49.059823 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fe30ba62-8df7-4f24-bc49-1cff3a2d430f tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Request method failure captured: Sep 08 10:55:49.059823 n-d-850501-12 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/servers/b7e97718-dc14-4e93-b7b3-49a8d8e03bb9 HTTP/1.1 Sep 08 10:55:49.059823 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:55:49.059823 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:55:49.059823 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:55:49.059823 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:55:49.059823 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:55:49.059823 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:55:49.059823 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:55:49.059823 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:55:49.059823 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcnTIBfdH5H0Q1rMlbnLYZQcAnuATI-6ncC0ETqGOy19nshWBWc6mMSPvOE_5zGIQBC9DCOSD4SaG9XyRLj03fab4bxuKCvYlxZzzB9WEeCTo5mGH1uU5x9CALWtC8B7Wu8ih4rvxppcLmpz4ET9xD3ym8uzzB22kwTIB3vo0v5dqyY Sep 08 10:55:49.059823 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:55:49.059823 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:55:49.059823 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:55:49.059823 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:55:49.059823 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:55:49.059823 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:55:49.059823 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 0958700fa94b42b2b6b47af40cf2f679 Sep 08 10:55:49.059823 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-SecurityGroupsTestJSON-353861575 Sep 08 10:55:49.059823 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:55:49.059823 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:55:49.059823 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0958700fa94b42b2b6b47af40cf2f679"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0958700fa94b42b2b6b47af40cf2f679"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0958700fa94b42b2b6b47af40cf2f679"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0958700fa94b42b2b6b47af40cf2f679"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:55:49.059823 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-SecurityGroupsTestJSON-353861575 Sep 08 10:55:49.059823 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 0958700fa94b42b2b6b47af40cf2f679 Sep 08 10:55:49.059823 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-353861575 Sep 08 10:55:49.059823 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-SecurityGroupsTestJSON-353861575-project Sep 08 10:55:49.059823 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:55:49.059823 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:55:49.059823 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: e1bec228c17647bba62ba7d57d28e4ed Sep 08 10:55:49.059823 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-SecurityGroupsTestJSON-353861575-project Sep 08 10:55:49.059823 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:55:49.059823 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance b7e97718-dc14-4e93-b7b3-49a8d8e03bb9 could not be found. Sep 08 10:55:49.059823 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'b7e97718-dc14-4e93-b7b3-49a8d8e03bb9'} Sep 08 10:55:49.059823 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:55:49.059823 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:49.059823 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:55:49.059823 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:55:49.059823 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:55:49.059823 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:55:49.059823 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:55:49.059823 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:55:49.059823 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:55:49.059823 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:55:49.059823 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7e97718-dc14-4e93-b7b3-49a8d8e03bb9 could not be found. Sep 08 10:55:49.059823 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:49.059823 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:49.059823 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:49.059823 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:49.059823 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:55:49.059823 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:55:49.059823 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:55:49.059823 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:55:49.059823 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:55:49.059823 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:55:49.059823 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:55:49.059823 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:55:49.059823 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:55:49.059823 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:55:49.059823 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:55:49.059823 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:55:49.059823 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:55:49.059823 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:55:49.071230 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7e97718-dc14-4e93-b7b3-49a8d8e03bb9 could not be found. Sep 08 10:55:49.071230 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:49.071230 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:49.071230 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:49.071230 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:49.071230 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:55:49.071230 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:55:49.071230 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:55:49.071230 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:55:49.071230 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7e97718-dc14-4e93-b7b3-49a8d8e03bb9 could not be found. Sep 08 10:55:49.071230 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:49.071230 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fe30ba62-8df7-4f24-bc49-1cff3a2d430f tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Returning 404 to user: Instance b7e97718-dc14-4e93-b7b3-49a8d8e03bb9 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:55:49.071230 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fe30ba62-8df7-4f24-bc49-1cff3a2d430f tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b7e97718-dc14-4e93-b7b3-49a8d8e03bb9" status: 404 len: 111 microversion: 2.1 time: 0.036705 Sep 08 10:55:49.071230 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1952/3977] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:55:49 2022] DELETE /compute/v2.1/servers/b7e97718-dc14-4e93-b7b3-49a8d8e03bb9 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:55:49.076160 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7db2f7e1-051e-467c-8d67-ba4deff32889 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:49.076160 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7db2f7e1-051e-467c-8d67-ba4deff32889 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 379a5e3e-0e59-4b53-a37e-f4e9d1000eaf] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:49.078794 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7db2f7e1-051e-467c-8d67-ba4deff32889 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:49.079008 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7db2f7e1-051e-467c-8d67-ba4deff32889 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:49.080019 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7db2f7e1-051e-467c-8d67-ba4deff32889 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:49.080457 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7db2f7e1-051e-467c-8d67-ba4deff32889 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:49.080850 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7db2f7e1-051e-467c-8d67-ba4deff32889 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:49.081323 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7db2f7e1-051e-467c-8d67-ba4deff32889 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:49.168557 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5493c674-37cd-409e-8e44-1c75f442c9db tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:49.194577 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5493c674-37cd-409e-8e44-1c75f442c9db tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3" status: 200 len: 1735 microversion: 2.1 time: 0.392898 Sep 08 10:55:49.201846 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2026/3978] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:48 2022] GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3 => generated 1735 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:49.210469 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-30591877-c7f1-4f1a-9bf9-931d351e1a60 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:49.220642 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-30591877-c7f1-4f1a-9bf9-931d351e1a60 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] [instance: 9e4282f7-daab-454b-93e5-7854754316c8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:49.262249 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-30591877-c7f1-4f1a-9bf9-931d351e1a60 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:49.263181 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-30591877-c7f1-4f1a-9bf9-931d351e1a60 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:49.264005 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-30591877-c7f1-4f1a-9bf9-931d351e1a60 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:49.265168 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-30591877-c7f1-4f1a-9bf9-931d351e1a60 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:49.265917 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-30591877-c7f1-4f1a-9bf9-931d351e1a60 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:49.266356 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-30591877-c7f1-4f1a-9bf9-931d351e1a60 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:49.361885 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7db2f7e1-051e-467c-8d67-ba4deff32889 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:49.382027 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7db2f7e1-051e-467c-8d67-ba4deff32889 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/379a5e3e-0e59-4b53-a37e-f4e9d1000eaf" status: 200 len: 1511 microversion: 2.1 time: 0.314493 Sep 08 10:55:49.382633 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1953/3979] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:49 2022] GET /compute/v2.1/servers/379a5e3e-0e59-4b53-a37e-f4e9d1000eaf => generated 1511 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:49.405480 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1b9e0119-f86b-450f-a33e-05cbcdb30a43 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:49.407505 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1b9e0119-f86b-450f-a33e-05cbcdb30a43 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] [instance: b7e97718-dc14-4e93-b7b3-49a8d8e03bb9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:49.421468 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b9e0119-f86b-450f-a33e-05cbcdb30a43 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:49.422396 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b9e0119-f86b-450f-a33e-05cbcdb30a43 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:49.423320 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b9e0119-f86b-450f-a33e-05cbcdb30a43 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:49.424697 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b9e0119-f86b-450f-a33e-05cbcdb30a43 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:49.426074 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b9e0119-f86b-450f-a33e-05cbcdb30a43 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:49.427106 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b9e0119-f86b-450f-a33e-05cbcdb30a43 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:49.471311 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-1b9e0119-f86b-450f-a33e-05cbcdb30a43 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] HTTP exception thrown: Instance b7e97718-dc14-4e93-b7b3-49a8d8e03bb9 could not be found. Sep 08 10:55:49.474845 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1b9e0119-f86b-450f-a33e-05cbcdb30a43 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Request method failure captured: Sep 08 10:55:49.474845 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/b7e97718-dc14-4e93-b7b3-49a8d8e03bb9 HTTP/1.1 Sep 08 10:55:49.474845 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:55:49.474845 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:55:49.474845 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:55:49.474845 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:55:49.474845 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:55:49.474845 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:55:49.474845 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:55:49.474845 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:55:49.474845 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcnTIBfdH5H0Q1rMlbnLYZQcAnuATI-6ncC0ETqGOy19nshWBWc6mMSPvOE_5zGIQBC9DCOSD4SaG9XyRLj03fab4bxuKCvYlxZzzB9WEeCTo5mGH1uU5x9CALWtC8B7Wu8ih4rvxppcLmpz4ET9xD3ym8uzzB22kwTIB3vo0v5dqyY Sep 08 10:55:49.474845 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:55:49.474845 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:55:49.474845 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:55:49.474845 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:55:49.474845 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:55:49.474845 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:55:49.474845 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 0958700fa94b42b2b6b47af40cf2f679 Sep 08 10:55:49.474845 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-SecurityGroupsTestJSON-353861575 Sep 08 10:55:49.474845 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:55:49.474845 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:55:49.474845 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0958700fa94b42b2b6b47af40cf2f679"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0958700fa94b42b2b6b47af40cf2f679"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0958700fa94b42b2b6b47af40cf2f679"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0958700fa94b42b2b6b47af40cf2f679"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:55:49.474845 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-SecurityGroupsTestJSON-353861575 Sep 08 10:55:49.474845 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 0958700fa94b42b2b6b47af40cf2f679 Sep 08 10:55:49.474845 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-353861575 Sep 08 10:55:49.474845 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-SecurityGroupsTestJSON-353861575-project Sep 08 10:55:49.474845 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:55:49.474845 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:55:49.474845 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: e1bec228c17647bba62ba7d57d28e4ed Sep 08 10:55:49.474845 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-SecurityGroupsTestJSON-353861575-project Sep 08 10:55:49.474845 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:55:49.474845 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance b7e97718-dc14-4e93-b7b3-49a8d8e03bb9 could not be found. Sep 08 10:55:49.474845 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'b7e97718-dc14-4e93-b7b3-49a8d8e03bb9'} Sep 08 10:55:49.474845 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:55:49.474845 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:49.474845 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:55:49.474845 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:55:49.474845 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:55:49.474845 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:55:49.474845 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:55:49.474845 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:55:49.474845 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:55:49.474845 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:55:49.474845 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7e97718-dc14-4e93-b7b3-49a8d8e03bb9 could not be found. Sep 08 10:55:49.474845 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:49.474845 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:49.474845 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:49.474845 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:49.474845 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:55:49.474845 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:55:49.474845 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:55:49.474845 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:55:49.474845 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:55:49.474845 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:55:49.474845 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:55:49.474845 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:55:49.474845 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:55:49.474845 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:55:49.474845 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:55:49.474845 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:55:49.474845 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7e97718-dc14-4e93-b7b3-49a8d8e03bb9 could not be found. Sep 08 10:55:49.474845 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:49.474845 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:49.474845 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:49.485840 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:49.485840 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:55:49.485840 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:55:49.485840 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:55:49.485840 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:55:49.485840 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7e97718-dc14-4e93-b7b3-49a8d8e03bb9 could not be found. Sep 08 10:55:49.485840 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:49.495995 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1b9e0119-f86b-450f-a33e-05cbcdb30a43 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Returning 404 to user: Instance b7e97718-dc14-4e93-b7b3-49a8d8e03bb9 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:55:49.499236 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1b9e0119-f86b-450f-a33e-05cbcdb30a43 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "GET /compute/v2.1/servers/b7e97718-dc14-4e93-b7b3-49a8d8e03bb9" status: 404 len: 111 microversion: 2.1 time: 0.114418 Sep 08 10:55:49.501355 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1954/3980] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:49 2022] GET /compute/v2.1/servers/b7e97718-dc14-4e93-b7b3-49a8d8e03bb9 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:55:49.507070 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5b1ba230-3bb7-4b6a-95f5-ddee87b1edd9 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:49.508121 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5b1ba230-3bb7-4b6a-95f5-ddee87b1edd9 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:49.518425 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b1ba230-3bb7-4b6a-95f5-ddee87b1edd9 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:49.520122 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b1ba230-3bb7-4b6a-95f5-ddee87b1edd9 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:49.520753 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b1ba230-3bb7-4b6a-95f5-ddee87b1edd9 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:49.522255 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b1ba230-3bb7-4b6a-95f5-ddee87b1edd9 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:49.522895 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b1ba230-3bb7-4b6a-95f5-ddee87b1edd9 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:49.524389 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b1ba230-3bb7-4b6a-95f5-ddee87b1edd9 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:49.554534 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:55:49.639313 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5b1ba230-3bb7-4b6a-95f5-ddee87b1edd9 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:49.653627 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5b1ba230-3bb7-4b6a-95f5-ddee87b1edd9 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:49.657673 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5b1ba230-3bb7-4b6a-95f5-ddee87b1edd9 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:49.659544 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5b1ba230-3bb7-4b6a-95f5-ddee87b1edd9 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 200 len: 1605 microversion: 2.32 time: 0.156337 Sep 08 10:55:49.660861 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1955/3981] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:55:49 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 1605 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:55:49.668606 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8816e556-281f-46d3-949d-c30d77a7f1af tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Calling method '.version_select at 0x7f68e491be50>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:49.707137 n-d-850501-12 devstack@n-api.service[128862]: DEBUG neutronclient.v2_0.client [None req-8816e556-281f-46d3-949d-c30d77a7f1af tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6f3b2b1f-362f-4566-a774-9c795703ef36 does not exist", "detail": ""}} {{(pid=128862) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 08 10:55:49.708672 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.security_group_api [None req-8816e556-281f-46d3-949d-c30d77a7f1af tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Neutron security group 6f3b2b1f-362f-4566-a774-9c795703ef36 not found {{(pid=128862) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 08 10:55:49.709417 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-8816e556-281f-46d3-949d-c30d77a7f1af tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] HTTP exception thrown: Security group 6f3b2b1f-362f-4566-a774-9c795703ef36 does not exist Sep 08 10:55:49.709417 n-d-850501-12 devstack@n-api.service[128862]: Neutron server returns request_ids: ['req-55150dbc-8277-44fe-8863-e322ec0eee23'] Sep 08 10:55:49.712082 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8816e556-281f-46d3-949d-c30d77a7f1af tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Request method failure captured: Sep 08 10:55:49.712082 n-d-850501-12 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/os-security-groups/6f3b2b1f-362f-4566-a774-9c795703ef36 HTTP/1.1 Sep 08 10:55:49.712082 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:55:49.712082 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:55:49.712082 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:55:49.712082 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:55:49.712082 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:55:49.712082 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:55:49.712082 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:55:49.712082 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:55:49.712082 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcnTIBfdH5H0Q1rMlbnLYZQcAnuATI-6ncC0ETqGOy19nshWBWc6mMSPvOE_5zGIQBC9DCOSD4SaG9XyRLj03fab4bxuKCvYlxZzzB9WEeCTo5mGH1uU5x9CALWtC8B7Wu8ih4rvxppcLmpz4ET9xD3ym8uzzB22kwTIB3vo0v5dqyY Sep 08 10:55:49.712082 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:55:49.712082 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:55:49.712082 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:55:49.712082 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:55:49.712082 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:55:49.712082 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:55:49.712082 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 0958700fa94b42b2b6b47af40cf2f679 Sep 08 10:55:49.712082 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-SecurityGroupsTestJSON-353861575 Sep 08 10:55:49.712082 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:55:49.712082 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:55:49.712082 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0958700fa94b42b2b6b47af40cf2f679"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0958700fa94b42b2b6b47af40cf2f679"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0958700fa94b42b2b6b47af40cf2f679"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0958700fa94b42b2b6b47af40cf2f679"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:55:49.712082 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-SecurityGroupsTestJSON-353861575 Sep 08 10:55:49.712082 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 0958700fa94b42b2b6b47af40cf2f679 Sep 08 10:55:49.712082 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-353861575 Sep 08 10:55:49.712082 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-SecurityGroupsTestJSON-353861575-project Sep 08 10:55:49.712082 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:55:49.712082 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:55:49.712082 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: e1bec228c17647bba62ba7d57d28e4ed Sep 08 10:55:49.712082 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-SecurityGroupsTestJSON-353861575-project Sep 08 10:55:49.712082 n-d-850501-12 devstack@n-api.service[128862]: method: Sep 08 10:55:49.712082 n-d-850501-12 devstack@n-api.service[128862]: exception: Security group 6f3b2b1f-362f-4566-a774-9c795703ef36 does not exist Sep 08 10:55:49.712082 n-d-850501-12 devstack@n-api.service[128862]: Neutron server returns request_ids: ['req-55150dbc-8277-44fe-8863-e322ec0eee23'] Sep 08 10:55:49.712082 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '6f3b2b1f-362f-4566-a774-9c795703ef36'} Sep 08 10:55:49.712082 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:55:49.712082 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:49.712082 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 08 10:55:49.712082 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 08 10:55:49.712082 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:55:49.712082 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:55:49.712082 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 08 10:55:49.712082 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 08 10:55:49.712082 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:55:49.712082 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:55:49.712082 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 08 10:55:49.712082 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 08 10:55:49.712082 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:55:49.712082 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:55:49.712082 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 08 10:55:49.712082 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 08 10:55:49.712082 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:55:49.712082 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:55:49.712082 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 08 10:55:49.712082 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 08 10:55:49.712082 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:55:49.712082 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:55:49.712082 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 08 10:55:49.712082 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 08 10:55:49.712082 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 08 10:55:49.712082 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 08 10:55:49.712082 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6f3b2b1f-362f-4566-a774-9c795703ef36 does not exist Sep 08 10:55:49.716719 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-55150dbc-8277-44fe-8863-e322ec0eee23'] Sep 08 10:55:49.716719 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:49.716719 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:49.716719 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:49.716719 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:49.716719 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 08 10:55:49.716719 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 08 10:55:49.716719 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 08 10:55:49.716719 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 08 10:55:49.716719 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6f3b2b1f-362f-4566-a774-9c795703ef36 does not exist Sep 08 10:55:49.716719 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-55150dbc-8277-44fe-8863-e322ec0eee23'] Sep 08 10:55:49.716719 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:49.716719 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:49.716719 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:49.716719 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:49.716719 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:55:49.716719 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:55:49.716719 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:55:49.716719 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:55:49.716719 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:55:49.716719 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:55:49.716719 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:55:49.716719 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:55:49.716719 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 08 10:55:49.716719 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 08 10:55:49.716719 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6f3b2b1f-362f-4566-a774-9c795703ef36 does not exist Sep 08 10:55:49.716719 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-55150dbc-8277-44fe-8863-e322ec0eee23'] Sep 08 10:55:49.716719 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:49.716719 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:49.716719 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:49.716719 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:49.716719 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:55:49.716719 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:55:49.716719 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:55:49.716719 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:55:49.716719 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6f3b2b1f-362f-4566-a774-9c795703ef36 does not exist Sep 08 10:55:49.716719 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-55150dbc-8277-44fe-8863-e322ec0eee23'] Sep 08 10:55:49.716719 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:49.723919 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8816e556-281f-46d3-949d-c30d77a7f1af tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Returning 404 to user: Security group 6f3b2b1f-362f-4566-a774-9c795703ef36 does not exist Sep 08 10:55:49.723919 n-d-850501-12 devstack@n-api.service[128862]: Neutron server returns request_ids: ['req-55150dbc-8277-44fe-8863-e322ec0eee23'] {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:55:49.725282 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8816e556-281f-46d3-949d-c30d77a7f1af tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/6f3b2b1f-362f-4566-a774-9c795703ef36" status: 404 len: 194 microversion: 2.1 time: 0.062460 Sep 08 10:55:49.727353 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1956/3982] 10.222.0.27 () {58 vars in 1272 bytes} [Thu Sep 8 10:55:49 2022] DELETE /compute/v2.1/os-security-groups/6f3b2b1f-362f-4566-a774-9c795703ef36 => generated 194 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:55:49.739388 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7a755e22-76ac-4e15-a7fd-789af7ea01d5 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Calling method '.version_select at 0x7f68e43508b0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:49.795241 n-d-850501-12 devstack@n-api.service[128862]: DEBUG neutronclient.v2_0.client [None req-7a755e22-76ac-4e15-a7fd-789af7ea01d5 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9abcfaa8-eed1-428d-a9ef-d3953e75ba6d does not exist", "detail": ""}} {{(pid=128862) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 08 10:55:49.796269 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.security_group_api [None req-7a755e22-76ac-4e15-a7fd-789af7ea01d5 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Neutron security group 9abcfaa8-eed1-428d-a9ef-d3953e75ba6d not found {{(pid=128862) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 08 10:55:49.798256 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-7a755e22-76ac-4e15-a7fd-789af7ea01d5 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] HTTP exception thrown: Security group 9abcfaa8-eed1-428d-a9ef-d3953e75ba6d does not exist Sep 08 10:55:49.798256 n-d-850501-12 devstack@n-api.service[128862]: Neutron server returns request_ids: ['req-280b1d18-fa12-46d8-837c-cecb675ca3bb'] Sep 08 10:55:49.801855 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7a755e22-76ac-4e15-a7fd-789af7ea01d5 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Request method failure captured: Sep 08 10:55:49.801855 n-d-850501-12 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/os-security-groups/9abcfaa8-eed1-428d-a9ef-d3953e75ba6d HTTP/1.1 Sep 08 10:55:49.801855 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:55:49.801855 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:55:49.801855 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:55:49.801855 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:55:49.801855 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:55:49.801855 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:55:49.801855 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:55:49.801855 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:55:49.801855 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcnTIBfdH5H0Q1rMlbnLYZQcAnuATI-6ncC0ETqGOy19nshWBWc6mMSPvOE_5zGIQBC9DCOSD4SaG9XyRLj03fab4bxuKCvYlxZzzB9WEeCTo5mGH1uU5x9CALWtC8B7Wu8ih4rvxppcLmpz4ET9xD3ym8uzzB22kwTIB3vo0v5dqyY Sep 08 10:55:49.801855 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:55:49.801855 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:55:49.801855 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:55:49.801855 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:55:49.801855 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:55:49.801855 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:55:49.801855 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 0958700fa94b42b2b6b47af40cf2f679 Sep 08 10:55:49.801855 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-SecurityGroupsTestJSON-353861575 Sep 08 10:55:49.801855 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:55:49.801855 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:55:49.801855 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0958700fa94b42b2b6b47af40cf2f679"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0958700fa94b42b2b6b47af40cf2f679"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0958700fa94b42b2b6b47af40cf2f679"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0958700fa94b42b2b6b47af40cf2f679"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:55:49.801855 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-SecurityGroupsTestJSON-353861575 Sep 08 10:55:49.801855 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 0958700fa94b42b2b6b47af40cf2f679 Sep 08 10:55:49.801855 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-353861575 Sep 08 10:55:49.801855 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-SecurityGroupsTestJSON-353861575-project Sep 08 10:55:49.801855 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:55:49.801855 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:55:49.801855 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: e1bec228c17647bba62ba7d57d28e4ed Sep 08 10:55:49.801855 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-SecurityGroupsTestJSON-353861575-project Sep 08 10:55:49.801855 n-d-850501-12 devstack@n-api.service[128862]: method: Sep 08 10:55:49.801855 n-d-850501-12 devstack@n-api.service[128862]: exception: Security group 9abcfaa8-eed1-428d-a9ef-d3953e75ba6d does not exist Sep 08 10:55:49.801855 n-d-850501-12 devstack@n-api.service[128862]: Neutron server returns request_ids: ['req-280b1d18-fa12-46d8-837c-cecb675ca3bb'] Sep 08 10:55:49.801855 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '9abcfaa8-eed1-428d-a9ef-d3953e75ba6d'} Sep 08 10:55:49.801855 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:55:49.801855 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:49.801855 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 08 10:55:49.801855 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 08 10:55:49.801855 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:55:49.801855 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:55:49.801855 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 08 10:55:49.801855 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 08 10:55:49.801855 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:55:49.801855 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:55:49.801855 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 08 10:55:49.801855 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 08 10:55:49.801855 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:55:49.801855 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:55:49.801855 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 08 10:55:49.801855 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 08 10:55:49.801855 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:55:49.801855 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:55:49.801855 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 08 10:55:49.801855 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 08 10:55:49.801855 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:55:49.801855 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:55:49.801855 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 08 10:55:49.801855 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 08 10:55:49.801855 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 08 10:55:49.801855 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 08 10:55:49.801855 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9abcfaa8-eed1-428d-a9ef-d3953e75ba6d does not exist Sep 08 10:55:49.807580 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-280b1d18-fa12-46d8-837c-cecb675ca3bb'] Sep 08 10:55:49.807580 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:49.807580 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:49.807580 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:49.807580 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:49.807580 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 08 10:55:49.807580 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 08 10:55:49.807580 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 08 10:55:49.807580 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 08 10:55:49.807580 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9abcfaa8-eed1-428d-a9ef-d3953e75ba6d does not exist Sep 08 10:55:49.807580 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-280b1d18-fa12-46d8-837c-cecb675ca3bb'] Sep 08 10:55:49.807580 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:49.807580 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:49.807580 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:49.807580 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:49.807580 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:55:49.807580 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:55:49.807580 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:55:49.807580 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:55:49.807580 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:55:49.807580 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:55:49.807580 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:55:49.807580 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:55:49.807580 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 08 10:55:49.807580 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 08 10:55:49.807580 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9abcfaa8-eed1-428d-a9ef-d3953e75ba6d does not exist Sep 08 10:55:49.807580 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-280b1d18-fa12-46d8-837c-cecb675ca3bb'] Sep 08 10:55:49.807580 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:49.807580 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:49.807580 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:49.807580 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:49.807580 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:55:49.807580 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:55:49.807580 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:55:49.807580 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:55:49.807580 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9abcfaa8-eed1-428d-a9ef-d3953e75ba6d does not exist Sep 08 10:55:49.807580 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-280b1d18-fa12-46d8-837c-cecb675ca3bb'] Sep 08 10:55:49.807580 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:49.807580 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7a755e22-76ac-4e15-a7fd-789af7ea01d5 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Returning 404 to user: Security group 9abcfaa8-eed1-428d-a9ef-d3953e75ba6d does not exist Sep 08 10:55:49.807580 n-d-850501-12 devstack@n-api.service[128862]: Neutron server returns request_ids: ['req-280b1d18-fa12-46d8-837c-cecb675ca3bb'] {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:55:49.807580 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7a755e22-76ac-4e15-a7fd-789af7ea01d5 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/9abcfaa8-eed1-428d-a9ef-d3953e75ba6d" status: 404 len: 194 microversion: 2.1 time: 0.070667 Sep 08 10:55:49.807580 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1957/3983] 10.222.0.27 () {58 vars in 1272 bytes} [Thu Sep 8 10:55:49 2022] DELETE /compute/v2.1/os-security-groups/9abcfaa8-eed1-428d-a9ef-d3953e75ba6d => generated 194 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:55:49.816534 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d4ab59eb-8b13-4643-80a1-f74ea474c68a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:49.816840 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d4ab59eb-8b13-4643-80a1-f74ea474c68a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:49.828359 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d4ab59eb-8b13-4643-80a1-f74ea474c68a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:49.829232 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d4ab59eb-8b13-4643-80a1-f74ea474c68a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:49.830481 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d4ab59eb-8b13-4643-80a1-f74ea474c68a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:49.832348 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d4ab59eb-8b13-4643-80a1-f74ea474c68a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:49.833493 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d4ab59eb-8b13-4643-80a1-f74ea474c68a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:49.834559 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d4ab59eb-8b13-4643-80a1-f74ea474c68a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:49.838702 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-30591877-c7f1-4f1a-9bf9-931d351e1a60 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22145c653c804031ae233de6d84647fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1c70903c3d42d790d9ef96adc1fdbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:49.849751 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-30591877-c7f1-4f1a-9bf9-931d351e1a60 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] 10.222.0.27 "GET /compute/v2.1/servers/9e4282f7-daab-454b-93e5-7854754316c8" status: 200 len: 1354 microversion: 2.1 time: 0.646133 Sep 08 10:55:49.852708 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2027/3984] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:49 2022] GET /compute/v2.1/servers/9e4282f7-daab-454b-93e5-7854754316c8 => generated 1354 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:49.859706 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-019b6bae-2738-4db9-9688-f737b11dd174 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Calling method '.version_select at 0x7f68df8c3b80>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:49.980441 n-d-850501-12 devstack@n-api.service[128861]: DEBUG neutronclient.v2_0.client [None req-019b6bae-2738-4db9-9688-f737b11dd174 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 2f2c8f0e-68e5-4516-8b75-9aa893598ed3 does not exist", "detail": ""}} {{(pid=128861) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 08 10:55:49.981122 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.security_group_api [None req-019b6bae-2738-4db9-9688-f737b11dd174 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Neutron security group 2f2c8f0e-68e5-4516-8b75-9aa893598ed3 not found {{(pid=128861) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 08 10:55:49.981657 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-019b6bae-2738-4db9-9688-f737b11dd174 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] HTTP exception thrown: Security group 2f2c8f0e-68e5-4516-8b75-9aa893598ed3 does not exist Sep 08 10:55:49.981657 n-d-850501-12 devstack@n-api.service[128861]: Neutron server returns request_ids: ['req-7ec5467d-a043-469f-890c-b72c08c4bd5e'] Sep 08 10:55:49.983844 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-019b6bae-2738-4db9-9688-f737b11dd174 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Request method failure captured: Sep 08 10:55:49.983844 n-d-850501-12 devstack@n-api.service[128861]: request: DELETE /compute/v2.1/os-security-groups/2f2c8f0e-68e5-4516-8b75-9aa893598ed3 HTTP/1.1 Sep 08 10:55:49.983844 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:55:49.983844 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:55:49.983844 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:55:49.983844 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:55:49.983844 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:55:49.983844 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:55:49.983844 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:55:49.983844 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:55:49.983844 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcnTIBfdH5H0Q1rMlbnLYZQcAnuATI-6ncC0ETqGOy19nshWBWc6mMSPvOE_5zGIQBC9DCOSD4SaG9XyRLj03fab4bxuKCvYlxZzzB9WEeCTo5mGH1uU5x9CALWtC8B7Wu8ih4rvxppcLmpz4ET9xD3ym8uzzB22kwTIB3vo0v5dqyY Sep 08 10:55:49.983844 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:55:49.983844 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:55:49.983844 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:55:49.983844 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:55:49.983844 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:55:49.983844 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:55:49.983844 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 0958700fa94b42b2b6b47af40cf2f679 Sep 08 10:55:49.983844 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-SecurityGroupsTestJSON-353861575 Sep 08 10:55:49.983844 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:55:49.983844 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:55:49.983844 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0958700fa94b42b2b6b47af40cf2f679"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0958700fa94b42b2b6b47af40cf2f679"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0958700fa94b42b2b6b47af40cf2f679"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0958700fa94b42b2b6b47af40cf2f679"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:55:49.983844 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-SecurityGroupsTestJSON-353861575 Sep 08 10:55:49.983844 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 0958700fa94b42b2b6b47af40cf2f679 Sep 08 10:55:49.983844 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-353861575 Sep 08 10:55:49.983844 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-SecurityGroupsTestJSON-353861575-project Sep 08 10:55:49.983844 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:55:49.983844 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:55:49.983844 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: e1bec228c17647bba62ba7d57d28e4ed Sep 08 10:55:49.983844 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-SecurityGroupsTestJSON-353861575-project Sep 08 10:55:49.983844 n-d-850501-12 devstack@n-api.service[128861]: method: Sep 08 10:55:49.983844 n-d-850501-12 devstack@n-api.service[128861]: exception: Security group 2f2c8f0e-68e5-4516-8b75-9aa893598ed3 does not exist Sep 08 10:55:49.983844 n-d-850501-12 devstack@n-api.service[128861]: Neutron server returns request_ids: ['req-7ec5467d-a043-469f-890c-b72c08c4bd5e'] Sep 08 10:55:49.983844 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '2f2c8f0e-68e5-4516-8b75-9aa893598ed3'} Sep 08 10:55:49.983844 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:55:49.983844 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:49.983844 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 08 10:55:49.983844 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 08 10:55:49.983844 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:55:49.983844 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:55:49.983844 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 08 10:55:49.983844 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 08 10:55:49.983844 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:55:49.983844 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:55:49.983844 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 08 10:55:49.983844 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 08 10:55:49.983844 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:55:49.983844 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:55:49.983844 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 08 10:55:49.983844 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 08 10:55:49.983844 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:55:49.983844 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:55:49.983844 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 08 10:55:49.983844 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 08 10:55:49.983844 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:55:49.983844 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:55:49.983844 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 08 10:55:49.983844 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 08 10:55:49.983844 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 08 10:55:49.983844 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 08 10:55:49.983844 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 2f2c8f0e-68e5-4516-8b75-9aa893598ed3 does not exist Sep 08 10:55:49.995504 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7ec5467d-a043-469f-890c-b72c08c4bd5e'] Sep 08 10:55:49.995504 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:49.995504 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:49.995504 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:49.995504 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:49.995504 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 08 10:55:49.995504 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 08 10:55:49.995504 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 08 10:55:49.995504 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 08 10:55:49.995504 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 2f2c8f0e-68e5-4516-8b75-9aa893598ed3 does not exist Sep 08 10:55:49.995504 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7ec5467d-a043-469f-890c-b72c08c4bd5e'] Sep 08 10:55:49.995504 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:49.995504 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:49.995504 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:49.995504 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:49.995504 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:55:49.995504 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:55:49.995504 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:55:49.995504 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:55:49.995504 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:55:49.995504 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:55:49.995504 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:55:49.995504 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:55:49.995504 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 08 10:55:49.995504 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 08 10:55:49.995504 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 2f2c8f0e-68e5-4516-8b75-9aa893598ed3 does not exist Sep 08 10:55:49.995504 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7ec5467d-a043-469f-890c-b72c08c4bd5e'] Sep 08 10:55:49.995504 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:49.995504 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:49.995504 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:49.995504 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:49.995504 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:55:49.995504 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:55:49.995504 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:55:49.995504 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:55:49.995504 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 2f2c8f0e-68e5-4516-8b75-9aa893598ed3 does not exist Sep 08 10:55:49.995504 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7ec5467d-a043-469f-890c-b72c08c4bd5e'] Sep 08 10:55:49.995504 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:49.995504 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-019b6bae-2738-4db9-9688-f737b11dd174 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Returning 404 to user: Security group 2f2c8f0e-68e5-4516-8b75-9aa893598ed3 does not exist Sep 08 10:55:49.995504 n-d-850501-12 devstack@n-api.service[128861]: Neutron server returns request_ids: ['req-7ec5467d-a043-469f-890c-b72c08c4bd5e'] {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:55:49.995504 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-019b6bae-2738-4db9-9688-f737b11dd174 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/2f2c8f0e-68e5-4516-8b75-9aa893598ed3" status: 404 len: 194 microversion: 2.1 time: 0.130752 Sep 08 10:55:49.995504 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2028/3985] 10.222.0.27 () {58 vars in 1272 bytes} [Thu Sep 8 10:55:49 2022] DELETE /compute/v2.1/os-security-groups/2f2c8f0e-68e5-4516-8b75-9aa893598ed3 => generated 194 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:55:49.995504 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-1f2314f1-30eb-4e8b-881b-87413289b238 req-a42578c4-5810-49f5-93a7-f4b41e152854 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e4282f7-daab-454b-93e5-7854754316c8", "tag": "d83ddcd1-a521-4860-bd2f-45d8879fd5b2"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:55:50.018453 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-1f2314f1-30eb-4e8b-881b-87413289b238 req-a42578c4-5810-49f5-93a7-f4b41e152854 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:50.019061 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-1f2314f1-30eb-4e8b-881b-87413289b238 req-a42578c4-5810-49f5-93a7-f4b41e152854 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:50.019517 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-1f2314f1-30eb-4e8b-881b-87413289b238 req-a42578c4-5810-49f5-93a7-f4b41e152854 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:50.035321 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-1f2314f1-30eb-4e8b-881b-87413289b238 req-a42578c4-5810-49f5-93a7-f4b41e152854 service nova] Creating event network-changed:d83ddcd1-a521-4860-bd2f-45d8879fd5b2 for instance 9e4282f7-daab-454b-93e5-7854754316c8 on n-h2-850501-12 Sep 08 10:55:50.045262 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-1f2314f1-30eb-4e8b-881b-87413289b238 req-a42578c4-5810-49f5-93a7-f4b41e152854 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057629 Sep 08 10:55:50.046724 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2029/3986] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:55:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:55:50.054454 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2882ca2b-9180-4d48-8106-bcc7b3b57266 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Calling method '.version_select at 0x7f68e45753a0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:50.127859 n-d-850501-12 devstack@n-api.service[128861]: DEBUG neutronclient.v2_0.client [None req-2882ca2b-9180-4d48-8106-bcc7b3b57266 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9ddb7c1d-4f44-4670-b703-506a13de29d8 does not exist", "detail": ""}} {{(pid=128861) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 08 10:55:50.130073 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.security_group_api [None req-2882ca2b-9180-4d48-8106-bcc7b3b57266 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Neutron security group 9ddb7c1d-4f44-4670-b703-506a13de29d8 not found {{(pid=128861) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 08 10:55:50.131103 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-2882ca2b-9180-4d48-8106-bcc7b3b57266 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] HTTP exception thrown: Security group 9ddb7c1d-4f44-4670-b703-506a13de29d8 does not exist Sep 08 10:55:50.131103 n-d-850501-12 devstack@n-api.service[128861]: Neutron server returns request_ids: ['req-26dadde4-7fe7-4026-836f-5129ab36a806'] Sep 08 10:55:50.143447 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2882ca2b-9180-4d48-8106-bcc7b3b57266 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Request method failure captured: Sep 08 10:55:50.143447 n-d-850501-12 devstack@n-api.service[128861]: request: DELETE /compute/v2.1/os-security-groups/9ddb7c1d-4f44-4670-b703-506a13de29d8 HTTP/1.1 Sep 08 10:55:50.143447 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:55:50.143447 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:55:50.143447 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:55:50.143447 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:55:50.143447 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:55:50.143447 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:55:50.143447 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:55:50.143447 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:55:50.143447 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcnTIBfdH5H0Q1rMlbnLYZQcAnuATI-6ncC0ETqGOy19nshWBWc6mMSPvOE_5zGIQBC9DCOSD4SaG9XyRLj03fab4bxuKCvYlxZzzB9WEeCTo5mGH1uU5x9CALWtC8B7Wu8ih4rvxppcLmpz4ET9xD3ym8uzzB22kwTIB3vo0v5dqyY Sep 08 10:55:50.143447 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:55:50.143447 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:55:50.143447 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:55:50.143447 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:55:50.143447 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:55:50.143447 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:55:50.143447 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 0958700fa94b42b2b6b47af40cf2f679 Sep 08 10:55:50.143447 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-SecurityGroupsTestJSON-353861575 Sep 08 10:55:50.143447 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:55:50.143447 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:55:50.143447 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0958700fa94b42b2b6b47af40cf2f679"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0958700fa94b42b2b6b47af40cf2f679"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0958700fa94b42b2b6b47af40cf2f679"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0958700fa94b42b2b6b47af40cf2f679"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:55:50.143447 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-SecurityGroupsTestJSON-353861575 Sep 08 10:55:50.143447 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 0958700fa94b42b2b6b47af40cf2f679 Sep 08 10:55:50.143447 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-353861575 Sep 08 10:55:50.143447 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-SecurityGroupsTestJSON-353861575-project Sep 08 10:55:50.143447 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:55:50.143447 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:55:50.143447 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: e1bec228c17647bba62ba7d57d28e4ed Sep 08 10:55:50.143447 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-SecurityGroupsTestJSON-353861575-project Sep 08 10:55:50.143447 n-d-850501-12 devstack@n-api.service[128861]: method: Sep 08 10:55:50.143447 n-d-850501-12 devstack@n-api.service[128861]: exception: Security group 9ddb7c1d-4f44-4670-b703-506a13de29d8 does not exist Sep 08 10:55:50.143447 n-d-850501-12 devstack@n-api.service[128861]: Neutron server returns request_ids: ['req-26dadde4-7fe7-4026-836f-5129ab36a806'] Sep 08 10:55:50.143447 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '9ddb7c1d-4f44-4670-b703-506a13de29d8'} Sep 08 10:55:50.143447 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:55:50.143447 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:50.143447 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 08 10:55:50.143447 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 08 10:55:50.143447 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:55:50.143447 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:55:50.143447 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 08 10:55:50.143447 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 08 10:55:50.143447 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:55:50.143447 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:55:50.143447 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 08 10:55:50.143447 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 08 10:55:50.143447 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:55:50.143447 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:55:50.143447 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 08 10:55:50.143447 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 08 10:55:50.143447 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:55:50.143447 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:55:50.143447 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 08 10:55:50.143447 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 08 10:55:50.143447 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:55:50.143447 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:55:50.143447 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 08 10:55:50.143447 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 08 10:55:50.143447 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 08 10:55:50.143447 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 08 10:55:50.143447 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9ddb7c1d-4f44-4670-b703-506a13de29d8 does not exist Sep 08 10:55:50.148419 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-26dadde4-7fe7-4026-836f-5129ab36a806'] Sep 08 10:55:50.148419 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:50.148419 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:50.148419 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:50.148419 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:50.148419 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 08 10:55:50.148419 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 08 10:55:50.148419 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 08 10:55:50.148419 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 08 10:55:50.148419 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9ddb7c1d-4f44-4670-b703-506a13de29d8 does not exist Sep 08 10:55:50.148419 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-26dadde4-7fe7-4026-836f-5129ab36a806'] Sep 08 10:55:50.148419 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:50.148419 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:50.148419 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:50.148419 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:50.148419 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:55:50.148419 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:55:50.148419 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:55:50.148419 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:55:50.148419 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:55:50.148419 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:55:50.148419 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:55:50.148419 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:55:50.148419 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 08 10:55:50.148419 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 08 10:55:50.148419 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9ddb7c1d-4f44-4670-b703-506a13de29d8 does not exist Sep 08 10:55:50.148419 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-26dadde4-7fe7-4026-836f-5129ab36a806'] Sep 08 10:55:50.148419 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:50.148419 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:50.148419 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:50.148419 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:50.148419 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:55:50.148419 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:55:50.148419 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:55:50.148419 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:55:50.148419 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9ddb7c1d-4f44-4670-b703-506a13de29d8 does not exist Sep 08 10:55:50.148419 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-26dadde4-7fe7-4026-836f-5129ab36a806'] Sep 08 10:55:50.148419 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:50.148419 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2882ca2b-9180-4d48-8106-bcc7b3b57266 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Returning 404 to user: Security group 9ddb7c1d-4f44-4670-b703-506a13de29d8 does not exist Sep 08 10:55:50.148419 n-d-850501-12 devstack@n-api.service[128861]: Neutron server returns request_ids: ['req-26dadde4-7fe7-4026-836f-5129ab36a806'] {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:55:50.151433 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2882ca2b-9180-4d48-8106-bcc7b3b57266 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/9ddb7c1d-4f44-4670-b703-506a13de29d8" status: 404 len: 194 microversion: 2.1 time: 0.100942 Sep 08 10:55:50.153355 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2030/3987] 10.222.0.27 () {58 vars in 1272 bytes} [Thu Sep 8 10:55:50 2022] DELETE /compute/v2.1/os-security-groups/9ddb7c1d-4f44-4670-b703-506a13de29d8 => generated 194 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:55:50.164954 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-35d9c7b5-765c-47f9-8cac-24d7132b5e94 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:50.169758 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-35d9c7b5-765c-47f9-8cac-24d7132b5e94 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] [instance: b8edf980-3cac-4b70-bbf2-bad0e4681366] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:50.173775 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d4ab59eb-8b13-4643-80a1-f74ea474c68a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:50.188340 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d4ab59eb-8b13-4643-80a1-f74ea474c68a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1510 microversion: 2.1 time: 0.379995 Sep 08 10:55:50.193544 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-35d9c7b5-765c-47f9-8cac-24d7132b5e94 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:50.194414 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-35d9c7b5-765c-47f9-8cac-24d7132b5e94 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:50.195068 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-35d9c7b5-765c-47f9-8cac-24d7132b5e94 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:50.201795 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-35d9c7b5-765c-47f9-8cac-24d7132b5e94 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:50.204813 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-35d9c7b5-765c-47f9-8cac-24d7132b5e94 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:50.206930 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-35d9c7b5-765c-47f9-8cac-24d7132b5e94 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:50.207162 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1958/3988] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:49 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1510 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:50.211915 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-def2b11a-01a4-47e8-b2bc-9b0d34971545 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Calling method '.version_select at 0x7f68e4f50e50>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:50.289496 n-d-850501-12 devstack@n-api.service[128862]: DEBUG neutronclient.v2_0.client [None req-def2b11a-01a4-47e8-b2bc-9b0d34971545 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 540ef6b8-3e5b-4fdd-b2ef-f191f9f705fc does not exist", "detail": ""}} {{(pid=128862) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 08 10:55:50.291010 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.security_group_api [None req-def2b11a-01a4-47e8-b2bc-9b0d34971545 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Neutron security group 540ef6b8-3e5b-4fdd-b2ef-f191f9f705fc not found {{(pid=128862) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 08 10:55:50.292238 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-def2b11a-01a4-47e8-b2bc-9b0d34971545 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] HTTP exception thrown: Security group 540ef6b8-3e5b-4fdd-b2ef-f191f9f705fc does not exist Sep 08 10:55:50.292238 n-d-850501-12 devstack@n-api.service[128862]: Neutron server returns request_ids: ['req-af6e767e-e76e-47e1-ab69-6584dc9976bf'] Sep 08 10:55:50.296471 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-def2b11a-01a4-47e8-b2bc-9b0d34971545 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Request method failure captured: Sep 08 10:55:50.296471 n-d-850501-12 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/os-security-groups/540ef6b8-3e5b-4fdd-b2ef-f191f9f705fc HTTP/1.1 Sep 08 10:55:50.296471 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:55:50.296471 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:55:50.296471 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:55:50.296471 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:55:50.296471 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:55:50.296471 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:55:50.296471 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:55:50.296471 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:55:50.296471 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcnTIBfdH5H0Q1rMlbnLYZQcAnuATI-6ncC0ETqGOy19nshWBWc6mMSPvOE_5zGIQBC9DCOSD4SaG9XyRLj03fab4bxuKCvYlxZzzB9WEeCTo5mGH1uU5x9CALWtC8B7Wu8ih4rvxppcLmpz4ET9xD3ym8uzzB22kwTIB3vo0v5dqyY Sep 08 10:55:50.296471 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:55:50.296471 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:55:50.296471 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:55:50.296471 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:55:50.296471 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:55:50.296471 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:55:50.296471 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 0958700fa94b42b2b6b47af40cf2f679 Sep 08 10:55:50.296471 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-SecurityGroupsTestJSON-353861575 Sep 08 10:55:50.296471 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:55:50.296471 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:55:50.296471 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0958700fa94b42b2b6b47af40cf2f679"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0958700fa94b42b2b6b47af40cf2f679"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0958700fa94b42b2b6b47af40cf2f679"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0958700fa94b42b2b6b47af40cf2f679"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:55:50.296471 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-SecurityGroupsTestJSON-353861575 Sep 08 10:55:50.296471 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 0958700fa94b42b2b6b47af40cf2f679 Sep 08 10:55:50.296471 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-353861575 Sep 08 10:55:50.296471 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-SecurityGroupsTestJSON-353861575-project Sep 08 10:55:50.296471 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:55:50.296471 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:55:50.296471 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: e1bec228c17647bba62ba7d57d28e4ed Sep 08 10:55:50.296471 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-SecurityGroupsTestJSON-353861575-project Sep 08 10:55:50.296471 n-d-850501-12 devstack@n-api.service[128862]: method: Sep 08 10:55:50.296471 n-d-850501-12 devstack@n-api.service[128862]: exception: Security group 540ef6b8-3e5b-4fdd-b2ef-f191f9f705fc does not exist Sep 08 10:55:50.296471 n-d-850501-12 devstack@n-api.service[128862]: Neutron server returns request_ids: ['req-af6e767e-e76e-47e1-ab69-6584dc9976bf'] Sep 08 10:55:50.296471 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '540ef6b8-3e5b-4fdd-b2ef-f191f9f705fc'} Sep 08 10:55:50.296471 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:55:50.296471 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:50.296471 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 08 10:55:50.296471 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 08 10:55:50.296471 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:55:50.296471 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:55:50.296471 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 08 10:55:50.296471 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 08 10:55:50.296471 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:55:50.296471 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:55:50.296471 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 08 10:55:50.296471 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 08 10:55:50.296471 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:55:50.296471 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:55:50.296471 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 08 10:55:50.296471 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 08 10:55:50.296471 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:55:50.296471 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:55:50.296471 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 08 10:55:50.296471 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 08 10:55:50.296471 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:55:50.296471 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:55:50.296471 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 08 10:55:50.296471 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 08 10:55:50.296471 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 08 10:55:50.296471 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 08 10:55:50.296471 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 540ef6b8-3e5b-4fdd-b2ef-f191f9f705fc does not exist Sep 08 10:55:50.302266 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-af6e767e-e76e-47e1-ab69-6584dc9976bf'] Sep 08 10:55:50.302266 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:50.302266 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:50.302266 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:50.302266 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:50.302266 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 08 10:55:50.302266 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 08 10:55:50.302266 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 08 10:55:50.302266 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 08 10:55:50.302266 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 540ef6b8-3e5b-4fdd-b2ef-f191f9f705fc does not exist Sep 08 10:55:50.302266 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-af6e767e-e76e-47e1-ab69-6584dc9976bf'] Sep 08 10:55:50.302266 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:50.302266 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:50.302266 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:50.302266 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:50.302266 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:55:50.302266 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:55:50.302266 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:55:50.302266 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:55:50.302266 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:55:50.302266 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:55:50.302266 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:55:50.302266 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:55:50.302266 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 08 10:55:50.302266 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 08 10:55:50.302266 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 540ef6b8-3e5b-4fdd-b2ef-f191f9f705fc does not exist Sep 08 10:55:50.302266 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-af6e767e-e76e-47e1-ab69-6584dc9976bf'] Sep 08 10:55:50.302266 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:50.302266 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:50.302266 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:50.302266 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:50.302266 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:55:50.302266 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:55:50.302266 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:55:50.302266 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:55:50.302266 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 540ef6b8-3e5b-4fdd-b2ef-f191f9f705fc does not exist Sep 08 10:55:50.302266 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-af6e767e-e76e-47e1-ab69-6584dc9976bf'] Sep 08 10:55:50.302266 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:55:50.306881 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-def2b11a-01a4-47e8-b2bc-9b0d34971545 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Returning 404 to user: Security group 540ef6b8-3e5b-4fdd-b2ef-f191f9f705fc does not exist Sep 08 10:55:50.306881 n-d-850501-12 devstack@n-api.service[128862]: Neutron server returns request_ids: ['req-af6e767e-e76e-47e1-ab69-6584dc9976bf'] {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:55:50.307778 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-def2b11a-01a4-47e8-b2bc-9b0d34971545 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/540ef6b8-3e5b-4fdd-b2ef-f191f9f705fc" status: 404 len: 194 microversion: 2.1 time: 0.099769 Sep 08 10:55:50.308363 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1959/3989] 10.222.0.27 () {58 vars in 1272 bytes} [Thu Sep 8 10:55:50 2022] DELETE /compute/v2.1/os-security-groups/540ef6b8-3e5b-4fdd-b2ef-f191f9f705fc => generated 194 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:55:50.317207 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4f0fc14c-7876-437b-bde3-c75b66f99e3b tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:50.321928 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4f0fc14c-7876-437b-bde3-c75b66f99e3b tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: 93d05d86-99b6-43f0-83c7-257ab64a12f3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:50.333502 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f0fc14c-7876-437b-bde3-c75b66f99e3b tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:50.335290 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f0fc14c-7876-437b-bde3-c75b66f99e3b tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:50.335857 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f0fc14c-7876-437b-bde3-c75b66f99e3b tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:50.339096 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f0fc14c-7876-437b-bde3-c75b66f99e3b tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:50.339877 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f0fc14c-7876-437b-bde3-c75b66f99e3b tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:50.340476 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f0fc14c-7876-437b-bde3-c75b66f99e3b tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:50.492764 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-35d9c7b5-765c-47f9-8cac-24d7132b5e94 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89f6def8f54778b80b315f2eb0c9b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da8b15686cd4d688a48e857fb16e4cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:50.502809 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-35d9c7b5-765c-47f9-8cac-24d7132b5e94 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] 10.222.0.27 "GET /compute/v2.1/servers/b8edf980-3cac-4b70-bbf2-bad0e4681366" status: 200 len: 1529 microversion: 2.1 time: 0.348147 Sep 08 10:55:50.507937 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2031/3990] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:50 2022] GET /compute/v2.1/servers/b8edf980-3cac-4b70-bbf2-bad0e4681366 => generated 1529 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:50.526001 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ae6ca1ef-874e-4d0f-8344-7a54a6be5f0d tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Calling method '.version_select at 0x7f68e45758b0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:50.592134 n-d-850501-12 devstack@n-api.service[128861]: DEBUG neutronclient.v2_0.client [None req-ae6ca1ef-874e-4d0f-8344-7a54a6be5f0d tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3ac11542-baf3-446d-8bc0-0847f6550959 does not exist", "detail": ""}} {{(pid=128861) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 08 10:55:50.592748 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.security_group_api [None req-ae6ca1ef-874e-4d0f-8344-7a54a6be5f0d tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Neutron security group 3ac11542-baf3-446d-8bc0-0847f6550959 not found {{(pid=128861) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 08 10:55:50.593347 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-ae6ca1ef-874e-4d0f-8344-7a54a6be5f0d tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] HTTP exception thrown: Security group 3ac11542-baf3-446d-8bc0-0847f6550959 does not exist Sep 08 10:55:50.593347 n-d-850501-12 devstack@n-api.service[128861]: Neutron server returns request_ids: ['req-c48f8a24-21c7-41df-a796-765d4287c699'] Sep 08 10:55:50.595339 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ae6ca1ef-874e-4d0f-8344-7a54a6be5f0d tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Request method failure captured: Sep 08 10:55:50.595339 n-d-850501-12 devstack@n-api.service[128861]: request: DELETE /compute/v2.1/os-security-groups/3ac11542-baf3-446d-8bc0-0847f6550959 HTTP/1.1 Sep 08 10:55:50.595339 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:55:50.595339 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:55:50.595339 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:55:50.595339 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:55:50.595339 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:55:50.595339 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:55:50.595339 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:55:50.595339 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:55:50.595339 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcnTIBfdH5H0Q1rMlbnLYZQcAnuATI-6ncC0ETqGOy19nshWBWc6mMSPvOE_5zGIQBC9DCOSD4SaG9XyRLj03fab4bxuKCvYlxZzzB9WEeCTo5mGH1uU5x9CALWtC8B7Wu8ih4rvxppcLmpz4ET9xD3ym8uzzB22kwTIB3vo0v5dqyY Sep 08 10:55:50.595339 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:55:50.595339 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:55:50.595339 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:55:50.595339 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:55:50.595339 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:55:50.595339 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:55:50.595339 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 0958700fa94b42b2b6b47af40cf2f679 Sep 08 10:55:50.595339 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-SecurityGroupsTestJSON-353861575 Sep 08 10:55:50.595339 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:55:50.595339 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:55:50.595339 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0958700fa94b42b2b6b47af40cf2f679"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0958700fa94b42b2b6b47af40cf2f679"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0958700fa94b42b2b6b47af40cf2f679"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0958700fa94b42b2b6b47af40cf2f679"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:55:50.595339 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-SecurityGroupsTestJSON-353861575 Sep 08 10:55:50.595339 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 0958700fa94b42b2b6b47af40cf2f679 Sep 08 10:55:50.595339 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-353861575 Sep 08 10:55:50.595339 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-SecurityGroupsTestJSON-353861575-project Sep 08 10:55:50.595339 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:55:50.595339 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:55:50.595339 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: e1bec228c17647bba62ba7d57d28e4ed Sep 08 10:55:50.595339 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-SecurityGroupsTestJSON-353861575-project Sep 08 10:55:50.595339 n-d-850501-12 devstack@n-api.service[128861]: method: Sep 08 10:55:50.595339 n-d-850501-12 devstack@n-api.service[128861]: exception: Security group 3ac11542-baf3-446d-8bc0-0847f6550959 does not exist Sep 08 10:55:50.595339 n-d-850501-12 devstack@n-api.service[128861]: Neutron server returns request_ids: ['req-c48f8a24-21c7-41df-a796-765d4287c699'] Sep 08 10:55:50.595339 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '3ac11542-baf3-446d-8bc0-0847f6550959'} Sep 08 10:55:50.595339 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:55:50.595339 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:50.595339 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 08 10:55:50.595339 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 08 10:55:50.595339 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:55:50.595339 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:55:50.595339 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 08 10:55:50.595339 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 08 10:55:50.595339 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:55:50.595339 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:55:50.595339 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 08 10:55:50.595339 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 08 10:55:50.595339 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:55:50.595339 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:55:50.595339 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 08 10:55:50.595339 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 08 10:55:50.595339 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:55:50.595339 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:55:50.595339 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 08 10:55:50.595339 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 08 10:55:50.595339 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:55:50.595339 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:55:50.595339 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 08 10:55:50.595339 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 08 10:55:50.595339 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 08 10:55:50.595339 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 08 10:55:50.595339 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 3ac11542-baf3-446d-8bc0-0847f6550959 does not exist Sep 08 10:55:50.601945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c48f8a24-21c7-41df-a796-765d4287c699'] Sep 08 10:55:50.601945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:50.601945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:50.601945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:50.601945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:50.601945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 08 10:55:50.601945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 08 10:55:50.601945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 08 10:55:50.601945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 08 10:55:50.601945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 3ac11542-baf3-446d-8bc0-0847f6550959 does not exist Sep 08 10:55:50.601945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c48f8a24-21c7-41df-a796-765d4287c699'] Sep 08 10:55:50.601945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:50.601945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:50.601945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:50.601945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:50.601945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:55:50.601945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:55:50.601945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:55:50.601945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:55:50.601945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:55:50.601945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:55:50.601945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:55:50.601945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:55:50.601945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 08 10:55:50.601945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 08 10:55:50.601945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 3ac11542-baf3-446d-8bc0-0847f6550959 does not exist Sep 08 10:55:50.601945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c48f8a24-21c7-41df-a796-765d4287c699'] Sep 08 10:55:50.601945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:50.601945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:50.601945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:50.601945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:50.601945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:55:50.601945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:55:50.601945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:55:50.601945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:55:50.601945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 3ac11542-baf3-446d-8bc0-0847f6550959 does not exist Sep 08 10:55:50.601945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c48f8a24-21c7-41df-a796-765d4287c699'] Sep 08 10:55:50.601945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:50.601945 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ae6ca1ef-874e-4d0f-8344-7a54a6be5f0d tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Returning 404 to user: Security group 3ac11542-baf3-446d-8bc0-0847f6550959 does not exist Sep 08 10:55:50.601945 n-d-850501-12 devstack@n-api.service[128861]: Neutron server returns request_ids: ['req-c48f8a24-21c7-41df-a796-765d4287c699'] {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:55:50.601945 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ae6ca1ef-874e-4d0f-8344-7a54a6be5f0d tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/3ac11542-baf3-446d-8bc0-0847f6550959" status: 404 len: 194 microversion: 2.1 time: 0.087699 Sep 08 10:55:50.601945 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2032/3991] 10.222.0.27 () {58 vars in 1272 bytes} [Thu Sep 8 10:55:50 2022] DELETE /compute/v2.1/os-security-groups/3ac11542-baf3-446d-8bc0-0847f6550959 => generated 194 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:55:50.615729 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-64bc2416-db16-4a34-979e-6f9567ac606d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:50.616375 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-64bc2416-db16-4a34-979e-6f9567ac606d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 379a5e3e-0e59-4b53-a37e-f4e9d1000eaf] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:50.624712 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64bc2416-db16-4a34-979e-6f9567ac606d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:50.625018 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64bc2416-db16-4a34-979e-6f9567ac606d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:50.625561 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64bc2416-db16-4a34-979e-6f9567ac606d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:50.626330 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64bc2416-db16-4a34-979e-6f9567ac606d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:50.626805 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64bc2416-db16-4a34-979e-6f9567ac606d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:50.627241 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64bc2416-db16-4a34-979e-6f9567ac606d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:50.836108 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4f0fc14c-7876-437b-bde3-c75b66f99e3b tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:50.853461 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4f0fc14c-7876-437b-bde3-c75b66f99e3b tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3" status: 200 len: 1735 microversion: 2.1 time: 0.540047 Sep 08 10:55:50.854335 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1960/3992] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:50 2022] GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3 => generated 1735 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:50.876661 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b470d0c5-0406-4a85-9127-9e291ccb9a4a tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:50.877486 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b470d0c5-0406-4a85-9127-9e291ccb9a4a tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] [instance: 62784844-aa89-4715-a3e2-6346c45e0cdb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:50.883959 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b470d0c5-0406-4a85-9127-9e291ccb9a4a tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:50.884795 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b470d0c5-0406-4a85-9127-9e291ccb9a4a tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:50.895538 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b470d0c5-0406-4a85-9127-9e291ccb9a4a tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:50.896534 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b470d0c5-0406-4a85-9127-9e291ccb9a4a tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:50.897455 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b470d0c5-0406-4a85-9127-9e291ccb9a4a tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:50.898192 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b470d0c5-0406-4a85-9127-9e291ccb9a4a tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:50.945844 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b470d0c5-0406-4a85-9127-9e291ccb9a4a tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] [instance: 62784844-aa89-4715-a3e2-6346c45e0cdb] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:55:51.053369 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b470d0c5-0406-4a85-9127-9e291ccb9a4a tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "DELETE /compute/v2.1/servers/62784844-aa89-4715-a3e2-6346c45e0cdb" status: 204 len: 0 microversion: 2.1 time: 0.182472 Sep 08 10:55:51.054632 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1961/3993] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:55:50 2022] DELETE /compute/v2.1/servers/62784844-aa89-4715-a3e2-6346c45e0cdb => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:55:51.069662 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2d9f2f85-2989-4d81-bb52-6ff821010671 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:51.073104 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2d9f2f85-2989-4d81-bb52-6ff821010671 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:51.106242 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2d9f2f85-2989-4d81-bb52-6ff821010671 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:51.107064 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2d9f2f85-2989-4d81-bb52-6ff821010671 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:51.107683 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2d9f2f85-2989-4d81-bb52-6ff821010671 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:51.110867 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2d9f2f85-2989-4d81-bb52-6ff821010671 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:51.111767 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2d9f2f85-2989-4d81-bb52-6ff821010671 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:51.112381 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2d9f2f85-2989-4d81-bb52-6ff821010671 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:51.113700 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-64bc2416-db16-4a34-979e-6f9567ac606d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:51.145530 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-64bc2416-db16-4a34-979e-6f9567ac606d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/379a5e3e-0e59-4b53-a37e-f4e9d1000eaf" status: 200 len: 1511 microversion: 2.1 time: 0.542387 Sep 08 10:55:51.149984 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2033/3994] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:50 2022] GET /compute/v2.1/servers/379a5e3e-0e59-4b53-a37e-f4e9d1000eaf => generated 1511 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:51.168156 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fb605ff0-19a0-4bc1-98f7-c1c9abc4e0cc tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:51.169216 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fb605ff0-19a0-4bc1-98f7-c1c9abc4e0cc tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] [instance: 9e4282f7-daab-454b-93e5-7854754316c8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:51.178151 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb605ff0-19a0-4bc1-98f7-c1c9abc4e0cc tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:51.179482 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb605ff0-19a0-4bc1-98f7-c1c9abc4e0cc tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:51.180196 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb605ff0-19a0-4bc1-98f7-c1c9abc4e0cc tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:51.181252 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb605ff0-19a0-4bc1-98f7-c1c9abc4e0cc tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:51.182060 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb605ff0-19a0-4bc1-98f7-c1c9abc4e0cc tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:51.183452 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb605ff0-19a0-4bc1-98f7-c1c9abc4e0cc tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:51.240877 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2d9f2f85-2989-4d81-bb52-6ff821010671 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:51.251915 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2d9f2f85-2989-4d81-bb52-6ff821010671 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:51.257680 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2d9f2f85-2989-4d81-bb52-6ff821010671 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:51.265174 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2d9f2f85-2989-4d81-bb52-6ff821010671 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 200 len: 1605 microversion: 2.32 time: 0.208946 Sep 08 10:55:51.288903 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1962/3995] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:55:51 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 1605 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:55:51.298068 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0546bfa2-e1d7-4992-9b6e-c1ba4c161ded tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:51.300684 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0546bfa2-e1d7-4992-9b6e-c1ba4c161ded tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] [instance: 62784844-aa89-4715-a3e2-6346c45e0cdb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:51.314210 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0546bfa2-e1d7-4992-9b6e-c1ba4c161ded tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:51.315053 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0546bfa2-e1d7-4992-9b6e-c1ba4c161ded tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:51.317845 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0546bfa2-e1d7-4992-9b6e-c1ba4c161ded tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:51.318725 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0546bfa2-e1d7-4992-9b6e-c1ba4c161ded tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:51.324185 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0546bfa2-e1d7-4992-9b6e-c1ba4c161ded tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:51.324745 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0546bfa2-e1d7-4992-9b6e-c1ba4c161ded tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:51.463598 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-fb605ff0-19a0-4bc1-98f7-c1c9abc4e0cc tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22145c653c804031ae233de6d84647fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1c70903c3d42d790d9ef96adc1fdbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:51.475912 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fb605ff0-19a0-4bc1-98f7-c1c9abc4e0cc tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] 10.222.0.27 "GET /compute/v2.1/servers/9e4282f7-daab-454b-93e5-7854754316c8" status: 200 len: 1354 microversion: 2.1 time: 0.323926 Sep 08 10:55:51.476811 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2034/3996] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:51 2022] GET /compute/v2.1/servers/9e4282f7-daab-454b-93e5-7854754316c8 => generated 1354 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:51.489587 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-603c65d7-7a83-4767-8df8-9d8d9e3a2ab6 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:51.491519 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-603c65d7-7a83-4767-8df8-9d8d9e3a2ab6 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:51.516087 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-603c65d7-7a83-4767-8df8-9d8d9e3a2ab6 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:51.516357 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-603c65d7-7a83-4767-8df8-9d8d9e3a2ab6 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:51.517445 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-603c65d7-7a83-4767-8df8-9d8d9e3a2ab6 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:51.522113 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-603c65d7-7a83-4767-8df8-9d8d9e3a2ab6 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:51.522680 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-603c65d7-7a83-4767-8df8-9d8d9e3a2ab6 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:51.523319 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-603c65d7-7a83-4767-8df8-9d8d9e3a2ab6 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:51.701667 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0546bfa2-e1d7-4992-9b6e-c1ba4c161ded tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1bec228c17647bba62ba7d57d28e4ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0958700fa94b42b2b6b47af40cf2f679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:51.713407 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0546bfa2-e1d7-4992-9b6e-c1ba4c161ded tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "GET /compute/v2.1/servers/62784844-aa89-4715-a3e2-6346c45e0cdb" status: 200 len: 1646 microversion: 2.1 time: 0.421982 Sep 08 10:55:51.715394 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1963/3997] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:51 2022] GET /compute/v2.1/servers/62784844-aa89-4715-a3e2-6346c45e0cdb => generated 1646 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:51.721802 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7ce5e792-5ce1-4c57-a51a-841d0497fae6 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:51.722739 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7ce5e792-5ce1-4c57-a51a-841d0497fae6 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] [instance: b8edf980-3cac-4b70-bbf2-bad0e4681366] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:51.730201 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ce5e792-5ce1-4c57-a51a-841d0497fae6 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:51.731018 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ce5e792-5ce1-4c57-a51a-841d0497fae6 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:51.731681 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ce5e792-5ce1-4c57-a51a-841d0497fae6 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:51.732619 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ce5e792-5ce1-4c57-a51a-841d0497fae6 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:51.733353 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ce5e792-5ce1-4c57-a51a-841d0497fae6 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:51.734032 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ce5e792-5ce1-4c57-a51a-841d0497fae6 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:51.829882 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7ce5e792-5ce1-4c57-a51a-841d0497fae6 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89f6def8f54778b80b315f2eb0c9b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da8b15686cd4d688a48e857fb16e4cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:51.848513 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7ce5e792-5ce1-4c57-a51a-841d0497fae6 tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] 10.222.0.27 "GET /compute/v2.1/servers/b8edf980-3cac-4b70-bbf2-bad0e4681366" status: 200 len: 1487 microversion: 2.1 time: 0.123212 Sep 08 10:55:51.848513 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1964/3998] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:51 2022] GET /compute/v2.1/servers/b8edf980-3cac-4b70-bbf2-bad0e4681366 => generated 1487 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:51.854405 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-db632f96-5680-4e75-95f2-1444d6bb691d req-da16ef18-b0a1-4296-a0da-499cde546ae6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8edf980-3cac-4b70-bbf2-bad0e4681366", "name": "network-vif-deleted", "tag": "1cfa6b3e-b72b-4178-b6f3-3e1870fd236b"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:55:51.881160 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-db632f96-5680-4e75-95f2-1444d6bb691d req-da16ef18-b0a1-4296-a0da-499cde546ae6 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:51.884522 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-db632f96-5680-4e75-95f2-1444d6bb691d req-da16ef18-b0a1-4296-a0da-499cde546ae6 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:51.885307 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-db632f96-5680-4e75-95f2-1444d6bb691d req-da16ef18-b0a1-4296-a0da-499cde546ae6 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:51.901576 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-db632f96-5680-4e75-95f2-1444d6bb691d req-da16ef18-b0a1-4296-a0da-499cde546ae6 service nova] Creating event network-vif-deleted:1cfa6b3e-b72b-4178-b6f3-3e1870fd236b for instance b8edf980-3cac-4b70-bbf2-bad0e4681366 on n-h1-850501-12 Sep 08 10:55:51.907496 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-db632f96-5680-4e75-95f2-1444d6bb691d req-da16ef18-b0a1-4296-a0da-499cde546ae6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065004 Sep 08 10:55:51.908415 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1965/3999] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:55:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:55:51.916742 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-15d48df0-3fd4-4596-823c-972f6202597a tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:51.917752 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-15d48df0-3fd4-4596-823c-972f6202597a tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: 93d05d86-99b6-43f0-83c7-257ab64a12f3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:51.927653 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15d48df0-3fd4-4596-823c-972f6202597a tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:51.928159 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15d48df0-3fd4-4596-823c-972f6202597a tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:51.928713 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15d48df0-3fd4-4596-823c-972f6202597a tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:51.929474 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15d48df0-3fd4-4596-823c-972f6202597a tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:51.929939 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15d48df0-3fd4-4596-823c-972f6202597a tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:51.930433 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15d48df0-3fd4-4596-823c-972f6202597a tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:51.967752 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-603c65d7-7a83-4767-8df8-9d8d9e3a2ab6 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:51.980471 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-603c65d7-7a83-4767-8df8-9d8d9e3a2ab6 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1510 microversion: 2.1 time: 0.500861 Sep 08 10:55:51.987186 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2035/4000] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:51 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1510 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:52.120918 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-f49321a9-f3e9-460e-a030-d606bcb9c71c req-686487ce-9c95-4238-99a8-0cdf8f0c9dbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e4282f7-daab-454b-93e5-7854754316c8", "tag": "f22fbc47-8d40-4a4a-b4db-418a5a719296"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:55:52.148006 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-f49321a9-f3e9-460e-a030-d606bcb9c71c req-686487ce-9c95-4238-99a8-0cdf8f0c9dbb service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:52.150428 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-f49321a9-f3e9-460e-a030-d606bcb9c71c req-686487ce-9c95-4238-99a8-0cdf8f0c9dbb service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:52.152174 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-f49321a9-f3e9-460e-a030-d606bcb9c71c req-686487ce-9c95-4238-99a8-0cdf8f0c9dbb service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:52.186098 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-f49321a9-f3e9-460e-a030-d606bcb9c71c req-686487ce-9c95-4238-99a8-0cdf8f0c9dbb service nova] Creating event network-changed:f22fbc47-8d40-4a4a-b4db-418a5a719296 for instance 9e4282f7-daab-454b-93e5-7854754316c8 on n-h2-850501-12 Sep 08 10:55:52.194299 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-f49321a9-f3e9-460e-a030-d606bcb9c71c req-686487ce-9c95-4238-99a8-0cdf8f0c9dbb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077270 Sep 08 10:55:52.196114 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2036/4001] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:55:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:55:52.206132 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c12366df-a23a-417a-b7d0-2971fb976e4e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:52.207776 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c12366df-a23a-417a-b7d0-2971fb976e4e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 379a5e3e-0e59-4b53-a37e-f4e9d1000eaf] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:52.216496 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c12366df-a23a-417a-b7d0-2971fb976e4e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:52.218536 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c12366df-a23a-417a-b7d0-2971fb976e4e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:52.219438 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c12366df-a23a-417a-b7d0-2971fb976e4e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:52.221070 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c12366df-a23a-417a-b7d0-2971fb976e4e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:52.222344 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c12366df-a23a-417a-b7d0-2971fb976e4e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:52.223621 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c12366df-a23a-417a-b7d0-2971fb976e4e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:52.258368 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-15d48df0-3fd4-4596-823c-972f6202597a tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:52.285631 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-15d48df0-3fd4-4596-823c-972f6202597a tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3" status: 200 len: 1735 microversion: 2.1 time: 0.365825 Sep 08 10:55:52.286631 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1966/4002] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:51 2022] GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3 => generated 1735 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:52.310123 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1709ba08-4a22-4ba8-bd5b-72539102055d tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:52.311141 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1709ba08-4a22-4ba8-bd5b-72539102055d tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:52.332471 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1709ba08-4a22-4ba8-bd5b-72539102055d tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:52.346071 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1709ba08-4a22-4ba8-bd5b-72539102055d tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:52.346857 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1709ba08-4a22-4ba8-bd5b-72539102055d tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:52.347830 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1709ba08-4a22-4ba8-bd5b-72539102055d tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:52.348503 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1709ba08-4a22-4ba8-bd5b-72539102055d tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:52.349179 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1709ba08-4a22-4ba8-bd5b-72539102055d tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:52.474805 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1709ba08-4a22-4ba8-bd5b-72539102055d tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:52.484147 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c12366df-a23a-417a-b7d0-2971fb976e4e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:52.494913 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c12366df-a23a-417a-b7d0-2971fb976e4e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/379a5e3e-0e59-4b53-a37e-f4e9d1000eaf" status: 200 len: 1511 microversion: 2.1 time: 0.296633 Sep 08 10:55:52.500275 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1709ba08-4a22-4ba8-bd5b-72539102055d tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:52.502680 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2037/4003] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:52 2022] GET /compute/v2.1/servers/379a5e3e-0e59-4b53-a37e-f4e9d1000eaf => generated 1511 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:52.506178 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1709ba08-4a22-4ba8-bd5b-72539102055d tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:52.513530 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1709ba08-4a22-4ba8-bd5b-72539102055d tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 200 len: 1605 microversion: 2.32 time: 0.204489 Sep 08 10:55:52.525464 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1967/4004] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:55:52 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 1605 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:55:52.537522 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bf16ac60-ebd0-4b74-ab15-65d48a2502e3 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:52.546439 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bf16ac60-ebd0-4b74-ab15-65d48a2502e3 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] [instance: 9e4282f7-daab-454b-93e5-7854754316c8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:52.554403 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf16ac60-ebd0-4b74-ab15-65d48a2502e3 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:52.557883 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf16ac60-ebd0-4b74-ab15-65d48a2502e3 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:52.558614 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf16ac60-ebd0-4b74-ab15-65d48a2502e3 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:52.559327 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf16ac60-ebd0-4b74-ab15-65d48a2502e3 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:52.559779 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf16ac60-ebd0-4b74-ab15-65d48a2502e3 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:52.565693 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf16ac60-ebd0-4b74-ab15-65d48a2502e3 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:52.751856 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9501c606-977a-456c-83ff-801f1b6efa72 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:52.752384 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9501c606-977a-456c-83ff-801f1b6efa72 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] [instance: 62784844-aa89-4715-a3e2-6346c45e0cdb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:52.760362 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9501c606-977a-456c-83ff-801f1b6efa72 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:52.773886 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9501c606-977a-456c-83ff-801f1b6efa72 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:52.774647 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9501c606-977a-456c-83ff-801f1b6efa72 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:52.775618 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9501c606-977a-456c-83ff-801f1b6efa72 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:52.776293 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9501c606-977a-456c-83ff-801f1b6efa72 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:52.776718 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9501c606-977a-456c-83ff-801f1b6efa72 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:52.995772 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-bf16ac60-ebd0-4b74-ab15-65d48a2502e3 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22145c653c804031ae233de6d84647fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1c70903c3d42d790d9ef96adc1fdbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:53.011702 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bf16ac60-ebd0-4b74-ab15-65d48a2502e3 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] 10.222.0.27 "GET /compute/v2.1/servers/9e4282f7-daab-454b-93e5-7854754316c8" status: 200 len: 1354 microversion: 2.1 time: 0.507460 Sep 08 10:55:53.012715 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2038/4005] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:52 2022] GET /compute/v2.1/servers/9e4282f7-daab-454b-93e5-7854754316c8 => generated 1354 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:53.018384 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bccf711d-ffb4-4c6c-9217-44e478a8b7ad tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:53.029758 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bccf711d-ffb4-4c6c-9217-44e478a8b7ad tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] [instance: b8edf980-3cac-4b70-bbf2-bad0e4681366] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:53.043280 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bccf711d-ffb4-4c6c-9217-44e478a8b7ad tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:53.044112 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bccf711d-ffb4-4c6c-9217-44e478a8b7ad tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:53.044816 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bccf711d-ffb4-4c6c-9217-44e478a8b7ad tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:53.049511 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bccf711d-ffb4-4c6c-9217-44e478a8b7ad tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:53.050533 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bccf711d-ffb4-4c6c-9217-44e478a8b7ad tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:53.051061 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bccf711d-ffb4-4c6c-9217-44e478a8b7ad tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:53.063634 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9501c606-977a-456c-83ff-801f1b6efa72 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1bec228c17647bba62ba7d57d28e4ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0958700fa94b42b2b6b47af40cf2f679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:53.080758 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9501c606-977a-456c-83ff-801f1b6efa72 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "GET /compute/v2.1/servers/62784844-aa89-4715-a3e2-6346c45e0cdb" status: 200 len: 1646 microversion: 2.1 time: 0.333107 Sep 08 10:55:53.092488 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1968/4006] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:52 2022] GET /compute/v2.1/servers/62784844-aa89-4715-a3e2-6346c45e0cdb => generated 1646 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:55:53.093503 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-bccf711d-ffb4-4c6c-9217-44e478a8b7ad tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] HTTP exception thrown: Instance b8edf980-3cac-4b70-bbf2-bad0e4681366 could not be found. Sep 08 10:55:53.093503 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bccf711d-ffb4-4c6c-9217-44e478a8b7ad tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Request method failure captured: Sep 08 10:55:53.093503 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/b8edf980-3cac-4b70-bbf2-bad0e4681366 HTTP/1.1 Sep 08 10:55:53.093503 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:55:53.093503 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:55:53.093503 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:55:53.093503 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:55:53.093503 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:55:53.093503 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:55:53.093503 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:55:53.093503 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:55:53.093503 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcoVlcfMWzdVuDQg7vWFqQQFDtU3VeE8k9GtY9VXHJ5AO064Rinh5_6LtM43avMwWZAqAcmfs2dkE140ZBopWPpL6yY2E9XG-QcbU6IiQmkCSPig7329idCYmNEYxF4tkaqq-gf3RKzIRRUbriIA4nWBxRVw49p8wbYECrvlHwD682I Sep 08 10:55:53.093503 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:55:53.093503 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:55:53.093503 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:55:53.093503 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:55:53.093503 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:55:53.093503 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:55:53.093503 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 4da8b15686cd4d688a48e857fb16e4cf Sep 08 10:55:53.093503 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-869175413 Sep 08 10:55:53.093503 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:55:53.093503 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:55:53.093503 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4da8b15686cd4d688a48e857fb16e4cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4da8b15686cd4d688a48e857fb16e4cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4da8b15686cd4d688a48e857fb16e4cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4da8b15686cd4d688a48e857fb16e4cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:55:53.093503 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-869175413 Sep 08 10:55:53.093503 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 4da8b15686cd4d688a48e857fb16e4cf Sep 08 10:55:53.093503 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-869175413 Sep 08 10:55:53.093503 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServerAddressesNegativeTestJSON-869175413-project Sep 08 10:55:53.093503 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:55:53.093503 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:55:53.093503 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: ad89f6def8f54778b80b315f2eb0c9b5 Sep 08 10:55:53.093503 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-869175413-project Sep 08 10:55:53.093503 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:55:53.093503 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance b8edf980-3cac-4b70-bbf2-bad0e4681366 could not be found. Sep 08 10:55:53.093503 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': 'b8edf980-3cac-4b70-bbf2-bad0e4681366'} Sep 08 10:55:53.093503 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:55:53.093503 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:53.093503 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:55:53.093503 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:55:53.093503 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:55:53.093503 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:55:53.093503 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:55:53.093503 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:55:53.093503 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:55:53.093503 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:55:53.093503 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8edf980-3cac-4b70-bbf2-bad0e4681366 could not be found. Sep 08 10:55:53.093503 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:53.093503 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:53.093503 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:53.093503 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:53.093503 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:55:53.093503 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:55:53.093503 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:55:53.093503 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:55:53.093503 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:55:53.093503 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:55:53.093503 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:55:53.093503 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:55:53.093503 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:55:53.093503 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:55:53.093503 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:55:53.118751 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:55:53.118751 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8edf980-3cac-4b70-bbf2-bad0e4681366 could not be found. Sep 08 10:55:53.118751 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:53.118751 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:53.118751 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:53.118751 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:53.118751 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:55:53.118751 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:55:53.118751 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:55:53.118751 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:55:53.118751 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8edf980-3cac-4b70-bbf2-bad0e4681366 could not be found. Sep 08 10:55:53.118751 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:53.118751 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bccf711d-ffb4-4c6c-9217-44e478a8b7ad tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] Returning 404 to user: Instance b8edf980-3cac-4b70-bbf2-bad0e4681366 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:55:53.118751 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bccf711d-ffb4-4c6c-9217-44e478a8b7ad tempest-ServerAddressesNegativeTestJSON-869175413 tempest-ServerAddressesNegativeTestJSON-869175413-project] 10.222.0.27 "GET /compute/v2.1/servers/b8edf980-3cac-4b70-bbf2-bad0e4681366" status: 404 len: 111 microversion: 2.1 time: 0.076909 Sep 08 10:55:53.118751 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2039/4007] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:53 2022] GET /compute/v2.1/servers/b8edf980-3cac-4b70-bbf2-bad0e4681366 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:55:53.121237 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-97a719e1-3ed4-4d83-a69f-3bbca7faf79e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:53.121237 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-97a719e1-3ed4-4d83-a69f-3bbca7faf79e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:53.121237 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-97a719e1-3ed4-4d83-a69f-3bbca7faf79e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:53.121237 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-97a719e1-3ed4-4d83-a69f-3bbca7faf79e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:53.132652 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-97a719e1-3ed4-4d83-a69f-3bbca7faf79e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:53.132652 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-97a719e1-3ed4-4d83-a69f-3bbca7faf79e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:53.132652 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-97a719e1-3ed4-4d83-a69f-3bbca7faf79e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:53.132652 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-97a719e1-3ed4-4d83-a69f-3bbca7faf79e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:53.324177 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7893c07c-e8df-4e1d-981e-5784af25f4c2 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:53.324837 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7893c07c-e8df-4e1d-981e-5784af25f4c2 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: 93d05d86-99b6-43f0-83c7-257ab64a12f3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:53.346576 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7893c07c-e8df-4e1d-981e-5784af25f4c2 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:53.347122 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7893c07c-e8df-4e1d-981e-5784af25f4c2 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:53.347620 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7893c07c-e8df-4e1d-981e-5784af25f4c2 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:53.348396 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7893c07c-e8df-4e1d-981e-5784af25f4c2 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:53.348900 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7893c07c-e8df-4e1d-981e-5784af25f4c2 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:53.349376 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7893c07c-e8df-4e1d-981e-5784af25f4c2 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:54.078655 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7893c07c-e8df-4e1d-981e-5784af25f4c2 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:54.101294 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7893c07c-e8df-4e1d-981e-5784af25f4c2 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3" status: 200 len: 1735 microversion: 2.1 time: 0.771029 Sep 08 10:55:54.101905 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2040/4008] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:53 2022] GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3 => generated 1735 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:55:54.106995 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6b193370-fe6a-4dfa-8ad1-472530c728d0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:54.107619 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6b193370-fe6a-4dfa-8ad1-472530c728d0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 379a5e3e-0e59-4b53-a37e-f4e9d1000eaf] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:54.125123 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-97a719e1-3ed4-4d83-a69f-3bbca7faf79e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:54.134296 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-97a719e1-3ed4-4d83-a69f-3bbca7faf79e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1510 microversion: 2.1 time: 1.051225 Sep 08 10:55:54.140347 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6b193370-fe6a-4dfa-8ad1-472530c728d0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:54.140856 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6b193370-fe6a-4dfa-8ad1-472530c728d0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:54.141324 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6b193370-fe6a-4dfa-8ad1-472530c728d0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:54.142051 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6b193370-fe6a-4dfa-8ad1-472530c728d0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:54.143533 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6b193370-fe6a-4dfa-8ad1-472530c728d0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:54.143964 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6b193370-fe6a-4dfa-8ad1-472530c728d0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:54.155539 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1969/4009] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:53 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1510 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:54.174253 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-25fc9161-e7d1-4387-9f99-972ff593ab54 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:54.181653 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-25fc9161-e7d1-4387-9f99-972ff593ab54 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:54.199907 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25fc9161-e7d1-4387-9f99-972ff593ab54 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:54.200408 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25fc9161-e7d1-4387-9f99-972ff593ab54 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:54.200846 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25fc9161-e7d1-4387-9f99-972ff593ab54 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:54.201606 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25fc9161-e7d1-4387-9f99-972ff593ab54 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:54.202435 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25fc9161-e7d1-4387-9f99-972ff593ab54 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:54.203816 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25fc9161-e7d1-4387-9f99-972ff593ab54 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:54.440221 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-25fc9161-e7d1-4387-9f99-972ff593ab54 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:54.463554 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-25fc9161-e7d1-4387-9f99-972ff593ab54 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:54.468905 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-25fc9161-e7d1-4387-9f99-972ff593ab54 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:54.472477 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-25fc9161-e7d1-4387-9f99-972ff593ab54 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 200 len: 1605 microversion: 2.32 time: 0.311758 Sep 08 10:55:54.475567 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1970/4010] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:55:54 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 1605 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:55:54.487154 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-733a2766-6d0c-4e7e-bc5b-603e770f0030 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:54.491830 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-733a2766-6d0c-4e7e-bc5b-603e770f0030 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] [instance: 9e4282f7-daab-454b-93e5-7854754316c8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:54.513525 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-733a2766-6d0c-4e7e-bc5b-603e770f0030 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:54.515821 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-733a2766-6d0c-4e7e-bc5b-603e770f0030 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:54.517548 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-733a2766-6d0c-4e7e-bc5b-603e770f0030 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:54.519548 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-733a2766-6d0c-4e7e-bc5b-603e770f0030 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:54.521434 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-733a2766-6d0c-4e7e-bc5b-603e770f0030 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:54.523687 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-733a2766-6d0c-4e7e-bc5b-603e770f0030 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:55.030746 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-733a2766-6d0c-4e7e-bc5b-603e770f0030 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22145c653c804031ae233de6d84647fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1c70903c3d42d790d9ef96adc1fdbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:55.046356 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-733a2766-6d0c-4e7e-bc5b-603e770f0030 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] 10.222.0.27 "GET /compute/v2.1/servers/9e4282f7-daab-454b-93e5-7854754316c8" status: 200 len: 1354 microversion: 2.1 time: 0.563705 Sep 08 10:55:55.062182 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1971/4011] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:54 2022] GET /compute/v2.1/servers/9e4282f7-daab-454b-93e5-7854754316c8 => generated 1354 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:55.070018 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2c376895-e097-4199-bca8-6e1e14ebcb02 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:55.070656 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2c376895-e097-4199-bca8-6e1e14ebcb02 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] [instance: 62784844-aa89-4715-a3e2-6346c45e0cdb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:55.079133 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2c376895-e097-4199-bca8-6e1e14ebcb02 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:55.079642 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2c376895-e097-4199-bca8-6e1e14ebcb02 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:55.080345 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2c376895-e097-4199-bca8-6e1e14ebcb02 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:55.081134 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2c376895-e097-4199-bca8-6e1e14ebcb02 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:55.082065 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2c376895-e097-4199-bca8-6e1e14ebcb02 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:55.082769 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2c376895-e097-4199-bca8-6e1e14ebcb02 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:55.120056 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6b193370-fe6a-4dfa-8ad1-472530c728d0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:55.132332 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6b193370-fe6a-4dfa-8ad1-472530c728d0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/379a5e3e-0e59-4b53-a37e-f4e9d1000eaf" status: 200 len: 1511 microversion: 2.1 time: 1.029109 Sep 08 10:55:55.135758 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2041/4012] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:54 2022] GET /compute/v2.1/servers/379a5e3e-0e59-4b53-a37e-f4e9d1000eaf => generated 1511 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:55.157192 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-81a91872-7fa6-4df1-8b78-c0d1317c69f5 req-8f6e58d8-411f-4650-b8ef-928e65923611 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62784844-aa89-4715-a3e2-6346c45e0cdb", "name": "network-vif-deleted", "tag": "b935b113-3fd8-4c56-8353-221839b04fcc"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:55:55.162793 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2c376895-e097-4199-bca8-6e1e14ebcb02 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:55.163967 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2c376895-e097-4199-bca8-6e1e14ebcb02 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:55.164420 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2c376895-e097-4199-bca8-6e1e14ebcb02 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:55.164885 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-2c376895-e097-4199-bca8-6e1e14ebcb02 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lazy-loading 'fault' on Instance uuid 62784844-aa89-4715-a3e2-6346c45e0cdb {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:55:55.190154 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-81a91872-7fa6-4df1-8b78-c0d1317c69f5 req-8f6e58d8-411f-4650-b8ef-928e65923611 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:55.190649 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-81a91872-7fa6-4df1-8b78-c0d1317c69f5 req-8f6e58d8-411f-4650-b8ef-928e65923611 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:55.191557 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-81a91872-7fa6-4df1-8b78-c0d1317c69f5 req-8f6e58d8-411f-4650-b8ef-928e65923611 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:55.229198 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2c376895-e097-4199-bca8-6e1e14ebcb02 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1bec228c17647bba62ba7d57d28e4ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0958700fa94b42b2b6b47af40cf2f679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:55.232906 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-81a91872-7fa6-4df1-8b78-c0d1317c69f5 req-8f6e58d8-411f-4650-b8ef-928e65923611 service nova] Creating event network-vif-deleted:b935b113-3fd8-4c56-8353-221839b04fcc for instance 62784844-aa89-4715-a3e2-6346c45e0cdb on n-h2-850501-12 Sep 08 10:55:55.242309 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2c376895-e097-4199-bca8-6e1e14ebcb02 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "GET /compute/v2.1/servers/62784844-aa89-4715-a3e2-6346c45e0cdb" status: 200 len: 1305 microversion: 2.1 time: 0.178052 Sep 08 10:55:55.242887 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-81a91872-7fa6-4df1-8b78-c0d1317c69f5 req-8f6e58d8-411f-4650-b8ef-928e65923611 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105865 Sep 08 10:55:55.243489 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2042/4013] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:55:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:55:55.248584 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-80acfe34-1d8d-46b3-9780-e48263ebad02 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:55.258200 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1972/4014] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:55 2022] GET /compute/v2.1/servers/62784844-aa89-4715-a3e2-6346c45e0cdb => generated 1305 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:55.258536 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-80acfe34-1d8d-46b3-9780-e48263ebad02 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: 93d05d86-99b6-43f0-83c7-257ab64a12f3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:55.265420 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bf9aa231-9ea0-4cc0-88bc-16f83c443617 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:55.270143 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bf9aa231-9ea0-4cc0-88bc-16f83c443617 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:55.271689 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-80acfe34-1d8d-46b3-9780-e48263ebad02 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:55.272195 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-80acfe34-1d8d-46b3-9780-e48263ebad02 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:55.272636 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-80acfe34-1d8d-46b3-9780-e48263ebad02 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:55.273371 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-80acfe34-1d8d-46b3-9780-e48263ebad02 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:55.274003 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-80acfe34-1d8d-46b3-9780-e48263ebad02 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:55.274417 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-80acfe34-1d8d-46b3-9780-e48263ebad02 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:55.280045 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf9aa231-9ea0-4cc0-88bc-16f83c443617 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:55.284952 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf9aa231-9ea0-4cc0-88bc-16f83c443617 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:55.285515 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf9aa231-9ea0-4cc0-88bc-16f83c443617 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:55.286726 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf9aa231-9ea0-4cc0-88bc-16f83c443617 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:55.287403 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf9aa231-9ea0-4cc0-88bc-16f83c443617 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:55.287896 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf9aa231-9ea0-4cc0-88bc-16f83c443617 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:55.649474 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bf9aa231-9ea0-4cc0-88bc-16f83c443617 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:55.660701 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:55:55.683788 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bf9aa231-9ea0-4cc0-88bc-16f83c443617 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1510 microversion: 2.1 time: 0.420860 Sep 08 10:55:55.684938 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1973/4015] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:55 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1510 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:55.694296 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-80acfe34-1d8d-46b3-9780-e48263ebad02 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:55.713820 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bf9f26c5-6dbf-47e0-a6a2-4968f76f5363 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:55.717151 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bf9f26c5-6dbf-47e0-a6a2-4968f76f5363 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:55.724248 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-80acfe34-1d8d-46b3-9780-e48263ebad02 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3" status: 200 len: 1735 microversion: 2.1 time: 0.478938 Sep 08 10:55:55.725433 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2043/4016] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:55 2022] GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3 => generated 1735 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:55.743940 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf9f26c5-6dbf-47e0-a6a2-4968f76f5363 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:55.747377 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf9f26c5-6dbf-47e0-a6a2-4968f76f5363 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:55.748769 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf9f26c5-6dbf-47e0-a6a2-4968f76f5363 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:55.751172 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf9f26c5-6dbf-47e0-a6a2-4968f76f5363 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:55.755554 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf9f26c5-6dbf-47e0-a6a2-4968f76f5363 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:55.756707 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf9f26c5-6dbf-47e0-a6a2-4968f76f5363 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:55.939813 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bf9f26c5-6dbf-47e0-a6a2-4968f76f5363 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:55.979667 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bf9f26c5-6dbf-47e0-a6a2-4968f76f5363 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:55.982405 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bf9f26c5-6dbf-47e0-a6a2-4968f76f5363 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:55.993176 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bf9f26c5-6dbf-47e0-a6a2-4968f76f5363 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 200 len: 1605 microversion: 2.32 time: 0.302050 Sep 08 10:55:55.994449 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1974/4017] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:55:55 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 1605 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:55:56.075989 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c3726a3e-5d7b-4c0b-96f0-fd2e177ea7bc tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:56.076747 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c3726a3e-5d7b-4c0b-96f0-fd2e177ea7bc tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] [instance: 9e4282f7-daab-454b-93e5-7854754316c8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:56.095635 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c3726a3e-5d7b-4c0b-96f0-fd2e177ea7bc tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:56.100422 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c3726a3e-5d7b-4c0b-96f0-fd2e177ea7bc tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:56.101011 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c3726a3e-5d7b-4c0b-96f0-fd2e177ea7bc tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:56.102135 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c3726a3e-5d7b-4c0b-96f0-fd2e177ea7bc tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:56.103939 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c3726a3e-5d7b-4c0b-96f0-fd2e177ea7bc tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:56.106729 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c3726a3e-5d7b-4c0b-96f0-fd2e177ea7bc tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:56.162871 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1ed3f4b8-f08e-4c14-9f6d-a4a6fafccdd6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:56.167405 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1ed3f4b8-f08e-4c14-9f6d-a4a6fafccdd6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 379a5e3e-0e59-4b53-a37e-f4e9d1000eaf] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:56.175327 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:55:56.190911 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ed3f4b8-f08e-4c14-9f6d-a4a6fafccdd6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:56.191417 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ed3f4b8-f08e-4c14-9f6d-a4a6fafccdd6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:56.192075 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ed3f4b8-f08e-4c14-9f6d-a4a6fafccdd6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:56.192870 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ed3f4b8-f08e-4c14-9f6d-a4a6fafccdd6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:56.193364 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ed3f4b8-f08e-4c14-9f6d-a4a6fafccdd6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:56.193791 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ed3f4b8-f08e-4c14-9f6d-a4a6fafccdd6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:56.521743 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c3726a3e-5d7b-4c0b-96f0-fd2e177ea7bc tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22145c653c804031ae233de6d84647fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1c70903c3d42d790d9ef96adc1fdbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:56.534699 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c3726a3e-5d7b-4c0b-96f0-fd2e177ea7bc tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] 10.222.0.27 "GET /compute/v2.1/servers/9e4282f7-daab-454b-93e5-7854754316c8" status: 200 len: 1354 microversion: 2.1 time: 0.461063 Sep 08 10:55:56.535483 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2044/4018] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:56 2022] GET /compute/v2.1/servers/9e4282f7-daab-454b-93e5-7854754316c8 => generated 1354 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:56.541980 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-23dbe957-d918-4fbf-9207-088d18a8f283 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:56.542903 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-23dbe957-d918-4fbf-9207-088d18a8f283 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] [instance: 62784844-aa89-4715-a3e2-6346c45e0cdb] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:56.562941 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-23dbe957-d918-4fbf-9207-088d18a8f283 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:56.563803 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-23dbe957-d918-4fbf-9207-088d18a8f283 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:56.564517 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-23dbe957-d918-4fbf-9207-088d18a8f283 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:56.565550 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-23dbe957-d918-4fbf-9207-088d18a8f283 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:56.566254 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-23dbe957-d918-4fbf-9207-088d18a8f283 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:56.566918 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-23dbe957-d918-4fbf-9207-088d18a8f283 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:56.586603 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-23dbe957-d918-4fbf-9207-088d18a8f283 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] HTTP exception thrown: Instance 62784844-aa89-4715-a3e2-6346c45e0cdb could not be found. Sep 08 10:55:56.589580 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-23dbe957-d918-4fbf-9207-088d18a8f283 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Request method failure captured: Sep 08 10:55:56.589580 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/62784844-aa89-4715-a3e2-6346c45e0cdb HTTP/1.1 Sep 08 10:55:56.589580 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:55:56.589580 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:55:56.589580 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:55:56.589580 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:55:56.589580 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:55:56.589580 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:55:56.589580 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:55:56.589580 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:55:56.589580 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcnTIBfdH5H0Q1rMlbnLYZQcAnuATI-6ncC0ETqGOy19nshWBWc6mMSPvOE_5zGIQBC9DCOSD4SaG9XyRLj03fab4bxuKCvYlxZzzB9WEeCTo5mGH1uU5x9CALWtC8B7Wu8ih4rvxppcLmpz4ET9xD3ym8uzzB22kwTIB3vo0v5dqyY Sep 08 10:55:56.589580 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:55:56.589580 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:55:56.589580 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:55:56.589580 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:55:56.589580 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:55:56.589580 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:55:56.589580 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 0958700fa94b42b2b6b47af40cf2f679 Sep 08 10:55:56.589580 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-SecurityGroupsTestJSON-353861575 Sep 08 10:55:56.589580 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:55:56.589580 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:55:56.589580 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0958700fa94b42b2b6b47af40cf2f679"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0958700fa94b42b2b6b47af40cf2f679"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0958700fa94b42b2b6b47af40cf2f679"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0958700fa94b42b2b6b47af40cf2f679"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:55:56.589580 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-SecurityGroupsTestJSON-353861575 Sep 08 10:55:56.589580 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 0958700fa94b42b2b6b47af40cf2f679 Sep 08 10:55:56.589580 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-353861575 Sep 08 10:55:56.589580 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-SecurityGroupsTestJSON-353861575-project Sep 08 10:55:56.589580 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:55:56.589580 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:55:56.589580 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: e1bec228c17647bba62ba7d57d28e4ed Sep 08 10:55:56.589580 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-SecurityGroupsTestJSON-353861575-project Sep 08 10:55:56.589580 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:55:56.589580 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 62784844-aa89-4715-a3e2-6346c45e0cdb could not be found. Sep 08 10:55:56.589580 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '62784844-aa89-4715-a3e2-6346c45e0cdb'} Sep 08 10:55:56.589580 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:55:56.589580 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:56.589580 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:55:56.589580 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:55:56.589580 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:55:56.589580 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:55:56.589580 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:55:56.589580 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:55:56.589580 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:55:56.589580 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:55:56.589580 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62784844-aa89-4715-a3e2-6346c45e0cdb could not be found. Sep 08 10:55:56.589580 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:56.589580 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:56.589580 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:56.589580 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:56.589580 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:55:56.589580 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:55:56.589580 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:55:56.589580 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:55:56.589580 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:55:56.589580 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:55:56.589580 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:55:56.589580 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:55:56.589580 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:55:56.589580 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:55:56.589580 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:55:56.589580 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:55:56.589580 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62784844-aa89-4715-a3e2-6346c45e0cdb could not be found. Sep 08 10:55:56.589580 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:56.589580 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:56.589580 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:56.597405 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:56.597405 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:55:56.597405 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:55:56.597405 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:55:56.597405 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:55:56.597405 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62784844-aa89-4715-a3e2-6346c45e0cdb could not be found. Sep 08 10:55:56.597405 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:55:56.597405 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-23dbe957-d918-4fbf-9207-088d18a8f283 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Returning 404 to user: Instance 62784844-aa89-4715-a3e2-6346c45e0cdb could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:55:56.597405 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-23dbe957-d918-4fbf-9207-088d18a8f283 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "GET /compute/v2.1/servers/62784844-aa89-4715-a3e2-6346c45e0cdb" status: 404 len: 111 microversion: 2.1 time: 0.057748 Sep 08 10:55:56.598790 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2045/4019] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:56 2022] GET /compute/v2.1/servers/62784844-aa89-4715-a3e2-6346c45e0cdb => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:55:56.615032 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c15b91f1-207a-4880-b980-c3afb0d9e8f4 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Calling method '.version_select at 0x7f68e48c9a60>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:56.648578 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1ed3f4b8-f08e-4c14-9f6d-a4a6fafccdd6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:56.659943 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1ed3f4b8-f08e-4c14-9f6d-a4a6fafccdd6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/379a5e3e-0e59-4b53-a37e-f4e9d1000eaf" status: 200 len: 1511 microversion: 2.1 time: 0.504877 Sep 08 10:55:56.662278 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1975/4020] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:56 2022] GET /compute/v2.1/servers/379a5e3e-0e59-4b53-a37e-f4e9d1000eaf => generated 1511 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:56.729799 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e045ab6c-4d26-4bf0-9dfb-7e70f6e38ad5 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:56.730412 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e045ab6c-4d26-4bf0-9dfb-7e70f6e38ad5 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:56.746792 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e045ab6c-4d26-4bf0-9dfb-7e70f6e38ad5 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:56.747605 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e045ab6c-4d26-4bf0-9dfb-7e70f6e38ad5 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:56.748243 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e045ab6c-4d26-4bf0-9dfb-7e70f6e38ad5 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:56.749713 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e045ab6c-4d26-4bf0-9dfb-7e70f6e38ad5 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:56.750518 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e045ab6c-4d26-4bf0-9dfb-7e70f6e38ad5 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:56.751127 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e045ab6c-4d26-4bf0-9dfb-7e70f6e38ad5 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:57.058691 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c15b91f1-207a-4880-b980-c3afb0d9e8f4 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/97eb00bc-fe26-42f9-82f9-a30716b36096" status: 202 len: 0 microversion: 2.1 time: 0.455489 Sep 08 10:55:57.059534 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2046/4021] 10.222.0.27 () {58 vars in 1272 bytes} [Thu Sep 8 10:55:56 2022] DELETE /compute/v2.1/os-security-groups/97eb00bc-fe26-42f9-82f9-a30716b36096 => generated 0 bytes in 457 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:55:57.070633 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cd458cea-8352-44ea-b515-5c00ecfdb0e9 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:57.072188 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cd458cea-8352-44ea-b515-5c00ecfdb0e9 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: 93d05d86-99b6-43f0-83c7-257ab64a12f3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:57.104447 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cd458cea-8352-44ea-b515-5c00ecfdb0e9 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:57.105264 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cd458cea-8352-44ea-b515-5c00ecfdb0e9 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:57.105914 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cd458cea-8352-44ea-b515-5c00ecfdb0e9 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:57.107200 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cd458cea-8352-44ea-b515-5c00ecfdb0e9 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:57.109279 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cd458cea-8352-44ea-b515-5c00ecfdb0e9 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:57.110369 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cd458cea-8352-44ea-b515-5c00ecfdb0e9 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:57.195967 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e045ab6c-4d26-4bf0-9dfb-7e70f6e38ad5 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:57.210299 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e045ab6c-4d26-4bf0-9dfb-7e70f6e38ad5 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1531 microversion: 2.1 time: 0.484616 Sep 08 10:55:57.214358 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1976/4022] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:56 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1531 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:57.222085 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bc1f28c3-ea2b-40f3-a67a-2f29b3d82120 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:57.223325 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bc1f28c3-ea2b-40f3-a67a-2f29b3d82120 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:57.250524 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bc1f28c3-ea2b-40f3-a67a-2f29b3d82120 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:57.251318 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bc1f28c3-ea2b-40f3-a67a-2f29b3d82120 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:57.251941 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bc1f28c3-ea2b-40f3-a67a-2f29b3d82120 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:57.252860 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bc1f28c3-ea2b-40f3-a67a-2f29b3d82120 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:57.253568 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bc1f28c3-ea2b-40f3-a67a-2f29b3d82120 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:57.254192 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bc1f28c3-ea2b-40f3-a67a-2f29b3d82120 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:57.388793 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-cd458cea-8352-44ea-b515-5c00ecfdb0e9 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:57.400331 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cd458cea-8352-44ea-b515-5c00ecfdb0e9 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3" status: 200 len: 1735 microversion: 2.1 time: 0.339300 Sep 08 10:55:57.413170 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2047/4023] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:57 2022] GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3 => generated 1735 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:57.416676 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bc1f28c3-ea2b-40f3-a67a-2f29b3d82120 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:57.424263 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bae881b8-8c87-46bd-9f7d-5a1c889f8585 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] Calling method '.version_select at 0x7f68e4a25940>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:57.443157 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bc1f28c3-ea2b-40f3-a67a-2f29b3d82120 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:57.450736 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bc1f28c3-ea2b-40f3-a67a-2f29b3d82120 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:57.454617 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bc1f28c3-ea2b-40f3-a67a-2f29b3d82120 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 200 len: 1605 microversion: 2.32 time: 0.236039 Sep 08 10:55:57.457256 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1977/4024] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:55:57 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 1605 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:55:57.565906 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ff4ce4bf-2d83-4bc7-bc10-1d9a0a60f299 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:57.565906 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ff4ce4bf-2d83-4bc7-bc10-1d9a0a60f299 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] [instance: 9e4282f7-daab-454b-93e5-7854754316c8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:57.575455 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff4ce4bf-2d83-4bc7-bc10-1d9a0a60f299 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:57.577425 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff4ce4bf-2d83-4bc7-bc10-1d9a0a60f299 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:57.578458 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff4ce4bf-2d83-4bc7-bc10-1d9a0a60f299 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:57.580590 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff4ce4bf-2d83-4bc7-bc10-1d9a0a60f299 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:57.581501 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff4ce4bf-2d83-4bc7-bc10-1d9a0a60f299 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:57.582194 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff4ce4bf-2d83-4bc7-bc10-1d9a0a60f299 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:57.875547 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bae881b8-8c87-46bd-9f7d-5a1c889f8585 tempest-SecurityGroupsTestJSON-353861575 tempest-SecurityGroupsTestJSON-353861575-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/98cfc01d-d0f6-4876-b482-4fe1e2cc1feb" status: 202 len: 0 microversion: 2.1 time: 0.459736 Sep 08 10:55:57.880327 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2048/4025] 10.222.0.27 () {58 vars in 1272 bytes} [Thu Sep 8 10:55:57 2022] DELETE /compute/v2.1/os-security-groups/98cfc01d-d0f6-4876-b482-4fe1e2cc1feb => generated 0 bytes in 466 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:55:57.886218 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5e517c4d-0f7f-446a-9c6c-9ee24556c9ad tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:57.888828 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5e517c4d-0f7f-446a-9c6c-9ee24556c9ad tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 379a5e3e-0e59-4b53-a37e-f4e9d1000eaf] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:57.907835 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5e517c4d-0f7f-446a-9c6c-9ee24556c9ad tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:57.909450 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5e517c4d-0f7f-446a-9c6c-9ee24556c9ad tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:57.911009 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5e517c4d-0f7f-446a-9c6c-9ee24556c9ad tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:57.915293 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5e517c4d-0f7f-446a-9c6c-9ee24556c9ad tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:57.916386 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5e517c4d-0f7f-446a-9c6c-9ee24556c9ad tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:57.917175 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5e517c4d-0f7f-446a-9c6c-9ee24556c9ad tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:58.140436 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ff4ce4bf-2d83-4bc7-bc10-1d9a0a60f299 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22145c653c804031ae233de6d84647fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1c70903c3d42d790d9ef96adc1fdbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:58.150728 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ff4ce4bf-2d83-4bc7-bc10-1d9a0a60f299 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] 10.222.0.27 "GET /compute/v2.1/servers/9e4282f7-daab-454b-93e5-7854754316c8" status: 200 len: 1354 microversion: 2.1 time: 0.590566 Sep 08 10:55:58.167693 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1978/4026] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:57 2022] GET /compute/v2.1/servers/9e4282f7-daab-454b-93e5-7854754316c8 => generated 1354 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:55:58.237800 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a2b12b00-1179-45a6-ba4c-5f1d90f24259 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:58.239250 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a2b12b00-1179-45a6-ba4c-5f1d90f24259 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:58.264149 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2b12b00-1179-45a6-ba4c-5f1d90f24259 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:58.268130 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2b12b00-1179-45a6-ba4c-5f1d90f24259 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:58.276413 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2b12b00-1179-45a6-ba4c-5f1d90f24259 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:58.278095 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2b12b00-1179-45a6-ba4c-5f1d90f24259 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:58.281803 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2b12b00-1179-45a6-ba4c-5f1d90f24259 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:58.283657 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2b12b00-1179-45a6-ba4c-5f1d90f24259 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:58.423517 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5e517c4d-0f7f-446a-9c6c-9ee24556c9ad tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:58.438032 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5e517c4d-0f7f-446a-9c6c-9ee24556c9ad tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/379a5e3e-0e59-4b53-a37e-f4e9d1000eaf" status: 200 len: 1511 microversion: 2.1 time: 0.556373 Sep 08 10:55:58.444204 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2049/4027] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:57 2022] GET /compute/v2.1/servers/379a5e3e-0e59-4b53-a37e-f4e9d1000eaf => generated 1511 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:58.452460 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f0640084-b010-4b5f-a653-7f04eb73a23d tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:58.453384 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f0640084-b010-4b5f-a653-7f04eb73a23d tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: 93d05d86-99b6-43f0-83c7-257ab64a12f3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:58.475811 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f0640084-b010-4b5f-a653-7f04eb73a23d tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:58.485575 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f0640084-b010-4b5f-a653-7f04eb73a23d tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:58.487721 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f0640084-b010-4b5f-a653-7f04eb73a23d tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:58.489773 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f0640084-b010-4b5f-a653-7f04eb73a23d tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:58.490847 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f0640084-b010-4b5f-a653-7f04eb73a23d tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:58.492164 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f0640084-b010-4b5f-a653-7f04eb73a23d tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:58.501297 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=100 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:55:58.741461 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a2b12b00-1179-45a6-ba4c-5f1d90f24259 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:58.758335 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a2b12b00-1179-45a6-ba4c-5f1d90f24259 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1531 microversion: 2.1 time: 0.523784 Sep 08 10:55:58.760943 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1979/4028] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:58 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1531 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:55:58.774991 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e89cf9a4-2555-4aee-9348-c1c23a57be9d tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:58.777117 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e89cf9a4-2555-4aee-9348-c1c23a57be9d tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:58.793483 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e89cf9a4-2555-4aee-9348-c1c23a57be9d tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:58.794163 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e89cf9a4-2555-4aee-9348-c1c23a57be9d tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:58.798818 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e89cf9a4-2555-4aee-9348-c1c23a57be9d tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:58.802438 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e89cf9a4-2555-4aee-9348-c1c23a57be9d tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:58.804952 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e89cf9a4-2555-4aee-9348-c1c23a57be9d tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:58.807733 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e89cf9a4-2555-4aee-9348-c1c23a57be9d tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:59.058596 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e89cf9a4-2555-4aee-9348-c1c23a57be9d tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:59.076607 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e89cf9a4-2555-4aee-9348-c1c23a57be9d tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:59.079295 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e89cf9a4-2555-4aee-9348-c1c23a57be9d tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:59.081707 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e89cf9a4-2555-4aee-9348-c1c23a57be9d tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 200 len: 1605 microversion: 2.32 time: 0.319100 Sep 08 10:55:59.084008 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1980/4029] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:55:58 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 1605 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:55:59.149729 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f0640084-b010-4b5f-a653-7f04eb73a23d tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:59.167276 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f0640084-b010-4b5f-a653-7f04eb73a23d tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3" status: 200 len: 1735 microversion: 2.1 time: 0.717400 Sep 08 10:55:59.170243 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2050/4030] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:58 2022] GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3 => generated 1735 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:59.204377 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ea822dca-edc7-4117-a6a0-e98e009bc960 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:59.205614 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ea822dca-edc7-4117-a6a0-e98e009bc960 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] [instance: 9e4282f7-daab-454b-93e5-7854754316c8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:59.216584 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea822dca-edc7-4117-a6a0-e98e009bc960 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:59.217653 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea822dca-edc7-4117-a6a0-e98e009bc960 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:59.219686 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea822dca-edc7-4117-a6a0-e98e009bc960 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:59.222580 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea822dca-edc7-4117-a6a0-e98e009bc960 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:59.224471 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea822dca-edc7-4117-a6a0-e98e009bc960 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:59.224627 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea822dca-edc7-4117-a6a0-e98e009bc960 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:59.480065 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-58f663bf-2459-4553-88e9-041cafc7e71b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:59.480749 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-58f663bf-2459-4553-88e9-041cafc7e71b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 379a5e3e-0e59-4b53-a37e-f4e9d1000eaf] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:59.494156 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-58f663bf-2459-4553-88e9-041cafc7e71b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:59.511196 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-58f663bf-2459-4553-88e9-041cafc7e71b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:59.513766 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-58f663bf-2459-4553-88e9-041cafc7e71b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:59.517384 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-58f663bf-2459-4553-88e9-041cafc7e71b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:59.519634 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-58f663bf-2459-4553-88e9-041cafc7e71b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:59.520717 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-58f663bf-2459-4553-88e9-041cafc7e71b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:59.712370 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ea822dca-edc7-4117-a6a0-e98e009bc960 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22145c653c804031ae233de6d84647fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1c70903c3d42d790d9ef96adc1fdbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:59.729715 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ea822dca-edc7-4117-a6a0-e98e009bc960 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] 10.222.0.27 "GET /compute/v2.1/servers/9e4282f7-daab-454b-93e5-7854754316c8" status: 200 len: 1354 microversion: 2.1 time: 0.528863 Sep 08 10:55:59.731757 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1981/4031] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:59 2022] GET /compute/v2.1/servers/9e4282f7-daab-454b-93e5-7854754316c8 => generated 1354 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:59.750239 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-973e8dc7-bb1c-4513-868f-48059d6bb638 req-cf427300-fcef-47d3-a560-26716815aa34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74eebde7-4328-4ddf-be14-bb9fba70ec03", "name": "network-vif-plugged", "status": "completed", "tag": "15f823c3-a4f6-4444-a294-abb10fd52df7"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:55:59.778703 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-973e8dc7-bb1c-4513-868f-48059d6bb638 req-cf427300-fcef-47d3-a560-26716815aa34 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:59.782679 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-973e8dc7-bb1c-4513-868f-48059d6bb638 req-cf427300-fcef-47d3-a560-26716815aa34 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:59.783363 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-973e8dc7-bb1c-4513-868f-48059d6bb638 req-cf427300-fcef-47d3-a560-26716815aa34 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:59.814610 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-973e8dc7-bb1c-4513-868f-48059d6bb638 req-cf427300-fcef-47d3-a560-26716815aa34 service nova] Creating event network-vif-plugged:15f823c3-a4f6-4444-a294-abb10fd52df7 for instance 74eebde7-4328-4ddf-be14-bb9fba70ec03 on n-h1-850501-12 Sep 08 10:55:59.829119 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-973e8dc7-bb1c-4513-868f-48059d6bb638 req-cf427300-fcef-47d3-a560-26716815aa34 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092546 Sep 08 10:55:59.830780 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1982/4032] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:55:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:55:59.843898 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6caf3ac2-42fe-4866-9e3a-21ac37fb9ae1 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:59.844626 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6caf3ac2-42fe-4866-9e3a-21ac37fb9ae1 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:59.863972 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6caf3ac2-42fe-4866-9e3a-21ac37fb9ae1 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:59.864483 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6caf3ac2-42fe-4866-9e3a-21ac37fb9ae1 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:59.864929 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6caf3ac2-42fe-4866-9e3a-21ac37fb9ae1 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:59.868065 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6caf3ac2-42fe-4866-9e3a-21ac37fb9ae1 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:59.868554 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6caf3ac2-42fe-4866-9e3a-21ac37fb9ae1 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:59.868997 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6caf3ac2-42fe-4866-9e3a-21ac37fb9ae1 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:59.955492 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-58f663bf-2459-4553-88e9-041cafc7e71b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:59.974843 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-58f663bf-2459-4553-88e9-041cafc7e71b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/379a5e3e-0e59-4b53-a37e-f4e9d1000eaf" status: 200 len: 1511 microversion: 2.1 time: 0.499056 Sep 08 10:55:59.975715 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2051/4033] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:59 2022] GET /compute/v2.1/servers/379a5e3e-0e59-4b53-a37e-f4e9d1000eaf => generated 1511 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:56:00.114713 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a4ca2c50-d4e7-4294-bbc5-f20467a5359f tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:00.115597 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a4ca2c50-d4e7-4294-bbc5-f20467a5359f tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:00.150704 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a4ca2c50-d4e7-4294-bbc5-f20467a5359f tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:00.171973 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a4ca2c50-d4e7-4294-bbc5-f20467a5359f tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:00.173476 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a4ca2c50-d4e7-4294-bbc5-f20467a5359f tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:00.174605 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a4ca2c50-d4e7-4294-bbc5-f20467a5359f tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:00.175264 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a4ca2c50-d4e7-4294-bbc5-f20467a5359f tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:00.175898 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a4ca2c50-d4e7-4294-bbc5-f20467a5359f tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:00.222230 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6caf3ac2-42fe-4866-9e3a-21ac37fb9ae1 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:00.231364 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6caf3ac2-42fe-4866-9e3a-21ac37fb9ae1 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1526 microversion: 2.1 time: 0.398350 Sep 08 10:56:00.231975 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1983/4034] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:59 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1526 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:00.239617 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-148291da-6c10-44ba-a46e-2d2b0d731d02 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:00.241337 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-148291da-6c10-44ba-a46e-2d2b0d731d02 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: 93d05d86-99b6-43f0-83c7-257ab64a12f3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:00.250813 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-148291da-6c10-44ba-a46e-2d2b0d731d02 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:00.251979 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-148291da-6c10-44ba-a46e-2d2b0d731d02 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:00.252618 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-148291da-6c10-44ba-a46e-2d2b0d731d02 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:00.253831 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-148291da-6c10-44ba-a46e-2d2b0d731d02 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:00.256370 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-148291da-6c10-44ba-a46e-2d2b0d731d02 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:00.268355 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-148291da-6c10-44ba-a46e-2d2b0d731d02 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:00.438254 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a4ca2c50-d4e7-4294-bbc5-f20467a5359f tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:00.448028 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a4ca2c50-d4e7-4294-bbc5-f20467a5359f tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:00.452880 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a4ca2c50-d4e7-4294-bbc5-f20467a5359f tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:00.458464 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a4ca2c50-d4e7-4294-bbc5-f20467a5359f tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 200 len: 1605 microversion: 2.32 time: 0.348808 Sep 08 10:56:00.459592 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2052/4035] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:56:00 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 1605 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:56:00.603047 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-148291da-6c10-44ba-a46e-2d2b0d731d02 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:00.620105 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-148291da-6c10-44ba-a46e-2d2b0d731d02 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3" status: 200 len: 1735 microversion: 2.1 time: 0.387016 Sep 08 10:56:00.654394 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1984/4036] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:00 2022] GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3 => generated 1735 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:00.753599 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9b1f5079-59ce-4ccc-bd2f-f52efb85caa5 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:00.754232 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9b1f5079-59ce-4ccc-bd2f-f52efb85caa5 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] [instance: 9e4282f7-daab-454b-93e5-7854754316c8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:00.776273 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9b1f5079-59ce-4ccc-bd2f-f52efb85caa5 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:00.776779 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9b1f5079-59ce-4ccc-bd2f-f52efb85caa5 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:00.787183 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9b1f5079-59ce-4ccc-bd2f-f52efb85caa5 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:00.788078 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9b1f5079-59ce-4ccc-bd2f-f52efb85caa5 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:00.788581 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9b1f5079-59ce-4ccc-bd2f-f52efb85caa5 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:00.789065 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9b1f5079-59ce-4ccc-bd2f-f52efb85caa5 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:01.004788 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1f9dcbd4-1a13-496c-8e21-35bf4c790420 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:01.006429 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1f9dcbd4-1a13-496c-8e21-35bf4c790420 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 379a5e3e-0e59-4b53-a37e-f4e9d1000eaf] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:01.021266 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f9dcbd4-1a13-496c-8e21-35bf4c790420 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:01.026838 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f9dcbd4-1a13-496c-8e21-35bf4c790420 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:01.028075 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f9dcbd4-1a13-496c-8e21-35bf4c790420 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:01.030436 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f9dcbd4-1a13-496c-8e21-35bf4c790420 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:01.045247 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f9dcbd4-1a13-496c-8e21-35bf4c790420 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:01.046969 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f9dcbd4-1a13-496c-8e21-35bf4c790420 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:01.433615 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1f9dcbd4-1a13-496c-8e21-35bf4c790420 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:01.452999 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1f9dcbd4-1a13-496c-8e21-35bf4c790420 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/379a5e3e-0e59-4b53-a37e-f4e9d1000eaf" status: 200 len: 1511 microversion: 2.1 time: 0.451743 Sep 08 10:56:01.454684 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1985/4037] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:00 2022] GET /compute/v2.1/servers/379a5e3e-0e59-4b53-a37e-f4e9d1000eaf => generated 1511 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:01.463350 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ab408e5d-9d1f-4824-8833-219e6a2de54c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:01.464508 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ab408e5d-9d1f-4824-8833-219e6a2de54c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:01.474247 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab408e5d-9d1f-4824-8833-219e6a2de54c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:01.475258 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab408e5d-9d1f-4824-8833-219e6a2de54c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:01.476520 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab408e5d-9d1f-4824-8833-219e6a2de54c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:01.478177 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab408e5d-9d1f-4824-8833-219e6a2de54c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:01.479010 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab408e5d-9d1f-4824-8833-219e6a2de54c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:01.479509 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab408e5d-9d1f-4824-8833-219e6a2de54c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:01.659231 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9b1f5079-59ce-4ccc-bd2f-f52efb85caa5 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22145c653c804031ae233de6d84647fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1c70903c3d42d790d9ef96adc1fdbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:01.683495 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9b1f5079-59ce-4ccc-bd2f-f52efb85caa5 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] 10.222.0.27 "GET /compute/v2.1/servers/9e4282f7-daab-454b-93e5-7854754316c8" status: 200 len: 1354 microversion: 2.1 time: 0.929319 Sep 08 10:56:01.685301 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2053/4038] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:00 2022] GET /compute/v2.1/servers/9e4282f7-daab-454b-93e5-7854754316c8 => generated 1354 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:01.718936 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3292ead2-df11-4c79-a4e8-8f575e7b24cb tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:01.722120 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3292ead2-df11-4c79-a4e8-8f575e7b24cb tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:01.757232 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3292ead2-df11-4c79-a4e8-8f575e7b24cb tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:01.761942 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3292ead2-df11-4c79-a4e8-8f575e7b24cb tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:01.762667 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3292ead2-df11-4c79-a4e8-8f575e7b24cb tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:01.765134 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3292ead2-df11-4c79-a4e8-8f575e7b24cb tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:01.771152 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3292ead2-df11-4c79-a4e8-8f575e7b24cb tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:01.772588 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3292ead2-df11-4c79-a4e8-8f575e7b24cb tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:01.901060 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ab408e5d-9d1f-4824-8833-219e6a2de54c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:01.911587 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ab408e5d-9d1f-4824-8833-219e6a2de54c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1526 microversion: 2.1 time: 0.454730 Sep 08 10:56:01.924751 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1986/4039] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:01 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1526 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:01.933455 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b6b0af4b-43a0-4b7f-8aec-e48d3e314ca0 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:01.934733 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b6b0af4b-43a0-4b7f-8aec-e48d3e314ca0 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: 93d05d86-99b6-43f0-83c7-257ab64a12f3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:01.942420 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b6b0af4b-43a0-4b7f-8aec-e48d3e314ca0 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:01.943063 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b6b0af4b-43a0-4b7f-8aec-e48d3e314ca0 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:01.943626 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b6b0af4b-43a0-4b7f-8aec-e48d3e314ca0 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:01.944653 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b6b0af4b-43a0-4b7f-8aec-e48d3e314ca0 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:01.945296 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b6b0af4b-43a0-4b7f-8aec-e48d3e314ca0 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:01.946064 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b6b0af4b-43a0-4b7f-8aec-e48d3e314ca0 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:02.197603 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b6b0af4b-43a0-4b7f-8aec-e48d3e314ca0 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:02.208701 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b6b0af4b-43a0-4b7f-8aec-e48d3e314ca0 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3" status: 200 len: 1735 microversion: 2.1 time: 0.281686 Sep 08 10:56:02.211455 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1987/4040] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:01 2022] GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3 => generated 1735 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:02.278291 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-3292ead2-df11-4c79-a4e8-8f575e7b24cb tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:02.292889 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-3292ead2-df11-4c79-a4e8-8f575e7b24cb tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:02.300328 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-3292ead2-df11-4c79-a4e8-8f575e7b24cb tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:02.317253 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3292ead2-df11-4c79-a4e8-8f575e7b24cb tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 200 len: 1605 microversion: 2.32 time: 0.613698 Sep 08 10:56:02.329093 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2054/4041] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:56:01 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 1605 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:56:02.481053 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-824190f8-4a22-4a31-8c4d-107419ee760d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:02.483535 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-824190f8-4a22-4a31-8c4d-107419ee760d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 379a5e3e-0e59-4b53-a37e-f4e9d1000eaf] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:02.509070 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-824190f8-4a22-4a31-8c4d-107419ee760d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:02.510163 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-824190f8-4a22-4a31-8c4d-107419ee760d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:02.511819 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-824190f8-4a22-4a31-8c4d-107419ee760d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:02.515001 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-824190f8-4a22-4a31-8c4d-107419ee760d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:02.516323 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-824190f8-4a22-4a31-8c4d-107419ee760d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:02.517266 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-824190f8-4a22-4a31-8c4d-107419ee760d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:02.716786 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-521a7a70-25d5-40dc-823a-f42efbd0a9ab tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:02.717729 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-521a7a70-25d5-40dc-823a-f42efbd0a9ab tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] [instance: 9e4282f7-daab-454b-93e5-7854754316c8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:02.734837 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-521a7a70-25d5-40dc-823a-f42efbd0a9ab tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:02.735683 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-521a7a70-25d5-40dc-823a-f42efbd0a9ab tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:02.736420 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-521a7a70-25d5-40dc-823a-f42efbd0a9ab tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:02.744948 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-521a7a70-25d5-40dc-823a-f42efbd0a9ab tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:02.745507 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-521a7a70-25d5-40dc-823a-f42efbd0a9ab tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:02.745953 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-521a7a70-25d5-40dc-823a-f42efbd0a9ab tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:02.934907 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-824190f8-4a22-4a31-8c4d-107419ee760d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:02.945338 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-824190f8-4a22-4a31-8c4d-107419ee760d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/379a5e3e-0e59-4b53-a37e-f4e9d1000eaf" status: 200 len: 1511 microversion: 2.1 time: 0.469272 Sep 08 10:56:02.946236 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1988/4042] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:02 2022] GET /compute/v2.1/servers/379a5e3e-0e59-4b53-a37e-f4e9d1000eaf => generated 1511 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:02.960456 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-717e24e7-1fa0-4d8d-8136-f3a2c1b273f8 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:02.961435 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-717e24e7-1fa0-4d8d-8136-f3a2c1b273f8 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:02.976746 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-717e24e7-1fa0-4d8d-8136-f3a2c1b273f8 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:02.977764 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-717e24e7-1fa0-4d8d-8136-f3a2c1b273f8 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:02.978357 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-717e24e7-1fa0-4d8d-8136-f3a2c1b273f8 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:02.980826 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-717e24e7-1fa0-4d8d-8136-f3a2c1b273f8 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:02.981601 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-717e24e7-1fa0-4d8d-8136-f3a2c1b273f8 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:02.982614 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-717e24e7-1fa0-4d8d-8136-f3a2c1b273f8 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:03.348191 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-717e24e7-1fa0-4d8d-8136-f3a2c1b273f8 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:03.372533 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-717e24e7-1fa0-4d8d-8136-f3a2c1b273f8 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1526 microversion: 2.1 time: 0.423583 Sep 08 10:56:03.391996 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1989/4043] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:02 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1526 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:03.397407 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-886dcbc5-9cd1-4a1d-9fff-ac9c7f7d55e3 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:03.398580 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-886dcbc5-9cd1-4a1d-9fff-ac9c7f7d55e3 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: 93d05d86-99b6-43f0-83c7-257ab64a12f3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:03.413541 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-886dcbc5-9cd1-4a1d-9fff-ac9c7f7d55e3 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:03.413967 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-886dcbc5-9cd1-4a1d-9fff-ac9c7f7d55e3 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:03.414415 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-886dcbc5-9cd1-4a1d-9fff-ac9c7f7d55e3 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:03.415138 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-886dcbc5-9cd1-4a1d-9fff-ac9c7f7d55e3 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:03.415597 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-886dcbc5-9cd1-4a1d-9fff-ac9c7f7d55e3 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:03.416216 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-886dcbc5-9cd1-4a1d-9fff-ac9c7f7d55e3 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:03.497543 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-521a7a70-25d5-40dc-823a-f42efbd0a9ab tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22145c653c804031ae233de6d84647fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1c70903c3d42d790d9ef96adc1fdbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:03.508023 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-521a7a70-25d5-40dc-823a-f42efbd0a9ab tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] 10.222.0.27 "GET /compute/v2.1/servers/9e4282f7-daab-454b-93e5-7854754316c8" status: 200 len: 1354 microversion: 2.1 time: 0.795967 Sep 08 10:56:03.512420 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2055/4044] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:02 2022] GET /compute/v2.1/servers/9e4282f7-daab-454b-93e5-7854754316c8 => generated 1354 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:03.520708 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fb1582bb-b0b0-490c-a491-9d6014aab322 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:03.530796 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fb1582bb-b0b0-490c-a491-9d6014aab322 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:03.568374 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb1582bb-b0b0-490c-a491-9d6014aab322 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:03.572385 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb1582bb-b0b0-490c-a491-9d6014aab322 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:03.573095 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb1582bb-b0b0-490c-a491-9d6014aab322 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:03.575462 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb1582bb-b0b0-490c-a491-9d6014aab322 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:03.578229 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb1582bb-b0b0-490c-a491-9d6014aab322 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:03.580853 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb1582bb-b0b0-490c-a491-9d6014aab322 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:03.781376 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-886dcbc5-9cd1-4a1d-9fff-ac9c7f7d55e3 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:03.790302 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-886dcbc5-9cd1-4a1d-9fff-ac9c7f7d55e3 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3" status: 200 len: 1735 microversion: 2.1 time: 0.396987 Sep 08 10:56:03.809059 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1990/4045] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:03 2022] GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3 => generated 1735 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:03.978435 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6dc12ab3-edbd-497d-83f0-c445d047f493 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:03.979819 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6dc12ab3-edbd-497d-83f0-c445d047f493 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 379a5e3e-0e59-4b53-a37e-f4e9d1000eaf] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:04.015475 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6dc12ab3-edbd-497d-83f0-c445d047f493 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:04.018461 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6dc12ab3-edbd-497d-83f0-c445d047f493 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:04.019807 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6dc12ab3-edbd-497d-83f0-c445d047f493 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:04.022536 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6dc12ab3-edbd-497d-83f0-c445d047f493 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:04.028772 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6dc12ab3-edbd-497d-83f0-c445d047f493 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:04.029676 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6dc12ab3-edbd-497d-83f0-c445d047f493 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:04.046155 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:56:04.089283 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-fb1582bb-b0b0-490c-a491-9d6014aab322 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:04.127333 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-fb1582bb-b0b0-490c-a491-9d6014aab322 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:04.131038 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-fb1582bb-b0b0-490c-a491-9d6014aab322 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:04.138650 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fb1582bb-b0b0-490c-a491-9d6014aab322 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 200 len: 1605 microversion: 2.32 time: 0.624855 Sep 08 10:56:04.142839 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2056/4046] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:56:03 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 1605 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:56:04.337053 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6dc12ab3-edbd-497d-83f0-c445d047f493 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:04.348666 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6dc12ab3-edbd-497d-83f0-c445d047f493 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/379a5e3e-0e59-4b53-a37e-f4e9d1000eaf" status: 200 len: 1511 microversion: 2.1 time: 0.377121 Sep 08 10:56:04.362009 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1991/4047] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:03 2022] GET /compute/v2.1/servers/379a5e3e-0e59-4b53-a37e-f4e9d1000eaf => generated 1511 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:56:04.396951 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d853a573-c628-4fbc-9799-0bb4b1087ae1 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:04.402277 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d853a573-c628-4fbc-9799-0bb4b1087ae1 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:04.423023 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d853a573-c628-4fbc-9799-0bb4b1087ae1 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:04.428814 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d853a573-c628-4fbc-9799-0bb4b1087ae1 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:04.429481 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d853a573-c628-4fbc-9799-0bb4b1087ae1 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:04.430511 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d853a573-c628-4fbc-9799-0bb4b1087ae1 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:04.433312 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d853a573-c628-4fbc-9799-0bb4b1087ae1 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:04.433739 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d853a573-c628-4fbc-9799-0bb4b1087ae1 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:04.531442 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c5a1d239-820c-4b17-a5a4-845098cb7a2b tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:04.532441 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c5a1d239-820c-4b17-a5a4-845098cb7a2b tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] [instance: 9e4282f7-daab-454b-93e5-7854754316c8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:04.550954 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5a1d239-820c-4b17-a5a4-845098cb7a2b tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:04.551724 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5a1d239-820c-4b17-a5a4-845098cb7a2b tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:04.552466 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5a1d239-820c-4b17-a5a4-845098cb7a2b tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:04.556291 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5a1d239-820c-4b17-a5a4-845098cb7a2b tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:04.557109 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5a1d239-820c-4b17-a5a4-845098cb7a2b tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:04.557824 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5a1d239-820c-4b17-a5a4-845098cb7a2b tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:04.962635 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d853a573-c628-4fbc-9799-0bb4b1087ae1 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:04.971802 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d853a573-c628-4fbc-9799-0bb4b1087ae1 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1526 microversion: 2.1 time: 0.579440 Sep 08 10:56:04.981136 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2057/4048] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:04 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1526 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:05.005400 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2ab077ae-2b18-4194-94cf-df54605e8f80 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:05.006053 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2ab077ae-2b18-4194-94cf-df54605e8f80 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: 93d05d86-99b6-43f0-83c7-257ab64a12f3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:05.026475 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2ab077ae-2b18-4194-94cf-df54605e8f80 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:05.027089 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2ab077ae-2b18-4194-94cf-df54605e8f80 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:05.027587 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2ab077ae-2b18-4194-94cf-df54605e8f80 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:05.035437 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2ab077ae-2b18-4194-94cf-df54605e8f80 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:05.035975 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2ab077ae-2b18-4194-94cf-df54605e8f80 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:05.037363 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2ab077ae-2b18-4194-94cf-df54605e8f80 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:05.712112 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2ab077ae-2b18-4194-94cf-df54605e8f80 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:05.741277 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2ab077ae-2b18-4194-94cf-df54605e8f80 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3" status: 200 len: 1735 microversion: 2.1 time: 0.754281 Sep 08 10:56:05.745826 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2058/4049] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:04 2022] GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3 => generated 1735 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:05.768850 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a19369cc-7eec-481a-822f-0d62f7b0c0b0 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:05.772598 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a19369cc-7eec-481a-822f-0d62f7b0c0b0 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:05.795402 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a19369cc-7eec-481a-822f-0d62f7b0c0b0 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:05.800904 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a19369cc-7eec-481a-822f-0d62f7b0c0b0 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:05.803165 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a19369cc-7eec-481a-822f-0d62f7b0c0b0 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:05.805933 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a19369cc-7eec-481a-822f-0d62f7b0c0b0 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:05.806425 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a19369cc-7eec-481a-822f-0d62f7b0c0b0 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:05.806949 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a19369cc-7eec-481a-822f-0d62f7b0c0b0 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:05.982264 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c5a1d239-820c-4b17-a5a4-845098cb7a2b tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22145c653c804031ae233de6d84647fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1c70903c3d42d790d9ef96adc1fdbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:05.991101 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c5a1d239-820c-4b17-a5a4-845098cb7a2b tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] 10.222.0.27 "GET /compute/v2.1/servers/9e4282f7-daab-454b-93e5-7854754316c8" status: 200 len: 1354 microversion: 2.1 time: 1.464363 Sep 08 10:56:06.000078 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1992/4050] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:04 2022] GET /compute/v2.1/servers/9e4282f7-daab-454b-93e5-7854754316c8 => generated 1354 bytes in 1474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:56:06.008299 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c954d32b-1ba8-4b45-a99a-d464090895ec tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:06.020518 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c954d32b-1ba8-4b45-a99a-d464090895ec tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 379a5e3e-0e59-4b53-a37e-f4e9d1000eaf] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:06.050125 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c954d32b-1ba8-4b45-a99a-d464090895ec tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:06.051095 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c954d32b-1ba8-4b45-a99a-d464090895ec tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:06.051774 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c954d32b-1ba8-4b45-a99a-d464090895ec tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:06.052790 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c954d32b-1ba8-4b45-a99a-d464090895ec tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:06.053508 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c954d32b-1ba8-4b45-a99a-d464090895ec tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:06.054172 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c954d32b-1ba8-4b45-a99a-d464090895ec tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:06.113963 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a19369cc-7eec-481a-822f-0d62f7b0c0b0 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:06.136197 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a19369cc-7eec-481a-822f-0d62f7b0c0b0 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:06.145275 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a19369cc-7eec-481a-822f-0d62f7b0c0b0 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:06.149327 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a19369cc-7eec-481a-822f-0d62f7b0c0b0 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 200 len: 1605 microversion: 2.32 time: 0.401554 Sep 08 10:56:06.156185 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2059/4051] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:56:05 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 1605 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:56:06.173557 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a9db6838-2e04-4e89-a327-5c7620760c66 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:06.180737 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a9db6838-2e04-4e89-a327-5c7620760c66 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:06.199238 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a9db6838-2e04-4e89-a327-5c7620760c66 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:06.207835 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a9db6838-2e04-4e89-a327-5c7620760c66 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:06.208582 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a9db6838-2e04-4e89-a327-5c7620760c66 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:06.211764 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a9db6838-2e04-4e89-a327-5c7620760c66 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:06.212714 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a9db6838-2e04-4e89-a327-5c7620760c66 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:06.214748 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a9db6838-2e04-4e89-a327-5c7620760c66 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:07.280527 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c954d32b-1ba8-4b45-a99a-d464090895ec tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:07.301734 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c954d32b-1ba8-4b45-a99a-d464090895ec tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/379a5e3e-0e59-4b53-a37e-f4e9d1000eaf" status: 200 len: 1511 microversion: 2.1 time: 1.297096 Sep 08 10:56:07.307538 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1993/4052] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:06 2022] GET /compute/v2.1/servers/379a5e3e-0e59-4b53-a37e-f4e9d1000eaf => generated 1511 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:07.326156 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-199aa4c1-74ec-445f-bd9d-3976ba854a1a req-321e590a-079b-4d21-86ec-c5da095de042 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e4282f7-daab-454b-93e5-7854754316c8", "name": "network-vif-plugged", "status": "completed", "tag": "cf3ab348-494e-468a-b277-a1c2300a402c"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:56:07.362485 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-199aa4c1-74ec-445f-bd9d-3976ba854a1a req-321e590a-079b-4d21-86ec-c5da095de042 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:07.369929 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-199aa4c1-74ec-445f-bd9d-3976ba854a1a req-321e590a-079b-4d21-86ec-c5da095de042 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:07.373510 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-199aa4c1-74ec-445f-bd9d-3976ba854a1a req-321e590a-079b-4d21-86ec-c5da095de042 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:07.417226 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-199aa4c1-74ec-445f-bd9d-3976ba854a1a req-321e590a-079b-4d21-86ec-c5da095de042 service nova] Creating event network-vif-plugged:cf3ab348-494e-468a-b277-a1c2300a402c for instance 9e4282f7-daab-454b-93e5-7854754316c8 on n-h2-850501-12 Sep 08 10:56:07.435075 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-199aa4c1-74ec-445f-bd9d-3976ba854a1a req-321e590a-079b-4d21-86ec-c5da095de042 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122164 Sep 08 10:56:07.440980 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1994/4053] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:56:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:56:07.461110 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-50422bf2-6ea9-4539-b33f-d372e623f513 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:07.470668 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-50422bf2-6ea9-4539-b33f-d372e623f513 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: 93d05d86-99b6-43f0-83c7-257ab64a12f3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:07.511401 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-50422bf2-6ea9-4539-b33f-d372e623f513 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:07.524543 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-50422bf2-6ea9-4539-b33f-d372e623f513 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:07.527086 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-50422bf2-6ea9-4539-b33f-d372e623f513 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:07.533681 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-50422bf2-6ea9-4539-b33f-d372e623f513 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:07.536960 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-50422bf2-6ea9-4539-b33f-d372e623f513 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:07.538839 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-50422bf2-6ea9-4539-b33f-d372e623f513 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:07.545385 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a9db6838-2e04-4e89-a327-5c7620760c66 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:07.567877 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a9db6838-2e04-4e89-a327-5c7620760c66 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1526 microversion: 2.1 time: 1.406216 Sep 08 10:56:07.571058 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2060/4054] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:06 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1526 bytes in 1414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:07.589806 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f4054337-d4a0-4585-bcf0-352bece056eb tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:07.591014 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f4054337-d4a0-4585-bcf0-352bece056eb tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] [instance: 9e4282f7-daab-454b-93e5-7854754316c8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:07.613582 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f4054337-d4a0-4585-bcf0-352bece056eb tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:07.614806 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f4054337-d4a0-4585-bcf0-352bece056eb tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:07.615457 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f4054337-d4a0-4585-bcf0-352bece056eb tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:07.618882 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f4054337-d4a0-4585-bcf0-352bece056eb tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:07.620739 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f4054337-d4a0-4585-bcf0-352bece056eb tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:07.623074 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f4054337-d4a0-4585-bcf0-352bece056eb tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:08.301001 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f4054337-d4a0-4585-bcf0-352bece056eb tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22145c653c804031ae233de6d84647fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1c70903c3d42d790d9ef96adc1fdbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:08.311680 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f4054337-d4a0-4585-bcf0-352bece056eb tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] 10.222.0.27 "GET /compute/v2.1/servers/9e4282f7-daab-454b-93e5-7854754316c8" status: 200 len: 1354 microversion: 2.1 time: 0.737700 Sep 08 10:56:08.315941 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2061/4055] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:07 2022] GET /compute/v2.1/servers/9e4282f7-daab-454b-93e5-7854754316c8 => generated 1354 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:08.334909 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-484be889-9a76-426b-9bf7-3b7c45b517cd tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:08.336187 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-484be889-9a76-426b-9bf7-3b7c45b517cd tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:08.348834 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-484be889-9a76-426b-9bf7-3b7c45b517cd tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:08.352008 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-484be889-9a76-426b-9bf7-3b7c45b517cd tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:08.352462 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-484be889-9a76-426b-9bf7-3b7c45b517cd tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:08.353258 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-484be889-9a76-426b-9bf7-3b7c45b517cd tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:08.353723 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-484be889-9a76-426b-9bf7-3b7c45b517cd tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:08.354152 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-484be889-9a76-426b-9bf7-3b7c45b517cd tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:08.492543 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-50422bf2-6ea9-4539-b33f-d372e623f513 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:08.501401 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-484be889-9a76-426b-9bf7-3b7c45b517cd tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:08.508919 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-50422bf2-6ea9-4539-b33f-d372e623f513 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3" status: 200 len: 1735 microversion: 2.1 time: 1.066192 Sep 08 10:56:08.509559 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1995/4056] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:07 2022] GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3 => generated 1735 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:08.539686 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-484be889-9a76-426b-9bf7-3b7c45b517cd tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:08.541184 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-484be889-9a76-426b-9bf7-3b7c45b517cd tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:08.542410 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-484be889-9a76-426b-9bf7-3b7c45b517cd tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 200 len: 1605 microversion: 2.32 time: 0.222612 Sep 08 10:56:08.567175 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4ed2bc32-f675-4452-bf5a-ad80be9dc111 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:08.567431 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4ed2bc32-f675-4452-bf5a-ad80be9dc111 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 379a5e3e-0e59-4b53-a37e-f4e9d1000eaf] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:08.568843 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2062/4057] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:56:08 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 1605 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:56:08.574204 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ed2bc32-f675-4452-bf5a-ad80be9dc111 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:08.574738 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ed2bc32-f675-4452-bf5a-ad80be9dc111 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:08.575147 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ed2bc32-f675-4452-bf5a-ad80be9dc111 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:08.575868 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ed2bc32-f675-4452-bf5a-ad80be9dc111 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:08.576888 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ed2bc32-f675-4452-bf5a-ad80be9dc111 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:08.577788 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ed2bc32-f675-4452-bf5a-ad80be9dc111 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:08.606068 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8b7ee6f0-eaed-4756-95bd-d9c95d7dadc9 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:08.608545 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8b7ee6f0-eaed-4756-95bd-d9c95d7dadc9 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:08.626710 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8b7ee6f0-eaed-4756-95bd-d9c95d7dadc9 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:08.631248 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8b7ee6f0-eaed-4756-95bd-d9c95d7dadc9 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:08.632529 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8b7ee6f0-eaed-4756-95bd-d9c95d7dadc9 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:08.634338 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8b7ee6f0-eaed-4756-95bd-d9c95d7dadc9 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:08.637201 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8b7ee6f0-eaed-4756-95bd-d9c95d7dadc9 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:08.637777 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8b7ee6f0-eaed-4756-95bd-d9c95d7dadc9 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:08.875182 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4ed2bc32-f675-4452-bf5a-ad80be9dc111 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:08.885234 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4ed2bc32-f675-4452-bf5a-ad80be9dc111 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/379a5e3e-0e59-4b53-a37e-f4e9d1000eaf" status: 200 len: 1511 microversion: 2.1 time: 0.326070 Sep 08 10:56:08.886080 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1996/4058] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:08 2022] GET /compute/v2.1/servers/379a5e3e-0e59-4b53-a37e-f4e9d1000eaf => generated 1511 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:09.218963 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8b7ee6f0-eaed-4756-95bd-d9c95d7dadc9 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:09.233085 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8b7ee6f0-eaed-4756-95bd-d9c95d7dadc9 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1526 microversion: 2.1 time: 0.636852 Sep 08 10:56:09.239706 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2063/4059] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:08 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1526 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:56:09.344576 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f96b00bc-5ff0-4c86-8014-95ca8d1352f3 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:09.346435 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f96b00bc-5ff0-4c86-8014-95ca8d1352f3 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] [instance: 9e4282f7-daab-454b-93e5-7854754316c8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:09.361534 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f96b00bc-5ff0-4c86-8014-95ca8d1352f3 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:09.368590 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f96b00bc-5ff0-4c86-8014-95ca8d1352f3 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:09.371491 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f96b00bc-5ff0-4c86-8014-95ca8d1352f3 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:09.373885 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f96b00bc-5ff0-4c86-8014-95ca8d1352f3 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:09.376276 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f96b00bc-5ff0-4c86-8014-95ca8d1352f3 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:09.377449 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f96b00bc-5ff0-4c86-8014-95ca8d1352f3 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:09.537442 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2af60f0f-6d33-4ff0-9c11-695595e54186 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:09.538430 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2af60f0f-6d33-4ff0-9c11-695595e54186 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: 93d05d86-99b6-43f0-83c7-257ab64a12f3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:09.553417 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2af60f0f-6d33-4ff0-9c11-695595e54186 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:09.554489 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2af60f0f-6d33-4ff0-9c11-695595e54186 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:09.555305 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2af60f0f-6d33-4ff0-9c11-695595e54186 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:09.556943 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2af60f0f-6d33-4ff0-9c11-695595e54186 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:09.560199 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2af60f0f-6d33-4ff0-9c11-695595e54186 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:09.561883 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2af60f0f-6d33-4ff0-9c11-695595e54186 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:09.727239 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f96b00bc-5ff0-4c86-8014-95ca8d1352f3 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22145c653c804031ae233de6d84647fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1c70903c3d42d790d9ef96adc1fdbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:09.755692 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f96b00bc-5ff0-4c86-8014-95ca8d1352f3 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] 10.222.0.27 "GET /compute/v2.1/servers/9e4282f7-daab-454b-93e5-7854754316c8" status: 200 len: 1354 microversion: 2.1 time: 0.418299 Sep 08 10:56:09.757494 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1997/4060] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:09 2022] GET /compute/v2.1/servers/9e4282f7-daab-454b-93e5-7854754316c8 => generated 1354 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:09.763314 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-218d22cc-9ff5-434e-ba30-6dd9e1b0cea0 req-16f01ce0-aed1-47c4-ac5a-14c0021e73c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e4282f7-daab-454b-93e5-7854754316c8", "name": "network-vif-plugged", "status": "completed", "tag": "d83ddcd1-a521-4860-bd2f-45d8879fd5b2"}, {"server_uuid": "9e4282f7-daab-454b-93e5-7854754316c8", "name": "network-vif-plugged", "status": "completed", "tag": "f22fbc47-8d40-4a4a-b4db-418a5a719296"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:56:09.793313 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-218d22cc-9ff5-434e-ba30-6dd9e1b0cea0 req-16f01ce0-aed1-47c4-ac5a-14c0021e73c6 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:09.803637 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-218d22cc-9ff5-434e-ba30-6dd9e1b0cea0 req-16f01ce0-aed1-47c4-ac5a-14c0021e73c6 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:09.804771 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-218d22cc-9ff5-434e-ba30-6dd9e1b0cea0 req-16f01ce0-aed1-47c4-ac5a-14c0021e73c6 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:09.851534 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-218d22cc-9ff5-434e-ba30-6dd9e1b0cea0 req-16f01ce0-aed1-47c4-ac5a-14c0021e73c6 service nova] Creating event network-vif-plugged:d83ddcd1-a521-4860-bd2f-45d8879fd5b2 for instance 9e4282f7-daab-454b-93e5-7854754316c8 on n-h2-850501-12 Sep 08 10:56:09.854202 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-218d22cc-9ff5-434e-ba30-6dd9e1b0cea0 req-16f01ce0-aed1-47c4-ac5a-14c0021e73c6 service nova] Creating event network-vif-plugged:f22fbc47-8d40-4a4a-b4db-418a5a719296 for instance 9e4282f7-daab-454b-93e5-7854754316c8 on n-h2-850501-12 Sep 08 10:56:09.869223 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-218d22cc-9ff5-434e-ba30-6dd9e1b0cea0 req-16f01ce0-aed1-47c4-ac5a-14c0021e73c6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.110070 Sep 08 10:56:09.870942 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1998/4061] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:56:09 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:56:09.888159 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e43f611d-be99-4d8a-8f65-ace11eac7c45 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:09.892472 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e43f611d-be99-4d8a-8f65-ace11eac7c45 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:09.931631 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e43f611d-be99-4d8a-8f65-ace11eac7c45 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:09.945102 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e43f611d-be99-4d8a-8f65-ace11eac7c45 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:09.946034 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e43f611d-be99-4d8a-8f65-ace11eac7c45 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:09.947223 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e43f611d-be99-4d8a-8f65-ace11eac7c45 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:09.953763 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e43f611d-be99-4d8a-8f65-ace11eac7c45 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:09.956990 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e43f611d-be99-4d8a-8f65-ace11eac7c45 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:10.095282 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e43f611d-be99-4d8a-8f65-ace11eac7c45 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:10.110948 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e43f611d-be99-4d8a-8f65-ace11eac7c45 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:10.114020 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e43f611d-be99-4d8a-8f65-ace11eac7c45 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:10.118936 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e43f611d-be99-4d8a-8f65-ace11eac7c45 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 200 len: 1605 microversion: 2.32 time: 0.244776 Sep 08 10:56:10.142373 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1999/4062] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:56:09 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 1605 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:56:10.160943 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-67def005-3a4a-4025-b600-88046ee48129 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:10.167114 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-67def005-3a4a-4025-b600-88046ee48129 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 379a5e3e-0e59-4b53-a37e-f4e9d1000eaf] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:10.181829 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67def005-3a4a-4025-b600-88046ee48129 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:10.183136 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67def005-3a4a-4025-b600-88046ee48129 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:10.183756 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67def005-3a4a-4025-b600-88046ee48129 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:10.187105 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67def005-3a4a-4025-b600-88046ee48129 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:10.188035 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67def005-3a4a-4025-b600-88046ee48129 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:10.188873 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67def005-3a4a-4025-b600-88046ee48129 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:10.575090 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-67def005-3a4a-4025-b600-88046ee48129 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:10.599765 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-67def005-3a4a-4025-b600-88046ee48129 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/379a5e3e-0e59-4b53-a37e-f4e9d1000eaf" status: 200 len: 1511 microversion: 2.1 time: 0.453887 Sep 08 10:56:10.602846 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2000/4063] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:10 2022] GET /compute/v2.1/servers/379a5e3e-0e59-4b53-a37e-f4e9d1000eaf => generated 1511 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:10.621752 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-54253d8c-b99b-4bdf-bb42-e82458cb61c8 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:10.622615 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-54253d8c-b99b-4bdf-bb42-e82458cb61c8 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:10.640739 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54253d8c-b99b-4bdf-bb42-e82458cb61c8 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:10.641274 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54253d8c-b99b-4bdf-bb42-e82458cb61c8 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:10.641709 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54253d8c-b99b-4bdf-bb42-e82458cb61c8 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:10.646524 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54253d8c-b99b-4bdf-bb42-e82458cb61c8 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:10.647024 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54253d8c-b99b-4bdf-bb42-e82458cb61c8 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:10.653853 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54253d8c-b99b-4bdf-bb42-e82458cb61c8 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:11.065709 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2af60f0f-6d33-4ff0-9c11-695595e54186 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:11.082754 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2af60f0f-6d33-4ff0-9c11-695595e54186 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3" status: 200 len: 1735 microversion: 2.1 time: 1.546912 Sep 08 10:56:11.084008 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2064/4064] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:09 2022] GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3 => generated 1735 bytes in 1551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:56:11.094773 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b22eddcf-e904-45d9-89f7-2cffbb27c09c tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:11.097174 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b22eddcf-e904-45d9-89f7-2cffbb27c09c tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] [instance: 9e4282f7-daab-454b-93e5-7854754316c8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:11.123344 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-54253d8c-b99b-4bdf-bb42-e82458cb61c8 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:11.134737 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b22eddcf-e904-45d9-89f7-2cffbb27c09c tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:11.136034 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-54253d8c-b99b-4bdf-bb42-e82458cb61c8 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1526 microversion: 2.1 time: 0.530365 Sep 08 10:56:11.136744 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b22eddcf-e904-45d9-89f7-2cffbb27c09c tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:11.137902 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2001/4065] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:10 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1526 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:11.141660 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b22eddcf-e904-45d9-89f7-2cffbb27c09c tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:11.142423 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b22eddcf-e904-45d9-89f7-2cffbb27c09c tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:11.142892 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b22eddcf-e904-45d9-89f7-2cffbb27c09c tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:11.143341 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b22eddcf-e904-45d9-89f7-2cffbb27c09c tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:11.159578 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e09f5f61-db16-44b5-8bca-28dfa2de1fb6 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:11.166097 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e09f5f61-db16-44b5-8bca-28dfa2de1fb6 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:11.188395 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e09f5f61-db16-44b5-8bca-28dfa2de1fb6 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:11.189114 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e09f5f61-db16-44b5-8bca-28dfa2de1fb6 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:11.191051 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e09f5f61-db16-44b5-8bca-28dfa2de1fb6 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:11.195709 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e09f5f61-db16-44b5-8bca-28dfa2de1fb6 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:11.196558 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e09f5f61-db16-44b5-8bca-28dfa2de1fb6 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:11.197637 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e09f5f61-db16-44b5-8bca-28dfa2de1fb6 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:11.355361 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e09f5f61-db16-44b5-8bca-28dfa2de1fb6 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:11.375845 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e09f5f61-db16-44b5-8bca-28dfa2de1fb6 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:11.380794 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e09f5f61-db16-44b5-8bca-28dfa2de1fb6 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:11.382590 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e09f5f61-db16-44b5-8bca-28dfa2de1fb6 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 200 len: 1605 microversion: 2.32 time: 0.229117 Sep 08 10:56:11.399490 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2002/4066] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:56:11 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 1605 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:56:11.627314 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a1d99a9b-e2bf-4389-859b-6db1c8180991 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:11.627942 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a1d99a9b-e2bf-4389-859b-6db1c8180991 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 379a5e3e-0e59-4b53-a37e-f4e9d1000eaf] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:11.655106 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a1d99a9b-e2bf-4389-859b-6db1c8180991 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:11.656036 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a1d99a9b-e2bf-4389-859b-6db1c8180991 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:11.656642 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a1d99a9b-e2bf-4389-859b-6db1c8180991 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:11.663307 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a1d99a9b-e2bf-4389-859b-6db1c8180991 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:11.665611 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a1d99a9b-e2bf-4389-859b-6db1c8180991 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:11.674510 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a1d99a9b-e2bf-4389-859b-6db1c8180991 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:11.692632 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b22eddcf-e904-45d9-89f7-2cffbb27c09c tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22145c653c804031ae233de6d84647fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1c70903c3d42d790d9ef96adc1fdbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:11.703512 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b22eddcf-e904-45d9-89f7-2cffbb27c09c tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] 10.222.0.27 "GET /compute/v2.1/servers/9e4282f7-daab-454b-93e5-7854754316c8" status: 200 len: 1354 microversion: 2.1 time: 0.618077 Sep 08 10:56:11.717280 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2065/4067] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:11 2022] GET /compute/v2.1/servers/9e4282f7-daab-454b-93e5-7854754316c8 => generated 1354 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:11.962010 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a1d99a9b-e2bf-4389-859b-6db1c8180991 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:11.977554 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a1d99a9b-e2bf-4389-859b-6db1c8180991 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/379a5e3e-0e59-4b53-a37e-f4e9d1000eaf" status: 200 len: 1511 microversion: 2.1 time: 0.352881 Sep 08 10:56:11.980047 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2003/4068] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:11 2022] GET /compute/v2.1/servers/379a5e3e-0e59-4b53-a37e-f4e9d1000eaf => generated 1511 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:56:12.118001 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-796ed238-ac9a-4be8-aa05-d87decde4751 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:12.119263 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-796ed238-ac9a-4be8-aa05-d87decde4751 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: 93d05d86-99b6-43f0-83c7-257ab64a12f3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:12.147568 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-796ed238-ac9a-4be8-aa05-d87decde4751 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:12.151480 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-796ed238-ac9a-4be8-aa05-d87decde4751 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:12.152231 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-796ed238-ac9a-4be8-aa05-d87decde4751 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:12.154077 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-796ed238-ac9a-4be8-aa05-d87decde4751 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:12.155558 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-796ed238-ac9a-4be8-aa05-d87decde4751 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:12.156275 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-796ed238-ac9a-4be8-aa05-d87decde4751 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:12.171362 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-705e0a54-9711-49a9-b97d-6321d293b69a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:12.174531 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-705e0a54-9711-49a9-b97d-6321d293b69a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:12.193321 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-705e0a54-9711-49a9-b97d-6321d293b69a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:12.193321 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-705e0a54-9711-49a9-b97d-6321d293b69a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:12.202057 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-705e0a54-9711-49a9-b97d-6321d293b69a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:12.206200 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-705e0a54-9711-49a9-b97d-6321d293b69a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:12.206796 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-705e0a54-9711-49a9-b97d-6321d293b69a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:12.207337 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-705e0a54-9711-49a9-b97d-6321d293b69a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:12.544037 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-705e0a54-9711-49a9-b97d-6321d293b69a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:12.570661 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-705e0a54-9711-49a9-b97d-6321d293b69a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1526 microversion: 2.1 time: 0.405937 Sep 08 10:56:12.576990 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2004/4069] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:12 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1526 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:12.587858 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c8db6fbb-91f4-46f5-a460-8a9d59d70d0e tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:12.591256 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c8db6fbb-91f4-46f5-a460-8a9d59d70d0e tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:12.612619 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c8db6fbb-91f4-46f5-a460-8a9d59d70d0e tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:12.614064 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c8db6fbb-91f4-46f5-a460-8a9d59d70d0e tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:12.614212 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-796ed238-ac9a-4be8-aa05-d87decde4751 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:12.616640 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=100 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:56:12.617844 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c8db6fbb-91f4-46f5-a460-8a9d59d70d0e tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:12.621733 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c8db6fbb-91f4-46f5-a460-8a9d59d70d0e tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:12.623679 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c8db6fbb-91f4-46f5-a460-8a9d59d70d0e tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:12.625342 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c8db6fbb-91f4-46f5-a460-8a9d59d70d0e tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:12.639229 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-796ed238-ac9a-4be8-aa05-d87decde4751 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3" status: 200 len: 1715 microversion: 2.1 time: 0.529488 Sep 08 10:56:12.671394 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2066/4070] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:12 2022] GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3 => generated 1715 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:12.737643 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-20ee4b49-251c-4b70-a81f-7ab83974329c tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:12.738559 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-20ee4b49-251c-4b70-a81f-7ab83974329c tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] [instance: 9e4282f7-daab-454b-93e5-7854754316c8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:12.742249 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c8db6fbb-91f4-46f5-a460-8a9d59d70d0e tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:12.744960 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c8db6fbb-91f4-46f5-a460-8a9d59d70d0e tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:12.745707 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c8db6fbb-91f4-46f5-a460-8a9d59d70d0e tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:12.746399 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-c8db6fbb-91f4-46f5-a460-8a9d59d70d0e tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lazy-loading 'fault' on Instance uuid 98277784-8e48-4a7b-8786-ce579e1d5ccf {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:56:12.752666 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-20ee4b49-251c-4b70-a81f-7ab83974329c tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:12.753394 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-20ee4b49-251c-4b70-a81f-7ab83974329c tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:12.753754 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-20ee4b49-251c-4b70-a81f-7ab83974329c tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:12.754497 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-20ee4b49-251c-4b70-a81f-7ab83974329c tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:12.754987 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-20ee4b49-251c-4b70-a81f-7ab83974329c tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:12.755411 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-20ee4b49-251c-4b70-a81f-7ab83974329c tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:12.808336 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c8db6fbb-91f4-46f5-a460-8a9d59d70d0e tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:12.826422 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c8db6fbb-91f4-46f5-a460-8a9d59d70d0e tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:12.828324 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c8db6fbb-91f4-46f5-a460-8a9d59d70d0e tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72c4838df30441628becfb4e61778366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf115ce61d864726b0e6e6b28c6ac69a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:12.830226 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c8db6fbb-91f4-46f5-a460-8a9d59d70d0e tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 200 len: 1610 microversion: 2.32 time: 0.251864 Sep 08 10:56:12.846522 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2005/4071] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:56:12 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 1610 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:56:12.933400 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-578f3bbe-100a-4919-bd60-296ae1cf86e6 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:12.933914 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-578f3bbe-100a-4919-bd60-296ae1cf86e6 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: 93d05d86-99b6-43f0-83c7-257ab64a12f3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:12.945280 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-578f3bbe-100a-4919-bd60-296ae1cf86e6 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:12.946018 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-578f3bbe-100a-4919-bd60-296ae1cf86e6 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:12.946897 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-578f3bbe-100a-4919-bd60-296ae1cf86e6 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:12.947845 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-578f3bbe-100a-4919-bd60-296ae1cf86e6 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:12.948632 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-578f3bbe-100a-4919-bd60-296ae1cf86e6 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:12.948765 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-578f3bbe-100a-4919-bd60-296ae1cf86e6 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:13.191745 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-578f3bbe-100a-4919-bd60-296ae1cf86e6 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] HTTP exception thrown: Cannot 'detach_volume' instance 93d05d86-99b6-43f0-83c7-257ab64a12f3 while it is in vm_state rescued Sep 08 10:56:13.203232 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-578f3bbe-100a-4919-bd60-296ae1cf86e6 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Request method failure captured: Sep 08 10:56:13.203232 n-d-850501-12 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3/os-volume_attachments/36d7bab8-c050-4496-aba4-395658e6e896 HTTP/1.1 Sep 08 10:56:13.203232 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:56:13.203232 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:56:13.203232 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:56:13.203232 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:56:13.203232 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:56:13.203232 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:56:13.203232 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:56:13.203232 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:56:13.203232 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGclZnrdHbcSspe2CSaO_gA2LIWMGtHJAKVo_u3dlzxs9JxAXcXCwrL-z-q8SJvnWUnwIz6KxjkLXp0jFFwIV3x5Qp_zUHQKWEwS-EZKwoM8W4-UxwLeQWJTnQ9cWOYmTzHY9djf2pYmuh6sOSJJezx_5s2ElCgN_L-D4iql7Pg9xGj8 Sep 08 10:56:13.203232 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:56:13.203232 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:56:13.203232 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:56:13.203232 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:56:13.203232 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:56:13.203232 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:56:13.203232 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 33063b3b9e0543369c28ea918f52cf37 Sep 08 10:56:13.203232 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1820338337 Sep 08 10:56:13.203232 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:56:13.203232 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:56:13.203232 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/33063b3b9e0543369c28ea918f52cf37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/33063b3b9e0543369c28ea918f52cf37"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_33063b3b9e0543369c28ea918f52cf37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/33063b3b9e0543369c28ea918f52cf37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:56:13.203232 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1820338337 Sep 08 10:56:13.203232 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 33063b3b9e0543369c28ea918f52cf37 Sep 08 10:56:13.203232 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1820338337 Sep 08 10:56:13.203232 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServerRescueNegativeTestJSON-1820338337-project Sep 08 10:56:13.203232 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:56:13.203232 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:56:13.203232 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 8f487f5d062e4ac3bf21c2416a7b50ee Sep 08 10:56:13.203232 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1820338337-project Sep 08 10:56:13.203232 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:56:13.203232 n-d-850501-12 devstack@n-api.service[128862]: exception: Cannot 'detach_volume' instance 93d05d86-99b6-43f0-83c7-257ab64a12f3 while it is in vm_state rescued Sep 08 10:56:13.203232 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'server_id': '93d05d86-99b6-43f0-83c7-257ab64a12f3', 'id': '36d7bab8-c050-4496-aba4-395658e6e896'} Sep 08 10:56:13.203232 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:56:13.203232 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:56:13.203232 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 08 10:56:13.203232 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 08 10:56:13.203232 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 10:56:13.203232 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 10:56:13.203232 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 08 10:56:13.203232 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 08 10:56:13.203232 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 93d05d86-99b6-43f0-83c7-257ab64a12f3 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 08 10:56:13.203232 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:56:13.203232 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:56:13.203232 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:56:13.203232 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:56:13.203232 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:56:13.203232 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:56:13.203232 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:56:13.203232 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:56:13.203232 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:56:13.203232 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:56:13.203232 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 08 10:56:13.203232 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 08 10:56:13.203232 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 08 10:56:13.203232 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 08 10:56:13.203232 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 93d05d86-99b6-43f0-83c7-257ab64a12f3 while it is in vm_state rescued Sep 08 10:56:13.203232 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:56:13.203232 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:56:13.203232 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:56:13.203232 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:56:13.211988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:56:13.211988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:56:13.211988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:56:13.211988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:56:13.211988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 93d05d86-99b6-43f0-83c7-257ab64a12f3 while it is in vm_state rescued Sep 08 10:56:13.211988 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:56:13.214660 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-578f3bbe-100a-4919-bd60-296ae1cf86e6 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Returning 409 to user: Cannot 'detach_volume' instance 93d05d86-99b6-43f0-83c7-257ab64a12f3 while it is in vm_state rescued {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:56:13.215859 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-578f3bbe-100a-4919-bd60-296ae1cf86e6 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "DELETE /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3/os-volume_attachments/36d7bab8-c050-4496-aba4-395658e6e896" status: 409 len: 152 microversion: 2.1 time: 0.287189 Sep 08 10:56:13.217538 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2006/4072] 10.222.0.27 () {58 vars in 1416 bytes} [Thu Sep 8 10:56:12 2022] DELETE /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3/os-volume_attachments/36d7bab8-c050-4496-aba4-395658e6e896 => generated 152 bytes in 289 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:56:13.226928 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-768ebfa9-46d2-42fc-8cbb-b91b034bd07f tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:13.227898 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-768ebfa9-46d2-42fc-8cbb-b91b034bd07f tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 379a5e3e-0e59-4b53-a37e-f4e9d1000eaf] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:13.237453 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-768ebfa9-46d2-42fc-8cbb-b91b034bd07f tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:13.238309 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-768ebfa9-46d2-42fc-8cbb-b91b034bd07f tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:13.238989 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-768ebfa9-46d2-42fc-8cbb-b91b034bd07f tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:13.240134 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-768ebfa9-46d2-42fc-8cbb-b91b034bd07f tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:13.241438 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-768ebfa9-46d2-42fc-8cbb-b91b034bd07f tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:13.242159 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-768ebfa9-46d2-42fc-8cbb-b91b034bd07f tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:13.273588 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-20ee4b49-251c-4b70-a81f-7ab83974329c tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22145c653c804031ae233de6d84647fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1c70903c3d42d790d9ef96adc1fdbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:13.287065 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-20ee4b49-251c-4b70-a81f-7ab83974329c tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] 10.222.0.27 "GET /compute/v2.1/servers/9e4282f7-daab-454b-93e5-7854754316c8" status: 200 len: 1803 microversion: 2.1 time: 0.555251 Sep 08 10:56:13.290720 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2067/4073] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:12 2022] GET /compute/v2.1/servers/9e4282f7-daab-454b-93e5-7854754316c8 => generated 1803 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:13.320234 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8399ef4e-25b2-413e-a038-d946ea302b2a tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:56:13.329930 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8399ef4e-25b2-413e-a038-d946ea302b2a tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: 93d05d86-99b6-43f0-83c7-257ab64a12f3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:13.350175 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8399ef4e-25b2-413e-a038-d946ea302b2a tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:13.352636 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8399ef4e-25b2-413e-a038-d946ea302b2a tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:13.356998 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8399ef4e-25b2-413e-a038-d946ea302b2a tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:13.358738 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8399ef4e-25b2-413e-a038-d946ea302b2a tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:13.362217 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8399ef4e-25b2-413e-a038-d946ea302b2a tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:13.365616 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8399ef4e-25b2-413e-a038-d946ea302b2a tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:13.472224 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-768ebfa9-46d2-42fc-8cbb-b91b034bd07f tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:13.488230 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-768ebfa9-46d2-42fc-8cbb-b91b034bd07f tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/379a5e3e-0e59-4b53-a37e-f4e9d1000eaf" status: 200 len: 1511 microversion: 2.1 time: 0.268103 Sep 08 10:56:13.489222 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2007/4074] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:13 2022] GET /compute/v2.1/servers/379a5e3e-0e59-4b53-a37e-f4e9d1000eaf => generated 1511 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:13.498712 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c35af3c6-c7bc-4a23-b2b3-ff4fffbfa04e tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:13.499845 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c35af3c6-c7bc-4a23-b2b3-ff4fffbfa04e tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] [instance: 9e4282f7-daab-454b-93e5-7854754316c8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:13.508163 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c35af3c6-c7bc-4a23-b2b3-ff4fffbfa04e tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:13.509120 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c35af3c6-c7bc-4a23-b2b3-ff4fffbfa04e tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:13.509852 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c35af3c6-c7bc-4a23-b2b3-ff4fffbfa04e tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:13.510826 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c35af3c6-c7bc-4a23-b2b3-ff4fffbfa04e tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:13.511509 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c35af3c6-c7bc-4a23-b2b3-ff4fffbfa04e tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:13.512322 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c35af3c6-c7bc-4a23-b2b3-ff4fffbfa04e tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:13.554861 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c35af3c6-c7bc-4a23-b2b3-ff4fffbfa04e tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] 10.222.0.27 "GET /compute/v2.1/servers/9e4282f7-daab-454b-93e5-7854754316c8/ips" status: 200 len: 217 microversion: 2.1 time: 0.064200 Sep 08 10:56:13.556859 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2008/4075] 10.222.0.27 () {58 vars in 1248 bytes} [Thu Sep 8 10:56:13 2022] GET /compute/v2.1/servers/9e4282f7-daab-454b-93e5-7854754316c8/ips => generated 217 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:56:13.581277 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c4de76c1-097b-404e-a0b9-f31bcf9e0d76 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:13.582574 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c4de76c1-097b-404e-a0b9-f31bcf9e0d76 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] [instance: 9e4282f7-daab-454b-93e5-7854754316c8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:13.595106 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c4de76c1-097b-404e-a0b9-f31bcf9e0d76 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:13.596240 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c4de76c1-097b-404e-a0b9-f31bcf9e0d76 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:13.597180 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c4de76c1-097b-404e-a0b9-f31bcf9e0d76 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:13.598146 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c4de76c1-097b-404e-a0b9-f31bcf9e0d76 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:13.598625 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c4de76c1-097b-404e-a0b9-f31bcf9e0d76 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:13.599089 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c4de76c1-097b-404e-a0b9-f31bcf9e0d76 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:13.600224 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8399ef4e-25b2-413e-a038-d946ea302b2a tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "POST /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3/action" status: 202 len: 0 microversion: 2.1 time: 0.291721 Sep 08 10:56:13.612804 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2068/4076] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:56:13 2022] POST /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3/action => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:56:13.623606 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c1a034ae-6b73-4dc2-a535-49faf8d52744 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:13.632876 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c1a034ae-6b73-4dc2-a535-49faf8d52744 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:13.653258 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:56:13.660902 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c4de76c1-097b-404e-a0b9-f31bcf9e0d76 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] [instance: 9e4282f7-daab-454b-93e5-7854754316c8] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:56:13.664484 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c1a034ae-6b73-4dc2-a535-49faf8d52744 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:13.668360 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c1a034ae-6b73-4dc2-a535-49faf8d52744 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:13.668822 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c1a034ae-6b73-4dc2-a535-49faf8d52744 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:13.676382 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c1a034ae-6b73-4dc2-a535-49faf8d52744 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:13.679183 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c1a034ae-6b73-4dc2-a535-49faf8d52744 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:13.681045 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c1a034ae-6b73-4dc2-a535-49faf8d52744 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:13.899831 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c4de76c1-097b-404e-a0b9-f31bcf9e0d76 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9e4282f7-daab-454b-93e5-7854754316c8" status: 204 len: 0 microversion: 2.1 time: 0.323310 Sep 08 10:56:13.901962 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2009/4077] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:56:13 2022] DELETE /compute/v2.1/servers/9e4282f7-daab-454b-93e5-7854754316c8 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:56:13.926578 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1c4c2098-05dd-4b67-b84b-e07453259482 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:13.927337 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1c4c2098-05dd-4b67-b84b-e07453259482 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: 93d05d86-99b6-43f0-83c7-257ab64a12f3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:13.956484 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c4c2098-05dd-4b67-b84b-e07453259482 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:13.961708 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c4c2098-05dd-4b67-b84b-e07453259482 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:13.962520 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c4c2098-05dd-4b67-b84b-e07453259482 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:13.963802 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c4c2098-05dd-4b67-b84b-e07453259482 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:13.964618 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c4c2098-05dd-4b67-b84b-e07453259482 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:13.965328 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c4c2098-05dd-4b67-b84b-e07453259482 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:14.349544 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1c4c2098-05dd-4b67-b84b-e07453259482 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:14.361881 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1c4c2098-05dd-4b67-b84b-e07453259482 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3" status: 200 len: 1723 microversion: 2.1 time: 0.452573 Sep 08 10:56:14.381703 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c1a034ae-6b73-4dc2-a535-49faf8d52744 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:14.382335 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2010/4078] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:13 2022] GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3 => generated 1723 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:14.391808 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c1a034ae-6b73-4dc2-a535-49faf8d52744 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1526 microversion: 2.1 time: 0.776577 Sep 08 10:56:14.398015 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2069/4079] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:13 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1526 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:14.399110 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-36385554-3476-427f-afc6-e48832742665 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:14.400742 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-36385554-3476-427f-afc6-e48832742665 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:14.409739 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-91f42bd6-5b2f-4c70-83e1-a1674bd94785 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:14.410682 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-91f42bd6-5b2f-4c70-83e1-a1674bd94785 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] [instance: 9e4282f7-daab-454b-93e5-7854754316c8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:14.432703 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36385554-3476-427f-afc6-e48832742665 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:14.433634 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36385554-3476-427f-afc6-e48832742665 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:14.434448 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36385554-3476-427f-afc6-e48832742665 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:14.437313 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-91f42bd6-5b2f-4c70-83e1-a1674bd94785 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:14.440338 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-91f42bd6-5b2f-4c70-83e1-a1674bd94785 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:14.441331 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-91f42bd6-5b2f-4c70-83e1-a1674bd94785 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:14.442299 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-91f42bd6-5b2f-4c70-83e1-a1674bd94785 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:14.444437 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-91f42bd6-5b2f-4c70-83e1-a1674bd94785 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:14.444903 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36385554-3476-427f-afc6-e48832742665 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:14.445577 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-91f42bd6-5b2f-4c70-83e1-a1674bd94785 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:14.446796 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36385554-3476-427f-afc6-e48832742665 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:14.447844 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36385554-3476-427f-afc6-e48832742665 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:14.516394 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-36385554-3476-427f-afc6-e48832742665 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] HTTP exception thrown: Instance 98277784-8e48-4a7b-8786-ce579e1d5ccf could not be found. Sep 08 10:56:14.527327 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-36385554-3476-427f-afc6-e48832742665 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Request method failure captured: Sep 08 10:56:14.527327 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf HTTP/1.1 Sep 08 10:56:14.527327 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:56:14.527327 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:56:14.527327 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:56:14.527327 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:56:14.527327 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:56:14.527327 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:56:14.527327 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:56:14.527327 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:56:14.527327 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGciCxGmkU2lR8vtcZsVRYJ6XitHjr0LEEa7l3XJj4sj1DyTmB4LIp3zsJ7Sf-tMXEoiMS1GjnYdwcUnIXxaDj9pKL-zBWQYbLdXnhkuNOTTgIH6lsqDIjTl-3WORoE1ZaSQhUlCsPf1vQejvThe4R2bjlVFm0M4EY7cMg56kFkqbBAQ Sep 08 10:56:14.527327 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:56:14.527327 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:56:14.527327 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:56:14.527327 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:56:14.527327 n-d-850501-12 devstack@n-api.service[128862]: X-Openstack-Nova-Api-Version: 2.32 Sep 08 10:56:14.527327 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:56:14.527327 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:56:14.527327 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: bf115ce61d864726b0e6e6b28c6ac69a Sep 08 10:56:14.527327 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-TaggedBootDevicesTest-1345534377 Sep 08 10:56:14.527327 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:56:14.527327 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:56:14.527327 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bf115ce61d864726b0e6e6b28c6ac69a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bf115ce61d864726b0e6e6b28c6ac69a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bf115ce61d864726b0e6e6b28c6ac69a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bf115ce61d864726b0e6e6b28c6ac69a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:56:14.527327 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-TaggedBootDevicesTest-1345534377 Sep 08 10:56:14.527327 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: bf115ce61d864726b0e6e6b28c6ac69a Sep 08 10:56:14.527327 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1345534377 Sep 08 10:56:14.527327 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-TaggedBootDevicesTest-1345534377-project Sep 08 10:56:14.527327 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:56:14.527327 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:56:14.527327 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 72c4838df30441628becfb4e61778366 Sep 08 10:56:14.527327 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-TaggedBootDevicesTest-1345534377-project Sep 08 10:56:14.527327 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:56:14.527327 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 98277784-8e48-4a7b-8786-ce579e1d5ccf could not be found. Sep 08 10:56:14.527327 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '98277784-8e48-4a7b-8786-ce579e1d5ccf'} Sep 08 10:56:14.527327 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:56:14.527327 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:56:14.527327 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:56:14.527327 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:56:14.527327 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:56:14.527327 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:56:14.527327 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:56:14.527327 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:56:14.527327 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:56:14.527327 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:56:14.527327 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98277784-8e48-4a7b-8786-ce579e1d5ccf could not be found. Sep 08 10:56:14.527327 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:56:14.527327 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:56:14.527327 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:56:14.527327 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:56:14.527327 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:56:14.527327 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:56:14.527327 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:56:14.527327 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:56:14.527327 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:56:14.527327 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:56:14.527327 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:56:14.527327 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:56:14.527327 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:56:14.527327 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:56:14.527327 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:56:14.527327 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:56:14.527327 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98277784-8e48-4a7b-8786-ce579e1d5ccf could not be found. Sep 08 10:56:14.527327 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:56:14.527327 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:56:14.534131 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:56:14.534131 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:56:14.534131 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:56:14.534131 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:56:14.534131 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:56:14.534131 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:56:14.534131 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98277784-8e48-4a7b-8786-ce579e1d5ccf could not be found. Sep 08 10:56:14.534131 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:56:14.534131 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-36385554-3476-427f-afc6-e48832742665 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Returning 404 to user: Instance 98277784-8e48-4a7b-8786-ce579e1d5ccf could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:56:14.534131 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-36385554-3476-427f-afc6-e48832742665 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 404 len: 111 microversion: 2.32 time: 0.147690 Sep 08 10:56:14.534131 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2011/4080] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:56:14 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:56:14.548270 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-78a45768-8fc4-4b9a-a2c6-00fbcde01621 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:14.552192 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-78a45768-8fc4-4b9a-a2c6-00fbcde01621 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 379a5e3e-0e59-4b53-a37e-f4e9d1000eaf] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:14.580770 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-78a45768-8fc4-4b9a-a2c6-00fbcde01621 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:14.584793 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-78a45768-8fc4-4b9a-a2c6-00fbcde01621 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:14.585591 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-78a45768-8fc4-4b9a-a2c6-00fbcde01621 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:14.586752 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-78a45768-8fc4-4b9a-a2c6-00fbcde01621 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:14.587512 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-78a45768-8fc4-4b9a-a2c6-00fbcde01621 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:14.588267 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-78a45768-8fc4-4b9a-a2c6-00fbcde01621 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:14.881817 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-91f42bd6-5b2f-4c70-83e1-a1674bd94785 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22145c653c804031ae233de6d84647fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1c70903c3d42d790d9ef96adc1fdbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:14.894235 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-91f42bd6-5b2f-4c70-83e1-a1674bd94785 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] 10.222.0.27 "GET /compute/v2.1/servers/9e4282f7-daab-454b-93e5-7854754316c8" status: 200 len: 1809 microversion: 2.1 time: 0.494725 Sep 08 10:56:14.898983 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2070/4081] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:14 2022] GET /compute/v2.1/servers/9e4282f7-daab-454b-93e5-7854754316c8 => generated 1809 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:14.909737 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c2c15ab0-eacd-4329-92b8-172ee2a0f1ad tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '.version_select at 0x7f68e44cbd30>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:14.962557 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c2c15ab0-eacd-4329-92b8-172ee2a0f1ad tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1695367385" status: 204 len: 0 microversion: 2.32 time: 0.062339 Sep 08 10:56:14.968242 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2071/4082] 10.222.0.27 () {60 vars in 1262 bytes} [Thu Sep 8 10:56:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1695367385 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 10:56:15.124079 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-78a45768-8fc4-4b9a-a2c6-00fbcde01621 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:15.143665 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-78a45768-8fc4-4b9a-a2c6-00fbcde01621 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/379a5e3e-0e59-4b53-a37e-f4e9d1000eaf" status: 200 len: 1511 microversion: 2.1 time: 0.608432 Sep 08 10:56:15.144624 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2012/4083] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:14 2022] GET /compute/v2.1/servers/379a5e3e-0e59-4b53-a37e-f4e9d1000eaf => generated 1511 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:15.390736 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-09235891-e2d7-4b1b-bb37-66f1565eb0de tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:15.391862 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-09235891-e2d7-4b1b-bb37-66f1565eb0de tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: 93d05d86-99b6-43f0-83c7-257ab64a12f3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:15.437143 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-09235891-e2d7-4b1b-bb37-66f1565eb0de tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:15.437573 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4bff867f-fb71-4872-899e-7e9be899c004 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:15.438330 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4bff867f-fb71-4872-899e-7e9be899c004 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:15.439548 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-09235891-e2d7-4b1b-bb37-66f1565eb0de tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:15.440795 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-09235891-e2d7-4b1b-bb37-66f1565eb0de tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:15.444623 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-09235891-e2d7-4b1b-bb37-66f1565eb0de tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:15.446014 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-09235891-e2d7-4b1b-bb37-66f1565eb0de tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:15.448839 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-09235891-e2d7-4b1b-bb37-66f1565eb0de tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:15.457500 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4bff867f-fb71-4872-899e-7e9be899c004 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:15.458514 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4bff867f-fb71-4872-899e-7e9be899c004 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:15.473783 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4bff867f-fb71-4872-899e-7e9be899c004 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:15.475398 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4bff867f-fb71-4872-899e-7e9be899c004 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:15.479474 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4bff867f-fb71-4872-899e-7e9be899c004 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:15.484852 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4bff867f-fb71-4872-899e-7e9be899c004 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:15.979826 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4bff867f-fb71-4872-899e-7e9be899c004 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:15.998545 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4bff867f-fb71-4872-899e-7e9be899c004 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1526 microversion: 2.1 time: 0.565790 Sep 08 10:56:15.999423 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2013/4084] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:15 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1526 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:16.004335 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f9b2a942-9f66-4fdf-ad3f-b67bc7befe8b tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:16.005157 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f9b2a942-9f66-4fdf-ad3f-b67bc7befe8b tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] [instance: 9e4282f7-daab-454b-93e5-7854754316c8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:16.017735 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f9b2a942-9f66-4fdf-ad3f-b67bc7befe8b tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:16.018234 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f9b2a942-9f66-4fdf-ad3f-b67bc7befe8b tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:16.018755 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f9b2a942-9f66-4fdf-ad3f-b67bc7befe8b tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:16.019659 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f9b2a942-9f66-4fdf-ad3f-b67bc7befe8b tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:16.020181 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f9b2a942-9f66-4fdf-ad3f-b67bc7befe8b tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:16.020682 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f9b2a942-9f66-4fdf-ad3f-b67bc7befe8b tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:16.323616 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-09235891-e2d7-4b1b-bb37-66f1565eb0de tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:16.334423 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-09235891-e2d7-4b1b-bb37-66f1565eb0de tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3" status: 200 len: 1723 microversion: 2.1 time: 0.948535 Sep 08 10:56:16.335108 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2072/4085] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:15 2022] GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3 => generated 1723 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:16.339847 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fb78e56f-cad5-4e1a-87e1-47ab3ff93c0c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:16.340458 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fb78e56f-cad5-4e1a-87e1-47ab3ff93c0c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 379a5e3e-0e59-4b53-a37e-f4e9d1000eaf] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:16.347313 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb78e56f-cad5-4e1a-87e1-47ab3ff93c0c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:16.347807 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb78e56f-cad5-4e1a-87e1-47ab3ff93c0c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:16.348240 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb78e56f-cad5-4e1a-87e1-47ab3ff93c0c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:16.348937 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb78e56f-cad5-4e1a-87e1-47ab3ff93c0c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:16.349515 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb78e56f-cad5-4e1a-87e1-47ab3ff93c0c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:16.349943 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb78e56f-cad5-4e1a-87e1-47ab3ff93c0c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:16.512021 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f9b2a942-9f66-4fdf-ad3f-b67bc7befe8b tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22145c653c804031ae233de6d84647fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1c70903c3d42d790d9ef96adc1fdbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:16.535176 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f9b2a942-9f66-4fdf-ad3f-b67bc7befe8b tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] 10.222.0.27 "GET /compute/v2.1/servers/9e4282f7-daab-454b-93e5-7854754316c8" status: 200 len: 1809 microversion: 2.1 time: 0.534491 Sep 08 10:56:16.536098 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2014/4086] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:15 2022] GET /compute/v2.1/servers/9e4282f7-daab-454b-93e5-7854754316c8 => generated 1809 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:17.025432 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9fd8db75-304b-445d-a005-29a4f0db7f5e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:17.026079 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9fd8db75-304b-445d-a005-29a4f0db7f5e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:17.042778 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9fd8db75-304b-445d-a005-29a4f0db7f5e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:17.043173 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9fd8db75-304b-445d-a005-29a4f0db7f5e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:17.051559 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9fd8db75-304b-445d-a005-29a4f0db7f5e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:17.052333 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9fd8db75-304b-445d-a005-29a4f0db7f5e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:17.052810 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9fd8db75-304b-445d-a005-29a4f0db7f5e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:17.053284 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9fd8db75-304b-445d-a005-29a4f0db7f5e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:17.302139 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-fb78e56f-cad5-4e1a-87e1-47ab3ff93c0c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:17.315720 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fb78e56f-cad5-4e1a-87e1-47ab3ff93c0c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/379a5e3e-0e59-4b53-a37e-f4e9d1000eaf" status: 200 len: 1488 microversion: 2.1 time: 0.979373 Sep 08 10:56:17.320891 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2073/4087] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:16 2022] GET /compute/v2.1/servers/379a5e3e-0e59-4b53-a37e-f4e9d1000eaf => generated 1488 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:17.349965 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c06967f3-a669-4c55-80fc-77fe4dd6b5d3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:56:17.353863 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c06967f3-a669-4c55-80fc-77fe4dd6b5d3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:17.361414 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c06967f3-a669-4c55-80fc-77fe4dd6b5d3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:17.368370 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c06967f3-a669-4c55-80fc-77fe4dd6b5d3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:17.368987 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c06967f3-a669-4c55-80fc-77fe4dd6b5d3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:17.369804 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c06967f3-a669-4c55-80fc-77fe4dd6b5d3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:17.370680 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c06967f3-a669-4c55-80fc-77fe4dd6b5d3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:17.371124 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c06967f3-a669-4c55-80fc-77fe4dd6b5d3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:17.463437 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c06967f3-a669-4c55-80fc-77fe4dd6b5d3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "POST /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7/action" status: 200 len: 148 microversion: 2.1 time: 0.118773 Sep 08 10:56:17.469990 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2074/4088] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:56:17 2022] POST /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7/action => generated 148 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:56:17.476411 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d9a33967-96be-4150-a41b-7cf83bc4b07e tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:17.477156 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d9a33967-96be-4150-a41b-7cf83bc4b07e tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: 93d05d86-99b6-43f0-83c7-257ab64a12f3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:17.496435 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:56:17.500108 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d9a33967-96be-4150-a41b-7cf83bc4b07e tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:17.500615 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d9a33967-96be-4150-a41b-7cf83bc4b07e tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:17.501078 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d9a33967-96be-4150-a41b-7cf83bc4b07e tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:17.505501 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d9a33967-96be-4150-a41b-7cf83bc4b07e tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:17.508690 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d9a33967-96be-4150-a41b-7cf83bc4b07e tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:17.509466 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d9a33967-96be-4150-a41b-7cf83bc4b07e tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:17.582871 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9fd8db75-304b-445d-a005-29a4f0db7f5e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:17.590896 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9fd8db75-304b-445d-a005-29a4f0db7f5e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1526 microversion: 2.1 time: 0.569241 Sep 08 10:56:17.598165 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2015/4089] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:17 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1526 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:17.644875 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1e691d8a-cde5-4f31-b9e3-2a5113a9c625 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:17.645758 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1e691d8a-cde5-4f31-b9e3-2a5113a9c625 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:17.658214 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e691d8a-cde5-4f31-b9e3-2a5113a9c625 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:17.659092 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e691d8a-cde5-4f31-b9e3-2a5113a9c625 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:17.663582 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e691d8a-cde5-4f31-b9e3-2a5113a9c625 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:17.664682 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e691d8a-cde5-4f31-b9e3-2a5113a9c625 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:17.665430 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e691d8a-cde5-4f31-b9e3-2a5113a9c625 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:17.666092 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e691d8a-cde5-4f31-b9e3-2a5113a9c625 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:18.002909 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1e691d8a-cde5-4f31-b9e3-2a5113a9c625 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:18.016156 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1e691d8a-cde5-4f31-b9e3-2a5113a9c625 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1671 microversion: 2.1 time: 0.388765 Sep 08 10:56:18.020309 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2016/4090] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:17 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1671 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:18.037384 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b0331395-267e-4aa1-9b07-a61ef3e4a7ac tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:18.038510 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b0331395-267e-4aa1-9b07-a61ef3e4a7ac tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] [instance: 9e4282f7-daab-454b-93e5-7854754316c8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:18.053140 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b0331395-267e-4aa1-9b07-a61ef3e4a7ac tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:18.053930 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b0331395-267e-4aa1-9b07-a61ef3e4a7ac tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:18.054624 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b0331395-267e-4aa1-9b07-a61ef3e4a7ac tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:18.055587 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b0331395-267e-4aa1-9b07-a61ef3e4a7ac tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:18.056274 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b0331395-267e-4aa1-9b07-a61ef3e4a7ac tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:18.057010 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b0331395-267e-4aa1-9b07-a61ef3e4a7ac tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:18.342604 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d9a33967-96be-4150-a41b-7cf83bc4b07e tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:18.357921 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d9a33967-96be-4150-a41b-7cf83bc4b07e tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3" status: 200 len: 1723 microversion: 2.1 time: 0.891631 Sep 08 10:56:18.358668 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2075/4091] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:17 2022] GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3 => generated 1723 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:18.371381 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f84c8f8b-563c-4f03-913d-d74e5edad281 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:18.372466 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f84c8f8b-563c-4f03-913d-d74e5edad281 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:18.395622 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f84c8f8b-563c-4f03-913d-d74e5edad281 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:18.398409 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f84c8f8b-563c-4f03-913d-d74e5edad281 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:18.399047 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f84c8f8b-563c-4f03-913d-d74e5edad281 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:18.400844 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f84c8f8b-563c-4f03-913d-d74e5edad281 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:18.405206 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f84c8f8b-563c-4f03-913d-d74e5edad281 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:18.405889 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f84c8f8b-563c-4f03-913d-d74e5edad281 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:19.026275 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b0331395-267e-4aa1-9b07-a61ef3e4a7ac tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22145c653c804031ae233de6d84647fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1c70903c3d42d790d9ef96adc1fdbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:19.052674 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b0331395-267e-4aa1-9b07-a61ef3e4a7ac tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] 10.222.0.27 "GET /compute/v2.1/servers/9e4282f7-daab-454b-93e5-7854754316c8" status: 200 len: 1788 microversion: 2.1 time: 1.030454 Sep 08 10:56:19.062779 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2017/4092] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:18 2022] GET /compute/v2.1/servers/9e4282f7-daab-454b-93e5-7854754316c8 => generated 1788 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:19.076718 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-db0abe30-fbef-4b85-b16f-51adf85c8088 req-b2c6f3f4-b575-40e4-b4c4-52fb40a4af69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e4282f7-daab-454b-93e5-7854754316c8", "name": "network-vif-unplugged", "status": "completed", "tag": "f22fbc47-8d40-4a4a-b4db-418a5a719296"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:56:19.142697 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-db0abe30-fbef-4b85-b16f-51adf85c8088 req-b2c6f3f4-b575-40e4-b4c4-52fb40a4af69 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:19.143192 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-db0abe30-fbef-4b85-b16f-51adf85c8088 req-b2c6f3f4-b575-40e4-b4c4-52fb40a4af69 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:19.143624 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-db0abe30-fbef-4b85-b16f-51adf85c8088 req-b2c6f3f4-b575-40e4-b4c4-52fb40a4af69 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:19.190097 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-db0abe30-fbef-4b85-b16f-51adf85c8088 req-b2c6f3f4-b575-40e4-b4c4-52fb40a4af69 service nova] Creating event network-vif-unplugged:f22fbc47-8d40-4a4a-b4db-418a5a719296 for instance 9e4282f7-daab-454b-93e5-7854754316c8 on n-h2-850501-12 Sep 08 10:56:19.203964 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-db0abe30-fbef-4b85-b16f-51adf85c8088 req-b2c6f3f4-b575-40e4-b4c4-52fb40a4af69 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.139364 Sep 08 10:56:19.208480 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2018/4093] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:56:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:56:19.225320 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-3db43e81-6dbe-4e3b-a27d-e0e73f1fd897 req-8b0cfebc-b644-42c0-ad5f-4883636fa45b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e4282f7-daab-454b-93e5-7854754316c8", "name": "network-vif-deleted", "tag": "d83ddcd1-a521-4860-bd2f-45d8879fd5b2"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:56:19.258297 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-3db43e81-6dbe-4e3b-a27d-e0e73f1fd897 req-8b0cfebc-b644-42c0-ad5f-4883636fa45b service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:19.259743 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f84c8f8b-563c-4f03-913d-d74e5edad281 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:19.270850 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f84c8f8b-563c-4f03-913d-d74e5edad281 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1671 microversion: 2.1 time: 0.911017 Sep 08 10:56:19.275054 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-3db43e81-6dbe-4e3b-a27d-e0e73f1fd897 req-8b0cfebc-b644-42c0-ad5f-4883636fa45b service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:19.275736 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-3db43e81-6dbe-4e3b-a27d-e0e73f1fd897 req-8b0cfebc-b644-42c0-ad5f-4883636fa45b service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:19.277895 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2076/4094] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:18 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1671 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:19.283927 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6f653396-0e69-42e0-b800-422f2aa60b90 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:19.300170 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6f653396-0e69-42e0-b800-422f2aa60b90 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:19.312753 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-3db43e81-6dbe-4e3b-a27d-e0e73f1fd897 req-8b0cfebc-b644-42c0-ad5f-4883636fa45b service nova] Creating event network-vif-deleted:d83ddcd1-a521-4860-bd2f-45d8879fd5b2 for instance 9e4282f7-daab-454b-93e5-7854754316c8 on n-h2-850501-12 Sep 08 10:56:19.321757 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6f653396-0e69-42e0-b800-422f2aa60b90 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:19.322442 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6f653396-0e69-42e0-b800-422f2aa60b90 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:19.322827 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-3db43e81-6dbe-4e3b-a27d-e0e73f1fd897 req-8b0cfebc-b644-42c0-ad5f-4883636fa45b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112020 Sep 08 10:56:19.323921 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2019/4095] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:56:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:56:19.324171 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6f653396-0e69-42e0-b800-422f2aa60b90 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:19.325078 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6f653396-0e69-42e0-b800-422f2aa60b90 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:19.330905 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6f653396-0e69-42e0-b800-422f2aa60b90 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:19.331501 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6f653396-0e69-42e0-b800-422f2aa60b90 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:19.332220 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d2a7c175-65b6-4fc8-a875-04480c71f595 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:19.333145 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d2a7c175-65b6-4fc8-a875-04480c71f595 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:19.344646 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2a7c175-65b6-4fc8-a875-04480c71f595 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:19.346112 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2a7c175-65b6-4fc8-a875-04480c71f595 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:19.347119 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2a7c175-65b6-4fc8-a875-04480c71f595 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:19.348190 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2a7c175-65b6-4fc8-a875-04480c71f595 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:19.349326 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2a7c175-65b6-4fc8-a875-04480c71f595 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:19.349930 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2a7c175-65b6-4fc8-a875-04480c71f595 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:19.762107 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6f653396-0e69-42e0-b800-422f2aa60b90 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:19.775835 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6f653396-0e69-42e0-b800-422f2aa60b90 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1526 microversion: 2.1 time: 0.494796 Sep 08 10:56:19.793908 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2077/4096] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:19 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1526 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:19.803984 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d2a7c175-65b6-4fc8-a875-04480c71f595 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:19.807011 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-179fbc41-b1f8-4960-b051-e43af4d94e95 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:19.807779 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-179fbc41-b1f8-4960-b051-e43af4d94e95 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: 93d05d86-99b6-43f0-83c7-257ab64a12f3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:19.817315 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d2a7c175-65b6-4fc8-a875-04480c71f595 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1671 microversion: 2.1 time: 0.491803 Sep 08 10:56:19.818346 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2020/4097] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:19 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1671 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:19.832308 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-179fbc41-b1f8-4960-b051-e43af4d94e95 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:19.832308 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-179fbc41-b1f8-4960-b051-e43af4d94e95 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:19.832308 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-179fbc41-b1f8-4960-b051-e43af4d94e95 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:19.832308 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-179fbc41-b1f8-4960-b051-e43af4d94e95 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:19.832308 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-179fbc41-b1f8-4960-b051-e43af4d94e95 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:19.832308 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-179fbc41-b1f8-4960-b051-e43af4d94e95 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:20.114198 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1138f31a-582f-4aee-b003-605bab88ce2f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1975568299", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "18a80af3-5a0a-4eb1-9a35-8a545a9d9cea"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:56:20.132564 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:56:20.260288 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-1138f31a-582f-4aee-b003-605bab88ce2f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] validate_networks() for [('18a80af3-5a0a-4eb1-9a35-8a545a9d9cea', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:56:20.513228 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-179fbc41-b1f8-4960-b051-e43af4d94e95 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:20.534862 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-179fbc41-b1f8-4960-b051-e43af4d94e95 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3" status: 200 len: 1729 microversion: 2.1 time: 0.738214 Sep 08 10:56:20.536001 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2078/4098] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:19 2022] GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3 => generated 1729 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:20.553881 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f691da1d-ae8c-4924-b499-6abc14ea266d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:20.554607 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f691da1d-ae8c-4924-b499-6abc14ea266d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:20.566439 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f691da1d-ae8c-4924-b499-6abc14ea266d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:20.567046 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f691da1d-ae8c-4924-b499-6abc14ea266d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:20.567796 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f691da1d-ae8c-4924-b499-6abc14ea266d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:20.568656 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f691da1d-ae8c-4924-b499-6abc14ea266d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:20.569283 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f691da1d-ae8c-4924-b499-6abc14ea266d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:20.569780 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f691da1d-ae8c-4924-b499-6abc14ea266d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:21.298855 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-1138f31a-582f-4aee-b003-605bab88ce2f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:56:21.299894 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-1138f31a-582f-4aee-b003-605bab88ce2f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:56:21.300588 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-1138f31a-582f-4aee-b003-605bab88ce2f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:56:21.301202 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-1138f31a-582f-4aee-b003-605bab88ce2f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:56:21.301930 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-1138f31a-582f-4aee-b003-605bab88ce2f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:56:21.323569 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1138f31a-582f-4aee-b003-605bab88ce2f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:21.324332 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1138f31a-582f-4aee-b003-605bab88ce2f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:21.342371 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1138f31a-582f-4aee-b003-605bab88ce2f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:21.343565 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1138f31a-582f-4aee-b003-605bab88ce2f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:21.344227 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1138f31a-582f-4aee-b003-605bab88ce2f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:21.353155 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1138f31a-582f-4aee-b003-605bab88ce2f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:21.453760 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-1138f31a-582f-4aee-b003-605bab88ce2f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Getting quotas for project 4478d0e315d948df9eda910f205646c3. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:56:21.473804 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-1138f31a-582f-4aee-b003-605bab88ce2f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Getting quotas for user 06a779e85e1c493985f7cfe8aceb9c87 and project 4478d0e315d948df9eda910f205646c3. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:56:21.528148 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1138f31a-582f-4aee-b003-605bab88ce2f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:56:21.538328 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1138f31a-582f-4aee-b003-605bab88ce2f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] [instance: 931569b4-139a-4939-abf3-49a589eb1d91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:56:21.650224 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1138f31a-582f-4aee-b003-605bab88ce2f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.807499 Sep 08 10:56:21.652275 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2021/4099] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:56:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1811 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:56:21.668702 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-14419d50-a7b1-4c65-95bf-446983af25dd tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:21.671095 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-14419d50-a7b1-4c65-95bf-446983af25dd tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] [instance: 9e4282f7-daab-454b-93e5-7854754316c8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:21.689860 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f691da1d-ae8c-4924-b499-6abc14ea266d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:21.691728 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-14419d50-a7b1-4c65-95bf-446983af25dd tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:21.693404 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-14419d50-a7b1-4c65-95bf-446983af25dd tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:21.695471 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-14419d50-a7b1-4c65-95bf-446983af25dd tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:21.698217 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f691da1d-ae8c-4924-b499-6abc14ea266d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1671 microversion: 2.1 time: 1.160894 Sep 08 10:56:21.699543 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-14419d50-a7b1-4c65-95bf-446983af25dd tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:21.700345 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2079/4100] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:20 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1671 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:21.702866 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-14419d50-a7b1-4c65-95bf-446983af25dd tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:21.703365 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-14419d50-a7b1-4c65-95bf-446983af25dd tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:21.748348 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f186f8b5-6915-4664-84c8-f5f3b8c19b1d tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:21.748788 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f186f8b5-6915-4664-84c8-f5f3b8c19b1d tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: 93d05d86-99b6-43f0-83c7-257ab64a12f3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:21.780274 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f186f8b5-6915-4664-84c8-f5f3b8c19b1d tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:21.781283 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f186f8b5-6915-4664-84c8-f5f3b8c19b1d tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:21.785205 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f186f8b5-6915-4664-84c8-f5f3b8c19b1d tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:21.786517 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f186f8b5-6915-4664-84c8-f5f3b8c19b1d tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:21.788637 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f186f8b5-6915-4664-84c8-f5f3b8c19b1d tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:21.793205 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f186f8b5-6915-4664-84c8-f5f3b8c19b1d tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:22.012219 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f186f8b5-6915-4664-84c8-f5f3b8c19b1d tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.293061 Sep 08 10:56:22.013082 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2080/4101] 10.222.0.27 () {58 vars in 1275 bytes} [Thu Sep 8 10:56:21 2022] GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3/os-interface => generated 284 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:56:22.034291 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6b5c4422-b9cb-4f81-9921-1c4c09445701 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:22.036859 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6b5c4422-b9cb-4f81-9921-1c4c09445701 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:22.062256 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6b5c4422-b9cb-4f81-9921-1c4c09445701 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:22.065089 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6b5c4422-b9cb-4f81-9921-1c4c09445701 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:22.066514 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6b5c4422-b9cb-4f81-9921-1c4c09445701 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:22.071586 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6b5c4422-b9cb-4f81-9921-1c4c09445701 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:22.088535 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6b5c4422-b9cb-4f81-9921-1c4c09445701 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:22.089537 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6b5c4422-b9cb-4f81-9921-1c4c09445701 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:22.400817 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-14419d50-a7b1-4c65-95bf-446983af25dd tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22145c653c804031ae233de6d84647fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1c70903c3d42d790d9ef96adc1fdbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:22.412180 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-14419d50-a7b1-4c65-95bf-446983af25dd tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] 10.222.0.27 "GET /compute/v2.1/servers/9e4282f7-daab-454b-93e5-7854754316c8" status: 200 len: 1609 microversion: 2.1 time: 0.758109 Sep 08 10:56:22.412777 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2022/4102] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:21 2022] GET /compute/v2.1/servers/9e4282f7-daab-454b-93e5-7854754316c8 => generated 1609 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:22.418678 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-0e57a0a9-76fc-4443-b52d-c9eef8d08052 req-dc4f0a63-92ac-45c7-bbd9-62e23c9978a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e4282f7-daab-454b-93e5-7854754316c8", "name": "network-vif-unplugged", "status": "completed", "tag": "cf3ab348-494e-468a-b277-a1c2300a402c"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:56:22.470144 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-0e57a0a9-76fc-4443-b52d-c9eef8d08052 req-dc4f0a63-92ac-45c7-bbd9-62e23c9978a1 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:22.470643 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-0e57a0a9-76fc-4443-b52d-c9eef8d08052 req-dc4f0a63-92ac-45c7-bbd9-62e23c9978a1 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:22.471098 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-0e57a0a9-76fc-4443-b52d-c9eef8d08052 req-dc4f0a63-92ac-45c7-bbd9-62e23c9978a1 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:22.572195 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-0e57a0a9-76fc-4443-b52d-c9eef8d08052 req-dc4f0a63-92ac-45c7-bbd9-62e23c9978a1 service nova] Creating event network-vif-unplugged:cf3ab348-494e-468a-b277-a1c2300a402c for instance 9e4282f7-daab-454b-93e5-7854754316c8 on n-h2-850501-12 Sep 08 10:56:22.594695 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-0e57a0a9-76fc-4443-b52d-c9eef8d08052 req-dc4f0a63-92ac-45c7-bbd9-62e23c9978a1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.179360 Sep 08 10:56:22.601261 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2023/4103] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:56:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:56:22.625478 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-791caeaa-693c-46c3-800a-ccd4fa178b8c req-1ac81cb0-efaa-49ae-90c7-650068f4e60b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e4282f7-daab-454b-93e5-7854754316c8", "name": "network-vif-deleted", "tag": "cf3ab348-494e-468a-b277-a1c2300a402c"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:56:22.644284 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6b5c4422-b9cb-4f81-9921-1c4c09445701 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:22.672879 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6b5c4422-b9cb-4f81-9921-1c4c09445701 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1526 microversion: 2.1 time: 0.649857 Sep 08 10:56:22.675700 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2081/4104] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:22 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1526 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:22.703392 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7fccc1c5-9bba-4c29-b1e1-e0ff529f580b tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-610778500", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "18a80af3-5a0a-4eb1-9a35-8a545a9d9cea"}]}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:56:22.712086 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-791caeaa-693c-46c3-800a-ccd4fa178b8c req-1ac81cb0-efaa-49ae-90c7-650068f4e60b service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:22.712588 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-791caeaa-693c-46c3-800a-ccd4fa178b8c req-1ac81cb0-efaa-49ae-90c7-650068f4e60b service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:22.720177 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-791caeaa-693c-46c3-800a-ccd4fa178b8c req-1ac81cb0-efaa-49ae-90c7-650068f4e60b service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:22.785783 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-791caeaa-693c-46c3-800a-ccd4fa178b8c req-1ac81cb0-efaa-49ae-90c7-650068f4e60b service nova] Creating event network-vif-deleted:cf3ab348-494e-468a-b277-a1c2300a402c for instance 9e4282f7-daab-454b-93e5-7854754316c8 on n-h2-850501-12 Sep 08 10:56:22.815420 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-791caeaa-693c-46c3-800a-ccd4fa178b8c req-1ac81cb0-efaa-49ae-90c7-650068f4e60b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.212348 Sep 08 10:56:22.826922 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2024/4105] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:56:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:56:22.840641 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-66b94146-fd9a-4fd9-998b-e5a609323c2c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2025072661", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "b9022ed4-d5a1-4655-b50c-e8de49533ecf"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:56:22.931646 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-7fccc1c5-9bba-4c29-b1e1-e0ff529f580b tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] validate_networks() for [('18a80af3-5a0a-4eb1-9a35-8a545a9d9cea', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:56:23.072631 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-66b94146-fd9a-4fd9-998b-e5a609323c2c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] validate_networks() for [('b9022ed4-d5a1-4655-b50c-e8de49533ecf', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:56:25.060622 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-7fccc1c5-9bba-4c29-b1e1-e0ff529f580b tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:56:25.062279 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-7fccc1c5-9bba-4c29-b1e1-e0ff529f580b tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:56:25.066477 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-7fccc1c5-9bba-4c29-b1e1-e0ff529f580b tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:56:25.066719 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-7fccc1c5-9bba-4c29-b1e1-e0ff529f580b tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:56:25.067179 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-7fccc1c5-9bba-4c29-b1e1-e0ff529f580b tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:56:25.097850 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7fccc1c5-9bba-4c29-b1e1-e0ff529f580b tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:25.098371 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7fccc1c5-9bba-4c29-b1e1-e0ff529f580b tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:25.101292 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7fccc1c5-9bba-4c29-b1e1-e0ff529f580b tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:25.102336 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7fccc1c5-9bba-4c29-b1e1-e0ff529f580b tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:25.104227 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7fccc1c5-9bba-4c29-b1e1-e0ff529f580b tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:25.105786 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7fccc1c5-9bba-4c29-b1e1-e0ff529f580b tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:25.160384 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-7fccc1c5-9bba-4c29-b1e1-e0ff529f580b tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Getting quotas for project 4478d0e315d948df9eda910f205646c3. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:56:25.182287 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-7fccc1c5-9bba-4c29-b1e1-e0ff529f580b tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Getting quotas for user 06a779e85e1c493985f7cfe8aceb9c87 and project 4478d0e315d948df9eda910f205646c3. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:56:25.239351 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7fccc1c5-9bba-4c29-b1e1-e0ff529f580b tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:56:25.245743 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7fccc1c5-9bba-4c29-b1e1-e0ff529f580b tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] [instance: 13039f8f-105b-4bb5-b632-753e183d2f1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:56:25.474079 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7fccc1c5-9bba-4c29-b1e1-e0ff529f580b tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.795554 Sep 08 10:56:25.492025 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2082/4106] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:56:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 2814 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:56:25.519233 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e2352c4d-146e-4221-a23e-f1f39a7821cf tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:25.520856 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e2352c4d-146e-4221-a23e-f1f39a7821cf tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] [instance: 9e4282f7-daab-454b-93e5-7854754316c8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:25.561222 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e2352c4d-146e-4221-a23e-f1f39a7821cf tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:25.610196 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e2352c4d-146e-4221-a23e-f1f39a7821cf tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:25.610196 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e2352c4d-146e-4221-a23e-f1f39a7821cf tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:25.610196 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e2352c4d-146e-4221-a23e-f1f39a7821cf tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:25.610196 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e2352c4d-146e-4221-a23e-f1f39a7821cf tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:25.610196 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e2352c4d-146e-4221-a23e-f1f39a7821cf tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:25.686153 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e2352c4d-146e-4221-a23e-f1f39a7821cf tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:25.700136 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e2352c4d-146e-4221-a23e-f1f39a7821cf tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:25.701487 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e2352c4d-146e-4221-a23e-f1f39a7821cf tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:25.702204 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-e2352c4d-146e-4221-a23e-f1f39a7821cf tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lazy-loading 'fault' on Instance uuid 9e4282f7-daab-454b-93e5-7854754316c8 {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:56:25.861682 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e2352c4d-146e-4221-a23e-f1f39a7821cf tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22145c653c804031ae233de6d84647fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1c70903c3d42d790d9ef96adc1fdbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:25.880902 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e2352c4d-146e-4221-a23e-f1f39a7821cf tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] 10.222.0.27 "GET /compute/v2.1/servers/9e4282f7-daab-454b-93e5-7854754316c8" status: 200 len: 1302 microversion: 2.1 time: 0.387151 Sep 08 10:56:25.882841 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2083/4107] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:25 2022] GET /compute/v2.1/servers/9e4282f7-daab-454b-93e5-7854754316c8 => generated 1302 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:25.895488 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ea5b2e3e-74a4-4aae-8ec6-9dca16ffdc74 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:25.896464 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ea5b2e3e-74a4-4aae-8ec6-9dca16ffdc74 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:25.912995 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ea5b2e3e-74a4-4aae-8ec6-9dca16ffdc74 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:25.915336 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ea5b2e3e-74a4-4aae-8ec6-9dca16ffdc74 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:25.915967 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ea5b2e3e-74a4-4aae-8ec6-9dca16ffdc74 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:25.921140 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ea5b2e3e-74a4-4aae-8ec6-9dca16ffdc74 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:25.922037 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ea5b2e3e-74a4-4aae-8ec6-9dca16ffdc74 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:25.922669 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ea5b2e3e-74a4-4aae-8ec6-9dca16ffdc74 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:25.970474 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:56:26.619965 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-66b94146-fd9a-4fd9-998b-e5a609323c2c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:56:26.620520 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-66b94146-fd9a-4fd9-998b-e5a609323c2c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:56:26.621391 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-66b94146-fd9a-4fd9-998b-e5a609323c2c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:56:26.621908 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-66b94146-fd9a-4fd9-998b-e5a609323c2c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:56:26.622596 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-66b94146-fd9a-4fd9-998b-e5a609323c2c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:56:26.676212 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-66b94146-fd9a-4fd9-998b-e5a609323c2c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:26.686372 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-66b94146-fd9a-4fd9-998b-e5a609323c2c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:26.692255 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-66b94146-fd9a-4fd9-998b-e5a609323c2c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:26.702332 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-66b94146-fd9a-4fd9-998b-e5a609323c2c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:26.736282 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-66b94146-fd9a-4fd9-998b-e5a609323c2c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.034s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:26.738829 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-66b94146-fd9a-4fd9-998b-e5a609323c2c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:26.916602 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-66b94146-fd9a-4fd9-998b-e5a609323c2c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Getting quotas for project 11b5d4706b2d43aca8290ccf07ee1ece. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:56:26.961843 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-66b94146-fd9a-4fd9-998b-e5a609323c2c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Getting quotas for user d68b017335c84d15becbdc7615498103 and project 11b5d4706b2d43aca8290ccf07ee1ece. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:56:27.076810 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-66b94146-fd9a-4fd9-998b-e5a609323c2c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:56:27.093700 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-66b94146-fd9a-4fd9-998b-e5a609323c2c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 85c5c938-83a1-4ca3-b9b1-b05d818f7efc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:56:27.203791 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-66b94146-fd9a-4fd9-998b-e5a609323c2c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.375103 Sep 08 10:56:27.211701 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2025/4108] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:56:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 4384 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:56:27.242259 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-970b060b-6531-40a5-b340-cd1e7acfe46c req-39568268-3fe1-414d-92d8-1c1be3d6e720 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e4282f7-daab-454b-93e5-7854754316c8", "name": "network-vif-deleted", "tag": "f22fbc47-8d40-4a4a-b4db-418a5a719296"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:56:27.280961 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-970b060b-6531-40a5-b340-cd1e7acfe46c req-39568268-3fe1-414d-92d8-1c1be3d6e720 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:27.289490 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-970b060b-6531-40a5-b340-cd1e7acfe46c req-39568268-3fe1-414d-92d8-1c1be3d6e720 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:27.291231 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-970b060b-6531-40a5-b340-cd1e7acfe46c req-39568268-3fe1-414d-92d8-1c1be3d6e720 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:27.339175 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-970b060b-6531-40a5-b340-cd1e7acfe46c req-39568268-3fe1-414d-92d8-1c1be3d6e720 service nova] Creating event network-vif-deleted:f22fbc47-8d40-4a4a-b4db-418a5a719296 for instance 9e4282f7-daab-454b-93e5-7854754316c8 on n-h2-850501-12 Sep 08 10:56:27.361129 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-970b060b-6531-40a5-b340-cd1e7acfe46c req-39568268-3fe1-414d-92d8-1c1be3d6e720 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143277 Sep 08 10:56:27.365139 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2026/4109] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:56:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:56:27.389746 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-add69c68-4b44-4a35-ba4d-eecda395cd9e tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1835011700", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "451", "networks": [{"uuid": "18a80af3-5a0a-4eb1-9a35-8a545a9d9cea"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:56:27.784627 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ea5b2e3e-74a4-4aae-8ec6-9dca16ffdc74 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:27.802555 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ea5b2e3e-74a4-4aae-8ec6-9dca16ffdc74 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1526 microversion: 2.1 time: 1.915562 Sep 08 10:56:27.803990 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2084/4110] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:25 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1526 bytes in 1920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:27.822821 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-be2b7154-3bbd-49f2-8496-fb6e4f784124 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:27.827795 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-be2b7154-3bbd-49f2-8496-fb6e4f784124 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] [instance: 9e4282f7-daab-454b-93e5-7854754316c8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:27.854854 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-be2b7154-3bbd-49f2-8496-fb6e4f784124 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:27.856849 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-be2b7154-3bbd-49f2-8496-fb6e4f784124 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:27.858152 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-be2b7154-3bbd-49f2-8496-fb6e4f784124 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:27.861782 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-be2b7154-3bbd-49f2-8496-fb6e4f784124 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:27.862289 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-be2b7154-3bbd-49f2-8496-fb6e4f784124 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:27.864765 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-be2b7154-3bbd-49f2-8496-fb6e4f784124 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:27.867891 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-add69c68-4b44-4a35-ba4d-eecda395cd9e tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] validate_networks() for [('18a80af3-5a0a-4eb1-9a35-8a545a9d9cea', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:56:27.903060 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-be2b7154-3bbd-49f2-8496-fb6e4f784124 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] HTTP exception thrown: Instance 9e4282f7-daab-454b-93e5-7854754316c8 could not be found. Sep 08 10:56:27.909644 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-be2b7154-3bbd-49f2-8496-fb6e4f784124 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Request method failure captured: Sep 08 10:56:27.909644 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/9e4282f7-daab-454b-93e5-7854754316c8 HTTP/1.1 Sep 08 10:56:27.909644 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:56:27.909644 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:56:27.909644 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:56:27.909644 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:56:27.909644 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:56:27.909644 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:56:27.909644 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:56:27.909644 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:56:27.909644 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcod6NyAY5khuYZmAuIgq4JBYBTI-D4jLVXxFgAEX8W5oVvP2tD1ZRtXgkupryqxfQ5TxEluQna7tvFbLU8Nqj1H4c3e-hI-CSApfK2lfysLLiu0tl4KfZ6Hp5ha-7InD_PXInG3o5sbUtFWmNzHNdMQ2u-nfdV_i_ROuHFcUNRzWKE Sep 08 10:56:27.909644 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:56:27.909644 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:56:27.909644 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:56:27.909644 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:56:27.909644 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:56:27.909644 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:56:27.909644 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 1f1c70903c3d42d790d9ef96adc1fdbd Sep 08 10:56:27.909644 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServersTestMultiNic-1772230459 Sep 08 10:56:27.909644 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:56:27.909644 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:56:27.909644 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1f1c70903c3d42d790d9ef96adc1fdbd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1f1c70903c3d42d790d9ef96adc1fdbd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1f1c70903c3d42d790d9ef96adc1fdbd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1f1c70903c3d42d790d9ef96adc1fdbd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:56:27.909644 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServersTestMultiNic-1772230459 Sep 08 10:56:27.909644 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 1f1c70903c3d42d790d9ef96adc1fdbd Sep 08 10:56:27.909644 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServersTestMultiNic-1772230459 Sep 08 10:56:27.909644 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServersTestMultiNic-1772230459-project Sep 08 10:56:27.909644 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:56:27.909644 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:56:27.909644 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 22145c653c804031ae233de6d84647fe Sep 08 10:56:27.909644 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServersTestMultiNic-1772230459-project Sep 08 10:56:27.909644 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:56:27.909644 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 9e4282f7-daab-454b-93e5-7854754316c8 could not be found. Sep 08 10:56:27.909644 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '9e4282f7-daab-454b-93e5-7854754316c8'} Sep 08 10:56:27.909644 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:56:27.909644 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:56:27.909644 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:56:27.909644 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:56:27.909644 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:56:27.909644 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:56:27.909644 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:56:27.909644 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:56:27.909644 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:56:27.909644 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:56:27.909644 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e4282f7-daab-454b-93e5-7854754316c8 could not be found. Sep 08 10:56:27.909644 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:56:27.909644 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:56:27.909644 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:56:27.909644 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:56:27.909644 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:56:27.909644 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:56:27.909644 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:56:27.909644 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:56:27.909644 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:56:27.909644 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:56:27.909644 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:56:27.909644 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:56:27.909644 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:56:27.909644 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:56:27.909644 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:56:27.909644 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:56:27.909644 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e4282f7-daab-454b-93e5-7854754316c8 could not be found. Sep 08 10:56:27.909644 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:56:27.909644 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:56:27.909644 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:56:27.921158 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:56:27.921158 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:56:27.921158 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:56:27.921158 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:56:27.921158 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:56:27.921158 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e4282f7-daab-454b-93e5-7854754316c8 could not be found. Sep 08 10:56:27.921158 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:56:27.921158 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-be2b7154-3bbd-49f2-8496-fb6e4f784124 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Returning 404 to user: Instance 9e4282f7-daab-454b-93e5-7854754316c8 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:56:27.921158 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-be2b7154-3bbd-49f2-8496-fb6e4f784124 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] 10.222.0.27 "GET /compute/v2.1/servers/9e4282f7-daab-454b-93e5-7854754316c8" status: 404 len: 111 microversion: 2.1 time: 0.109384 Sep 08 10:56:27.921158 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2085/4111] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:27 2022] GET /compute/v2.1/servers/9e4282f7-daab-454b-93e5-7854754316c8 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:56:27.938649 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-70b923f2-7b5a-4c12-8cc6-e548c2020a90 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:27.948339 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-70b923f2-7b5a-4c12-8cc6-e548c2020a90 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 85c5c938-83a1-4ca3-b9b1-b05d818f7efc] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:28.203963 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-70b923f2-7b5a-4c12-8cc6-e548c2020a90 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:28.211928 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-70b923f2-7b5a-4c12-8cc6-e548c2020a90 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/85c5c938-83a1-4ca3-b9b1-b05d818f7efc" status: 200 len: 1215 microversion: 2.1 time: 0.294444 Sep 08 10:56:28.217067 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2086/4112] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:27 2022] GET /compute/v2.1/servers/85c5c938-83a1-4ca3-b9b1-b05d818f7efc => generated 1215 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:28.827864 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-81dcb888-f08b-4fd6-a0be-64fca9b015cb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:28.828517 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-81dcb888-f08b-4fd6-a0be-64fca9b015cb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:28.861652 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-81dcb888-f08b-4fd6-a0be-64fca9b015cb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:28.862145 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-81dcb888-f08b-4fd6-a0be-64fca9b015cb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:28.875920 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-81dcb888-f08b-4fd6-a0be-64fca9b015cb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:28.876859 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-81dcb888-f08b-4fd6-a0be-64fca9b015cb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:28.879778 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-81dcb888-f08b-4fd6-a0be-64fca9b015cb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:28.882252 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-81dcb888-f08b-4fd6-a0be-64fca9b015cb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:29.649507 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-81dcb888-f08b-4fd6-a0be-64fca9b015cb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:29.697113 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-81dcb888-f08b-4fd6-a0be-64fca9b015cb tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1526 microversion: 2.1 time: 0.866815 Sep 08 10:56:29.704669 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2087/4113] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:28 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1526 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:56:29.712150 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8d381bc9-c158-4ccb-8dae-d6fd1876c86a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:29.713457 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8d381bc9-c158-4ccb-8dae-d6fd1876c86a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 85c5c938-83a1-4ca3-b9b1-b05d818f7efc] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:29.737496 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8d381bc9-c158-4ccb-8dae-d6fd1876c86a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:29.738320 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8d381bc9-c158-4ccb-8dae-d6fd1876c86a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:29.738953 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8d381bc9-c158-4ccb-8dae-d6fd1876c86a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:29.740690 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8d381bc9-c158-4ccb-8dae-d6fd1876c86a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:29.743980 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8d381bc9-c158-4ccb-8dae-d6fd1876c86a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:29.745223 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8d381bc9-c158-4ccb-8dae-d6fd1876c86a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:29.949749 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-add69c68-4b44-4a35-ba4d-eecda395cd9e tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:56:29.951532 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-add69c68-4b44-4a35-ba4d-eecda395cd9e tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:56:29.952317 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-add69c68-4b44-4a35-ba4d-eecda395cd9e tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:56:29.952908 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-add69c68-4b44-4a35-ba4d-eecda395cd9e tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:56:29.953505 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-add69c68-4b44-4a35-ba4d-eecda395cd9e tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:56:29.972911 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-add69c68-4b44-4a35-ba4d-eecda395cd9e tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:29.974379 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-add69c68-4b44-4a35-ba4d-eecda395cd9e tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:29.975047 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-add69c68-4b44-4a35-ba4d-eecda395cd9e tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:29.976002 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-add69c68-4b44-4a35-ba4d-eecda395cd9e tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:29.976642 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-add69c68-4b44-4a35-ba4d-eecda395cd9e tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:29.977503 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-add69c68-4b44-4a35-ba4d-eecda395cd9e tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:30.018624 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-add69c68-4b44-4a35-ba4d-eecda395cd9e tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Getting quotas for project 4478d0e315d948df9eda910f205646c3. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:56:30.052694 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-add69c68-4b44-4a35-ba4d-eecda395cd9e tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Getting quotas for user 06a779e85e1c493985f7cfe8aceb9c87 and project 4478d0e315d948df9eda910f205646c3. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:56:30.101791 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-add69c68-4b44-4a35-ba4d-eecda395cd9e tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:56:30.105265 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-add69c68-4b44-4a35-ba4d-eecda395cd9e tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] [instance: 51e76f20-555e-4867-a42b-30727dc94169] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:56:30.141521 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8d381bc9-c158-4ccb-8dae-d6fd1876c86a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:30.156659 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8d381bc9-c158-4ccb-8dae-d6fd1876c86a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/85c5c938-83a1-4ca3-b9b1-b05d818f7efc" status: 200 len: 1267 microversion: 2.1 time: 0.450215 Sep 08 10:56:30.158129 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2088/4114] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:29 2022] GET /compute/v2.1/servers/85c5c938-83a1-4ca3-b9b1-b05d818f7efc => generated 1267 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:30.216899 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-add69c68-4b44-4a35-ba4d-eecda395cd9e tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.847938 Sep 08 10:56:30.217893 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2027/4115] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:56:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 2852 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:56:30.235424 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-d3d1e433-55bd-4e07-b7c1-501837e0bd50 req-4ad98403-0b95-4dd9-bfba-bcffcd88b865 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93d05d86-99b6-43f0-83c7-257ab64a12f3", "tag": "b7d2eec4-5d46-4733-a430-f161034305f1"}, {"name": "network-changed", "server_uuid": "93d05d86-99b6-43f0-83c7-257ab64a12f3", "tag": "b7d2eec4-5d46-4733-a430-f161034305f1"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:56:30.264127 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d3d1e433-55bd-4e07-b7c1-501837e0bd50 req-4ad98403-0b95-4dd9-bfba-bcffcd88b865 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:30.268968 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d3d1e433-55bd-4e07-b7c1-501837e0bd50 req-4ad98403-0b95-4dd9-bfba-bcffcd88b865 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:30.269658 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d3d1e433-55bd-4e07-b7c1-501837e0bd50 req-4ad98403-0b95-4dd9-bfba-bcffcd88b865 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:30.300949 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-d3d1e433-55bd-4e07-b7c1-501837e0bd50 req-4ad98403-0b95-4dd9-bfba-bcffcd88b865 service nova] Creating event network-changed:b7d2eec4-5d46-4733-a430-f161034305f1 for instance 93d05d86-99b6-43f0-83c7-257ab64a12f3 on n-h2-850501-12 Sep 08 10:56:30.301752 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-d3d1e433-55bd-4e07-b7c1-501837e0bd50 req-4ad98403-0b95-4dd9-bfba-bcffcd88b865 service nova] Creating event network-changed:b7d2eec4-5d46-4733-a430-f161034305f1 for instance 93d05d86-99b6-43f0-83c7-257ab64a12f3 on n-h2-850501-12 Sep 08 10:56:30.312224 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-d3d1e433-55bd-4e07-b7c1-501837e0bd50 req-4ad98403-0b95-4dd9-bfba-bcffcd88b865 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.085946 Sep 08 10:56:30.318761 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2028/4116] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:56:30 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:56:30.331492 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a548fd9b-c82e-4c2d-aa65-c2f14280b37a tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:30.332316 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a548fd9b-c82e-4c2d-aa65-c2f14280b37a tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] [instance: 51e76f20-555e-4867-a42b-30727dc94169] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:30.500948 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-af21d9eb-3c4f-405e-970b-65ca0a9d9855 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-35532777", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "fddcc482-f97a-435a-9555-c38424cb6290"}]}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:56:30.517405 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a548fd9b-c82e-4c2d-aa65-c2f14280b37a tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a779e85e1c493985f7cfe8aceb9c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4478d0e315d948df9eda910f205646c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:30.526162 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a548fd9b-c82e-4c2d-aa65-c2f14280b37a tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] 10.222.0.27 "GET /compute/v2.1/servers/51e76f20-555e-4867-a42b-30727dc94169" status: 200 len: 1221 microversion: 2.1 time: 0.205470 Sep 08 10:56:30.526767 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2029/4117] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:30 2022] GET /compute/v2.1/servers/51e76f20-555e-4867-a42b-30727dc94169 => generated 1221 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:30.584262 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-af21d9eb-3c4f-405e-970b-65ca0a9d9855 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] validate_networks() for [('fddcc482-f97a-435a-9555-c38424cb6290', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:56:30.727763 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c7dab3ab-c844-4486-9ff7-38ba1e9b7d37 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:30.728864 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c7dab3ab-c844-4486-9ff7-38ba1e9b7d37 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:30.740542 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c7dab3ab-c844-4486-9ff7-38ba1e9b7d37 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:30.749931 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c7dab3ab-c844-4486-9ff7-38ba1e9b7d37 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:30.750690 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c7dab3ab-c844-4486-9ff7-38ba1e9b7d37 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:30.751642 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c7dab3ab-c844-4486-9ff7-38ba1e9b7d37 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:30.752298 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c7dab3ab-c844-4486-9ff7-38ba1e9b7d37 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:30.752953 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c7dab3ab-c844-4486-9ff7-38ba1e9b7d37 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:31.491695 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c7dab3ab-c844-4486-9ff7-38ba1e9b7d37 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:31.506487 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c7dab3ab-c844-4486-9ff7-38ba1e9b7d37 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1508 microversion: 2.1 time: 0.777087 Sep 08 10:56:31.508091 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2030/4118] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:30 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1508 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:56:31.518633 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e5a563f3-a1e2-4ca2-8b82-4b4f1117bade tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:31.519589 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e5a563f3-a1e2-4ca2-8b82-4b4f1117bade tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 85c5c938-83a1-4ca3-b9b1-b05d818f7efc] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:31.534675 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e5a563f3-a1e2-4ca2-8b82-4b4f1117bade tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:31.538840 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e5a563f3-a1e2-4ca2-8b82-4b4f1117bade tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:31.539506 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e5a563f3-a1e2-4ca2-8b82-4b4f1117bade tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:31.540662 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e5a563f3-a1e2-4ca2-8b82-4b4f1117bade tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:31.541763 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e5a563f3-a1e2-4ca2-8b82-4b4f1117bade tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:31.543030 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e5a563f3-a1e2-4ca2-8b82-4b4f1117bade tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:31.726096 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e5a563f3-a1e2-4ca2-8b82-4b4f1117bade tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:31.733076 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:56:31.739014 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e5a563f3-a1e2-4ca2-8b82-4b4f1117bade tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/85c5c938-83a1-4ca3-b9b1-b05d818f7efc" status: 200 len: 1273 microversion: 2.1 time: 0.229686 Sep 08 10:56:31.739606 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2031/4119] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:31 2022] GET /compute/v2.1/servers/85c5c938-83a1-4ca3-b9b1-b05d818f7efc => generated 1273 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:31.754542 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-aed0c1fe-222e-4bb2-92af-4d4e1e493253 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:31.758207 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-aed0c1fe-222e-4bb2-92af-4d4e1e493253 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] [instance: 51e76f20-555e-4867-a42b-30727dc94169] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:31.767936 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aed0c1fe-222e-4bb2-92af-4d4e1e493253 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:31.768893 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aed0c1fe-222e-4bb2-92af-4d4e1e493253 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:31.769579 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aed0c1fe-222e-4bb2-92af-4d4e1e493253 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:31.770535 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aed0c1fe-222e-4bb2-92af-4d4e1e493253 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:31.771202 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aed0c1fe-222e-4bb2-92af-4d4e1e493253 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:31.773325 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aed0c1fe-222e-4bb2-92af-4d4e1e493253 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:31.988764 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-aed0c1fe-222e-4bb2-92af-4d4e1e493253 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a779e85e1c493985f7cfe8aceb9c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4478d0e315d948df9eda910f205646c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:31.998842 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-aed0c1fe-222e-4bb2-92af-4d4e1e493253 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] 10.222.0.27 "GET /compute/v2.1/servers/51e76f20-555e-4867-a42b-30727dc94169" status: 200 len: 1273 microversion: 2.1 time: 0.257977 Sep 08 10:56:32.000423 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2032/4120] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:31 2022] GET /compute/v2.1/servers/51e76f20-555e-4867-a42b-30727dc94169 => generated 1273 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:32.149536 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-171c8e4b-9e5c-4f50-8454-c8a73230bfa8 req-ba1fd762-adde-4f59-846b-3907716ded6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "931569b4-139a-4939-abf3-49a589eb1d91", "tag": "5479ce77-c509-4787-8670-94752e80b0c7"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:56:32.171514 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-171c8e4b-9e5c-4f50-8454-c8a73230bfa8 req-ba1fd762-adde-4f59-846b-3907716ded6e service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:32.176088 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-171c8e4b-9e5c-4f50-8454-c8a73230bfa8 req-ba1fd762-adde-4f59-846b-3907716ded6e service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:32.176780 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-171c8e4b-9e5c-4f50-8454-c8a73230bfa8 req-ba1fd762-adde-4f59-846b-3907716ded6e service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:32.193932 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-171c8e4b-9e5c-4f50-8454-c8a73230bfa8 req-ba1fd762-adde-4f59-846b-3907716ded6e service nova] Creating event network-changed:5479ce77-c509-4787-8670-94752e80b0c7 for instance 931569b4-139a-4939-abf3-49a589eb1d91 on n-h1-850501-12 Sep 08 10:56:32.206297 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-171c8e4b-9e5c-4f50-8454-c8a73230bfa8 req-ba1fd762-adde-4f59-846b-3907716ded6e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064227 Sep 08 10:56:32.207326 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2033/4121] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:56:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:56:32.534543 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-51cbd5d6-2af7-48c9-b6ee-f4dd698f8a5e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:32.536902 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-51cbd5d6-2af7-48c9-b6ee-f4dd698f8a5e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:32.558601 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51cbd5d6-2af7-48c9-b6ee-f4dd698f8a5e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:32.559130 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51cbd5d6-2af7-48c9-b6ee-f4dd698f8a5e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:32.561596 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51cbd5d6-2af7-48c9-b6ee-f4dd698f8a5e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:32.561596 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51cbd5d6-2af7-48c9-b6ee-f4dd698f8a5e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:32.561915 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51cbd5d6-2af7-48c9-b6ee-f4dd698f8a5e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:32.562802 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51cbd5d6-2af7-48c9-b6ee-f4dd698f8a5e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:32.935587 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-51cbd5d6-2af7-48c9-b6ee-f4dd698f8a5e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:32.948063 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-51cbd5d6-2af7-48c9-b6ee-f4dd698f8a5e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1508 microversion: 2.1 time: 0.418932 Sep 08 10:56:32.955537 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2034/4122] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:32 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1508 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:56:32.994137 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-02b62604-ba5a-42cf-beaf-81c322d39c3a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:32.996600 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-02b62604-ba5a-42cf-beaf-81c322d39c3a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 85c5c938-83a1-4ca3-b9b1-b05d818f7efc] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:33.012024 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02b62604-ba5a-42cf-beaf-81c322d39c3a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:33.013556 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02b62604-ba5a-42cf-beaf-81c322d39c3a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:33.016870 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02b62604-ba5a-42cf-beaf-81c322d39c3a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:33.018013 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02b62604-ba5a-42cf-beaf-81c322d39c3a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:33.022483 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02b62604-ba5a-42cf-beaf-81c322d39c3a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:33.026792 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02b62604-ba5a-42cf-beaf-81c322d39c3a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:33.229132 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-02b62604-ba5a-42cf-beaf-81c322d39c3a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:33.243476 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-02b62604-ba5a-42cf-beaf-81c322d39c3a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/85c5c938-83a1-4ca3-b9b1-b05d818f7efc" status: 200 len: 1273 microversion: 2.1 time: 0.286445 Sep 08 10:56:33.244078 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2035/4123] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:32 2022] GET /compute/v2.1/servers/85c5c938-83a1-4ca3-b9b1-b05d818f7efc => generated 1273 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:33.257511 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-26ba05f6-8c74-48a8-ace6-ccc9758baeb6 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:33.258465 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-26ba05f6-8c74-48a8-ace6-ccc9758baeb6 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] [instance: 51e76f20-555e-4867-a42b-30727dc94169] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:33.276093 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-26ba05f6-8c74-48a8-ace6-ccc9758baeb6 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:33.277192 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-26ba05f6-8c74-48a8-ace6-ccc9758baeb6 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:33.278789 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-26ba05f6-8c74-48a8-ace6-ccc9758baeb6 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:33.279743 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-26ba05f6-8c74-48a8-ace6-ccc9758baeb6 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:33.282280 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-26ba05f6-8c74-48a8-ace6-ccc9758baeb6 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:33.282951 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-26ba05f6-8c74-48a8-ace6-ccc9758baeb6 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:33.495129 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-26ba05f6-8c74-48a8-ace6-ccc9758baeb6 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a779e85e1c493985f7cfe8aceb9c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4478d0e315d948df9eda910f205646c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:33.517083 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-26ba05f6-8c74-48a8-ace6-ccc9758baeb6 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] 10.222.0.27 "GET /compute/v2.1/servers/51e76f20-555e-4867-a42b-30727dc94169" status: 200 len: 1273 microversion: 2.1 time: 0.264803 Sep 08 10:56:33.523066 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2036/4124] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:33 2022] GET /compute/v2.1/servers/51e76f20-555e-4867-a42b-30727dc94169 => generated 1273 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:33.539907 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4063026e-91f6-429e-a8f1-7c801db8fab4 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:33.539907 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4063026e-91f6-429e-a8f1-7c801db8fab4 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:33.572480 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4063026e-91f6-429e-a8f1-7c801db8fab4 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:33.573272 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4063026e-91f6-429e-a8f1-7c801db8fab4 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:33.573730 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4063026e-91f6-429e-a8f1-7c801db8fab4 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:33.574480 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4063026e-91f6-429e-a8f1-7c801db8fab4 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:33.575514 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4063026e-91f6-429e-a8f1-7c801db8fab4 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:33.575948 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4063026e-91f6-429e-a8f1-7c801db8fab4 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:33.609259 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-4063026e-91f6-429e-a8f1-7c801db8fab4 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] HTTP exception thrown: Instance 98277784-8e48-4a7b-8786-ce579e1d5ccf could not be found. Sep 08 10:56:33.611105 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4063026e-91f6-429e-a8f1-7c801db8fab4 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Request method failure captured: Sep 08 10:56:33.611105 n-d-850501-12 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf HTTP/1.1 Sep 08 10:56:33.611105 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:56:33.611105 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:56:33.611105 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:56:33.611105 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:56:33.611105 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:56:33.611105 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:56:33.611105 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:56:33.611105 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:56:33.611105 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGciCxGmkU2lR8vtcZsVRYJ6XitHjr0LEEa7l3XJj4sj1DyTmB4LIp3zsJ7Sf-tMXEoiMS1GjnYdwcUnIXxaDj9pKL-zBWQYbLdXnhkuNOTTgIH6lsqDIjTl-3WORoE1ZaSQhUlCsPf1vQejvThe4R2bjlVFm0M4EY7cMg56kFkqbBAQ Sep 08 10:56:33.611105 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:56:33.611105 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:56:33.611105 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:56:33.611105 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:56:33.611105 n-d-850501-12 devstack@n-api.service[128862]: X-Openstack-Nova-Api-Version: 2.32 Sep 08 10:56:33.611105 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:56:33.611105 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:56:33.611105 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: bf115ce61d864726b0e6e6b28c6ac69a Sep 08 10:56:33.611105 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-TaggedBootDevicesTest-1345534377 Sep 08 10:56:33.611105 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:56:33.611105 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:56:33.611105 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bf115ce61d864726b0e6e6b28c6ac69a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bf115ce61d864726b0e6e6b28c6ac69a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bf115ce61d864726b0e6e6b28c6ac69a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bf115ce61d864726b0e6e6b28c6ac69a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:56:33.611105 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-TaggedBootDevicesTest-1345534377 Sep 08 10:56:33.611105 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: bf115ce61d864726b0e6e6b28c6ac69a Sep 08 10:56:33.611105 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1345534377 Sep 08 10:56:33.611105 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-TaggedBootDevicesTest-1345534377-project Sep 08 10:56:33.611105 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:56:33.611105 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:56:33.611105 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 72c4838df30441628becfb4e61778366 Sep 08 10:56:33.611105 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-TaggedBootDevicesTest-1345534377-project Sep 08 10:56:33.611105 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:56:33.611105 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 98277784-8e48-4a7b-8786-ce579e1d5ccf could not be found. Sep 08 10:56:33.611105 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '98277784-8e48-4a7b-8786-ce579e1d5ccf'} Sep 08 10:56:33.611105 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:56:33.611105 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:56:33.611105 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:56:33.611105 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:56:33.611105 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:56:33.611105 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:56:33.611105 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:56:33.611105 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:56:33.611105 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:56:33.611105 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:56:33.611105 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98277784-8e48-4a7b-8786-ce579e1d5ccf could not be found. Sep 08 10:56:33.611105 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:56:33.611105 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:56:33.611105 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:56:33.611105 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:56:33.611105 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:56:33.611105 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:56:33.611105 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:56:33.611105 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:56:33.611105 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:56:33.611105 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:56:33.611105 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:56:33.611105 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:56:33.611105 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:56:33.611105 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:56:33.611105 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:56:33.611105 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:56:33.611105 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:56:33.611105 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:56:33.615914 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98277784-8e48-4a7b-8786-ce579e1d5ccf could not be found. Sep 08 10:56:33.615914 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:56:33.615914 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:56:33.615914 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:56:33.615914 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:56:33.615914 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:56:33.615914 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:56:33.615914 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:56:33.615914 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:56:33.615914 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98277784-8e48-4a7b-8786-ce579e1d5ccf could not be found. Sep 08 10:56:33.615914 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:56:33.615914 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4063026e-91f6-429e-a8f1-7c801db8fab4 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Returning 404 to user: Instance 98277784-8e48-4a7b-8786-ce579e1d5ccf could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:56:33.615914 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4063026e-91f6-429e-a8f1-7c801db8fab4 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "DELETE /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 404 len: 111 microversion: 2.32 time: 0.083440 Sep 08 10:56:33.618835 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2037/4125] 10.222.0.27 () {60 vars in 1280 bytes} [Thu Sep 8 10:56:33 2022] DELETE /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:56:33.631684 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-94d9ddd3-6336-422f-b313-e79be0bb02b7 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:33.633930 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-94d9ddd3-6336-422f-b313-e79be0bb02b7 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] [instance: 98277784-8e48-4a7b-8786-ce579e1d5ccf] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:33.648512 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94d9ddd3-6336-422f-b313-e79be0bb02b7 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:33.654155 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94d9ddd3-6336-422f-b313-e79be0bb02b7 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:33.657539 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94d9ddd3-6336-422f-b313-e79be0bb02b7 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:33.659883 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94d9ddd3-6336-422f-b313-e79be0bb02b7 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:33.663871 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94d9ddd3-6336-422f-b313-e79be0bb02b7 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:33.664525 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94d9ddd3-6336-422f-b313-e79be0bb02b7 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:33.705620 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-94d9ddd3-6336-422f-b313-e79be0bb02b7 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] HTTP exception thrown: Instance 98277784-8e48-4a7b-8786-ce579e1d5ccf could not be found. Sep 08 10:56:33.707994 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-94d9ddd3-6336-422f-b313-e79be0bb02b7 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Request method failure captured: Sep 08 10:56:33.707994 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf HTTP/1.1 Sep 08 10:56:33.707994 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:56:33.707994 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:56:33.707994 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:56:33.707994 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:56:33.707994 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:56:33.707994 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:56:33.707994 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:56:33.707994 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:56:33.707994 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGciCxGmkU2lR8vtcZsVRYJ6XitHjr0LEEa7l3XJj4sj1DyTmB4LIp3zsJ7Sf-tMXEoiMS1GjnYdwcUnIXxaDj9pKL-zBWQYbLdXnhkuNOTTgIH6lsqDIjTl-3WORoE1ZaSQhUlCsPf1vQejvThe4R2bjlVFm0M4EY7cMg56kFkqbBAQ Sep 08 10:56:33.707994 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:56:33.707994 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:56:33.707994 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:56:33.707994 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:56:33.707994 n-d-850501-12 devstack@n-api.service[128862]: X-Openstack-Nova-Api-Version: 2.32 Sep 08 10:56:33.707994 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:56:33.707994 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:56:33.707994 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: bf115ce61d864726b0e6e6b28c6ac69a Sep 08 10:56:33.707994 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-TaggedBootDevicesTest-1345534377 Sep 08 10:56:33.707994 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:56:33.707994 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:56:33.707994 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bf115ce61d864726b0e6e6b28c6ac69a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bf115ce61d864726b0e6e6b28c6ac69a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bf115ce61d864726b0e6e6b28c6ac69a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bf115ce61d864726b0e6e6b28c6ac69a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:56:33.707994 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-TaggedBootDevicesTest-1345534377 Sep 08 10:56:33.707994 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: bf115ce61d864726b0e6e6b28c6ac69a Sep 08 10:56:33.707994 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1345534377 Sep 08 10:56:33.707994 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-TaggedBootDevicesTest-1345534377-project Sep 08 10:56:33.707994 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:56:33.707994 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:56:33.707994 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 72c4838df30441628becfb4e61778366 Sep 08 10:56:33.707994 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-TaggedBootDevicesTest-1345534377-project Sep 08 10:56:33.707994 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:56:33.707994 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 98277784-8e48-4a7b-8786-ce579e1d5ccf could not be found. Sep 08 10:56:33.707994 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '98277784-8e48-4a7b-8786-ce579e1d5ccf'} Sep 08 10:56:33.707994 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:56:33.707994 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:56:33.707994 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:56:33.707994 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:56:33.707994 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:56:33.707994 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:56:33.707994 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:56:33.707994 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:56:33.707994 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:56:33.707994 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:56:33.707994 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98277784-8e48-4a7b-8786-ce579e1d5ccf could not be found. Sep 08 10:56:33.707994 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:56:33.707994 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:56:33.707994 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:56:33.707994 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:56:33.707994 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:56:33.707994 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:56:33.707994 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:56:33.707994 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:56:33.707994 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:56:33.707994 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:56:33.707994 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:56:33.707994 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:56:33.707994 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:56:33.707994 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:56:33.707994 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:56:33.707994 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:56:33.707994 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98277784-8e48-4a7b-8786-ce579e1d5ccf could not be found. Sep 08 10:56:33.707994 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:56:33.707994 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:56:33.712922 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:56:33.712922 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:56:33.712922 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:56:33.712922 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:56:33.712922 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:56:33.712922 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:56:33.712922 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98277784-8e48-4a7b-8786-ce579e1d5ccf could not be found. Sep 08 10:56:33.712922 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:56:33.719167 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-94d9ddd3-6336-422f-b313-e79be0bb02b7 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] Returning 404 to user: Instance 98277784-8e48-4a7b-8786-ce579e1d5ccf could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:56:33.721675 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-94d9ddd3-6336-422f-b313-e79be0bb02b7 tempest-TaggedBootDevicesTest-1345534377 tempest-TaggedBootDevicesTest-1345534377-project] 10.222.0.27 "GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf" status: 404 len: 111 microversion: 2.32 time: 0.093955 Sep 08 10:56:33.728636 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2038/4126] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:56:33 2022] GET /compute/v2.1/servers/98277784-8e48-4a7b-8786-ce579e1d5ccf => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:56:33.983067 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-af21d9eb-3c4f-405e-970b-65ca0a9d9855 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:56:34.006242 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7cdb022e-fd4d-4758-9e65-55ddf2758ed1 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:34.007028 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-af21d9eb-3c4f-405e-970b-65ca0a9d9855 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:56:34.007756 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-af21d9eb-3c4f-405e-970b-65ca0a9d9855 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:56:34.008271 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-af21d9eb-3c4f-405e-970b-65ca0a9d9855 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:56:34.008804 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-af21d9eb-3c4f-405e-970b-65ca0a9d9855 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:56:34.009945 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7cdb022e-fd4d-4758-9e65-55ddf2758ed1 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:34.034063 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7cdb022e-fd4d-4758-9e65-55ddf2758ed1 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:34.036137 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7cdb022e-fd4d-4758-9e65-55ddf2758ed1 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:34.038053 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7cdb022e-fd4d-4758-9e65-55ddf2758ed1 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:34.042052 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7cdb022e-fd4d-4758-9e65-55ddf2758ed1 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:34.042887 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7cdb022e-fd4d-4758-9e65-55ddf2758ed1 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:34.044798 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7cdb022e-fd4d-4758-9e65-55ddf2758ed1 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:34.046752 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-af21d9eb-3c4f-405e-970b-65ca0a9d9855 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:34.050561 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-af21d9eb-3c4f-405e-970b-65ca0a9d9855 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:34.056485 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-af21d9eb-3c4f-405e-970b-65ca0a9d9855 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:34.060164 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-af21d9eb-3c4f-405e-970b-65ca0a9d9855 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:34.060662 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-af21d9eb-3c4f-405e-970b-65ca0a9d9855 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:34.061237 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-af21d9eb-3c4f-405e-970b-65ca0a9d9855 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:34.128360 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-af21d9eb-3c4f-405e-970b-65ca0a9d9855 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Getting quotas for project b7d73ca665b94264a22f7bae7d799cff. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:56:34.149063 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-af21d9eb-3c4f-405e-970b-65ca0a9d9855 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Getting quotas for user 6e7177ce97ae4fad81993ec8597cfe2d and project b7d73ca665b94264a22f7bae7d799cff. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:56:34.203120 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-af21d9eb-3c4f-405e-970b-65ca0a9d9855 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:56:34.216767 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-af21d9eb-3c4f-405e-970b-65ca0a9d9855 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] [instance: 7c2e066a-8160-4bcd-80be-33091a3e0fac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:56:34.358979 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-af21d9eb-3c4f-405e-970b-65ca0a9d9855 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.199534 Sep 08 10:56:34.366254 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2089/4127] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:56:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 4207 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:56:34.385122 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-9a32070b-8686-48b3-b00d-a4e9b59c92b4 req-1855aa51-fdff-42e2-ad7d-09488a4dbf45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74eebde7-4328-4ddf-be14-bb9fba70ec03", "name": "network-vif-unplugged", "status": "completed", "tag": "15f823c3-a4f6-4444-a294-abb10fd52df7"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:56:34.395672 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-9a32070b-8686-48b3-b00d-a4e9b59c92b4 req-1855aa51-fdff-42e2-ad7d-09488a4dbf45 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:34.396160 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-9a32070b-8686-48b3-b00d-a4e9b59c92b4 req-1855aa51-fdff-42e2-ad7d-09488a4dbf45 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:34.396594 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-9a32070b-8686-48b3-b00d-a4e9b59c92b4 req-1855aa51-fdff-42e2-ad7d-09488a4dbf45 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:34.423749 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-9a32070b-8686-48b3-b00d-a4e9b59c92b4 req-1855aa51-fdff-42e2-ad7d-09488a4dbf45 service nova] Creating event network-vif-unplugged:15f823c3-a4f6-4444-a294-abb10fd52df7 for instance 74eebde7-4328-4ddf-be14-bb9fba70ec03 on n-h1-850501-12 Sep 08 10:56:34.438190 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-9a32070b-8686-48b3-b00d-a4e9b59c92b4 req-1855aa51-fdff-42e2-ad7d-09488a4dbf45 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070499 Sep 08 10:56:34.439422 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2090/4128] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:56:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:56:34.454163 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-220a5b70-a344-402a-a8dc-f52ece8a8329 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:34.457662 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-220a5b70-a344-402a-a8dc-f52ece8a8329 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 85c5c938-83a1-4ca3-b9b1-b05d818f7efc] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:34.479436 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-220a5b70-a344-402a-a8dc-f52ece8a8329 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:34.479942 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-220a5b70-a344-402a-a8dc-f52ece8a8329 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:34.480391 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-220a5b70-a344-402a-a8dc-f52ece8a8329 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:34.481667 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-220a5b70-a344-402a-a8dc-f52ece8a8329 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:34.482203 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-220a5b70-a344-402a-a8dc-f52ece8a8329 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:34.485923 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-220a5b70-a344-402a-a8dc-f52ece8a8329 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:34.877413 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7cdb022e-fd4d-4758-9e65-55ddf2758ed1 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:34.891731 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7cdb022e-fd4d-4758-9e65-55ddf2758ed1 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1508 microversion: 2.1 time: 0.913311 Sep 08 10:56:34.896870 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2039/4129] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:33 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1508 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:34.914277 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-80670cf8-c087-4468-9c8d-d249a1a6072c tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:34.919340 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-80670cf8-c087-4468-9c8d-d249a1a6072c tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] [instance: 7c2e066a-8160-4bcd-80be-33091a3e0fac] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:35.182048 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-80670cf8-c087-4468-9c8d-d249a1a6072c tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7177ce97ae4fad81993ec8597cfe2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d73ca665b94264a22f7bae7d799cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:35.208399 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-80670cf8-c087-4468-9c8d-d249a1a6072c tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] 10.222.0.27 "GET /compute/v2.1/servers/7c2e066a-8160-4bcd-80be-33091a3e0fac" status: 200 len: 1214 microversion: 2.1 time: 0.309972 Sep 08 10:56:35.210855 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2040/4130] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:34 2022] GET /compute/v2.1/servers/7c2e066a-8160-4bcd-80be-33091a3e0fac => generated 1214 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:35.234040 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dfd6a028-ff2e-4ca2-a1b7-fe1928809eb3 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:35.235420 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-dfd6a028-ff2e-4ca2-a1b7-fe1928809eb3 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] [instance: 51e76f20-555e-4867-a42b-30727dc94169] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:35.255599 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dfd6a028-ff2e-4ca2-a1b7-fe1928809eb3 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:35.266358 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dfd6a028-ff2e-4ca2-a1b7-fe1928809eb3 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:35.271489 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dfd6a028-ff2e-4ca2-a1b7-fe1928809eb3 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:35.272605 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dfd6a028-ff2e-4ca2-a1b7-fe1928809eb3 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:35.273352 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dfd6a028-ff2e-4ca2-a1b7-fe1928809eb3 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:35.273894 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dfd6a028-ff2e-4ca2-a1b7-fe1928809eb3 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:35.761697 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-dfd6a028-ff2e-4ca2-a1b7-fe1928809eb3 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a779e85e1c493985f7cfe8aceb9c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4478d0e315d948df9eda910f205646c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:35.784780 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-dfd6a028-ff2e-4ca2-a1b7-fe1928809eb3 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] 10.222.0.27 "GET /compute/v2.1/servers/51e76f20-555e-4867-a42b-30727dc94169" status: 200 len: 1279 microversion: 2.1 time: 0.572133 Sep 08 10:56:35.787379 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2041/4131] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:35 2022] GET /compute/v2.1/servers/51e76f20-555e-4867-a42b-30727dc94169 => generated 1279 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:35.925317 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f2fbe3a9-6cb7-4841-88f7-91ca768d2d24 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:35.925935 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f2fbe3a9-6cb7-4841-88f7-91ca768d2d24 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:35.935113 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f2fbe3a9-6cb7-4841-88f7-91ca768d2d24 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:35.938991 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f2fbe3a9-6cb7-4841-88f7-91ca768d2d24 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:35.939760 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f2fbe3a9-6cb7-4841-88f7-91ca768d2d24 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:35.942870 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f2fbe3a9-6cb7-4841-88f7-91ca768d2d24 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:35.946797 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f2fbe3a9-6cb7-4841-88f7-91ca768d2d24 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:35.947455 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f2fbe3a9-6cb7-4841-88f7-91ca768d2d24 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:36.009320 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-220a5b70-a344-402a-a8dc-f52ece8a8329 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:36.018168 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-220a5b70-a344-402a-a8dc-f52ece8a8329 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/85c5c938-83a1-4ca3-b9b1-b05d818f7efc" status: 200 len: 1315 microversion: 2.1 time: 1.577277 Sep 08 10:56:36.021437 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2091/4132] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:34 2022] GET /compute/v2.1/servers/85c5c938-83a1-4ca3-b9b1-b05d818f7efc => generated 1315 bytes in 1581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:36.237874 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-74eb4fdc-7fdd-44af-b96b-19a40d47ec29 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:36.238564 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-74eb4fdc-7fdd-44af-b96b-19a40d47ec29 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] [instance: 7c2e066a-8160-4bcd-80be-33091a3e0fac] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:36.251083 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-74eb4fdc-7fdd-44af-b96b-19a40d47ec29 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:36.251378 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-74eb4fdc-7fdd-44af-b96b-19a40d47ec29 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:36.260911 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-74eb4fdc-7fdd-44af-b96b-19a40d47ec29 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:36.262165 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-74eb4fdc-7fdd-44af-b96b-19a40d47ec29 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:36.262561 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-74eb4fdc-7fdd-44af-b96b-19a40d47ec29 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:36.263012 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-74eb4fdc-7fdd-44af-b96b-19a40d47ec29 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:36.534945 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-74eb4fdc-7fdd-44af-b96b-19a40d47ec29 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7177ce97ae4fad81993ec8597cfe2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d73ca665b94264a22f7bae7d799cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:36.547364 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-74eb4fdc-7fdd-44af-b96b-19a40d47ec29 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] 10.222.0.27 "GET /compute/v2.1/servers/7c2e066a-8160-4bcd-80be-33091a3e0fac" status: 200 len: 1266 microversion: 2.1 time: 0.313229 Sep 08 10:56:36.557719 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2092/4133] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:36 2022] GET /compute/v2.1/servers/7c2e066a-8160-4bcd-80be-33091a3e0fac => generated 1266 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:56:36.810171 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a54a7038-706e-474c-9a48-5c5591652136 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:36.810799 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a54a7038-706e-474c-9a48-5c5591652136 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] [instance: 51e76f20-555e-4867-a42b-30727dc94169] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:36.818833 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a54a7038-706e-474c-9a48-5c5591652136 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:36.823884 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a54a7038-706e-474c-9a48-5c5591652136 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:36.825141 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a54a7038-706e-474c-9a48-5c5591652136 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:36.826068 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a54a7038-706e-474c-9a48-5c5591652136 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:36.826710 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a54a7038-706e-474c-9a48-5c5591652136 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:36.827322 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a54a7038-706e-474c-9a48-5c5591652136 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:37.017795 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a54a7038-706e-474c-9a48-5c5591652136 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a779e85e1c493985f7cfe8aceb9c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4478d0e315d948df9eda910f205646c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:37.031260 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a54a7038-706e-474c-9a48-5c5591652136 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] 10.222.0.27 "GET /compute/v2.1/servers/51e76f20-555e-4867-a42b-30727dc94169" status: 200 len: 1279 microversion: 2.1 time: 0.225125 Sep 08 10:56:37.031870 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2093/4134] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:36 2022] GET /compute/v2.1/servers/51e76f20-555e-4867-a42b-30727dc94169 => generated 1279 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:56:37.052236 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fb4a89b2-95d4-47fa-bc9a-c25089e7551e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:37.052856 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fb4a89b2-95d4-47fa-bc9a-c25089e7551e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 85c5c938-83a1-4ca3-b9b1-b05d818f7efc] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:37.068734 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb4a89b2-95d4-47fa-bc9a-c25089e7551e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:37.069249 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb4a89b2-95d4-47fa-bc9a-c25089e7551e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:37.069868 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb4a89b2-95d4-47fa-bc9a-c25089e7551e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:37.070730 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb4a89b2-95d4-47fa-bc9a-c25089e7551e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:37.071995 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb4a89b2-95d4-47fa-bc9a-c25089e7551e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:37.072591 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb4a89b2-95d4-47fa-bc9a-c25089e7551e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:37.373745 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f2fbe3a9-6cb7-4841-88f7-91ca768d2d24 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:37.388197 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f2fbe3a9-6cb7-4841-88f7-91ca768d2d24 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1451 microversion: 2.1 time: 1.465262 Sep 08 10:56:37.390457 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2042/4135] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:35 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1451 bytes in 1470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:56:37.420634 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-60c607c9-039e-4e4f-969a-47aa8a97d753 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:37.423354 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-60c607c9-039e-4e4f-969a-47aa8a97d753 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:37.436091 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-60c607c9-039e-4e4f-969a-47aa8a97d753 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:37.437234 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-60c607c9-039e-4e4f-969a-47aa8a97d753 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:37.438488 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-60c607c9-039e-4e4f-969a-47aa8a97d753 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:37.440298 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-60c607c9-039e-4e4f-969a-47aa8a97d753 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:37.441008 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-60c607c9-039e-4e4f-969a-47aa8a97d753 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:37.441610 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-60c607c9-039e-4e4f-969a-47aa8a97d753 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:37.670696 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-fb4a89b2-95d4-47fa-bc9a-c25089e7551e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:37.682287 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fb4a89b2-95d4-47fa-bc9a-c25089e7551e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/85c5c938-83a1-4ca3-b9b1-b05d818f7efc" status: 200 len: 1315 microversion: 2.1 time: 0.633715 Sep 08 10:56:37.686984 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2094/4136] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:37 2022] GET /compute/v2.1/servers/85c5c938-83a1-4ca3-b9b1-b05d818f7efc => generated 1315 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:37.702163 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5f982649-5a06-4e51-9935-b4f6048d4578 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:37.703011 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5f982649-5a06-4e51-9935-b4f6048d4578 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] [instance: 7c2e066a-8160-4bcd-80be-33091a3e0fac] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:37.710679 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5f982649-5a06-4e51-9935-b4f6048d4578 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:37.715047 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5f982649-5a06-4e51-9935-b4f6048d4578 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:37.716541 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5f982649-5a06-4e51-9935-b4f6048d4578 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:37.718152 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5f982649-5a06-4e51-9935-b4f6048d4578 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:37.721853 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5f982649-5a06-4e51-9935-b4f6048d4578 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:37.722574 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5f982649-5a06-4e51-9935-b4f6048d4578 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:37.940081 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5f982649-5a06-4e51-9935-b4f6048d4578 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7177ce97ae4fad81993ec8597cfe2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d73ca665b94264a22f7bae7d799cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:37.964237 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5f982649-5a06-4e51-9935-b4f6048d4578 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] 10.222.0.27 "GET /compute/v2.1/servers/7c2e066a-8160-4bcd-80be-33091a3e0fac" status: 200 len: 1272 microversion: 2.1 time: 0.274402 Sep 08 10:56:37.966579 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2095/4137] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:37 2022] GET /compute/v2.1/servers/7c2e066a-8160-4bcd-80be-33091a3e0fac => generated 1272 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:37.989708 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-192796aa-dc52-4ae2-9bea-799c294566c8 req-e8a5af73-637f-41c3-a632-a346b8722026 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13039f8f-105b-4bb5-b632-753e183d2f1a", "tag": "aad9298d-af3f-4e11-966b-2f2a4bcaeb62"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:56:38.005275 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-192796aa-dc52-4ae2-9bea-799c294566c8 req-e8a5af73-637f-41c3-a632-a346b8722026 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:38.009435 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-192796aa-dc52-4ae2-9bea-799c294566c8 req-e8a5af73-637f-41c3-a632-a346b8722026 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:38.010207 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-192796aa-dc52-4ae2-9bea-799c294566c8 req-e8a5af73-637f-41c3-a632-a346b8722026 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:38.049844 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-192796aa-dc52-4ae2-9bea-799c294566c8 req-e8a5af73-637f-41c3-a632-a346b8722026 service nova] Creating event network-changed:aad9298d-af3f-4e11-966b-2f2a4bcaeb62 for instance 13039f8f-105b-4bb5-b632-753e183d2f1a on n-h2-850501-12 Sep 08 10:56:38.054727 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-60c607c9-039e-4e4f-969a-47aa8a97d753 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:38.067716 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-60c607c9-039e-4e4f-969a-47aa8a97d753 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1451 microversion: 2.1 time: 0.655926 Sep 08 10:56:38.082668 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2043/4138] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:37 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1451 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:38.082668 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b851507f-f56c-4a2a-b55a-0b9fa1e2fce4 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:38.082668 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b851507f-f56c-4a2a-b55a-0b9fa1e2fce4 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] [instance: 51e76f20-555e-4867-a42b-30727dc94169] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:38.083275 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-192796aa-dc52-4ae2-9bea-799c294566c8 req-e8a5af73-637f-41c3-a632-a346b8722026 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110220 Sep 08 10:56:38.083275 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2096/4139] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:56:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:56:38.089933 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b851507f-f56c-4a2a-b55a-0b9fa1e2fce4 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:38.089933 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b851507f-f56c-4a2a-b55a-0b9fa1e2fce4 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:38.091110 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b851507f-f56c-4a2a-b55a-0b9fa1e2fce4 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:38.095931 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b851507f-f56c-4a2a-b55a-0b9fa1e2fce4 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:38.096426 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b851507f-f56c-4a2a-b55a-0b9fa1e2fce4 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:38.096868 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b851507f-f56c-4a2a-b55a-0b9fa1e2fce4 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:38.149609 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-31b0c505-b99a-4c29-8eb2-e825bcb53ce3 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:56:38.150340 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-31b0c505-b99a-4c29-8eb2-e825bcb53ce3 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:38.162040 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-31b0c505-b99a-4c29-8eb2-e825bcb53ce3 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:38.162554 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-31b0c505-b99a-4c29-8eb2-e825bcb53ce3 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:38.166062 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-31b0c505-b99a-4c29-8eb2-e825bcb53ce3 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:38.166885 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-31b0c505-b99a-4c29-8eb2-e825bcb53ce3 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:38.167368 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-31b0c505-b99a-4c29-8eb2-e825bcb53ce3 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:38.167799 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-31b0c505-b99a-4c29-8eb2-e825bcb53ce3 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:38.218654 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-31b0c505-b99a-4c29-8eb2-e825bcb53ce3 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lazy-loading 'flavor' on Instance uuid 74eebde7-4328-4ddf-be14-bb9fba70ec03 {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:56:38.249258 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-31b0c505-b99a-4c29-8eb2-e825bcb53ce3 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] HTTP exception thrown: Cannot 'shelve' instance 74eebde7-4328-4ddf-be14-bb9fba70ec03 while it is in vm_state shelved_offloaded Sep 08 10:56:38.254591 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-31b0c505-b99a-4c29-8eb2-e825bcb53ce3 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Request method failure captured: Sep 08 10:56:38.254591 n-d-850501-12 devstack@n-api.service[128861]: request: POST /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03/action HTTP/1.1 Sep 08 10:56:38.254591 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:56:38.254591 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:56:38.254591 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:56:38.254591 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 14 Sep 08 10:56:38.254591 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:56:38.254591 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:56:38.254591 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:56:38.254591 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:56:38.254591 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcmnspi0cCT_Ts_s7jcB6HjtEcdULbQPd_krJniB9lBsXpm1cXSOD-YMaJoaapHCxuCXz0q6Qe4WXufr5At6SSPw8ov8Oz1eUk-fSNbVp7WlOPycfCf5I6xwH7tfbsoefVfbTiDOfU9mTBl0Vs74qdfTniErHfQlEG4cAvAQl1-wMrs Sep 08 10:56:38.254591 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:56:38.254591 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:56:38.254591 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:56:38.254591 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:56:38.254591 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:56:38.254591 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:56:38.254591 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:56:38.254591 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:56:38.254591 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:56:38.254591 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:56:38.254591 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:56:38.254591 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:56:38.254591 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:56:38.254591 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:56:38.254591 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:56:38.254591 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:56:38.254591 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:56:38.254591 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 7f551e6fe34243c290a25b57ab26af19 Sep 08 10:56:38.254591 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:56:38.254591 n-d-850501-12 devstack@n-api.service[128861]: Sep 08 10:56:38.254591 n-d-850501-12 devstack@n-api.service[128861]: {"shelve": {}} Sep 08 10:56:38.254591 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:56:38.254591 n-d-850501-12 devstack@n-api.service[128861]: exception: Cannot 'shelve' instance 74eebde7-4328-4ddf-be14-bb9fba70ec03 while it is in vm_state shelved_offloaded Sep 08 10:56:38.254591 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '74eebde7-4328-4ddf-be14-bb9fba70ec03', 'body': {'shelve': {}}} Sep 08 10:56:38.254591 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:56:38.254591 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:56:38.254591 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Sep 08 10:56:38.254591 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Sep 08 10:56:38.254591 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 08 10:56:38.254591 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 08 10:56:38.254591 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 08 10:56:38.254591 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 08 10:56:38.254591 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 08 10:56:38.254591 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 08 10:56:38.254591 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 10:56:38.254591 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 10:56:38.254591 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 08 10:56:38.254591 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 08 10:56:38.254591 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 74eebde7-4328-4ddf-be14-bb9fba70ec03 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Sep 08 10:56:38.254591 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:56:38.254591 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:56:38.254591 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:56:38.254591 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:56:38.254591 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:56:38.254591 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:56:38.254591 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:56:38.254591 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:56:38.254591 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:56:38.254591 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:56:38.254591 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Sep 08 10:56:38.254591 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 08 10:56:38.254591 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 08 10:56:38.258537 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 08 10:56:38.258537 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 74eebde7-4328-4ddf-be14-bb9fba70ec03 while it is in vm_state shelved_offloaded Sep 08 10:56:38.258537 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:56:38.258537 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:56:38.258537 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:56:38.258537 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:56:38.258537 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:56:38.258537 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:56:38.258537 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:56:38.258537 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:56:38.258537 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 74eebde7-4328-4ddf-be14-bb9fba70ec03 while it is in vm_state shelved_offloaded Sep 08 10:56:38.258537 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:56:38.259744 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-31b0c505-b99a-4c29-8eb2-e825bcb53ce3 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Returning 409 to user: Cannot 'shelve' instance 74eebde7-4328-4ddf-be14-bb9fba70ec03 while it is in vm_state shelved_offloaded {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:56:38.264058 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-31b0c505-b99a-4c29-8eb2-e825bcb53ce3 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "POST /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03/action" status: 409 len: 155 microversion: 2.1 time: 0.119817 Sep 08 10:56:38.276418 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2097/4140] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:56:38 2022] POST /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03/action => generated 155 bytes in 134 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 08 10:56:38.283622 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fe763e71-48f2-4912-8334-0c8775683b1c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:56:38.284527 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fe763e71-48f2-4912-8334-0c8775683b1c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:38.292244 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fe763e71-48f2-4912-8334-0c8775683b1c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:38.292986 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fe763e71-48f2-4912-8334-0c8775683b1c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:38.293622 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fe763e71-48f2-4912-8334-0c8775683b1c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:38.294482 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fe763e71-48f2-4912-8334-0c8775683b1c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:38.295085 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fe763e71-48f2-4912-8334-0c8775683b1c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:38.295673 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fe763e71-48f2-4912-8334-0c8775683b1c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:38.339728 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fe763e71-48f2-4912-8334-0c8775683b1c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128861) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 08 10:56:38.462026 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fe763e71-48f2-4912-8334-0c8775683b1c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "POST /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03/action" status: 202 len: 0 microversion: 2.1 time: 0.182134 Sep 08 10:56:38.464961 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2098/4141] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:56:38 2022] POST /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:56:38.484712 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4f31b822-1786-473e-b118-234401dfc83c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:38.489236 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4f31b822-1786-473e-b118-234401dfc83c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:38.506277 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4f31b822-1786-473e-b118-234401dfc83c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:38.506788 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4f31b822-1786-473e-b118-234401dfc83c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:38.508353 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4f31b822-1786-473e-b118-234401dfc83c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:38.519753 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4f31b822-1786-473e-b118-234401dfc83c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:38.520777 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4f31b822-1786-473e-b118-234401dfc83c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:38.521573 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4f31b822-1786-473e-b118-234401dfc83c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:38.593501 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b851507f-f56c-4a2a-b55a-0b9fa1e2fce4 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a779e85e1c493985f7cfe8aceb9c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4478d0e315d948df9eda910f205646c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:38.606021 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b851507f-f56c-4a2a-b55a-0b9fa1e2fce4 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] 10.222.0.27 "GET /compute/v2.1/servers/51e76f20-555e-4867-a42b-30727dc94169" status: 200 len: 1279 microversion: 2.1 time: 0.535923 Sep 08 10:56:38.621075 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2044/4142] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:38 2022] GET /compute/v2.1/servers/51e76f20-555e-4867-a42b-30727dc94169 => generated 1279 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:38.708082 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-88b2c755-5915-4ccb-9910-11ed2135b8fa tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:38.708703 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-88b2c755-5915-4ccb-9910-11ed2135b8fa tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 85c5c938-83a1-4ca3-b9b1-b05d818f7efc] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:38.724584 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-88b2c755-5915-4ccb-9910-11ed2135b8fa tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:38.725366 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-88b2c755-5915-4ccb-9910-11ed2135b8fa tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:38.725952 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-88b2c755-5915-4ccb-9910-11ed2135b8fa tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:38.726966 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-88b2c755-5915-4ccb-9910-11ed2135b8fa tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:38.727555 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-88b2c755-5915-4ccb-9910-11ed2135b8fa tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:38.728122 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-88b2c755-5915-4ccb-9910-11ed2135b8fa tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:39.168185 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-88b2c755-5915-4ccb-9910-11ed2135b8fa tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:39.179446 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-88b2c755-5915-4ccb-9910-11ed2135b8fa tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/85c5c938-83a1-4ca3-b9b1-b05d818f7efc" status: 200 len: 1315 microversion: 2.1 time: 0.475859 Sep 08 10:56:39.180518 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2045/4143] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:38 2022] GET /compute/v2.1/servers/85c5c938-83a1-4ca3-b9b1-b05d818f7efc => generated 1315 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:56:39.185631 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c16ddb1d-1ca0-45be-baea-1e637a49f68f tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:39.190188 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c16ddb1d-1ca0-45be-baea-1e637a49f68f tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] [instance: 7c2e066a-8160-4bcd-80be-33091a3e0fac] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:39.214820 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c16ddb1d-1ca0-45be-baea-1e637a49f68f tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:39.216256 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c16ddb1d-1ca0-45be-baea-1e637a49f68f tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:39.217211 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c16ddb1d-1ca0-45be-baea-1e637a49f68f tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:39.218300 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c16ddb1d-1ca0-45be-baea-1e637a49f68f tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:39.218977 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c16ddb1d-1ca0-45be-baea-1e637a49f68f tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:39.219606 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c16ddb1d-1ca0-45be-baea-1e637a49f68f tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:39.552751 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4f31b822-1786-473e-b118-234401dfc83c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:39.582979 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4f31b822-1786-473e-b118-234401dfc83c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1459 microversion: 2.1 time: 1.113176 Sep 08 10:56:39.587281 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2099/4144] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:38 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1459 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:39.641582 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e09a79d9-7469-486e-9fbc-862733266ee0 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:39.642381 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e09a79d9-7469-486e-9fbc-862733266ee0 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] [instance: 51e76f20-555e-4867-a42b-30727dc94169] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:39.666121 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e09a79d9-7469-486e-9fbc-862733266ee0 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:39.666639 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e09a79d9-7469-486e-9fbc-862733266ee0 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:39.667086 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e09a79d9-7469-486e-9fbc-862733266ee0 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:39.667803 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e09a79d9-7469-486e-9fbc-862733266ee0 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:39.675657 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e09a79d9-7469-486e-9fbc-862733266ee0 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:39.677216 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e09a79d9-7469-486e-9fbc-862733266ee0 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:39.883908 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c16ddb1d-1ca0-45be-baea-1e637a49f68f tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7177ce97ae4fad81993ec8597cfe2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d73ca665b94264a22f7bae7d799cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:39.900474 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c16ddb1d-1ca0-45be-baea-1e637a49f68f tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] 10.222.0.27 "GET /compute/v2.1/servers/7c2e066a-8160-4bcd-80be-33091a3e0fac" status: 200 len: 1314 microversion: 2.1 time: 0.718517 Sep 08 10:56:39.901316 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2046/4145] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:39 2022] GET /compute/v2.1/servers/7c2e066a-8160-4bcd-80be-33091a3e0fac => generated 1314 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:40.204548 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d21e93cf-4834-4142-9efd-40789d6350b3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:40.205651 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d21e93cf-4834-4142-9efd-40789d6350b3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 85c5c938-83a1-4ca3-b9b1-b05d818f7efc] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:40.214685 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:56:40.220939 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d21e93cf-4834-4142-9efd-40789d6350b3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:40.224190 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d21e93cf-4834-4142-9efd-40789d6350b3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:40.224825 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d21e93cf-4834-4142-9efd-40789d6350b3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:40.226372 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d21e93cf-4834-4142-9efd-40789d6350b3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:40.226872 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d21e93cf-4834-4142-9efd-40789d6350b3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:40.229046 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d21e93cf-4834-4142-9efd-40789d6350b3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:40.360005 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e09a79d9-7469-486e-9fbc-862733266ee0 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a779e85e1c493985f7cfe8aceb9c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4478d0e315d948df9eda910f205646c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:40.371858 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e09a79d9-7469-486e-9fbc-862733266ee0 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] 10.222.0.27 "GET /compute/v2.1/servers/51e76f20-555e-4867-a42b-30727dc94169" status: 200 len: 1321 microversion: 2.1 time: 0.737104 Sep 08 10:56:40.372450 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2100/4146] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:39 2022] GET /compute/v2.1/servers/51e76f20-555e-4867-a42b-30727dc94169 => generated 1321 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:56:40.390541 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-1a4d4897-64af-4808-bc89-c1b37c89d4e3 req-d4c6de61-09c0-4bb7-b867-7f89c49e27f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85c5c938-83a1-4ca3-b9b1-b05d818f7efc", "tag": "bb42ab11-44aa-447c-8de2-2170b134194c"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:56:40.408343 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-1a4d4897-64af-4808-bc89-c1b37c89d4e3 req-d4c6de61-09c0-4bb7-b867-7f89c49e27f0 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:40.410505 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-1a4d4897-64af-4808-bc89-c1b37c89d4e3 req-d4c6de61-09c0-4bb7-b867-7f89c49e27f0 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:40.414464 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-1a4d4897-64af-4808-bc89-c1b37c89d4e3 req-d4c6de61-09c0-4bb7-b867-7f89c49e27f0 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:40.429312 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-1a4d4897-64af-4808-bc89-c1b37c89d4e3 req-d4c6de61-09c0-4bb7-b867-7f89c49e27f0 service nova] Creating event network-changed:bb42ab11-44aa-447c-8de2-2170b134194c for instance 85c5c938-83a1-4ca3-b9b1-b05d818f7efc on n-h2-850501-12 Sep 08 10:56:40.437635 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-1a4d4897-64af-4808-bc89-c1b37c89d4e3 req-d4c6de61-09c0-4bb7-b867-7f89c49e27f0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060628 Sep 08 10:56:40.438343 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2101/4147] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:56:40.610364 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-91be402b-f1ee-4d44-8c98-7c27a7874c4a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:40.611271 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-91be402b-f1ee-4d44-8c98-7c27a7874c4a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:40.623802 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-91be402b-f1ee-4d44-8c98-7c27a7874c4a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:40.624470 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-91be402b-f1ee-4d44-8c98-7c27a7874c4a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:40.625053 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-91be402b-f1ee-4d44-8c98-7c27a7874c4a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:40.625894 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-91be402b-f1ee-4d44-8c98-7c27a7874c4a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:40.630461 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-91be402b-f1ee-4d44-8c98-7c27a7874c4a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:40.631092 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-91be402b-f1ee-4d44-8c98-7c27a7874c4a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:41.041144 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-91be402b-f1ee-4d44-8c98-7c27a7874c4a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:41.058095 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-91be402b-f1ee-4d44-8c98-7c27a7874c4a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1459 microversion: 2.1 time: 0.450733 Sep 08 10:56:41.079219 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2102/4148] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:40 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1459 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:41.100794 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b6f5c333-98f7-49ff-9405-76e39c31c717 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:41.102653 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b6f5c333-98f7-49ff-9405-76e39c31c717 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] [instance: 7c2e066a-8160-4bcd-80be-33091a3e0fac] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:41.116500 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b6f5c333-98f7-49ff-9405-76e39c31c717 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:41.117926 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b6f5c333-98f7-49ff-9405-76e39c31c717 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:41.118516 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b6f5c333-98f7-49ff-9405-76e39c31c717 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:41.119387 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b6f5c333-98f7-49ff-9405-76e39c31c717 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:41.120556 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b6f5c333-98f7-49ff-9405-76e39c31c717 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:41.121234 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b6f5c333-98f7-49ff-9405-76e39c31c717 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:41.240112 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d21e93cf-4834-4142-9efd-40789d6350b3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:41.253545 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d21e93cf-4834-4142-9efd-40789d6350b3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/85c5c938-83a1-4ca3-b9b1-b05d818f7efc" status: 200 len: 1315 microversion: 2.1 time: 1.054544 Sep 08 10:56:41.254165 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2047/4149] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:40 2022] GET /compute/v2.1/servers/85c5c938-83a1-4ca3-b9b1-b05d818f7efc => generated 1315 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:56:41.405605 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b6f50e61-227b-4474-801b-c8d0777946c1 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:41.406307 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b6f50e61-227b-4474-801b-c8d0777946c1 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] [instance: 51e76f20-555e-4867-a42b-30727dc94169] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:41.419233 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:56:41.425365 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b6f50e61-227b-4474-801b-c8d0777946c1 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:41.428180 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b6f50e61-227b-4474-801b-c8d0777946c1 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:41.428750 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b6f50e61-227b-4474-801b-c8d0777946c1 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:41.430613 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b6f50e61-227b-4474-801b-c8d0777946c1 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:41.432190 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b6f50e61-227b-4474-801b-c8d0777946c1 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:41.432770 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b6f50e61-227b-4474-801b-c8d0777946c1 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:41.800630 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b6f5c333-98f7-49ff-9405-76e39c31c717 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7177ce97ae4fad81993ec8597cfe2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d73ca665b94264a22f7bae7d799cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:41.833786 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b6f5c333-98f7-49ff-9405-76e39c31c717 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] 10.222.0.27 "GET /compute/v2.1/servers/7c2e066a-8160-4bcd-80be-33091a3e0fac" status: 200 len: 1314 microversion: 2.1 time: 0.751572 Sep 08 10:56:41.842620 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2103/4150] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:41 2022] GET /compute/v2.1/servers/7c2e066a-8160-4bcd-80be-33091a3e0fac => generated 1314 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:42.087422 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-dab04193-6b74-4293-92d2-365111d93562 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:42.088064 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-dab04193-6b74-4293-92d2-365111d93562 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:42.104213 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dab04193-6b74-4293-92d2-365111d93562 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:42.111440 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dab04193-6b74-4293-92d2-365111d93562 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:42.113879 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dab04193-6b74-4293-92d2-365111d93562 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:42.114813 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dab04193-6b74-4293-92d2-365111d93562 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:42.117604 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dab04193-6b74-4293-92d2-365111d93562 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:42.118338 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dab04193-6b74-4293-92d2-365111d93562 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:42.191592 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:56:42.388956 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b6f50e61-227b-4474-801b-c8d0777946c1 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a779e85e1c493985f7cfe8aceb9c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4478d0e315d948df9eda910f205646c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:42.410687 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b6f50e61-227b-4474-801b-c8d0777946c1 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] 10.222.0.27 "GET /compute/v2.1/servers/51e76f20-555e-4867-a42b-30727dc94169" status: 200 len: 1321 microversion: 2.1 time: 1.012120 Sep 08 10:56:42.416527 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2048/4151] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:41 2022] GET /compute/v2.1/servers/51e76f20-555e-4867-a42b-30727dc94169 => generated 1321 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:42.436732 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-869a81ea-3110-4277-baca-fd19c7aca26e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:42.439704 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-869a81ea-3110-4277-baca-fd19c7aca26e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 85c5c938-83a1-4ca3-b9b1-b05d818f7efc] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:42.482522 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-869a81ea-3110-4277-baca-fd19c7aca26e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:42.488638 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-869a81ea-3110-4277-baca-fd19c7aca26e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:42.489237 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-869a81ea-3110-4277-baca-fd19c7aca26e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:42.490997 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-869a81ea-3110-4277-baca-fd19c7aca26e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:42.493394 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-869a81ea-3110-4277-baca-fd19c7aca26e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:42.494074 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-869a81ea-3110-4277-baca-fd19c7aca26e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:43.045562 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-dab04193-6b74-4293-92d2-365111d93562 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:43.059358 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-dab04193-6b74-4293-92d2-365111d93562 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1517 microversion: 2.1 time: 0.972358 Sep 08 10:56:43.060847 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2104/4152] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:42 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1517 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:43.092882 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-b93e8a9d-98ae-458c-b33e-113d11f6f9b3 req-0ccf5eda-46cf-4494-a980-8733a13fb5e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c2e066a-8160-4bcd-80be-33091a3e0fac", "tag": "585ccf42-903a-4b23-b54e-c5d6e8ffcfd3"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:56:43.127358 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-b93e8a9d-98ae-458c-b33e-113d11f6f9b3 req-0ccf5eda-46cf-4494-a980-8733a13fb5e9 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:43.128069 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-b93e8a9d-98ae-458c-b33e-113d11f6f9b3 req-0ccf5eda-46cf-4494-a980-8733a13fb5e9 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:43.128647 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-b93e8a9d-98ae-458c-b33e-113d11f6f9b3 req-0ccf5eda-46cf-4494-a980-8733a13fb5e9 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:43.154775 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-b93e8a9d-98ae-458c-b33e-113d11f6f9b3 req-0ccf5eda-46cf-4494-a980-8733a13fb5e9 service nova] Creating event network-changed:585ccf42-903a-4b23-b54e-c5d6e8ffcfd3 for instance 7c2e066a-8160-4bcd-80be-33091a3e0fac on n-h1-850501-12 Sep 08 10:56:43.163468 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-b93e8a9d-98ae-458c-b33e-113d11f6f9b3 req-0ccf5eda-46cf-4494-a980-8733a13fb5e9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086458 Sep 08 10:56:43.164659 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2105/4153] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:56:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:56:43.170250 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-856eabac-e42d-48f6-b32a-68e3ba12727b tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:43.177549 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-856eabac-e42d-48f6-b32a-68e3ba12727b tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] [instance: 7c2e066a-8160-4bcd-80be-33091a3e0fac] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:43.195511 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:56:43.198598 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-856eabac-e42d-48f6-b32a-68e3ba12727b tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:43.200529 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-856eabac-e42d-48f6-b32a-68e3ba12727b tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:43.201270 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-856eabac-e42d-48f6-b32a-68e3ba12727b tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:43.202163 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-856eabac-e42d-48f6-b32a-68e3ba12727b tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:43.202769 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-856eabac-e42d-48f6-b32a-68e3ba12727b tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:43.203338 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-856eabac-e42d-48f6-b32a-68e3ba12727b tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:43.411271 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-869a81ea-3110-4277-baca-fd19c7aca26e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:43.428504 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-869a81ea-3110-4277-baca-fd19c7aca26e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/85c5c938-83a1-4ca3-b9b1-b05d818f7efc" status: 200 len: 1315 microversion: 2.1 time: 1.010647 Sep 08 10:56:43.431938 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2049/4154] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:42 2022] GET /compute/v2.1/servers/85c5c938-83a1-4ca3-b9b1-b05d818f7efc => generated 1315 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:43.441763 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8dbf95f1-8b9b-4434-a594-612ec9b5aa37 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:43.443676 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8dbf95f1-8b9b-4434-a594-612ec9b5aa37 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] [instance: 51e76f20-555e-4867-a42b-30727dc94169] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:43.460890 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8dbf95f1-8b9b-4434-a594-612ec9b5aa37 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:43.463399 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8dbf95f1-8b9b-4434-a594-612ec9b5aa37 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:43.464014 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8dbf95f1-8b9b-4434-a594-612ec9b5aa37 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:43.466368 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8dbf95f1-8b9b-4434-a594-612ec9b5aa37 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:43.467043 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8dbf95f1-8b9b-4434-a594-612ec9b5aa37 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:43.468112 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8dbf95f1-8b9b-4434-a594-612ec9b5aa37 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:43.587732 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-856eabac-e42d-48f6-b32a-68e3ba12727b tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7177ce97ae4fad81993ec8597cfe2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d73ca665b94264a22f7bae7d799cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:43.604408 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-856eabac-e42d-48f6-b32a-68e3ba12727b tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] 10.222.0.27 "GET /compute/v2.1/servers/7c2e066a-8160-4bcd-80be-33091a3e0fac" status: 200 len: 1314 microversion: 2.1 time: 0.438294 Sep 08 10:56:43.605200 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2106/4155] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:43 2022] GET /compute/v2.1/servers/7c2e066a-8160-4bcd-80be-33091a3e0fac => generated 1314 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:44.087866 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-37f4fcd2-d255-4b8c-91e9-060b33a66dc6 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:44.089479 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-37f4fcd2-d255-4b8c-91e9-060b33a66dc6 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:44.092399 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=4 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:56:44.114481 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-37f4fcd2-d255-4b8c-91e9-060b33a66dc6 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:44.115153 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-37f4fcd2-d255-4b8c-91e9-060b33a66dc6 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:44.116180 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-37f4fcd2-d255-4b8c-91e9-060b33a66dc6 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:44.120537 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-37f4fcd2-d255-4b8c-91e9-060b33a66dc6 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:44.122417 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-37f4fcd2-d255-4b8c-91e9-060b33a66dc6 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:44.123200 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-37f4fcd2-d255-4b8c-91e9-060b33a66dc6 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:44.180987 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=14 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:56:44.803721 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-37f4fcd2-d255-4b8c-91e9-060b33a66dc6 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:44.829011 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-37f4fcd2-d255-4b8c-91e9-060b33a66dc6 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1517 microversion: 2.1 time: 0.746119 Sep 08 10:56:44.833223 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2107/4156] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:44 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1517 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:56:44.853120 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-1ac760d7-bb4f-4b95-8c86-9ee8d9bb294e req-cd016c1b-6c2a-4f95-af17-3d3b9497433a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "931569b4-139a-4939-abf3-49a589eb1d91", "name": "network-vif-plugged", "status": "completed", "tag": "5479ce77-c509-4787-8670-94752e80b0c7"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:56:44.881232 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-1ac760d7-bb4f-4b95-8c86-9ee8d9bb294e req-cd016c1b-6c2a-4f95-af17-3d3b9497433a service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:44.887025 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-1ac760d7-bb4f-4b95-8c86-9ee8d9bb294e req-cd016c1b-6c2a-4f95-af17-3d3b9497433a service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:44.887776 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-1ac760d7-bb4f-4b95-8c86-9ee8d9bb294e req-cd016c1b-6c2a-4f95-af17-3d3b9497433a service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:44.922520 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-1ac760d7-bb4f-4b95-8c86-9ee8d9bb294e req-cd016c1b-6c2a-4f95-af17-3d3b9497433a service nova] Creating event network-vif-plugged:5479ce77-c509-4787-8670-94752e80b0c7 for instance 931569b4-139a-4939-abf3-49a589eb1d91 on n-h1-850501-12 Sep 08 10:56:44.935590 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-1ac760d7-bb4f-4b95-8c86-9ee8d9bb294e req-cd016c1b-6c2a-4f95-af17-3d3b9497433a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088786 Sep 08 10:56:44.936877 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2108/4157] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:56:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:56:44.947816 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-979d8ab6-fbf6-45bd-81ba-71b495ce210a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:44.952353 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-979d8ab6-fbf6-45bd-81ba-71b495ce210a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 85c5c938-83a1-4ca3-b9b1-b05d818f7efc] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:44.968141 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-979d8ab6-fbf6-45bd-81ba-71b495ce210a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:44.971452 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-979d8ab6-fbf6-45bd-81ba-71b495ce210a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:44.973226 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-979d8ab6-fbf6-45bd-81ba-71b495ce210a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:44.974834 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-979d8ab6-fbf6-45bd-81ba-71b495ce210a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:44.975551 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-979d8ab6-fbf6-45bd-81ba-71b495ce210a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:44.979079 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-979d8ab6-fbf6-45bd-81ba-71b495ce210a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:45.200578 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=22 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:56:45.267630 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8dbf95f1-8b9b-4434-a594-612ec9b5aa37 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a779e85e1c493985f7cfe8aceb9c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4478d0e315d948df9eda910f205646c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:45.282062 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8dbf95f1-8b9b-4434-a594-612ec9b5aa37 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] 10.222.0.27 "GET /compute/v2.1/servers/51e76f20-555e-4867-a42b-30727dc94169" status: 200 len: 1321 microversion: 2.1 time: 1.845692 Sep 08 10:56:45.287633 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2050/4158] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:43 2022] GET /compute/v2.1/servers/51e76f20-555e-4867-a42b-30727dc94169 => generated 1321 bytes in 1852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:45.312120 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c2190e86-5933-45ef-a22c-8c33748cc0de tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:45.318351 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c2190e86-5933-45ef-a22c-8c33748cc0de tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] [instance: 7c2e066a-8160-4bcd-80be-33091a3e0fac] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:45.358724 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2190e86-5933-45ef-a22c-8c33748cc0de tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:45.370099 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2190e86-5933-45ef-a22c-8c33748cc0de tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:45.370611 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2190e86-5933-45ef-a22c-8c33748cc0de tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:45.371425 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2190e86-5933-45ef-a22c-8c33748cc0de tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:45.372901 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2190e86-5933-45ef-a22c-8c33748cc0de tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:45.373379 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2190e86-5933-45ef-a22c-8c33748cc0de tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:45.444471 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:56:45.481715 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-979d8ab6-fbf6-45bd-81ba-71b495ce210a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:45.503834 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-979d8ab6-fbf6-45bd-81ba-71b495ce210a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/85c5c938-83a1-4ca3-b9b1-b05d818f7efc" status: 200 len: 1315 microversion: 2.1 time: 0.564883 Sep 08 10:56:45.508398 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2109/4159] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:44 2022] GET /compute/v2.1/servers/85c5c938-83a1-4ca3-b9b1-b05d818f7efc => generated 1315 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:45.526796 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-39c938db-1944-431c-bf46-df4174eeb9cd req-b0479f5d-810d-426d-81e0-ea748bd958a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51e76f20-555e-4867-a42b-30727dc94169", "tag": "b769ec83-23f3-4327-8169-ebe5904a41a5"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:56:45.561017 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-39c938db-1944-431c-bf46-df4174eeb9cd req-b0479f5d-810d-426d-81e0-ea748bd958a2 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:45.565620 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-39c938db-1944-431c-bf46-df4174eeb9cd req-b0479f5d-810d-426d-81e0-ea748bd958a2 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:45.566298 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-39c938db-1944-431c-bf46-df4174eeb9cd req-b0479f5d-810d-426d-81e0-ea748bd958a2 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:45.598118 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-39c938db-1944-431c-bf46-df4174eeb9cd req-b0479f5d-810d-426d-81e0-ea748bd958a2 service nova] Creating event network-changed:b769ec83-23f3-4327-8169-ebe5904a41a5 for instance 51e76f20-555e-4867-a42b-30727dc94169 on n-h1-850501-12 Sep 08 10:56:45.610382 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-39c938db-1944-431c-bf46-df4174eeb9cd req-b0479f5d-810d-426d-81e0-ea748bd958a2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100674 Sep 08 10:56:45.611673 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2110/4160] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:56:45.621493 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-90b42773-fbce-4117-987c-cc3e4ef88cbe tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1769407394", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "cd607f8f-1d05-48fe-a1bd-8097905a124d"}, {"uuid": "951871bb-cb10-4e88-9b9b-edae08d17e3d"}]}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:56:45.748703 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-90b42773-fbce-4117-987c-cc3e4ef88cbe tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] validate_networks() for [('cd607f8f-1d05-48fe-a1bd-8097905a124d', None, None, None, None, None), ('951871bb-cb10-4e88-9b9b-edae08d17e3d', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:56:45.867367 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c2190e86-5933-45ef-a22c-8c33748cc0de tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7177ce97ae4fad81993ec8597cfe2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d73ca665b94264a22f7bae7d799cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:45.884194 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c2190e86-5933-45ef-a22c-8c33748cc0de tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] 10.222.0.27 "GET /compute/v2.1/servers/7c2e066a-8160-4bcd-80be-33091a3e0fac" status: 200 len: 1314 microversion: 2.1 time: 0.593155 Sep 08 10:56:45.887096 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2051/4161] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:45 2022] GET /compute/v2.1/servers/7c2e066a-8160-4bcd-80be-33091a3e0fac => generated 1314 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:45.908093 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f09c4345-fad9-40d9-bf91-7b9a9052c41a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:45.909458 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f09c4345-fad9-40d9-bf91-7b9a9052c41a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:45.920748 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f09c4345-fad9-40d9-bf91-7b9a9052c41a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:45.921648 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f09c4345-fad9-40d9-bf91-7b9a9052c41a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:45.922656 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f09c4345-fad9-40d9-bf91-7b9a9052c41a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:45.930286 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f09c4345-fad9-40d9-bf91-7b9a9052c41a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:45.937830 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f09c4345-fad9-40d9-bf91-7b9a9052c41a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:45.938286 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f09c4345-fad9-40d9-bf91-7b9a9052c41a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:46.300183 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f09c4345-fad9-40d9-bf91-7b9a9052c41a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:46.319017 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f09c4345-fad9-40d9-bf91-7b9a9052c41a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1517 microversion: 2.1 time: 0.429206 Sep 08 10:56:46.319865 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2052/4162] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:45 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1517 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:46.326943 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2e5a0f5d-1775-42e5-b323-81f9e5cc2512 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:46.328022 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2e5a0f5d-1775-42e5-b323-81f9e5cc2512 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] [instance: 51e76f20-555e-4867-a42b-30727dc94169] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:46.336061 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e5a0f5d-1775-42e5-b323-81f9e5cc2512 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:46.336776 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e5a0f5d-1775-42e5-b323-81f9e5cc2512 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:46.337708 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e5a0f5d-1775-42e5-b323-81f9e5cc2512 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:46.340427 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e5a0f5d-1775-42e5-b323-81f9e5cc2512 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:46.341070 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e5a0f5d-1775-42e5-b323-81f9e5cc2512 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:46.341773 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e5a0f5d-1775-42e5-b323-81f9e5cc2512 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:46.549959 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2e5a0f5d-1775-42e5-b323-81f9e5cc2512 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a779e85e1c493985f7cfe8aceb9c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4478d0e315d948df9eda910f205646c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:46.561959 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2e5a0f5d-1775-42e5-b323-81f9e5cc2512 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] 10.222.0.27 "GET /compute/v2.1/servers/51e76f20-555e-4867-a42b-30727dc94169" status: 200 len: 1321 microversion: 2.1 time: 0.240662 Sep 08 10:56:46.563189 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2053/4163] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:46 2022] GET /compute/v2.1/servers/51e76f20-555e-4867-a42b-30727dc94169 => generated 1321 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:46.592110 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a4927ec6-6555-4f0e-9d90-b32c94a04588 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:46.594289 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a4927ec6-6555-4f0e-9d90-b32c94a04588 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 85c5c938-83a1-4ca3-b9b1-b05d818f7efc] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:46.614934 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a4927ec6-6555-4f0e-9d90-b32c94a04588 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:46.619361 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a4927ec6-6555-4f0e-9d90-b32c94a04588 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:46.621201 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a4927ec6-6555-4f0e-9d90-b32c94a04588 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:46.625760 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a4927ec6-6555-4f0e-9d90-b32c94a04588 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:46.626661 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a4927ec6-6555-4f0e-9d90-b32c94a04588 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:46.627522 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a4927ec6-6555-4f0e-9d90-b32c94a04588 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:46.840286 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a4927ec6-6555-4f0e-9d90-b32c94a04588 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:46.852533 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a4927ec6-6555-4f0e-9d90-b32c94a04588 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/85c5c938-83a1-4ca3-b9b1-b05d818f7efc" status: 200 len: 1315 microversion: 2.1 time: 0.268840 Sep 08 10:56:46.853168 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2054/4164] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:46 2022] GET /compute/v2.1/servers/85c5c938-83a1-4ca3-b9b1-b05d818f7efc => generated 1315 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:46.925664 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cb0526a0-cb4e-41a1-a353-33bb61eccabc tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:46.926295 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cb0526a0-cb4e-41a1-a353-33bb61eccabc tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] [instance: 7c2e066a-8160-4bcd-80be-33091a3e0fac] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:46.937568 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb0526a0-cb4e-41a1-a353-33bb61eccabc tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:46.940346 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb0526a0-cb4e-41a1-a353-33bb61eccabc tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:46.940846 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb0526a0-cb4e-41a1-a353-33bb61eccabc tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:46.941643 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb0526a0-cb4e-41a1-a353-33bb61eccabc tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:46.944675 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb0526a0-cb4e-41a1-a353-33bb61eccabc tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:46.945174 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb0526a0-cb4e-41a1-a353-33bb61eccabc tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:47.040468 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-90b42773-fbce-4117-987c-cc3e4ef88cbe tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:56:47.041063 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-90b42773-fbce-4117-987c-cc3e4ef88cbe tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:56:47.041715 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-90b42773-fbce-4117-987c-cc3e4ef88cbe tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:56:47.042867 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-90b42773-fbce-4117-987c-cc3e4ef88cbe tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:56:47.043806 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-90b42773-fbce-4117-987c-cc3e4ef88cbe tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:56:47.076239 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90b42773-fbce-4117-987c-cc3e4ef88cbe tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:47.077148 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90b42773-fbce-4117-987c-cc3e4ef88cbe tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:47.096685 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90b42773-fbce-4117-987c-cc3e4ef88cbe tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:47.100178 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90b42773-fbce-4117-987c-cc3e4ef88cbe tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:47.100728 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90b42773-fbce-4117-987c-cc3e4ef88cbe tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:47.105910 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90b42773-fbce-4117-987c-cc3e4ef88cbe tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:47.172513 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-90b42773-fbce-4117-987c-cc3e4ef88cbe tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Getting quotas for project 1f1c70903c3d42d790d9ef96adc1fdbd. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:56:47.201482 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-90b42773-fbce-4117-987c-cc3e4ef88cbe tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Getting quotas for user 22145c653c804031ae233de6d84647fe and project 1f1c70903c3d42d790d9ef96adc1fdbd. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:56:47.268094 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-90b42773-fbce-4117-987c-cc3e4ef88cbe tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:56:47.270966 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-90b42773-fbce-4117-987c-cc3e4ef88cbe tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] [instance: 2d995117-3718-4b9d-a4a1-c1185d34d701] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:56:47.365019 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cb0526a0-cb4e-41a1-a353-33bb61eccabc tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7177ce97ae4fad81993ec8597cfe2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d73ca665b94264a22f7bae7d799cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:47.394944 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cb0526a0-cb4e-41a1-a353-33bb61eccabc tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] 10.222.0.27 "GET /compute/v2.1/servers/7c2e066a-8160-4bcd-80be-33091a3e0fac" status: 200 len: 1314 microversion: 2.1 time: 0.474024 Sep 08 10:56:47.409066 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2055/4165] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:46 2022] GET /compute/v2.1/servers/7c2e066a-8160-4bcd-80be-33091a3e0fac => generated 1314 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:47.420833 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-8987548d-083d-44b3-8f0b-09e4e1da7c0d req-4f0a4c22-f912-404f-9938-9463d4b4b552 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13039f8f-105b-4bb5-b632-753e183d2f1a", "name": "network-vif-plugged", "status": "completed", "tag": "aad9298d-af3f-4e11-966b-2f2a4bcaeb62"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:56:47.437986 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-90b42773-fbce-4117-987c-cc3e4ef88cbe tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.820697 Sep 08 10:56:47.443817 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2111/4166] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:56:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1831 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:56:47.467065 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cc3a021c-14d6-412c-b902-9ecd76231ab6 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:47.468372 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cc3a021c-14d6-412c-b902-9ecd76231ab6 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:47.468888 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-8987548d-083d-44b3-8f0b-09e4e1da7c0d req-4f0a4c22-f912-404f-9938-9463d4b4b552 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:47.469621 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-8987548d-083d-44b3-8f0b-09e4e1da7c0d req-4f0a4c22-f912-404f-9938-9463d4b4b552 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:47.473565 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-8987548d-083d-44b3-8f0b-09e4e1da7c0d req-4f0a4c22-f912-404f-9938-9463d4b4b552 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:47.489359 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc3a021c-14d6-412c-b902-9ecd76231ab6 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:47.493943 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc3a021c-14d6-412c-b902-9ecd76231ab6 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:47.510104 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc3a021c-14d6-412c-b902-9ecd76231ab6 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:47.512123 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc3a021c-14d6-412c-b902-9ecd76231ab6 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:47.518892 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc3a021c-14d6-412c-b902-9ecd76231ab6 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:47.520161 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc3a021c-14d6-412c-b902-9ecd76231ab6 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:47.532975 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-8987548d-083d-44b3-8f0b-09e4e1da7c0d req-4f0a4c22-f912-404f-9938-9463d4b4b552 service nova] Creating event network-vif-plugged:aad9298d-af3f-4e11-966b-2f2a4bcaeb62 for instance 13039f8f-105b-4bb5-b632-753e183d2f1a on n-h2-850501-12 Sep 08 10:56:47.541545 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-8987548d-083d-44b3-8f0b-09e4e1da7c0d req-4f0a4c22-f912-404f-9938-9463d4b4b552 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139393 Sep 08 10:56:47.542161 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2056/4167] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:56:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:56:47.559730 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a9933fa5-81bb-4a93-9a5a-d33f8332b698 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:47.561883 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a9933fa5-81bb-4a93-9a5a-d33f8332b698 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] [instance: 2d995117-3718-4b9d-a4a1-c1185d34d701] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:47.701286 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a9933fa5-81bb-4a93-9a5a-d33f8332b698 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22145c653c804031ae233de6d84647fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1c70903c3d42d790d9ef96adc1fdbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:47.710354 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a9933fa5-81bb-4a93-9a5a-d33f8332b698 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] 10.222.0.27 "GET /compute/v2.1/servers/2d995117-3718-4b9d-a4a1-c1185d34d701" status: 200 len: 1213 microversion: 2.1 time: 0.166640 Sep 08 10:56:47.716926 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2057/4168] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:47 2022] GET /compute/v2.1/servers/2d995117-3718-4b9d-a4a1-c1185d34d701 => generated 1213 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:47.723316 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a2a591b1-4f06-4941-8fd5-05d17bb8c3c1 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:47.734383 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a2a591b1-4f06-4941-8fd5-05d17bb8c3c1 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] [instance: 51e76f20-555e-4867-a42b-30727dc94169] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:47.759164 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2a591b1-4f06-4941-8fd5-05d17bb8c3c1 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:47.763729 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2a591b1-4f06-4941-8fd5-05d17bb8c3c1 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:47.765463 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2a591b1-4f06-4941-8fd5-05d17bb8c3c1 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:47.769389 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2a591b1-4f06-4941-8fd5-05d17bb8c3c1 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:47.770623 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2a591b1-4f06-4941-8fd5-05d17bb8c3c1 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:47.771752 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2a591b1-4f06-4941-8fd5-05d17bb8c3c1 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:47.802079 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-cc3a021c-14d6-412c-b902-9ecd76231ab6 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:47.812109 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cc3a021c-14d6-412c-b902-9ecd76231ab6 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1517 microversion: 2.1 time: 0.365981 Sep 08 10:56:47.817755 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2112/4169] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:47 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1517 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:47.880933 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6ddaf8de-5cd9-4792-a4c8-48653f3b98a2 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:47.881756 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6ddaf8de-5cd9-4792-a4c8-48653f3b98a2 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 85c5c938-83a1-4ca3-b9b1-b05d818f7efc] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:47.893367 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6ddaf8de-5cd9-4792-a4c8-48653f3b98a2 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:47.895789 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6ddaf8de-5cd9-4792-a4c8-48653f3b98a2 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:47.905522 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6ddaf8de-5cd9-4792-a4c8-48653f3b98a2 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:47.907266 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6ddaf8de-5cd9-4792-a4c8-48653f3b98a2 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:47.908694 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6ddaf8de-5cd9-4792-a4c8-48653f3b98a2 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:47.909544 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6ddaf8de-5cd9-4792-a4c8-48653f3b98a2 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:48.081172 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a2a591b1-4f06-4941-8fd5-05d17bb8c3c1 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a779e85e1c493985f7cfe8aceb9c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4478d0e315d948df9eda910f205646c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:48.091195 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a2a591b1-4f06-4941-8fd5-05d17bb8c3c1 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] 10.222.0.27 "GET /compute/v2.1/servers/51e76f20-555e-4867-a42b-30727dc94169" status: 200 len: 1321 microversion: 2.1 time: 0.371896 Sep 08 10:56:48.092009 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2058/4170] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:47 2022] GET /compute/v2.1/servers/51e76f20-555e-4867-a42b-30727dc94169 => generated 1321 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:48.426210 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0c23153d-07f6-4f02-be0d-552d0d866bd3 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:48.426889 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0c23153d-07f6-4f02-be0d-552d0d866bd3 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] [instance: 7c2e066a-8160-4bcd-80be-33091a3e0fac] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:48.467088 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0c23153d-07f6-4f02-be0d-552d0d866bd3 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:48.469071 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0c23153d-07f6-4f02-be0d-552d0d866bd3 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:48.471289 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0c23153d-07f6-4f02-be0d-552d0d866bd3 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:48.474309 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0c23153d-07f6-4f02-be0d-552d0d866bd3 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:48.475947 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0c23153d-07f6-4f02-be0d-552d0d866bd3 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:48.479451 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0c23153d-07f6-4f02-be0d-552d0d866bd3 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:49.287558 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6ddaf8de-5cd9-4792-a4c8-48653f3b98a2 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:49.344129 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0c23153d-07f6-4f02-be0d-552d0d866bd3 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7177ce97ae4fad81993ec8597cfe2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d73ca665b94264a22f7bae7d799cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:49.352441 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0c23153d-07f6-4f02-be0d-552d0d866bd3 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] 10.222.0.27 "GET /compute/v2.1/servers/7c2e066a-8160-4bcd-80be-33091a3e0fac" status: 200 len: 1314 microversion: 2.1 time: 0.932190 Sep 08 10:56:49.354933 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6ddaf8de-5cd9-4792-a4c8-48653f3b98a2 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/85c5c938-83a1-4ca3-b9b1-b05d818f7efc" status: 200 len: 1315 microversion: 2.1 time: 1.461963 Sep 08 10:56:49.358720 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2113/4171] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:47 2022] GET /compute/v2.1/servers/85c5c938-83a1-4ca3-b9b1-b05d818f7efc => generated 1315 bytes in 1484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:49.358861 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2059/4172] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:48 2022] GET /compute/v2.1/servers/7c2e066a-8160-4bcd-80be-33091a3e0fac => generated 1314 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:49.378108 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1a9fef5d-b392-4e7c-8a29-b892321c83c7 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:49.379258 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1a9fef5d-b392-4e7c-8a29-b892321c83c7 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] [instance: 2d995117-3718-4b9d-a4a1-c1185d34d701] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:49.393937 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fdeeddcb-d4ed-4f7b-94c9-2035beba6f52 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:49.400977 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fdeeddcb-d4ed-4f7b-94c9-2035beba6f52 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:49.408403 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1a9fef5d-b392-4e7c-8a29-b892321c83c7 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:49.410199 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1a9fef5d-b392-4e7c-8a29-b892321c83c7 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:49.413753 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1a9fef5d-b392-4e7c-8a29-b892321c83c7 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:49.414877 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1a9fef5d-b392-4e7c-8a29-b892321c83c7 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:49.418534 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1a9fef5d-b392-4e7c-8a29-b892321c83c7 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:49.421747 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1a9fef5d-b392-4e7c-8a29-b892321c83c7 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:49.444943 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fdeeddcb-d4ed-4f7b-94c9-2035beba6f52 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:49.447808 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fdeeddcb-d4ed-4f7b-94c9-2035beba6f52 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:49.454468 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fdeeddcb-d4ed-4f7b-94c9-2035beba6f52 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:49.459374 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fdeeddcb-d4ed-4f7b-94c9-2035beba6f52 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:49.464550 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fdeeddcb-d4ed-4f7b-94c9-2035beba6f52 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:49.469664 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fdeeddcb-d4ed-4f7b-94c9-2035beba6f52 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:49.738406 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1a9fef5d-b392-4e7c-8a29-b892321c83c7 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22145c653c804031ae233de6d84647fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1c70903c3d42d790d9ef96adc1fdbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:49.760176 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1a9fef5d-b392-4e7c-8a29-b892321c83c7 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] 10.222.0.27 "GET /compute/v2.1/servers/2d995117-3718-4b9d-a4a1-c1185d34d701" status: 200 len: 1209 microversion: 2.1 time: 0.399563 Sep 08 10:56:49.760787 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2060/4173] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:49 2022] GET /compute/v2.1/servers/2d995117-3718-4b9d-a4a1-c1185d34d701 => generated 1209 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:49.768596 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-16e689ef-b474-4aeb-b073-702457c5c26c tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:49.769420 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-16e689ef-b474-4aeb-b073-702457c5c26c tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] [instance: 51e76f20-555e-4867-a42b-30727dc94169] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:49.803243 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-16e689ef-b474-4aeb-b073-702457c5c26c tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:49.803804 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-16e689ef-b474-4aeb-b073-702457c5c26c tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:49.804253 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-16e689ef-b474-4aeb-b073-702457c5c26c tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:49.804982 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-16e689ef-b474-4aeb-b073-702457c5c26c tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:49.825213 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-16e689ef-b474-4aeb-b073-702457c5c26c tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:49.825688 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-16e689ef-b474-4aeb-b073-702457c5c26c tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:50.105696 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-fdeeddcb-d4ed-4f7b-94c9-2035beba6f52 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:50.134209 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fdeeddcb-d4ed-4f7b-94c9-2035beba6f52 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1517 microversion: 2.1 time: 0.767456 Sep 08 10:56:50.161947 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2114/4174] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:49 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1517 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:50.437986 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-16e689ef-b474-4aeb-b073-702457c5c26c tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a779e85e1c493985f7cfe8aceb9c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4478d0e315d948df9eda910f205646c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:50.456796 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-16e689ef-b474-4aeb-b073-702457c5c26c tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] 10.222.0.27 "GET /compute/v2.1/servers/51e76f20-555e-4867-a42b-30727dc94169" status: 200 len: 1321 microversion: 2.1 time: 0.694730 Sep 08 10:56:50.475720 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2061/4175] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:49 2022] GET /compute/v2.1/servers/51e76f20-555e-4867-a42b-30727dc94169 => generated 1321 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:50.491659 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-328f5751-a9d1-4005-816e-cf0b76a9278c tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:50.492922 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-328f5751-a9d1-4005-816e-cf0b76a9278c tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] [instance: 7c2e066a-8160-4bcd-80be-33091a3e0fac] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:50.510037 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-328f5751-a9d1-4005-816e-cf0b76a9278c tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:50.510880 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-328f5751-a9d1-4005-816e-cf0b76a9278c tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:50.511599 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-328f5751-a9d1-4005-816e-cf0b76a9278c tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:50.512692 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-328f5751-a9d1-4005-816e-cf0b76a9278c tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:50.513368 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-328f5751-a9d1-4005-816e-cf0b76a9278c tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:50.514034 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-328f5751-a9d1-4005-816e-cf0b76a9278c tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:51.179268 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-45f6ef44-d1fa-4754-a901-2adeac29a865 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:51.179882 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-45f6ef44-d1fa-4754-a901-2adeac29a865 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 85c5c938-83a1-4ca3-b9b1-b05d818f7efc] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:51.190755 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-45f6ef44-d1fa-4754-a901-2adeac29a865 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:51.198585 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-45f6ef44-d1fa-4754-a901-2adeac29a865 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:51.203602 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-45f6ef44-d1fa-4754-a901-2adeac29a865 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:51.212279 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-45f6ef44-d1fa-4754-a901-2adeac29a865 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:51.213509 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-45f6ef44-d1fa-4754-a901-2adeac29a865 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:51.214184 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-45f6ef44-d1fa-4754-a901-2adeac29a865 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:51.710118 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-328f5751-a9d1-4005-816e-cf0b76a9278c tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7177ce97ae4fad81993ec8597cfe2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d73ca665b94264a22f7bae7d799cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:51.730519 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-328f5751-a9d1-4005-816e-cf0b76a9278c tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] 10.222.0.27 "GET /compute/v2.1/servers/7c2e066a-8160-4bcd-80be-33091a3e0fac" status: 200 len: 1314 microversion: 2.1 time: 1.252936 Sep 08 10:56:51.731853 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2062/4176] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:50 2022] GET /compute/v2.1/servers/7c2e066a-8160-4bcd-80be-33091a3e0fac => generated 1314 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:51.764836 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-746f8cb1-838b-4ead-92d6-96965bf7d70b tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:51.767012 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-746f8cb1-838b-4ead-92d6-96965bf7d70b tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] [instance: 2d995117-3718-4b9d-a4a1-c1185d34d701] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:51.790234 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-746f8cb1-838b-4ead-92d6-96965bf7d70b tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:51.791216 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-746f8cb1-838b-4ead-92d6-96965bf7d70b tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:51.791875 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-746f8cb1-838b-4ead-92d6-96965bf7d70b tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:51.796638 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-746f8cb1-838b-4ead-92d6-96965bf7d70b tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:51.808800 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-746f8cb1-838b-4ead-92d6-96965bf7d70b tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:51.809921 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-746f8cb1-838b-4ead-92d6-96965bf7d70b tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:51.963401 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-45f6ef44-d1fa-4754-a901-2adeac29a865 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:51.976420 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-45f6ef44-d1fa-4754-a901-2adeac29a865 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/85c5c938-83a1-4ca3-b9b1-b05d818f7efc" status: 200 len: 1315 microversion: 2.1 time: 1.596849 Sep 08 10:56:51.984583 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2115/4177] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:50 2022] GET /compute/v2.1/servers/85c5c938-83a1-4ca3-b9b1-b05d818f7efc => generated 1315 bytes in 1606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:52.000438 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9c16ae5b-dcbb-4869-950f-9e4a15e17f1c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:52.003922 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9c16ae5b-dcbb-4869-950f-9e4a15e17f1c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:52.032324 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9c16ae5b-dcbb-4869-950f-9e4a15e17f1c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:52.037581 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9c16ae5b-dcbb-4869-950f-9e4a15e17f1c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:52.042012 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9c16ae5b-dcbb-4869-950f-9e4a15e17f1c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:52.045102 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9c16ae5b-dcbb-4869-950f-9e4a15e17f1c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:52.045755 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9c16ae5b-dcbb-4869-950f-9e4a15e17f1c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:52.047748 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9c16ae5b-dcbb-4869-950f-9e4a15e17f1c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:52.064624 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-746f8cb1-838b-4ead-92d6-96965bf7d70b tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22145c653c804031ae233de6d84647fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1c70903c3d42d790d9ef96adc1fdbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:52.074748 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-746f8cb1-838b-4ead-92d6-96965bf7d70b tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] 10.222.0.27 "GET /compute/v2.1/servers/2d995117-3718-4b9d-a4a1-c1185d34d701" status: 200 len: 1271 microversion: 2.1 time: 0.313665 Sep 08 10:56:52.087566 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2063/4178] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:51 2022] GET /compute/v2.1/servers/2d995117-3718-4b9d-a4a1-c1185d34d701 => generated 1271 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:52.092995 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6b99d675-b679-4dc8-96ea-2ad6e6b46f03 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:52.093896 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6b99d675-b679-4dc8-96ea-2ad6e6b46f03 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] [instance: 51e76f20-555e-4867-a42b-30727dc94169] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:52.107995 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b99d675-b679-4dc8-96ea-2ad6e6b46f03 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:52.108798 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b99d675-b679-4dc8-96ea-2ad6e6b46f03 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:52.109494 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b99d675-b679-4dc8-96ea-2ad6e6b46f03 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:52.118468 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b99d675-b679-4dc8-96ea-2ad6e6b46f03 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:52.119294 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b99d675-b679-4dc8-96ea-2ad6e6b46f03 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:52.119934 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b99d675-b679-4dc8-96ea-2ad6e6b46f03 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:52.759824 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9c16ae5b-dcbb-4869-950f-9e4a15e17f1c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:52.795571 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6b99d675-b679-4dc8-96ea-2ad6e6b46f03 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a779e85e1c493985f7cfe8aceb9c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4478d0e315d948df9eda910f205646c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:52.810790 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9c16ae5b-dcbb-4869-950f-9e4a15e17f1c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1517 microversion: 2.1 time: 0.819959 Sep 08 10:56:52.812728 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2116/4179] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:51 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1517 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:52.834330 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6b99d675-b679-4dc8-96ea-2ad6e6b46f03 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] 10.222.0.27 "GET /compute/v2.1/servers/51e76f20-555e-4867-a42b-30727dc94169" status: 200 len: 1321 microversion: 2.1 time: 0.722085 Sep 08 10:56:52.841549 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2064/4180] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:52 2022] GET /compute/v2.1/servers/51e76f20-555e-4867-a42b-30727dc94169 => generated 1321 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:52.867790 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-99f1660d-814e-4a36-a179-6b1dbab784ce tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:52.876339 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-99f1660d-814e-4a36-a179-6b1dbab784ce tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] [instance: 7c2e066a-8160-4bcd-80be-33091a3e0fac] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:52.899908 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-99f1660d-814e-4a36-a179-6b1dbab784ce tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:52.906387 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-99f1660d-814e-4a36-a179-6b1dbab784ce tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:52.911809 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-99f1660d-814e-4a36-a179-6b1dbab784ce tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:52.913171 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-99f1660d-814e-4a36-a179-6b1dbab784ce tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:52.917240 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-99f1660d-814e-4a36-a179-6b1dbab784ce tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:52.920720 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-99f1660d-814e-4a36-a179-6b1dbab784ce tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:53.016299 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8e1a9ab7-442b-418f-bb2e-e54bbb7d46ac tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:53.018849 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8e1a9ab7-442b-418f-bb2e-e54bbb7d46ac tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 85c5c938-83a1-4ca3-b9b1-b05d818f7efc] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:53.054734 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e1a9ab7-442b-418f-bb2e-e54bbb7d46ac tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:53.056009 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e1a9ab7-442b-418f-bb2e-e54bbb7d46ac tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:53.056693 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e1a9ab7-442b-418f-bb2e-e54bbb7d46ac tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:53.058875 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e1a9ab7-442b-418f-bb2e-e54bbb7d46ac tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:53.060082 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e1a9ab7-442b-418f-bb2e-e54bbb7d46ac tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:53.061433 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e1a9ab7-442b-418f-bb2e-e54bbb7d46ac tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:53.410480 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8e1a9ab7-442b-418f-bb2e-e54bbb7d46ac tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:53.430253 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8e1a9ab7-442b-418f-bb2e-e54bbb7d46ac tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/85c5c938-83a1-4ca3-b9b1-b05d818f7efc" status: 200 len: 1315 microversion: 2.1 time: 0.426476 Sep 08 10:56:53.439764 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2065/4181] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:53 2022] GET /compute/v2.1/servers/85c5c938-83a1-4ca3-b9b1-b05d818f7efc => generated 1315 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:53.461610 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5b35625b-ac59-4f5b-81cf-8aff8a9bf8df tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:53.468245 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5b35625b-ac59-4f5b-81cf-8aff8a9bf8df tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] [instance: 2d995117-3718-4b9d-a4a1-c1185d34d701] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:53.482998 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b35625b-ac59-4f5b-81cf-8aff8a9bf8df tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:53.486052 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b35625b-ac59-4f5b-81cf-8aff8a9bf8df tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:53.488528 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b35625b-ac59-4f5b-81cf-8aff8a9bf8df tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:53.489837 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b35625b-ac59-4f5b-81cf-8aff8a9bf8df tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:53.492488 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b35625b-ac59-4f5b-81cf-8aff8a9bf8df tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:53.493140 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b35625b-ac59-4f5b-81cf-8aff8a9bf8df tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:54.112933 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-99f1660d-814e-4a36-a179-6b1dbab784ce tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7177ce97ae4fad81993ec8597cfe2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d73ca665b94264a22f7bae7d799cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:54.127373 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-99f1660d-814e-4a36-a179-6b1dbab784ce tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] 10.222.0.27 "GET /compute/v2.1/servers/7c2e066a-8160-4bcd-80be-33091a3e0fac" status: 200 len: 1314 microversion: 2.1 time: 1.309156 Sep 08 10:56:54.128626 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2117/4182] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:52 2022] GET /compute/v2.1/servers/7c2e066a-8160-4bcd-80be-33091a3e0fac => generated 1314 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:54.143542 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1ab44d15-d1f8-41fd-a075-98ef96eca24a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:54.144391 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1ab44d15-d1f8-41fd-a075-98ef96eca24a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:54.154285 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5b35625b-ac59-4f5b-81cf-8aff8a9bf8df tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22145c653c804031ae233de6d84647fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1c70903c3d42d790d9ef96adc1fdbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:54.160616 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1ab44d15-d1f8-41fd-a075-98ef96eca24a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:54.166816 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1ab44d15-d1f8-41fd-a075-98ef96eca24a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:54.167557 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1ab44d15-d1f8-41fd-a075-98ef96eca24a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:54.168782 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1ab44d15-d1f8-41fd-a075-98ef96eca24a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:54.169458 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1ab44d15-d1f8-41fd-a075-98ef96eca24a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:54.170075 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1ab44d15-d1f8-41fd-a075-98ef96eca24a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:54.172089 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5b35625b-ac59-4f5b-81cf-8aff8a9bf8df tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] 10.222.0.27 "GET /compute/v2.1/servers/2d995117-3718-4b9d-a4a1-c1185d34d701" status: 200 len: 1313 microversion: 2.1 time: 0.730454 Sep 08 10:56:54.190103 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2066/4183] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:53 2022] GET /compute/v2.1/servers/2d995117-3718-4b9d-a4a1-c1185d34d701 => generated 1313 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:54.203628 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-549acb69-f475-499d-a85c-79bf0ea8773a tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:54.204257 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-549acb69-f475-499d-a85c-79bf0ea8773a tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] [instance: 51e76f20-555e-4867-a42b-30727dc94169] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:54.239723 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-549acb69-f475-499d-a85c-79bf0ea8773a tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:54.240230 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-549acb69-f475-499d-a85c-79bf0ea8773a tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:54.240673 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-549acb69-f475-499d-a85c-79bf0ea8773a tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:54.248185 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-549acb69-f475-499d-a85c-79bf0ea8773a tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:54.251448 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-549acb69-f475-499d-a85c-79bf0ea8773a tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:54.251915 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-549acb69-f475-499d-a85c-79bf0ea8773a tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:54.871285 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-549acb69-f475-499d-a85c-79bf0ea8773a tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a779e85e1c493985f7cfe8aceb9c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4478d0e315d948df9eda910f205646c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:54.892765 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-549acb69-f475-499d-a85c-79bf0ea8773a tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] 10.222.0.27 "GET /compute/v2.1/servers/51e76f20-555e-4867-a42b-30727dc94169" status: 200 len: 1321 microversion: 2.1 time: 0.701180 Sep 08 10:56:54.894477 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2067/4184] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:54 2022] GET /compute/v2.1/servers/51e76f20-555e-4867-a42b-30727dc94169 => generated 1321 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:54.915770 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1ab44d15-d1f8-41fd-a075-98ef96eca24a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:54.932405 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1ab44d15-d1f8-41fd-a075-98ef96eca24a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1517 microversion: 2.1 time: 0.797023 Sep 08 10:56:54.935815 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2118/4185] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:54 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1517 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:54.941790 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-2c245d7f-8300-4923-a643-9bfb1ba6fbb1 req-cd34cd2a-1672-40d5-81c2-0103c681ca57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85c5c938-83a1-4ca3-b9b1-b05d818f7efc", "name": "network-vif-plugged", "status": "completed", "tag": "bb42ab11-44aa-447c-8de2-2170b134194c"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:56:54.944724 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-759d11d2-df98-4841-9217-3011418a7328 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:54.945714 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-759d11d2-df98-4841-9217-3011418a7328 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 85c5c938-83a1-4ca3-b9b1-b05d818f7efc] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:54.956761 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-759d11d2-df98-4841-9217-3011418a7328 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:54.958250 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-759d11d2-df98-4841-9217-3011418a7328 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:54.959757 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-759d11d2-df98-4841-9217-3011418a7328 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:54.963215 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-759d11d2-df98-4841-9217-3011418a7328 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:54.965245 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-759d11d2-df98-4841-9217-3011418a7328 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:54.966201 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-759d11d2-df98-4841-9217-3011418a7328 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:54.973841 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-2c245d7f-8300-4923-a643-9bfb1ba6fbb1 req-cd34cd2a-1672-40d5-81c2-0103c681ca57 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:54.974343 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-2c245d7f-8300-4923-a643-9bfb1ba6fbb1 req-cd34cd2a-1672-40d5-81c2-0103c681ca57 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:54.974789 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-2c245d7f-8300-4923-a643-9bfb1ba6fbb1 req-cd34cd2a-1672-40d5-81c2-0103c681ca57 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:55.048069 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-2c245d7f-8300-4923-a643-9bfb1ba6fbb1 req-cd34cd2a-1672-40d5-81c2-0103c681ca57 service nova] Creating event network-vif-plugged:bb42ab11-44aa-447c-8de2-2170b134194c for instance 85c5c938-83a1-4ca3-b9b1-b05d818f7efc on n-h2-850501-12 Sep 08 10:56:55.058866 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-2c245d7f-8300-4923-a643-9bfb1ba6fbb1 req-cd34cd2a-1672-40d5-81c2-0103c681ca57 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159779 Sep 08 10:56:55.059829 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2068/4186] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:56:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:56:55.175806 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f48b8dcf-e32b-4696-a941-60e61b384864 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:55.176736 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f48b8dcf-e32b-4696-a941-60e61b384864 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] [instance: 7c2e066a-8160-4bcd-80be-33091a3e0fac] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:55.197118 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f48b8dcf-e32b-4696-a941-60e61b384864 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:55.197960 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f48b8dcf-e32b-4696-a941-60e61b384864 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:55.199617 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f48b8dcf-e32b-4696-a941-60e61b384864 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:55.202929 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f48b8dcf-e32b-4696-a941-60e61b384864 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:55.205070 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f48b8dcf-e32b-4696-a941-60e61b384864 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:55.208103 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f48b8dcf-e32b-4696-a941-60e61b384864 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:55.609238 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-759d11d2-df98-4841-9217-3011418a7328 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:55.632470 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-759d11d2-df98-4841-9217-3011418a7328 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/85c5c938-83a1-4ca3-b9b1-b05d818f7efc" status: 200 len: 1315 microversion: 2.1 time: 0.694419 Sep 08 10:56:55.634026 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2119/4187] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:54 2022] GET /compute/v2.1/servers/85c5c938-83a1-4ca3-b9b1-b05d818f7efc => generated 1315 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:55.674914 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1dbcac04-5e76-4c08-bbaa-be52b5c638fd tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:55.675628 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1dbcac04-5e76-4c08-bbaa-be52b5c638fd tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] [instance: 2d995117-3718-4b9d-a4a1-c1185d34d701] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:55.699023 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1dbcac04-5e76-4c08-bbaa-be52b5c638fd tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:55.699866 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1dbcac04-5e76-4c08-bbaa-be52b5c638fd tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:55.712407 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1dbcac04-5e76-4c08-bbaa-be52b5c638fd tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:55.720777 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1dbcac04-5e76-4c08-bbaa-be52b5c638fd tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:55.721490 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1dbcac04-5e76-4c08-bbaa-be52b5c638fd tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:55.721947 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1dbcac04-5e76-4c08-bbaa-be52b5c638fd tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:55.794593 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f48b8dcf-e32b-4696-a941-60e61b384864 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7177ce97ae4fad81993ec8597cfe2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d73ca665b94264a22f7bae7d799cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:55.811168 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f48b8dcf-e32b-4696-a941-60e61b384864 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] 10.222.0.27 "GET /compute/v2.1/servers/7c2e066a-8160-4bcd-80be-33091a3e0fac" status: 200 len: 1314 microversion: 2.1 time: 0.640632 Sep 08 10:56:55.812160 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2069/4188] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:55 2022] GET /compute/v2.1/servers/7c2e066a-8160-4bcd-80be-33091a3e0fac => generated 1314 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:55.923462 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fa57c1af-6ff1-4759-b1ad-8036b3d672fc tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:55.924077 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fa57c1af-6ff1-4759-b1ad-8036b3d672fc tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] [instance: 51e76f20-555e-4867-a42b-30727dc94169] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:55.941079 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fa57c1af-6ff1-4759-b1ad-8036b3d672fc tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:55.941587 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fa57c1af-6ff1-4759-b1ad-8036b3d672fc tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:55.942026 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fa57c1af-6ff1-4759-b1ad-8036b3d672fc tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:55.942731 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fa57c1af-6ff1-4759-b1ad-8036b3d672fc tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:55.943198 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fa57c1af-6ff1-4759-b1ad-8036b3d672fc tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:55.943609 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fa57c1af-6ff1-4759-b1ad-8036b3d672fc tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:56.063670 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:56:56.485329 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1dbcac04-5e76-4c08-bbaa-be52b5c638fd tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22145c653c804031ae233de6d84647fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1c70903c3d42d790d9ef96adc1fdbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:56.498746 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1dbcac04-5e76-4c08-bbaa-be52b5c638fd tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] 10.222.0.27 "GET /compute/v2.1/servers/2d995117-3718-4b9d-a4a1-c1185d34d701" status: 200 len: 1313 microversion: 2.1 time: 0.863461 Sep 08 10:56:56.500474 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fa57c1af-6ff1-4759-b1ad-8036b3d672fc tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a779e85e1c493985f7cfe8aceb9c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4478d0e315d948df9eda910f205646c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:56.526825 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2120/4189] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:55 2022] GET /compute/v2.1/servers/2d995117-3718-4b9d-a4a1-c1185d34d701 => generated 1313 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:56.551273 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fa57c1af-6ff1-4759-b1ad-8036b3d672fc tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] 10.222.0.27 "GET /compute/v2.1/servers/51e76f20-555e-4867-a42b-30727dc94169" status: 200 len: 1321 microversion: 2.1 time: 0.631485 Sep 08 10:56:56.552607 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2070/4190] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:55 2022] GET /compute/v2.1/servers/51e76f20-555e-4867-a42b-30727dc94169 => generated 1321 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:56.553538 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4bb74aaf-44ca-427a-8325-f300fedc71b1 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:56.554399 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4bb74aaf-44ca-427a-8325-f300fedc71b1 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:56.575622 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4bb74aaf-44ca-427a-8325-f300fedc71b1 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:56.576495 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4bb74aaf-44ca-427a-8325-f300fedc71b1 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:56.577252 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4bb74aaf-44ca-427a-8325-f300fedc71b1 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:56.579985 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4bb74aaf-44ca-427a-8325-f300fedc71b1 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:56.580530 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4bb74aaf-44ca-427a-8325-f300fedc71b1 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:56.581346 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4bb74aaf-44ca-427a-8325-f300fedc71b1 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:56.661486 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1504768e-ebc8-4587-9a36-5f4af4918bcd tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:56.662107 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1504768e-ebc8-4587-9a36-5f4af4918bcd tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 85c5c938-83a1-4ca3-b9b1-b05d818f7efc] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:56.671831 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1504768e-ebc8-4587-9a36-5f4af4918bcd tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:56.672330 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1504768e-ebc8-4587-9a36-5f4af4918bcd tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:56.677194 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1504768e-ebc8-4587-9a36-5f4af4918bcd tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:56.677194 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1504768e-ebc8-4587-9a36-5f4af4918bcd tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:56.677194 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1504768e-ebc8-4587-9a36-5f4af4918bcd tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:56.677194 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1504768e-ebc8-4587-9a36-5f4af4918bcd tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:57.129165 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:56:57.141128 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1504768e-ebc8-4587-9a36-5f4af4918bcd tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:57.169201 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1504768e-ebc8-4587-9a36-5f4af4918bcd tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/85c5c938-83a1-4ca3-b9b1-b05d818f7efc" status: 200 len: 1315 microversion: 2.1 time: 0.508713 Sep 08 10:56:57.173532 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2071/4191] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:56 2022] GET /compute/v2.1/servers/85c5c938-83a1-4ca3-b9b1-b05d818f7efc => generated 1315 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:56:57.206345 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-76577c10-510f-4fc1-8918-26e264c44e17 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:57.224473 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=6 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:56:57.232273 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-76577c10-510f-4fc1-8918-26e264c44e17 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] [instance: 7c2e066a-8160-4bcd-80be-33091a3e0fac] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:57.262208 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76577c10-510f-4fc1-8918-26e264c44e17 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:57.262729 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76577c10-510f-4fc1-8918-26e264c44e17 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:57.271414 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76577c10-510f-4fc1-8918-26e264c44e17 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:57.273354 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76577c10-510f-4fc1-8918-26e264c44e17 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:57.274227 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76577c10-510f-4fc1-8918-26e264c44e17 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:57.278471 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76577c10-510f-4fc1-8918-26e264c44e17 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:57.416955 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4bb74aaf-44ca-427a-8325-f300fedc71b1 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:57.435455 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4bb74aaf-44ca-427a-8325-f300fedc71b1 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1517 microversion: 2.1 time: 0.906622 Sep 08 10:56:57.449760 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2121/4192] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:56 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1517 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:57.463740 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-014687ef-5b0c-4ba3-9086-eb6193d9a52d req-c5918d51-5f88-4aac-a019-9ef1ce5a1fea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c2e066a-8160-4bcd-80be-33091a3e0fac", "name": "network-vif-plugged", "status": "completed", "tag": "585ccf42-903a-4b23-b54e-c5d6e8ffcfd3"}, {"server_uuid": "51e76f20-555e-4867-a42b-30727dc94169", "name": "network-vif-plugged", "status": "completed", "tag": "b769ec83-23f3-4327-8169-ebe5904a41a5"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:56:57.500471 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-014687ef-5b0c-4ba3-9086-eb6193d9a52d req-c5918d51-5f88-4aac-a019-9ef1ce5a1fea service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:57.505792 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-014687ef-5b0c-4ba3-9086-eb6193d9a52d req-c5918d51-5f88-4aac-a019-9ef1ce5a1fea service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:57.506406 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-014687ef-5b0c-4ba3-9086-eb6193d9a52d req-c5918d51-5f88-4aac-a019-9ef1ce5a1fea service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:57.539528 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-014687ef-5b0c-4ba3-9086-eb6193d9a52d req-c5918d51-5f88-4aac-a019-9ef1ce5a1fea service nova] Creating event network-vif-plugged:585ccf42-903a-4b23-b54e-c5d6e8ffcfd3 for instance 7c2e066a-8160-4bcd-80be-33091a3e0fac on n-h1-850501-12 Sep 08 10:56:57.546880 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-014687ef-5b0c-4ba3-9086-eb6193d9a52d req-c5918d51-5f88-4aac-a019-9ef1ce5a1fea service nova] Creating event network-vif-plugged:b769ec83-23f3-4327-8169-ebe5904a41a5 for instance 51e76f20-555e-4867-a42b-30727dc94169 on n-h1-850501-12 Sep 08 10:56:57.569626 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-014687ef-5b0c-4ba3-9086-eb6193d9a52d req-c5918d51-5f88-4aac-a019-9ef1ce5a1fea service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.117477 Sep 08 10:56:57.577187 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2122/4193] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:56:57 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:56:57.585900 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5bb23bdd-9714-4d92-a77e-0c7c427ba494 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:57.594880 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5bb23bdd-9714-4d92-a77e-0c7c427ba494 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: 93d05d86-99b6-43f0-83c7-257ab64a12f3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:57.630886 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5bb23bdd-9714-4d92-a77e-0c7c427ba494 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:57.636782 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5bb23bdd-9714-4d92-a77e-0c7c427ba494 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:57.637501 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5bb23bdd-9714-4d92-a77e-0c7c427ba494 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:57.638408 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5bb23bdd-9714-4d92-a77e-0c7c427ba494 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:57.641063 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5bb23bdd-9714-4d92-a77e-0c7c427ba494 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:57.641763 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5bb23bdd-9714-4d92-a77e-0c7c427ba494 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:57.705832 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:56:57.895274 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-5bb23bdd-9714-4d92-a77e-0c7c427ba494 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lazy-loading 'services' on Instance uuid 93d05d86-99b6-43f0-83c7-257ab64a12f3 {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:56:58.150426 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=100 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:56:58.195099 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5bb23bdd-9714-4d92-a77e-0c7c427ba494 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "DELETE /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3/os-volume_attachments/36d7bab8-c050-4496-aba4-395658e6e896" status: 202 len: 0 microversion: 2.1 time: 0.603100 Sep 08 10:56:58.195099 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2123/4194] 10.222.0.27 () {58 vars in 1416 bytes} [Thu Sep 8 10:56:57 2022] DELETE /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3/os-volume_attachments/36d7bab8-c050-4496-aba4-395658e6e896 => generated 0 bytes in 605 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:56:58.195099 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cbf20126-4568-4a6b-9d80-5879e58517c3 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:58.195099 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cbf20126-4568-4a6b-9d80-5879e58517c3 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] [instance: 2d995117-3718-4b9d-a4a1-c1185d34d701] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:58.201819 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-76577c10-510f-4fc1-8918-26e264c44e17 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7177ce97ae4fad81993ec8597cfe2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d73ca665b94264a22f7bae7d799cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:58.213546 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-76577c10-510f-4fc1-8918-26e264c44e17 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] 10.222.0.27 "GET /compute/v2.1/servers/7c2e066a-8160-4bcd-80be-33091a3e0fac" status: 200 len: 1314 microversion: 2.1 time: 1.037189 Sep 08 10:56:58.219801 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2072/4195] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:57 2022] GET /compute/v2.1/servers/7c2e066a-8160-4bcd-80be-33091a3e0fac => generated 1314 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:58.237277 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fcd0d17a-a79f-46f7-9f5a-aba2172cd2fb tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:58.238955 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cbf20126-4568-4a6b-9d80-5879e58517c3 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:58.239649 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cbf20126-4568-4a6b-9d80-5879e58517c3 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:58.240317 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cbf20126-4568-4a6b-9d80-5879e58517c3 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:58.241268 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cbf20126-4568-4a6b-9d80-5879e58517c3 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:58.252555 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fcd0d17a-a79f-46f7-9f5a-aba2172cd2fb tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] [instance: 51e76f20-555e-4867-a42b-30727dc94169] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:58.255442 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cbf20126-4568-4a6b-9d80-5879e58517c3 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:58.256375 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cbf20126-4568-4a6b-9d80-5879e58517c3 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:58.279242 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fcd0d17a-a79f-46f7-9f5a-aba2172cd2fb tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:58.281520 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fcd0d17a-a79f-46f7-9f5a-aba2172cd2fb tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:58.283079 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fcd0d17a-a79f-46f7-9f5a-aba2172cd2fb tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:58.283079 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fcd0d17a-a79f-46f7-9f5a-aba2172cd2fb tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:58.283656 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fcd0d17a-a79f-46f7-9f5a-aba2172cd2fb tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:58.293652 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fcd0d17a-a79f-46f7-9f5a-aba2172cd2fb tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:58.822522 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-cbf20126-4568-4a6b-9d80-5879e58517c3 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22145c653c804031ae233de6d84647fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1c70903c3d42d790d9ef96adc1fdbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:58.843251 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cbf20126-4568-4a6b-9d80-5879e58517c3 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] 10.222.0.27 "GET /compute/v2.1/servers/2d995117-3718-4b9d-a4a1-c1185d34d701" status: 200 len: 1334 microversion: 2.1 time: 0.657041 Sep 08 10:56:58.845453 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2124/4196] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:58 2022] GET /compute/v2.1/servers/2d995117-3718-4b9d-a4a1-c1185d34d701 => generated 1334 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:58.857896 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-04313fdc-75d3-4f4c-8b3d-e4ae12aa4ae0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:58.859802 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-04313fdc-75d3-4f4c-8b3d-e4ae12aa4ae0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 85c5c938-83a1-4ca3-b9b1-b05d818f7efc] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:58.880051 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-04313fdc-75d3-4f4c-8b3d-e4ae12aa4ae0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:58.881596 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-04313fdc-75d3-4f4c-8b3d-e4ae12aa4ae0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:58.882820 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-04313fdc-75d3-4f4c-8b3d-e4ae12aa4ae0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:58.885085 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-04313fdc-75d3-4f4c-8b3d-e4ae12aa4ae0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:58.885961 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-04313fdc-75d3-4f4c-8b3d-e4ae12aa4ae0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:58.887216 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-04313fdc-75d3-4f4c-8b3d-e4ae12aa4ae0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:59.505740 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-04313fdc-75d3-4f4c-8b3d-e4ae12aa4ae0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:59.523215 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-04313fdc-75d3-4f4c-8b3d-e4ae12aa4ae0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/85c5c938-83a1-4ca3-b9b1-b05d818f7efc" status: 200 len: 1502 microversion: 2.1 time: 0.676274 Sep 08 10:56:59.531044 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2125/4197] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:58 2022] GET /compute/v2.1/servers/85c5c938-83a1-4ca3-b9b1-b05d818f7efc => generated 1502 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:59.556990 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c3ce35de-03eb-45bc-a82b-2bd6fd2bb0c0 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:59.578944 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c3ce35de-03eb-45bc-a82b-2bd6fd2bb0c0 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: 93d05d86-99b6-43f0-83c7-257ab64a12f3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:59.601212 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c3ce35de-03eb-45bc-a82b-2bd6fd2bb0c0 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:59.603848 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c3ce35de-03eb-45bc-a82b-2bd6fd2bb0c0 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:59.605090 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c3ce35de-03eb-45bc-a82b-2bd6fd2bb0c0 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:59.606040 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c3ce35de-03eb-45bc-a82b-2bd6fd2bb0c0 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:59.608144 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c3ce35de-03eb-45bc-a82b-2bd6fd2bb0c0 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:59.610672 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c3ce35de-03eb-45bc-a82b-2bd6fd2bb0c0 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:59.785351 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c3ce35de-03eb-45bc-a82b-2bd6fd2bb0c0 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.251093 Sep 08 10:56:59.789011 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2126/4198] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 10:56:59 2022] GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3/os-volume_attachments => generated 197 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:56:59.804021 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-923c90bb-977d-490c-84b3-ebae86e60fa7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:59.810466 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-923c90bb-977d-490c-84b3-ebae86e60fa7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:59.834967 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-923c90bb-977d-490c-84b3-ebae86e60fa7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:59.837468 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-923c90bb-977d-490c-84b3-ebae86e60fa7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:59.838472 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-923c90bb-977d-490c-84b3-ebae86e60fa7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:59.843612 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-923c90bb-977d-490c-84b3-ebae86e60fa7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:59.844343 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-923c90bb-977d-490c-84b3-ebae86e60fa7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:59.846216 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-923c90bb-977d-490c-84b3-ebae86e60fa7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:00.254576 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fcd0d17a-a79f-46f7-9f5a-aba2172cd2fb tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a779e85e1c493985f7cfe8aceb9c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4478d0e315d948df9eda910f205646c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:00.277363 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fcd0d17a-a79f-46f7-9f5a-aba2172cd2fb tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] 10.222.0.27 "GET /compute/v2.1/servers/51e76f20-555e-4867-a42b-30727dc94169" status: 200 len: 1321 microversion: 2.1 time: 2.048023 Sep 08 10:57:00.286183 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2073/4199] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:58 2022] GET /compute/v2.1/servers/51e76f20-555e-4867-a42b-30727dc94169 => generated 1321 bytes in 2065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:00.310238 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6ff43c36-d7e1-45af-b4ca-16590c3a81e5 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:00.311133 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6ff43c36-d7e1-45af-b4ca-16590c3a81e5 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] [instance: 7c2e066a-8160-4bcd-80be-33091a3e0fac] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:00.321825 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ff43c36-d7e1-45af-b4ca-16590c3a81e5 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:00.322499 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ff43c36-d7e1-45af-b4ca-16590c3a81e5 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:00.323004 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ff43c36-d7e1-45af-b4ca-16590c3a81e5 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:00.324060 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ff43c36-d7e1-45af-b4ca-16590c3a81e5 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:00.327092 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ff43c36-d7e1-45af-b4ca-16590c3a81e5 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:00.328320 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ff43c36-d7e1-45af-b4ca-16590c3a81e5 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:00.694175 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-923c90bb-977d-490c-84b3-ebae86e60fa7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:00.708388 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-923c90bb-977d-490c-84b3-ebae86e60fa7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1517 microversion: 2.1 time: 0.918251 Sep 08 10:57:00.725054 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2127/4200] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:59 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1517 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:00.731467 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-721123fb-db1e-4857-b4c8-73ea6c03af18 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:57:00.734107 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-721123fb-db1e-4857-b4c8-73ea6c03af18 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 85c5c938-83a1-4ca3-b9b1-b05d818f7efc] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:00.766219 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-721123fb-db1e-4857-b4c8-73ea6c03af18 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:00.767290 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-721123fb-db1e-4857-b4c8-73ea6c03af18 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:00.775349 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-721123fb-db1e-4857-b4c8-73ea6c03af18 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:00.780183 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-721123fb-db1e-4857-b4c8-73ea6c03af18 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:00.781745 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-721123fb-db1e-4857-b4c8-73ea6c03af18 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:00.782387 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-721123fb-db1e-4857-b4c8-73ea6c03af18 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:00.902814 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-721123fb-db1e-4857-b4c8-73ea6c03af18 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "POST /compute/v2.1/servers/85c5c938-83a1-4ca3-b9b1-b05d818f7efc/action" status: 200 len: 14 microversion: 2.1 time: 0.187554 Sep 08 10:57:00.904243 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2128/4201] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:57:00 2022] POST /compute/v2.1/servers/85c5c938-83a1-4ca3-b9b1-b05d818f7efc/action => generated 14 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:57:00.905546 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6ff43c36-d7e1-45af-b4ca-16590c3a81e5 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7177ce97ae4fad81993ec8597cfe2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d73ca665b94264a22f7bae7d799cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:00.921004 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-dd63572b-6aa7-40b4-b925-36b21885047e tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:00.924935 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-dd63572b-6aa7-40b4-b925-36b21885047e tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] [instance: 2d995117-3718-4b9d-a4a1-c1185d34d701] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:00.940308 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd63572b-6aa7-40b4-b925-36b21885047e tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:00.940927 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd63572b-6aa7-40b4-b925-36b21885047e tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:00.941511 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd63572b-6aa7-40b4-b925-36b21885047e tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:00.942339 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd63572b-6aa7-40b4-b925-36b21885047e tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:00.945457 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6ff43c36-d7e1-45af-b4ca-16590c3a81e5 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] 10.222.0.27 "GET /compute/v2.1/servers/7c2e066a-8160-4bcd-80be-33091a3e0fac" status: 200 len: 1314 microversion: 2.1 time: 0.657741 Sep 08 10:57:00.946295 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd63572b-6aa7-40b4-b925-36b21885047e tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:00.949357 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd63572b-6aa7-40b4-b925-36b21885047e tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:00.955875 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2074/4202] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:00 2022] GET /compute/v2.1/servers/7c2e066a-8160-4bcd-80be-33091a3e0fac => generated 1314 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:00.974703 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-11c864f4-e2c8-4b99-be92-b81c8ce448eb req-b857e972-89f3-4eb7-beb1-2260f70997c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d995117-3718-4b9d-a4a1-c1185d34d701", "tag": "7ec9baef-5ccd-4968-99a9-d96da1b42bf3"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:57:01.007840 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-11c864f4-e2c8-4b99-be92-b81c8ce448eb req-b857e972-89f3-4eb7-beb1-2260f70997c7 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:01.008785 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-11c864f4-e2c8-4b99-be92-b81c8ce448eb req-b857e972-89f3-4eb7-beb1-2260f70997c7 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:01.009463 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-11c864f4-e2c8-4b99-be92-b81c8ce448eb req-b857e972-89f3-4eb7-beb1-2260f70997c7 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:01.049237 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-11c864f4-e2c8-4b99-be92-b81c8ce448eb req-b857e972-89f3-4eb7-beb1-2260f70997c7 service nova] Creating event network-changed:7ec9baef-5ccd-4968-99a9-d96da1b42bf3 for instance 2d995117-3718-4b9d-a4a1-c1185d34d701 on n-h2-850501-12 Sep 08 10:57:01.070119 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-11c864f4-e2c8-4b99-be92-b81c8ce448eb req-b857e972-89f3-4eb7-beb1-2260f70997c7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111171 Sep 08 10:57:01.071294 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2075/4203] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:57:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:57:01.082521 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c2bf7955-3bfa-4472-808f-892272db86b3 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:01.087890 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c2bf7955-3bfa-4472-808f-892272db86b3 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: 93d05d86-99b6-43f0-83c7-257ab64a12f3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:01.103588 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2bf7955-3bfa-4472-808f-892272db86b3 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:01.105428 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2bf7955-3bfa-4472-808f-892272db86b3 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:01.106092 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2bf7955-3bfa-4472-808f-892272db86b3 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:01.108194 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2bf7955-3bfa-4472-808f-892272db86b3 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:01.109188 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2bf7955-3bfa-4472-808f-892272db86b3 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:01.110200 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2bf7955-3bfa-4472-808f-892272db86b3 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:01.167019 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c2bf7955-3bfa-4472-808f-892272db86b3 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093437 Sep 08 10:57:01.168645 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2076/4204] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 10:57:01 2022] GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:57:01.329304 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a8de7f07-c434-4fa7-90e3-31dafd843a2b tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:01.330061 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a8de7f07-c434-4fa7-90e3-31dafd843a2b tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] [instance: 51e76f20-555e-4867-a42b-30727dc94169] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:01.343915 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a8de7f07-c434-4fa7-90e3-31dafd843a2b tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:01.356395 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a8de7f07-c434-4fa7-90e3-31dafd843a2b tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:01.356864 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a8de7f07-c434-4fa7-90e3-31dafd843a2b tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:01.357663 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a8de7f07-c434-4fa7-90e3-31dafd843a2b tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:01.358521 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a8de7f07-c434-4fa7-90e3-31dafd843a2b tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:01.358967 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a8de7f07-c434-4fa7-90e3-31dafd843a2b tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:01.599746 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-dd63572b-6aa7-40b4-b925-36b21885047e tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22145c653c804031ae233de6d84647fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1c70903c3d42d790d9ef96adc1fdbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:01.609879 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-dd63572b-6aa7-40b4-b925-36b21885047e tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] 10.222.0.27 "GET /compute/v2.1/servers/2d995117-3718-4b9d-a4a1-c1185d34d701" status: 200 len: 1334 microversion: 2.1 time: 0.700912 Sep 08 10:57:01.612660 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2129/4205] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:00 2022] GET /compute/v2.1/servers/2d995117-3718-4b9d-a4a1-c1185d34d701 => generated 1334 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:01.739821 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9fd0590d-44c1-4b77-9243-623298528e3b tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:01.741372 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9fd0590d-44c1-4b77-9243-623298528e3b tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:01.749716 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9fd0590d-44c1-4b77-9243-623298528e3b tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:01.750597 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9fd0590d-44c1-4b77-9243-623298528e3b tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:01.751576 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9fd0590d-44c1-4b77-9243-623298528e3b tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:01.753102 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9fd0590d-44c1-4b77-9243-623298528e3b tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:01.754048 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9fd0590d-44c1-4b77-9243-623298528e3b tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:01.754850 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9fd0590d-44c1-4b77-9243-623298528e3b tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:01.939496 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a8de7f07-c434-4fa7-90e3-31dafd843a2b tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a779e85e1c493985f7cfe8aceb9c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4478d0e315d948df9eda910f205646c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:01.950665 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a8de7f07-c434-4fa7-90e3-31dafd843a2b tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] 10.222.0.27 "GET /compute/v2.1/servers/51e76f20-555e-4867-a42b-30727dc94169" status: 200 len: 1321 microversion: 2.1 time: 0.625432 Sep 08 10:57:01.962631 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2077/4206] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:01 2022] GET /compute/v2.1/servers/51e76f20-555e-4867-a42b-30727dc94169 => generated 1321 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:01.982202 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-42c0dac9-1d49-4719-8639-fa908756a902 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:57:01.985844 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-42c0dac9-1d49-4719-8639-fa908756a902 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 85c5c938-83a1-4ca3-b9b1-b05d818f7efc] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:02.002897 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42c0dac9-1d49-4719-8639-fa908756a902 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:02.005222 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42c0dac9-1d49-4719-8639-fa908756a902 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:02.006004 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42c0dac9-1d49-4719-8639-fa908756a902 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:02.007629 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42c0dac9-1d49-4719-8639-fa908756a902 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:02.009990 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42c0dac9-1d49-4719-8639-fa908756a902 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:02.013719 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42c0dac9-1d49-4719-8639-fa908756a902 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:02.109493 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-42c0dac9-1d49-4719-8639-fa908756a902 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "POST /compute/v2.1/servers/85c5c938-83a1-4ca3-b9b1-b05d818f7efc/action" status: 200 len: 14 microversion: 2.1 time: 0.145103 Sep 08 10:57:02.110559 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2078/4207] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:57:01 2022] POST /compute/v2.1/servers/85c5c938-83a1-4ca3-b9b1-b05d818f7efc/action => generated 14 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:57:02.138524 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6202f5aa-02b5-4857-8d24-8ec87d6b5fcc tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:02.139576 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6202f5aa-02b5-4857-8d24-8ec87d6b5fcc tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] [instance: 7c2e066a-8160-4bcd-80be-33091a3e0fac] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:02.152292 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6202f5aa-02b5-4857-8d24-8ec87d6b5fcc tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:02.157872 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6202f5aa-02b5-4857-8d24-8ec87d6b5fcc tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:02.158669 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6202f5aa-02b5-4857-8d24-8ec87d6b5fcc tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:02.160276 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6202f5aa-02b5-4857-8d24-8ec87d6b5fcc tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:02.161205 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6202f5aa-02b5-4857-8d24-8ec87d6b5fcc tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:02.161816 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6202f5aa-02b5-4857-8d24-8ec87d6b5fcc tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:02.833231 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9fd0590d-44c1-4b77-9243-623298528e3b tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:02.865110 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9fd0590d-44c1-4b77-9243-623298528e3b tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1517 microversion: 2.1 time: 1.128886 Sep 08 10:57:02.868326 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2130/4208] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:01 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1517 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:02.903106 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-620fa2de-bb9e-47c0-a806-cfacff5dd533 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:02.927590 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-620fa2de-bb9e-47c0-a806-cfacff5dd533 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: 93d05d86-99b6-43f0-83c7-257ab64a12f3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:02.958108 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-620fa2de-bb9e-47c0-a806-cfacff5dd533 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:02.958630 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-620fa2de-bb9e-47c0-a806-cfacff5dd533 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:02.972203 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-620fa2de-bb9e-47c0-a806-cfacff5dd533 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:02.976481 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-620fa2de-bb9e-47c0-a806-cfacff5dd533 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:02.982046 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-620fa2de-bb9e-47c0-a806-cfacff5dd533 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:02.983150 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-620fa2de-bb9e-47c0-a806-cfacff5dd533 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:03.155287 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6202f5aa-02b5-4857-8d24-8ec87d6b5fcc tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7177ce97ae4fad81993ec8597cfe2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d73ca665b94264a22f7bae7d799cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:03.204223 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6202f5aa-02b5-4857-8d24-8ec87d6b5fcc tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] 10.222.0.27 "GET /compute/v2.1/servers/7c2e066a-8160-4bcd-80be-33091a3e0fac" status: 200 len: 1314 microversion: 2.1 time: 1.091321 Sep 08 10:57:03.212182 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2079/4209] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:02 2022] GET /compute/v2.1/servers/7c2e066a-8160-4bcd-80be-33091a3e0fac => generated 1314 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:03.233823 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8f6e23e5-96b4-4e99-b593-a2a333a6c03f tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:03.238341 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8f6e23e5-96b4-4e99-b593-a2a333a6c03f tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] [instance: 2d995117-3718-4b9d-a4a1-c1185d34d701] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:03.250055 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-620fa2de-bb9e-47c0-a806-cfacff5dd533 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.377028 Sep 08 10:57:03.252570 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2131/4210] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 10:57:02 2022] GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3/os-volume_attachments => generated 197 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:57:03.266104 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-abb5a0e8-51ee-4ca0-a3fd-bf829e8969d2 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:03.268342 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-abb5a0e8-51ee-4ca0-a3fd-bf829e8969d2 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] [instance: 51e76f20-555e-4867-a42b-30727dc94169] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:03.277719 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f6e23e5-96b4-4e99-b593-a2a333a6c03f tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:03.280553 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f6e23e5-96b4-4e99-b593-a2a333a6c03f tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:03.284098 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f6e23e5-96b4-4e99-b593-a2a333a6c03f tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:03.286265 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f6e23e5-96b4-4e99-b593-a2a333a6c03f tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:03.291093 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-abb5a0e8-51ee-4ca0-a3fd-bf829e8969d2 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:03.291666 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-abb5a0e8-51ee-4ca0-a3fd-bf829e8969d2 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:03.295392 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-abb5a0e8-51ee-4ca0-a3fd-bf829e8969d2 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:03.296995 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-abb5a0e8-51ee-4ca0-a3fd-bf829e8969d2 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:03.297789 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-abb5a0e8-51ee-4ca0-a3fd-bf829e8969d2 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:03.298276 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-abb5a0e8-51ee-4ca0-a3fd-bf829e8969d2 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:03.308885 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f6e23e5-96b4-4e99-b593-a2a333a6c03f tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:03.312847 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f6e23e5-96b4-4e99-b593-a2a333a6c03f tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:03.888737 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8f6e23e5-96b4-4e99-b593-a2a333a6c03f tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22145c653c804031ae233de6d84647fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1c70903c3d42d790d9ef96adc1fdbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:03.903301 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-abb5a0e8-51ee-4ca0-a3fd-bf829e8969d2 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a779e85e1c493985f7cfe8aceb9c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4478d0e315d948df9eda910f205646c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:03.910651 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8f6e23e5-96b4-4e99-b593-a2a333a6c03f tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] 10.222.0.27 "GET /compute/v2.1/servers/2d995117-3718-4b9d-a4a1-c1185d34d701" status: 200 len: 1334 microversion: 2.1 time: 0.693926 Sep 08 10:57:03.915357 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2080/4211] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:03 2022] GET /compute/v2.1/servers/2d995117-3718-4b9d-a4a1-c1185d34d701 => generated 1334 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:03.924262 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-abb5a0e8-51ee-4ca0-a3fd-bf829e8969d2 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] 10.222.0.27 "GET /compute/v2.1/servers/51e76f20-555e-4867-a42b-30727dc94169" status: 200 len: 1321 microversion: 2.1 time: 0.667839 Sep 08 10:57:03.935432 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2132/4212] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:03 2022] GET /compute/v2.1/servers/51e76f20-555e-4867-a42b-30727dc94169 => generated 1321 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:03.952845 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-5d4da779-bb01-4e20-a165-21682e003903 req-66a94df8-1a78-4b7c-91bc-c838a32a47cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d995117-3718-4b9d-a4a1-c1185d34d701", "tag": "e7a41aa4-591c-472d-b711-40d5b75d5929"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:57:03.963134 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6183a8a5-6d94-4272-8a44-72c53a52ca8f tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:57:03.966290 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6183a8a5-6d94-4272-8a44-72c53a52ca8f tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 85c5c938-83a1-4ca3-b9b1-b05d818f7efc] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:03.983974 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6183a8a5-6d94-4272-8a44-72c53a52ca8f tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:03.984562 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6183a8a5-6d94-4272-8a44-72c53a52ca8f tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:03.985338 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6183a8a5-6d94-4272-8a44-72c53a52ca8f tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:03.986908 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6183a8a5-6d94-4272-8a44-72c53a52ca8f tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:03.987982 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6183a8a5-6d94-4272-8a44-72c53a52ca8f tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:03.988751 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6183a8a5-6d94-4272-8a44-72c53a52ca8f tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:03.989792 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-5d4da779-bb01-4e20-a165-21682e003903 req-66a94df8-1a78-4b7c-91bc-c838a32a47cf service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:03.993506 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-5d4da779-bb01-4e20-a165-21682e003903 req-66a94df8-1a78-4b7c-91bc-c838a32a47cf service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:03.994102 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-5d4da779-bb01-4e20-a165-21682e003903 req-66a94df8-1a78-4b7c-91bc-c838a32a47cf service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:04.049727 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-5d4da779-bb01-4e20-a165-21682e003903 req-66a94df8-1a78-4b7c-91bc-c838a32a47cf service nova] Creating event network-changed:e7a41aa4-591c-472d-b711-40d5b75d5929 for instance 2d995117-3718-4b9d-a4a1-c1185d34d701 on n-h2-850501-12 Sep 08 10:57:04.054553 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6183a8a5-6d94-4272-8a44-72c53a52ca8f tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "POST /compute/v2.1/servers/85c5c938-83a1-4ca3-b9b1-b05d818f7efc/action" status: 200 len: 14 microversion: 2.1 time: 0.106825 Sep 08 10:57:04.056194 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2081/4213] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:57:03 2022] POST /compute/v2.1/servers/85c5c938-83a1-4ca3-b9b1-b05d818f7efc/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:57:04.070734 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0cb4eca1-81d6-460a-a637-39a7e4a0c7b9 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:04.071464 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0cb4eca1-81d6-460a-a637-39a7e4a0c7b9 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:04.096058 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-5d4da779-bb01-4e20-a165-21682e003903 req-66a94df8-1a78-4b7c-91bc-c838a32a47cf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147650 Sep 08 10:57:04.102821 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0cb4eca1-81d6-460a-a637-39a7e4a0c7b9 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:04.103322 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0cb4eca1-81d6-460a-a637-39a7e4a0c7b9 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:04.109429 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2133/4214] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:57:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:57:04.110994 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0cb4eca1-81d6-460a-a637-39a7e4a0c7b9 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:04.111803 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0cb4eca1-81d6-460a-a637-39a7e4a0c7b9 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:04.112307 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0cb4eca1-81d6-460a-a637-39a7e4a0c7b9 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:04.112753 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0cb4eca1-81d6-460a-a637-39a7e4a0c7b9 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:04.259673 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6194c5ef-2eae-41db-8328-7f03c49dab9f tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:04.260760 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6194c5ef-2eae-41db-8328-7f03c49dab9f tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] [instance: 7c2e066a-8160-4bcd-80be-33091a3e0fac] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:04.278056 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6194c5ef-2eae-41db-8328-7f03c49dab9f tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:04.281392 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6194c5ef-2eae-41db-8328-7f03c49dab9f tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:04.282582 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6194c5ef-2eae-41db-8328-7f03c49dab9f tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:04.284264 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6194c5ef-2eae-41db-8328-7f03c49dab9f tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:04.290212 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6194c5ef-2eae-41db-8328-7f03c49dab9f tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:04.291127 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6194c5ef-2eae-41db-8328-7f03c49dab9f tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:04.735668 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0cb4eca1-81d6-460a-a637-39a7e4a0c7b9 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:04.755844 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0cb4eca1-81d6-460a-a637-39a7e4a0c7b9 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1517 microversion: 2.1 time: 0.698133 Sep 08 10:57:04.760130 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2082/4215] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:04 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1517 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:04.785849 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-321b4320-2acc-4d58-ae35-9a1e36c8edbc tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:04.788425 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-321b4320-2acc-4d58-ae35-9a1e36c8edbc tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: 93d05d86-99b6-43f0-83c7-257ab64a12f3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:04.799385 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-321b4320-2acc-4d58-ae35-9a1e36c8edbc tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:04.800400 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-321b4320-2acc-4d58-ae35-9a1e36c8edbc tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:04.801137 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-321b4320-2acc-4d58-ae35-9a1e36c8edbc tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:04.803332 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-321b4320-2acc-4d58-ae35-9a1e36c8edbc tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:04.809280 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-321b4320-2acc-4d58-ae35-9a1e36c8edbc tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:04.810144 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-321b4320-2acc-4d58-ae35-9a1e36c8edbc tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:04.847094 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6194c5ef-2eae-41db-8328-7f03c49dab9f tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7177ce97ae4fad81993ec8597cfe2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d73ca665b94264a22f7bae7d799cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:04.860353 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6194c5ef-2eae-41db-8328-7f03c49dab9f tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] 10.222.0.27 "GET /compute/v2.1/servers/7c2e066a-8160-4bcd-80be-33091a3e0fac" status: 200 len: 1502 microversion: 2.1 time: 0.614636 Sep 08 10:57:04.878868 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-321b4320-2acc-4d58-ae35-9a1e36c8edbc tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103490 Sep 08 10:57:04.879868 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2083/4216] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 10:57:04 2022] GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:57:04.883916 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2134/4217] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:04 2022] GET /compute/v2.1/servers/7c2e066a-8160-4bcd-80be-33091a3e0fac => generated 1502 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:04.914948 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-69ad2e7b-101a-40a4-ae30-0e3f04187351 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:04.917140 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-69ad2e7b-101a-40a4-ae30-0e3f04187351 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] [instance: 7c2e066a-8160-4bcd-80be-33091a3e0fac] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:04.946189 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-69ad2e7b-101a-40a4-ae30-0e3f04187351 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:04.946189 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-69ad2e7b-101a-40a4-ae30-0e3f04187351 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:04.946189 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-69ad2e7b-101a-40a4-ae30-0e3f04187351 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:04.946189 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-69ad2e7b-101a-40a4-ae30-0e3f04187351 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:04.946189 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-69ad2e7b-101a-40a4-ae30-0e3f04187351 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:04.946189 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-69ad2e7b-101a-40a4-ae30-0e3f04187351 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:04.958694 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f52df768-ae8c-48a3-9c11-682713184a9a tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:04.968729 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f52df768-ae8c-48a3-9c11-682713184a9a tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] [instance: 2d995117-3718-4b9d-a4a1-c1185d34d701] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:05.017349 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f52df768-ae8c-48a3-9c11-682713184a9a tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:05.018429 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f52df768-ae8c-48a3-9c11-682713184a9a tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:05.019970 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f52df768-ae8c-48a3-9c11-682713184a9a tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:05.020871 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f52df768-ae8c-48a3-9c11-682713184a9a tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:05.023826 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f52df768-ae8c-48a3-9c11-682713184a9a tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:05.024808 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f52df768-ae8c-48a3-9c11-682713184a9a tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:05.218358 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-69ad2e7b-101a-40a4-ae30-0e3f04187351 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7c2e066a-8160-4bcd-80be-33091a3e0fac/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.308250 Sep 08 10:57:05.225691 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2084/4218] 10.222.0.27 () {58 vars in 1296 bytes} [Thu Sep 8 10:57:04 2022] DELETE /compute/v2.1/servers/7c2e066a-8160-4bcd-80be-33091a3e0fac/os-server-password => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 10:57:05.242790 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-62ff8772-ac5e-4cbc-a1b1-b8872ff3e292 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:05.246433 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-62ff8772-ac5e-4cbc-a1b1-b8872ff3e292 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] [instance: 51e76f20-555e-4867-a42b-30727dc94169] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:05.272738 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-62ff8772-ac5e-4cbc-a1b1-b8872ff3e292 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:05.273660 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-62ff8772-ac5e-4cbc-a1b1-b8872ff3e292 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:05.274527 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-62ff8772-ac5e-4cbc-a1b1-b8872ff3e292 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:05.275533 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-62ff8772-ac5e-4cbc-a1b1-b8872ff3e292 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:05.279276 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-62ff8772-ac5e-4cbc-a1b1-b8872ff3e292 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:05.281096 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-62ff8772-ac5e-4cbc-a1b1-b8872ff3e292 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:05.390188 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f52df768-ae8c-48a3-9c11-682713184a9a tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22145c653c804031ae233de6d84647fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1c70903c3d42d790d9ef96adc1fdbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:05.434104 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f52df768-ae8c-48a3-9c11-682713184a9a tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] 10.222.0.27 "GET /compute/v2.1/servers/2d995117-3718-4b9d-a4a1-c1185d34d701" status: 200 len: 1334 microversion: 2.1 time: 0.477960 Sep 08 10:57:05.441435 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2135/4219] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:04 2022] GET /compute/v2.1/servers/2d995117-3718-4b9d-a4a1-c1185d34d701 => generated 1334 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:05.474627 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3f92f01c-7923-4c0b-bee9-efa31b2e945d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:57:05.482241 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3f92f01c-7923-4c0b-bee9-efa31b2e945d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 85c5c938-83a1-4ca3-b9b1-b05d818f7efc] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:05.489689 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3f92f01c-7923-4c0b-bee9-efa31b2e945d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:05.490453 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3f92f01c-7923-4c0b-bee9-efa31b2e945d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:05.491263 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3f92f01c-7923-4c0b-bee9-efa31b2e945d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:05.492155 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3f92f01c-7923-4c0b-bee9-efa31b2e945d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:05.493324 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3f92f01c-7923-4c0b-bee9-efa31b2e945d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:05.493927 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3f92f01c-7923-4c0b-bee9-efa31b2e945d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:05.628111 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3f92f01c-7923-4c0b-bee9-efa31b2e945d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "POST /compute/v2.1/servers/85c5c938-83a1-4ca3-b9b1-b05d818f7efc/action" status: 200 len: 14 microversion: 2.1 time: 0.182795 Sep 08 10:57:05.645051 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2136/4220] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:57:05 2022] POST /compute/v2.1/servers/85c5c938-83a1-4ca3-b9b1-b05d818f7efc/action => generated 14 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:57:05.667947 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-936fe581-91d3-414c-92aa-b69100d7197f tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:05.668818 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-936fe581-91d3-414c-92aa-b69100d7197f tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] [instance: 7c2e066a-8160-4bcd-80be-33091a3e0fac] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:05.704170 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-936fe581-91d3-414c-92aa-b69100d7197f tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:05.704969 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-936fe581-91d3-414c-92aa-b69100d7197f tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:05.705778 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-936fe581-91d3-414c-92aa-b69100d7197f tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:05.707050 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-936fe581-91d3-414c-92aa-b69100d7197f tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:05.707863 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-936fe581-91d3-414c-92aa-b69100d7197f tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:05.708619 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-936fe581-91d3-414c-92aa-b69100d7197f tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:05.841639 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-936fe581-91d3-414c-92aa-b69100d7197f tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] 10.222.0.27 "GET /compute/v2.1/servers/7c2e066a-8160-4bcd-80be-33091a3e0fac/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.194394 Sep 08 10:57:05.854500 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2137/4221] 10.222.0.27 () {58 vars in 1293 bytes} [Thu Sep 8 10:57:05 2022] GET /compute/v2.1/servers/7c2e066a-8160-4bcd-80be-33091a3e0fac/os-server-password => generated 16 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:57:05.875921 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7325587b-5a70-493a-8f1b-e3fa0a42356c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:05.876970 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7325587b-5a70-493a-8f1b-e3fa0a42356c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:05.907779 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7325587b-5a70-493a-8f1b-e3fa0a42356c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:05.908699 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7325587b-5a70-493a-8f1b-e3fa0a42356c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:05.912349 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7325587b-5a70-493a-8f1b-e3fa0a42356c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:05.913521 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7325587b-5a70-493a-8f1b-e3fa0a42356c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:05.914173 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7325587b-5a70-493a-8f1b-e3fa0a42356c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:05.914776 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7325587b-5a70-493a-8f1b-e3fa0a42356c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:06.353805 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-62ff8772-ac5e-4cbc-a1b1-b8872ff3e292 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a779e85e1c493985f7cfe8aceb9c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4478d0e315d948df9eda910f205646c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:06.381867 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-62ff8772-ac5e-4cbc-a1b1-b8872ff3e292 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] 10.222.0.27 "GET /compute/v2.1/servers/51e76f20-555e-4867-a42b-30727dc94169" status: 200 len: 1321 microversion: 2.1 time: 1.149713 Sep 08 10:57:06.398379 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2085/4222] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:05 2022] GET /compute/v2.1/servers/51e76f20-555e-4867-a42b-30727dc94169 => generated 1321 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:06.426440 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-065a0fce-d5f0-40ef-85c7-fd9f4dcc3400 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:06.427362 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-065a0fce-d5f0-40ef-85c7-fd9f4dcc3400 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] [instance: 7c2e066a-8160-4bcd-80be-33091a3e0fac] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:06.438955 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-065a0fce-d5f0-40ef-85c7-fd9f4dcc3400 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:06.440475 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-065a0fce-d5f0-40ef-85c7-fd9f4dcc3400 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:06.441222 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-065a0fce-d5f0-40ef-85c7-fd9f4dcc3400 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:06.442249 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-065a0fce-d5f0-40ef-85c7-fd9f4dcc3400 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:06.443653 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-065a0fce-d5f0-40ef-85c7-fd9f4dcc3400 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:06.445149 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-065a0fce-d5f0-40ef-85c7-fd9f4dcc3400 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:06.496583 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-065a0fce-d5f0-40ef-85c7-fd9f4dcc3400 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] [instance: 7c2e066a-8160-4bcd-80be-33091a3e0fac] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:57:06.539571 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=4 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:57:06.632676 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-065a0fce-d5f0-40ef-85c7-fd9f4dcc3400 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7c2e066a-8160-4bcd-80be-33091a3e0fac" status: 204 len: 0 microversion: 2.1 time: 0.231473 Sep 08 10:57:06.637070 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2086/4223] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:57:06 2022] DELETE /compute/v2.1/servers/7c2e066a-8160-4bcd-80be-33091a3e0fac => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:57:06.648867 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-aca2c552-c9c6-4fb6-b14d-25bae9cebda9 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:06.653398 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-aca2c552-c9c6-4fb6-b14d-25bae9cebda9 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: 93d05d86-99b6-43f0-83c7-257ab64a12f3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:06.664546 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aca2c552-c9c6-4fb6-b14d-25bae9cebda9 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:06.665492 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aca2c552-c9c6-4fb6-b14d-25bae9cebda9 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:06.666153 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aca2c552-c9c6-4fb6-b14d-25bae9cebda9 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:06.667681 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aca2c552-c9c6-4fb6-b14d-25bae9cebda9 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:06.668494 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aca2c552-c9c6-4fb6-b14d-25bae9cebda9 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:06.669280 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aca2c552-c9c6-4fb6-b14d-25bae9cebda9 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:06.761743 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-aca2c552-c9c6-4fb6-b14d-25bae9cebda9 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.123256 Sep 08 10:57:06.767800 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2087/4224] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 10:57:06 2022] GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:57:06.813067 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d7236f26-a32c-48da-af6e-e6ec00611c44 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:06.815329 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d7236f26-a32c-48da-af6e-e6ec00611c44 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] [instance: 2d995117-3718-4b9d-a4a1-c1185d34d701] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:06.846471 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d7236f26-a32c-48da-af6e-e6ec00611c44 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:06.847564 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d7236f26-a32c-48da-af6e-e6ec00611c44 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:06.848678 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d7236f26-a32c-48da-af6e-e6ec00611c44 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:06.854810 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d7236f26-a32c-48da-af6e-e6ec00611c44 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:06.855974 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d7236f26-a32c-48da-af6e-e6ec00611c44 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:06.856772 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d7236f26-a32c-48da-af6e-e6ec00611c44 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:06.931037 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7325587b-5a70-493a-8f1b-e3fa0a42356c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:06.942647 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7325587b-5a70-493a-8f1b-e3fa0a42356c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1517 microversion: 2.1 time: 1.085223 Sep 08 10:57:06.944146 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2138/4225] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:05 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1517 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:06.962423 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c471a3e1-e6c2-4d96-8611-01d6dbc5f32c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:57:06.967146 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c471a3e1-e6c2-4d96-8611-01d6dbc5f32c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 85c5c938-83a1-4ca3-b9b1-b05d818f7efc] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:06.985477 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c471a3e1-e6c2-4d96-8611-01d6dbc5f32c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:06.986271 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c471a3e1-e6c2-4d96-8611-01d6dbc5f32c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:06.987198 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c471a3e1-e6c2-4d96-8611-01d6dbc5f32c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:06.988648 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c471a3e1-e6c2-4d96-8611-01d6dbc5f32c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:06.989668 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c471a3e1-e6c2-4d96-8611-01d6dbc5f32c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:06.990803 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c471a3e1-e6c2-4d96-8611-01d6dbc5f32c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:07.798428 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d7236f26-a32c-48da-af6e-e6ec00611c44 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22145c653c804031ae233de6d84647fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1c70903c3d42d790d9ef96adc1fdbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:07.817171 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d7236f26-a32c-48da-af6e-e6ec00611c44 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] 10.222.0.27 "GET /compute/v2.1/servers/2d995117-3718-4b9d-a4a1-c1185d34d701" status: 200 len: 1334 microversion: 2.1 time: 1.051790 Sep 08 10:57:07.818013 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2088/4226] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:06 2022] GET /compute/v2.1/servers/2d995117-3718-4b9d-a4a1-c1185d34d701 => generated 1334 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:07.839258 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-47508c06-5385-4960-b6a2-7b4ac8f57cde tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:07.839938 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-47508c06-5385-4960-b6a2-7b4ac8f57cde tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] [instance: 7c2e066a-8160-4bcd-80be-33091a3e0fac] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:07.865437 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-47508c06-5385-4960-b6a2-7b4ac8f57cde tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:07.865964 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-47508c06-5385-4960-b6a2-7b4ac8f57cde tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:07.866424 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-47508c06-5385-4960-b6a2-7b4ac8f57cde tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:07.867202 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-47508c06-5385-4960-b6a2-7b4ac8f57cde tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:07.867678 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-47508c06-5385-4960-b6a2-7b4ac8f57cde tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:07.868118 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-47508c06-5385-4960-b6a2-7b4ac8f57cde tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:08.150921 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c471a3e1-e6c2-4d96-8611-01d6dbc5f32c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "POST /compute/v2.1/servers/85c5c938-83a1-4ca3-b9b1-b05d818f7efc/action" status: 200 len: 14 microversion: 2.1 time: 1.205332 Sep 08 10:57:08.153207 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2139/4227] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:57:06 2022] POST /compute/v2.1/servers/85c5c938-83a1-4ca3-b9b1-b05d818f7efc/action => generated 14 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:57:08.160386 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ec4099d2-6aec-4648-9785-8ff7aed4437d tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:08.161956 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ec4099d2-6aec-4648-9785-8ff7aed4437d tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] [instance: 51e76f20-555e-4867-a42b-30727dc94169] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:08.170234 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ec4099d2-6aec-4648-9785-8ff7aed4437d tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:08.170978 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ec4099d2-6aec-4648-9785-8ff7aed4437d tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:08.171584 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ec4099d2-6aec-4648-9785-8ff7aed4437d tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:08.172477 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ec4099d2-6aec-4648-9785-8ff7aed4437d tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:08.173966 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ec4099d2-6aec-4648-9785-8ff7aed4437d tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:08.174563 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ec4099d2-6aec-4648-9785-8ff7aed4437d tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:08.446429 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-47508c06-5385-4960-b6a2-7b4ac8f57cde tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7177ce97ae4fad81993ec8597cfe2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d73ca665b94264a22f7bae7d799cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:08.493691 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-47508c06-5385-4960-b6a2-7b4ac8f57cde tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] 10.222.0.27 "GET /compute/v2.1/servers/7c2e066a-8160-4bcd-80be-33091a3e0fac" status: 200 len: 1508 microversion: 2.1 time: 0.673875 Sep 08 10:57:08.497656 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2089/4228] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:07 2022] GET /compute/v2.1/servers/7c2e066a-8160-4bcd-80be-33091a3e0fac => generated 1508 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:08.504136 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8e08fc30-cc6d-49f0-9385-4316d0865c78 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:08.507975 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8e08fc30-cc6d-49f0-9385-4316d0865c78 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: 93d05d86-99b6-43f0-83c7-257ab64a12f3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:08.515494 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e08fc30-cc6d-49f0-9385-4316d0865c78 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:08.516897 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e08fc30-cc6d-49f0-9385-4316d0865c78 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:08.517625 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e08fc30-cc6d-49f0-9385-4316d0865c78 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:08.518652 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e08fc30-cc6d-49f0-9385-4316d0865c78 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:08.519354 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e08fc30-cc6d-49f0-9385-4316d0865c78 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:08.519804 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e08fc30-cc6d-49f0-9385-4316d0865c78 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:08.577083 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8e08fc30-cc6d-49f0-9385-4316d0865c78 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.077311 Sep 08 10:57:08.581429 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2090/4229] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 10:57:08 2022] GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3/os-volume_attachments => generated 25 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:57:08.594656 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6ce78838-7f1c-4100-bb36-60a1fbacd45d tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:08.595310 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6ce78838-7f1c-4100-bb36-60a1fbacd45d tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:08.616682 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ec4099d2-6aec-4648-9785-8ff7aed4437d tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a779e85e1c493985f7cfe8aceb9c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4478d0e315d948df9eda910f205646c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:08.629083 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ce78838-7f1c-4100-bb36-60a1fbacd45d tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:08.629551 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ce78838-7f1c-4100-bb36-60a1fbacd45d tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:08.630008 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ce78838-7f1c-4100-bb36-60a1fbacd45d tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:08.630758 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ce78838-7f1c-4100-bb36-60a1fbacd45d tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:08.631223 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ce78838-7f1c-4100-bb36-60a1fbacd45d tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:08.631672 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ce78838-7f1c-4100-bb36-60a1fbacd45d tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:08.641857 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ec4099d2-6aec-4648-9785-8ff7aed4437d tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] 10.222.0.27 "GET /compute/v2.1/servers/51e76f20-555e-4867-a42b-30727dc94169" status: 200 len: 1511 microversion: 2.1 time: 0.486594 Sep 08 10:57:08.643321 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2140/4230] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:08 2022] GET /compute/v2.1/servers/51e76f20-555e-4867-a42b-30727dc94169 => generated 1511 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:08.676787 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b8346309-bd42-4544-a2c6-307f57f8f2a5 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:08.688440 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b8346309-bd42-4544-a2c6-307f57f8f2a5 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] [instance: 931569b4-139a-4939-abf3-49a589eb1d91] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:08.727350 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b8346309-bd42-4544-a2c6-307f57f8f2a5 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:08.727860 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b8346309-bd42-4544-a2c6-307f57f8f2a5 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:08.728303 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b8346309-bd42-4544-a2c6-307f57f8f2a5 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:08.729638 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b8346309-bd42-4544-a2c6-307f57f8f2a5 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:08.730762 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b8346309-bd42-4544-a2c6-307f57f8f2a5 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:08.731400 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b8346309-bd42-4544-a2c6-307f57f8f2a5 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:09.047685 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b8346309-bd42-4544-a2c6-307f57f8f2a5 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a779e85e1c493985f7cfe8aceb9c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4478d0e315d948df9eda910f205646c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:09.056100 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b8346309-bd42-4544-a2c6-307f57f8f2a5 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] 10.222.0.27 "GET /compute/v2.1/servers/931569b4-139a-4939-abf3-49a589eb1d91" status: 200 len: 1512 microversion: 2.1 time: 0.391232 Sep 08 10:57:09.059276 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2141/4231] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:08 2022] GET /compute/v2.1/servers/931569b4-139a-4939-abf3-49a589eb1d91 => generated 1512 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:09.076599 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3b5e417e-8b15-4561-ba4b-63e9e6dc038e tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:57:09.082163 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3b5e417e-8b15-4561-ba4b-63e9e6dc038e tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: a882cf75-539a-45fa-ae2b-4e0f043b340d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:09.090503 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3b5e417e-8b15-4561-ba4b-63e9e6dc038e tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:09.090503 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3b5e417e-8b15-4561-ba4b-63e9e6dc038e tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:09.090960 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3b5e417e-8b15-4561-ba4b-63e9e6dc038e tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:09.091497 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3b5e417e-8b15-4561-ba4b-63e9e6dc038e tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:09.091965 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3b5e417e-8b15-4561-ba4b-63e9e6dc038e tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:09.092401 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3b5e417e-8b15-4561-ba4b-63e9e6dc038e tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:09.115425 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:57:09.144771 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-3b5e417e-8b15-4561-ba4b-63e9e6dc038e tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] HTTP exception thrown: Cannot 'reboot' instance a882cf75-539a-45fa-ae2b-4e0f043b340d while it is in vm_state rescued Sep 08 10:57:09.148009 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3b5e417e-8b15-4561-ba4b-63e9e6dc038e tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Request method failure captured: Sep 08 10:57:09.148009 n-d-850501-12 devstack@n-api.service[128861]: request: POST /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d/action HTTP/1.1 Sep 08 10:57:09.148009 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:57:09.148009 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:57:09.148009 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:57:09.148009 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 28 Sep 08 10:57:09.148009 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:57:09.148009 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:57:09.148009 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:57:09.148009 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:57:09.148009 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGclZnrdHbcSspe2CSaO_gA2LIWMGtHJAKVo_u3dlzxs9JxAXcXCwrL-z-q8SJvnWUnwIz6KxjkLXp0jFFwIV3x5Qp_zUHQKWEwS-EZKwoM8W4-UxwLeQWJTnQ9cWOYmTzHY9djf2pYmuh6sOSJJezx_5s2ElCgN_L-D4iql7Pg9xGj8 Sep 08 10:57:09.148009 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:57:09.148009 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:57:09.148009 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:57:09.148009 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:57:09.148009 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:57:09.148009 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:57:09.148009 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 33063b3b9e0543369c28ea918f52cf37 Sep 08 10:57:09.148009 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1820338337 Sep 08 10:57:09.148009 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:57:09.148009 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:57:09.148009 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/33063b3b9e0543369c28ea918f52cf37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/33063b3b9e0543369c28ea918f52cf37"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_33063b3b9e0543369c28ea918f52cf37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/33063b3b9e0543369c28ea918f52cf37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:57:09.148009 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1820338337 Sep 08 10:57:09.148009 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 33063b3b9e0543369c28ea918f52cf37 Sep 08 10:57:09.148009 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1820338337 Sep 08 10:57:09.148009 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServerRescueNegativeTestJSON-1820338337-project Sep 08 10:57:09.148009 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:57:09.148009 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:57:09.148009 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 8f487f5d062e4ac3bf21c2416a7b50ee Sep 08 10:57:09.148009 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1820338337-project Sep 08 10:57:09.148009 n-d-850501-12 devstack@n-api.service[128861]: Sep 08 10:57:09.148009 n-d-850501-12 devstack@n-api.service[128861]: {"reboot": {"type": "HARD"}} Sep 08 10:57:09.148009 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:57:09.148009 n-d-850501-12 devstack@n-api.service[128861]: exception: Cannot 'reboot' instance a882cf75-539a-45fa-ae2b-4e0f043b340d while it is in vm_state rescued Sep 08 10:57:09.148009 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': 'a882cf75-539a-45fa-ae2b-4e0f043b340d', 'body': {'reboot': {'type': 'HARD'}}} Sep 08 10:57:09.148009 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:57:09.148009 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:57:09.148009 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Sep 08 10:57:09.148009 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Sep 08 10:57:09.148009 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 10:57:09.148009 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 10:57:09.148009 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Sep 08 10:57:09.148009 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Sep 08 10:57:09.148009 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 08 10:57:09.148009 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 08 10:57:09.148009 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a882cf75-539a-45fa-ae2b-4e0f043b340d in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Sep 08 10:57:09.148009 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:57:09.148009 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:57:09.148009 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:57:09.148009 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:57:09.148009 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:57:09.148009 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:57:09.148009 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:57:09.148009 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:57:09.148009 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:57:09.148009 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:57:09.148009 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:57:09.148009 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:57:09.148009 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Sep 08 10:57:09.148009 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 08 10:57:09.148009 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 08 10:57:09.148009 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 08 10:57:09.158846 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance a882cf75-539a-45fa-ae2b-4e0f043b340d while it is in vm_state rescued Sep 08 10:57:09.158846 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:57:09.158846 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:57:09.158846 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:57:09.158846 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:57:09.158846 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:57:09.158846 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:57:09.158846 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:57:09.158846 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:57:09.158846 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance a882cf75-539a-45fa-ae2b-4e0f043b340d while it is in vm_state rescued Sep 08 10:57:09.158846 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:57:09.158846 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3b5e417e-8b15-4561-ba4b-63e9e6dc038e tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Returning 409 to user: Cannot 'reboot' instance a882cf75-539a-45fa-ae2b-4e0f043b340d while it is in vm_state rescued {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:57:09.158846 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3b5e417e-8b15-4561-ba4b-63e9e6dc038e tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "POST /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d/action" status: 409 len: 145 microversion: 2.1 time: 0.079089 Sep 08 10:57:09.158846 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2142/4232] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:57:09 2022] POST /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d/action => generated 145 bytes in 97 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:57:09.164093 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3837da8a-0f0a-430e-9952-2d3cbf1e1a83 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:09.164964 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3837da8a-0f0a-430e-9952-2d3cbf1e1a83 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] [instance: 2d995117-3718-4b9d-a4a1-c1185d34d701] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:09.175538 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3837da8a-0f0a-430e-9952-2d3cbf1e1a83 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:09.176052 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3837da8a-0f0a-430e-9952-2d3cbf1e1a83 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:09.177217 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3837da8a-0f0a-430e-9952-2d3cbf1e1a83 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:09.178450 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3837da8a-0f0a-430e-9952-2d3cbf1e1a83 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:09.178914 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3837da8a-0f0a-430e-9952-2d3cbf1e1a83 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:09.179344 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3837da8a-0f0a-430e-9952-2d3cbf1e1a83 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:09.256966 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6ce78838-7f1c-4100-bb36-60a1fbacd45d tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:09.267878 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6ce78838-7f1c-4100-bb36-60a1fbacd45d tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1517 microversion: 2.1 time: 0.684654 Sep 08 10:57:09.269293 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2091/4233] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:08 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1517 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:09.276645 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-05e61b0d-2c1a-473a-bfb4-ea97b9f6b01c tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:09.278126 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-05e61b0d-2c1a-473a-bfb4-ea97b9f6b01c tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] [instance: 13039f8f-105b-4bb5-b632-753e183d2f1a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:09.289262 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-05e61b0d-2c1a-473a-bfb4-ea97b9f6b01c tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:09.290444 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-05e61b0d-2c1a-473a-bfb4-ea97b9f6b01c tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:09.292047 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-05e61b0d-2c1a-473a-bfb4-ea97b9f6b01c tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:09.293367 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-05e61b0d-2c1a-473a-bfb4-ea97b9f6b01c tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:09.294148 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-05e61b0d-2c1a-473a-bfb4-ea97b9f6b01c tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:09.295206 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-05e61b0d-2c1a-473a-bfb4-ea97b9f6b01c tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:09.610903 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-05e61b0d-2c1a-473a-bfb4-ea97b9f6b01c tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a779e85e1c493985f7cfe8aceb9c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4478d0e315d948df9eda910f205646c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:09.629257 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-05e61b0d-2c1a-473a-bfb4-ea97b9f6b01c tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] 10.222.0.27 "GET /compute/v2.1/servers/13039f8f-105b-4bb5-b632-753e183d2f1a" status: 200 len: 1511 microversion: 2.1 time: 0.358794 Sep 08 10:57:09.630118 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2092/4234] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:09 2022] GET /compute/v2.1/servers/13039f8f-105b-4bb5-b632-753e183d2f1a => generated 1511 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:09.637622 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d8ff1908-c898-43fb-9cc3-b613ac157d14 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:57:09.640711 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d8ff1908-c898-43fb-9cc3-b613ac157d14 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: a882cf75-539a-45fa-ae2b-4e0f043b340d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:09.659247 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-3837da8a-0f0a-430e-9952-2d3cbf1e1a83 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22145c653c804031ae233de6d84647fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1c70903c3d42d790d9ef96adc1fdbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:09.661833 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d8ff1908-c898-43fb-9cc3-b613ac157d14 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:09.662997 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d8ff1908-c898-43fb-9cc3-b613ac157d14 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:09.663781 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d8ff1908-c898-43fb-9cc3-b613ac157d14 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:09.664821 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d8ff1908-c898-43fb-9cc3-b613ac157d14 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:09.665830 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d8ff1908-c898-43fb-9cc3-b613ac157d14 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:09.667081 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d8ff1908-c898-43fb-9cc3-b613ac157d14 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:09.675109 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3837da8a-0f0a-430e-9952-2d3cbf1e1a83 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] 10.222.0.27 "GET /compute/v2.1/servers/2d995117-3718-4b9d-a4a1-c1185d34d701" status: 200 len: 1334 microversion: 2.1 time: 0.516777 Sep 08 10:57:09.678175 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2143/4235] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:09 2022] GET /compute/v2.1/servers/2d995117-3718-4b9d-a4a1-c1185d34d701 => generated 1334 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:09.688980 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fd1c663f-40d7-4046-b12e-633c600597d4 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:57:09.691881 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fd1c663f-40d7-4046-b12e-633c600597d4 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 85c5c938-83a1-4ca3-b9b1-b05d818f7efc] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:09.700955 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fd1c663f-40d7-4046-b12e-633c600597d4 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:09.701957 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fd1c663f-40d7-4046-b12e-633c600597d4 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:09.702623 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fd1c663f-40d7-4046-b12e-633c600597d4 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:09.704038 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fd1c663f-40d7-4046-b12e-633c600597d4 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:09.704630 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fd1c663f-40d7-4046-b12e-633c600597d4 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:09.704849 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fd1c663f-40d7-4046-b12e-633c600597d4 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:09.754978 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-d8ff1908-c898-43fb-9cc3-b613ac157d14 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] HTTP exception thrown: Cannot 'rebuild' instance a882cf75-539a-45fa-ae2b-4e0f043b340d while it is in vm_state rescued Sep 08 10:57:09.758787 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d8ff1908-c898-43fb-9cc3-b613ac157d14 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Request method failure captured: Sep 08 10:57:09.758787 n-d-850501-12 devstack@n-api.service[128862]: request: POST /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d/action HTTP/1.1 Sep 08 10:57:09.758787 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:57:09.758787 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:57:09.758787 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:57:09.758787 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 65 Sep 08 10:57:09.758787 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:57:09.758787 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:57:09.758787 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:57:09.758787 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:57:09.758787 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGclZnrdHbcSspe2CSaO_gA2LIWMGtHJAKVo_u3dlzxs9JxAXcXCwrL-z-q8SJvnWUnwIz6KxjkLXp0jFFwIV3x5Qp_zUHQKWEwS-EZKwoM8W4-UxwLeQWJTnQ9cWOYmTzHY9djf2pYmuh6sOSJJezx_5s2ElCgN_L-D4iql7Pg9xGj8 Sep 08 10:57:09.758787 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:57:09.758787 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:57:09.758787 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:57:09.758787 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:57:09.758787 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:57:09.758787 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:57:09.758787 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 33063b3b9e0543369c28ea918f52cf37 Sep 08 10:57:09.758787 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1820338337 Sep 08 10:57:09.758787 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:57:09.758787 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:57:09.758787 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/33063b3b9e0543369c28ea918f52cf37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/33063b3b9e0543369c28ea918f52cf37"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_33063b3b9e0543369c28ea918f52cf37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/33063b3b9e0543369c28ea918f52cf37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:57:09.758787 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1820338337 Sep 08 10:57:09.758787 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 33063b3b9e0543369c28ea918f52cf37 Sep 08 10:57:09.758787 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1820338337 Sep 08 10:57:09.758787 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServerRescueNegativeTestJSON-1820338337-project Sep 08 10:57:09.758787 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:57:09.758787 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:57:09.758787 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 8f487f5d062e4ac3bf21c2416a7b50ee Sep 08 10:57:09.758787 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1820338337-project Sep 08 10:57:09.758787 n-d-850501-12 devstack@n-api.service[128862]: Sep 08 10:57:09.758787 n-d-850501-12 devstack@n-api.service[128862]: {"rebuild": {"imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117"}} Sep 08 10:57:09.758787 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:57:09.758787 n-d-850501-12 devstack@n-api.service[128862]: exception: Cannot 'rebuild' instance a882cf75-539a-45fa-ae2b-4e0f043b340d while it is in vm_state rescued Sep 08 10:57:09.758787 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'a882cf75-539a-45fa-ae2b-4e0f043b340d', 'body': {'rebuild': {'imageRef': '503f4a0f-e18f-47fd-ad12-0289e3463117'}}} Sep 08 10:57:09.758787 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:57:09.758787 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:57:09.758787 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Sep 08 10:57:09.758787 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Sep 08 10:57:09.758787 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 08 10:57:09.758787 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 08 10:57:09.758787 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 08 10:57:09.758787 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 08 10:57:09.758787 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 10:57:09.758787 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 10:57:09.758787 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 08 10:57:09.758787 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 08 10:57:09.758787 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a882cf75-539a-45fa-ae2b-4e0f043b340d in vm_state rescued. Cannot rebuild while the instance is in this state. Sep 08 10:57:09.758787 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:57:09.758787 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:57:09.758787 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:57:09.758787 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:57:09.758787 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:57:09.758787 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:57:09.758787 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:57:09.758787 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:57:09.758787 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:57:09.758787 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:57:09.758787 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:57:09.758787 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:57:09.758787 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:57:09.758787 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:57:09.758787 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:57:09.764129 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:57:09.764129 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Sep 08 10:57:09.764129 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Sep 08 10:57:09.764129 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 08 10:57:09.764129 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 08 10:57:09.764129 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 08 10:57:09.764129 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance a882cf75-539a-45fa-ae2b-4e0f043b340d while it is in vm_state rescued Sep 08 10:57:09.764129 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:57:09.764129 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:57:09.764129 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:57:09.764129 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:57:09.764129 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:57:09.764129 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:57:09.764129 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:57:09.764129 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:57:09.764129 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance a882cf75-539a-45fa-ae2b-4e0f043b340d while it is in vm_state rescued Sep 08 10:57:09.764129 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:57:09.765080 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fd1c663f-40d7-4046-b12e-633c600597d4 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "POST /compute/v2.1/servers/85c5c938-83a1-4ca3-b9b1-b05d818f7efc/action" status: 200 len: 14 microversion: 2.1 time: 0.079495 Sep 08 10:57:09.765080 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2144/4236] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:57:09 2022] POST /compute/v2.1/servers/85c5c938-83a1-4ca3-b9b1-b05d818f7efc/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:57:09.766352 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d8ff1908-c898-43fb-9cc3-b613ac157d14 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Returning 409 to user: Cannot 'rebuild' instance a882cf75-539a-45fa-ae2b-4e0f043b340d while it is in vm_state rescued {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:57:09.767814 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d8ff1908-c898-43fb-9cc3-b613ac157d14 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "POST /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d/action" status: 409 len: 146 microversion: 2.1 time: 0.136297 Sep 08 10:57:09.767930 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9ed27390-c997-4049-b031-ac9becae3000 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:09.768782 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9ed27390-c997-4049-b031-ac9becae3000 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] [instance: 7c2e066a-8160-4bcd-80be-33091a3e0fac] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:09.772442 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2093/4237] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:57:09 2022] POST /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d/action => generated 146 bytes in 141 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:57:09.777889 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ed27390-c997-4049-b031-ac9becae3000 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:09.778396 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ed27390-c997-4049-b031-ac9becae3000 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:09.779511 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ed27390-c997-4049-b031-ac9becae3000 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:09.780163 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-53556509-bd7c-46a2-b634-c51fb3b6d81f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:09.780384 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ed27390-c997-4049-b031-ac9becae3000 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:09.780868 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ed27390-c997-4049-b031-ac9becae3000 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:09.781390 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ed27390-c997-4049-b031-ac9becae3000 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:09.786780 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-53556509-bd7c-46a2-b634-c51fb3b6d81f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '06a779e85e1c493985f7cfe8aceb9c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4478d0e315d948df9eda910f205646c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:09.788078 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-53556509-bd7c-46a2-b634-c51fb3b6d81f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '4478d0e315d948df9eda910f205646c3'} {{(pid=128862) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:57:09.797682 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:57:09.818589 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53556509-bd7c-46a2-b634-c51fb3b6d81f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:09.819328 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53556509-bd7c-46a2-b634-c51fb3b6d81f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:09.819925 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53556509-bd7c-46a2-b634-c51fb3b6d81f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:09.820839 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53556509-bd7c-46a2-b634-c51fb3b6d81f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:09.821522 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53556509-bd7c-46a2-b634-c51fb3b6d81f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:09.822119 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53556509-bd7c-46a2-b634-c51fb3b6d81f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:09.988015 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.multi_cell_list [None req-53556509-bd7c-46a2-b634-c51fb3b6d81f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128862) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 10:57:10.118416 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-53556509-bd7c-46a2-b634-c51fb3b6d81f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a779e85e1c493985f7cfe8aceb9c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4478d0e315d948df9eda910f205646c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:10.126137 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53556509-bd7c-46a2-b634-c51fb3b6d81f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:10.126689 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53556509-bd7c-46a2-b634-c51fb3b6d81f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:10.127148 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53556509-bd7c-46a2-b634-c51fb3b6d81f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:10.150611 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9ed27390-c997-4049-b031-ac9becae3000 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7177ce97ae4fad81993ec8597cfe2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d73ca665b94264a22f7bae7d799cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:10.162375 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9ed27390-c997-4049-b031-ac9becae3000 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] 10.222.0.27 "GET /compute/v2.1/servers/7c2e066a-8160-4bcd-80be-33091a3e0fac" status: 200 len: 1508 microversion: 2.1 time: 0.399554 Sep 08 10:57:10.163699 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2145/4238] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:09 2022] GET /compute/v2.1/servers/7c2e066a-8160-4bcd-80be-33091a3e0fac => generated 1508 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:10.169786 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c083f71c-84ae-405d-a0e7-5291423ccc22 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:10.170565 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c083f71c-84ae-405d-a0e7-5291423ccc22 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: 93d05d86-99b6-43f0-83c7-257ab64a12f3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:10.177638 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c083f71c-84ae-405d-a0e7-5291423ccc22 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:10.179398 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c083f71c-84ae-405d-a0e7-5291423ccc22 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:10.180014 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c083f71c-84ae-405d-a0e7-5291423ccc22 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:10.180926 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c083f71c-84ae-405d-a0e7-5291423ccc22 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:10.181629 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c083f71c-84ae-405d-a0e7-5291423ccc22 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:10.182256 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c083f71c-84ae-405d-a0e7-5291423ccc22 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:10.219895 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c083f71c-84ae-405d-a0e7-5291423ccc22 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: 93d05d86-99b6-43f0-83c7-257ab64a12f3] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:57:10.340504 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:57:10.346154 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c083f71c-84ae-405d-a0e7-5291423ccc22 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "DELETE /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3" status: 204 len: 0 microversion: 2.1 time: 0.180614 Sep 08 10:57:10.347463 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2146/4239] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:57:10 2022] DELETE /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:57:10.355081 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-63922d0a-ae11-41a1-949e-22ac5a400cbf tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:10.356508 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-63922d0a-ae11-41a1-949e-22ac5a400cbf tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:10.367801 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-63922d0a-ae11-41a1-949e-22ac5a400cbf tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:10.368297 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-63922d0a-ae11-41a1-949e-22ac5a400cbf tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:10.368766 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-63922d0a-ae11-41a1-949e-22ac5a400cbf tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:10.373507 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-63922d0a-ae11-41a1-949e-22ac5a400cbf tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:10.374207 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-63922d0a-ae11-41a1-949e-22ac5a400cbf tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:10.374646 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-63922d0a-ae11-41a1-949e-22ac5a400cbf tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:10.443469 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-53556509-bd7c-46a2-b634-c51fb3b6d81f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] 10.222.0.27 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1514 microversion: 2.1 time: 0.669572 Sep 08 10:57:10.459225 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2094/4240] 10.222.0.27 () {58 vars in 1167 bytes} [Thu Sep 8 10:57:09 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1514 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:10.472901 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-56d10d10-4c62-4a3e-a0b8-2166a1da4375 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:10.473905 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-56d10d10-4c62-4a3e-a0b8-2166a1da4375 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: 93d05d86-99b6-43f0-83c7-257ab64a12f3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:10.481242 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-56d10d10-4c62-4a3e-a0b8-2166a1da4375 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:10.481748 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-56d10d10-4c62-4a3e-a0b8-2166a1da4375 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:10.482193 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-56d10d10-4c62-4a3e-a0b8-2166a1da4375 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:10.482976 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-56d10d10-4c62-4a3e-a0b8-2166a1da4375 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:10.483440 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-56d10d10-4c62-4a3e-a0b8-2166a1da4375 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:10.483948 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-56d10d10-4c62-4a3e-a0b8-2166a1da4375 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:10.871467 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-63922d0a-ae11-41a1-949e-22ac5a400cbf tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:10.893129 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-63922d0a-ae11-41a1-949e-22ac5a400cbf tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1517 microversion: 2.1 time: 0.535311 Sep 08 10:57:10.894378 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2147/4241] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:10 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1517 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:10.906747 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-87147216-4c69-41a6-98c6-fda8d9f6eb48 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:10.923241 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-87147216-4c69-41a6-98c6-fda8d9f6eb48 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '06a779e85e1c493985f7cfe8aceb9c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4478d0e315d948df9eda910f205646c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:10.924277 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-87147216-4c69-41a6-98c6-fda8d9f6eb48 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1975568299', 'deleted': False, 'project_id': '4478d0e315d948df9eda910f205646c3'} {{(pid=128861) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:57:10.931198 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-87147216-4c69-41a6-98c6-fda8d9f6eb48 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:10.931792 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-87147216-4c69-41a6-98c6-fda8d9f6eb48 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:10.932915 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-87147216-4c69-41a6-98c6-fda8d9f6eb48 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:10.934149 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-87147216-4c69-41a6-98c6-fda8d9f6eb48 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:10.934770 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-87147216-4c69-41a6-98c6-fda8d9f6eb48 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:10.935308 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-87147216-4c69-41a6-98c6-fda8d9f6eb48 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:11.062634 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.multi_cell_list [None req-87147216-4c69-41a6-98c6-fda8d9f6eb48 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128861) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 10:57:11.180964 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-87147216-4c69-41a6-98c6-fda8d9f6eb48 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a779e85e1c493985f7cfe8aceb9c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4478d0e315d948df9eda910f205646c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:11.188328 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-87147216-4c69-41a6-98c6-fda8d9f6eb48 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:11.188826 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-87147216-4c69-41a6-98c6-fda8d9f6eb48 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:11.189294 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-87147216-4c69-41a6-98c6-fda8d9f6eb48 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:11.435586 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-87147216-4c69-41a6-98c6-fda8d9f6eb48 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] 10.222.0.27 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1975568299" status: 200 len: 1515 microversion: 2.1 time: 0.539891 Sep 08 10:57:11.451566 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2148/4242] 10.222.0.27 () {58 vars in 1263 bytes} [Thu Sep 8 10:57:10 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1975568299 => generated 1515 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:11.451566 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1d7f2bd8-37cf-447b-bd26-4b95e44646a6 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:11.451566 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1d7f2bd8-37cf-447b-bd26-4b95e44646a6 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] [instance: 2d995117-3718-4b9d-a4a1-c1185d34d701] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:11.457365 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1d7f2bd8-37cf-447b-bd26-4b95e44646a6 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:11.457365 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1d7f2bd8-37cf-447b-bd26-4b95e44646a6 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:11.457365 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1d7f2bd8-37cf-447b-bd26-4b95e44646a6 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:11.458907 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1d7f2bd8-37cf-447b-bd26-4b95e44646a6 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:11.459412 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1d7f2bd8-37cf-447b-bd26-4b95e44646a6 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:11.459989 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1d7f2bd8-37cf-447b-bd26-4b95e44646a6 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:11.468848 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-56d10d10-4c62-4a3e-a0b8-2166a1da4375 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:11.481709 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-56d10d10-4c62-4a3e-a0b8-2166a1da4375 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3" status: 200 len: 1689 microversion: 2.1 time: 1.022302 Sep 08 10:57:11.483381 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2095/4243] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:10 2022] GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3 => generated 1689 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:11.488668 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-00ade2ae-a2f5-4e5b-af06-524d6d2a2adc tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:57:11.491513 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-00ade2ae-a2f5-4e5b-af06-524d6d2a2adc tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 85c5c938-83a1-4ca3-b9b1-b05d818f7efc] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:11.500337 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00ade2ae-a2f5-4e5b-af06-524d6d2a2adc tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:11.501819 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00ade2ae-a2f5-4e5b-af06-524d6d2a2adc tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:11.502348 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00ade2ae-a2f5-4e5b-af06-524d6d2a2adc tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:11.503231 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00ade2ae-a2f5-4e5b-af06-524d6d2a2adc tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:11.503774 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00ade2ae-a2f5-4e5b-af06-524d6d2a2adc tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:11.504279 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00ade2ae-a2f5-4e5b-af06-524d6d2a2adc tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:11.812147 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1d7f2bd8-37cf-447b-bd26-4b95e44646a6 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22145c653c804031ae233de6d84647fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1c70903c3d42d790d9ef96adc1fdbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:11.825427 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1d7f2bd8-37cf-447b-bd26-4b95e44646a6 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] 10.222.0.27 "GET /compute/v2.1/servers/2d995117-3718-4b9d-a4a1-c1185d34d701" status: 200 len: 1334 microversion: 2.1 time: 0.387333 Sep 08 10:57:11.837984 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2149/4244] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:11 2022] GET /compute/v2.1/servers/2d995117-3718-4b9d-a4a1-c1185d34d701 => generated 1334 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:11.837984 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-42be7401-0218-4b94-a414-29ab05fb0392 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:11.838566 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-42be7401-0218-4b94-a414-29ab05fb0392 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] [instance: 7c2e066a-8160-4bcd-80be-33091a3e0fac] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:11.845776 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-42be7401-0218-4b94-a414-29ab05fb0392 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:11.846452 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-42be7401-0218-4b94-a414-29ab05fb0392 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:11.846702 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-42be7401-0218-4b94-a414-29ab05fb0392 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:11.847425 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-42be7401-0218-4b94-a414-29ab05fb0392 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:11.847888 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-42be7401-0218-4b94-a414-29ab05fb0392 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:11.848484 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-42be7401-0218-4b94-a414-29ab05fb0392 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:12.082752 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-42be7401-0218-4b94-a414-29ab05fb0392 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7177ce97ae4fad81993ec8597cfe2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d73ca665b94264a22f7bae7d799cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:12.090963 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-42be7401-0218-4b94-a414-29ab05fb0392 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] 10.222.0.27 "GET /compute/v2.1/servers/7c2e066a-8160-4bcd-80be-33091a3e0fac" status: 200 len: 1508 microversion: 2.1 time: 0.257025 Sep 08 10:57:12.105458 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2150/4245] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:11 2022] GET /compute/v2.1/servers/7c2e066a-8160-4bcd-80be-33091a3e0fac => generated 1508 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:12.113018 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b8f9ee27-8d7f-40aa-831a-4dc4aae0805c tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:12.117763 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b8f9ee27-8d7f-40aa-831a-4dc4aae0805c tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '06a779e85e1c493985f7cfe8aceb9c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4478d0e315d948df9eda910f205646c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:12.118743 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b8f9ee27-8d7f-40aa-831a-4dc4aae0805c tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '4478d0e315d948df9eda910f205646c3'} {{(pid=128861) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:57:12.130080 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b8f9ee27-8d7f-40aa-831a-4dc4aae0805c tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:12.130561 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b8f9ee27-8d7f-40aa-831a-4dc4aae0805c tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:12.130998 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b8f9ee27-8d7f-40aa-831a-4dc4aae0805c tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:12.131777 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b8f9ee27-8d7f-40aa-831a-4dc4aae0805c tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:12.132285 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b8f9ee27-8d7f-40aa-831a-4dc4aae0805c tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:12.132845 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b8f9ee27-8d7f-40aa-831a-4dc4aae0805c tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:12.258466 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.multi_cell_list [None req-b8f9ee27-8d7f-40aa-831a-4dc4aae0805c tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128861) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 10:57:12.399708 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b8f9ee27-8d7f-40aa-831a-4dc4aae0805c tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a779e85e1c493985f7cfe8aceb9c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4478d0e315d948df9eda910f205646c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:12.415836 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b8f9ee27-8d7f-40aa-831a-4dc4aae0805c tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:12.428867 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b8f9ee27-8d7f-40aa-831a-4dc4aae0805c tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:12.429591 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b8f9ee27-8d7f-40aa-831a-4dc4aae0805c tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:12.697079 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b8f9ee27-8d7f-40aa-831a-4dc4aae0805c tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] 10.222.0.27 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4517 microversion: 2.1 time: 0.590042 Sep 08 10:57:12.699867 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2151/4246] 10.222.0.27 () {58 vars in 1173 bytes} [Thu Sep 8 10:57:12 2022] GET /compute/v2.1/servers/detail?status=active => generated 4517 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:12.710126 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e65e56b3-b6af-482f-9477-3a2f2f6b49cd tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:12.711046 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e65e56b3-b6af-482f-9477-3a2f2f6b49cd tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:12.721506 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e65e56b3-b6af-482f-9477-3a2f2f6b49cd tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:12.722427 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e65e56b3-b6af-482f-9477-3a2f2f6b49cd tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:12.723385 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e65e56b3-b6af-482f-9477-3a2f2f6b49cd tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:12.724460 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e65e56b3-b6af-482f-9477-3a2f2f6b49cd tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:12.725479 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e65e56b3-b6af-482f-9477-3a2f2f6b49cd tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:12.726757 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e65e56b3-b6af-482f-9477-3a2f2f6b49cd tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:13.008265 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e65e56b3-b6af-482f-9477-3a2f2f6b49cd tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:13.019070 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e65e56b3-b6af-482f-9477-3a2f2f6b49cd tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1517 microversion: 2.1 time: 0.317388 Sep 08 10:57:13.033838 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2152/4247] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:12 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1517 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:13.052708 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-9131e6ec-7ae2-493d-9093-fffc20c0f6af req-03553e6b-19b2-472d-a283-08a5655916e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c2e066a-8160-4bcd-80be-33091a3e0fac", "name": "network-vif-deleted", "tag": "585ccf42-903a-4b23-b54e-c5d6e8ffcfd3"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:57:13.070016 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-9131e6ec-7ae2-493d-9093-fffc20c0f6af req-03553e6b-19b2-472d-a283-08a5655916e5 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:13.070613 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-9131e6ec-7ae2-493d-9093-fffc20c0f6af req-03553e6b-19b2-472d-a283-08a5655916e5 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:13.071061 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-9131e6ec-7ae2-493d-9093-fffc20c0f6af req-03553e6b-19b2-472d-a283-08a5655916e5 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:13.089884 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-9131e6ec-7ae2-493d-9093-fffc20c0f6af req-03553e6b-19b2-472d-a283-08a5655916e5 service nova] Creating event network-vif-deleted:585ccf42-903a-4b23-b54e-c5d6e8ffcfd3 for instance 7c2e066a-8160-4bcd-80be-33091a3e0fac on n-h1-850501-12 Sep 08 10:57:13.093415 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-9131e6ec-7ae2-493d-9093-fffc20c0f6af req-03553e6b-19b2-472d-a283-08a5655916e5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057582 Sep 08 10:57:13.094388 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2153/4248] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:57:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:57:13.099704 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-98920e07-3936-4d6f-b9c9-d3ea225887da tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:13.100420 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-98920e07-3936-4d6f-b9c9-d3ea225887da tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: 93d05d86-99b6-43f0-83c7-257ab64a12f3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:13.110822 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-98920e07-3936-4d6f-b9c9-d3ea225887da tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:13.112862 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-98920e07-3936-4d6f-b9c9-d3ea225887da tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:13.112862 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-98920e07-3936-4d6f-b9c9-d3ea225887da tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:13.113902 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-98920e07-3936-4d6f-b9c9-d3ea225887da tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:13.114761 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-98920e07-3936-4d6f-b9c9-d3ea225887da tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:13.115547 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-98920e07-3936-4d6f-b9c9-d3ea225887da tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:13.506778 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-98920e07-3936-4d6f-b9c9-d3ea225887da tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:13.523469 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-98920e07-3936-4d6f-b9c9-d3ea225887da tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3" status: 200 len: 1689 microversion: 2.1 time: 0.424812 Sep 08 10:57:13.531517 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2154/4249] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:13 2022] GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3 => generated 1689 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:13.556323 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5cf79d83-bbe3-4314-9189-37c5197ec4fd tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:13.564082 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5cf79d83-bbe3-4314-9189-37c5197ec4fd tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '06a779e85e1c493985f7cfe8aceb9c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4478d0e315d948df9eda910f205646c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:13.564904 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.compute.servers [None req-5cf79d83-bbe3-4314-9189-37c5197ec4fd tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Removing options 'limit' from query {{(pid=128861) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 08 10:57:13.566181 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5cf79d83-bbe3-4314-9189-37c5197ec4fd tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Searching by: {'deleted': False, 'project_id': '4478d0e315d948df9eda910f205646c3'} {{(pid=128861) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:57:13.573259 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5cf79d83-bbe3-4314-9189-37c5197ec4fd tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:13.574194 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5cf79d83-bbe3-4314-9189-37c5197ec4fd tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:13.574852 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5cf79d83-bbe3-4314-9189-37c5197ec4fd tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:13.575912 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5cf79d83-bbe3-4314-9189-37c5197ec4fd tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:13.576536 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5cf79d83-bbe3-4314-9189-37c5197ec4fd tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:13.577209 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5cf79d83-bbe3-4314-9189-37c5197ec4fd tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:13.609855 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-00ade2ae-a2f5-4e5b-af06-524d6d2a2adc tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "POST /compute/v2.1/servers/85c5c938-83a1-4ca3-b9b1-b05d818f7efc/action" status: 200 len: 16394 microversion: 2.1 time: 2.124905 Sep 08 10:57:13.611086 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2096/4250] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:57:11 2022] POST /compute/v2.1/servers/85c5c938-83a1-4ca3-b9b1-b05d818f7efc/action => generated 16394 bytes in 2127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:57:13.616721 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-17f19494-7ee8-42fd-a2b9-1f4d3904d596 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:13.625544 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-17f19494-7ee8-42fd-a2b9-1f4d3904d596 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] [instance: 2d995117-3718-4b9d-a4a1-c1185d34d701] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:13.643131 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-17f19494-7ee8-42fd-a2b9-1f4d3904d596 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:13.643131 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-17f19494-7ee8-42fd-a2b9-1f4d3904d596 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:13.643131 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-17f19494-7ee8-42fd-a2b9-1f4d3904d596 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:13.643725 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-17f19494-7ee8-42fd-a2b9-1f4d3904d596 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:13.644718 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-17f19494-7ee8-42fd-a2b9-1f4d3904d596 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:13.645523 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-17f19494-7ee8-42fd-a2b9-1f4d3904d596 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:13.676930 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5cf79d83-bbe3-4314-9189-37c5197ec4fd tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a779e85e1c493985f7cfe8aceb9c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4478d0e315d948df9eda910f205646c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:13.695524 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5cf79d83-bbe3-4314-9189-37c5197ec4fd tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:13.700909 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5cf79d83-bbe3-4314-9189-37c5197ec4fd tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:13.704716 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5cf79d83-bbe3-4314-9189-37c5197ec4fd tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:14.101785 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-17f19494-7ee8-42fd-a2b9-1f4d3904d596 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22145c653c804031ae233de6d84647fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1c70903c3d42d790d9ef96adc1fdbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:14.128107 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-17f19494-7ee8-42fd-a2b9-1f4d3904d596 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] 10.222.0.27 "GET /compute/v2.1/servers/2d995117-3718-4b9d-a4a1-c1185d34d701" status: 200 len: 1334 microversion: 2.1 time: 0.514810 Sep 08 10:57:14.144029 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2097/4251] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:13 2022] GET /compute/v2.1/servers/2d995117-3718-4b9d-a4a1-c1185d34d701 => generated 1334 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:14.164790 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6a962405-a386-4ff7-9a37-6cf419e58258 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:14.165831 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6a962405-a386-4ff7-9a37-6cf419e58258 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] [instance: 7c2e066a-8160-4bcd-80be-33091a3e0fac] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:14.174114 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a962405-a386-4ff7-9a37-6cf419e58258 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:14.174965 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a962405-a386-4ff7-9a37-6cf419e58258 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:14.175878 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a962405-a386-4ff7-9a37-6cf419e58258 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:14.176857 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a962405-a386-4ff7-9a37-6cf419e58258 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:14.178272 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a962405-a386-4ff7-9a37-6cf419e58258 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:14.181499 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a962405-a386-4ff7-9a37-6cf419e58258 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:14.217194 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5cf79d83-bbe3-4314-9189-37c5197ec4fd tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] 10.222.0.27 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1660 microversion: 2.1 time: 0.673988 Sep 08 10:57:14.217999 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2155/4252] 10.222.0.27 () {58 vars in 1161 bytes} [Thu Sep 8 10:57:13 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1660 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:14.223514 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e370450b-1d9a-4df8-98e7-3cfcc408f2a8 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:14.224562 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e370450b-1d9a-4df8-98e7-3cfcc408f2a8 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:14.224977 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-6a962405-a386-4ff7-9a37-6cf419e58258 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] HTTP exception thrown: Instance 7c2e066a-8160-4bcd-80be-33091a3e0fac could not be found. Sep 08 10:57:14.227967 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6a962405-a386-4ff7-9a37-6cf419e58258 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Request method failure captured: Sep 08 10:57:14.227967 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/7c2e066a-8160-4bcd-80be-33091a3e0fac HTTP/1.1 Sep 08 10:57:14.227967 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:57:14.227967 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:57:14.227967 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:57:14.227967 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:57:14.227967 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:57:14.227967 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:57:14.227967 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:57:14.227967 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:57:14.227967 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcpcJ5zm_JbzuAWLQidBs6rQIHSEw_e_wdTjBB75fWFatiFEXJOeuTMaFvBgIUWxDjtwdq2QIUAh3R44BsmClPdczP1nco4iq8Hy8oEhYJXMoYqsbFToCqXDDqtsa8eFhq-sxQ6y-Iecb_chucfIFtQEkBrPVFYEqKQ7SheumB4tMzI Sep 08 10:57:14.227967 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:57:14.227967 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:57:14.227967 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:57:14.227967 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:57:14.227967 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:57:14.227967 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:57:14.227967 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: b7d73ca665b94264a22f7bae7d799cff Sep 08 10:57:14.227967 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServerPasswordTestJSON-2100251760 Sep 08 10:57:14.227967 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:57:14.227967 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:57:14.227967 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b7d73ca665b94264a22f7bae7d799cff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b7d73ca665b94264a22f7bae7d799cff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b7d73ca665b94264a22f7bae7d799cff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b7d73ca665b94264a22f7bae7d799cff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:57:14.227967 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServerPasswordTestJSON-2100251760 Sep 08 10:57:14.227967 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: b7d73ca665b94264a22f7bae7d799cff Sep 08 10:57:14.227967 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServerPasswordTestJSON-2100251760 Sep 08 10:57:14.227967 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServerPasswordTestJSON-2100251760-project Sep 08 10:57:14.227967 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:57:14.227967 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:57:14.227967 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 6e7177ce97ae4fad81993ec8597cfe2d Sep 08 10:57:14.227967 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServerPasswordTestJSON-2100251760-project Sep 08 10:57:14.227967 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:57:14.227967 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 7c2e066a-8160-4bcd-80be-33091a3e0fac could not be found. Sep 08 10:57:14.227967 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '7c2e066a-8160-4bcd-80be-33091a3e0fac'} Sep 08 10:57:14.227967 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:57:14.227967 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:57:14.227967 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:57:14.227967 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:57:14.227967 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:57:14.227967 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:57:14.227967 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:57:14.227967 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:57:14.227967 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:57:14.227967 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:57:14.227967 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c2e066a-8160-4bcd-80be-33091a3e0fac could not be found. Sep 08 10:57:14.227967 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:57:14.227967 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:57:14.227967 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:57:14.227967 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:57:14.227967 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:57:14.227967 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:57:14.227967 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:57:14.227967 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:57:14.227967 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:57:14.227967 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:57:14.227967 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:57:14.227967 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:57:14.227967 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:57:14.227967 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:57:14.227967 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:57:14.227967 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:57:14.227967 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c2e066a-8160-4bcd-80be-33091a3e0fac could not be found. Sep 08 10:57:14.227967 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:57:14.227967 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:57:14.227967 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:57:14.234654 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:57:14.234654 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:57:14.234654 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:57:14.234654 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:57:14.234654 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:57:14.234654 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c2e066a-8160-4bcd-80be-33091a3e0fac could not be found. Sep 08 10:57:14.234654 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:57:14.245429 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6a962405-a386-4ff7-9a37-6cf419e58258 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] Returning 404 to user: Instance 7c2e066a-8160-4bcd-80be-33091a3e0fac could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:57:14.247911 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e370450b-1d9a-4df8-98e7-3cfcc408f2a8 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:14.248427 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e370450b-1d9a-4df8-98e7-3cfcc408f2a8 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:14.248874 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e370450b-1d9a-4df8-98e7-3cfcc408f2a8 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:14.252854 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6a962405-a386-4ff7-9a37-6cf419e58258 tempest-ServerPasswordTestJSON-2100251760 tempest-ServerPasswordTestJSON-2100251760-project] 10.222.0.27 "GET /compute/v2.1/servers/7c2e066a-8160-4bcd-80be-33091a3e0fac" status: 404 len: 111 microversion: 2.1 time: 0.092805 Sep 08 10:57:14.255506 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e370450b-1d9a-4df8-98e7-3cfcc408f2a8 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:14.255954 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2098/4253] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:14 2022] GET /compute/v2.1/servers/7c2e066a-8160-4bcd-80be-33091a3e0fac => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:57:14.256100 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e370450b-1d9a-4df8-98e7-3cfcc408f2a8 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:14.256741 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e370450b-1d9a-4df8-98e7-3cfcc408f2a8 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:14.499150 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-b2ee90d5-789c-4ca8-a6d3-64ad2e7d79bc req-60cb629d-202d-4f81-a115-0c58db14fedb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d995117-3718-4b9d-a4a1-c1185d34d701", "name": "network-vif-plugged", "status": "completed", "tag": "7ec9baef-5ccd-4968-99a9-d96da1b42bf3"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:57:14.510040 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b2ee90d5-789c-4ca8-a6d3-64ad2e7d79bc req-60cb629d-202d-4f81-a115-0c58db14fedb service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:14.511114 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b2ee90d5-789c-4ca8-a6d3-64ad2e7d79bc req-60cb629d-202d-4f81-a115-0c58db14fedb service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:14.511830 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b2ee90d5-789c-4ca8-a6d3-64ad2e7d79bc req-60cb629d-202d-4f81-a115-0c58db14fedb service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:14.531024 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-b2ee90d5-789c-4ca8-a6d3-64ad2e7d79bc req-60cb629d-202d-4f81-a115-0c58db14fedb service nova] Creating event network-vif-plugged:7ec9baef-5ccd-4968-99a9-d96da1b42bf3 for instance 2d995117-3718-4b9d-a4a1-c1185d34d701 on n-h2-850501-12 Sep 08 10:57:14.536668 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-b2ee90d5-789c-4ca8-a6d3-64ad2e7d79bc req-60cb629d-202d-4f81-a115-0c58db14fedb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.278708 Sep 08 10:57:14.537393 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2099/4254] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:57:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:57:14.546168 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c1f993c8-cd25-4019-8d07-375c70d18430 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:14.547559 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c1f993c8-cd25-4019-8d07-375c70d18430 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:14.558164 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c1f993c8-cd25-4019-8d07-375c70d18430 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:14.558667 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c1f993c8-cd25-4019-8d07-375c70d18430 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:14.559108 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c1f993c8-cd25-4019-8d07-375c70d18430 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:14.560047 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c1f993c8-cd25-4019-8d07-375c70d18430 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:14.560509 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c1f993c8-cd25-4019-8d07-375c70d18430 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:14.560948 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c1f993c8-cd25-4019-8d07-375c70d18430 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:15.110324 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e370450b-1d9a-4df8-98e7-3cfcc408f2a8 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:15.121958 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e370450b-1d9a-4df8-98e7-3cfcc408f2a8 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1671 microversion: 2.1 time: 0.902239 Sep 08 10:57:15.125226 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2156/4255] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:14 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1671 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:15.129761 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4a4336b7-f9d1-47be-a5ed-1573b3b0cacc tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:15.138850 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4a4336b7-f9d1-47be-a5ed-1573b3b0cacc tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '06a779e85e1c493985f7cfe8aceb9c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4478d0e315d948df9eda910f205646c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:15.139609 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4a4336b7-f9d1-47be-a5ed-1573b3b0cacc tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '4478d0e315d948df9eda910f205646c3'} {{(pid=128861) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:57:15.145712 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a4336b7-f9d1-47be-a5ed-1573b3b0cacc tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:15.146228 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a4336b7-f9d1-47be-a5ed-1573b3b0cacc tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:15.146741 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a4336b7-f9d1-47be-a5ed-1573b3b0cacc tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:15.147666 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a4336b7-f9d1-47be-a5ed-1573b3b0cacc tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:15.148303 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a4336b7-f9d1-47be-a5ed-1573b3b0cacc tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:15.149736 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a4336b7-f9d1-47be-a5ed-1573b3b0cacc tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:15.152514 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c1f993c8-cd25-4019-8d07-375c70d18430 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:15.168653 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c1f993c8-cd25-4019-8d07-375c70d18430 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1517 microversion: 2.1 time: 0.629702 Sep 08 10:57:15.169651 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2100/4256] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:14 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1517 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:15.175049 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2afd64cf-d546-4fea-b19e-a7a300b93653 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:15.175681 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2afd64cf-d546-4fea-b19e-a7a300b93653 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: 93d05d86-99b6-43f0-83c7-257ab64a12f3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:15.184064 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2afd64cf-d546-4fea-b19e-a7a300b93653 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:15.184572 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2afd64cf-d546-4fea-b19e-a7a300b93653 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:15.185014 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2afd64cf-d546-4fea-b19e-a7a300b93653 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:15.185753 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2afd64cf-d546-4fea-b19e-a7a300b93653 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:15.186859 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2afd64cf-d546-4fea-b19e-a7a300b93653 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:15.187310 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2afd64cf-d546-4fea-b19e-a7a300b93653 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:15.221770 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.multi_cell_list [None req-4a4336b7-f9d1-47be-a5ed-1573b3b0cacc tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128861) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 10:57:15.245894 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:57:15.282180 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4a4336b7-f9d1-47be-a5ed-1573b3b0cacc tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] 10.222.0.27 "GET /compute/v2.1/servers?status=active" status: 200 len: 1011 microversion: 2.1 time: 0.158400 Sep 08 10:57:15.283034 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2157/4257] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Sep 8 10:57:15 2022] GET /compute/v2.1/servers?status=active => generated 1011 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:15.288534 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e78611d0-6c01-445a-8288-a6e94192111b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:15.289409 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e78611d0-6c01-445a-8288-a6e94192111b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:15.297480 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e78611d0-6c01-445a-8288-a6e94192111b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:15.300947 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e78611d0-6c01-445a-8288-a6e94192111b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:15.303553 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e78611d0-6c01-445a-8288-a6e94192111b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:15.304632 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e78611d0-6c01-445a-8288-a6e94192111b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:15.305320 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e78611d0-6c01-445a-8288-a6e94192111b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:15.306029 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e78611d0-6c01-445a-8288-a6e94192111b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:15.664775 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2afd64cf-d546-4fea-b19e-a7a300b93653 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:15.685017 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2afd64cf-d546-4fea-b19e-a7a300b93653 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3" status: 200 len: 1689 microversion: 2.1 time: 0.512815 Sep 08 10:57:15.685698 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e78611d0-6c01-445a-8288-a6e94192111b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:15.695645 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2101/4258] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:15 2022] GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3 => generated 1689 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:15.703663 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-51fa3668-58fe-4cd2-b3b7-af66b39fe81d tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:15.706341 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-51fa3668-58fe-4cd2-b3b7-af66b39fe81d tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] [instance: 2d995117-3718-4b9d-a4a1-c1185d34d701] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:15.723581 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51fa3668-58fe-4cd2-b3b7-af66b39fe81d tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:15.724127 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51fa3668-58fe-4cd2-b3b7-af66b39fe81d tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:15.724576 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51fa3668-58fe-4cd2-b3b7-af66b39fe81d tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:15.728371 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51fa3668-58fe-4cd2-b3b7-af66b39fe81d tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:15.735556 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51fa3668-58fe-4cd2-b3b7-af66b39fe81d tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:15.736659 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51fa3668-58fe-4cd2-b3b7-af66b39fe81d tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:15.740363 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e78611d0-6c01-445a-8288-a6e94192111b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1671 microversion: 2.1 time: 0.455569 Sep 08 10:57:15.742155 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2158/4259] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:15 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1671 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:15.756799 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b6885d5e-9b82-4688-b834-9ad2ca1cd462 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:15.771307 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b6885d5e-9b82-4688-b834-9ad2ca1cd462 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '06a779e85e1c493985f7cfe8aceb9c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4478d0e315d948df9eda910f205646c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:15.773268 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.compute.servers [None req-b6885d5e-9b82-4688-b834-9ad2ca1cd462 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Removing options 'limit' from query {{(pid=128861) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 08 10:57:15.777276 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b6885d5e-9b82-4688-b834-9ad2ca1cd462 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Searching by: {'deleted': False, 'project_id': '4478d0e315d948df9eda910f205646c3'} {{(pid=128861) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:57:15.787084 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b6885d5e-9b82-4688-b834-9ad2ca1cd462 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:15.793595 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b6885d5e-9b82-4688-b834-9ad2ca1cd462 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:15.794387 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b6885d5e-9b82-4688-b834-9ad2ca1cd462 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:15.795347 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b6885d5e-9b82-4688-b834-9ad2ca1cd462 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:15.796013 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b6885d5e-9b82-4688-b834-9ad2ca1cd462 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:15.796612 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b6885d5e-9b82-4688-b834-9ad2ca1cd462 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:15.833234 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.multi_cell_list [None req-b6885d5e-9b82-4688-b834-9ad2ca1cd462 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128861) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 10:57:15.872879 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b6885d5e-9b82-4688-b834-9ad2ca1cd462 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] 10.222.0.27 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1011 microversion: 2.1 time: 0.128932 Sep 08 10:57:15.873742 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2159/4260] 10.222.0.27 () {58 vars in 1150 bytes} [Thu Sep 8 10:57:15 2022] GET /compute/v2.1/servers?limit=100000 => generated 1011 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:15.878663 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d04a0bff-c7db-465b-b140-decb685dcacb tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:15.879823 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d04a0bff-c7db-465b-b140-decb685dcacb tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:15.893417 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d04a0bff-c7db-465b-b140-decb685dcacb tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:15.899806 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d04a0bff-c7db-465b-b140-decb685dcacb tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:15.902325 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d04a0bff-c7db-465b-b140-decb685dcacb tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:15.903365 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d04a0bff-c7db-465b-b140-decb685dcacb tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:15.904634 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d04a0bff-c7db-465b-b140-decb685dcacb tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:15.905368 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d04a0bff-c7db-465b-b140-decb685dcacb tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:16.242327 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d04a0bff-c7db-465b-b140-decb685dcacb tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:16.257321 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d04a0bff-c7db-465b-b140-decb685dcacb tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1671 microversion: 2.1 time: 0.382089 Sep 08 10:57:16.258446 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2160/4261] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:15 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1671 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:16.266644 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6e2c668d-9bf1-4324-9ec8-d2ba46fc45dc tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:16.282570 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6e2c668d-9bf1-4324-9ec8-d2ba46fc45dc tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '06a779e85e1c493985f7cfe8aceb9c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4478d0e315d948df9eda910f205646c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:16.283629 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6e2c668d-9bf1-4324-9ec8-d2ba46fc45dc tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Searching by: {'deleted': False, 'project_id': '4478d0e315d948df9eda910f205646c3'} {{(pid=128861) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:57:16.293298 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6e2c668d-9bf1-4324-9ec8-d2ba46fc45dc tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:16.294048 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6e2c668d-9bf1-4324-9ec8-d2ba46fc45dc tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:16.296514 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6e2c668d-9bf1-4324-9ec8-d2ba46fc45dc tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:16.298653 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6e2c668d-9bf1-4324-9ec8-d2ba46fc45dc tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:16.299360 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6e2c668d-9bf1-4324-9ec8-d2ba46fc45dc tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:16.307893 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6e2c668d-9bf1-4324-9ec8-d2ba46fc45dc tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:16.354551 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.multi_cell_list [None req-6e2c668d-9bf1-4324-9ec8-d2ba46fc45dc tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128861) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 10:57:16.425418 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6e2c668d-9bf1-4324-9ec8-d2ba46fc45dc tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 1011 microversion: 2.1 time: 0.163849 Sep 08 10:57:16.427075 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2161/4262] 10.222.0.27 () {58 vars in 1125 bytes} [Thu Sep 8 10:57:16 2022] GET /compute/v2.1/servers => generated 1011 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:16.432829 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-35417e82-539b-4ffa-a127-66c3a370cc5f tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:16.433726 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-35417e82-539b-4ffa-a127-66c3a370cc5f tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:16.445398 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-35417e82-539b-4ffa-a127-66c3a370cc5f tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:16.449921 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-35417e82-539b-4ffa-a127-66c3a370cc5f tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:16.450379 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-35417e82-539b-4ffa-a127-66c3a370cc5f tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:16.451278 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-35417e82-539b-4ffa-a127-66c3a370cc5f tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:16.451873 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-35417e82-539b-4ffa-a127-66c3a370cc5f tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:16.452579 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-35417e82-539b-4ffa-a127-66c3a370cc5f tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:16.670527 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-51fa3668-58fe-4cd2-b3b7-af66b39fe81d tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22145c653c804031ae233de6d84647fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1c70903c3d42d790d9ef96adc1fdbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:16.687104 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-51fa3668-58fe-4cd2-b3b7-af66b39fe81d tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] 10.222.0.27 "GET /compute/v2.1/servers/2d995117-3718-4b9d-a4a1-c1185d34d701" status: 200 len: 1334 microversion: 2.1 time: 0.998182 Sep 08 10:57:16.688118 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2102/4263] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:15 2022] GET /compute/v2.1/servers/2d995117-3718-4b9d-a4a1-c1185d34d701 => generated 1334 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:16.706665 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ee9691eb-b2f7-4ff1-afa2-3880895927ff tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:16.707300 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ee9691eb-b2f7-4ff1-afa2-3880895927ff tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:16.715939 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ee9691eb-b2f7-4ff1-afa2-3880895927ff tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:16.717039 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ee9691eb-b2f7-4ff1-afa2-3880895927ff tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:16.718951 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ee9691eb-b2f7-4ff1-afa2-3880895927ff tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:16.720760 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ee9691eb-b2f7-4ff1-afa2-3880895927ff tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:16.721329 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ee9691eb-b2f7-4ff1-afa2-3880895927ff tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:16.722325 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ee9691eb-b2f7-4ff1-afa2-3880895927ff tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:16.749862 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:57:16.972965 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-35417e82-539b-4ffa-a127-66c3a370cc5f tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:16.992814 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-35417e82-539b-4ffa-a127-66c3a370cc5f tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1517 microversion: 2.1 time: 0.564010 Sep 08 10:57:16.995215 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2162/4264] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:16 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1517 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:17.004923 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5dbd0adc-0ac2-4095-ae3d-61a4c290eb79 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:17.012272 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5dbd0adc-0ac2-4095-ae3d-61a4c290eb79 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '06a779e85e1c493985f7cfe8aceb9c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4478d0e315d948df9eda910f205646c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:17.013316 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5dbd0adc-0ac2-4095-ae3d-61a4c290eb79 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '4478d0e315d948df9eda910f205646c3'} {{(pid=128861) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:57:17.028431 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5dbd0adc-0ac2-4095-ae3d-61a4c290eb79 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:17.029365 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5dbd0adc-0ac2-4095-ae3d-61a4c290eb79 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:17.030207 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5dbd0adc-0ac2-4095-ae3d-61a4c290eb79 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:17.031185 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5dbd0adc-0ac2-4095-ae3d-61a4c290eb79 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:17.031857 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5dbd0adc-0ac2-4095-ae3d-61a4c290eb79 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:17.032489 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5dbd0adc-0ac2-4095-ae3d-61a4c290eb79 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:17.101756 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ee9691eb-b2f7-4ff1-afa2-3880895927ff tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:17.117802 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ee9691eb-b2f7-4ff1-afa2-3880895927ff tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1671 microversion: 2.1 time: 0.428960 Sep 08 10:57:17.118629 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2103/4265] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:16 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1671 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:17.125041 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-782528ab-e8b8-4678-bfbc-ee571c09ebc9 req-1666d8c9-de30-48cb-b48d-6d4ebc7030a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d995117-3718-4b9d-a4a1-c1185d34d701", "name": "network-vif-plugged", "status": "completed", "tag": "e7a41aa4-591c-472d-b711-40d5b75d5929"}, {"server_uuid": "74eebde7-4328-4ddf-be14-bb9fba70ec03", "name": "network-vif-plugged", "status": "completed", "tag": "15f823c3-a4f6-4444-a294-abb10fd52df7"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:57:17.139531 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-782528ab-e8b8-4678-bfbc-ee571c09ebc9 req-1666d8c9-de30-48cb-b48d-6d4ebc7030a1 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:17.140115 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-782528ab-e8b8-4678-bfbc-ee571c09ebc9 req-1666d8c9-de30-48cb-b48d-6d4ebc7030a1 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:17.140562 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-782528ab-e8b8-4678-bfbc-ee571c09ebc9 req-1666d8c9-de30-48cb-b48d-6d4ebc7030a1 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:17.159985 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.multi_cell_list [None req-5dbd0adc-0ac2-4095-ae3d-61a4c290eb79 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128861) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 10:57:17.177411 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-782528ab-e8b8-4678-bfbc-ee571c09ebc9 req-1666d8c9-de30-48cb-b48d-6d4ebc7030a1 service nova] Creating event network-vif-plugged:e7a41aa4-591c-472d-b711-40d5b75d5929 for instance 2d995117-3718-4b9d-a4a1-c1185d34d701 on n-h2-850501-12 Sep 08 10:57:17.179107 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-782528ab-e8b8-4678-bfbc-ee571c09ebc9 req-1666d8c9-de30-48cb-b48d-6d4ebc7030a1 service nova] Creating event network-vif-plugged:15f823c3-a4f6-4444-a294-abb10fd52df7 for instance 74eebde7-4328-4ddf-be14-bb9fba70ec03 on n-h1-850501-12 Sep 08 10:57:17.195986 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-782528ab-e8b8-4678-bfbc-ee571c09ebc9 req-1666d8c9-de30-48cb-b48d-6d4ebc7030a1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.076285 Sep 08 10:57:17.204105 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2104/4266] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:57:17 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:57:17.220737 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bc4c5d79-734d-428a-9ccb-88d21288d7c5 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:17.223162 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bc4c5d79-734d-428a-9ccb-88d21288d7c5 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: 93d05d86-99b6-43f0-83c7-257ab64a12f3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:17.262383 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bc4c5d79-734d-428a-9ccb-88d21288d7c5 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:17.263215 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bc4c5d79-734d-428a-9ccb-88d21288d7c5 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:17.263603 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bc4c5d79-734d-428a-9ccb-88d21288d7c5 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:17.266009 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bc4c5d79-734d-428a-9ccb-88d21288d7c5 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:17.266607 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bc4c5d79-734d-428a-9ccb-88d21288d7c5 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:17.267359 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bc4c5d79-734d-428a-9ccb-88d21288d7c5 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:17.406143 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5dbd0adc-0ac2-4095-ae3d-61a4c290eb79 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] 10.222.0.27 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.409094 Sep 08 10:57:17.416426 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2163/4267] 10.222.0.27 () {58 vars in 1146 bytes} [Thu Sep 8 10:57:16 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:57:17.416426 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-636fb3c5-da81-443f-b598-7991a68ef469 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:57:17.416426 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-636fb3c5-da81-443f-b598-7991a68ef469 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:17.427429 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-636fb3c5-da81-443f-b598-7991a68ef469 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:17.430841 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-636fb3c5-da81-443f-b598-7991a68ef469 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:17.434609 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-636fb3c5-da81-443f-b598-7991a68ef469 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:17.435821 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-636fb3c5-da81-443f-b598-7991a68ef469 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:17.437216 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-636fb3c5-da81-443f-b598-7991a68ef469 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:17.438761 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-636fb3c5-da81-443f-b598-7991a68ef469 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:17.563835 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-636fb3c5-da81-443f-b598-7991a68ef469 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Locking {{(pid=128861) lock /opt/stack/nova/nova/compute/api.py:4845}} Sep 08 10:57:17.713622 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bc4c5d79-734d-428a-9ccb-88d21288d7c5 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:17.731195 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-636fb3c5-da81-443f-b598-7991a68ef469 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "POST /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7/action" status: 202 len: 0 microversion: 2.1 time: 0.322305 Sep 08 10:57:17.733517 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2164/4268] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:57:17 2022] POST /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7/action => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:57:17.734138 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bc4c5d79-734d-428a-9ccb-88d21288d7c5 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3" status: 200 len: 1621 microversion: 2.1 time: 0.526416 Sep 08 10:57:17.734755 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2105/4269] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:17 2022] GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3 => generated 1621 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:17.754740 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-1d8c4f5b-aaa2-4a2b-ab89-b81329567f95 req-29790dbd-cbf3-4a6e-aa48-46a912a8d6ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93d05d86-99b6-43f0-83c7-257ab64a12f3", "name": "network-vif-deleted", "tag": "b7d2eec4-5d46-4733-a430-f161034305f1"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:57:17.764575 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cc86f672-dbc8-42c6-a674-375d18bd6944 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:17.766520 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-1d8c4f5b-aaa2-4a2b-ab89-b81329567f95 req-29790dbd-cbf3-4a6e-aa48-46a912a8d6ec service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:17.772829 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-1d8c4f5b-aaa2-4a2b-ab89-b81329567f95 req-29790dbd-cbf3-4a6e-aa48-46a912a8d6ec service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:17.774713 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-1d8c4f5b-aaa2-4a2b-ab89-b81329567f95 req-29790dbd-cbf3-4a6e-aa48-46a912a8d6ec service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:17.793277 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cc86f672-dbc8-42c6-a674-375d18bd6944 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '06a779e85e1c493985f7cfe8aceb9c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4478d0e315d948df9eda910f205646c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:17.796140 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.compute.servers [None req-cc86f672-dbc8-42c6-a674-375d18bd6944 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Removing options 'limit' from query {{(pid=128862) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 08 10:57:17.799165 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cc86f672-dbc8-42c6-a674-375d18bd6944 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Searching by: {'deleted': False, 'project_id': '4478d0e315d948df9eda910f205646c3'} {{(pid=128862) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:57:17.802023 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-1d8c4f5b-aaa2-4a2b-ab89-b81329567f95 req-29790dbd-cbf3-4a6e-aa48-46a912a8d6ec service nova] Creating event network-vif-deleted:b7d2eec4-5d46-4733-a430-f161034305f1 for instance 93d05d86-99b6-43f0-83c7-257ab64a12f3 on n-h2-850501-12 Sep 08 10:57:17.815370 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-1d8c4f5b-aaa2-4a2b-ab89-b81329567f95 req-29790dbd-cbf3-4a6e-aa48-46a912a8d6ec service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079178 Sep 08 10:57:17.816400 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2165/4270] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:57:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:57:17.823329 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc86f672-dbc8-42c6-a674-375d18bd6944 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:17.823966 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc86f672-dbc8-42c6-a674-375d18bd6944 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:17.825223 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc86f672-dbc8-42c6-a674-375d18bd6944 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:17.826882 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc86f672-dbc8-42c6-a674-375d18bd6944 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:17.831685 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9d22b42b-6727-41e6-80f1-b463e11dc558 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:17.831685 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9d22b42b-6727-41e6-80f1-b463e11dc558 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] [instance: 2d995117-3718-4b9d-a4a1-c1185d34d701] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:17.838370 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc86f672-dbc8-42c6-a674-375d18bd6944 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:17.839229 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc86f672-dbc8-42c6-a674-375d18bd6944 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:17.846864 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9d22b42b-6727-41e6-80f1-b463e11dc558 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:17.847372 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9d22b42b-6727-41e6-80f1-b463e11dc558 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:17.848410 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9d22b42b-6727-41e6-80f1-b463e11dc558 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:17.854210 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9d22b42b-6727-41e6-80f1-b463e11dc558 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:17.854713 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9d22b42b-6727-41e6-80f1-b463e11dc558 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:17.855169 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9d22b42b-6727-41e6-80f1-b463e11dc558 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:17.880769 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cc86f672-dbc8-42c6-a674-375d18bd6944 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] 10.222.0.27 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.122041 Sep 08 10:57:17.891277 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2106/4271] 10.222.0.27 () {58 vars in 1140 bytes} [Thu Sep 8 10:57:17 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:57:17.903029 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-001b3f77-9797-424c-a6f2-9808ff8d2050 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:17.903857 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-001b3f77-9797-424c-a6f2-9808ff8d2050 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:17.929307 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-001b3f77-9797-424c-a6f2-9808ff8d2050 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:17.930323 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-001b3f77-9797-424c-a6f2-9808ff8d2050 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:17.931054 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-001b3f77-9797-424c-a6f2-9808ff8d2050 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:17.932120 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-001b3f77-9797-424c-a6f2-9808ff8d2050 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:17.933149 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-001b3f77-9797-424c-a6f2-9808ff8d2050 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:17.934397 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-001b3f77-9797-424c-a6f2-9808ff8d2050 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:18.251262 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9d22b42b-6727-41e6-80f1-b463e11dc558 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22145c653c804031ae233de6d84647fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1c70903c3d42d790d9ef96adc1fdbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:18.263063 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9d22b42b-6727-41e6-80f1-b463e11dc558 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] 10.222.0.27 "GET /compute/v2.1/servers/2d995117-3718-4b9d-a4a1-c1185d34d701" status: 200 len: 1334 microversion: 2.1 time: 0.445300 Sep 08 10:57:18.273874 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2166/4272] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:17 2022] GET /compute/v2.1/servers/2d995117-3718-4b9d-a4a1-c1185d34d701 => generated 1334 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:18.277140 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-54d50f3e-25e8-4af7-a4ec-b841d5bd4bbd tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:18.285653 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-54d50f3e-25e8-4af7-a4ec-b841d5bd4bbd tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '06a779e85e1c493985f7cfe8aceb9c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4478d0e315d948df9eda910f205646c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:18.290643 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-54d50f3e-25e8-4af7-a4ec-b841d5bd4bbd tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1975568299', 'deleted': False, 'project_id': '4478d0e315d948df9eda910f205646c3'} {{(pid=128861) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:57:18.305743 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-54d50f3e-25e8-4af7-a4ec-b841d5bd4bbd tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:18.306227 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-54d50f3e-25e8-4af7-a4ec-b841d5bd4bbd tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:18.306690 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-54d50f3e-25e8-4af7-a4ec-b841d5bd4bbd tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:18.307416 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-54d50f3e-25e8-4af7-a4ec-b841d5bd4bbd tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:18.307862 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-54d50f3e-25e8-4af7-a4ec-b841d5bd4bbd tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:18.308286 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-54d50f3e-25e8-4af7-a4ec-b841d5bd4bbd tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:18.500711 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.multi_cell_list [None req-54d50f3e-25e8-4af7-a4ec-b841d5bd4bbd tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128861) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 10:57:18.590234 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-001b3f77-9797-424c-a6f2-9808ff8d2050 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:18.608981 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-001b3f77-9797-424c-a6f2-9808ff8d2050 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1671 microversion: 2.1 time: 0.721890 Sep 08 10:57:18.609847 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2107/4273] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:17 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1671 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:18.632037 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d743c7e4-a01b-41a2-886f-03233aa728fa tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:18.632904 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d743c7e4-a01b-41a2-886f-03233aa728fa tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:18.644341 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d743c7e4-a01b-41a2-886f-03233aa728fa tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:18.645262 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-54d50f3e-25e8-4af7-a4ec-b841d5bd4bbd tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] 10.222.0.27 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1975568299" status: 200 len: 346 microversion: 2.1 time: 0.376884 Sep 08 10:57:18.646724 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2167/4274] 10.222.0.27 () {58 vars in 1242 bytes} [Thu Sep 8 10:57:18 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1975568299 => generated 346 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:57:18.647188 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d743c7e4-a01b-41a2-886f-03233aa728fa tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:18.647703 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d743c7e4-a01b-41a2-886f-03233aa728fa tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:18.648450 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d743c7e4-a01b-41a2-886f-03233aa728fa tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:18.648916 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d743c7e4-a01b-41a2-886f-03233aa728fa tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:18.649409 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d743c7e4-a01b-41a2-886f-03233aa728fa tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:18.653081 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5a8d1abb-c1a4-45dc-bd32-f0e2d2049372 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:57:18.660513 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5a8d1abb-c1a4-45dc-bd32-f0e2d2049372 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:18.661635 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5a8d1abb-c1a4-45dc-bd32-f0e2d2049372 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:18.662299 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5a8d1abb-c1a4-45dc-bd32-f0e2d2049372 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:18.692635 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-5a8d1abb-c1a4-45dc-bd32-f0e2d2049372 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] HTTP exception thrown: Instance e81e0acc-0b96-4dbc-a5bb-89183f5204e7 is locked Sep 08 10:57:18.696826 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5a8d1abb-c1a4-45dc-bd32-f0e2d2049372 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Request method failure captured: Sep 08 10:57:18.696826 n-d-850501-12 devstack@n-api.service[128861]: request: POST /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7/action HTTP/1.1 Sep 08 10:57:18.696826 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:57:18.696826 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:57:18.696826 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:57:18.696826 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 15 Sep 08 10:57:18.696826 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:57:18.696826 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:57:18.696826 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:57:18.696826 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:57:18.696826 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGclESil0k3YwhrgmBq9RP58BT8ggCfoq71W7WWaQs79ajWV7VkDiBFW1SHjoqsRUYcZFA-S32MHtcVEuvCs9KDt4sUyYXYecQKP0Pc6KvZoCxHDx-TLBLeVMVKgTKTHMZY5fKwLa-YndhdHH_rmxBkRZ4MxFl9oZaWC-z8pqYA8SSe4 Sep 08 10:57:18.696826 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:57:18.696826 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:57:18.696826 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:57:18.696826 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:57:18.696826 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:57:18.696826 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:57:18.696826 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 11b5d4706b2d43aca8290ccf07ee1ece Sep 08 10:57:18.696826 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServerActionsTestJSON-1762930547 Sep 08 10:57:18.696826 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:57:18.696826 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:57:18.696826 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/11b5d4706b2d43aca8290ccf07ee1ece"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/11b5d4706b2d43aca8290ccf07ee1ece"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_11b5d4706b2d43aca8290ccf07ee1ece"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/11b5d4706b2d43aca8290ccf07ee1ece"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:57:18.696826 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServerActionsTestJSON-1762930547 Sep 08 10:57:18.696826 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 11b5d4706b2d43aca8290ccf07ee1ece Sep 08 10:57:18.696826 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServerActionsTestJSON-1762930547 Sep 08 10:57:18.696826 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServerActionsTestJSON-1762930547-project Sep 08 10:57:18.696826 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:57:18.696826 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:57:18.696826 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: d68b017335c84d15becbdc7615498103 Sep 08 10:57:18.696826 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServerActionsTestJSON-1762930547-project Sep 08 10:57:18.696826 n-d-850501-12 devstack@n-api.service[128861]: Sep 08 10:57:18.696826 n-d-850501-12 devstack@n-api.service[128861]: {"os-stop": {}} Sep 08 10:57:18.696826 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:57:18.696826 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance e81e0acc-0b96-4dbc-a5bb-89183f5204e7 is locked Sep 08 10:57:18.696826 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': 'e81e0acc-0b96-4dbc-a5bb-89183f5204e7', 'body': {'os-stop': {}}} Sep 08 10:57:18.696826 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:57:18.696826 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:57:18.696826 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Sep 08 10:57:18.696826 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Sep 08 10:57:18.696826 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Sep 08 10:57:18.696826 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Sep 08 10:57:18.696826 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance e81e0acc-0b96-4dbc-a5bb-89183f5204e7 is locked Sep 08 10:57:18.696826 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:57:18.696826 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:57:18.696826 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:57:18.696826 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:57:18.696826 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:57:18.696826 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:57:18.696826 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:57:18.696826 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:57:18.696826 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:57:18.696826 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:57:18.696826 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Sep 08 10:57:18.696826 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Sep 08 10:57:18.696826 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance e81e0acc-0b96-4dbc-a5bb-89183f5204e7 is locked Sep 08 10:57:18.696826 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:57:18.696826 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:57:18.696826 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:57:18.696826 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:57:18.696826 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:57:18.696826 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:57:18.696826 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:57:18.696826 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:57:18.696826 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e81e0acc-0b96-4dbc-a5bb-89183f5204e7 is locked Sep 08 10:57:18.696826 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:57:18.704733 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5a8d1abb-c1a4-45dc-bd32-f0e2d2049372 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Returning 409 to user: Instance e81e0acc-0b96-4dbc-a5bb-89183f5204e7 is locked {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:57:18.707406 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5a8d1abb-c1a4-45dc-bd32-f0e2d2049372 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "POST /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7/action" status: 409 len: 107 microversion: 2.1 time: 0.058851 Sep 08 10:57:18.710089 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2168/4275] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:57:18 2022] POST /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7/action => generated 107 bytes in 62 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:57:18.724314 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-64e53542-2c09-487c-9854-4b35986ca5ba tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:57:18.733720 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64e53542-2c09-487c-9854-4b35986ca5ba tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:18.734484 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64e53542-2c09-487c-9854-4b35986ca5ba tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:18.735195 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64e53542-2c09-487c-9854-4b35986ca5ba tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:18.772402 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-64e53542-2c09-487c-9854-4b35986ca5ba tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] [instance: 931569b4-139a-4939-abf3-49a589eb1d91] Going to try to stop instance {{(pid=128861) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 08 10:57:18.827046 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-64e53542-2c09-487c-9854-4b35986ca5ba tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] 10.222.0.27 "POST /compute/v2.1/servers/931569b4-139a-4939-abf3-49a589eb1d91/action" status: 202 len: 0 microversion: 2.1 time: 0.115185 Sep 08 10:57:18.828862 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2169/4276] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:57:18 2022] POST /compute/v2.1/servers/931569b4-139a-4939-abf3-49a589eb1d91/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:57:18.835338 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3bf3a9f1-0e69-4d23-aa85-96a322b72323 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:57:18.836590 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3bf3a9f1-0e69-4d23-aa85-96a322b72323 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:18.845243 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3bf3a9f1-0e69-4d23-aa85-96a322b72323 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:18.846438 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3bf3a9f1-0e69-4d23-aa85-96a322b72323 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:18.847602 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3bf3a9f1-0e69-4d23-aa85-96a322b72323 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:18.850754 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3bf3a9f1-0e69-4d23-aa85-96a322b72323 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:18.851571 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3bf3a9f1-0e69-4d23-aa85-96a322b72323 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:18.852292 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3bf3a9f1-0e69-4d23-aa85-96a322b72323 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:18.891215 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:57:18.987139 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3bf3a9f1-0e69-4d23-aa85-96a322b72323 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Unlocking {{(pid=128861) unlock /opt/stack/nova/nova/compute/api.py:4874}} Sep 08 10:57:19.123720 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3bf3a9f1-0e69-4d23-aa85-96a322b72323 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "POST /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7/action" status: 202 len: 0 microversion: 2.1 time: 0.291448 Sep 08 10:57:19.125337 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2170/4277] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:57:18 2022] POST /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7/action => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:57:19.136255 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-506a97ea-ed43-47dc-8bb7-f04cd7cda018 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:19.137009 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-506a97ea-ed43-47dc-8bb7-f04cd7cda018 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: 93d05d86-99b6-43f0-83c7-257ab64a12f3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:19.159253 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-506a97ea-ed43-47dc-8bb7-f04cd7cda018 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:19.159800 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-506a97ea-ed43-47dc-8bb7-f04cd7cda018 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:19.160265 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-506a97ea-ed43-47dc-8bb7-f04cd7cda018 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:19.163745 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-506a97ea-ed43-47dc-8bb7-f04cd7cda018 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:19.166739 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-506a97ea-ed43-47dc-8bb7-f04cd7cda018 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:19.167452 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-506a97ea-ed43-47dc-8bb7-f04cd7cda018 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:19.211018 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-506a97ea-ed43-47dc-8bb7-f04cd7cda018 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] HTTP exception thrown: Instance 93d05d86-99b6-43f0-83c7-257ab64a12f3 could not be found. Sep 08 10:57:19.215498 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-506a97ea-ed43-47dc-8bb7-f04cd7cda018 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Request method failure captured: Sep 08 10:57:19.215498 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3 HTTP/1.1 Sep 08 10:57:19.215498 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:57:19.215498 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:57:19.215498 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:57:19.215498 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:57:19.215498 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:57:19.215498 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:57:19.215498 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:57:19.215498 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:57:19.215498 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGclZnrdHbcSspe2CSaO_gA2LIWMGtHJAKVo_u3dlzxs9JxAXcXCwrL-z-q8SJvnWUnwIz6KxjkLXp0jFFwIV3x5Qp_zUHQKWEwS-EZKwoM8W4-UxwLeQWJTnQ9cWOYmTzHY9djf2pYmuh6sOSJJezx_5s2ElCgN_L-D4iql7Pg9xGj8 Sep 08 10:57:19.215498 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:57:19.215498 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:57:19.215498 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:57:19.215498 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:57:19.215498 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:57:19.215498 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:57:19.215498 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 33063b3b9e0543369c28ea918f52cf37 Sep 08 10:57:19.215498 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1820338337 Sep 08 10:57:19.215498 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:57:19.215498 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:57:19.215498 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/33063b3b9e0543369c28ea918f52cf37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/33063b3b9e0543369c28ea918f52cf37"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_33063b3b9e0543369c28ea918f52cf37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/33063b3b9e0543369c28ea918f52cf37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:57:19.215498 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1820338337 Sep 08 10:57:19.215498 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 33063b3b9e0543369c28ea918f52cf37 Sep 08 10:57:19.215498 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1820338337 Sep 08 10:57:19.215498 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServerRescueNegativeTestJSON-1820338337-project Sep 08 10:57:19.215498 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:57:19.215498 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:57:19.215498 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 8f487f5d062e4ac3bf21c2416a7b50ee Sep 08 10:57:19.215498 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1820338337-project Sep 08 10:57:19.215498 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:57:19.215498 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 93d05d86-99b6-43f0-83c7-257ab64a12f3 could not be found. Sep 08 10:57:19.215498 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '93d05d86-99b6-43f0-83c7-257ab64a12f3'} Sep 08 10:57:19.215498 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:57:19.215498 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:57:19.215498 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:57:19.215498 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:57:19.215498 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:57:19.215498 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:57:19.215498 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:57:19.215498 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:57:19.215498 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:57:19.215498 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:57:19.215498 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93d05d86-99b6-43f0-83c7-257ab64a12f3 could not be found. Sep 08 10:57:19.215498 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:57:19.215498 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:57:19.215498 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:57:19.215498 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:57:19.215498 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:57:19.215498 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:57:19.215498 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:57:19.215498 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:57:19.215498 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:57:19.215498 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:57:19.215498 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:57:19.215498 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:57:19.215498 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:57:19.215498 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:57:19.215498 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:57:19.215498 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:57:19.215498 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93d05d86-99b6-43f0-83c7-257ab64a12f3 could not be found. Sep 08 10:57:19.215498 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:57:19.215498 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:57:19.219370 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:57:19.219370 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:57:19.219370 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:57:19.219370 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:57:19.219370 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:57:19.219370 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:57:19.219370 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93d05d86-99b6-43f0-83c7-257ab64a12f3 could not be found. Sep 08 10:57:19.219370 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:57:19.219370 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-506a97ea-ed43-47dc-8bb7-f04cd7cda018 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Returning 404 to user: Instance 93d05d86-99b6-43f0-83c7-257ab64a12f3 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:57:19.222496 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-506a97ea-ed43-47dc-8bb7-f04cd7cda018 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3" status: 404 len: 111 microversion: 2.1 time: 0.096082 Sep 08 10:57:19.227900 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2171/4278] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:19 2022] GET /compute/v2.1/servers/93d05d86-99b6-43f0-83c7-257ab64a12f3 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:57:19.243160 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8e2b631c-e3cd-42af-a14f-eb42698d5c8a tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:19.243781 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8e2b631c-e3cd-42af-a14f-eb42698d5c8a tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] [instance: 931569b4-139a-4939-abf3-49a589eb1d91] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:19.251245 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8e2b631c-e3cd-42af-a14f-eb42698d5c8a tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:19.251759 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8e2b631c-e3cd-42af-a14f-eb42698d5c8a tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:19.252231 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8e2b631c-e3cd-42af-a14f-eb42698d5c8a tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:19.252919 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8e2b631c-e3cd-42af-a14f-eb42698d5c8a tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:19.253436 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8e2b631c-e3cd-42af-a14f-eb42698d5c8a tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:19.253868 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8e2b631c-e3cd-42af-a14f-eb42698d5c8a tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:19.482556 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d743c7e4-a01b-41a2-886f-03233aa728fa tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:19.498134 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d743c7e4-a01b-41a2-886f-03233aa728fa tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1517 microversion: 2.1 time: 0.885951 Sep 08 10:57:19.521994 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2108/4279] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:18 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1517 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:19.527812 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8eda5289-1439-4a86-8051-5b2678d169bf tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:57:19.547303 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8eda5289-1439-4a86-8051-5b2678d169bf tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:19.548082 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8eda5289-1439-4a86-8051-5b2678d169bf tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:19.548667 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8eda5289-1439-4a86-8051-5b2678d169bf tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:19.677843 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8eda5289-1439-4a86-8051-5b2678d169bf tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Going to try to stop instance {{(pid=128862) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 08 10:57:19.781204 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8eda5289-1439-4a86-8051-5b2678d169bf tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "POST /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7/action" status: 202 len: 0 microversion: 2.1 time: 0.256593 Sep 08 10:57:19.783309 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2109/4280] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:57:19 2022] POST /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7/action => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:57:19.807299 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cc6a659f-41a5-4f25-bd86-fc9dc36abf3b tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '.version_select at 0x7f68e414d5e0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:19.824257 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8e2b631c-e3cd-42af-a14f-eb42698d5c8a tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a779e85e1c493985f7cfe8aceb9c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4478d0e315d948df9eda910f205646c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:19.844141 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8e2b631c-e3cd-42af-a14f-eb42698d5c8a tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] 10.222.0.27 "GET /compute/v2.1/servers/931569b4-139a-4939-abf3-49a589eb1d91" status: 200 len: 1522 microversion: 2.1 time: 0.605106 Sep 08 10:57:19.855472 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cc6a659f-41a5-4f25-bd86-fc9dc36abf3b tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-844901694" status: 202 len: 0 microversion: 2.1 time: 0.070267 Sep 08 10:57:19.860415 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2110/4281] 10.222.0.27 () {58 vars in 1218 bytes} [Thu Sep 8 10:57:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-844901694 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:57:19.861558 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2172/4282] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:19 2022] GET /compute/v2.1/servers/931569b4-139a-4939-abf3-49a589eb1d91 => generated 1522 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:19.871242 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a955f122-5db0-48ca-be49-34ffc3f301ce tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:19.872520 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a955f122-5db0-48ca-be49-34ffc3f301ce tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] [instance: 2d995117-3718-4b9d-a4a1-c1185d34d701] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:19.882303 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a955f122-5db0-48ca-be49-34ffc3f301ce tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:19.883090 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a955f122-5db0-48ca-be49-34ffc3f301ce tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:19.883731 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a955f122-5db0-48ca-be49-34ffc3f301ce tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:19.884821 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a955f122-5db0-48ca-be49-34ffc3f301ce tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:19.885669 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a955f122-5db0-48ca-be49-34ffc3f301ce tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:19.886442 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a955f122-5db0-48ca-be49-34ffc3f301ce tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:19.889911 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ec0725b7-7c70-4031-b081-a8b664c4fcb6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:19.891015 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ec0725b7-7c70-4031-b081-a8b664c4fcb6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:19.916669 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ec0725b7-7c70-4031-b081-a8b664c4fcb6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:19.917698 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ec0725b7-7c70-4031-b081-a8b664c4fcb6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:19.918474 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ec0725b7-7c70-4031-b081-a8b664c4fcb6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:19.919580 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ec0725b7-7c70-4031-b081-a8b664c4fcb6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:19.920248 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ec0725b7-7c70-4031-b081-a8b664c4fcb6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:19.923273 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ec0725b7-7c70-4031-b081-a8b664c4fcb6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:20.109786 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:57:20.287112 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a955f122-5db0-48ca-be49-34ffc3f301ce tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22145c653c804031ae233de6d84647fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1c70903c3d42d790d9ef96adc1fdbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:20.298396 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a955f122-5db0-48ca-be49-34ffc3f301ce tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] 10.222.0.27 "GET /compute/v2.1/servers/2d995117-3718-4b9d-a4a1-c1185d34d701" status: 200 len: 1670 microversion: 2.1 time: 0.436658 Sep 08 10:57:20.314242 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2111/4283] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:19 2022] GET /compute/v2.1/servers/2d995117-3718-4b9d-a4a1-c1185d34d701 => generated 1670 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:20.327348 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a90c9baa-9482-44b3-bc44-bac15abba65c tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:20.328287 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a90c9baa-9482-44b3-bc44-bac15abba65c tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] [instance: 2d995117-3718-4b9d-a4a1-c1185d34d701] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:20.336541 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a90c9baa-9482-44b3-bc44-bac15abba65c tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:20.337520 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a90c9baa-9482-44b3-bc44-bac15abba65c tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:20.338664 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a90c9baa-9482-44b3-bc44-bac15abba65c tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:20.339653 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a90c9baa-9482-44b3-bc44-bac15abba65c tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:20.340273 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a90c9baa-9482-44b3-bc44-bac15abba65c tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:20.341223 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a90c9baa-9482-44b3-bc44-bac15abba65c tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:20.377332 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a90c9baa-9482-44b3-bc44-bac15abba65c tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] 10.222.0.27 "GET /compute/v2.1/servers/2d995117-3718-4b9d-a4a1-c1185d34d701/ips" status: 200 len: 180 microversion: 2.1 time: 0.053589 Sep 08 10:57:20.391266 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2112/4284] 10.222.0.27 () {58 vars in 1248 bytes} [Thu Sep 8 10:57:20 2022] GET /compute/v2.1/servers/2d995117-3718-4b9d-a4a1-c1185d34d701/ips => generated 180 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:57:20.399487 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bd3e95e3-ee0a-4c8c-956c-8dc5bc17d1ef tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:20.400258 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bd3e95e3-ee0a-4c8c-956c-8dc5bc17d1ef tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] [instance: 2d995117-3718-4b9d-a4a1-c1185d34d701] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:20.408593 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bd3e95e3-ee0a-4c8c-956c-8dc5bc17d1ef tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:20.409370 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bd3e95e3-ee0a-4c8c-956c-8dc5bc17d1ef tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:20.409964 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bd3e95e3-ee0a-4c8c-956c-8dc5bc17d1ef tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:20.410894 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bd3e95e3-ee0a-4c8c-956c-8dc5bc17d1ef tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:20.411997 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bd3e95e3-ee0a-4c8c-956c-8dc5bc17d1ef tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:20.412583 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bd3e95e3-ee0a-4c8c-956c-8dc5bc17d1ef tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:20.444498 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bd3e95e3-ee0a-4c8c-956c-8dc5bc17d1ef tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] [instance: 2d995117-3718-4b9d-a4a1-c1185d34d701] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:57:20.605744 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bd3e95e3-ee0a-4c8c-956c-8dc5bc17d1ef tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2d995117-3718-4b9d-a4a1-c1185d34d701" status: 204 len: 0 microversion: 2.1 time: 0.212062 Sep 08 10:57:20.607034 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2113/4285] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:57:20 2022] DELETE /compute/v2.1/servers/2d995117-3718-4b9d-a4a1-c1185d34d701 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:57:20.619653 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-17faf13e-67d1-4655-92b7-ca4f055be923 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:20.620939 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-17faf13e-67d1-4655-92b7-ca4f055be923 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:20.628458 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-17faf13e-67d1-4655-92b7-ca4f055be923 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:20.628962 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-17faf13e-67d1-4655-92b7-ca4f055be923 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:20.629452 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-17faf13e-67d1-4655-92b7-ca4f055be923 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:20.630296 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-17faf13e-67d1-4655-92b7-ca4f055be923 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:20.631229 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-17faf13e-67d1-4655-92b7-ca4f055be923 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:20.631983 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-17faf13e-67d1-4655-92b7-ca4f055be923 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:21.014317 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ec0725b7-7c70-4031-b081-a8b664c4fcb6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:21.053251 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ec0725b7-7c70-4031-b081-a8b664c4fcb6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1681 microversion: 2.1 time: 1.186340 Sep 08 10:57:21.054558 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2173/4286] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:19 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1681 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:21.101683 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-62037f02-fcc0-46b3-81a5-927043413497 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:21.118129 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-62037f02-fcc0-46b3-81a5-927043413497 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] [instance: 2d995117-3718-4b9d-a4a1-c1185d34d701] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:21.140556 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-62037f02-fcc0-46b3-81a5-927043413497 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:21.142639 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-62037f02-fcc0-46b3-81a5-927043413497 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:21.143413 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-62037f02-fcc0-46b3-81a5-927043413497 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:21.144427 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-62037f02-fcc0-46b3-81a5-927043413497 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:21.145151 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-62037f02-fcc0-46b3-81a5-927043413497 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:21.146871 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-62037f02-fcc0-46b3-81a5-927043413497 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:21.787353 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-17faf13e-67d1-4655-92b7-ca4f055be923 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:21.799223 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-17faf13e-67d1-4655-92b7-ca4f055be923 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1517 microversion: 2.1 time: 1.186097 Sep 08 10:57:21.815141 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2114/4287] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:20 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1517 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:21.830068 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-49fca49d-055e-4a80-943b-354e524acad8 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:21.831997 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-49fca49d-055e-4a80-943b-354e524acad8 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] [instance: 931569b4-139a-4939-abf3-49a589eb1d91] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:21.844280 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49fca49d-055e-4a80-943b-354e524acad8 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:21.855832 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49fca49d-055e-4a80-943b-354e524acad8 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:21.856449 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49fca49d-055e-4a80-943b-354e524acad8 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:21.858260 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49fca49d-055e-4a80-943b-354e524acad8 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:21.858892 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49fca49d-055e-4a80-943b-354e524acad8 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:21.860065 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49fca49d-055e-4a80-943b-354e524acad8 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:22.221103 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-62037f02-fcc0-46b3-81a5-927043413497 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22145c653c804031ae233de6d84647fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1c70903c3d42d790d9ef96adc1fdbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:22.234650 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-62037f02-fcc0-46b3-81a5-927043413497 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] 10.222.0.27 "GET /compute/v2.1/servers/2d995117-3718-4b9d-a4a1-c1185d34d701" status: 200 len: 1676 microversion: 2.1 time: 1.149001 Sep 08 10:57:22.235250 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2174/4288] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:21 2022] GET /compute/v2.1/servers/2d995117-3718-4b9d-a4a1-c1185d34d701 => generated 1676 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:22.266671 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d8af39c5-96a2-4f58-b0fe-58b4c332a92e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:22.267297 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d8af39c5-96a2-4f58-b0fe-58b4c332a92e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:22.294895 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d8af39c5-96a2-4f58-b0fe-58b4c332a92e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:22.295784 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d8af39c5-96a2-4f58-b0fe-58b4c332a92e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:22.296379 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d8af39c5-96a2-4f58-b0fe-58b4c332a92e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:22.297298 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d8af39c5-96a2-4f58-b0fe-58b4c332a92e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:22.297961 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d8af39c5-96a2-4f58-b0fe-58b4c332a92e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:22.298620 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d8af39c5-96a2-4f58-b0fe-58b4c332a92e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:22.535538 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d8af39c5-96a2-4f58-b0fe-58b4c332a92e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:22.547778 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d8af39c5-96a2-4f58-b0fe-58b4c332a92e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1681 microversion: 2.1 time: 0.290612 Sep 08 10:57:22.548969 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2175/4289] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:22 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1681 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:22.829895 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5bc34f14-e0fd-42c8-b0a5-442a2cf91317 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:22.831032 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5bc34f14-e0fd-42c8-b0a5-442a2cf91317 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:22.850601 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5bc34f14-e0fd-42c8-b0a5-442a2cf91317 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:22.851448 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5bc34f14-e0fd-42c8-b0a5-442a2cf91317 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:22.852260 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5bc34f14-e0fd-42c8-b0a5-442a2cf91317 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:22.854054 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5bc34f14-e0fd-42c8-b0a5-442a2cf91317 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:22.854844 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5bc34f14-e0fd-42c8-b0a5-442a2cf91317 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:22.855328 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5bc34f14-e0fd-42c8-b0a5-442a2cf91317 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:22.934516 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-49fca49d-055e-4a80-943b-354e524acad8 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a779e85e1c493985f7cfe8aceb9c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4478d0e315d948df9eda910f205646c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:22.945779 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-49fca49d-055e-4a80-943b-354e524acad8 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] 10.222.0.27 "GET /compute/v2.1/servers/931569b4-139a-4939-abf3-49a589eb1d91" status: 200 len: 1522 microversion: 2.1 time: 1.128910 Sep 08 10:57:22.946782 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2115/4290] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:21 2022] GET /compute/v2.1/servers/931569b4-139a-4939-abf3-49a589eb1d91 => generated 1522 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:23.102511 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5bc34f14-e0fd-42c8-b0a5-442a2cf91317 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:23.117944 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5bc34f14-e0fd-42c8-b0a5-442a2cf91317 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 0.291566 Sep 08 10:57:23.121045 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2176/4291] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:22 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:57:23.157469 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-af8fb414-729f-4c97-a9ed-44b3b0eb6726 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:23.158569 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-af8fb414-729f-4c97-a9ed-44b3b0eb6726 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:23.168506 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af8fb414-729f-4c97-a9ed-44b3b0eb6726 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:23.169440 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af8fb414-729f-4c97-a9ed-44b3b0eb6726 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:23.169941 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af8fb414-729f-4c97-a9ed-44b3b0eb6726 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:23.170797 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af8fb414-729f-4c97-a9ed-44b3b0eb6726 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:23.172226 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af8fb414-729f-4c97-a9ed-44b3b0eb6726 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:23.172226 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af8fb414-729f-4c97-a9ed-44b3b0eb6726 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:23.264871 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-25d0df6e-b65f-4f0b-b1e0-26611430ad87 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:23.266952 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-25d0df6e-b65f-4f0b-b1e0-26611430ad87 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] [instance: 2d995117-3718-4b9d-a4a1-c1185d34d701] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:23.280778 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-25d0df6e-b65f-4f0b-b1e0-26611430ad87 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:23.282075 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-25d0df6e-b65f-4f0b-b1e0-26611430ad87 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:23.288985 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-25d0df6e-b65f-4f0b-b1e0-26611430ad87 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:23.290188 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-25d0df6e-b65f-4f0b-b1e0-26611430ad87 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:23.290886 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-25d0df6e-b65f-4f0b-b1e0-26611430ad87 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:23.291495 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-25d0df6e-b65f-4f0b-b1e0-26611430ad87 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:23.600252 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-25d0df6e-b65f-4f0b-b1e0-26611430ad87 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22145c653c804031ae233de6d84647fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1c70903c3d42d790d9ef96adc1fdbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:23.615951 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-25d0df6e-b65f-4f0b-b1e0-26611430ad87 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] 10.222.0.27 "GET /compute/v2.1/servers/2d995117-3718-4b9d-a4a1-c1185d34d701" status: 200 len: 1676 microversion: 2.1 time: 0.354525 Sep 08 10:57:23.636159 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2177/4292] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:23 2022] GET /compute/v2.1/servers/2d995117-3718-4b9d-a4a1-c1185d34d701 => generated 1676 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:57:23.644343 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-665ce493-69c3-4641-ab8f-068d94eb16e6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:23.646279 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-665ce493-69c3-4641-ab8f-068d94eb16e6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:23.658738 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-665ce493-69c3-4641-ab8f-068d94eb16e6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:23.659651 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-665ce493-69c3-4641-ab8f-068d94eb16e6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:23.660628 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-665ce493-69c3-4641-ab8f-068d94eb16e6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:23.662670 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-665ce493-69c3-4641-ab8f-068d94eb16e6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:23.663537 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-665ce493-69c3-4641-ab8f-068d94eb16e6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:23.664267 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-665ce493-69c3-4641-ab8f-068d94eb16e6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:23.686956 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=6 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:57:23.906179 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-665ce493-69c3-4641-ab8f-068d94eb16e6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:23.917902 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-665ce493-69c3-4641-ab8f-068d94eb16e6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1681 microversion: 2.1 time: 0.280235 Sep 08 10:57:23.919794 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2178/4293] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:23 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1681 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:23.954691 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-af8fb414-729f-4c97-a9ed-44b3b0eb6726 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:23.981961 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-51ebf0e3-87ed-4458-a5da-2166715b8566 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:23.987953 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-51ebf0e3-87ed-4458-a5da-2166715b8566 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] [instance: 931569b4-139a-4939-abf3-49a589eb1d91] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:24.004674 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-af8fb414-729f-4c97-a9ed-44b3b0eb6726 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 0.854998 Sep 08 10:57:24.019795 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2116/4294] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:23 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:57:24.020203 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-51ebf0e3-87ed-4458-a5da-2166715b8566 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:24.020203 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-51ebf0e3-87ed-4458-a5da-2166715b8566 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:24.020203 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-51ebf0e3-87ed-4458-a5da-2166715b8566 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:24.020203 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-51ebf0e3-87ed-4458-a5da-2166715b8566 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:24.020203 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-51ebf0e3-87ed-4458-a5da-2166715b8566 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:24.020203 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-51ebf0e3-87ed-4458-a5da-2166715b8566 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:24.078432 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-70eb18ad-0328-47cc-a14c-f0779c8fef8e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:24.079535 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-70eb18ad-0328-47cc-a14c-f0779c8fef8e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:24.109597 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70eb18ad-0328-47cc-a14c-f0779c8fef8e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:24.110459 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70eb18ad-0328-47cc-a14c-f0779c8fef8e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:24.117767 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70eb18ad-0328-47cc-a14c-f0779c8fef8e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:24.129450 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70eb18ad-0328-47cc-a14c-f0779c8fef8e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:24.133752 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70eb18ad-0328-47cc-a14c-f0779c8fef8e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:24.139035 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70eb18ad-0328-47cc-a14c-f0779c8fef8e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:24.525943 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-51ebf0e3-87ed-4458-a5da-2166715b8566 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a779e85e1c493985f7cfe8aceb9c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4478d0e315d948df9eda910f205646c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:24.538501 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-51ebf0e3-87ed-4458-a5da-2166715b8566 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] 10.222.0.27 "GET /compute/v2.1/servers/931569b4-139a-4939-abf3-49a589eb1d91" status: 200 len: 1522 microversion: 2.1 time: 0.570554 Sep 08 10:57:24.539198 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2179/4295] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:23 2022] GET /compute/v2.1/servers/931569b4-139a-4939-abf3-49a589eb1d91 => generated 1522 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:24.658431 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-aa43dd03-76d0-4df7-8098-080ebccdb297 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:24.658910 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-aa43dd03-76d0-4df7-8098-080ebccdb297 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] [instance: 2d995117-3718-4b9d-a4a1-c1185d34d701] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:24.678325 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aa43dd03-76d0-4df7-8098-080ebccdb297 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:24.679528 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aa43dd03-76d0-4df7-8098-080ebccdb297 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:24.680385 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aa43dd03-76d0-4df7-8098-080ebccdb297 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:24.682115 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aa43dd03-76d0-4df7-8098-080ebccdb297 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:24.683123 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aa43dd03-76d0-4df7-8098-080ebccdb297 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:24.684885 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aa43dd03-76d0-4df7-8098-080ebccdb297 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:24.934367 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-70eb18ad-0328-47cc-a14c-f0779c8fef8e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:24.962213 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-70eb18ad-0328-47cc-a14c-f0779c8fef8e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 0.892808 Sep 08 10:57:24.969333 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2117/4296] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:24 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:57:24.979792 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2745e2f5-a135-49ef-a88e-40276a5a16d3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:24.982545 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2745e2f5-a135-49ef-a88e-40276a5a16d3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:25.006110 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2745e2f5-a135-49ef-a88e-40276a5a16d3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:25.009865 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2745e2f5-a135-49ef-a88e-40276a5a16d3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:25.010758 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2745e2f5-a135-49ef-a88e-40276a5a16d3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:25.012308 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2745e2f5-a135-49ef-a88e-40276a5a16d3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:25.014701 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2745e2f5-a135-49ef-a88e-40276a5a16d3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:25.019852 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2745e2f5-a135-49ef-a88e-40276a5a16d3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:25.419062 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-aa43dd03-76d0-4df7-8098-080ebccdb297 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22145c653c804031ae233de6d84647fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1c70903c3d42d790d9ef96adc1fdbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:25.427670 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-aa43dd03-76d0-4df7-8098-080ebccdb297 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] 10.222.0.27 "GET /compute/v2.1/servers/2d995117-3718-4b9d-a4a1-c1185d34d701" status: 200 len: 1655 microversion: 2.1 time: 0.780472 Sep 08 10:57:25.432377 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2180/4297] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:24 2022] GET /compute/v2.1/servers/2d995117-3718-4b9d-a4a1-c1185d34d701 => generated 1655 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:25.456980 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-89bc26b9-71ed-4302-b014-51776b7e8096 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:57:25.468848 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2745e2f5-a135-49ef-a88e-40276a5a16d3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:25.479599 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2745e2f5-a135-49ef-a88e-40276a5a16d3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1681 microversion: 2.1 time: 0.513666 Sep 08 10:57:25.481573 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-89bc26b9-71ed-4302-b014-51776b7e8096 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] HTTP exception thrown: Instance 6e7a884a-eb72-489f-a235-41d010f54281 has no mapping to a cell. Sep 08 10:57:25.484058 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2118/4298] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:24 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1681 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:25.489052 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-7d8a7345-ad2e-419a-8bb0-7181fa9f6cb1 req-ad94f7b4-d731-4276-bbbc-505a433ba075 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d995117-3718-4b9d-a4a1-c1185d34d701", "name": "network-vif-deleted", "tag": "7ec9baef-5ccd-4968-99a9-d96da1b42bf3"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:57:25.491462 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-89bc26b9-71ed-4302-b014-51776b7e8096 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Request method failure captured: Sep 08 10:57:25.491462 n-d-850501-12 devstack@n-api.service[128861]: request: POST /compute/v2.1/servers/6e7a884a-eb72-489f-a235-41d010f54281/action HTTP/1.1 Sep 08 10:57:25.491462 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:57:25.491462 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:57:25.491462 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:57:25.491462 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 15 Sep 08 10:57:25.491462 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:57:25.491462 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:57:25.491462 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:57:25.491462 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:57:25.491462 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcmnspi0cCT_Ts_s7jcB6HjtEcdULbQPd_krJniB9lBsXpm1cXSOD-YMaJoaapHCxuCXz0q6Qe4WXufr5At6SSPw8ov8Oz1eUk-fSNbVp7WlOPycfCf5I6xwH7tfbsoefVfbTiDOfU9mTBl0Vs74qdfTniErHfQlEG4cAvAQl1-wMrs Sep 08 10:57:25.491462 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:57:25.491462 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:57:25.491462 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:57:25.491462 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:57:25.491462 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:57:25.491462 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:57:25.491462 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:57:25.491462 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:57:25.491462 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:57:25.491462 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:57:25.491462 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:57:25.491462 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:57:25.491462 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:57:25.491462 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:57:25.491462 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:57:25.491462 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:57:25.491462 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:57:25.491462 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 7f551e6fe34243c290a25b57ab26af19 Sep 08 10:57:25.491462 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:57:25.491462 n-d-850501-12 devstack@n-api.service[128861]: Sep 08 10:57:25.491462 n-d-850501-12 devstack@n-api.service[128861]: {"os-stop": {}} Sep 08 10:57:25.491462 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:57:25.491462 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 6e7a884a-eb72-489f-a235-41d010f54281 has no mapping to a cell. Sep 08 10:57:25.491462 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '6e7a884a-eb72-489f-a235-41d010f54281', 'body': {'os-stop': {}}} Sep 08 10:57:25.491462 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:57:25.491462 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:57:25.491462 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Sep 08 10:57:25.491462 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Sep 08 10:57:25.491462 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 10:57:25.491462 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 10:57:25.491462 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Sep 08 10:57:25.491462 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Sep 08 10:57:25.491462 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 08 10:57:25.491462 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 08 10:57:25.491462 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Sep 08 10:57:25.491462 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Sep 08 10:57:25.491462 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 6e7a884a-eb72-489f-a235-41d010f54281 has no mapping to a cell. Sep 08 10:57:25.491462 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:57:25.491462 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:57:25.491462 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:57:25.491462 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:57:25.491462 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:57:25.491462 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:57:25.491462 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:57:25.491462 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:57:25.491462 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:57:25.491462 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:57:25.491462 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Sep 08 10:57:25.491462 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Sep 08 10:57:25.491462 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Sep 08 10:57:25.491462 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:57:25.491462 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e7a884a-eb72-489f-a235-41d010f54281 has no mapping to a cell. Sep 08 10:57:25.497823 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:57:25.497823 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:57:25.497823 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:57:25.497823 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:57:25.497823 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:57:25.497823 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:57:25.497823 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:57:25.497823 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:57:25.497823 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e7a884a-eb72-489f-a235-41d010f54281 has no mapping to a cell. Sep 08 10:57:25.497823 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:57:25.500916 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-89bc26b9-71ed-4302-b014-51776b7e8096 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Returning 404 to user: Instance 6e7a884a-eb72-489f-a235-41d010f54281 has no mapping to a cell. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:57:25.502502 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-89bc26b9-71ed-4302-b014-51776b7e8096 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "POST /compute/v2.1/servers/6e7a884a-eb72-489f-a235-41d010f54281/action" status: 404 len: 117 microversion: 2.1 time: 0.056101 Sep 08 10:57:25.503630 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2181/4299] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:57:25 2022] POST /compute/v2.1/servers/6e7a884a-eb72-489f-a235-41d010f54281/action => generated 117 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:57:25.512007 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5f10acce-6a1c-42cd-9459-effb997f2ffc tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:25.514743 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5f10acce-6a1c-42cd-9459-effb997f2ffc tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:25.527121 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-7d8a7345-ad2e-419a-8bb0-7181fa9f6cb1 req-ad94f7b4-d731-4276-bbbc-505a433ba075 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:25.529641 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5f10acce-6a1c-42cd-9459-effb997f2ffc tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:25.531188 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-7d8a7345-ad2e-419a-8bb0-7181fa9f6cb1 req-ad94f7b4-d731-4276-bbbc-505a433ba075 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:25.531865 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-7d8a7345-ad2e-419a-8bb0-7181fa9f6cb1 req-ad94f7b4-d731-4276-bbbc-505a433ba075 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:25.535861 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5f10acce-6a1c-42cd-9459-effb997f2ffc tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:25.537143 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5f10acce-6a1c-42cd-9459-effb997f2ffc tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:25.542010 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5f10acce-6a1c-42cd-9459-effb997f2ffc tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:25.543559 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5f10acce-6a1c-42cd-9459-effb997f2ffc tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:25.544512 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5f10acce-6a1c-42cd-9459-effb997f2ffc tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:25.570271 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-7d8a7345-ad2e-419a-8bb0-7181fa9f6cb1 req-ad94f7b4-d731-4276-bbbc-505a433ba075 service nova] Creating event network-vif-deleted:7ec9baef-5ccd-4968-99a9-d96da1b42bf3 for instance 2d995117-3718-4b9d-a4a1-c1185d34d701 on n-h2-850501-12 Sep 08 10:57:25.584158 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-7d8a7345-ad2e-419a-8bb0-7181fa9f6cb1 req-ad94f7b4-d731-4276-bbbc-505a433ba075 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098101 Sep 08 10:57:25.588484 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2119/4300] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:57:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:57:25.598329 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-42861891-ff5b-401b-ab90-e8ce048c16a6 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:25.613745 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-42861891-ff5b-401b-ab90-e8ce048c16a6 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] [instance: 931569b4-139a-4939-abf3-49a589eb1d91] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:25.634802 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42861891-ff5b-401b-ab90-e8ce048c16a6 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:25.636486 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42861891-ff5b-401b-ab90-e8ce048c16a6 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:25.641682 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42861891-ff5b-401b-ab90-e8ce048c16a6 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:25.642629 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42861891-ff5b-401b-ab90-e8ce048c16a6 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:25.643278 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42861891-ff5b-401b-ab90-e8ce048c16a6 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:25.644193 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42861891-ff5b-401b-ab90-e8ce048c16a6 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:25.923444 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5f10acce-6a1c-42cd-9459-effb997f2ffc tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:25.942644 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5f10acce-6a1c-42cd-9459-effb997f2ffc tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 0.434673 Sep 08 10:57:25.943268 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2182/4301] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:25 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:57:25.970568 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3afad23d-f095-4ee2-a67d-6b0636fd48bf tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:25.971190 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3afad23d-f095-4ee2-a67d-6b0636fd48bf tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:25.985791 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3afad23d-f095-4ee2-a67d-6b0636fd48bf tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:25.986520 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3afad23d-f095-4ee2-a67d-6b0636fd48bf tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:25.987090 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3afad23d-f095-4ee2-a67d-6b0636fd48bf tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:25.988627 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3afad23d-f095-4ee2-a67d-6b0636fd48bf tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:25.989418 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3afad23d-f095-4ee2-a67d-6b0636fd48bf tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:25.989998 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3afad23d-f095-4ee2-a67d-6b0636fd48bf tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:26.502622 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-42861891-ff5b-401b-ab90-e8ce048c16a6 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a779e85e1c493985f7cfe8aceb9c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4478d0e315d948df9eda910f205646c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:26.522497 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:57:26.532170 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-42861891-ff5b-401b-ab90-e8ce048c16a6 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] 10.222.0.27 "GET /compute/v2.1/servers/931569b4-139a-4939-abf3-49a589eb1d91" status: 200 len: 1522 microversion: 2.1 time: 0.941552 Sep 08 10:57:26.536646 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2120/4302] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:25 2022] GET /compute/v2.1/servers/931569b4-139a-4939-abf3-49a589eb1d91 => generated 1522 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:26.548486 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d2639f11-b954-4fda-a5e7-fa305869175c tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:26.554019 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d2639f11-b954-4fda-a5e7-fa305869175c tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] [instance: 2d995117-3718-4b9d-a4a1-c1185d34d701] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:26.589242 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2639f11-b954-4fda-a5e7-fa305869175c tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:26.589880 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2639f11-b954-4fda-a5e7-fa305869175c tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:26.590560 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2639f11-b954-4fda-a5e7-fa305869175c tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:26.591679 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2639f11-b954-4fda-a5e7-fa305869175c tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:26.592373 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2639f11-b954-4fda-a5e7-fa305869175c tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:26.607290 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2639f11-b954-4fda-a5e7-fa305869175c tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:26.640227 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-3afad23d-f095-4ee2-a67d-6b0636fd48bf tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:26.698838 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3afad23d-f095-4ee2-a67d-6b0636fd48bf tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 0.728302 Sep 08 10:57:26.705297 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2183/4303] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:25 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:57:26.718867 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-90a4c496-07f1-4fda-b840-e5e436a910c6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:26.725069 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-90a4c496-07f1-4fda-b840-e5e436a910c6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:26.749916 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90a4c496-07f1-4fda-b840-e5e436a910c6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:26.751541 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90a4c496-07f1-4fda-b840-e5e436a910c6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:26.752893 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90a4c496-07f1-4fda-b840-e5e436a910c6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:26.755281 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90a4c496-07f1-4fda-b840-e5e436a910c6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:26.756245 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90a4c496-07f1-4fda-b840-e5e436a910c6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:26.757731 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90a4c496-07f1-4fda-b840-e5e436a910c6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:26.786676 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d2639f11-b954-4fda-a5e7-fa305869175c tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22145c653c804031ae233de6d84647fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1c70903c3d42d790d9ef96adc1fdbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:26.795635 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d2639f11-b954-4fda-a5e7-fa305869175c tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] 10.222.0.27 "GET /compute/v2.1/servers/2d995117-3718-4b9d-a4a1-c1185d34d701" status: 200 len: 1298 microversion: 2.1 time: 0.253758 Sep 08 10:57:26.802104 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2121/4304] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:26 2022] GET /compute/v2.1/servers/2d995117-3718-4b9d-a4a1-c1185d34d701 => generated 1298 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:26.813402 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7d44c579-479f-43b4-82f1-513d4b86c01a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:57:26.820634 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7d44c579-479f-43b4-82f1-513d4b86c01a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 33cd55d1-3972-452e-b5b0-d69c929caee5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:26.842230 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-7d44c579-479f-43b4-82f1-513d4b86c01a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] HTTP exception thrown: Instance 33cd55d1-3972-452e-b5b0-d69c929caee5 could not be found. Sep 08 10:57:26.847766 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7d44c579-479f-43b4-82f1-513d4b86c01a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Request method failure captured: Sep 08 10:57:26.847766 n-d-850501-12 devstack@n-api.service[128862]: request: POST /compute/v2.1/servers/33cd55d1-3972-452e-b5b0-d69c929caee5/action HTTP/1.1 Sep 08 10:57:26.847766 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:57:26.847766 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:57:26.847766 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:57:26.847766 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 15 Sep 08 10:57:26.847766 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:57:26.847766 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:57:26.847766 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:57:26.847766 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:57:26.847766 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcmnspi0cCT_Ts_s7jcB6HjtEcdULbQPd_krJniB9lBsXpm1cXSOD-YMaJoaapHCxuCXz0q6Qe4WXufr5At6SSPw8ov8Oz1eUk-fSNbVp7WlOPycfCf5I6xwH7tfbsoefVfbTiDOfU9mTBl0Vs74qdfTniErHfQlEG4cAvAQl1-wMrs Sep 08 10:57:26.847766 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:57:26.847766 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:57:26.847766 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:57:26.847766 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:57:26.847766 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:57:26.847766 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:57:26.847766 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:57:26.847766 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:57:26.847766 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:57:26.847766 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:57:26.847766 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:57:26.847766 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:57:26.847766 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:57:26.847766 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:57:26.847766 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:57:26.847766 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:57:26.847766 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:57:26.847766 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 7f551e6fe34243c290a25b57ab26af19 Sep 08 10:57:26.847766 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:57:26.847766 n-d-850501-12 devstack@n-api.service[128862]: Sep 08 10:57:26.847766 n-d-850501-12 devstack@n-api.service[128862]: {"suspend": {}} Sep 08 10:57:26.847766 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:57:26.847766 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 33cd55d1-3972-452e-b5b0-d69c929caee5 could not be found. Sep 08 10:57:26.847766 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '33cd55d1-3972-452e-b5b0-d69c929caee5', 'body': {'suspend': {}}} Sep 08 10:57:26.847766 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:57:26.847766 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:57:26.847766 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:57:26.847766 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:57:26.847766 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:57:26.847766 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:57:26.847766 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 08 10:57:26.847766 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 08 10:57:26.847766 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33cd55d1-3972-452e-b5b0-d69c929caee5 could not be found. Sep 08 10:57:26.847766 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:57:26.847766 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:57:26.847766 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:57:26.847766 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:57:26.847766 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:57:26.847766 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:57:26.847766 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:57:26.847766 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:57:26.847766 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:57:26.847766 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:57:26.847766 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Sep 08 10:57:26.847766 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Sep 08 10:57:26.847766 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:57:26.847766 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:57:26.847766 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33cd55d1-3972-452e-b5b0-d69c929caee5 could not be found. Sep 08 10:57:26.847766 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:57:26.847766 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:57:26.847766 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:57:26.847766 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:57:26.847766 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:57:26.847766 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:57:26.851850 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:57:26.851850 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:57:26.851850 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33cd55d1-3972-452e-b5b0-d69c929caee5 could not be found. Sep 08 10:57:26.851850 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:57:26.855362 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7d44c579-479f-43b4-82f1-513d4b86c01a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Returning 404 to user: Instance 33cd55d1-3972-452e-b5b0-d69c929caee5 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:57:26.858075 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7d44c579-479f-43b4-82f1-513d4b86c01a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "POST /compute/v2.1/servers/33cd55d1-3972-452e-b5b0-d69c929caee5/action" status: 404 len: 111 microversion: 2.1 time: 0.054739 Sep 08 10:57:26.862817 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2122/4305] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:57:26 2022] POST /compute/v2.1/servers/33cd55d1-3972-452e-b5b0-d69c929caee5/action => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:57:26.875727 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cbda6aaa-ce93-4867-8ed4-26a92da2947e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:26.876357 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cbda6aaa-ce93-4867-8ed4-26a92da2947e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:26.901389 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cbda6aaa-ce93-4867-8ed4-26a92da2947e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:26.902205 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cbda6aaa-ce93-4867-8ed4-26a92da2947e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:26.903889 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cbda6aaa-ce93-4867-8ed4-26a92da2947e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:26.905857 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cbda6aaa-ce93-4867-8ed4-26a92da2947e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:26.906497 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cbda6aaa-ce93-4867-8ed4-26a92da2947e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:26.907088 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cbda6aaa-ce93-4867-8ed4-26a92da2947e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:27.238272 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-90a4c496-07f1-4fda-b840-e5e436a910c6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:27.254720 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-90a4c496-07f1-4fda-b840-e5e436a910c6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1681 microversion: 2.1 time: 0.547406 Sep 08 10:57:27.256778 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2184/4306] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:26 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1681 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:27.325116 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cbda6aaa-ce93-4867-8ed4-26a92da2947e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:27.341656 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cbda6aaa-ce93-4867-8ed4-26a92da2947e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 0.475827 Sep 08 10:57:27.343037 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2123/4307] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:26 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:27.367652 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6e00a494-7a9b-447c-b7cb-5b3a37d34abe tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:27.369913 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6e00a494-7a9b-447c-b7cb-5b3a37d34abe tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:27.376395 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6e00a494-7a9b-447c-b7cb-5b3a37d34abe tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:27.377238 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6e00a494-7a9b-447c-b7cb-5b3a37d34abe tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:27.377389 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6e00a494-7a9b-447c-b7cb-5b3a37d34abe tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:27.378684 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6e00a494-7a9b-447c-b7cb-5b3a37d34abe tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:27.379725 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6e00a494-7a9b-447c-b7cb-5b3a37d34abe tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:27.380410 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6e00a494-7a9b-447c-b7cb-5b3a37d34abe tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:27.576839 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6661f34a-f681-4c87-a1b4-39174ca31e2e tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:27.577975 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6661f34a-f681-4c87-a1b4-39174ca31e2e tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] [instance: 931569b4-139a-4939-abf3-49a589eb1d91] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:27.588575 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6661f34a-f681-4c87-a1b4-39174ca31e2e tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:27.589221 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6661f34a-f681-4c87-a1b4-39174ca31e2e tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:27.592120 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6661f34a-f681-4c87-a1b4-39174ca31e2e tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:27.592884 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6661f34a-f681-4c87-a1b4-39174ca31e2e tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:27.595644 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6661f34a-f681-4c87-a1b4-39174ca31e2e tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:27.596826 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6661f34a-f681-4c87-a1b4-39174ca31e2e tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:27.788382 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6e00a494-7a9b-447c-b7cb-5b3a37d34abe tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:27.791886 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:57:27.799320 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6e00a494-7a9b-447c-b7cb-5b3a37d34abe tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 0.435782 Sep 08 10:57:27.801746 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2185/4308] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:27 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:27.818480 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-b65a7081-3a4e-4224-b441-c1e1a8bf3753 req-0996b7dd-846a-4736-9fcb-ca2f124a4a36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d995117-3718-4b9d-a4a1-c1185d34d701", "name": "network-vif-deleted", "tag": "e7a41aa4-591c-472d-b711-40d5b75d5929"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:57:27.846837 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-b65a7081-3a4e-4224-b441-c1e1a8bf3753 req-0996b7dd-846a-4736-9fcb-ca2f124a4a36 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:27.848273 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-b65a7081-3a4e-4224-b441-c1e1a8bf3753 req-0996b7dd-846a-4736-9fcb-ca2f124a4a36 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:27.849624 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-b65a7081-3a4e-4224-b441-c1e1a8bf3753 req-0996b7dd-846a-4736-9fcb-ca2f124a4a36 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:27.859049 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=4 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:57:27.882994 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-b65a7081-3a4e-4224-b441-c1e1a8bf3753 req-0996b7dd-846a-4736-9fcb-ca2f124a4a36 service nova] Creating event network-vif-deleted:e7a41aa4-591c-472d-b711-40d5b75d5929 for instance 2d995117-3718-4b9d-a4a1-c1185d34d701 on n-h2-850501-12 Sep 08 10:57:27.908563 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-b65a7081-3a4e-4224-b441-c1e1a8bf3753 req-0996b7dd-846a-4736-9fcb-ca2f124a4a36 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104537 Sep 08 10:57:27.909513 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2186/4309] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:57:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:57:27.927361 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bf93ad8b-0838-4488-aef6-c3580ed8256c tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:27.928457 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bf93ad8b-0838-4488-aef6-c3580ed8256c tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] [instance: 2d995117-3718-4b9d-a4a1-c1185d34d701] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:27.947228 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf93ad8b-0838-4488-aef6-c3580ed8256c tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:27.947949 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf93ad8b-0838-4488-aef6-c3580ed8256c tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:27.948403 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf93ad8b-0838-4488-aef6-c3580ed8256c tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:27.949150 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf93ad8b-0838-4488-aef6-c3580ed8256c tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:27.949625 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf93ad8b-0838-4488-aef6-c3580ed8256c tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:27.950057 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf93ad8b-0838-4488-aef6-c3580ed8256c tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:28.003186 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-bf93ad8b-0838-4488-aef6-c3580ed8256c tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] HTTP exception thrown: Instance 2d995117-3718-4b9d-a4a1-c1185d34d701 could not be found. Sep 08 10:57:28.009013 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bf93ad8b-0838-4488-aef6-c3580ed8256c tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Request method failure captured: Sep 08 10:57:28.009013 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/2d995117-3718-4b9d-a4a1-c1185d34d701 HTTP/1.1 Sep 08 10:57:28.009013 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:57:28.009013 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:57:28.009013 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:57:28.009013 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:57:28.009013 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:57:28.009013 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:57:28.009013 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:57:28.009013 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:57:28.009013 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcod6NyAY5khuYZmAuIgq4JBYBTI-D4jLVXxFgAEX8W5oVvP2tD1ZRtXgkupryqxfQ5TxEluQna7tvFbLU8Nqj1H4c3e-hI-CSApfK2lfysLLiu0tl4KfZ6Hp5ha-7InD_PXInG3o5sbUtFWmNzHNdMQ2u-nfdV_i_ROuHFcUNRzWKE Sep 08 10:57:28.009013 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:57:28.009013 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:57:28.009013 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:57:28.009013 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:57:28.009013 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:57:28.009013 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:57:28.009013 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 1f1c70903c3d42d790d9ef96adc1fdbd Sep 08 10:57:28.009013 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServersTestMultiNic-1772230459 Sep 08 10:57:28.009013 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:57:28.009013 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:57:28.009013 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1f1c70903c3d42d790d9ef96adc1fdbd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1f1c70903c3d42d790d9ef96adc1fdbd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1f1c70903c3d42d790d9ef96adc1fdbd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1f1c70903c3d42d790d9ef96adc1fdbd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:57:28.009013 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServersTestMultiNic-1772230459 Sep 08 10:57:28.009013 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 1f1c70903c3d42d790d9ef96adc1fdbd Sep 08 10:57:28.009013 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServersTestMultiNic-1772230459 Sep 08 10:57:28.009013 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServersTestMultiNic-1772230459-project Sep 08 10:57:28.009013 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:57:28.009013 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:57:28.009013 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 22145c653c804031ae233de6d84647fe Sep 08 10:57:28.009013 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServersTestMultiNic-1772230459-project Sep 08 10:57:28.009013 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:57:28.009013 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 2d995117-3718-4b9d-a4a1-c1185d34d701 could not be found. Sep 08 10:57:28.009013 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '2d995117-3718-4b9d-a4a1-c1185d34d701'} Sep 08 10:57:28.009013 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:57:28.009013 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:57:28.009013 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:57:28.009013 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:57:28.009013 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:57:28.009013 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:57:28.009013 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:57:28.009013 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:57:28.009013 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:57:28.009013 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:57:28.009013 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d995117-3718-4b9d-a4a1-c1185d34d701 could not be found. Sep 08 10:57:28.009013 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:57:28.009013 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:57:28.009013 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:57:28.009013 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:57:28.009013 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:57:28.009013 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:57:28.009013 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:57:28.009013 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:57:28.009013 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:57:28.009013 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:57:28.009013 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:57:28.009013 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:57:28.009013 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:57:28.009013 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:57:28.009013 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:57:28.009013 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:57:28.009013 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d995117-3718-4b9d-a4a1-c1185d34d701 could not be found. Sep 08 10:57:28.009013 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:57:28.009013 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:57:28.009013 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:57:28.013331 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:57:28.013331 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:57:28.013331 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:57:28.013331 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:57:28.013331 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:57:28.013331 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d995117-3718-4b9d-a4a1-c1185d34d701 could not be found. Sep 08 10:57:28.013331 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:57:28.013331 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bf93ad8b-0838-4488-aef6-c3580ed8256c tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Returning 404 to user: Instance 2d995117-3718-4b9d-a4a1-c1185d34d701 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:57:28.013331 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bf93ad8b-0838-4488-aef6-c3580ed8256c tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] 10.222.0.27 "GET /compute/v2.1/servers/2d995117-3718-4b9d-a4a1-c1185d34d701" status: 404 len: 111 microversion: 2.1 time: 0.099979 Sep 08 10:57:28.013331 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2187/4310] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:27 2022] GET /compute/v2.1/servers/2d995117-3718-4b9d-a4a1-c1185d34d701 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:57:28.015864 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-449c8d82-06e7-47ea-8959-a9b1764fdf1d tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:57:28.016409 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-449c8d82-06e7-47ea-8959-a9b1764fdf1d tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:28.039209 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-449c8d82-06e7-47ea-8959-a9b1764fdf1d tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:28.039915 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-449c8d82-06e7-47ea-8959-a9b1764fdf1d tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:28.041426 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-449c8d82-06e7-47ea-8959-a9b1764fdf1d tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:28.042360 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-449c8d82-06e7-47ea-8959-a9b1764fdf1d tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:28.044031 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-449c8d82-06e7-47ea-8959-a9b1764fdf1d tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:28.045699 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-449c8d82-06e7-47ea-8959-a9b1764fdf1d tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:28.097383 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-449c8d82-06e7-47ea-8959-a9b1764fdf1d tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lazy-loading 'flavor' on Instance uuid 74eebde7-4328-4ddf-be14-bb9fba70ec03 {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:57:28.271697 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-449c8d82-06e7-47ea-8959-a9b1764fdf1d tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "POST /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03/action" status: 202 len: 0 microversion: 2.1 time: 0.254671 Sep 08 10:57:28.278516 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2188/4311] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:57:28 2022] POST /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:57:28.336037 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0377d5fb-e828-4df9-a111-b7a894f272e6 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:28.341843 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0377d5fb-e828-4df9-a111-b7a894f272e6 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:28.353855 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0377d5fb-e828-4df9-a111-b7a894f272e6 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:28.354996 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0377d5fb-e828-4df9-a111-b7a894f272e6 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:28.356138 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0377d5fb-e828-4df9-a111-b7a894f272e6 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:28.357329 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0377d5fb-e828-4df9-a111-b7a894f272e6 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:28.360131 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0377d5fb-e828-4df9-a111-b7a894f272e6 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:28.362132 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0377d5fb-e828-4df9-a111-b7a894f272e6 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:28.402002 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=16 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:57:28.678852 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6661f34a-f681-4c87-a1b4-39174ca31e2e tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a779e85e1c493985f7cfe8aceb9c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4478d0e315d948df9eda910f205646c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:28.701524 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6661f34a-f681-4c87-a1b4-39174ca31e2e tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] 10.222.0.27 "GET /compute/v2.1/servers/931569b4-139a-4939-abf3-49a589eb1d91" status: 200 len: 1522 microversion: 2.1 time: 1.130528 Sep 08 10:57:28.703387 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2124/4312] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:27 2022] GET /compute/v2.1/servers/931569b4-139a-4939-abf3-49a589eb1d91 => generated 1522 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:28.716211 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0bed9f88-db2d-4616-848e-6022eb9ee972 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:28.718498 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0bed9f88-db2d-4616-848e-6022eb9ee972 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:28.747407 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0bed9f88-db2d-4616-848e-6022eb9ee972 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:28.751838 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0bed9f88-db2d-4616-848e-6022eb9ee972 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:28.752885 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0bed9f88-db2d-4616-848e-6022eb9ee972 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:28.753296 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0bed9f88-db2d-4616-848e-6022eb9ee972 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:28.753855 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0bed9f88-db2d-4616-848e-6022eb9ee972 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:28.757179 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0bed9f88-db2d-4616-848e-6022eb9ee972 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:28.880409 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0377d5fb-e828-4df9-a111-b7a894f272e6 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:28.934227 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0377d5fb-e828-4df9-a111-b7a894f272e6 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1512 microversion: 2.1 time: 0.649145 Sep 08 10:57:28.936823 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2189/4313] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:28 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1512 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:29.031470 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0bed9f88-db2d-4616-848e-6022eb9ee972 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:29.055692 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0bed9f88-db2d-4616-848e-6022eb9ee972 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1681 microversion: 2.1 time: 0.348176 Sep 08 10:57:29.060532 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2125/4314] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:28 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1681 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:29.741322 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9009a3ce-a68f-426b-af65-3355cf05ba2f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:29.742159 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9009a3ce-a68f-426b-af65-3355cf05ba2f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] [instance: 931569b4-139a-4939-abf3-49a589eb1d91] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:29.759566 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9009a3ce-a68f-426b-af65-3355cf05ba2f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:29.761736 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9009a3ce-a68f-426b-af65-3355cf05ba2f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:29.763162 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9009a3ce-a68f-426b-af65-3355cf05ba2f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:29.766929 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9009a3ce-a68f-426b-af65-3355cf05ba2f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:29.768246 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9009a3ce-a68f-426b-af65-3355cf05ba2f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:29.769122 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9009a3ce-a68f-426b-af65-3355cf05ba2f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:29.963758 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8741c5b4-fd10-4079-bc4a-9ac71f64825c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:29.964388 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8741c5b4-fd10-4079-bc4a-9ac71f64825c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:29.984083 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8741c5b4-fd10-4079-bc4a-9ac71f64825c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:29.990647 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8741c5b4-fd10-4079-bc4a-9ac71f64825c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:29.992021 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8741c5b4-fd10-4079-bc4a-9ac71f64825c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:29.993823 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8741c5b4-fd10-4079-bc4a-9ac71f64825c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:29.995253 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8741c5b4-fd10-4079-bc4a-9ac71f64825c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:29.997883 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8741c5b4-fd10-4079-bc4a-9ac71f64825c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:30.154697 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9009a3ce-a68f-426b-af65-3355cf05ba2f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a779e85e1c493985f7cfe8aceb9c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4478d0e315d948df9eda910f205646c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:30.184986 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9009a3ce-a68f-426b-af65-3355cf05ba2f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] 10.222.0.27 "GET /compute/v2.1/servers/931569b4-139a-4939-abf3-49a589eb1d91" status: 200 len: 1499 microversion: 2.1 time: 0.451379 Sep 08 10:57:30.187287 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2190/4315] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:29 2022] GET /compute/v2.1/servers/931569b4-139a-4939-abf3-49a589eb1d91 => generated 1499 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:30.197478 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-03dbd26a-0968-4484-9965-4643dece1fef tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:30.198012 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-03dbd26a-0968-4484-9965-4643dece1fef tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:30.213419 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-03dbd26a-0968-4484-9965-4643dece1fef tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:30.216143 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-03dbd26a-0968-4484-9965-4643dece1fef tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:30.216598 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-03dbd26a-0968-4484-9965-4643dece1fef tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:30.217379 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-03dbd26a-0968-4484-9965-4643dece1fef tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:30.217842 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-03dbd26a-0968-4484-9965-4643dece1fef tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:30.218274 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-03dbd26a-0968-4484-9965-4643dece1fef tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:30.511882 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-03dbd26a-0968-4484-9965-4643dece1fef tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:30.526450 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-03dbd26a-0968-4484-9965-4643dece1fef tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1681 microversion: 2.1 time: 0.332903 Sep 08 10:57:30.527475 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2191/4316] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:30 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1681 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:30.532279 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fb4ddb40-7588-447f-836b-f9acfde08576 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:30.538161 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-fb4ddb40-7588-447f-836b-f9acfde08576 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '06a779e85e1c493985f7cfe8aceb9c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4478d0e315d948df9eda910f205646c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:30.538989 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fb4ddb40-7588-447f-836b-f9acfde08576 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '4478d0e315d948df9eda910f205646c3'} {{(pid=128861) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:57:30.543987 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=100 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:57:30.545930 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb4ddb40-7588-447f-836b-f9acfde08576 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:30.546627 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb4ddb40-7588-447f-836b-f9acfde08576 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:30.547334 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb4ddb40-7588-447f-836b-f9acfde08576 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:30.548541 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb4ddb40-7588-447f-836b-f9acfde08576 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:30.549255 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb4ddb40-7588-447f-836b-f9acfde08576 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:30.549905 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb4ddb40-7588-447f-836b-f9acfde08576 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:30.590805 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.multi_cell_list [None req-fb4ddb40-7588-447f-836b-f9acfde08576 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128861) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 10:57:30.630045 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fb4ddb40-7588-447f-836b-f9acfde08576 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] 10.222.0.27 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.101313 Sep 08 10:57:30.631191 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2192/4317] 10.222.0.27 () {58 vars in 1154 bytes} [Thu Sep 8 10:57:30 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:57:30.642645 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9c915dc2-dfb3-40e5-8959-438fbcfa6eee tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:57:30.669409 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9c915dc2-dfb3-40e5-8959-438fbcfa6eee tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:30.670229 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9c915dc2-dfb3-40e5-8959-438fbcfa6eee tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:30.670867 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9c915dc2-dfb3-40e5-8959-438fbcfa6eee tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:30.696244 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9c915dc2-dfb3-40e5-8959-438fbcfa6eee tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] [instance: 931569b4-139a-4939-abf3-49a589eb1d91] Going to try to start instance {{(pid=128861) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 08 10:57:30.804864 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9c915dc2-dfb3-40e5-8959-438fbcfa6eee tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] 10.222.0.27 "POST /compute/v2.1/servers/931569b4-139a-4939-abf3-49a589eb1d91/action" status: 202 len: 0 microversion: 2.1 time: 0.165891 Sep 08 10:57:30.805847 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2193/4318] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:57:30 2022] POST /compute/v2.1/servers/931569b4-139a-4939-abf3-49a589eb1d91/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:57:30.842653 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-daec7263-fcc3-4048-a9db-c8b1e03a8f4e tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:30.844612 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-daec7263-fcc3-4048-a9db-c8b1e03a8f4e tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] [instance: 931569b4-139a-4939-abf3-49a589eb1d91] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:30.860591 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-daec7263-fcc3-4048-a9db-c8b1e03a8f4e tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:30.861102 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-daec7263-fcc3-4048-a9db-c8b1e03a8f4e tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:30.863974 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-daec7263-fcc3-4048-a9db-c8b1e03a8f4e tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:30.864750 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-daec7263-fcc3-4048-a9db-c8b1e03a8f4e tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:30.865246 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-daec7263-fcc3-4048-a9db-c8b1e03a8f4e tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:30.865676 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-daec7263-fcc3-4048-a9db-c8b1e03a8f4e tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:31.121987 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8741c5b4-fd10-4079-bc4a-9ac71f64825c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:31.135702 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8741c5b4-fd10-4079-bc4a-9ac71f64825c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1495 microversion: 2.1 time: 1.177599 Sep 08 10:57:31.142119 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2126/4319] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:29 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1495 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:31.164697 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b689fd26-fa98-447f-8311-1db66865bfad tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:57:31.165890 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b689fd26-fa98-447f-8311-1db66865bfad tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:31.186877 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b689fd26-fa98-447f-8311-1db66865bfad tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:31.187833 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b689fd26-fa98-447f-8311-1db66865bfad tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:31.188602 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b689fd26-fa98-447f-8311-1db66865bfad tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:31.197607 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b689fd26-fa98-447f-8311-1db66865bfad tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:31.198890 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b689fd26-fa98-447f-8311-1db66865bfad tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:31.199634 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b689fd26-fa98-447f-8311-1db66865bfad tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:31.265927 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-b689fd26-fa98-447f-8311-1db66865bfad tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lazy-loading 'flavor' on Instance uuid 74eebde7-4328-4ddf-be14-bb9fba70ec03 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:57:31.292911 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-b689fd26-fa98-447f-8311-1db66865bfad tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] HTTP exception thrown: Cannot 'suspend' instance 74eebde7-4328-4ddf-be14-bb9fba70ec03 while it is in vm_state suspended Sep 08 10:57:31.297658 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b689fd26-fa98-447f-8311-1db66865bfad tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Request method failure captured: Sep 08 10:57:31.297658 n-d-850501-12 devstack@n-api.service[128862]: request: POST /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03/action HTTP/1.1 Sep 08 10:57:31.297658 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:57:31.297658 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:57:31.297658 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:57:31.297658 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 15 Sep 08 10:57:31.297658 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:57:31.297658 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:57:31.297658 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:57:31.297658 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:57:31.297658 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcmnspi0cCT_Ts_s7jcB6HjtEcdULbQPd_krJniB9lBsXpm1cXSOD-YMaJoaapHCxuCXz0q6Qe4WXufr5At6SSPw8ov8Oz1eUk-fSNbVp7WlOPycfCf5I6xwH7tfbsoefVfbTiDOfU9mTBl0Vs74qdfTniErHfQlEG4cAvAQl1-wMrs Sep 08 10:57:31.297658 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:57:31.297658 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:57:31.297658 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:57:31.297658 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:57:31.297658 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:57:31.297658 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:57:31.297658 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:57:31.297658 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:57:31.297658 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:57:31.297658 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:57:31.297658 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:57:31.297658 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:57:31.297658 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:57:31.297658 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:57:31.297658 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:57:31.297658 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:57:31.297658 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:57:31.297658 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 7f551e6fe34243c290a25b57ab26af19 Sep 08 10:57:31.297658 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:57:31.297658 n-d-850501-12 devstack@n-api.service[128862]: Sep 08 10:57:31.297658 n-d-850501-12 devstack@n-api.service[128862]: {"suspend": {}} Sep 08 10:57:31.297658 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:57:31.297658 n-d-850501-12 devstack@n-api.service[128862]: exception: Cannot 'suspend' instance 74eebde7-4328-4ddf-be14-bb9fba70ec03 while it is in vm_state suspended Sep 08 10:57:31.297658 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '74eebde7-4328-4ddf-be14-bb9fba70ec03', 'body': {'suspend': {}}} Sep 08 10:57:31.297658 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:57:31.297658 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:57:31.297658 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Sep 08 10:57:31.297658 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Sep 08 10:57:31.297658 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 08 10:57:31.297658 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 08 10:57:31.297658 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 08 10:57:31.297658 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 08 10:57:31.297658 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 08 10:57:31.297658 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 08 10:57:31.297658 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Sep 08 10:57:31.297658 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 08 10:57:31.297658 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 10:57:31.297658 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 10:57:31.297658 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 08 10:57:31.297658 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 08 10:57:31.297658 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 74eebde7-4328-4ddf-be14-bb9fba70ec03 in vm_state suspended. Cannot suspend while the instance is in this state. Sep 08 10:57:31.297658 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:57:31.297658 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:57:31.297658 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:57:31.297658 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:57:31.297658 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:57:31.297658 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:57:31.297658 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:57:31.297658 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:57:31.297658 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:57:31.297658 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:57:31.297658 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Sep 08 10:57:31.297658 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 08 10:57:31.301405 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 08 10:57:31.301405 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 08 10:57:31.301405 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 74eebde7-4328-4ddf-be14-bb9fba70ec03 while it is in vm_state suspended Sep 08 10:57:31.301405 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:57:31.301405 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:57:31.301405 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:57:31.301405 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:57:31.301405 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:57:31.301405 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:57:31.301405 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:57:31.301405 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:57:31.301405 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 74eebde7-4328-4ddf-be14-bb9fba70ec03 while it is in vm_state suspended Sep 08 10:57:31.301405 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:57:31.303246 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b689fd26-fa98-447f-8311-1db66865bfad tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Returning 409 to user: Cannot 'suspend' instance 74eebde7-4328-4ddf-be14-bb9fba70ec03 while it is in vm_state suspended {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:57:31.304463 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b689fd26-fa98-447f-8311-1db66865bfad tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "POST /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03/action" status: 409 len: 148 microversion: 2.1 time: 0.144496 Sep 08 10:57:31.305476 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2127/4320] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:57:31 2022] POST /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03/action => generated 148 bytes in 146 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:57:31.315628 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b3e85666-a0d5-4a7f-a89e-f0f193d497bd tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:57:31.316599 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b3e85666-a0d5-4a7f-a89e-f0f193d497bd tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:31.323874 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3e85666-a0d5-4a7f-a89e-f0f193d497bd tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:31.326679 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3e85666-a0d5-4a7f-a89e-f0f193d497bd tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:31.327714 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3e85666-a0d5-4a7f-a89e-f0f193d497bd tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:31.330366 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3e85666-a0d5-4a7f-a89e-f0f193d497bd tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:31.331972 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3e85666-a0d5-4a7f-a89e-f0f193d497bd tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:31.332659 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3e85666-a0d5-4a7f-a89e-f0f193d497bd tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:31.406628 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-daec7263-fcc3-4048-a9db-c8b1e03a8f4e tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a779e85e1c493985f7cfe8aceb9c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4478d0e315d948df9eda910f205646c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:31.419137 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-daec7263-fcc3-4048-a9db-c8b1e03a8f4e tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] 10.222.0.27 "GET /compute/v2.1/servers/931569b4-139a-4939-abf3-49a589eb1d91" status: 200 len: 1508 microversion: 2.1 time: 0.608307 Sep 08 10:57:31.420799 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b3e85666-a0d5-4a7f-a89e-f0f193d497bd tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "POST /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03/action" status: 202 len: 0 microversion: 2.1 time: 0.109942 Sep 08 10:57:31.422721 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2128/4321] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:57:31 2022] POST /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 10:57:31.433459 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2194/4322] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:30 2022] GET /compute/v2.1/servers/931569b4-139a-4939-abf3-49a589eb1d91 => generated 1508 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:31.436926 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-64c2a229-ecc3-4e90-96c6-5824ebf8c61c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:31.442501 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-64c2a229-ecc3-4e90-96c6-5824ebf8c61c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:31.459482 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64c2a229-ecc3-4e90-96c6-5824ebf8c61c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:31.460683 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64c2a229-ecc3-4e90-96c6-5824ebf8c61c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:31.462757 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64c2a229-ecc3-4e90-96c6-5824ebf8c61c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:31.464868 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64c2a229-ecc3-4e90-96c6-5824ebf8c61c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:31.465577 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64c2a229-ecc3-4e90-96c6-5824ebf8c61c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:31.466030 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64c2a229-ecc3-4e90-96c6-5824ebf8c61c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:31.553488 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4463aa4d-74d2-40df-9943-e73d12f2ff20 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:31.554137 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4463aa4d-74d2-40df-9943-e73d12f2ff20 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:31.566169 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4463aa4d-74d2-40df-9943-e73d12f2ff20 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:31.566689 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4463aa4d-74d2-40df-9943-e73d12f2ff20 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:31.573635 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4463aa4d-74d2-40df-9943-e73d12f2ff20 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:31.573635 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4463aa4d-74d2-40df-9943-e73d12f2ff20 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:31.573635 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4463aa4d-74d2-40df-9943-e73d12f2ff20 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:31.577939 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4463aa4d-74d2-40df-9943-e73d12f2ff20 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:32.184895 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4463aa4d-74d2-40df-9943-e73d12f2ff20 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:32.199449 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4463aa4d-74d2-40df-9943-e73d12f2ff20 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1681 microversion: 2.1 time: 0.651517 Sep 08 10:57:32.200049 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2195/4323] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:31 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1681 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:32.405155 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-64c2a229-ecc3-4e90-96c6-5824ebf8c61c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:32.417603 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-64c2a229-ecc3-4e90-96c6-5824ebf8c61c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1501 microversion: 2.1 time: 0.987899 Sep 08 10:57:32.418197 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2129/4324] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:31 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1501 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:32.444345 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fc335246-57f9-40d8-bc34-3dd587b4b0f3 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:32.445581 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fc335246-57f9-40d8-bc34-3dd587b4b0f3 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] [instance: 931569b4-139a-4939-abf3-49a589eb1d91] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:32.452514 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fc335246-57f9-40d8-bc34-3dd587b4b0f3 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:32.453369 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fc335246-57f9-40d8-bc34-3dd587b4b0f3 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:32.453955 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fc335246-57f9-40d8-bc34-3dd587b4b0f3 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:32.454817 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fc335246-57f9-40d8-bc34-3dd587b4b0f3 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:32.455418 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fc335246-57f9-40d8-bc34-3dd587b4b0f3 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:32.456058 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fc335246-57f9-40d8-bc34-3dd587b4b0f3 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:33.228427 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-345e96ab-db57-4dcd-9cf8-4f5ff47b0a82 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:33.229266 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-345e96ab-db57-4dcd-9cf8-4f5ff47b0a82 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:33.253698 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-345e96ab-db57-4dcd-9cf8-4f5ff47b0a82 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:33.255198 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-345e96ab-db57-4dcd-9cf8-4f5ff47b0a82 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:33.259407 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-345e96ab-db57-4dcd-9cf8-4f5ff47b0a82 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:33.264279 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-345e96ab-db57-4dcd-9cf8-4f5ff47b0a82 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:33.265307 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-fc335246-57f9-40d8-bc34-3dd587b4b0f3 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a779e85e1c493985f7cfe8aceb9c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4478d0e315d948df9eda910f205646c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:33.267728 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-345e96ab-db57-4dcd-9cf8-4f5ff47b0a82 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:33.268990 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-345e96ab-db57-4dcd-9cf8-4f5ff47b0a82 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:33.275482 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fc335246-57f9-40d8-bc34-3dd587b4b0f3 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] 10.222.0.27 "GET /compute/v2.1/servers/931569b4-139a-4939-abf3-49a589eb1d91" status: 200 len: 1508 microversion: 2.1 time: 0.835025 Sep 08 10:57:33.293429 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2196/4325] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:32 2022] GET /compute/v2.1/servers/931569b4-139a-4939-abf3-49a589eb1d91 => generated 1508 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:33.442990 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e05d6d27-abd2-4623-8f79-6b12ec16c9b2 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:33.443636 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e05d6d27-abd2-4623-8f79-6b12ec16c9b2 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:33.454884 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e05d6d27-abd2-4623-8f79-6b12ec16c9b2 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:33.455888 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e05d6d27-abd2-4623-8f79-6b12ec16c9b2 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:33.456257 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e05d6d27-abd2-4623-8f79-6b12ec16c9b2 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:33.461612 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e05d6d27-abd2-4623-8f79-6b12ec16c9b2 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:33.465354 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e05d6d27-abd2-4623-8f79-6b12ec16c9b2 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:33.466275 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e05d6d27-abd2-4623-8f79-6b12ec16c9b2 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:34.098041 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e05d6d27-abd2-4623-8f79-6b12ec16c9b2 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:34.114663 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e05d6d27-abd2-4623-8f79-6b12ec16c9b2 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1501 microversion: 2.1 time: 0.676929 Sep 08 10:57:34.115835 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2197/4326] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:33 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1501 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:34.324504 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4ec0690e-5f53-4bee-8023-f6833c1e1eba tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:34.331423 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4ec0690e-5f53-4bee-8023-f6833c1e1eba tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] [instance: 931569b4-139a-4939-abf3-49a589eb1d91] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:34.352813 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ec0690e-5f53-4bee-8023-f6833c1e1eba tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:34.353751 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ec0690e-5f53-4bee-8023-f6833c1e1eba tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:34.370330 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ec0690e-5f53-4bee-8023-f6833c1e1eba tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:34.382327 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ec0690e-5f53-4bee-8023-f6833c1e1eba tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:34.385295 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ec0690e-5f53-4bee-8023-f6833c1e1eba tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:34.385965 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ec0690e-5f53-4bee-8023-f6833c1e1eba tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:34.395646 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-345e96ab-db57-4dcd-9cf8-4f5ff47b0a82 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:34.411257 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-345e96ab-db57-4dcd-9cf8-4f5ff47b0a82 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1681 microversion: 2.1 time: 1.187491 Sep 08 10:57:34.413965 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2130/4327] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:33 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1681 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:57:34.937814 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2c616136-904d-4858-9b21-e67a56bc8bcc tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:34.938528 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2c616136-904d-4858-9b21-e67a56bc8bcc tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: a882cf75-539a-45fa-ae2b-4e0f043b340d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:34.941977 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4ec0690e-5f53-4bee-8023-f6833c1e1eba tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a779e85e1c493985f7cfe8aceb9c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4478d0e315d948df9eda910f205646c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:34.954445 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2c616136-904d-4858-9b21-e67a56bc8bcc tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:34.955373 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2c616136-904d-4858-9b21-e67a56bc8bcc tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:34.956636 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2c616136-904d-4858-9b21-e67a56bc8bcc tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:34.957426 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2c616136-904d-4858-9b21-e67a56bc8bcc tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:34.957896 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2c616136-904d-4858-9b21-e67a56bc8bcc tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:34.958333 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2c616136-904d-4858-9b21-e67a56bc8bcc tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:34.980491 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4ec0690e-5f53-4bee-8023-f6833c1e1eba tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] 10.222.0.27 "GET /compute/v2.1/servers/931569b4-139a-4939-abf3-49a589eb1d91" status: 200 len: 1512 microversion: 2.1 time: 0.672165 Sep 08 10:57:34.981513 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2198/4328] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:34 2022] GET /compute/v2.1/servers/931569b4-139a-4939-abf3-49a589eb1d91 => generated 1512 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:35.025282 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bf9c2b17-d524-4378-b0f8-1d5e9e6a5f6f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:35.035158 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-bf9c2b17-d524-4378-b0f8-1d5e9e6a5f6f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '06a779e85e1c493985f7cfe8aceb9c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4478d0e315d948df9eda910f205646c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:35.035400 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2c616136-904d-4858-9b21-e67a56bc8bcc tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: a882cf75-539a-45fa-ae2b-4e0f043b340d] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:57:35.035943 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.compute.servers [None req-bf9c2b17-d524-4378-b0f8-1d5e9e6a5f6f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Removing options 'limit' from query {{(pid=128861) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 08 10:57:35.065554 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bf9c2b17-d524-4378-b0f8-1d5e9e6a5f6f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Searching by: {'deleted': False, 'project_id': '4478d0e315d948df9eda910f205646c3'} {{(pid=128861) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:57:35.067964 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf9c2b17-d524-4378-b0f8-1d5e9e6a5f6f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:35.068819 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf9c2b17-d524-4378-b0f8-1d5e9e6a5f6f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:35.069617 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf9c2b17-d524-4378-b0f8-1d5e9e6a5f6f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:35.070918 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf9c2b17-d524-4378-b0f8-1d5e9e6a5f6f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:35.071777 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf9c2b17-d524-4378-b0f8-1d5e9e6a5f6f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:35.072789 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf9c2b17-d524-4378-b0f8-1d5e9e6a5f6f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:35.075469 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bf9c2b17-d524-4378-b0f8-1d5e9e6a5f6f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] 10.222.0.27 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.065624 Sep 08 10:57:35.088708 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2199/4329] 10.222.0.27 () {58 vars in 1140 bytes} [Thu Sep 8 10:57:35 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:57:35.119561 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-65ca2cb8-e576-4dcb-8828-2c1d01bcbf35 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:35.120174 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-65ca2cb8-e576-4dcb-8828-2c1d01bcbf35 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] [instance: 931569b4-139a-4939-abf3-49a589eb1d91] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:35.132622 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-65ca2cb8-e576-4dcb-8828-2c1d01bcbf35 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:35.133091 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-65ca2cb8-e576-4dcb-8828-2c1d01bcbf35 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:35.133524 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-65ca2cb8-e576-4dcb-8828-2c1d01bcbf35 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:35.134843 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-65ca2cb8-e576-4dcb-8828-2c1d01bcbf35 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:35.135412 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-65ca2cb8-e576-4dcb-8828-2c1d01bcbf35 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:35.135733 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-65ca2cb8-e576-4dcb-8828-2c1d01bcbf35 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:35.297322 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2c616136-904d-4858-9b21-e67a56bc8bcc tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d" status: 204 len: 0 microversion: 2.1 time: 0.364327 Sep 08 10:57:35.300543 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2131/4330] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:57:34 2022] DELETE /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:57:35.309496 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8f858b84-cf8f-4ba2-969e-d4e9f87a940d tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:35.310864 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8f858b84-cf8f-4ba2-969e-d4e9f87a940d tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:35.323226 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f858b84-cf8f-4ba2-969e-d4e9f87a940d tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:35.323741 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f858b84-cf8f-4ba2-969e-d4e9f87a940d tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:35.324192 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f858b84-cf8f-4ba2-969e-d4e9f87a940d tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:35.324925 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f858b84-cf8f-4ba2-969e-d4e9f87a940d tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:35.325423 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f858b84-cf8f-4ba2-969e-d4e9f87a940d tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:35.327035 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f858b84-cf8f-4ba2-969e-d4e9f87a940d tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:35.617958 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-65ca2cb8-e576-4dcb-8828-2c1d01bcbf35 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a779e85e1c493985f7cfe8aceb9c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4478d0e315d948df9eda910f205646c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:35.633280 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-65ca2cb8-e576-4dcb-8828-2c1d01bcbf35 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] 10.222.0.27 "GET /compute/v2.1/servers/931569b4-139a-4939-abf3-49a589eb1d91" status: 200 len: 1512 microversion: 2.1 time: 0.542849 Sep 08 10:57:35.649077 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2200/4331] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:35 2022] GET /compute/v2.1/servers/931569b4-139a-4939-abf3-49a589eb1d91 => generated 1512 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:35.649077 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-71b6a52a-2e66-434c-b303-1983210ccf45 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:35.649077 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-71b6a52a-2e66-434c-b303-1983210ccf45 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: a882cf75-539a-45fa-ae2b-4e0f043b340d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:35.661967 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-71b6a52a-2e66-434c-b303-1983210ccf45 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:35.664426 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-71b6a52a-2e66-434c-b303-1983210ccf45 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:35.666189 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-71b6a52a-2e66-434c-b303-1983210ccf45 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:35.670490 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-71b6a52a-2e66-434c-b303-1983210ccf45 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:35.671920 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-71b6a52a-2e66-434c-b303-1983210ccf45 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:35.672610 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-71b6a52a-2e66-434c-b303-1983210ccf45 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:36.245094 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8f858b84-cf8f-4ba2-969e-d4e9f87a940d tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:36.268992 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8f858b84-cf8f-4ba2-969e-d4e9f87a940d tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 0.965738 Sep 08 10:57:36.277363 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2132/4332] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:35 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:36.287824 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-930d5039-2bc7-4b44-bc14-45252bc82a5f tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:36.291226 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-930d5039-2bc7-4b44-bc14-45252bc82a5f tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:36.319866 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-930d5039-2bc7-4b44-bc14-45252bc82a5f tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:36.323447 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-930d5039-2bc7-4b44-bc14-45252bc82a5f tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:36.326054 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-930d5039-2bc7-4b44-bc14-45252bc82a5f tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:36.328169 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-930d5039-2bc7-4b44-bc14-45252bc82a5f tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:36.333712 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-930d5039-2bc7-4b44-bc14-45252bc82a5f tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:36.334491 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-930d5039-2bc7-4b44-bc14-45252bc82a5f tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:36.346033 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-71b6a52a-2e66-434c-b303-1983210ccf45 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:36.355882 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:57:36.362485 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-71b6a52a-2e66-434c-b303-1983210ccf45 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d" status: 200 len: 1508 microversion: 2.1 time: 0.725635 Sep 08 10:57:36.365108 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2201/4333] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:35 2022] GET /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d => generated 1508 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:36.372745 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7dba4d4f-ffd2-4f69-96f9-decb439f746f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:36.373693 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7dba4d4f-ffd2-4f69-96f9-decb439f746f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] [instance: 13039f8f-105b-4bb5-b632-753e183d2f1a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:36.384505 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7dba4d4f-ffd2-4f69-96f9-decb439f746f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:36.395374 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7dba4d4f-ffd2-4f69-96f9-decb439f746f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:36.396621 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7dba4d4f-ffd2-4f69-96f9-decb439f746f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:36.399457 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7dba4d4f-ffd2-4f69-96f9-decb439f746f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:36.400196 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7dba4d4f-ffd2-4f69-96f9-decb439f746f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:36.400827 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7dba4d4f-ffd2-4f69-96f9-decb439f746f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:36.972936 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-930d5039-2bc7-4b44-bc14-45252bc82a5f tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:36.992682 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-930d5039-2bc7-4b44-bc14-45252bc82a5f tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1658 microversion: 2.1 time: 0.713835 Sep 08 10:57:36.993388 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2133/4334] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:36 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1658 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:37.012203 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7e509239-d5e3-4551-8c1b-c6163dab9dbd tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:37.012836 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7e509239-d5e3-4551-8c1b-c6163dab9dbd tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:37.035966 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e509239-d5e3-4551-8c1b-c6163dab9dbd tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:37.036397 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e509239-d5e3-4551-8c1b-c6163dab9dbd tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:37.043200 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e509239-d5e3-4551-8c1b-c6163dab9dbd tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:37.045537 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e509239-d5e3-4551-8c1b-c6163dab9dbd tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:37.047420 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e509239-d5e3-4551-8c1b-c6163dab9dbd tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:37.047868 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e509239-d5e3-4551-8c1b-c6163dab9dbd tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:37.323050 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7dba4d4f-ffd2-4f69-96f9-decb439f746f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a779e85e1c493985f7cfe8aceb9c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4478d0e315d948df9eda910f205646c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:37.359943 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7dba4d4f-ffd2-4f69-96f9-decb439f746f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] 10.222.0.27 "GET /compute/v2.1/servers/13039f8f-105b-4bb5-b632-753e183d2f1a" status: 200 len: 1511 microversion: 2.1 time: 0.992840 Sep 08 10:57:37.373180 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2202/4335] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:36 2022] GET /compute/v2.1/servers/13039f8f-105b-4bb5-b632-753e183d2f1a => generated 1511 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:37.382926 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2d2dd242-45f7-4fa1-9947-d5d2d15dd637 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:57:37.392753 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2d2dd242-45f7-4fa1-9947-d5d2d15dd637 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:37.393351 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2d2dd242-45f7-4fa1-9947-d5d2d15dd637 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:37.393935 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2d2dd242-45f7-4fa1-9947-d5d2d15dd637 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:37.443448 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2d2dd242-45f7-4fa1-9947-d5d2d15dd637 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Going to try to start instance {{(pid=128861) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 08 10:57:37.518085 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2d2dd242-45f7-4fa1-9947-d5d2d15dd637 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "POST /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7/action" status: 202 len: 0 microversion: 2.1 time: 0.155699 Sep 08 10:57:37.518695 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2203/4336] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:57:37 2022] POST /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:57:37.530425 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-214b8ba8-135e-4f49-a999-d7d9d22fbf7d tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:37.532624 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-214b8ba8-135e-4f49-a999-d7d9d22fbf7d tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] [instance: 2d995117-3718-4b9d-a4a1-c1185d34d701] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:37.544372 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7e509239-d5e3-4551-8c1b-c6163dab9dbd tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:37.545112 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-214b8ba8-135e-4f49-a999-d7d9d22fbf7d tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:37.545792 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-214b8ba8-135e-4f49-a999-d7d9d22fbf7d tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:37.546501 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-214b8ba8-135e-4f49-a999-d7d9d22fbf7d tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:37.547507 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-214b8ba8-135e-4f49-a999-d7d9d22fbf7d tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:37.548116 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-214b8ba8-135e-4f49-a999-d7d9d22fbf7d tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:37.549119 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-214b8ba8-135e-4f49-a999-d7d9d22fbf7d tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:37.561082 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7e509239-d5e3-4551-8c1b-c6163dab9dbd tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 0.564933 Sep 08 10:57:37.569098 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2134/4337] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:36 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:37.576608 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4121db75-6e7b-400e-95df-1f4fd8bb153e tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:37.581805 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4121db75-6e7b-400e-95df-1f4fd8bb153e tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] [instance: 51e76f20-555e-4867-a42b-30727dc94169] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:37.589923 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:57:37.596642 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-214b8ba8-135e-4f49-a999-d7d9d22fbf7d tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] HTTP exception thrown: Instance 2d995117-3718-4b9d-a4a1-c1185d34d701 could not be found. Sep 08 10:57:37.598706 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-214b8ba8-135e-4f49-a999-d7d9d22fbf7d tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Request method failure captured: Sep 08 10:57:37.598706 n-d-850501-12 devstack@n-api.service[128861]: request: DELETE /compute/v2.1/servers/2d995117-3718-4b9d-a4a1-c1185d34d701 HTTP/1.1 Sep 08 10:57:37.598706 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:57:37.598706 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:57:37.598706 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:57:37.598706 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:57:37.598706 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:57:37.598706 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:57:37.598706 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:57:37.598706 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:57:37.598706 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcod6NyAY5khuYZmAuIgq4JBYBTI-D4jLVXxFgAEX8W5oVvP2tD1ZRtXgkupryqxfQ5TxEluQna7tvFbLU8Nqj1H4c3e-hI-CSApfK2lfysLLiu0tl4KfZ6Hp5ha-7InD_PXInG3o5sbUtFWmNzHNdMQ2u-nfdV_i_ROuHFcUNRzWKE Sep 08 10:57:37.598706 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:57:37.598706 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:57:37.598706 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:57:37.598706 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:57:37.598706 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:57:37.598706 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:57:37.598706 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 1f1c70903c3d42d790d9ef96adc1fdbd Sep 08 10:57:37.598706 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServersTestMultiNic-1772230459 Sep 08 10:57:37.598706 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:57:37.598706 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:57:37.598706 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1f1c70903c3d42d790d9ef96adc1fdbd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1f1c70903c3d42d790d9ef96adc1fdbd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1f1c70903c3d42d790d9ef96adc1fdbd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1f1c70903c3d42d790d9ef96adc1fdbd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:57:37.598706 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServersTestMultiNic-1772230459 Sep 08 10:57:37.598706 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 1f1c70903c3d42d790d9ef96adc1fdbd Sep 08 10:57:37.598706 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServersTestMultiNic-1772230459 Sep 08 10:57:37.598706 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServersTestMultiNic-1772230459-project Sep 08 10:57:37.598706 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:57:37.598706 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:57:37.598706 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 22145c653c804031ae233de6d84647fe Sep 08 10:57:37.598706 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServersTestMultiNic-1772230459-project Sep 08 10:57:37.598706 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:57:37.598706 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 2d995117-3718-4b9d-a4a1-c1185d34d701 could not be found. Sep 08 10:57:37.598706 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '2d995117-3718-4b9d-a4a1-c1185d34d701'} Sep 08 10:57:37.598706 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:57:37.598706 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:57:37.598706 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:57:37.598706 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:57:37.598706 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:57:37.598706 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:57:37.598706 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:57:37.598706 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:57:37.598706 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:57:37.598706 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:57:37.598706 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d995117-3718-4b9d-a4a1-c1185d34d701 could not be found. Sep 08 10:57:37.598706 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:57:37.598706 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:57:37.598706 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:57:37.598706 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:57:37.598706 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:57:37.598706 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:57:37.598706 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:57:37.598706 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:57:37.598706 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:57:37.598706 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:57:37.598706 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:57:37.598706 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:57:37.598706 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:57:37.598706 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:57:37.598706 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:57:37.598706 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:57:37.598706 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:57:37.598706 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:57:37.606630 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d995117-3718-4b9d-a4a1-c1185d34d701 could not be found. Sep 08 10:57:37.606630 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:57:37.606630 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:57:37.606630 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:57:37.606630 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:57:37.606630 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:57:37.606630 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:57:37.606630 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:57:37.606630 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:57:37.606630 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d995117-3718-4b9d-a4a1-c1185d34d701 could not be found. Sep 08 10:57:37.606630 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:57:37.606630 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-214b8ba8-135e-4f49-a999-d7d9d22fbf7d tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Returning 404 to user: Instance 2d995117-3718-4b9d-a4a1-c1185d34d701 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:57:37.606630 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-214b8ba8-135e-4f49-a999-d7d9d22fbf7d tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2d995117-3718-4b9d-a4a1-c1185d34d701" status: 404 len: 111 microversion: 2.1 time: 0.084199 Sep 08 10:57:37.606630 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2204/4338] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:57:37 2022] DELETE /compute/v2.1/servers/2d995117-3718-4b9d-a4a1-c1185d34d701 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:57:37.617744 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4121db75-6e7b-400e-95df-1f4fd8bb153e tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:37.619666 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4121db75-6e7b-400e-95df-1f4fd8bb153e tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:37.620519 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4121db75-6e7b-400e-95df-1f4fd8bb153e tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:37.621992 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4121db75-6e7b-400e-95df-1f4fd8bb153e tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:37.622963 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4121db75-6e7b-400e-95df-1f4fd8bb153e tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:37.623822 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4121db75-6e7b-400e-95df-1f4fd8bb153e tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:37.633371 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a11b555d-e361-4074-abd3-0f0f0dcb78bb tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:37.635261 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a11b555d-e361-4074-abd3-0f0f0dcb78bb tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: a882cf75-539a-45fa-ae2b-4e0f043b340d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:37.648575 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a11b555d-e361-4074-abd3-0f0f0dcb78bb tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:37.649268 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a11b555d-e361-4074-abd3-0f0f0dcb78bb tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:37.650364 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a11b555d-e361-4074-abd3-0f0f0dcb78bb tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:37.651890 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a11b555d-e361-4074-abd3-0f0f0dcb78bb tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:37.653019 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a11b555d-e361-4074-abd3-0f0f0dcb78bb tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:37.653913 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a11b555d-e361-4074-abd3-0f0f0dcb78bb tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:38.268842 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4121db75-6e7b-400e-95df-1f4fd8bb153e tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a779e85e1c493985f7cfe8aceb9c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4478d0e315d948df9eda910f205646c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:38.271606 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:57:38.328306 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4121db75-6e7b-400e-95df-1f4fd8bb153e tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] 10.222.0.27 "GET /compute/v2.1/servers/51e76f20-555e-4867-a42b-30727dc94169" status: 200 len: 1511 microversion: 2.1 time: 0.746317 Sep 08 10:57:38.330910 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2135/4339] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:37 2022] GET /compute/v2.1/servers/51e76f20-555e-4867-a42b-30727dc94169 => generated 1511 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:38.340750 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6f3fca8f-b3e7-41ce-baae-58e84da6055e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:38.343484 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6f3fca8f-b3e7-41ce-baae-58e84da6055e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:38.359557 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f3fca8f-b3e7-41ce-baae-58e84da6055e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:38.360207 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f3fca8f-b3e7-41ce-baae-58e84da6055e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:38.360797 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f3fca8f-b3e7-41ce-baae-58e84da6055e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:38.362658 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f3fca8f-b3e7-41ce-baae-58e84da6055e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:38.365296 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f3fca8f-b3e7-41ce-baae-58e84da6055e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:38.366008 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f3fca8f-b3e7-41ce-baae-58e84da6055e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:38.480137 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a11b555d-e361-4074-abd3-0f0f0dcb78bb tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:38.499479 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a11b555d-e361-4074-abd3-0f0f0dcb78bb tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d" status: 200 len: 1508 microversion: 2.1 time: 0.888383 Sep 08 10:57:38.515601 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2205/4340] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:37 2022] GET /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d => generated 1508 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:38.552365 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cdfcfd54-334c-4c4a-8a1c-042a62215747 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:57:38.553429 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cdfcfd54-334c-4c4a-8a1c-042a62215747 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 02b09401-4b45-4528-a8e2-f8e9fe6baf84] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:38.566198 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-cdfcfd54-334c-4c4a-8a1c-042a62215747 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] HTTP exception thrown: Instance 02b09401-4b45-4528-a8e2-f8e9fe6baf84 could not be found. Sep 08 10:57:38.571630 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cdfcfd54-334c-4c4a-8a1c-042a62215747 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Request method failure captured: Sep 08 10:57:38.571630 n-d-850501-12 devstack@n-api.service[128861]: request: POST /compute/v2.1/servers/02b09401-4b45-4528-a8e2-f8e9fe6baf84/action HTTP/1.1 Sep 08 10:57:38.571630 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:57:38.571630 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:57:38.571630 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:57:38.571630 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 15 Sep 08 10:57:38.571630 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:57:38.571630 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:57:38.571630 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:57:38.571630 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:57:38.571630 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcmnspi0cCT_Ts_s7jcB6HjtEcdULbQPd_krJniB9lBsXpm1cXSOD-YMaJoaapHCxuCXz0q6Qe4WXufr5At6SSPw8ov8Oz1eUk-fSNbVp7WlOPycfCf5I6xwH7tfbsoefVfbTiDOfU9mTBl0Vs74qdfTniErHfQlEG4cAvAQl1-wMrs Sep 08 10:57:38.571630 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:57:38.571630 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:57:38.571630 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:57:38.571630 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:57:38.571630 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:57:38.571630 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:57:38.571630 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:57:38.571630 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:57:38.571630 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:57:38.571630 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:57:38.571630 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:57:38.571630 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:57:38.571630 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:57:38.571630 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:57:38.571630 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:57:38.571630 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:57:38.571630 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:57:38.571630 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 7f551e6fe34243c290a25b57ab26af19 Sep 08 10:57:38.571630 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:57:38.571630 n-d-850501-12 devstack@n-api.service[128861]: Sep 08 10:57:38.571630 n-d-850501-12 devstack@n-api.service[128861]: {"unpause": {}} Sep 08 10:57:38.571630 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:57:38.571630 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 02b09401-4b45-4528-a8e2-f8e9fe6baf84 could not be found. Sep 08 10:57:38.571630 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '02b09401-4b45-4528-a8e2-f8e9fe6baf84', 'body': {'unpause': {}}} Sep 08 10:57:38.571630 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:57:38.571630 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:57:38.571630 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:57:38.571630 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:57:38.571630 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:57:38.571630 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:57:38.571630 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 08 10:57:38.571630 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 08 10:57:38.571630 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02b09401-4b45-4528-a8e2-f8e9fe6baf84 could not be found. Sep 08 10:57:38.571630 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:57:38.571630 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:57:38.571630 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:57:38.571630 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:57:38.571630 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:57:38.571630 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:57:38.571630 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:57:38.571630 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:57:38.571630 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:57:38.571630 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:57:38.571630 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Sep 08 10:57:38.571630 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Sep 08 10:57:38.571630 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:57:38.571630 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:57:38.571630 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02b09401-4b45-4528-a8e2-f8e9fe6baf84 could not be found. Sep 08 10:57:38.571630 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:57:38.571630 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:57:38.571630 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:57:38.571630 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:57:38.571630 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:57:38.571630 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:57:38.579460 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:57:38.579460 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:57:38.579460 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02b09401-4b45-4528-a8e2-f8e9fe6baf84 could not be found. Sep 08 10:57:38.579460 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:57:38.585342 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cdfcfd54-334c-4c4a-8a1c-042a62215747 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Returning 404 to user: Instance 02b09401-4b45-4528-a8e2-f8e9fe6baf84 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:57:38.585342 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cdfcfd54-334c-4c4a-8a1c-042a62215747 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "POST /compute/v2.1/servers/02b09401-4b45-4528-a8e2-f8e9fe6baf84/action" status: 404 len: 111 microversion: 2.1 time: 0.040360 Sep 08 10:57:38.585342 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2206/4341] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:57:38 2022] POST /compute/v2.1/servers/02b09401-4b45-4528-a8e2-f8e9fe6baf84/action => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:57:38.597162 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ee465e9c-265f-445e-939c-fc7191590c05 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:38.599544 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ee465e9c-265f-445e-939c-fc7191590c05 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] [instance: 2d995117-3718-4b9d-a4a1-c1185d34d701] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:38.616426 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ee465e9c-265f-445e-939c-fc7191590c05 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:38.618127 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ee465e9c-265f-445e-939c-fc7191590c05 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:38.619794 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ee465e9c-265f-445e-939c-fc7191590c05 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:38.622421 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ee465e9c-265f-445e-939c-fc7191590c05 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:38.623991 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ee465e9c-265f-445e-939c-fc7191590c05 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:38.625253 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ee465e9c-265f-445e-939c-fc7191590c05 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:38.666404 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-ee465e9c-265f-445e-939c-fc7191590c05 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] HTTP exception thrown: Instance 2d995117-3718-4b9d-a4a1-c1185d34d701 could not be found. Sep 08 10:57:38.670854 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ee465e9c-265f-445e-939c-fc7191590c05 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Request method failure captured: Sep 08 10:57:38.670854 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/2d995117-3718-4b9d-a4a1-c1185d34d701 HTTP/1.1 Sep 08 10:57:38.670854 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:57:38.670854 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:57:38.670854 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:57:38.670854 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:57:38.670854 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:57:38.670854 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:57:38.670854 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:57:38.670854 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:57:38.670854 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcod6NyAY5khuYZmAuIgq4JBYBTI-D4jLVXxFgAEX8W5oVvP2tD1ZRtXgkupryqxfQ5TxEluQna7tvFbLU8Nqj1H4c3e-hI-CSApfK2lfysLLiu0tl4KfZ6Hp5ha-7InD_PXInG3o5sbUtFWmNzHNdMQ2u-nfdV_i_ROuHFcUNRzWKE Sep 08 10:57:38.670854 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:57:38.670854 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:57:38.670854 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:57:38.670854 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:57:38.670854 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:57:38.670854 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:57:38.670854 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 1f1c70903c3d42d790d9ef96adc1fdbd Sep 08 10:57:38.670854 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServersTestMultiNic-1772230459 Sep 08 10:57:38.670854 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:57:38.670854 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:57:38.670854 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1f1c70903c3d42d790d9ef96adc1fdbd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1f1c70903c3d42d790d9ef96adc1fdbd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1f1c70903c3d42d790d9ef96adc1fdbd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1f1c70903c3d42d790d9ef96adc1fdbd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:57:38.670854 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServersTestMultiNic-1772230459 Sep 08 10:57:38.670854 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 1f1c70903c3d42d790d9ef96adc1fdbd Sep 08 10:57:38.670854 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServersTestMultiNic-1772230459 Sep 08 10:57:38.670854 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServersTestMultiNic-1772230459-project Sep 08 10:57:38.670854 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:57:38.670854 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:57:38.670854 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 22145c653c804031ae233de6d84647fe Sep 08 10:57:38.670854 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServersTestMultiNic-1772230459-project Sep 08 10:57:38.670854 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:57:38.670854 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 2d995117-3718-4b9d-a4a1-c1185d34d701 could not be found. Sep 08 10:57:38.670854 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '2d995117-3718-4b9d-a4a1-c1185d34d701'} Sep 08 10:57:38.670854 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:57:38.670854 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:57:38.670854 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:57:38.670854 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:57:38.670854 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:57:38.670854 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:57:38.670854 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:57:38.670854 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:57:38.670854 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:57:38.670854 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:57:38.670854 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d995117-3718-4b9d-a4a1-c1185d34d701 could not be found. Sep 08 10:57:38.670854 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:57:38.670854 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:57:38.670854 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:57:38.670854 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:57:38.670854 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:57:38.670854 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:57:38.670854 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:57:38.670854 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:57:38.670854 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:57:38.670854 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:57:38.670854 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:57:38.670854 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:57:38.670854 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:57:38.670854 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:57:38.670854 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:57:38.670854 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:57:38.670854 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d995117-3718-4b9d-a4a1-c1185d34d701 could not be found. Sep 08 10:57:38.670854 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:57:38.670854 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:57:38.670854 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:57:38.678234 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:57:38.678234 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:57:38.678234 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:57:38.678234 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:57:38.678234 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:57:38.678234 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d995117-3718-4b9d-a4a1-c1185d34d701 could not be found. Sep 08 10:57:38.678234 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:57:38.678234 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ee465e9c-265f-445e-939c-fc7191590c05 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Returning 404 to user: Instance 2d995117-3718-4b9d-a4a1-c1185d34d701 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:57:38.678234 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ee465e9c-265f-445e-939c-fc7191590c05 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] 10.222.0.27 "GET /compute/v2.1/servers/2d995117-3718-4b9d-a4a1-c1185d34d701" status: 404 len: 111 microversion: 2.1 time: 0.086380 Sep 08 10:57:38.678234 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2207/4342] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:38 2022] GET /compute/v2.1/servers/2d995117-3718-4b9d-a4a1-c1185d34d701 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:57:38.689242 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1bd0d0e8-ee4f-4472-8a2c-d0a1a3f6e6fa tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:38.704059 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1bd0d0e8-ee4f-4472-8a2c-d0a1a3f6e6fa tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '06a779e85e1c493985f7cfe8aceb9c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4478d0e315d948df9eda910f205646c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:38.705823 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1bd0d0e8-ee4f-4472-8a2c-d0a1a3f6e6fa tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Searching by: {'ip': '172.20.0.14', 'deleted': False, 'project_id': '4478d0e315d948df9eda910f205646c3'} {{(pid=128861) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:57:39.059610 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1bd0d0e8-ee4f-4472-8a2c-d0a1a3f6e6fa tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:39.061929 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1bd0d0e8-ee4f-4472-8a2c-d0a1a3f6e6fa tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:39.068940 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1bd0d0e8-ee4f-4472-8a2c-d0a1a3f6e6fa tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:39.070577 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1bd0d0e8-ee4f-4472-8a2c-d0a1a3f6e6fa tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:39.077420 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1bd0d0e8-ee4f-4472-8a2c-d0a1a3f6e6fa tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:39.082366 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1bd0d0e8-ee4f-4472-8a2c-d0a1a3f6e6fa tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:39.201148 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6f3fca8f-b3e7-41ce-baae-58e84da6055e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:39.214527 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6f3fca8f-b3e7-41ce-baae-58e84da6055e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1667 microversion: 2.1 time: 0.881996 Sep 08 10:57:39.219841 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2136/4343] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:38 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1667 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:39.226990 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-41ce6bab-e8f1-4f45-a4c1-a3a2cd538232 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:39.230081 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-41ce6bab-e8f1-4f45-a4c1-a3a2cd538232 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:39.244509 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-41ce6bab-e8f1-4f45-a4c1-a3a2cd538232 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:39.253549 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-41ce6bab-e8f1-4f45-a4c1-a3a2cd538232 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:39.254423 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-41ce6bab-e8f1-4f45-a4c1-a3a2cd538232 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:39.255724 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-41ce6bab-e8f1-4f45-a4c1-a3a2cd538232 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:39.256423 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-41ce6bab-e8f1-4f45-a4c1-a3a2cd538232 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:39.257213 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-41ce6bab-e8f1-4f45-a4c1-a3a2cd538232 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:39.353267 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.multi_cell_list [None req-1bd0d0e8-ee4f-4472-8a2c-d0a1a3f6e6fa tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128861) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 10:57:39.465834 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1bd0d0e8-ee4f-4472-8a2c-d0a1a3f6e6fa tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] 10.222.0.27 "GET /compute/v2.1/servers?ip=172.20.0.14" status: 200 len: 346 microversion: 2.1 time: 0.788827 Sep 08 10:57:39.468839 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2208/4344] 10.222.0.27 () {58 vars in 1154 bytes} [Thu Sep 8 10:57:38 2022] GET /compute/v2.1/servers?ip=172.20.0.14 => generated 346 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:57:39.473224 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e8b01ecf-49b7-4dd0-9081-3c15f4236db5 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:39.473883 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e8b01ecf-49b7-4dd0-9081-3c15f4236db5 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] [instance: 9e4282f7-daab-454b-93e5-7854754316c8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:39.486815 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e8b01ecf-49b7-4dd0-9081-3c15f4236db5 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:39.487826 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e8b01ecf-49b7-4dd0-9081-3c15f4236db5 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:39.488582 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e8b01ecf-49b7-4dd0-9081-3c15f4236db5 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:39.489619 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e8b01ecf-49b7-4dd0-9081-3c15f4236db5 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:39.490193 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e8b01ecf-49b7-4dd0-9081-3c15f4236db5 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:39.490819 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e8b01ecf-49b7-4dd0-9081-3c15f4236db5 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:39.519437 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-e8b01ecf-49b7-4dd0-9081-3c15f4236db5 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] HTTP exception thrown: Instance 9e4282f7-daab-454b-93e5-7854754316c8 could not be found. Sep 08 10:57:39.531405 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e8b01ecf-49b7-4dd0-9081-3c15f4236db5 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Request method failure captured: Sep 08 10:57:39.531405 n-d-850501-12 devstack@n-api.service[128861]: request: DELETE /compute/v2.1/servers/9e4282f7-daab-454b-93e5-7854754316c8 HTTP/1.1 Sep 08 10:57:39.531405 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:57:39.531405 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:57:39.531405 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:57:39.531405 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:57:39.531405 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:57:39.531405 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:57:39.531405 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:57:39.531405 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:57:39.531405 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcod6NyAY5khuYZmAuIgq4JBYBTI-D4jLVXxFgAEX8W5oVvP2tD1ZRtXgkupryqxfQ5TxEluQna7tvFbLU8Nqj1H4c3e-hI-CSApfK2lfysLLiu0tl4KfZ6Hp5ha-7InD_PXInG3o5sbUtFWmNzHNdMQ2u-nfdV_i_ROuHFcUNRzWKE Sep 08 10:57:39.531405 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:57:39.531405 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:57:39.531405 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:57:39.531405 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:57:39.531405 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:57:39.531405 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:57:39.531405 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 1f1c70903c3d42d790d9ef96adc1fdbd Sep 08 10:57:39.531405 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServersTestMultiNic-1772230459 Sep 08 10:57:39.531405 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:57:39.531405 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:57:39.531405 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1f1c70903c3d42d790d9ef96adc1fdbd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1f1c70903c3d42d790d9ef96adc1fdbd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1f1c70903c3d42d790d9ef96adc1fdbd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1f1c70903c3d42d790d9ef96adc1fdbd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:57:39.531405 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServersTestMultiNic-1772230459 Sep 08 10:57:39.531405 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 1f1c70903c3d42d790d9ef96adc1fdbd Sep 08 10:57:39.531405 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServersTestMultiNic-1772230459 Sep 08 10:57:39.531405 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServersTestMultiNic-1772230459-project Sep 08 10:57:39.531405 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:57:39.531405 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:57:39.531405 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 22145c653c804031ae233de6d84647fe Sep 08 10:57:39.531405 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServersTestMultiNic-1772230459-project Sep 08 10:57:39.531405 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:57:39.531405 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 9e4282f7-daab-454b-93e5-7854754316c8 could not be found. Sep 08 10:57:39.531405 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '9e4282f7-daab-454b-93e5-7854754316c8'} Sep 08 10:57:39.531405 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:57:39.531405 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:57:39.531405 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:57:39.531405 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:57:39.531405 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:57:39.531405 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:57:39.531405 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:57:39.531405 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:57:39.531405 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:57:39.531405 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:57:39.531405 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e4282f7-daab-454b-93e5-7854754316c8 could not be found. Sep 08 10:57:39.531405 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:57:39.531405 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:57:39.531405 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:57:39.531405 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:57:39.531405 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:57:39.531405 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:57:39.531405 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:57:39.531405 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:57:39.531405 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:57:39.531405 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:57:39.531405 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:57:39.531405 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:57:39.531405 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:57:39.531405 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:57:39.531405 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:57:39.531405 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:57:39.531405 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:57:39.531405 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:57:39.536682 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e4282f7-daab-454b-93e5-7854754316c8 could not be found. Sep 08 10:57:39.536682 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:57:39.536682 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:57:39.536682 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:57:39.536682 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:57:39.536682 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:57:39.536682 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:57:39.536682 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:57:39.536682 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:57:39.536682 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e4282f7-daab-454b-93e5-7854754316c8 could not be found. Sep 08 10:57:39.536682 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:57:39.540894 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e8b01ecf-49b7-4dd0-9081-3c15f4236db5 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Returning 404 to user: Instance 9e4282f7-daab-454b-93e5-7854754316c8 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:57:39.543087 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e8b01ecf-49b7-4dd0-9081-3c15f4236db5 tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9e4282f7-daab-454b-93e5-7854754316c8" status: 404 len: 111 microversion: 2.1 time: 0.074543 Sep 08 10:57:39.553017 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2209/4345] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:57:39 2022] DELETE /compute/v2.1/servers/9e4282f7-daab-454b-93e5-7854754316c8 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:57:39.559113 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-31b4bda7-ef0a-4f34-9667-ea0203667bbb tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:39.559990 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-31b4bda7-ef0a-4f34-9667-ea0203667bbb tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] [instance: 931569b4-139a-4939-abf3-49a589eb1d91] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:39.595772 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-31b4bda7-ef0a-4f34-9667-ea0203667bbb tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:39.597903 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-31b4bda7-ef0a-4f34-9667-ea0203667bbb tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:39.598509 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-31b4bda7-ef0a-4f34-9667-ea0203667bbb tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:39.599526 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-31b4bda7-ef0a-4f34-9667-ea0203667bbb tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:39.600214 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-31b4bda7-ef0a-4f34-9667-ea0203667bbb tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:39.600885 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-31b4bda7-ef0a-4f34-9667-ea0203667bbb tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:39.978120 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-41ce6bab-e8f1-4f45-a4c1-a3a2cd538232 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:39.989746 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-41ce6bab-e8f1-4f45-a4c1-a3a2cd538232 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 0.768517 Sep 08 10:57:39.992015 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2137/4346] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:39 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:40.005884 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-afe1d5b1-cdf4-4178-b1c2-a0fb0ed8b080 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:40.006879 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-afe1d5b1-cdf4-4178-b1c2-a0fb0ed8b080 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: a882cf75-539a-45fa-ae2b-4e0f043b340d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:40.021184 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-afe1d5b1-cdf4-4178-b1c2-a0fb0ed8b080 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:40.022092 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-afe1d5b1-cdf4-4178-b1c2-a0fb0ed8b080 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:40.027044 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-afe1d5b1-cdf4-4178-b1c2-a0fb0ed8b080 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:40.028082 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-afe1d5b1-cdf4-4178-b1c2-a0fb0ed8b080 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:40.028785 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-afe1d5b1-cdf4-4178-b1c2-a0fb0ed8b080 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:40.029473 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-afe1d5b1-cdf4-4178-b1c2-a0fb0ed8b080 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:40.247865 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-afe1d5b1-cdf4-4178-b1c2-a0fb0ed8b080 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:40.269878 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-afe1d5b1-cdf4-4178-b1c2-a0fb0ed8b080 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d" status: 200 len: 1466 microversion: 2.1 time: 0.273030 Sep 08 10:57:40.272063 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2138/4347] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:39 2022] GET /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d => generated 1466 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:40.295416 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-07239b62-9e3e-44a3-a38a-fda12f4de2de tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:40.299227 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-07239b62-9e3e-44a3-a38a-fda12f4de2de tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] [instance: 9e4282f7-daab-454b-93e5-7854754316c8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:40.312671 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-07239b62-9e3e-44a3-a38a-fda12f4de2de tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:40.313583 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-07239b62-9e3e-44a3-a38a-fda12f4de2de tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:40.314265 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-07239b62-9e3e-44a3-a38a-fda12f4de2de tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:40.315384 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-07239b62-9e3e-44a3-a38a-fda12f4de2de tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:40.316083 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-07239b62-9e3e-44a3-a38a-fda12f4de2de tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:40.316720 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-07239b62-9e3e-44a3-a38a-fda12f4de2de tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:40.340451 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-07239b62-9e3e-44a3-a38a-fda12f4de2de tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] HTTP exception thrown: Instance 9e4282f7-daab-454b-93e5-7854754316c8 could not be found. Sep 08 10:57:40.343525 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-07239b62-9e3e-44a3-a38a-fda12f4de2de tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Request method failure captured: Sep 08 10:57:40.343525 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/9e4282f7-daab-454b-93e5-7854754316c8 HTTP/1.1 Sep 08 10:57:40.343525 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:57:40.343525 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:57:40.343525 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:57:40.343525 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:57:40.343525 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:57:40.343525 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:57:40.343525 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:57:40.343525 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:57:40.343525 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcod6NyAY5khuYZmAuIgq4JBYBTI-D4jLVXxFgAEX8W5oVvP2tD1ZRtXgkupryqxfQ5TxEluQna7tvFbLU8Nqj1H4c3e-hI-CSApfK2lfysLLiu0tl4KfZ6Hp5ha-7InD_PXInG3o5sbUtFWmNzHNdMQ2u-nfdV_i_ROuHFcUNRzWKE Sep 08 10:57:40.343525 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:57:40.343525 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:57:40.343525 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:57:40.343525 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:57:40.343525 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:57:40.343525 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:57:40.343525 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 1f1c70903c3d42d790d9ef96adc1fdbd Sep 08 10:57:40.343525 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersTestMultiNic-1772230459 Sep 08 10:57:40.343525 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:57:40.343525 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:57:40.343525 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1f1c70903c3d42d790d9ef96adc1fdbd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1f1c70903c3d42d790d9ef96adc1fdbd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1f1c70903c3d42d790d9ef96adc1fdbd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1f1c70903c3d42d790d9ef96adc1fdbd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:57:40.343525 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServersTestMultiNic-1772230459 Sep 08 10:57:40.343525 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 1f1c70903c3d42d790d9ef96adc1fdbd Sep 08 10:57:40.343525 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersTestMultiNic-1772230459 Sep 08 10:57:40.343525 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServersTestMultiNic-1772230459-project Sep 08 10:57:40.343525 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:57:40.343525 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:57:40.343525 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 22145c653c804031ae233de6d84647fe Sep 08 10:57:40.343525 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServersTestMultiNic-1772230459-project Sep 08 10:57:40.343525 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:57:40.343525 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 9e4282f7-daab-454b-93e5-7854754316c8 could not be found. Sep 08 10:57:40.343525 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '9e4282f7-daab-454b-93e5-7854754316c8'} Sep 08 10:57:40.343525 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:57:40.343525 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:57:40.343525 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:57:40.343525 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:57:40.343525 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:57:40.343525 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:57:40.343525 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:57:40.343525 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:57:40.343525 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:57:40.343525 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:57:40.343525 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e4282f7-daab-454b-93e5-7854754316c8 could not be found. Sep 08 10:57:40.343525 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:57:40.343525 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:57:40.343525 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:57:40.343525 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:57:40.343525 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:57:40.343525 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:57:40.343525 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:57:40.343525 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:57:40.343525 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:57:40.343525 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:57:40.343525 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:57:40.343525 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:57:40.343525 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:57:40.343525 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:57:40.343525 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:57:40.343525 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:57:40.343525 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e4282f7-daab-454b-93e5-7854754316c8 could not be found. Sep 08 10:57:40.343525 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:57:40.343525 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:57:40.343525 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:57:40.350113 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:57:40.350113 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:57:40.350113 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:57:40.350113 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:57:40.350113 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:57:40.350113 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e4282f7-daab-454b-93e5-7854754316c8 could not be found. Sep 08 10:57:40.350113 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:57:40.355212 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-07239b62-9e3e-44a3-a38a-fda12f4de2de tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] Returning 404 to user: Instance 9e4282f7-daab-454b-93e5-7854754316c8 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:57:40.356132 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-07239b62-9e3e-44a3-a38a-fda12f4de2de tempest-ServersTestMultiNic-1772230459 tempest-ServersTestMultiNic-1772230459-project] 10.222.0.27 "GET /compute/v2.1/servers/9e4282f7-daab-454b-93e5-7854754316c8" status: 404 len: 111 microversion: 2.1 time: 0.082313 Sep 08 10:57:40.367574 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2139/4348] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:40 2022] GET /compute/v2.1/servers/9e4282f7-daab-454b-93e5-7854754316c8 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:57:40.379065 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7ec6b3b0-7885-4eb0-90f4-0e19005350b0 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:40.379605 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7ec6b3b0-7885-4eb0-90f4-0e19005350b0 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:40.399369 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ec6b3b0-7885-4eb0-90f4-0e19005350b0 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:40.402738 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ec6b3b0-7885-4eb0-90f4-0e19005350b0 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:40.403669 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ec6b3b0-7885-4eb0-90f4-0e19005350b0 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:40.416732 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ec6b3b0-7885-4eb0-90f4-0e19005350b0 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:40.417390 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ec6b3b0-7885-4eb0-90f4-0e19005350b0 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:40.417853 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ec6b3b0-7885-4eb0-90f4-0e19005350b0 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:40.531387 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-31b4bda7-ef0a-4f34-9667-ea0203667bbb tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a779e85e1c493985f7cfe8aceb9c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4478d0e315d948df9eda910f205646c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:40.567255 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-31b4bda7-ef0a-4f34-9667-ea0203667bbb tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] 10.222.0.27 "GET /compute/v2.1/servers/931569b4-139a-4939-abf3-49a589eb1d91" status: 200 len: 1512 microversion: 2.1 time: 1.011760 Sep 08 10:57:40.578658 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2210/4349] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:39 2022] GET /compute/v2.1/servers/931569b4-139a-4939-abf3-49a589eb1d91 => generated 1512 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:41.102808 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-2b947205-9021-4e55-b873-8e16e018453b req-141d4659-1fa7-4d2e-a4e4-fbd0e13c543f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a882cf75-539a-45fa-ae2b-4e0f043b340d", "name": "network-vif-deleted", "tag": "077130a0-4e23-4573-8f49-5e525ae937fa"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:57:41.132611 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-2b947205-9021-4e55-b873-8e16e018453b req-141d4659-1fa7-4d2e-a4e4-fbd0e13c543f service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:41.137763 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-2b947205-9021-4e55-b873-8e16e018453b req-141d4659-1fa7-4d2e-a4e4-fbd0e13c543f service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:41.143607 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-2b947205-9021-4e55-b873-8e16e018453b req-141d4659-1fa7-4d2e-a4e4-fbd0e13c543f service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:41.151906 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7ec6b3b0-7885-4eb0-90f4-0e19005350b0 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:41.176294 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7ec6b3b0-7885-4eb0-90f4-0e19005350b0 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 0.805895 Sep 08 10:57:41.177204 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2140/4350] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:40 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:41.195480 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c42bc776-5302-449a-b8b2-fd806881130a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:41.196727 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c42bc776-5302-449a-b8b2-fd806881130a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:41.225181 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-2b947205-9021-4e55-b873-8e16e018453b req-141d4659-1fa7-4d2e-a4e4-fbd0e13c543f service nova] Creating event network-vif-deleted:077130a0-4e23-4573-8f49-5e525ae937fa for instance a882cf75-539a-45fa-ae2b-4e0f043b340d on n-h1-850501-12 Sep 08 10:57:41.230582 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c42bc776-5302-449a-b8b2-fd806881130a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:41.231156 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c42bc776-5302-449a-b8b2-fd806881130a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:41.232181 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c42bc776-5302-449a-b8b2-fd806881130a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:41.233112 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c42bc776-5302-449a-b8b2-fd806881130a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:41.233779 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c42bc776-5302-449a-b8b2-fd806881130a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:41.234551 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c42bc776-5302-449a-b8b2-fd806881130a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:41.247033 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-2b947205-9021-4e55-b873-8e16e018453b req-141d4659-1fa7-4d2e-a4e4-fbd0e13c543f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.664748 Sep 08 10:57:41.247969 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2211/4351] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:57:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:57:41.256262 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-58567a4d-2ecb-4a5e-b736-79a7e5bc391e tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:41.273502 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-58567a4d-2ecb-4a5e-b736-79a7e5bc391e tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] [instance: 13039f8f-105b-4bb5-b632-753e183d2f1a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:41.296566 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-58567a4d-2ecb-4a5e-b736-79a7e5bc391e tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:41.300825 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-58567a4d-2ecb-4a5e-b736-79a7e5bc391e tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:41.301735 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-58567a4d-2ecb-4a5e-b736-79a7e5bc391e tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:41.302678 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-58567a4d-2ecb-4a5e-b736-79a7e5bc391e tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:41.305228 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-58567a4d-2ecb-4a5e-b736-79a7e5bc391e tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:41.306000 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-58567a4d-2ecb-4a5e-b736-79a7e5bc391e tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:41.702839 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c42bc776-5302-449a-b8b2-fd806881130a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:41.717583 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c42bc776-5302-449a-b8b2-fd806881130a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1671 microversion: 2.1 time: 0.538887 Sep 08 10:57:41.721707 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2141/4352] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:41 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1671 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:41.753696 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dd680c11-1a9f-46c8-a722-15127e0c5aec tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:57:41.759957 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-dd680c11-1a9f-46c8-a722-15127e0c5aec tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:41.779291 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd680c11-1a9f-46c8-a722-15127e0c5aec tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:41.779785 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd680c11-1a9f-46c8-a722-15127e0c5aec tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:41.780230 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd680c11-1a9f-46c8-a722-15127e0c5aec tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:41.782610 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd680c11-1a9f-46c8-a722-15127e0c5aec tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:41.784461 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd680c11-1a9f-46c8-a722-15127e0c5aec tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:41.785482 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd680c11-1a9f-46c8-a722-15127e0c5aec tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:41.856130 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-dd680c11-1a9f-46c8-a722-15127e0c5aec tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] HTTP exception thrown: Cannot 'unpause' instance 74eebde7-4328-4ddf-be14-bb9fba70ec03 while it is in vm_state active Sep 08 10:57:41.860810 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dd680c11-1a9f-46c8-a722-15127e0c5aec tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Request method failure captured: Sep 08 10:57:41.860810 n-d-850501-12 devstack@n-api.service[128862]: request: POST /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03/action HTTP/1.1 Sep 08 10:57:41.860810 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:57:41.860810 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:57:41.860810 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:57:41.860810 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 15 Sep 08 10:57:41.860810 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:57:41.860810 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:57:41.860810 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:57:41.860810 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:57:41.860810 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcmnspi0cCT_Ts_s7jcB6HjtEcdULbQPd_krJniB9lBsXpm1cXSOD-YMaJoaapHCxuCXz0q6Qe4WXufr5At6SSPw8ov8Oz1eUk-fSNbVp7WlOPycfCf5I6xwH7tfbsoefVfbTiDOfU9mTBl0Vs74qdfTniErHfQlEG4cAvAQl1-wMrs Sep 08 10:57:41.860810 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:57:41.860810 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:57:41.860810 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:57:41.860810 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:57:41.860810 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:57:41.860810 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:57:41.860810 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:57:41.860810 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:57:41.860810 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:57:41.860810 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:57:41.860810 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:57:41.860810 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:57:41.860810 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:57:41.860810 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:57:41.860810 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:57:41.860810 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:57:41.860810 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:57:41.860810 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 7f551e6fe34243c290a25b57ab26af19 Sep 08 10:57:41.860810 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:57:41.860810 n-d-850501-12 devstack@n-api.service[128862]: Sep 08 10:57:41.860810 n-d-850501-12 devstack@n-api.service[128862]: {"unpause": {}} Sep 08 10:57:41.860810 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:57:41.860810 n-d-850501-12 devstack@n-api.service[128862]: exception: Cannot 'unpause' instance 74eebde7-4328-4ddf-be14-bb9fba70ec03 while it is in vm_state active Sep 08 10:57:41.860810 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '74eebde7-4328-4ddf-be14-bb9fba70ec03', 'body': {'unpause': {}}} Sep 08 10:57:41.860810 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:57:41.860810 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:57:41.860810 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Sep 08 10:57:41.860810 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Sep 08 10:57:41.860810 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 10:57:41.860810 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 10:57:41.860810 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 08 10:57:41.860810 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 08 10:57:41.860810 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 74eebde7-4328-4ddf-be14-bb9fba70ec03 in vm_state active. Cannot unpause while the instance is in this state. Sep 08 10:57:41.860810 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:57:41.860810 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:57:41.860810 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:57:41.860810 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:57:41.860810 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:57:41.860810 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:57:41.860810 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:57:41.860810 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:57:41.860810 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:57:41.860810 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:57:41.860810 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Sep 08 10:57:41.860810 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 08 10:57:41.860810 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 08 10:57:41.860810 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 08 10:57:41.860810 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 74eebde7-4328-4ddf-be14-bb9fba70ec03 while it is in vm_state active Sep 08 10:57:41.860810 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:57:41.860810 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:57:41.860810 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:57:41.860810 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:57:41.860810 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:57:41.864635 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:57:41.864635 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:57:41.864635 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:57:41.864635 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 74eebde7-4328-4ddf-be14-bb9fba70ec03 while it is in vm_state active Sep 08 10:57:41.864635 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:57:41.864942 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-58567a4d-2ecb-4a5e-b736-79a7e5bc391e tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a779e85e1c493985f7cfe8aceb9c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4478d0e315d948df9eda910f205646c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:41.867246 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dd680c11-1a9f-46c8-a722-15127e0c5aec tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Returning 409 to user: Cannot 'unpause' instance 74eebde7-4328-4ddf-be14-bb9fba70ec03 while it is in vm_state active {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:57:41.870821 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-dd680c11-1a9f-46c8-a722-15127e0c5aec tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "POST /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03/action" status: 409 len: 145 microversion: 2.1 time: 0.123574 Sep 08 10:57:41.871742 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2142/4353] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:57:41 2022] POST /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03/action => generated 145 bytes in 137 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:57:41.879407 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b1d1ccff-58fe-47fd-8cac-00dd72c5812c tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:41.881955 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b1d1ccff-58fe-47fd-8cac-00dd72c5812c tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: a882cf75-539a-45fa-ae2b-4e0f043b340d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:41.898434 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1d1ccff-58fe-47fd-8cac-00dd72c5812c tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:41.900094 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1d1ccff-58fe-47fd-8cac-00dd72c5812c tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:41.901781 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1d1ccff-58fe-47fd-8cac-00dd72c5812c tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:41.902909 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1d1ccff-58fe-47fd-8cac-00dd72c5812c tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:41.906839 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1d1ccff-58fe-47fd-8cac-00dd72c5812c tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:41.920724 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-58567a4d-2ecb-4a5e-b736-79a7e5bc391e tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] 10.222.0.27 "GET /compute/v2.1/servers/13039f8f-105b-4bb5-b632-753e183d2f1a" status: 200 len: 1511 microversion: 2.1 time: 0.668303 Sep 08 10:57:41.924054 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2212/4354] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:41 2022] GET /compute/v2.1/servers/13039f8f-105b-4bb5-b632-753e183d2f1a => generated 1511 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:41.941318 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1d1ccff-58fe-47fd-8cac-00dd72c5812c tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:41.950560 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ffdbb953-5eda-432e-bb83-760593a653b6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:41.951627 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ffdbb953-5eda-432e-bb83-760593a653b6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:41.964916 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-b1d1ccff-58fe-47fd-8cac-00dd72c5812c tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] HTTP exception thrown: Instance a882cf75-539a-45fa-ae2b-4e0f043b340d could not be found. Sep 08 10:57:41.970084 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b1d1ccff-58fe-47fd-8cac-00dd72c5812c tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Request method failure captured: Sep 08 10:57:41.970084 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d HTTP/1.1 Sep 08 10:57:41.970084 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:57:41.970084 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:57:41.970084 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:57:41.970084 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:57:41.970084 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:57:41.970084 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:57:41.970084 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:57:41.970084 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:57:41.970084 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGclZnrdHbcSspe2CSaO_gA2LIWMGtHJAKVo_u3dlzxs9JxAXcXCwrL-z-q8SJvnWUnwIz6KxjkLXp0jFFwIV3x5Qp_zUHQKWEwS-EZKwoM8W4-UxwLeQWJTnQ9cWOYmTzHY9djf2pYmuh6sOSJJezx_5s2ElCgN_L-D4iql7Pg9xGj8 Sep 08 10:57:41.970084 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:57:41.970084 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:57:41.970084 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:57:41.970084 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:57:41.970084 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:57:41.970084 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:57:41.970084 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 33063b3b9e0543369c28ea918f52cf37 Sep 08 10:57:41.970084 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1820338337 Sep 08 10:57:41.970084 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:57:41.970084 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:57:41.970084 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/33063b3b9e0543369c28ea918f52cf37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/33063b3b9e0543369c28ea918f52cf37"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_33063b3b9e0543369c28ea918f52cf37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/33063b3b9e0543369c28ea918f52cf37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:57:41.970084 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1820338337 Sep 08 10:57:41.970084 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 33063b3b9e0543369c28ea918f52cf37 Sep 08 10:57:41.970084 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1820338337 Sep 08 10:57:41.970084 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServerRescueNegativeTestJSON-1820338337-project Sep 08 10:57:41.970084 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:57:41.970084 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:57:41.970084 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 8f487f5d062e4ac3bf21c2416a7b50ee Sep 08 10:57:41.970084 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1820338337-project Sep 08 10:57:41.970084 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:57:41.970084 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance a882cf75-539a-45fa-ae2b-4e0f043b340d could not be found. Sep 08 10:57:41.970084 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'a882cf75-539a-45fa-ae2b-4e0f043b340d'} Sep 08 10:57:41.970084 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:57:41.970084 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:57:41.970084 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:57:41.970084 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:57:41.970084 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:57:41.970084 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:57:41.970084 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:57:41.970084 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:57:41.970084 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:57:41.970084 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:57:41.970084 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a882cf75-539a-45fa-ae2b-4e0f043b340d could not be found. Sep 08 10:57:41.970084 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:57:41.970084 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:57:41.970084 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:57:41.970084 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:57:41.970084 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:57:41.970084 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:57:41.970084 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:57:41.970084 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:57:41.970084 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:57:41.970084 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:57:41.970084 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:57:41.970084 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:57:41.970084 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:57:41.970084 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:57:41.970084 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:57:41.970084 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:57:41.970084 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a882cf75-539a-45fa-ae2b-4e0f043b340d could not be found. Sep 08 10:57:41.970084 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:57:41.970084 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:57:41.973765 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:57:41.973765 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:57:41.973765 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:57:41.973765 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:57:41.973765 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:57:41.973765 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:57:41.973765 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a882cf75-539a-45fa-ae2b-4e0f043b340d could not be found. Sep 08 10:57:41.973765 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:57:41.973765 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b1d1ccff-58fe-47fd-8cac-00dd72c5812c tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Returning 404 to user: Instance a882cf75-539a-45fa-ae2b-4e0f043b340d could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:57:41.974324 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b1d1ccff-58fe-47fd-8cac-00dd72c5812c tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d" status: 404 len: 111 microversion: 2.1 time: 0.100324 Sep 08 10:57:41.975761 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2143/4355] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:41 2022] GET /compute/v2.1/servers/a882cf75-539a-45fa-ae2b-4e0f043b340d => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:57:41.991333 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6031b8ed-2ae6-4337-8250-d34be8d602d3 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:41.992474 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6031b8ed-2ae6-4337-8250-d34be8d602d3 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:42.007110 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6031b8ed-2ae6-4337-8250-d34be8d602d3 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:42.007965 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ffdbb953-5eda-432e-bb83-760593a653b6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:42.009755 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ffdbb953-5eda-432e-bb83-760593a653b6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:42.011136 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6031b8ed-2ae6-4337-8250-d34be8d602d3 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:42.012206 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6031b8ed-2ae6-4337-8250-d34be8d602d3 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:42.013711 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6031b8ed-2ae6-4337-8250-d34be8d602d3 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:42.015043 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6031b8ed-2ae6-4337-8250-d34be8d602d3 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:42.016001 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6031b8ed-2ae6-4337-8250-d34be8d602d3 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:42.018428 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ffdbb953-5eda-432e-bb83-760593a653b6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:42.023713 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ffdbb953-5eda-432e-bb83-760593a653b6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:42.032162 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ffdbb953-5eda-432e-bb83-760593a653b6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:42.032602 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ffdbb953-5eda-432e-bb83-760593a653b6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:42.279211 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6031b8ed-2ae6-4337-8250-d34be8d602d3 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:42.295847 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6031b8ed-2ae6-4337-8250-d34be8d602d3 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 0.318195 Sep 08 10:57:42.326383 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2144/4356] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:41 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:42.336134 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a2889bd1-dbaf-4176-b232-4bfdea8f7b70 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:42.337300 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a2889bd1-dbaf-4176-b232-4bfdea8f7b70 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] [instance: 51e76f20-555e-4867-a42b-30727dc94169] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:42.363948 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2889bd1-dbaf-4176-b232-4bfdea8f7b70 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:42.368239 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2889bd1-dbaf-4176-b232-4bfdea8f7b70 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:42.369099 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2889bd1-dbaf-4176-b232-4bfdea8f7b70 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:42.372620 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2889bd1-dbaf-4176-b232-4bfdea8f7b70 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:42.374026 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2889bd1-dbaf-4176-b232-4bfdea8f7b70 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:42.377083 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2889bd1-dbaf-4176-b232-4bfdea8f7b70 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:42.562849 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ffdbb953-5eda-432e-bb83-760593a653b6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:42.582048 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ffdbb953-5eda-432e-bb83-760593a653b6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1671 microversion: 2.1 time: 0.647565 Sep 08 10:57:42.583789 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2213/4357] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:41 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1671 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:42.593686 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-acfbc084-f93b-4283-aa34-315840b5ce58 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:42.595285 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-acfbc084-f93b-4283-aa34-315840b5ce58 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: fafff8cb-0e6f-4243-a91c-ec559f656880] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:42.609735 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-acfbc084-f93b-4283-aa34-315840b5ce58 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:42.610865 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-acfbc084-f93b-4283-aa34-315840b5ce58 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:42.611828 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-acfbc084-f93b-4283-aa34-315840b5ce58 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:42.613128 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-acfbc084-f93b-4283-aa34-315840b5ce58 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:42.613867 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-acfbc084-f93b-4283-aa34-315840b5ce58 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:42.615037 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-acfbc084-f93b-4283-aa34-315840b5ce58 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:42.652792 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-acfbc084-f93b-4283-aa34-315840b5ce58 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: fafff8cb-0e6f-4243-a91c-ec559f656880] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:57:42.833803 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-acfbc084-f93b-4283-aa34-315840b5ce58 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "DELETE /compute/v2.1/servers/fafff8cb-0e6f-4243-a91c-ec559f656880" status: 204 len: 0 microversion: 2.1 time: 0.241409 Sep 08 10:57:42.839086 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2214/4358] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:57:42 2022] DELETE /compute/v2.1/servers/fafff8cb-0e6f-4243-a91c-ec559f656880 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:57:42.872862 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4e0fb8b8-8cad-4f91-b2d1-c1d74a91940a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:42.879396 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4e0fb8b8-8cad-4f91-b2d1-c1d74a91940a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:42.925857 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4e0fb8b8-8cad-4f91-b2d1-c1d74a91940a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:42.926990 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4e0fb8b8-8cad-4f91-b2d1-c1d74a91940a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:42.927848 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4e0fb8b8-8cad-4f91-b2d1-c1d74a91940a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:42.928673 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4e0fb8b8-8cad-4f91-b2d1-c1d74a91940a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:42.929664 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4e0fb8b8-8cad-4f91-b2d1-c1d74a91940a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:42.930239 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4e0fb8b8-8cad-4f91-b2d1-c1d74a91940a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:43.237413 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a2889bd1-dbaf-4176-b232-4bfdea8f7b70 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a779e85e1c493985f7cfe8aceb9c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4478d0e315d948df9eda910f205646c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:43.249290 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a2889bd1-dbaf-4176-b232-4bfdea8f7b70 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] 10.222.0.27 "GET /compute/v2.1/servers/51e76f20-555e-4867-a42b-30727dc94169" status: 200 len: 1511 microversion: 2.1 time: 0.921075 Sep 08 10:57:43.250151 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2145/4359] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:42 2022] GET /compute/v2.1/servers/51e76f20-555e-4867-a42b-30727dc94169 => generated 1511 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:43.278405 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fd28380c-aabf-4d43-8cf2-841f9b4b3420 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:57:43.281265 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fd28380c-aabf-4d43-8cf2-841f9b4b3420 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:43.295373 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd28380c-aabf-4d43-8cf2-841f9b4b3420 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:43.296210 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd28380c-aabf-4d43-8cf2-841f9b4b3420 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:43.296837 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd28380c-aabf-4d43-8cf2-841f9b4b3420 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:43.297775 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd28380c-aabf-4d43-8cf2-841f9b4b3420 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:43.306577 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd28380c-aabf-4d43-8cf2-841f9b4b3420 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:43.307257 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd28380c-aabf-4d43-8cf2-841f9b4b3420 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:43.413641 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fd28380c-aabf-4d43-8cf2-841f9b4b3420 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Unlocking {{(pid=128862) unlock /opt/stack/nova/nova/compute/api.py:4874}} Sep 08 10:57:43.572302 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fd28380c-aabf-4d43-8cf2-841f9b4b3420 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "POST /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7/action" status: 202 len: 0 microversion: 2.1 time: 0.302643 Sep 08 10:57:43.573650 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2146/4360] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:57:43 2022] POST /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7/action => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:57:43.593787 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-079f44df-0b97-487f-990b-5afb67472275 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:43.594825 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-079f44df-0b97-487f-990b-5afb67472275 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: fafff8cb-0e6f-4243-a91c-ec559f656880] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:43.610635 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4e0fb8b8-8cad-4f91-b2d1-c1d74a91940a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:43.619494 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-079f44df-0b97-487f-990b-5afb67472275 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:43.620373 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-079f44df-0b97-487f-990b-5afb67472275 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:43.621132 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-079f44df-0b97-487f-990b-5afb67472275 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:43.622214 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-079f44df-0b97-487f-990b-5afb67472275 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:43.622813 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-079f44df-0b97-487f-990b-5afb67472275 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:43.629766 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-079f44df-0b97-487f-990b-5afb67472275 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:43.642366 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4e0fb8b8-8cad-4f91-b2d1-c1d74a91940a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 0.798559 Sep 08 10:57:43.645913 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2215/4361] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:42 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:43.673229 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bbcbbae6-76cb-4ce7-8a71-84c4daaecf90 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:43.681620 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-bbcbbae6-76cb-4ce7-8a71-84c4daaecf90 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '06a779e85e1c493985f7cfe8aceb9c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4478d0e315d948df9eda910f205646c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:43.682931 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bbcbbae6-76cb-4ce7-8a71-84c4daaecf90 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Searching by: {'deleted': False, 'project_id': '4478d0e315d948df9eda910f205646c3'} {{(pid=128861) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:57:43.692176 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bbcbbae6-76cb-4ce7-8a71-84c4daaecf90 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:43.692980 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bbcbbae6-76cb-4ce7-8a71-84c4daaecf90 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:43.694027 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bbcbbae6-76cb-4ce7-8a71-84c4daaecf90 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:43.696310 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bbcbbae6-76cb-4ce7-8a71-84c4daaecf90 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:43.697353 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bbcbbae6-76cb-4ce7-8a71-84c4daaecf90 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:43.698072 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bbcbbae6-76cb-4ce7-8a71-84c4daaecf90 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:43.821857 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.multi_cell_list [None req-bbcbbae6-76cb-4ce7-8a71-84c4daaecf90 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128861) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 10:57:43.940531 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-bbcbbae6-76cb-4ce7-8a71-84c4daaecf90 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a779e85e1c493985f7cfe8aceb9c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4478d0e315d948df9eda910f205646c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:43.961823 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bbcbbae6-76cb-4ce7-8a71-84c4daaecf90 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:43.962661 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bbcbbae6-76cb-4ce7-8a71-84c4daaecf90 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:43.963587 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bbcbbae6-76cb-4ce7-8a71-84c4daaecf90 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:44.319501 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-079f44df-0b97-487f-990b-5afb67472275 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:44.350383 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-079f44df-0b97-487f-990b-5afb67472275 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/fafff8cb-0e6f-4243-a91c-ec559f656880" status: 200 len: 1522 microversion: 2.1 time: 0.775215 Sep 08 10:57:44.354605 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2147/4362] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:43 2022] GET /compute/v2.1/servers/fafff8cb-0e6f-4243-a91c-ec559f656880 => generated 1522 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:44.382258 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-12560b40-e414-43b2-ad1c-5fb7b3441611 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:44.384074 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-12560b40-e414-43b2-ad1c-5fb7b3441611 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:44.402085 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12560b40-e414-43b2-ad1c-5fb7b3441611 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:44.404135 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12560b40-e414-43b2-ad1c-5fb7b3441611 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:44.406896 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12560b40-e414-43b2-ad1c-5fb7b3441611 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:44.409276 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12560b40-e414-43b2-ad1c-5fb7b3441611 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:44.412164 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12560b40-e414-43b2-ad1c-5fb7b3441611 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:44.415619 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12560b40-e414-43b2-ad1c-5fb7b3441611 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:44.804738 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bbcbbae6-76cb-4ce7-8a71-84c4daaecf90 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] 10.222.0.27 "GET /compute/v2.1/servers/detail" status: 200 len: 4517 microversion: 2.1 time: 1.144022 Sep 08 10:57:44.806964 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2216/4363] 10.222.0.27 () {58 vars in 1146 bytes} [Thu Sep 8 10:57:43 2022] GET /compute/v2.1/servers/detail => generated 4517 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:44.819091 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-dce72455-42c5-4922-b75c-6ca7e59838ae tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:57:44.823728 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-dce72455-42c5-4922-b75c-6ca7e59838ae tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 0115571c-32fa-40e9-8f32-fa4fcbc0fe86] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:44.848607 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-dce72455-42c5-4922-b75c-6ca7e59838ae tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] HTTP exception thrown: Instance 0115571c-32fa-40e9-8f32-fa4fcbc0fe86 could not be found. Sep 08 10:57:44.856012 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-dce72455-42c5-4922-b75c-6ca7e59838ae tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Request method failure captured: Sep 08 10:57:44.856012 n-d-850501-12 devstack@n-api.service[128861]: request: POST /compute/v2.1/servers/0115571c-32fa-40e9-8f32-fa4fcbc0fe86/action HTTP/1.1 Sep 08 10:57:44.856012 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:57:44.856012 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:57:44.856012 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:57:44.856012 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 18 Sep 08 10:57:44.856012 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:57:44.856012 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:57:44.856012 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:57:44.856012 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:57:44.856012 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcmnspi0cCT_Ts_s7jcB6HjtEcdULbQPd_krJniB9lBsXpm1cXSOD-YMaJoaapHCxuCXz0q6Qe4WXufr5At6SSPw8ov8Oz1eUk-fSNbVp7WlOPycfCf5I6xwH7tfbsoefVfbTiDOfU9mTBl0Vs74qdfTniErHfQlEG4cAvAQl1-wMrs Sep 08 10:57:44.856012 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:57:44.856012 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:57:44.856012 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:57:44.856012 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:57:44.856012 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:57:44.856012 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:57:44.856012 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:57:44.856012 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:57:44.856012 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:57:44.856012 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:57:44.856012 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:57:44.856012 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:57:44.856012 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:57:44.856012 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:57:44.856012 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:57:44.856012 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:57:44.856012 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:57:44.856012 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 7f551e6fe34243c290a25b57ab26af19 Sep 08 10:57:44.856012 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:57:44.856012 n-d-850501-12 devstack@n-api.service[128861]: Sep 08 10:57:44.856012 n-d-850501-12 devstack@n-api.service[128861]: {"unshelve": null} Sep 08 10:57:44.856012 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:57:44.856012 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 0115571c-32fa-40e9-8f32-fa4fcbc0fe86 could not be found. Sep 08 10:57:44.856012 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '0115571c-32fa-40e9-8f32-fa4fcbc0fe86', 'body': {'unshelve': None}} Sep 08 10:57:44.856012 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:57:44.856012 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:57:44.856012 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:57:44.856012 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:57:44.856012 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:57:44.856012 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:57:44.856012 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 08 10:57:44.856012 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 08 10:57:44.856012 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0115571c-32fa-40e9-8f32-fa4fcbc0fe86 could not be found. Sep 08 10:57:44.856012 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:57:44.856012 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:57:44.856012 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:57:44.856012 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:57:44.856012 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:57:44.856012 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:57:44.856012 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:57:44.856012 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:57:44.856012 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:57:44.856012 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:57:44.856012 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:57:44.856012 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:57:44.856012 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:57:44.856012 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:57:44.856012 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Sep 08 10:57:44.856012 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 08 10:57:44.856012 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:57:44.856012 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:57:44.856012 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0115571c-32fa-40e9-8f32-fa4fcbc0fe86 could not be found. Sep 08 10:57:44.856012 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:57:44.856012 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:57:44.861708 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:57:44.861708 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:57:44.861708 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:57:44.861708 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:57:44.861708 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:57:44.861708 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:57:44.861708 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0115571c-32fa-40e9-8f32-fa4fcbc0fe86 could not be found. Sep 08 10:57:44.861708 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:57:44.867500 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-dce72455-42c5-4922-b75c-6ca7e59838ae tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Returning 404 to user: Instance 0115571c-32fa-40e9-8f32-fa4fcbc0fe86 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:57:44.869698 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-dce72455-42c5-4922-b75c-6ca7e59838ae tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "POST /compute/v2.1/servers/0115571c-32fa-40e9-8f32-fa4fcbc0fe86/action" status: 404 len: 111 microversion: 2.1 time: 0.061091 Sep 08 10:57:44.872160 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2217/4364] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:57:44 2022] POST /compute/v2.1/servers/0115571c-32fa-40e9-8f32-fa4fcbc0fe86/action => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:57:44.891640 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-57bb1541-fd0d-46e5-837f-612835f2afa2 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:44.949075 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-57bb1541-fd0d-46e5-837f-612835f2afa2 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '06a779e85e1c493985f7cfe8aceb9c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4478d0e315d948df9eda910f205646c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:44.953279 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-57bb1541-fd0d-46e5-837f-612835f2afa2 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '4478d0e315d948df9eda910f205646c3'} {{(pid=128861) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:57:44.973193 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-12560b40-e414-43b2-ad1c-5fb7b3441611 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:44.991825 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-12560b40-e414-43b2-ad1c-5fb7b3441611 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1671 microversion: 2.1 time: 0.636142 Sep 08 10:57:45.009085 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2148/4365] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:44 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1671 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:45.011262 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-aff74c4e-1f9c-44fe-b2dd-f14c162c08c7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:45.016972 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-aff74c4e-1f9c-44fe-b2dd-f14c162c08c7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:45.044255 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aff74c4e-1f9c-44fe-b2dd-f14c162c08c7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:45.044940 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aff74c4e-1f9c-44fe-b2dd-f14c162c08c7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:45.045506 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aff74c4e-1f9c-44fe-b2dd-f14c162c08c7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:45.047755 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aff74c4e-1f9c-44fe-b2dd-f14c162c08c7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:45.048351 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aff74c4e-1f9c-44fe-b2dd-f14c162c08c7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:45.050462 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aff74c4e-1f9c-44fe-b2dd-f14c162c08c7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:45.145793 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-57bb1541-fd0d-46e5-837f-612835f2afa2 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:45.146632 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-57bb1541-fd0d-46e5-837f-612835f2afa2 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:45.147392 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-57bb1541-fd0d-46e5-837f-612835f2afa2 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:45.149805 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-57bb1541-fd0d-46e5-837f-612835f2afa2 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:45.150636 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-57bb1541-fd0d-46e5-837f-612835f2afa2 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:45.151404 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-57bb1541-fd0d-46e5-837f-612835f2afa2 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:45.270534 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.multi_cell_list [None req-57bb1541-fd0d-46e5-837f-612835f2afa2 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128861) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 10:57:45.407330 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-57bb1541-fd0d-46e5-837f-612835f2afa2 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] 10.222.0.27 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1011 microversion: 2.1 time: 0.531777 Sep 08 10:57:45.421051 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2218/4366] 10.222.0.27 () {58 vars in 1150 bytes} [Thu Sep 8 10:57:44 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1011 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:45.438468 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2c76e435-8faa-4618-b9df-62debfa0f43c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:45.439352 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2c76e435-8faa-4618-b9df-62debfa0f43c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:45.468209 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2c76e435-8faa-4618-b9df-62debfa0f43c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:45.468730 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2c76e435-8faa-4618-b9df-62debfa0f43c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:45.469212 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2c76e435-8faa-4618-b9df-62debfa0f43c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:45.469947 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2c76e435-8faa-4618-b9df-62debfa0f43c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:45.470413 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2c76e435-8faa-4618-b9df-62debfa0f43c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:45.470843 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2c76e435-8faa-4618-b9df-62debfa0f43c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:45.546383 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:57:45.976307 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2c76e435-8faa-4618-b9df-62debfa0f43c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:46.016064 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2c76e435-8faa-4618-b9df-62debfa0f43c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1671 microversion: 2.1 time: 0.605540 Sep 08 10:57:46.018225 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2219/4367] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:45 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1671 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:46.026718 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a63fdb5d-da55-4ddb-ac35-fe22fec5e1b1 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:46.027803 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a63fdb5d-da55-4ddb-ac35-fe22fec5e1b1 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: fafff8cb-0e6f-4243-a91c-ec559f656880] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:46.044280 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a63fdb5d-da55-4ddb-ac35-fe22fec5e1b1 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:46.047669 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a63fdb5d-da55-4ddb-ac35-fe22fec5e1b1 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:46.049737 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a63fdb5d-da55-4ddb-ac35-fe22fec5e1b1 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:46.052319 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a63fdb5d-da55-4ddb-ac35-fe22fec5e1b1 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:46.057210 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a63fdb5d-da55-4ddb-ac35-fe22fec5e1b1 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:46.058557 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a63fdb5d-da55-4ddb-ac35-fe22fec5e1b1 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:46.187625 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-aff74c4e-1f9c-44fe-b2dd-f14c162c08c7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:46.214494 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-aff74c4e-1f9c-44fe-b2dd-f14c162c08c7 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 1.214760 Sep 08 10:57:46.216439 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2149/4368] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:44 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:46.254255 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-04acbd21-d3a8-4cea-a0ca-d68cd912abd4 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:46.282936 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-04acbd21-d3a8-4cea-a0ca-d68cd912abd4 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '06a779e85e1c493985f7cfe8aceb9c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4478d0e315d948df9eda910f205646c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:46.284808 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-04acbd21-d3a8-4cea-a0ca-d68cd912abd4 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '4478d0e315d948df9eda910f205646c3'} {{(pid=128862) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:57:46.302584 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04acbd21-d3a8-4cea-a0ca-d68cd912abd4 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:46.305367 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04acbd21-d3a8-4cea-a0ca-d68cd912abd4 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:46.308649 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04acbd21-d3a8-4cea-a0ca-d68cd912abd4 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:46.309585 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04acbd21-d3a8-4cea-a0ca-d68cd912abd4 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:46.310896 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04acbd21-d3a8-4cea-a0ca-d68cd912abd4 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:46.313421 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04acbd21-d3a8-4cea-a0ca-d68cd912abd4 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:46.813934 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.multi_cell_list [None req-04acbd21-d3a8-4cea-a0ca-d68cd912abd4 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128862) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 10:57:47.043442 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-04acbd21-d3a8-4cea-a0ca-d68cd912abd4 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] 10.222.0.27 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1011 microversion: 2.1 time: 0.820688 Sep 08 10:57:47.045840 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2150/4369] 10.222.0.27 () {58 vars in 1212 bytes} [Thu Sep 8 10:57:46 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1011 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:47.078362 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9b6a8f96-9594-4062-84e7-96f65ca8cafe tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:47.081190 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9b6a8f96-9594-4062-84e7-96f65ca8cafe tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:47.096664 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9b6a8f96-9594-4062-84e7-96f65ca8cafe tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:47.097352 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9b6a8f96-9594-4062-84e7-96f65ca8cafe tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:47.103455 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9b6a8f96-9594-4062-84e7-96f65ca8cafe tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:47.105047 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9b6a8f96-9594-4062-84e7-96f65ca8cafe tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:47.105976 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9b6a8f96-9594-4062-84e7-96f65ca8cafe tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:47.112090 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9b6a8f96-9594-4062-84e7-96f65ca8cafe tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:47.143557 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:57:47.189718 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a63fdb5d-da55-4ddb-ac35-fe22fec5e1b1 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f487f5d062e4ac3bf21c2416a7b50ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33063b3b9e0543369c28ea918f52cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:47.257900 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a63fdb5d-da55-4ddb-ac35-fe22fec5e1b1 tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/fafff8cb-0e6f-4243-a91c-ec559f656880" status: 200 len: 1522 microversion: 2.1 time: 1.235679 Sep 08 10:57:47.259496 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2220/4370] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:46 2022] GET /compute/v2.1/servers/fafff8cb-0e6f-4243-a91c-ec559f656880 => generated 1522 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:47.292702 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-00ff72fd-016a-4713-8e40-648254844117 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:47.295167 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-00ff72fd-016a-4713-8e40-648254844117 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:47.307624 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-00ff72fd-016a-4713-8e40-648254844117 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:47.308748 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-00ff72fd-016a-4713-8e40-648254844117 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:47.310102 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-00ff72fd-016a-4713-8e40-648254844117 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:47.311773 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-00ff72fd-016a-4713-8e40-648254844117 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:47.312906 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-00ff72fd-016a-4713-8e40-648254844117 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:47.313895 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-00ff72fd-016a-4713-8e40-648254844117 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:47.606757 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9b6a8f96-9594-4062-84e7-96f65ca8cafe tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:47.624671 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9b6a8f96-9594-4062-84e7-96f65ca8cafe tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1671 microversion: 2.1 time: 0.576292 Sep 08 10:57:47.634127 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2151/4371] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:47 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1671 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:47.644939 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-ef13bd7c-6fe4-4994-a42e-28d5d9a708c5 req-a9588960-d3f4-4e81-b69b-397e60213281 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fafff8cb-0e6f-4243-a91c-ec559f656880", "name": "network-vif-deleted", "tag": "e1da214d-9efc-406e-bdeb-34180a49fc95"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:57:47.672606 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ef13bd7c-6fe4-4994-a42e-28d5d9a708c5 req-a9588960-d3f4-4e81-b69b-397e60213281 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:47.680780 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ef13bd7c-6fe4-4994-a42e-28d5d9a708c5 req-a9588960-d3f4-4e81-b69b-397e60213281 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:47.681752 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ef13bd7c-6fe4-4994-a42e-28d5d9a708c5 req-a9588960-d3f4-4e81-b69b-397e60213281 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:47.719938 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-ef13bd7c-6fe4-4994-a42e-28d5d9a708c5 req-a9588960-d3f4-4e81-b69b-397e60213281 service nova] Creating event network-vif-deleted:e1da214d-9efc-406e-bdeb-34180a49fc95 for instance fafff8cb-0e6f-4243-a91c-ec559f656880 on n-h2-850501-12 Sep 08 10:57:47.729712 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-ef13bd7c-6fe4-4994-a42e-28d5d9a708c5 req-a9588960-d3f4-4e81-b69b-397e60213281 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093697 Sep 08 10:57:47.737931 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2152/4372] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:57:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:57:47.750778 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ae2a7c2d-2895-4824-b2a8-3140ae877bc1 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:47.759031 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ae2a7c2d-2895-4824-b2a8-3140ae877bc1 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '06a779e85e1c493985f7cfe8aceb9c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4478d0e315d948df9eda910f205646c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:47.760211 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ae2a7c2d-2895-4824-b2a8-3140ae877bc1 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '4478d0e315d948df9eda910f205646c3'} {{(pid=128862) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:57:47.768971 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae2a7c2d-2895-4824-b2a8-3140ae877bc1 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:47.770080 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae2a7c2d-2895-4824-b2a8-3140ae877bc1 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:47.770730 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae2a7c2d-2895-4824-b2a8-3140ae877bc1 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:47.771549 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae2a7c2d-2895-4824-b2a8-3140ae877bc1 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:47.772082 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae2a7c2d-2895-4824-b2a8-3140ae877bc1 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:47.772496 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae2a7c2d-2895-4824-b2a8-3140ae877bc1 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:47.933693 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.multi_cell_list [None req-ae2a7c2d-2895-4824-b2a8-3140ae877bc1 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128862) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 10:57:48.026427 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ae2a7c2d-2895-4824-b2a8-3140ae877bc1 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] 10.222.0.27 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1011 microversion: 2.1 time: 0.285752 Sep 08 10:57:48.027999 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2153/4373] 10.222.0.27 () {58 vars in 1196 bytes} [Thu Sep 8 10:57:47 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1011 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:48.037820 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-261b7c5b-8622-42cc-b8aa-59db127c5dd1 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:57:48.041329 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-261b7c5b-8622-42cc-b8aa-59db127c5dd1 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:48.053420 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-00ff72fd-016a-4713-8e40-648254844117 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:48.053655 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-261b7c5b-8622-42cc-b8aa-59db127c5dd1 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:48.055180 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-261b7c5b-8622-42cc-b8aa-59db127c5dd1 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:48.056817 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-261b7c5b-8622-42cc-b8aa-59db127c5dd1 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:48.057632 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-261b7c5b-8622-42cc-b8aa-59db127c5dd1 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:48.058310 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-261b7c5b-8622-42cc-b8aa-59db127c5dd1 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:48.058701 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-261b7c5b-8622-42cc-b8aa-59db127c5dd1 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:48.065836 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-00ff72fd-016a-4713-8e40-648254844117 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 0.797687 Sep 08 10:57:48.067698 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2221/4374] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:47 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:48.081222 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a5138404-1ecf-4a21-a69f-0053933865d3 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:48.088569 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a5138404-1ecf-4a21-a69f-0053933865d3 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '06a779e85e1c493985f7cfe8aceb9c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4478d0e315d948df9eda910f205646c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:48.089584 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a5138404-1ecf-4a21-a69f-0053933865d3 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Searching by: {'name': '1975568299', 'deleted': False, 'project_id': '4478d0e315d948df9eda910f205646c3'} {{(pid=128861) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:57:48.096061 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a5138404-1ecf-4a21-a69f-0053933865d3 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:48.096869 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a5138404-1ecf-4a21-a69f-0053933865d3 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:48.097728 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a5138404-1ecf-4a21-a69f-0053933865d3 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:48.098543 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a5138404-1ecf-4a21-a69f-0053933865d3 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:48.102595 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a5138404-1ecf-4a21-a69f-0053933865d3 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:48.103560 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a5138404-1ecf-4a21-a69f-0053933865d3 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:48.281694 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-261b7c5b-8622-42cc-b8aa-59db127c5dd1 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "POST /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7/action" status: 202 len: 0 microversion: 2.1 time: 0.249109 Sep 08 10:57:48.288218 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2154/4375] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:57:48 2022] POST /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:57:48.306363 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0f7115d0-1fd2-4334-ad09-6cd148c65fca tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:57:48.308707 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0f7115d0-1fd2-4334-ad09-6cd148c65fca tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:48.330768 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f7115d0-1fd2-4334-ad09-6cd148c65fca tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:48.334889 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f7115d0-1fd2-4334-ad09-6cd148c65fca tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:48.335876 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f7115d0-1fd2-4334-ad09-6cd148c65fca tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:48.341705 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f7115d0-1fd2-4334-ad09-6cd148c65fca tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:48.343243 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f7115d0-1fd2-4334-ad09-6cd148c65fca tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:48.344684 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f7115d0-1fd2-4334-ad09-6cd148c65fca tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:48.418071 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-0f7115d0-1fd2-4334-ad09-6cd148c65fca tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] HTTP exception thrown: Cannot 'unshelve' instance 74eebde7-4328-4ddf-be14-bb9fba70ec03 while it is in vm_state active Sep 08 10:57:48.420760 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0f7115d0-1fd2-4334-ad09-6cd148c65fca tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Request method failure captured: Sep 08 10:57:48.420760 n-d-850501-12 devstack@n-api.service[128862]: request: POST /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03/action HTTP/1.1 Sep 08 10:57:48.420760 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:57:48.420760 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:57:48.420760 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:57:48.420760 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 18 Sep 08 10:57:48.420760 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:57:48.420760 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:57:48.420760 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:57:48.420760 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:57:48.420760 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcmnspi0cCT_Ts_s7jcB6HjtEcdULbQPd_krJniB9lBsXpm1cXSOD-YMaJoaapHCxuCXz0q6Qe4WXufr5At6SSPw8ov8Oz1eUk-fSNbVp7WlOPycfCf5I6xwH7tfbsoefVfbTiDOfU9mTBl0Vs74qdfTniErHfQlEG4cAvAQl1-wMrs Sep 08 10:57:48.420760 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:57:48.420760 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:57:48.420760 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:57:48.420760 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:57:48.420760 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:57:48.420760 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:57:48.420760 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:57:48.420760 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:57:48.420760 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:57:48.420760 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:57:48.420760 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:57:48.420760 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:57:48.420760 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:57:48.420760 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:57:48.420760 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:57:48.420760 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:57:48.420760 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:57:48.420760 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 7f551e6fe34243c290a25b57ab26af19 Sep 08 10:57:48.420760 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:57:48.420760 n-d-850501-12 devstack@n-api.service[128862]: Sep 08 10:57:48.420760 n-d-850501-12 devstack@n-api.service[128862]: {"unshelve": null} Sep 08 10:57:48.420760 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:57:48.420760 n-d-850501-12 devstack@n-api.service[128862]: exception: Cannot 'unshelve' instance 74eebde7-4328-4ddf-be14-bb9fba70ec03 while it is in vm_state active Sep 08 10:57:48.420760 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '74eebde7-4328-4ddf-be14-bb9fba70ec03', 'body': {'unshelve': None}} Sep 08 10:57:48.420760 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:57:48.420760 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:57:48.420760 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Sep 08 10:57:48.420760 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Sep 08 10:57:48.420760 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 08 10:57:48.420760 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 10:57:48.420760 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 10:57:48.420760 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 10:57:48.420760 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 08 10:57:48.420760 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 08 10:57:48.420760 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 74eebde7-4328-4ddf-be14-bb9fba70ec03 in vm_state active. Cannot unshelve while the instance is in this state. Sep 08 10:57:48.420760 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:57:48.420760 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:57:48.420760 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:57:48.420760 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:57:48.420760 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:57:48.420760 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:57:48.420760 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:57:48.420760 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:57:48.420760 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:57:48.420760 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:57:48.420760 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:57:48.420760 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:57:48.420760 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:57:48.420760 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:57:48.420760 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Sep 08 10:57:48.420760 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Sep 08 10:57:48.420760 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 08 10:57:48.420760 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 08 10:57:48.428062 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 74eebde7-4328-4ddf-be14-bb9fba70ec03 while it is in vm_state active Sep 08 10:57:48.428062 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:57:48.428062 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:57:48.428062 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:57:48.428062 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:57:48.428062 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:57:48.428062 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:57:48.428062 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:57:48.428062 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:57:48.428062 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 74eebde7-4328-4ddf-be14-bb9fba70ec03 while it is in vm_state active Sep 08 10:57:48.428062 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:57:48.428062 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0f7115d0-1fd2-4334-ad09-6cd148c65fca tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Returning 409 to user: Cannot 'unshelve' instance 74eebde7-4328-4ddf-be14-bb9fba70ec03 while it is in vm_state active {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:57:48.428062 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0f7115d0-1fd2-4334-ad09-6cd148c65fca tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "POST /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03/action" status: 409 len: 146 microversion: 2.1 time: 0.132394 Sep 08 10:57:48.429119 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2155/4376] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:57:48 2022] POST /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03/action => generated 146 bytes in 139 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:57:48.431755 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.multi_cell_list [None req-a5138404-1ecf-4a21-a69f-0053933865d3 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128861) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 10:57:48.435580 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7c40ecc0-b964-4bed-bf26-4b845196378c tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:48.457339 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7c40ecc0-b964-4bed-bf26-4b845196378c tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] [instance: fafff8cb-0e6f-4243-a91c-ec559f656880] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:48.469699 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c40ecc0-b964-4bed-bf26-4b845196378c tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:48.470933 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c40ecc0-b964-4bed-bf26-4b845196378c tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:48.472201 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c40ecc0-b964-4bed-bf26-4b845196378c tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:48.474395 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c40ecc0-b964-4bed-bf26-4b845196378c tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:48.475528 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c40ecc0-b964-4bed-bf26-4b845196378c tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:48.478936 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c40ecc0-b964-4bed-bf26-4b845196378c tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:48.514613 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-7c40ecc0-b964-4bed-bf26-4b845196378c tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] HTTP exception thrown: Instance fafff8cb-0e6f-4243-a91c-ec559f656880 could not be found. Sep 08 10:57:48.516490 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7c40ecc0-b964-4bed-bf26-4b845196378c tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Request method failure captured: Sep 08 10:57:48.516490 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/fafff8cb-0e6f-4243-a91c-ec559f656880 HTTP/1.1 Sep 08 10:57:48.516490 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:57:48.516490 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:57:48.516490 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:57:48.516490 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:57:48.516490 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:57:48.516490 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:57:48.516490 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:57:48.516490 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:57:48.516490 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGclZnrdHbcSspe2CSaO_gA2LIWMGtHJAKVo_u3dlzxs9JxAXcXCwrL-z-q8SJvnWUnwIz6KxjkLXp0jFFwIV3x5Qp_zUHQKWEwS-EZKwoM8W4-UxwLeQWJTnQ9cWOYmTzHY9djf2pYmuh6sOSJJezx_5s2ElCgN_L-D4iql7Pg9xGj8 Sep 08 10:57:48.516490 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:57:48.516490 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:57:48.516490 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:57:48.516490 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:57:48.516490 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:57:48.516490 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:57:48.516490 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 33063b3b9e0543369c28ea918f52cf37 Sep 08 10:57:48.516490 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1820338337 Sep 08 10:57:48.516490 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:57:48.516490 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:57:48.516490 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/33063b3b9e0543369c28ea918f52cf37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/33063b3b9e0543369c28ea918f52cf37"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_33063b3b9e0543369c28ea918f52cf37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/33063b3b9e0543369c28ea918f52cf37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:57:48.516490 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1820338337 Sep 08 10:57:48.516490 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 33063b3b9e0543369c28ea918f52cf37 Sep 08 10:57:48.516490 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1820338337 Sep 08 10:57:48.516490 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServerRescueNegativeTestJSON-1820338337-project Sep 08 10:57:48.516490 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:57:48.516490 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:57:48.516490 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 8f487f5d062e4ac3bf21c2416a7b50ee Sep 08 10:57:48.516490 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1820338337-project Sep 08 10:57:48.516490 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:57:48.516490 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance fafff8cb-0e6f-4243-a91c-ec559f656880 could not be found. Sep 08 10:57:48.516490 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'fafff8cb-0e6f-4243-a91c-ec559f656880'} Sep 08 10:57:48.516490 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:57:48.516490 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:57:48.516490 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:57:48.516490 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:57:48.516490 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:57:48.516490 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:57:48.516490 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:57:48.516490 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:57:48.516490 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:57:48.516490 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:57:48.516490 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fafff8cb-0e6f-4243-a91c-ec559f656880 could not be found. Sep 08 10:57:48.516490 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:57:48.516490 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:57:48.516490 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:57:48.516490 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:57:48.516490 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:57:48.516490 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:57:48.516490 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:57:48.516490 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:57:48.516490 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:57:48.516490 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:57:48.516490 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:57:48.516490 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:57:48.516490 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:57:48.516490 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:57:48.516490 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:57:48.516490 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:57:48.516490 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fafff8cb-0e6f-4243-a91c-ec559f656880 could not be found. Sep 08 10:57:48.516490 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:57:48.516490 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:57:48.524094 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:57:48.524094 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:57:48.524094 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:57:48.524094 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:57:48.524094 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:57:48.524094 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:57:48.524094 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fafff8cb-0e6f-4243-a91c-ec559f656880 could not be found. Sep 08 10:57:48.524094 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:57:48.526203 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7c40ecc0-b964-4bed-bf26-4b845196378c tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] Returning 404 to user: Instance fafff8cb-0e6f-4243-a91c-ec559f656880 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:57:48.527338 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7c40ecc0-b964-4bed-bf26-4b845196378c tempest-ServerRescueNegativeTestJSON-1820338337 tempest-ServerRescueNegativeTestJSON-1820338337-project] 10.222.0.27 "GET /compute/v2.1/servers/fafff8cb-0e6f-4243-a91c-ec559f656880" status: 404 len: 111 microversion: 2.1 time: 0.097626 Sep 08 10:57:48.532789 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2156/4377] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:48 2022] GET /compute/v2.1/servers/fafff8cb-0e6f-4243-a91c-ec559f656880 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:57:48.539027 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f28e55a5-5e0a-4d84-b419-c6fa4cd91dd6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:48.544855 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f28e55a5-5e0a-4d84-b419-c6fa4cd91dd6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:48.564311 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f28e55a5-5e0a-4d84-b419-c6fa4cd91dd6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:48.565402 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f28e55a5-5e0a-4d84-b419-c6fa4cd91dd6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:48.566164 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f28e55a5-5e0a-4d84-b419-c6fa4cd91dd6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:48.567472 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f28e55a5-5e0a-4d84-b419-c6fa4cd91dd6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:48.569496 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f28e55a5-5e0a-4d84-b419-c6fa4cd91dd6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:48.570454 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f28e55a5-5e0a-4d84-b419-c6fa4cd91dd6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:48.711911 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a5138404-1ecf-4a21-a69f-0053933865d3 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] 10.222.0.27 "GET /compute/v2.1/servers?name=1975568299" status: 200 len: 346 microversion: 2.1 time: 0.642115 Sep 08 10:57:48.730317 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2222/4378] 10.222.0.27 () {58 vars in 1156 bytes} [Thu Sep 8 10:57:48 2022] GET /compute/v2.1/servers?name=1975568299 => generated 346 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:57:48.741519 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6f9fc318-89a2-44d0-a481-414073ec9374 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:48.742661 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6f9fc318-89a2-44d0-a481-414073ec9374 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:48.749721 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6f9fc318-89a2-44d0-a481-414073ec9374 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:48.750177 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6f9fc318-89a2-44d0-a481-414073ec9374 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:48.751709 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6f9fc318-89a2-44d0-a481-414073ec9374 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:48.752880 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6f9fc318-89a2-44d0-a481-414073ec9374 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:48.753568 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6f9fc318-89a2-44d0-a481-414073ec9374 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:48.754149 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6f9fc318-89a2-44d0-a481-414073ec9374 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:49.135075 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6f9fc318-89a2-44d0-a481-414073ec9374 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:49.144828 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6f9fc318-89a2-44d0-a481-414073ec9374 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 0.412919 Sep 08 10:57:49.145424 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2223/4379] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:48 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:49.425895 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f28e55a5-5e0a-4d84-b419-c6fa4cd91dd6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:49.448246 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f28e55a5-5e0a-4d84-b419-c6fa4cd91dd6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1676 microversion: 2.1 time: 0.913953 Sep 08 10:57:49.453527 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2157/4380] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:48 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1676 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:49.468297 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8d5fd879-89ce-44aa-a8cc-71673d6eba49 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:49.483833 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8d5fd879-89ce-44aa-a8cc-71673d6eba49 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '06a779e85e1c493985f7cfe8aceb9c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4478d0e315d948df9eda910f205646c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:49.487082 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8d5fd879-89ce-44aa-a8cc-71673d6eba49 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '4478d0e315d948df9eda910f205646c3'} {{(pid=128862) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:57:49.500741 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d5fd879-89ce-44aa-a8cc-71673d6eba49 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:49.501410 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d5fd879-89ce-44aa-a8cc-71673d6eba49 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:49.503073 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d5fd879-89ce-44aa-a8cc-71673d6eba49 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:49.503988 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d5fd879-89ce-44aa-a8cc-71673d6eba49 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:49.505230 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d5fd879-89ce-44aa-a8cc-71673d6eba49 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:49.507269 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d5fd879-89ce-44aa-a8cc-71673d6eba49 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:49.557154 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5d2867b3-7262-4414-8bac-a3d45b8ee5e6 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1575680093", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "dc0a3241-15d1-4554-8d50-4b00e666d5ea"}]}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:57:49.743498 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-5d2867b3-7262-4414-8bac-a3d45b8ee5e6 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] validate_networks() for [('dc0a3241-15d1-4554-8d50-4b00e666d5ea', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:57:49.807735 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.multi_cell_list [None req-8d5fd879-89ce-44aa-a8cc-71673d6eba49 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128862) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 10:57:50.011487 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8d5fd879-89ce-44aa-a8cc-71673d6eba49 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] 10.222.0.27 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1011 microversion: 2.1 time: 0.556080 Sep 08 10:57:50.013484 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2158/4381] 10.222.0.27 () {58 vars in 1154 bytes} [Thu Sep 8 10:57:49 2022] GET /compute/v2.1/servers?name=-instance => generated 1011 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:50.024856 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c8e35226-69cd-4008-bf67-8857fb554de8 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:50.027285 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c8e35226-69cd-4008-bf67-8857fb554de8 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:50.040347 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c8e35226-69cd-4008-bf67-8857fb554de8 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:50.041932 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c8e35226-69cd-4008-bf67-8857fb554de8 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:50.043254 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c8e35226-69cd-4008-bf67-8857fb554de8 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:50.045243 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c8e35226-69cd-4008-bf67-8857fb554de8 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:50.046227 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c8e35226-69cd-4008-bf67-8857fb554de8 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:50.047499 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c8e35226-69cd-4008-bf67-8857fb554de8 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:50.754906 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-5d2867b3-7262-4414-8bac-a3d45b8ee5e6 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:57:50.758365 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-5d2867b3-7262-4414-8bac-a3d45b8ee5e6 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:57:50.760104 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-5d2867b3-7262-4414-8bac-a3d45b8ee5e6 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:57:50.760858 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-5d2867b3-7262-4414-8bac-a3d45b8ee5e6 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:57:50.761512 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-5d2867b3-7262-4414-8bac-a3d45b8ee5e6 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:57:50.792896 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c8e35226-69cd-4008-bf67-8857fb554de8 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:50.823451 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5d2867b3-7262-4414-8bac-a3d45b8ee5e6 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:50.823950 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5d2867b3-7262-4414-8bac-a3d45b8ee5e6 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:50.829837 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5d2867b3-7262-4414-8bac-a3d45b8ee5e6 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:50.833546 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5d2867b3-7262-4414-8bac-a3d45b8ee5e6 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:50.834945 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c8e35226-69cd-4008-bf67-8857fb554de8 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 0.818342 Sep 08 10:57:50.853557 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5d2867b3-7262-4414-8bac-a3d45b8ee5e6 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:50.855423 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2159/4382] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:50 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:50.856862 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5d2867b3-7262-4414-8bac-a3d45b8ee5e6 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:50.875104 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2aee6360-a71d-4dc6-aabb-7a7fdc6becd3 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:50.897895 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2aee6360-a71d-4dc6-aabb-7a7fdc6becd3 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '06a779e85e1c493985f7cfe8aceb9c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4478d0e315d948df9eda910f205646c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:50.899659 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2aee6360-a71d-4dc6-aabb-7a7fdc6becd3 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-197556829', 'deleted': False, 'project_id': '4478d0e315d948df9eda910f205646c3'} {{(pid=128862) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:57:50.921113 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2aee6360-a71d-4dc6-aabb-7a7fdc6becd3 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:50.922379 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-5d2867b3-7262-4414-8bac-a3d45b8ee5e6 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Getting quotas for project def11bb6a39848a5855a6c8534b5edba. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:57:50.925099 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2aee6360-a71d-4dc6-aabb-7a7fdc6becd3 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:50.925819 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2aee6360-a71d-4dc6-aabb-7a7fdc6becd3 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:50.928593 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2aee6360-a71d-4dc6-aabb-7a7fdc6becd3 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:50.934208 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2aee6360-a71d-4dc6-aabb-7a7fdc6becd3 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:50.936108 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2aee6360-a71d-4dc6-aabb-7a7fdc6becd3 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:50.941682 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-5d2867b3-7262-4414-8bac-a3d45b8ee5e6 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Getting quotas for user 886104e81be14c18a30b75facfcf246e and project def11bb6a39848a5855a6c8534b5edba. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:57:50.991685 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5d2867b3-7262-4414-8bac-a3d45b8ee5e6 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:57:50.995713 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5d2867b3-7262-4414-8bac-a3d45b8ee5e6 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: 82458f68-8fcf-4d1f-8e7b-87d76f3576ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:57:51.078692 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5d2867b3-7262-4414-8bac-a3d45b8ee5e6 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.918418 Sep 08 10:57:51.088407 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2224/4383] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:57:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1929 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:57:51.093587 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c4b3005e-4206-4cb6-858a-e30b6be7d663 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:51.096174 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c4b3005e-4206-4cb6-858a-e30b6be7d663 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:51.109843 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c4b3005e-4206-4cb6-858a-e30b6be7d663 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:51.110410 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c4b3005e-4206-4cb6-858a-e30b6be7d663 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:51.110867 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c4b3005e-4206-4cb6-858a-e30b6be7d663 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:51.111599 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c4b3005e-4206-4cb6-858a-e30b6be7d663 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:51.112067 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c4b3005e-4206-4cb6-858a-e30b6be7d663 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:51.112501 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c4b3005e-4206-4cb6-858a-e30b6be7d663 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:51.133042 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.multi_cell_list [None req-2aee6360-a71d-4dc6-aabb-7a7fdc6becd3 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128862) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 10:57:51.236065 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2aee6360-a71d-4dc6-aabb-7a7fdc6becd3 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] 10.222.0.27 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-197556829" status: 200 len: 346 microversion: 2.1 time: 0.377635 Sep 08 10:57:51.237013 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2160/4384] 10.222.0.27 () {58 vars in 1228 bytes} [Thu Sep 8 10:57:50 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-197556829 => generated 346 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:57:51.245145 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2efcd259-bc63-445b-9c26-50aec01cc561 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1974051519_updated"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:57:51.247940 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2efcd259-bc63-445b-9c26-50aec01cc561 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: f34f89ac-1d25-43c0-a4b0-c92ca88eb929] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:51.255544 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-2efcd259-bc63-445b-9c26-50aec01cc561 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] HTTP exception thrown: Instance f34f89ac-1d25-43c0-a4b0-c92ca88eb929 could not be found. Sep 08 10:57:51.258397 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2efcd259-bc63-445b-9c26-50aec01cc561 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Request method failure captured: Sep 08 10:57:51.258397 n-d-850501-12 devstack@n-api.service[128862]: request: PUT /compute/v2.1/servers/f34f89ac-1d25-43c0-a4b0-c92ca88eb929 HTTP/1.1 Sep 08 10:57:51.258397 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:57:51.258397 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:57:51.258397 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:57:51.258397 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 81 Sep 08 10:57:51.258397 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:57:51.258397 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:57:51.258397 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:57:51.258397 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:57:51.258397 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcmnspi0cCT_Ts_s7jcB6HjtEcdULbQPd_krJniB9lBsXpm1cXSOD-YMaJoaapHCxuCXz0q6Qe4WXufr5At6SSPw8ov8Oz1eUk-fSNbVp7WlOPycfCf5I6xwH7tfbsoefVfbTiDOfU9mTBl0Vs74qdfTniErHfQlEG4cAvAQl1-wMrs Sep 08 10:57:51.258397 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:57:51.258397 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:57:51.258397 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:57:51.258397 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:57:51.258397 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:57:51.258397 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:57:51.258397 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:57:51.258397 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:57:51.258397 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:57:51.258397 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:57:51.258397 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:57:51.258397 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:57:51.258397 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:57:51.258397 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:57:51.258397 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:57:51.258397 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:57:51.258397 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:57:51.258397 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 7f551e6fe34243c290a25b57ab26af19 Sep 08 10:57:51.258397 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:57:51.258397 n-d-850501-12 devstack@n-api.service[128862]: Sep 08 10:57:51.258397 n-d-850501-12 devstack@n-api.service[128862]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1974051519_updated"}} Sep 08 10:57:51.258397 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:57:51.258397 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance f34f89ac-1d25-43c0-a4b0-c92ca88eb929 could not be found. Sep 08 10:57:51.258397 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'f34f89ac-1d25-43c0-a4b0-c92ca88eb929', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1974051519_updated'}}} Sep 08 10:57:51.258397 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:57:51.258397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:57:51.258397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:57:51.258397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:57:51.258397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:57:51.258397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:57:51.258397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 08 10:57:51.258397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 08 10:57:51.258397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f34f89ac-1d25-43c0-a4b0-c92ca88eb929 could not be found. Sep 08 10:57:51.258397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:57:51.258397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:57:51.258397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:57:51.258397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:57:51.258397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:57:51.258397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:57:51.258397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:57:51.258397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:57:51.258397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:57:51.258397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:57:51.258397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:57:51.258397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:57:51.258397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:57:51.258397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:57:51.258397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:57:51.258397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:57:51.258397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 08 10:57:51.258397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Sep 08 10:57:51.258397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Sep 08 10:57:51.258397 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:57:51.262842 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:57:51.262842 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:57:51.262842 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:57:51.262842 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f34f89ac-1d25-43c0-a4b0-c92ca88eb929 could not be found. Sep 08 10:57:51.262842 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:57:51.262842 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:57:51.262842 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:57:51.262842 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:57:51.262842 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:57:51.262842 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:57:51.262842 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:57:51.262842 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:57:51.262842 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f34f89ac-1d25-43c0-a4b0-c92ca88eb929 could not be found. Sep 08 10:57:51.262842 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:57:51.266737 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2efcd259-bc63-445b-9c26-50aec01cc561 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Returning 404 to user: Instance f34f89ac-1d25-43c0-a4b0-c92ca88eb929 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:57:51.268843 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2efcd259-bc63-445b-9c26-50aec01cc561 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "PUT /compute/v2.1/servers/f34f89ac-1d25-43c0-a4b0-c92ca88eb929" status: 404 len: 111 microversion: 2.1 time: 0.030056 Sep 08 10:57:51.270839 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2161/4385] 10.222.0.27 () {60 vars in 1256 bytes} [Thu Sep 8 10:57:51 2022] PUT /compute/v2.1/servers/f34f89ac-1d25-43c0-a4b0-c92ca88eb929 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:57:51.293696 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-be65ea97-a8fc-4308-82b5-18231be53f2d tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:51.294984 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-be65ea97-a8fc-4308-82b5-18231be53f2d tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: 82458f68-8fcf-4d1f-8e7b-87d76f3576ad] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:51.541117 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-be65ea97-a8fc-4308-82b5-18231be53f2d tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:51.548885 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-be65ea97-a8fc-4308-82b5-18231be53f2d tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad" status: 200 len: 1218 microversion: 2.1 time: 0.275532 Sep 08 10:57:51.552781 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2162/4386] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:51 2022] GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad => generated 1218 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:51.574741 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9dda590e-6ae2-4b2c-97e4-21b9f756cb2f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:51.587782 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9dda590e-6ae2-4b2c-97e4-21b9f756cb2f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] [instance: 51e76f20-555e-4867-a42b-30727dc94169] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:51.610966 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9dda590e-6ae2-4b2c-97e4-21b9f756cb2f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:51.611749 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9dda590e-6ae2-4b2c-97e4-21b9f756cb2f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:51.612383 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9dda590e-6ae2-4b2c-97e4-21b9f756cb2f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:51.613305 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9dda590e-6ae2-4b2c-97e4-21b9f756cb2f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:51.613938 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9dda590e-6ae2-4b2c-97e4-21b9f756cb2f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:51.614524 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9dda590e-6ae2-4b2c-97e4-21b9f756cb2f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:51.673198 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9dda590e-6ae2-4b2c-97e4-21b9f756cb2f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] [instance: 51e76f20-555e-4867-a42b-30727dc94169] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:57:51.875201 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9dda590e-6ae2-4b2c-97e4-21b9f756cb2f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] 10.222.0.27 "DELETE /compute/v2.1/servers/51e76f20-555e-4867-a42b-30727dc94169" status: 204 len: 0 microversion: 2.1 time: 0.304731 Sep 08 10:57:51.878560 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2163/4387] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:57:51 2022] DELETE /compute/v2.1/servers/51e76f20-555e-4867-a42b-30727dc94169 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:57:51.892295 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c19898f1-5b4b-44a7-860b-cd5594d06b0a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:51.893549 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c19898f1-5b4b-44a7-860b-cd5594d06b0a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:51.916139 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c19898f1-5b4b-44a7-860b-cd5594d06b0a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:51.918913 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c19898f1-5b4b-44a7-860b-cd5594d06b0a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:51.923707 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c19898f1-5b4b-44a7-860b-cd5594d06b0a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:51.924980 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c19898f1-5b4b-44a7-860b-cd5594d06b0a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:51.925678 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c19898f1-5b4b-44a7-860b-cd5594d06b0a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:51.926332 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c19898f1-5b4b-44a7-860b-cd5594d06b0a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:52.037952 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c4b3005e-4206-4cb6-858a-e30b6be7d663 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:52.052673 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c4b3005e-4206-4cb6-858a-e30b6be7d663 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1656 microversion: 2.1 time: 0.962589 Sep 08 10:57:52.053938 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2225/4388] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:51 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1656 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:52.059888 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-20d46ec6-a504-4b0d-9b8b-d5599a4c6e8b tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:52.060529 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-20d46ec6-a504-4b0d-9b8b-d5599a4c6e8b tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] [instance: 51e76f20-555e-4867-a42b-30727dc94169] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:52.073099 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-20d46ec6-a504-4b0d-9b8b-d5599a4c6e8b tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:52.074236 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-20d46ec6-a504-4b0d-9b8b-d5599a4c6e8b tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:52.078645 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-20d46ec6-a504-4b0d-9b8b-d5599a4c6e8b tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:52.079867 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-20d46ec6-a504-4b0d-9b8b-d5599a4c6e8b tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:52.080571 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-20d46ec6-a504-4b0d-9b8b-d5599a4c6e8b tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:52.081198 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-20d46ec6-a504-4b0d-9b8b-d5599a4c6e8b tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:52.511605 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-20d46ec6-a504-4b0d-9b8b-d5599a4c6e8b tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a779e85e1c493985f7cfe8aceb9c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4478d0e315d948df9eda910f205646c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:52.521835 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-20d46ec6-a504-4b0d-9b8b-d5599a4c6e8b tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] 10.222.0.27 "GET /compute/v2.1/servers/51e76f20-555e-4867-a42b-30727dc94169" status: 200 len: 1517 microversion: 2.1 time: 0.465777 Sep 08 10:57:52.534087 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2226/4389] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:52 2022] GET /compute/v2.1/servers/51e76f20-555e-4867-a42b-30727dc94169 => generated 1517 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:52.534087 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ca0e7eff-d89b-49a5-8f75-2f00e8fa18df tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:57:52.534087 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ca0e7eff-d89b-49a5-8f75-2f00e8fa18df tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:52.537777 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ca0e7eff-d89b-49a5-8f75-2f00e8fa18df tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:52.538705 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ca0e7eff-d89b-49a5-8f75-2f00e8fa18df tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:52.539392 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ca0e7eff-d89b-49a5-8f75-2f00e8fa18df tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:52.540650 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ca0e7eff-d89b-49a5-8f75-2f00e8fa18df tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:52.541574 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ca0e7eff-d89b-49a5-8f75-2f00e8fa18df tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:52.542263 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ca0e7eff-d89b-49a5-8f75-2f00e8fa18df tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:52.697502 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ca0e7eff-d89b-49a5-8f75-2f00e8fa18df tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "POST /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7/action" status: 202 len: 0 microversion: 2.1 time: 0.170851 Sep 08 10:57:52.705748 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2227/4390] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:57:52 2022] POST /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:57:52.718393 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9a2c7873-212b-4e0d-9da5-39f83ba5a1cd tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:52.720127 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9a2c7873-212b-4e0d-9da5-39f83ba5a1cd tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: 82458f68-8fcf-4d1f-8e7b-87d76f3576ad] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:52.828064 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9a2c7873-212b-4e0d-9da5-39f83ba5a1cd tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:52.839820 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9a2c7873-212b-4e0d-9da5-39f83ba5a1cd tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad" status: 200 len: 1218 microversion: 2.1 time: 0.131640 Sep 08 10:57:52.844775 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2228/4391] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:52 2022] GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad => generated 1218 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:52.859257 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-452bdfbd-2faa-49d2-a847-0334cb94af87 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:52.860293 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-452bdfbd-2faa-49d2-a847-0334cb94af87 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:52.877375 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-452bdfbd-2faa-49d2-a847-0334cb94af87 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:52.881814 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-452bdfbd-2faa-49d2-a847-0334cb94af87 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:52.883075 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-452bdfbd-2faa-49d2-a847-0334cb94af87 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:52.884712 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-452bdfbd-2faa-49d2-a847-0334cb94af87 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:52.888299 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-452bdfbd-2faa-49d2-a847-0334cb94af87 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:52.889470 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-452bdfbd-2faa-49d2-a847-0334cb94af87 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:53.275316 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-452bdfbd-2faa-49d2-a847-0334cb94af87 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:53.284711 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-452bdfbd-2faa-49d2-a847-0334cb94af87 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1663 microversion: 2.1 time: 0.438343 Sep 08 10:57:53.285953 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2229/4392] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:52 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1663 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:53.460164 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c19898f1-5b4b-44a7-860b-cd5594d06b0a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:53.479976 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c19898f1-5b4b-44a7-860b-cd5594d06b0a tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 1.594277 Sep 08 10:57:53.481864 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2164/4393] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:51 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 1603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:53.513225 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e861d3da-cef7-48c2-a3c0-6dbd5da13839 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:53.514663 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e861d3da-cef7-48c2-a3c0-6dbd5da13839 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:53.530941 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e861d3da-cef7-48c2-a3c0-6dbd5da13839 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:53.531791 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e861d3da-cef7-48c2-a3c0-6dbd5da13839 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:53.539637 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e861d3da-cef7-48c2-a3c0-6dbd5da13839 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:53.540919 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e861d3da-cef7-48c2-a3c0-6dbd5da13839 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:53.541800 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e861d3da-cef7-48c2-a3c0-6dbd5da13839 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:53.542518 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e861d3da-cef7-48c2-a3c0-6dbd5da13839 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:53.566413 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a9f30919-9429-4048-9cb0-db042e87fd4c tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:53.568174 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a9f30919-9429-4048-9cb0-db042e87fd4c tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] [instance: 51e76f20-555e-4867-a42b-30727dc94169] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:53.604418 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a9f30919-9429-4048-9cb0-db042e87fd4c tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:53.623608 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a9f30919-9429-4048-9cb0-db042e87fd4c tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:53.624187 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a9f30919-9429-4048-9cb0-db042e87fd4c tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:53.625092 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a9f30919-9429-4048-9cb0-db042e87fd4c tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:53.625808 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a9f30919-9429-4048-9cb0-db042e87fd4c tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:53.626733 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a9f30919-9429-4048-9cb0-db042e87fd4c tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:54.169867 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e861d3da-cef7-48c2-a3c0-6dbd5da13839 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:54.215412 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e861d3da-cef7-48c2-a3c0-6dbd5da13839 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 0.706047 Sep 08 10:57:54.226252 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2230/4394] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:53 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:54.235889 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4a900efb-8791-46f4-9f35-c3668fbca47d tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:54.238240 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4a900efb-8791-46f4-9f35-c3668fbca47d tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: 82458f68-8fcf-4d1f-8e7b-87d76f3576ad] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:54.256452 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a900efb-8791-46f4-9f35-c3668fbca47d tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:54.262561 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a900efb-8791-46f4-9f35-c3668fbca47d tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:54.264218 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a900efb-8791-46f4-9f35-c3668fbca47d tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:54.272640 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a900efb-8791-46f4-9f35-c3668fbca47d tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:54.275224 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a900efb-8791-46f4-9f35-c3668fbca47d tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:54.276171 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a900efb-8791-46f4-9f35-c3668fbca47d tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:54.471936 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4a900efb-8791-46f4-9f35-c3668fbca47d tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:54.493799 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4a900efb-8791-46f4-9f35-c3668fbca47d tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad" status: 200 len: 1278 microversion: 2.1 time: 0.264364 Sep 08 10:57:54.495249 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2231/4395] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:54 2022] GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad => generated 1278 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:54.520557 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b45a3f3c-0009-48cd-b9d1-5fec4858840b tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:57:54.536295 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b45a3f3c-0009-48cd-b9d1-5fec4858840b tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Request method failure captured: Sep 08 10:57:54.536295 n-d-850501-12 devstack@n-api.service[128861]: request: PUT /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 HTTP/1.1 Sep 08 10:57:54.536295 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:57:54.536295 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:57:54.536295 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:57:54.536295 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 280 Sep 08 10:57:54.536295 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:57:54.536295 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:57:54.536295 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:57:54.536295 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:57:54.536295 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcmnspi0cCT_Ts_s7jcB6HjtEcdULbQPd_krJniB9lBsXpm1cXSOD-YMaJoaapHCxuCXz0q6Qe4WXufr5At6SSPw8ov8Oz1eUk-fSNbVp7WlOPycfCf5I6xwH7tfbsoefVfbTiDOfU9mTBl0Vs74qdfTniErHfQlEG4cAvAQl1-wMrs Sep 08 10:57:54.536295 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:57:54.536295 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:57:54.536295 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:57:54.536295 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:57:54.536295 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:57:54.536295 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:57:54.536295 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:57:54.536295 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:57:54.536295 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:57:54.536295 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:57:54.536295 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:57:54.536295 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:57:54.536295 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:57:54.536295 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:57:54.536295 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:57:54.536295 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:57:54.536295 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:57:54.536295 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 7f551e6fe34243c290a25b57ab26af19 Sep 08 10:57:54.536295 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:57:54.536295 n-d-850501-12 devstack@n-api.service[128861]: Sep 08 10:57:54.536295 n-d-850501-12 devstack@n-api.service[128861]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Sep 08 10:57:54.536295 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:57:54.536295 n-d-850501-12 devstack@n-api.service[128861]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 08 10:57:54.536295 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '74eebde7-4328-4ddf-be14-bb9fba70ec03', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Sep 08 10:57:54.536295 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:57:54.536295 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:57:54.536295 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 10:57:54.536295 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 10:57:54.536295 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 10:57:54.536295 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise error Sep 08 10:57:54.536295 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 08 10:57:54.536295 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:57:54.536295 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Sep 08 10:57:54.536295 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 08 10:57:54.536295 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:57:54.536295 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 08 10:57:54.536295 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 08 10:57:54.536295 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:57:54.536295 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:57:54.536295 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:57:54.536295 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:57:54.540030 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:57:54.540030 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:57:54.540030 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:57:54.540030 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:57:54.540030 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:57:54.540030 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:57:54.540030 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:57:54.540030 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:57:54.540030 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 10:57:54.540030 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 10:57:54.540030 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 10:57:54.540030 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 10:57:54.540030 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 10:57:54.540030 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 10:57:54.540030 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 08 10:57:54.540030 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:57:54.540030 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:57:54.540030 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:57:54.540030 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:57:54.540030 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:57:54.540030 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:57:54.540030 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 10:57:54.540030 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 10:57:54.540030 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 08 10:57:54.540030 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:57:54.540030 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b45a3f3c-0009-48cd-b9d1-5fec4858840b tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:57:54.540030 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b45a3f3c-0009-48cd-b9d1-5fec4858840b tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "PUT /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 400 len: 619 microversion: 2.1 time: 0.042474 Sep 08 10:57:54.544169 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2232/4396] 10.222.0.27 () {60 vars in 1257 bytes} [Thu Sep 8 10:57:54 2022] PUT /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 619 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:57:54.550029 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-41642a3b-c81d-4c8f-999d-50be78cb597a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:54.552254 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-41642a3b-c81d-4c8f-999d-50be78cb597a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:54.566165 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41642a3b-c81d-4c8f-999d-50be78cb597a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:54.566889 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41642a3b-c81d-4c8f-999d-50be78cb597a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:54.567689 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41642a3b-c81d-4c8f-999d-50be78cb597a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:54.568901 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41642a3b-c81d-4c8f-999d-50be78cb597a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:54.569743 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41642a3b-c81d-4c8f-999d-50be78cb597a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:54.572656 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41642a3b-c81d-4c8f-999d-50be78cb597a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:54.625115 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a9f30919-9429-4048-9cb0-db042e87fd4c tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a779e85e1c493985f7cfe8aceb9c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4478d0e315d948df9eda910f205646c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:54.642303 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a9f30919-9429-4048-9cb0-db042e87fd4c tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] 10.222.0.27 "GET /compute/v2.1/servers/51e76f20-555e-4867-a42b-30727dc94169" status: 200 len: 1517 microversion: 2.1 time: 1.082171 Sep 08 10:57:54.646227 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2165/4397] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:53 2022] GET /compute/v2.1/servers/51e76f20-555e-4867-a42b-30727dc94169 => generated 1517 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:54.658066 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-17dade6a-ab5f-4f65-bc41-1d243b2d8627 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:54.664640 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-17dade6a-ab5f-4f65-bc41-1d243b2d8627 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:54.682966 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-17dade6a-ab5f-4f65-bc41-1d243b2d8627 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:54.683843 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-17dade6a-ab5f-4f65-bc41-1d243b2d8627 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:54.684482 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-17dade6a-ab5f-4f65-bc41-1d243b2d8627 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:54.685631 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-17dade6a-ab5f-4f65-bc41-1d243b2d8627 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:54.686251 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-17dade6a-ab5f-4f65-bc41-1d243b2d8627 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:54.686846 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-17dade6a-ab5f-4f65-bc41-1d243b2d8627 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:54.838227 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-41642a3b-c81d-4c8f-999d-50be78cb597a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:54.864159 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-41642a3b-c81d-4c8f-999d-50be78cb597a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1671 microversion: 2.1 time: 0.320719 Sep 08 10:57:54.884709 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2233/4398] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:54 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1671 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:54.902074 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bca9a60c-d2b6-4027-85fe-38d269e59883 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:54.903539 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bca9a60c-d2b6-4027-85fe-38d269e59883 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:54.934344 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:57:54.940619 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bca9a60c-d2b6-4027-85fe-38d269e59883 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:54.941515 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bca9a60c-d2b6-4027-85fe-38d269e59883 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:54.942120 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bca9a60c-d2b6-4027-85fe-38d269e59883 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:54.943885 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bca9a60c-d2b6-4027-85fe-38d269e59883 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:54.946307 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bca9a60c-d2b6-4027-85fe-38d269e59883 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:54.947085 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bca9a60c-d2b6-4027-85fe-38d269e59883 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:55.278861 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-bca9a60c-d2b6-4027-85fe-38d269e59883 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:55.291708 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bca9a60c-d2b6-4027-85fe-38d269e59883 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1671 microversion: 2.1 time: 0.390843 Sep 08 10:57:55.292822 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2234/4399] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:54 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1671 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:55.322751 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f5ad55dc-08bc-4df8-a158-bd1a2107f1ba tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:55.323607 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f5ad55dc-08bc-4df8-a158-bd1a2107f1ba tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:55.332590 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f5ad55dc-08bc-4df8-a158-bd1a2107f1ba tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:55.333343 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f5ad55dc-08bc-4df8-a158-bd1a2107f1ba tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:55.334003 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f5ad55dc-08bc-4df8-a158-bd1a2107f1ba tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:55.334974 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f5ad55dc-08bc-4df8-a158-bd1a2107f1ba tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:55.336392 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f5ad55dc-08bc-4df8-a158-bd1a2107f1ba tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:55.337083 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f5ad55dc-08bc-4df8-a158-bd1a2107f1ba tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:55.613743 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f5ad55dc-08bc-4df8-a158-bd1a2107f1ba tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:55.633998 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f5ad55dc-08bc-4df8-a158-bd1a2107f1ba tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1671 microversion: 2.1 time: 0.317176 Sep 08 10:57:55.634586 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2235/4400] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:55 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1671 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:55.657930 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-69142d5b-cdf1-4480-8d36-8a0fe9ee13e6 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:55.658558 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-69142d5b-cdf1-4480-8d36-8a0fe9ee13e6 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: 82458f68-8fcf-4d1f-8e7b-87d76f3576ad] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:55.669181 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-69142d5b-cdf1-4480-8d36-8a0fe9ee13e6 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:55.669998 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-69142d5b-cdf1-4480-8d36-8a0fe9ee13e6 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:55.670593 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-69142d5b-cdf1-4480-8d36-8a0fe9ee13e6 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:55.671623 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-69142d5b-cdf1-4480-8d36-8a0fe9ee13e6 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:55.672294 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-69142d5b-cdf1-4480-8d36-8a0fe9ee13e6 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:55.673005 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-69142d5b-cdf1-4480-8d36-8a0fe9ee13e6 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:55.930456 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-17dade6a-ab5f-4f65-bc41-1d243b2d8627 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:55.937936 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-69142d5b-cdf1-4480-8d36-8a0fe9ee13e6 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:55.949572 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-69142d5b-cdf1-4480-8d36-8a0fe9ee13e6 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad" status: 200 len: 1276 microversion: 2.1 time: 0.309062 Sep 08 10:57:55.951506 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-17dade6a-ab5f-4f65-bc41-1d243b2d8627 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 1.304165 Sep 08 10:57:55.952638 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2166/4401] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:54 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:55.957425 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2236/4402] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:55 2022] GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad => generated 1276 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:55.967751 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0c129c7f-92fc-47fa-80fd-3e0cde1a4b86 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:55.968368 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0c129c7f-92fc-47fa-80fd-3e0cde1a4b86 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] [instance: 51e76f20-555e-4867-a42b-30727dc94169] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:55.974754 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0c129c7f-92fc-47fa-80fd-3e0cde1a4b86 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:55.975555 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0c129c7f-92fc-47fa-80fd-3e0cde1a4b86 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:55.977126 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0c129c7f-92fc-47fa-80fd-3e0cde1a4b86 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:55.978362 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0c129c7f-92fc-47fa-80fd-3e0cde1a4b86 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:55.979058 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0c129c7f-92fc-47fa-80fd-3e0cde1a4b86 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:55.979695 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0c129c7f-92fc-47fa-80fd-3e0cde1a4b86 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:55.985225 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:57:55.988198 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a48b4a83-6866-4ff4-ad6d-96d918813c6f tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:55.988878 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a48b4a83-6866-4ff4-ad6d-96d918813c6f tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:56.006727 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a48b4a83-6866-4ff4-ad6d-96d918813c6f tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:56.009809 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a48b4a83-6866-4ff4-ad6d-96d918813c6f tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:56.010519 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a48b4a83-6866-4ff4-ad6d-96d918813c6f tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:56.011806 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a48b4a83-6866-4ff4-ad6d-96d918813c6f tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:56.014880 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a48b4a83-6866-4ff4-ad6d-96d918813c6f tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:56.016148 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a48b4a83-6866-4ff4-ad6d-96d918813c6f tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:56.256089 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0c129c7f-92fc-47fa-80fd-3e0cde1a4b86 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a779e85e1c493985f7cfe8aceb9c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4478d0e315d948df9eda910f205646c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:56.285723 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0c129c7f-92fc-47fa-80fd-3e0cde1a4b86 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] 10.222.0.27 "GET /compute/v2.1/servers/51e76f20-555e-4867-a42b-30727dc94169" status: 200 len: 1517 microversion: 2.1 time: 0.326368 Sep 08 10:57:56.289876 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2237/4403] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:55 2022] GET /compute/v2.1/servers/51e76f20-555e-4867-a42b-30727dc94169 => generated 1517 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:56.313659 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-17403a19-8c53-440a-8724-bda136f5e539 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:56.317431 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-17403a19-8c53-440a-8724-bda136f5e539 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:56.343771 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-17403a19-8c53-440a-8724-bda136f5e539 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:56.347897 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-17403a19-8c53-440a-8724-bda136f5e539 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:56.350030 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-17403a19-8c53-440a-8724-bda136f5e539 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:56.350992 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-17403a19-8c53-440a-8724-bda136f5e539 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:56.353279 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-17403a19-8c53-440a-8724-bda136f5e539 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:56.356714 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-17403a19-8c53-440a-8724-bda136f5e539 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:56.606551 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-17403a19-8c53-440a-8724-bda136f5e539 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:56.641188 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-17403a19-8c53-440a-8724-bda136f5e539 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 0.343011 Sep 08 10:57:56.642143 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2238/4404] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:56 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:56.671138 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d99e3b0d-efb5-4d0b-b4d0-2155fc469808 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:57:56.681073 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d99e3b0d-efb5-4d0b-b4d0-2155fc469808 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Request method failure captured: Sep 08 10:57:56.681073 n-d-850501-12 devstack@n-api.service[128861]: request: PUT /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 HTTP/1.1 Sep 08 10:57:56.681073 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:57:56.681073 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:57:56.681073 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:57:56.681073 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 24 Sep 08 10:57:56.681073 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:57:56.681073 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:57:56.681073 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:57:56.681073 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:57:56.681073 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcmnspi0cCT_Ts_s7jcB6HjtEcdULbQPd_krJniB9lBsXpm1cXSOD-YMaJoaapHCxuCXz0q6Qe4WXufr5At6SSPw8ov8Oz1eUk-fSNbVp7WlOPycfCf5I6xwH7tfbsoefVfbTiDOfU9mTBl0Vs74qdfTniErHfQlEG4cAvAQl1-wMrs Sep 08 10:57:56.681073 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:57:56.681073 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:57:56.681073 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:57:56.681073 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:57:56.681073 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:57:56.681073 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:57:56.681073 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:57:56.681073 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:57:56.681073 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:57:56.681073 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:57:56.681073 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:57:56.681073 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:57:56.681073 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:57:56.681073 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:57:56.681073 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:57:56.681073 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:57:56.681073 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:57:56.681073 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 7f551e6fe34243c290a25b57ab26af19 Sep 08 10:57:56.681073 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:57:56.681073 n-d-850501-12 devstack@n-api.service[128861]: Sep 08 10:57:56.681073 n-d-850501-12 devstack@n-api.service[128861]: {"server": {"name": ""}} Sep 08 10:57:56.681073 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:57:56.681073 n-d-850501-12 devstack@n-api.service[128861]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 08 10:57:56.681073 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '74eebde7-4328-4ddf-be14-bb9fba70ec03', 'body': {'server': {'name': ''}}} Sep 08 10:57:56.681073 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:57:56.681073 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:57:56.681073 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 10:57:56.681073 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 10:57:56.681073 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 10:57:56.681073 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise error Sep 08 10:57:56.681073 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 08 10:57:56.681073 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:57:56.681073 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Sep 08 10:57:56.681073 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 08 10:57:56.681073 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:57:56.681073 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 08 10:57:56.681073 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi '' Sep 08 10:57:56.681073 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:57:56.681073 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:57:56.681073 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:57:56.681073 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:57:56.681073 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:57:56.681073 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:57:56.681073 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:57:56.681073 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:57:56.681073 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:57:56.681073 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:57:56.681073 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:57:56.681073 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:57:56.681073 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 10:57:56.681073 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 10:57:56.681073 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 10:57:56.681073 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 10:57:56.681073 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 10:57:56.681073 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 10:57:56.690517 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 08 10:57:56.690517 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:57:56.690517 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:57:56.690517 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:57:56.690517 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:57:56.690517 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:57:56.690517 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:57:56.690517 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 10:57:56.690517 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 10:57:56.690517 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 08 10:57:56.690517 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:57:56.699295 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d99e3b0d-efb5-4d0b-b4d0-2155fc469808 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:57:56.701897 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d99e3b0d-efb5-4d0b-b4d0-2155fc469808 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "PUT /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 400 len: 108 microversion: 2.1 time: 0.038808 Sep 08 10:57:56.703949 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2239/4405] 10.222.0.27 () {60 vars in 1256 bytes} [Thu Sep 8 10:57:56 2022] PUT /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 108 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:57:56.728871 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-477c0a3c-2123-4c03-95a5-3235d13cf9e3 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:56.732431 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-477c0a3c-2123-4c03-95a5-3235d13cf9e3 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:56.769565 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-477c0a3c-2123-4c03-95a5-3235d13cf9e3 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:56.771815 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-477c0a3c-2123-4c03-95a5-3235d13cf9e3 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:56.774216 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-477c0a3c-2123-4c03-95a5-3235d13cf9e3 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:56.777686 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-477c0a3c-2123-4c03-95a5-3235d13cf9e3 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:56.780889 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-477c0a3c-2123-4c03-95a5-3235d13cf9e3 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:56.783170 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-477c0a3c-2123-4c03-95a5-3235d13cf9e3 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:56.799414 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a48b4a83-6866-4ff4-ad6d-96d918813c6f tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:56.802864 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:57:56.821489 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a48b4a83-6866-4ff4-ad6d-96d918813c6f tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1671 microversion: 2.1 time: 0.843121 Sep 08 10:57:56.822422 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2167/4406] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:55 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1671 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:56.880885 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b0b7b717-48cb-4ad6-ac73-5ae5526ea3f8 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:56.881841 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b0b7b717-48cb-4ad6-ac73-5ae5526ea3f8 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:56.902148 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b0b7b717-48cb-4ad6-ac73-5ae5526ea3f8 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:56.906886 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b0b7b717-48cb-4ad6-ac73-5ae5526ea3f8 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:56.909632 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b0b7b717-48cb-4ad6-ac73-5ae5526ea3f8 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:56.910501 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b0b7b717-48cb-4ad6-ac73-5ae5526ea3f8 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:56.916039 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b0b7b717-48cb-4ad6-ac73-5ae5526ea3f8 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:56.918474 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b0b7b717-48cb-4ad6-ac73-5ae5526ea3f8 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:57.291614 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-477c0a3c-2123-4c03-95a5-3235d13cf9e3 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:57.304605 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-477c0a3c-2123-4c03-95a5-3235d13cf9e3 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1504 microversion: 2.1 time: 0.591524 Sep 08 10:57:57.315803 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2240/4407] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:56 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1504 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:57.342238 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-447e7205-2a34-4257-a9bb-813dc62e8b55 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:57.342737 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-447e7205-2a34-4257-a9bb-813dc62e8b55 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: 82458f68-8fcf-4d1f-8e7b-87d76f3576ad] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:57.370939 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-447e7205-2a34-4257-a9bb-813dc62e8b55 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:57.371476 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-447e7205-2a34-4257-a9bb-813dc62e8b55 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:57.375763 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-447e7205-2a34-4257-a9bb-813dc62e8b55 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:57.376745 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-447e7205-2a34-4257-a9bb-813dc62e8b55 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:57.378533 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-447e7205-2a34-4257-a9bb-813dc62e8b55 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:57.381394 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-447e7205-2a34-4257-a9bb-813dc62e8b55 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:57.768818 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-447e7205-2a34-4257-a9bb-813dc62e8b55 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:57.785879 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-447e7205-2a34-4257-a9bb-813dc62e8b55 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad" status: 200 len: 1276 microversion: 2.1 time: 0.466306 Sep 08 10:57:57.786850 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2241/4408] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:57 2022] GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad => generated 1276 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:57.794612 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-141a6bd9-45f5-4cf9-ba47-5317ae4a2ef6 req-77e1d36f-c735-412e-b844-26882b233101 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51e76f20-555e-4867-a42b-30727dc94169", "name": "network-vif-deleted", "tag": "b769ec83-23f3-4327-8169-ebe5904a41a5"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:57:57.819665 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-141a6bd9-45f5-4cf9-ba47-5317ae4a2ef6 req-77e1d36f-c735-412e-b844-26882b233101 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:57.823610 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-141a6bd9-45f5-4cf9-ba47-5317ae4a2ef6 req-77e1d36f-c735-412e-b844-26882b233101 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:57.825002 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-141a6bd9-45f5-4cf9-ba47-5317ae4a2ef6 req-77e1d36f-c735-412e-b844-26882b233101 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:57.853467 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-141a6bd9-45f5-4cf9-ba47-5317ae4a2ef6 req-77e1d36f-c735-412e-b844-26882b233101 service nova] Creating event network-vif-deleted:b769ec83-23f3-4327-8169-ebe5904a41a5 for instance 51e76f20-555e-4867-a42b-30727dc94169 on n-h1-850501-12 Sep 08 10:57:57.872579 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-141a6bd9-45f5-4cf9-ba47-5317ae4a2ef6 req-77e1d36f-c735-412e-b844-26882b233101 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083454 Sep 08 10:57:57.877472 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2242/4409] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:57:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:57:57.906209 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4327cdb7-833c-453d-b860-4c837ec72378 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:57.907605 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4327cdb7-833c-453d-b860-4c837ec72378 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] [instance: 51e76f20-555e-4867-a42b-30727dc94169] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:57.918255 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b0b7b717-48cb-4ad6-ac73-5ae5526ea3f8 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:57.925401 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4327cdb7-833c-453d-b860-4c837ec72378 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:57.931391 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4327cdb7-833c-453d-b860-4c837ec72378 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:57.932116 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4327cdb7-833c-453d-b860-4c837ec72378 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:57.932869 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b0b7b717-48cb-4ad6-ac73-5ae5526ea3f8 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1671 microversion: 2.1 time: 1.057755 Sep 08 10:57:57.933452 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4327cdb7-833c-453d-b860-4c837ec72378 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:57.933943 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4327cdb7-833c-453d-b860-4c837ec72378 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:57.934507 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4327cdb7-833c-453d-b860-4c837ec72378 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:57.935967 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2168/4410] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:56 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1671 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:57.958962 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d53b8a32-5e9d-46db-8f78-2b835ddcf96c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:57.959971 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d53b8a32-5e9d-46db-8f78-2b835ddcf96c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:57.967362 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d53b8a32-5e9d-46db-8f78-2b835ddcf96c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:57.973145 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d53b8a32-5e9d-46db-8f78-2b835ddcf96c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:57.973960 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d53b8a32-5e9d-46db-8f78-2b835ddcf96c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:57.974951 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d53b8a32-5e9d-46db-8f78-2b835ddcf96c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:57.980280 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d53b8a32-5e9d-46db-8f78-2b835ddcf96c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:57.981146 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d53b8a32-5e9d-46db-8f78-2b835ddcf96c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:57.993911 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4327cdb7-833c-453d-b860-4c837ec72378 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:57.994670 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4327cdb7-833c-453d-b860-4c837ec72378 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:57.995451 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4327cdb7-833c-453d-b860-4c837ec72378 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:57.996112 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-4327cdb7-833c-453d-b860-4c837ec72378 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lazy-loading 'fault' on Instance uuid 51e76f20-555e-4867-a42b-30727dc94169 {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:57:58.082907 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4327cdb7-833c-453d-b860-4c837ec72378 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a779e85e1c493985f7cfe8aceb9c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4478d0e315d948df9eda910f205646c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:58.099268 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4327cdb7-833c-453d-b860-4c837ec72378 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] 10.222.0.27 "GET /compute/v2.1/servers/51e76f20-555e-4867-a42b-30727dc94169" status: 200 len: 1311 microversion: 2.1 time: 0.217295 Sep 08 10:57:58.127773 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2243/4411] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:57 2022] GET /compute/v2.1/servers/51e76f20-555e-4867-a42b-30727dc94169 => generated 1311 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:58.814403 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8f3fe556-20f4-4882-b32e-c9cb208496ca tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:58.816364 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8f3fe556-20f4-4882-b32e-c9cb208496ca tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: 82458f68-8fcf-4d1f-8e7b-87d76f3576ad] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:58.831745 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d53b8a32-5e9d-46db-8f78-2b835ddcf96c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:58.848643 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f3fe556-20f4-4882-b32e-c9cb208496ca tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:58.857037 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f3fe556-20f4-4882-b32e-c9cb208496ca tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:58.857687 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f3fe556-20f4-4882-b32e-c9cb208496ca tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:58.858471 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f3fe556-20f4-4882-b32e-c9cb208496ca tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:58.859417 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f3fe556-20f4-4882-b32e-c9cb208496ca tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:58.859417 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f3fe556-20f4-4882-b32e-c9cb208496ca tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:58.863098 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d53b8a32-5e9d-46db-8f78-2b835ddcf96c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1671 microversion: 2.1 time: 0.907830 Sep 08 10:57:58.864649 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2169/4412] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:57 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1671 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:58.993751 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8f3fe556-20f4-4882-b32e-c9cb208496ca tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:59.002005 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8f3fe556-20f4-4882-b32e-c9cb208496ca tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad" status: 200 len: 1276 microversion: 2.1 time: 0.192166 Sep 08 10:57:59.020464 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2244/4413] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:58 2022] GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad => generated 1276 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:57:59.147426 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a6db261d-2b8f-4c9b-9a55-85df2398c170 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:59.149182 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a6db261d-2b8f-4c9b-9a55-85df2398c170 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] [instance: 51e76f20-555e-4867-a42b-30727dc94169] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:59.165047 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a6db261d-2b8f-4c9b-9a55-85df2398c170 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:59.168924 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a6db261d-2b8f-4c9b-9a55-85df2398c170 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:59.170004 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a6db261d-2b8f-4c9b-9a55-85df2398c170 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:59.186083 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a6db261d-2b8f-4c9b-9a55-85df2398c170 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:59.187007 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a6db261d-2b8f-4c9b-9a55-85df2398c170 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:59.188142 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a6db261d-2b8f-4c9b-9a55-85df2398c170 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:59.228194 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-a6db261d-2b8f-4c9b-9a55-85df2398c170 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] HTTP exception thrown: Instance 51e76f20-555e-4867-a42b-30727dc94169 could not be found. Sep 08 10:57:59.233489 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a6db261d-2b8f-4c9b-9a55-85df2398c170 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Request method failure captured: Sep 08 10:57:59.233489 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/51e76f20-555e-4867-a42b-30727dc94169 HTTP/1.1 Sep 08 10:57:59.233489 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:57:59.233489 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:57:59.233489 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:57:59.233489 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:57:59.233489 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:57:59.233489 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:57:59.233489 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:57:59.233489 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:57:59.233489 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcpTk-tjJHj9kGRXPej75R07q3Iljlbh0dY-FvwRNlK7I1XRt8Qm3z6jPmDmnHaBp30gg1KRPAmd2okZdHcNf0OnlFcsJJsxRkmaz8AFPZ15wFWWRx3ssDdd946r6ndovP-VI1B0i4IVZtl9c0XnXFwzkRpx8wGHiNNKM2kAoAg37I0 Sep 08 10:57:59.233489 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:57:59.233489 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:57:59.233489 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:57:59.233489 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:57:59.233489 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:57:59.233489 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:57:59.233489 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 4478d0e315d948df9eda910f205646c3 Sep 08 10:57:59.233489 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ListServerFiltersTestJSON-1889876693 Sep 08 10:57:59.233489 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:57:59.233489 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:57:59.233489 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4478d0e315d948df9eda910f205646c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4478d0e315d948df9eda910f205646c3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4478d0e315d948df9eda910f205646c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4478d0e315d948df9eda910f205646c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:57:59.233489 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ListServerFiltersTestJSON-1889876693 Sep 08 10:57:59.233489 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 4478d0e315d948df9eda910f205646c3 Sep 08 10:57:59.233489 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1889876693 Sep 08 10:57:59.233489 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ListServerFiltersTestJSON-1889876693-project Sep 08 10:57:59.233489 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:57:59.233489 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:57:59.233489 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 06a779e85e1c493985f7cfe8aceb9c87 Sep 08 10:57:59.233489 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ListServerFiltersTestJSON-1889876693-project Sep 08 10:57:59.233489 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:57:59.233489 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 51e76f20-555e-4867-a42b-30727dc94169 could not be found. Sep 08 10:57:59.233489 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '51e76f20-555e-4867-a42b-30727dc94169'} Sep 08 10:57:59.233489 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:57:59.233489 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:57:59.233489 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:57:59.233489 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:57:59.233489 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:57:59.233489 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:57:59.233489 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:57:59.233489 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:57:59.233489 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:57:59.233489 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:57:59.233489 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51e76f20-555e-4867-a42b-30727dc94169 could not be found. Sep 08 10:57:59.233489 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:57:59.233489 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:57:59.233489 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:57:59.233489 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:57:59.233489 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:57:59.233489 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:57:59.233489 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:57:59.233489 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:57:59.233489 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:57:59.233489 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:57:59.233489 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:57:59.233489 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:57:59.233489 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:57:59.233489 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:57:59.233489 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:57:59.233489 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:57:59.233489 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51e76f20-555e-4867-a42b-30727dc94169 could not be found. Sep 08 10:57:59.233489 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:57:59.233489 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:57:59.233489 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:57:59.239341 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:57:59.239341 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:57:59.239341 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:57:59.239341 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:57:59.239341 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:57:59.239341 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51e76f20-555e-4867-a42b-30727dc94169 could not be found. Sep 08 10:57:59.239341 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:57:59.240546 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a6db261d-2b8f-4c9b-9a55-85df2398c170 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Returning 404 to user: Instance 51e76f20-555e-4867-a42b-30727dc94169 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:57:59.243922 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a6db261d-2b8f-4c9b-9a55-85df2398c170 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] 10.222.0.27 "GET /compute/v2.1/servers/51e76f20-555e-4867-a42b-30727dc94169" status: 404 len: 111 microversion: 2.1 time: 0.104323 Sep 08 10:57:59.245289 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2170/4414] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:59 2022] GET /compute/v2.1/servers/51e76f20-555e-4867-a42b-30727dc94169 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:57:59.258553 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7475df19-e547-4461-81bc-94fa1e19d9a3 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:59.259875 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7475df19-e547-4461-81bc-94fa1e19d9a3 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] [instance: 13039f8f-105b-4bb5-b632-753e183d2f1a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:59.278599 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7475df19-e547-4461-81bc-94fa1e19d9a3 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:59.280033 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7475df19-e547-4461-81bc-94fa1e19d9a3 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:59.281369 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7475df19-e547-4461-81bc-94fa1e19d9a3 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:59.282942 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7475df19-e547-4461-81bc-94fa1e19d9a3 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:59.289394 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7475df19-e547-4461-81bc-94fa1e19d9a3 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:59.290247 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7475df19-e547-4461-81bc-94fa1e19d9a3 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:59.378511 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7475df19-e547-4461-81bc-94fa1e19d9a3 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] [instance: 13039f8f-105b-4bb5-b632-753e183d2f1a] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:57:59.616510 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7475df19-e547-4461-81bc-94fa1e19d9a3 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] 10.222.0.27 "DELETE /compute/v2.1/servers/13039f8f-105b-4bb5-b632-753e183d2f1a" status: 204 len: 0 microversion: 2.1 time: 0.365156 Sep 08 10:57:59.618453 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2245/4415] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:57:59 2022] DELETE /compute/v2.1/servers/13039f8f-105b-4bb5-b632-753e183d2f1a => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:57:59.630647 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a7180eda-b120-4286-a806-a43207b551ea tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:59.632042 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a7180eda-b120-4286-a806-a43207b551ea tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] [instance: 13039f8f-105b-4bb5-b632-753e183d2f1a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:59.640728 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a7180eda-b120-4286-a806-a43207b551ea tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:59.642100 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a7180eda-b120-4286-a806-a43207b551ea tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:59.642915 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a7180eda-b120-4286-a806-a43207b551ea tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:59.646970 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a7180eda-b120-4286-a806-a43207b551ea tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:59.647896 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a7180eda-b120-4286-a806-a43207b551ea tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:59.649605 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a7180eda-b120-4286-a806-a43207b551ea tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:00.032247 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1330b02c-06c9-4bba-ab79-37e734fd70cc tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:00.033690 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1330b02c-06c9-4bba-ab79-37e734fd70cc tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: 82458f68-8fcf-4d1f-8e7b-87d76f3576ad] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:00.051642 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1330b02c-06c9-4bba-ab79-37e734fd70cc tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:00.052682 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1330b02c-06c9-4bba-ab79-37e734fd70cc tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:00.053633 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1330b02c-06c9-4bba-ab79-37e734fd70cc tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:00.055644 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1330b02c-06c9-4bba-ab79-37e734fd70cc tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:00.056481 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1330b02c-06c9-4bba-ab79-37e734fd70cc tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:00.057090 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1330b02c-06c9-4bba-ab79-37e734fd70cc tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:00.355083 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1330b02c-06c9-4bba-ab79-37e734fd70cc tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:00.367240 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1330b02c-06c9-4bba-ab79-37e734fd70cc tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad" status: 200 len: 1318 microversion: 2.1 time: 0.344652 Sep 08 10:58:00.369805 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2246/4416] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:00 2022] GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad => generated 1318 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:58:00.743537 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a7180eda-b120-4286-a806-a43207b551ea tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a779e85e1c493985f7cfe8aceb9c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4478d0e315d948df9eda910f205646c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:00.765973 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a7180eda-b120-4286-a806-a43207b551ea tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] 10.222.0.27 "GET /compute/v2.1/servers/13039f8f-105b-4bb5-b632-753e183d2f1a" status: 200 len: 1517 microversion: 2.1 time: 1.142222 Sep 08 10:58:00.767035 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2171/4417] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:59 2022] GET /compute/v2.1/servers/13039f8f-105b-4bb5-b632-753e183d2f1a => generated 1517 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:58:01.405726 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6d68a349-9d0c-47c0-9706-22540149eca8 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:01.406483 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6d68a349-9d0c-47c0-9706-22540149eca8 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: 82458f68-8fcf-4d1f-8e7b-87d76f3576ad] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:01.421663 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=12 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:58:01.432890 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6d68a349-9d0c-47c0-9706-22540149eca8 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:01.436734 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6d68a349-9d0c-47c0-9706-22540149eca8 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:01.438498 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6d68a349-9d0c-47c0-9706-22540149eca8 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:01.441390 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6d68a349-9d0c-47c0-9706-22540149eca8 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:01.441961 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6d68a349-9d0c-47c0-9706-22540149eca8 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:01.443629 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6d68a349-9d0c-47c0-9706-22540149eca8 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:01.794367 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-661df070-bcd8-4034-b275-168bef742c44 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:01.799129 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-661df070-bcd8-4034-b275-168bef742c44 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] [instance: 13039f8f-105b-4bb5-b632-753e183d2f1a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:01.810951 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=8 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:58:01.813987 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:58:01.821190 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-661df070-bcd8-4034-b275-168bef742c44 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:01.822439 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-661df070-bcd8-4034-b275-168bef742c44 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:01.823743 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-661df070-bcd8-4034-b275-168bef742c44 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:01.825186 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-661df070-bcd8-4034-b275-168bef742c44 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:01.826925 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-661df070-bcd8-4034-b275-168bef742c44 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:01.828017 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-661df070-bcd8-4034-b275-168bef742c44 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:02.001335 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6d68a349-9d0c-47c0-9706-22540149eca8 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:02.027032 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6d68a349-9d0c-47c0-9706-22540149eca8 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad" status: 200 len: 1318 microversion: 2.1 time: 0.624066 Sep 08 10:58:02.028679 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2247/4418] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:01 2022] GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad => generated 1318 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:58:02.714759 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-661df070-bcd8-4034-b275-168bef742c44 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a779e85e1c493985f7cfe8aceb9c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4478d0e315d948df9eda910f205646c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:02.735776 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-661df070-bcd8-4034-b275-168bef742c44 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] 10.222.0.27 "GET /compute/v2.1/servers/13039f8f-105b-4bb5-b632-753e183d2f1a" status: 200 len: 1517 microversion: 2.1 time: 0.950336 Sep 08 10:58:02.740113 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2172/4419] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:01 2022] GET /compute/v2.1/servers/13039f8f-105b-4bb5-b632-753e183d2f1a => generated 1517 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:58:02.833395 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=10 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:58:03.061783 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ad4bdebf-f639-4d11-8f2c-38a37567fad9 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:03.062826 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ad4bdebf-f639-4d11-8f2c-38a37567fad9 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: 82458f68-8fcf-4d1f-8e7b-87d76f3576ad] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:03.090646 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad4bdebf-f639-4d11-8f2c-38a37567fad9 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:03.100766 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad4bdebf-f639-4d11-8f2c-38a37567fad9 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:03.101555 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad4bdebf-f639-4d11-8f2c-38a37567fad9 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:03.103509 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad4bdebf-f639-4d11-8f2c-38a37567fad9 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:03.104376 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad4bdebf-f639-4d11-8f2c-38a37567fad9 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:03.106328 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad4bdebf-f639-4d11-8f2c-38a37567fad9 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:03.469230 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-b2f4f6bb-d626-4581-9e57-9295a5ab0fa0 req-341efdaa-1483-42ca-8686-51f252334171 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13039f8f-105b-4bb5-b632-753e183d2f1a", "name": "network-vif-deleted", "tag": "aad9298d-af3f-4e11-966b-2f2a4bcaeb62"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:58:03.501990 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-b2f4f6bb-d626-4581-9e57-9295a5ab0fa0 req-341efdaa-1483-42ca-8686-51f252334171 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:03.506317 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-b2f4f6bb-d626-4581-9e57-9295a5ab0fa0 req-341efdaa-1483-42ca-8686-51f252334171 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:03.509952 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-b2f4f6bb-d626-4581-9e57-9295a5ab0fa0 req-341efdaa-1483-42ca-8686-51f252334171 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:03.549197 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-b2f4f6bb-d626-4581-9e57-9295a5ab0fa0 req-341efdaa-1483-42ca-8686-51f252334171 service nova] Creating event network-vif-deleted:aad9298d-af3f-4e11-966b-2f2a4bcaeb62 for instance 13039f8f-105b-4bb5-b632-753e183d2f1a on n-h2-850501-12 Sep 08 10:58:03.563273 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-b2f4f6bb-d626-4581-9e57-9295a5ab0fa0 req-341efdaa-1483-42ca-8686-51f252334171 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.791476 Sep 08 10:58:03.579402 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2248/4420] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:58:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:58:03.770013 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-daa1cfaf-1f88-4939-a80d-f6be97ce69cb tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:03.771102 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-daa1cfaf-1f88-4939-a80d-f6be97ce69cb tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] [instance: 13039f8f-105b-4bb5-b632-753e183d2f1a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:03.833891 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-daa1cfaf-1f88-4939-a80d-f6be97ce69cb tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:03.836995 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-daa1cfaf-1f88-4939-a80d-f6be97ce69cb tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:03.838027 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-daa1cfaf-1f88-4939-a80d-f6be97ce69cb tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:03.845161 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-daa1cfaf-1f88-4939-a80d-f6be97ce69cb tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:03.846395 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-daa1cfaf-1f88-4939-a80d-f6be97ce69cb tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:03.849014 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-daa1cfaf-1f88-4939-a80d-f6be97ce69cb tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:03.983804 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-daa1cfaf-1f88-4939-a80d-f6be97ce69cb tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:03.985365 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-daa1cfaf-1f88-4939-a80d-f6be97ce69cb tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:03.986774 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-daa1cfaf-1f88-4939-a80d-f6be97ce69cb tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:03.988143 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-daa1cfaf-1f88-4939-a80d-f6be97ce69cb tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lazy-loading 'fault' on Instance uuid 13039f8f-105b-4bb5-b632-753e183d2f1a {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:58:04.150104 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-daa1cfaf-1f88-4939-a80d-f6be97ce69cb tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a779e85e1c493985f7cfe8aceb9c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4478d0e315d948df9eda910f205646c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:04.172909 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-daa1cfaf-1f88-4939-a80d-f6be97ce69cb tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] 10.222.0.27 "GET /compute/v2.1/servers/13039f8f-105b-4bb5-b632-753e183d2f1a" status: 200 len: 1310 microversion: 2.1 time: 0.409104 Sep 08 10:58:04.176884 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2249/4421] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:03 2022] GET /compute/v2.1/servers/13039f8f-105b-4bb5-b632-753e183d2f1a => generated 1310 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:58:04.547333 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ad4bdebf-f639-4d11-8f2c-38a37567fad9 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:04.560940 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ad4bdebf-f639-4d11-8f2c-38a37567fad9 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad" status: 200 len: 1318 microversion: 2.1 time: 1.507507 Sep 08 10:58:04.565444 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2173/4422] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:03 2022] GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad => generated 1318 bytes in 1513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:58:05.205556 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2ada9a53-c8f3-4f11-afaf-75554bf26112 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:05.207213 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2ada9a53-c8f3-4f11-afaf-75554bf26112 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] [instance: 13039f8f-105b-4bb5-b632-753e183d2f1a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:05.236176 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2ada9a53-c8f3-4f11-afaf-75554bf26112 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:05.237514 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2ada9a53-c8f3-4f11-afaf-75554bf26112 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:05.239192 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2ada9a53-c8f3-4f11-afaf-75554bf26112 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:05.240975 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2ada9a53-c8f3-4f11-afaf-75554bf26112 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:05.242348 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2ada9a53-c8f3-4f11-afaf-75554bf26112 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:05.243430 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2ada9a53-c8f3-4f11-afaf-75554bf26112 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:05.282701 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-2ada9a53-c8f3-4f11-afaf-75554bf26112 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] HTTP exception thrown: Instance 13039f8f-105b-4bb5-b632-753e183d2f1a could not be found. Sep 08 10:58:05.295859 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2ada9a53-c8f3-4f11-afaf-75554bf26112 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Request method failure captured: Sep 08 10:58:05.295859 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/13039f8f-105b-4bb5-b632-753e183d2f1a HTTP/1.1 Sep 08 10:58:05.295859 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:58:05.295859 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:58:05.295859 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:58:05.295859 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:58:05.295859 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:58:05.295859 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:58:05.295859 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:58:05.295859 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:58:05.295859 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcpTk-tjJHj9kGRXPej75R07q3Iljlbh0dY-FvwRNlK7I1XRt8Qm3z6jPmDmnHaBp30gg1KRPAmd2okZdHcNf0OnlFcsJJsxRkmaz8AFPZ15wFWWRx3ssDdd946r6ndovP-VI1B0i4IVZtl9c0XnXFwzkRpx8wGHiNNKM2kAoAg37I0 Sep 08 10:58:05.295859 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:58:05.295859 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:58:05.295859 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:58:05.295859 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:58:05.295859 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:58:05.295859 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:58:05.295859 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 4478d0e315d948df9eda910f205646c3 Sep 08 10:58:05.295859 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ListServerFiltersTestJSON-1889876693 Sep 08 10:58:05.295859 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:58:05.295859 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:58:05.295859 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4478d0e315d948df9eda910f205646c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4478d0e315d948df9eda910f205646c3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4478d0e315d948df9eda910f205646c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4478d0e315d948df9eda910f205646c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:58:05.295859 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ListServerFiltersTestJSON-1889876693 Sep 08 10:58:05.295859 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 4478d0e315d948df9eda910f205646c3 Sep 08 10:58:05.295859 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1889876693 Sep 08 10:58:05.295859 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ListServerFiltersTestJSON-1889876693-project Sep 08 10:58:05.295859 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:58:05.295859 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:58:05.295859 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 06a779e85e1c493985f7cfe8aceb9c87 Sep 08 10:58:05.295859 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ListServerFiltersTestJSON-1889876693-project Sep 08 10:58:05.295859 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:58:05.295859 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 13039f8f-105b-4bb5-b632-753e183d2f1a could not be found. Sep 08 10:58:05.295859 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '13039f8f-105b-4bb5-b632-753e183d2f1a'} Sep 08 10:58:05.295859 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:58:05.295859 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:58:05.295859 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:58:05.295859 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:58:05.295859 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:58:05.295859 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:58:05.295859 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:58:05.295859 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:58:05.295859 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:58:05.295859 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:58:05.295859 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13039f8f-105b-4bb5-b632-753e183d2f1a could not be found. Sep 08 10:58:05.295859 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:58:05.295859 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:58:05.295859 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:58:05.295859 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:58:05.295859 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:58:05.295859 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:58:05.295859 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:58:05.295859 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:58:05.295859 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:58:05.295859 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:58:05.295859 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:58:05.295859 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:58:05.295859 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:58:05.295859 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:58:05.295859 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:58:05.295859 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:58:05.295859 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13039f8f-105b-4bb5-b632-753e183d2f1a could not be found. Sep 08 10:58:05.295859 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:58:05.295859 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:58:05.295859 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:58:05.302319 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:58:05.302319 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:58:05.302319 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:58:05.302319 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:58:05.302319 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:58:05.302319 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13039f8f-105b-4bb5-b632-753e183d2f1a could not be found. Sep 08 10:58:05.302319 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:58:05.307680 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2ada9a53-c8f3-4f11-afaf-75554bf26112 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Returning 404 to user: Instance 13039f8f-105b-4bb5-b632-753e183d2f1a could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:58:05.309404 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2ada9a53-c8f3-4f11-afaf-75554bf26112 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] 10.222.0.27 "GET /compute/v2.1/servers/13039f8f-105b-4bb5-b632-753e183d2f1a" status: 404 len: 111 microversion: 2.1 time: 0.112061 Sep 08 10:58:05.311842 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2250/4423] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:05 2022] GET /compute/v2.1/servers/13039f8f-105b-4bb5-b632-753e183d2f1a => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:58:05.320033 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c5f2b372-713a-4a24-9a9b-d17b8690d1d0 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:05.320400 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c5f2b372-713a-4a24-9a9b-d17b8690d1d0 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] [instance: 931569b4-139a-4939-abf3-49a589eb1d91] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:05.332123 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5f2b372-713a-4a24-9a9b-d17b8690d1d0 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:05.332631 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5f2b372-713a-4a24-9a9b-d17b8690d1d0 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:05.333104 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5f2b372-713a-4a24-9a9b-d17b8690d1d0 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:05.333838 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5f2b372-713a-4a24-9a9b-d17b8690d1d0 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:05.334299 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5f2b372-713a-4a24-9a9b-d17b8690d1d0 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:05.334728 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5f2b372-713a-4a24-9a9b-d17b8690d1d0 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:05.383540 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c5f2b372-713a-4a24-9a9b-d17b8690d1d0 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] [instance: 931569b4-139a-4939-abf3-49a589eb1d91] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:58:05.555135 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c5f2b372-713a-4a24-9a9b-d17b8690d1d0 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] 10.222.0.27 "DELETE /compute/v2.1/servers/931569b4-139a-4939-abf3-49a589eb1d91" status: 204 len: 0 microversion: 2.1 time: 0.239607 Sep 08 10:58:05.556997 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2174/4424] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:58:05 2022] DELETE /compute/v2.1/servers/931569b4-139a-4939-abf3-49a589eb1d91 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 10:58:05.566415 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7c5bdbfc-3dff-401f-b739-3ddbeb39d705 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:05.567198 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7c5bdbfc-3dff-401f-b739-3ddbeb39d705 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] [instance: 931569b4-139a-4939-abf3-49a589eb1d91] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:05.584718 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c5bdbfc-3dff-401f-b739-3ddbeb39d705 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:05.585942 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c5bdbfc-3dff-401f-b739-3ddbeb39d705 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:05.586722 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c5bdbfc-3dff-401f-b739-3ddbeb39d705 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:05.587543 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c5bdbfc-3dff-401f-b739-3ddbeb39d705 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:05.587948 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c5bdbfc-3dff-401f-b739-3ddbeb39d705 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:05.588379 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c5bdbfc-3dff-401f-b739-3ddbeb39d705 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:05.612685 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3a215cab-eaaa-4ac5-9125-65dce01d0690 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:05.613956 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3a215cab-eaaa-4ac5-9125-65dce01d0690 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: 82458f68-8fcf-4d1f-8e7b-87d76f3576ad] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:05.625238 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a215cab-eaaa-4ac5-9125-65dce01d0690 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:05.625895 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a215cab-eaaa-4ac5-9125-65dce01d0690 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:05.626340 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a215cab-eaaa-4ac5-9125-65dce01d0690 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:05.633910 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a215cab-eaaa-4ac5-9125-65dce01d0690 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:05.635828 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a215cab-eaaa-4ac5-9125-65dce01d0690 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:05.636446 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a215cab-eaaa-4ac5-9125-65dce01d0690 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:06.350033 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3a215cab-eaaa-4ac5-9125-65dce01d0690 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:06.358737 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3a215cab-eaaa-4ac5-9125-65dce01d0690 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad" status: 200 len: 1318 microversion: 2.1 time: 0.751196 Sep 08 10:58:06.362766 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2175/4425] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:05 2022] GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad => generated 1318 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:58:06.397772 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-6be8cf4e-e420-45f2-be54-2baedb225e9e req-54a15e76-5436-48da-9a3e-bc937638ba1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82458f68-8fcf-4d1f-8e7b-87d76f3576ad", "tag": "a5bc7eaa-9e35-436f-955a-a184196c4b6d"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:58:06.459788 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7c5bdbfc-3dff-401f-b739-3ddbeb39d705 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a779e85e1c493985f7cfe8aceb9c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4478d0e315d948df9eda910f205646c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:06.461286 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-6be8cf4e-e420-45f2-be54-2baedb225e9e req-54a15e76-5436-48da-9a3e-bc937638ba1c service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:06.463510 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-6be8cf4e-e420-45f2-be54-2baedb225e9e req-54a15e76-5436-48da-9a3e-bc937638ba1c service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:06.464119 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-6be8cf4e-e420-45f2-be54-2baedb225e9e req-54a15e76-5436-48da-9a3e-bc937638ba1c service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:06.490710 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-6be8cf4e-e420-45f2-be54-2baedb225e9e req-54a15e76-5436-48da-9a3e-bc937638ba1c service nova] Creating event network-changed:a5bc7eaa-9e35-436f-955a-a184196c4b6d for instance 82458f68-8fcf-4d1f-8e7b-87d76f3576ad on n-h2-850501-12 Sep 08 10:58:06.500382 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7c5bdbfc-3dff-401f-b739-3ddbeb39d705 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] 10.222.0.27 "GET /compute/v2.1/servers/931569b4-139a-4939-abf3-49a589eb1d91" status: 200 len: 1518 microversion: 2.1 time: 0.935566 Sep 08 10:58:06.509255 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-6be8cf4e-e420-45f2-be54-2baedb225e9e req-54a15e76-5436-48da-9a3e-bc937638ba1c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136599 Sep 08 10:58:06.511027 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2176/4426] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:58:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:58:06.513949 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2251/4427] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:05 2022] GET /compute/v2.1/servers/931569b4-139a-4939-abf3-49a589eb1d91 => generated 1518 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:58:07.401709 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-57f4ca50-1bb8-4985-a5d6-b09a1ddbabc9 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:07.404115 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-57f4ca50-1bb8-4985-a5d6-b09a1ddbabc9 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: 82458f68-8fcf-4d1f-8e7b-87d76f3576ad] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:07.427187 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-57f4ca50-1bb8-4985-a5d6-b09a1ddbabc9 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:07.429787 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-57f4ca50-1bb8-4985-a5d6-b09a1ddbabc9 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:07.430525 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-57f4ca50-1bb8-4985-a5d6-b09a1ddbabc9 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:07.432982 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-57f4ca50-1bb8-4985-a5d6-b09a1ddbabc9 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:07.435944 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-57f4ca50-1bb8-4985-a5d6-b09a1ddbabc9 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:07.436605 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-57f4ca50-1bb8-4985-a5d6-b09a1ddbabc9 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:07.533879 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-08f8815b-0436-49ec-88ec-009afab2753f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:07.535341 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-08f8815b-0436-49ec-88ec-009afab2753f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] [instance: 931569b4-139a-4939-abf3-49a589eb1d91] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:07.545290 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-08f8815b-0436-49ec-88ec-009afab2753f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:07.546146 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-08f8815b-0436-49ec-88ec-009afab2753f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:07.546814 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-08f8815b-0436-49ec-88ec-009afab2753f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:07.548349 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-08f8815b-0436-49ec-88ec-009afab2753f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:07.549699 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-08f8815b-0436-49ec-88ec-009afab2753f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:07.550753 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-08f8815b-0436-49ec-88ec-009afab2753f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:08.032872 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-08f8815b-0436-49ec-88ec-009afab2753f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a779e85e1c493985f7cfe8aceb9c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4478d0e315d948df9eda910f205646c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:08.062801 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-08f8815b-0436-49ec-88ec-009afab2753f tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] 10.222.0.27 "GET /compute/v2.1/servers/931569b4-139a-4939-abf3-49a589eb1d91" status: 200 len: 1518 microversion: 2.1 time: 0.537274 Sep 08 10:58:08.066313 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2252/4428] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:07 2022] GET /compute/v2.1/servers/931569b4-139a-4939-abf3-49a589eb1d91 => generated 1518 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:58:08.089979 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7cdb2ef4-0598-4302-8d85-9a5fa50ba1e8 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:08.090712 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7cdb2ef4-0598-4302-8d85-9a5fa50ba1e8 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: a78d6e53-cc72-4cbd-95f5-e1f859062525] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:08.102296 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7cdb2ef4-0598-4302-8d85-9a5fa50ba1e8 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:08.102766 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7cdb2ef4-0598-4302-8d85-9a5fa50ba1e8 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:08.105683 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7cdb2ef4-0598-4302-8d85-9a5fa50ba1e8 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:08.107815 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7cdb2ef4-0598-4302-8d85-9a5fa50ba1e8 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:08.109745 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7cdb2ef4-0598-4302-8d85-9a5fa50ba1e8 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:08.115236 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7cdb2ef4-0598-4302-8d85-9a5fa50ba1e8 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:08.168696 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-7cdb2ef4-0598-4302-8d85-9a5fa50ba1e8 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] HTTP exception thrown: Instance a78d6e53-cc72-4cbd-95f5-e1f859062525 could not be found. Sep 08 10:58:08.187093 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7cdb2ef4-0598-4302-8d85-9a5fa50ba1e8 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Request method failure captured: Sep 08 10:58:08.187093 n-d-850501-12 devstack@n-api.service[128861]: request: DELETE /compute/v2.1/servers/a78d6e53-cc72-4cbd-95f5-e1f859062525 HTTP/1.1 Sep 08 10:58:08.187093 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:58:08.187093 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:58:08.187093 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:58:08.187093 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:58:08.187093 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:58:08.187093 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:58:08.187093 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:58:08.187093 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:58:08.187093 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcmnspi0cCT_Ts_s7jcB6HjtEcdULbQPd_krJniB9lBsXpm1cXSOD-YMaJoaapHCxuCXz0q6Qe4WXufr5At6SSPw8ov8Oz1eUk-fSNbVp7WlOPycfCf5I6xwH7tfbsoefVfbTiDOfU9mTBl0Vs74qdfTniErHfQlEG4cAvAQl1-wMrs Sep 08 10:58:08.187093 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:58:08.187093 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:58:08.187093 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:58:08.187093 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:58:08.187093 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:58:08.187093 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:58:08.187093 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:58:08.187093 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:58:08.187093 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:58:08.187093 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:58:08.187093 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:58:08.187093 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:58:08.187093 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:58:08.187093 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:58:08.187093 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:58:08.187093 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:58:08.187093 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:58:08.187093 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 7f551e6fe34243c290a25b57ab26af19 Sep 08 10:58:08.187093 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:58:08.187093 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:58:08.187093 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance a78d6e53-cc72-4cbd-95f5-e1f859062525 could not be found. Sep 08 10:58:08.187093 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': 'a78d6e53-cc72-4cbd-95f5-e1f859062525'} Sep 08 10:58:08.187093 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:58:08.187093 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:58:08.187093 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:58:08.187093 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:58:08.187093 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:58:08.187093 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:58:08.187093 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:58:08.187093 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:58:08.187093 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:58:08.187093 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:58:08.187093 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a78d6e53-cc72-4cbd-95f5-e1f859062525 could not be found. Sep 08 10:58:08.187093 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:58:08.187093 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:58:08.187093 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:58:08.187093 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:58:08.187093 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:58:08.187093 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:58:08.187093 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:58:08.187093 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:58:08.187093 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:58:08.187093 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:58:08.187093 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:58:08.187093 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:58:08.187093 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:58:08.187093 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:58:08.187093 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:58:08.187093 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:58:08.187093 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:58:08.187093 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:58:08.197266 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a78d6e53-cc72-4cbd-95f5-e1f859062525 could not be found. Sep 08 10:58:08.197266 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:58:08.197266 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:58:08.197266 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:58:08.197266 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:58:08.197266 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:58:08.197266 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:58:08.197266 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:58:08.197266 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:58:08.197266 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a78d6e53-cc72-4cbd-95f5-e1f859062525 could not be found. Sep 08 10:58:08.197266 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:58:08.197266 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7cdb2ef4-0598-4302-8d85-9a5fa50ba1e8 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Returning 404 to user: Instance a78d6e53-cc72-4cbd-95f5-e1f859062525 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:58:08.204293 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7cdb2ef4-0598-4302-8d85-9a5fa50ba1e8 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a78d6e53-cc72-4cbd-95f5-e1f859062525" status: 404 len: 111 microversion: 2.1 time: 0.120070 Sep 08 10:58:08.207033 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2253/4429] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:58:08 2022] DELETE /compute/v2.1/servers/a78d6e53-cc72-4cbd-95f5-e1f859062525 => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:58:08.222316 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5b7b4733-588d-4db8-bed0-e8f097900ca0 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:08.227858 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5b7b4733-588d-4db8-bed0-e8f097900ca0 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: a78d6e53-cc72-4cbd-95f5-e1f859062525] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:08.238999 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5b7b4733-588d-4db8-bed0-e8f097900ca0 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:08.240525 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5b7b4733-588d-4db8-bed0-e8f097900ca0 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:08.241756 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5b7b4733-588d-4db8-bed0-e8f097900ca0 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:08.244633 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5b7b4733-588d-4db8-bed0-e8f097900ca0 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:08.246281 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5b7b4733-588d-4db8-bed0-e8f097900ca0 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:08.247784 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5b7b4733-588d-4db8-bed0-e8f097900ca0 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:08.280031 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-5b7b4733-588d-4db8-bed0-e8f097900ca0 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] HTTP exception thrown: Instance a78d6e53-cc72-4cbd-95f5-e1f859062525 could not be found. Sep 08 10:58:08.283905 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5b7b4733-588d-4db8-bed0-e8f097900ca0 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Request method failure captured: Sep 08 10:58:08.283905 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/a78d6e53-cc72-4cbd-95f5-e1f859062525 HTTP/1.1 Sep 08 10:58:08.283905 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:58:08.283905 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:58:08.283905 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:58:08.283905 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:58:08.283905 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:58:08.283905 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:58:08.283905 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:58:08.283905 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:58:08.283905 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcmnspi0cCT_Ts_s7jcB6HjtEcdULbQPd_krJniB9lBsXpm1cXSOD-YMaJoaapHCxuCXz0q6Qe4WXufr5At6SSPw8ov8Oz1eUk-fSNbVp7WlOPycfCf5I6xwH7tfbsoefVfbTiDOfU9mTBl0Vs74qdfTniErHfQlEG4cAvAQl1-wMrs Sep 08 10:58:08.283905 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:58:08.283905 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:58:08.283905 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:58:08.283905 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:58:08.283905 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:58:08.283905 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:58:08.283905 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:58:08.283905 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:58:08.283905 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:58:08.283905 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:58:08.283905 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:58:08.283905 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:58:08.283905 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:58:08.283905 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:58:08.283905 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:58:08.283905 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:58:08.283905 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:58:08.283905 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 7f551e6fe34243c290a25b57ab26af19 Sep 08 10:58:08.283905 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:58:08.283905 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:58:08.283905 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance a78d6e53-cc72-4cbd-95f5-e1f859062525 could not be found. Sep 08 10:58:08.283905 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': 'a78d6e53-cc72-4cbd-95f5-e1f859062525'} Sep 08 10:58:08.283905 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:58:08.283905 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:58:08.283905 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:58:08.283905 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:58:08.283905 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:58:08.283905 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:58:08.283905 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:58:08.283905 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:58:08.283905 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:58:08.283905 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:58:08.283905 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a78d6e53-cc72-4cbd-95f5-e1f859062525 could not be found. Sep 08 10:58:08.283905 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:58:08.283905 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:58:08.283905 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:58:08.283905 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:58:08.283905 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:58:08.283905 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:58:08.283905 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:58:08.283905 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:58:08.283905 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:58:08.283905 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:58:08.283905 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:58:08.283905 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:58:08.283905 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:58:08.283905 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:58:08.283905 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:58:08.283905 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:58:08.283905 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a78d6e53-cc72-4cbd-95f5-e1f859062525 could not be found. Sep 08 10:58:08.283905 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:58:08.283905 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:58:08.283905 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:58:08.287579 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:58:08.287579 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:58:08.287579 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:58:08.287579 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:58:08.287579 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:58:08.287579 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a78d6e53-cc72-4cbd-95f5-e1f859062525 could not be found. Sep 08 10:58:08.287579 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:58:08.287579 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5b7b4733-588d-4db8-bed0-e8f097900ca0 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Returning 404 to user: Instance a78d6e53-cc72-4cbd-95f5-e1f859062525 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:58:08.288172 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5b7b4733-588d-4db8-bed0-e8f097900ca0 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/a78d6e53-cc72-4cbd-95f5-e1f859062525" status: 404 len: 111 microversion: 2.1 time: 0.073088 Sep 08 10:58:08.302712 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2254/4430] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:08 2022] GET /compute/v2.1/servers/a78d6e53-cc72-4cbd-95f5-e1f859062525 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 10:58:08.307907 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bf8d5700-9a1b-409a-aefd-3d5b59ccd913 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:08.318749 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bf8d5700-9a1b-409a-aefd-3d5b59ccd913 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:08.349433 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf8d5700-9a1b-409a-aefd-3d5b59ccd913 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:08.350201 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf8d5700-9a1b-409a-aefd-3d5b59ccd913 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:08.351881 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf8d5700-9a1b-409a-aefd-3d5b59ccd913 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:08.353769 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf8d5700-9a1b-409a-aefd-3d5b59ccd913 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:08.355365 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf8d5700-9a1b-409a-aefd-3d5b59ccd913 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:08.356768 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf8d5700-9a1b-409a-aefd-3d5b59ccd913 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:08.437344 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bf8d5700-9a1b-409a-aefd-3d5b59ccd913 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:58:08.446441 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:58:08.468505 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-57f4ca50-1bb8-4985-a5d6-b09a1ddbabc9 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:08.500923 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-57f4ca50-1bb8-4985-a5d6-b09a1ddbabc9 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad" status: 200 len: 1318 microversion: 2.1 time: 1.107002 Sep 08 10:58:08.502414 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2177/4431] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:07 2022] GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad => generated 1318 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:58:08.680926 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bf8d5700-9a1b-409a-aefd-3d5b59ccd913 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "DELETE /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 204 len: 0 microversion: 2.1 time: 0.376149 Sep 08 10:58:08.684253 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2255/4432] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:58:08 2022] DELETE /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:58:08.693794 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-35877357-40ad-40cc-8cd7-f52cb23d0a7c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:08.694583 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-35877357-40ad-40cc-8cd7-f52cb23d0a7c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:08.697680 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:58:08.717711 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35877357-40ad-40cc-8cd7-f52cb23d0a7c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:08.719297 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35877357-40ad-40cc-8cd7-f52cb23d0a7c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:08.719947 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35877357-40ad-40cc-8cd7-f52cb23d0a7c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:08.731027 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35877357-40ad-40cc-8cd7-f52cb23d0a7c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:08.736206 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35877357-40ad-40cc-8cd7-f52cb23d0a7c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:08.737093 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35877357-40ad-40cc-8cd7-f52cb23d0a7c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:09.126639 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d1290421-2016-413f-ae46-f86edda07eb8 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:09.134128 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d1290421-2016-413f-ae46-f86edda07eb8 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] [instance: 931569b4-139a-4939-abf3-49a589eb1d91] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:09.152418 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d1290421-2016-413f-ae46-f86edda07eb8 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:09.152922 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d1290421-2016-413f-ae46-f86edda07eb8 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:09.157300 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d1290421-2016-413f-ae46-f86edda07eb8 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:09.160148 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d1290421-2016-413f-ae46-f86edda07eb8 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:09.161370 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d1290421-2016-413f-ae46-f86edda07eb8 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:09.162046 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d1290421-2016-413f-ae46-f86edda07eb8 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:09.589830 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-35877357-40ad-40cc-8cd7-f52cb23d0a7c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:09.618989 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-35877357-40ad-40cc-8cd7-f52cb23d0a7c tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1510 microversion: 2.1 time: 0.928221 Sep 08 10:58:09.641322 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2178/4433] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:08 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1510 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:58:09.651312 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5ab8e7f2-cae1-45c4-90e7-9a568a2b4ba3 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:09.652470 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5ab8e7f2-cae1-45c4-90e7-9a568a2b4ba3 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: 82458f68-8fcf-4d1f-8e7b-87d76f3576ad] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:09.675732 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ab8e7f2-cae1-45c4-90e7-9a568a2b4ba3 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:09.676543 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ab8e7f2-cae1-45c4-90e7-9a568a2b4ba3 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:09.677179 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ab8e7f2-cae1-45c4-90e7-9a568a2b4ba3 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:09.678165 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ab8e7f2-cae1-45c4-90e7-9a568a2b4ba3 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:09.678851 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ab8e7f2-cae1-45c4-90e7-9a568a2b4ba3 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:09.679451 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ab8e7f2-cae1-45c4-90e7-9a568a2b4ba3 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:10.115279 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5ab8e7f2-cae1-45c4-90e7-9a568a2b4ba3 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:10.127910 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5ab8e7f2-cae1-45c4-90e7-9a568a2b4ba3 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad" status: 200 len: 1318 microversion: 2.1 time: 0.482599 Sep 08 10:58:10.128802 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2179/4434] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:09 2022] GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad => generated 1318 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:58:10.431724 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-122e193a-b2be-4877-abdb-84de9df7e99e req-e63fb324-0c3a-4cd1-89b3-7c8887bcfa9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "931569b4-139a-4939-abf3-49a589eb1d91", "name": "network-vif-deleted", "tag": "5479ce77-c509-4787-8670-94752e80b0c7"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:58:10.455661 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-122e193a-b2be-4877-abdb-84de9df7e99e req-e63fb324-0c3a-4cd1-89b3-7c8887bcfa9b service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:10.457341 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-122e193a-b2be-4877-abdb-84de9df7e99e req-e63fb324-0c3a-4cd1-89b3-7c8887bcfa9b service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:10.459166 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-122e193a-b2be-4877-abdb-84de9df7e99e req-e63fb324-0c3a-4cd1-89b3-7c8887bcfa9b service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:10.504077 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-122e193a-b2be-4877-abdb-84de9df7e99e req-e63fb324-0c3a-4cd1-89b3-7c8887bcfa9b service nova] Creating event network-vif-deleted:5479ce77-c509-4787-8670-94752e80b0c7 for instance 931569b4-139a-4939-abf3-49a589eb1d91 on n-h1-850501-12 Sep 08 10:58:10.533851 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-122e193a-b2be-4877-abdb-84de9df7e99e req-e63fb324-0c3a-4cd1-89b3-7c8887bcfa9b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107226 Sep 08 10:58:10.536298 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2180/4435] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:58:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:58:10.628042 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d1290421-2016-413f-ae46-f86edda07eb8 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a779e85e1c493985f7cfe8aceb9c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4478d0e315d948df9eda910f205646c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:10.654649 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-565af109-3545-479d-9428-89806a05da0e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:10.655543 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-565af109-3545-479d-9428-89806a05da0e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:10.669680 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-565af109-3545-479d-9428-89806a05da0e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:10.670717 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d1290421-2016-413f-ae46-f86edda07eb8 tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] 10.222.0.27 "GET /compute/v2.1/servers/931569b4-139a-4939-abf3-49a589eb1d91" status: 200 len: 1518 microversion: 2.1 time: 1.569800 Sep 08 10:58:10.672587 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-565af109-3545-479d-9428-89806a05da0e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:10.673752 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-565af109-3545-479d-9428-89806a05da0e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:10.675048 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-565af109-3545-479d-9428-89806a05da0e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:10.676917 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-565af109-3545-479d-9428-89806a05da0e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:10.679619 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-565af109-3545-479d-9428-89806a05da0e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:10.682924 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2256/4436] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:09 2022] GET /compute/v2.1/servers/931569b4-139a-4939-abf3-49a589eb1d91 => generated 1518 bytes in 1586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:58:11.153978 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d26d4cb8-37ee-44ab-af66-0bc51fec9a16 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:11.155069 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d26d4cb8-37ee-44ab-af66-0bc51fec9a16 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: 82458f68-8fcf-4d1f-8e7b-87d76f3576ad] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:11.174162 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d26d4cb8-37ee-44ab-af66-0bc51fec9a16 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:11.175088 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d26d4cb8-37ee-44ab-af66-0bc51fec9a16 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:11.177519 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d26d4cb8-37ee-44ab-af66-0bc51fec9a16 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:11.182474 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d26d4cb8-37ee-44ab-af66-0bc51fec9a16 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:11.186425 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d26d4cb8-37ee-44ab-af66-0bc51fec9a16 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:11.188093 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d26d4cb8-37ee-44ab-af66-0bc51fec9a16 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:11.437049 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-565af109-3545-479d-9428-89806a05da0e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:11.460643 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-565af109-3545-479d-9428-89806a05da0e tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1510 microversion: 2.1 time: 0.811485 Sep 08 10:58:11.463726 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2181/4437] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:10 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1510 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:58:11.720060 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a53c1cec-ac42-49f1-b192-f58b1788c2fd tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:11.722336 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a53c1cec-ac42-49f1-b192-f58b1788c2fd tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] [instance: 931569b4-139a-4939-abf3-49a589eb1d91] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:11.735676 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a53c1cec-ac42-49f1-b192-f58b1788c2fd tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:11.737604 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a53c1cec-ac42-49f1-b192-f58b1788c2fd tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:11.740427 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a53c1cec-ac42-49f1-b192-f58b1788c2fd tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:11.742292 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a53c1cec-ac42-49f1-b192-f58b1788c2fd tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:11.747479 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a53c1cec-ac42-49f1-b192-f58b1788c2fd tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:11.748567 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a53c1cec-ac42-49f1-b192-f58b1788c2fd tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:11.853306 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a53c1cec-ac42-49f1-b192-f58b1788c2fd tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:11.854138 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a53c1cec-ac42-49f1-b192-f58b1788c2fd tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:11.856141 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a53c1cec-ac42-49f1-b192-f58b1788c2fd tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:11.856972 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-a53c1cec-ac42-49f1-b192-f58b1788c2fd tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lazy-loading 'fault' on Instance uuid 931569b4-139a-4939-abf3-49a589eb1d91 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:58:11.863268 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d26d4cb8-37ee-44ab-af66-0bc51fec9a16 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:11.876068 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d26d4cb8-37ee-44ab-af66-0bc51fec9a16 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad" status: 200 len: 1318 microversion: 2.1 time: 0.726352 Sep 08 10:58:11.878067 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2257/4438] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:11 2022] GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad => generated 1318 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:58:12.058067 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a53c1cec-ac42-49f1-b192-f58b1788c2fd tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a779e85e1c493985f7cfe8aceb9c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4478d0e315d948df9eda910f205646c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:12.071823 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a53c1cec-ac42-49f1-b192-f58b1788c2fd tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] 10.222.0.27 "GET /compute/v2.1/servers/931569b4-139a-4939-abf3-49a589eb1d91" status: 200 len: 1311 microversion: 2.1 time: 0.358353 Sep 08 10:58:12.101602 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2182/4439] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:11 2022] GET /compute/v2.1/servers/931569b4-139a-4939-abf3-49a589eb1d91 => generated 1311 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:58:12.494968 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bf405300-27eb-475e-b507-713f579a6d06 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:12.495856 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bf405300-27eb-475e-b507-713f579a6d06 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:12.511886 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf405300-27eb-475e-b507-713f579a6d06 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:12.511886 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf405300-27eb-475e-b507-713f579a6d06 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:12.511886 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf405300-27eb-475e-b507-713f579a6d06 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:12.511886 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf405300-27eb-475e-b507-713f579a6d06 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:12.511886 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf405300-27eb-475e-b507-713f579a6d06 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:12.512588 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf405300-27eb-475e-b507-713f579a6d06 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:12.584875 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf405300-27eb-475e-b507-713f579a6d06 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:12.585530 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf405300-27eb-475e-b507-713f579a6d06 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:12.586233 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf405300-27eb-475e-b507-713f579a6d06 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:12.586930 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-bf405300-27eb-475e-b507-713f579a6d06 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lazy-loading 'fault' on Instance uuid 74eebde7-4328-4ddf-be14-bb9fba70ec03 {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:58:12.608140 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-ad3c61f0-ff5b-458d-a9e4-a599806ded28 req-6ad9fbf3-a6de-49b6-b3e3-cd68a8048479 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74eebde7-4328-4ddf-be14-bb9fba70ec03", "name": "network-vif-deleted", "tag": "15f823c3-a4f6-4444-a294-abb10fd52df7"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:58:12.656163 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ad3c61f0-ff5b-458d-a9e4-a599806ded28 req-6ad9fbf3-a6de-49b6-b3e3-cd68a8048479 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:12.658910 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ad3c61f0-ff5b-458d-a9e4-a599806ded28 req-6ad9fbf3-a6de-49b6-b3e3-cd68a8048479 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:12.659800 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ad3c61f0-ff5b-458d-a9e4-a599806ded28 req-6ad9fbf3-a6de-49b6-b3e3-cd68a8048479 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:12.676934 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-ad3c61f0-ff5b-458d-a9e4-a599806ded28 req-6ad9fbf3-a6de-49b6-b3e3-cd68a8048479 service nova] Creating event network-vif-deleted:15f823c3-a4f6-4444-a294-abb10fd52df7 for instance 74eebde7-4328-4ddf-be14-bb9fba70ec03 on n-h1-850501-12 Sep 08 10:58:12.684027 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-ad3c61f0-ff5b-458d-a9e4-a599806ded28 req-6ad9fbf3-a6de-49b6-b3e3-cd68a8048479 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089750 Sep 08 10:58:12.689573 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2183/4440] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:58:12.754810 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-bf405300-27eb-475e-b507-713f579a6d06 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f551e6fe34243c290a25b57ab26af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6150571a49ee49df9aebb749b57e7db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:12.776820 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bf405300-27eb-475e-b507-713f579a6d06 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 200 len: 1306 microversion: 2.1 time: 0.282408 Sep 08 10:58:12.778957 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2258/4441] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:12 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 1306 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:58:12.925967 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-607f33b1-47b3-4c82-9fd4-9d0d75fe1997 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:12.927886 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-607f33b1-47b3-4c82-9fd4-9d0d75fe1997 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: 82458f68-8fcf-4d1f-8e7b-87d76f3576ad] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:12.946899 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-607f33b1-47b3-4c82-9fd4-9d0d75fe1997 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:12.947573 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-607f33b1-47b3-4c82-9fd4-9d0d75fe1997 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:12.948211 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-607f33b1-47b3-4c82-9fd4-9d0d75fe1997 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:12.948964 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-607f33b1-47b3-4c82-9fd4-9d0d75fe1997 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:12.949478 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-607f33b1-47b3-4c82-9fd4-9d0d75fe1997 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:12.949912 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-607f33b1-47b3-4c82-9fd4-9d0d75fe1997 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:13.121063 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-92c33542-c9d0-4a13-8ab5-6ea51a9fdf0d tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:13.126614 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-92c33542-c9d0-4a13-8ab5-6ea51a9fdf0d tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] [instance: 931569b4-139a-4939-abf3-49a589eb1d91] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:13.134405 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-92c33542-c9d0-4a13-8ab5-6ea51a9fdf0d tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:13.135167 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-92c33542-c9d0-4a13-8ab5-6ea51a9fdf0d tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:13.135759 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-92c33542-c9d0-4a13-8ab5-6ea51a9fdf0d tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:13.136709 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-92c33542-c9d0-4a13-8ab5-6ea51a9fdf0d tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:13.137358 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-92c33542-c9d0-4a13-8ab5-6ea51a9fdf0d tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:13.137937 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-92c33542-c9d0-4a13-8ab5-6ea51a9fdf0d tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:13.154996 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-92c33542-c9d0-4a13-8ab5-6ea51a9fdf0d tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] HTTP exception thrown: Instance 931569b4-139a-4939-abf3-49a589eb1d91 could not be found. Sep 08 10:58:13.156885 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-92c33542-c9d0-4a13-8ab5-6ea51a9fdf0d tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Request method failure captured: Sep 08 10:58:13.156885 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/931569b4-139a-4939-abf3-49a589eb1d91 HTTP/1.1 Sep 08 10:58:13.156885 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:58:13.156885 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:58:13.156885 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:58:13.156885 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:58:13.156885 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:58:13.156885 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:58:13.156885 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:58:13.156885 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:58:13.156885 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcpTk-tjJHj9kGRXPej75R07q3Iljlbh0dY-FvwRNlK7I1XRt8Qm3z6jPmDmnHaBp30gg1KRPAmd2okZdHcNf0OnlFcsJJsxRkmaz8AFPZ15wFWWRx3ssDdd946r6ndovP-VI1B0i4IVZtl9c0XnXFwzkRpx8wGHiNNKM2kAoAg37I0 Sep 08 10:58:13.156885 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:58:13.156885 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:58:13.156885 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:58:13.156885 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:58:13.156885 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:58:13.156885 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:58:13.156885 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 4478d0e315d948df9eda910f205646c3 Sep 08 10:58:13.156885 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ListServerFiltersTestJSON-1889876693 Sep 08 10:58:13.156885 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:58:13.156885 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:58:13.156885 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4478d0e315d948df9eda910f205646c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4478d0e315d948df9eda910f205646c3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4478d0e315d948df9eda910f205646c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4478d0e315d948df9eda910f205646c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:58:13.156885 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ListServerFiltersTestJSON-1889876693 Sep 08 10:58:13.156885 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 4478d0e315d948df9eda910f205646c3 Sep 08 10:58:13.156885 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1889876693 Sep 08 10:58:13.156885 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ListServerFiltersTestJSON-1889876693-project Sep 08 10:58:13.156885 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:58:13.156885 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:58:13.156885 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 06a779e85e1c493985f7cfe8aceb9c87 Sep 08 10:58:13.156885 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ListServerFiltersTestJSON-1889876693-project Sep 08 10:58:13.156885 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:58:13.156885 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 931569b4-139a-4939-abf3-49a589eb1d91 could not be found. Sep 08 10:58:13.156885 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '931569b4-139a-4939-abf3-49a589eb1d91'} Sep 08 10:58:13.156885 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:58:13.156885 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:58:13.156885 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:58:13.156885 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:58:13.156885 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:58:13.156885 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:58:13.156885 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:58:13.156885 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:58:13.156885 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:58:13.156885 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:58:13.156885 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 931569b4-139a-4939-abf3-49a589eb1d91 could not be found. Sep 08 10:58:13.156885 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:58:13.156885 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:58:13.156885 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:58:13.156885 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:58:13.156885 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:58:13.156885 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:58:13.156885 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:58:13.156885 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:58:13.156885 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:58:13.156885 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:58:13.156885 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:58:13.156885 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:58:13.156885 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:58:13.156885 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:58:13.156885 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:58:13.156885 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:58:13.156885 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 931569b4-139a-4939-abf3-49a589eb1d91 could not be found. Sep 08 10:58:13.156885 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:58:13.156885 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:58:13.156885 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:58:13.160908 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:58:13.160908 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:58:13.160908 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:58:13.160908 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:58:13.160908 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:58:13.160908 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 931569b4-139a-4939-abf3-49a589eb1d91 could not be found. Sep 08 10:58:13.160908 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:58:13.164811 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-92c33542-c9d0-4a13-8ab5-6ea51a9fdf0d tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] Returning 404 to user: Instance 931569b4-139a-4939-abf3-49a589eb1d91 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:58:13.165908 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-92c33542-c9d0-4a13-8ab5-6ea51a9fdf0d tempest-ListServerFiltersTestJSON-1889876693 tempest-ListServerFiltersTestJSON-1889876693-project] 10.222.0.27 "GET /compute/v2.1/servers/931569b4-139a-4939-abf3-49a589eb1d91" status: 404 len: 111 microversion: 2.1 time: 0.061892 Sep 08 10:58:13.170323 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2259/4442] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:13 2022] GET /compute/v2.1/servers/931569b4-139a-4939-abf3-49a589eb1d91 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:58:13.480828 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-607f33b1-47b3-4c82-9fd4-9d0d75fe1997 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:13.489683 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-607f33b1-47b3-4c82-9fd4-9d0d75fe1997 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad" status: 200 len: 1318 microversion: 2.1 time: 0.576180 Sep 08 10:58:13.490280 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2184/4443] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:12 2022] GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad => generated 1318 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:58:13.807388 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-41b6fdcd-7865-4ba8-b403-8594f4afc2b3 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:13.808014 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-41b6fdcd-7865-4ba8-b403-8594f4afc2b3 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] [instance: 74eebde7-4328-4ddf-be14-bb9fba70ec03] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:13.816556 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41b6fdcd-7865-4ba8-b403-8594f4afc2b3 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:13.817417 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41b6fdcd-7865-4ba8-b403-8594f4afc2b3 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:13.818070 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41b6fdcd-7865-4ba8-b403-8594f4afc2b3 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:13.818775 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41b6fdcd-7865-4ba8-b403-8594f4afc2b3 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:13.819233 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41b6fdcd-7865-4ba8-b403-8594f4afc2b3 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:13.819975 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41b6fdcd-7865-4ba8-b403-8594f4afc2b3 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:13.841964 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-41b6fdcd-7865-4ba8-b403-8594f4afc2b3 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] HTTP exception thrown: Instance 74eebde7-4328-4ddf-be14-bb9fba70ec03 could not be found. Sep 08 10:58:13.843798 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-41b6fdcd-7865-4ba8-b403-8594f4afc2b3 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Request method failure captured: Sep 08 10:58:13.843798 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 HTTP/1.1 Sep 08 10:58:13.843798 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:58:13.843798 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:58:13.843798 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:58:13.843798 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:58:13.843798 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:58:13.843798 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:58:13.843798 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:58:13.843798 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:58:13.843798 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcmnspi0cCT_Ts_s7jcB6HjtEcdULbQPd_krJniB9lBsXpm1cXSOD-YMaJoaapHCxuCXz0q6Qe4WXufr5At6SSPw8ov8Oz1eUk-fSNbVp7WlOPycfCf5I6xwH7tfbsoefVfbTiDOfU9mTBl0Vs74qdfTniErHfQlEG4cAvAQl1-wMrs Sep 08 10:58:13.843798 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:58:13.843798 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:58:13.843798 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:58:13.843798 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:58:13.843798 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:58:13.843798 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:58:13.843798 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:58:13.843798 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:58:13.843798 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:58:13.843798 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:58:13.843798 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6150571a49ee49df9aebb749b57e7db5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:58:13.843798 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:58:13.843798 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 6150571a49ee49df9aebb749b57e7db5 Sep 08 10:58:13.843798 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2022221293 Sep 08 10:58:13.843798 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:58:13.843798 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:58:13.843798 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:58:13.843798 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 7f551e6fe34243c290a25b57ab26af19 Sep 08 10:58:13.843798 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServersNegativeTestJSON-2022221293-project Sep 08 10:58:13.843798 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:58:13.843798 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 74eebde7-4328-4ddf-be14-bb9fba70ec03 could not be found. Sep 08 10:58:13.843798 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '74eebde7-4328-4ddf-be14-bb9fba70ec03'} Sep 08 10:58:13.843798 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:58:13.843798 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:58:13.843798 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:58:13.843798 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:58:13.843798 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:58:13.843798 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:58:13.843798 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:58:13.843798 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:58:13.843798 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:58:13.843798 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:58:13.843798 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74eebde7-4328-4ddf-be14-bb9fba70ec03 could not be found. Sep 08 10:58:13.843798 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:58:13.843798 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:58:13.843798 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:58:13.843798 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:58:13.843798 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:58:13.843798 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:58:13.843798 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:58:13.843798 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:58:13.843798 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:58:13.843798 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:58:13.843798 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:58:13.843798 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:58:13.843798 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:58:13.843798 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:58:13.843798 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:58:13.843798 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:58:13.843798 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74eebde7-4328-4ddf-be14-bb9fba70ec03 could not be found. Sep 08 10:58:13.843798 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:58:13.843798 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:58:13.843798 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:58:13.848059 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:58:13.848059 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:58:13.848059 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:58:13.848059 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:58:13.848059 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:58:13.848059 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74eebde7-4328-4ddf-be14-bb9fba70ec03 could not be found. Sep 08 10:58:13.848059 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:58:13.849906 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-41b6fdcd-7865-4ba8-b403-8594f4afc2b3 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] Returning 404 to user: Instance 74eebde7-4328-4ddf-be14-bb9fba70ec03 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:58:13.851438 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-41b6fdcd-7865-4ba8-b403-8594f4afc2b3 tempest-ServersNegativeTestJSON-2022221293 tempest-ServersNegativeTestJSON-2022221293-project] 10.222.0.27 "GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03" status: 404 len: 111 microversion: 2.1 time: 0.048774 Sep 08 10:58:13.852247 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2260/4444] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:13 2022] GET /compute/v2.1/servers/74eebde7-4328-4ddf-be14-bb9fba70ec03 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:58:14.517042 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f5a2cf7a-8bc9-46c2-aabe-eec74b3e7284 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:14.517684 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f5a2cf7a-8bc9-46c2-aabe-eec74b3e7284 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: 82458f68-8fcf-4d1f-8e7b-87d76f3576ad] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:14.538067 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f5a2cf7a-8bc9-46c2-aabe-eec74b3e7284 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:14.541188 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f5a2cf7a-8bc9-46c2-aabe-eec74b3e7284 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:14.545352 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f5a2cf7a-8bc9-46c2-aabe-eec74b3e7284 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:14.546340 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f5a2cf7a-8bc9-46c2-aabe-eec74b3e7284 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:14.547140 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f5a2cf7a-8bc9-46c2-aabe-eec74b3e7284 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:14.547757 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f5a2cf7a-8bc9-46c2-aabe-eec74b3e7284 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:14.611795 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:58:14.914574 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f5a2cf7a-8bc9-46c2-aabe-eec74b3e7284 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:14.931392 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f5a2cf7a-8bc9-46c2-aabe-eec74b3e7284 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad" status: 200 len: 1318 microversion: 2.1 time: 0.418137 Sep 08 10:58:14.935177 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2185/4445] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:14 2022] GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad => generated 1318 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:58:15.119131 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-b736df33-f9a3-4b69-bd58-351701d4baff req-2a10fd50-02cb-4763-a1b5-bb124ef05904 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82458f68-8fcf-4d1f-8e7b-87d76f3576ad", "name": "network-vif-plugged", "status": "completed", "tag": "a5bc7eaa-9e35-436f-955a-a184196c4b6d"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:58:15.135454 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-b736df33-f9a3-4b69-bd58-351701d4baff req-2a10fd50-02cb-4763-a1b5-bb124ef05904 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:15.136238 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-b736df33-f9a3-4b69-bd58-351701d4baff req-2a10fd50-02cb-4763-a1b5-bb124ef05904 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:15.137015 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-b736df33-f9a3-4b69-bd58-351701d4baff req-2a10fd50-02cb-4763-a1b5-bb124ef05904 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:15.154381 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-b736df33-f9a3-4b69-bd58-351701d4baff req-2a10fd50-02cb-4763-a1b5-bb124ef05904 service nova] Creating event network-vif-plugged:a5bc7eaa-9e35-436f-955a-a184196c4b6d for instance 82458f68-8fcf-4d1f-8e7b-87d76f3576ad on n-h2-850501-12 Sep 08 10:58:15.162751 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-b736df33-f9a3-4b69-bd58-351701d4baff req-2a10fd50-02cb-4763-a1b5-bb124ef05904 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046691 Sep 08 10:58:15.164064 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2261/4446] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:58:15.969445 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-52c3f183-5b2c-4193-95e9-9a0e5b75a282 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:15.970885 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-52c3f183-5b2c-4193-95e9-9a0e5b75a282 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: 82458f68-8fcf-4d1f-8e7b-87d76f3576ad] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:16.031071 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-52c3f183-5b2c-4193-95e9-9a0e5b75a282 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:16.039183 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-52c3f183-5b2c-4193-95e9-9a0e5b75a282 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:16.039944 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-52c3f183-5b2c-4193-95e9-9a0e5b75a282 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:16.043502 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-52c3f183-5b2c-4193-95e9-9a0e5b75a282 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:16.045264 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-52c3f183-5b2c-4193-95e9-9a0e5b75a282 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:16.048682 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-52c3f183-5b2c-4193-95e9-9a0e5b75a282 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:16.906880 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-52c3f183-5b2c-4193-95e9-9a0e5b75a282 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:16.970577 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-52c3f183-5b2c-4193-95e9-9a0e5b75a282 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad" status: 200 len: 1318 microversion: 2.1 time: 1.013505 Sep 08 10:58:16.972935 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2186/4447] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:15 2022] GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad => generated 1318 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:58:18.002256 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-97848379-923e-4001-a9f5-0009b48ac483 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:18.003700 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-97848379-923e-4001-a9f5-0009b48ac483 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: 82458f68-8fcf-4d1f-8e7b-87d76f3576ad] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:18.017491 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-97848379-923e-4001-a9f5-0009b48ac483 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:18.018735 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-97848379-923e-4001-a9f5-0009b48ac483 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:18.019755 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-97848379-923e-4001-a9f5-0009b48ac483 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:18.020680 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-97848379-923e-4001-a9f5-0009b48ac483 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:18.021421 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-97848379-923e-4001-a9f5-0009b48ac483 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:18.022622 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-97848379-923e-4001-a9f5-0009b48ac483 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:19.289861 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-97848379-923e-4001-a9f5-0009b48ac483 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:19.307449 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-97848379-923e-4001-a9f5-0009b48ac483 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad" status: 200 len: 1508 microversion: 2.1 time: 1.311460 Sep 08 10:58:19.308771 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2262/4448] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:17 2022] GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad => generated 1508 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:58:19.336034 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a9bbc997-329c-4386-a0c8-ff2ef7108748 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:19.338145 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a9bbc997-329c-4386-a0c8-ff2ef7108748 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: 82458f68-8fcf-4d1f-8e7b-87d76f3576ad] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:19.347254 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a9bbc997-329c-4386-a0c8-ff2ef7108748 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:19.347990 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a9bbc997-329c-4386-a0c8-ff2ef7108748 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:19.348578 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a9bbc997-329c-4386-a0c8-ff2ef7108748 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:19.350337 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a9bbc997-329c-4386-a0c8-ff2ef7108748 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:19.351563 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a9bbc997-329c-4386-a0c8-ff2ef7108748 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:19.352876 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a9bbc997-329c-4386-a0c8-ff2ef7108748 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:19.735568 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a9bbc997-329c-4386-a0c8-ff2ef7108748 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:19.753748 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a9bbc997-329c-4386-a0c8-ff2ef7108748 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad" status: 200 len: 1508 microversion: 2.1 time: 0.424593 Sep 08 10:58:19.780320 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2187/4449] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:19 2022] GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad => generated 1508 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:58:19.789915 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d369c456-5b48-47d5-be17-acee3f9bd7c8 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "OS-DCF:diskConfig": "AUTO"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:58:19.794983 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d369c456-5b48-47d5-be17-acee3f9bd7c8 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: 82458f68-8fcf-4d1f-8e7b-87d76f3576ad] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:19.814242 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d369c456-5b48-47d5-be17-acee3f9bd7c8 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:19.814807 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d369c456-5b48-47d5-be17-acee3f9bd7c8 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:19.815430 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d369c456-5b48-47d5-be17-acee3f9bd7c8 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:19.819288 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d369c456-5b48-47d5-be17-acee3f9bd7c8 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:19.820588 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d369c456-5b48-47d5-be17-acee3f9bd7c8 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:19.824594 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d369c456-5b48-47d5-be17-acee3f9bd7c8 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:20.073246 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-d369c456-5b48-47d5-be17-acee3f9bd7c8 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:58:20.073769 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-d369c456-5b48-47d5-be17-acee3f9bd7c8 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:58:20.074322 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-d369c456-5b48-47d5-be17-acee3f9bd7c8 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:58:20.074917 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-d369c456-5b48-47d5-be17-acee3f9bd7c8 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:58:20.075403 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-d369c456-5b48-47d5-be17-acee3f9bd7c8 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:58:20.188524 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d369c456-5b48-47d5-be17-acee3f9bd7c8 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: 82458f68-8fcf-4d1f-8e7b-87d76f3576ad] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:20.198276 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d369c456-5b48-47d5-be17-acee3f9bd7c8 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:20.199013 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d369c456-5b48-47d5-be17-acee3f9bd7c8 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:20.199643 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d369c456-5b48-47d5-be17-acee3f9bd7c8 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:20.200658 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d369c456-5b48-47d5-be17-acee3f9bd7c8 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:20.201830 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d369c456-5b48-47d5-be17-acee3f9bd7c8 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:20.202727 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d369c456-5b48-47d5-be17-acee3f9bd7c8 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:20.248889 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d369c456-5b48-47d5-be17-acee3f9bd7c8 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "POST /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad/action" status: 202 len: 1110 microversion: 2.1 time: 0.467951 Sep 08 10:58:20.251106 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2263/4450] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:58:19 2022] POST /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad/action => generated 1110 bytes in 472 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 08 10:58:20.285825 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f62d6ce9-df4c-43c6-a410-7164774f4dd0 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:20.287553 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f62d6ce9-df4c-43c6-a410-7164774f4dd0 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: 82458f68-8fcf-4d1f-8e7b-87d76f3576ad] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:20.302433 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f62d6ce9-df4c-43c6-a410-7164774f4dd0 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:20.305769 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f62d6ce9-df4c-43c6-a410-7164774f4dd0 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:20.307294 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f62d6ce9-df4c-43c6-a410-7164774f4dd0 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:20.308939 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f62d6ce9-df4c-43c6-a410-7164774f4dd0 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:20.309720 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f62d6ce9-df4c-43c6-a410-7164774f4dd0 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:20.310436 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f62d6ce9-df4c-43c6-a410-7164774f4dd0 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:20.848507 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f62d6ce9-df4c-43c6-a410-7164774f4dd0 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:20.860354 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f62d6ce9-df4c-43c6-a410-7164774f4dd0 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad" status: 200 len: 1515 microversion: 2.1 time: 0.593153 Sep 08 10:58:20.861552 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2188/4451] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:20 2022] GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad => generated 1515 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:58:21.887155 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f00c4d81-7a0a-4c87-bee7-4bfc031053ad tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:21.888705 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f00c4d81-7a0a-4c87-bee7-4bfc031053ad tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: 82458f68-8fcf-4d1f-8e7b-87d76f3576ad] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:21.906548 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f00c4d81-7a0a-4c87-bee7-4bfc031053ad tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:21.907486 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f00c4d81-7a0a-4c87-bee7-4bfc031053ad tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:21.908777 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f00c4d81-7a0a-4c87-bee7-4bfc031053ad tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:21.910114 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f00c4d81-7a0a-4c87-bee7-4bfc031053ad tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:21.914911 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f00c4d81-7a0a-4c87-bee7-4bfc031053ad tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:21.915690 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f00c4d81-7a0a-4c87-bee7-4bfc031053ad tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:22.335174 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f00c4d81-7a0a-4c87-bee7-4bfc031053ad tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:22.354016 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f00c4d81-7a0a-4c87-bee7-4bfc031053ad tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad" status: 200 len: 1515 microversion: 2.1 time: 0.463616 Sep 08 10:58:22.354701 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2264/4452] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:21 2022] GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad => generated 1515 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:58:23.388044 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8359db5f-9d82-4981-ab31-eee81cfdc5f6 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:23.388575 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8359db5f-9d82-4981-ab31-eee81cfdc5f6 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: 82458f68-8fcf-4d1f-8e7b-87d76f3576ad] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:23.400181 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8359db5f-9d82-4981-ab31-eee81cfdc5f6 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:23.400686 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8359db5f-9d82-4981-ab31-eee81cfdc5f6 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:23.403483 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8359db5f-9d82-4981-ab31-eee81cfdc5f6 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:23.404274 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8359db5f-9d82-4981-ab31-eee81cfdc5f6 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:23.404819 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8359db5f-9d82-4981-ab31-eee81cfdc5f6 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:23.407751 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8359db5f-9d82-4981-ab31-eee81cfdc5f6 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:24.064805 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8359db5f-9d82-4981-ab31-eee81cfdc5f6 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:24.079821 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8359db5f-9d82-4981-ab31-eee81cfdc5f6 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad" status: 200 len: 1515 microversion: 2.1 time: 0.702167 Sep 08 10:58:24.080620 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2189/4453] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:23 2022] GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad => generated 1515 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:58:25.111925 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e2c76212-e8c9-48d0-9e5a-7dc8412c7003 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:25.113462 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e2c76212-e8c9-48d0-9e5a-7dc8412c7003 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: 82458f68-8fcf-4d1f-8e7b-87d76f3576ad] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:25.127252 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:58:25.131252 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e2c76212-e8c9-48d0-9e5a-7dc8412c7003 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:25.134195 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e2c76212-e8c9-48d0-9e5a-7dc8412c7003 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:25.134980 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e2c76212-e8c9-48d0-9e5a-7dc8412c7003 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:25.138981 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e2c76212-e8c9-48d0-9e5a-7dc8412c7003 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:25.159644 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e2c76212-e8c9-48d0-9e5a-7dc8412c7003 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:25.161146 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e2c76212-e8c9-48d0-9e5a-7dc8412c7003 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:25.815608 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e2c76212-e8c9-48d0-9e5a-7dc8412c7003 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:25.834899 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e2c76212-e8c9-48d0-9e5a-7dc8412c7003 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad" status: 200 len: 1515 microversion: 2.1 time: 0.735276 Sep 08 10:58:25.845198 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2265/4454] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:25 2022] GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad => generated 1515 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:58:26.859677 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f6ca435a-1054-40be-93ec-c5dcc2720a39 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:26.860960 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f6ca435a-1054-40be-93ec-c5dcc2720a39 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: 82458f68-8fcf-4d1f-8e7b-87d76f3576ad] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:26.876307 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f6ca435a-1054-40be-93ec-c5dcc2720a39 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:26.876307 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f6ca435a-1054-40be-93ec-c5dcc2720a39 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:26.879925 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f6ca435a-1054-40be-93ec-c5dcc2720a39 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:26.882230 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f6ca435a-1054-40be-93ec-c5dcc2720a39 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:26.886243 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f6ca435a-1054-40be-93ec-c5dcc2720a39 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:26.886977 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f6ca435a-1054-40be-93ec-c5dcc2720a39 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:28.120949 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f6ca435a-1054-40be-93ec-c5dcc2720a39 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:28.132571 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f6ca435a-1054-40be-93ec-c5dcc2720a39 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad" status: 200 len: 1515 microversion: 2.1 time: 1.277799 Sep 08 10:58:28.136652 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2190/4455] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:26 2022] GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad => generated 1515 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:58:28.736418 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-43cf52c5-1ed6-44bd-8465-4c63e3b22654 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1240950759", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "72f99669-ed73-4bbc-8751-e9819047240e"}]}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:58:28.847627 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-43cf52c5-1ed6-44bd-8465-4c63e3b22654 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] validate_networks() for [('72f99669-ed73-4bbc-8751-e9819047240e', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:58:29.163077 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-39b5495d-b791-42b3-a9e7-ba83f1d25e97 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:29.164741 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-39b5495d-b791-42b3-a9e7-ba83f1d25e97 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: 82458f68-8fcf-4d1f-8e7b-87d76f3576ad] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:29.178794 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-39b5495d-b791-42b3-a9e7-ba83f1d25e97 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:29.183389 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-39b5495d-b791-42b3-a9e7-ba83f1d25e97 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:29.185681 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-39b5495d-b791-42b3-a9e7-ba83f1d25e97 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:29.186645 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-39b5495d-b791-42b3-a9e7-ba83f1d25e97 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:29.189456 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-39b5495d-b791-42b3-a9e7-ba83f1d25e97 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:29.190091 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-39b5495d-b791-42b3-a9e7-ba83f1d25e97 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:29.627304 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-39b5495d-b791-42b3-a9e7-ba83f1d25e97 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:29.693330 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-39b5495d-b791-42b3-a9e7-ba83f1d25e97 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad" status: 200 len: 1515 microversion: 2.1 time: 0.534360 Sep 08 10:58:29.694520 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2191/4456] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:29 2022] GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad => generated 1515 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:58:30.599002 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-43cf52c5-1ed6-44bd-8465-4c63e3b22654 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:58:30.600196 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-43cf52c5-1ed6-44bd-8465-4c63e3b22654 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:58:30.600690 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-43cf52c5-1ed6-44bd-8465-4c63e3b22654 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:58:30.601204 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-43cf52c5-1ed6-44bd-8465-4c63e3b22654 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:58:30.601551 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-43cf52c5-1ed6-44bd-8465-4c63e3b22654 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:58:30.631387 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-43cf52c5-1ed6-44bd-8465-4c63e3b22654 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:30.642780 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-43cf52c5-1ed6-44bd-8465-4c63e3b22654 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:30.651359 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-43cf52c5-1ed6-44bd-8465-4c63e3b22654 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:30.653640 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-43cf52c5-1ed6-44bd-8465-4c63e3b22654 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:30.655828 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-43cf52c5-1ed6-44bd-8465-4c63e3b22654 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:30.657603 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-43cf52c5-1ed6-44bd-8465-4c63e3b22654 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:30.725586 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ef0eeb58-a3af-47e1-a4c8-5047086c42c7 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:30.728227 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ef0eeb58-a3af-47e1-a4c8-5047086c42c7 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: 82458f68-8fcf-4d1f-8e7b-87d76f3576ad] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:30.749099 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-43cf52c5-1ed6-44bd-8465-4c63e3b22654 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Getting quotas for project ae429b36d3af4e708071ee7be5974025. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:58:30.756954 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef0eeb58-a3af-47e1-a4c8-5047086c42c7 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:30.757734 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef0eeb58-a3af-47e1-a4c8-5047086c42c7 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:30.762798 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef0eeb58-a3af-47e1-a4c8-5047086c42c7 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:30.763810 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef0eeb58-a3af-47e1-a4c8-5047086c42c7 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:30.765848 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef0eeb58-a3af-47e1-a4c8-5047086c42c7 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:30.767262 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef0eeb58-a3af-47e1-a4c8-5047086c42c7 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:30.773880 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-43cf52c5-1ed6-44bd-8465-4c63e3b22654 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Getting quotas for user 27627bddc6b144188fc4cc1f9e8b677f and project ae429b36d3af4e708071ee7be5974025. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:58:30.838371 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-43cf52c5-1ed6-44bd-8465-4c63e3b22654 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:58:30.846122 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-43cf52c5-1ed6-44bd-8465-4c63e3b22654 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] [instance: 05840cb4-7e09-49c5-8d55-a94dbfe241ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:58:30.984565 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-43cf52c5-1ed6-44bd-8465-4c63e3b22654 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 2.870246 Sep 08 10:58:30.985885 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2266/4457] 10.222.0.27 () {62 vars in 1188 bytes} [Thu Sep 8 10:58:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 2873 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 08 10:58:30.996979 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4d51b775-c65a-4a63-99dd-2697882add5a tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:30.997914 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4d51b775-c65a-4a63-99dd-2697882add5a tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] [instance: 05840cb4-7e09-49c5-8d55-a94dbfe241ae] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:31.235761 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4d51b775-c65a-4a63-99dd-2697882add5a tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27627bddc6b144188fc4cc1f9e8b677f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae429b36d3af4e708071ee7be5974025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:31.253784 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4d51b775-c65a-4a63-99dd-2697882add5a tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27627bddc6b144188fc4cc1f9e8b677f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae429b36d3af4e708071ee7be5974025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:31.258825 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4d51b775-c65a-4a63-99dd-2697882add5a tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27627bddc6b144188fc4cc1f9e8b677f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae429b36d3af4e708071ee7be5974025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:31.267976 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4d51b775-c65a-4a63-99dd-2697882add5a tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] 10.222.0.27 "GET /compute/v2.1/servers/05840cb4-7e09-49c5-8d55-a94dbfe241ae" status: 200 len: 1262 microversion: 2.26 time: 0.274724 Sep 08 10:58:31.277898 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2267/4458] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:58:30 2022] GET /compute/v2.1/servers/05840cb4-7e09-49c5-8d55-a94dbfe241ae => generated 1262 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:58:31.349956 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ef0eeb58-a3af-47e1-a4c8-5047086c42c7 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:31.366890 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ef0eeb58-a3af-47e1-a4c8-5047086c42c7 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad" status: 200 len: 1515 microversion: 2.1 time: 0.647311 Sep 08 10:58:31.370629 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2192/4459] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:30 2022] GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad => generated 1515 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:58:32.023020 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b0fc150c-bc73-4df9-8de5-6c21c6f1f62b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:58:32.027260 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b0fc150c-bc73-4df9-8de5-6c21c6f1f62b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:32.052283 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b0fc150c-bc73-4df9-8de5-6c21c6f1f62b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:32.055918 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b0fc150c-bc73-4df9-8de5-6c21c6f1f62b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:32.059181 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b0fc150c-bc73-4df9-8de5-6c21c6f1f62b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:32.060763 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b0fc150c-bc73-4df9-8de5-6c21c6f1f62b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:32.071444 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b0fc150c-bc73-4df9-8de5-6c21c6f1f62b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:32.074043 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b0fc150c-bc73-4df9-8de5-6c21c6f1f62b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:32.305389 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-29c17c41-c021-4738-b593-d125ecc0c4a0 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:32.305910 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b0fc150c-bc73-4df9-8de5-6c21c6f1f62b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "POST /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7/action" status: 202 len: 0 microversion: 2.1 time: 0.280577 Sep 08 10:58:32.306000 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-29c17c41-c021-4738-b593-d125ecc0c4a0 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] [instance: 05840cb4-7e09-49c5-8d55-a94dbfe241ae] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:32.308411 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2268/4460] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:58:32 2022] POST /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:58:32.317616 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-29c17c41-c021-4738-b593-d125ecc0c4a0 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:32.327103 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-29c17c41-c021-4738-b593-d125ecc0c4a0 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:32.329423 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-29c17c41-c021-4738-b593-d125ecc0c4a0 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:32.330388 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-29c17c41-c021-4738-b593-d125ecc0c4a0 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:32.336294 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-29c17c41-c021-4738-b593-d125ecc0c4a0 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:32.337169 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-29c17c41-c021-4738-b593-d125ecc0c4a0 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:32.339636 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-14228841-a8ba-402d-90e5-cfb0ae80f0c4 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:32.342738 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-14228841-a8ba-402d-90e5-cfb0ae80f0c4 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:32.370932 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-14228841-a8ba-402d-90e5-cfb0ae80f0c4 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:32.371469 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-14228841-a8ba-402d-90e5-cfb0ae80f0c4 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:32.373156 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-14228841-a8ba-402d-90e5-cfb0ae80f0c4 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:32.377218 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-14228841-a8ba-402d-90e5-cfb0ae80f0c4 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:32.379180 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-14228841-a8ba-402d-90e5-cfb0ae80f0c4 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:32.379852 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-14228841-a8ba-402d-90e5-cfb0ae80f0c4 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:33.199523 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-14228841-a8ba-402d-90e5-cfb0ae80f0c4 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:33.218385 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-14228841-a8ba-402d-90e5-cfb0ae80f0c4 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1673 microversion: 2.1 time: 0.904836 Sep 08 10:58:33.221463 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2269/4461] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:32 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1673 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:58:33.233651 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a003f348-5b24-451f-b580-f0eccfc7a661 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:33.234740 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a003f348-5b24-451f-b580-f0eccfc7a661 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: 82458f68-8fcf-4d1f-8e7b-87d76f3576ad] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:33.263561 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a003f348-5b24-451f-b580-f0eccfc7a661 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:33.266066 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a003f348-5b24-451f-b580-f0eccfc7a661 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:33.266703 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a003f348-5b24-451f-b580-f0eccfc7a661 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:33.267642 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a003f348-5b24-451f-b580-f0eccfc7a661 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:33.269271 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a003f348-5b24-451f-b580-f0eccfc7a661 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:33.273112 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a003f348-5b24-451f-b580-f0eccfc7a661 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:33.736662 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a003f348-5b24-451f-b580-f0eccfc7a661 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:33.754404 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a003f348-5b24-451f-b580-f0eccfc7a661 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad" status: 200 len: 1515 microversion: 2.1 time: 0.530435 Sep 08 10:58:33.757122 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2270/4462] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:33 2022] GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad => generated 1515 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:58:33.963677 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-29c17c41-c021-4738-b593-d125ecc0c4a0 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27627bddc6b144188fc4cc1f9e8b677f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae429b36d3af4e708071ee7be5974025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:33.981407 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-29c17c41-c021-4738-b593-d125ecc0c4a0 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27627bddc6b144188fc4cc1f9e8b677f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae429b36d3af4e708071ee7be5974025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:33.985176 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-29c17c41-c021-4738-b593-d125ecc0c4a0 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27627bddc6b144188fc4cc1f9e8b677f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae429b36d3af4e708071ee7be5974025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:33.995501 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-29c17c41-c021-4738-b593-d125ecc0c4a0 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] 10.222.0.27 "GET /compute/v2.1/servers/05840cb4-7e09-49c5-8d55-a94dbfe241ae" status: 200 len: 1266 microversion: 2.26 time: 1.699444 Sep 08 10:58:33.998127 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2193/4463] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:58:32 2022] GET /compute/v2.1/servers/05840cb4-7e09-49c5-8d55-a94dbfe241ae => generated 1266 bytes in 1703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:58:34.256626 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e7aafec4-a92b-4e0e-a033-6fe15eb028f0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:34.259063 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e7aafec4-a92b-4e0e-a033-6fe15eb028f0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:34.304118 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e7aafec4-a92b-4e0e-a033-6fe15eb028f0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:34.310960 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e7aafec4-a92b-4e0e-a033-6fe15eb028f0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:34.311912 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e7aafec4-a92b-4e0e-a033-6fe15eb028f0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:34.321835 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e7aafec4-a92b-4e0e-a033-6fe15eb028f0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:34.322490 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e7aafec4-a92b-4e0e-a033-6fe15eb028f0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:34.322882 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e7aafec4-a92b-4e0e-a033-6fe15eb028f0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:34.352348 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:58:34.786635 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7bf6bf94-4e08-475d-b1b6-672e8454100b tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:34.787773 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7bf6bf94-4e08-475d-b1b6-672e8454100b tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: 82458f68-8fcf-4d1f-8e7b-87d76f3576ad] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:34.805485 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7bf6bf94-4e08-475d-b1b6-672e8454100b tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:34.816345 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7bf6bf94-4e08-475d-b1b6-672e8454100b tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:34.820314 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7bf6bf94-4e08-475d-b1b6-672e8454100b tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:34.821567 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7bf6bf94-4e08-475d-b1b6-672e8454100b tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:34.822089 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7bf6bf94-4e08-475d-b1b6-672e8454100b tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:34.826367 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7bf6bf94-4e08-475d-b1b6-672e8454100b tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:35.370231 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e7aafec4-a92b-4e0e-a033-6fe15eb028f0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:35.384489 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e7aafec4-a92b-4e0e-a033-6fe15eb028f0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1673 microversion: 2.1 time: 1.141352 Sep 08 10:58:35.389519 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2271/4464] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:34 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1673 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:58:35.394582 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-129851f7-0531-43bc-ae5b-94093e59de48 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:35.399914 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-129851f7-0531-43bc-ae5b-94093e59de48 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] [instance: 05840cb4-7e09-49c5-8d55-a94dbfe241ae] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:35.417338 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-129851f7-0531-43bc-ae5b-94093e59de48 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:35.418102 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-129851f7-0531-43bc-ae5b-94093e59de48 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:35.418755 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-129851f7-0531-43bc-ae5b-94093e59de48 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:35.419679 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-129851f7-0531-43bc-ae5b-94093e59de48 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:35.420697 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-129851f7-0531-43bc-ae5b-94093e59de48 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:35.421335 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-129851f7-0531-43bc-ae5b-94093e59de48 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:35.542700 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-129851f7-0531-43bc-ae5b-94093e59de48 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27627bddc6b144188fc4cc1f9e8b677f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae429b36d3af4e708071ee7be5974025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:35.557376 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-129851f7-0531-43bc-ae5b-94093e59de48 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27627bddc6b144188fc4cc1f9e8b677f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae429b36d3af4e708071ee7be5974025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:35.563613 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-129851f7-0531-43bc-ae5b-94093e59de48 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27627bddc6b144188fc4cc1f9e8b677f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae429b36d3af4e708071ee7be5974025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:35.580234 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-129851f7-0531-43bc-ae5b-94093e59de48 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] 10.222.0.27 "GET /compute/v2.1/servers/05840cb4-7e09-49c5-8d55-a94dbfe241ae" status: 200 len: 1320 microversion: 2.26 time: 0.188071 Sep 08 10:58:35.584400 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2272/4465] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:58:35 2022] GET /compute/v2.1/servers/05840cb4-7e09-49c5-8d55-a94dbfe241ae => generated 1320 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:58:35.612495 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7bf6bf94-4e08-475d-b1b6-672e8454100b tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:35.636134 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7bf6bf94-4e08-475d-b1b6-672e8454100b tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad" status: 200 len: 1515 microversion: 2.1 time: 0.853987 Sep 08 10:58:35.636655 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2194/4466] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:34 2022] GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad => generated 1515 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:58:36.416651 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-247f1cd9-bb49-405b-9c9b-bd976aa3213b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:36.416651 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-247f1cd9-bb49-405b-9c9b-bd976aa3213b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:36.438638 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-247f1cd9-bb49-405b-9c9b-bd976aa3213b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:36.444437 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-247f1cd9-bb49-405b-9c9b-bd976aa3213b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:36.445572 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-247f1cd9-bb49-405b-9c9b-bd976aa3213b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:36.449383 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-247f1cd9-bb49-405b-9c9b-bd976aa3213b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:36.451073 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-247f1cd9-bb49-405b-9c9b-bd976aa3213b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:36.454502 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-247f1cd9-bb49-405b-9c9b-bd976aa3213b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:36.611739 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-70f68940-e78f-4252-9410-f4750f7f510e tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:36.612770 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-70f68940-e78f-4252-9410-f4750f7f510e tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] [instance: 05840cb4-7e09-49c5-8d55-a94dbfe241ae] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:36.655390 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70f68940-e78f-4252-9410-f4750f7f510e tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:36.658532 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70f68940-e78f-4252-9410-f4750f7f510e tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:36.659856 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70f68940-e78f-4252-9410-f4750f7f510e tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:36.663214 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70f68940-e78f-4252-9410-f4750f7f510e tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:36.664590 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70f68940-e78f-4252-9410-f4750f7f510e tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:36.666597 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70f68940-e78f-4252-9410-f4750f7f510e tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:36.803474 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-247f1cd9-bb49-405b-9c9b-bd976aa3213b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:36.818339 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-247f1cd9-bb49-405b-9c9b-bd976aa3213b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1673 microversion: 2.1 time: 0.406245 Sep 08 10:58:36.826381 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2273/4467] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:36 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1673 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:58:36.839251 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1404ae91-0622-4f36-9a00-0d7d00c0ca90 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:36.840251 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1404ae91-0622-4f36-9a00-0d7d00c0ca90 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: 82458f68-8fcf-4d1f-8e7b-87d76f3576ad] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:36.853557 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1404ae91-0622-4f36-9a00-0d7d00c0ca90 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:36.859264 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1404ae91-0622-4f36-9a00-0d7d00c0ca90 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:36.860785 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1404ae91-0622-4f36-9a00-0d7d00c0ca90 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:36.862383 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1404ae91-0622-4f36-9a00-0d7d00c0ca90 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:36.865571 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1404ae91-0622-4f36-9a00-0d7d00c0ca90 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:36.866731 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1404ae91-0622-4f36-9a00-0d7d00c0ca90 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:37.113314 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1404ae91-0622-4f36-9a00-0d7d00c0ca90 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:37.125859 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1404ae91-0622-4f36-9a00-0d7d00c0ca90 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad" status: 200 len: 1515 microversion: 2.1 time: 0.297755 Sep 08 10:58:37.127066 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2274/4468] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:36 2022] GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad => generated 1515 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:58:37.156138 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-70f68940-e78f-4252-9410-f4750f7f510e tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27627bddc6b144188fc4cc1f9e8b677f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae429b36d3af4e708071ee7be5974025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:37.187517 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-70f68940-e78f-4252-9410-f4750f7f510e tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27627bddc6b144188fc4cc1f9e8b677f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae429b36d3af4e708071ee7be5974025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:37.192000 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-70f68940-e78f-4252-9410-f4750f7f510e tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27627bddc6b144188fc4cc1f9e8b677f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae429b36d3af4e708071ee7be5974025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:37.196389 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-70f68940-e78f-4252-9410-f4750f7f510e tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] 10.222.0.27 "GET /compute/v2.1/servers/05840cb4-7e09-49c5-8d55-a94dbfe241ae" status: 200 len: 1320 microversion: 2.26 time: 0.590910 Sep 08 10:58:37.201490 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2195/4469] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:58:36 2022] GET /compute/v2.1/servers/05840cb4-7e09-49c5-8d55-a94dbfe241ae => generated 1320 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:58:37.508207 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-85f9c83e-fabf-4dd2-bf3a-700d98de9eaf tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-486312903", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "0d959ec7-a27c-4bd5-9c98-dad4f232a48b"}]}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:58:37.634767 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-85f9c83e-fabf-4dd2-bf3a-700d98de9eaf tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] validate_networks() for [('0d959ec7-a27c-4bd5-9c98-dad4f232a48b', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:58:37.857708 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-27195c48-2064-4fe5-b8dc-4a859f4bb5d2 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:37.859560 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-27195c48-2064-4fe5-b8dc-4a859f4bb5d2 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:37.881504 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27195c48-2064-4fe5-b8dc-4a859f4bb5d2 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:37.884322 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27195c48-2064-4fe5-b8dc-4a859f4bb5d2 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:37.884799 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27195c48-2064-4fe5-b8dc-4a859f4bb5d2 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:37.885752 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27195c48-2064-4fe5-b8dc-4a859f4bb5d2 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:37.887188 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27195c48-2064-4fe5-b8dc-4a859f4bb5d2 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:37.888926 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27195c48-2064-4fe5-b8dc-4a859f4bb5d2 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:38.946086 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-27195c48-2064-4fe5-b8dc-4a859f4bb5d2 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:38.965872 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-27195c48-2064-4fe5-b8dc-4a859f4bb5d2 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1673 microversion: 2.1 time: 1.117209 Sep 08 10:58:38.980900 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2196/4470] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:37 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1673 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:58:38.990019 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-79226c69-ec91-46af-8436-2fe2dfcb0b84 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:38.990998 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-79226c69-ec91-46af-8436-2fe2dfcb0b84 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: 82458f68-8fcf-4d1f-8e7b-87d76f3576ad] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:39.016003 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=40 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:58:39.018890 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-79226c69-ec91-46af-8436-2fe2dfcb0b84 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:39.020376 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-79226c69-ec91-46af-8436-2fe2dfcb0b84 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:39.021060 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-79226c69-ec91-46af-8436-2fe2dfcb0b84 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:39.022141 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-79226c69-ec91-46af-8436-2fe2dfcb0b84 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:39.022772 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-79226c69-ec91-46af-8436-2fe2dfcb0b84 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:39.023364 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-79226c69-ec91-46af-8436-2fe2dfcb0b84 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:39.245684 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-85f9c83e-fabf-4dd2-bf3a-700d98de9eaf tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:58:39.246384 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-85f9c83e-fabf-4dd2-bf3a-700d98de9eaf tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:58:39.247043 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-85f9c83e-fabf-4dd2-bf3a-700d98de9eaf tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:58:39.247294 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-85f9c83e-fabf-4dd2-bf3a-700d98de9eaf tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:58:39.248287 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-85f9c83e-fabf-4dd2-bf3a-700d98de9eaf tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:58:39.262563 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-85f9c83e-fabf-4dd2-bf3a-700d98de9eaf tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:39.263429 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-85f9c83e-fabf-4dd2-bf3a-700d98de9eaf tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:39.264283 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-85f9c83e-fabf-4dd2-bf3a-700d98de9eaf tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:39.265311 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-85f9c83e-fabf-4dd2-bf3a-700d98de9eaf tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:39.266456 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-85f9c83e-fabf-4dd2-bf3a-700d98de9eaf tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:39.267135 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-85f9c83e-fabf-4dd2-bf3a-700d98de9eaf tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:39.297697 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-85f9c83e-fabf-4dd2-bf3a-700d98de9eaf tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Getting quotas for project c8a85de2674b413cb72fe0de96eec7cc. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:58:39.304439 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-85f9c83e-fabf-4dd2-bf3a-700d98de9eaf tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Getting quotas for user e1fe29b5496a4169b0588b7b18d75537 and project c8a85de2674b413cb72fe0de96eec7cc. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:58:39.323971 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-85f9c83e-fabf-4dd2-bf3a-700d98de9eaf tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Going to run 3 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:58:39.326919 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-85f9c83e-fabf-4dd2-bf3a-700d98de9eaf tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] [instance: a167b49e-6d6c-4602-8980-9a42fea46555] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:58:39.375511 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-85f9c83e-fabf-4dd2-bf3a-700d98de9eaf tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] [instance: f1de1e06-01fa-4eb7-9dc6-be46802187c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=a167b49e-6d6c-4602-8980-9a42fea46555,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:58:39.462664 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-85f9c83e-fabf-4dd2-bf3a-700d98de9eaf tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] [instance: 7931ea02-ab01-4895-9ff2-265a0f58fe67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=f1de1e06-01fa-4eb7-9dc6-be46802187c5,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:58:39.604534 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-85f9c83e-fabf-4dd2-bf3a-700d98de9eaf tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.476170 Sep 08 10:58:39.605240 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2275/4471] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:58:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 2477 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:58:39.611673 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0689559f-829e-400f-8dc4-44782be9d08c tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:39.612539 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0689559f-829e-400f-8dc4-44782be9d08c tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] [instance: 05840cb4-7e09-49c5-8d55-a94dbfe241ae] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:39.621551 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0689559f-829e-400f-8dc4-44782be9d08c tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:39.622794 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0689559f-829e-400f-8dc4-44782be9d08c tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:39.623425 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0689559f-829e-400f-8dc4-44782be9d08c tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:39.624581 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0689559f-829e-400f-8dc4-44782be9d08c tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:39.625237 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0689559f-829e-400f-8dc4-44782be9d08c tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:39.625828 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0689559f-829e-400f-8dc4-44782be9d08c tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:39.968764 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0689559f-829e-400f-8dc4-44782be9d08c tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27627bddc6b144188fc4cc1f9e8b677f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae429b36d3af4e708071ee7be5974025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:39.986336 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0689559f-829e-400f-8dc4-44782be9d08c tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27627bddc6b144188fc4cc1f9e8b677f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae429b36d3af4e708071ee7be5974025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:39.992417 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0689559f-829e-400f-8dc4-44782be9d08c tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27627bddc6b144188fc4cc1f9e8b677f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae429b36d3af4e708071ee7be5974025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:39.993970 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0689559f-829e-400f-8dc4-44782be9d08c tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] 10.222.0.27 "GET /compute/v2.1/servers/05840cb4-7e09-49c5-8d55-a94dbfe241ae" status: 200 len: 1362 microversion: 2.26 time: 0.387289 Sep 08 10:58:40.015381 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2276/4472] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:58:39 2022] GET /compute/v2.1/servers/05840cb4-7e09-49c5-8d55-a94dbfe241ae => generated 1362 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:58:40.035777 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-54a45f0e-bb6c-4fd8-a3ba-11d71132dc74 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:40.048191 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-54a45f0e-bb6c-4fd8-a3ba-11d71132dc74 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e1fe29b5496a4169b0588b7b18d75537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a85de2674b413cb72fe0de96eec7cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:40.053148 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-54a45f0e-bb6c-4fd8-a3ba-11d71132dc74 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Searching by: {'deleted': False, 'project_id': 'c8a85de2674b413cb72fe0de96eec7cc'} {{(pid=128861) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:58:40.103382 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-54a45f0e-bb6c-4fd8-a3ba-11d71132dc74 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:40.111130 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-54a45f0e-bb6c-4fd8-a3ba-11d71132dc74 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:40.111678 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-54a45f0e-bb6c-4fd8-a3ba-11d71132dc74 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:40.114602 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-54a45f0e-bb6c-4fd8-a3ba-11d71132dc74 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:40.115359 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-54a45f0e-bb6c-4fd8-a3ba-11d71132dc74 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:40.117086 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-54a45f0e-bb6c-4fd8-a3ba-11d71132dc74 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:40.130051 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-79226c69-ec91-46af-8436-2fe2dfcb0b84 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:40.143869 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-79226c69-ec91-46af-8436-2fe2dfcb0b84 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad" status: 200 len: 1515 microversion: 2.1 time: 1.161277 Sep 08 10:58:40.145251 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2197/4473] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:38 2022] GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad => generated 1515 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:58:40.168109 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2952bfab-b65c-40ec-9386-90d8be76d210 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:40.170650 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2952bfab-b65c-40ec-9386-90d8be76d210 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:40.173520 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-54a45f0e-bb6c-4fd8-a3ba-11d71132dc74 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.151353 Sep 08 10:58:40.175337 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2277/4474] 10.222.0.27 () {58 vars in 1125 bytes} [Thu Sep 8 10:58:40 2022] GET /compute/v2.1/servers => generated 1015 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:58:40.193244 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2952bfab-b65c-40ec-9386-90d8be76d210 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:40.194418 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2952bfab-b65c-40ec-9386-90d8be76d210 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:40.195130 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2952bfab-b65c-40ec-9386-90d8be76d210 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:40.196188 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2952bfab-b65c-40ec-9386-90d8be76d210 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:40.196894 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2952bfab-b65c-40ec-9386-90d8be76d210 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:40.197545 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2952bfab-b65c-40ec-9386-90d8be76d210 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:40.197657 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-24b0f5a1-1b5a-48b1-9bc3-daeab8264f95 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:40.200074 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-24b0f5a1-1b5a-48b1-9bc3-daeab8264f95 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] [instance: 7931ea02-ab01-4895-9ff2-265a0f58fe67] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:40.385386 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-24b0f5a1-1b5a-48b1-9bc3-daeab8264f95 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fe29b5496a4169b0588b7b18d75537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a85de2674b413cb72fe0de96eec7cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:40.396760 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-24b0f5a1-1b5a-48b1-9bc3-daeab8264f95 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] 10.222.0.27 "GET /compute/v2.1/servers/7931ea02-ab01-4895-9ff2-265a0f58fe67" status: 200 len: 1222 microversion: 2.1 time: 0.209459 Sep 08 10:58:40.399464 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2278/4475] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:40 2022] GET /compute/v2.1/servers/7931ea02-ab01-4895-9ff2-265a0f58fe67 => generated 1222 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:58:41.030082 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-961ce4d3-d048-42ed-a5f9-2a3bdc52b4a3 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:41.031211 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-961ce4d3-d048-42ed-a5f9-2a3bdc52b4a3 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] [instance: 05840cb4-7e09-49c5-8d55-a94dbfe241ae] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:41.065595 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-961ce4d3-d048-42ed-a5f9-2a3bdc52b4a3 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:41.070780 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-961ce4d3-d048-42ed-a5f9-2a3bdc52b4a3 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:41.073234 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-961ce4d3-d048-42ed-a5f9-2a3bdc52b4a3 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:41.077204 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-961ce4d3-d048-42ed-a5f9-2a3bdc52b4a3 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:41.078602 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-961ce4d3-d048-42ed-a5f9-2a3bdc52b4a3 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:41.079240 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-961ce4d3-d048-42ed-a5f9-2a3bdc52b4a3 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:41.110704 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2952bfab-b65c-40ec-9386-90d8be76d210 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:41.130232 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2952bfab-b65c-40ec-9386-90d8be76d210 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1671 microversion: 2.1 time: 0.980604 Sep 08 10:58:41.132140 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2198/4476] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:40 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1671 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:58:41.173130 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dbd5ffb3-470c-4654-8e7d-130d50256705 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:41.174034 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-dbd5ffb3-470c-4654-8e7d-130d50256705 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: 82458f68-8fcf-4d1f-8e7b-87d76f3576ad] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:41.187624 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dbd5ffb3-470c-4654-8e7d-130d50256705 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:41.188877 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dbd5ffb3-470c-4654-8e7d-130d50256705 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:41.191447 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dbd5ffb3-470c-4654-8e7d-130d50256705 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:41.197982 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dbd5ffb3-470c-4654-8e7d-130d50256705 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:41.198838 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dbd5ffb3-470c-4654-8e7d-130d50256705 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:41.199482 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dbd5ffb3-470c-4654-8e7d-130d50256705 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:41.580856 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-961ce4d3-d048-42ed-a5f9-2a3bdc52b4a3 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27627bddc6b144188fc4cc1f9e8b677f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae429b36d3af4e708071ee7be5974025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:41.585412 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-dbd5ffb3-470c-4654-8e7d-130d50256705 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:41.598449 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-dbd5ffb3-470c-4654-8e7d-130d50256705 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad" status: 200 len: 1515 microversion: 2.1 time: 0.429107 Sep 08 10:58:41.603535 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2199/4477] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:41 2022] GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad => generated 1515 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:58:41.604451 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-961ce4d3-d048-42ed-a5f9-2a3bdc52b4a3 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27627bddc6b144188fc4cc1f9e8b677f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae429b36d3af4e708071ee7be5974025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:41.609540 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f301f09d-31a4-4c64-84e4-2058d5dbe1c4 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:41.610479 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f301f09d-31a4-4c64-84e4-2058d5dbe1c4 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] [instance: 7931ea02-ab01-4895-9ff2-265a0f58fe67] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:41.613503 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-961ce4d3-d048-42ed-a5f9-2a3bdc52b4a3 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27627bddc6b144188fc4cc1f9e8b677f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae429b36d3af4e708071ee7be5974025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:41.614880 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-961ce4d3-d048-42ed-a5f9-2a3bdc52b4a3 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] 10.222.0.27 "GET /compute/v2.1/servers/05840cb4-7e09-49c5-8d55-a94dbfe241ae" status: 200 len: 1362 microversion: 2.26 time: 0.589072 Sep 08 10:58:41.618077 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2279/4478] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:58:41 2022] GET /compute/v2.1/servers/05840cb4-7e09-49c5-8d55-a94dbfe241ae => generated 1362 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:58:41.761677 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f301f09d-31a4-4c64-84e4-2058d5dbe1c4 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fe29b5496a4169b0588b7b18d75537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a85de2674b413cb72fe0de96eec7cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:41.772792 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f301f09d-31a4-4c64-84e4-2058d5dbe1c4 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] 10.222.0.27 "GET /compute/v2.1/servers/7931ea02-ab01-4895-9ff2-265a0f58fe67" status: 200 len: 1222 microversion: 2.1 time: 0.164851 Sep 08 10:58:41.792731 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2200/4479] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:41 2022] GET /compute/v2.1/servers/7931ea02-ab01-4895-9ff2-265a0f58fe67 => generated 1222 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:58:42.574831 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-cfdc4dca-0a6b-4cf9-a5ad-dedf0c8d4c02 req-c49ec0ff-f99c-414e-adda-e9ab7255a3d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05840cb4-7e09-49c5-8d55-a94dbfe241ae", "tag": "6c596fb9-9619-434d-bf94-2d6385b48bc1"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:58:42.604651 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-cfdc4dca-0a6b-4cf9-a5ad-dedf0c8d4c02 req-c49ec0ff-f99c-414e-adda-e9ab7255a3d5 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:42.609520 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-cfdc4dca-0a6b-4cf9-a5ad-dedf0c8d4c02 req-c49ec0ff-f99c-414e-adda-e9ab7255a3d5 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:42.610889 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-cfdc4dca-0a6b-4cf9-a5ad-dedf0c8d4c02 req-c49ec0ff-f99c-414e-adda-e9ab7255a3d5 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:42.636837 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e40c8469-13a6-40b3-b527-5ff8050f48af tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:42.640252 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e40c8469-13a6-40b3-b527-5ff8050f48af tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: 82458f68-8fcf-4d1f-8e7b-87d76f3576ad] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:42.643399 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-cfdc4dca-0a6b-4cf9-a5ad-dedf0c8d4c02 req-c49ec0ff-f99c-414e-adda-e9ab7255a3d5 service nova] Creating event network-changed:6c596fb9-9619-434d-bf94-2d6385b48bc1 for instance 05840cb4-7e09-49c5-8d55-a94dbfe241ae on n-h1-850501-12 Sep 08 10:58:42.657354 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-cfdc4dca-0a6b-4cf9-a5ad-dedf0c8d4c02 req-c49ec0ff-f99c-414e-adda-e9ab7255a3d5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088145 Sep 08 10:58:42.661429 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2280/4480] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:58:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:58:42.675312 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e40c8469-13a6-40b3-b527-5ff8050f48af tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:42.680375 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8d167d34-2b57-44a7-bb38-9911d6dbad78 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:42.681450 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8d167d34-2b57-44a7-bb38-9911d6dbad78 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] [instance: 05840cb4-7e09-49c5-8d55-a94dbfe241ae] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:42.688275 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e40c8469-13a6-40b3-b527-5ff8050f48af tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:42.694749 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e40c8469-13a6-40b3-b527-5ff8050f48af tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:42.698076 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e40c8469-13a6-40b3-b527-5ff8050f48af tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:42.699371 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8d167d34-2b57-44a7-bb38-9911d6dbad78 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:42.702955 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8d167d34-2b57-44a7-bb38-9911d6dbad78 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:42.704058 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e40c8469-13a6-40b3-b527-5ff8050f48af tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:42.705568 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e40c8469-13a6-40b3-b527-5ff8050f48af tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:42.705894 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8d167d34-2b57-44a7-bb38-9911d6dbad78 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:42.709637 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8d167d34-2b57-44a7-bb38-9911d6dbad78 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:42.711563 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8d167d34-2b57-44a7-bb38-9911d6dbad78 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:42.712180 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8d167d34-2b57-44a7-bb38-9911d6dbad78 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:43.253533 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8d167d34-2b57-44a7-bb38-9911d6dbad78 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27627bddc6b144188fc4cc1f9e8b677f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae429b36d3af4e708071ee7be5974025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:43.282243 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8d167d34-2b57-44a7-bb38-9911d6dbad78 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27627bddc6b144188fc4cc1f9e8b677f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae429b36d3af4e708071ee7be5974025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:43.322309 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8d167d34-2b57-44a7-bb38-9911d6dbad78 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27627bddc6b144188fc4cc1f9e8b677f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae429b36d3af4e708071ee7be5974025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:43.325945 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8d167d34-2b57-44a7-bb38-9911d6dbad78 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] 10.222.0.27 "GET /compute/v2.1/servers/05840cb4-7e09-49c5-8d55-a94dbfe241ae" status: 200 len: 1362 microversion: 2.26 time: 0.662677 Sep 08 10:58:43.347163 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2281/4481] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:58:42 2022] GET /compute/v2.1/servers/05840cb4-7e09-49c5-8d55-a94dbfe241ae => generated 1362 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:58:43.359769 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cdfa9a61-acaf-4437-9ad4-6f18e55c2704 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:43.369435 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cdfa9a61-acaf-4437-9ad4-6f18e55c2704 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] [instance: 7931ea02-ab01-4895-9ff2-265a0f58fe67] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:43.390896 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cdfa9a61-acaf-4437-9ad4-6f18e55c2704 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:43.393854 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cdfa9a61-acaf-4437-9ad4-6f18e55c2704 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:43.397279 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cdfa9a61-acaf-4437-9ad4-6f18e55c2704 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:43.399391 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cdfa9a61-acaf-4437-9ad4-6f18e55c2704 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:43.400683 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cdfa9a61-acaf-4437-9ad4-6f18e55c2704 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:43.402094 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cdfa9a61-acaf-4437-9ad4-6f18e55c2704 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:43.572944 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e40c8469-13a6-40b3-b527-5ff8050f48af tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:43.591719 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-cdfa9a61-acaf-4437-9ad4-6f18e55c2704 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fe29b5496a4169b0588b7b18d75537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a85de2674b413cb72fe0de96eec7cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:43.594069 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e40c8469-13a6-40b3-b527-5ff8050f48af tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad" status: 200 len: 1515 microversion: 2.1 time: 0.967950 Sep 08 10:58:43.601878 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2201/4482] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:42 2022] GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad => generated 1515 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:58:43.607832 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cdfa9a61-acaf-4437-9ad4-6f18e55c2704 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] 10.222.0.27 "GET /compute/v2.1/servers/7931ea02-ab01-4895-9ff2-265a0f58fe67" status: 200 len: 1274 microversion: 2.1 time: 0.257971 Sep 08 10:58:43.620250 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2282/4483] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:43 2022] GET /compute/v2.1/servers/7931ea02-ab01-4895-9ff2-265a0f58fe67 => generated 1274 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:58:44.361540 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-aeb21685-4bd6-4403-9d2b-cdd35d293444 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:44.362213 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-aeb21685-4bd6-4403-9d2b-cdd35d293444 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] [instance: 05840cb4-7e09-49c5-8d55-a94dbfe241ae] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:44.376436 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aeb21685-4bd6-4403-9d2b-cdd35d293444 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:44.377477 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aeb21685-4bd6-4403-9d2b-cdd35d293444 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:44.378295 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aeb21685-4bd6-4403-9d2b-cdd35d293444 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:44.381279 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aeb21685-4bd6-4403-9d2b-cdd35d293444 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:44.383730 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aeb21685-4bd6-4403-9d2b-cdd35d293444 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:44.384352 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aeb21685-4bd6-4403-9d2b-cdd35d293444 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:44.625902 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cb4c7d44-4916-4469-ac5b-07f673f59ed5 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:44.626771 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cb4c7d44-4916-4469-ac5b-07f673f59ed5 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: 82458f68-8fcf-4d1f-8e7b-87d76f3576ad] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:44.642094 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb4c7d44-4916-4469-ac5b-07f673f59ed5 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:44.645276 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb4c7d44-4916-4469-ac5b-07f673f59ed5 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:44.645775 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb4c7d44-4916-4469-ac5b-07f673f59ed5 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:44.646535 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb4c7d44-4916-4469-ac5b-07f673f59ed5 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:44.647017 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb4c7d44-4916-4469-ac5b-07f673f59ed5 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:44.647455 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb4c7d44-4916-4469-ac5b-07f673f59ed5 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:45.002463 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-cb4c7d44-4916-4469-ac5b-07f673f59ed5 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:45.016249 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cb4c7d44-4916-4469-ac5b-07f673f59ed5 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad" status: 200 len: 1515 microversion: 2.1 time: 0.395718 Sep 08 10:58:45.023101 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2283/4484] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:44 2022] GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad => generated 1515 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:58:45.029299 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b743d3ef-104a-4071-98f7-37e2156f3b06 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:45.037178 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b743d3ef-104a-4071-98f7-37e2156f3b06 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] [instance: 7931ea02-ab01-4895-9ff2-265a0f58fe67] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:45.056336 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b743d3ef-104a-4071-98f7-37e2156f3b06 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:45.056858 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b743d3ef-104a-4071-98f7-37e2156f3b06 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:45.057340 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b743d3ef-104a-4071-98f7-37e2156f3b06 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:45.069342 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b743d3ef-104a-4071-98f7-37e2156f3b06 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:45.070443 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b743d3ef-104a-4071-98f7-37e2156f3b06 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:45.072958 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b743d3ef-104a-4071-98f7-37e2156f3b06 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:45.275257 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b743d3ef-104a-4071-98f7-37e2156f3b06 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fe29b5496a4169b0588b7b18d75537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a85de2674b413cb72fe0de96eec7cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:45.291911 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b743d3ef-104a-4071-98f7-37e2156f3b06 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] 10.222.0.27 "GET /compute/v2.1/servers/7931ea02-ab01-4895-9ff2-265a0f58fe67" status: 200 len: 1280 microversion: 2.1 time: 0.266741 Sep 08 10:58:45.307726 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2284/4485] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:45 2022] GET /compute/v2.1/servers/7931ea02-ab01-4895-9ff2-265a0f58fe67 => generated 1280 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:58:45.804452 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-aeb21685-4bd6-4403-9d2b-cdd35d293444 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27627bddc6b144188fc4cc1f9e8b677f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae429b36d3af4e708071ee7be5974025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:45.814276 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=99 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:58:45.839092 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-aeb21685-4bd6-4403-9d2b-cdd35d293444 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27627bddc6b144188fc4cc1f9e8b677f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae429b36d3af4e708071ee7be5974025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:45.849206 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-aeb21685-4bd6-4403-9d2b-cdd35d293444 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27627bddc6b144188fc4cc1f9e8b677f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae429b36d3af4e708071ee7be5974025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:45.854003 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-aeb21685-4bd6-4403-9d2b-cdd35d293444 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] 10.222.0.27 "GET /compute/v2.1/servers/05840cb4-7e09-49c5-8d55-a94dbfe241ae" status: 200 len: 1362 microversion: 2.26 time: 1.497158 Sep 08 10:58:45.859641 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2202/4486] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:58:44 2022] GET /compute/v2.1/servers/05840cb4-7e09-49c5-8d55-a94dbfe241ae => generated 1362 bytes in 1503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:58:46.061166 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-aac7651c-8593-47a5-9c3b-20e59c26de7c tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:46.064387 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-aac7651c-8593-47a5-9c3b-20e59c26de7c tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: 82458f68-8fcf-4d1f-8e7b-87d76f3576ad] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:46.106115 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aac7651c-8593-47a5-9c3b-20e59c26de7c tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:46.108836 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aac7651c-8593-47a5-9c3b-20e59c26de7c tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:46.115251 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aac7651c-8593-47a5-9c3b-20e59c26de7c tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:46.121877 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aac7651c-8593-47a5-9c3b-20e59c26de7c tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:46.121877 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aac7651c-8593-47a5-9c3b-20e59c26de7c tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:46.121877 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aac7651c-8593-47a5-9c3b-20e59c26de7c tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:46.316729 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3f03dc17-1ff5-4e40-b891-9649091c35ae tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:46.321639 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3f03dc17-1ff5-4e40-b891-9649091c35ae tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] [instance: 7931ea02-ab01-4895-9ff2-265a0f58fe67] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:46.338167 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3f03dc17-1ff5-4e40-b891-9649091c35ae tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:46.339199 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3f03dc17-1ff5-4e40-b891-9649091c35ae tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:46.340190 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3f03dc17-1ff5-4e40-b891-9649091c35ae tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:46.344804 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3f03dc17-1ff5-4e40-b891-9649091c35ae tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:46.346858 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3f03dc17-1ff5-4e40-b891-9649091c35ae tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:46.349307 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3f03dc17-1ff5-4e40-b891-9649091c35ae tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:46.595268 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3f03dc17-1ff5-4e40-b891-9649091c35ae tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fe29b5496a4169b0588b7b18d75537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a85de2674b413cb72fe0de96eec7cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:46.622680 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3f03dc17-1ff5-4e40-b891-9649091c35ae tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] 10.222.0.27 "GET /compute/v2.1/servers/7931ea02-ab01-4895-9ff2-265a0f58fe67" status: 200 len: 1280 microversion: 2.1 time: 0.296614 Sep 08 10:58:46.642481 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2203/4487] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:46 2022] GET /compute/v2.1/servers/7931ea02-ab01-4895-9ff2-265a0f58fe67 => generated 1280 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:58:46.891334 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4f85b5d3-2fc3-447b-9b2a-ade62f6518b2 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:46.892719 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4f85b5d3-2fc3-447b-9b2a-ade62f6518b2 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] [instance: 05840cb4-7e09-49c5-8d55-a94dbfe241ae] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:46.915543 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f85b5d3-2fc3-447b-9b2a-ade62f6518b2 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:46.924340 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f85b5d3-2fc3-447b-9b2a-ade62f6518b2 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:46.925142 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f85b5d3-2fc3-447b-9b2a-ade62f6518b2 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:46.926076 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f85b5d3-2fc3-447b-9b2a-ade62f6518b2 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:46.926989 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f85b5d3-2fc3-447b-9b2a-ade62f6518b2 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:46.927592 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f85b5d3-2fc3-447b-9b2a-ade62f6518b2 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:46.982232 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-aac7651c-8593-47a5-9c3b-20e59c26de7c tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:46.995379 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-aac7651c-8593-47a5-9c3b-20e59c26de7c tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad" status: 200 len: 1515 microversion: 2.1 time: 0.952089 Sep 08 10:58:47.005791 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2285/4488] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:46 2022] GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad => generated 1515 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:58:47.563165 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4f85b5d3-2fc3-447b-9b2a-ade62f6518b2 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27627bddc6b144188fc4cc1f9e8b677f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae429b36d3af4e708071ee7be5974025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:47.583436 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4f85b5d3-2fc3-447b-9b2a-ade62f6518b2 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27627bddc6b144188fc4cc1f9e8b677f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae429b36d3af4e708071ee7be5974025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:47.587421 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4f85b5d3-2fc3-447b-9b2a-ade62f6518b2 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27627bddc6b144188fc4cc1f9e8b677f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae429b36d3af4e708071ee7be5974025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:47.590571 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4f85b5d3-2fc3-447b-9b2a-ade62f6518b2 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] 10.222.0.27 "GET /compute/v2.1/servers/05840cb4-7e09-49c5-8d55-a94dbfe241ae" status: 200 len: 1362 microversion: 2.26 time: 0.703417 Sep 08 10:58:47.591980 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2204/4489] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:58:46 2022] GET /compute/v2.1/servers/05840cb4-7e09-49c5-8d55-a94dbfe241ae => generated 1362 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:58:47.649107 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1739e8bd-f73f-40cc-9729-bce9aa450d51 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:47.650366 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1739e8bd-f73f-40cc-9729-bce9aa450d51 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] [instance: 7931ea02-ab01-4895-9ff2-265a0f58fe67] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:47.666138 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1739e8bd-f73f-40cc-9729-bce9aa450d51 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:47.675127 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1739e8bd-f73f-40cc-9729-bce9aa450d51 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:47.680992 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1739e8bd-f73f-40cc-9729-bce9aa450d51 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:47.685200 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1739e8bd-f73f-40cc-9729-bce9aa450d51 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:47.690842 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1739e8bd-f73f-40cc-9729-bce9aa450d51 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:47.691965 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1739e8bd-f73f-40cc-9729-bce9aa450d51 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:47.835683 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1739e8bd-f73f-40cc-9729-bce9aa450d51 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fe29b5496a4169b0588b7b18d75537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a85de2674b413cb72fe0de96eec7cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:47.847439 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1739e8bd-f73f-40cc-9729-bce9aa450d51 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] 10.222.0.27 "GET /compute/v2.1/servers/7931ea02-ab01-4895-9ff2-265a0f58fe67" status: 200 len: 1280 microversion: 2.1 time: 0.203345 Sep 08 10:58:47.848052 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2286/4490] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:47 2022] GET /compute/v2.1/servers/7931ea02-ab01-4895-9ff2-265a0f58fe67 => generated 1280 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:58:48.039285 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6fad1162-955e-46ab-af9e-7e85a215b041 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:48.040870 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6fad1162-955e-46ab-af9e-7e85a215b041 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: 82458f68-8fcf-4d1f-8e7b-87d76f3576ad] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:48.069811 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6fad1162-955e-46ab-af9e-7e85a215b041 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:48.071740 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6fad1162-955e-46ab-af9e-7e85a215b041 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:48.073565 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6fad1162-955e-46ab-af9e-7e85a215b041 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:48.078571 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6fad1162-955e-46ab-af9e-7e85a215b041 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:48.080878 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6fad1162-955e-46ab-af9e-7e85a215b041 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:48.083024 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6fad1162-955e-46ab-af9e-7e85a215b041 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:48.621056 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-acac4b55-b241-4d88-b86c-7aea48e351df tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:48.622244 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-acac4b55-b241-4d88-b86c-7aea48e351df tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] [instance: 05840cb4-7e09-49c5-8d55-a94dbfe241ae] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:48.647653 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-acac4b55-b241-4d88-b86c-7aea48e351df tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:48.648671 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-acac4b55-b241-4d88-b86c-7aea48e351df tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:48.649639 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-acac4b55-b241-4d88-b86c-7aea48e351df tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:48.651716 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-acac4b55-b241-4d88-b86c-7aea48e351df tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:48.652343 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-acac4b55-b241-4d88-b86c-7aea48e351df tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:48.652933 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-acac4b55-b241-4d88-b86c-7aea48e351df tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:48.690326 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6fad1162-955e-46ab-af9e-7e85a215b041 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:48.705665 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6fad1162-955e-46ab-af9e-7e85a215b041 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad" status: 200 len: 1515 microversion: 2.1 time: 0.673800 Sep 08 10:58:48.722825 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2205/4491] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:48 2022] GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad => generated 1515 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:58:49.129006 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-acac4b55-b241-4d88-b86c-7aea48e351df tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27627bddc6b144188fc4cc1f9e8b677f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae429b36d3af4e708071ee7be5974025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:49.139202 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-acac4b55-b241-4d88-b86c-7aea48e351df tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27627bddc6b144188fc4cc1f9e8b677f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae429b36d3af4e708071ee7be5974025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:49.147580 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-acac4b55-b241-4d88-b86c-7aea48e351df tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27627bddc6b144188fc4cc1f9e8b677f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae429b36d3af4e708071ee7be5974025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:49.150715 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-acac4b55-b241-4d88-b86c-7aea48e351df tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] 10.222.0.27 "GET /compute/v2.1/servers/05840cb4-7e09-49c5-8d55-a94dbfe241ae" status: 200 len: 1362 microversion: 2.26 time: 0.534247 Sep 08 10:58:49.153635 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2287/4492] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:58:48 2022] GET /compute/v2.1/servers/05840cb4-7e09-49c5-8d55-a94dbfe241ae => generated 1362 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:58:49.163771 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-61fa2b92-5a80-4a35-98c9-f4bf384d8e14 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:49.172562 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-61fa2b92-5a80-4a35-98c9-f4bf384d8e14 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] [instance: 7931ea02-ab01-4895-9ff2-265a0f58fe67] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:49.180302 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-61fa2b92-5a80-4a35-98c9-f4bf384d8e14 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:49.181613 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-61fa2b92-5a80-4a35-98c9-f4bf384d8e14 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:49.189729 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-61fa2b92-5a80-4a35-98c9-f4bf384d8e14 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:49.191148 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-61fa2b92-5a80-4a35-98c9-f4bf384d8e14 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:49.192453 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-61fa2b92-5a80-4a35-98c9-f4bf384d8e14 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:49.193403 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-61fa2b92-5a80-4a35-98c9-f4bf384d8e14 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:49.224225 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-51561d57-acae-4a60-86f3-904368183203 tempest-PortsAdminExtendedAttrsIpV6TestJSON-136873890 tempest-PortsAdminExtendedAttrsIpV6TestJSON-136873890-project-admin] Calling method '.version_select at 0x7f68e8a58700>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:49.227189 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51561d57-acae-4a60-86f3-904368183203 tempest-PortsAdminExtendedAttrsIpV6TestJSON-136873890 tempest-PortsAdminExtendedAttrsIpV6TestJSON-136873890-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:49.227970 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51561d57-acae-4a60-86f3-904368183203 tempest-PortsAdminExtendedAttrsIpV6TestJSON-136873890 tempest-PortsAdminExtendedAttrsIpV6TestJSON-136873890-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:49.228416 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51561d57-acae-4a60-86f3-904368183203 tempest-PortsAdminExtendedAttrsIpV6TestJSON-136873890 tempest-PortsAdminExtendedAttrsIpV6TestJSON-136873890-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:49.279147 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51561d57-acae-4a60-86f3-904368183203 tempest-PortsAdminExtendedAttrsIpV6TestJSON-136873890 tempest-PortsAdminExtendedAttrsIpV6TestJSON-136873890-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:49.281127 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51561d57-acae-4a60-86f3-904368183203 tempest-PortsAdminExtendedAttrsIpV6TestJSON-136873890 tempest-PortsAdminExtendedAttrsIpV6TestJSON-136873890-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:49.281804 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51561d57-acae-4a60-86f3-904368183203 tempest-PortsAdminExtendedAttrsIpV6TestJSON-136873890 tempest-PortsAdminExtendedAttrsIpV6TestJSON-136873890-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:49.300159 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51561d57-acae-4a60-86f3-904368183203 tempest-PortsAdminExtendedAttrsIpV6TestJSON-136873890 tempest-PortsAdminExtendedAttrsIpV6TestJSON-136873890-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:49.300981 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51561d57-acae-4a60-86f3-904368183203 tempest-PortsAdminExtendedAttrsIpV6TestJSON-136873890 tempest-PortsAdminExtendedAttrsIpV6TestJSON-136873890-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:49.301907 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51561d57-acae-4a60-86f3-904368183203 tempest-PortsAdminExtendedAttrsIpV6TestJSON-136873890 tempest-PortsAdminExtendedAttrsIpV6TestJSON-136873890-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:49.309636 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-51561d57-acae-4a60-86f3-904368183203 tempest-PortsAdminExtendedAttrsIpV6TestJSON-136873890 tempest-PortsAdminExtendedAttrsIpV6TestJSON-136873890-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.585011 Sep 08 10:58:49.318234 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2206/4493] 10.222.0.27 () {58 vars in 1146 bytes} [Thu Sep 8 10:58:48 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:58:49.729922 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5282deba-1aee-4321-a704-635be4129f92 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:49.731121 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5282deba-1aee-4321-a704-635be4129f92 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: 82458f68-8fcf-4d1f-8e7b-87d76f3576ad] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:49.751324 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5282deba-1aee-4321-a704-635be4129f92 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:49.751992 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5282deba-1aee-4321-a704-635be4129f92 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:49.752454 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5282deba-1aee-4321-a704-635be4129f92 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:49.757316 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5282deba-1aee-4321-a704-635be4129f92 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:49.757839 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5282deba-1aee-4321-a704-635be4129f92 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:49.758293 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5282deba-1aee-4321-a704-635be4129f92 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:49.764894 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-61fa2b92-5a80-4a35-98c9-f4bf384d8e14 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fe29b5496a4169b0588b7b18d75537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a85de2674b413cb72fe0de96eec7cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:49.796721 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-61fa2b92-5a80-4a35-98c9-f4bf384d8e14 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] 10.222.0.27 "GET /compute/v2.1/servers/7931ea02-ab01-4895-9ff2-265a0f58fe67" status: 200 len: 1322 microversion: 2.1 time: 0.637703 Sep 08 10:58:49.805584 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2288/4494] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:49 2022] GET /compute/v2.1/servers/7931ea02-ab01-4895-9ff2-265a0f58fe67 => generated 1322 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:58:50.187979 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d03e459e-a01f-4c30-94c3-e94ff23e261c tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:50.190983 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d03e459e-a01f-4c30-94c3-e94ff23e261c tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] [instance: 05840cb4-7e09-49c5-8d55-a94dbfe241ae] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:50.199112 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=6 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:58:50.229198 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d03e459e-a01f-4c30-94c3-e94ff23e261c tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:50.234966 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d03e459e-a01f-4c30-94c3-e94ff23e261c tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:50.240137 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d03e459e-a01f-4c30-94c3-e94ff23e261c tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:50.242187 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d03e459e-a01f-4c30-94c3-e94ff23e261c tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:50.243263 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d03e459e-a01f-4c30-94c3-e94ff23e261c tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:50.246048 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d03e459e-a01f-4c30-94c3-e94ff23e261c tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:50.390478 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=16 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:58:51.246812 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d03e459e-a01f-4c30-94c3-e94ff23e261c tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27627bddc6b144188fc4cc1f9e8b677f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae429b36d3af4e708071ee7be5974025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:51.272314 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d03e459e-a01f-4c30-94c3-e94ff23e261c tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27627bddc6b144188fc4cc1f9e8b677f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae429b36d3af4e708071ee7be5974025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:51.274627 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d03e459e-a01f-4c30-94c3-e94ff23e261c tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27627bddc6b144188fc4cc1f9e8b677f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae429b36d3af4e708071ee7be5974025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:51.277200 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d03e459e-a01f-4c30-94c3-e94ff23e261c tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] 10.222.0.27 "GET /compute/v2.1/servers/05840cb4-7e09-49c5-8d55-a94dbfe241ae" status: 200 len: 1362 microversion: 2.26 time: 1.098534 Sep 08 10:58:51.284037 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2289/4495] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:58:50 2022] GET /compute/v2.1/servers/05840cb4-7e09-49c5-8d55-a94dbfe241ae => generated 1362 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:58:51.300085 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3159f4de-a5cd-4b4a-b585-150b61e7034d tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:51.304490 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5282deba-1aee-4321-a704-635be4129f92 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:51.308072 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3159f4de-a5cd-4b4a-b585-150b61e7034d tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] [instance: 7931ea02-ab01-4895-9ff2-265a0f58fe67] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:51.322683 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3159f4de-a5cd-4b4a-b585-150b61e7034d tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:51.323608 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3159f4de-a5cd-4b4a-b585-150b61e7034d tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:51.324363 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3159f4de-a5cd-4b4a-b585-150b61e7034d tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:51.326088 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3159f4de-a5cd-4b4a-b585-150b61e7034d tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:51.327336 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3159f4de-a5cd-4b4a-b585-150b61e7034d tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:51.328067 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3159f4de-a5cd-4b4a-b585-150b61e7034d tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:51.328207 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5282deba-1aee-4321-a704-635be4129f92 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad" status: 200 len: 1515 microversion: 2.1 time: 1.603307 Sep 08 10:58:51.333289 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2207/4496] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:49 2022] GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad => generated 1515 bytes in 1609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:58:51.944992 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-3159f4de-a5cd-4b4a-b585-150b61e7034d tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fe29b5496a4169b0588b7b18d75537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a85de2674b413cb72fe0de96eec7cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:51.950716 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=100 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:58:51.960327 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3159f4de-a5cd-4b4a-b585-150b61e7034d tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] 10.222.0.27 "GET /compute/v2.1/servers/7931ea02-ab01-4895-9ff2-265a0f58fe67" status: 200 len: 1322 microversion: 2.1 time: 0.674055 Sep 08 10:58:51.961804 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2290/4497] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:51 2022] GET /compute/v2.1/servers/7931ea02-ab01-4895-9ff2-265a0f58fe67 => generated 1322 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:58:52.025543 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-bf36e0d3-e39f-4c16-acf1-2b9565d0ce86 req-9470df64-3d6d-47c3-abf5-a0ca7fad221d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05840cb4-7e09-49c5-8d55-a94dbfe241ae", "name": "network-vif-plugged", "status": "completed", "tag": "6c596fb9-9619-434d-bf94-2d6385b48bc1"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:58:52.050070 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:58:52.055733 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-bf36e0d3-e39f-4c16-acf1-2b9565d0ce86 req-9470df64-3d6d-47c3-abf5-a0ca7fad221d service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:52.057500 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-bf36e0d3-e39f-4c16-acf1-2b9565d0ce86 req-9470df64-3d6d-47c3-abf5-a0ca7fad221d service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:52.058145 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-bf36e0d3-e39f-4c16-acf1-2b9565d0ce86 req-9470df64-3d6d-47c3-abf5-a0ca7fad221d service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:52.092746 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-bf36e0d3-e39f-4c16-acf1-2b9565d0ce86 req-9470df64-3d6d-47c3-abf5-a0ca7fad221d service nova] Creating event network-vif-plugged:6c596fb9-9619-434d-bf94-2d6385b48bc1 for instance 05840cb4-7e09-49c5-8d55-a94dbfe241ae on n-h1-850501-12 Sep 08 10:58:52.106950 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-bf36e0d3-e39f-4c16-acf1-2b9565d0ce86 req-9470df64-3d6d-47c3-abf5-a0ca7fad221d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085522 Sep 08 10:58:52.108847 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2208/4498] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:58:52.315960 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1bc8e492-250b-47e1-b4d8-0720c122c00f tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:52.320175 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1bc8e492-250b-47e1-b4d8-0720c122c00f tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] [instance: 05840cb4-7e09-49c5-8d55-a94dbfe241ae] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:52.334256 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1bc8e492-250b-47e1-b4d8-0720c122c00f tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:52.335193 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1bc8e492-250b-47e1-b4d8-0720c122c00f tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:52.336103 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1bc8e492-250b-47e1-b4d8-0720c122c00f tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:52.337944 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1bc8e492-250b-47e1-b4d8-0720c122c00f tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:52.340373 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1bc8e492-250b-47e1-b4d8-0720c122c00f tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:52.341415 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1bc8e492-250b-47e1-b4d8-0720c122c00f tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:52.356620 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9a3c7987-a14d-400a-8241-3c5238eee175 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:52.358621 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9a3c7987-a14d-400a-8241-3c5238eee175 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: 82458f68-8fcf-4d1f-8e7b-87d76f3576ad] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:52.372759 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9a3c7987-a14d-400a-8241-3c5238eee175 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:52.373554 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9a3c7987-a14d-400a-8241-3c5238eee175 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:52.375624 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9a3c7987-a14d-400a-8241-3c5238eee175 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:52.376716 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9a3c7987-a14d-400a-8241-3c5238eee175 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:52.378289 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9a3c7987-a14d-400a-8241-3c5238eee175 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:52.380431 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9a3c7987-a14d-400a-8241-3c5238eee175 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:53.050300 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1bc8e492-250b-47e1-b4d8-0720c122c00f tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27627bddc6b144188fc4cc1f9e8b677f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae429b36d3af4e708071ee7be5974025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:53.070011 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1bc8e492-250b-47e1-b4d8-0720c122c00f tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27627bddc6b144188fc4cc1f9e8b677f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae429b36d3af4e708071ee7be5974025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:53.076036 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1bc8e492-250b-47e1-b4d8-0720c122c00f tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27627bddc6b144188fc4cc1f9e8b677f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae429b36d3af4e708071ee7be5974025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:53.077400 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1bc8e492-250b-47e1-b4d8-0720c122c00f tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] 10.222.0.27 "GET /compute/v2.1/servers/05840cb4-7e09-49c5-8d55-a94dbfe241ae" status: 200 len: 1362 microversion: 2.26 time: 0.765561 Sep 08 10:58:53.097628 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2291/4499] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:58:52 2022] GET /compute/v2.1/servers/05840cb4-7e09-49c5-8d55-a94dbfe241ae => generated 1362 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:58:53.113377 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-08298086-a99e-48c0-8d7d-e7f0d53da310 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:53.115151 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-08298086-a99e-48c0-8d7d-e7f0d53da310 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] [instance: 7931ea02-ab01-4895-9ff2-265a0f58fe67] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:53.123809 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-08298086-a99e-48c0-8d7d-e7f0d53da310 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:53.124437 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-08298086-a99e-48c0-8d7d-e7f0d53da310 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:53.125267 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-08298086-a99e-48c0-8d7d-e7f0d53da310 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:53.126694 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-08298086-a99e-48c0-8d7d-e7f0d53da310 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:53.127342 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-08298086-a99e-48c0-8d7d-e7f0d53da310 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:53.127783 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-08298086-a99e-48c0-8d7d-e7f0d53da310 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:53.371475 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9a3c7987-a14d-400a-8241-3c5238eee175 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:53.396657 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9a3c7987-a14d-400a-8241-3c5238eee175 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad" status: 200 len: 1515 microversion: 2.1 time: 1.044316 Sep 08 10:58:53.397305 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2209/4500] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:52 2022] GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad => generated 1515 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:58:53.529643 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-08298086-a99e-48c0-8d7d-e7f0d53da310 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fe29b5496a4169b0588b7b18d75537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a85de2674b413cb72fe0de96eec7cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:53.543913 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-08298086-a99e-48c0-8d7d-e7f0d53da310 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] 10.222.0.27 "GET /compute/v2.1/servers/7931ea02-ab01-4895-9ff2-265a0f58fe67" status: 200 len: 1322 microversion: 2.1 time: 0.444326 Sep 08 10:58:53.545196 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2292/4501] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:53 2022] GET /compute/v2.1/servers/7931ea02-ab01-4895-9ff2-265a0f58fe67 => generated 1322 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:58:54.109208 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-94a5ca20-e8fb-4c78-812a-f8428f3aa554 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:54.110223 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-94a5ca20-e8fb-4c78-812a-f8428f3aa554 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] [instance: 05840cb4-7e09-49c5-8d55-a94dbfe241ae] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:54.129911 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94a5ca20-e8fb-4c78-812a-f8428f3aa554 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:54.140626 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94a5ca20-e8fb-4c78-812a-f8428f3aa554 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:54.142810 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94a5ca20-e8fb-4c78-812a-f8428f3aa554 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:54.143962 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94a5ca20-e8fb-4c78-812a-f8428f3aa554 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:54.149786 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94a5ca20-e8fb-4c78-812a-f8428f3aa554 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:54.150917 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94a5ca20-e8fb-4c78-812a-f8428f3aa554 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:54.424058 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e5ac766d-7bb0-4645-9183-3df15f13e7ce tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:54.425552 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e5ac766d-7bb0-4645-9183-3df15f13e7ce tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: 82458f68-8fcf-4d1f-8e7b-87d76f3576ad] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:54.451445 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e5ac766d-7bb0-4645-9183-3df15f13e7ce tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:54.453975 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e5ac766d-7bb0-4645-9183-3df15f13e7ce tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:54.455134 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e5ac766d-7bb0-4645-9183-3df15f13e7ce tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:54.465368 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e5ac766d-7bb0-4645-9183-3df15f13e7ce tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:54.467358 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e5ac766d-7bb0-4645-9183-3df15f13e7ce tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:54.469974 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e5ac766d-7bb0-4645-9183-3df15f13e7ce tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:54.951574 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e5ac766d-7bb0-4645-9183-3df15f13e7ce tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:54.971745 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e5ac766d-7bb0-4645-9183-3df15f13e7ce tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad" status: 200 len: 1521 microversion: 2.1 time: 0.553713 Sep 08 10:58:54.974603 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2293/4502] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:54 2022] GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad => generated 1521 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:58:54.999491 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-47a4cb07-1ee3-4641-ba70-bd95a20a7f4a tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:55.001592 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-47a4cb07-1ee3-4641-ba70-bd95a20a7f4a tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] [instance: 7931ea02-ab01-4895-9ff2-265a0f58fe67] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:55.030092 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-47a4cb07-1ee3-4641-ba70-bd95a20a7f4a tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:55.031549 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-47a4cb07-1ee3-4641-ba70-bd95a20a7f4a tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:55.033692 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-47a4cb07-1ee3-4641-ba70-bd95a20a7f4a tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:55.037549 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-47a4cb07-1ee3-4641-ba70-bd95a20a7f4a tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:55.038779 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-47a4cb07-1ee3-4641-ba70-bd95a20a7f4a tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:55.039627 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-47a4cb07-1ee3-4641-ba70-bd95a20a7f4a tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:55.111981 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-94a5ca20-e8fb-4c78-812a-f8428f3aa554 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27627bddc6b144188fc4cc1f9e8b677f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae429b36d3af4e708071ee7be5974025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:55.128664 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-94a5ca20-e8fb-4c78-812a-f8428f3aa554 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27627bddc6b144188fc4cc1f9e8b677f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae429b36d3af4e708071ee7be5974025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:55.136113 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-94a5ca20-e8fb-4c78-812a-f8428f3aa554 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27627bddc6b144188fc4cc1f9e8b677f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae429b36d3af4e708071ee7be5974025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:55.139148 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-94a5ca20-e8fb-4c78-812a-f8428f3aa554 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] 10.222.0.27 "GET /compute/v2.1/servers/05840cb4-7e09-49c5-8d55-a94dbfe241ae" status: 200 len: 1362 microversion: 2.26 time: 1.035132 Sep 08 10:58:55.153173 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2210/4503] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:58:54 2022] GET /compute/v2.1/servers/05840cb4-7e09-49c5-8d55-a94dbfe241ae => generated 1362 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:58:55.153173 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-a6e80cc1-da98-471f-8efd-6ea573abd3a4 req-5c92d018-02b2-4f50-9870-da330add9d19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a167b49e-6d6c-4602-8980-9a42fea46555", "tag": "cdf21544-85bd-4eb8-bb0b-d202a941648f"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:58:55.181933 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a6e80cc1-da98-471f-8efd-6ea573abd3a4 req-5c92d018-02b2-4f50-9870-da330add9d19 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:55.182567 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a6e80cc1-da98-471f-8efd-6ea573abd3a4 req-5c92d018-02b2-4f50-9870-da330add9d19 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:55.183199 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a6e80cc1-da98-471f-8efd-6ea573abd3a4 req-5c92d018-02b2-4f50-9870-da330add9d19 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:55.197131 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-a6e80cc1-da98-471f-8efd-6ea573abd3a4 req-5c92d018-02b2-4f50-9870-da330add9d19 service nova] Creating event network-changed:cdf21544-85bd-4eb8-bb0b-d202a941648f for instance a167b49e-6d6c-4602-8980-9a42fea46555 on n-h1-850501-12 Sep 08 10:58:55.203899 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-a6e80cc1-da98-471f-8efd-6ea573abd3a4 req-5c92d018-02b2-4f50-9870-da330add9d19 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059900 Sep 08 10:58:55.204872 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2211/4504] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:58:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:58:55.306858 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-2b5276e3-f3ae-4c05-be27-8976f22d191b req-2ffa472f-cc34-4725-a80c-987eafcba81a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82458f68-8fcf-4d1f-8e7b-87d76f3576ad", "name": "network-vif-unplugged", "status": "completed", "tag": "a5bc7eaa-9e35-436f-955a-a184196c4b6d"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:58:55.327583 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-2b5276e3-f3ae-4c05-be27-8976f22d191b req-2ffa472f-cc34-4725-a80c-987eafcba81a service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:55.328074 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-2b5276e3-f3ae-4c05-be27-8976f22d191b req-2ffa472f-cc34-4725-a80c-987eafcba81a service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:55.328517 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-2b5276e3-f3ae-4c05-be27-8976f22d191b req-2ffa472f-cc34-4725-a80c-987eafcba81a service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:55.369004 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-2b5276e3-f3ae-4c05-be27-8976f22d191b req-2ffa472f-cc34-4725-a80c-987eafcba81a service nova] Creating event network-vif-unplugged:a5bc7eaa-9e35-436f-955a-a184196c4b6d for instance 82458f68-8fcf-4d1f-8e7b-87d76f3576ad on n-h2-850501-12 Sep 08 10:58:55.378693 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-2b5276e3-f3ae-4c05-be27-8976f22d191b req-2ffa472f-cc34-4725-a80c-987eafcba81a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076134 Sep 08 10:58:55.380135 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2212/4505] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:58:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:58:55.500764 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-47a4cb07-1ee3-4641-ba70-bd95a20a7f4a tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fe29b5496a4169b0588b7b18d75537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a85de2674b413cb72fe0de96eec7cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:55.518374 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-47a4cb07-1ee3-4641-ba70-bd95a20a7f4a tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] 10.222.0.27 "GET /compute/v2.1/servers/7931ea02-ab01-4895-9ff2-265a0f58fe67" status: 200 len: 1322 microversion: 2.1 time: 0.540884 Sep 08 10:58:55.525199 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2294/4506] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:54 2022] GET /compute/v2.1/servers/7931ea02-ab01-4895-9ff2-265a0f58fe67 => generated 1322 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:58:56.006931 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-485aef01-7c48-406f-8110-68c4f6f6441c tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:56.008167 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-485aef01-7c48-406f-8110-68c4f6f6441c tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: 82458f68-8fcf-4d1f-8e7b-87d76f3576ad] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:56.026515 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-485aef01-7c48-406f-8110-68c4f6f6441c tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:56.027019 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-485aef01-7c48-406f-8110-68c4f6f6441c tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:56.028694 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-485aef01-7c48-406f-8110-68c4f6f6441c tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:56.029768 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-485aef01-7c48-406f-8110-68c4f6f6441c tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:56.030837 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-485aef01-7c48-406f-8110-68c4f6f6441c tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:56.031541 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-485aef01-7c48-406f-8110-68c4f6f6441c tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:56.186116 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-55ef5c3e-c3fc-45fa-bc21-df8d5da762d8 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:56.186908 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-55ef5c3e-c3fc-45fa-bc21-df8d5da762d8 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] [instance: 05840cb4-7e09-49c5-8d55-a94dbfe241ae] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:56.197678 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:58:56.199429 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-55ef5c3e-c3fc-45fa-bc21-df8d5da762d8 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:56.204249 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-55ef5c3e-c3fc-45fa-bc21-df8d5da762d8 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:56.204945 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-55ef5c3e-c3fc-45fa-bc21-df8d5da762d8 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:56.206561 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-55ef5c3e-c3fc-45fa-bc21-df8d5da762d8 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:56.207912 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-55ef5c3e-c3fc-45fa-bc21-df8d5da762d8 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:56.210260 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-55ef5c3e-c3fc-45fa-bc21-df8d5da762d8 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:56.590772 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-485aef01-7c48-406f-8110-68c4f6f6441c tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:56.622936 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-55ef5c3e-c3fc-45fa-bc21-df8d5da762d8 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27627bddc6b144188fc4cc1f9e8b677f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae429b36d3af4e708071ee7be5974025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:56.650187 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-55ef5c3e-c3fc-45fa-bc21-df8d5da762d8 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27627bddc6b144188fc4cc1f9e8b677f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae429b36d3af4e708071ee7be5974025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:56.659772 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-485aef01-7c48-406f-8110-68c4f6f6441c tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad" status: 200 len: 1521 microversion: 2.1 time: 0.659580 Sep 08 10:58:56.661949 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-55ef5c3e-c3fc-45fa-bc21-df8d5da762d8 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27627bddc6b144188fc4cc1f9e8b677f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae429b36d3af4e708071ee7be5974025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:56.668901 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-55ef5c3e-c3fc-45fa-bc21-df8d5da762d8 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] 10.222.0.27 "GET /compute/v2.1/servers/05840cb4-7e09-49c5-8d55-a94dbfe241ae" status: 200 len: 1547 microversion: 2.26 time: 0.486546 Sep 08 10:58:56.670741 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2295/4507] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:58:56 2022] GET /compute/v2.1/servers/05840cb4-7e09-49c5-8d55-a94dbfe241ae => generated 1547 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:58:56.676584 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2213/4508] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:55 2022] GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad => generated 1521 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:58:56.694930 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b0554e91-d50d-4a09-b137-7358e72e469a tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:56.696766 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b0554e91-d50d-4a09-b137-7358e72e469a tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] [instance: 7931ea02-ab01-4895-9ff2-265a0f58fe67] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:56.706053 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-25f8b86a-d39d-49ae-96d5-76abbeabcf7f tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Calling method '.version_select at 0x7f68e47315e0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:56.715663 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b0554e91-d50d-4a09-b137-7358e72e469a tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:56.717352 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b0554e91-d50d-4a09-b137-7358e72e469a tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:56.718765 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b0554e91-d50d-4a09-b137-7358e72e469a tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:56.720787 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b0554e91-d50d-4a09-b137-7358e72e469a tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:56.722065 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b0554e91-d50d-4a09-b137-7358e72e469a tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:56.723065 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b0554e91-d50d-4a09-b137-7358e72e469a tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:56.726101 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25f8b86a-d39d-49ae-96d5-76abbeabcf7f tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:56.737713 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25f8b86a-d39d-49ae-96d5-76abbeabcf7f tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:56.739320 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25f8b86a-d39d-49ae-96d5-76abbeabcf7f tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:56.765925 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-25f8b86a-d39d-49ae-96d5-76abbeabcf7f tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] [instance: 05840cb4-7e09-49c5-8d55-a94dbfe241ae] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:56.790661 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25f8b86a-d39d-49ae-96d5-76abbeabcf7f tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:56.791088 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25f8b86a-d39d-49ae-96d5-76abbeabcf7f tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:56.791533 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25f8b86a-d39d-49ae-96d5-76abbeabcf7f tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:56.792265 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25f8b86a-d39d-49ae-96d5-76abbeabcf7f tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:56.792727 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25f8b86a-d39d-49ae-96d5-76abbeabcf7f tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:56.793187 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25f8b86a-d39d-49ae-96d5-76abbeabcf7f tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:56.839912 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25f8b86a-d39d-49ae-96d5-76abbeabcf7f tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:56.840576 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25f8b86a-d39d-49ae-96d5-76abbeabcf7f tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:56.841353 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25f8b86a-d39d-49ae-96d5-76abbeabcf7f tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:56.862765 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25f8b86a-d39d-49ae-96d5-76abbeabcf7f tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:56.863378 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25f8b86a-d39d-49ae-96d5-76abbeabcf7f tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:56.863844 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25f8b86a-d39d-49ae-96d5-76abbeabcf7f tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:56.947590 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-25f8b86a-d39d-49ae-96d5-76abbeabcf7f tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lazy-loading 'flavor' on Instance uuid 05840cb4-7e09-49c5-8d55-a94dbfe241ae {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:58:56.993554 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-25f8b86a-d39d-49ae-96d5-76abbeabcf7f tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] 10.222.0.27 "PUT /compute/v2.1/servers/05840cb4-7e09-49c5-8d55-a94dbfe241ae/tags/tempest-tag-2032297833" status: 201 len: 0 microversion: 2.26 time: 0.296300 Sep 08 10:58:57.002036 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2214/4509] 10.222.0.27 () {62 vars in 1380 bytes} [Thu Sep 8 10:58:56 2022] PUT /compute/v2.1/servers/05840cb4-7e09-49c5-8d55-a94dbfe241ae/tags/tempest-tag-2032297833 => generated 0 bytes in 305 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Sep 08 10:58:57.016773 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-980fdc3d-326d-47cd-af1e-e79993605281 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Calling method '.version_select at 0x7f68e4748d30>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:57.037999 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-980fdc3d-326d-47cd-af1e-e79993605281 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:57.038498 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-980fdc3d-326d-47cd-af1e-e79993605281 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:57.043962 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-980fdc3d-326d-47cd-af1e-e79993605281 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:57.073397 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-980fdc3d-326d-47cd-af1e-e79993605281 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] 10.222.0.27 "GET /compute/v2.1/servers/05840cb4-7e09-49c5-8d55-a94dbfe241ae/tags/tempest-tag-2032297833" status: 204 len: 0 microversion: 2.26 time: 0.067068 Sep 08 10:58:57.079770 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2215/4510] 10.222.0.27 () {60 vars in 1361 bytes} [Thu Sep 8 10:58:57 2022] GET /compute/v2.1/servers/05840cb4-7e09-49c5-8d55-a94dbfe241ae/tags/tempest-tag-2032297833 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 10:58:57.096951 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f3aa40cd-33e6-4eca-b2da-b88d70172881 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Calling method '.version_select at 0x7f68e46df820>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:57.118371 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f3aa40cd-33e6-4eca-b2da-b88d70172881 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:57.119164 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f3aa40cd-33e6-4eca-b2da-b88d70172881 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:57.122489 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f3aa40cd-33e6-4eca-b2da-b88d70172881 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:57.123836 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f3aa40cd-33e6-4eca-b2da-b88d70172881 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] [instance: 05840cb4-7e09-49c5-8d55-a94dbfe241ae] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:57.142509 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f3aa40cd-33e6-4eca-b2da-b88d70172881 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:57.144497 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f3aa40cd-33e6-4eca-b2da-b88d70172881 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:57.147381 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f3aa40cd-33e6-4eca-b2da-b88d70172881 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:57.148155 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f3aa40cd-33e6-4eca-b2da-b88d70172881 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:57.150890 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f3aa40cd-33e6-4eca-b2da-b88d70172881 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:57.151339 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f3aa40cd-33e6-4eca-b2da-b88d70172881 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:57.234690 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f3aa40cd-33e6-4eca-b2da-b88d70172881 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:57.236610 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f3aa40cd-33e6-4eca-b2da-b88d70172881 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:57.237683 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f3aa40cd-33e6-4eca-b2da-b88d70172881 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:57.286709 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-f3aa40cd-33e6-4eca-b2da-b88d70172881 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lazy-loading 'flavor' on Instance uuid 05840cb4-7e09-49c5-8d55-a94dbfe241ae {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:58:57.335956 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f3aa40cd-33e6-4eca-b2da-b88d70172881 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] 10.222.0.27 "DELETE /compute/v2.1/servers/05840cb4-7e09-49c5-8d55-a94dbfe241ae/tags" status: 204 len: 0 microversion: 2.26 time: 0.250178 Sep 08 10:58:57.340076 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2216/4511] 10.222.0.27 () {60 vars in 1295 bytes} [Thu Sep 8 10:58:57 2022] DELETE /compute/v2.1/servers/05840cb4-7e09-49c5-8d55-a94dbfe241ae/tags => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 10:58:57.351427 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-87247255-f8d0-45a0-b351-f8db213f6577 req-a2183247-ecb5-4492-9dc9-1cddc019d0cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7931ea02-ab01-4895-9ff2-265a0f58fe67", "tag": "f0d5f2d9-a160-435c-aee8-9a0ee4f8a71f"}, {"name": "network-changed", "server_uuid": "f1de1e06-01fa-4eb7-9dc6-be46802187c5", "tag": "fb64b460-5d71-43ac-9f97-8a017825ab09"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:58:57.379387 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-87247255-f8d0-45a0-b351-f8db213f6577 req-a2183247-ecb5-4492-9dc9-1cddc019d0cd service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:57.380115 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-87247255-f8d0-45a0-b351-f8db213f6577 req-a2183247-ecb5-4492-9dc9-1cddc019d0cd service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:57.381016 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-87247255-f8d0-45a0-b351-f8db213f6577 req-a2183247-ecb5-4492-9dc9-1cddc019d0cd service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:57.402623 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-87247255-f8d0-45a0-b351-f8db213f6577 req-a2183247-ecb5-4492-9dc9-1cddc019d0cd service nova] Creating event network-changed:f0d5f2d9-a160-435c-aee8-9a0ee4f8a71f for instance 7931ea02-ab01-4895-9ff2-265a0f58fe67 on n-h1-850501-12 Sep 08 10:58:57.403315 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-87247255-f8d0-45a0-b351-f8db213f6577 req-a2183247-ecb5-4492-9dc9-1cddc019d0cd service nova] Creating event network-changed:fb64b460-5d71-43ac-9f97-8a017825ab09 for instance f1de1e06-01fa-4eb7-9dc6-be46802187c5 on n-h2-850501-12 Sep 08 10:58:57.421790 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-87247255-f8d0-45a0-b351-f8db213f6577 req-a2183247-ecb5-4492-9dc9-1cddc019d0cd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.078746 Sep 08 10:58:57.422872 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2217/4512] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:58:57 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:58:57.434407 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a7dc5a92-90bb-4756-9f18-7b3ebc52a2d6 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Calling method '.version_select at 0x7f68e4748d30>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:57.455445 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a7dc5a92-90bb-4756-9f18-7b3ebc52a2d6 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:57.456383 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a7dc5a92-90bb-4756-9f18-7b3ebc52a2d6 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:57.457076 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a7dc5a92-90bb-4756-9f18-7b3ebc52a2d6 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:57.498287 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a7dc5a92-90bb-4756-9f18-7b3ebc52a2d6 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] 10.222.0.27 "GET /compute/v2.1/servers/05840cb4-7e09-49c5-8d55-a94dbfe241ae/tags" status: 200 len: 12 microversion: 2.26 time: 0.073997 Sep 08 10:58:57.502886 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2218/4513] 10.222.0.27 () {60 vars in 1292 bytes} [Thu Sep 8 10:58:57 2022] GET /compute/v2.1/servers/05840cb4-7e09-49c5-8d55-a94dbfe241ae/tags => generated 12 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:58:57.514410 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-570e0494-1476-4892-adf8-0ae23a30feeb tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Calling method '.version_select at 0x7f68e43500d0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:57.548218 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-570e0494-1476-4892-adf8-0ae23a30feeb tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:57.552126 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-570e0494-1476-4892-adf8-0ae23a30feeb tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:57.552126 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-570e0494-1476-4892-adf8-0ae23a30feeb tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:57.569139 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-570e0494-1476-4892-adf8-0ae23a30feeb tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] [instance: 05840cb4-7e09-49c5-8d55-a94dbfe241ae] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:57.579173 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-570e0494-1476-4892-adf8-0ae23a30feeb tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:57.579930 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-570e0494-1476-4892-adf8-0ae23a30feeb tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:57.580532 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-570e0494-1476-4892-adf8-0ae23a30feeb tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:57.581652 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-570e0494-1476-4892-adf8-0ae23a30feeb tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:57.582371 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-570e0494-1476-4892-adf8-0ae23a30feeb tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:57.582966 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-570e0494-1476-4892-adf8-0ae23a30feeb tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:57.644093 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-570e0494-1476-4892-adf8-0ae23a30feeb tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:57.644912 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-570e0494-1476-4892-adf8-0ae23a30feeb tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:57.645676 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-570e0494-1476-4892-adf8-0ae23a30feeb tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:57.662553 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-570e0494-1476-4892-adf8-0ae23a30feeb tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:57.666132 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-570e0494-1476-4892-adf8-0ae23a30feeb tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:57.667317 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-570e0494-1476-4892-adf8-0ae23a30feeb tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:57.678876 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=1,nova_cell1:DELETE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:58:57.721087 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-570e0494-1476-4892-adf8-0ae23a30feeb tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lazy-loading 'flavor' on Instance uuid 05840cb4-7e09-49c5-8d55-a94dbfe241ae {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:58:57.786318 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-570e0494-1476-4892-adf8-0ae23a30feeb tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] 10.222.0.27 "PUT /compute/v2.1/servers/05840cb4-7e09-49c5-8d55-a94dbfe241ae/tags/tempest-tag-2039911643" status: 201 len: 0 microversion: 2.26 time: 0.272545 Sep 08 10:58:57.786318 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2219/4514] 10.222.0.27 () {62 vars in 1380 bytes} [Thu Sep 8 10:58:57 2022] PUT /compute/v2.1/servers/05840cb4-7e09-49c5-8d55-a94dbfe241ae/tags/tempest-tag-2039911643 => generated 0 bytes in 276 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Sep 08 10:58:57.795407 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-66e4f96e-874b-43fc-b34d-f9845697c110 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:57.796037 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-66e4f96e-874b-43fc-b34d-f9845697c110 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: 82458f68-8fcf-4d1f-8e7b-87d76f3576ad] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:57.825204 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-66e4f96e-874b-43fc-b34d-f9845697c110 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:57.826013 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-66e4f96e-874b-43fc-b34d-f9845697c110 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:57.826798 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-66e4f96e-874b-43fc-b34d-f9845697c110 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:57.827957 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-66e4f96e-874b-43fc-b34d-f9845697c110 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:57.828724 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-66e4f96e-874b-43fc-b34d-f9845697c110 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:57.835619 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-66e4f96e-874b-43fc-b34d-f9845697c110 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:57.974071 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b0554e91-d50d-4a09-b137-7358e72e469a tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fe29b5496a4169b0588b7b18d75537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a85de2674b413cb72fe0de96eec7cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:57.986558 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b0554e91-d50d-4a09-b137-7358e72e469a tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] 10.222.0.27 "GET /compute/v2.1/servers/7931ea02-ab01-4895-9ff2-265a0f58fe67" status: 200 len: 1322 microversion: 2.1 time: 1.313996 Sep 08 10:58:58.002427 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2296/4515] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:56 2022] GET /compute/v2.1/servers/7931ea02-ab01-4895-9ff2-265a0f58fe67 => generated 1322 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:58:58.021534 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2316e4d7-ac60-4373-ac85-c993476438df tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Calling method '.version_select at 0x7f68df4e4040>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:58.033920 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2316e4d7-ac60-4373-ac85-c993476438df tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:58.034953 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2316e4d7-ac60-4373-ac85-c993476438df tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:58.036549 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2316e4d7-ac60-4373-ac85-c993476438df tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:58.077831 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2316e4d7-ac60-4373-ac85-c993476438df tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] 10.222.0.27 "GET /compute/v2.1/servers/05840cb4-7e09-49c5-8d55-a94dbfe241ae/tags" status: 200 len: 36 microversion: 2.26 time: 0.073901 Sep 08 10:58:58.081530 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2297/4516] 10.222.0.27 () {60 vars in 1292 bytes} [Thu Sep 8 10:58:58 2022] GET /compute/v2.1/servers/05840cb4-7e09-49c5-8d55-a94dbfe241ae/tags => generated 36 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:58:58.092241 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e14dd3c4-ff8a-415c-ad8a-281a5135eb3c tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Calling method '.version_select at 0x7f68e40d54c0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:58.102327 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e14dd3c4-ff8a-415c-ad8a-281a5135eb3c tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:58.102825 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e14dd3c4-ff8a-415c-ad8a-281a5135eb3c tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:58.103268 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e14dd3c4-ff8a-415c-ad8a-281a5135eb3c tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:58.103755 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e14dd3c4-ff8a-415c-ad8a-281a5135eb3c tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] [instance: 05840cb4-7e09-49c5-8d55-a94dbfe241ae] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:58.111160 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e14dd3c4-ff8a-415c-ad8a-281a5135eb3c tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:58.111664 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e14dd3c4-ff8a-415c-ad8a-281a5135eb3c tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:58.112104 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e14dd3c4-ff8a-415c-ad8a-281a5135eb3c tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:58.112821 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e14dd3c4-ff8a-415c-ad8a-281a5135eb3c tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:58.113812 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e14dd3c4-ff8a-415c-ad8a-281a5135eb3c tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:58.114251 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e14dd3c4-ff8a-415c-ad8a-281a5135eb3c tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:58.154549 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e14dd3c4-ff8a-415c-ad8a-281a5135eb3c tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:58.155017 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e14dd3c4-ff8a-415c-ad8a-281a5135eb3c tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:58.155467 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e14dd3c4-ff8a-415c-ad8a-281a5135eb3c tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:58.196120 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-e14dd3c4-ff8a-415c-ad8a-281a5135eb3c tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lazy-loading 'flavor' on Instance uuid 05840cb4-7e09-49c5-8d55-a94dbfe241ae {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:58:58.229834 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e14dd3c4-ff8a-415c-ad8a-281a5135eb3c tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] 10.222.0.27 "DELETE /compute/v2.1/servers/05840cb4-7e09-49c5-8d55-a94dbfe241ae/tags/tempest-tag-2039911643" status: 204 len: 0 microversion: 2.26 time: 0.142537 Sep 08 10:58:58.231792 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2298/4517] 10.222.0.27 () {60 vars in 1364 bytes} [Thu Sep 8 10:58:58 2022] DELETE /compute/v2.1/servers/05840cb4-7e09-49c5-8d55-a94dbfe241ae/tags/tempest-tag-2039911643 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 10:58:58.244785 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a584405c-87b8-4b0d-89c7-a9776b60ebd8 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Calling method '.version_select at 0x7f68e44f0a60>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:58.249918 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-66e4f96e-874b-43fc-b34d-f9845697c110 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:58.267380 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-66e4f96e-874b-43fc-b34d-f9845697c110 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad" status: 200 len: 1521 microversion: 2.1 time: 0.480602 Sep 08 10:58:58.273386 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2220/4518] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:57 2022] GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad => generated 1521 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:58:58.274860 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a584405c-87b8-4b0d-89c7-a9776b60ebd8 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:58.276100 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a584405c-87b8-4b0d-89c7-a9776b60ebd8 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:58.277881 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a584405c-87b8-4b0d-89c7-a9776b60ebd8 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:58.289750 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a584405c-87b8-4b0d-89c7-a9776b60ebd8 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] 10.222.0.27 "GET /compute/v2.1/servers/05840cb4-7e09-49c5-8d55-a94dbfe241ae/tags" status: 200 len: 12 microversion: 2.26 time: 0.051472 Sep 08 10:58:58.292666 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2299/4519] 10.222.0.27 () {60 vars in 1292 bytes} [Thu Sep 8 10:58:58 2022] GET /compute/v2.1/servers/05840cb4-7e09-49c5-8d55-a94dbfe241ae/tags => generated 12 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:58:58.314547 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2802ca14-9e8b-47c8-b7e0-343c85b4fd90 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Calling method '.version_select at 0x7f68e464a550>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:58.327162 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2802ca14-9e8b-47c8-b7e0-343c85b4fd90 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:58.328565 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2802ca14-9e8b-47c8-b7e0-343c85b4fd90 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:58.329257 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2802ca14-9e8b-47c8-b7e0-343c85b4fd90 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:58.330174 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2802ca14-9e8b-47c8-b7e0-343c85b4fd90 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] [instance: 05840cb4-7e09-49c5-8d55-a94dbfe241ae] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:58.340720 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2802ca14-9e8b-47c8-b7e0-343c85b4fd90 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:58.340986 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2802ca14-9e8b-47c8-b7e0-343c85b4fd90 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:58.341453 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2802ca14-9e8b-47c8-b7e0-343c85b4fd90 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:58.343449 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2802ca14-9e8b-47c8-b7e0-343c85b4fd90 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:58.343849 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2802ca14-9e8b-47c8-b7e0-343c85b4fd90 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:58.345073 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2802ca14-9e8b-47c8-b7e0-343c85b4fd90 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:58.374177 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2802ca14-9e8b-47c8-b7e0-343c85b4fd90 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:58.374720 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2802ca14-9e8b-47c8-b7e0-343c85b4fd90 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:58.376717 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2802ca14-9e8b-47c8-b7e0-343c85b4fd90 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:58.395985 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-2802ca14-9e8b-47c8-b7e0-343c85b4fd90 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lazy-loading 'flavor' on Instance uuid 05840cb4-7e09-49c5-8d55-a94dbfe241ae {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:58:58.428120 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2802ca14-9e8b-47c8-b7e0-343c85b4fd90 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] 10.222.0.27 "DELETE /compute/v2.1/servers/05840cb4-7e09-49c5-8d55-a94dbfe241ae/tags" status: 204 len: 0 microversion: 2.26 time: 0.126479 Sep 08 10:58:58.439639 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2221/4520] 10.222.0.27 () {60 vars in 1295 bytes} [Thu Sep 8 10:58:58 2022] DELETE /compute/v2.1/servers/05840cb4-7e09-49c5-8d55-a94dbfe241ae/tags => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 10:58:58.452997 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-097c377b-9213-41a6-88ce-d5e5bb5130f8 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Calling method '.version_select at 0x7f68df4d0430>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:58.474308 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-097c377b-9213-41a6-88ce-d5e5bb5130f8 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:58.475275 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-097c377b-9213-41a6-88ce-d5e5bb5130f8 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:58.475945 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-097c377b-9213-41a6-88ce-d5e5bb5130f8 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:58.476782 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-097c377b-9213-41a6-88ce-d5e5bb5130f8 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] [instance: 05840cb4-7e09-49c5-8d55-a94dbfe241ae] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:58.484154 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-097c377b-9213-41a6-88ce-d5e5bb5130f8 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:58.484905 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-097c377b-9213-41a6-88ce-d5e5bb5130f8 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:58.485405 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-097c377b-9213-41a6-88ce-d5e5bb5130f8 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:58.486121 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-097c377b-9213-41a6-88ce-d5e5bb5130f8 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:58.486616 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-097c377b-9213-41a6-88ce-d5e5bb5130f8 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:58.487050 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-097c377b-9213-41a6-88ce-d5e5bb5130f8 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:58.608124 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-097c377b-9213-41a6-88ce-d5e5bb5130f8 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:58.608124 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-097c377b-9213-41a6-88ce-d5e5bb5130f8 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:58.608520 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-097c377b-9213-41a6-88ce-d5e5bb5130f8 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:58.665907 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-097c377b-9213-41a6-88ce-d5e5bb5130f8 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:58.671334 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-097c377b-9213-41a6-88ce-d5e5bb5130f8 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:58.674451 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-097c377b-9213-41a6-88ce-d5e5bb5130f8 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:58.758846 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-097c377b-9213-41a6-88ce-d5e5bb5130f8 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lazy-loading 'flavor' on Instance uuid 05840cb4-7e09-49c5-8d55-a94dbfe241ae {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:58:58.792759 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-097c377b-9213-41a6-88ce-d5e5bb5130f8 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] 10.222.0.27 "PUT /compute/v2.1/servers/05840cb4-7e09-49c5-8d55-a94dbfe241ae/tags/tempest-tag-1636723461" status: 201 len: 0 microversion: 2.26 time: 0.347564 Sep 08 10:58:58.800254 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2300/4521] 10.222.0.27 () {62 vars in 1380 bytes} [Thu Sep 8 10:58:58 2022] PUT /compute/v2.1/servers/05840cb4-7e09-49c5-8d55-a94dbfe241ae/tags/tempest-tag-1636723461 => generated 0 bytes in 355 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Sep 08 10:58:58.811386 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-12c9213f-a48e-4dd3-97ed-d9d1b75e3275 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Calling method '.version_select at 0x7f68e48060d0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:58.841705 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12c9213f-a48e-4dd3-97ed-d9d1b75e3275 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:58.865715 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12c9213f-a48e-4dd3-97ed-d9d1b75e3275 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:58.866184 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12c9213f-a48e-4dd3-97ed-d9d1b75e3275 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:58.866696 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-12c9213f-a48e-4dd3-97ed-d9d1b75e3275 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] [instance: 05840cb4-7e09-49c5-8d55-a94dbfe241ae] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:58.879710 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12c9213f-a48e-4dd3-97ed-d9d1b75e3275 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:58.894218 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12c9213f-a48e-4dd3-97ed-d9d1b75e3275 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:58.895533 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12c9213f-a48e-4dd3-97ed-d9d1b75e3275 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:58.896776 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12c9213f-a48e-4dd3-97ed-d9d1b75e3275 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:58.897686 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12c9213f-a48e-4dd3-97ed-d9d1b75e3275 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:58.898140 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12c9213f-a48e-4dd3-97ed-d9d1b75e3275 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:58.943567 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12c9213f-a48e-4dd3-97ed-d9d1b75e3275 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:58.944616 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12c9213f-a48e-4dd3-97ed-d9d1b75e3275 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:58.945505 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12c9213f-a48e-4dd3-97ed-d9d1b75e3275 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:58.962698 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12c9213f-a48e-4dd3-97ed-d9d1b75e3275 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:58.963448 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12c9213f-a48e-4dd3-97ed-d9d1b75e3275 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:58.964172 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12c9213f-a48e-4dd3-97ed-d9d1b75e3275 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:59.003211 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-12c9213f-a48e-4dd3-97ed-d9d1b75e3275 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lazy-loading 'flavor' on Instance uuid 05840cb4-7e09-49c5-8d55-a94dbfe241ae {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:58:59.024464 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-12c9213f-a48e-4dd3-97ed-d9d1b75e3275 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] 10.222.0.27 "PUT /compute/v2.1/servers/05840cb4-7e09-49c5-8d55-a94dbfe241ae/tags/tempest-tag-698094815" status: 201 len: 0 microversion: 2.26 time: 0.221656 Sep 08 10:58:59.025051 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-63add6c1-a324-4049-87ca-140c14dbe1d9 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:59.025687 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-63add6c1-a324-4049-87ca-140c14dbe1d9 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] [instance: 7931ea02-ab01-4895-9ff2-265a0f58fe67] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:59.031265 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2222/4522] 10.222.0.27 () {62 vars in 1377 bytes} [Thu Sep 8 10:58:58 2022] PUT /compute/v2.1/servers/05840cb4-7e09-49c5-8d55-a94dbfe241ae/tags/tempest-tag-698094815 => generated 0 bytes in 228 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Sep 08 10:58:59.040988 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-523538fa-8c2c-49f9-884d-a85fd1bd4ed5 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Calling method '.version_select at 0x7f68e4630040>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:59.045603 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-63add6c1-a324-4049-87ca-140c14dbe1d9 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:59.046123 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-63add6c1-a324-4049-87ca-140c14dbe1d9 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:59.049078 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-63add6c1-a324-4049-87ca-140c14dbe1d9 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:59.052664 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-63add6c1-a324-4049-87ca-140c14dbe1d9 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:59.053327 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-523538fa-8c2c-49f9-884d-a85fd1bd4ed5 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:59.053494 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-63add6c1-a324-4049-87ca-140c14dbe1d9 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:59.054208 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-523538fa-8c2c-49f9-884d-a85fd1bd4ed5 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:59.055751 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-523538fa-8c2c-49f9-884d-a85fd1bd4ed5 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:59.055953 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-63add6c1-a324-4049-87ca-140c14dbe1d9 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:59.056630 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-523538fa-8c2c-49f9-884d-a85fd1bd4ed5 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] [instance: 05840cb4-7e09-49c5-8d55-a94dbfe241ae] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:59.063634 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-523538fa-8c2c-49f9-884d-a85fd1bd4ed5 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:59.064433 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-523538fa-8c2c-49f9-884d-a85fd1bd4ed5 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:59.066034 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-523538fa-8c2c-49f9-884d-a85fd1bd4ed5 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:59.067650 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-523538fa-8c2c-49f9-884d-a85fd1bd4ed5 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:59.068352 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-523538fa-8c2c-49f9-884d-a85fd1bd4ed5 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:59.068957 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-523538fa-8c2c-49f9-884d-a85fd1bd4ed5 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:59.099742 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-523538fa-8c2c-49f9-884d-a85fd1bd4ed5 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:59.100436 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-523538fa-8c2c-49f9-884d-a85fd1bd4ed5 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:59.100896 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-523538fa-8c2c-49f9-884d-a85fd1bd4ed5 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:59.118595 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-523538fa-8c2c-49f9-884d-a85fd1bd4ed5 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lazy-loading 'flavor' on Instance uuid 05840cb4-7e09-49c5-8d55-a94dbfe241ae {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:58:59.136345 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-523538fa-8c2c-49f9-884d-a85fd1bd4ed5 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] 10.222.0.27 "DELETE /compute/v2.1/servers/05840cb4-7e09-49c5-8d55-a94dbfe241ae/tags" status: 204 len: 0 microversion: 2.26 time: 0.101901 Sep 08 10:58:59.140621 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2223/4523] 10.222.0.27 () {60 vars in 1295 bytes} [Thu Sep 8 10:58:59 2022] DELETE /compute/v2.1/servers/05840cb4-7e09-49c5-8d55-a94dbfe241ae/tags => generated 0 bytes in 104 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 10:58:59.148287 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9278af41-11ab-4a67-942d-ec0ae5e48270 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Calling method '.version_select at 0x7f68e4350b80>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:59.163204 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9278af41-11ab-4a67-942d-ec0ae5e48270 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:59.165564 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9278af41-11ab-4a67-942d-ec0ae5e48270 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:59.166447 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9278af41-11ab-4a67-942d-ec0ae5e48270 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:59.188639 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9278af41-11ab-4a67-942d-ec0ae5e48270 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] 10.222.0.27 "GET /compute/v2.1/servers/05840cb4-7e09-49c5-8d55-a94dbfe241ae/tags" status: 200 len: 12 microversion: 2.26 time: 0.046630 Sep 08 10:58:59.197350 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2224/4524] 10.222.0.27 () {60 vars in 1292 bytes} [Thu Sep 8 10:58:59 2022] GET /compute/v2.1/servers/05840cb4-7e09-49c5-8d55-a94dbfe241ae/tags => generated 12 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:58:59.204171 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-49d61eb0-52ee-4bf4-b4ae-f41ae159d2ae tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Calling method '.version_select at 0x7f68e46300d0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:59.215878 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49d61eb0-52ee-4bf4-b4ae-f41ae159d2ae tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:59.216577 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49d61eb0-52ee-4bf4-b4ae-f41ae159d2ae tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:59.217217 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49d61eb0-52ee-4bf4-b4ae-f41ae159d2ae tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:59.218090 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-49d61eb0-52ee-4bf4-b4ae-f41ae159d2ae tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] [instance: 05840cb4-7e09-49c5-8d55-a94dbfe241ae] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:59.227201 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49d61eb0-52ee-4bf4-b4ae-f41ae159d2ae tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:59.228257 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49d61eb0-52ee-4bf4-b4ae-f41ae159d2ae tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:59.228996 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49d61eb0-52ee-4bf4-b4ae-f41ae159d2ae tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:59.230011 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49d61eb0-52ee-4bf4-b4ae-f41ae159d2ae tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:59.230640 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49d61eb0-52ee-4bf4-b4ae-f41ae159d2ae tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:59.231872 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49d61eb0-52ee-4bf4-b4ae-f41ae159d2ae tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:59.263031 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49d61eb0-52ee-4bf4-b4ae-f41ae159d2ae tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:59.263806 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49d61eb0-52ee-4bf4-b4ae-f41ae159d2ae tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:59.264420 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49d61eb0-52ee-4bf4-b4ae-f41ae159d2ae tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:59.278400 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-49d61eb0-52ee-4bf4-b4ae-f41ae159d2ae tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lazy-loading 'flavor' on Instance uuid 05840cb4-7e09-49c5-8d55-a94dbfe241ae {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:58:59.305738 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-49d61eb0-52ee-4bf4-b4ae-f41ae159d2ae tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] 10.222.0.27 "DELETE /compute/v2.1/servers/05840cb4-7e09-49c5-8d55-a94dbfe241ae/tags" status: 204 len: 0 microversion: 2.26 time: 0.106691 Sep 08 10:58:59.308939 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2225/4525] 10.222.0.27 () {60 vars in 1295 bytes} [Thu Sep 8 10:58:59 2022] DELETE /compute/v2.1/servers/05840cb4-7e09-49c5-8d55-a94dbfe241ae/tags => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 10:58:59.322604 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-663e4f47-2ff9-4cd1-ae2d-528e484c01b1 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:59.323494 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-663e4f47-2ff9-4cd1-ae2d-528e484c01b1 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: 82458f68-8fcf-4d1f-8e7b-87d76f3576ad] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:59.338682 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-663e4f47-2ff9-4cd1-ae2d-528e484c01b1 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:59.341435 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-663e4f47-2ff9-4cd1-ae2d-528e484c01b1 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:59.342159 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-663e4f47-2ff9-4cd1-ae2d-528e484c01b1 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:59.343117 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-663e4f47-2ff9-4cd1-ae2d-528e484c01b1 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:59.345080 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-663e4f47-2ff9-4cd1-ae2d-528e484c01b1 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:59.346789 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-663e4f47-2ff9-4cd1-ae2d-528e484c01b1 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:00.594339 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-663e4f47-2ff9-4cd1-ae2d-528e484c01b1 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:00.634784 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-663e4f47-2ff9-4cd1-ae2d-528e484c01b1 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad" status: 200 len: 1521 microversion: 2.1 time: 1.321884 Sep 08 10:59:00.635808 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2226/4526] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:59 2022] GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad => generated 1521 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:00.662563 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6be4a930-aca1-4318-9a39-cbb7c666fb6f tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Calling method '.version_select at 0x7f68e46df310>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:00.666347 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-63add6c1-a324-4049-87ca-140c14dbe1d9 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fe29b5496a4169b0588b7b18d75537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a85de2674b413cb72fe0de96eec7cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:00.680453 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-63add6c1-a324-4049-87ca-140c14dbe1d9 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] 10.222.0.27 "GET /compute/v2.1/servers/7931ea02-ab01-4895-9ff2-265a0f58fe67" status: 200 len: 1322 microversion: 2.1 time: 1.662975 Sep 08 10:59:00.684907 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6be4a930-aca1-4318-9a39-cbb7c666fb6f tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:00.686343 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2301/4527] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:59 2022] GET /compute/v2.1/servers/7931ea02-ab01-4895-9ff2-265a0f58fe67 => generated 1322 bytes in 1664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:59:00.687066 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6be4a930-aca1-4318-9a39-cbb7c666fb6f tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:00.687819 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6be4a930-aca1-4318-9a39-cbb7c666fb6f tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:00.691143 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6be4a930-aca1-4318-9a39-cbb7c666fb6f tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] [instance: 05840cb4-7e09-49c5-8d55-a94dbfe241ae] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:00.707540 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-ee5f13fa-e050-4e42-9e58-f648794b5251 req-e572cbb6-baff-477e-923e-92d60eb2e3ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82458f68-8fcf-4d1f-8e7b-87d76f3576ad", "name": "network-vif-plugged", "status": "completed", "tag": "a5bc7eaa-9e35-436f-955a-a184196c4b6d"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:59:00.711328 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6be4a930-aca1-4318-9a39-cbb7c666fb6f tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:00.712805 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6be4a930-aca1-4318-9a39-cbb7c666fb6f tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:00.713802 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6be4a930-aca1-4318-9a39-cbb7c666fb6f tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:00.716576 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6be4a930-aca1-4318-9a39-cbb7c666fb6f tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:00.718026 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6be4a930-aca1-4318-9a39-cbb7c666fb6f tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:00.719336 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6be4a930-aca1-4318-9a39-cbb7c666fb6f tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:00.767714 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-ee5f13fa-e050-4e42-9e58-f648794b5251 req-e572cbb6-baff-477e-923e-92d60eb2e3ae service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:00.769064 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-ee5f13fa-e050-4e42-9e58-f648794b5251 req-e572cbb6-baff-477e-923e-92d60eb2e3ae service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:00.771026 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-ee5f13fa-e050-4e42-9e58-f648794b5251 req-e572cbb6-baff-477e-923e-92d60eb2e3ae service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:00.788806 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6be4a930-aca1-4318-9a39-cbb7c666fb6f tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:00.791937 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6be4a930-aca1-4318-9a39-cbb7c666fb6f tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:00.792761 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6be4a930-aca1-4318-9a39-cbb7c666fb6f tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:00.834184 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6be4a930-aca1-4318-9a39-cbb7c666fb6f tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:00.834685 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6be4a930-aca1-4318-9a39-cbb7c666fb6f tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:00.835126 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6be4a930-aca1-4318-9a39-cbb7c666fb6f tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:00.845508 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-ee5f13fa-e050-4e42-9e58-f648794b5251 req-e572cbb6-baff-477e-923e-92d60eb2e3ae service nova] Creating event network-vif-plugged:a5bc7eaa-9e35-436f-955a-a184196c4b6d for instance 82458f68-8fcf-4d1f-8e7b-87d76f3576ad on n-h2-850501-12 Sep 08 10:59:00.866646 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-ee5f13fa-e050-4e42-9e58-f648794b5251 req-e572cbb6-baff-477e-923e-92d60eb2e3ae service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.178157 Sep 08 10:59:00.873336 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2302/4528] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:59:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:59:00.921202 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-6be4a930-aca1-4318-9a39-cbb7c666fb6f tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lazy-loading 'flavor' on Instance uuid 05840cb4-7e09-49c5-8d55-a94dbfe241ae {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:59:00.954472 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6be4a930-aca1-4318-9a39-cbb7c666fb6f tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] 10.222.0.27 "PUT /compute/v2.1/servers/05840cb4-7e09-49c5-8d55-a94dbfe241ae/tags/tempest-tag-1163151134" status: 201 len: 0 microversion: 2.26 time: 0.298157 Sep 08 10:59:00.955763 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2227/4529] 10.222.0.27 () {62 vars in 1380 bytes} [Thu Sep 8 10:59:00 2022] PUT /compute/v2.1/servers/05840cb4-7e09-49c5-8d55-a94dbfe241ae/tags/tempest-tag-1163151134 => generated 0 bytes in 319 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Sep 08 10:59:00.977740 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-16626a4a-34ab-4dc6-9b68-bf56bacf456f tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Calling method '.version_select at 0x7f68df95e820>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:00.999570 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-16626a4a-34ab-4dc6-9b68-bf56bacf456f tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:01.000793 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-16626a4a-34ab-4dc6-9b68-bf56bacf456f tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:01.003122 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-16626a4a-34ab-4dc6-9b68-bf56bacf456f tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:01.005805 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-16626a4a-34ab-4dc6-9b68-bf56bacf456f tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] [instance: 05840cb4-7e09-49c5-8d55-a94dbfe241ae] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:01.017612 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-16626a4a-34ab-4dc6-9b68-bf56bacf456f tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:01.018899 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-16626a4a-34ab-4dc6-9b68-bf56bacf456f tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:01.020875 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-16626a4a-34ab-4dc6-9b68-bf56bacf456f tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:01.022558 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-16626a4a-34ab-4dc6-9b68-bf56bacf456f tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:01.023662 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-16626a4a-34ab-4dc6-9b68-bf56bacf456f tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:01.024669 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-16626a4a-34ab-4dc6-9b68-bf56bacf456f tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:01.096646 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-16626a4a-34ab-4dc6-9b68-bf56bacf456f tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:01.097303 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-16626a4a-34ab-4dc6-9b68-bf56bacf456f tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:01.098314 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-16626a4a-34ab-4dc6-9b68-bf56bacf456f tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:01.113766 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-16626a4a-34ab-4dc6-9b68-bf56bacf456f tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:01.114550 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-16626a4a-34ab-4dc6-9b68-bf56bacf456f tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:01.115185 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-16626a4a-34ab-4dc6-9b68-bf56bacf456f tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:01.149587 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-16626a4a-34ab-4dc6-9b68-bf56bacf456f tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lazy-loading 'flavor' on Instance uuid 05840cb4-7e09-49c5-8d55-a94dbfe241ae {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:59:01.174254 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-16626a4a-34ab-4dc6-9b68-bf56bacf456f tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] 10.222.0.27 "PUT /compute/v2.1/servers/05840cb4-7e09-49c5-8d55-a94dbfe241ae/tags/tempest-tag-1480525163" status: 201 len: 0 microversion: 2.26 time: 0.207858 Sep 08 10:59:01.175971 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2303/4530] 10.222.0.27 () {62 vars in 1380 bytes} [Thu Sep 8 10:59:00 2022] PUT /compute/v2.1/servers/05840cb4-7e09-49c5-8d55-a94dbfe241ae/tags/tempest-tag-1480525163 => generated 0 bytes in 211 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Sep 08 10:59:01.186628 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e6557ab9-9bb1-487a-b11c-cdb0f50de324 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Action: 'update_all', calling method: .version_select at 0x7f68e464a8b0>, body: {"tags": ["tempest-tag-1554044574", "tempest-tag-901828627"]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:59:01.199052 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e6557ab9-9bb1-487a-b11c-cdb0f50de324 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:01.200523 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e6557ab9-9bb1-487a-b11c-cdb0f50de324 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:01.201350 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e6557ab9-9bb1-487a-b11c-cdb0f50de324 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:01.202421 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e6557ab9-9bb1-487a-b11c-cdb0f50de324 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] [instance: 05840cb4-7e09-49c5-8d55-a94dbfe241ae] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:01.212187 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e6557ab9-9bb1-487a-b11c-cdb0f50de324 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:01.212910 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e6557ab9-9bb1-487a-b11c-cdb0f50de324 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:01.213977 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e6557ab9-9bb1-487a-b11c-cdb0f50de324 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:01.214947 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e6557ab9-9bb1-487a-b11c-cdb0f50de324 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:01.215600 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e6557ab9-9bb1-487a-b11c-cdb0f50de324 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:01.216235 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e6557ab9-9bb1-487a-b11c-cdb0f50de324 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:01.260036 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e6557ab9-9bb1-487a-b11c-cdb0f50de324 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:01.260774 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e6557ab9-9bb1-487a-b11c-cdb0f50de324 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:01.261750 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e6557ab9-9bb1-487a-b11c-cdb0f50de324 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:01.315235 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-e6557ab9-9bb1-487a-b11c-cdb0f50de324 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lazy-loading 'flavor' on Instance uuid 05840cb4-7e09-49c5-8d55-a94dbfe241ae {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:59:01.353175 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e6557ab9-9bb1-487a-b11c-cdb0f50de324 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] 10.222.0.27 "PUT /compute/v2.1/servers/05840cb4-7e09-49c5-8d55-a94dbfe241ae/tags" status: 200 len: 61 microversion: 2.26 time: 0.171395 Sep 08 10:59:01.354144 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2228/4531] 10.222.0.27 () {62 vars in 1312 bytes} [Thu Sep 8 10:59:01 2022] PUT /compute/v2.1/servers/05840cb4-7e09-49c5-8d55-a94dbfe241ae/tags => generated 61 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:59:01.366707 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fa746e91-f7af-488a-a4c0-482a9d1fbef4 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Calling method '.version_select at 0x7f68e40d5040>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:01.392985 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fa746e91-f7af-488a-a4c0-482a9d1fbef4 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:01.394799 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fa746e91-f7af-488a-a4c0-482a9d1fbef4 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:01.396801 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fa746e91-f7af-488a-a4c0-482a9d1fbef4 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:01.427740 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fa746e91-f7af-488a-a4c0-482a9d1fbef4 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] 10.222.0.27 "GET /compute/v2.1/servers/05840cb4-7e09-49c5-8d55-a94dbfe241ae/tags" status: 200 len: 61 microversion: 2.26 time: 0.067363 Sep 08 10:59:01.430343 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2304/4532] 10.222.0.27 () {60 vars in 1292 bytes} [Thu Sep 8 10:59:01 2022] GET /compute/v2.1/servers/05840cb4-7e09-49c5-8d55-a94dbfe241ae/tags => generated 61 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:01.442897 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c7b43dff-4851-4907-8e7b-0a570e7fbe0b tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Calling method '.version_select at 0x7f68e46305e0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:01.460249 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c7b43dff-4851-4907-8e7b-0a570e7fbe0b tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:01.466406 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c7b43dff-4851-4907-8e7b-0a570e7fbe0b tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:01.467153 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c7b43dff-4851-4907-8e7b-0a570e7fbe0b tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:01.468332 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c7b43dff-4851-4907-8e7b-0a570e7fbe0b tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] [instance: 05840cb4-7e09-49c5-8d55-a94dbfe241ae] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:01.487305 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c7b43dff-4851-4907-8e7b-0a570e7fbe0b tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:01.488765 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c7b43dff-4851-4907-8e7b-0a570e7fbe0b tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:01.493944 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c7b43dff-4851-4907-8e7b-0a570e7fbe0b tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:01.504470 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c7b43dff-4851-4907-8e7b-0a570e7fbe0b tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:01.505723 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c7b43dff-4851-4907-8e7b-0a570e7fbe0b tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:01.506776 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c7b43dff-4851-4907-8e7b-0a570e7fbe0b tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:01.604180 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c7b43dff-4851-4907-8e7b-0a570e7fbe0b tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:01.605389 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c7b43dff-4851-4907-8e7b-0a570e7fbe0b tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:01.606002 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c7b43dff-4851-4907-8e7b-0a570e7fbe0b tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:01.610054 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:RELEASE=3,nova_cell1:SELECT=88,nova_cell1:DELETE=4,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:59:01.627608 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-c7b43dff-4851-4907-8e7b-0a570e7fbe0b tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lazy-loading 'flavor' on Instance uuid 05840cb4-7e09-49c5-8d55-a94dbfe241ae {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:59:01.661397 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c7b43dff-4851-4907-8e7b-0a570e7fbe0b tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] 10.222.0.27 "DELETE /compute/v2.1/servers/05840cb4-7e09-49c5-8d55-a94dbfe241ae/tags" status: 204 len: 0 microversion: 2.26 time: 0.225835 Sep 08 10:59:01.663046 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-dca10c14-dc97-4a96-8fe2-c1e140e4f5b4 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:01.663688 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-dca10c14-dc97-4a96-8fe2-c1e140e4f5b4 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: 82458f68-8fcf-4d1f-8e7b-87d76f3576ad] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:01.665092 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2229/4533] 10.222.0.27 () {60 vars in 1295 bytes} [Thu Sep 8 10:59:01 2022] DELETE /compute/v2.1/servers/05840cb4-7e09-49c5-8d55-a94dbfe241ae/tags => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 10:59:01.679183 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dca10c14-dc97-4a96-8fe2-c1e140e4f5b4 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:01.680049 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dca10c14-dc97-4a96-8fe2-c1e140e4f5b4 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:01.680611 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dca10c14-dc97-4a96-8fe2-c1e140e4f5b4 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:01.682294 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-423150fc-f356-409f-9d3b-a13b8d239d29 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:01.683808 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-423150fc-f356-409f-9d3b-a13b8d239d29 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] [instance: 05840cb4-7e09-49c5-8d55-a94dbfe241ae] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:01.690163 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dca10c14-dc97-4a96-8fe2-c1e140e4f5b4 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:01.691043 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dca10c14-dc97-4a96-8fe2-c1e140e4f5b4 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:01.691526 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dca10c14-dc97-4a96-8fe2-c1e140e4f5b4 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:01.696758 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=93,nova_cell1:DELETE=1,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:59:01.709416 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-423150fc-f356-409f-9d3b-a13b8d239d29 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:01.710657 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-423150fc-f356-409f-9d3b-a13b8d239d29 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:01.713860 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-423150fc-f356-409f-9d3b-a13b8d239d29 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:01.717679 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-423150fc-f356-409f-9d3b-a13b8d239d29 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:01.718732 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-423150fc-f356-409f-9d3b-a13b8d239d29 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:01.719617 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-423150fc-f356-409f-9d3b-a13b8d239d29 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:01.789355 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-423150fc-f356-409f-9d3b-a13b8d239d29 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] [instance: 05840cb4-7e09-49c5-8d55-a94dbfe241ae] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:59:02.065290 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-423150fc-f356-409f-9d3b-a13b8d239d29 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] 10.222.0.27 "DELETE /compute/v2.1/servers/05840cb4-7e09-49c5-8d55-a94dbfe241ae" status: 204 len: 0 microversion: 2.26 time: 0.393373 Sep 08 10:59:02.073896 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2230/4534] 10.222.0.27 () {60 vars in 1280 bytes} [Thu Sep 8 10:59:01 2022] DELETE /compute/v2.1/servers/05840cb4-7e09-49c5-8d55-a94dbfe241ae => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 10:59:02.082531 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-38d3325c-12ed-47b1-a86b-501074d3f5a4 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:02.088612 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-38d3325c-12ed-47b1-a86b-501074d3f5a4 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] [instance: 7931ea02-ab01-4895-9ff2-265a0f58fe67] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:02.109817 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38d3325c-12ed-47b1-a86b-501074d3f5a4 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:02.110295 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38d3325c-12ed-47b1-a86b-501074d3f5a4 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:02.110770 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38d3325c-12ed-47b1-a86b-501074d3f5a4 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:02.111483 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38d3325c-12ed-47b1-a86b-501074d3f5a4 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:02.111951 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38d3325c-12ed-47b1-a86b-501074d3f5a4 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:02.112388 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38d3325c-12ed-47b1-a86b-501074d3f5a4 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:02.297916 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-dca10c14-dc97-4a96-8fe2-c1e140e4f5b4 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:02.345800 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-dca10c14-dc97-4a96-8fe2-c1e140e4f5b4 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad" status: 200 len: 1521 microversion: 2.1 time: 0.682137 Sep 08 10:59:02.348874 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2305/4535] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:01 2022] GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad => generated 1521 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:02.367612 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a6e51eb0-685a-4ff4-bd82-61c4f2c77164 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:02.369105 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a6e51eb0-685a-4ff4-bd82-61c4f2c77164 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] [instance: 05840cb4-7e09-49c5-8d55-a94dbfe241ae] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:02.379782 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a6e51eb0-685a-4ff4-bd82-61c4f2c77164 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:02.380617 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a6e51eb0-685a-4ff4-bd82-61c4f2c77164 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:02.381319 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a6e51eb0-685a-4ff4-bd82-61c4f2c77164 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:02.382336 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a6e51eb0-685a-4ff4-bd82-61c4f2c77164 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:02.383046 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a6e51eb0-685a-4ff4-bd82-61c4f2c77164 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:02.385960 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a6e51eb0-685a-4ff4-bd82-61c4f2c77164 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:02.896826 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-38d3325c-12ed-47b1-a86b-501074d3f5a4 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fe29b5496a4169b0588b7b18d75537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a85de2674b413cb72fe0de96eec7cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:02.908983 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-38d3325c-12ed-47b1-a86b-501074d3f5a4 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] 10.222.0.27 "GET /compute/v2.1/servers/7931ea02-ab01-4895-9ff2-265a0f58fe67" status: 200 len: 1322 microversion: 2.1 time: 0.836181 Sep 08 10:59:02.909652 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2231/4536] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:02 2022] GET /compute/v2.1/servers/7931ea02-ab01-4895-9ff2-265a0f58fe67 => generated 1322 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:03.055176 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-e42d685b-83ac-48bb-b4dd-b3ad11395c10 req-3468ef7b-8880-4343-aabc-5bf01e17da78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1de1e06-01fa-4eb7-9dc6-be46802187c5", "name": "network-vif-plugged", "status": "completed", "tag": "fb64b460-5d71-43ac-9f97-8a017825ab09"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:59:03.078676 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:59:03.126265 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e42d685b-83ac-48bb-b4dd-b3ad11395c10 req-3468ef7b-8880-4343-aabc-5bf01e17da78 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:03.126687 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e42d685b-83ac-48bb-b4dd-b3ad11395c10 req-3468ef7b-8880-4343-aabc-5bf01e17da78 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:03.127131 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e42d685b-83ac-48bb-b4dd-b3ad11395c10 req-3468ef7b-8880-4343-aabc-5bf01e17da78 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:03.172804 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-e42d685b-83ac-48bb-b4dd-b3ad11395c10 req-3468ef7b-8880-4343-aabc-5bf01e17da78 service nova] Creating event network-vif-plugged:fb64b460-5d71-43ac-9f97-8a017825ab09 for instance f1de1e06-01fa-4eb7-9dc6-be46802187c5 on n-h2-850501-12 Sep 08 10:59:03.195781 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-e42d685b-83ac-48bb-b4dd-b3ad11395c10 req-3468ef7b-8880-4343-aabc-5bf01e17da78 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158672 Sep 08 10:59:03.202964 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2232/4537] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:59:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:59:03.378553 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5397c1de-5e70-4958-acf2-f1d202b22f2f tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:03.379551 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5397c1de-5e70-4958-acf2-f1d202b22f2f tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: 82458f68-8fcf-4d1f-8e7b-87d76f3576ad] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:03.418992 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5397c1de-5e70-4958-acf2-f1d202b22f2f tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:03.429250 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5397c1de-5e70-4958-acf2-f1d202b22f2f tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:03.429814 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5397c1de-5e70-4958-acf2-f1d202b22f2f tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:03.435413 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5397c1de-5e70-4958-acf2-f1d202b22f2f tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:03.435912 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5397c1de-5e70-4958-acf2-f1d202b22f2f tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:03.441390 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5397c1de-5e70-4958-acf2-f1d202b22f2f tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:03.663170 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a6e51eb0-685a-4ff4-bd82-61c4f2c77164 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27627bddc6b144188fc4cc1f9e8b677f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae429b36d3af4e708071ee7be5974025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:03.679631 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a6e51eb0-685a-4ff4-bd82-61c4f2c77164 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27627bddc6b144188fc4cc1f9e8b677f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae429b36d3af4e708071ee7be5974025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:03.683476 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a6e51eb0-685a-4ff4-bd82-61c4f2c77164 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27627bddc6b144188fc4cc1f9e8b677f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae429b36d3af4e708071ee7be5974025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:03.690605 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a6e51eb0-685a-4ff4-bd82-61c4f2c77164 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] 10.222.0.27 "GET /compute/v2.1/servers/05840cb4-7e09-49c5-8d55-a94dbfe241ae" status: 200 len: 1553 microversion: 2.26 time: 1.335087 Sep 08 10:59:03.692471 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2306/4538] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:59:02 2022] GET /compute/v2.1/servers/05840cb4-7e09-49c5-8d55-a94dbfe241ae => generated 1553 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:59:03.957598 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5b576ab9-7d38-46bb-ac93-b044edd9e07c tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:03.959050 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5b576ab9-7d38-46bb-ac93-b044edd9e07c tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] [instance: 7931ea02-ab01-4895-9ff2-265a0f58fe67] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:03.991356 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5b576ab9-7d38-46bb-ac93-b044edd9e07c tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:03.992940 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5b576ab9-7d38-46bb-ac93-b044edd9e07c tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:03.995242 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5b576ab9-7d38-46bb-ac93-b044edd9e07c tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:03.997660 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5b576ab9-7d38-46bb-ac93-b044edd9e07c tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:03.999741 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5b576ab9-7d38-46bb-ac93-b044edd9e07c tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:04.001803 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5b576ab9-7d38-46bb-ac93-b044edd9e07c tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:04.717815 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5b576ab9-7d38-46bb-ac93-b044edd9e07c tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fe29b5496a4169b0588b7b18d75537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a85de2674b413cb72fe0de96eec7cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:04.730391 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5b576ab9-7d38-46bb-ac93-b044edd9e07c tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] 10.222.0.27 "GET /compute/v2.1/servers/7931ea02-ab01-4895-9ff2-265a0f58fe67" status: 200 len: 1322 microversion: 2.1 time: 0.778720 Sep 08 10:59:04.753154 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5397c1de-5e70-4958-acf2-f1d202b22f2f tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:04.758740 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2307/4539] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:03 2022] GET /compute/v2.1/servers/7931ea02-ab01-4895-9ff2-265a0f58fe67 => generated 1322 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:04.763996 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7432c14b-48a8-4bee-b473-0f3f8ea91075 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:04.764755 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7432c14b-48a8-4bee-b473-0f3f8ea91075 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] [instance: 05840cb4-7e09-49c5-8d55-a94dbfe241ae] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:04.769574 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5397c1de-5e70-4958-acf2-f1d202b22f2f tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad" status: 200 len: 1506 microversion: 2.1 time: 1.399086 Sep 08 10:59:04.775434 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2233/4540] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:03 2022] GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad => generated 1506 bytes in 1406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:59:04.795980 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c154c805-1347-42cb-b410-2e12abf577e8 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:04.797193 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c154c805-1347-42cb-b410-2e12abf577e8 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: 82458f68-8fcf-4d1f-8e7b-87d76f3576ad] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:04.805095 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7432c14b-48a8-4bee-b473-0f3f8ea91075 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:04.808543 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7432c14b-48a8-4bee-b473-0f3f8ea91075 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:04.810282 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7432c14b-48a8-4bee-b473-0f3f8ea91075 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:04.812746 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7432c14b-48a8-4bee-b473-0f3f8ea91075 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:04.814187 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7432c14b-48a8-4bee-b473-0f3f8ea91075 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:04.814412 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c154c805-1347-42cb-b410-2e12abf577e8 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:04.817038 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c154c805-1347-42cb-b410-2e12abf577e8 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:04.817912 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c154c805-1347-42cb-b410-2e12abf577e8 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:04.818870 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7432c14b-48a8-4bee-b473-0f3f8ea91075 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:04.821014 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c154c805-1347-42cb-b410-2e12abf577e8 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:04.823680 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c154c805-1347-42cb-b410-2e12abf577e8 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:04.824413 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c154c805-1347-42cb-b410-2e12abf577e8 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:05.515607 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7432c14b-48a8-4bee-b473-0f3f8ea91075 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27627bddc6b144188fc4cc1f9e8b677f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae429b36d3af4e708071ee7be5974025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:05.535007 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7432c14b-48a8-4bee-b473-0f3f8ea91075 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27627bddc6b144188fc4cc1f9e8b677f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae429b36d3af4e708071ee7be5974025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:05.537911 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7432c14b-48a8-4bee-b473-0f3f8ea91075 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27627bddc6b144188fc4cc1f9e8b677f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae429b36d3af4e708071ee7be5974025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:05.539296 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7432c14b-48a8-4bee-b473-0f3f8ea91075 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] 10.222.0.27 "GET /compute/v2.1/servers/05840cb4-7e09-49c5-8d55-a94dbfe241ae" status: 200 len: 1553 microversion: 2.26 time: 0.779506 Sep 08 10:59:05.540140 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2308/4541] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:59:04 2022] GET /compute/v2.1/servers/05840cb4-7e09-49c5-8d55-a94dbfe241ae => generated 1553 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:59:05.545652 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-c96b649a-dce1-491d-a174-eedac1be7e3f req-73879977-30af-480e-9697-8ab376b904c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a167b49e-6d6c-4602-8980-9a42fea46555", "name": "network-vif-plugged", "status": "completed", "tag": "cdf21544-85bd-4eb8-bb0b-d202a941648f"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:59:05.556908 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-c96b649a-dce1-491d-a174-eedac1be7e3f req-73879977-30af-480e-9697-8ab376b904c4 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:05.557860 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-c96b649a-dce1-491d-a174-eedac1be7e3f req-73879977-30af-480e-9697-8ab376b904c4 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:05.558675 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-c96b649a-dce1-491d-a174-eedac1be7e3f req-73879977-30af-480e-9697-8ab376b904c4 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:05.573813 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-c96b649a-dce1-491d-a174-eedac1be7e3f req-73879977-30af-480e-9697-8ab376b904c4 service nova] Creating event network-vif-plugged:cdf21544-85bd-4eb8-bb0b-d202a941648f for instance a167b49e-6d6c-4602-8980-9a42fea46555 on n-h1-850501-12 Sep 08 10:59:05.579660 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-c96b649a-dce1-491d-a174-eedac1be7e3f req-73879977-30af-480e-9697-8ab376b904c4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038254 Sep 08 10:59:05.580948 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2309/4542] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:59:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:59:05.767317 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d9e814df-c0dd-4f8d-887f-8b174ac9e76f tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:05.768632 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d9e814df-c0dd-4f8d-887f-8b174ac9e76f tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] [instance: 7931ea02-ab01-4895-9ff2-265a0f58fe67] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:05.786756 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d9e814df-c0dd-4f8d-887f-8b174ac9e76f tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:05.787332 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d9e814df-c0dd-4f8d-887f-8b174ac9e76f tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:05.788531 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d9e814df-c0dd-4f8d-887f-8b174ac9e76f tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:05.789691 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d9e814df-c0dd-4f8d-887f-8b174ac9e76f tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:05.791696 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d9e814df-c0dd-4f8d-887f-8b174ac9e76f tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:05.792436 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d9e814df-c0dd-4f8d-887f-8b174ac9e76f tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:05.826369 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c154c805-1347-42cb-b410-2e12abf577e8 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:05.839493 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c154c805-1347-42cb-b410-2e12abf577e8 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad" status: 200 len: 1506 microversion: 2.1 time: 1.048926 Sep 08 10:59:05.843500 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2234/4543] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:04 2022] GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad => generated 1506 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:05.871925 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7a23d689-30fb-4f6b-a25c-d9abc6b14f67 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:05.873991 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7a23d689-30fb-4f6b-a25c-d9abc6b14f67 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: 82458f68-8fcf-4d1f-8e7b-87d76f3576ad] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:05.888126 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7a23d689-30fb-4f6b-a25c-d9abc6b14f67 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:05.892041 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7a23d689-30fb-4f6b-a25c-d9abc6b14f67 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:05.892918 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7a23d689-30fb-4f6b-a25c-d9abc6b14f67 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:05.894687 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7a23d689-30fb-4f6b-a25c-d9abc6b14f67 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:05.897817 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7a23d689-30fb-4f6b-a25c-d9abc6b14f67 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:05.898638 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7a23d689-30fb-4f6b-a25c-d9abc6b14f67 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:05.973581 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7a23d689-30fb-4f6b-a25c-d9abc6b14f67 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: 82458f68-8fcf-4d1f-8e7b-87d76f3576ad] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:59:06.220240 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7a23d689-30fb-4f6b-a25c-d9abc6b14f67 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "DELETE /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad" status: 204 len: 0 microversion: 2.1 time: 0.351156 Sep 08 10:59:06.222006 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2235/4544] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:59:05 2022] DELETE /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:59:06.275789 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d9e814df-c0dd-4f8d-887f-8b174ac9e76f tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fe29b5496a4169b0588b7b18d75537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a85de2674b413cb72fe0de96eec7cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:06.295937 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d9e814df-c0dd-4f8d-887f-8b174ac9e76f tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] 10.222.0.27 "GET /compute/v2.1/servers/7931ea02-ab01-4895-9ff2-265a0f58fe67" status: 200 len: 1322 microversion: 2.1 time: 0.533138 Sep 08 10:59:06.306102 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2310/4545] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:05 2022] GET /compute/v2.1/servers/7931ea02-ab01-4895-9ff2-265a0f58fe67 => generated 1322 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:06.452531 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6f3affe1-1dce-4da7-b407-33f304d015e2 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-798619377", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "dc0a3241-15d1-4554-8d50-4b00e666d5ea"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:59:06.537839 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-6f3affe1-1dce-4da7-b407-33f304d015e2 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] validate_networks() for [('dc0a3241-15d1-4554-8d50-4b00e666d5ea', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:59:06.578467 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-189dc845-cf96-43fc-91a6-14bda94e314a tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:06.579829 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-189dc845-cf96-43fc-91a6-14bda94e314a tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] [instance: 05840cb4-7e09-49c5-8d55-a94dbfe241ae] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:06.594246 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-189dc845-cf96-43fc-91a6-14bda94e314a tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:06.596444 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-189dc845-cf96-43fc-91a6-14bda94e314a tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:06.599401 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-189dc845-cf96-43fc-91a6-14bda94e314a tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:06.600279 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-189dc845-cf96-43fc-91a6-14bda94e314a tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:06.600870 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-189dc845-cf96-43fc-91a6-14bda94e314a tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:06.601514 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-189dc845-cf96-43fc-91a6-14bda94e314a tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:07.098265 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-189dc845-cf96-43fc-91a6-14bda94e314a tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27627bddc6b144188fc4cc1f9e8b677f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae429b36d3af4e708071ee7be5974025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:07.117609 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-189dc845-cf96-43fc-91a6-14bda94e314a tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27627bddc6b144188fc4cc1f9e8b677f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae429b36d3af4e708071ee7be5974025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:07.121747 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-189dc845-cf96-43fc-91a6-14bda94e314a tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27627bddc6b144188fc4cc1f9e8b677f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae429b36d3af4e708071ee7be5974025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:07.127367 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-189dc845-cf96-43fc-91a6-14bda94e314a tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] 10.222.0.27 "GET /compute/v2.1/servers/05840cb4-7e09-49c5-8d55-a94dbfe241ae" status: 200 len: 1511 microversion: 2.26 time: 0.555067 Sep 08 10:59:07.129974 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2311/4546] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:59:06 2022] GET /compute/v2.1/servers/05840cb4-7e09-49c5-8d55-a94dbfe241ae => generated 1511 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:59:07.166151 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-4a9ed3d7-6654-483d-8d62-c8e7a7902f60 req-47f98854-2656-4f2f-b7f1-b1afc06129c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05840cb4-7e09-49c5-8d55-a94dbfe241ae", "name": "network-vif-deleted", "tag": "6c596fb9-9619-434d-bf94-2d6385b48bc1"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:59:07.210161 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-4a9ed3d7-6654-483d-8d62-c8e7a7902f60 req-47f98854-2656-4f2f-b7f1-b1afc06129c7 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:07.215410 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-4a9ed3d7-6654-483d-8d62-c8e7a7902f60 req-47f98854-2656-4f2f-b7f1-b1afc06129c7 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:07.216309 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-4a9ed3d7-6654-483d-8d62-c8e7a7902f60 req-47f98854-2656-4f2f-b7f1-b1afc06129c7 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:07.285814 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-4a9ed3d7-6654-483d-8d62-c8e7a7902f60 req-47f98854-2656-4f2f-b7f1-b1afc06129c7 service nova] Creating event network-vif-deleted:6c596fb9-9619-434d-bf94-2d6385b48bc1 for instance 05840cb4-7e09-49c5-8d55-a94dbfe241ae on n-h1-850501-12 Sep 08 10:59:07.306946 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-4a9ed3d7-6654-483d-8d62-c8e7a7902f60 req-47f98854-2656-4f2f-b7f1-b1afc06129c7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159250 Sep 08 10:59:07.307569 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2312/4547] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:59:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:59:07.329915 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-71a1bec2-fac0-4f69-8925-3b73a83591e2 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:07.330839 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-71a1bec2-fac0-4f69-8925-3b73a83591e2 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] [instance: 7931ea02-ab01-4895-9ff2-265a0f58fe67] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:07.343430 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-71a1bec2-fac0-4f69-8925-3b73a83591e2 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:07.344260 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-71a1bec2-fac0-4f69-8925-3b73a83591e2 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:07.344866 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-71a1bec2-fac0-4f69-8925-3b73a83591e2 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:07.345860 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-71a1bec2-fac0-4f69-8925-3b73a83591e2 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:07.346536 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-71a1bec2-fac0-4f69-8925-3b73a83591e2 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:07.347350 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-71a1bec2-fac0-4f69-8925-3b73a83591e2 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:07.746085 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-71a1bec2-fac0-4f69-8925-3b73a83591e2 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fe29b5496a4169b0588b7b18d75537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a85de2674b413cb72fe0de96eec7cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:07.782633 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-71a1bec2-fac0-4f69-8925-3b73a83591e2 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] 10.222.0.27 "GET /compute/v2.1/servers/7931ea02-ab01-4895-9ff2-265a0f58fe67" status: 200 len: 1322 microversion: 2.1 time: 0.458121 Sep 08 10:59:07.791423 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2313/4548] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:07 2022] GET /compute/v2.1/servers/7931ea02-ab01-4895-9ff2-265a0f58fe67 => generated 1322 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:59:07.810760 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-5d05d061-3ff0-42de-ae80-02704cb849f5 req-fac7e00d-29e8-49a5-a9c8-c895d0af5137 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7931ea02-ab01-4895-9ff2-265a0f58fe67", "name": "network-vif-plugged", "status": "completed", "tag": "f0d5f2d9-a160-435c-aee8-9a0ee4f8a71f"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:59:07.850935 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-5d05d061-3ff0-42de-ae80-02704cb849f5 req-fac7e00d-29e8-49a5-a9c8-c895d0af5137 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:07.854712 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-5d05d061-3ff0-42de-ae80-02704cb849f5 req-fac7e00d-29e8-49a5-a9c8-c895d0af5137 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:07.855264 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-5d05d061-3ff0-42de-ae80-02704cb849f5 req-fac7e00d-29e8-49a5-a9c8-c895d0af5137 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:07.891362 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-5d05d061-3ff0-42de-ae80-02704cb849f5 req-fac7e00d-29e8-49a5-a9c8-c895d0af5137 service nova] Creating event network-vif-plugged:f0d5f2d9-a160-435c-aee8-9a0ee4f8a71f for instance 7931ea02-ab01-4895-9ff2-265a0f58fe67 on n-h1-850501-12 Sep 08 10:59:07.918147 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-5d05d061-3ff0-42de-ae80-02704cb849f5 req-fac7e00d-29e8-49a5-a9c8-c895d0af5137 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122247 Sep 08 10:59:07.928828 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2314/4549] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:59:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:59:08.070689 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-6f3affe1-1dce-4da7-b407-33f304d015e2 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:59:08.071262 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-6f3affe1-1dce-4da7-b407-33f304d015e2 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:59:08.071743 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-6f3affe1-1dce-4da7-b407-33f304d015e2 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:59:08.072247 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-6f3affe1-1dce-4da7-b407-33f304d015e2 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:59:08.072907 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-6f3affe1-1dce-4da7-b407-33f304d015e2 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:59:08.095377 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f3affe1-1dce-4da7-b407-33f304d015e2 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:08.098917 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f3affe1-1dce-4da7-b407-33f304d015e2 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:08.099508 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f3affe1-1dce-4da7-b407-33f304d015e2 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:08.106117 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f3affe1-1dce-4da7-b407-33f304d015e2 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:08.106917 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f3affe1-1dce-4da7-b407-33f304d015e2 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:08.107997 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f3affe1-1dce-4da7-b407-33f304d015e2 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:08.159190 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-6f3affe1-1dce-4da7-b407-33f304d015e2 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Getting quotas for project def11bb6a39848a5855a6c8534b5edba. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:59:08.164340 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a6cc95aa-3645-4e18-954c-17fa455072a4 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:08.165750 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a6cc95aa-3645-4e18-954c-17fa455072a4 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] [instance: 05840cb4-7e09-49c5-8d55-a94dbfe241ae] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:08.182182 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-6f3affe1-1dce-4da7-b407-33f304d015e2 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Getting quotas for user 886104e81be14c18a30b75facfcf246e and project def11bb6a39848a5855a6c8534b5edba. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:59:08.191499 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a6cc95aa-3645-4e18-954c-17fa455072a4 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:08.192804 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a6cc95aa-3645-4e18-954c-17fa455072a4 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:08.193960 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a6cc95aa-3645-4e18-954c-17fa455072a4 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:08.196055 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a6cc95aa-3645-4e18-954c-17fa455072a4 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:08.198341 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a6cc95aa-3645-4e18-954c-17fa455072a4 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:08.200141 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a6cc95aa-3645-4e18-954c-17fa455072a4 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:08.231862 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6f3affe1-1dce-4da7-b407-33f304d015e2 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:59:08.234363 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6f3affe1-1dce-4da7-b407-33f304d015e2 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:59:08.335331 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a6cc95aa-3645-4e18-954c-17fa455072a4 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:08.335970 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a6cc95aa-3645-4e18-954c-17fa455072a4 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:08.336690 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a6cc95aa-3645-4e18-954c-17fa455072a4 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:08.340608 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-a6cc95aa-3645-4e18-954c-17fa455072a4 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lazy-loading 'fault' on Instance uuid 05840cb4-7e09-49c5-8d55-a94dbfe241ae {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:59:08.386538 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6f3affe1-1dce-4da7-b407-33f304d015e2 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.955839 Sep 08 10:59:08.399284 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2236/4550] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:59:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1970 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:59:08.423793 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-286b3848-dbef-4229-8f2a-1c38ce3a4eb7 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:08.430803 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-286b3848-dbef-4229-8f2a-1c38ce3a4eb7 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:08.639703 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a6cc95aa-3645-4e18-954c-17fa455072a4 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27627bddc6b144188fc4cc1f9e8b677f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae429b36d3af4e708071ee7be5974025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:08.663176 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a6cc95aa-3645-4e18-954c-17fa455072a4 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27627bddc6b144188fc4cc1f9e8b677f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae429b36d3af4e708071ee7be5974025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:08.664699 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a6cc95aa-3645-4e18-954c-17fa455072a4 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27627bddc6b144188fc4cc1f9e8b677f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae429b36d3af4e708071ee7be5974025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:08.665982 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a6cc95aa-3645-4e18-954c-17fa455072a4 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] 10.222.0.27 "GET /compute/v2.1/servers/05840cb4-7e09-49c5-8d55-a94dbfe241ae" status: 200 len: 1352 microversion: 2.26 time: 0.508470 Sep 08 10:59:08.666545 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2315/4551] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:59:08 2022] GET /compute/v2.1/servers/05840cb4-7e09-49c5-8d55-a94dbfe241ae => generated 1352 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:59:08.792361 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-286b3848-dbef-4229-8f2a-1c38ce3a4eb7 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:08.801201 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-286b3848-dbef-4229-8f2a-1c38ce3a4eb7 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8" status: 200 len: 1217 microversion: 2.1 time: 0.390523 Sep 08 10:59:08.822746 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cf2a1277-043f-492d-89f6-8c04677d451f tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:08.823793 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cf2a1277-043f-492d-89f6-8c04677d451f tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] [instance: 7931ea02-ab01-4895-9ff2-265a0f58fe67] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:08.826466 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2237/4552] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:08 2022] GET /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8 => generated 1217 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:08.849681 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cf2a1277-043f-492d-89f6-8c04677d451f tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:08.851871 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cf2a1277-043f-492d-89f6-8c04677d451f tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:08.852605 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cf2a1277-043f-492d-89f6-8c04677d451f tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:08.857524 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cf2a1277-043f-492d-89f6-8c04677d451f tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:08.858576 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cf2a1277-043f-492d-89f6-8c04677d451f tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:08.859343 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cf2a1277-043f-492d-89f6-8c04677d451f tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:09.699064 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-cf2a1277-043f-492d-89f6-8c04677d451f tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fe29b5496a4169b0588b7b18d75537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a85de2674b413cb72fe0de96eec7cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:09.705405 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-43a4b327-34e3-49d6-b878-8c84ae89b287 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:09.707609 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-43a4b327-34e3-49d6-b878-8c84ae89b287 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] [instance: 05840cb4-7e09-49c5-8d55-a94dbfe241ae] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:09.726131 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-43a4b327-34e3-49d6-b878-8c84ae89b287 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:09.726938 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-43a4b327-34e3-49d6-b878-8c84ae89b287 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:09.727572 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-43a4b327-34e3-49d6-b878-8c84ae89b287 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:09.729872 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-43a4b327-34e3-49d6-b878-8c84ae89b287 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:09.731341 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-43a4b327-34e3-49d6-b878-8c84ae89b287 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:09.733045 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-43a4b327-34e3-49d6-b878-8c84ae89b287 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:09.734339 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cf2a1277-043f-492d-89f6-8c04677d451f tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] 10.222.0.27 "GET /compute/v2.1/servers/7931ea02-ab01-4895-9ff2-265a0f58fe67" status: 200 len: 1322 microversion: 2.1 time: 0.914102 Sep 08 10:59:09.741499 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2316/4553] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:08 2022] GET /compute/v2.1/servers/7931ea02-ab01-4895-9ff2-265a0f58fe67 => generated 1322 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:59:09.802564 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-43a4b327-34e3-49d6-b878-8c84ae89b287 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] HTTP exception thrown: Instance 05840cb4-7e09-49c5-8d55-a94dbfe241ae could not be found. Sep 08 10:59:09.804809 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-43a4b327-34e3-49d6-b878-8c84ae89b287 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Request method failure captured: Sep 08 10:59:09.804809 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/05840cb4-7e09-49c5-8d55-a94dbfe241ae HTTP/1.1 Sep 08 10:59:09.804809 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:59:09.804809 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:59:09.804809 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:59:09.804809 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:59:09.804809 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:59:09.804809 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:59:09.804809 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:59:09.804809 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:59:09.804809 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcrTVDSypzhqOvsr6w-bgITZUmOjeNG5Q-oSidl8TEJhRcgab0YIalE6SftPvsEhZB131VCoYREG5_ZHZdx0uWGUy8pW3sX2lLgnhJ3KV0dGOvHWjDrNs8zLaAqTWgXsTx9-H4rVZRlNhqGj-_AB7bBivgcI3ZtObbIBDeNUYTLAYCs Sep 08 10:59:09.804809 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:59:09.804809 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:59:09.804809 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:59:09.804809 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:59:09.804809 n-d-850501-12 devstack@n-api.service[128862]: X-Openstack-Nova-Api-Version: 2.26 Sep 08 10:59:09.804809 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:59:09.804809 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:59:09.804809 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: ae429b36d3af4e708071ee7be5974025 Sep 08 10:59:09.804809 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServerTagsTestJSON-27775878 Sep 08 10:59:09.804809 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:59:09.804809 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:59:09.804809 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ae429b36d3af4e708071ee7be5974025"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ae429b36d3af4e708071ee7be5974025"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ae429b36d3af4e708071ee7be5974025"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ae429b36d3af4e708071ee7be5974025"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:59:09.804809 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServerTagsTestJSON-27775878 Sep 08 10:59:09.804809 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: ae429b36d3af4e708071ee7be5974025 Sep 08 10:59:09.804809 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServerTagsTestJSON-27775878 Sep 08 10:59:09.804809 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServerTagsTestJSON-27775878-project Sep 08 10:59:09.804809 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:59:09.804809 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:59:09.804809 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 27627bddc6b144188fc4cc1f9e8b677f Sep 08 10:59:09.804809 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServerTagsTestJSON-27775878-project Sep 08 10:59:09.804809 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:59:09.804809 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 05840cb4-7e09-49c5-8d55-a94dbfe241ae could not be found. Sep 08 10:59:09.804809 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '05840cb4-7e09-49c5-8d55-a94dbfe241ae'} Sep 08 10:59:09.804809 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:59:09.804809 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:59:09.804809 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:59:09.804809 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:59:09.804809 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:59:09.804809 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:59:09.804809 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:59:09.804809 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:59:09.804809 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:59:09.804809 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:59:09.804809 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05840cb4-7e09-49c5-8d55-a94dbfe241ae could not be found. Sep 08 10:59:09.804809 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:59:09.804809 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:59:09.804809 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:59:09.804809 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:59:09.804809 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:59:09.804809 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:59:09.804809 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:59:09.804809 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:59:09.804809 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:59:09.804809 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:59:09.804809 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:59:09.804809 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:59:09.804809 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:59:09.804809 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:59:09.804809 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:59:09.804809 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:59:09.804809 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05840cb4-7e09-49c5-8d55-a94dbfe241ae could not be found. Sep 08 10:59:09.804809 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:59:09.804809 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:59:09.804809 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:59:09.810960 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:59:09.810960 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:59:09.810960 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:59:09.810960 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:59:09.810960 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:59:09.810960 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05840cb4-7e09-49c5-8d55-a94dbfe241ae could not be found. Sep 08 10:59:09.810960 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:59:09.814148 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-43a4b327-34e3-49d6-b878-8c84ae89b287 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] Returning 404 to user: Instance 05840cb4-7e09-49c5-8d55-a94dbfe241ae could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:59:09.816126 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-43a4b327-34e3-49d6-b878-8c84ae89b287 tempest-ServerTagsTestJSON-27775878 tempest-ServerTagsTestJSON-27775878-project] 10.222.0.27 "GET /compute/v2.1/servers/05840cb4-7e09-49c5-8d55-a94dbfe241ae" status: 404 len: 111 microversion: 2.26 time: 0.117725 Sep 08 10:59:09.819800 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2238/4554] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:59:09 2022] GET /compute/v2.1/servers/05840cb4-7e09-49c5-8d55-a94dbfe241ae => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:59:09.837518 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f6fc0f09-8a6a-44c8-893a-6c3a4107749d tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:09.840384 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f6fc0f09-8a6a-44c8-893a-6c3a4107749d tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:09.852370 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f6fc0f09-8a6a-44c8-893a-6c3a4107749d tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:09.853704 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f6fc0f09-8a6a-44c8-893a-6c3a4107749d tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:09.854273 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f6fc0f09-8a6a-44c8-893a-6c3a4107749d tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:09.856697 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f6fc0f09-8a6a-44c8-893a-6c3a4107749d tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:09.857677 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f6fc0f09-8a6a-44c8-893a-6c3a4107749d tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:09.858474 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f6fc0f09-8a6a-44c8-893a-6c3a4107749d tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:10.046344 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-0ea2e142-c531-474f-ab48-57bcd940e122 req-a00d23b4-21c3-44a2-b8f4-7c57cc2e3000 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82458f68-8fcf-4d1f-8e7b-87d76f3576ad", "name": "network-vif-deleted", "tag": "a5bc7eaa-9e35-436f-955a-a184196c4b6d"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:59:10.101566 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-0ea2e142-c531-474f-ab48-57bcd940e122 req-a00d23b4-21c3-44a2-b8f4-7c57cc2e3000 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:10.103100 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-0ea2e142-c531-474f-ab48-57bcd940e122 req-a00d23b4-21c3-44a2-b8f4-7c57cc2e3000 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:10.107244 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-0ea2e142-c531-474f-ab48-57bcd940e122 req-a00d23b4-21c3-44a2-b8f4-7c57cc2e3000 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:10.138770 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f6fc0f09-8a6a-44c8-893a-6c3a4107749d tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:10.158014 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-0ea2e142-c531-474f-ab48-57bcd940e122 req-a00d23b4-21c3-44a2-b8f4-7c57cc2e3000 service nova] Creating event network-vif-deleted:a5bc7eaa-9e35-436f-955a-a184196c4b6d for instance 82458f68-8fcf-4d1f-8e7b-87d76f3576ad on n-h2-850501-12 Sep 08 10:59:10.160511 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f6fc0f09-8a6a-44c8-893a-6c3a4107749d tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8" status: 200 len: 1213 microversion: 2.1 time: 0.328032 Sep 08 10:59:10.173908 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-0ea2e142-c531-474f-ab48-57bcd940e122 req-a00d23b4-21c3-44a2-b8f4-7c57cc2e3000 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134551 Sep 08 10:59:10.179532 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2317/4556] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:09 2022] GET /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8 => generated 1213 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:10.179897 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2239/4556] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:59:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:59:10.764867 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c7c8cff0-086b-4c0a-ab9e-9da9d3c52a27 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:10.766325 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c7c8cff0-086b-4c0a-ab9e-9da9d3c52a27 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] [instance: 7931ea02-ab01-4895-9ff2-265a0f58fe67] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:10.796369 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c7c8cff0-086b-4c0a-ab9e-9da9d3c52a27 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:10.803640 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c7c8cff0-086b-4c0a-ab9e-9da9d3c52a27 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:10.805596 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c7c8cff0-086b-4c0a-ab9e-9da9d3c52a27 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:10.807195 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c7c8cff0-086b-4c0a-ab9e-9da9d3c52a27 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:10.812912 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c7c8cff0-086b-4c0a-ab9e-9da9d3c52a27 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:10.814562 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c7c8cff0-086b-4c0a-ab9e-9da9d3c52a27 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:11.192844 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bdf5c532-fb5f-451b-ad51-f8486264e5ee tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:11.196585 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bdf5c532-fb5f-451b-ad51-f8486264e5ee tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:11.222421 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bdf5c532-fb5f-451b-ad51-f8486264e5ee tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:11.224420 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bdf5c532-fb5f-451b-ad51-f8486264e5ee tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:11.227209 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bdf5c532-fb5f-451b-ad51-f8486264e5ee tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:11.228463 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bdf5c532-fb5f-451b-ad51-f8486264e5ee tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:11.230787 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bdf5c532-fb5f-451b-ad51-f8486264e5ee tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:11.232162 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bdf5c532-fb5f-451b-ad51-f8486264e5ee tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:11.430630 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bdf5c532-fb5f-451b-ad51-f8486264e5ee tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:11.445522 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bdf5c532-fb5f-451b-ad51-f8486264e5ee tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8" status: 200 len: 1275 microversion: 2.1 time: 0.258494 Sep 08 10:59:11.465994 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2240/4557] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:11 2022] GET /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8 => generated 1275 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:11.675036 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c7c8cff0-086b-4c0a-ab9e-9da9d3c52a27 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fe29b5496a4169b0588b7b18d75537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a85de2674b413cb72fe0de96eec7cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:11.693310 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c7c8cff0-086b-4c0a-ab9e-9da9d3c52a27 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] 10.222.0.27 "GET /compute/v2.1/servers/7931ea02-ab01-4895-9ff2-265a0f58fe67" status: 200 len: 1515 microversion: 2.1 time: 0.932719 Sep 08 10:59:11.709065 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2318/4558] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:10 2022] GET /compute/v2.1/servers/7931ea02-ab01-4895-9ff2-265a0f58fe67 => generated 1515 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:11.720797 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-feee4c05-0a44-4bc4-95ed-b53b33f817cc tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:11.722472 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-feee4c05-0a44-4bc4-95ed-b53b33f817cc tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] [instance: f1de1e06-01fa-4eb7-9dc6-be46802187c5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:11.729382 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-feee4c05-0a44-4bc4-95ed-b53b33f817cc tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:11.730371 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-feee4c05-0a44-4bc4-95ed-b53b33f817cc tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:11.731049 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-feee4c05-0a44-4bc4-95ed-b53b33f817cc tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:11.732031 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-feee4c05-0a44-4bc4-95ed-b53b33f817cc tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:11.732721 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-feee4c05-0a44-4bc4-95ed-b53b33f817cc tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:11.733403 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-feee4c05-0a44-4bc4-95ed-b53b33f817cc tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:12.082190 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-feee4c05-0a44-4bc4-95ed-b53b33f817cc tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fe29b5496a4169b0588b7b18d75537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a85de2674b413cb72fe0de96eec7cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:12.102352 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-feee4c05-0a44-4bc4-95ed-b53b33f817cc tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] 10.222.0.27 "GET /compute/v2.1/servers/f1de1e06-01fa-4eb7-9dc6-be46802187c5" status: 200 len: 1516 microversion: 2.1 time: 0.385517 Sep 08 10:59:12.105016 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2241/4559] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:11 2022] GET /compute/v2.1/servers/f1de1e06-01fa-4eb7-9dc6-be46802187c5 => generated 1516 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:12.138374 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-886a6af3-6916-465f-b6f6-6196d7408d3f tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:12.144085 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-886a6af3-6916-465f-b6f6-6196d7408d3f tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] [instance: a167b49e-6d6c-4602-8980-9a42fea46555] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:12.155367 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-886a6af3-6916-465f-b6f6-6196d7408d3f tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:12.156153 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-886a6af3-6916-465f-b6f6-6196d7408d3f tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:12.157840 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-886a6af3-6916-465f-b6f6-6196d7408d3f tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:12.159869 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-886a6af3-6916-465f-b6f6-6196d7408d3f tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:12.161287 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-886a6af3-6916-465f-b6f6-6196d7408d3f tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:12.162163 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-886a6af3-6916-465f-b6f6-6196d7408d3f tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:12.483200 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f6864ecf-3388-48f5-aa7b-53ceeba070eb tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:12.483860 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f6864ecf-3388-48f5-aa7b-53ceeba070eb tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:12.495077 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f6864ecf-3388-48f5-aa7b-53ceeba070eb tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:12.496516 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f6864ecf-3388-48f5-aa7b-53ceeba070eb tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:12.506757 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f6864ecf-3388-48f5-aa7b-53ceeba070eb tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:12.507663 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f6864ecf-3388-48f5-aa7b-53ceeba070eb tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:12.508410 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f6864ecf-3388-48f5-aa7b-53ceeba070eb tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:12.508988 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f6864ecf-3388-48f5-aa7b-53ceeba070eb tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:12.521287 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-886a6af3-6916-465f-b6f6-6196d7408d3f tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fe29b5496a4169b0588b7b18d75537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a85de2674b413cb72fe0de96eec7cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:12.537920 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-886a6af3-6916-465f-b6f6-6196d7408d3f tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] 10.222.0.27 "GET /compute/v2.1/servers/a167b49e-6d6c-4602-8980-9a42fea46555" status: 200 len: 1516 microversion: 2.1 time: 0.410329 Sep 08 10:59:12.541168 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2319/4560] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:12 2022] GET /compute/v2.1/servers/a167b49e-6d6c-4602-8980-9a42fea46555 => generated 1516 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:12.574793 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0a941e6a-7fe6-43ce-82e6-5f4ee0fac952 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:12.575351 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0a941e6a-7fe6-43ce-82e6-5f4ee0fac952 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] [instance: a167b49e-6d6c-4602-8980-9a42fea46555] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:12.583023 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0a941e6a-7fe6-43ce-82e6-5f4ee0fac952 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:12.583649 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0a941e6a-7fe6-43ce-82e6-5f4ee0fac952 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:12.584190 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0a941e6a-7fe6-43ce-82e6-5f4ee0fac952 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:12.584913 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0a941e6a-7fe6-43ce-82e6-5f4ee0fac952 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:12.585471 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0a941e6a-7fe6-43ce-82e6-5f4ee0fac952 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:12.585904 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0a941e6a-7fe6-43ce-82e6-5f4ee0fac952 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:12.628595 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0a941e6a-7fe6-43ce-82e6-5f4ee0fac952 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] [instance: a167b49e-6d6c-4602-8980-9a42fea46555] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:59:12.796441 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0a941e6a-7fe6-43ce-82e6-5f4ee0fac952 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a167b49e-6d6c-4602-8980-9a42fea46555" status: 204 len: 0 microversion: 2.1 time: 0.225239 Sep 08 10:59:12.799050 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2320/4561] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:59:12 2022] DELETE /compute/v2.1/servers/a167b49e-6d6c-4602-8980-9a42fea46555 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 10:59:12.810474 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-44eef40f-bebe-4097-8b33-6823983928fa tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:12.811654 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-44eef40f-bebe-4097-8b33-6823983928fa tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] [instance: a167b49e-6d6c-4602-8980-9a42fea46555] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:12.822965 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-44eef40f-bebe-4097-8b33-6823983928fa tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:12.824198 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-44eef40f-bebe-4097-8b33-6823983928fa tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:12.825245 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-44eef40f-bebe-4097-8b33-6823983928fa tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:12.826527 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-44eef40f-bebe-4097-8b33-6823983928fa tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:12.827595 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-44eef40f-bebe-4097-8b33-6823983928fa tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:12.828465 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-44eef40f-bebe-4097-8b33-6823983928fa tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:13.151245 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f6864ecf-3388-48f5-aa7b-53ceeba070eb tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:13.179600 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f6864ecf-3388-48f5-aa7b-53ceeba070eb tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8" status: 200 len: 1275 microversion: 2.1 time: 0.699810 Sep 08 10:59:13.183042 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2242/4562] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:12 2022] GET /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8 => generated 1275 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:59:13.623842 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-44eef40f-bebe-4097-8b33-6823983928fa tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fe29b5496a4169b0588b7b18d75537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a85de2674b413cb72fe0de96eec7cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:13.625959 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:59:13.646776 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-44eef40f-bebe-4097-8b33-6823983928fa tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] 10.222.0.27 "GET /compute/v2.1/servers/a167b49e-6d6c-4602-8980-9a42fea46555" status: 200 len: 1522 microversion: 2.1 time: 0.842477 Sep 08 10:59:13.648176 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2321/4563] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:12 2022] GET /compute/v2.1/servers/a167b49e-6d6c-4602-8980-9a42fea46555 => generated 1522 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:14.212064 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-55484a45-b170-4b7a-a416-09cd26a6a2a0 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:14.216115 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-55484a45-b170-4b7a-a416-09cd26a6a2a0 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:14.240644 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55484a45-b170-4b7a-a416-09cd26a6a2a0 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:14.242054 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55484a45-b170-4b7a-a416-09cd26a6a2a0 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:14.243244 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55484a45-b170-4b7a-a416-09cd26a6a2a0 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:14.247529 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55484a45-b170-4b7a-a416-09cd26a6a2a0 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:14.253971 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55484a45-b170-4b7a-a416-09cd26a6a2a0 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:14.255265 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55484a45-b170-4b7a-a416-09cd26a6a2a0 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:14.673548 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e06f5faa-1f25-4e46-9ece-bba0ddaf5575 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:14.675668 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e06f5faa-1f25-4e46-9ece-bba0ddaf5575 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] [instance: a167b49e-6d6c-4602-8980-9a42fea46555] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:14.690546 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e06f5faa-1f25-4e46-9ece-bba0ddaf5575 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:14.694217 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e06f5faa-1f25-4e46-9ece-bba0ddaf5575 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:14.694923 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e06f5faa-1f25-4e46-9ece-bba0ddaf5575 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:14.696171 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e06f5faa-1f25-4e46-9ece-bba0ddaf5575 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:14.699039 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e06f5faa-1f25-4e46-9ece-bba0ddaf5575 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:14.699925 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e06f5faa-1f25-4e46-9ece-bba0ddaf5575 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:14.792218 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-55484a45-b170-4b7a-a416-09cd26a6a2a0 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:14.802377 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-55484a45-b170-4b7a-a416-09cd26a6a2a0 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8" status: 200 len: 1317 microversion: 2.1 time: 0.599624 Sep 08 10:59:14.808426 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2243/4564] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:14 2022] GET /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8 => generated 1317 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:15.682729 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e06f5faa-1f25-4e46-9ece-bba0ddaf5575 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fe29b5496a4169b0588b7b18d75537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a85de2674b413cb72fe0de96eec7cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:15.696035 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e06f5faa-1f25-4e46-9ece-bba0ddaf5575 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] 10.222.0.27 "GET /compute/v2.1/servers/a167b49e-6d6c-4602-8980-9a42fea46555" status: 200 len: 1522 microversion: 2.1 time: 1.027260 Sep 08 10:59:15.710246 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2322/4565] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:14 2022] GET /compute/v2.1/servers/a167b49e-6d6c-4602-8980-9a42fea46555 => generated 1522 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:15.838263 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-88f283e6-6597-4b34-9464-bdb5ee1f0b5d tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:15.841088 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-88f283e6-6597-4b34-9464-bdb5ee1f0b5d tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:15.862013 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-88f283e6-6597-4b34-9464-bdb5ee1f0b5d tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:15.863317 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-88f283e6-6597-4b34-9464-bdb5ee1f0b5d tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:15.866404 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-88f283e6-6597-4b34-9464-bdb5ee1f0b5d tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:15.870086 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-88f283e6-6597-4b34-9464-bdb5ee1f0b5d tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:15.870578 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-88f283e6-6597-4b34-9464-bdb5ee1f0b5d tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:15.871046 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-88f283e6-6597-4b34-9464-bdb5ee1f0b5d tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:16.249442 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-88f283e6-6597-4b34-9464-bdb5ee1f0b5d tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:16.273383 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-88f283e6-6597-4b34-9464-bdb5ee1f0b5d tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8" status: 200 len: 1317 microversion: 2.1 time: 0.443393 Sep 08 10:59:16.280547 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2244/4566] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:15 2022] GET /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8 => generated 1317 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:16.427473 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-99d1787c-06b5-4733-8486-c0509353eac4 req-fe2f58dd-9111-4cf0-9c6f-718805cbc012 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a167b49e-6d6c-4602-8980-9a42fea46555", "name": "network-vif-deleted", "tag": "cdf21544-85bd-4eb8-bb0b-d202a941648f"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:59:16.487583 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-99d1787c-06b5-4733-8486-c0509353eac4 req-fe2f58dd-9111-4cf0-9c6f-718805cbc012 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:16.489230 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-99d1787c-06b5-4733-8486-c0509353eac4 req-fe2f58dd-9111-4cf0-9c6f-718805cbc012 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:16.491550 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-99d1787c-06b5-4733-8486-c0509353eac4 req-fe2f58dd-9111-4cf0-9c6f-718805cbc012 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:16.532697 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-99d1787c-06b5-4733-8486-c0509353eac4 req-fe2f58dd-9111-4cf0-9c6f-718805cbc012 service nova] Creating event network-vif-deleted:cdf21544-85bd-4eb8-bb0b-d202a941648f for instance a167b49e-6d6c-4602-8980-9a42fea46555 on n-h1-850501-12 Sep 08 10:59:16.547686 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-99d1787c-06b5-4733-8486-c0509353eac4 req-fe2f58dd-9111-4cf0-9c6f-718805cbc012 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137422 Sep 08 10:59:16.551229 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2323/4567] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:59:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:59:16.727080 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b023af94-9cf2-4140-9656-da745a110d84 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:16.727926 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b023af94-9cf2-4140-9656-da745a110d84 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] [instance: a167b49e-6d6c-4602-8980-9a42fea46555] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:16.772316 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b023af94-9cf2-4140-9656-da745a110d84 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:16.777558 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b023af94-9cf2-4140-9656-da745a110d84 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:16.780478 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b023af94-9cf2-4140-9656-da745a110d84 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:16.781956 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b023af94-9cf2-4140-9656-da745a110d84 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:16.782599 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b023af94-9cf2-4140-9656-da745a110d84 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:16.788742 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b023af94-9cf2-4140-9656-da745a110d84 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:16.911983 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b023af94-9cf2-4140-9656-da745a110d84 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:16.915383 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b023af94-9cf2-4140-9656-da745a110d84 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:16.916106 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b023af94-9cf2-4140-9656-da745a110d84 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:16.917686 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-b023af94-9cf2-4140-9656-da745a110d84 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lazy-loading 'fault' on Instance uuid a167b49e-6d6c-4602-8980-9a42fea46555 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:59:17.229762 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b023af94-9cf2-4140-9656-da745a110d84 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fe29b5496a4169b0588b7b18d75537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a85de2674b413cb72fe0de96eec7cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:17.242411 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b023af94-9cf2-4140-9656-da745a110d84 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] 10.222.0.27 "GET /compute/v2.1/servers/a167b49e-6d6c-4602-8980-9a42fea46555" status: 200 len: 1312 microversion: 2.1 time: 0.522158 Sep 08 10:59:17.246424 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2245/4568] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:16 2022] GET /compute/v2.1/servers/a167b49e-6d6c-4602-8980-9a42fea46555 => generated 1312 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:17.308908 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-74e499c5-afbe-4cd1-857b-65360943e540 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:17.310403 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-74e499c5-afbe-4cd1-857b-65360943e540 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:17.342572 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-74e499c5-afbe-4cd1-857b-65360943e540 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:17.349267 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-74e499c5-afbe-4cd1-857b-65360943e540 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:17.351507 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-74e499c5-afbe-4cd1-857b-65360943e540 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:17.365068 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-74e499c5-afbe-4cd1-857b-65360943e540 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:17.371163 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-74e499c5-afbe-4cd1-857b-65360943e540 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:17.383797 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-74e499c5-afbe-4cd1-857b-65360943e540 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:17.934000 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-74e499c5-afbe-4cd1-857b-65360943e540 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:17.972351 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-74e499c5-afbe-4cd1-857b-65360943e540 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8" status: 200 len: 1317 microversion: 2.1 time: 0.668363 Sep 08 10:59:17.973950 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2324/4569] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:17 2022] GET /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8 => generated 1317 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:18.271964 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-10bc53e4-6849-4e8e-92f9-339a5d5f5edb tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:18.274461 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-10bc53e4-6849-4e8e-92f9-339a5d5f5edb tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] [instance: a167b49e-6d6c-4602-8980-9a42fea46555] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:18.287971 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:59:18.302923 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10bc53e4-6849-4e8e-92f9-339a5d5f5edb tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:18.304548 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10bc53e4-6849-4e8e-92f9-339a5d5f5edb tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:18.305208 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10bc53e4-6849-4e8e-92f9-339a5d5f5edb tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:18.307701 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10bc53e4-6849-4e8e-92f9-339a5d5f5edb tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:18.310349 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10bc53e4-6849-4e8e-92f9-339a5d5f5edb tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:18.311014 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10bc53e4-6849-4e8e-92f9-339a5d5f5edb tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:18.314810 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:DELETE=1,nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:59:18.376328 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-10bc53e4-6849-4e8e-92f9-339a5d5f5edb tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] HTTP exception thrown: Instance a167b49e-6d6c-4602-8980-9a42fea46555 could not be found. Sep 08 10:59:18.380993 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-10bc53e4-6849-4e8e-92f9-339a5d5f5edb tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Request method failure captured: Sep 08 10:59:18.380993 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/a167b49e-6d6c-4602-8980-9a42fea46555 HTTP/1.1 Sep 08 10:59:18.380993 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:59:18.380993 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:59:18.380993 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:59:18.380993 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:59:18.380993 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:59:18.380993 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:59:18.380993 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:59:18.380993 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:59:18.380993 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcrcVdMg9S7tZRTqL7bDdz9i1kj7VzWegdw8mSVFrv6G-CHHrkYUBxSWD-HRsUQpmpJ5CBV8licgrL486WPziGCUCcTFTucXmQdp9NGa_v88TBSJiqO3rGqDud8GM2bIUxMXr4Tu4wNWlNJFERSNqdiz3LE8GSD3HNbvxbZ23g1e9M0 Sep 08 10:59:18.380993 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:59:18.380993 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:59:18.380993 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:59:18.380993 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:59:18.380993 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:59:18.380993 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:59:18.380993 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: c8a85de2674b413cb72fe0de96eec7cc Sep 08 10:59:18.380993 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ListServersNegativeTestJSON-2023907786 Sep 08 10:59:18.380993 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:59:18.380993 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:59:18.380993 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c8a85de2674b413cb72fe0de96eec7cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c8a85de2674b413cb72fe0de96eec7cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c8a85de2674b413cb72fe0de96eec7cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c8a85de2674b413cb72fe0de96eec7cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:59:18.380993 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ListServersNegativeTestJSON-2023907786 Sep 08 10:59:18.380993 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: c8a85de2674b413cb72fe0de96eec7cc Sep 08 10:59:18.380993 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-2023907786 Sep 08 10:59:18.380993 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ListServersNegativeTestJSON-2023907786-project Sep 08 10:59:18.380993 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:59:18.380993 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:59:18.380993 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: e1fe29b5496a4169b0588b7b18d75537 Sep 08 10:59:18.380993 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ListServersNegativeTestJSON-2023907786-project Sep 08 10:59:18.380993 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:59:18.380993 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance a167b49e-6d6c-4602-8980-9a42fea46555 could not be found. Sep 08 10:59:18.380993 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'a167b49e-6d6c-4602-8980-9a42fea46555'} Sep 08 10:59:18.380993 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:59:18.380993 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:59:18.380993 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:59:18.380993 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:59:18.380993 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:59:18.380993 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:59:18.380993 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:59:18.380993 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:59:18.380993 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:59:18.380993 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:59:18.380993 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a167b49e-6d6c-4602-8980-9a42fea46555 could not be found. Sep 08 10:59:18.380993 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:59:18.380993 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:59:18.380993 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:59:18.380993 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:59:18.380993 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:59:18.380993 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:59:18.380993 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:59:18.380993 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:59:18.380993 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:59:18.380993 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:59:18.380993 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:59:18.380993 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:59:18.380993 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:59:18.380993 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:59:18.380993 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:59:18.380993 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:59:18.380993 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a167b49e-6d6c-4602-8980-9a42fea46555 could not be found. Sep 08 10:59:18.380993 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:59:18.380993 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:59:18.386136 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:59:18.386136 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:59:18.386136 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:59:18.386136 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:59:18.386136 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:59:18.386136 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:59:18.386136 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a167b49e-6d6c-4602-8980-9a42fea46555 could not be found. Sep 08 10:59:18.386136 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:59:18.386136 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-10bc53e4-6849-4e8e-92f9-339a5d5f5edb tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Returning 404 to user: Instance a167b49e-6d6c-4602-8980-9a42fea46555 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:59:18.386136 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-10bc53e4-6849-4e8e-92f9-339a5d5f5edb tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] 10.222.0.27 "GET /compute/v2.1/servers/a167b49e-6d6c-4602-8980-9a42fea46555" status: 404 len: 111 microversion: 2.1 time: 0.116279 Sep 08 10:59:18.405116 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a56a6176-9096-4fb5-9777-d0148a299399 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:18.405748 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2246/4570] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:18 2022] GET /compute/v2.1/servers/a167b49e-6d6c-4602-8980-9a42fea46555 => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:59:18.416356 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a56a6176-9096-4fb5-9777-d0148a299399 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e1fe29b5496a4169b0588b7b18d75537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a85de2674b413cb72fe0de96eec7cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:18.417731 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a56a6176-9096-4fb5-9777-d0148a299399 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': 'c8a85de2674b413cb72fe0de96eec7cc'} {{(pid=128861) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:59:18.427518 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a56a6176-9096-4fb5-9777-d0148a299399 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:18.428328 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a56a6176-9096-4fb5-9777-d0148a299399 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:18.436048 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a56a6176-9096-4fb5-9777-d0148a299399 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:18.437821 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a56a6176-9096-4fb5-9777-d0148a299399 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:18.438699 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a56a6176-9096-4fb5-9777-d0148a299399 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:18.439821 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a56a6176-9096-4fb5-9777-d0148a299399 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:18.604148 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-d5204c73-db9c-433c-9a92-5077ecc3188d req-7823b4b5-cee7-4450-9039-ec55f2d50289 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8", "tag": "5f04b415-8433-4439-80f4-4d2e2907654b"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:59:18.685076 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d5204c73-db9c-433c-9a92-5077ecc3188d req-7823b4b5-cee7-4450-9039-ec55f2d50289 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:18.687945 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d5204c73-db9c-433c-9a92-5077ecc3188d req-7823b4b5-cee7-4450-9039-ec55f2d50289 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:18.689635 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d5204c73-db9c-433c-9a92-5077ecc3188d req-7823b4b5-cee7-4450-9039-ec55f2d50289 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:18.764056 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-d5204c73-db9c-433c-9a92-5077ecc3188d req-7823b4b5-cee7-4450-9039-ec55f2d50289 service nova] Creating event network-changed:5f04b415-8433-4439-80f4-4d2e2907654b for instance f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8 on n-h2-850501-12 Sep 08 10:59:18.788227 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-d5204c73-db9c-433c-9a92-5077ecc3188d req-7823b4b5-cee7-4450-9039-ec55f2d50289 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.193116 Sep 08 10:59:18.791865 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2247/4571] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:59:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:59:18.901151 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a56a6176-9096-4fb5-9777-d0148a299399 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] 10.222.0.27 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.496180 Sep 08 10:59:18.901151 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2325/4572] 10.222.0.27 () {58 vars in 1230 bytes} [Thu Sep 8 10:59:18 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:59:18.931627 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-deabddbb-c7fd-4258-a964-9108b7f65752 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:18.945762 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-deabddbb-c7fd-4258-a964-9108b7f65752 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Request method failure captured: Sep 08 10:59:18.945762 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Sep 08 10:59:18.945762 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:59:18.945762 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:59:18.945762 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:59:18.945762 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:59:18.945762 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:59:18.945762 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:59:18.945762 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:59:18.945762 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:59:18.945762 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcrcVdMg9S7tZRTqL7bDdz9i1kj7VzWegdw8mSVFrv6G-CHHrkYUBxSWD-HRsUQpmpJ5CBV8licgrL486WPziGCUCcTFTucXmQdp9NGa_v88TBSJiqO3rGqDud8GM2bIUxMXr4Tu4wNWlNJFERSNqdiz3LE8GSD3HNbvxbZ23g1e9M0 Sep 08 10:59:18.945762 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:59:18.945762 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:59:18.945762 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:59:18.945762 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:59:18.945762 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:59:18.945762 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:59:18.945762 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: c8a85de2674b413cb72fe0de96eec7cc Sep 08 10:59:18.945762 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ListServersNegativeTestJSON-2023907786 Sep 08 10:59:18.945762 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:59:18.945762 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:59:18.945762 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c8a85de2674b413cb72fe0de96eec7cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c8a85de2674b413cb72fe0de96eec7cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c8a85de2674b413cb72fe0de96eec7cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c8a85de2674b413cb72fe0de96eec7cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:59:18.945762 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ListServersNegativeTestJSON-2023907786 Sep 08 10:59:18.945762 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: c8a85de2674b413cb72fe0de96eec7cc Sep 08 10:59:18.945762 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-2023907786 Sep 08 10:59:18.945762 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ListServersNegativeTestJSON-2023907786-project Sep 08 10:59:18.945762 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:59:18.945762 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:59:18.945762 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: e1fe29b5496a4169b0588b7b18d75537 Sep 08 10:59:18.945762 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ListServersNegativeTestJSON-2023907786-project Sep 08 10:59:18.945762 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:59:18.945762 n-d-850501-12 devstack@n-api.service[128862]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Sep 08 10:59:18.945762 n-d-850501-12 devstack@n-api.service[128862]: action_args: {} Sep 08 10:59:18.945762 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:59:18.945762 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:59:18.945762 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 10:59:18.945762 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 10:59:18.945762 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 10:59:18.945762 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise error Sep 08 10:59:18.945762 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Sep 08 10:59:18.945762 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:59:18.945762 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Sep 08 10:59:18.945762 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Sep 08 10:59:18.945762 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:59:18.945762 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi On instance[0]: Sep 08 10:59:18.945762 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi '2011/01/01' Sep 08 10:59:18.945762 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:59:18.945762 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:59:18.945762 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:59:18.945762 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:59:18.945762 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:59:18.945762 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:59:18.945762 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:59:18.945762 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:59:18.945762 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:59:18.945762 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:59:18.945762 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 08 10:59:18.945762 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:59:18.945762 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 08 10:59:18.945762 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:59:18.945762 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 08 10:59:18.945762 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:59:18.945762 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 08 10:59:18.945762 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Sep 08 10:59:18.945762 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Sep 08 10:59:18.945762 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 10:59:18.950796 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 10:59:18.950796 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 10:59:18.950796 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 10:59:18.950796 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Sep 08 10:59:18.950796 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:59:18.950796 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:59:18.950796 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:59:18.950796 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:59:18.950796 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:59:18.950796 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:59:18.950796 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 10:59:18.950796 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 10:59:18.950796 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Sep 08 10:59:18.950796 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:59:18.950796 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-deabddbb-c7fd-4258-a964-9108b7f65752 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:59:18.950796 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-deabddbb-c7fd-4258-a964-9108b7f65752 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] 10.222.0.27 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.038564 Sep 08 10:59:18.950796 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2248/4573] 10.222.0.27 () {58 vars in 1182 bytes} [Thu Sep 8 10:59:18 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:59:18.965188 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cfc0d37a-643a-4603-8273-512562b00980 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:18.974377 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-cfc0d37a-643a-4603-8273-512562b00980 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e1fe29b5496a4169b0588b7b18d75537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a85de2674b413cb72fe0de96eec7cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:18.981419 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cfc0d37a-643a-4603-8273-512562b00980 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Searching by: {'deleted': False, 'project_id': 'c8a85de2674b413cb72fe0de96eec7cc'} {{(pid=128861) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:59:18.996639 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=8 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:59:19.004923 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-09a58ada-cc0b-4152-9a82-4cd06bb06b5d tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:19.006222 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-09a58ada-cc0b-4152-9a82-4cd06bb06b5d tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:19.014334 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-09a58ada-cc0b-4152-9a82-4cd06bb06b5d tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:19.016097 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-09a58ada-cc0b-4152-9a82-4cd06bb06b5d tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:19.017592 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-09a58ada-cc0b-4152-9a82-4cd06bb06b5d tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:19.019090 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-09a58ada-cc0b-4152-9a82-4cd06bb06b5d tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:19.019951 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-09a58ada-cc0b-4152-9a82-4cd06bb06b5d tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:19.020689 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-09a58ada-cc0b-4152-9a82-4cd06bb06b5d tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:19.035168 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cfc0d37a-643a-4603-8273-512562b00980 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:19.035699 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cfc0d37a-643a-4603-8273-512562b00980 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:19.036278 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cfc0d37a-643a-4603-8273-512562b00980 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:19.037191 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cfc0d37a-643a-4603-8273-512562b00980 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:19.037839 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cfc0d37a-643a-4603-8273-512562b00980 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:19.038461 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cfc0d37a-643a-4603-8273-512562b00980 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:19.100028 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.multi_cell_list [None req-cfc0d37a-643a-4603-8273-512562b00980 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128861) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 10:59:19.154721 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cfc0d37a-643a-4603-8273-512562b00980 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.199341 Sep 08 10:59:19.157757 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2326/4574] 10.222.0.27 () {58 vars in 1125 bytes} [Thu Sep 8 10:59:18 2022] GET /compute/v2.1/servers => generated 681 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:59:19.172463 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-30f6e38f-f6b7-4700-8bf6-8a0128f0f8ac tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:19.184912 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-30f6e38f-f6b7-4700-8bf6-8a0128f0f8ac tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e1fe29b5496a4169b0588b7b18d75537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a85de2674b413cb72fe0de96eec7cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:19.185667 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.compute.servers [None req-30f6e38f-f6b7-4700-8bf6-8a0128f0f8ac tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Removing options 'limit' from query {{(pid=128861) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 08 10:59:19.186515 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-30f6e38f-f6b7-4700-8bf6-8a0128f0f8ac tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Searching by: {'deleted': False, 'project_id': 'c8a85de2674b413cb72fe0de96eec7cc'} {{(pid=128861) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:59:19.201546 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-30f6e38f-f6b7-4700-8bf6-8a0128f0f8ac tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:19.204273 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-30f6e38f-f6b7-4700-8bf6-8a0128f0f8ac tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:19.204998 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-30f6e38f-f6b7-4700-8bf6-8a0128f0f8ac tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:19.206628 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-30f6e38f-f6b7-4700-8bf6-8a0128f0f8ac tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:19.209130 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-30f6e38f-f6b7-4700-8bf6-8a0128f0f8ac tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:19.209786 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-30f6e38f-f6b7-4700-8bf6-8a0128f0f8ac tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:19.274890 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.multi_cell_list [None req-30f6e38f-f6b7-4700-8bf6-8a0128f0f8ac tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=128861) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 10:59:19.309968 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-30f6e38f-f6b7-4700-8bf6-8a0128f0f8ac tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] 10.222.0.27 "GET /compute/v2.1/servers?limit=102" status: 200 len: 681 microversion: 2.1 time: 0.145425 Sep 08 10:59:19.320386 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2327/4575] 10.222.0.27 () {58 vars in 1144 bytes} [Thu Sep 8 10:59:19 2022] GET /compute/v2.1/servers?limit=102 => generated 681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:59:19.326609 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cf3034a3-da7b-4303-911f-e60988726dcd tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:19.331455 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-09a58ada-cc0b-4152-9a82-4cd06bb06b5d tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:19.333214 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cf3034a3-da7b-4303-911f-e60988726dcd tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Request method failure captured: Sep 08 10:59:19.333214 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Sep 08 10:59:19.333214 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:59:19.333214 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:59:19.333214 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:59:19.333214 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:59:19.333214 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:59:19.333214 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:59:19.333214 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:59:19.333214 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:59:19.333214 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcrcVdMg9S7tZRTqL7bDdz9i1kj7VzWegdw8mSVFrv6G-CHHrkYUBxSWD-HRsUQpmpJ5CBV8licgrL486WPziGCUCcTFTucXmQdp9NGa_v88TBSJiqO3rGqDud8GM2bIUxMXr4Tu4wNWlNJFERSNqdiz3LE8GSD3HNbvxbZ23g1e9M0 Sep 08 10:59:19.333214 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:59:19.333214 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:59:19.333214 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:59:19.333214 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:59:19.333214 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:59:19.333214 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:59:19.333214 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: c8a85de2674b413cb72fe0de96eec7cc Sep 08 10:59:19.333214 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ListServersNegativeTestJSON-2023907786 Sep 08 10:59:19.333214 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:59:19.333214 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:59:19.333214 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c8a85de2674b413cb72fe0de96eec7cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c8a85de2674b413cb72fe0de96eec7cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c8a85de2674b413cb72fe0de96eec7cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c8a85de2674b413cb72fe0de96eec7cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:59:19.333214 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ListServersNegativeTestJSON-2023907786 Sep 08 10:59:19.333214 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: c8a85de2674b413cb72fe0de96eec7cc Sep 08 10:59:19.333214 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-2023907786 Sep 08 10:59:19.333214 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ListServersNegativeTestJSON-2023907786-project Sep 08 10:59:19.333214 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:59:19.333214 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:59:19.333214 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: e1fe29b5496a4169b0588b7b18d75537 Sep 08 10:59:19.333214 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ListServersNegativeTestJSON-2023907786-project Sep 08 10:59:19.333214 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:59:19.333214 n-d-850501-12 devstack@n-api.service[128861]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Sep 08 10:59:19.333214 n-d-850501-12 devstack@n-api.service[128861]: action_args: {} Sep 08 10:59:19.333214 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:59:19.333214 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:59:19.333214 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 10:59:19.333214 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 10:59:19.333214 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 10:59:19.333214 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise error Sep 08 10:59:19.333214 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Sep 08 10:59:19.333214 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:59:19.333214 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Sep 08 10:59:19.333214 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 08 10:59:19.333214 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi 'minimum': 0, Sep 08 10:59:19.333214 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 08 10:59:19.333214 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 08 10:59:19.333214 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:59:19.333214 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi On instance[0]: Sep 08 10:59:19.333214 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi '-1' Sep 08 10:59:19.333214 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:59:19.333214 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:59:19.333214 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:59:19.333214 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:59:19.333214 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:59:19.333214 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:59:19.333214 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:59:19.333214 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:59:19.333214 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:59:19.333214 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:59:19.333214 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 08 10:59:19.333214 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:59:19.333214 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 08 10:59:19.333214 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:59:19.333214 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 08 10:59:19.333214 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:59:19.333214 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 08 10:59:19.333214 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Sep 08 10:59:19.333214 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Sep 08 10:59:19.339310 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 10:59:19.339310 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 10:59:19.339310 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 10:59:19.339310 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 10:59:19.339310 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Sep 08 10:59:19.339310 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:59:19.339310 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:59:19.339310 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:59:19.339310 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:59:19.339310 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:59:19.339310 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:59:19.339310 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 10:59:19.339310 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 10:59:19.339310 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Sep 08 10:59:19.339310 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:59:19.342438 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cf3034a3-da7b-4303-911f-e60988726dcd tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:59:19.343562 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cf3034a3-da7b-4303-911f-e60988726dcd tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] 10.222.0.27 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.021251 Sep 08 10:59:19.344358 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2328/4576] 10.222.0.27 () {58 vars in 1142 bytes} [Thu Sep 8 10:59:19 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:59:19.352353 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-09a58ada-cc0b-4152-9a82-4cd06bb06b5d tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8" status: 200 len: 1317 microversion: 2.1 time: 0.354715 Sep 08 10:59:19.353111 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2249/4577] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:18 2022] GET /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8 => generated 1317 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:59:19.361448 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c17189ff-46bb-4ee8-b293-293ea5a2c9b9 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:19.371007 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c17189ff-46bb-4ee8-b293-293ea5a2c9b9 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Request method failure captured: Sep 08 10:59:19.371007 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Sep 08 10:59:19.371007 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:59:19.371007 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:59:19.371007 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:59:19.371007 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:59:19.371007 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:59:19.371007 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:59:19.371007 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:59:19.371007 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:59:19.371007 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcrcVdMg9S7tZRTqL7bDdz9i1kj7VzWegdw8mSVFrv6G-CHHrkYUBxSWD-HRsUQpmpJ5CBV8licgrL486WPziGCUCcTFTucXmQdp9NGa_v88TBSJiqO3rGqDud8GM2bIUxMXr4Tu4wNWlNJFERSNqdiz3LE8GSD3HNbvxbZ23g1e9M0 Sep 08 10:59:19.371007 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:59:19.371007 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:59:19.371007 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:59:19.371007 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:59:19.371007 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:59:19.371007 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:59:19.371007 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: c8a85de2674b413cb72fe0de96eec7cc Sep 08 10:59:19.371007 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ListServersNegativeTestJSON-2023907786 Sep 08 10:59:19.371007 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:59:19.371007 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:59:19.371007 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c8a85de2674b413cb72fe0de96eec7cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c8a85de2674b413cb72fe0de96eec7cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c8a85de2674b413cb72fe0de96eec7cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c8a85de2674b413cb72fe0de96eec7cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:59:19.371007 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ListServersNegativeTestJSON-2023907786 Sep 08 10:59:19.371007 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: c8a85de2674b413cb72fe0de96eec7cc Sep 08 10:59:19.371007 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-2023907786 Sep 08 10:59:19.371007 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ListServersNegativeTestJSON-2023907786-project Sep 08 10:59:19.371007 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:59:19.371007 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:59:19.371007 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: e1fe29b5496a4169b0588b7b18d75537 Sep 08 10:59:19.371007 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ListServersNegativeTestJSON-2023907786-project Sep 08 10:59:19.371007 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:59:19.371007 n-d-850501-12 devstack@n-api.service[128861]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Sep 08 10:59:19.371007 n-d-850501-12 devstack@n-api.service[128861]: action_args: {} Sep 08 10:59:19.371007 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:59:19.371007 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:59:19.371007 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 10:59:19.371007 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 10:59:19.371007 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 10:59:19.371007 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise error Sep 08 10:59:19.371007 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Sep 08 10:59:19.371007 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:59:19.371007 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Sep 08 10:59:19.371007 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 08 10:59:19.371007 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi 'minimum': 0, Sep 08 10:59:19.371007 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 08 10:59:19.371007 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 08 10:59:19.371007 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:59:19.371007 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi On instance[0]: Sep 08 10:59:19.371007 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi 'testing' Sep 08 10:59:19.371007 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:59:19.371007 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:59:19.371007 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:59:19.371007 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:59:19.371007 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:59:19.371007 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:59:19.371007 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:59:19.371007 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:59:19.371007 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:59:19.371007 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:59:19.371007 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 08 10:59:19.371007 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:59:19.371007 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 08 10:59:19.371007 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:59:19.371007 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 08 10:59:19.371007 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:59:19.371007 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 08 10:59:19.371007 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Sep 08 10:59:19.371007 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Sep 08 10:59:19.380372 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 10:59:19.380372 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 10:59:19.380372 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 10:59:19.380372 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 10:59:19.380372 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Sep 08 10:59:19.380372 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:59:19.380372 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:59:19.380372 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:59:19.380372 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:59:19.380372 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:59:19.380372 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:59:19.380372 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 10:59:19.380372 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 10:59:19.380372 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Sep 08 10:59:19.380372 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:59:19.387724 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c17189ff-46bb-4ee8-b293-293ea5a2c9b9 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:59:19.404980 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c17189ff-46bb-4ee8-b293-293ea5a2c9b9 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] 10.222.0.27 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.045371 Sep 08 10:59:19.417861 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2329/4578] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Sep 8 10:59:19 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 67 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:59:19.432154 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a9026b47-80a5-4277-83a0-d329e1f9e308 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:19.442778 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a9026b47-80a5-4277-83a0-d329e1f9e308 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e1fe29b5496a4169b0588b7b18d75537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a85de2674b413cb72fe0de96eec7cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:19.445573 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a9026b47-80a5-4277-83a0-d329e1f9e308 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': 'c8a85de2674b413cb72fe0de96eec7cc'} {{(pid=128862) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:59:19.462496 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.compute.servers [None req-a9026b47-80a5-4277-83a0-d329e1f9e308 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Flavor 'non_existing_flavor' could not be found {{(pid=128862) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Sep 08 10:59:19.464018 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a9026b47-80a5-4277-83a0-d329e1f9e308 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] 10.222.0.27 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.037344 Sep 08 10:59:19.464601 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2250/4579] 10.222.0.27 () {58 vars in 1178 bytes} [Thu Sep 8 10:59:19 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 08 10:59:19.501833 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-81ff624e-9502-441b-8c8c-fd7111a84bac tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:19.514804 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-81ff624e-9502-441b-8c8c-fd7111a84bac tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e1fe29b5496a4169b0588b7b18d75537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a85de2674b413cb72fe0de96eec7cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:19.516311 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-81ff624e-9502-441b-8c8c-fd7111a84bac tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': 'c8a85de2674b413cb72fe0de96eec7cc'} {{(pid=128861) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:59:19.531624 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-81ff624e-9502-441b-8c8c-fd7111a84bac tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:19.532869 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-81ff624e-9502-441b-8c8c-fd7111a84bac tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:19.533575 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-81ff624e-9502-441b-8c8c-fd7111a84bac tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:19.535130 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-81ff624e-9502-441b-8c8c-fd7111a84bac tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:19.535854 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-81ff624e-9502-441b-8c8c-fd7111a84bac tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:19.536533 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-81ff624e-9502-441b-8c8c-fd7111a84bac tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:19.661997 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-81ff624e-9502-441b-8c8c-fd7111a84bac tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] 10.222.0.27 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.181559 Sep 08 10:59:19.662685 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2330/4580] 10.222.0.27 () {58 vars in 1174 bytes} [Thu Sep 8 10:59:19 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:59:19.677433 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5d0d0f7e-829a-4861-878e-183ef853a28d tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:19.684803 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5d0d0f7e-829a-4861-878e-183ef853a28d tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e1fe29b5496a4169b0588b7b18d75537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a85de2674b413cb72fe0de96eec7cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:19.686376 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5d0d0f7e-829a-4861-878e-183ef853a28d tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': 'c8a85de2674b413cb72fe0de96eec7cc'} {{(pid=128862) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:59:19.699522 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5d0d0f7e-829a-4861-878e-183ef853a28d tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:19.700670 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5d0d0f7e-829a-4861-878e-183ef853a28d tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:19.702019 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5d0d0f7e-829a-4861-878e-183ef853a28d tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:19.703724 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5d0d0f7e-829a-4861-878e-183ef853a28d tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:19.704817 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5d0d0f7e-829a-4861-878e-183ef853a28d tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:19.705751 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5d0d0f7e-829a-4861-878e-183ef853a28d tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:19.822743 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5d0d0f7e-829a-4861-878e-183ef853a28d tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] 10.222.0.27 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.150231 Sep 08 10:59:19.837957 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ec161d91-b333-4975-a6c0-f27f9d378f01 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:19.843981 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ec161d91-b333-4975-a6c0-f27f9d378f01 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e1fe29b5496a4169b0588b7b18d75537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a85de2674b413cb72fe0de96eec7cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:19.848042 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ec161d91-b333-4975-a6c0-f27f9d378f01 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Searching by: {'deleted': False, 'project_id': 'c8a85de2674b413cb72fe0de96eec7cc'} {{(pid=128861) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:59:19.859867 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2251/4581] 10.222.0.27 () {58 vars in 1184 bytes} [Thu Sep 8 10:59:19 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:59:19.874723 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ec161d91-b333-4975-a6c0-f27f9d378f01 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:19.875489 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ec161d91-b333-4975-a6c0-f27f9d378f01 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:19.876099 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ec161d91-b333-4975-a6c0-f27f9d378f01 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:19.879654 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ec161d91-b333-4975-a6c0-f27f9d378f01 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:19.880959 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ec161d91-b333-4975-a6c0-f27f9d378f01 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:19.881777 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ec161d91-b333-4975-a6c0-f27f9d378f01 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:19.933749 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.multi_cell_list [None req-ec161d91-b333-4975-a6c0-f27f9d378f01 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128861) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 10:59:19.995939 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ec161d91-b333-4975-a6c0-f27f9d378f01 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fe29b5496a4169b0588b7b18d75537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a85de2674b413cb72fe0de96eec7cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:20.017517 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ec161d91-b333-4975-a6c0-f27f9d378f01 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:20.018734 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ec161d91-b333-4975-a6c0-f27f9d378f01 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:20.019402 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ec161d91-b333-4975-a6c0-f27f9d378f01 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:20.383284 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b4dc9278-5a42-4f0d-b645-4ac25c400047 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:20.385644 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b4dc9278-5a42-4f0d-b645-4ac25c400047 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:20.403361 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4dc9278-5a42-4f0d-b645-4ac25c400047 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:20.407758 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4dc9278-5a42-4f0d-b645-4ac25c400047 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:20.409553 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4dc9278-5a42-4f0d-b645-4ac25c400047 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:20.413489 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4dc9278-5a42-4f0d-b645-4ac25c400047 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:20.415631 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4dc9278-5a42-4f0d-b645-4ac25c400047 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:20.416442 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4dc9278-5a42-4f0d-b645-4ac25c400047 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:20.563724 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ec161d91-b333-4975-a6c0-f27f9d378f01 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] 10.222.0.27 "GET /compute/v2.1/servers/detail" status: 200 len: 3024 microversion: 2.1 time: 0.727212 Sep 08 10:59:20.566979 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2331/4582] 10.222.0.27 () {58 vars in 1146 bytes} [Thu Sep 8 10:59:19 2022] GET /compute/v2.1/servers/detail => generated 3024 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:20.593300 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5bd9ea65-3fc6-4742-bccb-da03a6e62d1c tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:20.602466 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5bd9ea65-3fc6-4742-bccb-da03a6e62d1c tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e1fe29b5496a4169b0588b7b18d75537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a85de2674b413cb72fe0de96eec7cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:20.616509 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5bd9ea65-3fc6-4742-bccb-da03a6e62d1c tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] 10.222.0.27 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.026999 Sep 08 10:59:20.617169 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2332/4583] 10.222.0.27 () {58 vars in 1178 bytes} [Thu Sep 8 10:59:20 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:59:20.631816 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-99511840-c325-462e-bf55-a7c94a7db19f tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:20.655775 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-99511840-c325-462e-bf55-a7c94a7db19f tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e1fe29b5496a4169b0588b7b18d75537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a85de2674b413cb72fe0de96eec7cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:20.678078 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-99511840-c325-462e-bf55-a7c94a7db19f tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Searching by: {'deleted': False, 'project_id': 'c8a85de2674b413cb72fe0de96eec7cc'} {{(pid=128861) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:59:20.711368 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-99511840-c325-462e-bf55-a7c94a7db19f tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:20.711845 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-99511840-c325-462e-bf55-a7c94a7db19f tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:20.712297 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-99511840-c325-462e-bf55-a7c94a7db19f tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:20.729479 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-99511840-c325-462e-bf55-a7c94a7db19f tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:20.730299 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-99511840-c325-462e-bf55-a7c94a7db19f tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:20.730770 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-99511840-c325-462e-bf55-a7c94a7db19f tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:20.874026 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.multi_cell_list [None req-99511840-c325-462e-bf55-a7c94a7db19f tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128861) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 10:59:21.012876 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b4dc9278-5a42-4f0d-b645-4ac25c400047 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:21.025233 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b4dc9278-5a42-4f0d-b645-4ac25c400047 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8" status: 200 len: 1317 microversion: 2.1 time: 0.648734 Sep 08 10:59:21.031103 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2252/4584] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:20 2022] GET /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8 => generated 1317 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:21.045278 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-99511840-c325-462e-bf55-a7c94a7db19f tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.416956 Sep 08 10:59:21.046927 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2333/4585] 10.222.0.27 () {58 vars in 1125 bytes} [Thu Sep 8 10:59:20 2022] GET /compute/v2.1/servers => generated 681 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:59:21.067579 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f2bb9136-6d1d-4a1f-9fb4-251b92f91688 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:21.068313 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f2bb9136-6d1d-4a1f-9fb4-251b92f91688 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] [instance: a167b49e-6d6c-4602-8980-9a42fea46555] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:21.087071 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f2bb9136-6d1d-4a1f-9fb4-251b92f91688 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:21.087677 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f2bb9136-6d1d-4a1f-9fb4-251b92f91688 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:21.088124 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f2bb9136-6d1d-4a1f-9fb4-251b92f91688 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:21.089382 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f2bb9136-6d1d-4a1f-9fb4-251b92f91688 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:21.090024 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f2bb9136-6d1d-4a1f-9fb4-251b92f91688 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:21.090620 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f2bb9136-6d1d-4a1f-9fb4-251b92f91688 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:21.116525 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-f2bb9136-6d1d-4a1f-9fb4-251b92f91688 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] HTTP exception thrown: Instance a167b49e-6d6c-4602-8980-9a42fea46555 could not be found. Sep 08 10:59:21.119555 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f2bb9136-6d1d-4a1f-9fb4-251b92f91688 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Request method failure captured: Sep 08 10:59:21.119555 n-d-850501-12 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/servers/a167b49e-6d6c-4602-8980-9a42fea46555 HTTP/1.1 Sep 08 10:59:21.119555 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 10:59:21.119555 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 10:59:21.119555 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 10:59:21.119555 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 10:59:21.119555 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 10:59:21.119555 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 10:59:21.119555 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 10:59:21.119555 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 10:59:21.119555 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcrcVdMg9S7tZRTqL7bDdz9i1kj7VzWegdw8mSVFrv6G-CHHrkYUBxSWD-HRsUQpmpJ5CBV8licgrL486WPziGCUCcTFTucXmQdp9NGa_v88TBSJiqO3rGqDud8GM2bIUxMXr4Tu4wNWlNJFERSNqdiz3LE8GSD3HNbvxbZ23g1e9M0 Sep 08 10:59:21.119555 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 10:59:21.119555 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 10:59:21.119555 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 10:59:21.119555 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 10:59:21.119555 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 10:59:21.119555 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 10:59:21.119555 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: c8a85de2674b413cb72fe0de96eec7cc Sep 08 10:59:21.119555 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ListServersNegativeTestJSON-2023907786 Sep 08 10:59:21.119555 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 10:59:21.119555 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 10:59:21.119555 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c8a85de2674b413cb72fe0de96eec7cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c8a85de2674b413cb72fe0de96eec7cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c8a85de2674b413cb72fe0de96eec7cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c8a85de2674b413cb72fe0de96eec7cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:59:21.119555 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ListServersNegativeTestJSON-2023907786 Sep 08 10:59:21.119555 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: c8a85de2674b413cb72fe0de96eec7cc Sep 08 10:59:21.119555 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-2023907786 Sep 08 10:59:21.119555 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ListServersNegativeTestJSON-2023907786-project Sep 08 10:59:21.119555 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 10:59:21.119555 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 10:59:21.119555 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: e1fe29b5496a4169b0588b7b18d75537 Sep 08 10:59:21.119555 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ListServersNegativeTestJSON-2023907786-project Sep 08 10:59:21.119555 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 10:59:21.119555 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance a167b49e-6d6c-4602-8980-9a42fea46555 could not be found. Sep 08 10:59:21.119555 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'a167b49e-6d6c-4602-8980-9a42fea46555'} Sep 08 10:59:21.119555 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:59:21.119555 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:59:21.119555 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:59:21.119555 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:59:21.119555 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:59:21.119555 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:59:21.119555 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:59:21.119555 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:59:21.119555 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:59:21.119555 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:59:21.119555 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a167b49e-6d6c-4602-8980-9a42fea46555 could not be found. Sep 08 10:59:21.119555 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:59:21.119555 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:59:21.119555 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:59:21.119555 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:59:21.119555 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:59:21.119555 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:59:21.119555 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:59:21.119555 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:59:21.119555 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:59:21.119555 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:59:21.119555 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:59:21.119555 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:59:21.119555 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:59:21.119555 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:59:21.119555 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:59:21.119555 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:59:21.119555 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:59:21.119555 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:59:21.129526 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a167b49e-6d6c-4602-8980-9a42fea46555 could not be found. Sep 08 10:59:21.129526 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:59:21.129526 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:59:21.129526 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:59:21.129526 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:59:21.129526 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:59:21.129526 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:59:21.129526 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:59:21.129526 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:59:21.129526 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a167b49e-6d6c-4602-8980-9a42fea46555 could not be found. Sep 08 10:59:21.129526 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 10:59:21.154853 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f2bb9136-6d1d-4a1f-9fb4-251b92f91688 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Returning 404 to user: Instance a167b49e-6d6c-4602-8980-9a42fea46555 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:59:21.156676 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f2bb9136-6d1d-4a1f-9fb4-251b92f91688 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a167b49e-6d6c-4602-8980-9a42fea46555" status: 404 len: 111 microversion: 2.1 time: 0.095300 Sep 08 10:59:21.170703 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c657d367-9b83-42f1-9d5c-6847bcbda425 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:21.171170 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c657d367-9b83-42f1-9d5c-6847bcbda425 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] [instance: f1de1e06-01fa-4eb7-9dc6-be46802187c5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:21.177312 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2253/4586] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:59:21 2022] DELETE /compute/v2.1/servers/a167b49e-6d6c-4602-8980-9a42fea46555 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:59:21.178982 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c657d367-9b83-42f1-9d5c-6847bcbda425 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:21.179541 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c657d367-9b83-42f1-9d5c-6847bcbda425 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:21.180270 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c657d367-9b83-42f1-9d5c-6847bcbda425 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:21.181261 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c657d367-9b83-42f1-9d5c-6847bcbda425 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:21.181935 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c657d367-9b83-42f1-9d5c-6847bcbda425 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:21.182579 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c657d367-9b83-42f1-9d5c-6847bcbda425 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:21.213150 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c657d367-9b83-42f1-9d5c-6847bcbda425 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] [instance: f1de1e06-01fa-4eb7-9dc6-be46802187c5] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:59:21.372070 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c657d367-9b83-42f1-9d5c-6847bcbda425 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f1de1e06-01fa-4eb7-9dc6-be46802187c5" status: 204 len: 0 microversion: 2.1 time: 0.204627 Sep 08 10:59:21.382969 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-44c20c1f-c38a-42ba-9e3c-e79aa15b9c04 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:21.383539 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-44c20c1f-c38a-42ba-9e3c-e79aa15b9c04 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] [instance: 7931ea02-ab01-4895-9ff2-265a0f58fe67] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:21.387732 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2334/4587] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:59:21 2022] DELETE /compute/v2.1/servers/f1de1e06-01fa-4eb7-9dc6-be46802187c5 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:59:21.404800 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-44c20c1f-c38a-42ba-9e3c-e79aa15b9c04 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:21.405743 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-44c20c1f-c38a-42ba-9e3c-e79aa15b9c04 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:21.407539 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-44c20c1f-c38a-42ba-9e3c-e79aa15b9c04 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:21.408523 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-44c20c1f-c38a-42ba-9e3c-e79aa15b9c04 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:21.413383 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-44c20c1f-c38a-42ba-9e3c-e79aa15b9c04 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:21.413886 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-44c20c1f-c38a-42ba-9e3c-e79aa15b9c04 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:21.480374 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-44c20c1f-c38a-42ba-9e3c-e79aa15b9c04 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] [instance: 7931ea02-ab01-4895-9ff2-265a0f58fe67] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:59:21.679290 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-44c20c1f-c38a-42ba-9e3c-e79aa15b9c04 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7931ea02-ab01-4895-9ff2-265a0f58fe67" status: 204 len: 0 microversion: 2.1 time: 0.301100 Sep 08 10:59:21.680297 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2254/4588] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 10:59:21 2022] DELETE /compute/v2.1/servers/7931ea02-ab01-4895-9ff2-265a0f58fe67 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:59:21.694480 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f49fe51a-6777-4964-b989-6aab6df401b6 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:21.700570 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f49fe51a-6777-4964-b989-6aab6df401b6 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] [instance: a167b49e-6d6c-4602-8980-9a42fea46555] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:21.721452 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f49fe51a-6777-4964-b989-6aab6df401b6 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:21.722514 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f49fe51a-6777-4964-b989-6aab6df401b6 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:21.723189 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f49fe51a-6777-4964-b989-6aab6df401b6 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:21.724156 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f49fe51a-6777-4964-b989-6aab6df401b6 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:21.724840 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f49fe51a-6777-4964-b989-6aab6df401b6 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:21.725529 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f49fe51a-6777-4964-b989-6aab6df401b6 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:21.743473 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-f49fe51a-6777-4964-b989-6aab6df401b6 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] HTTP exception thrown: Instance a167b49e-6d6c-4602-8980-9a42fea46555 could not be found. Sep 08 10:59:21.746941 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f49fe51a-6777-4964-b989-6aab6df401b6 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Request method failure captured: Sep 08 10:59:21.746941 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/a167b49e-6d6c-4602-8980-9a42fea46555 HTTP/1.1 Sep 08 10:59:21.746941 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:59:21.746941 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:59:21.746941 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:59:21.746941 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:59:21.746941 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:59:21.746941 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:59:21.746941 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:59:21.746941 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:59:21.746941 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcrcVdMg9S7tZRTqL7bDdz9i1kj7VzWegdw8mSVFrv6G-CHHrkYUBxSWD-HRsUQpmpJ5CBV8licgrL486WPziGCUCcTFTucXmQdp9NGa_v88TBSJiqO3rGqDud8GM2bIUxMXr4Tu4wNWlNJFERSNqdiz3LE8GSD3HNbvxbZ23g1e9M0 Sep 08 10:59:21.746941 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:59:21.746941 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:59:21.746941 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:59:21.746941 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:59:21.746941 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:59:21.746941 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:59:21.746941 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: c8a85de2674b413cb72fe0de96eec7cc Sep 08 10:59:21.746941 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ListServersNegativeTestJSON-2023907786 Sep 08 10:59:21.746941 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:59:21.746941 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:59:21.746941 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c8a85de2674b413cb72fe0de96eec7cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c8a85de2674b413cb72fe0de96eec7cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c8a85de2674b413cb72fe0de96eec7cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c8a85de2674b413cb72fe0de96eec7cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:59:21.746941 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ListServersNegativeTestJSON-2023907786 Sep 08 10:59:21.746941 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: c8a85de2674b413cb72fe0de96eec7cc Sep 08 10:59:21.746941 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-2023907786 Sep 08 10:59:21.746941 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ListServersNegativeTestJSON-2023907786-project Sep 08 10:59:21.746941 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:59:21.746941 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:59:21.746941 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: e1fe29b5496a4169b0588b7b18d75537 Sep 08 10:59:21.746941 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ListServersNegativeTestJSON-2023907786-project Sep 08 10:59:21.746941 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:59:21.746941 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance a167b49e-6d6c-4602-8980-9a42fea46555 could not be found. Sep 08 10:59:21.746941 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': 'a167b49e-6d6c-4602-8980-9a42fea46555'} Sep 08 10:59:21.746941 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:59:21.746941 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:59:21.746941 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:59:21.746941 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:59:21.746941 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:59:21.746941 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:59:21.746941 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:59:21.746941 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:59:21.746941 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:59:21.746941 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:59:21.746941 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a167b49e-6d6c-4602-8980-9a42fea46555 could not be found. Sep 08 10:59:21.746941 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:59:21.746941 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:59:21.746941 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:59:21.746941 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:59:21.746941 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:59:21.746941 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:59:21.746941 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:59:21.746941 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:59:21.746941 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:59:21.746941 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:59:21.746941 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:59:21.746941 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:59:21.746941 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:59:21.746941 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:59:21.746941 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:59:21.746941 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:59:21.746941 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a167b49e-6d6c-4602-8980-9a42fea46555 could not be found. Sep 08 10:59:21.746941 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:59:21.746941 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:59:21.761174 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:59:21.761174 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:59:21.761174 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:59:21.761174 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:59:21.761174 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:59:21.761174 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:59:21.761174 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a167b49e-6d6c-4602-8980-9a42fea46555 could not be found. Sep 08 10:59:21.761174 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:59:21.761174 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f49fe51a-6777-4964-b989-6aab6df401b6 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Returning 404 to user: Instance a167b49e-6d6c-4602-8980-9a42fea46555 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:59:21.761174 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f49fe51a-6777-4964-b989-6aab6df401b6 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] 10.222.0.27 "GET /compute/v2.1/servers/a167b49e-6d6c-4602-8980-9a42fea46555" status: 404 len: 111 microversion: 2.1 time: 0.065736 Sep 08 10:59:21.761174 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2335/4589] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:21 2022] GET /compute/v2.1/servers/a167b49e-6d6c-4602-8980-9a42fea46555 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:59:21.767803 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-254c55be-4668-45b2-96b8-35912fcb8d3e tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:21.769368 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-254c55be-4668-45b2-96b8-35912fcb8d3e tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] [instance: f1de1e06-01fa-4eb7-9dc6-be46802187c5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:21.778267 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-254c55be-4668-45b2-96b8-35912fcb8d3e tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:21.778878 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-254c55be-4668-45b2-96b8-35912fcb8d3e tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:21.779555 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-254c55be-4668-45b2-96b8-35912fcb8d3e tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:21.780696 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-254c55be-4668-45b2-96b8-35912fcb8d3e tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:21.781283 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-254c55be-4668-45b2-96b8-35912fcb8d3e tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:21.782343 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-254c55be-4668-45b2-96b8-35912fcb8d3e tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:22.062969 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bafa3a0b-8729-42e1-8c0e-e5ea2820bbd6 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:22.064018 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bafa3a0b-8729-42e1-8c0e-e5ea2820bbd6 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:22.093988 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bafa3a0b-8729-42e1-8c0e-e5ea2820bbd6 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:22.094822 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bafa3a0b-8729-42e1-8c0e-e5ea2820bbd6 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:22.095571 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bafa3a0b-8729-42e1-8c0e-e5ea2820bbd6 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:22.097518 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bafa3a0b-8729-42e1-8c0e-e5ea2820bbd6 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:22.098290 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bafa3a0b-8729-42e1-8c0e-e5ea2820bbd6 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:22.108929 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bafa3a0b-8729-42e1-8c0e-e5ea2820bbd6 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:22.383454 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-254c55be-4668-45b2-96b8-35912fcb8d3e tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fe29b5496a4169b0588b7b18d75537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a85de2674b413cb72fe0de96eec7cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:22.393606 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-254c55be-4668-45b2-96b8-35912fcb8d3e tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] 10.222.0.27 "GET /compute/v2.1/servers/f1de1e06-01fa-4eb7-9dc6-be46802187c5" status: 200 len: 1522 microversion: 2.1 time: 0.633742 Sep 08 10:59:22.400308 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2255/4590] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:21 2022] GET /compute/v2.1/servers/f1de1e06-01fa-4eb7-9dc6-be46802187c5 => generated 1522 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:23.055421 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-bafa3a0b-8729-42e1-8c0e-e5ea2820bbd6 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:23.088353 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bafa3a0b-8729-42e1-8c0e-e5ea2820bbd6 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8" status: 200 len: 1317 microversion: 2.1 time: 1.030605 Sep 08 10:59:23.090781 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2336/4591] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:22 2022] GET /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8 => generated 1317 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:59:23.450916 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-981f7ca4-ab81-49d2-afb9-06e537b32fba tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:23.451549 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-981f7ca4-ab81-49d2-afb9-06e537b32fba tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] [instance: f1de1e06-01fa-4eb7-9dc6-be46802187c5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:23.471019 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-981f7ca4-ab81-49d2-afb9-06e537b32fba tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:23.472960 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-981f7ca4-ab81-49d2-afb9-06e537b32fba tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:23.479651 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-981f7ca4-ab81-49d2-afb9-06e537b32fba tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:23.480853 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-981f7ca4-ab81-49d2-afb9-06e537b32fba tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:23.483014 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-981f7ca4-ab81-49d2-afb9-06e537b32fba tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:23.503011 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-981f7ca4-ab81-49d2-afb9-06e537b32fba tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:24.054525 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-8a3c11c9-a561-41de-b5d4-56e0464be3f8 req-46188d05-0cd8-4731-a073-7c0ad2ed6de2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1de1e06-01fa-4eb7-9dc6-be46802187c5", "name": "network-vif-unplugged", "status": "completed", "tag": "fb64b460-5d71-43ac-9f97-8a017825ab09"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:59:24.080145 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:59:24.088054 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-8a3c11c9-a561-41de-b5d4-56e0464be3f8 req-46188d05-0cd8-4731-a073-7c0ad2ed6de2 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:24.088557 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-8a3c11c9-a561-41de-b5d4-56e0464be3f8 req-46188d05-0cd8-4731-a073-7c0ad2ed6de2 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:24.089015 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-8a3c11c9-a561-41de-b5d4-56e0464be3f8 req-46188d05-0cd8-4731-a073-7c0ad2ed6de2 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:24.121836 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-8a3c11c9-a561-41de-b5d4-56e0464be3f8 req-46188d05-0cd8-4731-a073-7c0ad2ed6de2 service nova] Creating event network-vif-unplugged:fb64b460-5d71-43ac-9f97-8a017825ab09 for instance f1de1e06-01fa-4eb7-9dc6-be46802187c5 on n-h2-850501-12 Sep 08 10:59:24.132230 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-8a3c11c9-a561-41de-b5d4-56e0464be3f8 req-46188d05-0cd8-4731-a073-7c0ad2ed6de2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081718 Sep 08 10:59:24.133225 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2337/4592] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:59:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:59:24.142730 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c0d6f154-3f05-430a-b238-d2be3f9c3c20 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:24.158093 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c0d6f154-3f05-430a-b238-d2be3f9c3c20 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:24.165848 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c0d6f154-3f05-430a-b238-d2be3f9c3c20 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:24.166609 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c0d6f154-3f05-430a-b238-d2be3f9c3c20 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:24.167243 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c0d6f154-3f05-430a-b238-d2be3f9c3c20 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:24.168141 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c0d6f154-3f05-430a-b238-d2be3f9c3c20 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:24.168762 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c0d6f154-3f05-430a-b238-d2be3f9c3c20 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:24.169375 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c0d6f154-3f05-430a-b238-d2be3f9c3c20 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:24.213622 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-981f7ca4-ab81-49d2-afb9-06e537b32fba tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fe29b5496a4169b0588b7b18d75537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a85de2674b413cb72fe0de96eec7cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:24.230722 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-981f7ca4-ab81-49d2-afb9-06e537b32fba tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] 10.222.0.27 "GET /compute/v2.1/servers/f1de1e06-01fa-4eb7-9dc6-be46802187c5" status: 200 len: 1522 microversion: 2.1 time: 0.784797 Sep 08 10:59:24.246020 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2256/4593] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:23 2022] GET /compute/v2.1/servers/f1de1e06-01fa-4eb7-9dc6-be46802187c5 => generated 1522 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:59:24.247567 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ffc9d237-85bc-49c5-9490-a334d3951e41 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:24.248551 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ffc9d237-85bc-49c5-9490-a334d3951e41 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:24.263089 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ffc9d237-85bc-49c5-9490-a334d3951e41 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:24.265509 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ffc9d237-85bc-49c5-9490-a334d3951e41 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:24.268580 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ffc9d237-85bc-49c5-9490-a334d3951e41 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:24.271586 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ffc9d237-85bc-49c5-9490-a334d3951e41 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:24.272120 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ffc9d237-85bc-49c5-9490-a334d3951e41 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:24.272613 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ffc9d237-85bc-49c5-9490-a334d3951e41 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:24.735915 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ffc9d237-85bc-49c5-9490-a334d3951e41 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:24.752778 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ffc9d237-85bc-49c5-9490-a334d3951e41 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8" status: 200 len: 1317 microversion: 2.1 time: 0.518495 Sep 08 10:59:24.758554 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2257/4594] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:24 2022] GET /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8 => generated 1317 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:24.774147 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-3f6f37a0-481a-4901-ab25-2b2ce9d801f4 req-fb31a6ad-564b-46d1-baa1-448e074f5984 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1de1e06-01fa-4eb7-9dc6-be46802187c5", "name": "network-vif-deleted", "tag": "fb64b460-5d71-43ac-9f97-8a017825ab09"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:59:24.807233 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-3f6f37a0-481a-4901-ab25-2b2ce9d801f4 req-fb31a6ad-564b-46d1-baa1-448e074f5984 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:24.807731 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-3f6f37a0-481a-4901-ab25-2b2ce9d801f4 req-fb31a6ad-564b-46d1-baa1-448e074f5984 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:24.808169 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-3f6f37a0-481a-4901-ab25-2b2ce9d801f4 req-fb31a6ad-564b-46d1-baa1-448e074f5984 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:24.841239 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-3f6f37a0-481a-4901-ab25-2b2ce9d801f4 req-fb31a6ad-564b-46d1-baa1-448e074f5984 service nova] Creating event network-vif-deleted:fb64b460-5d71-43ac-9f97-8a017825ab09 for instance f1de1e06-01fa-4eb7-9dc6-be46802187c5 on n-h2-850501-12 Sep 08 10:59:24.876500 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-3f6f37a0-481a-4901-ab25-2b2ce9d801f4 req-fb31a6ad-564b-46d1-baa1-448e074f5984 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113446 Sep 08 10:59:24.882967 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2258/4595] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:59:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:59:25.254674 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-262ea08d-219d-42df-b83b-77a3530cfca8 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:25.255464 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-262ea08d-219d-42df-b83b-77a3530cfca8 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] [instance: f1de1e06-01fa-4eb7-9dc6-be46802187c5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:25.269190 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-262ea08d-219d-42df-b83b-77a3530cfca8 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:25.270065 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-262ea08d-219d-42df-b83b-77a3530cfca8 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:25.271151 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-262ea08d-219d-42df-b83b-77a3530cfca8 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:25.273751 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-262ea08d-219d-42df-b83b-77a3530cfca8 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:25.275865 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-262ea08d-219d-42df-b83b-77a3530cfca8 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:25.277884 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-262ea08d-219d-42df-b83b-77a3530cfca8 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:25.341137 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-262ea08d-219d-42df-b83b-77a3530cfca8 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:25.342000 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-262ea08d-219d-42df-b83b-77a3530cfca8 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:25.342667 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-262ea08d-219d-42df-b83b-77a3530cfca8 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:25.343344 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-262ea08d-219d-42df-b83b-77a3530cfca8 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lazy-loading 'fault' on Instance uuid f1de1e06-01fa-4eb7-9dc6-be46802187c5 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:59:25.483186 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-262ea08d-219d-42df-b83b-77a3530cfca8 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fe29b5496a4169b0588b7b18d75537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a85de2674b413cb72fe0de96eec7cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:25.502884 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-262ea08d-219d-42df-b83b-77a3530cfca8 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] 10.222.0.27 "GET /compute/v2.1/servers/f1de1e06-01fa-4eb7-9dc6-be46802187c5" status: 200 len: 1312 microversion: 2.1 time: 0.252283 Sep 08 10:59:25.508728 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2259/4596] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:25 2022] GET /compute/v2.1/servers/f1de1e06-01fa-4eb7-9dc6-be46802187c5 => generated 1312 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:25.538348 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c0d6f154-3f05-430a-b238-d2be3f9c3c20 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:25.552848 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c0d6f154-3f05-430a-b238-d2be3f9c3c20 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1671 microversion: 2.1 time: 1.418332 Sep 08 10:59:25.555884 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2338/4597] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:24 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1671 bytes in 1422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:25.584096 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1a888489-8c59-4718-9987-37871245ab2d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:25.585771 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1a888489-8c59-4718-9987-37871245ab2d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:25.598553 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1a888489-8c59-4718-9987-37871245ab2d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:25.599525 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1a888489-8c59-4718-9987-37871245ab2d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:25.600828 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1a888489-8c59-4718-9987-37871245ab2d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:25.603706 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1a888489-8c59-4718-9987-37871245ab2d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:25.606494 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1a888489-8c59-4718-9987-37871245ab2d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:25.608939 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1a888489-8c59-4718-9987-37871245ab2d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:25.787321 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fb38eec6-6ffc-43b4-ae46-9e02f5082bed tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:25.788224 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fb38eec6-6ffc-43b4-ae46-9e02f5082bed tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:25.807587 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb38eec6-6ffc-43b4-ae46-9e02f5082bed tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:25.810285 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb38eec6-6ffc-43b4-ae46-9e02f5082bed tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:25.810753 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb38eec6-6ffc-43b4-ae46-9e02f5082bed tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:25.812406 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb38eec6-6ffc-43b4-ae46-9e02f5082bed tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:25.815466 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb38eec6-6ffc-43b4-ae46-9e02f5082bed tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:25.816105 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb38eec6-6ffc-43b4-ae46-9e02f5082bed tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:26.247477 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1a888489-8c59-4718-9987-37871245ab2d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:26.257362 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1a888489-8c59-4718-9987-37871245ab2d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1671 microversion: 2.1 time: 0.677479 Sep 08 10:59:26.258772 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2260/4598] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:25 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1671 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:26.264479 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-b8a17aa6-57ee-4b91-b22c-8bd604bb0516 req-93900685-e358-498b-a171-cf767b72388f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8", "name": "network-vif-plugged", "status": "completed", "tag": "5f04b415-8433-4439-80f4-4d2e2907654b"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:59:26.277015 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b8a17aa6-57ee-4b91-b22c-8bd604bb0516 req-93900685-e358-498b-a171-cf767b72388f service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:26.277924 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b8a17aa6-57ee-4b91-b22c-8bd604bb0516 req-93900685-e358-498b-a171-cf767b72388f service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:26.278640 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b8a17aa6-57ee-4b91-b22c-8bd604bb0516 req-93900685-e358-498b-a171-cf767b72388f service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:26.295765 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-b8a17aa6-57ee-4b91-b22c-8bd604bb0516 req-93900685-e358-498b-a171-cf767b72388f service nova] Creating event network-vif-plugged:5f04b415-8433-4439-80f4-4d2e2907654b for instance f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8 on n-h2-850501-12 Sep 08 10:59:26.302360 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-b8a17aa6-57ee-4b91-b22c-8bd604bb0516 req-93900685-e358-498b-a171-cf767b72388f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041962 Sep 08 10:59:26.303630 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2261/4599] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:59:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:59:26.310220 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f9328a13-7302-4b29-bf12-1a813cd8653e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:26.311337 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f9328a13-7302-4b29-bf12-1a813cd8653e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:26.319792 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f9328a13-7302-4b29-bf12-1a813cd8653e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:26.320540 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f9328a13-7302-4b29-bf12-1a813cd8653e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:26.321285 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f9328a13-7302-4b29-bf12-1a813cd8653e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:26.322556 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f9328a13-7302-4b29-bf12-1a813cd8653e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:26.323236 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f9328a13-7302-4b29-bf12-1a813cd8653e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:26.323895 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f9328a13-7302-4b29-bf12-1a813cd8653e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:26.516540 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-fb38eec6-6ffc-43b4-ae46-9e02f5082bed tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:26.539940 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fb38eec6-6ffc-43b4-ae46-9e02f5082bed tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8" status: 200 len: 1317 microversion: 2.1 time: 0.757822 Sep 08 10:59:26.541390 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2339/4600] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:25 2022] GET /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8 => generated 1317 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:26.565708 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-2a9d9c21-9d03-4236-96a3-47e13fd182f2 req-e3672362-e8a3-4a5e-ad09-553beb7e254c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7931ea02-ab01-4895-9ff2-265a0f58fe67", "name": "network-vif-deleted", "tag": "f0d5f2d9-a160-435c-aee8-9a0ee4f8a71f"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:59:26.578922 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-2a9d9c21-9d03-4236-96a3-47e13fd182f2 req-e3672362-e8a3-4a5e-ad09-553beb7e254c service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:26.579722 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-2a9d9c21-9d03-4236-96a3-47e13fd182f2 req-e3672362-e8a3-4a5e-ad09-553beb7e254c service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:26.580855 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-2a9d9c21-9d03-4236-96a3-47e13fd182f2 req-e3672362-e8a3-4a5e-ad09-553beb7e254c service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:26.593978 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-2a9d9c21-9d03-4236-96a3-47e13fd182f2 req-e3672362-e8a3-4a5e-ad09-553beb7e254c service nova] Creating event network-vif-deleted:f0d5f2d9-a160-435c-aee8-9a0ee4f8a71f for instance 7931ea02-ab01-4895-9ff2-265a0f58fe67 on n-h1-850501-12 Sep 08 10:59:26.601194 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-2a9d9c21-9d03-4236-96a3-47e13fd182f2 req-e3672362-e8a3-4a5e-ad09-553beb7e254c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057765 Sep 08 10:59:26.603129 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2340/4601] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:59:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:59:26.612202 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9991aaaf-ffc3-47e6-8ca8-bb5b1561e0da tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:26.613147 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9991aaaf-ffc3-47e6-8ca8-bb5b1561e0da tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] [instance: f1de1e06-01fa-4eb7-9dc6-be46802187c5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:26.620831 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9991aaaf-ffc3-47e6-8ca8-bb5b1561e0da tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:26.621602 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9991aaaf-ffc3-47e6-8ca8-bb5b1561e0da tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:26.622201 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9991aaaf-ffc3-47e6-8ca8-bb5b1561e0da tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:26.623248 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9991aaaf-ffc3-47e6-8ca8-bb5b1561e0da tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:26.624071 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9991aaaf-ffc3-47e6-8ca8-bb5b1561e0da tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:26.624685 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9991aaaf-ffc3-47e6-8ca8-bb5b1561e0da tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:26.643348 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-9991aaaf-ffc3-47e6-8ca8-bb5b1561e0da tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] HTTP exception thrown: Instance f1de1e06-01fa-4eb7-9dc6-be46802187c5 could not be found. Sep 08 10:59:26.646559 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9991aaaf-ffc3-47e6-8ca8-bb5b1561e0da tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Request method failure captured: Sep 08 10:59:26.646559 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/f1de1e06-01fa-4eb7-9dc6-be46802187c5 HTTP/1.1 Sep 08 10:59:26.646559 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:59:26.646559 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:59:26.646559 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:59:26.646559 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:59:26.646559 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:59:26.646559 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:59:26.646559 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:59:26.646559 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:59:26.646559 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcrcVdMg9S7tZRTqL7bDdz9i1kj7VzWegdw8mSVFrv6G-CHHrkYUBxSWD-HRsUQpmpJ5CBV8licgrL486WPziGCUCcTFTucXmQdp9NGa_v88TBSJiqO3rGqDud8GM2bIUxMXr4Tu4wNWlNJFERSNqdiz3LE8GSD3HNbvxbZ23g1e9M0 Sep 08 10:59:26.646559 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:59:26.646559 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:59:26.646559 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:59:26.646559 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:59:26.646559 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:59:26.646559 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:59:26.646559 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: c8a85de2674b413cb72fe0de96eec7cc Sep 08 10:59:26.646559 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ListServersNegativeTestJSON-2023907786 Sep 08 10:59:26.646559 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:59:26.646559 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:59:26.646559 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c8a85de2674b413cb72fe0de96eec7cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c8a85de2674b413cb72fe0de96eec7cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c8a85de2674b413cb72fe0de96eec7cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c8a85de2674b413cb72fe0de96eec7cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:59:26.646559 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ListServersNegativeTestJSON-2023907786 Sep 08 10:59:26.646559 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: c8a85de2674b413cb72fe0de96eec7cc Sep 08 10:59:26.646559 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-2023907786 Sep 08 10:59:26.646559 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ListServersNegativeTestJSON-2023907786-project Sep 08 10:59:26.646559 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:59:26.646559 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:59:26.646559 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: e1fe29b5496a4169b0588b7b18d75537 Sep 08 10:59:26.646559 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ListServersNegativeTestJSON-2023907786-project Sep 08 10:59:26.646559 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:59:26.646559 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance f1de1e06-01fa-4eb7-9dc6-be46802187c5 could not be found. Sep 08 10:59:26.646559 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': 'f1de1e06-01fa-4eb7-9dc6-be46802187c5'} Sep 08 10:59:26.646559 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:59:26.646559 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:59:26.646559 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:59:26.646559 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:59:26.646559 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:59:26.646559 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:59:26.646559 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:59:26.646559 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:59:26.646559 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:59:26.646559 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:59:26.646559 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1de1e06-01fa-4eb7-9dc6-be46802187c5 could not be found. Sep 08 10:59:26.646559 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:59:26.646559 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:59:26.646559 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:59:26.646559 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:59:26.646559 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:59:26.646559 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:59:26.646559 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:59:26.646559 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:59:26.646559 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:59:26.646559 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:59:26.646559 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:59:26.646559 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:59:26.646559 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:59:26.646559 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:59:26.646559 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:59:26.646559 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:59:26.646559 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1de1e06-01fa-4eb7-9dc6-be46802187c5 could not be found. Sep 08 10:59:26.646559 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:59:26.646559 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:59:26.650742 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:59:26.650742 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:59:26.650742 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:59:26.650742 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:59:26.650742 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:59:26.650742 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:59:26.650742 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1de1e06-01fa-4eb7-9dc6-be46802187c5 could not be found. Sep 08 10:59:26.650742 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:59:26.657071 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9991aaaf-ffc3-47e6-8ca8-bb5b1561e0da tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Returning 404 to user: Instance f1de1e06-01fa-4eb7-9dc6-be46802187c5 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:59:26.657969 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9991aaaf-ffc3-47e6-8ca8-bb5b1561e0da tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] 10.222.0.27 "GET /compute/v2.1/servers/f1de1e06-01fa-4eb7-9dc6-be46802187c5" status: 404 len: 111 microversion: 2.1 time: 0.052261 Sep 08 10:59:26.659475 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2341/4602] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:26 2022] GET /compute/v2.1/servers/f1de1e06-01fa-4eb7-9dc6-be46802187c5 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:59:26.667371 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3d1da57c-8ba4-48e2-96e0-0454f9e92e4d tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:26.667996 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3d1da57c-8ba4-48e2-96e0-0454f9e92e4d tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] [instance: 7931ea02-ab01-4895-9ff2-265a0f58fe67] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:26.675106 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3d1da57c-8ba4-48e2-96e0-0454f9e92e4d tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:26.675708 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3d1da57c-8ba4-48e2-96e0-0454f9e92e4d tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:26.676353 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3d1da57c-8ba4-48e2-96e0-0454f9e92e4d tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:26.677283 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3d1da57c-8ba4-48e2-96e0-0454f9e92e4d tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:26.677905 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3d1da57c-8ba4-48e2-96e0-0454f9e92e4d tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:26.678504 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3d1da57c-8ba4-48e2-96e0-0454f9e92e4d tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:26.720140 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3d1da57c-8ba4-48e2-96e0-0454f9e92e4d tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:26.720649 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3d1da57c-8ba4-48e2-96e0-0454f9e92e4d tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:26.721660 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3d1da57c-8ba4-48e2-96e0-0454f9e92e4d tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:26.722127 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-3d1da57c-8ba4-48e2-96e0-0454f9e92e4d tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lazy-loading 'fault' on Instance uuid 7931ea02-ab01-4895-9ff2-265a0f58fe67 {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:59:26.724494 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:59:26.894816 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f9328a13-7302-4b29-bf12-1a813cd8653e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:26.905152 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f9328a13-7302-4b29-bf12-1a813cd8653e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1671 microversion: 2.1 time: 0.599833 Sep 08 10:59:26.906229 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2262/4603] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:26 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1671 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:26.939845 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3dcb941e-6a16-4b10-a601-ad1df07adff0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:26.942340 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3dcb941e-6a16-4b10-a601-ad1df07adff0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:26.952169 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3dcb941e-6a16-4b10-a601-ad1df07adff0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:26.953148 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3dcb941e-6a16-4b10-a601-ad1df07adff0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:26.953747 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3dcb941e-6a16-4b10-a601-ad1df07adff0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:26.954880 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3dcb941e-6a16-4b10-a601-ad1df07adff0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:26.956027 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3dcb941e-6a16-4b10-a601-ad1df07adff0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:26.956717 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3dcb941e-6a16-4b10-a601-ad1df07adff0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:27.169688 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-3d1da57c-8ba4-48e2-96e0-0454f9e92e4d tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fe29b5496a4169b0588b7b18d75537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a85de2674b413cb72fe0de96eec7cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:27.206098 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3d1da57c-8ba4-48e2-96e0-0454f9e92e4d tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] 10.222.0.27 "GET /compute/v2.1/servers/7931ea02-ab01-4895-9ff2-265a0f58fe67" status: 200 len: 1312 microversion: 2.1 time: 0.538439 Sep 08 10:59:27.210163 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2342/4604] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:26 2022] GET /compute/v2.1/servers/7931ea02-ab01-4895-9ff2-265a0f58fe67 => generated 1312 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:59:27.334127 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-698b2504-cdf6-46ed-b0fa-f9cb4159d292 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Action: 'create', calling method: .version_select at 0x7f68e40cb3a0>, body: {"keypair": {"name": "tempest-keypair-1848326281", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFaI6lLs+Qocn47rvWy3ugSiSd7eKroZ/py2U33pKAFBkdM+XnvYl7Hkp9NZWwJWuXL0ZQ8Y9QmhvvU7Shg3Pn+5Zw0sJWzp7wgLHrczUWG857nrdCNhnQn4v1kb+fv++w=="}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:59:27.363482 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-698b2504-cdf6-46ed-b0fa-f9cb4159d292 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Getting quotas for project 1582bf1f51b246c68ec82f173df79a5a. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:59:27.369229 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-698b2504-cdf6-46ed-b0fa-f9cb4159d292 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Getting quotas for user 9ba7568d44ad47e8b37504ecc8a402ca and project 1582bf1f51b246c68ec82f173df79a5a. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:59:27.403463 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-698b2504-cdf6-46ed-b0fa-f9cb4159d292 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.073624 Sep 08 10:59:27.405826 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3dcb941e-6a16-4b10-a601-ad1df07adff0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:27.412824 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2343/4605] 10.222.0.27 () {62 vars in 1200 bytes} [Thu Sep 8 10:59:27 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 83 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 08 10:59:27.419686 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3dcb941e-6a16-4b10-a601-ad1df07adff0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1671 microversion: 2.1 time: 0.485880 Sep 08 10:59:27.421195 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2263/4606] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:26 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1671 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:27.568894 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0fc6aaa9-b3c1-4047-a109-f8126429344d tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:27.570322 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0fc6aaa9-b3c1-4047-a109-f8126429344d tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:27.585083 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0fc6aaa9-b3c1-4047-a109-f8126429344d tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:27.588701 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0fc6aaa9-b3c1-4047-a109-f8126429344d tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:27.589488 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0fc6aaa9-b3c1-4047-a109-f8126429344d tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:27.591924 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0fc6aaa9-b3c1-4047-a109-f8126429344d tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:27.592417 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0fc6aaa9-b3c1-4047-a109-f8126429344d tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:27.592894 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0fc6aaa9-b3c1-4047-a109-f8126429344d tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:27.714901 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-47efcbeb-069b-4d30-81de-36acfcfb27b7 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-607724124", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "b9022ed4-d5a1-4655-b50c-e8de49533ecf"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:59:27.805778 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-47efcbeb-069b-4d30-81de-36acfcfb27b7 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] validate_networks() for [('b9022ed4-d5a1-4655-b50c-e8de49533ecf', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:59:27.926944 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0fc6aaa9-b3c1-4047-a109-f8126429344d tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:27.936944 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0fc6aaa9-b3c1-4047-a109-f8126429344d tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8" status: 200 len: 1317 microversion: 2.1 time: 0.372715 Sep 08 10:59:27.938261 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2344/4607] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:27 2022] GET /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8 => generated 1317 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:28.233708 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-852af1fa-ebc1-49cd-8e9f-68cc9730e4e9 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:28.234794 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-852af1fa-ebc1-49cd-8e9f-68cc9730e4e9 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] [instance: 7931ea02-ab01-4895-9ff2-265a0f58fe67] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:28.251314 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-852af1fa-ebc1-49cd-8e9f-68cc9730e4e9 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:28.252646 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-852af1fa-ebc1-49cd-8e9f-68cc9730e4e9 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:28.254464 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-852af1fa-ebc1-49cd-8e9f-68cc9730e4e9 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:28.261881 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-852af1fa-ebc1-49cd-8e9f-68cc9730e4e9 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:28.271772 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-852af1fa-ebc1-49cd-8e9f-68cc9730e4e9 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:28.275667 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-852af1fa-ebc1-49cd-8e9f-68cc9730e4e9 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:28.319875 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-852af1fa-ebc1-49cd-8e9f-68cc9730e4e9 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] HTTP exception thrown: Instance 7931ea02-ab01-4895-9ff2-265a0f58fe67 could not be found. Sep 08 10:59:28.322131 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-852af1fa-ebc1-49cd-8e9f-68cc9730e4e9 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Request method failure captured: Sep 08 10:59:28.322131 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/7931ea02-ab01-4895-9ff2-265a0f58fe67 HTTP/1.1 Sep 08 10:59:28.322131 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 10:59:28.322131 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 10:59:28.322131 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 10:59:28.322131 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 10:59:28.322131 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 10:59:28.322131 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 10:59:28.322131 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 10:59:28.322131 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 10:59:28.322131 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcrcVdMg9S7tZRTqL7bDdz9i1kj7VzWegdw8mSVFrv6G-CHHrkYUBxSWD-HRsUQpmpJ5CBV8licgrL486WPziGCUCcTFTucXmQdp9NGa_v88TBSJiqO3rGqDud8GM2bIUxMXr4Tu4wNWlNJFERSNqdiz3LE8GSD3HNbvxbZ23g1e9M0 Sep 08 10:59:28.322131 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 10:59:28.322131 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 10:59:28.322131 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 10:59:28.322131 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 10:59:28.322131 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 10:59:28.322131 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 10:59:28.322131 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: c8a85de2674b413cb72fe0de96eec7cc Sep 08 10:59:28.322131 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ListServersNegativeTestJSON-2023907786 Sep 08 10:59:28.322131 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 10:59:28.322131 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 10:59:28.322131 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c8a85de2674b413cb72fe0de96eec7cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c8a85de2674b413cb72fe0de96eec7cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c8a85de2674b413cb72fe0de96eec7cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c8a85de2674b413cb72fe0de96eec7cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 10:59:28.322131 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ListServersNegativeTestJSON-2023907786 Sep 08 10:59:28.322131 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: c8a85de2674b413cb72fe0de96eec7cc Sep 08 10:59:28.322131 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-2023907786 Sep 08 10:59:28.322131 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ListServersNegativeTestJSON-2023907786-project Sep 08 10:59:28.322131 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 10:59:28.322131 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 10:59:28.322131 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: e1fe29b5496a4169b0588b7b18d75537 Sep 08 10:59:28.322131 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ListServersNegativeTestJSON-2023907786-project Sep 08 10:59:28.322131 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 10:59:28.322131 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 7931ea02-ab01-4895-9ff2-265a0f58fe67 could not be found. Sep 08 10:59:28.322131 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '7931ea02-ab01-4895-9ff2-265a0f58fe67'} Sep 08 10:59:28.322131 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:59:28.322131 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:59:28.322131 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:59:28.322131 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:59:28.322131 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:59:28.322131 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:59:28.322131 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:59:28.322131 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:59:28.322131 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:59:28.322131 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:59:28.322131 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7931ea02-ab01-4895-9ff2-265a0f58fe67 could not be found. Sep 08 10:59:28.322131 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:59:28.322131 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:59:28.322131 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:59:28.322131 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:59:28.322131 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:59:28.322131 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:59:28.322131 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:59:28.322131 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:59:28.322131 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:59:28.322131 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:59:28.322131 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:59:28.322131 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:59:28.322131 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:59:28.322131 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:59:28.322131 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:59:28.322131 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:59:28.322131 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7931ea02-ab01-4895-9ff2-265a0f58fe67 could not be found. Sep 08 10:59:28.322131 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:59:28.322131 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:59:28.327609 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:59:28.327609 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:59:28.327609 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:59:28.327609 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:59:28.327609 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:59:28.327609 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:59:28.327609 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7931ea02-ab01-4895-9ff2-265a0f58fe67 could not be found. Sep 08 10:59:28.327609 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 10:59:28.330173 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-852af1fa-ebc1-49cd-8e9f-68cc9730e4e9 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] Returning 404 to user: Instance 7931ea02-ab01-4895-9ff2-265a0f58fe67 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:59:28.332130 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-852af1fa-ebc1-49cd-8e9f-68cc9730e4e9 tempest-ListServersNegativeTestJSON-2023907786 tempest-ListServersNegativeTestJSON-2023907786-project] 10.222.0.27 "GET /compute/v2.1/servers/7931ea02-ab01-4895-9ff2-265a0f58fe67" status: 404 len: 111 microversion: 2.1 time: 0.103195 Sep 08 10:59:28.332943 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2345/4608] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:28 2022] GET /compute/v2.1/servers/7931ea02-ab01-4895-9ff2-265a0f58fe67 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 10:59:28.955983 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-47efcbeb-069b-4d30-81de-36acfcfb27b7 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:59:28.965992 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-47efcbeb-069b-4d30-81de-36acfcfb27b7 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:59:28.966601 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-47efcbeb-069b-4d30-81de-36acfcfb27b7 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:59:28.968578 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ae35cc16-6320-468b-8924-beac0584a9c2 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:28.970641 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-47efcbeb-069b-4d30-81de-36acfcfb27b7 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:59:28.972199 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-47efcbeb-069b-4d30-81de-36acfcfb27b7 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:59:28.973391 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ae35cc16-6320-468b-8924-beac0584a9c2 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:28.991965 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ae35cc16-6320-468b-8924-beac0584a9c2 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:28.999046 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ae35cc16-6320-468b-8924-beac0584a9c2 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:28.999558 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ae35cc16-6320-468b-8924-beac0584a9c2 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:29.000322 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ae35cc16-6320-468b-8924-beac0584a9c2 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:29.003956 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-47efcbeb-069b-4d30-81de-36acfcfb27b7 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:29.004839 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ae35cc16-6320-468b-8924-beac0584a9c2 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:29.005758 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ae35cc16-6320-468b-8924-beac0584a9c2 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:29.012495 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-47efcbeb-069b-4d30-81de-36acfcfb27b7 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:29.013214 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-47efcbeb-069b-4d30-81de-36acfcfb27b7 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:29.014239 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-47efcbeb-069b-4d30-81de-36acfcfb27b7 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:29.015888 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-47efcbeb-069b-4d30-81de-36acfcfb27b7 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:29.020135 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-47efcbeb-069b-4d30-81de-36acfcfb27b7 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:29.097272 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-47efcbeb-069b-4d30-81de-36acfcfb27b7 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Getting quotas for project 11b5d4706b2d43aca8290ccf07ee1ece. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:59:29.110431 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:59:29.111786 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-47efcbeb-069b-4d30-81de-36acfcfb27b7 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Getting quotas for user d68b017335c84d15becbdc7615498103 and project 11b5d4706b2d43aca8290ccf07ee1ece. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:59:29.152769 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-47efcbeb-069b-4d30-81de-36acfcfb27b7 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:59:29.155076 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-47efcbeb-069b-4d30-81de-36acfcfb27b7 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 280de799-ddfb-4ced-a4b4-758807cb1279] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:59:29.287404 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-47efcbeb-069b-4d30-81de-36acfcfb27b7 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.576480 Sep 08 10:59:29.288403 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2264/4609] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:59:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:59:29.300259 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7309d736-0b69-443e-a87d-036b33207a89 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:29.300960 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7309d736-0b69-443e-a87d-036b33207a89 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 280de799-ddfb-4ced-a4b4-758807cb1279] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:29.417172 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7309d736-0b69-443e-a87d-036b33207a89 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:29.427386 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7309d736-0b69-443e-a87d-036b33207a89 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/280de799-ddfb-4ced-a4b4-758807cb1279" status: 200 len: 1214 microversion: 2.1 time: 0.129852 Sep 08 10:59:29.428005 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2265/4610] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:29 2022] GET /compute/v2.1/servers/280de799-ddfb-4ced-a4b4-758807cb1279 => generated 1214 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:59:29.801252 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ae35cc16-6320-468b-8924-beac0584a9c2 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:29.810835 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ae35cc16-6320-468b-8924-beac0584a9c2 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8" status: 200 len: 1507 microversion: 2.1 time: 0.850655 Sep 08 10:59:29.817561 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2346/4611] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:28 2022] GET /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8 => generated 1507 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:29.844597 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-606d54c2-50de-4dec-8fb0-a4074134c1ee tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:29.845506 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-606d54c2-50de-4dec-8fb0-a4074134c1ee tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:29.865927 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-606d54c2-50de-4dec-8fb0-a4074134c1ee tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:29.866442 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-606d54c2-50de-4dec-8fb0-a4074134c1ee tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:29.866883 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-606d54c2-50de-4dec-8fb0-a4074134c1ee tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:29.872436 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-606d54c2-50de-4dec-8fb0-a4074134c1ee tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:29.872932 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-606d54c2-50de-4dec-8fb0-a4074134c1ee tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:29.873595 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-606d54c2-50de-4dec-8fb0-a4074134c1ee tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:30.183705 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-606d54c2-50de-4dec-8fb0-a4074134c1ee tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:30.202406 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-606d54c2-50de-4dec-8fb0-a4074134c1ee tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8" status: 200 len: 1507 microversion: 2.1 time: 0.361377 Sep 08 10:59:30.203731 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2266/4612] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:29 2022] GET /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8 => generated 1507 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:30.230817 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5c0f4c21-2e46-4832-bfc4-0d58611fb099 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:59:30.234156 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5c0f4c21-2e46-4832-bfc4-0d58611fb099 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:30.247839 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c0f4c21-2e46-4832-bfc4-0d58611fb099 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:30.249293 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c0f4c21-2e46-4832-bfc4-0d58611fb099 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:30.250020 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c0f4c21-2e46-4832-bfc4-0d58611fb099 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:30.251434 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c0f4c21-2e46-4832-bfc4-0d58611fb099 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:30.252661 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c0f4c21-2e46-4832-bfc4-0d58611fb099 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:30.253531 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c0f4c21-2e46-4832-bfc4-0d58611fb099 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:30.350194 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:59:30.364720 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5c0f4c21-2e46-4832-bfc4-0d58611fb099 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "PUT /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8" status: 200 len: 1079 microversion: 2.1 time: 0.139761 Sep 08 10:59:30.366048 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2267/4613] 10.222.0.27 () {60 vars in 1256 bytes} [Thu Sep 8 10:59:30 2022] PUT /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8 => generated 1079 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:30.386109 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-83152ed5-8301-457e-b764-4c9c61257da0 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:30.388497 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-83152ed5-8301-457e-b764-4c9c61257da0 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:30.412935 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c8449285-2e80-430d-bf3d-334c827c23e8 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1544174869", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": "none"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:59:30.422786 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-83152ed5-8301-457e-b764-4c9c61257da0 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:30.426243 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-83152ed5-8301-457e-b764-4c9c61257da0 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:30.429232 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-83152ed5-8301-457e-b764-4c9c61257da0 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:30.431489 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-83152ed5-8301-457e-b764-4c9c61257da0 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:30.432765 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-83152ed5-8301-457e-b764-4c9c61257da0 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:30.434694 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-83152ed5-8301-457e-b764-4c9c61257da0 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:30.543845 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-c8449285-2e80-430d-bf3d-334c827c23e8 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:59:30.543845 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-c8449285-2e80-430d-bf3d-334c827c23e8 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:59:30.543845 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-c8449285-2e80-430d-bf3d-334c827c23e8 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:59:30.544373 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-c8449285-2e80-430d-bf3d-334c827c23e8 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:59:30.544986 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-c8449285-2e80-430d-bf3d-334c827c23e8 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:59:30.590293 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c8449285-2e80-430d-bf3d-334c827c23e8 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:30.591487 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c8449285-2e80-430d-bf3d-334c827c23e8 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:30.592704 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c8449285-2e80-430d-bf3d-334c827c23e8 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:30.594559 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c8449285-2e80-430d-bf3d-334c827c23e8 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:30.596222 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c8449285-2e80-430d-bf3d-334c827c23e8 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:30.596866 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c8449285-2e80-430d-bf3d-334c827c23e8 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:30.622080 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-c8449285-2e80-430d-bf3d-334c827c23e8 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Getting quotas for project 439ad18bf93e4b8aabbf49377b39a018. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:59:30.637077 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-c8449285-2e80-430d-bf3d-334c827c23e8 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Getting quotas for user 84737bb9727d429fa322c7b311154ffe and project 439ad18bf93e4b8aabbf49377b39a018. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:59:30.686868 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c8449285-2e80-430d-bf3d-334c827c23e8 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:59:30.689830 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c8449285-2e80-430d-bf3d-334c827c23e8 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] [instance: 56dd4f3a-f9c7-4ec6-8be1-8e200e1a1f4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:59:30.789553 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c8449285-2e80-430d-bf3d-334c827c23e8 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.662585 Sep 08 10:59:30.790236 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2347/4614] 10.222.0.27 () {62 vars in 1188 bytes} [Thu Sep 8 10:59:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 665 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 08 10:59:30.800042 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-13ac0ba1-bfec-4cdb-afef-699f26b18e07 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:30.800659 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-13ac0ba1-bfec-4cdb-afef-699f26b18e07 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 280de799-ddfb-4ced-a4b4-758807cb1279] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:30.824178 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-13ac0ba1-bfec-4cdb-afef-699f26b18e07 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:30.827273 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-13ac0ba1-bfec-4cdb-afef-699f26b18e07 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:30.827741 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-13ac0ba1-bfec-4cdb-afef-699f26b18e07 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:30.832516 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-13ac0ba1-bfec-4cdb-afef-699f26b18e07 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:30.833895 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-13ac0ba1-bfec-4cdb-afef-699f26b18e07 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:30.834772 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-13ac0ba1-bfec-4cdb-afef-699f26b18e07 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:30.981957 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-13ac0ba1-bfec-4cdb-afef-699f26b18e07 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:30.999465 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-13ac0ba1-bfec-4cdb-afef-699f26b18e07 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/280de799-ddfb-4ced-a4b4-758807cb1279" status: 200 len: 1266 microversion: 2.1 time: 0.197393 Sep 08 10:59:31.000440 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2348/4615] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:30 2022] GET /compute/v2.1/servers/280de799-ddfb-4ced-a4b4-758807cb1279 => generated 1266 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:31.010637 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8d92cd39-c910-47c4-a95e-0975d8978107 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:31.011266 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8d92cd39-c910-47c4-a95e-0975d8978107 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] [instance: 56dd4f3a-f9c7-4ec6-8be1-8e200e1a1f4d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:31.092607 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-83152ed5-8301-457e-b764-4c9c61257da0 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:31.110576 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-83152ed5-8301-457e-b764-4c9c61257da0 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8" status: 200 len: 1505 microversion: 2.1 time: 0.729181 Sep 08 10:59:31.117067 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2268/4616] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:30 2022] GET /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8 => generated 1505 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:59:31.143579 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-73853d51-ee25-426d-ba2c-8e8061b5d107 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:31.144548 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-73853d51-ee25-426d-ba2c-8e8061b5d107 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:31.151719 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-73853d51-ee25-426d-ba2c-8e8061b5d107 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:31.152731 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-73853d51-ee25-426d-ba2c-8e8061b5d107 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:31.153493 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-73853d51-ee25-426d-ba2c-8e8061b5d107 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:31.154594 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-73853d51-ee25-426d-ba2c-8e8061b5d107 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:31.155725 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-73853d51-ee25-426d-ba2c-8e8061b5d107 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:31.156325 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-73853d51-ee25-426d-ba2c-8e8061b5d107 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:31.264322 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8d92cd39-c910-47c4-a95e-0975d8978107 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:31.290727 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8d92cd39-c910-47c4-a95e-0975d8978107 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:31.297280 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8d92cd39-c910-47c4-a95e-0975d8978107 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:31.302351 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8d92cd39-c910-47c4-a95e-0975d8978107 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] 10.222.0.27 "GET /compute/v2.1/servers/56dd4f3a-f9c7-4ec6-8be1-8e200e1a1f4d" status: 200 len: 1278 microversion: 2.47 time: 0.300871 Sep 08 10:59:31.305369 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2349/4617] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:59:31 2022] GET /compute/v2.1/servers/56dd4f3a-f9c7-4ec6-8be1-8e200e1a1f4d => generated 1278 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:59:31.612703 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-93cde94f-e788-4457-8fcd-dac96792c73c tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1143011993", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": "none"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:59:31.641768 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-73853d51-ee25-426d-ba2c-8e8061b5d107 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:31.656773 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-73853d51-ee25-426d-ba2c-8e8061b5d107 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8" status: 200 len: 1505 microversion: 2.1 time: 0.519474 Sep 08 10:59:31.657616 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2269/4618] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:31 2022] GET /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8 => generated 1505 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:59:31.687891 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2a3dc11a-48d9-41bd-a676-54dc10292b92 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:59:31.694042 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2a3dc11a-48d9-41bd-a676-54dc10292b92 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:31.712784 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2a3dc11a-48d9-41bd-a676-54dc10292b92 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:31.716350 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2a3dc11a-48d9-41bd-a676-54dc10292b92 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:31.716858 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2a3dc11a-48d9-41bd-a676-54dc10292b92 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:31.729250 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2a3dc11a-48d9-41bd-a676-54dc10292b92 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:31.729857 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2a3dc11a-48d9-41bd-a676-54dc10292b92 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:31.730483 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2a3dc11a-48d9-41bd-a676-54dc10292b92 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:31.735096 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-93cde94f-e788-4457-8fcd-dac96792c73c tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:59:31.735474 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-93cde94f-e788-4457-8fcd-dac96792c73c tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:59:31.735963 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-93cde94f-e788-4457-8fcd-dac96792c73c tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:59:31.737261 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-93cde94f-e788-4457-8fcd-dac96792c73c tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:59:31.738009 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-93cde94f-e788-4457-8fcd-dac96792c73c tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:59:31.761387 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-93cde94f-e788-4457-8fcd-dac96792c73c tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:31.764480 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-93cde94f-e788-4457-8fcd-dac96792c73c tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:31.767502 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-93cde94f-e788-4457-8fcd-dac96792c73c tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:31.769156 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-93cde94f-e788-4457-8fcd-dac96792c73c tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:31.771335 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-93cde94f-e788-4457-8fcd-dac96792c73c tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:31.771768 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-93cde94f-e788-4457-8fcd-dac96792c73c tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:31.824119 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-93cde94f-e788-4457-8fcd-dac96792c73c tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Getting quotas for project 439ad18bf93e4b8aabbf49377b39a018. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:59:31.847921 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-93cde94f-e788-4457-8fcd-dac96792c73c tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Getting quotas for user 84737bb9727d429fa322c7b311154ffe and project 439ad18bf93e4b8aabbf49377b39a018. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:59:31.872293 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-93cde94f-e788-4457-8fcd-dac96792c73c tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:59:31.874943 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-93cde94f-e788-4457-8fcd-dac96792c73c tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] [instance: e2a29434-ee7b-466c-baaf-945c7918d31c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:59:31.958441 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-2a3dc11a-48d9-41bd-a676-54dc10292b92 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:59:31.958865 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-2a3dc11a-48d9-41bd-a676-54dc10292b92 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:59:31.960493 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-93cde94f-e788-4457-8fcd-dac96792c73c tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.352884 Sep 08 10:59:31.962354 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2350/4619] 10.222.0.27 () {62 vars in 1188 bytes} [Thu Sep 8 10:59:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 356 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 08 10:59:31.968731 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-2a3dc11a-48d9-41bd-a676-54dc10292b92 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:59:31.969117 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-2a3dc11a-48d9-41bd-a676-54dc10292b92 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:59:31.969552 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-2a3dc11a-48d9-41bd-a676-54dc10292b92 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:59:31.983988 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0090f2dd-7a96-4279-b23a-0442368781c6 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:59:31.989949 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0090f2dd-7a96-4279-b23a-0442368781c6 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] [instance: e2a29434-ee7b-466c-baaf-945c7918d31c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:32.072227 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0090f2dd-7a96-4279-b23a-0442368781c6 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] 10.222.0.27 "PUT /compute/v2.1/servers/e2a29434-ee7b-466c-baaf-945c7918d31c" status: 200 len: 992 microversion: 2.47 time: 0.100776 Sep 08 10:59:32.073655 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2351/4620] 10.222.0.27 () {62 vars in 1297 bytes} [Thu Sep 8 10:59:31 2022] PUT /compute/v2.1/servers/e2a29434-ee7b-466c-baaf-945c7918d31c => generated 992 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:59:32.094155 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1746e96a-6fc1-4bac-a7d6-baaeb47f3c51 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:32.095028 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1746e96a-6fc1-4bac-a7d6-baaeb47f3c51 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 280de799-ddfb-4ced-a4b4-758807cb1279] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:32.112266 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1746e96a-6fc1-4bac-a7d6-baaeb47f3c51 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:32.112900 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1746e96a-6fc1-4bac-a7d6-baaeb47f3c51 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:32.115549 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1746e96a-6fc1-4bac-a7d6-baaeb47f3c51 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:32.117230 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1746e96a-6fc1-4bac-a7d6-baaeb47f3c51 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:32.118958 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1746e96a-6fc1-4bac-a7d6-baaeb47f3c51 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:32.119675 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1746e96a-6fc1-4bac-a7d6-baaeb47f3c51 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:32.141540 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2a3dc11a-48d9-41bd-a676-54dc10292b92 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:32.152924 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2a3dc11a-48d9-41bd-a676-54dc10292b92 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:32.153924 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2a3dc11a-48d9-41bd-a676-54dc10292b92 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:32.154588 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2a3dc11a-48d9-41bd-a676-54dc10292b92 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:32.155736 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2a3dc11a-48d9-41bd-a676-54dc10292b92 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:32.156995 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2a3dc11a-48d9-41bd-a676-54dc10292b92 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:32.157755 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2a3dc11a-48d9-41bd-a676-54dc10292b92 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:32.200806 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2a3dc11a-48d9-41bd-a676-54dc10292b92 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "POST /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8/action" status: 202 len: 1111 microversion: 2.1 time: 0.518354 Sep 08 10:59:32.203275 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2270/4621] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:59:31 2022] POST /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8/action => generated 1111 bytes in 522 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 08 10:59:32.213389 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-455bb0d4-3415-40c4-9488-5a9ed0f560d4 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:32.217203 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-455bb0d4-3415-40c4-9488-5a9ed0f560d4 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] [instance: e2a29434-ee7b-466c-baaf-945c7918d31c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:32.331274 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-455bb0d4-3415-40c4-9488-5a9ed0f560d4 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:32.342686 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-455bb0d4-3415-40c4-9488-5a9ed0f560d4 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:32.344151 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-455bb0d4-3415-40c4-9488-5a9ed0f560d4 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:32.345333 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-455bb0d4-3415-40c4-9488-5a9ed0f560d4 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] 10.222.0.27 "GET /compute/v2.1/servers/e2a29434-ee7b-466c-baaf-945c7918d31c" status: 200 len: 1278 microversion: 2.47 time: 0.140802 Sep 08 10:59:32.362260 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2271/4622] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:59:32 2022] GET /compute/v2.1/servers/e2a29434-ee7b-466c-baaf-945c7918d31c => generated 1278 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:59:32.381628 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cf4e9864-eb27-447e-8462-549dd00b0ba1 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:32.382638 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cf4e9864-eb27-447e-8462-549dd00b0ba1 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:32.392234 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cf4e9864-eb27-447e-8462-549dd00b0ba1 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:32.393574 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cf4e9864-eb27-447e-8462-549dd00b0ba1 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:32.394081 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cf4e9864-eb27-447e-8462-549dd00b0ba1 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:32.394992 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cf4e9864-eb27-447e-8462-549dd00b0ba1 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:32.395469 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cf4e9864-eb27-447e-8462-549dd00b0ba1 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:32.395902 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cf4e9864-eb27-447e-8462-549dd00b0ba1 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:32.496705 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1746e96a-6fc1-4bac-a7d6-baaeb47f3c51 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:32.514136 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1746e96a-6fc1-4bac-a7d6-baaeb47f3c51 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/280de799-ddfb-4ced-a4b4-758807cb1279" status: 200 len: 1272 microversion: 2.1 time: 0.435433 Sep 08 10:59:32.515048 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2352/4623] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:32 2022] GET /compute/v2.1/servers/280de799-ddfb-4ced-a4b4-758807cb1279 => generated 1272 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:32.531066 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b1978f6d-bed8-44b5-b7e0-326471a9e3b7 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-143920928", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "428afae0-4349-40fc-b84a-4b6fc877a62a"}, {"port": "5ccca1c6-6f4a-4fcf-9598-50a337d556cc", "tag": "port-1"}, {"port": "ecb96651-93e7-41bd-9408-8b3399bfaef2", "tag": "port-2"}, {"uuid": "a1323ab8-5d2f-43e0-bf80-2365f3659f5e", "tag": "net-1"}, {"uuid": "a1323ab8-5d2f-43e0-bf80-2365f3659f5e"}, {"uuid": "f06a2f17-02ad-4290-a103-22b2e384c3a9", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "f06a2f17-02ad-4290-a103-22b2e384c3a9", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "b15672e0-8ab2-4606-985e-71fdcc2939d5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "12fece83-5c19-4d98-a322-721a705a3e52", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "2a87762b-df39-4014-95bb-8005567bb1c0", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--347053253"}], "key_name": "tempest-keypair-1848326281", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:59:32.915386 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-b1978f6d-bed8-44b5-b7e0-326471a9e3b7 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] validate_networks() for [('428afae0-4349-40fc-b84a-4b6fc877a62a', None, None, None, None, None), (None, None, '5ccca1c6-6f4a-4fcf-9598-50a337d556cc', None, None, None), (None, None, 'ecb96651-93e7-41bd-9408-8b3399bfaef2', None, None, None), ('a1323ab8-5d2f-43e0-bf80-2365f3659f5e', None, None, None, None, None), ('a1323ab8-5d2f-43e0-bf80-2365f3659f5e', None, None, None, None, None), ('f06a2f17-02ad-4290-a103-22b2e384c3a9', '10.2.2.100', None, None, None, None), ('f06a2f17-02ad-4290-a103-22b2e384c3a9', '10.2.2.200', None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:59:33.241152 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cf4e9864-eb27-447e-8462-549dd00b0ba1 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:33.252183 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cf4e9864-eb27-447e-8462-549dd00b0ba1 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8" status: 200 len: 1516 microversion: 2.1 time: 0.887296 Sep 08 10:59:33.253603 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2272/4624] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:32 2022] GET /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8 => generated 1516 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:33.381869 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4d4e9d0b-47b1-46df-8c78-24746d73f1ce tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:33.383047 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4d4e9d0b-47b1-46df-8c78-24746d73f1ce tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] [instance: e2a29434-ee7b-466c-baaf-945c7918d31c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:33.392741 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d4e9d0b-47b1-46df-8c78-24746d73f1ce tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:33.393689 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d4e9d0b-47b1-46df-8c78-24746d73f1ce tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:33.394383 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d4e9d0b-47b1-46df-8c78-24746d73f1ce tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:33.395642 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d4e9d0b-47b1-46df-8c78-24746d73f1ce tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:33.396418 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d4e9d0b-47b1-46df-8c78-24746d73f1ce tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:33.397120 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d4e9d0b-47b1-46df-8c78-24746d73f1ce tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:33.599112 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4d4e9d0b-47b1-46df-8c78-24746d73f1ce tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:33.632855 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4d4e9d0b-47b1-46df-8c78-24746d73f1ce tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:33.634680 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4d4e9d0b-47b1-46df-8c78-24746d73f1ce tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:33.638388 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4d4e9d0b-47b1-46df-8c78-24746d73f1ce tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] 10.222.0.27 "GET /compute/v2.1/servers/e2a29434-ee7b-466c-baaf-945c7918d31c" status: 200 len: 1330 microversion: 2.47 time: 0.262369 Sep 08 10:59:33.639280 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2273/4625] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:59:33 2022] GET /compute/v2.1/servers/e2a29434-ee7b-466c-baaf-945c7918d31c => generated 1330 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:59:33.652934 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e31e7c0c-b0f6-4e8c-99e7-27496c92078a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:33.653815 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e31e7c0c-b0f6-4e8c-99e7-27496c92078a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 280de799-ddfb-4ced-a4b4-758807cb1279] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:33.665444 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e31e7c0c-b0f6-4e8c-99e7-27496c92078a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:33.668913 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e31e7c0c-b0f6-4e8c-99e7-27496c92078a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:33.669708 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e31e7c0c-b0f6-4e8c-99e7-27496c92078a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:33.670674 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e31e7c0c-b0f6-4e8c-99e7-27496c92078a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:33.681301 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e31e7c0c-b0f6-4e8c-99e7-27496c92078a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:33.682071 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e31e7c0c-b0f6-4e8c-99e7-27496c92078a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:33.828282 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e31e7c0c-b0f6-4e8c-99e7-27496c92078a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:33.843824 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e31e7c0c-b0f6-4e8c-99e7-27496c92078a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/280de799-ddfb-4ced-a4b4-758807cb1279" status: 200 len: 1272 microversion: 2.1 time: 0.202907 Sep 08 10:59:33.845438 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2274/4626] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:33 2022] GET /compute/v2.1/servers/280de799-ddfb-4ced-a4b4-758807cb1279 => generated 1272 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:34.289621 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-057076cd-f32f-4f1f-ad8a-2016bf7c5a38 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:34.291675 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-057076cd-f32f-4f1f-ad8a-2016bf7c5a38 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:34.343409 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-057076cd-f32f-4f1f-ad8a-2016bf7c5a38 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:34.343979 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-057076cd-f32f-4f1f-ad8a-2016bf7c5a38 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:34.344426 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-057076cd-f32f-4f1f-ad8a-2016bf7c5a38 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:34.349185 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-057076cd-f32f-4f1f-ad8a-2016bf7c5a38 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:34.349682 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-057076cd-f32f-4f1f-ad8a-2016bf7c5a38 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:34.351525 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-057076cd-f32f-4f1f-ad8a-2016bf7c5a38 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:35.519879 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-057076cd-f32f-4f1f-ad8a-2016bf7c5a38 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:35.530512 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-057076cd-f32f-4f1f-ad8a-2016bf7c5a38 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8" status: 200 len: 1516 microversion: 2.1 time: 1.251100 Sep 08 10:59:35.531544 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2275/4627] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:34 2022] GET /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8 => generated 1516 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:35.554697 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-df24ad3d-88aa-4ba7-a253-8bcc5058cdc0 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:35.557589 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-df24ad3d-88aa-4ba7-a253-8bcc5058cdc0 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] [instance: e2a29434-ee7b-466c-baaf-945c7918d31c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:35.566067 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df24ad3d-88aa-4ba7-a253-8bcc5058cdc0 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:35.567270 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df24ad3d-88aa-4ba7-a253-8bcc5058cdc0 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:35.568229 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df24ad3d-88aa-4ba7-a253-8bcc5058cdc0 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:35.569248 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df24ad3d-88aa-4ba7-a253-8bcc5058cdc0 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:35.570308 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df24ad3d-88aa-4ba7-a253-8bcc5058cdc0 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:35.570970 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df24ad3d-88aa-4ba7-a253-8bcc5058cdc0 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:35.748668 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-df24ad3d-88aa-4ba7-a253-8bcc5058cdc0 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:35.760194 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-df24ad3d-88aa-4ba7-a253-8bcc5058cdc0 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:35.762906 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-df24ad3d-88aa-4ba7-a253-8bcc5058cdc0 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:35.766258 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-df24ad3d-88aa-4ba7-a253-8bcc5058cdc0 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] 10.222.0.27 "GET /compute/v2.1/servers/e2a29434-ee7b-466c-baaf-945c7918d31c" status: 200 len: 1348 microversion: 2.47 time: 0.231541 Sep 08 10:59:35.767571 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2276/4628] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:59:35 2022] GET /compute/v2.1/servers/e2a29434-ee7b-466c-baaf-945c7918d31c => generated 1348 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:59:35.774105 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7957ba80-5cf2-4d4b-a1d3-ae687b14823d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:35.775578 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7957ba80-5cf2-4d4b-a1d3-ae687b14823d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 280de799-ddfb-4ced-a4b4-758807cb1279] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:35.786681 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7957ba80-5cf2-4d4b-a1d3-ae687b14823d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:35.787881 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7957ba80-5cf2-4d4b-a1d3-ae687b14823d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:35.788889 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7957ba80-5cf2-4d4b-a1d3-ae687b14823d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:35.790745 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7957ba80-5cf2-4d4b-a1d3-ae687b14823d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:35.791723 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7957ba80-5cf2-4d4b-a1d3-ae687b14823d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:35.792684 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7957ba80-5cf2-4d4b-a1d3-ae687b14823d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:36.290160 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7957ba80-5cf2-4d4b-a1d3-ae687b14823d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:36.298546 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7957ba80-5cf2-4d4b-a1d3-ae687b14823d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/280de799-ddfb-4ced-a4b4-758807cb1279" status: 200 len: 1314 microversion: 2.1 time: 0.529601 Sep 08 10:59:36.299549 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2277/4629] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:35 2022] GET /compute/v2.1/servers/280de799-ddfb-4ced-a4b4-758807cb1279 => generated 1314 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:36.560352 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8a902850-7428-4905-bb85-45364c9988f5 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:36.560895 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8a902850-7428-4905-bb85-45364c9988f5 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:36.569965 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8a902850-7428-4905-bb85-45364c9988f5 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:36.571479 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8a902850-7428-4905-bb85-45364c9988f5 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:36.572153 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8a902850-7428-4905-bb85-45364c9988f5 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:36.573277 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8a902850-7428-4905-bb85-45364c9988f5 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:36.574714 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8a902850-7428-4905-bb85-45364c9988f5 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:36.576066 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8a902850-7428-4905-bb85-45364c9988f5 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:36.975433 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8a902850-7428-4905-bb85-45364c9988f5 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:36.987635 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8a902850-7428-4905-bb85-45364c9988f5 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8" status: 200 len: 1516 microversion: 2.1 time: 0.434625 Sep 08 10:59:36.989233 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2278/4630] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:36 2022] GET /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8 => generated 1516 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:36.995906 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-9e999719-b098-4240-974b-31dd5c50a09b req-a6cc3602-117f-4d65-9fd3-9193adcf539f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "280de799-ddfb-4ced-a4b4-758807cb1279", "tag": "c70fa2a6-ca73-4956-b002-02ae3374520a"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:59:37.006322 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-9e999719-b098-4240-974b-31dd5c50a09b req-a6cc3602-117f-4d65-9fd3-9193adcf539f service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:37.007243 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-9e999719-b098-4240-974b-31dd5c50a09b req-a6cc3602-117f-4d65-9fd3-9193adcf539f service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:37.008038 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-9e999719-b098-4240-974b-31dd5c50a09b req-a6cc3602-117f-4d65-9fd3-9193adcf539f service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:37.021946 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-9e999719-b098-4240-974b-31dd5c50a09b req-a6cc3602-117f-4d65-9fd3-9193adcf539f service nova] Creating event network-changed:c70fa2a6-ca73-4956-b002-02ae3374520a for instance 280de799-ddfb-4ced-a4b4-758807cb1279 on n-h1-850501-12 Sep 08 10:59:37.028545 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-9e999719-b098-4240-974b-31dd5c50a09b req-a6cc3602-117f-4d65-9fd3-9193adcf539f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037852 Sep 08 10:59:37.029774 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2279/4631] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:59:37.039938 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ed5fc557-05a0-48f0-a642-22b8ae8b1059 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:37.040892 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ed5fc557-05a0-48f0-a642-22b8ae8b1059 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] [instance: e2a29434-ee7b-466c-baaf-945c7918d31c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:37.050866 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ed5fc557-05a0-48f0-a642-22b8ae8b1059 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:37.051703 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ed5fc557-05a0-48f0-a642-22b8ae8b1059 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:37.052425 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ed5fc557-05a0-48f0-a642-22b8ae8b1059 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:37.053191 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ed5fc557-05a0-48f0-a642-22b8ae8b1059 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:37.053658 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ed5fc557-05a0-48f0-a642-22b8ae8b1059 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:37.054090 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ed5fc557-05a0-48f0-a642-22b8ae8b1059 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:37.264483 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ed5fc557-05a0-48f0-a642-22b8ae8b1059 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:37.302271 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ed5fc557-05a0-48f0-a642-22b8ae8b1059 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:37.307598 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ed5fc557-05a0-48f0-a642-22b8ae8b1059 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:37.312057 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ed5fc557-05a0-48f0-a642-22b8ae8b1059 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] 10.222.0.27 "GET /compute/v2.1/servers/e2a29434-ee7b-466c-baaf-945c7918d31c" status: 200 len: 1336 microversion: 2.47 time: 0.280122 Sep 08 10:59:37.315467 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2280/4632] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:59:37 2022] GET /compute/v2.1/servers/e2a29434-ee7b-466c-baaf-945c7918d31c => generated 1336 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:59:37.359600 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3499b212-9204-4239-aa4e-ead50686e144 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:37.363433 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3499b212-9204-4239-aa4e-ead50686e144 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 280de799-ddfb-4ced-a4b4-758807cb1279] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:37.383702 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3499b212-9204-4239-aa4e-ead50686e144 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:37.384224 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3499b212-9204-4239-aa4e-ead50686e144 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:37.384668 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3499b212-9204-4239-aa4e-ead50686e144 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:37.385438 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3499b212-9204-4239-aa4e-ead50686e144 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:37.385893 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3499b212-9204-4239-aa4e-ead50686e144 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:37.386334 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3499b212-9204-4239-aa4e-ead50686e144 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:37.793385 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3499b212-9204-4239-aa4e-ead50686e144 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:37.816743 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3499b212-9204-4239-aa4e-ead50686e144 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/280de799-ddfb-4ced-a4b4-758807cb1279" status: 200 len: 1314 microversion: 2.1 time: 0.473595 Sep 08 10:59:37.820117 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2281/4633] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:37 2022] GET /compute/v2.1/servers/280de799-ddfb-4ced-a4b4-758807cb1279 => generated 1314 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:38.016151 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fc8d39cf-5181-4c32-8db3-ae778654282f tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:38.016788 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fc8d39cf-5181-4c32-8db3-ae778654282f tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:38.026409 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fc8d39cf-5181-4c32-8db3-ae778654282f tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:38.026913 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fc8d39cf-5181-4c32-8db3-ae778654282f tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:38.027354 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fc8d39cf-5181-4c32-8db3-ae778654282f tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:38.033257 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fc8d39cf-5181-4c32-8db3-ae778654282f tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:38.033877 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fc8d39cf-5181-4c32-8db3-ae778654282f tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:38.034316 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fc8d39cf-5181-4c32-8db3-ae778654282f tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:38.471037 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fc8d39cf-5181-4c32-8db3-ae778654282f tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:38.482040 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fc8d39cf-5181-4c32-8db3-ae778654282f tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8" status: 200 len: 1516 microversion: 2.1 time: 0.471129 Sep 08 10:59:38.483873 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2282/4634] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:38 2022] GET /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8 => generated 1516 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:59:38.490260 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-043cbb66-79fe-461e-85e2-dc4702df7208 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:38.491329 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-043cbb66-79fe-461e-85e2-dc4702df7208 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] [instance: e2a29434-ee7b-466c-baaf-945c7918d31c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:38.504192 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-043cbb66-79fe-461e-85e2-dc4702df7208 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:38.505273 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-043cbb66-79fe-461e-85e2-dc4702df7208 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:38.506007 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-043cbb66-79fe-461e-85e2-dc4702df7208 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:38.506851 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-043cbb66-79fe-461e-85e2-dc4702df7208 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:38.507445 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-043cbb66-79fe-461e-85e2-dc4702df7208 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:38.507965 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-043cbb66-79fe-461e-85e2-dc4702df7208 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:38.638481 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-043cbb66-79fe-461e-85e2-dc4702df7208 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:38.649887 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-043cbb66-79fe-461e-85e2-dc4702df7208 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:38.654863 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-043cbb66-79fe-461e-85e2-dc4702df7208 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:38.658794 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-043cbb66-79fe-461e-85e2-dc4702df7208 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] 10.222.0.27 "GET /compute/v2.1/servers/e2a29434-ee7b-466c-baaf-945c7918d31c" status: 200 len: 1336 microversion: 2.47 time: 0.173495 Sep 08 10:59:38.660032 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2283/4635] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:59:38 2022] GET /compute/v2.1/servers/e2a29434-ee7b-466c-baaf-945c7918d31c => generated 1336 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:59:38.821057 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-b1978f6d-bed8-44b5-b7e0-326471a9e3b7 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:59:38.823193 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-b1978f6d-bed8-44b5-b7e0-326471a9e3b7 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:59:38.824379 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-b1978f6d-bed8-44b5-b7e0-326471a9e3b7 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:59:38.825327 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-b1978f6d-bed8-44b5-b7e0-326471a9e3b7 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:59:38.826800 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-b1978f6d-bed8-44b5-b7e0-326471a9e3b7 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:59:38.847297 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9c9b4d78-3221-4a4b-aa4b-bddce18df734 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:38.848597 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9c9b4d78-3221-4a4b-aa4b-bddce18df734 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 280de799-ddfb-4ced-a4b4-758807cb1279] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:38.867622 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b1978f6d-bed8-44b5-b7e0-326471a9e3b7 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:38.868179 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b1978f6d-bed8-44b5-b7e0-326471a9e3b7 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:38.868675 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b1978f6d-bed8-44b5-b7e0-326471a9e3b7 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:38.869618 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b1978f6d-bed8-44b5-b7e0-326471a9e3b7 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:38.873240 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9c9b4d78-3221-4a4b-aa4b-bddce18df734 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:38.874262 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9c9b4d78-3221-4a4b-aa4b-bddce18df734 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:38.875030 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9c9b4d78-3221-4a4b-aa4b-bddce18df734 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:38.876897 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b1978f6d-bed8-44b5-b7e0-326471a9e3b7 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:38.878059 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b1978f6d-bed8-44b5-b7e0-326471a9e3b7 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:38.880687 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9c9b4d78-3221-4a4b-aa4b-bddce18df734 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:38.881528 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9c9b4d78-3221-4a4b-aa4b-bddce18df734 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:38.882166 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9c9b4d78-3221-4a4b-aa4b-bddce18df734 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:38.893184 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:59:38.928612 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-b1978f6d-bed8-44b5-b7e0-326471a9e3b7 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Getting quotas for project 1582bf1f51b246c68ec82f173df79a5a. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:59:38.942287 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-b1978f6d-bed8-44b5-b7e0-326471a9e3b7 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Getting quotas for user 9ba7568d44ad47e8b37504ecc8a402ca and project 1582bf1f51b246c68ec82f173df79a5a. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:59:39.054425 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=4 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:59:39.277368 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b1978f6d-bed8-44b5-b7e0-326471a9e3b7 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:59:39.280706 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b1978f6d-bed8-44b5-b7e0-326471a9e3b7 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='b15672e0-8ab2-4606-985e-71fdcc2939d5',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='12fece83-5c19-4d98-a322-721a705a3e52',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2a87762b-df39-4014-95bb-8005567bb1c0',volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:59:40.042549 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b1978f6d-bed8-44b5-b7e0-326471a9e3b7 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 7.526064 Sep 08 10:59:40.043560 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2353/4636] 10.222.0.27 () {62 vars in 1189 bytes} [Thu Sep 8 10:59:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 7528 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 08 10:59:40.049547 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-03ca6e31-4bc2-4c8d-b87f-09d5f75bfdda tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:40.050578 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-03ca6e31-4bc2-4c8d-b87f-09d5f75bfdda tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:40.061300 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-03ca6e31-4bc2-4c8d-b87f-09d5f75bfdda tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:40.062203 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-03ca6e31-4bc2-4c8d-b87f-09d5f75bfdda tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:40.063051 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-03ca6e31-4bc2-4c8d-b87f-09d5f75bfdda tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:40.066413 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-03ca6e31-4bc2-4c8d-b87f-09d5f75bfdda tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:40.067767 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-03ca6e31-4bc2-4c8d-b87f-09d5f75bfdda tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:40.069830 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-03ca6e31-4bc2-4c8d-b87f-09d5f75bfdda tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:40.308665 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-03ca6e31-4bc2-4c8d-b87f-09d5f75bfdda tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:40.326630 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-03ca6e31-4bc2-4c8d-b87f-09d5f75bfdda tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8" status: 200 len: 1516 microversion: 2.1 time: 0.281938 Sep 08 10:59:40.327913 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2354/4637] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:40 2022] GET /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8 => generated 1516 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:40.341460 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-164464eb-d99c-47d8-b705-cd93ec2dd3b9 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:40.343485 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-164464eb-d99c-47d8-b705-cd93ec2dd3b9 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] [instance: e2a29434-ee7b-466c-baaf-945c7918d31c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:40.346783 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:59:40.370484 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-164464eb-d99c-47d8-b705-cd93ec2dd3b9 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:40.371244 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-164464eb-d99c-47d8-b705-cd93ec2dd3b9 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:40.373402 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-164464eb-d99c-47d8-b705-cd93ec2dd3b9 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:40.374308 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-164464eb-d99c-47d8-b705-cd93ec2dd3b9 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:40.382008 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-164464eb-d99c-47d8-b705-cd93ec2dd3b9 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:40.382756 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-164464eb-d99c-47d8-b705-cd93ec2dd3b9 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:40.450954 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9c9b4d78-3221-4a4b-aa4b-bddce18df734 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:40.466336 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9c9b4d78-3221-4a4b-aa4b-bddce18df734 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/280de799-ddfb-4ced-a4b4-758807cb1279" status: 200 len: 1314 microversion: 2.1 time: 1.625538 Sep 08 10:59:40.467968 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2284/4638] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:38 2022] GET /compute/v2.1/servers/280de799-ddfb-4ced-a4b4-758807cb1279 => generated 1314 bytes in 1628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:59:40.475559 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-35ab388c-07b2-4b25-8326-94f4540f5144 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:40.477000 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-35ab388c-07b2-4b25-8326-94f4540f5144 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:40.596450 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-35ab388c-07b2-4b25-8326-94f4540f5144 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:40.625706 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-35ab388c-07b2-4b25-8326-94f4540f5144 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:40.632528 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-35ab388c-07b2-4b25-8326-94f4540f5144 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:40.635404 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-35ab388c-07b2-4b25-8326-94f4540f5144 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1285 microversion: 2.42 time: 0.165876 Sep 08 10:59:40.665541 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2285/4639] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:59:40 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1285 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:59:41.371761 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-88af98da-9ac0-4f56-bbb0-cdc7736f055e tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:41.372773 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-88af98da-9ac0-4f56-bbb0-cdc7736f055e tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:41.391153 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-88af98da-9ac0-4f56-bbb0-cdc7736f055e tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:41.400406 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-88af98da-9ac0-4f56-bbb0-cdc7736f055e tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:41.401680 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-88af98da-9ac0-4f56-bbb0-cdc7736f055e tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:41.403692 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-88af98da-9ac0-4f56-bbb0-cdc7736f055e tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:41.405827 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-88af98da-9ac0-4f56-bbb0-cdc7736f055e tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:41.406668 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-88af98da-9ac0-4f56-bbb0-cdc7736f055e tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:41.448032 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-164464eb-d99c-47d8-b705-cd93ec2dd3b9 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:41.464564 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-164464eb-d99c-47d8-b705-cd93ec2dd3b9 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:41.466351 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-164464eb-d99c-47d8-b705-cd93ec2dd3b9 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:41.474468 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-164464eb-d99c-47d8-b705-cd93ec2dd3b9 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] 10.222.0.27 "GET /compute/v2.1/servers/e2a29434-ee7b-466c-baaf-945c7918d31c" status: 200 len: 1357 microversion: 2.47 time: 1.140599 Sep 08 10:59:41.475396 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2355/4640] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:59:40 2022] GET /compute/v2.1/servers/e2a29434-ee7b-466c-baaf-945c7918d31c => generated 1357 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:59:41.494424 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f4c5f49e-c340-4110-be10-fbcc5f9f727c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:41.495476 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f4c5f49e-c340-4110-be10-fbcc5f9f727c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 280de799-ddfb-4ced-a4b4-758807cb1279] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:41.510216 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f4c5f49e-c340-4110-be10-fbcc5f9f727c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:41.513596 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f4c5f49e-c340-4110-be10-fbcc5f9f727c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:41.514239 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f4c5f49e-c340-4110-be10-fbcc5f9f727c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:41.519154 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f4c5f49e-c340-4110-be10-fbcc5f9f727c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:41.519812 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f4c5f49e-c340-4110-be10-fbcc5f9f727c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:41.520432 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f4c5f49e-c340-4110-be10-fbcc5f9f727c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:42.018304 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f4c5f49e-c340-4110-be10-fbcc5f9f727c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:42.028847 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f4c5f49e-c340-4110-be10-fbcc5f9f727c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/280de799-ddfb-4ced-a4b4-758807cb1279" status: 200 len: 1314 microversion: 2.1 time: 0.540206 Sep 08 10:59:42.043141 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2356/4641] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:41 2022] GET /compute/v2.1/servers/280de799-ddfb-4ced-a4b4-758807cb1279 => generated 1314 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:42.054776 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bed7a2a8-0ba2-45ce-96d6-dedffff5392d tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:59:42.064731 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bed7a2a8-0ba2-45ce-96d6-dedffff5392d tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] [instance: e2a29434-ee7b-466c-baaf-945c7918d31c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:42.067783 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-88af98da-9ac0-4f56-bbb0-cdc7736f055e tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:42.084757 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bed7a2a8-0ba2-45ce-96d6-dedffff5392d tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:42.085328 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bed7a2a8-0ba2-45ce-96d6-dedffff5392d tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:42.085826 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bed7a2a8-0ba2-45ce-96d6-dedffff5392d tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:42.086560 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bed7a2a8-0ba2-45ce-96d6-dedffff5392d tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:42.087023 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bed7a2a8-0ba2-45ce-96d6-dedffff5392d tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:42.087644 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bed7a2a8-0ba2-45ce-96d6-dedffff5392d tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:42.096493 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-88af98da-9ac0-4f56-bbb0-cdc7736f055e tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8" status: 200 len: 1516 microversion: 2.1 time: 0.731294 Sep 08 10:59:42.100867 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2286/4642] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:41 2022] GET /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8 => generated 1516 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:42.117664 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e0d66e9a-80d2-4226-becc-abf7a088db80 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:42.118646 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e0d66e9a-80d2-4226-becc-abf7a088db80 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:42.128071 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0d66e9a-80d2-4226-becc-abf7a088db80 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:42.128980 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0d66e9a-80d2-4226-becc-abf7a088db80 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:42.129654 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0d66e9a-80d2-4226-becc-abf7a088db80 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:42.130752 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0d66e9a-80d2-4226-becc-abf7a088db80 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:42.131426 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0d66e9a-80d2-4226-becc-abf7a088db80 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:42.132212 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0d66e9a-80d2-4226-becc-abf7a088db80 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:42.251984 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-bed7a2a8-0ba2-45ce-96d6-dedffff5392d tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:59:42.253550 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-bed7a2a8-0ba2-45ce-96d6-dedffff5392d tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:59:42.254446 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-bed7a2a8-0ba2-45ce-96d6-dedffff5392d tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:59:42.255243 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-bed7a2a8-0ba2-45ce-96d6-dedffff5392d tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:59:42.256771 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-bed7a2a8-0ba2-45ce-96d6-dedffff5392d tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:59:42.299778 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e0d66e9a-80d2-4226-becc-abf7a088db80 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:42.315285 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e0d66e9a-80d2-4226-becc-abf7a088db80 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:42.317468 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e0d66e9a-80d2-4226-becc-abf7a088db80 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:42.319871 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e0d66e9a-80d2-4226-becc-abf7a088db80 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1527 microversion: 2.42 time: 0.215504 Sep 08 10:59:42.320879 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2287/4643] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:59:42 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1527 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:59:42.380599 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bed7a2a8-0ba2-45ce-96d6-dedffff5392d tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] [instance: e2a29434-ee7b-466c-baaf-945c7918d31c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:42.402165 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bed7a2a8-0ba2-45ce-96d6-dedffff5392d tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:42.402936 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bed7a2a8-0ba2-45ce-96d6-dedffff5392d tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:42.403300 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bed7a2a8-0ba2-45ce-96d6-dedffff5392d tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:42.404044 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bed7a2a8-0ba2-45ce-96d6-dedffff5392d tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:42.404535 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bed7a2a8-0ba2-45ce-96d6-dedffff5392d tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:42.405040 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bed7a2a8-0ba2-45ce-96d6-dedffff5392d tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:42.467752 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bed7a2a8-0ba2-45ce-96d6-dedffff5392d tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] 10.222.0.27 "POST /compute/v2.1/servers/e2a29434-ee7b-466c-baaf-945c7918d31c/action" status: 202 len: 1079 microversion: 2.47 time: 0.423352 Sep 08 10:59:42.468487 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2357/4644] 10.222.0.27 () {62 vars in 1319 bytes} [Thu Sep 8 10:59:42 2022] POST /compute/v2.1/servers/e2a29434-ee7b-466c-baaf-945c7918d31c/action => generated 1079 bytes in 425 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 08 10:59:42.497004 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-427df0ea-ca41-4c8f-9a2e-49c39983e187 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:42.497650 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-427df0ea-ca41-4c8f-9a2e-49c39983e187 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] [instance: e2a29434-ee7b-466c-baaf-945c7918d31c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:42.514915 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-427df0ea-ca41-4c8f-9a2e-49c39983e187 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:42.519061 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-427df0ea-ca41-4c8f-9a2e-49c39983e187 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:42.519569 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-427df0ea-ca41-4c8f-9a2e-49c39983e187 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:42.523346 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-427df0ea-ca41-4c8f-9a2e-49c39983e187 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:42.524585 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-427df0ea-ca41-4c8f-9a2e-49c39983e187 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:42.527287 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-427df0ea-ca41-4c8f-9a2e-49c39983e187 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:42.824645 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-427df0ea-ca41-4c8f-9a2e-49c39983e187 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:42.842459 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-427df0ea-ca41-4c8f-9a2e-49c39983e187 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:42.851197 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-427df0ea-ca41-4c8f-9a2e-49c39983e187 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:42.858540 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-427df0ea-ca41-4c8f-9a2e-49c39983e187 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] 10.222.0.27 "GET /compute/v2.1/servers/e2a29434-ee7b-466c-baaf-945c7918d31c" status: 200 len: 1366 microversion: 2.47 time: 0.371437 Sep 08 10:59:42.863000 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2288/4645] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:59:42 2022] GET /compute/v2.1/servers/e2a29434-ee7b-466c-baaf-945c7918d31c => generated 1366 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:59:43.068573 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-20395c33-670a-42df-a19e-03fc18ceb467 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:43.070817 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-20395c33-670a-42df-a19e-03fc18ceb467 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 280de799-ddfb-4ced-a4b4-758807cb1279] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:43.090589 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-20395c33-670a-42df-a19e-03fc18ceb467 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:43.093119 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-20395c33-670a-42df-a19e-03fc18ceb467 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:43.093772 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-20395c33-670a-42df-a19e-03fc18ceb467 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:43.094685 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-20395c33-670a-42df-a19e-03fc18ceb467 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:43.097301 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-20395c33-670a-42df-a19e-03fc18ceb467 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:43.097932 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-20395c33-670a-42df-a19e-03fc18ceb467 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:43.133627 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-81a6035e-1c0d-46b5-9b1d-e32d16aa54a0 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:43.134590 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-81a6035e-1c0d-46b5-9b1d-e32d16aa54a0 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:43.161530 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81a6035e-1c0d-46b5-9b1d-e32d16aa54a0 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:43.164375 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81a6035e-1c0d-46b5-9b1d-e32d16aa54a0 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:43.165207 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81a6035e-1c0d-46b5-9b1d-e32d16aa54a0 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:43.168434 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81a6035e-1c0d-46b5-9b1d-e32d16aa54a0 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:43.171886 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81a6035e-1c0d-46b5-9b1d-e32d16aa54a0 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:43.172416 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81a6035e-1c0d-46b5-9b1d-e32d16aa54a0 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:43.627634 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-81a6035e-1c0d-46b5-9b1d-e32d16aa54a0 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:43.638199 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-81a6035e-1c0d-46b5-9b1d-e32d16aa54a0 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8" status: 200 len: 1516 microversion: 2.1 time: 0.513201 Sep 08 10:59:43.640123 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2289/4646] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:43 2022] GET /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8 => generated 1516 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:59:43.672094 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-94e7a54b-d3d3-4cd7-bfc3-570a542067a0 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:43.672767 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-94e7a54b-d3d3-4cd7-bfc3-570a542067a0 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:43.689814 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94e7a54b-d3d3-4cd7-bfc3-570a542067a0 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:43.690319 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94e7a54b-d3d3-4cd7-bfc3-570a542067a0 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:43.690850 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94e7a54b-d3d3-4cd7-bfc3-570a542067a0 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:43.691561 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94e7a54b-d3d3-4cd7-bfc3-570a542067a0 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:43.692014 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94e7a54b-d3d3-4cd7-bfc3-570a542067a0 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:43.695723 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94e7a54b-d3d3-4cd7-bfc3-570a542067a0 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:43.803092 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-20395c33-670a-42df-a19e-03fc18ceb467 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:43.823791 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-20395c33-670a-42df-a19e-03fc18ceb467 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/280de799-ddfb-4ced-a4b4-758807cb1279" status: 200 len: 1314 microversion: 2.1 time: 0.761632 Sep 08 10:59:43.828184 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2358/4647] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:43 2022] GET /compute/v2.1/servers/280de799-ddfb-4ced-a4b4-758807cb1279 => generated 1314 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:43.895370 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-024df8d7-f40a-406e-a6e0-6f2816a3b216 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:43.896486 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-024df8d7-f40a-406e-a6e0-6f2816a3b216 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] [instance: e2a29434-ee7b-466c-baaf-945c7918d31c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:43.904011 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-024df8d7-f40a-406e-a6e0-6f2816a3b216 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:43.904710 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-024df8d7-f40a-406e-a6e0-6f2816a3b216 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:43.905307 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-024df8d7-f40a-406e-a6e0-6f2816a3b216 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:43.917506 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-024df8d7-f40a-406e-a6e0-6f2816a3b216 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:43.921743 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-024df8d7-f40a-406e-a6e0-6f2816a3b216 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:43.922219 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-024df8d7-f40a-406e-a6e0-6f2816a3b216 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:44.034729 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-94e7a54b-d3d3-4cd7-bfc3-570a542067a0 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:44.052655 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-94e7a54b-d3d3-4cd7-bfc3-570a542067a0 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:44.057009 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-94e7a54b-d3d3-4cd7-bfc3-570a542067a0 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:44.062967 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-94e7a54b-d3d3-4cd7-bfc3-570a542067a0 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1593 microversion: 2.42 time: 0.419785 Sep 08 10:59:44.067342 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2290/4648] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:59:43 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1593 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:59:44.137664 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-024df8d7-f40a-406e-a6e0-6f2816a3b216 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:44.147071 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-024df8d7-f40a-406e-a6e0-6f2816a3b216 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:44.154066 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-024df8d7-f40a-406e-a6e0-6f2816a3b216 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:44.155387 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-024df8d7-f40a-406e-a6e0-6f2816a3b216 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] 10.222.0.27 "GET /compute/v2.1/servers/e2a29434-ee7b-466c-baaf-945c7918d31c" status: 200 len: 1366 microversion: 2.47 time: 0.264746 Sep 08 10:59:44.165635 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2359/4649] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:59:43 2022] GET /compute/v2.1/servers/e2a29434-ee7b-466c-baaf-945c7918d31c => generated 1366 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:59:44.668004 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8d2b28b4-96f9-4f38-9b9f-2ca022477dc4 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:44.668717 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8d2b28b4-96f9-4f38-9b9f-2ca022477dc4 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:44.696057 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d2b28b4-96f9-4f38-9b9f-2ca022477dc4 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:44.696922 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d2b28b4-96f9-4f38-9b9f-2ca022477dc4 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:44.700191 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d2b28b4-96f9-4f38-9b9f-2ca022477dc4 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:44.701563 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d2b28b4-96f9-4f38-9b9f-2ca022477dc4 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:44.702252 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d2b28b4-96f9-4f38-9b9f-2ca022477dc4 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:44.706575 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d2b28b4-96f9-4f38-9b9f-2ca022477dc4 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:44.858508 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cbda86e4-6f49-4012-b8b7-2923893aa5e5 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:44.859193 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cbda86e4-6f49-4012-b8b7-2923893aa5e5 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 280de799-ddfb-4ced-a4b4-758807cb1279] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:44.879330 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cbda86e4-6f49-4012-b8b7-2923893aa5e5 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:44.879849 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cbda86e4-6f49-4012-b8b7-2923893aa5e5 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:44.898330 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cbda86e4-6f49-4012-b8b7-2923893aa5e5 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:44.899130 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cbda86e4-6f49-4012-b8b7-2923893aa5e5 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:44.903642 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cbda86e4-6f49-4012-b8b7-2923893aa5e5 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:44.905469 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cbda86e4-6f49-4012-b8b7-2923893aa5e5 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:45.408439 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8d2b28b4-96f9-4f38-9b9f-2ca022477dc4 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:45.423873 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8d2b28b4-96f9-4f38-9b9f-2ca022477dc4 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8" status: 200 len: 1516 microversion: 2.1 time: 0.761336 Sep 08 10:59:45.424666 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2291/4650] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:44 2022] GET /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8 => generated 1516 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:59:45.441135 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-08b0c99e-eeec-4e5f-b66f-fdb09216e974 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:45.446304 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-08b0c99e-eeec-4e5f-b66f-fdb09216e974 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:45.467703 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08b0c99e-eeec-4e5f-b66f-fdb09216e974 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:45.472606 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08b0c99e-eeec-4e5f-b66f-fdb09216e974 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:45.473562 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08b0c99e-eeec-4e5f-b66f-fdb09216e974 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:45.474708 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08b0c99e-eeec-4e5f-b66f-fdb09216e974 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:45.475338 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08b0c99e-eeec-4e5f-b66f-fdb09216e974 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:45.477045 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08b0c99e-eeec-4e5f-b66f-fdb09216e974 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:45.590551 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-cbda86e4-6f49-4012-b8b7-2923893aa5e5 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:45.599697 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cbda86e4-6f49-4012-b8b7-2923893aa5e5 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/280de799-ddfb-4ced-a4b4-758807cb1279" status: 200 len: 1314 microversion: 2.1 time: 0.745484 Sep 08 10:59:45.604088 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2360/4651] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:44 2022] GET /compute/v2.1/servers/280de799-ddfb-4ced-a4b4-758807cb1279 => generated 1314 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:45.616227 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5407326e-0d06-471d-bf24-be2a496718fb tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:45.616681 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-08b0c99e-eeec-4e5f-b66f-fdb09216e974 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:45.617480 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5407326e-0d06-471d-bf24-be2a496718fb tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] [instance: e2a29434-ee7b-466c-baaf-945c7918d31c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:45.626781 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5407326e-0d06-471d-bf24-be2a496718fb tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:45.631722 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-08b0c99e-eeec-4e5f-b66f-fdb09216e974 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:45.633250 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5407326e-0d06-471d-bf24-be2a496718fb tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:45.635363 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-08b0c99e-eeec-4e5f-b66f-fdb09216e974 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:45.638130 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5407326e-0d06-471d-bf24-be2a496718fb tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:45.639193 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5407326e-0d06-471d-bf24-be2a496718fb tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:45.639316 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-08b0c99e-eeec-4e5f-b66f-fdb09216e974 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1593 microversion: 2.42 time: 0.209756 Sep 08 10:59:45.639843 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2292/4652] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:59:45 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1593 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:59:45.641964 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5407326e-0d06-471d-bf24-be2a496718fb tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:45.642685 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5407326e-0d06-471d-bf24-be2a496718fb tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:45.948459 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5407326e-0d06-471d-bf24-be2a496718fb tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:45.964179 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5407326e-0d06-471d-bf24-be2a496718fb tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:45.967097 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5407326e-0d06-471d-bf24-be2a496718fb tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:45.969254 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5407326e-0d06-471d-bf24-be2a496718fb tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] 10.222.0.27 "GET /compute/v2.1/servers/e2a29434-ee7b-466c-baaf-945c7918d31c" status: 200 len: 1366 microversion: 2.47 time: 0.363813 Sep 08 10:59:45.986433 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2361/4653] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:59:45 2022] GET /compute/v2.1/servers/e2a29434-ee7b-466c-baaf-945c7918d31c => generated 1366 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:59:46.113501 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-76e3c5a7-8e25-407b-bdef-be3ed5653042 req-972768de-7f2f-4298-9e01-9a843a9eb767 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "280de799-ddfb-4ced-a4b4-758807cb1279", "name": "network-vif-plugged", "status": "completed", "tag": "c70fa2a6-ca73-4956-b002-02ae3374520a"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:59:46.158972 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-76e3c5a7-8e25-407b-bdef-be3ed5653042 req-972768de-7f2f-4298-9e01-9a843a9eb767 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:46.178961 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-76e3c5a7-8e25-407b-bdef-be3ed5653042 req-972768de-7f2f-4298-9e01-9a843a9eb767 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:46.188012 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-76e3c5a7-8e25-407b-bdef-be3ed5653042 req-972768de-7f2f-4298-9e01-9a843a9eb767 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:46.239774 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-76e3c5a7-8e25-407b-bdef-be3ed5653042 req-972768de-7f2f-4298-9e01-9a843a9eb767 service nova] Creating event network-vif-plugged:c70fa2a6-ca73-4956-b002-02ae3374520a for instance 280de799-ddfb-4ced-a4b4-758807cb1279 on n-h1-850501-12 Sep 08 10:59:46.279494 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-76e3c5a7-8e25-407b-bdef-be3ed5653042 req-972768de-7f2f-4298-9e01-9a843a9eb767 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171296 Sep 08 10:59:46.281224 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2293/4654] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:59:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:59:46.458619 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-dd8c0d6f-e4ed-48f2-af27-fd09a54a2ad9 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:46.464476 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-dd8c0d6f-e4ed-48f2-af27-fd09a54a2ad9 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:46.480791 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd8c0d6f-e4ed-48f2-af27-fd09a54a2ad9 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:46.482610 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd8c0d6f-e4ed-48f2-af27-fd09a54a2ad9 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:46.483693 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd8c0d6f-e4ed-48f2-af27-fd09a54a2ad9 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:46.496910 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd8c0d6f-e4ed-48f2-af27-fd09a54a2ad9 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:46.500244 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd8c0d6f-e4ed-48f2-af27-fd09a54a2ad9 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:46.501851 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd8c0d6f-e4ed-48f2-af27-fd09a54a2ad9 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:46.634575 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a9b44418-07d9-4fea-a840-1c23cca71a2b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:46.635544 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a9b44418-07d9-4fea-a840-1c23cca71a2b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 280de799-ddfb-4ced-a4b4-758807cb1279] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:46.653325 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a9b44418-07d9-4fea-a840-1c23cca71a2b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:46.654471 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a9b44418-07d9-4fea-a840-1c23cca71a2b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:46.662447 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a9b44418-07d9-4fea-a840-1c23cca71a2b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:46.663226 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a9b44418-07d9-4fea-a840-1c23cca71a2b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:46.663960 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a9b44418-07d9-4fea-a840-1c23cca71a2b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:46.664395 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a9b44418-07d9-4fea-a840-1c23cca71a2b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:47.126635 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a9b44418-07d9-4fea-a840-1c23cca71a2b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:47.143560 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a9b44418-07d9-4fea-a840-1c23cca71a2b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/280de799-ddfb-4ced-a4b4-758807cb1279" status: 200 len: 1314 microversion: 2.1 time: 0.514944 Sep 08 10:59:47.147424 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2294/4655] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:46 2022] GET /compute/v2.1/servers/280de799-ddfb-4ced-a4b4-758807cb1279 => generated 1314 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:59:47.174226 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f73dd250-8da2-4744-a28b-5c71430df0e4 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:47.175645 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f73dd250-8da2-4744-a28b-5c71430df0e4 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:47.183685 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f73dd250-8da2-4744-a28b-5c71430df0e4 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:47.184582 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f73dd250-8da2-4744-a28b-5c71430df0e4 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:47.185312 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f73dd250-8da2-4744-a28b-5c71430df0e4 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:47.186273 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f73dd250-8da2-4744-a28b-5c71430df0e4 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:47.186991 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f73dd250-8da2-4744-a28b-5c71430df0e4 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:47.187639 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f73dd250-8da2-4744-a28b-5c71430df0e4 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:47.598645 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f73dd250-8da2-4744-a28b-5c71430df0e4 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:47.615287 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f73dd250-8da2-4744-a28b-5c71430df0e4 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:47.618902 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f73dd250-8da2-4744-a28b-5c71430df0e4 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:47.623122 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f73dd250-8da2-4744-a28b-5c71430df0e4 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1660 microversion: 2.42 time: 0.458997 Sep 08 10:59:47.624267 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2295/4656] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:59:47 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1660 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:59:47.638393 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c67b78c3-cc47-46a1-9a94-44511493ce98 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:47.639331 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c67b78c3-cc47-46a1-9a94-44511493ce98 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] [instance: e2a29434-ee7b-466c-baaf-945c7918d31c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:47.663426 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c67b78c3-cc47-46a1-9a94-44511493ce98 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:47.665635 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c67b78c3-cc47-46a1-9a94-44511493ce98 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:47.667759 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c67b78c3-cc47-46a1-9a94-44511493ce98 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:47.668673 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c67b78c3-cc47-46a1-9a94-44511493ce98 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:47.671833 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c67b78c3-cc47-46a1-9a94-44511493ce98 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:47.673442 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c67b78c3-cc47-46a1-9a94-44511493ce98 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:47.822616 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c67b78c3-cc47-46a1-9a94-44511493ce98 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:47.835884 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c67b78c3-cc47-46a1-9a94-44511493ce98 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:47.838385 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c67b78c3-cc47-46a1-9a94-44511493ce98 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:47.840331 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c67b78c3-cc47-46a1-9a94-44511493ce98 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] 10.222.0.27 "GET /compute/v2.1/servers/e2a29434-ee7b-466c-baaf-945c7918d31c" status: 200 len: 1366 microversion: 2.47 time: 0.214433 Sep 08 10:59:47.844412 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2296/4657] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:59:47 2022] GET /compute/v2.1/servers/e2a29434-ee7b-466c-baaf-945c7918d31c => generated 1366 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:59:48.208263 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ce695c4b-23b3-426d-b342-d372f1e14f0d tempest-ComputeTenantNetworksTest-1849149841 tempest-ComputeTenantNetworksTest-1849149841-project] Calling method '.version_select at 0x7f68e44bbca0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:48.351830 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-dd8c0d6f-e4ed-48f2-af27-fd09a54a2ad9 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:48.357062 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:59:48.379854 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-dd8c0d6f-e4ed-48f2-af27-fd09a54a2ad9 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8" status: 200 len: 1516 microversion: 2.1 time: 1.931696 Sep 08 10:59:48.380389 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2362/4658] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:46 2022] GET /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8 => generated 1516 bytes in 1935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:48.398539 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-408825ff-b0e7-4c83-aba9-431b53668eb9 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:48.399589 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-408825ff-b0e7-4c83-aba9-431b53668eb9 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 280de799-ddfb-4ced-a4b4-758807cb1279] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:48.434421 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-408825ff-b0e7-4c83-aba9-431b53668eb9 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:48.435114 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-408825ff-b0e7-4c83-aba9-431b53668eb9 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:48.435796 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-408825ff-b0e7-4c83-aba9-431b53668eb9 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:48.436943 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-408825ff-b0e7-4c83-aba9-431b53668eb9 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:48.437675 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-408825ff-b0e7-4c83-aba9-431b53668eb9 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:48.439576 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-408825ff-b0e7-4c83-aba9-431b53668eb9 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:48.778814 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ce695c4b-23b3-426d-b342-d372f1e14f0d tempest-ComputeTenantNetworksTest-1849149841 tempest-ComputeTenantNetworksTest-1849149841-project] 10.222.0.27 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 421 microversion: 2.1 time: 0.932305 Sep 08 10:59:48.780065 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2297/4659] 10.222.0.27 () {58 vars in 1158 bytes} [Thu Sep 8 10:59:47 2022] GET /compute/v2.1/os-tenant-networks => generated 421 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:59:48.792642 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7ab07c9c-ce14-42da-8322-5b669db2004b tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:48.793742 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7ab07c9c-ce14-42da-8322-5b669db2004b tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:48.814679 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ab07c9c-ce14-42da-8322-5b669db2004b tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:48.815807 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ab07c9c-ce14-42da-8322-5b669db2004b tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:48.816855 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ab07c9c-ce14-42da-8322-5b669db2004b tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:48.817860 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ab07c9c-ce14-42da-8322-5b669db2004b tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:48.821999 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ab07c9c-ce14-42da-8322-5b669db2004b tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:48.827297 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ab07c9c-ce14-42da-8322-5b669db2004b tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:48.911381 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=18 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:59:48.999386 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=26 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:59:49.362307 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-408825ff-b0e7-4c83-aba9-431b53668eb9 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:49.375219 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7ab07c9c-ce14-42da-8322-5b669db2004b tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:49.419000 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7ab07c9c-ce14-42da-8322-5b669db2004b tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:49.423377 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7ab07c9c-ce14-42da-8322-5b669db2004b tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:49.423943 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-408825ff-b0e7-4c83-aba9-431b53668eb9 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/280de799-ddfb-4ced-a4b4-758807cb1279" status: 200 len: 1314 microversion: 2.1 time: 1.039180 Sep 08 10:59:49.431535 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7ab07c9c-ce14-42da-8322-5b669db2004b tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1660 microversion: 2.42 time: 0.649248 Sep 08 10:59:49.432391 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2298/4660] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:59:48 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1660 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:59:49.444986 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7df07109-75c2-49cc-813b-9927a02c9326 tempest-ComputeTenantNetworksTest-1849149841 tempest-ComputeTenantNetworksTest-1849149841-project] Calling method '.version_select at 0x7f68e424eb80>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:49.452556 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2363/4661] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:48 2022] GET /compute/v2.1/servers/280de799-ddfb-4ced-a4b4-758807cb1279 => generated 1314 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:49.473655 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4c05ae3e-4ba0-452c-9420-d7458fa2ba02 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:49.474529 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4c05ae3e-4ba0-452c-9420-d7458fa2ba02 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] [instance: e2a29434-ee7b-466c-baaf-945c7918d31c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:49.491751 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4c05ae3e-4ba0-452c-9420-d7458fa2ba02 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:49.498156 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4c05ae3e-4ba0-452c-9420-d7458fa2ba02 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:49.499019 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4c05ae3e-4ba0-452c-9420-d7458fa2ba02 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:49.499995 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4c05ae3e-4ba0-452c-9420-d7458fa2ba02 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:49.500706 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4c05ae3e-4ba0-452c-9420-d7458fa2ba02 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:49.501662 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4c05ae3e-4ba0-452c-9420-d7458fa2ba02 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:49.724439 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4c05ae3e-4ba0-452c-9420-d7458fa2ba02 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:49.750962 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4c05ae3e-4ba0-452c-9420-d7458fa2ba02 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:49.767620 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4c05ae3e-4ba0-452c-9420-d7458fa2ba02 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:49.775571 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4c05ae3e-4ba0-452c-9420-d7458fa2ba02 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] 10.222.0.27 "GET /compute/v2.1/servers/e2a29434-ee7b-466c-baaf-945c7918d31c" status: 200 len: 1366 microversion: 2.47 time: 0.313133 Sep 08 10:59:49.778956 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2364/4662] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:59:49 2022] GET /compute/v2.1/servers/e2a29434-ee7b-466c-baaf-945c7918d31c => generated 1366 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:59:49.796612 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7df07109-75c2-49cc-813b-9927a02c9326 tempest-ComputeTenantNetworksTest-1849149841 tempest-ComputeTenantNetworksTest-1849149841-project] 10.222.0.27 "GET /compute/v2.1/os-tenant-networks/b6343c9c-1c8f-40cd-8074-5f0dbb5df869" status: 200 len: 140 microversion: 2.1 time: 0.362971 Sep 08 10:59:49.800152 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-399bca51-be8a-478f-a1da-44cc2b3cda6e tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:49.800791 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-399bca51-be8a-478f-a1da-44cc2b3cda6e tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:49.801975 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2299/4663] 10.222.0.27 () {58 vars in 1269 bytes} [Thu Sep 8 10:59:49 2022] GET /compute/v2.1/os-tenant-networks/b6343c9c-1c8f-40cd-8074-5f0dbb5df869 => generated 140 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:59:49.816991 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-399bca51-be8a-478f-a1da-44cc2b3cda6e tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:49.818009 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-399bca51-be8a-478f-a1da-44cc2b3cda6e tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:49.819359 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-399bca51-be8a-478f-a1da-44cc2b3cda6e tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:49.822432 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-399bca51-be8a-478f-a1da-44cc2b3cda6e tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:49.825879 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-399bca51-be8a-478f-a1da-44cc2b3cda6e tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:49.826669 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-399bca51-be8a-478f-a1da-44cc2b3cda6e tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:50.314147 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-399bca51-be8a-478f-a1da-44cc2b3cda6e tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:50.337802 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-399bca51-be8a-478f-a1da-44cc2b3cda6e tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8" status: 200 len: 1516 microversion: 2.1 time: 0.555995 Sep 08 10:59:50.340339 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2365/4664] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:49 2022] GET /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8 => generated 1516 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:50.482029 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-68ce1787-1593-436d-a1ae-d56791d89bbf tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:50.484616 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-77062cc6-c027-4bdf-a10c-33e5432b8f18 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:50.487580 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-77062cc6-c027-4bdf-a10c-33e5432b8f18 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:50.498998 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-68ce1787-1593-436d-a1ae-d56791d89bbf tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 280de799-ddfb-4ced-a4b4-758807cb1279] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:50.549991 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-77062cc6-c027-4bdf-a10c-33e5432b8f18 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:50.557681 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68ce1787-1593-436d-a1ae-d56791d89bbf tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:50.557996 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-77062cc6-c027-4bdf-a10c-33e5432b8f18 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:50.558908 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-77062cc6-c027-4bdf-a10c-33e5432b8f18 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:50.559259 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68ce1787-1593-436d-a1ae-d56791d89bbf tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:50.559938 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-77062cc6-c027-4bdf-a10c-33e5432b8f18 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:50.560218 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68ce1787-1593-436d-a1ae-d56791d89bbf tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:50.561183 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68ce1787-1593-436d-a1ae-d56791d89bbf tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:50.561871 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68ce1787-1593-436d-a1ae-d56791d89bbf tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:50.562656 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68ce1787-1593-436d-a1ae-d56791d89bbf tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:50.563874 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-77062cc6-c027-4bdf-a10c-33e5432b8f18 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:50.564412 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-77062cc6-c027-4bdf-a10c-33e5432b8f18 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:50.620644 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=12 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:59:51.451061 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-77062cc6-c027-4bdf-a10c-33e5432b8f18 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:51.496698 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-77062cc6-c027-4bdf-a10c-33e5432b8f18 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:51.503533 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-77062cc6-c027-4bdf-a10c-33e5432b8f18 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:51.506978 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-77062cc6-c027-4bdf-a10c-33e5432b8f18 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1706 microversion: 2.42 time: 1.039014 Sep 08 10:59:51.511558 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2366/4665] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:59:50 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1706 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:59:51.538691 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f8b2a84d-1a9a-4631-8eac-a3b7752b6c67 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:51.540971 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f8b2a84d-1a9a-4631-8eac-a3b7752b6c67 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] [instance: e2a29434-ee7b-466c-baaf-945c7918d31c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:51.562685 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f8b2a84d-1a9a-4631-8eac-a3b7752b6c67 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:51.564304 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f8b2a84d-1a9a-4631-8eac-a3b7752b6c67 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:51.565458 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f8b2a84d-1a9a-4631-8eac-a3b7752b6c67 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:51.567111 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f8b2a84d-1a9a-4631-8eac-a3b7752b6c67 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:51.569515 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f8b2a84d-1a9a-4631-8eac-a3b7752b6c67 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:51.570276 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f8b2a84d-1a9a-4631-8eac-a3b7752b6c67 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:51.744050 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f8b2a84d-1a9a-4631-8eac-a3b7752b6c67 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:51.765908 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f8b2a84d-1a9a-4631-8eac-a3b7752b6c67 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:51.772245 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f8b2a84d-1a9a-4631-8eac-a3b7752b6c67 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:51.775519 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f8b2a84d-1a9a-4631-8eac-a3b7752b6c67 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] 10.222.0.27 "GET /compute/v2.1/servers/e2a29434-ee7b-466c-baaf-945c7918d31c" status: 200 len: 1366 microversion: 2.47 time: 0.260028 Sep 08 10:59:51.777580 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2367/4666] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:59:51 2022] GET /compute/v2.1/servers/e2a29434-ee7b-466c-baaf-945c7918d31c => generated 1366 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:59:51.792783 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-68ce1787-1593-436d-a1ae-d56791d89bbf tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:51.809905 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-afd57e1e-8013-438b-9a92-a79ef2a555ee tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:51.810536 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-afd57e1e-8013-438b-9a92-a79ef2a555ee tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:51.818460 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-68ce1787-1593-436d-a1ae-d56791d89bbf tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/280de799-ddfb-4ced-a4b4-758807cb1279" status: 200 len: 1502 microversion: 2.1 time: 1.351456 Sep 08 10:59:51.832420 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2300/4667] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:50 2022] GET /compute/v2.1/servers/280de799-ddfb-4ced-a4b4-758807cb1279 => generated 1502 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:51.832979 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-afd57e1e-8013-438b-9a92-a79ef2a555ee tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:51.845880 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-afd57e1e-8013-438b-9a92-a79ef2a555ee tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:51.848060 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-afd57e1e-8013-438b-9a92-a79ef2a555ee tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:51.849503 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-afd57e1e-8013-438b-9a92-a79ef2a555ee tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:51.850171 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-afd57e1e-8013-438b-9a92-a79ef2a555ee tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:51.850770 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-afd57e1e-8013-438b-9a92-a79ef2a555ee tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:51.851654 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-71843aa8-1d0e-4ef3-a8a8-2aa868aa935b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:59:51.852802 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-71843aa8-1d0e-4ef3-a8a8-2aa868aa935b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 280de799-ddfb-4ced-a4b4-758807cb1279] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:51.873963 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71843aa8-1d0e-4ef3-a8a8-2aa868aa935b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:51.876941 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71843aa8-1d0e-4ef3-a8a8-2aa868aa935b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:51.877675 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71843aa8-1d0e-4ef3-a8a8-2aa868aa935b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:51.878614 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71843aa8-1d0e-4ef3-a8a8-2aa868aa935b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:51.880231 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71843aa8-1d0e-4ef3-a8a8-2aa868aa935b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:51.882093 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71843aa8-1d0e-4ef3-a8a8-2aa868aa935b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:52.506301 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.network.security_group_api [None req-71843aa8-1d0e-4ef3-a8a8-2aa868aa935b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Removing security group 471e214a-e85e-4fb6-8455-6f073536678b from port c70fa2a6-ca73-4956-b002-02ae3374520a Sep 08 10:59:52.565062 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-afd57e1e-8013-438b-9a92-a79ef2a555ee tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:52.600709 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-afd57e1e-8013-438b-9a92-a79ef2a555ee tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8" status: 200 len: 1516 microversion: 2.1 time: 0.814953 Sep 08 10:59:52.604315 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2368/4668] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:51 2022] GET /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8 => generated 1516 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:52.628257 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b5d2a3b5-bfb4-4b3d-9630-183b0ac736a5 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:52.629389 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b5d2a3b5-bfb4-4b3d-9630-183b0ac736a5 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:52.668253 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b5d2a3b5-bfb4-4b3d-9630-183b0ac736a5 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:52.669433 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b5d2a3b5-bfb4-4b3d-9630-183b0ac736a5 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:52.672341 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b5d2a3b5-bfb4-4b3d-9630-183b0ac736a5 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:52.677329 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b5d2a3b5-bfb4-4b3d-9630-183b0ac736a5 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:52.679593 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b5d2a3b5-bfb4-4b3d-9630-183b0ac736a5 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:52.681252 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b5d2a3b5-bfb4-4b3d-9630-183b0ac736a5 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:53.670811 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b5d2a3b5-bfb4-4b3d-9630-183b0ac736a5 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:53.702386 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b5d2a3b5-bfb4-4b3d-9630-183b0ac736a5 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:53.720988 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b5d2a3b5-bfb4-4b3d-9630-183b0ac736a5 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:53.727416 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b5d2a3b5-bfb4-4b3d-9630-183b0ac736a5 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1752 microversion: 2.42 time: 1.115768 Sep 08 10:59:53.729940 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2369/4669] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:59:52 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1752 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:59:53.767156 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a8fd956a-2343-4ecb-86ad-214cca171d4e tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:53.770561 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a8fd956a-2343-4ecb-86ad-214cca171d4e tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] [instance: e2a29434-ee7b-466c-baaf-945c7918d31c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:53.793919 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a8fd956a-2343-4ecb-86ad-214cca171d4e tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:53.809424 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a8fd956a-2343-4ecb-86ad-214cca171d4e tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:53.817361 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a8fd956a-2343-4ecb-86ad-214cca171d4e tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:53.819341 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a8fd956a-2343-4ecb-86ad-214cca171d4e tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:53.821151 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a8fd956a-2343-4ecb-86ad-214cca171d4e tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:53.822149 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a8fd956a-2343-4ecb-86ad-214cca171d4e tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:54.035561 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a8fd956a-2343-4ecb-86ad-214cca171d4e tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:54.051499 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a8fd956a-2343-4ecb-86ad-214cca171d4e tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:54.052960 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a8fd956a-2343-4ecb-86ad-214cca171d4e tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:54.054197 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a8fd956a-2343-4ecb-86ad-214cca171d4e tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] 10.222.0.27 "GET /compute/v2.1/servers/e2a29434-ee7b-466c-baaf-945c7918d31c" status: 200 len: 1366 microversion: 2.47 time: 0.322490 Sep 08 10:59:54.054786 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2370/4670] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:59:53 2022] GET /compute/v2.1/servers/e2a29434-ee7b-466c-baaf-945c7918d31c => generated 1366 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:59:54.091956 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-88ed1241-543e-4da9-92ea-fd2ec2441334 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:54.092817 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-88ed1241-543e-4da9-92ea-fd2ec2441334 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:54.133893 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88ed1241-543e-4da9-92ea-fd2ec2441334 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:54.135064 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88ed1241-543e-4da9-92ea-fd2ec2441334 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:54.135064 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88ed1241-543e-4da9-92ea-fd2ec2441334 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:54.135899 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88ed1241-543e-4da9-92ea-fd2ec2441334 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:54.136057 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88ed1241-543e-4da9-92ea-fd2ec2441334 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:54.146239 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88ed1241-543e-4da9-92ea-fd2ec2441334 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:54.176051 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-71843aa8-1d0e-4ef3-a8a8-2aa868aa935b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "POST /compute/v2.1/servers/280de799-ddfb-4ced-a4b4-758807cb1279/action" status: 202 len: 0 microversion: 2.1 time: 2.329568 Sep 08 10:59:54.176575 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2301/4671] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 10:59:51 2022] POST /compute/v2.1/servers/280de799-ddfb-4ced-a4b4-758807cb1279/action => generated 0 bytes in 2331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:59:54.186272 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cc0d0160-77ab-406f-865c-9d8d8c5148e6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:54.193804 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cc0d0160-77ab-406f-865c-9d8d8c5148e6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 280de799-ddfb-4ced-a4b4-758807cb1279] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:54.218450 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc0d0160-77ab-406f-865c-9d8d8c5148e6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:54.218936 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc0d0160-77ab-406f-865c-9d8d8c5148e6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:54.226652 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc0d0160-77ab-406f-865c-9d8d8c5148e6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:54.233536 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc0d0160-77ab-406f-865c-9d8d8c5148e6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:54.235391 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc0d0160-77ab-406f-865c-9d8d8c5148e6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:54.245746 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc0d0160-77ab-406f-865c-9d8d8c5148e6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:54.941756 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cc0d0160-77ab-406f-865c-9d8d8c5148e6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:54.950459 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cc0d0160-77ab-406f-865c-9d8d8c5148e6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/280de799-ddfb-4ced-a4b4-758807cb1279" status: 200 len: 1460 microversion: 2.1 time: 0.769082 Sep 08 10:59:54.957966 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2302/4672] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:54 2022] GET /compute/v2.1/servers/280de799-ddfb-4ced-a4b4-758807cb1279 => generated 1460 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:59:54.965498 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-9bb7243b-d6c7-488d-8197-8e996299a807 req-519f7058-6c23-457c-9816-6d8f28bcd5a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "280de799-ddfb-4ced-a4b4-758807cb1279", "tag": "c70fa2a6-ca73-4956-b002-02ae3374520a"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:59:55.016759 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-9bb7243b-d6c7-488d-8197-8e996299a807 req-519f7058-6c23-457c-9816-6d8f28bcd5a4 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:55.017603 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-9bb7243b-d6c7-488d-8197-8e996299a807 req-519f7058-6c23-457c-9816-6d8f28bcd5a4 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:55.018397 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-9bb7243b-d6c7-488d-8197-8e996299a807 req-519f7058-6c23-457c-9816-6d8f28bcd5a4 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:55.097252 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-9bb7243b-d6c7-488d-8197-8e996299a807 req-519f7058-6c23-457c-9816-6d8f28bcd5a4 service nova] Creating event network-changed:c70fa2a6-ca73-4956-b002-02ae3374520a for instance 280de799-ddfb-4ced-a4b4-758807cb1279 on n-h1-850501-12 Sep 08 10:59:55.134914 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-9bb7243b-d6c7-488d-8197-8e996299a807 req-519f7058-6c23-457c-9816-6d8f28bcd5a4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.174567 Sep 08 10:59:55.140394 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2303/4673] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 10:59:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:59:55.160766 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5c55df93-7bc1-4ff5-a351-cbaaa4055ec6 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:55.166903 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5c55df93-7bc1-4ff5-a351-cbaaa4055ec6 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:55.188871 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c55df93-7bc1-4ff5-a351-cbaaa4055ec6 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:55.198194 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c55df93-7bc1-4ff5-a351-cbaaa4055ec6 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:55.200686 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c55df93-7bc1-4ff5-a351-cbaaa4055ec6 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:55.208143 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c55df93-7bc1-4ff5-a351-cbaaa4055ec6 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:55.208993 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c55df93-7bc1-4ff5-a351-cbaaa4055ec6 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:55.209786 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c55df93-7bc1-4ff5-a351-cbaaa4055ec6 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:55.476466 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-88ed1241-543e-4da9-92ea-fd2ec2441334 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:55.488039 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-88ed1241-543e-4da9-92ea-fd2ec2441334 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8" status: 200 len: 1516 microversion: 2.1 time: 1.424788 Sep 08 10:59:55.498441 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2371/4674] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:54 2022] GET /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8 => generated 1516 bytes in 1442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:55.522378 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-be12d9d7-6236-4655-ad41-8a81adefaee9 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:55.523172 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-be12d9d7-6236-4655-ad41-8a81adefaee9 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:55.542844 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-be12d9d7-6236-4655-ad41-8a81adefaee9 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:55.543349 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-be12d9d7-6236-4655-ad41-8a81adefaee9 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:55.543796 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-be12d9d7-6236-4655-ad41-8a81adefaee9 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:55.544515 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-be12d9d7-6236-4655-ad41-8a81adefaee9 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:55.544981 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-be12d9d7-6236-4655-ad41-8a81adefaee9 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:55.545440 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-be12d9d7-6236-4655-ad41-8a81adefaee9 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:56.132176 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-be12d9d7-6236-4655-ad41-8a81adefaee9 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:56.143450 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-be12d9d7-6236-4655-ad41-8a81adefaee9 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1671 microversion: 2.1 time: 0.632735 Sep 08 10:59:56.148785 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2372/4675] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:55 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1671 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:56.155586 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e7ae6945-12d8-4900-9e21-05db7d93d22e tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:56.164351 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e7ae6945-12d8-4900-9e21-05db7d93d22e tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] [instance: e2a29434-ee7b-466c-baaf-945c7918d31c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:56.185308 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e7ae6945-12d8-4900-9e21-05db7d93d22e tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:56.185810 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e7ae6945-12d8-4900-9e21-05db7d93d22e tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:56.186571 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e7ae6945-12d8-4900-9e21-05db7d93d22e tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:56.187107 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e7ae6945-12d8-4900-9e21-05db7d93d22e tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:56.188007 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e7ae6945-12d8-4900-9e21-05db7d93d22e tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:56.188446 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e7ae6945-12d8-4900-9e21-05db7d93d22e tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:56.205864 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5c55df93-7bc1-4ff5-a351-cbaaa4055ec6 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:56.242493 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5c55df93-7bc1-4ff5-a351-cbaaa4055ec6 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:56.249247 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5c55df93-7bc1-4ff5-a351-cbaaa4055ec6 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:56.256751 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5c55df93-7bc1-4ff5-a351-cbaaa4055ec6 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1752 microversion: 2.42 time: 1.112658 Sep 08 10:59:56.260198 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2304/4676] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:59:55 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1752 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:59:56.275471 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3a602b1c-5f48-4598-97ec-c1b0c8b66763 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:56.276119 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3a602b1c-5f48-4598-97ec-c1b0c8b66763 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:56.295068 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a602b1c-5f48-4598-97ec-c1b0c8b66763 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:56.295830 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a602b1c-5f48-4598-97ec-c1b0c8b66763 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:56.296442 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a602b1c-5f48-4598-97ec-c1b0c8b66763 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:56.297496 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a602b1c-5f48-4598-97ec-c1b0c8b66763 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:56.298135 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a602b1c-5f48-4598-97ec-c1b0c8b66763 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:56.300232 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a602b1c-5f48-4598-97ec-c1b0c8b66763 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:56.348806 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:59:56.351208 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e7ae6945-12d8-4900-9e21-05db7d93d22e tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:56.369647 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e7ae6945-12d8-4900-9e21-05db7d93d22e tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:56.379377 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e7ae6945-12d8-4900-9e21-05db7d93d22e tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:56.381676 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e7ae6945-12d8-4900-9e21-05db7d93d22e tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] 10.222.0.27 "GET /compute/v2.1/servers/e2a29434-ee7b-466c-baaf-945c7918d31c" status: 200 len: 1366 microversion: 2.47 time: 0.231219 Sep 08 10:59:56.408692 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2373/4677] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:59:56 2022] GET /compute/v2.1/servers/e2a29434-ee7b-466c-baaf-945c7918d31c => generated 1366 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:59:56.529997 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-27569e9e-c0d6-4505-95b8-54a24280ddbf tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:56.530985 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-27569e9e-c0d6-4505-95b8-54a24280ddbf tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:56.551462 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-27569e9e-c0d6-4505-95b8-54a24280ddbf tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:56.551968 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-27569e9e-c0d6-4505-95b8-54a24280ddbf tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:56.552408 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-27569e9e-c0d6-4505-95b8-54a24280ddbf tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:56.560886 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-27569e9e-c0d6-4505-95b8-54a24280ddbf tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:56.561603 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-27569e9e-c0d6-4505-95b8-54a24280ddbf tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:56.562063 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-27569e9e-c0d6-4505-95b8-54a24280ddbf tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:56.824616 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3a602b1c-5f48-4598-97ec-c1b0c8b66763 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:56.838253 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3a602b1c-5f48-4598-97ec-c1b0c8b66763 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1671 microversion: 2.1 time: 0.576432 Sep 08 10:59:56.839560 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2305/4678] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:56 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1671 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:56.876537 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-03b4819b-b2b0-4266-a671-474ef339afab tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:56.878021 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-03b4819b-b2b0-4266-a671-474ef339afab tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:56.901449 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03b4819b-b2b0-4266-a671-474ef339afab tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:56.908156 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03b4819b-b2b0-4266-a671-474ef339afab tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:56.909530 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03b4819b-b2b0-4266-a671-474ef339afab tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:56.911133 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03b4819b-b2b0-4266-a671-474ef339afab tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:56.914425 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03b4819b-b2b0-4266-a671-474ef339afab tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:56.921522 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03b4819b-b2b0-4266-a671-474ef339afab tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:57.267293 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-03b4819b-b2b0-4266-a671-474ef339afab tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:57.295029 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-03b4819b-b2b0-4266-a671-474ef339afab tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1671 microversion: 2.1 time: 0.424975 Sep 08 10:59:57.321075 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2306/4679] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:56 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1671 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:59:57.347074 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dd18be86-5f6e-49a5-8da9-94deec8db4c5 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:57.353509 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-dd18be86-5f6e-49a5-8da9-94deec8db4c5 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:57.376124 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:59:57.379793 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd18be86-5f6e-49a5-8da9-94deec8db4c5 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:57.383295 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd18be86-5f6e-49a5-8da9-94deec8db4c5 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:57.388252 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd18be86-5f6e-49a5-8da9-94deec8db4c5 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:57.389881 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd18be86-5f6e-49a5-8da9-94deec8db4c5 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:57.392373 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd18be86-5f6e-49a5-8da9-94deec8db4c5 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:57.394533 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd18be86-5f6e-49a5-8da9-94deec8db4c5 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:58.008109 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-27569e9e-c0d6-4505-95b8-54a24280ddbf tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:58.035946 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-27569e9e-c0d6-4505-95b8-54a24280ddbf tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8" status: 200 len: 1516 microversion: 2.1 time: 1.509693 Sep 08 10:59:58.037345 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2374/4680] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:56 2022] GET /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8 => generated 1516 bytes in 1512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:58.057745 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-dd18be86-5f6e-49a5-8da9-94deec8db4c5 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:58.076452 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c7900024-fd01-4ba0-ae78-d719d11bfe05 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:58.081819 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c7900024-fd01-4ba0-ae78-d719d11bfe05 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:58.107203 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-dd18be86-5f6e-49a5-8da9-94deec8db4c5 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:58.114159 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c7900024-fd01-4ba0-ae78-d719d11bfe05 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:58.117944 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-dd18be86-5f6e-49a5-8da9-94deec8db4c5 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:58.118860 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c7900024-fd01-4ba0-ae78-d719d11bfe05 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:58.120432 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-dd18be86-5f6e-49a5-8da9-94deec8db4c5 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1752 microversion: 2.42 time: 0.796545 Sep 08 10:59:58.123114 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c7900024-fd01-4ba0-ae78-d719d11bfe05 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:58.124681 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2307/4681] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:59:57 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1752 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:59:58.131606 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c7900024-fd01-4ba0-ae78-d719d11bfe05 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:58.139226 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c7900024-fd01-4ba0-ae78-d719d11bfe05 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:58.139699 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c7900024-fd01-4ba0-ae78-d719d11bfe05 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:58.150959 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7f59a9e2-1a68-481c-ab5c-d1ee6728a03b tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:58.154550 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7f59a9e2-1a68-481c-ab5c-d1ee6728a03b tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] [instance: e2a29434-ee7b-466c-baaf-945c7918d31c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:58.171953 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f59a9e2-1a68-481c-ab5c-d1ee6728a03b tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:58.173101 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f59a9e2-1a68-481c-ab5c-d1ee6728a03b tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:58.176176 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f59a9e2-1a68-481c-ab5c-d1ee6728a03b tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:58.177620 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f59a9e2-1a68-481c-ab5c-d1ee6728a03b tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:58.178516 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f59a9e2-1a68-481c-ab5c-d1ee6728a03b tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:58.180894 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f59a9e2-1a68-481c-ab5c-d1ee6728a03b tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:58.372720 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7f59a9e2-1a68-481c-ab5c-d1ee6728a03b tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:58.383131 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7f59a9e2-1a68-481c-ab5c-d1ee6728a03b tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:58.390224 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7f59a9e2-1a68-481c-ab5c-d1ee6728a03b tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:58.400639 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7f59a9e2-1a68-481c-ab5c-d1ee6728a03b tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] 10.222.0.27 "GET /compute/v2.1/servers/e2a29434-ee7b-466c-baaf-945c7918d31c" status: 200 len: 1366 microversion: 2.47 time: 0.262009 Sep 08 10:59:58.401274 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2308/4682] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:59:58 2022] GET /compute/v2.1/servers/e2a29434-ee7b-466c-baaf-945c7918d31c => generated 1366 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:59:58.505411 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c7900024-fd01-4ba0-ae78-d719d11bfe05 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:58.548691 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c7900024-fd01-4ba0-ae78-d719d11bfe05 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1671 microversion: 2.1 time: 0.508758 Sep 08 10:59:58.550281 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2375/4683] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:58 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1671 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:58.766438 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3319e028-6c0e-444b-985f-3a0f578867b3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-706685308", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "b9022ed4-d5a1-4655-b50c-e8de49533ecf"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:59:58.835799 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-3319e028-6c0e-444b-985f-3a0f578867b3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] validate_networks() for [('b9022ed4-d5a1-4655-b50c-e8de49533ecf', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:59:58.883836 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-34db3079-ac6d-4310-bf0f-b9dec496afb5 tempest-VolumesTestJSON-887081819 tempest-VolumesTestJSON-887081819-project] Calling method '.version_select at 0x7f68e4d688b0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:58.978763 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-34db3079-ac6d-4310-bf0f-b9dec496afb5 tempest-VolumesTestJSON-887081819 tempest-VolumesTestJSON-887081819-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/dfaa025d-239c-49b2-a7d2-c5a04d9255c7" status: 200 len: 351 microversion: 2.1 time: 0.098866 Sep 08 10:59:58.979427 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2376/4684] 10.222.0.27 () {58 vars in 1245 bytes} [Thu Sep 8 10:59:58 2022] GET /compute/v2.1/os-volumes/dfaa025d-239c-49b2-a7d2-c5a04d9255c7 => generated 351 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:59:59.065617 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7979d083-15e3-4769-bcce-4c785aafb855 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:59.066982 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7979d083-15e3-4769-bcce-4c785aafb855 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:59.074549 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7979d083-15e3-4769-bcce-4c785aafb855 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:59.075285 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7979d083-15e3-4769-bcce-4c785aafb855 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:59.076122 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7979d083-15e3-4769-bcce-4c785aafb855 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:59.077211 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7979d083-15e3-4769-bcce-4c785aafb855 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:59.077817 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7979d083-15e3-4769-bcce-4c785aafb855 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:59.078482 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7979d083-15e3-4769-bcce-4c785aafb855 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:59.364820 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7979d083-15e3-4769-bcce-4c785aafb855 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:59.375008 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7979d083-15e3-4769-bcce-4c785aafb855 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8" status: 200 len: 1516 microversion: 2.1 time: 0.314146 Sep 08 10:59:59.381266 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2377/4685] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:59 2022] GET /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8 => generated 1516 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:59.397367 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4bcb8c5b-540e-4d61-89e2-f979948f4db3 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:59.398395 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4bcb8c5b-540e-4d61-89e2-f979948f4db3 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:59.405522 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4bcb8c5b-540e-4d61-89e2-f979948f4db3 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:59.406318 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4bcb8c5b-540e-4d61-89e2-f979948f4db3 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:59.407871 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4bcb8c5b-540e-4d61-89e2-f979948f4db3 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:59.410126 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4bcb8c5b-540e-4d61-89e2-f979948f4db3 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:59.410703 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4bcb8c5b-540e-4d61-89e2-f979948f4db3 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:59.411246 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4bcb8c5b-540e-4d61-89e2-f979948f4db3 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:59.950530 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4bcb8c5b-540e-4d61-89e2-f979948f4db3 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:59.968549 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4bcb8c5b-540e-4d61-89e2-f979948f4db3 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:59.972839 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4bcb8c5b-540e-4d61-89e2-f979948f4db3 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:59.975377 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4bcb8c5b-540e-4d61-89e2-f979948f4db3 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1798 microversion: 2.42 time: 0.592628 Sep 08 10:59:59.978529 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2378/4686] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:59:59 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1798 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:59:59.991828 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a79bcd42-8d61-41e7-9b06-f9f900f8ed01 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:59.992519 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a79bcd42-8d61-41e7-9b06-f9f900f8ed01 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] [instance: e2a29434-ee7b-466c-baaf-945c7918d31c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:00.005437 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a79bcd42-8d61-41e7-9b06-f9f900f8ed01 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:00.005946 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a79bcd42-8d61-41e7-9b06-f9f900f8ed01 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:00.012203 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a79bcd42-8d61-41e7-9b06-f9f900f8ed01 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:00.013084 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a79bcd42-8d61-41e7-9b06-f9f900f8ed01 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:00.013582 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a79bcd42-8d61-41e7-9b06-f9f900f8ed01 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:00.014035 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a79bcd42-8d61-41e7-9b06-f9f900f8ed01 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:00.246623 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a79bcd42-8d61-41e7-9b06-f9f900f8ed01 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:00.275118 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a79bcd42-8d61-41e7-9b06-f9f900f8ed01 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:00.281949 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a79bcd42-8d61-41e7-9b06-f9f900f8ed01 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:00.284801 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a79bcd42-8d61-41e7-9b06-f9f900f8ed01 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] 10.222.0.27 "GET /compute/v2.1/servers/e2a29434-ee7b-466c-baaf-945c7918d31c" status: 200 len: 1366 microversion: 2.47 time: 0.304056 Sep 08 11:00:00.286251 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2379/4687] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 10:59:59 2022] GET /compute/v2.1/servers/e2a29434-ee7b-466c-baaf-945c7918d31c => generated 1366 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:00:00.403750 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a59946cb-60e3-43f8-9651-154c81f799ff tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:00.404379 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a59946cb-60e3-43f8-9651-154c81f799ff tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:00.423073 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a59946cb-60e3-43f8-9651-154c81f799ff tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:00.423945 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a59946cb-60e3-43f8-9651-154c81f799ff tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:00.424573 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a59946cb-60e3-43f8-9651-154c81f799ff tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:00.425504 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a59946cb-60e3-43f8-9651-154c81f799ff tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:00.426627 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a59946cb-60e3-43f8-9651-154c81f799ff tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:00.437876 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a59946cb-60e3-43f8-9651-154c81f799ff tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:00.495452 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=100 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:00:00.736654 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-3319e028-6c0e-444b-985f-3a0f578867b3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:00:00.737209 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-3319e028-6c0e-444b-985f-3a0f578867b3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:00:00.737755 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-3319e028-6c0e-444b-985f-3a0f578867b3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:00:00.738181 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-3319e028-6c0e-444b-985f-3a0f578867b3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:00:00.738667 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-3319e028-6c0e-444b-985f-3a0f578867b3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:00:00.763412 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3319e028-6c0e-444b-985f-3a0f578867b3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:00.766127 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3319e028-6c0e-444b-985f-3a0f578867b3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:00.771009 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3319e028-6c0e-444b-985f-3a0f578867b3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:00.773531 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3319e028-6c0e-444b-985f-3a0f578867b3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:00.774477 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3319e028-6c0e-444b-985f-3a0f578867b3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:00.776617 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3319e028-6c0e-444b-985f-3a0f578867b3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:00.826456 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-3319e028-6c0e-444b-985f-3a0f578867b3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Getting quotas for project 11b5d4706b2d43aca8290ccf07ee1ece. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:00:00.839833 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-3319e028-6c0e-444b-985f-3a0f578867b3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Getting quotas for user d68b017335c84d15becbdc7615498103 and project 11b5d4706b2d43aca8290ccf07ee1ece. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:00:00.877174 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3319e028-6c0e-444b-985f-3a0f578867b3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:00:00.880301 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3319e028-6c0e-444b-985f-3a0f578867b3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 2cad3ede-cfb3-48bb-b0e1-b999dc5cae07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:00:00.998940 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3319e028-6c0e-444b-985f-3a0f578867b3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.236495 Sep 08 11:00:01.004032 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2309/4688] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 10:59:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 2241 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 11:00:01.022266 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a59946cb-60e3-43f8-9651-154c81f799ff tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:01.036195 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a59946cb-60e3-43f8-9651-154c81f799ff tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8" status: 200 len: 1522 microversion: 2.1 time: 0.636220 Sep 08 11:00:01.037463 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2380/4689] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:00:00 2022] GET /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8 => generated 1522 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:00:01.040371 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3e7420d7-2673-441b-b9c1-5358b523a3f2 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:01.041007 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3e7420d7-2673-441b-b9c1-5358b523a3f2 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:01.044265 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-53b28043-f0ff-47c1-99d1-3fe18a456ba7 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:01.045761 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-53b28043-f0ff-47c1-99d1-3fe18a456ba7 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 2cad3ede-cfb3-48bb-b0e1-b999dc5cae07] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:01.070032 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e7420d7-2673-441b-b9c1-5358b523a3f2 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:01.070652 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e7420d7-2673-441b-b9c1-5358b523a3f2 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:01.071026 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e7420d7-2673-441b-b9c1-5358b523a3f2 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:01.076611 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e7420d7-2673-441b-b9c1-5358b523a3f2 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:01.077399 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e7420d7-2673-441b-b9c1-5358b523a3f2 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:01.079182 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e7420d7-2673-441b-b9c1-5358b523a3f2 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:01.400749 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-53b28043-f0ff-47c1-99d1-3fe18a456ba7 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:01.458701 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-53b28043-f0ff-47c1-99d1-3fe18a456ba7 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/2cad3ede-cfb3-48bb-b0e1-b999dc5cae07" status: 200 len: 1214 microversion: 2.1 time: 0.419644 Sep 08 11:00:01.459472 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2381/4690] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:00:01 2022] GET /compute/v2.1/servers/2cad3ede-cfb3-48bb-b0e1-b999dc5cae07 => generated 1214 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:00:01.470428 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c0f395e3-60cb-44d6-bb3d-651ddc1859c8 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:01.471179 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c0f395e3-60cb-44d6-bb3d-651ddc1859c8 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] [instance: e2a29434-ee7b-466c-baaf-945c7918d31c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:01.490214 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c0f395e3-60cb-44d6-bb3d-651ddc1859c8 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:01.490732 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c0f395e3-60cb-44d6-bb3d-651ddc1859c8 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:01.491177 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c0f395e3-60cb-44d6-bb3d-651ddc1859c8 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:01.491896 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c0f395e3-60cb-44d6-bb3d-651ddc1859c8 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:01.492365 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c0f395e3-60cb-44d6-bb3d-651ddc1859c8 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:01.492803 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c0f395e3-60cb-44d6-bb3d-651ddc1859c8 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:01.756128 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c0f395e3-60cb-44d6-bb3d-651ddc1859c8 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:01.795752 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c0f395e3-60cb-44d6-bb3d-651ddc1859c8 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:01.808178 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c0f395e3-60cb-44d6-bb3d-651ddc1859c8 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:01.811954 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c0f395e3-60cb-44d6-bb3d-651ddc1859c8 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] 10.222.0.27 "GET /compute/v2.1/servers/e2a29434-ee7b-466c-baaf-945c7918d31c" status: 200 len: 1366 microversion: 2.47 time: 0.348981 Sep 08 11:00:01.829964 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2382/4691] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:00:01 2022] GET /compute/v2.1/servers/e2a29434-ee7b-466c-baaf-945c7918d31c => generated 1366 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:00:01.865724 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8d0b977e-6b23-4cda-82d6-11c03e2dead1 tempest-VolumesTestJSON-887081819 tempest-VolumesTestJSON-887081819-project] Calling method '.version_select at 0x7f68e4d37c10>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:02.083534 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8d0b977e-6b23-4cda-82d6-11c03e2dead1 tempest-VolumesTestJSON-887081819 tempest-VolumesTestJSON-887081819-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/dc76420b-af9f-44f0-8991-18e076b9cb05" status: 200 len: 351 microversion: 2.1 time: 0.249955 Sep 08 11:00:02.084118 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2383/4692] 10.222.0.27 () {58 vars in 1245 bytes} [Thu Sep 8 11:00:01 2022] GET /compute/v2.1/os-volumes/dc76420b-af9f-44f0-8991-18e076b9cb05 => generated 351 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:00:02.092407 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-760eefa9-5000-4b1e-93c1-091c0bf73be4 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:02.097614 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-760eefa9-5000-4b1e-93c1-091c0bf73be4 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:02.143725 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-760eefa9-5000-4b1e-93c1-091c0bf73be4 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:02.146645 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-760eefa9-5000-4b1e-93c1-091c0bf73be4 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:02.148029 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-760eefa9-5000-4b1e-93c1-091c0bf73be4 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:02.150013 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-760eefa9-5000-4b1e-93c1-091c0bf73be4 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:02.151631 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-760eefa9-5000-4b1e-93c1-091c0bf73be4 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:02.154319 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-760eefa9-5000-4b1e-93c1-091c0bf73be4 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:02.400085 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3e7420d7-2673-441b-b9c1-5358b523a3f2 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:02.431401 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3e7420d7-2673-441b-b9c1-5358b523a3f2 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:02.436815 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3e7420d7-2673-441b-b9c1-5358b523a3f2 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:02.444453 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3e7420d7-2673-441b-b9c1-5358b523a3f2 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1844 microversion: 2.42 time: 1.431848 Sep 08 11:00:02.465057 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2310/4693] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:00:01 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1844 bytes in 1444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:00:02.500672 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-621de177-726b-4e21-8e75-c1f894262a17 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:02.501435 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-621de177-726b-4e21-8e75-c1f894262a17 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 2cad3ede-cfb3-48bb-b0e1-b999dc5cae07] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:02.530313 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-621de177-726b-4e21-8e75-c1f894262a17 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:02.532141 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-621de177-726b-4e21-8e75-c1f894262a17 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:02.533171 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-621de177-726b-4e21-8e75-c1f894262a17 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:02.534662 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-621de177-726b-4e21-8e75-c1f894262a17 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:02.535668 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-621de177-726b-4e21-8e75-c1f894262a17 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:02.536617 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-621de177-726b-4e21-8e75-c1f894262a17 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:02.905742 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-760eefa9-5000-4b1e-93c1-091c0bf73be4 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:02.941652 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-760eefa9-5000-4b1e-93c1-091c0bf73be4 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8" status: 200 len: 1522 microversion: 2.1 time: 0.853123 Sep 08 11:00:02.955951 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2384/4694] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:00:02 2022] GET /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8 => generated 1522 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:00:02.983260 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c4ae228c-c0f4-4601-a788-63d4f664c9d5 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:02.985177 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c4ae228c-c0f4-4601-a788-63d4f664c9d5 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] [instance: e2a29434-ee7b-466c-baaf-945c7918d31c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:02.996327 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c4ae228c-c0f4-4601-a788-63d4f664c9d5 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:02.997107 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c4ae228c-c0f4-4601-a788-63d4f664c9d5 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:02.999061 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c4ae228c-c0f4-4601-a788-63d4f664c9d5 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:03.001187 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c4ae228c-c0f4-4601-a788-63d4f664c9d5 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:03.002556 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c4ae228c-c0f4-4601-a788-63d4f664c9d5 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:03.003508 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c4ae228c-c0f4-4601-a788-63d4f664c9d5 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:03.214422 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c4ae228c-c0f4-4601-a788-63d4f664c9d5 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:03.228841 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c4ae228c-c0f4-4601-a788-63d4f664c9d5 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:03.230605 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c4ae228c-c0f4-4601-a788-63d4f664c9d5 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:03.236129 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c4ae228c-c0f4-4601-a788-63d4f664c9d5 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] 10.222.0.27 "GET /compute/v2.1/servers/e2a29434-ee7b-466c-baaf-945c7918d31c" status: 200 len: 1366 microversion: 2.47 time: 0.278476 Sep 08 11:00:03.237063 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2385/4695] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:00:02 2022] GET /compute/v2.1/servers/e2a29434-ee7b-466c-baaf-945c7918d31c => generated 1366 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:00:03.484102 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-418bad11-892e-4393-9e04-023ace09b7cf tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:03.486621 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-418bad11-892e-4393-9e04-023ace09b7cf tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:03.508310 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-418bad11-892e-4393-9e04-023ace09b7cf tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:03.508923 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-418bad11-892e-4393-9e04-023ace09b7cf tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:03.511085 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-418bad11-892e-4393-9e04-023ace09b7cf tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:03.511928 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-418bad11-892e-4393-9e04-023ace09b7cf tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:03.520338 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-418bad11-892e-4393-9e04-023ace09b7cf tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:03.521456 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-418bad11-892e-4393-9e04-023ace09b7cf tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:03.603405 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-621de177-726b-4e21-8e75-c1f894262a17 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:03.628037 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-621de177-726b-4e21-8e75-c1f894262a17 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/2cad3ede-cfb3-48bb-b0e1-b999dc5cae07" status: 200 len: 1210 microversion: 2.1 time: 1.128891 Sep 08 11:00:03.629738 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2311/4696] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:00:02 2022] GET /compute/v2.1/servers/2cad3ede-cfb3-48bb-b0e1-b999dc5cae07 => generated 1210 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:00:03.992945 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-de0a5cf4-809a-437c-8b90-0dbf95ed0fba tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:03.994016 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-de0a5cf4-809a-437c-8b90-0dbf95ed0fba tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:04.016782 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de0a5cf4-809a-437c-8b90-0dbf95ed0fba tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:04.018774 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de0a5cf4-809a-437c-8b90-0dbf95ed0fba tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:04.019418 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de0a5cf4-809a-437c-8b90-0dbf95ed0fba tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:04.020907 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de0a5cf4-809a-437c-8b90-0dbf95ed0fba tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:04.021586 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de0a5cf4-809a-437c-8b90-0dbf95ed0fba tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:04.022313 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de0a5cf4-809a-437c-8b90-0dbf95ed0fba tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:04.150544 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-418bad11-892e-4393-9e04-023ace09b7cf tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:04.177147 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-418bad11-892e-4393-9e04-023ace09b7cf tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:04.185671 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-418bad11-892e-4393-9e04-023ace09b7cf tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:04.186881 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-418bad11-892e-4393-9e04-023ace09b7cf tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1844 microversion: 2.42 time: 0.707034 Sep 08 11:00:04.187726 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2386/4697] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:00:03 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1844 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 11:00:04.276947 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a2a75a54-550c-453c-b5bf-48a71b127e77 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:04.279773 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a2a75a54-550c-453c-b5bf-48a71b127e77 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] [instance: e2a29434-ee7b-466c-baaf-945c7918d31c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:04.308730 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a2a75a54-550c-453c-b5bf-48a71b127e77 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:04.309500 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a2a75a54-550c-453c-b5bf-48a71b127e77 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:04.310092 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a2a75a54-550c-453c-b5bf-48a71b127e77 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:04.310972 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a2a75a54-550c-453c-b5bf-48a71b127e77 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:04.311590 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a2a75a54-550c-453c-b5bf-48a71b127e77 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:04.312135 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a2a75a54-550c-453c-b5bf-48a71b127e77 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:04.809284 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a2a75a54-550c-453c-b5bf-48a71b127e77 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:04.840534 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a2a75a54-550c-453c-b5bf-48a71b127e77 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:04.842625 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a2a75a54-550c-453c-b5bf-48a71b127e77 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:04.844424 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a2a75a54-550c-453c-b5bf-48a71b127e77 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] 10.222.0.27 "GET /compute/v2.1/servers/e2a29434-ee7b-466c-baaf-945c7918d31c" status: 200 len: 1366 microversion: 2.47 time: 0.574226 Sep 08 11:00:04.845010 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2387/4698] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:00:04 2022] GET /compute/v2.1/servers/e2a29434-ee7b-466c-baaf-945c7918d31c => generated 1366 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:00:04.906876 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-c83267ee-671a-4b86-a38f-1c9685e8dab1 req-5211168e-ea00-4d31-99a6-cd15c95abc0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8", "name": "network-vif-plugged", "status": "completed", "tag": "5f04b415-8433-4439-80f4-4d2e2907654b"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:00:04.944027 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-c83267ee-671a-4b86-a38f-1c9685e8dab1 req-5211168e-ea00-4d31-99a6-cd15c95abc0c service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:04.945314 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-c83267ee-671a-4b86-a38f-1c9685e8dab1 req-5211168e-ea00-4d31-99a6-cd15c95abc0c service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:04.957967 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-c83267ee-671a-4b86-a38f-1c9685e8dab1 req-5211168e-ea00-4d31-99a6-cd15c95abc0c service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:05.003691 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-c83267ee-671a-4b86-a38f-1c9685e8dab1 req-5211168e-ea00-4d31-99a6-cd15c95abc0c service nova] Creating event network-vif-plugged:5f04b415-8433-4439-80f4-4d2e2907654b for instance f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8 on n-h2-850501-12 Sep 08 11:00:05.012603 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-c83267ee-671a-4b86-a38f-1c9685e8dab1 req-5211168e-ea00-4d31-99a6-cd15c95abc0c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126185 Sep 08 11:00:05.014442 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2388/4699] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:00:05.034116 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-de0a5cf4-809a-437c-8b90-0dbf95ed0fba tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:05.037528 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-01b87661-4553-4af2-bc1c-c1262e1d89e6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:05.039287 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-01b87661-4553-4af2-bc1c-c1262e1d89e6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 2cad3ede-cfb3-48bb-b0e1-b999dc5cae07] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:05.051954 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-01b87661-4553-4af2-bc1c-c1262e1d89e6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:05.052685 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-01b87661-4553-4af2-bc1c-c1262e1d89e6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:05.054033 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-01b87661-4553-4af2-bc1c-c1262e1d89e6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:05.055771 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-de0a5cf4-809a-437c-8b90-0dbf95ed0fba tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8" status: 200 len: 1522 microversion: 2.1 time: 1.070517 Sep 08 11:00:05.056082 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-01b87661-4553-4af2-bc1c-c1262e1d89e6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:05.056383 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2312/4700] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:00:03 2022] GET /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8 => generated 1522 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:00:05.056981 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-01b87661-4553-4af2-bc1c-c1262e1d89e6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:05.057754 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-01b87661-4553-4af2-bc1c-c1262e1d89e6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:05.086347 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-40da43b9-efde-4038-99a7-7a1b94f0a766 req-26df9fc5-d345-409f-85df-86e3be7f4afb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59", "tag": "76a878f3-633e-4081-8c09-d5e66451d704"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:00:05.124973 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-40da43b9-efde-4038-99a7-7a1b94f0a766 req-26df9fc5-d345-409f-85df-86e3be7f4afb service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:05.126127 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-40da43b9-efde-4038-99a7-7a1b94f0a766 req-26df9fc5-d345-409f-85df-86e3be7f4afb service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:05.127074 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-40da43b9-efde-4038-99a7-7a1b94f0a766 req-26df9fc5-d345-409f-85df-86e3be7f4afb service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:05.157661 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-40da43b9-efde-4038-99a7-7a1b94f0a766 req-26df9fc5-d345-409f-85df-86e3be7f4afb service nova] Creating event network-changed:76a878f3-633e-4081-8c09-d5e66451d704 for instance 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 on n-h2-850501-12 Sep 08 11:00:05.177942 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-40da43b9-efde-4038-99a7-7a1b94f0a766 req-26df9fc5-d345-409f-85df-86e3be7f4afb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100869 Sep 08 11:00:05.178895 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2313/4701] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:00:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:00:05.216431 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1c6fb953-45a1-4e2f-8cc9-ef13436e3193 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:05.217429 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1c6fb953-45a1-4e2f-8cc9-ef13436e3193 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:05.247333 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c6fb953-45a1-4e2f-8cc9-ef13436e3193 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:05.248069 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c6fb953-45a1-4e2f-8cc9-ef13436e3193 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:05.248726 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c6fb953-45a1-4e2f-8cc9-ef13436e3193 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:05.257911 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c6fb953-45a1-4e2f-8cc9-ef13436e3193 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:05.258420 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c6fb953-45a1-4e2f-8cc9-ef13436e3193 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:05.258919 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c6fb953-45a1-4e2f-8cc9-ef13436e3193 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:05.520399 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-01b87661-4553-4af2-bc1c-c1262e1d89e6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:05.547780 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-01b87661-4553-4af2-bc1c-c1262e1d89e6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/2cad3ede-cfb3-48bb-b0e1-b999dc5cae07" status: 200 len: 1272 microversion: 2.1 time: 0.530782 Sep 08 11:00:05.548867 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2389/4702] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:00:05 2022] GET /compute/v2.1/servers/2cad3ede-cfb3-48bb-b0e1-b999dc5cae07 => generated 1272 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:00:05.597405 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b75871ed-63b3-420e-98e9-593a55ff14da tempest-VolumesTestJSON-887081819 tempest-VolumesTestJSON-887081819-project] Calling method '.version_select at 0x7f68e4babaf0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:05.691812 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b75871ed-63b3-420e-98e9-593a55ff14da tempest-VolumesTestJSON-887081819 tempest-VolumesTestJSON-887081819-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/f2328b31-533f-44c1-bc97-f3060dc29882" status: 200 len: 351 microversion: 2.1 time: 0.126749 Sep 08 11:00:05.693053 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2390/4703] 10.222.0.27 () {58 vars in 1245 bytes} [Thu Sep 8 11:00:05 2022] GET /compute/v2.1/os-volumes/f2328b31-533f-44c1-bc97-f3060dc29882 => generated 351 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:00:05.708628 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-435f15ec-d3c9-412b-a5d7-f8b2a48a8529 tempest-VolumesTestJSON-887081819 tempest-VolumesTestJSON-887081819-project] Calling method '.version_select at 0x7f68e518e310>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:05.857985 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-435f15ec-d3c9-412b-a5d7-f8b2a48a8529 tempest-VolumesTestJSON-887081819 tempest-VolumesTestJSON-887081819-project] 10.222.0.27 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.155247 Sep 08 11:00:05.858655 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2391/4704] 10.222.0.27 () {58 vars in 1134 bytes} [Thu Sep 8 11:00:05 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:00:05.876333 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9f04a9a1-360b-407d-a018-a8354ab56559 tempest-VolumesTestJSON-887081819 tempest-VolumesTestJSON-887081819-project] Calling method '.version_select at 0x7f68e40e6280>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:06.086034 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1c6fb953-45a1-4e2f-8cc9-ef13436e3193 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:06.092681 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9f04a9a1-360b-407d-a018-a8354ab56559 tempest-VolumesTestJSON-887081819 tempest-VolumesTestJSON-887081819-project] 10.222.0.27 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.221997 Sep 08 11:00:06.096225 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2392/4705] 10.222.0.27 () {58 vars in 1149 bytes} [Thu Sep 8 11:00:05 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:00:06.107920 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6d3ae942-cd68-44f3-85ff-accc56cf3f83 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:06.109948 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1c6fb953-45a1-4e2f-8cc9-ef13436e3193 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:06.111928 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6d3ae942-cd68-44f3-85ff-accc56cf3f83 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] [instance: e2a29434-ee7b-466c-baaf-945c7918d31c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:06.128915 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6d3ae942-cd68-44f3-85ff-accc56cf3f83 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:06.130235 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6d3ae942-cd68-44f3-85ff-accc56cf3f83 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:06.131753 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1c6fb953-45a1-4e2f-8cc9-ef13436e3193 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:06.132257 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6d3ae942-cd68-44f3-85ff-accc56cf3f83 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:06.133639 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1c6fb953-45a1-4e2f-8cc9-ef13436e3193 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1844 microversion: 2.42 time: 0.922068 Sep 08 11:00:06.134171 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6d3ae942-cd68-44f3-85ff-accc56cf3f83 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:06.134570 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2314/4706] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:00:05 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1844 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:00:06.135414 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6d3ae942-cd68-44f3-85ff-accc56cf3f83 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:06.136685 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6d3ae942-cd68-44f3-85ff-accc56cf3f83 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:06.153064 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4ab59b4f-714e-46ab-b3a0-b6876b22a381 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:06.153064 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4ab59b4f-714e-46ab-b3a0-b6876b22a381 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:06.180532 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ab59b4f-714e-46ab-b3a0-b6876b22a381 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:06.181428 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ab59b4f-714e-46ab-b3a0-b6876b22a381 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:06.182181 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ab59b4f-714e-46ab-b3a0-b6876b22a381 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:06.183236 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ab59b4f-714e-46ab-b3a0-b6876b22a381 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:06.183833 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ab59b4f-714e-46ab-b3a0-b6876b22a381 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:06.184483 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ab59b4f-714e-46ab-b3a0-b6876b22a381 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:06.328394 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6d3ae942-cd68-44f3-85ff-accc56cf3f83 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:06.361997 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6d3ae942-cd68-44f3-85ff-accc56cf3f83 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:06.370292 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6d3ae942-cd68-44f3-85ff-accc56cf3f83 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:06.372241 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6d3ae942-cd68-44f3-85ff-accc56cf3f83 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] 10.222.0.27 "GET /compute/v2.1/servers/e2a29434-ee7b-466c-baaf-945c7918d31c" status: 200 len: 1366 microversion: 2.47 time: 0.273935 Sep 08 11:00:06.380788 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2393/4707] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:00:06 2022] GET /compute/v2.1/servers/e2a29434-ee7b-466c-baaf-945c7918d31c => generated 1366 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:00:06.387581 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7c7b7d3f-4623-498c-8cd8-d915496984a1 tempest-VolumesTestJSON-887081819 tempest-VolumesTestJSON-887081819-project] Calling method '.version_select at 0x7f68e49f7160>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:06.506317 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7c7b7d3f-4623-498c-8cd8-d915496984a1 tempest-VolumesTestJSON-887081819 tempest-VolumesTestJSON-887081819-project] 10.222.0.27 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.123850 Sep 08 11:00:06.507148 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2394/4708] 10.222.0.27 () {58 vars in 1134 bytes} [Thu Sep 8 11:00:06 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:00:06.529486 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-26fc3339-e7aa-4ca1-a8d4-c266067aca33 tempest-VolumesTestJSON-887081819 tempest-VolumesTestJSON-887081819-project] Calling method '.version_select at 0x7f68e4d37280>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:06.830463 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-26fc3339-e7aa-4ca1-a8d4-c266067aca33 tempest-VolumesTestJSON-887081819 tempest-VolumesTestJSON-887081819-project] 10.222.0.27 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.311633 Sep 08 11:00:06.831059 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2395/4709] 10.222.0.27 () {58 vars in 1167 bytes} [Thu Sep 8 11:00:06 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:00:06.836482 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e689c8c5-2031-4c88-914e-e34fce0a84bc tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:06.837573 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e689c8c5-2031-4c88-914e-e34fce0a84bc tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 2cad3ede-cfb3-48bb-b0e1-b999dc5cae07] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:06.859908 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e689c8c5-2031-4c88-914e-e34fce0a84bc tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:06.860665 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e689c8c5-2031-4c88-914e-e34fce0a84bc tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:06.861348 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e689c8c5-2031-4c88-914e-e34fce0a84bc tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:06.862257 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e689c8c5-2031-4c88-914e-e34fce0a84bc tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:06.866566 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e689c8c5-2031-4c88-914e-e34fce0a84bc tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:06.867287 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e689c8c5-2031-4c88-914e-e34fce0a84bc tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:06.925659 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4ab59b4f-714e-46ab-b3a0-b6876b22a381 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:06.945101 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4ab59b4f-714e-46ab-b3a0-b6876b22a381 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8" status: 200 len: 1522 microversion: 2.1 time: 0.800521 Sep 08 11:00:06.947507 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2315/4710] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:00:06 2022] GET /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8 => generated 1522 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:00:06.960538 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4927357b-0461-4133-8f91-a63c86cc9a4e tempest-VolumesTestJSON-887081819 tempest-VolumesTestJSON-887081819-project] Calling method '.version_select at 0x7f68e8a611f0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:07.053013 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e689c8c5-2031-4c88-914e-e34fce0a84bc tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:07.066483 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e689c8c5-2031-4c88-914e-e34fce0a84bc tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/2cad3ede-cfb3-48bb-b0e1-b999dc5cae07" status: 200 len: 1272 microversion: 2.1 time: 0.234334 Sep 08 11:00:07.067085 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2396/4711] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:00:06 2022] GET /compute/v2.1/servers/2cad3ede-cfb3-48bb-b0e1-b999dc5cae07 => generated 1272 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:00:07.124514 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4927357b-0461-4133-8f91-a63c86cc9a4e tempest-VolumesTestJSON-887081819 tempest-VolumesTestJSON-887081819-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.174104 Sep 08 11:00:07.127427 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2316/4712] 10.222.0.27 () {58 vars in 1170 bytes} [Thu Sep 8 11:00:06 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:00:07.142564 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6e2a7103-3e38-4e70-8e66-6d4690f6d42d tempest-VolumesTestJSON-887081819 tempest-VolumesTestJSON-887081819-project] Calling method '.version_select at 0x7f68e4d23ee0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:07.165633 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8dde7189-a7dc-4a28-b25d-69d6bfbcf9a4 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:07.166246 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8dde7189-a7dc-4a28-b25d-69d6bfbcf9a4 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:07.197524 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8dde7189-a7dc-4a28-b25d-69d6bfbcf9a4 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:07.200478 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8dde7189-a7dc-4a28-b25d-69d6bfbcf9a4 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:07.205151 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8dde7189-a7dc-4a28-b25d-69d6bfbcf9a4 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:07.210074 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8dde7189-a7dc-4a28-b25d-69d6bfbcf9a4 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:07.211869 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8dde7189-a7dc-4a28-b25d-69d6bfbcf9a4 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:07.212932 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8dde7189-a7dc-4a28-b25d-69d6bfbcf9a4 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:07.259559 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6e2a7103-3e38-4e70-8e66-6d4690f6d42d tempest-VolumesTestJSON-887081819 tempest-VolumesTestJSON-887081819-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.121689 Sep 08 11:00:07.270628 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2397/4713] 10.222.0.27 () {58 vars in 1155 bytes} [Thu Sep 8 11:00:07 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:00:07.276468 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a2fc47a8-3529-415e-9a6d-f0730128edb2 tempest-VolumesTestJSON-887081819 tempest-VolumesTestJSON-887081819-project] Calling method '.version_select at 0x7f68e40ad820>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:07.482667 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a2fc47a8-3529-415e-9a6d-f0730128edb2 tempest-VolumesTestJSON-887081819 tempest-VolumesTestJSON-887081819-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.210634 Sep 08 11:00:07.492640 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2398/4714] 10.222.0.27 () {58 vars in 1188 bytes} [Thu Sep 8 11:00:07 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:00:07.498660 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7cc7d76c-9cee-4888-b27c-130ce85d2cfb tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:07.498660 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7cc7d76c-9cee-4888-b27c-130ce85d2cfb tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] [instance: e2a29434-ee7b-466c-baaf-945c7918d31c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:07.515945 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7cc7d76c-9cee-4888-b27c-130ce85d2cfb tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:07.516612 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7cc7d76c-9cee-4888-b27c-130ce85d2cfb tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:07.519183 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7cc7d76c-9cee-4888-b27c-130ce85d2cfb tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:07.521577 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7cc7d76c-9cee-4888-b27c-130ce85d2cfb tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:07.522226 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7cc7d76c-9cee-4888-b27c-130ce85d2cfb tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:07.525420 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7cc7d76c-9cee-4888-b27c-130ce85d2cfb tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:07.823565 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8dde7189-a7dc-4a28-b25d-69d6bfbcf9a4 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:07.859906 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8dde7189-a7dc-4a28-b25d-69d6bfbcf9a4 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:07.865377 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8dde7189-a7dc-4a28-b25d-69d6bfbcf9a4 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:07.869738 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8dde7189-a7dc-4a28-b25d-69d6bfbcf9a4 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1865 microversion: 2.42 time: 0.707517 Sep 08 11:00:07.871810 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2317/4715] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:00:07 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1865 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 11:00:07.888500 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-81b915e7-a40a-4e14-8552-825143f04e8d tempest-VolumesTestJSON-887081819 tempest-VolumesTestJSON-887081819-project] Calling method '.version_select at 0x7f68e45b98b0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:07.946197 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7cc7d76c-9cee-4888-b27c-130ce85d2cfb tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:07.980237 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7cc7d76c-9cee-4888-b27c-130ce85d2cfb tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:07.998907 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7cc7d76c-9cee-4888-b27c-130ce85d2cfb tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:08.001097 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7cc7d76c-9cee-4888-b27c-130ce85d2cfb tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] 10.222.0.27 "GET /compute/v2.1/servers/e2a29434-ee7b-466c-baaf-945c7918d31c" status: 200 len: 1366 microversion: 2.47 time: 0.507039 Sep 08 11:00:08.002036 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2399/4716] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:00:07 2022] GET /compute/v2.1/servers/e2a29434-ee7b-466c-baaf-945c7918d31c => generated 1366 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:00:08.032348 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1bee9660-20a7-46de-b542-84249a1e77e0 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:08.033431 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1bee9660-20a7-46de-b542-84249a1e77e0 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:08.075918 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1bee9660-20a7-46de-b542-84249a1e77e0 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:08.076754 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1bee9660-20a7-46de-b542-84249a1e77e0 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:08.087938 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1bee9660-20a7-46de-b542-84249a1e77e0 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:08.088972 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1bee9660-20a7-46de-b542-84249a1e77e0 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:08.089820 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1bee9660-20a7-46de-b542-84249a1e77e0 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:08.090570 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1bee9660-20a7-46de-b542-84249a1e77e0 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:08.243985 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-81b915e7-a40a-4e14-8552-825143f04e8d tempest-VolumesTestJSON-887081819 tempest-VolumesTestJSON-887081819-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.369233 Sep 08 11:00:08.244724 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2318/4717] 10.222.0.27 () {58 vars in 1155 bytes} [Thu Sep 8 11:00:07 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:00:08.250394 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-08d600ab-f016-4557-8bd7-ac08766b14ea tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:08.251020 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-08d600ab-f016-4557-8bd7-ac08766b14ea tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 2cad3ede-cfb3-48bb-b0e1-b999dc5cae07] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:08.269163 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08d600ab-f016-4557-8bd7-ac08766b14ea tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:08.269764 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08d600ab-f016-4557-8bd7-ac08766b14ea tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:08.270482 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08d600ab-f016-4557-8bd7-ac08766b14ea tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:08.276406 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08d600ab-f016-4557-8bd7-ac08766b14ea tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:08.277298 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08d600ab-f016-4557-8bd7-ac08766b14ea tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:08.277903 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08d600ab-f016-4557-8bd7-ac08766b14ea tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:08.861579 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1bee9660-20a7-46de-b542-84249a1e77e0 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:08.885144 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1bee9660-20a7-46de-b542-84249a1e77e0 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8" status: 200 len: 1507 microversion: 2.1 time: 0.878266 Sep 08 11:00:08.889242 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2400/4718] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:00:08 2022] GET /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8 => generated 1507 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:00:08.907418 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-10216db2-c382-4476-b640-1678232e69d8 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:08.908410 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-10216db2-c382-4476-b640-1678232e69d8 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:08.925785 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-10216db2-c382-4476-b640-1678232e69d8 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:08.926634 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-10216db2-c382-4476-b640-1678232e69d8 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:08.927338 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-10216db2-c382-4476-b640-1678232e69d8 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:08.928270 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-10216db2-c382-4476-b640-1678232e69d8 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:08.928899 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-10216db2-c382-4476-b640-1678232e69d8 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:08.929677 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-10216db2-c382-4476-b640-1678232e69d8 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:09.123515 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-08d600ab-f016-4557-8bd7-ac08766b14ea tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:09.149318 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-08d600ab-f016-4557-8bd7-ac08766b14ea tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/2cad3ede-cfb3-48bb-b0e1-b999dc5cae07" status: 200 len: 1314 microversion: 2.1 time: 0.900490 Sep 08 11:00:09.152059 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2319/4719] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:00:08 2022] GET /compute/v2.1/servers/2cad3ede-cfb3-48bb-b0e1-b999dc5cae07 => generated 1314 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:00:09.170003 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-96ea9245-267b-4e81-ae2c-87885d10a2b9 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:09.172284 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-96ea9245-267b-4e81-ae2c-87885d10a2b9 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:09.213927 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-96ea9245-267b-4e81-ae2c-87885d10a2b9 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:09.218902 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-96ea9245-267b-4e81-ae2c-87885d10a2b9 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:09.226114 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-96ea9245-267b-4e81-ae2c-87885d10a2b9 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:09.227427 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-96ea9245-267b-4e81-ae2c-87885d10a2b9 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:09.228261 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-96ea9245-267b-4e81-ae2c-87885d10a2b9 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:09.229052 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-96ea9245-267b-4e81-ae2c-87885d10a2b9 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:09.902913 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-96ea9245-267b-4e81-ae2c-87885d10a2b9 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:09.919387 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-96ea9245-267b-4e81-ae2c-87885d10a2b9 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8" status: 200 len: 1507 microversion: 2.1 time: 0.763288 Sep 08 11:00:09.923541 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2320/4720] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:00:09 2022] GET /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8 => generated 1507 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:00:09.941702 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-035571a8-a262-4a5e-b198-bd950796ed55 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:09.941900 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-035571a8-a262-4a5e-b198-bd950796ed55 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] [instance: e2a29434-ee7b-466c-baaf-945c7918d31c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:09.958428 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-035571a8-a262-4a5e-b198-bd950796ed55 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:09.959112 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-035571a8-a262-4a5e-b198-bd950796ed55 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:09.959568 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-035571a8-a262-4a5e-b198-bd950796ed55 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:09.962855 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-035571a8-a262-4a5e-b198-bd950796ed55 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:09.963389 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-035571a8-a262-4a5e-b198-bd950796ed55 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:09.968499 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-035571a8-a262-4a5e-b198-bd950796ed55 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:10.108253 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-035571a8-a262-4a5e-b198-bd950796ed55 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:10.128963 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-035571a8-a262-4a5e-b198-bd950796ed55 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:10.131509 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-035571a8-a262-4a5e-b198-bd950796ed55 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:10.132823 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-035571a8-a262-4a5e-b198-bd950796ed55 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] 10.222.0.27 "GET /compute/v2.1/servers/e2a29434-ee7b-466c-baaf-945c7918d31c" status: 200 len: 1366 microversion: 2.47 time: 0.202114 Sep 08 11:00:10.156978 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2321/4721] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:00:09 2022] GET /compute/v2.1/servers/e2a29434-ee7b-466c-baaf-945c7918d31c => generated 1366 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:00:10.183749 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-a89d1a02-c048-4287-b2e7-6155d3d8a8c3 req-8252f353-8c74-4a1b-9206-b2e3638c1870 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59", "tag": "5ccca1c6-6f4a-4fcf-9598-50a337d556cc"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:00:10.227758 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a89d1a02-c048-4287-b2e7-6155d3d8a8c3 req-8252f353-8c74-4a1b-9206-b2e3638c1870 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:10.228518 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a89d1a02-c048-4287-b2e7-6155d3d8a8c3 req-8252f353-8c74-4a1b-9206-b2e3638c1870 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:10.229289 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a89d1a02-c048-4287-b2e7-6155d3d8a8c3 req-8252f353-8c74-4a1b-9206-b2e3638c1870 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:10.248023 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-10216db2-c382-4476-b640-1678232e69d8 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:10.267807 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-10216db2-c382-4476-b640-1678232e69d8 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:10.269771 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-10216db2-c382-4476-b640-1678232e69d8 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:10.271008 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-a89d1a02-c048-4287-b2e7-6155d3d8a8c3 req-8252f353-8c74-4a1b-9206-b2e3638c1870 service nova] Creating event network-changed:5ccca1c6-6f4a-4fcf-9598-50a337d556cc for instance 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 on n-h2-850501-12 Sep 08 11:00:10.281429 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-10216db2-c382-4476-b640-1678232e69d8 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1865 microversion: 2.42 time: 1.374007 Sep 08 11:00:10.282398 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2401/4722] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:00:08 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1865 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:00:10.287814 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bd87855f-b1fe-4049-b383-aa94fd7e580b tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:10.288635 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bd87855f-b1fe-4049-b383-aa94fd7e580b tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:10.296160 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-a89d1a02-c048-4287-b2e7-6155d3d8a8c3 req-8252f353-8c74-4a1b-9206-b2e3638c1870 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137344 Sep 08 11:00:10.298998 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2322/4723] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:00:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:00:10.303481 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bd87855f-b1fe-4049-b383-aa94fd7e580b tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:10.304213 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bd87855f-b1fe-4049-b383-aa94fd7e580b tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:10.304820 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bd87855f-b1fe-4049-b383-aa94fd7e580b tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:10.305795 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bd87855f-b1fe-4049-b383-aa94fd7e580b tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:10.310372 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bd87855f-b1fe-4049-b383-aa94fd7e580b tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:10.311047 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bd87855f-b1fe-4049-b383-aa94fd7e580b tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:10.315048 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8f6d2a4e-94d0-47df-b754-40c447078484 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:10.317220 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8f6d2a4e-94d0-47df-b754-40c447078484 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 2cad3ede-cfb3-48bb-b0e1-b999dc5cae07] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:10.340651 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f6d2a4e-94d0-47df-b754-40c447078484 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:10.344676 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f6d2a4e-94d0-47df-b754-40c447078484 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:10.348013 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f6d2a4e-94d0-47df-b754-40c447078484 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:10.349356 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f6d2a4e-94d0-47df-b754-40c447078484 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:10.354467 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f6d2a4e-94d0-47df-b754-40c447078484 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:10.356743 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f6d2a4e-94d0-47df-b754-40c447078484 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:10.379177 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bd87855f-b1fe-4049-b383-aa94fd7e580b tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:00:10.535645 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=84 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:00:10.563127 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bd87855f-b1fe-4049-b383-aa94fd7e580b tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8" status: 204 len: 0 microversion: 2.1 time: 0.278693 Sep 08 11:00:10.573132 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2402/4724] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:00:10 2022] DELETE /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:00:10.800398 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:00:10.849539 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d39ad3e8-94ca-4787-8794-f71e52360d77 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1440353885", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "dc0a3241-15d1-4554-8d50-4b00e666d5ea"}]}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:00:10.868633 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:00:10.949925 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-d39ad3e8-94ca-4787-8794-f71e52360d77 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] validate_networks() for [('dc0a3241-15d1-4554-8d50-4b00e666d5ea', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:00:11.386488 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8f6d2a4e-94d0-47df-b754-40c447078484 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:11.405547 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8f6d2a4e-94d0-47df-b754-40c447078484 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/2cad3ede-cfb3-48bb-b0e1-b999dc5cae07" status: 200 len: 1314 microversion: 2.1 time: 1.101697 Sep 08 11:00:11.426777 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2323/4725] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:00:10 2022] GET /compute/v2.1/servers/2cad3ede-cfb3-48bb-b0e1-b999dc5cae07 => generated 1314 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:00:11.426777 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-348b3e3a-86b2-4267-b2da-058321ef2738 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:11.426777 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-348b3e3a-86b2-4267-b2da-058321ef2738 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] [instance: e2a29434-ee7b-466c-baaf-945c7918d31c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:11.449817 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-348b3e3a-86b2-4267-b2da-058321ef2738 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:11.450428 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-348b3e3a-86b2-4267-b2da-058321ef2738 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:11.450873 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-348b3e3a-86b2-4267-b2da-058321ef2738 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:11.451651 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-348b3e3a-86b2-4267-b2da-058321ef2738 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:11.452128 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-348b3e3a-86b2-4267-b2da-058321ef2738 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:11.452680 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-348b3e3a-86b2-4267-b2da-058321ef2738 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:11.453469 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:00:11.653933 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-348b3e3a-86b2-4267-b2da-058321ef2738 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:11.669891 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-348b3e3a-86b2-4267-b2da-058321ef2738 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:11.671600 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-348b3e3a-86b2-4267-b2da-058321ef2738 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:11.672805 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-348b3e3a-86b2-4267-b2da-058321ef2738 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] 10.222.0.27 "GET /compute/v2.1/servers/e2a29434-ee7b-466c-baaf-945c7918d31c" status: 200 len: 1366 microversion: 2.47 time: 0.259284 Sep 08 11:00:11.682124 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2324/4726] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:00:11 2022] GET /compute/v2.1/servers/e2a29434-ee7b-466c-baaf-945c7918d31c => generated 1366 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:00:11.692582 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-342b9c12-ac17-4266-906f-d9c513ba62a6 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:11.698405 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-342b9c12-ac17-4266-906f-d9c513ba62a6 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:11.715239 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-342b9c12-ac17-4266-906f-d9c513ba62a6 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:11.717787 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-342b9c12-ac17-4266-906f-d9c513ba62a6 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:11.718659 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-342b9c12-ac17-4266-906f-d9c513ba62a6 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:11.719566 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-342b9c12-ac17-4266-906f-d9c513ba62a6 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:11.723336 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-342b9c12-ac17-4266-906f-d9c513ba62a6 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:11.724041 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-342b9c12-ac17-4266-906f-d9c513ba62a6 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:12.731574 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-342b9c12-ac17-4266-906f-d9c513ba62a6 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:12.788613 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-342b9c12-ac17-4266-906f-d9c513ba62a6 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:12.790557 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-342b9c12-ac17-4266-906f-d9c513ba62a6 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:12.794843 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-342b9c12-ac17-4266-906f-d9c513ba62a6 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1865 microversion: 2.42 time: 1.107949 Sep 08 11:00:12.800698 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2325/4727] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:00:11 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1865 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:00:12.831692 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3bab0b37-c7f0-413c-b3fe-ab253c5eca40 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:12.840721 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3bab0b37-c7f0-413c-b3fe-ab253c5eca40 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 2cad3ede-cfb3-48bb-b0e1-b999dc5cae07] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:12.869050 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3bab0b37-c7f0-413c-b3fe-ab253c5eca40 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:12.879186 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3bab0b37-c7f0-413c-b3fe-ab253c5eca40 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:12.879818 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3bab0b37-c7f0-413c-b3fe-ab253c5eca40 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:12.884631 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3bab0b37-c7f0-413c-b3fe-ab253c5eca40 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:12.885288 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3bab0b37-c7f0-413c-b3fe-ab253c5eca40 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:12.887207 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3bab0b37-c7f0-413c-b3fe-ab253c5eca40 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:12.912886 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:00:13.172439 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-d39ad3e8-94ca-4787-8794-f71e52360d77 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:00:13.173448 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-d39ad3e8-94ca-4787-8794-f71e52360d77 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:00:13.174467 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-d39ad3e8-94ca-4787-8794-f71e52360d77 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:00:13.175347 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-d39ad3e8-94ca-4787-8794-f71e52360d77 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:00:13.177960 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-d39ad3e8-94ca-4787-8794-f71e52360d77 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:00:13.218831 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d39ad3e8-94ca-4787-8794-f71e52360d77 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:13.222102 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d39ad3e8-94ca-4787-8794-f71e52360d77 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:13.224726 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d39ad3e8-94ca-4787-8794-f71e52360d77 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:13.234982 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d39ad3e8-94ca-4787-8794-f71e52360d77 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:13.236179 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d39ad3e8-94ca-4787-8794-f71e52360d77 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:13.242163 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d39ad3e8-94ca-4787-8794-f71e52360d77 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:13.284201 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-d39ad3e8-94ca-4787-8794-f71e52360d77 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Getting quotas for project def11bb6a39848a5855a6c8534b5edba. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:00:13.291563 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-d39ad3e8-94ca-4787-8794-f71e52360d77 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Getting quotas for user 886104e81be14c18a30b75facfcf246e and project def11bb6a39848a5855a6c8534b5edba. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:00:13.329565 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3bab0b37-c7f0-413c-b3fe-ab253c5eca40 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:13.330244 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d39ad3e8-94ca-4787-8794-f71e52360d77 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:00:13.338700 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3bab0b37-c7f0-413c-b3fe-ab253c5eca40 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/2cad3ede-cfb3-48bb-b0e1-b999dc5cae07" status: 200 len: 1314 microversion: 2.1 time: 0.534591 Sep 08 11:00:13.339890 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d39ad3e8-94ca-4787-8794-f71e52360d77 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: dc6ac766-e3bf-456b-b595-f7d7a512571a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:00:13.361060 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2326/4728] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:00:12 2022] GET /compute/v2.1/servers/2cad3ede-cfb3-48bb-b0e1-b999dc5cae07 => generated 1314 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:00:13.363712 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7901ac28-373c-40b2-8575-f940af9d0411 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:13.368687 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7901ac28-373c-40b2-8575-f940af9d0411 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] [instance: e2a29434-ee7b-466c-baaf-945c7918d31c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:13.387709 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7901ac28-373c-40b2-8575-f940af9d0411 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:13.388214 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7901ac28-373c-40b2-8575-f940af9d0411 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:13.388653 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7901ac28-373c-40b2-8575-f940af9d0411 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:13.389414 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7901ac28-373c-40b2-8575-f940af9d0411 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:13.389905 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7901ac28-373c-40b2-8575-f940af9d0411 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:13.391283 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7901ac28-373c-40b2-8575-f940af9d0411 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:13.459379 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d39ad3e8-94ca-4787-8794-f71e52360d77 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.613964 Sep 08 11:00:13.460751 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2403/4729] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 11:00:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:00:13.478738 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7a18c77b-7675-4e0c-8898-d1f6f28340b9 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:13.479736 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7a18c77b-7675-4e0c-8898-d1f6f28340b9 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: dc6ac766-e3bf-456b-b595-f7d7a512571a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:13.703420 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7901ac28-373c-40b2-8575-f940af9d0411 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:13.712473 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7901ac28-373c-40b2-8575-f940af9d0411 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:13.714169 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7901ac28-373c-40b2-8575-f940af9d0411 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:13.715536 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7901ac28-373c-40b2-8575-f940af9d0411 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] 10.222.0.27 "GET /compute/v2.1/servers/e2a29434-ee7b-466c-baaf-945c7918d31c" status: 200 len: 1366 microversion: 2.47 time: 0.364674 Sep 08 11:00:13.725661 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2327/4730] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:00:13 2022] GET /compute/v2.1/servers/e2a29434-ee7b-466c-baaf-945c7918d31c => generated 1366 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:00:13.766634 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7a18c77b-7675-4e0c-8898-d1f6f28340b9 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:13.776119 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7a18c77b-7675-4e0c-8898-d1f6f28340b9 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/dc6ac766-e3bf-456b-b595-f7d7a512571a" status: 200 len: 1218 microversion: 2.1 time: 0.301483 Sep 08 11:00:13.784482 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2404/4731] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:00:13 2022] GET /compute/v2.1/servers/dc6ac766-e3bf-456b-b595-f7d7a512571a => generated 1218 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:00:13.840750 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-17c924c6-b40f-483f-a18e-7874944bb2a8 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:13.842713 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-17c924c6-b40f-483f-a18e-7874944bb2a8 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:13.881916 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-17c924c6-b40f-483f-a18e-7874944bb2a8 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:13.892311 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-17c924c6-b40f-483f-a18e-7874944bb2a8 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:13.892935 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-17c924c6-b40f-483f-a18e-7874944bb2a8 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:13.898195 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-17c924c6-b40f-483f-a18e-7874944bb2a8 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:13.898821 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-17c924c6-b40f-483f-a18e-7874944bb2a8 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:13.899281 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-17c924c6-b40f-483f-a18e-7874944bb2a8 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:14.375800 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d5dae71c-2d06-4e6e-9e8a-cfdaddc5cc37 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:14.377277 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d5dae71c-2d06-4e6e-9e8a-cfdaddc5cc37 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 2cad3ede-cfb3-48bb-b0e1-b999dc5cae07] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:14.388602 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d5dae71c-2d06-4e6e-9e8a-cfdaddc5cc37 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:14.394745 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d5dae71c-2d06-4e6e-9e8a-cfdaddc5cc37 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:14.395454 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d5dae71c-2d06-4e6e-9e8a-cfdaddc5cc37 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:14.396465 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d5dae71c-2d06-4e6e-9e8a-cfdaddc5cc37 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:14.397205 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d5dae71c-2d06-4e6e-9e8a-cfdaddc5cc37 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:14.397877 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d5dae71c-2d06-4e6e-9e8a-cfdaddc5cc37 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:15.079158 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-17c924c6-b40f-483f-a18e-7874944bb2a8 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:15.098950 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-17c924c6-b40f-483f-a18e-7874944bb2a8 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:15.103682 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-17c924c6-b40f-483f-a18e-7874944bb2a8 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:15.107381 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-17c924c6-b40f-483f-a18e-7874944bb2a8 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1886 microversion: 2.42 time: 1.273694 Sep 08 11:00:15.110438 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2328/4732] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:00:13 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1886 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:00:15.122137 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d6f6cc9a-cbc6-47ef-9404-5e6f413fd899 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:15.122785 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d6f6cc9a-cbc6-47ef-9404-5e6f413fd899 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] [instance: e2a29434-ee7b-466c-baaf-945c7918d31c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:15.137828 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d6f6cc9a-cbc6-47ef-9404-5e6f413fd899 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:15.141323 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d6f6cc9a-cbc6-47ef-9404-5e6f413fd899 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:15.142115 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d6f6cc9a-cbc6-47ef-9404-5e6f413fd899 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:15.143037 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d6f6cc9a-cbc6-47ef-9404-5e6f413fd899 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:15.143864 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d6f6cc9a-cbc6-47ef-9404-5e6f413fd899 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:15.144638 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d6f6cc9a-cbc6-47ef-9404-5e6f413fd899 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:15.515939 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d5dae71c-2d06-4e6e-9e8a-cfdaddc5cc37 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:15.524004 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d6f6cc9a-cbc6-47ef-9404-5e6f413fd899 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:15.528212 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d5dae71c-2d06-4e6e-9e8a-cfdaddc5cc37 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/2cad3ede-cfb3-48bb-b0e1-b999dc5cae07" status: 200 len: 1314 microversion: 2.1 time: 1.156282 Sep 08 11:00:15.531269 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2405/4733] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:00:14 2022] GET /compute/v2.1/servers/2cad3ede-cfb3-48bb-b0e1-b999dc5cae07 => generated 1314 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:00:15.566645 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8fd8476f-3727-45b0-9e79-4ec9d61e5342 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:15.567365 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d6f6cc9a-cbc6-47ef-9404-5e6f413fd899 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:15.569368 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8fd8476f-3727-45b0-9e79-4ec9d61e5342 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: dc6ac766-e3bf-456b-b595-f7d7a512571a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:15.580194 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d6f6cc9a-cbc6-47ef-9404-5e6f413fd899 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:15.585345 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d6f6cc9a-cbc6-47ef-9404-5e6f413fd899 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] 10.222.0.27 "GET /compute/v2.1/servers/e2a29434-ee7b-466c-baaf-945c7918d31c" status: 200 len: 1366 microversion: 2.47 time: 0.471497 Sep 08 11:00:15.586915 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8fd8476f-3727-45b0-9e79-4ec9d61e5342 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:15.587660 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8fd8476f-3727-45b0-9e79-4ec9d61e5342 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:15.590143 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8fd8476f-3727-45b0-9e79-4ec9d61e5342 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:15.591292 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2329/4734] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:00:15 2022] GET /compute/v2.1/servers/e2a29434-ee7b-466c-baaf-945c7918d31c => generated 1366 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:00:15.594056 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8fd8476f-3727-45b0-9e79-4ec9d61e5342 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:15.594714 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8fd8476f-3727-45b0-9e79-4ec9d61e5342 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:15.595349 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8fd8476f-3727-45b0-9e79-4ec9d61e5342 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:15.608478 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-4010a4c1-5a39-443d-859c-d2e1078b46e4 req-7bd857fb-1ca8-447d-9f21-9341ea66ef1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cad3ede-cfb3-48bb-b0e1-b999dc5cae07", "tag": "06ecac7f-05cd-4f87-9398-fe2c4f48cb33"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:00:15.663869 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-4010a4c1-5a39-443d-859c-d2e1078b46e4 req-7bd857fb-1ca8-447d-9f21-9341ea66ef1a service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:15.668871 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-4010a4c1-5a39-443d-859c-d2e1078b46e4 req-7bd857fb-1ca8-447d-9f21-9341ea66ef1a service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:15.669463 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-4010a4c1-5a39-443d-859c-d2e1078b46e4 req-7bd857fb-1ca8-447d-9f21-9341ea66ef1a service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:15.743675 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-4010a4c1-5a39-443d-859c-d2e1078b46e4 req-7bd857fb-1ca8-447d-9f21-9341ea66ef1a service nova] Creating event network-changed:06ecac7f-05cd-4f87-9398-fe2c4f48cb33 for instance 2cad3ede-cfb3-48bb-b0e1-b999dc5cae07 on n-h1-850501-12 Sep 08 11:00:15.760182 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-4010a4c1-5a39-443d-859c-d2e1078b46e4 req-7bd857fb-1ca8-447d-9f21-9341ea66ef1a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164574 Sep 08 11:00:15.762439 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2330/4735] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:00:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:00:16.007070 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8fd8476f-3727-45b0-9e79-4ec9d61e5342 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:16.014416 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:00:16.018404 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8fd8476f-3727-45b0-9e79-4ec9d61e5342 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/dc6ac766-e3bf-456b-b595-f7d7a512571a" status: 200 len: 1214 microversion: 2.1 time: 0.464933 Sep 08 11:00:16.025879 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2406/4736] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:00:15 2022] GET /compute/v2.1/servers/dc6ac766-e3bf-456b-b595-f7d7a512571a => generated 1214 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:00:16.149784 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ea9a1b76-6aad-4fe2-bc38-1f3a84e99dea tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:16.150633 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ea9a1b76-6aad-4fe2-bc38-1f3a84e99dea tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:16.167900 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea9a1b76-6aad-4fe2-bc38-1f3a84e99dea tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:16.169656 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea9a1b76-6aad-4fe2-bc38-1f3a84e99dea tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:16.172355 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea9a1b76-6aad-4fe2-bc38-1f3a84e99dea tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:16.178343 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea9a1b76-6aad-4fe2-bc38-1f3a84e99dea tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:16.182807 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea9a1b76-6aad-4fe2-bc38-1f3a84e99dea tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:16.183624 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea9a1b76-6aad-4fe2-bc38-1f3a84e99dea tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:16.562283 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b8022b4e-b298-4154-a886-7b1d47583ed3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:16.562926 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b8022b4e-b298-4154-a886-7b1d47583ed3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 2cad3ede-cfb3-48bb-b0e1-b999dc5cae07] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:16.581275 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b8022b4e-b298-4154-a886-7b1d47583ed3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:16.585283 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b8022b4e-b298-4154-a886-7b1d47583ed3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:16.585854 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b8022b4e-b298-4154-a886-7b1d47583ed3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:16.587163 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b8022b4e-b298-4154-a886-7b1d47583ed3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:16.587661 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b8022b4e-b298-4154-a886-7b1d47583ed3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:16.588110 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b8022b4e-b298-4154-a886-7b1d47583ed3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:16.788458 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ea9a1b76-6aad-4fe2-bc38-1f3a84e99dea tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:16.806532 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ea9a1b76-6aad-4fe2-bc38-1f3a84e99dea tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:16.812903 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ea9a1b76-6aad-4fe2-bc38-1f3a84e99dea tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:16.819820 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ea9a1b76-6aad-4fe2-bc38-1f3a84e99dea tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1886 microversion: 2.42 time: 0.671208 Sep 08 11:00:16.823174 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2331/4737] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:00:16 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1886 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:00:16.840059 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-59b23183-32bc-4fd9-84f3-de1c1e780233 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:16.842467 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-59b23183-32bc-4fd9-84f3-de1c1e780233 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] [instance: e2a29434-ee7b-466c-baaf-945c7918d31c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:16.867221 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-59b23183-32bc-4fd9-84f3-de1c1e780233 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:16.867221 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-59b23183-32bc-4fd9-84f3-de1c1e780233 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:16.867221 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-59b23183-32bc-4fd9-84f3-de1c1e780233 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:16.869996 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-59b23183-32bc-4fd9-84f3-de1c1e780233 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:16.871021 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-59b23183-32bc-4fd9-84f3-de1c1e780233 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:16.873585 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-59b23183-32bc-4fd9-84f3-de1c1e780233 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:17.579332 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-59b23183-32bc-4fd9-84f3-de1c1e780233 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:17.592591 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-59b23183-32bc-4fd9-84f3-de1c1e780233 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:17.595391 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-59b23183-32bc-4fd9-84f3-de1c1e780233 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:17.596672 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-59b23183-32bc-4fd9-84f3-de1c1e780233 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] 10.222.0.27 "GET /compute/v2.1/servers/e2a29434-ee7b-466c-baaf-945c7918d31c" status: 200 len: 1372 microversion: 2.47 time: 0.772111 Sep 08 11:00:17.597328 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2332/4738] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:00:16 2022] GET /compute/v2.1/servers/e2a29434-ee7b-466c-baaf-945c7918d31c => generated 1372 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:00:17.627458 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-16027341-a608-42e5-ab3b-5e1ab544cf28 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:17.628882 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-16027341-a608-42e5-ab3b-5e1ab544cf28 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: dc6ac766-e3bf-456b-b595-f7d7a512571a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:17.643567 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-16027341-a608-42e5-ab3b-5e1ab544cf28 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:17.644764 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-16027341-a608-42e5-ab3b-5e1ab544cf28 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:17.645961 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-16027341-a608-42e5-ab3b-5e1ab544cf28 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:17.647370 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-16027341-a608-42e5-ab3b-5e1ab544cf28 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:17.648260 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-16027341-a608-42e5-ab3b-5e1ab544cf28 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:17.649216 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-16027341-a608-42e5-ab3b-5e1ab544cf28 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:17.862003 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-16027341-a608-42e5-ab3b-5e1ab544cf28 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:17.879606 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-16027341-a608-42e5-ab3b-5e1ab544cf28 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/dc6ac766-e3bf-456b-b595-f7d7a512571a" status: 200 len: 1278 microversion: 2.1 time: 0.269897 Sep 08 11:00:17.881164 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2333/4739] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:00:17 2022] GET /compute/v2.1/servers/dc6ac766-e3bf-456b-b595-f7d7a512571a => generated 1278 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:00:17.893896 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0eea9c3b-b009-492e-8ff0-da27e9c33f35 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:17.897332 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0eea9c3b-b009-492e-8ff0-da27e9c33f35 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:17.913005 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0eea9c3b-b009-492e-8ff0-da27e9c33f35 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:17.915972 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0eea9c3b-b009-492e-8ff0-da27e9c33f35 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:17.918378 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0eea9c3b-b009-492e-8ff0-da27e9c33f35 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:17.919430 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0eea9c3b-b009-492e-8ff0-da27e9c33f35 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:17.921745 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0eea9c3b-b009-492e-8ff0-da27e9c33f35 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:17.922442 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0eea9c3b-b009-492e-8ff0-da27e9c33f35 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:18.130816 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b8022b4e-b298-4154-a886-7b1d47583ed3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:18.152289 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b8022b4e-b298-4154-a886-7b1d47583ed3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/2cad3ede-cfb3-48bb-b0e1-b999dc5cae07" status: 200 len: 1314 microversion: 2.1 time: 1.596844 Sep 08 11:00:18.169576 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2407/4740] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:00:16 2022] GET /compute/v2.1/servers/2cad3ede-cfb3-48bb-b0e1-b999dc5cae07 => generated 1314 bytes in 1615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:00:18.181414 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-acbc5dde-eda6-4679-9163-5e82088c00a5 req-4830f1c2-d7d3-47c9-a4da-d39336c5f953 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59", "tag": "ecb96651-93e7-41bd-9408-8b3399bfaef2"}, {"server_uuid": "f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8", "name": "network-vif-deleted", "tag": "5f04b415-8433-4439-80f4-4d2e2907654b"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:00:18.206117 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-acbc5dde-eda6-4679-9163-5e82088c00a5 req-4830f1c2-d7d3-47c9-a4da-d39336c5f953 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:18.206896 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-acbc5dde-eda6-4679-9163-5e82088c00a5 req-4830f1c2-d7d3-47c9-a4da-d39336c5f953 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:18.207491 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-acbc5dde-eda6-4679-9163-5e82088c00a5 req-4830f1c2-d7d3-47c9-a4da-d39336c5f953 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:18.226557 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-acbc5dde-eda6-4679-9163-5e82088c00a5 req-4830f1c2-d7d3-47c9-a4da-d39336c5f953 service nova] Creating event network-changed:ecb96651-93e7-41bd-9408-8b3399bfaef2 for instance 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 on n-h2-850501-12 Sep 08 11:00:18.227288 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-acbc5dde-eda6-4679-9163-5e82088c00a5 req-4830f1c2-d7d3-47c9-a4da-d39336c5f953 service nova] Creating event network-vif-deleted:5f04b415-8433-4439-80f4-4d2e2907654b for instance f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8 on n-h2-850501-12 Sep 08 11:00:18.242318 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-acbc5dde-eda6-4679-9163-5e82088c00a5 req-4830f1c2-d7d3-47c9-a4da-d39336c5f953 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.070945 Sep 08 11:00:18.243863 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2408/4741] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:00:18 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:00:18.606978 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0eea9c3b-b009-492e-8ff0-da27e9c33f35 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:18.634594 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0eea9c3b-b009-492e-8ff0-da27e9c33f35 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:18.639883 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0eea9c3b-b009-492e-8ff0-da27e9c33f35 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:18.641358 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0eea9c3b-b009-492e-8ff0-da27e9c33f35 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1874 microversion: 2.42 time: 0.757949 Sep 08 11:00:18.644623 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b069febe-6e55-47a0-85b7-23b1f159e73e tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:18.648531 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b069febe-6e55-47a0-85b7-23b1f159e73e tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] [instance: e2a29434-ee7b-466c-baaf-945c7918d31c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:18.649630 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2334/4742] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:00:17 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1874 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:00:18.698433 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b069febe-6e55-47a0-85b7-23b1f159e73e tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:18.699508 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b069febe-6e55-47a0-85b7-23b1f159e73e tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:18.705074 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b069febe-6e55-47a0-85b7-23b1f159e73e tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:18.709315 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b069febe-6e55-47a0-85b7-23b1f159e73e tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:18.710308 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b069febe-6e55-47a0-85b7-23b1f159e73e tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:18.714745 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b069febe-6e55-47a0-85b7-23b1f159e73e tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:18.928927 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6904581e-3646-481a-a1f6-73a7e0aef871 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:18.930132 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6904581e-3646-481a-a1f6-73a7e0aef871 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: dc6ac766-e3bf-456b-b595-f7d7a512571a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:18.941015 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6904581e-3646-481a-a1f6-73a7e0aef871 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:18.943123 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6904581e-3646-481a-a1f6-73a7e0aef871 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:18.943826 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6904581e-3646-481a-a1f6-73a7e0aef871 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:18.946881 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6904581e-3646-481a-a1f6-73a7e0aef871 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:18.947901 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6904581e-3646-481a-a1f6-73a7e0aef871 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:18.948518 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6904581e-3646-481a-a1f6-73a7e0aef871 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:19.163224 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6904581e-3646-481a-a1f6-73a7e0aef871 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:19.193257 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6904581e-3646-481a-a1f6-73a7e0aef871 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/dc6ac766-e3bf-456b-b595-f7d7a512571a" status: 200 len: 1276 microversion: 2.1 time: 0.264085 Sep 08 11:00:19.194531 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2335/4743] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:00:18 2022] GET /compute/v2.1/servers/dc6ac766-e3bf-456b-b595-f7d7a512571a => generated 1276 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:00:19.211304 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5652556c-2713-4465-aa29-e30ab3f854f4 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:19.213200 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5652556c-2713-4465-aa29-e30ab3f854f4 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 2cad3ede-cfb3-48bb-b0e1-b999dc5cae07] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:19.231731 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5652556c-2713-4465-aa29-e30ab3f854f4 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:19.236586 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5652556c-2713-4465-aa29-e30ab3f854f4 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:19.237059 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5652556c-2713-4465-aa29-e30ab3f854f4 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:19.237879 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5652556c-2713-4465-aa29-e30ab3f854f4 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:19.238342 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5652556c-2713-4465-aa29-e30ab3f854f4 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:19.238828 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5652556c-2713-4465-aa29-e30ab3f854f4 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:19.352239 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b069febe-6e55-47a0-85b7-23b1f159e73e tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:19.367551 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b069febe-6e55-47a0-85b7-23b1f159e73e tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:19.370427 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b069febe-6e55-47a0-85b7-23b1f159e73e tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:19.371676 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b069febe-6e55-47a0-85b7-23b1f159e73e tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] 10.222.0.27 "GET /compute/v2.1/servers/e2a29434-ee7b-466c-baaf-945c7918d31c" status: 200 len: 1372 microversion: 2.47 time: 0.740511 Sep 08 11:00:19.372262 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2409/4744] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:00:18 2022] GET /compute/v2.1/servers/e2a29434-ee7b-466c-baaf-945c7918d31c => generated 1372 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 11:00:19.684916 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-353b0831-6d9f-4058-8955-c4aa14d27241 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:19.686073 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-353b0831-6d9f-4058-8955-c4aa14d27241 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:19.703648 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-353b0831-6d9f-4058-8955-c4aa14d27241 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:19.704475 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-353b0831-6d9f-4058-8955-c4aa14d27241 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:19.707275 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-353b0831-6d9f-4058-8955-c4aa14d27241 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:19.708347 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-353b0831-6d9f-4058-8955-c4aa14d27241 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:19.710051 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-353b0831-6d9f-4058-8955-c4aa14d27241 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:19.712164 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-353b0831-6d9f-4058-8955-c4aa14d27241 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:20.158987 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5652556c-2713-4465-aa29-e30ab3f854f4 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:20.191639 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5652556c-2713-4465-aa29-e30ab3f854f4 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/2cad3ede-cfb3-48bb-b0e1-b999dc5cae07" status: 200 len: 1314 microversion: 2.1 time: 0.992561 Sep 08 11:00:20.195107 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2336/4745] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:00:19 2022] GET /compute/v2.1/servers/2cad3ede-cfb3-48bb-b0e1-b999dc5cae07 => generated 1314 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:00:20.237682 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-df80ae16-216c-4760-967b-7721abe7c3c3 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:20.240176 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-df80ae16-216c-4760-967b-7721abe7c3c3 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: dc6ac766-e3bf-456b-b595-f7d7a512571a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:20.269449 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df80ae16-216c-4760-967b-7721abe7c3c3 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:20.270456 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df80ae16-216c-4760-967b-7721abe7c3c3 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:20.271301 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df80ae16-216c-4760-967b-7721abe7c3c3 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:20.276883 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df80ae16-216c-4760-967b-7721abe7c3c3 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:20.277929 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df80ae16-216c-4760-967b-7721abe7c3c3 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:20.281117 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df80ae16-216c-4760-967b-7721abe7c3c3 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:20.482817 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-df80ae16-216c-4760-967b-7721abe7c3c3 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:20.498746 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-df80ae16-216c-4760-967b-7721abe7c3c3 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/dc6ac766-e3bf-456b-b595-f7d7a512571a" status: 200 len: 1276 microversion: 2.1 time: 0.270713 Sep 08 11:00:20.505293 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2337/4746] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:00:20 2022] GET /compute/v2.1/servers/dc6ac766-e3bf-456b-b595-f7d7a512571a => generated 1276 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:00:20.539158 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-353b0831-6d9f-4058-8955-c4aa14d27241 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:20.557877 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-353b0831-6d9f-4058-8955-c4aa14d27241 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:20.562212 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-353b0831-6d9f-4058-8955-c4aa14d27241 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:20.562721 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-eb870e01-9de2-4648-814b-70a7343a9017 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:20.563359 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-eb870e01-9de2-4648-814b-70a7343a9017 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] [instance: e2a29434-ee7b-466c-baaf-945c7918d31c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:20.568350 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-353b0831-6d9f-4058-8955-c4aa14d27241 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1874 microversion: 2.42 time: 0.887508 Sep 08 11:00:20.568960 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2410/4747] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:00:19 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1874 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 11:00:20.580569 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb870e01-9de2-4648-814b-70a7343a9017 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:20.580569 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb870e01-9de2-4648-814b-70a7343a9017 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:20.581280 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb870e01-9de2-4648-814b-70a7343a9017 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:20.590596 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb870e01-9de2-4648-814b-70a7343a9017 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:20.599845 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb870e01-9de2-4648-814b-70a7343a9017 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:20.600429 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb870e01-9de2-4648-814b-70a7343a9017 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:20.858582 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-eb870e01-9de2-4648-814b-70a7343a9017 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:20.872199 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-eb870e01-9de2-4648-814b-70a7343a9017 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:20.881059 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-eb870e01-9de2-4648-814b-70a7343a9017 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:20.882754 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-eb870e01-9de2-4648-814b-70a7343a9017 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] 10.222.0.27 "GET /compute/v2.1/servers/e2a29434-ee7b-466c-baaf-945c7918d31c" status: 200 len: 1357 microversion: 2.47 time: 0.326273 Sep 08 11:00:20.885468 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2338/4748] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:00:20 2022] GET /compute/v2.1/servers/e2a29434-ee7b-466c-baaf-945c7918d31c => generated 1357 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 11:00:20.927328 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-69ef2268-ffba-4ff5-a473-296411fe011b tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:20.933135 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-69ef2268-ffba-4ff5-a473-296411fe011b tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:20.937540 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-69ef2268-ffba-4ff5-a473-296411fe011b tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Searching by: {'deleted': False, 'project_id': '439ad18bf93e4b8aabbf49377b39a018'} {{(pid=128861) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 11:00:20.970081 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-69ef2268-ffba-4ff5-a473-296411fe011b tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:20.971679 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-69ef2268-ffba-4ff5-a473-296411fe011b tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:20.973789 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-69ef2268-ffba-4ff5-a473-296411fe011b tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:20.974144 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-a8d247e7-b69e-4fa9-abad-a269073ab18f req-60959142-3ea5-4e9b-9f92-66a7f7ba34cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59", "tag": "0cd4ca73-de26-4dfe-88cc-7092866bcfee"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:00:21.002473 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-69ef2268-ffba-4ff5-a473-296411fe011b tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:21.003550 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-69ef2268-ffba-4ff5-a473-296411fe011b tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:21.004212 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-69ef2268-ffba-4ff5-a473-296411fe011b tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:21.013359 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a8d247e7-b69e-4fa9-abad-a269073ab18f req-60959142-3ea5-4e9b-9f92-66a7f7ba34cf service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:21.014356 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a8d247e7-b69e-4fa9-abad-a269073ab18f req-60959142-3ea5-4e9b-9f92-66a7f7ba34cf service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:21.014941 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a8d247e7-b69e-4fa9-abad-a269073ab18f req-60959142-3ea5-4e9b-9f92-66a7f7ba34cf service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:21.050820 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-a8d247e7-b69e-4fa9-abad-a269073ab18f req-60959142-3ea5-4e9b-9f92-66a7f7ba34cf service nova] Creating event network-changed:0cd4ca73-de26-4dfe-88cc-7092866bcfee for instance 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 on n-h2-850501-12 Sep 08 11:00:21.066137 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-a8d247e7-b69e-4fa9-abad-a269073ab18f req-60959142-3ea5-4e9b-9f92-66a7f7ba34cf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095772 Sep 08 11:00:21.066902 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2339/4749] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:00:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:00:21.224354 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6be5e13a-2c4b-49be-a4c7-6aed8ced035d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:21.228235 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6be5e13a-2c4b-49be-a4c7-6aed8ced035d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 2cad3ede-cfb3-48bb-b0e1-b999dc5cae07] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:21.247144 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6be5e13a-2c4b-49be-a4c7-6aed8ced035d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:21.247930 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6be5e13a-2c4b-49be-a4c7-6aed8ced035d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:21.248568 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6be5e13a-2c4b-49be-a4c7-6aed8ced035d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:21.253892 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6be5e13a-2c4b-49be-a4c7-6aed8ced035d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:21.254690 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6be5e13a-2c4b-49be-a4c7-6aed8ced035d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:21.255299 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6be5e13a-2c4b-49be-a4c7-6aed8ced035d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:21.380539 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.multi_cell_list [None req-69ef2268-ffba-4ff5-a473-296411fe011b tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128861) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 11:00:21.641116 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-69ef2268-ffba-4ff5-a473-296411fe011b tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:21.662359 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-69ef2268-ffba-4ff5-a473-296411fe011b tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:21.663568 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-69ef2268-ffba-4ff5-a473-296411fe011b tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:21.664186 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-69ef2268-ffba-4ff5-a473-296411fe011b tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:21.682214 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-69ef2268-ffba-4ff5-a473-296411fe011b tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:21.685086 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-69ef2268-ffba-4ff5-a473-296411fe011b tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:22.130032 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6be5e13a-2c4b-49be-a4c7-6aed8ced035d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:22.145014 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6be5e13a-2c4b-49be-a4c7-6aed8ced035d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/2cad3ede-cfb3-48bb-b0e1-b999dc5cae07" status: 200 len: 1314 microversion: 2.1 time: 0.925536 Sep 08 11:00:22.146141 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2340/4750] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:00:21 2022] GET /compute/v2.1/servers/2cad3ede-cfb3-48bb-b0e1-b999dc5cae07 => generated 1314 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:00:22.151491 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-105a322f-5cea-4d45-992f-85cf1c3070ff tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:22.158922 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-105a322f-5cea-4d45-992f-85cf1c3070ff tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: dc6ac766-e3bf-456b-b595-f7d7a512571a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:22.183390 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-105a322f-5cea-4d45-992f-85cf1c3070ff tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:22.185845 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-105a322f-5cea-4d45-992f-85cf1c3070ff tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:22.192392 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-105a322f-5cea-4d45-992f-85cf1c3070ff tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:22.193675 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-105a322f-5cea-4d45-992f-85cf1c3070ff tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:22.194563 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-105a322f-5cea-4d45-992f-85cf1c3070ff tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:22.195574 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-105a322f-5cea-4d45-992f-85cf1c3070ff tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:22.287660 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-69ef2268-ffba-4ff5-a473-296411fe011b tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] 10.222.0.27 "GET /compute/v2.1/servers/detail" status: 200 len: 2707 microversion: 2.47 time: 1.364269 Sep 08 11:00:22.288323 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2411/4751] 10.222.0.27 () {60 vars in 1187 bytes} [Thu Sep 8 11:00:20 2022] GET /compute/v2.1/servers/detail => generated 2707 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:00:22.297416 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fc64700f-cefb-4a81-a6c2-a0d6df312909 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:22.297416 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fc64700f-cefb-4a81-a6c2-a0d6df312909 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:22.319198 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fc64700f-cefb-4a81-a6c2-a0d6df312909 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:22.319198 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fc64700f-cefb-4a81-a6c2-a0d6df312909 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:22.320381 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fc64700f-cefb-4a81-a6c2-a0d6df312909 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:22.321673 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fc64700f-cefb-4a81-a6c2-a0d6df312909 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:22.322324 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fc64700f-cefb-4a81-a6c2-a0d6df312909 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:22.325628 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fc64700f-cefb-4a81-a6c2-a0d6df312909 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:22.988185 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-fc64700f-cefb-4a81-a6c2-a0d6df312909 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:23.015516 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-fc64700f-cefb-4a81-a6c2-a0d6df312909 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:23.018857 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-fc64700f-cefb-4a81-a6c2-a0d6df312909 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:23.022410 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fc64700f-cefb-4a81-a6c2-a0d6df312909 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1874 microversion: 2.42 time: 0.733006 Sep 08 11:00:23.026304 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2412/4752] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:00:22 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1874 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:00:23.035094 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-185aa03f-1c91-4f19-bb32-103dc8c3538f tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:23.040063 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-185aa03f-1c91-4f19-bb32-103dc8c3538f tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] [instance: e2a29434-ee7b-466c-baaf-945c7918d31c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:23.054711 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-185aa03f-1c91-4f19-bb32-103dc8c3538f tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:23.057173 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-185aa03f-1c91-4f19-bb32-103dc8c3538f tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:23.057796 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-185aa03f-1c91-4f19-bb32-103dc8c3538f tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:23.059616 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-185aa03f-1c91-4f19-bb32-103dc8c3538f tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:23.061613 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-185aa03f-1c91-4f19-bb32-103dc8c3538f tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:23.062250 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-185aa03f-1c91-4f19-bb32-103dc8c3538f tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:23.127747 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-185aa03f-1c91-4f19-bb32-103dc8c3538f tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] [instance: e2a29434-ee7b-466c-baaf-945c7918d31c] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:00:23.319791 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-185aa03f-1c91-4f19-bb32-103dc8c3538f tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e2a29434-ee7b-466c-baaf-945c7918d31c" status: 204 len: 0 microversion: 2.47 time: 0.289964 Sep 08 11:00:23.322796 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2413/4753] 10.222.0.27 () {60 vars in 1280 bytes} [Thu Sep 8 11:00:23 2022] DELETE /compute/v2.1/servers/e2a29434-ee7b-466c-baaf-945c7918d31c => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 11:00:23.338463 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cae9f2e1-c86e-4ea2-88fb-c4baa3d56ae4 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:23.339189 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cae9f2e1-c86e-4ea2-88fb-c4baa3d56ae4 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 2cad3ede-cfb3-48bb-b0e1-b999dc5cae07] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:23.355905 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cae9f2e1-c86e-4ea2-88fb-c4baa3d56ae4 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:23.358789 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cae9f2e1-c86e-4ea2-88fb-c4baa3d56ae4 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:23.360138 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cae9f2e1-c86e-4ea2-88fb-c4baa3d56ae4 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:23.364068 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cae9f2e1-c86e-4ea2-88fb-c4baa3d56ae4 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:23.364806 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cae9f2e1-c86e-4ea2-88fb-c4baa3d56ae4 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:23.365451 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cae9f2e1-c86e-4ea2-88fb-c4baa3d56ae4 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:23.818448 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-105a322f-5cea-4d45-992f-85cf1c3070ff tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:23.846787 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-105a322f-5cea-4d45-992f-85cf1c3070ff tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/dc6ac766-e3bf-456b-b595-f7d7a512571a" status: 200 len: 1318 microversion: 2.1 time: 1.690422 Sep 08 11:00:23.850303 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2341/4754] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:00:22 2022] GET /compute/v2.1/servers/dc6ac766-e3bf-456b-b595-f7d7a512571a => generated 1318 bytes in 1703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:00:23.891694 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bdc4a0c1-776e-430b-898b-ab495807fee4 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:23.895623 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bdc4a0c1-776e-430b-898b-ab495807fee4 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] [instance: e2a29434-ee7b-466c-baaf-945c7918d31c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:23.932980 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bdc4a0c1-776e-430b-898b-ab495807fee4 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:23.938063 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bdc4a0c1-776e-430b-898b-ab495807fee4 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:23.942925 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bdc4a0c1-776e-430b-898b-ab495807fee4 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:23.943946 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bdc4a0c1-776e-430b-898b-ab495807fee4 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:23.947705 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bdc4a0c1-776e-430b-898b-ab495807fee4 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:23.950608 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bdc4a0c1-776e-430b-898b-ab495807fee4 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:24.263683 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bdc4a0c1-776e-430b-898b-ab495807fee4 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:24.284923 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bdc4a0c1-776e-430b-898b-ab495807fee4 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:24.286780 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bdc4a0c1-776e-430b-898b-ab495807fee4 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:24.288148 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bdc4a0c1-776e-430b-898b-ab495807fee4 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] 10.222.0.27 "GET /compute/v2.1/servers/e2a29434-ee7b-466c-baaf-945c7918d31c" status: 200 len: 1363 microversion: 2.47 time: 0.417990 Sep 08 11:00:24.289066 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2342/4755] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:00:23 2022] GET /compute/v2.1/servers/e2a29434-ee7b-466c-baaf-945c7918d31c => generated 1363 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:00:24.301584 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b73d791c-27cc-4de8-a406-a4016a48feca tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:24.303766 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b73d791c-27cc-4de8-a406-a4016a48feca tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:24.319478 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b73d791c-27cc-4de8-a406-a4016a48feca tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:24.319980 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b73d791c-27cc-4de8-a406-a4016a48feca tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:24.320421 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b73d791c-27cc-4de8-a406-a4016a48feca tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:24.321174 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b73d791c-27cc-4de8-a406-a4016a48feca tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:24.321641 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b73d791c-27cc-4de8-a406-a4016a48feca tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:24.322068 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b73d791c-27cc-4de8-a406-a4016a48feca tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:24.364706 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-cae9f2e1-c86e-4ea2-88fb-c4baa3d56ae4 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:24.393759 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cae9f2e1-c86e-4ea2-88fb-c4baa3d56ae4 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/2cad3ede-cfb3-48bb-b0e1-b999dc5cae07" status: 200 len: 1314 microversion: 2.1 time: 1.055292 Sep 08 11:00:24.395005 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2414/4756] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:00:23 2022] GET /compute/v2.1/servers/2cad3ede-cfb3-48bb-b0e1-b999dc5cae07 => generated 1314 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:00:24.667495 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-ce5ee744-20ae-4d51-b677-29d6f57258b8 req-7e22fa85-4467-4117-b36a-8f4760637672 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cad3ede-cfb3-48bb-b0e1-b999dc5cae07", "name": "network-vif-plugged", "status": "completed", "tag": "06ecac7f-05cd-4f87-9398-fe2c4f48cb33"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:00:24.696154 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-ce5ee744-20ae-4d51-b677-29d6f57258b8 req-7e22fa85-4467-4117-b36a-8f4760637672 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:24.700540 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-ce5ee744-20ae-4d51-b677-29d6f57258b8 req-7e22fa85-4467-4117-b36a-8f4760637672 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:24.701402 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-ce5ee744-20ae-4d51-b677-29d6f57258b8 req-7e22fa85-4467-4117-b36a-8f4760637672 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:24.737391 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-ce5ee744-20ae-4d51-b677-29d6f57258b8 req-7e22fa85-4467-4117-b36a-8f4760637672 service nova] Creating event network-vif-plugged:06ecac7f-05cd-4f87-9398-fe2c4f48cb33 for instance 2cad3ede-cfb3-48bb-b0e1-b999dc5cae07 on n-h1-850501-12 Sep 08 11:00:24.746028 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-ce5ee744-20ae-4d51-b677-29d6f57258b8 req-7e22fa85-4467-4117-b36a-8f4760637672 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084772 Sep 08 11:00:24.747199 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2415/4757] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:00:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:00:24.884892 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-df847763-5de5-4dd0-8a4a-199ba34f406d tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:24.897523 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-df847763-5de5-4dd0-8a4a-199ba34f406d tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: dc6ac766-e3bf-456b-b595-f7d7a512571a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:24.939052 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-df847763-5de5-4dd0-8a4a-199ba34f406d tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:24.940030 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-df847763-5de5-4dd0-8a4a-199ba34f406d tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:24.943976 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-df847763-5de5-4dd0-8a4a-199ba34f406d tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:24.945305 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-df847763-5de5-4dd0-8a4a-199ba34f406d tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:24.946364 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-df847763-5de5-4dd0-8a4a-199ba34f406d tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:24.947293 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-df847763-5de5-4dd0-8a4a-199ba34f406d tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:25.132954 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b73d791c-27cc-4de8-a406-a4016a48feca tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:25.160325 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b73d791c-27cc-4de8-a406-a4016a48feca tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:25.166947 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b73d791c-27cc-4de8-a406-a4016a48feca tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:25.169404 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b73d791c-27cc-4de8-a406-a4016a48feca tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1874 microversion: 2.42 time: 0.878045 Sep 08 11:00:25.171706 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2343/4758] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:00:24 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1874 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:00:25.326243 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a04cf06e-3927-49a9-a0c5-ece4c8ba4e6b tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:25.327413 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a04cf06e-3927-49a9-a0c5-ece4c8ba4e6b tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] [instance: e2a29434-ee7b-466c-baaf-945c7918d31c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:25.339113 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a04cf06e-3927-49a9-a0c5-ece4c8ba4e6b tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:25.340239 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a04cf06e-3927-49a9-a0c5-ece4c8ba4e6b tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:25.341616 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a04cf06e-3927-49a9-a0c5-ece4c8ba4e6b tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:25.344752 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a04cf06e-3927-49a9-a0c5-ece4c8ba4e6b tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:25.345849 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a04cf06e-3927-49a9-a0c5-ece4c8ba4e6b tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:25.346575 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a04cf06e-3927-49a9-a0c5-ece4c8ba4e6b tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:25.356398 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:00:25.558890 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a04cf06e-3927-49a9-a0c5-ece4c8ba4e6b tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:25.590284 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a04cf06e-3927-49a9-a0c5-ece4c8ba4e6b tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:25.593259 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a04cf06e-3927-49a9-a0c5-ece4c8ba4e6b tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:25.595811 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a04cf06e-3927-49a9-a0c5-ece4c8ba4e6b tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] 10.222.0.27 "GET /compute/v2.1/servers/e2a29434-ee7b-466c-baaf-945c7918d31c" status: 200 len: 1363 microversion: 2.47 time: 0.275608 Sep 08 11:00:25.605726 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2344/4759] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:00:25 2022] GET /compute/v2.1/servers/e2a29434-ee7b-466c-baaf-945c7918d31c => generated 1363 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:00:25.617992 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d9b6c2ec-5786-4d53-9b6a-2f5de4d0ead5 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:25.619050 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d9b6c2ec-5786-4d53-9b6a-2f5de4d0ead5 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 2cad3ede-cfb3-48bb-b0e1-b999dc5cae07] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:25.654143 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d9b6c2ec-5786-4d53-9b6a-2f5de4d0ead5 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:25.654998 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d9b6c2ec-5786-4d53-9b6a-2f5de4d0ead5 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:25.655686 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d9b6c2ec-5786-4d53-9b6a-2f5de4d0ead5 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:25.656819 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d9b6c2ec-5786-4d53-9b6a-2f5de4d0ead5 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:25.657582 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d9b6c2ec-5786-4d53-9b6a-2f5de4d0ead5 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:25.658266 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d9b6c2ec-5786-4d53-9b6a-2f5de4d0ead5 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:26.102985 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-df847763-5de5-4dd0-8a4a-199ba34f406d tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:26.114082 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-df847763-5de5-4dd0-8a4a-199ba34f406d tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/dc6ac766-e3bf-456b-b595-f7d7a512571a" status: 200 len: 1318 microversion: 2.1 time: 1.235456 Sep 08 11:00:26.115013 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2416/4760] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:00:24 2022] GET /compute/v2.1/servers/dc6ac766-e3bf-456b-b595-f7d7a512571a => generated 1318 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:00:26.162565 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-7efe4978-3947-42c0-a961-cd8554d824f1 req-d8ab22a3-9bf6-4670-9122-eb35b3125e97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc6ac766-e3bf-456b-b595-f7d7a512571a", "tag": "7810e56a-3d8e-4143-b7b9-f129f1fafdc6"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:00:26.178937 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-7efe4978-3947-42c0-a961-cd8554d824f1 req-d8ab22a3-9bf6-4670-9122-eb35b3125e97 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:26.179853 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-7efe4978-3947-42c0-a961-cd8554d824f1 req-d8ab22a3-9bf6-4670-9122-eb35b3125e97 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:26.180577 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-7efe4978-3947-42c0-a961-cd8554d824f1 req-d8ab22a3-9bf6-4670-9122-eb35b3125e97 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:26.219301 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-7efe4978-3947-42c0-a961-cd8554d824f1 req-d8ab22a3-9bf6-4670-9122-eb35b3125e97 service nova] Creating event network-changed:7810e56a-3d8e-4143-b7b9-f129f1fafdc6 for instance dc6ac766-e3bf-456b-b595-f7d7a512571a on n-h2-850501-12 Sep 08 11:00:26.235206 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-7efe4978-3947-42c0-a961-cd8554d824f1 req-d8ab22a3-9bf6-4670-9122-eb35b3125e97 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076245 Sep 08 11:00:26.236141 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2417/4761] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:00:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:00:26.241623 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-06b322ca-c20a-4fe6-9bf5-8ade7ea2e89a tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:26.249387 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-06b322ca-c20a-4fe6-9bf5-8ade7ea2e89a tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:26.258692 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d9b6c2ec-5786-4d53-9b6a-2f5de4d0ead5 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:26.261422 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06b322ca-c20a-4fe6-9bf5-8ade7ea2e89a tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:26.262133 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06b322ca-c20a-4fe6-9bf5-8ade7ea2e89a tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:26.262746 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06b322ca-c20a-4fe6-9bf5-8ade7ea2e89a tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:26.263644 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06b322ca-c20a-4fe6-9bf5-8ade7ea2e89a tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:26.270687 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06b322ca-c20a-4fe6-9bf5-8ade7ea2e89a tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:26.271327 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06b322ca-c20a-4fe6-9bf5-8ade7ea2e89a tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:26.279529 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d9b6c2ec-5786-4d53-9b6a-2f5de4d0ead5 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/2cad3ede-cfb3-48bb-b0e1-b999dc5cae07" status: 200 len: 1314 microversion: 2.1 time: 0.672158 Sep 08 11:00:26.284148 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2345/4762] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:00:25 2022] GET /compute/v2.1/servers/2cad3ede-cfb3-48bb-b0e1-b999dc5cae07 => generated 1314 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:00:26.637183 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1130e079-0de3-482a-b9d5-e4092ddca369 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:26.644176 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1130e079-0de3-482a-b9d5-e4092ddca369 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] [instance: e2a29434-ee7b-466c-baaf-945c7918d31c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:26.663870 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1130e079-0de3-482a-b9d5-e4092ddca369 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:26.664378 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1130e079-0de3-482a-b9d5-e4092ddca369 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:26.664823 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1130e079-0de3-482a-b9d5-e4092ddca369 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:26.679916 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1130e079-0de3-482a-b9d5-e4092ddca369 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:26.680722 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1130e079-0de3-482a-b9d5-e4092ddca369 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:26.681294 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1130e079-0de3-482a-b9d5-e4092ddca369 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:26.796159 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1130e079-0de3-482a-b9d5-e4092ddca369 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:26.798928 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1130e079-0de3-482a-b9d5-e4092ddca369 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:26.799563 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1130e079-0de3-482a-b9d5-e4092ddca369 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:26.800038 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-1130e079-0de3-482a-b9d5-e4092ddca369 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lazy-loading 'fault' on Instance uuid e2a29434-ee7b-466c-baaf-945c7918d31c {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:00:26.910188 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-06b322ca-c20a-4fe6-9bf5-8ade7ea2e89a tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:26.927991 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-06b322ca-c20a-4fe6-9bf5-8ade7ea2e89a tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:26.929883 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-06b322ca-c20a-4fe6-9bf5-8ade7ea2e89a tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:26.931306 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-06b322ca-c20a-4fe6-9bf5-8ade7ea2e89a tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1874 microversion: 2.42 time: 0.693873 Sep 08 11:00:26.934075 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2418/4763] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:00:26 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1874 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:00:27.142936 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f7732041-0be4-4020-bd1b-45aadc6cdd04 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:27.144290 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f7732041-0be4-4020-bd1b-45aadc6cdd04 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: dc6ac766-e3bf-456b-b595-f7d7a512571a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:27.155499 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f7732041-0be4-4020-bd1b-45aadc6cdd04 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:27.156008 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f7732041-0be4-4020-bd1b-45aadc6cdd04 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:27.164572 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f7732041-0be4-4020-bd1b-45aadc6cdd04 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:27.172936 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f7732041-0be4-4020-bd1b-45aadc6cdd04 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:27.174755 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f7732041-0be4-4020-bd1b-45aadc6cdd04 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:27.180285 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f7732041-0be4-4020-bd1b-45aadc6cdd04 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:27.413423 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1130e079-0de3-482a-b9d5-e4092ddca369 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:27.435761 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1130e079-0de3-482a-b9d5-e4092ddca369 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:27.440655 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1130e079-0de3-482a-b9d5-e4092ddca369 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:27.442230 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1130e079-0de3-482a-b9d5-e4092ddca369 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] 10.222.0.27 "GET /compute/v2.1/servers/e2a29434-ee7b-466c-baaf-945c7918d31c" status: 200 len: 1368 microversion: 2.47 time: 0.809648 Sep 08 11:00:27.444486 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2346/4764] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:00:26 2022] GET /compute/v2.1/servers/e2a29434-ee7b-466c-baaf-945c7918d31c => generated 1368 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:00:27.500219 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-86df0ef1-e6b1-4577-80bf-37678ad8d2b9 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:27.502318 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-86df0ef1-e6b1-4577-80bf-37678ad8d2b9 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 2cad3ede-cfb3-48bb-b0e1-b999dc5cae07] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:27.563834 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:00:27.589505 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-86df0ef1-e6b1-4577-80bf-37678ad8d2b9 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:27.591420 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-86df0ef1-e6b1-4577-80bf-37678ad8d2b9 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:27.592720 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-86df0ef1-e6b1-4577-80bf-37678ad8d2b9 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:27.600372 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-86df0ef1-e6b1-4577-80bf-37678ad8d2b9 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:27.607326 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-86df0ef1-e6b1-4577-80bf-37678ad8d2b9 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:27.608662 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-86df0ef1-e6b1-4577-80bf-37678ad8d2b9 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:27.865325 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f7732041-0be4-4020-bd1b-45aadc6cdd04 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:27.886006 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f7732041-0be4-4020-bd1b-45aadc6cdd04 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/dc6ac766-e3bf-456b-b595-f7d7a512571a" status: 200 len: 1318 microversion: 2.1 time: 0.747358 Sep 08 11:00:27.886606 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2419/4765] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:00:27 2022] GET /compute/v2.1/servers/dc6ac766-e3bf-456b-b595-f7d7a512571a => generated 1318 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:00:27.969982 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-442774e6-cee3-49a6-8542-e5aa38c202bc tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:27.970609 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-442774e6-cee3-49a6-8542-e5aa38c202bc tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:27.985076 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-442774e6-cee3-49a6-8542-e5aa38c202bc tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:27.985864 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-442774e6-cee3-49a6-8542-e5aa38c202bc tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:27.986717 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-442774e6-cee3-49a6-8542-e5aa38c202bc tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:27.987631 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-442774e6-cee3-49a6-8542-e5aa38c202bc tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:27.997300 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-442774e6-cee3-49a6-8542-e5aa38c202bc tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:27.998535 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-442774e6-cee3-49a6-8542-e5aa38c202bc tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:28.626591 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-442774e6-cee3-49a6-8542-e5aa38c202bc tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:28.646637 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-442774e6-cee3-49a6-8542-e5aa38c202bc tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:28.648108 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-442774e6-cee3-49a6-8542-e5aa38c202bc tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:28.650596 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-442774e6-cee3-49a6-8542-e5aa38c202bc tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1874 microversion: 2.42 time: 0.686452 Sep 08 11:00:28.653178 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2420/4766] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:00:27 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1874 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:00:28.665313 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-811dcf4e-c420-49c9-afb6-8129be7b000f req-9ac15943-30e9-408f-a61a-87a03c6c84b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59", "tag": "d3dee7fc-0d23-496a-962c-d681c647d159"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:00:28.690093 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-811dcf4e-c420-49c9-afb6-8129be7b000f req-9ac15943-30e9-408f-a61a-87a03c6c84b2 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:28.690913 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-811dcf4e-c420-49c9-afb6-8129be7b000f req-9ac15943-30e9-408f-a61a-87a03c6c84b2 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:28.691507 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-811dcf4e-c420-49c9-afb6-8129be7b000f req-9ac15943-30e9-408f-a61a-87a03c6c84b2 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:28.704862 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-811dcf4e-c420-49c9-afb6-8129be7b000f req-9ac15943-30e9-408f-a61a-87a03c6c84b2 service nova] Creating event network-changed:d3dee7fc-0d23-496a-962c-d681c647d159 for instance 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 on n-h2-850501-12 Sep 08 11:00:28.710901 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-811dcf4e-c420-49c9-afb6-8129be7b000f req-9ac15943-30e9-408f-a61a-87a03c6c84b2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054572 Sep 08 11:00:28.712649 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2421/4767] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:00:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:00:28.718832 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8ec93f38-1795-4db9-92ce-fd5f021e92eb tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:28.720314 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8ec93f38-1795-4db9-92ce-fd5f021e92eb tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] [instance: e2a29434-ee7b-466c-baaf-945c7918d31c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:28.738457 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8ec93f38-1795-4db9-92ce-fd5f021e92eb tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:28.739684 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8ec93f38-1795-4db9-92ce-fd5f021e92eb tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:28.740348 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8ec93f38-1795-4db9-92ce-fd5f021e92eb tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:28.741434 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8ec93f38-1795-4db9-92ce-fd5f021e92eb tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:28.742134 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8ec93f38-1795-4db9-92ce-fd5f021e92eb tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:28.742923 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8ec93f38-1795-4db9-92ce-fd5f021e92eb tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:28.763409 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-8ec93f38-1795-4db9-92ce-fd5f021e92eb tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] HTTP exception thrown: Instance e2a29434-ee7b-466c-baaf-945c7918d31c could not be found. Sep 08 11:00:28.766066 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8ec93f38-1795-4db9-92ce-fd5f021e92eb tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Request method failure captured: Sep 08 11:00:28.766066 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/e2a29434-ee7b-466c-baaf-945c7918d31c HTTP/1.1 Sep 08 11:00:28.766066 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:00:28.766066 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:00:28.766066 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:00:28.766066 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 11:00:28.766066 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:00:28.766066 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:00:28.766066 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:00:28.766066 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:00:28.766066 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcsRnFHVtOp6RKskoGDwC0vbu4wVNMkizABaZIC6PKwt7-qhHFy_S4LIsYSg_7axa5Li0SexuOsW6NPyTsg-6ZezudcmT2Bdf4WfkidH6IQyCJWaqBg7eTd5e5tBZTLZLw2i-i1c0wXi4y7ywfxEvfwLRXH4dcOWtmmFz-7LEj-XhR8 Sep 08 11:00:28.766066 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:00:28.766066 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:00:28.766066 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:00:28.766066 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:00:28.766066 n-d-850501-12 devstack@n-api.service[128861]: X-Openstack-Nova-Api-Version: 2.47 Sep 08 11:00:28.766066 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:00:28.766066 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:00:28.766066 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 439ad18bf93e4b8aabbf49377b39a018 Sep 08 11:00:28.766066 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServerShowV247Test-70235502 Sep 08 11:00:28.766066 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:00:28.766066 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:00:28.766066 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/439ad18bf93e4b8aabbf49377b39a018"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/439ad18bf93e4b8aabbf49377b39a018"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_439ad18bf93e4b8aabbf49377b39a018"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/439ad18bf93e4b8aabbf49377b39a018"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:00:28.766066 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServerShowV247Test-70235502 Sep 08 11:00:28.766066 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 439ad18bf93e4b8aabbf49377b39a018 Sep 08 11:00:28.766066 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServerShowV247Test-70235502 Sep 08 11:00:28.766066 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServerShowV247Test-70235502-project Sep 08 11:00:28.766066 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:00:28.766066 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:00:28.766066 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 84737bb9727d429fa322c7b311154ffe Sep 08 11:00:28.766066 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServerShowV247Test-70235502-project Sep 08 11:00:28.766066 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 11:00:28.766066 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance e2a29434-ee7b-466c-baaf-945c7918d31c could not be found. Sep 08 11:00:28.766066 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': 'e2a29434-ee7b-466c-baaf-945c7918d31c'} Sep 08 11:00:28.766066 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:00:28.766066 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:00:28.766066 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:00:28.766066 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:00:28.766066 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:00:28.766066 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:00:28.766066 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:00:28.766066 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:00:28.766066 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:00:28.766066 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:00:28.766066 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2a29434-ee7b-466c-baaf-945c7918d31c could not be found. Sep 08 11:00:28.766066 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:00:28.766066 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:00:28.766066 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:00:28.766066 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:00:28.766066 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:00:28.766066 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:00:28.766066 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:00:28.766066 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:00:28.766066 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:00:28.766066 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:00:28.766066 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:00:28.766066 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:00:28.766066 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:00:28.766066 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:00:28.766066 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:00:28.766066 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:00:28.766066 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2a29434-ee7b-466c-baaf-945c7918d31c could not be found. Sep 08 11:00:28.766066 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:00:28.766066 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:00:28.766066 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:00:28.773176 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:00:28.773176 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:00:28.773176 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:00:28.773176 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:00:28.773176 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:00:28.773176 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2a29434-ee7b-466c-baaf-945c7918d31c could not be found. Sep 08 11:00:28.773176 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:00:28.775661 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8ec93f38-1795-4db9-92ce-fd5f021e92eb tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Returning 404 to user: Instance e2a29434-ee7b-466c-baaf-945c7918d31c could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:00:28.777052 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8ec93f38-1795-4db9-92ce-fd5f021e92eb tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] 10.222.0.27 "GET /compute/v2.1/servers/e2a29434-ee7b-466c-baaf-945c7918d31c" status: 404 len: 111 microversion: 2.47 time: 0.062858 Sep 08 11:00:28.778033 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2422/4768] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:00:28 2022] GET /compute/v2.1/servers/e2a29434-ee7b-466c-baaf-945c7918d31c => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 11:00:28.800042 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4024076c-2953-40fb-bff9-1df27e7ae63a tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:28.801313 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4024076c-2953-40fb-bff9-1df27e7ae63a tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] [instance: 56dd4f3a-f9c7-4ec6-8be1-8e200e1a1f4d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:28.818880 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4024076c-2953-40fb-bff9-1df27e7ae63a tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:28.823204 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4024076c-2953-40fb-bff9-1df27e7ae63a tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:28.826847 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4024076c-2953-40fb-bff9-1df27e7ae63a tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:28.828079 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4024076c-2953-40fb-bff9-1df27e7ae63a tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:28.831719 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4024076c-2953-40fb-bff9-1df27e7ae63a tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:28.832916 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4024076c-2953-40fb-bff9-1df27e7ae63a tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:28.880430 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4024076c-2953-40fb-bff9-1df27e7ae63a tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] [instance: 56dd4f3a-f9c7-4ec6-8be1-8e200e1a1f4d] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:00:28.936987 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:00:29.063172 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4024076c-2953-40fb-bff9-1df27e7ae63a tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] 10.222.0.27 "DELETE /compute/v2.1/servers/56dd4f3a-f9c7-4ec6-8be1-8e200e1a1f4d" status: 204 len: 0 microversion: 2.47 time: 0.279145 Sep 08 11:00:29.064184 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2423/4769] 10.222.0.27 () {60 vars in 1280 bytes} [Thu Sep 8 11:00:28 2022] DELETE /compute/v2.1/servers/56dd4f3a-f9c7-4ec6-8be1-8e200e1a1f4d => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 11:00:29.070429 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ca23c265-d301-4b16-b1e8-2aafc58d6bf4 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:29.071529 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ca23c265-d301-4b16-b1e8-2aafc58d6bf4 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: dc6ac766-e3bf-456b-b595-f7d7a512571a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:29.078775 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ca23c265-d301-4b16-b1e8-2aafc58d6bf4 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:29.080087 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ca23c265-d301-4b16-b1e8-2aafc58d6bf4 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:29.081162 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ca23c265-d301-4b16-b1e8-2aafc58d6bf4 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:29.082738 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ca23c265-d301-4b16-b1e8-2aafc58d6bf4 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:29.084495 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ca23c265-d301-4b16-b1e8-2aafc58d6bf4 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:29.085961 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ca23c265-d301-4b16-b1e8-2aafc58d6bf4 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:29.305541 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-86df0ef1-e6b1-4577-80bf-37678ad8d2b9 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:29.331084 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-86df0ef1-e6b1-4577-80bf-37678ad8d2b9 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/2cad3ede-cfb3-48bb-b0e1-b999dc5cae07" status: 200 len: 1314 microversion: 2.1 time: 1.838398 Sep 08 11:00:29.334451 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2347/4770] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:00:27 2022] GET /compute/v2.1/servers/2cad3ede-cfb3-48bb-b0e1-b999dc5cae07 => generated 1314 bytes in 1869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:00:29.361222 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d4a0fcf4-9605-4cd4-a890-e6c0063c1016 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:29.362487 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d4a0fcf4-9605-4cd4-a890-e6c0063c1016 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] [instance: 56dd4f3a-f9c7-4ec6-8be1-8e200e1a1f4d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:29.373628 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d4a0fcf4-9605-4cd4-a890-e6c0063c1016 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:29.375069 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d4a0fcf4-9605-4cd4-a890-e6c0063c1016 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:29.375836 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d4a0fcf4-9605-4cd4-a890-e6c0063c1016 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:29.376467 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d4a0fcf4-9605-4cd4-a890-e6c0063c1016 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:29.377248 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d4a0fcf4-9605-4cd4-a890-e6c0063c1016 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:29.377739 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d4a0fcf4-9605-4cd4-a890-e6c0063c1016 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:29.682610 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d4a0fcf4-9605-4cd4-a890-e6c0063c1016 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:29.694496 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d4a0fcf4-9605-4cd4-a890-e6c0063c1016 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:29.702985 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d4a0fcf4-9605-4cd4-a890-e6c0063c1016 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:29.704328 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d4a0fcf4-9605-4cd4-a890-e6c0063c1016 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] 10.222.0.27 "GET /compute/v2.1/servers/56dd4f3a-f9c7-4ec6-8be1-8e200e1a1f4d" status: 200 len: 1363 microversion: 2.47 time: 0.367981 Sep 08 11:00:29.704925 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2348/4771] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:00:29 2022] GET /compute/v2.1/servers/56dd4f3a-f9c7-4ec6-8be1-8e200e1a1f4d => generated 1363 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:00:29.719722 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f5c609ae-a36a-44a1-91d3-fa4e86ea8f1d tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:29.720389 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f5c609ae-a36a-44a1-91d3-fa4e86ea8f1d tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:29.739919 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f5c609ae-a36a-44a1-91d3-fa4e86ea8f1d tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:29.744542 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f5c609ae-a36a-44a1-91d3-fa4e86ea8f1d tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:29.745453 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f5c609ae-a36a-44a1-91d3-fa4e86ea8f1d tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:29.746293 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f5c609ae-a36a-44a1-91d3-fa4e86ea8f1d tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:29.749712 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f5c609ae-a36a-44a1-91d3-fa4e86ea8f1d tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:29.751497 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f5c609ae-a36a-44a1-91d3-fa4e86ea8f1d tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:29.762522 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ca23c265-d301-4b16-b1e8-2aafc58d6bf4 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:29.773067 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ca23c265-d301-4b16-b1e8-2aafc58d6bf4 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/dc6ac766-e3bf-456b-b595-f7d7a512571a" status: 200 len: 1318 microversion: 2.1 time: 0.707090 Sep 08 11:00:29.774420 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2424/4772] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:00:29 2022] GET /compute/v2.1/servers/dc6ac766-e3bf-456b-b595-f7d7a512571a => generated 1318 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:00:30.367250 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d7bcea48-c5f9-4ea0-8b0c-8c6e0941f997 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:30.368312 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d7bcea48-c5f9-4ea0-8b0c-8c6e0941f997 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 2cad3ede-cfb3-48bb-b0e1-b999dc5cae07] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:30.380317 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d7bcea48-c5f9-4ea0-8b0c-8c6e0941f997 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:30.381697 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d7bcea48-c5f9-4ea0-8b0c-8c6e0941f997 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:30.383083 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d7bcea48-c5f9-4ea0-8b0c-8c6e0941f997 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:30.384017 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d7bcea48-c5f9-4ea0-8b0c-8c6e0941f997 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:30.384666 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d7bcea48-c5f9-4ea0-8b0c-8c6e0941f997 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:30.385447 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d7bcea48-c5f9-4ea0-8b0c-8c6e0941f997 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:31.050177 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f5c609ae-a36a-44a1-91d3-fa4e86ea8f1d tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:31.091426 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f5c609ae-a36a-44a1-91d3-fa4e86ea8f1d tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:31.098346 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f5c609ae-a36a-44a1-91d3-fa4e86ea8f1d tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:31.102026 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f5c609ae-a36a-44a1-91d3-fa4e86ea8f1d tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1874 microversion: 2.42 time: 1.395313 Sep 08 11:00:31.104853 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2349/4773] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:00:29 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1874 bytes in 1399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:00:31.115013 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-865fc35d-7f27-498c-b053-8379b76746a4 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:31.117744 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-865fc35d-7f27-498c-b053-8379b76746a4 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] [instance: 56dd4f3a-f9c7-4ec6-8be1-8e200e1a1f4d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:31.142403 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=4 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:00:31.149687 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-865fc35d-7f27-498c-b053-8379b76746a4 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:31.150929 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-865fc35d-7f27-498c-b053-8379b76746a4 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:31.151869 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-865fc35d-7f27-498c-b053-8379b76746a4 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:31.153855 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-865fc35d-7f27-498c-b053-8379b76746a4 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:31.155417 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-865fc35d-7f27-498c-b053-8379b76746a4 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:31.156663 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-865fc35d-7f27-498c-b053-8379b76746a4 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:31.386113 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-865fc35d-7f27-498c-b053-8379b76746a4 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:31.403668 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-865fc35d-7f27-498c-b053-8379b76746a4 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:31.406689 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-865fc35d-7f27-498c-b053-8379b76746a4 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:31.407932 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-865fc35d-7f27-498c-b053-8379b76746a4 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] 10.222.0.27 "GET /compute/v2.1/servers/56dd4f3a-f9c7-4ec6-8be1-8e200e1a1f4d" status: 200 len: 1363 microversion: 2.47 time: 0.301056 Sep 08 11:00:31.408502 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2350/4774] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:00:31 2022] GET /compute/v2.1/servers/56dd4f3a-f9c7-4ec6-8be1-8e200e1a1f4d => generated 1363 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:00:31.452899 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-67dd5740-ddad-41b1-b3f0-7093627d2e0f tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:31.453784 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-67dd5740-ddad-41b1-b3f0-7093627d2e0f tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: dc6ac766-e3bf-456b-b595-f7d7a512571a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:31.474544 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67dd5740-ddad-41b1-b3f0-7093627d2e0f tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:31.475133 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67dd5740-ddad-41b1-b3f0-7093627d2e0f tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:31.475657 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67dd5740-ddad-41b1-b3f0-7093627d2e0f tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:31.476497 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67dd5740-ddad-41b1-b3f0-7093627d2e0f tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:31.477061 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67dd5740-ddad-41b1-b3f0-7093627d2e0f tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:31.477557 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67dd5740-ddad-41b1-b3f0-7093627d2e0f tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:31.589977 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d7bcea48-c5f9-4ea0-8b0c-8c6e0941f997 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:31.601521 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d7bcea48-c5f9-4ea0-8b0c-8c6e0941f997 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/2cad3ede-cfb3-48bb-b0e1-b999dc5cae07" status: 200 len: 1502 microversion: 2.1 time: 1.241492 Sep 08 11:00:31.602922 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2425/4775] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:00:30 2022] GET /compute/v2.1/servers/2cad3ede-cfb3-48bb-b0e1-b999dc5cae07 => generated 1502 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:00:31.611952 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-5d64e218-7c7a-43cd-a06e-e97b3b3254a0 req-f8e0be8f-32c5-42bc-b938-b2f6e1c249b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59", "tag": "43a5e615-6fc8-4ec6-8b8a-8c3e382e1b29"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:00:31.627692 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-5d64e218-7c7a-43cd-a06e-e97b3b3254a0 req-f8e0be8f-32c5-42bc-b938-b2f6e1c249b7 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:31.628995 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-5d64e218-7c7a-43cd-a06e-e97b3b3254a0 req-f8e0be8f-32c5-42bc-b938-b2f6e1c249b7 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:31.629778 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-5d64e218-7c7a-43cd-a06e-e97b3b3254a0 req-f8e0be8f-32c5-42bc-b938-b2f6e1c249b7 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:31.633843 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=10 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:00:31.676221 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-5d64e218-7c7a-43cd-a06e-e97b3b3254a0 req-f8e0be8f-32c5-42bc-b938-b2f6e1c249b7 service nova] Creating event network-changed:43a5e615-6fc8-4ec6-8b8a-8c3e382e1b29 for instance 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 on n-h2-850501-12 Sep 08 11:00:31.684798 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-5d64e218-7c7a-43cd-a06e-e97b3b3254a0 req-f8e0be8f-32c5-42bc-b938-b2f6e1c249b7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079855 Sep 08 11:00:31.686788 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2426/4776] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:00:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:00:31.695831 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4c23885f-e8ce-4270-b9d8-e46e6317443b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:00:31.701846 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4c23885f-e8ce-4270-b9d8-e46e6317443b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 2cad3ede-cfb3-48bb-b0e1-b999dc5cae07] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:31.712567 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4c23885f-e8ce-4270-b9d8-e46e6317443b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:31.713463 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4c23885f-e8ce-4270-b9d8-e46e6317443b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:31.714286 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4c23885f-e8ce-4270-b9d8-e46e6317443b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:31.715155 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4c23885f-e8ce-4270-b9d8-e46e6317443b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:31.716158 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4c23885f-e8ce-4270-b9d8-e46e6317443b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:31.716947 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4c23885f-e8ce-4270-b9d8-e46e6317443b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:31.861880 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4c23885f-e8ce-4270-b9d8-e46e6317443b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "POST /compute/v2.1/servers/2cad3ede-cfb3-48bb-b0e1-b999dc5cae07/action" status: 202 len: 0 microversion: 2.1 time: 0.173196 Sep 08 11:00:31.864176 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2427/4777] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 11:00:31 2022] POST /compute/v2.1/servers/2cad3ede-cfb3-48bb-b0e1-b999dc5cae07/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:00:31.877575 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e38c9450-658b-401d-b0de-c2fee14633d5 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:31.878539 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e38c9450-658b-401d-b0de-c2fee14633d5 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 2cad3ede-cfb3-48bb-b0e1-b999dc5cae07] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:31.888375 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e38c9450-658b-401d-b0de-c2fee14633d5 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:31.889637 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e38c9450-658b-401d-b0de-c2fee14633d5 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:31.890416 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e38c9450-658b-401d-b0de-c2fee14633d5 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:31.891342 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e38c9450-658b-401d-b0de-c2fee14633d5 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:31.892096 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e38c9450-658b-401d-b0de-c2fee14633d5 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:31.892760 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e38c9450-658b-401d-b0de-c2fee14633d5 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:32.250997 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-67dd5740-ddad-41b1-b3f0-7093627d2e0f tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:32.264866 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-67dd5740-ddad-41b1-b3f0-7093627d2e0f tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/dc6ac766-e3bf-456b-b595-f7d7a512571a" status: 200 len: 1318 microversion: 2.1 time: 0.853087 Sep 08 11:00:32.266083 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2351/4778] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:00:31 2022] GET /compute/v2.1/servers/dc6ac766-e3bf-456b-b595-f7d7a512571a => generated 1318 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:00:32.277042 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-afefb0e2-60a0-4882-b913-56d4bdb259b2 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:32.278974 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-afefb0e2-60a0-4882-b913-56d4bdb259b2 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:32.296178 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-afefb0e2-60a0-4882-b913-56d4bdb259b2 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:32.297719 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-afefb0e2-60a0-4882-b913-56d4bdb259b2 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:32.299089 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-afefb0e2-60a0-4882-b913-56d4bdb259b2 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:32.301258 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-afefb0e2-60a0-4882-b913-56d4bdb259b2 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:32.302138 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-afefb0e2-60a0-4882-b913-56d4bdb259b2 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:32.303534 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-afefb0e2-60a0-4882-b913-56d4bdb259b2 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:32.522965 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e38c9450-658b-401d-b0de-c2fee14633d5 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:32.535831 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e38c9450-658b-401d-b0de-c2fee14633d5 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/2cad3ede-cfb3-48bb-b0e1-b999dc5cae07" status: 200 len: 1507 microversion: 2.1 time: 0.665159 Sep 08 11:00:32.541411 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2428/4779] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:00:31 2022] GET /compute/v2.1/servers/2cad3ede-cfb3-48bb-b0e1-b999dc5cae07 => generated 1507 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:00:32.562056 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-1ead7f8d-2461-4eb7-a3ac-977ebfdf2c34 req-070ac949-a715-4676-b56f-86e402e9289b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc6ac766-e3bf-456b-b595-f7d7a512571a", "name": "network-vif-plugged", "status": "completed", "tag": "7810e56a-3d8e-4143-b7b9-f129f1fafdc6"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:00:32.577480 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-1ead7f8d-2461-4eb7-a3ac-977ebfdf2c34 req-070ac949-a715-4676-b56f-86e402e9289b service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:32.578364 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-1ead7f8d-2461-4eb7-a3ac-977ebfdf2c34 req-070ac949-a715-4676-b56f-86e402e9289b service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:32.579197 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-1ead7f8d-2461-4eb7-a3ac-977ebfdf2c34 req-070ac949-a715-4676-b56f-86e402e9289b service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:32.595139 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-1ead7f8d-2461-4eb7-a3ac-977ebfdf2c34 req-070ac949-a715-4676-b56f-86e402e9289b service nova] Creating event network-vif-plugged:7810e56a-3d8e-4143-b7b9-f129f1fafdc6 for instance dc6ac766-e3bf-456b-b595-f7d7a512571a on n-h2-850501-12 Sep 08 11:00:32.600662 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-1ead7f8d-2461-4eb7-a3ac-977ebfdf2c34 req-070ac949-a715-4676-b56f-86e402e9289b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050289 Sep 08 11:00:32.605160 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2429/4780] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:00:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:00:32.612187 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b47043d0-6c91-4b77-b7bf-a6aace4d7cd1 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:32.613000 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b47043d0-6c91-4b77-b7bf-a6aace4d7cd1 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] [instance: 56dd4f3a-f9c7-4ec6-8be1-8e200e1a1f4d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:32.622714 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b47043d0-6c91-4b77-b7bf-a6aace4d7cd1 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:32.623856 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b47043d0-6c91-4b77-b7bf-a6aace4d7cd1 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:32.625790 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b47043d0-6c91-4b77-b7bf-a6aace4d7cd1 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:32.626994 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b47043d0-6c91-4b77-b7bf-a6aace4d7cd1 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:32.627913 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b47043d0-6c91-4b77-b7bf-a6aace4d7cd1 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:32.630019 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b47043d0-6c91-4b77-b7bf-a6aace4d7cd1 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:32.687479 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b47043d0-6c91-4b77-b7bf-a6aace4d7cd1 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:32.688085 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b47043d0-6c91-4b77-b7bf-a6aace4d7cd1 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:32.691477 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b47043d0-6c91-4b77-b7bf-a6aace4d7cd1 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:32.692104 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-b47043d0-6c91-4b77-b7bf-a6aace4d7cd1 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lazy-loading 'fault' on Instance uuid 56dd4f3a-f9c7-4ec6-8be1-8e200e1a1f4d {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:00:32.821047 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b47043d0-6c91-4b77-b7bf-a6aace4d7cd1 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:32.833268 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b47043d0-6c91-4b77-b7bf-a6aace4d7cd1 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:32.835279 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b47043d0-6c91-4b77-b7bf-a6aace4d7cd1 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84737bb9727d429fa322c7b311154ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '439ad18bf93e4b8aabbf49377b39a018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:32.836793 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b47043d0-6c91-4b77-b7bf-a6aace4d7cd1 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] 10.222.0.27 "GET /compute/v2.1/servers/56dd4f3a-f9c7-4ec6-8be1-8e200e1a1f4d" status: 200 len: 1368 microversion: 2.47 time: 0.230268 Sep 08 11:00:32.838308 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2430/4781] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:00:32 2022] GET /compute/v2.1/servers/56dd4f3a-f9c7-4ec6-8be1-8e200e1a1f4d => generated 1368 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:00:33.253656 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-afefb0e2-60a0-4882-b913-56d4bdb259b2 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:33.282976 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-afefb0e2-60a0-4882-b913-56d4bdb259b2 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:33.285088 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-afefb0e2-60a0-4882-b913-56d4bdb259b2 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:33.286599 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-afefb0e2-60a0-4882-b913-56d4bdb259b2 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1874 microversion: 2.42 time: 1.019489 Sep 08 11:00:33.289857 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e0c6b296-f594-4da8-b77b-03c3f94e6b13 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:33.290669 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e0c6b296-f594-4da8-b77b-03c3f94e6b13 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: dc6ac766-e3bf-456b-b595-f7d7a512571a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:33.305055 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2352/4782] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:00:32 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1874 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:00:33.329012 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e0c6b296-f594-4da8-b77b-03c3f94e6b13 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:33.329529 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e0c6b296-f594-4da8-b77b-03c3f94e6b13 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:33.330167 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e0c6b296-f594-4da8-b77b-03c3f94e6b13 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:33.331099 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e0c6b296-f594-4da8-b77b-03c3f94e6b13 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:33.331546 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e0c6b296-f594-4da8-b77b-03c3f94e6b13 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:33.332145 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e0c6b296-f594-4da8-b77b-03c3f94e6b13 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:33.567472 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ec151598-d3d5-4967-8eed-ac32acd9c7d1 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:33.568476 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ec151598-d3d5-4967-8eed-ac32acd9c7d1 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 2cad3ede-cfb3-48bb-b0e1-b999dc5cae07] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:33.577724 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec151598-d3d5-4967-8eed-ac32acd9c7d1 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:33.578888 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec151598-d3d5-4967-8eed-ac32acd9c7d1 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:33.579557 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec151598-d3d5-4967-8eed-ac32acd9c7d1 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:33.580526 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec151598-d3d5-4967-8eed-ac32acd9c7d1 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:33.581239 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec151598-d3d5-4967-8eed-ac32acd9c7d1 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:33.581884 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec151598-d3d5-4967-8eed-ac32acd9c7d1 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:33.762519 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e0c6b296-f594-4da8-b77b-03c3f94e6b13 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:33.774085 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e0c6b296-f594-4da8-b77b-03c3f94e6b13 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/dc6ac766-e3bf-456b-b595-f7d7a512571a" status: 200 len: 1318 microversion: 2.1 time: 0.486897 Sep 08 11:00:33.775086 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2431/4783] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:00:33 2022] GET /compute/v2.1/servers/dc6ac766-e3bf-456b-b595-f7d7a512571a => generated 1318 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:00:33.782529 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-b0173778-3673-42ce-8bd1-4b95c01e381a req-b509c486-a737-4040-8e0c-e2de641f030d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59", "tag": "9239d9ef-a9de-493e-bc47-0fcce1dee834"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:00:33.796021 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-b0173778-3673-42ce-8bd1-4b95c01e381a req-b509c486-a737-4040-8e0c-e2de641f030d service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:33.796611 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-b0173778-3673-42ce-8bd1-4b95c01e381a req-b509c486-a737-4040-8e0c-e2de641f030d service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:33.797343 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-b0173778-3673-42ce-8bd1-4b95c01e381a req-b509c486-a737-4040-8e0c-e2de641f030d service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:33.822030 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-b0173778-3673-42ce-8bd1-4b95c01e381a req-b509c486-a737-4040-8e0c-e2de641f030d service nova] Creating event network-changed:9239d9ef-a9de-493e-bc47-0fcce1dee834 for instance 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 on n-h2-850501-12 Sep 08 11:00:33.829730 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-b0173778-3673-42ce-8bd1-4b95c01e381a req-b509c486-a737-4040-8e0c-e2de641f030d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052369 Sep 08 11:00:33.831439 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2432/4784] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:00:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:00:33.865613 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9a4ede81-e34e-44b9-8cd2-16f21796f958 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:33.866333 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9a4ede81-e34e-44b9-8cd2-16f21796f958 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] [instance: 56dd4f3a-f9c7-4ec6-8be1-8e200e1a1f4d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:33.872950 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9a4ede81-e34e-44b9-8cd2-16f21796f958 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:33.874299 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9a4ede81-e34e-44b9-8cd2-16f21796f958 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:33.874851 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9a4ede81-e34e-44b9-8cd2-16f21796f958 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:33.875927 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9a4ede81-e34e-44b9-8cd2-16f21796f958 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:33.876389 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9a4ede81-e34e-44b9-8cd2-16f21796f958 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:33.876977 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9a4ede81-e34e-44b9-8cd2-16f21796f958 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:33.892443 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-9a4ede81-e34e-44b9-8cd2-16f21796f958 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] HTTP exception thrown: Instance 56dd4f3a-f9c7-4ec6-8be1-8e200e1a1f4d could not be found. Sep 08 11:00:33.894584 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9a4ede81-e34e-44b9-8cd2-16f21796f958 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Request method failure captured: Sep 08 11:00:33.894584 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/56dd4f3a-f9c7-4ec6-8be1-8e200e1a1f4d HTTP/1.1 Sep 08 11:00:33.894584 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:00:33.894584 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:00:33.894584 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:00:33.894584 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 11:00:33.894584 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:00:33.894584 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:00:33.894584 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:00:33.894584 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:00:33.894584 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcsRnFHVtOp6RKskoGDwC0vbu4wVNMkizABaZIC6PKwt7-qhHFy_S4LIsYSg_7axa5Li0SexuOsW6NPyTsg-6ZezudcmT2Bdf4WfkidH6IQyCJWaqBg7eTd5e5tBZTLZLw2i-i1c0wXi4y7ywfxEvfwLRXH4dcOWtmmFz-7LEj-XhR8 Sep 08 11:00:33.894584 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:00:33.894584 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:00:33.894584 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:00:33.894584 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:00:33.894584 n-d-850501-12 devstack@n-api.service[128861]: X-Openstack-Nova-Api-Version: 2.47 Sep 08 11:00:33.894584 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:00:33.894584 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:00:33.894584 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 439ad18bf93e4b8aabbf49377b39a018 Sep 08 11:00:33.894584 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServerShowV247Test-70235502 Sep 08 11:00:33.894584 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:00:33.894584 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:00:33.894584 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/439ad18bf93e4b8aabbf49377b39a018"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/439ad18bf93e4b8aabbf49377b39a018"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_439ad18bf93e4b8aabbf49377b39a018"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/439ad18bf93e4b8aabbf49377b39a018"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:00:33.894584 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServerShowV247Test-70235502 Sep 08 11:00:33.894584 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 439ad18bf93e4b8aabbf49377b39a018 Sep 08 11:00:33.894584 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServerShowV247Test-70235502 Sep 08 11:00:33.894584 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServerShowV247Test-70235502-project Sep 08 11:00:33.894584 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:00:33.894584 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:00:33.894584 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 84737bb9727d429fa322c7b311154ffe Sep 08 11:00:33.894584 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServerShowV247Test-70235502-project Sep 08 11:00:33.894584 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 11:00:33.894584 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 56dd4f3a-f9c7-4ec6-8be1-8e200e1a1f4d could not be found. Sep 08 11:00:33.894584 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '56dd4f3a-f9c7-4ec6-8be1-8e200e1a1f4d'} Sep 08 11:00:33.894584 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:00:33.894584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:00:33.894584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:00:33.894584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:00:33.894584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:00:33.894584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:00:33.894584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:00:33.894584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:00:33.894584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:00:33.894584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:00:33.894584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56dd4f3a-f9c7-4ec6-8be1-8e200e1a1f4d could not be found. Sep 08 11:00:33.894584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:00:33.894584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:00:33.894584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:00:33.894584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:00:33.894584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:00:33.894584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:00:33.894584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:00:33.894584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:00:33.894584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:00:33.894584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:00:33.894584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:00:33.894584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:00:33.894584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:00:33.894584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:00:33.894584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:00:33.894584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:00:33.894584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56dd4f3a-f9c7-4ec6-8be1-8e200e1a1f4d could not be found. Sep 08 11:00:33.894584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:00:33.894584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:00:33.894584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:00:33.902617 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:00:33.902617 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:00:33.902617 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:00:33.902617 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:00:33.902617 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:00:33.902617 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56dd4f3a-f9c7-4ec6-8be1-8e200e1a1f4d could not be found. Sep 08 11:00:33.902617 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:00:33.905985 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9a4ede81-e34e-44b9-8cd2-16f21796f958 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] Returning 404 to user: Instance 56dd4f3a-f9c7-4ec6-8be1-8e200e1a1f4d could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:00:33.907046 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9a4ede81-e34e-44b9-8cd2-16f21796f958 tempest-ServerShowV247Test-70235502 tempest-ServerShowV247Test-70235502-project] 10.222.0.27 "GET /compute/v2.1/servers/56dd4f3a-f9c7-4ec6-8be1-8e200e1a1f4d" status: 404 len: 111 microversion: 2.47 time: 0.046154 Sep 08 11:00:33.908384 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2433/4785] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:00:33 2022] GET /compute/v2.1/servers/56dd4f3a-f9c7-4ec6-8be1-8e200e1a1f4d => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 08 11:00:33.977913 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ec151598-d3d5-4967-8eed-ac32acd9c7d1 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:33.988196 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ec151598-d3d5-4967-8eed-ac32acd9c7d1 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/2cad3ede-cfb3-48bb-b0e1-b999dc5cae07" status: 200 len: 1487 microversion: 2.1 time: 0.424603 Sep 08 11:00:33.988788 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2353/4786] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:00:33 2022] GET /compute/v2.1/servers/2cad3ede-cfb3-48bb-b0e1-b999dc5cae07 => generated 1487 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:00:34.015189 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-76f0ec28-e7cf-4628-80cf-63e9e761701c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:00:34.015753 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-76f0ec28-e7cf-4628-80cf-63e9e761701c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 2cad3ede-cfb3-48bb-b0e1-b999dc5cae07] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:34.017852 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:00:34.028449 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-76f0ec28-e7cf-4628-80cf-63e9e761701c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:34.028936 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-76f0ec28-e7cf-4628-80cf-63e9e761701c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:34.031874 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-76f0ec28-e7cf-4628-80cf-63e9e761701c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:34.032622 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-76f0ec28-e7cf-4628-80cf-63e9e761701c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:34.036314 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-76f0ec28-e7cf-4628-80cf-63e9e761701c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:34.038367 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-76f0ec28-e7cf-4628-80cf-63e9e761701c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:34.090706 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-76f0ec28-e7cf-4628-80cf-63e9e761701c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lazy-loading 'flavor' on Instance uuid 2cad3ede-cfb3-48bb-b0e1-b999dc5cae07 {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:00:34.325470 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2d852d49-30b0-4a22-a724-e85c79e5e482 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:34.326081 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2d852d49-30b0-4a22-a724-e85c79e5e482 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:34.332878 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2d852d49-30b0-4a22-a724-e85c79e5e482 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:34.333409 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2d852d49-30b0-4a22-a724-e85c79e5e482 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:34.333843 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2d852d49-30b0-4a22-a724-e85c79e5e482 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:34.334549 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2d852d49-30b0-4a22-a724-e85c79e5e482 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:34.335006 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2d852d49-30b0-4a22-a724-e85c79e5e482 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:34.335430 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2d852d49-30b0-4a22-a724-e85c79e5e482 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:34.411656 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-76f0ec28-e7cf-4628-80cf-63e9e761701c tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "POST /compute/v2.1/servers/2cad3ede-cfb3-48bb-b0e1-b999dc5cae07/action" status: 202 len: 0 microversion: 2.1 time: 0.396904 Sep 08 11:00:34.412616 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2434/4787] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 11:00:34 2022] POST /compute/v2.1/servers/2cad3ede-cfb3-48bb-b0e1-b999dc5cae07/action => generated 0 bytes in 402 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:00:34.430157 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c16c7bc7-eeac-4a18-85e3-da39e2f4af8a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:34.432354 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c16c7bc7-eeac-4a18-85e3-da39e2f4af8a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 2cad3ede-cfb3-48bb-b0e1-b999dc5cae07] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:34.443145 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c16c7bc7-eeac-4a18-85e3-da39e2f4af8a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:34.444291 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c16c7bc7-eeac-4a18-85e3-da39e2f4af8a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:34.445597 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c16c7bc7-eeac-4a18-85e3-da39e2f4af8a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:34.447468 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c16c7bc7-eeac-4a18-85e3-da39e2f4af8a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:34.449121 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c16c7bc7-eeac-4a18-85e3-da39e2f4af8a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:34.449783 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c16c7bc7-eeac-4a18-85e3-da39e2f4af8a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:34.850826 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2d852d49-30b0-4a22-a724-e85c79e5e482 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:34.880722 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2d852d49-30b0-4a22-a724-e85c79e5e482 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:34.888019 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2d852d49-30b0-4a22-a724-e85c79e5e482 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:34.892445 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2d852d49-30b0-4a22-a724-e85c79e5e482 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1874 microversion: 2.42 time: 0.572978 Sep 08 11:00:34.930181 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2354/4788] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:00:34 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1874 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 11:00:34.943600 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d9a21be5-f924-4045-a4eb-d4128f122f93 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:34.944225 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d9a21be5-f924-4045-a4eb-d4128f122f93 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: dc6ac766-e3bf-456b-b595-f7d7a512571a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:34.955292 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d9a21be5-f924-4045-a4eb-d4128f122f93 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:34.957306 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d9a21be5-f924-4045-a4eb-d4128f122f93 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:34.958326 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d9a21be5-f924-4045-a4eb-d4128f122f93 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:34.960293 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d9a21be5-f924-4045-a4eb-d4128f122f93 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:34.961163 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d9a21be5-f924-4045-a4eb-d4128f122f93 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:34.961849 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d9a21be5-f924-4045-a4eb-d4128f122f93 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:35.080260 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c16c7bc7-eeac-4a18-85e3-da39e2f4af8a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:35.100095 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c16c7bc7-eeac-4a18-85e3-da39e2f4af8a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/2cad3ede-cfb3-48bb-b0e1-b999dc5cae07" status: 200 len: 1493 microversion: 2.1 time: 0.680712 Sep 08 11:00:35.100705 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2435/4789] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:00:34 2022] GET /compute/v2.1/servers/2cad3ede-cfb3-48bb-b0e1-b999dc5cae07 => generated 1493 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:00:35.610454 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d9a21be5-f924-4045-a4eb-d4128f122f93 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:35.618581 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d9a21be5-f924-4045-a4eb-d4128f122f93 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/dc6ac766-e3bf-456b-b595-f7d7a512571a" status: 200 len: 1508 microversion: 2.1 time: 0.687197 Sep 08 11:00:35.619479 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2355/4790] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:00:34 2022] GET /compute/v2.1/servers/dc6ac766-e3bf-456b-b595-f7d7a512571a => generated 1508 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:00:35.644745 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-47f9707f-315b-42f7-b9cb-2df88648daf7 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:35.645884 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-47f9707f-315b-42f7-b9cb-2df88648daf7 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: dc6ac766-e3bf-456b-b595-f7d7a512571a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:35.656065 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-47f9707f-315b-42f7-b9cb-2df88648daf7 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:35.656997 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-47f9707f-315b-42f7-b9cb-2df88648daf7 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:35.657721 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-47f9707f-315b-42f7-b9cb-2df88648daf7 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:35.658738 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-47f9707f-315b-42f7-b9cb-2df88648daf7 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:35.659423 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-47f9707f-315b-42f7-b9cb-2df88648daf7 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:35.660080 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-47f9707f-315b-42f7-b9cb-2df88648daf7 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:35.943539 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c2cd5ab3-bf78-41f3-b3da-a835df5c9cd0 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:35.944166 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c2cd5ab3-bf78-41f3-b3da-a835df5c9cd0 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:35.970574 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2cd5ab3-bf78-41f3-b3da-a835df5c9cd0 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:35.971073 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2cd5ab3-bf78-41f3-b3da-a835df5c9cd0 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:35.971624 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2cd5ab3-bf78-41f3-b3da-a835df5c9cd0 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:35.972347 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2cd5ab3-bf78-41f3-b3da-a835df5c9cd0 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:35.975015 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2cd5ab3-bf78-41f3-b3da-a835df5c9cd0 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:35.975827 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2cd5ab3-bf78-41f3-b3da-a835df5c9cd0 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:36.212464 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-47f9707f-315b-42f7-b9cb-2df88648daf7 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:36.223616 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-47f9707f-315b-42f7-b9cb-2df88648daf7 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/dc6ac766-e3bf-456b-b595-f7d7a512571a" status: 200 len: 1508 microversion: 2.1 time: 0.584801 Sep 08 11:00:36.254739 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2436/4791] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:00:35 2022] GET /compute/v2.1/servers/dc6ac766-e3bf-456b-b595-f7d7a512571a => generated 1508 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:00:36.260157 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-330a4568-8b68-4643-add3-60d7ea8f449e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:36.264481 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-330a4568-8b68-4643-add3-60d7ea8f449e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 2cad3ede-cfb3-48bb-b0e1-b999dc5cae07] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:36.279814 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-330a4568-8b68-4643-add3-60d7ea8f449e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:36.283361 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-330a4568-8b68-4643-add3-60d7ea8f449e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:36.284144 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-330a4568-8b68-4643-add3-60d7ea8f449e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:36.288600 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-330a4568-8b68-4643-add3-60d7ea8f449e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:36.289575 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-330a4568-8b68-4643-add3-60d7ea8f449e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:36.290464 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-330a4568-8b68-4643-add3-60d7ea8f449e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:36.386139 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c2cd5ab3-bf78-41f3-b3da-a835df5c9cd0 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:36.408213 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c2cd5ab3-bf78-41f3-b3da-a835df5c9cd0 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:36.418679 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c2cd5ab3-bf78-41f3-b3da-a835df5c9cd0 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:36.424776 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c2cd5ab3-bf78-41f3-b3da-a835df5c9cd0 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1874 microversion: 2.42 time: 0.484638 Sep 08 11:00:36.427004 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2356/4792] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:00:35 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1874 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:00:36.443411 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c8a2d3f5-643e-47a0-a94e-17f571464505 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:00:36.448445 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c8a2d3f5-643e-47a0-a94e-17f571464505 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: dc6ac766-e3bf-456b-b595-f7d7a512571a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:36.463966 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c8a2d3f5-643e-47a0-a94e-17f571464505 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:36.467505 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c8a2d3f5-643e-47a0-a94e-17f571464505 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:36.467776 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c8a2d3f5-643e-47a0-a94e-17f571464505 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:36.468489 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c8a2d3f5-643e-47a0-a94e-17f571464505 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:36.468971 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c8a2d3f5-643e-47a0-a94e-17f571464505 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:36.469470 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c8a2d3f5-643e-47a0-a94e-17f571464505 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:36.647748 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c8a2d3f5-643e-47a0-a94e-17f571464505 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "PUT /compute/v2.1/servers/dc6ac766-e3bf-456b-b595-f7d7a512571a" status: 200 len: 1080 microversion: 2.1 time: 0.216528 Sep 08 11:00:36.651155 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2357/4793] 10.222.0.27 () {60 vars in 1256 bytes} [Thu Sep 8 11:00:36 2022] PUT /compute/v2.1/servers/dc6ac766-e3bf-456b-b595-f7d7a512571a => generated 1080 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:00:36.679379 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b04677f7-4d67-4106-b29b-bdbe6a3f8b3f tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:36.680063 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b04677f7-4d67-4106-b29b-bdbe6a3f8b3f tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: dc6ac766-e3bf-456b-b595-f7d7a512571a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:36.693970 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b04677f7-4d67-4106-b29b-bdbe6a3f8b3f tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:36.696872 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b04677f7-4d67-4106-b29b-bdbe6a3f8b3f tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:36.698043 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b04677f7-4d67-4106-b29b-bdbe6a3f8b3f tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:36.699309 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b04677f7-4d67-4106-b29b-bdbe6a3f8b3f tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:36.700033 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b04677f7-4d67-4106-b29b-bdbe6a3f8b3f tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:36.700725 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b04677f7-4d67-4106-b29b-bdbe6a3f8b3f tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:37.495240 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b04677f7-4d67-4106-b29b-bdbe6a3f8b3f tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:37.508796 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b04677f7-4d67-4106-b29b-bdbe6a3f8b3f tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/dc6ac766-e3bf-456b-b595-f7d7a512571a" status: 200 len: 1506 microversion: 2.1 time: 0.835650 Sep 08 11:00:37.511016 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2358/4794] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:00:36 2022] GET /compute/v2.1/servers/dc6ac766-e3bf-456b-b595-f7d7a512571a => generated 1506 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:00:37.517639 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cbc2cc6e-4f21-4516-898a-19c28e19aafa tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:37.521521 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cbc2cc6e-4f21-4516-898a-19c28e19aafa tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:37.532816 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cbc2cc6e-4f21-4516-898a-19c28e19aafa tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:37.533461 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cbc2cc6e-4f21-4516-898a-19c28e19aafa tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:37.533998 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cbc2cc6e-4f21-4516-898a-19c28e19aafa tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:37.534872 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cbc2cc6e-4f21-4516-898a-19c28e19aafa tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:37.535572 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cbc2cc6e-4f21-4516-898a-19c28e19aafa tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:37.537228 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cbc2cc6e-4f21-4516-898a-19c28e19aafa tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:37.554289 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-330a4568-8b68-4643-add3-60d7ea8f449e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:37.571479 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-330a4568-8b68-4643-add3-60d7ea8f449e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/2cad3ede-cfb3-48bb-b0e1-b999dc5cae07" status: 200 len: 1514 microversion: 2.1 time: 1.311095 Sep 08 11:00:37.573853 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2437/4795] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:00:36 2022] GET /compute/v2.1/servers/2cad3ede-cfb3-48bb-b0e1-b999dc5cae07 => generated 1514 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:00:37.577070 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-330a4568-8b68-4643-add3-60d7ea8f449e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:37.581606 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-330a4568-8b68-4643-add3-60d7ea8f449e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute//" status: 200 len: 377 microversion: - time: 0.004823 Sep 08 11:00:37.583244 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2438/4796] 10.222.0.27 () {56 vars in 886 bytes} [Thu Sep 8 11:00:37 2022] GET /compute/ => generated 377 bytes in 8 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 08 11:00:37.591608 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-64ea2ed4-cfd0-42f2-a9d7-48cf6f348891 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:37.596512 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-64ea2ed4-cfd0-42f2-a9d7-48cf6f348891 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: dc6ac766-e3bf-456b-b595-f7d7a512571a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:37.614320 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64ea2ed4-cfd0-42f2-a9d7-48cf6f348891 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:37.615876 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64ea2ed4-cfd0-42f2-a9d7-48cf6f348891 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:37.619497 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64ea2ed4-cfd0-42f2-a9d7-48cf6f348891 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:37.620753 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64ea2ed4-cfd0-42f2-a9d7-48cf6f348891 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:37.621468 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64ea2ed4-cfd0-42f2-a9d7-48cf6f348891 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:37.623808 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64ea2ed4-cfd0-42f2-a9d7-48cf6f348891 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:38.030502 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-64ea2ed4-cfd0-42f2-a9d7-48cf6f348891 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:38.038648 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:00:38.047179 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-64ea2ed4-cfd0-42f2-a9d7-48cf6f348891 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/dc6ac766-e3bf-456b-b595-f7d7a512571a" status: 200 len: 1506 microversion: 2.1 time: 0.460435 Sep 08 11:00:38.051620 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2439/4797] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:00:37 2022] GET /compute/v2.1/servers/dc6ac766-e3bf-456b-b595-f7d7a512571a => generated 1506 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:00:38.077058 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-37512149-8df7-4028-b361-78f1f6b14127 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:00:38.080132 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-37512149-8df7-4028-b361-78f1f6b14127 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: dc6ac766-e3bf-456b-b595-f7d7a512571a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:38.097794 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cbc2cc6e-4f21-4516-898a-19c28e19aafa tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:38.099517 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-37512149-8df7-4028-b361-78f1f6b14127 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:38.100030 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-37512149-8df7-4028-b361-78f1f6b14127 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:38.100480 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-37512149-8df7-4028-b361-78f1f6b14127 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:38.100963 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:00:38.101245 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-37512149-8df7-4028-b361-78f1f6b14127 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:38.103605 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-37512149-8df7-4028-b361-78f1f6b14127 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:38.104065 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-37512149-8df7-4028-b361-78f1f6b14127 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:38.125447 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cbc2cc6e-4f21-4516-898a-19c28e19aafa tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:38.127211 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cbc2cc6e-4f21-4516-898a-19c28e19aafa tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:38.128695 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cbc2cc6e-4f21-4516-898a-19c28e19aafa tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1874 microversion: 2.42 time: 0.616479 Sep 08 11:00:38.145192 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2359/4798] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:00:37 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1874 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:00:38.209752 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-37512149-8df7-4028-b361-78f1f6b14127 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "PUT /compute/v2.1/servers/dc6ac766-e3bf-456b-b595-f7d7a512571a" status: 200 len: 1082 microversion: 2.1 time: 0.137327 Sep 08 11:00:38.211214 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2440/4799] 10.222.0.27 () {60 vars in 1256 bytes} [Thu Sep 8 11:00:38 2022] PUT /compute/v2.1/servers/dc6ac766-e3bf-456b-b595-f7d7a512571a => generated 1082 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:00:38.229093 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-94714986-29e6-4b96-ab84-9912966339c8 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:38.230153 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-94714986-29e6-4b96-ab84-9912966339c8 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: dc6ac766-e3bf-456b-b595-f7d7a512571a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:38.240217 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94714986-29e6-4b96-ab84-9912966339c8 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:38.241280 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94714986-29e6-4b96-ab84-9912966339c8 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:38.241879 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94714986-29e6-4b96-ab84-9912966339c8 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:38.243122 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94714986-29e6-4b96-ab84-9912966339c8 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:38.243730 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94714986-29e6-4b96-ab84-9912966339c8 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:38.244314 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94714986-29e6-4b96-ab84-9912966339c8 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:38.542215 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-d5ebfb68-c0b4-4667-a1ca-c94e2106e0b6 req-436392dd-95a9-40cb-879f-8fbf13fa2951 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cad3ede-cfb3-48bb-b0e1-b999dc5cae07", "name": "network-vif-plugged", "status": "completed", "tag": "06ecac7f-05cd-4f87-9398-fe2c4f48cb33"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:00:38.577177 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-d5ebfb68-c0b4-4667-a1ca-c94e2106e0b6 req-436392dd-95a9-40cb-879f-8fbf13fa2951 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:38.577883 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-d5ebfb68-c0b4-4667-a1ca-c94e2106e0b6 req-436392dd-95a9-40cb-879f-8fbf13fa2951 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:38.580939 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-d5ebfb68-c0b4-4667-a1ca-c94e2106e0b6 req-436392dd-95a9-40cb-879f-8fbf13fa2951 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:38.628963 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-d5ebfb68-c0b4-4667-a1ca-c94e2106e0b6 req-436392dd-95a9-40cb-879f-8fbf13fa2951 service nova] Creating event network-vif-plugged:06ecac7f-05cd-4f87-9398-fe2c4f48cb33 for instance 2cad3ede-cfb3-48bb-b0e1-b999dc5cae07 on n-h1-850501-12 Sep 08 11:00:38.645531 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-d5ebfb68-c0b4-4667-a1ca-c94e2106e0b6 req-436392dd-95a9-40cb-879f-8fbf13fa2951 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108018 Sep 08 11:00:38.649197 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2441/4800] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:00:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:00:38.661068 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-94b93af7-0176-457c-89d5-7a45ac28f1a5 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:38.661824 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-94b93af7-0176-457c-89d5-7a45ac28f1a5 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 2cad3ede-cfb3-48bb-b0e1-b999dc5cae07] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:38.685893 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-94b93af7-0176-457c-89d5-7a45ac28f1a5 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:38.686590 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-94b93af7-0176-457c-89d5-7a45ac28f1a5 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:38.689425 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-94b93af7-0176-457c-89d5-7a45ac28f1a5 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:38.691320 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-94b93af7-0176-457c-89d5-7a45ac28f1a5 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:38.691832 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-94b93af7-0176-457c-89d5-7a45ac28f1a5 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:38.692227 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-94b93af7-0176-457c-89d5-7a45ac28f1a5 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:39.037659 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-94714986-29e6-4b96-ab84-9912966339c8 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:39.046821 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-94714986-29e6-4b96-ab84-9912966339c8 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/dc6ac766-e3bf-456b-b595-f7d7a512571a" status: 200 len: 1508 microversion: 2.1 time: 0.821779 Sep 08 11:00:39.051893 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2360/4801] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:00:38 2022] GET /compute/v2.1/servers/dc6ac766-e3bf-456b-b595-f7d7a512571a => generated 1508 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:00:39.074772 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e3551746-723c-43c7-87a6-63f21f8d7d79 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:39.075799 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e3551746-723c-43c7-87a6-63f21f8d7d79 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: dc6ac766-e3bf-456b-b595-f7d7a512571a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:39.086613 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e3551746-723c-43c7-87a6-63f21f8d7d79 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:39.088410 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e3551746-723c-43c7-87a6-63f21f8d7d79 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:39.089941 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e3551746-723c-43c7-87a6-63f21f8d7d79 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:39.095642 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e3551746-723c-43c7-87a6-63f21f8d7d79 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:39.096563 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e3551746-723c-43c7-87a6-63f21f8d7d79 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:39.097260 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e3551746-723c-43c7-87a6-63f21f8d7d79 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:39.103582 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-94b93af7-0176-457c-89d5-7a45ac28f1a5 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:39.118578 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-94b93af7-0176-457c-89d5-7a45ac28f1a5 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/2cad3ede-cfb3-48bb-b0e1-b999dc5cae07" status: 200 len: 1509 microversion: 2.1 time: 0.467999 Sep 08 11:00:39.121257 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2442/4802] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:00:38 2022] GET /compute/v2.1/servers/2cad3ede-cfb3-48bb-b0e1-b999dc5cae07 => generated 1509 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:00:39.162326 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-31775097-77d8-4b3d-a7c2-b4ef687a1b2e tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:39.163925 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-31775097-77d8-4b3d-a7c2-b4ef687a1b2e tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:39.191535 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-31775097-77d8-4b3d-a7c2-b4ef687a1b2e tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:39.192117 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-31775097-77d8-4b3d-a7c2-b4ef687a1b2e tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:39.192577 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-31775097-77d8-4b3d-a7c2-b4ef687a1b2e tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:39.201716 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-31775097-77d8-4b3d-a7c2-b4ef687a1b2e tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:39.202238 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-31775097-77d8-4b3d-a7c2-b4ef687a1b2e tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:39.202688 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-31775097-77d8-4b3d-a7c2-b4ef687a1b2e tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:39.620141 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-31775097-77d8-4b3d-a7c2-b4ef687a1b2e tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:39.635004 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-31775097-77d8-4b3d-a7c2-b4ef687a1b2e tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:39.638482 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-31775097-77d8-4b3d-a7c2-b4ef687a1b2e tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:39.643499 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-31775097-77d8-4b3d-a7c2-b4ef687a1b2e tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1874 microversion: 2.42 time: 0.486585 Sep 08 11:00:39.646534 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2443/4803] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:00:39 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1874 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:00:39.823991 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e3551746-723c-43c7-87a6-63f21f8d7d79 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:39.835744 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e3551746-723c-43c7-87a6-63f21f8d7d79 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/dc6ac766-e3bf-456b-b595-f7d7a512571a" status: 200 len: 1508 microversion: 2.1 time: 0.765348 Sep 08 11:00:39.837892 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2361/4804] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:00:39 2022] GET /compute/v2.1/servers/dc6ac766-e3bf-456b-b595-f7d7a512571a => generated 1508 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:00:39.871134 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a2b7c0ef-9ffa-4499-94a2-15af3ecbcb3e tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:39.871630 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a2b7c0ef-9ffa-4499-94a2-15af3ecbcb3e tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: dc6ac766-e3bf-456b-b595-f7d7a512571a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:39.884716 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a2b7c0ef-9ffa-4499-94a2-15af3ecbcb3e tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:39.885262 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a2b7c0ef-9ffa-4499-94a2-15af3ecbcb3e tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:39.890063 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a2b7c0ef-9ffa-4499-94a2-15af3ecbcb3e tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:39.894619 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a2b7c0ef-9ffa-4499-94a2-15af3ecbcb3e tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:39.897312 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a2b7c0ef-9ffa-4499-94a2-15af3ecbcb3e tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:39.900111 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a2b7c0ef-9ffa-4499-94a2-15af3ecbcb3e tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:39.972113 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a2b7c0ef-9ffa-4499-94a2-15af3ecbcb3e tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: dc6ac766-e3bf-456b-b595-f7d7a512571a] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:00:40.132161 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a2b7c0ef-9ffa-4499-94a2-15af3ecbcb3e tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "DELETE /compute/v2.1/servers/dc6ac766-e3bf-456b-b595-f7d7a512571a" status: 204 len: 0 microversion: 2.1 time: 0.264099 Sep 08 11:00:40.134740 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2444/4805] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:00:39 2022] DELETE /compute/v2.1/servers/dc6ac766-e3bf-456b-b595-f7d7a512571a => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:00:40.143870 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-736213b1-e280-436c-af37-759d527e34a9 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:40.145019 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-736213b1-e280-436c-af37-759d527e34a9 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 2cad3ede-cfb3-48bb-b0e1-b999dc5cae07] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:40.149993 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3dc7e112-db44-4bc1-bf5c-68ddadb8dfa2 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:40.151272 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3dc7e112-db44-4bc1-bf5c-68ddadb8dfa2 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: dc6ac766-e3bf-456b-b595-f7d7a512571a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:40.161811 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3dc7e112-db44-4bc1-bf5c-68ddadb8dfa2 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:40.162623 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3dc7e112-db44-4bc1-bf5c-68ddadb8dfa2 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:40.163545 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3dc7e112-db44-4bc1-bf5c-68ddadb8dfa2 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:40.165749 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3dc7e112-db44-4bc1-bf5c-68ddadb8dfa2 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:40.166404 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-736213b1-e280-436c-af37-759d527e34a9 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:40.166697 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3dc7e112-db44-4bc1-bf5c-68ddadb8dfa2 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:40.167349 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3dc7e112-db44-4bc1-bf5c-68ddadb8dfa2 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:40.169276 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-736213b1-e280-436c-af37-759d527e34a9 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:40.170307 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-736213b1-e280-436c-af37-759d527e34a9 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:40.171055 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-736213b1-e280-436c-af37-759d527e34a9 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:40.171516 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-736213b1-e280-436c-af37-759d527e34a9 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:40.189492 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-736213b1-e280-436c-af37-759d527e34a9 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:40.207914 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3dc7e112-db44-4bc1-bf5c-68ddadb8dfa2 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: dc6ac766-e3bf-456b-b595-f7d7a512571a] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:00:40.315804 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.compute.api [None req-3dc7e112-db44-4bc1-bf5c-68ddadb8dfa2 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: dc6ac766-e3bf-456b-b595-f7d7a512571a] Instance is already in deleting state, ignoring this request Sep 08 11:00:40.320740 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3dc7e112-db44-4bc1-bf5c-68ddadb8dfa2 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "DELETE /compute/v2.1/servers/dc6ac766-e3bf-456b-b595-f7d7a512571a" status: 204 len: 0 microversion: 2.1 time: 0.177079 Sep 08 11:00:40.324008 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2445/4806] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:00:40 2022] DELETE /compute/v2.1/servers/dc6ac766-e3bf-456b-b595-f7d7a512571a => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:00:40.334975 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4f9a06e8-6aa3-4689-b38d-41385ebd2a22 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:40.337920 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4f9a06e8-6aa3-4689-b38d-41385ebd2a22 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: dc6ac766-e3bf-456b-b595-f7d7a512571a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:40.361763 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4f9a06e8-6aa3-4689-b38d-41385ebd2a22 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:40.365323 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4f9a06e8-6aa3-4689-b38d-41385ebd2a22 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:40.366044 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4f9a06e8-6aa3-4689-b38d-41385ebd2a22 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:40.367116 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4f9a06e8-6aa3-4689-b38d-41385ebd2a22 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:40.376592 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4f9a06e8-6aa3-4689-b38d-41385ebd2a22 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:40.381422 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4f9a06e8-6aa3-4689-b38d-41385ebd2a22 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:41.050621 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-736213b1-e280-436c-af37-759d527e34a9 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:41.068375 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-736213b1-e280-436c-af37-759d527e34a9 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/2cad3ede-cfb3-48bb-b0e1-b999dc5cae07" status: 200 len: 1509 microversion: 2.1 time: 0.921262 Sep 08 11:00:41.069165 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2362/4807] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:00:40 2022] GET /compute/v2.1/servers/2cad3ede-cfb3-48bb-b0e1-b999dc5cae07 => generated 1509 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:00:41.090991 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-14678324-0ca3-445b-863e-5a3dcb728fdd tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:41.092361 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-14678324-0ca3-445b-863e-5a3dcb728fdd tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:41.109495 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-14678324-0ca3-445b-863e-5a3dcb728fdd tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:41.110150 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-14678324-0ca3-445b-863e-5a3dcb728fdd tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:41.110622 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-14678324-0ca3-445b-863e-5a3dcb728fdd tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:41.111337 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-14678324-0ca3-445b-863e-5a3dcb728fdd tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:41.111805 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-14678324-0ca3-445b-863e-5a3dcb728fdd tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:41.112240 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-14678324-0ca3-445b-863e-5a3dcb728fdd tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:41.454990 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4f9a06e8-6aa3-4689-b38d-41385ebd2a22 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:41.465847 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4f9a06e8-6aa3-4689-b38d-41385ebd2a22 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/dc6ac766-e3bf-456b-b595-f7d7a512571a" status: 200 len: 1514 microversion: 2.1 time: 1.137751 Sep 08 11:00:41.470692 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2446/4808] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:00:40 2022] GET /compute/v2.1/servers/dc6ac766-e3bf-456b-b595-f7d7a512571a => generated 1514 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:00:42.094807 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c1404667-d8f0-4a23-b24f-5c72432d1ce5 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:42.095985 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c1404667-d8f0-4a23-b24f-5c72432d1ce5 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 2cad3ede-cfb3-48bb-b0e1-b999dc5cae07] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:42.108697 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c1404667-d8f0-4a23-b24f-5c72432d1ce5 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:42.113259 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c1404667-d8f0-4a23-b24f-5c72432d1ce5 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:42.116666 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c1404667-d8f0-4a23-b24f-5c72432d1ce5 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:42.117729 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c1404667-d8f0-4a23-b24f-5c72432d1ce5 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:42.118558 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c1404667-d8f0-4a23-b24f-5c72432d1ce5 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:42.119219 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c1404667-d8f0-4a23-b24f-5c72432d1ce5 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:42.346512 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-14678324-0ca3-445b-863e-5a3dcb728fdd tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:42.369478 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-14678324-0ca3-445b-863e-5a3dcb728fdd tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:42.375650 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-14678324-0ca3-445b-863e-5a3dcb728fdd tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:42.377217 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-14678324-0ca3-445b-863e-5a3dcb728fdd tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1874 microversion: 2.42 time: 1.307185 Sep 08 11:00:42.380983 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2363/4809] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:00:41 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1874 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:00:42.407641 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c1404667-d8f0-4a23-b24f-5c72432d1ce5 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:42.426420 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c1404667-d8f0-4a23-b24f-5c72432d1ce5 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/2cad3ede-cfb3-48bb-b0e1-b999dc5cae07" status: 200 len: 1509 microversion: 2.1 time: 0.336373 Sep 08 11:00:42.438308 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2447/4810] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:00:42 2022] GET /compute/v2.1/servers/2cad3ede-cfb3-48bb-b0e1-b999dc5cae07 => generated 1509 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:00:42.495726 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9938ef0b-fbff-4f3f-a9fd-af32bf5322bd tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:42.497170 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9938ef0b-fbff-4f3f-a9fd-af32bf5322bd tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: dc6ac766-e3bf-456b-b595-f7d7a512571a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:42.516269 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9938ef0b-fbff-4f3f-a9fd-af32bf5322bd tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:42.517057 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9938ef0b-fbff-4f3f-a9fd-af32bf5322bd tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:42.517692 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9938ef0b-fbff-4f3f-a9fd-af32bf5322bd tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:42.518580 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9938ef0b-fbff-4f3f-a9fd-af32bf5322bd tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:42.520281 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9938ef0b-fbff-4f3f-a9fd-af32bf5322bd tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:42.520874 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9938ef0b-fbff-4f3f-a9fd-af32bf5322bd tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:43.011944 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9938ef0b-fbff-4f3f-a9fd-af32bf5322bd tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:43.027562 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9938ef0b-fbff-4f3f-a9fd-af32bf5322bd tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/dc6ac766-e3bf-456b-b595-f7d7a512571a" status: 200 len: 1514 microversion: 2.1 time: 0.539274 Sep 08 11:00:43.028153 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2364/4811] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:00:42 2022] GET /compute/v2.1/servers/dc6ac766-e3bf-456b-b595-f7d7a512571a => generated 1514 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:00:43.410977 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-255e4541-ae3d-4e75-b0cc-8605d0179328 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:43.412112 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-255e4541-ae3d-4e75-b0cc-8605d0179328 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:43.423868 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-255e4541-ae3d-4e75-b0cc-8605d0179328 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:43.426070 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-255e4541-ae3d-4e75-b0cc-8605d0179328 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:43.426714 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-255e4541-ae3d-4e75-b0cc-8605d0179328 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:43.428613 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-255e4541-ae3d-4e75-b0cc-8605d0179328 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:43.429548 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-255e4541-ae3d-4e75-b0cc-8605d0179328 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:43.432923 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-255e4541-ae3d-4e75-b0cc-8605d0179328 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:43.454860 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-98198c14-ddc0-4c2c-8dc6-4d69644f24e2 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:43.455483 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-98198c14-ddc0-4c2c-8dc6-4d69644f24e2 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 2cad3ede-cfb3-48bb-b0e1-b999dc5cae07] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:43.470365 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-98198c14-ddc0-4c2c-8dc6-4d69644f24e2 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:43.477059 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-98198c14-ddc0-4c2c-8dc6-4d69644f24e2 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:43.479626 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-98198c14-ddc0-4c2c-8dc6-4d69644f24e2 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:43.481177 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-98198c14-ddc0-4c2c-8dc6-4d69644f24e2 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:43.493016 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-98198c14-ddc0-4c2c-8dc6-4d69644f24e2 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:43.493947 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-98198c14-ddc0-4c2c-8dc6-4d69644f24e2 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:44.009180 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-255e4541-ae3d-4e75-b0cc-8605d0179328 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:44.037543 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-255e4541-ae3d-4e75-b0cc-8605d0179328 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:44.042636 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-255e4541-ae3d-4e75-b0cc-8605d0179328 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:44.044190 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-255e4541-ae3d-4e75-b0cc-8605d0179328 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1874 microversion: 2.42 time: 0.637355 Sep 08 11:00:44.050358 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2448/4812] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:00:43 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1874 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:00:44.216280 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-98198c14-ddc0-4c2c-8dc6-4d69644f24e2 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:44.234076 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-98198c14-ddc0-4c2c-8dc6-4d69644f24e2 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/2cad3ede-cfb3-48bb-b0e1-b999dc5cae07" status: 200 len: 1509 microversion: 2.1 time: 0.783950 Sep 08 11:00:44.235282 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2365/4813] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:00:43 2022] GET /compute/v2.1/servers/2cad3ede-cfb3-48bb-b0e1-b999dc5cae07 => generated 1509 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:00:44.240495 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-3e8f145f-103c-4300-9f8a-c79215d0ad7b req-f075c31f-8986-4435-b614-c86a15733e53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc6ac766-e3bf-456b-b595-f7d7a512571a", "name": "network-vif-deleted", "tag": "7810e56a-3d8e-4143-b7b9-f129f1fafdc6"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:00:44.274592 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-3e8f145f-103c-4300-9f8a-c79215d0ad7b req-f075c31f-8986-4435-b614-c86a15733e53 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:44.276751 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-3e8f145f-103c-4300-9f8a-c79215d0ad7b req-f075c31f-8986-4435-b614-c86a15733e53 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:44.278121 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-3e8f145f-103c-4300-9f8a-c79215d0ad7b req-f075c31f-8986-4435-b614-c86a15733e53 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:44.322394 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-3e8f145f-103c-4300-9f8a-c79215d0ad7b req-f075c31f-8986-4435-b614-c86a15733e53 service nova] Creating event network-vif-deleted:7810e56a-3d8e-4143-b7b9-f129f1fafdc6 for instance dc6ac766-e3bf-456b-b595-f7d7a512571a on n-h2-850501-12 Sep 08 11:00:44.339230 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-3e8f145f-103c-4300-9f8a-c79215d0ad7b req-f075c31f-8986-4435-b614-c86a15733e53 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101964 Sep 08 11:00:44.346063 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2366/4814] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:00:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:00:44.356513 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4e2f220f-7240-45c6-a5dd-1d7b61594ef7 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:44.358291 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4e2f220f-7240-45c6-a5dd-1d7b61594ef7 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: dc6ac766-e3bf-456b-b595-f7d7a512571a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:44.365422 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e2f220f-7240-45c6-a5dd-1d7b61594ef7 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:44.366228 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e2f220f-7240-45c6-a5dd-1d7b61594ef7 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:44.366894 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e2f220f-7240-45c6-a5dd-1d7b61594ef7 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:44.368643 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e2f220f-7240-45c6-a5dd-1d7b61594ef7 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:44.370173 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e2f220f-7240-45c6-a5dd-1d7b61594ef7 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:44.370895 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e2f220f-7240-45c6-a5dd-1d7b61594ef7 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:44.419189 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e2f220f-7240-45c6-a5dd-1d7b61594ef7 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:44.420862 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e2f220f-7240-45c6-a5dd-1d7b61594ef7 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:44.422025 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e2f220f-7240-45c6-a5dd-1d7b61594ef7 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:44.422778 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-4e2f220f-7240-45c6-a5dd-1d7b61594ef7 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lazy-loading 'fault' on Instance uuid dc6ac766-e3bf-456b-b595-f7d7a512571a {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:00:44.490878 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4e2f220f-7240-45c6-a5dd-1d7b61594ef7 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886104e81be14c18a30b75facfcf246e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def11bb6a39848a5855a6c8534b5edba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:44.566487 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4e2f220f-7240-45c6-a5dd-1d7b61594ef7 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/dc6ac766-e3bf-456b-b595-f7d7a512571a" status: 200 len: 1308 microversion: 2.1 time: 0.214916 Sep 08 11:00:44.568446 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2367/4815] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:00:44 2022] GET /compute/v2.1/servers/dc6ac766-e3bf-456b-b595-f7d7a512571a => generated 1308 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:00:44.827326 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1bb2c053-efa8-4319-8717-335ba479f5f0 tempest-ExtensionsTest-2020812484 tempest-ExtensionsTest-2020812484-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:44.830132 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1bb2c053-efa8-4319-8717-335ba479f5f0 tempest-ExtensionsTest-2020812484 tempest-ExtensionsTest-2020812484-project] 10.222.0.27 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.777950 Sep 08 11:00:44.830971 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2449/4816] 10.222.0.27 () {58 vars in 1170 bytes} [Thu Sep 8 11:00:44 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:00:44.842857 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c78b9fdb-ebf1-49ec-bb68-b1e2676e2244 tempest-ExtensionsTest-2020812484 tempest-ExtensionsTest-2020812484-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:44.845878 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c78b9fdb-ebf1-49ec-bb68-b1e2676e2244 tempest-ExtensionsTest-2020812484 tempest-ExtensionsTest-2020812484-project] 10.222.0.27 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.007203 Sep 08 11:00:44.847249 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2368/4817] 10.222.0.27 () {58 vars in 1134 bytes} [Thu Sep 8 11:00:44 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 11:00:45.084033 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-32a8af81-9260-4336-b244-7268e55965b1 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:45.085010 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-32a8af81-9260-4336-b244-7268e55965b1 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:45.099905 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-32a8af81-9260-4336-b244-7268e55965b1 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:45.101455 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-32a8af81-9260-4336-b244-7268e55965b1 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:45.101897 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-32a8af81-9260-4336-b244-7268e55965b1 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:45.106158 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-32a8af81-9260-4336-b244-7268e55965b1 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:45.107351 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-32a8af81-9260-4336-b244-7268e55965b1 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:45.108185 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-32a8af81-9260-4336-b244-7268e55965b1 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:45.268540 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-88089973-8815-4158-a14e-c82112e68804 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:45.271594 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-88089973-8815-4158-a14e-c82112e68804 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 2cad3ede-cfb3-48bb-b0e1-b999dc5cae07] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:45.295212 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-88089973-8815-4158-a14e-c82112e68804 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:45.296757 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-88089973-8815-4158-a14e-c82112e68804 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:45.297466 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-88089973-8815-4158-a14e-c82112e68804 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:45.298498 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-88089973-8815-4158-a14e-c82112e68804 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:45.299177 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-88089973-8815-4158-a14e-c82112e68804 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:45.301733 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-88089973-8815-4158-a14e-c82112e68804 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:45.671093 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-32a8af81-9260-4336-b244-7268e55965b1 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:45.682398 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-32a8af81-9260-4336-b244-7268e55965b1 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:45.684737 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-32a8af81-9260-4336-b244-7268e55965b1 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:45.688196 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-32a8af81-9260-4336-b244-7268e55965b1 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1874 microversion: 2.42 time: 0.607733 Sep 08 11:00:45.689017 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2450/4818] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:00:45 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1874 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:00:45.696435 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7373de03-f6d6-423a-9cf4-f5cc4c0c483f tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:45.697442 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7373de03-f6d6-423a-9cf4-f5cc4c0c483f tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: dc6ac766-e3bf-456b-b595-f7d7a512571a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:45.706775 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7373de03-f6d6-423a-9cf4-f5cc4c0c483f tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:45.707544 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7373de03-f6d6-423a-9cf4-f5cc4c0c483f tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:45.708150 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7373de03-f6d6-423a-9cf4-f5cc4c0c483f tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:45.709319 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7373de03-f6d6-423a-9cf4-f5cc4c0c483f tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:45.710174 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7373de03-f6d6-423a-9cf4-f5cc4c0c483f tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:45.711044 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7373de03-f6d6-423a-9cf4-f5cc4c0c483f tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:45.732961 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-7373de03-f6d6-423a-9cf4-f5cc4c0c483f tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] HTTP exception thrown: Instance dc6ac766-e3bf-456b-b595-f7d7a512571a could not be found. Sep 08 11:00:45.735426 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7373de03-f6d6-423a-9cf4-f5cc4c0c483f tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Request method failure captured: Sep 08 11:00:45.735426 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/dc6ac766-e3bf-456b-b595-f7d7a512571a HTTP/1.1 Sep 08 11:00:45.735426 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:00:45.735426 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:00:45.735426 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:00:45.735426 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 11:00:45.735426 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:00:45.735426 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:00:45.735426 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:00:45.735426 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:00:45.735426 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcqs5rmT4eT7GJb8IMsQTFB7NcuijudznuEcZXGo36JQdAqXL4ap3XQx82WrisMCaKSVfCo0kDZCZazAIV253gOknVwLifmg682ZY3OPV0T8LQ1z_y6-q_mDxd9dEE1aCpTvhgf2jtXUWCvyodKct13wyO20CjQ51HdgmEGw0B8icDo Sep 08 11:00:45.735426 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:00:45.735426 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:00:45.735426 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:00:45.735426 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:00:45.735426 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:00:45.735426 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:00:45.735426 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: def11bb6a39848a5855a6c8534b5edba Sep 08 11:00:45.735426 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1851073780 Sep 08 11:00:45.735426 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:00:45.735426 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:00:45.735426 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/def11bb6a39848a5855a6c8534b5edba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/def11bb6a39848a5855a6c8534b5edba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_def11bb6a39848a5855a6c8534b5edba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/def11bb6a39848a5855a6c8534b5edba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:00:45.735426 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServerDiskConfigTestJSON-1851073780 Sep 08 11:00:45.735426 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: def11bb6a39848a5855a6c8534b5edba Sep 08 11:00:45.735426 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1851073780 Sep 08 11:00:45.735426 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServerDiskConfigTestJSON-1851073780-project Sep 08 11:00:45.735426 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:00:45.735426 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:00:45.735426 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 886104e81be14c18a30b75facfcf246e Sep 08 11:00:45.735426 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServerDiskConfigTestJSON-1851073780-project Sep 08 11:00:45.735426 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 11:00:45.735426 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance dc6ac766-e3bf-456b-b595-f7d7a512571a could not be found. Sep 08 11:00:45.735426 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': 'dc6ac766-e3bf-456b-b595-f7d7a512571a'} Sep 08 11:00:45.735426 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:00:45.735426 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:00:45.735426 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:00:45.735426 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:00:45.735426 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:00:45.735426 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:00:45.735426 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:00:45.735426 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:00:45.735426 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:00:45.735426 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:00:45.735426 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc6ac766-e3bf-456b-b595-f7d7a512571a could not be found. Sep 08 11:00:45.735426 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:00:45.735426 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:00:45.735426 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:00:45.735426 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:00:45.735426 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:00:45.735426 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:00:45.735426 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:00:45.735426 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:00:45.735426 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:00:45.735426 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:00:45.735426 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:00:45.735426 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:00:45.735426 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:00:45.735426 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:00:45.735426 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:00:45.735426 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:00:45.735426 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc6ac766-e3bf-456b-b595-f7d7a512571a could not be found. Sep 08 11:00:45.735426 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:00:45.735426 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:00:45.735426 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:00:45.740568 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:00:45.740568 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:00:45.740568 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:00:45.740568 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:00:45.740568 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:00:45.740568 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc6ac766-e3bf-456b-b595-f7d7a512571a could not be found. Sep 08 11:00:45.740568 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:00:45.742690 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7373de03-f6d6-423a-9cf4-f5cc4c0c483f tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Returning 404 to user: Instance dc6ac766-e3bf-456b-b595-f7d7a512571a could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:00:45.744203 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7373de03-f6d6-423a-9cf4-f5cc4c0c483f tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/dc6ac766-e3bf-456b-b595-f7d7a512571a" status: 404 len: 111 microversion: 2.1 time: 0.053451 Sep 08 11:00:45.746090 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2451/4819] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:00:45 2022] GET /compute/v2.1/servers/dc6ac766-e3bf-456b-b595-f7d7a512571a => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:00:45.760009 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c7565366-7f1c-437a-806f-1bc87e3be975 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:45.762573 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c7565366-7f1c-437a-806f-1bc87e3be975 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:45.784109 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c7565366-7f1c-437a-806f-1bc87e3be975 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:45.784937 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c7565366-7f1c-437a-806f-1bc87e3be975 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:45.785624 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c7565366-7f1c-437a-806f-1bc87e3be975 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:45.786713 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c7565366-7f1c-437a-806f-1bc87e3be975 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:45.787399 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c7565366-7f1c-437a-806f-1bc87e3be975 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:45.789605 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c7565366-7f1c-437a-806f-1bc87e3be975 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:45.836952 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-c7565366-7f1c-437a-806f-1bc87e3be975 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] HTTP exception thrown: Instance f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8 could not be found. Sep 08 11:00:45.852770 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c7565366-7f1c-437a-806f-1bc87e3be975 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Request method failure captured: Sep 08 11:00:45.852770 n-d-850501-12 devstack@n-api.service[128861]: request: DELETE /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8 HTTP/1.1 Sep 08 11:00:45.852770 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:00:45.852770 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:00:45.852770 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:00:45.852770 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 11:00:45.852770 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:00:45.852770 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:00:45.852770 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:00:45.852770 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:00:45.852770 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcqs5rmT4eT7GJb8IMsQTFB7NcuijudznuEcZXGo36JQdAqXL4ap3XQx82WrisMCaKSVfCo0kDZCZazAIV253gOknVwLifmg682ZY3OPV0T8LQ1z_y6-q_mDxd9dEE1aCpTvhgf2jtXUWCvyodKct13wyO20CjQ51HdgmEGw0B8icDo Sep 08 11:00:45.852770 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:00:45.852770 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:00:45.852770 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:00:45.852770 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:00:45.852770 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:00:45.852770 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:00:45.852770 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: def11bb6a39848a5855a6c8534b5edba Sep 08 11:00:45.852770 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1851073780 Sep 08 11:00:45.852770 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:00:45.852770 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:00:45.852770 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/def11bb6a39848a5855a6c8534b5edba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/def11bb6a39848a5855a6c8534b5edba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_def11bb6a39848a5855a6c8534b5edba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/def11bb6a39848a5855a6c8534b5edba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:00:45.852770 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServerDiskConfigTestJSON-1851073780 Sep 08 11:00:45.852770 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: def11bb6a39848a5855a6c8534b5edba Sep 08 11:00:45.852770 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1851073780 Sep 08 11:00:45.852770 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServerDiskConfigTestJSON-1851073780-project Sep 08 11:00:45.852770 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:00:45.852770 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:00:45.852770 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 886104e81be14c18a30b75facfcf246e Sep 08 11:00:45.852770 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServerDiskConfigTestJSON-1851073780-project Sep 08 11:00:45.852770 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 11:00:45.852770 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8 could not be found. Sep 08 11:00:45.852770 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': 'f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8'} Sep 08 11:00:45.852770 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:00:45.852770 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:00:45.852770 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:00:45.852770 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:00:45.852770 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:00:45.852770 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:00:45.852770 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:00:45.852770 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:00:45.852770 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:00:45.852770 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:00:45.852770 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8 could not be found. Sep 08 11:00:45.852770 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:00:45.852770 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:00:45.852770 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:00:45.852770 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:00:45.852770 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:00:45.852770 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:00:45.852770 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:00:45.852770 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:00:45.852770 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:00:45.852770 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:00:45.852770 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 11:00:45.852770 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 11:00:45.852770 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 11:00:45.852770 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 11:00:45.852770 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:00:45.852770 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:00:45.852770 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:00:45.852770 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:00:45.858120 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8 could not be found. Sep 08 11:00:45.858120 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:00:45.858120 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:00:45.858120 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:00:45.858120 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:00:45.858120 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:00:45.858120 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:00:45.858120 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:00:45.858120 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:00:45.858120 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8 could not be found. Sep 08 11:00:45.858120 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:00:45.858120 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c7565366-7f1c-437a-806f-1bc87e3be975 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Returning 404 to user: Instance f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:00:45.858120 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c7565366-7f1c-437a-806f-1bc87e3be975 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8" status: 404 len: 111 microversion: 2.1 time: 0.104179 Sep 08 11:00:45.859310 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2452/4820] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:00:45 2022] DELETE /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 11:00:45.871950 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-724a850b-1326-404e-848b-5a95fa9a4a87 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:45.872675 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-724a850b-1326-404e-848b-5a95fa9a4a87 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:45.896368 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-724a850b-1326-404e-848b-5a95fa9a4a87 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:45.897170 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-724a850b-1326-404e-848b-5a95fa9a4a87 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:45.897630 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-724a850b-1326-404e-848b-5a95fa9a4a87 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:45.898373 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-724a850b-1326-404e-848b-5a95fa9a4a87 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:45.898897 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-724a850b-1326-404e-848b-5a95fa9a4a87 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:45.901800 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-724a850b-1326-404e-848b-5a95fa9a4a87 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:45.947682 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-724a850b-1326-404e-848b-5a95fa9a4a87 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] HTTP exception thrown: Instance f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8 could not be found. Sep 08 11:00:45.954509 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-724a850b-1326-404e-848b-5a95fa9a4a87 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Request method failure captured: Sep 08 11:00:45.954509 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8 HTTP/1.1 Sep 08 11:00:45.954509 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:00:45.954509 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:00:45.954509 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:00:45.954509 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 11:00:45.954509 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:00:45.954509 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:00:45.954509 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:00:45.954509 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:00:45.954509 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcqs5rmT4eT7GJb8IMsQTFB7NcuijudznuEcZXGo36JQdAqXL4ap3XQx82WrisMCaKSVfCo0kDZCZazAIV253gOknVwLifmg682ZY3OPV0T8LQ1z_y6-q_mDxd9dEE1aCpTvhgf2jtXUWCvyodKct13wyO20CjQ51HdgmEGw0B8icDo Sep 08 11:00:45.954509 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:00:45.954509 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:00:45.954509 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:00:45.954509 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:00:45.954509 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:00:45.954509 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:00:45.954509 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: def11bb6a39848a5855a6c8534b5edba Sep 08 11:00:45.954509 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1851073780 Sep 08 11:00:45.954509 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:00:45.954509 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:00:45.954509 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/def11bb6a39848a5855a6c8534b5edba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/def11bb6a39848a5855a6c8534b5edba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_def11bb6a39848a5855a6c8534b5edba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/def11bb6a39848a5855a6c8534b5edba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:00:45.954509 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServerDiskConfigTestJSON-1851073780 Sep 08 11:00:45.954509 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: def11bb6a39848a5855a6c8534b5edba Sep 08 11:00:45.954509 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1851073780 Sep 08 11:00:45.954509 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServerDiskConfigTestJSON-1851073780-project Sep 08 11:00:45.954509 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:00:45.954509 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:00:45.954509 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 886104e81be14c18a30b75facfcf246e Sep 08 11:00:45.954509 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServerDiskConfigTestJSON-1851073780-project Sep 08 11:00:45.954509 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 11:00:45.954509 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8 could not be found. Sep 08 11:00:45.954509 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': 'f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8'} Sep 08 11:00:45.954509 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:00:45.954509 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:00:45.954509 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:00:45.954509 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:00:45.954509 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:00:45.954509 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:00:45.954509 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:00:45.954509 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:00:45.954509 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:00:45.954509 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:00:45.954509 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8 could not be found. Sep 08 11:00:45.954509 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:00:45.954509 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:00:45.954509 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:00:45.954509 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:00:45.954509 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:00:45.954509 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:00:45.954509 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:00:45.954509 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:00:45.954509 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:00:45.954509 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:00:45.954509 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:00:45.954509 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:00:45.954509 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:00:45.954509 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:00:45.954509 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:00:45.954509 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:00:45.954509 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8 could not be found. Sep 08 11:00:45.954509 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:00:45.954509 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:00:45.954509 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:00:45.959217 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:00:45.959217 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:00:45.959217 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:00:45.959217 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:00:45.959217 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:00:45.959217 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8 could not be found. Sep 08 11:00:45.959217 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:00:45.959217 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-724a850b-1326-404e-848b-5a95fa9a4a87 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Returning 404 to user: Instance f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:00:45.959217 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-724a850b-1326-404e-848b-5a95fa9a4a87 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8" status: 404 len: 111 microversion: 2.1 time: 0.092841 Sep 08 11:00:45.959217 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2453/4821] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:00:45 2022] GET /compute/v2.1/servers/f4c6f290-05ab-4ecd-a4aa-77e0c7464fb8 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:00:45.975566 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1e4db566-7788-48b6-b4d1-e7eadd2b7116 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:45.976372 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1e4db566-7788-48b6-b4d1-e7eadd2b7116 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: 82458f68-8fcf-4d1f-8e7b-87d76f3576ad] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:45.992691 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e4db566-7788-48b6-b4d1-e7eadd2b7116 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:45.994311 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e4db566-7788-48b6-b4d1-e7eadd2b7116 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:45.996310 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e4db566-7788-48b6-b4d1-e7eadd2b7116 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:45.997186 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e4db566-7788-48b6-b4d1-e7eadd2b7116 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:46.000085 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e4db566-7788-48b6-b4d1-e7eadd2b7116 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:46.000549 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e4db566-7788-48b6-b4d1-e7eadd2b7116 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:46.028332 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-1e4db566-7788-48b6-b4d1-e7eadd2b7116 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] HTTP exception thrown: Instance 82458f68-8fcf-4d1f-8e7b-87d76f3576ad could not be found. Sep 08 11:00:46.031523 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1e4db566-7788-48b6-b4d1-e7eadd2b7116 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Request method failure captured: Sep 08 11:00:46.031523 n-d-850501-12 devstack@n-api.service[128861]: request: DELETE /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad HTTP/1.1 Sep 08 11:00:46.031523 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:00:46.031523 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:00:46.031523 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:00:46.031523 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 11:00:46.031523 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:00:46.031523 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:00:46.031523 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:00:46.031523 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:00:46.031523 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcqs5rmT4eT7GJb8IMsQTFB7NcuijudznuEcZXGo36JQdAqXL4ap3XQx82WrisMCaKSVfCo0kDZCZazAIV253gOknVwLifmg682ZY3OPV0T8LQ1z_y6-q_mDxd9dEE1aCpTvhgf2jtXUWCvyodKct13wyO20CjQ51HdgmEGw0B8icDo Sep 08 11:00:46.031523 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:00:46.031523 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:00:46.031523 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:00:46.031523 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:00:46.031523 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:00:46.031523 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:00:46.031523 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: def11bb6a39848a5855a6c8534b5edba Sep 08 11:00:46.031523 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1851073780 Sep 08 11:00:46.031523 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:00:46.031523 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:00:46.031523 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/def11bb6a39848a5855a6c8534b5edba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/def11bb6a39848a5855a6c8534b5edba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_def11bb6a39848a5855a6c8534b5edba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/def11bb6a39848a5855a6c8534b5edba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:00:46.031523 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServerDiskConfigTestJSON-1851073780 Sep 08 11:00:46.031523 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: def11bb6a39848a5855a6c8534b5edba Sep 08 11:00:46.031523 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1851073780 Sep 08 11:00:46.031523 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServerDiskConfigTestJSON-1851073780-project Sep 08 11:00:46.031523 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:00:46.031523 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:00:46.031523 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 886104e81be14c18a30b75facfcf246e Sep 08 11:00:46.031523 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServerDiskConfigTestJSON-1851073780-project Sep 08 11:00:46.031523 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 11:00:46.031523 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 82458f68-8fcf-4d1f-8e7b-87d76f3576ad could not be found. Sep 08 11:00:46.031523 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '82458f68-8fcf-4d1f-8e7b-87d76f3576ad'} Sep 08 11:00:46.031523 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:00:46.031523 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:00:46.031523 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:00:46.031523 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:00:46.031523 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:00:46.031523 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:00:46.031523 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:00:46.031523 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:00:46.031523 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:00:46.031523 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:00:46.031523 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82458f68-8fcf-4d1f-8e7b-87d76f3576ad could not be found. Sep 08 11:00:46.031523 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:00:46.031523 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:00:46.031523 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:00:46.031523 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:00:46.031523 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:00:46.031523 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:00:46.031523 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:00:46.031523 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:00:46.031523 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:00:46.031523 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:00:46.031523 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 11:00:46.031523 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 11:00:46.031523 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 11:00:46.031523 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 11:00:46.031523 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:00:46.031523 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:00:46.031523 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:00:46.031523 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:00:46.036107 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82458f68-8fcf-4d1f-8e7b-87d76f3576ad could not be found. Sep 08 11:00:46.036107 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:00:46.036107 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:00:46.036107 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:00:46.036107 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:00:46.036107 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:00:46.036107 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:00:46.036107 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:00:46.036107 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:00:46.036107 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82458f68-8fcf-4d1f-8e7b-87d76f3576ad could not be found. Sep 08 11:00:46.036107 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:00:46.036107 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1e4db566-7788-48b6-b4d1-e7eadd2b7116 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Returning 404 to user: Instance 82458f68-8fcf-4d1f-8e7b-87d76f3576ad could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:00:46.036107 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1e4db566-7788-48b6-b4d1-e7eadd2b7116 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "DELETE /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad" status: 404 len: 111 microversion: 2.1 time: 0.071031 Sep 08 11:00:46.036992 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2454/4822] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:00:45 2022] DELETE /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 11:00:46.042181 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-74f81064-10b8-4cc8-aea6-f86e4552f193 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:46.042805 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-74f81064-10b8-4cc8-aea6-f86e4552f193 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] [instance: 82458f68-8fcf-4d1f-8e7b-87d76f3576ad] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:46.055050 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-74f81064-10b8-4cc8-aea6-f86e4552f193 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:46.055992 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-74f81064-10b8-4cc8-aea6-f86e4552f193 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:46.056983 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-88089973-8815-4158-a14e-c82112e68804 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:46.057644 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-74f81064-10b8-4cc8-aea6-f86e4552f193 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:46.058908 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-74f81064-10b8-4cc8-aea6-f86e4552f193 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:46.062169 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-74f81064-10b8-4cc8-aea6-f86e4552f193 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:46.062640 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-74f81064-10b8-4cc8-aea6-f86e4552f193 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:46.076545 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-88089973-8815-4158-a14e-c82112e68804 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/2cad3ede-cfb3-48bb-b0e1-b999dc5cae07" status: 200 len: 1509 microversion: 2.1 time: 0.819668 Sep 08 11:00:46.078575 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2369/4823] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:00:45 2022] GET /compute/v2.1/servers/2cad3ede-cfb3-48bb-b0e1-b999dc5cae07 => generated 1509 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:00:46.101841 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-74f81064-10b8-4cc8-aea6-f86e4552f193 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] HTTP exception thrown: Instance 82458f68-8fcf-4d1f-8e7b-87d76f3576ad could not be found. Sep 08 11:00:46.103674 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-74f81064-10b8-4cc8-aea6-f86e4552f193 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Request method failure captured: Sep 08 11:00:46.103674 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad HTTP/1.1 Sep 08 11:00:46.103674 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:00:46.103674 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:00:46.103674 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:00:46.103674 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 11:00:46.103674 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:00:46.103674 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:00:46.103674 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:00:46.103674 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:00:46.103674 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcqs5rmT4eT7GJb8IMsQTFB7NcuijudznuEcZXGo36JQdAqXL4ap3XQx82WrisMCaKSVfCo0kDZCZazAIV253gOknVwLifmg682ZY3OPV0T8LQ1z_y6-q_mDxd9dEE1aCpTvhgf2jtXUWCvyodKct13wyO20CjQ51HdgmEGw0B8icDo Sep 08 11:00:46.103674 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:00:46.103674 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:00:46.103674 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:00:46.103674 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:00:46.103674 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:00:46.103674 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:00:46.103674 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: def11bb6a39848a5855a6c8534b5edba Sep 08 11:00:46.103674 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1851073780 Sep 08 11:00:46.103674 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:00:46.103674 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:00:46.103674 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/def11bb6a39848a5855a6c8534b5edba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/def11bb6a39848a5855a6c8534b5edba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_def11bb6a39848a5855a6c8534b5edba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/def11bb6a39848a5855a6c8534b5edba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:00:46.103674 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServerDiskConfigTestJSON-1851073780 Sep 08 11:00:46.103674 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: def11bb6a39848a5855a6c8534b5edba Sep 08 11:00:46.103674 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1851073780 Sep 08 11:00:46.103674 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServerDiskConfigTestJSON-1851073780-project Sep 08 11:00:46.103674 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:00:46.103674 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:00:46.103674 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 886104e81be14c18a30b75facfcf246e Sep 08 11:00:46.103674 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServerDiskConfigTestJSON-1851073780-project Sep 08 11:00:46.103674 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 11:00:46.103674 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 82458f68-8fcf-4d1f-8e7b-87d76f3576ad could not be found. Sep 08 11:00:46.103674 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '82458f68-8fcf-4d1f-8e7b-87d76f3576ad'} Sep 08 11:00:46.103674 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:00:46.103674 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:00:46.103674 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:00:46.103674 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:00:46.103674 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:00:46.103674 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:00:46.103674 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:00:46.103674 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:00:46.103674 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:00:46.103674 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:00:46.103674 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82458f68-8fcf-4d1f-8e7b-87d76f3576ad could not be found. Sep 08 11:00:46.103674 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:00:46.103674 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:00:46.103674 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:00:46.103674 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:00:46.103674 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:00:46.103674 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:00:46.103674 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:00:46.103674 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:00:46.103674 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:00:46.103674 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:00:46.103674 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:00:46.103674 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:00:46.103674 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:00:46.103674 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:00:46.103674 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:00:46.103674 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:00:46.103674 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82458f68-8fcf-4d1f-8e7b-87d76f3576ad could not be found. Sep 08 11:00:46.103674 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:00:46.103674 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:00:46.103674 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:00:46.109044 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:00:46.109044 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:00:46.109044 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:00:46.109044 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:00:46.109044 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:00:46.109044 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82458f68-8fcf-4d1f-8e7b-87d76f3576ad could not be found. Sep 08 11:00:46.109044 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:00:46.109044 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-74f81064-10b8-4cc8-aea6-f86e4552f193 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] Returning 404 to user: Instance 82458f68-8fcf-4d1f-8e7b-87d76f3576ad could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:00:46.109044 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-74f81064-10b8-4cc8-aea6-f86e4552f193 tempest-ServerDiskConfigTestJSON-1851073780 tempest-ServerDiskConfigTestJSON-1851073780-project] 10.222.0.27 "GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad" status: 404 len: 111 microversion: 2.1 time: 0.069261 Sep 08 11:00:46.111188 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2455/4824] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:00:46 2022] GET /compute/v2.1/servers/82458f68-8fcf-4d1f-8e7b-87d76f3576ad => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:00:46.718775 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dade985e-dea5-4667-b98a-3146de3ebaad tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:46.719387 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-dade985e-dea5-4667-b98a-3146de3ebaad tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:46.731516 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dade985e-dea5-4667-b98a-3146de3ebaad tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:46.738880 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dade985e-dea5-4667-b98a-3146de3ebaad tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:46.740945 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dade985e-dea5-4667-b98a-3146de3ebaad tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:46.744704 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dade985e-dea5-4667-b98a-3146de3ebaad tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:46.750880 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dade985e-dea5-4667-b98a-3146de3ebaad tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:46.764540 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dade985e-dea5-4667-b98a-3146de3ebaad tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:47.111437 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-95a6a6d6-c413-4938-8813-c1d0f8d9b2ae tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:47.112763 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-95a6a6d6-c413-4938-8813-c1d0f8d9b2ae tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 2cad3ede-cfb3-48bb-b0e1-b999dc5cae07] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:47.126055 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-95a6a6d6-c413-4938-8813-c1d0f8d9b2ae tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:47.131972 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-95a6a6d6-c413-4938-8813-c1d0f8d9b2ae tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:47.131972 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-95a6a6d6-c413-4938-8813-c1d0f8d9b2ae tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:47.131972 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-95a6a6d6-c413-4938-8813-c1d0f8d9b2ae tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:47.131972 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-95a6a6d6-c413-4938-8813-c1d0f8d9b2ae tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:47.131972 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-95a6a6d6-c413-4938-8813-c1d0f8d9b2ae tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:47.353888 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-dade985e-dea5-4667-b98a-3146de3ebaad tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:47.379047 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-dade985e-dea5-4667-b98a-3146de3ebaad tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:47.381015 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-dade985e-dea5-4667-b98a-3146de3ebaad tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:47.386543 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-dade985e-dea5-4667-b98a-3146de3ebaad tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1874 microversion: 2.42 time: 0.670259 Sep 08 11:00:47.387707 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2370/4825] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:00:46 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1874 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:00:47.945934 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-95a6a6d6-c413-4938-8813-c1d0f8d9b2ae tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:47.961138 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-95a6a6d6-c413-4938-8813-c1d0f8d9b2ae tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/2cad3ede-cfb3-48bb-b0e1-b999dc5cae07" status: 200 len: 1509 microversion: 2.1 time: 0.856227 Sep 08 11:00:47.962046 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2456/4826] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:00:47 2022] GET /compute/v2.1/servers/2cad3ede-cfb3-48bb-b0e1-b999dc5cae07 => generated 1509 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:00:48.426377 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-828062f2-104a-44a2-ac27-b7ab2c71c7f5 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:48.427049 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-828062f2-104a-44a2-ac27-b7ab2c71c7f5 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:48.443923 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-828062f2-104a-44a2-ac27-b7ab2c71c7f5 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:48.444358 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-828062f2-104a-44a2-ac27-b7ab2c71c7f5 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:48.444802 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-828062f2-104a-44a2-ac27-b7ab2c71c7f5 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:48.452478 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-828062f2-104a-44a2-ac27-b7ab2c71c7f5 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:48.452982 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-828062f2-104a-44a2-ac27-b7ab2c71c7f5 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:48.456832 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-828062f2-104a-44a2-ac27-b7ab2c71c7f5 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:48.987444 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-dec9a33f-c301-473e-87c6-92e338370acb tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:48.989450 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-dec9a33f-c301-473e-87c6-92e338370acb tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 2cad3ede-cfb3-48bb-b0e1-b999dc5cae07] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:49.007063 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dec9a33f-c301-473e-87c6-92e338370acb tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:49.008087 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dec9a33f-c301-473e-87c6-92e338370acb tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:49.027887 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dec9a33f-c301-473e-87c6-92e338370acb tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:49.030170 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dec9a33f-c301-473e-87c6-92e338370acb tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:49.031774 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dec9a33f-c301-473e-87c6-92e338370acb tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:49.034988 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dec9a33f-c301-473e-87c6-92e338370acb tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:49.228960 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-828062f2-104a-44a2-ac27-b7ab2c71c7f5 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:49.246415 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-828062f2-104a-44a2-ac27-b7ab2c71c7f5 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:49.250445 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-828062f2-104a-44a2-ac27-b7ab2c71c7f5 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:49.257894 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-828062f2-104a-44a2-ac27-b7ab2c71c7f5 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1874 microversion: 2.42 time: 0.835410 Sep 08 11:00:49.258022 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2371/4827] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:00:48 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1874 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 11:00:50.066870 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-dec9a33f-c301-473e-87c6-92e338370acb tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:50.074396 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:00:50.079248 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-dec9a33f-c301-473e-87c6-92e338370acb tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/2cad3ede-cfb3-48bb-b0e1-b999dc5cae07" status: 200 len: 1509 microversion: 2.1 time: 1.094938 Sep 08 11:00:50.081737 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2457/4828] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:00:48 2022] GET /compute/v2.1/servers/2cad3ede-cfb3-48bb-b0e1-b999dc5cae07 => generated 1509 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:00:50.287237 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4f5b4408-a510-4fd5-a173-03570f675dcd tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:50.287862 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4f5b4408-a510-4fd5-a173-03570f675dcd tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:50.303130 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f5b4408-a510-4fd5-a173-03570f675dcd tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:50.307986 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f5b4408-a510-4fd5-a173-03570f675dcd tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:50.308740 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f5b4408-a510-4fd5-a173-03570f675dcd tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:50.310357 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f5b4408-a510-4fd5-a173-03570f675dcd tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:50.313951 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f5b4408-a510-4fd5-a173-03570f675dcd tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:50.314618 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f5b4408-a510-4fd5-a173-03570f675dcd tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:51.105187 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-03637b7d-2c75-4c12-a168-7fd5c82528b7 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:51.107300 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-03637b7d-2c75-4c12-a168-7fd5c82528b7 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 2cad3ede-cfb3-48bb-b0e1-b999dc5cae07] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:51.143176 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-03637b7d-2c75-4c12-a168-7fd5c82528b7 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:51.147282 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-03637b7d-2c75-4c12-a168-7fd5c82528b7 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:51.148611 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-03637b7d-2c75-4c12-a168-7fd5c82528b7 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:51.149711 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-03637b7d-2c75-4c12-a168-7fd5c82528b7 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:51.155586 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-03637b7d-2c75-4c12-a168-7fd5c82528b7 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:51.157539 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-03637b7d-2c75-4c12-a168-7fd5c82528b7 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:51.537771 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4f5b4408-a510-4fd5-a173-03570f675dcd tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:51.560303 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4f5b4408-a510-4fd5-a173-03570f675dcd tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:51.578107 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4f5b4408-a510-4fd5-a173-03570f675dcd tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:51.579753 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4f5b4408-a510-4fd5-a173-03570f675dcd tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1874 microversion: 2.42 time: 1.296715 Sep 08 11:00:51.585521 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2372/4829] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:00:50 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1874 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:00:51.586987 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4f5b4408-a510-4fd5-a173-03570f675dcd tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:51.589282 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4f5b4408-a510-4fd5-a173-03570f675dcd tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002555 Sep 08 11:00:51.608176 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2373/4830] 10.222.0.27 () {56 vars in 886 bytes} [Thu Sep 8 11:00:51 2022] GET /compute/ => generated 377 bytes in 18 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 08 11:00:51.610066 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4f5b4408-a510-4fd5-a173-03570f675dcd tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:51.611408 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4f5b4408-a510-4fd5-a173-03570f675dcd tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.001878 Sep 08 11:00:51.612471 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2374/4831] 10.222.0.27 () {54 vars in 1035 bytes} [Thu Sep 8 11:00:51 2022] GET /compute/v2/ => generated 379 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Sep 08 11:00:51.622335 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4f5b4408-a510-4fd5-a173-03570f675dcd tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:51.624969 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4f5b4408-a510-4fd5-a173-03570f675dcd tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.003262 Sep 08 11:00:51.637880 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2375/4832] 10.222.0.27 () {54 vars in 1041 bytes} [Thu Sep 8 11:00:51 2022] GET /compute/v2.1/ => generated 388 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:00:51.639399 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4f5b4408-a510-4fd5-a173-03570f675dcd tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:51.643603 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4f5b4408-a510-4fd5-a173-03570f675dcd tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute//" status: 200 len: 377 microversion: - time: 0.004422 Sep 08 11:00:51.644950 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2376/4833] 10.222.0.27 () {56 vars in 886 bytes} [Thu Sep 8 11:00:51 2022] GET /compute/ => generated 377 bytes in 6 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 08 11:00:52.635998 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-51424d31-af8c-4993-ad22-821642ccb3c5 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:52.637455 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-51424d31-af8c-4993-ad22-821642ccb3c5 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:52.664064 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51424d31-af8c-4993-ad22-821642ccb3c5 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:52.664600 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51424d31-af8c-4993-ad22-821642ccb3c5 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:52.667570 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51424d31-af8c-4993-ad22-821642ccb3c5 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:52.668536 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51424d31-af8c-4993-ad22-821642ccb3c5 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:52.673524 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51424d31-af8c-4993-ad22-821642ccb3c5 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:52.677123 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51424d31-af8c-4993-ad22-821642ccb3c5 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:53.399323 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-03637b7d-2c75-4c12-a168-7fd5c82528b7 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:53.408960 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-03637b7d-2c75-4c12-a168-7fd5c82528b7 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/2cad3ede-cfb3-48bb-b0e1-b999dc5cae07" status: 200 len: 1509 microversion: 2.1 time: 2.310254 Sep 08 11:00:53.424827 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2458/4834] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:00:51 2022] GET /compute/v2.1/servers/2cad3ede-cfb3-48bb-b0e1-b999dc5cae07 => generated 1509 bytes in 2327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:00:53.813395 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-51424d31-af8c-4993-ad22-821642ccb3c5 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:53.824387 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-51424d31-af8c-4993-ad22-821642ccb3c5 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:53.846305 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-51424d31-af8c-4993-ad22-821642ccb3c5 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:53.847532 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-51424d31-af8c-4993-ad22-821642ccb3c5 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1874 microversion: 2.42 time: 1.225996 Sep 08 11:00:53.848108 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2377/4835] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:00:52 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1874 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:00:54.439877 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ff654be1-fee2-44ca-9bb4-620a67b3ca66 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:54.441623 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ff654be1-fee2-44ca-9bb4-620a67b3ca66 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 2cad3ede-cfb3-48bb-b0e1-b999dc5cae07] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:54.457581 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ff654be1-fee2-44ca-9bb4-620a67b3ca66 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:54.462883 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ff654be1-fee2-44ca-9bb4-620a67b3ca66 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:54.467932 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ff654be1-fee2-44ca-9bb4-620a67b3ca66 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:54.470557 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ff654be1-fee2-44ca-9bb4-620a67b3ca66 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:54.471916 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ff654be1-fee2-44ca-9bb4-620a67b3ca66 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:54.475431 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ff654be1-fee2-44ca-9bb4-620a67b3ca66 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:54.879679 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-56fa5c2e-963d-4b25-a7af-9bc5c4093ae3 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:54.880295 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-56fa5c2e-963d-4b25-a7af-9bc5c4093ae3 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:54.887333 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-56fa5c2e-963d-4b25-a7af-9bc5c4093ae3 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:54.898917 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-56fa5c2e-963d-4b25-a7af-9bc5c4093ae3 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:54.909737 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-56fa5c2e-963d-4b25-a7af-9bc5c4093ae3 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:54.910751 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-56fa5c2e-963d-4b25-a7af-9bc5c4093ae3 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:54.916128 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-56fa5c2e-963d-4b25-a7af-9bc5c4093ae3 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:54.916816 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-56fa5c2e-963d-4b25-a7af-9bc5c4093ae3 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:55.797837 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-56fa5c2e-963d-4b25-a7af-9bc5c4093ae3 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:55.822124 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-56fa5c2e-963d-4b25-a7af-9bc5c4093ae3 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:55.824362 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-56fa5c2e-963d-4b25-a7af-9bc5c4093ae3 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:55.831553 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-56fa5c2e-963d-4b25-a7af-9bc5c4093ae3 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1874 microversion: 2.42 time: 0.955422 Sep 08 11:00:55.846672 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2378/4836] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:00:54 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1874 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 11:00:55.873109 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ff654be1-fee2-44ca-9bb4-620a67b3ca66 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:55.889992 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ff654be1-fee2-44ca-9bb4-620a67b3ca66 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/2cad3ede-cfb3-48bb-b0e1-b999dc5cae07" status: 200 len: 1509 microversion: 2.1 time: 1.454474 Sep 08 11:00:55.891890 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2459/4837] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:00:54 2022] GET /compute/v2.1/servers/2cad3ede-cfb3-48bb-b0e1-b999dc5cae07 => generated 1509 bytes in 1458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:00:56.868912 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-791768e6-ec34-42f8-8c31-61c30a577df9 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:56.869687 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-791768e6-ec34-42f8-8c31-61c30a577df9 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:56.890914 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-791768e6-ec34-42f8-8c31-61c30a577df9 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:56.891563 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-791768e6-ec34-42f8-8c31-61c30a577df9 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:56.892203 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-791768e6-ec34-42f8-8c31-61c30a577df9 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:56.896057 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-791768e6-ec34-42f8-8c31-61c30a577df9 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:56.897139 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-791768e6-ec34-42f8-8c31-61c30a577df9 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:56.900540 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-791768e6-ec34-42f8-8c31-61c30a577df9 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:56.926539 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d598ecb1-2d02-48c9-83bb-81d7976a3e8b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:56.928022 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d598ecb1-2d02-48c9-83bb-81d7976a3e8b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 2cad3ede-cfb3-48bb-b0e1-b999dc5cae07] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:56.961172 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d598ecb1-2d02-48c9-83bb-81d7976a3e8b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:56.961705 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d598ecb1-2d02-48c9-83bb-81d7976a3e8b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:56.963603 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d598ecb1-2d02-48c9-83bb-81d7976a3e8b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:56.965554 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d598ecb1-2d02-48c9-83bb-81d7976a3e8b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:56.975614 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d598ecb1-2d02-48c9-83bb-81d7976a3e8b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:56.975614 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d598ecb1-2d02-48c9-83bb-81d7976a3e8b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:57.495051 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-791768e6-ec34-42f8-8c31-61c30a577df9 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:57.524319 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-791768e6-ec34-42f8-8c31-61c30a577df9 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:57.526138 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-791768e6-ec34-42f8-8c31-61c30a577df9 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:57.533013 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-791768e6-ec34-42f8-8c31-61c30a577df9 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1874 microversion: 2.42 time: 0.666456 Sep 08 11:00:57.560506 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2379/4838] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:00:56 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1874 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:00:57.968074 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d598ecb1-2d02-48c9-83bb-81d7976a3e8b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:57.988786 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d598ecb1-2d02-48c9-83bb-81d7976a3e8b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/2cad3ede-cfb3-48bb-b0e1-b999dc5cae07" status: 200 len: 1509 microversion: 2.1 time: 1.070000 Sep 08 11:00:58.006262 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2460/4839] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:00:56 2022] GET /compute/v2.1/servers/2cad3ede-cfb3-48bb-b0e1-b999dc5cae07 => generated 1509 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:00:58.562995 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-82bf9daf-90e8-4b1b-891b-16a738e668e0 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:58.563809 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-82bf9daf-90e8-4b1b-891b-16a738e668e0 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:58.572706 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=58 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:00:58.581643 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-82bf9daf-90e8-4b1b-891b-16a738e668e0 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:58.582122 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-82bf9daf-90e8-4b1b-891b-16a738e668e0 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:58.582557 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-82bf9daf-90e8-4b1b-891b-16a738e668e0 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:58.593884 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-82bf9daf-90e8-4b1b-891b-16a738e668e0 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:58.595370 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-82bf9daf-90e8-4b1b-891b-16a738e668e0 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:58.596465 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-82bf9daf-90e8-4b1b-891b-16a738e668e0 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:59.012521 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-236357b0-08c3-4253-9e47-18c970b60702 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:00:59.013986 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-236357b0-08c3-4253-9e47-18c970b60702 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 2cad3ede-cfb3-48bb-b0e1-b999dc5cae07] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:00:59.031099 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-236357b0-08c3-4253-9e47-18c970b60702 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:59.031600 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-236357b0-08c3-4253-9e47-18c970b60702 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:59.032043 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-236357b0-08c3-4253-9e47-18c970b60702 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:59.032759 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-236357b0-08c3-4253-9e47-18c970b60702 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:00:59.033275 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-236357b0-08c3-4253-9e47-18c970b60702 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:00:59.033706 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-236357b0-08c3-4253-9e47-18c970b60702 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:00:59.833059 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-82bf9daf-90e8-4b1b-891b-16a738e668e0 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:59.842787 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-82bf9daf-90e8-4b1b-891b-16a738e668e0 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:59.844246 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-82bf9daf-90e8-4b1b-891b-16a738e668e0 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:59.869521 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-82bf9daf-90e8-4b1b-891b-16a738e668e0 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1874 microversion: 2.42 time: 1.286882 Sep 08 11:00:59.879092 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2380/4840] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:00:58 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1874 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:00:59.957913 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-236357b0-08c3-4253-9e47-18c970b60702 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:00:59.966289 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-236357b0-08c3-4253-9e47-18c970b60702 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/2cad3ede-cfb3-48bb-b0e1-b999dc5cae07" status: 200 len: 1509 microversion: 2.1 time: 0.957466 Sep 08 11:00:59.966894 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2461/4841] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:00:59 2022] GET /compute/v2.1/servers/2cad3ede-cfb3-48bb-b0e1-b999dc5cae07 => generated 1509 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:01:00.903568 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f0f35241-7dc0-4a6f-bfeb-7574f82e0eea tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:00.904720 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f0f35241-7dc0-4a6f-bfeb-7574f82e0eea tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:00.922471 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0f35241-7dc0-4a6f-bfeb-7574f82e0eea tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:00.922974 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0f35241-7dc0-4a6f-bfeb-7574f82e0eea tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:00.923416 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0f35241-7dc0-4a6f-bfeb-7574f82e0eea tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:00.926430 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0f35241-7dc0-4a6f-bfeb-7574f82e0eea tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:00.928510 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0f35241-7dc0-4a6f-bfeb-7574f82e0eea tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:00.929514 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0f35241-7dc0-4a6f-bfeb-7574f82e0eea tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:00.994637 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-148f0be0-aeea-41c3-93f0-1cfeaefff592 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:00.995387 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-148f0be0-aeea-41c3-93f0-1cfeaefff592 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 2cad3ede-cfb3-48bb-b0e1-b999dc5cae07] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:01.015341 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-148f0be0-aeea-41c3-93f0-1cfeaefff592 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:01.019514 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-148f0be0-aeea-41c3-93f0-1cfeaefff592 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:01.022355 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-148f0be0-aeea-41c3-93f0-1cfeaefff592 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:01.027313 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-148f0be0-aeea-41c3-93f0-1cfeaefff592 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:01.031103 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-148f0be0-aeea-41c3-93f0-1cfeaefff592 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:01.031771 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-148f0be0-aeea-41c3-93f0-1cfeaefff592 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:01.314988 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f0f35241-7dc0-4a6f-bfeb-7574f82e0eea tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:01.325223 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:01:01.333625 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f0f35241-7dc0-4a6f-bfeb-7574f82e0eea tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:01.335813 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f0f35241-7dc0-4a6f-bfeb-7574f82e0eea tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:01.347960 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f0f35241-7dc0-4a6f-bfeb-7574f82e0eea tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1874 microversion: 2.42 time: 0.439481 Sep 08 11:01:01.350078 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2381/4842] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:01:00 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1874 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:01:02.382486 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b5cd27b1-62e7-4298-917f-35b52ce3817e tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:02.383157 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b5cd27b1-62e7-4298-917f-35b52ce3817e tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:02.398574 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b5cd27b1-62e7-4298-917f-35b52ce3817e tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:02.401586 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b5cd27b1-62e7-4298-917f-35b52ce3817e tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:02.403692 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b5cd27b1-62e7-4298-917f-35b52ce3817e tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:02.405455 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b5cd27b1-62e7-4298-917f-35b52ce3817e tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:02.407450 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b5cd27b1-62e7-4298-917f-35b52ce3817e tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:02.408585 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b5cd27b1-62e7-4298-917f-35b52ce3817e tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:02.441452 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-148f0be0-aeea-41c3-93f0-1cfeaefff592 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:02.454747 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-148f0be0-aeea-41c3-93f0-1cfeaefff592 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/2cad3ede-cfb3-48bb-b0e1-b999dc5cae07" status: 200 len: 1509 microversion: 2.1 time: 1.465333 Sep 08 11:01:02.468523 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2462/4843] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:01:00 2022] GET /compute/v2.1/servers/2cad3ede-cfb3-48bb-b0e1-b999dc5cae07 => generated 1509 bytes in 1479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:01:03.492591 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fb966285-582b-46eb-a3c5-189bcdadfd70 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:03.493573 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fb966285-582b-46eb-a3c5-189bcdadfd70 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 2cad3ede-cfb3-48bb-b0e1-b999dc5cae07] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:03.510043 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb966285-582b-46eb-a3c5-189bcdadfd70 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:03.510835 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb966285-582b-46eb-a3c5-189bcdadfd70 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:03.511392 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb966285-582b-46eb-a3c5-189bcdadfd70 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:03.512066 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb966285-582b-46eb-a3c5-189bcdadfd70 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:03.512523 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb966285-582b-46eb-a3c5-189bcdadfd70 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:03.512941 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb966285-582b-46eb-a3c5-189bcdadfd70 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:03.741848 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b5cd27b1-62e7-4298-917f-35b52ce3817e tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:03.763129 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b5cd27b1-62e7-4298-917f-35b52ce3817e tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:03.765301 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b5cd27b1-62e7-4298-917f-35b52ce3817e tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:03.766891 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b5cd27b1-62e7-4298-917f-35b52ce3817e tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1874 microversion: 2.42 time: 1.390924 Sep 08 11:01:03.767771 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2382/4844] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:01:02 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1874 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:01:04.100033 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-fb966285-582b-46eb-a3c5-189bcdadfd70 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:04.118004 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fb966285-582b-46eb-a3c5-189bcdadfd70 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/2cad3ede-cfb3-48bb-b0e1-b999dc5cae07" status: 200 len: 1509 microversion: 2.1 time: 0.628378 Sep 08 11:01:04.139030 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2463/4845] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:01:03 2022] GET /compute/v2.1/servers/2cad3ede-cfb3-48bb-b0e1-b999dc5cae07 => generated 1509 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:01:04.798495 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ace5f794-782b-4d90-ac0e-bff5e88cdd04 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:04.798495 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ace5f794-782b-4d90-ac0e-bff5e88cdd04 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:04.810499 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ace5f794-782b-4d90-ac0e-bff5e88cdd04 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:04.811020 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ace5f794-782b-4d90-ac0e-bff5e88cdd04 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:04.811464 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ace5f794-782b-4d90-ac0e-bff5e88cdd04 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:04.812198 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ace5f794-782b-4d90-ac0e-bff5e88cdd04 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:04.812662 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ace5f794-782b-4d90-ac0e-bff5e88cdd04 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:04.817279 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ace5f794-782b-4d90-ac0e-bff5e88cdd04 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:05.153490 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-39bb3c04-a3f9-4325-9098-42e2838b8d8b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:05.154162 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-39bb3c04-a3f9-4325-9098-42e2838b8d8b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 2cad3ede-cfb3-48bb-b0e1-b999dc5cae07] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:05.171410 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:01:05.172955 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-39bb3c04-a3f9-4325-9098-42e2838b8d8b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:05.173491 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-39bb3c04-a3f9-4325-9098-42e2838b8d8b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:05.173934 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-39bb3c04-a3f9-4325-9098-42e2838b8d8b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:05.174659 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-39bb3c04-a3f9-4325-9098-42e2838b8d8b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:05.180663 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-39bb3c04-a3f9-4325-9098-42e2838b8d8b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:05.181350 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-39bb3c04-a3f9-4325-9098-42e2838b8d8b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:05.793456 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-39bb3c04-a3f9-4325-9098-42e2838b8d8b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:05.807258 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-39bb3c04-a3f9-4325-9098-42e2838b8d8b tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/2cad3ede-cfb3-48bb-b0e1-b999dc5cae07" status: 200 len: 1506 microversion: 2.1 time: 0.661153 Sep 08 11:01:05.828920 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2464/4846] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:01:05 2022] GET /compute/v2.1/servers/2cad3ede-cfb3-48bb-b0e1-b999dc5cae07 => generated 1506 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:01:06.154814 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ace5f794-782b-4d90-ac0e-bff5e88cdd04 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:06.177130 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ace5f794-782b-4d90-ac0e-bff5e88cdd04 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:06.181278 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ace5f794-782b-4d90-ac0e-bff5e88cdd04 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:06.183067 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ace5f794-782b-4d90-ac0e-bff5e88cdd04 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1874 microversion: 2.42 time: 1.391331 Sep 08 11:01:06.199053 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2383/4847] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:01:04 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1874 bytes in 1408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:01:06.849188 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a965b946-6cdf-4317-bf6f-2dd6ba153167 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:06.849875 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a965b946-6cdf-4317-bf6f-2dd6ba153167 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 2cad3ede-cfb3-48bb-b0e1-b999dc5cae07] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:06.874441 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a965b946-6cdf-4317-bf6f-2dd6ba153167 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:06.874957 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a965b946-6cdf-4317-bf6f-2dd6ba153167 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:06.875455 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a965b946-6cdf-4317-bf6f-2dd6ba153167 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:06.876128 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a965b946-6cdf-4317-bf6f-2dd6ba153167 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:06.876593 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a965b946-6cdf-4317-bf6f-2dd6ba153167 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:06.877049 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a965b946-6cdf-4317-bf6f-2dd6ba153167 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:07.157936 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a965b946-6cdf-4317-bf6f-2dd6ba153167 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:07.171466 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a965b946-6cdf-4317-bf6f-2dd6ba153167 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/2cad3ede-cfb3-48bb-b0e1-b999dc5cae07" status: 200 len: 1506 microversion: 2.1 time: 0.327396 Sep 08 11:01:07.172188 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2465/4848] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:01:06 2022] GET /compute/v2.1/servers/2cad3ede-cfb3-48bb-b0e1-b999dc5cae07 => generated 1506 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:01:07.213532 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-609e0f01-aa6d-4d6d-89d1-f1432b3b7480 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:07.214172 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-609e0f01-aa6d-4d6d-89d1-f1432b3b7480 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:07.233665 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-609e0f01-aa6d-4d6d-89d1-f1432b3b7480 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:07.234633 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-609e0f01-aa6d-4d6d-89d1-f1432b3b7480 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:07.235731 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-609e0f01-aa6d-4d6d-89d1-f1432b3b7480 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:07.237638 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-609e0f01-aa6d-4d6d-89d1-f1432b3b7480 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:07.241697 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-609e0f01-aa6d-4d6d-89d1-f1432b3b7480 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:07.242454 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-609e0f01-aa6d-4d6d-89d1-f1432b3b7480 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:07.896733 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-609e0f01-aa6d-4d6d-89d1-f1432b3b7480 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:07.907062 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-609e0f01-aa6d-4d6d-89d1-f1432b3b7480 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:07.928495 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-609e0f01-aa6d-4d6d-89d1-f1432b3b7480 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:07.935262 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-609e0f01-aa6d-4d6d-89d1-f1432b3b7480 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1874 microversion: 2.42 time: 0.724851 Sep 08 11:01:07.937481 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2384/4849] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:01:07 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1874 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:01:08.209691 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1154e25f-378d-4645-b915-e06bf63d2975 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:08.211019 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1154e25f-378d-4645-b915-e06bf63d2975 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 2cad3ede-cfb3-48bb-b0e1-b999dc5cae07] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:08.228822 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1154e25f-378d-4645-b915-e06bf63d2975 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:08.229869 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1154e25f-378d-4645-b915-e06bf63d2975 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:08.231578 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1154e25f-378d-4645-b915-e06bf63d2975 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:08.233567 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1154e25f-378d-4645-b915-e06bf63d2975 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:08.236370 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1154e25f-378d-4645-b915-e06bf63d2975 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:08.239918 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1154e25f-378d-4645-b915-e06bf63d2975 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:08.513249 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1154e25f-378d-4645-b915-e06bf63d2975 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:08.528489 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1154e25f-378d-4645-b915-e06bf63d2975 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/2cad3ede-cfb3-48bb-b0e1-b999dc5cae07" status: 200 len: 1506 microversion: 2.1 time: 0.323324 Sep 08 11:01:08.535984 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2466/4850] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:01:08 2022] GET /compute/v2.1/servers/2cad3ede-cfb3-48bb-b0e1-b999dc5cae07 => generated 1506 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:01:08.970670 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5ad0d1ef-fe92-4f85-96d0-03785ede6d27 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:08.972277 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5ad0d1ef-fe92-4f85-96d0-03785ede6d27 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:09.008203 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ad0d1ef-fe92-4f85-96d0-03785ede6d27 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:09.009163 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ad0d1ef-fe92-4f85-96d0-03785ede6d27 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:09.014367 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ad0d1ef-fe92-4f85-96d0-03785ede6d27 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:09.015091 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ad0d1ef-fe92-4f85-96d0-03785ede6d27 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:09.017511 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ad0d1ef-fe92-4f85-96d0-03785ede6d27 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:09.019057 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ad0d1ef-fe92-4f85-96d0-03785ede6d27 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:09.485654 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-1830faae-83e8-4f72-b498-e56ff90c09c5 req-b7a2a529-ca9e-436c-8811-c3099ea58f1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cad3ede-cfb3-48bb-b0e1-b999dc5cae07", "name": "network-vif-unplugged", "status": "completed", "tag": "06ecac7f-05cd-4f87-9398-fe2c4f48cb33"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:01:09.536822 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-1830faae-83e8-4f72-b498-e56ff90c09c5 req-b7a2a529-ca9e-436c-8811-c3099ea58f1d service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:09.538676 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-1830faae-83e8-4f72-b498-e56ff90c09c5 req-b7a2a529-ca9e-436c-8811-c3099ea58f1d service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:09.545411 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-1830faae-83e8-4f72-b498-e56ff90c09c5 req-b7a2a529-ca9e-436c-8811-c3099ea58f1d service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:09.636344 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-1830faae-83e8-4f72-b498-e56ff90c09c5 req-b7a2a529-ca9e-436c-8811-c3099ea58f1d service nova] Creating event network-vif-unplugged:06ecac7f-05cd-4f87-9398-fe2c4f48cb33 for instance 2cad3ede-cfb3-48bb-b0e1-b999dc5cae07 on n-h1-850501-12 Sep 08 11:01:09.651378 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-1830faae-83e8-4f72-b498-e56ff90c09c5 req-b7a2a529-ca9e-436c-8811-c3099ea58f1d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.169711 Sep 08 11:01:09.652006 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2467/4851] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:01:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:01:09.662402 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ad7f0d4f-3e38-4011-847f-cc298a48ce8a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:09.664091 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ad7f0d4f-3e38-4011-847f-cc298a48ce8a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 2cad3ede-cfb3-48bb-b0e1-b999dc5cae07] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:09.674721 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ad7f0d4f-3e38-4011-847f-cc298a48ce8a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:09.675928 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ad7f0d4f-3e38-4011-847f-cc298a48ce8a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:09.676972 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ad7f0d4f-3e38-4011-847f-cc298a48ce8a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:09.678744 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ad7f0d4f-3e38-4011-847f-cc298a48ce8a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:09.680101 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ad7f0d4f-3e38-4011-847f-cc298a48ce8a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:09.681162 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ad7f0d4f-3e38-4011-847f-cc298a48ce8a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:10.064523 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ad7f0d4f-3e38-4011-847f-cc298a48ce8a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:10.087033 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ad7f0d4f-3e38-4011-847f-cc298a48ce8a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/2cad3ede-cfb3-48bb-b0e1-b999dc5cae07" status: 200 len: 1509 microversion: 2.1 time: 0.424423 Sep 08 11:01:10.087302 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2468/4852] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:01:09 2022] GET /compute/v2.1/servers/2cad3ede-cfb3-48bb-b0e1-b999dc5cae07 => generated 1509 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:01:10.115735 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-474036e7-9ee3-47e3-a278-0bbd4d691de7 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:10.116311 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-474036e7-9ee3-47e3-a278-0bbd4d691de7 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:10.123640 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-474036e7-9ee3-47e3-a278-0bbd4d691de7 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:10.124711 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-474036e7-9ee3-47e3-a278-0bbd4d691de7 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:10.125193 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-474036e7-9ee3-47e3-a278-0bbd4d691de7 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:10.125943 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-474036e7-9ee3-47e3-a278-0bbd4d691de7 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:10.126407 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-474036e7-9ee3-47e3-a278-0bbd4d691de7 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:10.126834 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-474036e7-9ee3-47e3-a278-0bbd4d691de7 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:10.421299 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-474036e7-9ee3-47e3-a278-0bbd4d691de7 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:10.436083 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-474036e7-9ee3-47e3-a278-0bbd4d691de7 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1671 microversion: 2.1 time: 0.324145 Sep 08 11:01:10.438135 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2469/4853] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:01:10 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1671 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:01:10.487115 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ae01df99-7455-4e1b-be5d-2c0b3c5a6a58 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:10.490773 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ae01df99-7455-4e1b-be5d-2c0b3c5a6a58 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:10.499769 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ae01df99-7455-4e1b-be5d-2c0b3c5a6a58 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:10.500580 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ae01df99-7455-4e1b-be5d-2c0b3c5a6a58 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:10.501276 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ae01df99-7455-4e1b-be5d-2c0b3c5a6a58 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:10.506711 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ae01df99-7455-4e1b-be5d-2c0b3c5a6a58 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:10.507622 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ae01df99-7455-4e1b-be5d-2c0b3c5a6a58 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:10.508227 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ae01df99-7455-4e1b-be5d-2c0b3c5a6a58 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:10.960985 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ae01df99-7455-4e1b-be5d-2c0b3c5a6a58 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:10.984219 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ae01df99-7455-4e1b-be5d-2c0b3c5a6a58 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1671 microversion: 2.1 time: 0.519793 Sep 08 11:01:10.987173 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2470/4854] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:01:10 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1671 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:01:11.015047 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-15bf6c13-d43a-4207-879a-738307b86294 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:11.015930 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-15bf6c13-d43a-4207-879a-738307b86294 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:11.029198 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-15bf6c13-d43a-4207-879a-738307b86294 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:11.030485 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-15bf6c13-d43a-4207-879a-738307b86294 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:11.032508 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-15bf6c13-d43a-4207-879a-738307b86294 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:11.034539 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-15bf6c13-d43a-4207-879a-738307b86294 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:11.035715 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-15bf6c13-d43a-4207-879a-738307b86294 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:11.037771 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-15bf6c13-d43a-4207-879a-738307b86294 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:11.305181 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5ad0d1ef-fe92-4f85-96d0-03785ede6d27 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:11.317822 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5ad0d1ef-fe92-4f85-96d0-03785ede6d27 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:11.319542 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5ad0d1ef-fe92-4f85-96d0-03785ede6d27 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:11.322058 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5ad0d1ef-fe92-4f85-96d0-03785ede6d27 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1874 microversion: 2.42 time: 2.361553 Sep 08 11:01:11.323209 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2385/4855] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:01:08 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1874 bytes in 2363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:01:11.450497 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-15bf6c13-d43a-4207-879a-738307b86294 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:11.466815 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-15bf6c13-d43a-4207-879a-738307b86294 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1671 microversion: 2.1 time: 0.456919 Sep 08 11:01:11.483996 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2471/4856] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:01:11 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1671 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:01:11.492484 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-437fb4f8-4886-4a3f-a11f-f0c417fc5069 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:11.493514 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-437fb4f8-4886-4a3f-a11f-f0c417fc5069 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:11.509220 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-437fb4f8-4886-4a3f-a11f-f0c417fc5069 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:11.509726 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-437fb4f8-4886-4a3f-a11f-f0c417fc5069 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:11.510304 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-437fb4f8-4886-4a3f-a11f-f0c417fc5069 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:11.511030 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-437fb4f8-4886-4a3f-a11f-f0c417fc5069 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:11.512082 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-437fb4f8-4886-4a3f-a11f-f0c417fc5069 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:11.512645 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-437fb4f8-4886-4a3f-a11f-f0c417fc5069 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:12.150923 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-437fb4f8-4886-4a3f-a11f-f0c417fc5069 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:12.177778 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-437fb4f8-4886-4a3f-a11f-f0c417fc5069 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1671 microversion: 2.1 time: 0.690203 Sep 08 11:01:12.182531 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2386/4857] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:01:11 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1671 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:01:12.215390 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-853ad685-374b-4c95-b5db-df2380ba6cf2 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:01:12.235138 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-853ad685-374b-4c95-b5db-df2380ba6cf2 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:12.235919 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-853ad685-374b-4c95-b5db-df2380ba6cf2 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:12.237852 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-853ad685-374b-4c95-b5db-df2380ba6cf2 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:12.300040 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-853ad685-374b-4c95-b5db-df2380ba6cf2 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Going to try to stop instance {{(pid=128861) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 08 11:01:12.370775 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-75bbb20a-4498-4a5a-920a-daf036050827 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:12.372280 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-75bbb20a-4498-4a5a-920a-daf036050827 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:12.397649 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-75bbb20a-4498-4a5a-920a-daf036050827 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:12.397984 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-75bbb20a-4498-4a5a-920a-daf036050827 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:12.400147 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-75bbb20a-4498-4a5a-920a-daf036050827 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:12.403785 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-853ad685-374b-4c95-b5db-df2380ba6cf2 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "POST /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7/action" status: 202 len: 0 microversion: 2.1 time: 0.193550 Sep 08 11:01:12.405086 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2472/4858] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 11:01:12 2022] POST /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7/action => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 11:01:12.420090 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-75bbb20a-4498-4a5a-920a-daf036050827 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:12.421070 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-75bbb20a-4498-4a5a-920a-daf036050827 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:12.421740 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-75bbb20a-4498-4a5a-920a-daf036050827 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:12.444914 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7f5f4138-5a35-485a-b685-1a76eb6cd519 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:12.446339 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7f5f4138-5a35-485a-b685-1a76eb6cd519 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:12.466419 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7f5f4138-5a35-485a-b685-1a76eb6cd519 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:12.469172 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7f5f4138-5a35-485a-b685-1a76eb6cd519 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:12.469985 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7f5f4138-5a35-485a-b685-1a76eb6cd519 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:12.473958 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7f5f4138-5a35-485a-b685-1a76eb6cd519 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:12.474583 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7f5f4138-5a35-485a-b685-1a76eb6cd519 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:12.475129 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7f5f4138-5a35-485a-b685-1a76eb6cd519 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:12.845433 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7f5f4138-5a35-485a-b685-1a76eb6cd519 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:12.879765 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7f5f4138-5a35-485a-b685-1a76eb6cd519 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1681 microversion: 2.1 time: 0.460982 Sep 08 11:01:12.881402 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2473/4859] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:01:12 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1681 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:01:13.258613 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-75bbb20a-4498-4a5a-920a-daf036050827 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:13.279951 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-75bbb20a-4498-4a5a-920a-daf036050827 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:13.289234 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-75bbb20a-4498-4a5a-920a-daf036050827 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:13.291277 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-75bbb20a-4498-4a5a-920a-daf036050827 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1874 microversion: 2.42 time: 0.932575 Sep 08 11:01:13.292570 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2387/4860] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:01:12 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1874 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:01:13.909449 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7f1ab24c-8377-44cb-9a4f-afe5878fc568 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:13.910880 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7f1ab24c-8377-44cb-9a4f-afe5878fc568 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:13.921929 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7f1ab24c-8377-44cb-9a4f-afe5878fc568 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:13.922439 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7f1ab24c-8377-44cb-9a4f-afe5878fc568 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:13.922888 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7f1ab24c-8377-44cb-9a4f-afe5878fc568 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:13.923612 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7f1ab24c-8377-44cb-9a4f-afe5878fc568 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:13.924081 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7f1ab24c-8377-44cb-9a4f-afe5878fc568 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:13.929787 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7f1ab24c-8377-44cb-9a4f-afe5878fc568 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:13.950981 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:01:14.328096 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4bba1ae8-a4b4-4b75-a25c-3e3573601669 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:14.328714 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4bba1ae8-a4b4-4b75-a25c-3e3573601669 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:14.346419 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4bba1ae8-a4b4-4b75-a25c-3e3573601669 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:14.346922 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4bba1ae8-a4b4-4b75-a25c-3e3573601669 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:14.347360 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4bba1ae8-a4b4-4b75-a25c-3e3573601669 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:14.348075 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4bba1ae8-a4b4-4b75-a25c-3e3573601669 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:14.348535 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4bba1ae8-a4b4-4b75-a25c-3e3573601669 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:14.348965 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4bba1ae8-a4b4-4b75-a25c-3e3573601669 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:14.588622 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7f1ab24c-8377-44cb-9a4f-afe5878fc568 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:14.603647 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7f1ab24c-8377-44cb-9a4f-afe5878fc568 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1681 microversion: 2.1 time: 0.696745 Sep 08 11:01:14.606853 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2474/4861] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:01:13 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1681 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:01:15.086677 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4bba1ae8-a4b4-4b75-a25c-3e3573601669 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:15.103761 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4bba1ae8-a4b4-4b75-a25c-3e3573601669 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:15.107408 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4bba1ae8-a4b4-4b75-a25c-3e3573601669 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:15.116067 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4bba1ae8-a4b4-4b75-a25c-3e3573601669 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1874 microversion: 2.42 time: 0.792119 Sep 08 11:01:15.117471 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2388/4862] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:01:14 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1874 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:01:15.630901 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bcadd3f7-ec28-4b91-b449-f412a5c81a0d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:15.631522 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bcadd3f7-ec28-4b91-b449-f412a5c81a0d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:15.648794 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bcadd3f7-ec28-4b91-b449-f412a5c81a0d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:15.649823 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bcadd3f7-ec28-4b91-b449-f412a5c81a0d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:15.650520 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bcadd3f7-ec28-4b91-b449-f412a5c81a0d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:15.652948 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bcadd3f7-ec28-4b91-b449-f412a5c81a0d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:15.653804 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bcadd3f7-ec28-4b91-b449-f412a5c81a0d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:15.656707 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bcadd3f7-ec28-4b91-b449-f412a5c81a0d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:16.150570 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d39ed858-834f-4108-a010-a9d449a7f07b tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:16.153089 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d39ed858-834f-4108-a010-a9d449a7f07b tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:16.168235 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d39ed858-834f-4108-a010-a9d449a7f07b tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:16.169639 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d39ed858-834f-4108-a010-a9d449a7f07b tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:16.170545 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d39ed858-834f-4108-a010-a9d449a7f07b tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:16.171504 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d39ed858-834f-4108-a010-a9d449a7f07b tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:16.172176 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d39ed858-834f-4108-a010-a9d449a7f07b tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:16.172808 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d39ed858-834f-4108-a010-a9d449a7f07b tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:16.596190 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d39ed858-834f-4108-a010-a9d449a7f07b tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:16.618446 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d39ed858-834f-4108-a010-a9d449a7f07b tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:16.622839 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d39ed858-834f-4108-a010-a9d449a7f07b tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:16.625950 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d39ed858-834f-4108-a010-a9d449a7f07b tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1874 microversion: 2.42 time: 0.482294 Sep 08 11:01:16.627684 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2389/4863] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:01:16 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1874 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:01:16.983309 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-bcadd3f7-ec28-4b91-b449-f412a5c81a0d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:16.999279 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bcadd3f7-ec28-4b91-b449-f412a5c81a0d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1681 microversion: 2.1 time: 1.373335 Sep 08 11:01:17.001183 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2475/4864] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:01:15 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1681 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:01:17.655192 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-746b09cb-ab06-4192-8796-ec33e85f06cc tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:17.656440 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-746b09cb-ab06-4192-8796-ec33e85f06cc tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:17.676449 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-746b09cb-ab06-4192-8796-ec33e85f06cc tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:17.677950 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-746b09cb-ab06-4192-8796-ec33e85f06cc tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:17.680301 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-746b09cb-ab06-4192-8796-ec33e85f06cc tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:17.683775 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-746b09cb-ab06-4192-8796-ec33e85f06cc tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:17.684551 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-746b09cb-ab06-4192-8796-ec33e85f06cc tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:17.685243 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-746b09cb-ab06-4192-8796-ec33e85f06cc tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:18.029213 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8b401851-88de-42a0-b4ab-da0997a6ebe2 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:18.030453 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8b401851-88de-42a0-b4ab-da0997a6ebe2 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:18.045923 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8b401851-88de-42a0-b4ab-da0997a6ebe2 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:18.046818 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8b401851-88de-42a0-b4ab-da0997a6ebe2 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:18.047438 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8b401851-88de-42a0-b4ab-da0997a6ebe2 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:18.048409 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8b401851-88de-42a0-b4ab-da0997a6ebe2 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:18.050311 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8b401851-88de-42a0-b4ab-da0997a6ebe2 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:18.050927 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8b401851-88de-42a0-b4ab-da0997a6ebe2 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:18.206974 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-746b09cb-ab06-4192-8796-ec33e85f06cc tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:18.229396 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-746b09cb-ab06-4192-8796-ec33e85f06cc tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:18.231227 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-746b09cb-ab06-4192-8796-ec33e85f06cc tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:18.232702 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-746b09cb-ab06-4192-8796-ec33e85f06cc tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1874 microversion: 2.42 time: 0.582716 Sep 08 11:01:18.233804 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2390/4865] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:01:17 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1874 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:01:19.170697 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8b401851-88de-42a0-b4ab-da0997a6ebe2 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:19.182937 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8b401851-88de-42a0-b4ab-da0997a6ebe2 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1681 microversion: 2.1 time: 1.157765 Sep 08 11:01:19.184440 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2476/4866] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:01:18 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1681 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:01:19.266462 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-26ced6bd-f925-4777-9093-fa0f40df1090 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:19.267283 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-26ced6bd-f925-4777-9093-fa0f40df1090 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:19.289762 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-26ced6bd-f925-4777-9093-fa0f40df1090 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:19.292698 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-26ced6bd-f925-4777-9093-fa0f40df1090 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:19.296197 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-26ced6bd-f925-4777-9093-fa0f40df1090 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:19.299375 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-26ced6bd-f925-4777-9093-fa0f40df1090 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:19.299866 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-26ced6bd-f925-4777-9093-fa0f40df1090 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:19.302034 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-26ced6bd-f925-4777-9093-fa0f40df1090 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:20.213872 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1a9a0ca5-b42d-4f8f-8e8d-fec2e5515eb9 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:20.215372 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1a9a0ca5-b42d-4f8f-8e8d-fec2e5515eb9 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:20.226573 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1a9a0ca5-b42d-4f8f-8e8d-fec2e5515eb9 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:20.227081 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1a9a0ca5-b42d-4f8f-8e8d-fec2e5515eb9 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:20.227527 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1a9a0ca5-b42d-4f8f-8e8d-fec2e5515eb9 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:20.228251 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1a9a0ca5-b42d-4f8f-8e8d-fec2e5515eb9 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:20.228715 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1a9a0ca5-b42d-4f8f-8e8d-fec2e5515eb9 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:20.229198 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1a9a0ca5-b42d-4f8f-8e8d-fec2e5515eb9 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:20.787920 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1a9a0ca5-b42d-4f8f-8e8d-fec2e5515eb9 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:20.800721 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1a9a0ca5-b42d-4f8f-8e8d-fec2e5515eb9 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1681 microversion: 2.1 time: 0.590833 Sep 08 11:01:20.804928 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2477/4867] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:01:20 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1681 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:01:20.815169 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-763c5170-eb6e-49ee-9e5f-0a1602771c84 req-600759bb-ab7e-424e-9b15-bd4b89253478 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59", "name": "network-vif-plugged", "status": "completed", "tag": "ecb96651-93e7-41bd-9408-8b3399bfaef2"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:01:20.845438 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-763c5170-eb6e-49ee-9e5f-0a1602771c84 req-600759bb-ab7e-424e-9b15-bd4b89253478 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:20.846200 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-763c5170-eb6e-49ee-9e5f-0a1602771c84 req-600759bb-ab7e-424e-9b15-bd4b89253478 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:20.847078 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-763c5170-eb6e-49ee-9e5f-0a1602771c84 req-600759bb-ab7e-424e-9b15-bd4b89253478 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:20.876440 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-763c5170-eb6e-49ee-9e5f-0a1602771c84 req-600759bb-ab7e-424e-9b15-bd4b89253478 service nova] Creating event network-vif-plugged:ecb96651-93e7-41bd-9408-8b3399bfaef2 for instance 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 on n-h2-850501-12 Sep 08 11:01:20.885519 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-763c5170-eb6e-49ee-9e5f-0a1602771c84 req-600759bb-ab7e-424e-9b15-bd4b89253478 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078645 Sep 08 11:01:20.889345 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2478/4868] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:01:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:01:21.218172 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-26ced6bd-f925-4777-9093-fa0f40df1090 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:21.241087 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-26ced6bd-f925-4777-9093-fa0f40df1090 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:21.250141 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-26ced6bd-f925-4777-9093-fa0f40df1090 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:21.251607 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-26ced6bd-f925-4777-9093-fa0f40df1090 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1874 microversion: 2.42 time: 1.992278 Sep 08 11:01:21.255518 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2391/4869] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:01:19 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1874 bytes in 1996 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:01:21.839988 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8980aca4-17be-4079-a448-01b134b113f8 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:21.840707 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8980aca4-17be-4079-a448-01b134b113f8 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:21.857369 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8980aca4-17be-4079-a448-01b134b113f8 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:21.859641 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8980aca4-17be-4079-a448-01b134b113f8 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:21.860179 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8980aca4-17be-4079-a448-01b134b113f8 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:21.861302 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8980aca4-17be-4079-a448-01b134b113f8 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:21.862042 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8980aca4-17be-4079-a448-01b134b113f8 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:21.862917 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8980aca4-17be-4079-a448-01b134b113f8 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:22.281926 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5b757c60-0fe8-45e9-a381-ef6560e8f443 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:22.282488 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5b757c60-0fe8-45e9-a381-ef6560e8f443 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:22.290045 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b757c60-0fe8-45e9-a381-ef6560e8f443 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:22.290712 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b757c60-0fe8-45e9-a381-ef6560e8f443 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:22.291338 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b757c60-0fe8-45e9-a381-ef6560e8f443 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:22.293633 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b757c60-0fe8-45e9-a381-ef6560e8f443 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:22.294839 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b757c60-0fe8-45e9-a381-ef6560e8f443 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:22.295936 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b757c60-0fe8-45e9-a381-ef6560e8f443 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:22.354367 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8980aca4-17be-4079-a448-01b134b113f8 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:22.363516 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8980aca4-17be-4079-a448-01b134b113f8 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1681 microversion: 2.1 time: 0.527878 Sep 08 11:01:22.373877 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2479/4870] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:01:21 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1681 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:01:22.998278 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5b757c60-0fe8-45e9-a381-ef6560e8f443 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:23.010402 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5b757c60-0fe8-45e9-a381-ef6560e8f443 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:23.013411 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5b757c60-0fe8-45e9-a381-ef6560e8f443 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:23.014975 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5b757c60-0fe8-45e9-a381-ef6560e8f443 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1874 microversion: 2.42 time: 0.739102 Sep 08 11:01:23.016453 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2392/4871] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:01:22 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1874 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:01:23.397730 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-db0d1a97-10f0-4e68-a5dc-0b341b34920e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:23.398364 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-db0d1a97-10f0-4e68-a5dc-0b341b34920e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:23.407148 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-db0d1a97-10f0-4e68-a5dc-0b341b34920e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:23.408010 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-db0d1a97-10f0-4e68-a5dc-0b341b34920e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:23.408645 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-db0d1a97-10f0-4e68-a5dc-0b341b34920e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:23.409626 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-db0d1a97-10f0-4e68-a5dc-0b341b34920e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:23.410261 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-db0d1a97-10f0-4e68-a5dc-0b341b34920e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:23.410855 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-db0d1a97-10f0-4e68-a5dc-0b341b34920e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:24.046140 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c7e19268-6f9e-4a0a-a005-b719df361e14 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:24.047291 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c7e19268-6f9e-4a0a-a005-b719df361e14 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:24.058723 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c7e19268-6f9e-4a0a-a005-b719df361e14 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:24.059916 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c7e19268-6f9e-4a0a-a005-b719df361e14 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:24.060543 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c7e19268-6f9e-4a0a-a005-b719df361e14 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:24.061467 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c7e19268-6f9e-4a0a-a005-b719df361e14 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:24.062452 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c7e19268-6f9e-4a0a-a005-b719df361e14 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:24.063043 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c7e19268-6f9e-4a0a-a005-b719df361e14 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:24.087147 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-db0d1a97-10f0-4e68-a5dc-0b341b34920e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:24.096521 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-db0d1a97-10f0-4e68-a5dc-0b341b34920e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1658 microversion: 2.1 time: 0.702789 Sep 08 11:01:24.100749 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2480/4872] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:01:23 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1658 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:01:24.130076 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-20a62a02-6a0d-4832-8787-5bcc9199d889 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:01:24.138068 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-20a62a02-6a0d-4832-8787-5bcc9199d889 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:24.139054 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-20a62a02-6a0d-4832-8787-5bcc9199d889 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:24.141188 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-20a62a02-6a0d-4832-8787-5bcc9199d889 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:24.217971 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-20a62a02-6a0d-4832-8787-5bcc9199d889 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Going to try to start instance {{(pid=128861) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 08 11:01:24.315793 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-20a62a02-6a0d-4832-8787-5bcc9199d889 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "POST /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7/action" status: 202 len: 0 microversion: 2.1 time: 0.189912 Sep 08 11:01:24.316442 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2481/4873] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 11:01:24 2022] POST /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7/action => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 11:01:24.332414 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-7be85b40-fb13-4a9c-b944-61e25d744c52 req-6dfb3b6c-0809-458e-bbbc-bf411cf8ac25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59", "name": "network-vif-plugged", "status": "completed", "tag": "d3dee7fc-0d23-496a-962c-d681c647d159"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:01:24.401414 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-7be85b40-fb13-4a9c-b944-61e25d744c52 req-6dfb3b6c-0809-458e-bbbc-bf411cf8ac25 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:24.408095 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-7be85b40-fb13-4a9c-b944-61e25d744c52 req-6dfb3b6c-0809-458e-bbbc-bf411cf8ac25 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:24.408861 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-7be85b40-fb13-4a9c-b944-61e25d744c52 req-6dfb3b6c-0809-458e-bbbc-bf411cf8ac25 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:24.454678 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-7be85b40-fb13-4a9c-b944-61e25d744c52 req-6dfb3b6c-0809-458e-bbbc-bf411cf8ac25 service nova] Creating event network-vif-plugged:d3dee7fc-0d23-496a-962c-d681c647d159 for instance 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 on n-h2-850501-12 Sep 08 11:01:24.470075 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-7be85b40-fb13-4a9c-b944-61e25d744c52 req-6dfb3b6c-0809-458e-bbbc-bf411cf8ac25 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146421 Sep 08 11:01:24.471482 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2482/4874] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:01:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:01:24.481005 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b7ed34b1-133d-4fd4-9f6c-527cea811fb4 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:24.482858 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b7ed34b1-133d-4fd4-9f6c-527cea811fb4 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:24.493384 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b7ed34b1-133d-4fd4-9f6c-527cea811fb4 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:24.494389 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b7ed34b1-133d-4fd4-9f6c-527cea811fb4 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:24.495814 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b7ed34b1-133d-4fd4-9f6c-527cea811fb4 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:24.497871 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b7ed34b1-133d-4fd4-9f6c-527cea811fb4 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:24.499148 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b7ed34b1-133d-4fd4-9f6c-527cea811fb4 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:24.500529 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b7ed34b1-133d-4fd4-9f6c-527cea811fb4 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:25.143444 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b7ed34b1-133d-4fd4-9f6c-527cea811fb4 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:25.156177 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b7ed34b1-133d-4fd4-9f6c-527cea811fb4 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1667 microversion: 2.1 time: 0.682993 Sep 08 11:01:25.168561 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2483/4875] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:01:24 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1667 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:01:25.247921 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c7e19268-6f9e-4a0a-a005-b719df361e14 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:25.275459 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c7e19268-6f9e-4a0a-a005-b719df361e14 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:25.286088 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c7e19268-6f9e-4a0a-a005-b719df361e14 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:25.294731 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c7e19268-6f9e-4a0a-a005-b719df361e14 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1874 microversion: 2.42 time: 1.251292 Sep 08 11:01:25.295385 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2393/4876] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:01:24 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1874 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 11:01:25.478177 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d7ab0611-8c58-489e-8742-c8d6bdf004e8 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1282036208", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "35d93e86-1efc-42d5-9aec-407fd905b6aa"}]}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:01:25.603740 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-d7ab0611-8c58-489e-8742-c8d6bdf004e8 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] validate_networks() for [('35d93e86-1efc-42d5-9aec-407fd905b6aa', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:01:26.192717 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-842e3187-d61c-4925-bdd9-a4946ed886d7 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:26.193749 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-842e3187-d61c-4925-bdd9-a4946ed886d7 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:26.215658 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-842e3187-d61c-4925-bdd9-a4946ed886d7 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:26.218853 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-842e3187-d61c-4925-bdd9-a4946ed886d7 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:26.219964 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-842e3187-d61c-4925-bdd9-a4946ed886d7 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:26.224043 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-842e3187-d61c-4925-bdd9-a4946ed886d7 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:26.225383 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-842e3187-d61c-4925-bdd9-a4946ed886d7 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:26.227699 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-842e3187-d61c-4925-bdd9-a4946ed886d7 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:26.622006 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-842e3187-d61c-4925-bdd9-a4946ed886d7 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:26.639857 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-842e3187-d61c-4925-bdd9-a4946ed886d7 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1667 microversion: 2.1 time: 0.452134 Sep 08 11:01:26.653346 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2394/4877] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:01:26 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1667 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:01:26.658598 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-707ce6b2-eb22-4c9b-b99c-175c2ce75b5c tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:26.662990 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-707ce6b2-eb22-4c9b-b99c-175c2ce75b5c tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:26.675071 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-707ce6b2-eb22-4c9b-b99c-175c2ce75b5c tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:26.678156 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-707ce6b2-eb22-4c9b-b99c-175c2ce75b5c tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:26.678914 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-707ce6b2-eb22-4c9b-b99c-175c2ce75b5c tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:26.681228 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-707ce6b2-eb22-4c9b-b99c-175c2ce75b5c tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:26.682684 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-707ce6b2-eb22-4c9b-b99c-175c2ce75b5c tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:26.686406 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-707ce6b2-eb22-4c9b-b99c-175c2ce75b5c tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:27.319497 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-707ce6b2-eb22-4c9b-b99c-175c2ce75b5c tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:27.332268 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-707ce6b2-eb22-4c9b-b99c-175c2ce75b5c tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:27.335941 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-707ce6b2-eb22-4c9b-b99c-175c2ce75b5c tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:27.341152 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-707ce6b2-eb22-4c9b-b99c-175c2ce75b5c tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1874 microversion: 2.42 time: 0.686271 Sep 08 11:01:27.342112 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2395/4878] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:01:26 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1874 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:01:27.365695 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-b6f71581-ec70-4b46-a449-13b227ebead7 req-0013eb58-0a38-419a-9858-a109b3af6e43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59", "name": "network-vif-plugged", "status": "completed", "tag": "5ccca1c6-6f4a-4fcf-9598-50a337d556cc"}, {"server_uuid": "954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59", "name": "network-vif-plugged", "status": "completed", "tag": "0cd4ca73-de26-4dfe-88cc-7092866bcfee"}, {"server_uuid": "954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59", "name": "network-vif-plugged", "status": "completed", "tag": "9239d9ef-a9de-493e-bc47-0fcce1dee834"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:01:27.389492 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b6f71581-ec70-4b46-a449-13b227ebead7 req-0013eb58-0a38-419a-9858-a109b3af6e43 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:27.394013 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b6f71581-ec70-4b46-a449-13b227ebead7 req-0013eb58-0a38-419a-9858-a109b3af6e43 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:27.395050 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b6f71581-ec70-4b46-a449-13b227ebead7 req-0013eb58-0a38-419a-9858-a109b3af6e43 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:27.431074 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-b6f71581-ec70-4b46-a449-13b227ebead7 req-0013eb58-0a38-419a-9858-a109b3af6e43 service nova] Creating event network-vif-plugged:5ccca1c6-6f4a-4fcf-9598-50a337d556cc for instance 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 on n-h2-850501-12 Sep 08 11:01:27.431591 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-b6f71581-ec70-4b46-a449-13b227ebead7 req-0013eb58-0a38-419a-9858-a109b3af6e43 service nova] Creating event network-vif-plugged:0cd4ca73-de26-4dfe-88cc-7092866bcfee for instance 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 on n-h2-850501-12 Sep 08 11:01:27.432820 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-b6f71581-ec70-4b46-a449-13b227ebead7 req-0013eb58-0a38-419a-9858-a109b3af6e43 service nova] Creating event network-vif-plugged:9239d9ef-a9de-493e-bc47-0fcce1dee834 for instance 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 on n-h2-850501-12 Sep 08 11:01:27.442177 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-b6f71581-ec70-4b46-a449-13b227ebead7 req-0013eb58-0a38-419a-9858-a109b3af6e43 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.083330 Sep 08 11:01:27.444142 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2396/4879] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:01:27 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:01:27.681282 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6567b1d5-1585-46b6-b6a1-1b7598be38a0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:27.684852 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6567b1d5-1585-46b6-b6a1-1b7598be38a0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:27.693245 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6567b1d5-1585-46b6-b6a1-1b7598be38a0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:27.694543 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6567b1d5-1585-46b6-b6a1-1b7598be38a0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:27.696114 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6567b1d5-1585-46b6-b6a1-1b7598be38a0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:27.697225 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6567b1d5-1585-46b6-b6a1-1b7598be38a0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:27.698948 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6567b1d5-1585-46b6-b6a1-1b7598be38a0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:27.700745 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6567b1d5-1585-46b6-b6a1-1b7598be38a0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:28.101670 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6567b1d5-1585-46b6-b6a1-1b7598be38a0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:28.117318 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6567b1d5-1585-46b6-b6a1-1b7598be38a0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1667 microversion: 2.1 time: 0.442880 Sep 08 11:01:28.118706 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2397/4880] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:01:27 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1667 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:01:28.342596 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-d7ab0611-8c58-489e-8742-c8d6bdf004e8 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:01:28.344576 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-d7ab0611-8c58-489e-8742-c8d6bdf004e8 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:01:28.345866 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-d7ab0611-8c58-489e-8742-c8d6bdf004e8 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:01:28.346781 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-d7ab0611-8c58-489e-8742-c8d6bdf004e8 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:01:28.347817 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-d7ab0611-8c58-489e-8742-c8d6bdf004e8 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:01:28.377922 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-88ec640c-fc9e-47ef-a80f-990844b4da29 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:28.379727 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-88ec640c-fc9e-47ef-a80f-990844b4da29 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:28.398423 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d7ab0611-8c58-489e-8742-c8d6bdf004e8 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:28.399982 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d7ab0611-8c58-489e-8742-c8d6bdf004e8 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:28.402370 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-88ec640c-fc9e-47ef-a80f-990844b4da29 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:28.403004 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-88ec640c-fc9e-47ef-a80f-990844b4da29 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:28.403455 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-88ec640c-fc9e-47ef-a80f-990844b4da29 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:28.404296 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-88ec640c-fc9e-47ef-a80f-990844b4da29 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:28.405515 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d7ab0611-8c58-489e-8742-c8d6bdf004e8 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:28.406364 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d7ab0611-8c58-489e-8742-c8d6bdf004e8 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:28.406789 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d7ab0611-8c58-489e-8742-c8d6bdf004e8 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:28.407218 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d7ab0611-8c58-489e-8742-c8d6bdf004e8 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:28.417741 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-88ec640c-fc9e-47ef-a80f-990844b4da29 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:28.421573 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-88ec640c-fc9e-47ef-a80f-990844b4da29 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:28.493551 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-d7ab0611-8c58-489e-8742-c8d6bdf004e8 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Getting quotas for project 018d96ec30b54c46b00921c38e6f935d. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:01:28.524630 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-d7ab0611-8c58-489e-8742-c8d6bdf004e8 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Getting quotas for user dd8b7103d37e4309b7d1f683963eb522 and project 018d96ec30b54c46b00921c38e6f935d. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:01:28.607806 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d7ab0611-8c58-489e-8742-c8d6bdf004e8 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:01:28.615420 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d7ab0611-8c58-489e-8742-c8d6bdf004e8 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] [instance: 204530da-48f3-4d1e-89af-5c09f7be66ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:01:28.766487 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d7ab0611-8c58-489e-8742-c8d6bdf004e8 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.596319 Sep 08 11:01:28.767073 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2484/4881] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 11:01:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 3598 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:01:28.801578 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f8394101-e4a6-4ad9-9ae4-3aebafc23cb6 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:28.809214 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f8394101-e4a6-4ad9-9ae4-3aebafc23cb6 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] [instance: 204530da-48f3-4d1e-89af-5c09f7be66ad] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:29.119839 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-88ec640c-fc9e-47ef-a80f-990844b4da29 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:29.146034 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-88ec640c-fc9e-47ef-a80f-990844b4da29 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:29.151976 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-88ec640c-fc9e-47ef-a80f-990844b4da29 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:29.156457 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-88ec640c-fc9e-47ef-a80f-990844b4da29 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1874 microversion: 2.42 time: 0.787142 Sep 08 11:01:29.159965 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2398/4882] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:01:28 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1874 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 11:01:29.180571 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1141f57a-10d5-4598-a76e-d74fdabb85da tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:29.182580 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1141f57a-10d5-4598-a76e-d74fdabb85da tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:29.196815 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=38 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:01:29.205330 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1141f57a-10d5-4598-a76e-d74fdabb85da tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:29.205879 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1141f57a-10d5-4598-a76e-d74fdabb85da tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:29.206398 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1141f57a-10d5-4598-a76e-d74fdabb85da tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:29.207166 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1141f57a-10d5-4598-a76e-d74fdabb85da tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:29.209764 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1141f57a-10d5-4598-a76e-d74fdabb85da tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:29.210223 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1141f57a-10d5-4598-a76e-d74fdabb85da tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:29.275870 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:01:29.378087 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f8394101-e4a6-4ad9-9ae4-3aebafc23cb6 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8b7103d37e4309b7d1f683963eb522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018d96ec30b54c46b00921c38e6f935d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:29.391752 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f8394101-e4a6-4ad9-9ae4-3aebafc23cb6 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] 10.222.0.27 "GET /compute/v2.1/servers/204530da-48f3-4d1e-89af-5c09f7be66ad" status: 200 len: 1225 microversion: 2.1 time: 0.615977 Sep 08 11:01:29.393789 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2485/4883] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:01:28 2022] GET /compute/v2.1/servers/204530da-48f3-4d1e-89af-5c09f7be66ad => generated 1225 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:01:29.467326 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-1064207b-d588-47ce-96da-2e7909e313db req-94bf6672-7dd9-424d-853f-0e534e4122b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59", "name": "network-vif-plugged", "status": "completed", "tag": "43a5e615-6fc8-4ec6-8b8a-8c3e382e1b29"}, {"server_uuid": "954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59", "name": "network-vif-plugged", "status": "completed", "tag": "76a878f3-633e-4081-8c09-d5e66451d704"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:01:29.499791 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-1064207b-d588-47ce-96da-2e7909e313db req-94bf6672-7dd9-424d-853f-0e534e4122b9 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:29.500297 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-1064207b-d588-47ce-96da-2e7909e313db req-94bf6672-7dd9-424d-853f-0e534e4122b9 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:29.500734 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-1064207b-d588-47ce-96da-2e7909e313db req-94bf6672-7dd9-424d-853f-0e534e4122b9 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:29.552631 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-1064207b-d588-47ce-96da-2e7909e313db req-94bf6672-7dd9-424d-853f-0e534e4122b9 service nova] Creating event network-vif-plugged:43a5e615-6fc8-4ec6-8b8a-8c3e382e1b29 for instance 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 on n-h2-850501-12 Sep 08 11:01:29.556519 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-1064207b-d588-47ce-96da-2e7909e313db req-94bf6672-7dd9-424d-853f-0e534e4122b9 service nova] Creating event network-vif-plugged:76a878f3-633e-4081-8c09-d5e66451d704 for instance 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 on n-h2-850501-12 Sep 08 11:01:29.579640 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-1064207b-d588-47ce-96da-2e7909e313db req-94bf6672-7dd9-424d-853f-0e534e4122b9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.115652 Sep 08 11:01:29.586345 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2486/4884] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:01:29 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:01:30.085657 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1141f57a-10d5-4598-a76e-d74fdabb85da tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:30.098185 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1141f57a-10d5-4598-a76e-d74fdabb85da tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1671 microversion: 2.1 time: 0.935406 Sep 08 11:01:30.098859 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2399/4885] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:01:29 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1671 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:01:30.129424 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b524419e-3f20-4ccf-9afc-8709bc98bcc5 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:30.130283 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b524419e-3f20-4ccf-9afc-8709bc98bcc5 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:30.143831 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b524419e-3f20-4ccf-9afc-8709bc98bcc5 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:30.144654 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b524419e-3f20-4ccf-9afc-8709bc98bcc5 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:30.145389 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b524419e-3f20-4ccf-9afc-8709bc98bcc5 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:30.146310 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b524419e-3f20-4ccf-9afc-8709bc98bcc5 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:30.147067 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b524419e-3f20-4ccf-9afc-8709bc98bcc5 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:30.154947 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b524419e-3f20-4ccf-9afc-8709bc98bcc5 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:30.187531 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e19ee78b-fae9-41c5-8aaa-4462ea1ecc14 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:30.188158 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e19ee78b-fae9-41c5-8aaa-4462ea1ecc14 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:30.207529 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e19ee78b-fae9-41c5-8aaa-4462ea1ecc14 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:30.208439 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e19ee78b-fae9-41c5-8aaa-4462ea1ecc14 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:30.212653 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e19ee78b-fae9-41c5-8aaa-4462ea1ecc14 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:30.226413 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e19ee78b-fae9-41c5-8aaa-4462ea1ecc14 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:30.227939 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e19ee78b-fae9-41c5-8aaa-4462ea1ecc14 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:30.228889 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e19ee78b-fae9-41c5-8aaa-4462ea1ecc14 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:30.917500 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b524419e-3f20-4ccf-9afc-8709bc98bcc5 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:30.980006 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b524419e-3f20-4ccf-9afc-8709bc98bcc5 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1671 microversion: 2.1 time: 0.851855 Sep 08 11:01:30.985309 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2487/4886] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:01:30 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1671 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:01:31.017403 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-dbaabc92-de3c-4c83-bdd9-a9f5ed8ac607 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:31.020791 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-dbaabc92-de3c-4c83-bdd9-a9f5ed8ac607 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] [instance: 204530da-48f3-4d1e-89af-5c09f7be66ad] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:31.043891 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dbaabc92-de3c-4c83-bdd9-a9f5ed8ac607 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:31.044666 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dbaabc92-de3c-4c83-bdd9-a9f5ed8ac607 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:31.045430 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dbaabc92-de3c-4c83-bdd9-a9f5ed8ac607 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:31.046566 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dbaabc92-de3c-4c83-bdd9-a9f5ed8ac607 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:31.047515 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dbaabc92-de3c-4c83-bdd9-a9f5ed8ac607 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:31.048196 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dbaabc92-de3c-4c83-bdd9-a9f5ed8ac607 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:31.317044 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-dbaabc92-de3c-4c83-bdd9-a9f5ed8ac607 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8b7103d37e4309b7d1f683963eb522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018d96ec30b54c46b00921c38e6f935d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:31.330163 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-dbaabc92-de3c-4c83-bdd9-a9f5ed8ac607 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] 10.222.0.27 "GET /compute/v2.1/servers/204530da-48f3-4d1e-89af-5c09f7be66ad" status: 200 len: 1277 microversion: 2.1 time: 0.339793 Sep 08 11:01:31.333765 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2488/4887] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:01:30 2022] GET /compute/v2.1/servers/204530da-48f3-4d1e-89af-5c09f7be66ad => generated 1277 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:01:31.343198 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0653f100-7a85-4778-8019-2fc354f28cf5 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:31.344130 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0653f100-7a85-4778-8019-2fc354f28cf5 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:31.379721 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0653f100-7a85-4778-8019-2fc354f28cf5 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:31.380282 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0653f100-7a85-4778-8019-2fc354f28cf5 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:31.380918 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0653f100-7a85-4778-8019-2fc354f28cf5 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:31.381840 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0653f100-7a85-4778-8019-2fc354f28cf5 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:31.383392 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0653f100-7a85-4778-8019-2fc354f28cf5 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:31.383853 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0653f100-7a85-4778-8019-2fc354f28cf5 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:31.688712 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e19ee78b-fae9-41c5-8aaa-4462ea1ecc14 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:31.703904 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e19ee78b-fae9-41c5-8aaa-4462ea1ecc14 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:31.707477 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e19ee78b-fae9-41c5-8aaa-4462ea1ecc14 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:31.709679 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e19ee78b-fae9-41c5-8aaa-4462ea1ecc14 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1874 microversion: 2.42 time: 1.526892 Sep 08 11:01:31.727247 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2400/4888] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:01:30 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1874 bytes in 1545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 11:01:32.010273 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0653f100-7a85-4778-8019-2fc354f28cf5 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:32.020255 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0653f100-7a85-4778-8019-2fc354f28cf5 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1671 microversion: 2.1 time: 0.685245 Sep 08 11:01:32.020887 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2489/4889] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:01:31 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1671 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:01:32.044319 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-033da985-3da5-4b09-a3d4-5a361a56e5ba tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:32.044784 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-033da985-3da5-4b09-a3d4-5a361a56e5ba tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:32.051376 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-033da985-3da5-4b09-a3d4-5a361a56e5ba tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:32.052155 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-033da985-3da5-4b09-a3d4-5a361a56e5ba tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:32.052753 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-033da985-3da5-4b09-a3d4-5a361a56e5ba tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:32.053673 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-033da985-3da5-4b09-a3d4-5a361a56e5ba tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:32.054316 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-033da985-3da5-4b09-a3d4-5a361a56e5ba tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:32.055118 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-033da985-3da5-4b09-a3d4-5a361a56e5ba tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:32.366514 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d817c165-b46c-451a-8b3f-b37e88f34030 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:32.367130 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d817c165-b46c-451a-8b3f-b37e88f34030 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] [instance: 204530da-48f3-4d1e-89af-5c09f7be66ad] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:32.376455 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d817c165-b46c-451a-8b3f-b37e88f34030 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:32.376973 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d817c165-b46c-451a-8b3f-b37e88f34030 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:32.380792 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d817c165-b46c-451a-8b3f-b37e88f34030 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:32.381564 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d817c165-b46c-451a-8b3f-b37e88f34030 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:32.382045 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d817c165-b46c-451a-8b3f-b37e88f34030 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:32.382472 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d817c165-b46c-451a-8b3f-b37e88f34030 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:32.446221 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-033da985-3da5-4b09-a3d4-5a361a56e5ba tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:32.458642 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-033da985-3da5-4b09-a3d4-5a361a56e5ba tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1671 microversion: 2.1 time: 0.419177 Sep 08 11:01:32.459915 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2401/4890] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:01:32 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1671 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:01:32.481619 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e898b116-c2c8-4287-8098-60f3e6098af9 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:32.482432 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e898b116-c2c8-4287-8098-60f3e6098af9 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:32.493190 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e898b116-c2c8-4287-8098-60f3e6098af9 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:32.493990 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e898b116-c2c8-4287-8098-60f3e6098af9 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:32.494438 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e898b116-c2c8-4287-8098-60f3e6098af9 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:32.495252 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e898b116-c2c8-4287-8098-60f3e6098af9 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:32.495701 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e898b116-c2c8-4287-8098-60f3e6098af9 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:32.499786 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e898b116-c2c8-4287-8098-60f3e6098af9 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:32.580502 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d817c165-b46c-451a-8b3f-b37e88f34030 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8b7103d37e4309b7d1f683963eb522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018d96ec30b54c46b00921c38e6f935d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:32.594227 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d817c165-b46c-451a-8b3f-b37e88f34030 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] 10.222.0.27 "GET /compute/v2.1/servers/204530da-48f3-4d1e-89af-5c09f7be66ad" status: 200 len: 1283 microversion: 2.1 time: 0.231412 Sep 08 11:01:32.595703 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2490/4891] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:01:32 2022] GET /compute/v2.1/servers/204530da-48f3-4d1e-89af-5c09f7be66ad => generated 1283 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:01:32.745977 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9c79e9a6-431f-4079-aa73-d82eb445cc78 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:32.751942 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9c79e9a6-431f-4079-aa73-d82eb445cc78 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:32.768519 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9c79e9a6-431f-4079-aa73-d82eb445cc78 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:32.769044 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9c79e9a6-431f-4079-aa73-d82eb445cc78 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:32.769719 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9c79e9a6-431f-4079-aa73-d82eb445cc78 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:32.772829 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9c79e9a6-431f-4079-aa73-d82eb445cc78 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:32.773333 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9c79e9a6-431f-4079-aa73-d82eb445cc78 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:32.773979 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9c79e9a6-431f-4079-aa73-d82eb445cc78 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:32.979129 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e898b116-c2c8-4287-8098-60f3e6098af9 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:32.999375 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e898b116-c2c8-4287-8098-60f3e6098af9 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1671 microversion: 2.1 time: 0.520075 Sep 08 11:01:33.013067 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2402/4892] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:01:32 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1671 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:01:33.027548 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-49d76642-0aff-4853-8170-495d6e7eab69 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:01:33.028174 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-49d76642-0aff-4853-8170-495d6e7eab69 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:33.037134 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49d76642-0aff-4853-8170-495d6e7eab69 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:33.038006 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49d76642-0aff-4853-8170-495d6e7eab69 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:33.038679 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49d76642-0aff-4853-8170-495d6e7eab69 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:33.040285 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49d76642-0aff-4853-8170-495d6e7eab69 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:33.040814 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49d76642-0aff-4853-8170-495d6e7eab69 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:33.041536 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49d76642-0aff-4853-8170-495d6e7eab69 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:33.097319 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-49d76642-0aff-4853-8170-495d6e7eab69 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lazy-loading 'flavor' on Instance uuid e81e0acc-0b96-4dbc-a5bb-89183f5204e7 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:01:33.239062 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-49d76642-0aff-4853-8170-495d6e7eab69 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "POST /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7/action" status: 202 len: 0 microversion: 2.1 time: 0.217124 Sep 08 11:01:33.241103 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2403/4893] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 11:01:33 2022] POST /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:01:33.267410 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-46a81462-5e39-4444-9e7e-5136a33f90cd tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:33.277118 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-46a81462-5e39-4444-9e7e-5136a33f90cd tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:33.292587 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-46a81462-5e39-4444-9e7e-5136a33f90cd tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:33.293803 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-46a81462-5e39-4444-9e7e-5136a33f90cd tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:33.295610 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-46a81462-5e39-4444-9e7e-5136a33f90cd tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:33.297614 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-46a81462-5e39-4444-9e7e-5136a33f90cd tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:33.298918 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-46a81462-5e39-4444-9e7e-5136a33f90cd tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:33.299054 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-46a81462-5e39-4444-9e7e-5136a33f90cd tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:33.326181 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9c79e9a6-431f-4079-aa73-d82eb445cc78 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:33.367771 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9c79e9a6-431f-4079-aa73-d82eb445cc78 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:33.376042 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9c79e9a6-431f-4079-aa73-d82eb445cc78 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:33.389307 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9c79e9a6-431f-4079-aa73-d82eb445cc78 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1874 microversion: 2.42 time: 0.652680 Sep 08 11:01:33.392601 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2491/4894] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:01:32 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1874 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 11:01:33.625227 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5e71653a-efd5-408d-bdcc-8134e41cb5eb tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:33.626259 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5e71653a-efd5-408d-bdcc-8134e41cb5eb tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] [instance: 204530da-48f3-4d1e-89af-5c09f7be66ad] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:33.633457 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5e71653a-efd5-408d-bdcc-8134e41cb5eb tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:33.634179 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5e71653a-efd5-408d-bdcc-8134e41cb5eb tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:33.634715 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5e71653a-efd5-408d-bdcc-8134e41cb5eb tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:33.636502 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5e71653a-efd5-408d-bdcc-8134e41cb5eb tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:33.637297 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5e71653a-efd5-408d-bdcc-8134e41cb5eb tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:33.637997 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5e71653a-efd5-408d-bdcc-8134e41cb5eb tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:33.749091 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-46a81462-5e39-4444-9e7e-5136a33f90cd tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:33.759135 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-46a81462-5e39-4444-9e7e-5136a33f90cd tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1679 microversion: 2.1 time: 0.500664 Sep 08 11:01:33.760948 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2404/4895] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:01:33 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1679 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:01:33.778235 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5e71653a-efd5-408d-bdcc-8134e41cb5eb tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8b7103d37e4309b7d1f683963eb522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018d96ec30b54c46b00921c38e6f935d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:33.798391 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5e71653a-efd5-408d-bdcc-8134e41cb5eb tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] 10.222.0.27 "GET /compute/v2.1/servers/204530da-48f3-4d1e-89af-5c09f7be66ad" status: 200 len: 1283 microversion: 2.1 time: 0.176707 Sep 08 11:01:33.800911 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2492/4896] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:01:33 2022] GET /compute/v2.1/servers/204530da-48f3-4d1e-89af-5c09f7be66ad => generated 1283 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:01:34.426552 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-659d183c-f986-4949-b3a6-2ede4111aae3 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:34.427170 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-659d183c-f986-4949-b3a6-2ede4111aae3 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:34.458322 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-659d183c-f986-4949-b3a6-2ede4111aae3 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:34.459073 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-659d183c-f986-4949-b3a6-2ede4111aae3 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:34.460202 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-659d183c-f986-4949-b3a6-2ede4111aae3 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:34.464453 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-659d183c-f986-4949-b3a6-2ede4111aae3 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:34.466462 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-659d183c-f986-4949-b3a6-2ede4111aae3 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:34.468696 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-659d183c-f986-4949-b3a6-2ede4111aae3 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:34.784102 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-93373279-e978-4032-90ba-1872748276e0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:34.785841 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-93373279-e978-4032-90ba-1872748276e0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:34.797786 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-93373279-e978-4032-90ba-1872748276e0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:34.798517 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-93373279-e978-4032-90ba-1872748276e0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:34.799156 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-93373279-e978-4032-90ba-1872748276e0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:34.800131 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-93373279-e978-4032-90ba-1872748276e0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:34.800839 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-93373279-e978-4032-90ba-1872748276e0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:34.802291 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-93373279-e978-4032-90ba-1872748276e0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:34.834404 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:01:35.034006 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-659d183c-f986-4949-b3a6-2ede4111aae3 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:35.044688 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-659d183c-f986-4949-b3a6-2ede4111aae3 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:35.046594 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-659d183c-f986-4949-b3a6-2ede4111aae3 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:35.048160 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-659d183c-f986-4949-b3a6-2ede4111aae3 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 2832 microversion: 2.42 time: 0.625863 Sep 08 11:01:35.060471 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2405/4897] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:01:34 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 2832 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:01:35.079804 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2b877607-5e44-4abc-88db-d0d3407fa4d6 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:35.080891 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2b877607-5e44-4abc-88db-d0d3407fa4d6 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] [instance: 204530da-48f3-4d1e-89af-5c09f7be66ad] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:35.088192 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b877607-5e44-4abc-88db-d0d3407fa4d6 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:35.089281 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b877607-5e44-4abc-88db-d0d3407fa4d6 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:35.090603 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b877607-5e44-4abc-88db-d0d3407fa4d6 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:35.091729 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b877607-5e44-4abc-88db-d0d3407fa4d6 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:35.092563 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b877607-5e44-4abc-88db-d0d3407fa4d6 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:35.093421 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b877607-5e44-4abc-88db-d0d3407fa4d6 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:35.637924 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-93373279-e978-4032-90ba-1872748276e0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:35.655765 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-93373279-e978-4032-90ba-1872748276e0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1662 microversion: 2.1 time: 0.871478 Sep 08 11:01:35.658643 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2493/4898] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:01:34 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1662 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:01:35.673897 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4004dda6-cc4e-4683-9874-d374dcea1a77 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:35.674769 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4004dda6-cc4e-4683-9874-d374dcea1a77 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:35.676958 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:01:35.699445 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4004dda6-cc4e-4683-9874-d374dcea1a77 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:35.702506 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4004dda6-cc4e-4683-9874-d374dcea1a77 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:35.703326 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4004dda6-cc4e-4683-9874-d374dcea1a77 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:35.704151 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4004dda6-cc4e-4683-9874-d374dcea1a77 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:35.705298 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4004dda6-cc4e-4683-9874-d374dcea1a77 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:35.706737 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4004dda6-cc4e-4683-9874-d374dcea1a77 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:35.901484 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2b877607-5e44-4abc-88db-d0d3407fa4d6 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8b7103d37e4309b7d1f683963eb522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018d96ec30b54c46b00921c38e6f935d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:35.911867 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2b877607-5e44-4abc-88db-d0d3407fa4d6 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] 10.222.0.27 "GET /compute/v2.1/servers/204530da-48f3-4d1e-89af-5c09f7be66ad" status: 200 len: 1325 microversion: 2.1 time: 0.844734 Sep 08 11:01:35.914405 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2406/4899] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:01:35 2022] GET /compute/v2.1/servers/204530da-48f3-4d1e-89af-5c09f7be66ad => generated 1325 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:01:35.924105 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-49ca9f75-a3dc-4057-9439-082b0926a8aa tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:01:35.930688 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-49ca9f75-a3dc-4057-9439-082b0926a8aa tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:35.943427 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49ca9f75-a3dc-4057-9439-082b0926a8aa tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:35.945066 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49ca9f75-a3dc-4057-9439-082b0926a8aa tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:35.946056 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49ca9f75-a3dc-4057-9439-082b0926a8aa tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:35.946952 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49ca9f75-a3dc-4057-9439-082b0926a8aa tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:35.948436 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49ca9f75-a3dc-4057-9439-082b0926a8aa tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:35.949011 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49ca9f75-a3dc-4057-9439-082b0926a8aa tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:35.970497 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4004dda6-cc4e-4683-9874-d374dcea1a77 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.310067 Sep 08 11:01:35.971264 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2494/4900] 10.222.0.27 () {60 vars in 1316 bytes} [Thu Sep 8 11:01:35 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59/os-interface => generated 1830 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:01:36.048248 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-49ca9f75-a3dc-4057-9439-082b0926a8aa tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "POST /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7/action" status: 202 len: 0 microversion: 2.1 time: 0.132218 Sep 08 11:01:36.053055 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2407/4901] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 11:01:35 2022] POST /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:01:36.059125 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7789623c-6a1f-4c4e-b5b5-8d3fe9a0aec9 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:36.059829 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7789623c-6a1f-4c4e-b5b5-8d3fe9a0aec9 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:36.066130 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7789623c-6a1f-4c4e-b5b5-8d3fe9a0aec9 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:36.066764 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7789623c-6a1f-4c4e-b5b5-8d3fe9a0aec9 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:36.067419 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7789623c-6a1f-4c4e-b5b5-8d3fe9a0aec9 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:36.069221 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7789623c-6a1f-4c4e-b5b5-8d3fe9a0aec9 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:36.070227 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7789623c-6a1f-4c4e-b5b5-8d3fe9a0aec9 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:36.071217 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7789623c-6a1f-4c4e-b5b5-8d3fe9a0aec9 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:36.678801 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7789623c-6a1f-4c4e-b5b5-8d3fe9a0aec9 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:36.696752 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7789623c-6a1f-4c4e-b5b5-8d3fe9a0aec9 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1668 microversion: 2.1 time: 0.642746 Sep 08 11:01:36.699626 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2495/4902] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:01:36 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1668 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:01:36.940987 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fabf6432-af1d-4774-8893-0aeba4b76348 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:36.941736 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fabf6432-af1d-4774-8893-0aeba4b76348 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] [instance: 204530da-48f3-4d1e-89af-5c09f7be66ad] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:36.960801 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fabf6432-af1d-4774-8893-0aeba4b76348 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:36.961336 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fabf6432-af1d-4774-8893-0aeba4b76348 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:36.961774 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fabf6432-af1d-4774-8893-0aeba4b76348 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:36.962488 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fabf6432-af1d-4774-8893-0aeba4b76348 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:36.962938 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fabf6432-af1d-4774-8893-0aeba4b76348 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:36.964104 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fabf6432-af1d-4774-8893-0aeba4b76348 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:37.552535 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fabf6432-af1d-4774-8893-0aeba4b76348 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8b7103d37e4309b7d1f683963eb522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018d96ec30b54c46b00921c38e6f935d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:37.561150 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fabf6432-af1d-4774-8893-0aeba4b76348 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] 10.222.0.27 "GET /compute/v2.1/servers/204530da-48f3-4d1e-89af-5c09f7be66ad" status: 200 len: 1325 microversion: 2.1 time: 0.625783 Sep 08 11:01:37.577504 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2408/4903] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:01:36 2022] GET /compute/v2.1/servers/204530da-48f3-4d1e-89af-5c09f7be66ad => generated 1325 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:01:37.724908 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7870d659-5750-4209-9d58-688a11c7f9c2 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:37.726465 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7870d659-5750-4209-9d58-688a11c7f9c2 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:37.735202 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-b7715a1b-1998-4102-bf0f-efe11e93d1d3 req-97d28bf0-9a08-43a8-a2e4-3441a9844d86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "204530da-48f3-4d1e-89af-5c09f7be66ad", "tag": "fd6783dd-259f-493c-8ae8-1a23eee60db8"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:01:37.764951 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7870d659-5750-4209-9d58-688a11c7f9c2 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:37.770000 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7870d659-5750-4209-9d58-688a11c7f9c2 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:37.772203 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7870d659-5750-4209-9d58-688a11c7f9c2 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:37.776199 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7870d659-5750-4209-9d58-688a11c7f9c2 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:37.778861 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b7715a1b-1998-4102-bf0f-efe11e93d1d3 req-97d28bf0-9a08-43a8-a2e4-3441a9844d86 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:37.779463 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7870d659-5750-4209-9d58-688a11c7f9c2 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:37.780132 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7870d659-5750-4209-9d58-688a11c7f9c2 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:37.782074 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b7715a1b-1998-4102-bf0f-efe11e93d1d3 req-97d28bf0-9a08-43a8-a2e4-3441a9844d86 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:37.782690 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b7715a1b-1998-4102-bf0f-efe11e93d1d3 req-97d28bf0-9a08-43a8-a2e4-3441a9844d86 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:37.826841 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-b7715a1b-1998-4102-bf0f-efe11e93d1d3 req-97d28bf0-9a08-43a8-a2e4-3441a9844d86 service nova] Creating event network-changed:fd6783dd-259f-493c-8ae8-1a23eee60db8 for instance 204530da-48f3-4d1e-89af-5c09f7be66ad on n-h1-850501-12 Sep 08 11:01:37.832865 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-b7715a1b-1998-4102-bf0f-efe11e93d1d3 req-97d28bf0-9a08-43a8-a2e4-3441a9844d86 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104705 Sep 08 11:01:37.835154 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2409/4904] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:01:38.268091 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7870d659-5750-4209-9d58-688a11c7f9c2 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:38.286158 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7870d659-5750-4209-9d58-688a11c7f9c2 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1668 microversion: 2.1 time: 0.566795 Sep 08 11:01:38.302290 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2496/4905] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:01:37 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1668 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:01:38.585262 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c675d37c-873e-483c-bbd1-6a85d3ba5f4d tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:38.585973 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c675d37c-873e-483c-bbd1-6a85d3ba5f4d tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] [instance: 204530da-48f3-4d1e-89af-5c09f7be66ad] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:38.596614 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c675d37c-873e-483c-bbd1-6a85d3ba5f4d tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:38.597165 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c675d37c-873e-483c-bbd1-6a85d3ba5f4d tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:38.600500 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c675d37c-873e-483c-bbd1-6a85d3ba5f4d tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:38.604226 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c675d37c-873e-483c-bbd1-6a85d3ba5f4d tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:38.604902 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c675d37c-873e-483c-bbd1-6a85d3ba5f4d tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:38.605517 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c675d37c-873e-483c-bbd1-6a85d3ba5f4d tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:39.310304 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ba5b60b7-5486-4076-800f-91935b939798 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:39.310927 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ba5b60b7-5486-4076-800f-91935b939798 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:39.312867 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:01:39.329168 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ba5b60b7-5486-4076-800f-91935b939798 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:39.329676 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ba5b60b7-5486-4076-800f-91935b939798 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:39.330114 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ba5b60b7-5486-4076-800f-91935b939798 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:39.330823 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ba5b60b7-5486-4076-800f-91935b939798 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:39.337836 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ba5b60b7-5486-4076-800f-91935b939798 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:39.340436 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ba5b60b7-5486-4076-800f-91935b939798 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:39.385317 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=8 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:01:39.574410 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c675d37c-873e-483c-bbd1-6a85d3ba5f4d tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8b7103d37e4309b7d1f683963eb522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018d96ec30b54c46b00921c38e6f935d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:39.592709 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c675d37c-873e-483c-bbd1-6a85d3ba5f4d tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] 10.222.0.27 "GET /compute/v2.1/servers/204530da-48f3-4d1e-89af-5c09f7be66ad" status: 200 len: 1325 microversion: 2.1 time: 1.012507 Sep 08 11:01:39.593649 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2410/4906] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:01:38 2022] GET /compute/v2.1/servers/204530da-48f3-4d1e-89af-5c09f7be66ad => generated 1325 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:01:39.908761 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-213b386e-9fb9-4aa2-9282-c6406da9b5ed req-ddfd0582-8ab7-44e9-bd41-864b295badcf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59", "tag": "76a878f3-633e-4081-8c09-d5e66451d704"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:01:39.923199 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-213b386e-9fb9-4aa2-9282-c6406da9b5ed req-ddfd0582-8ab7-44e9-bd41-864b295badcf service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:39.925692 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-213b386e-9fb9-4aa2-9282-c6406da9b5ed req-ddfd0582-8ab7-44e9-bd41-864b295badcf service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:39.929059 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-213b386e-9fb9-4aa2-9282-c6406da9b5ed req-ddfd0582-8ab7-44e9-bd41-864b295badcf service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:39.953303 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-213b386e-9fb9-4aa2-9282-c6406da9b5ed req-ddfd0582-8ab7-44e9-bd41-864b295badcf service nova] Creating event network-changed:76a878f3-633e-4081-8c09-d5e66451d704 for instance 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 on n-h2-850501-12 Sep 08 11:01:39.974477 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-213b386e-9fb9-4aa2-9282-c6406da9b5ed req-ddfd0582-8ab7-44e9-bd41-864b295badcf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069615 Sep 08 11:01:39.983878 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2411/4907] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:01:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:01:40.004338 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ba5b60b7-5486-4076-800f-91935b939798 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:40.022233 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ba5b60b7-5486-4076-800f-91935b939798 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1668 microversion: 2.1 time: 0.713873 Sep 08 11:01:40.048571 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2497/4908] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:01:39 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1668 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:01:40.622948 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a02d4206-3d0a-4d90-b614-bcc33b294acb tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:40.626170 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a02d4206-3d0a-4d90-b614-bcc33b294acb tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] [instance: 204530da-48f3-4d1e-89af-5c09f7be66ad] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:40.657853 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a02d4206-3d0a-4d90-b614-bcc33b294acb tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:40.664583 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a02d4206-3d0a-4d90-b614-bcc33b294acb tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:40.669515 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a02d4206-3d0a-4d90-b614-bcc33b294acb tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:40.670972 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a02d4206-3d0a-4d90-b614-bcc33b294acb tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:40.674817 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a02d4206-3d0a-4d90-b614-bcc33b294acb tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:40.675564 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a02d4206-3d0a-4d90-b614-bcc33b294acb tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:41.051880 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-94b94fc4-3e24-4a20-8b8a-b20baed15680 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:41.052574 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-94b94fc4-3e24-4a20-8b8a-b20baed15680 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:41.061944 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-94b94fc4-3e24-4a20-8b8a-b20baed15680 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:41.062443 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-94b94fc4-3e24-4a20-8b8a-b20baed15680 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:41.067093 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-94b94fc4-3e24-4a20-8b8a-b20baed15680 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:41.067869 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-94b94fc4-3e24-4a20-8b8a-b20baed15680 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:41.068367 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-94b94fc4-3e24-4a20-8b8a-b20baed15680 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:41.068781 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-94b94fc4-3e24-4a20-8b8a-b20baed15680 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:41.818479 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a02d4206-3d0a-4d90-b614-bcc33b294acb tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8b7103d37e4309b7d1f683963eb522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018d96ec30b54c46b00921c38e6f935d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:41.831438 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a02d4206-3d0a-4d90-b614-bcc33b294acb tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] 10.222.0.27 "GET /compute/v2.1/servers/204530da-48f3-4d1e-89af-5c09f7be66ad" status: 200 len: 1325 microversion: 2.1 time: 1.217423 Sep 08 11:01:41.839660 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2412/4909] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:01:40 2022] GET /compute/v2.1/servers/204530da-48f3-4d1e-89af-5c09f7be66ad => generated 1325 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:01:41.943289 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-94b94fc4-3e24-4a20-8b8a-b20baed15680 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:41.958300 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-94b94fc4-3e24-4a20-8b8a-b20baed15680 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1671 microversion: 2.1 time: 0.910791 Sep 08 11:01:41.958903 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2498/4910] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:01:41 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1671 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:01:41.990874 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-14ca6b9f-ba4d-49dd-813e-8e240649e207 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:41.991503 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-14ca6b9f-ba4d-49dd-813e-8e240649e207 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:42.007700 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-14ca6b9f-ba4d-49dd-813e-8e240649e207 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:42.009137 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-14ca6b9f-ba4d-49dd-813e-8e240649e207 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:42.011129 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-14ca6b9f-ba4d-49dd-813e-8e240649e207 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:42.014461 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-14ca6b9f-ba4d-49dd-813e-8e240649e207 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:42.016633 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-14ca6b9f-ba4d-49dd-813e-8e240649e207 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:42.019802 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-14ca6b9f-ba4d-49dd-813e-8e240649e207 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:42.861307 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5cbfb158-c3b9-4fd5-b7e8-d087b3bccf7e tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:42.862012 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5cbfb158-c3b9-4fd5-b7e8-d087b3bccf7e tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] [instance: 204530da-48f3-4d1e-89af-5c09f7be66ad] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:42.878648 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5cbfb158-c3b9-4fd5-b7e8-d087b3bccf7e tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:42.879055 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5cbfb158-c3b9-4fd5-b7e8-d087b3bccf7e tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:42.879866 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5cbfb158-c3b9-4fd5-b7e8-d087b3bccf7e tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:42.881191 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5cbfb158-c3b9-4fd5-b7e8-d087b3bccf7e tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:42.881911 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5cbfb158-c3b9-4fd5-b7e8-d087b3bccf7e tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:42.882655 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5cbfb158-c3b9-4fd5-b7e8-d087b3bccf7e tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:42.921063 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-14ca6b9f-ba4d-49dd-813e-8e240649e207 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:42.946894 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-14ca6b9f-ba4d-49dd-813e-8e240649e207 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1671 microversion: 2.1 time: 0.958602 Sep 08 11:01:42.948888 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2413/4911] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:01:41 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1671 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:01:42.981268 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dbf5ae83-2bdc-46ab-a145-a61d470748d1 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:42.981268 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-dbf5ae83-2bdc-46ab-a145-a61d470748d1 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 2cad3ede-cfb3-48bb-b0e1-b999dc5cae07] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:42.993524 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dbf5ae83-2bdc-46ab-a145-a61d470748d1 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:42.994640 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dbf5ae83-2bdc-46ab-a145-a61d470748d1 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:42.995021 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dbf5ae83-2bdc-46ab-a145-a61d470748d1 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:42.995737 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dbf5ae83-2bdc-46ab-a145-a61d470748d1 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:42.996186 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dbf5ae83-2bdc-46ab-a145-a61d470748d1 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:42.998008 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dbf5ae83-2bdc-46ab-a145-a61d470748d1 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:43.026115 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:01:43.034565 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-dbf5ae83-2bdc-46ab-a145-a61d470748d1 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 2cad3ede-cfb3-48bb-b0e1-b999dc5cae07] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:01:43.044026 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.compute.api [None req-dbf5ae83-2bdc-46ab-a145-a61d470748d1 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 2cad3ede-cfb3-48bb-b0e1-b999dc5cae07] Working on deleting snapshot 8377b848-ca86-4e71-a208-9a7b68b5f684 from shelved instance... Sep 08 11:01:43.585532 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5cbfb158-c3b9-4fd5-b7e8-d087b3bccf7e tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8b7103d37e4309b7d1f683963eb522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018d96ec30b54c46b00921c38e6f935d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:43.595081 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5cbfb158-c3b9-4fd5-b7e8-d087b3bccf7e tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] 10.222.0.27 "GET /compute/v2.1/servers/204530da-48f3-4d1e-89af-5c09f7be66ad" status: 200 len: 1325 microversion: 2.1 time: 0.737005 Sep 08 11:01:43.595720 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2499/4912] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:01:42 2022] GET /compute/v2.1/servers/204530da-48f3-4d1e-89af-5c09f7be66ad => generated 1325 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:01:44.627878 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c45dc4b9-9f55-4698-ad07-0a8c698f1762 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:44.630049 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c45dc4b9-9f55-4698-ad07-0a8c698f1762 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] [instance: 204530da-48f3-4d1e-89af-5c09f7be66ad] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:44.657500 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c45dc4b9-9f55-4698-ad07-0a8c698f1762 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:44.658395 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c45dc4b9-9f55-4698-ad07-0a8c698f1762 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:44.661935 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c45dc4b9-9f55-4698-ad07-0a8c698f1762 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:44.666150 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c45dc4b9-9f55-4698-ad07-0a8c698f1762 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:44.670493 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c45dc4b9-9f55-4698-ad07-0a8c698f1762 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:44.674348 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c45dc4b9-9f55-4698-ad07-0a8c698f1762 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:44.699025 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-dbf5ae83-2bdc-46ab-a145-a61d470748d1 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 2cad3ede-cfb3-48bb-b0e1-b999dc5cae07] Doing local delete in cell 2785b110-f847-4739-9d30-5b571c6d79f4(cell1) {{(pid=128862) _delete /opt/stack/nova/nova/compute/api.py:2546}} Sep 08 11:01:44.703464 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dbf5ae83-2bdc-46ab-a145-a61d470748d1 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:44.708168 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dbf5ae83-2bdc-46ab-a145-a61d470748d1 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:44.709209 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dbf5ae83-2bdc-46ab-a145-a61d470748d1 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:44.709872 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.compute.api [None req-dbf5ae83-2bdc-46ab-a145-a61d470748d1 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 2cad3ede-cfb3-48bb-b0e1-b999dc5cae07] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Sep 08 11:01:44.720998 n-d-850501-12 devstack@n-api.service[128862]: ERROR oslo.messaging._drivers.impl_rabbit [None req-dbf5ae83-2bdc-46ab-a145-a61d470748d1 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [b0c801de-0373-4c4c-89db-ae41eb7b49ab] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 08 11:01:45.038532 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c45dc4b9-9f55-4698-ad07-0a8c698f1762 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8b7103d37e4309b7d1f683963eb522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018d96ec30b54c46b00921c38e6f935d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:45.050328 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c45dc4b9-9f55-4698-ad07-0a8c698f1762 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] 10.222.0.27 "GET /compute/v2.1/servers/204530da-48f3-4d1e-89af-5c09f7be66ad" status: 200 len: 1325 microversion: 2.1 time: 0.429264 Sep 08 11:01:45.060283 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2500/4913] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:01:44 2022] GET /compute/v2.1/servers/204530da-48f3-4d1e-89af-5c09f7be66ad => generated 1325 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:01:45.169866 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-83337ed7-f7c8-40c5-b38b-ec429ca2cf20 req-f479ba0e-a2ad-4027-b566-0e3d16f184c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "204530da-48f3-4d1e-89af-5c09f7be66ad", "name": "network-vif-plugged", "status": "completed", "tag": "fd6783dd-259f-493c-8ae8-1a23eee60db8"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:01:45.181257 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-83337ed7-f7c8-40c5-b38b-ec429ca2cf20 req-f479ba0e-a2ad-4027-b566-0e3d16f184c1 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:45.182148 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-83337ed7-f7c8-40c5-b38b-ec429ca2cf20 req-f479ba0e-a2ad-4027-b566-0e3d16f184c1 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:45.182935 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-83337ed7-f7c8-40c5-b38b-ec429ca2cf20 req-f479ba0e-a2ad-4027-b566-0e3d16f184c1 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:45.196850 n-d-850501-12 devstack@n-api.service[128861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 11:01:45.198024 n-d-850501-12 devstack@n-api.service[128861]: Thu Sep 8 11:01:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.27) !!! Sep 08 11:01:45.205832 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-83337ed7-f7c8-40c5-b38b-ec429ca2cf20 req-f479ba0e-a2ad-4027-b566-0e3d16f184c1 service nova] Creating event network-vif-plugged:fd6783dd-259f-493c-8ae8-1a23eee60db8 for instance 204530da-48f3-4d1e-89af-5c09f7be66ad on n-h1-850501-12 Sep 08 11:01:45.227123 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-83337ed7-f7c8-40c5-b38b-ec429ca2cf20 req-f479ba0e-a2ad-4027-b566-0e3d16f184c1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060917 Sep 08 11:01:45.227950 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2501/4914] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:01:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:01:45.733952 n-d-850501-12 devstack@n-api.service[128862]: INFO oslo.messaging._drivers.impl_rabbit [None req-dbf5ae83-2bdc-46ab-a145-a61d470748d1 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [b0c801de-0373-4c4c-89db-ae41eb7b49ab] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 33358. Sep 08 11:01:45.742472 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-dbf5ae83-2bdc-46ab-a145-a61d470748d1 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 2cad3ede-cfb3-48bb-b0e1-b999dc5cae07] deallocate_for_instance() {{(pid=128862) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Sep 08 11:01:46.080031 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ebb794a7-e785-428a-97a4-bd1bef73edc0 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:46.080739 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ebb794a7-e785-428a-97a4-bd1bef73edc0 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] [instance: 204530da-48f3-4d1e-89af-5c09f7be66ad] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:46.089517 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ebb794a7-e785-428a-97a4-bd1bef73edc0 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:46.090282 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ebb794a7-e785-428a-97a4-bd1bef73edc0 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:46.090901 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ebb794a7-e785-428a-97a4-bd1bef73edc0 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:46.091793 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ebb794a7-e785-428a-97a4-bd1bef73edc0 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:46.092257 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ebb794a7-e785-428a-97a4-bd1bef73edc0 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:46.092689 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ebb794a7-e785-428a-97a4-bd1bef73edc0 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:46.285282 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ebb794a7-e785-428a-97a4-bd1bef73edc0 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8b7103d37e4309b7d1f683963eb522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018d96ec30b54c46b00921c38e6f935d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:46.301501 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ebb794a7-e785-428a-97a4-bd1bef73edc0 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] 10.222.0.27 "GET /compute/v2.1/servers/204530da-48f3-4d1e-89af-5c09f7be66ad" status: 200 len: 1325 microversion: 2.1 time: 0.226372 Sep 08 11:01:46.302119 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2502/4915] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:01:46 2022] GET /compute/v2.1/servers/204530da-48f3-4d1e-89af-5c09f7be66ad => generated 1325 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:01:47.168726 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-dbf5ae83-2bdc-46ab-a145-a61d470748d1 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 2cad3ede-cfb3-48bb-b0e1-b999dc5cae07] Updating instance_info_cache with network_info: [] {{(pid=128862) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 08 11:01:47.197787 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-f92c623f-9e5a-4a73-a3b4-1381cfe419ed req-e973362b-24cd-476e-8065-fb2c819a05fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cad3ede-cfb3-48bb-b0e1-b999dc5cae07", "name": "network-vif-deleted", "tag": "06ecac7f-05cd-4f87-9398-fe2c4f48cb33"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:01:47.246054 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-f92c623f-9e5a-4a73-a3b4-1381cfe419ed req-e973362b-24cd-476e-8065-fb2c819a05fa service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:47.247750 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-f92c623f-9e5a-4a73-a3b4-1381cfe419ed req-e973362b-24cd-476e-8065-fb2c819a05fa service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:47.248649 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-f92c623f-9e5a-4a73-a3b4-1381cfe419ed req-e973362b-24cd-476e-8065-fb2c819a05fa service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:47.307502 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.compute.server_external_events [req-f92c623f-9e5a-4a73-a3b4-1381cfe419ed req-e973362b-24cd-476e-8065-fb2c819a05fa service nova] Unable to find a host for instance 2cad3ede-cfb3-48bb-b0e1-b999dc5cae07. Dropping event network-vif-deleted {{(pid=128861) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 08 11:01:47.308491 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-f92c623f-9e5a-4a73-a3b4-1381cfe419ed req-e973362b-24cd-476e-8065-fb2c819a05fa service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.118927 Sep 08 11:01:47.309635 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2503/4916] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:01:47 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 121 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 08 11:01:47.333113 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cece3d82-4824-4edf-b087-9a64571ad050 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:47.335441 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cece3d82-4824-4edf-b087-9a64571ad050 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] [instance: 204530da-48f3-4d1e-89af-5c09f7be66ad] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:47.347481 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cece3d82-4824-4edf-b087-9a64571ad050 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:47.348614 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cece3d82-4824-4edf-b087-9a64571ad050 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:47.349402 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cece3d82-4824-4edf-b087-9a64571ad050 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:47.350468 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cece3d82-4824-4edf-b087-9a64571ad050 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:47.351205 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cece3d82-4824-4edf-b087-9a64571ad050 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:47.351913 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cece3d82-4824-4edf-b087-9a64571ad050 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:47.578695 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-cece3d82-4824-4edf-b087-9a64571ad050 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8b7103d37e4309b7d1f683963eb522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018d96ec30b54c46b00921c38e6f935d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:47.594767 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cece3d82-4824-4edf-b087-9a64571ad050 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] 10.222.0.27 "GET /compute/v2.1/servers/204530da-48f3-4d1e-89af-5c09f7be66ad" status: 200 len: 1522 microversion: 2.1 time: 0.271338 Sep 08 11:01:47.595368 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2504/4917] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:01:47 2022] GET /compute/v2.1/servers/204530da-48f3-4d1e-89af-5c09f7be66ad => generated 1522 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:01:47.623033 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-45b62096-f2eb-4dbb-be42-8fab4f1b4b45 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:47.623949 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-45b62096-f2eb-4dbb-be42-8fab4f1b4b45 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] [instance: 204530da-48f3-4d1e-89af-5c09f7be66ad] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:47.631455 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-45b62096-f2eb-4dbb-be42-8fab4f1b4b45 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:47.632161 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-45b62096-f2eb-4dbb-be42-8fab4f1b4b45 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:47.632632 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-45b62096-f2eb-4dbb-be42-8fab4f1b4b45 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:47.633517 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-45b62096-f2eb-4dbb-be42-8fab4f1b4b45 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:47.634681 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-45b62096-f2eb-4dbb-be42-8fab4f1b4b45 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:47.635653 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-45b62096-f2eb-4dbb-be42-8fab4f1b4b45 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:47.681884 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-45b62096-f2eb-4dbb-be42-8fab4f1b4b45 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] HTTP exception thrown: Action 999 not found Sep 08 11:01:47.692643 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-45b62096-f2eb-4dbb-be42-8fab4f1b4b45 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Request method failure captured: Sep 08 11:01:47.692643 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/204530da-48f3-4d1e-89af-5c09f7be66ad/os-instance-actions/999 HTTP/1.1 Sep 08 11:01:47.692643 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:01:47.692643 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:01:47.692643 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:01:47.692643 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 11:01:47.692643 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:01:47.692643 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:01:47.692643 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:01:47.692643 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:01:47.692643 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcuEbCWSqAEO5PN19xbJJd-8IEBhCRA44Bz_7Zxt9WXnAJefC1nmqnDkhx3wdEJqDGXfOX1fms8l-CmlexWfbhI_uMXhMo26BqUx4z00AjwdiVK58tei6I93SihtcHOm0SbIk_oynP5gvvH9X-cWdE0L07YgKMnElMNtX6yAto_UIqE Sep 08 11:01:47.692643 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:01:47.692643 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:01:47.692643 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:01:47.692643 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:01:47.692643 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:01:47.692643 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:01:47.692643 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 018d96ec30b54c46b00921c38e6f935d Sep 08 11:01:47.692643 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-743246211 Sep 08 11:01:47.692643 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:01:47.692643 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:01:47.692643 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/018d96ec30b54c46b00921c38e6f935d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/018d96ec30b54c46b00921c38e6f935d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_018d96ec30b54c46b00921c38e6f935d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/018d96ec30b54c46b00921c38e6f935d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:01:47.692643 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-743246211 Sep 08 11:01:47.692643 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 018d96ec30b54c46b00921c38e6f935d Sep 08 11:01:47.692643 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-743246211 Sep 08 11:01:47.692643 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-InstanceActionsNegativeTestJSON-743246211-project Sep 08 11:01:47.692643 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:01:47.692643 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:01:47.692643 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: dd8b7103d37e4309b7d1f683963eb522 Sep 08 11:01:47.692643 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-743246211-project Sep 08 11:01:47.692643 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 11:01:47.692643 n-d-850501-12 devstack@n-api.service[128861]: exception: Action 999 not found Sep 08 11:01:47.692643 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'server_id': '204530da-48f3-4d1e-89af-5c09f7be66ad', 'id': '999'} Sep 08 11:01:47.692643 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:01:47.692643 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:01:47.692643 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:01:47.692643 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:01:47.692643 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:01:47.692643 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:01:47.692643 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:01:47.692643 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:01:47.692643 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Sep 08 11:01:47.692643 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 08 11:01:47.692643 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Sep 08 11:01:47.692643 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:01:47.692643 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:01:47.692643 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:01:47.692643 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:01:47.692643 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:01:47.692643 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:01:47.692643 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:01:47.692643 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:01:47.692643 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Sep 08 11:01:47.692643 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:01:47.697012 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-45b62096-f2eb-4dbb-be42-8fab4f1b4b45 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Returning 404 to user: Action 999 not found {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:01:47.697012 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-45b62096-f2eb-4dbb-be42-8fab4f1b4b45 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] 10.222.0.27 "GET /compute/v2.1/servers/204530da-48f3-4d1e-89af-5c09f7be66ad/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.076225 Sep 08 11:01:47.697012 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2505/4918] 10.222.0.27 () {58 vars in 1308 bytes} [Thu Sep 8 11:01:47 2022] GET /compute/v2.1/servers/204530da-48f3-4d1e-89af-5c09f7be66ad/os-instance-actions/999 => generated 66 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 08 11:01:47.707477 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6d49c00b-213a-4b0f-a523-fb01b39dc7bb tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Calling method '.version_select at 0x7f68e4959040>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:47.708044 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6d49c00b-213a-4b0f-a523-fb01b39dc7bb tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] [instance: dcb59bcb-980e-4ce8-821d-248f4b1d1431] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:47.715041 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-6d49c00b-213a-4b0f-a523-fb01b39dc7bb tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] HTTP exception thrown: Instance dcb59bcb-980e-4ce8-821d-248f4b1d1431 could not be found. Sep 08 11:01:47.716888 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6d49c00b-213a-4b0f-a523-fb01b39dc7bb tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Request method failure captured: Sep 08 11:01:47.716888 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/dcb59bcb-980e-4ce8-821d-248f4b1d1431/os-instance-actions HTTP/1.1 Sep 08 11:01:47.716888 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:01:47.716888 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:01:47.716888 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:01:47.716888 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 11:01:47.716888 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:01:47.716888 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:01:47.716888 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:01:47.716888 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:01:47.716888 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcuEbCWSqAEO5PN19xbJJd-8IEBhCRA44Bz_7Zxt9WXnAJefC1nmqnDkhx3wdEJqDGXfOX1fms8l-CmlexWfbhI_uMXhMo26BqUx4z00AjwdiVK58tei6I93SihtcHOm0SbIk_oynP5gvvH9X-cWdE0L07YgKMnElMNtX6yAto_UIqE Sep 08 11:01:47.716888 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:01:47.716888 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:01:47.716888 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:01:47.716888 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:01:47.716888 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:01:47.716888 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:01:47.716888 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 018d96ec30b54c46b00921c38e6f935d Sep 08 11:01:47.716888 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-743246211 Sep 08 11:01:47.716888 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:01:47.716888 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:01:47.716888 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/018d96ec30b54c46b00921c38e6f935d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/018d96ec30b54c46b00921c38e6f935d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_018d96ec30b54c46b00921c38e6f935d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/018d96ec30b54c46b00921c38e6f935d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:01:47.716888 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-743246211 Sep 08 11:01:47.716888 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 018d96ec30b54c46b00921c38e6f935d Sep 08 11:01:47.716888 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-743246211 Sep 08 11:01:47.716888 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-InstanceActionsNegativeTestJSON-743246211-project Sep 08 11:01:47.716888 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:01:47.716888 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:01:47.716888 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: dd8b7103d37e4309b7d1f683963eb522 Sep 08 11:01:47.716888 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-743246211-project Sep 08 11:01:47.716888 n-d-850501-12 devstack@n-api.service[128861]: method: Sep 08 11:01:47.716888 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance dcb59bcb-980e-4ce8-821d-248f4b1d1431 could not be found. Sep 08 11:01:47.716888 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'server_id': 'dcb59bcb-980e-4ce8-821d-248f4b1d1431'} Sep 08 11:01:47.716888 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:01:47.716888 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:01:47.716888 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:01:47.716888 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:01:47.716888 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:01:47.716888 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:01:47.716888 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 08 11:01:47.716888 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 08 11:01:47.716888 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcb59bcb-980e-4ce8-821d-248f4b1d1431 could not be found. Sep 08 11:01:47.716888 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:01:47.716888 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:01:47.716888 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:01:47.716888 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:01:47.716888 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:01:47.716888 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:01:47.716888 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:01:47.716888 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:01:47.716888 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 11:01:47.716888 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 11:01:47.716888 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:01:47.716888 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:01:47.716888 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Sep 08 11:01:47.716888 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Sep 08 11:01:47.716888 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 11:01:47.716888 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 11:01:47.716888 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Sep 08 11:01:47.716888 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Sep 08 11:01:47.716888 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:01:47.716888 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:01:47.721077 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcb59bcb-980e-4ce8-821d-248f4b1d1431 could not be found. Sep 08 11:01:47.721077 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:01:47.721077 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:01:47.721077 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:01:47.721077 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:01:47.721077 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:01:47.721077 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:01:47.721077 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:01:47.721077 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:01:47.721077 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcb59bcb-980e-4ce8-821d-248f4b1d1431 could not be found. Sep 08 11:01:47.721077 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:01:47.721077 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6d49c00b-213a-4b0f-a523-fb01b39dc7bb tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Returning 404 to user: Instance dcb59bcb-980e-4ce8-821d-248f4b1d1431 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:01:47.721077 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6d49c00b-213a-4b0f-a523-fb01b39dc7bb tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] 10.222.0.27 "GET /compute/v2.1/servers/dcb59bcb-980e-4ce8-821d-248f4b1d1431/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.015268 Sep 08 11:01:47.721077 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2506/4919] 10.222.0.27 () {58 vars in 1296 bytes} [Thu Sep 8 11:01:47 2022] GET /compute/v2.1/servers/dcb59bcb-980e-4ce8-821d-248f4b1d1431/os-instance-actions => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 11:01:47.728055 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-32360e34-e6cd-47de-8699-c296537f0472 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:47.729121 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-32360e34-e6cd-47de-8699-c296537f0472 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] [instance: 204530da-48f3-4d1e-89af-5c09f7be66ad] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:47.736545 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-32360e34-e6cd-47de-8699-c296537f0472 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:47.737070 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-32360e34-e6cd-47de-8699-c296537f0472 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:47.737604 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-32360e34-e6cd-47de-8699-c296537f0472 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:47.738352 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-32360e34-e6cd-47de-8699-c296537f0472 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:47.741264 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-32360e34-e6cd-47de-8699-c296537f0472 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:47.741264 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-32360e34-e6cd-47de-8699-c296537f0472 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:47.771157 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-32360e34-e6cd-47de-8699-c296537f0472 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] [instance: 204530da-48f3-4d1e-89af-5c09f7be66ad] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:01:47.885063 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-32360e34-e6cd-47de-8699-c296537f0472 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] 10.222.0.27 "DELETE /compute/v2.1/servers/204530da-48f3-4d1e-89af-5c09f7be66ad" status: 204 len: 0 microversion: 2.1 time: 0.158586 Sep 08 11:01:47.890562 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2507/4920] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:01:47 2022] DELETE /compute/v2.1/servers/204530da-48f3-4d1e-89af-5c09f7be66ad => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 11:01:47.904650 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-56982c96-3932-459c-8161-f750c0ef4c9e tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:47.905565 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-56982c96-3932-459c-8161-f750c0ef4c9e tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] [instance: 204530da-48f3-4d1e-89af-5c09f7be66ad] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:47.925228 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-56982c96-3932-459c-8161-f750c0ef4c9e tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:47.926055 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-56982c96-3932-459c-8161-f750c0ef4c9e tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:47.926841 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-56982c96-3932-459c-8161-f750c0ef4c9e tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:47.928282 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-56982c96-3932-459c-8161-f750c0ef4c9e tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:47.929109 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-56982c96-3932-459c-8161-f750c0ef4c9e tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:47.930465 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-56982c96-3932-459c-8161-f750c0ef4c9e tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:48.205650 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-dbf5ae83-2bdc-46ab-a145-a61d470748d1 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2cad3ede-cfb3-48bb-b0e1-b999dc5cae07" status: 204 len: 0 microversion: 2.1 time: 5.233902 Sep 08 11:01:48.208236 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2414/4921] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:01:42 2022] DELETE /compute/v2.1/servers/2cad3ede-cfb3-48bb-b0e1-b999dc5cae07 => generated 0 bytes in 5237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:01:48.209357 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-56982c96-3932-459c-8161-f750c0ef4c9e tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8b7103d37e4309b7d1f683963eb522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018d96ec30b54c46b00921c38e6f935d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:48.216762 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7d9b727b-b5b5-4cd0-8383-740d2163c072 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:48.217434 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7d9b727b-b5b5-4cd0-8383-740d2163c072 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 2cad3ede-cfb3-48bb-b0e1-b999dc5cae07] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:48.227247 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-56982c96-3932-459c-8161-f750c0ef4c9e tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] 10.222.0.27 "GET /compute/v2.1/servers/204530da-48f3-4d1e-89af-5c09f7be66ad" status: 200 len: 1528 microversion: 2.1 time: 0.334732 Sep 08 11:01:48.238691 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2508/4922] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:01:47 2022] GET /compute/v2.1/servers/204530da-48f3-4d1e-89af-5c09f7be66ad => generated 1528 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:01:48.239175 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d9b727b-b5b5-4cd0-8383-740d2163c072 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:48.239175 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d9b727b-b5b5-4cd0-8383-740d2163c072 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:48.239175 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d9b727b-b5b5-4cd0-8383-740d2163c072 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:48.239175 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d9b727b-b5b5-4cd0-8383-740d2163c072 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:48.239175 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d9b727b-b5b5-4cd0-8383-740d2163c072 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:48.239175 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d9b727b-b5b5-4cd0-8383-740d2163c072 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:48.268609 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-7d9b727b-b5b5-4cd0-8383-740d2163c072 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] HTTP exception thrown: Instance 2cad3ede-cfb3-48bb-b0e1-b999dc5cae07 could not be found. Sep 08 11:01:48.271144 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7d9b727b-b5b5-4cd0-8383-740d2163c072 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Request method failure captured: Sep 08 11:01:48.271144 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/2cad3ede-cfb3-48bb-b0e1-b999dc5cae07 HTTP/1.1 Sep 08 11:01:48.271144 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 11:01:48.271144 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 11:01:48.271144 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 11:01:48.271144 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 11:01:48.271144 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 11:01:48.271144 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 11:01:48.271144 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 11:01:48.271144 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 11:01:48.271144 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGclESil0k3YwhrgmBq9RP58BT8ggCfoq71W7WWaQs79ajWV7VkDiBFW1SHjoqsRUYcZFA-S32MHtcVEuvCs9KDt4sUyYXYecQKP0Pc6KvZoCxHDx-TLBLeVMVKgTKTHMZY5fKwLa-YndhdHH_rmxBkRZ4MxFl9oZaWC-z8pqYA8SSe4 Sep 08 11:01:48.271144 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 11:01:48.271144 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 11:01:48.271144 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 11:01:48.271144 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 11:01:48.271144 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 11:01:48.271144 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 11:01:48.271144 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 11b5d4706b2d43aca8290ccf07ee1ece Sep 08 11:01:48.271144 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServerActionsTestJSON-1762930547 Sep 08 11:01:48.271144 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 11:01:48.271144 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 11:01:48.271144 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/11b5d4706b2d43aca8290ccf07ee1ece"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/11b5d4706b2d43aca8290ccf07ee1ece"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_11b5d4706b2d43aca8290ccf07ee1ece"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/11b5d4706b2d43aca8290ccf07ee1ece"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:01:48.271144 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServerActionsTestJSON-1762930547 Sep 08 11:01:48.271144 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 11b5d4706b2d43aca8290ccf07ee1ece Sep 08 11:01:48.271144 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServerActionsTestJSON-1762930547 Sep 08 11:01:48.271144 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServerActionsTestJSON-1762930547-project Sep 08 11:01:48.271144 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 11:01:48.271144 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 11:01:48.271144 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: d68b017335c84d15becbdc7615498103 Sep 08 11:01:48.271144 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServerActionsTestJSON-1762930547-project Sep 08 11:01:48.271144 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 11:01:48.271144 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 2cad3ede-cfb3-48bb-b0e1-b999dc5cae07 could not be found. Sep 08 11:01:48.271144 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '2cad3ede-cfb3-48bb-b0e1-b999dc5cae07'} Sep 08 11:01:48.271144 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:01:48.271144 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:01:48.271144 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:01:48.271144 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:01:48.271144 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:01:48.271144 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:01:48.271144 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:01:48.271144 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:01:48.271144 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:01:48.271144 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:01:48.271144 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cad3ede-cfb3-48bb-b0e1-b999dc5cae07 could not be found. Sep 08 11:01:48.271144 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:01:48.271144 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:01:48.271144 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:01:48.271144 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:01:48.271144 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:01:48.271144 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:01:48.271144 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:01:48.271144 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:01:48.271144 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:01:48.271144 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:01:48.271144 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:01:48.271144 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:01:48.271144 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:01:48.271144 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:01:48.271144 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:01:48.271144 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:01:48.271144 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cad3ede-cfb3-48bb-b0e1-b999dc5cae07 could not be found. Sep 08 11:01:48.271144 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:01:48.271144 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:01:48.271144 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:01:48.279925 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:01:48.279925 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:01:48.279925 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:01:48.279925 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:01:48.279925 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:01:48.279925 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cad3ede-cfb3-48bb-b0e1-b999dc5cae07 could not be found. Sep 08 11:01:48.279925 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:01:48.279925 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7d9b727b-b5b5-4cd0-8383-740d2163c072 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Returning 404 to user: Instance 2cad3ede-cfb3-48bb-b0e1-b999dc5cae07 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:01:48.279925 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7d9b727b-b5b5-4cd0-8383-740d2163c072 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/2cad3ede-cfb3-48bb-b0e1-b999dc5cae07" status: 404 len: 111 microversion: 2.1 time: 0.061292 Sep 08 11:01:48.279925 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2415/4923] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:01:48 2022] GET /compute/v2.1/servers/2cad3ede-cfb3-48bb-b0e1-b999dc5cae07 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:01:48.288303 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ad43eba0-4901-4844-a7ff-c36954b1766e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:48.289067 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ad43eba0-4901-4844-a7ff-c36954b1766e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 280de799-ddfb-4ced-a4b4-758807cb1279] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:48.299362 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ad43eba0-4901-4844-a7ff-c36954b1766e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:48.300141 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ad43eba0-4901-4844-a7ff-c36954b1766e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:48.300722 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ad43eba0-4901-4844-a7ff-c36954b1766e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:48.301775 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ad43eba0-4901-4844-a7ff-c36954b1766e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:48.302242 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ad43eba0-4901-4844-a7ff-c36954b1766e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:48.302718 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ad43eba0-4901-4844-a7ff-c36954b1766e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:48.337274 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ad43eba0-4901-4844-a7ff-c36954b1766e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 280de799-ddfb-4ced-a4b4-758807cb1279] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:01:48.408166 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:01:48.448037 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ad43eba0-4901-4844-a7ff-c36954b1766e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "DELETE /compute/v2.1/servers/280de799-ddfb-4ced-a4b4-758807cb1279" status: 204 len: 0 microversion: 2.1 time: 0.163866 Sep 08 11:01:48.449606 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2509/4924] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:01:48 2022] DELETE /compute/v2.1/servers/280de799-ddfb-4ced-a4b4-758807cb1279 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:01:48.466194 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-987f0f34-d5d3-4d57-88cb-0a72466c3f77 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:48.467418 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-987f0f34-d5d3-4d57-88cb-0a72466c3f77 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 280de799-ddfb-4ced-a4b4-758807cb1279] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:48.480140 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-987f0f34-d5d3-4d57-88cb-0a72466c3f77 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:48.480985 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-987f0f34-d5d3-4d57-88cb-0a72466c3f77 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:48.481749 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-987f0f34-d5d3-4d57-88cb-0a72466c3f77 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:48.483491 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-987f0f34-d5d3-4d57-88cb-0a72466c3f77 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:48.484264 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-987f0f34-d5d3-4d57-88cb-0a72466c3f77 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:48.485019 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-987f0f34-d5d3-4d57-88cb-0a72466c3f77 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:48.645861 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-987f0f34-d5d3-4d57-88cb-0a72466c3f77 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:48.656490 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-987f0f34-d5d3-4d57-88cb-0a72466c3f77 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/280de799-ddfb-4ced-a4b4-758807cb1279" status: 200 len: 1466 microversion: 2.1 time: 0.200263 Sep 08 11:01:48.657478 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2416/4925] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:01:48 2022] GET /compute/v2.1/servers/280de799-ddfb-4ced-a4b4-758807cb1279 => generated 1466 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:01:49.272818 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1e7ec63a-c52c-4a99-842b-027230662bb5 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:49.273898 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1e7ec63a-c52c-4a99-842b-027230662bb5 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] [instance: 204530da-48f3-4d1e-89af-5c09f7be66ad] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:49.285555 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e7ec63a-c52c-4a99-842b-027230662bb5 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:49.286472 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e7ec63a-c52c-4a99-842b-027230662bb5 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:49.287009 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e7ec63a-c52c-4a99-842b-027230662bb5 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:49.288181 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e7ec63a-c52c-4a99-842b-027230662bb5 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:49.289164 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e7ec63a-c52c-4a99-842b-027230662bb5 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:49.289854 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e7ec63a-c52c-4a99-842b-027230662bb5 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:49.695561 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f191182e-146a-4ab8-8682-fc48696bc4b3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:49.696331 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f191182e-146a-4ab8-8682-fc48696bc4b3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 280de799-ddfb-4ced-a4b4-758807cb1279] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:49.703369 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f191182e-146a-4ab8-8682-fc48696bc4b3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:49.704522 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f191182e-146a-4ab8-8682-fc48696bc4b3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:49.705316 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f191182e-146a-4ab8-8682-fc48696bc4b3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:49.706563 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f191182e-146a-4ab8-8682-fc48696bc4b3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:49.707523 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f191182e-146a-4ab8-8682-fc48696bc4b3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:49.708593 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f191182e-146a-4ab8-8682-fc48696bc4b3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:49.827049 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f191182e-146a-4ab8-8682-fc48696bc4b3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:49.839358 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f191182e-146a-4ab8-8682-fc48696bc4b3 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/280de799-ddfb-4ced-a4b4-758807cb1279" status: 200 len: 1466 microversion: 2.1 time: 0.148854 Sep 08 11:01:49.842135 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2417/4926] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:01:49 2022] GET /compute/v2.1/servers/280de799-ddfb-4ced-a4b4-758807cb1279 => generated 1466 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:01:49.983569 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1e7ec63a-c52c-4a99-842b-027230662bb5 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8b7103d37e4309b7d1f683963eb522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018d96ec30b54c46b00921c38e6f935d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:49.993386 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1e7ec63a-c52c-4a99-842b-027230662bb5 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] 10.222.0.27 "GET /compute/v2.1/servers/204530da-48f3-4d1e-89af-5c09f7be66ad" status: 200 len: 1528 microversion: 2.1 time: 0.724482 Sep 08 11:01:49.993386 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2510/4927] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:01:49 2022] GET /compute/v2.1/servers/204530da-48f3-4d1e-89af-5c09f7be66ad => generated 1528 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:01:51.020308 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fa475873-ac69-4663-ba08-e86d1b9c350a tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:51.021336 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fa475873-ac69-4663-ba08-e86d1b9c350a tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] [instance: 204530da-48f3-4d1e-89af-5c09f7be66ad] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:51.038012 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fa475873-ac69-4663-ba08-e86d1b9c350a tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:51.039303 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fa475873-ac69-4663-ba08-e86d1b9c350a tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:51.040098 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fa475873-ac69-4663-ba08-e86d1b9c350a tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:51.042346 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fa475873-ac69-4663-ba08-e86d1b9c350a tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:51.043069 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fa475873-ac69-4663-ba08-e86d1b9c350a tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:51.043800 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fa475873-ac69-4663-ba08-e86d1b9c350a tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:51.395557 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-fa475873-ac69-4663-ba08-e86d1b9c350a tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8b7103d37e4309b7d1f683963eb522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018d96ec30b54c46b00921c38e6f935d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:51.410516 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fa475873-ac69-4663-ba08-e86d1b9c350a tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] 10.222.0.27 "GET /compute/v2.1/servers/204530da-48f3-4d1e-89af-5c09f7be66ad" status: 200 len: 1528 microversion: 2.1 time: 0.398308 Sep 08 11:01:51.411917 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2511/4928] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:01:51 2022] GET /compute/v2.1/servers/204530da-48f3-4d1e-89af-5c09f7be66ad => generated 1528 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:01:51.518770 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9b2e33a6-c4bc-4723-b346-000bc75094ac tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:51.519909 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9b2e33a6-c4bc-4723-b346-000bc75094ac tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 280de799-ddfb-4ced-a4b4-758807cb1279] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:51.529378 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9b2e33a6-c4bc-4723-b346-000bc75094ac tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:51.530242 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9b2e33a6-c4bc-4723-b346-000bc75094ac tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:51.530839 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9b2e33a6-c4bc-4723-b346-000bc75094ac tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:51.531986 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9b2e33a6-c4bc-4723-b346-000bc75094ac tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:51.533193 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9b2e33a6-c4bc-4723-b346-000bc75094ac tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:51.534020 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9b2e33a6-c4bc-4723-b346-000bc75094ac tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:51.796910 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9b2e33a6-c4bc-4723-b346-000bc75094ac tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:51.811800 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9b2e33a6-c4bc-4723-b346-000bc75094ac tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/280de799-ddfb-4ced-a4b4-758807cb1279" status: 200 len: 1466 microversion: 2.1 time: 0.939983 Sep 08 11:01:51.817722 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2418/4929] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:01:50 2022] GET /compute/v2.1/servers/280de799-ddfb-4ced-a4b4-758807cb1279 => generated 1466 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:01:52.109244 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-0a296fd6-ecfa-4910-8632-80ae312d4334 req-c7879547-9cd3-47f6-8b66-447fe0189bdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "204530da-48f3-4d1e-89af-5c09f7be66ad", "name": "network-vif-deleted", "tag": "fd6783dd-259f-493c-8ae8-1a23eee60db8"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:01:52.125984 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-0a296fd6-ecfa-4910-8632-80ae312d4334 req-c7879547-9cd3-47f6-8b66-447fe0189bdb service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:52.127016 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-0a296fd6-ecfa-4910-8632-80ae312d4334 req-c7879547-9cd3-47f6-8b66-447fe0189bdb service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:52.127843 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-0a296fd6-ecfa-4910-8632-80ae312d4334 req-c7879547-9cd3-47f6-8b66-447fe0189bdb service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:52.144592 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-0a296fd6-ecfa-4910-8632-80ae312d4334 req-c7879547-9cd3-47f6-8b66-447fe0189bdb service nova] Creating event network-vif-deleted:fd6783dd-259f-493c-8ae8-1a23eee60db8 for instance 204530da-48f3-4d1e-89af-5c09f7be66ad on n-h1-850501-12 Sep 08 11:01:52.162405 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-0a296fd6-ecfa-4910-8632-80ae312d4334 req-c7879547-9cd3-47f6-8b66-447fe0189bdb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057367 Sep 08 11:01:52.171281 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2512/4930] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:01:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:01:52.434833 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0b3b9544-ea03-491c-91ba-b5efc3ce700b tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:52.435717 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0b3b9544-ea03-491c-91ba-b5efc3ce700b tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] [instance: 204530da-48f3-4d1e-89af-5c09f7be66ad] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:52.444529 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0b3b9544-ea03-491c-91ba-b5efc3ce700b tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:52.445678 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0b3b9544-ea03-491c-91ba-b5efc3ce700b tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:52.446161 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0b3b9544-ea03-491c-91ba-b5efc3ce700b tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:52.447858 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0b3b9544-ea03-491c-91ba-b5efc3ce700b tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:52.461074 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0b3b9544-ea03-491c-91ba-b5efc3ce700b tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:52.462045 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0b3b9544-ea03-491c-91ba-b5efc3ce700b tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:52.848986 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ecb44f55-f67a-42e8-970d-8a9e1d516ad0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:52.850052 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ecb44f55-f67a-42e8-970d-8a9e1d516ad0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 280de799-ddfb-4ced-a4b4-758807cb1279] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:52.871064 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ecb44f55-f67a-42e8-970d-8a9e1d516ad0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:52.873673 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ecb44f55-f67a-42e8-970d-8a9e1d516ad0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:52.875363 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ecb44f55-f67a-42e8-970d-8a9e1d516ad0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:52.877494 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ecb44f55-f67a-42e8-970d-8a9e1d516ad0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:52.879813 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ecb44f55-f67a-42e8-970d-8a9e1d516ad0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:52.880464 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ecb44f55-f67a-42e8-970d-8a9e1d516ad0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:52.972289 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0b3b9544-ea03-491c-91ba-b5efc3ce700b tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:52.973416 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0b3b9544-ea03-491c-91ba-b5efc3ce700b tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:52.974027 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0b3b9544-ea03-491c-91ba-b5efc3ce700b tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:52.974943 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-0b3b9544-ea03-491c-91ba-b5efc3ce700b tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Lazy-loading 'fault' on Instance uuid 204530da-48f3-4d1e-89af-5c09f7be66ad {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:01:53.106361 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ecb44f55-f67a-42e8-970d-8a9e1d516ad0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:53.119550 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ecb44f55-f67a-42e8-970d-8a9e1d516ad0 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/280de799-ddfb-4ced-a4b4-758807cb1279" status: 200 len: 1466 microversion: 2.1 time: 0.276577 Sep 08 11:01:53.134653 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2513/4931] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:01:52 2022] GET /compute/v2.1/servers/280de799-ddfb-4ced-a4b4-758807cb1279 => generated 1466 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:01:53.368013 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0b3b9544-ea03-491c-91ba-b5efc3ce700b tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8b7103d37e4309b7d1f683963eb522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018d96ec30b54c46b00921c38e6f935d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:53.387740 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0b3b9544-ea03-491c-91ba-b5efc3ce700b tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] 10.222.0.27 "GET /compute/v2.1/servers/204530da-48f3-4d1e-89af-5c09f7be66ad" status: 200 len: 1315 microversion: 2.1 time: 0.956991 Sep 08 11:01:53.390198 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2419/4932] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:01:52 2022] GET /compute/v2.1/servers/204530da-48f3-4d1e-89af-5c09f7be66ad => generated 1315 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:01:54.013717 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-34bea3c0-0559-4b84-84e6-3249486735d1 req-ec16db94-6917-4860-8037-86147ac5776a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "280de799-ddfb-4ced-a4b4-758807cb1279", "name": "network-vif-deleted", "tag": "c70fa2a6-ca73-4956-b002-02ae3374520a"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:01:54.042993 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-34bea3c0-0559-4b84-84e6-3249486735d1 req-ec16db94-6917-4860-8037-86147ac5776a service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:54.044030 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-34bea3c0-0559-4b84-84e6-3249486735d1 req-ec16db94-6917-4860-8037-86147ac5776a service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:54.045090 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-34bea3c0-0559-4b84-84e6-3249486735d1 req-ec16db94-6917-4860-8037-86147ac5776a service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:54.098857 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-34bea3c0-0559-4b84-84e6-3249486735d1 req-ec16db94-6917-4860-8037-86147ac5776a service nova] Creating event network-vif-deleted:c70fa2a6-ca73-4956-b002-02ae3374520a for instance 280de799-ddfb-4ced-a4b4-758807cb1279 on n-h1-850501-12 Sep 08 11:01:54.123347 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-34bea3c0-0559-4b84-84e6-3249486735d1 req-ec16db94-6917-4860-8037-86147ac5776a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109941 Sep 08 11:01:54.127442 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2514/4933] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:01:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:01:54.147814 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dbec1fa5-7be7-4d3e-881c-7019708a5b0a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:54.148814 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-dbec1fa5-7be7-4d3e-881c-7019708a5b0a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 280de799-ddfb-4ced-a4b4-758807cb1279] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:54.175763 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dbec1fa5-7be7-4d3e-881c-7019708a5b0a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:54.178535 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dbec1fa5-7be7-4d3e-881c-7019708a5b0a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:54.179007 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dbec1fa5-7be7-4d3e-881c-7019708a5b0a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:54.179753 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dbec1fa5-7be7-4d3e-881c-7019708a5b0a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:54.190735 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dbec1fa5-7be7-4d3e-881c-7019708a5b0a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:54.194457 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dbec1fa5-7be7-4d3e-881c-7019708a5b0a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:54.284357 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dbec1fa5-7be7-4d3e-881c-7019708a5b0a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:54.286030 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dbec1fa5-7be7-4d3e-881c-7019708a5b0a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:54.286752 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dbec1fa5-7be7-4d3e-881c-7019708a5b0a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:54.288454 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-dbec1fa5-7be7-4d3e-881c-7019708a5b0a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lazy-loading 'fault' on Instance uuid 280de799-ddfb-4ced-a4b4-758807cb1279 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:01:54.418596 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-41c49425-0afd-4000-a927-35db88480ad9 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:54.419672 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-41c49425-0afd-4000-a927-35db88480ad9 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] [instance: 204530da-48f3-4d1e-89af-5c09f7be66ad] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:54.427143 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41c49425-0afd-4000-a927-35db88480ad9 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:54.427638 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41c49425-0afd-4000-a927-35db88480ad9 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:54.428152 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41c49425-0afd-4000-a927-35db88480ad9 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:54.429081 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41c49425-0afd-4000-a927-35db88480ad9 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:54.429526 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41c49425-0afd-4000-a927-35db88480ad9 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:54.429950 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41c49425-0afd-4000-a927-35db88480ad9 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:54.456617 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-41c49425-0afd-4000-a927-35db88480ad9 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] HTTP exception thrown: Instance 204530da-48f3-4d1e-89af-5c09f7be66ad could not be found. Sep 08 11:01:54.464431 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-41c49425-0afd-4000-a927-35db88480ad9 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Request method failure captured: Sep 08 11:01:54.464431 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/204530da-48f3-4d1e-89af-5c09f7be66ad HTTP/1.1 Sep 08 11:01:54.464431 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:01:54.464431 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:01:54.464431 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:01:54.464431 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 11:01:54.464431 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:01:54.464431 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:01:54.464431 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:01:54.464431 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:01:54.464431 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcuEbCWSqAEO5PN19xbJJd-8IEBhCRA44Bz_7Zxt9WXnAJefC1nmqnDkhx3wdEJqDGXfOX1fms8l-CmlexWfbhI_uMXhMo26BqUx4z00AjwdiVK58tei6I93SihtcHOm0SbIk_oynP5gvvH9X-cWdE0L07YgKMnElMNtX6yAto_UIqE Sep 08 11:01:54.464431 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:01:54.464431 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:01:54.464431 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:01:54.464431 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:01:54.464431 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:01:54.464431 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:01:54.464431 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 018d96ec30b54c46b00921c38e6f935d Sep 08 11:01:54.464431 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-743246211 Sep 08 11:01:54.464431 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:01:54.464431 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:01:54.464431 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/018d96ec30b54c46b00921c38e6f935d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/018d96ec30b54c46b00921c38e6f935d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_018d96ec30b54c46b00921c38e6f935d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/018d96ec30b54c46b00921c38e6f935d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:01:54.464431 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-743246211 Sep 08 11:01:54.464431 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 018d96ec30b54c46b00921c38e6f935d Sep 08 11:01:54.464431 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-743246211 Sep 08 11:01:54.464431 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-InstanceActionsNegativeTestJSON-743246211-project Sep 08 11:01:54.464431 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:01:54.464431 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:01:54.464431 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: dd8b7103d37e4309b7d1f683963eb522 Sep 08 11:01:54.464431 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-743246211-project Sep 08 11:01:54.464431 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 11:01:54.464431 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 204530da-48f3-4d1e-89af-5c09f7be66ad could not be found. Sep 08 11:01:54.464431 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '204530da-48f3-4d1e-89af-5c09f7be66ad'} Sep 08 11:01:54.464431 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:01:54.464431 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:01:54.464431 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:01:54.464431 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:01:54.464431 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:01:54.464431 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:01:54.464431 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:01:54.464431 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:01:54.464431 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:01:54.464431 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:01:54.464431 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 204530da-48f3-4d1e-89af-5c09f7be66ad could not be found. Sep 08 11:01:54.464431 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:01:54.464431 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:01:54.464431 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:01:54.464431 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:01:54.464431 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:01:54.464431 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:01:54.464431 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:01:54.464431 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:01:54.464431 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:01:54.464431 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:01:54.464431 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:01:54.464431 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:01:54.464431 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:01:54.464431 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:01:54.464431 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:01:54.464431 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:01:54.464431 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 204530da-48f3-4d1e-89af-5c09f7be66ad could not be found. Sep 08 11:01:54.464431 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:01:54.464431 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:01:54.471516 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:01:54.471516 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:01:54.471516 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:01:54.471516 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:01:54.471516 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:01:54.471516 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:01:54.471516 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 204530da-48f3-4d1e-89af-5c09f7be66ad could not be found. Sep 08 11:01:54.471516 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:01:54.471516 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-41c49425-0afd-4000-a927-35db88480ad9 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] Returning 404 to user: Instance 204530da-48f3-4d1e-89af-5c09f7be66ad could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:01:54.471516 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-41c49425-0afd-4000-a927-35db88480ad9 tempest-InstanceActionsNegativeTestJSON-743246211 tempest-InstanceActionsNegativeTestJSON-743246211-project] 10.222.0.27 "GET /compute/v2.1/servers/204530da-48f3-4d1e-89af-5c09f7be66ad" status: 404 len: 111 microversion: 2.1 time: 0.056182 Sep 08 11:01:54.471516 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2515/4934] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:01:54 2022] GET /compute/v2.1/servers/204530da-48f3-4d1e-89af-5c09f7be66ad => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:01:54.507726 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-dbec1fa5-7be7-4d3e-881c-7019708a5b0a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:54.521385 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-dbec1fa5-7be7-4d3e-881c-7019708a5b0a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/280de799-ddfb-4ced-a4b4-758807cb1279" status: 200 len: 1304 microversion: 2.1 time: 0.378242 Sep 08 11:01:54.521985 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2420/4935] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:01:54 2022] GET /compute/v2.1/servers/280de799-ddfb-4ced-a4b4-758807cb1279 => generated 1304 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:01:55.551463 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f7e13c0f-556f-4985-b1d0-7d1cfd561037 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:55.552631 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f7e13c0f-556f-4985-b1d0-7d1cfd561037 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 280de799-ddfb-4ced-a4b4-758807cb1279] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:55.566440 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f7e13c0f-556f-4985-b1d0-7d1cfd561037 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:55.566936 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f7e13c0f-556f-4985-b1d0-7d1cfd561037 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:55.567369 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f7e13c0f-556f-4985-b1d0-7d1cfd561037 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:55.568089 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f7e13c0f-556f-4985-b1d0-7d1cfd561037 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:55.568539 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f7e13c0f-556f-4985-b1d0-7d1cfd561037 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:55.568964 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f7e13c0f-556f-4985-b1d0-7d1cfd561037 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:55.597485 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-f7e13c0f-556f-4985-b1d0-7d1cfd561037 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] HTTP exception thrown: Instance 280de799-ddfb-4ced-a4b4-758807cb1279 could not be found. Sep 08 11:01:55.599585 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f7e13c0f-556f-4985-b1d0-7d1cfd561037 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Request method failure captured: Sep 08 11:01:55.599585 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/280de799-ddfb-4ced-a4b4-758807cb1279 HTTP/1.1 Sep 08 11:01:55.599585 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:01:55.599585 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:01:55.599585 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:01:55.599585 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 11:01:55.599585 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:01:55.599585 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:01:55.599585 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:01:55.599585 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:01:55.599585 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGclESil0k3YwhrgmBq9RP58BT8ggCfoq71W7WWaQs79ajWV7VkDiBFW1SHjoqsRUYcZFA-S32MHtcVEuvCs9KDt4sUyYXYecQKP0Pc6KvZoCxHDx-TLBLeVMVKgTKTHMZY5fKwLa-YndhdHH_rmxBkRZ4MxFl9oZaWC-z8pqYA8SSe4 Sep 08 11:01:55.599585 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:01:55.599585 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:01:55.599585 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:01:55.599585 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:01:55.599585 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:01:55.599585 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:01:55.599585 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 11b5d4706b2d43aca8290ccf07ee1ece Sep 08 11:01:55.599585 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServerActionsTestJSON-1762930547 Sep 08 11:01:55.599585 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:01:55.599585 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:01:55.599585 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/11b5d4706b2d43aca8290ccf07ee1ece"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/11b5d4706b2d43aca8290ccf07ee1ece"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_11b5d4706b2d43aca8290ccf07ee1ece"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/11b5d4706b2d43aca8290ccf07ee1ece"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:01:55.599585 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServerActionsTestJSON-1762930547 Sep 08 11:01:55.599585 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 11b5d4706b2d43aca8290ccf07ee1ece Sep 08 11:01:55.599585 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServerActionsTestJSON-1762930547 Sep 08 11:01:55.599585 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServerActionsTestJSON-1762930547-project Sep 08 11:01:55.599585 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:01:55.599585 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:01:55.599585 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: d68b017335c84d15becbdc7615498103 Sep 08 11:01:55.599585 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServerActionsTestJSON-1762930547-project Sep 08 11:01:55.599585 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 11:01:55.599585 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 280de799-ddfb-4ced-a4b4-758807cb1279 could not be found. Sep 08 11:01:55.599585 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '280de799-ddfb-4ced-a4b4-758807cb1279'} Sep 08 11:01:55.599585 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:01:55.599585 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:01:55.599585 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:01:55.599585 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:01:55.599585 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:01:55.599585 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:01:55.599585 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:01:55.599585 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:01:55.599585 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:01:55.599585 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:01:55.599585 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 280de799-ddfb-4ced-a4b4-758807cb1279 could not be found. Sep 08 11:01:55.599585 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:01:55.599585 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:01:55.599585 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:01:55.599585 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:01:55.599585 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:01:55.599585 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:01:55.599585 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:01:55.599585 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:01:55.599585 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:01:55.599585 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:01:55.599585 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:01:55.599585 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:01:55.599585 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:01:55.599585 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:01:55.599585 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:01:55.599585 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:01:55.599585 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 280de799-ddfb-4ced-a4b4-758807cb1279 could not be found. Sep 08 11:01:55.599585 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:01:55.599585 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:01:55.599585 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:01:55.604591 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:01:55.604591 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:01:55.604591 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:01:55.604591 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:01:55.604591 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:01:55.604591 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 280de799-ddfb-4ced-a4b4-758807cb1279 could not be found. Sep 08 11:01:55.604591 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:01:55.608450 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f7e13c0f-556f-4985-b1d0-7d1cfd561037 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Returning 404 to user: Instance 280de799-ddfb-4ced-a4b4-758807cb1279 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:01:55.611098 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f7e13c0f-556f-4985-b1d0-7d1cfd561037 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/280de799-ddfb-4ced-a4b4-758807cb1279" status: 404 len: 111 microversion: 2.1 time: 0.062613 Sep 08 11:01:55.613460 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2516/4936] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:01:55 2022] GET /compute/v2.1/servers/280de799-ddfb-4ced-a4b4-758807cb1279 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:01:55.624682 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9fe083d6-6cca-4295-bf74-5303957f3e2a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:55.625472 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9fe083d6-6cca-4295-bf74-5303957f3e2a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 85c5c938-83a1-4ca3-b9b1-b05d818f7efc] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:55.636227 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9fe083d6-6cca-4295-bf74-5303957f3e2a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:55.636227 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9fe083d6-6cca-4295-bf74-5303957f3e2a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:55.636863 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9fe083d6-6cca-4295-bf74-5303957f3e2a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:55.637634 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9fe083d6-6cca-4295-bf74-5303957f3e2a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:55.638293 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9fe083d6-6cca-4295-bf74-5303957f3e2a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:55.638899 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9fe083d6-6cca-4295-bf74-5303957f3e2a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:55.701327 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9fe083d6-6cca-4295-bf74-5303957f3e2a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 85c5c938-83a1-4ca3-b9b1-b05d818f7efc] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:01:55.834443 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9fe083d6-6cca-4295-bf74-5303957f3e2a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "DELETE /compute/v2.1/servers/85c5c938-83a1-4ca3-b9b1-b05d818f7efc" status: 204 len: 0 microversion: 2.1 time: 0.214422 Sep 08 11:01:55.840120 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2421/4937] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:01:55 2022] DELETE /compute/v2.1/servers/85c5c938-83a1-4ca3-b9b1-b05d818f7efc => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:01:55.844699 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1366f33c-9b96-49e1-b7d4-8ac7906b1303 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:55.845584 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1366f33c-9b96-49e1-b7d4-8ac7906b1303 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 85c5c938-83a1-4ca3-b9b1-b05d818f7efc] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:55.853423 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1366f33c-9b96-49e1-b7d4-8ac7906b1303 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:55.854260 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1366f33c-9b96-49e1-b7d4-8ac7906b1303 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:55.854889 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1366f33c-9b96-49e1-b7d4-8ac7906b1303 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:55.855798 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1366f33c-9b96-49e1-b7d4-8ac7906b1303 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:55.856435 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1366f33c-9b96-49e1-b7d4-8ac7906b1303 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:55.857335 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1366f33c-9b96-49e1-b7d4-8ac7906b1303 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:56.103643 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1366f33c-9b96-49e1-b7d4-8ac7906b1303 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:56.122252 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1366f33c-9b96-49e1-b7d4-8ac7906b1303 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/85c5c938-83a1-4ca3-b9b1-b05d818f7efc" status: 200 len: 1508 microversion: 2.1 time: 0.281846 Sep 08 11:01:56.122857 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2517/4938] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:01:55 2022] GET /compute/v2.1/servers/85c5c938-83a1-4ca3-b9b1-b05d818f7efc => generated 1508 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:01:57.158314 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1839af19-69de-47ad-a285-257e51a48ca6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:57.162177 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1839af19-69de-47ad-a285-257e51a48ca6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 85c5c938-83a1-4ca3-b9b1-b05d818f7efc] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:57.187729 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1839af19-69de-47ad-a285-257e51a48ca6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:57.187949 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1839af19-69de-47ad-a285-257e51a48ca6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:57.188214 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1839af19-69de-47ad-a285-257e51a48ca6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:57.190928 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1839af19-69de-47ad-a285-257e51a48ca6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:57.193165 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1839af19-69de-47ad-a285-257e51a48ca6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:57.198681 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1839af19-69de-47ad-a285-257e51a48ca6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:58.314043 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1839af19-69de-47ad-a285-257e51a48ca6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:58.325640 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1839af19-69de-47ad-a285-257e51a48ca6 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/85c5c938-83a1-4ca3-b9b1-b05d818f7efc" status: 200 len: 1508 microversion: 2.1 time: 1.179504 Sep 08 11:01:58.334024 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2422/4939] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:01:57 2022] GET /compute/v2.1/servers/85c5c938-83a1-4ca3-b9b1-b05d818f7efc => generated 1508 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:01:59.375207 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e2aba206-a76d-40ec-8a72-3d4725824a17 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:59.376896 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e2aba206-a76d-40ec-8a72-3d4725824a17 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 85c5c938-83a1-4ca3-b9b1-b05d818f7efc] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:59.413503 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e2aba206-a76d-40ec-8a72-3d4725824a17 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:59.425975 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e2aba206-a76d-40ec-8a72-3d4725824a17 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:59.428518 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e2aba206-a76d-40ec-8a72-3d4725824a17 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:59.444317 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e2aba206-a76d-40ec-8a72-3d4725824a17 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:59.445457 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e2aba206-a76d-40ec-8a72-3d4725824a17 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:59.447904 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e2aba206-a76d-40ec-8a72-3d4725824a17 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:59.682381 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-b83df123-7bec-4fe6-a4b4-258008a4db45 req-ad39226b-ccc4-4c7d-b711-c8598bd35027 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85c5c938-83a1-4ca3-b9b1-b05d818f7efc", "name": "network-vif-deleted", "tag": "bb42ab11-44aa-447c-8de2-2170b134194c"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:01:59.700209 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:01:59.708295 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b83df123-7bec-4fe6-a4b4-258008a4db45 req-ad39226b-ccc4-4c7d-b711-c8598bd35027 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:59.710663 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b83df123-7bec-4fe6-a4b4-258008a4db45 req-ad39226b-ccc4-4c7d-b711-c8598bd35027 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:59.710832 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e2aba206-a76d-40ec-8a72-3d4725824a17 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:59.713164 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b83df123-7bec-4fe6-a4b4-258008a4db45 req-ad39226b-ccc4-4c7d-b711-c8598bd35027 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:59.723932 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e2aba206-a76d-40ec-8a72-3d4725824a17 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/85c5c938-83a1-4ca3-b9b1-b05d818f7efc" status: 200 len: 1466 microversion: 2.1 time: 0.357279 Sep 08 11:01:59.726486 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2518/4940] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:01:59 2022] GET /compute/v2.1/servers/85c5c938-83a1-4ca3-b9b1-b05d818f7efc => generated 1466 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:01:59.736041 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:01:59.781526 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-b83df123-7bec-4fe6-a4b4-258008a4db45 req-ad39226b-ccc4-4c7d-b711-c8598bd35027 service nova] Creating event network-vif-deleted:bb42ab11-44aa-447c-8de2-2170b134194c for instance 85c5c938-83a1-4ca3-b9b1-b05d818f7efc on n-h2-850501-12 Sep 08 11:01:59.795601 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-b83df123-7bec-4fe6-a4b4-258008a4db45 req-ad39226b-ccc4-4c7d-b711-c8598bd35027 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120675 Sep 08 11:01:59.797229 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2423/4941] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:01:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:02:00.753887 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-badf7e90-3a88-41f4-9a1d-386ae602b11d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:02:00.754510 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-badf7e90-3a88-41f4-9a1d-386ae602b11d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 85c5c938-83a1-4ca3-b9b1-b05d818f7efc] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:02:00.776968 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-badf7e90-3a88-41f4-9a1d-386ae602b11d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:00.777242 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-badf7e90-3a88-41f4-9a1d-386ae602b11d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:00.777670 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-badf7e90-3a88-41f4-9a1d-386ae602b11d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:00.787858 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-badf7e90-3a88-41f4-9a1d-386ae602b11d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:00.795178 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-badf7e90-3a88-41f4-9a1d-386ae602b11d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:00.796021 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-badf7e90-3a88-41f4-9a1d-386ae602b11d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:00.859185 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-badf7e90-3a88-41f4-9a1d-386ae602b11d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:00.859941 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-badf7e90-3a88-41f4-9a1d-386ae602b11d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:00.860418 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-badf7e90-3a88-41f4-9a1d-386ae602b11d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:00.860933 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-badf7e90-3a88-41f4-9a1d-386ae602b11d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lazy-loading 'fault' on Instance uuid 85c5c938-83a1-4ca3-b9b1-b05d818f7efc {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:02:01.209321 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-badf7e90-3a88-41f4-9a1d-386ae602b11d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:02:01.224226 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-badf7e90-3a88-41f4-9a1d-386ae602b11d tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/85c5c938-83a1-4ca3-b9b1-b05d818f7efc" status: 200 len: 1305 microversion: 2.1 time: 0.474058 Sep 08 11:02:01.225081 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2519/4942] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:02:00 2022] GET /compute/v2.1/servers/85c5c938-83a1-4ca3-b9b1-b05d818f7efc => generated 1305 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:02:02.255887 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-58cfc35e-d252-4042-b006-6e4eb88cf56a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:02:02.256857 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-58cfc35e-d252-4042-b006-6e4eb88cf56a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 85c5c938-83a1-4ca3-b9b1-b05d818f7efc] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:02:02.308113 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-58cfc35e-d252-4042-b006-6e4eb88cf56a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:02.310846 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-58cfc35e-d252-4042-b006-6e4eb88cf56a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:02.312715 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-58cfc35e-d252-4042-b006-6e4eb88cf56a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:02.313971 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-58cfc35e-d252-4042-b006-6e4eb88cf56a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:02.324049 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-58cfc35e-d252-4042-b006-6e4eb88cf56a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:02.325683 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-58cfc35e-d252-4042-b006-6e4eb88cf56a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:02.369997 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-58cfc35e-d252-4042-b006-6e4eb88cf56a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] HTTP exception thrown: Instance 85c5c938-83a1-4ca3-b9b1-b05d818f7efc could not be found. Sep 08 11:02:02.375203 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-58cfc35e-d252-4042-b006-6e4eb88cf56a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Request method failure captured: Sep 08 11:02:02.375203 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/85c5c938-83a1-4ca3-b9b1-b05d818f7efc HTTP/1.1 Sep 08 11:02:02.375203 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 11:02:02.375203 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 11:02:02.375203 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 11:02:02.375203 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 11:02:02.375203 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 11:02:02.375203 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 11:02:02.375203 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 11:02:02.375203 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 11:02:02.375203 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGclESil0k3YwhrgmBq9RP58BT8ggCfoq71W7WWaQs79ajWV7VkDiBFW1SHjoqsRUYcZFA-S32MHtcVEuvCs9KDt4sUyYXYecQKP0Pc6KvZoCxHDx-TLBLeVMVKgTKTHMZY5fKwLa-YndhdHH_rmxBkRZ4MxFl9oZaWC-z8pqYA8SSe4 Sep 08 11:02:02.375203 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 11:02:02.375203 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 11:02:02.375203 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 11:02:02.375203 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 11:02:02.375203 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 11:02:02.375203 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 11:02:02.375203 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 11b5d4706b2d43aca8290ccf07ee1ece Sep 08 11:02:02.375203 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServerActionsTestJSON-1762930547 Sep 08 11:02:02.375203 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 11:02:02.375203 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 11:02:02.375203 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/11b5d4706b2d43aca8290ccf07ee1ece"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/11b5d4706b2d43aca8290ccf07ee1ece"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_11b5d4706b2d43aca8290ccf07ee1ece"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/11b5d4706b2d43aca8290ccf07ee1ece"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:02:02.375203 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServerActionsTestJSON-1762930547 Sep 08 11:02:02.375203 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 11b5d4706b2d43aca8290ccf07ee1ece Sep 08 11:02:02.375203 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServerActionsTestJSON-1762930547 Sep 08 11:02:02.375203 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServerActionsTestJSON-1762930547-project Sep 08 11:02:02.375203 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 11:02:02.375203 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 11:02:02.375203 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: d68b017335c84d15becbdc7615498103 Sep 08 11:02:02.375203 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServerActionsTestJSON-1762930547-project Sep 08 11:02:02.375203 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 11:02:02.375203 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 85c5c938-83a1-4ca3-b9b1-b05d818f7efc could not be found. Sep 08 11:02:02.375203 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '85c5c938-83a1-4ca3-b9b1-b05d818f7efc'} Sep 08 11:02:02.375203 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:02:02.375203 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:02:02.375203 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:02:02.375203 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:02:02.375203 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:02:02.375203 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:02:02.375203 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:02:02.375203 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:02:02.375203 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:02:02.375203 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:02:02.375203 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85c5c938-83a1-4ca3-b9b1-b05d818f7efc could not be found. Sep 08 11:02:02.375203 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:02:02.375203 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:02:02.375203 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:02:02.375203 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:02:02.375203 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:02:02.375203 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:02:02.375203 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:02:02.375203 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:02:02.375203 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:02:02.375203 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:02:02.375203 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:02:02.375203 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:02:02.375203 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:02:02.375203 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:02:02.375203 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:02:02.375203 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:02:02.375203 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85c5c938-83a1-4ca3-b9b1-b05d818f7efc could not be found. Sep 08 11:02:02.375203 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:02:02.375203 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:02:02.375203 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:02:02.379701 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:02:02.379701 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:02:02.379701 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:02:02.379701 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:02:02.379701 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:02:02.379701 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85c5c938-83a1-4ca3-b9b1-b05d818f7efc could not be found. Sep 08 11:02:02.379701 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:02:02.379701 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-58cfc35e-d252-4042-b006-6e4eb88cf56a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Returning 404 to user: Instance 85c5c938-83a1-4ca3-b9b1-b05d818f7efc could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:02:02.381287 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-58cfc35e-d252-4042-b006-6e4eb88cf56a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/85c5c938-83a1-4ca3-b9b1-b05d818f7efc" status: 404 len: 111 microversion: 2.1 time: 0.130078 Sep 08 11:02:02.393265 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d4a09070-f868-4665-bbb2-1e813f356a35 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:02:02.393967 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d4a09070-f868-4665-bbb2-1e813f356a35 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 379a5e3e-0e59-4b53-a37e-f4e9d1000eaf] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:02:02.400141 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2424/4943] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:02:02 2022] GET /compute/v2.1/servers/85c5c938-83a1-4ca3-b9b1-b05d818f7efc => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:02:02.412979 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d4a09070-f868-4665-bbb2-1e813f356a35 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:02.413594 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d4a09070-f868-4665-bbb2-1e813f356a35 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:02.416273 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d4a09070-f868-4665-bbb2-1e813f356a35 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:02.418511 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d4a09070-f868-4665-bbb2-1e813f356a35 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:02.421740 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d4a09070-f868-4665-bbb2-1e813f356a35 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:02.422217 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d4a09070-f868-4665-bbb2-1e813f356a35 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:02.487757 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d4a09070-f868-4665-bbb2-1e813f356a35 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 379a5e3e-0e59-4b53-a37e-f4e9d1000eaf] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:02:02.684387 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d4a09070-f868-4665-bbb2-1e813f356a35 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "DELETE /compute/v2.1/servers/379a5e3e-0e59-4b53-a37e-f4e9d1000eaf" status: 204 len: 0 microversion: 2.1 time: 0.295882 Sep 08 11:02:02.689127 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2520/4944] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:02:02 2022] DELETE /compute/v2.1/servers/379a5e3e-0e59-4b53-a37e-f4e9d1000eaf => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:02:02.701830 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b5ce7c90-8dda-4fb6-81a7-9f366b35cf9a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:02:02.702848 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b5ce7c90-8dda-4fb6-81a7-9f366b35cf9a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 379a5e3e-0e59-4b53-a37e-f4e9d1000eaf] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:02:02.728734 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b5ce7c90-8dda-4fb6-81a7-9f366b35cf9a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:02.732271 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b5ce7c90-8dda-4fb6-81a7-9f366b35cf9a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:02.736179 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b5ce7c90-8dda-4fb6-81a7-9f366b35cf9a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:02.737116 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b5ce7c90-8dda-4fb6-81a7-9f366b35cf9a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:02.759618 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b5ce7c90-8dda-4fb6-81a7-9f366b35cf9a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:02.768725 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b5ce7c90-8dda-4fb6-81a7-9f366b35cf9a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:03.302833 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b5ce7c90-8dda-4fb6-81a7-9f366b35cf9a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:02:03.327987 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b5ce7c90-8dda-4fb6-81a7-9f366b35cf9a tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/379a5e3e-0e59-4b53-a37e-f4e9d1000eaf" status: 200 len: 1494 microversion: 2.1 time: 0.631394 Sep 08 11:02:03.329332 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2425/4945] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:02:02 2022] GET /compute/v2.1/servers/379a5e3e-0e59-4b53-a37e-f4e9d1000eaf => generated 1494 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:02:04.372765 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f2ef4bd1-d249-456b-8fbb-2b5c79ec0617 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:02:04.373543 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f2ef4bd1-d249-456b-8fbb-2b5c79ec0617 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 379a5e3e-0e59-4b53-a37e-f4e9d1000eaf] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:02:04.385930 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f2ef4bd1-d249-456b-8fbb-2b5c79ec0617 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:04.388074 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f2ef4bd1-d249-456b-8fbb-2b5c79ec0617 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:04.388832 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f2ef4bd1-d249-456b-8fbb-2b5c79ec0617 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:04.389829 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f2ef4bd1-d249-456b-8fbb-2b5c79ec0617 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:04.390540 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f2ef4bd1-d249-456b-8fbb-2b5c79ec0617 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:04.391255 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f2ef4bd1-d249-456b-8fbb-2b5c79ec0617 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:04.782525 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f2ef4bd1-d249-456b-8fbb-2b5c79ec0617 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:02:04.796717 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f2ef4bd1-d249-456b-8fbb-2b5c79ec0617 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/379a5e3e-0e59-4b53-a37e-f4e9d1000eaf" status: 200 len: 1452 microversion: 2.1 time: 0.436104 Sep 08 11:02:04.807497 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2521/4946] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:02:04 2022] GET /compute/v2.1/servers/379a5e3e-0e59-4b53-a37e-f4e9d1000eaf => generated 1452 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:02:05.017632 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-c2c71989-d31a-4e88-8d22-ddcc6761d27b req-ab9d0e51-1a7f-423b-9726-dcf14016949c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "379a5e3e-0e59-4b53-a37e-f4e9d1000eaf", "name": "network-vif-deleted", "tag": "2e460d9c-8d3b-48a3-86c2-1bf47c800c37"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:02:05.035442 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c2c71989-d31a-4e88-8d22-ddcc6761d27b req-ab9d0e51-1a7f-423b-9726-dcf14016949c service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:05.036231 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c2c71989-d31a-4e88-8d22-ddcc6761d27b req-ab9d0e51-1a7f-423b-9726-dcf14016949c service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:05.036986 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c2c71989-d31a-4e88-8d22-ddcc6761d27b req-ab9d0e51-1a7f-423b-9726-dcf14016949c service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:05.078107 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-c2c71989-d31a-4e88-8d22-ddcc6761d27b req-ab9d0e51-1a7f-423b-9726-dcf14016949c service nova] Creating event network-vif-deleted:2e460d9c-8d3b-48a3-86c2-1bf47c800c37 for instance 379a5e3e-0e59-4b53-a37e-f4e9d1000eaf on n-h2-850501-12 Sep 08 11:02:05.084562 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-c2c71989-d31a-4e88-8d22-ddcc6761d27b req-ab9d0e51-1a7f-423b-9726-dcf14016949c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072033 Sep 08 11:02:05.085950 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2426/4947] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:02:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:02:05.825710 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-47865b31-34fc-495c-a95e-833d201cbf6e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:02:05.827582 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-47865b31-34fc-495c-a95e-833d201cbf6e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 379a5e3e-0e59-4b53-a37e-f4e9d1000eaf] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:02:05.833375 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=3 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:02:05.838853 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-47865b31-34fc-495c-a95e-833d201cbf6e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:05.839563 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-47865b31-34fc-495c-a95e-833d201cbf6e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:05.840098 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-47865b31-34fc-495c-a95e-833d201cbf6e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:05.840871 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-47865b31-34fc-495c-a95e-833d201cbf6e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:05.841634 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-47865b31-34fc-495c-a95e-833d201cbf6e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:05.842274 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-47865b31-34fc-495c-a95e-833d201cbf6e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:05.926750 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-47865b31-34fc-495c-a95e-833d201cbf6e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:05.927554 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-47865b31-34fc-495c-a95e-833d201cbf6e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:05.928205 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-47865b31-34fc-495c-a95e-833d201cbf6e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:05.928860 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-47865b31-34fc-495c-a95e-833d201cbf6e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lazy-loading 'fault' on Instance uuid 379a5e3e-0e59-4b53-a37e-f4e9d1000eaf {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:02:06.128951 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-47865b31-34fc-495c-a95e-833d201cbf6e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:02:06.137882 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-47865b31-34fc-495c-a95e-833d201cbf6e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/379a5e3e-0e59-4b53-a37e-f4e9d1000eaf" status: 200 len: 1304 microversion: 2.1 time: 0.317399 Sep 08 11:02:06.148236 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2522/4948] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:02:05 2022] GET /compute/v2.1/servers/379a5e3e-0e59-4b53-a37e-f4e9d1000eaf => generated 1304 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:02:07.169426 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d641906a-abe2-4e3c-9d33-888ae2c44725 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:02:07.171431 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d641906a-abe2-4e3c-9d33-888ae2c44725 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: 379a5e3e-0e59-4b53-a37e-f4e9d1000eaf] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:02:07.190188 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d641906a-abe2-4e3c-9d33-888ae2c44725 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:07.190807 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d641906a-abe2-4e3c-9d33-888ae2c44725 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:07.191334 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d641906a-abe2-4e3c-9d33-888ae2c44725 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:07.202547 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d641906a-abe2-4e3c-9d33-888ae2c44725 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:07.204528 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d641906a-abe2-4e3c-9d33-888ae2c44725 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:07.205767 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d641906a-abe2-4e3c-9d33-888ae2c44725 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:07.247930 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-d641906a-abe2-4e3c-9d33-888ae2c44725 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] HTTP exception thrown: Instance 379a5e3e-0e59-4b53-a37e-f4e9d1000eaf could not be found. Sep 08 11:02:07.253894 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d641906a-abe2-4e3c-9d33-888ae2c44725 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Request method failure captured: Sep 08 11:02:07.253894 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/379a5e3e-0e59-4b53-a37e-f4e9d1000eaf HTTP/1.1 Sep 08 11:02:07.253894 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 11:02:07.253894 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 11:02:07.253894 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 11:02:07.253894 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 11:02:07.253894 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 11:02:07.253894 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 11:02:07.253894 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 11:02:07.253894 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 11:02:07.253894 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGclESil0k3YwhrgmBq9RP58BT8ggCfoq71W7WWaQs79ajWV7VkDiBFW1SHjoqsRUYcZFA-S32MHtcVEuvCs9KDt4sUyYXYecQKP0Pc6KvZoCxHDx-TLBLeVMVKgTKTHMZY5fKwLa-YndhdHH_rmxBkRZ4MxFl9oZaWC-z8pqYA8SSe4 Sep 08 11:02:07.253894 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 11:02:07.253894 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 11:02:07.253894 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 11:02:07.253894 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 11:02:07.253894 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 11:02:07.253894 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 11:02:07.253894 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 11b5d4706b2d43aca8290ccf07ee1ece Sep 08 11:02:07.253894 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServerActionsTestJSON-1762930547 Sep 08 11:02:07.253894 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 11:02:07.253894 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 11:02:07.253894 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/11b5d4706b2d43aca8290ccf07ee1ece"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/11b5d4706b2d43aca8290ccf07ee1ece"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_11b5d4706b2d43aca8290ccf07ee1ece"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/11b5d4706b2d43aca8290ccf07ee1ece"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:02:07.253894 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServerActionsTestJSON-1762930547 Sep 08 11:02:07.253894 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 11b5d4706b2d43aca8290ccf07ee1ece Sep 08 11:02:07.253894 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServerActionsTestJSON-1762930547 Sep 08 11:02:07.253894 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServerActionsTestJSON-1762930547-project Sep 08 11:02:07.253894 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 11:02:07.253894 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 11:02:07.253894 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: d68b017335c84d15becbdc7615498103 Sep 08 11:02:07.253894 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServerActionsTestJSON-1762930547-project Sep 08 11:02:07.253894 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 11:02:07.253894 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 379a5e3e-0e59-4b53-a37e-f4e9d1000eaf could not be found. Sep 08 11:02:07.253894 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '379a5e3e-0e59-4b53-a37e-f4e9d1000eaf'} Sep 08 11:02:07.253894 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:02:07.253894 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:02:07.253894 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:02:07.253894 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:02:07.253894 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:02:07.253894 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:02:07.253894 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:02:07.253894 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:02:07.253894 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:02:07.253894 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:02:07.253894 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 379a5e3e-0e59-4b53-a37e-f4e9d1000eaf could not be found. Sep 08 11:02:07.253894 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:02:07.253894 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:02:07.253894 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:02:07.253894 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:02:07.253894 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:02:07.253894 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:02:07.253894 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:02:07.253894 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:02:07.253894 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:02:07.253894 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:02:07.253894 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:02:07.253894 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:02:07.253894 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:02:07.253894 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:02:07.253894 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:02:07.253894 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:02:07.253894 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 379a5e3e-0e59-4b53-a37e-f4e9d1000eaf could not be found. Sep 08 11:02:07.253894 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:02:07.253894 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:02:07.253894 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:02:07.260742 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:02:07.260742 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:02:07.260742 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:02:07.260742 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:02:07.260742 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:02:07.260742 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 379a5e3e-0e59-4b53-a37e-f4e9d1000eaf could not be found. Sep 08 11:02:07.260742 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:02:07.264595 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d641906a-abe2-4e3c-9d33-888ae2c44725 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Returning 404 to user: Instance 379a5e3e-0e59-4b53-a37e-f4e9d1000eaf could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:02:07.266687 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d641906a-abe2-4e3c-9d33-888ae2c44725 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/379a5e3e-0e59-4b53-a37e-f4e9d1000eaf" status: 404 len: 111 microversion: 2.1 time: 0.105264 Sep 08 11:02:07.270575 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2427/4949] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:02:07 2022] GET /compute/v2.1/servers/379a5e3e-0e59-4b53-a37e-f4e9d1000eaf => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:02:07.289772 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d1defcec-65bc-4da4-8ea3-d66d458345df tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:02:07.290854 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d1defcec-65bc-4da4-8ea3-d66d458345df tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:02:07.307162 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d1defcec-65bc-4da4-8ea3-d66d458345df tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:07.307951 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d1defcec-65bc-4da4-8ea3-d66d458345df tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:07.308561 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d1defcec-65bc-4da4-8ea3-d66d458345df tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:07.309301 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d1defcec-65bc-4da4-8ea3-d66d458345df tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:07.309754 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d1defcec-65bc-4da4-8ea3-d66d458345df tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:07.310187 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d1defcec-65bc-4da4-8ea3-d66d458345df tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:07.382618 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d1defcec-65bc-4da4-8ea3-d66d458345df tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:02:07.550406 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d1defcec-65bc-4da4-8ea3-d66d458345df tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 204 len: 0 microversion: 2.1 time: 0.275425 Sep 08 11:02:07.556590 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2523/4950] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:02:07 2022] DELETE /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 11:02:07.561536 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ea23fa6f-bf20-4c7d-9a29-a2cac15c7270 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:02:07.562455 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ea23fa6f-bf20-4c7d-9a29-a2cac15c7270 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:02:07.572879 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea23fa6f-bf20-4c7d-9a29-a2cac15c7270 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:07.573446 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea23fa6f-bf20-4c7d-9a29-a2cac15c7270 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:07.577837 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea23fa6f-bf20-4c7d-9a29-a2cac15c7270 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:07.579933 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea23fa6f-bf20-4c7d-9a29-a2cac15c7270 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:07.581697 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea23fa6f-bf20-4c7d-9a29-a2cac15c7270 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:07.583479 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea23fa6f-bf20-4c7d-9a29-a2cac15c7270 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:07.940658 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ea23fa6f-bf20-4c7d-9a29-a2cac15c7270 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:02:07.952996 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ea23fa6f-bf20-4c7d-9a29-a2cac15c7270 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1677 microversion: 2.1 time: 0.395039 Sep 08 11:02:07.955069 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2428/4951] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:02:07 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1677 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:02:08.989523 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7d6d5369-9c33-4146-a50e-1cdcf7fe4e20 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:02:08.991877 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7d6d5369-9c33-4146-a50e-1cdcf7fe4e20 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:02:09.013994 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7d6d5369-9c33-4146-a50e-1cdcf7fe4e20 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:09.014500 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7d6d5369-9c33-4146-a50e-1cdcf7fe4e20 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:09.014945 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7d6d5369-9c33-4146-a50e-1cdcf7fe4e20 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:09.015672 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7d6d5369-9c33-4146-a50e-1cdcf7fe4e20 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:09.016134 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7d6d5369-9c33-4146-a50e-1cdcf7fe4e20 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:09.016566 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7d6d5369-9c33-4146-a50e-1cdcf7fe4e20 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:09.496809 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7d6d5369-9c33-4146-a50e-1cdcf7fe4e20 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:02:09.499556 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:02:09.510154 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7d6d5369-9c33-4146-a50e-1cdcf7fe4e20 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1677 microversion: 2.1 time: 0.529238 Sep 08 11:02:09.522738 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2524/4952] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:02:08 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1677 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:02:10.540864 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b45d27cb-1556-4f3c-a10e-67e4ed29aa1e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:02:10.541679 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b45d27cb-1556-4f3c-a10e-67e4ed29aa1e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:02:10.583549 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b45d27cb-1556-4f3c-a10e-67e4ed29aa1e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:10.584625 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b45d27cb-1556-4f3c-a10e-67e4ed29aa1e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:10.596107 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b45d27cb-1556-4f3c-a10e-67e4ed29aa1e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:10.600281 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b45d27cb-1556-4f3c-a10e-67e4ed29aa1e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:10.603099 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b45d27cb-1556-4f3c-a10e-67e4ed29aa1e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:10.603582 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b45d27cb-1556-4f3c-a10e-67e4ed29aa1e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:11.405175 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b45d27cb-1556-4f3c-a10e-67e4ed29aa1e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:02:11.429499 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b45d27cb-1556-4f3c-a10e-67e4ed29aa1e tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1677 microversion: 2.1 time: 0.897147 Sep 08 11:02:11.433608 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2429/4953] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:02:10 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1677 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:02:12.460080 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1639523a-60a8-4882-a982-2380bc794b02 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:02:12.460703 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1639523a-60a8-4882-a982-2380bc794b02 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:02:12.473884 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1639523a-60a8-4882-a982-2380bc794b02 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:12.477813 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1639523a-60a8-4882-a982-2380bc794b02 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:12.478810 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1639523a-60a8-4882-a982-2380bc794b02 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:12.481457 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1639523a-60a8-4882-a982-2380bc794b02 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:12.483056 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1639523a-60a8-4882-a982-2380bc794b02 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:12.484166 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1639523a-60a8-4882-a982-2380bc794b02 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:12.738692 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1639523a-60a8-4882-a982-2380bc794b02 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:02:12.781219 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1639523a-60a8-4882-a982-2380bc794b02 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1609 microversion: 2.1 time: 0.324584 Sep 08 11:02:12.782292 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2525/4954] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:02:12 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1609 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:02:13.815274 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-aa31d77e-45dc-4410-b3b4-290ff4a42e55 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:02:13.816266 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-aa31d77e-45dc-4410-b3b4-290ff4a42e55 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:02:13.827404 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa31d77e-45dc-4410-b3b4-290ff4a42e55 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:13.828534 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa31d77e-45dc-4410-b3b4-290ff4a42e55 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:13.829335 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa31d77e-45dc-4410-b3b4-290ff4a42e55 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:13.830148 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa31d77e-45dc-4410-b3b4-290ff4a42e55 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:13.831085 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa31d77e-45dc-4410-b3b4-290ff4a42e55 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:13.831941 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa31d77e-45dc-4410-b3b4-290ff4a42e55 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:13.984237 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-aa31d77e-45dc-4410-b3b4-290ff4a42e55 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:02:13.999190 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-aa31d77e-45dc-4410-b3b4-290ff4a42e55 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1609 microversion: 2.1 time: 0.191798 Sep 08 11:02:14.001269 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2430/4955] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:02:13 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1609 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:02:14.723671 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-ef195426-2680-488c-8d1f-abf67124ec4d req-b0f17163-8e18-41b6-af2f-85751028aa9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e81e0acc-0b96-4dbc-a5bb-89183f5204e7", "name": "network-vif-deleted", "tag": "ff9d981d-5db2-425c-b066-f87540f6e91c"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:02:14.766073 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-ef195426-2680-488c-8d1f-abf67124ec4d req-b0f17163-8e18-41b6-af2f-85751028aa9c service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:14.766571 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-ef195426-2680-488c-8d1f-abf67124ec4d req-b0f17163-8e18-41b6-af2f-85751028aa9c service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:14.767156 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-ef195426-2680-488c-8d1f-abf67124ec4d req-b0f17163-8e18-41b6-af2f-85751028aa9c service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:14.833479 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-ef195426-2680-488c-8d1f-abf67124ec4d req-b0f17163-8e18-41b6-af2f-85751028aa9c service nova] Creating event network-vif-deleted:ff9d981d-5db2-425c-b066-f87540f6e91c for instance e81e0acc-0b96-4dbc-a5bb-89183f5204e7 on n-h1-850501-12 Sep 08 11:02:14.855156 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-ef195426-2680-488c-8d1f-abf67124ec4d req-b0f17163-8e18-41b6-af2f-85751028aa9c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135014 Sep 08 11:02:14.860960 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2526/4956] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:02:15.029896 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-773e8c87-457a-4a2c-b049-9c10c19aa8ad tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:02:15.031133 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-773e8c87-457a-4a2c-b049-9c10c19aa8ad tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:02:15.057458 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-773e8c87-457a-4a2c-b049-9c10c19aa8ad tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:15.063763 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-773e8c87-457a-4a2c-b049-9c10c19aa8ad tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:15.068977 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-773e8c87-457a-4a2c-b049-9c10c19aa8ad tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:15.078557 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-773e8c87-457a-4a2c-b049-9c10c19aa8ad tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:15.079622 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-773e8c87-457a-4a2c-b049-9c10c19aa8ad tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:15.081442 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-773e8c87-457a-4a2c-b049-9c10c19aa8ad tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:15.176570 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-773e8c87-457a-4a2c-b049-9c10c19aa8ad tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:15.178095 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-773e8c87-457a-4a2c-b049-9c10c19aa8ad tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:15.178910 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-773e8c87-457a-4a2c-b049-9c10c19aa8ad tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:15.180971 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-773e8c87-457a-4a2c-b049-9c10c19aa8ad tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lazy-loading 'fault' on Instance uuid e81e0acc-0b96-4dbc-a5bb-89183f5204e7 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:02:15.301610 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-773e8c87-457a-4a2c-b049-9c10c19aa8ad tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68b017335c84d15becbdc7615498103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5d4706b2d43aca8290ccf07ee1ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:02:15.329117 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-773e8c87-457a-4a2c-b049-9c10c19aa8ad tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 200 len: 1328 microversion: 2.1 time: 0.301269 Sep 08 11:02:15.330495 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2431/4957] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:02:15 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 1328 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:02:16.364807 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-37c808fc-06fd-41bd-9c13-ad1e91704df1 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:02:16.365796 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-37c808fc-06fd-41bd-9c13-ad1e91704df1 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] [instance: e81e0acc-0b96-4dbc-a5bb-89183f5204e7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:02:16.387901 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-37c808fc-06fd-41bd-9c13-ad1e91704df1 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:16.389607 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-37c808fc-06fd-41bd-9c13-ad1e91704df1 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:16.390539 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-37c808fc-06fd-41bd-9c13-ad1e91704df1 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:16.391781 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-37c808fc-06fd-41bd-9c13-ad1e91704df1 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:16.393915 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-37c808fc-06fd-41bd-9c13-ad1e91704df1 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:16.395086 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-37c808fc-06fd-41bd-9c13-ad1e91704df1 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:16.416522 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-37c808fc-06fd-41bd-9c13-ad1e91704df1 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] HTTP exception thrown: Instance e81e0acc-0b96-4dbc-a5bb-89183f5204e7 could not be found. Sep 08 11:02:16.420701 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-37c808fc-06fd-41bd-9c13-ad1e91704df1 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Request method failure captured: Sep 08 11:02:16.420701 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 HTTP/1.1 Sep 08 11:02:16.420701 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:02:16.420701 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:02:16.420701 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:02:16.420701 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 11:02:16.420701 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:02:16.420701 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:02:16.420701 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:02:16.420701 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:02:16.420701 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGclESil0k3YwhrgmBq9RP58BT8ggCfoq71W7WWaQs79ajWV7VkDiBFW1SHjoqsRUYcZFA-S32MHtcVEuvCs9KDt4sUyYXYecQKP0Pc6KvZoCxHDx-TLBLeVMVKgTKTHMZY5fKwLa-YndhdHH_rmxBkRZ4MxFl9oZaWC-z8pqYA8SSe4 Sep 08 11:02:16.420701 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:02:16.420701 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:02:16.420701 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:02:16.420701 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:02:16.420701 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:02:16.420701 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:02:16.420701 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 11b5d4706b2d43aca8290ccf07ee1ece Sep 08 11:02:16.420701 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServerActionsTestJSON-1762930547 Sep 08 11:02:16.420701 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:02:16.420701 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:02:16.420701 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/11b5d4706b2d43aca8290ccf07ee1ece"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/11b5d4706b2d43aca8290ccf07ee1ece"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_11b5d4706b2d43aca8290ccf07ee1ece"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/11b5d4706b2d43aca8290ccf07ee1ece"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:02:16.420701 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServerActionsTestJSON-1762930547 Sep 08 11:02:16.420701 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 11b5d4706b2d43aca8290ccf07ee1ece Sep 08 11:02:16.420701 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServerActionsTestJSON-1762930547 Sep 08 11:02:16.420701 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServerActionsTestJSON-1762930547-project Sep 08 11:02:16.420701 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:02:16.420701 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:02:16.420701 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: d68b017335c84d15becbdc7615498103 Sep 08 11:02:16.420701 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServerActionsTestJSON-1762930547-project Sep 08 11:02:16.420701 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 11:02:16.420701 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance e81e0acc-0b96-4dbc-a5bb-89183f5204e7 could not be found. Sep 08 11:02:16.420701 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': 'e81e0acc-0b96-4dbc-a5bb-89183f5204e7'} Sep 08 11:02:16.420701 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:02:16.420701 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:02:16.420701 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:02:16.420701 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:02:16.420701 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:02:16.420701 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:02:16.420701 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:02:16.420701 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:02:16.420701 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:02:16.420701 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:02:16.420701 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e81e0acc-0b96-4dbc-a5bb-89183f5204e7 could not be found. Sep 08 11:02:16.420701 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:02:16.420701 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:02:16.420701 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:02:16.420701 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:02:16.420701 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:02:16.420701 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:02:16.420701 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:02:16.420701 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:02:16.420701 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:02:16.420701 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:02:16.420701 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:02:16.420701 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:02:16.420701 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:02:16.420701 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:02:16.420701 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:02:16.420701 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:02:16.420701 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e81e0acc-0b96-4dbc-a5bb-89183f5204e7 could not be found. Sep 08 11:02:16.420701 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:02:16.420701 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:02:16.420701 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:02:16.427851 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:02:16.427851 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:02:16.427851 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:02:16.427851 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:02:16.427851 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:02:16.427851 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e81e0acc-0b96-4dbc-a5bb-89183f5204e7 could not be found. Sep 08 11:02:16.427851 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:02:16.433455 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-37c808fc-06fd-41bd-9c13-ad1e91704df1 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Returning 404 to user: Instance e81e0acc-0b96-4dbc-a5bb-89183f5204e7 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:02:16.434683 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-37c808fc-06fd-41bd-9c13-ad1e91704df1 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7" status: 404 len: 111 microversion: 2.1 time: 0.076434 Sep 08 11:02:16.435868 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2527/4958] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:02:16 2022] GET /compute/v2.1/servers/e81e0acc-0b96-4dbc-a5bb-89183f5204e7 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:02:16.443892 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b83be025-a083-4a65-9e86-bb24c3c16764 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] Calling method '.version_select at 0x7f68e425cd30>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:02:16.486620 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b83be025-a083-4a65-9e86-bb24c3c16764 tempest-ServerActionsTestJSON-1762930547 tempest-ServerActionsTestJSON-1762930547-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1982550133" status: 202 len: 0 microversion: 2.1 time: 0.046548 Sep 08 11:02:16.489193 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2432/4959] 10.222.0.27 () {58 vars in 1221 bytes} [Thu Sep 8 11:02:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1982550133 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:02:26.386539 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:02:26.402626 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=11 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:02:26.459255 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-acf2f5e9-0575-4774-905a-c9fc2a9ac707 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-403380250", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "a965f728-92c3-4b06-822a-37d513a42280"}]}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:02:26.560595 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-acf2f5e9-0575-4774-905a-c9fc2a9ac707 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] validate_networks() for [('a965f728-92c3-4b06-822a-37d513a42280', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:02:28.226925 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-acf2f5e9-0575-4774-905a-c9fc2a9ac707 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:02:28.227512 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-acf2f5e9-0575-4774-905a-c9fc2a9ac707 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:02:28.228023 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-acf2f5e9-0575-4774-905a-c9fc2a9ac707 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:02:28.229203 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-acf2f5e9-0575-4774-905a-c9fc2a9ac707 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:02:28.230604 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-acf2f5e9-0575-4774-905a-c9fc2a9ac707 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:02:28.250215 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-acf2f5e9-0575-4774-905a-c9fc2a9ac707 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:28.251550 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-acf2f5e9-0575-4774-905a-c9fc2a9ac707 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:28.252308 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-acf2f5e9-0575-4774-905a-c9fc2a9ac707 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:28.261018 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-acf2f5e9-0575-4774-905a-c9fc2a9ac707 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:28.263070 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-acf2f5e9-0575-4774-905a-c9fc2a9ac707 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:28.270168 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-acf2f5e9-0575-4774-905a-c9fc2a9ac707 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:28.339740 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-acf2f5e9-0575-4774-905a-c9fc2a9ac707 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Getting quotas for project da2c943d597149fdbac4a8774ec2e077. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:02:28.358206 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-acf2f5e9-0575-4774-905a-c9fc2a9ac707 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Getting quotas for user 0bfefc448cdc4976b7a7b93ffceae60b and project da2c943d597149fdbac4a8774ec2e077. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:02:28.405969 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-acf2f5e9-0575-4774-905a-c9fc2a9ac707 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:02:28.411320 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-acf2f5e9-0575-4774-905a-c9fc2a9ac707 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] [instance: 929d11dd-2733-49aa-be5c-7cc5ad5fb564] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:02:28.549910 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-acf2f5e9-0575-4774-905a-c9fc2a9ac707 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.343172 Sep 08 11:02:28.559738 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2528/4960] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 11:02:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 2354 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:02:28.563646 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f660636b-2cf5-4f43-bfb7-d44fa1098dec tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:02:28.564273 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f660636b-2cf5-4f43-bfb7-d44fa1098dec tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] [instance: 929d11dd-2733-49aa-be5c-7cc5ad5fb564] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:02:28.595489 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=39 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:02:28.595489 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=22,nova_api:DELETE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:02:28.708365 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f660636b-2cf5-4f43-bfb7-d44fa1098dec tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfefc448cdc4976b7a7b93ffceae60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2c943d597149fdbac4a8774ec2e077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:02:28.717008 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f660636b-2cf5-4f43-bfb7-d44fa1098dec tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] 10.222.0.27 "GET /compute/v2.1/servers/929d11dd-2733-49aa-be5c-7cc5ad5fb564" status: 200 len: 1216 microversion: 2.1 time: 0.157228 Sep 08 11:02:28.736106 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2433/4961] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:02:28 2022] GET /compute/v2.1/servers/929d11dd-2733-49aa-be5c-7cc5ad5fb564 => generated 1216 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:02:29.748384 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ea6b94be-2dc6-45a4-bfce-8e95c5f87e68 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:02:29.750265 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ea6b94be-2dc6-45a4-bfce-8e95c5f87e68 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] [instance: 929d11dd-2733-49aa-be5c-7cc5ad5fb564] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:02:29.771858 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ea6b94be-2dc6-45a4-bfce-8e95c5f87e68 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:29.775262 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ea6b94be-2dc6-45a4-bfce-8e95c5f87e68 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:29.776202 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ea6b94be-2dc6-45a4-bfce-8e95c5f87e68 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:29.780340 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ea6b94be-2dc6-45a4-bfce-8e95c5f87e68 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:29.780340 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ea6b94be-2dc6-45a4-bfce-8e95c5f87e68 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:29.783468 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ea6b94be-2dc6-45a4-bfce-8e95c5f87e68 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:30.036595 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ea6b94be-2dc6-45a4-bfce-8e95c5f87e68 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfefc448cdc4976b7a7b93ffceae60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2c943d597149fdbac4a8774ec2e077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:02:30.064474 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ea6b94be-2dc6-45a4-bfce-8e95c5f87e68 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] 10.222.0.27 "GET /compute/v2.1/servers/929d11dd-2733-49aa-be5c-7cc5ad5fb564" status: 200 len: 1212 microversion: 2.1 time: 0.324338 Sep 08 11:02:30.089877 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2529/4962] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:02:29 2022] GET /compute/v2.1/servers/929d11dd-2733-49aa-be5c-7cc5ad5fb564 => generated 1212 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:02:30.479028 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ca645f24-8d1b-412e-b3a6-18bcc95cced8 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:02:30.479649 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ca645f24-8d1b-412e-b3a6-18bcc95cced8 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:02:30.491982 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ca645f24-8d1b-412e-b3a6-18bcc95cced8 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:30.492580 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ca645f24-8d1b-412e-b3a6-18bcc95cced8 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:30.493042 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ca645f24-8d1b-412e-b3a6-18bcc95cced8 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:30.493785 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ca645f24-8d1b-412e-b3a6-18bcc95cced8 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:30.497240 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ca645f24-8d1b-412e-b3a6-18bcc95cced8 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:30.497711 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ca645f24-8d1b-412e-b3a6-18bcc95cced8 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:31.098424 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5e2f810b-7468-4b2b-b37a-0a53625c42b4 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:02:31.099708 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5e2f810b-7468-4b2b-b37a-0a53625c42b4 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] [instance: 929d11dd-2733-49aa-be5c-7cc5ad5fb564] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:02:31.120500 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5e2f810b-7468-4b2b-b37a-0a53625c42b4 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:31.121013 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5e2f810b-7468-4b2b-b37a-0a53625c42b4 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:31.121476 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5e2f810b-7468-4b2b-b37a-0a53625c42b4 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:31.122202 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5e2f810b-7468-4b2b-b37a-0a53625c42b4 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:31.122660 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5e2f810b-7468-4b2b-b37a-0a53625c42b4 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:31.126132 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5e2f810b-7468-4b2b-b37a-0a53625c42b4 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:31.395098 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ca645f24-8d1b-412e-b3a6-18bcc95cced8 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:02:31.434607 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ca645f24-8d1b-412e-b3a6-18bcc95cced8 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:02:31.454534 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ca645f24-8d1b-412e-b3a6-18bcc95cced8 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:02:31.479605 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ca645f24-8d1b-412e-b3a6-18bcc95cced8 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 2951 microversion: 2.42 time: 1.004306 Sep 08 11:02:31.496070 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2434/4963] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:02:30 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 2951 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:02:31.501782 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5e2f810b-7468-4b2b-b37a-0a53625c42b4 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfefc448cdc4976b7a7b93ffceae60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2c943d597149fdbac4a8774ec2e077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:02:31.516472 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-78bf1db4-a14e-4fc0-8c83-ac8a967aed2d tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:02:31.517225 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-78bf1db4-a14e-4fc0-8c83-ac8a967aed2d tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:02:31.520989 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5e2f810b-7468-4b2b-b37a-0a53625c42b4 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] 10.222.0.27 "GET /compute/v2.1/servers/929d11dd-2733-49aa-be5c-7cc5ad5fb564" status: 200 len: 1274 microversion: 2.1 time: 0.427701 Sep 08 11:02:31.539227 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-78bf1db4-a14e-4fc0-8c83-ac8a967aed2d tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:31.540099 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-78bf1db4-a14e-4fc0-8c83-ac8a967aed2d tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:31.540675 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-78bf1db4-a14e-4fc0-8c83-ac8a967aed2d tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:31.541611 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-78bf1db4-a14e-4fc0-8c83-ac8a967aed2d tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:31.542081 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-78bf1db4-a14e-4fc0-8c83-ac8a967aed2d tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:31.542526 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-78bf1db4-a14e-4fc0-8c83-ac8a967aed2d tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:31.559439 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2530/4964] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:02:31 2022] GET /compute/v2.1/servers/929d11dd-2733-49aa-be5c-7cc5ad5fb564 => generated 1274 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:02:32.029433 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-78bf1db4-a14e-4fc0-8c83-ac8a967aed2d tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.518553 Sep 08 11:02:32.042147 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2435/4965] 10.222.0.27 () {60 vars in 1316 bytes} [Thu Sep 8 11:02:31 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59/os-interface => generated 1830 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:02:32.564080 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d962de4f-0a3c-48f6-9942-78bbaa957eba tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:02:32.564837 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d962de4f-0a3c-48f6-9942-78bbaa957eba tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] [instance: 929d11dd-2733-49aa-be5c-7cc5ad5fb564] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:02:32.592628 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d962de4f-0a3c-48f6-9942-78bbaa957eba tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:32.593772 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d962de4f-0a3c-48f6-9942-78bbaa957eba tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:32.596249 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d962de4f-0a3c-48f6-9942-78bbaa957eba tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:32.606718 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d962de4f-0a3c-48f6-9942-78bbaa957eba tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:32.607487 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d962de4f-0a3c-48f6-9942-78bbaa957eba tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:32.610132 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d962de4f-0a3c-48f6-9942-78bbaa957eba tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:33.237136 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d962de4f-0a3c-48f6-9942-78bbaa957eba tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfefc448cdc4976b7a7b93ffceae60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2c943d597149fdbac4a8774ec2e077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:02:33.250409 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d962de4f-0a3c-48f6-9942-78bbaa957eba tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] 10.222.0.27 "GET /compute/v2.1/servers/929d11dd-2733-49aa-be5c-7cc5ad5fb564" status: 200 len: 1316 microversion: 2.1 time: 0.685995 Sep 08 11:02:33.251100 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2531/4966] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:02:32 2022] GET /compute/v2.1/servers/929d11dd-2733-49aa-be5c-7cc5ad5fb564 => generated 1316 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:02:34.281093 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2c633804-a1d4-4689-a4b2-b90f0b73efcb tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:02:34.282279 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2c633804-a1d4-4689-a4b2-b90f0b73efcb tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] [instance: 929d11dd-2733-49aa-be5c-7cc5ad5fb564] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:02:34.289189 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2c633804-a1d4-4689-a4b2-b90f0b73efcb tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:34.290453 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2c633804-a1d4-4689-a4b2-b90f0b73efcb tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:34.290453 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2c633804-a1d4-4689-a4b2-b90f0b73efcb tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:34.290741 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2c633804-a1d4-4689-a4b2-b90f0b73efcb tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:34.291221 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2c633804-a1d4-4689-a4b2-b90f0b73efcb tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:34.297536 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2c633804-a1d4-4689-a4b2-b90f0b73efcb tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:34.895062 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2c633804-a1d4-4689-a4b2-b90f0b73efcb tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfefc448cdc4976b7a7b93ffceae60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2c943d597149fdbac4a8774ec2e077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:02:34.904265 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2c633804-a1d4-4689-a4b2-b90f0b73efcb tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] 10.222.0.27 "GET /compute/v2.1/servers/929d11dd-2733-49aa-be5c-7cc5ad5fb564" status: 200 len: 1316 microversion: 2.1 time: 0.632051 Sep 08 11:02:34.908758 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2436/4967] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:02:34 2022] GET /compute/v2.1/servers/929d11dd-2733-49aa-be5c-7cc5ad5fb564 => generated 1316 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:02:35.644010 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-b0ce29cf-dc34-48da-ba6c-86e94564c133 req-9db36574-2702-4e43-8247-78771dbab600 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "929d11dd-2733-49aa-be5c-7cc5ad5fb564", "tag": "da23a93c-d38c-43bd-97f5-c657936dfd24"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:02:35.668036 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-b0ce29cf-dc34-48da-ba6c-86e94564c133 req-9db36574-2702-4e43-8247-78771dbab600 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:35.669141 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-b0ce29cf-dc34-48da-ba6c-86e94564c133 req-9db36574-2702-4e43-8247-78771dbab600 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:35.669888 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-b0ce29cf-dc34-48da-ba6c-86e94564c133 req-9db36574-2702-4e43-8247-78771dbab600 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:35.690406 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-b0ce29cf-dc34-48da-ba6c-86e94564c133 req-9db36574-2702-4e43-8247-78771dbab600 service nova] Creating event network-changed:da23a93c-d38c-43bd-97f5-c657936dfd24 for instance 929d11dd-2733-49aa-be5c-7cc5ad5fb564 on n-h1-850501-12 Sep 08 11:02:35.697505 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-b0ce29cf-dc34-48da-ba6c-86e94564c133 req-9db36574-2702-4e43-8247-78771dbab600 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056604 Sep 08 11:02:35.698972 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2532/4968] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:02:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:02:35.931063 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7ae57934-7456-4635-a112-d06cb7cf114d tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:02:35.931740 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7ae57934-7456-4635-a112-d06cb7cf114d tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] [instance: 929d11dd-2733-49aa-be5c-7cc5ad5fb564] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:02:35.949758 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ae57934-7456-4635-a112-d06cb7cf114d tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:35.953855 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ae57934-7456-4635-a112-d06cb7cf114d tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:35.956733 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ae57934-7456-4635-a112-d06cb7cf114d tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:35.960247 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ae57934-7456-4635-a112-d06cb7cf114d tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:35.962281 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ae57934-7456-4635-a112-d06cb7cf114d tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:35.965279 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ae57934-7456-4635-a112-d06cb7cf114d tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:37.203615 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7ae57934-7456-4635-a112-d06cb7cf114d tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfefc448cdc4976b7a7b93ffceae60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2c943d597149fdbac4a8774ec2e077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:02:37.247242 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7ae57934-7456-4635-a112-d06cb7cf114d tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] 10.222.0.27 "GET /compute/v2.1/servers/929d11dd-2733-49aa-be5c-7cc5ad5fb564" status: 200 len: 1316 microversion: 2.1 time: 1.322392 Sep 08 11:02:37.269433 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2437/4969] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:02:35 2022] GET /compute/v2.1/servers/929d11dd-2733-49aa-be5c-7cc5ad5fb564 => generated 1316 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:02:38.278332 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d2fb5a29-c279-419a-a501-9010ad5445b8 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:02:38.279813 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d2fb5a29-c279-419a-a501-9010ad5445b8 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] [instance: 929d11dd-2733-49aa-be5c-7cc5ad5fb564] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:02:38.295289 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d2fb5a29-c279-419a-a501-9010ad5445b8 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:38.296040 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d2fb5a29-c279-419a-a501-9010ad5445b8 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:38.296887 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d2fb5a29-c279-419a-a501-9010ad5445b8 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:38.298071 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d2fb5a29-c279-419a-a501-9010ad5445b8 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:38.298737 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d2fb5a29-c279-419a-a501-9010ad5445b8 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:38.299360 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d2fb5a29-c279-419a-a501-9010ad5445b8 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:38.307046 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:02:38.387682 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=6 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:02:38.618384 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d2fb5a29-c279-419a-a501-9010ad5445b8 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfefc448cdc4976b7a7b93ffceae60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2c943d597149fdbac4a8774ec2e077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:02:38.629878 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d2fb5a29-c279-419a-a501-9010ad5445b8 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] 10.222.0.27 "GET /compute/v2.1/servers/929d11dd-2733-49aa-be5c-7cc5ad5fb564" status: 200 len: 1316 microversion: 2.1 time: 0.358663 Sep 08 11:02:38.630468 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2533/4970] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:02:38 2022] GET /compute/v2.1/servers/929d11dd-2733-49aa-be5c-7cc5ad5fb564 => generated 1316 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:02:39.366139 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:02:39.654838 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-dfb45bdc-b82c-4b34-8e1a-f669f812deb2 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:02:39.655643 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-dfb45bdc-b82c-4b34-8e1a-f669f812deb2 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] [instance: 929d11dd-2733-49aa-be5c-7cc5ad5fb564] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:02:39.668431 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dfb45bdc-b82c-4b34-8e1a-f669f812deb2 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:39.673079 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dfb45bdc-b82c-4b34-8e1a-f669f812deb2 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:39.673880 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dfb45bdc-b82c-4b34-8e1a-f669f812deb2 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:39.683197 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dfb45bdc-b82c-4b34-8e1a-f669f812deb2 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:39.684422 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dfb45bdc-b82c-4b34-8e1a-f669f812deb2 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:39.688697 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dfb45bdc-b82c-4b34-8e1a-f669f812deb2 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:40.032261 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-138c9ad2-fc50-45a1-bc62-57d8352800c9 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1584260876", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": "none"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:02:40.044409 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-dfb45bdc-b82c-4b34-8e1a-f669f812deb2 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfefc448cdc4976b7a7b93ffceae60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2c943d597149fdbac4a8774ec2e077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:02:40.057906 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-dfb45bdc-b82c-4b34-8e1a-f669f812deb2 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] 10.222.0.27 "GET /compute/v2.1/servers/929d11dd-2733-49aa-be5c-7cc5ad5fb564" status: 200 len: 1316 microversion: 2.1 time: 0.407524 Sep 08 11:02:40.064468 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2534/4971] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:02:39 2022] GET /compute/v2.1/servers/929d11dd-2733-49aa-be5c-7cc5ad5fb564 => generated 1316 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:02:40.143903 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-138c9ad2-fc50-45a1-bc62-57d8352800c9 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:02:40.144344 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-138c9ad2-fc50-45a1-bc62-57d8352800c9 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:02:40.144833 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-138c9ad2-fc50-45a1-bc62-57d8352800c9 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:02:40.145271 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-138c9ad2-fc50-45a1-bc62-57d8352800c9 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:02:40.145926 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-138c9ad2-fc50-45a1-bc62-57d8352800c9 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:02:40.169979 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-138c9ad2-fc50-45a1-bc62-57d8352800c9 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:40.170768 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-138c9ad2-fc50-45a1-bc62-57d8352800c9 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:40.171384 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-138c9ad2-fc50-45a1-bc62-57d8352800c9 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:40.172351 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-138c9ad2-fc50-45a1-bc62-57d8352800c9 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:40.173263 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-138c9ad2-fc50-45a1-bc62-57d8352800c9 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:40.179601 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-138c9ad2-fc50-45a1-bc62-57d8352800c9 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:40.216923 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-138c9ad2-fc50-45a1-bc62-57d8352800c9 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Getting quotas for project c77537c326a9416bab504adaa30f78ac. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:02:40.231121 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-138c9ad2-fc50-45a1-bc62-57d8352800c9 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Getting quotas for user da193a1f4c3f4d05ae748641564ffe63 and project c77537c326a9416bab504adaa30f78ac. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:02:40.271419 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-138c9ad2-fc50-45a1-bc62-57d8352800c9 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:02:40.276760 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-138c9ad2-fc50-45a1-bc62-57d8352800c9 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] [instance: 9b1a22ca-81fc-4d21-89c8-4e81e0eaf8a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:02:40.397067 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-138c9ad2-fc50-45a1-bc62-57d8352800c9 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 1.037670 Sep 08 11:02:40.397777 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2438/4972] 10.222.0.27 () {62 vars in 1188 bytes} [Thu Sep 8 11:02:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1039 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 08 11:02:40.409631 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8b5db6fa-5f0f-406a-b377-566261565c94 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:02:40.410591 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8b5db6fa-5f0f-406a-b377-566261565c94 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] [instance: 9b1a22ca-81fc-4d21-89c8-4e81e0eaf8a0] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:02:40.707990 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8b5db6fa-5f0f-406a-b377-566261565c94 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da193a1f4c3f4d05ae748641564ffe63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77537c326a9416bab504adaa30f78ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:02:40.718564 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8b5db6fa-5f0f-406a-b377-566261565c94 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da193a1f4c3f4d05ae748641564ffe63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77537c326a9416bab504adaa30f78ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:02:40.728339 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8b5db6fa-5f0f-406a-b377-566261565c94 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da193a1f4c3f4d05ae748641564ffe63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77537c326a9416bab504adaa30f78ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:02:40.732832 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8b5db6fa-5f0f-406a-b377-566261565c94 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] 10.222.0.27 "GET /compute/v2.1/servers/9b1a22ca-81fc-4d21-89c8-4e81e0eaf8a0" status: 200 len: 1281 microversion: 2.47 time: 0.327353 Sep 08 11:02:40.733305 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2535/4973] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:02:40 2022] GET /compute/v2.1/servers/9b1a22ca-81fc-4d21-89c8-4e81e0eaf8a0 => generated 1281 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:02:41.084166 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-19cb8ae2-8d56-4440-97b5-66849465f66c tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:02:41.086384 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-19cb8ae2-8d56-4440-97b5-66849465f66c tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] [instance: 929d11dd-2733-49aa-be5c-7cc5ad5fb564] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:02:41.102982 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-19cb8ae2-8d56-4440-97b5-66849465f66c tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:41.104653 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-19cb8ae2-8d56-4440-97b5-66849465f66c tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:41.105506 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-19cb8ae2-8d56-4440-97b5-66849465f66c tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:41.109114 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-19cb8ae2-8d56-4440-97b5-66849465f66c tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:41.111452 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-19cb8ae2-8d56-4440-97b5-66849465f66c tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:41.112094 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-19cb8ae2-8d56-4440-97b5-66849465f66c tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:41.433741 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-19cb8ae2-8d56-4440-97b5-66849465f66c tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfefc448cdc4976b7a7b93ffceae60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2c943d597149fdbac4a8774ec2e077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:02:41.444132 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-19cb8ae2-8d56-4440-97b5-66849465f66c tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] 10.222.0.27 "GET /compute/v2.1/servers/929d11dd-2733-49aa-be5c-7cc5ad5fb564" status: 200 len: 1316 microversion: 2.1 time: 0.363507 Sep 08 11:02:41.459662 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2439/4974] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:02:41 2022] GET /compute/v2.1/servers/929d11dd-2733-49aa-be5c-7cc5ad5fb564 => generated 1316 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:02:41.585393 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-4f680666-7ffe-46b7-a4a2-d364e45aa1b2 req-176652d7-63cd-451a-b959-30eb8601fe76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "929d11dd-2733-49aa-be5c-7cc5ad5fb564", "name": "network-vif-plugged", "status": "completed", "tag": "da23a93c-d38c-43bd-97f5-c657936dfd24"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:02:41.628188 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-4f680666-7ffe-46b7-a4a2-d364e45aa1b2 req-176652d7-63cd-451a-b959-30eb8601fe76 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:41.629099 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-4f680666-7ffe-46b7-a4a2-d364e45aa1b2 req-176652d7-63cd-451a-b959-30eb8601fe76 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:41.638387 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-4f680666-7ffe-46b7-a4a2-d364e45aa1b2 req-176652d7-63cd-451a-b959-30eb8601fe76 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:41.693090 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-4f680666-7ffe-46b7-a4a2-d364e45aa1b2 req-176652d7-63cd-451a-b959-30eb8601fe76 service nova] Creating event network-vif-plugged:da23a93c-d38c-43bd-97f5-c657936dfd24 for instance 929d11dd-2733-49aa-be5c-7cc5ad5fb564 on n-h1-850501-12 Sep 08 11:02:41.699978 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-4f680666-7ffe-46b7-a4a2-d364e45aa1b2 req-176652d7-63cd-451a-b959-30eb8601fe76 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.459920 Sep 08 11:02:41.701055 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2536/4975] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:02:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:02:41.767539 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1ca2924f-a55f-46c3-a60c-5b1778802c62 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:02:41.768070 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1ca2924f-a55f-46c3-a60c-5b1778802c62 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] [instance: 9b1a22ca-81fc-4d21-89c8-4e81e0eaf8a0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:02:41.781997 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ca2924f-a55f-46c3-a60c-5b1778802c62 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:41.789511 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ca2924f-a55f-46c3-a60c-5b1778802c62 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:41.790467 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ca2924f-a55f-46c3-a60c-5b1778802c62 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:41.801353 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ca2924f-a55f-46c3-a60c-5b1778802c62 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:41.802136 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ca2924f-a55f-46c3-a60c-5b1778802c62 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:41.802780 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ca2924f-a55f-46c3-a60c-5b1778802c62 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:42.191151 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1ca2924f-a55f-46c3-a60c-5b1778802c62 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da193a1f4c3f4d05ae748641564ffe63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77537c326a9416bab504adaa30f78ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:02:42.202951 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1ca2924f-a55f-46c3-a60c-5b1778802c62 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da193a1f4c3f4d05ae748641564ffe63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77537c326a9416bab504adaa30f78ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:02:42.212836 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1ca2924f-a55f-46c3-a60c-5b1778802c62 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da193a1f4c3f4d05ae748641564ffe63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77537c326a9416bab504adaa30f78ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:02:42.215037 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1ca2924f-a55f-46c3-a60c-5b1778802c62 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] 10.222.0.27 "GET /compute/v2.1/servers/9b1a22ca-81fc-4d21-89c8-4e81e0eaf8a0" status: 200 len: 1277 microversion: 2.47 time: 0.451827 Sep 08 11:02:42.217664 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2440/4976] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:02:41 2022] GET /compute/v2.1/servers/9b1a22ca-81fc-4d21-89c8-4e81e0eaf8a0 => generated 1277 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:02:42.495315 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3881d23d-0b52-45ac-b45d-17bf9bdeaca0 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:02:42.496078 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3881d23d-0b52-45ac-b45d-17bf9bdeaca0 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] [instance: 929d11dd-2733-49aa-be5c-7cc5ad5fb564] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:02:42.533875 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3881d23d-0b52-45ac-b45d-17bf9bdeaca0 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:42.534377 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3881d23d-0b52-45ac-b45d-17bf9bdeaca0 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:42.536210 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3881d23d-0b52-45ac-b45d-17bf9bdeaca0 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:42.548042 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3881d23d-0b52-45ac-b45d-17bf9bdeaca0 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:42.550091 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3881d23d-0b52-45ac-b45d-17bf9bdeaca0 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:42.554757 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3881d23d-0b52-45ac-b45d-17bf9bdeaca0 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:43.253665 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-174f5d3c-ee50-45de-b157-6e0c909eeac9 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:02:43.254284 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-174f5d3c-ee50-45de-b157-6e0c909eeac9 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] [instance: 9b1a22ca-81fc-4d21-89c8-4e81e0eaf8a0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:02:43.278680 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-174f5d3c-ee50-45de-b157-6e0c909eeac9 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:43.279678 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-174f5d3c-ee50-45de-b157-6e0c909eeac9 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:43.280348 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-174f5d3c-ee50-45de-b157-6e0c909eeac9 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:43.282978 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-174f5d3c-ee50-45de-b157-6e0c909eeac9 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:43.283705 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-174f5d3c-ee50-45de-b157-6e0c909eeac9 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:43.284464 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-174f5d3c-ee50-45de-b157-6e0c909eeac9 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:43.332427 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-3881d23d-0b52-45ac-b45d-17bf9bdeaca0 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfefc448cdc4976b7a7b93ffceae60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2c943d597149fdbac4a8774ec2e077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:02:43.341731 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3881d23d-0b52-45ac-b45d-17bf9bdeaca0 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] 10.222.0.27 "GET /compute/v2.1/servers/929d11dd-2733-49aa-be5c-7cc5ad5fb564" status: 200 len: 1316 microversion: 2.1 time: 0.860861 Sep 08 11:02:43.358479 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2537/4977] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:02:42 2022] GET /compute/v2.1/servers/929d11dd-2733-49aa-be5c-7cc5ad5fb564 => generated 1316 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:02:43.429768 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-174f5d3c-ee50-45de-b157-6e0c909eeac9 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da193a1f4c3f4d05ae748641564ffe63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77537c326a9416bab504adaa30f78ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:02:43.456741 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-174f5d3c-ee50-45de-b157-6e0c909eeac9 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da193a1f4c3f4d05ae748641564ffe63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77537c326a9416bab504adaa30f78ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:02:43.464351 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-174f5d3c-ee50-45de-b157-6e0c909eeac9 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da193a1f4c3f4d05ae748641564ffe63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77537c326a9416bab504adaa30f78ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:02:43.471525 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-174f5d3c-ee50-45de-b157-6e0c909eeac9 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] 10.222.0.27 "GET /compute/v2.1/servers/9b1a22ca-81fc-4d21-89c8-4e81e0eaf8a0" status: 200 len: 1339 microversion: 2.47 time: 0.223460 Sep 08 11:02:43.474307 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2441/4978] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:02:43 2022] GET /compute/v2.1/servers/9b1a22ca-81fc-4d21-89c8-4e81e0eaf8a0 => generated 1339 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:02:44.378282 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-88220a6b-c9f5-4595-88ce-21095241139c tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:02:44.379560 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-88220a6b-c9f5-4595-88ce-21095241139c tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] [instance: 929d11dd-2733-49aa-be5c-7cc5ad5fb564] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:02:44.394391 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88220a6b-c9f5-4595-88ce-21095241139c tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:44.399522 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88220a6b-c9f5-4595-88ce-21095241139c tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:44.400247 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88220a6b-c9f5-4595-88ce-21095241139c tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:44.402362 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88220a6b-c9f5-4595-88ce-21095241139c tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:44.404099 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88220a6b-c9f5-4595-88ce-21095241139c tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:44.404738 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88220a6b-c9f5-4595-88ce-21095241139c tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:44.498355 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6f706c6a-6428-4713-8106-55103be9fa2e tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:02:44.498981 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6f706c6a-6428-4713-8106-55103be9fa2e tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] [instance: 9b1a22ca-81fc-4d21-89c8-4e81e0eaf8a0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:02:44.515391 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f706c6a-6428-4713-8106-55103be9fa2e tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:44.515822 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f706c6a-6428-4713-8106-55103be9fa2e tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:44.516325 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f706c6a-6428-4713-8106-55103be9fa2e tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:44.519453 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f706c6a-6428-4713-8106-55103be9fa2e tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:44.520147 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f706c6a-6428-4713-8106-55103be9fa2e tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:44.520597 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f706c6a-6428-4713-8106-55103be9fa2e tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:44.714618 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6f706c6a-6428-4713-8106-55103be9fa2e tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da193a1f4c3f4d05ae748641564ffe63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77537c326a9416bab504adaa30f78ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:02:44.723361 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6f706c6a-6428-4713-8106-55103be9fa2e tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da193a1f4c3f4d05ae748641564ffe63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77537c326a9416bab504adaa30f78ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:02:44.726983 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6f706c6a-6428-4713-8106-55103be9fa2e tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da193a1f4c3f4d05ae748641564ffe63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77537c326a9416bab504adaa30f78ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:02:44.728342 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6f706c6a-6428-4713-8106-55103be9fa2e tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] 10.222.0.27 "GET /compute/v2.1/servers/9b1a22ca-81fc-4d21-89c8-4e81e0eaf8a0" status: 200 len: 1339 microversion: 2.47 time: 0.235297 Sep 08 11:02:44.729302 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2442/4979] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:02:44 2022] GET /compute/v2.1/servers/9b1a22ca-81fc-4d21-89c8-4e81e0eaf8a0 => generated 1339 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:02:44.885044 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-88220a6b-c9f5-4595-88ce-21095241139c tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfefc448cdc4976b7a7b93ffceae60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2c943d597149fdbac4a8774ec2e077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:02:44.898612 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-88220a6b-c9f5-4595-88ce-21095241139c tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] 10.222.0.27 "GET /compute/v2.1/servers/929d11dd-2733-49aa-be5c-7cc5ad5fb564" status: 200 len: 1506 microversion: 2.1 time: 0.525268 Sep 08 11:02:44.902444 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2538/4980] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:02:44 2022] GET /compute/v2.1/servers/929d11dd-2733-49aa-be5c-7cc5ad5fb564 => generated 1506 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:02:44.930890 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3cc9bac6-0fe4-4259-bba4-28578de7339e tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:02:44.931402 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3cc9bac6-0fe4-4259-bba4-28578de7339e tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] [instance: 929d11dd-2733-49aa-be5c-7cc5ad5fb564] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:02:44.940369 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3cc9bac6-0fe4-4259-bba4-28578de7339e tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:44.942112 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3cc9bac6-0fe4-4259-bba4-28578de7339e tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:44.942561 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3cc9bac6-0fe4-4259-bba4-28578de7339e tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:44.943287 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3cc9bac6-0fe4-4259-bba4-28578de7339e tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:44.944559 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3cc9bac6-0fe4-4259-bba4-28578de7339e tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:44.955988 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3cc9bac6-0fe4-4259-bba4-28578de7339e tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:44.984870 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3cc9bac6-0fe4-4259-bba4-28578de7339e tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] 10.222.0.27 "GET /compute/v2.1/servers/929d11dd-2733-49aa-be5c-7cc5ad5fb564/ips" status: 200 len: 110 microversion: 2.1 time: 0.060720 Sep 08 11:02:44.985590 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2443/4981] 10.222.0.27 () {58 vars in 1248 bytes} [Thu Sep 8 11:02:44 2022] GET /compute/v2.1/servers/929d11dd-2733-49aa-be5c-7cc5ad5fb564/ips => generated 110 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:02:44.999220 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ba0d8378-c6fa-43c3-9ac4-b43f7d90e9dd tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:02:44.999745 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ba0d8378-c6fa-43c3-9ac4-b43f7d90e9dd tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] [instance: 929d11dd-2733-49aa-be5c-7cc5ad5fb564] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:02:45.007362 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ba0d8378-c6fa-43c3-9ac4-b43f7d90e9dd tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:45.007862 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ba0d8378-c6fa-43c3-9ac4-b43f7d90e9dd tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:45.008310 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ba0d8378-c6fa-43c3-9ac4-b43f7d90e9dd tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:45.009662 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ba0d8378-c6fa-43c3-9ac4-b43f7d90e9dd tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:45.010139 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ba0d8378-c6fa-43c3-9ac4-b43f7d90e9dd tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:45.010572 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ba0d8378-c6fa-43c3-9ac4-b43f7d90e9dd tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:45.056443 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ba0d8378-c6fa-43c3-9ac4-b43f7d90e9dd tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] 10.222.0.27 "GET /compute/v2.1/servers/929d11dd-2733-49aa-be5c-7cc5ad5fb564/ips" status: 200 len: 110 microversion: 2.1 time: 0.061062 Sep 08 11:02:45.057418 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2539/4982] 10.222.0.27 () {58 vars in 1248 bytes} [Thu Sep 8 11:02:44 2022] GET /compute/v2.1/servers/929d11dd-2733-49aa-be5c-7cc5ad5fb564/ips => generated 110 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:02:45.069005 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0b1ef0c1-d9ed-46a3-84db-18fd1f5c3d40 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:02:45.069618 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0b1ef0c1-d9ed-46a3-84db-18fd1f5c3d40 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] [instance: 929d11dd-2733-49aa-be5c-7cc5ad5fb564] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:02:45.075997 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0b1ef0c1-d9ed-46a3-84db-18fd1f5c3d40 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:45.076753 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0b1ef0c1-d9ed-46a3-84db-18fd1f5c3d40 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:45.077451 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0b1ef0c1-d9ed-46a3-84db-18fd1f5c3d40 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:45.078177 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0b1ef0c1-d9ed-46a3-84db-18fd1f5c3d40 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:45.078636 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0b1ef0c1-d9ed-46a3-84db-18fd1f5c3d40 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:45.079277 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0b1ef0c1-d9ed-46a3-84db-18fd1f5c3d40 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:45.104747 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0b1ef0c1-d9ed-46a3-84db-18fd1f5c3d40 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] 10.222.0.27 "GET /compute/v2.1/servers/929d11dd-2733-49aa-be5c-7cc5ad5fb564/ips/tempest-ServerAddressesTestJSON-1460794759-network" status: 200 len: 95 microversion: 2.1 time: 0.040033 Sep 08 11:02:45.105401 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2444/4983] 10.222.0.27 () {58 vars in 1401 bytes} [Thu Sep 8 11:02:45 2022] GET /compute/v2.1/servers/929d11dd-2733-49aa-be5c-7cc5ad5fb564/ips/tempest-ServerAddressesTestJSON-1460794759-network => generated 95 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 11:02:45.118920 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9aeae68b-a015-426e-a91e-076ed13599f0 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:02:45.119595 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9aeae68b-a015-426e-a91e-076ed13599f0 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] [instance: 929d11dd-2733-49aa-be5c-7cc5ad5fb564] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:02:45.148058 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9aeae68b-a015-426e-a91e-076ed13599f0 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:45.148581 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9aeae68b-a015-426e-a91e-076ed13599f0 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:45.149041 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9aeae68b-a015-426e-a91e-076ed13599f0 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:45.150259 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9aeae68b-a015-426e-a91e-076ed13599f0 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:45.150848 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9aeae68b-a015-426e-a91e-076ed13599f0 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:45.151364 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9aeae68b-a015-426e-a91e-076ed13599f0 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:45.179733 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9aeae68b-a015-426e-a91e-076ed13599f0 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] [instance: 929d11dd-2733-49aa-be5c-7cc5ad5fb564] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:02:45.265878 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9aeae68b-a015-426e-a91e-076ed13599f0 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] 10.222.0.27 "DELETE /compute/v2.1/servers/929d11dd-2733-49aa-be5c-7cc5ad5fb564" status: 204 len: 0 microversion: 2.1 time: 0.150734 Sep 08 11:02:45.266725 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2540/4984] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:02:45 2022] DELETE /compute/v2.1/servers/929d11dd-2733-49aa-be5c-7cc5ad5fb564 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:02:45.287268 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-33b86324-c9f9-4eb7-a328-8cce4df50b54 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:02:45.290307 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-33b86324-c9f9-4eb7-a328-8cce4df50b54 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] [instance: 929d11dd-2733-49aa-be5c-7cc5ad5fb564] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:02:45.309207 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33b86324-c9f9-4eb7-a328-8cce4df50b54 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:45.310233 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33b86324-c9f9-4eb7-a328-8cce4df50b54 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:45.310961 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33b86324-c9f9-4eb7-a328-8cce4df50b54 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:45.314854 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33b86324-c9f9-4eb7-a328-8cce4df50b54 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:45.315795 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33b86324-c9f9-4eb7-a328-8cce4df50b54 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:45.316715 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33b86324-c9f9-4eb7-a328-8cce4df50b54 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:45.582695 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-33b86324-c9f9-4eb7-a328-8cce4df50b54 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfefc448cdc4976b7a7b93ffceae60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2c943d597149fdbac4a8774ec2e077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:02:45.601576 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-33b86324-c9f9-4eb7-a328-8cce4df50b54 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] 10.222.0.27 "GET /compute/v2.1/servers/929d11dd-2733-49aa-be5c-7cc5ad5fb564" status: 200 len: 1512 microversion: 2.1 time: 0.328550 Sep 08 11:02:45.603271 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2445/4985] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:02:45 2022] GET /compute/v2.1/servers/929d11dd-2733-49aa-be5c-7cc5ad5fb564 => generated 1512 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:02:45.765953 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-73036109-e565-4061-8c6d-60168b8d7794 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:02:45.774938 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-73036109-e565-4061-8c6d-60168b8d7794 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] [instance: 9b1a22ca-81fc-4d21-89c8-4e81e0eaf8a0] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:02:45.812142 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-73036109-e565-4061-8c6d-60168b8d7794 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:45.812812 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-73036109-e565-4061-8c6d-60168b8d7794 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:45.814409 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-73036109-e565-4061-8c6d-60168b8d7794 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:45.816637 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-73036109-e565-4061-8c6d-60168b8d7794 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:45.819710 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-73036109-e565-4061-8c6d-60168b8d7794 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:45.821364 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-73036109-e565-4061-8c6d-60168b8d7794 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:45.961301 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-73036109-e565-4061-8c6d-60168b8d7794 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da193a1f4c3f4d05ae748641564ffe63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77537c326a9416bab504adaa30f78ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:02:45.973018 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-73036109-e565-4061-8c6d-60168b8d7794 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da193a1f4c3f4d05ae748641564ffe63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77537c326a9416bab504adaa30f78ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:02:45.975564 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-73036109-e565-4061-8c6d-60168b8d7794 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da193a1f4c3f4d05ae748641564ffe63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77537c326a9416bab504adaa30f78ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:02:45.976869 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-73036109-e565-4061-8c6d-60168b8d7794 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] 10.222.0.27 "GET /compute/v2.1/servers/9b1a22ca-81fc-4d21-89c8-4e81e0eaf8a0" status: 200 len: 1360 microversion: 2.47 time: 0.219050 Sep 08 11:02:45.978134 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2541/4986] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:02:45 2022] GET /compute/v2.1/servers/9b1a22ca-81fc-4d21-89c8-4e81e0eaf8a0 => generated 1360 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 11:02:46.008785 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-33749f5e-e1b8-40f5-876a-ff5dd8a5167f tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-549928143"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:02:46.012325 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-33749f5e-e1b8-40f5-876a-ff5dd8a5167f tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] [instance: 9b1a22ca-81fc-4d21-89c8-4e81e0eaf8a0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:02:46.019129 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33749f5e-e1b8-40f5-876a-ff5dd8a5167f tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:46.019978 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33749f5e-e1b8-40f5-876a-ff5dd8a5167f tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:46.020626 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33749f5e-e1b8-40f5-876a-ff5dd8a5167f tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:46.033309 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33749f5e-e1b8-40f5-876a-ff5dd8a5167f tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:46.034329 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33749f5e-e1b8-40f5-876a-ff5dd8a5167f tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:46.034856 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33749f5e-e1b8-40f5-876a-ff5dd8a5167f tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:46.452891 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-33749f5e-e1b8-40f5-876a-ff5dd8a5167f tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] 10.222.0.27 "POST /compute/v2.1/servers/9b1a22ca-81fc-4d21-89c8-4e81e0eaf8a0/action" status: 202 len: 52 microversion: 2.47 time: 0.448373 Sep 08 11:02:46.477765 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d9e8f00d-91b4-4696-b062-d52d2df48e90 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:02:46.478380 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d9e8f00d-91b4-4696-b062-d52d2df48e90 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] [instance: 9b1a22ca-81fc-4d21-89c8-4e81e0eaf8a0] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:02:46.486103 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2446/4987] 10.222.0.27 () {62 vars in 1319 bytes} [Thu Sep 8 11:02:46 2022] POST /compute/v2.1/servers/9b1a22ca-81fc-4d21-89c8-4e81e0eaf8a0/action => generated 52 bytes in 483 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Sep 08 11:02:46.504739 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d9e8f00d-91b4-4696-b062-d52d2df48e90 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:46.508924 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d9e8f00d-91b4-4696-b062-d52d2df48e90 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:46.512522 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d9e8f00d-91b4-4696-b062-d52d2df48e90 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:46.513372 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d9e8f00d-91b4-4696-b062-d52d2df48e90 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:46.518364 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d9e8f00d-91b4-4696-b062-d52d2df48e90 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:46.519239 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d9e8f00d-91b4-4696-b062-d52d2df48e90 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:46.558783 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d9e8f00d-91b4-4696-b062-d52d2df48e90 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] [instance: 9b1a22ca-81fc-4d21-89c8-4e81e0eaf8a0] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:02:46.641843 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d62ca3e8-fa7b-450f-baf5-55b8bcd8537b tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:02:46.642680 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d62ca3e8-fa7b-450f-baf5-55b8bcd8537b tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] [instance: 929d11dd-2733-49aa-be5c-7cc5ad5fb564] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:02:46.660435 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d62ca3e8-fa7b-450f-baf5-55b8bcd8537b tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:46.660944 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d62ca3e8-fa7b-450f-baf5-55b8bcd8537b tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:46.661427 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d62ca3e8-fa7b-450f-baf5-55b8bcd8537b tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:46.662828 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d62ca3e8-fa7b-450f-baf5-55b8bcd8537b tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:46.663686 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d62ca3e8-fa7b-450f-baf5-55b8bcd8537b tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:46.664275 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d62ca3e8-fa7b-450f-baf5-55b8bcd8537b tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:46.768202 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d9e8f00d-91b4-4696-b062-d52d2df48e90 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9b1a22ca-81fc-4d21-89c8-4e81e0eaf8a0" status: 204 len: 0 microversion: 2.47 time: 0.303046 Sep 08 11:02:46.774229 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2542/4988] 10.222.0.27 () {60 vars in 1280 bytes} [Thu Sep 8 11:02:46 2022] DELETE /compute/v2.1/servers/9b1a22ca-81fc-4d21-89c8-4e81e0eaf8a0 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 11:02:46.817912 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3ad42e8b-86e7-42a0-8774-42d82da8143f tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:02:46.820899 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3ad42e8b-86e7-42a0-8774-42d82da8143f tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] [instance: 9b1a22ca-81fc-4d21-89c8-4e81e0eaf8a0] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:02:46.840980 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3ad42e8b-86e7-42a0-8774-42d82da8143f tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:46.841571 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3ad42e8b-86e7-42a0-8774-42d82da8143f tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:46.842053 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3ad42e8b-86e7-42a0-8774-42d82da8143f tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:46.842742 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3ad42e8b-86e7-42a0-8774-42d82da8143f tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:46.849865 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3ad42e8b-86e7-42a0-8774-42d82da8143f tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:46.851248 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3ad42e8b-86e7-42a0-8774-42d82da8143f tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:46.993644 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-3ad42e8b-86e7-42a0-8774-42d82da8143f tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da193a1f4c3f4d05ae748641564ffe63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77537c326a9416bab504adaa30f78ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:02:47.004663 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-3ad42e8b-86e7-42a0-8774-42d82da8143f tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da193a1f4c3f4d05ae748641564ffe63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77537c326a9416bab504adaa30f78ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:02:47.008275 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-3ad42e8b-86e7-42a0-8774-42d82da8143f tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da193a1f4c3f4d05ae748641564ffe63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77537c326a9416bab504adaa30f78ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:02:47.011451 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3ad42e8b-86e7-42a0-8774-42d82da8143f tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] 10.222.0.27 "GET /compute/v2.1/servers/9b1a22ca-81fc-4d21-89c8-4e81e0eaf8a0" status: 200 len: 1366 microversion: 2.47 time: 0.230464 Sep 08 11:02:47.013911 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2543/4989] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:02:46 2022] GET /compute/v2.1/servers/9b1a22ca-81fc-4d21-89c8-4e81e0eaf8a0 => generated 1366 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:02:47.252508 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d62ca3e8-fa7b-450f-baf5-55b8bcd8537b tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfefc448cdc4976b7a7b93ffceae60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2c943d597149fdbac4a8774ec2e077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:02:47.261945 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d62ca3e8-fa7b-450f-baf5-55b8bcd8537b tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] 10.222.0.27 "GET /compute/v2.1/servers/929d11dd-2733-49aa-be5c-7cc5ad5fb564" status: 200 len: 1512 microversion: 2.1 time: 0.628733 Sep 08 11:02:47.265793 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2447/4990] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:02:46 2022] GET /compute/v2.1/servers/929d11dd-2733-49aa-be5c-7cc5ad5fb564 => generated 1512 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:02:48.040891 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-44a4dda0-83cc-43c9-bd3e-89e7834b4599 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:02:48.041701 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-44a4dda0-83cc-43c9-bd3e-89e7834b4599 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] [instance: 9b1a22ca-81fc-4d21-89c8-4e81e0eaf8a0] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:02:48.061735 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-44a4dda0-83cc-43c9-bd3e-89e7834b4599 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:48.062673 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-44a4dda0-83cc-43c9-bd3e-89e7834b4599 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:48.063378 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-44a4dda0-83cc-43c9-bd3e-89e7834b4599 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:48.064505 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-44a4dda0-83cc-43c9-bd3e-89e7834b4599 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:48.066532 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-44a4dda0-83cc-43c9-bd3e-89e7834b4599 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:48.067082 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-44a4dda0-83cc-43c9-bd3e-89e7834b4599 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:48.107560 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:02:48.192726 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-44a4dda0-83cc-43c9-bd3e-89e7834b4599 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da193a1f4c3f4d05ae748641564ffe63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77537c326a9416bab504adaa30f78ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:02:48.211305 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-44a4dda0-83cc-43c9-bd3e-89e7834b4599 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da193a1f4c3f4d05ae748641564ffe63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77537c326a9416bab504adaa30f78ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:02:48.212948 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-44a4dda0-83cc-43c9-bd3e-89e7834b4599 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da193a1f4c3f4d05ae748641564ffe63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77537c326a9416bab504adaa30f78ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:02:48.214276 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-44a4dda0-83cc-43c9-bd3e-89e7834b4599 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] 10.222.0.27 "GET /compute/v2.1/servers/9b1a22ca-81fc-4d21-89c8-4e81e0eaf8a0" status: 200 len: 1366 microversion: 2.47 time: 0.178147 Sep 08 11:02:48.218488 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2544/4991] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:02:48 2022] GET /compute/v2.1/servers/9b1a22ca-81fc-4d21-89c8-4e81e0eaf8a0 => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:02:48.291996 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-524836ad-e4ef-4146-b24b-7f8073da1186 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:02:48.292710 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-524836ad-e4ef-4146-b24b-7f8073da1186 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] [instance: 929d11dd-2733-49aa-be5c-7cc5ad5fb564] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:02:48.308634 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-524836ad-e4ef-4146-b24b-7f8073da1186 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:48.309278 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-524836ad-e4ef-4146-b24b-7f8073da1186 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:48.309802 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-524836ad-e4ef-4146-b24b-7f8073da1186 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:48.313267 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-524836ad-e4ef-4146-b24b-7f8073da1186 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:48.313999 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-524836ad-e4ef-4146-b24b-7f8073da1186 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:48.315160 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-524836ad-e4ef-4146-b24b-7f8073da1186 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:48.595409 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-524836ad-e4ef-4146-b24b-7f8073da1186 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfefc448cdc4976b7a7b93ffceae60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2c943d597149fdbac4a8774ec2e077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:02:48.604892 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-524836ad-e4ef-4146-b24b-7f8073da1186 tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] 10.222.0.27 "GET /compute/v2.1/servers/929d11dd-2733-49aa-be5c-7cc5ad5fb564" status: 200 len: 1470 microversion: 2.1 time: 0.317457 Sep 08 11:02:48.631432 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2448/4992] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:02:48 2022] GET /compute/v2.1/servers/929d11dd-2733-49aa-be5c-7cc5ad5fb564 => generated 1470 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:02:48.809615 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-f8173ac7-296b-4699-a807-55c4cb62273e req-10298cc8-1753-48ab-bd58-70aa0d4c9fce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "929d11dd-2733-49aa-be5c-7cc5ad5fb564", "name": "network-vif-deleted", "tag": "da23a93c-d38c-43bd-97f5-c657936dfd24"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:02:48.839422 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-f8173ac7-296b-4699-a807-55c4cb62273e req-10298cc8-1753-48ab-bd58-70aa0d4c9fce service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:48.840830 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-f8173ac7-296b-4699-a807-55c4cb62273e req-10298cc8-1753-48ab-bd58-70aa0d4c9fce service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:48.843992 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-f8173ac7-296b-4699-a807-55c4cb62273e req-10298cc8-1753-48ab-bd58-70aa0d4c9fce service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:48.878050 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-f8173ac7-296b-4699-a807-55c4cb62273e req-10298cc8-1753-48ab-bd58-70aa0d4c9fce service nova] Creating event network-vif-deleted:da23a93c-d38c-43bd-97f5-c657936dfd24 for instance 929d11dd-2733-49aa-be5c-7cc5ad5fb564 on n-h1-850501-12 Sep 08 11:02:48.902653 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-f8173ac7-296b-4699-a807-55c4cb62273e req-10298cc8-1753-48ab-bd58-70aa0d4c9fce service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.529083 Sep 08 11:02:48.908926 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2545/4993] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:02:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:02:49.253882 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1efe24ba-3059-4a9a-9347-94fd78773df5 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:02:49.254823 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1efe24ba-3059-4a9a-9347-94fd78773df5 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] [instance: 9b1a22ca-81fc-4d21-89c8-4e81e0eaf8a0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:02:49.267045 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1efe24ba-3059-4a9a-9347-94fd78773df5 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:49.285601 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1efe24ba-3059-4a9a-9347-94fd78773df5 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:49.286387 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1efe24ba-3059-4a9a-9347-94fd78773df5 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:49.293235 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1efe24ba-3059-4a9a-9347-94fd78773df5 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:49.294772 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1efe24ba-3059-4a9a-9347-94fd78773df5 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:49.295428 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1efe24ba-3059-4a9a-9347-94fd78773df5 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:49.582872 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1efe24ba-3059-4a9a-9347-94fd78773df5 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da193a1f4c3f4d05ae748641564ffe63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77537c326a9416bab504adaa30f78ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:02:49.600880 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1efe24ba-3059-4a9a-9347-94fd78773df5 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da193a1f4c3f4d05ae748641564ffe63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77537c326a9416bab504adaa30f78ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:02:49.602410 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1efe24ba-3059-4a9a-9347-94fd78773df5 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da193a1f4c3f4d05ae748641564ffe63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77537c326a9416bab504adaa30f78ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:02:49.603624 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1efe24ba-3059-4a9a-9347-94fd78773df5 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] 10.222.0.27 "GET /compute/v2.1/servers/9b1a22ca-81fc-4d21-89c8-4e81e0eaf8a0" status: 200 len: 1366 microversion: 2.47 time: 0.359929 Sep 08 11:02:49.610945 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2449/4994] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:02:49 2022] GET /compute/v2.1/servers/9b1a22ca-81fc-4d21-89c8-4e81e0eaf8a0 => generated 1366 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:02:49.638681 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-28e18f27-6085-4e02-949c-3e4dc722ad3a tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:02:49.640583 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-28e18f27-6085-4e02-949c-3e4dc722ad3a tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] [instance: 929d11dd-2733-49aa-be5c-7cc5ad5fb564] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:02:49.663879 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-28e18f27-6085-4e02-949c-3e4dc722ad3a tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:49.665679 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-28e18f27-6085-4e02-949c-3e4dc722ad3a tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:49.666400 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-28e18f27-6085-4e02-949c-3e4dc722ad3a tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:49.668759 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-28e18f27-6085-4e02-949c-3e4dc722ad3a tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:49.669400 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-28e18f27-6085-4e02-949c-3e4dc722ad3a tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:49.671046 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-28e18f27-6085-4e02-949c-3e4dc722ad3a tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:49.692032 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-28e18f27-6085-4e02-949c-3e4dc722ad3a tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] HTTP exception thrown: Instance 929d11dd-2733-49aa-be5c-7cc5ad5fb564 could not be found. Sep 08 11:02:49.694886 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-28e18f27-6085-4e02-949c-3e4dc722ad3a tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Request method failure captured: Sep 08 11:02:49.694886 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/929d11dd-2733-49aa-be5c-7cc5ad5fb564 HTTP/1.1 Sep 08 11:02:49.694886 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:02:49.694886 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:02:49.694886 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:02:49.694886 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 11:02:49.694886 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:02:49.694886 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:02:49.694886 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:02:49.694886 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:02:49.694886 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcvBHTu-zM0ZJYJw18BL4iozZ9YPdpVLerTqEpVIXzE2irzoi_EB-gaqcEaax2ZE-IOgkDLM-EPdu5Qi6P_v6KD498UxrVaMdKBoWvAHBkg-aGILsLgV9GAogpndTTldmrHpwMv-ITSUp6IjK_hkacc3_0rPg9yVkTjJ96_wfnR-PDg Sep 08 11:02:49.694886 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:02:49.694886 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:02:49.694886 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:02:49.694886 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:02:49.694886 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:02:49.694886 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:02:49.694886 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: da2c943d597149fdbac4a8774ec2e077 Sep 08 11:02:49.694886 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServerAddressesTestJSON-2120576824 Sep 08 11:02:49.694886 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:02:49.694886 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:02:49.694886 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/da2c943d597149fdbac4a8774ec2e077"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da2c943d597149fdbac4a8774ec2e077"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_da2c943d597149fdbac4a8774ec2e077"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da2c943d597149fdbac4a8774ec2e077"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:02:49.694886 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServerAddressesTestJSON-2120576824 Sep 08 11:02:49.694886 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: da2c943d597149fdbac4a8774ec2e077 Sep 08 11:02:49.694886 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServerAddressesTestJSON-2120576824 Sep 08 11:02:49.694886 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServerAddressesTestJSON-2120576824-project Sep 08 11:02:49.694886 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:02:49.694886 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:02:49.694886 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 0bfefc448cdc4976b7a7b93ffceae60b Sep 08 11:02:49.694886 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServerAddressesTestJSON-2120576824-project Sep 08 11:02:49.694886 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 11:02:49.694886 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 929d11dd-2733-49aa-be5c-7cc5ad5fb564 could not be found. Sep 08 11:02:49.694886 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '929d11dd-2733-49aa-be5c-7cc5ad5fb564'} Sep 08 11:02:49.694886 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:02:49.694886 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:02:49.694886 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:02:49.694886 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:02:49.694886 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:02:49.694886 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:02:49.694886 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:02:49.694886 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:02:49.694886 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:02:49.694886 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:02:49.694886 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 929d11dd-2733-49aa-be5c-7cc5ad5fb564 could not be found. Sep 08 11:02:49.694886 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:02:49.694886 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:02:49.694886 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:02:49.694886 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:02:49.694886 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:02:49.694886 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:02:49.694886 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:02:49.694886 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:02:49.694886 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:02:49.694886 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:02:49.694886 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:02:49.694886 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:02:49.694886 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:02:49.694886 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:02:49.694886 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:02:49.694886 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:02:49.694886 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 929d11dd-2733-49aa-be5c-7cc5ad5fb564 could not be found. Sep 08 11:02:49.694886 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:02:49.694886 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:02:49.694886 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:02:49.700915 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:02:49.700915 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:02:49.700915 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:02:49.700915 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:02:49.700915 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:02:49.700915 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 929d11dd-2733-49aa-be5c-7cc5ad5fb564 could not be found. Sep 08 11:02:49.700915 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:02:49.703766 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-28e18f27-6085-4e02-949c-3e4dc722ad3a tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] Returning 404 to user: Instance 929d11dd-2733-49aa-be5c-7cc5ad5fb564 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:02:49.704872 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-28e18f27-6085-4e02-949c-3e4dc722ad3a tempest-ServerAddressesTestJSON-2120576824 tempest-ServerAddressesTestJSON-2120576824-project] 10.222.0.27 "GET /compute/v2.1/servers/929d11dd-2733-49aa-be5c-7cc5ad5fb564" status: 404 len: 111 microversion: 2.1 time: 0.072829 Sep 08 11:02:49.705698 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2546/4995] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:02:49 2022] GET /compute/v2.1/servers/929d11dd-2733-49aa-be5c-7cc5ad5fb564 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:02:50.631378 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4b1f5dcf-2ed5-42d9-bd1c-d8945cb6abe5 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:02:50.632006 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4b1f5dcf-2ed5-42d9-bd1c-d8945cb6abe5 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] [instance: 9b1a22ca-81fc-4d21-89c8-4e81e0eaf8a0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:02:50.634304 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:02:50.635168 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:02:50.653618 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4b1f5dcf-2ed5-42d9-bd1c-d8945cb6abe5 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:50.654431 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4b1f5dcf-2ed5-42d9-bd1c-d8945cb6abe5 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:50.655052 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4b1f5dcf-2ed5-42d9-bd1c-d8945cb6abe5 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:50.655953 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4b1f5dcf-2ed5-42d9-bd1c-d8945cb6abe5 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:50.656590 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4b1f5dcf-2ed5-42d9-bd1c-d8945cb6abe5 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:50.657236 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4b1f5dcf-2ed5-42d9-bd1c-d8945cb6abe5 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:50.691437 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-4b1f5dcf-2ed5-42d9-bd1c-d8945cb6abe5 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] HTTP exception thrown: Instance 9b1a22ca-81fc-4d21-89c8-4e81e0eaf8a0 could not be found. Sep 08 11:02:50.693752 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4b1f5dcf-2ed5-42d9-bd1c-d8945cb6abe5 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Request method failure captured: Sep 08 11:02:50.693752 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/9b1a22ca-81fc-4d21-89c8-4e81e0eaf8a0 HTTP/1.1 Sep 08 11:02:50.693752 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 11:02:50.693752 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 11:02:50.693752 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 11:02:50.693752 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 11:02:50.693752 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 11:02:50.693752 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 11:02:50.693752 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 11:02:50.693752 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 11:02:50.693752 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcvOeMhtmBPzq_A5Sf79lHRUdMBbKxBg-ECZrOZkfz6pp7TFQhuMYL_IEwkn1nDrhtpTSVh43uoO1RgMjDQyjxFMfz-pVTTCzKJW8AKy4lWzGk4F4tu7xzuIDIpSO9sB6lnwKpkGO1KestWeKh43-zv18BMBefh0uLypO1v53SbBACY Sep 08 11:02:50.693752 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 11:02:50.693752 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 11:02:50.693752 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 11:02:50.693752 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 11:02:50.693752 n-d-850501-12 devstack@n-api.service[128862]: X-Openstack-Nova-Api-Version: 2.47 Sep 08 11:02:50.693752 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 11:02:50.693752 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 11:02:50.693752 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: c77537c326a9416bab504adaa30f78ac Sep 08 11:02:50.693752 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersAaction247Test-308806571 Sep 08 11:02:50.693752 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 11:02:50.693752 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 11:02:50.693752 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c77537c326a9416bab504adaa30f78ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c77537c326a9416bab504adaa30f78ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c77537c326a9416bab504adaa30f78ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c77537c326a9416bab504adaa30f78ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:02:50.693752 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServersAaction247Test-308806571 Sep 08 11:02:50.693752 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: c77537c326a9416bab504adaa30f78ac Sep 08 11:02:50.693752 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersAaction247Test-308806571 Sep 08 11:02:50.693752 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServersAaction247Test-308806571-project Sep 08 11:02:50.693752 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 11:02:50.693752 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 11:02:50.693752 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: da193a1f4c3f4d05ae748641564ffe63 Sep 08 11:02:50.693752 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServersAaction247Test-308806571-project Sep 08 11:02:50.693752 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 11:02:50.693752 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 9b1a22ca-81fc-4d21-89c8-4e81e0eaf8a0 could not be found. Sep 08 11:02:50.693752 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '9b1a22ca-81fc-4d21-89c8-4e81e0eaf8a0'} Sep 08 11:02:50.693752 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:02:50.693752 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:02:50.693752 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:02:50.693752 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:02:50.693752 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:02:50.693752 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:02:50.693752 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:02:50.693752 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:02:50.693752 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:02:50.693752 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:02:50.693752 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b1a22ca-81fc-4d21-89c8-4e81e0eaf8a0 could not be found. Sep 08 11:02:50.693752 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:02:50.693752 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:02:50.693752 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:02:50.693752 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:02:50.693752 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:02:50.693752 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:02:50.693752 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:02:50.693752 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:02:50.693752 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:02:50.693752 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:02:50.693752 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:02:50.693752 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:02:50.693752 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:02:50.693752 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:02:50.693752 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:02:50.693752 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:02:50.693752 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b1a22ca-81fc-4d21-89c8-4e81e0eaf8a0 could not be found. Sep 08 11:02:50.693752 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:02:50.693752 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:02:50.693752 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:02:50.699176 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:02:50.699176 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:02:50.699176 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:02:50.699176 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:02:50.699176 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:02:50.699176 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b1a22ca-81fc-4d21-89c8-4e81e0eaf8a0 could not be found. Sep 08 11:02:50.699176 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:02:50.701275 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4b1f5dcf-2ed5-42d9-bd1c-d8945cb6abe5 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] Returning 404 to user: Instance 9b1a22ca-81fc-4d21-89c8-4e81e0eaf8a0 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:02:50.708210 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4b1f5dcf-2ed5-42d9-bd1c-d8945cb6abe5 tempest-ServersAaction247Test-308806571 tempest-ServersAaction247Test-308806571-project] 10.222.0.27 "GET /compute/v2.1/servers/9b1a22ca-81fc-4d21-89c8-4e81e0eaf8a0" status: 404 len: 111 microversion: 2.47 time: 0.081517 Sep 08 11:02:50.709541 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2450/4996] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:02:50 2022] GET /compute/v2.1/servers/9b1a22ca-81fc-4d21-89c8-4e81e0eaf8a0 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 11:03:21.271683 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:03:21.272778 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:03:21.273623 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=6 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:03:21.835113 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b412be67-e339-4c3d-9dca-2ac59b7f4b80 tempest-ServerGroup264TestJSON-1656077950 tempest-ServerGroup264TestJSON-1656077950-project] Action: 'create', calling method: .version_select at 0x7f68e89bfd30>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:03:21.907033 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-b412be67-e339-4c3d-9dca-2ac59b7f4b80 tempest-ServerGroup264TestJSON-1656077950 tempest-ServerGroup264TestJSON-1656077950-project] Getting quotas for project 661eab8a527d42db8f6e9855b31c384f. Resources: {'server_groups'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:03:21.922567 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-b412be67-e339-4c3d-9dca-2ac59b7f4b80 tempest-ServerGroup264TestJSON-1656077950 tempest-ServerGroup264TestJSON-1656077950-project] Getting quotas for user 06e29282853a4aa4a2902f538998b2c3 and project 661eab8a527d42db8f6e9855b31c384f. Resources: {'server_groups'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:03:22.102873 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-b412be67-e339-4c3d-9dca-2ac59b7f4b80 tempest-ServerGroup264TestJSON-1656077950 tempest-ServerGroup264TestJSON-1656077950-project] Getting quotas for project 661eab8a527d42db8f6e9855b31c384f. Resources: {'server_groups'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:03:22.111250 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-b412be67-e339-4c3d-9dca-2ac59b7f4b80 tempest-ServerGroup264TestJSON-1656077950 tempest-ServerGroup264TestJSON-1656077950-project] Getting quotas for user 06e29282853a4aa4a2902f538998b2c3 and project 661eab8a527d42db8f6e9855b31c384f. Resources: {'server_groups'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:03:22.167844 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b412be67-e339-4c3d-9dca-2ac59b7f4b80 tempest-ServerGroup264TestJSON-1656077950 tempest-ServerGroup264TestJSON-1656077950-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.901904 Sep 08 11:03:22.179907 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2632cabe-2857-4193-8771-1eacabfc730d tempest-ServerGroup264TestJSON-1656077950 tempest-ServerGroup264TestJSON-1656077950-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:03:22.193959 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2547/4997] 10.222.0.27 () {62 vars in 1214 bytes} [Thu Sep 8 11:03:21 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 11:03:22.203867 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:03:22.204699 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:03:22.219581 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2632cabe-2857-4193-8771-1eacabfc730d tempest-ServerGroup264TestJSON-1656077950 tempest-ServerGroup264TestJSON-1656077950-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.043660 Sep 08 11:03:22.220169 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2451/4998] 10.222.0.27 () {60 vars in 1193 bytes} [Thu Sep 8 11:03:22 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 11:03:22.232762 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a00017cf-9249-485c-be3e-0bb3d3fc0332 tempest-ServerGroup264TestJSON-1656077950 tempest-ServerGroup264TestJSON-1656077950-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:03:22.256370 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a00017cf-9249-485c-be3e-0bb3d3fc0332 tempest-ServerGroup264TestJSON-1656077950 tempest-ServerGroup264TestJSON-1656077950-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups/4a4228e3-3059-40c7-87c7-007bcaf038a7" status: 200 len: 235 microversion: 2.64 time: 0.027592 Sep 08 11:03:22.260081 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2548/4999] 10.222.0.27 () {60 vars in 1304 bytes} [Thu Sep 8 11:03:22 2022] GET /compute/v2.1/os-server-groups/4a4228e3-3059-40c7-87c7-007bcaf038a7 => generated 235 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 11:03:22.272355 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d84ae26e-8a5a-434c-b5a3-dc2f83fc7c07 tempest-ServerGroup264TestJSON-1656077950 tempest-ServerGroup264TestJSON-1656077950-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:03:22.356755 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d84ae26e-8a5a-434c-b5a3-dc2f83fc7c07 tempest-ServerGroup264TestJSON-1656077950 tempest-ServerGroup264TestJSON-1656077950-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/4a4228e3-3059-40c7-87c7-007bcaf038a7" status: 204 len: 0 microversion: 2.64 time: 0.089463 Sep 08 11:03:22.357691 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2452/5000] 10.222.0.27 () {60 vars in 1307 bytes} [Thu Sep 8 11:03:22 2022] DELETE /compute/v2.1/os-server-groups/4a4228e3-3059-40c7-87c7-007bcaf038a7 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 11:03:22.367300 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-20b036a8-67d7-4e7f-a105-e055d49a4e2d tempest-ServerGroup264TestJSON-1656077950 tempest-ServerGroup264TestJSON-1656077950-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:03:22.386128 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-20b036a8-67d7-4e7f-a105-e055d49a4e2d tempest-ServerGroup264TestJSON-1656077950 tempest-ServerGroup264TestJSON-1656077950-project] HTTP exception thrown: Instance group 4a4228e3-3059-40c7-87c7-007bcaf038a7 could not be found. Sep 08 11:03:22.395661 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-20b036a8-67d7-4e7f-a105-e055d49a4e2d tempest-ServerGroup264TestJSON-1656077950 tempest-ServerGroup264TestJSON-1656077950-project] Request method failure captured: Sep 08 11:03:22.395661 n-d-850501-12 devstack@n-api.service[128861]: request: DELETE /compute/v2.1/os-server-groups/4a4228e3-3059-40c7-87c7-007bcaf038a7 HTTP/1.1 Sep 08 11:03:22.395661 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:03:22.395661 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:03:22.395661 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:03:22.395661 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 11:03:22.395661 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:03:22.395661 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:03:22.395661 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:03:22.395661 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:03:22.395661 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcv5UYBj6CKbcxhCnnbCWGVUUIO1nO4m3H9_PoqHRNf6csCVnHfhV0CBCO4hknHIm1eNzhUCd1zBOhz3oBcyVN5J7BmN4DUsnTSjc1XNWEDcVRz3qHkiUtdtDr2Vv53Qmg7pwBwifCrsSZeIyl6E2aNhqk5asEdaC4K-XslvxdB2wSc Sep 08 11:03:22.395661 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:03:22.395661 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:03:22.395661 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:03:22.395661 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:03:22.395661 n-d-850501-12 devstack@n-api.service[128861]: X-Openstack-Nova-Api-Version: 2.64 Sep 08 11:03:22.395661 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:03:22.395661 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:03:22.395661 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 661eab8a527d42db8f6e9855b31c384f Sep 08 11:03:22.395661 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServerGroup264TestJSON-1656077950 Sep 08 11:03:22.395661 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:03:22.395661 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:03:22.395661 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/661eab8a527d42db8f6e9855b31c384f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/661eab8a527d42db8f6e9855b31c384f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_661eab8a527d42db8f6e9855b31c384f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/661eab8a527d42db8f6e9855b31c384f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:03:22.395661 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServerGroup264TestJSON-1656077950 Sep 08 11:03:22.395661 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 661eab8a527d42db8f6e9855b31c384f Sep 08 11:03:22.395661 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1656077950 Sep 08 11:03:22.395661 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServerGroup264TestJSON-1656077950-project Sep 08 11:03:22.395661 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:03:22.395661 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:03:22.395661 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 06e29282853a4aa4a2902f538998b2c3 Sep 08 11:03:22.395661 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServerGroup264TestJSON-1656077950-project Sep 08 11:03:22.395661 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 11:03:22.395661 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance group 4a4228e3-3059-40c7-87c7-007bcaf038a7 could not be found. Sep 08 11:03:22.395661 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '4a4228e3-3059-40c7-87c7-007bcaf038a7'} Sep 08 11:03:22.395661 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:03:22.395661 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:03:22.395661 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 08 11:03:22.395661 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 08 11:03:22.395661 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 11:03:22.395661 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 11:03:22.395661 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 08 11:03:22.395661 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 08 11:03:22.395661 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 08 11:03:22.395661 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 08 11:03:22.395661 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 08 11:03:22.395661 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 08 11:03:22.395661 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 4a4228e3-3059-40c7-87c7-007bcaf038a7 could not be found. Sep 08 11:03:22.395661 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:03:22.395661 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:03:22.395661 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:03:22.395661 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:03:22.395661 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:03:22.395661 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:03:22.395661 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:03:22.395661 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:03:22.395661 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:03:22.395661 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:03:22.395661 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 08 11:03:22.395661 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:03:22.395661 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 4a4228e3-3059-40c7-87c7-007bcaf038a7 could not be found. Sep 08 11:03:22.395661 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:03:22.395661 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:03:22.395661 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:03:22.395661 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:03:22.401798 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:03:22.401798 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:03:22.401798 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:03:22.401798 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:03:22.401798 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 4a4228e3-3059-40c7-87c7-007bcaf038a7 could not be found. Sep 08 11:03:22.401798 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:03:22.415521 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-20b036a8-67d7-4e7f-a105-e055d49a4e2d tempest-ServerGroup264TestJSON-1656077950 tempest-ServerGroup264TestJSON-1656077950-project] Returning 404 to user: Instance group 4a4228e3-3059-40c7-87c7-007bcaf038a7 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:03:22.416696 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-20b036a8-67d7-4e7f-a105-e055d49a4e2d tempest-ServerGroup264TestJSON-1656077950 tempest-ServerGroup264TestJSON-1656077950-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/4a4228e3-3059-40c7-87c7-007bcaf038a7" status: 404 len: 117 microversion: 2.64 time: 0.053821 Sep 08 11:03:22.423723 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2549/5001] 10.222.0.27 () {60 vars in 1307 bytes} [Thu Sep 8 11:03:22 2022] DELETE /compute/v2.1/os-server-groups/4a4228e3-3059-40c7-87c7-007bcaf038a7 => generated 117 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 11:03:50.013227 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:03:50.398892 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b27b46b5-12f5-497d-a93d-5dca04e51305 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-745832165", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:03:50.535066 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-b27b46b5-12f5-497d-a93d-5dca04e51305 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] validate_networks() for [('4755547e-2c92-473c-a725-42a753054a1d', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:03:52.454004 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-b27b46b5-12f5-497d-a93d-5dca04e51305 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:03:52.454886 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-b27b46b5-12f5-497d-a93d-5dca04e51305 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:03:52.455031 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-b27b46b5-12f5-497d-a93d-5dca04e51305 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:03:52.455440 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-b27b46b5-12f5-497d-a93d-5dca04e51305 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:03:52.455853 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-b27b46b5-12f5-497d-a93d-5dca04e51305 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:03:52.485042 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b27b46b5-12f5-497d-a93d-5dca04e51305 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:03:52.485674 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b27b46b5-12f5-497d-a93d-5dca04e51305 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:03:52.486129 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b27b46b5-12f5-497d-a93d-5dca04e51305 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:03:52.487585 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b27b46b5-12f5-497d-a93d-5dca04e51305 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:03:52.488047 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b27b46b5-12f5-497d-a93d-5dca04e51305 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:03:52.488472 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b27b46b5-12f5-497d-a93d-5dca04e51305 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:03:52.596352 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-b27b46b5-12f5-497d-a93d-5dca04e51305 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Getting quotas for project e840dc8280574c4ba37942e50731f01c. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:03:52.611138 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-b27b46b5-12f5-497d-a93d-5dca04e51305 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Getting quotas for user 7b794eec6c6346cd981cbc4929be2d9a and project e840dc8280574c4ba37942e50731f01c. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:03:52.642929 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b27b46b5-12f5-497d-a93d-5dca04e51305 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:03:52.650524 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b27b46b5-12f5-497d-a93d-5dca04e51305 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: bb63079f-c8d9-4d31-8e45-7fac521c2066] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:03:52.768763 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b27b46b5-12f5-497d-a93d-5dca04e51305 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.755956 Sep 08 11:03:52.770045 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2453/5002] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 11:03:50 2022] POST /compute/v2.1/servers => generated 383 bytes in 2760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:03:52.781964 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8a875cad-214e-4fd8-ba9a-c7297de9fc95 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:03:52.782644 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8a875cad-214e-4fd8-ba9a-c7297de9fc95 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: bb63079f-c8d9-4d31-8e45-7fac521c2066] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:03:52.786451 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=8 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:03:52.789347 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:03:52.989991 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8a875cad-214e-4fd8-ba9a-c7297de9fc95 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b794eec6c6346cd981cbc4929be2d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e840dc8280574c4ba37942e50731f01c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:03:53.011158 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8a875cad-214e-4fd8-ba9a-c7297de9fc95 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/bb63079f-c8d9-4d31-8e45-7fac521c2066" status: 200 len: 1213 microversion: 2.1 time: 0.230812 Sep 08 11:03:53.013439 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2550/5003] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:03:52 2022] GET /compute/v2.1/servers/bb63079f-c8d9-4d31-8e45-7fac521c2066 => generated 1213 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:03:54.043502 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3f34b62b-1d61-491c-ae44-27938153433f tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:03:54.046633 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3f34b62b-1d61-491c-ae44-27938153433f tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: bb63079f-c8d9-4d31-8e45-7fac521c2066] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:03:54.438912 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3f34b62b-1d61-491c-ae44-27938153433f tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b794eec6c6346cd981cbc4929be2d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e840dc8280574c4ba37942e50731f01c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:03:54.459994 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3f34b62b-1d61-491c-ae44-27938153433f tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/bb63079f-c8d9-4d31-8e45-7fac521c2066" status: 200 len: 1213 microversion: 2.1 time: 0.417337 Sep 08 11:03:54.465758 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2454/5004] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:03:54 2022] GET /compute/v2.1/servers/bb63079f-c8d9-4d31-8e45-7fac521c2066 => generated 1213 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:03:55.488603 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5fd24a81-cfb1-4ae3-801f-69e6f56a0361 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:03:55.489321 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5fd24a81-cfb1-4ae3-801f-69e6f56a0361 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: bb63079f-c8d9-4d31-8e45-7fac521c2066] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:03:55.510392 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5fd24a81-cfb1-4ae3-801f-69e6f56a0361 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:03:55.519776 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5fd24a81-cfb1-4ae3-801f-69e6f56a0361 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:03:55.520256 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5fd24a81-cfb1-4ae3-801f-69e6f56a0361 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:03:55.527678 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5fd24a81-cfb1-4ae3-801f-69e6f56a0361 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:03:55.528202 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5fd24a81-cfb1-4ae3-801f-69e6f56a0361 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:03:55.528848 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5fd24a81-cfb1-4ae3-801f-69e6f56a0361 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:03:55.776898 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5fd24a81-cfb1-4ae3-801f-69e6f56a0361 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b794eec6c6346cd981cbc4929be2d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e840dc8280574c4ba37942e50731f01c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:03:55.787269 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5fd24a81-cfb1-4ae3-801f-69e6f56a0361 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/bb63079f-c8d9-4d31-8e45-7fac521c2066" status: 200 len: 1265 microversion: 2.1 time: 0.303737 Sep 08 11:03:55.802438 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2551/5005] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:03:55 2022] GET /compute/v2.1/servers/bb63079f-c8d9-4d31-8e45-7fac521c2066 => generated 1265 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:03:56.832146 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-17dc8d4d-3a56-4e66-82ac-465f89fbe373 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:03:56.832772 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-17dc8d4d-3a56-4e66-82ac-465f89fbe373 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: bb63079f-c8d9-4d31-8e45-7fac521c2066] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:03:56.855084 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-17dc8d4d-3a56-4e66-82ac-465f89fbe373 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:03:56.859513 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-17dc8d4d-3a56-4e66-82ac-465f89fbe373 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:03:56.864793 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-17dc8d4d-3a56-4e66-82ac-465f89fbe373 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:03:56.867896 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-17dc8d4d-3a56-4e66-82ac-465f89fbe373 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:03:56.868386 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-17dc8d4d-3a56-4e66-82ac-465f89fbe373 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:03:56.873881 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-17dc8d4d-3a56-4e66-82ac-465f89fbe373 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:03:57.118521 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-17dc8d4d-3a56-4e66-82ac-465f89fbe373 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b794eec6c6346cd981cbc4929be2d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e840dc8280574c4ba37942e50731f01c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:03:57.146919 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-17dc8d4d-3a56-4e66-82ac-465f89fbe373 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/bb63079f-c8d9-4d31-8e45-7fac521c2066" status: 200 len: 1271 microversion: 2.1 time: 0.320384 Sep 08 11:03:57.149062 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2455/5006] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:03:56 2022] GET /compute/v2.1/servers/bb63079f-c8d9-4d31-8e45-7fac521c2066 => generated 1271 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:03:58.176971 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8b1a80e4-cea6-4342-ba1e-4feb61f1a66c tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:03:58.179122 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8b1a80e4-cea6-4342-ba1e-4feb61f1a66c tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: bb63079f-c8d9-4d31-8e45-7fac521c2066] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:03:58.190168 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8b1a80e4-cea6-4342-ba1e-4feb61f1a66c tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:03:58.191176 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8b1a80e4-cea6-4342-ba1e-4feb61f1a66c tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:03:58.191913 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8b1a80e4-cea6-4342-ba1e-4feb61f1a66c tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:03:58.192704 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8b1a80e4-cea6-4342-ba1e-4feb61f1a66c tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:03:58.193336 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8b1a80e4-cea6-4342-ba1e-4feb61f1a66c tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:03:58.193898 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8b1a80e4-cea6-4342-ba1e-4feb61f1a66c tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:03:58.320047 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8b1a80e4-cea6-4342-ba1e-4feb61f1a66c tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b794eec6c6346cd981cbc4929be2d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e840dc8280574c4ba37942e50731f01c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:03:58.338487 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8b1a80e4-cea6-4342-ba1e-4feb61f1a66c tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/bb63079f-c8d9-4d31-8e45-7fac521c2066" status: 200 len: 1271 microversion: 2.1 time: 0.169679 Sep 08 11:03:58.341339 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2552/5007] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:03:58 2022] GET /compute/v2.1/servers/bb63079f-c8d9-4d31-8e45-7fac521c2066 => generated 1271 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:03:59.364027 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ea08a7b8-50d2-4cf8-b251-24d151f69e4f tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:03:59.365339 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ea08a7b8-50d2-4cf8-b251-24d151f69e4f tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: bb63079f-c8d9-4d31-8e45-7fac521c2066] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:03:59.374095 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea08a7b8-50d2-4cf8-b251-24d151f69e4f tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:03:59.374885 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea08a7b8-50d2-4cf8-b251-24d151f69e4f tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:03:59.375574 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea08a7b8-50d2-4cf8-b251-24d151f69e4f tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:03:59.377476 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea08a7b8-50d2-4cf8-b251-24d151f69e4f tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:03:59.378183 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea08a7b8-50d2-4cf8-b251-24d151f69e4f tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:03:59.378988 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea08a7b8-50d2-4cf8-b251-24d151f69e4f tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:03:59.956081 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ea08a7b8-50d2-4cf8-b251-24d151f69e4f tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b794eec6c6346cd981cbc4929be2d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e840dc8280574c4ba37942e50731f01c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:03:59.969398 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ea08a7b8-50d2-4cf8-b251-24d151f69e4f tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/bb63079f-c8d9-4d31-8e45-7fac521c2066" status: 200 len: 1313 microversion: 2.1 time: 0.611221 Sep 08 11:03:59.969994 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2456/5008] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:03:59 2022] GET /compute/v2.1/servers/bb63079f-c8d9-4d31-8e45-7fac521c2066 => generated 1313 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:00.999209 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b3a2c54d-5d9f-4e46-9e02-f8d0ceeba5d3 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:01.000780 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b3a2c54d-5d9f-4e46-9e02-f8d0ceeba5d3 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: bb63079f-c8d9-4d31-8e45-7fac521c2066] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:01.018942 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b3a2c54d-5d9f-4e46-9e02-f8d0ceeba5d3 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:01.020734 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b3a2c54d-5d9f-4e46-9e02-f8d0ceeba5d3 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:01.022250 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b3a2c54d-5d9f-4e46-9e02-f8d0ceeba5d3 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:01.023203 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b3a2c54d-5d9f-4e46-9e02-f8d0ceeba5d3 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:01.024521 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b3a2c54d-5d9f-4e46-9e02-f8d0ceeba5d3 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:01.025932 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b3a2c54d-5d9f-4e46-9e02-f8d0ceeba5d3 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:01.406805 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b3a2c54d-5d9f-4e46-9e02-f8d0ceeba5d3 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b794eec6c6346cd981cbc4929be2d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e840dc8280574c4ba37942e50731f01c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:01.419616 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b3a2c54d-5d9f-4e46-9e02-f8d0ceeba5d3 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/bb63079f-c8d9-4d31-8e45-7fac521c2066" status: 200 len: 1313 microversion: 2.1 time: 0.425239 Sep 08 11:04:01.420225 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2553/5009] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:00 2022] GET /compute/v2.1/servers/bb63079f-c8d9-4d31-8e45-7fac521c2066 => generated 1313 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:01.451178 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-3834e2e0-4447-4dbd-8b18-d5c1c31ecbcc req-27b79f91-d358-47a3-8aa1-213cf87f2572 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb63079f-c8d9-4d31-8e45-7fac521c2066", "tag": "e4cf7514-340c-4940-974b-33eb5c924cd7"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:04:01.474031 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-3834e2e0-4447-4dbd-8b18-d5c1c31ecbcc req-27b79f91-d358-47a3-8aa1-213cf87f2572 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:01.476153 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-3834e2e0-4447-4dbd-8b18-d5c1c31ecbcc req-27b79f91-d358-47a3-8aa1-213cf87f2572 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:01.476933 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-3834e2e0-4447-4dbd-8b18-d5c1c31ecbcc req-27b79f91-d358-47a3-8aa1-213cf87f2572 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:01.507739 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-3834e2e0-4447-4dbd-8b18-d5c1c31ecbcc req-27b79f91-d358-47a3-8aa1-213cf87f2572 service nova] Creating event network-changed:e4cf7514-340c-4940-974b-33eb5c924cd7 for instance bb63079f-c8d9-4d31-8e45-7fac521c2066 on n-h1-850501-12 Sep 08 11:04:01.521539 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-3834e2e0-4447-4dbd-8b18-d5c1c31ecbcc req-27b79f91-d358-47a3-8aa1-213cf87f2572 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074682 Sep 08 11:04:01.526768 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2457/5010] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:04:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:04:02.445224 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-16af2109-81ee-4f65-8e2f-a7e6afed1c18 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:02.445841 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-16af2109-81ee-4f65-8e2f-a7e6afed1c18 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: bb63079f-c8d9-4d31-8e45-7fac521c2066] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:02.469479 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-16af2109-81ee-4f65-8e2f-a7e6afed1c18 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:02.473144 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-16af2109-81ee-4f65-8e2f-a7e6afed1c18 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:02.475920 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-16af2109-81ee-4f65-8e2f-a7e6afed1c18 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:02.476915 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-16af2109-81ee-4f65-8e2f-a7e6afed1c18 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:02.479506 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-16af2109-81ee-4f65-8e2f-a7e6afed1c18 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:02.480687 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-16af2109-81ee-4f65-8e2f-a7e6afed1c18 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:03.005382 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:04:03.509663 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-16af2109-81ee-4f65-8e2f-a7e6afed1c18 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b794eec6c6346cd981cbc4929be2d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e840dc8280574c4ba37942e50731f01c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:03.531200 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-16af2109-81ee-4f65-8e2f-a7e6afed1c18 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/bb63079f-c8d9-4d31-8e45-7fac521c2066" status: 200 len: 1313 microversion: 2.1 time: 1.090082 Sep 08 11:04:03.533835 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2554/5011] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:02 2022] GET /compute/v2.1/servers/bb63079f-c8d9-4d31-8e45-7fac521c2066 => generated 1313 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:04.242049 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:04:04.247068 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3a8696a9-6a01-4734-9e8f-ec60168e46ad tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2139069700", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "3ff0a267-4b99-4eda-8f9a-08e74f7ba99a"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:04:04.363815 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-3a8696a9-6a01-4734-9e8f-ec60168e46ad tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] validate_networks() for [('3ff0a267-4b99-4eda-8f9a-08e74f7ba99a', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:04:04.451550 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=8 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:04:04.558354 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d1b3ad8e-6ecb-460a-a59a-453ec947844a tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:04.559591 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d1b3ad8e-6ecb-460a-a59a-453ec947844a tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: bb63079f-c8d9-4d31-8e45-7fac521c2066] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:04.574781 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d1b3ad8e-6ecb-460a-a59a-453ec947844a tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:04.575799 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d1b3ad8e-6ecb-460a-a59a-453ec947844a tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:04.577866 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d1b3ad8e-6ecb-460a-a59a-453ec947844a tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:04.580988 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d1b3ad8e-6ecb-460a-a59a-453ec947844a tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:04.584079 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d1b3ad8e-6ecb-460a-a59a-453ec947844a tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:04.584548 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d1b3ad8e-6ecb-460a-a59a-453ec947844a tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:05.388217 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-3a8696a9-6a01-4734-9e8f-ec60168e46ad tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:04:05.388740 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-3a8696a9-6a01-4734-9e8f-ec60168e46ad tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:04:05.389146 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-3a8696a9-6a01-4734-9e8f-ec60168e46ad tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:04:05.393659 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-3a8696a9-6a01-4734-9e8f-ec60168e46ad tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:04:05.395058 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-3a8696a9-6a01-4734-9e8f-ec60168e46ad tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:04:05.417517 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a8696a9-6a01-4734-9e8f-ec60168e46ad tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:05.418849 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a8696a9-6a01-4734-9e8f-ec60168e46ad tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:05.420684 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a8696a9-6a01-4734-9e8f-ec60168e46ad tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:05.429746 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a8696a9-6a01-4734-9e8f-ec60168e46ad tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:05.430811 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a8696a9-6a01-4734-9e8f-ec60168e46ad tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:05.431733 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a8696a9-6a01-4734-9e8f-ec60168e46ad tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:05.469077 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-3a8696a9-6a01-4734-9e8f-ec60168e46ad tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Getting quotas for project 7a358ca8de0b489481a98bdacac284a0. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:04:05.477071 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-3a8696a9-6a01-4734-9e8f-ec60168e46ad tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Getting quotas for user 0b8bb78a06234641b145546a8328f639 and project 7a358ca8de0b489481a98bdacac284a0. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:04:05.499740 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3a8696a9-6a01-4734-9e8f-ec60168e46ad tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:04:05.503681 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3a8696a9-6a01-4734-9e8f-ec60168e46ad tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] [instance: e6274d86-c6b8-43b2-926d-a02f5248c2d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:04:05.610350 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3a8696a9-6a01-4734-9e8f-ec60168e46ad tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.374032 Sep 08 11:04:05.630540 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2458/5012] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 11:04:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1395 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:04:05.646880 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-38c198aa-3557-4352-b35e-bf4b51e09723 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:05.649161 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-38c198aa-3557-4352-b35e-bf4b51e09723 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] [instance: e6274d86-c6b8-43b2-926d-a02f5248c2d5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:05.781613 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-38c198aa-3557-4352-b35e-bf4b51e09723 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8bb78a06234641b145546a8328f639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a358ca8de0b489481a98bdacac284a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:05.803345 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-38c198aa-3557-4352-b35e-bf4b51e09723 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] 10.222.0.27 "GET /compute/v2.1/servers/e6274d86-c6b8-43b2-926d-a02f5248c2d5" status: 200 len: 1214 microversion: 2.1 time: 0.170958 Sep 08 11:04:05.806100 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2459/5013] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:05 2022] GET /compute/v2.1/servers/e6274d86-c6b8-43b2-926d-a02f5248c2d5 => generated 1214 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:05.994695 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d1b3ad8e-6ecb-460a-a59a-453ec947844a tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b794eec6c6346cd981cbc4929be2d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e840dc8280574c4ba37942e50731f01c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:06.004337 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d1b3ad8e-6ecb-460a-a59a-453ec947844a tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/bb63079f-c8d9-4d31-8e45-7fac521c2066" status: 200 len: 1313 microversion: 2.1 time: 1.452024 Sep 08 11:04:06.010392 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2555/5014] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:04 2022] GET /compute/v2.1/servers/bb63079f-c8d9-4d31-8e45-7fac521c2066 => generated 1313 bytes in 1459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:04:06.835911 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-827f52e2-a171-4f24-8810-aa801ebf48c4 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:06.835911 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-827f52e2-a171-4f24-8810-aa801ebf48c4 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] [instance: e6274d86-c6b8-43b2-926d-a02f5248c2d5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:06.850025 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-827f52e2-a171-4f24-8810-aa801ebf48c4 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:06.850544 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-827f52e2-a171-4f24-8810-aa801ebf48c4 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:06.850994 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-827f52e2-a171-4f24-8810-aa801ebf48c4 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:06.854768 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-827f52e2-a171-4f24-8810-aa801ebf48c4 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:06.855262 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-827f52e2-a171-4f24-8810-aa801ebf48c4 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:06.858318 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-827f52e2-a171-4f24-8810-aa801ebf48c4 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:07.036689 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9334da6b-b70d-4b0b-aa31-69cca5b99d91 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:07.037703 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9334da6b-b70d-4b0b-aa31-69cca5b99d91 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: bb63079f-c8d9-4d31-8e45-7fac521c2066] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:07.044925 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9334da6b-b70d-4b0b-aa31-69cca5b99d91 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:07.045581 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9334da6b-b70d-4b0b-aa31-69cca5b99d91 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:07.046118 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9334da6b-b70d-4b0b-aa31-69cca5b99d91 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:07.046943 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9334da6b-b70d-4b0b-aa31-69cca5b99d91 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:07.047530 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9334da6b-b70d-4b0b-aa31-69cca5b99d91 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:07.049135 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9334da6b-b70d-4b0b-aa31-69cca5b99d91 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:07.123767 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-827f52e2-a171-4f24-8810-aa801ebf48c4 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8bb78a06234641b145546a8328f639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a358ca8de0b489481a98bdacac284a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:07.140030 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-827f52e2-a171-4f24-8810-aa801ebf48c4 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] 10.222.0.27 "GET /compute/v2.1/servers/e6274d86-c6b8-43b2-926d-a02f5248c2d5" status: 200 len: 1266 microversion: 2.1 time: 0.311419 Sep 08 11:04:07.153204 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2460/5015] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:06 2022] GET /compute/v2.1/servers/e6274d86-c6b8-43b2-926d-a02f5248c2d5 => generated 1266 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:07.360620 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9334da6b-b70d-4b0b-aa31-69cca5b99d91 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b794eec6c6346cd981cbc4929be2d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e840dc8280574c4ba37942e50731f01c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:07.371200 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9334da6b-b70d-4b0b-aa31-69cca5b99d91 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/bb63079f-c8d9-4d31-8e45-7fac521c2066" status: 200 len: 1313 microversion: 2.1 time: 0.339184 Sep 08 11:04:07.375570 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2556/5016] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:07 2022] GET /compute/v2.1/servers/bb63079f-c8d9-4d31-8e45-7fac521c2066 => generated 1313 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:04:08.184483 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c7ef0078-e79f-4845-a974-835d720c41b7 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:08.185659 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c7ef0078-e79f-4845-a974-835d720c41b7 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] [instance: e6274d86-c6b8-43b2-926d-a02f5248c2d5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:08.195643 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c7ef0078-e79f-4845-a974-835d720c41b7 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:08.195643 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c7ef0078-e79f-4845-a974-835d720c41b7 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:08.195643 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c7ef0078-e79f-4845-a974-835d720c41b7 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:08.196143 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c7ef0078-e79f-4845-a974-835d720c41b7 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:08.196607 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c7ef0078-e79f-4845-a974-835d720c41b7 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:08.197067 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c7ef0078-e79f-4845-a974-835d720c41b7 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:08.354727 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c7ef0078-e79f-4845-a974-835d720c41b7 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8bb78a06234641b145546a8328f639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a358ca8de0b489481a98bdacac284a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:08.395059 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c7ef0078-e79f-4845-a974-835d720c41b7 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] 10.222.0.27 "GET /compute/v2.1/servers/e6274d86-c6b8-43b2-926d-a02f5248c2d5" status: 200 len: 1272 microversion: 2.1 time: 0.216499 Sep 08 11:04:08.397318 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2461/5017] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:08 2022] GET /compute/v2.1/servers/e6274d86-c6b8-43b2-926d-a02f5248c2d5 => generated 1272 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:08.417666 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2181f96c-6cd5-461f-8c59-728c5e23c7a3 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:08.418389 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2181f96c-6cd5-461f-8c59-728c5e23c7a3 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: bb63079f-c8d9-4d31-8e45-7fac521c2066] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:08.441928 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2181f96c-6cd5-461f-8c59-728c5e23c7a3 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:08.442897 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2181f96c-6cd5-461f-8c59-728c5e23c7a3 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:08.443829 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2181f96c-6cd5-461f-8c59-728c5e23c7a3 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:08.454589 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2181f96c-6cd5-461f-8c59-728c5e23c7a3 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:08.455356 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2181f96c-6cd5-461f-8c59-728c5e23c7a3 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:08.456009 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2181f96c-6cd5-461f-8c59-728c5e23c7a3 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:09.081567 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2181f96c-6cd5-461f-8c59-728c5e23c7a3 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b794eec6c6346cd981cbc4929be2d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e840dc8280574c4ba37942e50731f01c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:09.114520 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2181f96c-6cd5-461f-8c59-728c5e23c7a3 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/bb63079f-c8d9-4d31-8e45-7fac521c2066" status: 200 len: 1313 microversion: 2.1 time: 0.699403 Sep 08 11:04:09.117186 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2557/5018] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:08 2022] GET /compute/v2.1/servers/bb63079f-c8d9-4d31-8e45-7fac521c2066 => generated 1313 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:04:09.421405 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-284b281c-76a8-4b03-92d8-dd89075b9ab7 req-15b1faa4-a780-49ad-b04c-f2347971524d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb63079f-c8d9-4d31-8e45-7fac521c2066", "name": "network-vif-plugged", "status": "completed", "tag": "e4cf7514-340c-4940-974b-33eb5c924cd7"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:04:09.426801 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e9f07083-7e25-4210-9953-bb4669c4e4f2 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:09.427426 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e9f07083-7e25-4210-9953-bb4669c4e4f2 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] [instance: e6274d86-c6b8-43b2-926d-a02f5248c2d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:09.443120 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e9f07083-7e25-4210-9953-bb4669c4e4f2 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:09.443666 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e9f07083-7e25-4210-9953-bb4669c4e4f2 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:09.444821 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e9f07083-7e25-4210-9953-bb4669c4e4f2 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:09.445051 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e9f07083-7e25-4210-9953-bb4669c4e4f2 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:09.450296 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e9f07083-7e25-4210-9953-bb4669c4e4f2 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:09.451565 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-284b281c-76a8-4b03-92d8-dd89075b9ab7 req-15b1faa4-a780-49ad-b04c-f2347971524d service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:09.452296 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e9f07083-7e25-4210-9953-bb4669c4e4f2 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:09.452989 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-284b281c-76a8-4b03-92d8-dd89075b9ab7 req-15b1faa4-a780-49ad-b04c-f2347971524d service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:09.455682 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-284b281c-76a8-4b03-92d8-dd89075b9ab7 req-15b1faa4-a780-49ad-b04c-f2347971524d service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:09.491880 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-284b281c-76a8-4b03-92d8-dd89075b9ab7 req-15b1faa4-a780-49ad-b04c-f2347971524d service nova] Creating event network-vif-plugged:e4cf7514-340c-4940-974b-33eb5c924cd7 for instance bb63079f-c8d9-4d31-8e45-7fac521c2066 on n-h1-850501-12 Sep 08 11:04:09.502924 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-284b281c-76a8-4b03-92d8-dd89075b9ab7 req-15b1faa4-a780-49ad-b04c-f2347971524d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090946 Sep 08 11:04:09.508976 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2462/5019] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:04:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:04:10.140010 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-565537db-ef5a-4811-a140-248ca63a6961 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:10.141000 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-565537db-ef5a-4811-a140-248ca63a6961 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: bb63079f-c8d9-4d31-8e45-7fac521c2066] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:10.156774 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-565537db-ef5a-4811-a140-248ca63a6961 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:10.158547 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-565537db-ef5a-4811-a140-248ca63a6961 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:10.160709 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-565537db-ef5a-4811-a140-248ca63a6961 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:10.161776 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-565537db-ef5a-4811-a140-248ca63a6961 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:10.164488 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-565537db-ef5a-4811-a140-248ca63a6961 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:10.165198 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-565537db-ef5a-4811-a140-248ca63a6961 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:10.578074 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-565537db-ef5a-4811-a140-248ca63a6961 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b794eec6c6346cd981cbc4929be2d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e840dc8280574c4ba37942e50731f01c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:10.590893 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e9f07083-7e25-4210-9953-bb4669c4e4f2 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8bb78a06234641b145546a8328f639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a358ca8de0b489481a98bdacac284a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:10.592411 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-565537db-ef5a-4811-a140-248ca63a6961 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/bb63079f-c8d9-4d31-8e45-7fac521c2066" status: 200 len: 1313 microversion: 2.1 time: 0.457435 Sep 08 11:04:10.596857 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2463/5020] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:10 2022] GET /compute/v2.1/servers/bb63079f-c8d9-4d31-8e45-7fac521c2066 => generated 1313 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:04:10.608441 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e9f07083-7e25-4210-9953-bb4669c4e4f2 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] 10.222.0.27 "GET /compute/v2.1/servers/e6274d86-c6b8-43b2-926d-a02f5248c2d5" status: 200 len: 1314 microversion: 2.1 time: 1.191854 Sep 08 11:04:10.609302 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2558/5021] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:09 2022] GET /compute/v2.1/servers/e6274d86-c6b8-43b2-926d-a02f5248c2d5 => generated 1314 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:04:11.618624 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-81c46307-a8cc-4259-83d6-d5c4d135a4d5 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:11.619980 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-81c46307-a8cc-4259-83d6-d5c4d135a4d5 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: bb63079f-c8d9-4d31-8e45-7fac521c2066] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:11.634624 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81c46307-a8cc-4259-83d6-d5c4d135a4d5 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:11.636110 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81c46307-a8cc-4259-83d6-d5c4d135a4d5 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:11.636727 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81c46307-a8cc-4259-83d6-d5c4d135a4d5 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:11.638812 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81c46307-a8cc-4259-83d6-d5c4d135a4d5 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:11.640622 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81c46307-a8cc-4259-83d6-d5c4d135a4d5 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:11.642138 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81c46307-a8cc-4259-83d6-d5c4d135a4d5 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:11.652626 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f533e5eb-0905-4cfe-957c-375748d6cbd8 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:11.654252 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f533e5eb-0905-4cfe-957c-375748d6cbd8 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] [instance: e6274d86-c6b8-43b2-926d-a02f5248c2d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:11.674590 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f533e5eb-0905-4cfe-957c-375748d6cbd8 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:11.680984 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f533e5eb-0905-4cfe-957c-375748d6cbd8 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:11.684350 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f533e5eb-0905-4cfe-957c-375748d6cbd8 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:11.691704 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f533e5eb-0905-4cfe-957c-375748d6cbd8 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:11.692843 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f533e5eb-0905-4cfe-957c-375748d6cbd8 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:11.693491 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f533e5eb-0905-4cfe-957c-375748d6cbd8 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:12.524826 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-81c46307-a8cc-4259-83d6-d5c4d135a4d5 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b794eec6c6346cd981cbc4929be2d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e840dc8280574c4ba37942e50731f01c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:12.556248 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-81c46307-a8cc-4259-83d6-d5c4d135a4d5 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/bb63079f-c8d9-4d31-8e45-7fac521c2066" status: 200 len: 1499 microversion: 2.1 time: 0.940695 Sep 08 11:04:12.559632 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2464/5022] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:11 2022] GET /compute/v2.1/servers/bb63079f-c8d9-4d31-8e45-7fac521c2066 => generated 1499 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:04:12.578647 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-25606afa-4685-41c2-a952-87b6a9db781a req-4e73894c-7ac4-43ba-ac6e-562ee718975c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6274d86-c6b8-43b2-926d-a02f5248c2d5", "tag": "49d058f2-d9b4-4ae8-b85f-2af8fd4dbbbe"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:04:12.615671 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-25606afa-4685-41c2-a952-87b6a9db781a req-4e73894c-7ac4-43ba-ac6e-562ee718975c service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:12.619940 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-25606afa-4685-41c2-a952-87b6a9db781a req-4e73894c-7ac4-43ba-ac6e-562ee718975c service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:12.620565 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-25606afa-4685-41c2-a952-87b6a9db781a req-4e73894c-7ac4-43ba-ac6e-562ee718975c service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:12.649389 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f533e5eb-0905-4cfe-957c-375748d6cbd8 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8bb78a06234641b145546a8328f639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a358ca8de0b489481a98bdacac284a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:12.658350 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f533e5eb-0905-4cfe-957c-375748d6cbd8 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] 10.222.0.27 "GET /compute/v2.1/servers/e6274d86-c6b8-43b2-926d-a02f5248c2d5" status: 200 len: 1314 microversion: 2.1 time: 1.009502 Sep 08 11:04:12.661840 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-25606afa-4685-41c2-a952-87b6a9db781a req-4e73894c-7ac4-43ba-ac6e-562ee718975c service nova] Creating event network-changed:49d058f2-d9b4-4ae8-b85f-2af8fd4dbbbe for instance e6274d86-c6b8-43b2-926d-a02f5248c2d5 on n-h2-850501-12 Sep 08 11:04:12.664855 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2559/5023] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:11 2022] GET /compute/v2.1/servers/e6274d86-c6b8-43b2-926d-a02f5248c2d5 => generated 1314 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:04:12.671879 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-192bf311-ac13-4ee0-8f9a-d1c1aa17cb49 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:04:12.674681 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-192bf311-ac13-4ee0-8f9a-d1c1aa17cb49 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: bb63079f-c8d9-4d31-8e45-7fac521c2066] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:12.682983 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-25606afa-4685-41c2-a952-87b6a9db781a req-4e73894c-7ac4-43ba-ac6e-562ee718975c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120363 Sep 08 11:04:12.683866 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2465/5024] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:04:12.696873 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-192bf311-ac13-4ee0-8f9a-d1c1aa17cb49 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:12.697667 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-192bf311-ac13-4ee0-8f9a-d1c1aa17cb49 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:12.698276 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-192bf311-ac13-4ee0-8f9a-d1c1aa17cb49 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:12.699157 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-192bf311-ac13-4ee0-8f9a-d1c1aa17cb49 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:12.701724 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-192bf311-ac13-4ee0-8f9a-d1c1aa17cb49 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:12.702041 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-192bf311-ac13-4ee0-8f9a-d1c1aa17cb49 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:12.768292 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-192bf311-ac13-4ee0-8f9a-d1c1aa17cb49 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lazy-loading 'flavor' on Instance uuid bb63079f-c8d9-4d31-8e45-7fac521c2066 {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:04:12.922358 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-192bf311-ac13-4ee0-8f9a-d1c1aa17cb49 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "POST /compute/v2.1/servers/bb63079f-c8d9-4d31-8e45-7fac521c2066/action" status: 200 len: 32 microversion: 2.1 time: 0.255922 Sep 08 11:04:12.925664 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2560/5025] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 11:04:12 2022] POST /compute/v2.1/servers/bb63079f-c8d9-4d31-8e45-7fac521c2066/action => generated 32 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 11:04:12.936131 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6cb6dfd6-7d9d-4d9b-9b2e-efc0331b1d9a tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:12.936949 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6cb6dfd6-7d9d-4d9b-9b2e-efc0331b1d9a tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: bb63079f-c8d9-4d31-8e45-7fac521c2066] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:12.946104 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6cb6dfd6-7d9d-4d9b-9b2e-efc0331b1d9a tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:12.951259 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6cb6dfd6-7d9d-4d9b-9b2e-efc0331b1d9a tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:12.954812 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6cb6dfd6-7d9d-4d9b-9b2e-efc0331b1d9a tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:12.957949 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6cb6dfd6-7d9d-4d9b-9b2e-efc0331b1d9a tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:12.964417 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6cb6dfd6-7d9d-4d9b-9b2e-efc0331b1d9a tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:12.965419 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6cb6dfd6-7d9d-4d9b-9b2e-efc0331b1d9a tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:13.692237 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0d734ad6-4742-4f58-8c4d-93b379869f02 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:13.693801 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0d734ad6-4742-4f58-8c4d-93b379869f02 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] [instance: e6274d86-c6b8-43b2-926d-a02f5248c2d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:13.704997 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d734ad6-4742-4f58-8c4d-93b379869f02 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:13.709517 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d734ad6-4742-4f58-8c4d-93b379869f02 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:13.710349 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d734ad6-4742-4f58-8c4d-93b379869f02 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:13.715690 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d734ad6-4742-4f58-8c4d-93b379869f02 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:13.716495 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d734ad6-4742-4f58-8c4d-93b379869f02 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:13.717197 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d734ad6-4742-4f58-8c4d-93b379869f02 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:13.784656 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6cb6dfd6-7d9d-4d9b-9b2e-efc0331b1d9a tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b794eec6c6346cd981cbc4929be2d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e840dc8280574c4ba37942e50731f01c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:13.799754 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6cb6dfd6-7d9d-4d9b-9b2e-efc0331b1d9a tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/bb63079f-c8d9-4d31-8e45-7fac521c2066" status: 200 len: 1505 microversion: 2.1 time: 0.865439 Sep 08 11:04:13.803030 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2466/5026] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:12 2022] GET /compute/v2.1/servers/bb63079f-c8d9-4d31-8e45-7fac521c2066 => generated 1505 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:14.285257 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0d734ad6-4742-4f58-8c4d-93b379869f02 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8bb78a06234641b145546a8328f639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a358ca8de0b489481a98bdacac284a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:14.305060 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0d734ad6-4742-4f58-8c4d-93b379869f02 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] 10.222.0.27 "GET /compute/v2.1/servers/e6274d86-c6b8-43b2-926d-a02f5248c2d5" status: 200 len: 1314 microversion: 2.1 time: 0.620939 Sep 08 11:04:14.308854 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2561/5027] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:13 2022] GET /compute/v2.1/servers/e6274d86-c6b8-43b2-926d-a02f5248c2d5 => generated 1314 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:04:14.829424 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4b9ef236-f51e-44eb-81d3-133fc2f00478 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:14.839041 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4b9ef236-f51e-44eb-81d3-133fc2f00478 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: bb63079f-c8d9-4d31-8e45-7fac521c2066] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:14.881481 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4b9ef236-f51e-44eb-81d3-133fc2f00478 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:14.888770 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4b9ef236-f51e-44eb-81d3-133fc2f00478 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:14.901622 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4b9ef236-f51e-44eb-81d3-133fc2f00478 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:14.902978 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4b9ef236-f51e-44eb-81d3-133fc2f00478 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:14.905501 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4b9ef236-f51e-44eb-81d3-133fc2f00478 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:14.919634 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4b9ef236-f51e-44eb-81d3-133fc2f00478 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:15.340898 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-af79ed4e-02db-4bec-9e4c-78b6d8487964 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:15.342253 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-af79ed4e-02db-4bec-9e4c-78b6d8487964 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] [instance: e6274d86-c6b8-43b2-926d-a02f5248c2d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:15.379268 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-af79ed4e-02db-4bec-9e4c-78b6d8487964 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:15.380356 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-af79ed4e-02db-4bec-9e4c-78b6d8487964 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:15.380814 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-af79ed4e-02db-4bec-9e4c-78b6d8487964 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:15.390650 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-af79ed4e-02db-4bec-9e4c-78b6d8487964 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:15.391497 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-af79ed4e-02db-4bec-9e4c-78b6d8487964 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:15.393517 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-af79ed4e-02db-4bec-9e4c-78b6d8487964 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:15.456083 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:04:15.787647 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=8 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:04:16.286149 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4b9ef236-f51e-44eb-81d3-133fc2f00478 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b794eec6c6346cd981cbc4929be2d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e840dc8280574c4ba37942e50731f01c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:16.298166 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4b9ef236-f51e-44eb-81d3-133fc2f00478 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/bb63079f-c8d9-4d31-8e45-7fac521c2066" status: 200 len: 1505 microversion: 2.1 time: 1.472967 Sep 08 11:04:16.298777 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2467/5028] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:14 2022] GET /compute/v2.1/servers/bb63079f-c8d9-4d31-8e45-7fac521c2066 => generated 1505 bytes in 1475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:16.716723 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-af79ed4e-02db-4bec-9e4c-78b6d8487964 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8bb78a06234641b145546a8328f639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a358ca8de0b489481a98bdacac284a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:16.734267 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-af79ed4e-02db-4bec-9e4c-78b6d8487964 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] 10.222.0.27 "GET /compute/v2.1/servers/e6274d86-c6b8-43b2-926d-a02f5248c2d5" status: 200 len: 1314 microversion: 2.1 time: 1.399683 Sep 08 11:04:16.745070 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2562/5029] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:15 2022] GET /compute/v2.1/servers/e6274d86-c6b8-43b2-926d-a02f5248c2d5 => generated 1314 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:04:17.327393 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-22bca64b-30f9-4569-81a9-611476b4af3c tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:17.329119 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-22bca64b-30f9-4569-81a9-611476b4af3c tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: bb63079f-c8d9-4d31-8e45-7fac521c2066] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:17.352517 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-22bca64b-30f9-4569-81a9-611476b4af3c tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:17.355477 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-22bca64b-30f9-4569-81a9-611476b4af3c tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:17.362130 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-22bca64b-30f9-4569-81a9-611476b4af3c tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:17.362949 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-22bca64b-30f9-4569-81a9-611476b4af3c tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:17.370778 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-22bca64b-30f9-4569-81a9-611476b4af3c tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:17.371344 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-22bca64b-30f9-4569-81a9-611476b4af3c tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:17.629127 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-22bca64b-30f9-4569-81a9-611476b4af3c tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b794eec6c6346cd981cbc4929be2d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e840dc8280574c4ba37942e50731f01c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:17.641756 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-22bca64b-30f9-4569-81a9-611476b4af3c tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/bb63079f-c8d9-4d31-8e45-7fac521c2066" status: 200 len: 1505 microversion: 2.1 time: 0.315045 Sep 08 11:04:17.642560 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2468/5030] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:17 2022] GET /compute/v2.1/servers/bb63079f-c8d9-4d31-8e45-7fac521c2066 => generated 1505 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:17.762680 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4a94cc28-b4b2-4e74-a69d-f558b2752502 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:17.763408 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4a94cc28-b4b2-4e74-a69d-f558b2752502 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] [instance: e6274d86-c6b8-43b2-926d-a02f5248c2d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:17.780154 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a94cc28-b4b2-4e74-a69d-f558b2752502 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:17.782091 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a94cc28-b4b2-4e74-a69d-f558b2752502 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:17.782808 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a94cc28-b4b2-4e74-a69d-f558b2752502 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:17.785106 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a94cc28-b4b2-4e74-a69d-f558b2752502 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:17.785961 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a94cc28-b4b2-4e74-a69d-f558b2752502 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:17.786686 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a94cc28-b4b2-4e74-a69d-f558b2752502 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:18.671036 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-11e02638-eb53-4e81-a4c7-458a44237ccf tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:18.671840 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-11e02638-eb53-4e81-a4c7-458a44237ccf tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: bb63079f-c8d9-4d31-8e45-7fac521c2066] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:18.696924 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-11e02638-eb53-4e81-a4c7-458a44237ccf tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:18.697507 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-11e02638-eb53-4e81-a4c7-458a44237ccf tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:18.697958 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-11e02638-eb53-4e81-a4c7-458a44237ccf tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:18.698691 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-11e02638-eb53-4e81-a4c7-458a44237ccf tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:18.699163 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-11e02638-eb53-4e81-a4c7-458a44237ccf tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:18.699594 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-11e02638-eb53-4e81-a4c7-458a44237ccf tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:18.708703 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4a94cc28-b4b2-4e74-a69d-f558b2752502 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8bb78a06234641b145546a8328f639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a358ca8de0b489481a98bdacac284a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:18.716632 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4a94cc28-b4b2-4e74-a69d-f558b2752502 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] 10.222.0.27 "GET /compute/v2.1/servers/e6274d86-c6b8-43b2-926d-a02f5248c2d5" status: 200 len: 1314 microversion: 2.1 time: 0.959428 Sep 08 11:04:18.721832 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2563/5031] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:17 2022] GET /compute/v2.1/servers/e6274d86-c6b8-43b2-926d-a02f5248c2d5 => generated 1314 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:18.990598 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-11e02638-eb53-4e81-a4c7-458a44237ccf tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b794eec6c6346cd981cbc4929be2d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e840dc8280574c4ba37942e50731f01c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:18.998923 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-11e02638-eb53-4e81-a4c7-458a44237ccf tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/bb63079f-c8d9-4d31-8e45-7fac521c2066" status: 200 len: 1505 microversion: 2.1 time: 0.331727 Sep 08 11:04:18.999843 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2469/5032] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:18 2022] GET /compute/v2.1/servers/bb63079f-c8d9-4d31-8e45-7fac521c2066 => generated 1505 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:04:19.571845 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-dde4469d-89f8-4342-b07d-221e924a17ae req-79d551d3-25e7-44c7-b8f0-a0cd5c9dc964 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6274d86-c6b8-43b2-926d-a02f5248c2d5", "name": "network-vif-plugged", "status": "completed", "tag": "49d058f2-d9b4-4ae8-b85f-2af8fd4dbbbe"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:04:19.591591 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-dde4469d-89f8-4342-b07d-221e924a17ae req-79d551d3-25e7-44c7-b8f0-a0cd5c9dc964 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:19.593584 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-dde4469d-89f8-4342-b07d-221e924a17ae req-79d551d3-25e7-44c7-b8f0-a0cd5c9dc964 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:19.597927 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-dde4469d-89f8-4342-b07d-221e924a17ae req-79d551d3-25e7-44c7-b8f0-a0cd5c9dc964 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:19.626613 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-dde4469d-89f8-4342-b07d-221e924a17ae req-79d551d3-25e7-44c7-b8f0-a0cd5c9dc964 service nova] Creating event network-vif-plugged:49d058f2-d9b4-4ae8-b85f-2af8fd4dbbbe for instance e6274d86-c6b8-43b2-926d-a02f5248c2d5 on n-h2-850501-12 Sep 08 11:04:19.642148 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-dde4469d-89f8-4342-b07d-221e924a17ae req-79d551d3-25e7-44c7-b8f0-a0cd5c9dc964 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074075 Sep 08 11:04:19.643429 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2564/5033] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:04:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:04:19.749132 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0a52f933-6711-4a36-a92f-d9ef5246ee14 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:19.749772 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0a52f933-6711-4a36-a92f-d9ef5246ee14 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] [instance: e6274d86-c6b8-43b2-926d-a02f5248c2d5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:19.760824 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0a52f933-6711-4a36-a92f-d9ef5246ee14 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:19.768434 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0a52f933-6711-4a36-a92f-d9ef5246ee14 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:19.769053 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0a52f933-6711-4a36-a92f-d9ef5246ee14 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:19.769915 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0a52f933-6711-4a36-a92f-d9ef5246ee14 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:19.770477 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0a52f933-6711-4a36-a92f-d9ef5246ee14 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:19.770978 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0a52f933-6711-4a36-a92f-d9ef5246ee14 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:20.032877 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a817b164-e6a8-4d84-a799-2d606991f01f tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:20.034386 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a817b164-e6a8-4d84-a799-2d606991f01f tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: bb63079f-c8d9-4d31-8e45-7fac521c2066] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:20.056645 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a817b164-e6a8-4d84-a799-2d606991f01f tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:20.057852 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a817b164-e6a8-4d84-a799-2d606991f01f tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:20.058500 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a817b164-e6a8-4d84-a799-2d606991f01f tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:20.059607 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a817b164-e6a8-4d84-a799-2d606991f01f tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:20.060249 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a817b164-e6a8-4d84-a799-2d606991f01f tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:20.060946 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a817b164-e6a8-4d84-a799-2d606991f01f tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:20.569068 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a817b164-e6a8-4d84-a799-2d606991f01f tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b794eec6c6346cd981cbc4929be2d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e840dc8280574c4ba37942e50731f01c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:20.583289 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a817b164-e6a8-4d84-a799-2d606991f01f tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/bb63079f-c8d9-4d31-8e45-7fac521c2066" status: 200 len: 1505 microversion: 2.1 time: 0.558631 Sep 08 11:04:20.584002 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2565/5034] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:20 2022] GET /compute/v2.1/servers/bb63079f-c8d9-4d31-8e45-7fac521c2066 => generated 1505 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:20.668412 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0a52f933-6711-4a36-a92f-d9ef5246ee14 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8bb78a06234641b145546a8328f639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a358ca8de0b489481a98bdacac284a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:20.670758 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=75 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:04:20.679690 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0a52f933-6711-4a36-a92f-d9ef5246ee14 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] 10.222.0.27 "GET /compute/v2.1/servers/e6274d86-c6b8-43b2-926d-a02f5248c2d5" status: 200 len: 1314 microversion: 2.1 time: 0.937920 Sep 08 11:04:20.694244 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2470/5035] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:19 2022] GET /compute/v2.1/servers/e6274d86-c6b8-43b2-926d-a02f5248c2d5 => generated 1314 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:04:21.616714 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e3a06120-986f-4c03-b003-fa79be8fb8df tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:21.617293 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e3a06120-986f-4c03-b003-fa79be8fb8df tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: bb63079f-c8d9-4d31-8e45-7fac521c2066] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:21.630123 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e3a06120-986f-4c03-b003-fa79be8fb8df tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:21.630949 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e3a06120-986f-4c03-b003-fa79be8fb8df tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:21.632948 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e3a06120-986f-4c03-b003-fa79be8fb8df tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:21.633879 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e3a06120-986f-4c03-b003-fa79be8fb8df tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:21.638966 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e3a06120-986f-4c03-b003-fa79be8fb8df tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:21.639643 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e3a06120-986f-4c03-b003-fa79be8fb8df tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:21.654850 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:04:21.708303 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-01ae5b69-2ad8-42f0-bb14-659ec366ecc3 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:21.709757 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-01ae5b69-2ad8-42f0-bb14-659ec366ecc3 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] [instance: e6274d86-c6b8-43b2-926d-a02f5248c2d5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:21.718112 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:04:21.723702 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01ae5b69-2ad8-42f0-bb14-659ec366ecc3 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:21.724867 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01ae5b69-2ad8-42f0-bb14-659ec366ecc3 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:21.726794 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01ae5b69-2ad8-42f0-bb14-659ec366ecc3 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:21.728883 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01ae5b69-2ad8-42f0-bb14-659ec366ecc3 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:21.729579 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01ae5b69-2ad8-42f0-bb14-659ec366ecc3 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:21.731226 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01ae5b69-2ad8-42f0-bb14-659ec366ecc3 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:22.133063 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e3a06120-986f-4c03-b003-fa79be8fb8df tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b794eec6c6346cd981cbc4929be2d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e840dc8280574c4ba37942e50731f01c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:22.153558 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e3a06120-986f-4c03-b003-fa79be8fb8df tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/bb63079f-c8d9-4d31-8e45-7fac521c2066" status: 200 len: 1505 microversion: 2.1 time: 0.540605 Sep 08 11:04:22.162276 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2566/5036] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:21 2022] GET /compute/v2.1/servers/bb63079f-c8d9-4d31-8e45-7fac521c2066 => generated 1505 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:22.327384 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-01ae5b69-2ad8-42f0-bb14-659ec366ecc3 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8bb78a06234641b145546a8328f639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a358ca8de0b489481a98bdacac284a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:22.342422 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-01ae5b69-2ad8-42f0-bb14-659ec366ecc3 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] 10.222.0.27 "GET /compute/v2.1/servers/e6274d86-c6b8-43b2-926d-a02f5248c2d5" status: 200 len: 1314 microversion: 2.1 time: 0.635836 Sep 08 11:04:22.343196 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2471/5037] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:21 2022] GET /compute/v2.1/servers/e6274d86-c6b8-43b2-926d-a02f5248c2d5 => generated 1314 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:04:23.193438 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d0fdb9db-55e4-4db0-ba52-3b59c58a78f6 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:23.194062 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d0fdb9db-55e4-4db0-ba52-3b59c58a78f6 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: bb63079f-c8d9-4d31-8e45-7fac521c2066] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:23.198348 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=37 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:04:23.209661 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d0fdb9db-55e4-4db0-ba52-3b59c58a78f6 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:23.210181 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d0fdb9db-55e4-4db0-ba52-3b59c58a78f6 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:23.210696 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d0fdb9db-55e4-4db0-ba52-3b59c58a78f6 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:23.214322 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d0fdb9db-55e4-4db0-ba52-3b59c58a78f6 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:23.215905 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d0fdb9db-55e4-4db0-ba52-3b59c58a78f6 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:23.218055 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d0fdb9db-55e4-4db0-ba52-3b59c58a78f6 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:23.369845 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a6354b9c-f7bb-4fba-b986-b79c3bce7994 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:23.371063 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a6354b9c-f7bb-4fba-b986-b79c3bce7994 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] [instance: e6274d86-c6b8-43b2-926d-a02f5248c2d5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:23.397394 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a6354b9c-f7bb-4fba-b986-b79c3bce7994 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:23.399264 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a6354b9c-f7bb-4fba-b986-b79c3bce7994 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:23.402905 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a6354b9c-f7bb-4fba-b986-b79c3bce7994 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:23.404494 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a6354b9c-f7bb-4fba-b986-b79c3bce7994 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:23.408140 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a6354b9c-f7bb-4fba-b986-b79c3bce7994 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:23.410106 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a6354b9c-f7bb-4fba-b986-b79c3bce7994 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:23.729824 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d0fdb9db-55e4-4db0-ba52-3b59c58a78f6 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b794eec6c6346cd981cbc4929be2d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e840dc8280574c4ba37942e50731f01c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:23.738720 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d0fdb9db-55e4-4db0-ba52-3b59c58a78f6 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/bb63079f-c8d9-4d31-8e45-7fac521c2066" status: 200 len: 1505 microversion: 2.1 time: 0.550789 Sep 08 11:04:23.739624 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2567/5038] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:23 2022] GET /compute/v2.1/servers/bb63079f-c8d9-4d31-8e45-7fac521c2066 => generated 1505 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:23.756099 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a6354b9c-f7bb-4fba-b986-b79c3bce7994 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8bb78a06234641b145546a8328f639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a358ca8de0b489481a98bdacac284a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:23.776284 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a6354b9c-f7bb-4fba-b986-b79c3bce7994 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] 10.222.0.27 "GET /compute/v2.1/servers/e6274d86-c6b8-43b2-926d-a02f5248c2d5" status: 200 len: 1499 microversion: 2.1 time: 0.411788 Sep 08 11:04:23.777564 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2472/5039] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:23 2022] GET /compute/v2.1/servers/e6274d86-c6b8-43b2-926d-a02f5248c2d5 => generated 1499 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:24.507012 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-782df0c9-d480-4472-a0b2-03ccc068706c tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:24.508174 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-782df0c9-d480-4472-a0b2-03ccc068706c tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] [instance: e6274d86-c6b8-43b2-926d-a02f5248c2d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:24.517776 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-782df0c9-d480-4472-a0b2-03ccc068706c tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:24.518520 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-782df0c9-d480-4472-a0b2-03ccc068706c tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:24.519166 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-782df0c9-d480-4472-a0b2-03ccc068706c tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:24.520142 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-782df0c9-d480-4472-a0b2-03ccc068706c tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:24.520812 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-782df0c9-d480-4472-a0b2-03ccc068706c tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:24.521705 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-782df0c9-d480-4472-a0b2-03ccc068706c tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:24.564616 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-782df0c9-d480-4472-a0b2-03ccc068706c tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] [instance: e6274d86-c6b8-43b2-926d-a02f5248c2d5] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:04:24.751480 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-782df0c9-d480-4472-a0b2-03ccc068706c tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e6274d86-c6b8-43b2-926d-a02f5248c2d5" status: 204 len: 0 microversion: 2.1 time: 0.249254 Sep 08 11:04:24.753395 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2568/5040] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:04:24 2022] DELETE /compute/v2.1/servers/e6274d86-c6b8-43b2-926d-a02f5248c2d5 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:04:24.763114 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ae814763-5229-414b-815f-ddc9ccc9f8f8 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:24.764511 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ae814763-5229-414b-815f-ddc9ccc9f8f8 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] [instance: e6274d86-c6b8-43b2-926d-a02f5248c2d5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:24.779437 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae814763-5229-414b-815f-ddc9ccc9f8f8 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:24.783015 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae814763-5229-414b-815f-ddc9ccc9f8f8 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:24.784363 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae814763-5229-414b-815f-ddc9ccc9f8f8 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:24.785455 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-539613c1-1c97-4c35-b48a-05fa724e080a tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:24.786557 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae814763-5229-414b-815f-ddc9ccc9f8f8 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:24.787614 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-539613c1-1c97-4c35-b48a-05fa724e080a tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: bb63079f-c8d9-4d31-8e45-7fac521c2066] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:24.789267 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae814763-5229-414b-815f-ddc9ccc9f8f8 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:24.790047 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae814763-5229-414b-815f-ddc9ccc9f8f8 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:24.809729 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-539613c1-1c97-4c35-b48a-05fa724e080a tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:24.810242 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-539613c1-1c97-4c35-b48a-05fa724e080a tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:24.810697 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-539613c1-1c97-4c35-b48a-05fa724e080a tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:24.811428 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-539613c1-1c97-4c35-b48a-05fa724e080a tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:24.811885 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-539613c1-1c97-4c35-b48a-05fa724e080a tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:24.812309 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-539613c1-1c97-4c35-b48a-05fa724e080a tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:25.114619 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ae814763-5229-414b-815f-ddc9ccc9f8f8 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8bb78a06234641b145546a8328f639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a358ca8de0b489481a98bdacac284a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:25.126641 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ae814763-5229-414b-815f-ddc9ccc9f8f8 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] 10.222.0.27 "GET /compute/v2.1/servers/e6274d86-c6b8-43b2-926d-a02f5248c2d5" status: 200 len: 1505 microversion: 2.1 time: 0.368690 Sep 08 11:04:25.133880 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2473/5041] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:24 2022] GET /compute/v2.1/servers/e6274d86-c6b8-43b2-926d-a02f5248c2d5 => generated 1505 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:25.380309 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-539613c1-1c97-4c35-b48a-05fa724e080a tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b794eec6c6346cd981cbc4929be2d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e840dc8280574c4ba37942e50731f01c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:25.391096 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-539613c1-1c97-4c35-b48a-05fa724e080a tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/bb63079f-c8d9-4d31-8e45-7fac521c2066" status: 200 len: 1505 microversion: 2.1 time: 0.618559 Sep 08 11:04:25.395829 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2569/5042] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:24 2022] GET /compute/v2.1/servers/bb63079f-c8d9-4d31-8e45-7fac521c2066 => generated 1505 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:26.166715 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1211fe1c-9a1d-4382-82fa-df25c722d292 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:26.167879 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1211fe1c-9a1d-4382-82fa-df25c722d292 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] [instance: e6274d86-c6b8-43b2-926d-a02f5248c2d5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:26.192641 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1211fe1c-9a1d-4382-82fa-df25c722d292 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:26.193824 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1211fe1c-9a1d-4382-82fa-df25c722d292 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:26.193824 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1211fe1c-9a1d-4382-82fa-df25c722d292 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:26.201943 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1211fe1c-9a1d-4382-82fa-df25c722d292 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:26.205201 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1211fe1c-9a1d-4382-82fa-df25c722d292 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:26.206047 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1211fe1c-9a1d-4382-82fa-df25c722d292 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:26.422577 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-eadbc719-df8e-4f4e-a853-0da3d819ec1e tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:26.423208 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-eadbc719-df8e-4f4e-a853-0da3d819ec1e tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: bb63079f-c8d9-4d31-8e45-7fac521c2066] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:26.434916 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eadbc719-df8e-4f4e-a853-0da3d819ec1e tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:26.435700 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eadbc719-df8e-4f4e-a853-0da3d819ec1e tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:26.436875 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eadbc719-df8e-4f4e-a853-0da3d819ec1e tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:26.438373 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eadbc719-df8e-4f4e-a853-0da3d819ec1e tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:26.439022 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eadbc719-df8e-4f4e-a853-0da3d819ec1e tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:26.439634 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eadbc719-df8e-4f4e-a853-0da3d819ec1e tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:26.717247 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-eadbc719-df8e-4f4e-a853-0da3d819ec1e tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b794eec6c6346cd981cbc4929be2d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e840dc8280574c4ba37942e50731f01c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:26.730049 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-eadbc719-df8e-4f4e-a853-0da3d819ec1e tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/bb63079f-c8d9-4d31-8e45-7fac521c2066" status: 200 len: 1505 microversion: 2.1 time: 0.312113 Sep 08 11:04:26.731350 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2570/5043] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:26 2022] GET /compute/v2.1/servers/bb63079f-c8d9-4d31-8e45-7fac521c2066 => generated 1505 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:04:27.057748 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1211fe1c-9a1d-4382-82fa-df25c722d292 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8bb78a06234641b145546a8328f639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a358ca8de0b489481a98bdacac284a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:27.074633 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1211fe1c-9a1d-4382-82fa-df25c722d292 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] 10.222.0.27 "GET /compute/v2.1/servers/e6274d86-c6b8-43b2-926d-a02f5248c2d5" status: 200 len: 1505 microversion: 2.1 time: 0.911345 Sep 08 11:04:27.075925 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2474/5044] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:26 2022] GET /compute/v2.1/servers/e6274d86-c6b8-43b2-926d-a02f5248c2d5 => generated 1505 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:27.433875 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-3ebf783e-e551-42fb-9bc7-152ecc580f72 req-58552d30-a885-47a2-82b4-c2074f29ddf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6274d86-c6b8-43b2-926d-a02f5248c2d5", "name": "network-vif-deleted", "tag": "49d058f2-d9b4-4ae8-b85f-2af8fd4dbbbe"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:04:27.451257 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-3ebf783e-e551-42fb-9bc7-152ecc580f72 req-58552d30-a885-47a2-82b4-c2074f29ddf3 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:27.451762 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-3ebf783e-e551-42fb-9bc7-152ecc580f72 req-58552d30-a885-47a2-82b4-c2074f29ddf3 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:27.452451 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-3ebf783e-e551-42fb-9bc7-152ecc580f72 req-58552d30-a885-47a2-82b4-c2074f29ddf3 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:27.492005 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-3ebf783e-e551-42fb-9bc7-152ecc580f72 req-58552d30-a885-47a2-82b4-c2074f29ddf3 service nova] Creating event network-vif-deleted:49d058f2-d9b4-4ae8-b85f-2af8fd4dbbbe for instance e6274d86-c6b8-43b2-926d-a02f5248c2d5 on n-h2-850501-12 Sep 08 11:04:27.511011 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-3ebf783e-e551-42fb-9bc7-152ecc580f72 req-58552d30-a885-47a2-82b4-c2074f29ddf3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081322 Sep 08 11:04:27.511656 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2571/5045] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:04:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:04:27.757754 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-93686637-dc3c-4266-a757-8848d4d71ee8 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:27.759004 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-93686637-dc3c-4266-a757-8848d4d71ee8 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: bb63079f-c8d9-4d31-8e45-7fac521c2066] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:27.772975 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-93686637-dc3c-4266-a757-8848d4d71ee8 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:27.774173 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-93686637-dc3c-4266-a757-8848d4d71ee8 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:27.776294 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-93686637-dc3c-4266-a757-8848d4d71ee8 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:27.777280 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-93686637-dc3c-4266-a757-8848d4d71ee8 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:27.778594 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-93686637-dc3c-4266-a757-8848d4d71ee8 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:27.779238 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-93686637-dc3c-4266-a757-8848d4d71ee8 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:28.108328 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0d767a65-308d-40b5-ab95-e841a3766d11 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:28.121045 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0d767a65-308d-40b5-ab95-e841a3766d11 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] [instance: e6274d86-c6b8-43b2-926d-a02f5248c2d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:28.161423 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d767a65-308d-40b5-ab95-e841a3766d11 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:28.162378 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d767a65-308d-40b5-ab95-e841a3766d11 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:28.163355 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d767a65-308d-40b5-ab95-e841a3766d11 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:28.164491 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d767a65-308d-40b5-ab95-e841a3766d11 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:28.165312 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d767a65-308d-40b5-ab95-e841a3766d11 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:28.169159 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d767a65-308d-40b5-ab95-e841a3766d11 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:28.269292 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d767a65-308d-40b5-ab95-e841a3766d11 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:28.283637 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d767a65-308d-40b5-ab95-e841a3766d11 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:28.284415 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d767a65-308d-40b5-ab95-e841a3766d11 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:28.286108 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-0d767a65-308d-40b5-ab95-e841a3766d11 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lazy-loading 'fault' on Instance uuid e6274d86-c6b8-43b2-926d-a02f5248c2d5 {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:04:28.378884 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-93686637-dc3c-4266-a757-8848d4d71ee8 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b794eec6c6346cd981cbc4929be2d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e840dc8280574c4ba37942e50731f01c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:28.391191 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-93686637-dc3c-4266-a757-8848d4d71ee8 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/bb63079f-c8d9-4d31-8e45-7fac521c2066" status: 200 len: 1505 microversion: 2.1 time: 0.637080 Sep 08 11:04:28.392070 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2475/5046] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:27 2022] GET /compute/v2.1/servers/bb63079f-c8d9-4d31-8e45-7fac521c2066 => generated 1505 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:28.522331 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0d767a65-308d-40b5-ab95-e841a3766d11 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8bb78a06234641b145546a8328f639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a358ca8de0b489481a98bdacac284a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:28.539085 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0d767a65-308d-40b5-ab95-e841a3766d11 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] 10.222.0.27 "GET /compute/v2.1/servers/e6274d86-c6b8-43b2-926d-a02f5248c2d5" status: 200 len: 1304 microversion: 2.1 time: 0.440205 Sep 08 11:04:28.553118 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2572/5047] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:28 2022] GET /compute/v2.1/servers/e6274d86-c6b8-43b2-926d-a02f5248c2d5 => generated 1304 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:04:29.427478 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-44eb0abe-9de0-4fa4-98bd-8b702dc6da0f tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:29.437912 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-44eb0abe-9de0-4fa4-98bd-8b702dc6da0f tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: bb63079f-c8d9-4d31-8e45-7fac521c2066] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:29.447801 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-44eb0abe-9de0-4fa4-98bd-8b702dc6da0f tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:29.448810 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-44eb0abe-9de0-4fa4-98bd-8b702dc6da0f tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:29.449977 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-44eb0abe-9de0-4fa4-98bd-8b702dc6da0f tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:29.450966 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-44eb0abe-9de0-4fa4-98bd-8b702dc6da0f tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:29.451760 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-44eb0abe-9de0-4fa4-98bd-8b702dc6da0f tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:29.452424 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-44eb0abe-9de0-4fa4-98bd-8b702dc6da0f tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:29.568398 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2c532b8f-3172-4257-a439-d58b86e48d2a tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:29.569017 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2c532b8f-3172-4257-a439-d58b86e48d2a tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] [instance: e6274d86-c6b8-43b2-926d-a02f5248c2d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:29.584868 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2c532b8f-3172-4257-a439-d58b86e48d2a tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:29.585900 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2c532b8f-3172-4257-a439-d58b86e48d2a tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:29.585900 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2c532b8f-3172-4257-a439-d58b86e48d2a tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:29.586600 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2c532b8f-3172-4257-a439-d58b86e48d2a tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:29.587070 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2c532b8f-3172-4257-a439-d58b86e48d2a tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:29.587506 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2c532b8f-3172-4257-a439-d58b86e48d2a tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:29.637443 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-2c532b8f-3172-4257-a439-d58b86e48d2a tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] HTTP exception thrown: Instance e6274d86-c6b8-43b2-926d-a02f5248c2d5 could not be found. Sep 08 11:04:29.639163 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2c532b8f-3172-4257-a439-d58b86e48d2a tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Request method failure captured: Sep 08 11:04:29.639163 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/e6274d86-c6b8-43b2-926d-a02f5248c2d5 HTTP/1.1 Sep 08 11:04:29.639163 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:04:29.639163 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:04:29.639163 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:04:29.639163 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 11:04:29.639163 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:04:29.639163 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:04:29.639163 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:04:29.639163 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:04:29.639163 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcwgsDN_sWqlCrPT9Dhnftz2zgtQyy7oHB8JaPjzAynRKIlGRNxy4ALBn16aWvYml1-qJSZhFDPnJJ4X57c6foAYPy4GVBd7ka_Yp4UYoP5PTrJbowsTLJnhfRvx9fw0u3x4zdglZ3GMWgSRfc2LBP5zkT0PRBaomtAuYDgEFC465QI Sep 08 11:04:29.639163 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:04:29.639163 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:04:29.639163 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:04:29.639163 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:04:29.639163 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:04:29.639163 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:04:29.639163 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 7a358ca8de0b489481a98bdacac284a0 Sep 08 11:04:29.639163 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-VolumesActionsTest-1223370134 Sep 08 11:04:29.639163 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:04:29.639163 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:04:29.639163 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7a358ca8de0b489481a98bdacac284a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7a358ca8de0b489481a98bdacac284a0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7a358ca8de0b489481a98bdacac284a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7a358ca8de0b489481a98bdacac284a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:04:29.639163 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-VolumesActionsTest-1223370134 Sep 08 11:04:29.639163 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 7a358ca8de0b489481a98bdacac284a0 Sep 08 11:04:29.639163 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-VolumesActionsTest-1223370134 Sep 08 11:04:29.639163 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-VolumesActionsTest-1223370134-project Sep 08 11:04:29.639163 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:04:29.639163 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:04:29.639163 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 0b8bb78a06234641b145546a8328f639 Sep 08 11:04:29.639163 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-VolumesActionsTest-1223370134-project Sep 08 11:04:29.639163 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 11:04:29.639163 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance e6274d86-c6b8-43b2-926d-a02f5248c2d5 could not be found. Sep 08 11:04:29.639163 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': 'e6274d86-c6b8-43b2-926d-a02f5248c2d5'} Sep 08 11:04:29.639163 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:04:29.639163 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:04:29.639163 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:04:29.639163 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:04:29.639163 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:04:29.639163 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:04:29.639163 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:04:29.639163 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:04:29.639163 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:04:29.639163 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:04:29.639163 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6274d86-c6b8-43b2-926d-a02f5248c2d5 could not be found. Sep 08 11:04:29.639163 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:04:29.639163 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:04:29.639163 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:04:29.639163 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:04:29.639163 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:04:29.639163 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:04:29.639163 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:04:29.639163 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:04:29.639163 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:04:29.639163 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:04:29.639163 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:04:29.639163 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:04:29.639163 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:04:29.639163 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:04:29.639163 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:04:29.639163 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:04:29.639163 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6274d86-c6b8-43b2-926d-a02f5248c2d5 could not be found. Sep 08 11:04:29.639163 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:04:29.639163 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:04:29.639163 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:04:29.644415 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:04:29.644415 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:04:29.644415 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:04:29.644415 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:04:29.644415 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:04:29.644415 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6274d86-c6b8-43b2-926d-a02f5248c2d5 could not be found. Sep 08 11:04:29.644415 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:04:29.644415 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2c532b8f-3172-4257-a439-d58b86e48d2a tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Returning 404 to user: Instance e6274d86-c6b8-43b2-926d-a02f5248c2d5 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:04:29.644415 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2c532b8f-3172-4257-a439-d58b86e48d2a tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] 10.222.0.27 "GET /compute/v2.1/servers/e6274d86-c6b8-43b2-926d-a02f5248c2d5" status: 404 len: 111 microversion: 2.1 time: 0.077479 Sep 08 11:04:29.653904 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2573/5048] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:29 2022] GET /compute/v2.1/servers/e6274d86-c6b8-43b2-926d-a02f5248c2d5 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:04:29.716662 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-44eb0abe-9de0-4fa4-98bd-8b702dc6da0f tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b794eec6c6346cd981cbc4929be2d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e840dc8280574c4ba37942e50731f01c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:29.730451 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-44eb0abe-9de0-4fa4-98bd-8b702dc6da0f tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/bb63079f-c8d9-4d31-8e45-7fac521c2066" status: 200 len: 1505 microversion: 2.1 time: 0.312159 Sep 08 11:04:29.737206 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2476/5049] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:29 2022] GET /compute/v2.1/servers/bb63079f-c8d9-4d31-8e45-7fac521c2066 => generated 1505 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:29.833504 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9250c96b-a157-4c12-bbc6-1c5789aa6c7a tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-118859310", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "3ff0a267-4b99-4eda-8f9a-08e74f7ba99a"}]}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:04:29.910207 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-9250c96b-a157-4c12-bbc6-1c5789aa6c7a tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] validate_networks() for [('3ff0a267-4b99-4eda-8f9a-08e74f7ba99a', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:04:30.770060 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-aa26bef4-1bca-4042-967f-0016dfe00d4c tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:30.771362 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-aa26bef4-1bca-4042-967f-0016dfe00d4c tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: bb63079f-c8d9-4d31-8e45-7fac521c2066] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:30.783995 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa26bef4-1bca-4042-967f-0016dfe00d4c tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:30.791441 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa26bef4-1bca-4042-967f-0016dfe00d4c tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:30.792003 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa26bef4-1bca-4042-967f-0016dfe00d4c tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:30.793892 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa26bef4-1bca-4042-967f-0016dfe00d4c tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:30.794388 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa26bef4-1bca-4042-967f-0016dfe00d4c tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:30.794834 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa26bef4-1bca-4042-967f-0016dfe00d4c tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:31.391837 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-aa26bef4-1bca-4042-967f-0016dfe00d4c tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b794eec6c6346cd981cbc4929be2d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e840dc8280574c4ba37942e50731f01c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:31.408880 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-aa26bef4-1bca-4042-967f-0016dfe00d4c tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/bb63079f-c8d9-4d31-8e45-7fac521c2066" status: 200 len: 1505 microversion: 2.1 time: 0.653999 Sep 08 11:04:31.422603 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2477/5050] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:30 2022] GET /compute/v2.1/servers/bb63079f-c8d9-4d31-8e45-7fac521c2066 => generated 1505 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:31.746401 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-9250c96b-a157-4c12-bbc6-1c5789aa6c7a tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:04:31.747426 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-9250c96b-a157-4c12-bbc6-1c5789aa6c7a tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:04:31.748294 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-9250c96b-a157-4c12-bbc6-1c5789aa6c7a tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:04:31.748887 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-9250c96b-a157-4c12-bbc6-1c5789aa6c7a tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:04:31.751103 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-9250c96b-a157-4c12-bbc6-1c5789aa6c7a tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:04:31.778089 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9250c96b-a157-4c12-bbc6-1c5789aa6c7a tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:31.778984 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9250c96b-a157-4c12-bbc6-1c5789aa6c7a tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:31.779593 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9250c96b-a157-4c12-bbc6-1c5789aa6c7a tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:31.780726 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9250c96b-a157-4c12-bbc6-1c5789aa6c7a tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:31.781449 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9250c96b-a157-4c12-bbc6-1c5789aa6c7a tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:31.782997 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9250c96b-a157-4c12-bbc6-1c5789aa6c7a tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:31.845543 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-9250c96b-a157-4c12-bbc6-1c5789aa6c7a tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Getting quotas for project 7a358ca8de0b489481a98bdacac284a0. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:04:31.854968 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-9250c96b-a157-4c12-bbc6-1c5789aa6c7a tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Getting quotas for user 0b8bb78a06234641b145546a8328f639 and project 7a358ca8de0b489481a98bdacac284a0. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:04:31.904933 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9250c96b-a157-4c12-bbc6-1c5789aa6c7a tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:04:31.913634 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9250c96b-a157-4c12-bbc6-1c5789aa6c7a tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] [instance: dc7b95b8-bc96-44e6-a8ba-c9857f512396] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:04:32.076838 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9250c96b-a157-4c12-bbc6-1c5789aa6c7a tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.249569 Sep 08 11:04:32.084863 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2574/5051] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 11:04:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2261 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:04:32.097969 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4e45c8a2-14d5-4616-8aa2-ff30f0a922eb tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:32.099901 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4e45c8a2-14d5-4616-8aa2-ff30f0a922eb tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] [instance: dc7b95b8-bc96-44e6-a8ba-c9857f512396] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:32.438314 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e5b40f46-2d7a-4903-a497-12b3411b7bec tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:32.439898 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e5b40f46-2d7a-4903-a497-12b3411b7bec tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: bb63079f-c8d9-4d31-8e45-7fac521c2066] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:32.447271 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e5b40f46-2d7a-4903-a497-12b3411b7bec tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:32.447776 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e5b40f46-2d7a-4903-a497-12b3411b7bec tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:32.448213 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e5b40f46-2d7a-4903-a497-12b3411b7bec tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:32.448932 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e5b40f46-2d7a-4903-a497-12b3411b7bec tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:32.457717 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e5b40f46-2d7a-4903-a497-12b3411b7bec tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:32.458317 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e5b40f46-2d7a-4903-a497-12b3411b7bec tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:32.639998 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4e45c8a2-14d5-4616-8aa2-ff30f0a922eb tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8bb78a06234641b145546a8328f639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a358ca8de0b489481a98bdacac284a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:32.651938 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4e45c8a2-14d5-4616-8aa2-ff30f0a922eb tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] 10.222.0.27 "GET /compute/v2.1/servers/dc7b95b8-bc96-44e6-a8ba-c9857f512396" status: 200 len: 1213 microversion: 2.1 time: 0.559122 Sep 08 11:04:32.658288 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2478/5052] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:32 2022] GET /compute/v2.1/servers/dc7b95b8-bc96-44e6-a8ba-c9857f512396 => generated 1213 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:33.001112 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e5b40f46-2d7a-4903-a497-12b3411b7bec tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b794eec6c6346cd981cbc4929be2d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e840dc8280574c4ba37942e50731f01c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:33.015219 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e5b40f46-2d7a-4903-a497-12b3411b7bec tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/bb63079f-c8d9-4d31-8e45-7fac521c2066" status: 200 len: 1505 microversion: 2.1 time: 0.578916 Sep 08 11:04:33.028942 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2575/5053] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:32 2022] GET /compute/v2.1/servers/bb63079f-c8d9-4d31-8e45-7fac521c2066 => generated 1505 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:33.710822 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8746ebbc-9542-4d22-b067-063c6438c14f tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:33.711535 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8746ebbc-9542-4d22-b067-063c6438c14f tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] [instance: dc7b95b8-bc96-44e6-a8ba-c9857f512396] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:33.739523 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8746ebbc-9542-4d22-b067-063c6438c14f tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:33.740340 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8746ebbc-9542-4d22-b067-063c6438c14f tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:33.740954 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8746ebbc-9542-4d22-b067-063c6438c14f tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:33.749019 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8746ebbc-9542-4d22-b067-063c6438c14f tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:33.758363 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8746ebbc-9542-4d22-b067-063c6438c14f tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:33.759096 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8746ebbc-9542-4d22-b067-063c6438c14f tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:34.043711 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d7891e9a-c875-49e4-8d01-de27add31adb tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:34.045247 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d7891e9a-c875-49e4-8d01-de27add31adb tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: bb63079f-c8d9-4d31-8e45-7fac521c2066] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:34.060504 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d7891e9a-c875-49e4-8d01-de27add31adb tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:34.061013 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d7891e9a-c875-49e4-8d01-de27add31adb tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:34.061828 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d7891e9a-c875-49e4-8d01-de27add31adb tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:34.063815 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d7891e9a-c875-49e4-8d01-de27add31adb tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:34.064475 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d7891e9a-c875-49e4-8d01-de27add31adb tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:34.065121 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d7891e9a-c875-49e4-8d01-de27add31adb tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:34.130530 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8746ebbc-9542-4d22-b067-063c6438c14f tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8bb78a06234641b145546a8328f639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a358ca8de0b489481a98bdacac284a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:34.147903 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8746ebbc-9542-4d22-b067-063c6438c14f tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] 10.222.0.27 "GET /compute/v2.1/servers/dc7b95b8-bc96-44e6-a8ba-c9857f512396" status: 200 len: 1265 microversion: 2.1 time: 0.460277 Sep 08 11:04:34.163725 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2479/5054] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:33 2022] GET /compute/v2.1/servers/dc7b95b8-bc96-44e6-a8ba-c9857f512396 => generated 1265 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:34.674469 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d7891e9a-c875-49e4-8d01-de27add31adb tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b794eec6c6346cd981cbc4929be2d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e840dc8280574c4ba37942e50731f01c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:34.689525 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d7891e9a-c875-49e4-8d01-de27add31adb tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/bb63079f-c8d9-4d31-8e45-7fac521c2066" status: 200 len: 1505 microversion: 2.1 time: 0.649964 Sep 08 11:04:34.693247 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2576/5055] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:34 2022] GET /compute/v2.1/servers/bb63079f-c8d9-4d31-8e45-7fac521c2066 => generated 1505 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:35.176495 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a6d21848-a84e-4c25-917b-426b22384fa3 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:35.177806 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a6d21848-a84e-4c25-917b-426b22384fa3 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] [instance: dc7b95b8-bc96-44e6-a8ba-c9857f512396] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:35.202418 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a6d21848-a84e-4c25-917b-426b22384fa3 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:35.204064 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a6d21848-a84e-4c25-917b-426b22384fa3 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:35.204692 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a6d21848-a84e-4c25-917b-426b22384fa3 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:35.205658 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a6d21848-a84e-4c25-917b-426b22384fa3 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:35.206292 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a6d21848-a84e-4c25-917b-426b22384fa3 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:35.207057 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a6d21848-a84e-4c25-917b-426b22384fa3 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:35.537940 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a6d21848-a84e-4c25-917b-426b22384fa3 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8bb78a06234641b145546a8328f639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a358ca8de0b489481a98bdacac284a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:35.555206 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a6d21848-a84e-4c25-917b-426b22384fa3 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] 10.222.0.27 "GET /compute/v2.1/servers/dc7b95b8-bc96-44e6-a8ba-c9857f512396" status: 200 len: 1271 microversion: 2.1 time: 0.382248 Sep 08 11:04:35.571722 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2480/5056] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:35 2022] GET /compute/v2.1/servers/dc7b95b8-bc96-44e6-a8ba-c9857f512396 => generated 1271 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:35.727870 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5d31650c-9721-4028-bc5a-cf67f06658b2 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:35.730950 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5d31650c-9721-4028-bc5a-cf67f06658b2 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: bb63079f-c8d9-4d31-8e45-7fac521c2066] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:35.744766 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5d31650c-9721-4028-bc5a-cf67f06658b2 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:35.747867 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5d31650c-9721-4028-bc5a-cf67f06658b2 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:35.748688 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5d31650c-9721-4028-bc5a-cf67f06658b2 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:35.751327 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5d31650c-9721-4028-bc5a-cf67f06658b2 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:35.751972 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5d31650c-9721-4028-bc5a-cf67f06658b2 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:35.753625 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5d31650c-9721-4028-bc5a-cf67f06658b2 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:36.585699 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-08ad776f-2122-4974-9d78-b424cecf9527 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:36.591490 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-08ad776f-2122-4974-9d78-b424cecf9527 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] [instance: dc7b95b8-bc96-44e6-a8ba-c9857f512396] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:36.613769 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5d31650c-9721-4028-bc5a-cf67f06658b2 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b794eec6c6346cd981cbc4929be2d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e840dc8280574c4ba37942e50731f01c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:36.631763 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5d31650c-9721-4028-bc5a-cf67f06658b2 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/bb63079f-c8d9-4d31-8e45-7fac521c2066" status: 200 len: 1505 microversion: 2.1 time: 0.916728 Sep 08 11:04:36.634844 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2577/5057] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:35 2022] GET /compute/v2.1/servers/bb63079f-c8d9-4d31-8e45-7fac521c2066 => generated 1505 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:36.644661 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08ad776f-2122-4974-9d78-b424cecf9527 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:36.646974 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08ad776f-2122-4974-9d78-b424cecf9527 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:36.647748 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08ad776f-2122-4974-9d78-b424cecf9527 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:36.650674 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08ad776f-2122-4974-9d78-b424cecf9527 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:36.651606 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08ad776f-2122-4974-9d78-b424cecf9527 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:36.652490 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08ad776f-2122-4974-9d78-b424cecf9527 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:36.870414 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-08ad776f-2122-4974-9d78-b424cecf9527 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8bb78a06234641b145546a8328f639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a358ca8de0b489481a98bdacac284a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:36.919584 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-08ad776f-2122-4974-9d78-b424cecf9527 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] 10.222.0.27 "GET /compute/v2.1/servers/dc7b95b8-bc96-44e6-a8ba-c9857f512396" status: 200 len: 1271 microversion: 2.1 time: 0.323585 Sep 08 11:04:36.920896 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2481/5058] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:36 2022] GET /compute/v2.1/servers/dc7b95b8-bc96-44e6-a8ba-c9857f512396 => generated 1271 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:37.659732 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-91bc1584-bba7-4ce8-9df5-b0443d7dc85f tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:37.660370 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-91bc1584-bba7-4ce8-9df5-b0443d7dc85f tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: bb63079f-c8d9-4d31-8e45-7fac521c2066] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:37.676103 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-91bc1584-bba7-4ce8-9df5-b0443d7dc85f tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:37.676606 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-91bc1584-bba7-4ce8-9df5-b0443d7dc85f tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:37.689940 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-91bc1584-bba7-4ce8-9df5-b0443d7dc85f tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:37.696111 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-91bc1584-bba7-4ce8-9df5-b0443d7dc85f tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:37.696622 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-91bc1584-bba7-4ce8-9df5-b0443d7dc85f tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:37.703592 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-91bc1584-bba7-4ce8-9df5-b0443d7dc85f tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:37.946472 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a17c753d-da09-4807-8054-ba19157aa3bd tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:37.947724 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a17c753d-da09-4807-8054-ba19157aa3bd tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] [instance: dc7b95b8-bc96-44e6-a8ba-c9857f512396] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:37.984685 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a17c753d-da09-4807-8054-ba19157aa3bd tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:37.988903 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a17c753d-da09-4807-8054-ba19157aa3bd tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:37.990413 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a17c753d-da09-4807-8054-ba19157aa3bd tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:37.991206 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a17c753d-da09-4807-8054-ba19157aa3bd tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:37.991695 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a17c753d-da09-4807-8054-ba19157aa3bd tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:37.992139 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a17c753d-da09-4807-8054-ba19157aa3bd tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:38.144870 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-91bc1584-bba7-4ce8-9df5-b0443d7dc85f tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b794eec6c6346cd981cbc4929be2d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e840dc8280574c4ba37942e50731f01c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:38.174974 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-91bc1584-bba7-4ce8-9df5-b0443d7dc85f tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/bb63079f-c8d9-4d31-8e45-7fac521c2066" status: 200 len: 1505 microversion: 2.1 time: 0.519421 Sep 08 11:04:38.178396 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2578/5059] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:37 2022] GET /compute/v2.1/servers/bb63079f-c8d9-4d31-8e45-7fac521c2066 => generated 1505 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:39.099505 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a17c753d-da09-4807-8054-ba19157aa3bd tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8bb78a06234641b145546a8328f639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a358ca8de0b489481a98bdacac284a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:39.120433 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a17c753d-da09-4807-8054-ba19157aa3bd tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] 10.222.0.27 "GET /compute/v2.1/servers/dc7b95b8-bc96-44e6-a8ba-c9857f512396" status: 200 len: 1313 microversion: 2.1 time: 1.177757 Sep 08 11:04:39.128289 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2482/5060] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:37 2022] GET /compute/v2.1/servers/dc7b95b8-bc96-44e6-a8ba-c9857f512396 => generated 1313 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:39.207278 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3c1ceff2-1919-4599-bce0-c873a2258d46 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:39.210642 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3c1ceff2-1919-4599-bce0-c873a2258d46 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: bb63079f-c8d9-4d31-8e45-7fac521c2066] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:39.231190 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c1ceff2-1919-4599-bce0-c873a2258d46 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:39.238751 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c1ceff2-1919-4599-bce0-c873a2258d46 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:39.239847 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c1ceff2-1919-4599-bce0-c873a2258d46 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:39.244012 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c1ceff2-1919-4599-bce0-c873a2258d46 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:39.244958 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c1ceff2-1919-4599-bce0-c873a2258d46 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:39.245721 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c1ceff2-1919-4599-bce0-c873a2258d46 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:39.504969 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0a47f54b-62de-43cb-8092-ef93df9fb1ed tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:39.505509 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0a47f54b-62de-43cb-8092-ef93df9fb1ed tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:39.522458 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0a47f54b-62de-43cb-8092-ef93df9fb1ed tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:39.533993 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0a47f54b-62de-43cb-8092-ef93df9fb1ed tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:39.535413 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0a47f54b-62de-43cb-8092-ef93df9fb1ed tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:39.536677 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0a47f54b-62de-43cb-8092-ef93df9fb1ed tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:39.546834 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0a47f54b-62de-43cb-8092-ef93df9fb1ed tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:39.548095 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0a47f54b-62de-43cb-8092-ef93df9fb1ed tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:39.696787 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0a47f54b-62de-43cb-8092-ef93df9fb1ed tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:04:39.957178 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3c1ceff2-1919-4599-bce0-c873a2258d46 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b794eec6c6346cd981cbc4929be2d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e840dc8280574c4ba37942e50731f01c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:40.018380 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3c1ceff2-1919-4599-bce0-c873a2258d46 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/bb63079f-c8d9-4d31-8e45-7fac521c2066" status: 200 len: 1505 microversion: 2.1 time: 0.813400 Sep 08 11:04:40.025713 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0a47f54b-62de-43cb-8092-ef93df9fb1ed tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "DELETE /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 204 len: 0 microversion: 2.42 time: 1.036641 Sep 08 11:04:40.027950 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2579/5061] 10.222.0.27 () {60 vars in 1280 bytes} [Thu Sep 8 11:04:38 2022] DELETE /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 0 bytes in 1040 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 11:04:40.041209 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2483/5062] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:39 2022] GET /compute/v2.1/servers/bb63079f-c8d9-4d31-8e45-7fac521c2066 => generated 1505 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:40.050883 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f25dcd5f-c49f-4f19-ae43-fe51a3d944e1 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:40.051861 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f25dcd5f-c49f-4f19-ae43-fe51a3d944e1 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:40.070689 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f25dcd5f-c49f-4f19-ae43-fe51a3d944e1 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:40.073656 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f25dcd5f-c49f-4f19-ae43-fe51a3d944e1 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:40.077095 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f25dcd5f-c49f-4f19-ae43-fe51a3d944e1 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:40.078865 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f25dcd5f-c49f-4f19-ae43-fe51a3d944e1 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:40.081464 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f25dcd5f-c49f-4f19-ae43-fe51a3d944e1 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:40.083710 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f25dcd5f-c49f-4f19-ae43-fe51a3d944e1 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:40.147151 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a406ddaf-6ce8-4da3-9aa4-9de6ef986161 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:40.150553 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a406ddaf-6ce8-4da3-9aa4-9de6ef986161 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] [instance: dc7b95b8-bc96-44e6-a8ba-c9857f512396] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:40.168078 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a406ddaf-6ce8-4da3-9aa4-9de6ef986161 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:40.169091 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a406ddaf-6ce8-4da3-9aa4-9de6ef986161 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:40.171822 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a406ddaf-6ce8-4da3-9aa4-9de6ef986161 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:40.173161 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a406ddaf-6ce8-4da3-9aa4-9de6ef986161 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:40.174678 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a406ddaf-6ce8-4da3-9aa4-9de6ef986161 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:40.175412 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a406ddaf-6ce8-4da3-9aa4-9de6ef986161 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:40.849553 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f25dcd5f-c49f-4f19-ae43-fe51a3d944e1 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:40.866607 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f25dcd5f-c49f-4f19-ae43-fe51a3d944e1 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:40.875244 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f25dcd5f-c49f-4f19-ae43-fe51a3d944e1 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:40.876656 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f25dcd5f-c49f-4f19-ae43-fe51a3d944e1 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 2957 microversion: 2.42 time: 0.842788 Sep 08 11:04:40.893494 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2580/5063] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:04:40 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 2957 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:04:40.907278 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-05fd7d75-2505-45a6-bb5e-376db54850a6 req-c4a8869a-8c4e-4783-8ef6-32e2a39375e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc7b95b8-bc96-44e6-a8ba-c9857f512396", "tag": "b76bc23b-52a8-4121-9db1-6627806ca440"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:04:40.918552 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-05fd7d75-2505-45a6-bb5e-376db54850a6 req-c4a8869a-8c4e-4783-8ef6-32e2a39375e2 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:40.919414 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-05fd7d75-2505-45a6-bb5e-376db54850a6 req-c4a8869a-8c4e-4783-8ef6-32e2a39375e2 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:40.920053 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-05fd7d75-2505-45a6-bb5e-376db54850a6 req-c4a8869a-8c4e-4783-8ef6-32e2a39375e2 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:40.927242 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:04:40.964553 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-05fd7d75-2505-45a6-bb5e-376db54850a6 req-c4a8869a-8c4e-4783-8ef6-32e2a39375e2 service nova] Creating event network-changed:b76bc23b-52a8-4121-9db1-6627806ca440 for instance dc7b95b8-bc96-44e6-a8ba-c9857f512396 on n-h2-850501-12 Sep 08 11:04:40.983313 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-05fd7d75-2505-45a6-bb5e-376db54850a6 req-c4a8869a-8c4e-4783-8ef6-32e2a39375e2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084333 Sep 08 11:04:40.988649 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2581/5064] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:04:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:04:41.008169 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a406ddaf-6ce8-4da3-9aa4-9de6ef986161 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8bb78a06234641b145546a8328f639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a358ca8de0b489481a98bdacac284a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:41.020784 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a406ddaf-6ce8-4da3-9aa4-9de6ef986161 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] 10.222.0.27 "GET /compute/v2.1/servers/dc7b95b8-bc96-44e6-a8ba-c9857f512396" status: 200 len: 1313 microversion: 2.1 time: 0.878951 Sep 08 11:04:41.021493 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2484/5065] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:40 2022] GET /compute/v2.1/servers/dc7b95b8-bc96-44e6-a8ba-c9857f512396 => generated 1313 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:04:41.085505 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c5f3818d-0bcf-4c74-8520-33af1fa60adb tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:41.086634 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c5f3818d-0bcf-4c74-8520-33af1fa60adb tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: bb63079f-c8d9-4d31-8e45-7fac521c2066] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:41.147088 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c5f3818d-0bcf-4c74-8520-33af1fa60adb tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:41.149816 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c5f3818d-0bcf-4c74-8520-33af1fa60adb tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:41.150704 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c5f3818d-0bcf-4c74-8520-33af1fa60adb tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:41.152870 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c5f3818d-0bcf-4c74-8520-33af1fa60adb tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:41.156781 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c5f3818d-0bcf-4c74-8520-33af1fa60adb tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:41.158583 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c5f3818d-0bcf-4c74-8520-33af1fa60adb tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:41.803060 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:04:41.888038 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=6 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:04:41.911257 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-86929866-b0de-40ef-a192-28a249a34135 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:41.912576 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-86929866-b0de-40ef-a192-28a249a34135 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:41.924456 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-86929866-b0de-40ef-a192-28a249a34135 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:41.925292 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-86929866-b0de-40ef-a192-28a249a34135 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:41.927261 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-86929866-b0de-40ef-a192-28a249a34135 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:41.931108 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-86929866-b0de-40ef-a192-28a249a34135 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:41.931850 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-86929866-b0de-40ef-a192-28a249a34135 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:41.932480 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-86929866-b0de-40ef-a192-28a249a34135 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:42.387685 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c5f3818d-0bcf-4c74-8520-33af1fa60adb tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b794eec6c6346cd981cbc4929be2d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e840dc8280574c4ba37942e50731f01c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:42.402482 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c5f3818d-0bcf-4c74-8520-33af1fa60adb tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/bb63079f-c8d9-4d31-8e45-7fac521c2066" status: 200 len: 1505 microversion: 2.1 time: 1.327340 Sep 08 11:04:42.406089 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2582/5066] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:41 2022] GET /compute/v2.1/servers/bb63079f-c8d9-4d31-8e45-7fac521c2066 => generated 1505 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:42.415848 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0543faf6-4fae-4864-b9c1-bb82163be142 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:42.427875 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0543faf6-4fae-4864-b9c1-bb82163be142 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] [instance: dc7b95b8-bc96-44e6-a8ba-c9857f512396] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:42.448702 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0543faf6-4fae-4864-b9c1-bb82163be142 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:42.449366 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0543faf6-4fae-4864-b9c1-bb82163be142 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:42.449806 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0543faf6-4fae-4864-b9c1-bb82163be142 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:42.450584 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0543faf6-4fae-4864-b9c1-bb82163be142 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:42.451292 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0543faf6-4fae-4864-b9c1-bb82163be142 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:42.451884 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0543faf6-4fae-4864-b9c1-bb82163be142 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:42.557782 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-86929866-b0de-40ef-a192-28a249a34135 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:42.580339 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-86929866-b0de-40ef-a192-28a249a34135 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:42.583085 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-86929866-b0de-40ef-a192-28a249a34135 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:42.586536 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-86929866-b0de-40ef-a192-28a249a34135 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 2957 microversion: 2.42 time: 0.680268 Sep 08 11:04:42.588690 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2485/5067] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:04:41 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 2957 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 11:04:42.838523 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0543faf6-4fae-4864-b9c1-bb82163be142 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8bb78a06234641b145546a8328f639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a358ca8de0b489481a98bdacac284a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:42.880328 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0543faf6-4fae-4864-b9c1-bb82163be142 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] 10.222.0.27 "GET /compute/v2.1/servers/dc7b95b8-bc96-44e6-a8ba-c9857f512396" status: 200 len: 1313 microversion: 2.1 time: 0.471059 Sep 08 11:04:42.881479 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2583/5068] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:42 2022] GET /compute/v2.1/servers/dc7b95b8-bc96-44e6-a8ba-c9857f512396 => generated 1313 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:43.439780 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-96333381-c406-4a4f-be21-109859db416b tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:43.441047 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-96333381-c406-4a4f-be21-109859db416b tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: bb63079f-c8d9-4d31-8e45-7fac521c2066] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:43.461604 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:04:43.464372 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-96333381-c406-4a4f-be21-109859db416b tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:43.465275 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-96333381-c406-4a4f-be21-109859db416b tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:43.466027 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-96333381-c406-4a4f-be21-109859db416b tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:43.467019 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-96333381-c406-4a4f-be21-109859db416b tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:43.469541 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-96333381-c406-4a4f-be21-109859db416b tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:43.470865 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-96333381-c406-4a4f-be21-109859db416b tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:43.626331 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8718e30e-416a-4d06-9de6-24a7aaa02b35 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:43.626992 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8718e30e-416a-4d06-9de6-24a7aaa02b35 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:43.645939 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8718e30e-416a-4d06-9de6-24a7aaa02b35 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:43.647219 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8718e30e-416a-4d06-9de6-24a7aaa02b35 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:43.647686 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8718e30e-416a-4d06-9de6-24a7aaa02b35 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:43.654684 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8718e30e-416a-4d06-9de6-24a7aaa02b35 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:43.656030 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8718e30e-416a-4d06-9de6-24a7aaa02b35 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:43.657148 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8718e30e-416a-4d06-9de6-24a7aaa02b35 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:44.891536 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8718e30e-416a-4d06-9de6-24a7aaa02b35 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:44.918758 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8718e30e-416a-4d06-9de6-24a7aaa02b35 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:44.931008 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8718e30e-416a-4d06-9de6-24a7aaa02b35 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:44.938771 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8718e30e-416a-4d06-9de6-24a7aaa02b35 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 2957 microversion: 2.42 time: 1.317998 Sep 08 11:04:44.939655 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2584/5069] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:04:43 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 2957 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:04:44.950808 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4ecd79bc-5ce1-43e2-b2e7-891f8004b17b tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:44.959573 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4ecd79bc-5ce1-43e2-b2e7-891f8004b17b tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] [instance: dc7b95b8-bc96-44e6-a8ba-c9857f512396] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:44.985286 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ecd79bc-5ce1-43e2-b2e7-891f8004b17b tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:44.987839 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ecd79bc-5ce1-43e2-b2e7-891f8004b17b tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:44.987839 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ecd79bc-5ce1-43e2-b2e7-891f8004b17b tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:44.987839 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ecd79bc-5ce1-43e2-b2e7-891f8004b17b tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:44.987839 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ecd79bc-5ce1-43e2-b2e7-891f8004b17b tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:44.987839 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ecd79bc-5ce1-43e2-b2e7-891f8004b17b tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:45.651414 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-96333381-c406-4a4f-be21-109859db416b tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b794eec6c6346cd981cbc4929be2d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e840dc8280574c4ba37942e50731f01c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:45.687777 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-96333381-c406-4a4f-be21-109859db416b tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/bb63079f-c8d9-4d31-8e45-7fac521c2066" status: 200 len: 1505 microversion: 2.1 time: 2.239738 Sep 08 11:04:45.693663 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2486/5070] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:43 2022] GET /compute/v2.1/servers/bb63079f-c8d9-4d31-8e45-7fac521c2066 => generated 1505 bytes in 2263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:45.757199 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4ecd79bc-5ce1-43e2-b2e7-891f8004b17b tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8bb78a06234641b145546a8328f639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a358ca8de0b489481a98bdacac284a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:45.791134 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4ecd79bc-5ce1-43e2-b2e7-891f8004b17b tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] 10.222.0.27 "GET /compute/v2.1/servers/dc7b95b8-bc96-44e6-a8ba-c9857f512396" status: 200 len: 1313 microversion: 2.1 time: 0.829713 Sep 08 11:04:45.797100 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2585/5071] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:44 2022] GET /compute/v2.1/servers/dc7b95b8-bc96-44e6-a8ba-c9857f512396 => generated 1313 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:45.973438 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-85c3c17e-dfa8-4d66-a535-581aa88566a4 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:45.975870 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-85c3c17e-dfa8-4d66-a535-581aa88566a4 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:46.015778 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-85c3c17e-dfa8-4d66-a535-581aa88566a4 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:46.024248 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-85c3c17e-dfa8-4d66-a535-581aa88566a4 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:46.024856 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-85c3c17e-dfa8-4d66-a535-581aa88566a4 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:46.029788 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-85c3c17e-dfa8-4d66-a535-581aa88566a4 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:46.031136 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-85c3c17e-dfa8-4d66-a535-581aa88566a4 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:46.031580 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-85c3c17e-dfa8-4d66-a535-581aa88566a4 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:46.722487 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-74b3900a-6e7a-4cdf-9f65-0c97eea494eb tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:46.723116 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-74b3900a-6e7a-4cdf-9f65-0c97eea494eb tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: bb63079f-c8d9-4d31-8e45-7fac521c2066] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:46.742673 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-74b3900a-6e7a-4cdf-9f65-0c97eea494eb tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:46.743932 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-74b3900a-6e7a-4cdf-9f65-0c97eea494eb tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:46.744600 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-74b3900a-6e7a-4cdf-9f65-0c97eea494eb tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:46.749400 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-74b3900a-6e7a-4cdf-9f65-0c97eea494eb tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:46.750246 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-74b3900a-6e7a-4cdf-9f65-0c97eea494eb tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:46.751027 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-74b3900a-6e7a-4cdf-9f65-0c97eea494eb tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:47.100056 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-74b3900a-6e7a-4cdf-9f65-0c97eea494eb tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b794eec6c6346cd981cbc4929be2d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e840dc8280574c4ba37942e50731f01c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:47.109955 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-74b3900a-6e7a-4cdf-9f65-0c97eea494eb tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/bb63079f-c8d9-4d31-8e45-7fac521c2066" status: 200 len: 1485 microversion: 2.1 time: 0.392979 Sep 08 11:04:47.133523 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2586/5072] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:46 2022] GET /compute/v2.1/servers/bb63079f-c8d9-4d31-8e45-7fac521c2066 => generated 1485 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:04:47.167370 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-08362f73-0e0b-4aa3-847e-cadf4fe1fd8b tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:47.170054 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-08362f73-0e0b-4aa3-847e-cadf4fe1fd8b tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] [instance: dc7b95b8-bc96-44e6-a8ba-c9857f512396] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:47.183529 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-08362f73-0e0b-4aa3-847e-cadf4fe1fd8b tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:47.188656 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-08362f73-0e0b-4aa3-847e-cadf4fe1fd8b tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:47.189243 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-08362f73-0e0b-4aa3-847e-cadf4fe1fd8b tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:47.190425 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-08362f73-0e0b-4aa3-847e-cadf4fe1fd8b tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:47.192191 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-08362f73-0e0b-4aa3-847e-cadf4fe1fd8b tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:47.193260 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-08362f73-0e0b-4aa3-847e-cadf4fe1fd8b tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:47.252792 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-85c3c17e-dfa8-4d66-a535-581aa88566a4 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:47.269249 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-85c3c17e-dfa8-4d66-a535-581aa88566a4 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:47.272258 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-85c3c17e-dfa8-4d66-a535-581aa88566a4 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:47.277324 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-85c3c17e-dfa8-4d66-a535-581aa88566a4 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 2957 microversion: 2.42 time: 1.309348 Sep 08 11:04:47.290527 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2487/5073] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:04:45 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 2957 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:04:47.321174 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3258bdb1-ddff-4d5c-a46b-b14fd1849120 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1695079695", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:04:47.422492 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-3258bdb1-ddff-4d5c-a46b-b14fd1849120 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] validate_networks() for [('4755547e-2c92-473c-a725-42a753054a1d', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:04:47.479067 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-08362f73-0e0b-4aa3-847e-cadf4fe1fd8b tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8bb78a06234641b145546a8328f639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a358ca8de0b489481a98bdacac284a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:47.495929 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-08362f73-0e0b-4aa3-847e-cadf4fe1fd8b tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] 10.222.0.27 "GET /compute/v2.1/servers/dc7b95b8-bc96-44e6-a8ba-c9857f512396" status: 200 len: 1313 microversion: 2.1 time: 0.340975 Sep 08 11:04:47.497528 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2587/5074] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:47 2022] GET /compute/v2.1/servers/dc7b95b8-bc96-44e6-a8ba-c9857f512396 => generated 1313 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:48.309202 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-06f39d0a-23e2-4cab-bb26-29c9af20376a tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:48.310820 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-06f39d0a-23e2-4cab-bb26-29c9af20376a tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:48.325853 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06f39d0a-23e2-4cab-bb26-29c9af20376a tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:48.329840 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06f39d0a-23e2-4cab-bb26-29c9af20376a tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:48.330749 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06f39d0a-23e2-4cab-bb26-29c9af20376a tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:48.331803 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06f39d0a-23e2-4cab-bb26-29c9af20376a tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:48.339123 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06f39d0a-23e2-4cab-bb26-29c9af20376a tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:48.339764 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06f39d0a-23e2-4cab-bb26-29c9af20376a tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:49.297774 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-06f39d0a-23e2-4cab-bb26-29c9af20376a tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:49.316560 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-06f39d0a-23e2-4cab-bb26-29c9af20376a tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:49.318313 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-06f39d0a-23e2-4cab-bb26-29c9af20376a tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:49.321732 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-06f39d0a-23e2-4cab-bb26-29c9af20376a tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 2936 microversion: 2.42 time: 1.016464 Sep 08 11:04:49.337069 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2588/5075] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:04:48 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 2936 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 11:04:49.337842 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1f6485f3-dcbd-4519-a446-d49b2ba8ccc4 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:49.338461 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1f6485f3-dcbd-4519-a446-d49b2ba8ccc4 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] [instance: dc7b95b8-bc96-44e6-a8ba-c9857f512396] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:49.355818 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1f6485f3-dcbd-4519-a446-d49b2ba8ccc4 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:49.356466 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1f6485f3-dcbd-4519-a446-d49b2ba8ccc4 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:49.357073 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1f6485f3-dcbd-4519-a446-d49b2ba8ccc4 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:49.358637 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1f6485f3-dcbd-4519-a446-d49b2ba8ccc4 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:49.360390 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1f6485f3-dcbd-4519-a446-d49b2ba8ccc4 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:49.360937 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1f6485f3-dcbd-4519-a446-d49b2ba8ccc4 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:49.826541 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1f6485f3-dcbd-4519-a446-d49b2ba8ccc4 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8bb78a06234641b145546a8328f639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a358ca8de0b489481a98bdacac284a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:49.860696 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1f6485f3-dcbd-4519-a446-d49b2ba8ccc4 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] 10.222.0.27 "GET /compute/v2.1/servers/dc7b95b8-bc96-44e6-a8ba-c9857f512396" status: 200 len: 1313 microversion: 2.1 time: 0.534780 Sep 08 11:04:49.865892 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2589/5076] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:49 2022] GET /compute/v2.1/servers/dc7b95b8-bc96-44e6-a8ba-c9857f512396 => generated 1313 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:49.876839 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-09390c0d-50cf-46df-93de-3e2e78d9fd1f req-35b08326-9441-4699-8cc5-10d18be9a370 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59", "name": "network-vif-unplugged", "status": "completed", "tag": "ecb96651-93e7-41bd-9408-8b3399bfaef2"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:04:49.899196 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-09390c0d-50cf-46df-93de-3e2e78d9fd1f req-35b08326-9441-4699-8cc5-10d18be9a370 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:49.900802 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-09390c0d-50cf-46df-93de-3e2e78d9fd1f req-35b08326-9441-4699-8cc5-10d18be9a370 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:49.901626 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-09390c0d-50cf-46df-93de-3e2e78d9fd1f req-35b08326-9441-4699-8cc5-10d18be9a370 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:49.926585 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-09390c0d-50cf-46df-93de-3e2e78d9fd1f req-35b08326-9441-4699-8cc5-10d18be9a370 service nova] Creating event network-vif-unplugged:ecb96651-93e7-41bd-9408-8b3399bfaef2 for instance 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 on n-h2-850501-12 Sep 08 11:04:49.936768 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-09390c0d-50cf-46df-93de-3e2e78d9fd1f req-35b08326-9441-4699-8cc5-10d18be9a370 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065104 Sep 08 11:04:49.939724 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2590/5077] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:04:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:04:49.954622 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-3258bdb1-ddff-4d5c-a46b-b14fd1849120 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:04:49.955135 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-3258bdb1-ddff-4d5c-a46b-b14fd1849120 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:04:49.955714 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-3258bdb1-ddff-4d5c-a46b-b14fd1849120 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:04:49.956232 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-3258bdb1-ddff-4d5c-a46b-b14fd1849120 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:04:49.956805 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-3258bdb1-ddff-4d5c-a46b-b14fd1849120 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:04:49.977142 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3258bdb1-ddff-4d5c-a46b-b14fd1849120 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:49.978617 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3258bdb1-ddff-4d5c-a46b-b14fd1849120 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:49.979850 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3258bdb1-ddff-4d5c-a46b-b14fd1849120 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:49.982530 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3258bdb1-ddff-4d5c-a46b-b14fd1849120 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:49.983495 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3258bdb1-ddff-4d5c-a46b-b14fd1849120 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:49.984993 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3258bdb1-ddff-4d5c-a46b-b14fd1849120 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:50.019268 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-3258bdb1-ddff-4d5c-a46b-b14fd1849120 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Getting quotas for project e840dc8280574c4ba37942e50731f01c. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:04:50.038552 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-3258bdb1-ddff-4d5c-a46b-b14fd1849120 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Getting quotas for user 7b794eec6c6346cd981cbc4929be2d9a and project e840dc8280574c4ba37942e50731f01c. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:04:50.058952 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3258bdb1-ddff-4d5c-a46b-b14fd1849120 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:04:50.063028 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3258bdb1-ddff-4d5c-a46b-b14fd1849120 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: 938e014a-dca0-45aa-a90e-260597d8fd1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:04:50.170753 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3258bdb1-ddff-4d5c-a46b-b14fd1849120 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.853657 Sep 08 11:04:50.185897 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2488/5078] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 11:04:47 2022] POST /compute/v2.1/servers => generated 383 bytes in 2869 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 11:04:50.187802 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-22a895c6-00c0-4078-b469-d1424d1997bd tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:50.188521 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-22a895c6-00c0-4078-b469-d1424d1997bd tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: 938e014a-dca0-45aa-a90e-260597d8fd1f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:50.356185 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-43e77e13-3288-4aad-adfc-c70c484ab159 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:50.356871 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-43e77e13-3288-4aad-adfc-c70c484ab159 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:50.366856 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-43e77e13-3288-4aad-adfc-c70c484ab159 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:50.370961 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-43e77e13-3288-4aad-adfc-c70c484ab159 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:50.371809 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-43e77e13-3288-4aad-adfc-c70c484ab159 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:50.374459 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-43e77e13-3288-4aad-adfc-c70c484ab159 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:50.379612 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-43e77e13-3288-4aad-adfc-c70c484ab159 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:50.380367 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-43e77e13-3288-4aad-adfc-c70c484ab159 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:50.389920 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:04:51.106966 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-22a895c6-00c0-4078-b469-d1424d1997bd tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b794eec6c6346cd981cbc4929be2d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e840dc8280574c4ba37942e50731f01c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:51.122347 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-22a895c6-00c0-4078-b469-d1424d1997bd tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f" status: 200 len: 1214 microversion: 2.1 time: 0.938593 Sep 08 11:04:51.124307 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2591/5079] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:50 2022] GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f => generated 1214 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:51.135065 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-67a0e7b8-912f-49ac-b9a8-8ac43befe6b4 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:51.135705 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-67a0e7b8-912f-49ac-b9a8-8ac43befe6b4 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] [instance: dc7b95b8-bc96-44e6-a8ba-c9857f512396] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:51.163799 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-67a0e7b8-912f-49ac-b9a8-8ac43befe6b4 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:51.164347 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-67a0e7b8-912f-49ac-b9a8-8ac43befe6b4 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:51.164806 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-67a0e7b8-912f-49ac-b9a8-8ac43befe6b4 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:51.168098 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-67a0e7b8-912f-49ac-b9a8-8ac43befe6b4 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:51.168598 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-67a0e7b8-912f-49ac-b9a8-8ac43befe6b4 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:51.171153 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-67a0e7b8-912f-49ac-b9a8-8ac43befe6b4 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:51.807253 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-67a0e7b8-912f-49ac-b9a8-8ac43befe6b4 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8bb78a06234641b145546a8328f639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a358ca8de0b489481a98bdacac284a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:51.817312 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-67a0e7b8-912f-49ac-b9a8-8ac43befe6b4 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] 10.222.0.27 "GET /compute/v2.1/servers/dc7b95b8-bc96-44e6-a8ba-c9857f512396" status: 200 len: 1313 microversion: 2.1 time: 0.691828 Sep 08 11:04:51.823721 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2592/5080] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:51 2022] GET /compute/v2.1/servers/dc7b95b8-bc96-44e6-a8ba-c9857f512396 => generated 1313 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:52.004438 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-8efe5cbf-28e0-483e-a79d-4065d6b34af9 req-a9d44995-45e4-437e-91f1-ffec0dfffd05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59", "name": "network-vif-unplugged", "status": "completed", "tag": "d3dee7fc-0d23-496a-962c-d681c647d159"}, {"server_uuid": "954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59", "name": "network-vif-unplugged", "status": "completed", "tag": "0cd4ca73-de26-4dfe-88cc-7092866bcfee"}, {"server_uuid": "954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59", "name": "network-vif-unplugged", "status": "completed", "tag": "9239d9ef-a9de-493e-bc47-0fcce1dee834"}, {"server_uuid": "954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59", "name": "network-vif-unplugged", "status": "completed", "tag": "43a5e615-6fc8-4ec6-8b8a-8c3e382e1b29"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:04:52.042510 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-8efe5cbf-28e0-483e-a79d-4065d6b34af9 req-a9d44995-45e4-437e-91f1-ffec0dfffd05 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:52.048095 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-8efe5cbf-28e0-483e-a79d-4065d6b34af9 req-a9d44995-45e4-437e-91f1-ffec0dfffd05 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:52.050632 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-8efe5cbf-28e0-483e-a79d-4065d6b34af9 req-a9d44995-45e4-437e-91f1-ffec0dfffd05 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:52.161343 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-8efe5cbf-28e0-483e-a79d-4065d6b34af9 req-a9d44995-45e4-437e-91f1-ffec0dfffd05 service nova] Creating event network-vif-unplugged:d3dee7fc-0d23-496a-962c-d681c647d159 for instance 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 on n-h2-850501-12 Sep 08 11:04:52.164364 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-8efe5cbf-28e0-483e-a79d-4065d6b34af9 req-a9d44995-45e4-437e-91f1-ffec0dfffd05 service nova] Creating event network-vif-unplugged:0cd4ca73-de26-4dfe-88cc-7092866bcfee for instance 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 on n-h2-850501-12 Sep 08 11:04:52.179738 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-8efe5cbf-28e0-483e-a79d-4065d6b34af9 req-a9d44995-45e4-437e-91f1-ffec0dfffd05 service nova] Creating event network-vif-unplugged:9239d9ef-a9de-493e-bc47-0fcce1dee834 for instance 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 on n-h2-850501-12 Sep 08 11:04:52.189667 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-8efe5cbf-28e0-483e-a79d-4065d6b34af9 req-a9d44995-45e4-437e-91f1-ffec0dfffd05 service nova] Creating event network-vif-unplugged:43a5e615-6fc8-4ec6-8b8a-8c3e382e1b29 for instance 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 on n-h2-850501-12 Sep 08 11:04:52.218444 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-8efe5cbf-28e0-483e-a79d-4065d6b34af9 req-a9d44995-45e4-437e-91f1-ffec0dfffd05 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 704 microversion: 2.1 time: 0.206081 Sep 08 11:04:52.220413 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2593/5081] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:04:51 2022] POST /compute/v2.1/os-server-external-events => generated 704 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:04:52.225932 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f01cbb9b-14d3-40ea-ba6f-cf70a8b411d5 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:52.234601 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f01cbb9b-14d3-40ea-ba6f-cf70a8b411d5 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: 938e014a-dca0-45aa-a90e-260597d8fd1f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:52.241950 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f01cbb9b-14d3-40ea-ba6f-cf70a8b411d5 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:52.242620 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f01cbb9b-14d3-40ea-ba6f-cf70a8b411d5 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:52.243218 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f01cbb9b-14d3-40ea-ba6f-cf70a8b411d5 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:52.244113 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f01cbb9b-14d3-40ea-ba6f-cf70a8b411d5 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:52.244750 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f01cbb9b-14d3-40ea-ba6f-cf70a8b411d5 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:52.245365 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f01cbb9b-14d3-40ea-ba6f-cf70a8b411d5 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:52.344054 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-43e77e13-3288-4aad-adfc-c70c484ab159 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:52.348228 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f01cbb9b-14d3-40ea-ba6f-cf70a8b411d5 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b794eec6c6346cd981cbc4929be2d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e840dc8280574c4ba37942e50731f01c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:52.357380 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f01cbb9b-14d3-40ea-ba6f-cf70a8b411d5 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f" status: 200 len: 1266 microversion: 2.1 time: 0.135600 Sep 08 11:04:52.365741 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-43e77e13-3288-4aad-adfc-c70c484ab159 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:52.373013 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2594/5082] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:52 2022] GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:52.375399 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-43e77e13-3288-4aad-adfc-c70c484ab159 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:52.378480 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-43e77e13-3288-4aad-adfc-c70c484ab159 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 2936 microversion: 2.42 time: 2.027208 Sep 08 11:04:52.382142 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2489/5083] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:04:50 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 2936 bytes in 2032 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:04:52.848413 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7375dd67-1e7f-4b1c-9520-c6854b56dc16 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:52.849374 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7375dd67-1e7f-4b1c-9520-c6854b56dc16 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] [instance: dc7b95b8-bc96-44e6-a8ba-c9857f512396] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:52.856633 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7375dd67-1e7f-4b1c-9520-c6854b56dc16 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:52.869518 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7375dd67-1e7f-4b1c-9520-c6854b56dc16 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:52.873405 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7375dd67-1e7f-4b1c-9520-c6854b56dc16 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:52.875147 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7375dd67-1e7f-4b1c-9520-c6854b56dc16 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:52.880295 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7375dd67-1e7f-4b1c-9520-c6854b56dc16 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:52.882377 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7375dd67-1e7f-4b1c-9520-c6854b56dc16 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:53.396306 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-291f8c2b-f031-42bc-9e0f-286d740090bb tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:53.398083 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-291f8c2b-f031-42bc-9e0f-286d740090bb tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: 938e014a-dca0-45aa-a90e-260597d8fd1f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:53.406852 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:04:53.437614 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-291f8c2b-f031-42bc-9e0f-286d740090bb tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:53.438147 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-291f8c2b-f031-42bc-9e0f-286d740090bb tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:53.438649 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-291f8c2b-f031-42bc-9e0f-286d740090bb tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:53.439457 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-291f8c2b-f031-42bc-9e0f-286d740090bb tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:53.445704 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-291f8c2b-f031-42bc-9e0f-286d740090bb tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:53.446198 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-291f8c2b-f031-42bc-9e0f-286d740090bb tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:53.726698 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7375dd67-1e7f-4b1c-9520-c6854b56dc16 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8bb78a06234641b145546a8328f639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a358ca8de0b489481a98bdacac284a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:53.750649 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7375dd67-1e7f-4b1c-9520-c6854b56dc16 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] 10.222.0.27 "GET /compute/v2.1/servers/dc7b95b8-bc96-44e6-a8ba-c9857f512396" status: 200 len: 1313 microversion: 2.1 time: 0.901194 Sep 08 11:04:53.753376 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2595/5084] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:52 2022] GET /compute/v2.1/servers/dc7b95b8-bc96-44e6-a8ba-c9857f512396 => generated 1313 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:53.761683 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ca76f3e0-b5e3-4f22-ab96-d2fe712027e2 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:53.762557 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ca76f3e0-b5e3-4f22-ab96-d2fe712027e2 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:53.770287 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:04:53.774427 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ca76f3e0-b5e3-4f22-ab96-d2fe712027e2 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:53.775438 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ca76f3e0-b5e3-4f22-ab96-d2fe712027e2 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:53.776564 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ca76f3e0-b5e3-4f22-ab96-d2fe712027e2 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:53.778167 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ca76f3e0-b5e3-4f22-ab96-d2fe712027e2 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:53.778946 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ca76f3e0-b5e3-4f22-ab96-d2fe712027e2 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:53.780527 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ca76f3e0-b5e3-4f22-ab96-d2fe712027e2 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:53.849848 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-291f8c2b-f031-42bc-9e0f-286d740090bb tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b794eec6c6346cd981cbc4929be2d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e840dc8280574c4ba37942e50731f01c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:53.860249 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-291f8c2b-f031-42bc-9e0f-286d740090bb tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f" status: 200 len: 1272 microversion: 2.1 time: 0.475321 Sep 08 11:04:53.874144 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2490/5085] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:53 2022] GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f => generated 1272 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:04:54.234211 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ca76f3e0-b5e3-4f22-ab96-d2fe712027e2 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:54.244182 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ca76f3e0-b5e3-4f22-ab96-d2fe712027e2 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:54.257765 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-0d23a4d8-b29d-4808-8a2c-f7b3e213d675 req-56b80d73-f7a9-48e3-98ba-148bfae27554 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59", "name": "network-vif-unplugged", "status": "completed", "tag": "76a878f3-633e-4081-8c09-d5e66451d704"}, {"server_uuid": "dc7b95b8-bc96-44e6-a8ba-c9857f512396", "name": "network-vif-plugged", "status": "completed", "tag": "b76bc23b-52a8-4121-9db1-6627806ca440"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:04:54.260142 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ca76f3e0-b5e3-4f22-ab96-d2fe712027e2 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:54.261674 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ca76f3e0-b5e3-4f22-ab96-d2fe712027e2 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 2915 microversion: 2.42 time: 0.507090 Sep 08 11:04:54.268487 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2596/5086] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:04:53 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 2915 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:04:54.276621 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-0d23a4d8-b29d-4808-8a2c-f7b3e213d675 req-56b80d73-f7a9-48e3-98ba-148bfae27554 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:54.277152 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-0d23a4d8-b29d-4808-8a2c-f7b3e213d675 req-56b80d73-f7a9-48e3-98ba-148bfae27554 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:54.277586 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-0d23a4d8-b29d-4808-8a2c-f7b3e213d675 req-56b80d73-f7a9-48e3-98ba-148bfae27554 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:54.325300 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-0d23a4d8-b29d-4808-8a2c-f7b3e213d675 req-56b80d73-f7a9-48e3-98ba-148bfae27554 service nova] Creating event network-vif-unplugged:76a878f3-633e-4081-8c09-d5e66451d704 for instance 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 on n-h2-850501-12 Sep 08 11:04:54.325825 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-0d23a4d8-b29d-4808-8a2c-f7b3e213d675 req-56b80d73-f7a9-48e3-98ba-148bfae27554 service nova] Creating event network-vif-plugged:b76bc23b-52a8-4121-9db1-6627806ca440 for instance dc7b95b8-bc96-44e6-a8ba-c9857f512396 on n-h2-850501-12 Sep 08 11:04:54.351765 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-0d23a4d8-b29d-4808-8a2c-f7b3e213d675 req-56b80d73-f7a9-48e3-98ba-148bfae27554 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.097621 Sep 08 11:04:54.353198 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2491/5087] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:04:54 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:04:54.779130 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-52a9a403-8627-4e2a-8651-ef6fce1da066 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:54.780911 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-52a9a403-8627-4e2a-8651-ef6fce1da066 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] [instance: dc7b95b8-bc96-44e6-a8ba-c9857f512396] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:54.797738 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-52a9a403-8627-4e2a-8651-ef6fce1da066 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:54.799126 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-52a9a403-8627-4e2a-8651-ef6fce1da066 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:54.800935 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-52a9a403-8627-4e2a-8651-ef6fce1da066 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:54.802518 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-52a9a403-8627-4e2a-8651-ef6fce1da066 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:54.804222 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-52a9a403-8627-4e2a-8651-ef6fce1da066 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:54.805483 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-52a9a403-8627-4e2a-8651-ef6fce1da066 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:54.896865 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3e9376d3-caf4-4b1e-b680-b1b629c3d536 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:54.900730 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3e9376d3-caf4-4b1e-b680-b1b629c3d536 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: 938e014a-dca0-45aa-a90e-260597d8fd1f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:54.931975 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e9376d3-caf4-4b1e-b680-b1b629c3d536 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:54.954748 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e9376d3-caf4-4b1e-b680-b1b629c3d536 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:54.955468 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e9376d3-caf4-4b1e-b680-b1b629c3d536 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:54.957738 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e9376d3-caf4-4b1e-b680-b1b629c3d536 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:54.962558 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e9376d3-caf4-4b1e-b680-b1b629c3d536 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:54.964794 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e9376d3-caf4-4b1e-b680-b1b629c3d536 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:55.611431 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-52a9a403-8627-4e2a-8651-ef6fce1da066 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8bb78a06234641b145546a8328f639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a358ca8de0b489481a98bdacac284a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:55.622839 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-52a9a403-8627-4e2a-8651-ef6fce1da066 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] 10.222.0.27 "GET /compute/v2.1/servers/dc7b95b8-bc96-44e6-a8ba-c9857f512396" status: 200 len: 1313 microversion: 2.1 time: 0.848322 Sep 08 11:04:55.623987 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2597/5088] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:54 2022] GET /compute/v2.1/servers/dc7b95b8-bc96-44e6-a8ba-c9857f512396 => generated 1313 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:55.646117 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-82206a81-796e-4f7e-8634-d49f88af938f tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:55.647007 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-82206a81-796e-4f7e-8634-d49f88af938f tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:55.658361 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-82206a81-796e-4f7e-8634-d49f88af938f tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:55.661770 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-82206a81-796e-4f7e-8634-d49f88af938f tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:55.662438 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-82206a81-796e-4f7e-8634-d49f88af938f tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:55.663187 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-82206a81-796e-4f7e-8634-d49f88af938f tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:55.663646 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-82206a81-796e-4f7e-8634-d49f88af938f tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:55.664082 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-82206a81-796e-4f7e-8634-d49f88af938f tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:55.750832 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3e9376d3-caf4-4b1e-b680-b1b629c3d536 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b794eec6c6346cd981cbc4929be2d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e840dc8280574c4ba37942e50731f01c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:55.768163 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3e9376d3-caf4-4b1e-b680-b1b629c3d536 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f" status: 200 len: 1272 microversion: 2.1 time: 0.875573 Sep 08 11:04:55.783203 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2492/5089] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:54 2022] GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f => generated 1272 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:56.537095 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-82206a81-796e-4f7e-8634-d49f88af938f tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:56.560898 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-82206a81-796e-4f7e-8634-d49f88af938f tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:56.590147 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-82206a81-796e-4f7e-8634-d49f88af938f tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:56.594341 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-82206a81-796e-4f7e-8634-d49f88af938f tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 2915 microversion: 2.42 time: 0.958371 Sep 08 11:04:56.596632 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2598/5090] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:04:55 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 2915 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:04:56.649670 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2f4049f7-45c8-4fa9-bca2-c5babe9aeb8b tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:56.651673 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2f4049f7-45c8-4fa9-bca2-c5babe9aeb8b tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] [instance: dc7b95b8-bc96-44e6-a8ba-c9857f512396] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:56.668325 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2f4049f7-45c8-4fa9-bca2-c5babe9aeb8b tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:56.670356 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2f4049f7-45c8-4fa9-bca2-c5babe9aeb8b tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:56.671969 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2f4049f7-45c8-4fa9-bca2-c5babe9aeb8b tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:56.673127 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2f4049f7-45c8-4fa9-bca2-c5babe9aeb8b tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:56.676332 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2f4049f7-45c8-4fa9-bca2-c5babe9aeb8b tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:56.677336 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2f4049f7-45c8-4fa9-bca2-c5babe9aeb8b tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:56.796394 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9c33d100-9f53-4ca1-ac39-4bb02de6bfe7 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:56.797056 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9c33d100-9f53-4ca1-ac39-4bb02de6bfe7 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: 938e014a-dca0-45aa-a90e-260597d8fd1f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:56.809083 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9c33d100-9f53-4ca1-ac39-4bb02de6bfe7 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:56.809582 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9c33d100-9f53-4ca1-ac39-4bb02de6bfe7 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:56.811112 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9c33d100-9f53-4ca1-ac39-4bb02de6bfe7 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:56.815067 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9c33d100-9f53-4ca1-ac39-4bb02de6bfe7 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:56.815511 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9c33d100-9f53-4ca1-ac39-4bb02de6bfe7 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:56.815954 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9c33d100-9f53-4ca1-ac39-4bb02de6bfe7 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:57.327228 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9c33d100-9f53-4ca1-ac39-4bb02de6bfe7 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b794eec6c6346cd981cbc4929be2d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e840dc8280574c4ba37942e50731f01c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:57.343095 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9c33d100-9f53-4ca1-ac39-4bb02de6bfe7 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f" status: 200 len: 1272 microversion: 2.1 time: 0.551220 Sep 08 11:04:57.352935 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2599/5091] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:56 2022] GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f => generated 1272 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:57.639606 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-480f93ea-3cd5-4580-a3d7-219551f81e70 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:57.640689 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-480f93ea-3cd5-4580-a3d7-219551f81e70 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:57.666955 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-480f93ea-3cd5-4580-a3d7-219551f81e70 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:57.674207 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-480f93ea-3cd5-4580-a3d7-219551f81e70 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:57.674983 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-480f93ea-3cd5-4580-a3d7-219551f81e70 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:57.676277 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-480f93ea-3cd5-4580-a3d7-219551f81e70 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:57.676963 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-480f93ea-3cd5-4580-a3d7-219551f81e70 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:57.678096 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-480f93ea-3cd5-4580-a3d7-219551f81e70 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:58.296767 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2f4049f7-45c8-4fa9-bca2-c5babe9aeb8b tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8bb78a06234641b145546a8328f639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a358ca8de0b489481a98bdacac284a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:58.313785 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2f4049f7-45c8-4fa9-bca2-c5babe9aeb8b tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] 10.222.0.27 "GET /compute/v2.1/servers/dc7b95b8-bc96-44e6-a8ba-c9857f512396" status: 200 len: 1497 microversion: 2.1 time: 1.668509 Sep 08 11:04:58.315076 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2493/5092] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:56 2022] GET /compute/v2.1/servers/dc7b95b8-bc96-44e6-a8ba-c9857f512396 => generated 1497 bytes in 1671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:58.393217 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3225e5a0-be16-4bf1-9295-b4c01f9b89b2 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:58.393217 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3225e5a0-be16-4bf1-9295-b4c01f9b89b2 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: 938e014a-dca0-45aa-a90e-260597d8fd1f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:58.393217 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3225e5a0-be16-4bf1-9295-b4c01f9b89b2 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:58.393217 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3225e5a0-be16-4bf1-9295-b4c01f9b89b2 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:58.396229 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3225e5a0-be16-4bf1-9295-b4c01f9b89b2 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:58.397656 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3225e5a0-be16-4bf1-9295-b4c01f9b89b2 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:58.406919 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3225e5a0-be16-4bf1-9295-b4c01f9b89b2 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:58.409390 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3225e5a0-be16-4bf1-9295-b4c01f9b89b2 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:58.853699 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-480f93ea-3cd5-4580-a3d7-219551f81e70 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:58.860669 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=100 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:04:58.882030 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-480f93ea-3cd5-4580-a3d7-219551f81e70 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:58.883504 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-480f93ea-3cd5-4580-a3d7-219551f81e70 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:58.885523 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-480f93ea-3cd5-4580-a3d7-219551f81e70 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 2869 microversion: 2.42 time: 1.253047 Sep 08 11:04:58.886701 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2600/5093] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:04:57 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 2869 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 11:04:59.392686 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3225e5a0-be16-4bf1-9295-b4c01f9b89b2 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b794eec6c6346cd981cbc4929be2d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e840dc8280574c4ba37942e50731f01c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:59.412285 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3225e5a0-be16-4bf1-9295-b4c01f9b89b2 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f" status: 200 len: 1314 microversion: 2.1 time: 1.032683 Sep 08 11:04:59.413080 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2494/5094] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:58 2022] GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f => generated 1314 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:04:59.500357 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3529d094-6211-4d1e-acd5-e33ada27699e tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:59.501439 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3529d094-6211-4d1e-acd5-e33ada27699e tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] [instance: dc7b95b8-bc96-44e6-a8ba-c9857f512396] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:59.524551 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3529d094-6211-4d1e-acd5-e33ada27699e tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:59.525080 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3529d094-6211-4d1e-acd5-e33ada27699e tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:59.525534 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3529d094-6211-4d1e-acd5-e33ada27699e tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:59.526274 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3529d094-6211-4d1e-acd5-e33ada27699e tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:59.526738 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3529d094-6211-4d1e-acd5-e33ada27699e tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:59.527171 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3529d094-6211-4d1e-acd5-e33ada27699e tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:59.652564 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3529d094-6211-4d1e-acd5-e33ada27699e tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] [instance: dc7b95b8-bc96-44e6-a8ba-c9857f512396] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:04:59.884259 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3529d094-6211-4d1e-acd5-e33ada27699e tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] 10.222.0.27 "DELETE /compute/v2.1/servers/dc7b95b8-bc96-44e6-a8ba-c9857f512396" status: 204 len: 0 microversion: 2.1 time: 0.387987 Sep 08 11:04:59.896456 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2601/5095] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:04:59 2022] DELETE /compute/v2.1/servers/dc7b95b8-bc96-44e6-a8ba-c9857f512396 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 11:04:59.901384 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-385c7f5a-8210-49f0-8259-6e11f83e3bcd tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:59.902372 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-385c7f5a-8210-49f0-8259-6e11f83e3bcd tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] [instance: dc7b95b8-bc96-44e6-a8ba-c9857f512396] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:59.919421 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-92b8e7f5-7bd6-4baa-81b0-2e121a4b997b tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:59.921365 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-92b8e7f5-7bd6-4baa-81b0-2e121a4b997b tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:59.926254 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-385c7f5a-8210-49f0-8259-6e11f83e3bcd tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:59.932933 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-385c7f5a-8210-49f0-8259-6e11f83e3bcd tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:59.940029 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-385c7f5a-8210-49f0-8259-6e11f83e3bcd tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:59.941235 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-385c7f5a-8210-49f0-8259-6e11f83e3bcd tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:59.942278 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-92b8e7f5-7bd6-4baa-81b0-2e121a4b997b tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:59.943023 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-385c7f5a-8210-49f0-8259-6e11f83e3bcd tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:59.943777 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-92b8e7f5-7bd6-4baa-81b0-2e121a4b997b tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:59.944490 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-385c7f5a-8210-49f0-8259-6e11f83e3bcd tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:59.945231 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-92b8e7f5-7bd6-4baa-81b0-2e121a4b997b tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:59.949522 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-92b8e7f5-7bd6-4baa-81b0-2e121a4b997b tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:59.950412 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-92b8e7f5-7bd6-4baa-81b0-2e121a4b997b tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:59.951423 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-92b8e7f5-7bd6-4baa-81b0-2e121a4b997b tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:00.018001 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:05:00.049004 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:05:01.113136 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:05:02.002027 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-92b8e7f5-7bd6-4baa-81b0-2e121a4b997b tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:02.017590 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-92b8e7f5-7bd6-4baa-81b0-2e121a4b997b tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:02.031979 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-92b8e7f5-7bd6-4baa-81b0-2e121a4b997b tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:02.037913 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-92b8e7f5-7bd6-4baa-81b0-2e121a4b997b tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 2869 microversion: 2.42 time: 2.123092 Sep 08 11:05:02.049769 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2602/5096] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:04:59 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 2869 bytes in 2136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:05:02.064981 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-370b9813-054d-42ae-b17c-f03582363c69 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:02.065811 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-370b9813-054d-42ae-b17c-f03582363c69 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: 938e014a-dca0-45aa-a90e-260597d8fd1f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:02.075090 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-370b9813-054d-42ae-b17c-f03582363c69 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:02.082155 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-370b9813-054d-42ae-b17c-f03582363c69 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:02.082722 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-370b9813-054d-42ae-b17c-f03582363c69 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:02.083902 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-370b9813-054d-42ae-b17c-f03582363c69 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:02.094613 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-370b9813-054d-42ae-b17c-f03582363c69 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:02.094613 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-370b9813-054d-42ae-b17c-f03582363c69 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:02.768463 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-385c7f5a-8210-49f0-8259-6e11f83e3bcd tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8bb78a06234641b145546a8328f639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a358ca8de0b489481a98bdacac284a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:02.781608 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-385c7f5a-8210-49f0-8259-6e11f83e3bcd tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] 10.222.0.27 "GET /compute/v2.1/servers/dc7b95b8-bc96-44e6-a8ba-c9857f512396" status: 200 len: 1503 microversion: 2.1 time: 2.884169 Sep 08 11:05:02.792633 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2495/5097] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:59 2022] GET /compute/v2.1/servers/dc7b95b8-bc96-44e6-a8ba-c9857f512396 => generated 1503 bytes in 2896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:05:02.846513 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-370b9813-054d-42ae-b17c-f03582363c69 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b794eec6c6346cd981cbc4929be2d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e840dc8280574c4ba37942e50731f01c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:02.871009 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-370b9813-054d-42ae-b17c-f03582363c69 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f" status: 200 len: 1314 microversion: 2.1 time: 0.819746 Sep 08 11:05:02.871606 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2603/5098] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:05:02 2022] GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f => generated 1314 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:05:03.086616 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e447694e-7985-4200-9c6a-422ddfe446a4 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:03.087437 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e447694e-7985-4200-9c6a-422ddfe446a4 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:03.113869 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e447694e-7985-4200-9c6a-422ddfe446a4 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:03.117487 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e447694e-7985-4200-9c6a-422ddfe446a4 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:03.120547 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e447694e-7985-4200-9c6a-422ddfe446a4 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:03.121648 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e447694e-7985-4200-9c6a-422ddfe446a4 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:03.125909 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e447694e-7985-4200-9c6a-422ddfe446a4 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:03.127696 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e447694e-7985-4200-9c6a-422ddfe446a4 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:03.150953 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-4d215901-f43f-4eb0-b76a-03dd3ffff581 req-77d493a2-6d7a-4bc9-85e8-fe00ff58617f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59", "name": "network-vif-deleted", "tag": "76a878f3-633e-4081-8c09-d5e66451d704"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:05:03.187344 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-4d215901-f43f-4eb0-b76a-03dd3ffff581 req-77d493a2-6d7a-4bc9-85e8-fe00ff58617f service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:03.190294 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-4d215901-f43f-4eb0-b76a-03dd3ffff581 req-77d493a2-6d7a-4bc9-85e8-fe00ff58617f service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:03.191603 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-4d215901-f43f-4eb0-b76a-03dd3ffff581 req-77d493a2-6d7a-4bc9-85e8-fe00ff58617f service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:03.240813 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-4d215901-f43f-4eb0-b76a-03dd3ffff581 req-77d493a2-6d7a-4bc9-85e8-fe00ff58617f service nova] Creating event network-vif-deleted:76a878f3-633e-4081-8c09-d5e66451d704 for instance 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 on n-h2-850501-12 Sep 08 11:05:03.253355 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-4d215901-f43f-4eb0-b76a-03dd3ffff581 req-77d493a2-6d7a-4bc9-85e8-fe00ff58617f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104572 Sep 08 11:05:03.258008 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2604/5099] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:05:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:05:03.823409 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-12c75cc9-04fb-4b1e-8dd6-0155f67f6eec tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:03.825127 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-12c75cc9-04fb-4b1e-8dd6-0155f67f6eec tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] [instance: dc7b95b8-bc96-44e6-a8ba-c9857f512396] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:03.858040 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-12c75cc9-04fb-4b1e-8dd6-0155f67f6eec tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:03.859497 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-12c75cc9-04fb-4b1e-8dd6-0155f67f6eec tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:03.860138 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-12c75cc9-04fb-4b1e-8dd6-0155f67f6eec tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:03.861130 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-12c75cc9-04fb-4b1e-8dd6-0155f67f6eec tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:03.862327 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-12c75cc9-04fb-4b1e-8dd6-0155f67f6eec tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:03.863185 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-12c75cc9-04fb-4b1e-8dd6-0155f67f6eec tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:04.070289 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e447694e-7985-4200-9c6a-422ddfe446a4 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:04.088604 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e447694e-7985-4200-9c6a-422ddfe446a4 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:04.095133 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e447694e-7985-4200-9c6a-422ddfe446a4 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:04.098095 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e447694e-7985-4200-9c6a-422ddfe446a4 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 2869 microversion: 2.42 time: 1.019146 Sep 08 11:05:04.109803 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2496/5100] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:05:03 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 2869 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:05:04.133591 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2f100405-3b7e-44f5-8761-242fb1496f31 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:04.134634 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2f100405-3b7e-44f5-8761-242fb1496f31 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: 938e014a-dca0-45aa-a90e-260597d8fd1f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:04.163199 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2f100405-3b7e-44f5-8761-242fb1496f31 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:04.171874 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2f100405-3b7e-44f5-8761-242fb1496f31 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:04.174337 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2f100405-3b7e-44f5-8761-242fb1496f31 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:04.178289 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2f100405-3b7e-44f5-8761-242fb1496f31 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:04.179673 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2f100405-3b7e-44f5-8761-242fb1496f31 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:04.181090 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2f100405-3b7e-44f5-8761-242fb1496f31 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:04.515438 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-12c75cc9-04fb-4b1e-8dd6-0155f67f6eec tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8bb78a06234641b145546a8328f639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a358ca8de0b489481a98bdacac284a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:04.525089 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-12c75cc9-04fb-4b1e-8dd6-0155f67f6eec tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] 10.222.0.27 "GET /compute/v2.1/servers/dc7b95b8-bc96-44e6-a8ba-c9857f512396" status: 200 len: 1503 microversion: 2.1 time: 0.707178 Sep 08 11:05:04.525694 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2605/5101] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:05:03 2022] GET /compute/v2.1/servers/dc7b95b8-bc96-44e6-a8ba-c9857f512396 => generated 1503 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:05:05.143197 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-346a1820-2ad0-41cc-914b-f3376c262d51 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:05.145510 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-346a1820-2ad0-41cc-914b-f3376c262d51 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:05.194511 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-346a1820-2ad0-41cc-914b-f3376c262d51 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:05.195845 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-346a1820-2ad0-41cc-914b-f3376c262d51 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:05.197355 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-346a1820-2ad0-41cc-914b-f3376c262d51 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:05.198941 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-346a1820-2ad0-41cc-914b-f3376c262d51 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:05.200055 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-346a1820-2ad0-41cc-914b-f3376c262d51 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:05.201699 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-346a1820-2ad0-41cc-914b-f3376c262d51 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:06.573883 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2f100405-3b7e-44f5-8761-242fb1496f31 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b794eec6c6346cd981cbc4929be2d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e840dc8280574c4ba37942e50731f01c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:06.598516 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2f100405-3b7e-44f5-8761-242fb1496f31 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f" status: 200 len: 1314 microversion: 2.1 time: 2.487224 Sep 08 11:05:06.613819 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2497/5102] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:05:04 2022] GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f => generated 1314 bytes in 2492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:05:06.615392 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d3ebd38d-2d5c-41db-b0ef-a05950a144c3 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:06.618363 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d3ebd38d-2d5c-41db-b0ef-a05950a144c3 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] [instance: dc7b95b8-bc96-44e6-a8ba-c9857f512396] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:06.620609 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-346a1820-2ad0-41cc-914b-f3376c262d51 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:06.646647 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d3ebd38d-2d5c-41db-b0ef-a05950a144c3 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:06.648483 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d3ebd38d-2d5c-41db-b0ef-a05950a144c3 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:06.652448 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d3ebd38d-2d5c-41db-b0ef-a05950a144c3 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:06.654871 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d3ebd38d-2d5c-41db-b0ef-a05950a144c3 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:06.657179 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d3ebd38d-2d5c-41db-b0ef-a05950a144c3 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:06.657650 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d3ebd38d-2d5c-41db-b0ef-a05950a144c3 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:06.679331 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-346a1820-2ad0-41cc-914b-f3376c262d51 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:06.690073 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-346a1820-2ad0-41cc-914b-f3376c262d51 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:06.702698 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-346a1820-2ad0-41cc-914b-f3376c262d51 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 2531 microversion: 2.42 time: 1.564575 Sep 08 11:05:06.729753 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2606/5103] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:05:05 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 2531 bytes in 1596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 11:05:06.745377 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-765e49a1-248a-4dfe-a5dd-da8124ef1af5 req-9dff13a9-e13b-43c0-947e-227ed3fa37f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "938e014a-dca0-45aa-a90e-260597d8fd1f", "tag": "05ea6e2e-2c0c-4f4c-86e5-ee6235225925"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:05:06.781436 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-765e49a1-248a-4dfe-a5dd-da8124ef1af5 req-9dff13a9-e13b-43c0-947e-227ed3fa37f7 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:06.784377 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-765e49a1-248a-4dfe-a5dd-da8124ef1af5 req-9dff13a9-e13b-43c0-947e-227ed3fa37f7 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:06.785634 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-765e49a1-248a-4dfe-a5dd-da8124ef1af5 req-9dff13a9-e13b-43c0-947e-227ed3fa37f7 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:06.832418 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-765e49a1-248a-4dfe-a5dd-da8124ef1af5 req-9dff13a9-e13b-43c0-947e-227ed3fa37f7 service nova] Creating event network-changed:05ea6e2e-2c0c-4f4c-86e5-ee6235225925 for instance 938e014a-dca0-45aa-a90e-260597d8fd1f on n-h1-850501-12 Sep 08 11:05:06.851884 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-765e49a1-248a-4dfe-a5dd-da8124ef1af5 req-9dff13a9-e13b-43c0-947e-227ed3fa37f7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120493 Sep 08 11:05:06.859121 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2607/5104] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:05:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:05:07.321622 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-cd93e863-5c66-415e-a981-03e1c321dc10 req-9728ee69-88a6-424d-8d83-539a4a34a814 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc7b95b8-bc96-44e6-a8ba-c9857f512396", "name": "network-vif-deleted", "tag": "b76bc23b-52a8-4121-9db1-6627806ca440"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:05:07.321913 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d3ebd38d-2d5c-41db-b0ef-a05950a144c3 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8bb78a06234641b145546a8328f639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a358ca8de0b489481a98bdacac284a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:07.338018 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d3ebd38d-2d5c-41db-b0ef-a05950a144c3 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] 10.222.0.27 "GET /compute/v2.1/servers/dc7b95b8-bc96-44e6-a8ba-c9857f512396" status: 200 len: 1298 microversion: 2.1 time: 0.733624 Sep 08 11:05:07.338637 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2498/5105] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:05:06 2022] GET /compute/v2.1/servers/dc7b95b8-bc96-44e6-a8ba-c9857f512396 => generated 1298 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:05:07.343422 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-cd93e863-5c66-415e-a981-03e1c321dc10 req-9728ee69-88a6-424d-8d83-539a4a34a814 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:07.344759 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-cd93e863-5c66-415e-a981-03e1c321dc10 req-9728ee69-88a6-424d-8d83-539a4a34a814 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:07.345683 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-cd93e863-5c66-415e-a981-03e1c321dc10 req-9728ee69-88a6-424d-8d83-539a4a34a814 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:07.363094 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-cd93e863-5c66-415e-a981-03e1c321dc10 req-9728ee69-88a6-424d-8d83-539a4a34a814 service nova] Creating event network-vif-deleted:b76bc23b-52a8-4121-9db1-6627806ca440 for instance dc7b95b8-bc96-44e6-a8ba-c9857f512396 on n-h2-850501-12 Sep 08 11:05:07.374236 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-cd93e863-5c66-415e-a981-03e1c321dc10 req-9728ee69-88a6-424d-8d83-539a4a34a814 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.513173 Sep 08 11:05:07.375467 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2608/5106] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:05:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:05:07.621685 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-753eeba4-8740-42a9-9d9d-786c583fb602 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:07.623738 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-753eeba4-8740-42a9-9d9d-786c583fb602 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: 938e014a-dca0-45aa-a90e-260597d8fd1f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:07.636324 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-753eeba4-8740-42a9-9d9d-786c583fb602 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:07.640115 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-753eeba4-8740-42a9-9d9d-786c583fb602 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:07.640668 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-753eeba4-8740-42a9-9d9d-786c583fb602 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:07.643811 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-753eeba4-8740-42a9-9d9d-786c583fb602 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:07.646619 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-753eeba4-8740-42a9-9d9d-786c583fb602 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:07.649599 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-753eeba4-8740-42a9-9d9d-786c583fb602 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:07.733557 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7e95b371-a1fd-4ff9-b412-8340a3759e8f tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:07.736522 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7e95b371-a1fd-4ff9-b412-8340a3759e8f tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:07.752194 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7e95b371-a1fd-4ff9-b412-8340a3759e8f tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:07.753095 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7e95b371-a1fd-4ff9-b412-8340a3759e8f tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:07.753760 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7e95b371-a1fd-4ff9-b412-8340a3759e8f tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:07.755007 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7e95b371-a1fd-4ff9-b412-8340a3759e8f tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:07.759243 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7e95b371-a1fd-4ff9-b412-8340a3759e8f tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:07.759997 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7e95b371-a1fd-4ff9-b412-8340a3759e8f tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:08.463329 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7e95b371-a1fd-4ff9-b412-8340a3759e8f tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:08.498670 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7e95b371-a1fd-4ff9-b412-8340a3759e8f tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:08.505067 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7e95b371-a1fd-4ff9-b412-8340a3759e8f tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:08.506913 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7e95b371-a1fd-4ff9-b412-8340a3759e8f tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 2531 microversion: 2.42 time: 0.778614 Sep 08 11:05:08.526113 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2609/5107] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:05:07 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 2531 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 11:05:08.540785 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a3acd53f-65dc-4831-a59b-5d942d40d9c8 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:08.543161 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a3acd53f-65dc-4831-a59b-5d942d40d9c8 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] [instance: dc7b95b8-bc96-44e6-a8ba-c9857f512396] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:08.551651 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a3acd53f-65dc-4831-a59b-5d942d40d9c8 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:08.552767 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a3acd53f-65dc-4831-a59b-5d942d40d9c8 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:08.553925 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a3acd53f-65dc-4831-a59b-5d942d40d9c8 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:08.554884 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a3acd53f-65dc-4831-a59b-5d942d40d9c8 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:08.555575 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a3acd53f-65dc-4831-a59b-5d942d40d9c8 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:08.556233 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a3acd53f-65dc-4831-a59b-5d942d40d9c8 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:08.572630 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-a3acd53f-65dc-4831-a59b-5d942d40d9c8 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] HTTP exception thrown: Instance dc7b95b8-bc96-44e6-a8ba-c9857f512396 could not be found. Sep 08 11:05:08.576742 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a3acd53f-65dc-4831-a59b-5d942d40d9c8 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Request method failure captured: Sep 08 11:05:08.576742 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/dc7b95b8-bc96-44e6-a8ba-c9857f512396 HTTP/1.1 Sep 08 11:05:08.576742 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:05:08.576742 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:05:08.576742 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:05:08.576742 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 11:05:08.576742 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:05:08.576742 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:05:08.576742 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:05:08.576742 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:05:08.576742 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcwgsDN_sWqlCrPT9Dhnftz2zgtQyy7oHB8JaPjzAynRKIlGRNxy4ALBn16aWvYml1-qJSZhFDPnJJ4X57c6foAYPy4GVBd7ka_Yp4UYoP5PTrJbowsTLJnhfRvx9fw0u3x4zdglZ3GMWgSRfc2LBP5zkT0PRBaomtAuYDgEFC465QI Sep 08 11:05:08.576742 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:05:08.576742 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:05:08.576742 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:05:08.576742 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:05:08.576742 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:05:08.576742 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:05:08.576742 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 7a358ca8de0b489481a98bdacac284a0 Sep 08 11:05:08.576742 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-VolumesActionsTest-1223370134 Sep 08 11:05:08.576742 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:05:08.576742 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:05:08.576742 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7a358ca8de0b489481a98bdacac284a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7a358ca8de0b489481a98bdacac284a0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7a358ca8de0b489481a98bdacac284a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7a358ca8de0b489481a98bdacac284a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:05:08.576742 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-VolumesActionsTest-1223370134 Sep 08 11:05:08.576742 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 7a358ca8de0b489481a98bdacac284a0 Sep 08 11:05:08.576742 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-VolumesActionsTest-1223370134 Sep 08 11:05:08.576742 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-VolumesActionsTest-1223370134-project Sep 08 11:05:08.576742 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:05:08.576742 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:05:08.576742 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 0b8bb78a06234641b145546a8328f639 Sep 08 11:05:08.576742 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-VolumesActionsTest-1223370134-project Sep 08 11:05:08.576742 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 11:05:08.576742 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance dc7b95b8-bc96-44e6-a8ba-c9857f512396 could not be found. Sep 08 11:05:08.576742 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': 'dc7b95b8-bc96-44e6-a8ba-c9857f512396'} Sep 08 11:05:08.576742 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:05:08.576742 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:05:08.576742 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:05:08.576742 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:05:08.576742 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:05:08.576742 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:05:08.576742 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:05:08.576742 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:05:08.576742 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:05:08.576742 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:05:08.576742 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc7b95b8-bc96-44e6-a8ba-c9857f512396 could not be found. Sep 08 11:05:08.576742 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:05:08.576742 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:05:08.576742 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:05:08.576742 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:05:08.576742 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:05:08.576742 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:05:08.576742 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:05:08.576742 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:05:08.576742 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:05:08.576742 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:05:08.576742 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:05:08.576742 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:05:08.576742 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:05:08.576742 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:05:08.576742 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:05:08.576742 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:05:08.576742 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc7b95b8-bc96-44e6-a8ba-c9857f512396 could not be found. Sep 08 11:05:08.576742 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:05:08.576742 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:05:08.576742 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:05:08.581965 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:05:08.581965 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:05:08.581965 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:05:08.581965 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:05:08.581965 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:05:08.581965 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc7b95b8-bc96-44e6-a8ba-c9857f512396 could not be found. Sep 08 11:05:08.581965 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:05:08.585757 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a3acd53f-65dc-4831-a59b-5d942d40d9c8 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] Returning 404 to user: Instance dc7b95b8-bc96-44e6-a8ba-c9857f512396 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:05:08.587274 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a3acd53f-65dc-4831-a59b-5d942d40d9c8 tempest-VolumesActionsTest-1223370134 tempest-VolumesActionsTest-1223370134-project] 10.222.0.27 "GET /compute/v2.1/servers/dc7b95b8-bc96-44e6-a8ba-c9857f512396" status: 404 len: 111 microversion: 2.1 time: 0.054879 Sep 08 11:05:08.588443 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2610/5108] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:05:08 2022] GET /compute/v2.1/servers/dc7b95b8-bc96-44e6-a8ba-c9857f512396 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:05:08.810863 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-753eeba4-8740-42a9-9d9d-786c583fb602 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b794eec6c6346cd981cbc4929be2d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e840dc8280574c4ba37942e50731f01c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:08.829110 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-753eeba4-8740-42a9-9d9d-786c583fb602 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f" status: 200 len: 1314 microversion: 2.1 time: 1.209924 Sep 08 11:05:08.831554 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2499/5109] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:05:07 2022] GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f => generated 1314 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:05:09.200143 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-da8e2cf4-1628-4664-9f70-62b37c1ca8c1 req-2bdc4fc7-fe06-4dac-acd5-0b75bf64d91e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59", "name": "network-vif-deleted", "tag": "9239d9ef-a9de-493e-bc47-0fcce1dee834"}, {"server_uuid": "954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59", "name": "network-vif-deleted", "tag": "43a5e615-6fc8-4ec6-8b8a-8c3e382e1b29"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:05:09.223349 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-da8e2cf4-1628-4664-9f70-62b37c1ca8c1 req-2bdc4fc7-fe06-4dac-acd5-0b75bf64d91e service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:09.225322 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-da8e2cf4-1628-4664-9f70-62b37c1ca8c1 req-2bdc4fc7-fe06-4dac-acd5-0b75bf64d91e service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:09.228044 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-da8e2cf4-1628-4664-9f70-62b37c1ca8c1 req-2bdc4fc7-fe06-4dac-acd5-0b75bf64d91e service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:09.284427 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-da8e2cf4-1628-4664-9f70-62b37c1ca8c1 req-2bdc4fc7-fe06-4dac-acd5-0b75bf64d91e service nova] Creating event network-vif-deleted:9239d9ef-a9de-493e-bc47-0fcce1dee834 for instance 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 on n-h2-850501-12 Sep 08 11:05:09.287670 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-da8e2cf4-1628-4664-9f70-62b37c1ca8c1 req-2bdc4fc7-fe06-4dac-acd5-0b75bf64d91e service nova] Creating event network-vif-deleted:43a5e615-6fc8-4ec6-8b8a-8c3e382e1b29 for instance 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 on n-h2-850501-12 Sep 08 11:05:09.329247 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-da8e2cf4-1628-4664-9f70-62b37c1ca8c1 req-2bdc4fc7-fe06-4dac-acd5-0b75bf64d91e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.128986 Sep 08 11:05:09.329935 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2611/5110] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:05:09 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:05:09.544413 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-469f4aae-8f7b-4cd1-8e48-e5b6e0184131 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:09.549707 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-469f4aae-8f7b-4cd1-8e48-e5b6e0184131 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:09.565943 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-469f4aae-8f7b-4cd1-8e48-e5b6e0184131 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:09.566868 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-469f4aae-8f7b-4cd1-8e48-e5b6e0184131 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:09.577583 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-469f4aae-8f7b-4cd1-8e48-e5b6e0184131 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:09.578788 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-469f4aae-8f7b-4cd1-8e48-e5b6e0184131 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:09.579514 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-469f4aae-8f7b-4cd1-8e48-e5b6e0184131 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:09.580190 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-469f4aae-8f7b-4cd1-8e48-e5b6e0184131 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:09.868128 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6e502c1c-bd84-4267-8b6b-09b34b546661 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:09.874965 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6e502c1c-bd84-4267-8b6b-09b34b546661 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: 938e014a-dca0-45aa-a90e-260597d8fd1f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:09.885383 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6e502c1c-bd84-4267-8b6b-09b34b546661 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:09.886367 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6e502c1c-bd84-4267-8b6b-09b34b546661 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:09.887056 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6e502c1c-bd84-4267-8b6b-09b34b546661 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:09.889088 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6e502c1c-bd84-4267-8b6b-09b34b546661 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:09.890556 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6e502c1c-bd84-4267-8b6b-09b34b546661 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:09.891354 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6e502c1c-bd84-4267-8b6b-09b34b546661 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:10.208141 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-469f4aae-8f7b-4cd1-8e48-e5b6e0184131 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:10.221813 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-469f4aae-8f7b-4cd1-8e48-e5b6e0184131 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:10.224041 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-469f4aae-8f7b-4cd1-8e48-e5b6e0184131 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:10.225744 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-469f4aae-8f7b-4cd1-8e48-e5b6e0184131 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 2213 microversion: 2.42 time: 0.685524 Sep 08 11:05:10.227278 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2500/5111] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:05:09 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 2213 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:05:10.615487 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6e502c1c-bd84-4267-8b6b-09b34b546661 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b794eec6c6346cd981cbc4929be2d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e840dc8280574c4ba37942e50731f01c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:10.641635 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6e502c1c-bd84-4267-8b6b-09b34b546661 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f" status: 200 len: 1314 microversion: 2.1 time: 0.783189 Sep 08 11:05:10.642738 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2612/5112] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:05:09 2022] GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f => generated 1314 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:05:11.283858 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6d1afdef-4819-4891-839f-6cb42fe0bf08 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:11.285294 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6d1afdef-4819-4891-839f-6cb42fe0bf08 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:11.295996 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d1afdef-4819-4891-839f-6cb42fe0bf08 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:11.296494 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d1afdef-4819-4891-839f-6cb42fe0bf08 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:11.296933 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d1afdef-4819-4891-839f-6cb42fe0bf08 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:11.297690 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d1afdef-4819-4891-839f-6cb42fe0bf08 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:11.298147 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d1afdef-4819-4891-839f-6cb42fe0bf08 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:11.298586 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d1afdef-4819-4891-839f-6cb42fe0bf08 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:11.374554 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-82ecc77d-d11b-45df-840a-b898e04f42dd req-4d7575ff-c2a7-491a-a3cc-3e3bed7198b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59", "name": "network-vif-deleted", "tag": "d3dee7fc-0d23-496a-962c-d681c647d159"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:05:11.394911 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-82ecc77d-d11b-45df-840a-b898e04f42dd req-4d7575ff-c2a7-491a-a3cc-3e3bed7198b1 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:11.395706 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-82ecc77d-d11b-45df-840a-b898e04f42dd req-4d7575ff-c2a7-491a-a3cc-3e3bed7198b1 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:11.397536 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-82ecc77d-d11b-45df-840a-b898e04f42dd req-4d7575ff-c2a7-491a-a3cc-3e3bed7198b1 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:11.426497 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-82ecc77d-d11b-45df-840a-b898e04f42dd req-4d7575ff-c2a7-491a-a3cc-3e3bed7198b1 service nova] Creating event network-vif-deleted:d3dee7fc-0d23-496a-962c-d681c647d159 for instance 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 on n-h2-850501-12 Sep 08 11:05:11.436732 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-82ecc77d-d11b-45df-840a-b898e04f42dd req-4d7575ff-c2a7-491a-a3cc-3e3bed7198b1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065845 Sep 08 11:05:11.442738 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2613/5113] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:05:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:05:11.670180 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1da6e51a-8a62-47e3-b1ab-3e6aaee9f506 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:11.671124 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1da6e51a-8a62-47e3-b1ab-3e6aaee9f506 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: 938e014a-dca0-45aa-a90e-260597d8fd1f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:11.686960 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1da6e51a-8a62-47e3-b1ab-3e6aaee9f506 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:11.687468 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1da6e51a-8a62-47e3-b1ab-3e6aaee9f506 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:11.688110 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1da6e51a-8a62-47e3-b1ab-3e6aaee9f506 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:11.688849 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1da6e51a-8a62-47e3-b1ab-3e6aaee9f506 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:11.689696 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1da6e51a-8a62-47e3-b1ab-3e6aaee9f506 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:11.690144 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1da6e51a-8a62-47e3-b1ab-3e6aaee9f506 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:12.322969 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6d1afdef-4819-4891-839f-6cb42fe0bf08 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:12.342070 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6d1afdef-4819-4891-839f-6cb42fe0bf08 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:12.345320 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6d1afdef-4819-4891-839f-6cb42fe0bf08 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:12.348940 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6d1afdef-4819-4891-839f-6cb42fe0bf08 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 2167 microversion: 2.42 time: 1.068073 Sep 08 11:05:12.351425 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2501/5114] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:05:11 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 2167 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 11:05:12.422066 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1da6e51a-8a62-47e3-b1ab-3e6aaee9f506 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b794eec6c6346cd981cbc4929be2d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e840dc8280574c4ba37942e50731f01c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:12.431598 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1da6e51a-8a62-47e3-b1ab-3e6aaee9f506 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f" status: 200 len: 1314 microversion: 2.1 time: 0.766373 Sep 08 11:05:12.432924 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2614/5115] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:05:11 2022] GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f => generated 1314 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:05:13.384301 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e81d9c51-cb27-4e48-b3e5-10171d7fa204 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:13.385837 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e81d9c51-cb27-4e48-b3e5-10171d7fa204 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:13.398391 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e81d9c51-cb27-4e48-b3e5-10171d7fa204 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:13.399650 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e81d9c51-cb27-4e48-b3e5-10171d7fa204 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:13.400349 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e81d9c51-cb27-4e48-b3e5-10171d7fa204 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:13.401612 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e81d9c51-cb27-4e48-b3e5-10171d7fa204 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:13.402429 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e81d9c51-cb27-4e48-b3e5-10171d7fa204 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:13.403252 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e81d9c51-cb27-4e48-b3e5-10171d7fa204 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:13.482569 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6112b9d7-e688-4193-927c-ab4ca76f1774 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:13.483611 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6112b9d7-e688-4193-927c-ab4ca76f1774 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: 938e014a-dca0-45aa-a90e-260597d8fd1f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:13.494818 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6112b9d7-e688-4193-927c-ab4ca76f1774 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:13.495344 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6112b9d7-e688-4193-927c-ab4ca76f1774 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:13.496109 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6112b9d7-e688-4193-927c-ab4ca76f1774 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:13.497619 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6112b9d7-e688-4193-927c-ab4ca76f1774 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:13.500561 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6112b9d7-e688-4193-927c-ab4ca76f1774 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:13.501840 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6112b9d7-e688-4193-927c-ab4ca76f1774 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:13.547751 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e81d9c51-cb27-4e48-b3e5-10171d7fa204 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:13.572432 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e81d9c51-cb27-4e48-b3e5-10171d7fa204 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:13.576590 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e81d9c51-cb27-4e48-b3e5-10171d7fa204 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:13.578531 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e81d9c51-cb27-4e48-b3e5-10171d7fa204 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1604 microversion: 2.42 time: 0.202616 Sep 08 11:05:13.583697 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2502/5116] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:05:13 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1604 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:05:14.089701 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-fac9475c-9c32-46cd-80af-3e6d37640139 req-58aba640-176a-4c75-a18f-d29a95bf2ef6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59", "name": "network-vif-deleted", "tag": "0cd4ca73-de26-4dfe-88cc-7092866bcfee"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:05:14.113434 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-fac9475c-9c32-46cd-80af-3e6d37640139 req-58aba640-176a-4c75-a18f-d29a95bf2ef6 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:14.114021 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-fac9475c-9c32-46cd-80af-3e6d37640139 req-58aba640-176a-4c75-a18f-d29a95bf2ef6 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:14.114536 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-fac9475c-9c32-46cd-80af-3e6d37640139 req-58aba640-176a-4c75-a18f-d29a95bf2ef6 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:14.142150 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-fac9475c-9c32-46cd-80af-3e6d37640139 req-58aba640-176a-4c75-a18f-d29a95bf2ef6 service nova] Creating event network-vif-deleted:0cd4ca73-de26-4dfe-88cc-7092866bcfee for instance 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 on n-h2-850501-12 Sep 08 11:05:14.156098 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-fac9475c-9c32-46cd-80af-3e6d37640139 req-58aba640-176a-4c75-a18f-d29a95bf2ef6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071880 Sep 08 11:05:14.160742 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2503/5117] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:05:14.505273 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6112b9d7-e688-4193-927c-ab4ca76f1774 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b794eec6c6346cd981cbc4929be2d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e840dc8280574c4ba37942e50731f01c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:14.516862 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6112b9d7-e688-4193-927c-ab4ca76f1774 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f" status: 200 len: 1314 microversion: 2.1 time: 1.054632 Sep 08 11:05:14.519787 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2615/5118] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:05:13 2022] GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f => generated 1314 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:05:14.617491 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-79edcc09-1a4d-4b4d-9b28-859ea99e6e23 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:14.620088 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-79edcc09-1a4d-4b4d-9b28-859ea99e6e23 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:14.642980 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-79edcc09-1a4d-4b4d-9b28-859ea99e6e23 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:14.645505 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-79edcc09-1a4d-4b4d-9b28-859ea99e6e23 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:14.648706 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-79edcc09-1a4d-4b4d-9b28-859ea99e6e23 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:14.649909 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-79edcc09-1a4d-4b4d-9b28-859ea99e6e23 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:14.652910 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-79edcc09-1a4d-4b4d-9b28-859ea99e6e23 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:14.655993 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-79edcc09-1a4d-4b4d-9b28-859ea99e6e23 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:14.821305 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-79edcc09-1a4d-4b4d-9b28-859ea99e6e23 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:14.852626 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-79edcc09-1a4d-4b4d-9b28-859ea99e6e23 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:14.858689 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-79edcc09-1a4d-4b4d-9b28-859ea99e6e23 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:14.869204 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-79edcc09-1a4d-4b4d-9b28-859ea99e6e23 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1604 microversion: 2.42 time: 0.258307 Sep 08 11:05:14.874187 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2504/5119] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:05:14 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1604 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:05:15.544657 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ca28b058-2ffc-48aa-aaf4-751c49cd722e tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:15.545498 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ca28b058-2ffc-48aa-aaf4-751c49cd722e tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: 938e014a-dca0-45aa-a90e-260597d8fd1f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:15.569229 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ca28b058-2ffc-48aa-aaf4-751c49cd722e tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:15.570085 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ca28b058-2ffc-48aa-aaf4-751c49cd722e tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:15.576473 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ca28b058-2ffc-48aa-aaf4-751c49cd722e tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:15.577642 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ca28b058-2ffc-48aa-aaf4-751c49cd722e tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:15.578348 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ca28b058-2ffc-48aa-aaf4-751c49cd722e tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:15.579243 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ca28b058-2ffc-48aa-aaf4-751c49cd722e tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:15.900954 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2ceb9bea-8684-4625-8347-47f56142d1e3 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:15.901620 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2ceb9bea-8684-4625-8347-47f56142d1e3 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:15.918055 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2ceb9bea-8684-4625-8347-47f56142d1e3 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:15.922196 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2ceb9bea-8684-4625-8347-47f56142d1e3 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:15.925219 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2ceb9bea-8684-4625-8347-47f56142d1e3 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:15.931430 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2ceb9bea-8684-4625-8347-47f56142d1e3 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:15.932409 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2ceb9bea-8684-4625-8347-47f56142d1e3 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:15.935576 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2ceb9bea-8684-4625-8347-47f56142d1e3 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:16.369827 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2ceb9bea-8684-4625-8347-47f56142d1e3 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:16.378537 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ca28b058-2ffc-48aa-aaf4-751c49cd722e tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b794eec6c6346cd981cbc4929be2d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e840dc8280574c4ba37942e50731f01c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:16.391879 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ca28b058-2ffc-48aa-aaf4-751c49cd722e tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f" status: 200 len: 1314 microversion: 2.1 time: 0.852356 Sep 08 11:05:16.398752 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2ceb9bea-8684-4625-8347-47f56142d1e3 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:16.401010 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2616/5120] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:05:15 2022] GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f => generated 1314 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:05:16.407598 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2ceb9bea-8684-4625-8347-47f56142d1e3 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:16.414561 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2ceb9bea-8684-4625-8347-47f56142d1e3 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1604 microversion: 2.42 time: 0.518340 Sep 08 11:05:16.417234 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2505/5121] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:05:15 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1604 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:05:17.432450 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-49f39701-d85d-4206-abb6-59a8206db520 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:17.433171 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-49f39701-d85d-4206-abb6-59a8206db520 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: 938e014a-dca0-45aa-a90e-260597d8fd1f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:17.445359 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-66ed5755-3fba-4f34-9f21-d55285fd00ac tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:17.446059 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-66ed5755-3fba-4f34-9f21-d55285fd00ac tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:17.476917 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-49f39701-d85d-4206-abb6-59a8206db520 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:17.477407 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-49f39701-d85d-4206-abb6-59a8206db520 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:17.478043 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-66ed5755-3fba-4f34-9f21-d55285fd00ac tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:17.479345 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-66ed5755-3fba-4f34-9f21-d55285fd00ac tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:17.479991 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-49f39701-d85d-4206-abb6-59a8206db520 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:17.482025 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-66ed5755-3fba-4f34-9f21-d55285fd00ac tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:17.483110 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-49f39701-d85d-4206-abb6-59a8206db520 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:17.487351 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-49f39701-d85d-4206-abb6-59a8206db520 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:17.489735 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-66ed5755-3fba-4f34-9f21-d55285fd00ac tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:17.490452 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-49f39701-d85d-4206-abb6-59a8206db520 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:17.492041 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-66ed5755-3fba-4f34-9f21-d55285fd00ac tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:17.495547 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-66ed5755-3fba-4f34-9f21-d55285fd00ac tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:18.010144 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-49f39701-d85d-4206-abb6-59a8206db520 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b794eec6c6346cd981cbc4929be2d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e840dc8280574c4ba37942e50731f01c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:18.019620 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-49f39701-d85d-4206-abb6-59a8206db520 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f" status: 200 len: 1314 microversion: 2.1 time: 0.592709 Sep 08 11:05:18.029830 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2617/5122] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:05:17 2022] GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f => generated 1314 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:05:18.163132 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-66ed5755-3fba-4f34-9f21-d55285fd00ac tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:18.181287 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-66ed5755-3fba-4f34-9f21-d55285fd00ac tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:18.190780 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-66ed5755-3fba-4f34-9f21-d55285fd00ac tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:18.192310 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-66ed5755-3fba-4f34-9f21-d55285fd00ac tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1604 microversion: 2.42 time: 0.751284 Sep 08 11:05:18.197805 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2506/5123] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:05:17 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1604 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 11:05:19.053904 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f0d8004b-a110-4a00-b271-f590f534a7ca tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:19.055594 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f0d8004b-a110-4a00-b271-f590f534a7ca tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: 938e014a-dca0-45aa-a90e-260597d8fd1f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:19.068495 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f0d8004b-a110-4a00-b271-f590f534a7ca tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:19.077222 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f0d8004b-a110-4a00-b271-f590f534a7ca tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:19.080228 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f0d8004b-a110-4a00-b271-f590f534a7ca tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:19.081480 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f0d8004b-a110-4a00-b271-f590f534a7ca tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:19.085802 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f0d8004b-a110-4a00-b271-f590f534a7ca tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:19.086981 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f0d8004b-a110-4a00-b271-f590f534a7ca tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:19.233236 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ac8aa7d4-910b-4be1-bebf-8436ba162b0f tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:19.234758 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ac8aa7d4-910b-4be1-bebf-8436ba162b0f tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:19.259609 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ac8aa7d4-910b-4be1-bebf-8436ba162b0f tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:19.261062 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ac8aa7d4-910b-4be1-bebf-8436ba162b0f tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:19.261832 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ac8aa7d4-910b-4be1-bebf-8436ba162b0f tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:19.263573 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ac8aa7d4-910b-4be1-bebf-8436ba162b0f tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:19.270470 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ac8aa7d4-910b-4be1-bebf-8436ba162b0f tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:19.277822 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ac8aa7d4-910b-4be1-bebf-8436ba162b0f tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:19.282223 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:05:19.502404 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ac8aa7d4-910b-4be1-bebf-8436ba162b0f tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:19.515032 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ac8aa7d4-910b-4be1-bebf-8436ba162b0f tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:19.524229 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ac8aa7d4-910b-4be1-bebf-8436ba162b0f tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:19.526364 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ac8aa7d4-910b-4be1-bebf-8436ba162b0f tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1604 microversion: 2.42 time: 0.298362 Sep 08 11:05:19.551291 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2507/5124] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:05:19 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1604 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 11:05:19.756014 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f0d8004b-a110-4a00-b271-f590f534a7ca tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b794eec6c6346cd981cbc4929be2d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e840dc8280574c4ba37942e50731f01c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:19.765886 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f0d8004b-a110-4a00-b271-f590f534a7ca tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f" status: 200 len: 1314 microversion: 2.1 time: 0.716131 Sep 08 11:05:19.780616 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2618/5125] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:05:19 2022] GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f => generated 1314 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:05:20.400598 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-cc794bec-cef0-4d1f-acda-8e8a1ce27223 req-469a3a37-5bc0-4280-b9ee-f7884e47fd9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "938e014a-dca0-45aa-a90e-260597d8fd1f", "name": "network-vif-plugged", "status": "completed", "tag": "05ea6e2e-2c0c-4f4c-86e5-ee6235225925"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:05:20.437785 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-cc794bec-cef0-4d1f-acda-8e8a1ce27223 req-469a3a37-5bc0-4280-b9ee-f7884e47fd9e service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:20.438293 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-cc794bec-cef0-4d1f-acda-8e8a1ce27223 req-469a3a37-5bc0-4280-b9ee-f7884e47fd9e service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:20.446026 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-cc794bec-cef0-4d1f-acda-8e8a1ce27223 req-469a3a37-5bc0-4280-b9ee-f7884e47fd9e service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:20.520265 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-cc794bec-cef0-4d1f-acda-8e8a1ce27223 req-469a3a37-5bc0-4280-b9ee-f7884e47fd9e service nova] Creating event network-vif-plugged:05ea6e2e-2c0c-4f4c-86e5-ee6235225925 for instance 938e014a-dca0-45aa-a90e-260597d8fd1f on n-h1-850501-12 Sep 08 11:05:20.545654 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-cc794bec-cef0-4d1f-acda-8e8a1ce27223 req-469a3a37-5bc0-4280-b9ee-f7884e47fd9e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145460 Sep 08 11:05:20.550254 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2508/5126] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:05:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:05:20.561678 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fa9b60a8-266b-4659-aa8f-6a99143cc0a4 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:20.562448 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fa9b60a8-266b-4659-aa8f-6a99143cc0a4 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:20.583900 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fa9b60a8-266b-4659-aa8f-6a99143cc0a4 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:20.586871 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fa9b60a8-266b-4659-aa8f-6a99143cc0a4 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:20.587504 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fa9b60a8-266b-4659-aa8f-6a99143cc0a4 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:20.588268 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fa9b60a8-266b-4659-aa8f-6a99143cc0a4 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:20.597801 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fa9b60a8-266b-4659-aa8f-6a99143cc0a4 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:20.599205 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fa9b60a8-266b-4659-aa8f-6a99143cc0a4 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:20.785916 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-fa9b60a8-266b-4659-aa8f-6a99143cc0a4 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:20.794854 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:05:20.805264 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-fa9b60a8-266b-4659-aa8f-6a99143cc0a4 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:20.807352 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6d90ff04-0c34-494c-9620-e40d29deb00c tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:20.808323 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6d90ff04-0c34-494c-9620-e40d29deb00c tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: 938e014a-dca0-45aa-a90e-260597d8fd1f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:20.809294 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-fa9b60a8-266b-4659-aa8f-6a99143cc0a4 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:20.816187 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fa9b60a8-266b-4659-aa8f-6a99143cc0a4 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1604 microversion: 2.42 time: 0.264138 Sep 08 11:05:20.829268 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d90ff04-0c34-494c-9620-e40d29deb00c tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:20.829268 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d90ff04-0c34-494c-9620-e40d29deb00c tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:20.829268 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d90ff04-0c34-494c-9620-e40d29deb00c tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:20.829268 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d90ff04-0c34-494c-9620-e40d29deb00c tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:20.829268 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d90ff04-0c34-494c-9620-e40d29deb00c tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:20.829268 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d90ff04-0c34-494c-9620-e40d29deb00c tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:20.830764 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2619/5127] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:05:20 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1604 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 11:05:21.492325 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6d90ff04-0c34-494c-9620-e40d29deb00c tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b794eec6c6346cd981cbc4929be2d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e840dc8280574c4ba37942e50731f01c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:21.505834 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6d90ff04-0c34-494c-9620-e40d29deb00c tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f" status: 200 len: 1314 microversion: 2.1 time: 0.704155 Sep 08 11:05:21.507010 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2509/5128] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:05:20 2022] GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f => generated 1314 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:05:21.845911 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-179c5197-483e-4aa5-817f-8dde3ad46de8 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:21.846521 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-179c5197-483e-4aa5-817f-8dde3ad46de8 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:21.874713 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-179c5197-483e-4aa5-817f-8dde3ad46de8 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:21.875613 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-179c5197-483e-4aa5-817f-8dde3ad46de8 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:21.876400 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-179c5197-483e-4aa5-817f-8dde3ad46de8 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:21.877342 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-179c5197-483e-4aa5-817f-8dde3ad46de8 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:21.878001 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-179c5197-483e-4aa5-817f-8dde3ad46de8 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:21.878603 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-179c5197-483e-4aa5-817f-8dde3ad46de8 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:22.047639 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-179c5197-483e-4aa5-817f-8dde3ad46de8 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:22.064530 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-179c5197-483e-4aa5-817f-8dde3ad46de8 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:22.092517 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-179c5197-483e-4aa5-817f-8dde3ad46de8 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:22.096106 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-179c5197-483e-4aa5-817f-8dde3ad46de8 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1604 microversion: 2.42 time: 0.254073 Sep 08 11:05:22.100014 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2620/5129] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:05:21 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1604 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:05:22.533599 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-344d6ebb-248e-49c9-a61f-1e7165466c32 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:22.535874 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-344d6ebb-248e-49c9-a61f-1e7165466c32 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: 938e014a-dca0-45aa-a90e-260597d8fd1f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:22.551359 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-344d6ebb-248e-49c9-a61f-1e7165466c32 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:22.554209 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-344d6ebb-248e-49c9-a61f-1e7165466c32 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:22.554956 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-344d6ebb-248e-49c9-a61f-1e7165466c32 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:22.555957 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-344d6ebb-248e-49c9-a61f-1e7165466c32 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:22.560739 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-344d6ebb-248e-49c9-a61f-1e7165466c32 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:22.561591 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-344d6ebb-248e-49c9-a61f-1e7165466c32 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:23.145692 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7aaca278-7672-4552-9463-4c3c848e2fe2 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:23.147166 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7aaca278-7672-4552-9463-4c3c848e2fe2 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:23.167338 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7aaca278-7672-4552-9463-4c3c848e2fe2 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:23.172129 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7aaca278-7672-4552-9463-4c3c848e2fe2 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:23.172752 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7aaca278-7672-4552-9463-4c3c848e2fe2 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:23.177283 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7aaca278-7672-4552-9463-4c3c848e2fe2 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:23.178158 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7aaca278-7672-4552-9463-4c3c848e2fe2 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:23.180025 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7aaca278-7672-4552-9463-4c3c848e2fe2 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:23.357103 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7aaca278-7672-4552-9463-4c3c848e2fe2 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:23.374470 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7aaca278-7672-4552-9463-4c3c848e2fe2 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:23.376834 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7aaca278-7672-4552-9463-4c3c848e2fe2 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:23.378312 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7aaca278-7672-4552-9463-4c3c848e2fe2 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1604 microversion: 2.42 time: 0.238096 Sep 08 11:05:23.379972 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2621/5130] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:05:23 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1604 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 11:05:23.649535 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-344d6ebb-248e-49c9-a61f-1e7165466c32 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b794eec6c6346cd981cbc4929be2d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e840dc8280574c4ba37942e50731f01c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:23.666442 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-344d6ebb-248e-49c9-a61f-1e7165466c32 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f" status: 200 len: 1314 microversion: 2.1 time: 1.136372 Sep 08 11:05:23.685115 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2510/5131] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:05:22 2022] GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f => generated 1314 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:05:24.406623 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5501d63a-5194-417d-960a-54d8a9aad518 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:24.407279 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5501d63a-5194-417d-960a-54d8a9aad518 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:24.420747 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:05:24.422291 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5501d63a-5194-417d-960a-54d8a9aad518 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:24.422818 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5501d63a-5194-417d-960a-54d8a9aad518 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:24.423261 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5501d63a-5194-417d-960a-54d8a9aad518 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:24.423977 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5501d63a-5194-417d-960a-54d8a9aad518 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:24.424431 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5501d63a-5194-417d-960a-54d8a9aad518 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:24.424852 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5501d63a-5194-417d-960a-54d8a9aad518 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:24.722882 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-134a1b6e-074b-470c-a6ce-f56aac05e310 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:24.723682 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-134a1b6e-074b-470c-a6ce-f56aac05e310 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: 938e014a-dca0-45aa-a90e-260597d8fd1f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:24.738803 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=42 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:05:24.743427 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-134a1b6e-074b-470c-a6ce-f56aac05e310 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:24.744212 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-134a1b6e-074b-470c-a6ce-f56aac05e310 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:24.750959 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-134a1b6e-074b-470c-a6ce-f56aac05e310 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:24.752236 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-134a1b6e-074b-470c-a6ce-f56aac05e310 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:24.753339 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-134a1b6e-074b-470c-a6ce-f56aac05e310 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:24.754078 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-134a1b6e-074b-470c-a6ce-f56aac05e310 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:25.360972 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-134a1b6e-074b-470c-a6ce-f56aac05e310 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b794eec6c6346cd981cbc4929be2d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e840dc8280574c4ba37942e50731f01c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:25.383092 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-134a1b6e-074b-470c-a6ce-f56aac05e310 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f" status: 200 len: 1500 microversion: 2.1 time: 0.665015 Sep 08 11:05:25.401676 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2511/5132] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:05:24 2022] GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f => generated 1500 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:05:25.424402 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7c773bb3-55f2-44cc-85a9-2e7c55867ac1 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:05:25.439625 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7c773bb3-55f2-44cc-85a9-2e7c55867ac1 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: 938e014a-dca0-45aa-a90e-260597d8fd1f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:25.455095 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c773bb3-55f2-44cc-85a9-2e7c55867ac1 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:25.456391 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c773bb3-55f2-44cc-85a9-2e7c55867ac1 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:25.457786 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c773bb3-55f2-44cc-85a9-2e7c55867ac1 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:25.460362 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5501d63a-5194-417d-960a-54d8a9aad518 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:25.462894 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c773bb3-55f2-44cc-85a9-2e7c55867ac1 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:25.468522 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c773bb3-55f2-44cc-85a9-2e7c55867ac1 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:25.469741 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c773bb3-55f2-44cc-85a9-2e7c55867ac1 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:25.487730 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5501d63a-5194-417d-960a-54d8a9aad518 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:25.502767 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5501d63a-5194-417d-960a-54d8a9aad518 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:25.509240 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5501d63a-5194-417d-960a-54d8a9aad518 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1604 microversion: 2.42 time: 1.102074 Sep 08 11:05:25.510162 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2622/5133] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:05:24 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1604 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:05:25.603098 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-7c773bb3-55f2-44cc-85a9-2e7c55867ac1 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lazy-loading 'flavor' on Instance uuid 938e014a-dca0-45aa-a90e-260597d8fd1f {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:05:25.848304 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7c773bb3-55f2-44cc-85a9-2e7c55867ac1 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "POST /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f/action" status: 200 len: 32 microversion: 2.1 time: 0.435016 Sep 08 11:05:25.852183 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2512/5134] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 11:05:25 2022] POST /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f/action => generated 32 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 11:05:25.863281 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-71c95763-2892-47a2-8db0-66a18c99966a tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:25.866610 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-71c95763-2892-47a2-8db0-66a18c99966a tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: 938e014a-dca0-45aa-a90e-260597d8fd1f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:25.875801 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-71c95763-2892-47a2-8db0-66a18c99966a tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:25.877231 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-71c95763-2892-47a2-8db0-66a18c99966a tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:25.878464 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-71c95763-2892-47a2-8db0-66a18c99966a tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:25.879732 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-71c95763-2892-47a2-8db0-66a18c99966a tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:25.880698 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-71c95763-2892-47a2-8db0-66a18c99966a tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:25.881934 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-71c95763-2892-47a2-8db0-66a18c99966a tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:26.348094 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-71c95763-2892-47a2-8db0-66a18c99966a tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b794eec6c6346cd981cbc4929be2d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e840dc8280574c4ba37942e50731f01c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:26.358380 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-71c95763-2892-47a2-8db0-66a18c99966a tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f" status: 200 len: 1506 microversion: 2.1 time: 0.499115 Sep 08 11:05:26.378413 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2623/5135] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:05:25 2022] GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f => generated 1506 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:05:26.547008 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-23a08606-df22-4669-a8da-f884d2b7ee82 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:26.548030 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-23a08606-df22-4669-a8da-f884d2b7ee82 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:26.567070 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23a08606-df22-4669-a8da-f884d2b7ee82 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:26.567569 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23a08606-df22-4669-a8da-f884d2b7ee82 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:26.568224 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23a08606-df22-4669-a8da-f884d2b7ee82 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:26.568946 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23a08606-df22-4669-a8da-f884d2b7ee82 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:26.569434 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23a08606-df22-4669-a8da-f884d2b7ee82 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:26.569859 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23a08606-df22-4669-a8da-f884d2b7ee82 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:27.122800 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-23a08606-df22-4669-a8da-f884d2b7ee82 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:27.149331 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-23a08606-df22-4669-a8da-f884d2b7ee82 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:27.168940 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-23a08606-df22-4669-a8da-f884d2b7ee82 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:27.178572 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-23a08606-df22-4669-a8da-f884d2b7ee82 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1604 microversion: 2.42 time: 0.634604 Sep 08 11:05:27.203748 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2513/5136] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:05:26 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1604 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:05:27.388348 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1d3df072-14ae-46e8-846d-34d3637811fe tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:27.389223 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1d3df072-14ae-46e8-846d-34d3637811fe tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: 938e014a-dca0-45aa-a90e-260597d8fd1f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:27.414949 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1d3df072-14ae-46e8-846d-34d3637811fe tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:27.415459 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1d3df072-14ae-46e8-846d-34d3637811fe tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:27.416005 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1d3df072-14ae-46e8-846d-34d3637811fe tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:27.416734 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1d3df072-14ae-46e8-846d-34d3637811fe tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:27.422847 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1d3df072-14ae-46e8-846d-34d3637811fe tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:27.425687 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1d3df072-14ae-46e8-846d-34d3637811fe tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:28.219588 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-54253b3b-f2a5-4ac0-88eb-050d7191baec tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:28.220239 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-54253b3b-f2a5-4ac0-88eb-050d7191baec tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:28.229410 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54253b3b-f2a5-4ac0-88eb-050d7191baec tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:28.230151 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54253b3b-f2a5-4ac0-88eb-050d7191baec tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:28.231351 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54253b3b-f2a5-4ac0-88eb-050d7191baec tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:28.232763 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54253b3b-f2a5-4ac0-88eb-050d7191baec tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:28.234064 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54253b3b-f2a5-4ac0-88eb-050d7191baec tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:28.234904 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54253b3b-f2a5-4ac0-88eb-050d7191baec tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:28.373441 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-54253b3b-f2a5-4ac0-88eb-050d7191baec tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:28.401500 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-54253b3b-f2a5-4ac0-88eb-050d7191baec tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:28.406605 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-54253b3b-f2a5-4ac0-88eb-050d7191baec tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:28.412712 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-54253b3b-f2a5-4ac0-88eb-050d7191baec tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1604 microversion: 2.42 time: 0.198250 Sep 08 11:05:28.426285 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2514/5137] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:05:28 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1604 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:05:28.582085 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1d3df072-14ae-46e8-846d-34d3637811fe tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b794eec6c6346cd981cbc4929be2d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e840dc8280574c4ba37942e50731f01c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:28.598855 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1d3df072-14ae-46e8-846d-34d3637811fe tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f" status: 200 len: 1506 microversion: 2.1 time: 1.214290 Sep 08 11:05:28.600786 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2624/5138] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:05:27 2022] GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f => generated 1506 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:05:29.451635 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9d42c96e-cc11-41cc-b3a3-b625ebb9a00d tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:29.452883 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9d42c96e-cc11-41cc-b3a3-b625ebb9a00d tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:29.466304 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d42c96e-cc11-41cc-b3a3-b625ebb9a00d tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:29.469302 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d42c96e-cc11-41cc-b3a3-b625ebb9a00d tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:29.470350 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d42c96e-cc11-41cc-b3a3-b625ebb9a00d tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:29.475754 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d42c96e-cc11-41cc-b3a3-b625ebb9a00d tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:29.476438 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d42c96e-cc11-41cc-b3a3-b625ebb9a00d tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:29.477053 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d42c96e-cc11-41cc-b3a3-b625ebb9a00d tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:29.629633 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e6f10c98-1c26-4b5f-83b6-683088d6fec9 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:29.630267 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e6f10c98-1c26-4b5f-83b6-683088d6fec9 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: 938e014a-dca0-45aa-a90e-260597d8fd1f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:29.658742 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e6f10c98-1c26-4b5f-83b6-683088d6fec9 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:29.662665 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e6f10c98-1c26-4b5f-83b6-683088d6fec9 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:29.663284 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e6f10c98-1c26-4b5f-83b6-683088d6fec9 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:29.666418 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e6f10c98-1c26-4b5f-83b6-683088d6fec9 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:29.668768 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e6f10c98-1c26-4b5f-83b6-683088d6fec9 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:29.670073 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e6f10c98-1c26-4b5f-83b6-683088d6fec9 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:29.743981 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9d42c96e-cc11-41cc-b3a3-b625ebb9a00d tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:29.766818 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9d42c96e-cc11-41cc-b3a3-b625ebb9a00d tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:29.769938 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9d42c96e-cc11-41cc-b3a3-b625ebb9a00d tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:29.778677 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9d42c96e-cc11-41cc-b3a3-b625ebb9a00d tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1604 microversion: 2.42 time: 0.334328 Sep 08 11:05:29.781552 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2515/5139] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:05:29 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1604 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:05:29.950098 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e6f10c98-1c26-4b5f-83b6-683088d6fec9 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b794eec6c6346cd981cbc4929be2d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e840dc8280574c4ba37942e50731f01c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:29.967854 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e6f10c98-1c26-4b5f-83b6-683088d6fec9 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f" status: 200 len: 1506 microversion: 2.1 time: 0.341202 Sep 08 11:05:29.970080 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2625/5140] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:05:29 2022] GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f => generated 1506 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:05:30.811285 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-25f3aff5-42cc-4ab8-a7fe-fee768549fff tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:30.811967 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-25f3aff5-42cc-4ab8-a7fe-fee768549fff tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:30.827614 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25f3aff5-42cc-4ab8-a7fe-fee768549fff tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:30.829272 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25f3aff5-42cc-4ab8-a7fe-fee768549fff tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:30.830826 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25f3aff5-42cc-4ab8-a7fe-fee768549fff tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:30.832506 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25f3aff5-42cc-4ab8-a7fe-fee768549fff tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:30.834959 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25f3aff5-42cc-4ab8-a7fe-fee768549fff tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:30.841311 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25f3aff5-42cc-4ab8-a7fe-fee768549fff tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:30.994557 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d4005ac1-f51f-46a3-9642-c4a66fda4e50 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:30.995268 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d4005ac1-f51f-46a3-9642-c4a66fda4e50 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: 938e014a-dca0-45aa-a90e-260597d8fd1f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:31.014507 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d4005ac1-f51f-46a3-9642-c4a66fda4e50 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:31.017398 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d4005ac1-f51f-46a3-9642-c4a66fda4e50 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:31.019979 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d4005ac1-f51f-46a3-9642-c4a66fda4e50 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:31.023633 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d4005ac1-f51f-46a3-9642-c4a66fda4e50 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:31.024401 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d4005ac1-f51f-46a3-9642-c4a66fda4e50 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:31.025989 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d4005ac1-f51f-46a3-9642-c4a66fda4e50 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:31.252962 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-25f3aff5-42cc-4ab8-a7fe-fee768549fff tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:31.273570 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-25f3aff5-42cc-4ab8-a7fe-fee768549fff tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:31.278732 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-25f3aff5-42cc-4ab8-a7fe-fee768549fff tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:31.280345 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-25f3aff5-42cc-4ab8-a7fe-fee768549fff tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1604 microversion: 2.42 time: 0.475343 Sep 08 11:05:31.288195 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2516/5141] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:05:30 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1604 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:05:31.606438 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d4005ac1-f51f-46a3-9642-c4a66fda4e50 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b794eec6c6346cd981cbc4929be2d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e840dc8280574c4ba37942e50731f01c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:31.624364 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d4005ac1-f51f-46a3-9642-c4a66fda4e50 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f" status: 200 len: 1506 microversion: 2.1 time: 0.634672 Sep 08 11:05:31.642799 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2626/5142] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:05:30 2022] GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f => generated 1506 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:05:32.328890 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-38e417c6-406b-422c-a3d6-246237b97de1 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:32.334449 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-38e417c6-406b-422c-a3d6-246237b97de1 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:32.359248 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38e417c6-406b-422c-a3d6-246237b97de1 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:32.361531 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38e417c6-406b-422c-a3d6-246237b97de1 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:32.362797 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38e417c6-406b-422c-a3d6-246237b97de1 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:32.363562 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38e417c6-406b-422c-a3d6-246237b97de1 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:32.366257 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38e417c6-406b-422c-a3d6-246237b97de1 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:32.366918 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38e417c6-406b-422c-a3d6-246237b97de1 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:32.655994 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0485e219-9c21-448e-8449-b230d9c6a042 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:32.658131 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0485e219-9c21-448e-8449-b230d9c6a042 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: 938e014a-dca0-45aa-a90e-260597d8fd1f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:32.679924 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0485e219-9c21-448e-8449-b230d9c6a042 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:32.680864 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0485e219-9c21-448e-8449-b230d9c6a042 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:32.681641 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0485e219-9c21-448e-8449-b230d9c6a042 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:32.682881 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0485e219-9c21-448e-8449-b230d9c6a042 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:32.683311 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-38e417c6-406b-422c-a3d6-246237b97de1 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:32.686588 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0485e219-9c21-448e-8449-b230d9c6a042 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:32.687239 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0485e219-9c21-448e-8449-b230d9c6a042 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:32.703235 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-38e417c6-406b-422c-a3d6-246237b97de1 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:32.709885 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-38e417c6-406b-422c-a3d6-246237b97de1 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:32.711698 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-38e417c6-406b-422c-a3d6-246237b97de1 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1604 microversion: 2.42 time: 0.394829 Sep 08 11:05:32.719031 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2517/5143] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:05:32 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1604 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:05:33.748755 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ee7c28ae-e2cb-47de-b548-6905e9d8c95f tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:33.751017 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ee7c28ae-e2cb-47de-b548-6905e9d8c95f tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:33.771278 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ee7c28ae-e2cb-47de-b548-6905e9d8c95f tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:33.773124 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ee7c28ae-e2cb-47de-b548-6905e9d8c95f tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:33.776331 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ee7c28ae-e2cb-47de-b548-6905e9d8c95f tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:33.780702 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ee7c28ae-e2cb-47de-b548-6905e9d8c95f tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:33.786425 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ee7c28ae-e2cb-47de-b548-6905e9d8c95f tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:33.787970 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ee7c28ae-e2cb-47de-b548-6905e9d8c95f tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:33.988969 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ee7c28ae-e2cb-47de-b548-6905e9d8c95f tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:34.016232 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ee7c28ae-e2cb-47de-b548-6905e9d8c95f tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:34.018041 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ee7c28ae-e2cb-47de-b548-6905e9d8c95f tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:34.019293 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ee7c28ae-e2cb-47de-b548-6905e9d8c95f tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1604 microversion: 2.42 time: 0.275436 Sep 08 11:05:34.019862 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2518/5144] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:05:33 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1604 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:05:34.519094 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0485e219-9c21-448e-8449-b230d9c6a042 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b794eec6c6346cd981cbc4929be2d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e840dc8280574c4ba37942e50731f01c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:34.557168 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0485e219-9c21-448e-8449-b230d9c6a042 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f" status: 200 len: 1506 microversion: 2.1 time: 1.904259 Sep 08 11:05:34.562963 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2627/5145] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:05:32 2022] GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f => generated 1506 bytes in 1913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:05:35.052120 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-597f351e-e246-4c1e-909c-9c57e55d3862 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:35.053417 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-597f351e-e246-4c1e-909c-9c57e55d3862 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:35.079963 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-597f351e-e246-4c1e-909c-9c57e55d3862 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:35.088420 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-597f351e-e246-4c1e-909c-9c57e55d3862 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:35.092245 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-597f351e-e246-4c1e-909c-9c57e55d3862 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:35.094427 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-597f351e-e246-4c1e-909c-9c57e55d3862 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:35.098181 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-597f351e-e246-4c1e-909c-9c57e55d3862 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:35.099673 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-597f351e-e246-4c1e-909c-9c57e55d3862 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:35.352766 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-597f351e-e246-4c1e-909c-9c57e55d3862 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:35.378259 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-597f351e-e246-4c1e-909c-9c57e55d3862 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:35.381642 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-597f351e-e246-4c1e-909c-9c57e55d3862 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:35.390145 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-597f351e-e246-4c1e-909c-9c57e55d3862 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1604 microversion: 2.42 time: 0.343899 Sep 08 11:05:35.412370 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2519/5146] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:05:35 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1604 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:05:35.588728 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-22f71e92-2e7a-45ae-b3da-b7604014d90c tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:35.591804 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-22f71e92-2e7a-45ae-b3da-b7604014d90c tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: 938e014a-dca0-45aa-a90e-260597d8fd1f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:35.619428 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-22f71e92-2e7a-45ae-b3da-b7604014d90c tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:35.620045 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-22f71e92-2e7a-45ae-b3da-b7604014d90c tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:35.620500 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-22f71e92-2e7a-45ae-b3da-b7604014d90c tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:35.627882 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-22f71e92-2e7a-45ae-b3da-b7604014d90c tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:35.628425 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-22f71e92-2e7a-45ae-b3da-b7604014d90c tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:35.628875 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-22f71e92-2e7a-45ae-b3da-b7604014d90c tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:36.428612 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6c54f4bf-9f24-4014-9184-31747c1fc68f tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:36.429900 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6c54f4bf-9f24-4014-9184-31747c1fc68f tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:36.448583 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6c54f4bf-9f24-4014-9184-31747c1fc68f tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:36.448820 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6c54f4bf-9f24-4014-9184-31747c1fc68f tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:36.454225 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6c54f4bf-9f24-4014-9184-31747c1fc68f tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:36.458539 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6c54f4bf-9f24-4014-9184-31747c1fc68f tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:36.462726 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6c54f4bf-9f24-4014-9184-31747c1fc68f tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:36.464334 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6c54f4bf-9f24-4014-9184-31747c1fc68f tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:36.583729 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-22f71e92-2e7a-45ae-b3da-b7604014d90c tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b794eec6c6346cd981cbc4929be2d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e840dc8280574c4ba37942e50731f01c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:36.604781 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-22f71e92-2e7a-45ae-b3da-b7604014d90c tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f" status: 200 len: 1506 microversion: 2.1 time: 1.022223 Sep 08 11:05:36.609626 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2628/5147] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:05:35 2022] GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f => generated 1506 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:05:36.824719 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6c54f4bf-9f24-4014-9184-31747c1fc68f tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:36.850305 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6c54f4bf-9f24-4014-9184-31747c1fc68f tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:36.859357 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6c54f4bf-9f24-4014-9184-31747c1fc68f tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:36.861123 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6c54f4bf-9f24-4014-9184-31747c1fc68f tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1604 microversion: 2.42 time: 0.437014 Sep 08 11:05:36.869276 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2520/5148] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:05:36 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1604 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:05:37.633293 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0dabb5af-afd9-4a3e-b9e0-a835be3ce10b tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:37.634098 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0dabb5af-afd9-4a3e-b9e0-a835be3ce10b tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: 938e014a-dca0-45aa-a90e-260597d8fd1f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:37.649421 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0dabb5af-afd9-4a3e-b9e0-a835be3ce10b tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:37.650097 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0dabb5af-afd9-4a3e-b9e0-a835be3ce10b tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:37.651435 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0dabb5af-afd9-4a3e-b9e0-a835be3ce10b tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:37.655180 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0dabb5af-afd9-4a3e-b9e0-a835be3ce10b tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:37.655835 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0dabb5af-afd9-4a3e-b9e0-a835be3ce10b tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:37.656411 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0dabb5af-afd9-4a3e-b9e0-a835be3ce10b tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:37.898805 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-64ce8680-8788-4737-9490-75e6687a7d50 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:37.899436 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-64ce8680-8788-4737-9490-75e6687a7d50 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:37.921656 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64ce8680-8788-4737-9490-75e6687a7d50 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:37.922767 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64ce8680-8788-4737-9490-75e6687a7d50 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:37.925944 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64ce8680-8788-4737-9490-75e6687a7d50 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:37.929655 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64ce8680-8788-4737-9490-75e6687a7d50 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:37.932363 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64ce8680-8788-4737-9490-75e6687a7d50 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:37.934513 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64ce8680-8788-4737-9490-75e6687a7d50 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:38.384720 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-64ce8680-8788-4737-9490-75e6687a7d50 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:38.459532 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-64ce8680-8788-4737-9490-75e6687a7d50 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:38.482776 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-64ce8680-8788-4737-9490-75e6687a7d50 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:38.494220 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-64ce8680-8788-4737-9490-75e6687a7d50 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1604 microversion: 2.42 time: 0.590134 Sep 08 11:05:38.495463 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2521/5149] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:05:37 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1604 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 11:05:39.250106 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0dabb5af-afd9-4a3e-b9e0-a835be3ce10b tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b794eec6c6346cd981cbc4929be2d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e840dc8280574c4ba37942e50731f01c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:39.278544 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0dabb5af-afd9-4a3e-b9e0-a835be3ce10b tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f" status: 200 len: 1506 microversion: 2.1 time: 1.649072 Sep 08 11:05:39.283389 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2629/5150] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:05:37 2022] GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f => generated 1506 bytes in 1656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:05:39.527938 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e00e792c-92f1-420a-ab96-2fa39bc4d0d1 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:39.529466 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e00e792c-92f1-420a-ab96-2fa39bc4d0d1 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:39.542203 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e00e792c-92f1-420a-ab96-2fa39bc4d0d1 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:39.542789 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e00e792c-92f1-420a-ab96-2fa39bc4d0d1 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:39.543610 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e00e792c-92f1-420a-ab96-2fa39bc4d0d1 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:39.544366 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e00e792c-92f1-420a-ab96-2fa39bc4d0d1 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:39.544841 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e00e792c-92f1-420a-ab96-2fa39bc4d0d1 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:39.559654 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e00e792c-92f1-420a-ab96-2fa39bc4d0d1 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:39.627231 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:05:39.890055 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e00e792c-92f1-420a-ab96-2fa39bc4d0d1 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:39.914909 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e00e792c-92f1-420a-ab96-2fa39bc4d0d1 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:39.920591 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e00e792c-92f1-420a-ab96-2fa39bc4d0d1 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:39.922308 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e00e792c-92f1-420a-ab96-2fa39bc4d0d1 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1604 microversion: 2.42 time: 0.399431 Sep 08 11:05:39.942078 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2522/5151] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:05:39 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1604 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:05:40.309740 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a3221872-c821-44ad-948f-dd15cc8796d9 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:40.310384 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a3221872-c821-44ad-948f-dd15cc8796d9 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: 938e014a-dca0-45aa-a90e-260597d8fd1f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:40.333387 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a3221872-c821-44ad-948f-dd15cc8796d9 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:40.333913 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a3221872-c821-44ad-948f-dd15cc8796d9 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:40.334367 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a3221872-c821-44ad-948f-dd15cc8796d9 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:40.340860 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a3221872-c821-44ad-948f-dd15cc8796d9 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:40.341510 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a3221872-c821-44ad-948f-dd15cc8796d9 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:40.341971 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a3221872-c821-44ad-948f-dd15cc8796d9 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:40.961495 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b3eb32dd-eab8-4041-a0bd-732001333bb6 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:40.962884 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b3eb32dd-eab8-4041-a0bd-732001333bb6 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:40.989345 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3eb32dd-eab8-4041-a0bd-732001333bb6 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:40.992790 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3eb32dd-eab8-4041-a0bd-732001333bb6 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:40.993507 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3eb32dd-eab8-4041-a0bd-732001333bb6 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:40.996595 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3eb32dd-eab8-4041-a0bd-732001333bb6 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:41.002450 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3eb32dd-eab8-4041-a0bd-732001333bb6 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:41.005351 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3eb32dd-eab8-4041-a0bd-732001333bb6 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:41.281686 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b3eb32dd-eab8-4041-a0bd-732001333bb6 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:41.310779 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b3eb32dd-eab8-4041-a0bd-732001333bb6 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:41.330031 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b3eb32dd-eab8-4041-a0bd-732001333bb6 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:41.331380 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b3eb32dd-eab8-4041-a0bd-732001333bb6 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1604 microversion: 2.42 time: 0.376554 Sep 08 11:05:41.332006 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2523/5152] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:05:40 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1604 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:05:41.691345 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a3221872-c821-44ad-948f-dd15cc8796d9 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b794eec6c6346cd981cbc4929be2d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e840dc8280574c4ba37942e50731f01c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:41.703854 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a3221872-c821-44ad-948f-dd15cc8796d9 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f" status: 200 len: 1506 microversion: 2.1 time: 1.399716 Sep 08 11:05:41.728459 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2630/5153] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:05:40 2022] GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f => generated 1506 bytes in 1425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:05:42.362512 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4e9e626c-5d3a-48ac-9316-731c4a0c06dc tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:42.363863 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4e9e626c-5d3a-48ac-9316-731c4a0c06dc tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:42.376058 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e9e626c-5d3a-48ac-9316-731c4a0c06dc tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:42.384736 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e9e626c-5d3a-48ac-9316-731c4a0c06dc tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:42.387870 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e9e626c-5d3a-48ac-9316-731c4a0c06dc tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:42.390066 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e9e626c-5d3a-48ac-9316-731c4a0c06dc tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:42.395667 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e9e626c-5d3a-48ac-9316-731c4a0c06dc tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:42.401370 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e9e626c-5d3a-48ac-9316-731c4a0c06dc tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:42.733881 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0a58a1f2-2400-42f8-a4c3-95370816e62a tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:42.734509 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0a58a1f2-2400-42f8-a4c3-95370816e62a tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: 938e014a-dca0-45aa-a90e-260597d8fd1f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:42.749103 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0a58a1f2-2400-42f8-a4c3-95370816e62a tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:42.757394 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0a58a1f2-2400-42f8-a4c3-95370816e62a tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:42.757966 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0a58a1f2-2400-42f8-a4c3-95370816e62a tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:42.758747 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0a58a1f2-2400-42f8-a4c3-95370816e62a tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:42.759229 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0a58a1f2-2400-42f8-a4c3-95370816e62a tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:42.759670 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0a58a1f2-2400-42f8-a4c3-95370816e62a tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:43.005509 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4e9e626c-5d3a-48ac-9316-731c4a0c06dc tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:43.016932 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4e9e626c-5d3a-48ac-9316-731c4a0c06dc tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:43.043187 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4e9e626c-5d3a-48ac-9316-731c4a0c06dc tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:43.053497 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4e9e626c-5d3a-48ac-9316-731c4a0c06dc tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1604 microversion: 2.42 time: 0.694259 Sep 08 11:05:43.056966 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2524/5154] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:05:42 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1604 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 11:05:43.756737 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0a58a1f2-2400-42f8-a4c3-95370816e62a tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b794eec6c6346cd981cbc4929be2d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e840dc8280574c4ba37942e50731f01c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:43.774119 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0a58a1f2-2400-42f8-a4c3-95370816e62a tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f" status: 200 len: 1506 microversion: 2.1 time: 1.045640 Sep 08 11:05:43.784546 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2631/5155] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:05:42 2022] GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f => generated 1506 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:05:44.084620 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cf93709c-ab19-4c1d-875a-850ff6fa9358 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:44.085807 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cf93709c-ab19-4c1d-875a-850ff6fa9358 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:44.104044 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cf93709c-ab19-4c1d-875a-850ff6fa9358 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:44.124153 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cf93709c-ab19-4c1d-875a-850ff6fa9358 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:44.124632 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cf93709c-ab19-4c1d-875a-850ff6fa9358 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:44.126455 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cf93709c-ab19-4c1d-875a-850ff6fa9358 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:44.127103 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cf93709c-ab19-4c1d-875a-850ff6fa9358 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:44.127784 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cf93709c-ab19-4c1d-875a-850ff6fa9358 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:44.217777 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cf93709c-ab19-4c1d-875a-850ff6fa9358 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:44.243552 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cf93709c-ab19-4c1d-875a-850ff6fa9358 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:44.246157 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cf93709c-ab19-4c1d-875a-850ff6fa9358 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:44.258863 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cf93709c-ab19-4c1d-875a-850ff6fa9358 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1604 microversion: 2.42 time: 0.178663 Sep 08 11:05:44.278434 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2525/5156] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:05:44 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1604 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:05:44.804534 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cb41f35f-88c6-4cc9-b28a-bb126b82dcad tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:44.805851 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cb41f35f-88c6-4cc9-b28a-bb126b82dcad tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: 938e014a-dca0-45aa-a90e-260597d8fd1f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:44.835374 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb41f35f-88c6-4cc9-b28a-bb126b82dcad tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:44.837482 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb41f35f-88c6-4cc9-b28a-bb126b82dcad tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:44.840761 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb41f35f-88c6-4cc9-b28a-bb126b82dcad tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:44.842411 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb41f35f-88c6-4cc9-b28a-bb126b82dcad tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:44.850836 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb41f35f-88c6-4cc9-b28a-bb126b82dcad tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:44.851500 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb41f35f-88c6-4cc9-b28a-bb126b82dcad tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:45.292180 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-40761779-2e91-4aa5-90ef-0640dca744fd tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:45.292975 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-40761779-2e91-4aa5-90ef-0640dca744fd tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:45.310674 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-40761779-2e91-4aa5-90ef-0640dca744fd tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:45.312878 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-40761779-2e91-4aa5-90ef-0640dca744fd tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:45.313364 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-40761779-2e91-4aa5-90ef-0640dca744fd tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:45.326888 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-40761779-2e91-4aa5-90ef-0640dca744fd tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:45.327613 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-40761779-2e91-4aa5-90ef-0640dca744fd tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:45.329620 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-40761779-2e91-4aa5-90ef-0640dca744fd tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:45.808405 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-cb41f35f-88c6-4cc9-b28a-bb126b82dcad tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b794eec6c6346cd981cbc4929be2d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e840dc8280574c4ba37942e50731f01c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:45.849113 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cb41f35f-88c6-4cc9-b28a-bb126b82dcad tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f" status: 200 len: 1506 microversion: 2.1 time: 1.049156 Sep 08 11:05:45.854082 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2632/5157] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:05:44 2022] GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f => generated 1506 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:05:46.325374 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-40761779-2e91-4aa5-90ef-0640dca744fd tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:46.358308 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-40761779-2e91-4aa5-90ef-0640dca744fd tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:46.362803 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-40761779-2e91-4aa5-90ef-0640dca744fd tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:46.364221 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-40761779-2e91-4aa5-90ef-0640dca744fd tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1604 microversion: 2.42 time: 1.081796 Sep 08 11:05:46.367921 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2526/5158] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:05:45 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1604 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:05:46.882459 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-194d5c6b-c95c-4863-a96c-c09e1e21d6d9 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:46.883098 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-194d5c6b-c95c-4863-a96c-c09e1e21d6d9 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: 938e014a-dca0-45aa-a90e-260597d8fd1f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:46.891318 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-194d5c6b-c95c-4863-a96c-c09e1e21d6d9 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:46.891814 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-194d5c6b-c95c-4863-a96c-c09e1e21d6d9 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:46.897878 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-194d5c6b-c95c-4863-a96c-c09e1e21d6d9 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:46.898678 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-194d5c6b-c95c-4863-a96c-c09e1e21d6d9 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:46.899207 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-194d5c6b-c95c-4863-a96c-c09e1e21d6d9 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:46.899590 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-194d5c6b-c95c-4863-a96c-c09e1e21d6d9 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:47.395715 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e4047e03-2696-4f27-b1d5-57ad5dde0ace tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:47.396241 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e4047e03-2696-4f27-b1d5-57ad5dde0ace tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:47.425138 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e4047e03-2696-4f27-b1d5-57ad5dde0ace tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:47.425661 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e4047e03-2696-4f27-b1d5-57ad5dde0ace tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:47.437879 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e4047e03-2696-4f27-b1d5-57ad5dde0ace tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:47.444027 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e4047e03-2696-4f27-b1d5-57ad5dde0ace tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:47.444551 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e4047e03-2696-4f27-b1d5-57ad5dde0ace tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:47.449556 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e4047e03-2696-4f27-b1d5-57ad5dde0ace tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:48.497793 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-194d5c6b-c95c-4863-a96c-c09e1e21d6d9 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b794eec6c6346cd981cbc4929be2d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e840dc8280574c4ba37942e50731f01c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:48.507352 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-194d5c6b-c95c-4863-a96c-c09e1e21d6d9 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f" status: 200 len: 1506 microversion: 2.1 time: 1.628868 Sep 08 11:05:48.513843 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2633/5159] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:05:46 2022] GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f => generated 1506 bytes in 1636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:05:48.669302 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e4047e03-2696-4f27-b1d5-57ad5dde0ace tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:48.693916 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e4047e03-2696-4f27-b1d5-57ad5dde0ace tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:48.706252 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e4047e03-2696-4f27-b1d5-57ad5dde0ace tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:48.707511 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e4047e03-2696-4f27-b1d5-57ad5dde0ace tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1604 microversion: 2.42 time: 1.315853 Sep 08 11:05:48.717314 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2527/5160] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:05:47 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1604 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 11:05:49.537607 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-60b64fd2-66fe-4a34-9273-1d9edc4e6f40 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:49.538232 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-60b64fd2-66fe-4a34-9273-1d9edc4e6f40 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: 938e014a-dca0-45aa-a90e-260597d8fd1f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:49.561559 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-60b64fd2-66fe-4a34-9273-1d9edc4e6f40 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:49.562062 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-60b64fd2-66fe-4a34-9273-1d9edc4e6f40 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:49.562787 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-60b64fd2-66fe-4a34-9273-1d9edc4e6f40 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:49.566718 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-60b64fd2-66fe-4a34-9273-1d9edc4e6f40 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:49.569376 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-60b64fd2-66fe-4a34-9273-1d9edc4e6f40 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:49.570407 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-60b64fd2-66fe-4a34-9273-1d9edc4e6f40 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:49.735830 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-444653fb-4d94-49ce-8f27-3b55e95f747a tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:49.736960 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-444653fb-4d94-49ce-8f27-3b55e95f747a tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:49.747578 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-444653fb-4d94-49ce-8f27-3b55e95f747a tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:49.751582 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-444653fb-4d94-49ce-8f27-3b55e95f747a tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:49.752226 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-444653fb-4d94-49ce-8f27-3b55e95f747a tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:49.755025 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-444653fb-4d94-49ce-8f27-3b55e95f747a tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:49.757461 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-444653fb-4d94-49ce-8f27-3b55e95f747a tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:49.758869 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-444653fb-4d94-49ce-8f27-3b55e95f747a tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:49.953728 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-60b64fd2-66fe-4a34-9273-1d9edc4e6f40 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b794eec6c6346cd981cbc4929be2d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e840dc8280574c4ba37942e50731f01c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:49.963056 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-60b64fd2-66fe-4a34-9273-1d9edc4e6f40 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f" status: 200 len: 1506 microversion: 2.1 time: 0.429483 Sep 08 11:05:49.970956 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2634/5161] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:05:49 2022] GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f => generated 1506 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:05:50.047358 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-444653fb-4d94-49ce-8f27-3b55e95f747a tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:50.058772 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-444653fb-4d94-49ce-8f27-3b55e95f747a tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:50.065960 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-444653fb-4d94-49ce-8f27-3b55e95f747a tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:50.067466 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-444653fb-4d94-49ce-8f27-3b55e95f747a tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1604 microversion: 2.42 time: 0.335942 Sep 08 11:05:50.069768 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2528/5162] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:05:49 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1604 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 11:05:51.004282 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-96778f13-3c92-44b0-817f-301302260ac0 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:51.005547 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-96778f13-3c92-44b0-817f-301302260ac0 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: 938e014a-dca0-45aa-a90e-260597d8fd1f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:51.019018 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-96778f13-3c92-44b0-817f-301302260ac0 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:51.019793 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-96778f13-3c92-44b0-817f-301302260ac0 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:51.025845 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-96778f13-3c92-44b0-817f-301302260ac0 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:51.027762 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-96778f13-3c92-44b0-817f-301302260ac0 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:51.028411 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-96778f13-3c92-44b0-817f-301302260ac0 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:51.029469 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-96778f13-3c92-44b0-817f-301302260ac0 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:51.108376 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4cec107a-19e5-4f78-bf81-c8b049800397 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:51.110452 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4cec107a-19e5-4f78-bf81-c8b049800397 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:51.146383 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4cec107a-19e5-4f78-bf81-c8b049800397 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:51.146779 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4cec107a-19e5-4f78-bf81-c8b049800397 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:51.149899 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4cec107a-19e5-4f78-bf81-c8b049800397 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:51.153732 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4cec107a-19e5-4f78-bf81-c8b049800397 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:51.154647 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4cec107a-19e5-4f78-bf81-c8b049800397 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:51.155481 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4cec107a-19e5-4f78-bf81-c8b049800397 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:51.382235 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4cec107a-19e5-4f78-bf81-c8b049800397 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:51.382823 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4cec107a-19e5-4f78-bf81-c8b049800397 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:51.383280 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4cec107a-19e5-4f78-bf81-c8b049800397 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:51.383755 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-4cec107a-19e5-4f78-bf81-c8b049800397 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lazy-loading 'fault' on Instance uuid 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:05:51.605680 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-96778f13-3c92-44b0-817f-301302260ac0 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b794eec6c6346cd981cbc4929be2d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e840dc8280574c4ba37942e50731f01c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:51.619856 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-96778f13-3c92-44b0-817f-301302260ac0 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f" status: 200 len: 1506 microversion: 2.1 time: 0.619771 Sep 08 11:05:51.623063 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2635/5163] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:05:50 2022] GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f => generated 1506 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:05:51.758777 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4cec107a-19e5-4f78-bf81-c8b049800397 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:51.790005 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4cec107a-19e5-4f78-bf81-c8b049800397 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:51.791525 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4cec107a-19e5-4f78-bf81-c8b049800397 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ba7568d44ad47e8b37504ecc8a402ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1582bf1f51b246c68ec82f173df79a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:51.800619 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4cec107a-19e5-4f78-bf81-c8b049800397 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 200 len: 1609 microversion: 2.42 time: 0.690464 Sep 08 11:05:51.805171 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2529/5164] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:05:51 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 1609 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 11:05:52.665539 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d0579fa0-8340-4e53-9a9e-2bb25cc34581 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:52.666175 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d0579fa0-8340-4e53-9a9e-2bb25cc34581 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: 938e014a-dca0-45aa-a90e-260597d8fd1f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:52.684338 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d0579fa0-8340-4e53-9a9e-2bb25cc34581 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:52.684854 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d0579fa0-8340-4e53-9a9e-2bb25cc34581 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:52.685338 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d0579fa0-8340-4e53-9a9e-2bb25cc34581 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:52.686076 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d0579fa0-8340-4e53-9a9e-2bb25cc34581 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:52.686542 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d0579fa0-8340-4e53-9a9e-2bb25cc34581 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:52.686974 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d0579fa0-8340-4e53-9a9e-2bb25cc34581 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:52.812601 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=97 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:05:52.836739 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b46d504c-5847-433a-a84f-0bbc9fabb55c tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:52.838060 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b46d504c-5847-433a-a84f-0bbc9fabb55c tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:52.861306 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b46d504c-5847-433a-a84f-0bbc9fabb55c tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:52.862075 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b46d504c-5847-433a-a84f-0bbc9fabb55c tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:52.862697 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b46d504c-5847-433a-a84f-0bbc9fabb55c tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:52.863585 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b46d504c-5847-433a-a84f-0bbc9fabb55c tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:52.864198 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b46d504c-5847-433a-a84f-0bbc9fabb55c tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:52.864780 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b46d504c-5847-433a-a84f-0bbc9fabb55c tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:52.908666 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-b46d504c-5847-433a-a84f-0bbc9fabb55c tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] HTTP exception thrown: Instance 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 could not be found. Sep 08 11:05:52.926360 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b46d504c-5847-433a-a84f-0bbc9fabb55c tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Request method failure captured: Sep 08 11:05:52.926360 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 HTTP/1.1 Sep 08 11:05:52.926360 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 11:05:52.926360 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 11:05:52.926360 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 11:05:52.926360 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 11:05:52.926360 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 11:05:52.926360 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 11:05:52.926360 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 11:05:52.926360 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 11:05:52.926360 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcrIsEQPBsFJxCGxh7fIUqj2XVaEpSUrDt1oWEGN9oGhg3rCbNLhcpluBkXK30-kS7Vm-TjcO1nCKuIFQoJ1nYZ0UAUHv4zQ51eh1IxcF9JI_FwPtNJ6cUgnlcX9D_dbxVq7325Uv_3csjHS3m4GBFWLXCWMGi4MQr_X34nc6ZlcoXA Sep 08 11:05:52.926360 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 11:05:52.926360 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 11:05:52.926360 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 11:05:52.926360 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 11:05:52.926360 n-d-850501-12 devstack@n-api.service[128862]: X-Openstack-Nova-Api-Version: 2.42 Sep 08 11:05:52.926360 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 11:05:52.926360 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 11:05:52.926360 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 1582bf1f51b246c68ec82f173df79a5a Sep 08 11:05:52.926360 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-654717678 Sep 08 11:05:52.926360 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 11:05:52.926360 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 11:05:52.926360 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1582bf1f51b246c68ec82f173df79a5a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1582bf1f51b246c68ec82f173df79a5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1582bf1f51b246c68ec82f173df79a5a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1582bf1f51b246c68ec82f173df79a5a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:05:52.926360 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-TaggedBootDevicesTest_v242-654717678 Sep 08 11:05:52.926360 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 1582bf1f51b246c68ec82f173df79a5a Sep 08 11:05:52.926360 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-654717678 Sep 08 11:05:52.926360 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-TaggedBootDevicesTest_v242-654717678-project Sep 08 11:05:52.926360 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 11:05:52.926360 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 11:05:52.926360 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 9ba7568d44ad47e8b37504ecc8a402ca Sep 08 11:05:52.926360 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-TaggedBootDevicesTest_v242-654717678-project Sep 08 11:05:52.926360 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 11:05:52.926360 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 could not be found. Sep 08 11:05:52.926360 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59'} Sep 08 11:05:52.926360 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:05:52.926360 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:05:52.926360 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:05:52.926360 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:05:52.926360 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:05:52.926360 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:05:52.926360 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:05:52.926360 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:05:52.926360 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:05:52.926360 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:05:52.926360 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 could not be found. Sep 08 11:05:52.926360 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:05:52.926360 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:05:52.926360 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:05:52.926360 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:05:52.926360 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:05:52.926360 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:05:52.926360 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:05:52.926360 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:05:52.926360 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:05:52.926360 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:05:52.926360 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:05:52.926360 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:05:52.926360 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:05:52.926360 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:05:52.926360 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:05:52.926360 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:05:52.926360 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 could not be found. Sep 08 11:05:52.926360 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:05:52.926360 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:05:52.930745 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:05:52.930745 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:05:52.930745 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:05:52.930745 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:05:52.930745 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:05:52.930745 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:05:52.930745 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 could not be found. Sep 08 11:05:52.930745 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:05:52.930745 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b46d504c-5847-433a-a84f-0bbc9fabb55c tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Returning 404 to user: Instance 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:05:52.930745 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b46d504c-5847-433a-a84f-0bbc9fabb55c tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 404 len: 111 microversion: 2.42 time: 0.100075 Sep 08 11:05:52.934379 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2530/5165] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:05:52 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 08 11:05:52.941648 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3fe2bd44-81ed-4a0a-8719-e5e3704549be tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '.version_select at 0x7f68e4630af0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:52.998925 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3fe2bd44-81ed-4a0a-8719-e5e3704549be tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1848326281" status: 204 len: 0 microversion: 2.42 time: 0.061802 Sep 08 11:05:53.006796 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2531/5166] 10.222.0.27 () {60 vars in 1262 bytes} [Thu Sep 8 11:05:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1848326281 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 11:05:53.340070 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d0579fa0-8340-4e53-9a9e-2bb25cc34581 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b794eec6c6346cd981cbc4929be2d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e840dc8280574c4ba37942e50731f01c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:53.350666 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d0579fa0-8340-4e53-9a9e-2bb25cc34581 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f" status: 200 len: 1506 microversion: 2.1 time: 0.692952 Sep 08 11:05:53.363417 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2636/5167] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:05:52 2022] GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f => generated 1506 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:05:54.390578 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6d2d0362-0b3d-48e2-976a-e5ae163fa835 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:54.394297 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6d2d0362-0b3d-48e2-976a-e5ae163fa835 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: 938e014a-dca0-45aa-a90e-260597d8fd1f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:54.431183 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d2d0362-0b3d-48e2-976a-e5ae163fa835 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:54.432086 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d2d0362-0b3d-48e2-976a-e5ae163fa835 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:54.434472 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d2d0362-0b3d-48e2-976a-e5ae163fa835 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:54.435841 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d2d0362-0b3d-48e2-976a-e5ae163fa835 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:54.440188 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d2d0362-0b3d-48e2-976a-e5ae163fa835 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:54.440892 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d2d0362-0b3d-48e2-976a-e5ae163fa835 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:56.181381 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6d2d0362-0b3d-48e2-976a-e5ae163fa835 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b794eec6c6346cd981cbc4929be2d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e840dc8280574c4ba37942e50731f01c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:56.196037 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6d2d0362-0b3d-48e2-976a-e5ae163fa835 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f" status: 200 len: 1506 microversion: 2.1 time: 1.811937 Sep 08 11:05:56.206825 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2532/5168] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:05:54 2022] GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f => generated 1506 bytes in 1827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:05:57.220442 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-30e06965-890f-4542-abfe-f1740b587ba2 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:57.221046 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-30e06965-890f-4542-abfe-f1740b587ba2 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: 938e014a-dca0-45aa-a90e-260597d8fd1f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:57.223513 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=30 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:05:57.236503 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-30e06965-890f-4542-abfe-f1740b587ba2 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:57.247273 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-30e06965-890f-4542-abfe-f1740b587ba2 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:57.251468 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-30e06965-890f-4542-abfe-f1740b587ba2 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:57.252280 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-30e06965-890f-4542-abfe-f1740b587ba2 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:57.257208 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-30e06965-890f-4542-abfe-f1740b587ba2 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:57.266583 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-30e06965-890f-4542-abfe-f1740b587ba2 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:58.076979 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-30e06965-890f-4542-abfe-f1740b587ba2 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b794eec6c6346cd981cbc4929be2d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e840dc8280574c4ba37942e50731f01c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:58.111726 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-30e06965-890f-4542-abfe-f1740b587ba2 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f" status: 200 len: 1506 microversion: 2.1 time: 0.895493 Sep 08 11:05:58.114239 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2637/5169] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:05:57 2022] GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f => generated 1506 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:05:59.151802 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-10a84725-b77b-4236-ad9d-23dfc824549e tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:59.152541 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-10a84725-b77b-4236-ad9d-23dfc824549e tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: 938e014a-dca0-45aa-a90e-260597d8fd1f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:59.171670 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:05:59.179094 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10a84725-b77b-4236-ad9d-23dfc824549e tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:59.181469 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10a84725-b77b-4236-ad9d-23dfc824549e tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:59.184108 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10a84725-b77b-4236-ad9d-23dfc824549e tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:59.188529 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10a84725-b77b-4236-ad9d-23dfc824549e tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:59.190933 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10a84725-b77b-4236-ad9d-23dfc824549e tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:59.191541 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10a84725-b77b-4236-ad9d-23dfc824549e tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:00.652908 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-10a84725-b77b-4236-ad9d-23dfc824549e tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b794eec6c6346cd981cbc4929be2d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e840dc8280574c4ba37942e50731f01c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:06:00.707152 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-10a84725-b77b-4236-ad9d-23dfc824549e tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f" status: 200 len: 1506 microversion: 2.1 time: 1.562984 Sep 08 11:06:00.718152 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2533/5170] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:05:59 2022] GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f => generated 1506 bytes in 1575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:06:01.764006 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b00dfb27-73c6-4b07-8348-4b5454f16a5f tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:06:01.765472 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b00dfb27-73c6-4b07-8348-4b5454f16a5f tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: 938e014a-dca0-45aa-a90e-260597d8fd1f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:06:01.779780 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b00dfb27-73c6-4b07-8348-4b5454f16a5f tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:01.786054 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b00dfb27-73c6-4b07-8348-4b5454f16a5f tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:01.786845 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b00dfb27-73c6-4b07-8348-4b5454f16a5f tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:01.787759 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b00dfb27-73c6-4b07-8348-4b5454f16a5f tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:01.788380 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b00dfb27-73c6-4b07-8348-4b5454f16a5f tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:01.788980 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b00dfb27-73c6-4b07-8348-4b5454f16a5f tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:02.299310 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b00dfb27-73c6-4b07-8348-4b5454f16a5f tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b794eec6c6346cd981cbc4929be2d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e840dc8280574c4ba37942e50731f01c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:06:02.354752 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b00dfb27-73c6-4b07-8348-4b5454f16a5f tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f" status: 200 len: 1486 microversion: 2.1 time: 0.596839 Sep 08 11:06:02.402335 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2638/5171] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:06:01 2022] GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f => generated 1486 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:06:02.415185 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-88b183b6-96de-49e0-bcb3-ae764ff456d1 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:06:02.416493 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-88b183b6-96de-49e0-bcb3-ae764ff456d1 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: 938e014a-dca0-45aa-a90e-260597d8fd1f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:06:02.443332 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-88b183b6-96de-49e0-bcb3-ae764ff456d1 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:02.444028 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-88b183b6-96de-49e0-bcb3-ae764ff456d1 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:02.444474 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-88b183b6-96de-49e0-bcb3-ae764ff456d1 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:02.449186 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-88b183b6-96de-49e0-bcb3-ae764ff456d1 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:02.451399 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-88b183b6-96de-49e0-bcb3-ae764ff456d1 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:02.452007 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-88b183b6-96de-49e0-bcb3-ae764ff456d1 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:02.676719 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-88b183b6-96de-49e0-bcb3-ae764ff456d1 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "POST /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f/action" status: 202 len: 0 microversion: 2.1 time: 0.260478 Sep 08 11:06:02.683908 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2534/5172] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 11:06:02 2022] POST /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f/action => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:06:02.687408 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-925f5924-8fc4-45fa-bb6d-970df9a127eb tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:06:02.688552 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-925f5924-8fc4-45fa-bb6d-970df9a127eb tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: 938e014a-dca0-45aa-a90e-260597d8fd1f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:06:02.701995 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-925f5924-8fc4-45fa-bb6d-970df9a127eb tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:02.704635 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-925f5924-8fc4-45fa-bb6d-970df9a127eb tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:02.705728 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-925f5924-8fc4-45fa-bb6d-970df9a127eb tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:02.709493 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-925f5924-8fc4-45fa-bb6d-970df9a127eb tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:02.710333 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-925f5924-8fc4-45fa-bb6d-970df9a127eb tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:02.726206 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-925f5924-8fc4-45fa-bb6d-970df9a127eb tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:03.737752 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-925f5924-8fc4-45fa-bb6d-970df9a127eb tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b794eec6c6346cd981cbc4929be2d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e840dc8280574c4ba37942e50731f01c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:06:03.750466 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-925f5924-8fc4-45fa-bb6d-970df9a127eb tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f" status: 200 len: 1494 microversion: 2.1 time: 1.066788 Sep 08 11:06:03.751076 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2639/5173] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:06:02 2022] GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f => generated 1494 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:06:04.779069 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ca167f8d-b32d-4d6f-a102-212ccd7b9a38 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:06:04.780364 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ca167f8d-b32d-4d6f-a102-212ccd7b9a38 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: 938e014a-dca0-45aa-a90e-260597d8fd1f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:06:04.800166 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ca167f8d-b32d-4d6f-a102-212ccd7b9a38 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:04.812234 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ca167f8d-b32d-4d6f-a102-212ccd7b9a38 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:04.821759 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ca167f8d-b32d-4d6f-a102-212ccd7b9a38 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:04.823178 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ca167f8d-b32d-4d6f-a102-212ccd7b9a38 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:04.823660 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ca167f8d-b32d-4d6f-a102-212ccd7b9a38 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:04.824102 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ca167f8d-b32d-4d6f-a102-212ccd7b9a38 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:05.886084 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ca167f8d-b32d-4d6f-a102-212ccd7b9a38 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b794eec6c6346cd981cbc4929be2d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e840dc8280574c4ba37942e50731f01c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:06:05.909262 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ca167f8d-b32d-4d6f-a102-212ccd7b9a38 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f" status: 200 len: 1494 microversion: 2.1 time: 1.135123 Sep 08 11:06:05.919711 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2535/5174] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:06:04 2022] GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f => generated 1494 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:06:06.940251 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ac1ccaa0-328c-4dde-a5fb-cfb6722d89d1 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:06:06.943240 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ac1ccaa0-328c-4dde-a5fb-cfb6722d89d1 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: 938e014a-dca0-45aa-a90e-260597d8fd1f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:06:06.968441 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ac1ccaa0-328c-4dde-a5fb-cfb6722d89d1 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:06.969345 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ac1ccaa0-328c-4dde-a5fb-cfb6722d89d1 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:06.971548 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ac1ccaa0-328c-4dde-a5fb-cfb6722d89d1 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:06.972553 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ac1ccaa0-328c-4dde-a5fb-cfb6722d89d1 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:06.973319 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ac1ccaa0-328c-4dde-a5fb-cfb6722d89d1 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:06.973980 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ac1ccaa0-328c-4dde-a5fb-cfb6722d89d1 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:07.719424 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ac1ccaa0-328c-4dde-a5fb-cfb6722d89d1 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b794eec6c6346cd981cbc4929be2d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e840dc8280574c4ba37942e50731f01c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:06:07.734413 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ac1ccaa0-328c-4dde-a5fb-cfb6722d89d1 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f" status: 200 len: 1494 microversion: 2.1 time: 0.798432 Sep 08 11:06:07.737513 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2640/5175] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:06:06 2022] GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f => generated 1494 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:06:08.765602 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9699a928-1229-463c-a0f4-2e20ed61b55c tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:06:08.767930 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9699a928-1229-463c-a0f4-2e20ed61b55c tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: 938e014a-dca0-45aa-a90e-260597d8fd1f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:06:08.795698 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9699a928-1229-463c-a0f4-2e20ed61b55c tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:08.796703 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9699a928-1229-463c-a0f4-2e20ed61b55c tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:08.797661 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9699a928-1229-463c-a0f4-2e20ed61b55c tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:08.812697 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9699a928-1229-463c-a0f4-2e20ed61b55c tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:08.813821 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9699a928-1229-463c-a0f4-2e20ed61b55c tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:08.814483 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9699a928-1229-463c-a0f4-2e20ed61b55c tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:10.951347 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9699a928-1229-463c-a0f4-2e20ed61b55c tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b794eec6c6346cd981cbc4929be2d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e840dc8280574c4ba37942e50731f01c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:06:10.954492 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:06:11.011837 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9699a928-1229-463c-a0f4-2e20ed61b55c tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f" status: 200 len: 1500 microversion: 2.1 time: 2.250986 Sep 08 11:06:11.017184 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2536/5176] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:06:08 2022] GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f => generated 1500 bytes in 2258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:06:11.060877 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5f856c3a-a0f0-4125-ba1f-6c4c41ec424f tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:06:11.062002 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5f856c3a-a0f0-4125-ba1f-6c4c41ec424f tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: 938e014a-dca0-45aa-a90e-260597d8fd1f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:06:11.080240 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5f856c3a-a0f0-4125-ba1f-6c4c41ec424f tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:11.084558 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5f856c3a-a0f0-4125-ba1f-6c4c41ec424f tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:11.086322 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5f856c3a-a0f0-4125-ba1f-6c4c41ec424f tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:11.087233 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5f856c3a-a0f0-4125-ba1f-6c4c41ec424f tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:11.090447 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5f856c3a-a0f0-4125-ba1f-6c4c41ec424f tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:11.091092 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5f856c3a-a0f0-4125-ba1f-6c4c41ec424f tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:11.160607 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5f856c3a-a0f0-4125-ba1f-6c4c41ec424f tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: 938e014a-dca0-45aa-a90e-260597d8fd1f] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:06:11.465691 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5f856c3a-a0f0-4125-ba1f-6c4c41ec424f tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "DELETE /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f" status: 204 len: 0 microversion: 2.1 time: 0.396435 Sep 08 11:06:11.483213 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2641/5177] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:06:11 2022] DELETE /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:06:11.512512 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8fd82450-5d1f-426c-b5fc-45b7cbcca317 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:06:11.514253 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8fd82450-5d1f-426c-b5fc-45b7cbcca317 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: 938e014a-dca0-45aa-a90e-260597d8fd1f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:06:11.541735 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8fd82450-5d1f-426c-b5fc-45b7cbcca317 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:11.547164 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8fd82450-5d1f-426c-b5fc-45b7cbcca317 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:11.558943 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8fd82450-5d1f-426c-b5fc-45b7cbcca317 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:11.565963 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8fd82450-5d1f-426c-b5fc-45b7cbcca317 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:11.567658 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8fd82450-5d1f-426c-b5fc-45b7cbcca317 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:11.581324 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8fd82450-5d1f-426c-b5fc-45b7cbcca317 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:12.516207 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8fd82450-5d1f-426c-b5fc-45b7cbcca317 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b794eec6c6346cd981cbc4929be2d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e840dc8280574c4ba37942e50731f01c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:06:12.541312 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8fd82450-5d1f-426c-b5fc-45b7cbcca317 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f" status: 200 len: 1506 microversion: 2.1 time: 1.034001 Sep 08 11:06:12.542485 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2537/5178] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:06:11 2022] GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f => generated 1506 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:06:13.591697 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0018f8d8-1fa7-423f-af42-af23042ef0a3 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:06:13.602536 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0018f8d8-1fa7-423f-af42-af23042ef0a3 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: 938e014a-dca0-45aa-a90e-260597d8fd1f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:06:13.671211 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0018f8d8-1fa7-423f-af42-af23042ef0a3 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:13.672376 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0018f8d8-1fa7-423f-af42-af23042ef0a3 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:13.673297 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0018f8d8-1fa7-423f-af42-af23042ef0a3 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:13.685782 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0018f8d8-1fa7-423f-af42-af23042ef0a3 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:13.691059 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0018f8d8-1fa7-423f-af42-af23042ef0a3 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:13.694716 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0018f8d8-1fa7-423f-af42-af23042ef0a3 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:15.348521 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0018f8d8-1fa7-423f-af42-af23042ef0a3 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b794eec6c6346cd981cbc4929be2d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e840dc8280574c4ba37942e50731f01c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:06:15.371996 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0018f8d8-1fa7-423f-af42-af23042ef0a3 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f" status: 200 len: 1506 microversion: 2.1 time: 1.795900 Sep 08 11:06:15.372613 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2642/5179] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:06:13 2022] GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f => generated 1506 bytes in 1798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:06:16.413974 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5db781b5-69eb-4a99-8182-92a9595241d2 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:06:16.414739 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5db781b5-69eb-4a99-8182-92a9595241d2 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: 938e014a-dca0-45aa-a90e-260597d8fd1f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:06:16.438181 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5db781b5-69eb-4a99-8182-92a9595241d2 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:16.438924 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5db781b5-69eb-4a99-8182-92a9595241d2 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:16.439499 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5db781b5-69eb-4a99-8182-92a9595241d2 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:16.440838 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5db781b5-69eb-4a99-8182-92a9595241d2 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:16.441762 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5db781b5-69eb-4a99-8182-92a9595241d2 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:16.442362 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5db781b5-69eb-4a99-8182-92a9595241d2 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:17.551832 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a4aedcaf-4db5-4f73-928e-f1f88d604dbe tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:06:17.552412 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a4aedcaf-4db5-4f73-928e-f1f88d604dbe tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:06:17.612848 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a4aedcaf-4db5-4f73-928e-f1f88d604dbe tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:17.622383 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a4aedcaf-4db5-4f73-928e-f1f88d604dbe tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:17.627685 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a4aedcaf-4db5-4f73-928e-f1f88d604dbe tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:17.635414 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a4aedcaf-4db5-4f73-928e-f1f88d604dbe tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:17.636265 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a4aedcaf-4db5-4f73-928e-f1f88d604dbe tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:17.636723 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a4aedcaf-4db5-4f73-928e-f1f88d604dbe tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:17.716416 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-a4aedcaf-4db5-4f73-928e-f1f88d604dbe tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] HTTP exception thrown: Instance 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 could not be found. Sep 08 11:06:17.723209 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a4aedcaf-4db5-4f73-928e-f1f88d604dbe tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Request method failure captured: Sep 08 11:06:17.723209 n-d-850501-12 devstack@n-api.service[128861]: request: DELETE /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 HTTP/1.1 Sep 08 11:06:17.723209 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:06:17.723209 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:06:17.723209 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:06:17.723209 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 11:06:17.723209 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:06:17.723209 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:06:17.723209 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:06:17.723209 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:06:17.723209 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcrIsEQPBsFJxCGxh7fIUqj2XVaEpSUrDt1oWEGN9oGhg3rCbNLhcpluBkXK30-kS7Vm-TjcO1nCKuIFQoJ1nYZ0UAUHv4zQ51eh1IxcF9JI_FwPtNJ6cUgnlcX9D_dbxVq7325Uv_3csjHS3m4GBFWLXCWMGi4MQr_X34nc6ZlcoXA Sep 08 11:06:17.723209 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:06:17.723209 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:06:17.723209 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:06:17.723209 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:06:17.723209 n-d-850501-12 devstack@n-api.service[128861]: X-Openstack-Nova-Api-Version: 2.42 Sep 08 11:06:17.723209 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:06:17.723209 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:06:17.723209 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 1582bf1f51b246c68ec82f173df79a5a Sep 08 11:06:17.723209 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-654717678 Sep 08 11:06:17.723209 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:06:17.723209 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:06:17.723209 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1582bf1f51b246c68ec82f173df79a5a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1582bf1f51b246c68ec82f173df79a5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1582bf1f51b246c68ec82f173df79a5a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1582bf1f51b246c68ec82f173df79a5a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:06:17.723209 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-TaggedBootDevicesTest_v242-654717678 Sep 08 11:06:17.723209 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 1582bf1f51b246c68ec82f173df79a5a Sep 08 11:06:17.723209 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-654717678 Sep 08 11:06:17.723209 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-TaggedBootDevicesTest_v242-654717678-project Sep 08 11:06:17.723209 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:06:17.723209 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:06:17.723209 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 9ba7568d44ad47e8b37504ecc8a402ca Sep 08 11:06:17.723209 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-TaggedBootDevicesTest_v242-654717678-project Sep 08 11:06:17.723209 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 11:06:17.723209 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 could not be found. Sep 08 11:06:17.723209 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59'} Sep 08 11:06:17.723209 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:06:17.723209 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:06:17.723209 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:06:17.723209 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:06:17.723209 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:06:17.723209 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:06:17.723209 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:06:17.723209 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:06:17.723209 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:06:17.723209 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:06:17.723209 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 could not be found. Sep 08 11:06:17.723209 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:06:17.723209 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:06:17.723209 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:06:17.723209 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:06:17.723209 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:06:17.723209 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:06:17.723209 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:06:17.723209 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:06:17.723209 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:06:17.723209 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:06:17.723209 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 11:06:17.723209 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 11:06:17.723209 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 11:06:17.723209 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 11:06:17.723209 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:06:17.723209 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:06:17.723209 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:06:17.723209 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:06:17.726949 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 could not be found. Sep 08 11:06:17.726949 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:06:17.726949 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:06:17.726949 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:06:17.726949 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:06:17.726949 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:06:17.726949 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:06:17.726949 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:06:17.726949 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:06:17.726949 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 could not be found. Sep 08 11:06:17.726949 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:06:17.730812 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a4aedcaf-4db5-4f73-928e-f1f88d604dbe tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Returning 404 to user: Instance 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:06:17.731999 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a4aedcaf-4db5-4f73-928e-f1f88d604dbe tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "DELETE /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 404 len: 111 microversion: 2.42 time: 0.196106 Sep 08 11:06:17.733142 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2643/5180] 10.222.0.27 () {60 vars in 1280 bytes} [Thu Sep 8 11:06:17 2022] DELETE /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 111 bytes in 201 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 11:06:17.741312 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-00b1672c-f402-4b43-9d5f-191b59781046 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:06:17.750103 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-00b1672c-f402-4b43-9d5f-191b59781046 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] [instance: 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:06:17.761696 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-00b1672c-f402-4b43-9d5f-191b59781046 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:17.762561 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-00b1672c-f402-4b43-9d5f-191b59781046 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:17.763227 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-00b1672c-f402-4b43-9d5f-191b59781046 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:17.764247 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-00b1672c-f402-4b43-9d5f-191b59781046 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:17.764930 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-00b1672c-f402-4b43-9d5f-191b59781046 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:17.765621 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-00b1672c-f402-4b43-9d5f-191b59781046 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:17.803041 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-00b1672c-f402-4b43-9d5f-191b59781046 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] HTTP exception thrown: Instance 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 could not be found. Sep 08 11:06:17.804765 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-00b1672c-f402-4b43-9d5f-191b59781046 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Request method failure captured: Sep 08 11:06:17.804765 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 HTTP/1.1 Sep 08 11:06:17.804765 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:06:17.804765 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:06:17.804765 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:06:17.804765 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 11:06:17.804765 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:06:17.804765 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:06:17.804765 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:06:17.804765 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:06:17.804765 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcrIsEQPBsFJxCGxh7fIUqj2XVaEpSUrDt1oWEGN9oGhg3rCbNLhcpluBkXK30-kS7Vm-TjcO1nCKuIFQoJ1nYZ0UAUHv4zQ51eh1IxcF9JI_FwPtNJ6cUgnlcX9D_dbxVq7325Uv_3csjHS3m4GBFWLXCWMGi4MQr_X34nc6ZlcoXA Sep 08 11:06:17.804765 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:06:17.804765 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:06:17.804765 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:06:17.804765 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:06:17.804765 n-d-850501-12 devstack@n-api.service[128861]: X-Openstack-Nova-Api-Version: 2.42 Sep 08 11:06:17.804765 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:06:17.804765 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:06:17.804765 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 1582bf1f51b246c68ec82f173df79a5a Sep 08 11:06:17.804765 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-654717678 Sep 08 11:06:17.804765 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:06:17.804765 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:06:17.804765 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1582bf1f51b246c68ec82f173df79a5a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1582bf1f51b246c68ec82f173df79a5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1582bf1f51b246c68ec82f173df79a5a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1582bf1f51b246c68ec82f173df79a5a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:06:17.804765 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-TaggedBootDevicesTest_v242-654717678 Sep 08 11:06:17.804765 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 1582bf1f51b246c68ec82f173df79a5a Sep 08 11:06:17.804765 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-654717678 Sep 08 11:06:17.804765 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-TaggedBootDevicesTest_v242-654717678-project Sep 08 11:06:17.804765 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:06:17.804765 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:06:17.804765 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 9ba7568d44ad47e8b37504ecc8a402ca Sep 08 11:06:17.804765 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-TaggedBootDevicesTest_v242-654717678-project Sep 08 11:06:17.804765 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 11:06:17.804765 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 could not be found. Sep 08 11:06:17.804765 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59'} Sep 08 11:06:17.804765 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:06:17.804765 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:06:17.804765 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:06:17.804765 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:06:17.804765 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:06:17.804765 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:06:17.804765 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:06:17.804765 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:06:17.804765 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:06:17.804765 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:06:17.804765 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 could not be found. Sep 08 11:06:17.804765 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:06:17.804765 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:06:17.804765 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:06:17.804765 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:06:17.804765 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:06:17.804765 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:06:17.804765 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:06:17.804765 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:06:17.804765 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:06:17.804765 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:06:17.804765 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:06:17.804765 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:06:17.804765 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:06:17.804765 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:06:17.804765 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:06:17.804765 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:06:17.804765 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 could not be found. Sep 08 11:06:17.804765 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:06:17.804765 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:06:17.808651 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:06:17.808651 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:06:17.808651 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:06:17.808651 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:06:17.808651 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:06:17.808651 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:06:17.808651 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 could not be found. Sep 08 11:06:17.808651 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:06:17.820286 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-00b1672c-f402-4b43-9d5f-191b59781046 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] Returning 404 to user: Instance 954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:06:17.822340 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-00b1672c-f402-4b43-9d5f-191b59781046 tempest-TaggedBootDevicesTest_v242-654717678 tempest-TaggedBootDevicesTest_v242-654717678-project] 10.222.0.27 "GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59" status: 404 len: 111 microversion: 2.42 time: 0.084276 Sep 08 11:06:17.823513 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2644/5181] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:06:17 2022] GET /compute/v2.1/servers/954f281f-ca5e-4cb5-a3e6-d4a96a9d0b59 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 08 11:06:18.632001 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5db781b5-69eb-4a99-8182-92a9595241d2 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b794eec6c6346cd981cbc4929be2d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e840dc8280574c4ba37942e50731f01c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:06:18.666227 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5db781b5-69eb-4a99-8182-92a9595241d2 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f" status: 200 len: 1506 microversion: 2.1 time: 2.249149 Sep 08 11:06:18.691814 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2538/5182] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:06:16 2022] GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f => generated 1506 bytes in 2278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:06:19.697527 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-46fd673c-0f3d-430c-a760-306a724840b3 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:06:19.698188 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-46fd673c-0f3d-430c-a760-306a724840b3 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: 938e014a-dca0-45aa-a90e-260597d8fd1f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:06:19.712738 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-46fd673c-0f3d-430c-a760-306a724840b3 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:19.733939 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-46fd673c-0f3d-430c-a760-306a724840b3 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:19.736212 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-46fd673c-0f3d-430c-a760-306a724840b3 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:19.737173 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-46fd673c-0f3d-430c-a760-306a724840b3 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:19.745897 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-46fd673c-0f3d-430c-a760-306a724840b3 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:19.746361 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-46fd673c-0f3d-430c-a760-306a724840b3 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:20.010396 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-a62b1065-350a-4cdc-84df-f136a03fcb11 req-3884742b-11d8-40af-8e1f-8ba3cd5acad6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "938e014a-dca0-45aa-a90e-260597d8fd1f", "name": "network-vif-deleted", "tag": "05ea6e2e-2c0c-4f4c-86e5-ee6235225925"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:06:20.039484 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a62b1065-350a-4cdc-84df-f136a03fcb11 req-3884742b-11d8-40af-8e1f-8ba3cd5acad6 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:20.042423 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a62b1065-350a-4cdc-84df-f136a03fcb11 req-3884742b-11d8-40af-8e1f-8ba3cd5acad6 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:20.047300 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a62b1065-350a-4cdc-84df-f136a03fcb11 req-3884742b-11d8-40af-8e1f-8ba3cd5acad6 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:20.103436 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-a62b1065-350a-4cdc-84df-f136a03fcb11 req-3884742b-11d8-40af-8e1f-8ba3cd5acad6 service nova] Creating event network-vif-deleted:05ea6e2e-2c0c-4f4c-86e5-ee6235225925 for instance 938e014a-dca0-45aa-a90e-260597d8fd1f on n-h1-850501-12 Sep 08 11:06:20.128939 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-a62b1065-350a-4cdc-84df-f136a03fcb11 req-3884742b-11d8-40af-8e1f-8ba3cd5acad6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128257 Sep 08 11:06:20.136639 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2539/5183] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:06:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Sep 08 11:06:20.348797 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-46fd673c-0f3d-430c-a760-306a724840b3 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b794eec6c6346cd981cbc4929be2d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e840dc8280574c4ba37942e50731f01c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:06:20.357894 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-46fd673c-0f3d-430c-a760-306a724840b3 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f" status: 200 len: 1464 microversion: 2.1 time: 0.664391 Sep 08 11:06:20.367505 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2645/5184] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:06:19 2022] GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f => generated 1464 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:06:21.397978 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d33a69f1-7ac8-46c6-87f5-64160c665ce4 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:06:21.399255 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d33a69f1-7ac8-46c6-87f5-64160c665ce4 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: 938e014a-dca0-45aa-a90e-260597d8fd1f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:06:21.431601 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d33a69f1-7ac8-46c6-87f5-64160c665ce4 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:21.433710 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d33a69f1-7ac8-46c6-87f5-64160c665ce4 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:21.441873 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d33a69f1-7ac8-46c6-87f5-64160c665ce4 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:21.449629 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d33a69f1-7ac8-46c6-87f5-64160c665ce4 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:21.451554 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d33a69f1-7ac8-46c6-87f5-64160c665ce4 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:21.453789 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d33a69f1-7ac8-46c6-87f5-64160c665ce4 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:21.542427 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-d33a69f1-7ac8-46c6-87f5-64160c665ce4 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] HTTP exception thrown: Instance 938e014a-dca0-45aa-a90e-260597d8fd1f could not be found. Sep 08 11:06:21.544471 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d33a69f1-7ac8-46c6-87f5-64160c665ce4 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Request method failure captured: Sep 08 11:06:21.544471 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f HTTP/1.1 Sep 08 11:06:21.544471 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 11:06:21.544471 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 11:06:21.544471 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 11:06:21.544471 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 11:06:21.544471 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 11:06:21.544471 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 11:06:21.544471 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 11:06:21.544471 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 11:06:21.544471 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcwVtVzlNjV8vGiYH5yH0z-flBWFS3U0kp0x7871qkhjG0lawsrMX8y8eDYD5OopWrBiVCcGqwCAPDv9gvTrkrAPleozxaNdl76VmOj1FMyajNEewDKHHki3DeA0deszD3y4FeuHF_FX5uqpO9RpwmJsar1hut7P9upPSyPhCp-FmZk Sep 08 11:06:21.544471 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 11:06:21.544471 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 11:06:21.544471 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 11:06:21.544471 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 11:06:21.544471 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 11:06:21.544471 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 11:06:21.544471 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: e840dc8280574c4ba37942e50731f01c Sep 08 11:06:21.544471 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServerRescueTestJSON-1228098825 Sep 08 11:06:21.544471 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 11:06:21.544471 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 11:06:21.544471 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e840dc8280574c4ba37942e50731f01c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e840dc8280574c4ba37942e50731f01c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e840dc8280574c4ba37942e50731f01c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e840dc8280574c4ba37942e50731f01c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:06:21.544471 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServerRescueTestJSON-1228098825 Sep 08 11:06:21.544471 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: e840dc8280574c4ba37942e50731f01c Sep 08 11:06:21.544471 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServerRescueTestJSON-1228098825 Sep 08 11:06:21.544471 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServerRescueTestJSON-1228098825-project Sep 08 11:06:21.544471 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 11:06:21.544471 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 11:06:21.544471 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 7b794eec6c6346cd981cbc4929be2d9a Sep 08 11:06:21.544471 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServerRescueTestJSON-1228098825-project Sep 08 11:06:21.544471 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 11:06:21.544471 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 938e014a-dca0-45aa-a90e-260597d8fd1f could not be found. Sep 08 11:06:21.544471 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '938e014a-dca0-45aa-a90e-260597d8fd1f'} Sep 08 11:06:21.544471 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:06:21.544471 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:06:21.544471 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:06:21.544471 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:06:21.544471 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:06:21.544471 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:06:21.544471 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:06:21.544471 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:06:21.544471 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:06:21.544471 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:06:21.544471 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 938e014a-dca0-45aa-a90e-260597d8fd1f could not be found. Sep 08 11:06:21.544471 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:06:21.544471 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:06:21.544471 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:06:21.544471 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:06:21.544471 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:06:21.544471 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:06:21.544471 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:06:21.544471 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:06:21.544471 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:06:21.544471 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:06:21.544471 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:06:21.544471 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:06:21.544471 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:06:21.544471 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:06:21.544471 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:06:21.544471 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:06:21.544471 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 938e014a-dca0-45aa-a90e-260597d8fd1f could not be found. Sep 08 11:06:21.544471 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:06:21.544471 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:06:21.544471 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:06:21.548217 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:06:21.548217 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:06:21.548217 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:06:21.548217 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:06:21.548217 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:06:21.548217 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 938e014a-dca0-45aa-a90e-260597d8fd1f could not be found. Sep 08 11:06:21.548217 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:06:21.551589 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d33a69f1-7ac8-46c6-87f5-64160c665ce4 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Returning 404 to user: Instance 938e014a-dca0-45aa-a90e-260597d8fd1f could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:06:21.553157 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d33a69f1-7ac8-46c6-87f5-64160c665ce4 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f" status: 404 len: 111 microversion: 2.1 time: 0.164754 Sep 08 11:06:21.557289 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2540/5185] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:06:21 2022] GET /compute/v2.1/servers/938e014a-dca0-45aa-a90e-260597d8fd1f => generated 111 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:06:21.561973 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b831ce1d-e912-49ac-bb12-8698f9372dbe tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:06:21.562725 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b831ce1d-e912-49ac-bb12-8698f9372dbe tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: bb63079f-c8d9-4d31-8e45-7fac521c2066] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:06:21.576598 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b831ce1d-e912-49ac-bb12-8698f9372dbe tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:21.577137 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b831ce1d-e912-49ac-bb12-8698f9372dbe tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:21.585763 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b831ce1d-e912-49ac-bb12-8698f9372dbe tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:21.586770 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b831ce1d-e912-49ac-bb12-8698f9372dbe tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:21.587955 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b831ce1d-e912-49ac-bb12-8698f9372dbe tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:21.597766 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b831ce1d-e912-49ac-bb12-8698f9372dbe tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:21.759461 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b831ce1d-e912-49ac-bb12-8698f9372dbe tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: bb63079f-c8d9-4d31-8e45-7fac521c2066] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:06:21.995112 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b831ce1d-e912-49ac-bb12-8698f9372dbe tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "DELETE /compute/v2.1/servers/bb63079f-c8d9-4d31-8e45-7fac521c2066" status: 204 len: 0 microversion: 2.1 time: 0.433277 Sep 08 11:06:22.008488 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c8e93330-d472-4832-8cd7-fd60322cbbd7 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:06:22.009311 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c8e93330-d472-4832-8cd7-fd60322cbbd7 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: bb63079f-c8d9-4d31-8e45-7fac521c2066] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:06:22.012079 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2646/5186] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:06:21 2022] DELETE /compute/v2.1/servers/bb63079f-c8d9-4d31-8e45-7fac521c2066 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:06:22.019712 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c8e93330-d472-4832-8cd7-fd60322cbbd7 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:22.020211 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c8e93330-d472-4832-8cd7-fd60322cbbd7 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:22.024154 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c8e93330-d472-4832-8cd7-fd60322cbbd7 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:22.027679 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c8e93330-d472-4832-8cd7-fd60322cbbd7 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:22.028338 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c8e93330-d472-4832-8cd7-fd60322cbbd7 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:22.029687 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c8e93330-d472-4832-8cd7-fd60322cbbd7 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:23.041345 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c8e93330-d472-4832-8cd7-fd60322cbbd7 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b794eec6c6346cd981cbc4929be2d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e840dc8280574c4ba37942e50731f01c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:06:23.090246 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c8e93330-d472-4832-8cd7-fd60322cbbd7 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/bb63079f-c8d9-4d31-8e45-7fac521c2066" status: 200 len: 1491 microversion: 2.1 time: 1.087563 Sep 08 11:06:23.112675 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2541/5187] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:06:22 2022] GET /compute/v2.1/servers/bb63079f-c8d9-4d31-8e45-7fac521c2066 => generated 1491 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:06:24.127614 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bfa4910a-89f0-4f96-a39e-5de9a2ed0756 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:06:24.129479 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bfa4910a-89f0-4f96-a39e-5de9a2ed0756 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: bb63079f-c8d9-4d31-8e45-7fac521c2066] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:06:24.163063 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bfa4910a-89f0-4f96-a39e-5de9a2ed0756 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:24.171297 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bfa4910a-89f0-4f96-a39e-5de9a2ed0756 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:24.173720 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bfa4910a-89f0-4f96-a39e-5de9a2ed0756 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:24.177832 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bfa4910a-89f0-4f96-a39e-5de9a2ed0756 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:24.179237 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bfa4910a-89f0-4f96-a39e-5de9a2ed0756 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:24.182560 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bfa4910a-89f0-4f96-a39e-5de9a2ed0756 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:24.259397 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:06:26.091599 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-bfa4910a-89f0-4f96-a39e-5de9a2ed0756 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b794eec6c6346cd981cbc4929be2d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e840dc8280574c4ba37942e50731f01c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:06:26.107770 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bfa4910a-89f0-4f96-a39e-5de9a2ed0756 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/bb63079f-c8d9-4d31-8e45-7fac521c2066" status: 200 len: 1491 microversion: 2.1 time: 1.986567 Sep 08 11:06:26.108597 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2647/5188] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:06:24 2022] GET /compute/v2.1/servers/bb63079f-c8d9-4d31-8e45-7fac521c2066 => generated 1491 bytes in 1989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:06:27.135243 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-76a42603-74f9-4c65-9c2c-8b4c71c57ce8 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:06:27.136535 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-76a42603-74f9-4c65-9c2c-8b4c71c57ce8 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: bb63079f-c8d9-4d31-8e45-7fac521c2066] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:06:27.166529 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76a42603-74f9-4c65-9c2c-8b4c71c57ce8 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:27.169665 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76a42603-74f9-4c65-9c2c-8b4c71c57ce8 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:27.173908 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76a42603-74f9-4c65-9c2c-8b4c71c57ce8 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:27.175109 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76a42603-74f9-4c65-9c2c-8b4c71c57ce8 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:27.183669 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76a42603-74f9-4c65-9c2c-8b4c71c57ce8 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:27.184397 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76a42603-74f9-4c65-9c2c-8b4c71c57ce8 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:28.072420 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-7e9daf27-d41e-4f99-94cd-35f0b7312ee4 req-e95d22c7-ada4-4097-a4f8-e6ea6f809eee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb63079f-c8d9-4d31-8e45-7fac521c2066", "name": "network-vif-unplugged", "status": "completed", "tag": "e4cf7514-340c-4940-974b-33eb5c924cd7"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:06:28.109466 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:06:28.115603 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-7e9daf27-d41e-4f99-94cd-35f0b7312ee4 req-e95d22c7-ada4-4097-a4f8-e6ea6f809eee service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:28.116407 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-7e9daf27-d41e-4f99-94cd-35f0b7312ee4 req-e95d22c7-ada4-4097-a4f8-e6ea6f809eee service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:28.117049 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-7e9daf27-d41e-4f99-94cd-35f0b7312ee4 req-e95d22c7-ada4-4097-a4f8-e6ea6f809eee service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:28.194542 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-7e9daf27-d41e-4f99-94cd-35f0b7312ee4 req-e95d22c7-ada4-4097-a4f8-e6ea6f809eee service nova] Creating event network-vif-unplugged:e4cf7514-340c-4940-974b-33eb5c924cd7 for instance bb63079f-c8d9-4d31-8e45-7fac521c2066 on n-h1-850501-12 Sep 08 11:06:28.214755 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-7e9daf27-d41e-4f99-94cd-35f0b7312ee4 req-e95d22c7-ada4-4097-a4f8-e6ea6f809eee service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.146973 Sep 08 11:06:28.220854 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2648/5189] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:06:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:06:29.121543 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-76a42603-74f9-4c65-9c2c-8b4c71c57ce8 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b794eec6c6346cd981cbc4929be2d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e840dc8280574c4ba37942e50731f01c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:06:29.144947 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-76a42603-74f9-4c65-9c2c-8b4c71c57ce8 tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/bb63079f-c8d9-4d31-8e45-7fac521c2066" status: 200 len: 1491 microversion: 2.1 time: 2.013715 Sep 08 11:06:29.161157 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2542/5190] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:06:27 2022] GET /compute/v2.1/servers/bb63079f-c8d9-4d31-8e45-7fac521c2066 => generated 1491 bytes in 2032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:06:29.552768 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-e2775179-23ea-4cc3-858f-ffcc1218e738 req-d2604f1a-d896-40b4-88e2-5161ff55245c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb63079f-c8d9-4d31-8e45-7fac521c2066", "name": "network-vif-deleted", "tag": "e4cf7514-340c-4940-974b-33eb5c924cd7"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:06:29.646036 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-e2775179-23ea-4cc3-858f-ffcc1218e738 req-d2604f1a-d896-40b4-88e2-5161ff55245c service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:29.649941 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-e2775179-23ea-4cc3-858f-ffcc1218e738 req-d2604f1a-d896-40b4-88e2-5161ff55245c service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:29.650414 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-e2775179-23ea-4cc3-858f-ffcc1218e738 req-d2604f1a-d896-40b4-88e2-5161ff55245c service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:29.695110 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-e2775179-23ea-4cc3-858f-ffcc1218e738 req-d2604f1a-d896-40b4-88e2-5161ff55245c service nova] Creating event network-vif-deleted:e4cf7514-340c-4940-974b-33eb5c924cd7 for instance bb63079f-c8d9-4d31-8e45-7fac521c2066 on n-h1-850501-12 Sep 08 11:06:29.706268 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-e2775179-23ea-4cc3-858f-ffcc1218e738 req-d2604f1a-d896-40b4-88e2-5161ff55245c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167205 Sep 08 11:06:29.707212 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2649/5191] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:06:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:06:30.170570 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1e0545d7-db42-4288-b534-5c4123e6c3ef tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:06:30.171196 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1e0545d7-db42-4288-b534-5c4123e6c3ef tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: bb63079f-c8d9-4d31-8e45-7fac521c2066] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:06:30.174726 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=20 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:06:30.190612 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e0545d7-db42-4288-b534-5c4123e6c3ef tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:30.191908 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e0545d7-db42-4288-b534-5c4123e6c3ef tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:30.194822 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e0545d7-db42-4288-b534-5c4123e6c3ef tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:30.195871 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e0545d7-db42-4288-b534-5c4123e6c3ef tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:30.197293 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e0545d7-db42-4288-b534-5c4123e6c3ef tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:30.199617 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e0545d7-db42-4288-b534-5c4123e6c3ef tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:30.280216 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e0545d7-db42-4288-b534-5c4123e6c3ef tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:30.291376 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e0545d7-db42-4288-b534-5c4123e6c3ef tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:30.293148 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e0545d7-db42-4288-b534-5c4123e6c3ef tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:30.295914 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-1e0545d7-db42-4288-b534-5c4123e6c3ef tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lazy-loading 'fault' on Instance uuid bb63079f-c8d9-4d31-8e45-7fac521c2066 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:06:30.491325 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1e0545d7-db42-4288-b534-5c4123e6c3ef tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b794eec6c6346cd981cbc4929be2d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e840dc8280574c4ba37942e50731f01c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:06:30.504373 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1e0545d7-db42-4288-b534-5c4123e6c3ef tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/bb63079f-c8d9-4d31-8e45-7fac521c2066" status: 200 len: 1303 microversion: 2.1 time: 0.337930 Sep 08 11:06:30.531691 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2543/5192] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:06:30 2022] GET /compute/v2.1/servers/bb63079f-c8d9-4d31-8e45-7fac521c2066 => generated 1303 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:06:31.540263 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-188e9d3c-1302-4cfd-b012-53ec720db2bb tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:06:31.542275 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-188e9d3c-1302-4cfd-b012-53ec720db2bb tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] [instance: bb63079f-c8d9-4d31-8e45-7fac521c2066] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:06:31.564885 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-188e9d3c-1302-4cfd-b012-53ec720db2bb tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:31.566024 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-188e9d3c-1302-4cfd-b012-53ec720db2bb tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:31.566822 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-188e9d3c-1302-4cfd-b012-53ec720db2bb tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:31.568303 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-188e9d3c-1302-4cfd-b012-53ec720db2bb tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:31.577266 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-188e9d3c-1302-4cfd-b012-53ec720db2bb tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:31.577963 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-188e9d3c-1302-4cfd-b012-53ec720db2bb tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:31.634483 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-188e9d3c-1302-4cfd-b012-53ec720db2bb tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] HTTP exception thrown: Instance bb63079f-c8d9-4d31-8e45-7fac521c2066 could not be found. Sep 08 11:06:31.636181 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-188e9d3c-1302-4cfd-b012-53ec720db2bb tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Request method failure captured: Sep 08 11:06:31.636181 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/bb63079f-c8d9-4d31-8e45-7fac521c2066 HTTP/1.1 Sep 08 11:06:31.636181 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:06:31.636181 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:06:31.636181 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:06:31.636181 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 11:06:31.636181 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:06:31.636181 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:06:31.636181 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:06:31.636181 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:06:31.636181 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcwVtVzlNjV8vGiYH5yH0z-flBWFS3U0kp0x7871qkhjG0lawsrMX8y8eDYD5OopWrBiVCcGqwCAPDv9gvTrkrAPleozxaNdl76VmOj1FMyajNEewDKHHki3DeA0deszD3y4FeuHF_FX5uqpO9RpwmJsar1hut7P9upPSyPhCp-FmZk Sep 08 11:06:31.636181 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:06:31.636181 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:06:31.636181 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:06:31.636181 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:06:31.636181 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:06:31.636181 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:06:31.636181 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: e840dc8280574c4ba37942e50731f01c Sep 08 11:06:31.636181 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServerRescueTestJSON-1228098825 Sep 08 11:06:31.636181 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:06:31.636181 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:06:31.636181 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e840dc8280574c4ba37942e50731f01c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e840dc8280574c4ba37942e50731f01c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e840dc8280574c4ba37942e50731f01c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e840dc8280574c4ba37942e50731f01c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:06:31.636181 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServerRescueTestJSON-1228098825 Sep 08 11:06:31.636181 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: e840dc8280574c4ba37942e50731f01c Sep 08 11:06:31.636181 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServerRescueTestJSON-1228098825 Sep 08 11:06:31.636181 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServerRescueTestJSON-1228098825-project Sep 08 11:06:31.636181 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:06:31.636181 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:06:31.636181 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 7b794eec6c6346cd981cbc4929be2d9a Sep 08 11:06:31.636181 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServerRescueTestJSON-1228098825-project Sep 08 11:06:31.636181 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 11:06:31.636181 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance bb63079f-c8d9-4d31-8e45-7fac521c2066 could not be found. Sep 08 11:06:31.636181 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': 'bb63079f-c8d9-4d31-8e45-7fac521c2066'} Sep 08 11:06:31.636181 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:06:31.636181 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:06:31.636181 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:06:31.636181 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:06:31.636181 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:06:31.636181 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:06:31.636181 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:06:31.636181 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:06:31.636181 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:06:31.636181 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:06:31.636181 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb63079f-c8d9-4d31-8e45-7fac521c2066 could not be found. Sep 08 11:06:31.636181 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:06:31.636181 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:06:31.636181 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:06:31.636181 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:06:31.636181 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:06:31.636181 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:06:31.636181 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:06:31.636181 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:06:31.636181 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:06:31.636181 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:06:31.636181 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:06:31.636181 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:06:31.636181 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:06:31.636181 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:06:31.636181 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:06:31.636181 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:06:31.636181 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb63079f-c8d9-4d31-8e45-7fac521c2066 could not be found. Sep 08 11:06:31.636181 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:06:31.636181 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:06:31.636181 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:06:31.640228 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:06:31.640228 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:06:31.640228 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:06:31.640228 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:06:31.640228 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:06:31.640228 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb63079f-c8d9-4d31-8e45-7fac521c2066 could not be found. Sep 08 11:06:31.640228 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:06:31.640228 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-188e9d3c-1302-4cfd-b012-53ec720db2bb tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] Returning 404 to user: Instance bb63079f-c8d9-4d31-8e45-7fac521c2066 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:06:31.640228 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-188e9d3c-1302-4cfd-b012-53ec720db2bb tempest-ServerRescueTestJSON-1228098825 tempest-ServerRescueTestJSON-1228098825-project] 10.222.0.27 "GET /compute/v2.1/servers/bb63079f-c8d9-4d31-8e45-7fac521c2066" status: 404 len: 111 microversion: 2.1 time: 0.102424 Sep 08 11:06:31.640228 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2650/5193] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:06:31 2022] GET /compute/v2.1/servers/bb63079f-c8d9-4d31-8e45-7fac521c2066 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:07:22.783957 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a1012ac8-6d9b-40dc-a5f9-d33caec14696 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-91989628", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:07:22.804418 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:07:22.805006 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=37 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:07:23.410380 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-a1012ac8-6d9b-40dc-a5f9-d33caec14696 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] validate_networks() for None {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:07:24.389261 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-a1012ac8-6d9b-40dc-a5f9-d33caec14696 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:07:24.389807 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-a1012ac8-6d9b-40dc-a5f9-d33caec14696 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:07:24.390161 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-a1012ac8-6d9b-40dc-a5f9-d33caec14696 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:07:24.390584 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-a1012ac8-6d9b-40dc-a5f9-d33caec14696 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:07:24.391000 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-a1012ac8-6d9b-40dc-a5f9-d33caec14696 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:07:24.409859 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a1012ac8-6d9b-40dc-a5f9-d33caec14696 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:24.410599 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a1012ac8-6d9b-40dc-a5f9-d33caec14696 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:24.411198 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a1012ac8-6d9b-40dc-a5f9-d33caec14696 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:24.412310 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a1012ac8-6d9b-40dc-a5f9-d33caec14696 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:24.414050 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a1012ac8-6d9b-40dc-a5f9-d33caec14696 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:24.416392 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a1012ac8-6d9b-40dc-a5f9-d33caec14696 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:24.461964 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-a1012ac8-6d9b-40dc-a5f9-d33caec14696 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Getting quotas for project c0747c2d0ac142d6817b6c974b6c0062. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:07:24.489389 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-a1012ac8-6d9b-40dc-a5f9-d33caec14696 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Getting quotas for user bd5bc1e5fa2043758151cbdf256e12b5 and project c0747c2d0ac142d6817b6c974b6c0062. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:07:24.519943 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a1012ac8-6d9b-40dc-a5f9-d33caec14696 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:07:24.523000 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a1012ac8-6d9b-40dc-a5f9-d33caec14696 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] [instance: 38c3f72b-a090-4673-9a1c-a8e0877e8840] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:07:24.722326 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a1012ac8-6d9b-40dc-a5f9-d33caec14696 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.943341 Sep 08 11:07:24.725901 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2544/5194] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 11:07:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1946 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:07:24.738534 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3cb5aef9-d605-471b-830e-ad0da9b02a8c tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:07:24.740326 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3cb5aef9-d605-471b-830e-ad0da9b02a8c tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] [instance: 38c3f72b-a090-4673-9a1c-a8e0877e8840] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:07:24.743569 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=5 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:07:24.750437 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=11 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:07:24.754685 n-d-850501-12 devstack@n-api.service[128861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 11:07:24.755766 n-d-850501-12 devstack@n-api.service[128861]: Thu Sep 8 11:07:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/38c3f72b-a090-4673-9a1c-a8e0877e8840 (ip 10.222.0.27) !!! Sep 08 11:07:25.270426 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d145c680-938e-484b-aee5-5653c40f8f94 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-92310136", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "20951261-edda-4da9-a3e2-8f222023ad9d"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:07:25.430834 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-d145c680-938e-484b-aee5-5653c40f8f94 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] validate_networks() for [('20951261-edda-4da9-a3e2-8f222023ad9d', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:07:25.599920 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-3cb5aef9-d605-471b-830e-ad0da9b02a8c tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bc1e5fa2043758151cbdf256e12b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0747c2d0ac142d6817b6c974b6c0062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:07:25.614465 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3cb5aef9-d605-471b-830e-ad0da9b02a8c tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] 10.222.0.27 "GET /compute/v2.1/servers/38c3f72b-a090-4673-9a1c-a8e0877e8840" status: 200 len: 1213 microversion: 2.1 time: 0.883942 Sep 08 11:07:25.637450 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2651/5195] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:07:24 2022] GET /compute/v2.1/servers/38c3f72b-a090-4673-9a1c-a8e0877e8840 => generated 1213 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:07:26.643079 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3b7da31f-4922-449f-a400-cdd84fded937 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:07:26.643687 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3b7da31f-4922-449f-a400-cdd84fded937 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] [instance: 38c3f72b-a090-4673-9a1c-a8e0877e8840] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:07:26.664415 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3b7da31f-4922-449f-a400-cdd84fded937 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:26.665494 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3b7da31f-4922-449f-a400-cdd84fded937 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:26.665494 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3b7da31f-4922-449f-a400-cdd84fded937 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:26.666122 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3b7da31f-4922-449f-a400-cdd84fded937 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:26.666579 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3b7da31f-4922-449f-a400-cdd84fded937 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:26.666998 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3b7da31f-4922-449f-a400-cdd84fded937 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:27.241786 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-d145c680-938e-484b-aee5-5653c40f8f94 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:07:27.242302 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-d145c680-938e-484b-aee5-5653c40f8f94 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:07:27.242738 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-d145c680-938e-484b-aee5-5653c40f8f94 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:07:27.243154 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-d145c680-938e-484b-aee5-5653c40f8f94 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:07:27.243567 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-d145c680-938e-484b-aee5-5653c40f8f94 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:07:27.277920 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d145c680-938e-484b-aee5-5653c40f8f94 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:27.278198 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d145c680-938e-484b-aee5-5653c40f8f94 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:27.279628 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d145c680-938e-484b-aee5-5653c40f8f94 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:27.284203 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d145c680-938e-484b-aee5-5653c40f8f94 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:27.285085 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d145c680-938e-484b-aee5-5653c40f8f94 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:27.287739 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d145c680-938e-484b-aee5-5653c40f8f94 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:27.348521 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-d145c680-938e-484b-aee5-5653c40f8f94 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Getting quotas for project 7868787bfea94355a5d5971bab0d5ed4. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:07:27.364855 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-d145c680-938e-484b-aee5-5653c40f8f94 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Getting quotas for user 5193272e9ab24845aff53982dbe2c6f0 and project 7868787bfea94355a5d5971bab0d5ed4. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:07:27.418580 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-3b7da31f-4922-449f-a400-cdd84fded937 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bc1e5fa2043758151cbdf256e12b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0747c2d0ac142d6817b6c974b6c0062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:07:27.428241 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3b7da31f-4922-449f-a400-cdd84fded937 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] 10.222.0.27 "GET /compute/v2.1/servers/38c3f72b-a090-4673-9a1c-a8e0877e8840" status: 200 len: 1209 microversion: 2.1 time: 0.789732 Sep 08 11:07:27.430845 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d145c680-938e-484b-aee5-5653c40f8f94 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:07:27.448016 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d145c680-938e-484b-aee5-5653c40f8f94 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 7821851a-f9fb-4995-892d-8637b07067f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:07:27.452267 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2652/5196] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:07:26 2022] GET /compute/v2.1/servers/38c3f72b-a090-4673-9a1c-a8e0877e8840 => generated 1209 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:07:27.588244 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d145c680-938e-484b-aee5-5653c40f8f94 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.700516 Sep 08 11:07:27.600849 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2545/5197] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 11:07:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 2714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:07:27.605940 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ed2cf02b-f7ae-4f03-9104-d277fd884cc9 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:07:27.606574 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ed2cf02b-f7ae-4f03-9104-d277fd884cc9 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 7821851a-f9fb-4995-892d-8637b07067f8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:07:27.901912 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ed2cf02b-f7ae-4f03-9104-d277fd884cc9 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:07:27.912181 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ed2cf02b-f7ae-4f03-9104-d277fd884cc9 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/7821851a-f9fb-4995-892d-8637b07067f8" status: 200 len: 1191 microversion: 2.1 time: 0.314708 Sep 08 11:07:27.914827 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2653/5198] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:07:27 2022] GET /compute/v2.1/servers/7821851a-f9fb-4995-892d-8637b07067f8 => generated 1191 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:07:28.466568 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-41baf28e-629d-435d-997d-aa76c134ccfe tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:07:28.467186 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-41baf28e-629d-435d-997d-aa76c134ccfe tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] [instance: 38c3f72b-a090-4673-9a1c-a8e0877e8840] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:07:28.496558 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-41baf28e-629d-435d-997d-aa76c134ccfe tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:28.496981 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-41baf28e-629d-435d-997d-aa76c134ccfe tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:28.497485 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-41baf28e-629d-435d-997d-aa76c134ccfe tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:28.498171 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-41baf28e-629d-435d-997d-aa76c134ccfe tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:28.498630 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-41baf28e-629d-435d-997d-aa76c134ccfe tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:28.499062 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-41baf28e-629d-435d-997d-aa76c134ccfe tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:28.687309 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-41baf28e-629d-435d-997d-aa76c134ccfe tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bc1e5fa2043758151cbdf256e12b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0747c2d0ac142d6817b6c974b6c0062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:07:28.711847 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-41baf28e-629d-435d-997d-aa76c134ccfe tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] 10.222.0.27 "GET /compute/v2.1/servers/38c3f72b-a090-4673-9a1c-a8e0877e8840" status: 200 len: 1271 microversion: 2.1 time: 0.242934 Sep 08 11:07:28.727820 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2546/5199] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:07:28 2022] GET /compute/v2.1/servers/38c3f72b-a090-4673-9a1c-a8e0877e8840 => generated 1271 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:07:28.945100 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c3bc5b7e-8bbe-41a9-8b1b-bb609450a563 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:07:28.946463 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c3bc5b7e-8bbe-41a9-8b1b-bb609450a563 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 7821851a-f9fb-4995-892d-8637b07067f8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:07:28.993794 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c3bc5b7e-8bbe-41a9-8b1b-bb609450a563 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:28.997714 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c3bc5b7e-8bbe-41a9-8b1b-bb609450a563 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:29.009616 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c3bc5b7e-8bbe-41a9-8b1b-bb609450a563 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:29.014022 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c3bc5b7e-8bbe-41a9-8b1b-bb609450a563 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:29.015527 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c3bc5b7e-8bbe-41a9-8b1b-bb609450a563 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:29.016480 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c3bc5b7e-8bbe-41a9-8b1b-bb609450a563 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:29.397812 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c3bc5b7e-8bbe-41a9-8b1b-bb609450a563 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:07:29.407508 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c3bc5b7e-8bbe-41a9-8b1b-bb609450a563 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/7821851a-f9fb-4995-892d-8637b07067f8" status: 200 len: 1195 microversion: 2.1 time: 0.469321 Sep 08 11:07:29.408116 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2654/5200] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:07:28 2022] GET /compute/v2.1/servers/7821851a-f9fb-4995-892d-8637b07067f8 => generated 1195 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:07:29.741233 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-029a84b1-5ca7-45db-b5a9-bb97ddf90677 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:07:29.742519 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-029a84b1-5ca7-45db-b5a9-bb97ddf90677 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] [instance: 38c3f72b-a090-4673-9a1c-a8e0877e8840] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:07:29.788548 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-029a84b1-5ca7-45db-b5a9-bb97ddf90677 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:29.789714 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-029a84b1-5ca7-45db-b5a9-bb97ddf90677 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:29.790472 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-029a84b1-5ca7-45db-b5a9-bb97ddf90677 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:29.791999 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-029a84b1-5ca7-45db-b5a9-bb97ddf90677 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:29.792855 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-029a84b1-5ca7-45db-b5a9-bb97ddf90677 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:29.793869 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-029a84b1-5ca7-45db-b5a9-bb97ddf90677 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:30.110089 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-029a84b1-5ca7-45db-b5a9-bb97ddf90677 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bc1e5fa2043758151cbdf256e12b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0747c2d0ac142d6817b6c974b6c0062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:07:30.151599 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-029a84b1-5ca7-45db-b5a9-bb97ddf90677 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] 10.222.0.27 "GET /compute/v2.1/servers/38c3f72b-a090-4673-9a1c-a8e0877e8840" status: 200 len: 1271 microversion: 2.1 time: 0.417021 Sep 08 11:07:30.153453 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2547/5201] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:07:29 2022] GET /compute/v2.1/servers/38c3f72b-a090-4673-9a1c-a8e0877e8840 => generated 1271 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:07:30.450632 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5d164c51-3de5-4b7e-9241-ba38973d7bef tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:07:30.453076 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5d164c51-3de5-4b7e-9241-ba38973d7bef tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 7821851a-f9fb-4995-892d-8637b07067f8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:07:30.485658 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5d164c51-3de5-4b7e-9241-ba38973d7bef tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:30.491201 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5d164c51-3de5-4b7e-9241-ba38973d7bef tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:30.493795 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5d164c51-3de5-4b7e-9241-ba38973d7bef tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:30.494911 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5d164c51-3de5-4b7e-9241-ba38973d7bef tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:30.503202 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5d164c51-3de5-4b7e-9241-ba38973d7bef tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:30.503828 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5d164c51-3de5-4b7e-9241-ba38973d7bef tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:30.800870 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5d164c51-3de5-4b7e-9241-ba38973d7bef tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:07:30.813666 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5d164c51-3de5-4b7e-9241-ba38973d7bef tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/7821851a-f9fb-4995-892d-8637b07067f8" status: 200 len: 1249 microversion: 2.1 time: 0.384616 Sep 08 11:07:30.818540 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2655/5202] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:07:30 2022] GET /compute/v2.1/servers/7821851a-f9fb-4995-892d-8637b07067f8 => generated 1249 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:07:31.178101 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-785b9050-08ee-49f5-b03a-907855714267 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:07:31.179855 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-785b9050-08ee-49f5-b03a-907855714267 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] [instance: 38c3f72b-a090-4673-9a1c-a8e0877e8840] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:07:31.208282 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-785b9050-08ee-49f5-b03a-907855714267 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:31.209608 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-785b9050-08ee-49f5-b03a-907855714267 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:31.210072 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-785b9050-08ee-49f5-b03a-907855714267 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:31.213057 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-785b9050-08ee-49f5-b03a-907855714267 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:31.213523 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-785b9050-08ee-49f5-b03a-907855714267 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:31.213957 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-785b9050-08ee-49f5-b03a-907855714267 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:31.424566 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-785b9050-08ee-49f5-b03a-907855714267 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bc1e5fa2043758151cbdf256e12b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0747c2d0ac142d6817b6c974b6c0062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:07:31.437907 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-785b9050-08ee-49f5-b03a-907855714267 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] 10.222.0.27 "GET /compute/v2.1/servers/38c3f72b-a090-4673-9a1c-a8e0877e8840" status: 200 len: 1271 microversion: 2.1 time: 0.265489 Sep 08 11:07:31.450055 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2548/5203] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:07:31 2022] GET /compute/v2.1/servers/38c3f72b-a090-4673-9a1c-a8e0877e8840 => generated 1271 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:07:31.843437 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-41907c19-50ed-442a-a95b-2da0b8ce2031 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:07:31.847624 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-41907c19-50ed-442a-a95b-2da0b8ce2031 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 7821851a-f9fb-4995-892d-8637b07067f8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:07:31.917661 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41907c19-50ed-442a-a95b-2da0b8ce2031 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:31.919706 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41907c19-50ed-442a-a95b-2da0b8ce2031 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:31.923337 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41907c19-50ed-442a-a95b-2da0b8ce2031 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:31.932450 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41907c19-50ed-442a-a95b-2da0b8ce2031 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:31.935055 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41907c19-50ed-442a-a95b-2da0b8ce2031 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:31.936545 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41907c19-50ed-442a-a95b-2da0b8ce2031 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:32.359646 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-41907c19-50ed-442a-a95b-2da0b8ce2031 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:07:32.381279 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-41907c19-50ed-442a-a95b-2da0b8ce2031 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/7821851a-f9fb-4995-892d-8637b07067f8" status: 200 len: 1249 microversion: 2.1 time: 0.542164 Sep 08 11:07:32.384115 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2656/5204] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:07:31 2022] GET /compute/v2.1/servers/7821851a-f9fb-4995-892d-8637b07067f8 => generated 1249 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:07:32.472347 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-88f14ff5-8c7c-415d-8cf0-2fec099a1980 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:07:32.473900 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-88f14ff5-8c7c-415d-8cf0-2fec099a1980 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] [instance: 38c3f72b-a090-4673-9a1c-a8e0877e8840] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:07:32.522888 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-88f14ff5-8c7c-415d-8cf0-2fec099a1980 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:32.530635 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-88f14ff5-8c7c-415d-8cf0-2fec099a1980 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:32.531715 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-88f14ff5-8c7c-415d-8cf0-2fec099a1980 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:32.534759 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-88f14ff5-8c7c-415d-8cf0-2fec099a1980 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:32.537877 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-88f14ff5-8c7c-415d-8cf0-2fec099a1980 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:32.541388 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-88f14ff5-8c7c-415d-8cf0-2fec099a1980 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:33.418664 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8679210d-19aa-4935-9fa2-9581de6ee997 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:07:33.420761 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8679210d-19aa-4935-9fa2-9581de6ee997 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 7821851a-f9fb-4995-892d-8637b07067f8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:07:33.440619 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8679210d-19aa-4935-9fa2-9581de6ee997 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:33.441190 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8679210d-19aa-4935-9fa2-9581de6ee997 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:33.441671 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8679210d-19aa-4935-9fa2-9581de6ee997 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:33.442661 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8679210d-19aa-4935-9fa2-9581de6ee997 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:33.443403 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8679210d-19aa-4935-9fa2-9581de6ee997 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:33.443871 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8679210d-19aa-4935-9fa2-9581de6ee997 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:34.581643 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8679210d-19aa-4935-9fa2-9581de6ee997 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:07:34.597517 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8679210d-19aa-4935-9fa2-9581de6ee997 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/7821851a-f9fb-4995-892d-8637b07067f8" status: 200 len: 1291 microversion: 2.1 time: 1.183560 Sep 08 11:07:34.600559 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2657/5205] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:07:33 2022] GET /compute/v2.1/servers/7821851a-f9fb-4995-892d-8637b07067f8 => generated 1291 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:07:34.803451 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-88f14ff5-8c7c-415d-8cf0-2fec099a1980 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bc1e5fa2043758151cbdf256e12b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0747c2d0ac142d6817b6c974b6c0062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:07:34.821333 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-88f14ff5-8c7c-415d-8cf0-2fec099a1980 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] 10.222.0.27 "GET /compute/v2.1/servers/38c3f72b-a090-4673-9a1c-a8e0877e8840" status: 200 len: 1313 microversion: 2.1 time: 2.357039 Sep 08 11:07:34.823796 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2549/5206] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:07:32 2022] GET /compute/v2.1/servers/38c3f72b-a090-4673-9a1c-a8e0877e8840 => generated 1313 bytes in 2361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:07:35.624490 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-50ce3932-e23c-4b25-b61e-e47181fb1df8 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:07:35.625452 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-50ce3932-e23c-4b25-b61e-e47181fb1df8 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 7821851a-f9fb-4995-892d-8637b07067f8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:07:35.647855 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-50ce3932-e23c-4b25-b61e-e47181fb1df8 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:35.650796 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-50ce3932-e23c-4b25-b61e-e47181fb1df8 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:35.651419 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-50ce3932-e23c-4b25-b61e-e47181fb1df8 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:35.663076 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-50ce3932-e23c-4b25-b61e-e47181fb1df8 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:35.663748 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-50ce3932-e23c-4b25-b61e-e47181fb1df8 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:35.667186 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-50ce3932-e23c-4b25-b61e-e47181fb1df8 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:35.850368 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-393b5a41-3978-47ae-ab79-0de10127853e tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:07:35.851067 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-393b5a41-3978-47ae-ab79-0de10127853e tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] [instance: 38c3f72b-a090-4673-9a1c-a8e0877e8840] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:07:35.879698 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-393b5a41-3978-47ae-ab79-0de10127853e tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:35.880202 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-393b5a41-3978-47ae-ab79-0de10127853e tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:35.880820 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-393b5a41-3978-47ae-ab79-0de10127853e tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:35.881591 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-393b5a41-3978-47ae-ab79-0de10127853e tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:35.882276 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-393b5a41-3978-47ae-ab79-0de10127853e tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:35.882897 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-393b5a41-3978-47ae-ab79-0de10127853e tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:36.078781 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-50ce3932-e23c-4b25-b61e-e47181fb1df8 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:07:36.094140 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-50ce3932-e23c-4b25-b61e-e47181fb1df8 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/7821851a-f9fb-4995-892d-8637b07067f8" status: 200 len: 1291 microversion: 2.1 time: 0.473864 Sep 08 11:07:36.095395 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2658/5207] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:07:35 2022] GET /compute/v2.1/servers/7821851a-f9fb-4995-892d-8637b07067f8 => generated 1291 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:07:36.744681 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-33f4e361-0165-4573-b43c-8db799a4db6e req-6cc888ca-ec84-49c4-80fe-8eb54cb423af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7821851a-f9fb-4995-892d-8637b07067f8", "tag": "c3ffbffa-35c1-4da6-9441-977c449724b3"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:07:36.766673 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-33f4e361-0165-4573-b43c-8db799a4db6e req-6cc888ca-ec84-49c4-80fe-8eb54cb423af service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:36.800306 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-33f4e361-0165-4573-b43c-8db799a4db6e req-6cc888ca-ec84-49c4-80fe-8eb54cb423af service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:36.803023 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-33f4e361-0165-4573-b43c-8db799a4db6e req-6cc888ca-ec84-49c4-80fe-8eb54cb423af service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.034s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:36.862188 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-33f4e361-0165-4573-b43c-8db799a4db6e req-6cc888ca-ec84-49c4-80fe-8eb54cb423af service nova] Creating event network-changed:c3ffbffa-35c1-4da6-9441-977c449724b3 for instance 7821851a-f9fb-4995-892d-8637b07067f8 on n-h1-850501-12 Sep 08 11:07:36.884925 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-33f4e361-0165-4573-b43c-8db799a4db6e req-6cc888ca-ec84-49c4-80fe-8eb54cb423af service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152977 Sep 08 11:07:36.893345 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2659/5208] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:07:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:07:37.124179 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b6f07611-c6c1-46b5-bbeb-245a5d36dd90 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:07:37.125033 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b6f07611-c6c1-46b5-bbeb-245a5d36dd90 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 7821851a-f9fb-4995-892d-8637b07067f8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:07:37.143611 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b6f07611-c6c1-46b5-bbeb-245a5d36dd90 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:37.144162 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b6f07611-c6c1-46b5-bbeb-245a5d36dd90 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:37.144631 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b6f07611-c6c1-46b5-bbeb-245a5d36dd90 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:37.149823 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b6f07611-c6c1-46b5-bbeb-245a5d36dd90 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:37.151318 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b6f07611-c6c1-46b5-bbeb-245a5d36dd90 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:37.151962 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b6f07611-c6c1-46b5-bbeb-245a5d36dd90 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:37.329732 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=4 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:07:37.396619 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=12 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:07:37.851837 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b6f07611-c6c1-46b5-bbeb-245a5d36dd90 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:07:37.879931 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b6f07611-c6c1-46b5-bbeb-245a5d36dd90 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/7821851a-f9fb-4995-892d-8637b07067f8" status: 200 len: 1291 microversion: 2.1 time: 0.760425 Sep 08 11:07:37.881306 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2660/5209] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:07:37 2022] GET /compute/v2.1/servers/7821851a-f9fb-4995-892d-8637b07067f8 => generated 1291 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:07:37.965971 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-393b5a41-3978-47ae-ab79-0de10127853e tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bc1e5fa2043758151cbdf256e12b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0747c2d0ac142d6817b6c974b6c0062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:07:38.032035 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-393b5a41-3978-47ae-ab79-0de10127853e tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] 10.222.0.27 "GET /compute/v2.1/servers/38c3f72b-a090-4673-9a1c-a8e0877e8840" status: 200 len: 1313 microversion: 2.1 time: 2.188087 Sep 08 11:07:38.032642 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2550/5210] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:07:35 2022] GET /compute/v2.1/servers/38c3f72b-a090-4673-9a1c-a8e0877e8840 => generated 1313 bytes in 2190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:07:38.907503 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2e1ad9d0-68cf-4fe4-bbdb-688b75abe443 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:07:38.910348 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2e1ad9d0-68cf-4fe4-bbdb-688b75abe443 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 7821851a-f9fb-4995-892d-8637b07067f8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:07:38.922744 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=4 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:07:38.954921 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2e1ad9d0-68cf-4fe4-bbdb-688b75abe443 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:38.955581 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2e1ad9d0-68cf-4fe4-bbdb-688b75abe443 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:38.956091 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2e1ad9d0-68cf-4fe4-bbdb-688b75abe443 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:38.957114 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2e1ad9d0-68cf-4fe4-bbdb-688b75abe443 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:38.964003 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2e1ad9d0-68cf-4fe4-bbdb-688b75abe443 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:38.964480 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2e1ad9d0-68cf-4fe4-bbdb-688b75abe443 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:39.066016 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-156b9c32-a9e3-471b-9830-66728ff39dcd tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:07:39.066550 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-156b9c32-a9e3-471b-9830-66728ff39dcd tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] [instance: 38c3f72b-a090-4673-9a1c-a8e0877e8840] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:07:39.113348 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-156b9c32-a9e3-471b-9830-66728ff39dcd tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:39.116695 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-156b9c32-a9e3-471b-9830-66728ff39dcd tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:39.118475 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-156b9c32-a9e3-471b-9830-66728ff39dcd tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:39.122595 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-156b9c32-a9e3-471b-9830-66728ff39dcd tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:39.123727 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-156b9c32-a9e3-471b-9830-66728ff39dcd tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:39.126270 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-156b9c32-a9e3-471b-9830-66728ff39dcd tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:39.412182 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2e1ad9d0-68cf-4fe4-bbdb-688b75abe443 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:07:39.435950 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2e1ad9d0-68cf-4fe4-bbdb-688b75abe443 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/7821851a-f9fb-4995-892d-8637b07067f8" status: 200 len: 1291 microversion: 2.1 time: 0.531828 Sep 08 11:07:39.454977 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2661/5211] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:07:38 2022] GET /compute/v2.1/servers/7821851a-f9fb-4995-892d-8637b07067f8 => generated 1291 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:07:40.463604 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e28c3235-ef37-4fe3-a195-0cead3a3f412 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:07:40.465131 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e28c3235-ef37-4fe3-a195-0cead3a3f412 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 7821851a-f9fb-4995-892d-8637b07067f8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:07:40.484394 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e28c3235-ef37-4fe3-a195-0cead3a3f412 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:40.485044 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e28c3235-ef37-4fe3-a195-0cead3a3f412 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:40.485503 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e28c3235-ef37-4fe3-a195-0cead3a3f412 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:40.486226 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e28c3235-ef37-4fe3-a195-0cead3a3f412 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:40.486688 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e28c3235-ef37-4fe3-a195-0cead3a3f412 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:40.491573 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e28c3235-ef37-4fe3-a195-0cead3a3f412 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:40.675384 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-156b9c32-a9e3-471b-9830-66728ff39dcd tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bc1e5fa2043758151cbdf256e12b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0747c2d0ac142d6817b6c974b6c0062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:07:40.689864 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-156b9c32-a9e3-471b-9830-66728ff39dcd tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] 10.222.0.27 "GET /compute/v2.1/servers/38c3f72b-a090-4673-9a1c-a8e0877e8840" status: 200 len: 1313 microversion: 2.1 time: 1.634879 Sep 08 11:07:40.691112 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2551/5212] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:07:39 2022] GET /compute/v2.1/servers/38c3f72b-a090-4673-9a1c-a8e0877e8840 => generated 1313 bytes in 1637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:07:40.846393 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e28c3235-ef37-4fe3-a195-0cead3a3f412 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:07:40.866026 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e28c3235-ef37-4fe3-a195-0cead3a3f412 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/7821851a-f9fb-4995-892d-8637b07067f8" status: 200 len: 1291 microversion: 2.1 time: 0.407139 Sep 08 11:07:40.866712 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2662/5213] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:07:40 2022] GET /compute/v2.1/servers/7821851a-f9fb-4995-892d-8637b07067f8 => generated 1291 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:07:41.719673 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-95a03931-a59c-4589-a614-da5c3a8d7767 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:07:41.725772 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-95a03931-a59c-4589-a614-da5c3a8d7767 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] [instance: 38c3f72b-a090-4673-9a1c-a8e0877e8840] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:07:41.742356 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-95a03931-a59c-4589-a614-da5c3a8d7767 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:41.743446 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-95a03931-a59c-4589-a614-da5c3a8d7767 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:41.744133 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-95a03931-a59c-4589-a614-da5c3a8d7767 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:41.745231 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-95a03931-a59c-4589-a614-da5c3a8d7767 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:41.746278 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-95a03931-a59c-4589-a614-da5c3a8d7767 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:41.747149 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-95a03931-a59c-4589-a614-da5c3a8d7767 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:41.899283 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1c993d14-6b22-4217-a870-da50b77f0c83 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:07:41.900154 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1c993d14-6b22-4217-a870-da50b77f0c83 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 7821851a-f9fb-4995-892d-8637b07067f8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:07:41.937205 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1c993d14-6b22-4217-a870-da50b77f0c83 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:41.937560 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1c993d14-6b22-4217-a870-da50b77f0c83 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:41.938254 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1c993d14-6b22-4217-a870-da50b77f0c83 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:41.939192 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1c993d14-6b22-4217-a870-da50b77f0c83 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:41.939849 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1c993d14-6b22-4217-a870-da50b77f0c83 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:41.940495 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1c993d14-6b22-4217-a870-da50b77f0c83 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:42.288263 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1c993d14-6b22-4217-a870-da50b77f0c83 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:07:42.298507 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1c993d14-6b22-4217-a870-da50b77f0c83 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/7821851a-f9fb-4995-892d-8637b07067f8" status: 200 len: 1291 microversion: 2.1 time: 0.407759 Sep 08 11:07:42.299106 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2663/5214] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:07:41 2022] GET /compute/v2.1/servers/7821851a-f9fb-4995-892d-8637b07067f8 => generated 1291 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:07:42.568085 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-95a03931-a59c-4589-a614-da5c3a8d7767 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bc1e5fa2043758151cbdf256e12b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0747c2d0ac142d6817b6c974b6c0062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:07:42.578964 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-95a03931-a59c-4589-a614-da5c3a8d7767 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] 10.222.0.27 "GET /compute/v2.1/servers/38c3f72b-a090-4673-9a1c-a8e0877e8840" status: 200 len: 1313 microversion: 2.1 time: 0.863354 Sep 08 11:07:42.588243 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2552/5215] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:07:41 2022] GET /compute/v2.1/servers/38c3f72b-a090-4673-9a1c-a8e0877e8840 => generated 1313 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:07:42.732637 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-aa35473c-c72d-4ba7-826f-2e70e7805981 req-c257fa75-e9b7-46d1-bcac-578ebc15d0fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7821851a-f9fb-4995-892d-8637b07067f8", "name": "network-vif-plugged", "status": "completed", "tag": "c3ffbffa-35c1-4da6-9441-977c449724b3"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:07:42.751794 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-aa35473c-c72d-4ba7-826f-2e70e7805981 req-c257fa75-e9b7-46d1-bcac-578ebc15d0fa service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:42.755248 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-aa35473c-c72d-4ba7-826f-2e70e7805981 req-c257fa75-e9b7-46d1-bcac-578ebc15d0fa service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:42.757440 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-aa35473c-c72d-4ba7-826f-2e70e7805981 req-c257fa75-e9b7-46d1-bcac-578ebc15d0fa service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:42.789544 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-aa35473c-c72d-4ba7-826f-2e70e7805981 req-c257fa75-e9b7-46d1-bcac-578ebc15d0fa service nova] Creating event network-vif-plugged:c3ffbffa-35c1-4da6-9441-977c449724b3 for instance 7821851a-f9fb-4995-892d-8637b07067f8 on n-h1-850501-12 Sep 08 11:07:42.798827 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-aa35473c-c72d-4ba7-826f-2e70e7805981 req-c257fa75-e9b7-46d1-bcac-578ebc15d0fa service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.385236 Sep 08 11:07:42.800112 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2664/5216] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:07:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:07:43.002695 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-df8d3e33-1222-4126-8bc4-779d620d161c req-9e198258-08cf-4bf6-b934-4a7f7c2d97d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38c3f72b-a090-4673-9a1c-a8e0877e8840", "tag": "94c23f33-3bde-4ca8-ac35-ecd78f858091"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:07:43.034746 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-df8d3e33-1222-4126-8bc4-779d620d161c req-9e198258-08cf-4bf6-b934-4a7f7c2d97d2 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:43.036937 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-df8d3e33-1222-4126-8bc4-779d620d161c req-9e198258-08cf-4bf6-b934-4a7f7c2d97d2 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:43.040609 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-df8d3e33-1222-4126-8bc4-779d620d161c req-9e198258-08cf-4bf6-b934-4a7f7c2d97d2 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:43.103954 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-df8d3e33-1222-4126-8bc4-779d620d161c req-9e198258-08cf-4bf6-b934-4a7f7c2d97d2 service nova] Creating event network-changed:94c23f33-3bde-4ca8-ac35-ecd78f858091 for instance 38c3f72b-a090-4673-9a1c-a8e0877e8840 on n-h2-850501-12 Sep 08 11:07:43.119871 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-df8d3e33-1222-4126-8bc4-779d620d161c req-9e198258-08cf-4bf6-b934-4a7f7c2d97d2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121461 Sep 08 11:07:43.122644 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2553/5217] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:07:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:07:43.338203 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cfe27848-20c1-4bbd-866d-8246c74ef12b tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:07:43.339431 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cfe27848-20c1-4bbd-866d-8246c74ef12b tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 7821851a-f9fb-4995-892d-8637b07067f8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:07:43.367944 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cfe27848-20c1-4bbd-866d-8246c74ef12b tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:43.368461 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cfe27848-20c1-4bbd-866d-8246c74ef12b tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:43.369216 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cfe27848-20c1-4bbd-866d-8246c74ef12b tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:43.369986 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cfe27848-20c1-4bbd-866d-8246c74ef12b tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:43.370463 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cfe27848-20c1-4bbd-866d-8246c74ef12b tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:43.370896 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cfe27848-20c1-4bbd-866d-8246c74ef12b tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:43.608921 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8478c55d-bae6-4737-ba6f-fc7fb0fef5a3 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:07:43.610432 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8478c55d-bae6-4737-ba6f-fc7fb0fef5a3 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] [instance: 38c3f72b-a090-4673-9a1c-a8e0877e8840] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:07:43.635524 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8478c55d-bae6-4737-ba6f-fc7fb0fef5a3 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:43.640186 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8478c55d-bae6-4737-ba6f-fc7fb0fef5a3 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:43.641376 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8478c55d-bae6-4737-ba6f-fc7fb0fef5a3 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:43.643454 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8478c55d-bae6-4737-ba6f-fc7fb0fef5a3 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:43.645669 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8478c55d-bae6-4737-ba6f-fc7fb0fef5a3 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:43.647667 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8478c55d-bae6-4737-ba6f-fc7fb0fef5a3 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:44.139135 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-cfe27848-20c1-4bbd-866d-8246c74ef12b tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:07:44.151318 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cfe27848-20c1-4bbd-866d-8246c74ef12b tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/7821851a-f9fb-4995-892d-8637b07067f8" status: 200 len: 1291 microversion: 2.1 time: 0.826248 Sep 08 11:07:44.155946 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2665/5218] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:07:43 2022] GET /compute/v2.1/servers/7821851a-f9fb-4995-892d-8637b07067f8 => generated 1291 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:07:44.530244 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8478c55d-bae6-4737-ba6f-fc7fb0fef5a3 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bc1e5fa2043758151cbdf256e12b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0747c2d0ac142d6817b6c974b6c0062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:07:44.541560 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8478c55d-bae6-4737-ba6f-fc7fb0fef5a3 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] 10.222.0.27 "GET /compute/v2.1/servers/38c3f72b-a090-4673-9a1c-a8e0877e8840" status: 200 len: 1313 microversion: 2.1 time: 0.939647 Sep 08 11:07:44.542153 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2554/5219] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:07:43 2022] GET /compute/v2.1/servers/38c3f72b-a090-4673-9a1c-a8e0877e8840 => generated 1313 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:07:45.187137 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6fb0f7c6-cf45-49d9-ae8e-180614c2536b tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:07:45.187760 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6fb0f7c6-cf45-49d9-ae8e-180614c2536b tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 7821851a-f9fb-4995-892d-8637b07067f8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:07:45.217264 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6fb0f7c6-cf45-49d9-ae8e-180614c2536b tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:45.218125 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6fb0f7c6-cf45-49d9-ae8e-180614c2536b tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:45.220422 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6fb0f7c6-cf45-49d9-ae8e-180614c2536b tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:45.221689 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6fb0f7c6-cf45-49d9-ae8e-180614c2536b tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:45.223674 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6fb0f7c6-cf45-49d9-ae8e-180614c2536b tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:45.224112 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6fb0f7c6-cf45-49d9-ae8e-180614c2536b tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:45.568990 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b199b41f-b210-4161-9381-7ef25cff15bc tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:07:45.569968 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b199b41f-b210-4161-9381-7ef25cff15bc tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] [instance: 38c3f72b-a090-4673-9a1c-a8e0877e8840] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:07:45.581962 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b199b41f-b210-4161-9381-7ef25cff15bc tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:45.588040 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b199b41f-b210-4161-9381-7ef25cff15bc tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:45.588865 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b199b41f-b210-4161-9381-7ef25cff15bc tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:45.590089 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b199b41f-b210-4161-9381-7ef25cff15bc tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:45.591172 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b199b41f-b210-4161-9381-7ef25cff15bc tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:45.591932 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b199b41f-b210-4161-9381-7ef25cff15bc tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:46.132648 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b199b41f-b210-4161-9381-7ef25cff15bc tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bc1e5fa2043758151cbdf256e12b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0747c2d0ac142d6817b6c974b6c0062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:07:46.151953 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b199b41f-b210-4161-9381-7ef25cff15bc tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] 10.222.0.27 "GET /compute/v2.1/servers/38c3f72b-a090-4673-9a1c-a8e0877e8840" status: 200 len: 1313 microversion: 2.1 time: 0.587886 Sep 08 11:07:46.159703 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2555/5220] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:07:45 2022] GET /compute/v2.1/servers/38c3f72b-a090-4673-9a1c-a8e0877e8840 => generated 1313 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:07:46.327901 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6fb0f7c6-cf45-49d9-ae8e-180614c2536b tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:07:46.362958 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6fb0f7c6-cf45-49d9-ae8e-180614c2536b tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/7821851a-f9fb-4995-892d-8637b07067f8" status: 200 len: 1472 microversion: 2.1 time: 1.181507 Sep 08 11:07:46.364175 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2666/5221] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:07:45 2022] GET /compute/v2.1/servers/7821851a-f9fb-4995-892d-8637b07067f8 => generated 1472 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:07:46.627680 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ec1f3b27-ef4f-4a8c-8916-0872b5a06ce4 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-761189729", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:07:46.759169 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-ec1f3b27-ef4f-4a8c-8916-0872b5a06ce4 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] validate_networks() for [('20951261-edda-4da9-a3e2-8f222023ad9d', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:07:47.180376 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-75b82f33-787d-43a2-8830-b7aaf9199e23 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:07:47.180993 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-75b82f33-787d-43a2-8830-b7aaf9199e23 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] [instance: 38c3f72b-a090-4673-9a1c-a8e0877e8840] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:07:47.217013 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-75b82f33-787d-43a2-8830-b7aaf9199e23 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:47.217552 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-75b82f33-787d-43a2-8830-b7aaf9199e23 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:47.217970 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-75b82f33-787d-43a2-8830-b7aaf9199e23 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:47.234624 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-75b82f33-787d-43a2-8830-b7aaf9199e23 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:47.235611 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-75b82f33-787d-43a2-8830-b7aaf9199e23 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:47.236219 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-75b82f33-787d-43a2-8830-b7aaf9199e23 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:49.443381 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-75b82f33-787d-43a2-8830-b7aaf9199e23 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bc1e5fa2043758151cbdf256e12b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0747c2d0ac142d6817b6c974b6c0062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:07:49.452551 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-75b82f33-787d-43a2-8830-b7aaf9199e23 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] 10.222.0.27 "GET /compute/v2.1/servers/38c3f72b-a090-4673-9a1c-a8e0877e8840" status: 200 len: 1313 microversion: 2.1 time: 2.277334 Sep 08 11:07:49.457912 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2667/5222] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:07:47 2022] GET /compute/v2.1/servers/38c3f72b-a090-4673-9a1c-a8e0877e8840 => generated 1313 bytes in 2283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:07:49.830219 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-ec1f3b27-ef4f-4a8c-8916-0872b5a06ce4 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:07:49.830753 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-ec1f3b27-ef4f-4a8c-8916-0872b5a06ce4 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:07:49.831182 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-ec1f3b27-ef4f-4a8c-8916-0872b5a06ce4 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:07:49.831596 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-ec1f3b27-ef4f-4a8c-8916-0872b5a06ce4 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:07:49.832248 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-ec1f3b27-ef4f-4a8c-8916-0872b5a06ce4 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:07:49.858525 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec1f3b27-ef4f-4a8c-8916-0872b5a06ce4 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:49.867948 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec1f3b27-ef4f-4a8c-8916-0872b5a06ce4 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:49.868785 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec1f3b27-ef4f-4a8c-8916-0872b5a06ce4 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:49.870070 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec1f3b27-ef4f-4a8c-8916-0872b5a06ce4 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:49.871011 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec1f3b27-ef4f-4a8c-8916-0872b5a06ce4 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:49.874842 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec1f3b27-ef4f-4a8c-8916-0872b5a06ce4 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:49.965488 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-ec1f3b27-ef4f-4a8c-8916-0872b5a06ce4 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Getting quotas for project 7868787bfea94355a5d5971bab0d5ed4. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:07:49.980910 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-ec1f3b27-ef4f-4a8c-8916-0872b5a06ce4 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Getting quotas for user 5193272e9ab24845aff53982dbe2c6f0 and project 7868787bfea94355a5d5971bab0d5ed4. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:07:50.026643 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ec1f3b27-ef4f-4a8c-8916-0872b5a06ce4 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:07:50.035472 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ec1f3b27-ef4f-4a8c-8916-0872b5a06ce4 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 3ff17681-db51-4109-a47b-d8703450df01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:07:50.158453 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ec1f3b27-ef4f-4a8c-8916-0872b5a06ce4 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.536773 Sep 08 11:07:50.161330 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2556/5223] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 11:07:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 3540 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:07:50.172556 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-311d4126-7b55-494f-99d0-7020e3c4fbe5 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:07:50.173183 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-311d4126-7b55-494f-99d0-7020e3c4fbe5 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 3ff17681-db51-4109-a47b-d8703450df01] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:07:50.212801 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-311d4126-7b55-494f-99d0-7020e3c4fbe5 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 3ff17681-db51-4109-a47b-d8703450df01] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:07:50.483727 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0375c0de-a101-4758-bd56-ca32bfe5eeb0 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:07:50.484254 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0375c0de-a101-4758-bd56-ca32bfe5eeb0 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] [instance: 38c3f72b-a090-4673-9a1c-a8e0877e8840] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:07:50.500449 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0375c0de-a101-4758-bd56-ca32bfe5eeb0 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:50.504415 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0375c0de-a101-4758-bd56-ca32bfe5eeb0 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:50.506503 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0375c0de-a101-4758-bd56-ca32bfe5eeb0 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:50.510451 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0375c0de-a101-4758-bd56-ca32bfe5eeb0 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:50.528849 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0375c0de-a101-4758-bd56-ca32bfe5eeb0 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:50.530529 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0375c0de-a101-4758-bd56-ca32bfe5eeb0 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:50.973715 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-311d4126-7b55-494f-99d0-7020e3c4fbe5 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3ff17681-db51-4109-a47b-d8703450df01" status: 204 len: 0 microversion: 2.1 time: 0.802339 Sep 08 11:07:50.980451 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2668/5224] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:07:50 2022] DELETE /compute/v2.1/servers/3ff17681-db51-4109-a47b-d8703450df01 => generated 0 bytes in 813 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:07:51.016238 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9f0d1bb4-6fd3-410e-a650-1ec3a29bd108 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:07:51.019538 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9f0d1bb4-6fd3-410e-a650-1ec3a29bd108 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 3ff17681-db51-4109-a47b-d8703450df01] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:07:51.076065 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-9f0d1bb4-6fd3-410e-a650-1ec3a29bd108 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] HTTP exception thrown: Instance 3ff17681-db51-4109-a47b-d8703450df01 could not be found. Sep 08 11:07:51.085507 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9f0d1bb4-6fd3-410e-a650-1ec3a29bd108 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Request method failure captured: Sep 08 11:07:51.085507 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/3ff17681-db51-4109-a47b-d8703450df01 HTTP/1.1 Sep 08 11:07:51.085507 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:07:51.085507 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:07:51.085507 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:07:51.085507 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 11:07:51.085507 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:07:51.085507 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:07:51.085507 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:07:51.085507 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:07:51.085507 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGczsmQNk4U50BxzpgES3MzOpQCXZXSfv8U0fcthNptdjh-xj4_PXNp1cjGhvwh0ftE8negXuLuWJgSY_-2MLUgv_DNMLspYk9lV1lwtSgINsi9nLe-7tZYJuQnQiEJ_Nrc9KtaPntdIqDspehXXUE-x22uN3GKjXVnYgVPtfdxa4_cE Sep 08 11:07:51.085507 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:07:51.085507 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:07:51.085507 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:07:51.085507 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:07:51.085507 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:07:51.085507 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:07:51.085507 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 7868787bfea94355a5d5971bab0d5ed4 Sep 08 11:07:51.085507 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServersTestJSON-1882931607 Sep 08 11:07:51.085507 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:07:51.085507 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:07:51.085507 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:07:51.085507 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServersTestJSON-1882931607 Sep 08 11:07:51.085507 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 7868787bfea94355a5d5971bab0d5ed4 Sep 08 11:07:51.085507 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServersTestJSON-1882931607 Sep 08 11:07:51.085507 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServersTestJSON-1882931607-project Sep 08 11:07:51.085507 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:07:51.085507 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:07:51.085507 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 5193272e9ab24845aff53982dbe2c6f0 Sep 08 11:07:51.085507 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServersTestJSON-1882931607-project Sep 08 11:07:51.085507 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 11:07:51.085507 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 3ff17681-db51-4109-a47b-d8703450df01 could not be found. Sep 08 11:07:51.085507 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '3ff17681-db51-4109-a47b-d8703450df01'} Sep 08 11:07:51.085507 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:07:51.085507 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:07:51.085507 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2932, in _get_instance Sep 08 11:07:51.085507 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( Sep 08 11:07:51.085507 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 11:07:51.085507 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 11:07:51.085507 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid Sep 08 11:07:51.085507 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) Sep 08 11:07:51.085507 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 08 11:07:51.085507 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 08 11:07:51.085507 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db Sep 08 11:07:51.085507 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) Sep 08 11:07:51.085507 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance 3ff17681-db51-4109-a47b-d8703450df01 Sep 08 11:07:51.085507 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:07:51.085507 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:07:51.085507 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:07:51.085507 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:07:51.085507 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:07:51.085507 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:07:51.085507 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:07:51.085507 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:07:51.085507 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2944, in _get_instance Sep 08 11:07:51.085507 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 08 11:07:51.085507 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ff17681-db51-4109-a47b-d8703450df01 could not be found. Sep 08 11:07:51.085507 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:07:51.085507 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:07:51.085507 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:07:51.085507 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:07:51.085507 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:07:51.085507 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:07:51.089334 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:07:51.089334 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:07:51.089334 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:07:51.089334 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:07:51.089334 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:07:51.089334 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:07:51.089334 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:07:51.089334 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:07:51.089334 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:07:51.089334 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:07:51.089334 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ff17681-db51-4109-a47b-d8703450df01 could not be found. Sep 08 11:07:51.089334 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:07:51.089334 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:07:51.089334 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:07:51.089334 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:07:51.089334 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:07:51.089334 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:07:51.089334 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:07:51.089334 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:07:51.089334 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ff17681-db51-4109-a47b-d8703450df01 could not be found. Sep 08 11:07:51.089334 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:07:51.092194 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9f0d1bb4-6fd3-410e-a650-1ec3a29bd108 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Returning 404 to user: Instance 3ff17681-db51-4109-a47b-d8703450df01 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:07:51.093310 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9f0d1bb4-6fd3-410e-a650-1ec3a29bd108 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/3ff17681-db51-4109-a47b-d8703450df01" status: 404 len: 111 microversion: 2.1 time: 0.107159 Sep 08 11:07:51.094399 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2669/5225] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:07:50 2022] GET /compute/v2.1/servers/3ff17681-db51-4109-a47b-d8703450df01 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:07:51.240412 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6b08040d-9944-4ba2-8489-0c120c485c4f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1502001687", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "20951261-edda-4da9-a3e2-8f222023ad9d"}]}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:07:51.377200 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-6b08040d-9944-4ba2-8489-0c120c485c4f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] validate_networks() for [('20951261-edda-4da9-a3e2-8f222023ad9d', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:07:51.449146 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0375c0de-a101-4758-bd56-ca32bfe5eeb0 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bc1e5fa2043758151cbdf256e12b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0747c2d0ac142d6817b6c974b6c0062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:07:51.478575 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0375c0de-a101-4758-bd56-ca32bfe5eeb0 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] 10.222.0.27 "GET /compute/v2.1/servers/38c3f72b-a090-4673-9a1c-a8e0877e8840" status: 200 len: 1313 microversion: 2.1 time: 0.996824 Sep 08 11:07:51.483302 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2557/5226] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:07:50 2022] GET /compute/v2.1/servers/38c3f72b-a090-4673-9a1c-a8e0877e8840 => generated 1313 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:07:51.505916 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-9acbffc7-33c8-434d-ba8f-d26a3c724da0 req-af55bd86-435d-4c29-95c8-a325dcda2de0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38c3f72b-a090-4673-9a1c-a8e0877e8840", "name": "network-vif-plugged", "status": "completed", "tag": "94c23f33-3bde-4ca8-ac35-ecd78f858091"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:07:51.563601 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-9acbffc7-33c8-434d-ba8f-d26a3c724da0 req-af55bd86-435d-4c29-95c8-a325dcda2de0 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:51.568838 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-9acbffc7-33c8-434d-ba8f-d26a3c724da0 req-af55bd86-435d-4c29-95c8-a325dcda2de0 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:51.571671 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-9acbffc7-33c8-434d-ba8f-d26a3c724da0 req-af55bd86-435d-4c29-95c8-a325dcda2de0 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:51.664373 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-9acbffc7-33c8-434d-ba8f-d26a3c724da0 req-af55bd86-435d-4c29-95c8-a325dcda2de0 service nova] Creating event network-vif-plugged:94c23f33-3bde-4ca8-ac35-ecd78f858091 for instance 38c3f72b-a090-4673-9a1c-a8e0877e8840 on n-h2-850501-12 Sep 08 11:07:51.679000 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-9acbffc7-33c8-434d-ba8f-d26a3c724da0 req-af55bd86-435d-4c29-95c8-a325dcda2de0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.183782 Sep 08 11:07:51.681099 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2558/5227] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:07:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:07:52.505872 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a9429e6d-b0c5-47ce-84cc-397d54fc111f tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:07:52.507347 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a9429e6d-b0c5-47ce-84cc-397d54fc111f tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] [instance: 38c3f72b-a090-4673-9a1c-a8e0877e8840] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:07:52.523077 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a9429e6d-b0c5-47ce-84cc-397d54fc111f tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:52.523533 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a9429e6d-b0c5-47ce-84cc-397d54fc111f tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:52.523973 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a9429e6d-b0c5-47ce-84cc-397d54fc111f tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:52.524698 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a9429e6d-b0c5-47ce-84cc-397d54fc111f tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:52.525216 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a9429e6d-b0c5-47ce-84cc-397d54fc111f tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:52.525733 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a9429e6d-b0c5-47ce-84cc-397d54fc111f tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:53.934247 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a9429e6d-b0c5-47ce-84cc-397d54fc111f tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bc1e5fa2043758151cbdf256e12b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0747c2d0ac142d6817b6c974b6c0062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:07:53.937825 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=75 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:07:53.966060 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a9429e6d-b0c5-47ce-84cc-397d54fc111f tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] 10.222.0.27 "GET /compute/v2.1/servers/38c3f72b-a090-4673-9a1c-a8e0877e8840" status: 200 len: 1313 microversion: 2.1 time: 1.460890 Sep 08 11:07:53.977995 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2559/5228] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:07:52 2022] GET /compute/v2.1/servers/38c3f72b-a090-4673-9a1c-a8e0877e8840 => generated 1313 bytes in 1468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:07:54.321718 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-6b08040d-9944-4ba2-8489-0c120c485c4f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:07:54.322893 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-6b08040d-9944-4ba2-8489-0c120c485c4f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:07:54.323763 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-6b08040d-9944-4ba2-8489-0c120c485c4f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:07:54.324412 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-6b08040d-9944-4ba2-8489-0c120c485c4f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:07:54.325133 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-6b08040d-9944-4ba2-8489-0c120c485c4f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:07:54.349837 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6b08040d-9944-4ba2-8489-0c120c485c4f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:54.354017 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6b08040d-9944-4ba2-8489-0c120c485c4f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:54.354835 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6b08040d-9944-4ba2-8489-0c120c485c4f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:54.358881 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6b08040d-9944-4ba2-8489-0c120c485c4f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:54.359700 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6b08040d-9944-4ba2-8489-0c120c485c4f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:54.361553 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6b08040d-9944-4ba2-8489-0c120c485c4f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:54.455349 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-6b08040d-9944-4ba2-8489-0c120c485c4f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Getting quotas for project 7868787bfea94355a5d5971bab0d5ed4. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:07:54.476352 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-6b08040d-9944-4ba2-8489-0c120c485c4f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Getting quotas for user 5193272e9ab24845aff53982dbe2c6f0 and project 7868787bfea94355a5d5971bab0d5ed4. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:07:54.521061 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6b08040d-9944-4ba2-8489-0c120c485c4f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:07:54.527037 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6b08040d-9944-4ba2-8489-0c120c485c4f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 7ed54969-4b5f-4a05-ad5a-9d675702f1c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:07:54.655092 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6b08040d-9944-4ba2-8489-0c120c485c4f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.419200 Sep 08 11:07:54.659004 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2670/5229] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 11:07:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 3424 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:07:54.680025 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2eb33786-b507-4d0e-aa31-ff36b91b005d tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:07:54.680654 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2eb33786-b507-4d0e-aa31-ff36b91b005d tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 7ed54969-4b5f-4a05-ad5a-9d675702f1c4] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:07:54.721295 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=9 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:07:54.870468 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4c9ef63d-012f-4030-b178-8a353e7fb78a tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1066752891", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "5ecc4489-d8fd-49a1-a6c0-1b9e1c26ebb3"}]}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:07:54.926553 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=71,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:07:55.001628 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-4c9ef63d-012f-4030-b178-8a353e7fb78a tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] validate_networks() for [('5ecc4489-d8fd-49a1-a6c0-1b9e1c26ebb3', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:07:55.132389 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2eb33786-b507-4d0e-aa31-ff36b91b005d tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:07:55.156625 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2eb33786-b507-4d0e-aa31-ff36b91b005d tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/7ed54969-4b5f-4a05-ad5a-9d675702f1c4" status: 200 len: 1221 microversion: 2.1 time: 0.489062 Sep 08 11:07:55.157321 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2560/5230] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:07:54 2022] GET /compute/v2.1/servers/7ed54969-4b5f-4a05-ad5a-9d675702f1c4 => generated 1221 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:07:55.188494 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-44876571-926f-4fc8-83c7-c42a28623c2e tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:07:55.189158 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-44876571-926f-4fc8-83c7-c42a28623c2e tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] [instance: 38c3f72b-a090-4673-9a1c-a8e0877e8840] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:07:55.217421 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-44876571-926f-4fc8-83c7-c42a28623c2e tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:55.217943 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-44876571-926f-4fc8-83c7-c42a28623c2e tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:55.220758 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-44876571-926f-4fc8-83c7-c42a28623c2e tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:55.224495 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-44876571-926f-4fc8-83c7-c42a28623c2e tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:55.225005 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-44876571-926f-4fc8-83c7-c42a28623c2e tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:55.225497 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-44876571-926f-4fc8-83c7-c42a28623c2e tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:56.184165 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-44876571-926f-4fc8-83c7-c42a28623c2e tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bc1e5fa2043758151cbdf256e12b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0747c2d0ac142d6817b6c974b6c0062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:07:56.198453 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-44876571-926f-4fc8-83c7-c42a28623c2e tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] 10.222.0.27 "GET /compute/v2.1/servers/38c3f72b-a090-4673-9a1c-a8e0877e8840" status: 200 len: 1463 microversion: 2.1 time: 1.018601 Sep 08 11:07:56.201218 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2561/5231] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:07:55 2022] GET /compute/v2.1/servers/38c3f72b-a090-4673-9a1c-a8e0877e8840 => generated 1463 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:07:56.223036 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-07aaaa0d-7789-4efe-9189-52fb564e54de tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:07:56.226932 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-07aaaa0d-7789-4efe-9189-52fb564e54de tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 7ed54969-4b5f-4a05-ad5a-9d675702f1c4] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:07:56.254406 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-07aaaa0d-7789-4efe-9189-52fb564e54de tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:56.255567 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-07aaaa0d-7789-4efe-9189-52fb564e54de tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:56.257814 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-07aaaa0d-7789-4efe-9189-52fb564e54de tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:56.259682 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-07aaaa0d-7789-4efe-9189-52fb564e54de tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:56.261536 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-07aaaa0d-7789-4efe-9189-52fb564e54de tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:56.262626 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-07aaaa0d-7789-4efe-9189-52fb564e54de tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:56.615296 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-07aaaa0d-7789-4efe-9189-52fb564e54de tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:07:56.630868 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-07aaaa0d-7789-4efe-9189-52fb564e54de tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/7ed54969-4b5f-4a05-ad5a-9d675702f1c4" status: 200 len: 1225 microversion: 2.1 time: 0.424579 Sep 08 11:07:56.635529 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2562/5232] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:07:56 2022] GET /compute/v2.1/servers/7ed54969-4b5f-4a05-ad5a-9d675702f1c4 => generated 1225 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:07:56.666752 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f392dc9e-cd02-464e-bdfa-64bffafda973 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:07:56.672629 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f392dc9e-cd02-464e-bdfa-64bffafda973 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] [instance: 38c3f72b-a090-4673-9a1c-a8e0877e8840] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:07:56.700951 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f392dc9e-cd02-464e-bdfa-64bffafda973 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:56.704527 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f392dc9e-cd02-464e-bdfa-64bffafda973 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:56.709397 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f392dc9e-cd02-464e-bdfa-64bffafda973 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:56.711574 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f392dc9e-cd02-464e-bdfa-64bffafda973 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:56.715720 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f392dc9e-cd02-464e-bdfa-64bffafda973 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:56.716410 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f392dc9e-cd02-464e-bdfa-64bffafda973 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:56.899976 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f392dc9e-cd02-464e-bdfa-64bffafda973 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] [instance: 38c3f72b-a090-4673-9a1c-a8e0877e8840] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:07:57.220488 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f392dc9e-cd02-464e-bdfa-64bffafda973 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] 10.222.0.27 "DELETE /compute/v2.1/servers/38c3f72b-a090-4673-9a1c-a8e0877e8840" status: 204 len: 0 microversion: 2.1 time: 0.582563 Sep 08 11:07:57.221928 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2563/5233] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:07:56 2022] DELETE /compute/v2.1/servers/38c3f72b-a090-4673-9a1c-a8e0877e8840 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:07:57.235605 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8a47bc9c-b0f4-4333-bc1d-66fc8ad3d92b tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:07:57.238834 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8a47bc9c-b0f4-4333-bc1d-66fc8ad3d92b tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] [instance: 38c3f72b-a090-4673-9a1c-a8e0877e8840] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:07:57.250966 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8a47bc9c-b0f4-4333-bc1d-66fc8ad3d92b tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:57.255259 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8a47bc9c-b0f4-4333-bc1d-66fc8ad3d92b tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:57.256179 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8a47bc9c-b0f4-4333-bc1d-66fc8ad3d92b tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:57.257975 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8a47bc9c-b0f4-4333-bc1d-66fc8ad3d92b tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:57.260667 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8a47bc9c-b0f4-4333-bc1d-66fc8ad3d92b tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:57.262797 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8a47bc9c-b0f4-4333-bc1d-66fc8ad3d92b tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:57.887318 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8a47bc9c-b0f4-4333-bc1d-66fc8ad3d92b tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bc1e5fa2043758151cbdf256e12b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0747c2d0ac142d6817b6c974b6c0062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:07:57.916488 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8a47bc9c-b0f4-4333-bc1d-66fc8ad3d92b tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] 10.222.0.27 "GET /compute/v2.1/servers/38c3f72b-a090-4673-9a1c-a8e0877e8840" status: 200 len: 1469 microversion: 2.1 time: 0.679853 Sep 08 11:07:57.916488 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2564/5234] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:07:57 2022] GET /compute/v2.1/servers/38c3f72b-a090-4673-9a1c-a8e0877e8840 => generated 1469 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:07:57.934635 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-953b509c-91c5-4e63-bdde-38ca61d32539 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:07:57.935852 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-953b509c-91c5-4e63-bdde-38ca61d32539 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 7ed54969-4b5f-4a05-ad5a-9d675702f1c4] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:07:57.957441 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-953b509c-91c5-4e63-bdde-38ca61d32539 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:57.964595 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-953b509c-91c5-4e63-bdde-38ca61d32539 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:57.965193 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-953b509c-91c5-4e63-bdde-38ca61d32539 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:57.966181 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-953b509c-91c5-4e63-bdde-38ca61d32539 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:57.977538 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-953b509c-91c5-4e63-bdde-38ca61d32539 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:57.981695 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-953b509c-91c5-4e63-bdde-38ca61d32539 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:58.129414 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-4c9ef63d-012f-4030-b178-8a353e7fb78a tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:07:58.129979 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-4c9ef63d-012f-4030-b178-8a353e7fb78a tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:07:58.130447 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-4c9ef63d-012f-4030-b178-8a353e7fb78a tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:07:58.130930 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-4c9ef63d-012f-4030-b178-8a353e7fb78a tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:07:58.131422 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-4c9ef63d-012f-4030-b178-8a353e7fb78a tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:07:58.146234 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4c9ef63d-012f-4030-b178-8a353e7fb78a tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:58.146846 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4c9ef63d-012f-4030-b178-8a353e7fb78a tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:58.149867 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4c9ef63d-012f-4030-b178-8a353e7fb78a tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:58.150953 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4c9ef63d-012f-4030-b178-8a353e7fb78a tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:58.152445 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4c9ef63d-012f-4030-b178-8a353e7fb78a tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:58.153075 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4c9ef63d-012f-4030-b178-8a353e7fb78a tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:58.163327 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=85 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:07:58.213283 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-953b509c-91c5-4e63-bdde-38ca61d32539 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:07:58.229435 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-953b509c-91c5-4e63-bdde-38ca61d32539 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/7ed54969-4b5f-4a05-ad5a-9d675702f1c4" status: 200 len: 1273 microversion: 2.1 time: 0.309344 Sep 08 11:07:58.230555 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2565/5235] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:07:57 2022] GET /compute/v2.1/servers/7ed54969-4b5f-4a05-ad5a-9d675702f1c4 => generated 1273 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:07:58.232913 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-4c9ef63d-012f-4030-b178-8a353e7fb78a tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Getting quotas for project c6e0611b471443e7a0a744fb4f049edf. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:07:58.259887 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-4c9ef63d-012f-4030-b178-8a353e7fb78a tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Getting quotas for user 63e13cf235bb4721972b5c4a1c7b70b1 and project c6e0611b471443e7a0a744fb4f049edf. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:07:58.301637 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4c9ef63d-012f-4030-b178-8a353e7fb78a tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:07:58.304652 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4c9ef63d-012f-4030-b178-8a353e7fb78a tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] [instance: ab59c99b-000f-4819-9f15-ae7dfe723568] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:07:58.448894 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4c9ef63d-012f-4030-b178-8a353e7fb78a tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.773308 Sep 08 11:07:58.449629 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2671/5236] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 11:07:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 3775 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:07:58.472575 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b100ef98-7ae1-41f0-a226-5953d3939544 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:07:58.474953 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b100ef98-7ae1-41f0-a226-5953d3939544 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] [instance: ab59c99b-000f-4819-9f15-ae7dfe723568] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:07:58.649618 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b100ef98-7ae1-41f0-a226-5953d3939544 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e13cf235bb4721972b5c4a1c7b70b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e0611b471443e7a0a744fb4f049edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:07:58.678004 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b100ef98-7ae1-41f0-a226-5953d3939544 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] 10.222.0.27 "GET /compute/v2.1/servers/ab59c99b-000f-4819-9f15-ae7dfe723568" status: 200 len: 1224 microversion: 2.1 time: 0.220557 Sep 08 11:07:58.694736 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2566/5237] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:07:58 2022] GET /compute/v2.1/servers/ab59c99b-000f-4819-9f15-ae7dfe723568 => generated 1224 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:07:58.951946 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6879bf75-dae5-47a5-9d26-9cc8f8d43009 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:07:58.952803 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6879bf75-dae5-47a5-9d26-9cc8f8d43009 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] [instance: 38c3f72b-a090-4673-9a1c-a8e0877e8840] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:07:58.988257 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6879bf75-dae5-47a5-9d26-9cc8f8d43009 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:58.988811 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6879bf75-dae5-47a5-9d26-9cc8f8d43009 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:59.057401 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6879bf75-dae5-47a5-9d26-9cc8f8d43009 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:59.058296 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6879bf75-dae5-47a5-9d26-9cc8f8d43009 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:59.058789 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6879bf75-dae5-47a5-9d26-9cc8f8d43009 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:59.059230 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6879bf75-dae5-47a5-9d26-9cc8f8d43009 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:59.254851 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5868c0ea-c875-43bf-82fe-e75aec7b00c8 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:07:59.255717 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5868c0ea-c875-43bf-82fe-e75aec7b00c8 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 7ed54969-4b5f-4a05-ad5a-9d675702f1c4] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:07:59.294598 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5868c0ea-c875-43bf-82fe-e75aec7b00c8 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:59.295108 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5868c0ea-c875-43bf-82fe-e75aec7b00c8 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:59.297384 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5868c0ea-c875-43bf-82fe-e75aec7b00c8 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:59.304316 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5868c0ea-c875-43bf-82fe-e75aec7b00c8 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:59.305792 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5868c0ea-c875-43bf-82fe-e75aec7b00c8 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:59.306994 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5868c0ea-c875-43bf-82fe-e75aec7b00c8 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:59.912878 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:07:59.953410 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5868c0ea-c875-43bf-82fe-e75aec7b00c8 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:07:59.980518 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5868c0ea-c875-43bf-82fe-e75aec7b00c8 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/7ed54969-4b5f-4a05-ad5a-9d675702f1c4" status: 200 len: 1279 microversion: 2.1 time: 0.729955 Sep 08 11:07:59.981167 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2567/5238] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:07:59 2022] GET /compute/v2.1/servers/7ed54969-4b5f-4a05-ad5a-9d675702f1c4 => generated 1279 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:07:59.993379 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0ce44b38-2ad9-47bc-8a37-05c20a7633b4 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:07:59.995299 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0ce44b38-2ad9-47bc-8a37-05c20a7633b4 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] [instance: ab59c99b-000f-4819-9f15-ae7dfe723568] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:00.013694 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ce44b38-2ad9-47bc-8a37-05c20a7633b4 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:00.014609 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ce44b38-2ad9-47bc-8a37-05c20a7633b4 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:00.016756 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ce44b38-2ad9-47bc-8a37-05c20a7633b4 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:00.021606 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ce44b38-2ad9-47bc-8a37-05c20a7633b4 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:00.022462 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ce44b38-2ad9-47bc-8a37-05c20a7633b4 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:00.023115 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ce44b38-2ad9-47bc-8a37-05c20a7633b4 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:00.375940 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0ce44b38-2ad9-47bc-8a37-05c20a7633b4 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e13cf235bb4721972b5c4a1c7b70b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e0611b471443e7a0a744fb4f049edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:08:00.384849 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0ce44b38-2ad9-47bc-8a37-05c20a7633b4 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] 10.222.0.27 "GET /compute/v2.1/servers/ab59c99b-000f-4819-9f15-ae7dfe723568" status: 200 len: 1220 microversion: 2.1 time: 0.401173 Sep 08 11:08:00.388854 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2568/5239] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:07:59 2022] GET /compute/v2.1/servers/ab59c99b-000f-4819-9f15-ae7dfe723568 => generated 1220 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:08:01.012193 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d5eea1d9-6850-448c-8185-78c090f68121 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:01.015853 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d5eea1d9-6850-448c-8185-78c090f68121 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 7ed54969-4b5f-4a05-ad5a-9d675702f1c4] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:01.036095 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d5eea1d9-6850-448c-8185-78c090f68121 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:01.041835 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d5eea1d9-6850-448c-8185-78c090f68121 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:01.042339 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d5eea1d9-6850-448c-8185-78c090f68121 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:01.047413 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d5eea1d9-6850-448c-8185-78c090f68121 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:01.047929 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d5eea1d9-6850-448c-8185-78c090f68121 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:01.048376 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d5eea1d9-6850-448c-8185-78c090f68121 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:01.099940 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6879bf75-dae5-47a5-9d26-9cc8f8d43009 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bc1e5fa2043758151cbdf256e12b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0747c2d0ac142d6817b6c974b6c0062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:08:01.112048 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6879bf75-dae5-47a5-9d26-9cc8f8d43009 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] 10.222.0.27 "GET /compute/v2.1/servers/38c3f72b-a090-4673-9a1c-a8e0877e8840" status: 200 len: 1469 microversion: 2.1 time: 2.173148 Sep 08 11:08:01.118682 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2672/5240] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:07:58 2022] GET /compute/v2.1/servers/38c3f72b-a090-4673-9a1c-a8e0877e8840 => generated 1469 bytes in 2181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:08:01.419269 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cb25f861-7ed5-44f3-a118-345a58e9f659 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:01.419793 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cb25f861-7ed5-44f3-a118-345a58e9f659 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] [instance: ab59c99b-000f-4819-9f15-ae7dfe723568] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:01.436713 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb25f861-7ed5-44f3-a118-345a58e9f659 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:01.442049 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb25f861-7ed5-44f3-a118-345a58e9f659 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:01.447293 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb25f861-7ed5-44f3-a118-345a58e9f659 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:01.450430 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb25f861-7ed5-44f3-a118-345a58e9f659 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:01.453192 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb25f861-7ed5-44f3-a118-345a58e9f659 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:01.455240 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb25f861-7ed5-44f3-a118-345a58e9f659 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:01.941634 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d5eea1d9-6850-448c-8185-78c090f68121 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:08:01.964258 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d5eea1d9-6850-448c-8185-78c090f68121 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/7ed54969-4b5f-4a05-ad5a-9d675702f1c4" status: 200 len: 1321 microversion: 2.1 time: 0.962018 Sep 08 11:08:01.967111 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2569/5241] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:08:00 2022] GET /compute/v2.1/servers/7ed54969-4b5f-4a05-ad5a-9d675702f1c4 => generated 1321 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:08:01.979388 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-cb25f861-7ed5-44f3-a118-345a58e9f659 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e13cf235bb4721972b5c4a1c7b70b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e0611b471443e7a0a744fb4f049edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:08:02.010654 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cb25f861-7ed5-44f3-a118-345a58e9f659 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] 10.222.0.27 "GET /compute/v2.1/servers/ab59c99b-000f-4819-9f15-ae7dfe723568" status: 200 len: 1284 microversion: 2.1 time: 0.606332 Sep 08 11:08:02.011256 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2673/5242] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:08:01 2022] GET /compute/v2.1/servers/ab59c99b-000f-4819-9f15-ae7dfe723568 => generated 1284 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:08:02.152287 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b774bdfe-44f0-49ef-b621-5dbe7fbde430 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:02.153061 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b774bdfe-44f0-49ef-b621-5dbe7fbde430 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] [instance: 38c3f72b-a090-4673-9a1c-a8e0877e8840] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:02.178610 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b774bdfe-44f0-49ef-b621-5dbe7fbde430 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:02.179198 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b774bdfe-44f0-49ef-b621-5dbe7fbde430 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:02.185286 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b774bdfe-44f0-49ef-b621-5dbe7fbde430 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:02.188100 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b774bdfe-44f0-49ef-b621-5dbe7fbde430 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:02.194431 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b774bdfe-44f0-49ef-b621-5dbe7fbde430 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:02.197324 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b774bdfe-44f0-49ef-b621-5dbe7fbde430 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:02.958266 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-7d896e0e-6e2d-44c0-a110-f0ad9bf34119 req-4654076c-8cc0-484e-9620-7896cfb1b3a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38c3f72b-a090-4673-9a1c-a8e0877e8840", "name": "network-vif-unplugged", "status": "completed", "tag": "94c23f33-3bde-4ca8-ac35-ecd78f858091"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:08:02.986973 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-7d896e0e-6e2d-44c0-a110-f0ad9bf34119 req-4654076c-8cc0-484e-9620-7896cfb1b3a2 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:02.987678 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-7d896e0e-6e2d-44c0-a110-f0ad9bf34119 req-4654076c-8cc0-484e-9620-7896cfb1b3a2 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:02.988470 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-7d896e0e-6e2d-44c0-a110-f0ad9bf34119 req-4654076c-8cc0-484e-9620-7896cfb1b3a2 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:03.049536 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-7d896e0e-6e2d-44c0-a110-f0ad9bf34119 req-4654076c-8cc0-484e-9620-7896cfb1b3a2 service nova] Creating event network-vif-unplugged:94c23f33-3bde-4ca8-ac35-ecd78f858091 for instance 38c3f72b-a090-4673-9a1c-a8e0877e8840 on n-h2-850501-12 Sep 08 11:08:03.088106 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-7d896e0e-6e2d-44c0-a110-f0ad9bf34119 req-4654076c-8cc0-484e-9620-7896cfb1b3a2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.133235 Sep 08 11:08:03.094634 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2674/5243] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:08:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:08:03.110544 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c6842cad-b4fb-44d6-8c8c-e7796591fc96 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:03.115273 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c6842cad-b4fb-44d6-8c8c-e7796591fc96 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 7ed54969-4b5f-4a05-ad5a-9d675702f1c4] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:03.128676 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c6842cad-b4fb-44d6-8c8c-e7796591fc96 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:03.132937 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c6842cad-b4fb-44d6-8c8c-e7796591fc96 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:03.133684 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c6842cad-b4fb-44d6-8c8c-e7796591fc96 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:03.135531 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c6842cad-b4fb-44d6-8c8c-e7796591fc96 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:03.137648 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c6842cad-b4fb-44d6-8c8c-e7796591fc96 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:03.138357 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c6842cad-b4fb-44d6-8c8c-e7796591fc96 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:03.230816 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b774bdfe-44f0-49ef-b621-5dbe7fbde430 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bc1e5fa2043758151cbdf256e12b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0747c2d0ac142d6817b6c974b6c0062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:08:03.239636 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b774bdfe-44f0-49ef-b621-5dbe7fbde430 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] 10.222.0.27 "GET /compute/v2.1/servers/38c3f72b-a090-4673-9a1c-a8e0877e8840" status: 200 len: 1469 microversion: 2.1 time: 1.091793 Sep 08 11:08:03.242388 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2570/5244] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:08:02 2022] GET /compute/v2.1/servers/38c3f72b-a090-4673-9a1c-a8e0877e8840 => generated 1469 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:08:03.267270 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f292e0b4-95d2-492e-902e-8dc868b6aab9 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:03.273174 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f292e0b4-95d2-492e-902e-8dc868b6aab9 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] [instance: ab59c99b-000f-4819-9f15-ae7dfe723568] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:03.295461 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f292e0b4-95d2-492e-902e-8dc868b6aab9 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:03.298604 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f292e0b4-95d2-492e-902e-8dc868b6aab9 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:03.301178 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f292e0b4-95d2-492e-902e-8dc868b6aab9 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:03.303742 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f292e0b4-95d2-492e-902e-8dc868b6aab9 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:03.305339 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f292e0b4-95d2-492e-902e-8dc868b6aab9 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:03.310447 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f292e0b4-95d2-492e-902e-8dc868b6aab9 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:03.540448 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f292e0b4-95d2-492e-902e-8dc868b6aab9 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e13cf235bb4721972b5c4a1c7b70b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e0611b471443e7a0a744fb4f049edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:08:03.574239 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f292e0b4-95d2-492e-902e-8dc868b6aab9 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] 10.222.0.27 "GET /compute/v2.1/servers/ab59c99b-000f-4819-9f15-ae7dfe723568" status: 200 len: 1282 microversion: 2.1 time: 0.330169 Sep 08 11:08:03.575254 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2571/5245] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:08:03 2022] GET /compute/v2.1/servers/ab59c99b-000f-4819-9f15-ae7dfe723568 => generated 1282 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:08:04.264756 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a20dbdc4-538f-415a-9e3a-819c729cfbc4 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:04.265483 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a20dbdc4-538f-415a-9e3a-819c729cfbc4 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] [instance: 38c3f72b-a090-4673-9a1c-a8e0877e8840] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:04.296077 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c6842cad-b4fb-44d6-8c8c-e7796591fc96 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:08:04.296568 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a20dbdc4-538f-415a-9e3a-819c729cfbc4 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:04.301105 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a20dbdc4-538f-415a-9e3a-819c729cfbc4 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:04.302114 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a20dbdc4-538f-415a-9e3a-819c729cfbc4 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:04.307110 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a20dbdc4-538f-415a-9e3a-819c729cfbc4 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:04.307754 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a20dbdc4-538f-415a-9e3a-819c729cfbc4 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:04.308216 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a20dbdc4-538f-415a-9e3a-819c729cfbc4 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:04.318826 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c6842cad-b4fb-44d6-8c8c-e7796591fc96 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/7ed54969-4b5f-4a05-ad5a-9d675702f1c4" status: 200 len: 1321 microversion: 2.1 time: 1.219361 Sep 08 11:08:04.319944 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2675/5246] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:08:03 2022] GET /compute/v2.1/servers/7ed54969-4b5f-4a05-ad5a-9d675702f1c4 => generated 1321 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:08:04.593212 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-476195a6-ba1c-46e6-a37f-a8b0dc502aec req-01b8f6bc-0fc5-4ab3-85b4-70eafb5470ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38c3f72b-a090-4673-9a1c-a8e0877e8840", "name": "network-vif-deleted", "tag": "94c23f33-3bde-4ca8-ac35-ecd78f858091"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:08:04.651684 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-476195a6-ba1c-46e6-a37f-a8b0dc502aec req-01b8f6bc-0fc5-4ab3-85b4-70eafb5470ca service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:04.663823 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-476195a6-ba1c-46e6-a37f-a8b0dc502aec req-01b8f6bc-0fc5-4ab3-85b4-70eafb5470ca service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:04.664517 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-476195a6-ba1c-46e6-a37f-a8b0dc502aec req-01b8f6bc-0fc5-4ab3-85b4-70eafb5470ca service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:04.743787 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-476195a6-ba1c-46e6-a37f-a8b0dc502aec req-01b8f6bc-0fc5-4ab3-85b4-70eafb5470ca service nova] Creating event network-vif-deleted:94c23f33-3bde-4ca8-ac35-ecd78f858091 for instance 38c3f72b-a090-4673-9a1c-a8e0877e8840 on n-h2-850501-12 Sep 08 11:08:04.753895 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-476195a6-ba1c-46e6-a37f-a8b0dc502aec req-01b8f6bc-0fc5-4ab3-85b4-70eafb5470ca service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163343 Sep 08 11:08:04.755110 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2676/5247] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:08:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:08:04.763677 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1e1b145b-4afb-4192-aa99-40607750ae48 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:04.764681 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1e1b145b-4afb-4192-aa99-40607750ae48 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] [instance: ab59c99b-000f-4819-9f15-ae7dfe723568] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:04.774724 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e1b145b-4afb-4192-aa99-40607750ae48 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:04.775584 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e1b145b-4afb-4192-aa99-40607750ae48 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:04.779586 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e1b145b-4afb-4192-aa99-40607750ae48 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:04.781698 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e1b145b-4afb-4192-aa99-40607750ae48 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:04.782719 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e1b145b-4afb-4192-aa99-40607750ae48 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:04.786362 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e1b145b-4afb-4192-aa99-40607750ae48 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:04.832125 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a20dbdc4-538f-415a-9e3a-819c729cfbc4 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bc1e5fa2043758151cbdf256e12b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0747c2d0ac142d6817b6c974b6c0062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:08:04.866018 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a20dbdc4-538f-415a-9e3a-819c729cfbc4 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] 10.222.0.27 "GET /compute/v2.1/servers/38c3f72b-a090-4673-9a1c-a8e0877e8840" status: 200 len: 1427 microversion: 2.1 time: 0.598110 Sep 08 11:08:04.867536 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2572/5248] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:08:04 2022] GET /compute/v2.1/servers/38c3f72b-a090-4673-9a1c-a8e0877e8840 => generated 1427 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:08:05.092060 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1e1b145b-4afb-4192-aa99-40607750ae48 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e13cf235bb4721972b5c4a1c7b70b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e0611b471443e7a0a744fb4f049edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:08:05.103970 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1e1b145b-4afb-4192-aa99-40607750ae48 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] 10.222.0.27 "GET /compute/v2.1/servers/ab59c99b-000f-4819-9f15-ae7dfe723568" status: 200 len: 1282 microversion: 2.1 time: 0.345145 Sep 08 11:08:05.122959 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2677/5249] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:08:04 2022] GET /compute/v2.1/servers/ab59c99b-000f-4819-9f15-ae7dfe723568 => generated 1282 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:08:05.347290 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-940d596e-fcc1-4d6a-9c3c-c543b1ed535e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:05.349017 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-940d596e-fcc1-4d6a-9c3c-c543b1ed535e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 7ed54969-4b5f-4a05-ad5a-9d675702f1c4] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:05.377701 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-940d596e-fcc1-4d6a-9c3c-c543b1ed535e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:05.377905 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-5a9f702f-a671-4595-bd95-26bb98ea07f4 req-a54a290f-d4b5-48c6-8192-8b4c8ed8c081 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ed54969-4b5f-4a05-ad5a-9d675702f1c4", "tag": "3791516e-effb-4ab3-bd8b-b7191c90624c"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:08:05.381692 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-940d596e-fcc1-4d6a-9c3c-c543b1ed535e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:05.382812 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-940d596e-fcc1-4d6a-9c3c-c543b1ed535e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:05.384531 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-940d596e-fcc1-4d6a-9c3c-c543b1ed535e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:05.387228 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-940d596e-fcc1-4d6a-9c3c-c543b1ed535e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:05.387878 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-940d596e-fcc1-4d6a-9c3c-c543b1ed535e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:05.424723 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-5a9f702f-a671-4595-bd95-26bb98ea07f4 req-a54a290f-d4b5-48c6-8192-8b4c8ed8c081 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:05.425273 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-5a9f702f-a671-4595-bd95-26bb98ea07f4 req-a54a290f-d4b5-48c6-8192-8b4c8ed8c081 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:05.427056 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-5a9f702f-a671-4595-bd95-26bb98ea07f4 req-a54a290f-d4b5-48c6-8192-8b4c8ed8c081 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:05.480520 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-5a9f702f-a671-4595-bd95-26bb98ea07f4 req-a54a290f-d4b5-48c6-8192-8b4c8ed8c081 service nova] Creating event network-changed:3791516e-effb-4ab3-bd8b-b7191c90624c for instance 7ed54969-4b5f-4a05-ad5a-9d675702f1c4 on n-h2-850501-12 Sep 08 11:08:05.531865 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-5a9f702f-a671-4595-bd95-26bb98ea07f4 req-a54a290f-d4b5-48c6-8192-8b4c8ed8c081 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.436274 Sep 08 11:08:05.539431 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2573/5250] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:08:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:08:05.891675 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b643cd74-8164-485e-a0c5-e4c9d0651e30 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:05.892772 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b643cd74-8164-485e-a0c5-e4c9d0651e30 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] [instance: 38c3f72b-a090-4673-9a1c-a8e0877e8840] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:05.916838 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b643cd74-8164-485e-a0c5-e4c9d0651e30 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:05.920567 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b643cd74-8164-485e-a0c5-e4c9d0651e30 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:05.921975 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b643cd74-8164-485e-a0c5-e4c9d0651e30 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:05.924555 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b643cd74-8164-485e-a0c5-e4c9d0651e30 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:05.926119 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b643cd74-8164-485e-a0c5-e4c9d0651e30 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:05.928184 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b643cd74-8164-485e-a0c5-e4c9d0651e30 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:05.976129 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-b643cd74-8164-485e-a0c5-e4c9d0651e30 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] HTTP exception thrown: Instance 38c3f72b-a090-4673-9a1c-a8e0877e8840 could not be found. Sep 08 11:08:05.978227 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b643cd74-8164-485e-a0c5-e4c9d0651e30 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Request method failure captured: Sep 08 11:08:05.978227 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/38c3f72b-a090-4673-9a1c-a8e0877e8840 HTTP/1.1 Sep 08 11:08:05.978227 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 11:08:05.978227 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 11:08:05.978227 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 11:08:05.978227 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 11:08:05.978227 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 11:08:05.978227 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 11:08:05.978227 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 11:08:05.978227 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 11:08:05.978227 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGczmpXiUeP-JPXbbAwhQNatEq8e7QyyTKfhpV_d9Oeh5miT29ANXIz99L7azO-_yC0MKlZXiQzbBX-LNgKU_pxZj5rLWIEt-oReoSrfyn-6p3r8JNs64g9MA7CP9moi-2asxKZ_FPiZBZi7AsAjKuFqdza5Oh9UepOrcDa3QgJ6HaDI Sep 08 11:08:05.978227 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 11:08:05.978227 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 11:08:05.978227 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 11:08:05.978227 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 11:08:05.978227 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 11:08:05.978227 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 11:08:05.978227 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: c0747c2d0ac142d6817b6c974b6c0062 Sep 08 11:08:05.978227 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-VolumesNegativeTest-1002531015 Sep 08 11:08:05.978227 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 11:08:05.978227 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 11:08:05.978227 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c0747c2d0ac142d6817b6c974b6c0062"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c0747c2d0ac142d6817b6c974b6c0062"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c0747c2d0ac142d6817b6c974b6c0062"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c0747c2d0ac142d6817b6c974b6c0062"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:08:05.978227 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-VolumesNegativeTest-1002531015 Sep 08 11:08:05.978227 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: c0747c2d0ac142d6817b6c974b6c0062 Sep 08 11:08:05.978227 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-VolumesNegativeTest-1002531015 Sep 08 11:08:05.978227 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-VolumesNegativeTest-1002531015-project Sep 08 11:08:05.978227 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 11:08:05.978227 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 11:08:05.978227 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: bd5bc1e5fa2043758151cbdf256e12b5 Sep 08 11:08:05.978227 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-VolumesNegativeTest-1002531015-project Sep 08 11:08:05.978227 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 11:08:05.978227 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 38c3f72b-a090-4673-9a1c-a8e0877e8840 could not be found. Sep 08 11:08:05.978227 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '38c3f72b-a090-4673-9a1c-a8e0877e8840'} Sep 08 11:08:05.978227 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:08:05.978227 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:08:05.978227 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:08:05.978227 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:08:05.978227 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:08:05.978227 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:08:05.978227 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:08:05.978227 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:08:05.978227 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:08:05.978227 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:08:05.978227 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38c3f72b-a090-4673-9a1c-a8e0877e8840 could not be found. Sep 08 11:08:05.978227 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:08:05.978227 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:08:05.978227 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:08:05.978227 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:08:05.978227 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:08:05.978227 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:08:05.978227 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:08:05.978227 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:08:05.978227 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:08:05.978227 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:08:05.978227 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:08:05.978227 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:08:05.978227 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:08:05.978227 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:08:05.978227 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:08:05.978227 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:08:05.978227 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38c3f72b-a090-4673-9a1c-a8e0877e8840 could not be found. Sep 08 11:08:05.978227 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:08:05.978227 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:08:05.978227 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:08:05.982004 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:08:05.982004 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:08:05.982004 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:08:05.982004 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:08:05.982004 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:08:05.982004 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38c3f72b-a090-4673-9a1c-a8e0877e8840 could not be found. Sep 08 11:08:05.982004 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:08:05.986049 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b643cd74-8164-485e-a0c5-e4c9d0651e30 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] Returning 404 to user: Instance 38c3f72b-a090-4673-9a1c-a8e0877e8840 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:08:05.987319 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b643cd74-8164-485e-a0c5-e4c9d0651e30 tempest-VolumesNegativeTest-1002531015 tempest-VolumesNegativeTest-1002531015-project] 10.222.0.27 "GET /compute/v2.1/servers/38c3f72b-a090-4673-9a1c-a8e0877e8840" status: 404 len: 111 microversion: 2.1 time: 0.100980 Sep 08 11:08:05.991942 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2574/5251] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:08:05 2022] GET /compute/v2.1/servers/38c3f72b-a090-4673-9a1c-a8e0877e8840 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 11:08:06.137744 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-637c7186-a536-42eb-83a4-6fc44b658ef2 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:06.138597 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-637c7186-a536-42eb-83a4-6fc44b658ef2 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] [instance: ab59c99b-000f-4819-9f15-ae7dfe723568] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:06.163672 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-637c7186-a536-42eb-83a4-6fc44b658ef2 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:06.165583 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-637c7186-a536-42eb-83a4-6fc44b658ef2 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:06.168636 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-637c7186-a536-42eb-83a4-6fc44b658ef2 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:06.169645 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-637c7186-a536-42eb-83a4-6fc44b658ef2 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:06.170290 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-637c7186-a536-42eb-83a4-6fc44b658ef2 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:06.170834 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-637c7186-a536-42eb-83a4-6fc44b658ef2 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:06.447822 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-637c7186-a536-42eb-83a4-6fc44b658ef2 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e13cf235bb4721972b5c4a1c7b70b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e0611b471443e7a0a744fb4f049edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:08:06.485547 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-637c7186-a536-42eb-83a4-6fc44b658ef2 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] 10.222.0.27 "GET /compute/v2.1/servers/ab59c99b-000f-4819-9f15-ae7dfe723568" status: 200 len: 1282 microversion: 2.1 time: 0.351546 Sep 08 11:08:06.495134 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2575/5252] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:08:06 2022] GET /compute/v2.1/servers/ab59c99b-000f-4819-9f15-ae7dfe723568 => generated 1282 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:08:07.212544 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-940d596e-fcc1-4d6a-9c3c-c543b1ed535e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:08:07.220753 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-940d596e-fcc1-4d6a-9c3c-c543b1ed535e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/7ed54969-4b5f-4a05-ad5a-9d675702f1c4" status: 200 len: 1321 microversion: 2.1 time: 1.881382 Sep 08 11:08:07.222362 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2678/5253] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:08:05 2022] GET /compute/v2.1/servers/7ed54969-4b5f-4a05-ad5a-9d675702f1c4 => generated 1321 bytes in 1883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:08:07.509137 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c9b75daa-17eb-421a-ae52-1b52066891fb tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:07.509928 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c9b75daa-17eb-421a-ae52-1b52066891fb tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] [instance: ab59c99b-000f-4819-9f15-ae7dfe723568] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:07.532521 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c9b75daa-17eb-421a-ae52-1b52066891fb tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:07.532521 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c9b75daa-17eb-421a-ae52-1b52066891fb tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:07.532881 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c9b75daa-17eb-421a-ae52-1b52066891fb tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:07.534544 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c9b75daa-17eb-421a-ae52-1b52066891fb tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:07.535108 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c9b75daa-17eb-421a-ae52-1b52066891fb tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:07.535642 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c9b75daa-17eb-421a-ae52-1b52066891fb tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:08.256405 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-403a8724-ca2f-43b2-9f70-41e42dfb9c96 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:08.257084 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-403a8724-ca2f-43b2-9f70-41e42dfb9c96 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 7ed54969-4b5f-4a05-ad5a-9d675702f1c4] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:08.257887 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c9b75daa-17eb-421a-ae52-1b52066891fb tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e13cf235bb4721972b5c4a1c7b70b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e0611b471443e7a0a744fb4f049edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:08:08.259885 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=4 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:08:08.267138 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c9b75daa-17eb-421a-ae52-1b52066891fb tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] 10.222.0.27 "GET /compute/v2.1/servers/ab59c99b-000f-4819-9f15-ae7dfe723568" status: 200 len: 1324 microversion: 2.1 time: 0.762395 Sep 08 11:08:08.268673 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2576/5254] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:08:07 2022] GET /compute/v2.1/servers/ab59c99b-000f-4819-9f15-ae7dfe723568 => generated 1324 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:08:08.288971 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=14 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:08:08.301470 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-403a8724-ca2f-43b2-9f70-41e42dfb9c96 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:08.303482 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-403a8724-ca2f-43b2-9f70-41e42dfb9c96 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:08.304855 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-403a8724-ca2f-43b2-9f70-41e42dfb9c96 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:08.312152 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-403a8724-ca2f-43b2-9f70-41e42dfb9c96 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:08.314417 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-403a8724-ca2f-43b2-9f70-41e42dfb9c96 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:08.317115 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-403a8724-ca2f-43b2-9f70-41e42dfb9c96 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:09.295012 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-297de804-77ac-483a-b9c7-b45930ae1cff tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:09.296720 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-297de804-77ac-483a-b9c7-b45930ae1cff tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] [instance: ab59c99b-000f-4819-9f15-ae7dfe723568] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:09.300539 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=10 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:08:09.313350 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-297de804-77ac-483a-b9c7-b45930ae1cff tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:09.317403 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-297de804-77ac-483a-b9c7-b45930ae1cff tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:09.318145 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-297de804-77ac-483a-b9c7-b45930ae1cff tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:09.319154 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-297de804-77ac-483a-b9c7-b45930ae1cff tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:09.320588 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-297de804-77ac-483a-b9c7-b45930ae1cff tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:09.323638 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-297de804-77ac-483a-b9c7-b45930ae1cff tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:10.458785 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-403a8724-ca2f-43b2-9f70-41e42dfb9c96 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:08:10.467726 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-403a8724-ca2f-43b2-9f70-41e42dfb9c96 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/7ed54969-4b5f-4a05-ad5a-9d675702f1c4" status: 200 len: 1321 microversion: 2.1 time: 2.218517 Sep 08 11:08:10.468343 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2679/5255] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:08:08 2022] GET /compute/v2.1/servers/7ed54969-4b5f-4a05-ad5a-9d675702f1c4 => generated 1321 bytes in 2220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:08:10.516679 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-297de804-77ac-483a-b9c7-b45930ae1cff tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e13cf235bb4721972b5c4a1c7b70b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e0611b471443e7a0a744fb4f049edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:08:10.526781 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-297de804-77ac-483a-b9c7-b45930ae1cff tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] 10.222.0.27 "GET /compute/v2.1/servers/ab59c99b-000f-4819-9f15-ae7dfe723568" status: 200 len: 1324 microversion: 2.1 time: 1.235643 Sep 08 11:08:10.533513 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2577/5256] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:08:09 2022] GET /compute/v2.1/servers/ab59c99b-000f-4819-9f15-ae7dfe723568 => generated 1324 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:08:11.506534 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3968f6a8-b269-4d03-bd7b-ca1916c69b0f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:11.509742 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3968f6a8-b269-4d03-bd7b-ca1916c69b0f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 7ed54969-4b5f-4a05-ad5a-9d675702f1c4] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:11.541705 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3968f6a8-b269-4d03-bd7b-ca1916c69b0f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:11.543596 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3968f6a8-b269-4d03-bd7b-ca1916c69b0f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:11.545545 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3968f6a8-b269-4d03-bd7b-ca1916c69b0f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:11.548830 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3968f6a8-b269-4d03-bd7b-ca1916c69b0f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:11.551073 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3968f6a8-b269-4d03-bd7b-ca1916c69b0f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:11.552380 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3968f6a8-b269-4d03-bd7b-ca1916c69b0f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:11.553951 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-17d409ea-fbee-497e-8fd6-d9d6297a063b tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:11.554688 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-17d409ea-fbee-497e-8fd6-d9d6297a063b tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] [instance: ab59c99b-000f-4819-9f15-ae7dfe723568] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:11.572186 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-17d409ea-fbee-497e-8fd6-d9d6297a063b tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:11.576083 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-17d409ea-fbee-497e-8fd6-d9d6297a063b tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:11.576452 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-17d409ea-fbee-497e-8fd6-d9d6297a063b tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:11.577255 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-17d409ea-fbee-497e-8fd6-d9d6297a063b tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:11.577718 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-17d409ea-fbee-497e-8fd6-d9d6297a063b tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:11.578324 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-17d409ea-fbee-497e-8fd6-d9d6297a063b tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:11.582347 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:08:12.144111 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-17d409ea-fbee-497e-8fd6-d9d6297a063b tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e13cf235bb4721972b5c4a1c7b70b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e0611b471443e7a0a744fb4f049edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:08:12.155697 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-17d409ea-fbee-497e-8fd6-d9d6297a063b tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] 10.222.0.27 "GET /compute/v2.1/servers/ab59c99b-000f-4819-9f15-ae7dfe723568" status: 200 len: 1324 microversion: 2.1 time: 0.605573 Sep 08 11:08:12.170442 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2578/5257] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:08:11 2022] GET /compute/v2.1/servers/ab59c99b-000f-4819-9f15-ae7dfe723568 => generated 1324 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:08:12.992186 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-477b28d0-b748-40a9-bc06-fd214b38fc19 req-0041bee8-fd77-4b56-8c5e-6fefc12d8d0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ed54969-4b5f-4a05-ad5a-9d675702f1c4", "name": "network-vif-plugged", "status": "completed", "tag": "3791516e-effb-4ab3-bd8b-b7191c90624c"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:08:13.012411 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-477b28d0-b748-40a9-bc06-fd214b38fc19 req-0041bee8-fd77-4b56-8c5e-6fefc12d8d0a service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:13.012916 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-477b28d0-b748-40a9-bc06-fd214b38fc19 req-0041bee8-fd77-4b56-8c5e-6fefc12d8d0a service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:13.013400 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-477b28d0-b748-40a9-bc06-fd214b38fc19 req-0041bee8-fd77-4b56-8c5e-6fefc12d8d0a service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:13.033092 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-3968f6a8-b269-4d03-bd7b-ca1916c69b0f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:08:13.036342 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-477b28d0-b748-40a9-bc06-fd214b38fc19 req-0041bee8-fd77-4b56-8c5e-6fefc12d8d0a service nova] Creating event network-vif-plugged:3791516e-effb-4ab3-bd8b-b7191c90624c for instance 7ed54969-4b5f-4a05-ad5a-9d675702f1c4 on n-h2-850501-12 Sep 08 11:08:13.055031 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-477b28d0-b748-40a9-bc06-fd214b38fc19 req-0041bee8-fd77-4b56-8c5e-6fefc12d8d0a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066810 Sep 08 11:08:13.056561 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2579/5258] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:08:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:08:13.060941 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3968f6a8-b269-4d03-bd7b-ca1916c69b0f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/7ed54969-4b5f-4a05-ad5a-9d675702f1c4" status: 200 len: 1321 microversion: 2.1 time: 1.558573 Sep 08 11:08:13.062542 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2680/5259] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:08:11 2022] GET /compute/v2.1/servers/7ed54969-4b5f-4a05-ad5a-9d675702f1c4 => generated 1321 bytes in 1564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:08:13.214327 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-89ddd25f-5d0c-4463-914f-847677623b85 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:13.215306 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-89ddd25f-5d0c-4463-914f-847677623b85 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] [instance: ab59c99b-000f-4819-9f15-ae7dfe723568] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:13.224914 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89ddd25f-5d0c-4463-914f-847677623b85 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:13.225754 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89ddd25f-5d0c-4463-914f-847677623b85 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:13.226404 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89ddd25f-5d0c-4463-914f-847677623b85 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:13.227301 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89ddd25f-5d0c-4463-914f-847677623b85 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:13.228487 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89ddd25f-5d0c-4463-914f-847677623b85 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:13.229172 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89ddd25f-5d0c-4463-914f-847677623b85 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:13.947415 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-4df286d5-9f3a-4ab1-886c-a8873647b201 req-461bef94-26b8-46f7-9869-004ab49fb14e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab59c99b-000f-4819-9f15-ae7dfe723568", "tag": "b5be12f3-e743-4f7d-b469-60774d88af26"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:08:14.000178 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-4df286d5-9f3a-4ab1-886c-a8873647b201 req-461bef94-26b8-46f7-9869-004ab49fb14e service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:14.000681 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-4df286d5-9f3a-4ab1-886c-a8873647b201 req-461bef94-26b8-46f7-9869-004ab49fb14e service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:14.009631 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-4df286d5-9f3a-4ab1-886c-a8873647b201 req-461bef94-26b8-46f7-9869-004ab49fb14e service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:14.068821 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-4df286d5-9f3a-4ab1-886c-a8873647b201 req-461bef94-26b8-46f7-9869-004ab49fb14e service nova] Creating event network-changed:b5be12f3-e743-4f7d-b469-60774d88af26 for instance ab59c99b-000f-4819-9f15-ae7dfe723568 on n-h1-850501-12 Sep 08 11:08:14.078347 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-89ddd25f-5d0c-4463-914f-847677623b85 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e13cf235bb4721972b5c4a1c7b70b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e0611b471443e7a0a744fb4f049edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:08:14.088141 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-89ddd25f-5d0c-4463-914f-847677623b85 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] 10.222.0.27 "GET /compute/v2.1/servers/ab59c99b-000f-4819-9f15-ae7dfe723568" status: 200 len: 1324 microversion: 2.1 time: 0.884479 Sep 08 11:08:14.094433 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-4df286d5-9f3a-4ab1-886c-a8873647b201 req-461bef94-26b8-46f7-9869-004ab49fb14e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153621 Sep 08 11:08:14.095068 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2681/5260] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:08:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:08:14.112149 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2580/5261] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:08:13 2022] GET /compute/v2.1/servers/ab59c99b-000f-4819-9f15-ae7dfe723568 => generated 1324 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:08:14.112149 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-520730d5-78d9-465a-842a-260ea523697d tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:14.112149 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-520730d5-78d9-465a-842a-260ea523697d tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 7ed54969-4b5f-4a05-ad5a-9d675702f1c4] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:14.172125 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-520730d5-78d9-465a-842a-260ea523697d tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:14.175893 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-520730d5-78d9-465a-842a-260ea523697d tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:14.179901 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-520730d5-78d9-465a-842a-260ea523697d tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:14.181621 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-520730d5-78d9-465a-842a-260ea523697d tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:14.182252 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-520730d5-78d9-465a-842a-260ea523697d tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:14.182837 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-520730d5-78d9-465a-842a-260ea523697d tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:15.023929 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-520730d5-78d9-465a-842a-260ea523697d tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:08:15.039669 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-520730d5-78d9-465a-842a-260ea523697d tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/7ed54969-4b5f-4a05-ad5a-9d675702f1c4" status: 200 len: 1321 microversion: 2.1 time: 0.934687 Sep 08 11:08:15.042201 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2581/5262] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:08:14 2022] GET /compute/v2.1/servers/7ed54969-4b5f-4a05-ad5a-9d675702f1c4 => generated 1321 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:08:15.146697 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-64c22b6d-a731-4fb9-82d4-73b6c4f2070b tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:15.148062 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-64c22b6d-a731-4fb9-82d4-73b6c4f2070b tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] [instance: ab59c99b-000f-4819-9f15-ae7dfe723568] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:15.170489 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64c22b6d-a731-4fb9-82d4-73b6c4f2070b tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:15.178855 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64c22b6d-a731-4fb9-82d4-73b6c4f2070b tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:15.183136 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64c22b6d-a731-4fb9-82d4-73b6c4f2070b tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:15.184004 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64c22b6d-a731-4fb9-82d4-73b6c4f2070b tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:15.188438 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64c22b6d-a731-4fb9-82d4-73b6c4f2070b tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:15.188993 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64c22b6d-a731-4fb9-82d4-73b6c4f2070b tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:15.675457 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-64c22b6d-a731-4fb9-82d4-73b6c4f2070b tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e13cf235bb4721972b5c4a1c7b70b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e0611b471443e7a0a744fb4f049edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:08:15.725241 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-64c22b6d-a731-4fb9-82d4-73b6c4f2070b tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] 10.222.0.27 "GET /compute/v2.1/servers/ab59c99b-000f-4819-9f15-ae7dfe723568" status: 200 len: 1324 microversion: 2.1 time: 0.600860 Sep 08 11:08:15.745814 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2682/5263] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:08:15 2022] GET /compute/v2.1/servers/ab59c99b-000f-4819-9f15-ae7dfe723568 => generated 1324 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:08:16.070662 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9a7aada7-1ee4-49a1-9020-e44adc2331be tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:16.075889 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9a7aada7-1ee4-49a1-9020-e44adc2331be tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 7ed54969-4b5f-4a05-ad5a-9d675702f1c4] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:16.101569 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9a7aada7-1ee4-49a1-9020-e44adc2331be tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:16.102404 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9a7aada7-1ee4-49a1-9020-e44adc2331be tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:16.103086 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9a7aada7-1ee4-49a1-9020-e44adc2331be tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:16.104247 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9a7aada7-1ee4-49a1-9020-e44adc2331be tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:16.105414 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9a7aada7-1ee4-49a1-9020-e44adc2331be tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:16.106288 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9a7aada7-1ee4-49a1-9020-e44adc2331be tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:16.403904 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9a7aada7-1ee4-49a1-9020-e44adc2331be tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:08:16.413219 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9a7aada7-1ee4-49a1-9020-e44adc2331be tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/7ed54969-4b5f-4a05-ad5a-9d675702f1c4" status: 200 len: 1502 microversion: 2.1 time: 0.352331 Sep 08 11:08:16.442688 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-14965bf6-8175-456f-832f-bcd977a11c3f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:16.443512 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-14965bf6-8175-456f-832f-bcd977a11c3f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 7ed54969-4b5f-4a05-ad5a-9d675702f1c4] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:16.456273 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2582/5264] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:08:16 2022] GET /compute/v2.1/servers/7ed54969-4b5f-4a05-ad5a-9d675702f1c4 => generated 1502 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:08:16.470281 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-14965bf6-8175-456f-832f-bcd977a11c3f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:16.476297 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-14965bf6-8175-456f-832f-bcd977a11c3f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:16.483355 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-14965bf6-8175-456f-832f-bcd977a11c3f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:16.486867 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-14965bf6-8175-456f-832f-bcd977a11c3f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:16.496091 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-14965bf6-8175-456f-832f-bcd977a11c3f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:16.500903 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-14965bf6-8175-456f-832f-bcd977a11c3f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:16.759307 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-decf5df0-6cb7-4463-8fe0-3b4907fd79d0 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:16.760394 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-decf5df0-6cb7-4463-8fe0-3b4907fd79d0 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] [instance: ab59c99b-000f-4819-9f15-ae7dfe723568] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:16.820854 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-decf5df0-6cb7-4463-8fe0-3b4907fd79d0 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:16.821401 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-decf5df0-6cb7-4463-8fe0-3b4907fd79d0 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:16.821849 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-decf5df0-6cb7-4463-8fe0-3b4907fd79d0 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:16.822584 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-decf5df0-6cb7-4463-8fe0-3b4907fd79d0 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:16.823185 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-decf5df0-6cb7-4463-8fe0-3b4907fd79d0 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:16.823508 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-decf5df0-6cb7-4463-8fe0-3b4907fd79d0 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:17.199612 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-14965bf6-8175-456f-832f-bcd977a11c3f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:08:17.218211 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-14965bf6-8175-456f-832f-bcd977a11c3f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/7ed54969-4b5f-4a05-ad5a-9d675702f1c4" status: 200 len: 1502 microversion: 2.1 time: 0.777175 Sep 08 11:08:17.237457 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2683/5265] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:08:16 2022] GET /compute/v2.1/servers/7ed54969-4b5f-4a05-ad5a-9d675702f1c4 => generated 1502 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:08:17.246809 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-decf5df0-6cb7-4463-8fe0-3b4907fd79d0 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e13cf235bb4721972b5c4a1c7b70b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e0611b471443e7a0a744fb4f049edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:08:17.254128 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e674f9b6-bf83-4719-acff-8ac751a66010 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:17.254826 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e674f9b6-bf83-4719-acff-8ac751a66010 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 7ed54969-4b5f-4a05-ad5a-9d675702f1c4] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:17.272858 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-decf5df0-6cb7-4463-8fe0-3b4907fd79d0 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] 10.222.0.27 "GET /compute/v2.1/servers/ab59c99b-000f-4819-9f15-ae7dfe723568" status: 200 len: 1324 microversion: 2.1 time: 0.521951 Sep 08 11:08:17.275043 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2583/5266] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:08:16 2022] GET /compute/v2.1/servers/ab59c99b-000f-4819-9f15-ae7dfe723568 => generated 1324 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:08:17.292626 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e674f9b6-bf83-4719-acff-8ac751a66010 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:17.298640 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e674f9b6-bf83-4719-acff-8ac751a66010 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:17.300481 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e674f9b6-bf83-4719-acff-8ac751a66010 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:17.303592 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e674f9b6-bf83-4719-acff-8ac751a66010 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:17.305422 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e674f9b6-bf83-4719-acff-8ac751a66010 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:17.309111 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e674f9b6-bf83-4719-acff-8ac751a66010 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:17.384502 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e674f9b6-bf83-4719-acff-8ac751a66010 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 7ed54969-4b5f-4a05-ad5a-9d675702f1c4] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:08:17.597195 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e674f9b6-bf83-4719-acff-8ac751a66010 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7ed54969-4b5f-4a05-ad5a-9d675702f1c4" status: 204 len: 0 microversion: 2.1 time: 0.345387 Sep 08 11:08:17.599362 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2684/5267] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:08:17 2022] DELETE /compute/v2.1/servers/7ed54969-4b5f-4a05-ad5a-9d675702f1c4 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:08:17.617891 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-23823d23-19ca-4b96-b15b-afe852305608 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:17.623626 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-23823d23-19ca-4b96-b15b-afe852305608 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 7ed54969-4b5f-4a05-ad5a-9d675702f1c4] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:17.657385 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23823d23-19ca-4b96-b15b-afe852305608 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:17.659727 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23823d23-19ca-4b96-b15b-afe852305608 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:17.665574 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23823d23-19ca-4b96-b15b-afe852305608 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:17.669584 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23823d23-19ca-4b96-b15b-afe852305608 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:17.672321 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23823d23-19ca-4b96-b15b-afe852305608 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:17.676525 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23823d23-19ca-4b96-b15b-afe852305608 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:18.283313 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-23823d23-19ca-4b96-b15b-afe852305608 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:08:18.292615 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-23823d23-19ca-4b96-b15b-afe852305608 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/7ed54969-4b5f-4a05-ad5a-9d675702f1c4" status: 200 len: 1508 microversion: 2.1 time: 0.686540 Sep 08 11:08:18.293232 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2584/5268] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:08:17 2022] GET /compute/v2.1/servers/7ed54969-4b5f-4a05-ad5a-9d675702f1c4 => generated 1508 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:08:18.306435 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5483c9ab-0400-44c9-9fee-8e82e33575e5 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:18.307544 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5483c9ab-0400-44c9-9fee-8e82e33575e5 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] [instance: ab59c99b-000f-4819-9f15-ae7dfe723568] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:18.327116 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5483c9ab-0400-44c9-9fee-8e82e33575e5 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:18.327862 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5483c9ab-0400-44c9-9fee-8e82e33575e5 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:18.328653 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5483c9ab-0400-44c9-9fee-8e82e33575e5 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:18.329786 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5483c9ab-0400-44c9-9fee-8e82e33575e5 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:18.330563 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5483c9ab-0400-44c9-9fee-8e82e33575e5 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:18.330887 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5483c9ab-0400-44c9-9fee-8e82e33575e5 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:19.322525 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ecb0e217-aa19-4019-a10f-0b1730bcf46e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:19.323165 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ecb0e217-aa19-4019-a10f-0b1730bcf46e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 7ed54969-4b5f-4a05-ad5a-9d675702f1c4] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:19.337770 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ecb0e217-aa19-4019-a10f-0b1730bcf46e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:19.348488 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ecb0e217-aa19-4019-a10f-0b1730bcf46e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:19.349998 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ecb0e217-aa19-4019-a10f-0b1730bcf46e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:19.350768 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ecb0e217-aa19-4019-a10f-0b1730bcf46e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:19.359979 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ecb0e217-aa19-4019-a10f-0b1730bcf46e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:19.362639 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ecb0e217-aa19-4019-a10f-0b1730bcf46e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:19.825532 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ecb0e217-aa19-4019-a10f-0b1730bcf46e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:08:19.841704 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ecb0e217-aa19-4019-a10f-0b1730bcf46e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/7ed54969-4b5f-4a05-ad5a-9d675702f1c4" status: 200 len: 1508 microversion: 2.1 time: 0.523890 Sep 08 11:08:19.844293 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2585/5269] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:08:19 2022] GET /compute/v2.1/servers/7ed54969-4b5f-4a05-ad5a-9d675702f1c4 => generated 1508 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:08:20.341122 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5483c9ab-0400-44c9-9fee-8e82e33575e5 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e13cf235bb4721972b5c4a1c7b70b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e0611b471443e7a0a744fb4f049edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:08:20.359371 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-2f2c3cef-4c88-4f0a-b1a4-c4e49519ea89 req-4c2cccc0-6adc-4c33-a190-5032d1e92cb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ed54969-4b5f-4a05-ad5a-9d675702f1c4", "name": "network-vif-deleted", "tag": "3791516e-effb-4ab3-bd8b-b7191c90624c"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:08:20.394074 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5483c9ab-0400-44c9-9fee-8e82e33575e5 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] 10.222.0.27 "GET /compute/v2.1/servers/ab59c99b-000f-4819-9f15-ae7dfe723568" status: 200 len: 1324 microversion: 2.1 time: 2.086904 Sep 08 11:08:20.398947 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2685/5270] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:08:18 2022] GET /compute/v2.1/servers/ab59c99b-000f-4819-9f15-ae7dfe723568 => generated 1324 bytes in 2097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:08:20.456766 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-2f2c3cef-4c88-4f0a-b1a4-c4e49519ea89 req-4c2cccc0-6adc-4c33-a190-5032d1e92cb0 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:20.473708 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-2f2c3cef-4c88-4f0a-b1a4-c4e49519ea89 req-4c2cccc0-6adc-4c33-a190-5032d1e92cb0 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:20.473708 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-2f2c3cef-4c88-4f0a-b1a4-c4e49519ea89 req-4c2cccc0-6adc-4c33-a190-5032d1e92cb0 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:20.524506 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-2f2c3cef-4c88-4f0a-b1a4-c4e49519ea89 req-4c2cccc0-6adc-4c33-a190-5032d1e92cb0 service nova] Creating event network-vif-deleted:3791516e-effb-4ab3-bd8b-b7191c90624c for instance 7ed54969-4b5f-4a05-ad5a-9d675702f1c4 on n-h2-850501-12 Sep 08 11:08:20.573313 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-2f2c3cef-4c88-4f0a-b1a4-c4e49519ea89 req-4c2cccc0-6adc-4c33-a190-5032d1e92cb0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.207397 Sep 08 11:08:20.574335 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2586/5271] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:08:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:08:20.872386 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a885b677-6cb4-4374-838a-ea875d612f0a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:20.873192 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a885b677-6cb4-4374-838a-ea875d612f0a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 7ed54969-4b5f-4a05-ad5a-9d675702f1c4] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:20.891131 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a885b677-6cb4-4374-838a-ea875d612f0a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:20.892117 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a885b677-6cb4-4374-838a-ea875d612f0a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:20.893638 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a885b677-6cb4-4374-838a-ea875d612f0a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:20.899339 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a885b677-6cb4-4374-838a-ea875d612f0a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:20.901639 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a885b677-6cb4-4374-838a-ea875d612f0a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:20.906672 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a885b677-6cb4-4374-838a-ea875d612f0a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:21.004923 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a885b677-6cb4-4374-838a-ea875d612f0a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:21.005696 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a885b677-6cb4-4374-838a-ea875d612f0a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:21.006299 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a885b677-6cb4-4374-838a-ea875d612f0a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:21.006920 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-a885b677-6cb4-4374-838a-ea875d612f0a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lazy-loading 'fault' on Instance uuid 7ed54969-4b5f-4a05-ad5a-9d675702f1c4 {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:08:21.296300 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a885b677-6cb4-4374-838a-ea875d612f0a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:08:21.317062 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a885b677-6cb4-4374-838a-ea875d612f0a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/7ed54969-4b5f-4a05-ad5a-9d675702f1c4" status: 200 len: 1311 microversion: 2.1 time: 0.448801 Sep 08 11:08:21.335014 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2686/5272] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:08:20 2022] GET /compute/v2.1/servers/7ed54969-4b5f-4a05-ad5a-9d675702f1c4 => generated 1311 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:08:21.424269 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-872400bf-d2a5-4b1e-af77-3069bbaf5cb2 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:21.425723 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-872400bf-d2a5-4b1e-af77-3069bbaf5cb2 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] [instance: ab59c99b-000f-4819-9f15-ae7dfe723568] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:21.444434 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-872400bf-d2a5-4b1e-af77-3069bbaf5cb2 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:21.444992 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-872400bf-d2a5-4b1e-af77-3069bbaf5cb2 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:21.449485 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-872400bf-d2a5-4b1e-af77-3069bbaf5cb2 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:21.450489 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-872400bf-d2a5-4b1e-af77-3069bbaf5cb2 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:21.455415 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-872400bf-d2a5-4b1e-af77-3069bbaf5cb2 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:21.455880 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-872400bf-d2a5-4b1e-af77-3069bbaf5cb2 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:22.357751 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c83c9de6-5c87-472a-93cb-bf6d65ce3c74 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:22.359085 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c83c9de6-5c87-472a-93cb-bf6d65ce3c74 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 7ed54969-4b5f-4a05-ad5a-9d675702f1c4] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:22.385400 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c83c9de6-5c87-472a-93cb-bf6d65ce3c74 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:22.397201 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c83c9de6-5c87-472a-93cb-bf6d65ce3c74 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:22.399721 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c83c9de6-5c87-472a-93cb-bf6d65ce3c74 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:22.401749 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c83c9de6-5c87-472a-93cb-bf6d65ce3c74 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:22.405234 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c83c9de6-5c87-472a-93cb-bf6d65ce3c74 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:22.406372 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c83c9de6-5c87-472a-93cb-bf6d65ce3c74 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:22.458437 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-c83c9de6-5c87-472a-93cb-bf6d65ce3c74 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] HTTP exception thrown: Instance 7ed54969-4b5f-4a05-ad5a-9d675702f1c4 could not be found. Sep 08 11:08:22.460505 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c83c9de6-5c87-472a-93cb-bf6d65ce3c74 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Request method failure captured: Sep 08 11:08:22.460505 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/7ed54969-4b5f-4a05-ad5a-9d675702f1c4 HTTP/1.1 Sep 08 11:08:22.460505 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:08:22.460505 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:08:22.460505 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:08:22.460505 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 11:08:22.460505 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:08:22.460505 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:08:22.460505 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:08:22.460505 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:08:22.460505 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGczsmQNk4U50BxzpgES3MzOpQCXZXSfv8U0fcthNptdjh-xj4_PXNp1cjGhvwh0ftE8negXuLuWJgSY_-2MLUgv_DNMLspYk9lV1lwtSgINsi9nLe-7tZYJuQnQiEJ_Nrc9KtaPntdIqDspehXXUE-x22uN3GKjXVnYgVPtfdxa4_cE Sep 08 11:08:22.460505 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:08:22.460505 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:08:22.460505 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:08:22.460505 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:08:22.460505 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:08:22.460505 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:08:22.460505 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 7868787bfea94355a5d5971bab0d5ed4 Sep 08 11:08:22.460505 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServersTestJSON-1882931607 Sep 08 11:08:22.460505 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:08:22.460505 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:08:22.460505 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:08:22.460505 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServersTestJSON-1882931607 Sep 08 11:08:22.460505 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 7868787bfea94355a5d5971bab0d5ed4 Sep 08 11:08:22.460505 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServersTestJSON-1882931607 Sep 08 11:08:22.460505 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServersTestJSON-1882931607-project Sep 08 11:08:22.460505 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:08:22.460505 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:08:22.460505 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 5193272e9ab24845aff53982dbe2c6f0 Sep 08 11:08:22.460505 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServersTestJSON-1882931607-project Sep 08 11:08:22.460505 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 11:08:22.460505 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 7ed54969-4b5f-4a05-ad5a-9d675702f1c4 could not be found. Sep 08 11:08:22.460505 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '7ed54969-4b5f-4a05-ad5a-9d675702f1c4'} Sep 08 11:08:22.460505 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:08:22.460505 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:08:22.460505 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:08:22.460505 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:08:22.460505 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:08:22.460505 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:08:22.460505 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:08:22.460505 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:08:22.460505 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:08:22.460505 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:08:22.460505 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ed54969-4b5f-4a05-ad5a-9d675702f1c4 could not be found. Sep 08 11:08:22.460505 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:08:22.460505 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:08:22.460505 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:08:22.460505 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:08:22.460505 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:08:22.460505 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:08:22.460505 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:08:22.460505 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:08:22.460505 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:08:22.460505 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:08:22.460505 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:08:22.460505 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:08:22.460505 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:08:22.460505 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:08:22.460505 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:08:22.460505 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:08:22.460505 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ed54969-4b5f-4a05-ad5a-9d675702f1c4 could not be found. Sep 08 11:08:22.460505 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:08:22.460505 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:08:22.460505 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:08:22.465606 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:08:22.465606 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:08:22.465606 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:08:22.465606 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:08:22.465606 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:08:22.465606 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ed54969-4b5f-4a05-ad5a-9d675702f1c4 could not be found. Sep 08 11:08:22.465606 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:08:22.473400 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c83c9de6-5c87-472a-93cb-bf6d65ce3c74 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Returning 404 to user: Instance 7ed54969-4b5f-4a05-ad5a-9d675702f1c4 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:08:22.476070 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c83c9de6-5c87-472a-93cb-bf6d65ce3c74 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/7ed54969-4b5f-4a05-ad5a-9d675702f1c4" status: 404 len: 111 microversion: 2.1 time: 0.127554 Sep 08 11:08:22.488158 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2687/5273] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:08:22 2022] GET /compute/v2.1/servers/7ed54969-4b5f-4a05-ad5a-9d675702f1c4 => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:08:22.503336 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-de198982-72b9-4bfa-b440-71294596d1de tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Action: 'create', calling method: .version_select at 0x7f68df2a8e50>, body: {"keypair": {"name": "tempest-key-1259222347", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN53j14LKrjhl8AK13w4hdior68PyyFlI40yv9SWBX4DTMT1nD5me2Zv0VxRqZx3F6Q/FqYv9+prkxNJVExQUu3yfeWxKNHIc+JC5pse/GqIxLjBylOoe5Xfr7iE6SCAkQ=="}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:08:22.552938 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-de198982-72b9-4bfa-b440-71294596d1de tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Getting quotas for project 7868787bfea94355a5d5971bab0d5ed4. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:08:22.569827 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-de198982-72b9-4bfa-b440-71294596d1de tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Getting quotas for user 5193272e9ab24845aff53982dbe2c6f0 and project 7868787bfea94355a5d5971bab0d5ed4. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:08:22.634622 n-d-850501-12 devstack@n-api.service[128861]: ERROR oslo.messaging._drivers.impl_rabbit [None req-de198982-72b9-4bfa-b440-71294596d1de tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [95b76c8a-37f6-4e41-b0fd-012692e717b2] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 08 11:08:23.250525 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-872400bf-d2a5-4b1e-af77-3069bbaf5cb2 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e13cf235bb4721972b5c4a1c7b70b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e0611b471443e7a0a744fb4f049edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:08:23.261898 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-872400bf-d2a5-4b1e-af77-3069bbaf5cb2 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] 10.222.0.27 "GET /compute/v2.1/servers/ab59c99b-000f-4819-9f15-ae7dfe723568" status: 200 len: 1324 microversion: 2.1 time: 1.843306 Sep 08 11:08:23.265217 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2587/5274] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:08:21 2022] GET /compute/v2.1/servers/ab59c99b-000f-4819-9f15-ae7dfe723568 => generated 1324 bytes in 1847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:08:23.644232 n-d-850501-12 devstack@n-api.service[128861]: INFO oslo.messaging._drivers.impl_rabbit [None req-de198982-72b9-4bfa-b440-71294596d1de tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [95b76c8a-37f6-4e41-b0fd-012692e717b2] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 43498. Sep 08 11:08:23.672143 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-de198982-72b9-4bfa-b440-71294596d1de tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 1.179711 Sep 08 11:08:23.684483 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-015aec4d-6ad4-47e0-8643-0bf6d11ce767 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '.version_select at 0x7f68e8b5f700>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:23.690064 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2688/5275] 10.222.0.27 () {60 vars in 1159 bytes} [Thu Sep 8 11:08:22 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:08:23.695559 n-d-850501-12 devstack@n-api.service[128862]: WARNING oslo_db.sqlalchemy.utils [None req-015aec4d-6ad4-47e0-8643-0bf6d11ce767 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 08 11:08:23.710564 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-015aec4d-6ad4-47e0-8643-0bf6d11ce767 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.026041 Sep 08 11:08:23.711435 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2588/5276] 10.222.0.27 () {58 vars in 1137 bytes} [Thu Sep 8 11:08:23 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:08:24.071394 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1a755ab1-09cb-4ccc-900a-21e1ee82f40f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1232966496", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "key_name": "tempest-key-1259222347", "networks": [{"uuid": "20951261-edda-4da9-a3e2-8f222023ad9d"}]}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:08:24.177781 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-1a755ab1-09cb-4ccc-900a-21e1ee82f40f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] validate_networks() for [('20951261-edda-4da9-a3e2-8f222023ad9d', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:08:24.284468 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a285c0f0-84fa-48ef-8413-ed9851b1a50c tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:24.285545 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a285c0f0-84fa-48ef-8413-ed9851b1a50c tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] [instance: ab59c99b-000f-4819-9f15-ae7dfe723568] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:24.297840 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a285c0f0-84fa-48ef-8413-ed9851b1a50c tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:24.299934 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a285c0f0-84fa-48ef-8413-ed9851b1a50c tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:24.301411 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a285c0f0-84fa-48ef-8413-ed9851b1a50c tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:24.302412 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a285c0f0-84fa-48ef-8413-ed9851b1a50c tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:24.304322 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a285c0f0-84fa-48ef-8413-ed9851b1a50c tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:24.314755 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a285c0f0-84fa-48ef-8413-ed9851b1a50c tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:24.715004 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a285c0f0-84fa-48ef-8413-ed9851b1a50c tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e13cf235bb4721972b5c4a1c7b70b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e0611b471443e7a0a744fb4f049edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:08:24.729764 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a285c0f0-84fa-48ef-8413-ed9851b1a50c tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] 10.222.0.27 "GET /compute/v2.1/servers/ab59c99b-000f-4819-9f15-ae7dfe723568" status: 200 len: 1324 microversion: 2.1 time: 0.449755 Sep 08 11:08:24.733389 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2589/5277] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:08:24 2022] GET /compute/v2.1/servers/ab59c99b-000f-4819-9f15-ae7dfe723568 => generated 1324 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:08:25.052507 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:08:25.758395 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b4edf2dd-9830-46e9-b525-3c125b52c8ef tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:25.759853 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b4edf2dd-9830-46e9-b525-3c125b52c8ef tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] [instance: ab59c99b-000f-4819-9f15-ae7dfe723568] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:25.763144 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:08:25.791051 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4edf2dd-9830-46e9-b525-3c125b52c8ef tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:25.791806 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4edf2dd-9830-46e9-b525-3c125b52c8ef tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:25.792437 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4edf2dd-9830-46e9-b525-3c125b52c8ef tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:25.793774 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4edf2dd-9830-46e9-b525-3c125b52c8ef tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:25.794395 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4edf2dd-9830-46e9-b525-3c125b52c8ef tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:25.794980 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4edf2dd-9830-46e9-b525-3c125b52c8ef tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:26.310437 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-1a755ab1-09cb-4ccc-900a-21e1ee82f40f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:08:26.310897 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-1a755ab1-09cb-4ccc-900a-21e1ee82f40f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:08:26.311503 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-1a755ab1-09cb-4ccc-900a-21e1ee82f40f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:08:26.311927 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-1a755ab1-09cb-4ccc-900a-21e1ee82f40f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:08:26.312345 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-1a755ab1-09cb-4ccc-900a-21e1ee82f40f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:08:26.343455 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1a755ab1-09cb-4ccc-900a-21e1ee82f40f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:26.343965 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1a755ab1-09cb-4ccc-900a-21e1ee82f40f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:26.344412 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1a755ab1-09cb-4ccc-900a-21e1ee82f40f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:26.348761 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1a755ab1-09cb-4ccc-900a-21e1ee82f40f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:26.349706 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1a755ab1-09cb-4ccc-900a-21e1ee82f40f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:26.353689 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1a755ab1-09cb-4ccc-900a-21e1ee82f40f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:26.377125 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b4edf2dd-9830-46e9-b525-3c125b52c8ef tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e13cf235bb4721972b5c4a1c7b70b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e0611b471443e7a0a744fb4f049edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:08:26.409937 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b4edf2dd-9830-46e9-b525-3c125b52c8ef tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] 10.222.0.27 "GET /compute/v2.1/servers/ab59c99b-000f-4819-9f15-ae7dfe723568" status: 200 len: 1324 microversion: 2.1 time: 0.649208 Sep 08 11:08:26.430629 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2590/5278] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:08:25 2022] GET /compute/v2.1/servers/ab59c99b-000f-4819-9f15-ae7dfe723568 => generated 1324 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:08:26.430926 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-1a755ab1-09cb-4ccc-900a-21e1ee82f40f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Getting quotas for project 7868787bfea94355a5d5971bab0d5ed4. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:08:26.447885 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-1a755ab1-09cb-4ccc-900a-21e1ee82f40f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Getting quotas for user 5193272e9ab24845aff53982dbe2c6f0 and project 7868787bfea94355a5d5971bab0d5ed4. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:08:26.457818 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-7b6b795b-41be-4607-be3c-645c909b8bf7 req-78ab52ad-d00e-44ee-98f7-f70f0a6cc7ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab59c99b-000f-4819-9f15-ae7dfe723568", "name": "network-vif-plugged", "status": "completed", "tag": "b5be12f3-e743-4f7d-b469-60774d88af26"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:08:26.489537 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1a755ab1-09cb-4ccc-900a-21e1ee82f40f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:08:26.508488 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1a755ab1-09cb-4ccc-900a-21e1ee82f40f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 3c9e4ea7-9f84-44a9-8288-27adaed61617] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:08:26.535966 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-7b6b795b-41be-4607-be3c-645c909b8bf7 req-78ab52ad-d00e-44ee-98f7-f70f0a6cc7ab service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:26.536655 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-7b6b795b-41be-4607-be3c-645c909b8bf7 req-78ab52ad-d00e-44ee-98f7-f70f0a6cc7ab service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:26.550181 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-7b6b795b-41be-4607-be3c-645c909b8bf7 req-78ab52ad-d00e-44ee-98f7-f70f0a6cc7ab service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:26.639299 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-7b6b795b-41be-4607-be3c-645c909b8bf7 req-78ab52ad-d00e-44ee-98f7-f70f0a6cc7ab service nova] Creating event network-vif-plugged:b5be12f3-e743-4f7d-b469-60774d88af26 for instance ab59c99b-000f-4819-9f15-ae7dfe723568 on n-h1-850501-12 Sep 08 11:08:26.677712 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1a755ab1-09cb-4ccc-900a-21e1ee82f40f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.610439 Sep 08 11:08:26.690743 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2689/5279] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 11:08:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 2624 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:08:26.692080 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-7b6b795b-41be-4607-be3c-645c909b8bf7 req-78ab52ad-d00e-44ee-98f7-f70f0a6cc7ab service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.259932 Sep 08 11:08:26.696309 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2591/5280] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:08:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:08:26.698208 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-429a2370-9e5b-4a04-a4b5-2e183586509d tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:26.699266 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-429a2370-9e5b-4a04-a4b5-2e183586509d tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 3c9e4ea7-9f84-44a9-8288-27adaed61617] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:27.474159 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-43e3569e-8c24-4e83-bb45-4bfb77f487c2 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:27.474878 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-43e3569e-8c24-4e83-bb45-4bfb77f487c2 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] [instance: ab59c99b-000f-4819-9f15-ae7dfe723568] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:27.546314 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-43e3569e-8c24-4e83-bb45-4bfb77f487c2 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:27.553905 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-43e3569e-8c24-4e83-bb45-4bfb77f487c2 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:27.558760 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-43e3569e-8c24-4e83-bb45-4bfb77f487c2 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:27.562822 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-43e3569e-8c24-4e83-bb45-4bfb77f487c2 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:27.574585 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-43e3569e-8c24-4e83-bb45-4bfb77f487c2 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:27.575079 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-43e3569e-8c24-4e83-bb45-4bfb77f487c2 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:27.677664 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-429a2370-9e5b-4a04-a4b5-2e183586509d tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:08:27.685815 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-429a2370-9e5b-4a04-a4b5-2e183586509d tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/3c9e4ea7-9f84-44a9-8288-27adaed61617" status: 200 len: 1229 microversion: 2.1 time: 0.993507 Sep 08 11:08:27.686397 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2690/5281] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:08:26 2022] GET /compute/v2.1/servers/3c9e4ea7-9f84-44a9-8288-27adaed61617 => generated 1229 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:08:28.711803 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-38d442d1-3e98-4461-84e2-e543d6d8eaef tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:28.716056 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-38d442d1-3e98-4461-84e2-e543d6d8eaef tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 3c9e4ea7-9f84-44a9-8288-27adaed61617] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:28.772581 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-43e3569e-8c24-4e83-bb45-4bfb77f487c2 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e13cf235bb4721972b5c4a1c7b70b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e0611b471443e7a0a744fb4f049edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:08:28.790500 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-38d442d1-3e98-4461-84e2-e543d6d8eaef tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:28.791134 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-38d442d1-3e98-4461-84e2-e543d6d8eaef tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:28.791560 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-38d442d1-3e98-4461-84e2-e543d6d8eaef tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:28.792311 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-38d442d1-3e98-4461-84e2-e543d6d8eaef tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:28.792767 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-38d442d1-3e98-4461-84e2-e543d6d8eaef tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:28.793224 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-38d442d1-3e98-4461-84e2-e543d6d8eaef tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:28.794093 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-43e3569e-8c24-4e83-bb45-4bfb77f487c2 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] 10.222.0.27 "GET /compute/v2.1/servers/ab59c99b-000f-4819-9f15-ae7dfe723568" status: 200 len: 1324 microversion: 2.1 time: 1.354390 Sep 08 11:08:28.797842 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2592/5282] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:08:27 2022] GET /compute/v2.1/servers/ab59c99b-000f-4819-9f15-ae7dfe723568 => generated 1324 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:08:28.828659 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:08:29.603260 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-38d442d1-3e98-4461-84e2-e543d6d8eaef tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:08:29.616335 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-38d442d1-3e98-4461-84e2-e543d6d8eaef tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/3c9e4ea7-9f84-44a9-8288-27adaed61617" status: 200 len: 1281 microversion: 2.1 time: 0.907655 Sep 08 11:08:29.618739 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2691/5283] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:08:28 2022] GET /compute/v2.1/servers/3c9e4ea7-9f84-44a9-8288-27adaed61617 => generated 1281 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:08:29.824584 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-25edb570-ef67-463c-b264-905df461b09f tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:29.825409 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-25edb570-ef67-463c-b264-905df461b09f tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] [instance: ab59c99b-000f-4819-9f15-ae7dfe723568] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:29.841733 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25edb570-ef67-463c-b264-905df461b09f tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:29.843804 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25edb570-ef67-463c-b264-905df461b09f tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:29.846054 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25edb570-ef67-463c-b264-905df461b09f tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:29.850739 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25edb570-ef67-463c-b264-905df461b09f tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:29.861712 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25edb570-ef67-463c-b264-905df461b09f tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:29.862442 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25edb570-ef67-463c-b264-905df461b09f tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:30.649122 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-08a1dedc-7e2a-4b29-af3f-28d2e279f744 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:30.649917 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-08a1dedc-7e2a-4b29-af3f-28d2e279f744 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 3c9e4ea7-9f84-44a9-8288-27adaed61617] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:30.674962 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-08a1dedc-7e2a-4b29-af3f-28d2e279f744 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:30.675545 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-08a1dedc-7e2a-4b29-af3f-28d2e279f744 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:30.676108 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-08a1dedc-7e2a-4b29-af3f-28d2e279f744 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:30.676960 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-08a1dedc-7e2a-4b29-af3f-28d2e279f744 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:30.677687 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-08a1dedc-7e2a-4b29-af3f-28d2e279f744 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:30.678336 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-08a1dedc-7e2a-4b29-af3f-28d2e279f744 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:30.866246 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-08a1dedc-7e2a-4b29-af3f-28d2e279f744 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:08:30.874570 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-08a1dedc-7e2a-4b29-af3f-28d2e279f744 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/3c9e4ea7-9f84-44a9-8288-27adaed61617" status: 200 len: 1287 microversion: 2.1 time: 0.229340 Sep 08 11:08:30.877561 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2692/5284] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:08:30 2022] GET /compute/v2.1/servers/3c9e4ea7-9f84-44a9-8288-27adaed61617 => generated 1287 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:08:30.881444 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-25edb570-ef67-463c-b264-905df461b09f tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e13cf235bb4721972b5c4a1c7b70b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e0611b471443e7a0a744fb4f049edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:08:30.901246 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-25edb570-ef67-463c-b264-905df461b09f tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] 10.222.0.27 "GET /compute/v2.1/servers/ab59c99b-000f-4819-9f15-ae7dfe723568" status: 200 len: 1521 microversion: 2.1 time: 1.081643 Sep 08 11:08:30.963733 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2593/5285] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:08:29 2022] GET /compute/v2.1/servers/ab59c99b-000f-4819-9f15-ae7dfe723568 => generated 1521 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:08:31.198872 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7139d917-97ce-4f10-9112-6557b088aaa3 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2077572130", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "5ecc4489-d8fd-49a1-a6c0-1b9e1c26ebb3"}]}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:08:31.210992 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7139d917-97ce-4f10-9112-6557b088aaa3 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Request method failure captured: Sep 08 11:08:31.210992 n-d-850501-12 devstack@n-api.service[128861]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 11:08:31.210992 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:08:31.210992 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:08:31.210992 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:08:31.210992 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 243 Sep 08 11:08:31.210992 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:08:31.210992 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:08:31.210992 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:08:31.210992 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:08:31.210992 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGc0KxWJxkq5jmIveEZbiA78IWcFXsEKEFotyEacAgZaeWCzt11mdItPIa0TAJHM50CTFsoxR4wFprG1ZyfmC9ap4ki4XUhmzuSY1D6QKGPlO-3aForscVujH5yINnKlSiXIjQTz0ERZSNPL0SrUuKtgYKkvlVFh-Rvk2RNi4bxoP2_U Sep 08 11:08:31.210992 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:08:31.210992 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:08:31.210992 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:08:31.210992 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:08:31.210992 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:08:31.210992 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:08:31.210992 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: c6e0611b471443e7a0a744fb4f049edf Sep 08 11:08:31.210992 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1337355060 Sep 08 11:08:31.210992 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:08:31.210992 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:08:31.210992 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c6e0611b471443e7a0a744fb4f049edf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c6e0611b471443e7a0a744fb4f049edf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c6e0611b471443e7a0a744fb4f049edf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c6e0611b471443e7a0a744fb4f049edf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:08:31.210992 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1337355060 Sep 08 11:08:31.210992 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: c6e0611b471443e7a0a744fb4f049edf Sep 08 11:08:31.210992 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1337355060 Sep 08 11:08:31.210992 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServerMetadataNegativeTestJSON-1337355060-project Sep 08 11:08:31.210992 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:08:31.210992 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:08:31.210992 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 63e13cf235bb4721972b5c4a1c7b70b1 Sep 08 11:08:31.210992 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1337355060-project Sep 08 11:08:31.210992 n-d-850501-12 devstack@n-api.service[128861]: Sep 08 11:08:31.210992 n-d-850501-12 devstack@n-api.service[128861]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2077572130", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "5ecc4489-d8fd-49a1-a6c0-1b9e1c26ebb3"}]}} Sep 08 11:08:31.210992 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 11:08:31.210992 n-d-850501-12 devstack@n-api.service[128861]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 11:08:31.210992 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-2077572130', 'imageRef': '503f4a0f-e18f-47fd-ad12-0289e3463117', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '5ecc4489-d8fd-49a1-a6c0-1b9e1c26ebb3'}]}}} Sep 08 11:08:31.210992 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:08:31.210992 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:08:31.210992 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 11:08:31.210992 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 11:08:31.210992 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 11:08:31.210992 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise error Sep 08 11:08:31.210992 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 11:08:31.210992 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:08:31.210992 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 08 11:08:31.210992 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 08 11:08:31.210992 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 08 11:08:31.210992 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 08 11:08:31.210992 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 08 11:08:31.210992 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:08:31.210992 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 08 11:08:31.210992 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi {'': 'data1'} Sep 08 11:08:31.210992 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:08:31.210992 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:08:31.210992 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:08:31.210992 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:08:31.210992 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:08:31.210992 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:08:31.210992 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:08:31.210992 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:08:31.210992 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:08:31.210992 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:08:31.210992 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 11:08:31.216028 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 11:08:31.216028 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 11:08:31.216028 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 11:08:31.216028 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 11:08:31.216028 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 11:08:31.216028 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 11:08:31.216028 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 11:08:31.216028 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 11:08:31.216028 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:08:31.216028 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:08:31.216028 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:08:31.216028 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:08:31.216028 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:08:31.216028 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:08:31.216028 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 11:08:31.216028 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 11:08:31.216028 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 11:08:31.216028 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:08:31.219767 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7139d917-97ce-4f10-9112-6557b088aaa3 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:08:31.221442 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7139d917-97ce-4f10-9112-6557b088aaa3 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.026606 Sep 08 11:08:31.223057 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2693/5286] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 11:08:31 2022] POST /compute/v2.1/servers => generated 175 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 11:08:31.234652 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e74b9e50-2f6a-45a1-9eb0-b854af8eaada tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:31.235401 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e74b9e50-2f6a-45a1-9eb0-b854af8eaada tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] [instance: c3869990-b18d-42a0-8399-4abdc58def3f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:31.252321 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-e74b9e50-2f6a-45a1-9eb0-b854af8eaada tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] HTTP exception thrown: Instance c3869990-b18d-42a0-8399-4abdc58def3f could not be found. Sep 08 11:08:31.257429 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e74b9e50-2f6a-45a1-9eb0-b854af8eaada tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Request method failure captured: Sep 08 11:08:31.257429 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/c3869990-b18d-42a0-8399-4abdc58def3f/metadata HTTP/1.1 Sep 08 11:08:31.257429 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 11:08:31.257429 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 11:08:31.257429 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 11:08:31.257429 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 11:08:31.257429 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 11:08:31.257429 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 11:08:31.257429 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 11:08:31.257429 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 11:08:31.257429 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGc0KxWJxkq5jmIveEZbiA78IWcFXsEKEFotyEacAgZaeWCzt11mdItPIa0TAJHM50CTFsoxR4wFprG1ZyfmC9ap4ki4XUhmzuSY1D6QKGPlO-3aForscVujH5yINnKlSiXIjQTz0ERZSNPL0SrUuKtgYKkvlVFh-Rvk2RNi4bxoP2_U Sep 08 11:08:31.257429 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 11:08:31.257429 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 11:08:31.257429 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 11:08:31.257429 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 11:08:31.257429 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 11:08:31.257429 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 11:08:31.257429 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: c6e0611b471443e7a0a744fb4f049edf Sep 08 11:08:31.257429 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1337355060 Sep 08 11:08:31.257429 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 11:08:31.257429 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 11:08:31.257429 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c6e0611b471443e7a0a744fb4f049edf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c6e0611b471443e7a0a744fb4f049edf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c6e0611b471443e7a0a744fb4f049edf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c6e0611b471443e7a0a744fb4f049edf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:08:31.257429 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1337355060 Sep 08 11:08:31.257429 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: c6e0611b471443e7a0a744fb4f049edf Sep 08 11:08:31.257429 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1337355060 Sep 08 11:08:31.257429 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServerMetadataNegativeTestJSON-1337355060-project Sep 08 11:08:31.257429 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 11:08:31.257429 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 11:08:31.257429 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 63e13cf235bb4721972b5c4a1c7b70b1 Sep 08 11:08:31.257429 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1337355060-project Sep 08 11:08:31.257429 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 11:08:31.257429 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance c3869990-b18d-42a0-8399-4abdc58def3f could not be found. Sep 08 11:08:31.257429 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'server_id': 'c3869990-b18d-42a0-8399-4abdc58def3f'} Sep 08 11:08:31.257429 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:08:31.257429 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:08:31.257429 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:08:31.257429 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:08:31.257429 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:08:31.257429 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:08:31.257429 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 08 11:08:31.257429 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 08 11:08:31.257429 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3869990-b18d-42a0-8399-4abdc58def3f could not be found. Sep 08 11:08:31.257429 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:08:31.257429 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:08:31.257429 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:08:31.257429 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:08:31.257429 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:08:31.257429 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:08:31.257429 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:08:31.257429 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:08:31.257429 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:08:31.257429 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:08:31.257429 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Sep 08 11:08:31.257429 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Sep 08 11:08:31.257429 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:08:31.257429 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:08:31.257429 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3869990-b18d-42a0-8399-4abdc58def3f could not be found. Sep 08 11:08:31.257429 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:08:31.257429 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:08:31.257429 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:08:31.257429 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:08:31.257429 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:08:31.257429 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:08:31.261247 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:08:31.261247 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:08:31.261247 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3869990-b18d-42a0-8399-4abdc58def3f could not be found. Sep 08 11:08:31.261247 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:08:31.264674 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e74b9e50-2f6a-45a1-9eb0-b854af8eaada tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Returning 404 to user: Instance c3869990-b18d-42a0-8399-4abdc58def3f could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:08:31.265849 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e74b9e50-2f6a-45a1-9eb0-b854af8eaada tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] 10.222.0.27 "GET /compute/v2.1/servers/c3869990-b18d-42a0-8399-4abdc58def3f/metadata" status: 404 len: 111 microversion: 2.1 time: 0.035806 Sep 08 11:08:31.269807 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2594/5287] 10.222.0.27 () {58 vars in 1263 bytes} [Thu Sep 8 11:08:31 2022] GET /compute/v2.1/servers/c3869990-b18d-42a0-8399-4abdc58def3f/metadata => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:08:31.383861 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d1d38a73-f437-4d47-8e2d-db235094ae29 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2134707000", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "5ecc4489-d8fd-49a1-a6c0-1b9e1c26ebb3"}]}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:08:31.389708 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d1d38a73-f437-4d47-8e2d-db235094ae29 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Request method failure captured: Sep 08 11:08:31.389708 n-d-850501-12 devstack@n-api.service[128861]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 11:08:31.389708 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:08:31.389708 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:08:31.389708 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:08:31.389708 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 499 Sep 08 11:08:31.389708 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:08:31.389708 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:08:31.389708 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:08:31.389708 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:08:31.389708 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGc0KxWJxkq5jmIveEZbiA78IWcFXsEKEFotyEacAgZaeWCzt11mdItPIa0TAJHM50CTFsoxR4wFprG1ZyfmC9ap4ki4XUhmzuSY1D6QKGPlO-3aForscVujH5yINnKlSiXIjQTz0ERZSNPL0SrUuKtgYKkvlVFh-Rvk2RNi4bxoP2_U Sep 08 11:08:31.389708 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:08:31.389708 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:08:31.389708 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:08:31.389708 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:08:31.389708 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:08:31.389708 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:08:31.389708 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: c6e0611b471443e7a0a744fb4f049edf Sep 08 11:08:31.389708 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1337355060 Sep 08 11:08:31.389708 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:08:31.389708 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:08:31.389708 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c6e0611b471443e7a0a744fb4f049edf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c6e0611b471443e7a0a744fb4f049edf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c6e0611b471443e7a0a744fb4f049edf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c6e0611b471443e7a0a744fb4f049edf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:08:31.389708 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1337355060 Sep 08 11:08:31.389708 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: c6e0611b471443e7a0a744fb4f049edf Sep 08 11:08:31.389708 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1337355060 Sep 08 11:08:31.389708 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServerMetadataNegativeTestJSON-1337355060-project Sep 08 11:08:31.389708 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:08:31.389708 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:08:31.389708 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 63e13cf235bb4721972b5c4a1c7b70b1 Sep 08 11:08:31.389708 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1337355060-project Sep 08 11:08:31.389708 n-d-850501-12 devstack@n-api.service[128861]: Sep 08 11:08:31.389708 n-d-850501-12 devstack@n-api.service[128861]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2134707000", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "5ecc4489-d8fd-49a1-a6c0-1b9e1c26ebb3"}]}} Sep 08 11:08:31.389708 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 11:08:31.389708 n-d-850501-12 devstack@n-api.service[128861]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 11:08:31.389708 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-2134707000', 'imageRef': '503f4a0f-e18f-47fd-ad12-0289e3463117', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '5ecc4489-d8fd-49a1-a6c0-1b9e1c26ebb3'}]}}} Sep 08 11:08:31.389708 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:08:31.389708 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:08:31.389708 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 11:08:31.389708 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 11:08:31.389708 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 11:08:31.389708 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise error Sep 08 11:08:31.389708 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 11:08:31.389708 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:08:31.389708 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 08 11:08:31.389708 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 08 11:08:31.389708 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 08 11:08:31.389708 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 08 11:08:31.392717 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 08 11:08:31.392717 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:08:31.392717 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 08 11:08:31.392717 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 08 11:08:31.392717 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:08:31.392717 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:08:31.392717 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:08:31.392717 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:08:31.392717 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:08:31.392717 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:08:31.392717 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:08:31.392717 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:08:31.392717 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:08:31.392717 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:08:31.392717 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 11:08:31.392717 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 11:08:31.392717 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 11:08:31.392717 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 11:08:31.392717 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 11:08:31.392717 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 11:08:31.392717 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 11:08:31.392717 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 11:08:31.392717 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 11:08:31.392717 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:08:31.392717 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:08:31.392717 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:08:31.392717 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:08:31.392717 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:08:31.392717 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:08:31.392717 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 11:08:31.392717 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 11:08:31.392717 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 11:08:31.392717 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:08:31.404830 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d1d38a73-f437-4d47-8e2d-db235094ae29 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:08:31.406118 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d1d38a73-f437-4d47-8e2d-db235094ae29 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.026982 Sep 08 11:08:31.406927 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2694/5288] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 11:08:31 2022] POST /compute/v2.1/servers => generated 687 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 08 11:08:31.526541 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0a5e246a-41f8-4186-9026-0150222c9d59 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1761419075", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "5ecc4489-d8fd-49a1-a6c0-1b9e1c26ebb3"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:08:31.537990 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0a5e246a-41f8-4186-9026-0150222c9d59 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Request method failure captured: Sep 08 11:08:31.537990 n-d-850501-12 devstack@n-api.service[128862]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 11:08:31.537990 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 11:08:31.537990 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 11:08:31.537990 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 11:08:31.537990 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 500 Sep 08 11:08:31.537990 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 11:08:31.537990 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 11:08:31.537990 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 11:08:31.537990 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 11:08:31.537990 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGc0KxWJxkq5jmIveEZbiA78IWcFXsEKEFotyEacAgZaeWCzt11mdItPIa0TAJHM50CTFsoxR4wFprG1ZyfmC9ap4ki4XUhmzuSY1D6QKGPlO-3aForscVujH5yINnKlSiXIjQTz0ERZSNPL0SrUuKtgYKkvlVFh-Rvk2RNi4bxoP2_U Sep 08 11:08:31.537990 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 11:08:31.537990 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 11:08:31.537990 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 11:08:31.537990 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 11:08:31.537990 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 11:08:31.537990 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 11:08:31.537990 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: c6e0611b471443e7a0a744fb4f049edf Sep 08 11:08:31.537990 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1337355060 Sep 08 11:08:31.537990 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 11:08:31.537990 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 11:08:31.537990 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c6e0611b471443e7a0a744fb4f049edf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c6e0611b471443e7a0a744fb4f049edf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c6e0611b471443e7a0a744fb4f049edf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c6e0611b471443e7a0a744fb4f049edf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:08:31.537990 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1337355060 Sep 08 11:08:31.537990 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: c6e0611b471443e7a0a744fb4f049edf Sep 08 11:08:31.537990 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1337355060 Sep 08 11:08:31.537990 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServerMetadataNegativeTestJSON-1337355060-project Sep 08 11:08:31.537990 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 11:08:31.537990 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 11:08:31.537990 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 63e13cf235bb4721972b5c4a1c7b70b1 Sep 08 11:08:31.537990 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1337355060-project Sep 08 11:08:31.537990 n-d-850501-12 devstack@n-api.service[128862]: Sep 08 11:08:31.537990 n-d-850501-12 devstack@n-api.service[128862]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1761419075", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "5ecc4489-d8fd-49a1-a6c0-1b9e1c26ebb3"}]}} Sep 08 11:08:31.537990 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 11:08:31.537990 n-d-850501-12 devstack@n-api.service[128862]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 11:08:31.537990 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1761419075', 'imageRef': '503f4a0f-e18f-47fd-ad12-0289e3463117', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '5ecc4489-d8fd-49a1-a6c0-1b9e1c26ebb3'}]}}} Sep 08 11:08:31.537990 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:08:31.537990 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:08:31.537990 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 11:08:31.537990 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 11:08:31.537990 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 11:08:31.537990 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise error Sep 08 11:08:31.537990 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 11:08:31.537990 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:08:31.537990 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 08 11:08:31.537990 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 08 11:08:31.537990 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 08 11:08:31.537990 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 08 11:08:31.541267 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 08 11:08:31.541267 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:08:31.541267 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 08 11:08:31.541267 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 08 11:08:31.541267 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:08:31.541267 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:08:31.541267 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:08:31.541267 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:08:31.541267 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:08:31.541267 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:08:31.541267 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:08:31.541267 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:08:31.541267 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:08:31.541267 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:08:31.541267 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 11:08:31.541267 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 11:08:31.541267 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 11:08:31.541267 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 11:08:31.541267 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 11:08:31.541267 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 11:08:31.541267 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 11:08:31.541267 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 11:08:31.541267 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 11:08:31.541267 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:08:31.541267 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:08:31.541267 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:08:31.541267 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:08:31.541267 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:08:31.541267 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:08:31.541267 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 11:08:31.541267 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 11:08:31.541267 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 11:08:31.541267 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:08:31.543759 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0a5e246a-41f8-4186-9026-0150222c9d59 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:08:31.544873 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0a5e246a-41f8-4186-9026-0150222c9d59 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.022786 Sep 08 11:08:31.555528 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2595/5289] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 11:08:31 2022] POST /compute/v2.1/servers => generated 689 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 11:08:31.659571 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b9ec413d-5041-46c2-9e32-8f775cb29511 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-561465809", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "5ecc4489-d8fd-49a1-a6c0-1b9e1c26ebb3"}]}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:08:31.664136 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b9ec413d-5041-46c2-9e32-8f775cb29511 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Request method failure captured: Sep 08 11:08:31.664136 n-d-850501-12 devstack@n-api.service[128861]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 11:08:31.664136 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:08:31.664136 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:08:31.664136 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:08:31.664136 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 753 Sep 08 11:08:31.664136 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:08:31.664136 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:08:31.664136 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:08:31.664136 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:08:31.664136 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGc0KxWJxkq5jmIveEZbiA78IWcFXsEKEFotyEacAgZaeWCzt11mdItPIa0TAJHM50CTFsoxR4wFprG1ZyfmC9ap4ki4XUhmzuSY1D6QKGPlO-3aForscVujH5yINnKlSiXIjQTz0ERZSNPL0SrUuKtgYKkvlVFh-Rvk2RNi4bxoP2_U Sep 08 11:08:31.664136 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:08:31.664136 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:08:31.664136 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:08:31.664136 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:08:31.664136 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:08:31.664136 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:08:31.664136 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: c6e0611b471443e7a0a744fb4f049edf Sep 08 11:08:31.664136 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1337355060 Sep 08 11:08:31.664136 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:08:31.664136 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:08:31.664136 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c6e0611b471443e7a0a744fb4f049edf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c6e0611b471443e7a0a744fb4f049edf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c6e0611b471443e7a0a744fb4f049edf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c6e0611b471443e7a0a744fb4f049edf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:08:31.664136 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1337355060 Sep 08 11:08:31.664136 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: c6e0611b471443e7a0a744fb4f049edf Sep 08 11:08:31.664136 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1337355060 Sep 08 11:08:31.664136 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServerMetadataNegativeTestJSON-1337355060-project Sep 08 11:08:31.664136 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:08:31.664136 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:08:31.664136 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 63e13cf235bb4721972b5c4a1c7b70b1 Sep 08 11:08:31.664136 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1337355060-project Sep 08 11:08:31.664136 n-d-850501-12 devstack@n-api.service[128861]: Sep 08 11:08:31.664136 n-d-850501-12 devstack@n-api.service[128861]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-561465809", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "5ecc4489-d8fd-49a1-a6c0-1b9e1c26ebb3"}]}} Sep 08 11:08:31.664136 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 11:08:31.664136 n-d-850501-12 devstack@n-api.service[128861]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 11:08:31.664136 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-561465809', 'imageRef': '503f4a0f-e18f-47fd-ad12-0289e3463117', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '5ecc4489-d8fd-49a1-a6c0-1b9e1c26ebb3'}]}}} Sep 08 11:08:31.664136 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:08:31.664136 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:08:31.664136 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 11:08:31.664136 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 11:08:31.664136 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 11:08:31.667147 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise error Sep 08 11:08:31.667147 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 11:08:31.667147 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:08:31.667147 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 08 11:08:31.667147 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 08 11:08:31.667147 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 08 11:08:31.667147 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 08 11:08:31.667147 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 08 11:08:31.667147 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:08:31.667147 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 08 11:08:31.667147 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 08 11:08:31.667147 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:08:31.667147 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:08:31.667147 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:08:31.667147 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:08:31.667147 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:08:31.667147 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:08:31.667147 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:08:31.667147 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:08:31.667147 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:08:31.667147 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:08:31.667147 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 11:08:31.667147 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 11:08:31.667147 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 11:08:31.667147 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 11:08:31.667147 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 11:08:31.667147 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 11:08:31.667147 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 11:08:31.667147 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 11:08:31.667147 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 11:08:31.667147 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:08:31.667147 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:08:31.667147 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:08:31.667147 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:08:31.667147 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:08:31.667147 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:08:31.667147 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 11:08:31.667147 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 11:08:31.669834 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 11:08:31.669834 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:08:31.681924 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b9ec413d-5041-46c2-9e32-8f775cb29511 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:08:31.683004 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b9ec413d-5041-46c2-9e32-8f775cb29511 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.027974 Sep 08 11:08:31.683721 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2695/5290] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 11:08:31 2022] POST /compute/v2.1/servers => generated 1197 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Sep 08 11:08:31.777505 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c8214ed8-d3ab-41ed-9cd0-09fc12c9de7b tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1249237736", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "5ecc4489-d8fd-49a1-a6c0-1b9e1c26ebb3"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:08:31.788246 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c8214ed8-d3ab-41ed-9cd0-09fc12c9de7b tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Request method failure captured: Sep 08 11:08:31.788246 n-d-850501-12 devstack@n-api.service[128862]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 11:08:31.788246 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 11:08:31.788246 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 11:08:31.788246 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 11:08:31.788246 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 1266 Sep 08 11:08:31.788246 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 11:08:31.788246 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 11:08:31.788246 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 11:08:31.788246 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 11:08:31.788246 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGc0KxWJxkq5jmIveEZbiA78IWcFXsEKEFotyEacAgZaeWCzt11mdItPIa0TAJHM50CTFsoxR4wFprG1ZyfmC9ap4ki4XUhmzuSY1D6QKGPlO-3aForscVujH5yINnKlSiXIjQTz0ERZSNPL0SrUuKtgYKkvlVFh-Rvk2RNi4bxoP2_U Sep 08 11:08:31.788246 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 11:08:31.788246 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 11:08:31.788246 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 11:08:31.788246 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 11:08:31.788246 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 11:08:31.788246 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 11:08:31.788246 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: c6e0611b471443e7a0a744fb4f049edf Sep 08 11:08:31.788246 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1337355060 Sep 08 11:08:31.788246 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 11:08:31.788246 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 11:08:31.788246 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c6e0611b471443e7a0a744fb4f049edf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c6e0611b471443e7a0a744fb4f049edf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c6e0611b471443e7a0a744fb4f049edf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c6e0611b471443e7a0a744fb4f049edf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:08:31.788246 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1337355060 Sep 08 11:08:31.788246 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: c6e0611b471443e7a0a744fb4f049edf Sep 08 11:08:31.788246 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1337355060 Sep 08 11:08:31.788246 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServerMetadataNegativeTestJSON-1337355060-project Sep 08 11:08:31.788246 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 11:08:31.788246 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 11:08:31.788246 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 63e13cf235bb4721972b5c4a1c7b70b1 Sep 08 11:08:31.788246 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1337355060-project Sep 08 11:08:31.788246 n-d-850501-12 devstack@n-api.service[128862]: Sep 08 11:08:31.788246 n-d-850501-12 devstack@n-api.service[128862]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1249237736", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "5ecc4489-d8fd-49a1-a6c0-1b9e1c26ebb3"}]}} Sep 08 11:08:31.788246 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 11:08:31.790832 n-d-850501-12 devstack@n-api.service[128862]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 11:08:31.790832 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1249237736', 'imageRef': '503f4a0f-e18f-47fd-ad12-0289e3463117', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '5ecc4489-d8fd-49a1-a6c0-1b9e1c26ebb3'}]}}} Sep 08 11:08:31.790832 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:08:31.790832 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:08:31.790832 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 11:08:31.790832 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 11:08:31.790832 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 11:08:31.790832 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise error Sep 08 11:08:31.790832 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 11:08:31.790832 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:08:31.790832 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 08 11:08:31.790832 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 08 11:08:31.790832 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 08 11:08:31.790832 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 08 11:08:31.790832 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 08 11:08:31.790832 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:08:31.790832 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 08 11:08:31.792109 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 08 11:08:31.792109 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:08:31.792109 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:08:31.792109 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:08:31.792109 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:08:31.792109 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:08:31.792109 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:08:31.792109 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:08:31.792109 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:08:31.792109 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:08:31.792109 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:08:31.792109 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 11:08:31.792109 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 11:08:31.792109 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 11:08:31.792109 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 11:08:31.792109 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 11:08:31.792109 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 11:08:31.792109 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 11:08:31.792109 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 11:08:31.792109 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 11:08:31.792109 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:08:31.792109 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:08:31.792109 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:08:31.792109 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:08:31.792109 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:08:31.792109 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:08:31.792109 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 11:08:31.792109 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 11:08:31.794108 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 11:08:31.794108 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:08:31.801889 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c8214ed8-d3ab-41ed-9cd0-09fc12c9de7b tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:08:31.803068 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c8214ed8-d3ab-41ed-9cd0-09fc12c9de7b tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.030970 Sep 08 11:08:31.811494 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2596/5291] 10.222.0.27 () {60 vars in 1148 bytes} [Thu Sep 8 11:08:31 2022] POST /compute/v2.1/servers => generated 2221 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Sep 08 11:08:31.817393 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5302cbe3-f076-489e-ad20-ee17b6fd90d4 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:31.818057 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5302cbe3-f076-489e-ad20-ee17b6fd90d4 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] [instance: 6ee8bb9d-7c69-4e0e-8d77-a17f7f4e2a3b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:31.828924 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-5302cbe3-f076-489e-ad20-ee17b6fd90d4 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] HTTP exception thrown: Instance 6ee8bb9d-7c69-4e0e-8d77-a17f7f4e2a3b could not be found. Sep 08 11:08:31.843069 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5302cbe3-f076-489e-ad20-ee17b6fd90d4 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Request method failure captured: Sep 08 11:08:31.843069 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/6ee8bb9d-7c69-4e0e-8d77-a17f7f4e2a3b/metadata/test2 HTTP/1.1 Sep 08 11:08:31.843069 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:08:31.843069 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:08:31.843069 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:08:31.843069 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 11:08:31.843069 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:08:31.843069 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:08:31.843069 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:08:31.843069 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:08:31.843069 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGc0KxWJxkq5jmIveEZbiA78IWcFXsEKEFotyEacAgZaeWCzt11mdItPIa0TAJHM50CTFsoxR4wFprG1ZyfmC9ap4ki4XUhmzuSY1D6QKGPlO-3aForscVujH5yINnKlSiXIjQTz0ERZSNPL0SrUuKtgYKkvlVFh-Rvk2RNi4bxoP2_U Sep 08 11:08:31.843069 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:08:31.843069 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:08:31.843069 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:08:31.843069 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:08:31.843069 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:08:31.843069 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:08:31.843069 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: c6e0611b471443e7a0a744fb4f049edf Sep 08 11:08:31.843069 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1337355060 Sep 08 11:08:31.843069 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:08:31.843069 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:08:31.843069 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c6e0611b471443e7a0a744fb4f049edf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c6e0611b471443e7a0a744fb4f049edf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c6e0611b471443e7a0a744fb4f049edf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c6e0611b471443e7a0a744fb4f049edf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:08:31.843069 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1337355060 Sep 08 11:08:31.843069 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: c6e0611b471443e7a0a744fb4f049edf Sep 08 11:08:31.843069 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1337355060 Sep 08 11:08:31.843069 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServerMetadataNegativeTestJSON-1337355060-project Sep 08 11:08:31.843069 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:08:31.843069 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:08:31.843069 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 63e13cf235bb4721972b5c4a1c7b70b1 Sep 08 11:08:31.843069 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1337355060-project Sep 08 11:08:31.843069 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 11:08:31.843069 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 6ee8bb9d-7c69-4e0e-8d77-a17f7f4e2a3b could not be found. Sep 08 11:08:31.843069 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'server_id': '6ee8bb9d-7c69-4e0e-8d77-a17f7f4e2a3b', 'id': 'test2'} Sep 08 11:08:31.843069 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:08:31.843069 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:08:31.843069 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:08:31.843069 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:08:31.843069 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:08:31.843069 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:08:31.843069 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 08 11:08:31.843069 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 08 11:08:31.843069 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ee8bb9d-7c69-4e0e-8d77-a17f7f4e2a3b could not be found. Sep 08 11:08:31.843069 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:08:31.843069 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:08:31.843069 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:08:31.843069 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:08:31.843069 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:08:31.843069 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:08:31.843069 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:08:31.843069 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:08:31.843069 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:08:31.843069 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:08:31.843069 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Sep 08 11:08:31.843069 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Sep 08 11:08:31.843069 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:08:31.843069 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:08:31.843069 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ee8bb9d-7c69-4e0e-8d77-a17f7f4e2a3b could not be found. Sep 08 11:08:31.843069 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:08:31.843069 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:08:31.843069 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:08:31.843069 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:08:31.843069 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:08:31.843069 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:08:31.848238 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:08:31.848238 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:08:31.848238 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ee8bb9d-7c69-4e0e-8d77-a17f7f4e2a3b could not be found. Sep 08 11:08:31.848238 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:08:31.853461 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5302cbe3-f076-489e-ad20-ee17b6fd90d4 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Returning 404 to user: Instance 6ee8bb9d-7c69-4e0e-8d77-a17f7f4e2a3b could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:08:31.854586 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5302cbe3-f076-489e-ad20-ee17b6fd90d4 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] 10.222.0.27 "GET /compute/v2.1/servers/6ee8bb9d-7c69-4e0e-8d77-a17f7f4e2a3b/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.041671 Sep 08 11:08:31.862218 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2696/5292] 10.222.0.27 () {58 vars in 1281 bytes} [Thu Sep 8 11:08:31 2022] GET /compute/v2.1/servers/6ee8bb9d-7c69-4e0e-8d77-a17f7f4e2a3b/metadata/test2 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:08:31.886959 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e56ce442-3086-426d-a6b4-ef6ccbeed977 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:31.887641 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e56ce442-3086-426d-a6b4-ef6ccbeed977 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] [instance: ab59c99b-000f-4819-9f15-ae7dfe723568] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:31.902930 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e56ce442-3086-426d-a6b4-ef6ccbeed977 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:31.903589 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e56ce442-3086-426d-a6b4-ef6ccbeed977 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:31.903981 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b68a5db8-2a82-4c7d-8bc3-83823639d716 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:31.905085 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b68a5db8-2a82-4c7d-8bc3-83823639d716 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 3c9e4ea7-9f84-44a9-8288-27adaed61617] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:31.905324 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e56ce442-3086-426d-a6b4-ef6ccbeed977 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:31.906191 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e56ce442-3086-426d-a6b4-ef6ccbeed977 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:31.909562 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e56ce442-3086-426d-a6b4-ef6ccbeed977 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:31.910335 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e56ce442-3086-426d-a6b4-ef6ccbeed977 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:31.935688 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b68a5db8-2a82-4c7d-8bc3-83823639d716 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:31.936204 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b68a5db8-2a82-4c7d-8bc3-83823639d716 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:31.936653 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b68a5db8-2a82-4c7d-8bc3-83823639d716 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:31.937421 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b68a5db8-2a82-4c7d-8bc3-83823639d716 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:31.942958 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b68a5db8-2a82-4c7d-8bc3-83823639d716 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:31.943536 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b68a5db8-2a82-4c7d-8bc3-83823639d716 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:31.976170 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e56ce442-3086-426d-a6b4-ef6ccbeed977 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] [instance: ab59c99b-000f-4819-9f15-ae7dfe723568] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:08:32.201256 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e56ce442-3086-426d-a6b4-ef6ccbeed977 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ab59c99b-000f-4819-9f15-ae7dfe723568" status: 204 len: 0 microversion: 2.1 time: 0.319357 Sep 08 11:08:32.210444 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2597/5293] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:08:31 2022] DELETE /compute/v2.1/servers/ab59c99b-000f-4819-9f15-ae7dfe723568 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:08:32.234644 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c23ca148-c57f-4aee-9f24-dc8bfcee73e3 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:32.244036 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c23ca148-c57f-4aee-9f24-dc8bfcee73e3 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] [instance: ab59c99b-000f-4819-9f15-ae7dfe723568] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:32.275041 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c23ca148-c57f-4aee-9f24-dc8bfcee73e3 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:32.278300 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c23ca148-c57f-4aee-9f24-dc8bfcee73e3 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:32.279883 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c23ca148-c57f-4aee-9f24-dc8bfcee73e3 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:32.284255 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c23ca148-c57f-4aee-9f24-dc8bfcee73e3 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:32.287853 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c23ca148-c57f-4aee-9f24-dc8bfcee73e3 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:32.291990 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c23ca148-c57f-4aee-9f24-dc8bfcee73e3 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:32.364990 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b68a5db8-2a82-4c7d-8bc3-83823639d716 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:08:32.386809 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b68a5db8-2a82-4c7d-8bc3-83823639d716 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/3c9e4ea7-9f84-44a9-8288-27adaed61617" status: 200 len: 1287 microversion: 2.1 time: 0.484753 Sep 08 11:08:32.389884 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2697/5294] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:08:31 2022] GET /compute/v2.1/servers/3c9e4ea7-9f84-44a9-8288-27adaed61617 => generated 1287 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:08:32.922334 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c23ca148-c57f-4aee-9f24-dc8bfcee73e3 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e13cf235bb4721972b5c4a1c7b70b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e0611b471443e7a0a744fb4f049edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:08:32.935215 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c23ca148-c57f-4aee-9f24-dc8bfcee73e3 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] 10.222.0.27 "GET /compute/v2.1/servers/ab59c99b-000f-4819-9f15-ae7dfe723568" status: 200 len: 1527 microversion: 2.1 time: 0.720134 Sep 08 11:08:32.939410 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2598/5295] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:08:32 2022] GET /compute/v2.1/servers/ab59c99b-000f-4819-9f15-ae7dfe723568 => generated 1527 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:08:33.415464 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6baea56e-ab86-4f21-9bb7-1ab4083d8295 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:33.416067 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6baea56e-ab86-4f21-9bb7-1ab4083d8295 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 3c9e4ea7-9f84-44a9-8288-27adaed61617] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:33.427044 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6baea56e-ab86-4f21-9bb7-1ab4083d8295 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:33.427558 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6baea56e-ab86-4f21-9bb7-1ab4083d8295 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:33.427998 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6baea56e-ab86-4f21-9bb7-1ab4083d8295 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:33.428736 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6baea56e-ab86-4f21-9bb7-1ab4083d8295 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:33.429234 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6baea56e-ab86-4f21-9bb7-1ab4083d8295 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:33.438075 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6baea56e-ab86-4f21-9bb7-1ab4083d8295 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:33.966770 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-29a8ac42-df48-4145-9e5f-66906134bfec tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:33.967645 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-29a8ac42-df48-4145-9e5f-66906134bfec tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] [instance: ab59c99b-000f-4819-9f15-ae7dfe723568] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:33.980634 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-29a8ac42-df48-4145-9e5f-66906134bfec tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:33.988338 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-29a8ac42-df48-4145-9e5f-66906134bfec tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:33.991068 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-29a8ac42-df48-4145-9e5f-66906134bfec tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:33.992286 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-29a8ac42-df48-4145-9e5f-66906134bfec tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:33.993069 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-29a8ac42-df48-4145-9e5f-66906134bfec tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:33.996556 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-29a8ac42-df48-4145-9e5f-66906134bfec tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:34.088875 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:08:34.120200 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6baea56e-ab86-4f21-9bb7-1ab4083d8295 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:08:34.137165 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6baea56e-ab86-4f21-9bb7-1ab4083d8295 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/3c9e4ea7-9f84-44a9-8288-27adaed61617" status: 200 len: 1329 microversion: 2.1 time: 0.720839 Sep 08 11:08:34.139678 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2698/5296] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:08:33 2022] GET /compute/v2.1/servers/3c9e4ea7-9f84-44a9-8288-27adaed61617 => generated 1329 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:08:34.906106 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-29a8ac42-df48-4145-9e5f-66906134bfec tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e13cf235bb4721972b5c4a1c7b70b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e0611b471443e7a0a744fb4f049edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:08:34.915402 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-29a8ac42-df48-4145-9e5f-66906134bfec tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] 10.222.0.27 "GET /compute/v2.1/servers/ab59c99b-000f-4819-9f15-ae7dfe723568" status: 200 len: 1527 microversion: 2.1 time: 0.952540 Sep 08 11:08:34.917088 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2599/5297] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:08:33 2022] GET /compute/v2.1/servers/ab59c99b-000f-4819-9f15-ae7dfe723568 => generated 1527 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:08:35.164121 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-01dcf406-6372-4b34-a9ee-46c09d781f40 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:35.164744 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-01dcf406-6372-4b34-a9ee-46c09d781f40 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 3c9e4ea7-9f84-44a9-8288-27adaed61617] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:35.184638 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-01dcf406-6372-4b34-a9ee-46c09d781f40 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:35.185385 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-01dcf406-6372-4b34-a9ee-46c09d781f40 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:35.185995 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-01dcf406-6372-4b34-a9ee-46c09d781f40 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:35.190332 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-01dcf406-6372-4b34-a9ee-46c09d781f40 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:35.191140 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-01dcf406-6372-4b34-a9ee-46c09d781f40 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:35.191802 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-01dcf406-6372-4b34-a9ee-46c09d781f40 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:35.351352 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-ef2f2851-5e4d-4fec-bfd0-1162c1f07e66 req-dc27f5fb-611b-437f-adf9-6bc4d3aeafe5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c9e4ea7-9f84-44a9-8288-27adaed61617", "tag": "68006ba6-8dc6-4ece-8674-065415c10c64"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:08:35.411297 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ef2f2851-5e4d-4fec-bfd0-1162c1f07e66 req-dc27f5fb-611b-437f-adf9-6bc4d3aeafe5 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:35.413697 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ef2f2851-5e4d-4fec-bfd0-1162c1f07e66 req-dc27f5fb-611b-437f-adf9-6bc4d3aeafe5 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:35.414532 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ef2f2851-5e4d-4fec-bfd0-1162c1f07e66 req-dc27f5fb-611b-437f-adf9-6bc4d3aeafe5 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:35.454780 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-ef2f2851-5e4d-4fec-bfd0-1162c1f07e66 req-dc27f5fb-611b-437f-adf9-6bc4d3aeafe5 service nova] Creating event network-changed:68006ba6-8dc6-4ece-8674-065415c10c64 for instance 3c9e4ea7-9f84-44a9-8288-27adaed61617 on n-h2-850501-12 Sep 08 11:08:35.467067 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-ef2f2851-5e4d-4fec-bfd0-1162c1f07e66 req-dc27f5fb-611b-437f-adf9-6bc4d3aeafe5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120679 Sep 08 11:08:35.469072 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2600/5298] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:08:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:08:35.947121 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-51c49360-b910-4fbf-85fa-8f5c136c9c86 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:35.947841 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-51c49360-b910-4fbf-85fa-8f5c136c9c86 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] [instance: ab59c99b-000f-4819-9f15-ae7dfe723568] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:35.966902 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51c49360-b910-4fbf-85fa-8f5c136c9c86 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:35.967418 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51c49360-b910-4fbf-85fa-8f5c136c9c86 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:35.973663 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51c49360-b910-4fbf-85fa-8f5c136c9c86 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:35.976531 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51c49360-b910-4fbf-85fa-8f5c136c9c86 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:35.978110 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51c49360-b910-4fbf-85fa-8f5c136c9c86 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:35.980514 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51c49360-b910-4fbf-85fa-8f5c136c9c86 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:36.298959 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-51c49360-b910-4fbf-85fa-8f5c136c9c86 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e13cf235bb4721972b5c4a1c7b70b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e0611b471443e7a0a744fb4f049edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:08:36.316258 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-51c49360-b910-4fbf-85fa-8f5c136c9c86 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] 10.222.0.27 "GET /compute/v2.1/servers/ab59c99b-000f-4819-9f15-ae7dfe723568" status: 200 len: 1485 microversion: 2.1 time: 0.374027 Sep 08 11:08:36.341321 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2601/5299] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:08:35 2022] GET /compute/v2.1/servers/ab59c99b-000f-4819-9f15-ae7dfe723568 => generated 1485 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:08:36.406933 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:08:36.900782 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-d978ec7e-011f-4966-b619-afe74476178a req-4920593e-8dd5-4f14-8393-bc844d12a635 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab59c99b-000f-4819-9f15-ae7dfe723568", "name": "network-vif-deleted", "tag": "b5be12f3-e743-4f7d-b469-60774d88af26"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:08:36.966450 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d978ec7e-011f-4966-b619-afe74476178a req-4920593e-8dd5-4f14-8393-bc844d12a635 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:36.985440 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d978ec7e-011f-4966-b619-afe74476178a req-4920593e-8dd5-4f14-8393-bc844d12a635 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:36.985892 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d978ec7e-011f-4966-b619-afe74476178a req-4920593e-8dd5-4f14-8393-bc844d12a635 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:37.022105 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-d978ec7e-011f-4966-b619-afe74476178a req-4920593e-8dd5-4f14-8393-bc844d12a635 service nova] Creating event network-vif-deleted:b5be12f3-e743-4f7d-b469-60774d88af26 for instance ab59c99b-000f-4819-9f15-ae7dfe723568 on n-h1-850501-12 Sep 08 11:08:37.028025 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-d978ec7e-011f-4966-b619-afe74476178a req-4920593e-8dd5-4f14-8393-bc844d12a635 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131747 Sep 08 11:08:37.040596 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2602/5300] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:08:37.350714 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3d5ff96b-c551-4c9d-ac19-6e992d92f501 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:37.356652 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3d5ff96b-c551-4c9d-ac19-6e992d92f501 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] [instance: ab59c99b-000f-4819-9f15-ae7dfe723568] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:37.377099 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d5ff96b-c551-4c9d-ac19-6e992d92f501 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:37.381924 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d5ff96b-c551-4c9d-ac19-6e992d92f501 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:37.382445 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d5ff96b-c551-4c9d-ac19-6e992d92f501 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:37.393608 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d5ff96b-c551-4c9d-ac19-6e992d92f501 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:37.395469 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d5ff96b-c551-4c9d-ac19-6e992d92f501 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:37.396118 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d5ff96b-c551-4c9d-ac19-6e992d92f501 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:37.498993 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-01dcf406-6372-4b34-a9ee-46c09d781f40 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:08:37.507699 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-01dcf406-6372-4b34-a9ee-46c09d781f40 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/3c9e4ea7-9f84-44a9-8288-27adaed61617" status: 200 len: 1329 microversion: 2.1 time: 2.347597 Sep 08 11:08:37.508298 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2699/5301] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:08:35 2022] GET /compute/v2.1/servers/3c9e4ea7-9f84-44a9-8288-27adaed61617 => generated 1329 bytes in 2349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:08:37.536260 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d5ff96b-c551-4c9d-ac19-6e992d92f501 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:37.537674 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d5ff96b-c551-4c9d-ac19-6e992d92f501 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:37.538285 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d5ff96b-c551-4c9d-ac19-6e992d92f501 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:37.538896 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-3d5ff96b-c551-4c9d-ac19-6e992d92f501 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lazy-loading 'fault' on Instance uuid ab59c99b-000f-4819-9f15-ae7dfe723568 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:08:37.622622 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3d5ff96b-c551-4c9d-ac19-6e992d92f501 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e13cf235bb4721972b5c4a1c7b70b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e0611b471443e7a0a744fb4f049edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:08:37.632928 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3d5ff96b-c551-4c9d-ac19-6e992d92f501 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] 10.222.0.27 "GET /compute/v2.1/servers/ab59c99b-000f-4819-9f15-ae7dfe723568" status: 200 len: 1314 microversion: 2.1 time: 0.286583 Sep 08 11:08:37.634541 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2603/5302] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:08:37 2022] GET /compute/v2.1/servers/ab59c99b-000f-4819-9f15-ae7dfe723568 => generated 1314 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:08:38.555167 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-39587d69-73fe-415d-bebd-9e31ccdaed5b tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:38.561678 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-39587d69-73fe-415d-bebd-9e31ccdaed5b tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 3c9e4ea7-9f84-44a9-8288-27adaed61617] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:38.578016 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=12 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:08:38.600195 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-39587d69-73fe-415d-bebd-9e31ccdaed5b tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:38.600744 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-39587d69-73fe-415d-bebd-9e31ccdaed5b tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:38.617001 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-39587d69-73fe-415d-bebd-9e31ccdaed5b tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:38.618058 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-39587d69-73fe-415d-bebd-9e31ccdaed5b tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:38.618546 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-39587d69-73fe-415d-bebd-9e31ccdaed5b tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:38.620248 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-39587d69-73fe-415d-bebd-9e31ccdaed5b tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:38.665431 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-67e37e7f-ed14-4c02-80ab-f3c4c7a3ce12 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:38.666277 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-67e37e7f-ed14-4c02-80ab-f3c4c7a3ce12 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] [instance: ab59c99b-000f-4819-9f15-ae7dfe723568] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:38.720474 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67e37e7f-ed14-4c02-80ab-f3c4c7a3ce12 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:38.725608 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67e37e7f-ed14-4c02-80ab-f3c4c7a3ce12 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:38.728368 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67e37e7f-ed14-4c02-80ab-f3c4c7a3ce12 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:38.734119 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67e37e7f-ed14-4c02-80ab-f3c4c7a3ce12 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:38.739199 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67e37e7f-ed14-4c02-80ab-f3c4c7a3ce12 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:38.740076 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67e37e7f-ed14-4c02-80ab-f3c4c7a3ce12 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:38.799234 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-67e37e7f-ed14-4c02-80ab-f3c4c7a3ce12 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] HTTP exception thrown: Instance ab59c99b-000f-4819-9f15-ae7dfe723568 could not be found. Sep 08 11:08:38.817520 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-67e37e7f-ed14-4c02-80ab-f3c4c7a3ce12 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Request method failure captured: Sep 08 11:08:38.817520 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/ab59c99b-000f-4819-9f15-ae7dfe723568 HTTP/1.1 Sep 08 11:08:38.817520 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 11:08:38.817520 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 11:08:38.817520 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 11:08:38.817520 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 11:08:38.817520 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 11:08:38.817520 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 11:08:38.817520 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 11:08:38.817520 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 11:08:38.817520 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGc0KxWJxkq5jmIveEZbiA78IWcFXsEKEFotyEacAgZaeWCzt11mdItPIa0TAJHM50CTFsoxR4wFprG1ZyfmC9ap4ki4XUhmzuSY1D6QKGPlO-3aForscVujH5yINnKlSiXIjQTz0ERZSNPL0SrUuKtgYKkvlVFh-Rvk2RNi4bxoP2_U Sep 08 11:08:38.817520 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 11:08:38.817520 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 11:08:38.817520 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 11:08:38.817520 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 11:08:38.817520 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 11:08:38.817520 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 11:08:38.817520 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: c6e0611b471443e7a0a744fb4f049edf Sep 08 11:08:38.817520 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1337355060 Sep 08 11:08:38.817520 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 11:08:38.817520 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 11:08:38.817520 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c6e0611b471443e7a0a744fb4f049edf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c6e0611b471443e7a0a744fb4f049edf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c6e0611b471443e7a0a744fb4f049edf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c6e0611b471443e7a0a744fb4f049edf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:08:38.817520 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1337355060 Sep 08 11:08:38.817520 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: c6e0611b471443e7a0a744fb4f049edf Sep 08 11:08:38.817520 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1337355060 Sep 08 11:08:38.817520 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServerMetadataNegativeTestJSON-1337355060-project Sep 08 11:08:38.817520 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 11:08:38.817520 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 11:08:38.817520 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 63e13cf235bb4721972b5c4a1c7b70b1 Sep 08 11:08:38.817520 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1337355060-project Sep 08 11:08:38.817520 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 11:08:38.817520 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance ab59c99b-000f-4819-9f15-ae7dfe723568 could not be found. Sep 08 11:08:38.817520 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'ab59c99b-000f-4819-9f15-ae7dfe723568'} Sep 08 11:08:38.817520 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:08:38.817520 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:08:38.817520 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:08:38.817520 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:08:38.817520 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:08:38.817520 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:08:38.817520 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:08:38.817520 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:08:38.817520 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:08:38.817520 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:08:38.817520 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab59c99b-000f-4819-9f15-ae7dfe723568 could not be found. Sep 08 11:08:38.817520 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:08:38.817520 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:08:38.817520 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:08:38.817520 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:08:38.817520 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:08:38.817520 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:08:38.817520 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:08:38.817520 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:08:38.817520 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:08:38.817520 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:08:38.817520 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:08:38.817520 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:08:38.817520 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:08:38.817520 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:08:38.817520 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:08:38.817520 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:08:38.817520 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab59c99b-000f-4819-9f15-ae7dfe723568 could not be found. Sep 08 11:08:38.817520 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:08:38.817520 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:08:38.834356 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:08:38.834356 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:08:38.834356 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:08:38.834356 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:08:38.834356 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:08:38.834356 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:08:38.834356 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab59c99b-000f-4819-9f15-ae7dfe723568 could not be found. Sep 08 11:08:38.834356 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:08:38.857966 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-67e37e7f-ed14-4c02-80ab-f3c4c7a3ce12 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] Returning 404 to user: Instance ab59c99b-000f-4819-9f15-ae7dfe723568 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:08:38.882593 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-67e37e7f-ed14-4c02-80ab-f3c4c7a3ce12 tempest-ServerMetadataNegativeTestJSON-1337355060 tempest-ServerMetadataNegativeTestJSON-1337355060-project] 10.222.0.27 "GET /compute/v2.1/servers/ab59c99b-000f-4819-9f15-ae7dfe723568" status: 404 len: 111 microversion: 2.1 time: 0.220651 Sep 08 11:08:38.891450 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2604/5303] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:08:38 2022] GET /compute/v2.1/servers/ab59c99b-000f-4819-9f15-ae7dfe723568 => generated 111 bytes in 230 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:08:40.333802 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-39587d69-73fe-415d-bebd-9e31ccdaed5b tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:08:40.342804 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-39587d69-73fe-415d-bebd-9e31ccdaed5b tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/3c9e4ea7-9f84-44a9-8288-27adaed61617" status: 200 len: 1329 microversion: 2.1 time: 1.804592 Sep 08 11:08:40.378328 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2700/5304] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:08:38 2022] GET /compute/v2.1/servers/3c9e4ea7-9f84-44a9-8288-27adaed61617 => generated 1329 bytes in 1843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:08:41.394779 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0db15137-e41b-402a-8385-536dbf46b13c tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:41.397964 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0db15137-e41b-402a-8385-536dbf46b13c tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 3c9e4ea7-9f84-44a9-8288-27adaed61617] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:41.416177 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0db15137-e41b-402a-8385-536dbf46b13c tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:41.421690 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0db15137-e41b-402a-8385-536dbf46b13c tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:41.423194 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0db15137-e41b-402a-8385-536dbf46b13c tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:41.426140 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0db15137-e41b-402a-8385-536dbf46b13c tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:41.433306 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0db15137-e41b-402a-8385-536dbf46b13c tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:41.438886 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0db15137-e41b-402a-8385-536dbf46b13c tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:42.993131 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0db15137-e41b-402a-8385-536dbf46b13c tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:08:43.044002 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0db15137-e41b-402a-8385-536dbf46b13c tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/3c9e4ea7-9f84-44a9-8288-27adaed61617" status: 200 len: 1329 microversion: 2.1 time: 1.654336 Sep 08 11:08:43.071752 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2605/5305] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:08:41 2022] GET /compute/v2.1/servers/3c9e4ea7-9f84-44a9-8288-27adaed61617 => generated 1329 bytes in 1687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:08:44.073686 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-acb132a8-ee44-4893-ab7e-77ddc1375a0c tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:44.074313 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-acb132a8-ee44-4893-ab7e-77ddc1375a0c tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 3c9e4ea7-9f84-44a9-8288-27adaed61617] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:44.089542 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-acb132a8-ee44-4893-ab7e-77ddc1375a0c tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:44.092495 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-acb132a8-ee44-4893-ab7e-77ddc1375a0c tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:44.097495 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-acb132a8-ee44-4893-ab7e-77ddc1375a0c tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:44.098282 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-acb132a8-ee44-4893-ab7e-77ddc1375a0c tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:44.098735 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-acb132a8-ee44-4893-ab7e-77ddc1375a0c tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:44.099169 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-acb132a8-ee44-4893-ab7e-77ddc1375a0c tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:44.785396 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-acb132a8-ee44-4893-ab7e-77ddc1375a0c tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:08:44.800720 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-acb132a8-ee44-4893-ab7e-77ddc1375a0c tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/3c9e4ea7-9f84-44a9-8288-27adaed61617" status: 200 len: 1329 microversion: 2.1 time: 0.732711 Sep 08 11:08:44.821392 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2701/5306] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:08:44 2022] GET /compute/v2.1/servers/3c9e4ea7-9f84-44a9-8288-27adaed61617 => generated 1329 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:08:45.732353 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-67d95803-98eb-405c-86c8-34aa6a00c88b req-631d38ef-ed1d-4fcd-bef9-b8b414dfc208 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c9e4ea7-9f84-44a9-8288-27adaed61617", "name": "network-vif-plugged", "status": "completed", "tag": "68006ba6-8dc6-4ece-8674-065415c10c64"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:08:45.750215 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-67d95803-98eb-405c-86c8-34aa6a00c88b req-631d38ef-ed1d-4fcd-bef9-b8b414dfc208 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:45.756446 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-67d95803-98eb-405c-86c8-34aa6a00c88b req-631d38ef-ed1d-4fcd-bef9-b8b414dfc208 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:45.757115 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-67d95803-98eb-405c-86c8-34aa6a00c88b req-631d38ef-ed1d-4fcd-bef9-b8b414dfc208 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:45.786149 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-67d95803-98eb-405c-86c8-34aa6a00c88b req-631d38ef-ed1d-4fcd-bef9-b8b414dfc208 service nova] Creating event network-vif-plugged:68006ba6-8dc6-4ece-8674-065415c10c64 for instance 3c9e4ea7-9f84-44a9-8288-27adaed61617 on n-h2-850501-12 Sep 08 11:08:45.798053 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-67d95803-98eb-405c-86c8-34aa6a00c88b req-631d38ef-ed1d-4fcd-bef9-b8b414dfc208 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069390 Sep 08 11:08:45.811595 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2606/5307] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:08:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:08:45.847677 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4a8446f3-3b44-40c4-922f-09a2bac708e3 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:45.848306 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4a8446f3-3b44-40c4-922f-09a2bac708e3 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 3c9e4ea7-9f84-44a9-8288-27adaed61617] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:45.862197 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a8446f3-3b44-40c4-922f-09a2bac708e3 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:45.886523 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a8446f3-3b44-40c4-922f-09a2bac708e3 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:45.901104 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a8446f3-3b44-40c4-922f-09a2bac708e3 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:45.902100 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a8446f3-3b44-40c4-922f-09a2bac708e3 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:45.909395 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a8446f3-3b44-40c4-922f-09a2bac708e3 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:45.910197 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a8446f3-3b44-40c4-922f-09a2bac708e3 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:46.140542 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-34296956-0432-424f-ba54-fc9c5395a477 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-379043366", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "df77a721-ec3c-4dd0-9135-5ab61b9c07d1"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:08:46.243032 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-34296956-0432-424f-ba54-fc9c5395a477 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] validate_networks() for [('df77a721-ec3c-4dd0-9135-5ab61b9c07d1', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:08:46.621611 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4a8446f3-3b44-40c4-922f-09a2bac708e3 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:08:46.636434 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4a8446f3-3b44-40c4-922f-09a2bac708e3 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/3c9e4ea7-9f84-44a9-8288-27adaed61617" status: 200 len: 1329 microversion: 2.1 time: 0.797412 Sep 08 11:08:46.637294 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2702/5308] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:08:45 2022] GET /compute/v2.1/servers/3c9e4ea7-9f84-44a9-8288-27adaed61617 => generated 1329 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:08:47.667081 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-09355977-8b94-4c92-9b4c-5bb1e108980e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:47.668430 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-09355977-8b94-4c92-9b4c-5bb1e108980e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 3c9e4ea7-9f84-44a9-8288-27adaed61617] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:47.685226 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-09355977-8b94-4c92-9b4c-5bb1e108980e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:47.690952 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-09355977-8b94-4c92-9b4c-5bb1e108980e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:47.691624 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-09355977-8b94-4c92-9b4c-5bb1e108980e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:47.693117 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-09355977-8b94-4c92-9b4c-5bb1e108980e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:47.699615 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-09355977-8b94-4c92-9b4c-5bb1e108980e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:47.700264 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-09355977-8b94-4c92-9b4c-5bb1e108980e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:48.161074 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-34296956-0432-424f-ba54-fc9c5395a477 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:08:48.161534 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-34296956-0432-424f-ba54-fc9c5395a477 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:08:48.162034 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-34296956-0432-424f-ba54-fc9c5395a477 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:08:48.162383 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-34296956-0432-424f-ba54-fc9c5395a477 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:08:48.163818 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-34296956-0432-424f-ba54-fc9c5395a477 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:08:48.192058 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-34296956-0432-424f-ba54-fc9c5395a477 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:48.192566 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-34296956-0432-424f-ba54-fc9c5395a477 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:48.193015 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-34296956-0432-424f-ba54-fc9c5395a477 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:48.193786 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-34296956-0432-424f-ba54-fc9c5395a477 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:48.194251 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-34296956-0432-424f-ba54-fc9c5395a477 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:48.194685 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-34296956-0432-424f-ba54-fc9c5395a477 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:48.222059 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-09355977-8b94-4c92-9b4c-5bb1e108980e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:08:48.246252 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-09355977-8b94-4c92-9b4c-5bb1e108980e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/3c9e4ea7-9f84-44a9-8288-27adaed61617" status: 200 len: 1329 microversion: 2.1 time: 0.582822 Sep 08 11:08:48.253047 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2703/5309] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:08:47 2022] GET /compute/v2.1/servers/3c9e4ea7-9f84-44a9-8288-27adaed61617 => generated 1329 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:08:48.324478 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-34296956-0432-424f-ba54-fc9c5395a477 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Getting quotas for project 24e29f32d2ac4800b9b767f9e1b16526. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:08:48.334334 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-34296956-0432-424f-ba54-fc9c5395a477 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Getting quotas for user 6618b7ad8ff146dfbd892e3e35c2691f and project 24e29f32d2ac4800b9b767f9e1b16526. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:08:48.370925 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-34296956-0432-424f-ba54-fc9c5395a477 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:08:48.373834 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-34296956-0432-424f-ba54-fc9c5395a477 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] [instance: 5b547b31-4774-4c3b-a092-f10d890d57e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:08:48.529521 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-34296956-0432-424f-ba54-fc9c5395a477 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.393000 Sep 08 11:08:48.530137 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2607/5310] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 11:08:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 2395 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:08:48.544142 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-23ff934e-858a-4083-8cf8-f1b0dbb4ca67 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:48.544856 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-23ff934e-858a-4083-8cf8-f1b0dbb4ca67 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] [instance: 5b547b31-4774-4c3b-a092-f10d890d57e6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:48.662970 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-23ff934e-858a-4083-8cf8-f1b0dbb4ca67 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6618b7ad8ff146dfbd892e3e35c2691f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e29f32d2ac4800b9b767f9e1b16526', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:08:48.670996 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-23ff934e-858a-4083-8cf8-f1b0dbb4ca67 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] 10.222.0.27 "GET /compute/v2.1/servers/5b547b31-4774-4c3b-a092-f10d890d57e6" status: 200 len: 1218 microversion: 2.1 time: 0.131526 Sep 08 11:08:48.677592 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2704/5311] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:08:48 2022] GET /compute/v2.1/servers/5b547b31-4774-4c3b-a092-f10d890d57e6 => generated 1218 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:08:49.284670 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-81ced15d-1924-4a2f-b9e0-f5f58f1d1973 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:49.285938 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-81ced15d-1924-4a2f-b9e0-f5f58f1d1973 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 3c9e4ea7-9f84-44a9-8288-27adaed61617] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:49.323488 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81ced15d-1924-4a2f-b9e0-f5f58f1d1973 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:49.339885 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81ced15d-1924-4a2f-b9e0-f5f58f1d1973 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:49.341577 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81ced15d-1924-4a2f-b9e0-f5f58f1d1973 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:49.350426 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81ced15d-1924-4a2f-b9e0-f5f58f1d1973 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:49.351489 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81ced15d-1924-4a2f-b9e0-f5f58f1d1973 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:49.354002 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81ced15d-1924-4a2f-b9e0-f5f58f1d1973 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:49.697786 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5566e210-771f-49f4-91ec-ac5f7a0ec6e4 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:49.699155 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5566e210-771f-49f4-91ec-ac5f7a0ec6e4 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] [instance: 5b547b31-4774-4c3b-a092-f10d890d57e6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:49.737006 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5566e210-771f-49f4-91ec-ac5f7a0ec6e4 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:49.740867 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5566e210-771f-49f4-91ec-ac5f7a0ec6e4 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:49.741989 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5566e210-771f-49f4-91ec-ac5f7a0ec6e4 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:49.743186 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5566e210-771f-49f4-91ec-ac5f7a0ec6e4 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:49.743886 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5566e210-771f-49f4-91ec-ac5f7a0ec6e4 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:49.744504 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5566e210-771f-49f4-91ec-ac5f7a0ec6e4 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:49.934434 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5566e210-771f-49f4-91ec-ac5f7a0ec6e4 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6618b7ad8ff146dfbd892e3e35c2691f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e29f32d2ac4800b9b767f9e1b16526', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:08:49.956320 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5566e210-771f-49f4-91ec-ac5f7a0ec6e4 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] 10.222.0.27 "GET /compute/v2.1/servers/5b547b31-4774-4c3b-a092-f10d890d57e6" status: 200 len: 1222 microversion: 2.1 time: 0.260636 Sep 08 11:08:49.957716 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2705/5312] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:08:49 2022] GET /compute/v2.1/servers/5b547b31-4774-4c3b-a092-f10d890d57e6 => generated 1222 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:08:50.129278 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-81ced15d-1924-4a2f-b9e0-f5f58f1d1973 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:08:50.137236 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-81ced15d-1924-4a2f-b9e0-f5f58f1d1973 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/3c9e4ea7-9f84-44a9-8288-27adaed61617" status: 200 len: 1510 microversion: 2.1 time: 0.857099 Sep 08 11:08:50.140066 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2608/5313] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:08:49 2022] GET /compute/v2.1/servers/3c9e4ea7-9f84-44a9-8288-27adaed61617 => generated 1510 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:08:50.168305 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5b683e37-4983-4afb-a520-147bf2c4bb88 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:50.169264 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5b683e37-4983-4afb-a520-147bf2c4bb88 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 3c9e4ea7-9f84-44a9-8288-27adaed61617] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:50.184035 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5b683e37-4983-4afb-a520-147bf2c4bb88 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:50.184842 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5b683e37-4983-4afb-a520-147bf2c4bb88 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:50.185514 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5b683e37-4983-4afb-a520-147bf2c4bb88 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:50.192816 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5b683e37-4983-4afb-a520-147bf2c4bb88 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:50.193477 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5b683e37-4983-4afb-a520-147bf2c4bb88 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:50.194118 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5b683e37-4983-4afb-a520-147bf2c4bb88 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:50.979865 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-766050ca-d470-45f6-8810-182e3b3feb16 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:50.980490 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-766050ca-d470-45f6-8810-182e3b3feb16 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] [instance: 5b547b31-4774-4c3b-a092-f10d890d57e6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:51.004613 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-766050ca-d470-45f6-8810-182e3b3feb16 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:51.010091 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-766050ca-d470-45f6-8810-182e3b3feb16 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:51.010561 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-766050ca-d470-45f6-8810-182e3b3feb16 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:51.011327 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-766050ca-d470-45f6-8810-182e3b3feb16 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:51.011803 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-766050ca-d470-45f6-8810-182e3b3feb16 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:51.013623 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-766050ca-d470-45f6-8810-182e3b3feb16 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:51.258259 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-766050ca-d470-45f6-8810-182e3b3feb16 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6618b7ad8ff146dfbd892e3e35c2691f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e29f32d2ac4800b9b767f9e1b16526', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:08:51.279642 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-766050ca-d470-45f6-8810-182e3b3feb16 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] 10.222.0.27 "GET /compute/v2.1/servers/5b547b31-4774-4c3b-a092-f10d890d57e6" status: 200 len: 1288 microversion: 2.1 time: 0.303597 Sep 08 11:08:51.290976 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2609/5314] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:08:50 2022] GET /compute/v2.1/servers/5b547b31-4774-4c3b-a092-f10d890d57e6 => generated 1288 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:08:51.402111 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5b683e37-4983-4afb-a520-147bf2c4bb88 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:08:51.415407 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5b683e37-4983-4afb-a520-147bf2c4bb88 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/3c9e4ea7-9f84-44a9-8288-27adaed61617" status: 200 len: 1510 microversion: 2.1 time: 1.251142 Sep 08 11:08:51.416278 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2706/5315] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:08:50 2022] GET /compute/v2.1/servers/3c9e4ea7-9f84-44a9-8288-27adaed61617 => generated 1510 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:08:51.440654 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fb95cece-517a-4f05-a544-bea9177fb35a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:51.441376 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fb95cece-517a-4f05-a544-bea9177fb35a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 3c9e4ea7-9f84-44a9-8288-27adaed61617] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:51.464995 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb95cece-517a-4f05-a544-bea9177fb35a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:51.468007 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb95cece-517a-4f05-a544-bea9177fb35a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:51.469832 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb95cece-517a-4f05-a544-bea9177fb35a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:51.470778 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb95cece-517a-4f05-a544-bea9177fb35a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:51.471438 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb95cece-517a-4f05-a544-bea9177fb35a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:51.472517 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb95cece-517a-4f05-a544-bea9177fb35a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:51.535704 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fb95cece-517a-4f05-a544-bea9177fb35a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 3c9e4ea7-9f84-44a9-8288-27adaed61617] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:08:51.784540 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fb95cece-517a-4f05-a544-bea9177fb35a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3c9e4ea7-9f84-44a9-8288-27adaed61617" status: 204 len: 0 microversion: 2.1 time: 0.346117 Sep 08 11:08:51.789605 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2610/5316] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:08:51 2022] DELETE /compute/v2.1/servers/3c9e4ea7-9f84-44a9-8288-27adaed61617 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:08:51.795641 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bd2f685e-631f-4670-b4bf-f21a873f2072 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:51.796422 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bd2f685e-631f-4670-b4bf-f21a873f2072 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 3c9e4ea7-9f84-44a9-8288-27adaed61617] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:51.812341 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bd2f685e-631f-4670-b4bf-f21a873f2072 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:51.817082 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bd2f685e-631f-4670-b4bf-f21a873f2072 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:51.817822 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bd2f685e-631f-4670-b4bf-f21a873f2072 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:51.819326 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bd2f685e-631f-4670-b4bf-f21a873f2072 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:51.825871 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bd2f685e-631f-4670-b4bf-f21a873f2072 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:51.827356 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bd2f685e-631f-4670-b4bf-f21a873f2072 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:52.322826 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c067fd8b-1e46-49b7-ba00-a9481274ec7b tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:52.324105 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c067fd8b-1e46-49b7-ba00-a9481274ec7b tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] [instance: 5b547b31-4774-4c3b-a092-f10d890d57e6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:52.355707 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c067fd8b-1e46-49b7-ba00-a9481274ec7b tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:52.364774 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c067fd8b-1e46-49b7-ba00-a9481274ec7b tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:52.365587 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c067fd8b-1e46-49b7-ba00-a9481274ec7b tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:52.368910 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c067fd8b-1e46-49b7-ba00-a9481274ec7b tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:52.369605 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c067fd8b-1e46-49b7-ba00-a9481274ec7b tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:52.372241 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c067fd8b-1e46-49b7-ba00-a9481274ec7b tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:52.449404 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-bd2f685e-631f-4670-b4bf-f21a873f2072 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:08:52.460690 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bd2f685e-631f-4670-b4bf-f21a873f2072 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/3c9e4ea7-9f84-44a9-8288-27adaed61617" status: 200 len: 1516 microversion: 2.1 time: 0.669413 Sep 08 11:08:52.461906 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2707/5317] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:08:51 2022] GET /compute/v2.1/servers/3c9e4ea7-9f84-44a9-8288-27adaed61617 => generated 1516 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:08:52.618105 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c067fd8b-1e46-49b7-ba00-a9481274ec7b tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6618b7ad8ff146dfbd892e3e35c2691f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e29f32d2ac4800b9b767f9e1b16526', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:08:52.630288 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c067fd8b-1e46-49b7-ba00-a9481274ec7b tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] 10.222.0.27 "GET /compute/v2.1/servers/5b547b31-4774-4c3b-a092-f10d890d57e6" status: 200 len: 1276 microversion: 2.1 time: 0.316316 Sep 08 11:08:52.633440 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2611/5318] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:08:52 2022] GET /compute/v2.1/servers/5b547b31-4774-4c3b-a092-f10d890d57e6 => generated 1276 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:08:53.489553 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6d08138c-b72e-4422-bfb7-e60a2887f459 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:53.490780 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6d08138c-b72e-4422-bfb7-e60a2887f459 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 3c9e4ea7-9f84-44a9-8288-27adaed61617] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:53.506671 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6d08138c-b72e-4422-bfb7-e60a2887f459 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:53.508175 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6d08138c-b72e-4422-bfb7-e60a2887f459 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:53.511708 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6d08138c-b72e-4422-bfb7-e60a2887f459 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:53.524339 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6d08138c-b72e-4422-bfb7-e60a2887f459 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:53.525139 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6d08138c-b72e-4422-bfb7-e60a2887f459 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:53.528106 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6d08138c-b72e-4422-bfb7-e60a2887f459 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:53.658134 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5856add4-49f6-45d1-aa38-a6ec51776299 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:53.658810 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5856add4-49f6-45d1-aa38-a6ec51776299 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] [instance: 5b547b31-4774-4c3b-a092-f10d890d57e6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:53.697964 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5856add4-49f6-45d1-aa38-a6ec51776299 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:53.701466 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5856add4-49f6-45d1-aa38-a6ec51776299 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:53.707489 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5856add4-49f6-45d1-aa38-a6ec51776299 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:53.708210 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5856add4-49f6-45d1-aa38-a6ec51776299 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:53.715701 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5856add4-49f6-45d1-aa38-a6ec51776299 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:53.717720 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5856add4-49f6-45d1-aa38-a6ec51776299 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:54.398771 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5856add4-49f6-45d1-aa38-a6ec51776299 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6618b7ad8ff146dfbd892e3e35c2691f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e29f32d2ac4800b9b767f9e1b16526', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:08:54.425281 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5856add4-49f6-45d1-aa38-a6ec51776299 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] 10.222.0.27 "GET /compute/v2.1/servers/5b547b31-4774-4c3b-a092-f10d890d57e6" status: 200 len: 1318 microversion: 2.1 time: 0.756063 Sep 08 11:08:54.425987 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2612/5319] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:08:53 2022] GET /compute/v2.1/servers/5b547b31-4774-4c3b-a092-f10d890d57e6 => generated 1318 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:08:54.603496 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6d08138c-b72e-4422-bfb7-e60a2887f459 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:08:54.614620 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6d08138c-b72e-4422-bfb7-e60a2887f459 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/3c9e4ea7-9f84-44a9-8288-27adaed61617" status: 200 len: 1516 microversion: 2.1 time: 1.129317 Sep 08 11:08:54.622544 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2708/5320] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:08:53 2022] GET /compute/v2.1/servers/3c9e4ea7-9f84-44a9-8288-27adaed61617 => generated 1516 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:08:55.451378 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9b4e0a65-63f6-4f94-93fe-d9ea77c9e501 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:55.452007 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9b4e0a65-63f6-4f94-93fe-d9ea77c9e501 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] [instance: 5b547b31-4774-4c3b-a092-f10d890d57e6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:55.481314 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9b4e0a65-63f6-4f94-93fe-d9ea77c9e501 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:55.481840 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9b4e0a65-63f6-4f94-93fe-d9ea77c9e501 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:55.482260 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9b4e0a65-63f6-4f94-93fe-d9ea77c9e501 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:55.482986 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9b4e0a65-63f6-4f94-93fe-d9ea77c9e501 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:55.483448 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9b4e0a65-63f6-4f94-93fe-d9ea77c9e501 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:55.483881 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9b4e0a65-63f6-4f94-93fe-d9ea77c9e501 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:55.640989 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c7eb72a4-39f5-4bfc-89e9-41ea417bc634 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:55.641649 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c7eb72a4-39f5-4bfc-89e9-41ea417bc634 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 3c9e4ea7-9f84-44a9-8288-27adaed61617] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:55.644474 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:08:55.656813 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c7eb72a4-39f5-4bfc-89e9-41ea417bc634 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:55.662434 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c7eb72a4-39f5-4bfc-89e9-41ea417bc634 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:55.676662 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c7eb72a4-39f5-4bfc-89e9-41ea417bc634 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:55.682194 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c7eb72a4-39f5-4bfc-89e9-41ea417bc634 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:55.682905 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c7eb72a4-39f5-4bfc-89e9-41ea417bc634 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:55.683785 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c7eb72a4-39f5-4bfc-89e9-41ea417bc634 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:56.018075 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c7eb72a4-39f5-4bfc-89e9-41ea417bc634 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:08:56.032075 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c7eb72a4-39f5-4bfc-89e9-41ea417bc634 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/3c9e4ea7-9f84-44a9-8288-27adaed61617" status: 200 len: 1314 microversion: 2.1 time: 0.395417 Sep 08 11:08:56.057784 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2709/5321] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:08:55 2022] GET /compute/v2.1/servers/3c9e4ea7-9f84-44a9-8288-27adaed61617 => generated 1314 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:08:56.064101 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-2420a14f-1fe9-49b7-9484-3c430d86e7c6 req-e9b6230a-e7ad-4202-809b-1da010441138 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c9e4ea7-9f84-44a9-8288-27adaed61617", "name": "network-vif-deleted", "tag": "68006ba6-8dc6-4ece-8674-065415c10c64"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:08:56.091341 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9b4e0a65-63f6-4f94-93fe-d9ea77c9e501 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6618b7ad8ff146dfbd892e3e35c2691f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e29f32d2ac4800b9b767f9e1b16526', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:08:56.095567 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-2420a14f-1fe9-49b7-9484-3c430d86e7c6 req-e9b6230a-e7ad-4202-809b-1da010441138 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:56.096276 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-2420a14f-1fe9-49b7-9484-3c430d86e7c6 req-e9b6230a-e7ad-4202-809b-1da010441138 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:56.096876 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-2420a14f-1fe9-49b7-9484-3c430d86e7c6 req-e9b6230a-e7ad-4202-809b-1da010441138 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:56.100492 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9b4e0a65-63f6-4f94-93fe-d9ea77c9e501 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] 10.222.0.27 "GET /compute/v2.1/servers/5b547b31-4774-4c3b-a092-f10d890d57e6" status: 200 len: 1318 microversion: 2.1 time: 0.652895 Sep 08 11:08:56.108358 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2613/5322] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:08:55 2022] GET /compute/v2.1/servers/5b547b31-4774-4c3b-a092-f10d890d57e6 => generated 1318 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:08:56.131583 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-2420a14f-1fe9-49b7-9484-3c430d86e7c6 req-e9b6230a-e7ad-4202-809b-1da010441138 service nova] Creating event network-vif-deleted:68006ba6-8dc6-4ece-8674-065415c10c64 for instance 3c9e4ea7-9f84-44a9-8288-27adaed61617 on n-h2-850501-12 Sep 08 11:08:56.139883 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-2420a14f-1fe9-49b7-9484-3c430d86e7c6 req-e9b6230a-e7ad-4202-809b-1da010441138 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079232 Sep 08 11:08:56.145300 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2710/5323] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:08:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:08:57.066304 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4fd19f3b-0828-4458-9b19-1ebab31f7c64 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:57.069500 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4fd19f3b-0828-4458-9b19-1ebab31f7c64 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 3c9e4ea7-9f84-44a9-8288-27adaed61617] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:57.072215 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:08:57.092669 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4fd19f3b-0828-4458-9b19-1ebab31f7c64 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:57.093213 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4fd19f3b-0828-4458-9b19-1ebab31f7c64 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:57.094490 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4fd19f3b-0828-4458-9b19-1ebab31f7c64 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:57.095478 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4fd19f3b-0828-4458-9b19-1ebab31f7c64 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:57.095946 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4fd19f3b-0828-4458-9b19-1ebab31f7c64 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:57.096373 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4fd19f3b-0828-4458-9b19-1ebab31f7c64 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:57.132739 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-64265ed0-e1d9-4c9c-a7dc-d03f1abc75f2 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:57.133492 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-64265ed0-e1d9-4c9c-a7dc-d03f1abc75f2 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] [instance: 5b547b31-4774-4c3b-a092-f10d890d57e6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:57.140644 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-4fd19f3b-0828-4458-9b19-1ebab31f7c64 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] HTTP exception thrown: Instance 3c9e4ea7-9f84-44a9-8288-27adaed61617 could not be found. Sep 08 11:08:57.143008 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4fd19f3b-0828-4458-9b19-1ebab31f7c64 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Request method failure captured: Sep 08 11:08:57.143008 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/3c9e4ea7-9f84-44a9-8288-27adaed61617 HTTP/1.1 Sep 08 11:08:57.143008 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 11:08:57.143008 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 11:08:57.143008 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 11:08:57.143008 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 11:08:57.143008 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 11:08:57.143008 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 11:08:57.143008 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 11:08:57.143008 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 11:08:57.143008 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGczsmQNk4U50BxzpgES3MzOpQCXZXSfv8U0fcthNptdjh-xj4_PXNp1cjGhvwh0ftE8negXuLuWJgSY_-2MLUgv_DNMLspYk9lV1lwtSgINsi9nLe-7tZYJuQnQiEJ_Nrc9KtaPntdIqDspehXXUE-x22uN3GKjXVnYgVPtfdxa4_cE Sep 08 11:08:57.143008 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 11:08:57.143008 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 11:08:57.143008 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 11:08:57.143008 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 11:08:57.143008 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 11:08:57.143008 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 11:08:57.143008 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 7868787bfea94355a5d5971bab0d5ed4 Sep 08 11:08:57.143008 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersTestJSON-1882931607 Sep 08 11:08:57.143008 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 11:08:57.143008 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 11:08:57.143008 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:08:57.143008 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServersTestJSON-1882931607 Sep 08 11:08:57.143008 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 7868787bfea94355a5d5971bab0d5ed4 Sep 08 11:08:57.143008 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersTestJSON-1882931607 Sep 08 11:08:57.143008 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServersTestJSON-1882931607-project Sep 08 11:08:57.143008 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 11:08:57.143008 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 11:08:57.143008 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 5193272e9ab24845aff53982dbe2c6f0 Sep 08 11:08:57.143008 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServersTestJSON-1882931607-project Sep 08 11:08:57.143008 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 11:08:57.143008 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 3c9e4ea7-9f84-44a9-8288-27adaed61617 could not be found. Sep 08 11:08:57.143008 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '3c9e4ea7-9f84-44a9-8288-27adaed61617'} Sep 08 11:08:57.143008 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:08:57.143008 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:08:57.143008 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:08:57.143008 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:08:57.143008 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:08:57.143008 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:08:57.143008 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:08:57.143008 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:08:57.143008 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:08:57.143008 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:08:57.143008 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c9e4ea7-9f84-44a9-8288-27adaed61617 could not be found. Sep 08 11:08:57.143008 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:08:57.143008 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:08:57.143008 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:08:57.143008 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:08:57.143008 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:08:57.143008 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:08:57.143008 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:08:57.143008 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:08:57.143008 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:08:57.143008 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:08:57.143008 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:08:57.143008 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:08:57.143008 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:08:57.143008 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:08:57.143008 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:08:57.143008 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:08:57.143008 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c9e4ea7-9f84-44a9-8288-27adaed61617 could not be found. Sep 08 11:08:57.143008 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:08:57.143008 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:08:57.143008 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:08:57.147978 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:08:57.147978 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:08:57.147978 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:08:57.147978 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:08:57.147978 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:08:57.147978 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c9e4ea7-9f84-44a9-8288-27adaed61617 could not be found. Sep 08 11:08:57.147978 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:08:57.148494 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64265ed0-e1d9-4c9c-a7dc-d03f1abc75f2 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:57.148494 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64265ed0-e1d9-4c9c-a7dc-d03f1abc75f2 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:57.148494 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64265ed0-e1d9-4c9c-a7dc-d03f1abc75f2 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:57.148494 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64265ed0-e1d9-4c9c-a7dc-d03f1abc75f2 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:57.148494 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64265ed0-e1d9-4c9c-a7dc-d03f1abc75f2 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:57.148913 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64265ed0-e1d9-4c9c-a7dc-d03f1abc75f2 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:57.149710 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4fd19f3b-0828-4458-9b19-1ebab31f7c64 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Returning 404 to user: Instance 3c9e4ea7-9f84-44a9-8288-27adaed61617 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:08:57.150754 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4fd19f3b-0828-4458-9b19-1ebab31f7c64 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/3c9e4ea7-9f84-44a9-8288-27adaed61617" status: 404 len: 111 microversion: 2.1 time: 0.095441 Sep 08 11:08:57.151491 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2614/5324] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:08:57 2022] GET /compute/v2.1/servers/3c9e4ea7-9f84-44a9-8288-27adaed61617 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:08:57.162494 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6747c760-7c87-4649-99cd-a6261fd3d0c1 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '.version_select at 0x7f68e4ff9820>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:57.182592 n-d-850501-12 devstack@n-api.service[128862]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6747c760-7c87-4649-99cd-a6261fd3d0c1 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [b0c801de-0373-4c4c-89db-ae41eb7b49ab] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 08 11:08:57.817539 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-64265ed0-e1d9-4c9c-a7dc-d03f1abc75f2 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6618b7ad8ff146dfbd892e3e35c2691f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e29f32d2ac4800b9b767f9e1b16526', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:08:57.829565 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-64265ed0-e1d9-4c9c-a7dc-d03f1abc75f2 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] 10.222.0.27 "GET /compute/v2.1/servers/5b547b31-4774-4c3b-a092-f10d890d57e6" status: 200 len: 1318 microversion: 2.1 time: 0.701785 Sep 08 11:08:57.846472 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2711/5325] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:08:57 2022] GET /compute/v2.1/servers/5b547b31-4774-4c3b-a092-f10d890d57e6 => generated 1318 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:08:58.195109 n-d-850501-12 devstack@n-api.service[128862]: INFO oslo.messaging._drivers.impl_rabbit [None req-6747c760-7c87-4649-99cd-a6261fd3d0c1 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [b0c801de-0373-4c4c-89db-ae41eb7b49ab] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 44540. Sep 08 11:08:58.239253 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6747c760-7c87-4649-99cd-a6261fd3d0c1 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-key-1259222347" status: 202 len: 0 microversion: 2.1 time: 1.080262 Sep 08 11:08:58.253877 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2615/5326] 10.222.0.27 () {58 vars in 1209 bytes} [Thu Sep 8 11:08:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1259222347 => generated 0 bytes in 1096 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:08:58.528129 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c62c9f5c-4bb2-4735-9080-c8d22dc08218 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1464221198", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "20951261-edda-4da9-a3e2-8f222023ad9d"}]}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:08:58.616844 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-c62c9f5c-4bb2-4735-9080-c8d22dc08218 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] validate_networks() for [('20951261-edda-4da9-a3e2-8f222023ad9d', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:08:58.670494 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:08:58.855785 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-43d3eed5-7ec9-4567-aeaa-c66bb415de89 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:58.856720 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-43d3eed5-7ec9-4567-aeaa-c66bb415de89 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] [instance: 5b547b31-4774-4c3b-a092-f10d890d57e6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:58.859906 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:08:58.863080 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:08:58.885177 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-43d3eed5-7ec9-4567-aeaa-c66bb415de89 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:58.888919 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-43d3eed5-7ec9-4567-aeaa-c66bb415de89 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:58.889846 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-43d3eed5-7ec9-4567-aeaa-c66bb415de89 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:58.894664 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-43d3eed5-7ec9-4567-aeaa-c66bb415de89 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:58.897687 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-43d3eed5-7ec9-4567-aeaa-c66bb415de89 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:58.900146 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-43d3eed5-7ec9-4567-aeaa-c66bb415de89 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:59.599317 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-43d3eed5-7ec9-4567-aeaa-c66bb415de89 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6618b7ad8ff146dfbd892e3e35c2691f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e29f32d2ac4800b9b767f9e1b16526', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:08:59.614478 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-43d3eed5-7ec9-4567-aeaa-c66bb415de89 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] 10.222.0.27 "GET /compute/v2.1/servers/5b547b31-4774-4c3b-a092-f10d890d57e6" status: 200 len: 1318 microversion: 2.1 time: 0.762980 Sep 08 11:08:59.623417 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2616/5327] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:08:58 2022] GET /compute/v2.1/servers/5b547b31-4774-4c3b-a092-f10d890d57e6 => generated 1318 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:08:59.633239 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-ad9cca37-d4d2-45bb-b23b-1d701c68ab28 req-bbbfbe19-6a29-412a-9330-6a24af07d1f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b547b31-4774-4c3b-a092-f10d890d57e6", "tag": "8d41fbbc-7908-46e9-9e8d-d5103d2c3dc2"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:08:59.660003 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ad9cca37-d4d2-45bb-b23b-1d701c68ab28 req-bbbfbe19-6a29-412a-9330-6a24af07d1f5 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:59.661583 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ad9cca37-d4d2-45bb-b23b-1d701c68ab28 req-bbbfbe19-6a29-412a-9330-6a24af07d1f5 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:59.662207 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ad9cca37-d4d2-45bb-b23b-1d701c68ab28 req-bbbfbe19-6a29-412a-9330-6a24af07d1f5 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:59.688144 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-ad9cca37-d4d2-45bb-b23b-1d701c68ab28 req-bbbfbe19-6a29-412a-9330-6a24af07d1f5 service nova] Creating event network-changed:8d41fbbc-7908-46e9-9e8d-d5103d2c3dc2 for instance 5b547b31-4774-4c3b-a092-f10d890d57e6 on n-h1-850501-12 Sep 08 11:08:59.698539 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-ad9cca37-d4d2-45bb-b23b-1d701c68ab28 req-bbbfbe19-6a29-412a-9330-6a24af07d1f5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073515 Sep 08 11:08:59.699172 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2617/5328] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:08:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:09:00.647063 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fd34075f-0212-48c2-b8e4-d9383c63abd3 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:00.648606 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fd34075f-0212-48c2-b8e4-d9383c63abd3 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] [instance: 5b547b31-4774-4c3b-a092-f10d890d57e6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:00.656464 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd34075f-0212-48c2-b8e4-d9383c63abd3 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:00.657365 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd34075f-0212-48c2-b8e4-d9383c63abd3 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:00.657990 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd34075f-0212-48c2-b8e4-d9383c63abd3 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:00.658994 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd34075f-0212-48c2-b8e4-d9383c63abd3 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:00.659688 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd34075f-0212-48c2-b8e4-d9383c63abd3 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:00.660322 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd34075f-0212-48c2-b8e4-d9383c63abd3 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:01.104180 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fd34075f-0212-48c2-b8e4-d9383c63abd3 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6618b7ad8ff146dfbd892e3e35c2691f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e29f32d2ac4800b9b767f9e1b16526', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:01.113551 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fd34075f-0212-48c2-b8e4-d9383c63abd3 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] 10.222.0.27 "GET /compute/v2.1/servers/5b547b31-4774-4c3b-a092-f10d890d57e6" status: 200 len: 1318 microversion: 2.1 time: 0.471830 Sep 08 11:09:01.114686 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2618/5329] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:00 2022] GET /compute/v2.1/servers/5b547b31-4774-4c3b-a092-f10d890d57e6 => generated 1318 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:09:01.116342 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-c62c9f5c-4bb2-4735-9080-c8d22dc08218 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:09:01.117053 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-c62c9f5c-4bb2-4735-9080-c8d22dc08218 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:09:01.118203 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-c62c9f5c-4bb2-4735-9080-c8d22dc08218 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:09:01.118723 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-c62c9f5c-4bb2-4735-9080-c8d22dc08218 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:09:01.119251 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-c62c9f5c-4bb2-4735-9080-c8d22dc08218 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:09:01.145181 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c62c9f5c-4bb2-4735-9080-c8d22dc08218 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:01.146464 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c62c9f5c-4bb2-4735-9080-c8d22dc08218 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:01.149588 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c62c9f5c-4bb2-4735-9080-c8d22dc08218 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:01.150857 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c62c9f5c-4bb2-4735-9080-c8d22dc08218 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:01.152743 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c62c9f5c-4bb2-4735-9080-c8d22dc08218 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:01.153240 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c62c9f5c-4bb2-4735-9080-c8d22dc08218 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:01.179379 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=92 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:09:01.208268 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-c62c9f5c-4bb2-4735-9080-c8d22dc08218 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Getting quotas for project 7868787bfea94355a5d5971bab0d5ed4. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:09:01.242612 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-c62c9f5c-4bb2-4735-9080-c8d22dc08218 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Getting quotas for user 5193272e9ab24845aff53982dbe2c6f0 and project 7868787bfea94355a5d5971bab0d5ed4. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:09:01.285620 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c62c9f5c-4bb2-4735-9080-c8d22dc08218 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:09:01.288516 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c62c9f5c-4bb2-4735-9080-c8d22dc08218 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: c8060dc4-1634-4142-a4fe-35ee4ffc74f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:09:01.388170 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c62c9f5c-4bb2-4735-9080-c8d22dc08218 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.863928 Sep 08 11:09:01.389389 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2712/5330] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 11:08:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 2866 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:09:01.400747 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7216c752-e2c3-495f-b1d9-97ed646d68a1 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:01.405346 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7216c752-e2c3-495f-b1d9-97ed646d68a1 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: c8060dc4-1634-4142-a4fe-35ee4ffc74f2] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:01.541006 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7216c752-e2c3-495f-b1d9-97ed646d68a1 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:01.553605 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7216c752-e2c3-495f-b1d9-97ed646d68a1 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/c8060dc4-1634-4142-a4fe-35ee4ffc74f2" status: 200 len: 1209 microversion: 2.1 time: 0.151699 Sep 08 11:09:01.554523 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2619/5331] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:01 2022] GET /compute/v2.1/servers/c8060dc4-1634-4142-a4fe-35ee4ffc74f2 => generated 1209 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:09:02.159158 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8429e4d2-802d-4b43-a15a-80755f7ba482 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:02.163105 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8429e4d2-802d-4b43-a15a-80755f7ba482 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] [instance: 5b547b31-4774-4c3b-a092-f10d890d57e6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:02.201113 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8429e4d2-802d-4b43-a15a-80755f7ba482 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:02.201664 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8429e4d2-802d-4b43-a15a-80755f7ba482 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:02.202109 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8429e4d2-802d-4b43-a15a-80755f7ba482 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:02.202913 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8429e4d2-802d-4b43-a15a-80755f7ba482 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:02.203510 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8429e4d2-802d-4b43-a15a-80755f7ba482 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:02.220809 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8429e4d2-802d-4b43-a15a-80755f7ba482 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:02.580293 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-97879f19-0aa9-4fd4-8298-20cb57071623 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:02.581073 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-97879f19-0aa9-4fd4-8298-20cb57071623 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: c8060dc4-1634-4142-a4fe-35ee4ffc74f2] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:02.832539 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-97879f19-0aa9-4fd4-8298-20cb57071623 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:02.842859 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-97879f19-0aa9-4fd4-8298-20cb57071623 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/c8060dc4-1634-4142-a4fe-35ee4ffc74f2" status: 200 len: 1209 microversion: 2.1 time: 0.267202 Sep 08 11:09:02.849728 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2620/5332] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:02 2022] GET /compute/v2.1/servers/c8060dc4-1634-4142-a4fe-35ee4ffc74f2 => generated 1209 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:09:03.155088 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8429e4d2-802d-4b43-a15a-80755f7ba482 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6618b7ad8ff146dfbd892e3e35c2691f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e29f32d2ac4800b9b767f9e1b16526', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:03.178592 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8429e4d2-802d-4b43-a15a-80755f7ba482 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] 10.222.0.27 "GET /compute/v2.1/servers/5b547b31-4774-4c3b-a092-f10d890d57e6" status: 200 len: 1318 microversion: 2.1 time: 1.039041 Sep 08 11:09:03.180803 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2713/5333] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:02 2022] GET /compute/v2.1/servers/5b547b31-4774-4c3b-a092-f10d890d57e6 => generated 1318 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:09:03.871716 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-62a9fb9b-bfcd-4384-ad11-952f26dd4759 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:03.873010 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-62a9fb9b-bfcd-4384-ad11-952f26dd4759 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: c8060dc4-1634-4142-a4fe-35ee4ffc74f2] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:03.884120 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-62a9fb9b-bfcd-4384-ad11-952f26dd4759 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:03.889901 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-62a9fb9b-bfcd-4384-ad11-952f26dd4759 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:03.893453 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-62a9fb9b-bfcd-4384-ad11-952f26dd4759 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:03.894634 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-62a9fb9b-bfcd-4384-ad11-952f26dd4759 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:03.895375 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-62a9fb9b-bfcd-4384-ad11-952f26dd4759 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:03.897565 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-62a9fb9b-bfcd-4384-ad11-952f26dd4759 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:03.946174 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:09:04.206860 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5cb663b2-1257-48c3-97be-88d4ba0ca168 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:04.208310 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5cb663b2-1257-48c3-97be-88d4ba0ca168 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] [instance: 5b547b31-4774-4c3b-a092-f10d890d57e6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:04.223628 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5cb663b2-1257-48c3-97be-88d4ba0ca168 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:04.229449 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5cb663b2-1257-48c3-97be-88d4ba0ca168 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:04.231704 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5cb663b2-1257-48c3-97be-88d4ba0ca168 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:04.235929 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5cb663b2-1257-48c3-97be-88d4ba0ca168 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:04.237854 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5cb663b2-1257-48c3-97be-88d4ba0ca168 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:04.239941 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5cb663b2-1257-48c3-97be-88d4ba0ca168 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:04.252965 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-62a9fb9b-bfcd-4384-ad11-952f26dd4759 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:04.274728 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-62a9fb9b-bfcd-4384-ad11-952f26dd4759 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/c8060dc4-1634-4142-a4fe-35ee4ffc74f2" status: 200 len: 1267 microversion: 2.1 time: 0.406694 Sep 08 11:09:04.291571 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2621/5334] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:03 2022] GET /compute/v2.1/servers/c8060dc4-1634-4142-a4fe-35ee4ffc74f2 => generated 1267 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:09:04.957239 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5cb663b2-1257-48c3-97be-88d4ba0ca168 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6618b7ad8ff146dfbd892e3e35c2691f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e29f32d2ac4800b9b767f9e1b16526', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:04.971022 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5cb663b2-1257-48c3-97be-88d4ba0ca168 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] 10.222.0.27 "GET /compute/v2.1/servers/5b547b31-4774-4c3b-a092-f10d890d57e6" status: 200 len: 1318 microversion: 2.1 time: 0.769145 Sep 08 11:09:04.971936 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2714/5335] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:04 2022] GET /compute/v2.1/servers/5b547b31-4774-4c3b-a092-f10d890d57e6 => generated 1318 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:09:05.304436 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-961164f5-5dcf-4e73-ab3b-ce6f15afc4b0 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:05.305087 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-961164f5-5dcf-4e73-ab3b-ce6f15afc4b0 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: c8060dc4-1634-4142-a4fe-35ee4ffc74f2] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:05.320330 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-961164f5-5dcf-4e73-ab3b-ce6f15afc4b0 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:05.320849 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-961164f5-5dcf-4e73-ab3b-ce6f15afc4b0 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:05.324898 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-961164f5-5dcf-4e73-ab3b-ce6f15afc4b0 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:05.326713 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-961164f5-5dcf-4e73-ab3b-ce6f15afc4b0 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:05.327763 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-961164f5-5dcf-4e73-ab3b-ce6f15afc4b0 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:05.331947 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-961164f5-5dcf-4e73-ab3b-ce6f15afc4b0 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:05.999543 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-06bbdb22-f7e3-4af3-8e68-7d0a71bb595e tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:06.000978 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-06bbdb22-f7e3-4af3-8e68-7d0a71bb595e tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] [instance: 5b547b31-4774-4c3b-a092-f10d890d57e6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:06.012554 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06bbdb22-f7e3-4af3-8e68-7d0a71bb595e tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:06.018099 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06bbdb22-f7e3-4af3-8e68-7d0a71bb595e tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:06.018929 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06bbdb22-f7e3-4af3-8e68-7d0a71bb595e tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:06.019898 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06bbdb22-f7e3-4af3-8e68-7d0a71bb595e tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:06.020714 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06bbdb22-f7e3-4af3-8e68-7d0a71bb595e tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:06.021387 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06bbdb22-f7e3-4af3-8e68-7d0a71bb595e tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:06.636652 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-961164f5-5dcf-4e73-ab3b-ce6f15afc4b0 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:06.650011 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-961164f5-5dcf-4e73-ab3b-ce6f15afc4b0 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/c8060dc4-1634-4142-a4fe-35ee4ffc74f2" status: 200 len: 1309 microversion: 2.1 time: 1.346637 Sep 08 11:09:06.650848 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2622/5336] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:05 2022] GET /compute/v2.1/servers/c8060dc4-1634-4142-a4fe-35ee4ffc74f2 => generated 1309 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:09:07.208771 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-06bbdb22-f7e3-4af3-8e68-7d0a71bb595e tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6618b7ad8ff146dfbd892e3e35c2691f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e29f32d2ac4800b9b767f9e1b16526', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:07.220979 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-06bbdb22-f7e3-4af3-8e68-7d0a71bb595e tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] 10.222.0.27 "GET /compute/v2.1/servers/5b547b31-4774-4c3b-a092-f10d890d57e6" status: 200 len: 1318 microversion: 2.1 time: 1.226433 Sep 08 11:09:07.221937 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2715/5337] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:05 2022] GET /compute/v2.1/servers/5b547b31-4774-4c3b-a092-f10d890d57e6 => generated 1318 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:09:07.675954 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ba4616e9-02fb-42fa-9ba0-18f560477774 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:07.676990 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ba4616e9-02fb-42fa-9ba0-18f560477774 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: c8060dc4-1634-4142-a4fe-35ee4ffc74f2] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:07.699634 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba4616e9-02fb-42fa-9ba0-18f560477774 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:07.707410 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba4616e9-02fb-42fa-9ba0-18f560477774 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:07.708200 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba4616e9-02fb-42fa-9ba0-18f560477774 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:07.711669 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba4616e9-02fb-42fa-9ba0-18f560477774 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:07.712175 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba4616e9-02fb-42fa-9ba0-18f560477774 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:07.712625 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba4616e9-02fb-42fa-9ba0-18f560477774 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:08.248016 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-26ea2b2a-d532-4b53-b802-03b4865ec78c tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:08.249748 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-26ea2b2a-d532-4b53-b802-03b4865ec78c tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] [instance: 5b547b31-4774-4c3b-a092-f10d890d57e6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:08.274861 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-26ea2b2a-d532-4b53-b802-03b4865ec78c tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:08.275368 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-26ea2b2a-d532-4b53-b802-03b4865ec78c tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:08.275807 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-26ea2b2a-d532-4b53-b802-03b4865ec78c tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:08.276517 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-26ea2b2a-d532-4b53-b802-03b4865ec78c tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:08.277419 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-26ea2b2a-d532-4b53-b802-03b4865ec78c tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:08.278167 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-26ea2b2a-d532-4b53-b802-03b4865ec78c tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:08.632437 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ba4616e9-02fb-42fa-9ba0-18f560477774 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:08.645579 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ba4616e9-02fb-42fa-9ba0-18f560477774 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/c8060dc4-1634-4142-a4fe-35ee4ffc74f2" status: 200 len: 1309 microversion: 2.1 time: 0.975077 Sep 08 11:09:08.661049 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2623/5338] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:07 2022] GET /compute/v2.1/servers/c8060dc4-1634-4142-a4fe-35ee4ffc74f2 => generated 1309 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:09:09.017563 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-26ea2b2a-d532-4b53-b802-03b4865ec78c tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6618b7ad8ff146dfbd892e3e35c2691f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e29f32d2ac4800b9b767f9e1b16526', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:09.027225 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-26ea2b2a-d532-4b53-b802-03b4865ec78c tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] 10.222.0.27 "GET /compute/v2.1/servers/5b547b31-4774-4c3b-a092-f10d890d57e6" status: 200 len: 1318 microversion: 2.1 time: 0.783223 Sep 08 11:09:09.041318 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2716/5339] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:08 2022] GET /compute/v2.1/servers/5b547b31-4774-4c3b-a092-f10d890d57e6 => generated 1318 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:09:09.684558 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ffae492c-b449-4a7a-b408-3c1472d47f1f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:09.685909 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ffae492c-b449-4a7a-b408-3c1472d47f1f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: c8060dc4-1634-4142-a4fe-35ee4ffc74f2] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:09.723631 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ffae492c-b449-4a7a-b408-3c1472d47f1f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:09.724961 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ffae492c-b449-4a7a-b408-3c1472d47f1f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:09.726588 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ffae492c-b449-4a7a-b408-3c1472d47f1f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:09.728994 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ffae492c-b449-4a7a-b408-3c1472d47f1f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:09.732295 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ffae492c-b449-4a7a-b408-3c1472d47f1f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:09.733151 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ffae492c-b449-4a7a-b408-3c1472d47f1f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:10.071826 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-00cb981b-513c-4084-8d9c-40ae8f5845cf tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:10.081054 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-00cb981b-513c-4084-8d9c-40ae8f5845cf tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] [instance: 5b547b31-4774-4c3b-a092-f10d890d57e6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:10.101133 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-00cb981b-513c-4084-8d9c-40ae8f5845cf tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:10.104347 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-00cb981b-513c-4084-8d9c-40ae8f5845cf tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:10.105141 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-00cb981b-513c-4084-8d9c-40ae8f5845cf tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:10.109765 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-00cb981b-513c-4084-8d9c-40ae8f5845cf tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:10.112125 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-00cb981b-513c-4084-8d9c-40ae8f5845cf tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:10.112757 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-00cb981b-513c-4084-8d9c-40ae8f5845cf tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:10.748055 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ffae492c-b449-4a7a-b408-3c1472d47f1f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:10.761968 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ffae492c-b449-4a7a-b408-3c1472d47f1f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/c8060dc4-1634-4142-a4fe-35ee4ffc74f2" status: 200 len: 1309 microversion: 2.1 time: 1.089293 Sep 08 11:09:10.764852 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2624/5340] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:09 2022] GET /compute/v2.1/servers/c8060dc4-1634-4142-a4fe-35ee4ffc74f2 => generated 1309 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:09:10.775745 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-087f133d-2644-457a-b4f8-6be639d5b2b6 req-9c8cf235-b1b1-450b-9498-56ddf652f3b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8060dc4-1634-4142-a4fe-35ee4ffc74f2", "tag": "b28dc1a3-35f4-4159-b42f-b6eda5f29375"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:09:10.816679 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-087f133d-2644-457a-b4f8-6be639d5b2b6 req-9c8cf235-b1b1-450b-9498-56ddf652f3b3 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:10.818922 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-087f133d-2644-457a-b4f8-6be639d5b2b6 req-9c8cf235-b1b1-450b-9498-56ddf652f3b3 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:10.819656 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-087f133d-2644-457a-b4f8-6be639d5b2b6 req-9c8cf235-b1b1-450b-9498-56ddf652f3b3 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:10.865914 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-087f133d-2644-457a-b4f8-6be639d5b2b6 req-9c8cf235-b1b1-450b-9498-56ddf652f3b3 service nova] Creating event network-changed:b28dc1a3-35f4-4159-b42f-b6eda5f29375 for instance c8060dc4-1634-4142-a4fe-35ee4ffc74f2 on n-h2-850501-12 Sep 08 11:09:10.876468 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-087f133d-2644-457a-b4f8-6be639d5b2b6 req-9c8cf235-b1b1-450b-9498-56ddf652f3b3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106273 Sep 08 11:09:10.877888 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2625/5341] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:09:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:09:10.884801 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-3ce47048-2f0f-4e79-bb2f-79f001b42756 req-1b0b033a-fc33-4375-a039-b1ba635fe847 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b547b31-4774-4c3b-a092-f10d890d57e6", "name": "network-vif-plugged", "status": "completed", "tag": "8d41fbbc-7908-46e9-9e8d-d5103d2c3dc2"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:09:10.919172 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-3ce47048-2f0f-4e79-bb2f-79f001b42756 req-1b0b033a-fc33-4375-a039-b1ba635fe847 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:10.927692 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-3ce47048-2f0f-4e79-bb2f-79f001b42756 req-1b0b033a-fc33-4375-a039-b1ba635fe847 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:10.928396 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-3ce47048-2f0f-4e79-bb2f-79f001b42756 req-1b0b033a-fc33-4375-a039-b1ba635fe847 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:10.954743 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-3ce47048-2f0f-4e79-bb2f-79f001b42756 req-1b0b033a-fc33-4375-a039-b1ba635fe847 service nova] Creating event network-vif-plugged:8d41fbbc-7908-46e9-9e8d-d5103d2c3dc2 for instance 5b547b31-4774-4c3b-a092-f10d890d57e6 on n-h1-850501-12 Sep 08 11:09:10.968755 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-3ce47048-2f0f-4e79-bb2f-79f001b42756 req-1b0b033a-fc33-4375-a039-b1ba635fe847 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089128 Sep 08 11:09:10.970338 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2626/5342] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:09:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:09:11.180290 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:09:11.276224 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=6 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:09:11.611347 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-00cb981b-513c-4084-8d9c-40ae8f5845cf tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6618b7ad8ff146dfbd892e3e35c2691f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e29f32d2ac4800b9b767f9e1b16526', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:11.622222 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-00cb981b-513c-4084-8d9c-40ae8f5845cf tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] 10.222.0.27 "GET /compute/v2.1/servers/5b547b31-4774-4c3b-a092-f10d890d57e6" status: 200 len: 1318 microversion: 2.1 time: 1.562099 Sep 08 11:09:11.627505 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2717/5343] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:10 2022] GET /compute/v2.1/servers/5b547b31-4774-4c3b-a092-f10d890d57e6 => generated 1318 bytes in 1568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:09:11.789875 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-08d61f2b-4b01-4ee9-97d4-fb480255018e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:11.790867 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-08d61f2b-4b01-4ee9-97d4-fb480255018e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: c8060dc4-1634-4142-a4fe-35ee4ffc74f2] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:11.807238 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08d61f2b-4b01-4ee9-97d4-fb480255018e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:11.815484 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08d61f2b-4b01-4ee9-97d4-fb480255018e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:11.816078 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08d61f2b-4b01-4ee9-97d4-fb480255018e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:11.820232 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08d61f2b-4b01-4ee9-97d4-fb480255018e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:11.822129 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08d61f2b-4b01-4ee9-97d4-fb480255018e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:11.823647 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08d61f2b-4b01-4ee9-97d4-fb480255018e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:12.415652 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-08d61f2b-4b01-4ee9-97d4-fb480255018e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:12.457976 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-08d61f2b-4b01-4ee9-97d4-fb480255018e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/c8060dc4-1634-4142-a4fe-35ee4ffc74f2" status: 200 len: 1309 microversion: 2.1 time: 0.661183 Sep 08 11:09:12.473385 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2627/5344] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:11 2022] GET /compute/v2.1/servers/c8060dc4-1634-4142-a4fe-35ee4ffc74f2 => generated 1309 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:09:12.680033 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-44a573c2-843d-4552-a92e-522f7c71f921 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:12.693263 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-44a573c2-843d-4552-a92e-522f7c71f921 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] [instance: 5b547b31-4774-4c3b-a092-f10d890d57e6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:12.743123 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-44a573c2-843d-4552-a92e-522f7c71f921 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:12.745969 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-44a573c2-843d-4552-a92e-522f7c71f921 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:12.753088 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-44a573c2-843d-4552-a92e-522f7c71f921 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:12.755338 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-44a573c2-843d-4552-a92e-522f7c71f921 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:12.756732 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-44a573c2-843d-4552-a92e-522f7c71f921 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:12.757924 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-44a573c2-843d-4552-a92e-522f7c71f921 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:13.483876 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9ec87bd1-5577-4884-b60c-231072eb9516 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:13.485450 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9ec87bd1-5577-4884-b60c-231072eb9516 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: c8060dc4-1634-4142-a4fe-35ee4ffc74f2] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:13.488518 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=4 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:09:13.516441 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9ec87bd1-5577-4884-b60c-231072eb9516 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:13.537956 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9ec87bd1-5577-4884-b60c-231072eb9516 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:13.538449 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9ec87bd1-5577-4884-b60c-231072eb9516 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:13.545827 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9ec87bd1-5577-4884-b60c-231072eb9516 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:13.546451 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9ec87bd1-5577-4884-b60c-231072eb9516 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:13.547112 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9ec87bd1-5577-4884-b60c-231072eb9516 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:14.075611 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9ec87bd1-5577-4884-b60c-231072eb9516 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:14.095819 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9ec87bd1-5577-4884-b60c-231072eb9516 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/c8060dc4-1634-4142-a4fe-35ee4ffc74f2" status: 200 len: 1309 microversion: 2.1 time: 0.617246 Sep 08 11:09:14.096363 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2628/5345] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:13 2022] GET /compute/v2.1/servers/c8060dc4-1634-4142-a4fe-35ee4ffc74f2 => generated 1309 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:09:14.264680 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-44a573c2-843d-4552-a92e-522f7c71f921 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6618b7ad8ff146dfbd892e3e35c2691f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e29f32d2ac4800b9b767f9e1b16526', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:14.290857 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-44a573c2-843d-4552-a92e-522f7c71f921 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] 10.222.0.27 "GET /compute/v2.1/servers/5b547b31-4774-4c3b-a092-f10d890d57e6" status: 200 len: 1318 microversion: 2.1 time: 1.619951 Sep 08 11:09:14.291573 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2718/5346] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:12 2022] GET /compute/v2.1/servers/5b547b31-4774-4c3b-a092-f10d890d57e6 => generated 1318 bytes in 1628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:09:15.123655 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4195bd9d-11f6-44b0-9383-240ce0731817 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:15.124916 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4195bd9d-11f6-44b0-9383-240ce0731817 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: c8060dc4-1634-4142-a4fe-35ee4ffc74f2] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:15.141927 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4195bd9d-11f6-44b0-9383-240ce0731817 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:15.148853 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4195bd9d-11f6-44b0-9383-240ce0731817 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:15.149433 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4195bd9d-11f6-44b0-9383-240ce0731817 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:15.150254 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4195bd9d-11f6-44b0-9383-240ce0731817 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:15.150744 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4195bd9d-11f6-44b0-9383-240ce0731817 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:15.151177 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4195bd9d-11f6-44b0-9383-240ce0731817 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:15.406455 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-67a39e98-a33e-4218-90cc-939b3290ac07 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-8424022", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:09:15.658778 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-67a39e98-a33e-4218-90cc-939b3290ac07 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] validate_networks() for [('7dd0b2cb-750a-4628-9931-f3077763e79f', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:09:15.909874 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4195bd9d-11f6-44b0-9383-240ce0731817 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:15.940099 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4195bd9d-11f6-44b0-9383-240ce0731817 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/c8060dc4-1634-4142-a4fe-35ee4ffc74f2" status: 200 len: 1309 microversion: 2.1 time: 0.815411 Sep 08 11:09:15.942408 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2629/5347] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:15 2022] GET /compute/v2.1/servers/c8060dc4-1634-4142-a4fe-35ee4ffc74f2 => generated 1309 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:09:15.956081 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e628167c-b993-4162-ac5b-127eb488cb43 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:15.956725 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e628167c-b993-4162-ac5b-127eb488cb43 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] [instance: 5b547b31-4774-4c3b-a092-f10d890d57e6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:15.968711 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e628167c-b993-4162-ac5b-127eb488cb43 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:15.969440 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e628167c-b993-4162-ac5b-127eb488cb43 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:15.970031 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e628167c-b993-4162-ac5b-127eb488cb43 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:15.970895 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e628167c-b993-4162-ac5b-127eb488cb43 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:15.971561 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e628167c-b993-4162-ac5b-127eb488cb43 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:15.972314 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e628167c-b993-4162-ac5b-127eb488cb43 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:16.426150 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e628167c-b993-4162-ac5b-127eb488cb43 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6618b7ad8ff146dfbd892e3e35c2691f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e29f32d2ac4800b9b767f9e1b16526', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:16.441553 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e628167c-b993-4162-ac5b-127eb488cb43 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] 10.222.0.27 "GET /compute/v2.1/servers/5b547b31-4774-4c3b-a092-f10d890d57e6" status: 200 len: 1507 microversion: 2.1 time: 0.497790 Sep 08 11:09:16.442159 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2630/5348] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:15 2022] GET /compute/v2.1/servers/5b547b31-4774-4c3b-a092-f10d890d57e6 => generated 1507 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:09:16.966481 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4a408710-892a-464d-80b6-e569e5e5bac6 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:16.967030 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4a408710-892a-464d-80b6-e569e5e5bac6 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: c8060dc4-1634-4142-a4fe-35ee4ffc74f2] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:16.989151 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a408710-892a-464d-80b6-e569e5e5bac6 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:16.993198 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a408710-892a-464d-80b6-e569e5e5bac6 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:16.996131 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a408710-892a-464d-80b6-e569e5e5bac6 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:16.996915 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a408710-892a-464d-80b6-e569e5e5bac6 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:17.002237 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a408710-892a-464d-80b6-e569e5e5bac6 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:17.004761 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a408710-892a-464d-80b6-e569e5e5bac6 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:17.674357 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4a408710-892a-464d-80b6-e569e5e5bac6 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:17.691854 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4a408710-892a-464d-80b6-e569e5e5bac6 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/c8060dc4-1634-4142-a4fe-35ee4ffc74f2" status: 200 len: 1309 microversion: 2.1 time: 0.730473 Sep 08 11:09:17.697596 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2631/5349] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:16 2022] GET /compute/v2.1/servers/c8060dc4-1634-4142-a4fe-35ee4ffc74f2 => generated 1309 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:09:18.735742 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-67a39e98-a33e-4218-90cc-939b3290ac07 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:09:18.736421 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-67a39e98-a33e-4218-90cc-939b3290ac07 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:09:18.736921 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-67a39e98-a33e-4218-90cc-939b3290ac07 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:09:18.738201 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-67a39e98-a33e-4218-90cc-939b3290ac07 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:09:18.740974 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-70cada3c-5488-4932-b816-6406ba4bc28a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:18.741872 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-67a39e98-a33e-4218-90cc-939b3290ac07 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:09:18.747761 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-70cada3c-5488-4932-b816-6406ba4bc28a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: c8060dc4-1634-4142-a4fe-35ee4ffc74f2] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:18.803977 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70cada3c-5488-4932-b816-6406ba4bc28a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:18.806687 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70cada3c-5488-4932-b816-6406ba4bc28a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:18.811009 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70cada3c-5488-4932-b816-6406ba4bc28a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:18.812875 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70cada3c-5488-4932-b816-6406ba4bc28a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:18.814148 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70cada3c-5488-4932-b816-6406ba4bc28a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:18.816989 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70cada3c-5488-4932-b816-6406ba4bc28a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:18.819407 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-67a39e98-a33e-4218-90cc-939b3290ac07 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:18.819938 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-67a39e98-a33e-4218-90cc-939b3290ac07 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:18.820388 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-67a39e98-a33e-4218-90cc-939b3290ac07 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:18.821355 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-67a39e98-a33e-4218-90cc-939b3290ac07 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:18.821832 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-67a39e98-a33e-4218-90cc-939b3290ac07 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:18.822256 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-67a39e98-a33e-4218-90cc-939b3290ac07 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:18.997783 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-67a39e98-a33e-4218-90cc-939b3290ac07 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Getting quotas for project 6cdc4842f7d54826abd0086ad6654dbd. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:09:19.052654 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-67a39e98-a33e-4218-90cc-939b3290ac07 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Getting quotas for user e25641daaa044b1bb0e53d4d2b350f15 and project 6cdc4842f7d54826abd0086ad6654dbd. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:09:19.134091 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-67a39e98-a33e-4218-90cc-939b3290ac07 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:09:19.138461 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-67a39e98-a33e-4218-90cc-939b3290ac07 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] [instance: 41f1a22f-64b4-4564-94a9-99fc6740e0a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:09:19.307180 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-67a39e98-a33e-4218-90cc-939b3290ac07 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.163464 Sep 08 11:09:19.316023 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2719/5350] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 11:09:15 2022] POST /compute/v2.1/servers => generated 383 bytes in 4173 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:09:19.324488 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-311a3ff0-60ad-42e5-a4c4-7a9b6ed23b70 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:19.328450 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-311a3ff0-60ad-42e5-a4c4-7a9b6ed23b70 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] [instance: 41f1a22f-64b4-4564-94a9-99fc6740e0a1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:19.491098 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-70cada3c-5488-4932-b816-6406ba4bc28a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:19.500882 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-70cada3c-5488-4932-b816-6406ba4bc28a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/c8060dc4-1634-4142-a4fe-35ee4ffc74f2" status: 200 len: 1309 microversion: 2.1 time: 0.783558 Sep 08 11:09:19.505346 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2632/5351] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:18 2022] GET /compute/v2.1/servers/c8060dc4-1634-4142-a4fe-35ee4ffc74f2 => generated 1309 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:09:19.696223 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-311a3ff0-60ad-42e5-a4c4-7a9b6ed23b70 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25641daaa044b1bb0e53d4d2b350f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdc4842f7d54826abd0086ad6654dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:19.714862 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-311a3ff0-60ad-42e5-a4c4-7a9b6ed23b70 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] 10.222.0.27 "GET /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1" status: 200 len: 1220 microversion: 2.1 time: 0.395614 Sep 08 11:09:19.721146 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2720/5352] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:19 2022] GET /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1 => generated 1220 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:09:20.530449 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-39ea1d9f-c229-4bfc-b0a1-496db8256933 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:20.531702 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-39ea1d9f-c229-4bfc-b0a1-496db8256933 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: c8060dc4-1634-4142-a4fe-35ee4ffc74f2] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:20.544575 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-39ea1d9f-c229-4bfc-b0a1-496db8256933 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:20.553690 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-39ea1d9f-c229-4bfc-b0a1-496db8256933 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:20.561398 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-39ea1d9f-c229-4bfc-b0a1-496db8256933 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:20.562638 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-39ea1d9f-c229-4bfc-b0a1-496db8256933 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:20.565581 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-39ea1d9f-c229-4bfc-b0a1-496db8256933 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:20.567097 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-39ea1d9f-c229-4bfc-b0a1-496db8256933 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:20.745757 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-086258ea-d30b-42e4-acd8-9bf37ac8dc08 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:20.752388 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-086258ea-d30b-42e4-acd8-9bf37ac8dc08 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] [instance: 41f1a22f-64b4-4564-94a9-99fc6740e0a1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:20.988490 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-086258ea-d30b-42e4-acd8-9bf37ac8dc08 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25641daaa044b1bb0e53d4d2b350f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdc4842f7d54826abd0086ad6654dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:21.018218 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-086258ea-d30b-42e4-acd8-9bf37ac8dc08 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] 10.222.0.27 "GET /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1" status: 200 len: 1220 microversion: 2.1 time: 0.276089 Sep 08 11:09:21.026644 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2721/5353] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:20 2022] GET /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1 => generated 1220 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:09:21.707818 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-39ea1d9f-c229-4bfc-b0a1-496db8256933 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:21.717287 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-39ea1d9f-c229-4bfc-b0a1-496db8256933 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/c8060dc4-1634-4142-a4fe-35ee4ffc74f2" status: 200 len: 1309 microversion: 2.1 time: 1.191547 Sep 08 11:09:21.738862 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2633/5354] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:20 2022] GET /compute/v2.1/servers/c8060dc4-1634-4142-a4fe-35ee4ffc74f2 => generated 1309 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:09:22.052745 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cb2305e1-793d-4ccd-b73e-39042246e8df tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:22.053413 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cb2305e1-793d-4ccd-b73e-39042246e8df tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] [instance: 41f1a22f-64b4-4564-94a9-99fc6740e0a1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:22.073826 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb2305e1-793d-4ccd-b73e-39042246e8df tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:22.076715 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb2305e1-793d-4ccd-b73e-39042246e8df tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:22.078392 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb2305e1-793d-4ccd-b73e-39042246e8df tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:22.080781 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb2305e1-793d-4ccd-b73e-39042246e8df tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:22.081660 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb2305e1-793d-4ccd-b73e-39042246e8df tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:22.082227 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb2305e1-793d-4ccd-b73e-39042246e8df tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:22.213636 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-cb2305e1-793d-4ccd-b73e-39042246e8df tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25641daaa044b1bb0e53d4d2b350f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdc4842f7d54826abd0086ad6654dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:22.228144 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cb2305e1-793d-4ccd-b73e-39042246e8df tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] 10.222.0.27 "GET /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1" status: 200 len: 1272 microversion: 2.1 time: 0.180452 Sep 08 11:09:22.244772 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2722/5355] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:22 2022] GET /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1 => generated 1272 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:09:22.748042 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-46a8f244-0feb-49b4-926b-50ccccb3839d tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:22.749573 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-46a8f244-0feb-49b4-926b-50ccccb3839d tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: c8060dc4-1634-4142-a4fe-35ee4ffc74f2] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:22.761204 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-46a8f244-0feb-49b4-926b-50ccccb3839d tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:22.766113 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-46a8f244-0feb-49b4-926b-50ccccb3839d tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:22.766837 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-46a8f244-0feb-49b4-926b-50ccccb3839d tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:22.768356 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-46a8f244-0feb-49b4-926b-50ccccb3839d tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:22.769045 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-46a8f244-0feb-49b4-926b-50ccccb3839d tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:22.769636 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-46a8f244-0feb-49b4-926b-50ccccb3839d tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:23.259296 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d95616c3-7ba3-49cc-ab85-558f92f6c86d tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:23.260198 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d95616c3-7ba3-49cc-ab85-558f92f6c86d tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] [instance: 41f1a22f-64b4-4564-94a9-99fc6740e0a1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:23.272994 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d95616c3-7ba3-49cc-ab85-558f92f6c86d tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:23.278700 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d95616c3-7ba3-49cc-ab85-558f92f6c86d tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:23.279581 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d95616c3-7ba3-49cc-ab85-558f92f6c86d tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:23.284267 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d95616c3-7ba3-49cc-ab85-558f92f6c86d tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:23.289752 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d95616c3-7ba3-49cc-ab85-558f92f6c86d tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:23.290438 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d95616c3-7ba3-49cc-ab85-558f92f6c86d tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:23.525576 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d95616c3-7ba3-49cc-ab85-558f92f6c86d tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25641daaa044b1bb0e53d4d2b350f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdc4842f7d54826abd0086ad6654dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:23.556609 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d95616c3-7ba3-49cc-ab85-558f92f6c86d tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] 10.222.0.27 "GET /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1" status: 200 len: 1278 microversion: 2.1 time: 0.308574 Sep 08 11:09:23.558235 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2723/5356] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:23 2022] GET /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1 => generated 1278 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:09:23.745179 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-46a8f244-0feb-49b4-926b-50ccccb3839d tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:23.772945 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-46a8f244-0feb-49b4-926b-50ccccb3839d tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/c8060dc4-1634-4142-a4fe-35ee4ffc74f2" status: 200 len: 1309 microversion: 2.1 time: 1.029115 Sep 08 11:09:23.792341 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2634/5357] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:22 2022] GET /compute/v2.1/servers/c8060dc4-1634-4142-a4fe-35ee4ffc74f2 => generated 1309 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:09:23.880013 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-6b65a394-079b-4d29-888f-1584bdb7fdba req-84165cab-f14c-4bb3-83d2-a3f7faefdeda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8060dc4-1634-4142-a4fe-35ee4ffc74f2", "name": "network-vif-plugged", "status": "completed", "tag": "b28dc1a3-35f4-4159-b42f-b6eda5f29375"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:09:23.911396 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-6b65a394-079b-4d29-888f-1584bdb7fdba req-84165cab-f14c-4bb3-83d2-a3f7faefdeda service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:23.931322 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-6b65a394-079b-4d29-888f-1584bdb7fdba req-84165cab-f14c-4bb3-83d2-a3f7faefdeda service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:23.931322 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-6b65a394-079b-4d29-888f-1584bdb7fdba req-84165cab-f14c-4bb3-83d2-a3f7faefdeda service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:23.967865 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-6b65a394-079b-4d29-888f-1584bdb7fdba req-84165cab-f14c-4bb3-83d2-a3f7faefdeda service nova] Creating event network-vif-plugged:b28dc1a3-35f4-4159-b42f-b6eda5f29375 for instance c8060dc4-1634-4142-a4fe-35ee4ffc74f2 on n-h2-850501-12 Sep 08 11:09:23.980147 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-6b65a394-079b-4d29-888f-1584bdb7fdba req-84165cab-f14c-4bb3-83d2-a3f7faefdeda service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106577 Sep 08 11:09:23.986839 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2724/5358] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:09:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:09:24.593172 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-55a1ba4a-dc89-4f80-a214-201707731c16 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:24.599141 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-55a1ba4a-dc89-4f80-a214-201707731c16 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] [instance: 41f1a22f-64b4-4564-94a9-99fc6740e0a1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:24.616936 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55a1ba4a-dc89-4f80-a214-201707731c16 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:24.623588 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55a1ba4a-dc89-4f80-a214-201707731c16 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:24.626566 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55a1ba4a-dc89-4f80-a214-201707731c16 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:24.627621 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55a1ba4a-dc89-4f80-a214-201707731c16 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:24.629591 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55a1ba4a-dc89-4f80-a214-201707731c16 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:24.635529 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55a1ba4a-dc89-4f80-a214-201707731c16 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:24.829574 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e68327aa-130e-4c12-bee6-2232fa9c16b4 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:24.832829 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e68327aa-130e-4c12-bee6-2232fa9c16b4 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: c8060dc4-1634-4142-a4fe-35ee4ffc74f2] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:24.863657 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e68327aa-130e-4c12-bee6-2232fa9c16b4 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:24.865325 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e68327aa-130e-4c12-bee6-2232fa9c16b4 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:24.866306 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e68327aa-130e-4c12-bee6-2232fa9c16b4 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:24.870134 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e68327aa-130e-4c12-bee6-2232fa9c16b4 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:24.871574 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e68327aa-130e-4c12-bee6-2232fa9c16b4 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:24.880754 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e68327aa-130e-4c12-bee6-2232fa9c16b4 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:25.020610 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-55a1ba4a-dc89-4f80-a214-201707731c16 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25641daaa044b1bb0e53d4d2b350f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdc4842f7d54826abd0086ad6654dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:25.034409 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-55a1ba4a-dc89-4f80-a214-201707731c16 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] 10.222.0.27 "GET /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1" status: 200 len: 1278 microversion: 2.1 time: 0.450612 Sep 08 11:09:25.039214 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2635/5359] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:24 2022] GET /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1 => generated 1278 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:09:25.615507 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e68327aa-130e-4c12-bee6-2232fa9c16b4 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:25.648561 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e68327aa-130e-4c12-bee6-2232fa9c16b4 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/c8060dc4-1634-4142-a4fe-35ee4ffc74f2" status: 200 len: 1309 microversion: 2.1 time: 0.841551 Sep 08 11:09:25.666265 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2725/5360] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:24 2022] GET /compute/v2.1/servers/c8060dc4-1634-4142-a4fe-35ee4ffc74f2 => generated 1309 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:09:26.063077 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ff59b29e-7770-46f8-82fd-37054df96c2e tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:26.063746 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ff59b29e-7770-46f8-82fd-37054df96c2e tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] [instance: 41f1a22f-64b4-4564-94a9-99fc6740e0a1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:26.079887 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff59b29e-7770-46f8-82fd-37054df96c2e tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:26.080393 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff59b29e-7770-46f8-82fd-37054df96c2e tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:26.080837 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff59b29e-7770-46f8-82fd-37054df96c2e tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:26.081583 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff59b29e-7770-46f8-82fd-37054df96c2e tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:26.090302 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff59b29e-7770-46f8-82fd-37054df96c2e tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:26.097799 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff59b29e-7770-46f8-82fd-37054df96c2e tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:26.684777 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-27263ea0-1f70-4cbc-b4d4-cb5628f74fe3 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:26.686144 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-27263ea0-1f70-4cbc-b4d4-cb5628f74fe3 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: c8060dc4-1634-4142-a4fe-35ee4ffc74f2] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:26.694122 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=6 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:09:26.696181 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-27263ea0-1f70-4cbc-b4d4-cb5628f74fe3 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:26.696846 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-27263ea0-1f70-4cbc-b4d4-cb5628f74fe3 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:26.697946 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-27263ea0-1f70-4cbc-b4d4-cb5628f74fe3 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:26.699011 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-27263ea0-1f70-4cbc-b4d4-cb5628f74fe3 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:26.699634 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-27263ea0-1f70-4cbc-b4d4-cb5628f74fe3 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:26.700240 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-27263ea0-1f70-4cbc-b4d4-cb5628f74fe3 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:26.964201 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ff59b29e-7770-46f8-82fd-37054df96c2e tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25641daaa044b1bb0e53d4d2b350f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdc4842f7d54826abd0086ad6654dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:26.975393 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ff59b29e-7770-46f8-82fd-37054df96c2e tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] 10.222.0.27 "GET /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1" status: 200 len: 1320 microversion: 2.1 time: 0.916810 Sep 08 11:09:26.980011 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2636/5361] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:26 2022] GET /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1 => generated 1320 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:09:28.007299 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7723ab21-2fa8-4c5e-b0cb-a17b98040b31 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:28.008020 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7723ab21-2fa8-4c5e-b0cb-a17b98040b31 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] [instance: 41f1a22f-64b4-4564-94a9-99fc6740e0a1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:28.034651 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=51,nova_api:DELETE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:09:28.059402 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7723ab21-2fa8-4c5e-b0cb-a17b98040b31 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:28.064723 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7723ab21-2fa8-4c5e-b0cb-a17b98040b31 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:28.073705 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7723ab21-2fa8-4c5e-b0cb-a17b98040b31 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:28.081918 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7723ab21-2fa8-4c5e-b0cb-a17b98040b31 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:28.083594 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7723ab21-2fa8-4c5e-b0cb-a17b98040b31 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:28.091191 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7723ab21-2fa8-4c5e-b0cb-a17b98040b31 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:28.570646 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-27263ea0-1f70-4cbc-b4d4-cb5628f74fe3 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:28.584628 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-27263ea0-1f70-4cbc-b4d4-cb5628f74fe3 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/c8060dc4-1634-4142-a4fe-35ee4ffc74f2" status: 200 len: 1491 microversion: 2.1 time: 1.905481 Sep 08 11:09:28.585328 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2726/5362] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:26 2022] GET /compute/v2.1/servers/c8060dc4-1634-4142-a4fe-35ee4ffc74f2 => generated 1491 bytes in 1907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:09:29.015569 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0fbddd2b-bb6c-47e9-b56d-c86d4350ff5a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1464221198", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "20951261-edda-4da9-a3e2-8f222023ad9d"}]}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:09:29.029118 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:09:29.191101 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-0fbddd2b-bb6c-47e9-b56d-c86d4350ff5a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] validate_networks() for [('20951261-edda-4da9-a3e2-8f222023ad9d', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:09:30.256216 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7723ab21-2fa8-4c5e-b0cb-a17b98040b31 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25641daaa044b1bb0e53d4d2b350f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdc4842f7d54826abd0086ad6654dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:30.291708 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7723ab21-2fa8-4c5e-b0cb-a17b98040b31 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] 10.222.0.27 "GET /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1" status: 200 len: 1320 microversion: 2.1 time: 2.291020 Sep 08 11:09:30.296959 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2637/5363] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:27 2022] GET /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1 => generated 1320 bytes in 2298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:09:30.710528 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-0fbddd2b-bb6c-47e9-b56d-c86d4350ff5a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:09:30.711322 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-0fbddd2b-bb6c-47e9-b56d-c86d4350ff5a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:09:30.711810 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-0fbddd2b-bb6c-47e9-b56d-c86d4350ff5a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:09:30.712235 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-0fbddd2b-bb6c-47e9-b56d-c86d4350ff5a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:09:30.712658 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-0fbddd2b-bb6c-47e9-b56d-c86d4350ff5a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:09:30.736452 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0fbddd2b-bb6c-47e9-b56d-c86d4350ff5a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:30.738549 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0fbddd2b-bb6c-47e9-b56d-c86d4350ff5a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:30.741701 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0fbddd2b-bb6c-47e9-b56d-c86d4350ff5a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:30.742734 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0fbddd2b-bb6c-47e9-b56d-c86d4350ff5a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:30.743835 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0fbddd2b-bb6c-47e9-b56d-c86d4350ff5a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:30.747511 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0fbddd2b-bb6c-47e9-b56d-c86d4350ff5a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:30.802001 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-0fbddd2b-bb6c-47e9-b56d-c86d4350ff5a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Getting quotas for project 7868787bfea94355a5d5971bab0d5ed4. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:09:30.810744 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-0fbddd2b-bb6c-47e9-b56d-c86d4350ff5a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Getting quotas for user 5193272e9ab24845aff53982dbe2c6f0 and project 7868787bfea94355a5d5971bab0d5ed4. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:09:30.847915 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0fbddd2b-bb6c-47e9-b56d-c86d4350ff5a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:09:30.854303 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0fbddd2b-bb6c-47e9-b56d-c86d4350ff5a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:09:30.983991 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0fbddd2b-bb6c-47e9-b56d-c86d4350ff5a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.972890 Sep 08 11:09:30.992722 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2727/5364] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 11:09:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1984 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 11:09:31.017076 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-17682ca7-5529-43de-b471-e599e880c1c2 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:31.018959 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-17682ca7-5529-43de-b471-e599e880c1c2 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:31.323489 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-09ccf45d-a23c-44d5-90fc-a0e846126272 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:31.324177 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-09ccf45d-a23c-44d5-90fc-a0e846126272 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] [instance: 41f1a22f-64b4-4564-94a9-99fc6740e0a1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:31.339097 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-09ccf45d-a23c-44d5-90fc-a0e846126272 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:31.340267 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-09ccf45d-a23c-44d5-90fc-a0e846126272 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:31.340730 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-09ccf45d-a23c-44d5-90fc-a0e846126272 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:31.342443 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-09ccf45d-a23c-44d5-90fc-a0e846126272 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:31.342925 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-09ccf45d-a23c-44d5-90fc-a0e846126272 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:31.343361 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-09ccf45d-a23c-44d5-90fc-a0e846126272 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:31.399076 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=68 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:09:31.653408 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-17682ca7-5529-43de-b471-e599e880c1c2 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:31.664743 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-17682ca7-5529-43de-b471-e599e880c1c2 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65" status: 200 len: 1209 microversion: 2.1 time: 0.662683 Sep 08 11:09:31.668472 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2638/5365] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:31 2022] GET /compute/v2.1/servers/35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65 => generated 1209 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:09:32.565270 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-09ccf45d-a23c-44d5-90fc-a0e846126272 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25641daaa044b1bb0e53d4d2b350f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdc4842f7d54826abd0086ad6654dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:32.588507 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-09ccf45d-a23c-44d5-90fc-a0e846126272 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] 10.222.0.27 "GET /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1" status: 200 len: 1320 microversion: 2.1 time: 1.270305 Sep 08 11:09:32.595160 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2728/5366] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:31 2022] GET /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1 => generated 1320 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:09:32.692283 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ea7041fd-d9ef-4d45-8777-a8200f62c750 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:32.693103 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ea7041fd-d9ef-4d45-8777-a8200f62c750 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:32.708229 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea7041fd-d9ef-4d45-8777-a8200f62c750 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:32.709499 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea7041fd-d9ef-4d45-8777-a8200f62c750 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:32.710564 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea7041fd-d9ef-4d45-8777-a8200f62c750 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:32.713392 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea7041fd-d9ef-4d45-8777-a8200f62c750 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:32.714049 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea7041fd-d9ef-4d45-8777-a8200f62c750 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:32.717111 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea7041fd-d9ef-4d45-8777-a8200f62c750 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:32.996435 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-e531528a-266d-4a93-acd6-545fa4f79af0 req-ca6530b6-01bd-49a5-9155-4b76d9bc6c15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41f1a22f-64b4-4564-94a9-99fc6740e0a1", "tag": "62403e83-a296-4c79-be79-7a813046d1fe"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:09:33.016370 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-e531528a-266d-4a93-acd6-545fa4f79af0 req-ca6530b6-01bd-49a5-9155-4b76d9bc6c15 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:33.017900 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-e531528a-266d-4a93-acd6-545fa4f79af0 req-ca6530b6-01bd-49a5-9155-4b76d9bc6c15 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:33.019435 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-e531528a-266d-4a93-acd6-545fa4f79af0 req-ca6530b6-01bd-49a5-9155-4b76d9bc6c15 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:33.032877 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-e531528a-266d-4a93-acd6-545fa4f79af0 req-ca6530b6-01bd-49a5-9155-4b76d9bc6c15 service nova] Creating event network-changed:62403e83-a296-4c79-be79-7a813046d1fe for instance 41f1a22f-64b4-4564-94a9-99fc6740e0a1 on n-h2-850501-12 Sep 08 11:09:33.038973 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-e531528a-266d-4a93-acd6-545fa4f79af0 req-ca6530b6-01bd-49a5-9155-4b76d9bc6c15 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046220 Sep 08 11:09:33.040176 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2729/5367] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:09:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:09:33.095588 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ea7041fd-d9ef-4d45-8777-a8200f62c750 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:33.104243 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ea7041fd-d9ef-4d45-8777-a8200f62c750 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65" status: 200 len: 1261 microversion: 2.1 time: 0.416624 Sep 08 11:09:33.114238 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2639/5368] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:32 2022] GET /compute/v2.1/servers/35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65 => generated 1261 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:09:33.627236 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a1cc42bd-59ee-4b0b-91c1-6787aa4e9e84 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:33.628984 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a1cc42bd-59ee-4b0b-91c1-6787aa4e9e84 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] [instance: 41f1a22f-64b4-4564-94a9-99fc6740e0a1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:33.640141 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a1cc42bd-59ee-4b0b-91c1-6787aa4e9e84 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:33.642219 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a1cc42bd-59ee-4b0b-91c1-6787aa4e9e84 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:33.644018 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a1cc42bd-59ee-4b0b-91c1-6787aa4e9e84 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:33.646118 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a1cc42bd-59ee-4b0b-91c1-6787aa4e9e84 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:33.647894 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a1cc42bd-59ee-4b0b-91c1-6787aa4e9e84 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:33.649627 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a1cc42bd-59ee-4b0b-91c1-6787aa4e9e84 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:34.146353 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8f860e05-998f-4cac-bc33-0bae7f7da18e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:34.147745 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8f860e05-998f-4cac-bc33-0bae7f7da18e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:34.170833 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f860e05-998f-4cac-bc33-0bae7f7da18e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:34.173847 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f860e05-998f-4cac-bc33-0bae7f7da18e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:34.178295 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f860e05-998f-4cac-bc33-0bae7f7da18e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:34.181495 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f860e05-998f-4cac-bc33-0bae7f7da18e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:34.182466 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f860e05-998f-4cac-bc33-0bae7f7da18e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:34.183088 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f860e05-998f-4cac-bc33-0bae7f7da18e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:34.194556 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:09:34.511512 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a1cc42bd-59ee-4b0b-91c1-6787aa4e9e84 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25641daaa044b1bb0e53d4d2b350f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdc4842f7d54826abd0086ad6654dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:34.544470 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a1cc42bd-59ee-4b0b-91c1-6787aa4e9e84 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] 10.222.0.27 "GET /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1" status: 200 len: 1320 microversion: 2.1 time: 0.927835 Sep 08 11:09:34.560657 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2730/5369] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:33 2022] GET /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1 => generated 1320 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:09:34.845248 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8f860e05-998f-4cac-bc33-0bae7f7da18e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:34.865231 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8f860e05-998f-4cac-bc33-0bae7f7da18e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65" status: 200 len: 1267 microversion: 2.1 time: 0.725577 Sep 08 11:09:34.869406 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2640/5370] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:34 2022] GET /compute/v2.1/servers/35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65 => generated 1267 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:09:35.570771 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2a647bdd-98cc-4750-b039-b98a90762641 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:35.572048 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2a647bdd-98cc-4750-b039-b98a90762641 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] [instance: 41f1a22f-64b4-4564-94a9-99fc6740e0a1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:35.583955 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2a647bdd-98cc-4750-b039-b98a90762641 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:35.587475 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2a647bdd-98cc-4750-b039-b98a90762641 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:35.589150 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2a647bdd-98cc-4750-b039-b98a90762641 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:35.592342 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2a647bdd-98cc-4750-b039-b98a90762641 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:35.595477 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2a647bdd-98cc-4750-b039-b98a90762641 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:35.596160 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2a647bdd-98cc-4750-b039-b98a90762641 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:35.894228 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4a034e47-083e-49cb-985d-3bcbafdecdaf tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:35.894873 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4a034e47-083e-49cb-985d-3bcbafdecdaf tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:35.907725 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a034e47-083e-49cb-985d-3bcbafdecdaf tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:35.908280 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a034e47-083e-49cb-985d-3bcbafdecdaf tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:35.908753 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a034e47-083e-49cb-985d-3bcbafdecdaf tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:35.916015 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a034e47-083e-49cb-985d-3bcbafdecdaf tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:35.916525 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a034e47-083e-49cb-985d-3bcbafdecdaf tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:35.916974 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a034e47-083e-49cb-985d-3bcbafdecdaf tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:36.070006 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4a034e47-083e-49cb-985d-3bcbafdecdaf tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:36.079012 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4a034e47-083e-49cb-985d-3bcbafdecdaf tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65" status: 200 len: 1267 microversion: 2.1 time: 0.191299 Sep 08 11:09:36.083132 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2641/5371] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:35 2022] GET /compute/v2.1/servers/35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65 => generated 1267 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:09:36.612003 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2a647bdd-98cc-4750-b039-b98a90762641 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25641daaa044b1bb0e53d4d2b350f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdc4842f7d54826abd0086ad6654dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:36.637369 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2a647bdd-98cc-4750-b039-b98a90762641 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] 10.222.0.27 "GET /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1" status: 200 len: 1320 microversion: 2.1 time: 1.069338 Sep 08 11:09:36.637369 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2731/5372] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:35 2022] GET /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1 => generated 1320 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:09:36.921444 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-291be5d4-ed44-4729-866a-eb8ce2462b18 tempest-TestAggregatesBasicOps-855579361 tempest-TestAggregatesBasicOps-855579361-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-1611044563", "availability_zone": "foo_zone"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:09:36.926398 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.aggregate [None req-291be5d4-ed44-4729-866a-eb8ce2462b18 tempest-TestAggregatesBasicOps-855579361 tempest-TestAggregatesBasicOps-855579361-project-admin] Generated uuid 01acec27-3ece-4abc-9d20-64217f0bcb64 for aggregate {{(pid=128862) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 08 11:09:37.057910 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-291be5d4-ed44-4729-866a-eb8ce2462b18 tempest-TestAggregatesBasicOps-855579361 tempest-TestAggregatesBasicOps-855579361-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.964800 Sep 08 11:09:37.061493 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2642/5373] 10.222.0.27 () {60 vars in 1164 bytes} [Thu Sep 8 11:09:36 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:09:37.073006 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5b008abe-4d12-4a1b-8652-cc89b01efcf9 tempest-TestAggregatesBasicOps-855579361 tempest-TestAggregatesBasicOps-855579361-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:09:37.121821 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0d95f7ac-7449-4f18-9741-ddc14d998b01 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:37.125493 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0d95f7ac-7449-4f18-9741-ddc14d998b01 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:37.129248 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5b008abe-4d12-4a1b-8652-cc89b01efcf9 tempest-TestAggregatesBasicOps-855579361 tempest-TestAggregatesBasicOps-855579361-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.060231 Sep 08 11:09:37.131872 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2732/5374] 10.222.0.27 () {60 vars in 1194 bytes} [Thu Sep 8 11:09:37 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:09:37.143738 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5a2924ae-2eab-44b1-a93e-6da4a58a94e5 tempest-TestAggregatesBasicOps-855579361 tempest-TestAggregatesBasicOps-855579361-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:37.152940 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5a2924ae-2eab-44b1-a93e-6da4a58a94e5 tempest-TestAggregatesBasicOps-855579361 tempest-TestAggregatesBasicOps-855579361-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:37.154069 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d95f7ac-7449-4f18-9741-ddc14d998b01 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:37.155268 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d95f7ac-7449-4f18-9741-ddc14d998b01 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:37.155941 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5a2924ae-2eab-44b1-a93e-6da4a58a94e5 tempest-TestAggregatesBasicOps-855579361 tempest-TestAggregatesBasicOps-855579361-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:37.156180 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d95f7ac-7449-4f18-9741-ddc14d998b01 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:37.156633 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5a2924ae-2eab-44b1-a93e-6da4a58a94e5 tempest-TestAggregatesBasicOps-855579361 tempest-TestAggregatesBasicOps-855579361-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:37.157562 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d95f7ac-7449-4f18-9741-ddc14d998b01 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:37.158500 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d95f7ac-7449-4f18-9741-ddc14d998b01 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:37.158988 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5a2924ae-2eab-44b1-a93e-6da4a58a94e5 tempest-TestAggregatesBasicOps-855579361 tempest-TestAggregatesBasicOps-855579361-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:37.159400 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d95f7ac-7449-4f18-9741-ddc14d998b01 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:37.162566 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5a2924ae-2eab-44b1-a93e-6da4a58a94e5 tempest-TestAggregatesBasicOps-855579361 tempest-TestAggregatesBasicOps-855579361-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:37.164241 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5a2924ae-2eab-44b1-a93e-6da4a58a94e5 tempest-TestAggregatesBasicOps-855579361 tempest-TestAggregatesBasicOps-855579361-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:37.232075 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5a2924ae-2eab-44b1-a93e-6da4a58a94e5 tempest-TestAggregatesBasicOps-855579361 tempest-TestAggregatesBasicOps-855579361-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.091420 Sep 08 11:09:37.234364 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2733/5375] 10.222.0.27 () {58 vars in 1176 bytes} [Thu Sep 8 11:09:37 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:09:37.247010 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5d7292d9-1b90-43cb-b929-6c254df55220 tempest-TestAggregatesBasicOps-855579361 tempest-TestAggregatesBasicOps-855579361-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:37.264222 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5d7292d9-1b90-43cb-b929-6c254df55220 tempest-TestAggregatesBasicOps-855579361 tempest-TestAggregatesBasicOps-855579361-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.018980 Sep 08 11:09:37.265134 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2734/5376] 10.222.0.27 () {58 vars in 1143 bytes} [Thu Sep 8 11:09:37 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:09:37.277242 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-88542e2e-c721-4b5c-a289-d423403f6b19 tempest-TestAggregatesBasicOps-855579361 tempest-TestAggregatesBasicOps-855579361-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-850501-12"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:09:37.302254 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88542e2e-c721-4b5c-a289-d423403f6b19 tempest-TestAggregatesBasicOps-855579361 tempest-TestAggregatesBasicOps-855579361-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:37.303819 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88542e2e-c721-4b5c-a289-d423403f6b19 tempest-TestAggregatesBasicOps-855579361 tempest-TestAggregatesBasicOps-855579361-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:37.305675 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88542e2e-c721-4b5c-a289-d423403f6b19 tempest-TestAggregatesBasicOps-855579361 tempest-TestAggregatesBasicOps-855579361-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:37.589204 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-88542e2e-c721-4b5c-a289-d423403f6b19 tempest-TestAggregatesBasicOps-855579361 tempest-TestAggregatesBasicOps-855579361-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 311 microversion: 2.1 time: 0.316152 Sep 08 11:09:37.597919 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2735/5377] 10.222.0.27 () {60 vars in 1194 bytes} [Thu Sep 8 11:09:37 2022] POST /compute/v2.1/os-aggregates/19/action => generated 311 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:09:37.604394 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-68273c4e-2500-4cbe-9651-cef955fd3d1a tempest-TestAggregatesBasicOps-855579361 tempest-TestAggregatesBasicOps-855579361-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:37.638556 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-68273c4e-2500-4cbe-9651-cef955fd3d1a tempest-TestAggregatesBasicOps-855579361 tempest-TestAggregatesBasicOps-855579361-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 311 microversion: 2.1 time: 0.038801 Sep 08 11:09:37.640153 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2736/5378] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Sep 8 11:09:37 2022] GET /compute/v2.1/os-aggregates/19 => generated 311 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:09:37.655022 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-46c6b16c-a80b-4bf4-99b3-ba95aea1927e tempest-TestAggregatesBasicOps-855579361 tempest-TestAggregatesBasicOps-855579361-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-103690032", "availability_zone": "foo_zone"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:09:37.839254 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-46c6b16c-a80b-4bf4-99b3-ba95aea1927e tempest-TestAggregatesBasicOps-855579361 tempest-TestAggregatesBasicOps-855579361-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.189502 Sep 08 11:09:37.841488 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2737/5379] 10.222.0.27 () {60 vars in 1173 bytes} [Thu Sep 8 11:09:37 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:09:37.853497 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b6a0b69b-1f9d-4fa4-889e-9b098a0a750f tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:37.856248 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b6a0b69b-1f9d-4fa4-889e-9b098a0a750f tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] [instance: 41f1a22f-64b4-4564-94a9-99fc6740e0a1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:37.885533 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b6a0b69b-1f9d-4fa4-889e-9b098a0a750f tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:37.898677 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b6a0b69b-1f9d-4fa4-889e-9b098a0a750f tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:37.901868 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b6a0b69b-1f9d-4fa4-889e-9b098a0a750f tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:37.931077 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b6a0b69b-1f9d-4fa4-889e-9b098a0a750f tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:37.931865 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b6a0b69b-1f9d-4fa4-889e-9b098a0a750f tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:37.936016 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b6a0b69b-1f9d-4fa4-889e-9b098a0a750f tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:37.938196 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0d95f7ac-7449-4f18-9741-ddc14d998b01 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:37.948779 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0d95f7ac-7449-4f18-9741-ddc14d998b01 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65" status: 200 len: 1309 microversion: 2.1 time: 0.843486 Sep 08 11:09:37.953334 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2643/5380] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:37 2022] GET /compute/v2.1/servers/35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65 => generated 1309 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:09:37.965738 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-74d1175c-a7e7-4539-9cae-1981ee1a528e tempest-TestAggregatesBasicOps-855579361 tempest-TestAggregatesBasicOps-855579361-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:09:38.036690 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-74d1175c-a7e7-4539-9cae-1981ee1a528e tempest-TestAggregatesBasicOps-855579361 tempest-TestAggregatesBasicOps-855579361-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.080009 Sep 08 11:09:38.038804 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2644/5381] 10.222.0.27 () {60 vars in 1194 bytes} [Thu Sep 8 11:09:37 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:09:38.054222 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0e7a09e0-0b5a-4769-8aba-5d6354c4ed73 tempest-TestAggregatesBasicOps-855579361 tempest-TestAggregatesBasicOps-855579361-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:38.073689 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0e7a09e0-0b5a-4769-8aba-5d6354c4ed73 tempest-TestAggregatesBasicOps-855579361 tempest-TestAggregatesBasicOps-855579361-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.026638 Sep 08 11:09:38.088847 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2645/5382] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Sep 8 11:09:38 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:09:38.098329 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-252c6b62-bbe9-4e53-82f2-219dfcdd0baa tempest-TestAggregatesBasicOps-855579361 tempest-TestAggregatesBasicOps-855579361-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-850501-12"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:09:38.121877 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-252c6b62-bbe9-4e53-82f2-219dfcdd0baa tempest-TestAggregatesBasicOps-855579361 tempest-TestAggregatesBasicOps-855579361-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:38.123288 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-252c6b62-bbe9-4e53-82f2-219dfcdd0baa tempest-TestAggregatesBasicOps-855579361 tempest-TestAggregatesBasicOps-855579361-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:38.124552 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-252c6b62-bbe9-4e53-82f2-219dfcdd0baa tempest-TestAggregatesBasicOps-855579361 tempest-TestAggregatesBasicOps-855579361-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:38.423801 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b6a0b69b-1f9d-4fa4-889e-9b098a0a750f tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25641daaa044b1bb0e53d4d2b350f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdc4842f7d54826abd0086ad6654dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:38.436542 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b6a0b69b-1f9d-4fa4-889e-9b098a0a750f tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] 10.222.0.27 "GET /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1" status: 200 len: 1320 microversion: 2.1 time: 0.593889 Sep 08 11:09:38.449377 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2738/5383] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:37 2022] GET /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1 => generated 1320 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:09:38.845715 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-252c6b62-bbe9-4e53-82f2-219dfcdd0baa tempest-TestAggregatesBasicOps-855579361 tempest-TestAggregatesBasicOps-855579361-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.755166 Sep 08 11:09:38.860912 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-55223d2f-3ee2-42a3-ad81-a198c8b86bec tempest-TestAggregatesBasicOps-855579361 tempest-TestAggregatesBasicOps-855579361-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:38.863430 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2646/5384] 10.222.0.27 () {60 vars in 1194 bytes} [Thu Sep 8 11:09:38 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:09:38.933878 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-55223d2f-3ee2-42a3-ad81-a198c8b86bec tempest-TestAggregatesBasicOps-855579361 tempest-TestAggregatesBasicOps-855579361-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.079080 Sep 08 11:09:38.934501 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2739/5385] 10.222.0.27 () {58 vars in 1155 bytes} [Thu Sep 8 11:09:38 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Sep 08 11:09:38.980213 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-71ffcfa6-6fdf-46ed-a6c7-dc588365b954 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:38.982636 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-71ffcfa6-6fdf-46ed-a6c7-dc588365b954 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:39.005699 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71ffcfa6-6fdf-46ed-a6c7-dc588365b954 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:39.007201 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71ffcfa6-6fdf-46ed-a6c7-dc588365b954 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:39.008741 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71ffcfa6-6fdf-46ed-a6c7-dc588365b954 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:39.014837 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71ffcfa6-6fdf-46ed-a6c7-dc588365b954 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:39.016278 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71ffcfa6-6fdf-46ed-a6c7-dc588365b954 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:39.016878 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71ffcfa6-6fdf-46ed-a6c7-dc588365b954 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:39.442551 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-b66e81ca-1250-40bd-8f16-3694a93bb7ec req-3abf4baa-1bae-4708-9f8f-44cfe87452e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65", "tag": "335a743c-1f45-49f9-baee-da68db7f1a03"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:09:39.475810 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-b66e81ca-1250-40bd-8f16-3694a93bb7ec req-3abf4baa-1bae-4708-9f8f-44cfe87452e0 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:39.478610 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-b66e81ca-1250-40bd-8f16-3694a93bb7ec req-3abf4baa-1bae-4708-9f8f-44cfe87452e0 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:39.479263 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-b66e81ca-1250-40bd-8f16-3694a93bb7ec req-3abf4baa-1bae-4708-9f8f-44cfe87452e0 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:39.516410 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-b66e81ca-1250-40bd-8f16-3694a93bb7ec req-3abf4baa-1bae-4708-9f8f-44cfe87452e0 service nova] Creating event network-changed:335a743c-1f45-49f9-baee-da68db7f1a03 for instance 35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65 on n-h1-850501-12 Sep 08 11:09:39.532760 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-b66e81ca-1250-40bd-8f16-3694a93bb7ec req-3abf4baa-1bae-4708-9f8f-44cfe87452e0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094663 Sep 08 11:09:39.540710 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2740/5386] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:09:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:09:39.548335 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a2618730-311e-4891-bcef-aba2b5981509 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:39.549311 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a2618730-311e-4891-bcef-aba2b5981509 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] [instance: 41f1a22f-64b4-4564-94a9-99fc6740e0a1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:39.573164 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a2618730-311e-4891-bcef-aba2b5981509 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:39.574497 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a2618730-311e-4891-bcef-aba2b5981509 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:39.574977 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a2618730-311e-4891-bcef-aba2b5981509 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:39.580141 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a2618730-311e-4891-bcef-aba2b5981509 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:39.580887 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a2618730-311e-4891-bcef-aba2b5981509 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:39.581374 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a2618730-311e-4891-bcef-aba2b5981509 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:39.599840 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-71ffcfa6-6fdf-46ed-a6c7-dc588365b954 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:39.616733 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-71ffcfa6-6fdf-46ed-a6c7-dc588365b954 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65" status: 200 len: 1309 microversion: 2.1 time: 0.639132 Sep 08 11:09:39.629898 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2647/5387] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:38 2022] GET /compute/v2.1/servers/35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65 => generated 1309 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:09:40.239445 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a2618730-311e-4891-bcef-aba2b5981509 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25641daaa044b1bb0e53d4d2b350f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdc4842f7d54826abd0086ad6654dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:40.253289 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a2618730-311e-4891-bcef-aba2b5981509 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] 10.222.0.27 "GET /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1" status: 200 len: 1320 microversion: 2.1 time: 0.709994 Sep 08 11:09:40.253890 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2741/5388] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:39 2022] GET /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1 => generated 1320 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:09:40.641007 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b0202f93-e5d9-4f85-8623-2992a22185ab tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:40.641753 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b0202f93-e5d9-4f85-8623-2992a22185ab tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:40.658536 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b0202f93-e5d9-4f85-8623-2992a22185ab tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:40.659111 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b0202f93-e5d9-4f85-8623-2992a22185ab tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:40.659618 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b0202f93-e5d9-4f85-8623-2992a22185ab tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:40.660441 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b0202f93-e5d9-4f85-8623-2992a22185ab tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:40.663418 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b0202f93-e5d9-4f85-8623-2992a22185ab tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:40.663994 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b0202f93-e5d9-4f85-8623-2992a22185ab tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:41.283480 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1a106edf-61f8-41da-ad64-bdf5b371d6a7 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:41.284120 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1a106edf-61f8-41da-ad64-bdf5b371d6a7 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] [instance: 41f1a22f-64b4-4564-94a9-99fc6740e0a1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:41.286509 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=16 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:09:41.312345 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1a106edf-61f8-41da-ad64-bdf5b371d6a7 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:41.313890 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1a106edf-61f8-41da-ad64-bdf5b371d6a7 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:41.315209 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1a106edf-61f8-41da-ad64-bdf5b371d6a7 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:41.331820 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1a106edf-61f8-41da-ad64-bdf5b371d6a7 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:41.332846 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1a106edf-61f8-41da-ad64-bdf5b371d6a7 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:41.333611 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1a106edf-61f8-41da-ad64-bdf5b371d6a7 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:41.485511 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b0202f93-e5d9-4f85-8623-2992a22185ab tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:41.505179 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b0202f93-e5d9-4f85-8623-2992a22185ab tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65" status: 200 len: 1309 microversion: 2.1 time: 0.868591 Sep 08 11:09:41.517827 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2648/5389] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:40 2022] GET /compute/v2.1/servers/35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65 => generated 1309 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:09:41.776446 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1a106edf-61f8-41da-ad64-bdf5b371d6a7 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25641daaa044b1bb0e53d4d2b350f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdc4842f7d54826abd0086ad6654dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:41.791627 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1a106edf-61f8-41da-ad64-bdf5b371d6a7 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] 10.222.0.27 "GET /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1" status: 200 len: 1320 microversion: 2.1 time: 0.515021 Sep 08 11:09:41.792706 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2742/5390] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:41 2022] GET /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1 => generated 1320 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:09:42.531564 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-de735e55-ccb9-42fe-b14f-87e049342578 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:42.532234 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-de735e55-ccb9-42fe-b14f-87e049342578 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:42.537480 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:09:42.549733 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de735e55-ccb9-42fe-b14f-87e049342578 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:42.550643 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de735e55-ccb9-42fe-b14f-87e049342578 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:42.551409 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de735e55-ccb9-42fe-b14f-87e049342578 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:42.552448 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de735e55-ccb9-42fe-b14f-87e049342578 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:42.553180 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de735e55-ccb9-42fe-b14f-87e049342578 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:42.554916 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de735e55-ccb9-42fe-b14f-87e049342578 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:42.836499 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5e8913f8-4526-4861-b6a1-607aa9da62e7 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:42.838440 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5e8913f8-4526-4861-b6a1-607aa9da62e7 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] [instance: 41f1a22f-64b4-4564-94a9-99fc6740e0a1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:42.888157 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5e8913f8-4526-4861-b6a1-607aa9da62e7 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:42.889378 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5e8913f8-4526-4861-b6a1-607aa9da62e7 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:42.890534 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5e8913f8-4526-4861-b6a1-607aa9da62e7 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:42.894396 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5e8913f8-4526-4861-b6a1-607aa9da62e7 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:42.895486 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5e8913f8-4526-4861-b6a1-607aa9da62e7 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:42.898524 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5e8913f8-4526-4861-b6a1-607aa9da62e7 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:43.757524 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5e8913f8-4526-4861-b6a1-607aa9da62e7 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25641daaa044b1bb0e53d4d2b350f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdc4842f7d54826abd0086ad6654dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:43.777355 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5e8913f8-4526-4861-b6a1-607aa9da62e7 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] 10.222.0.27 "GET /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1" status: 200 len: 1320 microversion: 2.1 time: 0.960557 Sep 08 11:09:43.777799 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2743/5391] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:42 2022] GET /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1 => generated 1320 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:09:43.861811 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-aeb3baa2-5a3e-479e-ba05-3a2a456c3502 req-d21f3a2e-17d6-4023-b1ea-c99353e17345 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41f1a22f-64b4-4564-94a9-99fc6740e0a1", "name": "network-vif-plugged", "status": "completed", "tag": "62403e83-a296-4c79-be79-7a813046d1fe"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:09:43.887122 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-aeb3baa2-5a3e-479e-ba05-3a2a456c3502 req-d21f3a2e-17d6-4023-b1ea-c99353e17345 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:43.887339 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-aeb3baa2-5a3e-479e-ba05-3a2a456c3502 req-d21f3a2e-17d6-4023-b1ea-c99353e17345 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:43.895241 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-aeb3baa2-5a3e-479e-ba05-3a2a456c3502 req-d21f3a2e-17d6-4023-b1ea-c99353e17345 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:43.930958 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-aeb3baa2-5a3e-479e-ba05-3a2a456c3502 req-d21f3a2e-17d6-4023-b1ea-c99353e17345 service nova] Creating event network-vif-plugged:62403e83-a296-4c79-be79-7a813046d1fe for instance 41f1a22f-64b4-4564-94a9-99fc6740e0a1 on n-h2-850501-12 Sep 08 11:09:43.944651 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-aeb3baa2-5a3e-479e-ba05-3a2a456c3502 req-d21f3a2e-17d6-4023-b1ea-c99353e17345 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086628 Sep 08 11:09:43.945656 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2744/5392] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:09:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:09:44.020774 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-de735e55-ccb9-42fe-b14f-87e049342578 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:44.034106 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-de735e55-ccb9-42fe-b14f-87e049342578 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65" status: 200 len: 1309 microversion: 2.1 time: 1.507410 Sep 08 11:09:44.041016 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2649/5393] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:42 2022] GET /compute/v2.1/servers/35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65 => generated 1309 bytes in 1516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:09:44.804829 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-28fc5429-d3cc-4a1b-81a1-803f2d240bd0 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:44.806037 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-28fc5429-d3cc-4a1b-81a1-803f2d240bd0 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] [instance: 41f1a22f-64b4-4564-94a9-99fc6740e0a1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:44.818801 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-28fc5429-d3cc-4a1b-81a1-803f2d240bd0 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:44.819661 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-28fc5429-d3cc-4a1b-81a1-803f2d240bd0 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:44.821919 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-28fc5429-d3cc-4a1b-81a1-803f2d240bd0 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:44.825766 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-28fc5429-d3cc-4a1b-81a1-803f2d240bd0 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:44.826804 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-28fc5429-d3cc-4a1b-81a1-803f2d240bd0 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:44.827564 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-28fc5429-d3cc-4a1b-81a1-803f2d240bd0 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:45.062426 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b97809cc-4185-4025-8fd6-90065939e287 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:45.063839 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b97809cc-4185-4025-8fd6-90065939e287 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:45.094273 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b97809cc-4185-4025-8fd6-90065939e287 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:45.100486 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b97809cc-4185-4025-8fd6-90065939e287 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:45.101332 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b97809cc-4185-4025-8fd6-90065939e287 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:45.102318 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b97809cc-4185-4025-8fd6-90065939e287 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:45.103008 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b97809cc-4185-4025-8fd6-90065939e287 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:45.103659 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b97809cc-4185-4025-8fd6-90065939e287 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:46.252802 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b97809cc-4185-4025-8fd6-90065939e287 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:46.265526 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b97809cc-4185-4025-8fd6-90065939e287 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65" status: 200 len: 1309 microversion: 2.1 time: 1.208847 Sep 08 11:09:46.266155 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2650/5394] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:45 2022] GET /compute/v2.1/servers/35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65 => generated 1309 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:09:46.402123 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-28fc5429-d3cc-4a1b-81a1-803f2d240bd0 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25641daaa044b1bb0e53d4d2b350f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdc4842f7d54826abd0086ad6654dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:46.414274 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-28fc5429-d3cc-4a1b-81a1-803f2d240bd0 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] 10.222.0.27 "GET /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1" status: 200 len: 1320 microversion: 2.1 time: 1.613919 Sep 08 11:09:46.414866 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2745/5395] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:44 2022] GET /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1 => generated 1320 bytes in 1616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:09:46.509430 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-297b165a-e897-40be-99d4-98e53147203d req-c1ca8ad2-bce1-4683-95df-6df9ab2f7085 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65", "name": "network-vif-plugged", "status": "completed", "tag": "335a743c-1f45-49f9-baee-da68db7f1a03"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:09:46.533441 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-297b165a-e897-40be-99d4-98e53147203d req-c1ca8ad2-bce1-4683-95df-6df9ab2f7085 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:46.533984 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-297b165a-e897-40be-99d4-98e53147203d req-c1ca8ad2-bce1-4683-95df-6df9ab2f7085 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:46.534424 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-297b165a-e897-40be-99d4-98e53147203d req-c1ca8ad2-bce1-4683-95df-6df9ab2f7085 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:46.581262 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-297b165a-e897-40be-99d4-98e53147203d req-c1ca8ad2-bce1-4683-95df-6df9ab2f7085 service nova] Creating event network-vif-plugged:335a743c-1f45-49f9-baee-da68db7f1a03 for instance 35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65 on n-h1-850501-12 Sep 08 11:09:46.600332 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-297b165a-e897-40be-99d4-98e53147203d req-c1ca8ad2-bce1-4683-95df-6df9ab2f7085 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096092 Sep 08 11:09:46.601012 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2651/5396] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:09:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:09:47.297140 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-be4094cb-401f-460d-8757-128a726f69a5 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:47.298095 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-be4094cb-401f-460d-8757-128a726f69a5 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:47.338084 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=4 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:09:47.346677 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-be4094cb-401f-460d-8757-128a726f69a5 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:47.348818 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-be4094cb-401f-460d-8757-128a726f69a5 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:47.350707 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-be4094cb-401f-460d-8757-128a726f69a5 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:47.352148 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-be4094cb-401f-460d-8757-128a726f69a5 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:47.358749 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-be4094cb-401f-460d-8757-128a726f69a5 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:47.359691 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-be4094cb-401f-460d-8757-128a726f69a5 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:47.445744 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bf6b40b5-3446-4fad-8a9f-25417ea1a4a9 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:47.446583 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bf6b40b5-3446-4fad-8a9f-25417ea1a4a9 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] [instance: 41f1a22f-64b4-4564-94a9-99fc6740e0a1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:47.467654 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf6b40b5-3446-4fad-8a9f-25417ea1a4a9 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:47.468676 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf6b40b5-3446-4fad-8a9f-25417ea1a4a9 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:47.470982 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf6b40b5-3446-4fad-8a9f-25417ea1a4a9 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:47.472527 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf6b40b5-3446-4fad-8a9f-25417ea1a4a9 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:47.473416 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf6b40b5-3446-4fad-8a9f-25417ea1a4a9 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:47.474319 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf6b40b5-3446-4fad-8a9f-25417ea1a4a9 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:48.149481 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bf6b40b5-3446-4fad-8a9f-25417ea1a4a9 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25641daaa044b1bb0e53d4d2b350f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdc4842f7d54826abd0086ad6654dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:48.179665 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bf6b40b5-3446-4fad-8a9f-25417ea1a4a9 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] 10.222.0.27 "GET /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1" status: 200 len: 1516 microversion: 2.1 time: 0.739783 Sep 08 11:09:48.180732 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2652/5397] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:47 2022] GET /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1 => generated 1516 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:09:48.244093 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4c06fe9e-31dd-4a8f-95b7-b880afbfdbd7 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:09:48.250295 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4c06fe9e-31dd-4a8f-95b7-b880afbfdbd7 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] [instance: 41f1a22f-64b4-4564-94a9-99fc6740e0a1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:48.279356 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c06fe9e-31dd-4a8f-95b7-b880afbfdbd7 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:48.282803 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c06fe9e-31dd-4a8f-95b7-b880afbfdbd7 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:48.286007 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c06fe9e-31dd-4a8f-95b7-b880afbfdbd7 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:48.297860 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c06fe9e-31dd-4a8f-95b7-b880afbfdbd7 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:48.302077 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c06fe9e-31dd-4a8f-95b7-b880afbfdbd7 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:48.308925 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c06fe9e-31dd-4a8f-95b7-b880afbfdbd7 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:48.423768 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-4c06fe9e-31dd-4a8f-95b7-b880afbfdbd7 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lazy-loading 'flavor' on Instance uuid 41f1a22f-64b4-4564-94a9-99fc6740e0a1 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:09:48.523172 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-be4094cb-401f-460d-8757-128a726f69a5 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:48.556326 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-be4094cb-401f-460d-8757-128a726f69a5 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65" status: 200 len: 1309 microversion: 2.1 time: 1.268325 Sep 08 11:09:48.556326 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2746/5398] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:47 2022] GET /compute/v2.1/servers/35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65 => generated 1309 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:09:48.615262 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4c06fe9e-31dd-4a8f-95b7-b880afbfdbd7 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] 10.222.0.27 "POST /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1/action" status: 200 len: 32 microversion: 2.1 time: 0.397104 Sep 08 11:09:48.626730 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-90ca0369-fdc2-42e6-80be-efe52d4d405a tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:48.628057 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-90ca0369-fdc2-42e6-80be-efe52d4d405a tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] [instance: 41f1a22f-64b4-4564-94a9-99fc6740e0a1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:48.634298 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2653/5399] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 11:09:48 2022] POST /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1/action => generated 32 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 11:09:48.635213 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90ca0369-fdc2-42e6-80be-efe52d4d405a tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:48.635853 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90ca0369-fdc2-42e6-80be-efe52d4d405a tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:48.652571 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90ca0369-fdc2-42e6-80be-efe52d4d405a tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:48.654465 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90ca0369-fdc2-42e6-80be-efe52d4d405a tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:48.654950 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90ca0369-fdc2-42e6-80be-efe52d4d405a tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:48.665464 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90ca0369-fdc2-42e6-80be-efe52d4d405a tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:49.151237 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-90ca0369-fdc2-42e6-80be-efe52d4d405a tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25641daaa044b1bb0e53d4d2b350f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdc4842f7d54826abd0086ad6654dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:49.168396 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-90ca0369-fdc2-42e6-80be-efe52d4d405a tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] 10.222.0.27 "GET /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1" status: 200 len: 1522 microversion: 2.1 time: 0.546196 Sep 08 11:09:49.170644 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2747/5400] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:48 2022] GET /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1 => generated 1522 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:09:49.595648 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d87eae99-af2a-4b80-8c78-9feb35ae4548 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:49.596491 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d87eae99-af2a-4b80-8c78-9feb35ae4548 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:49.611588 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d87eae99-af2a-4b80-8c78-9feb35ae4548 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:49.612100 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d87eae99-af2a-4b80-8c78-9feb35ae4548 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:49.612548 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d87eae99-af2a-4b80-8c78-9feb35ae4548 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:49.613311 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d87eae99-af2a-4b80-8c78-9feb35ae4548 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:49.613758 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d87eae99-af2a-4b80-8c78-9feb35ae4548 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:49.614189 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d87eae99-af2a-4b80-8c78-9feb35ae4548 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:50.203222 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0d493482-bec1-4c72-ab0e-f55ede1fa4d4 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:50.203902 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0d493482-bec1-4c72-ab0e-f55ede1fa4d4 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] [instance: 41f1a22f-64b4-4564-94a9-99fc6740e0a1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:50.225581 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d493482-bec1-4c72-ab0e-f55ede1fa4d4 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:50.226094 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d493482-bec1-4c72-ab0e-f55ede1fa4d4 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:50.226546 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d493482-bec1-4c72-ab0e-f55ede1fa4d4 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:50.230298 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d493482-bec1-4c72-ab0e-f55ede1fa4d4 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:50.231365 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d493482-bec1-4c72-ab0e-f55ede1fa4d4 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:50.232056 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d493482-bec1-4c72-ab0e-f55ede1fa4d4 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:50.242335 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d87eae99-af2a-4b80-8c78-9feb35ae4548 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:50.252409 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d87eae99-af2a-4b80-8c78-9feb35ae4548 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65" status: 200 len: 1490 microversion: 2.1 time: 0.661769 Sep 08 11:09:50.261714 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2654/5401] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:49 2022] GET /compute/v2.1/servers/35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65 => generated 1490 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:09:50.288641 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-edb732ee-649f-4cb2-8694-a07e42248f19 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:50.289782 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-edb732ee-649f-4cb2-8694-a07e42248f19 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: c8060dc4-1634-4142-a4fe-35ee4ffc74f2] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:50.303122 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-edb732ee-649f-4cb2-8694-a07e42248f19 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:50.303639 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-edb732ee-649f-4cb2-8694-a07e42248f19 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:50.304083 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-edb732ee-649f-4cb2-8694-a07e42248f19 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:50.304807 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-edb732ee-649f-4cb2-8694-a07e42248f19 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:50.305290 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-edb732ee-649f-4cb2-8694-a07e42248f19 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:50.305723 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-edb732ee-649f-4cb2-8694-a07e42248f19 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:50.709221 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-edb732ee-649f-4cb2-8694-a07e42248f19 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:50.728482 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-edb732ee-649f-4cb2-8694-a07e42248f19 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/c8060dc4-1634-4142-a4fe-35ee4ffc74f2" status: 200 len: 1491 microversion: 2.1 time: 0.443263 Sep 08 11:09:50.733165 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2655/5402] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:50 2022] GET /compute/v2.1/servers/c8060dc4-1634-4142-a4fe-35ee4ffc74f2 => generated 1491 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:09:50.755634 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-86f4e940-0dc4-45cd-9f89-784bdaa494c9 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:50.756440 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-86f4e940-0dc4-45cd-9f89-784bdaa494c9 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:50.776171 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-86f4e940-0dc4-45cd-9f89-784bdaa494c9 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:50.784676 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-86f4e940-0dc4-45cd-9f89-784bdaa494c9 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:50.785517 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-86f4e940-0dc4-45cd-9f89-784bdaa494c9 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:50.786502 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-86f4e940-0dc4-45cd-9f89-784bdaa494c9 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:50.787791 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-86f4e940-0dc4-45cd-9f89-784bdaa494c9 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:50.788492 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-86f4e940-0dc4-45cd-9f89-784bdaa494c9 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:51.019797 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-86f4e940-0dc4-45cd-9f89-784bdaa494c9 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:51.033935 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-86f4e940-0dc4-45cd-9f89-784bdaa494c9 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65" status: 200 len: 1490 microversion: 2.1 time: 0.282160 Sep 08 11:09:51.035155 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2656/5403] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:50 2022] GET /compute/v2.1/servers/35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65 => generated 1490 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:09:51.061400 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-190aceb1-4bb2-4f14-be64-d226d7c0c24a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:51.062793 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-190aceb1-4bb2-4f14-be64-d226d7c0c24a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:51.079101 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-190aceb1-4bb2-4f14-be64-d226d7c0c24a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:51.080226 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-190aceb1-4bb2-4f14-be64-d226d7c0c24a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:51.081203 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-190aceb1-4bb2-4f14-be64-d226d7c0c24a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:51.081882 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-190aceb1-4bb2-4f14-be64-d226d7c0c24a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:51.082453 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-190aceb1-4bb2-4f14-be64-d226d7c0c24a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:51.083140 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-190aceb1-4bb2-4f14-be64-d226d7c0c24a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:51.091097 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0d493482-bec1-4c72-ab0e-f55ede1fa4d4 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25641daaa044b1bb0e53d4d2b350f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdc4842f7d54826abd0086ad6654dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:51.102767 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0d493482-bec1-4c72-ab0e-f55ede1fa4d4 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] 10.222.0.27 "GET /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1" status: 200 len: 1522 microversion: 2.1 time: 0.903994 Sep 08 11:09:51.105472 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2748/5404] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:50 2022] GET /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1 => generated 1522 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:09:51.225450 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-190aceb1-4bb2-4f14-be64-d226d7c0c24a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:09:51.383742 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:09:51.509338 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-190aceb1-4bb2-4f14-be64-d226d7c0c24a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "DELETE /compute/v2.1/servers/35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65" status: 204 len: 0 microversion: 2.1 time: 0.454011 Sep 08 11:09:51.513531 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2657/5405] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:09:51 2022] DELETE /compute/v2.1/servers/35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:09:51.522055 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-69604e17-86da-447b-a9d2-7f9401f9a773 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:51.522808 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-69604e17-86da-447b-a9d2-7f9401f9a773 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:51.539674 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-69604e17-86da-447b-a9d2-7f9401f9a773 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:51.540346 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-69604e17-86da-447b-a9d2-7f9401f9a773 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:51.542676 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-69604e17-86da-447b-a9d2-7f9401f9a773 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:51.544203 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-69604e17-86da-447b-a9d2-7f9401f9a773 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:51.548904 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-69604e17-86da-447b-a9d2-7f9401f9a773 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:51.549541 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-69604e17-86da-447b-a9d2-7f9401f9a773 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:52.065076 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-69604e17-86da-447b-a9d2-7f9401f9a773 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:52.101889 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-69604e17-86da-447b-a9d2-7f9401f9a773 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65" status: 200 len: 1496 microversion: 2.1 time: 0.566293 Sep 08 11:09:52.101889 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2749/5406] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:51 2022] GET /compute/v2.1/servers/35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65 => generated 1496 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:09:52.133265 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-04e1716f-7f9d-4079-8a6e-d0010c321e28 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:52.135349 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-04e1716f-7f9d-4079-8a6e-d0010c321e28 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] [instance: 41f1a22f-64b4-4564-94a9-99fc6740e0a1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:52.160634 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04e1716f-7f9d-4079-8a6e-d0010c321e28 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:52.161089 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04e1716f-7f9d-4079-8a6e-d0010c321e28 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:52.161570 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04e1716f-7f9d-4079-8a6e-d0010c321e28 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:52.162300 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04e1716f-7f9d-4079-8a6e-d0010c321e28 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:52.162757 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04e1716f-7f9d-4079-8a6e-d0010c321e28 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:52.163200 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04e1716f-7f9d-4079-8a6e-d0010c321e28 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:52.786776 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-04e1716f-7f9d-4079-8a6e-d0010c321e28 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25641daaa044b1bb0e53d4d2b350f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdc4842f7d54826abd0086ad6654dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:52.804344 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-04e1716f-7f9d-4079-8a6e-d0010c321e28 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] 10.222.0.27 "GET /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1" status: 200 len: 1522 microversion: 2.1 time: 0.677784 Sep 08 11:09:52.812083 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2658/5407] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:52 2022] GET /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1 => generated 1522 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:09:53.126352 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f8473f1f-e187-4c35-9783-4c6b4c15babc tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:53.128377 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f8473f1f-e187-4c35-9783-4c6b4c15babc tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:53.148204 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f8473f1f-e187-4c35-9783-4c6b4c15babc tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:53.148824 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f8473f1f-e187-4c35-9783-4c6b4c15babc tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:53.149552 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f8473f1f-e187-4c35-9783-4c6b4c15babc tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:53.150789 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f8473f1f-e187-4c35-9783-4c6b4c15babc tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:53.151263 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f8473f1f-e187-4c35-9783-4c6b4c15babc tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:53.151847 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f8473f1f-e187-4c35-9783-4c6b4c15babc tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:53.680575 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f8473f1f-e187-4c35-9783-4c6b4c15babc tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:53.722739 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f8473f1f-e187-4c35-9783-4c6b4c15babc tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65" status: 200 len: 1496 microversion: 2.1 time: 0.597423 Sep 08 11:09:53.732734 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2750/5408] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:53 2022] GET /compute/v2.1/servers/35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65 => generated 1496 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:09:53.834707 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a1c7dfe5-ef23-4880-bc30-914912703bd5 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:53.835362 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a1c7dfe5-ef23-4880-bc30-914912703bd5 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] [instance: 41f1a22f-64b4-4564-94a9-99fc6740e0a1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:53.852722 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a1c7dfe5-ef23-4880-bc30-914912703bd5 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:53.853498 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a1c7dfe5-ef23-4880-bc30-914912703bd5 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:53.854187 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a1c7dfe5-ef23-4880-bc30-914912703bd5 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:53.855238 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a1c7dfe5-ef23-4880-bc30-914912703bd5 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:53.856225 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a1c7dfe5-ef23-4880-bc30-914912703bd5 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:53.856940 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a1c7dfe5-ef23-4880-bc30-914912703bd5 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:54.273999 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a1c7dfe5-ef23-4880-bc30-914912703bd5 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25641daaa044b1bb0e53d4d2b350f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdc4842f7d54826abd0086ad6654dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:54.284869 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a1c7dfe5-ef23-4880-bc30-914912703bd5 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] 10.222.0.27 "GET /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1" status: 200 len: 1522 microversion: 2.1 time: 0.453962 Sep 08 11:09:54.298111 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2659/5409] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:53 2022] GET /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1 => generated 1522 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:09:54.790359 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-13226ab8-6195-423f-9fbb-79335825f67a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:54.792056 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-13226ab8-6195-423f-9fbb-79335825f67a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:54.807225 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-13226ab8-6195-423f-9fbb-79335825f67a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:54.818111 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-13226ab8-6195-423f-9fbb-79335825f67a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:54.818888 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-13226ab8-6195-423f-9fbb-79335825f67a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:54.822063 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-13226ab8-6195-423f-9fbb-79335825f67a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:54.824046 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-13226ab8-6195-423f-9fbb-79335825f67a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:54.826370 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-13226ab8-6195-423f-9fbb-79335825f67a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:54.979372 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-33a19a99-60c9-4002-b1ae-aab447922c49 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "da4539f8-7c64-4a3c-954c-5a48f785ecea", "device": "/dev/sdb"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:09:54.982829 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-33a19a99-60c9-4002-b1ae-aab447922c49 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] [instance: 5b547b31-4774-4c3b-a092-f10d890d57e6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:54.997699 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33a19a99-60c9-4002-b1ae-aab447922c49 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:54.998254 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33a19a99-60c9-4002-b1ae-aab447922c49 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:54.998726 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33a19a99-60c9-4002-b1ae-aab447922c49 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:54.999490 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33a19a99-60c9-4002-b1ae-aab447922c49 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:55.008240 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33a19a99-60c9-4002-b1ae-aab447922c49 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:55.008750 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33a19a99-60c9-4002-b1ae-aab447922c49 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:55.507677 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-13226ab8-6195-423f-9fbb-79335825f67a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:55.519671 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-13226ab8-6195-423f-9fbb-79335825f67a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65" status: 200 len: 1496 microversion: 2.1 time: 0.740435 Sep 08 11:09:55.521648 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2751/5410] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:54 2022] GET /compute/v2.1/servers/35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65 => generated 1496 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:09:55.529321 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-88bd07f4-69ba-4a9e-a6e5-a5f51b8b58dc tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:55.530329 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-88bd07f4-69ba-4a9e-a6e5-a5f51b8b58dc tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] [instance: 41f1a22f-64b4-4564-94a9-99fc6740e0a1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:55.540000 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88bd07f4-69ba-4a9e-a6e5-a5f51b8b58dc tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:55.540985 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88bd07f4-69ba-4a9e-a6e5-a5f51b8b58dc tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:55.541948 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88bd07f4-69ba-4a9e-a6e5-a5f51b8b58dc tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:55.543267 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88bd07f4-69ba-4a9e-a6e5-a5f51b8b58dc tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:55.545418 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88bd07f4-69ba-4a9e-a6e5-a5f51b8b58dc tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:55.546190 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88bd07f4-69ba-4a9e-a6e5-a5f51b8b58dc tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:55.575388 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-33a19a99-60c9-4002-b1ae-aab447922c49 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] 10.222.0.27 "POST /compute/v2.1/servers/5b547b31-4774-4c3b-a092-f10d890d57e6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.590448 Sep 08 11:09:55.586673 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2660/5411] 10.222.0.27 () {60 vars in 1323 bytes} [Thu Sep 8 11:09:54 2022] POST /compute/v2.1/servers/5b547b31-4774-4c3b-a092-f10d890d57e6/os-volume_attachments => generated 194 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:09:55.907342 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-88bd07f4-69ba-4a9e-a6e5-a5f51b8b58dc tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25641daaa044b1bb0e53d4d2b350f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdc4842f7d54826abd0086ad6654dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:55.910888 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=100 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:09:55.926361 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-88bd07f4-69ba-4a9e-a6e5-a5f51b8b58dc tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] 10.222.0.27 "GET /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1" status: 200 len: 1522 microversion: 2.1 time: 0.402966 Sep 08 11:09:55.930204 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2752/5412] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:55 2022] GET /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1 => generated 1522 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:09:56.225606 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-6476259b-bb16-49ec-8790-8a4bbb409fa3 req-ebb17370-ceb8-4159-b01b-3923bf7f6b41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65", "name": "network-vif-deleted", "tag": "335a743c-1f45-49f9-baee-da68db7f1a03"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:09:56.266246 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-6476259b-bb16-49ec-8790-8a4bbb409fa3 req-ebb17370-ceb8-4159-b01b-3923bf7f6b41 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:56.267077 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-6476259b-bb16-49ec-8790-8a4bbb409fa3 req-ebb17370-ceb8-4159-b01b-3923bf7f6b41 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:56.267723 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-6476259b-bb16-49ec-8790-8a4bbb409fa3 req-ebb17370-ceb8-4159-b01b-3923bf7f6b41 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:56.301629 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-6476259b-bb16-49ec-8790-8a4bbb409fa3 req-ebb17370-ceb8-4159-b01b-3923bf7f6b41 service nova] Creating event network-vif-deleted:335a743c-1f45-49f9-baee-da68db7f1a03 for instance 35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65 on n-h1-850501-12 Sep 08 11:09:56.333287 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-6476259b-bb16-49ec-8790-8a4bbb409fa3 req-ebb17370-ceb8-4159-b01b-3923bf7f6b41 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111779 Sep 08 11:09:56.336013 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2661/5413] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:09:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:09:56.558196 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5834f1cd-5623-44c4-afe2-08d11f855f4a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:56.560370 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5834f1cd-5623-44c4-afe2-08d11f855f4a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:56.576124 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5834f1cd-5623-44c4-afe2-08d11f855f4a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:56.578506 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5834f1cd-5623-44c4-afe2-08d11f855f4a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:56.582105 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5834f1cd-5623-44c4-afe2-08d11f855f4a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:56.582983 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5834f1cd-5623-44c4-afe2-08d11f855f4a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:56.583509 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5834f1cd-5623-44c4-afe2-08d11f855f4a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:56.583902 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5834f1cd-5623-44c4-afe2-08d11f855f4a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:56.667273 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5834f1cd-5623-44c4-afe2-08d11f855f4a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:56.668533 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5834f1cd-5623-44c4-afe2-08d11f855f4a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:56.672619 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5834f1cd-5623-44c4-afe2-08d11f855f4a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:56.673365 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-5834f1cd-5623-44c4-afe2-08d11f855f4a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lazy-loading 'fault' on Instance uuid 35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65 {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:09:56.776455 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5834f1cd-5623-44c4-afe2-08d11f855f4a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:56.789203 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5834f1cd-5623-44c4-afe2-08d11f855f4a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65" status: 200 len: 1299 microversion: 2.1 time: 0.237083 Sep 08 11:09:56.791886 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2753/5414] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:56 2022] GET /compute/v2.1/servers/35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65 => generated 1299 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:09:56.963455 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0754076a-0481-45fc-ba28-c4730b3be418 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:56.964436 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0754076a-0481-45fc-ba28-c4730b3be418 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] [instance: 41f1a22f-64b4-4564-94a9-99fc6740e0a1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:56.989858 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0754076a-0481-45fc-ba28-c4730b3be418 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:56.990789 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0754076a-0481-45fc-ba28-c4730b3be418 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:56.991414 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0754076a-0481-45fc-ba28-c4730b3be418 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:56.994764 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0754076a-0481-45fc-ba28-c4730b3be418 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:56.995472 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0754076a-0481-45fc-ba28-c4730b3be418 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:56.997068 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0754076a-0481-45fc-ba28-c4730b3be418 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:57.519463 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0754076a-0481-45fc-ba28-c4730b3be418 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25641daaa044b1bb0e53d4d2b350f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdc4842f7d54826abd0086ad6654dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:57.527983 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0754076a-0481-45fc-ba28-c4730b3be418 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] 10.222.0.27 "GET /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1" status: 200 len: 1522 microversion: 2.1 time: 0.571720 Sep 08 11:09:57.530899 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2662/5415] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:56 2022] GET /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1 => generated 1522 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:09:57.820324 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b07b5753-d543-439a-9b56-705818d840e8 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:57.822084 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b07b5753-d543-439a-9b56-705818d840e8 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:57.826168 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=5,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:09:57.833586 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b07b5753-d543-439a-9b56-705818d840e8 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:57.834321 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b07b5753-d543-439a-9b56-705818d840e8 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:57.835357 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b07b5753-d543-439a-9b56-705818d840e8 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:57.836275 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b07b5753-d543-439a-9b56-705818d840e8 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:57.837558 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b07b5753-d543-439a-9b56-705818d840e8 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:57.838954 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b07b5753-d543-439a-9b56-705818d840e8 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:57.861763 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-b07b5753-d543-439a-9b56-705818d840e8 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] HTTP exception thrown: Instance 35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65 could not be found. Sep 08 11:09:57.881258 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b07b5753-d543-439a-9b56-705818d840e8 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Request method failure captured: Sep 08 11:09:57.881258 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65 HTTP/1.1 Sep 08 11:09:57.881258 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:09:57.881258 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:09:57.881258 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:09:57.881258 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 11:09:57.881258 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:09:57.881258 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:09:57.881258 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:09:57.881258 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:09:57.881258 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGczsmQNk4U50BxzpgES3MzOpQCXZXSfv8U0fcthNptdjh-xj4_PXNp1cjGhvwh0ftE8negXuLuWJgSY_-2MLUgv_DNMLspYk9lV1lwtSgINsi9nLe-7tZYJuQnQiEJ_Nrc9KtaPntdIqDspehXXUE-x22uN3GKjXVnYgVPtfdxa4_cE Sep 08 11:09:57.881258 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:09:57.881258 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:09:57.881258 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:09:57.881258 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:09:57.881258 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:09:57.881258 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:09:57.881258 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 7868787bfea94355a5d5971bab0d5ed4 Sep 08 11:09:57.881258 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServersTestJSON-1882931607 Sep 08 11:09:57.881258 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:09:57.881258 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:09:57.881258 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:09:57.881258 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServersTestJSON-1882931607 Sep 08 11:09:57.881258 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 7868787bfea94355a5d5971bab0d5ed4 Sep 08 11:09:57.881258 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServersTestJSON-1882931607 Sep 08 11:09:57.881258 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServersTestJSON-1882931607-project Sep 08 11:09:57.881258 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:09:57.881258 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:09:57.881258 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 5193272e9ab24845aff53982dbe2c6f0 Sep 08 11:09:57.881258 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServersTestJSON-1882931607-project Sep 08 11:09:57.881258 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 11:09:57.881258 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65 could not be found. Sep 08 11:09:57.881258 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65'} Sep 08 11:09:57.881258 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:09:57.881258 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:09:57.881258 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:09:57.881258 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:09:57.881258 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:09:57.881258 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:09:57.881258 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:09:57.881258 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:09:57.881258 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:09:57.881258 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:09:57.881258 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65 could not be found. Sep 08 11:09:57.881258 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:09:57.881258 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:09:57.881258 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:09:57.881258 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:09:57.881258 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:09:57.881258 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:09:57.881258 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:09:57.881258 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:09:57.881258 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:09:57.881258 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:09:57.881258 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:09:57.881258 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:09:57.881258 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:09:57.881258 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:09:57.881258 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:09:57.881258 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:09:57.881258 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65 could not be found. Sep 08 11:09:57.881258 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:09:57.881258 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:09:57.881258 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:09:57.886221 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:09:57.886221 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:09:57.886221 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:09:57.886221 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:09:57.886221 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:09:57.886221 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65 could not be found. Sep 08 11:09:57.886221 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:09:57.888188 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b07b5753-d543-439a-9b56-705818d840e8 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Returning 404 to user: Instance 35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:09:57.893281 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b07b5753-d543-439a-9b56-705818d840e8 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65" status: 404 len: 111 microversion: 2.1 time: 0.079340 Sep 08 11:09:57.896515 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2754/5416] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:57 2022] GET /compute/v2.1/servers/35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:09:57.906197 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c6946dd0-fbd6-41df-ba64-95b0d4ebfaa5 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:57.906646 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c6946dd0-fbd6-41df-ba64-95b0d4ebfaa5 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: c8060dc4-1634-4142-a4fe-35ee4ffc74f2] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:57.923544 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c6946dd0-fbd6-41df-ba64-95b0d4ebfaa5 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:57.924266 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c6946dd0-fbd6-41df-ba64-95b0d4ebfaa5 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:57.924870 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c6946dd0-fbd6-41df-ba64-95b0d4ebfaa5 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:57.926957 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c6946dd0-fbd6-41df-ba64-95b0d4ebfaa5 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:57.927592 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c6946dd0-fbd6-41df-ba64-95b0d4ebfaa5 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:57.929384 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c6946dd0-fbd6-41df-ba64-95b0d4ebfaa5 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:57.993612 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c6946dd0-fbd6-41df-ba64-95b0d4ebfaa5 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: c8060dc4-1634-4142-a4fe-35ee4ffc74f2] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:09:58.169570 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c6946dd0-fbd6-41df-ba64-95b0d4ebfaa5 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c8060dc4-1634-4142-a4fe-35ee4ffc74f2" status: 204 len: 0 microversion: 2.1 time: 0.268021 Sep 08 11:09:58.171367 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2663/5417] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:09:57 2022] DELETE /compute/v2.1/servers/c8060dc4-1634-4142-a4fe-35ee4ffc74f2 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:09:58.182906 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ec57ad9e-5dcd-485c-8c90-ef5319cdccb1 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:58.185213 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ec57ad9e-5dcd-485c-8c90-ef5319cdccb1 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: c8060dc4-1634-4142-a4fe-35ee4ffc74f2] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:58.202555 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ec57ad9e-5dcd-485c-8c90-ef5319cdccb1 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:58.203324 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ec57ad9e-5dcd-485c-8c90-ef5319cdccb1 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:58.203931 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ec57ad9e-5dcd-485c-8c90-ef5319cdccb1 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:58.204884 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ec57ad9e-5dcd-485c-8c90-ef5319cdccb1 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:58.206813 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ec57ad9e-5dcd-485c-8c90-ef5319cdccb1 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:58.208729 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ec57ad9e-5dcd-485c-8c90-ef5319cdccb1 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:58.557262 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7db94bf2-a8ef-45a4-b74a-716a5bb9fa93 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:58.559835 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7db94bf2-a8ef-45a4-b74a-716a5bb9fa93 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] [instance: 41f1a22f-64b4-4564-94a9-99fc6740e0a1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:58.570236 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:09:58.577280 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7db94bf2-a8ef-45a4-b74a-716a5bb9fa93 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:58.578023 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7db94bf2-a8ef-45a4-b74a-716a5bb9fa93 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:58.580190 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7db94bf2-a8ef-45a4-b74a-716a5bb9fa93 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:58.583735 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7db94bf2-a8ef-45a4-b74a-716a5bb9fa93 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:58.584435 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7db94bf2-a8ef-45a4-b74a-716a5bb9fa93 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:58.585068 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7db94bf2-a8ef-45a4-b74a-716a5bb9fa93 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:58.707361 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ec57ad9e-5dcd-485c-8c90-ef5319cdccb1 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:58.721103 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ec57ad9e-5dcd-485c-8c90-ef5319cdccb1 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/c8060dc4-1634-4142-a4fe-35ee4ffc74f2" status: 200 len: 1497 microversion: 2.1 time: 0.543265 Sep 08 11:09:58.724119 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2755/5418] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:58 2022] GET /compute/v2.1/servers/c8060dc4-1634-4142-a4fe-35ee4ffc74f2 => generated 1497 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:09:59.159948 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7db94bf2-a8ef-45a4-b74a-716a5bb9fa93 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25641daaa044b1bb0e53d4d2b350f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdc4842f7d54826abd0086ad6654dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:59.186292 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7db94bf2-a8ef-45a4-b74a-716a5bb9fa93 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] 10.222.0.27 "GET /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1" status: 200 len: 1522 microversion: 2.1 time: 0.633511 Sep 08 11:09:59.186898 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2664/5419] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:58 2022] GET /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1 => generated 1522 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:09:59.746936 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-aae10652-7be6-4a41-aaf6-dfe253f835ab tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:59.748098 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-aae10652-7be6-4a41-aaf6-dfe253f835ab tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: c8060dc4-1634-4142-a4fe-35ee4ffc74f2] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:59.775330 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aae10652-7be6-4a41-aaf6-dfe253f835ab tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:59.775846 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aae10652-7be6-4a41-aaf6-dfe253f835ab tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:59.776296 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aae10652-7be6-4a41-aaf6-dfe253f835ab tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:59.777100 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aae10652-7be6-4a41-aaf6-dfe253f835ab tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:59.787260 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aae10652-7be6-4a41-aaf6-dfe253f835ab tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:59.787931 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aae10652-7be6-4a41-aaf6-dfe253f835ab tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:00.123851 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-aae10652-7be6-4a41-aaf6-dfe253f835ab tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:00.142451 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-aae10652-7be6-4a41-aaf6-dfe253f835ab tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/c8060dc4-1634-4142-a4fe-35ee4ffc74f2" status: 200 len: 1497 microversion: 2.1 time: 0.400378 Sep 08 11:10:00.144226 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2756/5420] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:59 2022] GET /compute/v2.1/servers/c8060dc4-1634-4142-a4fe-35ee4ffc74f2 => generated 1497 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:10:00.210688 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8e6a0163-5ea2-4913-a14e-d81a7d4e18bc tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:00.211502 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8e6a0163-5ea2-4913-a14e-d81a7d4e18bc tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] [instance: 41f1a22f-64b4-4564-94a9-99fc6740e0a1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:00.229507 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e6a0163-5ea2-4913-a14e-d81a7d4e18bc tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:00.229905 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e6a0163-5ea2-4913-a14e-d81a7d4e18bc tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:00.237299 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e6a0163-5ea2-4913-a14e-d81a7d4e18bc tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:00.238338 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e6a0163-5ea2-4913-a14e-d81a7d4e18bc tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:00.240931 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e6a0163-5ea2-4913-a14e-d81a7d4e18bc tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:00.241577 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e6a0163-5ea2-4913-a14e-d81a7d4e18bc tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:01.109083 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8e6a0163-5ea2-4913-a14e-d81a7d4e18bc tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25641daaa044b1bb0e53d4d2b350f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdc4842f7d54826abd0086ad6654dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:01.123325 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8e6a0163-5ea2-4913-a14e-d81a7d4e18bc tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] 10.222.0.27 "GET /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1" status: 200 len: 1522 microversion: 2.1 time: 0.917494 Sep 08 11:10:01.133571 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2665/5421] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:00 2022] GET /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1 => generated 1522 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:10:01.173847 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1402b146-4f8b-4ced-94a9-bd29e343c122 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:01.175656 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1402b146-4f8b-4ced-94a9-bd29e343c122 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: c8060dc4-1634-4142-a4fe-35ee4ffc74f2] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:01.193778 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1402b146-4f8b-4ced-94a9-bd29e343c122 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:01.194879 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1402b146-4f8b-4ced-94a9-bd29e343c122 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:01.195564 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1402b146-4f8b-4ced-94a9-bd29e343c122 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:01.196714 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1402b146-4f8b-4ced-94a9-bd29e343c122 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:01.197530 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1402b146-4f8b-4ced-94a9-bd29e343c122 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:01.204043 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1402b146-4f8b-4ced-94a9-bd29e343c122 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:01.794887 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1402b146-4f8b-4ced-94a9-bd29e343c122 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:01.814879 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1402b146-4f8b-4ced-94a9-bd29e343c122 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/c8060dc4-1634-4142-a4fe-35ee4ffc74f2" status: 200 len: 1497 microversion: 2.1 time: 0.651490 Sep 08 11:10:01.815912 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2757/5422] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:01 2022] GET /compute/v2.1/servers/c8060dc4-1634-4142-a4fe-35ee4ffc74f2 => generated 1497 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:10:02.173913 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dcb7e3bb-da22-44c0-8af7-a53ef9220ed5 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:02.175460 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-dcb7e3bb-da22-44c0-8af7-a53ef9220ed5 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] [instance: 41f1a22f-64b4-4564-94a9-99fc6740e0a1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:02.192102 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dcb7e3bb-da22-44c0-8af7-a53ef9220ed5 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:02.199524 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dcb7e3bb-da22-44c0-8af7-a53ef9220ed5 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:02.200517 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dcb7e3bb-da22-44c0-8af7-a53ef9220ed5 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:02.204786 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dcb7e3bb-da22-44c0-8af7-a53ef9220ed5 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:02.205946 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dcb7e3bb-da22-44c0-8af7-a53ef9220ed5 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:02.206685 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dcb7e3bb-da22-44c0-8af7-a53ef9220ed5 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:02.516528 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-43bb1b85-bb4c-4e7c-a74c-64584a43a87b req-68e39891-68bd-49bf-807b-9937289d14ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8060dc4-1634-4142-a4fe-35ee4ffc74f2", "name": "network-vif-deleted", "tag": "b28dc1a3-35f4-4159-b42f-b6eda5f29375"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:10:02.586597 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-43bb1b85-bb4c-4e7c-a74c-64584a43a87b req-68e39891-68bd-49bf-807b-9937289d14ef service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:02.587107 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-43bb1b85-bb4c-4e7c-a74c-64584a43a87b req-68e39891-68bd-49bf-807b-9937289d14ef service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:02.587645 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-43bb1b85-bb4c-4e7c-a74c-64584a43a87b req-68e39891-68bd-49bf-807b-9937289d14ef service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:02.638436 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-43bb1b85-bb4c-4e7c-a74c-64584a43a87b req-68e39891-68bd-49bf-807b-9937289d14ef service nova] Creating event network-vif-deleted:b28dc1a3-35f4-4159-b42f-b6eda5f29375 for instance c8060dc4-1634-4142-a4fe-35ee4ffc74f2 on n-h2-850501-12 Sep 08 11:10:02.657614 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-43bb1b85-bb4c-4e7c-a74c-64584a43a87b req-68e39891-68bd-49bf-807b-9937289d14ef service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148044 Sep 08 11:10:02.662692 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2758/5423] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:10:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:10:02.843783 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-87cbe3d6-d7d9-44bc-9d0f-688b394fe474 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:02.844496 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-87cbe3d6-d7d9-44bc-9d0f-688b394fe474 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: c8060dc4-1634-4142-a4fe-35ee4ffc74f2] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:02.858044 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-87cbe3d6-d7d9-44bc-9d0f-688b394fe474 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:02.858554 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-87cbe3d6-d7d9-44bc-9d0f-688b394fe474 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:02.863946 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-87cbe3d6-d7d9-44bc-9d0f-688b394fe474 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:02.864720 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-87cbe3d6-d7d9-44bc-9d0f-688b394fe474 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:02.865239 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-87cbe3d6-d7d9-44bc-9d0f-688b394fe474 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:02.865682 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-87cbe3d6-d7d9-44bc-9d0f-688b394fe474 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:03.042306 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-87cbe3d6-d7d9-44bc-9d0f-688b394fe474 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:03.043632 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-87cbe3d6-d7d9-44bc-9d0f-688b394fe474 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:03.044192 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-87cbe3d6-d7d9-44bc-9d0f-688b394fe474 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:03.044663 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-87cbe3d6-d7d9-44bc-9d0f-688b394fe474 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lazy-loading 'fault' on Instance uuid c8060dc4-1634-4142-a4fe-35ee4ffc74f2 {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:10:03.170296 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-dcb7e3bb-da22-44c0-8af7-a53ef9220ed5 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25641daaa044b1bb0e53d4d2b350f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdc4842f7d54826abd0086ad6654dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:03.182581 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-dcb7e3bb-da22-44c0-8af7-a53ef9220ed5 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] 10.222.0.27 "GET /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1" status: 200 len: 1522 microversion: 2.1 time: 1.023636 Sep 08 11:10:03.199715 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2666/5424] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:02 2022] GET /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1 => generated 1522 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:10:03.303660 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-87cbe3d6-d7d9-44bc-9d0f-688b394fe474 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:03.321644 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-87cbe3d6-d7d9-44bc-9d0f-688b394fe474 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/c8060dc4-1634-4142-a4fe-35ee4ffc74f2" status: 200 len: 1299 microversion: 2.1 time: 0.479474 Sep 08 11:10:03.326105 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2759/5425] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:02 2022] GET /compute/v2.1/servers/c8060dc4-1634-4142-a4fe-35ee4ffc74f2 => generated 1299 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:10:04.208376 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bafeaac8-d344-4878-9ae9-ff4bff04be63 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:04.209709 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bafeaac8-d344-4878-9ae9-ff4bff04be63 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] [instance: 41f1a22f-64b4-4564-94a9-99fc6740e0a1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:04.238759 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bafeaac8-d344-4878-9ae9-ff4bff04be63 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:04.242649 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bafeaac8-d344-4878-9ae9-ff4bff04be63 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:04.243369 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bafeaac8-d344-4878-9ae9-ff4bff04be63 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:04.244770 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bafeaac8-d344-4878-9ae9-ff4bff04be63 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:04.245465 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bafeaac8-d344-4878-9ae9-ff4bff04be63 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:04.247128 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bafeaac8-d344-4878-9ae9-ff4bff04be63 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:04.353528 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ab1c1979-aa8d-4853-a792-955a19f89607 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:04.354149 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ab1c1979-aa8d-4853-a792-955a19f89607 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: c8060dc4-1634-4142-a4fe-35ee4ffc74f2] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:04.364144 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ab1c1979-aa8d-4853-a792-955a19f89607 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:04.364642 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ab1c1979-aa8d-4853-a792-955a19f89607 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:04.369600 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ab1c1979-aa8d-4853-a792-955a19f89607 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:04.371057 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ab1c1979-aa8d-4853-a792-955a19f89607 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:04.371764 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ab1c1979-aa8d-4853-a792-955a19f89607 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:04.372211 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ab1c1979-aa8d-4853-a792-955a19f89607 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:04.408911 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-ab1c1979-aa8d-4853-a792-955a19f89607 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] HTTP exception thrown: Instance c8060dc4-1634-4142-a4fe-35ee4ffc74f2 could not be found. Sep 08 11:10:04.410759 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ab1c1979-aa8d-4853-a792-955a19f89607 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Request method failure captured: Sep 08 11:10:04.410759 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/c8060dc4-1634-4142-a4fe-35ee4ffc74f2 HTTP/1.1 Sep 08 11:10:04.410759 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:10:04.410759 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:10:04.410759 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:10:04.410759 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 11:10:04.410759 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:10:04.410759 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:10:04.410759 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:10:04.410759 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:10:04.410759 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGczsmQNk4U50BxzpgES3MzOpQCXZXSfv8U0fcthNptdjh-xj4_PXNp1cjGhvwh0ftE8negXuLuWJgSY_-2MLUgv_DNMLspYk9lV1lwtSgINsi9nLe-7tZYJuQnQiEJ_Nrc9KtaPntdIqDspehXXUE-x22uN3GKjXVnYgVPtfdxa4_cE Sep 08 11:10:04.410759 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:10:04.410759 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:10:04.410759 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:10:04.410759 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:10:04.410759 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:10:04.410759 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:10:04.410759 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 7868787bfea94355a5d5971bab0d5ed4 Sep 08 11:10:04.410759 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServersTestJSON-1882931607 Sep 08 11:10:04.410759 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:10:04.410759 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:10:04.410759 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:10:04.410759 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServersTestJSON-1882931607 Sep 08 11:10:04.410759 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 7868787bfea94355a5d5971bab0d5ed4 Sep 08 11:10:04.410759 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServersTestJSON-1882931607 Sep 08 11:10:04.410759 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServersTestJSON-1882931607-project Sep 08 11:10:04.410759 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:10:04.410759 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:10:04.410759 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 5193272e9ab24845aff53982dbe2c6f0 Sep 08 11:10:04.410759 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServersTestJSON-1882931607-project Sep 08 11:10:04.410759 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 11:10:04.410759 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance c8060dc4-1634-4142-a4fe-35ee4ffc74f2 could not be found. Sep 08 11:10:04.410759 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': 'c8060dc4-1634-4142-a4fe-35ee4ffc74f2'} Sep 08 11:10:04.410759 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:10:04.410759 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:10:04.410759 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:10:04.410759 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:10:04.410759 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:10:04.410759 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:10:04.410759 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:10:04.410759 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:10:04.410759 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:10:04.410759 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:10:04.410759 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8060dc4-1634-4142-a4fe-35ee4ffc74f2 could not be found. Sep 08 11:10:04.410759 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:10:04.410759 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:10:04.410759 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:10:04.410759 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:10:04.410759 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:10:04.410759 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:10:04.410759 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:10:04.410759 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:10:04.410759 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:10:04.410759 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:10:04.410759 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:10:04.410759 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:10:04.410759 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:10:04.410759 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:10:04.410759 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:10:04.410759 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:10:04.410759 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8060dc4-1634-4142-a4fe-35ee4ffc74f2 could not be found. Sep 08 11:10:04.410759 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:10:04.410759 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:10:04.410759 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:10:04.415291 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:10:04.415291 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:10:04.415291 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:10:04.415291 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:10:04.415291 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:10:04.415291 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8060dc4-1634-4142-a4fe-35ee4ffc74f2 could not be found. Sep 08 11:10:04.415291 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:10:04.415291 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ab1c1979-aa8d-4853-a792-955a19f89607 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Returning 404 to user: Instance c8060dc4-1634-4142-a4fe-35ee4ffc74f2 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:10:04.415291 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ab1c1979-aa8d-4853-a792-955a19f89607 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/c8060dc4-1634-4142-a4fe-35ee4ffc74f2" status: 404 len: 111 microversion: 2.1 time: 0.065452 Sep 08 11:10:04.415291 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2760/5426] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:04 2022] GET /compute/v2.1/servers/c8060dc4-1634-4142-a4fe-35ee4ffc74f2 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:10:04.644402 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9116bbf1-4686-4409-87ba-b44a55928836 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1048510413", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "20951261-edda-4da9-a3e2-8f222023ad9d"}]}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:10:04.742426 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-9116bbf1-4686-4409-87ba-b44a55928836 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] validate_networks() for [('20951261-edda-4da9-a3e2-8f222023ad9d', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:10:04.774405 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bafeaac8-d344-4878-9ae9-ff4bff04be63 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25641daaa044b1bb0e53d4d2b350f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdc4842f7d54826abd0086ad6654dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:04.782911 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bafeaac8-d344-4878-9ae9-ff4bff04be63 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] 10.222.0.27 "GET /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1" status: 200 len: 1522 microversion: 2.1 time: 0.579904 Sep 08 11:10:04.796585 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2667/5427] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:04 2022] GET /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1 => generated 1522 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:10:05.822075 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7167b15f-cf0f-4367-b834-4d803d19430e tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:05.822752 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7167b15f-cf0f-4367-b834-4d803d19430e tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] [instance: 41f1a22f-64b4-4564-94a9-99fc6740e0a1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:05.834976 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7167b15f-cf0f-4367-b834-4d803d19430e tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:05.837187 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7167b15f-cf0f-4367-b834-4d803d19430e tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:05.838055 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7167b15f-cf0f-4367-b834-4d803d19430e tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:05.840615 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7167b15f-cf0f-4367-b834-4d803d19430e tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:05.841276 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7167b15f-cf0f-4367-b834-4d803d19430e tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:05.842672 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7167b15f-cf0f-4367-b834-4d803d19430e tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:06.123487 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-9116bbf1-4686-4409-87ba-b44a55928836 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:10:06.124026 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-9116bbf1-4686-4409-87ba-b44a55928836 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:10:06.124376 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-9116bbf1-4686-4409-87ba-b44a55928836 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:10:06.124784 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-9116bbf1-4686-4409-87ba-b44a55928836 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:10:06.125495 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-9116bbf1-4686-4409-87ba-b44a55928836 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:10:06.138716 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9116bbf1-4686-4409-87ba-b44a55928836 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:06.139212 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9116bbf1-4686-4409-87ba-b44a55928836 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:06.139649 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9116bbf1-4686-4409-87ba-b44a55928836 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:06.140379 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9116bbf1-4686-4409-87ba-b44a55928836 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:06.140828 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9116bbf1-4686-4409-87ba-b44a55928836 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:06.141476 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9116bbf1-4686-4409-87ba-b44a55928836 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:06.164513 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-9116bbf1-4686-4409-87ba-b44a55928836 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Getting quotas for project 7868787bfea94355a5d5971bab0d5ed4. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:10:06.174237 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-9116bbf1-4686-4409-87ba-b44a55928836 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Getting quotas for user 5193272e9ab24845aff53982dbe2c6f0 and project 7868787bfea94355a5d5971bab0d5ed4. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:10:06.191732 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9116bbf1-4686-4409-87ba-b44a55928836 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:10:06.195191 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9116bbf1-4686-4409-87ba-b44a55928836 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 98ee37e8-3835-4d28-9e41-64b96c7de74f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:10:06.289956 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7167b15f-cf0f-4367-b834-4d803d19430e tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25641daaa044b1bb0e53d4d2b350f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdc4842f7d54826abd0086ad6654dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:06.306784 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7167b15f-cf0f-4367-b834-4d803d19430e tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] 10.222.0.27 "GET /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1" status: 200 len: 1522 microversion: 2.1 time: 0.483088 Sep 08 11:10:06.321205 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2668/5428] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:05 2022] GET /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1 => generated 1522 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:10:06.343522 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9116bbf1-4686-4409-87ba-b44a55928836 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.702887 Sep 08 11:10:06.348744 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2761/5429] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 11:10:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:10:06.371127 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-01c1961f-28cb-4d6d-8e05-f6aba5eb8949 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:06.371768 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-01c1961f-28cb-4d6d-8e05-f6aba5eb8949 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 98ee37e8-3835-4d28-9e41-64b96c7de74f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:06.598095 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-01c1961f-28cb-4d6d-8e05-f6aba5eb8949 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:06.606788 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-01c1961f-28cb-4d6d-8e05-f6aba5eb8949 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/98ee37e8-3835-4d28-9e41-64b96c7de74f" status: 200 len: 1209 microversion: 2.1 time: 0.250028 Sep 08 11:10:06.607388 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2669/5430] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:06 2022] GET /compute/v2.1/servers/98ee37e8-3835-4d28-9e41-64b96c7de74f => generated 1209 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:10:07.347423 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-60583720-4dad-4edf-80f4-1d85fe2b761e tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:07.348657 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-60583720-4dad-4edf-80f4-1d85fe2b761e tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] [instance: 41f1a22f-64b4-4564-94a9-99fc6740e0a1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:07.374296 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-60583720-4dad-4edf-80f4-1d85fe2b761e tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:07.375186 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-60583720-4dad-4edf-80f4-1d85fe2b761e tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:07.375639 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-60583720-4dad-4edf-80f4-1d85fe2b761e tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:07.376374 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-60583720-4dad-4edf-80f4-1d85fe2b761e tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:07.377019 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-60583720-4dad-4edf-80f4-1d85fe2b761e tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:07.378462 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-60583720-4dad-4edf-80f4-1d85fe2b761e tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:07.632245 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-94e08a4b-4476-4c3e-ba47-f69805b66fd4 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:07.633763 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-94e08a4b-4476-4c3e-ba47-f69805b66fd4 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 98ee37e8-3835-4d28-9e41-64b96c7de74f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:07.642762 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94e08a4b-4476-4c3e-ba47-f69805b66fd4 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:07.643665 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94e08a4b-4476-4c3e-ba47-f69805b66fd4 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:07.644345 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94e08a4b-4476-4c3e-ba47-f69805b66fd4 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:07.645463 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94e08a4b-4476-4c3e-ba47-f69805b66fd4 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:07.646340 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94e08a4b-4476-4c3e-ba47-f69805b66fd4 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:07.646927 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94e08a4b-4476-4c3e-ba47-f69805b66fd4 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:07.663532 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-60583720-4dad-4edf-80f4-1d85fe2b761e tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25641daaa044b1bb0e53d4d2b350f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdc4842f7d54826abd0086ad6654dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:07.680826 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-60583720-4dad-4edf-80f4-1d85fe2b761e tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] 10.222.0.27 "GET /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1" status: 200 len: 1522 microversion: 2.1 time: 0.344740 Sep 08 11:10:07.696966 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2762/5431] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:07 2022] GET /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1 => generated 1522 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:10:07.854133 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-94e08a4b-4476-4c3e-ba47-f69805b66fd4 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:07.863624 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-94e08a4b-4476-4c3e-ba47-f69805b66fd4 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/98ee37e8-3835-4d28-9e41-64b96c7de74f" status: 200 len: 1261 microversion: 2.1 time: 0.236615 Sep 08 11:10:07.881052 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2670/5432] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:07 2022] GET /compute/v2.1/servers/98ee37e8-3835-4d28-9e41-64b96c7de74f => generated 1261 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:10:08.708975 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f144670a-599b-4622-88f5-a76f1c82c2ce tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:08.709776 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f144670a-599b-4622-88f5-a76f1c82c2ce tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] [instance: 41f1a22f-64b4-4564-94a9-99fc6740e0a1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:08.721007 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f144670a-599b-4622-88f5-a76f1c82c2ce tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:08.722140 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f144670a-599b-4622-88f5-a76f1c82c2ce tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:08.723004 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f144670a-599b-4622-88f5-a76f1c82c2ce tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:08.723906 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f144670a-599b-4622-88f5-a76f1c82c2ce tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:08.724522 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f144670a-599b-4622-88f5-a76f1c82c2ce tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:08.725214 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f144670a-599b-4622-88f5-a76f1c82c2ce tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:08.896924 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bd8d8812-7dfa-4b46-91fe-78d78e8fc2a2 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:08.898133 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bd8d8812-7dfa-4b46-91fe-78d78e8fc2a2 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 98ee37e8-3835-4d28-9e41-64b96c7de74f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:08.913938 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bd8d8812-7dfa-4b46-91fe-78d78e8fc2a2 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:08.914733 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bd8d8812-7dfa-4b46-91fe-78d78e8fc2a2 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:08.915373 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bd8d8812-7dfa-4b46-91fe-78d78e8fc2a2 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:08.916397 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bd8d8812-7dfa-4b46-91fe-78d78e8fc2a2 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:08.918534 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bd8d8812-7dfa-4b46-91fe-78d78e8fc2a2 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:08.919265 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bd8d8812-7dfa-4b46-91fe-78d78e8fc2a2 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:09.069416 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bd8d8812-7dfa-4b46-91fe-78d78e8fc2a2 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:09.080613 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bd8d8812-7dfa-4b46-91fe-78d78e8fc2a2 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/98ee37e8-3835-4d28-9e41-64b96c7de74f" status: 200 len: 1267 microversion: 2.1 time: 0.187776 Sep 08 11:10:09.081249 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2671/5433] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:08 2022] GET /compute/v2.1/servers/98ee37e8-3835-4d28-9e41-64b96c7de74f => generated 1267 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:10:09.220575 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f144670a-599b-4622-88f5-a76f1c82c2ce tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25641daaa044b1bb0e53d4d2b350f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdc4842f7d54826abd0086ad6654dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:09.228301 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f144670a-599b-4622-88f5-a76f1c82c2ce tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] 10.222.0.27 "GET /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1" status: 200 len: 1522 microversion: 2.1 time: 0.523645 Sep 08 11:10:09.229448 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2763/5434] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:08 2022] GET /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1 => generated 1522 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:10:10.106606 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ea7eb8c7-65b5-41d0-8413-6a0bccd2affb tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:10.107233 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ea7eb8c7-65b5-41d0-8413-6a0bccd2affb tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 98ee37e8-3835-4d28-9e41-64b96c7de74f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:10.124686 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea7eb8c7-65b5-41d0-8413-6a0bccd2affb tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:10.125233 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea7eb8c7-65b5-41d0-8413-6a0bccd2affb tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:10.125678 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea7eb8c7-65b5-41d0-8413-6a0bccd2affb tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:10.126406 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea7eb8c7-65b5-41d0-8413-6a0bccd2affb tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:10.126869 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea7eb8c7-65b5-41d0-8413-6a0bccd2affb tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:10.127302 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea7eb8c7-65b5-41d0-8413-6a0bccd2affb tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:10.152425 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:10:10.251827 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a02a4a44-9e2d-4cac-aad5-f0df6917c173 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:10.253125 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a02a4a44-9e2d-4cac-aad5-f0df6917c173 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] [instance: 41f1a22f-64b4-4564-94a9-99fc6740e0a1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:10.262925 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a02a4a44-9e2d-4cac-aad5-f0df6917c173 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:10.266947 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a02a4a44-9e2d-4cac-aad5-f0df6917c173 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:10.267591 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a02a4a44-9e2d-4cac-aad5-f0df6917c173 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:10.268511 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a02a4a44-9e2d-4cac-aad5-f0df6917c173 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:10.273326 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a02a4a44-9e2d-4cac-aad5-f0df6917c173 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:10.274086 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a02a4a44-9e2d-4cac-aad5-f0df6917c173 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:10.458226 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ea7eb8c7-65b5-41d0-8413-6a0bccd2affb tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:10.467105 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ea7eb8c7-65b5-41d0-8413-6a0bccd2affb tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/98ee37e8-3835-4d28-9e41-64b96c7de74f" status: 200 len: 1309 microversion: 2.1 time: 0.365451 Sep 08 11:10:10.467703 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2672/5435] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:10 2022] GET /compute/v2.1/servers/98ee37e8-3835-4d28-9e41-64b96c7de74f => generated 1309 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:10:10.917893 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a02a4a44-9e2d-4cac-aad5-f0df6917c173 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25641daaa044b1bb0e53d4d2b350f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdc4842f7d54826abd0086ad6654dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:10.929227 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a02a4a44-9e2d-4cac-aad5-f0df6917c173 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] 10.222.0.27 "GET /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1" status: 200 len: 1522 microversion: 2.1 time: 0.681220 Sep 08 11:10:10.949233 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2764/5436] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:10 2022] GET /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1 => generated 1522 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:10:11.495388 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d0fb8cd0-9699-43f5-9f69-b1452d10fe45 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:11.496079 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d0fb8cd0-9699-43f5-9f69-b1452d10fe45 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 98ee37e8-3835-4d28-9e41-64b96c7de74f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:11.507797 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d0fb8cd0-9699-43f5-9f69-b1452d10fe45 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:11.510209 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d0fb8cd0-9699-43f5-9f69-b1452d10fe45 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:11.514903 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d0fb8cd0-9699-43f5-9f69-b1452d10fe45 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:11.516010 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d0fb8cd0-9699-43f5-9f69-b1452d10fe45 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:11.516653 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d0fb8cd0-9699-43f5-9f69-b1452d10fe45 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:11.516932 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d0fb8cd0-9699-43f5-9f69-b1452d10fe45 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:11.835763 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d0fb8cd0-9699-43f5-9f69-b1452d10fe45 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:11.847056 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d0fb8cd0-9699-43f5-9f69-b1452d10fe45 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/98ee37e8-3835-4d28-9e41-64b96c7de74f" status: 200 len: 1309 microversion: 2.1 time: 0.358903 Sep 08 11:10:11.848109 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2673/5437] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:11 2022] GET /compute/v2.1/servers/98ee37e8-3835-4d28-9e41-64b96c7de74f => generated 1309 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:10:11.956239 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2730b687-dd8b-4b94-841f-b9d1384f9d48 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:11.957583 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2730b687-dd8b-4b94-841f-b9d1384f9d48 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] [instance: 41f1a22f-64b4-4564-94a9-99fc6740e0a1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:11.979211 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2730b687-dd8b-4b94-841f-b9d1384f9d48 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:11.980101 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2730b687-dd8b-4b94-841f-b9d1384f9d48 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:11.980738 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2730b687-dd8b-4b94-841f-b9d1384f9d48 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:11.981985 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2730b687-dd8b-4b94-841f-b9d1384f9d48 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:11.982667 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2730b687-dd8b-4b94-841f-b9d1384f9d48 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:11.983279 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2730b687-dd8b-4b94-841f-b9d1384f9d48 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:12.338017 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2730b687-dd8b-4b94-841f-b9d1384f9d48 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25641daaa044b1bb0e53d4d2b350f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdc4842f7d54826abd0086ad6654dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:12.350146 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2730b687-dd8b-4b94-841f-b9d1384f9d48 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] 10.222.0.27 "GET /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1" status: 200 len: 1522 microversion: 2.1 time: 0.397968 Sep 08 11:10:12.366333 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2765/5438] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:11 2022] GET /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1 => generated 1522 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:10:12.875794 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ed603187-b1a5-462b-8d8c-afb628519f92 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:12.876516 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ed603187-b1a5-462b-8d8c-afb628519f92 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 98ee37e8-3835-4d28-9e41-64b96c7de74f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:12.889957 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed603187-b1a5-462b-8d8c-afb628519f92 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:12.892758 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed603187-b1a5-462b-8d8c-afb628519f92 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:12.895779 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed603187-b1a5-462b-8d8c-afb628519f92 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:12.896784 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed603187-b1a5-462b-8d8c-afb628519f92 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:12.900134 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed603187-b1a5-462b-8d8c-afb628519f92 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:12.901673 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed603187-b1a5-462b-8d8c-afb628519f92 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:12.964379 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-d6ad3b2b-696b-47c6-87e4-11cf6ef91098 req-8c6a4b6d-94a9-4348-9935-c45e8fa4350e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98ee37e8-3835-4d28-9e41-64b96c7de74f", "tag": "f8ab5210-6e46-4a53-bdcd-a0512739a1eb"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:10:12.989859 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d6ad3b2b-696b-47c6-87e4-11cf6ef91098 req-8c6a4b6d-94a9-4348-9935-c45e8fa4350e service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:12.990826 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d6ad3b2b-696b-47c6-87e4-11cf6ef91098 req-8c6a4b6d-94a9-4348-9935-c45e8fa4350e service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:12.991713 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d6ad3b2b-696b-47c6-87e4-11cf6ef91098 req-8c6a4b6d-94a9-4348-9935-c45e8fa4350e service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:13.007801 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-d6ad3b2b-696b-47c6-87e4-11cf6ef91098 req-8c6a4b6d-94a9-4348-9935-c45e8fa4350e service nova] Creating event network-changed:f8ab5210-6e46-4a53-bdcd-a0512739a1eb for instance 98ee37e8-3835-4d28-9e41-64b96c7de74f on n-h1-850501-12 Sep 08 11:10:13.024576 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-d6ad3b2b-696b-47c6-87e4-11cf6ef91098 req-8c6a4b6d-94a9-4348-9935-c45e8fa4350e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.568866 Sep 08 11:10:13.028497 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2674/5439] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:10:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:10:13.378747 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bbf33ae1-3cf6-4b44-91f3-932a0ce5aceb tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:13.379569 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bbf33ae1-3cf6-4b44-91f3-932a0ce5aceb tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] [instance: 41f1a22f-64b4-4564-94a9-99fc6740e0a1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:13.399729 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bbf33ae1-3cf6-4b44-91f3-932a0ce5aceb tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:13.400258 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bbf33ae1-3cf6-4b44-91f3-932a0ce5aceb tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:13.400711 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bbf33ae1-3cf6-4b44-91f3-932a0ce5aceb tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:13.402500 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bbf33ae1-3cf6-4b44-91f3-932a0ce5aceb tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:13.403036 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bbf33ae1-3cf6-4b44-91f3-932a0ce5aceb tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:13.411283 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bbf33ae1-3cf6-4b44-91f3-932a0ce5aceb tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:13.568065 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ed603187-b1a5-462b-8d8c-afb628519f92 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:13.581633 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ed603187-b1a5-462b-8d8c-afb628519f92 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/98ee37e8-3835-4d28-9e41-64b96c7de74f" status: 200 len: 1309 microversion: 2.1 time: 0.709939 Sep 08 11:10:13.587071 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2766/5440] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:12 2022] GET /compute/v2.1/servers/98ee37e8-3835-4d28-9e41-64b96c7de74f => generated 1309 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:10:13.773711 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bbf33ae1-3cf6-4b44-91f3-932a0ce5aceb tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25641daaa044b1bb0e53d4d2b350f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdc4842f7d54826abd0086ad6654dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:13.785532 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bbf33ae1-3cf6-4b44-91f3-932a0ce5aceb tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] 10.222.0.27 "GET /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1" status: 200 len: 1522 microversion: 2.1 time: 0.410598 Sep 08 11:10:13.786000 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2675/5441] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:13 2022] GET /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1 => generated 1522 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:10:14.624892 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-adab4e37-7cbf-40c7-b45f-c07df664c1be tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:14.625551 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-adab4e37-7cbf-40c7-b45f-c07df664c1be tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 98ee37e8-3835-4d28-9e41-64b96c7de74f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:14.634079 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-adab4e37-7cbf-40c7-b45f-c07df664c1be tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:14.636687 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-adab4e37-7cbf-40c7-b45f-c07df664c1be tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:14.637161 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-adab4e37-7cbf-40c7-b45f-c07df664c1be tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:14.637874 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-adab4e37-7cbf-40c7-b45f-c07df664c1be tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:14.639834 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-adab4e37-7cbf-40c7-b45f-c07df664c1be tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:14.645715 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-adab4e37-7cbf-40c7-b45f-c07df664c1be tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:14.816240 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dd1f2354-d31e-41bf-9647-1cf87a544619 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:14.817458 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-dd1f2354-d31e-41bf-9647-1cf87a544619 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] [instance: 41f1a22f-64b4-4564-94a9-99fc6740e0a1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:14.842055 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd1f2354-d31e-41bf-9647-1cf87a544619 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:14.843432 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd1f2354-d31e-41bf-9647-1cf87a544619 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:14.845329 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd1f2354-d31e-41bf-9647-1cf87a544619 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:14.846112 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd1f2354-d31e-41bf-9647-1cf87a544619 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:14.846565 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd1f2354-d31e-41bf-9647-1cf87a544619 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:14.861653 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd1f2354-d31e-41bf-9647-1cf87a544619 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:15.081428 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-adab4e37-7cbf-40c7-b45f-c07df664c1be tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:15.089841 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-adab4e37-7cbf-40c7-b45f-c07df664c1be tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/98ee37e8-3835-4d28-9e41-64b96c7de74f" status: 200 len: 1309 microversion: 2.1 time: 0.476207 Sep 08 11:10:15.105905 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2767/5442] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:14 2022] GET /compute/v2.1/servers/98ee37e8-3835-4d28-9e41-64b96c7de74f => generated 1309 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:10:15.264133 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-dd1f2354-d31e-41bf-9647-1cf87a544619 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25641daaa044b1bb0e53d4d2b350f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdc4842f7d54826abd0086ad6654dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:15.276842 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-dd1f2354-d31e-41bf-9647-1cf87a544619 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] 10.222.0.27 "GET /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1" status: 200 len: 1522 microversion: 2.1 time: 0.464918 Sep 08 11:10:15.277905 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2676/5443] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:14 2022] GET /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1 => generated 1522 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:10:16.115902 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4cb0e504-45c4-4f28-a9eb-d94f5782a215 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:16.117371 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4cb0e504-45c4-4f28-a9eb-d94f5782a215 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 98ee37e8-3835-4d28-9e41-64b96c7de74f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:16.140039 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4cb0e504-45c4-4f28-a9eb-d94f5782a215 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:16.148398 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4cb0e504-45c4-4f28-a9eb-d94f5782a215 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:16.158014 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4cb0e504-45c4-4f28-a9eb-d94f5782a215 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:16.159939 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4cb0e504-45c4-4f28-a9eb-d94f5782a215 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:16.162187 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4cb0e504-45c4-4f28-a9eb-d94f5782a215 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:16.165758 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4cb0e504-45c4-4f28-a9eb-d94f5782a215 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:16.168264 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:10:16.239195 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=6 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:10:16.310268 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7d6eccbf-59cd-4c82-a0d0-d3768196ae8f tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:16.311591 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7d6eccbf-59cd-4c82-a0d0-d3768196ae8f tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] [instance: 41f1a22f-64b4-4564-94a9-99fc6740e0a1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:16.328310 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d6eccbf-59cd-4c82-a0d0-d3768196ae8f tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:16.333522 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d6eccbf-59cd-4c82-a0d0-d3768196ae8f tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:16.335788 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d6eccbf-59cd-4c82-a0d0-d3768196ae8f tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:16.338887 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d6eccbf-59cd-4c82-a0d0-d3768196ae8f tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:16.339466 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d6eccbf-59cd-4c82-a0d0-d3768196ae8f tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:16.343250 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d6eccbf-59cd-4c82-a0d0-d3768196ae8f tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:16.603516 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:10:16.718425 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4cb0e504-45c4-4f28-a9eb-d94f5782a215 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:16.741012 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4cb0e504-45c4-4f28-a9eb-d94f5782a215 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/98ee37e8-3835-4d28-9e41-64b96c7de74f" status: 200 len: 1309 microversion: 2.1 time: 0.621338 Sep 08 11:10:16.741771 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2768/5444] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:16 2022] GET /compute/v2.1/servers/98ee37e8-3835-4d28-9e41-64b96c7de74f => generated 1309 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:10:16.916389 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7d6eccbf-59cd-4c82-a0d0-d3768196ae8f tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25641daaa044b1bb0e53d4d2b350f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdc4842f7d54826abd0086ad6654dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:16.936030 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7d6eccbf-59cd-4c82-a0d0-d3768196ae8f tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] 10.222.0.27 "GET /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1" status: 200 len: 1522 microversion: 2.1 time: 0.635999 Sep 08 11:10:16.936689 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2677/5445] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:16 2022] GET /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1 => generated 1522 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:10:17.764298 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-339297d6-168b-4c78-82a7-987e19804501 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:17.765687 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-339297d6-168b-4c78-82a7-987e19804501 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 98ee37e8-3835-4d28-9e41-64b96c7de74f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:17.780655 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-339297d6-168b-4c78-82a7-987e19804501 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:17.782640 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-339297d6-168b-4c78-82a7-987e19804501 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:17.785282 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-339297d6-168b-4c78-82a7-987e19804501 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:17.786295 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-339297d6-168b-4c78-82a7-987e19804501 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:17.788060 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-339297d6-168b-4c78-82a7-987e19804501 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:17.788745 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-339297d6-168b-4c78-82a7-987e19804501 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:17.968741 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-835cf997-feaf-43a2-865e-abfb00633d4f tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:17.969737 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-835cf997-feaf-43a2-865e-abfb00633d4f tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] [instance: 41f1a22f-64b4-4564-94a9-99fc6740e0a1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:17.988245 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-835cf997-feaf-43a2-865e-abfb00633d4f tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:17.990551 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-835cf997-feaf-43a2-865e-abfb00633d4f tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:17.992639 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-835cf997-feaf-43a2-865e-abfb00633d4f tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:17.993956 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-835cf997-feaf-43a2-865e-abfb00633d4f tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:18.000780 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-835cf997-feaf-43a2-865e-abfb00633d4f tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:18.001409 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-835cf997-feaf-43a2-865e-abfb00633d4f tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:18.463163 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-835cf997-feaf-43a2-865e-abfb00633d4f tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25641daaa044b1bb0e53d4d2b350f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdc4842f7d54826abd0086ad6654dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:18.474462 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-339297d6-168b-4c78-82a7-987e19804501 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:18.477149 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-835cf997-feaf-43a2-865e-abfb00633d4f tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] 10.222.0.27 "GET /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1" status: 200 len: 1502 microversion: 2.1 time: 0.510437 Sep 08 11:10:18.478017 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2678/5446] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:17 2022] GET /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1 => generated 1502 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:10:18.488213 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-339297d6-168b-4c78-82a7-987e19804501 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/98ee37e8-3835-4d28-9e41-64b96c7de74f" status: 200 len: 1309 microversion: 2.1 time: 0.728206 Sep 08 11:10:18.489396 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2769/5447] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:17 2022] GET /compute/v2.1/servers/98ee37e8-3835-4d28-9e41-64b96c7de74f => generated 1309 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:10:18.508634 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6557c4e2-2b10-4110-8a7e-f04a3560d312 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Action: 'create', calling method: .version_select at 0x7f68e464ba60>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-152376529", "description": "tempest-description-2083363213"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:10:18.719784 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-0898faaa-37ae-49fe-aa0f-67ce4851c23a req-670e835f-2899-4996-ba31-22ca17971a4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98ee37e8-3835-4d28-9e41-64b96c7de74f", "name": "network-vif-plugged", "status": "completed", "tag": "f8ab5210-6e46-4a53-bdcd-a0512739a1eb"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:10:18.739603 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-0898faaa-37ae-49fe-aa0f-67ce4851c23a req-670e835f-2899-4996-ba31-22ca17971a4c service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:18.746299 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-0898faaa-37ae-49fe-aa0f-67ce4851c23a req-670e835f-2899-4996-ba31-22ca17971a4c service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:18.746880 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-0898faaa-37ae-49fe-aa0f-67ce4851c23a req-670e835f-2899-4996-ba31-22ca17971a4c service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:18.784346 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-0898faaa-37ae-49fe-aa0f-67ce4851c23a req-670e835f-2899-4996-ba31-22ca17971a4c service nova] Creating event network-vif-plugged:f8ab5210-6e46-4a53-bdcd-a0512739a1eb for instance 98ee37e8-3835-4d28-9e41-64b96c7de74f on n-h1-850501-12 Sep 08 11:10:18.803661 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-0898faaa-37ae-49fe-aa0f-67ce4851c23a req-670e835f-2899-4996-ba31-22ca17971a4c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087557 Sep 08 11:10:18.806376 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2770/5448] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:10:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:10:19.241077 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6557c4e2-2b10-4110-8a7e-f04a3560d312 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 250 microversion: 2.1 time: 0.734817 Sep 08 11:10:19.242719 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2679/5449] 10.222.0.27 () {60 vars in 1180 bytes} [Thu Sep 8 11:10:18 2022] POST /compute/v2.1/os-security-groups => generated 250 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:10:19.262037 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8a59538b-8906-4dee-9e55-4fc2aa3dde9a tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-152376529"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:10:19.263478 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8a59538b-8906-4dee-9e55-4fc2aa3dde9a tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] [instance: 41f1a22f-64b4-4564-94a9-99fc6740e0a1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:19.274125 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8a59538b-8906-4dee-9e55-4fc2aa3dde9a tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:19.274932 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8a59538b-8906-4dee-9e55-4fc2aa3dde9a tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:19.275599 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8a59538b-8906-4dee-9e55-4fc2aa3dde9a tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:19.277130 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8a59538b-8906-4dee-9e55-4fc2aa3dde9a tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:19.277816 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8a59538b-8906-4dee-9e55-4fc2aa3dde9a tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:19.278463 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8a59538b-8906-4dee-9e55-4fc2aa3dde9a tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:19.520560 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ae8a9dc9-de19-4542-b29f-2ccbc2ca1b9f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:19.521116 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ae8a9dc9-de19-4542-b29f-2ccbc2ca1b9f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 98ee37e8-3835-4d28-9e41-64b96c7de74f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:19.532081 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae8a9dc9-de19-4542-b29f-2ccbc2ca1b9f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:19.532852 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae8a9dc9-de19-4542-b29f-2ccbc2ca1b9f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:19.533545 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae8a9dc9-de19-4542-b29f-2ccbc2ca1b9f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:19.534494 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae8a9dc9-de19-4542-b29f-2ccbc2ca1b9f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:19.538161 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae8a9dc9-de19-4542-b29f-2ccbc2ca1b9f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:19.538850 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae8a9dc9-de19-4542-b29f-2ccbc2ca1b9f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:19.657956 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.network.security_group_api [None req-8a59538b-8906-4dee-9e55-4fc2aa3dde9a tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Adding security group 9b26c6dc-0acc-47cd-8606-d421d7554d01 to port 62403e83-a296-4c79-be79-7a813046d1fe Sep 08 11:10:19.946658 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ae8a9dc9-de19-4542-b29f-2ccbc2ca1b9f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:19.961660 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ae8a9dc9-de19-4542-b29f-2ccbc2ca1b9f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/98ee37e8-3835-4d28-9e41-64b96c7de74f" status: 200 len: 1309 microversion: 2.1 time: 0.445784 Sep 08 11:10:19.962781 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2680/5450] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:19 2022] GET /compute/v2.1/servers/98ee37e8-3835-4d28-9e41-64b96c7de74f => generated 1309 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:10:20.977544 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8a59538b-8906-4dee-9e55-4fc2aa3dde9a tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] 10.222.0.27 "POST /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1/action" status: 202 len: 0 microversion: 2.1 time: 1.723748 Sep 08 11:10:20.978450 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2771/5451] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 11:10:19 2022] POST /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1/action => generated 0 bytes in 1726 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:10:20.987758 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3ed782cf-e17a-4ec6-95a3-c8fa2746cb20 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:20.988345 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a254a4ed-42eb-463d-a6c6-a78320826e08 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-152376529"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:10:20.988832 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3ed782cf-e17a-4ec6-95a3-c8fa2746cb20 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 98ee37e8-3835-4d28-9e41-64b96c7de74f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:20.989011 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a254a4ed-42eb-463d-a6c6-a78320826e08 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] [instance: 41f1a22f-64b4-4564-94a9-99fc6740e0a1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:21.030488 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a254a4ed-42eb-463d-a6c6-a78320826e08 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:21.030902 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a254a4ed-42eb-463d-a6c6-a78320826e08 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:21.031408 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3ed782cf-e17a-4ec6-95a3-c8fa2746cb20 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:21.032727 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a254a4ed-42eb-463d-a6c6-a78320826e08 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:21.033584 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3ed782cf-e17a-4ec6-95a3-c8fa2746cb20 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:21.034150 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3ed782cf-e17a-4ec6-95a3-c8fa2746cb20 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:21.036040 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3ed782cf-e17a-4ec6-95a3-c8fa2746cb20 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:21.037887 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3ed782cf-e17a-4ec6-95a3-c8fa2746cb20 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:21.042167 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3ed782cf-e17a-4ec6-95a3-c8fa2746cb20 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:21.045624 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a254a4ed-42eb-463d-a6c6-a78320826e08 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:21.046137 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a254a4ed-42eb-463d-a6c6-a78320826e08 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:21.046580 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a254a4ed-42eb-463d-a6c6-a78320826e08 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:21.120882 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=100 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:10:21.594370 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.network.security_group_api [None req-a254a4ed-42eb-463d-a6c6-a78320826e08 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Removing security group 9b26c6dc-0acc-47cd-8606-d421d7554d01 from port 62403e83-a296-4c79-be79-7a813046d1fe Sep 08 11:10:21.689276 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-3ed782cf-e17a-4ec6-95a3-c8fa2746cb20 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:21.700598 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3ed782cf-e17a-4ec6-95a3-c8fa2746cb20 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/98ee37e8-3835-4d28-9e41-64b96c7de74f" status: 200 len: 1490 microversion: 2.1 time: 0.716317 Sep 08 11:10:21.703512 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2772/5452] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:20 2022] GET /compute/v2.1/servers/98ee37e8-3835-4d28-9e41-64b96c7de74f => generated 1490 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:10:21.709019 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-043a26d8-7023-4271-979f-184f2b56baed req-32a609c5-f9a1-4cd1-9786-0095fb89e785 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41f1a22f-64b4-4564-94a9-99fc6740e0a1", "tag": "62403e83-a296-4c79-be79-7a813046d1fe"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:10:21.735163 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-043a26d8-7023-4271-979f-184f2b56baed req-32a609c5-f9a1-4cd1-9786-0095fb89e785 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:21.738819 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-043a26d8-7023-4271-979f-184f2b56baed req-32a609c5-f9a1-4cd1-9786-0095fb89e785 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:21.739823 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-043a26d8-7023-4271-979f-184f2b56baed req-32a609c5-f9a1-4cd1-9786-0095fb89e785 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:21.776556 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-043a26d8-7023-4271-979f-184f2b56baed req-32a609c5-f9a1-4cd1-9786-0095fb89e785 service nova] Creating event network-changed:62403e83-a296-4c79-be79-7a813046d1fe for instance 41f1a22f-64b4-4564-94a9-99fc6740e0a1 on n-h2-850501-12 Sep 08 11:10:21.786245 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-043a26d8-7023-4271-979f-184f2b56baed req-32a609c5-f9a1-4cd1-9786-0095fb89e785 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080645 Sep 08 11:10:21.788722 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2773/5453] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:10:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:10:21.797166 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e2fb63ab-4bab-4d55-b9a8-89b98ed40edf tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:10:21.822574 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e2fb63ab-4bab-4d55-b9a8-89b98ed40edf tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 98ee37e8-3835-4d28-9e41-64b96c7de74f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:21.849631 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e2fb63ab-4bab-4d55-b9a8-89b98ed40edf tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:21.850158 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e2fb63ab-4bab-4d55-b9a8-89b98ed40edf tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:21.855670 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e2fb63ab-4bab-4d55-b9a8-89b98ed40edf tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:21.856624 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e2fb63ab-4bab-4d55-b9a8-89b98ed40edf tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:21.857154 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e2fb63ab-4bab-4d55-b9a8-89b98ed40edf tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:21.857602 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e2fb63ab-4bab-4d55-b9a8-89b98ed40edf tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:22.103599 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e2fb63ab-4bab-4d55-b9a8-89b98ed40edf tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "PUT /compute/v2.1/servers/98ee37e8-3835-4d28-9e41-64b96c7de74f" status: 200 len: 1085 microversion: 2.1 time: 0.310241 Sep 08 11:10:22.104498 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2774/5454] 10.222.0.27 () {60 vars in 1256 bytes} [Thu Sep 8 11:10:21 2022] PUT /compute/v2.1/servers/98ee37e8-3835-4d28-9e41-64b96c7de74f => generated 1085 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:10:22.128537 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-24c4e607-072a-4d02-b62c-76a1ca4fa974 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:22.129392 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-24c4e607-072a-4d02-b62c-76a1ca4fa974 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 98ee37e8-3835-4d28-9e41-64b96c7de74f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:22.144475 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24c4e607-072a-4d02-b62c-76a1ca4fa974 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:22.145597 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24c4e607-072a-4d02-b62c-76a1ca4fa974 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:22.147394 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24c4e607-072a-4d02-b62c-76a1ca4fa974 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:22.149120 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24c4e607-072a-4d02-b62c-76a1ca4fa974 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:22.155313 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24c4e607-072a-4d02-b62c-76a1ca4fa974 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:22.156219 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24c4e607-072a-4d02-b62c-76a1ca4fa974 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:22.756621 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a254a4ed-42eb-463d-a6c6-a78320826e08 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] 10.222.0.27 "POST /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1/action" status: 202 len: 0 microversion: 2.1 time: 1.772877 Sep 08 11:10:22.757929 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2681/5455] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 11:10:20 2022] POST /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1/action => generated 0 bytes in 1775 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:10:22.768954 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fa605b6c-9c45-449f-a2f3-d04e7a78f224 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Action: 'create', calling method: .version_select at 0x7f68e8af0ee0>, body: {"pool": null} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:10:23.075225 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-24c4e607-072a-4d02-b62c-76a1ca4fa974 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:23.091847 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-24c4e607-072a-4d02-b62c-76a1ca4fa974 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/98ee37e8-3835-4d28-9e41-64b96c7de74f" status: 200 len: 1511 microversion: 2.1 time: 0.960721 Sep 08 11:10:23.092531 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2775/5456] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:22 2022] GET /compute/v2.1/servers/98ee37e8-3835-4d28-9e41-64b96c7de74f => generated 1511 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:10:23.100173 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-fec43d2f-a35e-42fd-a454-10e1b92b1633 req-3ea1a194-6416-4f83-92a0-7520752dec5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41f1a22f-64b4-4564-94a9-99fc6740e0a1", "tag": "62403e83-a296-4c79-be79-7a813046d1fe"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:10:23.129980 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-fec43d2f-a35e-42fd-a454-10e1b92b1633 req-3ea1a194-6416-4f83-92a0-7520752dec5f service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:23.131475 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-fec43d2f-a35e-42fd-a454-10e1b92b1633 req-3ea1a194-6416-4f83-92a0-7520752dec5f service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:23.132227 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-fec43d2f-a35e-42fd-a454-10e1b92b1633 req-3ea1a194-6416-4f83-92a0-7520752dec5f service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:23.165669 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-fec43d2f-a35e-42fd-a454-10e1b92b1633 req-3ea1a194-6416-4f83-92a0-7520752dec5f service nova] Creating event network-changed:62403e83-a296-4c79-be79-7a813046d1fe for instance 41f1a22f-64b4-4564-94a9-99fc6740e0a1 on n-h2-850501-12 Sep 08 11:10:23.187312 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-fec43d2f-a35e-42fd-a454-10e1b92b1633 req-3ea1a194-6416-4f83-92a0-7520752dec5f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093445 Sep 08 11:10:23.188928 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2776/5457] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:10:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:10:23.198660 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-71889fbc-f561-4af5-9deb-875650296259 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:23.203222 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-71889fbc-f561-4af5-9deb-875650296259 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 98ee37e8-3835-4d28-9e41-64b96c7de74f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:23.220753 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-71889fbc-f561-4af5-9deb-875650296259 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:23.221559 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-71889fbc-f561-4af5-9deb-875650296259 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:23.222164 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-71889fbc-f561-4af5-9deb-875650296259 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:23.223083 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-71889fbc-f561-4af5-9deb-875650296259 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:23.230328 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-71889fbc-f561-4af5-9deb-875650296259 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:23.231316 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-71889fbc-f561-4af5-9deb-875650296259 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:23.905955 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-71889fbc-f561-4af5-9deb-875650296259 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:23.914643 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-71889fbc-f561-4af5-9deb-875650296259 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/98ee37e8-3835-4d28-9e41-64b96c7de74f" status: 200 len: 1511 microversion: 2.1 time: 0.723897 Sep 08 11:10:23.915375 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2777/5458] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:23 2022] GET /compute/v2.1/servers/98ee37e8-3835-4d28-9e41-64b96c7de74f => generated 1511 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:10:23.943555 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-aeeba624-0a7e-4dc2-a200-1e9a75dcdfb4 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:23.944270 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-aeeba624-0a7e-4dc2-a200-1e9a75dcdfb4 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 98ee37e8-3835-4d28-9e41-64b96c7de74f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:23.974266 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aeeba624-0a7e-4dc2-a200-1e9a75dcdfb4 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:23.976793 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aeeba624-0a7e-4dc2-a200-1e9a75dcdfb4 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:23.977453 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aeeba624-0a7e-4dc2-a200-1e9a75dcdfb4 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:23.985083 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aeeba624-0a7e-4dc2-a200-1e9a75dcdfb4 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:23.988759 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aeeba624-0a7e-4dc2-a200-1e9a75dcdfb4 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:23.992777 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aeeba624-0a7e-4dc2-a200-1e9a75dcdfb4 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:24.107412 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-aeeba624-0a7e-4dc2-a200-1e9a75dcdfb4 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 98ee37e8-3835-4d28-9e41-64b96c7de74f] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:10:24.414079 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-aeeba624-0a7e-4dc2-a200-1e9a75dcdfb4 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "DELETE /compute/v2.1/servers/98ee37e8-3835-4d28-9e41-64b96c7de74f" status: 204 len: 0 microversion: 2.1 time: 0.473226 Sep 08 11:10:24.416081 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2778/5459] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:10:23 2022] DELETE /compute/v2.1/servers/98ee37e8-3835-4d28-9e41-64b96c7de74f => generated 0 bytes in 479 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:10:24.442561 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8333fe68-cc58-4944-8f6b-7eebb9875fd2 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:24.447808 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8333fe68-cc58-4944-8f6b-7eebb9875fd2 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 98ee37e8-3835-4d28-9e41-64b96c7de74f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:24.475387 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8333fe68-cc58-4944-8f6b-7eebb9875fd2 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:24.480705 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8333fe68-cc58-4944-8f6b-7eebb9875fd2 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:24.481528 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8333fe68-cc58-4944-8f6b-7eebb9875fd2 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:24.487327 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8333fe68-cc58-4944-8f6b-7eebb9875fd2 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:24.488088 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8333fe68-cc58-4944-8f6b-7eebb9875fd2 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:24.490743 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8333fe68-cc58-4944-8f6b-7eebb9875fd2 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:24.964965 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8333fe68-cc58-4944-8f6b-7eebb9875fd2 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:24.984185 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8333fe68-cc58-4944-8f6b-7eebb9875fd2 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/98ee37e8-3835-4d28-9e41-64b96c7de74f" status: 200 len: 1517 microversion: 2.1 time: 0.556296 Sep 08 11:10:24.987906 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2779/5460] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:24 2022] GET /compute/v2.1/servers/98ee37e8-3835-4d28-9e41-64b96c7de74f => generated 1517 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:10:26.016410 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-45d5cee1-c384-4126-a0fa-336bfdb94581 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:26.017062 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-45d5cee1-c384-4126-a0fa-336bfdb94581 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 98ee37e8-3835-4d28-9e41-64b96c7de74f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:26.041462 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-45d5cee1-c384-4126-a0fa-336bfdb94581 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:26.048107 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-45d5cee1-c384-4126-a0fa-336bfdb94581 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:26.048991 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-45d5cee1-c384-4126-a0fa-336bfdb94581 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:26.054043 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-45d5cee1-c384-4126-a0fa-336bfdb94581 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:26.054665 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-45d5cee1-c384-4126-a0fa-336bfdb94581 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:26.055112 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-45d5cee1-c384-4126-a0fa-336bfdb94581 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:26.948046 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-45d5cee1-c384-4126-a0fa-336bfdb94581 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:26.956595 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-45d5cee1-c384-4126-a0fa-336bfdb94581 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/98ee37e8-3835-4d28-9e41-64b96c7de74f" status: 200 len: 1517 microversion: 2.1 time: 0.948100 Sep 08 11:10:26.961412 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2780/5461] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:26 2022] GET /compute/v2.1/servers/98ee37e8-3835-4d28-9e41-64b96c7de74f => generated 1517 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:10:27.988464 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-88eaffcf-de57-40a0-8574-235182512865 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:27.989236 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-88eaffcf-de57-40a0-8574-235182512865 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 98ee37e8-3835-4d28-9e41-64b96c7de74f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:28.008886 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88eaffcf-de57-40a0-8574-235182512865 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:28.009342 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88eaffcf-de57-40a0-8574-235182512865 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:28.010315 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88eaffcf-de57-40a0-8574-235182512865 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:28.011066 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88eaffcf-de57-40a0-8574-235182512865 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:28.011538 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88eaffcf-de57-40a0-8574-235182512865 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:28.011975 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88eaffcf-de57-40a0-8574-235182512865 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:28.371247 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-88eaffcf-de57-40a0-8574-235182512865 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:28.381081 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-88eaffcf-de57-40a0-8574-235182512865 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/98ee37e8-3835-4d28-9e41-64b96c7de74f" status: 200 len: 1517 microversion: 2.1 time: 0.397028 Sep 08 11:10:28.390013 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2781/5462] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:27 2022] GET /compute/v2.1/servers/98ee37e8-3835-4d28-9e41-64b96c7de74f => generated 1517 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:10:29.316711 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-74bb407a-cd4a-40e0-8f92-81b8ac25c059 req-5c8285f2-937f-4ce3-8989-e6a2742a7bdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98ee37e8-3835-4d28-9e41-64b96c7de74f", "name": "network-vif-deleted", "tag": "f8ab5210-6e46-4a53-bdcd-a0512739a1eb"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:10:29.349417 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:10:29.397944 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-74bb407a-cd4a-40e0-8f92-81b8ac25c059 req-5c8285f2-937f-4ce3-8989-e6a2742a7bdd service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:29.404402 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-74bb407a-cd4a-40e0-8f92-81b8ac25c059 req-5c8285f2-937f-4ce3-8989-e6a2742a7bdd service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:29.409060 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-74bb407a-cd4a-40e0-8f92-81b8ac25c059 req-5c8285f2-937f-4ce3-8989-e6a2742a7bdd service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:29.452849 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-74bb407a-cd4a-40e0-8f92-81b8ac25c059 req-5c8285f2-937f-4ce3-8989-e6a2742a7bdd service nova] Creating event network-vif-deleted:f8ab5210-6e46-4a53-bdcd-a0512739a1eb for instance 98ee37e8-3835-4d28-9e41-64b96c7de74f on n-h1-850501-12 Sep 08 11:10:29.465198 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-74bb407a-cd4a-40e0-8f92-81b8ac25c059 req-5c8285f2-937f-4ce3-8989-e6a2742a7bdd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154454 Sep 08 11:10:29.470477 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2782/5463] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:10:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:10:29.486797 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5766a900-ad68-4d71-b93a-64045e80a11d tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:29.503488 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5766a900-ad68-4d71-b93a-64045e80a11d tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 98ee37e8-3835-4d28-9e41-64b96c7de74f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:29.538994 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5766a900-ad68-4d71-b93a-64045e80a11d tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:29.541467 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5766a900-ad68-4d71-b93a-64045e80a11d tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:29.542312 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5766a900-ad68-4d71-b93a-64045e80a11d tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:29.543123 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5766a900-ad68-4d71-b93a-64045e80a11d tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:29.543617 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5766a900-ad68-4d71-b93a-64045e80a11d tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:29.544062 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5766a900-ad68-4d71-b93a-64045e80a11d tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:29.680815 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5766a900-ad68-4d71-b93a-64045e80a11d tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:29.685817 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5766a900-ad68-4d71-b93a-64045e80a11d tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:29.686288 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5766a900-ad68-4d71-b93a-64045e80a11d tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:29.687362 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-5766a900-ad68-4d71-b93a-64045e80a11d tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lazy-loading 'fault' on Instance uuid 98ee37e8-3835-4d28-9e41-64b96c7de74f {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:10:29.902313 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5766a900-ad68-4d71-b93a-64045e80a11d tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:29.929311 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5766a900-ad68-4d71-b93a-64045e80a11d tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/98ee37e8-3835-4d28-9e41-64b96c7de74f" status: 200 len: 1320 microversion: 2.1 time: 0.456905 Sep 08 11:10:29.933698 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2783/5464] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:29 2022] GET /compute/v2.1/servers/98ee37e8-3835-4d28-9e41-64b96c7de74f => generated 1320 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:10:29.938390 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fa605b6c-9c45-449f-a2f3-d04e7a78f224 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 7.173757 Sep 08 11:10:29.939683 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2682/5465] 10.222.0.27 () {60 vars in 1170 bytes} [Thu Sep 8 11:10:22 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 7176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:10:29.962878 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-dfe33d37-6fca-4f5e-aac9-8c9316b0835c tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.7.143"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:10:29.976334 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-dfe33d37-6fca-4f5e-aac9-8c9316b0835c tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] [instance: 41f1a22f-64b4-4564-94a9-99fc6740e0a1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:29.997718 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dfe33d37-6fca-4f5e-aac9-8c9316b0835c tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:29.999340 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dfe33d37-6fca-4f5e-aac9-8c9316b0835c tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:30.003410 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dfe33d37-6fca-4f5e-aac9-8c9316b0835c tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:30.005401 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dfe33d37-6fca-4f5e-aac9-8c9316b0835c tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:30.006664 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dfe33d37-6fca-4f5e-aac9-8c9316b0835c tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:30.008025 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dfe33d37-6fca-4f5e-aac9-8c9316b0835c tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:30.090035 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dfe33d37-6fca-4f5e-aac9-8c9316b0835c tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "refresh_cache-41f1a22f-64b4-4564-94a9-99fc6740e0a1" {{(pid=128861) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 08 11:10:30.090455 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dfe33d37-6fca-4f5e-aac9-8c9316b0835c tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquired lock "refresh_cache-41f1a22f-64b4-4564-94a9-99fc6740e0a1" {{(pid=128861) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 08 11:10:30.966020 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-69b706fc-4fab-4b46-8e3a-3c6d7c9ab43d tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:30.967236 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-69b706fc-4fab-4b46-8e3a-3c6d7c9ab43d tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 98ee37e8-3835-4d28-9e41-64b96c7de74f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:30.972478 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=36 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:10:30.992523 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-69b706fc-4fab-4b46-8e3a-3c6d7c9ab43d tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:30.995079 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-69b706fc-4fab-4b46-8e3a-3c6d7c9ab43d tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:30.995713 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-69b706fc-4fab-4b46-8e3a-3c6d7c9ab43d tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:30.998111 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-69b706fc-4fab-4b46-8e3a-3c6d7c9ab43d tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:30.998765 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-69b706fc-4fab-4b46-8e3a-3c6d7c9ab43d tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:31.001202 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-69b706fc-4fab-4b46-8e3a-3c6d7c9ab43d tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:31.054344 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-69b706fc-4fab-4b46-8e3a-3c6d7c9ab43d tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] HTTP exception thrown: Instance 98ee37e8-3835-4d28-9e41-64b96c7de74f could not be found. Sep 08 11:10:31.067347 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-69b706fc-4fab-4b46-8e3a-3c6d7c9ab43d tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Request method failure captured: Sep 08 11:10:31.067347 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/98ee37e8-3835-4d28-9e41-64b96c7de74f HTTP/1.1 Sep 08 11:10:31.067347 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 11:10:31.067347 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 11:10:31.067347 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 11:10:31.067347 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 11:10:31.067347 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 11:10:31.067347 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 11:10:31.067347 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 11:10:31.067347 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 11:10:31.067347 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGczsmQNk4U50BxzpgES3MzOpQCXZXSfv8U0fcthNptdjh-xj4_PXNp1cjGhvwh0ftE8negXuLuWJgSY_-2MLUgv_DNMLspYk9lV1lwtSgINsi9nLe-7tZYJuQnQiEJ_Nrc9KtaPntdIqDspehXXUE-x22uN3GKjXVnYgVPtfdxa4_cE Sep 08 11:10:31.067347 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 11:10:31.067347 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 11:10:31.067347 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 11:10:31.067347 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 11:10:31.067347 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 11:10:31.067347 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 11:10:31.067347 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 7868787bfea94355a5d5971bab0d5ed4 Sep 08 11:10:31.067347 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersTestJSON-1882931607 Sep 08 11:10:31.067347 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 11:10:31.067347 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 11:10:31.067347 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:10:31.067347 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServersTestJSON-1882931607 Sep 08 11:10:31.067347 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 7868787bfea94355a5d5971bab0d5ed4 Sep 08 11:10:31.067347 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersTestJSON-1882931607 Sep 08 11:10:31.067347 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServersTestJSON-1882931607-project Sep 08 11:10:31.067347 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 11:10:31.067347 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 11:10:31.067347 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 5193272e9ab24845aff53982dbe2c6f0 Sep 08 11:10:31.067347 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServersTestJSON-1882931607-project Sep 08 11:10:31.067347 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 11:10:31.067347 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 98ee37e8-3835-4d28-9e41-64b96c7de74f could not be found. Sep 08 11:10:31.067347 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '98ee37e8-3835-4d28-9e41-64b96c7de74f'} Sep 08 11:10:31.067347 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:10:31.067347 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:10:31.067347 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:10:31.067347 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:10:31.067347 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:10:31.067347 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:10:31.067347 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:10:31.067347 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:10:31.067347 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:10:31.067347 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:10:31.067347 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98ee37e8-3835-4d28-9e41-64b96c7de74f could not be found. Sep 08 11:10:31.067347 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:10:31.067347 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:10:31.067347 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:10:31.067347 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:10:31.067347 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:10:31.067347 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:10:31.067347 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:10:31.067347 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:10:31.067347 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:10:31.067347 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:10:31.067347 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:10:31.067347 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:10:31.067347 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:10:31.067347 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:10:31.067347 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:10:31.067347 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:10:31.067347 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98ee37e8-3835-4d28-9e41-64b96c7de74f could not be found. Sep 08 11:10:31.067347 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:10:31.067347 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:10:31.067347 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:10:31.072081 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:10:31.072081 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:10:31.072081 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:10:31.072081 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:10:31.072081 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:10:31.072081 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98ee37e8-3835-4d28-9e41-64b96c7de74f could not be found. Sep 08 11:10:31.072081 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:10:31.072081 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-69b706fc-4fab-4b46-8e3a-3c6d7c9ab43d tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Returning 404 to user: Instance 98ee37e8-3835-4d28-9e41-64b96c7de74f could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:10:31.078264 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-69b706fc-4fab-4b46-8e3a-3c6d7c9ab43d tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/98ee37e8-3835-4d28-9e41-64b96c7de74f" status: 404 len: 111 microversion: 2.1 time: 0.119053 Sep 08 11:10:31.078866 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2683/5466] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:30 2022] GET /compute/v2.1/servers/98ee37e8-3835-4d28-9e41-64b96c7de74f => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 11:10:31.365159 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-09905892-1c14-416e-8367-dca61a848c36 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-949527740", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "20951261-edda-4da9-a3e2-8f222023ad9d"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:10:31.491276 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-09905892-1c14-416e-8367-dca61a848c36 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] validate_networks() for [('20951261-edda-4da9-a3e2-8f222023ad9d', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:10:33.446175 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-09905892-1c14-416e-8367-dca61a848c36 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:10:33.446764 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-09905892-1c14-416e-8367-dca61a848c36 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:10:33.447674 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-09905892-1c14-416e-8367-dca61a848c36 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:10:33.448220 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-09905892-1c14-416e-8367-dca61a848c36 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:10:33.448753 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-09905892-1c14-416e-8367-dca61a848c36 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:10:33.487621 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-09905892-1c14-416e-8367-dca61a848c36 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:33.488248 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-09905892-1c14-416e-8367-dca61a848c36 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:33.488843 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-09905892-1c14-416e-8367-dca61a848c36 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:33.489757 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-09905892-1c14-416e-8367-dca61a848c36 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:33.490344 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-09905892-1c14-416e-8367-dca61a848c36 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:33.490895 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-09905892-1c14-416e-8367-dca61a848c36 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:33.547088 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-09905892-1c14-416e-8367-dca61a848c36 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Getting quotas for project 7868787bfea94355a5d5971bab0d5ed4. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:10:33.564118 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-09905892-1c14-416e-8367-dca61a848c36 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Getting quotas for user 5193272e9ab24845aff53982dbe2c6f0 and project 7868787bfea94355a5d5971bab0d5ed4. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:10:33.602179 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-09905892-1c14-416e-8367-dca61a848c36 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:10:33.610997 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-09905892-1c14-416e-8367-dca61a848c36 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 77f13257-556d-4301-901b-92a99560c5d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:10:33.761477 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-09905892-1c14-416e-8367-dca61a848c36 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.400150 Sep 08 11:10:33.764797 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2684/5467] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 11:10:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2404 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:10:33.776675 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5399bb94-fee3-4cdc-a000-77ff98e5b486 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:33.777774 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5399bb94-fee3-4cdc-a000-77ff98e5b486 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 77f13257-556d-4301-901b-92a99560c5d1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:34.345735 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5399bb94-fee3-4cdc-a000-77ff98e5b486 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:34.357861 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5399bb94-fee3-4cdc-a000-77ff98e5b486 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1" status: 200 len: 1208 microversion: 2.1 time: 0.586133 Sep 08 11:10:34.358799 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2685/5468] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:33 2022] GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1 => generated 1208 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:10:35.149744 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-dfe33d37-6fca-4f5e-aac9-8c9316b0835c tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] [instance: 41f1a22f-64b4-4564-94a9-99fc6740e0a1] Building network info cache for instance {{(pid=128861) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 08 11:10:35.163010 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-e3aa32b5-8ad8-4b6f-a567-59893306e7dc req-ff86f01d-3533-4cdf-8b2e-43c68b761b84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41f1a22f-64b4-4564-94a9-99fc6740e0a1", "tag": "62403e83-a296-4c79-be79-7a813046d1fe"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:10:35.193475 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e3aa32b5-8ad8-4b6f-a567-59893306e7dc req-ff86f01d-3533-4cdf-8b2e-43c68b761b84 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:35.194007 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e3aa32b5-8ad8-4b6f-a567-59893306e7dc req-ff86f01d-3533-4cdf-8b2e-43c68b761b84 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:35.199292 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e3aa32b5-8ad8-4b6f-a567-59893306e7dc req-ff86f01d-3533-4cdf-8b2e-43c68b761b84 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:35.250436 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-e3aa32b5-8ad8-4b6f-a567-59893306e7dc req-ff86f01d-3533-4cdf-8b2e-43c68b761b84 service nova] Creating event network-changed:62403e83-a296-4c79-be79-7a813046d1fe for instance 41f1a22f-64b4-4564-94a9-99fc6740e0a1 on n-h2-850501-12 Sep 08 11:10:35.272105 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-e3aa32b5-8ad8-4b6f-a567-59893306e7dc req-ff86f01d-3533-4cdf-8b2e-43c68b761b84 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113519 Sep 08 11:10:35.278147 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2686/5469] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:10:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:10:35.386571 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e3651c0f-2072-4479-8cb8-9446cce35f2c tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:35.387358 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e3651c0f-2072-4479-8cb8-9446cce35f2c tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 77f13257-556d-4301-901b-92a99560c5d1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:35.409871 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e3651c0f-2072-4479-8cb8-9446cce35f2c tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:35.411318 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e3651c0f-2072-4479-8cb8-9446cce35f2c tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:35.413048 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e3651c0f-2072-4479-8cb8-9446cce35f2c tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:35.415088 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e3651c0f-2072-4479-8cb8-9446cce35f2c tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:35.416643 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e3651c0f-2072-4479-8cb8-9446cce35f2c tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:35.417276 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e3651c0f-2072-4479-8cb8-9446cce35f2c tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:35.679553 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e3651c0f-2072-4479-8cb8-9446cce35f2c tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:35.700097 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e3651c0f-2072-4479-8cb8-9446cce35f2c tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1" status: 200 len: 1204 microversion: 2.1 time: 0.319521 Sep 08 11:10:35.718630 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2687/5470] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:35 2022] GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1 => generated 1204 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:10:36.730233 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c0f3cdc6-8905-412c-a95a-f47ce6feebe6 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:36.730888 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c0f3cdc6-8905-412c-a95a-f47ce6feebe6 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 77f13257-556d-4301-901b-92a99560c5d1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:36.755665 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c0f3cdc6-8905-412c-a95a-f47ce6feebe6 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:36.756376 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c0f3cdc6-8905-412c-a95a-f47ce6feebe6 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:36.756828 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c0f3cdc6-8905-412c-a95a-f47ce6feebe6 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:36.757584 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c0f3cdc6-8905-412c-a95a-f47ce6feebe6 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:36.758099 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c0f3cdc6-8905-412c-a95a-f47ce6feebe6 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:36.758476 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c0f3cdc6-8905-412c-a95a-f47ce6feebe6 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:37.001357 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c0f3cdc6-8905-412c-a95a-f47ce6feebe6 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:37.005819 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-dfe33d37-6fca-4f5e-aac9-8c9316b0835c tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] [instance: 41f1a22f-64b4-4564-94a9-99fc6740e0a1] Updating instance_info_cache with network_info: [{"id": "62403e83-a296-4c79-be79-7a813046d1fe", "address": "fa:16:3e:a6:ac:70", "network": {"id": "7dd0b2cb-750a-4628-9931-f3077763e79f", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1587166013-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.7.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "6cdc4842f7d54826abd0086ad6654dbd", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap62403e83-a2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128861) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 08 11:10:37.011342 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c0f3cdc6-8905-412c-a95a-f47ce6feebe6 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1" status: 200 len: 1266 microversion: 2.1 time: 0.285938 Sep 08 11:10:37.011912 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2688/5471] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:36 2022] GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1 => generated 1266 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:10:37.031057 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dfe33d37-6fca-4f5e-aac9-8c9316b0835c tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Releasing lock "refresh_cache-41f1a22f-64b4-4564-94a9-99fc6740e0a1" {{(pid=128861) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 08 11:10:37.032304 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-dfe33d37-6fca-4f5e-aac9-8c9316b0835c tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] 10.222.0.27 "POST /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1/action" status: 202 len: 0 microversion: 2.1 time: 7.080091 Sep 08 11:10:37.033456 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2784/5472] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 11:10:29 2022] POST /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1/action => generated 0 bytes in 7082 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 08 11:10:37.063600 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ad5d99ec-d7af-4504-b1e4-e1d7209c4a67 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.7.143"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:10:37.906472 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ad5d99ec-d7af-4504-b1e4-e1d7209c4a67 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] [instance: 41f1a22f-64b4-4564-94a9-99fc6740e0a1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:37.913926 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad5d99ec-d7af-4504-b1e4-e1d7209c4a67 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:37.914420 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad5d99ec-d7af-4504-b1e4-e1d7209c4a67 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:37.914859 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad5d99ec-d7af-4504-b1e4-e1d7209c4a67 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:37.916371 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad5d99ec-d7af-4504-b1e4-e1d7209c4a67 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:37.916837 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad5d99ec-d7af-4504-b1e4-e1d7209c4a67 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:37.917300 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad5d99ec-d7af-4504-b1e4-e1d7209c4a67 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:38.035882 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-635a058e-5d99-414c-bc13-86a5f44ded60 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:38.037670 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-635a058e-5d99-414c-bc13-86a5f44ded60 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 77f13257-556d-4301-901b-92a99560c5d1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:38.067458 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-635a058e-5d99-414c-bc13-86a5f44ded60 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:38.072650 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-635a058e-5d99-414c-bc13-86a5f44ded60 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:38.073953 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-635a058e-5d99-414c-bc13-86a5f44ded60 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:38.075275 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-635a058e-5d99-414c-bc13-86a5f44ded60 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:38.078577 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-635a058e-5d99-414c-bc13-86a5f44ded60 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:38.080589 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-635a058e-5d99-414c-bc13-86a5f44ded60 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:38.273749 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-635a058e-5d99-414c-bc13-86a5f44ded60 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:38.287362 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-635a058e-5d99-414c-bc13-86a5f44ded60 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1" status: 200 len: 1266 microversion: 2.1 time: 0.256288 Sep 08 11:10:38.292791 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2785/5473] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:38 2022] GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1 => generated 1266 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:10:38.329207 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-33e2bc34-6886-4d12-8a3f-9bf6a66c5a94 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:38.329779 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-33e2bc34-6886-4d12-8a3f-9bf6a66c5a94 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] [instance: 5b547b31-4774-4c3b-a092-f10d890d57e6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:38.348901 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-33e2bc34-6886-4d12-8a3f-9bf6a66c5a94 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:38.353127 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-33e2bc34-6886-4d12-8a3f-9bf6a66c5a94 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:38.353950 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-33e2bc34-6886-4d12-8a3f-9bf6a66c5a94 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:38.354926 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-33e2bc34-6886-4d12-8a3f-9bf6a66c5a94 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:38.355417 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-33e2bc34-6886-4d12-8a3f-9bf6a66c5a94 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:38.355850 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-33e2bc34-6886-4d12-8a3f-9bf6a66c5a94 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:38.540176 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-33e2bc34-6886-4d12-8a3f-9bf6a66c5a94 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lazy-loading 'services' on Instance uuid 5b547b31-4774-4c3b-a092-f10d890d57e6 {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:10:38.646607 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:10:38.667729 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-33e2bc34-6886-4d12-8a3f-9bf6a66c5a94 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5b547b31-4774-4c3b-a092-f10d890d57e6/os-volume_attachments/da4539f8-7c64-4a3c-954c-5a48f785ecea" status: 202 len: 0 microversion: 2.1 time: 0.361679 Sep 08 11:10:38.668780 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2786/5474] 10.222.0.27 () {58 vars in 1416 bytes} [Thu Sep 8 11:10:38 2022] DELETE /compute/v2.1/servers/5b547b31-4774-4c3b-a092-f10d890d57e6/os-volume_attachments/da4539f8-7c64-4a3c-954c-5a48f785ecea => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:10:38.934008 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad5d99ec-d7af-4504-b1e4-e1d7209c4a67 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "refresh_cache-41f1a22f-64b4-4564-94a9-99fc6740e0a1" {{(pid=128862) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 08 11:10:38.934849 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad5d99ec-d7af-4504-b1e4-e1d7209c4a67 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquired lock "refresh_cache-41f1a22f-64b4-4564-94a9-99fc6740e0a1" {{(pid=128862) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 08 11:10:39.322001 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0891c5d6-a708-4e43-9902-84016c0c4a4f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:39.322423 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0891c5d6-a708-4e43-9902-84016c0c4a4f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 77f13257-556d-4301-901b-92a99560c5d1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:39.342868 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0891c5d6-a708-4e43-9902-84016c0c4a4f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:39.343668 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0891c5d6-a708-4e43-9902-84016c0c4a4f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:39.344325 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0891c5d6-a708-4e43-9902-84016c0c4a4f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:39.345236 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0891c5d6-a708-4e43-9902-84016c0c4a4f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:39.345855 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0891c5d6-a708-4e43-9902-84016c0c4a4f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:39.346496 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0891c5d6-a708-4e43-9902-84016c0c4a4f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:39.489193 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0891c5d6-a708-4e43-9902-84016c0c4a4f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:39.503187 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0891c5d6-a708-4e43-9902-84016c0c4a4f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1" status: 200 len: 1266 microversion: 2.1 time: 0.189116 Sep 08 11:10:39.503797 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2787/5475] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:39 2022] GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1 => generated 1266 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:10:40.529669 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e07ecc49-ebce-40b2-b622-4180d6a6b440 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:40.531145 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e07ecc49-ebce-40b2-b622-4180d6a6b440 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 77f13257-556d-4301-901b-92a99560c5d1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:40.554358 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e07ecc49-ebce-40b2-b622-4180d6a6b440 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:40.555935 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e07ecc49-ebce-40b2-b622-4180d6a6b440 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:40.561707 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e07ecc49-ebce-40b2-b622-4180d6a6b440 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:40.563109 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e07ecc49-ebce-40b2-b622-4180d6a6b440 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:40.564464 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e07ecc49-ebce-40b2-b622-4180d6a6b440 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:40.565725 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e07ecc49-ebce-40b2-b622-4180d6a6b440 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:41.651735 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e07ecc49-ebce-40b2-b622-4180d6a6b440 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:41.664741 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e07ecc49-ebce-40b2-b622-4180d6a6b440 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1" status: 200 len: 1308 microversion: 2.1 time: 1.140820 Sep 08 11:10:41.669212 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2788/5476] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:40 2022] GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1 => generated 1308 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:10:42.586477 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-ad5d99ec-d7af-4504-b1e4-e1d7209c4a67 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] [instance: 41f1a22f-64b4-4564-94a9-99fc6740e0a1] Building network info cache for instance {{(pid=128862) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 08 11:10:42.588856 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=68 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:10:42.694139 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-838538fa-fcae-41ef-b7e4-cdad7c7f751a req-135746aa-927b-4342-83b7-1a61e83c2041 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41f1a22f-64b4-4564-94a9-99fc6740e0a1", "tag": "62403e83-a296-4c79-be79-7a813046d1fe"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:10:42.739083 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-838538fa-fcae-41ef-b7e4-cdad7c7f751a req-135746aa-927b-4342-83b7-1a61e83c2041 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:42.741282 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-838538fa-fcae-41ef-b7e4-cdad7c7f751a req-135746aa-927b-4342-83b7-1a61e83c2041 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:42.741747 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-838538fa-fcae-41ef-b7e4-cdad7c7f751a req-135746aa-927b-4342-83b7-1a61e83c2041 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:42.788341 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-838538fa-fcae-41ef-b7e4-cdad7c7f751a req-135746aa-927b-4342-83b7-1a61e83c2041 service nova] Creating event network-changed:62403e83-a296-4c79-be79-7a813046d1fe for instance 41f1a22f-64b4-4564-94a9-99fc6740e0a1 on n-h2-850501-12 Sep 08 11:10:42.824220 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-838538fa-fcae-41ef-b7e4-cdad7c7f751a req-135746aa-927b-4342-83b7-1a61e83c2041 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138720 Sep 08 11:10:42.826862 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2789/5477] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:10:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:10:42.841912 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2bfce016-b561-40b2-ba52-e8f524acb752 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:42.843897 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2bfce016-b561-40b2-ba52-e8f524acb752 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 77f13257-556d-4301-901b-92a99560c5d1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:42.870710 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2bfce016-b561-40b2-ba52-e8f524acb752 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:42.873124 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2bfce016-b561-40b2-ba52-e8f524acb752 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:42.874927 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2bfce016-b561-40b2-ba52-e8f524acb752 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:42.876302 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2bfce016-b561-40b2-ba52-e8f524acb752 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:42.878170 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2bfce016-b561-40b2-ba52-e8f524acb752 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:42.880452 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2bfce016-b561-40b2-ba52-e8f524acb752 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:43.450902 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2bfce016-b561-40b2-ba52-e8f524acb752 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:43.459307 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2bfce016-b561-40b2-ba52-e8f524acb752 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1" status: 200 len: 1308 microversion: 2.1 time: 0.631100 Sep 08 11:10:43.459906 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2790/5478] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:42 2022] GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1 => generated 1308 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:10:43.522111 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:10:44.349706 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=8 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:10:44.489999 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f19b511c-33c7-4b28-9d0e-860a65509ca7 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:44.490625 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f19b511c-33c7-4b28-9d0e-860a65509ca7 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 77f13257-556d-4301-901b-92a99560c5d1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:44.503782 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f19b511c-33c7-4b28-9d0e-860a65509ca7 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:44.504706 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f19b511c-33c7-4b28-9d0e-860a65509ca7 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:44.507624 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f19b511c-33c7-4b28-9d0e-860a65509ca7 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:44.508549 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f19b511c-33c7-4b28-9d0e-860a65509ca7 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:44.512129 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f19b511c-33c7-4b28-9d0e-860a65509ca7 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:44.517726 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f19b511c-33c7-4b28-9d0e-860a65509ca7 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:45.155613 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-ad5d99ec-d7af-4504-b1e4-e1d7209c4a67 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] [instance: 41f1a22f-64b4-4564-94a9-99fc6740e0a1] Updating instance_info_cache with network_info: [{"id": "62403e83-a296-4c79-be79-7a813046d1fe", "address": "fa:16:3e:a6:ac:70", "network": {"id": "7dd0b2cb-750a-4628-9931-f3077763e79f", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1587166013-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "6cdc4842f7d54826abd0086ad6654dbd", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap62403e83-a2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128862) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 08 11:10:45.182157 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad5d99ec-d7af-4504-b1e4-e1d7209c4a67 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Releasing lock "refresh_cache-41f1a22f-64b4-4564-94a9-99fc6740e0a1" {{(pid=128862) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 08 11:10:45.183038 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ad5d99ec-d7af-4504-b1e4-e1d7209c4a67 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] 10.222.0.27 "POST /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1/action" status: 202 len: 0 microversion: 2.1 time: 8.138069 Sep 08 11:10:45.183843 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2689/5479] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 11:10:37 2022] POST /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1/action => generated 0 bytes in 8139 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 08 11:10:45.208567 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a635284e-9562-4aa7-83d2-f39913c31553 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Calling method '.version_select at 0x7f68e44c9ee0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:45.449681 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f19b511c-33c7-4b28-9d0e-860a65509ca7 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:45.467128 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f19b511c-33c7-4b28-9d0e-860a65509ca7 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1" status: 200 len: 1308 microversion: 2.1 time: 0.984916 Sep 08 11:10:45.474951 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2791/5480] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:44 2022] GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1 => generated 1308 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:10:45.480016 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-fbef791f-58d3-4ea0-800a-22e3cc05b486 req-df231ef8-1e97-4177-9c28-cd741ca8733e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77f13257-556d-4301-901b-92a99560c5d1", "tag": "0825e9e2-7ab2-4ee2-9782-aab8c75eada0"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:10:45.513721 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-fbef791f-58d3-4ea0-800a-22e3cc05b486 req-df231ef8-1e97-4177-9c28-cd741ca8733e service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:45.514977 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-fbef791f-58d3-4ea0-800a-22e3cc05b486 req-df231ef8-1e97-4177-9c28-cd741ca8733e service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:45.515596 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-fbef791f-58d3-4ea0-800a-22e3cc05b486 req-df231ef8-1e97-4177-9c28-cd741ca8733e service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:45.530433 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-fbef791f-58d3-4ea0-800a-22e3cc05b486 req-df231ef8-1e97-4177-9c28-cd741ca8733e service nova] Creating event network-changed:0825e9e2-7ab2-4ee2-9782-aab8c75eada0 for instance 77f13257-556d-4301-901b-92a99560c5d1 on n-h1-850501-12 Sep 08 11:10:45.537247 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-fbef791f-58d3-4ea0-800a-22e3cc05b486 req-df231ef8-1e97-4177-9c28-cd741ca8733e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060110 Sep 08 11:10:45.538339 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2792/5481] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:10:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:10:46.494334 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a02c8b43-dd2c-42e1-87b2-089b3a5c8e05 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:46.495104 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a02c8b43-dd2c-42e1-87b2-089b3a5c8e05 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 77f13257-556d-4301-901b-92a99560c5d1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:46.509900 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a02c8b43-dd2c-42e1-87b2-089b3a5c8e05 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:46.510406 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a02c8b43-dd2c-42e1-87b2-089b3a5c8e05 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:46.510846 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a02c8b43-dd2c-42e1-87b2-089b3a5c8e05 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:46.511571 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a02c8b43-dd2c-42e1-87b2-089b3a5c8e05 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:46.512030 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a02c8b43-dd2c-42e1-87b2-089b3a5c8e05 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:46.512461 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a02c8b43-dd2c-42e1-87b2-089b3a5c8e05 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:46.919178 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a02c8b43-dd2c-42e1-87b2-089b3a5c8e05 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:46.929477 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a02c8b43-dd2c-42e1-87b2-089b3a5c8e05 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1" status: 200 len: 1308 microversion: 2.1 time: 0.440585 Sep 08 11:10:46.930002 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2793/5482] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:46 2022] GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1 => generated 1308 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:10:47.784671 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9341b41d-c551-40a8-89ab-c894604be766 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:47.785829 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9341b41d-c551-40a8-89ab-c894604be766 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] [instance: 5b547b31-4774-4c3b-a092-f10d890d57e6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:47.799602 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9341b41d-c551-40a8-89ab-c894604be766 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:47.800694 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9341b41d-c551-40a8-89ab-c894604be766 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:47.801577 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9341b41d-c551-40a8-89ab-c894604be766 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:47.803305 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9341b41d-c551-40a8-89ab-c894604be766 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:47.804515 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9341b41d-c551-40a8-89ab-c894604be766 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:47.805885 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9341b41d-c551-40a8-89ab-c894604be766 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:47.890714 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9341b41d-c551-40a8-89ab-c894604be766 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] [instance: 5b547b31-4774-4c3b-a092-f10d890d57e6] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:10:47.911077 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:10:48.143223 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9341b41d-c551-40a8-89ab-c894604be766 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5b547b31-4774-4c3b-a092-f10d890d57e6" status: 204 len: 0 microversion: 2.1 time: 0.359133 Sep 08 11:10:48.146369 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2794/5483] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:10:47 2022] DELETE /compute/v2.1/servers/5b547b31-4774-4c3b-a092-f10d890d57e6 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 11:10:48.147211 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a635284e-9562-4aa7-83d2-f39913c31553 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/596340f4-fed2-413d-9207-e2869846baaf" status: 202 len: 0 microversion: 2.1 time: 2.958992 Sep 08 11:10:48.152571 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2690/5484] 10.222.0.27 () {58 vars in 1263 bytes} [Thu Sep 8 11:10:45 2022] DELETE /compute/v2.1/os-floating-ips/596340f4-fed2-413d-9207-e2869846baaf => generated 0 bytes in 2965 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:10:48.157947 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4920ff03-9132-4139-8333-06a3edd77c69 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:48.158451 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-70945d89-193d-4d8b-9942-052984617dd6 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:48.159131 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-70945d89-193d-4d8b-9942-052984617dd6 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] [instance: 5b547b31-4774-4c3b-a092-f10d890d57e6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:48.159483 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4920ff03-9132-4139-8333-06a3edd77c69 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 77f13257-556d-4301-901b-92a99560c5d1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:48.175854 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4920ff03-9132-4139-8333-06a3edd77c69 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:48.176951 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4920ff03-9132-4139-8333-06a3edd77c69 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:48.178490 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4920ff03-9132-4139-8333-06a3edd77c69 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:48.179501 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4920ff03-9132-4139-8333-06a3edd77c69 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:48.180476 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4920ff03-9132-4139-8333-06a3edd77c69 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:48.181742 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4920ff03-9132-4139-8333-06a3edd77c69 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:48.189067 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70945d89-193d-4d8b-9942-052984617dd6 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:48.189067 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70945d89-193d-4d8b-9942-052984617dd6 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:48.189067 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70945d89-193d-4d8b-9942-052984617dd6 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:48.189500 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70945d89-193d-4d8b-9942-052984617dd6 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:48.200078 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70945d89-193d-4d8b-9942-052984617dd6 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:48.200655 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70945d89-193d-4d8b-9942-052984617dd6 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:48.585393 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4920ff03-9132-4139-8333-06a3edd77c69 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:48.599243 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4920ff03-9132-4139-8333-06a3edd77c69 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1" status: 200 len: 1308 microversion: 2.1 time: 0.449903 Sep 08 11:10:48.603432 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2795/5485] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:48 2022] GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1 => generated 1308 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:10:48.605879 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-70945d89-193d-4d8b-9942-052984617dd6 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6618b7ad8ff146dfbd892e3e35c2691f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e29f32d2ac4800b9b767f9e1b16526', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:48.610525 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-24e9f2dc-d0e5-4e67-915a-c19ef3d6edc3 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Calling method '.version_select at 0x7f68df225040>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:48.649964 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-70945d89-193d-4d8b-9942-052984617dd6 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] 10.222.0.27 "GET /compute/v2.1/servers/5b547b31-4774-4c3b-a092-f10d890d57e6" status: 200 len: 1513 microversion: 2.1 time: 0.495012 Sep 08 11:10:48.650977 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2691/5486] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:48 2022] GET /compute/v2.1/servers/5b547b31-4774-4c3b-a092-f10d890d57e6 => generated 1513 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:10:48.945001 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-24e9f2dc-d0e5-4e67-915a-c19ef3d6edc3 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/9b26c6dc-0acc-47cd-8606-d421d7554d01" status: 202 len: 0 microversion: 2.1 time: 0.339851 Sep 08 11:10:48.947670 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2796/5487] 10.222.0.27 () {58 vars in 1272 bytes} [Thu Sep 8 11:10:48 2022] DELETE /compute/v2.1/os-security-groups/9b26c6dc-0acc-47cd-8606-d421d7554d01 => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:10:48.955519 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-54fabdf2-5d85-4fce-a1e0-bd8f7611ab45 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:48.956398 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-54fabdf2-5d85-4fce-a1e0-bd8f7611ab45 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] [instance: 41f1a22f-64b4-4564-94a9-99fc6740e0a1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:48.968224 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54fabdf2-5d85-4fce-a1e0-bd8f7611ab45 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:48.970188 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54fabdf2-5d85-4fce-a1e0-bd8f7611ab45 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:48.970888 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54fabdf2-5d85-4fce-a1e0-bd8f7611ab45 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:48.972471 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54fabdf2-5d85-4fce-a1e0-bd8f7611ab45 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:48.974320 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54fabdf2-5d85-4fce-a1e0-bd8f7611ab45 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:48.975240 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54fabdf2-5d85-4fce-a1e0-bd8f7611ab45 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:49.050121 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-54fabdf2-5d85-4fce-a1e0-bd8f7611ab45 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] [instance: 41f1a22f-64b4-4564-94a9-99fc6740e0a1] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:10:49.205156 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-54fabdf2-5d85-4fce-a1e0-bd8f7611ab45 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] 10.222.0.27 "DELETE /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1" status: 204 len: 0 microversion: 2.1 time: 0.252622 Sep 08 11:10:49.211491 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2692/5488] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:10:48 2022] DELETE /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:10:49.215713 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8974eb69-8410-4624-9b49-ee76ddf33de6 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:49.216654 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8974eb69-8410-4624-9b49-ee76ddf33de6 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] [instance: 41f1a22f-64b4-4564-94a9-99fc6740e0a1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:49.223849 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8974eb69-8410-4624-9b49-ee76ddf33de6 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:49.224523 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8974eb69-8410-4624-9b49-ee76ddf33de6 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:49.225277 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8974eb69-8410-4624-9b49-ee76ddf33de6 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:49.226108 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8974eb69-8410-4624-9b49-ee76ddf33de6 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:49.226801 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8974eb69-8410-4624-9b49-ee76ddf33de6 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:49.228006 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8974eb69-8410-4624-9b49-ee76ddf33de6 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:49.513916 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8974eb69-8410-4624-9b49-ee76ddf33de6 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25641daaa044b1bb0e53d4d2b350f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdc4842f7d54826abd0086ad6654dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:49.546547 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8974eb69-8410-4624-9b49-ee76ddf33de6 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] 10.222.0.27 "GET /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1" status: 200 len: 1508 microversion: 2.1 time: 0.335762 Sep 08 11:10:49.548568 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2797/5489] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:49 2022] GET /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1 => generated 1508 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:10:49.652641 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b140297c-a944-4235-974d-04e8bb652624 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:49.653836 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b140297c-a944-4235-974d-04e8bb652624 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 77f13257-556d-4301-901b-92a99560c5d1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:49.664282 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b140297c-a944-4235-974d-04e8bb652624 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:49.665126 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b140297c-a944-4235-974d-04e8bb652624 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:49.665726 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b140297c-a944-4235-974d-04e8bb652624 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:49.666628 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b140297c-a944-4235-974d-04e8bb652624 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:49.667248 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b140297c-a944-4235-974d-04e8bb652624 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:49.667868 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b140297c-a944-4235-974d-04e8bb652624 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:49.677988 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0e833c1f-720c-43cc-93a9-b48eb8aaf4ca tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:49.678698 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0e833c1f-720c-43cc-93a9-b48eb8aaf4ca tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] [instance: 5b547b31-4774-4c3b-a092-f10d890d57e6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:49.688948 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e833c1f-720c-43cc-93a9-b48eb8aaf4ca tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:49.689483 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e833c1f-720c-43cc-93a9-b48eb8aaf4ca tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:49.689922 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e833c1f-720c-43cc-93a9-b48eb8aaf4ca tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:49.697133 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e833c1f-720c-43cc-93a9-b48eb8aaf4ca tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:49.697673 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e833c1f-720c-43cc-93a9-b48eb8aaf4ca tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:49.698119 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e833c1f-720c-43cc-93a9-b48eb8aaf4ca tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:49.944668 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0e833c1f-720c-43cc-93a9-b48eb8aaf4ca tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6618b7ad8ff146dfbd892e3e35c2691f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e29f32d2ac4800b9b767f9e1b16526', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:49.960935 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0e833c1f-720c-43cc-93a9-b48eb8aaf4ca tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] 10.222.0.27 "GET /compute/v2.1/servers/5b547b31-4774-4c3b-a092-f10d890d57e6" status: 200 len: 1513 microversion: 2.1 time: 0.288701 Sep 08 11:10:49.963139 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2798/5490] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:49 2022] GET /compute/v2.1/servers/5b547b31-4774-4c3b-a092-f10d890d57e6 => generated 1513 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:10:50.028594 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b140297c-a944-4235-974d-04e8bb652624 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:50.037845 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b140297c-a944-4235-974d-04e8bb652624 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1" status: 200 len: 1308 microversion: 2.1 time: 0.391729 Sep 08 11:10:50.042647 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2693/5491] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:49 2022] GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1 => generated 1308 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:10:50.573658 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-98615acf-2e36-47fe-bd45-6b5008b20233 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:50.575121 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-98615acf-2e36-47fe-bd45-6b5008b20233 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] [instance: 41f1a22f-64b4-4564-94a9-99fc6740e0a1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:50.589908 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-98615acf-2e36-47fe-bd45-6b5008b20233 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:50.596180 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-98615acf-2e36-47fe-bd45-6b5008b20233 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:50.596718 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-98615acf-2e36-47fe-bd45-6b5008b20233 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:50.597983 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-98615acf-2e36-47fe-bd45-6b5008b20233 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:50.598628 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-98615acf-2e36-47fe-bd45-6b5008b20233 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:50.599402 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-98615acf-2e36-47fe-bd45-6b5008b20233 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:50.990486 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-813f6b40-9114-474d-bb4e-9f73021674f4 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:50.991110 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-813f6b40-9114-474d-bb4e-9f73021674f4 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] [instance: 5b547b31-4774-4c3b-a092-f10d890d57e6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:50.999305 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-813f6b40-9114-474d-bb4e-9f73021674f4 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:50.999805 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-813f6b40-9114-474d-bb4e-9f73021674f4 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:51.000251 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-813f6b40-9114-474d-bb4e-9f73021674f4 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:51.000971 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-813f6b40-9114-474d-bb4e-9f73021674f4 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:51.001465 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-813f6b40-9114-474d-bb4e-9f73021674f4 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:51.005333 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-813f6b40-9114-474d-bb4e-9f73021674f4 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:51.303496 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-813f6b40-9114-474d-bb4e-9f73021674f4 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6618b7ad8ff146dfbd892e3e35c2691f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e29f32d2ac4800b9b767f9e1b16526', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:51.321386 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-813f6b40-9114-474d-bb4e-9f73021674f4 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] 10.222.0.27 "GET /compute/v2.1/servers/5b547b31-4774-4c3b-a092-f10d890d57e6" status: 200 len: 1513 microversion: 2.1 time: 0.334603 Sep 08 11:10:51.322745 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2694/5492] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:50 2022] GET /compute/v2.1/servers/5b547b31-4774-4c3b-a092-f10d890d57e6 => generated 1513 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:10:51.337797 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4051b334-76af-4999-b010-3bae7d1a6b83 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:51.339049 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4051b334-76af-4999-b010-3bae7d1a6b83 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 77f13257-556d-4301-901b-92a99560c5d1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:51.393287 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4051b334-76af-4999-b010-3bae7d1a6b83 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:51.394008 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4051b334-76af-4999-b010-3bae7d1a6b83 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:51.394611 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4051b334-76af-4999-b010-3bae7d1a6b83 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:51.395459 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4051b334-76af-4999-b010-3bae7d1a6b83 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:51.395929 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4051b334-76af-4999-b010-3bae7d1a6b83 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:51.396354 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4051b334-76af-4999-b010-3bae7d1a6b83 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:51.481665 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-98615acf-2e36-47fe-bd45-6b5008b20233 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25641daaa044b1bb0e53d4d2b350f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdc4842f7d54826abd0086ad6654dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:51.498532 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-98615acf-2e36-47fe-bd45-6b5008b20233 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] 10.222.0.27 "GET /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1" status: 200 len: 1508 microversion: 2.1 time: 0.925000 Sep 08 11:10:51.499494 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2799/5493] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:50 2022] GET /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1 => generated 1508 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:10:51.880535 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-4336a1fc-6959-4211-9d2a-f9265138cf3c req-50c211e1-25c7-46f8-9588-ea94d13404e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b547b31-4774-4c3b-a092-f10d890d57e6", "name": "network-vif-deleted", "tag": "8d41fbbc-7908-46e9-9e8d-d5103d2c3dc2"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:10:51.918006 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-4336a1fc-6959-4211-9d2a-f9265138cf3c req-50c211e1-25c7-46f8-9588-ea94d13404e0 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:51.918554 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-4336a1fc-6959-4211-9d2a-f9265138cf3c req-50c211e1-25c7-46f8-9588-ea94d13404e0 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:51.921924 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-4336a1fc-6959-4211-9d2a-f9265138cf3c req-50c211e1-25c7-46f8-9588-ea94d13404e0 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:51.970693 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-4336a1fc-6959-4211-9d2a-f9265138cf3c req-50c211e1-25c7-46f8-9588-ea94d13404e0 service nova] Creating event network-vif-deleted:8d41fbbc-7908-46e9-9e8d-d5103d2c3dc2 for instance 5b547b31-4774-4c3b-a092-f10d890d57e6 on n-h1-850501-12 Sep 08 11:10:51.996906 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-4336a1fc-6959-4211-9d2a-f9265138cf3c req-50c211e1-25c7-46f8-9588-ea94d13404e0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119911 Sep 08 11:10:51.997859 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2800/5494] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:10:52.155176 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4051b334-76af-4999-b010-3bae7d1a6b83 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:52.181606 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4051b334-76af-4999-b010-3bae7d1a6b83 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1" status: 200 len: 1308 microversion: 2.1 time: 0.857220 Sep 08 11:10:52.190756 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2695/5495] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:51 2022] GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1 => generated 1308 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:10:52.353971 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-24f8b2c5-b438-4b9c-afe3-56aed8890303 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:52.354963 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-24f8b2c5-b438-4b9c-afe3-56aed8890303 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] [instance: 5b547b31-4774-4c3b-a092-f10d890d57e6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:52.364355 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24f8b2c5-b438-4b9c-afe3-56aed8890303 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:52.365155 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24f8b2c5-b438-4b9c-afe3-56aed8890303 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:52.365827 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24f8b2c5-b438-4b9c-afe3-56aed8890303 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:52.366793 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24f8b2c5-b438-4b9c-afe3-56aed8890303 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:52.372320 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24f8b2c5-b438-4b9c-afe3-56aed8890303 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:52.373247 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24f8b2c5-b438-4b9c-afe3-56aed8890303 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:52.498112 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24f8b2c5-b438-4b9c-afe3-56aed8890303 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:52.510376 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24f8b2c5-b438-4b9c-afe3-56aed8890303 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:52.515463 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24f8b2c5-b438-4b9c-afe3-56aed8890303 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:52.516149 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-24f8b2c5-b438-4b9c-afe3-56aed8890303 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lazy-loading 'fault' on Instance uuid 5b547b31-4774-4c3b-a092-f10d890d57e6 {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:10:52.531656 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-71718613-f40a-4cdb-a561-d70a38477e77 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:52.532880 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-71718613-f40a-4cdb-a561-d70a38477e77 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] [instance: 41f1a22f-64b4-4564-94a9-99fc6740e0a1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:52.544285 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71718613-f40a-4cdb-a561-d70a38477e77 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:52.544961 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71718613-f40a-4cdb-a561-d70a38477e77 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:52.545652 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71718613-f40a-4cdb-a561-d70a38477e77 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:52.549708 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71718613-f40a-4cdb-a561-d70a38477e77 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:52.550483 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71718613-f40a-4cdb-a561-d70a38477e77 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:52.551417 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71718613-f40a-4cdb-a561-d70a38477e77 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:52.698598 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-24f8b2c5-b438-4b9c-afe3-56aed8890303 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6618b7ad8ff146dfbd892e3e35c2691f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e29f32d2ac4800b9b767f9e1b16526', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:52.712693 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-24f8b2c5-b438-4b9c-afe3-56aed8890303 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] 10.222.0.27 "GET /compute/v2.1/servers/5b547b31-4774-4c3b-a092-f10d890d57e6" status: 200 len: 1308 microversion: 2.1 time: 0.361269 Sep 08 11:10:52.732633 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2801/5496] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:52 2022] GET /compute/v2.1/servers/5b547b31-4774-4c3b-a092-f10d890d57e6 => generated 1308 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:10:52.780027 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-7e1604cf-1427-4f6d-a94c-e84d7d5af23d req-a80f7e5e-f30c-42bc-ba6e-cf6af4e34aee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77f13257-556d-4301-901b-92a99560c5d1", "name": "network-vif-plugged", "status": "completed", "tag": "0825e9e2-7ab2-4ee2-9782-aab8c75eada0"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:10:52.814060 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-7e1604cf-1427-4f6d-a94c-e84d7d5af23d req-a80f7e5e-f30c-42bc-ba6e-cf6af4e34aee service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:52.814546 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-7e1604cf-1427-4f6d-a94c-e84d7d5af23d req-a80f7e5e-f30c-42bc-ba6e-cf6af4e34aee service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:52.814980 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-7e1604cf-1427-4f6d-a94c-e84d7d5af23d req-a80f7e5e-f30c-42bc-ba6e-cf6af4e34aee service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:52.862695 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-7e1604cf-1427-4f6d-a94c-e84d7d5af23d req-a80f7e5e-f30c-42bc-ba6e-cf6af4e34aee service nova] Creating event network-vif-plugged:0825e9e2-7ab2-4ee2-9782-aab8c75eada0 for instance 77f13257-556d-4301-901b-92a99560c5d1 on n-h1-850501-12 Sep 08 11:10:52.872756 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-7e1604cf-1427-4f6d-a94c-e84d7d5af23d req-a80f7e5e-f30c-42bc-ba6e-cf6af4e34aee service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122853 Sep 08 11:10:52.875681 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2802/5497] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:10:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:10:53.126968 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-71718613-f40a-4cdb-a561-d70a38477e77 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25641daaa044b1bb0e53d4d2b350f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdc4842f7d54826abd0086ad6654dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:53.145705 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-71718613-f40a-4cdb-a561-d70a38477e77 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] 10.222.0.27 "GET /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1" status: 200 len: 1508 microversion: 2.1 time: 0.618060 Sep 08 11:10:53.147373 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2696/5498] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:52 2022] GET /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1 => generated 1508 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:10:53.223662 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1c118597-8bd2-4097-b8b4-b587dcd1552a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:53.224930 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1c118597-8bd2-4097-b8b4-b587dcd1552a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 77f13257-556d-4301-901b-92a99560c5d1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:53.245311 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1c118597-8bd2-4097-b8b4-b587dcd1552a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:53.245828 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1c118597-8bd2-4097-b8b4-b587dcd1552a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:53.246273 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1c118597-8bd2-4097-b8b4-b587dcd1552a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:53.247007 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1c118597-8bd2-4097-b8b4-b587dcd1552a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:53.248334 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1c118597-8bd2-4097-b8b4-b587dcd1552a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:53.248772 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1c118597-8bd2-4097-b8b4-b587dcd1552a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:53.302294 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-fd5be4e5-d002-4ab4-b156-6a2a4cc0ecf9 req-aa5eedc1-8665-440b-b20c-075499592e48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41f1a22f-64b4-4564-94a9-99fc6740e0a1", "name": "network-vif-deleted", "tag": "62403e83-a296-4c79-be79-7a813046d1fe"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:10:53.316594 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-fd5be4e5-d002-4ab4-b156-6a2a4cc0ecf9 req-aa5eedc1-8665-440b-b20c-075499592e48 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:53.316594 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-fd5be4e5-d002-4ab4-b156-6a2a4cc0ecf9 req-aa5eedc1-8665-440b-b20c-075499592e48 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:53.317141 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-fd5be4e5-d002-4ab4-b156-6a2a4cc0ecf9 req-aa5eedc1-8665-440b-b20c-075499592e48 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:53.334122 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-fd5be4e5-d002-4ab4-b156-6a2a4cc0ecf9 req-aa5eedc1-8665-440b-b20c-075499592e48 service nova] Creating event network-vif-deleted:62403e83-a296-4c79-be79-7a813046d1fe for instance 41f1a22f-64b4-4564-94a9-99fc6740e0a1 on n-h2-850501-12 Sep 08 11:10:53.349112 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-fd5be4e5-d002-4ab4-b156-6a2a4cc0ecf9 req-aa5eedc1-8665-440b-b20c-075499592e48 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049204 Sep 08 11:10:53.372480 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2697/5499] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:10:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:10:53.557944 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1c118597-8bd2-4097-b8b4-b587dcd1552a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:53.570615 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1c118597-8bd2-4097-b8b4-b587dcd1552a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1" status: 200 len: 1308 microversion: 2.1 time: 0.354516 Sep 08 11:10:53.578450 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2803/5500] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:53 2022] GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1 => generated 1308 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:10:53.771929 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e3f1b7cd-3bd2-4852-a1f9-2d2e9ea8d192 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:53.773447 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e3f1b7cd-3bd2-4852-a1f9-2d2e9ea8d192 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] [instance: 5b547b31-4774-4c3b-a092-f10d890d57e6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:53.792449 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e3f1b7cd-3bd2-4852-a1f9-2d2e9ea8d192 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:53.793323 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e3f1b7cd-3bd2-4852-a1f9-2d2e9ea8d192 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:53.793979 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e3f1b7cd-3bd2-4852-a1f9-2d2e9ea8d192 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:53.797531 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e3f1b7cd-3bd2-4852-a1f9-2d2e9ea8d192 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:53.799053 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e3f1b7cd-3bd2-4852-a1f9-2d2e9ea8d192 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:53.800744 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e3f1b7cd-3bd2-4852-a1f9-2d2e9ea8d192 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:53.835169 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-e3f1b7cd-3bd2-4852-a1f9-2d2e9ea8d192 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] HTTP exception thrown: Instance 5b547b31-4774-4c3b-a092-f10d890d57e6 could not be found. Sep 08 11:10:53.837770 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e3f1b7cd-3bd2-4852-a1f9-2d2e9ea8d192 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Request method failure captured: Sep 08 11:10:53.837770 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/5b547b31-4774-4c3b-a092-f10d890d57e6 HTTP/1.1 Sep 08 11:10:53.837770 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 11:10:53.837770 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 11:10:53.837770 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 11:10:53.837770 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 11:10:53.837770 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 11:10:53.837770 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 11:10:53.837770 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 11:10:53.837770 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 11:10:53.837770 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGcy9QTB2spPthSFjI01L3fCIson4XPccYNNPT18YeqGd1v8fPtbA6oAjf0wb8c0xu1fksk59wERCofZeTIKCjZAQVMeBkdJ_pGxEszC7KUVHUYYRcD8MlDxLgzNFcXNssiCwtpbKKh_y30ZFrV0QpPEarSEYh_FGN1Rmozwl-Mp-Xkk Sep 08 11:10:53.837770 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 11:10:53.837770 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 11:10:53.837770 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 11:10:53.837770 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 11:10:53.837770 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 11:10:53.837770 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 11:10:53.837770 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 24e29f32d2ac4800b9b767f9e1b16526 Sep 08 11:10:53.837770 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1411644645 Sep 08 11:10:53.837770 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 11:10:53.837770 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 11:10:53.837770 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/24e29f32d2ac4800b9b767f9e1b16526"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/24e29f32d2ac4800b9b767f9e1b16526"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_24e29f32d2ac4800b9b767f9e1b16526"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/24e29f32d2ac4800b9b767f9e1b16526"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:10:53.837770 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-VolumesSnapshotTestJSON-1411644645 Sep 08 11:10:53.837770 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 24e29f32d2ac4800b9b767f9e1b16526 Sep 08 11:10:53.837770 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1411644645 Sep 08 11:10:53.837770 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-VolumesSnapshotTestJSON-1411644645-project Sep 08 11:10:53.837770 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 11:10:53.837770 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 11:10:53.837770 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 6618b7ad8ff146dfbd892e3e35c2691f Sep 08 11:10:53.837770 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-VolumesSnapshotTestJSON-1411644645-project Sep 08 11:10:53.837770 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 11:10:53.837770 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 5b547b31-4774-4c3b-a092-f10d890d57e6 could not be found. Sep 08 11:10:53.837770 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '5b547b31-4774-4c3b-a092-f10d890d57e6'} Sep 08 11:10:53.837770 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:10:53.837770 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:10:53.837770 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:10:53.837770 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:10:53.837770 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:10:53.837770 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:10:53.837770 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:10:53.837770 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:10:53.837770 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:10:53.837770 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:10:53.837770 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b547b31-4774-4c3b-a092-f10d890d57e6 could not be found. Sep 08 11:10:53.837770 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:10:53.837770 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:10:53.837770 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:10:53.837770 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:10:53.837770 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:10:53.837770 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:10:53.837770 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:10:53.837770 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:10:53.837770 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:10:53.837770 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:10:53.837770 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:10:53.837770 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:10:53.837770 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:10:53.837770 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:10:53.837770 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:10:53.837770 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:10:53.837770 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b547b31-4774-4c3b-a092-f10d890d57e6 could not be found. Sep 08 11:10:53.837770 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:10:53.837770 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:10:53.837770 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:10:53.842721 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:10:53.842721 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:10:53.842721 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:10:53.842721 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:10:53.842721 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:10:53.842721 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b547b31-4774-4c3b-a092-f10d890d57e6 could not be found. Sep 08 11:10:53.842721 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:10:53.842721 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e3f1b7cd-3bd2-4852-a1f9-2d2e9ea8d192 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Returning 404 to user: Instance 5b547b31-4774-4c3b-a092-f10d890d57e6 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:10:53.842721 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e3f1b7cd-3bd2-4852-a1f9-2d2e9ea8d192 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] 10.222.0.27 "GET /compute/v2.1/servers/5b547b31-4774-4c3b-a092-f10d890d57e6" status: 404 len: 111 microversion: 2.1 time: 0.078962 Sep 08 11:10:53.844080 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2698/5501] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:53 2022] GET /compute/v2.1/servers/5b547b31-4774-4c3b-a092-f10d890d57e6 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 11:10:54.184976 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-adb00fcb-42f8-4791-b5e2-f9790f87460d tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:54.185641 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-adb00fcb-42f8-4791-b5e2-f9790f87460d tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] [instance: 41f1a22f-64b4-4564-94a9-99fc6740e0a1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:54.199823 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-adb00fcb-42f8-4791-b5e2-f9790f87460d tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:54.200724 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-adb00fcb-42f8-4791-b5e2-f9790f87460d tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:54.201211 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-adb00fcb-42f8-4791-b5e2-f9790f87460d tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:54.201943 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-adb00fcb-42f8-4791-b5e2-f9790f87460d tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:54.202502 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-adb00fcb-42f8-4791-b5e2-f9790f87460d tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:54.203049 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-adb00fcb-42f8-4791-b5e2-f9790f87460d tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:54.241114 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-adb00fcb-42f8-4791-b5e2-f9790f87460d tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:54.242512 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-adb00fcb-42f8-4791-b5e2-f9790f87460d tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:54.244109 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-adb00fcb-42f8-4791-b5e2-f9790f87460d tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:54.255094 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-adb00fcb-42f8-4791-b5e2-f9790f87460d tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lazy-loading 'fault' on Instance uuid 41f1a22f-64b4-4564-94a9-99fc6740e0a1 {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:10:54.344178 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-adb00fcb-42f8-4791-b5e2-f9790f87460d tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25641daaa044b1bb0e53d4d2b350f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdc4842f7d54826abd0086ad6654dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:54.347876 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:10:54.354613 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-adb00fcb-42f8-4791-b5e2-f9790f87460d tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] 10.222.0.27 "GET /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1" status: 200 len: 1310 microversion: 2.1 time: 0.174868 Sep 08 11:10:54.355217 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2804/5502] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:54 2022] GET /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1 => generated 1310 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:10:54.604830 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0e0cb53e-52db-4adf-b386-f6617a11f41e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:54.606512 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0e0cb53e-52db-4adf-b386-f6617a11f41e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 77f13257-556d-4301-901b-92a99560c5d1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:54.630613 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e0cb53e-52db-4adf-b386-f6617a11f41e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:54.631437 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e0cb53e-52db-4adf-b386-f6617a11f41e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:54.631895 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e0cb53e-52db-4adf-b386-f6617a11f41e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:54.632593 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e0cb53e-52db-4adf-b386-f6617a11f41e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:54.637317 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e0cb53e-52db-4adf-b386-f6617a11f41e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:54.637830 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e0cb53e-52db-4adf-b386-f6617a11f41e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:54.937771 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0e0cb53e-52db-4adf-b386-f6617a11f41e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:54.947271 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0e0cb53e-52db-4adf-b386-f6617a11f41e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1" status: 200 len: 1489 microversion: 2.1 time: 0.347361 Sep 08 11:10:54.948449 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2699/5503] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:54 2022] GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1 => generated 1489 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:10:54.980476 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ae6916d7-d35b-41fb-9392-5b8515066390 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-2054433759"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:10:54.983330 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ae6916d7-d35b-41fb-9392-5b8515066390 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 77f13257-556d-4301-901b-92a99560c5d1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:54.999304 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ae6916d7-d35b-41fb-9392-5b8515066390 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:54.999994 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ae6916d7-d35b-41fb-9392-5b8515066390 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:55.000446 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ae6916d7-d35b-41fb-9392-5b8515066390 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:55.002252 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ae6916d7-d35b-41fb-9392-5b8515066390 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:55.002886 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ae6916d7-d35b-41fb-9392-5b8515066390 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:55.003482 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ae6916d7-d35b-41fb-9392-5b8515066390 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:55.111057 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ae6916d7-d35b-41fb-9392-5b8515066390 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "PUT /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1" status: 200 len: 1075 microversion: 2.1 time: 0.136449 Sep 08 11:10:55.112340 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2805/5504] 10.222.0.27 () {60 vars in 1256 bytes} [Thu Sep 8 11:10:54 2022] PUT /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1 => generated 1075 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:10:55.138550 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-84fb2a75-e0dd-4eaa-8918-4558d1a4c5e0 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:55.139981 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-84fb2a75-e0dd-4eaa-8918-4558d1a4c5e0 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 77f13257-556d-4301-901b-92a99560c5d1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:55.147056 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-84fb2a75-e0dd-4eaa-8918-4558d1a4c5e0 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:55.148003 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-84fb2a75-e0dd-4eaa-8918-4558d1a4c5e0 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:55.151404 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-84fb2a75-e0dd-4eaa-8918-4558d1a4c5e0 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:55.152685 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-84fb2a75-e0dd-4eaa-8918-4558d1a4c5e0 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:55.153428 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-84fb2a75-e0dd-4eaa-8918-4558d1a4c5e0 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:55.154198 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-84fb2a75-e0dd-4eaa-8918-4558d1a4c5e0 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:55.379809 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5d5f138a-63ad-458a-afbf-c3648f85a036 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:55.381018 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5d5f138a-63ad-458a-afbf-c3648f85a036 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] [instance: 41f1a22f-64b4-4564-94a9-99fc6740e0a1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:55.398013 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-84fb2a75-e0dd-4eaa-8918-4558d1a4c5e0 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:55.405622 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5d5f138a-63ad-458a-afbf-c3648f85a036 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:55.406147 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5d5f138a-63ad-458a-afbf-c3648f85a036 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:55.406593 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5d5f138a-63ad-458a-afbf-c3648f85a036 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:55.407443 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5d5f138a-63ad-458a-afbf-c3648f85a036 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:55.407917 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5d5f138a-63ad-458a-afbf-c3648f85a036 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:55.408354 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5d5f138a-63ad-458a-afbf-c3648f85a036 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:55.416629 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-84fb2a75-e0dd-4eaa-8918-4558d1a4c5e0 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1" status: 200 len: 1501 microversion: 2.1 time: 0.289374 Sep 08 11:10:55.417855 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2700/5505] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:55 2022] GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1 => generated 1501 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:10:55.429072 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-5d5f138a-63ad-458a-afbf-c3648f85a036 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] HTTP exception thrown: Instance 41f1a22f-64b4-4564-94a9-99fc6740e0a1 could not be found. Sep 08 11:10:55.431701 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5d5f138a-63ad-458a-afbf-c3648f85a036 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Request method failure captured: Sep 08 11:10:55.431701 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1 HTTP/1.1 Sep 08 11:10:55.431701 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:10:55.431701 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:10:55.431701 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:10:55.431701 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 11:10:55.431701 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:10:55.431701 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:10:55.431701 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:10:55.431701 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:10:55.431701 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGc1aHlwGhU8LZIQmKBuE6eeXSngr6Z267KpX_kaohp7mjZXUWkwTIOEJc7IcetM5buskMfkACDEQeLXkIV3NDasD_CsyFP8jtuQ5HJiLnA8mB4WZhXAfHJKvMBeYBPZ3yPr-Mj6-xyjq-pijU7Pix34rM0Ia2lrdUKnoM5hw7oC7Oa0 Sep 08 11:10:55.431701 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:10:55.431701 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:10:55.431701 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:10:55.431701 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:10:55.431701 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:10:55.431701 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:10:55.431701 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 6cdc4842f7d54826abd0086ad6654dbd Sep 08 11:10:55.431701 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-243527359 Sep 08 11:10:55.431701 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:10:55.431701 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:10:55.431701 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6cdc4842f7d54826abd0086ad6654dbd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6cdc4842f7d54826abd0086ad6654dbd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6cdc4842f7d54826abd0086ad6654dbd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6cdc4842f7d54826abd0086ad6654dbd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:10:55.431701 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-243527359 Sep 08 11:10:55.431701 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 6cdc4842f7d54826abd0086ad6654dbd Sep 08 11:10:55.431701 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-243527359 Sep 08 11:10:55.431701 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServerRescueTestJSONUnderV235-243527359-project Sep 08 11:10:55.431701 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:10:55.431701 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:10:55.431701 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: e25641daaa044b1bb0e53d4d2b350f15 Sep 08 11:10:55.431701 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-243527359-project Sep 08 11:10:55.431701 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 11:10:55.431701 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 41f1a22f-64b4-4564-94a9-99fc6740e0a1 could not be found. Sep 08 11:10:55.431701 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '41f1a22f-64b4-4564-94a9-99fc6740e0a1'} Sep 08 11:10:55.431701 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:10:55.431701 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:10:55.431701 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:10:55.431701 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:10:55.431701 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:10:55.431701 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:10:55.431701 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:10:55.431701 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:10:55.431701 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:10:55.431701 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:10:55.431701 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41f1a22f-64b4-4564-94a9-99fc6740e0a1 could not be found. Sep 08 11:10:55.431701 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:10:55.431701 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:10:55.431701 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:10:55.431701 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:10:55.431701 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:10:55.431701 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:10:55.431701 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:10:55.431701 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:10:55.431701 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:10:55.431701 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:10:55.431701 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:10:55.431701 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:10:55.431701 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:10:55.431701 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:10:55.431701 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:10:55.431701 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:10:55.431701 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41f1a22f-64b4-4564-94a9-99fc6740e0a1 could not be found. Sep 08 11:10:55.431701 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:10:55.431701 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:10:55.436214 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:10:55.436214 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:10:55.436214 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:10:55.436214 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:10:55.436214 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:10:55.436214 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:10:55.436214 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41f1a22f-64b4-4564-94a9-99fc6740e0a1 could not be found. Sep 08 11:10:55.436214 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:10:55.439379 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5d5f138a-63ad-458a-afbf-c3648f85a036 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] Returning 404 to user: Instance 41f1a22f-64b4-4564-94a9-99fc6740e0a1 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:10:55.440415 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e6abaac6-49e5-49c9-b366-927279dec769 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:55.440569 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5d5f138a-63ad-458a-afbf-c3648f85a036 tempest-ServerRescueTestJSONUnderV235-243527359 tempest-ServerRescueTestJSONUnderV235-243527359-project] 10.222.0.27 "GET /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1" status: 404 len: 111 microversion: 2.1 time: 0.064580 Sep 08 11:10:55.441055 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e6abaac6-49e5-49c9-b366-927279dec769 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 77f13257-556d-4301-901b-92a99560c5d1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:55.445526 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2806/5506] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:55 2022] GET /compute/v2.1/servers/41f1a22f-64b4-4564-94a9-99fc6740e0a1 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 11:10:55.448583 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e6abaac6-49e5-49c9-b366-927279dec769 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:55.449122 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e6abaac6-49e5-49c9-b366-927279dec769 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:55.449870 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e6abaac6-49e5-49c9-b366-927279dec769 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:55.450602 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e6abaac6-49e5-49c9-b366-927279dec769 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:55.451062 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e6abaac6-49e5-49c9-b366-927279dec769 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:55.451676 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e6abaac6-49e5-49c9-b366-927279dec769 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:56.075113 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e6abaac6-49e5-49c9-b366-927279dec769 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:56.092695 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e6abaac6-49e5-49c9-b366-927279dec769 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1" status: 200 len: 1501 microversion: 2.1 time: 0.647638 Sep 08 11:10:56.092695 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2701/5507] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:55 2022] GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1 => generated 1501 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:10:56.115419 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2f59d9e0-5f73-4e16-904d-279744d72805 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:10:56.128681 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2f59d9e0-5f73-4e16-904d-279744d72805 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:56.129105 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2f59d9e0-5f73-4e16-904d-279744d72805 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:56.129715 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2f59d9e0-5f73-4e16-904d-279744d72805 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:56.187959 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2f59d9e0-5f73-4e16-904d-279744d72805 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 77f13257-556d-4301-901b-92a99560c5d1] Going to try to stop instance {{(pid=128861) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 08 11:10:56.388663 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2f59d9e0-5f73-4e16-904d-279744d72805 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "POST /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1/action" status: 202 len: 0 microversion: 2.1 time: 0.280053 Sep 08 11:10:56.401507 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2807/5508] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 11:10:56 2022] POST /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1/action => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:10:56.410989 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2d64f7ad-aa67-4e8d-b7dd-968dab6598ff tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:56.411624 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2d64f7ad-aa67-4e8d-b7dd-968dab6598ff tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 77f13257-556d-4301-901b-92a99560c5d1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:56.430108 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2d64f7ad-aa67-4e8d-b7dd-968dab6598ff tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:56.431288 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2d64f7ad-aa67-4e8d-b7dd-968dab6598ff tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:56.432185 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2d64f7ad-aa67-4e8d-b7dd-968dab6598ff tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:56.433377 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2d64f7ad-aa67-4e8d-b7dd-968dab6598ff tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:56.434178 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2d64f7ad-aa67-4e8d-b7dd-968dab6598ff tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:56.434780 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2d64f7ad-aa67-4e8d-b7dd-968dab6598ff tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:56.747634 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2d64f7ad-aa67-4e8d-b7dd-968dab6598ff tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:56.764493 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2d64f7ad-aa67-4e8d-b7dd-968dab6598ff tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1" status: 200 len: 1511 microversion: 2.1 time: 0.357939 Sep 08 11:10:56.768994 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2702/5509] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:56 2022] GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1 => generated 1511 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:10:57.790494 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-dd142336-808f-4aa9-879f-2cac871f0585 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:57.791193 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-dd142336-808f-4aa9-879f-2cac871f0585 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 77f13257-556d-4301-901b-92a99560c5d1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:57.805681 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd142336-808f-4aa9-879f-2cac871f0585 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:57.806173 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd142336-808f-4aa9-879f-2cac871f0585 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:57.806611 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd142336-808f-4aa9-879f-2cac871f0585 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:57.807392 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd142336-808f-4aa9-879f-2cac871f0585 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:57.807767 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd142336-808f-4aa9-879f-2cac871f0585 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:57.808192 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd142336-808f-4aa9-879f-2cac871f0585 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:58.076719 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-dd142336-808f-4aa9-879f-2cac871f0585 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:58.091102 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-dd142336-808f-4aa9-879f-2cac871f0585 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1" status: 200 len: 1511 microversion: 2.1 time: 0.305138 Sep 08 11:10:58.092731 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2808/5510] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:57 2022] GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1 => generated 1511 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:10:59.116807 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7161c711-5f1c-40a2-8614-d9134066adc5 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:59.118013 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7161c711-5f1c-40a2-8614-d9134066adc5 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 77f13257-556d-4301-901b-92a99560c5d1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:59.147082 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7161c711-5f1c-40a2-8614-d9134066adc5 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:59.147604 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7161c711-5f1c-40a2-8614-d9134066adc5 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:59.148052 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7161c711-5f1c-40a2-8614-d9134066adc5 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:59.154794 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7161c711-5f1c-40a2-8614-d9134066adc5 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:59.155303 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7161c711-5f1c-40a2-8614-d9134066adc5 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:59.155751 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7161c711-5f1c-40a2-8614-d9134066adc5 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:00.302640 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7161c711-5f1c-40a2-8614-d9134066adc5 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:00.325196 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7161c711-5f1c-40a2-8614-d9134066adc5 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1" status: 200 len: 1511 microversion: 2.1 time: 1.212236 Sep 08 11:11:00.326429 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2703/5511] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:59 2022] GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1 => generated 1511 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:11:01.380699 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5aff68c0-7b3a-4806-b0d5-13c8ca675515 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:01.382224 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5aff68c0-7b3a-4806-b0d5-13c8ca675515 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 77f13257-556d-4301-901b-92a99560c5d1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:01.428187 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:11:01.449565 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5aff68c0-7b3a-4806-b0d5-13c8ca675515 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:01.452371 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5aff68c0-7b3a-4806-b0d5-13c8ca675515 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:01.453894 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5aff68c0-7b3a-4806-b0d5-13c8ca675515 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:01.455483 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5aff68c0-7b3a-4806-b0d5-13c8ca675515 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:01.456873 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5aff68c0-7b3a-4806-b0d5-13c8ca675515 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:01.459564 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5aff68c0-7b3a-4806-b0d5-13c8ca675515 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:01.806629 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5aff68c0-7b3a-4806-b0d5-13c8ca675515 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:01.836612 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5aff68c0-7b3a-4806-b0d5-13c8ca675515 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1" status: 200 len: 1511 microversion: 2.1 time: 0.487736 Sep 08 11:11:01.838209 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2809/5512] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:01 2022] GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1 => generated 1511 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:11:02.881561 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-84671e7e-9cbb-4740-8476-ec5332862a4b tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:02.882533 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-84671e7e-9cbb-4740-8476-ec5332862a4b tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 77f13257-556d-4301-901b-92a99560c5d1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:02.964390 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-84671e7e-9cbb-4740-8476-ec5332862a4b tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:02.966176 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-84671e7e-9cbb-4740-8476-ec5332862a4b tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:02.969619 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-84671e7e-9cbb-4740-8476-ec5332862a4b tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:02.973385 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-84671e7e-9cbb-4740-8476-ec5332862a4b tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:02.974598 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-84671e7e-9cbb-4740-8476-ec5332862a4b tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:02.977296 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-84671e7e-9cbb-4740-8476-ec5332862a4b tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:03.440751 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-84671e7e-9cbb-4740-8476-ec5332862a4b tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:03.502504 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-84671e7e-9cbb-4740-8476-ec5332862a4b tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1" status: 200 len: 1511 microversion: 2.1 time: 0.626431 Sep 08 11:11:03.503663 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2704/5513] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:02 2022] GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1 => generated 1511 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:11:04.529856 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a1181fe6-2363-4d2f-952d-122d541e03bd tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:04.530674 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a1181fe6-2363-4d2f-952d-122d541e03bd tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 77f13257-556d-4301-901b-92a99560c5d1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:04.542686 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a1181fe6-2363-4d2f-952d-122d541e03bd tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:04.543189 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a1181fe6-2363-4d2f-952d-122d541e03bd tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:04.549097 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a1181fe6-2363-4d2f-952d-122d541e03bd tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:04.549881 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a1181fe6-2363-4d2f-952d-122d541e03bd tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:04.551335 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a1181fe6-2363-4d2f-952d-122d541e03bd tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:04.551781 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a1181fe6-2363-4d2f-952d-122d541e03bd tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:04.745213 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a1181fe6-2363-4d2f-952d-122d541e03bd tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:04.759592 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a1181fe6-2363-4d2f-952d-122d541e03bd tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1" status: 200 len: 1511 microversion: 2.1 time: 0.234689 Sep 08 11:11:04.779811 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2810/5514] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:04 2022] GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1 => generated 1511 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:11:04.884543 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-42a277b6-7e41-4eff-b317-9b09c48977fb tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-338359267", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "df77a721-ec3c-4dd0-9135-5ab61b9c07d1"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:11:04.979196 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-42a277b6-7e41-4eff-b317-9b09c48977fb tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] validate_networks() for [('df77a721-ec3c-4dd0-9135-5ab61b9c07d1', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:11:05.614051 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-42a277b6-7e41-4eff-b317-9b09c48977fb tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:11:05.614908 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-42a277b6-7e41-4eff-b317-9b09c48977fb tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:11:05.615682 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-42a277b6-7e41-4eff-b317-9b09c48977fb tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:11:05.616440 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-42a277b6-7e41-4eff-b317-9b09c48977fb tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:11:05.618065 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-42a277b6-7e41-4eff-b317-9b09c48977fb tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:11:05.635797 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42a277b6-7e41-4eff-b317-9b09c48977fb tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:05.636715 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42a277b6-7e41-4eff-b317-9b09c48977fb tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:05.637362 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42a277b6-7e41-4eff-b317-9b09c48977fb tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:05.638147 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42a277b6-7e41-4eff-b317-9b09c48977fb tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:05.638817 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42a277b6-7e41-4eff-b317-9b09c48977fb tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:05.639438 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42a277b6-7e41-4eff-b317-9b09c48977fb tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:05.663241 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-42a277b6-7e41-4eff-b317-9b09c48977fb tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Getting quotas for project 24e29f32d2ac4800b9b767f9e1b16526. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:11:05.676299 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-42a277b6-7e41-4eff-b317-9b09c48977fb tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Getting quotas for user 6618b7ad8ff146dfbd892e3e35c2691f and project 24e29f32d2ac4800b9b767f9e1b16526. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:11:05.692572 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-42a277b6-7e41-4eff-b317-9b09c48977fb tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:11:05.695118 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-42a277b6-7e41-4eff-b317-9b09c48977fb tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] [instance: c4230fe2-77ab-4b37-a368-da0b8eabd595] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:11:05.787821 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-712f4a2a-c0e7-41f8-a014-1057145d766c tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:05.788446 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-712f4a2a-c0e7-41f8-a014-1057145d766c tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 77f13257-556d-4301-901b-92a99560c5d1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:05.799495 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-42a277b6-7e41-4eff-b317-9b09c48977fb tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.914774 Sep 08 11:11:05.801877 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2705/5515] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 11:11:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 923 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:11:05.808645 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-712f4a2a-c0e7-41f8-a014-1057145d766c tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:05.809194 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-712f4a2a-c0e7-41f8-a014-1057145d766c tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:05.809644 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-712f4a2a-c0e7-41f8-a014-1057145d766c tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:05.810376 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-712f4a2a-c0e7-41f8-a014-1057145d766c tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:05.810851 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-712f4a2a-c0e7-41f8-a014-1057145d766c tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:05.811288 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-712f4a2a-c0e7-41f8-a014-1057145d766c tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:05.815958 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fb13a3a8-3edd-4c9e-b1bb-044cb2d07b53 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:05.817155 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fb13a3a8-3edd-4c9e-b1bb-044cb2d07b53 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] [instance: c4230fe2-77ab-4b37-a368-da0b8eabd595] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:05.938373 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fb13a3a8-3edd-4c9e-b1bb-044cb2d07b53 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6618b7ad8ff146dfbd892e3e35c2691f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e29f32d2ac4800b9b767f9e1b16526', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:05.954089 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fb13a3a8-3edd-4c9e-b1bb-044cb2d07b53 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] 10.222.0.27 "GET /compute/v2.1/servers/c4230fe2-77ab-4b37-a368-da0b8eabd595" status: 200 len: 1218 microversion: 2.1 time: 0.143230 Sep 08 11:11:05.954995 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2706/5516] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:05 2022] GET /compute/v2.1/servers/c4230fe2-77ab-4b37-a368-da0b8eabd595 => generated 1218 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:11:06.113361 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-712f4a2a-c0e7-41f8-a014-1057145d766c tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:06.122469 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-712f4a2a-c0e7-41f8-a014-1057145d766c tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1" status: 200 len: 1511 microversion: 2.1 time: 0.339517 Sep 08 11:11:06.123579 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2811/5517] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:05 2022] GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1 => generated 1511 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:11:06.980969 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-289cecbb-0e14-4390-bd0f-3315af68aa4e tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:06.982548 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-289cecbb-0e14-4390-bd0f-3315af68aa4e tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] [instance: c4230fe2-77ab-4b37-a368-da0b8eabd595] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:06.995613 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-289cecbb-0e14-4390-bd0f-3315af68aa4e tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:06.997548 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-289cecbb-0e14-4390-bd0f-3315af68aa4e tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:07.004771 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-289cecbb-0e14-4390-bd0f-3315af68aa4e tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:07.005688 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-289cecbb-0e14-4390-bd0f-3315af68aa4e tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:07.006408 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-289cecbb-0e14-4390-bd0f-3315af68aa4e tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:07.007040 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-289cecbb-0e14-4390-bd0f-3315af68aa4e tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:07.145854 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-289cecbb-0e14-4390-bd0f-3315af68aa4e tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6618b7ad8ff146dfbd892e3e35c2691f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e29f32d2ac4800b9b767f9e1b16526', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:07.147811 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d834e1e4-de2c-4d4e-8150-7a1d7db281ba tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:07.149257 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d834e1e4-de2c-4d4e-8150-7a1d7db281ba tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 77f13257-556d-4301-901b-92a99560c5d1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:07.157790 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:11:07.166509 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d834e1e4-de2c-4d4e-8150-7a1d7db281ba tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:07.167025 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d834e1e4-de2c-4d4e-8150-7a1d7db281ba tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:07.167755 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d834e1e4-de2c-4d4e-8150-7a1d7db281ba tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:07.169468 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d834e1e4-de2c-4d4e-8150-7a1d7db281ba tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:07.169950 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d834e1e4-de2c-4d4e-8150-7a1d7db281ba tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:07.171617 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d834e1e4-de2c-4d4e-8150-7a1d7db281ba tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:07.177390 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-289cecbb-0e14-4390-bd0f-3315af68aa4e tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] 10.222.0.27 "GET /compute/v2.1/servers/c4230fe2-77ab-4b37-a368-da0b8eabd595" status: 200 len: 1270 microversion: 2.1 time: 0.200831 Sep 08 11:11:07.188765 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2707/5518] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:06 2022] GET /compute/v2.1/servers/c4230fe2-77ab-4b37-a368-da0b8eabd595 => generated 1270 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:11:07.420310 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d834e1e4-de2c-4d4e-8150-7a1d7db281ba tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:07.452144 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d834e1e4-de2c-4d4e-8150-7a1d7db281ba tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1" status: 200 len: 1511 microversion: 2.1 time: 0.306124 Sep 08 11:11:07.472992 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2812/5519] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:07 2022] GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1 => generated 1511 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:11:08.204867 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-31cebe35-c479-460a-97ef-aae561bd2dd7 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:08.206007 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-31cebe35-c479-460a-97ef-aae561bd2dd7 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] [instance: c4230fe2-77ab-4b37-a368-da0b8eabd595] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:08.219487 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-31cebe35-c479-460a-97ef-aae561bd2dd7 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:08.220000 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-31cebe35-c479-460a-97ef-aae561bd2dd7 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:08.220528 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-31cebe35-c479-460a-97ef-aae561bd2dd7 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:08.221222 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-31cebe35-c479-460a-97ef-aae561bd2dd7 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:08.225949 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-31cebe35-c479-460a-97ef-aae561bd2dd7 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:08.227946 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-31cebe35-c479-460a-97ef-aae561bd2dd7 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:08.335067 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-31cebe35-c479-460a-97ef-aae561bd2dd7 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6618b7ad8ff146dfbd892e3e35c2691f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e29f32d2ac4800b9b767f9e1b16526', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:08.353327 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-31cebe35-c479-460a-97ef-aae561bd2dd7 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] 10.222.0.27 "GET /compute/v2.1/servers/c4230fe2-77ab-4b37-a368-da0b8eabd595" status: 200 len: 1276 microversion: 2.1 time: 0.153196 Sep 08 11:11:08.370447 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2708/5520] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:08 2022] GET /compute/v2.1/servers/c4230fe2-77ab-4b37-a368-da0b8eabd595 => generated 1276 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:11:08.479621 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2f47480c-c81a-41af-b8e6-921bef10865e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:08.480982 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2f47480c-c81a-41af-b8e6-921bef10865e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 77f13257-556d-4301-901b-92a99560c5d1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:08.496195 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2f47480c-c81a-41af-b8e6-921bef10865e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:08.496721 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2f47480c-c81a-41af-b8e6-921bef10865e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:08.497975 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2f47480c-c81a-41af-b8e6-921bef10865e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:08.498739 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2f47480c-c81a-41af-b8e6-921bef10865e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:08.499455 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2f47480c-c81a-41af-b8e6-921bef10865e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:08.499904 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2f47480c-c81a-41af-b8e6-921bef10865e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:08.751554 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2f47480c-c81a-41af-b8e6-921bef10865e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:08.763528 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2f47480c-c81a-41af-b8e6-921bef10865e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1" status: 200 len: 1511 microversion: 2.1 time: 0.288769 Sep 08 11:11:08.778845 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2813/5521] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:08 2022] GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1 => generated 1511 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:11:09.382610 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3e2495eb-2a63-4db1-a306-762c09a5f604 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:09.383452 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3e2495eb-2a63-4db1-a306-762c09a5f604 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] [instance: c4230fe2-77ab-4b37-a368-da0b8eabd595] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:09.398725 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e2495eb-2a63-4db1-a306-762c09a5f604 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:09.399719 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e2495eb-2a63-4db1-a306-762c09a5f604 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:09.400326 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e2495eb-2a63-4db1-a306-762c09a5f604 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:09.402991 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e2495eb-2a63-4db1-a306-762c09a5f604 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:09.403494 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e2495eb-2a63-4db1-a306-762c09a5f604 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:09.405245 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e2495eb-2a63-4db1-a306-762c09a5f604 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:09.792513 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c5e81950-6d34-41cd-a7a3-e36f50f14124 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:09.793170 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c5e81950-6d34-41cd-a7a3-e36f50f14124 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 77f13257-556d-4301-901b-92a99560c5d1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:09.814697 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c5e81950-6d34-41cd-a7a3-e36f50f14124 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:09.815216 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c5e81950-6d34-41cd-a7a3-e36f50f14124 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:09.815664 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c5e81950-6d34-41cd-a7a3-e36f50f14124 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:09.825658 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c5e81950-6d34-41cd-a7a3-e36f50f14124 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:09.826421 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c5e81950-6d34-41cd-a7a3-e36f50f14124 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:09.829715 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c5e81950-6d34-41cd-a7a3-e36f50f14124 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:10.096416 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3e2495eb-2a63-4db1-a306-762c09a5f604 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6618b7ad8ff146dfbd892e3e35c2691f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e29f32d2ac4800b9b767f9e1b16526', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:10.107412 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3e2495eb-2a63-4db1-a306-762c09a5f604 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] 10.222.0.27 "GET /compute/v2.1/servers/c4230fe2-77ab-4b37-a368-da0b8eabd595" status: 200 len: 1318 microversion: 2.1 time: 0.733789 Sep 08 11:11:10.112852 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2709/5522] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:09 2022] GET /compute/v2.1/servers/c4230fe2-77ab-4b37-a368-da0b8eabd595 => generated 1318 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:11:10.401045 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c5e81950-6d34-41cd-a7a3-e36f50f14124 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:10.407033 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c5e81950-6d34-41cd-a7a3-e36f50f14124 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1" status: 200 len: 1511 microversion: 2.1 time: 0.619886 Sep 08 11:11:10.407644 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2814/5523] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:09 2022] GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1 => generated 1511 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:11:11.136660 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7871bbea-ab90-460c-9066-c75fe7ec1031 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:11.137450 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7871bbea-ab90-460c-9066-c75fe7ec1031 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] [instance: c4230fe2-77ab-4b37-a368-da0b8eabd595] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:11.151579 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7871bbea-ab90-460c-9066-c75fe7ec1031 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:11.152338 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7871bbea-ab90-460c-9066-c75fe7ec1031 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:11.156136 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7871bbea-ab90-460c-9066-c75fe7ec1031 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:11.157387 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7871bbea-ab90-460c-9066-c75fe7ec1031 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:11.157876 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7871bbea-ab90-460c-9066-c75fe7ec1031 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:11.158317 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7871bbea-ab90-460c-9066-c75fe7ec1031 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:11.437104 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6d4d656b-c9c1-45a9-a15b-3828544152bb tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:11.437952 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6d4d656b-c9c1-45a9-a15b-3828544152bb tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 77f13257-556d-4301-901b-92a99560c5d1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:11.456683 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6d4d656b-c9c1-45a9-a15b-3828544152bb tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:11.458068 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6d4d656b-c9c1-45a9-a15b-3828544152bb tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:11.458401 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6d4d656b-c9c1-45a9-a15b-3828544152bb tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:11.459114 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6d4d656b-c9c1-45a9-a15b-3828544152bb tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:11.460735 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7871bbea-ab90-460c-9066-c75fe7ec1031 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6618b7ad8ff146dfbd892e3e35c2691f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e29f32d2ac4800b9b767f9e1b16526', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:11.464647 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6d4d656b-c9c1-45a9-a15b-3828544152bb tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:11.467948 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6d4d656b-c9c1-45a9-a15b-3828544152bb tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:11.474045 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7871bbea-ab90-460c-9066-c75fe7ec1031 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] 10.222.0.27 "GET /compute/v2.1/servers/c4230fe2-77ab-4b37-a368-da0b8eabd595" status: 200 len: 1318 microversion: 2.1 time: 0.343661 Sep 08 11:11:11.494997 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2710/5524] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:11 2022] GET /compute/v2.1/servers/c4230fe2-77ab-4b37-a368-da0b8eabd595 => generated 1318 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:11:11.782310 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-3654b6f3-a9e7-427f-8565-4178a4cc49fa req-ed765678-6256-4d07-93dd-7278caa2b205 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4230fe2-77ab-4b37-a368-da0b8eabd595", "tag": "537949e9-e52a-4e19-8a5a-eda8f0ad5b5c"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:11:11.808157 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-3654b6f3-a9e7-427f-8565-4178a4cc49fa req-ed765678-6256-4d07-93dd-7278caa2b205 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:11.809662 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-3654b6f3-a9e7-427f-8565-4178a4cc49fa req-ed765678-6256-4d07-93dd-7278caa2b205 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:11.810129 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-3654b6f3-a9e7-427f-8565-4178a4cc49fa req-ed765678-6256-4d07-93dd-7278caa2b205 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:11.844872 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-3654b6f3-a9e7-427f-8565-4178a4cc49fa req-ed765678-6256-4d07-93dd-7278caa2b205 service nova] Creating event network-changed:537949e9-e52a-4e19-8a5a-eda8f0ad5b5c for instance c4230fe2-77ab-4b37-a368-da0b8eabd595 on n-h2-850501-12 Sep 08 11:11:11.858991 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6d4d656b-c9c1-45a9-a15b-3828544152bb tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:11.860347 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-3654b6f3-a9e7-427f-8565-4178a4cc49fa req-ed765678-6256-4d07-93dd-7278caa2b205 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083893 Sep 08 11:11:11.862552 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2711/5525] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:11:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:11:11.871649 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6d4d656b-c9c1-45a9-a15b-3828544152bb tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1" status: 200 len: 1511 microversion: 2.1 time: 0.439168 Sep 08 11:11:11.872951 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2815/5526] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:11 2022] GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1 => generated 1511 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:11:12.506921 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9e7567bd-48d2-4e41-99e9-8cef5ac8c578 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:12.508912 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9e7567bd-48d2-4e41-99e9-8cef5ac8c578 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] [instance: c4230fe2-77ab-4b37-a368-da0b8eabd595] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:12.532503 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9e7567bd-48d2-4e41-99e9-8cef5ac8c578 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:12.534575 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9e7567bd-48d2-4e41-99e9-8cef5ac8c578 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:12.539338 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9e7567bd-48d2-4e41-99e9-8cef5ac8c578 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:12.545509 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9e7567bd-48d2-4e41-99e9-8cef5ac8c578 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:12.547057 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9e7567bd-48d2-4e41-99e9-8cef5ac8c578 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:12.558085 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9e7567bd-48d2-4e41-99e9-8cef5ac8c578 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:12.897275 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f44dd10e-7442-437f-b50b-4cd9df9368d3 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:12.906802 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f44dd10e-7442-437f-b50b-4cd9df9368d3 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 77f13257-556d-4301-901b-92a99560c5d1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:12.928478 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f44dd10e-7442-437f-b50b-4cd9df9368d3 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:12.929075 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f44dd10e-7442-437f-b50b-4cd9df9368d3 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:12.929976 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f44dd10e-7442-437f-b50b-4cd9df9368d3 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:12.931062 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f44dd10e-7442-437f-b50b-4cd9df9368d3 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:12.931683 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f44dd10e-7442-437f-b50b-4cd9df9368d3 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:12.932421 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f44dd10e-7442-437f-b50b-4cd9df9368d3 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:13.448945 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f44dd10e-7442-437f-b50b-4cd9df9368d3 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:13.462732 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f44dd10e-7442-437f-b50b-4cd9df9368d3 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1" status: 200 len: 1511 microversion: 2.1 time: 0.569728 Sep 08 11:11:13.478019 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2816/5527] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:12 2022] GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1 => generated 1511 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:11:13.595730 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f44dd10e-7442-437f-b50b-4cd9df9368d3 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:13.597903 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f44dd10e-7442-437f-b50b-4cd9df9368d3 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002208 Sep 08 11:11:13.599052 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2817/5528] 10.222.0.27 () {56 vars in 886 bytes} [Thu Sep 8 11:11:13 2022] GET /compute/ => generated 377 bytes in 5 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 08 11:11:13.626778 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9e7567bd-48d2-4e41-99e9-8cef5ac8c578 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6618b7ad8ff146dfbd892e3e35c2691f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e29f32d2ac4800b9b767f9e1b16526', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:13.637235 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9e7567bd-48d2-4e41-99e9-8cef5ac8c578 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] 10.222.0.27 "GET /compute/v2.1/servers/c4230fe2-77ab-4b37-a368-da0b8eabd595" status: 200 len: 1318 microversion: 2.1 time: 1.134830 Sep 08 11:11:13.650239 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2712/5529] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:12 2022] GET /compute/v2.1/servers/c4230fe2-77ab-4b37-a368-da0b8eabd595 => generated 1318 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:11:14.504180 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-34066fa3-fa6f-45f9-b19d-f6da1b08459a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:14.508215 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-34066fa3-fa6f-45f9-b19d-f6da1b08459a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 77f13257-556d-4301-901b-92a99560c5d1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:14.524469 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-34066fa3-fa6f-45f9-b19d-f6da1b08459a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:14.525215 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-34066fa3-fa6f-45f9-b19d-f6da1b08459a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:14.525845 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-34066fa3-fa6f-45f9-b19d-f6da1b08459a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:14.526809 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-34066fa3-fa6f-45f9-b19d-f6da1b08459a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:14.527894 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-34066fa3-fa6f-45f9-b19d-f6da1b08459a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:14.528638 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-34066fa3-fa6f-45f9-b19d-f6da1b08459a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:14.662498 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-396ebf12-2fc9-46a1-9f81-886dfff2c0b4 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:14.663647 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-396ebf12-2fc9-46a1-9f81-886dfff2c0b4 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] [instance: c4230fe2-77ab-4b37-a368-da0b8eabd595] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:14.672177 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-396ebf12-2fc9-46a1-9f81-886dfff2c0b4 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:14.672619 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-396ebf12-2fc9-46a1-9f81-886dfff2c0b4 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:14.673069 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-396ebf12-2fc9-46a1-9f81-886dfff2c0b4 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:14.688816 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-396ebf12-2fc9-46a1-9f81-886dfff2c0b4 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:14.691930 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-396ebf12-2fc9-46a1-9f81-886dfff2c0b4 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:14.696782 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-396ebf12-2fc9-46a1-9f81-886dfff2c0b4 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:15.053442 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-34066fa3-fa6f-45f9-b19d-f6da1b08459a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:15.079088 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-34066fa3-fa6f-45f9-b19d-f6da1b08459a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1" status: 200 len: 1511 microversion: 2.1 time: 0.588846 Sep 08 11:11:15.080565 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2818/5530] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:14 2022] GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1 => generated 1511 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:11:15.227041 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-396ebf12-2fc9-46a1-9f81-886dfff2c0b4 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6618b7ad8ff146dfbd892e3e35c2691f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e29f32d2ac4800b9b767f9e1b16526', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:15.243760 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-396ebf12-2fc9-46a1-9f81-886dfff2c0b4 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] 10.222.0.27 "GET /compute/v2.1/servers/c4230fe2-77ab-4b37-a368-da0b8eabd595" status: 200 len: 1318 microversion: 2.1 time: 0.584163 Sep 08 11:11:15.244401 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2713/5531] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:14 2022] GET /compute/v2.1/servers/c4230fe2-77ab-4b37-a368-da0b8eabd595 => generated 1318 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:11:16.107469 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0f5b531b-62ad-493d-97b2-7636867ac14b tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:16.108723 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0f5b531b-62ad-493d-97b2-7636867ac14b tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 77f13257-556d-4301-901b-92a99560c5d1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:16.119124 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0f5b531b-62ad-493d-97b2-7636867ac14b tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:16.119919 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0f5b531b-62ad-493d-97b2-7636867ac14b tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:16.120548 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0f5b531b-62ad-493d-97b2-7636867ac14b tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:16.121587 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0f5b531b-62ad-493d-97b2-7636867ac14b tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:16.122384 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0f5b531b-62ad-493d-97b2-7636867ac14b tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:16.122987 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0f5b531b-62ad-493d-97b2-7636867ac14b tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:16.274709 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-47a28e47-2079-43ba-a808-f55444a1d36a tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:16.280107 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-47a28e47-2079-43ba-a808-f55444a1d36a tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] [instance: c4230fe2-77ab-4b37-a368-da0b8eabd595] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:16.285352 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:11:16.288806 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=8 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:11:16.301566 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-47a28e47-2079-43ba-a808-f55444a1d36a tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:16.305597 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-47a28e47-2079-43ba-a808-f55444a1d36a tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:16.306261 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-47a28e47-2079-43ba-a808-f55444a1d36a tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:16.307194 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-47a28e47-2079-43ba-a808-f55444a1d36a tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:16.309297 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-47a28e47-2079-43ba-a808-f55444a1d36a tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:16.309978 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-47a28e47-2079-43ba-a808-f55444a1d36a tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:16.567747 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0f5b531b-62ad-493d-97b2-7636867ac14b tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:16.577257 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-47a28e47-2079-43ba-a808-f55444a1d36a tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6618b7ad8ff146dfbd892e3e35c2691f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e29f32d2ac4800b9b767f9e1b16526', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:16.579957 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0f5b531b-62ad-493d-97b2-7636867ac14b tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1" status: 200 len: 1511 microversion: 2.1 time: 0.479631 Sep 08 11:11:16.586452 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-47a28e47-2079-43ba-a808-f55444a1d36a tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] 10.222.0.27 "GET /compute/v2.1/servers/c4230fe2-77ab-4b37-a368-da0b8eabd595" status: 200 len: 1318 microversion: 2.1 time: 0.321916 Sep 08 11:11:16.596923 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2714/5532] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:16 2022] GET /compute/v2.1/servers/c4230fe2-77ab-4b37-a368-da0b8eabd595 => generated 1318 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:11:16.605625 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2819/5533] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:16 2022] GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1 => generated 1511 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:11:17.609548 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c078522f-10b8-43c1-9380-fcc262937d33 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:17.610274 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c078522f-10b8-43c1-9380-fcc262937d33 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 77f13257-556d-4301-901b-92a99560c5d1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:17.623970 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-562deb35-34db-42b3-9d4a-602a149047cc tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:17.627429 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-562deb35-34db-42b3-9d4a-602a149047cc tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] [instance: c4230fe2-77ab-4b37-a368-da0b8eabd595] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:17.631111 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c078522f-10b8-43c1-9380-fcc262937d33 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:17.631613 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c078522f-10b8-43c1-9380-fcc262937d33 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:17.633101 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c078522f-10b8-43c1-9380-fcc262937d33 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:17.633668 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c078522f-10b8-43c1-9380-fcc262937d33 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:17.634134 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c078522f-10b8-43c1-9380-fcc262937d33 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:17.634560 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c078522f-10b8-43c1-9380-fcc262937d33 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:17.655783 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-562deb35-34db-42b3-9d4a-602a149047cc tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:17.657256 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-562deb35-34db-42b3-9d4a-602a149047cc tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:17.671145 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-562deb35-34db-42b3-9d4a-602a149047cc tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:17.672548 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-562deb35-34db-42b3-9d4a-602a149047cc tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:17.673437 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-562deb35-34db-42b3-9d4a-602a149047cc tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:17.680677 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-562deb35-34db-42b3-9d4a-602a149047cc tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:17.949003 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c078522f-10b8-43c1-9380-fcc262937d33 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:17.966970 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c078522f-10b8-43c1-9380-fcc262937d33 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1" status: 200 len: 1511 microversion: 2.1 time: 0.362818 Sep 08 11:11:17.968804 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2715/5534] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:17 2022] GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1 => generated 1511 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:11:18.701067 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-562deb35-34db-42b3-9d4a-602a149047cc tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6618b7ad8ff146dfbd892e3e35c2691f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e29f32d2ac4800b9b767f9e1b16526', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:18.716107 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-562deb35-34db-42b3-9d4a-602a149047cc tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] 10.222.0.27 "GET /compute/v2.1/servers/c4230fe2-77ab-4b37-a368-da0b8eabd595" status: 200 len: 1318 microversion: 2.1 time: 1.097648 Sep 08 11:11:18.717840 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2820/5535] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:17 2022] GET /compute/v2.1/servers/c4230fe2-77ab-4b37-a368-da0b8eabd595 => generated 1318 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:11:18.994870 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f01b2702-fa75-46e3-887b-92960a879380 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:18.995637 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f01b2702-fa75-46e3-887b-92960a879380 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 77f13257-556d-4301-901b-92a99560c5d1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:18.998536 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:11:19.018325 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-5f00ac08-8bc3-4186-896c-e431551a1476 req-5a6e94a1-cf1e-40cc-a5aa-11d52fc806d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4230fe2-77ab-4b37-a368-da0b8eabd595", "name": "network-vif-plugged", "status": "completed", "tag": "537949e9-e52a-4e19-8a5a-eda8f0ad5b5c"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:11:19.022541 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f01b2702-fa75-46e3-887b-92960a879380 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:19.027485 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f01b2702-fa75-46e3-887b-92960a879380 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:19.029524 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f01b2702-fa75-46e3-887b-92960a879380 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:19.030401 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f01b2702-fa75-46e3-887b-92960a879380 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:19.033711 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f01b2702-fa75-46e3-887b-92960a879380 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:19.038714 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f01b2702-fa75-46e3-887b-92960a879380 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:19.100372 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-5f00ac08-8bc3-4186-896c-e431551a1476 req-5a6e94a1-cf1e-40cc-a5aa-11d52fc806d4 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:19.112874 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-5f00ac08-8bc3-4186-896c-e431551a1476 req-5a6e94a1-cf1e-40cc-a5aa-11d52fc806d4 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:19.120968 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-5f00ac08-8bc3-4186-896c-e431551a1476 req-5a6e94a1-cf1e-40cc-a5aa-11d52fc806d4 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:19.154253 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-5f00ac08-8bc3-4186-896c-e431551a1476 req-5a6e94a1-cf1e-40cc-a5aa-11d52fc806d4 service nova] Creating event network-vif-plugged:537949e9-e52a-4e19-8a5a-eda8f0ad5b5c for instance c4230fe2-77ab-4b37-a368-da0b8eabd595 on n-h2-850501-12 Sep 08 11:11:19.170007 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-5f00ac08-8bc3-4186-896c-e431551a1476 req-5a6e94a1-cf1e-40cc-a5aa-11d52fc806d4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151464 Sep 08 11:11:19.172657 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2821/5536] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:11:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:11:19.751749 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0d4ef020-9026-42e2-9c9f-7c28fa39a864 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:19.755747 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0d4ef020-9026-42e2-9c9f-7c28fa39a864 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] [instance: c4230fe2-77ab-4b37-a368-da0b8eabd595] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:19.795481 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d4ef020-9026-42e2-9c9f-7c28fa39a864 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:19.796005 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d4ef020-9026-42e2-9c9f-7c28fa39a864 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:19.796471 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d4ef020-9026-42e2-9c9f-7c28fa39a864 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:19.807976 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d4ef020-9026-42e2-9c9f-7c28fa39a864 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:19.808546 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d4ef020-9026-42e2-9c9f-7c28fa39a864 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:19.809011 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d4ef020-9026-42e2-9c9f-7c28fa39a864 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:19.833072 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:11:19.961654 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f01b2702-fa75-46e3-887b-92960a879380 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:19.971229 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f01b2702-fa75-46e3-887b-92960a879380 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1" status: 200 len: 1511 microversion: 2.1 time: 0.981177 Sep 08 11:11:19.974842 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2716/5537] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:18 2022] GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1 => generated 1511 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:11:20.237926 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0d4ef020-9026-42e2-9c9f-7c28fa39a864 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6618b7ad8ff146dfbd892e3e35c2691f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e29f32d2ac4800b9b767f9e1b16526', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:20.266181 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0d4ef020-9026-42e2-9c9f-7c28fa39a864 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] 10.222.0.27 "GET /compute/v2.1/servers/c4230fe2-77ab-4b37-a368-da0b8eabd595" status: 200 len: 1318 microversion: 2.1 time: 0.527685 Sep 08 11:11:20.267674 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2822/5538] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:19 2022] GET /compute/v2.1/servers/c4230fe2-77ab-4b37-a368-da0b8eabd595 => generated 1318 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:11:20.999864 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b4aa6fef-e200-4fd8-9876-9b60d5bb99fa tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:21.001016 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b4aa6fef-e200-4fd8-9876-9b60d5bb99fa tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 77f13257-556d-4301-901b-92a99560c5d1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:21.013389 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4aa6fef-e200-4fd8-9876-9b60d5bb99fa tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:21.015051 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4aa6fef-e200-4fd8-9876-9b60d5bb99fa tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:21.015842 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4aa6fef-e200-4fd8-9876-9b60d5bb99fa tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:21.016863 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4aa6fef-e200-4fd8-9876-9b60d5bb99fa tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:21.017649 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4aa6fef-e200-4fd8-9876-9b60d5bb99fa tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:21.018359 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4aa6fef-e200-4fd8-9876-9b60d5bb99fa tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:21.293600 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e01409be-6901-4dad-8dd7-3dca59b40337 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:21.294226 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e01409be-6901-4dad-8dd7-3dca59b40337 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] [instance: c4230fe2-77ab-4b37-a368-da0b8eabd595] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:21.316050 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b4aa6fef-e200-4fd8-9876-9b60d5bb99fa tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:21.322119 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e01409be-6901-4dad-8dd7-3dca59b40337 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:21.324000 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e01409be-6901-4dad-8dd7-3dca59b40337 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:21.324976 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e01409be-6901-4dad-8dd7-3dca59b40337 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:21.326534 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e01409be-6901-4dad-8dd7-3dca59b40337 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:21.327269 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e01409be-6901-4dad-8dd7-3dca59b40337 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:21.327892 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e01409be-6901-4dad-8dd7-3dca59b40337 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:21.347763 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b4aa6fef-e200-4fd8-9876-9b60d5bb99fa tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1" status: 200 len: 1511 microversion: 2.1 time: 0.351767 Sep 08 11:11:21.349681 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2717/5539] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:20 2022] GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1 => generated 1511 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:11:21.589069 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e01409be-6901-4dad-8dd7-3dca59b40337 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6618b7ad8ff146dfbd892e3e35c2691f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e29f32d2ac4800b9b767f9e1b16526', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:21.604442 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e01409be-6901-4dad-8dd7-3dca59b40337 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] 10.222.0.27 "GET /compute/v2.1/servers/c4230fe2-77ab-4b37-a368-da0b8eabd595" status: 200 len: 1508 microversion: 2.1 time: 0.316641 Sep 08 11:11:21.605012 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2823/5540] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:21 2022] GET /compute/v2.1/servers/c4230fe2-77ab-4b37-a368-da0b8eabd595 => generated 1508 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:11:21.628780 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8f9fa775-3519-4c0a-bba1-a48c79d65477 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "50cb742f-90cd-4bab-8890-55658b8310b8", "device": "/dev/sdb"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:11:21.633174 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8f9fa775-3519-4c0a-bba1-a48c79d65477 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] [instance: c4230fe2-77ab-4b37-a368-da0b8eabd595] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:21.663997 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f9fa775-3519-4c0a-bba1-a48c79d65477 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:21.665372 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f9fa775-3519-4c0a-bba1-a48c79d65477 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:21.668405 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f9fa775-3519-4c0a-bba1-a48c79d65477 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:21.669483 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f9fa775-3519-4c0a-bba1-a48c79d65477 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:21.672205 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f9fa775-3519-4c0a-bba1-a48c79d65477 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:21.672848 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f9fa775-3519-4c0a-bba1-a48c79d65477 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:22.048497 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8f9fa775-3519-4c0a-bba1-a48c79d65477 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] 10.222.0.27 "POST /compute/v2.1/servers/c4230fe2-77ab-4b37-a368-da0b8eabd595/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.423657 Sep 08 11:11:22.049809 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2718/5541] 10.222.0.27 () {60 vars in 1323 bytes} [Thu Sep 8 11:11:21 2022] POST /compute/v2.1/servers/c4230fe2-77ab-4b37-a368-da0b8eabd595/os-volume_attachments => generated 194 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:11:22.380862 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f8cb3b8b-214d-4f7b-bd86-ed19abfcfe4a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:22.382485 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f8cb3b8b-214d-4f7b-bd86-ed19abfcfe4a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 77f13257-556d-4301-901b-92a99560c5d1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:22.407016 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f8cb3b8b-214d-4f7b-bd86-ed19abfcfe4a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:22.407871 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f8cb3b8b-214d-4f7b-bd86-ed19abfcfe4a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:22.410021 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f8cb3b8b-214d-4f7b-bd86-ed19abfcfe4a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:22.414373 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f8cb3b8b-214d-4f7b-bd86-ed19abfcfe4a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:22.415110 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f8cb3b8b-214d-4f7b-bd86-ed19abfcfe4a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:22.415725 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f8cb3b8b-214d-4f7b-bd86-ed19abfcfe4a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:22.760847 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f8cb3b8b-214d-4f7b-bd86-ed19abfcfe4a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:22.769930 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f8cb3b8b-214d-4f7b-bd86-ed19abfcfe4a tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1" status: 200 len: 1511 microversion: 2.1 time: 0.395137 Sep 08 11:11:22.772835 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2824/5542] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:22 2022] GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1 => generated 1511 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:11:23.802747 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2b54dc28-73ba-4b58-adbc-f126a8e5113e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:23.806971 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2b54dc28-73ba-4b58-adbc-f126a8e5113e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 77f13257-556d-4301-901b-92a99560c5d1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:23.817569 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b54dc28-73ba-4b58-adbc-f126a8e5113e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:23.818671 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b54dc28-73ba-4b58-adbc-f126a8e5113e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:23.821557 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b54dc28-73ba-4b58-adbc-f126a8e5113e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:23.827346 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b54dc28-73ba-4b58-adbc-f126a8e5113e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:23.831195 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b54dc28-73ba-4b58-adbc-f126a8e5113e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:23.831961 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b54dc28-73ba-4b58-adbc-f126a8e5113e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:24.112900 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2b54dc28-73ba-4b58-adbc-f126a8e5113e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:24.122744 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2b54dc28-73ba-4b58-adbc-f126a8e5113e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1" status: 200 len: 1511 microversion: 2.1 time: 0.331277 Sep 08 11:11:24.123346 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2719/5543] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:23 2022] GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1 => generated 1511 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:11:25.151833 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7ff65035-a1ed-465c-9378-b283f2321f76 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:25.153373 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7ff65035-a1ed-465c-9378-b283f2321f76 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 77f13257-556d-4301-901b-92a99560c5d1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:25.167852 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7ff65035-a1ed-465c-9378-b283f2321f76 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:25.176464 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7ff65035-a1ed-465c-9378-b283f2321f76 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:25.178023 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7ff65035-a1ed-465c-9378-b283f2321f76 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:25.182509 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7ff65035-a1ed-465c-9378-b283f2321f76 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:25.185792 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7ff65035-a1ed-465c-9378-b283f2321f76 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:25.186543 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7ff65035-a1ed-465c-9378-b283f2321f76 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:25.601804 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7ff65035-a1ed-465c-9378-b283f2321f76 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:25.624427 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7ff65035-a1ed-465c-9378-b283f2321f76 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1" status: 200 len: 1511 microversion: 2.1 time: 0.478220 Sep 08 11:11:25.630224 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2825/5544] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:25 2022] GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1 => generated 1511 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:11:26.654365 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b1db1f6f-9908-40b0-a3eb-40fa652d48bb tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:26.660418 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b1db1f6f-9908-40b0-a3eb-40fa652d48bb tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 77f13257-556d-4301-901b-92a99560c5d1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:26.691192 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1db1f6f-9908-40b0-a3eb-40fa652d48bb tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:26.697899 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1db1f6f-9908-40b0-a3eb-40fa652d48bb tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:26.699002 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1db1f6f-9908-40b0-a3eb-40fa652d48bb tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:26.700030 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1db1f6f-9908-40b0-a3eb-40fa652d48bb tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:26.708609 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1db1f6f-9908-40b0-a3eb-40fa652d48bb tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:26.711749 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1db1f6f-9908-40b0-a3eb-40fa652d48bb tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:27.354333 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b1db1f6f-9908-40b0-a3eb-40fa652d48bb tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:27.368232 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b1db1f6f-9908-40b0-a3eb-40fa652d48bb tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1" status: 200 len: 1511 microversion: 2.1 time: 0.717425 Sep 08 11:11:27.378328 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2720/5545] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:26 2022] GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1 => generated 1511 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:11:28.410386 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bc7cbd39-128f-4c30-a6ad-8d39ddcec92c tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:28.414566 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bc7cbd39-128f-4c30-a6ad-8d39ddcec92c tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 77f13257-556d-4301-901b-92a99560c5d1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:28.434779 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bc7cbd39-128f-4c30-a6ad-8d39ddcec92c tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:28.435539 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bc7cbd39-128f-4c30-a6ad-8d39ddcec92c tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:28.438052 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bc7cbd39-128f-4c30-a6ad-8d39ddcec92c tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:28.439857 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bc7cbd39-128f-4c30-a6ad-8d39ddcec92c tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:28.441314 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bc7cbd39-128f-4c30-a6ad-8d39ddcec92c tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:28.443260 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bc7cbd39-128f-4c30-a6ad-8d39ddcec92c tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:29.057467 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-bc7cbd39-128f-4c30-a6ad-8d39ddcec92c tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:29.067484 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bc7cbd39-128f-4c30-a6ad-8d39ddcec92c tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1" status: 200 len: 1488 microversion: 2.1 time: 0.662129 Sep 08 11:11:29.083279 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2826/5546] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:28 2022] GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1 => generated 1488 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:11:29.100299 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e65651a7-3ba1-4526-bc38-5b0a29198840 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-89407709"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:11:29.104748 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e65651a7-3ba1-4526-bc38-5b0a29198840 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 77f13257-556d-4301-901b-92a99560c5d1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:29.117734 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e65651a7-3ba1-4526-bc38-5b0a29198840 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:29.120093 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e65651a7-3ba1-4526-bc38-5b0a29198840 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:29.121961 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e65651a7-3ba1-4526-bc38-5b0a29198840 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:29.123167 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e65651a7-3ba1-4526-bc38-5b0a29198840 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:29.129168 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e65651a7-3ba1-4526-bc38-5b0a29198840 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:29.129916 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e65651a7-3ba1-4526-bc38-5b0a29198840 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:29.231972 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e65651a7-3ba1-4526-bc38-5b0a29198840 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "PUT /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1" status: 200 len: 1059 microversion: 2.1 time: 0.136092 Sep 08 11:11:29.233236 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2721/5547] 10.222.0.27 () {60 vars in 1256 bytes} [Thu Sep 8 11:11:29 2022] PUT /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1 => generated 1059 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:11:29.253691 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1e17edcb-d3ad-428e-8eac-954f4af94606 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:29.254790 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1e17edcb-d3ad-428e-8eac-954f4af94606 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 77f13257-556d-4301-901b-92a99560c5d1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:29.267448 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e17edcb-d3ad-428e-8eac-954f4af94606 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:29.267965 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e17edcb-d3ad-428e-8eac-954f4af94606 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:29.268411 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e17edcb-d3ad-428e-8eac-954f4af94606 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:29.273555 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e17edcb-d3ad-428e-8eac-954f4af94606 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:29.273985 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e17edcb-d3ad-428e-8eac-954f4af94606 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:29.274491 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e17edcb-d3ad-428e-8eac-954f4af94606 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:29.714725 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1e17edcb-d3ad-428e-8eac-954f4af94606 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:29.728873 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1e17edcb-d3ad-428e-8eac-954f4af94606 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1" status: 200 len: 1486 microversion: 2.1 time: 0.479772 Sep 08 11:11:29.742577 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2827/5548] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:29 2022] GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1 => generated 1486 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:11:29.757475 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7061072f-b8ca-4575-8918-0e1f236b7515 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:29.759289 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7061072f-b8ca-4575-8918-0e1f236b7515 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 77f13257-556d-4301-901b-92a99560c5d1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:29.771129 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7061072f-b8ca-4575-8918-0e1f236b7515 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:29.774041 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7061072f-b8ca-4575-8918-0e1f236b7515 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:29.776156 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7061072f-b8ca-4575-8918-0e1f236b7515 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:29.777302 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7061072f-b8ca-4575-8918-0e1f236b7515 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:29.779572 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7061072f-b8ca-4575-8918-0e1f236b7515 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:29.782928 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7061072f-b8ca-4575-8918-0e1f236b7515 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:30.329169 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7061072f-b8ca-4575-8918-0e1f236b7515 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:30.342704 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7061072f-b8ca-4575-8918-0e1f236b7515 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1" status: 200 len: 1486 microversion: 2.1 time: 0.591265 Sep 08 11:11:30.345634 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2722/5549] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:29 2022] GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1 => generated 1486 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:11:30.374579 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f7da874e-4a42-4f91-a0f7-682131b40266 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:30.375434 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f7da874e-4a42-4f91-a0f7-682131b40266 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 77f13257-556d-4301-901b-92a99560c5d1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:30.393391 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f7da874e-4a42-4f91-a0f7-682131b40266 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:30.400874 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f7da874e-4a42-4f91-a0f7-682131b40266 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:30.402439 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f7da874e-4a42-4f91-a0f7-682131b40266 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:30.404196 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f7da874e-4a42-4f91-a0f7-682131b40266 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:30.408340 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f7da874e-4a42-4f91-a0f7-682131b40266 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:30.411250 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f7da874e-4a42-4f91-a0f7-682131b40266 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:30.511243 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f7da874e-4a42-4f91-a0f7-682131b40266 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 77f13257-556d-4301-901b-92a99560c5d1] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:11:30.786723 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f7da874e-4a42-4f91-a0f7-682131b40266 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "DELETE /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1" status: 204 len: 0 microversion: 2.1 time: 0.415345 Sep 08 11:11:30.788969 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2828/5550] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:11:30 2022] DELETE /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:11:30.798412 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-028fbb99-d413-4e2a-ad39-7deccd64cba2 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:30.799459 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-028fbb99-d413-4e2a-ad39-7deccd64cba2 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 77f13257-556d-4301-901b-92a99560c5d1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:30.813171 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-028fbb99-d413-4e2a-ad39-7deccd64cba2 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:30.813682 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-028fbb99-d413-4e2a-ad39-7deccd64cba2 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:30.814190 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-028fbb99-d413-4e2a-ad39-7deccd64cba2 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:30.814837 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-028fbb99-d413-4e2a-ad39-7deccd64cba2 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:30.815323 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-028fbb99-d413-4e2a-ad39-7deccd64cba2 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:30.828280 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-028fbb99-d413-4e2a-ad39-7deccd64cba2 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:30.843078 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:11:31.637785 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-028fbb99-d413-4e2a-ad39-7deccd64cba2 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:31.659569 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-028fbb99-d413-4e2a-ad39-7deccd64cba2 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1" status: 200 len: 1492 microversion: 2.1 time: 0.865451 Sep 08 11:11:31.665461 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2723/5551] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:30 2022] GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1 => generated 1492 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:11:32.692027 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8a0a1d05-8bb3-4ce7-843e-80597a1b5abd tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:32.692841 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8a0a1d05-8bb3-4ce7-843e-80597a1b5abd tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 77f13257-556d-4301-901b-92a99560c5d1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:32.698498 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:11:32.718917 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8a0a1d05-8bb3-4ce7-843e-80597a1b5abd tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:32.721512 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8a0a1d05-8bb3-4ce7-843e-80597a1b5abd tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:32.722276 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8a0a1d05-8bb3-4ce7-843e-80597a1b5abd tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:32.724076 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8a0a1d05-8bb3-4ce7-843e-80597a1b5abd tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:32.724915 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8a0a1d05-8bb3-4ce7-843e-80597a1b5abd tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:32.726330 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8a0a1d05-8bb3-4ce7-843e-80597a1b5abd tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:33.045821 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8a0a1d05-8bb3-4ce7-843e-80597a1b5abd tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:33.060029 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8a0a1d05-8bb3-4ce7-843e-80597a1b5abd tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1" status: 200 len: 1450 microversion: 2.1 time: 0.373230 Sep 08 11:11:33.063888 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2829/5552] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:32 2022] GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1 => generated 1450 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:11:33.264466 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-0d7731c4-9f2d-4522-9f7b-4d94a50b5f11 req-deb3b4bb-b207-49a7-ac6b-e1b8ecb5efc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77f13257-556d-4301-901b-92a99560c5d1", "name": "network-vif-deleted", "tag": "0825e9e2-7ab2-4ee2-9782-aab8c75eada0"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:11:33.298261 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-0d7731c4-9f2d-4522-9f7b-4d94a50b5f11 req-deb3b4bb-b207-49a7-ac6b-e1b8ecb5efc4 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:33.299024 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-0d7731c4-9f2d-4522-9f7b-4d94a50b5f11 req-deb3b4bb-b207-49a7-ac6b-e1b8ecb5efc4 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:33.313598 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-0d7731c4-9f2d-4522-9f7b-4d94a50b5f11 req-deb3b4bb-b207-49a7-ac6b-e1b8ecb5efc4 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:33.342677 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-0d7731c4-9f2d-4522-9f7b-4d94a50b5f11 req-deb3b4bb-b207-49a7-ac6b-e1b8ecb5efc4 service nova] Creating event network-vif-deleted:0825e9e2-7ab2-4ee2-9782-aab8c75eada0 for instance 77f13257-556d-4301-901b-92a99560c5d1 on n-h1-850501-12 Sep 08 11:11:33.357916 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-0d7731c4-9f2d-4522-9f7b-4d94a50b5f11 req-deb3b4bb-b207-49a7-ac6b-e1b8ecb5efc4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096479 Sep 08 11:11:33.361486 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2830/5553] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:11:33.556428 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d8999ad0-94cc-4eb4-9778-faa0ba094689 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Action: 'create', calling method: .version_select at 0x7f68e4e5c430>, body: {"keypair": {"name": "tempest-keypair-656849058", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+ihd6qB+XWOPvAAZNd8591chyY9oKBDHBwRz3szgQpZe6jq2RfXmBxAN7IgI1raWgvzv4pF23CWFwWsqWiEUvQWLcICqOF5RyS5D1BXK4ngqazP2Z3axTjkrgG96ztHQ=="}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:11:33.605730 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-d8999ad0-94cc-4eb4-9778-faa0ba094689 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Getting quotas for project 364c37fba48647df9953911ecaa86e73. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:11:33.614264 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-d8999ad0-94cc-4eb4-9778-faa0ba094689 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Getting quotas for user 2e0da79f00a24cdb9312036aa4137aa0 and project 364c37fba48647df9953911ecaa86e73. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:11:33.680582 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d8999ad0-94cc-4eb4-9778-faa0ba094689 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.567368 Sep 08 11:11:33.681610 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2724/5554] 10.222.0.27 () {62 vars in 1200 bytes} [Thu Sep 8 11:11:33 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 569 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 08 11:11:34.114355 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a9879fc3-2283-4dd2-9534-6541ce728f1f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:34.116292 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a9879fc3-2283-4dd2-9534-6541ce728f1f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 77f13257-556d-4301-901b-92a99560c5d1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:34.123739 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a9879fc3-2283-4dd2-9534-6541ce728f1f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:34.124480 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a9879fc3-2283-4dd2-9534-6541ce728f1f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:34.125559 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a9879fc3-2283-4dd2-9534-6541ce728f1f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:34.126649 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a9879fc3-2283-4dd2-9534-6541ce728f1f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:34.127285 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a9879fc3-2283-4dd2-9534-6541ce728f1f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:34.127950 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a9879fc3-2283-4dd2-9534-6541ce728f1f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:34.200631 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a9879fc3-2283-4dd2-9534-6541ce728f1f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:34.201630 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a9879fc3-2283-4dd2-9534-6541ce728f1f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:34.202260 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a9879fc3-2283-4dd2-9534-6541ce728f1f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:34.203127 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-a9879fc3-2283-4dd2-9534-6541ce728f1f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lazy-loading 'fault' on Instance uuid 77f13257-556d-4301-901b-92a99560c5d1 {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:11:34.285211 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a9879fc3-2283-4dd2-9534-6541ce728f1f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:34.301683 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a9879fc3-2283-4dd2-9534-6541ce728f1f tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1" status: 200 len: 1308 microversion: 2.1 time: 0.199296 Sep 08 11:11:34.314434 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2831/5555] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:34 2022] GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1 => generated 1308 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:11:35.329647 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-16e8777b-b3b5-4f47-b173-f09df344a600 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:35.330276 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-16e8777b-b3b5-4f47-b173-f09df344a600 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 77f13257-556d-4301-901b-92a99560c5d1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:35.347197 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-16e8777b-b3b5-4f47-b173-f09df344a600 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:35.356046 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-16e8777b-b3b5-4f47-b173-f09df344a600 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:35.357580 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-16e8777b-b3b5-4f47-b173-f09df344a600 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:35.368018 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-16e8777b-b3b5-4f47-b173-f09df344a600 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:35.368769 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-16e8777b-b3b5-4f47-b173-f09df344a600 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:35.369313 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-16e8777b-b3b5-4f47-b173-f09df344a600 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:35.419873 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-16e8777b-b3b5-4f47-b173-f09df344a600 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] HTTP exception thrown: Instance 77f13257-556d-4301-901b-92a99560c5d1 could not be found. Sep 08 11:11:35.422166 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-16e8777b-b3b5-4f47-b173-f09df344a600 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Request method failure captured: Sep 08 11:11:35.422166 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1 HTTP/1.1 Sep 08 11:11:35.422166 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 11:11:35.422166 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 11:11:35.422166 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 11:11:35.422166 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 11:11:35.422166 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 11:11:35.422166 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 11:11:35.422166 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 11:11:35.422166 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 11:11:35.422166 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGczsmQNk4U50BxzpgES3MzOpQCXZXSfv8U0fcthNptdjh-xj4_PXNp1cjGhvwh0ftE8negXuLuWJgSY_-2MLUgv_DNMLspYk9lV1lwtSgINsi9nLe-7tZYJuQnQiEJ_Nrc9KtaPntdIqDspehXXUE-x22uN3GKjXVnYgVPtfdxa4_cE Sep 08 11:11:35.422166 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 11:11:35.422166 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 11:11:35.422166 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 11:11:35.422166 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 11:11:35.422166 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 11:11:35.422166 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 11:11:35.422166 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 7868787bfea94355a5d5971bab0d5ed4 Sep 08 11:11:35.422166 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersTestJSON-1882931607 Sep 08 11:11:35.422166 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 11:11:35.422166 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 11:11:35.422166 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:11:35.422166 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServersTestJSON-1882931607 Sep 08 11:11:35.422166 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 7868787bfea94355a5d5971bab0d5ed4 Sep 08 11:11:35.422166 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersTestJSON-1882931607 Sep 08 11:11:35.422166 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServersTestJSON-1882931607-project Sep 08 11:11:35.422166 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 11:11:35.422166 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 11:11:35.422166 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 5193272e9ab24845aff53982dbe2c6f0 Sep 08 11:11:35.422166 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServersTestJSON-1882931607-project Sep 08 11:11:35.422166 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 11:11:35.422166 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 77f13257-556d-4301-901b-92a99560c5d1 could not be found. Sep 08 11:11:35.422166 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '77f13257-556d-4301-901b-92a99560c5d1'} Sep 08 11:11:35.422166 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:11:35.422166 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:11:35.422166 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:11:35.422166 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:11:35.422166 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:11:35.422166 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:11:35.422166 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:11:35.422166 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:11:35.422166 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:11:35.422166 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:11:35.422166 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77f13257-556d-4301-901b-92a99560c5d1 could not be found. Sep 08 11:11:35.422166 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:11:35.422166 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:11:35.422166 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:11:35.422166 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:11:35.422166 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:11:35.422166 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:11:35.422166 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:11:35.422166 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:11:35.422166 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:11:35.422166 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:11:35.422166 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:11:35.422166 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:11:35.422166 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:11:35.422166 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:11:35.422166 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:11:35.422166 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:11:35.422166 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77f13257-556d-4301-901b-92a99560c5d1 could not be found. Sep 08 11:11:35.422166 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:11:35.422166 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:11:35.422166 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:11:35.427228 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:11:35.427228 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:11:35.427228 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:11:35.427228 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:11:35.427228 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:11:35.427228 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77f13257-556d-4301-901b-92a99560c5d1 could not be found. Sep 08 11:11:35.427228 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:11:35.430344 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-16e8777b-b3b5-4f47-b173-f09df344a600 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Returning 404 to user: Instance 77f13257-556d-4301-901b-92a99560c5d1 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:11:35.434508 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-16e8777b-b3b5-4f47-b173-f09df344a600 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1" status: 404 len: 111 microversion: 2.1 time: 0.107970 Sep 08 11:11:35.436221 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2725/5556] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:35 2022] GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:11:35.454842 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0930ec66-9052-4a50-883e-75806950fa5b tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:35.455356 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0930ec66-9052-4a50-883e-75806950fa5b tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 77f13257-556d-4301-901b-92a99560c5d1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:35.476894 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0930ec66-9052-4a50-883e-75806950fa5b tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:35.477430 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0930ec66-9052-4a50-883e-75806950fa5b tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:35.477870 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0930ec66-9052-4a50-883e-75806950fa5b tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:35.478585 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0930ec66-9052-4a50-883e-75806950fa5b tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:35.479047 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0930ec66-9052-4a50-883e-75806950fa5b tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:35.479482 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0930ec66-9052-4a50-883e-75806950fa5b tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:35.520304 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-0930ec66-9052-4a50-883e-75806950fa5b tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] HTTP exception thrown: Instance 77f13257-556d-4301-901b-92a99560c5d1 could not be found. Sep 08 11:11:35.549083 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0930ec66-9052-4a50-883e-75806950fa5b tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Request method failure captured: Sep 08 11:11:35.549083 n-d-850501-12 devstack@n-api.service[128861]: request: DELETE /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1 HTTP/1.1 Sep 08 11:11:35.549083 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:11:35.549083 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:11:35.549083 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:11:35.549083 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 11:11:35.549083 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:11:35.549083 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:11:35.549083 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:11:35.549083 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:11:35.549083 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGczsmQNk4U50BxzpgES3MzOpQCXZXSfv8U0fcthNptdjh-xj4_PXNp1cjGhvwh0ftE8negXuLuWJgSY_-2MLUgv_DNMLspYk9lV1lwtSgINsi9nLe-7tZYJuQnQiEJ_Nrc9KtaPntdIqDspehXXUE-x22uN3GKjXVnYgVPtfdxa4_cE Sep 08 11:11:35.549083 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:11:35.549083 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:11:35.549083 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:11:35.549083 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:11:35.549083 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:11:35.549083 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:11:35.549083 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 7868787bfea94355a5d5971bab0d5ed4 Sep 08 11:11:35.549083 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServersTestJSON-1882931607 Sep 08 11:11:35.549083 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:11:35.549083 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:11:35.549083 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:11:35.549083 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServersTestJSON-1882931607 Sep 08 11:11:35.549083 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 7868787bfea94355a5d5971bab0d5ed4 Sep 08 11:11:35.549083 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServersTestJSON-1882931607 Sep 08 11:11:35.549083 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServersTestJSON-1882931607-project Sep 08 11:11:35.549083 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:11:35.549083 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:11:35.549083 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 5193272e9ab24845aff53982dbe2c6f0 Sep 08 11:11:35.549083 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServersTestJSON-1882931607-project Sep 08 11:11:35.549083 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 11:11:35.549083 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 77f13257-556d-4301-901b-92a99560c5d1 could not be found. Sep 08 11:11:35.549083 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '77f13257-556d-4301-901b-92a99560c5d1'} Sep 08 11:11:35.549083 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:11:35.549083 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:11:35.549083 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:11:35.549083 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:11:35.549083 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:11:35.549083 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:11:35.549083 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:11:35.549083 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:11:35.549083 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:11:35.549083 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:11:35.549083 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77f13257-556d-4301-901b-92a99560c5d1 could not be found. Sep 08 11:11:35.549083 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:11:35.549083 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:11:35.549083 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:11:35.549083 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:11:35.549083 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:11:35.549083 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:11:35.549083 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:11:35.549083 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:11:35.549083 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:11:35.549083 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:11:35.549083 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 11:11:35.549083 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 11:11:35.549083 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 11:11:35.549083 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 11:11:35.549083 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:11:35.549083 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:11:35.549083 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:11:35.549083 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:11:35.549083 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77f13257-556d-4301-901b-92a99560c5d1 could not be found. Sep 08 11:11:35.554846 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:11:35.554846 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:11:35.554846 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:11:35.554846 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:11:35.554846 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:11:35.554846 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:11:35.554846 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:11:35.554846 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:11:35.554846 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77f13257-556d-4301-901b-92a99560c5d1 could not be found. Sep 08 11:11:35.554846 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:11:35.562542 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0930ec66-9052-4a50-883e-75806950fa5b tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Returning 404 to user: Instance 77f13257-556d-4301-901b-92a99560c5d1 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:11:35.564970 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0930ec66-9052-4a50-883e-75806950fa5b tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "DELETE /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1" status: 404 len: 111 microversion: 2.1 time: 0.120049 Sep 08 11:11:35.574274 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b3935ff3-4735-4af9-bfab-0aed9e63e156 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:35.574879 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b3935ff3-4735-4af9-bfab-0aed9e63e156 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 77f13257-556d-4301-901b-92a99560c5d1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:35.579579 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2832/5557] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:11:35 2022] DELETE /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 11:11:35.581313 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3935ff3-4735-4af9-bfab-0aed9e63e156 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:35.581812 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3935ff3-4735-4af9-bfab-0aed9e63e156 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:35.582250 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3935ff3-4735-4af9-bfab-0aed9e63e156 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:35.584102 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3935ff3-4735-4af9-bfab-0aed9e63e156 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:35.584575 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3935ff3-4735-4af9-bfab-0aed9e63e156 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:35.585132 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3935ff3-4735-4af9-bfab-0aed9e63e156 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:35.621641 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-b3935ff3-4735-4af9-bfab-0aed9e63e156 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] HTTP exception thrown: Instance 77f13257-556d-4301-901b-92a99560c5d1 could not be found. Sep 08 11:11:35.623218 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b3935ff3-4735-4af9-bfab-0aed9e63e156 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Request method failure captured: Sep 08 11:11:35.623218 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1 HTTP/1.1 Sep 08 11:11:35.623218 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 11:11:35.623218 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 11:11:35.623218 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 11:11:35.623218 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 11:11:35.623218 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 11:11:35.623218 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 11:11:35.623218 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 11:11:35.623218 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 11:11:35.623218 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGczsmQNk4U50BxzpgES3MzOpQCXZXSfv8U0fcthNptdjh-xj4_PXNp1cjGhvwh0ftE8negXuLuWJgSY_-2MLUgv_DNMLspYk9lV1lwtSgINsi9nLe-7tZYJuQnQiEJ_Nrc9KtaPntdIqDspehXXUE-x22uN3GKjXVnYgVPtfdxa4_cE Sep 08 11:11:35.623218 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 11:11:35.623218 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 11:11:35.623218 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 11:11:35.623218 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 11:11:35.623218 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 11:11:35.623218 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 11:11:35.623218 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 7868787bfea94355a5d5971bab0d5ed4 Sep 08 11:11:35.623218 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersTestJSON-1882931607 Sep 08 11:11:35.623218 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 11:11:35.623218 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 11:11:35.623218 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:11:35.623218 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServersTestJSON-1882931607 Sep 08 11:11:35.623218 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 7868787bfea94355a5d5971bab0d5ed4 Sep 08 11:11:35.623218 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersTestJSON-1882931607 Sep 08 11:11:35.623218 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServersTestJSON-1882931607-project Sep 08 11:11:35.623218 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 11:11:35.623218 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 11:11:35.623218 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 5193272e9ab24845aff53982dbe2c6f0 Sep 08 11:11:35.623218 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServersTestJSON-1882931607-project Sep 08 11:11:35.623218 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 11:11:35.623218 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 77f13257-556d-4301-901b-92a99560c5d1 could not be found. Sep 08 11:11:35.623218 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '77f13257-556d-4301-901b-92a99560c5d1'} Sep 08 11:11:35.623218 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:11:35.623218 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:11:35.623218 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:11:35.623218 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:11:35.623218 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:11:35.623218 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:11:35.623218 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:11:35.623218 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:11:35.623218 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:11:35.623218 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:11:35.623218 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77f13257-556d-4301-901b-92a99560c5d1 could not be found. Sep 08 11:11:35.623218 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:11:35.623218 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:11:35.623218 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:11:35.623218 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:11:35.623218 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:11:35.623218 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:11:35.623218 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:11:35.623218 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:11:35.623218 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:11:35.623218 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:11:35.623218 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:11:35.623218 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:11:35.623218 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:11:35.623218 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:11:35.623218 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:11:35.623218 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:11:35.623218 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77f13257-556d-4301-901b-92a99560c5d1 could not be found. Sep 08 11:11:35.623218 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:11:35.623218 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:11:35.623218 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:11:35.628364 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:11:35.628364 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:11:35.628364 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:11:35.628364 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:11:35.628364 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:11:35.628364 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77f13257-556d-4301-901b-92a99560c5d1 could not be found. Sep 08 11:11:35.628364 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:11:35.628364 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b3935ff3-4735-4af9-bfab-0aed9e63e156 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Returning 404 to user: Instance 77f13257-556d-4301-901b-92a99560c5d1 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:11:35.628364 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b3935ff3-4735-4af9-bfab-0aed9e63e156 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1" status: 404 len: 111 microversion: 2.1 time: 0.054222 Sep 08 11:11:35.634310 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-32dacc9c-a4ec-4c2f-99a5-44085d93c140 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:35.634893 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-32dacc9c-a4ec-4c2f-99a5-44085d93c140 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 98ee37e8-3835-4d28-9e41-64b96c7de74f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:35.640455 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2726/5558] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:35 2022] GET /compute/v2.1/servers/77f13257-556d-4301-901b-92a99560c5d1 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 11:11:35.645614 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-32dacc9c-a4ec-4c2f-99a5-44085d93c140 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:35.648646 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-32dacc9c-a4ec-4c2f-99a5-44085d93c140 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:35.649249 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-32dacc9c-a4ec-4c2f-99a5-44085d93c140 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:35.650886 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-32dacc9c-a4ec-4c2f-99a5-44085d93c140 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:35.652887 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-32dacc9c-a4ec-4c2f-99a5-44085d93c140 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:35.654355 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-32dacc9c-a4ec-4c2f-99a5-44085d93c140 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:35.688427 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-32dacc9c-a4ec-4c2f-99a5-44085d93c140 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] HTTP exception thrown: Instance 98ee37e8-3835-4d28-9e41-64b96c7de74f could not be found. Sep 08 11:11:35.697716 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-32dacc9c-a4ec-4c2f-99a5-44085d93c140 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Request method failure captured: Sep 08 11:11:35.697716 n-d-850501-12 devstack@n-api.service[128861]: request: DELETE /compute/v2.1/servers/98ee37e8-3835-4d28-9e41-64b96c7de74f HTTP/1.1 Sep 08 11:11:35.697716 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:11:35.697716 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:11:35.697716 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:11:35.697716 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 11:11:35.697716 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:11:35.697716 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:11:35.697716 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:11:35.697716 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:11:35.697716 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGczsmQNk4U50BxzpgES3MzOpQCXZXSfv8U0fcthNptdjh-xj4_PXNp1cjGhvwh0ftE8negXuLuWJgSY_-2MLUgv_DNMLspYk9lV1lwtSgINsi9nLe-7tZYJuQnQiEJ_Nrc9KtaPntdIqDspehXXUE-x22uN3GKjXVnYgVPtfdxa4_cE Sep 08 11:11:35.697716 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:11:35.697716 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:11:35.697716 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:11:35.697716 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:11:35.697716 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:11:35.697716 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:11:35.697716 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 7868787bfea94355a5d5971bab0d5ed4 Sep 08 11:11:35.697716 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServersTestJSON-1882931607 Sep 08 11:11:35.697716 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:11:35.697716 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:11:35.697716 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:11:35.697716 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServersTestJSON-1882931607 Sep 08 11:11:35.697716 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 7868787bfea94355a5d5971bab0d5ed4 Sep 08 11:11:35.697716 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServersTestJSON-1882931607 Sep 08 11:11:35.697716 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServersTestJSON-1882931607-project Sep 08 11:11:35.697716 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:11:35.697716 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:11:35.697716 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 5193272e9ab24845aff53982dbe2c6f0 Sep 08 11:11:35.697716 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServersTestJSON-1882931607-project Sep 08 11:11:35.697716 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 11:11:35.697716 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 98ee37e8-3835-4d28-9e41-64b96c7de74f could not be found. Sep 08 11:11:35.697716 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '98ee37e8-3835-4d28-9e41-64b96c7de74f'} Sep 08 11:11:35.697716 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:11:35.697716 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:11:35.697716 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:11:35.697716 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:11:35.697716 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:11:35.697716 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:11:35.697716 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:11:35.697716 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:11:35.697716 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:11:35.697716 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:11:35.697716 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98ee37e8-3835-4d28-9e41-64b96c7de74f could not be found. Sep 08 11:11:35.697716 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:11:35.697716 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:11:35.697716 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:11:35.697716 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:11:35.697716 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:11:35.697716 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:11:35.697716 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:11:35.697716 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:11:35.697716 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:11:35.697716 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:11:35.697716 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 11:11:35.697716 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 11:11:35.697716 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 11:11:35.697716 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 11:11:35.697716 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:11:35.697716 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:11:35.697716 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:11:35.697716 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:11:35.697716 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98ee37e8-3835-4d28-9e41-64b96c7de74f could not be found. Sep 08 11:11:35.702535 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:11:35.702535 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:11:35.702535 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:11:35.702535 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:11:35.702535 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:11:35.702535 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:11:35.702535 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:11:35.702535 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:11:35.702535 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98ee37e8-3835-4d28-9e41-64b96c7de74f could not be found. Sep 08 11:11:35.702535 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:11:35.704259 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-32dacc9c-a4ec-4c2f-99a5-44085d93c140 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Returning 404 to user: Instance 98ee37e8-3835-4d28-9e41-64b96c7de74f could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:11:35.705368 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-32dacc9c-a4ec-4c2f-99a5-44085d93c140 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "DELETE /compute/v2.1/servers/98ee37e8-3835-4d28-9e41-64b96c7de74f" status: 404 len: 111 microversion: 2.1 time: 0.075828 Sep 08 11:11:35.710007 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2833/5559] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:11:35 2022] DELETE /compute/v2.1/servers/98ee37e8-3835-4d28-9e41-64b96c7de74f => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:11:35.715546 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1d31a16e-584c-4e09-9bea-38576a241622 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:35.718253 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1d31a16e-584c-4e09-9bea-38576a241622 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 98ee37e8-3835-4d28-9e41-64b96c7de74f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:35.727289 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1d31a16e-584c-4e09-9bea-38576a241622 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:35.728054 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1d31a16e-584c-4e09-9bea-38576a241622 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:35.728605 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1d31a16e-584c-4e09-9bea-38576a241622 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:35.729428 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1d31a16e-584c-4e09-9bea-38576a241622 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:35.729956 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1d31a16e-584c-4e09-9bea-38576a241622 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:35.730498 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1d31a16e-584c-4e09-9bea-38576a241622 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:35.754518 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-1d31a16e-584c-4e09-9bea-38576a241622 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] HTTP exception thrown: Instance 98ee37e8-3835-4d28-9e41-64b96c7de74f could not be found. Sep 08 11:11:35.756416 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1d31a16e-584c-4e09-9bea-38576a241622 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Request method failure captured: Sep 08 11:11:35.756416 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/98ee37e8-3835-4d28-9e41-64b96c7de74f HTTP/1.1 Sep 08 11:11:35.756416 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 11:11:35.756416 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 11:11:35.756416 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 11:11:35.756416 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 11:11:35.756416 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 11:11:35.756416 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 11:11:35.756416 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 11:11:35.756416 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 11:11:35.756416 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGczsmQNk4U50BxzpgES3MzOpQCXZXSfv8U0fcthNptdjh-xj4_PXNp1cjGhvwh0ftE8negXuLuWJgSY_-2MLUgv_DNMLspYk9lV1lwtSgINsi9nLe-7tZYJuQnQiEJ_Nrc9KtaPntdIqDspehXXUE-x22uN3GKjXVnYgVPtfdxa4_cE Sep 08 11:11:35.756416 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 11:11:35.756416 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 11:11:35.756416 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 11:11:35.756416 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 11:11:35.756416 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 11:11:35.756416 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 11:11:35.756416 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 7868787bfea94355a5d5971bab0d5ed4 Sep 08 11:11:35.756416 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersTestJSON-1882931607 Sep 08 11:11:35.756416 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 11:11:35.756416 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 11:11:35.756416 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:11:35.756416 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServersTestJSON-1882931607 Sep 08 11:11:35.756416 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 7868787bfea94355a5d5971bab0d5ed4 Sep 08 11:11:35.756416 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersTestJSON-1882931607 Sep 08 11:11:35.756416 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServersTestJSON-1882931607-project Sep 08 11:11:35.756416 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 11:11:35.756416 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 11:11:35.756416 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 5193272e9ab24845aff53982dbe2c6f0 Sep 08 11:11:35.756416 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServersTestJSON-1882931607-project Sep 08 11:11:35.756416 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 11:11:35.756416 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 98ee37e8-3835-4d28-9e41-64b96c7de74f could not be found. Sep 08 11:11:35.756416 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '98ee37e8-3835-4d28-9e41-64b96c7de74f'} Sep 08 11:11:35.756416 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:11:35.756416 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:11:35.756416 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:11:35.756416 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:11:35.756416 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:11:35.756416 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:11:35.756416 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:11:35.756416 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:11:35.756416 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:11:35.756416 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:11:35.756416 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98ee37e8-3835-4d28-9e41-64b96c7de74f could not be found. Sep 08 11:11:35.756416 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:11:35.756416 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:11:35.756416 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:11:35.756416 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:11:35.756416 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:11:35.756416 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:11:35.756416 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:11:35.756416 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:11:35.756416 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:11:35.756416 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:11:35.756416 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:11:35.756416 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:11:35.756416 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:11:35.756416 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:11:35.756416 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:11:35.756416 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:11:35.756416 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98ee37e8-3835-4d28-9e41-64b96c7de74f could not be found. Sep 08 11:11:35.756416 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:11:35.756416 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:11:35.756416 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:11:35.761358 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:11:35.761358 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:11:35.761358 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:11:35.761358 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:11:35.761358 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:11:35.761358 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98ee37e8-3835-4d28-9e41-64b96c7de74f could not be found. Sep 08 11:11:35.761358 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:11:35.761358 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1d31a16e-584c-4e09-9bea-38576a241622 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Returning 404 to user: Instance 98ee37e8-3835-4d28-9e41-64b96c7de74f could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:11:35.762951 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1d31a16e-584c-4e09-9bea-38576a241622 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/98ee37e8-3835-4d28-9e41-64b96c7de74f" status: 404 len: 111 microversion: 2.1 time: 0.051801 Sep 08 11:11:35.764550 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2727/5560] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:35 2022] GET /compute/v2.1/servers/98ee37e8-3835-4d28-9e41-64b96c7de74f => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:11:35.774169 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a5bfc0fa-a9cc-4234-9e0e-b9e51d32cf05 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:35.774955 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a5bfc0fa-a9cc-4234-9e0e-b9e51d32cf05 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:35.782264 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a5bfc0fa-a9cc-4234-9e0e-b9e51d32cf05 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:35.782976 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a5bfc0fa-a9cc-4234-9e0e-b9e51d32cf05 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:35.783632 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a5bfc0fa-a9cc-4234-9e0e-b9e51d32cf05 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:35.784802 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a5bfc0fa-a9cc-4234-9e0e-b9e51d32cf05 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:35.785801 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a5bfc0fa-a9cc-4234-9e0e-b9e51d32cf05 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:35.786882 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a5bfc0fa-a9cc-4234-9e0e-b9e51d32cf05 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:35.809458 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-a5bfc0fa-a9cc-4234-9e0e-b9e51d32cf05 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] HTTP exception thrown: Instance 35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65 could not be found. Sep 08 11:11:35.811930 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a5bfc0fa-a9cc-4234-9e0e-b9e51d32cf05 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Request method failure captured: Sep 08 11:11:35.811930 n-d-850501-12 devstack@n-api.service[128861]: request: DELETE /compute/v2.1/servers/35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65 HTTP/1.1 Sep 08 11:11:35.811930 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:11:35.811930 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:11:35.811930 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:11:35.811930 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 11:11:35.811930 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:11:35.811930 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:11:35.811930 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:11:35.811930 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:11:35.811930 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGczsmQNk4U50BxzpgES3MzOpQCXZXSfv8U0fcthNptdjh-xj4_PXNp1cjGhvwh0ftE8negXuLuWJgSY_-2MLUgv_DNMLspYk9lV1lwtSgINsi9nLe-7tZYJuQnQiEJ_Nrc9KtaPntdIqDspehXXUE-x22uN3GKjXVnYgVPtfdxa4_cE Sep 08 11:11:35.811930 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:11:35.811930 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:11:35.811930 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:11:35.811930 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:11:35.811930 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:11:35.811930 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:11:35.811930 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 7868787bfea94355a5d5971bab0d5ed4 Sep 08 11:11:35.811930 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServersTestJSON-1882931607 Sep 08 11:11:35.811930 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:11:35.811930 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:11:35.811930 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:11:35.811930 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServersTestJSON-1882931607 Sep 08 11:11:35.811930 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 7868787bfea94355a5d5971bab0d5ed4 Sep 08 11:11:35.811930 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServersTestJSON-1882931607 Sep 08 11:11:35.811930 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServersTestJSON-1882931607-project Sep 08 11:11:35.811930 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:11:35.811930 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:11:35.811930 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 5193272e9ab24845aff53982dbe2c6f0 Sep 08 11:11:35.811930 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServersTestJSON-1882931607-project Sep 08 11:11:35.811930 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 11:11:35.811930 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65 could not be found. Sep 08 11:11:35.811930 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65'} Sep 08 11:11:35.811930 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:11:35.811930 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:11:35.811930 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:11:35.811930 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:11:35.811930 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:11:35.811930 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:11:35.811930 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:11:35.811930 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:11:35.811930 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:11:35.811930 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:11:35.811930 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65 could not be found. Sep 08 11:11:35.811930 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:11:35.811930 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:11:35.811930 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:11:35.811930 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:11:35.811930 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:11:35.811930 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:11:35.811930 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:11:35.811930 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:11:35.811930 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:11:35.811930 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:11:35.811930 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 11:11:35.811930 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 11:11:35.811930 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 11:11:35.811930 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 11:11:35.811930 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:11:35.811930 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:11:35.811930 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:11:35.811930 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:11:35.811930 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65 could not be found. Sep 08 11:11:35.816788 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:11:35.816788 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:11:35.816788 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:11:35.816788 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:11:35.816788 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:11:35.816788 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:11:35.816788 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:11:35.816788 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:11:35.816788 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65 could not be found. Sep 08 11:11:35.816788 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:11:35.818441 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a5bfc0fa-a9cc-4234-9e0e-b9e51d32cf05 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Returning 404 to user: Instance 35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:11:35.820004 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a5bfc0fa-a9cc-4234-9e0e-b9e51d32cf05 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "DELETE /compute/v2.1/servers/35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65" status: 404 len: 111 microversion: 2.1 time: 0.051110 Sep 08 11:11:35.825063 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2834/5561] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:11:35 2022] DELETE /compute/v2.1/servers/35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:11:35.833265 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-228a3c04-cd02-4ee8-8809-7d00d54f6aa1 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:35.834536 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-228a3c04-cd02-4ee8-8809-7d00d54f6aa1 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:35.849234 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-228a3c04-cd02-4ee8-8809-7d00d54f6aa1 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:35.850009 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-228a3c04-cd02-4ee8-8809-7d00d54f6aa1 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:35.850771 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-228a3c04-cd02-4ee8-8809-7d00d54f6aa1 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:35.851837 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-228a3c04-cd02-4ee8-8809-7d00d54f6aa1 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:35.852639 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-228a3c04-cd02-4ee8-8809-7d00d54f6aa1 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:35.853077 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-228a3c04-cd02-4ee8-8809-7d00d54f6aa1 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:35.883826 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-228a3c04-cd02-4ee8-8809-7d00d54f6aa1 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] HTTP exception thrown: Instance 35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65 could not be found. Sep 08 11:11:35.890000 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-228a3c04-cd02-4ee8-8809-7d00d54f6aa1 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Request method failure captured: Sep 08 11:11:35.890000 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65 HTTP/1.1 Sep 08 11:11:35.890000 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 11:11:35.890000 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 11:11:35.890000 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 11:11:35.890000 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 11:11:35.890000 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 11:11:35.890000 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 11:11:35.890000 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 11:11:35.890000 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 11:11:35.890000 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGczsmQNk4U50BxzpgES3MzOpQCXZXSfv8U0fcthNptdjh-xj4_PXNp1cjGhvwh0ftE8negXuLuWJgSY_-2MLUgv_DNMLspYk9lV1lwtSgINsi9nLe-7tZYJuQnQiEJ_Nrc9KtaPntdIqDspehXXUE-x22uN3GKjXVnYgVPtfdxa4_cE Sep 08 11:11:35.890000 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 11:11:35.890000 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 11:11:35.890000 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 11:11:35.890000 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 11:11:35.890000 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 11:11:35.890000 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 11:11:35.890000 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 7868787bfea94355a5d5971bab0d5ed4 Sep 08 11:11:35.890000 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersTestJSON-1882931607 Sep 08 11:11:35.890000 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 11:11:35.890000 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 11:11:35.890000 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:11:35.890000 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServersTestJSON-1882931607 Sep 08 11:11:35.890000 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 7868787bfea94355a5d5971bab0d5ed4 Sep 08 11:11:35.890000 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersTestJSON-1882931607 Sep 08 11:11:35.890000 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServersTestJSON-1882931607-project Sep 08 11:11:35.890000 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 11:11:35.890000 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 11:11:35.890000 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 5193272e9ab24845aff53982dbe2c6f0 Sep 08 11:11:35.890000 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServersTestJSON-1882931607-project Sep 08 11:11:35.890000 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 11:11:35.890000 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65 could not be found. Sep 08 11:11:35.890000 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65'} Sep 08 11:11:35.890000 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:11:35.890000 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:11:35.890000 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:11:35.890000 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:11:35.890000 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:11:35.890000 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:11:35.890000 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:11:35.890000 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:11:35.890000 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:11:35.890000 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:11:35.890000 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65 could not be found. Sep 08 11:11:35.890000 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:11:35.890000 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:11:35.890000 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:11:35.890000 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:11:35.890000 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:11:35.890000 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:11:35.890000 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:11:35.890000 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:11:35.890000 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:11:35.890000 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:11:35.890000 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:11:35.890000 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:11:35.890000 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:11:35.890000 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:11:35.890000 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:11:35.890000 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:11:35.890000 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65 could not be found. Sep 08 11:11:35.890000 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:11:35.890000 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:11:35.890000 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:11:35.895342 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:11:35.895342 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:11:35.895342 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:11:35.895342 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:11:35.895342 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:11:35.895342 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65 could not be found. Sep 08 11:11:35.895342 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:11:35.901564 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-228a3c04-cd02-4ee8-8809-7d00d54f6aa1 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Returning 404 to user: Instance 35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:11:35.903600 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-228a3c04-cd02-4ee8-8809-7d00d54f6aa1 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65" status: 404 len: 111 microversion: 2.1 time: 0.073920 Sep 08 11:11:35.908122 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2728/5562] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:35 2022] GET /compute/v2.1/servers/35f9c9d6-1c9d-4a46-a6cc-7509a1b16e65 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:11:35.915773 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2c9e7a2c-811d-4136-bf6d-7f409ba4db17 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:35.916429 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2c9e7a2c-811d-4136-bf6d-7f409ba4db17 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: c8060dc4-1634-4142-a4fe-35ee4ffc74f2] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:35.936980 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2c9e7a2c-811d-4136-bf6d-7f409ba4db17 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:35.937726 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2c9e7a2c-811d-4136-bf6d-7f409ba4db17 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:35.939588 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2c9e7a2c-811d-4136-bf6d-7f409ba4db17 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:35.942150 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2c9e7a2c-811d-4136-bf6d-7f409ba4db17 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:35.942804 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2c9e7a2c-811d-4136-bf6d-7f409ba4db17 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:35.944421 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2c9e7a2c-811d-4136-bf6d-7f409ba4db17 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:35.984204 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-2c9e7a2c-811d-4136-bf6d-7f409ba4db17 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] HTTP exception thrown: Instance c8060dc4-1634-4142-a4fe-35ee4ffc74f2 could not be found. Sep 08 11:11:36.002654 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2c9e7a2c-811d-4136-bf6d-7f409ba4db17 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Request method failure captured: Sep 08 11:11:36.002654 n-d-850501-12 devstack@n-api.service[128861]: request: DELETE /compute/v2.1/servers/c8060dc4-1634-4142-a4fe-35ee4ffc74f2 HTTP/1.1 Sep 08 11:11:36.002654 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:11:36.002654 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:11:36.002654 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:11:36.002654 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 11:11:36.002654 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:11:36.002654 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:11:36.002654 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:11:36.002654 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:11:36.002654 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGczsmQNk4U50BxzpgES3MzOpQCXZXSfv8U0fcthNptdjh-xj4_PXNp1cjGhvwh0ftE8negXuLuWJgSY_-2MLUgv_DNMLspYk9lV1lwtSgINsi9nLe-7tZYJuQnQiEJ_Nrc9KtaPntdIqDspehXXUE-x22uN3GKjXVnYgVPtfdxa4_cE Sep 08 11:11:36.002654 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:11:36.002654 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:11:36.002654 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:11:36.002654 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:11:36.002654 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:11:36.002654 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:11:36.002654 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 7868787bfea94355a5d5971bab0d5ed4 Sep 08 11:11:36.002654 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServersTestJSON-1882931607 Sep 08 11:11:36.002654 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:11:36.002654 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:11:36.002654 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:11:36.002654 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServersTestJSON-1882931607 Sep 08 11:11:36.002654 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 7868787bfea94355a5d5971bab0d5ed4 Sep 08 11:11:36.002654 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServersTestJSON-1882931607 Sep 08 11:11:36.002654 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServersTestJSON-1882931607-project Sep 08 11:11:36.002654 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:11:36.002654 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:11:36.002654 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 5193272e9ab24845aff53982dbe2c6f0 Sep 08 11:11:36.002654 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServersTestJSON-1882931607-project Sep 08 11:11:36.002654 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 11:11:36.002654 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance c8060dc4-1634-4142-a4fe-35ee4ffc74f2 could not be found. Sep 08 11:11:36.002654 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': 'c8060dc4-1634-4142-a4fe-35ee4ffc74f2'} Sep 08 11:11:36.002654 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:11:36.002654 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:11:36.002654 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:11:36.002654 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:11:36.002654 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:11:36.002654 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:11:36.002654 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:11:36.002654 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:11:36.002654 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:11:36.002654 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:11:36.002654 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8060dc4-1634-4142-a4fe-35ee4ffc74f2 could not be found. Sep 08 11:11:36.002654 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:11:36.002654 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:11:36.002654 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:11:36.002654 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:11:36.002654 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:11:36.002654 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:11:36.002654 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:11:36.002654 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:11:36.002654 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:11:36.002654 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:11:36.002654 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 11:11:36.002654 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 11:11:36.002654 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 11:11:36.002654 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 11:11:36.002654 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:11:36.002654 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:11:36.002654 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:11:36.002654 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:11:36.002654 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8060dc4-1634-4142-a4fe-35ee4ffc74f2 could not be found. Sep 08 11:11:36.011656 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:11:36.011656 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:11:36.011656 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:11:36.011656 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:11:36.011656 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:11:36.011656 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:11:36.011656 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:11:36.011656 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:11:36.011656 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8060dc4-1634-4142-a4fe-35ee4ffc74f2 could not be found. Sep 08 11:11:36.011656 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:11:36.011656 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2c9e7a2c-811d-4136-bf6d-7f409ba4db17 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Returning 404 to user: Instance c8060dc4-1634-4142-a4fe-35ee4ffc74f2 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:11:36.011656 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2c9e7a2c-811d-4136-bf6d-7f409ba4db17 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c8060dc4-1634-4142-a4fe-35ee4ffc74f2" status: 404 len: 111 microversion: 2.1 time: 0.095061 Sep 08 11:11:36.011656 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2835/5563] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:11:35 2022] DELETE /compute/v2.1/servers/c8060dc4-1634-4142-a4fe-35ee4ffc74f2 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:11:36.017510 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cc2f722c-7ce3-4d30-93e3-743673e4d524 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:36.017884 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cc2f722c-7ce3-4d30-93e3-743673e4d524 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: c8060dc4-1634-4142-a4fe-35ee4ffc74f2] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:36.025234 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc2f722c-7ce3-4d30-93e3-743673e4d524 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:36.026013 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc2f722c-7ce3-4d30-93e3-743673e4d524 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:36.026627 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc2f722c-7ce3-4d30-93e3-743673e4d524 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:36.027996 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc2f722c-7ce3-4d30-93e3-743673e4d524 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:36.028741 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc2f722c-7ce3-4d30-93e3-743673e4d524 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:36.029371 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc2f722c-7ce3-4d30-93e3-743673e4d524 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:36.066341 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-cc2f722c-7ce3-4d30-93e3-743673e4d524 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] HTTP exception thrown: Instance c8060dc4-1634-4142-a4fe-35ee4ffc74f2 could not be found. Sep 08 11:11:36.071809 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cc2f722c-7ce3-4d30-93e3-743673e4d524 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Request method failure captured: Sep 08 11:11:36.071809 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/c8060dc4-1634-4142-a4fe-35ee4ffc74f2 HTTP/1.1 Sep 08 11:11:36.071809 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 11:11:36.071809 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 11:11:36.071809 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 11:11:36.071809 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 11:11:36.071809 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 11:11:36.071809 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 11:11:36.071809 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 11:11:36.071809 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 11:11:36.071809 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGczsmQNk4U50BxzpgES3MzOpQCXZXSfv8U0fcthNptdjh-xj4_PXNp1cjGhvwh0ftE8negXuLuWJgSY_-2MLUgv_DNMLspYk9lV1lwtSgINsi9nLe-7tZYJuQnQiEJ_Nrc9KtaPntdIqDspehXXUE-x22uN3GKjXVnYgVPtfdxa4_cE Sep 08 11:11:36.071809 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 11:11:36.071809 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 11:11:36.071809 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 11:11:36.071809 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 11:11:36.071809 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 11:11:36.071809 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 11:11:36.071809 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 7868787bfea94355a5d5971bab0d5ed4 Sep 08 11:11:36.071809 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersTestJSON-1882931607 Sep 08 11:11:36.071809 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 11:11:36.071809 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 11:11:36.071809 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:11:36.071809 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServersTestJSON-1882931607 Sep 08 11:11:36.071809 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 7868787bfea94355a5d5971bab0d5ed4 Sep 08 11:11:36.071809 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersTestJSON-1882931607 Sep 08 11:11:36.071809 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServersTestJSON-1882931607-project Sep 08 11:11:36.071809 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 11:11:36.071809 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 11:11:36.071809 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 5193272e9ab24845aff53982dbe2c6f0 Sep 08 11:11:36.071809 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServersTestJSON-1882931607-project Sep 08 11:11:36.071809 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 11:11:36.071809 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance c8060dc4-1634-4142-a4fe-35ee4ffc74f2 could not be found. Sep 08 11:11:36.071809 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'c8060dc4-1634-4142-a4fe-35ee4ffc74f2'} Sep 08 11:11:36.071809 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:11:36.071809 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:11:36.071809 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:11:36.071809 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:11:36.071809 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:11:36.071809 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:11:36.071809 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:11:36.071809 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:11:36.071809 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:11:36.071809 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:11:36.071809 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8060dc4-1634-4142-a4fe-35ee4ffc74f2 could not be found. Sep 08 11:11:36.071809 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:11:36.071809 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:11:36.071809 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:11:36.071809 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:11:36.071809 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:11:36.071809 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:11:36.071809 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:11:36.071809 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:11:36.071809 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:11:36.071809 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:11:36.071809 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:11:36.071809 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:11:36.071809 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:11:36.071809 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:11:36.071809 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:11:36.071809 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:11:36.071809 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8060dc4-1634-4142-a4fe-35ee4ffc74f2 could not be found. Sep 08 11:11:36.071809 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:11:36.071809 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:11:36.071809 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:11:36.077559 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:11:36.077559 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:11:36.077559 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:11:36.077559 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:11:36.077559 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:11:36.077559 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8060dc4-1634-4142-a4fe-35ee4ffc74f2 could not be found. Sep 08 11:11:36.077559 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:11:36.077559 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cc2f722c-7ce3-4d30-93e3-743673e4d524 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Returning 404 to user: Instance c8060dc4-1634-4142-a4fe-35ee4ffc74f2 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:11:36.077559 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cc2f722c-7ce3-4d30-93e3-743673e4d524 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/c8060dc4-1634-4142-a4fe-35ee4ffc74f2" status: 404 len: 111 microversion: 2.1 time: 0.060096 Sep 08 11:11:36.098077 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6aaead24-3f4a-4840-9ef6-332b0a3472d6 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:36.098598 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6aaead24-3f4a-4840-9ef6-332b0a3472d6 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 3c9e4ea7-9f84-44a9-8288-27adaed61617] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:36.099049 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2729/5564] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:36 2022] GET /compute/v2.1/servers/c8060dc4-1634-4142-a4fe-35ee4ffc74f2 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:11:36.125203 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6aaead24-3f4a-4840-9ef6-332b0a3472d6 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:36.125988 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6aaead24-3f4a-4840-9ef6-332b0a3472d6 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:36.126703 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6aaead24-3f4a-4840-9ef6-332b0a3472d6 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:36.127818 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6aaead24-3f4a-4840-9ef6-332b0a3472d6 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:36.128498 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6aaead24-3f4a-4840-9ef6-332b0a3472d6 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:36.129175 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6aaead24-3f4a-4840-9ef6-332b0a3472d6 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:36.145903 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-6aaead24-3f4a-4840-9ef6-332b0a3472d6 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] HTTP exception thrown: Instance 3c9e4ea7-9f84-44a9-8288-27adaed61617 could not be found. Sep 08 11:11:36.148466 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6aaead24-3f4a-4840-9ef6-332b0a3472d6 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Request method failure captured: Sep 08 11:11:36.148466 n-d-850501-12 devstack@n-api.service[128861]: request: DELETE /compute/v2.1/servers/3c9e4ea7-9f84-44a9-8288-27adaed61617 HTTP/1.1 Sep 08 11:11:36.148466 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:11:36.148466 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:11:36.148466 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:11:36.148466 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 11:11:36.148466 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:11:36.148466 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:11:36.148466 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:11:36.148466 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:11:36.148466 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGczsmQNk4U50BxzpgES3MzOpQCXZXSfv8U0fcthNptdjh-xj4_PXNp1cjGhvwh0ftE8negXuLuWJgSY_-2MLUgv_DNMLspYk9lV1lwtSgINsi9nLe-7tZYJuQnQiEJ_Nrc9KtaPntdIqDspehXXUE-x22uN3GKjXVnYgVPtfdxa4_cE Sep 08 11:11:36.148466 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:11:36.148466 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:11:36.148466 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:11:36.148466 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:11:36.148466 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:11:36.148466 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:11:36.148466 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 7868787bfea94355a5d5971bab0d5ed4 Sep 08 11:11:36.148466 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServersTestJSON-1882931607 Sep 08 11:11:36.148466 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:11:36.148466 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:11:36.148466 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:11:36.148466 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServersTestJSON-1882931607 Sep 08 11:11:36.148466 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 7868787bfea94355a5d5971bab0d5ed4 Sep 08 11:11:36.148466 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServersTestJSON-1882931607 Sep 08 11:11:36.148466 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServersTestJSON-1882931607-project Sep 08 11:11:36.148466 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:11:36.148466 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:11:36.148466 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 5193272e9ab24845aff53982dbe2c6f0 Sep 08 11:11:36.148466 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServersTestJSON-1882931607-project Sep 08 11:11:36.148466 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 11:11:36.148466 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 3c9e4ea7-9f84-44a9-8288-27adaed61617 could not be found. Sep 08 11:11:36.148466 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '3c9e4ea7-9f84-44a9-8288-27adaed61617'} Sep 08 11:11:36.148466 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:11:36.148466 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:11:36.148466 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:11:36.148466 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:11:36.148466 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:11:36.148466 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:11:36.148466 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:11:36.148466 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:11:36.148466 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:11:36.148466 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:11:36.148466 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c9e4ea7-9f84-44a9-8288-27adaed61617 could not be found. Sep 08 11:11:36.148466 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:11:36.148466 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:11:36.148466 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:11:36.148466 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:11:36.148466 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:11:36.148466 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:11:36.148466 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:11:36.148466 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:11:36.148466 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:11:36.148466 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:11:36.148466 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 11:11:36.148466 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 11:11:36.148466 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 11:11:36.148466 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 11:11:36.148466 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:11:36.148466 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:11:36.148466 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:11:36.148466 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:11:36.148466 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c9e4ea7-9f84-44a9-8288-27adaed61617 could not be found. Sep 08 11:11:36.152417 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:11:36.152417 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:11:36.152417 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:11:36.152417 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:11:36.152417 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:11:36.152417 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:11:36.152417 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:11:36.152417 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:11:36.152417 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c9e4ea7-9f84-44a9-8288-27adaed61617 could not be found. Sep 08 11:11:36.152417 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:11:36.156468 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6aaead24-3f4a-4840-9ef6-332b0a3472d6 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Returning 404 to user: Instance 3c9e4ea7-9f84-44a9-8288-27adaed61617 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:11:36.157606 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6aaead24-3f4a-4840-9ef6-332b0a3472d6 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3c9e4ea7-9f84-44a9-8288-27adaed61617" status: 404 len: 111 microversion: 2.1 time: 0.078337 Sep 08 11:11:36.158679 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2836/5565] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:11:36 2022] DELETE /compute/v2.1/servers/3c9e4ea7-9f84-44a9-8288-27adaed61617 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 11:11:36.176176 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-218f634a-cf84-47d8-aa5c-a21d16106414 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:36.176976 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-218f634a-cf84-47d8-aa5c-a21d16106414 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 3c9e4ea7-9f84-44a9-8288-27adaed61617] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:36.189089 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-218f634a-cf84-47d8-aa5c-a21d16106414 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:36.189608 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-218f634a-cf84-47d8-aa5c-a21d16106414 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:36.191226 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-218f634a-cf84-47d8-aa5c-a21d16106414 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:36.192679 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-218f634a-cf84-47d8-aa5c-a21d16106414 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:36.196526 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-218f634a-cf84-47d8-aa5c-a21d16106414 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:36.196987 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-218f634a-cf84-47d8-aa5c-a21d16106414 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:36.229279 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-218f634a-cf84-47d8-aa5c-a21d16106414 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] HTTP exception thrown: Instance 3c9e4ea7-9f84-44a9-8288-27adaed61617 could not be found. Sep 08 11:11:36.233428 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-218f634a-cf84-47d8-aa5c-a21d16106414 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Request method failure captured: Sep 08 11:11:36.233428 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/3c9e4ea7-9f84-44a9-8288-27adaed61617 HTTP/1.1 Sep 08 11:11:36.233428 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 11:11:36.233428 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 11:11:36.233428 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 11:11:36.233428 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 11:11:36.233428 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 11:11:36.233428 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 11:11:36.233428 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 11:11:36.233428 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 11:11:36.233428 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGczsmQNk4U50BxzpgES3MzOpQCXZXSfv8U0fcthNptdjh-xj4_PXNp1cjGhvwh0ftE8negXuLuWJgSY_-2MLUgv_DNMLspYk9lV1lwtSgINsi9nLe-7tZYJuQnQiEJ_Nrc9KtaPntdIqDspehXXUE-x22uN3GKjXVnYgVPtfdxa4_cE Sep 08 11:11:36.233428 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 11:11:36.233428 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 11:11:36.233428 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 11:11:36.233428 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 11:11:36.233428 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 11:11:36.233428 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 11:11:36.233428 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 7868787bfea94355a5d5971bab0d5ed4 Sep 08 11:11:36.233428 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersTestJSON-1882931607 Sep 08 11:11:36.233428 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 11:11:36.233428 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 11:11:36.233428 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:11:36.233428 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServersTestJSON-1882931607 Sep 08 11:11:36.233428 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 7868787bfea94355a5d5971bab0d5ed4 Sep 08 11:11:36.233428 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersTestJSON-1882931607 Sep 08 11:11:36.233428 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServersTestJSON-1882931607-project Sep 08 11:11:36.233428 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 11:11:36.233428 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 11:11:36.233428 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 5193272e9ab24845aff53982dbe2c6f0 Sep 08 11:11:36.233428 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServersTestJSON-1882931607-project Sep 08 11:11:36.233428 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 11:11:36.233428 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 3c9e4ea7-9f84-44a9-8288-27adaed61617 could not be found. Sep 08 11:11:36.233428 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '3c9e4ea7-9f84-44a9-8288-27adaed61617'} Sep 08 11:11:36.233428 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:11:36.233428 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:11:36.233428 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:11:36.233428 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:11:36.233428 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:11:36.233428 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:11:36.233428 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:11:36.233428 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:11:36.233428 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:11:36.233428 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:11:36.233428 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c9e4ea7-9f84-44a9-8288-27adaed61617 could not be found. Sep 08 11:11:36.233428 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:11:36.233428 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:11:36.233428 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:11:36.233428 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:11:36.233428 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:11:36.233428 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:11:36.233428 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:11:36.233428 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:11:36.233428 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:11:36.233428 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:11:36.233428 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:11:36.233428 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:11:36.233428 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:11:36.233428 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:11:36.233428 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:11:36.233428 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:11:36.233428 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c9e4ea7-9f84-44a9-8288-27adaed61617 could not be found. Sep 08 11:11:36.233428 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:11:36.233428 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:11:36.233428 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:11:36.238133 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:11:36.238133 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:11:36.238133 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:11:36.238133 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:11:36.238133 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:11:36.238133 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c9e4ea7-9f84-44a9-8288-27adaed61617 could not be found. Sep 08 11:11:36.238133 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:11:36.239964 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-218f634a-cf84-47d8-aa5c-a21d16106414 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Returning 404 to user: Instance 3c9e4ea7-9f84-44a9-8288-27adaed61617 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:11:36.241693 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-218f634a-cf84-47d8-aa5c-a21d16106414 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/3c9e4ea7-9f84-44a9-8288-27adaed61617" status: 404 len: 111 microversion: 2.1 time: 0.076259 Sep 08 11:11:36.246259 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2730/5566] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:36 2022] GET /compute/v2.1/servers/3c9e4ea7-9f84-44a9-8288-27adaed61617 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:11:36.251009 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-af10f10f-13a5-4d8f-9505-6cb4508cb3c9 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:36.251511 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-af10f10f-13a5-4d8f-9505-6cb4508cb3c9 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 7ed54969-4b5f-4a05-ad5a-9d675702f1c4] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:36.260426 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-af10f10f-13a5-4d8f-9505-6cb4508cb3c9 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:36.260930 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-af10f10f-13a5-4d8f-9505-6cb4508cb3c9 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:36.261393 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-af10f10f-13a5-4d8f-9505-6cb4508cb3c9 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:36.262158 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-af10f10f-13a5-4d8f-9505-6cb4508cb3c9 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:36.262555 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-af10f10f-13a5-4d8f-9505-6cb4508cb3c9 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:36.262978 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-af10f10f-13a5-4d8f-9505-6cb4508cb3c9 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:36.305764 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-af10f10f-13a5-4d8f-9505-6cb4508cb3c9 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] HTTP exception thrown: Instance 7ed54969-4b5f-4a05-ad5a-9d675702f1c4 could not be found. Sep 08 11:11:36.307561 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-af10f10f-13a5-4d8f-9505-6cb4508cb3c9 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Request method failure captured: Sep 08 11:11:36.307561 n-d-850501-12 devstack@n-api.service[128861]: request: DELETE /compute/v2.1/servers/7ed54969-4b5f-4a05-ad5a-9d675702f1c4 HTTP/1.1 Sep 08 11:11:36.307561 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:11:36.307561 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:11:36.307561 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:11:36.307561 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 11:11:36.307561 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:11:36.307561 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:11:36.307561 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:11:36.307561 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:11:36.307561 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGczsmQNk4U50BxzpgES3MzOpQCXZXSfv8U0fcthNptdjh-xj4_PXNp1cjGhvwh0ftE8negXuLuWJgSY_-2MLUgv_DNMLspYk9lV1lwtSgINsi9nLe-7tZYJuQnQiEJ_Nrc9KtaPntdIqDspehXXUE-x22uN3GKjXVnYgVPtfdxa4_cE Sep 08 11:11:36.307561 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:11:36.307561 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:11:36.307561 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:11:36.307561 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:11:36.307561 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:11:36.307561 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:11:36.307561 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 7868787bfea94355a5d5971bab0d5ed4 Sep 08 11:11:36.307561 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServersTestJSON-1882931607 Sep 08 11:11:36.307561 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:11:36.307561 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:11:36.307561 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:11:36.307561 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServersTestJSON-1882931607 Sep 08 11:11:36.307561 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 7868787bfea94355a5d5971bab0d5ed4 Sep 08 11:11:36.307561 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServersTestJSON-1882931607 Sep 08 11:11:36.307561 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServersTestJSON-1882931607-project Sep 08 11:11:36.307561 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:11:36.307561 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:11:36.307561 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 5193272e9ab24845aff53982dbe2c6f0 Sep 08 11:11:36.307561 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServersTestJSON-1882931607-project Sep 08 11:11:36.307561 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 11:11:36.307561 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 7ed54969-4b5f-4a05-ad5a-9d675702f1c4 could not be found. Sep 08 11:11:36.307561 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '7ed54969-4b5f-4a05-ad5a-9d675702f1c4'} Sep 08 11:11:36.307561 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:11:36.307561 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:11:36.307561 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:11:36.307561 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:11:36.307561 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:11:36.307561 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:11:36.307561 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:11:36.307561 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:11:36.307561 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:11:36.307561 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:11:36.307561 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ed54969-4b5f-4a05-ad5a-9d675702f1c4 could not be found. Sep 08 11:11:36.307561 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:11:36.307561 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:11:36.307561 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:11:36.307561 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:11:36.307561 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:11:36.307561 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:11:36.307561 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:11:36.307561 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:11:36.307561 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:11:36.307561 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:11:36.307561 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 11:11:36.307561 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 11:11:36.307561 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 11:11:36.307561 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 11:11:36.307561 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:11:36.307561 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:11:36.307561 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:11:36.307561 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:11:36.307561 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ed54969-4b5f-4a05-ad5a-9d675702f1c4 could not be found. Sep 08 11:11:36.312313 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:11:36.312313 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:11:36.312313 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:11:36.312313 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:11:36.312313 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:11:36.312313 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:11:36.312313 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:11:36.312313 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:11:36.312313 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ed54969-4b5f-4a05-ad5a-9d675702f1c4 could not be found. Sep 08 11:11:36.312313 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:11:36.315797 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-af10f10f-13a5-4d8f-9505-6cb4508cb3c9 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Returning 404 to user: Instance 7ed54969-4b5f-4a05-ad5a-9d675702f1c4 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:11:36.315797 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-af10f10f-13a5-4d8f-9505-6cb4508cb3c9 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7ed54969-4b5f-4a05-ad5a-9d675702f1c4" status: 404 len: 111 microversion: 2.1 time: 0.068266 Sep 08 11:11:36.315797 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2837/5567] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:11:36 2022] DELETE /compute/v2.1/servers/7ed54969-4b5f-4a05-ad5a-9d675702f1c4 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:11:36.334284 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-83d02222-67c0-4762-bba7-72fd3fc7a4c2 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:36.334921 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-83d02222-67c0-4762-bba7-72fd3fc7a4c2 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 7ed54969-4b5f-4a05-ad5a-9d675702f1c4] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:36.361362 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-83d02222-67c0-4762-bba7-72fd3fc7a4c2 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:36.362018 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-83d02222-67c0-4762-bba7-72fd3fc7a4c2 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:36.362479 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-83d02222-67c0-4762-bba7-72fd3fc7a4c2 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:36.363383 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-83d02222-67c0-4762-bba7-72fd3fc7a4c2 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:36.363856 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-83d02222-67c0-4762-bba7-72fd3fc7a4c2 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:36.364545 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-83d02222-67c0-4762-bba7-72fd3fc7a4c2 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:36.411333 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-83d02222-67c0-4762-bba7-72fd3fc7a4c2 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] HTTP exception thrown: Instance 7ed54969-4b5f-4a05-ad5a-9d675702f1c4 could not be found. Sep 08 11:11:36.411333 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-83d02222-67c0-4762-bba7-72fd3fc7a4c2 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Request method failure captured: Sep 08 11:11:36.411333 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/7ed54969-4b5f-4a05-ad5a-9d675702f1c4 HTTP/1.1 Sep 08 11:11:36.411333 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 11:11:36.411333 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 11:11:36.411333 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 11:11:36.411333 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 11:11:36.411333 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 11:11:36.411333 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 11:11:36.411333 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 11:11:36.411333 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 11:11:36.411333 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGczsmQNk4U50BxzpgES3MzOpQCXZXSfv8U0fcthNptdjh-xj4_PXNp1cjGhvwh0ftE8negXuLuWJgSY_-2MLUgv_DNMLspYk9lV1lwtSgINsi9nLe-7tZYJuQnQiEJ_Nrc9KtaPntdIqDspehXXUE-x22uN3GKjXVnYgVPtfdxa4_cE Sep 08 11:11:36.411333 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 11:11:36.411333 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 11:11:36.411333 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 11:11:36.411333 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 11:11:36.411333 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 11:11:36.411333 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 11:11:36.411333 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 7868787bfea94355a5d5971bab0d5ed4 Sep 08 11:11:36.411333 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersTestJSON-1882931607 Sep 08 11:11:36.411333 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 11:11:36.411333 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 11:11:36.411333 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:11:36.411333 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServersTestJSON-1882931607 Sep 08 11:11:36.411333 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 7868787bfea94355a5d5971bab0d5ed4 Sep 08 11:11:36.411333 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersTestJSON-1882931607 Sep 08 11:11:36.411333 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServersTestJSON-1882931607-project Sep 08 11:11:36.411333 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 11:11:36.411333 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 11:11:36.411333 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 5193272e9ab24845aff53982dbe2c6f0 Sep 08 11:11:36.411333 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServersTestJSON-1882931607-project Sep 08 11:11:36.411333 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 11:11:36.411333 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 7ed54969-4b5f-4a05-ad5a-9d675702f1c4 could not be found. Sep 08 11:11:36.411333 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '7ed54969-4b5f-4a05-ad5a-9d675702f1c4'} Sep 08 11:11:36.411333 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:11:36.411333 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:11:36.411333 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:11:36.411333 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:11:36.411333 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:11:36.411333 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:11:36.411333 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:11:36.411333 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:11:36.411333 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:11:36.411333 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:11:36.411333 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ed54969-4b5f-4a05-ad5a-9d675702f1c4 could not be found. Sep 08 11:11:36.411333 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:11:36.411333 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:11:36.411333 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:11:36.411333 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:11:36.411333 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:11:36.411333 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:11:36.411333 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:11:36.411333 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:11:36.411333 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:11:36.411333 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:11:36.411333 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:11:36.411333 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:11:36.411333 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:11:36.411333 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:11:36.411333 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:11:36.411333 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:11:36.415419 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ed54969-4b5f-4a05-ad5a-9d675702f1c4 could not be found. Sep 08 11:11:36.415419 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:11:36.415419 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:11:36.415419 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:11:36.415419 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:11:36.415419 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:11:36.415419 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:11:36.415419 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:11:36.415419 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:11:36.415419 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ed54969-4b5f-4a05-ad5a-9d675702f1c4 could not be found. Sep 08 11:11:36.415419 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:11:36.415419 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-83d02222-67c0-4762-bba7-72fd3fc7a4c2 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Returning 404 to user: Instance 7ed54969-4b5f-4a05-ad5a-9d675702f1c4 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:11:36.418140 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-83d02222-67c0-4762-bba7-72fd3fc7a4c2 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/7ed54969-4b5f-4a05-ad5a-9d675702f1c4" status: 404 len: 111 microversion: 2.1 time: 0.086512 Sep 08 11:11:36.418781 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2731/5568] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:36 2022] GET /compute/v2.1/servers/7ed54969-4b5f-4a05-ad5a-9d675702f1c4 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:11:36.427064 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-594c99f7-2f3c-43b2-886e-30d2e416c5c5 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:36.428594 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-594c99f7-2f3c-43b2-886e-30d2e416c5c5 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 3ff17681-db51-4109-a47b-d8703450df01] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:36.437362 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-594c99f7-2f3c-43b2-886e-30d2e416c5c5 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] HTTP exception thrown: Instance 3ff17681-db51-4109-a47b-d8703450df01 could not be found. Sep 08 11:11:36.439645 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-594c99f7-2f3c-43b2-886e-30d2e416c5c5 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Request method failure captured: Sep 08 11:11:36.439645 n-d-850501-12 devstack@n-api.service[128861]: request: DELETE /compute/v2.1/servers/3ff17681-db51-4109-a47b-d8703450df01 HTTP/1.1 Sep 08 11:11:36.439645 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:11:36.439645 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:11:36.439645 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:11:36.439645 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 11:11:36.439645 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:11:36.439645 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:11:36.439645 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:11:36.439645 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:11:36.439645 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGczsmQNk4U50BxzpgES3MzOpQCXZXSfv8U0fcthNptdjh-xj4_PXNp1cjGhvwh0ftE8negXuLuWJgSY_-2MLUgv_DNMLspYk9lV1lwtSgINsi9nLe-7tZYJuQnQiEJ_Nrc9KtaPntdIqDspehXXUE-x22uN3GKjXVnYgVPtfdxa4_cE Sep 08 11:11:36.439645 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:11:36.439645 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:11:36.439645 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:11:36.439645 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:11:36.439645 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:11:36.439645 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:11:36.439645 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 7868787bfea94355a5d5971bab0d5ed4 Sep 08 11:11:36.439645 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServersTestJSON-1882931607 Sep 08 11:11:36.439645 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:11:36.439645 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:11:36.439645 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:11:36.439645 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServersTestJSON-1882931607 Sep 08 11:11:36.439645 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 7868787bfea94355a5d5971bab0d5ed4 Sep 08 11:11:36.439645 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServersTestJSON-1882931607 Sep 08 11:11:36.439645 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServersTestJSON-1882931607-project Sep 08 11:11:36.439645 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:11:36.439645 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:11:36.439645 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 5193272e9ab24845aff53982dbe2c6f0 Sep 08 11:11:36.439645 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServersTestJSON-1882931607-project Sep 08 11:11:36.439645 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 11:11:36.439645 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 3ff17681-db51-4109-a47b-d8703450df01 could not be found. Sep 08 11:11:36.439645 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '3ff17681-db51-4109-a47b-d8703450df01'} Sep 08 11:11:36.439645 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:11:36.439645 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:11:36.439645 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:11:36.439645 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:11:36.439645 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:11:36.439645 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:11:36.439645 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 08 11:11:36.439645 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 08 11:11:36.439645 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ff17681-db51-4109-a47b-d8703450df01 could not be found. Sep 08 11:11:36.439645 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:11:36.439645 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:11:36.439645 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:11:36.439645 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:11:36.439645 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:11:36.439645 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:11:36.439645 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:11:36.439645 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:11:36.439645 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:11:36.439645 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:11:36.439645 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 11:11:36.439645 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 11:11:36.439645 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 11:11:36.439645 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 11:11:36.439645 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:11:36.439645 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:11:36.439645 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:11:36.439645 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:11:36.439645 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ff17681-db51-4109-a47b-d8703450df01 could not be found. Sep 08 11:11:36.439645 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:11:36.439645 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:11:36.439645 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:11:36.445441 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:11:36.445441 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:11:36.445441 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:11:36.445441 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:11:36.445441 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:11:36.445441 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ff17681-db51-4109-a47b-d8703450df01 could not be found. Sep 08 11:11:36.445441 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:11:36.447009 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-594c99f7-2f3c-43b2-886e-30d2e416c5c5 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Returning 404 to user: Instance 3ff17681-db51-4109-a47b-d8703450df01 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:11:36.448252 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-594c99f7-2f3c-43b2-886e-30d2e416c5c5 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3ff17681-db51-4109-a47b-d8703450df01" status: 404 len: 111 microversion: 2.1 time: 0.025204 Sep 08 11:11:36.449332 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2838/5569] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:11:36 2022] DELETE /compute/v2.1/servers/3ff17681-db51-4109-a47b-d8703450df01 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 11:11:36.459766 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ba653a4d-d998-41b1-9767-6f3fb90dbe67 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:36.461833 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ba653a4d-d998-41b1-9767-6f3fb90dbe67 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 3ff17681-db51-4109-a47b-d8703450df01] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:36.472989 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-ba653a4d-d998-41b1-9767-6f3fb90dbe67 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] HTTP exception thrown: Instance 3ff17681-db51-4109-a47b-d8703450df01 could not be found. Sep 08 11:11:36.475039 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ba653a4d-d998-41b1-9767-6f3fb90dbe67 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Request method failure captured: Sep 08 11:11:36.475039 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/3ff17681-db51-4109-a47b-d8703450df01 HTTP/1.1 Sep 08 11:11:36.475039 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 11:11:36.475039 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 11:11:36.475039 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 11:11:36.475039 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 11:11:36.475039 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 11:11:36.475039 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 11:11:36.475039 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 11:11:36.475039 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 11:11:36.475039 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGczsmQNk4U50BxzpgES3MzOpQCXZXSfv8U0fcthNptdjh-xj4_PXNp1cjGhvwh0ftE8negXuLuWJgSY_-2MLUgv_DNMLspYk9lV1lwtSgINsi9nLe-7tZYJuQnQiEJ_Nrc9KtaPntdIqDspehXXUE-x22uN3GKjXVnYgVPtfdxa4_cE Sep 08 11:11:36.475039 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 11:11:36.475039 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 11:11:36.475039 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 11:11:36.475039 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 11:11:36.475039 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 11:11:36.475039 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 11:11:36.475039 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 7868787bfea94355a5d5971bab0d5ed4 Sep 08 11:11:36.475039 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersTestJSON-1882931607 Sep 08 11:11:36.475039 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 11:11:36.475039 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 11:11:36.475039 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:11:36.475039 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServersTestJSON-1882931607 Sep 08 11:11:36.475039 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 7868787bfea94355a5d5971bab0d5ed4 Sep 08 11:11:36.475039 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersTestJSON-1882931607 Sep 08 11:11:36.475039 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServersTestJSON-1882931607-project Sep 08 11:11:36.475039 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 11:11:36.475039 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 11:11:36.475039 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 5193272e9ab24845aff53982dbe2c6f0 Sep 08 11:11:36.475039 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServersTestJSON-1882931607-project Sep 08 11:11:36.475039 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 11:11:36.475039 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 3ff17681-db51-4109-a47b-d8703450df01 could not be found. Sep 08 11:11:36.475039 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '3ff17681-db51-4109-a47b-d8703450df01'} Sep 08 11:11:36.475039 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:11:36.475039 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:11:36.475039 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:11:36.475039 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:11:36.475039 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:11:36.475039 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:11:36.475039 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 08 11:11:36.475039 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 08 11:11:36.475039 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ff17681-db51-4109-a47b-d8703450df01 could not be found. Sep 08 11:11:36.475039 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:11:36.475039 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:11:36.475039 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:11:36.475039 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:11:36.475039 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:11:36.475039 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:11:36.475039 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:11:36.475039 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:11:36.475039 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:11:36.475039 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:11:36.475039 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:11:36.475039 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:11:36.475039 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:11:36.475039 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:11:36.475039 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:11:36.475039 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:11:36.475039 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ff17681-db51-4109-a47b-d8703450df01 could not be found. Sep 08 11:11:36.475039 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:11:36.475039 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:11:36.475039 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:11:36.475039 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:11:36.475039 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:11:36.480198 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:11:36.480198 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:11:36.480198 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:11:36.480198 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ff17681-db51-4109-a47b-d8703450df01 could not be found. Sep 08 11:11:36.480198 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:11:36.480198 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ba653a4d-d998-41b1-9767-6f3fb90dbe67 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Returning 404 to user: Instance 3ff17681-db51-4109-a47b-d8703450df01 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:11:36.480198 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ba653a4d-d998-41b1-9767-6f3fb90dbe67 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/3ff17681-db51-4109-a47b-d8703450df01" status: 404 len: 111 microversion: 2.1 time: 0.022367 Sep 08 11:11:36.481461 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2732/5570] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:36 2022] GET /compute/v2.1/servers/3ff17681-db51-4109-a47b-d8703450df01 => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:11:36.489733 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-476d4986-e13b-4767-8810-4f399d121096 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:36.492001 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-476d4986-e13b-4767-8810-4f399d121096 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 7821851a-f9fb-4995-892d-8637b07067f8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:36.502590 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-476d4986-e13b-4767-8810-4f399d121096 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:36.503141 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-476d4986-e13b-4767-8810-4f399d121096 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:36.503594 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-476d4986-e13b-4767-8810-4f399d121096 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:36.504325 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-476d4986-e13b-4767-8810-4f399d121096 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:36.504972 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-476d4986-e13b-4767-8810-4f399d121096 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:36.505582 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-476d4986-e13b-4767-8810-4f399d121096 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:36.547195 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-476d4986-e13b-4767-8810-4f399d121096 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 7821851a-f9fb-4995-892d-8637b07067f8] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:11:36.573324 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9170f0fd-a859-4d48-943c-bc59b189234c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-265303216", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2bfad326-f67a-49aa-87be-58dceddd9ab8"}], "security_groups": [{"name": "tempest-securitygroup--1868252399"}], "key_name": "tempest-keypair-656849058", "user_data": "}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:11:36.779715 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-476d4986-e13b-4767-8810-4f399d121096 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7821851a-f9fb-4995-892d-8637b07067f8" status: 204 len: 0 microversion: 2.1 time: 0.294037 Sep 08 11:11:36.784033 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2839/5571] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:11:36 2022] DELETE /compute/v2.1/servers/7821851a-f9fb-4995-892d-8637b07067f8 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:11:36.794706 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0d307ffd-8106-4431-9414-8c42a8ded5d6 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:36.802500 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0d307ffd-8106-4431-9414-8c42a8ded5d6 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 7821851a-f9fb-4995-892d-8637b07067f8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:36.810777 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d307ffd-8106-4431-9414-8c42a8ded5d6 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:36.811320 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d307ffd-8106-4431-9414-8c42a8ded5d6 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:36.811570 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-9170f0fd-a859-4d48-943c-bc59b189234c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] validate_networks() for [('2bfad326-f67a-49aa-87be-58dceddd9ab8', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:11:36.811760 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d307ffd-8106-4431-9414-8c42a8ded5d6 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:36.812480 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d307ffd-8106-4431-9414-8c42a8ded5d6 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:36.812936 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d307ffd-8106-4431-9414-8c42a8ded5d6 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:36.813598 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d307ffd-8106-4431-9414-8c42a8ded5d6 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:36.998473 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0d307ffd-8106-4431-9414-8c42a8ded5d6 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:37.004819 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:11:37.014245 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0d307ffd-8106-4431-9414-8c42a8ded5d6 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/7821851a-f9fb-4995-892d-8637b07067f8" status: 200 len: 1478 microversion: 2.1 time: 0.224452 Sep 08 11:11:37.014849 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2840/5572] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:36 2022] GET /compute/v2.1/servers/7821851a-f9fb-4995-892d-8637b07067f8 => generated 1478 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:11:37.508615 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-9170f0fd-a859-4d48-943c-bc59b189234c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:11:37.522403 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-9170f0fd-a859-4d48-943c-bc59b189234c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:11:37.523204 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-9170f0fd-a859-4d48-943c-bc59b189234c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:11:37.523644 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-9170f0fd-a859-4d48-943c-bc59b189234c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:11:37.524075 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-9170f0fd-a859-4d48-943c-bc59b189234c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:11:37.550430 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9170f0fd-a859-4d48-943c-bc59b189234c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:37.551154 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9170f0fd-a859-4d48-943c-bc59b189234c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:37.551499 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9170f0fd-a859-4d48-943c-bc59b189234c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:37.552259 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9170f0fd-a859-4d48-943c-bc59b189234c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:37.560318 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9170f0fd-a859-4d48-943c-bc59b189234c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:37.560318 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9170f0fd-a859-4d48-943c-bc59b189234c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:37.610891 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-9170f0fd-a859-4d48-943c-bc59b189234c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Getting quotas for project 364c37fba48647df9953911ecaa86e73. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:11:37.620695 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-9170f0fd-a859-4d48-943c-bc59b189234c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Getting quotas for user 2e0da79f00a24cdb9312036aa4137aa0 and project 364c37fba48647df9953911ecaa86e73. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:11:37.640284 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9170f0fd-a859-4d48-943c-bc59b189234c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:11:37.643528 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9170f0fd-a859-4d48-943c-bc59b189234c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:11:37.722593 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9170f0fd-a859-4d48-943c-bc59b189234c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.154593 Sep 08 11:11:37.723616 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2733/5573] 10.222.0.27 () {62 vars in 1188 bytes} [Thu Sep 8 11:11:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 1156 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 08 11:11:37.736358 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d28553a2-fcf2-459c-acb9-a1e9bf8b51f4 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:37.737681 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d28553a2-fcf2-459c-acb9-a1e9bf8b51f4 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:37.829094 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d28553a2-fcf2-459c-acb9-a1e9bf8b51f4 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:37.840529 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d28553a2-fcf2-459c-acb9-a1e9bf8b51f4 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:37.842035 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d28553a2-fcf2-459c-acb9-a1e9bf8b51f4 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:37.843544 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d28553a2-fcf2-459c-acb9-a1e9bf8b51f4 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e" status: 200 len: 1280 microversion: 2.20 time: 0.111819 Sep 08 11:11:37.844626 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2841/5574] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:11:37 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e => generated 1280 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:11:38.045738 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e9d317e7-2021-48ba-a3e9-2feda8646403 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:38.047545 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e9d317e7-2021-48ba-a3e9-2feda8646403 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 7821851a-f9fb-4995-892d-8637b07067f8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:38.098091 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9d317e7-2021-48ba-a3e9-2feda8646403 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:38.100398 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9d317e7-2021-48ba-a3e9-2feda8646403 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:38.102418 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9d317e7-2021-48ba-a3e9-2feda8646403 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:38.109376 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9d317e7-2021-48ba-a3e9-2feda8646403 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:38.110396 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9d317e7-2021-48ba-a3e9-2feda8646403 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:38.111219 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9d317e7-2021-48ba-a3e9-2feda8646403 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:38.479050 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e9d317e7-2021-48ba-a3e9-2feda8646403 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:38.493098 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e9d317e7-2021-48ba-a3e9-2feda8646403 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/7821851a-f9fb-4995-892d-8637b07067f8" status: 200 len: 1478 microversion: 2.1 time: 0.454888 Sep 08 11:11:38.494853 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2734/5575] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:38 2022] GET /compute/v2.1/servers/7821851a-f9fb-4995-892d-8637b07067f8 => generated 1478 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:11:38.874475 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ae58bd31-df2d-4690-bc2f-765fdc07d2c1 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:38.902431 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ae58bd31-df2d-4690-bc2f-765fdc07d2c1 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:38.963526 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ae58bd31-df2d-4690-bc2f-765fdc07d2c1 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:38.967855 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ae58bd31-df2d-4690-bc2f-765fdc07d2c1 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:38.968368 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ae58bd31-df2d-4690-bc2f-765fdc07d2c1 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:38.973291 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ae58bd31-df2d-4690-bc2f-765fdc07d2c1 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:38.974074 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ae58bd31-df2d-4690-bc2f-765fdc07d2c1 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:38.974968 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ae58bd31-df2d-4690-bc2f-765fdc07d2c1 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:39.158170 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ae58bd31-df2d-4690-bc2f-765fdc07d2c1 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:39.178598 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-e504d8be-aa19-441e-9750-6bf7a4ca454b req-9062ff04-e290-44ce-9ad1-de7a863ac5c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7821851a-f9fb-4995-892d-8637b07067f8", "name": "network-vif-deleted", "tag": "c3ffbffa-35c1-4da6-9441-977c449724b3"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:11:39.183178 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ae58bd31-df2d-4690-bc2f-765fdc07d2c1 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:39.191833 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ae58bd31-df2d-4690-bc2f-765fdc07d2c1 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:39.193176 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ae58bd31-df2d-4690-bc2f-765fdc07d2c1 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e" status: 200 len: 1284 microversion: 2.20 time: 0.324301 Sep 08 11:11:39.193627 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e504d8be-aa19-441e-9750-6bf7a4ca454b req-9062ff04-e290-44ce-9ad1-de7a863ac5c6 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:39.194310 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e504d8be-aa19-441e-9750-6bf7a4ca454b req-9062ff04-e290-44ce-9ad1-de7a863ac5c6 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:39.194912 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e504d8be-aa19-441e-9750-6bf7a4ca454b req-9062ff04-e290-44ce-9ad1-de7a863ac5c6 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:39.210658 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-e504d8be-aa19-441e-9750-6bf7a4ca454b req-9062ff04-e290-44ce-9ad1-de7a863ac5c6 service nova] Creating event network-vif-deleted:c3ffbffa-35c1-4da6-9441-977c449724b3 for instance 7821851a-f9fb-4995-892d-8637b07067f8 on n-h1-850501-12 Sep 08 11:11:39.220162 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2842/5576] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:11:38 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e => generated 1284 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:11:39.225407 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-e504d8be-aa19-441e-9750-6bf7a4ca454b req-9062ff04-e290-44ce-9ad1-de7a863ac5c6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051412 Sep 08 11:11:39.226453 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2735/5577] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:11:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:11:39.517117 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2557958d-4b5e-40ca-adbe-fe382f31a9c3 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:39.518307 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2557958d-4b5e-40ca-adbe-fe382f31a9c3 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 7821851a-f9fb-4995-892d-8637b07067f8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:39.529118 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2557958d-4b5e-40ca-adbe-fe382f31a9c3 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:39.531067 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2557958d-4b5e-40ca-adbe-fe382f31a9c3 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:39.537622 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2557958d-4b5e-40ca-adbe-fe382f31a9c3 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:39.541402 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2557958d-4b5e-40ca-adbe-fe382f31a9c3 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:39.541963 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2557958d-4b5e-40ca-adbe-fe382f31a9c3 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:39.542574 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2557958d-4b5e-40ca-adbe-fe382f31a9c3 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:39.652715 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2557958d-4b5e-40ca-adbe-fe382f31a9c3 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:39.653275 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2557958d-4b5e-40ca-adbe-fe382f31a9c3 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:39.653719 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2557958d-4b5e-40ca-adbe-fe382f31a9c3 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:39.654179 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-2557958d-4b5e-40ca-adbe-fe382f31a9c3 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lazy-loading 'fault' on Instance uuid 7821851a-f9fb-4995-892d-8637b07067f8 {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:11:39.827274 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2557958d-4b5e-40ca-adbe-fe382f31a9c3 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5193272e9ab24845aff53982dbe2c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7868787bfea94355a5d5971bab0d5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:39.856631 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2557958d-4b5e-40ca-adbe-fe382f31a9c3 tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/7821851a-f9fb-4995-892d-8637b07067f8" status: 200 len: 1281 microversion: 2.1 time: 0.343499 Sep 08 11:11:39.874489 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2843/5578] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:39 2022] GET /compute/v2.1/servers/7821851a-f9fb-4995-892d-8637b07067f8 => generated 1281 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:11:40.220911 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b27fcf81-15c2-4d85-ad66-88d7af052499 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:40.221730 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b27fcf81-15c2-4d85-ad66-88d7af052499 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:40.235304 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b27fcf81-15c2-4d85-ad66-88d7af052499 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:40.243593 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b27fcf81-15c2-4d85-ad66-88d7af052499 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:40.244171 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b27fcf81-15c2-4d85-ad66-88d7af052499 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:40.245065 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b27fcf81-15c2-4d85-ad66-88d7af052499 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:40.250559 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b27fcf81-15c2-4d85-ad66-88d7af052499 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:40.251110 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b27fcf81-15c2-4d85-ad66-88d7af052499 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:40.378583 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b27fcf81-15c2-4d85-ad66-88d7af052499 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:40.395612 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b27fcf81-15c2-4d85-ad66-88d7af052499 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:40.398494 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b27fcf81-15c2-4d85-ad66-88d7af052499 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:40.401600 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b27fcf81-15c2-4d85-ad66-88d7af052499 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e" status: 200 len: 1350 microversion: 2.20 time: 0.187257 Sep 08 11:11:40.402728 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2736/5579] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:11:40 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e => generated 1350 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:11:40.903996 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1b648d1b-8788-4320-a8aa-5904cbab9c3e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:40.904657 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1b648d1b-8788-4320-a8aa-5904cbab9c3e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] [instance: 7821851a-f9fb-4995-892d-8637b07067f8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:40.947664 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1b648d1b-8788-4320-a8aa-5904cbab9c3e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:40.948541 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1b648d1b-8788-4320-a8aa-5904cbab9c3e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:40.949283 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1b648d1b-8788-4320-a8aa-5904cbab9c3e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:40.951555 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1b648d1b-8788-4320-a8aa-5904cbab9c3e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:40.955977 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1b648d1b-8788-4320-a8aa-5904cbab9c3e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:40.956690 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1b648d1b-8788-4320-a8aa-5904cbab9c3e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:41.000220 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-1b648d1b-8788-4320-a8aa-5904cbab9c3e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] HTTP exception thrown: Instance 7821851a-f9fb-4995-892d-8637b07067f8 could not be found. Sep 08 11:11:41.002618 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1b648d1b-8788-4320-a8aa-5904cbab9c3e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Request method failure captured: Sep 08 11:11:41.002618 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/7821851a-f9fb-4995-892d-8637b07067f8 HTTP/1.1 Sep 08 11:11:41.002618 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:11:41.002618 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:11:41.002618 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:11:41.002618 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 11:11:41.002618 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:11:41.002618 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:11:41.002618 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:11:41.002618 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:11:41.002618 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGczsmQNk4U50BxzpgES3MzOpQCXZXSfv8U0fcthNptdjh-xj4_PXNp1cjGhvwh0ftE8negXuLuWJgSY_-2MLUgv_DNMLspYk9lV1lwtSgINsi9nLe-7tZYJuQnQiEJ_Nrc9KtaPntdIqDspehXXUE-x22uN3GKjXVnYgVPtfdxa4_cE Sep 08 11:11:41.002618 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:11:41.002618 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:11:41.002618 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:11:41.002618 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:11:41.002618 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:11:41.002618 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:11:41.002618 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 7868787bfea94355a5d5971bab0d5ed4 Sep 08 11:11:41.002618 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServersTestJSON-1882931607 Sep 08 11:11:41.002618 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:11:41.002618 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:11:41.002618 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7868787bfea94355a5d5971bab0d5ed4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:11:41.002618 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServersTestJSON-1882931607 Sep 08 11:11:41.002618 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 7868787bfea94355a5d5971bab0d5ed4 Sep 08 11:11:41.002618 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServersTestJSON-1882931607 Sep 08 11:11:41.002618 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServersTestJSON-1882931607-project Sep 08 11:11:41.002618 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:11:41.002618 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:11:41.002618 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 5193272e9ab24845aff53982dbe2c6f0 Sep 08 11:11:41.002618 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServersTestJSON-1882931607-project Sep 08 11:11:41.002618 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 11:11:41.002618 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 7821851a-f9fb-4995-892d-8637b07067f8 could not be found. Sep 08 11:11:41.002618 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '7821851a-f9fb-4995-892d-8637b07067f8'} Sep 08 11:11:41.002618 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:11:41.002618 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:11:41.002618 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:11:41.002618 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:11:41.002618 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:11:41.002618 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:11:41.002618 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:11:41.002618 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:11:41.002618 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:11:41.002618 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:11:41.002618 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7821851a-f9fb-4995-892d-8637b07067f8 could not be found. Sep 08 11:11:41.002618 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:11:41.002618 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:11:41.002618 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:11:41.002618 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:11:41.002618 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:11:41.002618 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:11:41.002618 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:11:41.002618 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:11:41.002618 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:11:41.002618 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:11:41.002618 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:11:41.002618 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:11:41.002618 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:11:41.002618 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:11:41.002618 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:11:41.002618 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:11:41.002618 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7821851a-f9fb-4995-892d-8637b07067f8 could not be found. Sep 08 11:11:41.002618 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:11:41.002618 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:11:41.002618 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:11:41.008098 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:11:41.008098 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:11:41.008098 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:11:41.008098 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:11:41.008098 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:11:41.008098 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7821851a-f9fb-4995-892d-8637b07067f8 could not be found. Sep 08 11:11:41.008098 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:11:41.009468 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1b648d1b-8788-4320-a8aa-5904cbab9c3e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] Returning 404 to user: Instance 7821851a-f9fb-4995-892d-8637b07067f8 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:11:41.010525 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1b648d1b-8788-4320-a8aa-5904cbab9c3e tempest-ServersTestJSON-1882931607 tempest-ServersTestJSON-1882931607-project] 10.222.0.27 "GET /compute/v2.1/servers/7821851a-f9fb-4995-892d-8637b07067f8" status: 404 len: 111 microversion: 2.1 time: 0.116995 Sep 08 11:11:41.011596 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2844/5580] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:40 2022] GET /compute/v2.1/servers/7821851a-f9fb-4995-892d-8637b07067f8 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:11:41.434907 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0845dece-0d8a-49c3-af8a-7873d1f7bb92 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:41.436127 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0845dece-0d8a-49c3-af8a-7873d1f7bb92 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:41.457102 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0845dece-0d8a-49c3-af8a-7873d1f7bb92 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:41.457937 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0845dece-0d8a-49c3-af8a-7873d1f7bb92 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:41.459125 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0845dece-0d8a-49c3-af8a-7873d1f7bb92 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:41.461382 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0845dece-0d8a-49c3-af8a-7873d1f7bb92 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:41.462024 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0845dece-0d8a-49c3-af8a-7873d1f7bb92 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:41.462990 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0845dece-0d8a-49c3-af8a-7873d1f7bb92 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:41.668445 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0845dece-0d8a-49c3-af8a-7873d1f7bb92 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:41.696400 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0845dece-0d8a-49c3-af8a-7873d1f7bb92 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:41.709524 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0845dece-0d8a-49c3-af8a-7873d1f7bb92 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:41.713230 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0845dece-0d8a-49c3-af8a-7873d1f7bb92 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e" status: 200 len: 1338 microversion: 2.20 time: 0.282859 Sep 08 11:11:41.715866 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2737/5581] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:11:41 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e => generated 1338 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:11:42.739641 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-af10237a-85d7-4c6d-ac35-aa73882992f0 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:42.741596 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-af10237a-85d7-4c6d-ac35-aa73882992f0 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:42.755367 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-af10237a-85d7-4c6d-ac35-aa73882992f0 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:42.765372 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-af10237a-85d7-4c6d-ac35-aa73882992f0 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:42.766209 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-af10237a-85d7-4c6d-ac35-aa73882992f0 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:42.768511 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-af10237a-85d7-4c6d-ac35-aa73882992f0 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:42.771029 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-af10237a-85d7-4c6d-ac35-aa73882992f0 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:42.771789 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-af10237a-85d7-4c6d-ac35-aa73882992f0 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:43.790194 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-af10237a-85d7-4c6d-ac35-aa73882992f0 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:43.814252 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-af10237a-85d7-4c6d-ac35-aa73882992f0 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:43.816323 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-af10237a-85d7-4c6d-ac35-aa73882992f0 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:43.818961 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-af10237a-85d7-4c6d-ac35-aa73882992f0 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e" status: 200 len: 1406 microversion: 2.20 time: 1.083093 Sep 08 11:11:43.820292 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2845/5582] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:11:42 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e => generated 1406 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:11:44.142339 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-8a4c886c-b077-41ad-93f6-c16e80aab653 req-667f0349-766d-4b15-908b-c3f9a9506e7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9c23be4-60f4-4bff-9e0d-8040618b552e", "tag": "0dcde267-c491-450a-894c-03db6d80d8ff"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:11:44.165235 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-8a4c886c-b077-41ad-93f6-c16e80aab653 req-667f0349-766d-4b15-908b-c3f9a9506e7d service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:44.166627 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-8a4c886c-b077-41ad-93f6-c16e80aab653 req-667f0349-766d-4b15-908b-c3f9a9506e7d service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:44.167172 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-8a4c886c-b077-41ad-93f6-c16e80aab653 req-667f0349-766d-4b15-908b-c3f9a9506e7d service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:44.192386 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-8a4c886c-b077-41ad-93f6-c16e80aab653 req-667f0349-766d-4b15-908b-c3f9a9506e7d service nova] Creating event network-changed:0dcde267-c491-450a-894c-03db6d80d8ff for instance f9c23be4-60f4-4bff-9e0d-8040618b552e on n-h1-850501-12 Sep 08 11:11:44.199209 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-8a4c886c-b077-41ad-93f6-c16e80aab653 req-667f0349-766d-4b15-908b-c3f9a9506e7d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061899 Sep 08 11:11:44.200299 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2738/5583] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:11:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:11:44.845564 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-563506d2-bb9f-41a1-bdaa-8d6c8847c1ad tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:44.846215 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-563506d2-bb9f-41a1-bdaa-8d6c8847c1ad tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:44.864827 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-563506d2-bb9f-41a1-bdaa-8d6c8847c1ad tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:44.865697 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-563506d2-bb9f-41a1-bdaa-8d6c8847c1ad tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:44.873636 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-563506d2-bb9f-41a1-bdaa-8d6c8847c1ad tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:44.874681 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-563506d2-bb9f-41a1-bdaa-8d6c8847c1ad tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:44.875201 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-563506d2-bb9f-41a1-bdaa-8d6c8847c1ad tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:44.875641 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-563506d2-bb9f-41a1-bdaa-8d6c8847c1ad tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:45.344313 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-563506d2-bb9f-41a1-bdaa-8d6c8847c1ad tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:45.354001 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-563506d2-bb9f-41a1-bdaa-8d6c8847c1ad tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:45.359669 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-563506d2-bb9f-41a1-bdaa-8d6c8847c1ad tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:45.362827 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-563506d2-bb9f-41a1-bdaa-8d6c8847c1ad tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e" status: 200 len: 1406 microversion: 2.20 time: 0.521394 Sep 08 11:11:45.368110 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2846/5584] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:11:44 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e => generated 1406 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 11:11:46.402312 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d853a239-09b1-4922-b79c-b17ce2b81f88 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:46.404024 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d853a239-09b1-4922-b79c-b17ce2b81f88 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:46.413221 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d853a239-09b1-4922-b79c-b17ce2b81f88 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:46.414537 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d853a239-09b1-4922-b79c-b17ce2b81f88 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:46.446054 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d853a239-09b1-4922-b79c-b17ce2b81f88 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:46.453866 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d853a239-09b1-4922-b79c-b17ce2b81f88 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:46.454693 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d853a239-09b1-4922-b79c-b17ce2b81f88 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:46.457953 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d853a239-09b1-4922-b79c-b17ce2b81f88 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:47.585883 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:11:47.621532 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d853a239-09b1-4922-b79c-b17ce2b81f88 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:47.632712 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=10 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:11:47.646233 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d853a239-09b1-4922-b79c-b17ce2b81f88 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:47.648197 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d853a239-09b1-4922-b79c-b17ce2b81f88 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:47.654125 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d853a239-09b1-4922-b79c-b17ce2b81f88 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e" status: 200 len: 1406 microversion: 2.20 time: 1.260158 Sep 08 11:11:47.656151 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2739/5585] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:11:46 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e => generated 1406 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:11:48.691800 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-df0099a6-b26b-4f03-a2f5-8e1443c16c96 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:48.692596 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-df0099a6-b26b-4f03-a2f5-8e1443c16c96 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:48.704046 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:11:48.738641 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-df0099a6-b26b-4f03-a2f5-8e1443c16c96 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:48.749671 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-df0099a6-b26b-4f03-a2f5-8e1443c16c96 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:48.750138 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-df0099a6-b26b-4f03-a2f5-8e1443c16c96 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:48.761670 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-df0099a6-b26b-4f03-a2f5-8e1443c16c96 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:48.762222 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-df0099a6-b26b-4f03-a2f5-8e1443c16c96 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:48.762687 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-df0099a6-b26b-4f03-a2f5-8e1443c16c96 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:49.303726 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-df0099a6-b26b-4f03-a2f5-8e1443c16c96 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:49.318412 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-df0099a6-b26b-4f03-a2f5-8e1443c16c96 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:49.319900 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-df0099a6-b26b-4f03-a2f5-8e1443c16c96 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:49.324124 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-df0099a6-b26b-4f03-a2f5-8e1443c16c96 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e" status: 200 len: 1406 microversion: 2.20 time: 0.647400 Sep 08 11:11:49.341455 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2847/5586] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:11:48 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e => generated 1406 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:11:50.355915 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-786f0e64-44f2-4e21-8fdd-3933116e5ff4 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:50.356531 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-786f0e64-44f2-4e21-8fdd-3933116e5ff4 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:50.359943 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=4 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:11:50.374538 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-786f0e64-44f2-4e21-8fdd-3933116e5ff4 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:50.375430 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-786f0e64-44f2-4e21-8fdd-3933116e5ff4 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:50.376181 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-786f0e64-44f2-4e21-8fdd-3933116e5ff4 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:50.377813 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-786f0e64-44f2-4e21-8fdd-3933116e5ff4 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:50.378466 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-786f0e64-44f2-4e21-8fdd-3933116e5ff4 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:50.379062 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-786f0e64-44f2-4e21-8fdd-3933116e5ff4 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:50.738310 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-786f0e64-44f2-4e21-8fdd-3933116e5ff4 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:50.758766 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-786f0e64-44f2-4e21-8fdd-3933116e5ff4 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:50.769209 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-786f0e64-44f2-4e21-8fdd-3933116e5ff4 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:50.769769 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-786f0e64-44f2-4e21-8fdd-3933116e5ff4 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e" status: 200 len: 1406 microversion: 2.20 time: 0.417882 Sep 08 11:11:50.770390 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2740/5587] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:11:50 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e => generated 1406 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:11:50.877003 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-e3a8f59d-bade-4dd1-8878-8ff7d53ad7fc req-f56b94fd-eb27-438a-8b56-c38e6ead8834 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9c23be4-60f4-4bff-9e0d-8040618b552e", "name": "network-vif-plugged", "status": "completed", "tag": "0dcde267-c491-450a-894c-03db6d80d8ff"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:11:50.910711 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-e3a8f59d-bade-4dd1-8878-8ff7d53ad7fc req-f56b94fd-eb27-438a-8b56-c38e6ead8834 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:50.915118 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-e3a8f59d-bade-4dd1-8878-8ff7d53ad7fc req-f56b94fd-eb27-438a-8b56-c38e6ead8834 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:50.917835 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-e3a8f59d-bade-4dd1-8878-8ff7d53ad7fc req-f56b94fd-eb27-438a-8b56-c38e6ead8834 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:50.953426 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-e3a8f59d-bade-4dd1-8878-8ff7d53ad7fc req-f56b94fd-eb27-438a-8b56-c38e6ead8834 service nova] Creating event network-vif-plugged:0dcde267-c491-450a-894c-03db6d80d8ff for instance f9c23be4-60f4-4bff-9e0d-8040618b552e on n-h1-850501-12 Sep 08 11:11:50.964276 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-e3a8f59d-bade-4dd1-8878-8ff7d53ad7fc req-f56b94fd-eb27-438a-8b56-c38e6ead8834 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093117 Sep 08 11:11:50.964907 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2848/5588] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:11:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:11:51.731711 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cb9b45a9-2be2-4235-972a-cc50ada62b6a tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-659482188", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": "none"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:11:51.810774 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-97ef9f29-e185-4e3f-a151-03bd92882f65 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:51.811719 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-97ef9f29-e185-4e3f-a151-03bd92882f65 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:51.823499 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-97ef9f29-e185-4e3f-a151-03bd92882f65 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:51.829349 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-97ef9f29-e185-4e3f-a151-03bd92882f65 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:51.829980 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-97ef9f29-e185-4e3f-a151-03bd92882f65 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:51.831008 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-97ef9f29-e185-4e3f-a151-03bd92882f65 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:51.831185 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-cb9b45a9-2be2-4235-972a-cc50ada62b6a tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:11:51.831550 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-cb9b45a9-2be2-4235-972a-cc50ada62b6a tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:11:51.831743 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-97ef9f29-e185-4e3f-a151-03bd92882f65 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:51.832441 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-cb9b45a9-2be2-4235-972a-cc50ada62b6a tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:11:51.832653 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-97ef9f29-e185-4e3f-a151-03bd92882f65 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:51.832863 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-cb9b45a9-2be2-4235-972a-cc50ada62b6a tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:11:51.833365 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-cb9b45a9-2be2-4235-972a-cc50ada62b6a tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:11:51.853836 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb9b45a9-2be2-4235-972a-cc50ada62b6a tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:51.856121 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb9b45a9-2be2-4235-972a-cc50ada62b6a tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:51.856871 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb9b45a9-2be2-4235-972a-cc50ada62b6a tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:51.857687 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb9b45a9-2be2-4235-972a-cc50ada62b6a tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:51.858162 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb9b45a9-2be2-4235-972a-cc50ada62b6a tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:51.858602 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb9b45a9-2be2-4235-972a-cc50ada62b6a tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:51.902028 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-cb9b45a9-2be2-4235-972a-cc50ada62b6a tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Getting quotas for project c071fd644d3f490294520a07946f9ed9. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:11:51.914138 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-cb9b45a9-2be2-4235-972a-cc50ada62b6a tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Getting quotas for user 0aa6292046a04e38bc419b707919df92 and project c071fd644d3f490294520a07946f9ed9. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:11:51.970389 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cb9b45a9-2be2-4235-972a-cc50ada62b6a tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:11:51.978039 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cb9b45a9-2be2-4235-972a-cc50ada62b6a tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] [instance: 0316b49d-d664-44c6-b57c-f84d163bfd0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:11:52.134648 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cb9b45a9-2be2-4235-972a-cc50ada62b6a tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.751175 Sep 08 11:11:52.136213 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2741/5589] 10.222.0.27 () {62 vars in 1188 bytes} [Thu Sep 8 11:11:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 761 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 08 11:11:52.149918 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-480019cc-c0f3-4591-af9f-01967f5549ff tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:52.151167 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-480019cc-c0f3-4591-af9f-01967f5549ff tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] [instance: 0316b49d-d664-44c6-b57c-f84d163bfd0d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:52.216782 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-97ef9f29-e185-4e3f-a151-03bd92882f65 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:52.258530 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-97ef9f29-e185-4e3f-a151-03bd92882f65 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:52.291325 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-97ef9f29-e185-4e3f-a151-03bd92882f65 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:52.299925 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-97ef9f29-e185-4e3f-a151-03bd92882f65 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e" status: 200 len: 1406 microversion: 2.20 time: 0.503461 Sep 08 11:11:52.305822 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2849/5590] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:11:51 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e => generated 1406 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 11:11:52.354913 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-480019cc-c0f3-4591-af9f-01967f5549ff tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:52.376478 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-480019cc-c0f3-4591-af9f-01967f5549ff tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:52.382748 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-480019cc-c0f3-4591-af9f-01967f5549ff tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:52.383969 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-480019cc-c0f3-4591-af9f-01967f5549ff tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] 10.222.0.27 "GET /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d" status: 200 len: 1277 microversion: 2.57 time: 0.240458 Sep 08 11:11:52.384566 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2742/5591] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:11:52 2022] GET /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d => generated 1277 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 11:11:53.333266 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f6c83e6e-c8a9-4f17-9892-d0c9a72d4223 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:53.334269 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f6c83e6e-c8a9-4f17-9892-d0c9a72d4223 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:53.352188 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f6c83e6e-c8a9-4f17-9892-d0c9a72d4223 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:53.353519 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f6c83e6e-c8a9-4f17-9892-d0c9a72d4223 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:53.354199 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f6c83e6e-c8a9-4f17-9892-d0c9a72d4223 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:53.356350 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f6c83e6e-c8a9-4f17-9892-d0c9a72d4223 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:53.359234 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f6c83e6e-c8a9-4f17-9892-d0c9a72d4223 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:53.405838 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f6c83e6e-c8a9-4f17-9892-d0c9a72d4223 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:53.419939 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d6520019-7ad4-475f-96e0-e89de643bf10 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:53.420568 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d6520019-7ad4-475f-96e0-e89de643bf10 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] [instance: 0316b49d-d664-44c6-b57c-f84d163bfd0d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:53.433088 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d6520019-7ad4-475f-96e0-e89de643bf10 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:53.433598 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d6520019-7ad4-475f-96e0-e89de643bf10 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:53.445818 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d6520019-7ad4-475f-96e0-e89de643bf10 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:53.447648 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d6520019-7ad4-475f-96e0-e89de643bf10 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:53.448151 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d6520019-7ad4-475f-96e0-e89de643bf10 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:53.448604 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d6520019-7ad4-475f-96e0-e89de643bf10 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:53.602724 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d6520019-7ad4-475f-96e0-e89de643bf10 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:53.616978 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d6520019-7ad4-475f-96e0-e89de643bf10 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:53.619784 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d6520019-7ad4-475f-96e0-e89de643bf10 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:53.621404 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d6520019-7ad4-475f-96e0-e89de643bf10 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] 10.222.0.27 "GET /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d" status: 200 len: 1273 microversion: 2.57 time: 0.205597 Sep 08 11:11:53.622611 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2743/5592] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:11:53 2022] GET /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d => generated 1273 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 11:11:53.813372 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f6c83e6e-c8a9-4f17-9892-d0c9a72d4223 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:53.826634 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f6c83e6e-c8a9-4f17-9892-d0c9a72d4223 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:53.828114 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f6c83e6e-c8a9-4f17-9892-d0c9a72d4223 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:53.835773 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f6c83e6e-c8a9-4f17-9892-d0c9a72d4223 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e" status: 200 len: 1597 microversion: 2.20 time: 0.507323 Sep 08 11:11:53.836420 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2850/5593] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:11:53 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e => generated 1597 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:11:53.870358 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4975752d-7285-44fb-bd74-ce3699bc4a8f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:53.874820 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4975752d-7285-44fb-bd74-ce3699bc4a8f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:53.909922 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4975752d-7285-44fb-bd74-ce3699bc4a8f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:53.953800 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4975752d-7285-44fb-bd74-ce3699bc4a8f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:53.956552 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4975752d-7285-44fb-bd74-ce3699bc4a8f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:53.959746 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4975752d-7285-44fb-bd74-ce3699bc4a8f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:53.962835 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4975752d-7285-44fb-bd74-ce3699bc4a8f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:53.966311 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4975752d-7285-44fb-bd74-ce3699bc4a8f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:54.103896 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4975752d-7285-44fb-bd74-ce3699bc4a8f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.242094 Sep 08 11:11:54.105668 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2744/5594] 10.222.0.27 () {60 vars in 1316 bytes} [Thu Sep 8 11:11:53 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e/os-interface => generated 284 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 11:11:54.652381 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-93da13f5-e4a5-4583-8a8e-6cc7b5dc25ca tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:54.653011 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-93da13f5-e4a5-4583-8a8e-6cc7b5dc25ca tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] [instance: 0316b49d-d664-44c6-b57c-f84d163bfd0d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:54.667334 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-93da13f5-e4a5-4583-8a8e-6cc7b5dc25ca tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:54.670964 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-93da13f5-e4a5-4583-8a8e-6cc7b5dc25ca tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:54.672643 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-93da13f5-e4a5-4583-8a8e-6cc7b5dc25ca tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:54.675048 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-93da13f5-e4a5-4583-8a8e-6cc7b5dc25ca tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:54.675705 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-93da13f5-e4a5-4583-8a8e-6cc7b5dc25ca tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:54.680916 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-93da13f5-e4a5-4583-8a8e-6cc7b5dc25ca tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:54.794281 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-93da13f5-e4a5-4583-8a8e-6cc7b5dc25ca tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:54.806361 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-93da13f5-e4a5-4583-8a8e-6cc7b5dc25ca tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:54.808050 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-93da13f5-e4a5-4583-8a8e-6cc7b5dc25ca tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:54.809674 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-93da13f5-e4a5-4583-8a8e-6cc7b5dc25ca tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] 10.222.0.27 "GET /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d" status: 200 len: 1347 microversion: 2.57 time: 0.161517 Sep 08 11:11:54.830615 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2851/5595] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:11:54 2022] GET /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d => generated 1347 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:11:55.839162 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2e3da974-a0fb-4b05-bf2d-e11e01adc770 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:55.840505 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2e3da974-a0fb-4b05-bf2d-e11e01adc770 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] [instance: 0316b49d-d664-44c6-b57c-f84d163bfd0d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:55.854733 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e3da974-a0fb-4b05-bf2d-e11e01adc770 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:55.856766 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e3da974-a0fb-4b05-bf2d-e11e01adc770 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:55.857493 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e3da974-a0fb-4b05-bf2d-e11e01adc770 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:55.859538 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e3da974-a0fb-4b05-bf2d-e11e01adc770 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:55.862501 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e3da974-a0fb-4b05-bf2d-e11e01adc770 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:55.863290 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e3da974-a0fb-4b05-bf2d-e11e01adc770 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:56.103479 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2e3da974-a0fb-4b05-bf2d-e11e01adc770 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:56.104628 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-eaa140db-51ff-4ad1-833a-d8b0ed1c823d req-7c890c8f-ba67-4528-99cb-b7e58d042ab4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9c23be4-60f4-4bff-9e0d-8040618b552e", "tag": "0dcde267-c491-450a-894c-03db6d80d8ff"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:11:56.113549 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2e3da974-a0fb-4b05-bf2d-e11e01adc770 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:56.116141 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2e3da974-a0fb-4b05-bf2d-e11e01adc770 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:56.117605 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2e3da974-a0fb-4b05-bf2d-e11e01adc770 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] 10.222.0.27 "GET /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d" status: 200 len: 1335 microversion: 2.57 time: 0.282508 Sep 08 11:11:56.118693 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2745/5596] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:11:55 2022] GET /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d => generated 1335 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 11:11:56.135275 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-eaa140db-51ff-4ad1-833a-d8b0ed1c823d req-7c890c8f-ba67-4528-99cb-b7e58d042ab4 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:56.136844 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-eaa140db-51ff-4ad1-833a-d8b0ed1c823d req-7c890c8f-ba67-4528-99cb-b7e58d042ab4 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:56.137818 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-eaa140db-51ff-4ad1-833a-d8b0ed1c823d req-7c890c8f-ba67-4528-99cb-b7e58d042ab4 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:56.163079 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-eaa140db-51ff-4ad1-833a-d8b0ed1c823d req-7c890c8f-ba67-4528-99cb-b7e58d042ab4 service nova] Creating event network-changed:0dcde267-c491-450a-894c-03db6d80d8ff for instance f9c23be4-60f4-4bff-9e0d-8040618b552e on n-h1-850501-12 Sep 08 11:11:56.177182 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-eaa140db-51ff-4ad1-833a-d8b0ed1c823d req-7c890c8f-ba67-4528-99cb-b7e58d042ab4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076537 Sep 08 11:11:56.183969 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2852/5597] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:11:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:11:57.160523 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-85aa4ddb-bff8-469e-ae53-6e41b3d1d2af tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:57.162902 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-85aa4ddb-bff8-469e-ae53-6e41b3d1d2af tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] [instance: 0316b49d-d664-44c6-b57c-f84d163bfd0d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:57.189466 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-85aa4ddb-bff8-469e-ae53-6e41b3d1d2af tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:57.189979 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-85aa4ddb-bff8-469e-ae53-6e41b3d1d2af tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:57.190427 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-85aa4ddb-bff8-469e-ae53-6e41b3d1d2af tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:57.195183 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-85aa4ddb-bff8-469e-ae53-6e41b3d1d2af tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:57.195706 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-85aa4ddb-bff8-469e-ae53-6e41b3d1d2af tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:57.196150 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-85aa4ddb-bff8-469e-ae53-6e41b3d1d2af tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:57.424669 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-85aa4ddb-bff8-469e-ae53-6e41b3d1d2af tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:57.506204 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-85aa4ddb-bff8-469e-ae53-6e41b3d1d2af tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:57.514242 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-85aa4ddb-bff8-469e-ae53-6e41b3d1d2af tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:57.525583 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-85aa4ddb-bff8-469e-ae53-6e41b3d1d2af tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] 10.222.0.27 "GET /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d" status: 200 len: 1356 microversion: 2.57 time: 0.370309 Sep 08 11:11:57.531103 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2746/5598] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:11:57 2022] GET /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d => generated 1356 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:11:57.648260 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bf271264-d538-4cab-b08f-a28570b14255 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:11:57.658812 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bf271264-d538-4cab-b08f-a28570b14255 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] [instance: 0316b49d-d664-44c6-b57c-f84d163bfd0d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:57.672021 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf271264-d538-4cab-b08f-a28570b14255 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:57.673353 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf271264-d538-4cab-b08f-a28570b14255 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:57.674361 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf271264-d538-4cab-b08f-a28570b14255 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:57.675819 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf271264-d538-4cab-b08f-a28570b14255 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:57.677527 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf271264-d538-4cab-b08f-a28570b14255 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:57.678859 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf271264-d538-4cab-b08f-a28570b14255 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:57.873132 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-bf271264-d538-4cab-b08f-a28570b14255 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:11:57.874168 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-bf271264-d538-4cab-b08f-a28570b14255 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:11:57.875309 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-bf271264-d538-4cab-b08f-a28570b14255 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:11:57.876342 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-bf271264-d538-4cab-b08f-a28570b14255 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:11:57.877349 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-bf271264-d538-4cab-b08f-a28570b14255 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:11:58.071706 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bf271264-d538-4cab-b08f-a28570b14255 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] [instance: 0316b49d-d664-44c6-b57c-f84d163bfd0d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:58.104894 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf271264-d538-4cab-b08f-a28570b14255 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:58.105827 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf271264-d538-4cab-b08f-a28570b14255 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:58.108421 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf271264-d538-4cab-b08f-a28570b14255 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:58.111695 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf271264-d538-4cab-b08f-a28570b14255 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:58.113721 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf271264-d538-4cab-b08f-a28570b14255 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:58.115897 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf271264-d538-4cab-b08f-a28570b14255 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:58.215621 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bf271264-d538-4cab-b08f-a28570b14255 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] 10.222.0.27 "POST /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d/action" status: 202 len: 1137 microversion: 2.57 time: 0.633788 Sep 08 11:11:58.233708 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2853/5599] 10.222.0.27 () {62 vars in 1320 bytes} [Thu Sep 8 11:11:57 2022] POST /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d/action => generated 1137 bytes in 655 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Sep 08 11:11:58.243023 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cc376e38-cb7f-4238-ae39-78d78116e20d tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:58.244588 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cc376e38-cb7f-4238-ae39-78d78116e20d tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] [instance: 0316b49d-d664-44c6-b57c-f84d163bfd0d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:58.254254 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc376e38-cb7f-4238-ae39-78d78116e20d tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:58.255215 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc376e38-cb7f-4238-ae39-78d78116e20d tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:58.255894 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc376e38-cb7f-4238-ae39-78d78116e20d tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:58.257070 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc376e38-cb7f-4238-ae39-78d78116e20d tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:58.257902 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc376e38-cb7f-4238-ae39-78d78116e20d tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:58.258539 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc376e38-cb7f-4238-ae39-78d78116e20d tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:58.466468 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cc376e38-cb7f-4238-ae39-78d78116e20d tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:58.482478 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cc376e38-cb7f-4238-ae39-78d78116e20d tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:58.484033 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cc376e38-cb7f-4238-ae39-78d78116e20d tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:58.492611 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cc376e38-cb7f-4238-ae39-78d78116e20d tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] 10.222.0.27 "GET /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d" status: 200 len: 1365 microversion: 2.57 time: 0.253712 Sep 08 11:11:58.529927 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2747/5600] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:11:58 2022] GET /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d => generated 1365 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:11:59.530710 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-32800675-0b80-4344-a873-796cce592680 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:59.531913 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-32800675-0b80-4344-a873-796cce592680 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] [instance: 0316b49d-d664-44c6-b57c-f84d163bfd0d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:59.548083 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-32800675-0b80-4344-a873-796cce592680 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:59.548587 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-32800675-0b80-4344-a873-796cce592680 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:59.549203 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-32800675-0b80-4344-a873-796cce592680 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:59.550316 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-32800675-0b80-4344-a873-796cce592680 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:59.550790 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-32800675-0b80-4344-a873-796cce592680 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:59.551979 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-32800675-0b80-4344-a873-796cce592680 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:59.652962 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-32800675-0b80-4344-a873-796cce592680 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:59.664312 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-32800675-0b80-4344-a873-796cce592680 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:59.665816 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-32800675-0b80-4344-a873-796cce592680 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:59.667549 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-32800675-0b80-4344-a873-796cce592680 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] 10.222.0.27 "GET /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d" status: 200 len: 1365 microversion: 2.57 time: 0.142279 Sep 08 11:11:59.668419 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2854/5601] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:11:59 2022] GET /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d => generated 1365 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:12:00.260216 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b2118d4e-b428-43a0-ae9c-a9dc7cc2cea0 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:00.261435 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b2118d4e-b428-43a0-ae9c-a9dc7cc2cea0 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] [instance: c4230fe2-77ab-4b37-a368-da0b8eabd595] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:00.269055 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b2118d4e-b428-43a0-ae9c-a9dc7cc2cea0 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:00.269654 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b2118d4e-b428-43a0-ae9c-a9dc7cc2cea0 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:00.270793 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b2118d4e-b428-43a0-ae9c-a9dc7cc2cea0 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:00.271596 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b2118d4e-b428-43a0-ae9c-a9dc7cc2cea0 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:00.272156 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b2118d4e-b428-43a0-ae9c-a9dc7cc2cea0 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:00.272685 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b2118d4e-b428-43a0-ae9c-a9dc7cc2cea0 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:00.366094 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-b2118d4e-b428-43a0-ae9c-a9dc7cc2cea0 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lazy-loading 'services' on Instance uuid c4230fe2-77ab-4b37-a368-da0b8eabd595 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:12:00.446464 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b2118d4e-b428-43a0-ae9c-a9dc7cc2cea0 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c4230fe2-77ab-4b37-a368-da0b8eabd595/os-volume_attachments/50cb742f-90cd-4bab-8890-55658b8310b8" status: 202 len: 0 microversion: 2.1 time: 0.190160 Sep 08 11:12:00.447159 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2748/5602] 10.222.0.27 () {58 vars in 1416 bytes} [Thu Sep 8 11:12:00 2022] DELETE /compute/v2.1/servers/c4230fe2-77ab-4b37-a368-da0b8eabd595/os-volume_attachments/50cb742f-90cd-4bab-8890-55658b8310b8 => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:12:00.704076 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2845952b-4b2e-4775-9aee-3f9bdd9b99e6 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:00.704698 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2845952b-4b2e-4775-9aee-3f9bdd9b99e6 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] [instance: 0316b49d-d664-44c6-b57c-f84d163bfd0d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:00.722556 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2845952b-4b2e-4775-9aee-3f9bdd9b99e6 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:00.723114 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2845952b-4b2e-4775-9aee-3f9bdd9b99e6 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:00.723709 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2845952b-4b2e-4775-9aee-3f9bdd9b99e6 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:00.724474 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2845952b-4b2e-4775-9aee-3f9bdd9b99e6 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:00.725089 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2845952b-4b2e-4775-9aee-3f9bdd9b99e6 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:00.729762 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2845952b-4b2e-4775-9aee-3f9bdd9b99e6 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:00.905248 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2845952b-4b2e-4775-9aee-3f9bdd9b99e6 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:00.922037 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2845952b-4b2e-4775-9aee-3f9bdd9b99e6 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:00.924468 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2845952b-4b2e-4775-9aee-3f9bdd9b99e6 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:00.927776 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2845952b-4b2e-4775-9aee-3f9bdd9b99e6 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] 10.222.0.27 "GET /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d" status: 200 len: 1365 microversion: 2.57 time: 0.227617 Sep 08 11:12:00.932145 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2855/5603] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:12:00 2022] GET /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d => generated 1365 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:12:01.973300 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-13f39cbf-79ce-4b04-aa53-cfa6997da467 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:01.973300 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-13f39cbf-79ce-4b04-aa53-cfa6997da467 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] [instance: 0316b49d-d664-44c6-b57c-f84d163bfd0d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:01.981644 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:12:01.984677 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-13f39cbf-79ce-4b04-aa53-cfa6997da467 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:01.989797 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-13f39cbf-79ce-4b04-aa53-cfa6997da467 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:01.990786 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-13f39cbf-79ce-4b04-aa53-cfa6997da467 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:01.992777 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-13f39cbf-79ce-4b04-aa53-cfa6997da467 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:01.993419 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-13f39cbf-79ce-4b04-aa53-cfa6997da467 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:01.993960 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-13f39cbf-79ce-4b04-aa53-cfa6997da467 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:02.049627 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:12:02.115835 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-13f39cbf-79ce-4b04-aa53-cfa6997da467 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:02.128114 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-13f39cbf-79ce-4b04-aa53-cfa6997da467 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:02.130014 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-13f39cbf-79ce-4b04-aa53-cfa6997da467 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:02.131558 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-13f39cbf-79ce-4b04-aa53-cfa6997da467 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] 10.222.0.27 "GET /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d" status: 200 len: 1365 microversion: 2.57 time: 0.168628 Sep 08 11:12:02.138524 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2749/5604] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:12:01 2022] GET /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d => generated 1365 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:12:03.159740 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-639d9322-3b3c-46b3-aa35-4a730e94665e tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:03.160390 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-639d9322-3b3c-46b3-aa35-4a730e94665e tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] [instance: 0316b49d-d664-44c6-b57c-f84d163bfd0d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:03.168095 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:12:03.170856 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-639d9322-3b3c-46b3-aa35-4a730e94665e tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:03.171823 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-639d9322-3b3c-46b3-aa35-4a730e94665e tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:03.172657 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-639d9322-3b3c-46b3-aa35-4a730e94665e tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:03.173621 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-639d9322-3b3c-46b3-aa35-4a730e94665e tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:03.174084 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-639d9322-3b3c-46b3-aa35-4a730e94665e tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:03.174512 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-639d9322-3b3c-46b3-aa35-4a730e94665e tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:03.272957 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-639d9322-3b3c-46b3-aa35-4a730e94665e tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:03.284027 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-639d9322-3b3c-46b3-aa35-4a730e94665e tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:03.285726 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-639d9322-3b3c-46b3-aa35-4a730e94665e tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:03.287063 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-639d9322-3b3c-46b3-aa35-4a730e94665e tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] 10.222.0.27 "GET /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d" status: 200 len: 1365 microversion: 2.57 time: 0.131386 Sep 08 11:12:03.302669 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2856/5605] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:12:03 2022] GET /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d => generated 1365 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 11:12:04.315876 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-eae996c2-263e-420a-8f06-3d0b74a4b901 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:04.316733 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-eae996c2-263e-420a-8f06-3d0b74a4b901 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] [instance: 0316b49d-d664-44c6-b57c-f84d163bfd0d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:04.334335 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=8 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:12:04.339011 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eae996c2-263e-420a-8f06-3d0b74a4b901 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:04.340025 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eae996c2-263e-420a-8f06-3d0b74a4b901 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:04.340825 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eae996c2-263e-420a-8f06-3d0b74a4b901 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:04.342154 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eae996c2-263e-420a-8f06-3d0b74a4b901 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:04.343016 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eae996c2-263e-420a-8f06-3d0b74a4b901 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:04.343808 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eae996c2-263e-420a-8f06-3d0b74a4b901 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:04.499059 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-eae996c2-263e-420a-8f06-3d0b74a4b901 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:04.508711 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-eae996c2-263e-420a-8f06-3d0b74a4b901 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:04.510223 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-eae996c2-263e-420a-8f06-3d0b74a4b901 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:04.511430 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-eae996c2-263e-420a-8f06-3d0b74a4b901 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] 10.222.0.27 "GET /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d" status: 200 len: 1365 microversion: 2.57 time: 0.200067 Sep 08 11:12:04.521417 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2750/5606] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:12:04 2022] GET /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d => generated 1365 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:12:05.541841 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bfaccd19-241f-46f1-8928-7d491a7e103c tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:05.543150 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bfaccd19-241f-46f1-8928-7d491a7e103c tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] [instance: 0316b49d-d664-44c6-b57c-f84d163bfd0d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:05.551468 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bfaccd19-241f-46f1-8928-7d491a7e103c tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:05.552377 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bfaccd19-241f-46f1-8928-7d491a7e103c tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:05.553337 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bfaccd19-241f-46f1-8928-7d491a7e103c tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:05.554267 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bfaccd19-241f-46f1-8928-7d491a7e103c tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:05.554938 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bfaccd19-241f-46f1-8928-7d491a7e103c tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:05.555604 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bfaccd19-241f-46f1-8928-7d491a7e103c tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:05.627646 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-bfaccd19-241f-46f1-8928-7d491a7e103c tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:05.638091 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-bfaccd19-241f-46f1-8928-7d491a7e103c tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:05.639875 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-bfaccd19-241f-46f1-8928-7d491a7e103c tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:05.641572 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bfaccd19-241f-46f1-8928-7d491a7e103c tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] 10.222.0.27 "GET /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d" status: 200 len: 1365 microversion: 2.57 time: 0.103981 Sep 08 11:12:05.642329 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2857/5607] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:12:05 2022] GET /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d => generated 1365 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:12:06.672369 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9b7c8c2c-fa7b-49d2-8340-0ac124e80b20 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:06.673390 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9b7c8c2c-fa7b-49d2-8340-0ac124e80b20 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] [instance: 0316b49d-d664-44c6-b57c-f84d163bfd0d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:06.688645 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9b7c8c2c-fa7b-49d2-8340-0ac124e80b20 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:06.689505 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9b7c8c2c-fa7b-49d2-8340-0ac124e80b20 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:06.690164 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9b7c8c2c-fa7b-49d2-8340-0ac124e80b20 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:06.692969 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9b7c8c2c-fa7b-49d2-8340-0ac124e80b20 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:06.695569 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9b7c8c2c-fa7b-49d2-8340-0ac124e80b20 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:06.696899 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9b7c8c2c-fa7b-49d2-8340-0ac124e80b20 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:06.837258 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9b7c8c2c-fa7b-49d2-8340-0ac124e80b20 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:06.850648 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9b7c8c2c-fa7b-49d2-8340-0ac124e80b20 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:06.853019 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9b7c8c2c-fa7b-49d2-8340-0ac124e80b20 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:06.856049 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9b7c8c2c-fa7b-49d2-8340-0ac124e80b20 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] 10.222.0.27 "GET /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d" status: 200 len: 1365 microversion: 2.57 time: 0.189859 Sep 08 11:12:06.868712 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2751/5608] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:12:06 2022] GET /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d => generated 1365 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 11:12:07.453834 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-daa239c2-5a24-487f-9d9a-f74edb4ca87a tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:07.455257 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-daa239c2-5a24-487f-9d9a-f74edb4ca87a tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] [instance: c4230fe2-77ab-4b37-a368-da0b8eabd595] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:07.468831 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-daa239c2-5a24-487f-9d9a-f74edb4ca87a tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:07.469369 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-daa239c2-5a24-487f-9d9a-f74edb4ca87a tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:07.470006 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-daa239c2-5a24-487f-9d9a-f74edb4ca87a tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:07.470768 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-daa239c2-5a24-487f-9d9a-f74edb4ca87a tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:07.471240 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-daa239c2-5a24-487f-9d9a-f74edb4ca87a tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:07.471677 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-daa239c2-5a24-487f-9d9a-f74edb4ca87a tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:07.478861 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:12:07.506137 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-daa239c2-5a24-487f-9d9a-f74edb4ca87a tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] [instance: c4230fe2-77ab-4b37-a368-da0b8eabd595] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:12:07.605690 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-daa239c2-5a24-487f-9d9a-f74edb4ca87a tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c4230fe2-77ab-4b37-a368-da0b8eabd595" status: 204 len: 0 microversion: 2.1 time: 0.157894 Sep 08 11:12:07.606682 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2858/5609] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:12:07 2022] DELETE /compute/v2.1/servers/c4230fe2-77ab-4b37-a368-da0b8eabd595 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:12:07.630409 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1e3b7310-69a1-44e0-b10b-be8a8afbca4a tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:07.631443 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1e3b7310-69a1-44e0-b10b-be8a8afbca4a tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] [instance: c4230fe2-77ab-4b37-a368-da0b8eabd595] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:07.639924 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e3b7310-69a1-44e0-b10b-be8a8afbca4a tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:07.640606 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e3b7310-69a1-44e0-b10b-be8a8afbca4a tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:07.640922 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e3b7310-69a1-44e0-b10b-be8a8afbca4a tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:07.641933 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e3b7310-69a1-44e0-b10b-be8a8afbca4a tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:07.642590 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e3b7310-69a1-44e0-b10b-be8a8afbca4a tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:07.643200 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e3b7310-69a1-44e0-b10b-be8a8afbca4a tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:07.830147 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1e3b7310-69a1-44e0-b10b-be8a8afbca4a tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6618b7ad8ff146dfbd892e3e35c2691f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e29f32d2ac4800b9b767f9e1b16526', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:07.845079 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1e3b7310-69a1-44e0-b10b-be8a8afbca4a tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] 10.222.0.27 "GET /compute/v2.1/servers/c4230fe2-77ab-4b37-a368-da0b8eabd595" status: 200 len: 1514 microversion: 2.1 time: 0.227964 Sep 08 11:12:07.845079 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2752/5610] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:12:07 2022] GET /compute/v2.1/servers/c4230fe2-77ab-4b37-a368-da0b8eabd595 => generated 1514 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:12:07.897777 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6557665c-c023-4dc2-895b-5e112d36182c tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:07.898691 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6557665c-c023-4dc2-895b-5e112d36182c tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] [instance: 0316b49d-d664-44c6-b57c-f84d163bfd0d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:07.945353 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6557665c-c023-4dc2-895b-5e112d36182c tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:07.946372 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6557665c-c023-4dc2-895b-5e112d36182c tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.034s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:07.950314 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6557665c-c023-4dc2-895b-5e112d36182c tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:07.951213 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6557665c-c023-4dc2-895b-5e112d36182c tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:07.954438 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6557665c-c023-4dc2-895b-5e112d36182c tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:07.954927 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6557665c-c023-4dc2-895b-5e112d36182c tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:08.063862 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6557665c-c023-4dc2-895b-5e112d36182c tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:08.072293 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6557665c-c023-4dc2-895b-5e112d36182c tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:08.073800 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6557665c-c023-4dc2-895b-5e112d36182c tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:08.074984 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6557665c-c023-4dc2-895b-5e112d36182c tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] 10.222.0.27 "GET /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d" status: 200 len: 1365 microversion: 2.57 time: 0.193467 Sep 08 11:12:08.075549 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2859/5611] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:12:07 2022] GET /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d => generated 1365 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 11:12:08.866700 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9f192bed-0d65-4a6d-b64c-ce4e940862a5 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:08.867424 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9f192bed-0d65-4a6d-b64c-ce4e940862a5 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] [instance: c4230fe2-77ab-4b37-a368-da0b8eabd595] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:08.874747 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f192bed-0d65-4a6d-b64c-ce4e940862a5 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:08.875334 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f192bed-0d65-4a6d-b64c-ce4e940862a5 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:08.875916 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f192bed-0d65-4a6d-b64c-ce4e940862a5 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:08.875916 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f192bed-0d65-4a6d-b64c-ce4e940862a5 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:08.875916 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f192bed-0d65-4a6d-b64c-ce4e940862a5 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:08.875916 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f192bed-0d65-4a6d-b64c-ce4e940862a5 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:09.055620 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9f192bed-0d65-4a6d-b64c-ce4e940862a5 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6618b7ad8ff146dfbd892e3e35c2691f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e29f32d2ac4800b9b767f9e1b16526', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:09.082646 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9f192bed-0d65-4a6d-b64c-ce4e940862a5 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] 10.222.0.27 "GET /compute/v2.1/servers/c4230fe2-77ab-4b37-a368-da0b8eabd595" status: 200 len: 1514 microversion: 2.1 time: 0.218524 Sep 08 11:12:09.084758 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2753/5612] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:12:08 2022] GET /compute/v2.1/servers/c4230fe2-77ab-4b37-a368-da0b8eabd595 => generated 1514 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:12:09.102524 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-aab1ee79-7902-4f6b-b6d6-82264c2496bb tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:09.103280 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-aab1ee79-7902-4f6b-b6d6-82264c2496bb tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] [instance: 0316b49d-d664-44c6-b57c-f84d163bfd0d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:09.118854 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aab1ee79-7902-4f6b-b6d6-82264c2496bb tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:09.120006 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aab1ee79-7902-4f6b-b6d6-82264c2496bb tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:09.121306 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aab1ee79-7902-4f6b-b6d6-82264c2496bb tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:09.122994 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aab1ee79-7902-4f6b-b6d6-82264c2496bb tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:09.125332 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aab1ee79-7902-4f6b-b6d6-82264c2496bb tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:09.126701 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aab1ee79-7902-4f6b-b6d6-82264c2496bb tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:09.273851 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-aab1ee79-7902-4f6b-b6d6-82264c2496bb tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:09.282608 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-aab1ee79-7902-4f6b-b6d6-82264c2496bb tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:09.284553 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-aab1ee79-7902-4f6b-b6d6-82264c2496bb tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:09.287145 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-aab1ee79-7902-4f6b-b6d6-82264c2496bb tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] 10.222.0.27 "GET /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d" status: 200 len: 1365 microversion: 2.57 time: 0.189541 Sep 08 11:12:09.288240 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2860/5613] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:12:09 2022] GET /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d => generated 1365 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:12:09.960306 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-59caaf1e-29a9-4c40-a3c7-e8a07c00eb43 req-e54cddc0-c63f-44e8-85cd-b4d9443243e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4230fe2-77ab-4b37-a368-da0b8eabd595", "name": "network-vif-deleted", "tag": "537949e9-e52a-4e19-8a5a-eda8f0ad5b5c"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:12:09.980172 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-59caaf1e-29a9-4c40-a3c7-e8a07c00eb43 req-e54cddc0-c63f-44e8-85cd-b4d9443243e6 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:09.980665 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-59caaf1e-29a9-4c40-a3c7-e8a07c00eb43 req-e54cddc0-c63f-44e8-85cd-b4d9443243e6 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:09.981134 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-59caaf1e-29a9-4c40-a3c7-e8a07c00eb43 req-e54cddc0-c63f-44e8-85cd-b4d9443243e6 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:09.998592 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-59caaf1e-29a9-4c40-a3c7-e8a07c00eb43 req-e54cddc0-c63f-44e8-85cd-b4d9443243e6 service nova] Creating event network-vif-deleted:537949e9-e52a-4e19-8a5a-eda8f0ad5b5c for instance c4230fe2-77ab-4b37-a368-da0b8eabd595 on n-h2-850501-12 Sep 08 11:12:10.027548 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-59caaf1e-29a9-4c40-a3c7-e8a07c00eb43 req-e54cddc0-c63f-44e8-85cd-b4d9443243e6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077203 Sep 08 11:12:10.028275 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2754/5614] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:12:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:12:10.112243 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-02f6bd1b-27cf-40f6-9b3a-599f94b695c3 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:10.114389 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-02f6bd1b-27cf-40f6-9b3a-599f94b695c3 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] [instance: c4230fe2-77ab-4b37-a368-da0b8eabd595] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:10.124967 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-02f6bd1b-27cf-40f6-9b3a-599f94b695c3 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:10.125826 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-02f6bd1b-27cf-40f6-9b3a-599f94b695c3 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:10.126492 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-02f6bd1b-27cf-40f6-9b3a-599f94b695c3 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:10.142343 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-02f6bd1b-27cf-40f6-9b3a-599f94b695c3 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:10.145160 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-02f6bd1b-27cf-40f6-9b3a-599f94b695c3 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:10.146200 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-02f6bd1b-27cf-40f6-9b3a-599f94b695c3 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:10.243264 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-02f6bd1b-27cf-40f6-9b3a-599f94b695c3 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:10.243766 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-02f6bd1b-27cf-40f6-9b3a-599f94b695c3 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:10.244212 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-02f6bd1b-27cf-40f6-9b3a-599f94b695c3 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:10.244676 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-02f6bd1b-27cf-40f6-9b3a-599f94b695c3 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lazy-loading 'fault' on Instance uuid c4230fe2-77ab-4b37-a368-da0b8eabd595 {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:12:10.315559 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-02f6bd1b-27cf-40f6-9b3a-599f94b695c3 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6618b7ad8ff146dfbd892e3e35c2691f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e29f32d2ac4800b9b767f9e1b16526', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:10.316254 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5a987bbc-8353-45b3-a1a4-62b545ef2e67 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:10.316978 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5a987bbc-8353-45b3-a1a4-62b545ef2e67 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] [instance: 0316b49d-d664-44c6-b57c-f84d163bfd0d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:10.325468 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-02f6bd1b-27cf-40f6-9b3a-599f94b695c3 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] 10.222.0.27 "GET /compute/v2.1/servers/c4230fe2-77ab-4b37-a368-da0b8eabd595" status: 200 len: 1308 microversion: 2.1 time: 0.217431 Sep 08 11:12:10.326436 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2861/5615] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:12:10 2022] GET /compute/v2.1/servers/c4230fe2-77ab-4b37-a368-da0b8eabd595 => generated 1308 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:12:10.356546 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a987bbc-8353-45b3-a1a4-62b545ef2e67 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:10.357077 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a987bbc-8353-45b3-a1a4-62b545ef2e67 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:10.357530 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a987bbc-8353-45b3-a1a4-62b545ef2e67 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:10.358267 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a987bbc-8353-45b3-a1a4-62b545ef2e67 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:10.358738 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a987bbc-8353-45b3-a1a4-62b545ef2e67 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:10.359169 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a987bbc-8353-45b3-a1a4-62b545ef2e67 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:10.475893 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5a987bbc-8353-45b3-a1a4-62b545ef2e67 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:10.486398 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5a987bbc-8353-45b3-a1a4-62b545ef2e67 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:10.489009 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5a987bbc-8353-45b3-a1a4-62b545ef2e67 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:10.490907 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5a987bbc-8353-45b3-a1a4-62b545ef2e67 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] 10.222.0.27 "GET /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d" status: 200 len: 1365 microversion: 2.57 time: 0.179069 Sep 08 11:12:10.491988 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2755/5616] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:12:10 2022] GET /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d => generated 1365 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:12:11.352574 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-643ec708-8608-4823-9d7b-f41354269959 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:11.353825 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-643ec708-8608-4823-9d7b-f41354269959 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] [instance: c4230fe2-77ab-4b37-a368-da0b8eabd595] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:11.368061 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-643ec708-8608-4823-9d7b-f41354269959 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:11.368568 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-643ec708-8608-4823-9d7b-f41354269959 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:11.369116 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-643ec708-8608-4823-9d7b-f41354269959 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:11.369851 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-643ec708-8608-4823-9d7b-f41354269959 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:11.370317 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-643ec708-8608-4823-9d7b-f41354269959 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:11.370748 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-643ec708-8608-4823-9d7b-f41354269959 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:11.405099 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-643ec708-8608-4823-9d7b-f41354269959 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] HTTP exception thrown: Instance c4230fe2-77ab-4b37-a368-da0b8eabd595 could not be found. Sep 08 11:12:11.407559 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-643ec708-8608-4823-9d7b-f41354269959 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Request method failure captured: Sep 08 11:12:11.407559 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/c4230fe2-77ab-4b37-a368-da0b8eabd595 HTTP/1.1 Sep 08 11:12:11.407559 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:12:11.407559 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:12:11.407559 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:12:11.407559 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 11:12:11.407559 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:12:11.407559 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:12:11.407559 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:12:11.407559 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:12:11.407559 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGcy9QTB2spPthSFjI01L3fCIson4XPccYNNPT18YeqGd1v8fPtbA6oAjf0wb8c0xu1fksk59wERCofZeTIKCjZAQVMeBkdJ_pGxEszC7KUVHUYYRcD8MlDxLgzNFcXNssiCwtpbKKh_y30ZFrV0QpPEarSEYh_FGN1Rmozwl-Mp-Xkk Sep 08 11:12:11.407559 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:12:11.407559 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:12:11.407559 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:12:11.407559 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:12:11.407559 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:12:11.407559 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:12:11.407559 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 24e29f32d2ac4800b9b767f9e1b16526 Sep 08 11:12:11.407559 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1411644645 Sep 08 11:12:11.407559 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:12:11.407559 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:12:11.407559 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/24e29f32d2ac4800b9b767f9e1b16526"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/24e29f32d2ac4800b9b767f9e1b16526"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_24e29f32d2ac4800b9b767f9e1b16526"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/24e29f32d2ac4800b9b767f9e1b16526"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:12:11.407559 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-VolumesSnapshotTestJSON-1411644645 Sep 08 11:12:11.407559 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 24e29f32d2ac4800b9b767f9e1b16526 Sep 08 11:12:11.407559 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1411644645 Sep 08 11:12:11.407559 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-VolumesSnapshotTestJSON-1411644645-project Sep 08 11:12:11.407559 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:12:11.407559 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:12:11.407559 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 6618b7ad8ff146dfbd892e3e35c2691f Sep 08 11:12:11.407559 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-VolumesSnapshotTestJSON-1411644645-project Sep 08 11:12:11.407559 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 11:12:11.407559 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance c4230fe2-77ab-4b37-a368-da0b8eabd595 could not be found. Sep 08 11:12:11.407559 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': 'c4230fe2-77ab-4b37-a368-da0b8eabd595'} Sep 08 11:12:11.407559 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:12:11.407559 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:12:11.407559 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:12:11.407559 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:12:11.407559 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:12:11.407559 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:12:11.407559 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:12:11.407559 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:12:11.407559 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:12:11.407559 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:12:11.407559 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4230fe2-77ab-4b37-a368-da0b8eabd595 could not be found. Sep 08 11:12:11.407559 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:12:11.407559 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:12:11.407559 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:12:11.407559 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:12:11.407559 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:12:11.407559 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:12:11.407559 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:12:11.407559 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:12:11.407559 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:12:11.407559 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:12:11.407559 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:12:11.407559 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:12:11.407559 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:12:11.407559 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:12:11.407559 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:12:11.407559 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:12:11.407559 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4230fe2-77ab-4b37-a368-da0b8eabd595 could not be found. Sep 08 11:12:11.407559 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:12:11.407559 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:12:11.407559 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:12:11.417331 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:12:11.417331 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:12:11.417331 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:12:11.417331 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:12:11.417331 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:12:11.417331 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4230fe2-77ab-4b37-a368-da0b8eabd595 could not be found. Sep 08 11:12:11.417331 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:12:11.417331 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-643ec708-8608-4823-9d7b-f41354269959 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] Returning 404 to user: Instance c4230fe2-77ab-4b37-a368-da0b8eabd595 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:12:11.417331 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-643ec708-8608-4823-9d7b-f41354269959 tempest-VolumesSnapshotTestJSON-1411644645 tempest-VolumesSnapshotTestJSON-1411644645-project] 10.222.0.27 "GET /compute/v2.1/servers/c4230fe2-77ab-4b37-a368-da0b8eabd595" status: 404 len: 111 microversion: 2.1 time: 0.060421 Sep 08 11:12:11.424978 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2862/5617] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:12:11 2022] GET /compute/v2.1/servers/c4230fe2-77ab-4b37-a368-da0b8eabd595 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:12:11.521965 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-da59d9a7-7db6-4798-8e25-1f29235385de tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:11.522610 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-da59d9a7-7db6-4798-8e25-1f29235385de tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] [instance: 0316b49d-d664-44c6-b57c-f84d163bfd0d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:11.542673 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-da59d9a7-7db6-4798-8e25-1f29235385de tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:11.543178 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-da59d9a7-7db6-4798-8e25-1f29235385de tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:11.545942 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-da59d9a7-7db6-4798-8e25-1f29235385de tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:11.548079 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-da59d9a7-7db6-4798-8e25-1f29235385de tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:11.551230 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-da59d9a7-7db6-4798-8e25-1f29235385de tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:11.552187 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-da59d9a7-7db6-4798-8e25-1f29235385de tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:11.737645 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-da59d9a7-7db6-4798-8e25-1f29235385de tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:11.753195 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-da59d9a7-7db6-4798-8e25-1f29235385de tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:11.755567 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-da59d9a7-7db6-4798-8e25-1f29235385de tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:11.756846 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-da59d9a7-7db6-4798-8e25-1f29235385de tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] 10.222.0.27 "GET /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d" status: 200 len: 1365 microversion: 2.57 time: 0.242690 Sep 08 11:12:11.762176 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2756/5618] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:12:11 2022] GET /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d => generated 1365 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:12:12.797061 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0bca7f8e-9115-4d3b-8484-be5847a57098 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:12.798800 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0bca7f8e-9115-4d3b-8484-be5847a57098 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] [instance: 0316b49d-d664-44c6-b57c-f84d163bfd0d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:12.812646 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0bca7f8e-9115-4d3b-8484-be5847a57098 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:12.813188 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0bca7f8e-9115-4d3b-8484-be5847a57098 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:12.813636 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0bca7f8e-9115-4d3b-8484-be5847a57098 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:12.815889 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0bca7f8e-9115-4d3b-8484-be5847a57098 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:12.817223 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0bca7f8e-9115-4d3b-8484-be5847a57098 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:12.817686 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0bca7f8e-9115-4d3b-8484-be5847a57098 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:12.943617 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0bca7f8e-9115-4d3b-8484-be5847a57098 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:12.964989 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0bca7f8e-9115-4d3b-8484-be5847a57098 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:12.968734 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0bca7f8e-9115-4d3b-8484-be5847a57098 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:12.974680 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0bca7f8e-9115-4d3b-8484-be5847a57098 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] 10.222.0.27 "GET /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d" status: 200 len: 1365 microversion: 2.57 time: 0.181453 Sep 08 11:12:12.981325 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2863/5619] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:12:12 2022] GET /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d => generated 1365 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:12:14.002205 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f987c94e-80de-43bc-925a-bc2ce667ac90 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:14.004352 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f987c94e-80de-43bc-925a-bc2ce667ac90 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] [instance: 0316b49d-d664-44c6-b57c-f84d163bfd0d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:14.012773 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f987c94e-80de-43bc-925a-bc2ce667ac90 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:14.013486 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f987c94e-80de-43bc-925a-bc2ce667ac90 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:14.014120 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f987c94e-80de-43bc-925a-bc2ce667ac90 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:14.015001 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f987c94e-80de-43bc-925a-bc2ce667ac90 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:14.015625 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f987c94e-80de-43bc-925a-bc2ce667ac90 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:14.016222 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f987c94e-80de-43bc-925a-bc2ce667ac90 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:14.089870 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f987c94e-80de-43bc-925a-bc2ce667ac90 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:14.101306 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f987c94e-80de-43bc-925a-bc2ce667ac90 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:14.103476 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f987c94e-80de-43bc-925a-bc2ce667ac90 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:14.104848 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f987c94e-80de-43bc-925a-bc2ce667ac90 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] 10.222.0.27 "GET /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d" status: 200 len: 1365 microversion: 2.57 time: 0.107056 Sep 08 11:12:14.105453 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2757/5620] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:12:13 2022] GET /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d => generated 1365 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:12:15.133370 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3bd10c45-b343-4604-9a26-4b03ec47bbce tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:15.134346 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3bd10c45-b343-4604-9a26-4b03ec47bbce tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] [instance: 0316b49d-d664-44c6-b57c-f84d163bfd0d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:15.151941 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3bd10c45-b343-4604-9a26-4b03ec47bbce tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:15.152460 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3bd10c45-b343-4604-9a26-4b03ec47bbce tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:15.152918 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3bd10c45-b343-4604-9a26-4b03ec47bbce tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:15.163525 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3bd10c45-b343-4604-9a26-4b03ec47bbce tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:15.164084 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3bd10c45-b343-4604-9a26-4b03ec47bbce tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:15.164556 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3bd10c45-b343-4604-9a26-4b03ec47bbce tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:15.269377 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-3bd10c45-b343-4604-9a26-4b03ec47bbce tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:15.279454 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-3bd10c45-b343-4604-9a26-4b03ec47bbce tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:15.283440 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-3bd10c45-b343-4604-9a26-4b03ec47bbce tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:15.295706 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3bd10c45-b343-4604-9a26-4b03ec47bbce tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] 10.222.0.27 "GET /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d" status: 200 len: 1365 microversion: 2.57 time: 0.167862 Sep 08 11:12:15.298166 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2864/5621] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:12:15 2022] GET /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d => generated 1365 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:12:16.334938 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e054304f-0f94-483c-9fb5-1b144a6c8c2e tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:16.335681 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e054304f-0f94-483c-9fb5-1b144a6c8c2e tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] [instance: 0316b49d-d664-44c6-b57c-f84d163bfd0d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:16.350586 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e054304f-0f94-483c-9fb5-1b144a6c8c2e tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:16.352287 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e054304f-0f94-483c-9fb5-1b144a6c8c2e tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:16.354719 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e054304f-0f94-483c-9fb5-1b144a6c8c2e tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:16.356012 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e054304f-0f94-483c-9fb5-1b144a6c8c2e tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:16.358332 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e054304f-0f94-483c-9fb5-1b144a6c8c2e tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:16.359128 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e054304f-0f94-483c-9fb5-1b144a6c8c2e tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:16.455283 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e054304f-0f94-483c-9fb5-1b144a6c8c2e tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:16.469332 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e054304f-0f94-483c-9fb5-1b144a6c8c2e tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:16.471103 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e054304f-0f94-483c-9fb5-1b144a6c8c2e tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:16.472592 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e054304f-0f94-483c-9fb5-1b144a6c8c2e tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] 10.222.0.27 "GET /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d" status: 200 len: 1365 microversion: 2.57 time: 0.142669 Sep 08 11:12:16.473777 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2758/5622] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:12:16 2022] GET /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d => generated 1365 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:12:17.505120 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6fb82276-77aa-41b7-8186-5238af08fa8a tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:17.506369 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6fb82276-77aa-41b7-8186-5238af08fa8a tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] [instance: 0316b49d-d664-44c6-b57c-f84d163bfd0d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:17.531885 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6fb82276-77aa-41b7-8186-5238af08fa8a tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:17.532735 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6fb82276-77aa-41b7-8186-5238af08fa8a tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:17.533421 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6fb82276-77aa-41b7-8186-5238af08fa8a tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:17.534612 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6fb82276-77aa-41b7-8186-5238af08fa8a tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:17.535775 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6fb82276-77aa-41b7-8186-5238af08fa8a tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:17.536489 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6fb82276-77aa-41b7-8186-5238af08fa8a tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:17.702840 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6fb82276-77aa-41b7-8186-5238af08fa8a tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:17.720651 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6fb82276-77aa-41b7-8186-5238af08fa8a tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:17.723059 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6fb82276-77aa-41b7-8186-5238af08fa8a tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:17.724571 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6fb82276-77aa-41b7-8186-5238af08fa8a tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] 10.222.0.27 "GET /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d" status: 200 len: 1365 microversion: 2.57 time: 0.224571 Sep 08 11:12:17.754361 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2865/5623] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:12:17 2022] GET /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d => generated 1365 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:12:18.771206 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fd08d88d-f45d-4c2d-b715-567b588896f4 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:18.771750 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fd08d88d-f45d-4c2d-b715-567b588896f4 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] [instance: 0316b49d-d664-44c6-b57c-f84d163bfd0d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:18.778523 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd08d88d-f45d-4c2d-b715-567b588896f4 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:18.779010 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd08d88d-f45d-4c2d-b715-567b588896f4 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:18.779442 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd08d88d-f45d-4c2d-b715-567b588896f4 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:18.780140 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd08d88d-f45d-4c2d-b715-567b588896f4 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:18.780594 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd08d88d-f45d-4c2d-b715-567b588896f4 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:18.781014 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd08d88d-f45d-4c2d-b715-567b588896f4 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:18.851860 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fd08d88d-f45d-4c2d-b715-567b588896f4 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:18.860729 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fd08d88d-f45d-4c2d-b715-567b588896f4 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:18.862284 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fd08d88d-f45d-4c2d-b715-567b588896f4 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:18.864029 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fd08d88d-f45d-4c2d-b715-567b588896f4 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] 10.222.0.27 "GET /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d" status: 200 len: 1365 microversion: 2.57 time: 0.097903 Sep 08 11:12:18.864917 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2759/5624] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:12:18 2022] GET /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d => generated 1365 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:12:18.908407 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ed797874-ac2c-4e71-8983-e981c6fab4cb tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1787754730", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:12:18.981584 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-ed797874-ac2c-4e71-8983-e981c6fab4cb tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] validate_networks() for None {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:12:19.354128 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-ed797874-ac2c-4e71-8983-e981c6fab4cb tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:12:19.355041 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-ed797874-ac2c-4e71-8983-e981c6fab4cb tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:12:19.355686 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-ed797874-ac2c-4e71-8983-e981c6fab4cb tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:12:19.356317 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-ed797874-ac2c-4e71-8983-e981c6fab4cb tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:12:19.356994 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-ed797874-ac2c-4e71-8983-e981c6fab4cb tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:12:19.370473 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed797874-ac2c-4e71-8983-e981c6fab4cb tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:19.371331 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed797874-ac2c-4e71-8983-e981c6fab4cb tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:19.372217 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed797874-ac2c-4e71-8983-e981c6fab4cb tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:19.374001 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed797874-ac2c-4e71-8983-e981c6fab4cb tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:19.375389 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed797874-ac2c-4e71-8983-e981c6fab4cb tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:19.376279 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed797874-ac2c-4e71-8983-e981c6fab4cb tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:19.401593 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-ed797874-ac2c-4e71-8983-e981c6fab4cb tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Getting quotas for project 209fb9b0936b483aa902a5c12803bc48. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:12:19.414712 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-ed797874-ac2c-4e71-8983-e981c6fab4cb tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Getting quotas for user f20be7bbc39a49a89aa2caf2bb328be7 and project 209fb9b0936b483aa902a5c12803bc48. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:12:19.432484 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ed797874-ac2c-4e71-8983-e981c6fab4cb tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:12:19.435293 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ed797874-ac2c-4e71-8983-e981c6fab4cb tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] [instance: 6b8c23b2-8127-4488-b785-44f1abc16edd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:12:19.508960 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ed797874-ac2c-4e71-8983-e981c6fab4cb tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.605348 Sep 08 11:12:19.509656 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2866/5625] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 11:12:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 607 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:12:19.542820 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3c427d02-d0b2-4443-a8b0-17e845d3b526 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:19.544218 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3c427d02-d0b2-4443-a8b0-17e845d3b526 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] [instance: 6b8c23b2-8127-4488-b785-44f1abc16edd] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:19.666145 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3c427d02-d0b2-4443-a8b0-17e845d3b526 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20be7bbc39a49a89aa2caf2bb328be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209fb9b0936b483aa902a5c12803bc48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:19.689539 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3c427d02-d0b2-4443-a8b0-17e845d3b526 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] 10.222.0.27 "GET /compute/v2.1/servers/6b8c23b2-8127-4488-b785-44f1abc16edd" status: 200 len: 1214 microversion: 2.1 time: 0.171628 Sep 08 11:12:19.693906 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2760/5626] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:12:19 2022] GET /compute/v2.1/servers/6b8c23b2-8127-4488-b785-44f1abc16edd => generated 1214 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:12:19.892654 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-19855cc2-33e2-4bfe-abc8-f316be04be07 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:19.893395 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-19855cc2-33e2-4bfe-abc8-f316be04be07 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] [instance: 0316b49d-d664-44c6-b57c-f84d163bfd0d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:19.910818 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-19855cc2-33e2-4bfe-abc8-f316be04be07 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:19.922057 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-19855cc2-33e2-4bfe-abc8-f316be04be07 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:19.922676 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-19855cc2-33e2-4bfe-abc8-f316be04be07 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:19.923474 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-19855cc2-33e2-4bfe-abc8-f316be04be07 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:19.923967 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-19855cc2-33e2-4bfe-abc8-f316be04be07 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:19.924423 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-19855cc2-33e2-4bfe-abc8-f316be04be07 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:20.027385 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-19855cc2-33e2-4bfe-abc8-f316be04be07 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:20.038088 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-19855cc2-33e2-4bfe-abc8-f316be04be07 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:20.039965 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-19855cc2-33e2-4bfe-abc8-f316be04be07 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:20.042760 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-19855cc2-33e2-4bfe-abc8-f316be04be07 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] 10.222.0.27 "GET /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d" status: 200 len: 1365 microversion: 2.57 time: 0.155847 Sep 08 11:12:20.049545 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2867/5627] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:12:19 2022] GET /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:12:20.718417 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a874fd1b-a068-4ee0-91fa-4f8b4023ef2c tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:20.719262 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a874fd1b-a068-4ee0-91fa-4f8b4023ef2c tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] [instance: 6b8c23b2-8127-4488-b785-44f1abc16edd] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:20.723811 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:12:20.743078 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a874fd1b-a068-4ee0-91fa-4f8b4023ef2c tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:20.744002 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a874fd1b-a068-4ee0-91fa-4f8b4023ef2c tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:20.744454 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a874fd1b-a068-4ee0-91fa-4f8b4023ef2c tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:20.745238 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a874fd1b-a068-4ee0-91fa-4f8b4023ef2c tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:20.745790 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a874fd1b-a068-4ee0-91fa-4f8b4023ef2c tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:20.746276 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a874fd1b-a068-4ee0-91fa-4f8b4023ef2c tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:20.879871 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a874fd1b-a068-4ee0-91fa-4f8b4023ef2c tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20be7bbc39a49a89aa2caf2bb328be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209fb9b0936b483aa902a5c12803bc48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:20.892417 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a874fd1b-a068-4ee0-91fa-4f8b4023ef2c tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] 10.222.0.27 "GET /compute/v2.1/servers/6b8c23b2-8127-4488-b785-44f1abc16edd" status: 200 len: 1266 microversion: 2.1 time: 0.177739 Sep 08 11:12:20.893430 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2761/5628] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:12:20 2022] GET /compute/v2.1/servers/6b8c23b2-8127-4488-b785-44f1abc16edd => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:12:21.074612 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fedc0ca8-1a8b-4a40-8b43-a529902bcb53 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:21.076807 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fedc0ca8-1a8b-4a40-8b43-a529902bcb53 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] [instance: 0316b49d-d664-44c6-b57c-f84d163bfd0d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:21.089148 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fedc0ca8-1a8b-4a40-8b43-a529902bcb53 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:21.090023 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fedc0ca8-1a8b-4a40-8b43-a529902bcb53 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:21.090611 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fedc0ca8-1a8b-4a40-8b43-a529902bcb53 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:21.091938 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fedc0ca8-1a8b-4a40-8b43-a529902bcb53 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:21.093567 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fedc0ca8-1a8b-4a40-8b43-a529902bcb53 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:21.094505 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fedc0ca8-1a8b-4a40-8b43-a529902bcb53 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:21.463020 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-fedc0ca8-1a8b-4a40-8b43-a529902bcb53 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:21.472773 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-fedc0ca8-1a8b-4a40-8b43-a529902bcb53 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:21.474480 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-fedc0ca8-1a8b-4a40-8b43-a529902bcb53 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:21.478784 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fedc0ca8-1a8b-4a40-8b43-a529902bcb53 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] 10.222.0.27 "GET /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d" status: 200 len: 1365 microversion: 2.57 time: 0.407937 Sep 08 11:12:21.479864 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2868/5629] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:12:21 2022] GET /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d => generated 1365 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 11:12:21.919486 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-049311c8-b9bb-4e81-8d7d-23391587ffab tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:21.921139 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-049311c8-b9bb-4e81-8d7d-23391587ffab tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] [instance: 6b8c23b2-8127-4488-b785-44f1abc16edd] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:21.933996 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-049311c8-b9bb-4e81-8d7d-23391587ffab tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:21.934981 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-049311c8-b9bb-4e81-8d7d-23391587ffab tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:21.935590 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-049311c8-b9bb-4e81-8d7d-23391587ffab tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:21.936608 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-049311c8-b9bb-4e81-8d7d-23391587ffab tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:21.937531 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-049311c8-b9bb-4e81-8d7d-23391587ffab tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:21.939050 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-049311c8-b9bb-4e81-8d7d-23391587ffab tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:22.103051 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-049311c8-b9bb-4e81-8d7d-23391587ffab tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20be7bbc39a49a89aa2caf2bb328be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209fb9b0936b483aa902a5c12803bc48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:22.111547 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-049311c8-b9bb-4e81-8d7d-23391587ffab tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] 10.222.0.27 "GET /compute/v2.1/servers/6b8c23b2-8127-4488-b785-44f1abc16edd" status: 200 len: 1272 microversion: 2.1 time: 0.196022 Sep 08 11:12:22.112296 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2762/5630] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:12:21 2022] GET /compute/v2.1/servers/6b8c23b2-8127-4488-b785-44f1abc16edd => generated 1272 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:12:22.512121 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-13689a2f-612b-49b0-af81-7b8193b3507a tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:22.513408 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-13689a2f-612b-49b0-af81-7b8193b3507a tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] [instance: 0316b49d-d664-44c6-b57c-f84d163bfd0d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:22.532145 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-13689a2f-612b-49b0-af81-7b8193b3507a tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:22.533077 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-13689a2f-612b-49b0-af81-7b8193b3507a tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:22.533865 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-13689a2f-612b-49b0-af81-7b8193b3507a tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:22.535019 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-13689a2f-612b-49b0-af81-7b8193b3507a tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:22.535808 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-13689a2f-612b-49b0-af81-7b8193b3507a tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:22.536609 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-13689a2f-612b-49b0-af81-7b8193b3507a tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:22.674331 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-13689a2f-612b-49b0-af81-7b8193b3507a tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:22.692375 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-13689a2f-612b-49b0-af81-7b8193b3507a tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:22.696245 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-13689a2f-612b-49b0-af81-7b8193b3507a tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:22.698031 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-13689a2f-612b-49b0-af81-7b8193b3507a tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] 10.222.0.27 "GET /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d" status: 200 len: 1365 microversion: 2.57 time: 0.191283 Sep 08 11:12:22.699113 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2869/5631] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:12:22 2022] GET /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d => generated 1365 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:12:23.140961 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-93cfe7f2-7252-47b1-994b-38730d2f86f4 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:23.141832 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-93cfe7f2-7252-47b1-994b-38730d2f86f4 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] [instance: 6b8c23b2-8127-4488-b785-44f1abc16edd] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:23.157641 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-93cfe7f2-7252-47b1-994b-38730d2f86f4 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:23.158128 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-93cfe7f2-7252-47b1-994b-38730d2f86f4 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:23.161369 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-93cfe7f2-7252-47b1-994b-38730d2f86f4 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:23.170117 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-93cfe7f2-7252-47b1-994b-38730d2f86f4 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:23.170317 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-93cfe7f2-7252-47b1-994b-38730d2f86f4 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:23.170607 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-93cfe7f2-7252-47b1-994b-38730d2f86f4 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:23.728981 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0f7fb63a-f466-4486-9372-dec715f670be tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:23.730171 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0f7fb63a-f466-4486-9372-dec715f670be tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] [instance: 0316b49d-d664-44c6-b57c-f84d163bfd0d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:23.757399 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0f7fb63a-f466-4486-9372-dec715f670be tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:23.758058 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0f7fb63a-f466-4486-9372-dec715f670be tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:23.769695 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0f7fb63a-f466-4486-9372-dec715f670be tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:23.770609 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0f7fb63a-f466-4486-9372-dec715f670be tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:23.771363 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0f7fb63a-f466-4486-9372-dec715f670be tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:23.781889 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0f7fb63a-f466-4486-9372-dec715f670be tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:23.948653 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0f7fb63a-f466-4486-9372-dec715f670be tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:23.967883 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0f7fb63a-f466-4486-9372-dec715f670be tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:23.969568 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0f7fb63a-f466-4486-9372-dec715f670be tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:23.972192 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0f7fb63a-f466-4486-9372-dec715f670be tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] 10.222.0.27 "GET /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d" status: 200 len: 1365 microversion: 2.57 time: 0.246635 Sep 08 11:12:23.972727 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2870/5632] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:12:23 2022] GET /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d => generated 1365 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 11:12:24.318904 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-93cfe7f2-7252-47b1-994b-38730d2f86f4 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20be7bbc39a49a89aa2caf2bb328be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209fb9b0936b483aa902a5c12803bc48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:24.329575 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-93cfe7f2-7252-47b1-994b-38730d2f86f4 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] 10.222.0.27 "GET /compute/v2.1/servers/6b8c23b2-8127-4488-b785-44f1abc16edd" status: 200 len: 1314 microversion: 2.1 time: 1.193540 Sep 08 11:12:24.348309 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2763/5633] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:12:23 2022] GET /compute/v2.1/servers/6b8c23b2-8127-4488-b785-44f1abc16edd => generated 1314 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:12:24.428360 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-aba07666-a234-40ba-8161-9599309dec67 req-b32089f7-4619-49c0-a991-78813682bb93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b8c23b2-8127-4488-b785-44f1abc16edd", "tag": "56f590fc-b946-40f9-bd6b-99f8d2d89b81"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:12:24.440200 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-aba07666-a234-40ba-8161-9599309dec67 req-b32089f7-4619-49c0-a991-78813682bb93 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:24.442019 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-aba07666-a234-40ba-8161-9599309dec67 req-b32089f7-4619-49c0-a991-78813682bb93 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:24.442463 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-aba07666-a234-40ba-8161-9599309dec67 req-b32089f7-4619-49c0-a991-78813682bb93 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:24.456182 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-aba07666-a234-40ba-8161-9599309dec67 req-b32089f7-4619-49c0-a991-78813682bb93 service nova] Creating event network-changed:56f590fc-b946-40f9-bd6b-99f8d2d89b81 for instance 6b8c23b2-8127-4488-b785-44f1abc16edd on n-h1-850501-12 Sep 08 11:12:24.462019 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-aba07666-a234-40ba-8161-9599309dec67 req-b32089f7-4619-49c0-a991-78813682bb93 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039675 Sep 08 11:12:24.470333 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2871/5634] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:12:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:12:24.999995 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8ebe5f9b-6b18-4723-ac8a-f7f0692104c6 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:25.000935 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8ebe5f9b-6b18-4723-ac8a-f7f0692104c6 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] [instance: 0316b49d-d664-44c6-b57c-f84d163bfd0d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:25.011628 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ebe5f9b-6b18-4723-ac8a-f7f0692104c6 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:25.013477 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ebe5f9b-6b18-4723-ac8a-f7f0692104c6 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:25.014980 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ebe5f9b-6b18-4723-ac8a-f7f0692104c6 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:25.015931 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ebe5f9b-6b18-4723-ac8a-f7f0692104c6 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:25.020474 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ebe5f9b-6b18-4723-ac8a-f7f0692104c6 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:25.021224 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ebe5f9b-6b18-4723-ac8a-f7f0692104c6 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:25.151187 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8ebe5f9b-6b18-4723-ac8a-f7f0692104c6 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:25.164856 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8ebe5f9b-6b18-4723-ac8a-f7f0692104c6 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:25.166858 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8ebe5f9b-6b18-4723-ac8a-f7f0692104c6 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:25.168262 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8ebe5f9b-6b18-4723-ac8a-f7f0692104c6 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] 10.222.0.27 "GET /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d" status: 200 len: 1365 microversion: 2.57 time: 0.172631 Sep 08 11:12:25.168824 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2764/5635] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:12:24 2022] GET /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:12:25.351641 n-d-850501-12 devstack@n-api.service[128861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 11:12:25.352288 n-d-850501-12 devstack@n-api.service[128861]: Thu Sep 8 11:12:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6b8c23b2-8127-4488-b785-44f1abc16edd (ip 10.222.0.27) !!! Sep 08 11:12:25.358098 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7419a6cd-58fb-44ab-b941-691bfcd3669f tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:25.359127 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7419a6cd-58fb-44ab-b941-691bfcd3669f tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] [instance: 6b8c23b2-8127-4488-b785-44f1abc16edd] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:25.374025 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7419a6cd-58fb-44ab-b941-691bfcd3669f tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:25.374889 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7419a6cd-58fb-44ab-b941-691bfcd3669f tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:25.375627 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7419a6cd-58fb-44ab-b941-691bfcd3669f tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:25.376586 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7419a6cd-58fb-44ab-b941-691bfcd3669f tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:25.377497 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7419a6cd-58fb-44ab-b941-691bfcd3669f tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:25.378543 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7419a6cd-58fb-44ab-b941-691bfcd3669f tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:25.746151 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7419a6cd-58fb-44ab-b941-691bfcd3669f tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20be7bbc39a49a89aa2caf2bb328be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209fb9b0936b483aa902a5c12803bc48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:25.759571 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7419a6cd-58fb-44ab-b941-691bfcd3669f tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] 10.222.0.27 "GET /compute/v2.1/servers/6b8c23b2-8127-4488-b785-44f1abc16edd" status: 200 len: 1314 microversion: 2.1 time: 0.408976 Sep 08 11:12:25.760921 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2872/5636] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:12:25 2022] GET /compute/v2.1/servers/6b8c23b2-8127-4488-b785-44f1abc16edd => generated 1314 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:12:26.228620 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-893aa0f8-166d-4314-81fa-08a0633f423f tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:26.229418 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-893aa0f8-166d-4314-81fa-08a0633f423f tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] [instance: 0316b49d-d664-44c6-b57c-f84d163bfd0d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:26.277016 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-893aa0f8-166d-4314-81fa-08a0633f423f tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:26.278069 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-893aa0f8-166d-4314-81fa-08a0633f423f tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:26.278605 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-893aa0f8-166d-4314-81fa-08a0633f423f tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:26.281292 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-893aa0f8-166d-4314-81fa-08a0633f423f tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:26.282169 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-893aa0f8-166d-4314-81fa-08a0633f423f tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:26.285831 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-893aa0f8-166d-4314-81fa-08a0633f423f tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:26.432822 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-893aa0f8-166d-4314-81fa-08a0633f423f tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:26.451108 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-893aa0f8-166d-4314-81fa-08a0633f423f tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:26.452932 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-893aa0f8-166d-4314-81fa-08a0633f423f tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:26.455628 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-893aa0f8-166d-4314-81fa-08a0633f423f tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] 10.222.0.27 "GET /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d" status: 200 len: 1365 microversion: 2.57 time: 0.231259 Sep 08 11:12:26.461089 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2765/5637] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:12:26 2022] GET /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d => generated 1365 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:12:26.784117 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7825a2e4-d1cc-4ab7-9fa5-95a9ebd11cef tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:26.784740 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7825a2e4-d1cc-4ab7-9fa5-95a9ebd11cef tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] [instance: 6b8c23b2-8127-4488-b785-44f1abc16edd] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:26.792565 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7825a2e4-d1cc-4ab7-9fa5-95a9ebd11cef tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:26.793396 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7825a2e4-d1cc-4ab7-9fa5-95a9ebd11cef tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:26.794008 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7825a2e4-d1cc-4ab7-9fa5-95a9ebd11cef tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:26.795058 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7825a2e4-d1cc-4ab7-9fa5-95a9ebd11cef tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:26.795791 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7825a2e4-d1cc-4ab7-9fa5-95a9ebd11cef tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:26.796387 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7825a2e4-d1cc-4ab7-9fa5-95a9ebd11cef tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:27.025987 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7825a2e4-d1cc-4ab7-9fa5-95a9ebd11cef tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20be7bbc39a49a89aa2caf2bb328be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209fb9b0936b483aa902a5c12803bc48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:27.039024 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7825a2e4-d1cc-4ab7-9fa5-95a9ebd11cef tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] 10.222.0.27 "GET /compute/v2.1/servers/6b8c23b2-8127-4488-b785-44f1abc16edd" status: 200 len: 1314 microversion: 2.1 time: 0.258942 Sep 08 11:12:27.039647 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2873/5638] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:12:26 2022] GET /compute/v2.1/servers/6b8c23b2-8127-4488-b785-44f1abc16edd => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:12:27.495125 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c936d906-3131-475f-89ce-ecea28cf98d8 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:27.495750 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c936d906-3131-475f-89ce-ecea28cf98d8 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] [instance: 0316b49d-d664-44c6-b57c-f84d163bfd0d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:27.502623 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c936d906-3131-475f-89ce-ecea28cf98d8 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:27.504522 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c936d906-3131-475f-89ce-ecea28cf98d8 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:27.505601 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c936d906-3131-475f-89ce-ecea28cf98d8 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:27.506756 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c936d906-3131-475f-89ce-ecea28cf98d8 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:27.507876 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c936d906-3131-475f-89ce-ecea28cf98d8 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:27.508764 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c936d906-3131-475f-89ce-ecea28cf98d8 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:27.590656 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c936d906-3131-475f-89ce-ecea28cf98d8 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:27.601082 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c936d906-3131-475f-89ce-ecea28cf98d8 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:27.603439 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c936d906-3131-475f-89ce-ecea28cf98d8 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:27.605061 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c936d906-3131-475f-89ce-ecea28cf98d8 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] 10.222.0.27 "GET /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d" status: 200 len: 1365 microversion: 2.57 time: 0.118082 Sep 08 11:12:27.606216 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2766/5639] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:12:27 2022] GET /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d => generated 1365 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:12:28.066991 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d7aa372a-cf09-4c95-9ab0-63570c850c6a tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:28.068002 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d7aa372a-cf09-4c95-9ab0-63570c850c6a tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] [instance: 6b8c23b2-8127-4488-b785-44f1abc16edd] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:28.075184 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d7aa372a-cf09-4c95-9ab0-63570c850c6a tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:28.075691 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d7aa372a-cf09-4c95-9ab0-63570c850c6a tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:28.076129 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d7aa372a-cf09-4c95-9ab0-63570c850c6a tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:28.076844 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d7aa372a-cf09-4c95-9ab0-63570c850c6a tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:28.077338 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d7aa372a-cf09-4c95-9ab0-63570c850c6a tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:28.077803 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d7aa372a-cf09-4c95-9ab0-63570c850c6a tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:28.235917 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d7aa372a-cf09-4c95-9ab0-63570c850c6a tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20be7bbc39a49a89aa2caf2bb328be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209fb9b0936b483aa902a5c12803bc48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:28.242809 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:12:28.246110 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d7aa372a-cf09-4c95-9ab0-63570c850c6a tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] 10.222.0.27 "GET /compute/v2.1/servers/6b8c23b2-8127-4488-b785-44f1abc16edd" status: 200 len: 1314 microversion: 2.1 time: 0.183562 Sep 08 11:12:28.246693 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2874/5640] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:12:28 2022] GET /compute/v2.1/servers/6b8c23b2-8127-4488-b785-44f1abc16edd => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:12:28.632187 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c99d465d-08ab-498a-b514-cacaadb6dd14 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:28.633787 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c99d465d-08ab-498a-b514-cacaadb6dd14 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] [instance: 0316b49d-d664-44c6-b57c-f84d163bfd0d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:28.647233 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c99d465d-08ab-498a-b514-cacaadb6dd14 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:28.648187 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c99d465d-08ab-498a-b514-cacaadb6dd14 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:28.649526 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c99d465d-08ab-498a-b514-cacaadb6dd14 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:28.654507 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c99d465d-08ab-498a-b514-cacaadb6dd14 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:28.655258 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c99d465d-08ab-498a-b514-cacaadb6dd14 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:28.655968 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c99d465d-08ab-498a-b514-cacaadb6dd14 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:28.690353 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:12:28.828347 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c99d465d-08ab-498a-b514-cacaadb6dd14 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:28.845048 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c99d465d-08ab-498a-b514-cacaadb6dd14 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:28.846723 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c99d465d-08ab-498a-b514-cacaadb6dd14 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:28.847955 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c99d465d-08ab-498a-b514-cacaadb6dd14 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] 10.222.0.27 "GET /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d" status: 200 len: 1365 microversion: 2.57 time: 0.220011 Sep 08 11:12:28.868336 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2767/5641] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:12:28 2022] GET /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d => generated 1365 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:12:29.271126 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7d6ddd44-2720-47a5-818d-7c7a5abafad7 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:29.271761 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7d6ddd44-2720-47a5-818d-7c7a5abafad7 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] [instance: 6b8c23b2-8127-4488-b785-44f1abc16edd] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:29.289328 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7d6ddd44-2720-47a5-818d-7c7a5abafad7 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:29.292373 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7d6ddd44-2720-47a5-818d-7c7a5abafad7 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:29.293017 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7d6ddd44-2720-47a5-818d-7c7a5abafad7 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:29.293983 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7d6ddd44-2720-47a5-818d-7c7a5abafad7 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:29.298379 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7d6ddd44-2720-47a5-818d-7c7a5abafad7 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:29.300670 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7d6ddd44-2720-47a5-818d-7c7a5abafad7 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:29.390192 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:12:29.425444 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=6 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:12:29.539598 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7d6ddd44-2720-47a5-818d-7c7a5abafad7 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20be7bbc39a49a89aa2caf2bb328be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209fb9b0936b483aa902a5c12803bc48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:29.551456 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7d6ddd44-2720-47a5-818d-7c7a5abafad7 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] 10.222.0.27 "GET /compute/v2.1/servers/6b8c23b2-8127-4488-b785-44f1abc16edd" status: 200 len: 1314 microversion: 2.1 time: 0.285354 Sep 08 11:12:29.553575 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2875/5642] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:12:29 2022] GET /compute/v2.1/servers/6b8c23b2-8127-4488-b785-44f1abc16edd => generated 1314 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:12:29.899747 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dcf65fb3-295b-4e87-8975-6788cea4f18a tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:29.900588 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-dcf65fb3-295b-4e87-8975-6788cea4f18a tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] [instance: 0316b49d-d664-44c6-b57c-f84d163bfd0d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:29.904647 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:12:29.909930 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dcf65fb3-295b-4e87-8975-6788cea4f18a tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:29.911070 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dcf65fb3-295b-4e87-8975-6788cea4f18a tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:29.911315 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dcf65fb3-295b-4e87-8975-6788cea4f18a tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:29.914032 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dcf65fb3-295b-4e87-8975-6788cea4f18a tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:29.914783 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dcf65fb3-295b-4e87-8975-6788cea4f18a tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:29.915379 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dcf65fb3-295b-4e87-8975-6788cea4f18a tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:30.024065 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-dcf65fb3-295b-4e87-8975-6788cea4f18a tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:30.033593 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-dcf65fb3-295b-4e87-8975-6788cea4f18a tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:30.035873 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-dcf65fb3-295b-4e87-8975-6788cea4f18a tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:30.037152 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-dcf65fb3-295b-4e87-8975-6788cea4f18a tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] 10.222.0.27 "GET /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d" status: 200 len: 1365 microversion: 2.57 time: 0.147983 Sep 08 11:12:30.038105 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2768/5643] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:12:29 2022] GET /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:12:30.583535 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b9e2777e-4863-489c-aca1-b57f85747a50 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:30.586139 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b9e2777e-4863-489c-aca1-b57f85747a50 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] [instance: 6b8c23b2-8127-4488-b785-44f1abc16edd] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:30.598421 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b9e2777e-4863-489c-aca1-b57f85747a50 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:30.598922 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b9e2777e-4863-489c-aca1-b57f85747a50 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:30.599468 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b9e2777e-4863-489c-aca1-b57f85747a50 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:30.600402 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b9e2777e-4863-489c-aca1-b57f85747a50 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:30.601048 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b9e2777e-4863-489c-aca1-b57f85747a50 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:30.601671 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b9e2777e-4863-489c-aca1-b57f85747a50 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:30.783900 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b9e2777e-4863-489c-aca1-b57f85747a50 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20be7bbc39a49a89aa2caf2bb328be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209fb9b0936b483aa902a5c12803bc48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:30.795288 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b9e2777e-4863-489c-aca1-b57f85747a50 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] 10.222.0.27 "GET /compute/v2.1/servers/6b8c23b2-8127-4488-b785-44f1abc16edd" status: 200 len: 1314 microversion: 2.1 time: 0.219339 Sep 08 11:12:30.796490 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2876/5644] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:12:30 2022] GET /compute/v2.1/servers/6b8c23b2-8127-4488-b785-44f1abc16edd => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:12:30.936450 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-62819d64-9f0d-42c4-898a-65d142b17f51 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:30.937428 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-62819d64-9f0d-42c4-898a-65d142b17f51 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:30.946217 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-62819d64-9f0d-42c4-898a-65d142b17f51 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:30.947057 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-62819d64-9f0d-42c4-898a-65d142b17f51 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:30.947910 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-62819d64-9f0d-42c4-898a-65d142b17f51 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:30.949220 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-62819d64-9f0d-42c4-898a-65d142b17f51 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:30.949940 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-62819d64-9f0d-42c4-898a-65d142b17f51 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:30.950747 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-62819d64-9f0d-42c4-898a-65d142b17f51 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:30.969902 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-68eac29a-c554-4275-9375-8216f5abf975 req-8252bc9b-e510-454f-86c4-2f6264e66a07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b8c23b2-8127-4488-b785-44f1abc16edd", "name": "network-vif-plugged", "status": "completed", "tag": "56f590fc-b946-40f9-bd6b-99f8d2d89b81"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:12:30.984525 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-68eac29a-c554-4275-9375-8216f5abf975 req-8252bc9b-e510-454f-86c4-2f6264e66a07 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:30.985341 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-68eac29a-c554-4275-9375-8216f5abf975 req-8252bc9b-e510-454f-86c4-2f6264e66a07 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:30.986008 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-68eac29a-c554-4275-9375-8216f5abf975 req-8252bc9b-e510-454f-86c4-2f6264e66a07 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:30.997370 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-62819d64-9f0d-42c4-898a-65d142b17f51 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e/ips" status: 200 len: 151 microversion: 2.20 time: 0.068130 Sep 08 11:12:30.998099 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2769/5645] 10.222.0.27 () {60 vars in 1289 bytes} [Thu Sep 8 11:12:30 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e/ips => generated 151 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 11:12:31.004105 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-68eac29a-c554-4275-9375-8216f5abf975 req-8252bc9b-e510-454f-86c4-2f6264e66a07 service nova] Creating event network-vif-plugged:56f590fc-b946-40f9-bd6b-99f8d2d89b81 for instance 6b8c23b2-8127-4488-b785-44f1abc16edd on n-h1-850501-12 Sep 08 11:12:31.019069 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-68eac29a-c554-4275-9375-8216f5abf975 req-8252bc9b-e510-454f-86c4-2f6264e66a07 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051561 Sep 08 11:12:31.020155 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2877/5646] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:12:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:12:31.065675 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5ebe8bb1-0055-456d-aa4b-af72778499b9 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:31.066254 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5ebe8bb1-0055-456d-aa4b-af72778499b9 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] [instance: 0316b49d-d664-44c6-b57c-f84d163bfd0d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:31.075801 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ebe8bb1-0055-456d-aa4b-af72778499b9 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:31.076324 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ebe8bb1-0055-456d-aa4b-af72778499b9 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:31.076758 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ebe8bb1-0055-456d-aa4b-af72778499b9 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:31.077514 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ebe8bb1-0055-456d-aa4b-af72778499b9 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:31.078366 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ebe8bb1-0055-456d-aa4b-af72778499b9 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:31.078366 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ebe8bb1-0055-456d-aa4b-af72778499b9 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:31.164001 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5ebe8bb1-0055-456d-aa4b-af72778499b9 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:31.173000 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5ebe8bb1-0055-456d-aa4b-af72778499b9 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:31.178504 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5ebe8bb1-0055-456d-aa4b-af72778499b9 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:31.179852 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5ebe8bb1-0055-456d-aa4b-af72778499b9 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] 10.222.0.27 "GET /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d" status: 200 len: 1371 microversion: 2.57 time: 0.119934 Sep 08 11:12:31.184667 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2770/5647] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:12:31 2022] GET /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d => generated 1371 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:12:31.448748 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-acfd4456-f15b-460a-8122-35680620189b tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Action: 'create', calling method: .version_select at 0x7f68e4d688b0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-809851702", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBADtcU0nWZRtEWaviOawHmnjUpblVCnNSxi5qlwYyB/sVYVlk4lG2qxMj9YalRJIdCqbvpQTACvEHAVOMQe5EYxZtqzMFbuifrvfIMRZS33eabE+uzQN1IInJxY2AMb4Bw=="}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:12:31.511981 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-acfd4456-f15b-460a-8122-35680620189b tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Getting quotas for project a0f9071124e74802a2f76cb326ca58df. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:12:31.542074 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-acfd4456-f15b-460a-8122-35680620189b tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Getting quotas for user c33e91fa4e3746aa8d8d23940e17bc1e and project a0f9071124e74802a2f76cb326ca58df. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:12:31.603530 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-acfd4456-f15b-460a-8122-35680620189b tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.469280 Sep 08 11:12:31.622994 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2878/5648] 10.222.0.27 () {60 vars in 1159 bytes} [Thu Sep 8 11:12:31 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:12:31.821210 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a289d253-367c-4fa2-bd92-e70f7a36974e tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:31.822143 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a289d253-367c-4fa2-bd92-e70f7a36974e tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] [instance: 6b8c23b2-8127-4488-b785-44f1abc16edd] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:31.834184 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a289d253-367c-4fa2-bd92-e70f7a36974e tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:31.835043 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a289d253-367c-4fa2-bd92-e70f7a36974e tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:31.835865 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a289d253-367c-4fa2-bd92-e70f7a36974e tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:31.836898 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a289d253-367c-4fa2-bd92-e70f7a36974e tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:31.837815 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a289d253-367c-4fa2-bd92-e70f7a36974e tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:31.838730 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a289d253-367c-4fa2-bd92-e70f7a36974e tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:32.095834 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a289d253-367c-4fa2-bd92-e70f7a36974e tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20be7bbc39a49a89aa2caf2bb328be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209fb9b0936b483aa902a5c12803bc48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:32.128732 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a289d253-367c-4fa2-bd92-e70f7a36974e tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] 10.222.0.27 "GET /compute/v2.1/servers/6b8c23b2-8127-4488-b785-44f1abc16edd" status: 200 len: 1314 microversion: 2.1 time: 0.311549 Sep 08 11:12:32.141709 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2771/5649] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:12:31 2022] GET /compute/v2.1/servers/6b8c23b2-8127-4488-b785-44f1abc16edd => generated 1314 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:12:32.209996 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b280f944-4960-401b-b4d8-ec62983b1854 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:32.210795 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b280f944-4960-401b-b4d8-ec62983b1854 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] [instance: 0316b49d-d664-44c6-b57c-f84d163bfd0d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:32.464462 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b280f944-4960-401b-b4d8-ec62983b1854 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:32.464462 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b280f944-4960-401b-b4d8-ec62983b1854 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:32.464462 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b280f944-4960-401b-b4d8-ec62983b1854 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:32.464462 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b280f944-4960-401b-b4d8-ec62983b1854 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:32.464462 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b280f944-4960-401b-b4d8-ec62983b1854 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:32.464462 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b280f944-4960-401b-b4d8-ec62983b1854 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:32.503537 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b280f944-4960-401b-b4d8-ec62983b1854 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:32.527156 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b280f944-4960-401b-b4d8-ec62983b1854 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:32.530060 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b280f944-4960-401b-b4d8-ec62983b1854 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:32.532016 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b280f944-4960-401b-b4d8-ec62983b1854 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] 10.222.0.27 "GET /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d" status: 200 len: 1371 microversion: 2.57 time: 0.326801 Sep 08 11:12:32.538708 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2879/5650] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:12:32 2022] GET /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d => generated 1371 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:12:33.154997 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1c6da17a-7441-400e-965b-0eb9552a2dfd tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:33.156386 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1c6da17a-7441-400e-965b-0eb9552a2dfd tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] [instance: 6b8c23b2-8127-4488-b785-44f1abc16edd] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:33.193433 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c6da17a-7441-400e-965b-0eb9552a2dfd tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:33.193968 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c6da17a-7441-400e-965b-0eb9552a2dfd tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:33.194423 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c6da17a-7441-400e-965b-0eb9552a2dfd tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:33.198692 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c6da17a-7441-400e-965b-0eb9552a2dfd tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:33.199642 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c6da17a-7441-400e-965b-0eb9552a2dfd tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:33.200386 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c6da17a-7441-400e-965b-0eb9552a2dfd tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:33.480909 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1c6da17a-7441-400e-965b-0eb9552a2dfd tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20be7bbc39a49a89aa2caf2bb328be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209fb9b0936b483aa902a5c12803bc48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:33.493089 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1c6da17a-7441-400e-965b-0eb9552a2dfd tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] 10.222.0.27 "GET /compute/v2.1/servers/6b8c23b2-8127-4488-b785-44f1abc16edd" status: 200 len: 1464 microversion: 2.1 time: 0.342094 Sep 08 11:12:33.505069 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2772/5651] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:12:33 2022] GET /compute/v2.1/servers/6b8c23b2-8127-4488-b785-44f1abc16edd => generated 1464 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:12:33.520439 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-60b5b906-237d-4197-b4db-05f1b99f7056 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bca08959-0445-41b2-a706-771b9c218d45", "device": "/dev/sdb"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:12:33.522320 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-60b5b906-237d-4197-b4db-05f1b99f7056 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] [instance: 6b8c23b2-8127-4488-b785-44f1abc16edd] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:33.524995 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:12:33.539507 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-60b5b906-237d-4197-b4db-05f1b99f7056 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:33.540430 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-60b5b906-237d-4197-b4db-05f1b99f7056 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:33.541131 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-60b5b906-237d-4197-b4db-05f1b99f7056 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:33.542082 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-60b5b906-237d-4197-b4db-05f1b99f7056 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:33.542771 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-60b5b906-237d-4197-b4db-05f1b99f7056 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:33.543400 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-60b5b906-237d-4197-b4db-05f1b99f7056 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:33.618040 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-42d39a59-1f9d-482e-8c0f-49991c6eaf3d tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:33.619525 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-42d39a59-1f9d-482e-8c0f-49991c6eaf3d tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] [instance: 0316b49d-d664-44c6-b57c-f84d163bfd0d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:33.645376 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42d39a59-1f9d-482e-8c0f-49991c6eaf3d tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:33.647817 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42d39a59-1f9d-482e-8c0f-49991c6eaf3d tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:33.648643 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42d39a59-1f9d-482e-8c0f-49991c6eaf3d tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:33.650434 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42d39a59-1f9d-482e-8c0f-49991c6eaf3d tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:33.654230 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42d39a59-1f9d-482e-8c0f-49991c6eaf3d tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:33.654749 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42d39a59-1f9d-482e-8c0f-49991c6eaf3d tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:33.812879 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-42d39a59-1f9d-482e-8c0f-49991c6eaf3d tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:33.825464 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-42d39a59-1f9d-482e-8c0f-49991c6eaf3d tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:33.827668 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-42d39a59-1f9d-482e-8c0f-49991c6eaf3d tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:33.829170 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-42d39a59-1f9d-482e-8c0f-49991c6eaf3d tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] 10.222.0.27 "GET /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d" status: 200 len: 1356 microversion: 2.57 time: 0.266140 Sep 08 11:12:33.853251 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2773/5652] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:12:33 2022] GET /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d => generated 1356 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:12:33.863528 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a05aa093-d717-4459-a418-88aac80d266d tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:33.864390 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a05aa093-d717-4459-a418-88aac80d266d tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] [instance: 0316b49d-d664-44c6-b57c-f84d163bfd0d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:33.873709 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a05aa093-d717-4459-a418-88aac80d266d tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:33.874352 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a05aa093-d717-4459-a418-88aac80d266d tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:33.875226 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a05aa093-d717-4459-a418-88aac80d266d tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:33.876463 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a05aa093-d717-4459-a418-88aac80d266d tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:33.877507 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a05aa093-d717-4459-a418-88aac80d266d tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:33.878477 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a05aa093-d717-4459-a418-88aac80d266d tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:33.958180 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a05aa093-d717-4459-a418-88aac80d266d tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] [instance: 0316b49d-d664-44c6-b57c-f84d163bfd0d] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:12:34.039016 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-60b5b906-237d-4197-b4db-05f1b99f7056 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] 10.222.0.27 "POST /compute/v2.1/servers/6b8c23b2-8127-4488-b785-44f1abc16edd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.524208 Sep 08 11:12:34.040671 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2880/5653] 10.222.0.27 () {60 vars in 1323 bytes} [Thu Sep 8 11:12:33 2022] POST /compute/v2.1/servers/6b8c23b2-8127-4488-b785-44f1abc16edd/os-volume_attachments => generated 194 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:12:34.114936 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a05aa093-d717-4459-a418-88aac80d266d tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d" status: 204 len: 0 microversion: 2.57 time: 0.258753 Sep 08 11:12:34.115814 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2774/5654] 10.222.0.27 () {60 vars in 1280 bytes} [Thu Sep 8 11:12:33 2022] DELETE /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 08 11:12:34.128576 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6e5dad28-490b-40e4-8d9e-e018fdfbc490 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:34.129526 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6e5dad28-490b-40e4-8d9e-e018fdfbc490 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] [instance: 0316b49d-d664-44c6-b57c-f84d163bfd0d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:34.140055 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6e5dad28-490b-40e4-8d9e-e018fdfbc490 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:34.141311 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6e5dad28-490b-40e4-8d9e-e018fdfbc490 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:34.142032 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6e5dad28-490b-40e4-8d9e-e018fdfbc490 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:34.142883 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6e5dad28-490b-40e4-8d9e-e018fdfbc490 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:34.143638 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6e5dad28-490b-40e4-8d9e-e018fdfbc490 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:34.144688 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6e5dad28-490b-40e4-8d9e-e018fdfbc490 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:34.309460 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6e5dad28-490b-40e4-8d9e-e018fdfbc490 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:34.328033 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6e5dad28-490b-40e4-8d9e-e018fdfbc490 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:34.332582 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6e5dad28-490b-40e4-8d9e-e018fdfbc490 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:34.335279 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6e5dad28-490b-40e4-8d9e-e018fdfbc490 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] 10.222.0.27 "GET /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d" status: 200 len: 1362 microversion: 2.57 time: 0.214268 Sep 08 11:12:34.336955 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2881/5655] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:12:34 2022] GET /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d => generated 1362 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 11:12:34.845744 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-30e3291e-fb00-448c-91c1-af8e3be54f69 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:12:34.847771 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-30e3291e-fb00-448c-91c1-af8e3be54f69 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:34.869241 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-30e3291e-fb00-448c-91c1-af8e3be54f69 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:34.873354 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-30e3291e-fb00-448c-91c1-af8e3be54f69 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:34.878846 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-30e3291e-fb00-448c-91c1-af8e3be54f69 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:34.880187 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-30e3291e-fb00-448c-91c1-af8e3be54f69 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:34.881126 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-30e3291e-fb00-448c-91c1-af8e3be54f69 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:34.881785 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-30e3291e-fb00-448c-91c1-af8e3be54f69 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:34.949013 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-30e3291e-fb00-448c-91c1-af8e3be54f69 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lazy-loading 'flavor' on Instance uuid f9c23be4-60f4-4bff-9e0d-8040618b552e {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:12:35.253110 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-30e3291e-fb00-448c-91c1-af8e3be54f69 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "POST /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e/action" status: 202 len: 0 microversion: 2.20 time: 0.411396 Sep 08 11:12:35.254355 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2775/5656] 10.222.0.27 () {62 vars in 1319 bytes} [Thu Sep 8 11:12:34 2022] POST /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e/action => generated 0 bytes in 414 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:12:35.265041 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-944f5e68-54de-4ac4-b30f-921ca1c65879 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:35.265664 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-944f5e68-54de-4ac4-b30f-921ca1c65879 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:35.279031 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-944f5e68-54de-4ac4-b30f-921ca1c65879 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:35.284263 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-944f5e68-54de-4ac4-b30f-921ca1c65879 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:35.289824 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-944f5e68-54de-4ac4-b30f-921ca1c65879 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:35.290602 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-944f5e68-54de-4ac4-b30f-921ca1c65879 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:35.291083 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-944f5e68-54de-4ac4-b30f-921ca1c65879 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:35.291514 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-944f5e68-54de-4ac4-b30f-921ca1c65879 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:35.369447 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7ab759af-4e39-4103-aece-cfd6ccb8f23c tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:35.370408 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7ab759af-4e39-4103-aece-cfd6ccb8f23c tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] [instance: 0316b49d-d664-44c6-b57c-f84d163bfd0d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:35.389886 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ab759af-4e39-4103-aece-cfd6ccb8f23c tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:35.390412 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ab759af-4e39-4103-aece-cfd6ccb8f23c tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:35.390861 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ab759af-4e39-4103-aece-cfd6ccb8f23c tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:35.391799 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ab759af-4e39-4103-aece-cfd6ccb8f23c tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:35.392271 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ab759af-4e39-4103-aece-cfd6ccb8f23c tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:35.392704 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ab759af-4e39-4103-aece-cfd6ccb8f23c tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:35.541285 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7ab759af-4e39-4103-aece-cfd6ccb8f23c tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:35.552500 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7ab759af-4e39-4103-aece-cfd6ccb8f23c tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:35.554014 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7ab759af-4e39-4103-aece-cfd6ccb8f23c tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:35.555378 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7ab759af-4e39-4103-aece-cfd6ccb8f23c tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] 10.222.0.27 "GET /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d" status: 200 len: 1362 microversion: 2.57 time: 0.190442 Sep 08 11:12:35.573156 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2776/5657] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:12:35 2022] GET /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d => generated 1362 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:12:35.734439 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-944f5e68-54de-4ac4-b30f-921ca1c65879 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:35.751608 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-944f5e68-54de-4ac4-b30f-921ca1c65879 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:35.759809 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-944f5e68-54de-4ac4-b30f-921ca1c65879 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:35.766802 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-944f5e68-54de-4ac4-b30f-921ca1c65879 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e" status: 200 len: 1722 microversion: 2.20 time: 0.505979 Sep 08 11:12:35.773562 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2882/5658] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:12:35 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e => generated 1722 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:12:36.587140 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7d86dfc3-4e96-4bec-8ec9-5e72bda99a81 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:36.587803 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7d86dfc3-4e96-4bec-8ec9-5e72bda99a81 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] [instance: 0316b49d-d664-44c6-b57c-f84d163bfd0d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:36.607517 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d86dfc3-4e96-4bec-8ec9-5e72bda99a81 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:36.608122 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d86dfc3-4e96-4bec-8ec9-5e72bda99a81 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:36.609786 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d86dfc3-4e96-4bec-8ec9-5e72bda99a81 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:36.611421 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d86dfc3-4e96-4bec-8ec9-5e72bda99a81 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:36.623528 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d86dfc3-4e96-4bec-8ec9-5e72bda99a81 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:36.624562 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d86dfc3-4e96-4bec-8ec9-5e72bda99a81 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:36.711703 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d86dfc3-4e96-4bec-8ec9-5e72bda99a81 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:36.712133 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d86dfc3-4e96-4bec-8ec9-5e72bda99a81 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:36.715025 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d86dfc3-4e96-4bec-8ec9-5e72bda99a81 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:36.715581 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-7d86dfc3-4e96-4bec-8ec9-5e72bda99a81 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lazy-loading 'fault' on Instance uuid 0316b49d-d664-44c6-b57c-f84d163bfd0d {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:12:36.799488 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-379fb3b1-fd8c-412d-9793-214a53be0730 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:36.800390 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-379fb3b1-fd8c-412d-9793-214a53be0730 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:36.800576 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7d86dfc3-4e96-4bec-8ec9-5e72bda99a81 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:36.810652 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7d86dfc3-4e96-4bec-8ec9-5e72bda99a81 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:36.813496 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7d86dfc3-4e96-4bec-8ec9-5e72bda99a81 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0aa6292046a04e38bc419b707919df92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c071fd644d3f490294520a07946f9ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:36.819208 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7d86dfc3-4e96-4bec-8ec9-5e72bda99a81 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] 10.222.0.27 "GET /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d" status: 200 len: 1367 microversion: 2.57 time: 0.239795 Sep 08 11:12:36.819413 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-379fb3b1-fd8c-412d-9793-214a53be0730 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:36.821114 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-379fb3b1-fd8c-412d-9793-214a53be0730 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:36.821933 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2777/5659] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:12:36 2022] GET /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d => generated 1367 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:12:36.823270 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-379fb3b1-fd8c-412d-9793-214a53be0730 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:36.826724 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-379fb3b1-fd8c-412d-9793-214a53be0730 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:36.831710 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-379fb3b1-fd8c-412d-9793-214a53be0730 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:36.832291 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-379fb3b1-fd8c-412d-9793-214a53be0730 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:37.539217 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-379fb3b1-fd8c-412d-9793-214a53be0730 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:37.554488 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-379fb3b1-fd8c-412d-9793-214a53be0730 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:37.556266 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-379fb3b1-fd8c-412d-9793-214a53be0730 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:37.558142 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-379fb3b1-fd8c-412d-9793-214a53be0730 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e" status: 200 len: 1722 microversion: 2.20 time: 0.763311 Sep 08 11:12:37.559263 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2883/5660] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:12:36 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e => generated 1722 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:12:37.861504 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-30323421-5442-4265-9ab2-0a6b2c4c3a04 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:37.862164 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-30323421-5442-4265-9ab2-0a6b2c4c3a04 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] [instance: 0316b49d-d664-44c6-b57c-f84d163bfd0d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:37.879867 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-30323421-5442-4265-9ab2-0a6b2c4c3a04 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:37.880343 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-30323421-5442-4265-9ab2-0a6b2c4c3a04 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:37.880981 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-30323421-5442-4265-9ab2-0a6b2c4c3a04 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:37.881915 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-30323421-5442-4265-9ab2-0a6b2c4c3a04 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:37.882539 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-30323421-5442-4265-9ab2-0a6b2c4c3a04 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:37.883130 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-30323421-5442-4265-9ab2-0a6b2c4c3a04 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:37.901192 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-30323421-5442-4265-9ab2-0a6b2c4c3a04 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] HTTP exception thrown: Instance 0316b49d-d664-44c6-b57c-f84d163bfd0d could not be found. Sep 08 11:12:37.904358 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-30323421-5442-4265-9ab2-0a6b2c4c3a04 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Request method failure captured: Sep 08 11:12:37.904358 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d HTTP/1.1 Sep 08 11:12:37.904358 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 11:12:37.904358 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 11:12:37.904358 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 11:12:37.904358 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 11:12:37.904358 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 11:12:37.904358 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 11:12:37.904358 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 11:12:37.904358 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 11:12:37.904358 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGc33az_NSawlI0kLCYmti6fbGHRvSbk7Qxefzq7aLr9X7YoxxJFkNWw9enK6AyviamGn5w7hwDfoDCm1nMTZkwfSXl-Gp-daVi4hovnis4h4iJu4096unAePfWI0QW3VgWl2XoaN7SvqD-UxkAEgSAO27WnakbUndnPfUMazqG1X1uY Sep 08 11:12:37.904358 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 11:12:37.904358 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 11:12:37.904358 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 11:12:37.904358 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 11:12:37.904358 n-d-850501-12 devstack@n-api.service[128862]: X-Openstack-Nova-Api-Version: 2.57 Sep 08 11:12:37.904358 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 11:12:37.904358 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 11:12:37.904358 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: c071fd644d3f490294520a07946f9ed9 Sep 08 11:12:37.904358 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServerShowV257Test-1956810863 Sep 08 11:12:37.904358 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 11:12:37.904358 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 11:12:37.904358 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c071fd644d3f490294520a07946f9ed9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c071fd644d3f490294520a07946f9ed9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c071fd644d3f490294520a07946f9ed9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c071fd644d3f490294520a07946f9ed9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:12:37.904358 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServerShowV257Test-1956810863 Sep 08 11:12:37.904358 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: c071fd644d3f490294520a07946f9ed9 Sep 08 11:12:37.904358 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServerShowV257Test-1956810863 Sep 08 11:12:37.904358 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServerShowV257Test-1956810863-project Sep 08 11:12:37.904358 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 11:12:37.904358 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 11:12:37.904358 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 0aa6292046a04e38bc419b707919df92 Sep 08 11:12:37.904358 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServerShowV257Test-1956810863-project Sep 08 11:12:37.904358 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 11:12:37.904358 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 0316b49d-d664-44c6-b57c-f84d163bfd0d could not be found. Sep 08 11:12:37.904358 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '0316b49d-d664-44c6-b57c-f84d163bfd0d'} Sep 08 11:12:37.904358 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:12:37.904358 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:12:37.904358 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:12:37.904358 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:12:37.904358 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:12:37.904358 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:12:37.904358 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:12:37.904358 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:12:37.904358 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:12:37.904358 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:12:37.904358 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0316b49d-d664-44c6-b57c-f84d163bfd0d could not be found. Sep 08 11:12:37.904358 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:12:37.904358 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:12:37.904358 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:12:37.904358 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:12:37.904358 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:12:37.904358 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:12:37.904358 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:12:37.904358 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:12:37.904358 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:12:37.904358 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:12:37.904358 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:12:37.904358 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:12:37.904358 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:12:37.904358 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:12:37.904358 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:12:37.904358 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:12:37.904358 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0316b49d-d664-44c6-b57c-f84d163bfd0d could not be found. Sep 08 11:12:37.904358 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:12:37.904358 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:12:37.904358 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:12:37.910798 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:12:37.910798 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:12:37.910798 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:12:37.910798 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:12:37.910798 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:12:37.910798 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0316b49d-d664-44c6-b57c-f84d163bfd0d could not be found. Sep 08 11:12:37.910798 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:12:37.912296 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-30323421-5442-4265-9ab2-0a6b2c4c3a04 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] Returning 404 to user: Instance 0316b49d-d664-44c6-b57c-f84d163bfd0d could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:12:37.914045 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-30323421-5442-4265-9ab2-0a6b2c4c3a04 tempest-ServerShowV257Test-1956810863 tempest-ServerShowV257Test-1956810863-project] 10.222.0.27 "GET /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d" status: 404 len: 111 microversion: 2.57 time: 0.056994 Sep 08 11:12:37.915359 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2778/5661] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:12:37 2022] GET /compute/v2.1/servers/0316b49d-d664-44c6-b57c-f84d163bfd0d => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 11:12:38.594661 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bcc1fb59-a68c-4643-9757-968f96a02fd7 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:38.595279 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bcc1fb59-a68c-4643-9757-968f96a02fd7 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:38.609123 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bcc1fb59-a68c-4643-9757-968f96a02fd7 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:38.609637 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bcc1fb59-a68c-4643-9757-968f96a02fd7 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:38.610087 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bcc1fb59-a68c-4643-9757-968f96a02fd7 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:38.610815 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bcc1fb59-a68c-4643-9757-968f96a02fd7 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:38.611277 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bcc1fb59-a68c-4643-9757-968f96a02fd7 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:38.612243 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bcc1fb59-a68c-4643-9757-968f96a02fd7 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:39.208837 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-bcc1fb59-a68c-4643-9757-968f96a02fd7 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:39.227461 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-bcc1fb59-a68c-4643-9757-968f96a02fd7 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:39.234825 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-bcc1fb59-a68c-4643-9757-968f96a02fd7 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:39.236286 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bcc1fb59-a68c-4643-9757-968f96a02fd7 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e" status: 200 len: 1722 microversion: 2.20 time: 0.646743 Sep 08 11:12:39.236932 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2884/5662] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:12:38 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e => generated 1722 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:12:40.267437 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-80911a1a-bf99-4df2-bb06-0b58ce421fac tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:40.269793 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-80911a1a-bf99-4df2-bb06-0b58ce421fac tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:40.323764 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80911a1a-bf99-4df2-bb06-0b58ce421fac tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:40.325707 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80911a1a-bf99-4df2-bb06-0b58ce421fac tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:40.326541 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80911a1a-bf99-4df2-bb06-0b58ce421fac tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:40.327528 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80911a1a-bf99-4df2-bb06-0b58ce421fac tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:40.333183 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80911a1a-bf99-4df2-bb06-0b58ce421fac tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:40.334675 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80911a1a-bf99-4df2-bb06-0b58ce421fac tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:40.975336 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-80911a1a-bf99-4df2-bb06-0b58ce421fac tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:40.990466 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-80911a1a-bf99-4df2-bb06-0b58ce421fac tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:40.992438 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-80911a1a-bf99-4df2-bb06-0b58ce421fac tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:41.004269 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-80911a1a-bf99-4df2-bb06-0b58ce421fac tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e" status: 200 len: 1722 microversion: 2.20 time: 0.738104 Sep 08 11:12:41.031118 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2779/5663] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:12:40 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e => generated 1722 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:12:42.038932 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5f85d44f-0b94-4f36-a7f7-51a957f7f327 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:42.039610 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5f85d44f-0b94-4f36-a7f7-51a957f7f327 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:42.056093 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=4 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:12:42.069438 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5f85d44f-0b94-4f36-a7f7-51a957f7f327 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:42.070070 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5f85d44f-0b94-4f36-a7f7-51a957f7f327 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:42.070554 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5f85d44f-0b94-4f36-a7f7-51a957f7f327 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:42.076457 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5f85d44f-0b94-4f36-a7f7-51a957f7f327 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:42.077884 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5f85d44f-0b94-4f36-a7f7-51a957f7f327 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:42.078338 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5f85d44f-0b94-4f36-a7f7-51a957f7f327 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:42.591393 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5f85d44f-0b94-4f36-a7f7-51a957f7f327 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:42.614320 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5f85d44f-0b94-4f36-a7f7-51a957f7f327 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:42.624946 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5f85d44f-0b94-4f36-a7f7-51a957f7f327 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:42.637115 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5f85d44f-0b94-4f36-a7f7-51a957f7f327 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e" status: 200 len: 1722 microversion: 2.20 time: 0.602433 Sep 08 11:12:42.637815 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2885/5664] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:12:42 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e => generated 1722 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 11:12:43.669674 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6c20444b-7cd0-4dbc-b06e-046abd3eebf6 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:43.671045 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6c20444b-7cd0-4dbc-b06e-046abd3eebf6 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:43.685553 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6c20444b-7cd0-4dbc-b06e-046abd3eebf6 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:43.686316 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6c20444b-7cd0-4dbc-b06e-046abd3eebf6 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:43.688180 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6c20444b-7cd0-4dbc-b06e-046abd3eebf6 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:43.690857 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6c20444b-7cd0-4dbc-b06e-046abd3eebf6 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:43.691743 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6c20444b-7cd0-4dbc-b06e-046abd3eebf6 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:43.694670 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6c20444b-7cd0-4dbc-b06e-046abd3eebf6 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:44.407779 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6c20444b-7cd0-4dbc-b06e-046abd3eebf6 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:44.418453 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6c20444b-7cd0-4dbc-b06e-046abd3eebf6 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:44.421227 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6c20444b-7cd0-4dbc-b06e-046abd3eebf6 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:44.422762 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6c20444b-7cd0-4dbc-b06e-046abd3eebf6 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e" status: 200 len: 1722 microversion: 2.20 time: 0.757378 Sep 08 11:12:44.424611 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2780/5665] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:12:43 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e => generated 1722 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:12:45.459683 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8d70d5cd-3441-4554-84d5-ebaeaf1ae353 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:45.461210 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8d70d5cd-3441-4554-84d5-ebaeaf1ae353 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:45.475549 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8d70d5cd-3441-4554-84d5-ebaeaf1ae353 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:45.476547 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8d70d5cd-3441-4554-84d5-ebaeaf1ae353 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:45.479477 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8d70d5cd-3441-4554-84d5-ebaeaf1ae353 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:45.480658 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8d70d5cd-3441-4554-84d5-ebaeaf1ae353 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:45.483281 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8d70d5cd-3441-4554-84d5-ebaeaf1ae353 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:45.484008 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8d70d5cd-3441-4554-84d5-ebaeaf1ae353 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:46.031772 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-81a0b668-2c39-4d51-9599-46b60e40a727 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1836260652", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "34cb4ffe-f30b-4f95-8e66-f6ceef2309e5"}], "key_name": "tempest-TestNetworkAdvancedServerOps-809851702", "security_groups": [{"name": "tempest-secgroup-smoke-1077325574"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:12:46.067911 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8d70d5cd-3441-4554-84d5-ebaeaf1ae353 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:46.105439 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8d70d5cd-3441-4554-84d5-ebaeaf1ae353 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:46.118831 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8d70d5cd-3441-4554-84d5-ebaeaf1ae353 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:46.122529 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8d70d5cd-3441-4554-84d5-ebaeaf1ae353 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e" status: 200 len: 1722 microversion: 2.20 time: 0.668830 Sep 08 11:12:46.131923 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2886/5666] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:12:45 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e => generated 1722 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 11:12:46.359853 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-81a0b668-2c39-4d51-9599-46b60e40a727 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] validate_networks() for [('34cb4ffe-f30b-4f95-8e66-f6ceef2309e5', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:12:47.188180 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3a6919a8-cc7f-4cb5-99ba-498dad16071d tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:47.189509 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3a6919a8-cc7f-4cb5-99ba-498dad16071d tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:47.208500 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3a6919a8-cc7f-4cb5-99ba-498dad16071d tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:47.212785 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3a6919a8-cc7f-4cb5-99ba-498dad16071d tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:47.213330 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3a6919a8-cc7f-4cb5-99ba-498dad16071d tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:47.214027 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3a6919a8-cc7f-4cb5-99ba-498dad16071d tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:47.214494 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3a6919a8-cc7f-4cb5-99ba-498dad16071d tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:47.214930 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3a6919a8-cc7f-4cb5-99ba-498dad16071d tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:47.738533 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-81a0b668-2c39-4d51-9599-46b60e40a727 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:12:47.738965 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-81a0b668-2c39-4d51-9599-46b60e40a727 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:12:47.739448 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-81a0b668-2c39-4d51-9599-46b60e40a727 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:12:47.739862 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-81a0b668-2c39-4d51-9599-46b60e40a727 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:12:47.740654 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-81a0b668-2c39-4d51-9599-46b60e40a727 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:12:47.774483 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81a0b668-2c39-4d51-9599-46b60e40a727 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:47.774941 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81a0b668-2c39-4d51-9599-46b60e40a727 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:47.776952 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81a0b668-2c39-4d51-9599-46b60e40a727 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:47.780231 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81a0b668-2c39-4d51-9599-46b60e40a727 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:47.786348 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81a0b668-2c39-4d51-9599-46b60e40a727 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:47.787014 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81a0b668-2c39-4d51-9599-46b60e40a727 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:47.840214 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:12:47.873262 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-3a6919a8-cc7f-4cb5-99ba-498dad16071d tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:47.889640 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-81a0b668-2c39-4d51-9599-46b60e40a727 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Getting quotas for project a0f9071124e74802a2f76cb326ca58df. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:12:47.918323 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-3a6919a8-cc7f-4cb5-99ba-498dad16071d tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:47.920122 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-3a6919a8-cc7f-4cb5-99ba-498dad16071d tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:47.929322 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-81a0b668-2c39-4d51-9599-46b60e40a727 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Getting quotas for user c33e91fa4e3746aa8d8d23940e17bc1e and project a0f9071124e74802a2f76cb326ca58df. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:12:47.936797 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3a6919a8-cc7f-4cb5-99ba-498dad16071d tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e" status: 200 len: 1722 microversion: 2.20 time: 0.759766 Sep 08 11:12:47.937617 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2887/5667] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:12:47 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e => generated 1722 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 11:12:47.997062 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-81a0b668-2c39-4d51-9599-46b60e40a727 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:12:48.005945 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-81a0b668-2c39-4d51-9599-46b60e40a727 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: af0ed4bb-bf39-4989-893c-14896abbc7d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:12:48.075788 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-81a0b668-2c39-4d51-9599-46b60e40a727 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.047829 Sep 08 11:12:48.078602 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2781/5668] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 11:12:46 2022] POST /compute/v2.1/servers => generated 406 bytes in 2052 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:12:48.089155 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7f77b3ba-e43e-41b7-a5d1-e4be4aaa742e tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:48.090918 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7f77b3ba-e43e-41b7-a5d1-e4be4aaa742e tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: af0ed4bb-bf39-4989-893c-14896abbc7d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:48.275820 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7f77b3ba-e43e-41b7-a5d1-e4be4aaa742e tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:48.288300 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7f77b3ba-e43e-41b7-a5d1-e4be4aaa742e tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5" status: 200 len: 1266 microversion: 2.1 time: 0.203098 Sep 08 11:12:48.289373 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2888/5669] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:12:48 2022] GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5 => generated 1266 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:12:48.975078 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3d8b6343-536f-44bc-9ad2-162267ea81bf tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:48.975884 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3d8b6343-536f-44bc-9ad2-162267ea81bf tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:49.004238 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d8b6343-536f-44bc-9ad2-162267ea81bf tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:49.005144 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d8b6343-536f-44bc-9ad2-162267ea81bf tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:49.007456 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d8b6343-536f-44bc-9ad2-162267ea81bf tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:49.008967 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d8b6343-536f-44bc-9ad2-162267ea81bf tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:49.010701 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d8b6343-536f-44bc-9ad2-162267ea81bf tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:49.013615 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d8b6343-536f-44bc-9ad2-162267ea81bf tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:49.317821 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-58459be7-ae13-43c6-b32e-e34eef197498 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:49.319951 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-58459be7-ae13-43c6-b32e-e34eef197498 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: af0ed4bb-bf39-4989-893c-14896abbc7d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:49.348687 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-58459be7-ae13-43c6-b32e-e34eef197498 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:49.351078 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-58459be7-ae13-43c6-b32e-e34eef197498 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:49.353327 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-58459be7-ae13-43c6-b32e-e34eef197498 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:49.357988 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-58459be7-ae13-43c6-b32e-e34eef197498 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:49.372488 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-58459be7-ae13-43c6-b32e-e34eef197498 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:49.375239 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-58459be7-ae13-43c6-b32e-e34eef197498 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:49.608977 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-58459be7-ae13-43c6-b32e-e34eef197498 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:49.635553 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-58459be7-ae13-43c6-b32e-e34eef197498 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5" status: 200 len: 1270 microversion: 2.1 time: 0.325480 Sep 08 11:12:49.638133 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2889/5670] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:12:49 2022] GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5 => generated 1270 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:12:49.728016 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3d8b6343-536f-44bc-9ad2-162267ea81bf tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:49.737760 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3d8b6343-536f-44bc-9ad2-162267ea81bf tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:49.743197 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3d8b6343-536f-44bc-9ad2-162267ea81bf tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:49.744686 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3d8b6343-536f-44bc-9ad2-162267ea81bf tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e" status: 200 len: 1722 microversion: 2.20 time: 0.773696 Sep 08 11:12:49.745779 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2782/5671] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:12:48 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e => generated 1722 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:12:50.721672 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ad35c23e-7bcd-439e-b9fc-d7818b62d53a tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:50.741893 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ad35c23e-7bcd-439e-b9fc-d7818b62d53a tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: af0ed4bb-bf39-4989-893c-14896abbc7d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:50.763399 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ad35c23e-7bcd-439e-b9fc-d7818b62d53a tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:50.765377 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ad35c23e-7bcd-439e-b9fc-d7818b62d53a tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:50.767509 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ad35c23e-7bcd-439e-b9fc-d7818b62d53a tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:50.769628 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ad35c23e-7bcd-439e-b9fc-d7818b62d53a tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:50.770914 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ad35c23e-7bcd-439e-b9fc-d7818b62d53a tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:50.771759 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ad35c23e-7bcd-439e-b9fc-d7818b62d53a tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:50.775666 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3b41c0b9-c945-4b3d-98ea-4f627aecfcad tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:50.776277 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3b41c0b9-c945-4b3d-98ea-4f627aecfcad tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:50.785276 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:12:50.802186 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b41c0b9-c945-4b3d-98ea-4f627aecfcad tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:50.802694 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b41c0b9-c945-4b3d-98ea-4f627aecfcad tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:50.803134 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b41c0b9-c945-4b3d-98ea-4f627aecfcad tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:50.803854 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b41c0b9-c945-4b3d-98ea-4f627aecfcad tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:50.804309 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b41c0b9-c945-4b3d-98ea-4f627aecfcad tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:50.804747 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b41c0b9-c945-4b3d-98ea-4f627aecfcad tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:51.052846 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ad35c23e-7bcd-439e-b9fc-d7818b62d53a tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:51.094386 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ad35c23e-7bcd-439e-b9fc-d7818b62d53a tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5" status: 200 len: 1326 microversion: 2.1 time: 0.410037 Sep 08 11:12:51.104405 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2890/5672] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:12:50 2022] GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5 => generated 1326 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:12:51.253390 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3b41c0b9-c945-4b3d-98ea-4f627aecfcad tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:51.262499 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3b41c0b9-c945-4b3d-98ea-4f627aecfcad tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:51.270062 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3b41c0b9-c945-4b3d-98ea-4f627aecfcad tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:51.271282 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3b41c0b9-c945-4b3d-98ea-4f627aecfcad tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e" status: 200 len: 1722 microversion: 2.20 time: 0.499557 Sep 08 11:12:51.291570 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2783/5673] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:12:50 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e => generated 1722 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:12:52.128767 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ae9c331d-2ab7-48c7-8495-65b79f7264c8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:52.129519 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ae9c331d-2ab7-48c7-8495-65b79f7264c8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: af0ed4bb-bf39-4989-893c-14896abbc7d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:52.159776 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ae9c331d-2ab7-48c7-8495-65b79f7264c8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:52.160915 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ae9c331d-2ab7-48c7-8495-65b79f7264c8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:52.165297 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ae9c331d-2ab7-48c7-8495-65b79f7264c8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:52.187854 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ae9c331d-2ab7-48c7-8495-65b79f7264c8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:52.196757 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ae9c331d-2ab7-48c7-8495-65b79f7264c8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:52.198817 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ae9c331d-2ab7-48c7-8495-65b79f7264c8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:52.320098 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fb18333f-bc57-4f3d-930b-50c171bab0df tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:52.321679 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fb18333f-bc57-4f3d-930b-50c171bab0df tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:52.369359 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb18333f-bc57-4f3d-930b-50c171bab0df tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:52.370263 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb18333f-bc57-4f3d-930b-50c171bab0df tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:52.374031 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb18333f-bc57-4f3d-930b-50c171bab0df tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:52.375071 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb18333f-bc57-4f3d-930b-50c171bab0df tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:52.376099 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb18333f-bc57-4f3d-930b-50c171bab0df tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:52.384397 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb18333f-bc57-4f3d-930b-50c171bab0df tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:52.411042 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ae9c331d-2ab7-48c7-8495-65b79f7264c8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:52.424289 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ae9c331d-2ab7-48c7-8495-65b79f7264c8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5" status: 200 len: 1324 microversion: 2.1 time: 0.298982 Sep 08 11:12:52.427011 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2891/5674] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:12:52 2022] GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5 => generated 1324 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:12:53.453901 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a42b1d5c-1070-4df7-84b1-c64550b06829 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:53.455049 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a42b1d5c-1070-4df7-84b1-c64550b06829 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: af0ed4bb-bf39-4989-893c-14896abbc7d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:53.504726 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a42b1d5c-1070-4df7-84b1-c64550b06829 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:53.505641 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a42b1d5c-1070-4df7-84b1-c64550b06829 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:53.506557 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a42b1d5c-1070-4df7-84b1-c64550b06829 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:53.507642 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a42b1d5c-1070-4df7-84b1-c64550b06829 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:53.508690 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a42b1d5c-1070-4df7-84b1-c64550b06829 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:53.509387 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a42b1d5c-1070-4df7-84b1-c64550b06829 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:53.702780 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a42b1d5c-1070-4df7-84b1-c64550b06829 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:53.722271 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:12:53.724851 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a42b1d5c-1070-4df7-84b1-c64550b06829 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5" status: 200 len: 1324 microversion: 2.1 time: 0.275513 Sep 08 11:12:53.737920 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2892/5675] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:12:53 2022] GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5 => generated 1324 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:12:53.815350 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fb18333f-bc57-4f3d-930b-50c171bab0df tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:53.830802 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fb18333f-bc57-4f3d-930b-50c171bab0df tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:53.832765 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fb18333f-bc57-4f3d-930b-50c171bab0df tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:53.836661 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fb18333f-bc57-4f3d-930b-50c171bab0df tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e" status: 200 len: 1722 microversion: 2.20 time: 1.533877 Sep 08 11:12:53.837546 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2784/5676] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:12:52 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e => generated 1722 bytes in 1537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:12:54.755218 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-af00e9e1-df1d-4083-b0bc-59e2caf6d721 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:54.755844 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-af00e9e1-df1d-4083-b0bc-59e2caf6d721 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: af0ed4bb-bf39-4989-893c-14896abbc7d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:54.802252 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-af00e9e1-df1d-4083-b0bc-59e2caf6d721 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:54.802779 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-af00e9e1-df1d-4083-b0bc-59e2caf6d721 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:54.803291 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-af00e9e1-df1d-4083-b0bc-59e2caf6d721 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:54.803956 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-af00e9e1-df1d-4083-b0bc-59e2caf6d721 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:54.804486 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-af00e9e1-df1d-4083-b0bc-59e2caf6d721 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:54.839879 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-af00e9e1-df1d-4083-b0bc-59e2caf6d721 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:54.867753 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dd2b74ba-accb-4684-8d62-3f928789b0e3 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:54.868723 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-dd2b74ba-accb-4684-8d62-3f928789b0e3 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:54.922051 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd2b74ba-accb-4684-8d62-3f928789b0e3 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:54.922564 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd2b74ba-accb-4684-8d62-3f928789b0e3 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:54.923583 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd2b74ba-accb-4684-8d62-3f928789b0e3 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:54.924399 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd2b74ba-accb-4684-8d62-3f928789b0e3 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:54.924991 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd2b74ba-accb-4684-8d62-3f928789b0e3 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:54.942208 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd2b74ba-accb-4684-8d62-3f928789b0e3 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:55.104542 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-af00e9e1-df1d-4083-b0bc-59e2caf6d721 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:55.116141 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-af00e9e1-df1d-4083-b0bc-59e2caf6d721 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5" status: 200 len: 1324 microversion: 2.1 time: 0.363369 Sep 08 11:12:55.129281 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2893/5677] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:12:54 2022] GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5 => generated 1324 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:12:56.139888 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f99d700a-7206-4478-a5fc-3b4563a46540 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:56.141393 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f99d700a-7206-4478-a5fc-3b4563a46540 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: af0ed4bb-bf39-4989-893c-14896abbc7d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:56.160480 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f99d700a-7206-4478-a5fc-3b4563a46540 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:56.164339 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f99d700a-7206-4478-a5fc-3b4563a46540 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:56.164874 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f99d700a-7206-4478-a5fc-3b4563a46540 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:56.169630 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f99d700a-7206-4478-a5fc-3b4563a46540 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:56.170541 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f99d700a-7206-4478-a5fc-3b4563a46540 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:56.171241 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f99d700a-7206-4478-a5fc-3b4563a46540 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:56.250921 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-dd2b74ba-accb-4684-8d62-3f928789b0e3 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:56.264903 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-dd2b74ba-accb-4684-8d62-3f928789b0e3 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:56.267788 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-dd2b74ba-accb-4684-8d62-3f928789b0e3 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:56.269826 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-dd2b74ba-accb-4684-8d62-3f928789b0e3 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e" status: 200 len: 1722 microversion: 2.20 time: 1.406250 Sep 08 11:12:56.281201 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2785/5678] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:12:54 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e => generated 1722 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:12:56.342750 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f99d700a-7206-4478-a5fc-3b4563a46540 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:56.356054 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f99d700a-7206-4478-a5fc-3b4563a46540 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5" status: 200 len: 1324 microversion: 2.1 time: 0.219909 Sep 08 11:12:56.357538 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2894/5679] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:12:56 2022] GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5 => generated 1324 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:12:57.298608 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-02637bfe-aebc-4b7a-a5b7-87fb64ce37d0 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:57.300510 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-02637bfe-aebc-4b7a-a5b7-87fb64ce37d0 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:57.316630 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02637bfe-aebc-4b7a-a5b7-87fb64ce37d0 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:57.317177 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02637bfe-aebc-4b7a-a5b7-87fb64ce37d0 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:57.317625 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02637bfe-aebc-4b7a-a5b7-87fb64ce37d0 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:57.318375 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02637bfe-aebc-4b7a-a5b7-87fb64ce37d0 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:57.318849 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02637bfe-aebc-4b7a-a5b7-87fb64ce37d0 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:57.319286 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02637bfe-aebc-4b7a-a5b7-87fb64ce37d0 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:57.607565 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2abe7f6c-15df-4f97-b73b-22b3390e0200 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Action: 'create', calling method: .version_select at 0x7f68e4b74ca0>, body: {"keypair": {"name": "tempest-keypair-1963866454", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJgcsRjTbzsJIAaQxJMj6+IAd2assX/WRSr6RXg5AYo01eqAn3vCT2EXMCt2Ts/IGB89z4f7ghy/9hC1mnQEYWRTV7Z47y/+UqB1D6xr+XIhh2IqVS/5wOxNH11Kobu3SQ=="}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:12:57.651410 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-2abe7f6c-15df-4f97-b73b-22b3390e0200 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Getting quotas for project 09dfe795da0e4988a50c38f19200ea7e. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:12:57.667312 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-2abe7f6c-15df-4f97-b73b-22b3390e0200 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Getting quotas for user d6bdfecc6c7a43608095044b0174b48f and project 09dfe795da0e4988a50c38f19200ea7e. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:12:57.725302 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2abe7f6c-15df-4f97-b73b-22b3390e0200 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.338555 Sep 08 11:12:57.726267 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2895/5680] 10.222.0.27 () {60 vars in 1159 bytes} [Thu Sep 8 11:12:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:12:57.744527 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cf8d5a82-a42a-4d8b-b968-ab2f2fcfe53f tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:57.746502 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cf8d5a82-a42a-4d8b-b968-ab2f2fcfe53f tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: af0ed4bb-bf39-4989-893c-14896abbc7d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:57.763871 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cf8d5a82-a42a-4d8b-b968-ab2f2fcfe53f tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:57.764386 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cf8d5a82-a42a-4d8b-b968-ab2f2fcfe53f tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:57.764845 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cf8d5a82-a42a-4d8b-b968-ab2f2fcfe53f tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:57.765661 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cf8d5a82-a42a-4d8b-b968-ab2f2fcfe53f tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:57.766649 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cf8d5a82-a42a-4d8b-b968-ab2f2fcfe53f tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:57.767446 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cf8d5a82-a42a-4d8b-b968-ab2f2fcfe53f tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:57.841486 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:12:57.960688 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:12:57.975051 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-02637bfe-aebc-4b7a-a5b7-87fb64ce37d0 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:57.989921 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-02637bfe-aebc-4b7a-a5b7-87fb64ce37d0 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:57.991490 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-02637bfe-aebc-4b7a-a5b7-87fb64ce37d0 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:57.992721 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-02637bfe-aebc-4b7a-a5b7-87fb64ce37d0 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e" status: 200 len: 1743 microversion: 2.20 time: 0.699001 Sep 08 11:12:58.005312 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2786/5681] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:12:57 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e => generated 1743 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:12:58.177635 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-cf8d5a82-a42a-4d8b-b968-ab2f2fcfe53f tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:58.187002 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cf8d5a82-a42a-4d8b-b968-ab2f2fcfe53f tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5" status: 200 len: 1392 microversion: 2.1 time: 0.459107 Sep 08 11:12:58.189277 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2896/5682] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:12:57 2022] GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5 => generated 1392 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:12:59.044601 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8f885052-1a9b-45bf-bcdf-e38fd9d9a8ed tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:59.045901 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8f885052-1a9b-45bf-bcdf-e38fd9d9a8ed tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:59.067766 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f885052-1a9b-45bf-bcdf-e38fd9d9a8ed tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:59.070759 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f885052-1a9b-45bf-bcdf-e38fd9d9a8ed tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:59.071500 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f885052-1a9b-45bf-bcdf-e38fd9d9a8ed tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:59.076794 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f885052-1a9b-45bf-bcdf-e38fd9d9a8ed tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:59.077910 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f885052-1a9b-45bf-bcdf-e38fd9d9a8ed tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:59.079948 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f885052-1a9b-45bf-bcdf-e38fd9d9a8ed tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:59.222350 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-609a9192-3159-404d-8557-40e5912093f5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:59.222963 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-609a9192-3159-404d-8557-40e5912093f5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: af0ed4bb-bf39-4989-893c-14896abbc7d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:59.243270 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-609a9192-3159-404d-8557-40e5912093f5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:59.252524 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-609a9192-3159-404d-8557-40e5912093f5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:59.253342 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-609a9192-3159-404d-8557-40e5912093f5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:59.254303 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-609a9192-3159-404d-8557-40e5912093f5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:59.254986 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-609a9192-3159-404d-8557-40e5912093f5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:59.258359 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-609a9192-3159-404d-8557-40e5912093f5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:59.633323 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-609a9192-3159-404d-8557-40e5912093f5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:59.654259 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-609a9192-3159-404d-8557-40e5912093f5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5" status: 200 len: 1392 microversion: 2.1 time: 0.433818 Sep 08 11:12:59.660547 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2897/5683] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:12:59 2022] GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5 => generated 1392 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:12:59.677147 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-71ea88e5-9674-4d83-bad0-815c2ce12a9a req-a9ceb31b-f497-4a89-82aa-0275d2860792 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af0ed4bb-bf39-4989-893c-14896abbc7d5", "tag": "d243af0a-26ec-4f11-98dd-3ce340f57c21"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:12:59.717519 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-71ea88e5-9674-4d83-bad0-815c2ce12a9a req-a9ceb31b-f497-4a89-82aa-0275d2860792 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:59.718831 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-71ea88e5-9674-4d83-bad0-815c2ce12a9a req-a9ceb31b-f497-4a89-82aa-0275d2860792 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:59.723127 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-71ea88e5-9674-4d83-bad0-815c2ce12a9a req-a9ceb31b-f497-4a89-82aa-0275d2860792 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:59.769537 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-71ea88e5-9674-4d83-bad0-815c2ce12a9a req-a9ceb31b-f497-4a89-82aa-0275d2860792 service nova] Creating event network-changed:d243af0a-26ec-4f11-98dd-3ce340f57c21 for instance af0ed4bb-bf39-4989-893c-14896abbc7d5 on n-h2-850501-12 Sep 08 11:12:59.785236 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-71ea88e5-9674-4d83-bad0-815c2ce12a9a req-a9ceb31b-f497-4a89-82aa-0275d2860792 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122834 Sep 08 11:12:59.785877 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2898/5684] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:12:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:12:59.996450 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8f885052-1a9b-45bf-bcdf-e38fd9d9a8ed tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:00.008183 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8f885052-1a9b-45bf-bcdf-e38fd9d9a8ed tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:00.013982 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8f885052-1a9b-45bf-bcdf-e38fd9d9a8ed tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:00.015239 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8f885052-1a9b-45bf-bcdf-e38fd9d9a8ed tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e" status: 200 len: 1743 microversion: 2.20 time: 0.974755 Sep 08 11:13:00.040963 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2787/5685] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:12:59 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e => generated 1743 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:13:00.684734 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-238044b8-ab9a-493c-b0d7-b287b24e41a8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:00.685752 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-238044b8-ab9a-493c-b0d7-b287b24e41a8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: af0ed4bb-bf39-4989-893c-14896abbc7d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:00.719838 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-238044b8-ab9a-493c-b0d7-b287b24e41a8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:00.729294 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-238044b8-ab9a-493c-b0d7-b287b24e41a8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:00.732466 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-238044b8-ab9a-493c-b0d7-b287b24e41a8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:00.741782 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-238044b8-ab9a-493c-b0d7-b287b24e41a8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:00.757298 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-238044b8-ab9a-493c-b0d7-b287b24e41a8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:00.758595 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-238044b8-ab9a-493c-b0d7-b287b24e41a8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:01.045336 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6bfb03d0-4cdf-4793-a196-9567e98ce064 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:01.045954 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6bfb03d0-4cdf-4793-a196-9567e98ce064 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:01.071948 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6bfb03d0-4cdf-4793-a196-9567e98ce064 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:01.077268 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6bfb03d0-4cdf-4793-a196-9567e98ce064 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:01.077787 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6bfb03d0-4cdf-4793-a196-9567e98ce064 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:01.084585 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6bfb03d0-4cdf-4793-a196-9567e98ce064 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:01.092810 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6bfb03d0-4cdf-4793-a196-9567e98ce064 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:01.093524 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6bfb03d0-4cdf-4793-a196-9567e98ce064 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:01.520355 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-238044b8-ab9a-493c-b0d7-b287b24e41a8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:01.530488 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-238044b8-ab9a-493c-b0d7-b287b24e41a8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5" status: 200 len: 1392 microversion: 2.1 time: 0.851179 Sep 08 11:13:01.531765 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2899/5686] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:13:00 2022] GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5 => generated 1392 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:13:01.536345 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6bfb03d0-4cdf-4793-a196-9567e98ce064 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:01.579342 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6bfb03d0-4cdf-4793-a196-9567e98ce064 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:01.592489 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6bfb03d0-4cdf-4793-a196-9567e98ce064 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:01.605261 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6bfb03d0-4cdf-4793-a196-9567e98ce064 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e" status: 200 len: 1738 microversion: 2.20 time: 0.559418 Sep 08 11:13:01.613286 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2788/5687] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:13:01 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e => generated 1738 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:13:02.562945 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b78d8e46-4491-4986-98f2-6805e8ce17a1 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:02.564545 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b78d8e46-4491-4986-98f2-6805e8ce17a1 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: af0ed4bb-bf39-4989-893c-14896abbc7d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:02.587219 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b78d8e46-4491-4986-98f2-6805e8ce17a1 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:02.587810 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b78d8e46-4491-4986-98f2-6805e8ce17a1 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:02.588483 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b78d8e46-4491-4986-98f2-6805e8ce17a1 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:02.589269 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b78d8e46-4491-4986-98f2-6805e8ce17a1 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:02.589743 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b78d8e46-4491-4986-98f2-6805e8ce17a1 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:02.590190 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b78d8e46-4491-4986-98f2-6805e8ce17a1 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:02.669759 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-df4f0743-d729-4015-9317-6b83cd2a202c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:02.675693 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-df4f0743-d729-4015-9317-6b83cd2a202c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:02.741174 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df4f0743-d729-4015-9317-6b83cd2a202c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:02.741687 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df4f0743-d729-4015-9317-6b83cd2a202c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:02.742140 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df4f0743-d729-4015-9317-6b83cd2a202c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:02.744220 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df4f0743-d729-4015-9317-6b83cd2a202c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:02.752199 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df4f0743-d729-4015-9317-6b83cd2a202c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:02.764923 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df4f0743-d729-4015-9317-6b83cd2a202c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:03.525400 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b78d8e46-4491-4986-98f2-6805e8ce17a1 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:03.536310 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b78d8e46-4491-4986-98f2-6805e8ce17a1 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5" status: 200 len: 1392 microversion: 2.1 time: 0.978932 Sep 08 11:13:03.551794 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2900/5688] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:13:02 2022] GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5 => generated 1392 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:13:03.570873 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-df4f0743-d729-4015-9317-6b83cd2a202c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:03.584853 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-df4f0743-d729-4015-9317-6b83cd2a202c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:03.586562 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-df4f0743-d729-4015-9317-6b83cd2a202c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:03.591158 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-df4f0743-d729-4015-9317-6b83cd2a202c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e" status: 200 len: 1738 microversion: 2.20 time: 0.928052 Sep 08 11:13:03.610727 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2789/5689] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:13:02 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e => generated 1738 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 11:13:03.811697 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-285f6d52-0907-4efa-9f4c-9176a195109f req-bea84430-9068-4007-b355-b1d8dbddad1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9c23be4-60f4-4bff-9e0d-8040618b552e", "name": "network-vif-plugged", "status": "completed", "tag": "0dcde267-c491-450a-894c-03db6d80d8ff"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:13:03.834536 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:13:03.847989 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-285f6d52-0907-4efa-9f4c-9176a195109f req-bea84430-9068-4007-b355-b1d8dbddad1b service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:03.848809 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-285f6d52-0907-4efa-9f4c-9176a195109f req-bea84430-9068-4007-b355-b1d8dbddad1b service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:03.850026 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-285f6d52-0907-4efa-9f4c-9176a195109f req-bea84430-9068-4007-b355-b1d8dbddad1b service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:03.889785 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-285f6d52-0907-4efa-9f4c-9176a195109f req-bea84430-9068-4007-b355-b1d8dbddad1b service nova] Creating event network-vif-plugged:0dcde267-c491-450a-894c-03db6d80d8ff for instance f9c23be4-60f4-4bff-9e0d-8040618b552e on n-h1-850501-12 Sep 08 11:13:03.902333 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-285f6d52-0907-4efa-9f4c-9176a195109f req-bea84430-9068-4007-b355-b1d8dbddad1b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.347826 Sep 08 11:13:03.905244 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2901/5690] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:13:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:13:04.383081 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7e577556-62b5-42fd-8ca4-b9cbe711a0be tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-632476134", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "96710c54-7b00-4b34-ad84-4034d740dc4d"}], "security_groups": [{"name": "tempest-securitygroup--72969699"}], "key_name": "tempest-keypair-1963866454", "user_data": "}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:13:04.568045 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bb207570-4948-4988-858a-5a284dec85cd tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:04.568781 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bb207570-4948-4988-858a-5a284dec85cd tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: af0ed4bb-bf39-4989-893c-14896abbc7d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:04.589578 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bb207570-4948-4988-858a-5a284dec85cd tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:04.590246 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bb207570-4948-4988-858a-5a284dec85cd tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:04.591103 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bb207570-4948-4988-858a-5a284dec85cd tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:04.592031 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bb207570-4948-4988-858a-5a284dec85cd tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:04.593797 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bb207570-4948-4988-858a-5a284dec85cd tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:04.597612 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bb207570-4948-4988-858a-5a284dec85cd tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:04.999921 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-7e577556-62b5-42fd-8ca4-b9cbe711a0be tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] validate_networks() for [('96710c54-7b00-4b34-ad84-4034d740dc4d', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:13:05.252616 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-bb207570-4948-4988-858a-5a284dec85cd tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:05.270666 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bb207570-4948-4988-858a-5a284dec85cd tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5" status: 200 len: 1392 microversion: 2.1 time: 0.707296 Sep 08 11:13:05.287186 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2902/5691] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:13:04 2022] GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5 => generated 1392 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:13:05.304568 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cd73bcd8-6200-4c6d-a991-22aeb5adcacf tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:05.307427 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cd73bcd8-6200-4c6d-a991-22aeb5adcacf tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:05.318876 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cd73bcd8-6200-4c6d-a991-22aeb5adcacf tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:05.320058 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cd73bcd8-6200-4c6d-a991-22aeb5adcacf tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:05.320754 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cd73bcd8-6200-4c6d-a991-22aeb5adcacf tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:05.321936 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cd73bcd8-6200-4c6d-a991-22aeb5adcacf tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:05.322601 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cd73bcd8-6200-4c6d-a991-22aeb5adcacf tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:05.324389 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cd73bcd8-6200-4c6d-a991-22aeb5adcacf tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:05.655551 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-cd73bcd8-6200-4c6d-a991-22aeb5adcacf tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:05.673383 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-cd73bcd8-6200-4c6d-a991-22aeb5adcacf tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:05.675208 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-cd73bcd8-6200-4c6d-a991-22aeb5adcacf tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:05.692491 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cd73bcd8-6200-4c6d-a991-22aeb5adcacf tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e" status: 200 len: 1738 microversion: 2.20 time: 0.403524 Sep 08 11:13:05.695189 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2903/5692] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:13:05 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e => generated 1738 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:13:06.294982 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9ae30f30-d8a6-435b-9e2d-4212a633d584 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:06.296945 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9ae30f30-d8a6-435b-9e2d-4212a633d584 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: af0ed4bb-bf39-4989-893c-14896abbc7d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:06.323896 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ae30f30-d8a6-435b-9e2d-4212a633d584 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:06.330491 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ae30f30-d8a6-435b-9e2d-4212a633d584 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:06.330953 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ae30f30-d8a6-435b-9e2d-4212a633d584 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:06.331724 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ae30f30-d8a6-435b-9e2d-4212a633d584 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:06.332199 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ae30f30-d8a6-435b-9e2d-4212a633d584 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:06.334726 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ae30f30-d8a6-435b-9e2d-4212a633d584 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:06.706431 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9ae30f30-d8a6-435b-9e2d-4212a633d584 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:06.726042 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9ae30f30-d8a6-435b-9e2d-4212a633d584 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5" status: 200 len: 1392 microversion: 2.1 time: 0.433934 Sep 08 11:13:06.730282 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2904/5693] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:13:06 2022] GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5 => generated 1392 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:13:06.744172 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ff52d56d-feb5-4125-92c6-f2cc765b2df9 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:06.749156 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ff52d56d-feb5-4125-92c6-f2cc765b2df9 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:06.785309 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ff52d56d-feb5-4125-92c6-f2cc765b2df9 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:06.786359 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ff52d56d-feb5-4125-92c6-f2cc765b2df9 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:06.799204 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ff52d56d-feb5-4125-92c6-f2cc765b2df9 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:06.800799 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ff52d56d-feb5-4125-92c6-f2cc765b2df9 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:06.808677 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ff52d56d-feb5-4125-92c6-f2cc765b2df9 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:06.817045 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ff52d56d-feb5-4125-92c6-f2cc765b2df9 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:06.922849 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-7e577556-62b5-42fd-8ca4-b9cbe711a0be tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:13:06.924971 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-7e577556-62b5-42fd-8ca4-b9cbe711a0be tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:13:06.926061 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-7e577556-62b5-42fd-8ca4-b9cbe711a0be tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:13:06.927184 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-7e577556-62b5-42fd-8ca4-b9cbe711a0be tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:13:06.927857 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-7e577556-62b5-42fd-8ca4-b9cbe711a0be tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:13:06.968918 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e577556-62b5-42fd-8ca4-b9cbe711a0be tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:06.970409 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e577556-62b5-42fd-8ca4-b9cbe711a0be tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:06.971060 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e577556-62b5-42fd-8ca4-b9cbe711a0be tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:06.972158 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e577556-62b5-42fd-8ca4-b9cbe711a0be tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:06.972815 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e577556-62b5-42fd-8ca4-b9cbe711a0be tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:06.973429 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e577556-62b5-42fd-8ca4-b9cbe711a0be tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:07.014136 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-7e577556-62b5-42fd-8ca4-b9cbe711a0be tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Getting quotas for project 09dfe795da0e4988a50c38f19200ea7e. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:13:07.039298 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-7e577556-62b5-42fd-8ca4-b9cbe711a0be tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Getting quotas for user d6bdfecc6c7a43608095044b0174b48f and project 09dfe795da0e4988a50c38f19200ea7e. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:13:07.092133 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7e577556-62b5-42fd-8ca4-b9cbe711a0be tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:13:07.100366 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7e577556-62b5-42fd-8ca4-b9cbe711a0be tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: a13b5e51-8a1d-4cb4-9485-a183b5a20c8d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:13:07.281934 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ff52d56d-feb5-4125-92c6-f2cc765b2df9 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:07.301661 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ff52d56d-feb5-4125-92c6-f2cc765b2df9 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:07.308659 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ff52d56d-feb5-4125-92c6-f2cc765b2df9 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:07.319649 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ff52d56d-feb5-4125-92c6-f2cc765b2df9 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e" status: 200 len: 1738 microversion: 2.20 time: 0.587796 Sep 08 11:13:07.320755 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2905/5694] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:13:06 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e => generated 1738 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:13:07.342929 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7e577556-62b5-42fd-8ca4-b9cbe711a0be tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 2.982016 Sep 08 11:13:07.344233 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2790/5695] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 11:13:04 2022] POST /compute/v2.1/servers => generated 400 bytes in 2986 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:13:07.364357 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2ef337f7-1e11-453f-971c-439d95b17354 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:07.365860 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2ef337f7-1e11-453f-971c-439d95b17354 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: a13b5e51-8a1d-4cb4-9485-a183b5a20c8d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:07.548803 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2ef337f7-1e11-453f-971c-439d95b17354 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bdfecc6c7a43608095044b0174b48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfe795da0e4988a50c38f19200ea7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:07.565726 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2ef337f7-1e11-453f-971c-439d95b17354 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d" status: 200 len: 1237 microversion: 2.1 time: 0.207623 Sep 08 11:13:07.572281 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2906/5696] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:13:07 2022] GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d => generated 1237 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:13:07.753573 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b33e1f79-5daa-41e9-bf76-10b056c56178 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:07.755093 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b33e1f79-5daa-41e9-bf76-10b056c56178 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: af0ed4bb-bf39-4989-893c-14896abbc7d5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:07.800778 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-08268d00-d417-4bea-bdbd-6d00e8b3edb1 req-2a268d6e-f98f-43a7-9c98-300b86a053a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af0ed4bb-bf39-4989-893c-14896abbc7d5", "name": "network-vif-plugged", "status": "completed", "tag": "d243af0a-26ec-4f11-98dd-3ce340f57c21"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:13:07.823437 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b33e1f79-5daa-41e9-bf76-10b056c56178 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:07.839596 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b33e1f79-5daa-41e9-bf76-10b056c56178 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:07.842526 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b33e1f79-5daa-41e9-bf76-10b056c56178 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:07.847866 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b33e1f79-5daa-41e9-bf76-10b056c56178 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:07.848638 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b33e1f79-5daa-41e9-bf76-10b056c56178 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:07.852826 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b33e1f79-5daa-41e9-bf76-10b056c56178 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:07.859535 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-08268d00-d417-4bea-bdbd-6d00e8b3edb1 req-2a268d6e-f98f-43a7-9c98-300b86a053a6 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:07.860814 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-08268d00-d417-4bea-bdbd-6d00e8b3edb1 req-2a268d6e-f98f-43a7-9c98-300b86a053a6 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:07.861284 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-08268d00-d417-4bea-bdbd-6d00e8b3edb1 req-2a268d6e-f98f-43a7-9c98-300b86a053a6 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:07.943734 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-08268d00-d417-4bea-bdbd-6d00e8b3edb1 req-2a268d6e-f98f-43a7-9c98-300b86a053a6 service nova] Creating event network-vif-plugged:d243af0a-26ec-4f11-98dd-3ce340f57c21 for instance af0ed4bb-bf39-4989-893c-14896abbc7d5 on n-h2-850501-12 Sep 08 11:13:07.991247 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-08268d00-d417-4bea-bdbd-6d00e8b3edb1 req-2a268d6e-f98f-43a7-9c98-300b86a053a6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.196818 Sep 08 11:13:07.993780 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2907/5697] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:13:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:13:08.348626 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-02a1cbe4-26d3-48f8-a87c-a248e9d595a0 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:08.350180 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-02a1cbe4-26d3-48f8-a87c-a248e9d595a0 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:08.367422 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-02a1cbe4-26d3-48f8-a87c-a248e9d595a0 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:08.369607 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-02a1cbe4-26d3-48f8-a87c-a248e9d595a0 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:08.370955 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-02a1cbe4-26d3-48f8-a87c-a248e9d595a0 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:08.372332 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-02a1cbe4-26d3-48f8-a87c-a248e9d595a0 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:08.376032 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-02a1cbe4-26d3-48f8-a87c-a248e9d595a0 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:08.377582 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-02a1cbe4-26d3-48f8-a87c-a248e9d595a0 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:08.765531 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b33e1f79-5daa-41e9-bf76-10b056c56178 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:08.775586 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b33e1f79-5daa-41e9-bf76-10b056c56178 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5" status: 200 len: 1392 microversion: 2.1 time: 1.027627 Sep 08 11:13:08.782591 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2791/5698] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:13:07 2022] GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5 => generated 1392 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:13:08.793296 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c8aac2cc-c778-4bd7-891e-7062c8c05346 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:08.798632 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-02a1cbe4-26d3-48f8-a87c-a248e9d595a0 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:08.803537 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c8aac2cc-c778-4bd7-891e-7062c8c05346 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: a13b5e51-8a1d-4cb4-9485-a183b5a20c8d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:08.812963 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-02a1cbe4-26d3-48f8-a87c-a248e9d595a0 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:08.821357 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-02a1cbe4-26d3-48f8-a87c-a248e9d595a0 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:08.825414 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-02a1cbe4-26d3-48f8-a87c-a248e9d595a0 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e" status: 200 len: 1738 microversion: 2.20 time: 0.482089 Sep 08 11:13:08.826848 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2908/5699] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:13:08 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e => generated 1738 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:13:08.926554 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c8aac2cc-c778-4bd7-891e-7062c8c05346 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bdfecc6c7a43608095044b0174b48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfe795da0e4988a50c38f19200ea7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:08.942200 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c8aac2cc-c778-4bd7-891e-7062c8c05346 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d" status: 200 len: 1237 microversion: 2.1 time: 0.158251 Sep 08 11:13:08.957014 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2792/5700] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:13:08 2022] GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d => generated 1237 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:13:09.832976 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1a2e9c29-a2ec-4d96-914f-be575195d8f5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:09.845018 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1a2e9c29-a2ec-4d96-914f-be575195d8f5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: af0ed4bb-bf39-4989-893c-14896abbc7d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:09.852058 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ed0fdce2-4129-483c-babb-866e59874a7f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:09.852685 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ed0fdce2-4129-483c-babb-866e59874a7f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:09.870279 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ed0fdce2-4129-483c-babb-866e59874a7f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:09.870818 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ed0fdce2-4129-483c-babb-866e59874a7f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:09.876074 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1a2e9c29-a2ec-4d96-914f-be575195d8f5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:09.876849 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1a2e9c29-a2ec-4d96-914f-be575195d8f5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:09.878648 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1a2e9c29-a2ec-4d96-914f-be575195d8f5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:09.879976 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ed0fdce2-4129-483c-babb-866e59874a7f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:09.880784 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ed0fdce2-4129-483c-babb-866e59874a7f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:09.881294 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ed0fdce2-4129-483c-babb-866e59874a7f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:09.881738 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ed0fdce2-4129-483c-babb-866e59874a7f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:09.882113 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1a2e9c29-a2ec-4d96-914f-be575195d8f5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:09.884671 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1a2e9c29-a2ec-4d96-914f-be575195d8f5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:09.899023 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1a2e9c29-a2ec-4d96-914f-be575195d8f5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:10.371279 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ed0fdce2-4129-483c-babb-866e59874a7f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:10.384029 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ed0fdce2-4129-483c-babb-866e59874a7f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:10.385994 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ed0fdce2-4129-483c-babb-866e59874a7f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:10.387761 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ed0fdce2-4129-483c-babb-866e59874a7f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e" status: 200 len: 1738 microversion: 2.20 time: 0.539738 Sep 08 11:13:10.389198 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2793/5701] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:13:09 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e => generated 1738 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 11:13:10.397376 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ecb3b8e1-74af-4a78-b86c-34a0dc1be1db tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:10.398607 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ecb3b8e1-74af-4a78-b86c-34a0dc1be1db tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: a13b5e51-8a1d-4cb4-9485-a183b5a20c8d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:10.411858 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ecb3b8e1-74af-4a78-b86c-34a0dc1be1db tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:10.413201 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ecb3b8e1-74af-4a78-b86c-34a0dc1be1db tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:10.413916 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ecb3b8e1-74af-4a78-b86c-34a0dc1be1db tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:10.414862 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ecb3b8e1-74af-4a78-b86c-34a0dc1be1db tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:10.415510 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ecb3b8e1-74af-4a78-b86c-34a0dc1be1db tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:10.416114 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ecb3b8e1-74af-4a78-b86c-34a0dc1be1db tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:10.490915 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1a2e9c29-a2ec-4d96-914f-be575195d8f5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:10.549337 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1a2e9c29-a2ec-4d96-914f-be575195d8f5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5" status: 200 len: 1564 microversion: 2.1 time: 0.740098 Sep 08 11:13:10.551649 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2909/5702] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:13:09 2022] GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5 => generated 1564 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:13:10.583722 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e094adc3-fa8f-40ad-ba12-1eee94713a1e tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:10.586350 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ecb3b8e1-74af-4a78-b86c-34a0dc1be1db tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bdfecc6c7a43608095044b0174b48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfe795da0e4988a50c38f19200ea7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:10.592743 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e094adc3-fa8f-40ad-ba12-1eee94713a1e tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: af0ed4bb-bf39-4989-893c-14896abbc7d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:10.629600 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ecb3b8e1-74af-4a78-b86c-34a0dc1be1db tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d" status: 200 len: 1289 microversion: 2.1 time: 0.237203 Sep 08 11:13:10.631667 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2794/5703] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:13:10 2022] GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d => generated 1289 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:13:10.651819 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e094adc3-fa8f-40ad-ba12-1eee94713a1e tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:10.658290 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e094adc3-fa8f-40ad-ba12-1eee94713a1e tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:10.659606 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e094adc3-fa8f-40ad-ba12-1eee94713a1e tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:10.665092 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e094adc3-fa8f-40ad-ba12-1eee94713a1e tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:10.668602 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e094adc3-fa8f-40ad-ba12-1eee94713a1e tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:10.669561 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e094adc3-fa8f-40ad-ba12-1eee94713a1e tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:10.997767 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e094adc3-fa8f-40ad-ba12-1eee94713a1e tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:11.010802 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e094adc3-fa8f-40ad-ba12-1eee94713a1e tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5" status: 200 len: 1564 microversion: 2.1 time: 0.433835 Sep 08 11:13:11.027987 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2910/5704] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:13:10 2022] GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5 => generated 1564 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:13:11.422885 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fbe41624-bc6b-42eb-9f3d-a2100b6be171 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:11.423953 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fbe41624-bc6b-42eb-9f3d-a2100b6be171 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:11.459108 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fbe41624-bc6b-42eb-9f3d-a2100b6be171 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:11.459624 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fbe41624-bc6b-42eb-9f3d-a2100b6be171 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:11.460069 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fbe41624-bc6b-42eb-9f3d-a2100b6be171 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:11.460805 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fbe41624-bc6b-42eb-9f3d-a2100b6be171 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:11.466909 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fbe41624-bc6b-42eb-9f3d-a2100b6be171 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:11.468179 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fbe41624-bc6b-42eb-9f3d-a2100b6be171 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:11.658791 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9e544ac7-9c5b-44d3-806f-249170548691 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:11.661948 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9e544ac7-9c5b-44d3-806f-249170548691 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: a13b5e51-8a1d-4cb4-9485-a183b5a20c8d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:11.681782 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e544ac7-9c5b-44d3-806f-249170548691 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:11.682699 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e544ac7-9c5b-44d3-806f-249170548691 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:11.683464 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e544ac7-9c5b-44d3-806f-249170548691 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:11.684784 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e544ac7-9c5b-44d3-806f-249170548691 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:11.687087 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e544ac7-9c5b-44d3-806f-249170548691 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:11.689319 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e544ac7-9c5b-44d3-806f-249170548691 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:11.888034 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9e544ac7-9c5b-44d3-806f-249170548691 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bdfecc6c7a43608095044b0174b48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfe795da0e4988a50c38f19200ea7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:11.904881 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9e544ac7-9c5b-44d3-806f-249170548691 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d" status: 200 len: 1295 microversion: 2.1 time: 0.252465 Sep 08 11:13:11.921339 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2911/5705] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:13:11 2022] GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d => generated 1295 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:13:12.935990 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-38993a13-bf97-438a-9e9f-cd944db227f0 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:12.936661 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-38993a13-bf97-438a-9e9f-cd944db227f0 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: a13b5e51-8a1d-4cb4-9485-a183b5a20c8d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:12.941459 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fbe41624-bc6b-42eb-9f3d-a2100b6be171 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:12.960213 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fbe41624-bc6b-42eb-9f3d-a2100b6be171 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:12.975237 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-38993a13-bf97-438a-9e9f-cd944db227f0 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:12.977014 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-38993a13-bf97-438a-9e9f-cd944db227f0 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:12.981618 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-38993a13-bf97-438a-9e9f-cd944db227f0 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:12.983866 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-38993a13-bf97-438a-9e9f-cd944db227f0 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:12.989911 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-38993a13-bf97-438a-9e9f-cd944db227f0 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:12.990456 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fbe41624-bc6b-42eb-9f3d-a2100b6be171 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:12.992601 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-38993a13-bf97-438a-9e9f-cd944db227f0 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:12.995817 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fbe41624-bc6b-42eb-9f3d-a2100b6be171 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e" status: 200 len: 1738 microversion: 2.20 time: 1.580834 Sep 08 11:13:12.996438 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2795/5706] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:13:11 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e => generated 1738 bytes in 1582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:13:13.411324 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-38993a13-bf97-438a-9e9f-cd944db227f0 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bdfecc6c7a43608095044b0174b48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfe795da0e4988a50c38f19200ea7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:13.425823 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-38993a13-bf97-438a-9e9f-cd944db227f0 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d" status: 200 len: 1361 microversion: 2.1 time: 0.496572 Sep 08 11:13:13.426690 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2912/5707] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:13:12 2022] GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d => generated 1361 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:13:14.026679 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3d326983-30e4-4b12-8be2-5d623413298b tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:14.027277 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3d326983-30e4-4b12-8be2-5d623413298b tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:14.042818 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d326983-30e4-4b12-8be2-5d623413298b tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:14.043329 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d326983-30e4-4b12-8be2-5d623413298b tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:14.051590 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d326983-30e4-4b12-8be2-5d623413298b tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:14.053228 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d326983-30e4-4b12-8be2-5d623413298b tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:14.057285 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d326983-30e4-4b12-8be2-5d623413298b tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:14.067635 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d326983-30e4-4b12-8be2-5d623413298b tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:14.457576 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-65125694-7684-468b-885f-0196542d6f3b tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:14.459018 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-65125694-7684-468b-885f-0196542d6f3b tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: a13b5e51-8a1d-4cb4-9485-a183b5a20c8d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:14.506384 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-65125694-7684-468b-885f-0196542d6f3b tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:14.507169 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-65125694-7684-468b-885f-0196542d6f3b tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:14.507789 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-65125694-7684-468b-885f-0196542d6f3b tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:14.508749 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-65125694-7684-468b-885f-0196542d6f3b tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:14.509415 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-65125694-7684-468b-885f-0196542d6f3b tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:14.510017 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-65125694-7684-468b-885f-0196542d6f3b tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:14.571059 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=100 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:13:14.794846 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3d326983-30e4-4b12-8be2-5d623413298b tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:14.825484 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3d326983-30e4-4b12-8be2-5d623413298b tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:14.831707 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3d326983-30e4-4b12-8be2-5d623413298b tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:14.834182 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3d326983-30e4-4b12-8be2-5d623413298b tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e" status: 200 len: 1738 microversion: 2.20 time: 0.812979 Sep 08 11:13:14.839121 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2796/5708] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:13:14 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e => generated 1738 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:13:15.351406 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-65125694-7684-468b-885f-0196542d6f3b tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bdfecc6c7a43608095044b0174b48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfe795da0e4988a50c38f19200ea7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:15.383702 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-65125694-7684-468b-885f-0196542d6f3b tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d" status: 200 len: 1361 microversion: 2.1 time: 0.928692 Sep 08 11:13:15.386134 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2913/5709] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:13:14 2022] GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d => generated 1361 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:13:15.793418 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-f92d15b8-c1d5-4d59-9087-e51725523538 req-672a002b-915e-4372-978c-fbc0109f0539 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a13b5e51-8a1d-4cb4-9485-a183b5a20c8d", "tag": "f1f6fdcb-f442-49bc-ba0f-8ea3d6242f8f"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:13:15.820653 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-f92d15b8-c1d5-4d59-9087-e51725523538 req-672a002b-915e-4372-978c-fbc0109f0539 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:15.821173 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-f92d15b8-c1d5-4d59-9087-e51725523538 req-672a002b-915e-4372-978c-fbc0109f0539 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:15.821611 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-f92d15b8-c1d5-4d59-9087-e51725523538 req-672a002b-915e-4372-978c-fbc0109f0539 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:15.870471 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8dbf8e5e-3e39-4427-bb72-6528b5934470 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:15.871304 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8dbf8e5e-3e39-4427-bb72-6528b5934470 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:15.892094 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-f92d15b8-c1d5-4d59-9087-e51725523538 req-672a002b-915e-4372-978c-fbc0109f0539 service nova] Creating event network-changed:f1f6fdcb-f442-49bc-ba0f-8ea3d6242f8f for instance a13b5e51-8a1d-4cb4-9485-a183b5a20c8d on n-h1-850501-12 Sep 08 11:13:15.896569 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8dbf8e5e-3e39-4427-bb72-6528b5934470 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:15.896876 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8dbf8e5e-3e39-4427-bb72-6528b5934470 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:15.903203 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8dbf8e5e-3e39-4427-bb72-6528b5934470 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:15.904173 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8dbf8e5e-3e39-4427-bb72-6528b5934470 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:15.904491 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8dbf8e5e-3e39-4427-bb72-6528b5934470 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:15.913710 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8dbf8e5e-3e39-4427-bb72-6528b5934470 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:15.925425 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-f92d15b8-c1d5-4d59-9087-e51725523538 req-672a002b-915e-4372-978c-fbc0109f0539 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143164 Sep 08 11:13:15.934058 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2797/5710] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:13:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:13:16.419357 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9f343d47-27f7-4cac-9382-895b2ab02fae tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:16.420935 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9f343d47-27f7-4cac-9382-895b2ab02fae tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: a13b5e51-8a1d-4cb4-9485-a183b5a20c8d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:16.450517 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f343d47-27f7-4cac-9382-895b2ab02fae tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:16.451374 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f343d47-27f7-4cac-9382-895b2ab02fae tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:16.452172 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f343d47-27f7-4cac-9382-895b2ab02fae tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:16.465212 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f343d47-27f7-4cac-9382-895b2ab02fae tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:16.466112 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f343d47-27f7-4cac-9382-895b2ab02fae tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:16.467094 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f343d47-27f7-4cac-9382-895b2ab02fae tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:16.597592 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8dbf8e5e-3e39-4427-bb72-6528b5934470 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:16.620151 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8dbf8e5e-3e39-4427-bb72-6528b5934470 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:16.623945 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8dbf8e5e-3e39-4427-bb72-6528b5934470 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:16.626958 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8dbf8e5e-3e39-4427-bb72-6528b5934470 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e" status: 200 len: 1738 microversion: 2.20 time: 0.760531 Sep 08 11:13:16.628087 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2914/5711] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:13:15 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e => generated 1738 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 11:13:16.984756 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:13:17.382873 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5630fe7e-e8b6-40e9-a29c-bc296d66c5a9 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:17.387221 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5630fe7e-e8b6-40e9-a29c-bc296d66c5a9 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: af0ed4bb-bf39-4989-893c-14896abbc7d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:17.440621 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5630fe7e-e8b6-40e9-a29c-bc296d66c5a9 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:17.441422 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5630fe7e-e8b6-40e9-a29c-bc296d66c5a9 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:17.442311 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5630fe7e-e8b6-40e9-a29c-bc296d66c5a9 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:17.444752 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5630fe7e-e8b6-40e9-a29c-bc296d66c5a9 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:17.445826 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5630fe7e-e8b6-40e9-a29c-bc296d66c5a9 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:17.446824 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5630fe7e-e8b6-40e9-a29c-bc296d66c5a9 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:17.493444 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9f343d47-27f7-4cac-9382-895b2ab02fae tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bdfecc6c7a43608095044b0174b48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfe795da0e4988a50c38f19200ea7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:17.508206 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9f343d47-27f7-4cac-9382-895b2ab02fae tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d" status: 200 len: 1361 microversion: 2.1 time: 1.100017 Sep 08 11:13:17.509733 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2798/5712] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:13:16 2022] GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d => generated 1361 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:13:17.614529 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=8 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:13:17.691045 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-15691cbd-10d6-4cd3-ad03-0ee6bb575f58 req-a523410f-81ea-4636-bc6e-a21d85208405 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af0ed4bb-bf39-4989-893c-14896abbc7d5", "tag": "d243af0a-26ec-4f11-98dd-3ce340f57c21"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:13:17.735517 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-15691cbd-10d6-4cd3-ad03-0ee6bb575f58 req-a523410f-81ea-4636-bc6e-a21d85208405 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:17.736674 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-15691cbd-10d6-4cd3-ad03-0ee6bb575f58 req-a523410f-81ea-4636-bc6e-a21d85208405 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:17.745222 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-15691cbd-10d6-4cd3-ad03-0ee6bb575f58 req-a523410f-81ea-4636-bc6e-a21d85208405 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:17.784808 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-15691cbd-10d6-4cd3-ad03-0ee6bb575f58 req-a523410f-81ea-4636-bc6e-a21d85208405 service nova] Creating event network-changed:d243af0a-26ec-4f11-98dd-3ce340f57c21 for instance af0ed4bb-bf39-4989-893c-14896abbc7d5 on n-h2-850501-12 Sep 08 11:13:17.801210 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-15691cbd-10d6-4cd3-ad03-0ee6bb575f58 req-a523410f-81ea-4636-bc6e-a21d85208405 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.289406 Sep 08 11:13:17.802034 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2799/5713] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:13:17.819346 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1535626f-4343-45fb-86d5-15e4609bf819 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:17.823931 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1535626f-4343-45fb-86d5-15e4609bf819 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:17.868554 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1535626f-4343-45fb-86d5-15e4609bf819 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:17.869743 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1535626f-4343-45fb-86d5-15e4609bf819 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:17.869743 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1535626f-4343-45fb-86d5-15e4609bf819 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:17.870619 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1535626f-4343-45fb-86d5-15e4609bf819 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:17.897891 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1535626f-4343-45fb-86d5-15e4609bf819 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:17.913510 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1535626f-4343-45fb-86d5-15e4609bf819 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.042s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:18.026736 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=92 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:13:18.239491 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5630fe7e-e8b6-40e9-a29c-bc296d66c5a9 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:18.300818 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5630fe7e-e8b6-40e9-a29c-bc296d66c5a9 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5" status: 200 len: 1564 microversion: 2.1 time: 0.908959 Sep 08 11:13:18.308525 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2915/5714] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:13:17 2022] GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5 => generated 1564 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:13:18.536783 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e98647d1-43ec-4d96-8883-8f9f947ff720 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:18.542470 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e98647d1-43ec-4d96-8883-8f9f947ff720 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: a13b5e51-8a1d-4cb4-9485-a183b5a20c8d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:18.561453 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e98647d1-43ec-4d96-8883-8f9f947ff720 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:18.561960 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e98647d1-43ec-4d96-8883-8f9f947ff720 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:18.563274 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e98647d1-43ec-4d96-8883-8f9f947ff720 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:18.572146 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e98647d1-43ec-4d96-8883-8f9f947ff720 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:18.573760 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e98647d1-43ec-4d96-8883-8f9f947ff720 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:18.575199 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e98647d1-43ec-4d96-8883-8f9f947ff720 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:18.933385 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=8 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:13:18.946507 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1535626f-4343-45fb-86d5-15e4609bf819 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:18.956011 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1535626f-4343-45fb-86d5-15e4609bf819 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:18.968676 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1535626f-4343-45fb-86d5-15e4609bf819 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:18.970527 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1535626f-4343-45fb-86d5-15e4609bf819 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e" status: 200 len: 1738 microversion: 2.20 time: 1.160720 Sep 08 11:13:18.978173 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2800/5715] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:13:17 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e => generated 1738 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:13:19.462101 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e98647d1-43ec-4d96-8883-8f9f947ff720 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bdfecc6c7a43608095044b0174b48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfe795da0e4988a50c38f19200ea7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:19.482332 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e98647d1-43ec-4d96-8883-8f9f947ff720 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d" status: 200 len: 1361 microversion: 2.1 time: 0.949059 Sep 08 11:13:19.497831 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2916/5716] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:13:18 2022] GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d => generated 1361 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:13:20.006403 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-36abb043-af33-42d8-8221-602742d9d179 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:20.007746 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-36abb043-af33-42d8-8221-602742d9d179 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:20.022904 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36abb043-af33-42d8-8221-602742d9d179 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:20.023911 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36abb043-af33-42d8-8221-602742d9d179 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:20.027614 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36abb043-af33-42d8-8221-602742d9d179 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:20.028740 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36abb043-af33-42d8-8221-602742d9d179 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:20.029487 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36abb043-af33-42d8-8221-602742d9d179 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:20.030143 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36abb043-af33-42d8-8221-602742d9d179 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:20.511884 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c90ca367-2fb4-496c-8389-a50c1be6d172 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:20.512613 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c90ca367-2fb4-496c-8389-a50c1be6d172 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: a13b5e51-8a1d-4cb4-9485-a183b5a20c8d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:20.527825 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c90ca367-2fb4-496c-8389-a50c1be6d172 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:20.540288 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c90ca367-2fb4-496c-8389-a50c1be6d172 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:20.541016 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c90ca367-2fb4-496c-8389-a50c1be6d172 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:20.541972 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c90ca367-2fb4-496c-8389-a50c1be6d172 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:20.542640 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c90ca367-2fb4-496c-8389-a50c1be6d172 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:20.543261 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c90ca367-2fb4-496c-8389-a50c1be6d172 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:21.063539 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c90ca367-2fb4-496c-8389-a50c1be6d172 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bdfecc6c7a43608095044b0174b48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfe795da0e4988a50c38f19200ea7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:21.078791 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c90ca367-2fb4-496c-8389-a50c1be6d172 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d" status: 200 len: 1361 microversion: 2.1 time: 0.570019 Sep 08 11:13:21.092870 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2917/5717] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:13:20 2022] GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d => generated 1361 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:13:21.266157 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-36abb043-af33-42d8-8221-602742d9d179 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:21.275518 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-36abb043-af33-42d8-8221-602742d9d179 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:21.305260 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-36abb043-af33-42d8-8221-602742d9d179 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:21.314230 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-36abb043-af33-42d8-8221-602742d9d179 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e" status: 200 len: 1738 microversion: 2.20 time: 1.314787 Sep 08 11:13:21.315506 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2801/5718] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:13:19 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e => generated 1738 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:13:22.126511 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5ba914c6-d34a-4b72-aefc-89c322993d20 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:22.128664 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5ba914c6-d34a-4b72-aefc-89c322993d20 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: a13b5e51-8a1d-4cb4-9485-a183b5a20c8d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:22.143665 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5ba914c6-d34a-4b72-aefc-89c322993d20 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:22.147530 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5ba914c6-d34a-4b72-aefc-89c322993d20 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:22.148362 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5ba914c6-d34a-4b72-aefc-89c322993d20 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:22.149784 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5ba914c6-d34a-4b72-aefc-89c322993d20 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:22.151192 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5ba914c6-d34a-4b72-aefc-89c322993d20 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:22.152850 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5ba914c6-d34a-4b72-aefc-89c322993d20 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:22.341815 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f9b5bcff-5adb-4ba5-990d-bf870a16062a tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:22.342554 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f9b5bcff-5adb-4ba5-990d-bf870a16062a tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:22.346014 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:13:22.359975 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f9b5bcff-5adb-4ba5-990d-bf870a16062a tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:22.365219 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f9b5bcff-5adb-4ba5-990d-bf870a16062a tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:22.366147 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f9b5bcff-5adb-4ba5-990d-bf870a16062a tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:22.367574 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f9b5bcff-5adb-4ba5-990d-bf870a16062a tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:22.368381 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f9b5bcff-5adb-4ba5-990d-bf870a16062a tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:22.372778 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5ba914c6-d34a-4b72-aefc-89c322993d20 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bdfecc6c7a43608095044b0174b48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfe795da0e4988a50c38f19200ea7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:22.373684 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f9b5bcff-5adb-4ba5-990d-bf870a16062a tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:22.393847 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5ba914c6-d34a-4b72-aefc-89c322993d20 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d" status: 200 len: 1361 microversion: 2.1 time: 0.272329 Sep 08 11:13:22.409230 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2918/5719] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:13:22 2022] GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d => generated 1361 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:13:22.733262 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f9b5bcff-5adb-4ba5-990d-bf870a16062a tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:22.747386 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f9b5bcff-5adb-4ba5-990d-bf870a16062a tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:22.751924 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f9b5bcff-5adb-4ba5-990d-bf870a16062a tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:22.753552 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f9b5bcff-5adb-4ba5-990d-bf870a16062a tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e" status: 200 len: 1738 microversion: 2.20 time: 0.415746 Sep 08 11:13:22.770356 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2802/5720] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:13:22 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e => generated 1738 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 11:13:23.273486 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-8f964cb4-b578-4057-a484-c999672c88ab req-588b2b1c-9723-4dc4-b875-b5e77174703d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a13b5e51-8a1d-4cb4-9485-a183b5a20c8d", "name": "network-vif-plugged", "status": "completed", "tag": "f1f6fdcb-f442-49bc-ba0f-8ea3d6242f8f"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:13:23.315044 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-8f964cb4-b578-4057-a484-c999672c88ab req-588b2b1c-9723-4dc4-b875-b5e77174703d service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:23.315629 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-8f964cb4-b578-4057-a484-c999672c88ab req-588b2b1c-9723-4dc4-b875-b5e77174703d service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:23.316068 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-8f964cb4-b578-4057-a484-c999672c88ab req-588b2b1c-9723-4dc4-b875-b5e77174703d service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:23.366831 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-8f964cb4-b578-4057-a484-c999672c88ab req-588b2b1c-9723-4dc4-b875-b5e77174703d service nova] Creating event network-vif-plugged:f1f6fdcb-f442-49bc-ba0f-8ea3d6242f8f for instance a13b5e51-8a1d-4cb4-9485-a183b5a20c8d on n-h1-850501-12 Sep 08 11:13:23.379925 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-8f964cb4-b578-4057-a484-c999672c88ab req-588b2b1c-9723-4dc4-b875-b5e77174703d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110691 Sep 08 11:13:23.383881 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2919/5721] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:13:23.428111 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-aedb9173-98e2-44d7-9138-b4a852059712 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:23.430008 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-aedb9173-98e2-44d7-9138-b4a852059712 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: a13b5e51-8a1d-4cb4-9485-a183b5a20c8d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:23.448617 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aedb9173-98e2-44d7-9138-b4a852059712 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:23.453602 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aedb9173-98e2-44d7-9138-b4a852059712 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:23.454247 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aedb9173-98e2-44d7-9138-b4a852059712 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:23.455729 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aedb9173-98e2-44d7-9138-b4a852059712 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:23.456219 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aedb9173-98e2-44d7-9138-b4a852059712 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:23.456736 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aedb9173-98e2-44d7-9138-b4a852059712 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:23.783212 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9362a00d-88c4-4a92-bb10-b34a0ec9db69 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:23.783918 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9362a00d-88c4-4a92-bb10-b34a0ec9db69 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:23.799579 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9362a00d-88c4-4a92-bb10-b34a0ec9db69 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:23.800120 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9362a00d-88c4-4a92-bb10-b34a0ec9db69 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:23.805813 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9362a00d-88c4-4a92-bb10-b34a0ec9db69 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:23.807111 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9362a00d-88c4-4a92-bb10-b34a0ec9db69 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:23.808083 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9362a00d-88c4-4a92-bb10-b34a0ec9db69 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:23.808782 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9362a00d-88c4-4a92-bb10-b34a0ec9db69 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:23.866687 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-aedb9173-98e2-44d7-9138-b4a852059712 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bdfecc6c7a43608095044b0174b48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfe795da0e4988a50c38f19200ea7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:23.877054 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-aedb9173-98e2-44d7-9138-b4a852059712 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d" status: 200 len: 1361 microversion: 2.1 time: 0.453718 Sep 08 11:13:23.881706 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2803/5722] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:13:23 2022] GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d => generated 1361 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:13:24.137951 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9362a00d-88c4-4a92-bb10-b34a0ec9db69 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:24.153332 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9362a00d-88c4-4a92-bb10-b34a0ec9db69 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:24.158553 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9362a00d-88c4-4a92-bb10-b34a0ec9db69 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:24.160087 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9362a00d-88c4-4a92-bb10-b34a0ec9db69 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e" status: 200 len: 1738 microversion: 2.20 time: 0.381670 Sep 08 11:13:24.160855 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2920/5723] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:13:23 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e => generated 1738 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 11:13:24.917082 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-04193525-584a-48f4-a4fd-086f21c1f1b1 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:24.918873 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-04193525-584a-48f4-a4fd-086f21c1f1b1 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: a13b5e51-8a1d-4cb4-9485-a183b5a20c8d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:24.931389 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04193525-584a-48f4-a4fd-086f21c1f1b1 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:24.934617 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04193525-584a-48f4-a4fd-086f21c1f1b1 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:24.935540 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04193525-584a-48f4-a4fd-086f21c1f1b1 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:24.937779 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04193525-584a-48f4-a4fd-086f21c1f1b1 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:24.938778 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04193525-584a-48f4-a4fd-086f21c1f1b1 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:24.939414 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04193525-584a-48f4-a4fd-086f21c1f1b1 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:25.132313 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-04193525-584a-48f4-a4fd-086f21c1f1b1 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bdfecc6c7a43608095044b0174b48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfe795da0e4988a50c38f19200ea7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:25.148621 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-04193525-584a-48f4-a4fd-086f21c1f1b1 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d" status: 200 len: 1361 microversion: 2.1 time: 0.235421 Sep 08 11:13:25.149744 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2804/5724] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:13:24 2022] GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d => generated 1361 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:13:25.192295 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-21ff2475-3c64-487f-82af-16a6a1d35c22 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:25.193177 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-21ff2475-3c64-487f-82af-16a6a1d35c22 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:25.222004 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-21ff2475-3c64-487f-82af-16a6a1d35c22 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:25.223944 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-21ff2475-3c64-487f-82af-16a6a1d35c22 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:25.227123 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-21ff2475-3c64-487f-82af-16a6a1d35c22 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:25.230475 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-21ff2475-3c64-487f-82af-16a6a1d35c22 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:25.233537 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-21ff2475-3c64-487f-82af-16a6a1d35c22 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:25.235168 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-21ff2475-3c64-487f-82af-16a6a1d35c22 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:25.516066 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-21ff2475-3c64-487f-82af-16a6a1d35c22 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:25.539280 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-21ff2475-3c64-487f-82af-16a6a1d35c22 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:25.547454 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-21ff2475-3c64-487f-82af-16a6a1d35c22 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:25.553818 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-21ff2475-3c64-487f-82af-16a6a1d35c22 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e" status: 200 len: 1738 microversion: 2.20 time: 0.367406 Sep 08 11:13:25.573326 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2921/5725] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:13:25 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e => generated 1738 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:13:26.182083 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-70acfdf8-3641-4bb5-af1c-5113695cfe1f tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:26.183594 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-70acfdf8-3641-4bb5-af1c-5113695cfe1f tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: a13b5e51-8a1d-4cb4-9485-a183b5a20c8d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:26.194929 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70acfdf8-3641-4bb5-af1c-5113695cfe1f tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:26.196383 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70acfdf8-3641-4bb5-af1c-5113695cfe1f tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:26.196829 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70acfdf8-3641-4bb5-af1c-5113695cfe1f tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:26.197639 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70acfdf8-3641-4bb5-af1c-5113695cfe1f tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:26.198279 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70acfdf8-3641-4bb5-af1c-5113695cfe1f tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:26.198888 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70acfdf8-3641-4bb5-af1c-5113695cfe1f tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:26.417956 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-70acfdf8-3641-4bb5-af1c-5113695cfe1f tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bdfecc6c7a43608095044b0174b48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfe795da0e4988a50c38f19200ea7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:26.432701 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-70acfdf8-3641-4bb5-af1c-5113695cfe1f tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d" status: 200 len: 1548 microversion: 2.1 time: 0.254427 Sep 08 11:13:26.433952 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2805/5726] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:13:26 2022] GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d => generated 1548 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:13:26.457959 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f363d58c-05d5-4ee2-9ad2-8668bc570690 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:26.459236 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f363d58c-05d5-4ee2-9ad2-8668bc570690 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: a13b5e51-8a1d-4cb4-9485-a183b5a20c8d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:26.477447 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f363d58c-05d5-4ee2-9ad2-8668bc570690 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:26.482783 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f363d58c-05d5-4ee2-9ad2-8668bc570690 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:26.483421 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f363d58c-05d5-4ee2-9ad2-8668bc570690 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:26.484798 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f363d58c-05d5-4ee2-9ad2-8668bc570690 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:26.485850 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f363d58c-05d5-4ee2-9ad2-8668bc570690 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:26.486750 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f363d58c-05d5-4ee2-9ad2-8668bc570690 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:26.591872 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d6c26db4-6ac4-49d4-a1b8-36daaee255e6 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:26.592513 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d6c26db4-6ac4-49d4-a1b8-36daaee255e6 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:26.600001 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d6c26db4-6ac4-49d4-a1b8-36daaee255e6 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:26.600754 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d6c26db4-6ac4-49d4-a1b8-36daaee255e6 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:26.601493 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d6c26db4-6ac4-49d4-a1b8-36daaee255e6 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:26.602566 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d6c26db4-6ac4-49d4-a1b8-36daaee255e6 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:26.604181 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d6c26db4-6ac4-49d4-a1b8-36daaee255e6 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:26.604793 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d6c26db4-6ac4-49d4-a1b8-36daaee255e6 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:26.629684 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f363d58c-05d5-4ee2-9ad2-8668bc570690 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.177241 Sep 08 11:13:26.630525 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2922/5727] 10.222.0.27 () {58 vars in 1275 bytes} [Thu Sep 8 11:13:26 2022] GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d/os-interface => generated 285 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:13:27.053384 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d6c26db4-6ac4-49d4-a1b8-36daaee255e6 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:27.065364 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d6c26db4-6ac4-49d4-a1b8-36daaee255e6 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:27.067111 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d6c26db4-6ac4-49d4-a1b8-36daaee255e6 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:27.070512 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d6c26db4-6ac4-49d4-a1b8-36daaee255e6 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e" status: 200 len: 1738 microversion: 2.20 time: 0.485647 Sep 08 11:13:27.071721 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2806/5728] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:13:26 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e => generated 1738 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:13:28.109124 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-940f3732-2296-4e65-9c8a-0aa600cf2232 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:28.110820 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-940f3732-2296-4e65-9c8a-0aa600cf2232 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:28.118971 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-940f3732-2296-4e65-9c8a-0aa600cf2232 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:28.119897 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-940f3732-2296-4e65-9c8a-0aa600cf2232 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:28.120571 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-940f3732-2296-4e65-9c8a-0aa600cf2232 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:28.121812 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-940f3732-2296-4e65-9c8a-0aa600cf2232 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:28.122531 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-940f3732-2296-4e65-9c8a-0aa600cf2232 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:28.123195 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-940f3732-2296-4e65-9c8a-0aa600cf2232 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:28.161292 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-c150a3ad-b0be-436b-b09d-b220f2b3cde6 req-9fee5d72-3ea9-4743-81a2-fba25b1920c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a13b5e51-8a1d-4cb4-9485-a183b5a20c8d", "tag": "f1f6fdcb-f442-49bc-ba0f-8ea3d6242f8f"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:13:28.184093 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c150a3ad-b0be-436b-b09d-b220f2b3cde6 req-9fee5d72-3ea9-4743-81a2-fba25b1920c7 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:28.188431 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c150a3ad-b0be-436b-b09d-b220f2b3cde6 req-9fee5d72-3ea9-4743-81a2-fba25b1920c7 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:28.194348 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c150a3ad-b0be-436b-b09d-b220f2b3cde6 req-9fee5d72-3ea9-4743-81a2-fba25b1920c7 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:28.218624 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-c150a3ad-b0be-436b-b09d-b220f2b3cde6 req-9fee5d72-3ea9-4743-81a2-fba25b1920c7 service nova] Creating event network-changed:f1f6fdcb-f442-49bc-ba0f-8ea3d6242f8f for instance a13b5e51-8a1d-4cb4-9485-a183b5a20c8d on n-h1-850501-12 Sep 08 11:13:28.256764 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-c150a3ad-b0be-436b-b09d-b220f2b3cde6 req-9fee5d72-3ea9-4743-81a2-fba25b1920c7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092080 Sep 08 11:13:28.256764 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2807/5729] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:13:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:13:28.454898 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-940f3732-2296-4e65-9c8a-0aa600cf2232 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:28.483133 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-940f3732-2296-4e65-9c8a-0aa600cf2232 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:28.484663 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-940f3732-2296-4e65-9c8a-0aa600cf2232 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:28.485925 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-940f3732-2296-4e65-9c8a-0aa600cf2232 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e" status: 200 len: 1720 microversion: 2.20 time: 0.390530 Sep 08 11:13:28.500733 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2923/5730] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:13:28 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e => generated 1720 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:13:29.522451 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9604d8f3-8387-48d9-99bd-72b61ac12df4 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:29.523763 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9604d8f3-8387-48d9-99bd-72b61ac12df4 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:29.532897 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9604d8f3-8387-48d9-99bd-72b61ac12df4 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:29.533663 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9604d8f3-8387-48d9-99bd-72b61ac12df4 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:29.534263 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9604d8f3-8387-48d9-99bd-72b61ac12df4 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:29.535512 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9604d8f3-8387-48d9-99bd-72b61ac12df4 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:29.536658 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9604d8f3-8387-48d9-99bd-72b61ac12df4 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:29.537588 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9604d8f3-8387-48d9-99bd-72b61ac12df4 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:29.768122 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9604d8f3-8387-48d9-99bd-72b61ac12df4 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:29.778105 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9604d8f3-8387-48d9-99bd-72b61ac12df4 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:29.779608 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9604d8f3-8387-48d9-99bd-72b61ac12df4 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:29.781362 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9604d8f3-8387-48d9-99bd-72b61ac12df4 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e" status: 200 len: 1720 microversion: 2.20 time: 0.265161 Sep 08 11:13:29.781931 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2808/5731] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:13:29 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e => generated 1720 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 11:13:30.808256 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-777004af-aa23-40ac-95f2-96a4c5d23904 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:30.808822 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-777004af-aa23-40ac-95f2-96a4c5d23904 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:30.820230 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-777004af-aa23-40ac-95f2-96a4c5d23904 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:30.820731 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-777004af-aa23-40ac-95f2-96a4c5d23904 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:30.824331 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-777004af-aa23-40ac-95f2-96a4c5d23904 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:30.826108 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-777004af-aa23-40ac-95f2-96a4c5d23904 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:30.826592 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-777004af-aa23-40ac-95f2-96a4c5d23904 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:30.827030 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-777004af-aa23-40ac-95f2-96a4c5d23904 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:31.087783 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-777004af-aa23-40ac-95f2-96a4c5d23904 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:31.122260 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-777004af-aa23-40ac-95f2-96a4c5d23904 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:31.124295 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-777004af-aa23-40ac-95f2-96a4c5d23904 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:31.125957 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-777004af-aa23-40ac-95f2-96a4c5d23904 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e" status: 200 len: 1723 microversion: 2.20 time: 0.321702 Sep 08 11:13:31.126853 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2924/5732] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:13:30 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e => generated 1723 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 11:13:31.157461 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6719a7fa-d51f-448e-8789-0a6a116af17b tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a5aa4d2f-9619-44cf-8fab-594e5bbf665d"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:13:31.160790 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6719a7fa-d51f-448e-8789-0a6a116af17b tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:31.168653 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6719a7fa-d51f-448e-8789-0a6a116af17b tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:31.169566 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6719a7fa-d51f-448e-8789-0a6a116af17b tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:31.170197 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6719a7fa-d51f-448e-8789-0a6a116af17b tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:31.171191 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6719a7fa-d51f-448e-8789-0a6a116af17b tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:31.171841 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6719a7fa-d51f-448e-8789-0a6a116af17b tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:31.172478 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6719a7fa-d51f-448e-8789-0a6a116af17b tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:31.280757 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-09e4a140-0267-4782-a028-ca90a8bd13a8 req-4d739f15-5063-4e2d-a9b0-b8d40556aafa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9c23be4-60f4-4bff-9e0d-8040618b552e", "name": "network-vif-unplugged", "status": "completed", "tag": "0dcde267-c491-450a-894c-03db6d80d8ff"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:13:31.313634 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-09e4a140-0267-4782-a028-ca90a8bd13a8 req-4d739f15-5063-4e2d-a9b0-b8d40556aafa service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:31.314828 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-09e4a140-0267-4782-a028-ca90a8bd13a8 req-4d739f15-5063-4e2d-a9b0-b8d40556aafa service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:31.315908 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-09e4a140-0267-4782-a028-ca90a8bd13a8 req-4d739f15-5063-4e2d-a9b0-b8d40556aafa service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:31.338697 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-09e4a140-0267-4782-a028-ca90a8bd13a8 req-4d739f15-5063-4e2d-a9b0-b8d40556aafa service nova] Creating event network-vif-unplugged:0dcde267-c491-450a-894c-03db6d80d8ff for instance f9c23be4-60f4-4bff-9e0d-8040618b552e on n-h1-850501-12 Sep 08 11:13:31.345638 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-09e4a140-0267-4782-a028-ca90a8bd13a8 req-4d739f15-5063-4e2d-a9b0-b8d40556aafa service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069451 Sep 08 11:13:31.362944 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2925/5733] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:13:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:13:31.630369 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6719a7fa-d51f-448e-8789-0a6a116af17b tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "POST /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.478078 Sep 08 11:13:31.631189 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2809/5734] 10.222.0.27 () {62 vars in 1364 bytes} [Thu Sep 8 11:13:31 2022] POST /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e/os-volume_attachments => generated 188 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 11:13:31.770097 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bb938552-85c8-4870-ad36-e90c3cbfdb61 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:13:31.771225 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bb938552-85c8-4870-ad36-e90c3cbfdb61 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:31.778078 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bb938552-85c8-4870-ad36-e90c3cbfdb61 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:31.778677 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bb938552-85c8-4870-ad36-e90c3cbfdb61 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:31.779190 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bb938552-85c8-4870-ad36-e90c3cbfdb61 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:31.780165 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bb938552-85c8-4870-ad36-e90c3cbfdb61 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:31.780730 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bb938552-85c8-4870-ad36-e90c3cbfdb61 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:31.781716 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bb938552-85c8-4870-ad36-e90c3cbfdb61 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:31.901838 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bb938552-85c8-4870-ad36-e90c3cbfdb61 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128861) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 08 11:13:32.016585 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bb938552-85c8-4870-ad36-e90c3cbfdb61 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "POST /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e/action" status: 202 len: 0 microversion: 2.20 time: 0.251711 Sep 08 11:13:32.019980 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2926/5735] 10.222.0.27 () {62 vars in 1319 bytes} [Thu Sep 8 11:13:31 2022] POST /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e/action => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 08 11:13:32.028297 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0bfe4f89-9293-4a01-8e2a-4da3a52352e1 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:32.029221 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0bfe4f89-9293-4a01-8e2a-4da3a52352e1 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:32.037240 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0bfe4f89-9293-4a01-8e2a-4da3a52352e1 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:32.038576 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0bfe4f89-9293-4a01-8e2a-4da3a52352e1 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:32.039269 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0bfe4f89-9293-4a01-8e2a-4da3a52352e1 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:32.040220 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0bfe4f89-9293-4a01-8e2a-4da3a52352e1 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:32.040888 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0bfe4f89-9293-4a01-8e2a-4da3a52352e1 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:32.041523 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0bfe4f89-9293-4a01-8e2a-4da3a52352e1 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:32.223728 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0bfe4f89-9293-4a01-8e2a-4da3a52352e1 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:32.235257 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0bfe4f89-9293-4a01-8e2a-4da3a52352e1 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:32.236829 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0bfe4f89-9293-4a01-8e2a-4da3a52352e1 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:32.238148 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0bfe4f89-9293-4a01-8e2a-4da3a52352e1 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e" status: 200 len: 1749 microversion: 2.20 time: 0.214630 Sep 08 11:13:32.241080 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2810/5736] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:13:32 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e => generated 1749 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:13:33.267945 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2e5f7898-a14f-4e3f-8c79-ee29eb051f7e tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:33.268599 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2e5f7898-a14f-4e3f-8c79-ee29eb051f7e tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:33.276976 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2e5f7898-a14f-4e3f-8c79-ee29eb051f7e tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:33.277539 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2e5f7898-a14f-4e3f-8c79-ee29eb051f7e tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:33.277974 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2e5f7898-a14f-4e3f-8c79-ee29eb051f7e tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:33.278683 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2e5f7898-a14f-4e3f-8c79-ee29eb051f7e tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:33.279146 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2e5f7898-a14f-4e3f-8c79-ee29eb051f7e tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:33.279577 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2e5f7898-a14f-4e3f-8c79-ee29eb051f7e tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:33.443747 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2e5f7898-a14f-4e3f-8c79-ee29eb051f7e tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:33.452844 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2e5f7898-a14f-4e3f-8c79-ee29eb051f7e tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:33.454359 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2e5f7898-a14f-4e3f-8c79-ee29eb051f7e tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:33.455559 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2e5f7898-a14f-4e3f-8c79-ee29eb051f7e tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e" status: 200 len: 1751 microversion: 2.20 time: 0.193284 Sep 08 11:13:33.461502 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2927/5737] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:13:33 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e => generated 1751 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:13:34.486649 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-22e8b6bc-225f-4336-95cb-aa094c1f7f30 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:34.487979 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-22e8b6bc-225f-4336-95cb-aa094c1f7f30 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:34.500629 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-22e8b6bc-225f-4336-95cb-aa094c1f7f30 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:34.518765 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-22e8b6bc-225f-4336-95cb-aa094c1f7f30 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:34.519252 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-22e8b6bc-225f-4336-95cb-aa094c1f7f30 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:34.533529 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-22e8b6bc-225f-4336-95cb-aa094c1f7f30 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:34.534157 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-22e8b6bc-225f-4336-95cb-aa094c1f7f30 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:34.534608 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-22e8b6bc-225f-4336-95cb-aa094c1f7f30 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:34.807198 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-22e8b6bc-225f-4336-95cb-aa094c1f7f30 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:34.825375 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-22e8b6bc-225f-4336-95cb-aa094c1f7f30 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:34.827389 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-22e8b6bc-225f-4336-95cb-aa094c1f7f30 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:34.828593 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-22e8b6bc-225f-4336-95cb-aa094c1f7f30 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e" status: 200 len: 1751 microversion: 2.20 time: 0.346101 Sep 08 11:13:34.829180 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2811/5738] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:13:34 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e => generated 1751 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:13:35.854915 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-26b7fe95-6c66-4508-b704-b01efc8aeb69 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:35.855595 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-26b7fe95-6c66-4508-b704-b01efc8aeb69 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:35.859762 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:13:35.874232 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-26b7fe95-6c66-4508-b704-b01efc8aeb69 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:35.885574 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-26b7fe95-6c66-4508-b704-b01efc8aeb69 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:35.887213 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-26b7fe95-6c66-4508-b704-b01efc8aeb69 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:35.888887 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-26b7fe95-6c66-4508-b704-b01efc8aeb69 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:35.889982 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-26b7fe95-6c66-4508-b704-b01efc8aeb69 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:35.890608 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-26b7fe95-6c66-4508-b704-b01efc8aeb69 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:36.111342 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-26b7fe95-6c66-4508-b704-b01efc8aeb69 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:36.125381 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-26b7fe95-6c66-4508-b704-b01efc8aeb69 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:36.127403 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-26b7fe95-6c66-4508-b704-b01efc8aeb69 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:36.129090 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-26b7fe95-6c66-4508-b704-b01efc8aeb69 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e" status: 200 len: 1751 microversion: 2.20 time: 0.277925 Sep 08 11:13:36.130263 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2928/5739] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:13:35 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e => generated 1751 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:13:37.176294 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-45f7b67f-f83f-4413-acdb-c748d43a7fd2 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:37.177523 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-45f7b67f-f83f-4413-acdb-c748d43a7fd2 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:37.185393 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-45f7b67f-f83f-4413-acdb-c748d43a7fd2 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:37.186271 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-45f7b67f-f83f-4413-acdb-c748d43a7fd2 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:37.186883 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-45f7b67f-f83f-4413-acdb-c748d43a7fd2 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:37.187775 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-45f7b67f-f83f-4413-acdb-c748d43a7fd2 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:37.188394 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-45f7b67f-f83f-4413-acdb-c748d43a7fd2 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:37.188983 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-45f7b67f-f83f-4413-acdb-c748d43a7fd2 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:37.212155 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5ec25ffc-0e2d-4647-82a6-bdfe57d84a01 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:13:37.215751 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5ec25ffc-0e2d-4647-82a6-bdfe57d84a01 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: af0ed4bb-bf39-4989-893c-14896abbc7d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:37.224030 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5ec25ffc-0e2d-4647-82a6-bdfe57d84a01 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:37.224781 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5ec25ffc-0e2d-4647-82a6-bdfe57d84a01 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:37.225465 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5ec25ffc-0e2d-4647-82a6-bdfe57d84a01 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:37.226364 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5ec25ffc-0e2d-4647-82a6-bdfe57d84a01 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:37.226987 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5ec25ffc-0e2d-4647-82a6-bdfe57d84a01 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:37.227587 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5ec25ffc-0e2d-4647-82a6-bdfe57d84a01 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:37.293160 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5ec25ffc-0e2d-4647-82a6-bdfe57d84a01 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "POST /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5/action" status: 200 len: 24574 microversion: 2.1 time: 0.085119 Sep 08 11:13:37.301414 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2929/5740] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 11:13:37 2022] POST /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5/action => generated 24574 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 11:13:37.417415 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-45f7b67f-f83f-4413-acdb-c748d43a7fd2 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:37.431003 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-45f7b67f-f83f-4413-acdb-c748d43a7fd2 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:37.432551 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-45f7b67f-f83f-4413-acdb-c748d43a7fd2 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:37.434338 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-45f7b67f-f83f-4413-acdb-c748d43a7fd2 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e" status: 200 len: 1751 microversion: 2.20 time: 0.263845 Sep 08 11:13:37.452843 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2812/5741] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:13:37 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e => generated 1751 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:13:38.494718 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5567cf21-b274-4f78-948e-ad2b59cbd6c8 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:38.497574 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5567cf21-b274-4f78-948e-ad2b59cbd6c8 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:38.506413 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5567cf21-b274-4f78-948e-ad2b59cbd6c8 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:38.507201 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5567cf21-b274-4f78-948e-ad2b59cbd6c8 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:38.507822 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5567cf21-b274-4f78-948e-ad2b59cbd6c8 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:38.508783 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5567cf21-b274-4f78-948e-ad2b59cbd6c8 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:38.509464 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5567cf21-b274-4f78-948e-ad2b59cbd6c8 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:38.510083 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5567cf21-b274-4f78-948e-ad2b59cbd6c8 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:38.720737 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5567cf21-b274-4f78-948e-ad2b59cbd6c8 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:38.732564 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5567cf21-b274-4f78-948e-ad2b59cbd6c8 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:38.734885 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5567cf21-b274-4f78-948e-ad2b59cbd6c8 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:38.736511 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5567cf21-b274-4f78-948e-ad2b59cbd6c8 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e" status: 200 len: 1751 microversion: 2.20 time: 0.266615 Sep 08 11:13:38.737704 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2930/5742] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:13:38 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e => generated 1751 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:13:39.765215 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-829271b7-e42d-40f4-a19b-68ebd2890760 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:39.766077 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-829271b7-e42d-40f4-a19b-68ebd2890760 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:39.773544 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-829271b7-e42d-40f4-a19b-68ebd2890760 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:39.774151 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-829271b7-e42d-40f4-a19b-68ebd2890760 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:39.774905 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-829271b7-e42d-40f4-a19b-68ebd2890760 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:39.775851 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-829271b7-e42d-40f4-a19b-68ebd2890760 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:39.776419 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-829271b7-e42d-40f4-a19b-68ebd2890760 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:39.776944 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-829271b7-e42d-40f4-a19b-68ebd2890760 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:39.965248 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-829271b7-e42d-40f4-a19b-68ebd2890760 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:39.978735 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-829271b7-e42d-40f4-a19b-68ebd2890760 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:39.980502 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-829271b7-e42d-40f4-a19b-68ebd2890760 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:39.982315 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-829271b7-e42d-40f4-a19b-68ebd2890760 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e" status: 200 len: 1751 microversion: 2.20 time: 0.222205 Sep 08 11:13:39.983635 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2813/5743] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:13:39 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e => generated 1751 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:13:41.010786 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-61eab5be-1c1a-468d-b426-23155b2e9377 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:41.012524 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-61eab5be-1c1a-468d-b426-23155b2e9377 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:41.021950 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-61eab5be-1c1a-468d-b426-23155b2e9377 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:41.022453 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-61eab5be-1c1a-468d-b426-23155b2e9377 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:41.022894 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-61eab5be-1c1a-468d-b426-23155b2e9377 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:41.023847 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-61eab5be-1c1a-468d-b426-23155b2e9377 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:41.024317 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-61eab5be-1c1a-468d-b426-23155b2e9377 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:41.024754 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-61eab5be-1c1a-468d-b426-23155b2e9377 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:41.052040 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:13:41.253948 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-61eab5be-1c1a-468d-b426-23155b2e9377 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:41.266640 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-61eab5be-1c1a-468d-b426-23155b2e9377 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:41.268256 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-61eab5be-1c1a-468d-b426-23155b2e9377 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:41.269605 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-61eab5be-1c1a-468d-b426-23155b2e9377 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e" status: 200 len: 1807 microversion: 2.20 time: 0.263070 Sep 08 11:13:41.270408 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2931/5744] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:13:41 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e => generated 1807 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:13:42.299127 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-82e1f3f7-2924-4fc4-b4af-30718d44ca94 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:42.299957 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-82e1f3f7-2924-4fc4-b4af-30718d44ca94 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:42.321043 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-82e1f3f7-2924-4fc4-b4af-30718d44ca94 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:42.321575 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-82e1f3f7-2924-4fc4-b4af-30718d44ca94 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:42.322030 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-82e1f3f7-2924-4fc4-b4af-30718d44ca94 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:42.322759 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-82e1f3f7-2924-4fc4-b4af-30718d44ca94 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:42.323223 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-82e1f3f7-2924-4fc4-b4af-30718d44ca94 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:42.323652 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-82e1f3f7-2924-4fc4-b4af-30718d44ca94 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:42.745164 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-82e1f3f7-2924-4fc4-b4af-30718d44ca94 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:42.751334 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:13:42.762870 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-82e1f3f7-2924-4fc4-b4af-30718d44ca94 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:42.765455 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-82e1f3f7-2924-4fc4-b4af-30718d44ca94 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:42.768235 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-82e1f3f7-2924-4fc4-b4af-30718d44ca94 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e" status: 200 len: 1807 microversion: 2.20 time: 0.474866 Sep 08 11:13:42.772080 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2814/5745] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:13:42 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e => generated 1807 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:13:43.653207 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-9ccc3130-e0a8-4400-8396-1176d887c623 req-e42a9c80-4e79-496d-80b8-e28577bfb373 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9c23be4-60f4-4bff-9e0d-8040618b552e", "tag": "0dcde267-c491-450a-894c-03db6d80d8ff"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:13:43.679690 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-9ccc3130-e0a8-4400-8396-1176d887c623 req-e42a9c80-4e79-496d-80b8-e28577bfb373 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:43.681601 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-9ccc3130-e0a8-4400-8396-1176d887c623 req-e42a9c80-4e79-496d-80b8-e28577bfb373 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:43.682476 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-9ccc3130-e0a8-4400-8396-1176d887c623 req-e42a9c80-4e79-496d-80b8-e28577bfb373 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:43.725968 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-9ccc3130-e0a8-4400-8396-1176d887c623 req-e42a9c80-4e79-496d-80b8-e28577bfb373 service nova] Creating event network-changed:0dcde267-c491-450a-894c-03db6d80d8ff for instance f9c23be4-60f4-4bff-9e0d-8040618b552e on n-h2-850501-12 Sep 08 11:13:43.739096 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-9ccc3130-e0a8-4400-8396-1176d887c623 req-e42a9c80-4e79-496d-80b8-e28577bfb373 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089453 Sep 08 11:13:43.741708 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2932/5746] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:13:43.798475 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-94774843-b1f0-4747-a30d-87aff453d43d tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:43.799082 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-94774843-b1f0-4747-a30d-87aff453d43d tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:43.812810 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94774843-b1f0-4747-a30d-87aff453d43d tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:43.813334 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94774843-b1f0-4747-a30d-87aff453d43d tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:43.813771 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94774843-b1f0-4747-a30d-87aff453d43d tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:43.816314 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94774843-b1f0-4747-a30d-87aff453d43d tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:43.816781 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94774843-b1f0-4747-a30d-87aff453d43d tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:43.817248 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94774843-b1f0-4747-a30d-87aff453d43d tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:44.136038 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-94774843-b1f0-4747-a30d-87aff453d43d tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:44.154801 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-94774843-b1f0-4747-a30d-87aff453d43d tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:44.159005 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-94774843-b1f0-4747-a30d-87aff453d43d tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:44.160246 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-94774843-b1f0-4747-a30d-87aff453d43d tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e" status: 200 len: 1807 microversion: 2.20 time: 0.365681 Sep 08 11:13:44.160837 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2815/5747] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:13:43 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e => generated 1807 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:13:45.188510 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-df9fa0a6-02be-42cf-a891-aac20d95eb6b tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:45.190078 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-df9fa0a6-02be-42cf-a891-aac20d95eb6b tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:45.204127 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-df9fa0a6-02be-42cf-a891-aac20d95eb6b tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:45.205408 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-df9fa0a6-02be-42cf-a891-aac20d95eb6b tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:45.207374 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-df9fa0a6-02be-42cf-a891-aac20d95eb6b tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:45.209866 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-df9fa0a6-02be-42cf-a891-aac20d95eb6b tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:45.210688 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-df9fa0a6-02be-42cf-a891-aac20d95eb6b tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:45.211470 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-df9fa0a6-02be-42cf-a891-aac20d95eb6b tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:45.436645 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-df9fa0a6-02be-42cf-a891-aac20d95eb6b tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:45.463024 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-df9fa0a6-02be-42cf-a891-aac20d95eb6b tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:45.467000 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-df9fa0a6-02be-42cf-a891-aac20d95eb6b tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:45.478753 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-df9fa0a6-02be-42cf-a891-aac20d95eb6b tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e" status: 200 len: 1807 microversion: 2.20 time: 0.295120 Sep 08 11:13:45.494880 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2933/5748] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:13:45 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e => generated 1807 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:13:46.512885 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-663f406a-6e46-4163-9b01-60662f290dd7 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:46.515563 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-663f406a-6e46-4163-9b01-60662f290dd7 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:46.532938 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-663f406a-6e46-4163-9b01-60662f290dd7 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:46.533468 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-663f406a-6e46-4163-9b01-60662f290dd7 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:46.539516 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-663f406a-6e46-4163-9b01-60662f290dd7 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:46.540769 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-663f406a-6e46-4163-9b01-60662f290dd7 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:46.541604 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-663f406a-6e46-4163-9b01-60662f290dd7 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:46.542512 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-663f406a-6e46-4163-9b01-60662f290dd7 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:46.928929 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-663f406a-6e46-4163-9b01-60662f290dd7 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:46.942126 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-663f406a-6e46-4163-9b01-60662f290dd7 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:46.945980 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-663f406a-6e46-4163-9b01-60662f290dd7 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:46.947791 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-663f406a-6e46-4163-9b01-60662f290dd7 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e" status: 200 len: 1807 microversion: 2.20 time: 0.440132 Sep 08 11:13:46.969572 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2816/5749] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:13:46 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e => generated 1807 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:13:47.061252 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-58a91058-0fc0-407f-9450-9d056450b02f tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Action: 'create', calling method: .version_select at 0x7f68e40ad940>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-745299918", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLy/wK8uzKU19lzlzAWrJIAnkGNv1igGI0YQIh3/2rf/r6OfRN7DTWAEQeffh0jTZEB+AVVWDs6RKCN2KrAgHuWX5VS3VDv+LqTuzAS7+6U8ZTCgraDZJY2X9+AeuQvL5w=="}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:13:47.117894 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-58a91058-0fc0-407f-9450-9d056450b02f tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Getting quotas for project 8309c65adcd147ba95df7ec8d6b8fb10. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:13:47.135475 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-58a91058-0fc0-407f-9450-9d056450b02f tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Getting quotas for user 7d9770721b674c489e0491156a7c5efc and project 8309c65adcd147ba95df7ec8d6b8fb10. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:13:47.199035 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-58a91058-0fc0-407f-9450-9d056450b02f tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.532161 Sep 08 11:13:47.206854 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2934/5750] 10.222.0.27 () {60 vars in 1159 bytes} [Thu Sep 8 11:13:46 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:13:47.980827 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9e330c25-2509-4a85-bab0-0cc67ecfe1e4 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:47.981758 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9e330c25-2509-4a85-bab0-0cc67ecfe1e4 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:48.004199 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9e330c25-2509-4a85-bab0-0cc67ecfe1e4 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:48.005143 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9e330c25-2509-4a85-bab0-0cc67ecfe1e4 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:48.005822 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9e330c25-2509-4a85-bab0-0cc67ecfe1e4 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:48.006853 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9e330c25-2509-4a85-bab0-0cc67ecfe1e4 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:48.007545 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9e330c25-2509-4a85-bab0-0cc67ecfe1e4 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:48.011889 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9e330c25-2509-4a85-bab0-0cc67ecfe1e4 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:48.138280 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8a6c1d2d-f109-4492-890c-0b2c49c79ada tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:48.140227 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8a6c1d2d-f109-4492-890c-0b2c49c79ada tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] [instance: af0ed4bb-bf39-4989-893c-14896abbc7d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:48.162674 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8a6c1d2d-f109-4492-890c-0b2c49c79ada tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:48.163479 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8a6c1d2d-f109-4492-890c-0b2c49c79ada tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:48.166613 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8a6c1d2d-f109-4492-890c-0b2c49c79ada tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:48.167755 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8a6c1d2d-f109-4492-890c-0b2c49c79ada tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:48.168526 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8a6c1d2d-f109-4492-890c-0b2c49c79ada tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:48.169504 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8a6c1d2d-f109-4492-890c-0b2c49c79ada tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:48.298700 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9e330c25-2509-4a85-bab0-0cc67ecfe1e4 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:48.308728 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9e330c25-2509-4a85-bab0-0cc67ecfe1e4 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:48.311498 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9e330c25-2509-4a85-bab0-0cc67ecfe1e4 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:48.313391 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9e330c25-2509-4a85-bab0-0cc67ecfe1e4 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e" status: 200 len: 1807 microversion: 2.20 time: 0.337365 Sep 08 11:13:48.314236 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2817/5751] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:13:47 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e => generated 1807 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:13:48.908964 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8a6c1d2d-f109-4492-890c-0b2c49c79ada tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5" status: 200 len: 1836 microversion: 2.1 time: 0.774545 Sep 08 11:13:48.909636 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2935/5752] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:13:48 2022] GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5 => generated 1836 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:13:48.940415 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-09ff7f44-bc48-43c2-a3fe-6dd50cb758a8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:48.942287 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-09ff7f44-bc48-43c2-a3fe-6dd50cb758a8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: af0ed4bb-bf39-4989-893c-14896abbc7d5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:48.956142 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-09ff7f44-bc48-43c2-a3fe-6dd50cb758a8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:48.956719 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-09ff7f44-bc48-43c2-a3fe-6dd50cb758a8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:48.957254 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-09ff7f44-bc48-43c2-a3fe-6dd50cb758a8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:48.958036 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-09ff7f44-bc48-43c2-a3fe-6dd50cb758a8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:48.958730 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-09ff7f44-bc48-43c2-a3fe-6dd50cb758a8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:48.959146 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-09ff7f44-bc48-43c2-a3fe-6dd50cb758a8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:49.340187 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-dc1788c5-bd91-4ed7-a458-f748635cfc0a tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:49.340822 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-dc1788c5-bd91-4ed7-a458-f748635cfc0a tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:49.353002 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dc1788c5-bd91-4ed7-a458-f748635cfc0a tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:49.354092 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-09ff7f44-bc48-43c2-a3fe-6dd50cb758a8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:49.357284 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dc1788c5-bd91-4ed7-a458-f748635cfc0a tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:49.361232 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dc1788c5-bd91-4ed7-a458-f748635cfc0a tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:49.362107 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dc1788c5-bd91-4ed7-a458-f748635cfc0a tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:49.362599 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dc1788c5-bd91-4ed7-a458-f748635cfc0a tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:49.363047 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dc1788c5-bd91-4ed7-a458-f748635cfc0a tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:49.367223 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-09ff7f44-bc48-43c2-a3fe-6dd50cb758a8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5" status: 200 len: 1683 microversion: 2.1 time: 0.434469 Sep 08 11:13:49.368441 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2818/5753] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:13:48 2022] GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5 => generated 1683 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:13:49.568124 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-afa88ea2-7062-4abc-b5a4-1d4b67db676c tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:13:49.570645 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-afa88ea2-7062-4abc-b5a4-1d4b67db676c tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: af0ed4bb-bf39-4989-893c-14896abbc7d5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:49.582669 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-afa88ea2-7062-4abc-b5a4-1d4b67db676c tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:49.583215 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-afa88ea2-7062-4abc-b5a4-1d4b67db676c tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:49.583659 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-afa88ea2-7062-4abc-b5a4-1d4b67db676c tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:49.584401 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-afa88ea2-7062-4abc-b5a4-1d4b67db676c tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:49.584887 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-afa88ea2-7062-4abc-b5a4-1d4b67db676c tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:49.585338 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-afa88ea2-7062-4abc-b5a4-1d4b67db676c tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:49.793856 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-dc1788c5-bd91-4ed7-a458-f748635cfc0a tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:49.816273 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-dc1788c5-bd91-4ed7-a458-f748635cfc0a tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:49.820760 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-dc1788c5-bd91-4ed7-a458-f748635cfc0a tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:49.822883 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-dc1788c5-bd91-4ed7-a458-f748635cfc0a tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e" status: 200 len: 1807 microversion: 2.20 time: 0.486853 Sep 08 11:13:49.839513 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2936/5754] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:13:49 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e => generated 1807 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:13:50.098271 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-afa88ea2-7062-4abc-b5a4-1d4b67db676c tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "POST /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5/action" status: 200 len: 32643 microversion: 2.1 time: 0.533808 Sep 08 11:13:50.100344 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2819/5755] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 11:13:49 2022] POST /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5/action => generated 32643 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 11:13:50.246663 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-acb7bafd-9476-4f7e-bacb-46691a460e46 tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:13:50.247342 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-acb7bafd-9476-4f7e-bacb-46691a460e46 tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] [instance: af0ed4bb-bf39-4989-893c-14896abbc7d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:50.266115 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-acb7bafd-9476-4f7e-bacb-46691a460e46 tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:50.266629 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-acb7bafd-9476-4f7e-bacb-46691a460e46 tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:50.267131 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-acb7bafd-9476-4f7e-bacb-46691a460e46 tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:50.267947 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-acb7bafd-9476-4f7e-bacb-46691a460e46 tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:50.268402 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-acb7bafd-9476-4f7e-bacb-46691a460e46 tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:50.268848 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-acb7bafd-9476-4f7e-bacb-46691a460e46 tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:50.410952 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-acb7bafd-9476-4f7e-bacb-46691a460e46 tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '2c091161fcc640d59b9772143add9ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151f52ba802b4bfcaf0b18aa45ee89d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:50.415997 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-acb7bafd-9476-4f7e-bacb-46691a460e46 tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] [instance: af0ed4bb-bf39-4989-893c-14896abbc7d5] flavor_id is None. Assuming migration. {{(pid=128861) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 08 11:13:50.416718 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-acb7bafd-9476-4f7e-bacb-46691a460e46 tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] [instance: af0ed4bb-bf39-4989-893c-14896abbc7d5] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128861) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 08 11:13:50.854636 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2a20aa7b-bd45-42f4-b44d-db756b72e4f0 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:50.862176 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2a20aa7b-bd45-42f4-b44d-db756b72e4f0 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:50.886622 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2a20aa7b-bd45-42f4-b44d-db756b72e4f0 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:50.892763 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2a20aa7b-bd45-42f4-b44d-db756b72e4f0 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:50.893302 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2a20aa7b-bd45-42f4-b44d-db756b72e4f0 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:50.894063 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2a20aa7b-bd45-42f4-b44d-db756b72e4f0 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:50.906147 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2a20aa7b-bd45-42f4-b44d-db756b72e4f0 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:50.906147 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2a20aa7b-bd45-42f4-b44d-db756b72e4f0 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:51.015224 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-acb7bafd-9476-4f7e-bacb-46691a460e46 tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5/action" status: 202 len: 0 microversion: 2.1 time: 0.772622 Sep 08 11:13:51.016860 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2937/5756] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 11:13:50 2022] POST /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5/action => generated 0 bytes in 775 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:13:51.063148 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-25a33658-1574-4ef3-b544-fcad49449d2f tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:51.063933 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-25a33658-1574-4ef3-b544-fcad49449d2f tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: af0ed4bb-bf39-4989-893c-14896abbc7d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:51.076895 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-25a33658-1574-4ef3-b544-fcad49449d2f tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:51.077811 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-25a33658-1574-4ef3-b544-fcad49449d2f tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:51.078501 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-25a33658-1574-4ef3-b544-fcad49449d2f tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:51.079438 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-25a33658-1574-4ef3-b544-fcad49449d2f tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:51.080138 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-25a33658-1574-4ef3-b544-fcad49449d2f tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:51.081680 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-25a33658-1574-4ef3-b544-fcad49449d2f tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:51.249184 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2a20aa7b-bd45-42f4-b44d-db756b72e4f0 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:51.289629 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2a20aa7b-bd45-42f4-b44d-db756b72e4f0 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:51.297172 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2a20aa7b-bd45-42f4-b44d-db756b72e4f0 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:51.299501 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2a20aa7b-bd45-42f4-b44d-db756b72e4f0 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e" status: 200 len: 1807 microversion: 2.20 time: 0.449312 Sep 08 11:13:51.303553 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2820/5757] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:13:50 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e => generated 1807 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:13:51.448544 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-25a33658-1574-4ef3-b544-fcad49449d2f tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:51.460499 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-25a33658-1574-4ef3-b544-fcad49449d2f tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5" status: 200 len: 1692 microversion: 2.1 time: 0.424160 Sep 08 11:13:51.467449 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2938/5758] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:13:51 2022] GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5 => generated 1692 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:13:52.332064 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-29e68438-9032-4210-88f7-47117c0b73eb tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:52.333480 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-29e68438-9032-4210-88f7-47117c0b73eb tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:52.348136 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-29e68438-9032-4210-88f7-47117c0b73eb tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:52.353756 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-29e68438-9032-4210-88f7-47117c0b73eb tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:52.356368 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-29e68438-9032-4210-88f7-47117c0b73eb tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:52.358246 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-29e68438-9032-4210-88f7-47117c0b73eb tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:52.361789 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-29e68438-9032-4210-88f7-47117c0b73eb tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:52.362526 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-29e68438-9032-4210-88f7-47117c0b73eb tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:52.498473 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b747ae67-e07e-4e2c-a7f1-6be21038b478 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:52.500123 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b747ae67-e07e-4e2c-a7f1-6be21038b478 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: af0ed4bb-bf39-4989-893c-14896abbc7d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:52.521489 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b747ae67-e07e-4e2c-a7f1-6be21038b478 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:52.524584 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b747ae67-e07e-4e2c-a7f1-6be21038b478 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:52.525271 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b747ae67-e07e-4e2c-a7f1-6be21038b478 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:52.528572 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b747ae67-e07e-4e2c-a7f1-6be21038b478 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:52.529990 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b747ae67-e07e-4e2c-a7f1-6be21038b478 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:52.530640 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b747ae67-e07e-4e2c-a7f1-6be21038b478 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:52.736827 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-29e68438-9032-4210-88f7-47117c0b73eb tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:52.750743 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-29e68438-9032-4210-88f7-47117c0b73eb tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:52.754681 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-29e68438-9032-4210-88f7-47117c0b73eb tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:52.758388 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-29e68438-9032-4210-88f7-47117c0b73eb tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e" status: 200 len: 1807 microversion: 2.20 time: 0.430358 Sep 08 11:13:52.762133 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2821/5759] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:13:52 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e => generated 1807 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:13:53.110111 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b747ae67-e07e-4e2c-a7f1-6be21038b478 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:53.122991 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b747ae67-e07e-4e2c-a7f1-6be21038b478 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5" status: 200 len: 1692 microversion: 2.1 time: 0.629104 Sep 08 11:13:53.123589 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2939/5760] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:13:52 2022] GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5 => generated 1692 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:13:53.790039 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9a7c234d-94df-458b-b1e2-7ac43b5681ac tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:53.791039 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9a7c234d-94df-458b-b1e2-7ac43b5681ac tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:53.812755 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=40 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:13:53.822156 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9a7c234d-94df-458b-b1e2-7ac43b5681ac tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:53.825764 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9a7c234d-94df-458b-b1e2-7ac43b5681ac tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:53.828624 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9a7c234d-94df-458b-b1e2-7ac43b5681ac tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:53.833328 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9a7c234d-94df-458b-b1e2-7ac43b5681ac tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:53.835598 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9a7c234d-94df-458b-b1e2-7ac43b5681ac tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:53.837325 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9a7c234d-94df-458b-b1e2-7ac43b5681ac tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:54.161874 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cd7d65d3-555d-40d2-9d14-952c15c2e136 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:54.162764 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cd7d65d3-555d-40d2-9d14-952c15c2e136 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: af0ed4bb-bf39-4989-893c-14896abbc7d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:54.199095 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cd7d65d3-555d-40d2-9d14-952c15c2e136 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:54.210291 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cd7d65d3-555d-40d2-9d14-952c15c2e136 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:54.211190 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cd7d65d3-555d-40d2-9d14-952c15c2e136 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:54.212684 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cd7d65d3-555d-40d2-9d14-952c15c2e136 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:54.213515 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cd7d65d3-555d-40d2-9d14-952c15c2e136 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:54.214174 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cd7d65d3-555d-40d2-9d14-952c15c2e136 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:54.755240 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-cd7d65d3-555d-40d2-9d14-952c15c2e136 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:54.768725 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cd7d65d3-555d-40d2-9d14-952c15c2e136 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5" status: 200 len: 1692 microversion: 2.1 time: 0.621659 Sep 08 11:13:54.769464 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2940/5761] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:13:54 2022] GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5 => generated 1692 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:13:54.874749 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9a7c234d-94df-458b-b1e2-7ac43b5681ac tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:54.932685 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9a7c234d-94df-458b-b1e2-7ac43b5681ac tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:54.938991 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9a7c234d-94df-458b-b1e2-7ac43b5681ac tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:54.944796 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9a7c234d-94df-458b-b1e2-7ac43b5681ac tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e" status: 200 len: 1807 microversion: 2.20 time: 1.158836 Sep 08 11:13:54.971456 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2822/5762] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:13:53 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e => generated 1807 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:13:55.810636 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9c1fd7ef-a237-4075-a16d-e510154d0746 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:55.822003 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9c1fd7ef-a237-4075-a16d-e510154d0746 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: af0ed4bb-bf39-4989-893c-14896abbc7d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:55.843905 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9c1fd7ef-a237-4075-a16d-e510154d0746 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:55.844435 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9c1fd7ef-a237-4075-a16d-e510154d0746 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:55.845513 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9c1fd7ef-a237-4075-a16d-e510154d0746 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:55.849985 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9c1fd7ef-a237-4075-a16d-e510154d0746 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:55.850461 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9c1fd7ef-a237-4075-a16d-e510154d0746 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:55.850923 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9c1fd7ef-a237-4075-a16d-e510154d0746 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:56.081230 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8d20220c-e95c-4b36-82c4-6e7e85d60497 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:56.082584 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8d20220c-e95c-4b36-82c4-6e7e85d60497 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:56.102398 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d20220c-e95c-4b36-82c4-6e7e85d60497 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:56.103884 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d20220c-e95c-4b36-82c4-6e7e85d60497 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:56.104390 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d20220c-e95c-4b36-82c4-6e7e85d60497 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:56.109215 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d20220c-e95c-4b36-82c4-6e7e85d60497 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:56.111558 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d20220c-e95c-4b36-82c4-6e7e85d60497 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:56.112833 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d20220c-e95c-4b36-82c4-6e7e85d60497 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:57.145534 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=4 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:13:57.371008 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9c1fd7ef-a237-4075-a16d-e510154d0746 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:57.380803 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9c1fd7ef-a237-4075-a16d-e510154d0746 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5" status: 200 len: 1692 microversion: 2.1 time: 1.586895 Sep 08 11:13:57.389180 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2941/5763] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:13:55 2022] GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5 => generated 1692 bytes in 1596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:13:57.732558 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8d20220c-e95c-4b36-82c4-6e7e85d60497 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:57.756686 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8d20220c-e95c-4b36-82c4-6e7e85d60497 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:57.758638 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8d20220c-e95c-4b36-82c4-6e7e85d60497 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:57.762563 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8d20220c-e95c-4b36-82c4-6e7e85d60497 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e" status: 200 len: 1807 microversion: 2.20 time: 1.762463 Sep 08 11:13:57.764915 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2823/5764] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:13:55 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e => generated 1807 bytes in 1768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:13:58.416161 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-70fe55da-54e7-45ca-a339-e4defe2fe871 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:58.417267 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-70fe55da-54e7-45ca-a339-e4defe2fe871 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: af0ed4bb-bf39-4989-893c-14896abbc7d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:58.433801 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-70fe55da-54e7-45ca-a339-e4defe2fe871 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:58.435570 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-70fe55da-54e7-45ca-a339-e4defe2fe871 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:58.436037 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-70fe55da-54e7-45ca-a339-e4defe2fe871 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:58.441136 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-70fe55da-54e7-45ca-a339-e4defe2fe871 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:58.445154 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-70fe55da-54e7-45ca-a339-e4defe2fe871 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:58.445766 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-70fe55da-54e7-45ca-a339-e4defe2fe871 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:58.795034 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8dbffce0-2f9d-429c-862d-a50ac4b9c63f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:58.796008 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8dbffce0-2f9d-429c-862d-a50ac4b9c63f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:58.840050 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8dbffce0-2f9d-429c-862d-a50ac4b9c63f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:58.845437 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8dbffce0-2f9d-429c-862d-a50ac4b9c63f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:58.846119 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8dbffce0-2f9d-429c-862d-a50ac4b9c63f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:58.847193 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8dbffce0-2f9d-429c-862d-a50ac4b9c63f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:58.849822 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8dbffce0-2f9d-429c-862d-a50ac4b9c63f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:58.850504 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8dbffce0-2f9d-429c-862d-a50ac4b9c63f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:58.889069 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-70fe55da-54e7-45ca-a339-e4defe2fe871 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:58.909868 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-70fe55da-54e7-45ca-a339-e4defe2fe871 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5" status: 200 len: 1692 microversion: 2.1 time: 0.486288 Sep 08 11:13:58.909868 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2942/5765] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:13:58 2022] GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5 => generated 1692 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:13:59.467933 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8dbffce0-2f9d-429c-862d-a50ac4b9c63f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:59.483341 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8dbffce0-2f9d-429c-862d-a50ac4b9c63f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:59.485203 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8dbffce0-2f9d-429c-862d-a50ac4b9c63f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:59.486549 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8dbffce0-2f9d-429c-862d-a50ac4b9c63f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e" status: 200 len: 1807 microversion: 2.20 time: 0.697583 Sep 08 11:13:59.487909 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2824/5766] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:13:58 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e => generated 1807 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:13:59.940598 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-00d258fa-8658-4892-87d4-eadaa7811241 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:59.941253 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-00d258fa-8658-4892-87d4-eadaa7811241 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: af0ed4bb-bf39-4989-893c-14896abbc7d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:59.971574 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-00d258fa-8658-4892-87d4-eadaa7811241 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:59.972410 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-00d258fa-8658-4892-87d4-eadaa7811241 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:59.973140 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-00d258fa-8658-4892-87d4-eadaa7811241 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:59.977649 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-00d258fa-8658-4892-87d4-eadaa7811241 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:59.978347 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-00d258fa-8658-4892-87d4-eadaa7811241 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:59.978824 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-00d258fa-8658-4892-87d4-eadaa7811241 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:00.269474 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-00d258fa-8658-4892-87d4-eadaa7811241 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:00.312769 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-00d258fa-8658-4892-87d4-eadaa7811241 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5" status: 200 len: 1697 microversion: 2.1 time: 0.375929 Sep 08 11:14:00.322494 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2943/5767] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:13:59 2022] GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5 => generated 1697 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:14:00.528261 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0eaf81f8-0587-4f28-b6d5-d7b6527f310d tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:00.533973 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0eaf81f8-0587-4f28-b6d5-d7b6527f310d tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:00.554906 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0eaf81f8-0587-4f28-b6d5-d7b6527f310d tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:00.554906 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0eaf81f8-0587-4f28-b6d5-d7b6527f310d tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:00.555137 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0eaf81f8-0587-4f28-b6d5-d7b6527f310d tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:00.555840 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0eaf81f8-0587-4f28-b6d5-d7b6527f310d tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:00.556502 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0eaf81f8-0587-4f28-b6d5-d7b6527f310d tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:00.556943 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0eaf81f8-0587-4f28-b6d5-d7b6527f310d tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:00.767076 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0eaf81f8-0587-4f28-b6d5-d7b6527f310d tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:00.786885 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0eaf81f8-0587-4f28-b6d5-d7b6527f310d tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:00.788767 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0eaf81f8-0587-4f28-b6d5-d7b6527f310d tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:00.796475 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0eaf81f8-0587-4f28-b6d5-d7b6527f310d tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e" status: 200 len: 1807 microversion: 2.20 time: 0.279796 Sep 08 11:14:00.797479 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2825/5768] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:14:00 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e => generated 1807 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 11:14:01.014869 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-dc80bd3c-75b1-489a-8f11-7f90e8cbfc3c tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-970312101-access_point-825809106", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "ff2bf983-ccc3-4002-85e7-6066585a80ed"}], "key_name": "tempest-TestSecurityGroupsBasicOps-745299918", "security_groups": [{"name": "tempest-secgroup_access--724439095"}, {"name": "tempest-secgroup_general--74381862"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:14:01.240803 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-dc80bd3c-75b1-489a-8f11-7f90e8cbfc3c tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] validate_networks() for [('ff2bf983-ccc3-4002-85e7-6066585a80ed', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:14:01.338572 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8c8af3fe-18df-4e04-aeb5-3cb5ba97db09 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:01.339350 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8c8af3fe-18df-4e04-aeb5-3cb5ba97db09 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: af0ed4bb-bf39-4989-893c-14896abbc7d5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:01.348774 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c8af3fe-18df-4e04-aeb5-3cb5ba97db09 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:01.349317 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c8af3fe-18df-4e04-aeb5-3cb5ba97db09 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:01.349760 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c8af3fe-18df-4e04-aeb5-3cb5ba97db09 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:01.350505 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c8af3fe-18df-4e04-aeb5-3cb5ba97db09 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:01.350972 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c8af3fe-18df-4e04-aeb5-3cb5ba97db09 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:01.351406 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c8af3fe-18df-4e04-aeb5-3cb5ba97db09 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:01.590828 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8c8af3fe-18df-4e04-aeb5-3cb5ba97db09 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:01.627638 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8c8af3fe-18df-4e04-aeb5-3cb5ba97db09 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5" status: 200 len: 1697 microversion: 2.1 time: 0.289983 Sep 08 11:14:01.648188 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2826/5769] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:01 2022] GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5 => generated 1697 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:14:01.835172 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bb5aa182-d83c-4e98-b96b-8e0c37e9b32e tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:01.836250 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bb5aa182-d83c-4e98-b96b-8e0c37e9b32e tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:01.847445 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb5aa182-d83c-4e98-b96b-8e0c37e9b32e tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:01.848869 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb5aa182-d83c-4e98-b96b-8e0c37e9b32e tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:01.849901 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb5aa182-d83c-4e98-b96b-8e0c37e9b32e tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:01.851747 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb5aa182-d83c-4e98-b96b-8e0c37e9b32e tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:01.852223 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb5aa182-d83c-4e98-b96b-8e0c37e9b32e tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:01.853342 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb5aa182-d83c-4e98-b96b-8e0c37e9b32e tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:01.885876 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-dc80bd3c-75b1-489a-8f11-7f90e8cbfc3c tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:14:01.886324 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-dc80bd3c-75b1-489a-8f11-7f90e8cbfc3c tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:14:01.886817 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-dc80bd3c-75b1-489a-8f11-7f90e8cbfc3c tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:14:01.887239 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-dc80bd3c-75b1-489a-8f11-7f90e8cbfc3c tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:14:01.888210 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-dc80bd3c-75b1-489a-8f11-7f90e8cbfc3c tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:14:01.902536 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dc80bd3c-75b1-489a-8f11-7f90e8cbfc3c tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:01.902536 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dc80bd3c-75b1-489a-8f11-7f90e8cbfc3c tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:01.902536 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dc80bd3c-75b1-489a-8f11-7f90e8cbfc3c tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:01.905005 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dc80bd3c-75b1-489a-8f11-7f90e8cbfc3c tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:01.905005 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dc80bd3c-75b1-489a-8f11-7f90e8cbfc3c tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:01.905843 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dc80bd3c-75b1-489a-8f11-7f90e8cbfc3c tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:01.947565 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-dc80bd3c-75b1-489a-8f11-7f90e8cbfc3c tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Getting quotas for project 8309c65adcd147ba95df7ec8d6b8fb10. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:14:01.958298 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-dc80bd3c-75b1-489a-8f11-7f90e8cbfc3c tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Getting quotas for user 7d9770721b674c489e0491156a7c5efc and project 8309c65adcd147ba95df7ec8d6b8fb10. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:14:01.997660 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-dc80bd3c-75b1-489a-8f11-7f90e8cbfc3c tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:14:02.002625 n-d-850501-12 devstack@n-api.service[128861]: WARNING nova.utils [None req-dc80bd3c-75b1-489a-8f11-7f90e8cbfc3c tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-970312101-access_point-825809106 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-970312101-acc Sep 08 11:14:02.003430 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-dc80bd3c-75b1-489a-8f11-7f90e8cbfc3c tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] [instance: 90938b52-4f78-45e5-aea8-4a74f5734b4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:14:02.081346 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-dc80bd3c-75b1-489a-8f11-7f90e8cbfc3c tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 455 microversion: 2.1 time: 1.070798 Sep 08 11:14:02.090293 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2944/5770] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 11:14:01 2022] POST /compute/v2.1/servers => generated 455 bytes in 1081 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:14:02.098611 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-eea4cb02-4878-4ce1-80ee-82c83e4d2778 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:02.100409 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-eea4cb02-4878-4ce1-80ee-82c83e4d2778 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] [instance: 90938b52-4f78-45e5-aea8-4a74f5734b4a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:02.222612 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bb5aa182-d83c-4e98-b96b-8e0c37e9b32e tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:02.236571 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-eea4cb02-4878-4ce1-80ee-82c83e4d2778 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9770721b674c489e0491156a7c5efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c65adcd147ba95df7ec8d6b8fb10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:02.249597 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bb5aa182-d83c-4e98-b96b-8e0c37e9b32e tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:02.252403 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bb5aa182-d83c-4e98-b96b-8e0c37e9b32e tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:02.254618 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bb5aa182-d83c-4e98-b96b-8e0c37e9b32e tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e" status: 200 len: 1807 microversion: 2.20 time: 0.429866 Sep 08 11:14:02.255667 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2827/5771] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:14:01 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e => generated 1807 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:14:02.298300 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-eea4cb02-4878-4ce1-80ee-82c83e4d2778 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] 10.222.0.27 "GET /compute/v2.1/servers/90938b52-4f78-45e5-aea8-4a74f5734b4a" status: 200 len: 1292 microversion: 2.1 time: 0.205739 Sep 08 11:14:02.299595 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2945/5772] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:02 2022] GET /compute/v2.1/servers/90938b52-4f78-45e5-aea8-4a74f5734b4a => generated 1292 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:14:02.664040 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5894fa2c-6afa-4a45-a723-f26fb1cf4814 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:02.673443 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5894fa2c-6afa-4a45-a723-f26fb1cf4814 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: af0ed4bb-bf39-4989-893c-14896abbc7d5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:02.685188 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5894fa2c-6afa-4a45-a723-f26fb1cf4814 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:02.686158 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5894fa2c-6afa-4a45-a723-f26fb1cf4814 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:02.726510 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5894fa2c-6afa-4a45-a723-f26fb1cf4814 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:02.729625 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5894fa2c-6afa-4a45-a723-f26fb1cf4814 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:02.730123 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5894fa2c-6afa-4a45-a723-f26fb1cf4814 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:02.730598 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5894fa2c-6afa-4a45-a723-f26fb1cf4814 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:03.084875 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5894fa2c-6afa-4a45-a723-f26fb1cf4814 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:03.107583 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5894fa2c-6afa-4a45-a723-f26fb1cf4814 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5" status: 200 len: 1697 microversion: 2.1 time: 0.443750 Sep 08 11:14:03.109496 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2828/5773] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:02 2022] GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5 => generated 1697 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:14:03.284451 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7590cf43-fa67-4e93-8052-375f1d7e286e tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:03.285306 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7590cf43-fa67-4e93-8052-375f1d7e286e tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:03.296653 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7590cf43-fa67-4e93-8052-375f1d7e286e tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:03.302495 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7590cf43-fa67-4e93-8052-375f1d7e286e tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:03.304077 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7590cf43-fa67-4e93-8052-375f1d7e286e tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:03.306334 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7590cf43-fa67-4e93-8052-375f1d7e286e tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:03.311266 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7590cf43-fa67-4e93-8052-375f1d7e286e tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:03.317168 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7590cf43-fa67-4e93-8052-375f1d7e286e tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:03.326561 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-95b27573-7f05-4693-8d5f-846bae058f46 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:03.327894 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-95b27573-7f05-4693-8d5f-846bae058f46 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] [instance: 90938b52-4f78-45e5-aea8-4a74f5734b4a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:03.347670 n-d-850501-12 devstack@n-api.service[128862]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 11:14:03.347921 n-d-850501-12 devstack@n-api.service[128862]: Thu Sep 8 11:14:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/90938b52-4f78-45e5-aea8-4a74f5734b4a (ip 10.222.0.27) !!! Sep 08 11:14:03.354073 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-95b27573-7f05-4693-8d5f-846bae058f46 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:03.354739 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-95b27573-7f05-4693-8d5f-846bae058f46 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:03.355200 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-95b27573-7f05-4693-8d5f-846bae058f46 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:03.358892 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-95b27573-7f05-4693-8d5f-846bae058f46 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:03.359327 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-95b27573-7f05-4693-8d5f-846bae058f46 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:03.359771 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-95b27573-7f05-4693-8d5f-846bae058f46 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:03.530361 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-95b27573-7f05-4693-8d5f-846bae058f46 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9770721b674c489e0491156a7c5efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c65adcd147ba95df7ec8d6b8fb10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:03.543250 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-95b27573-7f05-4693-8d5f-846bae058f46 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] 10.222.0.27 "GET /compute/v2.1/servers/90938b52-4f78-45e5-aea8-4a74f5734b4a" status: 200 len: 1344 microversion: 2.1 time: 0.222739 Sep 08 11:14:03.545419 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2829/5774] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:03 2022] GET /compute/v2.1/servers/90938b52-4f78-45e5-aea8-4a74f5734b4a => generated 1344 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:14:03.567164 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7590cf43-fa67-4e93-8052-375f1d7e286e tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:03.577863 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7590cf43-fa67-4e93-8052-375f1d7e286e tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:03.580605 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7590cf43-fa67-4e93-8052-375f1d7e286e tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:03.580605 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7590cf43-fa67-4e93-8052-375f1d7e286e tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e" status: 200 len: 1807 microversion: 2.20 time: 0.300167 Sep 08 11:14:03.582095 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2946/5775] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:14:03 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e => generated 1807 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:14:04.134946 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2d93ad2b-758d-4ba2-9095-999f4ae34f42 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:04.136252 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2d93ad2b-758d-4ba2-9095-999f4ae34f42 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: af0ed4bb-bf39-4989-893c-14896abbc7d5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:04.153815 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2d93ad2b-758d-4ba2-9095-999f4ae34f42 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:04.154727 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2d93ad2b-758d-4ba2-9095-999f4ae34f42 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:04.155364 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2d93ad2b-758d-4ba2-9095-999f4ae34f42 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:04.156288 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2d93ad2b-758d-4ba2-9095-999f4ae34f42 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:04.161143 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2d93ad2b-758d-4ba2-9095-999f4ae34f42 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:04.161838 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2d93ad2b-758d-4ba2-9095-999f4ae34f42 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:04.418666 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2d93ad2b-758d-4ba2-9095-999f4ae34f42 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:04.437577 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2d93ad2b-758d-4ba2-9095-999f4ae34f42 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5" status: 200 len: 1697 microversion: 2.1 time: 0.307252 Sep 08 11:14:04.439068 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2830/5776] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:04 2022] GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5 => generated 1697 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:14:04.570988 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-59e46307-3fea-4ee1-95e3-2486188ed484 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:04.571719 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-59e46307-3fea-4ee1-95e3-2486188ed484 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] [instance: 90938b52-4f78-45e5-aea8-4a74f5734b4a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:04.580834 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-59e46307-3fea-4ee1-95e3-2486188ed484 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:04.581482 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-59e46307-3fea-4ee1-95e3-2486188ed484 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:04.582182 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-59e46307-3fea-4ee1-95e3-2486188ed484 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:04.582991 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-59e46307-3fea-4ee1-95e3-2486188ed484 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:04.583534 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-59e46307-3fea-4ee1-95e3-2486188ed484 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:04.584148 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-59e46307-3fea-4ee1-95e3-2486188ed484 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:04.613592 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-64b06747-70e8-4090-bbbf-f04239f3e0a4 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:04.614233 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-64b06747-70e8-4090-bbbf-f04239f3e0a4 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:04.624975 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64b06747-70e8-4090-bbbf-f04239f3e0a4 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:04.626407 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64b06747-70e8-4090-bbbf-f04239f3e0a4 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:04.626842 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64b06747-70e8-4090-bbbf-f04239f3e0a4 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:04.627579 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64b06747-70e8-4090-bbbf-f04239f3e0a4 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:04.628070 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64b06747-70e8-4090-bbbf-f04239f3e0a4 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:04.628510 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64b06747-70e8-4090-bbbf-f04239f3e0a4 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:04.716133 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-59e46307-3fea-4ee1-95e3-2486188ed484 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9770721b674c489e0491156a7c5efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c65adcd147ba95df7ec8d6b8fb10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:04.726534 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-59e46307-3fea-4ee1-95e3-2486188ed484 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] 10.222.0.27 "GET /compute/v2.1/servers/90938b52-4f78-45e5-aea8-4a74f5734b4a" status: 200 len: 1352 microversion: 2.1 time: 0.159431 Sep 08 11:14:04.726863 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2947/5777] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:04 2022] GET /compute/v2.1/servers/90938b52-4f78-45e5-aea8-4a74f5734b4a => generated 1352 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:14:04.734610 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4d537360-172a-41e3-be92-f12e0901d1be tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:04.735171 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4d537360-172a-41e3-be92-f12e0901d1be tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: a13b5e51-8a1d-4cb4-9485-a183b5a20c8d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:04.742642 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4d537360-172a-41e3-be92-f12e0901d1be tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:04.743153 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4d537360-172a-41e3-be92-f12e0901d1be tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:04.743652 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4d537360-172a-41e3-be92-f12e0901d1be tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:04.744385 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4d537360-172a-41e3-be92-f12e0901d1be tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:04.744847 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4d537360-172a-41e3-be92-f12e0901d1be tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:04.745961 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4d537360-172a-41e3-be92-f12e0901d1be tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:04.790738 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4d537360-172a-41e3-be92-f12e0901d1be tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d/ips" status: 200 len: 147 microversion: 2.1 time: 0.062663 Sep 08 11:14:04.799260 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2948/5778] 10.222.0.27 () {58 vars in 1248 bytes} [Thu Sep 8 11:14:04 2022] GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d/ips => generated 147 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:14:05.018138 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-64b06747-70e8-4090-bbbf-f04239f3e0a4 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:05.020435 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:14:05.065170 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-64b06747-70e8-4090-bbbf-f04239f3e0a4 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:05.068723 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-64b06747-70e8-4090-bbbf-f04239f3e0a4 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:05.070993 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-64b06747-70e8-4090-bbbf-f04239f3e0a4 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e" status: 200 len: 1807 microversion: 2.20 time: 0.468382 Sep 08 11:14:05.083229 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2831/5779] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:14:04 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e => generated 1807 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:14:05.472540 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-527392e5-15ef-4722-bfdd-e1923b0dda9a tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:05.473556 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-527392e5-15ef-4722-bfdd-e1923b0dda9a tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: af0ed4bb-bf39-4989-893c-14896abbc7d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:05.486456 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-527392e5-15ef-4722-bfdd-e1923b0dda9a tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:05.487266 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-527392e5-15ef-4722-bfdd-e1923b0dda9a tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:05.493055 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-527392e5-15ef-4722-bfdd-e1923b0dda9a tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:05.494539 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-527392e5-15ef-4722-bfdd-e1923b0dda9a tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:05.495174 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-527392e5-15ef-4722-bfdd-e1923b0dda9a tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:05.495759 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-527392e5-15ef-4722-bfdd-e1923b0dda9a tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:05.761532 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ab7a3324-765d-42e1-81f9-efcf0687c449 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:05.764051 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ab7a3324-765d-42e1-81f9-efcf0687c449 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] [instance: 90938b52-4f78-45e5-aea8-4a74f5734b4a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:05.777739 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab7a3324-765d-42e1-81f9-efcf0687c449 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:05.779244 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab7a3324-765d-42e1-81f9-efcf0687c449 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:05.779956 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab7a3324-765d-42e1-81f9-efcf0687c449 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:05.781189 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab7a3324-765d-42e1-81f9-efcf0687c449 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:05.781959 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab7a3324-765d-42e1-81f9-efcf0687c449 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:05.784218 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab7a3324-765d-42e1-81f9-efcf0687c449 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:05.812268 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-527392e5-15ef-4722-bfdd-e1923b0dda9a tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:05.826678 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:14:05.846261 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-527392e5-15ef-4722-bfdd-e1923b0dda9a tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5" status: 200 len: 1697 microversion: 2.1 time: 0.377598 Sep 08 11:14:05.870245 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2949/5780] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:05 2022] GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5 => generated 1697 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:14:05.925274 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ab7a3324-765d-42e1-81f9-efcf0687c449 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9770721b674c489e0491156a7c5efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c65adcd147ba95df7ec8d6b8fb10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:05.936394 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ab7a3324-765d-42e1-81f9-efcf0687c449 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] 10.222.0.27 "GET /compute/v2.1/servers/90938b52-4f78-45e5-aea8-4a74f5734b4a" status: 200 len: 1350 microversion: 2.1 time: 0.178958 Sep 08 11:14:05.938947 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2832/5781] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:05 2022] GET /compute/v2.1/servers/90938b52-4f78-45e5-aea8-4a74f5734b4a => generated 1350 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:14:06.099688 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-df93f7cd-0bca-4bd9-af05-a0e56c2646ea tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:06.101137 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-df93f7cd-0bca-4bd9-af05-a0e56c2646ea tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:06.129251 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=4 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:14:06.133191 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-df93f7cd-0bca-4bd9-af05-a0e56c2646ea tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:06.136848 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-df93f7cd-0bca-4bd9-af05-a0e56c2646ea tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:06.137731 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-df93f7cd-0bca-4bd9-af05-a0e56c2646ea tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:06.139148 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-df93f7cd-0bca-4bd9-af05-a0e56c2646ea tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:06.139938 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-df93f7cd-0bca-4bd9-af05-a0e56c2646ea tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:06.141125 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-df93f7cd-0bca-4bd9-af05-a0e56c2646ea tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:06.449688 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-df93f7cd-0bca-4bd9-af05-a0e56c2646ea tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:06.482796 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-df93f7cd-0bca-4bd9-af05-a0e56c2646ea tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:06.492607 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-df93f7cd-0bca-4bd9-af05-a0e56c2646ea tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:06.493847 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-df93f7cd-0bca-4bd9-af05-a0e56c2646ea tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e" status: 200 len: 1807 microversion: 2.20 time: 0.399750 Sep 08 11:14:06.494994 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2950/5782] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:14:06 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e => generated 1807 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:14:06.873385 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3c0cdd23-45e2-4d1f-aa9f-6bebbac6762d tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:06.874108 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3c0cdd23-45e2-4d1f-aa9f-6bebbac6762d tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: af0ed4bb-bf39-4989-893c-14896abbc7d5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:06.889359 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c0cdd23-45e2-4d1f-aa9f-6bebbac6762d tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:06.889874 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c0cdd23-45e2-4d1f-aa9f-6bebbac6762d tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:06.890319 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c0cdd23-45e2-4d1f-aa9f-6bebbac6762d tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:06.891046 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c0cdd23-45e2-4d1f-aa9f-6bebbac6762d tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:06.895185 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c0cdd23-45e2-4d1f-aa9f-6bebbac6762d tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:06.895917 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c0cdd23-45e2-4d1f-aa9f-6bebbac6762d tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:06.970578 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5b46398e-b0cd-41ff-8aec-f2bb678178f1 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:06.972441 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5b46398e-b0cd-41ff-8aec-f2bb678178f1 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] [instance: 90938b52-4f78-45e5-aea8-4a74f5734b4a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:07.005448 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5b46398e-b0cd-41ff-8aec-f2bb678178f1 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:07.006757 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5b46398e-b0cd-41ff-8aec-f2bb678178f1 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:07.008826 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5b46398e-b0cd-41ff-8aec-f2bb678178f1 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:07.010831 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5b46398e-b0cd-41ff-8aec-f2bb678178f1 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:07.011537 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5b46398e-b0cd-41ff-8aec-f2bb678178f1 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:07.013295 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5b46398e-b0cd-41ff-8aec-f2bb678178f1 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:07.282052 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3c0cdd23-45e2-4d1f-aa9f-6bebbac6762d tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:07.292625 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3c0cdd23-45e2-4d1f-aa9f-6bebbac6762d tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5" status: 200 len: 1697 microversion: 2.1 time: 0.424320 Sep 08 11:14:07.311680 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2833/5783] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:06 2022] GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5 => generated 1697 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:14:07.331408 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5b46398e-b0cd-41ff-8aec-f2bb678178f1 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9770721b674c489e0491156a7c5efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c65adcd147ba95df7ec8d6b8fb10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:07.342669 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5b46398e-b0cd-41ff-8aec-f2bb678178f1 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] 10.222.0.27 "GET /compute/v2.1/servers/90938b52-4f78-45e5-aea8-4a74f5734b4a" status: 200 len: 1467 microversion: 2.1 time: 0.377902 Sep 08 11:14:07.358082 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2951/5784] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:06 2022] GET /compute/v2.1/servers/90938b52-4f78-45e5-aea8-4a74f5734b4a => generated 1467 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:14:07.564391 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1951570a-82ec-426a-bec7-a5b61a219643 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:07.565599 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1951570a-82ec-426a-bec7-a5b61a219643 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:07.580445 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1951570a-82ec-426a-bec7-a5b61a219643 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:07.581114 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1951570a-82ec-426a-bec7-a5b61a219643 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:07.581671 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1951570a-82ec-426a-bec7-a5b61a219643 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:07.582587 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1951570a-82ec-426a-bec7-a5b61a219643 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:07.583722 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1951570a-82ec-426a-bec7-a5b61a219643 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:07.584251 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1951570a-82ec-426a-bec7-a5b61a219643 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:07.632971 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-ca396743-8bbd-415a-8ff0-ba1a8a36218d req-cea74a0e-faa6-48ea-91b9-b0342000bfe0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9c23be4-60f4-4bff-9e0d-8040618b552e", "name": "network-vif-plugged", "status": "completed", "tag": "0dcde267-c491-450a-894c-03db6d80d8ff"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:14:07.655371 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-ca396743-8bbd-415a-8ff0-ba1a8a36218d req-cea74a0e-faa6-48ea-91b9-b0342000bfe0 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:07.659487 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-ca396743-8bbd-415a-8ff0-ba1a8a36218d req-cea74a0e-faa6-48ea-91b9-b0342000bfe0 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:07.661358 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-ca396743-8bbd-415a-8ff0-ba1a8a36218d req-cea74a0e-faa6-48ea-91b9-b0342000bfe0 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:07.694975 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-ca396743-8bbd-415a-8ff0-ba1a8a36218d req-cea74a0e-faa6-48ea-91b9-b0342000bfe0 service nova] Creating event network-vif-plugged:0dcde267-c491-450a-894c-03db6d80d8ff for instance f9c23be4-60f4-4bff-9e0d-8040618b552e on n-h2-850501-12 Sep 08 11:14:07.709861 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-ca396743-8bbd-415a-8ff0-ba1a8a36218d req-cea74a0e-faa6-48ea-91b9-b0342000bfe0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074700 Sep 08 11:14:07.711480 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2952/5785] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:14:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:14:07.720431 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-6f07ecbe-f464-470e-94eb-bcbdc3189aa6 req-8cc5c48d-d887-405e-8fd6-6d9c477cfa85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90938b52-4f78-45e5-aea8-4a74f5734b4a", "tag": "d97ac53d-0b97-46ea-9b48-bf5f2e72211d"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:14:07.743752 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-6f07ecbe-f464-470e-94eb-bcbdc3189aa6 req-8cc5c48d-d887-405e-8fd6-6d9c477cfa85 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:07.748287 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-6f07ecbe-f464-470e-94eb-bcbdc3189aa6 req-8cc5c48d-d887-405e-8fd6-6d9c477cfa85 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:07.759189 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-6f07ecbe-f464-470e-94eb-bcbdc3189aa6 req-8cc5c48d-d887-405e-8fd6-6d9c477cfa85 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:07.797188 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-6f07ecbe-f464-470e-94eb-bcbdc3189aa6 req-8cc5c48d-d887-405e-8fd6-6d9c477cfa85 service nova] Creating event network-changed:d97ac53d-0b97-46ea-9b48-bf5f2e72211d for instance 90938b52-4f78-45e5-aea8-4a74f5734b4a on n-h2-850501-12 Sep 08 11:14:07.810531 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-6f07ecbe-f464-470e-94eb-bcbdc3189aa6 req-8cc5c48d-d887-405e-8fd6-6d9c477cfa85 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095670 Sep 08 11:14:07.812172 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2953/5786] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:14:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:14:08.072550 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1951570a-82ec-426a-bec7-a5b61a219643 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:08.086529 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1951570a-82ec-426a-bec7-a5b61a219643 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:08.092510 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1951570a-82ec-426a-bec7-a5b61a219643 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:08.093788 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1951570a-82ec-426a-bec7-a5b61a219643 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e" status: 200 len: 1807 microversion: 2.20 time: 0.544728 Sep 08 11:14:08.100237 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2834/5787] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:14:07 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e => generated 1807 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:14:08.319477 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-615c465d-b5bc-4ab4-b1b8-ce334f5140f3 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:08.321716 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-615c465d-b5bc-4ab4-b1b8-ce334f5140f3 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: af0ed4bb-bf39-4989-893c-14896abbc7d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:08.334187 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-615c465d-b5bc-4ab4-b1b8-ce334f5140f3 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:08.335850 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-615c465d-b5bc-4ab4-b1b8-ce334f5140f3 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:08.335850 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-615c465d-b5bc-4ab4-b1b8-ce334f5140f3 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:08.340161 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-615c465d-b5bc-4ab4-b1b8-ce334f5140f3 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:08.341523 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-615c465d-b5bc-4ab4-b1b8-ce334f5140f3 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:08.343161 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-615c465d-b5bc-4ab4-b1b8-ce334f5140f3 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:08.368017 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fa416622-7f5d-42b7-bc75-1aaa15a6ca0f tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:08.368639 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fa416622-7f5d-42b7-bc75-1aaa15a6ca0f tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] [instance: 90938b52-4f78-45e5-aea8-4a74f5734b4a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:08.377954 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fa416622-7f5d-42b7-bc75-1aaa15a6ca0f tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:08.378544 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fa416622-7f5d-42b7-bc75-1aaa15a6ca0f tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:08.379050 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fa416622-7f5d-42b7-bc75-1aaa15a6ca0f tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:08.382298 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fa416622-7f5d-42b7-bc75-1aaa15a6ca0f tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:08.386677 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fa416622-7f5d-42b7-bc75-1aaa15a6ca0f tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:08.387150 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fa416622-7f5d-42b7-bc75-1aaa15a6ca0f tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:08.575072 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-615c465d-b5bc-4ab4-b1b8-ce334f5140f3 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:08.592558 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-615c465d-b5bc-4ab4-b1b8-ce334f5140f3 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5" status: 200 len: 1697 microversion: 2.1 time: 0.277025 Sep 08 11:14:08.594074 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2954/5788] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:08 2022] GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5 => generated 1697 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:14:08.661735 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fa416622-7f5d-42b7-bc75-1aaa15a6ca0f tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9770721b674c489e0491156a7c5efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c65adcd147ba95df7ec8d6b8fb10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:08.682233 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fa416622-7f5d-42b7-bc75-1aaa15a6ca0f tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] 10.222.0.27 "GET /compute/v2.1/servers/90938b52-4f78-45e5-aea8-4a74f5734b4a" status: 200 len: 1467 microversion: 2.1 time: 0.312848 Sep 08 11:14:08.684316 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2835/5789] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:08 2022] GET /compute/v2.1/servers/90938b52-4f78-45e5-aea8-4a74f5734b4a => generated 1467 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:14:09.129322 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-07a92ac8-88c5-427f-beb8-37d93d40cff7 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:09.130398 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-07a92ac8-88c5-427f-beb8-37d93d40cff7 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:09.137402 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-07a92ac8-88c5-427f-beb8-37d93d40cff7 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:09.137940 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-07a92ac8-88c5-427f-beb8-37d93d40cff7 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:09.138669 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-07a92ac8-88c5-427f-beb8-37d93d40cff7 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:09.139650 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-07a92ac8-88c5-427f-beb8-37d93d40cff7 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:09.140598 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-07a92ac8-88c5-427f-beb8-37d93d40cff7 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:09.141254 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-07a92ac8-88c5-427f-beb8-37d93d40cff7 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:09.297316 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-07a92ac8-88c5-427f-beb8-37d93d40cff7 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:09.308072 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-07a92ac8-88c5-427f-beb8-37d93d40cff7 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:09.310481 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-07a92ac8-88c5-427f-beb8-37d93d40cff7 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:09.311778 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-07a92ac8-88c5-427f-beb8-37d93d40cff7 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e" status: 200 len: 1807 microversion: 2.20 time: 0.186776 Sep 08 11:14:09.325708 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2955/5790] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:14:09 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e => generated 1807 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:14:09.439545 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-11a4a756-cf39-4b33-be7d-b8f25495dc12 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1f916d29-5245-4331-9d71-68b18700d6dd"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:14:09.442437 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-11a4a756-cf39-4b33-be7d-b8f25495dc12 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: a13b5e51-8a1d-4cb4-9485-a183b5a20c8d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:09.449675 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-11a4a756-cf39-4b33-be7d-b8f25495dc12 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:09.450572 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-11a4a756-cf39-4b33-be7d-b8f25495dc12 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:09.451107 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-11a4a756-cf39-4b33-be7d-b8f25495dc12 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:09.452013 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-11a4a756-cf39-4b33-be7d-b8f25495dc12 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:09.452565 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-11a4a756-cf39-4b33-be7d-b8f25495dc12 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:09.453132 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-11a4a756-cf39-4b33-be7d-b8f25495dc12 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:09.627451 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b37fc2ce-d4d4-4466-9edb-198cdff7ea92 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:09.628413 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b37fc2ce-d4d4-4466-9edb-198cdff7ea92 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: af0ed4bb-bf39-4989-893c-14896abbc7d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:09.639216 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b37fc2ce-d4d4-4466-9edb-198cdff7ea92 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:09.641341 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b37fc2ce-d4d4-4466-9edb-198cdff7ea92 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:09.642172 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b37fc2ce-d4d4-4466-9edb-198cdff7ea92 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:09.643002 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b37fc2ce-d4d4-4466-9edb-198cdff7ea92 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:09.645508 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b37fc2ce-d4d4-4466-9edb-198cdff7ea92 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:09.646027 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b37fc2ce-d4d4-4466-9edb-198cdff7ea92 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:09.826770 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b37fc2ce-d4d4-4466-9edb-198cdff7ea92 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:09.827198 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-11a4a756-cf39-4b33-be7d-b8f25495dc12 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "POST /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.391568 Sep 08 11:14:09.834728 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2836/5791] 10.222.0.27 () {60 vars in 1323 bytes} [Thu Sep 8 11:14:09 2022] POST /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d/os-volume_attachments => generated 194 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:14:09.843532 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6848b1c2-04ea-4e37-98fe-2e4e1ef2fc4e tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:09.845772 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6848b1c2-04ea-4e37-98fe-2e4e1ef2fc4e tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] [instance: 90938b52-4f78-45e5-aea8-4a74f5734b4a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:09.855284 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6848b1c2-04ea-4e37-98fe-2e4e1ef2fc4e tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:09.856513 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6848b1c2-04ea-4e37-98fe-2e4e1ef2fc4e tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:09.857667 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6848b1c2-04ea-4e37-98fe-2e4e1ef2fc4e tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:09.859095 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6848b1c2-04ea-4e37-98fe-2e4e1ef2fc4e tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:09.860037 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6848b1c2-04ea-4e37-98fe-2e4e1ef2fc4e tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:09.860830 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6848b1c2-04ea-4e37-98fe-2e4e1ef2fc4e tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:09.868688 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b37fc2ce-d4d4-4466-9edb-198cdff7ea92 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5" status: 200 len: 1697 microversion: 2.1 time: 0.245693 Sep 08 11:14:09.870644 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2956/5792] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:09 2022] GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5 => generated 1697 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:14:10.338828 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2611e010-d536-4a71-a442-82da603055fc tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:10.339878 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2611e010-d536-4a71-a442-82da603055fc tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:10.351313 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2611e010-d536-4a71-a442-82da603055fc tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:10.354251 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2611e010-d536-4a71-a442-82da603055fc tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:10.355160 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2611e010-d536-4a71-a442-82da603055fc tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:10.357943 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2611e010-d536-4a71-a442-82da603055fc tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:10.359514 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2611e010-d536-4a71-a442-82da603055fc tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:10.360212 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2611e010-d536-4a71-a442-82da603055fc tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:10.364169 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6848b1c2-04ea-4e37-98fe-2e4e1ef2fc4e tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9770721b674c489e0491156a7c5efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c65adcd147ba95df7ec8d6b8fb10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:10.373624 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6848b1c2-04ea-4e37-98fe-2e4e1ef2fc4e tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] 10.222.0.27 "GET /compute/v2.1/servers/90938b52-4f78-45e5-aea8-4a74f5734b4a" status: 200 len: 1467 microversion: 2.1 time: 0.537034 Sep 08 11:14:10.374214 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2837/5793] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:09 2022] GET /compute/v2.1/servers/90938b52-4f78-45e5-aea8-4a74f5734b4a => generated 1467 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:14:10.672636 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2611e010-d536-4a71-a442-82da603055fc tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:10.696472 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2611e010-d536-4a71-a442-82da603055fc tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:10.699281 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2611e010-d536-4a71-a442-82da603055fc tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:10.706371 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2611e010-d536-4a71-a442-82da603055fc tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e" status: 200 len: 1807 microversion: 2.20 time: 0.372212 Sep 08 11:14:10.707563 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2957/5794] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:14:10 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e => generated 1807 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 11:14:10.911344 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1906aa21-3fdb-42fd-a86e-aba08b7f3e6c tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:10.912567 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1906aa21-3fdb-42fd-a86e-aba08b7f3e6c tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: af0ed4bb-bf39-4989-893c-14896abbc7d5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:10.927816 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1906aa21-3fdb-42fd-a86e-aba08b7f3e6c tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:10.929505 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1906aa21-3fdb-42fd-a86e-aba08b7f3e6c tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:10.929505 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1906aa21-3fdb-42fd-a86e-aba08b7f3e6c tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:10.930252 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1906aa21-3fdb-42fd-a86e-aba08b7f3e6c tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:10.931032 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1906aa21-3fdb-42fd-a86e-aba08b7f3e6c tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:10.931836 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1906aa21-3fdb-42fd-a86e-aba08b7f3e6c tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:11.182070 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1906aa21-3fdb-42fd-a86e-aba08b7f3e6c tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:11.194292 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1906aa21-3fdb-42fd-a86e-aba08b7f3e6c tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5" status: 200 len: 1697 microversion: 2.1 time: 0.299749 Sep 08 11:14:11.195616 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2838/5795] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:10 2022] GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5 => generated 1697 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:14:11.398124 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-15b16e62-6948-44b6-ac4f-b263724fa5df tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:11.399021 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-15b16e62-6948-44b6-ac4f-b263724fa5df tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] [instance: 90938b52-4f78-45e5-aea8-4a74f5734b4a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:11.408897 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-15b16e62-6948-44b6-ac4f-b263724fa5df tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:11.409576 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-15b16e62-6948-44b6-ac4f-b263724fa5df tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:11.413272 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-15b16e62-6948-44b6-ac4f-b263724fa5df tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:11.414880 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-15b16e62-6948-44b6-ac4f-b263724fa5df tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:11.415942 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-15b16e62-6948-44b6-ac4f-b263724fa5df tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:11.416647 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-15b16e62-6948-44b6-ac4f-b263724fa5df tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:11.627192 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-15b16e62-6948-44b6-ac4f-b263724fa5df tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9770721b674c489e0491156a7c5efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c65adcd147ba95df7ec8d6b8fb10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:11.636719 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-15b16e62-6948-44b6-ac4f-b263724fa5df tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] 10.222.0.27 "GET /compute/v2.1/servers/90938b52-4f78-45e5-aea8-4a74f5734b4a" status: 200 len: 1467 microversion: 2.1 time: 0.242279 Sep 08 11:14:11.654077 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2958/5796] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:11 2022] GET /compute/v2.1/servers/90938b52-4f78-45e5-aea8-4a74f5734b4a => generated 1467 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:14:11.740028 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5b7844c6-5a0a-4924-84eb-f5343941a7cc tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:11.740886 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5b7844c6-5a0a-4924-84eb-f5343941a7cc tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:11.749174 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b7844c6-5a0a-4924-84eb-f5343941a7cc tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:11.750059 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b7844c6-5a0a-4924-84eb-f5343941a7cc tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:11.750916 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b7844c6-5a0a-4924-84eb-f5343941a7cc tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:11.752194 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b7844c6-5a0a-4924-84eb-f5343941a7cc tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:11.753278 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b7844c6-5a0a-4924-84eb-f5343941a7cc tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:11.753708 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b7844c6-5a0a-4924-84eb-f5343941a7cc tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:11.989778 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5b7844c6-5a0a-4924-84eb-f5343941a7cc tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:12.000865 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5b7844c6-5a0a-4924-84eb-f5343941a7cc tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:12.002371 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5b7844c6-5a0a-4924-84eb-f5343941a7cc tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:12.003551 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5b7844c6-5a0a-4924-84eb-f5343941a7cc tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e" status: 200 len: 1794 microversion: 2.20 time: 0.268434 Sep 08 11:14:12.004878 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2839/5797] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:14:11 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e => generated 1794 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:14:12.227539 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7749cb2b-0431-4d31-b4cc-525ed27857d3 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:12.228639 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7749cb2b-0431-4d31-b4cc-525ed27857d3 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: af0ed4bb-bf39-4989-893c-14896abbc7d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:12.235846 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:14:12.237641 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7749cb2b-0431-4d31-b4cc-525ed27857d3 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:12.238166 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7749cb2b-0431-4d31-b4cc-525ed27857d3 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:12.238606 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7749cb2b-0431-4d31-b4cc-525ed27857d3 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:12.239313 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7749cb2b-0431-4d31-b4cc-525ed27857d3 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:12.239776 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7749cb2b-0431-4d31-b4cc-525ed27857d3 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:12.240207 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7749cb2b-0431-4d31-b4cc-525ed27857d3 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:12.296887 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=8 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:14:12.395655 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7749cb2b-0431-4d31-b4cc-525ed27857d3 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:12.404548 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7749cb2b-0431-4d31-b4cc-525ed27857d3 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5" status: 200 len: 1697 microversion: 2.1 time: 0.185022 Sep 08 11:14:12.405286 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2959/5798] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:12 2022] GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5 => generated 1697 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:14:12.659644 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6fc13e7f-5da7-483d-8270-bb6bfe1d1c84 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:12.660621 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6fc13e7f-5da7-483d-8270-bb6bfe1d1c84 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] [instance: 90938b52-4f78-45e5-aea8-4a74f5734b4a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:12.667876 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6fc13e7f-5da7-483d-8270-bb6bfe1d1c84 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:12.668486 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6fc13e7f-5da7-483d-8270-bb6bfe1d1c84 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:12.668913 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6fc13e7f-5da7-483d-8270-bb6bfe1d1c84 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:12.670162 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6fc13e7f-5da7-483d-8270-bb6bfe1d1c84 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:12.670680 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6fc13e7f-5da7-483d-8270-bb6bfe1d1c84 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:12.671180 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6fc13e7f-5da7-483d-8270-bb6bfe1d1c84 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:12.846989 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6fc13e7f-5da7-483d-8270-bb6bfe1d1c84 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9770721b674c489e0491156a7c5efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c65adcd147ba95df7ec8d6b8fb10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:12.855539 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6fc13e7f-5da7-483d-8270-bb6bfe1d1c84 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] 10.222.0.27 "GET /compute/v2.1/servers/90938b52-4f78-45e5-aea8-4a74f5734b4a" status: 200 len: 1467 microversion: 2.1 time: 0.199638 Sep 08 11:14:12.856731 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2840/5799] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:12 2022] GET /compute/v2.1/servers/90938b52-4f78-45e5-aea8-4a74f5734b4a => generated 1467 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:14:13.429282 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a63dd9a6-54ee-4f21-a547-96370c9d6a5d tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:13.430009 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a63dd9a6-54ee-4f21-a547-96370c9d6a5d tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: af0ed4bb-bf39-4989-893c-14896abbc7d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:13.443599 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a63dd9a6-54ee-4f21-a547-96370c9d6a5d tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:13.444174 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a63dd9a6-54ee-4f21-a547-96370c9d6a5d tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:13.444625 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a63dd9a6-54ee-4f21-a547-96370c9d6a5d tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:13.445398 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a63dd9a6-54ee-4f21-a547-96370c9d6a5d tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:13.445864 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a63dd9a6-54ee-4f21-a547-96370c9d6a5d tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:13.446297 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a63dd9a6-54ee-4f21-a547-96370c9d6a5d tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:13.694275 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a63dd9a6-54ee-4f21-a547-96370c9d6a5d tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:13.705062 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a63dd9a6-54ee-4f21-a547-96370c9d6a5d tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5" status: 200 len: 1697 microversion: 2.1 time: 0.279825 Sep 08 11:14:13.710993 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2960/5800] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:13 2022] GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5 => generated 1697 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:14:13.823418 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-3a213c9f-6ffc-4f9c-a08a-c0322d76e5d3 req-69d82546-025a-4651-b437-b0cb58fe68e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90938b52-4f78-45e5-aea8-4a74f5734b4a", "name": "network-vif-plugged", "status": "completed", "tag": "d97ac53d-0b97-46ea-9b48-bf5f2e72211d"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:14:13.843198 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-3a213c9f-6ffc-4f9c-a08a-c0322d76e5d3 req-69d82546-025a-4651-b437-b0cb58fe68e6 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:13.846163 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-3a213c9f-6ffc-4f9c-a08a-c0322d76e5d3 req-69d82546-025a-4651-b437-b0cb58fe68e6 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:13.847220 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-3a213c9f-6ffc-4f9c-a08a-c0322d76e5d3 req-69d82546-025a-4651-b437-b0cb58fe68e6 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:13.879984 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6617db57-8e9a-4311-9b84-e86c9107e41a tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:13.880472 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6617db57-8e9a-4311-9b84-e86c9107e41a tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] [instance: 90938b52-4f78-45e5-aea8-4a74f5734b4a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:13.882876 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-3a213c9f-6ffc-4f9c-a08a-c0322d76e5d3 req-69d82546-025a-4651-b437-b0cb58fe68e6 service nova] Creating event network-vif-plugged:d97ac53d-0b97-46ea-9b48-bf5f2e72211d for instance 90938b52-4f78-45e5-aea8-4a74f5734b4a on n-h2-850501-12 Sep 08 11:14:13.899392 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-3a213c9f-6ffc-4f9c-a08a-c0322d76e5d3 req-69d82546-025a-4651-b437-b0cb58fe68e6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079726 Sep 08 11:14:13.900534 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2841/5801] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:14:13.909088 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6617db57-8e9a-4311-9b84-e86c9107e41a tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:13.909598 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6617db57-8e9a-4311-9b84-e86c9107e41a tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:13.910032 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6617db57-8e9a-4311-9b84-e86c9107e41a tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:13.922179 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6617db57-8e9a-4311-9b84-e86c9107e41a tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:13.926884 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6617db57-8e9a-4311-9b84-e86c9107e41a tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:13.927341 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6617db57-8e9a-4311-9b84-e86c9107e41a tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:14.211864 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6617db57-8e9a-4311-9b84-e86c9107e41a tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9770721b674c489e0491156a7c5efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c65adcd147ba95df7ec8d6b8fb10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:14.221142 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6617db57-8e9a-4311-9b84-e86c9107e41a tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] 10.222.0.27 "GET /compute/v2.1/servers/90938b52-4f78-45e5-aea8-4a74f5734b4a" status: 200 len: 1467 microversion: 2.1 time: 0.345153 Sep 08 11:14:14.221918 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2961/5802] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:13 2022] GET /compute/v2.1/servers/90938b52-4f78-45e5-aea8-4a74f5734b4a => generated 1467 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:14:14.734683 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9de31c98-ed82-4975-bc74-4695719205e2 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:14.735503 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9de31c98-ed82-4975-bc74-4695719205e2 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: af0ed4bb-bf39-4989-893c-14896abbc7d5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:14.741980 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9de31c98-ed82-4975-bc74-4695719205e2 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:14.742554 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9de31c98-ed82-4975-bc74-4695719205e2 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:14.743134 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9de31c98-ed82-4975-bc74-4695719205e2 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:14.744005 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9de31c98-ed82-4975-bc74-4695719205e2 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:14.744541 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9de31c98-ed82-4975-bc74-4695719205e2 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:14.745068 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9de31c98-ed82-4975-bc74-4695719205e2 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:14.900525 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9de31c98-ed82-4975-bc74-4695719205e2 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:14.908931 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9de31c98-ed82-4975-bc74-4695719205e2 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5" status: 200 len: 1697 microversion: 2.1 time: 0.179307 Sep 08 11:14:14.909644 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2842/5803] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:14 2022] GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5 => generated 1697 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:14:15.247428 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-16b1598f-f297-4f52-b998-8cd9c72c50b1 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:15.248407 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-16b1598f-f297-4f52-b998-8cd9c72c50b1 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] [instance: 90938b52-4f78-45e5-aea8-4a74f5734b4a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:15.256182 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-16b1598f-f297-4f52-b998-8cd9c72c50b1 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:15.256689 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-16b1598f-f297-4f52-b998-8cd9c72c50b1 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:15.257171 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-16b1598f-f297-4f52-b998-8cd9c72c50b1 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:15.257926 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-16b1598f-f297-4f52-b998-8cd9c72c50b1 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:15.258391 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-16b1598f-f297-4f52-b998-8cd9c72c50b1 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:15.258825 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-16b1598f-f297-4f52-b998-8cd9c72c50b1 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:15.493439 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-16b1598f-f297-4f52-b998-8cd9c72c50b1 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9770721b674c489e0491156a7c5efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c65adcd147ba95df7ec8d6b8fb10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:15.504609 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-16b1598f-f297-4f52-b998-8cd9c72c50b1 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] 10.222.0.27 "GET /compute/v2.1/servers/90938b52-4f78-45e5-aea8-4a74f5734b4a" status: 200 len: 1467 microversion: 2.1 time: 0.262576 Sep 08 11:14:15.506711 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2962/5804] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:15 2022] GET /compute/v2.1/servers/90938b52-4f78-45e5-aea8-4a74f5734b4a => generated 1467 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:14:15.931975 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7c577688-640e-44f8-a806-c10d79640c8d tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:15.932595 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7c577688-640e-44f8-a806-c10d79640c8d tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: af0ed4bb-bf39-4989-893c-14896abbc7d5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:15.940379 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c577688-640e-44f8-a806-c10d79640c8d tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:15.940973 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c577688-640e-44f8-a806-c10d79640c8d tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:15.941454 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c577688-640e-44f8-a806-c10d79640c8d tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:15.942161 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c577688-640e-44f8-a806-c10d79640c8d tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:15.942694 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c577688-640e-44f8-a806-c10d79640c8d tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:15.943123 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c577688-640e-44f8-a806-c10d79640c8d tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:16.089302 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7c577688-640e-44f8-a806-c10d79640c8d tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:16.100957 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7c577688-640e-44f8-a806-c10d79640c8d tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5" status: 200 len: 1697 microversion: 2.1 time: 0.173029 Sep 08 11:14:16.101576 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2843/5805] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:15 2022] GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5 => generated 1697 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:14:16.540612 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d524336d-e927-4d7c-a822-93e59ce882c7 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:16.543589 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d524336d-e927-4d7c-a822-93e59ce882c7 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] [instance: 90938b52-4f78-45e5-aea8-4a74f5734b4a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:16.552639 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d524336d-e927-4d7c-a822-93e59ce882c7 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:16.553730 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d524336d-e927-4d7c-a822-93e59ce882c7 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:16.554627 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d524336d-e927-4d7c-a822-93e59ce882c7 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:16.555952 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d524336d-e927-4d7c-a822-93e59ce882c7 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:16.556878 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d524336d-e927-4d7c-a822-93e59ce882c7 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:16.557503 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d524336d-e927-4d7c-a822-93e59ce882c7 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:16.717452 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d524336d-e927-4d7c-a822-93e59ce882c7 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9770721b674c489e0491156a7c5efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c65adcd147ba95df7ec8d6b8fb10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:16.726669 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d524336d-e927-4d7c-a822-93e59ce882c7 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] 10.222.0.27 "GET /compute/v2.1/servers/90938b52-4f78-45e5-aea8-4a74f5734b4a" status: 200 len: 1639 microversion: 2.1 time: 0.190602 Sep 08 11:14:16.727569 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2963/5806] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:16 2022] GET /compute/v2.1/servers/90938b52-4f78-45e5-aea8-4a74f5734b4a => generated 1639 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:14:16.750025 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c1f277ce-e7b8-4f97-8937-cbd7f6242040 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:16.750711 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c1f277ce-e7b8-4f97-8937-cbd7f6242040 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] [instance: 90938b52-4f78-45e5-aea8-4a74f5734b4a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:16.761403 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c1f277ce-e7b8-4f97-8937-cbd7f6242040 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:16.762849 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c1f277ce-e7b8-4f97-8937-cbd7f6242040 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:16.763647 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c1f277ce-e7b8-4f97-8937-cbd7f6242040 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:16.764553 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c1f277ce-e7b8-4f97-8937-cbd7f6242040 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:16.765210 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c1f277ce-e7b8-4f97-8937-cbd7f6242040 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:16.765799 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c1f277ce-e7b8-4f97-8937-cbd7f6242040 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:16.926123 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c1f277ce-e7b8-4f97-8937-cbd7f6242040 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9770721b674c489e0491156a7c5efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c65adcd147ba95df7ec8d6b8fb10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:16.934677 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c1f277ce-e7b8-4f97-8937-cbd7f6242040 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] 10.222.0.27 "GET /compute/v2.1/servers/90938b52-4f78-45e5-aea8-4a74f5734b4a" status: 200 len: 1639 microversion: 2.1 time: 0.188187 Sep 08 11:14:16.937375 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2844/5807] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:16 2022] GET /compute/v2.1/servers/90938b52-4f78-45e5-aea8-4a74f5734b4a => generated 1639 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:14:16.958058 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-023a9c73-6e43-45ef-9ca1-141efefa1e9a tempest-TestSecurityGroupsBasicOps-2057170618 tempest-TestSecurityGroupsBasicOps-2057170618-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:16.958981 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-023a9c73-6e43-45ef-9ca1-141efefa1e9a tempest-TestSecurityGroupsBasicOps-2057170618 tempest-TestSecurityGroupsBasicOps-2057170618-project-admin] [instance: 90938b52-4f78-45e5-aea8-4a74f5734b4a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:16.965379 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-023a9c73-6e43-45ef-9ca1-141efefa1e9a tempest-TestSecurityGroupsBasicOps-2057170618 tempest-TestSecurityGroupsBasicOps-2057170618-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:16.966254 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-023a9c73-6e43-45ef-9ca1-141efefa1e9a tempest-TestSecurityGroupsBasicOps-2057170618 tempest-TestSecurityGroupsBasicOps-2057170618-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:16.966710 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-023a9c73-6e43-45ef-9ca1-141efefa1e9a tempest-TestSecurityGroupsBasicOps-2057170618 tempest-TestSecurityGroupsBasicOps-2057170618-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:16.967433 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-023a9c73-6e43-45ef-9ca1-141efefa1e9a tempest-TestSecurityGroupsBasicOps-2057170618 tempest-TestSecurityGroupsBasicOps-2057170618-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:16.968091 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-023a9c73-6e43-45ef-9ca1-141efefa1e9a tempest-TestSecurityGroupsBasicOps-2057170618 tempest-TestSecurityGroupsBasicOps-2057170618-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:16.968529 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-023a9c73-6e43-45ef-9ca1-141efefa1e9a tempest-TestSecurityGroupsBasicOps-2057170618 tempest-TestSecurityGroupsBasicOps-2057170618-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:17.128092 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-441e20a0-94b9-413d-9f17-1cbdd84c1bf5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:17.129435 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-441e20a0-94b9-413d-9f17-1cbdd84c1bf5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: af0ed4bb-bf39-4989-893c-14896abbc7d5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:17.138189 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-441e20a0-94b9-413d-9f17-1cbdd84c1bf5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:17.139190 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-441e20a0-94b9-413d-9f17-1cbdd84c1bf5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:17.139896 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-441e20a0-94b9-413d-9f17-1cbdd84c1bf5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:17.140891 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-441e20a0-94b9-413d-9f17-1cbdd84c1bf5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:17.141624 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-441e20a0-94b9-413d-9f17-1cbdd84c1bf5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:17.142585 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-441e20a0-94b9-413d-9f17-1cbdd84c1bf5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:17.365676 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-023a9c73-6e43-45ef-9ca1-141efefa1e9a tempest-TestSecurityGroupsBasicOps-2057170618 tempest-TestSecurityGroupsBasicOps-2057170618-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/90938b52-4f78-45e5-aea8-4a74f5734b4a" status: 200 len: 1792 microversion: 2.1 time: 0.409123 Sep 08 11:14:17.383862 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2964/5808] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:16 2022] GET /compute/v2.1/servers/90938b52-4f78-45e5-aea8-4a74f5734b4a => generated 1792 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:14:17.412513 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-441e20a0-94b9-413d-9f17-1cbdd84c1bf5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:17.422891 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-441e20a0-94b9-413d-9f17-1cbdd84c1bf5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5" status: 200 len: 1697 microversion: 2.1 time: 0.299738 Sep 08 11:14:17.437058 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2845/5809] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:17 2022] GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5 => generated 1697 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:14:18.050818 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-cfa43305-2f32-4bc4-ab61-302b997e590b req-df5abcfa-b3ab-4bba-adf0-d669e5b32467 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af0ed4bb-bf39-4989-893c-14896abbc7d5", "name": "network-vif-unplugged", "status": "completed", "tag": "d243af0a-26ec-4f11-98dd-3ce340f57c21"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:14:18.073686 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-cfa43305-2f32-4bc4-ab61-302b997e590b req-df5abcfa-b3ab-4bba-adf0-d669e5b32467 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:18.076383 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-cfa43305-2f32-4bc4-ab61-302b997e590b req-df5abcfa-b3ab-4bba-adf0-d669e5b32467 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:18.078209 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-cfa43305-2f32-4bc4-ab61-302b997e590b req-df5abcfa-b3ab-4bba-adf0-d669e5b32467 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:18.114738 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-cfa43305-2f32-4bc4-ab61-302b997e590b req-df5abcfa-b3ab-4bba-adf0-d669e5b32467 service nova] Creating event network-vif-unplugged:d243af0a-26ec-4f11-98dd-3ce340f57c21 for instance af0ed4bb-bf39-4989-893c-14896abbc7d5 on n-h1-850501-12 Sep 08 11:14:18.131990 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [req-cfa43305-2f32-4bc4-ab61-302b997e590b req-df5abcfa-b3ab-4bba-adf0-d669e5b32467 service nova] Instance af0ed4bb-bf39-4989-893c-14896abbc7d5 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850501-12', 'n-h1-850501-12'} {{(pid=128861) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 11:14:18.146280 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-cfa43305-2f32-4bc4-ab61-302b997e590b req-df5abcfa-b3ab-4bba-adf0-d669e5b32467 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100204 Sep 08 11:14:18.147756 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2965/5810] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:14:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:14:18.449018 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dacba12d-9971-4478-aed3-2929e4fc9031 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:18.449758 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-dacba12d-9971-4478-aed3-2929e4fc9031 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: af0ed4bb-bf39-4989-893c-14896abbc7d5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:18.464619 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dacba12d-9971-4478-aed3-2929e4fc9031 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:18.465976 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dacba12d-9971-4478-aed3-2929e4fc9031 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:18.468842 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dacba12d-9971-4478-aed3-2929e4fc9031 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:18.474422 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dacba12d-9971-4478-aed3-2929e4fc9031 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:18.475397 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dacba12d-9971-4478-aed3-2929e4fc9031 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:18.476376 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dacba12d-9971-4478-aed3-2929e4fc9031 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:19.069562 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-dacba12d-9971-4478-aed3-2929e4fc9031 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:19.083014 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-dacba12d-9971-4478-aed3-2929e4fc9031 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5" status: 200 len: 1696 microversion: 2.1 time: 0.639165 Sep 08 11:14:19.084517 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2846/5811] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:18 2022] GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5 => generated 1696 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:14:20.109215 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9dc59cc9-18f8-472a-93a5-254bf0a31969 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:20.109984 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9dc59cc9-18f8-472a-93a5-254bf0a31969 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: af0ed4bb-bf39-4989-893c-14896abbc7d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:20.120130 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9dc59cc9-18f8-472a-93a5-254bf0a31969 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:20.120928 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9dc59cc9-18f8-472a-93a5-254bf0a31969 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:20.121636 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9dc59cc9-18f8-472a-93a5-254bf0a31969 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:20.122676 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9dc59cc9-18f8-472a-93a5-254bf0a31969 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:20.123143 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9dc59cc9-18f8-472a-93a5-254bf0a31969 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:20.123606 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9dc59cc9-18f8-472a-93a5-254bf0a31969 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:20.191849 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-e7daa228-9d39-406f-ba97-cefa3aa02d2d req-06049520-69c1-4425-8177-ec0288a93696 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af0ed4bb-bf39-4989-893c-14896abbc7d5", "tag": "d243af0a-26ec-4f11-98dd-3ce340f57c21"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:14:20.235894 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e7daa228-9d39-406f-ba97-cefa3aa02d2d req-06049520-69c1-4425-8177-ec0288a93696 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:20.240041 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e7daa228-9d39-406f-ba97-cefa3aa02d2d req-06049520-69c1-4425-8177-ec0288a93696 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:20.240858 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e7daa228-9d39-406f-ba97-cefa3aa02d2d req-06049520-69c1-4425-8177-ec0288a93696 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:20.270343 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-e7daa228-9d39-406f-ba97-cefa3aa02d2d req-06049520-69c1-4425-8177-ec0288a93696 service nova] Creating event network-changed:d243af0a-26ec-4f11-98dd-3ce340f57c21 for instance af0ed4bb-bf39-4989-893c-14896abbc7d5 on n-h1-850501-12 Sep 08 11:14:20.279304 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [req-e7daa228-9d39-406f-ba97-cefa3aa02d2d req-06049520-69c1-4425-8177-ec0288a93696 service nova] Instance af0ed4bb-bf39-4989-893c-14896abbc7d5 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850501-12', 'n-h1-850501-12'} {{(pid=128862) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 11:14:20.294744 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-e7daa228-9d39-406f-ba97-cefa3aa02d2d req-06049520-69c1-4425-8177-ec0288a93696 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112242 Sep 08 11:14:20.295376 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2847/5812] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:14:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:14:20.302258 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-ec10c02f-261e-42b0-9c34-fbaec45bcbc9 req-39133d6d-acbc-4f0a-9684-9711dcef8954 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90938b52-4f78-45e5-aea8-4a74f5734b4a", "tag": "d97ac53d-0b97-46ea-9b48-bf5f2e72211d"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:14:20.316708 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ec10c02f-261e-42b0-9c34-fbaec45bcbc9 req-39133d6d-acbc-4f0a-9684-9711dcef8954 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:20.317878 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ec10c02f-261e-42b0-9c34-fbaec45bcbc9 req-39133d6d-acbc-4f0a-9684-9711dcef8954 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:20.318560 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ec10c02f-261e-42b0-9c34-fbaec45bcbc9 req-39133d6d-acbc-4f0a-9684-9711dcef8954 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:20.324013 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:14:20.340315 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-ec10c02f-261e-42b0-9c34-fbaec45bcbc9 req-39133d6d-acbc-4f0a-9684-9711dcef8954 service nova] Creating event network-changed:d97ac53d-0b97-46ea-9b48-bf5f2e72211d for instance 90938b52-4f78-45e5-aea8-4a74f5734b4a on n-h2-850501-12 Sep 08 11:14:20.352874 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-ec10c02f-261e-42b0-9c34-fbaec45bcbc9 req-39133d6d-acbc-4f0a-9684-9711dcef8954 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055793 Sep 08 11:14:20.354736 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2848/5813] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:14:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:14:20.380570 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9dc59cc9-18f8-472a-93a5-254bf0a31969 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:20.445751 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9dc59cc9-18f8-472a-93a5-254bf0a31969 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5" status: 200 len: 1694 microversion: 2.1 time: 0.341616 Sep 08 11:14:20.447945 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2966/5814] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:20 2022] GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5 => generated 1694 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:14:21.482831 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-caef0168-e059-4995-b387-68cf19b3663c tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:21.487376 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-caef0168-e059-4995-b387-68cf19b3663c tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: af0ed4bb-bf39-4989-893c-14896abbc7d5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:21.508144 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-caef0168-e059-4995-b387-68cf19b3663c tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:21.509003 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-caef0168-e059-4995-b387-68cf19b3663c tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:21.509826 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-caef0168-e059-4995-b387-68cf19b3663c tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:21.510832 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-caef0168-e059-4995-b387-68cf19b3663c tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:21.511608 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-caef0168-e059-4995-b387-68cf19b3663c tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:21.512928 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-caef0168-e059-4995-b387-68cf19b3663c tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:21.913342 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-caef0168-e059-4995-b387-68cf19b3663c tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:21.923200 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-caef0168-e059-4995-b387-68cf19b3663c tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5" status: 200 len: 1694 microversion: 2.1 time: 0.451263 Sep 08 11:14:21.930214 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2849/5815] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:21 2022] GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5 => generated 1694 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:14:22.958987 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0ec42c37-332e-492e-92a9-6fc66079f889 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:22.959543 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0ec42c37-332e-492e-92a9-6fc66079f889 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: af0ed4bb-bf39-4989-893c-14896abbc7d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:22.967280 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0ec42c37-332e-492e-92a9-6fc66079f889 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:22.967830 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0ec42c37-332e-492e-92a9-6fc66079f889 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:22.968259 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0ec42c37-332e-492e-92a9-6fc66079f889 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:22.969009 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0ec42c37-332e-492e-92a9-6fc66079f889 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:22.969499 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0ec42c37-332e-492e-92a9-6fc66079f889 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:22.969999 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0ec42c37-332e-492e-92a9-6fc66079f889 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:23.155848 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0ec42c37-332e-492e-92a9-6fc66079f889 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:23.169951 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0ec42c37-332e-492e-92a9-6fc66079f889 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5" status: 200 len: 1691 microversion: 2.1 time: 0.212641 Sep 08 11:14:23.171066 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2967/5816] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:22 2022] GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5 => generated 1691 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:14:23.195696 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c2db88d8-d520-4621-a216-2132decc4716 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:14:23.196790 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c2db88d8-d520-4621-a216-2132decc4716 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: af0ed4bb-bf39-4989-893c-14896abbc7d5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:23.206311 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2db88d8-d520-4621-a216-2132decc4716 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:23.207017 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2db88d8-d520-4621-a216-2132decc4716 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:23.207678 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2db88d8-d520-4621-a216-2132decc4716 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:23.208576 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2db88d8-d520-4621-a216-2132decc4716 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:23.209297 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2db88d8-d520-4621-a216-2132decc4716 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:23.209900 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2db88d8-d520-4621-a216-2132decc4716 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:23.284738 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c2db88d8-d520-4621-a216-2132decc4716 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "POST /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5/action" status: 204 len: 0 microversion: 2.1 time: 0.091649 Sep 08 11:14:23.285783 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2850/5817] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 11:14:23 2022] POST /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5/action => generated 0 bytes in 94 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:14:23.295421 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-dbd52443-b8ba-4535-b6ab-b2c5b7fb0e7f tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:23.296695 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-dbd52443-b8ba-4535-b6ab-b2c5b7fb0e7f tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: af0ed4bb-bf39-4989-893c-14896abbc7d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:23.304660 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dbd52443-b8ba-4535-b6ab-b2c5b7fb0e7f tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:23.305407 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dbd52443-b8ba-4535-b6ab-b2c5b7fb0e7f tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:23.306631 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dbd52443-b8ba-4535-b6ab-b2c5b7fb0e7f tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:23.308199 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dbd52443-b8ba-4535-b6ab-b2c5b7fb0e7f tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:23.309648 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dbd52443-b8ba-4535-b6ab-b2c5b7fb0e7f tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:23.310375 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dbd52443-b8ba-4535-b6ab-b2c5b7fb0e7f tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:23.319651 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=100 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:14:23.536052 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-dbd52443-b8ba-4535-b6ab-b2c5b7fb0e7f tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:23.552520 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-dbd52443-b8ba-4535-b6ab-b2c5b7fb0e7f tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5" status: 200 len: 1691 microversion: 2.1 time: 0.262562 Sep 08 11:14:23.565373 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2968/5818] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:23 2022] GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5 => generated 1691 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:14:24.583101 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a6a97c48-3cc6-4c52-80e4-5d6cd8d78d4d tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:24.585205 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a6a97c48-3cc6-4c52-80e4-5d6cd8d78d4d tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: af0ed4bb-bf39-4989-893c-14896abbc7d5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:24.607086 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=58 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:14:24.620844 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a6a97c48-3cc6-4c52-80e4-5d6cd8d78d4d tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:24.621858 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a6a97c48-3cc6-4c52-80e4-5d6cd8d78d4d tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:24.623117 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a6a97c48-3cc6-4c52-80e4-5d6cd8d78d4d tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:24.624904 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a6a97c48-3cc6-4c52-80e4-5d6cd8d78d4d tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:24.626139 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a6a97c48-3cc6-4c52-80e4-5d6cd8d78d4d tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:24.626836 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a6a97c48-3cc6-4c52-80e4-5d6cd8d78d4d tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:24.865869 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a6a97c48-3cc6-4c52-80e4-5d6cd8d78d4d tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:24.888300 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a6a97c48-3cc6-4c52-80e4-5d6cd8d78d4d tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5" status: 200 len: 1691 microversion: 2.1 time: 0.311358 Sep 08 11:14:24.889618 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2851/5819] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:24 2022] GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5 => generated 1691 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:14:25.500760 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-cd8f0436-70e1-4f76-93ca-0b53ac89930a req-271ab614-87d1-41dd-a425-a154a624b000 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af0ed4bb-bf39-4989-893c-14896abbc7d5", "name": "network-vif-plugged", "status": "completed", "tag": "d243af0a-26ec-4f11-98dd-3ce340f57c21"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:14:25.528391 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-cd8f0436-70e1-4f76-93ca-0b53ac89930a req-271ab614-87d1-41dd-a425-a154a624b000 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:25.530021 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-cd8f0436-70e1-4f76-93ca-0b53ac89930a req-271ab614-87d1-41dd-a425-a154a624b000 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:25.550915 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-cd8f0436-70e1-4f76-93ca-0b53ac89930a req-271ab614-87d1-41dd-a425-a154a624b000 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:25.590034 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-efba47b9-7b27-4cbf-baf2-ec2f2dc2342e tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:14:25.596783 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-cd8f0436-70e1-4f76-93ca-0b53ac89930a req-271ab614-87d1-41dd-a425-a154a624b000 service nova] Creating event network-vif-plugged:d243af0a-26ec-4f11-98dd-3ce340f57c21 for instance af0ed4bb-bf39-4989-893c-14896abbc7d5 on n-h1-850501-12 Sep 08 11:14:25.609477 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-cd8f0436-70e1-4f76-93ca-0b53ac89930a req-271ab614-87d1-41dd-a425-a154a624b000 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113607 Sep 08 11:14:25.610670 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2969/5820] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:14:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:14:25.617929 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-efba47b9-7b27-4cbf-baf2-ec2f2dc2342e tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:25.619109 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-efba47b9-7b27-4cbf-baf2-ec2f2dc2342e tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:25.620317 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-efba47b9-7b27-4cbf-baf2-ec2f2dc2342e tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:25.660684 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-efba47b9-7b27-4cbf-baf2-ec2f2dc2342e tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: a13b5e51-8a1d-4cb4-9485-a183b5a20c8d] Going to try to stop instance {{(pid=128862) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 08 11:14:25.747574 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-efba47b9-7b27-4cbf-baf2-ec2f2dc2342e tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "POST /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d/action" status: 202 len: 0 microversion: 2.1 time: 0.167963 Sep 08 11:14:25.753408 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2852/5821] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 11:14:25 2022] POST /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:14:25.767254 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1e317784-13e1-41ec-a3f4-4801c623a388 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:25.768154 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1e317784-13e1-41ec-a3f4-4801c623a388 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: a13b5e51-8a1d-4cb4-9485-a183b5a20c8d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:25.778478 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e317784-13e1-41ec-a3f4-4801c623a388 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:25.779006 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e317784-13e1-41ec-a3f4-4801c623a388 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:25.779571 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e317784-13e1-41ec-a3f4-4801c623a388 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:25.780441 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e317784-13e1-41ec-a3f4-4801c623a388 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:25.781071 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e317784-13e1-41ec-a3f4-4801c623a388 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:25.781473 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e317784-13e1-41ec-a3f4-4801c623a388 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:25.927802 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-81d576ff-8a55-4d27-84b6-5c4a9025c8a6 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:25.928524 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-81d576ff-8a55-4d27-84b6-5c4a9025c8a6 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: af0ed4bb-bf39-4989-893c-14896abbc7d5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:25.942264 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81d576ff-8a55-4d27-84b6-5c4a9025c8a6 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:25.942835 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81d576ff-8a55-4d27-84b6-5c4a9025c8a6 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:25.943519 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81d576ff-8a55-4d27-84b6-5c4a9025c8a6 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:25.944329 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81d576ff-8a55-4d27-84b6-5c4a9025c8a6 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:25.944808 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81d576ff-8a55-4d27-84b6-5c4a9025c8a6 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:25.945315 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81d576ff-8a55-4d27-84b6-5c4a9025c8a6 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:26.065062 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1e317784-13e1-41ec-a3f4-4801c623a388 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bdfecc6c7a43608095044b0174b48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfe795da0e4988a50c38f19200ea7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:26.080090 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1e317784-13e1-41ec-a3f4-4801c623a388 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d" status: 200 len: 1723 microversion: 2.1 time: 0.323709 Sep 08 11:14:26.094603 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2970/5822] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:25 2022] GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d => generated 1723 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:14:26.166122 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-81d576ff-8a55-4d27-84b6-5c4a9025c8a6 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:26.183352 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-81d576ff-8a55-4d27-84b6-5c4a9025c8a6 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5" status: 200 len: 1683 microversion: 2.1 time: 0.270314 Sep 08 11:14:26.184817 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2853/5823] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:25 2022] GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5 => generated 1683 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:14:27.115780 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e9b5628e-ce5d-4b6c-bcad-58c9603a427d tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:27.117104 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e9b5628e-ce5d-4b6c-bcad-58c9603a427d tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: a13b5e51-8a1d-4cb4-9485-a183b5a20c8d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:27.136761 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e9b5628e-ce5d-4b6c-bcad-58c9603a427d tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:27.137433 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e9b5628e-ce5d-4b6c-bcad-58c9603a427d tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:27.137976 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e9b5628e-ce5d-4b6c-bcad-58c9603a427d tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:27.138954 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e9b5628e-ce5d-4b6c-bcad-58c9603a427d tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:27.139557 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e9b5628e-ce5d-4b6c-bcad-58c9603a427d tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:27.140246 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e9b5628e-ce5d-4b6c-bcad-58c9603a427d tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:27.349714 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e9b5628e-ce5d-4b6c-bcad-58c9603a427d tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bdfecc6c7a43608095044b0174b48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfe795da0e4988a50c38f19200ea7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:27.378107 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e9b5628e-ce5d-4b6c-bcad-58c9603a427d tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d" status: 200 len: 1723 microversion: 2.1 time: 0.249365 Sep 08 11:14:27.378107 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2971/5824] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:27 2022] GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d => generated 1723 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:14:27.399070 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a409f2f1-fca7-49d8-bfdc-d84e9a45f106 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:27.401407 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a409f2f1-fca7-49d8-bfdc-d84e9a45f106 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] [instance: 6b8c23b2-8127-4488-b785-44f1abc16edd] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:27.411134 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a409f2f1-fca7-49d8-bfdc-d84e9a45f106 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:27.411993 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a409f2f1-fca7-49d8-bfdc-d84e9a45f106 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:27.412596 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a409f2f1-fca7-49d8-bfdc-d84e9a45f106 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:27.413536 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a409f2f1-fca7-49d8-bfdc-d84e9a45f106 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:27.414152 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a409f2f1-fca7-49d8-bfdc-d84e9a45f106 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:27.414855 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a409f2f1-fca7-49d8-bfdc-d84e9a45f106 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:27.520818 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-a409f2f1-fca7-49d8-bfdc-d84e9a45f106 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Lazy-loading 'services' on Instance uuid 6b8c23b2-8127-4488-b785-44f1abc16edd {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:14:27.606599 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a409f2f1-fca7-49d8-bfdc-d84e9a45f106 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6b8c23b2-8127-4488-b785-44f1abc16edd/os-volume_attachments/bca08959-0445-41b2-a706-771b9c218d45" status: 202 len: 0 microversion: 2.1 time: 0.212140 Sep 08 11:14:27.607706 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2854/5825] 10.222.0.27 () {58 vars in 1416 bytes} [Thu Sep 8 11:14:27 2022] DELETE /compute/v2.1/servers/6b8c23b2-8127-4488-b785-44f1abc16edd/os-volume_attachments/bca08959-0445-41b2-a706-771b9c218d45 => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:14:28.393120 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-41ef86d3-86d2-4e3b-962a-57a7f762bdc9 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:28.393923 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-41ef86d3-86d2-4e3b-962a-57a7f762bdc9 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: a13b5e51-8a1d-4cb4-9485-a183b5a20c8d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:28.400828 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41ef86d3-86d2-4e3b-962a-57a7f762bdc9 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:28.401384 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41ef86d3-86d2-4e3b-962a-57a7f762bdc9 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:28.401838 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41ef86d3-86d2-4e3b-962a-57a7f762bdc9 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:28.402557 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41ef86d3-86d2-4e3b-962a-57a7f762bdc9 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:28.403022 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41ef86d3-86d2-4e3b-962a-57a7f762bdc9 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:28.403445 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41ef86d3-86d2-4e3b-962a-57a7f762bdc9 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:28.550521 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-41ef86d3-86d2-4e3b-962a-57a7f762bdc9 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bdfecc6c7a43608095044b0174b48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfe795da0e4988a50c38f19200ea7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:28.560854 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-41ef86d3-86d2-4e3b-962a-57a7f762bdc9 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d" status: 200 len: 1723 microversion: 2.1 time: 0.171581 Sep 08 11:14:28.562055 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2972/5826] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:28 2022] GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:14:29.585701 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4382785b-078e-4bb7-b947-44d7c2ce4eba tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:29.591035 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4382785b-078e-4bb7-b947-44d7c2ce4eba tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: a13b5e51-8a1d-4cb4-9485-a183b5a20c8d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:29.598482 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4382785b-078e-4bb7-b947-44d7c2ce4eba tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:29.598936 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4382785b-078e-4bb7-b947-44d7c2ce4eba tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:29.599383 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4382785b-078e-4bb7-b947-44d7c2ce4eba tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:29.600100 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4382785b-078e-4bb7-b947-44d7c2ce4eba tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:29.600564 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4382785b-078e-4bb7-b947-44d7c2ce4eba tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:29.601143 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4382785b-078e-4bb7-b947-44d7c2ce4eba tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:29.762909 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4382785b-078e-4bb7-b947-44d7c2ce4eba tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bdfecc6c7a43608095044b0174b48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfe795da0e4988a50c38f19200ea7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:29.780843 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4382785b-078e-4bb7-b947-44d7c2ce4eba tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d" status: 200 len: 1723 microversion: 2.1 time: 0.199374 Sep 08 11:14:29.793363 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2855/5827] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:29 2022] GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d => generated 1723 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:14:30.806419 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-263ce106-a183-47e9-9ccf-83e7cdfe39c9 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:30.807175 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-263ce106-a183-47e9-9ccf-83e7cdfe39c9 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: a13b5e51-8a1d-4cb4-9485-a183b5a20c8d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:30.819184 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-263ce106-a183-47e9-9ccf-83e7cdfe39c9 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:30.819642 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-263ce106-a183-47e9-9ccf-83e7cdfe39c9 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:30.820107 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-263ce106-a183-47e9-9ccf-83e7cdfe39c9 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:30.820847 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-263ce106-a183-47e9-9ccf-83e7cdfe39c9 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:30.821364 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-263ce106-a183-47e9-9ccf-83e7cdfe39c9 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:30.821795 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-263ce106-a183-47e9-9ccf-83e7cdfe39c9 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:31.283597 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-263ce106-a183-47e9-9ccf-83e7cdfe39c9 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bdfecc6c7a43608095044b0174b48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfe795da0e4988a50c38f19200ea7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:31.295953 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-263ce106-a183-47e9-9ccf-83e7cdfe39c9 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d" status: 200 len: 1723 microversion: 2.1 time: 0.493870 Sep 08 11:14:31.296765 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2973/5828] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:30 2022] GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d => generated 1723 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:14:32.319791 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3b5c987b-48cc-4417-b85f-fff76764e669 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:32.320536 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3b5c987b-48cc-4417-b85f-fff76764e669 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: a13b5e51-8a1d-4cb4-9485-a183b5a20c8d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:32.328554 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b5c987b-48cc-4417-b85f-fff76764e669 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:32.329085 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b5c987b-48cc-4417-b85f-fff76764e669 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:32.329788 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b5c987b-48cc-4417-b85f-fff76764e669 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:32.330740 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b5c987b-48cc-4417-b85f-fff76764e669 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:32.331423 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b5c987b-48cc-4417-b85f-fff76764e669 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:32.332109 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b5c987b-48cc-4417-b85f-fff76764e669 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:32.513675 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3b5c987b-48cc-4417-b85f-fff76764e669 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bdfecc6c7a43608095044b0174b48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfe795da0e4988a50c38f19200ea7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:32.525787 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3b5c987b-48cc-4417-b85f-fff76764e669 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d" status: 200 len: 1723 microversion: 2.1 time: 0.209790 Sep 08 11:14:32.536511 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2856/5829] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:32 2022] GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d => generated 1723 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:14:33.068870 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1a0809bd-9320-4f0a-aaa0-cd56229da075 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:33.069548 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1a0809bd-9320-4f0a-aaa0-cd56229da075 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] [instance: 6b8c23b2-8127-4488-b785-44f1abc16edd] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:33.078911 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1a0809bd-9320-4f0a-aaa0-cd56229da075 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:33.079703 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1a0809bd-9320-4f0a-aaa0-cd56229da075 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:33.080151 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1a0809bd-9320-4f0a-aaa0-cd56229da075 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:33.080907 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1a0809bd-9320-4f0a-aaa0-cd56229da075 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:33.081409 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1a0809bd-9320-4f0a-aaa0-cd56229da075 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:33.081851 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1a0809bd-9320-4f0a-aaa0-cd56229da075 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:33.109775 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1a0809bd-9320-4f0a-aaa0-cd56229da075 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] [instance: 6b8c23b2-8127-4488-b785-44f1abc16edd] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:14:33.200020 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1a0809bd-9320-4f0a-aaa0-cd56229da075 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6b8c23b2-8127-4488-b785-44f1abc16edd" status: 204 len: 0 microversion: 2.1 time: 0.134819 Sep 08 11:14:33.200639 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2974/5830] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:14:33 2022] DELETE /compute/v2.1/servers/6b8c23b2-8127-4488-b785-44f1abc16edd => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:14:33.209434 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7bc00682-01f6-4911-ada3-020a5303d515 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:33.210279 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7bc00682-01f6-4911-ada3-020a5303d515 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] [instance: 6b8c23b2-8127-4488-b785-44f1abc16edd] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:33.218022 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7bc00682-01f6-4911-ada3-020a5303d515 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:33.218636 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7bc00682-01f6-4911-ada3-020a5303d515 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:33.219095 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7bc00682-01f6-4911-ada3-020a5303d515 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:33.219814 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7bc00682-01f6-4911-ada3-020a5303d515 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:33.220411 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7bc00682-01f6-4911-ada3-020a5303d515 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:33.221145 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7bc00682-01f6-4911-ada3-020a5303d515 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:33.375594 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7bc00682-01f6-4911-ada3-020a5303d515 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20be7bbc39a49a89aa2caf2bb328be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209fb9b0936b483aa902a5c12803bc48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:33.384074 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7bc00682-01f6-4911-ada3-020a5303d515 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] 10.222.0.27 "GET /compute/v2.1/servers/6b8c23b2-8127-4488-b785-44f1abc16edd" status: 200 len: 1470 microversion: 2.1 time: 0.178695 Sep 08 11:14:33.384673 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2857/5831] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:33 2022] GET /compute/v2.1/servers/6b8c23b2-8127-4488-b785-44f1abc16edd => generated 1470 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:14:33.556588 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-24f1ce2c-df0b-4efc-a549-869a84bf81da tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:33.557338 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-24f1ce2c-df0b-4efc-a549-869a84bf81da tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: a13b5e51-8a1d-4cb4-9485-a183b5a20c8d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:33.564229 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24f1ce2c-df0b-4efc-a549-869a84bf81da tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:33.564722 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24f1ce2c-df0b-4efc-a549-869a84bf81da tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:33.565198 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24f1ce2c-df0b-4efc-a549-869a84bf81da tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:33.565920 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24f1ce2c-df0b-4efc-a549-869a84bf81da tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:33.566727 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24f1ce2c-df0b-4efc-a549-869a84bf81da tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:33.566986 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24f1ce2c-df0b-4efc-a549-869a84bf81da tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:33.739348 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-24f1ce2c-df0b-4efc-a549-869a84bf81da tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bdfecc6c7a43608095044b0174b48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfe795da0e4988a50c38f19200ea7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:33.750385 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-24f1ce2c-df0b-4efc-a549-869a84bf81da tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d" status: 200 len: 1723 microversion: 2.1 time: 0.198222 Sep 08 11:14:33.751041 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2975/5832] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:33 2022] GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d => generated 1723 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:14:34.412410 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5b338d3e-eb13-4d04-b68c-b5190a307957 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:34.413306 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5b338d3e-eb13-4d04-b68c-b5190a307957 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] [instance: 6b8c23b2-8127-4488-b785-44f1abc16edd] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:34.423320 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b338d3e-eb13-4d04-b68c-b5190a307957 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:34.424252 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b338d3e-eb13-4d04-b68c-b5190a307957 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:34.424804 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b338d3e-eb13-4d04-b68c-b5190a307957 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:34.426421 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b338d3e-eb13-4d04-b68c-b5190a307957 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:34.427122 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b338d3e-eb13-4d04-b68c-b5190a307957 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:34.427694 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b338d3e-eb13-4d04-b68c-b5190a307957 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:34.596903 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5b338d3e-eb13-4d04-b68c-b5190a307957 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20be7bbc39a49a89aa2caf2bb328be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209fb9b0936b483aa902a5c12803bc48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:34.606045 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5b338d3e-eb13-4d04-b68c-b5190a307957 tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] 10.222.0.27 "GET /compute/v2.1/servers/6b8c23b2-8127-4488-b785-44f1abc16edd" status: 200 len: 1470 microversion: 2.1 time: 0.200026 Sep 08 11:14:34.606770 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2858/5833] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:34 2022] GET /compute/v2.1/servers/6b8c23b2-8127-4488-b785-44f1abc16edd => generated 1470 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:14:34.778991 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-27bd3409-544c-46b0-916f-a760b02db16b tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:34.781136 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-27bd3409-544c-46b0-916f-a760b02db16b tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: a13b5e51-8a1d-4cb4-9485-a183b5a20c8d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:34.791243 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-27bd3409-544c-46b0-916f-a760b02db16b tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:34.793144 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-27bd3409-544c-46b0-916f-a760b02db16b tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:34.793793 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-27bd3409-544c-46b0-916f-a760b02db16b tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:34.795527 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-27bd3409-544c-46b0-916f-a760b02db16b tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:34.796360 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-27bd3409-544c-46b0-916f-a760b02db16b tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:34.797311 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-27bd3409-544c-46b0-916f-a760b02db16b tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:34.989963 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-27bd3409-544c-46b0-916f-a760b02db16b tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bdfecc6c7a43608095044b0174b48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfe795da0e4988a50c38f19200ea7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:34.999836 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-27bd3409-544c-46b0-916f-a760b02db16b tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d" status: 200 len: 1723 microversion: 2.1 time: 0.228785 Sep 08 11:14:35.000448 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2976/5834] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:34 2022] GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d => generated 1723 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:14:35.634049 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d44cf9e2-c10b-4405-a2f3-49006f8f106e tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:35.638317 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d44cf9e2-c10b-4405-a2f3-49006f8f106e tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] [instance: 6b8c23b2-8127-4488-b785-44f1abc16edd] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:35.649081 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d44cf9e2-c10b-4405-a2f3-49006f8f106e tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:35.649724 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d44cf9e2-c10b-4405-a2f3-49006f8f106e tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:35.650067 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d44cf9e2-c10b-4405-a2f3-49006f8f106e tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:35.650794 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d44cf9e2-c10b-4405-a2f3-49006f8f106e tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:35.651263 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d44cf9e2-c10b-4405-a2f3-49006f8f106e tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:35.651733 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d44cf9e2-c10b-4405-a2f3-49006f8f106e tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:35.676637 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-d47d7377-b939-4533-9a11-79d2c6031779 req-5f9bd7dc-6299-4c02-8b6c-26ab4a0b2ed1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b8c23b2-8127-4488-b785-44f1abc16edd", "name": "network-vif-deleted", "tag": "56f590fc-b946-40f9-bd6b-99f8d2d89b81"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:14:35.696968 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-d47d7377-b939-4533-9a11-79d2c6031779 req-5f9bd7dc-6299-4c02-8b6c-26ab4a0b2ed1 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:35.699791 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-d47d7377-b939-4533-9a11-79d2c6031779 req-5f9bd7dc-6299-4c02-8b6c-26ab4a0b2ed1 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:35.700461 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-d47d7377-b939-4533-9a11-79d2c6031779 req-5f9bd7dc-6299-4c02-8b6c-26ab4a0b2ed1 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:35.731468 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-d47d7377-b939-4533-9a11-79d2c6031779 req-5f9bd7dc-6299-4c02-8b6c-26ab4a0b2ed1 service nova] Creating event network-vif-deleted:56f590fc-b946-40f9-bd6b-99f8d2d89b81 for instance 6b8c23b2-8127-4488-b785-44f1abc16edd on n-h1-850501-12 Sep 08 11:14:35.737167 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-d47d7377-b939-4533-9a11-79d2c6031779 req-5f9bd7dc-6299-4c02-8b6c-26ab4a0b2ed1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066176 Sep 08 11:14:35.738374 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2977/5835] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:14:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:14:35.754297 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d44cf9e2-c10b-4405-a2f3-49006f8f106e tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20be7bbc39a49a89aa2caf2bb328be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209fb9b0936b483aa902a5c12803bc48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:35.763368 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d44cf9e2-c10b-4405-a2f3-49006f8f106e tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] 10.222.0.27 "GET /compute/v2.1/servers/6b8c23b2-8127-4488-b785-44f1abc16edd" status: 200 len: 1428 microversion: 2.1 time: 0.136424 Sep 08 11:14:35.764266 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2859/5836] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:35 2022] GET /compute/v2.1/servers/6b8c23b2-8127-4488-b785-44f1abc16edd => generated 1428 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:14:36.027145 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e17e1b95-08a8-42cf-b9cf-52de55d0aaea tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:36.028132 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e17e1b95-08a8-42cf-b9cf-52de55d0aaea tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: a13b5e51-8a1d-4cb4-9485-a183b5a20c8d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:36.036892 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e17e1b95-08a8-42cf-b9cf-52de55d0aaea tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:36.037554 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e17e1b95-08a8-42cf-b9cf-52de55d0aaea tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:36.038075 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e17e1b95-08a8-42cf-b9cf-52de55d0aaea tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:36.038876 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e17e1b95-08a8-42cf-b9cf-52de55d0aaea tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:36.039426 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e17e1b95-08a8-42cf-b9cf-52de55d0aaea tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:36.039936 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e17e1b95-08a8-42cf-b9cf-52de55d0aaea tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:36.220925 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e17e1b95-08a8-42cf-b9cf-52de55d0aaea tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bdfecc6c7a43608095044b0174b48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfe795da0e4988a50c38f19200ea7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:36.235950 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e17e1b95-08a8-42cf-b9cf-52de55d0aaea tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d" status: 200 len: 1723 microversion: 2.1 time: 0.213119 Sep 08 11:14:36.237004 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2978/5837] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:36 2022] GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d => generated 1723 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:14:36.787710 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a7653121-7641-4dce-a19b-b08a07d44b9f tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:36.788265 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a7653121-7641-4dce-a19b-b08a07d44b9f tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] [instance: 6b8c23b2-8127-4488-b785-44f1abc16edd] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:36.795634 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a7653121-7641-4dce-a19b-b08a07d44b9f tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:36.796133 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a7653121-7641-4dce-a19b-b08a07d44b9f tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:36.796573 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a7653121-7641-4dce-a19b-b08a07d44b9f tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:36.797352 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a7653121-7641-4dce-a19b-b08a07d44b9f tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:36.797839 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a7653121-7641-4dce-a19b-b08a07d44b9f tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:36.798295 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a7653121-7641-4dce-a19b-b08a07d44b9f tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:36.813163 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-a7653121-7641-4dce-a19b-b08a07d44b9f tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] HTTP exception thrown: Instance 6b8c23b2-8127-4488-b785-44f1abc16edd could not be found. Sep 08 11:14:36.814860 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a7653121-7641-4dce-a19b-b08a07d44b9f tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Request method failure captured: Sep 08 11:14:36.814860 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/6b8c23b2-8127-4488-b785-44f1abc16edd HTTP/1.1 Sep 08 11:14:36.814860 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 11:14:36.814860 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 11:14:36.814860 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 11:14:36.814860 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 11:14:36.814860 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 11:14:36.814860 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 11:14:36.814860 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 11:14:36.814860 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 11:14:36.814860 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGc4PikYbXRPhb998GCeRavO72r3096Dv4_MO-s3z1S5kGRVdLEOY9JKbB6nDT-h0KbxUgkD6xiTiXOR3geRQqRlqWFHbPZEMF5L9rT2g0Bv7IrbX33-YyD6JXv-rPLjT7PPLG8wMnG9Nnqb7SvYj5wzjmTs-MNoZgbxXSqmpshng1B8 Sep 08 11:14:36.814860 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 11:14:36.814860 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 11:14:36.814860 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 11:14:36.814860 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 11:14:36.814860 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 11:14:36.814860 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 11:14:36.814860 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 209fb9b0936b483aa902a5c12803bc48 Sep 08 11:14:36.814860 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-VolumesBackupsTest-1151271310 Sep 08 11:14:36.814860 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 11:14:36.814860 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 11:14:36.814860 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/209fb9b0936b483aa902a5c12803bc48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/209fb9b0936b483aa902a5c12803bc48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_209fb9b0936b483aa902a5c12803bc48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/209fb9b0936b483aa902a5c12803bc48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:14:36.814860 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-VolumesBackupsTest-1151271310 Sep 08 11:14:36.814860 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 209fb9b0936b483aa902a5c12803bc48 Sep 08 11:14:36.814860 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-VolumesBackupsTest-1151271310 Sep 08 11:14:36.814860 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-VolumesBackupsTest-1151271310-project Sep 08 11:14:36.814860 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 11:14:36.814860 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 11:14:36.814860 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: f20be7bbc39a49a89aa2caf2bb328be7 Sep 08 11:14:36.814860 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-VolumesBackupsTest-1151271310-project Sep 08 11:14:36.814860 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 11:14:36.814860 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 6b8c23b2-8127-4488-b785-44f1abc16edd could not be found. Sep 08 11:14:36.814860 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '6b8c23b2-8127-4488-b785-44f1abc16edd'} Sep 08 11:14:36.814860 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:14:36.814860 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:14:36.814860 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:14:36.814860 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:14:36.814860 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:14:36.814860 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:14:36.814860 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:14:36.814860 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:14:36.814860 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:14:36.814860 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:14:36.814860 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b8c23b2-8127-4488-b785-44f1abc16edd could not be found. Sep 08 11:14:36.814860 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:14:36.814860 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:14:36.814860 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:14:36.814860 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:14:36.814860 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:14:36.814860 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:14:36.814860 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:14:36.814860 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:14:36.814860 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:14:36.814860 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:14:36.814860 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:14:36.814860 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:14:36.814860 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:14:36.814860 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:14:36.814860 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:14:36.814860 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:14:36.814860 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b8c23b2-8127-4488-b785-44f1abc16edd could not be found. Sep 08 11:14:36.814860 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:14:36.814860 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:14:36.814860 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:14:36.824601 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:14:36.824601 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:14:36.824601 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:14:36.824601 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:14:36.824601 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:14:36.824601 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b8c23b2-8127-4488-b785-44f1abc16edd could not be found. Sep 08 11:14:36.824601 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:14:36.824601 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a7653121-7641-4dce-a19b-b08a07d44b9f tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] Returning 404 to user: Instance 6b8c23b2-8127-4488-b785-44f1abc16edd could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:14:36.824601 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a7653121-7641-4dce-a19b-b08a07d44b9f tempest-VolumesBackupsTest-1151271310 tempest-VolumesBackupsTest-1151271310-project] 10.222.0.27 "GET /compute/v2.1/servers/6b8c23b2-8127-4488-b785-44f1abc16edd" status: 404 len: 111 microversion: 2.1 time: 0.032724 Sep 08 11:14:36.824601 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2860/5838] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:36 2022] GET /compute/v2.1/servers/6b8c23b2-8127-4488-b785-44f1abc16edd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:14:37.262932 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6ec56cf9-e5d7-4bb8-ba06-424f05a174bb tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:37.263961 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6ec56cf9-e5d7-4bb8-ba06-424f05a174bb tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: a13b5e51-8a1d-4cb4-9485-a183b5a20c8d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:37.267078 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:14:37.272442 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6ec56cf9-e5d7-4bb8-ba06-424f05a174bb tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:37.273139 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6ec56cf9-e5d7-4bb8-ba06-424f05a174bb tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:37.273695 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6ec56cf9-e5d7-4bb8-ba06-424f05a174bb tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:37.274644 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6ec56cf9-e5d7-4bb8-ba06-424f05a174bb tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:37.275183 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6ec56cf9-e5d7-4bb8-ba06-424f05a174bb tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:37.275687 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6ec56cf9-e5d7-4bb8-ba06-424f05a174bb tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:37.434180 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6ec56cf9-e5d7-4bb8-ba06-424f05a174bb tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bdfecc6c7a43608095044b0174b48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfe795da0e4988a50c38f19200ea7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:37.443104 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6ec56cf9-e5d7-4bb8-ba06-424f05a174bb tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d" status: 200 len: 1700 microversion: 2.1 time: 0.184082 Sep 08 11:14:37.449916 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2979/5839] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:37 2022] GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d => generated 1700 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:14:37.468120 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4ebff492-c824-40b3-a13a-bd6a1ee12efc tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:14:37.474850 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ebff492-c824-40b3-a13a-bd6a1ee12efc tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:37.475417 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ebff492-c824-40b3-a13a-bd6a1ee12efc tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:37.475959 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ebff492-c824-40b3-a13a-bd6a1ee12efc tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:37.501818 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4ebff492-c824-40b3-a13a-bd6a1ee12efc tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: a13b5e51-8a1d-4cb4-9485-a183b5a20c8d] Going to try to start instance {{(pid=128862) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 08 11:14:37.552136 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4ebff492-c824-40b3-a13a-bd6a1ee12efc tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "POST /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d/action" status: 202 len: 0 microversion: 2.1 time: 0.088807 Sep 08 11:14:37.553181 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2861/5840] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 11:14:37 2022] POST /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:14:37.565913 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-545840b4-7330-4ae7-b1c4-b311f4363c6a tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:37.567314 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-545840b4-7330-4ae7-b1c4-b311f4363c6a tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: a13b5e51-8a1d-4cb4-9485-a183b5a20c8d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:37.575898 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-545840b4-7330-4ae7-b1c4-b311f4363c6a tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:37.576715 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-545840b4-7330-4ae7-b1c4-b311f4363c6a tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:37.577361 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-545840b4-7330-4ae7-b1c4-b311f4363c6a tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:37.578239 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-545840b4-7330-4ae7-b1c4-b311f4363c6a tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:37.578856 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-545840b4-7330-4ae7-b1c4-b311f4363c6a tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:37.579486 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-545840b4-7330-4ae7-b1c4-b311f4363c6a tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:37.825733 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-545840b4-7330-4ae7-b1c4-b311f4363c6a tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bdfecc6c7a43608095044b0174b48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfe795da0e4988a50c38f19200ea7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:37.834828 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-545840b4-7330-4ae7-b1c4-b311f4363c6a tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d" status: 200 len: 1709 microversion: 2.1 time: 0.275802 Sep 08 11:14:37.837158 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2980/5841] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:37 2022] GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d => generated 1709 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:14:38.865756 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4c1ad954-6564-43d5-a9cf-b472af004728 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:38.868040 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4c1ad954-6564-43d5-a9cf-b472af004728 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: a13b5e51-8a1d-4cb4-9485-a183b5a20c8d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:38.876628 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c1ad954-6564-43d5-a9cf-b472af004728 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:38.877398 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c1ad954-6564-43d5-a9cf-b472af004728 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:38.878055 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c1ad954-6564-43d5-a9cf-b472af004728 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:38.878960 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c1ad954-6564-43d5-a9cf-b472af004728 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:38.879705 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c1ad954-6564-43d5-a9cf-b472af004728 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:38.880320 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c1ad954-6564-43d5-a9cf-b472af004728 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:38.886627 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:14:39.081293 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4c1ad954-6564-43d5-a9cf-b472af004728 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bdfecc6c7a43608095044b0174b48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfe795da0e4988a50c38f19200ea7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:39.101225 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4c1ad954-6564-43d5-a9cf-b472af004728 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d" status: 200 len: 1709 microversion: 2.1 time: 0.245183 Sep 08 11:14:39.102219 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2862/5842] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:38 2022] GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d => generated 1709 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:14:40.132282 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-30856cb4-7dbd-4e2b-915a-c3d3821f6949 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:40.133829 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-30856cb4-7dbd-4e2b-915a-c3d3821f6949 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: a13b5e51-8a1d-4cb4-9485-a183b5a20c8d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:40.143300 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-30856cb4-7dbd-4e2b-915a-c3d3821f6949 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:40.144153 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-30856cb4-7dbd-4e2b-915a-c3d3821f6949 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:40.144845 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-30856cb4-7dbd-4e2b-915a-c3d3821f6949 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:40.147719 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-30856cb4-7dbd-4e2b-915a-c3d3821f6949 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:40.149094 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-30856cb4-7dbd-4e2b-915a-c3d3821f6949 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:40.149892 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-30856cb4-7dbd-4e2b-915a-c3d3821f6949 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:40.340967 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-30856cb4-7dbd-4e2b-915a-c3d3821f6949 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bdfecc6c7a43608095044b0174b48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfe795da0e4988a50c38f19200ea7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:40.349655 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-30856cb4-7dbd-4e2b-915a-c3d3821f6949 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d" status: 200 len: 1713 microversion: 2.1 time: 0.222426 Sep 08 11:14:40.366149 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2981/5843] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:40 2022] GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d => generated 1713 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:14:44.790439 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e535a38c-49c4-4c1e-8732-660405153c78 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:44.791065 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e535a38c-49c4-4c1e-8732-660405153c78 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:44.801814 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e535a38c-49c4-4c1e-8732-660405153c78 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:44.802317 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e535a38c-49c4-4c1e-8732-660405153c78 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:44.841201 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e535a38c-49c4-4c1e-8732-660405153c78 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:44.841201 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e535a38c-49c4-4c1e-8732-660405153c78 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:44.841201 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e535a38c-49c4-4c1e-8732-660405153c78 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:44.841201 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e535a38c-49c4-4c1e-8732-660405153c78 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:44.859828 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e535a38c-49c4-4c1e-8732-660405153c78 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e/os-volume_attachments/a5aa4d2f-9619-44cf-8fab-594e5bbf665d" status: 200 len: 194 microversion: 2.20 time: 0.073358 Sep 08 11:14:44.864936 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2863/5844] 10.222.0.27 () {60 vars in 1454 bytes} [Thu Sep 8 11:14:44 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e/os-volume_attachments/a5aa4d2f-9619-44cf-8fab-594e5bbf665d => generated 194 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 11:14:44.982138 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e0e87a95-29dc-4b84-b8be-330e1ab1233c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:44.982800 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e0e87a95-29dc-4b84-b8be-330e1ab1233c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:44.990513 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e0e87a95-29dc-4b84-b8be-330e1ab1233c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:44.991354 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e0e87a95-29dc-4b84-b8be-330e1ab1233c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:44.991792 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e0e87a95-29dc-4b84-b8be-330e1ab1233c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:44.992786 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e0e87a95-29dc-4b84-b8be-330e1ab1233c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:44.993430 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e0e87a95-29dc-4b84-b8be-330e1ab1233c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:44.994120 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e0e87a95-29dc-4b84-b8be-330e1ab1233c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:45.114142 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-e0e87a95-29dc-4b84-b8be-330e1ab1233c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lazy-loading 'services' on Instance uuid f9c23be4-60f4-4bff-9e0d-8040618b552e {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:14:45.223120 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e0e87a95-29dc-4b84-b8be-330e1ab1233c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e/os-volume_attachments/a5aa4d2f-9619-44cf-8fab-594e5bbf665d" status: 202 len: 0 microversion: 2.20 time: 0.246661 Sep 08 11:14:45.223733 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2982/5845] 10.222.0.27 () {60 vars in 1457 bytes} [Thu Sep 8 11:14:44 2022] DELETE /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e/os-volume_attachments/a5aa4d2f-9619-44cf-8fab-594e5bbf665d => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:14:45.233069 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1f4cd641-5ae2-41b2-842d-8370d77d48d4 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:45.235681 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1f4cd641-5ae2-41b2-842d-8370d77d48d4 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:45.242488 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f4cd641-5ae2-41b2-842d-8370d77d48d4 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:45.242997 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f4cd641-5ae2-41b2-842d-8370d77d48d4 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:45.243511 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f4cd641-5ae2-41b2-842d-8370d77d48d4 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:45.244248 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f4cd641-5ae2-41b2-842d-8370d77d48d4 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:45.245547 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f4cd641-5ae2-41b2-842d-8370d77d48d4 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:45.246126 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f4cd641-5ae2-41b2-842d-8370d77d48d4 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:45.281894 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1f4cd641-5ae2-41b2-842d-8370d77d48d4 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053018 Sep 08 11:14:45.282477 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2864/5846] 10.222.0.27 () {60 vars in 1343 bytes} [Thu Sep 8 11:14:45 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 11:14:46.310476 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c74c7e51-9fe3-4085-92f1-37ba933fa407 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:46.314643 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c74c7e51-9fe3-4085-92f1-37ba933fa407 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:46.327435 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c74c7e51-9fe3-4085-92f1-37ba933fa407 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:46.328201 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c74c7e51-9fe3-4085-92f1-37ba933fa407 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:46.329150 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c74c7e51-9fe3-4085-92f1-37ba933fa407 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:46.330293 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c74c7e51-9fe3-4085-92f1-37ba933fa407 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:46.331197 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c74c7e51-9fe3-4085-92f1-37ba933fa407 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:46.331791 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c74c7e51-9fe3-4085-92f1-37ba933fa407 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:46.369242 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:14:46.378123 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c74c7e51-9fe3-4085-92f1-37ba933fa407 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.086927 Sep 08 11:14:46.378734 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2983/5847] 10.222.0.27 () {60 vars in 1343 bytes} [Thu Sep 8 11:14:46 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 11:14:47.393860 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-86190fb7-69ad-4ba8-9958-a550401ab979 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:47.396927 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-86190fb7-69ad-4ba8-9958-a550401ab979 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:47.406037 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-86190fb7-69ad-4ba8-9958-a550401ab979 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:47.407089 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-86190fb7-69ad-4ba8-9958-a550401ab979 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:47.407855 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-86190fb7-69ad-4ba8-9958-a550401ab979 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:47.408831 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-86190fb7-69ad-4ba8-9958-a550401ab979 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:47.409489 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-86190fb7-69ad-4ba8-9958-a550401ab979 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:47.410154 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-86190fb7-69ad-4ba8-9958-a550401ab979 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:47.480384 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-86190fb7-69ad-4ba8-9958-a550401ab979 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.089588 Sep 08 11:14:47.482316 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2865/5848] 10.222.0.27 () {60 vars in 1343 bytes} [Thu Sep 8 11:14:47 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 11:14:48.494134 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-dc94eef1-2de4-4730-9fc2-badc1f7550ca tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:48.498828 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-dc94eef1-2de4-4730-9fc2-badc1f7550ca tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:48.513137 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dc94eef1-2de4-4730-9fc2-badc1f7550ca tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:48.513657 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dc94eef1-2de4-4730-9fc2-badc1f7550ca tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:48.517695 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dc94eef1-2de4-4730-9fc2-badc1f7550ca tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:48.518859 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dc94eef1-2de4-4730-9fc2-badc1f7550ca tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:48.519366 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dc94eef1-2de4-4730-9fc2-badc1f7550ca tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:48.520245 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dc94eef1-2de4-4730-9fc2-badc1f7550ca tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:48.577141 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-dc94eef1-2de4-4730-9fc2-badc1f7550ca tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.086983 Sep 08 11:14:48.578548 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2984/5849] 10.222.0.27 () {60 vars in 1343 bytes} [Thu Sep 8 11:14:48 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 11:14:49.596038 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8dfea905-e5c1-41fb-a01d-3d3fb3937d66 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:49.600651 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8dfea905-e5c1-41fb-a01d-3d3fb3937d66 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:49.615536 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8dfea905-e5c1-41fb-a01d-3d3fb3937d66 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:49.616693 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8dfea905-e5c1-41fb-a01d-3d3fb3937d66 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:49.617960 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8dfea905-e5c1-41fb-a01d-3d3fb3937d66 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:49.620136 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8dfea905-e5c1-41fb-a01d-3d3fb3937d66 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:49.621519 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8dfea905-e5c1-41fb-a01d-3d3fb3937d66 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:49.622589 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8dfea905-e5c1-41fb-a01d-3d3fb3937d66 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:49.685762 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8dfea905-e5c1-41fb-a01d-3d3fb3937d66 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.097884 Sep 08 11:14:49.694592 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2866/5850] 10.222.0.27 () {60 vars in 1343 bytes} [Thu Sep 8 11:14:49 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 11:14:50.702784 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d9d9f3a9-c78a-4ee1-9a07-fb32bb9c944f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:50.705078 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d9d9f3a9-c78a-4ee1-9a07-fb32bb9c944f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:50.713799 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d9d9f3a9-c78a-4ee1-9a07-fb32bb9c944f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:50.714308 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d9d9f3a9-c78a-4ee1-9a07-fb32bb9c944f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:50.714755 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d9d9f3a9-c78a-4ee1-9a07-fb32bb9c944f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:50.716537 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d9d9f3a9-c78a-4ee1-9a07-fb32bb9c944f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:50.717095 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d9d9f3a9-c78a-4ee1-9a07-fb32bb9c944f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:50.717680 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d9d9f3a9-c78a-4ee1-9a07-fb32bb9c944f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:50.754097 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d9d9f3a9-c78a-4ee1-9a07-fb32bb9c944f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.055774 Sep 08 11:14:50.754703 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2985/5851] 10.222.0.27 () {60 vars in 1343 bytes} [Thu Sep 8 11:14:50 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:14:50.843432 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a7e7fe49-f54e-43e3-9bfa-f6f364a5d87e tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:50.844576 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a7e7fe49-f54e-43e3-9bfa-f6f364a5d87e tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:50.857758 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a7e7fe49-f54e-43e3-9bfa-f6f364a5d87e tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:50.858477 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a7e7fe49-f54e-43e3-9bfa-f6f364a5d87e tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:50.859087 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a7e7fe49-f54e-43e3-9bfa-f6f364a5d87e tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:50.859978 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a7e7fe49-f54e-43e3-9bfa-f6f364a5d87e tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:50.860444 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a7e7fe49-f54e-43e3-9bfa-f6f364a5d87e tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:50.860885 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a7e7fe49-f54e-43e3-9bfa-f6f364a5d87e tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:50.921290 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a7e7fe49-f54e-43e3-9bfa-f6f364a5d87e tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:14:51.049416 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a7e7fe49-f54e-43e3-9bfa-f6f364a5d87e tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e" status: 204 len: 0 microversion: 2.20 time: 0.214844 Sep 08 11:14:51.057426 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2867/5852] 10.222.0.27 () {60 vars in 1280 bytes} [Thu Sep 8 11:14:50 2022] DELETE /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 11:14:51.066434 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-652efa4b-37ab-41d4-9438-897be8759bd5 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:51.071415 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-652efa4b-37ab-41d4-9438-897be8759bd5 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:51.079784 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-652efa4b-37ab-41d4-9438-897be8759bd5 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:51.080294 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-652efa4b-37ab-41d4-9438-897be8759bd5 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:51.080737 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-652efa4b-37ab-41d4-9438-897be8759bd5 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:51.081732 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-652efa4b-37ab-41d4-9438-897be8759bd5 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:51.082407 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-652efa4b-37ab-41d4-9438-897be8759bd5 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:51.082833 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-652efa4b-37ab-41d4-9438-897be8759bd5 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:51.274088 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-652efa4b-37ab-41d4-9438-897be8759bd5 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:51.285751 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-652efa4b-37ab-41d4-9438-897be8759bd5 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:51.288306 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-652efa4b-37ab-41d4-9438-897be8759bd5 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:51.289569 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-652efa4b-37ab-41d4-9438-897be8759bd5 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e" status: 200 len: 1722 microversion: 2.20 time: 0.230545 Sep 08 11:14:51.291866 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2986/5853] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:14:51 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e => generated 1722 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 11:14:52.328053 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c39c5940-c4d7-48e1-9074-4b68504ad1ca tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:52.328778 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c39c5940-c4d7-48e1-9074-4b68504ad1ca tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:52.339973 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c39c5940-c4d7-48e1-9074-4b68504ad1ca tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:52.340465 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c39c5940-c4d7-48e1-9074-4b68504ad1ca tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:52.341113 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c39c5940-c4d7-48e1-9074-4b68504ad1ca tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:52.342000 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c39c5940-c4d7-48e1-9074-4b68504ad1ca tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:52.342603 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c39c5940-c4d7-48e1-9074-4b68504ad1ca tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:52.343171 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c39c5940-c4d7-48e1-9074-4b68504ad1ca tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:52.449699 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1e573467-2f3f-4080-b2cd-8899f78998e8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:14:52.452805 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1e573467-2f3f-4080-b2cd-8899f78998e8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: af0ed4bb-bf39-4989-893c-14896abbc7d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:52.475714 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e573467-2f3f-4080-b2cd-8899f78998e8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:52.476457 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e573467-2f3f-4080-b2cd-8899f78998e8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:52.479611 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e573467-2f3f-4080-b2cd-8899f78998e8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:52.490028 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e573467-2f3f-4080-b2cd-8899f78998e8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:52.491983 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e573467-2f3f-4080-b2cd-8899f78998e8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:52.497303 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e573467-2f3f-4080-b2cd-8899f78998e8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:52.597628 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1e573467-2f3f-4080-b2cd-8899f78998e8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "POST /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5/action" status: 200 len: 24549 microversion: 2.1 time: 0.152289 Sep 08 11:14:52.609007 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2987/5854] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 11:14:52 2022] POST /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5/action => generated 24549 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 11:14:52.710881 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c39c5940-c4d7-48e1-9074-4b68504ad1ca tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:52.724474 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c39c5940-c4d7-48e1-9074-4b68504ad1ca tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:52.726592 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c39c5940-c4d7-48e1-9074-4b68504ad1ca tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:52.730444 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c39c5940-c4d7-48e1-9074-4b68504ad1ca tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e" status: 200 len: 1722 microversion: 2.20 time: 0.406772 Sep 08 11:14:52.733737 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2868/5855] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:14:52 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e => generated 1722 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 11:14:53.770809 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-daeec46b-5db6-4037-b784-37b6a1c68582 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:53.772163 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-daeec46b-5db6-4037-b784-37b6a1c68582 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:53.805461 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-daeec46b-5db6-4037-b784-37b6a1c68582 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:53.806452 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-daeec46b-5db6-4037-b784-37b6a1c68582 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:53.807143 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-daeec46b-5db6-4037-b784-37b6a1c68582 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:53.808110 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-daeec46b-5db6-4037-b784-37b6a1c68582 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:53.808777 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-daeec46b-5db6-4037-b784-37b6a1c68582 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:53.809682 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-daeec46b-5db6-4037-b784-37b6a1c68582 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:54.015261 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-daeec46b-5db6-4037-b784-37b6a1c68582 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:54.026280 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-daeec46b-5db6-4037-b784-37b6a1c68582 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:54.027953 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-daeec46b-5db6-4037-b784-37b6a1c68582 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:54.029250 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-daeec46b-5db6-4037-b784-37b6a1c68582 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e" status: 200 len: 1722 microversion: 2.20 time: 0.263597 Sep 08 11:14:54.030187 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2988/5856] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:14:53 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e => generated 1722 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:14:54.449863 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-f5d98261-ad37-4ab3-a32f-3d8df71d100a req-81ed361e-dee3-4957-b5a8-979f665c126b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9c23be4-60f4-4bff-9e0d-8040618b552e", "name": "network-vif-deleted", "tag": "0dcde267-c491-450a-894c-03db6d80d8ff"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:14:54.520857 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-f5d98261-ad37-4ab3-a32f-3d8df71d100a req-81ed361e-dee3-4957-b5a8-979f665c126b service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:54.521708 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-f5d98261-ad37-4ab3-a32f-3d8df71d100a req-81ed361e-dee3-4957-b5a8-979f665c126b service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:54.522318 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-f5d98261-ad37-4ab3-a32f-3d8df71d100a req-81ed361e-dee3-4957-b5a8-979f665c126b service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:54.567890 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-f5d98261-ad37-4ab3-a32f-3d8df71d100a req-81ed361e-dee3-4957-b5a8-979f665c126b service nova] Creating event network-vif-deleted:0dcde267-c491-450a-894c-03db6d80d8ff for instance f9c23be4-60f4-4bff-9e0d-8040618b552e on n-h2-850501-12 Sep 08 11:14:54.593950 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-f5d98261-ad37-4ab3-a32f-3d8df71d100a req-81ed361e-dee3-4957-b5a8-979f665c126b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149616 Sep 08 11:14:54.594901 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2869/5857] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:14:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:14:55.059645 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b250b090-e9ac-4223-a7e5-86130fc6bba2 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:55.060368 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b250b090-e9ac-4223-a7e5-86130fc6bba2 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:55.100051 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b250b090-e9ac-4223-a7e5-86130fc6bba2 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:55.104383 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b250b090-e9ac-4223-a7e5-86130fc6bba2 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:55.112739 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b250b090-e9ac-4223-a7e5-86130fc6bba2 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:55.114835 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b250b090-e9ac-4223-a7e5-86130fc6bba2 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:55.117413 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b250b090-e9ac-4223-a7e5-86130fc6bba2 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:55.117870 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b250b090-e9ac-4223-a7e5-86130fc6bba2 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:55.234604 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b250b090-e9ac-4223-a7e5-86130fc6bba2 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:55.236279 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b250b090-e9ac-4223-a7e5-86130fc6bba2 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:55.236737 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b250b090-e9ac-4223-a7e5-86130fc6bba2 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:55.238455 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-b250b090-e9ac-4223-a7e5-86130fc6bba2 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lazy-loading 'fault' on Instance uuid f9c23be4-60f4-4bff-9e0d-8040618b552e {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:14:55.402461 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b250b090-e9ac-4223-a7e5-86130fc6bba2 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:55.435356 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b250b090-e9ac-4223-a7e5-86130fc6bba2 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:55.439044 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b250b090-e9ac-4223-a7e5-86130fc6bba2 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:55.442724 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b250b090-e9ac-4223-a7e5-86130fc6bba2 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e" status: 200 len: 1370 microversion: 2.20 time: 0.388771 Sep 08 11:14:55.444468 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2989/5858] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:14:55 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e => generated 1370 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:14:56.485738 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-82b288c9-1eb9-407e-8bf1-6ca5aa816487 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:56.487096 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-82b288c9-1eb9-407e-8bf1-6ca5aa816487 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:56.494185 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:14:56.496656 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-82b288c9-1eb9-407e-8bf1-6ca5aa816487 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:56.497357 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-82b288c9-1eb9-407e-8bf1-6ca5aa816487 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:56.498353 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-82b288c9-1eb9-407e-8bf1-6ca5aa816487 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:56.499345 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-82b288c9-1eb9-407e-8bf1-6ca5aa816487 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:56.499535 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-82b288c9-1eb9-407e-8bf1-6ca5aa816487 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:56.500136 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-82b288c9-1eb9-407e-8bf1-6ca5aa816487 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:56.518429 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-82b288c9-1eb9-407e-8bf1-6ca5aa816487 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] HTTP exception thrown: Instance f9c23be4-60f4-4bff-9e0d-8040618b552e could not be found. Sep 08 11:14:56.520585 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-82b288c9-1eb9-407e-8bf1-6ca5aa816487 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Request method failure captured: Sep 08 11:14:56.520585 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e HTTP/1.1 Sep 08 11:14:56.520585 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 11:14:56.520585 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 11:14:56.520585 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 11:14:56.520585 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 11:14:56.520585 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 11:14:56.520585 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 11:14:56.520585 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 11:14:56.520585 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 11:14:56.520585 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGc3kfqVMG6_l5-n3Jy-yTIUNVn46vQMW0Svh8HvDX_Uw31ucMeRwEEg05OHVnjjynwLcmSgE9Go63mYndLW9b28zZhI7OsPdM7y12rMW0dEW1DuG0DWqI2z6goyVnhdLBllyJnuUcDLwXr0pG5cjZzwIq1snz9Ch69kN4pQx_GP1lvI Sep 08 11:14:56.520585 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 11:14:56.520585 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 11:14:56.520585 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 11:14:56.520585 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 11:14:56.520585 n-d-850501-12 devstack@n-api.service[128862]: X-Openstack-Nova-Api-Version: 2.20 Sep 08 11:14:56.520585 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 11:14:56.520585 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 11:14:56.520585 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 364c37fba48647df9953911ecaa86e73 Sep 08 11:14:56.520585 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-269023239 Sep 08 11:14:56.520585 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 11:14:56.520585 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 11:14:56.520585 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/364c37fba48647df9953911ecaa86e73"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/364c37fba48647df9953911ecaa86e73"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_364c37fba48647df9953911ecaa86e73"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/364c37fba48647df9953911ecaa86e73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:14:56.520585 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-AttachVolumeShelveTestJSON-269023239 Sep 08 11:14:56.520585 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 364c37fba48647df9953911ecaa86e73 Sep 08 11:14:56.520585 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-269023239 Sep 08 11:14:56.520585 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-AttachVolumeShelveTestJSON-269023239-project Sep 08 11:14:56.520585 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 11:14:56.520585 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 11:14:56.520585 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 2e0da79f00a24cdb9312036aa4137aa0 Sep 08 11:14:56.520585 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-AttachVolumeShelveTestJSON-269023239-project Sep 08 11:14:56.520585 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 11:14:56.520585 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance f9c23be4-60f4-4bff-9e0d-8040618b552e could not be found. Sep 08 11:14:56.520585 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'f9c23be4-60f4-4bff-9e0d-8040618b552e'} Sep 08 11:14:56.520585 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:14:56.520585 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:14:56.520585 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:14:56.520585 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:14:56.520585 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:14:56.520585 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:14:56.520585 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:14:56.520585 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:14:56.520585 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:14:56.520585 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:14:56.520585 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9c23be4-60f4-4bff-9e0d-8040618b552e could not be found. Sep 08 11:14:56.520585 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:14:56.520585 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:14:56.520585 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:14:56.520585 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:14:56.520585 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:14:56.520585 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:14:56.520585 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:14:56.520585 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:14:56.520585 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:14:56.520585 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:14:56.520585 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:14:56.520585 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:14:56.520585 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:14:56.520585 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:14:56.520585 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:14:56.520585 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:14:56.520585 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9c23be4-60f4-4bff-9e0d-8040618b552e could not be found. Sep 08 11:14:56.520585 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:14:56.520585 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:14:56.524959 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:14:56.524959 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:14:56.524959 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:14:56.524959 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:14:56.524959 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:14:56.524959 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:14:56.524959 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9c23be4-60f4-4bff-9e0d-8040618b552e could not be found. Sep 08 11:14:56.524959 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:14:56.527084 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-82b288c9-1eb9-407e-8bf1-6ca5aa816487 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Returning 404 to user: Instance f9c23be4-60f4-4bff-9e0d-8040618b552e could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:14:56.527703 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-82b288c9-1eb9-407e-8bf1-6ca5aa816487 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e" status: 404 len: 111 microversion: 2.20 time: 0.047756 Sep 08 11:14:56.528623 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2870/5859] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:14:56 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 11:14:56.537447 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f86e9ccd-8fbf-49a2-b739-449599ee6c4c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '.version_select at 0x7f68e44fb040>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:56.566655 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f86e9ccd-8fbf-49a2-b739-449599ee6c4c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-656849058" status: 204 len: 0 microversion: 2.20 time: 0.032953 Sep 08 11:14:56.571589 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2990/5860] 10.222.0.27 () {60 vars in 1259 bytes} [Thu Sep 8 11:14:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-656849058 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 11:14:57.418292 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9c37aa13-611f-4ca4-b755-7c7663cd98dc tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Action: 'create', calling method: .version_select at 0x7f68e8a92040>, body: {"keypair": {"name": "tempest-keypair-1060095653", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+dS/A9HD/8JUUgVRpdHVP5altcwne375F9FtESXuWoJf1McaqPhsGUYMztQd85MQTn5ql09G20LKieGmvMs1pNCoQBJPCuxZS8c48t4KffjF3aw6Iqd2lrZ9iNPl/FgA=="}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:14:57.444088 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-9c37aa13-611f-4ca4-b755-7c7663cd98dc tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Getting quotas for project 364c37fba48647df9953911ecaa86e73. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:14:57.451208 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-9c37aa13-611f-4ca4-b755-7c7663cd98dc tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Getting quotas for user 2e0da79f00a24cdb9312036aa4137aa0 and project 364c37fba48647df9953911ecaa86e73. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:14:57.487783 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9c37aa13-611f-4ca4-b755-7c7663cd98dc tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.087680 Sep 08 11:14:57.488780 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2871/5861] 10.222.0.27 () {62 vars in 1200 bytes} [Thu Sep 8 11:14:57 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 91 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 08 11:14:58.884129 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-827940f2-b2d9-4d7e-a6c0-7337b413edb6 tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:58.899082 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-827940f2-b2d9-4d7e-a6c0-7337b413edb6 tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] [instance: af0ed4bb-bf39-4989-893c-14896abbc7d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:58.941355 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-827940f2-b2d9-4d7e-a6c0-7337b413edb6 tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:58.942509 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-827940f2-b2d9-4d7e-a6c0-7337b413edb6 tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:58.944344 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-827940f2-b2d9-4d7e-a6c0-7337b413edb6 tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:58.950770 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-827940f2-b2d9-4d7e-a6c0-7337b413edb6 tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:58.952079 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-827940f2-b2d9-4d7e-a6c0-7337b413edb6 tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:58.953533 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-827940f2-b2d9-4d7e-a6c0-7337b413edb6 tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:59.428717 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-827940f2-b2d9-4d7e-a6c0-7337b413edb6 tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5" status: 200 len: 1836 microversion: 2.1 time: 0.549179 Sep 08 11:14:59.448215 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2991/5862] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:58 2022] GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5 => generated 1836 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:14:59.882782 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a3633a36-1cd0-4bed-8956-77d1545c127c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1852158546", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2bfad326-f67a-49aa-87be-58dceddd9ab8"}], "security_groups": [{"name": "tempest-securitygroup--834295862"}], "key_name": "tempest-keypair-1060095653", "user_data": "}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:15:00.061170 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-a3633a36-1cd0-4bed-8956-77d1545c127c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] validate_networks() for [('2bfad326-f67a-49aa-87be-58dceddd9ab8', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:15:00.606969 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-a3633a36-1cd0-4bed-8956-77d1545c127c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:15:00.607397 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-a3633a36-1cd0-4bed-8956-77d1545c127c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:15:00.607874 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-a3633a36-1cd0-4bed-8956-77d1545c127c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:15:00.608288 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-a3633a36-1cd0-4bed-8956-77d1545c127c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:15:00.608705 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-a3633a36-1cd0-4bed-8956-77d1545c127c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:15:00.627472 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a3633a36-1cd0-4bed-8956-77d1545c127c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:00.628051 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a3633a36-1cd0-4bed-8956-77d1545c127c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:00.628503 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a3633a36-1cd0-4bed-8956-77d1545c127c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:00.629262 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a3633a36-1cd0-4bed-8956-77d1545c127c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:00.630133 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a3633a36-1cd0-4bed-8956-77d1545c127c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:00.630601 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a3633a36-1cd0-4bed-8956-77d1545c127c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:00.668078 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-a3633a36-1cd0-4bed-8956-77d1545c127c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Getting quotas for project 364c37fba48647df9953911ecaa86e73. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:15:00.674925 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-a3633a36-1cd0-4bed-8956-77d1545c127c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Getting quotas for user 2e0da79f00a24cdb9312036aa4137aa0 and project 364c37fba48647df9953911ecaa86e73. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:15:00.699373 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a3633a36-1cd0-4bed-8956-77d1545c127c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:15:00.702581 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a3633a36-1cd0-4bed-8956-77d1545c127c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: 67dca3fd-4bba-447a-9af9-0aacf1dd5451] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:15:00.797408 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a3633a36-1cd0-4bed-8956-77d1545c127c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.915165 Sep 08 11:15:00.805821 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2872/5863] 10.222.0.27 () {62 vars in 1188 bytes} [Thu Sep 8 11:14:59 2022] POST /compute/v2.1/servers => generated 401 bytes in 928 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 08 11:15:00.811319 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9a357e75-f7de-426a-bcb3-cddc984bdbca tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:00.812029 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9a357e75-f7de-426a-bcb3-cddc984bdbca tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: 67dca3fd-4bba-447a-9af9-0aacf1dd5451] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:00.939210 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9a357e75-f7de-426a-bcb3-cddc984bdbca tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:00.948469 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9a357e75-f7de-426a-bcb3-cddc984bdbca tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:00.954492 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9a357e75-f7de-426a-bcb3-cddc984bdbca tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:00.955973 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9a357e75-f7de-426a-bcb3-cddc984bdbca tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451" status: 200 len: 1282 microversion: 2.20 time: 0.149664 Sep 08 11:15:00.956728 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2992/5864] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:15:00 2022] GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451 => generated 1282 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:15:01.991647 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-60258f3a-d5e6-457c-9f4f-760b6fd1f758 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:01.992637 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-60258f3a-d5e6-457c-9f4f-760b6fd1f758 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: 67dca3fd-4bba-447a-9af9-0aacf1dd5451] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:02.013190 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-60258f3a-d5e6-457c-9f4f-760b6fd1f758 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:02.016191 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-60258f3a-d5e6-457c-9f4f-760b6fd1f758 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:02.016789 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-60258f3a-d5e6-457c-9f4f-760b6fd1f758 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:02.018143 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-60258f3a-d5e6-457c-9f4f-760b6fd1f758 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:02.018650 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-60258f3a-d5e6-457c-9f4f-760b6fd1f758 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:02.019081 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-60258f3a-d5e6-457c-9f4f-760b6fd1f758 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:02.138006 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-60258f3a-d5e6-457c-9f4f-760b6fd1f758 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:02.156199 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-60258f3a-d5e6-457c-9f4f-760b6fd1f758 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:02.159448 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-60258f3a-d5e6-457c-9f4f-760b6fd1f758 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:02.162138 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-60258f3a-d5e6-457c-9f4f-760b6fd1f758 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451" status: 200 len: 1334 microversion: 2.20 time: 0.176092 Sep 08 11:15:02.192453 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2873/5865] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:15:01 2022] GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451 => generated 1334 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:15:02.966195 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-27c57949-d175-44f6-93aa-c43fb3e184a8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:02.966804 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-27c57949-d175-44f6-93aa-c43fb3e184a8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: af0ed4bb-bf39-4989-893c-14896abbc7d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:02.994935 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-27c57949-d175-44f6-93aa-c43fb3e184a8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:02.995738 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-27c57949-d175-44f6-93aa-c43fb3e184a8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:03.005997 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-27c57949-d175-44f6-93aa-c43fb3e184a8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:03.007137 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-27c57949-d175-44f6-93aa-c43fb3e184a8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:03.007835 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-27c57949-d175-44f6-93aa-c43fb3e184a8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:03.009641 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-27c57949-d175-44f6-93aa-c43fb3e184a8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:03.072768 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-a4f2a3bf-64f4-44cf-8e6e-08876b1fb7ee req-3e7e15c3-be3f-4641-b8f2-c20bfcdc599f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af0ed4bb-bf39-4989-893c-14896abbc7d5", "tag": "d243af0a-26ec-4f11-98dd-3ce340f57c21"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:15:03.089804 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-27c57949-d175-44f6-93aa-c43fb3e184a8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: af0ed4bb-bf39-4989-893c-14896abbc7d5] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:15:03.154672 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a4f2a3bf-64f4-44cf-8e6e-08876b1fb7ee req-3e7e15c3-be3f-4641-b8f2-c20bfcdc599f service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:03.174168 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a4f2a3bf-64f4-44cf-8e6e-08876b1fb7ee req-3e7e15c3-be3f-4641-b8f2-c20bfcdc599f service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:03.179795 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a4f2a3bf-64f4-44cf-8e6e-08876b1fb7ee req-3e7e15c3-be3f-4641-b8f2-c20bfcdc599f service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:03.227094 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-27c57949-d175-44f6-93aa-c43fb3e184a8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "DELETE /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5" status: 204 len: 0 microversion: 2.1 time: 0.265478 Sep 08 11:15:03.233232 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2993/5866] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:15:02 2022] DELETE /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 11:15:03.241309 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-52958db4-4128-4e9f-8ea4-99206caa4141 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:03.242307 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-52958db4-4128-4e9f-8ea4-99206caa4141 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: 67dca3fd-4bba-447a-9af9-0aacf1dd5451] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:03.254177 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-52958db4-4128-4e9f-8ea4-99206caa4141 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:03.255034 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-52958db4-4128-4e9f-8ea4-99206caa4141 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:03.255630 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-52958db4-4128-4e9f-8ea4-99206caa4141 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:03.256623 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-52958db4-4128-4e9f-8ea4-99206caa4141 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:03.257269 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-52958db4-4128-4e9f-8ea4-99206caa4141 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:03.257807 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-52958db4-4128-4e9f-8ea4-99206caa4141 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:03.316123 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-a4f2a3bf-64f4-44cf-8e6e-08876b1fb7ee req-3e7e15c3-be3f-4641-b8f2-c20bfcdc599f service nova] Creating event network-changed:d243af0a-26ec-4f11-98dd-3ce340f57c21 for instance af0ed4bb-bf39-4989-893c-14896abbc7d5 on n-h1-850501-12 Sep 08 11:15:03.343082 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-a4f2a3bf-64f4-44cf-8e6e-08876b1fb7ee req-3e7e15c3-be3f-4641-b8f2-c20bfcdc599f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.274500 Sep 08 11:15:03.363315 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2874/5867] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:15:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:15:03.391189 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-113e23bd-471d-472e-9218-2cdd6987e9e3 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:03.392416 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-113e23bd-471d-472e-9218-2cdd6987e9e3 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: af0ed4bb-bf39-4989-893c-14896abbc7d5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:03.451633 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-113e23bd-471d-472e-9218-2cdd6987e9e3 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:03.452775 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-113e23bd-471d-472e-9218-2cdd6987e9e3 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:03.457064 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-113e23bd-471d-472e-9218-2cdd6987e9e3 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:03.458239 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-113e23bd-471d-472e-9218-2cdd6987e9e3 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:03.461306 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-113e23bd-471d-472e-9218-2cdd6987e9e3 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:03.462134 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-113e23bd-471d-472e-9218-2cdd6987e9e3 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:03.594941 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-52958db4-4128-4e9f-8ea4-99206caa4141 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:03.614014 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-52958db4-4128-4e9f-8ea4-99206caa4141 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:03.616939 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-52958db4-4128-4e9f-8ea4-99206caa4141 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:03.619003 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-52958db4-4128-4e9f-8ea4-99206caa4141 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451" status: 200 len: 1340 microversion: 2.20 time: 0.383384 Sep 08 11:15:03.637059 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2994/5868] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:15:03 2022] GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451 => generated 1340 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:15:04.086136 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-113e23bd-471d-472e-9218-2cdd6987e9e3 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:04.098276 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-113e23bd-471d-472e-9218-2cdd6987e9e3 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5" status: 200 len: 1689 microversion: 2.1 time: 0.724834 Sep 08 11:15:04.124355 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2875/5869] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:03 2022] GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5 => generated 1689 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:15:04.664493 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ed02747c-4cb1-40c8-a5c7-de6fe94e6903 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:04.666381 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ed02747c-4cb1-40c8-a5c7-de6fe94e6903 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: 67dca3fd-4bba-447a-9af9-0aacf1dd5451] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:04.691568 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed02747c-4cb1-40c8-a5c7-de6fe94e6903 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:04.692065 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed02747c-4cb1-40c8-a5c7-de6fe94e6903 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:04.697072 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed02747c-4cb1-40c8-a5c7-de6fe94e6903 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:04.704818 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed02747c-4cb1-40c8-a5c7-de6fe94e6903 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:04.706847 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed02747c-4cb1-40c8-a5c7-de6fe94e6903 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:04.707310 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed02747c-4cb1-40c8-a5c7-de6fe94e6903 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:05.131520 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-22b40aa2-1b97-40c8-985f-91759fbc2154 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:05.132337 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-22b40aa2-1b97-40c8-985f-91759fbc2154 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: af0ed4bb-bf39-4989-893c-14896abbc7d5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:05.147328 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-22b40aa2-1b97-40c8-985f-91759fbc2154 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:05.148125 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-22b40aa2-1b97-40c8-985f-91759fbc2154 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:05.148808 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-22b40aa2-1b97-40c8-985f-91759fbc2154 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:05.150936 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-22b40aa2-1b97-40c8-985f-91759fbc2154 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:05.151824 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-22b40aa2-1b97-40c8-985f-91759fbc2154 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:05.171220 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-22b40aa2-1b97-40c8-985f-91759fbc2154 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:05.470932 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ed02747c-4cb1-40c8-a5c7-de6fe94e6903 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:05.487680 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ed02747c-4cb1-40c8-a5c7-de6fe94e6903 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:05.492824 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ed02747c-4cb1-40c8-a5c7-de6fe94e6903 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:05.497162 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ed02747c-4cb1-40c8-a5c7-de6fe94e6903 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451" status: 200 len: 1407 microversion: 2.20 time: 0.835497 Sep 08 11:15:05.499266 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2995/5870] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:15:04 2022] GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451 => generated 1407 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:15:05.670661 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-22b40aa2-1b97-40c8-985f-91759fbc2154 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:05.683556 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-22b40aa2-1b97-40c8-985f-91759fbc2154 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5" status: 200 len: 1689 microversion: 2.1 time: 0.555941 Sep 08 11:15:05.685336 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2876/5871] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:05 2022] GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5 => generated 1689 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:15:06.535554 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-99d73723-2e88-431e-b743-173d1c9a7342 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:06.536368 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-99d73723-2e88-431e-b743-173d1c9a7342 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: 67dca3fd-4bba-447a-9af9-0aacf1dd5451] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:06.546121 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-99d73723-2e88-431e-b743-173d1c9a7342 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:06.546697 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-99d73723-2e88-431e-b743-173d1c9a7342 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:06.547248 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-99d73723-2e88-431e-b743-173d1c9a7342 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:06.548395 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-99d73723-2e88-431e-b743-173d1c9a7342 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:06.548988 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-99d73723-2e88-431e-b743-173d1c9a7342 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:06.549843 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-99d73723-2e88-431e-b743-173d1c9a7342 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:06.713336 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0e8e070e-fb75-4f48-996a-0ead163982b0 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:06.713987 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0e8e070e-fb75-4f48-996a-0ead163982b0 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: af0ed4bb-bf39-4989-893c-14896abbc7d5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:06.745945 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e8e070e-fb75-4f48-996a-0ead163982b0 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:06.748351 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e8e070e-fb75-4f48-996a-0ead163982b0 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:06.749286 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e8e070e-fb75-4f48-996a-0ead163982b0 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:06.750675 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e8e070e-fb75-4f48-996a-0ead163982b0 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:06.754069 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e8e070e-fb75-4f48-996a-0ead163982b0 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:06.754821 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e8e070e-fb75-4f48-996a-0ead163982b0 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:07.624500 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-99d73723-2e88-431e-b743-173d1c9a7342 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:07.641265 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-99d73723-2e88-431e-b743-173d1c9a7342 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:07.642927 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-99d73723-2e88-431e-b743-173d1c9a7342 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:07.644118 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-99d73723-2e88-431e-b743-173d1c9a7342 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451" status: 200 len: 1407 microversion: 2.20 time: 1.115068 Sep 08 11:15:07.647495 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2996/5872] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:15:06 2022] GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451 => generated 1407 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:15:07.652478 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0e8e070e-fb75-4f48-996a-0ead163982b0 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:07.675777 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-3818b166-56cf-462b-9672-500027b584f5 req-3626ce7a-cbe5-421f-adaa-b0652181cf4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67dca3fd-4bba-447a-9af9-0aacf1dd5451", "tag": "242cd08b-a4b9-4348-bfc9-024fa3eaf821"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:15:07.683007 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0e8e070e-fb75-4f48-996a-0ead163982b0 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5" status: 200 len: 1570 microversion: 2.1 time: 0.958628 Sep 08 11:15:07.684384 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2877/5873] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:06 2022] GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5 => generated 1570 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:15:07.696360 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:15:07.699384 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-3818b166-56cf-462b-9672-500027b584f5 req-3626ce7a-cbe5-421f-adaa-b0652181cf4d service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:07.700048 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-3818b166-56cf-462b-9672-500027b584f5 req-3626ce7a-cbe5-421f-adaa-b0652181cf4d service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:07.701258 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-3818b166-56cf-462b-9672-500027b584f5 req-3626ce7a-cbe5-421f-adaa-b0652181cf4d service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:07.718876 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-3818b166-56cf-462b-9672-500027b584f5 req-3626ce7a-cbe5-421f-adaa-b0652181cf4d service nova] Creating event network-changed:242cd08b-a4b9-4348-bfc9-024fa3eaf821 for instance 67dca3fd-4bba-447a-9af9-0aacf1dd5451 on n-h2-850501-12 Sep 08 11:15:07.728745 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-3818b166-56cf-462b-9672-500027b584f5 req-3626ce7a-cbe5-421f-adaa-b0652181cf4d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055318 Sep 08 11:15:07.729867 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2997/5874] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:15:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:15:08.674197 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f93291b8-e858-408b-b260-f4de46dfaed2 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:08.674816 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f93291b8-e858-408b-b260-f4de46dfaed2 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: 67dca3fd-4bba-447a-9af9-0aacf1dd5451] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:08.690572 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f93291b8-e858-408b-b260-f4de46dfaed2 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:08.691305 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f93291b8-e858-408b-b260-f4de46dfaed2 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:08.692009 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f93291b8-e858-408b-b260-f4de46dfaed2 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:08.693053 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f93291b8-e858-408b-b260-f4de46dfaed2 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:08.694113 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f93291b8-e858-408b-b260-f4de46dfaed2 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:08.694706 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f93291b8-e858-408b-b260-f4de46dfaed2 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:08.714187 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-77d2cbdd-b1ce-4f50-ab02-9edf011d1478 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:08.717586 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-77d2cbdd-b1ce-4f50-ab02-9edf011d1478 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: af0ed4bb-bf39-4989-893c-14896abbc7d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:08.732723 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-77d2cbdd-b1ce-4f50-ab02-9edf011d1478 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:08.733632 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-77d2cbdd-b1ce-4f50-ab02-9edf011d1478 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:08.734558 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-77d2cbdd-b1ce-4f50-ab02-9edf011d1478 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:08.735489 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-77d2cbdd-b1ce-4f50-ab02-9edf011d1478 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:08.736227 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-77d2cbdd-b1ce-4f50-ab02-9edf011d1478 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:08.738457 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-77d2cbdd-b1ce-4f50-ab02-9edf011d1478 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:08.821414 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-77d2cbdd-b1ce-4f50-ab02-9edf011d1478 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:08.822692 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-77d2cbdd-b1ce-4f50-ab02-9edf011d1478 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:08.823280 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-77d2cbdd-b1ce-4f50-ab02-9edf011d1478 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:08.823914 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-77d2cbdd-b1ce-4f50-ab02-9edf011d1478 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lazy-loading 'fault' on Instance uuid af0ed4bb-bf39-4989-893c-14896abbc7d5 {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:15:09.030481 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-77d2cbdd-b1ce-4f50-ab02-9edf011d1478 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:09.041858 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-77d2cbdd-b1ce-4f50-ab02-9edf011d1478 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5" status: 200 len: 1356 microversion: 2.1 time: 0.334868 Sep 08 11:15:09.043755 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2998/5875] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:08 2022] GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5 => generated 1356 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:15:09.107936 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f93291b8-e858-408b-b260-f4de46dfaed2 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:09.114499 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:15:09.123182 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f93291b8-e858-408b-b260-f4de46dfaed2 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:09.124588 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f93291b8-e858-408b-b260-f4de46dfaed2 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:09.125809 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f93291b8-e858-408b-b260-f4de46dfaed2 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451" status: 200 len: 1407 microversion: 2.20 time: 0.455870 Sep 08 11:15:09.126381 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2878/5876] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:15:08 2022] GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451 => generated 1407 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:15:10.070623 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e5ef20f6-635f-46da-8dc5-ce380fb088ae tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:10.071608 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e5ef20f6-635f-46da-8dc5-ce380fb088ae tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: af0ed4bb-bf39-4989-893c-14896abbc7d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:10.089474 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e5ef20f6-635f-46da-8dc5-ce380fb088ae tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:10.092306 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e5ef20f6-635f-46da-8dc5-ce380fb088ae tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:10.096277 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e5ef20f6-635f-46da-8dc5-ce380fb088ae tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:10.097349 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e5ef20f6-635f-46da-8dc5-ce380fb088ae tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:10.097990 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e5ef20f6-635f-46da-8dc5-ce380fb088ae tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:10.101716 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e5ef20f6-635f-46da-8dc5-ce380fb088ae tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:10.157366 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c7fc77b4-2c2d-4f81-a914-19a0ccab904a tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:10.159276 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c7fc77b4-2c2d-4f81-a914-19a0ccab904a tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: 67dca3fd-4bba-447a-9af9-0aacf1dd5451] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:10.166498 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-e5ef20f6-635f-46da-8dc5-ce380fb088ae tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] HTTP exception thrown: Instance af0ed4bb-bf39-4989-893c-14896abbc7d5 could not be found. Sep 08 11:15:10.171180 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e5ef20f6-635f-46da-8dc5-ce380fb088ae tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Request method failure captured: Sep 08 11:15:10.171180 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5 HTTP/1.1 Sep 08 11:15:10.171180 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:15:10.171180 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:15:10.171180 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:15:10.171180 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 11:15:10.171180 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:15:10.171180 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:15:10.171180 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:15:10.171180 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:15:10.171180 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGc4eLGLW59QQolLaaYcmDAiK1YbvX0P6Oar8zm2OskBZObiWASS3uPq8vhdcTC5ZdVCfihBjMcHmME9I_dk-w3cv_qjNt6vtGdn5VgVz6nIlOrAKGTn8XYgxYQT4bLviOyr8E8viE7U4gtGDdg6vP3Ww_5rPnGvOSYRnSwZtG3vZ7Ao Sep 08 11:15:10.171180 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:15:10.171180 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:15:10.171180 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:15:10.171180 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:15:10.171180 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:15:10.171180 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:15:10.171180 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: a0f9071124e74802a2f76cb326ca58df Sep 08 11:15:10.171180 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1864834353 Sep 08 11:15:10.171180 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:15:10.171180 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:15:10.171180 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a0f9071124e74802a2f76cb326ca58df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a0f9071124e74802a2f76cb326ca58df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a0f9071124e74802a2f76cb326ca58df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a0f9071124e74802a2f76cb326ca58df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:15:10.171180 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1864834353 Sep 08 11:15:10.171180 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: a0f9071124e74802a2f76cb326ca58df Sep 08 11:15:10.171180 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1864834353 Sep 08 11:15:10.171180 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-TestNetworkAdvancedServerOps-1864834353-project Sep 08 11:15:10.171180 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:15:10.171180 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:15:10.171180 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: c33e91fa4e3746aa8d8d23940e17bc1e Sep 08 11:15:10.171180 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1864834353-project Sep 08 11:15:10.171180 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 11:15:10.171180 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance af0ed4bb-bf39-4989-893c-14896abbc7d5 could not be found. Sep 08 11:15:10.171180 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': 'af0ed4bb-bf39-4989-893c-14896abbc7d5'} Sep 08 11:15:10.171180 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:15:10.171180 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:15:10.171180 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:15:10.171180 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:15:10.171180 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:15:10.171180 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:15:10.171180 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:15:10.171180 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:15:10.171180 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:15:10.171180 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:15:10.171180 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af0ed4bb-bf39-4989-893c-14896abbc7d5 could not be found. Sep 08 11:15:10.171180 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:15:10.171180 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:15:10.171180 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:15:10.171180 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:15:10.171180 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:15:10.171180 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:15:10.171180 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:15:10.171180 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:15:10.171180 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:15:10.171180 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:15:10.171180 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:15:10.171180 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:15:10.171180 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:15:10.171180 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:15:10.171180 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:15:10.171180 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:15:10.171180 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af0ed4bb-bf39-4989-893c-14896abbc7d5 could not be found. Sep 08 11:15:10.171180 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:15:10.171180 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:15:10.175074 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:15:10.175074 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:15:10.175074 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:15:10.175074 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:15:10.175074 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:15:10.175074 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:15:10.175074 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af0ed4bb-bf39-4989-893c-14896abbc7d5 could not be found. Sep 08 11:15:10.175074 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:15:10.175074 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e5ef20f6-635f-46da-8dc5-ce380fb088ae tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Returning 404 to user: Instance af0ed4bb-bf39-4989-893c-14896abbc7d5 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:15:10.179996 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c7fc77b4-2c2d-4f81-a914-19a0ccab904a tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:10.180434 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e5ef20f6-635f-46da-8dc5-ce380fb088ae tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5" status: 404 len: 111 microversion: 2.1 time: 0.112096 Sep 08 11:15:10.181156 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2999/5877] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:10 2022] GET /compute/v2.1/servers/af0ed4bb-bf39-4989-893c-14896abbc7d5 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:15:10.181271 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c7fc77b4-2c2d-4f81-a914-19a0ccab904a tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:10.183744 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c7fc77b4-2c2d-4f81-a914-19a0ccab904a tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:10.184726 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c7fc77b4-2c2d-4f81-a914-19a0ccab904a tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:10.185979 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c7fc77b4-2c2d-4f81-a914-19a0ccab904a tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:10.190813 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c7fc77b4-2c2d-4f81-a914-19a0ccab904a tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:10.405142 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-4ac95cd2-31fb-4a66-a864-154c046ba5e5 req-70395079-b0a7-4ecd-9029-c55679a38f1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af0ed4bb-bf39-4989-893c-14896abbc7d5", "name": "network-vif-deleted", "tag": "d243af0a-26ec-4f11-98dd-3ce340f57c21"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:15:10.428031 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-4ac95cd2-31fb-4a66-a864-154c046ba5e5 req-70395079-b0a7-4ecd-9029-c55679a38f1e service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:10.428768 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-4ac95cd2-31fb-4a66-a864-154c046ba5e5 req-70395079-b0a7-4ecd-9029-c55679a38f1e service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:10.429489 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-4ac95cd2-31fb-4a66-a864-154c046ba5e5 req-70395079-b0a7-4ecd-9029-c55679a38f1e service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:10.460056 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-4ac95cd2-31fb-4a66-a864-154c046ba5e5 req-70395079-b0a7-4ecd-9029-c55679a38f1e service nova] Creating event network-vif-deleted:d243af0a-26ec-4f11-98dd-3ce340f57c21 for instance af0ed4bb-bf39-4989-893c-14896abbc7d5 on n-h1-850501-12 Sep 08 11:15:10.471144 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-4ac95cd2-31fb-4a66-a864-154c046ba5e5 req-70395079-b0a7-4ecd-9029-c55679a38f1e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071286 Sep 08 11:15:10.476059 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3000/5878] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:15:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:15:10.649587 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:15:10.669361 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c7fc77b4-2c2d-4f81-a914-19a0ccab904a tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:10.688052 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=10 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:15:10.701251 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c7fc77b4-2c2d-4f81-a914-19a0ccab904a tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:10.706078 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c7fc77b4-2c2d-4f81-a914-19a0ccab904a tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:10.722388 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c7fc77b4-2c2d-4f81-a914-19a0ccab904a tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451" status: 200 len: 1407 microversion: 2.20 time: 0.557001 Sep 08 11:15:10.726407 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2879/5879] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:15:10 2022] GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451 => generated 1407 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:15:11.605915 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:15:11.612572 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-824241af-f00c-47db-9e6a-74f48308190e tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1792279897", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "f97dbfcb-237c-4f17-abd7-443b9822c64a"}], "key_name": "tempest-TestSecurityGroupsBasicOps-745299918", "security_groups": []}, "os:scheduler_hints": {"different_host": ["90938b52-4f78-45e5-aea8-4a74f5734b4a"]}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:15:11.727278 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-824241af-f00c-47db-9e6a-74f48308190e tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] validate_networks() for [('f97dbfcb-237c-4f17-abd7-443b9822c64a', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:15:11.769481 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a4b29df9-2ca9-4600-befd-3fd2e6422fa5 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:11.770709 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a4b29df9-2ca9-4600-befd-3fd2e6422fa5 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: 67dca3fd-4bba-447a-9af9-0aacf1dd5451] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:11.785439 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a4b29df9-2ca9-4600-befd-3fd2e6422fa5 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:11.786091 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a4b29df9-2ca9-4600-befd-3fd2e6422fa5 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:11.786541 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a4b29df9-2ca9-4600-befd-3fd2e6422fa5 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:11.787263 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a4b29df9-2ca9-4600-befd-3fd2e6422fa5 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:11.792998 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a4b29df9-2ca9-4600-befd-3fd2e6422fa5 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:11.793613 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a4b29df9-2ca9-4600-befd-3fd2e6422fa5 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:12.120733 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a4b29df9-2ca9-4600-befd-3fd2e6422fa5 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:12.136270 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a4b29df9-2ca9-4600-befd-3fd2e6422fa5 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:12.138849 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a4b29df9-2ca9-4600-befd-3fd2e6422fa5 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:12.140154 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a4b29df9-2ca9-4600-befd-3fd2e6422fa5 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451" status: 200 len: 1407 microversion: 2.20 time: 0.374838 Sep 08 11:15:12.162030 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2880/5880] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:15:11 2022] GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451 => generated 1407 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:15:12.192648 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-ba0a8162-3b7c-4094-852e-7b862769e59e req-a4e89933-d356-45c4-90e5-2036cd680022 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67dca3fd-4bba-447a-9af9-0aacf1dd5451", "name": "network-vif-plugged", "status": "completed", "tag": "242cd08b-a4b9-4348-bfc9-024fa3eaf821"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:15:12.208320 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ba0a8162-3b7c-4094-852e-7b862769e59e req-a4e89933-d356-45c4-90e5-2036cd680022 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:12.210596 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ba0a8162-3b7c-4094-852e-7b862769e59e req-a4e89933-d356-45c4-90e5-2036cd680022 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:12.211346 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ba0a8162-3b7c-4094-852e-7b862769e59e req-a4e89933-d356-45c4-90e5-2036cd680022 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:12.224083 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-ba0a8162-3b7c-4094-852e-7b862769e59e req-a4e89933-d356-45c4-90e5-2036cd680022 service nova] Creating event network-vif-plugged:242cd08b-a4b9-4348-bfc9-024fa3eaf821 for instance 67dca3fd-4bba-447a-9af9-0aacf1dd5451 on n-h2-850501-12 Sep 08 11:15:12.234068 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-ba0a8162-3b7c-4094-852e-7b862769e59e req-a4e89933-d356-45c4-90e5-2036cd680022 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045422 Sep 08 11:15:12.235232 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2881/5881] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:15:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:15:12.898853 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-824241af-f00c-47db-9e6a-74f48308190e tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:15:12.899348 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-824241af-f00c-47db-9e6a-74f48308190e tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:15:12.900325 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-824241af-f00c-47db-9e6a-74f48308190e tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:15:12.900741 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-824241af-f00c-47db-9e6a-74f48308190e tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:15:12.901732 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-824241af-f00c-47db-9e6a-74f48308190e tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:15:12.934716 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-824241af-f00c-47db-9e6a-74f48308190e tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:12.935215 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-824241af-f00c-47db-9e6a-74f48308190e tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:12.935661 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-824241af-f00c-47db-9e6a-74f48308190e tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:12.936404 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-824241af-f00c-47db-9e6a-74f48308190e tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:12.936863 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-824241af-f00c-47db-9e6a-74f48308190e tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:12.939415 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-824241af-f00c-47db-9e6a-74f48308190e tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:12.995503 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-824241af-f00c-47db-9e6a-74f48308190e tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Getting quotas for project 8309c65adcd147ba95df7ec8d6b8fb10. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:15:13.011300 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-824241af-f00c-47db-9e6a-74f48308190e tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Getting quotas for user 7d9770721b674c489e0491156a7c5efc and project 8309c65adcd147ba95df7ec8d6b8fb10. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:15:13.045297 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-824241af-f00c-47db-9e6a-74f48308190e tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:15:13.048509 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-824241af-f00c-47db-9e6a-74f48308190e tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] [instance: dd14c8d7-1064-4448-9bc3-ba8ab71031fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:15:13.151000 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-824241af-f00c-47db-9e6a-74f48308190e tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.545955 Sep 08 11:15:13.154612 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3001/5882] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 11:15:11 2022] POST /compute/v2.1/servers => generated 361 bytes in 1551 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:15:13.168738 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2d310229-df13-482c-b53e-950b008e4d27 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:13.170368 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2d310229-df13-482c-b53e-950b008e4d27 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] [instance: dd14c8d7-1064-4448-9bc3-ba8ab71031fe] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:13.175031 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-df89bc18-ea62-4bcc-b312-1c3b828b651b tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:13.176478 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-df89bc18-ea62-4bcc-b312-1c3b828b651b tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: 67dca3fd-4bba-447a-9af9-0aacf1dd5451] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:13.186972 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-df89bc18-ea62-4bcc-b312-1c3b828b651b tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:13.187786 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-df89bc18-ea62-4bcc-b312-1c3b828b651b tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:13.189856 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-df89bc18-ea62-4bcc-b312-1c3b828b651b tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:13.190946 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-df89bc18-ea62-4bcc-b312-1c3b828b651b tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:13.191650 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-df89bc18-ea62-4bcc-b312-1c3b828b651b tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:13.193005 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-df89bc18-ea62-4bcc-b312-1c3b828b651b tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:13.299858 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2d310229-df13-482c-b53e-950b008e4d27 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9770721b674c489e0491156a7c5efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c65adcd147ba95df7ec8d6b8fb10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:13.310107 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2d310229-df13-482c-b53e-950b008e4d27 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] 10.222.0.27 "GET /compute/v2.1/servers/dd14c8d7-1064-4448-9bc3-ba8ab71031fe" status: 200 len: 1241 microversion: 2.1 time: 0.150378 Sep 08 11:15:13.311676 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2882/5883] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:13 2022] GET /compute/v2.1/servers/dd14c8d7-1064-4448-9bc3-ba8ab71031fe => generated 1241 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:15:13.961135 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-df89bc18-ea62-4bcc-b312-1c3b828b651b tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:13.977727 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-df89bc18-ea62-4bcc-b312-1c3b828b651b tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:13.986748 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-df89bc18-ea62-4bcc-b312-1c3b828b651b tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:13.990565 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-df89bc18-ea62-4bcc-b312-1c3b828b651b tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451" status: 200 len: 1407 microversion: 2.20 time: 0.821887 Sep 08 11:15:13.993531 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3002/5884] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:15:13 2022] GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451 => generated 1407 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 11:15:14.336678 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0f3bd9d5-5322-45ba-aa9b-99fdbf9bc0ee tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:14.339493 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0f3bd9d5-5322-45ba-aa9b-99fdbf9bc0ee tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] [instance: dd14c8d7-1064-4448-9bc3-ba8ab71031fe] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:14.362156 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f3bd9d5-5322-45ba-aa9b-99fdbf9bc0ee tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:14.362824 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f3bd9d5-5322-45ba-aa9b-99fdbf9bc0ee tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:14.363947 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f3bd9d5-5322-45ba-aa9b-99fdbf9bc0ee tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:14.364839 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f3bd9d5-5322-45ba-aa9b-99fdbf9bc0ee tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:14.365479 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f3bd9d5-5322-45ba-aa9b-99fdbf9bc0ee tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:14.366056 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f3bd9d5-5322-45ba-aa9b-99fdbf9bc0ee tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:14.522116 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0f3bd9d5-5322-45ba-aa9b-99fdbf9bc0ee tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9770721b674c489e0491156a7c5efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c65adcd147ba95df7ec8d6b8fb10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:14.541335 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0f3bd9d5-5322-45ba-aa9b-99fdbf9bc0ee tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] 10.222.0.27 "GET /compute/v2.1/servers/dd14c8d7-1064-4448-9bc3-ba8ab71031fe" status: 200 len: 1245 microversion: 2.1 time: 0.206578 Sep 08 11:15:14.543596 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2883/5885] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:14 2022] GET /compute/v2.1/servers/dd14c8d7-1064-4448-9bc3-ba8ab71031fe => generated 1245 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:15:15.026510 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a928cf0f-18f4-48eb-9464-a75859f58eef tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:15.027715 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a928cf0f-18f4-48eb-9464-a75859f58eef tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: 67dca3fd-4bba-447a-9af9-0aacf1dd5451] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:15.041808 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a928cf0f-18f4-48eb-9464-a75859f58eef tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:15.046114 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a928cf0f-18f4-48eb-9464-a75859f58eef tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:15.047456 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a928cf0f-18f4-48eb-9464-a75859f58eef tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:15.052279 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a928cf0f-18f4-48eb-9464-a75859f58eef tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:15.056540 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a928cf0f-18f4-48eb-9464-a75859f58eef tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:15.058623 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a928cf0f-18f4-48eb-9464-a75859f58eef tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:15.124333 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:15:15.453297 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a928cf0f-18f4-48eb-9464-a75859f58eef tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:15.470931 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a928cf0f-18f4-48eb-9464-a75859f58eef tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:15.479818 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a928cf0f-18f4-48eb-9464-a75859f58eef tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:15.481709 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a928cf0f-18f4-48eb-9464-a75859f58eef tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451" status: 200 len: 1599 microversion: 2.20 time: 0.460850 Sep 08 11:15:15.483087 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3003/5886] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:15:15 2022] GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451 => generated 1599 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:15:15.511620 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fdaffb1e-f783-4ae6-ae0f-46b0799cc36b tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:15.512797 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fdaffb1e-f783-4ae6-ae0f-46b0799cc36b tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: 67dca3fd-4bba-447a-9af9-0aacf1dd5451] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:15.521298 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fdaffb1e-f783-4ae6-ae0f-46b0799cc36b tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:15.522043 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fdaffb1e-f783-4ae6-ae0f-46b0799cc36b tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:15.522633 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fdaffb1e-f783-4ae6-ae0f-46b0799cc36b tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:15.523518 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fdaffb1e-f783-4ae6-ae0f-46b0799cc36b tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:15.524239 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fdaffb1e-f783-4ae6-ae0f-46b0799cc36b tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:15.525236 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fdaffb1e-f783-4ae6-ae0f-46b0799cc36b tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:15.570366 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ed917f3a-dfb7-4146-ba65-0ae267e4da96 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:15.572594 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ed917f3a-dfb7-4146-ba65-0ae267e4da96 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] [instance: dd14c8d7-1064-4448-9bc3-ba8ab71031fe] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:15.588476 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed917f3a-dfb7-4146-ba65-0ae267e4da96 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:15.590707 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed917f3a-dfb7-4146-ba65-0ae267e4da96 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:15.591498 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed917f3a-dfb7-4146-ba65-0ae267e4da96 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:15.593596 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed917f3a-dfb7-4146-ba65-0ae267e4da96 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:15.594235 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed917f3a-dfb7-4146-ba65-0ae267e4da96 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:15.594871 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed917f3a-dfb7-4146-ba65-0ae267e4da96 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:15.691934 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ed917f3a-dfb7-4146-ba65-0ae267e4da96 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9770721b674c489e0491156a7c5efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c65adcd147ba95df7ec8d6b8fb10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:15.704094 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ed917f3a-dfb7-4146-ba65-0ae267e4da96 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] 10.222.0.27 "GET /compute/v2.1/servers/dd14c8d7-1064-4448-9bc3-ba8ab71031fe" status: 200 len: 1311 microversion: 2.1 time: 0.140154 Sep 08 11:15:15.705919 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3004/5887] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:15 2022] GET /compute/v2.1/servers/dd14c8d7-1064-4448-9bc3-ba8ab71031fe => generated 1311 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:15:15.942209 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fdaffb1e-f783-4ae6-ae0f-46b0799cc36b tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.436351 Sep 08 11:15:15.945743 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2884/5888] 10.222.0.27 () {60 vars in 1316 bytes} [Thu Sep 8 11:15:15 2022] GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451/os-interface => generated 285 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 11:15:16.732550 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8abbbddd-e6ae-4b5a-b5bb-ae5e1c51f0d2 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:16.733714 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8abbbddd-e6ae-4b5a-b5bb-ae5e1c51f0d2 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] [instance: dd14c8d7-1064-4448-9bc3-ba8ab71031fe] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:16.771247 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8abbbddd-e6ae-4b5a-b5bb-ae5e1c51f0d2 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:16.772603 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8abbbddd-e6ae-4b5a-b5bb-ae5e1c51f0d2 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:16.773266 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8abbbddd-e6ae-4b5a-b5bb-ae5e1c51f0d2 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:16.774209 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8abbbddd-e6ae-4b5a-b5bb-ae5e1c51f0d2 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:16.775552 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8abbbddd-e6ae-4b5a-b5bb-ae5e1c51f0d2 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:16.776444 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8abbbddd-e6ae-4b5a-b5bb-ae5e1c51f0d2 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:16.968297 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8abbbddd-e6ae-4b5a-b5bb-ae5e1c51f0d2 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9770721b674c489e0491156a7c5efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c65adcd147ba95df7ec8d6b8fb10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:16.977705 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8abbbddd-e6ae-4b5a-b5bb-ae5e1c51f0d2 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] 10.222.0.27 "GET /compute/v2.1/servers/dd14c8d7-1064-4448-9bc3-ba8ab71031fe" status: 200 len: 1299 microversion: 2.1 time: 0.253021 Sep 08 11:15:16.979629 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3005/5889] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:16 2022] GET /compute/v2.1/servers/dd14c8d7-1064-4448-9bc3-ba8ab71031fe => generated 1299 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:15:17.735548 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-b60a9c64-42cc-418a-8905-912012556a2a req-40cf71aa-0fb8-4420-8762-31ae5cbcd549 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67dca3fd-4bba-447a-9af9-0aacf1dd5451", "tag": "242cd08b-a4b9-4348-bfc9-024fa3eaf821"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:15:17.759772 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b60a9c64-42cc-418a-8905-912012556a2a req-40cf71aa-0fb8-4420-8762-31ae5cbcd549 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:17.774185 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b60a9c64-42cc-418a-8905-912012556a2a req-40cf71aa-0fb8-4420-8762-31ae5cbcd549 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:17.775356 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b60a9c64-42cc-418a-8905-912012556a2a req-40cf71aa-0fb8-4420-8762-31ae5cbcd549 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:17.795504 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-b60a9c64-42cc-418a-8905-912012556a2a req-40cf71aa-0fb8-4420-8762-31ae5cbcd549 service nova] Creating event network-changed:242cd08b-a4b9-4348-bfc9-024fa3eaf821 for instance 67dca3fd-4bba-447a-9af9-0aacf1dd5451 on n-h2-850501-12 Sep 08 11:15:17.802025 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-b60a9c64-42cc-418a-8905-912012556a2a req-40cf71aa-0fb8-4420-8762-31ae5cbcd549 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.295065 Sep 08 11:15:17.804078 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2885/5890] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:15:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:15:18.013711 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f8e6a656-84b2-4c3d-96f6-2ababc7c6c2e tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:18.014356 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f8e6a656-84b2-4c3d-96f6-2ababc7c6c2e tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] [instance: dd14c8d7-1064-4448-9bc3-ba8ab71031fe] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:18.028065 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f8e6a656-84b2-4c3d-96f6-2ababc7c6c2e tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:18.033350 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f8e6a656-84b2-4c3d-96f6-2ababc7c6c2e tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:18.038295 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f8e6a656-84b2-4c3d-96f6-2ababc7c6c2e tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:18.039344 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f8e6a656-84b2-4c3d-96f6-2ababc7c6c2e tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:18.041682 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f8e6a656-84b2-4c3d-96f6-2ababc7c6c2e tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:18.042344 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f8e6a656-84b2-4c3d-96f6-2ababc7c6c2e tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:18.417450 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f8e6a656-84b2-4c3d-96f6-2ababc7c6c2e tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9770721b674c489e0491156a7c5efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c65adcd147ba95df7ec8d6b8fb10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:18.431784 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f8e6a656-84b2-4c3d-96f6-2ababc7c6c2e tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] 10.222.0.27 "GET /compute/v2.1/servers/dd14c8d7-1064-4448-9bc3-ba8ab71031fe" status: 200 len: 1299 microversion: 2.1 time: 0.426357 Sep 08 11:15:18.433789 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3006/5891] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:18 2022] GET /compute/v2.1/servers/dd14c8d7-1064-4448-9bc3-ba8ab71031fe => generated 1299 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:15:19.456527 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4aff037c-d80b-4a2f-81a7-0fbaba88296b tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:19.457954 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4aff037c-d80b-4a2f-81a7-0fbaba88296b tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] [instance: dd14c8d7-1064-4448-9bc3-ba8ab71031fe] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:19.493946 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4aff037c-d80b-4a2f-81a7-0fbaba88296b tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:19.495145 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4aff037c-d80b-4a2f-81a7-0fbaba88296b tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:19.495844 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4aff037c-d80b-4a2f-81a7-0fbaba88296b tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:19.496957 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4aff037c-d80b-4a2f-81a7-0fbaba88296b tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:19.497686 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4aff037c-d80b-4a2f-81a7-0fbaba88296b tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:19.498332 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4aff037c-d80b-4a2f-81a7-0fbaba88296b tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:19.674381 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6a66b108-7767-4be8-b74a-dcb2bcd5a915 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '.version_select at 0x7f68e456c0d0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:19.721237 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6a66b108-7767-4be8-b74a-dcb2bcd5a915 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-809851702" status: 202 len: 0 microversion: 2.1 time: 0.056890 Sep 08 11:15:19.728457 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3007/5892] 10.222.0.27 () {58 vars in 1281 bytes} [Thu Sep 8 11:15:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-809851702 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:15:19.785288 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-68180c9f-6ce3-4966-83ec-b6762ed816ca tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Action: 'create', calling method: .version_select at 0x7f68e40e68b0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1326606544", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKjmuKSXbAnc5XyBLsB6olRTG3fFCgxU7OBQqON+7YvusI2suWNLi4M9Uf/iefsLNOe2LClHUKyVDZOwiI2/6IWkKb67fcww0OeL2A1X/YiOKzluAB3Xo11KLBndfAu9w=="}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:15:19.807736 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-68180c9f-6ce3-4966-83ec-b6762ed816ca tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Getting quotas for project a0f9071124e74802a2f76cb326ca58df. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:15:19.816016 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-68180c9f-6ce3-4966-83ec-b6762ed816ca tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Getting quotas for user c33e91fa4e3746aa8d8d23940e17bc1e and project a0f9071124e74802a2f76cb326ca58df. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:15:19.845206 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-68180c9f-6ce3-4966-83ec-b6762ed816ca tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.081609 Sep 08 11:15:19.854276 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3008/5893] 10.222.0.27 () {60 vars in 1159 bytes} [Thu Sep 8 11:15:19 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:15:20.006795 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4aff037c-d80b-4a2f-81a7-0fbaba88296b tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9770721b674c489e0491156a7c5efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c65adcd147ba95df7ec8d6b8fb10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:20.024073 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4aff037c-d80b-4a2f-81a7-0fbaba88296b tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] 10.222.0.27 "GET /compute/v2.1/servers/dd14c8d7-1064-4448-9bc3-ba8ab71031fe" status: 200 len: 1299 microversion: 2.1 time: 0.572122 Sep 08 11:15:20.025588 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2886/5894] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:19 2022] GET /compute/v2.1/servers/dd14c8d7-1064-4448-9bc3-ba8ab71031fe => generated 1299 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:15:21.054644 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d5298c2b-c83a-4215-b001-ae35f0fe9dd3 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:21.056121 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d5298c2b-c83a-4215-b001-ae35f0fe9dd3 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] [instance: dd14c8d7-1064-4448-9bc3-ba8ab71031fe] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:21.075902 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d5298c2b-c83a-4215-b001-ae35f0fe9dd3 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:21.076751 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d5298c2b-c83a-4215-b001-ae35f0fe9dd3 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:21.078062 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d5298c2b-c83a-4215-b001-ae35f0fe9dd3 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:21.079733 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d5298c2b-c83a-4215-b001-ae35f0fe9dd3 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:21.080605 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d5298c2b-c83a-4215-b001-ae35f0fe9dd3 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:21.081281 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d5298c2b-c83a-4215-b001-ae35f0fe9dd3 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:21.396401 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d5298c2b-c83a-4215-b001-ae35f0fe9dd3 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9770721b674c489e0491156a7c5efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c65adcd147ba95df7ec8d6b8fb10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:21.425122 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d5298c2b-c83a-4215-b001-ae35f0fe9dd3 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] 10.222.0.27 "GET /compute/v2.1/servers/dd14c8d7-1064-4448-9bc3-ba8ab71031fe" status: 200 len: 1299 microversion: 2.1 time: 0.376795 Sep 08 11:15:21.426311 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3009/5895] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:21 2022] GET /compute/v2.1/servers/dd14c8d7-1064-4448-9bc3-ba8ab71031fe => generated 1299 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:15:21.706466 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dd6db12f-616e-4eb1-91a7-e3530fc44203 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:21.707567 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-dd6db12f-616e-4eb1-91a7-e3530fc44203 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: a13b5e51-8a1d-4cb4-9485-a183b5a20c8d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:21.732246 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd6db12f-616e-4eb1-91a7-e3530fc44203 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:21.733140 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd6db12f-616e-4eb1-91a7-e3530fc44203 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:21.733713 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd6db12f-616e-4eb1-91a7-e3530fc44203 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:21.734582 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd6db12f-616e-4eb1-91a7-e3530fc44203 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:21.737794 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd6db12f-616e-4eb1-91a7-e3530fc44203 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:21.738680 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd6db12f-616e-4eb1-91a7-e3530fc44203 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:21.877269 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-dd6db12f-616e-4eb1-91a7-e3530fc44203 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lazy-loading 'services' on Instance uuid a13b5e51-8a1d-4cb4-9485-a183b5a20c8d {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:15:22.014992 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-dd6db12f-616e-4eb1-91a7-e3530fc44203 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d/os-volume_attachments/1f916d29-5245-4331-9d71-68b18700d6dd" status: 202 len: 0 microversion: 2.1 time: 0.316831 Sep 08 11:15:22.016183 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2887/5896] 10.222.0.27 () {58 vars in 1416 bytes} [Thu Sep 8 11:15:21 2022] DELETE /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d/os-volume_attachments/1f916d29-5245-4331-9d71-68b18700d6dd => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:15:22.069344 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-9f9f3464-a78b-4dba-b361-570a4a0b9e53 req-d2220fd4-e217-47ea-ac63-5632ae6dba8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd14c8d7-1064-4448-9bc3-ba8ab71031fe", "tag": "a46e84f6-9235-45dd-a323-280cb5595b34"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:15:22.104045 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-9f9f3464-a78b-4dba-b361-570a4a0b9e53 req-d2220fd4-e217-47ea-ac63-5632ae6dba8c service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:22.108091 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-9f9f3464-a78b-4dba-b361-570a4a0b9e53 req-d2220fd4-e217-47ea-ac63-5632ae6dba8c service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:22.110313 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-9f9f3464-a78b-4dba-b361-570a4a0b9e53 req-d2220fd4-e217-47ea-ac63-5632ae6dba8c service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:22.145816 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-9f9f3464-a78b-4dba-b361-570a4a0b9e53 req-d2220fd4-e217-47ea-ac63-5632ae6dba8c service nova] Creating event network-changed:a46e84f6-9235-45dd-a323-280cb5595b34 for instance dd14c8d7-1064-4448-9bc3-ba8ab71031fe on n-h1-850501-12 Sep 08 11:15:22.158955 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-9f9f3464-a78b-4dba-b361-570a4a0b9e53 req-d2220fd4-e217-47ea-ac63-5632ae6dba8c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095067 Sep 08 11:15:22.160706 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3010/5897] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:15:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:15:22.458544 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-687fcbaf-afd7-4781-a91c-3600cca672d1 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:22.459597 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-687fcbaf-afd7-4781-a91c-3600cca672d1 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] [instance: dd14c8d7-1064-4448-9bc3-ba8ab71031fe] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:22.483518 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-687fcbaf-afd7-4781-a91c-3600cca672d1 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:22.484389 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-687fcbaf-afd7-4781-a91c-3600cca672d1 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:22.485093 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-687fcbaf-afd7-4781-a91c-3600cca672d1 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:22.486079 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-687fcbaf-afd7-4781-a91c-3600cca672d1 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:22.486768 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-687fcbaf-afd7-4781-a91c-3600cca672d1 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:22.487401 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-687fcbaf-afd7-4781-a91c-3600cca672d1 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:22.811820 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-687fcbaf-afd7-4781-a91c-3600cca672d1 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9770721b674c489e0491156a7c5efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c65adcd147ba95df7ec8d6b8fb10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:22.826733 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-687fcbaf-afd7-4781-a91c-3600cca672d1 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] 10.222.0.27 "GET /compute/v2.1/servers/dd14c8d7-1064-4448-9bc3-ba8ab71031fe" status: 200 len: 1299 microversion: 2.1 time: 0.371523 Sep 08 11:15:22.828931 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2888/5898] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:22 2022] GET /compute/v2.1/servers/dd14c8d7-1064-4448-9bc3-ba8ab71031fe => generated 1299 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:15:23.858392 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b11ca1c4-0b5d-4f54-9c1f-95c062df86a1 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:23.859215 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b11ca1c4-0b5d-4f54-9c1f-95c062df86a1 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] [instance: dd14c8d7-1064-4448-9bc3-ba8ab71031fe] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:23.865562 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:15:23.895236 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b11ca1c4-0b5d-4f54-9c1f-95c062df86a1 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:23.900368 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b11ca1c4-0b5d-4f54-9c1f-95c062df86a1 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:23.900841 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b11ca1c4-0b5d-4f54-9c1f-95c062df86a1 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:23.902211 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b11ca1c4-0b5d-4f54-9c1f-95c062df86a1 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:23.902841 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b11ca1c4-0b5d-4f54-9c1f-95c062df86a1 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:23.903583 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b11ca1c4-0b5d-4f54-9c1f-95c062df86a1 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:24.163508 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b11ca1c4-0b5d-4f54-9c1f-95c062df86a1 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9770721b674c489e0491156a7c5efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c65adcd147ba95df7ec8d6b8fb10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:24.200220 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b11ca1c4-0b5d-4f54-9c1f-95c062df86a1 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] 10.222.0.27 "GET /compute/v2.1/servers/dd14c8d7-1064-4448-9bc3-ba8ab71031fe" status: 200 len: 1299 microversion: 2.1 time: 0.346708 Sep 08 11:15:24.217822 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3011/5899] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:23 2022] GET /compute/v2.1/servers/dd14c8d7-1064-4448-9bc3-ba8ab71031fe => generated 1299 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:15:25.232698 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d8b6f880-f523-4b4c-952b-64567262f9a6 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:25.233735 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d8b6f880-f523-4b4c-952b-64567262f9a6 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] [instance: dd14c8d7-1064-4448-9bc3-ba8ab71031fe] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:25.236872 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:15:25.245221 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d8b6f880-f523-4b4c-952b-64567262f9a6 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:25.246281 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d8b6f880-f523-4b4c-952b-64567262f9a6 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:25.246926 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d8b6f880-f523-4b4c-952b-64567262f9a6 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:25.247889 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d8b6f880-f523-4b4c-952b-64567262f9a6 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:25.248606 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d8b6f880-f523-4b4c-952b-64567262f9a6 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:25.249272 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d8b6f880-f523-4b4c-952b-64567262f9a6 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:25.783295 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d8b6f880-f523-4b4c-952b-64567262f9a6 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9770721b674c489e0491156a7c5efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c65adcd147ba95df7ec8d6b8fb10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:25.796552 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d8b6f880-f523-4b4c-952b-64567262f9a6 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] 10.222.0.27 "GET /compute/v2.1/servers/dd14c8d7-1064-4448-9bc3-ba8ab71031fe" status: 200 len: 1299 microversion: 2.1 time: 0.573935 Sep 08 11:15:25.801672 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2889/5900] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:25 2022] GET /compute/v2.1/servers/dd14c8d7-1064-4448-9bc3-ba8ab71031fe => generated 1299 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:15:26.828203 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-44f7d065-a0b2-4eb9-bcdb-0ad4045b9b2a tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:26.829557 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-44f7d065-a0b2-4eb9-bcdb-0ad4045b9b2a tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] [instance: dd14c8d7-1064-4448-9bc3-ba8ab71031fe] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:26.884633 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-44f7d065-a0b2-4eb9-bcdb-0ad4045b9b2a tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:26.884633 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-44f7d065-a0b2-4eb9-bcdb-0ad4045b9b2a tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:26.886804 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-44f7d065-a0b2-4eb9-bcdb-0ad4045b9b2a tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:26.887796 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-44f7d065-a0b2-4eb9-bcdb-0ad4045b9b2a tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:26.888407 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-44f7d065-a0b2-4eb9-bcdb-0ad4045b9b2a tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:26.888981 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-44f7d065-a0b2-4eb9-bcdb-0ad4045b9b2a tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:27.006949 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-44f7d065-a0b2-4eb9-bcdb-0ad4045b9b2a tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9770721b674c489e0491156a7c5efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c65adcd147ba95df7ec8d6b8fb10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:27.031031 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-44f7d065-a0b2-4eb9-bcdb-0ad4045b9b2a tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] 10.222.0.27 "GET /compute/v2.1/servers/dd14c8d7-1064-4448-9bc3-ba8ab71031fe" status: 200 len: 1299 microversion: 2.1 time: 0.206923 Sep 08 11:15:27.034146 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3012/5901] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:26 2022] GET /compute/v2.1/servers/dd14c8d7-1064-4448-9bc3-ba8ab71031fe => generated 1299 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:15:28.063445 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6484da37-f3de-4eb0-a840-ac3a2ee99427 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:28.064448 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6484da37-f3de-4eb0-a840-ac3a2ee99427 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] [instance: dd14c8d7-1064-4448-9bc3-ba8ab71031fe] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:28.067854 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=4 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:15:28.100012 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6484da37-f3de-4eb0-a840-ac3a2ee99427 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:28.100905 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6484da37-f3de-4eb0-a840-ac3a2ee99427 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:28.102305 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6484da37-f3de-4eb0-a840-ac3a2ee99427 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:28.103457 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6484da37-f3de-4eb0-a840-ac3a2ee99427 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:28.104066 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6484da37-f3de-4eb0-a840-ac3a2ee99427 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:28.104645 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6484da37-f3de-4eb0-a840-ac3a2ee99427 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:28.482389 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6484da37-f3de-4eb0-a840-ac3a2ee99427 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9770721b674c489e0491156a7c5efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c65adcd147ba95df7ec8d6b8fb10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:28.495264 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6484da37-f3de-4eb0-a840-ac3a2ee99427 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] 10.222.0.27 "GET /compute/v2.1/servers/dd14c8d7-1064-4448-9bc3-ba8ab71031fe" status: 200 len: 1299 microversion: 2.1 time: 0.433214 Sep 08 11:15:28.495904 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2890/5902] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:28 2022] GET /compute/v2.1/servers/dd14c8d7-1064-4448-9bc3-ba8ab71031fe => generated 1299 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:15:29.164929 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-d3a9cc67-026d-4253-9ded-604c06bacfd7 req-62b80ed2-2554-4285-be8d-779f2c73fe68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd14c8d7-1064-4448-9bc3-ba8ab71031fe", "name": "network-vif-plugged", "status": "completed", "tag": "a46e84f6-9235-45dd-a323-280cb5595b34"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:15:29.205070 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-d3a9cc67-026d-4253-9ded-604c06bacfd7 req-62b80ed2-2554-4285-be8d-779f2c73fe68 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:29.209516 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-d3a9cc67-026d-4253-9ded-604c06bacfd7 req-62b80ed2-2554-4285-be8d-779f2c73fe68 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:29.210117 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-d3a9cc67-026d-4253-9ded-604c06bacfd7 req-62b80ed2-2554-4285-be8d-779f2c73fe68 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:29.287828 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-d3a9cc67-026d-4253-9ded-604c06bacfd7 req-62b80ed2-2554-4285-be8d-779f2c73fe68 service nova] Creating event network-vif-plugged:a46e84f6-9235-45dd-a323-280cb5595b34 for instance dd14c8d7-1064-4448-9bc3-ba8ab71031fe on n-h1-850501-12 Sep 08 11:15:29.311594 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-d3a9cc67-026d-4253-9ded-604c06bacfd7 req-62b80ed2-2554-4285-be8d-779f2c73fe68 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151215 Sep 08 11:15:29.313682 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3013/5903] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:15:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:15:29.519663 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-14ae1684-9fbc-41bd-939e-b4fceff41029 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:29.521013 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-14ae1684-9fbc-41bd-939e-b4fceff41029 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] [instance: dd14c8d7-1064-4448-9bc3-ba8ab71031fe] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:29.540966 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-14ae1684-9fbc-41bd-939e-b4fceff41029 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:29.541504 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-14ae1684-9fbc-41bd-939e-b4fceff41029 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:29.548945 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-14ae1684-9fbc-41bd-939e-b4fceff41029 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:29.549805 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-14ae1684-9fbc-41bd-939e-b4fceff41029 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:29.552702 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-14ae1684-9fbc-41bd-939e-b4fceff41029 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:29.553185 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-14ae1684-9fbc-41bd-939e-b4fceff41029 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:30.221338 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-14ae1684-9fbc-41bd-939e-b4fceff41029 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9770721b674c489e0491156a7c5efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c65adcd147ba95df7ec8d6b8fb10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:30.230586 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-14ae1684-9fbc-41bd-939e-b4fceff41029 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] 10.222.0.27 "GET /compute/v2.1/servers/dd14c8d7-1064-4448-9bc3-ba8ab71031fe" status: 200 len: 1299 microversion: 2.1 time: 0.715238 Sep 08 11:15:30.231186 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2891/5904] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:29 2022] GET /compute/v2.1/servers/dd14c8d7-1064-4448-9bc3-ba8ab71031fe => generated 1299 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:15:31.262818 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=10 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:15:31.270491 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-624b576e-5964-4661-ab89-abac6313d9ad tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:31.271735 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-624b576e-5964-4661-ab89-abac6313d9ad tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] [instance: dd14c8d7-1064-4448-9bc3-ba8ab71031fe] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:31.301705 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-624b576e-5964-4661-ab89-abac6313d9ad tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:31.309819 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-624b576e-5964-4661-ab89-abac6313d9ad tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:31.310517 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-624b576e-5964-4661-ab89-abac6313d9ad tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:31.311433 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-624b576e-5964-4661-ab89-abac6313d9ad tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:31.312061 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-624b576e-5964-4661-ab89-abac6313d9ad tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:31.312649 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-624b576e-5964-4661-ab89-abac6313d9ad tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:31.622315 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-624b576e-5964-4661-ab89-abac6313d9ad tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9770721b674c489e0491156a7c5efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c65adcd147ba95df7ec8d6b8fb10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:31.648023 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-624b576e-5964-4661-ab89-abac6313d9ad tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] 10.222.0.27 "GET /compute/v2.1/servers/dd14c8d7-1064-4448-9bc3-ba8ab71031fe" status: 200 len: 1472 microversion: 2.1 time: 0.386060 Sep 08 11:15:31.656084 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3014/5905] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:31 2022] GET /compute/v2.1/servers/dd14c8d7-1064-4448-9bc3-ba8ab71031fe => generated 1472 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:15:31.685790 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0be146a8-cadb-410f-aaf9-4eadf8b06696 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:31.686842 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0be146a8-cadb-410f-aaf9-4eadf8b06696 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] [instance: dd14c8d7-1064-4448-9bc3-ba8ab71031fe] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:31.708557 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0be146a8-cadb-410f-aaf9-4eadf8b06696 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:31.709428 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0be146a8-cadb-410f-aaf9-4eadf8b06696 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:31.716395 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0be146a8-cadb-410f-aaf9-4eadf8b06696 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:31.717539 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0be146a8-cadb-410f-aaf9-4eadf8b06696 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:31.718145 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0be146a8-cadb-410f-aaf9-4eadf8b06696 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:31.718698 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0be146a8-cadb-410f-aaf9-4eadf8b06696 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:32.354169 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0be146a8-cadb-410f-aaf9-4eadf8b06696 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9770721b674c489e0491156a7c5efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c65adcd147ba95df7ec8d6b8fb10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:32.370827 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4d43ebcc-0779-4d4b-83ff-21298247031c tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:15:32.382101 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4d43ebcc-0779-4d4b-83ff-21298247031c tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:32.383141 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4d43ebcc-0779-4d4b-83ff-21298247031c tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:32.386481 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0be146a8-cadb-410f-aaf9-4eadf8b06696 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] 10.222.0.27 "GET /compute/v2.1/servers/dd14c8d7-1064-4448-9bc3-ba8ab71031fe" status: 200 len: 1472 microversion: 2.1 time: 0.709626 Sep 08 11:15:32.387101 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2892/5906] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:31 2022] GET /compute/v2.1/servers/dd14c8d7-1064-4448-9bc3-ba8ab71031fe => generated 1472 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:15:32.387250 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4d43ebcc-0779-4d4b-83ff-21298247031c tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:32.412733 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-59f9604b-6337-4bc6-b709-60ab6235b5eb tempest-TestSecurityGroupsBasicOps-2057170618 tempest-TestSecurityGroupsBasicOps-2057170618-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:32.413773 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-59f9604b-6337-4bc6-b709-60ab6235b5eb tempest-TestSecurityGroupsBasicOps-2057170618 tempest-TestSecurityGroupsBasicOps-2057170618-project-admin] [instance: dd14c8d7-1064-4448-9bc3-ba8ab71031fe] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:32.424834 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-59f9604b-6337-4bc6-b709-60ab6235b5eb tempest-TestSecurityGroupsBasicOps-2057170618 tempest-TestSecurityGroupsBasicOps-2057170618-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:32.425622 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-59f9604b-6337-4bc6-b709-60ab6235b5eb tempest-TestSecurityGroupsBasicOps-2057170618 tempest-TestSecurityGroupsBasicOps-2057170618-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:32.426515 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-59f9604b-6337-4bc6-b709-60ab6235b5eb tempest-TestSecurityGroupsBasicOps-2057170618 tempest-TestSecurityGroupsBasicOps-2057170618-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:32.427551 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-59f9604b-6337-4bc6-b709-60ab6235b5eb tempest-TestSecurityGroupsBasicOps-2057170618 tempest-TestSecurityGroupsBasicOps-2057170618-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:32.428230 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-59f9604b-6337-4bc6-b709-60ab6235b5eb tempest-TestSecurityGroupsBasicOps-2057170618 tempest-TestSecurityGroupsBasicOps-2057170618-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:32.428869 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-59f9604b-6337-4bc6-b709-60ab6235b5eb tempest-TestSecurityGroupsBasicOps-2057170618 tempest-TestSecurityGroupsBasicOps-2057170618-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:32.439463 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4d43ebcc-0779-4d4b-83ff-21298247031c tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: a13b5e51-8a1d-4cb4-9485-a183b5a20c8d] Going to try to stop instance {{(pid=128861) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 08 11:15:32.553203 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4d43ebcc-0779-4d4b-83ff-21298247031c tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "POST /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d/action" status: 202 len: 0 microversion: 2.1 time: 0.191405 Sep 08 11:15:32.574453 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3015/5907] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 11:15:32 2022] POST /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:15:32.599484 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-800b5a2e-1ff0-40c3-99e0-d976b7fc464f tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:32.604779 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-800b5a2e-1ff0-40c3-99e0-d976b7fc464f tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: a13b5e51-8a1d-4cb4-9485-a183b5a20c8d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:32.626149 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-800b5a2e-1ff0-40c3-99e0-d976b7fc464f tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:32.628825 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-800b5a2e-1ff0-40c3-99e0-d976b7fc464f tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:32.631029 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-800b5a2e-1ff0-40c3-99e0-d976b7fc464f tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:32.633615 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-800b5a2e-1ff0-40c3-99e0-d976b7fc464f tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:32.637403 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-800b5a2e-1ff0-40c3-99e0-d976b7fc464f tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:32.639464 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-800b5a2e-1ff0-40c3-99e0-d976b7fc464f tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:32.670450 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-59f9604b-6337-4bc6-b709-60ab6235b5eb tempest-TestSecurityGroupsBasicOps-2057170618 tempest-TestSecurityGroupsBasicOps-2057170618-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/dd14c8d7-1064-4448-9bc3-ba8ab71031fe" status: 200 len: 1625 microversion: 2.1 time: 0.261974 Sep 08 11:15:32.678970 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2893/5908] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:32 2022] GET /compute/v2.1/servers/dd14c8d7-1064-4448-9bc3-ba8ab71031fe => generated 1625 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:15:32.701073 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0f0e8ae9-7c03-4b51-be0d-85dc4ba68b79 tempest-TestSecurityGroupsBasicOps-2057170618 tempest-TestSecurityGroupsBasicOps-2057170618-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:32.708114 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0f0e8ae9-7c03-4b51-be0d-85dc4ba68b79 tempest-TestSecurityGroupsBasicOps-2057170618 tempest-TestSecurityGroupsBasicOps-2057170618-project-admin] [instance: 90938b52-4f78-45e5-aea8-4a74f5734b4a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:32.744415 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f0e8ae9-7c03-4b51-be0d-85dc4ba68b79 tempest-TestSecurityGroupsBasicOps-2057170618 tempest-TestSecurityGroupsBasicOps-2057170618-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:32.755865 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f0e8ae9-7c03-4b51-be0d-85dc4ba68b79 tempest-TestSecurityGroupsBasicOps-2057170618 tempest-TestSecurityGroupsBasicOps-2057170618-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:32.756708 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f0e8ae9-7c03-4b51-be0d-85dc4ba68b79 tempest-TestSecurityGroupsBasicOps-2057170618 tempest-TestSecurityGroupsBasicOps-2057170618-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:32.757661 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f0e8ae9-7c03-4b51-be0d-85dc4ba68b79 tempest-TestSecurityGroupsBasicOps-2057170618 tempest-TestSecurityGroupsBasicOps-2057170618-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:32.762288 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f0e8ae9-7c03-4b51-be0d-85dc4ba68b79 tempest-TestSecurityGroupsBasicOps-2057170618 tempest-TestSecurityGroupsBasicOps-2057170618-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:32.764399 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f0e8ae9-7c03-4b51-be0d-85dc4ba68b79 tempest-TestSecurityGroupsBasicOps-2057170618 tempest-TestSecurityGroupsBasicOps-2057170618-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:33.573605 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-800b5a2e-1ff0-40c3-99e0-d976b7fc464f tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bdfecc6c7a43608095044b0174b48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfe795da0e4988a50c38f19200ea7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:33.589126 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-800b5a2e-1ff0-40c3-99e0-d976b7fc464f tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d" status: 200 len: 1677 microversion: 2.1 time: 1.010846 Sep 08 11:15:33.604573 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3016/5909] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:32 2022] GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d => generated 1677 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:15:33.735405 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0f0e8ae9-7c03-4b51-be0d-85dc4ba68b79 tempest-TestSecurityGroupsBasicOps-2057170618 tempest-TestSecurityGroupsBasicOps-2057170618-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/90938b52-4f78-45e5-aea8-4a74f5734b4a" status: 200 len: 1909 microversion: 2.1 time: 1.041155 Sep 08 11:15:33.737118 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2894/5910] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:32 2022] GET /compute/v2.1/servers/90938b52-4f78-45e5-aea8-4a74f5734b4a => generated 1909 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:15:33.957518 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8306cc15-b89b-402f-b1b7-ab43786c148d tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:33.960318 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8306cc15-b89b-402f-b1b7-ab43786c148d tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] [instance: dd14c8d7-1064-4448-9bc3-ba8ab71031fe] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:33.972832 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8306cc15-b89b-402f-b1b7-ab43786c148d tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:33.974009 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8306cc15-b89b-402f-b1b7-ab43786c148d tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:33.974704 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8306cc15-b89b-402f-b1b7-ab43786c148d tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:33.980002 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8306cc15-b89b-402f-b1b7-ab43786c148d tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:33.980875 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8306cc15-b89b-402f-b1b7-ab43786c148d tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:33.983269 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8306cc15-b89b-402f-b1b7-ab43786c148d tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:34.057216 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8306cc15-b89b-402f-b1b7-ab43786c148d tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] [instance: dd14c8d7-1064-4448-9bc3-ba8ab71031fe] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:15:34.271650 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8306cc15-b89b-402f-b1b7-ab43786c148d tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] 10.222.0.27 "DELETE /compute/v2.1/servers/dd14c8d7-1064-4448-9bc3-ba8ab71031fe" status: 204 len: 0 microversion: 2.1 time: 0.317719 Sep 08 11:15:34.272714 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3017/5911] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:15:33 2022] DELETE /compute/v2.1/servers/dd14c8d7-1064-4448-9bc3-ba8ab71031fe => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:15:34.283490 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-67b69d54-ea9a-4f70-a022-00ef266bb77d tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:34.284285 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-67b69d54-ea9a-4f70-a022-00ef266bb77d tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] [instance: dd14c8d7-1064-4448-9bc3-ba8ab71031fe] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:34.325384 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67b69d54-ea9a-4f70-a022-00ef266bb77d tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:34.326766 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67b69d54-ea9a-4f70-a022-00ef266bb77d tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:34.328950 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67b69d54-ea9a-4f70-a022-00ef266bb77d tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:34.333901 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67b69d54-ea9a-4f70-a022-00ef266bb77d tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:34.334416 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67b69d54-ea9a-4f70-a022-00ef266bb77d tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:34.338716 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67b69d54-ea9a-4f70-a022-00ef266bb77d tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:34.516540 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-dd3a849e-ebee-4be9-a167-e568f995a1f6 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-252028311", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "6bfc4fe3-4d7f-4a5e-b75c-3b24d0e72391"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1326606544", "security_groups": [{"name": "tempest-secgroup-smoke-1010894940"}]}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:15:34.664077 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-67b69d54-ea9a-4f70-a022-00ef266bb77d tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9770721b674c489e0491156a7c5efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c65adcd147ba95df7ec8d6b8fb10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:34.679130 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-67b69d54-ea9a-4f70-a022-00ef266bb77d tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] 10.222.0.27 "GET /compute/v2.1/servers/dd14c8d7-1064-4448-9bc3-ba8ab71031fe" status: 200 len: 1478 microversion: 2.1 time: 0.401141 Sep 08 11:15:34.691247 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2895/5912] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:34 2022] GET /compute/v2.1/servers/dd14c8d7-1064-4448-9bc3-ba8ab71031fe => generated 1478 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:15:34.707171 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e5fe8efc-1a4f-414c-99b1-41ed39d1ad23 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:34.708065 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e5fe8efc-1a4f-414c-99b1-41ed39d1ad23 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: a13b5e51-8a1d-4cb4-9485-a183b5a20c8d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:34.719837 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e5fe8efc-1a4f-414c-99b1-41ed39d1ad23 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:34.727180 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e5fe8efc-1a4f-414c-99b1-41ed39d1ad23 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:34.727903 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e5fe8efc-1a4f-414c-99b1-41ed39d1ad23 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:34.728683 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e5fe8efc-1a4f-414c-99b1-41ed39d1ad23 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:34.729200 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e5fe8efc-1a4f-414c-99b1-41ed39d1ad23 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:34.729629 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e5fe8efc-1a4f-414c-99b1-41ed39d1ad23 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:35.047802 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e5fe8efc-1a4f-414c-99b1-41ed39d1ad23 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bdfecc6c7a43608095044b0174b48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfe795da0e4988a50c38f19200ea7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:35.058179 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e5fe8efc-1a4f-414c-99b1-41ed39d1ad23 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d" status: 200 len: 1677 microversion: 2.1 time: 0.365484 Sep 08 11:15:35.078665 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2896/5913] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:34 2022] GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d => generated 1677 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:15:35.439432 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-dd3a849e-ebee-4be9-a167-e568f995a1f6 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] validate_networks() for [('6bfc4fe3-4d7f-4a5e-b75c-3b24d0e72391', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:15:35.728390 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6065f364-3da0-4169-bbb2-715e2228a2ff tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:35.729258 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6065f364-3da0-4169-bbb2-715e2228a2ff tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] [instance: dd14c8d7-1064-4448-9bc3-ba8ab71031fe] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:35.759558 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6065f364-3da0-4169-bbb2-715e2228a2ff tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:35.760065 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6065f364-3da0-4169-bbb2-715e2228a2ff tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:35.760506 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6065f364-3da0-4169-bbb2-715e2228a2ff tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:35.766202 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6065f364-3da0-4169-bbb2-715e2228a2ff tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:35.766820 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6065f364-3da0-4169-bbb2-715e2228a2ff tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:35.767439 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6065f364-3da0-4169-bbb2-715e2228a2ff tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:35.837295 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:15:36.044630 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6065f364-3da0-4169-bbb2-715e2228a2ff tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9770721b674c489e0491156a7c5efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c65adcd147ba95df7ec8d6b8fb10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:36.068212 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6065f364-3da0-4169-bbb2-715e2228a2ff tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] 10.222.0.27 "GET /compute/v2.1/servers/dd14c8d7-1064-4448-9bc3-ba8ab71031fe" status: 200 len: 1478 microversion: 2.1 time: 0.344087 Sep 08 11:15:36.089550 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2897/5914] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:35 2022] GET /compute/v2.1/servers/dd14c8d7-1064-4448-9bc3-ba8ab71031fe => generated 1478 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:15:36.396951 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-dd3a849e-ebee-4be9-a167-e568f995a1f6 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:15:36.397422 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-dd3a849e-ebee-4be9-a167-e568f995a1f6 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:15:36.400011 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-dd3a849e-ebee-4be9-a167-e568f995a1f6 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:15:36.400714 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-dd3a849e-ebee-4be9-a167-e568f995a1f6 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:15:36.400915 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-dd3a849e-ebee-4be9-a167-e568f995a1f6 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:15:36.421937 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd3a849e-ebee-4be9-a167-e568f995a1f6 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:36.422536 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd3a849e-ebee-4be9-a167-e568f995a1f6 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:36.425189 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd3a849e-ebee-4be9-a167-e568f995a1f6 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:36.427539 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd3a849e-ebee-4be9-a167-e568f995a1f6 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:36.428035 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd3a849e-ebee-4be9-a167-e568f995a1f6 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:36.428474 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd3a849e-ebee-4be9-a167-e568f995a1f6 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:36.496723 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-dd3a849e-ebee-4be9-a167-e568f995a1f6 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Getting quotas for project a0f9071124e74802a2f76cb326ca58df. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:15:36.516165 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-dd3a849e-ebee-4be9-a167-e568f995a1f6 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Getting quotas for user c33e91fa4e3746aa8d8d23940e17bc1e and project a0f9071124e74802a2f76cb326ca58df. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:15:36.537892 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4060562a-443b-481d-ae78-6d364a1e9b09 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Action: 'create', calling method: .version_select at 0x7f68df638550>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1946750982", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHU34PSSus0TEk2nDuj0Jf15a3U5Ye8OdxlInvTpNdvjbLSlIcon3TM1VxDVjSm7U/uBBwN2G0BXL51jcQjkV3aCKWQdka4ipn8xQ2IA+k5avEvNxh6KQr48d/f7bzfYpQ=="}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:15:36.550189 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-dd3a849e-ebee-4be9-a167-e568f995a1f6 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:15:36.558614 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-dd3a849e-ebee-4be9-a167-e568f995a1f6 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 85a3ba9d-cc78-422b-8327-4191b2067feb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:15:36.581731 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-4060562a-443b-481d-ae78-6d364a1e9b09 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Getting quotas for project 56f4fec1839448c28e7a0a3d16236ab6. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:15:36.587621 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-4060562a-443b-481d-ae78-6d364a1e9b09 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Getting quotas for user f9f3aa2815fd4dcc8767242bc5cd1c1d and project 56f4fec1839448c28e7a0a3d16236ab6. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:15:36.634447 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4060562a-443b-481d-ae78-6d364a1e9b09 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.555486 Sep 08 11:15:36.635305 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2898/5915] 10.222.0.27 () {60 vars in 1159 bytes} [Thu Sep 8 11:15:36 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:15:36.654451 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-29353cf8-6db3-4df8-9a7a-64d3181a509d tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:36.658622 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-29353cf8-6db3-4df8-9a7a-64d3181a509d tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: a13b5e51-8a1d-4cb4-9485-a183b5a20c8d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:36.691128 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-29353cf8-6db3-4df8-9a7a-64d3181a509d tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:36.692022 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-29353cf8-6db3-4df8-9a7a-64d3181a509d tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:36.693731 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-29353cf8-6db3-4df8-9a7a-64d3181a509d tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:36.700825 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-dd3a849e-ebee-4be9-a167-e568f995a1f6 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.193215 Sep 08 11:15:36.702051 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-29353cf8-6db3-4df8-9a7a-64d3181a509d tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:36.702647 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-29353cf8-6db3-4df8-9a7a-64d3181a509d tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:36.703187 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-29353cf8-6db3-4df8-9a7a-64d3181a509d tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:36.703647 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3018/5916] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 11:15:34 2022] POST /compute/v2.1/servers => generated 406 bytes in 2200 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:15:36.724074 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d7b2e77f-4a6a-4e6f-89e4-c0f105720cf5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:36.727060 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d7b2e77f-4a6a-4e6f-89e4-c0f105720cf5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 85a3ba9d-cc78-422b-8327-4191b2067feb] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:36.930628 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d7b2e77f-4a6a-4e6f-89e4-c0f105720cf5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:36.952120 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d7b2e77f-4a6a-4e6f-89e4-c0f105720cf5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb" status: 200 len: 1266 microversion: 2.1 time: 0.238214 Sep 08 11:15:36.955145 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3019/5917] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:36 2022] GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb => generated 1266 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:15:37.106014 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-76bc0abf-037d-4d91-a71f-68295af2f6f3 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:37.112035 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-76bc0abf-037d-4d91-a71f-68295af2f6f3 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] [instance: dd14c8d7-1064-4448-9bc3-ba8ab71031fe] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:37.179202 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:15:37.189550 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-76bc0abf-037d-4d91-a71f-68295af2f6f3 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:37.190069 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-76bc0abf-037d-4d91-a71f-68295af2f6f3 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:37.197873 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-76bc0abf-037d-4d91-a71f-68295af2f6f3 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:37.206558 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-76bc0abf-037d-4d91-a71f-68295af2f6f3 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:37.207105 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-76bc0abf-037d-4d91-a71f-68295af2f6f3 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:37.207614 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-76bc0abf-037d-4d91-a71f-68295af2f6f3 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:37.545969 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-76bc0abf-037d-4d91-a71f-68295af2f6f3 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9770721b674c489e0491156a7c5efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c65adcd147ba95df7ec8d6b8fb10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:37.576631 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-76bc0abf-037d-4d91-a71f-68295af2f6f3 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] 10.222.0.27 "GET /compute/v2.1/servers/dd14c8d7-1064-4448-9bc3-ba8ab71031fe" status: 200 len: 1478 microversion: 2.1 time: 0.458890 Sep 08 11:15:37.597858 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3020/5918] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:37 2022] GET /compute/v2.1/servers/dd14c8d7-1064-4448-9bc3-ba8ab71031fe => generated 1478 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:15:37.619939 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-da148cd0-0d7e-40ee-bbdb-83981a927d7f req-17de4c09-d843-4139-8a66-65a622a06adf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd14c8d7-1064-4448-9bc3-ba8ab71031fe", "name": "network-vif-deleted", "tag": "a46e84f6-9235-45dd-a323-280cb5595b34"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:15:37.672224 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-da148cd0-0d7e-40ee-bbdb-83981a927d7f req-17de4c09-d843-4139-8a66-65a622a06adf service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:37.672748 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-da148cd0-0d7e-40ee-bbdb-83981a927d7f req-17de4c09-d843-4139-8a66-65a622a06adf service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:37.673227 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-da148cd0-0d7e-40ee-bbdb-83981a927d7f req-17de4c09-d843-4139-8a66-65a622a06adf service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:37.708309 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-da148cd0-0d7e-40ee-bbdb-83981a927d7f req-17de4c09-d843-4139-8a66-65a622a06adf service nova] Creating event network-vif-deleted:a46e84f6-9235-45dd-a323-280cb5595b34 for instance dd14c8d7-1064-4448-9bc3-ba8ab71031fe on n-h1-850501-12 Sep 08 11:15:37.752430 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-da148cd0-0d7e-40ee-bbdb-83981a927d7f req-17de4c09-d843-4139-8a66-65a622a06adf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166682 Sep 08 11:15:37.761600 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3021/5919] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:15:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:15:37.792980 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-29353cf8-6db3-4df8-9a7a-64d3181a509d tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bdfecc6c7a43608095044b0174b48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfe795da0e4988a50c38f19200ea7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:37.806247 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-29353cf8-6db3-4df8-9a7a-64d3181a509d tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d" status: 200 len: 1677 microversion: 2.1 time: 1.169586 Sep 08 11:15:37.818800 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2899/5920] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:36 2022] GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d => generated 1677 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:15:37.992239 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3d04fb05-dfbb-4119-bba7-d306f2230304 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:37.993934 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3d04fb05-dfbb-4119-bba7-d306f2230304 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 85a3ba9d-cc78-422b-8327-4191b2067feb] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:38.016742 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3d04fb05-dfbb-4119-bba7-d306f2230304 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:38.018928 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3d04fb05-dfbb-4119-bba7-d306f2230304 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:38.019647 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3d04fb05-dfbb-4119-bba7-d306f2230304 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:38.026967 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3d04fb05-dfbb-4119-bba7-d306f2230304 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:38.029996 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3d04fb05-dfbb-4119-bba7-d306f2230304 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:38.035263 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3d04fb05-dfbb-4119-bba7-d306f2230304 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:38.160475 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-3d04fb05-dfbb-4119-bba7-d306f2230304 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:38.166262 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:15:38.177657 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3d04fb05-dfbb-4119-bba7-d306f2230304 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb" status: 200 len: 1270 microversion: 2.1 time: 0.196969 Sep 08 11:15:38.201885 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3022/5921] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:37 2022] GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb => generated 1270 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:15:38.605555 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-82fe0308-183a-416e-9231-db39c07f1dd9 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:38.607256 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-82fe0308-183a-416e-9231-db39c07f1dd9 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] [instance: dd14c8d7-1064-4448-9bc3-ba8ab71031fe] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:38.615542 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-82fe0308-183a-416e-9231-db39c07f1dd9 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:38.616047 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-82fe0308-183a-416e-9231-db39c07f1dd9 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:38.622130 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-82fe0308-183a-416e-9231-db39c07f1dd9 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:38.623004 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-82fe0308-183a-416e-9231-db39c07f1dd9 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:38.623494 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-82fe0308-183a-416e-9231-db39c07f1dd9 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:38.623947 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-82fe0308-183a-416e-9231-db39c07f1dd9 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:38.839524 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8051bbb2-bc91-47a1-8d22-af2345e29fc0 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:38.840892 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8051bbb2-bc91-47a1-8d22-af2345e29fc0 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: a13b5e51-8a1d-4cb4-9485-a183b5a20c8d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:38.863433 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8051bbb2-bc91-47a1-8d22-af2345e29fc0 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:38.868530 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8051bbb2-bc91-47a1-8d22-af2345e29fc0 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:38.869853 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8051bbb2-bc91-47a1-8d22-af2345e29fc0 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:38.872365 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8051bbb2-bc91-47a1-8d22-af2345e29fc0 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:38.873128 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8051bbb2-bc91-47a1-8d22-af2345e29fc0 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:38.875266 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8051bbb2-bc91-47a1-8d22-af2345e29fc0 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:39.087977 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-82fe0308-183a-416e-9231-db39c07f1dd9 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] HTTP exception thrown: Instance dd14c8d7-1064-4448-9bc3-ba8ab71031fe could not be found. Sep 08 11:15:39.090540 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-82fe0308-183a-416e-9231-db39c07f1dd9 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Request method failure captured: Sep 08 11:15:39.090540 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/dd14c8d7-1064-4448-9bc3-ba8ab71031fe HTTP/1.1 Sep 08 11:15:39.090540 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 11:15:39.090540 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 11:15:39.090540 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 11:15:39.090540 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 11:15:39.090540 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 11:15:39.090540 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 11:15:39.090540 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 11:15:39.090540 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 11:15:39.090540 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGc5o1e1xGxIyWIwCP8NAVSlptSa6tbrwmvIIjejVBcCs-tnfKQ3WwCQ1Pxa0zeoDXBtiyKYm9_7392jHbxZHaLYfIPudD0vTcWx9gHb8ZyQ9AW6TqW5ewtMUjeD8b0G7SNTyDnN-mU5dfh48q9-unMT3gfusabEMZB-7RIvCnd6iP60 Sep 08 11:15:39.090540 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 11:15:39.090540 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 11:15:39.090540 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 11:15:39.090540 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 11:15:39.090540 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 11:15:39.090540 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 11:15:39.090540 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 8309c65adcd147ba95df7ec8d6b8fb10 Sep 08 11:15:39.090540 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-970312101 Sep 08 11:15:39.090540 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 11:15:39.090540 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 11:15:39.090540 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8309c65adcd147ba95df7ec8d6b8fb10"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8309c65adcd147ba95df7ec8d6b8fb10"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8309c65adcd147ba95df7ec8d6b8fb10"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8309c65adcd147ba95df7ec8d6b8fb10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:15:39.090540 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-TestSecurityGroupsBasicOps-970312101 Sep 08 11:15:39.090540 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 8309c65adcd147ba95df7ec8d6b8fb10 Sep 08 11:15:39.090540 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-970312101 Sep 08 11:15:39.090540 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-TestSecurityGroupsBasicOps-970312101-project Sep 08 11:15:39.090540 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 11:15:39.090540 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 11:15:39.090540 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 7d9770721b674c489e0491156a7c5efc Sep 08 11:15:39.090540 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-TestSecurityGroupsBasicOps-970312101-project Sep 08 11:15:39.090540 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 11:15:39.090540 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance dd14c8d7-1064-4448-9bc3-ba8ab71031fe could not be found. Sep 08 11:15:39.090540 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'dd14c8d7-1064-4448-9bc3-ba8ab71031fe'} Sep 08 11:15:39.090540 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:15:39.090540 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:15:39.090540 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:15:39.090540 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:15:39.090540 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:15:39.090540 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:15:39.090540 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:15:39.090540 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:15:39.090540 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:15:39.090540 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:15:39.090540 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd14c8d7-1064-4448-9bc3-ba8ab71031fe could not be found. Sep 08 11:15:39.090540 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:15:39.090540 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:15:39.090540 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:15:39.090540 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:15:39.090540 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:15:39.090540 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:15:39.090540 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:15:39.090540 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:15:39.090540 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:15:39.090540 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:15:39.090540 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:15:39.090540 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:15:39.090540 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:15:39.090540 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:15:39.090540 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:15:39.090540 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:15:39.090540 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd14c8d7-1064-4448-9bc3-ba8ab71031fe could not be found. Sep 08 11:15:39.090540 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:15:39.090540 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:15:39.090540 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:15:39.094425 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:15:39.094425 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:15:39.094425 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:15:39.094425 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:15:39.094425 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:15:39.094425 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd14c8d7-1064-4448-9bc3-ba8ab71031fe could not be found. Sep 08 11:15:39.094425 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:15:39.095799 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-82fe0308-183a-416e-9231-db39c07f1dd9 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Returning 404 to user: Instance dd14c8d7-1064-4448-9bc3-ba8ab71031fe could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:15:39.097045 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-82fe0308-183a-416e-9231-db39c07f1dd9 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] 10.222.0.27 "GET /compute/v2.1/servers/dd14c8d7-1064-4448-9bc3-ba8ab71031fe" status: 404 len: 111 microversion: 2.1 time: 0.496560 Sep 08 11:15:39.098186 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2900/5922] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:38 2022] GET /compute/v2.1/servers/dd14c8d7-1064-4448-9bc3-ba8ab71031fe => generated 111 bytes in 498 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:15:39.204104 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-386066b4-e95b-4f06-aabd-68838d33c6ab tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:39.204894 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-386066b4-e95b-4f06-aabd-68838d33c6ab tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 85a3ba9d-cc78-422b-8327-4191b2067feb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:39.240425 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-386066b4-e95b-4f06-aabd-68838d33c6ab tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:39.240988 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-386066b4-e95b-4f06-aabd-68838d33c6ab tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:39.241544 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-386066b4-e95b-4f06-aabd-68838d33c6ab tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:39.250256 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-386066b4-e95b-4f06-aabd-68838d33c6ab tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:39.251262 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-386066b4-e95b-4f06-aabd-68838d33c6ab tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:39.251877 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-386066b4-e95b-4f06-aabd-68838d33c6ab tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:39.402375 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8051bbb2-bc91-47a1-8d22-af2345e29fc0 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bdfecc6c7a43608095044b0174b48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfe795da0e4988a50c38f19200ea7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:39.413997 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8051bbb2-bc91-47a1-8d22-af2345e29fc0 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d" status: 200 len: 1677 microversion: 2.1 time: 0.579789 Sep 08 11:15:39.414807 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3023/5923] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:38 2022] GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d => generated 1677 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:15:39.520057 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-386066b4-e95b-4f06-aabd-68838d33c6ab tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:39.532320 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-386066b4-e95b-4f06-aabd-68838d33c6ab tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb" status: 200 len: 1326 microversion: 2.1 time: 0.331555 Sep 08 11:15:39.532917 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2901/5924] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:39 2022] GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb => generated 1326 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:15:39.655558 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8a37a9ba-1121-45a8-b0f7-e5211ad94c30 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-2044132225", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1946750982", "security_groups": [{"name": "tempest-secgroup-smoke-962146005"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "1aacd3d1-1744-4fb4-8a87-78462c84fcf0"}]}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:15:39.900672 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-8a37a9ba-1121-45a8-b0f7-e5211ad94c30 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] validate_networks() for [('1aacd3d1-1744-4fb4-8a87-78462c84fcf0', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:15:40.439669 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-eb15b71e-b29a-4261-8f39-e02f11973708 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:40.441634 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-eb15b71e-b29a-4261-8f39-e02f11973708 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: a13b5e51-8a1d-4cb4-9485-a183b5a20c8d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:40.456550 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb15b71e-b29a-4261-8f39-e02f11973708 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:40.457336 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb15b71e-b29a-4261-8f39-e02f11973708 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:40.457998 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb15b71e-b29a-4261-8f39-e02f11973708 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:40.459015 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb15b71e-b29a-4261-8f39-e02f11973708 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:40.463814 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb15b71e-b29a-4261-8f39-e02f11973708 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:40.464626 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb15b71e-b29a-4261-8f39-e02f11973708 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:40.846767 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-eb15b71e-b29a-4261-8f39-e02f11973708 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bdfecc6c7a43608095044b0174b48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfe795da0e4988a50c38f19200ea7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:40.858857 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-eb15b71e-b29a-4261-8f39-e02f11973708 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d" status: 200 len: 1677 microversion: 2.1 time: 0.423003 Sep 08 11:15:40.867193 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2902/5925] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:40 2022] GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d => generated 1677 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:15:40.878022 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-21f87d90-0f3c-429c-8508-097d0bd57449 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:40.878861 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-21f87d90-0f3c-429c-8508-097d0bd57449 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 85a3ba9d-cc78-422b-8327-4191b2067feb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:40.909058 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-21f87d90-0f3c-429c-8508-097d0bd57449 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:40.909581 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-21f87d90-0f3c-429c-8508-097d0bd57449 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:40.910294 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-21f87d90-0f3c-429c-8508-097d0bd57449 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:40.910769 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-21f87d90-0f3c-429c-8508-097d0bd57449 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:40.911236 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-21f87d90-0f3c-429c-8508-097d0bd57449 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:40.921805 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-21f87d90-0f3c-429c-8508-097d0bd57449 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:41.285247 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-21f87d90-0f3c-429c-8508-097d0bd57449 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:41.293404 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-21f87d90-0f3c-429c-8508-097d0bd57449 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb" status: 200 len: 1392 microversion: 2.1 time: 0.424597 Sep 08 11:15:41.313541 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2903/5926] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:40 2022] GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb => generated 1392 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:15:41.512601 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-8a37a9ba-1121-45a8-b0f7-e5211ad94c30 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Getting quotas for project 56f4fec1839448c28e7a0a3d16236ab6. Resources: dict_keys(['metadata_items']) {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:15:41.543137 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-8a37a9ba-1121-45a8-b0f7-e5211ad94c30 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Getting quotas for user f9f3aa2815fd4dcc8767242bc5cd1c1d and project 56f4fec1839448c28e7a0a3d16236ab6. Resources: dict_keys(['metadata_items']) {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:15:41.569481 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-8a37a9ba-1121-45a8-b0f7-e5211ad94c30 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:15:41.570188 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-8a37a9ba-1121-45a8-b0f7-e5211ad94c30 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:15:41.571012 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-8a37a9ba-1121-45a8-b0f7-e5211ad94c30 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:15:41.571685 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-8a37a9ba-1121-45a8-b0f7-e5211ad94c30 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:15:41.572441 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-8a37a9ba-1121-45a8-b0f7-e5211ad94c30 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:15:41.620850 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8a37a9ba-1121-45a8-b0f7-e5211ad94c30 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:41.633732 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8a37a9ba-1121-45a8-b0f7-e5211ad94c30 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:41.634532 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8a37a9ba-1121-45a8-b0f7-e5211ad94c30 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:41.636170 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8a37a9ba-1121-45a8-b0f7-e5211ad94c30 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:41.648233 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8a37a9ba-1121-45a8-b0f7-e5211ad94c30 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:41.651047 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8a37a9ba-1121-45a8-b0f7-e5211ad94c30 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:41.703842 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-8a37a9ba-1121-45a8-b0f7-e5211ad94c30 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Getting quotas for project 56f4fec1839448c28e7a0a3d16236ab6. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:15:41.723410 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-8a37a9ba-1121-45a8-b0f7-e5211ad94c30 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Getting quotas for user f9f3aa2815fd4dcc8767242bc5cd1c1d and project 56f4fec1839448c28e7a0a3d16236ab6. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:15:41.763646 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8a37a9ba-1121-45a8-b0f7-e5211ad94c30 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:15:41.772844 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8a37a9ba-1121-45a8-b0f7-e5211ad94c30 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] [instance: 9426a1f8-7d16-47ec-af01-70d0c7766eb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:15:41.926880 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8def7182-3722-4f55-ac87-36b2708f2867 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:41.928063 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8def7182-3722-4f55-ac87-36b2708f2867 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: a13b5e51-8a1d-4cb4-9485-a183b5a20c8d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:41.966847 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8def7182-3722-4f55-ac87-36b2708f2867 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:41.967695 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8def7182-3722-4f55-ac87-36b2708f2867 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:41.968407 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8def7182-3722-4f55-ac87-36b2708f2867 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:41.981231 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8def7182-3722-4f55-ac87-36b2708f2867 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:41.984329 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8def7182-3722-4f55-ac87-36b2708f2867 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:41.986060 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8def7182-3722-4f55-ac87-36b2708f2867 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:42.041483 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8a37a9ba-1121-45a8-b0f7-e5211ad94c30 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.385689 Sep 08 11:15:42.049700 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3024/5927] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 11:15:39 2022] POST /compute/v2.1/servers => generated 405 bytes in 2399 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:15:42.060940 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e49c1b40-f216-4a3c-b1fa-a8686eece47e tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:42.061880 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e49c1b40-f216-4a3c-b1fa-a8686eece47e tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] [instance: 9426a1f8-7d16-47ec-af01-70d0c7766eb9] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:42.229368 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e49c1b40-f216-4a3c-b1fa-a8686eece47e tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f3aa2815fd4dcc8767242bc5cd1c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f4fec1839448c28e7a0a3d16236ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:42.243670 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e49c1b40-f216-4a3c-b1fa-a8686eece47e tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] 10.222.0.27 "GET /compute/v2.1/servers/9426a1f8-7d16-47ec-af01-70d0c7766eb9" status: 200 len: 1303 microversion: 2.1 time: 0.192513 Sep 08 11:15:42.244369 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3025/5928] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:42 2022] GET /compute/v2.1/servers/9426a1f8-7d16-47ec-af01-70d0c7766eb9 => generated 1303 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:15:42.321963 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-12eec3b0-c10f-43c5-97ee-4ff6f0231f4a tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:42.322846 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-12eec3b0-c10f-43c5-97ee-4ff6f0231f4a tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 85a3ba9d-cc78-422b-8327-4191b2067feb] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:42.342022 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-12eec3b0-c10f-43c5-97ee-4ff6f0231f4a tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:42.343440 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-12eec3b0-c10f-43c5-97ee-4ff6f0231f4a tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:42.347833 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-12eec3b0-c10f-43c5-97ee-4ff6f0231f4a tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:42.349453 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-12eec3b0-c10f-43c5-97ee-4ff6f0231f4a tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:42.350404 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-12eec3b0-c10f-43c5-97ee-4ff6f0231f4a tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:42.352240 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-12eec3b0-c10f-43c5-97ee-4ff6f0231f4a tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:42.501246 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8def7182-3722-4f55-ac87-36b2708f2867 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bdfecc6c7a43608095044b0174b48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfe795da0e4988a50c38f19200ea7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:42.513581 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8def7182-3722-4f55-ac87-36b2708f2867 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d" status: 200 len: 1677 microversion: 2.1 time: 0.614286 Sep 08 11:15:42.514720 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2904/5929] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:41 2022] GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d => generated 1677 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:15:42.917235 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-12eec3b0-c10f-43c5-97ee-4ff6f0231f4a tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:42.955330 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-12eec3b0-c10f-43c5-97ee-4ff6f0231f4a tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb" status: 200 len: 1392 microversion: 2.1 time: 0.637924 Sep 08 11:15:42.958229 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3026/5930] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:42 2022] GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb => generated 1392 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:15:42.985742 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-35a814d4-342f-471f-91ae-d8369a6aaf10 req-274c7425-85a7-423e-b4ac-73d987411828 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85a3ba9d-cc78-422b-8327-4191b2067feb", "tag": "6bdfb525-38ed-4bf1-b293-5310c08a39a1"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:15:43.057521 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-35a814d4-342f-471f-91ae-d8369a6aaf10 req-274c7425-85a7-423e-b4ac-73d987411828 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:43.058089 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-35a814d4-342f-471f-91ae-d8369a6aaf10 req-274c7425-85a7-423e-b4ac-73d987411828 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:43.058547 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-35a814d4-342f-471f-91ae-d8369a6aaf10 req-274c7425-85a7-423e-b4ac-73d987411828 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:43.106614 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-35a814d4-342f-471f-91ae-d8369a6aaf10 req-274c7425-85a7-423e-b4ac-73d987411828 service nova] Creating event network-changed:6bdfb525-38ed-4bf1-b293-5310c08a39a1 for instance 85a3ba9d-cc78-422b-8327-4191b2067feb on n-h2-850501-12 Sep 08 11:15:43.120631 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-35a814d4-342f-471f-91ae-d8369a6aaf10 req-274c7425-85a7-423e-b4ac-73d987411828 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142806 Sep 08 11:15:43.125455 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2905/5931] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:15:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:15:43.271581 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-582d372a-1bb8-4e5e-9c9a-e494ec7fcba9 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:43.273212 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-582d372a-1bb8-4e5e-9c9a-e494ec7fcba9 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] [instance: 9426a1f8-7d16-47ec-af01-70d0c7766eb9] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:43.281302 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-582d372a-1bb8-4e5e-9c9a-e494ec7fcba9 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:43.282039 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-582d372a-1bb8-4e5e-9c9a-e494ec7fcba9 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:43.282846 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-582d372a-1bb8-4e5e-9c9a-e494ec7fcba9 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:43.297897 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-582d372a-1bb8-4e5e-9c9a-e494ec7fcba9 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:43.298690 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-582d372a-1bb8-4e5e-9c9a-e494ec7fcba9 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:43.299301 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-582d372a-1bb8-4e5e-9c9a-e494ec7fcba9 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:43.543668 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1db84ffd-6191-46b2-b790-36d78be7fce5 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:43.544443 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1db84ffd-6191-46b2-b790-36d78be7fce5 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: a13b5e51-8a1d-4cb4-9485-a183b5a20c8d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:43.561779 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1db84ffd-6191-46b2-b790-36d78be7fce5 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:43.568531 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1db84ffd-6191-46b2-b790-36d78be7fce5 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:43.569435 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1db84ffd-6191-46b2-b790-36d78be7fce5 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:43.570008 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1db84ffd-6191-46b2-b790-36d78be7fce5 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:43.570697 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1db84ffd-6191-46b2-b790-36d78be7fce5 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:43.572396 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1db84ffd-6191-46b2-b790-36d78be7fce5 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:43.628196 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-582d372a-1bb8-4e5e-9c9a-e494ec7fcba9 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f3aa2815fd4dcc8767242bc5cd1c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f4fec1839448c28e7a0a3d16236ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:43.636803 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-582d372a-1bb8-4e5e-9c9a-e494ec7fcba9 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] 10.222.0.27 "GET /compute/v2.1/servers/9426a1f8-7d16-47ec-af01-70d0c7766eb9" status: 200 len: 1299 microversion: 2.1 time: 0.369211 Sep 08 11:15:43.640125 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3027/5932] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:43 2022] GET /compute/v2.1/servers/9426a1f8-7d16-47ec-af01-70d0c7766eb9 => generated 1299 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:15:43.980032 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8f18305e-1e1e-4790-b3ab-29d843adaa4e tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:43.980648 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8f18305e-1e1e-4790-b3ab-29d843adaa4e tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 85a3ba9d-cc78-422b-8327-4191b2067feb] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:43.996713 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f18305e-1e1e-4790-b3ab-29d843adaa4e tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:43.997532 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f18305e-1e1e-4790-b3ab-29d843adaa4e tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:43.998140 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f18305e-1e1e-4790-b3ab-29d843adaa4e tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:43.999000 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f18305e-1e1e-4790-b3ab-29d843adaa4e tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:44.005797 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f18305e-1e1e-4790-b3ab-29d843adaa4e tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:44.006486 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f18305e-1e1e-4790-b3ab-29d843adaa4e tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:44.375927 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1db84ffd-6191-46b2-b790-36d78be7fce5 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bdfecc6c7a43608095044b0174b48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfe795da0e4988a50c38f19200ea7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:44.390562 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1db84ffd-6191-46b2-b790-36d78be7fce5 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d" status: 200 len: 1654 microversion: 2.1 time: 0.854620 Sep 08 11:15:44.392441 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2906/5933] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:43 2022] GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d => generated 1654 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:15:44.406646 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8f18305e-1e1e-4790-b3ab-29d843adaa4e tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:44.418452 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3c49ed98-c972-4602-8e42-86a7d1b41d61 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:15:44.441502 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c49ed98-c972-4602-8e42-86a7d1b41d61 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:44.442015 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c49ed98-c972-4602-8e42-86a7d1b41d61 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:44.442812 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8f18305e-1e1e-4790-b3ab-29d843adaa4e tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb" status: 200 len: 1392 microversion: 2.1 time: 0.464302 Sep 08 11:15:44.443827 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3028/5934] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:43 2022] GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb => generated 1392 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:15:44.444346 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c49ed98-c972-4602-8e42-86a7d1b41d61 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:44.482555 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3c49ed98-c972-4602-8e42-86a7d1b41d61 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: a13b5e51-8a1d-4cb4-9485-a183b5a20c8d] Going to try to start instance {{(pid=128862) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 08 11:15:44.548286 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3c49ed98-c972-4602-8e42-86a7d1b41d61 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "POST /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d/action" status: 202 len: 0 microversion: 2.1 time: 0.134038 Sep 08 11:15:44.550763 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2907/5935] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 11:15:44 2022] POST /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:15:44.559084 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a475dbb8-a436-4656-8049-5769a66ac111 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:44.559719 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a475dbb8-a436-4656-8049-5769a66ac111 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: a13b5e51-8a1d-4cb4-9485-a183b5a20c8d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:44.611432 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a475dbb8-a436-4656-8049-5769a66ac111 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:44.612058 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a475dbb8-a436-4656-8049-5769a66ac111 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:44.617718 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a475dbb8-a436-4656-8049-5769a66ac111 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:44.619274 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a475dbb8-a436-4656-8049-5769a66ac111 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:44.621945 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a475dbb8-a436-4656-8049-5769a66ac111 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:44.623873 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a475dbb8-a436-4656-8049-5769a66ac111 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:44.660374 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c53610cb-f52d-4bb4-af11-ff8859376e49 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:44.661426 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c53610cb-f52d-4bb4-af11-ff8859376e49 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] [instance: 9426a1f8-7d16-47ec-af01-70d0c7766eb9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:44.671258 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c53610cb-f52d-4bb4-af11-ff8859376e49 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:44.674396 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c53610cb-f52d-4bb4-af11-ff8859376e49 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:44.677657 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c53610cb-f52d-4bb4-af11-ff8859376e49 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:44.679223 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c53610cb-f52d-4bb4-af11-ff8859376e49 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:44.682927 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c53610cb-f52d-4bb4-af11-ff8859376e49 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:44.683691 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c53610cb-f52d-4bb4-af11-ff8859376e49 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:44.862447 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c53610cb-f52d-4bb4-af11-ff8859376e49 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f3aa2815fd4dcc8767242bc5cd1c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f4fec1839448c28e7a0a3d16236ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:44.878858 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c53610cb-f52d-4bb4-af11-ff8859376e49 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] 10.222.0.27 "GET /compute/v2.1/servers/9426a1f8-7d16-47ec-af01-70d0c7766eb9" status: 200 len: 1361 microversion: 2.1 time: 0.222596 Sep 08 11:15:44.884527 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2908/5936] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:44 2022] GET /compute/v2.1/servers/9426a1f8-7d16-47ec-af01-70d0c7766eb9 => generated 1361 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:15:45.472699 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d5cd84e5-dc89-42d8-b41b-ae5dc86d96f8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:45.474442 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d5cd84e5-dc89-42d8-b41b-ae5dc86d96f8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 85a3ba9d-cc78-422b-8327-4191b2067feb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:45.487229 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d5cd84e5-dc89-42d8-b41b-ae5dc86d96f8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:45.489063 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d5cd84e5-dc89-42d8-b41b-ae5dc86d96f8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:45.490298 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d5cd84e5-dc89-42d8-b41b-ae5dc86d96f8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:45.494670 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d5cd84e5-dc89-42d8-b41b-ae5dc86d96f8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:45.496044 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d5cd84e5-dc89-42d8-b41b-ae5dc86d96f8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:45.496726 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d5cd84e5-dc89-42d8-b41b-ae5dc86d96f8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:45.603668 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a475dbb8-a436-4656-8049-5769a66ac111 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bdfecc6c7a43608095044b0174b48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfe795da0e4988a50c38f19200ea7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:45.620512 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a475dbb8-a436-4656-8049-5769a66ac111 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d" status: 200 len: 1663 microversion: 2.1 time: 1.065221 Sep 08 11:15:45.631129 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3029/5937] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:44 2022] GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d => generated 1663 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:15:45.910911 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7c933feb-2f7b-499e-9ec4-f76e2f72a833 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:45.911723 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7c933feb-2f7b-499e-9ec4-f76e2f72a833 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] [instance: 9426a1f8-7d16-47ec-af01-70d0c7766eb9] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:45.932326 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c933feb-2f7b-499e-9ec4-f76e2f72a833 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:45.932852 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c933feb-2f7b-499e-9ec4-f76e2f72a833 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:45.933331 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c933feb-2f7b-499e-9ec4-f76e2f72a833 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:45.934069 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c933feb-2f7b-499e-9ec4-f76e2f72a833 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:45.934533 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c933feb-2f7b-499e-9ec4-f76e2f72a833 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:45.934966 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c933feb-2f7b-499e-9ec4-f76e2f72a833 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:45.963515 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d5cd84e5-dc89-42d8-b41b-ae5dc86d96f8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:45.974352 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d5cd84e5-dc89-42d8-b41b-ae5dc86d96f8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb" status: 200 len: 1392 microversion: 2.1 time: 0.507878 Sep 08 11:15:45.990546 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2909/5938] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:45 2022] GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb => generated 1392 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:15:46.597222 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7c933feb-2f7b-499e-9ec4-f76e2f72a833 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f3aa2815fd4dcc8767242bc5cd1c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f4fec1839448c28e7a0a3d16236ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:46.623835 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7c933feb-2f7b-499e-9ec4-f76e2f72a833 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] 10.222.0.27 "GET /compute/v2.1/servers/9426a1f8-7d16-47ec-af01-70d0c7766eb9" status: 200 len: 1428 microversion: 2.1 time: 0.715882 Sep 08 11:15:46.624470 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3030/5939] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:45 2022] GET /compute/v2.1/servers/9426a1f8-7d16-47ec-af01-70d0c7766eb9 => generated 1428 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:15:46.648117 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8d353eb2-7502-4a33-b967-3e85466bab06 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:46.648852 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8d353eb2-7502-4a33-b967-3e85466bab06 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: a13b5e51-8a1d-4cb4-9485-a183b5a20c8d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:46.651574 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=4 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:15:46.657083 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d353eb2-7502-4a33-b967-3e85466bab06 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:46.657584 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d353eb2-7502-4a33-b967-3e85466bab06 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:46.658026 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d353eb2-7502-4a33-b967-3e85466bab06 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:46.658749 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d353eb2-7502-4a33-b967-3e85466bab06 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:46.659219 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d353eb2-7502-4a33-b967-3e85466bab06 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:46.666562 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d353eb2-7502-4a33-b967-3e85466bab06 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:47.003932 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b01d7482-4b0c-4221-8e43-852b06921de0 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:47.004686 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b01d7482-4b0c-4221-8e43-852b06921de0 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 85a3ba9d-cc78-422b-8327-4191b2067feb] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:47.029223 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b01d7482-4b0c-4221-8e43-852b06921de0 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:47.037241 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b01d7482-4b0c-4221-8e43-852b06921de0 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:47.038813 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b01d7482-4b0c-4221-8e43-852b06921de0 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:47.040256 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b01d7482-4b0c-4221-8e43-852b06921de0 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:47.041486 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b01d7482-4b0c-4221-8e43-852b06921de0 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:47.042247 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b01d7482-4b0c-4221-8e43-852b06921de0 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:47.409938 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8d353eb2-7502-4a33-b967-3e85466bab06 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bdfecc6c7a43608095044b0174b48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfe795da0e4988a50c38f19200ea7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:47.419506 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8d353eb2-7502-4a33-b967-3e85466bab06 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d" status: 200 len: 1663 microversion: 2.1 time: 0.775420 Sep 08 11:15:47.423518 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2910/5940] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:46 2022] GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d => generated 1663 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:15:47.434678 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b01d7482-4b0c-4221-8e43-852b06921de0 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:47.448454 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b01d7482-4b0c-4221-8e43-852b06921de0 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb" status: 200 len: 1392 microversion: 2.1 time: 0.450365 Sep 08 11:15:47.448969 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3031/5941] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:46 2022] GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb => generated 1392 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:15:47.651313 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-03123189-1557-4d16-bed6-37d8b06b5a1a tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:47.652613 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-03123189-1557-4d16-bed6-37d8b06b5a1a tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] [instance: 9426a1f8-7d16-47ec-af01-70d0c7766eb9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:47.659487 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03123189-1557-4d16-bed6-37d8b06b5a1a tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:47.660258 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03123189-1557-4d16-bed6-37d8b06b5a1a tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:47.661118 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03123189-1557-4d16-bed6-37d8b06b5a1a tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:47.662040 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03123189-1557-4d16-bed6-37d8b06b5a1a tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:47.662764 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03123189-1557-4d16-bed6-37d8b06b5a1a tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:47.664117 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03123189-1557-4d16-bed6-37d8b06b5a1a tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:47.917131 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-03123189-1557-4d16-bed6-37d8b06b5a1a tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f3aa2815fd4dcc8767242bc5cd1c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f4fec1839448c28e7a0a3d16236ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:47.930849 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-03123189-1557-4d16-bed6-37d8b06b5a1a tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] 10.222.0.27 "GET /compute/v2.1/servers/9426a1f8-7d16-47ec-af01-70d0c7766eb9" status: 200 len: 1428 microversion: 2.1 time: 0.282487 Sep 08 11:15:47.936079 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2911/5942] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:47 2022] GET /compute/v2.1/servers/9426a1f8-7d16-47ec-af01-70d0c7766eb9 => generated 1428 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:15:47.988085 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-192bff5d-9801-401c-a55f-4a592d77946e req-0d46c74d-a1a4-48cf-b46a-4d2e3678cb99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9426a1f8-7d16-47ec-af01-70d0c7766eb9", "tag": "bbc00306-8e8e-49d3-b545-cbe4ab9bdea8"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:15:48.009710 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-192bff5d-9801-401c-a55f-4a592d77946e req-0d46c74d-a1a4-48cf-b46a-4d2e3678cb99 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:48.010313 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-192bff5d-9801-401c-a55f-4a592d77946e req-0d46c74d-a1a4-48cf-b46a-4d2e3678cb99 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:48.014177 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-192bff5d-9801-401c-a55f-4a592d77946e req-0d46c74d-a1a4-48cf-b46a-4d2e3678cb99 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:48.044829 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-192bff5d-9801-401c-a55f-4a592d77946e req-0d46c74d-a1a4-48cf-b46a-4d2e3678cb99 service nova] Creating event network-changed:bbc00306-8e8e-49d3-b545-cbe4ab9bdea8 for instance 9426a1f8-7d16-47ec-af01-70d0c7766eb9 on n-h1-850501-12 Sep 08 11:15:48.065003 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-192bff5d-9801-401c-a55f-4a592d77946e req-0d46c74d-a1a4-48cf-b46a-4d2e3678cb99 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075189 Sep 08 11:15:48.066246 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3032/5943] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:15:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:15:48.210158 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-06c3194b-a525-46e8-b9a3-aadabec588ba req-86029b1a-e1d5-4dce-a918-1748a1e72128 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85a3ba9d-cc78-422b-8327-4191b2067feb", "name": "network-vif-plugged", "status": "completed", "tag": "6bdfb525-38ed-4bf1-b293-5310c08a39a1"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:15:48.228728 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-06c3194b-a525-46e8-b9a3-aadabec588ba req-86029b1a-e1d5-4dce-a918-1748a1e72128 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:48.229497 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-06c3194b-a525-46e8-b9a3-aadabec588ba req-86029b1a-e1d5-4dce-a918-1748a1e72128 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:48.230133 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-06c3194b-a525-46e8-b9a3-aadabec588ba req-86029b1a-e1d5-4dce-a918-1748a1e72128 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:48.265915 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-06c3194b-a525-46e8-b9a3-aadabec588ba req-86029b1a-e1d5-4dce-a918-1748a1e72128 service nova] Creating event network-vif-plugged:6bdfb525-38ed-4bf1-b293-5310c08a39a1 for instance 85a3ba9d-cc78-422b-8327-4191b2067feb on n-h2-850501-12 Sep 08 11:15:48.271541 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-06c3194b-a525-46e8-b9a3-aadabec588ba req-86029b1a-e1d5-4dce-a918-1748a1e72128 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070472 Sep 08 11:15:48.272598 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2912/5944] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:15:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:15:48.452587 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5aa9a65d-bfbe-4e35-bb3d-0061d43f1912 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:48.453643 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5aa9a65d-bfbe-4e35-bb3d-0061d43f1912 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: a13b5e51-8a1d-4cb4-9485-a183b5a20c8d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:48.460734 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5aa9a65d-bfbe-4e35-bb3d-0061d43f1912 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:48.461573 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5aa9a65d-bfbe-4e35-bb3d-0061d43f1912 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:48.462238 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5aa9a65d-bfbe-4e35-bb3d-0061d43f1912 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:48.463688 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5aa9a65d-bfbe-4e35-bb3d-0061d43f1912 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:48.464375 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5aa9a65d-bfbe-4e35-bb3d-0061d43f1912 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:48.465233 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5aa9a65d-bfbe-4e35-bb3d-0061d43f1912 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:48.472233 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-627be7a6-e12d-4fb5-822a-766511f28e83 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:48.472949 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-627be7a6-e12d-4fb5-822a-766511f28e83 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 85a3ba9d-cc78-422b-8327-4191b2067feb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:48.486155 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-627be7a6-e12d-4fb5-822a-766511f28e83 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:48.486993 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-627be7a6-e12d-4fb5-822a-766511f28e83 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:48.489922 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-627be7a6-e12d-4fb5-822a-766511f28e83 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:48.491607 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-627be7a6-e12d-4fb5-822a-766511f28e83 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:48.493863 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-627be7a6-e12d-4fb5-822a-766511f28e83 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:48.495245 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-627be7a6-e12d-4fb5-822a-766511f28e83 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:48.694739 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5aa9a65d-bfbe-4e35-bb3d-0061d43f1912 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bdfecc6c7a43608095044b0174b48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfe795da0e4988a50c38f19200ea7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:48.708355 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5aa9a65d-bfbe-4e35-bb3d-0061d43f1912 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d" status: 200 len: 1667 microversion: 2.1 time: 0.260366 Sep 08 11:15:48.721230 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3033/5945] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:48 2022] GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d => generated 1667 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:15:48.776645 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-627be7a6-e12d-4fb5-822a-766511f28e83 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:48.790613 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-627be7a6-e12d-4fb5-822a-766511f28e83 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb" status: 200 len: 1392 microversion: 2.1 time: 0.323112 Sep 08 11:15:48.799035 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2913/5946] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:48 2022] GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb => generated 1392 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:15:48.856334 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4201964b-47c8-48d1-86bf-61b35f362638 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:48.857043 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4201964b-47c8-48d1-86bf-61b35f362638 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] [instance: 90938b52-4f78-45e5-aea8-4a74f5734b4a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:48.860947 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-4c0bd34b-3464-4f98-abe0-55cebe8aa0f7 req-b51adc74-1a1b-4f37-a870-089e24f86de5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90938b52-4f78-45e5-aea8-4a74f5734b4a", "tag": "d97ac53d-0b97-46ea-9b48-bf5f2e72211d"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:15:48.863725 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4201964b-47c8-48d1-86bf-61b35f362638 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:48.864315 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4201964b-47c8-48d1-86bf-61b35f362638 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:48.864997 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4201964b-47c8-48d1-86bf-61b35f362638 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:48.867140 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4201964b-47c8-48d1-86bf-61b35f362638 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:48.868100 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4201964b-47c8-48d1-86bf-61b35f362638 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:48.868766 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4201964b-47c8-48d1-86bf-61b35f362638 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:48.871711 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-4c0bd34b-3464-4f98-abe0-55cebe8aa0f7 req-b51adc74-1a1b-4f37-a870-089e24f86de5 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:48.872197 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-4c0bd34b-3464-4f98-abe0-55cebe8aa0f7 req-b51adc74-1a1b-4f37-a870-089e24f86de5 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:48.872931 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-4c0bd34b-3464-4f98-abe0-55cebe8aa0f7 req-b51adc74-1a1b-4f37-a870-089e24f86de5 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:48.885078 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-4c0bd34b-3464-4f98-abe0-55cebe8aa0f7 req-b51adc74-1a1b-4f37-a870-089e24f86de5 service nova] Creating event network-changed:d97ac53d-0b97-46ea-9b48-bf5f2e72211d for instance 90938b52-4f78-45e5-aea8-4a74f5734b4a on n-h2-850501-12 Sep 08 11:15:48.891064 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-4c0bd34b-3464-4f98-abe0-55cebe8aa0f7 req-b51adc74-1a1b-4f37-a870-089e24f86de5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033909 Sep 08 11:15:48.894782 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2914/5947] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:15:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:15:48.918428 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4201964b-47c8-48d1-86bf-61b35f362638 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] [instance: 90938b52-4f78-45e5-aea8-4a74f5734b4a] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:15:48.955162 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f2a36dd7-c5df-4348-9d91-44fec88e17a9 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:48.956326 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f2a36dd7-c5df-4348-9d91-44fec88e17a9 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] [instance: 9426a1f8-7d16-47ec-af01-70d0c7766eb9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:48.962926 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f2a36dd7-c5df-4348-9d91-44fec88e17a9 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:48.963671 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f2a36dd7-c5df-4348-9d91-44fec88e17a9 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:48.964270 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f2a36dd7-c5df-4348-9d91-44fec88e17a9 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:48.965380 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f2a36dd7-c5df-4348-9d91-44fec88e17a9 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:48.965814 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f2a36dd7-c5df-4348-9d91-44fec88e17a9 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:48.966330 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f2a36dd7-c5df-4348-9d91-44fec88e17a9 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:49.017238 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4201964b-47c8-48d1-86bf-61b35f362638 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] 10.222.0.27 "DELETE /compute/v2.1/servers/90938b52-4f78-45e5-aea8-4a74f5734b4a" status: 204 len: 0 microversion: 2.1 time: 0.166100 Sep 08 11:15:49.018200 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3034/5948] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:15:48 2022] DELETE /compute/v2.1/servers/90938b52-4f78-45e5-aea8-4a74f5734b4a => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 11:15:49.028486 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f90a869c-1ca8-4024-bcf6-889c76e9a810 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:49.029473 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f90a869c-1ca8-4024-bcf6-889c76e9a810 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] [instance: 90938b52-4f78-45e5-aea8-4a74f5734b4a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:49.039224 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f90a869c-1ca8-4024-bcf6-889c76e9a810 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:49.039833 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f90a869c-1ca8-4024-bcf6-889c76e9a810 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:49.040581 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f90a869c-1ca8-4024-bcf6-889c76e9a810 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:49.041521 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f90a869c-1ca8-4024-bcf6-889c76e9a810 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:49.042215 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f90a869c-1ca8-4024-bcf6-889c76e9a810 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:49.043062 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f90a869c-1ca8-4024-bcf6-889c76e9a810 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:49.161596 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f2a36dd7-c5df-4348-9d91-44fec88e17a9 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f3aa2815fd4dcc8767242bc5cd1c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f4fec1839448c28e7a0a3d16236ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:49.174881 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f2a36dd7-c5df-4348-9d91-44fec88e17a9 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] 10.222.0.27 "GET /compute/v2.1/servers/9426a1f8-7d16-47ec-af01-70d0c7766eb9" status: 200 len: 1428 microversion: 2.1 time: 0.223459 Sep 08 11:15:49.176503 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2915/5949] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:48 2022] GET /compute/v2.1/servers/9426a1f8-7d16-47ec-af01-70d0c7766eb9 => generated 1428 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:15:49.249535 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f90a869c-1ca8-4024-bcf6-889c76e9a810 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9770721b674c489e0491156a7c5efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c65adcd147ba95df7ec8d6b8fb10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:49.262759 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f90a869c-1ca8-4024-bcf6-889c76e9a810 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] 10.222.0.27 "GET /compute/v2.1/servers/90938b52-4f78-45e5-aea8-4a74f5734b4a" status: 200 len: 1762 microversion: 2.1 time: 0.239337 Sep 08 11:15:49.263849 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3035/5950] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:49 2022] GET /compute/v2.1/servers/90938b52-4f78-45e5-aea8-4a74f5734b4a => generated 1762 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:15:49.822072 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4a813f69-4e4f-40ad-a87d-b11bf87e3462 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:49.822789 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4a813f69-4e4f-40ad-a87d-b11bf87e3462 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 85a3ba9d-cc78-422b-8327-4191b2067feb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:49.830256 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a813f69-4e4f-40ad-a87d-b11bf87e3462 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:49.832478 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a813f69-4e4f-40ad-a87d-b11bf87e3462 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:49.832478 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a813f69-4e4f-40ad-a87d-b11bf87e3462 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:49.833598 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a813f69-4e4f-40ad-a87d-b11bf87e3462 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:49.835284 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a813f69-4e4f-40ad-a87d-b11bf87e3462 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:49.835926 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a813f69-4e4f-40ad-a87d-b11bf87e3462 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:50.073928 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4a813f69-4e4f-40ad-a87d-b11bf87e3462 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:50.076440 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:15:50.084275 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4a813f69-4e4f-40ad-a87d-b11bf87e3462 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb" status: 200 len: 1392 microversion: 2.1 time: 0.266813 Sep 08 11:15:50.086046 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2916/5951] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:49 2022] GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb => generated 1392 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:15:50.198869 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9b91b236-14b3-4d88-bca2-aa4ec968b1eb tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:50.199496 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9b91b236-14b3-4d88-bca2-aa4ec968b1eb tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] [instance: 9426a1f8-7d16-47ec-af01-70d0c7766eb9] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:50.206529 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9b91b236-14b3-4d88-bca2-aa4ec968b1eb tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:50.207041 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9b91b236-14b3-4d88-bca2-aa4ec968b1eb tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:50.207486 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9b91b236-14b3-4d88-bca2-aa4ec968b1eb tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:50.208209 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9b91b236-14b3-4d88-bca2-aa4ec968b1eb tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:50.208673 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9b91b236-14b3-4d88-bca2-aa4ec968b1eb tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:50.209144 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9b91b236-14b3-4d88-bca2-aa4ec968b1eb tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:50.309187 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5216d839-1d9e-4a82-9023-aea03112cc44 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:50.311209 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5216d839-1d9e-4a82-9023-aea03112cc44 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] [instance: 90938b52-4f78-45e5-aea8-4a74f5734b4a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:50.327338 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5216d839-1d9e-4a82-9023-aea03112cc44 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:50.328085 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5216d839-1d9e-4a82-9023-aea03112cc44 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:50.329217 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5216d839-1d9e-4a82-9023-aea03112cc44 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:50.330227 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5216d839-1d9e-4a82-9023-aea03112cc44 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:50.330833 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5216d839-1d9e-4a82-9023-aea03112cc44 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:50.331575 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5216d839-1d9e-4a82-9023-aea03112cc44 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:50.371171 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9b91b236-14b3-4d88-bca2-aa4ec968b1eb tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f3aa2815fd4dcc8767242bc5cd1c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f4fec1839448c28e7a0a3d16236ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:50.380697 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9b91b236-14b3-4d88-bca2-aa4ec968b1eb tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] 10.222.0.27 "GET /compute/v2.1/servers/9426a1f8-7d16-47ec-af01-70d0c7766eb9" status: 200 len: 1428 microversion: 2.1 time: 0.186604 Sep 08 11:15:50.393429 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3036/5952] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:50 2022] GET /compute/v2.1/servers/9426a1f8-7d16-47ec-af01-70d0c7766eb9 => generated 1428 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:15:50.630636 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5216d839-1d9e-4a82-9023-aea03112cc44 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9770721b674c489e0491156a7c5efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c65adcd147ba95df7ec8d6b8fb10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:50.639335 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5216d839-1d9e-4a82-9023-aea03112cc44 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] 10.222.0.27 "GET /compute/v2.1/servers/90938b52-4f78-45e5-aea8-4a74f5734b4a" status: 200 len: 1762 microversion: 2.1 time: 0.347780 Sep 08 11:15:50.640145 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2917/5953] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:50 2022] GET /compute/v2.1/servers/90938b52-4f78-45e5-aea8-4a74f5734b4a => generated 1762 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:15:51.110039 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f902495d-00d0-4749-979d-9bfcca79ff19 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:51.111149 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f902495d-00d0-4749-979d-9bfcca79ff19 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 85a3ba9d-cc78-422b-8327-4191b2067feb] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:51.118937 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f902495d-00d0-4749-979d-9bfcca79ff19 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:51.119441 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f902495d-00d0-4749-979d-9bfcca79ff19 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:51.120290 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f902495d-00d0-4749-979d-9bfcca79ff19 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:51.121070 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f902495d-00d0-4749-979d-9bfcca79ff19 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:51.121540 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f902495d-00d0-4749-979d-9bfcca79ff19 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:51.122166 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f902495d-00d0-4749-979d-9bfcca79ff19 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:51.238322 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-c394f332-c2a3-414e-9318-1491aaf8aaed req-6565d6ab-0290-4a73-8a05-277f1bfa3b8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90938b52-4f78-45e5-aea8-4a74f5734b4a", "name": "network-vif-deleted", "tag": "d97ac53d-0b97-46ea-9b48-bf5f2e72211d"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:15:51.254050 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c394f332-c2a3-414e-9318-1491aaf8aaed req-6565d6ab-0290-4a73-8a05-277f1bfa3b8a service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:51.254725 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c394f332-c2a3-414e-9318-1491aaf8aaed req-6565d6ab-0290-4a73-8a05-277f1bfa3b8a service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:51.255154 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c394f332-c2a3-414e-9318-1491aaf8aaed req-6565d6ab-0290-4a73-8a05-277f1bfa3b8a service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:51.269919 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-c394f332-c2a3-414e-9318-1491aaf8aaed req-6565d6ab-0290-4a73-8a05-277f1bfa3b8a service nova] Creating event network-vif-deleted:d97ac53d-0b97-46ea-9b48-bf5f2e72211d for instance 90938b52-4f78-45e5-aea8-4a74f5734b4a on n-h2-850501-12 Sep 08 11:15:51.279284 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-c394f332-c2a3-414e-9318-1491aaf8aaed req-6565d6ab-0290-4a73-8a05-277f1bfa3b8a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046299 Sep 08 11:15:51.280202 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2918/5954] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:15:51.320738 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f902495d-00d0-4749-979d-9bfcca79ff19 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:51.329978 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f902495d-00d0-4749-979d-9bfcca79ff19 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb" status: 200 len: 1565 microversion: 2.1 time: 0.226027 Sep 08 11:15:51.330683 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3037/5955] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:51 2022] GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb => generated 1565 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:15:51.354081 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c5836c30-03d0-46ac-82b4-e16593b5d6a2 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:51.354809 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c5836c30-03d0-46ac-82b4-e16593b5d6a2 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 85a3ba9d-cc78-422b-8327-4191b2067feb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:51.361627 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5836c30-03d0-46ac-82b4-e16593b5d6a2 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:51.362243 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5836c30-03d0-46ac-82b4-e16593b5d6a2 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:51.362545 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5836c30-03d0-46ac-82b4-e16593b5d6a2 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:51.363239 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5836c30-03d0-46ac-82b4-e16593b5d6a2 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:51.363700 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5836c30-03d0-46ac-82b4-e16593b5d6a2 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:51.364125 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5836c30-03d0-46ac-82b4-e16593b5d6a2 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:51.406229 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e5b6f58c-9036-4243-9a73-48140bf516bf tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:51.421327 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e5b6f58c-9036-4243-9a73-48140bf516bf tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] [instance: 9426a1f8-7d16-47ec-af01-70d0c7766eb9] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:51.431198 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e5b6f58c-9036-4243-9a73-48140bf516bf tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:51.432120 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e5b6f58c-9036-4243-9a73-48140bf516bf tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:51.432957 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e5b6f58c-9036-4243-9a73-48140bf516bf tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:51.434206 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e5b6f58c-9036-4243-9a73-48140bf516bf tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:51.434901 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e5b6f58c-9036-4243-9a73-48140bf516bf tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:51.435584 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e5b6f58c-9036-4243-9a73-48140bf516bf tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:51.566425 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c5836c30-03d0-46ac-82b4-e16593b5d6a2 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:51.577353 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c5836c30-03d0-46ac-82b4-e16593b5d6a2 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb" status: 200 len: 1565 microversion: 2.1 time: 0.227239 Sep 08 11:15:51.578674 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2919/5956] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:51 2022] GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb => generated 1565 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:15:51.616287 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e5b6f58c-9036-4243-9a73-48140bf516bf tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f3aa2815fd4dcc8767242bc5cd1c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f4fec1839448c28e7a0a3d16236ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:51.625099 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e5b6f58c-9036-4243-9a73-48140bf516bf tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] 10.222.0.27 "GET /compute/v2.1/servers/9426a1f8-7d16-47ec-af01-70d0c7766eb9" status: 200 len: 1428 microversion: 2.1 time: 0.222354 Sep 08 11:15:51.627132 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3038/5957] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:51 2022] GET /compute/v2.1/servers/9426a1f8-7d16-47ec-af01-70d0c7766eb9 => generated 1428 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:15:51.664305 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f74f5172-888f-4133-af2f-261dcc427a37 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:51.665145 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f74f5172-888f-4133-af2f-261dcc427a37 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] [instance: 90938b52-4f78-45e5-aea8-4a74f5734b4a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:51.672380 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f74f5172-888f-4133-af2f-261dcc427a37 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:51.673191 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f74f5172-888f-4133-af2f-261dcc427a37 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:51.673791 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f74f5172-888f-4133-af2f-261dcc427a37 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:51.674740 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f74f5172-888f-4133-af2f-261dcc427a37 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:51.675363 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f74f5172-888f-4133-af2f-261dcc427a37 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:51.675999 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f74f5172-888f-4133-af2f-261dcc427a37 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:51.736720 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f74f5172-888f-4133-af2f-261dcc427a37 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:51.737441 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f74f5172-888f-4133-af2f-261dcc427a37 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:51.737958 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f74f5172-888f-4133-af2f-261dcc427a37 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:51.738489 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-f74f5172-888f-4133-af2f-261dcc427a37 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lazy-loading 'fault' on Instance uuid 90938b52-4f78-45e5-aea8-4a74f5734b4a {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:15:51.806113 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f74f5172-888f-4133-af2f-261dcc427a37 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9770721b674c489e0491156a7c5efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c65adcd147ba95df7ec8d6b8fb10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:51.821207 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f74f5172-888f-4133-af2f-261dcc427a37 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] 10.222.0.27 "GET /compute/v2.1/servers/90938b52-4f78-45e5-aea8-4a74f5734b4a" status: 200 len: 1382 microversion: 2.1 time: 0.159066 Sep 08 11:15:51.844120 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2920/5958] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:51 2022] GET /compute/v2.1/servers/90938b52-4f78-45e5-aea8-4a74f5734b4a => generated 1382 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:15:52.648735 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7817306f-bfce-40e6-a233-a5e0065cffbf tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:52.649770 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7817306f-bfce-40e6-a233-a5e0065cffbf tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] [instance: 9426a1f8-7d16-47ec-af01-70d0c7766eb9] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:52.652246 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=4 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:15:52.668191 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=20 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:15:52.690190 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7817306f-bfce-40e6-a233-a5e0065cffbf tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:52.690698 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7817306f-bfce-40e6-a233-a5e0065cffbf tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:52.691146 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7817306f-bfce-40e6-a233-a5e0065cffbf tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:52.691868 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7817306f-bfce-40e6-a233-a5e0065cffbf tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:52.692333 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7817306f-bfce-40e6-a233-a5e0065cffbf tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:52.693101 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7817306f-bfce-40e6-a233-a5e0065cffbf tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:52.734446 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6189f86f-3c28-4df4-bbc7-c7f9b2c5e857 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:52.735911 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6189f86f-3c28-4df4-bbc7-c7f9b2c5e857 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: 67dca3fd-4bba-447a-9af9-0aacf1dd5451] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:52.755959 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6189f86f-3c28-4df4-bbc7-c7f9b2c5e857 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:52.757476 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6189f86f-3c28-4df4-bbc7-c7f9b2c5e857 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:52.758289 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6189f86f-3c28-4df4-bbc7-c7f9b2c5e857 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:52.759188 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6189f86f-3c28-4df4-bbc7-c7f9b2c5e857 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:52.759811 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6189f86f-3c28-4df4-bbc7-c7f9b2c5e857 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:52.760459 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6189f86f-3c28-4df4-bbc7-c7f9b2c5e857 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:52.809095 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6189f86f-3c28-4df4-bbc7-c7f9b2c5e857 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451/ips" status: 200 len: 151 microversion: 2.20 time: 0.078029 Sep 08 11:15:52.810535 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2921/5959] 10.222.0.27 () {60 vars in 1289 bytes} [Thu Sep 8 11:15:52 2022] GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451/ips => generated 151 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 11:15:52.850189 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-51d6cc47-9e60-424f-a71e-85e40203d92d tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:52.851092 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-51d6cc47-9e60-424f-a71e-85e40203d92d tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] [instance: 90938b52-4f78-45e5-aea8-4a74f5734b4a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:52.863999 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51d6cc47-9e60-424f-a71e-85e40203d92d tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:52.864874 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51d6cc47-9e60-424f-a71e-85e40203d92d tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:52.866081 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51d6cc47-9e60-424f-a71e-85e40203d92d tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:52.867027 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51d6cc47-9e60-424f-a71e-85e40203d92d tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:52.867805 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51d6cc47-9e60-424f-a71e-85e40203d92d tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:52.873431 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51d6cc47-9e60-424f-a71e-85e40203d92d tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:52.893067 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-51d6cc47-9e60-424f-a71e-85e40203d92d tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] HTTP exception thrown: Instance 90938b52-4f78-45e5-aea8-4a74f5734b4a could not be found. Sep 08 11:15:52.907053 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-51d6cc47-9e60-424f-a71e-85e40203d92d tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Request method failure captured: Sep 08 11:15:52.907053 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/90938b52-4f78-45e5-aea8-4a74f5734b4a HTTP/1.1 Sep 08 11:15:52.907053 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 11:15:52.907053 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 11:15:52.907053 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 11:15:52.907053 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 11:15:52.907053 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 11:15:52.907053 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 11:15:52.907053 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 11:15:52.907053 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 11:15:52.907053 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGc5o1e1xGxIyWIwCP8NAVSlptSa6tbrwmvIIjejVBcCs-tnfKQ3WwCQ1Pxa0zeoDXBtiyKYm9_7392jHbxZHaLYfIPudD0vTcWx9gHb8ZyQ9AW6TqW5ewtMUjeD8b0G7SNTyDnN-mU5dfh48q9-unMT3gfusabEMZB-7RIvCnd6iP60 Sep 08 11:15:52.907053 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 11:15:52.907053 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 11:15:52.907053 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 11:15:52.907053 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 11:15:52.907053 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 11:15:52.907053 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 11:15:52.907053 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 8309c65adcd147ba95df7ec8d6b8fb10 Sep 08 11:15:52.907053 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-970312101 Sep 08 11:15:52.907053 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 11:15:52.907053 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 11:15:52.907053 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8309c65adcd147ba95df7ec8d6b8fb10"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8309c65adcd147ba95df7ec8d6b8fb10"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8309c65adcd147ba95df7ec8d6b8fb10"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8309c65adcd147ba95df7ec8d6b8fb10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:15:52.907053 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-TestSecurityGroupsBasicOps-970312101 Sep 08 11:15:52.907053 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 8309c65adcd147ba95df7ec8d6b8fb10 Sep 08 11:15:52.907053 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-970312101 Sep 08 11:15:52.907053 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-TestSecurityGroupsBasicOps-970312101-project Sep 08 11:15:52.907053 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 11:15:52.907053 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 11:15:52.907053 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 7d9770721b674c489e0491156a7c5efc Sep 08 11:15:52.907053 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-TestSecurityGroupsBasicOps-970312101-project Sep 08 11:15:52.907053 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 11:15:52.907053 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 90938b52-4f78-45e5-aea8-4a74f5734b4a could not be found. Sep 08 11:15:52.907053 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '90938b52-4f78-45e5-aea8-4a74f5734b4a'} Sep 08 11:15:52.907053 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:15:52.907053 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:15:52.907053 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:15:52.907053 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:15:52.907053 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:15:52.907053 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:15:52.907053 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:15:52.907053 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:15:52.907053 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:15:52.907053 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:15:52.907053 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90938b52-4f78-45e5-aea8-4a74f5734b4a could not be found. Sep 08 11:15:52.907053 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:15:52.907053 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:15:52.907053 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:15:52.907053 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:15:52.907053 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:15:52.907053 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:15:52.907053 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:15:52.907053 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:15:52.907053 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:15:52.907053 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:15:52.907053 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:15:52.907053 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:15:52.907053 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:15:52.907053 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:15:52.907053 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:15:52.907053 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:15:52.907053 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90938b52-4f78-45e5-aea8-4a74f5734b4a could not be found. Sep 08 11:15:52.907053 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:15:52.907053 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:15:52.907053 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:15:52.910644 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:15:52.910644 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:15:52.910644 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:15:52.910644 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:15:52.910644 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:15:52.910644 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90938b52-4f78-45e5-aea8-4a74f5734b4a could not be found. Sep 08 11:15:52.910644 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:15:52.910644 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-51d6cc47-9e60-424f-a71e-85e40203d92d tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Returning 404 to user: Instance 90938b52-4f78-45e5-aea8-4a74f5734b4a could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:15:52.910644 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-51d6cc47-9e60-424f-a71e-85e40203d92d tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] 10.222.0.27 "GET /compute/v2.1/servers/90938b52-4f78-45e5-aea8-4a74f5734b4a" status: 404 len: 111 microversion: 2.1 time: 0.062713 Sep 08 11:15:52.922028 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2922/5960] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:52 2022] GET /compute/v2.1/servers/90938b52-4f78-45e5-aea8-4a74f5734b4a => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 11:15:52.933003 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7817306f-bfce-40e6-a233-a5e0065cffbf tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f3aa2815fd4dcc8767242bc5cd1c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f4fec1839448c28e7a0a3d16236ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:52.945978 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7817306f-bfce-40e6-a233-a5e0065cffbf tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] 10.222.0.27 "GET /compute/v2.1/servers/9426a1f8-7d16-47ec-af01-70d0c7766eb9" status: 200 len: 1428 microversion: 2.1 time: 0.301575 Sep 08 11:15:52.946587 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3039/5961] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:52 2022] GET /compute/v2.1/servers/9426a1f8-7d16-47ec-af01-70d0c7766eb9 => generated 1428 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:15:53.976319 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-07de9a98-86cf-4817-a46e-f389aa8aae4d tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:53.977625 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-07de9a98-86cf-4817-a46e-f389aa8aae4d tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] [instance: 9426a1f8-7d16-47ec-af01-70d0c7766eb9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:53.996988 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-07de9a98-86cf-4817-a46e-f389aa8aae4d tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:53.998259 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-07de9a98-86cf-4817-a46e-f389aa8aae4d tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:53.999169 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-07de9a98-86cf-4817-a46e-f389aa8aae4d tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:54.000540 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-07de9a98-86cf-4817-a46e-f389aa8aae4d tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:54.001212 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-07de9a98-86cf-4817-a46e-f389aa8aae4d tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:54.001820 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-07de9a98-86cf-4817-a46e-f389aa8aae4d tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:54.011664 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-504414fb-c7f7-4718-9dd6-d0468cf33966 req-00f0ef83-9368-492f-8a73-a9d43b989fe9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9426a1f8-7d16-47ec-af01-70d0c7766eb9", "name": "network-vif-plugged", "status": "completed", "tag": "bbc00306-8e8e-49d3-b545-cbe4ab9bdea8"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:15:54.039112 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-504414fb-c7f7-4718-9dd6-d0468cf33966 req-00f0ef83-9368-492f-8a73-a9d43b989fe9 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:54.043831 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-504414fb-c7f7-4718-9dd6-d0468cf33966 req-00f0ef83-9368-492f-8a73-a9d43b989fe9 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:54.046075 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-504414fb-c7f7-4718-9dd6-d0468cf33966 req-00f0ef83-9368-492f-8a73-a9d43b989fe9 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:54.073463 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:15:54.090471 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-504414fb-c7f7-4718-9dd6-d0468cf33966 req-00f0ef83-9368-492f-8a73-a9d43b989fe9 service nova] Creating event network-vif-plugged:bbc00306-8e8e-49d3-b545-cbe4ab9bdea8 for instance 9426a1f8-7d16-47ec-af01-70d0c7766eb9 on n-h1-850501-12 Sep 08 11:15:54.108278 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-504414fb-c7f7-4718-9dd6-d0468cf33966 req-00f0ef83-9368-492f-8a73-a9d43b989fe9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101758 Sep 08 11:15:54.109824 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3040/5962] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:15:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:15:54.402415 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-aa16ea5f-a233-406d-a778-324931af8658 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:54.403445 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-aa16ea5f-a233-406d-a778-324931af8658 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 85a3ba9d-cc78-422b-8327-4191b2067feb] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:54.424071 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aa16ea5f-a233-406d-a778-324931af8658 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:54.425081 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aa16ea5f-a233-406d-a778-324931af8658 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:54.426015 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aa16ea5f-a233-406d-a778-324931af8658 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:54.426962 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aa16ea5f-a233-406d-a778-324931af8658 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:54.427763 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aa16ea5f-a233-406d-a778-324931af8658 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:54.429000 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aa16ea5f-a233-406d-a778-324931af8658 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:54.567486 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-07de9a98-86cf-4817-a46e-f389aa8aae4d tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f3aa2815fd4dcc8767242bc5cd1c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f4fec1839448c28e7a0a3d16236ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:54.580320 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-07de9a98-86cf-4817-a46e-f389aa8aae4d tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] 10.222.0.27 "GET /compute/v2.1/servers/9426a1f8-7d16-47ec-af01-70d0c7766eb9" status: 200 len: 1428 microversion: 2.1 time: 0.608859 Sep 08 11:15:54.606404 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2923/5963] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:53 2022] GET /compute/v2.1/servers/9426a1f8-7d16-47ec-af01-70d0c7766eb9 => generated 1428 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:15:54.614335 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-9f83d8a0-e539-47c5-8277-d26d81e1c8e5 req-bf8df836-b43e-49d1-8279-8392f537234f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85a3ba9d-cc78-422b-8327-4191b2067feb", "tag": "6bdfb525-38ed-4bf1-b293-5310c08a39a1"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:15:54.628779 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-9f83d8a0-e539-47c5-8277-d26d81e1c8e5 req-bf8df836-b43e-49d1-8279-8392f537234f service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:54.629601 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-9f83d8a0-e539-47c5-8277-d26d81e1c8e5 req-bf8df836-b43e-49d1-8279-8392f537234f service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:54.630260 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-9f83d8a0-e539-47c5-8277-d26d81e1c8e5 req-bf8df836-b43e-49d1-8279-8392f537234f service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:54.644605 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-9f83d8a0-e539-47c5-8277-d26d81e1c8e5 req-bf8df836-b43e-49d1-8279-8392f537234f service nova] Creating event network-changed:6bdfb525-38ed-4bf1-b293-5310c08a39a1 for instance 85a3ba9d-cc78-422b-8327-4191b2067feb on n-h2-850501-12 Sep 08 11:15:54.655315 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-9f83d8a0-e539-47c5-8277-d26d81e1c8e5 req-bf8df836-b43e-49d1-8279-8392f537234f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046855 Sep 08 11:15:54.656672 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2924/5964] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:15:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:15:55.135359 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-aa16ea5f-a233-406d-a778-324931af8658 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:55.157362 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-aa16ea5f-a233-406d-a778-324931af8658 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb" status: 200 len: 1565 microversion: 2.1 time: 0.764249 Sep 08 11:15:55.159290 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3041/5965] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:54 2022] GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb => generated 1565 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:15:55.621511 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a17d1f93-7ef4-4763-932c-47cab03531de tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:55.622857 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a17d1f93-7ef4-4763-932c-47cab03531de tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] [instance: 9426a1f8-7d16-47ec-af01-70d0c7766eb9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:55.629642 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a17d1f93-7ef4-4763-932c-47cab03531de tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:55.630519 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a17d1f93-7ef4-4763-932c-47cab03531de tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:55.631181 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a17d1f93-7ef4-4763-932c-47cab03531de tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:55.632185 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a17d1f93-7ef4-4763-932c-47cab03531de tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:55.632802 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a17d1f93-7ef4-4763-932c-47cab03531de tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:55.633433 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a17d1f93-7ef4-4763-932c-47cab03531de tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:55.904372 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1aed51eb-01f8-4251-93fc-8f19be0c8795 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:15:55.906013 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1aed51eb-01f8-4251-93fc-8f19be0c8795 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: 67dca3fd-4bba-447a-9af9-0aacf1dd5451] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:55.925663 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1aed51eb-01f8-4251-93fc-8f19be0c8795 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:55.926584 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1aed51eb-01f8-4251-93fc-8f19be0c8795 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:55.927294 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1aed51eb-01f8-4251-93fc-8f19be0c8795 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:55.929267 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1aed51eb-01f8-4251-93fc-8f19be0c8795 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:55.929945 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1aed51eb-01f8-4251-93fc-8f19be0c8795 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:55.930656 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1aed51eb-01f8-4251-93fc-8f19be0c8795 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:55.943884 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a17d1f93-7ef4-4763-932c-47cab03531de tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f3aa2815fd4dcc8767242bc5cd1c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f4fec1839448c28e7a0a3d16236ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:55.954208 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a17d1f93-7ef4-4763-932c-47cab03531de tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] 10.222.0.27 "GET /compute/v2.1/servers/9426a1f8-7d16-47ec-af01-70d0c7766eb9" status: 200 len: 1428 microversion: 2.1 time: 0.338645 Sep 08 11:15:55.955838 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2925/5966] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:55 2022] GET /compute/v2.1/servers/9426a1f8-7d16-47ec-af01-70d0c7766eb9 => generated 1428 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:15:55.981552 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-1aed51eb-01f8-4251-93fc-8f19be0c8795 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lazy-loading 'flavor' on Instance uuid 67dca3fd-4bba-447a-9af9-0aacf1dd5451 {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:15:56.257680 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1aed51eb-01f8-4251-93fc-8f19be0c8795 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "POST /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451/action" status: 202 len: 0 microversion: 2.20 time: 0.359993 Sep 08 11:15:56.258447 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3042/5967] 10.222.0.27 () {62 vars in 1319 bytes} [Thu Sep 8 11:15:55 2022] POST /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451/action => generated 0 bytes in 363 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:15:56.268299 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1a147a2e-1272-4c32-b7e8-3fcd12e5bef8 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:56.268977 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1a147a2e-1272-4c32-b7e8-3fcd12e5bef8 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: 67dca3fd-4bba-447a-9af9-0aacf1dd5451] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:56.280906 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1a147a2e-1272-4c32-b7e8-3fcd12e5bef8 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:56.282922 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1a147a2e-1272-4c32-b7e8-3fcd12e5bef8 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:56.283577 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1a147a2e-1272-4c32-b7e8-3fcd12e5bef8 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:56.285003 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1a147a2e-1272-4c32-b7e8-3fcd12e5bef8 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:56.285939 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1a147a2e-1272-4c32-b7e8-3fcd12e5bef8 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:56.288797 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1a147a2e-1272-4c32-b7e8-3fcd12e5bef8 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:56.888569 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1a147a2e-1272-4c32-b7e8-3fcd12e5bef8 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:56.901952 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1a147a2e-1272-4c32-b7e8-3fcd12e5bef8 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:56.903741 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1a147a2e-1272-4c32-b7e8-3fcd12e5bef8 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:56.905217 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1a147a2e-1272-4c32-b7e8-3fcd12e5bef8 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451" status: 200 len: 1723 microversion: 2.20 time: 0.641285 Sep 08 11:15:56.906334 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2926/5968] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:15:56 2022] GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451 => generated 1723 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:15:56.984976 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2627bda7-5c21-439a-a485-2049bfad0671 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:56.986221 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2627bda7-5c21-439a-a485-2049bfad0671 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] [instance: 9426a1f8-7d16-47ec-af01-70d0c7766eb9] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:56.997577 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2627bda7-5c21-439a-a485-2049bfad0671 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:56.998433 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2627bda7-5c21-439a-a485-2049bfad0671 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:56.999211 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2627bda7-5c21-439a-a485-2049bfad0671 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:57.000392 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2627bda7-5c21-439a-a485-2049bfad0671 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:57.001010 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2627bda7-5c21-439a-a485-2049bfad0671 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:57.001736 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2627bda7-5c21-439a-a485-2049bfad0671 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:57.216157 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2627bda7-5c21-439a-a485-2049bfad0671 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f3aa2815fd4dcc8767242bc5cd1c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f4fec1839448c28e7a0a3d16236ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:57.237279 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2627bda7-5c21-439a-a485-2049bfad0671 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] 10.222.0.27 "GET /compute/v2.1/servers/9426a1f8-7d16-47ec-af01-70d0c7766eb9" status: 200 len: 1609 microversion: 2.1 time: 0.260881 Sep 08 11:15:57.259738 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3043/5969] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:56 2022] GET /compute/v2.1/servers/9426a1f8-7d16-47ec-af01-70d0c7766eb9 => generated 1609 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:15:57.280894 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-df807efa-4f21-4ef5-9c83-9f77d8579a79 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:57.281723 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-df807efa-4f21-4ef5-9c83-9f77d8579a79 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] [instance: 9426a1f8-7d16-47ec-af01-70d0c7766eb9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:57.292943 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df807efa-4f21-4ef5-9c83-9f77d8579a79 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:57.293597 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df807efa-4f21-4ef5-9c83-9f77d8579a79 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:57.294115 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df807efa-4f21-4ef5-9c83-9f77d8579a79 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:57.298856 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df807efa-4f21-4ef5-9c83-9f77d8579a79 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:57.299720 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df807efa-4f21-4ef5-9c83-9f77d8579a79 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:57.300257 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df807efa-4f21-4ef5-9c83-9f77d8579a79 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:57.745810 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-df807efa-4f21-4ef5-9c83-9f77d8579a79 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f3aa2815fd4dcc8767242bc5cd1c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f4fec1839448c28e7a0a3d16236ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:57.763726 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-df807efa-4f21-4ef5-9c83-9f77d8579a79 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] 10.222.0.27 "GET /compute/v2.1/servers/9426a1f8-7d16-47ec-af01-70d0c7766eb9" status: 200 len: 1609 microversion: 2.1 time: 0.487846 Sep 08 11:15:57.770408 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2927/5970] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:57 2022] GET /compute/v2.1/servers/9426a1f8-7d16-47ec-af01-70d0c7766eb9 => generated 1609 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:15:57.793124 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-06068c16-0bcf-4d33-a88a-2d77cac33b2f tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:57.794231 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-06068c16-0bcf-4d33-a88a-2d77cac33b2f tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] [instance: 9426a1f8-7d16-47ec-af01-70d0c7766eb9] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:57.800805 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06068c16-0bcf-4d33-a88a-2d77cac33b2f tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:57.801646 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06068c16-0bcf-4d33-a88a-2d77cac33b2f tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:57.802274 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06068c16-0bcf-4d33-a88a-2d77cac33b2f tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:57.804125 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06068c16-0bcf-4d33-a88a-2d77cac33b2f tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:57.804846 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06068c16-0bcf-4d33-a88a-2d77cac33b2f tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:57.805477 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06068c16-0bcf-4d33-a88a-2d77cac33b2f tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:57.932313 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8d94739c-3216-4426-baad-0f5e18b648b1 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:57.932914 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8d94739c-3216-4426-baad-0f5e18b648b1 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: 67dca3fd-4bba-447a-9af9-0aacf1dd5451] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:57.940449 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d94739c-3216-4426-baad-0f5e18b648b1 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:57.941303 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d94739c-3216-4426-baad-0f5e18b648b1 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:57.941980 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d94739c-3216-4426-baad-0f5e18b648b1 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:57.942939 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d94739c-3216-4426-baad-0f5e18b648b1 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:57.944276 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d94739c-3216-4426-baad-0f5e18b648b1 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:57.945017 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d94739c-3216-4426-baad-0f5e18b648b1 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:57.989639 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-06068c16-0bcf-4d33-a88a-2d77cac33b2f tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f3aa2815fd4dcc8767242bc5cd1c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f4fec1839448c28e7a0a3d16236ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:58.000559 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-06068c16-0bcf-4d33-a88a-2d77cac33b2f tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] 10.222.0.27 "GET /compute/v2.1/servers/9426a1f8-7d16-47ec-af01-70d0c7766eb9" status: 200 len: 1609 microversion: 2.1 time: 0.211654 Sep 08 11:15:58.018410 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3044/5971] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:57 2022] GET /compute/v2.1/servers/9426a1f8-7d16-47ec-af01-70d0c7766eb9 => generated 1609 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:15:58.263959 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8d94739c-3216-4426-baad-0f5e18b648b1 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:58.276562 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8d94739c-3216-4426-baad-0f5e18b648b1 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:58.278370 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8d94739c-3216-4426-baad-0f5e18b648b1 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:58.279673 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8d94739c-3216-4426-baad-0f5e18b648b1 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451" status: 200 len: 1723 microversion: 2.20 time: 0.352897 Sep 08 11:15:58.280241 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2928/5972] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:15:57 2022] GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451 => generated 1723 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:15:59.130556 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ade6e69a-ab1e-4d7e-9338-9d13edb1a1d8 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] Calling method '.version_select at 0x7f68e406b1f0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:59.152468 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ade6e69a-ab1e-4d7e-9338-9d13edb1a1d8 tempest-TestSecurityGroupsBasicOps-970312101 tempest-TestSecurityGroupsBasicOps-970312101-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-745299918" status: 202 len: 0 microversion: 2.1 time: 0.026078 Sep 08 11:15:59.156337 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3045/5973] 10.222.0.27 () {58 vars in 1275 bytes} [Thu Sep 8 11:15:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-745299918 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:15:59.311325 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-32fb617e-3d23-4c5b-a176-18162d2500b5 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:59.313218 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-32fb617e-3d23-4c5b-a176-18162d2500b5 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: 67dca3fd-4bba-447a-9af9-0aacf1dd5451] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:59.316503 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:15:59.325513 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-32fb617e-3d23-4c5b-a176-18162d2500b5 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:59.328578 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-32fb617e-3d23-4c5b-a176-18162d2500b5 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:59.333545 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-32fb617e-3d23-4c5b-a176-18162d2500b5 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:59.336039 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-32fb617e-3d23-4c5b-a176-18162d2500b5 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:59.337496 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-32fb617e-3d23-4c5b-a176-18162d2500b5 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:59.338447 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-32fb617e-3d23-4c5b-a176-18162d2500b5 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:59.562503 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-32fb617e-3d23-4c5b-a176-18162d2500b5 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:59.574688 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-32fb617e-3d23-4c5b-a176-18162d2500b5 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:59.576380 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-32fb617e-3d23-4c5b-a176-18162d2500b5 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:59.577964 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-32fb617e-3d23-4c5b-a176-18162d2500b5 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451" status: 200 len: 1723 microversion: 2.20 time: 0.270795 Sep 08 11:15:59.578723 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2929/5974] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:15:59 2022] GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451 => generated 1723 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:16:00.608452 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-939dd8eb-b20c-477d-8005-3585b2cde333 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:00.609381 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-939dd8eb-b20c-477d-8005-3585b2cde333 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: 67dca3fd-4bba-447a-9af9-0aacf1dd5451] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:00.639283 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-939dd8eb-b20c-477d-8005-3585b2cde333 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:00.644184 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-43812c09-c215-4614-90cd-21bb13fcbf6c req-e63fc757-3829-4650-acc8-6126a242c3fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9426a1f8-7d16-47ec-af01-70d0c7766eb9", "tag": "bbc00306-8e8e-49d3-b545-cbe4ab9bdea8"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:16:00.647495 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-939dd8eb-b20c-477d-8005-3585b2cde333 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:00.652953 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-939dd8eb-b20c-477d-8005-3585b2cde333 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:00.654691 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-939dd8eb-b20c-477d-8005-3585b2cde333 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:00.660503 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-43812c09-c215-4614-90cd-21bb13fcbf6c req-e63fc757-3829-4650-acc8-6126a242c3fe service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:00.661282 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-939dd8eb-b20c-477d-8005-3585b2cde333 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:00.661941 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-43812c09-c215-4614-90cd-21bb13fcbf6c req-e63fc757-3829-4650-acc8-6126a242c3fe service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:00.662891 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-43812c09-c215-4614-90cd-21bb13fcbf6c req-e63fc757-3829-4650-acc8-6126a242c3fe service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:00.682273 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-43812c09-c215-4614-90cd-21bb13fcbf6c req-e63fc757-3829-4650-acc8-6126a242c3fe service nova] Creating event network-changed:bbc00306-8e8e-49d3-b545-cbe4ab9bdea8 for instance 9426a1f8-7d16-47ec-af01-70d0c7766eb9 on n-h1-850501-12 Sep 08 11:16:00.686063 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-939dd8eb-b20c-477d-8005-3585b2cde333 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:00.690299 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-43812c09-c215-4614-90cd-21bb13fcbf6c req-e63fc757-3829-4650-acc8-6126a242c3fe service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056267 Sep 08 11:16:00.697171 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2930/5975] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:16:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:16:01.024241 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-939dd8eb-b20c-477d-8005-3585b2cde333 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:01.036421 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-939dd8eb-b20c-477d-8005-3585b2cde333 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:01.038915 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-939dd8eb-b20c-477d-8005-3585b2cde333 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:01.058591 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-939dd8eb-b20c-477d-8005-3585b2cde333 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451" status: 200 len: 1723 microversion: 2.20 time: 0.454836 Sep 08 11:16:01.076607 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3046/5976] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:16:00 2022] GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451 => generated 1723 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:16:02.089705 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fe4a85f2-db4a-4af2-8039-acc97f4a030f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:02.091046 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fe4a85f2-db4a-4af2-8039-acc97f4a030f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: 67dca3fd-4bba-447a-9af9-0aacf1dd5451] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:02.105164 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fe4a85f2-db4a-4af2-8039-acc97f4a030f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:02.105828 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fe4a85f2-db4a-4af2-8039-acc97f4a030f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:02.106399 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fe4a85f2-db4a-4af2-8039-acc97f4a030f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:02.107205 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fe4a85f2-db4a-4af2-8039-acc97f4a030f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:02.107743 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fe4a85f2-db4a-4af2-8039-acc97f4a030f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:02.108282 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fe4a85f2-db4a-4af2-8039-acc97f4a030f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:02.306693 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fe4a85f2-db4a-4af2-8039-acc97f4a030f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:02.320709 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fe4a85f2-db4a-4af2-8039-acc97f4a030f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:02.323144 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fe4a85f2-db4a-4af2-8039-acc97f4a030f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:02.325545 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fe4a85f2-db4a-4af2-8039-acc97f4a030f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451" status: 200 len: 1723 microversion: 2.20 time: 0.240097 Sep 08 11:16:02.326662 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2931/5977] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:16:02 2022] GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451 => generated 1723 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:16:03.355047 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7a96c35f-c771-440b-b9e7-0c564999ce6c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:03.356122 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7a96c35f-c771-440b-b9e7-0c564999ce6c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: 67dca3fd-4bba-447a-9af9-0aacf1dd5451] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:03.366025 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a96c35f-c771-440b-b9e7-0c564999ce6c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:03.366735 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a96c35f-c771-440b-b9e7-0c564999ce6c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:03.367591 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a96c35f-c771-440b-b9e7-0c564999ce6c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:03.368657 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a96c35f-c771-440b-b9e7-0c564999ce6c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:03.369353 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a96c35f-c771-440b-b9e7-0c564999ce6c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:03.369966 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a96c35f-c771-440b-b9e7-0c564999ce6c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:03.613702 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7a96c35f-c771-440b-b9e7-0c564999ce6c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:03.627155 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7a96c35f-c771-440b-b9e7-0c564999ce6c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:03.628623 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7a96c35f-c771-440b-b9e7-0c564999ce6c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:03.629831 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7a96c35f-c771-440b-b9e7-0c564999ce6c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451" status: 200 len: 1723 microversion: 2.20 time: 0.281493 Sep 08 11:16:03.648623 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3047/5978] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:16:03 2022] GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451 => generated 1723 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 11:16:04.658375 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c822f4b4-1785-48e7-b290-d59ccbfe37d4 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:04.659771 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c822f4b4-1785-48e7-b290-d59ccbfe37d4 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: 67dca3fd-4bba-447a-9af9-0aacf1dd5451] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:04.668297 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c822f4b4-1785-48e7-b290-d59ccbfe37d4 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:04.668893 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c822f4b4-1785-48e7-b290-d59ccbfe37d4 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:04.669497 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c822f4b4-1785-48e7-b290-d59ccbfe37d4 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:04.670290 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c822f4b4-1785-48e7-b290-d59ccbfe37d4 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:04.670970 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c822f4b4-1785-48e7-b290-d59ccbfe37d4 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:04.678342 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c822f4b4-1785-48e7-b290-d59ccbfe37d4 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:05.009561 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c822f4b4-1785-48e7-b290-d59ccbfe37d4 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:05.025587 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c822f4b4-1785-48e7-b290-d59ccbfe37d4 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:05.032849 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c822f4b4-1785-48e7-b290-d59ccbfe37d4 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:05.034372 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c822f4b4-1785-48e7-b290-d59ccbfe37d4 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451" status: 200 len: 1723 microversion: 2.20 time: 0.381573 Sep 08 11:16:05.035378 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2932/5979] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:16:04 2022] GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451 => generated 1723 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:16:06.075705 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-801f717c-c836-49a4-84ef-6289c24536c7 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:06.077455 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-801f717c-c836-49a4-84ef-6289c24536c7 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: 67dca3fd-4bba-447a-9af9-0aacf1dd5451] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:06.096121 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-801f717c-c836-49a4-84ef-6289c24536c7 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:06.097217 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-801f717c-c836-49a4-84ef-6289c24536c7 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:06.098064 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-801f717c-c836-49a4-84ef-6289c24536c7 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:06.099884 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-801f717c-c836-49a4-84ef-6289c24536c7 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:06.100768 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-801f717c-c836-49a4-84ef-6289c24536c7 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:06.101886 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-801f717c-c836-49a4-84ef-6289c24536c7 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:06.372104 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-801f717c-c836-49a4-84ef-6289c24536c7 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:06.392449 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-801f717c-c836-49a4-84ef-6289c24536c7 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:06.395836 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-801f717c-c836-49a4-84ef-6289c24536c7 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:06.399722 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-801f717c-c836-49a4-84ef-6289c24536c7 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451" status: 200 len: 1723 microversion: 2.20 time: 0.330780 Sep 08 11:16:06.410287 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3048/5980] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:16:06 2022] GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451 => generated 1723 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:16:07.439123 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7acd3653-3754-4f72-b4ec-67ac20116b28 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:07.440314 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7acd3653-3754-4f72-b4ec-67ac20116b28 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: 67dca3fd-4bba-447a-9af9-0aacf1dd5451] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:07.452769 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7acd3653-3754-4f72-b4ec-67ac20116b28 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:07.454762 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7acd3653-3754-4f72-b4ec-67ac20116b28 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:07.467399 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7acd3653-3754-4f72-b4ec-67ac20116b28 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:07.468588 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7acd3653-3754-4f72-b4ec-67ac20116b28 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:07.469300 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7acd3653-3754-4f72-b4ec-67ac20116b28 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:07.469977 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7acd3653-3754-4f72-b4ec-67ac20116b28 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:07.838906 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7acd3653-3754-4f72-b4ec-67ac20116b28 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:07.854854 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7acd3653-3754-4f72-b4ec-67ac20116b28 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:07.856680 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7acd3653-3754-4f72-b4ec-67ac20116b28 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:07.858589 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7acd3653-3754-4f72-b4ec-67ac20116b28 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451" status: 200 len: 1723 microversion: 2.20 time: 0.423475 Sep 08 11:16:07.860179 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2933/5981] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:16:07 2022] GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451 => generated 1723 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:16:08.896849 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bb282cfc-d492-4ee4-a216-aaf4c0a39a10 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:08.898203 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bb282cfc-d492-4ee4-a216-aaf4c0a39a10 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: 67dca3fd-4bba-447a-9af9-0aacf1dd5451] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:08.902922 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:16:08.928856 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bb282cfc-d492-4ee4-a216-aaf4c0a39a10 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:08.930268 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bb282cfc-d492-4ee4-a216-aaf4c0a39a10 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:08.930923 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bb282cfc-d492-4ee4-a216-aaf4c0a39a10 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:08.931888 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bb282cfc-d492-4ee4-a216-aaf4c0a39a10 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:08.932557 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bb282cfc-d492-4ee4-a216-aaf4c0a39a10 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:08.933810 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bb282cfc-d492-4ee4-a216-aaf4c0a39a10 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:09.263193 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-bb282cfc-d492-4ee4-a216-aaf4c0a39a10 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:09.276088 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-bb282cfc-d492-4ee4-a216-aaf4c0a39a10 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:09.281494 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-bb282cfc-d492-4ee4-a216-aaf4c0a39a10 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:09.282761 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bb282cfc-d492-4ee4-a216-aaf4c0a39a10 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451" status: 200 len: 1723 microversion: 2.20 time: 0.400169 Sep 08 11:16:09.283355 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3049/5982] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:16:08 2022] GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451 => generated 1723 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 11:16:10.322620 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c0b4ba8d-ef1d-48e7-859a-05126f89ca86 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:10.323445 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c0b4ba8d-ef1d-48e7-859a-05126f89ca86 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: 67dca3fd-4bba-447a-9af9-0aacf1dd5451] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:10.335596 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c0b4ba8d-ef1d-48e7-859a-05126f89ca86 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:10.338497 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c0b4ba8d-ef1d-48e7-859a-05126f89ca86 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:10.340036 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c0b4ba8d-ef1d-48e7-859a-05126f89ca86 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:10.340936 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c0b4ba8d-ef1d-48e7-859a-05126f89ca86 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:10.342520 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c0b4ba8d-ef1d-48e7-859a-05126f89ca86 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:10.345641 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c0b4ba8d-ef1d-48e7-859a-05126f89ca86 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:10.570276 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c0b4ba8d-ef1d-48e7-859a-05126f89ca86 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:10.582050 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c0b4ba8d-ef1d-48e7-859a-05126f89ca86 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:10.583944 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c0b4ba8d-ef1d-48e7-859a-05126f89ca86 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:10.585967 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c0b4ba8d-ef1d-48e7-859a-05126f89ca86 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451" status: 200 len: 1723 microversion: 2.20 time: 0.272097 Sep 08 11:16:10.602383 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2934/5983] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:16:10 2022] GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451 => generated 1723 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 11:16:11.614200 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d0b28506-72ba-4993-956e-70898c63cbec tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:11.615067 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d0b28506-72ba-4993-956e-70898c63cbec tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: 67dca3fd-4bba-447a-9af9-0aacf1dd5451] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:11.628849 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d0b28506-72ba-4993-956e-70898c63cbec tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:11.629503 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d0b28506-72ba-4993-956e-70898c63cbec tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:11.629943 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d0b28506-72ba-4993-956e-70898c63cbec tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:11.630991 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d0b28506-72ba-4993-956e-70898c63cbec tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:11.633114 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d0b28506-72ba-4993-956e-70898c63cbec tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:11.634013 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d0b28506-72ba-4993-956e-70898c63cbec tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:11.958115 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d0b28506-72ba-4993-956e-70898c63cbec tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:11.974806 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d0b28506-72ba-4993-956e-70898c63cbec tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:11.978633 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d0b28506-72ba-4993-956e-70898c63cbec tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:11.980714 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d0b28506-72ba-4993-956e-70898c63cbec tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451" status: 200 len: 1723 microversion: 2.20 time: 0.371076 Sep 08 11:16:11.982499 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3050/5984] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:16:11 2022] GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451 => generated 1723 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:16:13.011670 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-87c9b92e-0a98-41fe-83e3-0b58c307f097 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:13.012334 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-87c9b92e-0a98-41fe-83e3-0b58c307f097 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: 67dca3fd-4bba-447a-9af9-0aacf1dd5451] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:13.036906 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87c9b92e-0a98-41fe-83e3-0b58c307f097 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:13.042968 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87c9b92e-0a98-41fe-83e3-0b58c307f097 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:13.045013 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87c9b92e-0a98-41fe-83e3-0b58c307f097 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:13.051701 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87c9b92e-0a98-41fe-83e3-0b58c307f097 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:13.054923 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87c9b92e-0a98-41fe-83e3-0b58c307f097 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:13.057267 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87c9b92e-0a98-41fe-83e3-0b58c307f097 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:13.324566 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-87c9b92e-0a98-41fe-83e3-0b58c307f097 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:13.339880 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-87c9b92e-0a98-41fe-83e3-0b58c307f097 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:13.341868 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-87c9b92e-0a98-41fe-83e3-0b58c307f097 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:13.343121 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-87c9b92e-0a98-41fe-83e3-0b58c307f097 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451" status: 200 len: 1744 microversion: 2.20 time: 0.336442 Sep 08 11:16:13.345295 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2935/5985] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:16:13 2022] GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451 => generated 1744 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:16:14.374574 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-66286d32-a98a-47fd-898e-bcf5f814b2e5 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:14.377928 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-66286d32-a98a-47fd-898e-bcf5f814b2e5 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: 67dca3fd-4bba-447a-9af9-0aacf1dd5451] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:14.387653 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-66286d32-a98a-47fd-898e-bcf5f814b2e5 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:14.388648 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-66286d32-a98a-47fd-898e-bcf5f814b2e5 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:14.389890 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-66286d32-a98a-47fd-898e-bcf5f814b2e5 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:14.391125 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-66286d32-a98a-47fd-898e-bcf5f814b2e5 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:14.391798 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-66286d32-a98a-47fd-898e-bcf5f814b2e5 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:14.392726 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-66286d32-a98a-47fd-898e-bcf5f814b2e5 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:14.665710 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-712a2b84-3b92-4cad-976c-4740f66bd2c0 req-220e1df9-8d0e-48b5-a442-46180b8b0fb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67dca3fd-4bba-447a-9af9-0aacf1dd5451", "name": "network-vif-plugged", "status": "completed", "tag": "242cd08b-a4b9-4348-bfc9-024fa3eaf821"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:16:14.688592 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-712a2b84-3b92-4cad-976c-4740f66bd2c0 req-220e1df9-8d0e-48b5-a442-46180b8b0fb3 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:14.694047 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-66286d32-a98a-47fd-898e-bcf5f814b2e5 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:14.705984 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-66286d32-a98a-47fd-898e-bcf5f814b2e5 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:14.713781 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-712a2b84-3b92-4cad-976c-4740f66bd2c0 req-220e1df9-8d0e-48b5-a442-46180b8b0fb3 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:14.714350 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-66286d32-a98a-47fd-898e-bcf5f814b2e5 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:14.715010 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-712a2b84-3b92-4cad-976c-4740f66bd2c0 req-220e1df9-8d0e-48b5-a442-46180b8b0fb3 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:14.715962 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-66286d32-a98a-47fd-898e-bcf5f814b2e5 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451" status: 200 len: 1744 microversion: 2.20 time: 0.346887 Sep 08 11:16:14.725832 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3051/5986] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:16:14 2022] GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451 => generated 1744 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 11:16:14.750083 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:16:14.761273 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-712a2b84-3b92-4cad-976c-4740f66bd2c0 req-220e1df9-8d0e-48b5-a442-46180b8b0fb3 service nova] Creating event network-vif-plugged:242cd08b-a4b9-4348-bfc9-024fa3eaf821 for instance 67dca3fd-4bba-447a-9af9-0aacf1dd5451 on n-h2-850501-12 Sep 08 11:16:14.771991 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-712a2b84-3b92-4cad-976c-4740f66bd2c0 req-220e1df9-8d0e-48b5-a442-46180b8b0fb3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111693 Sep 08 11:16:14.777923 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2936/5987] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:16:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:16:15.752121 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3a4b452a-4def-4ab2-8fe9-c94a4da9ab78 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:15.753068 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3a4b452a-4def-4ab2-8fe9-c94a4da9ab78 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: 67dca3fd-4bba-447a-9af9-0aacf1dd5451] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:15.773672 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3a4b452a-4def-4ab2-8fe9-c94a4da9ab78 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:15.774177 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3a4b452a-4def-4ab2-8fe9-c94a4da9ab78 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:15.774618 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3a4b452a-4def-4ab2-8fe9-c94a4da9ab78 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:15.775343 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3a4b452a-4def-4ab2-8fe9-c94a4da9ab78 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:15.781938 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3a4b452a-4def-4ab2-8fe9-c94a4da9ab78 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:15.782422 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3a4b452a-4def-4ab2-8fe9-c94a4da9ab78 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:16.237289 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-3a4b452a-4def-4ab2-8fe9-c94a4da9ab78 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:16.252478 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-3a4b452a-4def-4ab2-8fe9-c94a4da9ab78 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:16.253999 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-3a4b452a-4def-4ab2-8fe9-c94a4da9ab78 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:16.255434 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3a4b452a-4def-4ab2-8fe9-c94a4da9ab78 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451" status: 200 len: 1739 microversion: 2.20 time: 0.507778 Sep 08 11:16:16.256094 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3052/5988] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:16:15 2022] GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451 => generated 1739 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 11:16:17.324110 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a2733178-8615-4fb5-9c09-645d2517aaea tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:17.324817 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a2733178-8615-4fb5-9c09-645d2517aaea tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: 67dca3fd-4bba-447a-9af9-0aacf1dd5451] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:17.347719 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2733178-8615-4fb5-9c09-645d2517aaea tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:17.348357 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2733178-8615-4fb5-9c09-645d2517aaea tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:17.348942 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2733178-8615-4fb5-9c09-645d2517aaea tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:17.349896 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2733178-8615-4fb5-9c09-645d2517aaea tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:17.350478 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2733178-8615-4fb5-9c09-645d2517aaea tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:17.350983 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2733178-8615-4fb5-9c09-645d2517aaea tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:17.690138 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a2733178-8615-4fb5-9c09-645d2517aaea tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:17.702933 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a2733178-8615-4fb5-9c09-645d2517aaea tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:17.706620 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a2733178-8615-4fb5-9c09-645d2517aaea tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:17.715667 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a2733178-8615-4fb5-9c09-645d2517aaea tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451" status: 200 len: 1739 microversion: 2.20 time: 0.412812 Sep 08 11:16:17.731899 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2937/5989] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:16:17 2022] GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451 => generated 1739 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:16:18.754192 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ed67102b-eacc-4865-9cb3-d674354ca720 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:18.754981 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ed67102b-eacc-4865-9cb3-d674354ca720 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: 67dca3fd-4bba-447a-9af9-0aacf1dd5451] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:18.771531 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed67102b-eacc-4865-9cb3-d674354ca720 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:18.774026 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed67102b-eacc-4865-9cb3-d674354ca720 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:18.774026 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed67102b-eacc-4865-9cb3-d674354ca720 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:18.776484 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed67102b-eacc-4865-9cb3-d674354ca720 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:18.776484 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed67102b-eacc-4865-9cb3-d674354ca720 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:18.777442 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed67102b-eacc-4865-9cb3-d674354ca720 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:18.967882 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-87b08465-5288-48c4-bfce-fb508c7e4734 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:16:18.975620 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-87b08465-5288-48c4-bfce-fb508c7e4734 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 85a3ba9d-cc78-422b-8327-4191b2067feb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:19.010132 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87b08465-5288-48c4-bfce-fb508c7e4734 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:19.011311 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87b08465-5288-48c4-bfce-fb508c7e4734 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:19.013046 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87b08465-5288-48c4-bfce-fb508c7e4734 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:19.014896 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87b08465-5288-48c4-bfce-fb508c7e4734 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:19.016151 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87b08465-5288-48c4-bfce-fb508c7e4734 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:19.017217 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87b08465-5288-48c4-bfce-fb508c7e4734 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:19.111836 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ed67102b-eacc-4865-9cb3-d674354ca720 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:19.124781 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ed67102b-eacc-4865-9cb3-d674354ca720 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:19.129374 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ed67102b-eacc-4865-9cb3-d674354ca720 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:19.132086 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ed67102b-eacc-4865-9cb3-d674354ca720 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451" status: 200 len: 1739 microversion: 2.20 time: 0.381997 Sep 08 11:16:19.134941 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3053/5990] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:16:18 2022] GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451 => generated 1739 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:16:19.164575 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-87b08465-5288-48c4-bfce-fb508c7e4734 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "POST /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb/action" status: 200 len: 24531 microversion: 2.1 time: 0.225352 Sep 08 11:16:19.165633 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2938/5991] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 11:16:18 2022] POST /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb/action => generated 24531 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 11:16:20.160901 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c1cb973a-6403-4caa-8d78-a8a159840dd3 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:20.162633 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c1cb973a-6403-4caa-8d78-a8a159840dd3 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: 67dca3fd-4bba-447a-9af9-0aacf1dd5451] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:20.179751 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c1cb973a-6403-4caa-8d78-a8a159840dd3 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:20.182007 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c1cb973a-6403-4caa-8d78-a8a159840dd3 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:20.186424 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c1cb973a-6403-4caa-8d78-a8a159840dd3 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:20.188402 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c1cb973a-6403-4caa-8d78-a8a159840dd3 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:20.189317 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c1cb973a-6403-4caa-8d78-a8a159840dd3 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:20.190053 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c1cb973a-6403-4caa-8d78-a8a159840dd3 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:20.546737 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c1cb973a-6403-4caa-8d78-a8a159840dd3 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:20.559648 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c1cb973a-6403-4caa-8d78-a8a159840dd3 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:20.561300 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c1cb973a-6403-4caa-8d78-a8a159840dd3 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:20.562596 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c1cb973a-6403-4caa-8d78-a8a159840dd3 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451" status: 200 len: 1739 microversion: 2.20 time: 0.405977 Sep 08 11:16:20.581282 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3054/5992] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:16:20 2022] GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451 => generated 1739 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:16:21.609579 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-24287dcb-79c1-4234-bc3c-cf0f12132e84 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:21.611294 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-24287dcb-79c1-4234-bc3c-cf0f12132e84 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: 67dca3fd-4bba-447a-9af9-0aacf1dd5451] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:21.629982 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-24287dcb-79c1-4234-bc3c-cf0f12132e84 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:21.634499 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-24287dcb-79c1-4234-bc3c-cf0f12132e84 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:21.638553 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-24287dcb-79c1-4234-bc3c-cf0f12132e84 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:21.639493 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-24287dcb-79c1-4234-bc3c-cf0f12132e84 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:21.649082 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-24287dcb-79c1-4234-bc3c-cf0f12132e84 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:21.653897 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-24287dcb-79c1-4234-bc3c-cf0f12132e84 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:22.053892 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-24287dcb-79c1-4234-bc3c-cf0f12132e84 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:22.085532 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-24287dcb-79c1-4234-bc3c-cf0f12132e84 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:22.088197 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-24287dcb-79c1-4234-bc3c-cf0f12132e84 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:22.090464 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-24287dcb-79c1-4234-bc3c-cf0f12132e84 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451" status: 200 len: 1739 microversion: 2.20 time: 0.487802 Sep 08 11:16:22.092457 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2939/5993] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:16:21 2022] GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451 => generated 1739 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:16:23.118206 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9e3fd009-c80e-4527-aaa3-7fcb4b218106 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:23.119457 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9e3fd009-c80e-4527-aaa3-7fcb4b218106 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: 67dca3fd-4bba-447a-9af9-0aacf1dd5451] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:23.133822 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e3fd009-c80e-4527-aaa3-7fcb4b218106 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:23.134675 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e3fd009-c80e-4527-aaa3-7fcb4b218106 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:23.136043 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e3fd009-c80e-4527-aaa3-7fcb4b218106 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:23.137060 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e3fd009-c80e-4527-aaa3-7fcb4b218106 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:23.138444 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e3fd009-c80e-4527-aaa3-7fcb4b218106 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:23.147408 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e3fd009-c80e-4527-aaa3-7fcb4b218106 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:23.392445 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9e3fd009-c80e-4527-aaa3-7fcb4b218106 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:23.447233 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9e3fd009-c80e-4527-aaa3-7fcb4b218106 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:23.459037 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9e3fd009-c80e-4527-aaa3-7fcb4b218106 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:23.466722 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9e3fd009-c80e-4527-aaa3-7fcb4b218106 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451" status: 200 len: 1739 microversion: 2.20 time: 0.347144 Sep 08 11:16:23.482339 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3055/5994] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:16:23 2022] GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451 => generated 1739 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:16:24.496900 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8bb922cb-052c-43eb-aa52-a9ddde21db15 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:24.498484 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8bb922cb-052c-43eb-aa52-a9ddde21db15 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: 67dca3fd-4bba-447a-9af9-0aacf1dd5451] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:24.526559 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8bb922cb-052c-43eb-aa52-a9ddde21db15 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:24.534574 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8bb922cb-052c-43eb-aa52-a9ddde21db15 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:24.536144 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8bb922cb-052c-43eb-aa52-a9ddde21db15 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:24.536704 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8bb922cb-052c-43eb-aa52-a9ddde21db15 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:24.537247 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8bb922cb-052c-43eb-aa52-a9ddde21db15 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:24.537700 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8bb922cb-052c-43eb-aa52-a9ddde21db15 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:24.953737 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8bb922cb-052c-43eb-aa52-a9ddde21db15 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:24.977647 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8bb922cb-052c-43eb-aa52-a9ddde21db15 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:24.999036 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8bb922cb-052c-43eb-aa52-a9ddde21db15 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:25.005407 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8bb922cb-052c-43eb-aa52-a9ddde21db15 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451" status: 200 len: 1739 microversion: 2.20 time: 0.510844 Sep 08 11:16:25.018274 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2940/5995] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:16:24 2022] GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451 => generated 1739 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:16:26.054531 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-87963324-b029-4be5-91f7-b3fb6cb2dcc3 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:26.055681 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-87963324-b029-4be5-91f7-b3fb6cb2dcc3 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: 67dca3fd-4bba-447a-9af9-0aacf1dd5451] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:26.095526 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-87963324-b029-4be5-91f7-b3fb6cb2dcc3 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:26.102071 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-87963324-b029-4be5-91f7-b3fb6cb2dcc3 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:26.103249 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-87963324-b029-4be5-91f7-b3fb6cb2dcc3 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:26.104892 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-87963324-b029-4be5-91f7-b3fb6cb2dcc3 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:26.108730 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-87963324-b029-4be5-91f7-b3fb6cb2dcc3 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:26.111691 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-87963324-b029-4be5-91f7-b3fb6cb2dcc3 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:26.236556 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:16:26.443994 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-87963324-b029-4be5-91f7-b3fb6cb2dcc3 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:26.454368 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-87963324-b029-4be5-91f7-b3fb6cb2dcc3 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:26.461463 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-87963324-b029-4be5-91f7-b3fb6cb2dcc3 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:26.464206 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-87963324-b029-4be5-91f7-b3fb6cb2dcc3 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451" status: 200 len: 1739 microversion: 2.20 time: 0.419570 Sep 08 11:16:26.466758 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3056/5996] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:16:26 2022] GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451 => generated 1739 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:16:27.541182 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bfbf7e01-df98-4910-ba3b-5cba6c3fadbd tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:27.541960 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bfbf7e01-df98-4910-ba3b-5cba6c3fadbd tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: 67dca3fd-4bba-447a-9af9-0aacf1dd5451] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:27.557402 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bfbf7e01-df98-4910-ba3b-5cba6c3fadbd tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:27.557922 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bfbf7e01-df98-4910-ba3b-5cba6c3fadbd tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:27.558398 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bfbf7e01-df98-4910-ba3b-5cba6c3fadbd tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:27.559151 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bfbf7e01-df98-4910-ba3b-5cba6c3fadbd tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:27.559630 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bfbf7e01-df98-4910-ba3b-5cba6c3fadbd tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:27.560073 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bfbf7e01-df98-4910-ba3b-5cba6c3fadbd tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:27.764136 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bfbf7e01-df98-4910-ba3b-5cba6c3fadbd tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:27.777130 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bfbf7e01-df98-4910-ba3b-5cba6c3fadbd tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:27.793497 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bfbf7e01-df98-4910-ba3b-5cba6c3fadbd tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:27.795169 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bfbf7e01-df98-4910-ba3b-5cba6c3fadbd tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451" status: 200 len: 1739 microversion: 2.20 time: 0.295686 Sep 08 11:16:27.795998 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2941/5997] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:16:27 2022] GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451 => generated 1739 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:16:28.841692 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-00f73aff-b14e-415d-b8d8-cf936502a60f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:28.843227 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-00f73aff-b14e-415d-b8d8-cf936502a60f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: 67dca3fd-4bba-447a-9af9-0aacf1dd5451] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:28.862245 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-00f73aff-b14e-415d-b8d8-cf936502a60f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:28.865695 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-00f73aff-b14e-415d-b8d8-cf936502a60f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:28.866625 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-00f73aff-b14e-415d-b8d8-cf936502a60f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:28.868748 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-00f73aff-b14e-415d-b8d8-cf936502a60f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:28.869616 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-00f73aff-b14e-415d-b8d8-cf936502a60f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:28.870295 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-00f73aff-b14e-415d-b8d8-cf936502a60f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:29.110601 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-00f73aff-b14e-415d-b8d8-cf936502a60f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:29.124573 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-00f73aff-b14e-415d-b8d8-cf936502a60f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:29.126186 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-00f73aff-b14e-415d-b8d8-cf936502a60f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:29.129703 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-00f73aff-b14e-415d-b8d8-cf936502a60f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451" status: 200 len: 1739 microversion: 2.20 time: 0.309538 Sep 08 11:16:29.131288 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3057/5998] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:16:28 2022] GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451 => generated 1739 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:16:30.162315 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4a518c27-2678-4691-bade-3f03b907981f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:30.163680 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4a518c27-2678-4691-bade-3f03b907981f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: 67dca3fd-4bba-447a-9af9-0aacf1dd5451] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:30.172609 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=26 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:16:30.175634 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a518c27-2678-4691-bade-3f03b907981f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:30.177372 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a518c27-2678-4691-bade-3f03b907981f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:30.178336 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a518c27-2678-4691-bade-3f03b907981f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:30.179460 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a518c27-2678-4691-bade-3f03b907981f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:30.181850 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d6a83afa-d848-433f-9e2a-fc39e0d836ba tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:30.182479 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d6a83afa-d848-433f-9e2a-fc39e0d836ba tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] [instance: 85a3ba9d-cc78-422b-8327-4191b2067feb] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:30.183193 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a518c27-2678-4691-bade-3f03b907981f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:30.183852 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a518c27-2678-4691-bade-3f03b907981f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:30.193780 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d6a83afa-d848-433f-9e2a-fc39e0d836ba tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:30.194283 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d6a83afa-d848-433f-9e2a-fc39e0d836ba tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:30.194724 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d6a83afa-d848-433f-9e2a-fc39e0d836ba tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:30.196372 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d6a83afa-d848-433f-9e2a-fc39e0d836ba tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:30.197602 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d6a83afa-d848-433f-9e2a-fc39e0d836ba tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:30.201949 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d6a83afa-d848-433f-9e2a-fc39e0d836ba tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:30.412967 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4a518c27-2678-4691-bade-3f03b907981f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:30.428890 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4a518c27-2678-4691-bade-3f03b907981f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:30.431238 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4a518c27-2678-4691-bade-3f03b907981f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:30.431984 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4a518c27-2678-4691-bade-3f03b907981f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451" status: 200 len: 1739 microversion: 2.20 time: 0.275488 Sep 08 11:16:30.441726 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2942/5999] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:16:30 2022] GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451 => generated 1739 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:16:30.460625 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d609ed22-36e9-43fa-8f50-b6b42cee66c3 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:30.463015 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d609ed22-36e9-43fa-8f50-b6b42cee66c3 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: a13b5e51-8a1d-4cb4-9485-a183b5a20c8d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:30.469834 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d609ed22-36e9-43fa-8f50-b6b42cee66c3 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:30.470431 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d609ed22-36e9-43fa-8f50-b6b42cee66c3 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:30.470929 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d609ed22-36e9-43fa-8f50-b6b42cee66c3 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:30.471712 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d609ed22-36e9-43fa-8f50-b6b42cee66c3 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:30.472244 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d609ed22-36e9-43fa-8f50-b6b42cee66c3 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:30.473332 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d609ed22-36e9-43fa-8f50-b6b42cee66c3 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:30.495696 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d6a83afa-d848-433f-9e2a-fc39e0d836ba tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb" status: 200 len: 1837 microversion: 2.1 time: 0.317330 Sep 08 11:16:30.496882 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3058/6000] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:16:30 2022] GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb => generated 1837 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:16:30.506878 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d609ed22-36e9-43fa-8f50-b6b42cee66c3 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060414 Sep 08 11:16:30.507635 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2943/6001] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 11:16:30 2022] GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 11:16:30.522723 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4acedf8b-fb0b-4e74-b3be-7a17a326324f tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:30.523327 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4acedf8b-fb0b-4e74-b3be-7a17a326324f tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 85a3ba9d-cc78-422b-8327-4191b2067feb] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:30.539487 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4acedf8b-fb0b-4e74-b3be-7a17a326324f tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:30.540109 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4acedf8b-fb0b-4e74-b3be-7a17a326324f tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:30.540225 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4acedf8b-fb0b-4e74-b3be-7a17a326324f tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:30.542088 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4acedf8b-fb0b-4e74-b3be-7a17a326324f tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:30.542570 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4acedf8b-fb0b-4e74-b3be-7a17a326324f tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:30.543009 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4acedf8b-fb0b-4e74-b3be-7a17a326324f tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:30.612856 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7fbbb024-6f31-46a9-a90e-a7e7c6dff92d tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:30.614337 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7fbbb024-6f31-46a9-a90e-a7e7c6dff92d tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: a13b5e51-8a1d-4cb4-9485-a183b5a20c8d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:30.621095 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7fbbb024-6f31-46a9-a90e-a7e7c6dff92d tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:30.625636 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7fbbb024-6f31-46a9-a90e-a7e7c6dff92d tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:30.626080 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7fbbb024-6f31-46a9-a90e-a7e7c6dff92d tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:30.626812 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7fbbb024-6f31-46a9-a90e-a7e7c6dff92d tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:30.627270 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7fbbb024-6f31-46a9-a90e-a7e7c6dff92d tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:30.627695 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7fbbb024-6f31-46a9-a90e-a7e7c6dff92d tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:30.672693 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7fbbb024-6f31-46a9-a90e-a7e7c6dff92d tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: a13b5e51-8a1d-4cb4-9485-a183b5a20c8d] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:16:30.870434 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7fbbb024-6f31-46a9-a90e-a7e7c6dff92d tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d" status: 204 len: 0 microversion: 2.1 time: 0.263643 Sep 08 11:16:30.875589 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2944/6002] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:16:30 2022] DELETE /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 11:16:30.882978 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5eaaa249-85e3-48f2-b874-c5bd63ea802b tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:30.884109 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5eaaa249-85e3-48f2-b874-c5bd63ea802b tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: a13b5e51-8a1d-4cb4-9485-a183b5a20c8d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:30.902140 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5eaaa249-85e3-48f2-b874-c5bd63ea802b tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:30.903024 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5eaaa249-85e3-48f2-b874-c5bd63ea802b tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:30.904020 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5eaaa249-85e3-48f2-b874-c5bd63ea802b tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:30.905486 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5eaaa249-85e3-48f2-b874-c5bd63ea802b tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:30.906190 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5eaaa249-85e3-48f2-b874-c5bd63ea802b tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:30.906888 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5eaaa249-85e3-48f2-b874-c5bd63ea802b tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:30.946766 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4acedf8b-fb0b-4e74-b3be-7a17a326324f tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:30.963875 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4acedf8b-fb0b-4e74-b3be-7a17a326324f tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb" status: 200 len: 1684 microversion: 2.1 time: 0.446278 Sep 08 11:16:30.964872 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3059/6003] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:16:30 2022] GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb => generated 1684 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:16:31.135619 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-576f5355-29d9-4cfb-9cf9-ccb90d78ab25 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:16:31.138092 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-576f5355-29d9-4cfb-9cf9-ccb90d78ab25 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 85a3ba9d-cc78-422b-8327-4191b2067feb] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:31.151699 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-576f5355-29d9-4cfb-9cf9-ccb90d78ab25 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:31.155521 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-576f5355-29d9-4cfb-9cf9-ccb90d78ab25 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:31.156086 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-576f5355-29d9-4cfb-9cf9-ccb90d78ab25 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:31.157976 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-576f5355-29d9-4cfb-9cf9-ccb90d78ab25 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:31.159184 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-576f5355-29d9-4cfb-9cf9-ccb90d78ab25 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:31.161240 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-576f5355-29d9-4cfb-9cf9-ccb90d78ab25 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:31.167832 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5eaaa249-85e3-48f2-b874-c5bd63ea802b tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bdfecc6c7a43608095044b0174b48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfe795da0e4988a50c38f19200ea7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:31.182230 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5eaaa249-85e3-48f2-b874-c5bd63ea802b tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d" status: 200 len: 1673 microversion: 2.1 time: 0.304667 Sep 08 11:16:31.184250 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2945/6004] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:16:30 2022] GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d => generated 1673 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:16:31.267357 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-576f5355-29d9-4cfb-9cf9-ccb90d78ab25 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "POST /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb/action" status: 200 len: 32601 microversion: 2.1 time: 0.135396 Sep 08 11:16:31.269091 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3060/6005] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 11:16:31 2022] POST /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb/action => generated 32601 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 11:16:31.444225 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f3917cda-54cb-4d91-ae33-005fee9c981d tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:16:31.445200 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f3917cda-54cb-4d91-ae33-005fee9c981d tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] [instance: 85a3ba9d-cc78-422b-8327-4191b2067feb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:31.453424 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f3917cda-54cb-4d91-ae33-005fee9c981d tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:31.454251 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f3917cda-54cb-4d91-ae33-005fee9c981d tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:31.454887 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f3917cda-54cb-4d91-ae33-005fee9c981d tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:31.455821 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f3917cda-54cb-4d91-ae33-005fee9c981d tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:31.461568 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f3917cda-54cb-4d91-ae33-005fee9c981d tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:31.462418 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f3917cda-54cb-4d91-ae33-005fee9c981d tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:31.469839 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-890c0fad-5eee-4835-b509-f031b784cb33 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:31.471099 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-890c0fad-5eee-4835-b509-f031b784cb33 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: 67dca3fd-4bba-447a-9af9-0aacf1dd5451] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:31.499718 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-890c0fad-5eee-4835-b509-f031b784cb33 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:31.500532 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-890c0fad-5eee-4835-b509-f031b784cb33 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:31.501339 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-890c0fad-5eee-4835-b509-f031b784cb33 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:31.502538 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-890c0fad-5eee-4835-b509-f031b784cb33 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:31.506653 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-890c0fad-5eee-4835-b509-f031b784cb33 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:31.507805 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-890c0fad-5eee-4835-b509-f031b784cb33 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:31.684450 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-890c0fad-5eee-4835-b509-f031b784cb33 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:31.694998 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-890c0fad-5eee-4835-b509-f031b784cb33 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:31.697474 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-890c0fad-5eee-4835-b509-f031b784cb33 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:31.698939 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-890c0fad-5eee-4835-b509-f031b784cb33 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451" status: 200 len: 1739 microversion: 2.20 time: 0.238140 Sep 08 11:16:31.699708 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3061/6006] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:16:31 2022] GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451 => generated 1739 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:16:31.837975 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f3917cda-54cb-4d91-ae33-005fee9c981d tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '2c091161fcc640d59b9772143add9ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151f52ba802b4bfcaf0b18aa45ee89d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:31.838895 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f3917cda-54cb-4d91-ae33-005fee9c981d tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] [instance: 85a3ba9d-cc78-422b-8327-4191b2067feb] flavor_id is None. Assuming migration. {{(pid=128862) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 08 11:16:31.839616 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f3917cda-54cb-4d91-ae33-005fee9c981d tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] [instance: 85a3ba9d-cc78-422b-8327-4191b2067feb] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128862) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 08 11:16:32.173830 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f3917cda-54cb-4d91-ae33-005fee9c981d tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb/action" status: 202 len: 0 microversion: 2.1 time: 0.734959 Sep 08 11:16:32.183455 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2946/6007] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 11:16:31 2022] POST /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb/action => generated 0 bytes in 744 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:16:32.185130 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a838aec1-2cf9-4bb4-befd-68d566933948 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:32.185761 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a838aec1-2cf9-4bb4-befd-68d566933948 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 85a3ba9d-cc78-422b-8327-4191b2067feb] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:32.195641 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a838aec1-2cf9-4bb4-befd-68d566933948 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:32.196151 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a838aec1-2cf9-4bb4-befd-68d566933948 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:32.196597 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a838aec1-2cf9-4bb4-befd-68d566933948 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:32.203485 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a838aec1-2cf9-4bb4-befd-68d566933948 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:32.204257 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a838aec1-2cf9-4bb4-befd-68d566933948 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:32.204895 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a838aec1-2cf9-4bb4-befd-68d566933948 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:32.217464 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b262af0b-e75d-40b2-9d87-8371e4635584 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:32.218104 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b262af0b-e75d-40b2-9d87-8371e4635584 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: a13b5e51-8a1d-4cb4-9485-a183b5a20c8d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:32.230753 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b262af0b-e75d-40b2-9d87-8371e4635584 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:32.231258 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b262af0b-e75d-40b2-9d87-8371e4635584 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:32.231694 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b262af0b-e75d-40b2-9d87-8371e4635584 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:32.237963 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b262af0b-e75d-40b2-9d87-8371e4635584 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:32.239199 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b262af0b-e75d-40b2-9d87-8371e4635584 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:32.239789 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b262af0b-e75d-40b2-9d87-8371e4635584 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:32.468463 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a838aec1-2cf9-4bb4-befd-68d566933948 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:32.484952 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a838aec1-2cf9-4bb4-befd-68d566933948 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb" status: 200 len: 1693 microversion: 2.1 time: 0.304043 Sep 08 11:16:32.489196 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3062/6008] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:16:32 2022] GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb => generated 1693 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:16:32.703248 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b262af0b-e75d-40b2-9d87-8371e4635584 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bdfecc6c7a43608095044b0174b48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfe795da0e4988a50c38f19200ea7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:32.730296 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b262af0b-e75d-40b2-9d87-8371e4635584 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d" status: 200 len: 1673 microversion: 2.1 time: 0.522583 Sep 08 11:16:32.732485 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2947/6009] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:16:32 2022] GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d => generated 1673 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:16:32.742124 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f7e8cbfd-c1a6-4a3a-ada1-5fff94f01863 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:32.744461 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f7e8cbfd-c1a6-4a3a-ada1-5fff94f01863 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: 67dca3fd-4bba-447a-9af9-0aacf1dd5451] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:32.758900 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f7e8cbfd-c1a6-4a3a-ada1-5fff94f01863 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:32.762152 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f7e8cbfd-c1a6-4a3a-ada1-5fff94f01863 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:32.763214 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f7e8cbfd-c1a6-4a3a-ada1-5fff94f01863 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:32.765602 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f7e8cbfd-c1a6-4a3a-ada1-5fff94f01863 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:32.767159 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f7e8cbfd-c1a6-4a3a-ada1-5fff94f01863 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:32.768245 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f7e8cbfd-c1a6-4a3a-ada1-5fff94f01863 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:33.113658 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f7e8cbfd-c1a6-4a3a-ada1-5fff94f01863 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:33.122976 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f7e8cbfd-c1a6-4a3a-ada1-5fff94f01863 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:33.124455 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f7e8cbfd-c1a6-4a3a-ada1-5fff94f01863 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:33.125937 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f7e8cbfd-c1a6-4a3a-ada1-5fff94f01863 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451" status: 200 len: 1739 microversion: 2.20 time: 0.399230 Sep 08 11:16:33.129167 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3063/6010] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:16:32 2022] GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451 => generated 1739 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:16:33.517767 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-76f06613-ee88-446b-bf23-dfcc7a7cd846 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:33.518654 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-76f06613-ee88-446b-bf23-dfcc7a7cd846 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 85a3ba9d-cc78-422b-8327-4191b2067feb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:33.526957 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76f06613-ee88-446b-bf23-dfcc7a7cd846 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:33.527763 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76f06613-ee88-446b-bf23-dfcc7a7cd846 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:33.528667 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76f06613-ee88-446b-bf23-dfcc7a7cd846 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:33.529835 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76f06613-ee88-446b-bf23-dfcc7a7cd846 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:33.530533 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76f06613-ee88-446b-bf23-dfcc7a7cd846 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:33.531472 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76f06613-ee88-446b-bf23-dfcc7a7cd846 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:33.776682 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f9dd0227-7219-4be6-86bc-e6905e633307 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:33.778541 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f9dd0227-7219-4be6-86bc-e6905e633307 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: a13b5e51-8a1d-4cb4-9485-a183b5a20c8d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:33.797378 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f9dd0227-7219-4be6-86bc-e6905e633307 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:33.798568 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f9dd0227-7219-4be6-86bc-e6905e633307 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:33.799657 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f9dd0227-7219-4be6-86bc-e6905e633307 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:33.802222 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f9dd0227-7219-4be6-86bc-e6905e633307 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:33.804221 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f9dd0227-7219-4be6-86bc-e6905e633307 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:33.805446 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f9dd0227-7219-4be6-86bc-e6905e633307 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:33.915405 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-76f06613-ee88-446b-bf23-dfcc7a7cd846 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:33.940681 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-76f06613-ee88-446b-bf23-dfcc7a7cd846 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb" status: 200 len: 1693 microversion: 2.1 time: 0.431105 Sep 08 11:16:33.945508 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2948/6011] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:16:33 2022] GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb => generated 1693 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:16:34.547171 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-eb0444da-9458-42c5-aed7-7ad91e1783ad tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:34.552355 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-eb0444da-9458-42c5-aed7-7ad91e1783ad tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: 67dca3fd-4bba-447a-9af9-0aacf1dd5451] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:34.565087 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb0444da-9458-42c5-aed7-7ad91e1783ad tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:34.566338 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb0444da-9458-42c5-aed7-7ad91e1783ad tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:34.567886 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb0444da-9458-42c5-aed7-7ad91e1783ad tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:34.569437 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb0444da-9458-42c5-aed7-7ad91e1783ad tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:34.570795 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb0444da-9458-42c5-aed7-7ad91e1783ad tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:34.572529 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb0444da-9458-42c5-aed7-7ad91e1783ad tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:34.719311 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f9dd0227-7219-4be6-86bc-e6905e633307 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bdfecc6c7a43608095044b0174b48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfe795da0e4988a50c38f19200ea7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:34.743566 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f9dd0227-7219-4be6-86bc-e6905e633307 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d" status: 200 len: 1673 microversion: 2.1 time: 0.971785 Sep 08 11:16:34.745188 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3064/6012] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:16:33 2022] GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d => generated 1673 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:16:34.980736 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-63263e4e-31bc-4015-b440-637884d9a5a8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:34.982839 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-63263e4e-31bc-4015-b440-637884d9a5a8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 85a3ba9d-cc78-422b-8327-4191b2067feb] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:34.994105 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-63263e4e-31bc-4015-b440-637884d9a5a8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:34.994784 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-63263e4e-31bc-4015-b440-637884d9a5a8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:34.996531 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-63263e4e-31bc-4015-b440-637884d9a5a8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:34.998182 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-63263e4e-31bc-4015-b440-637884d9a5a8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:34.998815 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-63263e4e-31bc-4015-b440-637884d9a5a8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:34.999409 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-63263e4e-31bc-4015-b440-637884d9a5a8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:35.012374 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-eb0444da-9458-42c5-aed7-7ad91e1783ad tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:35.033364 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-eb0444da-9458-42c5-aed7-7ad91e1783ad tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:35.038540 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-eb0444da-9458-42c5-aed7-7ad91e1783ad tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:35.043740 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-eb0444da-9458-42c5-aed7-7ad91e1783ad tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451" status: 200 len: 1721 microversion: 2.20 time: 0.893468 Sep 08 11:16:35.052304 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2949/6013] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:16:34 2022] GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451 => generated 1721 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:16:35.297368 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-63263e4e-31bc-4015-b440-637884d9a5a8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:35.307955 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-63263e4e-31bc-4015-b440-637884d9a5a8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb" status: 200 len: 1693 microversion: 2.1 time: 0.336945 Sep 08 11:16:35.308663 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3065/6014] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:16:34 2022] GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb => generated 1693 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:16:35.635550 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-b8b2303b-2bc7-4ba1-aaa4-5a0050c23d0e req-765f14f9-0dae-4b7e-bef0-931435ec0a3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a13b5e51-8a1d-4cb4-9485-a183b5a20c8d", "name": "network-vif-deleted", "tag": "f1f6fdcb-f442-49bc-ba0f-8ea3d6242f8f"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:16:35.661389 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b8b2303b-2bc7-4ba1-aaa4-5a0050c23d0e req-765f14f9-0dae-4b7e-bef0-931435ec0a3c service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:35.667904 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b8b2303b-2bc7-4ba1-aaa4-5a0050c23d0e req-765f14f9-0dae-4b7e-bef0-931435ec0a3c service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:35.669865 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b8b2303b-2bc7-4ba1-aaa4-5a0050c23d0e req-765f14f9-0dae-4b7e-bef0-931435ec0a3c service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:35.692062 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-b8b2303b-2bc7-4ba1-aaa4-5a0050c23d0e req-765f14f9-0dae-4b7e-bef0-931435ec0a3c service nova] Creating event network-vif-deleted:f1f6fdcb-f442-49bc-ba0f-8ea3d6242f8f for instance a13b5e51-8a1d-4cb4-9485-a183b5a20c8d on n-h1-850501-12 Sep 08 11:16:35.706212 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-b8b2303b-2bc7-4ba1-aaa4-5a0050c23d0e req-765f14f9-0dae-4b7e-bef0-931435ec0a3c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074935 Sep 08 11:16:35.712364 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2950/6015] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:16:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:16:35.770448 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-463492d5-34bb-4384-b582-f15c1c27c27a tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:35.771766 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-463492d5-34bb-4384-b582-f15c1c27c27a tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: a13b5e51-8a1d-4cb4-9485-a183b5a20c8d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:35.788035 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-463492d5-34bb-4384-b582-f15c1c27c27a tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:35.792186 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-463492d5-34bb-4384-b582-f15c1c27c27a tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:35.792970 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-463492d5-34bb-4384-b582-f15c1c27c27a tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:35.793905 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-463492d5-34bb-4384-b582-f15c1c27c27a tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:35.794646 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-463492d5-34bb-4384-b582-f15c1c27c27a tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:35.797311 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-463492d5-34bb-4384-b582-f15c1c27c27a tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:35.886010 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-463492d5-34bb-4384-b582-f15c1c27c27a tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:35.886624 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-463492d5-34bb-4384-b582-f15c1c27c27a tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:35.887175 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-463492d5-34bb-4384-b582-f15c1c27c27a tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:35.887758 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-463492d5-34bb-4384-b582-f15c1c27c27a tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lazy-loading 'fault' on Instance uuid a13b5e51-8a1d-4cb4-9485-a183b5a20c8d {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:16:35.975461 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-463492d5-34bb-4384-b582-f15c1c27c27a tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bdfecc6c7a43608095044b0174b48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfe795da0e4988a50c38f19200ea7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:35.992170 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-463492d5-34bb-4384-b582-f15c1c27c27a tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d" status: 200 len: 1327 microversion: 2.1 time: 0.226320 Sep 08 11:16:36.009611 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3066/6016] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:16:35 2022] GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d => generated 1327 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:16:36.073614 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1ea2b467-b694-4100-ae4b-2dd91c960c57 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:36.074941 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1ea2b467-b694-4100-ae4b-2dd91c960c57 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: 67dca3fd-4bba-447a-9af9-0aacf1dd5451] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:36.089842 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ea2b467-b694-4100-ae4b-2dd91c960c57 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:36.090593 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ea2b467-b694-4100-ae4b-2dd91c960c57 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:36.094120 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ea2b467-b694-4100-ae4b-2dd91c960c57 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:36.095123 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ea2b467-b694-4100-ae4b-2dd91c960c57 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:36.095757 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ea2b467-b694-4100-ae4b-2dd91c960c57 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:36.096351 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ea2b467-b694-4100-ae4b-2dd91c960c57 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:36.099772 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:16:36.310310 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1ea2b467-b694-4100-ae4b-2dd91c960c57 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:36.332808 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-551d30db-250a-44b9-8f00-34a306986bde tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:36.333756 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1ea2b467-b694-4100-ae4b-2dd91c960c57 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:36.334031 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-551d30db-250a-44b9-8f00-34a306986bde tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 85a3ba9d-cc78-422b-8327-4191b2067feb] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:36.337646 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1ea2b467-b694-4100-ae4b-2dd91c960c57 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:36.340394 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1ea2b467-b694-4100-ae4b-2dd91c960c57 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451" status: 200 len: 1721 microversion: 2.20 time: 0.271085 Sep 08 11:16:36.342834 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2951/6017] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:16:36 2022] GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451 => generated 1721 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:16:36.360165 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-551d30db-250a-44b9-8f00-34a306986bde tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:36.363901 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-551d30db-250a-44b9-8f00-34a306986bde tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:36.365294 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-551d30db-250a-44b9-8f00-34a306986bde tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:36.367079 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-551d30db-250a-44b9-8f00-34a306986bde tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:36.368827 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-551d30db-250a-44b9-8f00-34a306986bde tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:36.370353 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-551d30db-250a-44b9-8f00-34a306986bde tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:36.438283 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-78e44601-d3b0-4eb7-87e1-ddecd7c0a879 req-b2d69999-6fc8-4f98-a0bb-6f56b7b248a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67dca3fd-4bba-447a-9af9-0aacf1dd5451", "name": "network-vif-unplugged", "status": "completed", "tag": "242cd08b-a4b9-4348-bfc9-024fa3eaf821"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:16:36.467159 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-78e44601-d3b0-4eb7-87e1-ddecd7c0a879 req-b2d69999-6fc8-4f98-a0bb-6f56b7b248a0 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:36.468847 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-78e44601-d3b0-4eb7-87e1-ddecd7c0a879 req-b2d69999-6fc8-4f98-a0bb-6f56b7b248a0 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:36.469451 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-78e44601-d3b0-4eb7-87e1-ddecd7c0a879 req-b2d69999-6fc8-4f98-a0bb-6f56b7b248a0 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:36.499969 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-78e44601-d3b0-4eb7-87e1-ddecd7c0a879 req-b2d69999-6fc8-4f98-a0bb-6f56b7b248a0 service nova] Creating event network-vif-unplugged:242cd08b-a4b9-4348-bfc9-024fa3eaf821 for instance 67dca3fd-4bba-447a-9af9-0aacf1dd5451 on n-h2-850501-12 Sep 08 11:16:36.515497 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-78e44601-d3b0-4eb7-87e1-ddecd7c0a879 req-b2d69999-6fc8-4f98-a0bb-6f56b7b248a0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085351 Sep 08 11:16:36.516857 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2952/6018] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:16:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:16:36.600692 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-551d30db-250a-44b9-8f00-34a306986bde tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:36.610756 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-551d30db-250a-44b9-8f00-34a306986bde tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb" status: 200 len: 1693 microversion: 2.1 time: 0.282639 Sep 08 11:16:36.611328 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3067/6019] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:16:36 2022] GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb => generated 1693 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:16:37.029964 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-560e83c5-69e4-465a-b9f9-2c444d22d39d tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:37.032552 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-560e83c5-69e4-465a-b9f9-2c444d22d39d tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: a13b5e51-8a1d-4cb4-9485-a183b5a20c8d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:37.044094 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-560e83c5-69e4-465a-b9f9-2c444d22d39d tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:37.044842 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-560e83c5-69e4-465a-b9f9-2c444d22d39d tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:37.048459 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-560e83c5-69e4-465a-b9f9-2c444d22d39d tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:37.049592 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-560e83c5-69e4-465a-b9f9-2c444d22d39d tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:37.050520 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-560e83c5-69e4-465a-b9f9-2c444d22d39d tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:37.051416 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-560e83c5-69e4-465a-b9f9-2c444d22d39d tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:37.075484 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-560e83c5-69e4-465a-b9f9-2c444d22d39d tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] HTTP exception thrown: Instance a13b5e51-8a1d-4cb4-9485-a183b5a20c8d could not be found. Sep 08 11:16:37.077943 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-560e83c5-69e4-465a-b9f9-2c444d22d39d tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Request method failure captured: Sep 08 11:16:37.077943 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d HTTP/1.1 Sep 08 11:16:37.077943 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 11:16:37.077943 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 11:16:37.077943 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 11:16:37.077943 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 11:16:37.077943 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 11:16:37.077943 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 11:16:37.077943 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 11:16:37.077943 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 11:16:37.077943 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGc45zUR61ebW_EzHCMbc6VtgxjxpBxZ1vn5tgJ28f5PYNkUZtw8FaeV_00ITw9X5j_OhMo8wdwdGnvQypZIm7by57nIIuLznoxOH3I_DFxPJc5kV_Mb8xXudQqjS13CJLT0Ff3sasdqmyCun3dDf3vf5N50OTTdpyz93Jie4GOJmzWE Sep 08 11:16:37.077943 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 11:16:37.077943 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 11:16:37.077943 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 11:16:37.077943 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 11:16:37.077943 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 11:16:37.077943 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 11:16:37.077943 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 09dfe795da0e4988a50c38f19200ea7e Sep 08 11:16:37.077943 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-AttachVolumeTestJSON-306053878 Sep 08 11:16:37.077943 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 11:16:37.077943 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 11:16:37.077943 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/09dfe795da0e4988a50c38f19200ea7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/09dfe795da0e4988a50c38f19200ea7e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_09dfe795da0e4988a50c38f19200ea7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/09dfe795da0e4988a50c38f19200ea7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:16:37.077943 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-AttachVolumeTestJSON-306053878 Sep 08 11:16:37.077943 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 09dfe795da0e4988a50c38f19200ea7e Sep 08 11:16:37.077943 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-AttachVolumeTestJSON-306053878 Sep 08 11:16:37.077943 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-AttachVolumeTestJSON-306053878-project Sep 08 11:16:37.077943 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 11:16:37.077943 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 11:16:37.077943 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: d6bdfecc6c7a43608095044b0174b48f Sep 08 11:16:37.077943 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-AttachVolumeTestJSON-306053878-project Sep 08 11:16:37.077943 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 11:16:37.077943 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance a13b5e51-8a1d-4cb4-9485-a183b5a20c8d could not be found. Sep 08 11:16:37.077943 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'a13b5e51-8a1d-4cb4-9485-a183b5a20c8d'} Sep 08 11:16:37.077943 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:16:37.077943 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:16:37.077943 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:16:37.077943 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:16:37.077943 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:16:37.077943 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:16:37.077943 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:16:37.077943 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:16:37.077943 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:16:37.077943 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:16:37.077943 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a13b5e51-8a1d-4cb4-9485-a183b5a20c8d could not be found. Sep 08 11:16:37.077943 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:16:37.077943 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:16:37.077943 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:16:37.077943 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:16:37.077943 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:16:37.077943 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:16:37.077943 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:16:37.077943 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:16:37.077943 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:16:37.077943 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:16:37.077943 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:16:37.077943 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:16:37.077943 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:16:37.077943 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:16:37.077943 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:16:37.077943 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:16:37.077943 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a13b5e51-8a1d-4cb4-9485-a183b5a20c8d could not be found. Sep 08 11:16:37.077943 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:16:37.077943 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:16:37.077943 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:16:37.082766 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:16:37.082766 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:16:37.082766 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:16:37.082766 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:16:37.082766 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:16:37.082766 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a13b5e51-8a1d-4cb4-9485-a183b5a20c8d could not be found. Sep 08 11:16:37.082766 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:16:37.085512 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-560e83c5-69e4-465a-b9f9-2c444d22d39d tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Returning 404 to user: Instance a13b5e51-8a1d-4cb4-9485-a183b5a20c8d could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:16:37.086596 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-560e83c5-69e4-465a-b9f9-2c444d22d39d tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d" status: 404 len: 111 microversion: 2.1 time: 0.062332 Sep 08 11:16:37.088045 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2953/6020] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:16:37 2022] GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:16:37.105422 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-39bfc541-27b5-4afd-96e6-633e4256e8d1 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Calling method '.version_select at 0x7f68e44f03a0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:37.136917 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-39bfc541-27b5-4afd-96e6-633e4256e8d1 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1963866454" status: 202 len: 0 microversion: 2.1 time: 0.044343 Sep 08 11:16:37.138176 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3068/6021] 10.222.0.27 () {58 vars in 1221 bytes} [Thu Sep 8 11:16:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1963866454 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:16:37.399994 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-81e5e261-ef0c-4d56-bcd8-0e226bd2b8b3 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:37.400660 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-81e5e261-ef0c-4d56-bcd8-0e226bd2b8b3 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: 67dca3fd-4bba-447a-9af9-0aacf1dd5451] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:37.414814 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81e5e261-ef0c-4d56-bcd8-0e226bd2b8b3 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:37.415318 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81e5e261-ef0c-4d56-bcd8-0e226bd2b8b3 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:37.415754 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81e5e261-ef0c-4d56-bcd8-0e226bd2b8b3 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:37.433452 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81e5e261-ef0c-4d56-bcd8-0e226bd2b8b3 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:37.434080 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81e5e261-ef0c-4d56-bcd8-0e226bd2b8b3 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:37.434539 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81e5e261-ef0c-4d56-bcd8-0e226bd2b8b3 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:37.651241 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-babc1c66-b396-4d4e-be5c-c8eb92167022 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:37.652003 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-babc1c66-b396-4d4e-be5c-c8eb92167022 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 85a3ba9d-cc78-422b-8327-4191b2067feb] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:37.678821 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-babc1c66-b396-4d4e-be5c-c8eb92167022 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:37.679374 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-babc1c66-b396-4d4e-be5c-c8eb92167022 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:37.679842 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-babc1c66-b396-4d4e-be5c-c8eb92167022 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:37.680619 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-babc1c66-b396-4d4e-be5c-c8eb92167022 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:37.681110 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-babc1c66-b396-4d4e-be5c-c8eb92167022 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:37.681596 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-babc1c66-b396-4d4e-be5c-c8eb92167022 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:37.876781 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-81e5e261-ef0c-4d56-bcd8-0e226bd2b8b3 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:37.902785 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-81e5e261-ef0c-4d56-bcd8-0e226bd2b8b3 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:37.905710 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-81e5e261-ef0c-4d56-bcd8-0e226bd2b8b3 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:37.907068 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-81e5e261-ef0c-4d56-bcd8-0e226bd2b8b3 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451" status: 200 len: 1724 microversion: 2.20 time: 0.543255 Sep 08 11:16:37.908820 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2954/6022] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:16:37 2022] GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451 => generated 1724 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:16:37.939197 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0c6bb57c-27d4-4262-9b06-606c45158ff9 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "08da4292-1d1b-4b23-a5bf-ce6e396cf89e"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:16:37.943244 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0c6bb57c-27d4-4262-9b06-606c45158ff9 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: 67dca3fd-4bba-447a-9af9-0aacf1dd5451] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:37.950035 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0c6bb57c-27d4-4262-9b06-606c45158ff9 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:37.956357 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0c6bb57c-27d4-4262-9b06-606c45158ff9 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:37.958563 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0c6bb57c-27d4-4262-9b06-606c45158ff9 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:37.968088 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0c6bb57c-27d4-4262-9b06-606c45158ff9 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:37.968782 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0c6bb57c-27d4-4262-9b06-606c45158ff9 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:37.969449 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0c6bb57c-27d4-4262-9b06-606c45158ff9 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:38.081984 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-babc1c66-b396-4d4e-be5c-c8eb92167022 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:38.107407 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-babc1c66-b396-4d4e-be5c-c8eb92167022 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb" status: 200 len: 1698 microversion: 2.1 time: 0.461151 Sep 08 11:16:38.108966 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3069/6023] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:16:37 2022] GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb => generated 1698 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:16:38.254327 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-318985f4-7eb3-4438-befb-0a2cd7d4b2e6 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Action: 'create', calling method: .version_select at 0x7f68e8962550>, body: {"keypair": {"name": "tempest-keypair-1181098926", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCvjB3DTKO6olJMQSQaqvY9Kc2k3nnvDJqaMA9yB685Vqcf2Qf8P6ddUnH2mxXq7GW0YeMu+sKK9bVTskVUNnubO3Hixmb43c0+I21lF7fN0ajFAtLQUxybCj3YEjQQB2w=="}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:16:38.278771 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-318985f4-7eb3-4438-befb-0a2cd7d4b2e6 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Getting quotas for project 09dfe795da0e4988a50c38f19200ea7e. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:16:38.286333 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-318985f4-7eb3-4438-befb-0a2cd7d4b2e6 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Getting quotas for user d6bdfecc6c7a43608095044b0174b48f and project 09dfe795da0e4988a50c38f19200ea7e. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:16:38.315549 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-318985f4-7eb3-4438-befb-0a2cd7d4b2e6 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.066901 Sep 08 11:16:38.316925 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3070/6024] 10.222.0.27 () {60 vars in 1159 bytes} [Thu Sep 8 11:16:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:16:38.398379 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0c6bb57c-27d4-4262-9b06-606c45158ff9 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "POST /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.464803 Sep 08 11:16:38.404626 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2955/6025] 10.222.0.27 () {62 vars in 1364 bytes} [Thu Sep 8 11:16:37 2022] POST /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451/os-volume_attachments => generated 188 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 11:16:38.590425 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-973bbfe2-0901-449a-b995-069638ae9ec2 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:38.591474 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-973bbfe2-0901-449a-b995-069638ae9ec2 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: 67dca3fd-4bba-447a-9af9-0aacf1dd5451] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:38.601750 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-973bbfe2-0901-449a-b995-069638ae9ec2 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:38.602588 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-973bbfe2-0901-449a-b995-069638ae9ec2 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:38.603033 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-973bbfe2-0901-449a-b995-069638ae9ec2 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:38.603769 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-973bbfe2-0901-449a-b995-069638ae9ec2 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:38.604277 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-973bbfe2-0901-449a-b995-069638ae9ec2 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:38.604695 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-973bbfe2-0901-449a-b995-069638ae9ec2 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:39.024232 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-973bbfe2-0901-449a-b995-069638ae9ec2 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "DELETE /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451/os-volume_attachments/08da4292-1d1b-4b23-a5bf-ce6e396cf89e" status: 202 len: 0 microversion: 2.20 time: 0.429846 Sep 08 11:16:39.041829 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3071/6026] 10.222.0.27 () {60 vars in 1457 bytes} [Thu Sep 8 11:16:38 2022] DELETE /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451/os-volume_attachments/08da4292-1d1b-4b23-a5bf-ce6e396cf89e => generated 0 bytes in 456 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:16:39.145102 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cc2f9325-011a-4b7e-aa10-03216bcf8f0d tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:16:39.147012 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1276e672-f182-406d-b61d-3685112278a2 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:39.148050 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1276e672-f182-406d-b61d-3685112278a2 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 85a3ba9d-cc78-422b-8327-4191b2067feb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:39.150871 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cc2f9325-011a-4b7e-aa10-03216bcf8f0d tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: 67dca3fd-4bba-447a-9af9-0aacf1dd5451] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:39.153577 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=58,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:16:39.172077 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc2f9325-011a-4b7e-aa10-03216bcf8f0d tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:39.173005 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc2f9325-011a-4b7e-aa10-03216bcf8f0d tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:39.173705 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc2f9325-011a-4b7e-aa10-03216bcf8f0d tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:39.174680 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc2f9325-011a-4b7e-aa10-03216bcf8f0d tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:39.175908 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1276e672-f182-406d-b61d-3685112278a2 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:39.176756 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc2f9325-011a-4b7e-aa10-03216bcf8f0d tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:39.177527 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc2f9325-011a-4b7e-aa10-03216bcf8f0d tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:39.178463 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1276e672-f182-406d-b61d-3685112278a2 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:39.182538 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1276e672-f182-406d-b61d-3685112278a2 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:39.183860 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1276e672-f182-406d-b61d-3685112278a2 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:39.184633 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1276e672-f182-406d-b61d-3685112278a2 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:39.185467 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1276e672-f182-406d-b61d-3685112278a2 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:39.213120 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:16:39.227332 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cc2f9325-011a-4b7e-aa10-03216bcf8f0d tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: 67dca3fd-4bba-447a-9af9-0aacf1dd5451] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128861) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 08 11:16:39.309543 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cc2f9325-011a-4b7e-aa10-03216bcf8f0d tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "POST /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451/action" status: 202 len: 0 microversion: 2.20 time: 0.169205 Sep 08 11:16:39.310919 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3072/6027] 10.222.0.27 () {62 vars in 1319 bytes} [Thu Sep 8 11:16:39 2022] POST /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451/action => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:16:39.319743 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0e57598c-fa48-4b8a-b62e-9941bf0f3b5d tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:39.320824 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0e57598c-fa48-4b8a-b62e-9941bf0f3b5d tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: 67dca3fd-4bba-447a-9af9-0aacf1dd5451] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:39.335355 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e57598c-fa48-4b8a-b62e-9941bf0f3b5d tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:39.336076 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e57598c-fa48-4b8a-b62e-9941bf0f3b5d tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:39.336698 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e57598c-fa48-4b8a-b62e-9941bf0f3b5d tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:39.339666 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e57598c-fa48-4b8a-b62e-9941bf0f3b5d tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:39.340319 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e57598c-fa48-4b8a-b62e-9941bf0f3b5d tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:39.341764 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e57598c-fa48-4b8a-b62e-9941bf0f3b5d tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:39.438826 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1276e672-f182-406d-b61d-3685112278a2 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:39.464174 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1276e672-f182-406d-b61d-3685112278a2 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb" status: 200 len: 1698 microversion: 2.1 time: 0.329040 Sep 08 11:16:39.465127 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2956/6028] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:16:39 2022] GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb => generated 1698 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:16:39.756973 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0e57598c-fa48-4b8a-b62e-9941bf0f3b5d tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:39.777676 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0e57598c-fa48-4b8a-b62e-9941bf0f3b5d tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:39.779556 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0e57598c-fa48-4b8a-b62e-9941bf0f3b5d tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:39.781045 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0e57598c-fa48-4b8a-b62e-9941bf0f3b5d tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451" status: 200 len: 1672 microversion: 2.20 time: 0.466288 Sep 08 11:16:39.782109 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3073/6029] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:16:39 2022] GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451 => generated 1672 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:16:40.499603 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ffc72da6-d8c4-4536-84e6-d1dff67ab20d tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:40.500344 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ffc72da6-d8c4-4536-84e6-d1dff67ab20d tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 85a3ba9d-cc78-422b-8327-4191b2067feb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:40.517872 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ffc72da6-d8c4-4536-84e6-d1dff67ab20d tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:40.518522 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ffc72da6-d8c4-4536-84e6-d1dff67ab20d tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:40.519163 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ffc72da6-d8c4-4536-84e6-d1dff67ab20d tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:40.522594 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ffc72da6-d8c4-4536-84e6-d1dff67ab20d tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:40.523405 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ffc72da6-d8c4-4536-84e6-d1dff67ab20d tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:40.524075 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ffc72da6-d8c4-4536-84e6-d1dff67ab20d tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:40.804525 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ffc72da6-d8c4-4536-84e6-d1dff67ab20d tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:40.814301 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ffc72da6-d8c4-4536-84e6-d1dff67ab20d tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb" status: 200 len: 1698 microversion: 2.1 time: 0.319122 Sep 08 11:16:40.817375 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2957/6030] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:16:40 2022] GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb => generated 1698 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:16:40.819307 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-876a377e-ffdb-4bbf-83b3-6c9a625ff6f3 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:40.821618 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-876a377e-ffdb-4bbf-83b3-6c9a625ff6f3 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: 67dca3fd-4bba-447a-9af9-0aacf1dd5451] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:40.837941 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-876a377e-ffdb-4bbf-83b3-6c9a625ff6f3 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:40.838444 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-876a377e-ffdb-4bbf-83b3-6c9a625ff6f3 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:40.838884 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-876a377e-ffdb-4bbf-83b3-6c9a625ff6f3 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:40.839591 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-876a377e-ffdb-4bbf-83b3-6c9a625ff6f3 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:40.842364 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-876a377e-ffdb-4bbf-83b3-6c9a625ff6f3 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:40.843065 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-876a377e-ffdb-4bbf-83b3-6c9a625ff6f3 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:40.955598 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-510a4bce-2256-4e2e-a336-cf906f1b327c tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1865113113", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "96710c54-7b00-4b34-ad84-4034d740dc4d"}], "security_groups": [{"name": "tempest-securitygroup--627646075"}], "key_name": "tempest-keypair-1181098926", "user_data": "}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:16:41.223047 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-876a377e-ffdb-4bbf-83b3-6c9a625ff6f3 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:41.226605 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-510a4bce-2256-4e2e-a336-cf906f1b327c tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] validate_networks() for [('96710c54-7b00-4b34-ad84-4034d740dc4d', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:16:41.234439 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-876a377e-ffdb-4bbf-83b3-6c9a625ff6f3 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:41.236610 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-876a377e-ffdb-4bbf-83b3-6c9a625ff6f3 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:41.238740 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-876a377e-ffdb-4bbf-83b3-6c9a625ff6f3 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451" status: 200 len: 1730 microversion: 2.20 time: 0.428053 Sep 08 11:16:41.239855 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3074/6031] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:16:40 2022] GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451 => generated 1730 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 11:16:41.843008 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-626408be-b3d8-4a42-a777-1f26f266359e tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:41.844461 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-626408be-b3d8-4a42-a777-1f26f266359e tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 85a3ba9d-cc78-422b-8327-4191b2067feb] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:41.852692 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-626408be-b3d8-4a42-a777-1f26f266359e tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:41.853594 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-626408be-b3d8-4a42-a777-1f26f266359e tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:41.854267 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-626408be-b3d8-4a42-a777-1f26f266359e tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:41.855339 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-626408be-b3d8-4a42-a777-1f26f266359e tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:41.856022 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-626408be-b3d8-4a42-a777-1f26f266359e tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:41.856653 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-626408be-b3d8-4a42-a777-1f26f266359e tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:42.044384 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-626408be-b3d8-4a42-a777-1f26f266359e tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:42.056199 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-626408be-b3d8-4a42-a777-1f26f266359e tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb" status: 200 len: 1698 microversion: 2.1 time: 0.217185 Sep 08 11:16:42.070442 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3075/6032] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:16:41 2022] GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb => generated 1698 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:16:42.212000 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-510a4bce-2256-4e2e-a336-cf906f1b327c tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:16:42.213333 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-510a4bce-2256-4e2e-a336-cf906f1b327c tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:16:42.218339 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-510a4bce-2256-4e2e-a336-cf906f1b327c tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:16:42.218967 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-510a4bce-2256-4e2e-a336-cf906f1b327c tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:16:42.219497 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-510a4bce-2256-4e2e-a336-cf906f1b327c tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:16:42.249839 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-510a4bce-2256-4e2e-a336-cf906f1b327c tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:42.250683 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-510a4bce-2256-4e2e-a336-cf906f1b327c tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:42.251367 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-510a4bce-2256-4e2e-a336-cf906f1b327c tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:42.252420 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-510a4bce-2256-4e2e-a336-cf906f1b327c tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:42.253147 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-510a4bce-2256-4e2e-a336-cf906f1b327c tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:42.253838 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-510a4bce-2256-4e2e-a336-cf906f1b327c tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:42.267956 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ca562233-8894-47dd-9ad4-7115c14e7459 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:42.269644 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ca562233-8894-47dd-9ad4-7115c14e7459 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: 67dca3fd-4bba-447a-9af9-0aacf1dd5451] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:42.277750 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-510a4bce-2256-4e2e-a336-cf906f1b327c tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Getting quotas for project 09dfe795da0e4988a50c38f19200ea7e. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:16:42.280676 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ca562233-8894-47dd-9ad4-7115c14e7459 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:42.281232 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ca562233-8894-47dd-9ad4-7115c14e7459 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:42.281691 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ca562233-8894-47dd-9ad4-7115c14e7459 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:42.282419 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ca562233-8894-47dd-9ad4-7115c14e7459 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:42.292795 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-510a4bce-2256-4e2e-a336-cf906f1b327c tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Getting quotas for user d6bdfecc6c7a43608095044b0174b48f and project 09dfe795da0e4988a50c38f19200ea7e. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:16:42.293395 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ca562233-8894-47dd-9ad4-7115c14e7459 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:42.293901 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ca562233-8894-47dd-9ad4-7115c14e7459 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:42.320592 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-510a4bce-2256-4e2e-a336-cf906f1b327c tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:16:42.323411 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-510a4bce-2256-4e2e-a336-cf906f1b327c tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: 77e88235-e334-40dc-bd38-680e467ac4e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:16:42.388756 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-510a4bce-2256-4e2e-a336-cf906f1b327c tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.437342 Sep 08 11:16:42.389785 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2958/6033] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 11:16:40 2022] POST /compute/v2.1/servers => generated 401 bytes in 1439 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 11:16:42.400355 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8cf316fe-6e64-4a83-a64d-9f6e9bf7f03f tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:42.400926 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8cf316fe-6e64-4a83-a64d-9f6e9bf7f03f tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] [instance: 9426a1f8-7d16-47ec-af01-70d0c7766eb9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:42.412009 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8cf316fe-6e64-4a83-a64d-9f6e9bf7f03f tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:42.412801 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8cf316fe-6e64-4a83-a64d-9f6e9bf7f03f tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:42.413451 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8cf316fe-6e64-4a83-a64d-9f6e9bf7f03f tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:42.414344 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8cf316fe-6e64-4a83-a64d-9f6e9bf7f03f tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:42.415864 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8cf316fe-6e64-4a83-a64d-9f6e9bf7f03f tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:42.416494 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8cf316fe-6e64-4a83-a64d-9f6e9bf7f03f tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:42.468788 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8cf316fe-6e64-4a83-a64d-9f6e9bf7f03f tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] 10.222.0.27 "GET /compute/v2.1/servers/9426a1f8-7d16-47ec-af01-70d0c7766eb9/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.074264 Sep 08 11:16:42.474126 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2959/6034] 10.222.0.27 () {58 vars in 1293 bytes} [Thu Sep 8 11:16:42 2022] GET /compute/v2.1/servers/9426a1f8-7d16-47ec-af01-70d0c7766eb9/os-server-password => generated 116 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:16:42.475659 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-585a26e5-feac-4970-98bf-5d7f5d8a94da tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:42.476476 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-585a26e5-feac-4970-98bf-5d7f5d8a94da tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: 77e88235-e334-40dc-bd38-680e467ac4e2] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:42.573879 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-585a26e5-feac-4970-98bf-5d7f5d8a94da tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bdfecc6c7a43608095044b0174b48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfe795da0e4988a50c38f19200ea7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:42.590405 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-585a26e5-feac-4970-98bf-5d7f5d8a94da tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "GET /compute/v2.1/servers/77e88235-e334-40dc-bd38-680e467ac4e2" status: 200 len: 1238 microversion: 2.1 time: 0.119521 Sep 08 11:16:42.592027 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2960/6035] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:16:42 2022] GET /compute/v2.1/servers/77e88235-e334-40dc-bd38-680e467ac4e2 => generated 1238 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:16:42.621114 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ca562233-8894-47dd-9ad4-7115c14e7459 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:42.640316 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ca562233-8894-47dd-9ad4-7115c14e7459 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:42.643325 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ca562233-8894-47dd-9ad4-7115c14e7459 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:42.646639 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ca562233-8894-47dd-9ad4-7115c14e7459 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451" status: 200 len: 1730 microversion: 2.20 time: 0.381640 Sep 08 11:16:42.653459 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3076/6036] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:16:42 2022] GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451 => generated 1730 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:16:43.085887 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9e1cfe20-bf16-46dd-bb4b-5edf57658714 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:43.088153 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9e1cfe20-bf16-46dd-bb4b-5edf57658714 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 85a3ba9d-cc78-422b-8327-4191b2067feb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:43.104523 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9e1cfe20-bf16-46dd-bb4b-5edf57658714 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:43.106621 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9e1cfe20-bf16-46dd-bb4b-5edf57658714 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:43.107703 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9e1cfe20-bf16-46dd-bb4b-5edf57658714 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:43.111090 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9e1cfe20-bf16-46dd-bb4b-5edf57658714 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:43.111828 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9e1cfe20-bf16-46dd-bb4b-5edf57658714 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:43.115310 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9e1cfe20-bf16-46dd-bb4b-5edf57658714 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:43.489584 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9e1cfe20-bf16-46dd-bb4b-5edf57658714 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:43.538484 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9e1cfe20-bf16-46dd-bb4b-5edf57658714 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb" status: 200 len: 1698 microversion: 2.1 time: 0.458749 Sep 08 11:16:43.554926 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2961/6037] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:16:43 2022] GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb => generated 1698 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:16:43.635293 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8f6a98fd-077b-47e0-8921-7eaeb181980e tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:43.644375 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8f6a98fd-077b-47e0-8921-7eaeb181980e tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: 77e88235-e334-40dc-bd38-680e467ac4e2] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:43.673911 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-336b5347-b530-4604-8719-eac5900f94d6 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:43.674702 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-336b5347-b530-4604-8719-eac5900f94d6 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: 67dca3fd-4bba-447a-9af9-0aacf1dd5451] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:43.682586 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f6a98fd-077b-47e0-8921-7eaeb181980e tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:43.683312 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f6a98fd-077b-47e0-8921-7eaeb181980e tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:43.683907 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f6a98fd-077b-47e0-8921-7eaeb181980e tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:43.684798 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f6a98fd-077b-47e0-8921-7eaeb181980e tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:43.689613 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f6a98fd-077b-47e0-8921-7eaeb181980e tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:43.689932 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f6a98fd-077b-47e0-8921-7eaeb181980e tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:43.698575 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-336b5347-b530-4604-8719-eac5900f94d6 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:43.701894 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-336b5347-b530-4604-8719-eac5900f94d6 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:43.702705 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-336b5347-b530-4604-8719-eac5900f94d6 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:43.704752 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-336b5347-b530-4604-8719-eac5900f94d6 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:43.708055 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-336b5347-b530-4604-8719-eac5900f94d6 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:43.708849 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-336b5347-b530-4604-8719-eac5900f94d6 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:43.821053 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8f6a98fd-077b-47e0-8921-7eaeb181980e tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bdfecc6c7a43608095044b0174b48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfe795da0e4988a50c38f19200ea7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:43.832003 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8f6a98fd-077b-47e0-8921-7eaeb181980e tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "GET /compute/v2.1/servers/77e88235-e334-40dc-bd38-680e467ac4e2" status: 200 len: 1290 microversion: 2.1 time: 0.200420 Sep 08 11:16:43.833004 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3077/6038] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:16:43 2022] GET /compute/v2.1/servers/77e88235-e334-40dc-bd38-680e467ac4e2 => generated 1290 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:16:44.084342 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-336b5347-b530-4604-8719-eac5900f94d6 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:44.093581 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-336b5347-b530-4604-8719-eac5900f94d6 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:44.099819 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-336b5347-b530-4604-8719-eac5900f94d6 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:44.106708 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-336b5347-b530-4604-8719-eac5900f94d6 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451" status: 200 len: 1730 microversion: 2.20 time: 0.437753 Sep 08 11:16:44.108049 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2962/6039] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:16:43 2022] GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451 => generated 1730 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:16:44.575823 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a8619027-af0b-48b4-b1cc-9c48ffeb93de tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:44.577863 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a8619027-af0b-48b4-b1cc-9c48ffeb93de tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 85a3ba9d-cc78-422b-8327-4191b2067feb] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:44.587798 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a8619027-af0b-48b4-b1cc-9c48ffeb93de tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:44.588667 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a8619027-af0b-48b4-b1cc-9c48ffeb93de tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:44.589635 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a8619027-af0b-48b4-b1cc-9c48ffeb93de tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:44.590601 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a8619027-af0b-48b4-b1cc-9c48ffeb93de tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:44.591283 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a8619027-af0b-48b4-b1cc-9c48ffeb93de tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:44.592179 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a8619027-af0b-48b4-b1cc-9c48ffeb93de tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:44.855924 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-55e86288-abb3-4e13-8736-da8a49a2f83a tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:44.858713 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-55e86288-abb3-4e13-8736-da8a49a2f83a tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: 77e88235-e334-40dc-bd38-680e467ac4e2] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:44.874226 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55e86288-abb3-4e13-8736-da8a49a2f83a tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:44.877499 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55e86288-abb3-4e13-8736-da8a49a2f83a tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:44.881956 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55e86288-abb3-4e13-8736-da8a49a2f83a tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:44.883304 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55e86288-abb3-4e13-8736-da8a49a2f83a tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:44.884577 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55e86288-abb3-4e13-8736-da8a49a2f83a tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:44.897982 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55e86288-abb3-4e13-8736-da8a49a2f83a tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:44.970856 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a8619027-af0b-48b4-b1cc-9c48ffeb93de tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:44.995414 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a8619027-af0b-48b4-b1cc-9c48ffeb93de tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb" status: 200 len: 1698 microversion: 2.1 time: 0.423348 Sep 08 11:16:45.015736 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3078/6040] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:16:44 2022] GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb => generated 1698 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:16:45.018202 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-55e86288-abb3-4e13-8736-da8a49a2f83a tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bdfecc6c7a43608095044b0174b48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfe795da0e4988a50c38f19200ea7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:45.031595 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-55e86288-abb3-4e13-8736-da8a49a2f83a tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "GET /compute/v2.1/servers/77e88235-e334-40dc-bd38-680e467ac4e2" status: 200 len: 1296 microversion: 2.1 time: 0.179704 Sep 08 11:16:45.041110 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2963/6041] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:16:44 2022] GET /compute/v2.1/servers/77e88235-e334-40dc-bd38-680e467ac4e2 => generated 1296 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:16:45.144444 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9cfc7dac-b016-49dc-bd82-93c4208cab68 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:45.145710 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9cfc7dac-b016-49dc-bd82-93c4208cab68 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: 67dca3fd-4bba-447a-9af9-0aacf1dd5451] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:45.185263 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9cfc7dac-b016-49dc-bd82-93c4208cab68 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:45.188374 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9cfc7dac-b016-49dc-bd82-93c4208cab68 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:45.191800 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9cfc7dac-b016-49dc-bd82-93c4208cab68 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:45.196905 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9cfc7dac-b016-49dc-bd82-93c4208cab68 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:45.198128 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9cfc7dac-b016-49dc-bd82-93c4208cab68 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:45.200274 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9cfc7dac-b016-49dc-bd82-93c4208cab68 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:45.511670 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9cfc7dac-b016-49dc-bd82-93c4208cab68 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:45.522622 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9cfc7dac-b016-49dc-bd82-93c4208cab68 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:45.524583 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9cfc7dac-b016-49dc-bd82-93c4208cab68 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:45.526139 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9cfc7dac-b016-49dc-bd82-93c4208cab68 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451" status: 200 len: 1730 microversion: 2.20 time: 0.388638 Sep 08 11:16:45.527395 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3079/6042] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:16:45 2022] GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451 => generated 1730 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:16:46.021967 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c3ff6ce8-7e45-41f0-8ddc-00138e2bc870 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:46.022782 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c3ff6ce8-7e45-41f0-8ddc-00138e2bc870 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 85a3ba9d-cc78-422b-8327-4191b2067feb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:46.039533 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c3ff6ce8-7e45-41f0-8ddc-00138e2bc870 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:46.041369 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c3ff6ce8-7e45-41f0-8ddc-00138e2bc870 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:46.043385 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c3ff6ce8-7e45-41f0-8ddc-00138e2bc870 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:46.045907 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c3ff6ce8-7e45-41f0-8ddc-00138e2bc870 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:46.047877 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c3ff6ce8-7e45-41f0-8ddc-00138e2bc870 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:46.048743 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c3ff6ce8-7e45-41f0-8ddc-00138e2bc870 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:46.065756 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ec9b5565-76ec-4eac-9368-7d4b02a511f0 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:46.067395 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ec9b5565-76ec-4eac-9368-7d4b02a511f0 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: 77e88235-e334-40dc-bd38-680e467ac4e2] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:46.083500 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ec9b5565-76ec-4eac-9368-7d4b02a511f0 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:46.084873 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ec9b5565-76ec-4eac-9368-7d4b02a511f0 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:46.087316 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ec9b5565-76ec-4eac-9368-7d4b02a511f0 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:46.088312 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ec9b5565-76ec-4eac-9368-7d4b02a511f0 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:46.090996 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ec9b5565-76ec-4eac-9368-7d4b02a511f0 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:46.091714 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ec9b5565-76ec-4eac-9368-7d4b02a511f0 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:46.470885 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ec9b5565-76ec-4eac-9368-7d4b02a511f0 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bdfecc6c7a43608095044b0174b48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfe795da0e4988a50c38f19200ea7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:46.485655 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ec9b5565-76ec-4eac-9368-7d4b02a511f0 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "GET /compute/v2.1/servers/77e88235-e334-40dc-bd38-680e467ac4e2" status: 200 len: 1363 microversion: 2.1 time: 0.429588 Sep 08 11:16:46.490780 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3080/6043] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:16:46 2022] GET /compute/v2.1/servers/77e88235-e334-40dc-bd38-680e467ac4e2 => generated 1363 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:16:46.553082 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c3ff6ce8-7e45-41f0-8ddc-00138e2bc870 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:46.558149 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-568b2274-ba2f-4e3a-a253-2cf931b50c52 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:46.558982 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-568b2274-ba2f-4e3a-a253-2cf931b50c52 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: 67dca3fd-4bba-447a-9af9-0aacf1dd5451] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:46.563937 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c3ff6ce8-7e45-41f0-8ddc-00138e2bc870 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb" status: 200 len: 1698 microversion: 2.1 time: 0.547474 Sep 08 11:16:46.569379 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2964/6044] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:16:46 2022] GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb => generated 1698 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:16:46.592771 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-568b2274-ba2f-4e3a-a253-2cf931b50c52 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:46.594496 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-568b2274-ba2f-4e3a-a253-2cf931b50c52 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:46.594959 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-568b2274-ba2f-4e3a-a253-2cf931b50c52 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:46.598140 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-568b2274-ba2f-4e3a-a253-2cf931b50c52 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:46.599657 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-568b2274-ba2f-4e3a-a253-2cf931b50c52 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:46.602097 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-568b2274-ba2f-4e3a-a253-2cf931b50c52 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:46.948864 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-568b2274-ba2f-4e3a-a253-2cf931b50c52 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:46.966741 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-568b2274-ba2f-4e3a-a253-2cf931b50c52 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:46.969517 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-568b2274-ba2f-4e3a-a253-2cf931b50c52 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:46.971606 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-568b2274-ba2f-4e3a-a253-2cf931b50c52 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451" status: 200 len: 1730 microversion: 2.20 time: 0.420285 Sep 08 11:16:46.973645 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3081/6045] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:16:46 2022] GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451 => generated 1730 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:16:47.523709 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ab14cbbb-6022-41ac-b1c3-0351a5d1ffba tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:47.525575 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ab14cbbb-6022-41ac-b1c3-0351a5d1ffba tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: 77e88235-e334-40dc-bd38-680e467ac4e2] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:47.542378 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab14cbbb-6022-41ac-b1c3-0351a5d1ffba tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:47.544230 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab14cbbb-6022-41ac-b1c3-0351a5d1ffba tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:47.545897 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab14cbbb-6022-41ac-b1c3-0351a5d1ffba tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:47.548052 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab14cbbb-6022-41ac-b1c3-0351a5d1ffba tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:47.551479 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab14cbbb-6022-41ac-b1c3-0351a5d1ffba tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:47.552218 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab14cbbb-6022-41ac-b1c3-0351a5d1ffba tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:47.596277 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1bc467be-6eb2-42b4-813e-1dbd93ef9423 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:47.598645 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1bc467be-6eb2-42b4-813e-1dbd93ef9423 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 85a3ba9d-cc78-422b-8327-4191b2067feb] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:47.607322 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1bc467be-6eb2-42b4-813e-1dbd93ef9423 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:47.608508 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1bc467be-6eb2-42b4-813e-1dbd93ef9423 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:47.609467 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1bc467be-6eb2-42b4-813e-1dbd93ef9423 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:47.610553 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1bc467be-6eb2-42b4-813e-1dbd93ef9423 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:47.611435 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1bc467be-6eb2-42b4-813e-1dbd93ef9423 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:47.612359 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1bc467be-6eb2-42b4-813e-1dbd93ef9423 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:48.007692 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1bc467be-6eb2-42b4-813e-1dbd93ef9423 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:48.029669 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1bc467be-6eb2-42b4-813e-1dbd93ef9423 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb" status: 200 len: 1698 microversion: 2.1 time: 0.429552 Sep 08 11:16:48.035541 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3082/6046] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:16:47 2022] GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb => generated 1698 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:16:48.054733 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-d9986e8a-2678-4b47-9cce-8e808c1ec564 req-147f0c03-9e13-413b-9e27-20bb5c1bf18b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77e88235-e334-40dc-bd38-680e467ac4e2", "tag": "3cdfc914-8511-4b1c-8d54-621c9c0e8153"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:16:48.089046 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-d9986e8a-2678-4b47-9cce-8e808c1ec564 req-147f0c03-9e13-413b-9e27-20bb5c1bf18b service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:48.090610 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-d9986e8a-2678-4b47-9cce-8e808c1ec564 req-147f0c03-9e13-413b-9e27-20bb5c1bf18b service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:48.093845 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-d9986e8a-2678-4b47-9cce-8e808c1ec564 req-147f0c03-9e13-413b-9e27-20bb5c1bf18b service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:48.138840 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-d9986e8a-2678-4b47-9cce-8e808c1ec564 req-147f0c03-9e13-413b-9e27-20bb5c1bf18b service nova] Creating event network-changed:3cdfc914-8511-4b1c-8d54-621c9c0e8153 for instance 77e88235-e334-40dc-bd38-680e467ac4e2 on n-h1-850501-12 Sep 08 11:16:48.146706 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-d9986e8a-2678-4b47-9cce-8e808c1ec564 req-147f0c03-9e13-413b-9e27-20bb5c1bf18b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108091 Sep 08 11:16:48.148271 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3083/6047] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:16:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:16:48.169157 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-26219f80-7420-4958-b8d4-21623640523a tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:48.171302 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-26219f80-7420-4958-b8d4-21623640523a tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: 67dca3fd-4bba-447a-9af9-0aacf1dd5451] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:48.191301 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-26219f80-7420-4958-b8d4-21623640523a tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:48.193617 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-26219f80-7420-4958-b8d4-21623640523a tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:48.194033 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-26219f80-7420-4958-b8d4-21623640523a tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:48.196075 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-26219f80-7420-4958-b8d4-21623640523a tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:48.197690 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-26219f80-7420-4958-b8d4-21623640523a tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:48.198669 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-26219f80-7420-4958-b8d4-21623640523a tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:48.296609 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=4 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:16:48.327920 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ab14cbbb-6022-41ac-b1c3-0351a5d1ffba tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bdfecc6c7a43608095044b0174b48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfe795da0e4988a50c38f19200ea7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:48.342659 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ab14cbbb-6022-41ac-b1c3-0351a5d1ffba tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "GET /compute/v2.1/servers/77e88235-e334-40dc-bd38-680e467ac4e2" status: 200 len: 1363 microversion: 2.1 time: 0.826661 Sep 08 11:16:48.360306 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2965/6048] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:16:47 2022] GET /compute/v2.1/servers/77e88235-e334-40dc-bd38-680e467ac4e2 => generated 1363 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:16:48.485558 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-26219f80-7420-4958-b8d4-21623640523a tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:48.503460 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-26219f80-7420-4958-b8d4-21623640523a tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:48.507919 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-26219f80-7420-4958-b8d4-21623640523a tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:48.510529 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-26219f80-7420-4958-b8d4-21623640523a tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451" status: 200 len: 1730 microversion: 2.20 time: 0.360690 Sep 08 11:16:48.514180 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3084/6049] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:16:48 2022] GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451 => generated 1730 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:16:49.061436 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1b109e0c-bef0-4297-b778-e7901d87d214 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:49.062869 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1b109e0c-bef0-4297-b778-e7901d87d214 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 85a3ba9d-cc78-422b-8327-4191b2067feb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:49.075128 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b109e0c-bef0-4297-b778-e7901d87d214 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:49.079306 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b109e0c-bef0-4297-b778-e7901d87d214 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:49.079950 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b109e0c-bef0-4297-b778-e7901d87d214 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:49.080880 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b109e0c-bef0-4297-b778-e7901d87d214 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:49.082054 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b109e0c-bef0-4297-b778-e7901d87d214 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:49.082821 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b109e0c-bef0-4297-b778-e7901d87d214 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:49.369268 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-200c351f-8e90-49ef-9a47-5be6088724f8 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:49.369927 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-200c351f-8e90-49ef-9a47-5be6088724f8 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: 77e88235-e334-40dc-bd38-680e467ac4e2] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:49.376688 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1b109e0c-bef0-4297-b778-e7901d87d214 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:49.389891 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-200c351f-8e90-49ef-9a47-5be6088724f8 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:49.390503 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1b109e0c-bef0-4297-b778-e7901d87d214 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb" status: 200 len: 1698 microversion: 2.1 time: 0.333004 Sep 08 11:16:49.391052 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-200c351f-8e90-49ef-9a47-5be6088724f8 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:49.391612 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-200c351f-8e90-49ef-9a47-5be6088724f8 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:49.392593 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-200c351f-8e90-49ef-9a47-5be6088724f8 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:49.393208 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-200c351f-8e90-49ef-9a47-5be6088724f8 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:49.396525 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2966/6050] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:16:49 2022] GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb => generated 1698 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:16:49.396952 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-200c351f-8e90-49ef-9a47-5be6088724f8 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:49.540505 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5d81beb3-51cb-48f1-9bf9-78344f0deb35 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:49.541435 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5d81beb3-51cb-48f1-9bf9-78344f0deb35 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: 67dca3fd-4bba-447a-9af9-0aacf1dd5451] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:49.568025 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5d81beb3-51cb-48f1-9bf9-78344f0deb35 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:49.569091 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5d81beb3-51cb-48f1-9bf9-78344f0deb35 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:49.569854 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5d81beb3-51cb-48f1-9bf9-78344f0deb35 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:49.570924 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5d81beb3-51cb-48f1-9bf9-78344f0deb35 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:49.576146 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5d81beb3-51cb-48f1-9bf9-78344f0deb35 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:49.577052 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5d81beb3-51cb-48f1-9bf9-78344f0deb35 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:49.735899 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-200c351f-8e90-49ef-9a47-5be6088724f8 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bdfecc6c7a43608095044b0174b48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfe795da0e4988a50c38f19200ea7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:49.750106 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-200c351f-8e90-49ef-9a47-5be6088724f8 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "GET /compute/v2.1/servers/77e88235-e334-40dc-bd38-680e467ac4e2" status: 200 len: 1363 microversion: 2.1 time: 0.381404 Sep 08 11:16:49.761063 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3085/6051] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:16:49 2022] GET /compute/v2.1/servers/77e88235-e334-40dc-bd38-680e467ac4e2 => generated 1363 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:16:50.425620 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ce0957b7-f7ad-4942-a1e4-552e303e5800 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:50.426665 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ce0957b7-f7ad-4942-a1e4-552e303e5800 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 85a3ba9d-cc78-422b-8327-4191b2067feb] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:50.463224 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ce0957b7-f7ad-4942-a1e4-552e303e5800 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:50.464046 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ce0957b7-f7ad-4942-a1e4-552e303e5800 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:50.464769 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ce0957b7-f7ad-4942-a1e4-552e303e5800 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:50.465759 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ce0957b7-f7ad-4942-a1e4-552e303e5800 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:50.466506 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ce0957b7-f7ad-4942-a1e4-552e303e5800 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:50.467066 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ce0957b7-f7ad-4942-a1e4-552e303e5800 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:50.808961 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ce0957b7-f7ad-4942-a1e4-552e303e5800 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:50.817699 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ce0957b7-f7ad-4942-a1e4-552e303e5800 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb" status: 200 len: 1698 microversion: 2.1 time: 0.397455 Sep 08 11:16:50.835001 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3086/6052] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:16:50 2022] GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb => generated 1698 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:16:50.839917 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5d81beb3-51cb-48f1-9bf9-78344f0deb35 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:50.849885 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5d81beb3-51cb-48f1-9bf9-78344f0deb35 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:50.851659 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5d81beb3-51cb-48f1-9bf9-78344f0deb35 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:50.853082 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5d81beb3-51cb-48f1-9bf9-78344f0deb35 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451" status: 200 len: 1730 microversion: 2.20 time: 1.316648 Sep 08 11:16:50.854115 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2967/6053] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:16:49 2022] GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451 => generated 1730 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 11:16:50.855395 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c609e6ee-3b33-4469-94a2-7c1fd62d6c4e tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:50.856202 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c609e6ee-3b33-4469-94a2-7c1fd62d6c4e tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: 77e88235-e334-40dc-bd38-680e467ac4e2] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:50.863891 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c609e6ee-3b33-4469-94a2-7c1fd62d6c4e tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:50.864638 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c609e6ee-3b33-4469-94a2-7c1fd62d6c4e tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:50.865339 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c609e6ee-3b33-4469-94a2-7c1fd62d6c4e tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:50.866357 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c609e6ee-3b33-4469-94a2-7c1fd62d6c4e tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:50.867076 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c609e6ee-3b33-4469-94a2-7c1fd62d6c4e tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:50.867770 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c609e6ee-3b33-4469-94a2-7c1fd62d6c4e tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:51.219859 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c609e6ee-3b33-4469-94a2-7c1fd62d6c4e tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bdfecc6c7a43608095044b0174b48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfe795da0e4988a50c38f19200ea7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:51.232094 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c609e6ee-3b33-4469-94a2-7c1fd62d6c4e tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "GET /compute/v2.1/servers/77e88235-e334-40dc-bd38-680e467ac4e2" status: 200 len: 1363 microversion: 2.1 time: 0.395622 Sep 08 11:16:51.233827 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3087/6054] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:16:50 2022] GET /compute/v2.1/servers/77e88235-e334-40dc-bd38-680e467ac4e2 => generated 1363 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:16:51.845526 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4eb1d88d-7e9a-47af-80cf-2e8fe476e01e tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:51.847656 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4eb1d88d-7e9a-47af-80cf-2e8fe476e01e tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 85a3ba9d-cc78-422b-8327-4191b2067feb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:51.865480 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4eb1d88d-7e9a-47af-80cf-2e8fe476e01e tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:51.875046 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4eb1d88d-7e9a-47af-80cf-2e8fe476e01e tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:51.879989 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4eb1d88d-7e9a-47af-80cf-2e8fe476e01e tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:51.881170 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4eb1d88d-7e9a-47af-80cf-2e8fe476e01e tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:51.881864 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4eb1d88d-7e9a-47af-80cf-2e8fe476e01e tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:51.882511 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4eb1d88d-7e9a-47af-80cf-2e8fe476e01e tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:51.884970 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7e10cdea-4e51-498a-a5a8-44800cf847be tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:51.885681 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7e10cdea-4e51-498a-a5a8-44800cf847be tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: 67dca3fd-4bba-447a-9af9-0aacf1dd5451] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:51.901376 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7e10cdea-4e51-498a-a5a8-44800cf847be tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:51.901888 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7e10cdea-4e51-498a-a5a8-44800cf847be tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:51.902332 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7e10cdea-4e51-498a-a5a8-44800cf847be tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:51.903055 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7e10cdea-4e51-498a-a5a8-44800cf847be tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:51.917948 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7e10cdea-4e51-498a-a5a8-44800cf847be tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:51.918524 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:16:51.919683 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7e10cdea-4e51-498a-a5a8-44800cf847be tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:51.971581 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:16:52.117615 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4eb1d88d-7e9a-47af-80cf-2e8fe476e01e tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:52.126907 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4eb1d88d-7e9a-47af-80cf-2e8fe476e01e tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb" status: 200 len: 1698 microversion: 2.1 time: 0.286046 Sep 08 11:16:52.145702 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2968/6055] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:16:51 2022] GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb => generated 1698 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:16:52.195645 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7e10cdea-4e51-498a-a5a8-44800cf847be tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:52.206260 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7e10cdea-4e51-498a-a5a8-44800cf847be tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:52.207950 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7e10cdea-4e51-498a-a5a8-44800cf847be tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:52.209402 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7e10cdea-4e51-498a-a5a8-44800cf847be tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451" status: 200 len: 1730 microversion: 2.20 time: 0.328415 Sep 08 11:16:52.225054 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3088/6056] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:16:51 2022] GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451 => generated 1730 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 11:16:52.257964 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3a2495d1-92c5-407c-9633-c59328099938 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:52.258787 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3a2495d1-92c5-407c-9633-c59328099938 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: 77e88235-e334-40dc-bd38-680e467ac4e2] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:52.265270 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a2495d1-92c5-407c-9633-c59328099938 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:52.266004 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a2495d1-92c5-407c-9633-c59328099938 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:52.266616 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a2495d1-92c5-407c-9633-c59328099938 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:52.267505 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a2495d1-92c5-407c-9633-c59328099938 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:52.268305 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a2495d1-92c5-407c-9633-c59328099938 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:52.268902 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a2495d1-92c5-407c-9633-c59328099938 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:52.269389 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:16:52.322740 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-e01ddc90-b35e-4856-8c06-5a8d31d47db8 req-6c5462aa-a23e-4aa3-bad0-17d25371396d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77e88235-e334-40dc-bd38-680e467ac4e2", "name": "network-vif-plugged", "status": "completed", "tag": "3cdfc914-8511-4b1c-8d54-621c9c0e8153"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:16:52.332829 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-e01ddc90-b35e-4856-8c06-5a8d31d47db8 req-6c5462aa-a23e-4aa3-bad0-17d25371396d service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:52.333901 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-e01ddc90-b35e-4856-8c06-5a8d31d47db8 req-6c5462aa-a23e-4aa3-bad0-17d25371396d service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:52.334562 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-e01ddc90-b35e-4856-8c06-5a8d31d47db8 req-6c5462aa-a23e-4aa3-bad0-17d25371396d service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:52.353015 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-e01ddc90-b35e-4856-8c06-5a8d31d47db8 req-6c5462aa-a23e-4aa3-bad0-17d25371396d service nova] Creating event network-vif-plugged:3cdfc914-8511-4b1c-8d54-621c9c0e8153 for instance 77e88235-e334-40dc-bd38-680e467ac4e2 on n-h1-850501-12 Sep 08 11:16:52.358226 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-e01ddc90-b35e-4856-8c06-5a8d31d47db8 req-6c5462aa-a23e-4aa3-bad0-17d25371396d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041934 Sep 08 11:16:52.359752 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3089/6057] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:16:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:16:52.478016 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3a2495d1-92c5-407c-9633-c59328099938 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bdfecc6c7a43608095044b0174b48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfe795da0e4988a50c38f19200ea7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:52.486136 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3a2495d1-92c5-407c-9633-c59328099938 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "GET /compute/v2.1/servers/77e88235-e334-40dc-bd38-680e467ac4e2" status: 200 len: 1363 microversion: 2.1 time: 0.232042 Sep 08 11:16:52.501585 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2969/6058] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:16:52 2022] GET /compute/v2.1/servers/77e88235-e334-40dc-bd38-680e467ac4e2 => generated 1363 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:16:53.154397 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e50bbbd8-f8c4-4540-88d2-c761684f3876 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:53.155355 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e50bbbd8-f8c4-4540-88d2-c761684f3876 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 85a3ba9d-cc78-422b-8327-4191b2067feb] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:53.163617 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e50bbbd8-f8c4-4540-88d2-c761684f3876 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:53.164127 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e50bbbd8-f8c4-4540-88d2-c761684f3876 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:53.164583 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e50bbbd8-f8c4-4540-88d2-c761684f3876 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:53.165347 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e50bbbd8-f8c4-4540-88d2-c761684f3876 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:53.165782 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e50bbbd8-f8c4-4540-88d2-c761684f3876 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:53.166214 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e50bbbd8-f8c4-4540-88d2-c761684f3876 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:53.236162 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-131516bd-d998-46bd-b307-0c6f8b9a8775 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:53.236895 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-131516bd-d998-46bd-b307-0c6f8b9a8775 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: 67dca3fd-4bba-447a-9af9-0aacf1dd5451] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:53.243600 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=8 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:16:53.246868 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-131516bd-d998-46bd-b307-0c6f8b9a8775 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:53.247763 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-131516bd-d998-46bd-b307-0c6f8b9a8775 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:53.248608 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-131516bd-d998-46bd-b307-0c6f8b9a8775 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:53.249933 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-131516bd-d998-46bd-b307-0c6f8b9a8775 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:53.250643 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-131516bd-d998-46bd-b307-0c6f8b9a8775 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:53.251287 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-131516bd-d998-46bd-b307-0c6f8b9a8775 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:53.327186 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e50bbbd8-f8c4-4540-88d2-c761684f3876 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:53.338480 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e50bbbd8-f8c4-4540-88d2-c761684f3876 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb" status: 200 len: 1698 microversion: 2.1 time: 0.189697 Sep 08 11:16:53.339909 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3090/6059] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:16:53 2022] GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb => generated 1698 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:16:53.446430 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-131516bd-d998-46bd-b307-0c6f8b9a8775 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:53.461446 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-131516bd-d998-46bd-b307-0c6f8b9a8775 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:53.464231 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-131516bd-d998-46bd-b307-0c6f8b9a8775 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:53.466329 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-131516bd-d998-46bd-b307-0c6f8b9a8775 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451" status: 200 len: 1730 microversion: 2.20 time: 0.233999 Sep 08 11:16:53.467327 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2970/6060] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:16:53 2022] GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451 => generated 1730 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:16:53.511300 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-80e266ab-185b-4664-b8d3-b408fd3a53c2 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:53.511930 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-80e266ab-185b-4664-b8d3-b408fd3a53c2 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: 77e88235-e334-40dc-bd38-680e467ac4e2] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:53.518518 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-80e266ab-185b-4664-b8d3-b408fd3a53c2 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:53.519081 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-80e266ab-185b-4664-b8d3-b408fd3a53c2 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:53.519521 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-80e266ab-185b-4664-b8d3-b408fd3a53c2 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:53.520225 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-80e266ab-185b-4664-b8d3-b408fd3a53c2 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:53.520685 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-80e266ab-185b-4664-b8d3-b408fd3a53c2 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:53.521138 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-80e266ab-185b-4664-b8d3-b408fd3a53c2 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:53.670320 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-80e266ab-185b-4664-b8d3-b408fd3a53c2 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bdfecc6c7a43608095044b0174b48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfe795da0e4988a50c38f19200ea7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:53.680615 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-80e266ab-185b-4664-b8d3-b408fd3a53c2 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "GET /compute/v2.1/servers/77e88235-e334-40dc-bd38-680e467ac4e2" status: 200 len: 1363 microversion: 2.1 time: 0.173290 Sep 08 11:16:53.681460 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3091/6061] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:16:53 2022] GET /compute/v2.1/servers/77e88235-e334-40dc-bd38-680e467ac4e2 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:16:54.362866 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0d8032e8-435b-491c-849e-dba8ffc9250b tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:54.364271 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0d8032e8-435b-491c-849e-dba8ffc9250b tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 85a3ba9d-cc78-422b-8327-4191b2067feb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:54.371351 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d8032e8-435b-491c-849e-dba8ffc9250b tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:54.371844 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d8032e8-435b-491c-849e-dba8ffc9250b tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:54.372292 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d8032e8-435b-491c-849e-dba8ffc9250b tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:54.373005 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d8032e8-435b-491c-849e-dba8ffc9250b tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:54.373495 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d8032e8-435b-491c-849e-dba8ffc9250b tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:54.374092 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d8032e8-435b-491c-849e-dba8ffc9250b tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:54.508104 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-76fb9138-a4c7-422b-88af-e3a8e13334fb tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:54.508760 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-76fb9138-a4c7-422b-88af-e3a8e13334fb tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: 67dca3fd-4bba-447a-9af9-0aacf1dd5451] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:54.515934 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-76fb9138-a4c7-422b-88af-e3a8e13334fb tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:54.516424 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-76fb9138-a4c7-422b-88af-e3a8e13334fb tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:54.517109 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-76fb9138-a4c7-422b-88af-e3a8e13334fb tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:54.517848 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-76fb9138-a4c7-422b-88af-e3a8e13334fb tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:54.518895 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-76fb9138-a4c7-422b-88af-e3a8e13334fb tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:54.519525 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-76fb9138-a4c7-422b-88af-e3a8e13334fb tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:54.524477 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0d8032e8-435b-491c-849e-dba8ffc9250b tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:54.538833 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0d8032e8-435b-491c-849e-dba8ffc9250b tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb" status: 200 len: 1698 microversion: 2.1 time: 0.180118 Sep 08 11:16:54.539658 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2971/6062] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:16:54 2022] GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb => generated 1698 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:16:54.662487 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-76fb9138-a4c7-422b-88af-e3a8e13334fb tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:54.672232 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-76fb9138-a4c7-422b-88af-e3a8e13334fb tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:54.673729 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-76fb9138-a4c7-422b-88af-e3a8e13334fb tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:54.675703 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-76fb9138-a4c7-422b-88af-e3a8e13334fb tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451" status: 200 len: 1730 microversion: 2.20 time: 0.172094 Sep 08 11:16:54.676359 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3092/6063] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:16:54 2022] GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451 => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 11:16:54.707357 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-164b21bd-f5af-42fd-b3ea-39ed047b7d74 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:54.707978 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-164b21bd-f5af-42fd-b3ea-39ed047b7d74 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: 77e88235-e334-40dc-bd38-680e467ac4e2] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:54.714323 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-164b21bd-f5af-42fd-b3ea-39ed047b7d74 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:54.714829 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-164b21bd-f5af-42fd-b3ea-39ed047b7d74 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:54.715281 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-164b21bd-f5af-42fd-b3ea-39ed047b7d74 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:54.716006 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-164b21bd-f5af-42fd-b3ea-39ed047b7d74 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:54.716478 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-164b21bd-f5af-42fd-b3ea-39ed047b7d74 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:54.716917 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-164b21bd-f5af-42fd-b3ea-39ed047b7d74 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:54.886354 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-164b21bd-f5af-42fd-b3ea-39ed047b7d74 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bdfecc6c7a43608095044b0174b48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfe795da0e4988a50c38f19200ea7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:54.895642 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-164b21bd-f5af-42fd-b3ea-39ed047b7d74 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "GET /compute/v2.1/servers/77e88235-e334-40dc-bd38-680e467ac4e2" status: 200 len: 1549 microversion: 2.1 time: 0.192948 Sep 08 11:16:54.896317 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2972/6064] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:16:54 2022] GET /compute/v2.1/servers/77e88235-e334-40dc-bd38-680e467ac4e2 => generated 1549 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:16:54.918655 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c78b84de-f167-4f4f-b4cd-5bf82d642515 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:54.919157 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c78b84de-f167-4f4f-b4cd-5bf82d642515 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: 77e88235-e334-40dc-bd38-680e467ac4e2] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:54.926339 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c78b84de-f167-4f4f-b4cd-5bf82d642515 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:54.926832 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c78b84de-f167-4f4f-b4cd-5bf82d642515 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:54.927271 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c78b84de-f167-4f4f-b4cd-5bf82d642515 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:54.927975 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c78b84de-f167-4f4f-b4cd-5bf82d642515 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:54.928436 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c78b84de-f167-4f4f-b4cd-5bf82d642515 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:54.928859 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c78b84de-f167-4f4f-b4cd-5bf82d642515 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:55.020954 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c78b84de-f167-4f4f-b4cd-5bf82d642515 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "GET /compute/v2.1/servers/77e88235-e334-40dc-bd38-680e467ac4e2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.106128 Sep 08 11:16:55.021585 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3093/6065] 10.222.0.27 () {58 vars in 1275 bytes} [Thu Sep 8 11:16:54 2022] GET /compute/v2.1/servers/77e88235-e334-40dc-bd38-680e467ac4e2/os-interface => generated 284 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:16:55.563023 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a3fd49df-5bad-416a-a4a3-cf6280d89f5f tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:55.563650 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a3fd49df-5bad-416a-a4a3-cf6280d89f5f tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 85a3ba9d-cc78-422b-8327-4191b2067feb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:55.571266 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a3fd49df-5bad-416a-a4a3-cf6280d89f5f tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:55.571769 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a3fd49df-5bad-416a-a4a3-cf6280d89f5f tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:55.572221 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a3fd49df-5bad-416a-a4a3-cf6280d89f5f tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:55.572944 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a3fd49df-5bad-416a-a4a3-cf6280d89f5f tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:55.573445 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a3fd49df-5bad-416a-a4a3-cf6280d89f5f tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:55.573885 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a3fd49df-5bad-416a-a4a3-cf6280d89f5f tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:55.703173 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0fbc46e4-b4d7-4080-b0b7-ba7ddc5b59ce tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:55.704567 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0fbc46e4-b4d7-4080-b0b7-ba7ddc5b59ce tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: 67dca3fd-4bba-447a-9af9-0aacf1dd5451] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:55.714066 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0fbc46e4-b4d7-4080-b0b7-ba7ddc5b59ce tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:55.714505 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0fbc46e4-b4d7-4080-b0b7-ba7ddc5b59ce tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:55.715460 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0fbc46e4-b4d7-4080-b0b7-ba7ddc5b59ce tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:55.716791 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0fbc46e4-b4d7-4080-b0b7-ba7ddc5b59ce tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:55.717427 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0fbc46e4-b4d7-4080-b0b7-ba7ddc5b59ce tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:55.718076 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0fbc46e4-b4d7-4080-b0b7-ba7ddc5b59ce tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:55.891849 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0fbc46e4-b4d7-4080-b0b7-ba7ddc5b59ce tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:55.901583 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0fbc46e4-b4d7-4080-b0b7-ba7ddc5b59ce tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:55.903335 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0fbc46e4-b4d7-4080-b0b7-ba7ddc5b59ce tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:55.904624 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0fbc46e4-b4d7-4080-b0b7-ba7ddc5b59ce tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451" status: 200 len: 1730 microversion: 2.20 time: 0.206489 Sep 08 11:16:55.905432 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3094/6066] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:16:55 2022] GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451 => generated 1730 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 11:16:55.993847 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a3fd49df-5bad-416a-a4a3-cf6280d89f5f tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:56.001940 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a3fd49df-5bad-416a-a4a3-cf6280d89f5f tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb" status: 200 len: 1697 microversion: 2.1 time: 0.442848 Sep 08 11:16:56.002607 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2973/6067] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:16:55 2022] GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb => generated 1697 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:16:56.433342 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-2d999e31-fd8d-41eb-93bc-20b18f83f251 req-98893aeb-6311-4cc9-97f2-297f2b479b2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67dca3fd-4bba-447a-9af9-0aacf1dd5451", "name": "network-vif-plugged", "status": "completed", "tag": "242cd08b-a4b9-4348-bfc9-024fa3eaf821"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:16:56.450410 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-2d999e31-fd8d-41eb-93bc-20b18f83f251 req-98893aeb-6311-4cc9-97f2-297f2b479b2a service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:56.451173 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-2d999e31-fd8d-41eb-93bc-20b18f83f251 req-98893aeb-6311-4cc9-97f2-297f2b479b2a service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:56.451974 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-2d999e31-fd8d-41eb-93bc-20b18f83f251 req-98893aeb-6311-4cc9-97f2-297f2b479b2a service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:56.467268 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-2d999e31-fd8d-41eb-93bc-20b18f83f251 req-98893aeb-6311-4cc9-97f2-297f2b479b2a service nova] Creating event network-vif-plugged:242cd08b-a4b9-4348-bfc9-024fa3eaf821 for instance 67dca3fd-4bba-447a-9af9-0aacf1dd5451 on n-h2-850501-12 Sep 08 11:16:56.474836 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-2d999e31-fd8d-41eb-93bc-20b18f83f251 req-98893aeb-6311-4cc9-97f2-297f2b479b2a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047208 Sep 08 11:16:56.476014 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3095/6068] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:16:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:16:56.580149 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-b3c9d3c8-6d22-46c6-8dfe-2dc1f6bfb0ca req-6dc1a56d-fc18-4e31-bba4-58df531f5516 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85a3ba9d-cc78-422b-8327-4191b2067feb", "name": "network-vif-unplugged", "status": "completed", "tag": "6bdfb525-38ed-4bf1-b293-5310c08a39a1"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:16:56.620993 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b3c9d3c8-6d22-46c6-8dfe-2dc1f6bfb0ca req-6dc1a56d-fc18-4e31-bba4-58df531f5516 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:56.621871 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b3c9d3c8-6d22-46c6-8dfe-2dc1f6bfb0ca req-6dc1a56d-fc18-4e31-bba4-58df531f5516 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:56.622640 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b3c9d3c8-6d22-46c6-8dfe-2dc1f6bfb0ca req-6dc1a56d-fc18-4e31-bba4-58df531f5516 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:56.666005 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-b3c9d3c8-6d22-46c6-8dfe-2dc1f6bfb0ca req-6dc1a56d-fc18-4e31-bba4-58df531f5516 service nova] Creating event network-vif-unplugged:6bdfb525-38ed-4bf1-b293-5310c08a39a1 for instance 85a3ba9d-cc78-422b-8327-4191b2067feb on n-h1-850501-12 Sep 08 11:16:56.677467 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [req-b3c9d3c8-6d22-46c6-8dfe-2dc1f6bfb0ca req-6dc1a56d-fc18-4e31-bba4-58df531f5516 service nova] Instance 85a3ba9d-cc78-422b-8327-4191b2067feb is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850501-12', 'n-h1-850501-12'} {{(pid=128862) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 11:16:56.699978 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-b3c9d3c8-6d22-46c6-8dfe-2dc1f6bfb0ca req-6dc1a56d-fc18-4e31-bba4-58df531f5516 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.127000 Sep 08 11:16:56.700918 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2974/6069] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:16:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:16:56.932383 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-64b381ab-7a55-46ad-b072-af6c7b99750c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:56.933819 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-64b381ab-7a55-46ad-b072-af6c7b99750c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: 67dca3fd-4bba-447a-9af9-0aacf1dd5451] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:56.948974 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64b381ab-7a55-46ad-b072-af6c7b99750c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:56.950612 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64b381ab-7a55-46ad-b072-af6c7b99750c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:56.952282 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64b381ab-7a55-46ad-b072-af6c7b99750c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:56.954515 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64b381ab-7a55-46ad-b072-af6c7b99750c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:56.957840 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64b381ab-7a55-46ad-b072-af6c7b99750c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:56.959039 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64b381ab-7a55-46ad-b072-af6c7b99750c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:57.040013 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5979538f-65dc-4e3c-869f-a467f7b6b421 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:57.048475 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5979538f-65dc-4e3c-869f-a467f7b6b421 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 85a3ba9d-cc78-422b-8327-4191b2067feb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:57.085933 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5979538f-65dc-4e3c-869f-a467f7b6b421 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:57.088101 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5979538f-65dc-4e3c-869f-a467f7b6b421 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:57.088619 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5979538f-65dc-4e3c-869f-a467f7b6b421 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:57.089605 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5979538f-65dc-4e3c-869f-a467f7b6b421 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:57.092426 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5979538f-65dc-4e3c-869f-a467f7b6b421 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:57.093246 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5979538f-65dc-4e3c-869f-a467f7b6b421 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:57.307920 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-64b381ab-7a55-46ad-b072-af6c7b99750c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:57.319901 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-64b381ab-7a55-46ad-b072-af6c7b99750c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:57.322000 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-64b381ab-7a55-46ad-b072-af6c7b99750c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:57.323602 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-64b381ab-7a55-46ad-b072-af6c7b99750c tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451" status: 200 len: 1730 microversion: 2.20 time: 0.395347 Sep 08 11:16:57.324872 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3096/6070] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:16:56 2022] GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451 => generated 1730 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:16:57.407322 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5979538f-65dc-4e3c-869f-a467f7b6b421 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:57.425361 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5979538f-65dc-4e3c-869f-a467f7b6b421 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb" status: 200 len: 1697 microversion: 2.1 time: 0.394713 Sep 08 11:16:57.430145 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2975/6071] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:16:57 2022] GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb => generated 1697 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:16:58.352534 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e233b48d-d33c-4fef-a0a5-65a8e65faa08 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:58.353697 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e233b48d-d33c-4fef-a0a5-65a8e65faa08 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: 67dca3fd-4bba-447a-9af9-0aacf1dd5451] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:58.365146 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e233b48d-d33c-4fef-a0a5-65a8e65faa08 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:58.365649 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e233b48d-d33c-4fef-a0a5-65a8e65faa08 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:58.366265 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e233b48d-d33c-4fef-a0a5-65a8e65faa08 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:58.367186 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e233b48d-d33c-4fef-a0a5-65a8e65faa08 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:58.368505 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e233b48d-d33c-4fef-a0a5-65a8e65faa08 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:58.369130 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e233b48d-d33c-4fef-a0a5-65a8e65faa08 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:58.454788 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-34e23f16-54fb-44fc-b8aa-81789b047932 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:58.459995 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-34e23f16-54fb-44fc-b8aa-81789b047932 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 85a3ba9d-cc78-422b-8327-4191b2067feb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:58.470701 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-34e23f16-54fb-44fc-b8aa-81789b047932 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:58.472079 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-34e23f16-54fb-44fc-b8aa-81789b047932 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:58.472697 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-34e23f16-54fb-44fc-b8aa-81789b047932 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:58.473565 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-34e23f16-54fb-44fc-b8aa-81789b047932 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:58.474433 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-34e23f16-54fb-44fc-b8aa-81789b047932 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:58.475013 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-34e23f16-54fb-44fc-b8aa-81789b047932 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:58.632055 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e233b48d-d33c-4fef-a0a5-65a8e65faa08 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:58.656643 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e233b48d-d33c-4fef-a0a5-65a8e65faa08 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:58.660318 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e233b48d-d33c-4fef-a0a5-65a8e65faa08 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:58.665480 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e233b48d-d33c-4fef-a0a5-65a8e65faa08 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451" status: 200 len: 1730 microversion: 2.20 time: 0.317550 Sep 08 11:16:58.666363 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3097/6072] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:16:58 2022] GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451 => generated 1730 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:16:58.738619 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-2e4d855b-bb29-4be2-98b6-b67cd85cf0b0 req-9b5ff150-39e6-4b36-9fdd-10733e465f2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77e88235-e334-40dc-bd38-680e467ac4e2", "tag": "3cdfc914-8511-4b1c-8d54-621c9c0e8153"}, {"name": "network-changed", "server_uuid": "85a3ba9d-cc78-422b-8327-4191b2067feb", "tag": "6bdfb525-38ed-4bf1-b293-5310c08a39a1"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:16:58.764299 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-2e4d855b-bb29-4be2-98b6-b67cd85cf0b0 req-9b5ff150-39e6-4b36-9fdd-10733e465f2c service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:58.764616 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-34e23f16-54fb-44fc-b8aa-81789b047932 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:58.765640 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-2e4d855b-bb29-4be2-98b6-b67cd85cf0b0 req-9b5ff150-39e6-4b36-9fdd-10733e465f2c service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:58.766554 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-2e4d855b-bb29-4be2-98b6-b67cd85cf0b0 req-9b5ff150-39e6-4b36-9fdd-10733e465f2c service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:58.773299 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-34e23f16-54fb-44fc-b8aa-81789b047932 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb" status: 200 len: 1697 microversion: 2.1 time: 0.323903 Sep 08 11:16:58.780580 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2976/6073] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:16:58 2022] GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb => generated 1697 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:16:58.796621 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-2e4d855b-bb29-4be2-98b6-b67cd85cf0b0 req-9b5ff150-39e6-4b36-9fdd-10733e465f2c service nova] Creating event network-changed:3cdfc914-8511-4b1c-8d54-621c9c0e8153 for instance 77e88235-e334-40dc-bd38-680e467ac4e2 on n-h1-850501-12 Sep 08 11:16:58.797633 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-2e4d855b-bb29-4be2-98b6-b67cd85cf0b0 req-9b5ff150-39e6-4b36-9fdd-10733e465f2c service nova] Creating event network-changed:6bdfb525-38ed-4bf1-b293-5310c08a39a1 for instance 85a3ba9d-cc78-422b-8327-4191b2067feb on n-h1-850501-12 Sep 08 11:16:58.809728 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [req-2e4d855b-bb29-4be2-98b6-b67cd85cf0b0 req-9b5ff150-39e6-4b36-9fdd-10733e465f2c service nova] Instance 85a3ba9d-cc78-422b-8327-4191b2067feb is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850501-12', 'n-h1-850501-12'} {{(pid=128861) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 11:16:58.832363 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-2e4d855b-bb29-4be2-98b6-b67cd85cf0b0 req-9b5ff150-39e6-4b36-9fdd-10733e465f2c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.102283 Sep 08 11:16:58.833323 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3098/6074] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:16:58 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:16:59.696405 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f8f1a340-5efe-441c-8d39-3b85ac879396 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:59.696936 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f8f1a340-5efe-441c-8d39-3b85ac879396 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: 67dca3fd-4bba-447a-9af9-0aacf1dd5451] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:59.704214 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f8f1a340-5efe-441c-8d39-3b85ac879396 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:59.704717 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f8f1a340-5efe-441c-8d39-3b85ac879396 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:59.705215 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f8f1a340-5efe-441c-8d39-3b85ac879396 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:59.706483 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f8f1a340-5efe-441c-8d39-3b85ac879396 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:59.706944 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f8f1a340-5efe-441c-8d39-3b85ac879396 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:59.707381 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f8f1a340-5efe-441c-8d39-3b85ac879396 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:59.801706 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ffdb5b7d-962c-4132-88fd-0148b5d4a9de tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:59.803246 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ffdb5b7d-962c-4132-88fd-0148b5d4a9de tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 85a3ba9d-cc78-422b-8327-4191b2067feb] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:59.810900 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ffdb5b7d-962c-4132-88fd-0148b5d4a9de tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:59.811761 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ffdb5b7d-962c-4132-88fd-0148b5d4a9de tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:59.812395 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ffdb5b7d-962c-4132-88fd-0148b5d4a9de tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:59.813445 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ffdb5b7d-962c-4132-88fd-0148b5d4a9de tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:59.814058 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ffdb5b7d-962c-4132-88fd-0148b5d4a9de tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:59.814634 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ffdb5b7d-962c-4132-88fd-0148b5d4a9de tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:59.854941 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f8f1a340-5efe-441c-8d39-3b85ac879396 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:59.866771 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f8f1a340-5efe-441c-8d39-3b85ac879396 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:59.868915 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f8f1a340-5efe-441c-8d39-3b85ac879396 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:59.870875 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f8f1a340-5efe-441c-8d39-3b85ac879396 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451" status: 200 len: 1717 microversion: 2.20 time: 0.178622 Sep 08 11:16:59.885057 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2977/6075] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:16:59 2022] GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451 => generated 1717 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 11:16:59.991380 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ffdb5b7d-962c-4132-88fd-0148b5d4a9de tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:17:00.002491 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ffdb5b7d-962c-4132-88fd-0148b5d4a9de tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb" status: 200 len: 1695 microversion: 2.1 time: 0.206092 Sep 08 11:17:00.003271 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3099/6076] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:16:59 2022] GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb => generated 1695 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:17:01.038260 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-87446780-2313-4c9b-8301-c72afa702bdc tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:17:01.039267 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-87446780-2313-4c9b-8301-c72afa702bdc tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 85a3ba9d-cc78-422b-8327-4191b2067feb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:17:01.059211 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:17:01.060775 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87446780-2313-4c9b-8301-c72afa702bdc tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:01.061296 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87446780-2313-4c9b-8301-c72afa702bdc tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:01.064569 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87446780-2313-4c9b-8301-c72afa702bdc tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:01.066574 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87446780-2313-4c9b-8301-c72afa702bdc tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:01.067216 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87446780-2313-4c9b-8301-c72afa702bdc tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:01.068184 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87446780-2313-4c9b-8301-c72afa702bdc tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:01.305541 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-87446780-2313-4c9b-8301-c72afa702bdc tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:17:01.320959 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-87446780-2313-4c9b-8301-c72afa702bdc tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb" status: 200 len: 1692 microversion: 2.1 time: 0.295392 Sep 08 11:17:01.322216 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2978/6077] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:17:01 2022] GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb => generated 1692 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:17:01.367271 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-457ec70b-af05-486e-9920-cec6307876b7 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:17:01.369335 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-457ec70b-af05-486e-9920-cec6307876b7 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 85a3ba9d-cc78-422b-8327-4191b2067feb] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:17:01.377592 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-457ec70b-af05-486e-9920-cec6307876b7 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:01.378637 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-457ec70b-af05-486e-9920-cec6307876b7 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:01.379374 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-457ec70b-af05-486e-9920-cec6307876b7 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:01.380343 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-457ec70b-af05-486e-9920-cec6307876b7 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:01.381004 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-457ec70b-af05-486e-9920-cec6307876b7 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:01.381655 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-457ec70b-af05-486e-9920-cec6307876b7 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:01.545103 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-457ec70b-af05-486e-9920-cec6307876b7 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "POST /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb/action" status: 202 len: 0 microversion: 2.1 time: 0.181127 Sep 08 11:17:01.546662 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3100/6078] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 11:17:01 2022] POST /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:17:01.559055 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bd4dc32f-65c8-472e-98be-4290c5db0e15 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:17:01.560316 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bd4dc32f-65c8-472e-98be-4290c5db0e15 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 85a3ba9d-cc78-422b-8327-4191b2067feb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:17:01.579537 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bd4dc32f-65c8-472e-98be-4290c5db0e15 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:01.580761 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bd4dc32f-65c8-472e-98be-4290c5db0e15 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:01.582072 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bd4dc32f-65c8-472e-98be-4290c5db0e15 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:01.583693 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bd4dc32f-65c8-472e-98be-4290c5db0e15 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:01.584714 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bd4dc32f-65c8-472e-98be-4290c5db0e15 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:01.585699 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bd4dc32f-65c8-472e-98be-4290c5db0e15 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:01.974975 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bd4dc32f-65c8-472e-98be-4290c5db0e15 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:17:01.985732 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bd4dc32f-65c8-472e-98be-4290c5db0e15 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb" status: 200 len: 1691 microversion: 2.1 time: 0.432291 Sep 08 11:17:02.001063 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2979/6079] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:17:01 2022] GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb => generated 1691 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:17:02.308771 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-c9690d1b-4795-44ba-b34a-cf8d38bd23af req-b4ee4b0c-0715-44b0-9f1d-cbfc95355852 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85a3ba9d-cc78-422b-8327-4191b2067feb", "name": "network-vif-plugged", "status": "completed", "tag": "6bdfb525-38ed-4bf1-b293-5310c08a39a1"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:17:02.336432 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-c9690d1b-4795-44ba-b34a-cf8d38bd23af req-b4ee4b0c-0715-44b0-9f1d-cbfc95355852 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:02.337550 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-c9690d1b-4795-44ba-b34a-cf8d38bd23af req-b4ee4b0c-0715-44b0-9f1d-cbfc95355852 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:02.338411 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-c9690d1b-4795-44ba-b34a-cf8d38bd23af req-b4ee4b0c-0715-44b0-9f1d-cbfc95355852 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:02.366848 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-c9690d1b-4795-44ba-b34a-cf8d38bd23af req-b4ee4b0c-0715-44b0-9f1d-cbfc95355852 service nova] Creating event network-vif-plugged:6bdfb525-38ed-4bf1-b293-5310c08a39a1 for instance 85a3ba9d-cc78-422b-8327-4191b2067feb on n-h1-850501-12 Sep 08 11:17:02.386958 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [req-c9690d1b-4795-44ba-b34a-cf8d38bd23af req-b4ee4b0c-0715-44b0-9f1d-cbfc95355852 service nova] Instance 85a3ba9d-cc78-422b-8327-4191b2067feb is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850501-12', 'n-h1-850501-12'} {{(pid=128861) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 11:17:02.406988 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-c9690d1b-4795-44ba-b34a-cf8d38bd23af req-b4ee4b0c-0715-44b0-9f1d-cbfc95355852 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101105 Sep 08 11:17:02.409327 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3101/6080] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:17:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:17:03.012421 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-692588ec-ee22-401d-b29b-1bf005eba42a tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:17:03.013355 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-692588ec-ee22-401d-b29b-1bf005eba42a tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 85a3ba9d-cc78-422b-8327-4191b2067feb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:17:03.024486 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-692588ec-ee22-401d-b29b-1bf005eba42a tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:03.024993 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-692588ec-ee22-401d-b29b-1bf005eba42a tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:03.025509 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-692588ec-ee22-401d-b29b-1bf005eba42a tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:03.026496 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-692588ec-ee22-401d-b29b-1bf005eba42a tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:03.026981 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-692588ec-ee22-401d-b29b-1bf005eba42a tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:03.027399 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-692588ec-ee22-401d-b29b-1bf005eba42a tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:03.248665 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-692588ec-ee22-401d-b29b-1bf005eba42a tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:17:03.257339 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-692588ec-ee22-401d-b29b-1bf005eba42a tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb" status: 200 len: 1691 microversion: 2.1 time: 0.249397 Sep 08 11:17:03.258367 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2980/6081] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:17:03 2022] GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb => generated 1691 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:17:04.285718 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-12b9a23a-7f4c-412c-a734-694c8647eadb tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:17:04.287592 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-12b9a23a-7f4c-412c-a734-694c8647eadb tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 85a3ba9d-cc78-422b-8327-4191b2067feb] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:17:04.298217 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-12b9a23a-7f4c-412c-a734-694c8647eadb tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:04.299517 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-12b9a23a-7f4c-412c-a734-694c8647eadb tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:04.299712 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-12b9a23a-7f4c-412c-a734-694c8647eadb tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:04.300441 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-12b9a23a-7f4c-412c-a734-694c8647eadb tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:04.300905 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-12b9a23a-7f4c-412c-a734-694c8647eadb tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:04.301380 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-12b9a23a-7f4c-412c-a734-694c8647eadb tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:04.500824 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-12b9a23a-7f4c-412c-a734-694c8647eadb tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:17:04.515073 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-12b9a23a-7f4c-412c-a734-694c8647eadb tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb" status: 200 len: 1691 microversion: 2.1 time: 0.236392 Sep 08 11:17:04.526270 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3102/6082] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:17:04 2022] GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb => generated 1691 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:17:05.540992 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b37bd88b-74bc-4045-a9e1-76dc7e466800 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:17:05.541683 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b37bd88b-74bc-4045-a9e1-76dc7e466800 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 85a3ba9d-cc78-422b-8327-4191b2067feb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:17:05.550707 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b37bd88b-74bc-4045-a9e1-76dc7e466800 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:05.551387 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b37bd88b-74bc-4045-a9e1-76dc7e466800 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:05.552074 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b37bd88b-74bc-4045-a9e1-76dc7e466800 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:05.552755 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b37bd88b-74bc-4045-a9e1-76dc7e466800 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:05.553552 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b37bd88b-74bc-4045-a9e1-76dc7e466800 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:05.554206 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b37bd88b-74bc-4045-a9e1-76dc7e466800 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:05.823320 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b37bd88b-74bc-4045-a9e1-76dc7e466800 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:17:05.831658 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b37bd88b-74bc-4045-a9e1-76dc7e466800 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb" status: 200 len: 1691 microversion: 2.1 time: 0.294648 Sep 08 11:17:05.832243 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2981/6083] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:17:05 2022] GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb => generated 1691 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:17:05.950966 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-a61798ff-669c-46b1-9cd6-b9dda3c4e4d3 req-3f883d39-6d38-40df-9fee-22f67288202c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85a3ba9d-cc78-422b-8327-4191b2067feb", "name": "network-vif-unplugged", "status": "completed", "tag": "6bdfb525-38ed-4bf1-b293-5310c08a39a1"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:17:05.962557 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-a61798ff-669c-46b1-9cd6-b9dda3c4e4d3 req-3f883d39-6d38-40df-9fee-22f67288202c service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:05.963170 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-a61798ff-669c-46b1-9cd6-b9dda3c4e4d3 req-3f883d39-6d38-40df-9fee-22f67288202c service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:05.963682 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-a61798ff-669c-46b1-9cd6-b9dda3c4e4d3 req-3f883d39-6d38-40df-9fee-22f67288202c service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:05.978801 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-a61798ff-669c-46b1-9cd6-b9dda3c4e4d3 req-3f883d39-6d38-40df-9fee-22f67288202c service nova] Creating event network-vif-unplugged:6bdfb525-38ed-4bf1-b293-5310c08a39a1 for instance 85a3ba9d-cc78-422b-8327-4191b2067feb on n-h2-850501-12 Sep 08 11:17:05.984712 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [req-a61798ff-669c-46b1-9cd6-b9dda3c4e4d3 req-3f883d39-6d38-40df-9fee-22f67288202c service nova] Instance 85a3ba9d-cc78-422b-8327-4191b2067feb is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850501-12', 'n-h1-850501-12'} {{(pid=128861) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 11:17:05.997196 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-a61798ff-669c-46b1-9cd6-b9dda3c4e4d3 req-3f883d39-6d38-40df-9fee-22f67288202c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050916 Sep 08 11:17:05.997829 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3103/6084] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:17:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:17:06.855119 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1bb2ec11-7ec8-4158-a697-004259660b96 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:17:06.855897 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1bb2ec11-7ec8-4158-a697-004259660b96 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 85a3ba9d-cc78-422b-8327-4191b2067feb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:17:06.863799 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1bb2ec11-7ec8-4158-a697-004259660b96 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:06.864440 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1bb2ec11-7ec8-4158-a697-004259660b96 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:06.864991 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1bb2ec11-7ec8-4158-a697-004259660b96 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:06.865837 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1bb2ec11-7ec8-4158-a697-004259660b96 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:06.866405 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1bb2ec11-7ec8-4158-a697-004259660b96 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:06.866939 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1bb2ec11-7ec8-4158-a697-004259660b96 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:07.216314 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1bb2ec11-7ec8-4158-a697-004259660b96 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:17:07.216314 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1bb2ec11-7ec8-4158-a697-004259660b96 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb" status: 200 len: 1691 microversion: 2.1 time: 0.289566 Sep 08 11:17:07.216314 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2982/6085] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:17:06 2022] GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb => generated 1691 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:17:08.017132 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-f27d2259-0459-4733-9476-86f04f48bbad req-7b5f4daa-b675-497b-b12f-0b283e40a153 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85a3ba9d-cc78-422b-8327-4191b2067feb", "tag": "6bdfb525-38ed-4bf1-b293-5310c08a39a1"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:17:08.029055 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-f27d2259-0459-4733-9476-86f04f48bbad req-7b5f4daa-b675-497b-b12f-0b283e40a153 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:08.030818 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-f27d2259-0459-4733-9476-86f04f48bbad req-7b5f4daa-b675-497b-b12f-0b283e40a153 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:08.030818 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-f27d2259-0459-4733-9476-86f04f48bbad req-7b5f4daa-b675-497b-b12f-0b283e40a153 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:08.045646 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-f27d2259-0459-4733-9476-86f04f48bbad req-7b5f4daa-b675-497b-b12f-0b283e40a153 service nova] Creating event network-changed:6bdfb525-38ed-4bf1-b293-5310c08a39a1 for instance 85a3ba9d-cc78-422b-8327-4191b2067feb on n-h2-850501-12 Sep 08 11:17:08.056616 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [req-f27d2259-0459-4733-9476-86f04f48bbad req-7b5f4daa-b675-497b-b12f-0b283e40a153 service nova] Instance 85a3ba9d-cc78-422b-8327-4191b2067feb is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850501-12', 'n-h1-850501-12'} {{(pid=128861) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 11:17:08.070519 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-f27d2259-0459-4733-9476-86f04f48bbad req-7b5f4daa-b675-497b-b12f-0b283e40a153 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059118 Sep 08 11:17:08.071369 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3104/6086] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:17:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:17:08.173511 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7e3d3736-9b9c-4f2d-823e-5e0847853fba tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:17:08.174626 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7e3d3736-9b9c-4f2d-823e-5e0847853fba tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 85a3ba9d-cc78-422b-8327-4191b2067feb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:17:08.183981 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e3d3736-9b9c-4f2d-823e-5e0847853fba tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:08.185656 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e3d3736-9b9c-4f2d-823e-5e0847853fba tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:08.186205 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e3d3736-9b9c-4f2d-823e-5e0847853fba tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:08.187114 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e3d3736-9b9c-4f2d-823e-5e0847853fba tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:08.187703 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e3d3736-9b9c-4f2d-823e-5e0847853fba tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:08.188142 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e3d3736-9b9c-4f2d-823e-5e0847853fba tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:08.588167 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7e3d3736-9b9c-4f2d-823e-5e0847853fba tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:17:08.601976 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7e3d3736-9b9c-4f2d-823e-5e0847853fba tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb" status: 200 len: 1691 microversion: 2.1 time: 0.434066 Sep 08 11:17:08.607040 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2983/6087] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:17:08 2022] GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb => generated 1691 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:17:09.649324 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6e96490c-35e7-4f52-a1be-ff6608028281 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:17:09.651668 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6e96490c-35e7-4f52-a1be-ff6608028281 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 85a3ba9d-cc78-422b-8327-4191b2067feb] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:17:09.676279 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:17:09.680100 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6e96490c-35e7-4f52-a1be-ff6608028281 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:09.681095 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6e96490c-35e7-4f52-a1be-ff6608028281 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:09.681638 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6e96490c-35e7-4f52-a1be-ff6608028281 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:09.682463 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6e96490c-35e7-4f52-a1be-ff6608028281 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:09.683107 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6e96490c-35e7-4f52-a1be-ff6608028281 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:09.683926 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6e96490c-35e7-4f52-a1be-ff6608028281 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:09.892842 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6e96490c-35e7-4f52-a1be-ff6608028281 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:17:09.901258 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6e96490c-35e7-4f52-a1be-ff6608028281 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb" status: 200 len: 1684 microversion: 2.1 time: 0.266945 Sep 08 11:17:09.902195 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3105/6088] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:17:09 2022] GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb => generated 1684 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:17:10.542772 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-a5bbbb32-2ee2-45d4-9e0f-c15502c40aff req-7f4d92c6-43c4-4f0e-9311-78dfda21de9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85a3ba9d-cc78-422b-8327-4191b2067feb", "name": "network-vif-plugged", "status": "completed", "tag": "6bdfb525-38ed-4bf1-b293-5310c08a39a1"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:17:10.560963 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a5bbbb32-2ee2-45d4-9e0f-c15502c40aff req-7f4d92c6-43c4-4f0e-9311-78dfda21de9f service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:10.561481 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a5bbbb32-2ee2-45d4-9e0f-c15502c40aff req-7f4d92c6-43c4-4f0e-9311-78dfda21de9f service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:10.562099 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a5bbbb32-2ee2-45d4-9e0f-c15502c40aff req-7f4d92c6-43c4-4f0e-9311-78dfda21de9f service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:10.575006 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-a5bbbb32-2ee2-45d4-9e0f-c15502c40aff req-7f4d92c6-43c4-4f0e-9311-78dfda21de9f service nova] Creating event network-vif-plugged:6bdfb525-38ed-4bf1-b293-5310c08a39a1 for instance 85a3ba9d-cc78-422b-8327-4191b2067feb on n-h2-850501-12 Sep 08 11:17:10.580681 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-a5bbbb32-2ee2-45d4-9e0f-c15502c40aff req-7f4d92c6-43c4-4f0e-9311-78dfda21de9f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043155 Sep 08 11:17:10.581720 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2984/6089] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:17:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:17:32.328212 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-572a21ee-81cd-4a47-b57d-e39614cb9423 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:17:32.330420 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-572a21ee-81cd-4a47-b57d-e39614cb9423 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: 77e88235-e334-40dc-bd38-680e467ac4e2] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:17:32.338684 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:17:32.339547 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:17:32.342340 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-572a21ee-81cd-4a47-b57d-e39614cb9423 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:32.347262 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-572a21ee-81cd-4a47-b57d-e39614cb9423 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:32.348286 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-572a21ee-81cd-4a47-b57d-e39614cb9423 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:32.349632 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-572a21ee-81cd-4a47-b57d-e39614cb9423 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:32.358590 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-572a21ee-81cd-4a47-b57d-e39614cb9423 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:32.358590 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-572a21ee-81cd-4a47-b57d-e39614cb9423 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:32.387825 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-572a21ee-81cd-4a47-b57d-e39614cb9423 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "GET /compute/v2.1/servers/77e88235-e334-40dc-bd38-680e467ac4e2/ips" status: 200 len: 146 microversion: 2.1 time: 0.063744 Sep 08 11:17:32.388522 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3106/6090] 10.222.0.27 () {58 vars in 1248 bytes} [Thu Sep 8 11:17:32 2022] GET /compute/v2.1/servers/77e88235-e334-40dc-bd38-680e467ac4e2/ips => generated 146 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:17:33.192826 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-99f8db8b-5c1c-448e-95db-e31e25bc5394 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:17:33.196347 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-99f8db8b-5c1c-448e-95db-e31e25bc5394 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: 67dca3fd-4bba-447a-9af9-0aacf1dd5451] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:17:33.205140 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=13 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:17:33.206242 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=93 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:17:33.218303 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-99f8db8b-5c1c-448e-95db-e31e25bc5394 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:33.218303 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-99f8db8b-5c1c-448e-95db-e31e25bc5394 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:33.218303 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-99f8db8b-5c1c-448e-95db-e31e25bc5394 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:33.218303 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-99f8db8b-5c1c-448e-95db-e31e25bc5394 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:33.218303 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-99f8db8b-5c1c-448e-95db-e31e25bc5394 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:33.218303 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-99f8db8b-5c1c-448e-95db-e31e25bc5394 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:33.267309 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-99f8db8b-5c1c-448e-95db-e31e25bc5394 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.079175 Sep 08 11:17:33.274596 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2985/6091] 10.222.0.27 () {60 vars in 1343 bytes} [Thu Sep 8 11:17:33 2022] GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451/os-volume_attachments => generated 25 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:17:33.347611 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-77bf165c-e892-499d-93ca-d8aeb4495bea tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:17:33.348159 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-77bf165c-e892-499d-93ca-d8aeb4495bea tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: 67dca3fd-4bba-447a-9af9-0aacf1dd5451] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:17:33.356583 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-77bf165c-e892-499d-93ca-d8aeb4495bea tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:33.357393 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-77bf165c-e892-499d-93ca-d8aeb4495bea tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:33.358047 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-77bf165c-e892-499d-93ca-d8aeb4495bea tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:33.359492 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-77bf165c-e892-499d-93ca-d8aeb4495bea tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:33.360571 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-77bf165c-e892-499d-93ca-d8aeb4495bea tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:33.361136 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-77bf165c-e892-499d-93ca-d8aeb4495bea tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:33.402852 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-77bf165c-e892-499d-93ca-d8aeb4495bea tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: 67dca3fd-4bba-447a-9af9-0aacf1dd5451] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:17:33.525444 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-77bf165c-e892-499d-93ca-d8aeb4495bea tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "DELETE /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451" status: 204 len: 0 microversion: 2.20 time: 0.180820 Sep 08 11:17:33.543098 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7fadfab8-bd97-423c-8afe-15c8d56f5761 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:17:33.544693 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7fadfab8-bd97-423c-8afe-15c8d56f5761 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: 67dca3fd-4bba-447a-9af9-0aacf1dd5451] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:17:33.552969 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7fadfab8-bd97-423c-8afe-15c8d56f5761 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:33.553513 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7fadfab8-bd97-423c-8afe-15c8d56f5761 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:33.554016 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7fadfab8-bd97-423c-8afe-15c8d56f5761 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:33.554747 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7fadfab8-bd97-423c-8afe-15c8d56f5761 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:33.555216 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7fadfab8-bd97-423c-8afe-15c8d56f5761 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:33.555721 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7fadfab8-bd97-423c-8afe-15c8d56f5761 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:33.558104 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3107/6092] 10.222.0.27 () {60 vars in 1280 bytes} [Thu Sep 8 11:17:33 2022] DELETE /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 11:17:33.859056 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7fadfab8-bd97-423c-8afe-15c8d56f5761 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:17:33.866009 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bda1c1e9-b9cf-421e-a88d-1b0d8c9f7691 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1ff11e91-21cd-4a2d-9bca-268f27762de0"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:17:33.868421 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bda1c1e9-b9cf-421e-a88d-1b0d8c9f7691 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: 77e88235-e334-40dc-bd38-680e467ac4e2] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:17:33.868532 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7fadfab8-bd97-423c-8afe-15c8d56f5761 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:17:33.874695 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bda1c1e9-b9cf-421e-a88d-1b0d8c9f7691 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:33.874945 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7fadfab8-bd97-423c-8afe-15c8d56f5761 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:17:33.875688 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bda1c1e9-b9cf-421e-a88d-1b0d8c9f7691 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:33.876320 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bda1c1e9-b9cf-421e-a88d-1b0d8c9f7691 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:33.877016 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7fadfab8-bd97-423c-8afe-15c8d56f5761 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451" status: 200 len: 1723 microversion: 2.20 time: 0.338290 Sep 08 11:17:33.877170 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bda1c1e9-b9cf-421e-a88d-1b0d8c9f7691 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:33.877519 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bda1c1e9-b9cf-421e-a88d-1b0d8c9f7691 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:33.877816 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2986/6093] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:17:33 2022] GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451 => generated 1723 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:17:33.881684 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bda1c1e9-b9cf-421e-a88d-1b0d8c9f7691 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:34.241231 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bda1c1e9-b9cf-421e-a88d-1b0d8c9f7691 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "POST /compute/v2.1/servers/77e88235-e334-40dc-bd38-680e467ac4e2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.379331 Sep 08 11:17:34.241903 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3108/6094] 10.222.0.27 () {60 vars in 1323 bytes} [Thu Sep 8 11:17:33 2022] POST /compute/v2.1/servers/77e88235-e334-40dc-bd38-680e467ac4e2/os-volume_attachments => generated 194 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:17:34.908708 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bcaa6e80-073f-47cc-8136-09356c3a4839 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:17:34.909998 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bcaa6e80-073f-47cc-8136-09356c3a4839 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: 67dca3fd-4bba-447a-9af9-0aacf1dd5451] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:17:34.934776 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bcaa6e80-073f-47cc-8136-09356c3a4839 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:34.938606 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bcaa6e80-073f-47cc-8136-09356c3a4839 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:34.939302 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bcaa6e80-073f-47cc-8136-09356c3a4839 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:34.941301 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bcaa6e80-073f-47cc-8136-09356c3a4839 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:34.941928 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bcaa6e80-073f-47cc-8136-09356c3a4839 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:34.942965 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bcaa6e80-073f-47cc-8136-09356c3a4839 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:35.130466 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bcaa6e80-073f-47cc-8136-09356c3a4839 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:17:35.143989 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bcaa6e80-073f-47cc-8136-09356c3a4839 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:17:35.149402 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bcaa6e80-073f-47cc-8136-09356c3a4839 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:17:35.150666 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bcaa6e80-073f-47cc-8136-09356c3a4839 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451" status: 200 len: 1723 microversion: 2.20 time: 0.250264 Sep 08 11:17:35.151257 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2987/6095] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:17:34 2022] GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451 => generated 1723 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 11:17:36.182557 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-318663bb-fbd5-40f4-8a76-001485174e85 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:17:36.183982 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-318663bb-fbd5-40f4-8a76-001485174e85 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: 67dca3fd-4bba-447a-9af9-0aacf1dd5451] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:17:36.193815 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-318663bb-fbd5-40f4-8a76-001485174e85 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:36.194615 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-318663bb-fbd5-40f4-8a76-001485174e85 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:36.195277 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-318663bb-fbd5-40f4-8a76-001485174e85 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:36.196219 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-318663bb-fbd5-40f4-8a76-001485174e85 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:36.196902 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-318663bb-fbd5-40f4-8a76-001485174e85 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:36.197580 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-318663bb-fbd5-40f4-8a76-001485174e85 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:36.286049 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-318663bb-fbd5-40f4-8a76-001485174e85 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:17:36.299544 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-318663bb-fbd5-40f4-8a76-001485174e85 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:17:36.301821 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-318663bb-fbd5-40f4-8a76-001485174e85 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0da79f00a24cdb9312036aa4137aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364c37fba48647df9953911ecaa86e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:17:36.303979 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-318663bb-fbd5-40f4-8a76-001485174e85 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451" status: 200 len: 1656 microversion: 2.20 time: 0.125729 Sep 08 11:17:36.305168 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3109/6096] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:17:36 2022] GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451 => generated 1656 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 11:17:36.679321 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-fd38dbbb-6ded-49d0-a38e-87073318e4bc req-701efd9f-1737-4662-bf98-8d8c39c1ae93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67dca3fd-4bba-447a-9af9-0aacf1dd5451", "name": "network-vif-deleted", "tag": "242cd08b-a4b9-4348-bfc9-024fa3eaf821"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:17:36.692958 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-fd38dbbb-6ded-49d0-a38e-87073318e4bc req-701efd9f-1737-4662-bf98-8d8c39c1ae93 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:36.693763 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-fd38dbbb-6ded-49d0-a38e-87073318e4bc req-701efd9f-1737-4662-bf98-8d8c39c1ae93 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:36.694626 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-fd38dbbb-6ded-49d0-a38e-87073318e4bc req-701efd9f-1737-4662-bf98-8d8c39c1ae93 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:36.711256 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-fd38dbbb-6ded-49d0-a38e-87073318e4bc req-701efd9f-1737-4662-bf98-8d8c39c1ae93 service nova] Creating event network-vif-deleted:242cd08b-a4b9-4348-bfc9-024fa3eaf821 for instance 67dca3fd-4bba-447a-9af9-0aacf1dd5451 on n-h2-850501-12 Sep 08 11:17:36.717309 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-fd38dbbb-6ded-49d0-a38e-87073318e4bc req-701efd9f-1737-4662-bf98-8d8c39c1ae93 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045605 Sep 08 11:17:36.722466 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2988/6097] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:17:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:17:37.345979 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fece7806-99b3-4dc7-b75c-baa6ee758983 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:17:37.347456 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fece7806-99b3-4dc7-b75c-baa6ee758983 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: 67dca3fd-4bba-447a-9af9-0aacf1dd5451] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:17:37.368835 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fece7806-99b3-4dc7-b75c-baa6ee758983 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:37.369903 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fece7806-99b3-4dc7-b75c-baa6ee758983 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:37.371987 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fece7806-99b3-4dc7-b75c-baa6ee758983 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:37.374907 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fece7806-99b3-4dc7-b75c-baa6ee758983 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:37.375765 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fece7806-99b3-4dc7-b75c-baa6ee758983 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:37.377743 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fece7806-99b3-4dc7-b75c-baa6ee758983 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:37.413060 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-fece7806-99b3-4dc7-b75c-baa6ee758983 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] HTTP exception thrown: Instance 67dca3fd-4bba-447a-9af9-0aacf1dd5451 could not be found. Sep 08 11:17:37.415050 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fece7806-99b3-4dc7-b75c-baa6ee758983 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Request method failure captured: Sep 08 11:17:37.415050 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451 HTTP/1.1 Sep 08 11:17:37.415050 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:17:37.415050 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:17:37.415050 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:17:37.415050 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 11:17:37.415050 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:17:37.415050 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:17:37.415050 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:17:37.415050 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:17:37.415050 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGc3kfqVMG6_l5-n3Jy-yTIUNVn46vQMW0Svh8HvDX_Uw31ucMeRwEEg05OHVnjjynwLcmSgE9Go63mYndLW9b28zZhI7OsPdM7y12rMW0dEW1DuG0DWqI2z6goyVnhdLBllyJnuUcDLwXr0pG5cjZzwIq1snz9Ch69kN4pQx_GP1lvI Sep 08 11:17:37.415050 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:17:37.415050 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:17:37.415050 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:17:37.415050 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:17:37.415050 n-d-850501-12 devstack@n-api.service[128861]: X-Openstack-Nova-Api-Version: 2.20 Sep 08 11:17:37.415050 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:17:37.415050 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:17:37.415050 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 364c37fba48647df9953911ecaa86e73 Sep 08 11:17:37.415050 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-269023239 Sep 08 11:17:37.415050 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:17:37.415050 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:17:37.415050 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/364c37fba48647df9953911ecaa86e73"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/364c37fba48647df9953911ecaa86e73"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_364c37fba48647df9953911ecaa86e73"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/364c37fba48647df9953911ecaa86e73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:17:37.415050 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-AttachVolumeShelveTestJSON-269023239 Sep 08 11:17:37.415050 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 364c37fba48647df9953911ecaa86e73 Sep 08 11:17:37.415050 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-269023239 Sep 08 11:17:37.415050 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-AttachVolumeShelveTestJSON-269023239-project Sep 08 11:17:37.415050 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:17:37.415050 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:17:37.415050 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 2e0da79f00a24cdb9312036aa4137aa0 Sep 08 11:17:37.415050 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-AttachVolumeShelveTestJSON-269023239-project Sep 08 11:17:37.415050 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 11:17:37.415050 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 67dca3fd-4bba-447a-9af9-0aacf1dd5451 could not be found. Sep 08 11:17:37.415050 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '67dca3fd-4bba-447a-9af9-0aacf1dd5451'} Sep 08 11:17:37.415050 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:17:37.415050 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:17:37.415050 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:17:37.415050 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:17:37.415050 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:17:37.415050 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:17:37.415050 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:17:37.415050 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:17:37.415050 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:17:37.415050 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:17:37.415050 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67dca3fd-4bba-447a-9af9-0aacf1dd5451 could not be found. Sep 08 11:17:37.415050 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:17:37.415050 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:17:37.415050 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:17:37.415050 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:17:37.415050 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:17:37.415050 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:17:37.415050 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:17:37.415050 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:17:37.415050 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:17:37.415050 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:17:37.415050 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:17:37.415050 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:17:37.415050 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:17:37.415050 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:17:37.415050 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:17:37.415050 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:17:37.415050 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67dca3fd-4bba-447a-9af9-0aacf1dd5451 could not be found. Sep 08 11:17:37.415050 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:17:37.415050 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:17:37.420005 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:17:37.420005 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:17:37.420005 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:17:37.420005 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:17:37.420005 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:17:37.420005 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:17:37.420005 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67dca3fd-4bba-447a-9af9-0aacf1dd5451 could not be found. Sep 08 11:17:37.420005 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:17:37.420005 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fece7806-99b3-4dc7-b75c-baa6ee758983 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Returning 404 to user: Instance 67dca3fd-4bba-447a-9af9-0aacf1dd5451 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:17:37.420005 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fece7806-99b3-4dc7-b75c-baa6ee758983 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451" status: 404 len: 111 microversion: 2.20 time: 0.088397 Sep 08 11:17:37.420005 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3110/6098] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:17:37 2022] GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 11:17:37.431278 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ff41fcb4-f09a-476f-ac81-3871226dd507 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '.version_select at 0x7f68e8b30280>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:17:37.462374 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ff41fcb4-f09a-476f-ac81-3871226dd507 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1060095653" status: 204 len: 0 microversion: 2.20 time: 0.035932 Sep 08 11:17:37.463787 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2989/6099] 10.222.0.27 () {60 vars in 1262 bytes} [Thu Sep 8 11:17:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1060095653 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 11:17:38.380139 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-df50255f-64f3-4fea-8e0a-29716fdeff79 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:17:38.383304 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-df50255f-64f3-4fea-8e0a-29716fdeff79 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 85a3ba9d-cc78-422b-8327-4191b2067feb] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:17:38.394100 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-df50255f-64f3-4fea-8e0a-29716fdeff79 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:38.394627 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-df50255f-64f3-4fea-8e0a-29716fdeff79 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:38.395073 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-df50255f-64f3-4fea-8e0a-29716fdeff79 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:38.395813 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-df50255f-64f3-4fea-8e0a-29716fdeff79 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:38.396529 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-df50255f-64f3-4fea-8e0a-29716fdeff79 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:38.396697 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-df50255f-64f3-4fea-8e0a-29716fdeff79 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:38.466019 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-df50255f-64f3-4fea-8e0a-29716fdeff79 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "POST /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb/action" status: 200 len: 63150 microversion: 2.1 time: 0.304883 Sep 08 11:17:38.477074 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3111/6100] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 11:17:38 2022] POST /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb/action => generated 63150 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 11:17:40.709677 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-984b913f-a24f-4cab-add4-40cc95bf1e5f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:17:40.710305 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-984b913f-a24f-4cab-add4-40cc95bf1e5f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: 67dca3fd-4bba-447a-9af9-0aacf1dd5451] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:17:40.717740 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-984b913f-a24f-4cab-add4-40cc95bf1e5f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:40.719131 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-984b913f-a24f-4cab-add4-40cc95bf1e5f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:40.719817 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-984b913f-a24f-4cab-add4-40cc95bf1e5f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:40.720701 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-984b913f-a24f-4cab-add4-40cc95bf1e5f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:40.721356 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-984b913f-a24f-4cab-add4-40cc95bf1e5f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:40.721939 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-984b913f-a24f-4cab-add4-40cc95bf1e5f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:40.737577 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-984b913f-a24f-4cab-add4-40cc95bf1e5f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] HTTP exception thrown: Instance 67dca3fd-4bba-447a-9af9-0aacf1dd5451 could not be found. Sep 08 11:17:40.739765 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-984b913f-a24f-4cab-add4-40cc95bf1e5f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Request method failure captured: Sep 08 11:17:40.739765 n-d-850501-12 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451 HTTP/1.1 Sep 08 11:17:40.739765 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 11:17:40.739765 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 11:17:40.739765 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 11:17:40.739765 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 11:17:40.739765 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 11:17:40.739765 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 11:17:40.739765 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 11:17:40.739765 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 11:17:40.739765 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGc3kfqVMG6_l5-n3Jy-yTIUNVn46vQMW0Svh8HvDX_Uw31ucMeRwEEg05OHVnjjynwLcmSgE9Go63mYndLW9b28zZhI7OsPdM7y12rMW0dEW1DuG0DWqI2z6goyVnhdLBllyJnuUcDLwXr0pG5cjZzwIq1snz9Ch69kN4pQx_GP1lvI Sep 08 11:17:40.739765 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 11:17:40.739765 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 11:17:40.739765 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 11:17:40.739765 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 11:17:40.739765 n-d-850501-12 devstack@n-api.service[128862]: X-Openstack-Nova-Api-Version: 2.20 Sep 08 11:17:40.739765 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 11:17:40.739765 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 11:17:40.739765 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 364c37fba48647df9953911ecaa86e73 Sep 08 11:17:40.739765 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-269023239 Sep 08 11:17:40.739765 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 11:17:40.739765 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 11:17:40.739765 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/364c37fba48647df9953911ecaa86e73"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/364c37fba48647df9953911ecaa86e73"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_364c37fba48647df9953911ecaa86e73"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/364c37fba48647df9953911ecaa86e73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:17:40.739765 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-AttachVolumeShelveTestJSON-269023239 Sep 08 11:17:40.739765 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 364c37fba48647df9953911ecaa86e73 Sep 08 11:17:40.739765 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-269023239 Sep 08 11:17:40.739765 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-AttachVolumeShelveTestJSON-269023239-project Sep 08 11:17:40.739765 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 11:17:40.739765 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 11:17:40.739765 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 2e0da79f00a24cdb9312036aa4137aa0 Sep 08 11:17:40.739765 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-AttachVolumeShelveTestJSON-269023239-project Sep 08 11:17:40.739765 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 11:17:40.739765 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 67dca3fd-4bba-447a-9af9-0aacf1dd5451 could not be found. Sep 08 11:17:40.739765 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '67dca3fd-4bba-447a-9af9-0aacf1dd5451'} Sep 08 11:17:40.739765 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:17:40.739765 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:17:40.739765 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:17:40.739765 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:17:40.739765 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:17:40.739765 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:17:40.739765 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:17:40.739765 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:17:40.739765 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:17:40.739765 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:17:40.739765 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67dca3fd-4bba-447a-9af9-0aacf1dd5451 could not be found. Sep 08 11:17:40.739765 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:17:40.739765 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:17:40.739765 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:17:40.739765 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:17:40.739765 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:17:40.739765 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:17:40.739765 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:17:40.739765 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:17:40.739765 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:17:40.739765 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:17:40.739765 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 11:17:40.739765 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 11:17:40.739765 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 11:17:40.739765 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 11:17:40.739765 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:17:40.739765 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:17:40.739765 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:17:40.739765 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:17:40.743647 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67dca3fd-4bba-447a-9af9-0aacf1dd5451 could not be found. Sep 08 11:17:40.743647 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:17:40.743647 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:17:40.743647 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:17:40.743647 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:17:40.743647 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:17:40.743647 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:17:40.743647 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:17:40.743647 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:17:40.743647 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67dca3fd-4bba-447a-9af9-0aacf1dd5451 could not be found. Sep 08 11:17:40.743647 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:17:40.745625 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-984b913f-a24f-4cab-add4-40cc95bf1e5f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Returning 404 to user: Instance 67dca3fd-4bba-447a-9af9-0aacf1dd5451 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:17:40.746704 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-984b913f-a24f-4cab-add4-40cc95bf1e5f tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "DELETE /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451" status: 404 len: 111 microversion: 2.20 time: 0.042097 Sep 08 11:17:40.747460 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2990/6101] 10.222.0.27 () {60 vars in 1280 bytes} [Thu Sep 8 11:17:40 2022] DELETE /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 11:17:40.757009 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fdc4ed7a-13b8-48b0-a008-70db99d607a0 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:17:40.757878 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fdc4ed7a-13b8-48b0-a008-70db99d607a0 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: 67dca3fd-4bba-447a-9af9-0aacf1dd5451] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:17:40.766007 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fdc4ed7a-13b8-48b0-a008-70db99d607a0 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:40.766981 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fdc4ed7a-13b8-48b0-a008-70db99d607a0 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:40.767748 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fdc4ed7a-13b8-48b0-a008-70db99d607a0 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:40.769054 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fdc4ed7a-13b8-48b0-a008-70db99d607a0 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:40.769998 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fdc4ed7a-13b8-48b0-a008-70db99d607a0 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:40.770622 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fdc4ed7a-13b8-48b0-a008-70db99d607a0 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:40.788764 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-fdc4ed7a-13b8-48b0-a008-70db99d607a0 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] HTTP exception thrown: Instance 67dca3fd-4bba-447a-9af9-0aacf1dd5451 could not be found. Sep 08 11:17:40.791368 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fdc4ed7a-13b8-48b0-a008-70db99d607a0 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Request method failure captured: Sep 08 11:17:40.791368 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451 HTTP/1.1 Sep 08 11:17:40.791368 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:17:40.791368 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:17:40.791368 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:17:40.791368 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 11:17:40.791368 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:17:40.791368 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:17:40.791368 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:17:40.791368 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:17:40.791368 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGc3kfqVMG6_l5-n3Jy-yTIUNVn46vQMW0Svh8HvDX_Uw31ucMeRwEEg05OHVnjjynwLcmSgE9Go63mYndLW9b28zZhI7OsPdM7y12rMW0dEW1DuG0DWqI2z6goyVnhdLBllyJnuUcDLwXr0pG5cjZzwIq1snz9Ch69kN4pQx_GP1lvI Sep 08 11:17:40.791368 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:17:40.791368 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:17:40.791368 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:17:40.791368 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:17:40.791368 n-d-850501-12 devstack@n-api.service[128861]: X-Openstack-Nova-Api-Version: 2.20 Sep 08 11:17:40.791368 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:17:40.791368 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:17:40.791368 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 364c37fba48647df9953911ecaa86e73 Sep 08 11:17:40.791368 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-269023239 Sep 08 11:17:40.791368 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:17:40.791368 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:17:40.791368 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/364c37fba48647df9953911ecaa86e73"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/364c37fba48647df9953911ecaa86e73"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_364c37fba48647df9953911ecaa86e73"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/364c37fba48647df9953911ecaa86e73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:17:40.791368 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-AttachVolumeShelveTestJSON-269023239 Sep 08 11:17:40.791368 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 364c37fba48647df9953911ecaa86e73 Sep 08 11:17:40.791368 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-269023239 Sep 08 11:17:40.791368 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-AttachVolumeShelveTestJSON-269023239-project Sep 08 11:17:40.791368 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:17:40.791368 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:17:40.791368 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 2e0da79f00a24cdb9312036aa4137aa0 Sep 08 11:17:40.791368 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-AttachVolumeShelveTestJSON-269023239-project Sep 08 11:17:40.791368 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 11:17:40.791368 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 67dca3fd-4bba-447a-9af9-0aacf1dd5451 could not be found. Sep 08 11:17:40.791368 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '67dca3fd-4bba-447a-9af9-0aacf1dd5451'} Sep 08 11:17:40.791368 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:17:40.791368 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:17:40.791368 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:17:40.791368 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:17:40.791368 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:17:40.791368 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:17:40.791368 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:17:40.791368 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:17:40.791368 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:17:40.791368 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:17:40.791368 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67dca3fd-4bba-447a-9af9-0aacf1dd5451 could not be found. Sep 08 11:17:40.791368 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:17:40.791368 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:17:40.791368 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:17:40.791368 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:17:40.791368 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:17:40.791368 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:17:40.791368 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:17:40.791368 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:17:40.791368 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:17:40.791368 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:17:40.791368 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:17:40.791368 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:17:40.791368 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:17:40.791368 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:17:40.791368 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:17:40.791368 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:17:40.791368 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67dca3fd-4bba-447a-9af9-0aacf1dd5451 could not be found. Sep 08 11:17:40.791368 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:17:40.791368 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:17:40.798367 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:17:40.798367 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:17:40.798367 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:17:40.798367 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:17:40.798367 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:17:40.798367 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:17:40.798367 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67dca3fd-4bba-447a-9af9-0aacf1dd5451 could not be found. Sep 08 11:17:40.798367 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:17:40.800346 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fdc4ed7a-13b8-48b0-a008-70db99d607a0 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Returning 404 to user: Instance 67dca3fd-4bba-447a-9af9-0aacf1dd5451 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:17:40.801562 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fdc4ed7a-13b8-48b0-a008-70db99d607a0 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451" status: 404 len: 111 microversion: 2.20 time: 0.049254 Sep 08 11:17:40.802657 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3112/6102] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:17:40 2022] GET /compute/v2.1/servers/67dca3fd-4bba-447a-9af9-0aacf1dd5451 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 11:17:44.789969 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-36c2ecac-5953-4f99-bcc0-c4476ac817b3 tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:17:44.790597 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-36c2ecac-5953-4f99-bcc0-c4476ac817b3 tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] [instance: 85a3ba9d-cc78-422b-8327-4191b2067feb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:17:44.805125 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36c2ecac-5953-4f99-bcc0-c4476ac817b3 tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:44.806014 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36c2ecac-5953-4f99-bcc0-c4476ac817b3 tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:44.806466 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36c2ecac-5953-4f99-bcc0-c4476ac817b3 tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:44.807239 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36c2ecac-5953-4f99-bcc0-c4476ac817b3 tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:44.807926 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36c2ecac-5953-4f99-bcc0-c4476ac817b3 tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:44.808223 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36c2ecac-5953-4f99-bcc0-c4476ac817b3 tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:45.006940 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-36c2ecac-5953-4f99-bcc0-c4476ac817b3 tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb" status: 200 len: 1837 microversion: 2.1 time: 0.359204 Sep 08 11:17:45.007683 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2991/6103] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:17:44 2022] GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb => generated 1837 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:17:46.132149 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-721f2401-9053-4071-8999-f99ad6cbcbd6 req-2b9b66ca-5015-4e13-b8b0-9c7445a18f6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85a3ba9d-cc78-422b-8327-4191b2067feb", "tag": "6bdfb525-38ed-4bf1-b293-5310c08a39a1"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:17:46.133012 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1d60f147-0c60-414d-857d-d87ef477d7b5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:17:46.144505 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1d60f147-0c60-414d-857d-d87ef477d7b5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 85a3ba9d-cc78-422b-8327-4191b2067feb] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:17:46.150290 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-721f2401-9053-4071-8999-f99ad6cbcbd6 req-2b9b66ca-5015-4e13-b8b0-9c7445a18f6a service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:46.150978 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-721f2401-9053-4071-8999-f99ad6cbcbd6 req-2b9b66ca-5015-4e13-b8b0-9c7445a18f6a service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:46.151727 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-721f2401-9053-4071-8999-f99ad6cbcbd6 req-2b9b66ca-5015-4e13-b8b0-9c7445a18f6a service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:46.163990 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1d60f147-0c60-414d-857d-d87ef477d7b5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:46.164733 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1d60f147-0c60-414d-857d-d87ef477d7b5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:46.165357 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1d60f147-0c60-414d-857d-d87ef477d7b5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:46.166221 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1d60f147-0c60-414d-857d-d87ef477d7b5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:46.166849 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1d60f147-0c60-414d-857d-d87ef477d7b5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:46.167431 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1d60f147-0c60-414d-857d-d87ef477d7b5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:46.198180 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-721f2401-9053-4071-8999-f99ad6cbcbd6 req-2b9b66ca-5015-4e13-b8b0-9c7445a18f6a service nova] Creating event network-changed:6bdfb525-38ed-4bf1-b293-5310c08a39a1 for instance 85a3ba9d-cc78-422b-8327-4191b2067feb on n-h2-850501-12 Sep 08 11:17:46.206744 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-721f2401-9053-4071-8999-f99ad6cbcbd6 req-2b9b66ca-5015-4e13-b8b0-9c7445a18f6a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078800 Sep 08 11:17:46.208096 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2992/6104] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:17:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:17:46.227666 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1d60f147-0c60-414d-857d-d87ef477d7b5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 85a3ba9d-cc78-422b-8327-4191b2067feb] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:17:46.447603 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1d60f147-0c60-414d-857d-d87ef477d7b5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "DELETE /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb" status: 204 len: 0 microversion: 2.1 time: 0.324546 Sep 08 11:17:46.448377 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3113/6105] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:17:46 2022] DELETE /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:17:46.457974 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-23761276-06b2-48a2-a432-715fcbc4f565 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:17:46.458685 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-23761276-06b2-48a2-a432-715fcbc4f565 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 85a3ba9d-cc78-422b-8327-4191b2067feb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:17:46.469010 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23761276-06b2-48a2-a432-715fcbc4f565 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:46.469538 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23761276-06b2-48a2-a432-715fcbc4f565 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:46.469986 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23761276-06b2-48a2-a432-715fcbc4f565 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:46.470709 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23761276-06b2-48a2-a432-715fcbc4f565 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:46.471176 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23761276-06b2-48a2-a432-715fcbc4f565 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:46.471611 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23761276-06b2-48a2-a432-715fcbc4f565 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:46.727001 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-23761276-06b2-48a2-a432-715fcbc4f565 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:17:46.736190 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-23761276-06b2-48a2-a432-715fcbc4f565 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb" status: 200 len: 1690 microversion: 2.1 time: 0.282405 Sep 08 11:17:46.754090 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2993/6106] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:17:46 2022] GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb => generated 1690 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:17:47.760905 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5aaa79ea-c11c-4061-81e4-10f7eda7c774 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:17:47.764868 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5aaa79ea-c11c-4061-81e4-10f7eda7c774 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 85a3ba9d-cc78-422b-8327-4191b2067feb] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:17:47.776846 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5aaa79ea-c11c-4061-81e4-10f7eda7c774 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:47.777361 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5aaa79ea-c11c-4061-81e4-10f7eda7c774 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:47.777992 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5aaa79ea-c11c-4061-81e4-10f7eda7c774 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:47.778874 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5aaa79ea-c11c-4061-81e4-10f7eda7c774 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:47.779488 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5aaa79ea-c11c-4061-81e4-10f7eda7c774 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:47.780247 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5aaa79ea-c11c-4061-81e4-10f7eda7c774 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:48.386993 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5aaa79ea-c11c-4061-81e4-10f7eda7c774 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:17:48.399549 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5aaa79ea-c11c-4061-81e4-10f7eda7c774 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb" status: 200 len: 1690 microversion: 2.1 time: 0.643171 Sep 08 11:17:48.403367 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3114/6107] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:17:47 2022] GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb => generated 1690 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:17:48.522335 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-82bf63f2-5392-45ce-a4ad-1791cfa0e5ef tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:17:48.523329 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-82bf63f2-5392-45ce-a4ad-1791cfa0e5ef tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:17:48.541149 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-82bf63f2-5392-45ce-a4ad-1791cfa0e5ef tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:48.544378 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-82bf63f2-5392-45ce-a4ad-1791cfa0e5ef tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:48.545220 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-82bf63f2-5392-45ce-a4ad-1791cfa0e5ef tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:48.546809 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-82bf63f2-5392-45ce-a4ad-1791cfa0e5ef tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:48.549593 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-82bf63f2-5392-45ce-a4ad-1791cfa0e5ef tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:48.550497 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-82bf63f2-5392-45ce-a4ad-1791cfa0e5ef tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:48.574283 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-82bf63f2-5392-45ce-a4ad-1791cfa0e5ef tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] HTTP exception thrown: Instance f9c23be4-60f4-4bff-9e0d-8040618b552e could not be found. Sep 08 11:17:48.576560 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-82bf63f2-5392-45ce-a4ad-1791cfa0e5ef tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Request method failure captured: Sep 08 11:17:48.576560 n-d-850501-12 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e HTTP/1.1 Sep 08 11:17:48.576560 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 11:17:48.576560 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 11:17:48.576560 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 11:17:48.576560 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 11:17:48.576560 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 11:17:48.576560 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 11:17:48.576560 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 11:17:48.576560 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 11:17:48.576560 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGc3kfqVMG6_l5-n3Jy-yTIUNVn46vQMW0Svh8HvDX_Uw31ucMeRwEEg05OHVnjjynwLcmSgE9Go63mYndLW9b28zZhI7OsPdM7y12rMW0dEW1DuG0DWqI2z6goyVnhdLBllyJnuUcDLwXr0pG5cjZzwIq1snz9Ch69kN4pQx_GP1lvI Sep 08 11:17:48.576560 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 11:17:48.576560 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 11:17:48.576560 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 11:17:48.576560 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 11:17:48.576560 n-d-850501-12 devstack@n-api.service[128862]: X-Openstack-Nova-Api-Version: 2.20 Sep 08 11:17:48.576560 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 11:17:48.576560 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 11:17:48.576560 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 364c37fba48647df9953911ecaa86e73 Sep 08 11:17:48.576560 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-269023239 Sep 08 11:17:48.576560 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 11:17:48.576560 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 11:17:48.576560 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/364c37fba48647df9953911ecaa86e73"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/364c37fba48647df9953911ecaa86e73"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_364c37fba48647df9953911ecaa86e73"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/364c37fba48647df9953911ecaa86e73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:17:48.576560 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-AttachVolumeShelveTestJSON-269023239 Sep 08 11:17:48.576560 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 364c37fba48647df9953911ecaa86e73 Sep 08 11:17:48.576560 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-269023239 Sep 08 11:17:48.576560 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-AttachVolumeShelveTestJSON-269023239-project Sep 08 11:17:48.576560 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 11:17:48.576560 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 11:17:48.576560 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 2e0da79f00a24cdb9312036aa4137aa0 Sep 08 11:17:48.576560 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-AttachVolumeShelveTestJSON-269023239-project Sep 08 11:17:48.576560 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 11:17:48.576560 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance f9c23be4-60f4-4bff-9e0d-8040618b552e could not be found. Sep 08 11:17:48.576560 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'f9c23be4-60f4-4bff-9e0d-8040618b552e'} Sep 08 11:17:48.576560 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:17:48.576560 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:17:48.576560 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:17:48.576560 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:17:48.576560 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:17:48.576560 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:17:48.576560 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:17:48.576560 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:17:48.576560 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:17:48.576560 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:17:48.576560 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9c23be4-60f4-4bff-9e0d-8040618b552e could not be found. Sep 08 11:17:48.576560 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:17:48.576560 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:17:48.576560 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:17:48.576560 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:17:48.576560 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:17:48.576560 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:17:48.576560 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:17:48.576560 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:17:48.576560 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:17:48.576560 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:17:48.576560 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 11:17:48.576560 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 11:17:48.576560 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 11:17:48.576560 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 11:17:48.576560 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:17:48.576560 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:17:48.576560 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:17:48.576560 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:17:48.582066 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9c23be4-60f4-4bff-9e0d-8040618b552e could not be found. Sep 08 11:17:48.582066 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:17:48.582066 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:17:48.582066 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:17:48.582066 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:17:48.582066 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:17:48.582066 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:17:48.582066 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:17:48.582066 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:17:48.582066 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9c23be4-60f4-4bff-9e0d-8040618b552e could not be found. Sep 08 11:17:48.582066 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:17:48.584240 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-82bf63f2-5392-45ce-a4ad-1791cfa0e5ef tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Returning 404 to user: Instance f9c23be4-60f4-4bff-9e0d-8040618b552e could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:17:48.585348 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-82bf63f2-5392-45ce-a4ad-1791cfa0e5ef tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e" status: 404 len: 111 microversion: 2.20 time: 0.069490 Sep 08 11:17:48.586056 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2994/6108] 10.222.0.27 () {60 vars in 1280 bytes} [Thu Sep 8 11:17:48 2022] DELETE /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 11:17:48.596328 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1a90ce3e-4908-4c83-b3c1-0931317ee303 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:17:48.596945 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1a90ce3e-4908-4c83-b3c1-0931317ee303 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] [instance: f9c23be4-60f4-4bff-9e0d-8040618b552e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:17:48.608317 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1a90ce3e-4908-4c83-b3c1-0931317ee303 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:48.609446 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1a90ce3e-4908-4c83-b3c1-0931317ee303 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:48.610083 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1a90ce3e-4908-4c83-b3c1-0931317ee303 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:48.611121 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1a90ce3e-4908-4c83-b3c1-0931317ee303 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:48.611581 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1a90ce3e-4908-4c83-b3c1-0931317ee303 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:48.612010 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1a90ce3e-4908-4c83-b3c1-0931317ee303 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:48.645273 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-1a90ce3e-4908-4c83-b3c1-0931317ee303 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] HTTP exception thrown: Instance f9c23be4-60f4-4bff-9e0d-8040618b552e could not be found. Sep 08 11:17:48.646985 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1a90ce3e-4908-4c83-b3c1-0931317ee303 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Request method failure captured: Sep 08 11:17:48.646985 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e HTTP/1.1 Sep 08 11:17:48.646985 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:17:48.646985 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:17:48.646985 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:17:48.646985 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 11:17:48.646985 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:17:48.646985 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:17:48.646985 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:17:48.646985 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:17:48.646985 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGc3kfqVMG6_l5-n3Jy-yTIUNVn46vQMW0Svh8HvDX_Uw31ucMeRwEEg05OHVnjjynwLcmSgE9Go63mYndLW9b28zZhI7OsPdM7y12rMW0dEW1DuG0DWqI2z6goyVnhdLBllyJnuUcDLwXr0pG5cjZzwIq1snz9Ch69kN4pQx_GP1lvI Sep 08 11:17:48.646985 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:17:48.646985 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:17:48.646985 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:17:48.646985 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:17:48.646985 n-d-850501-12 devstack@n-api.service[128861]: X-Openstack-Nova-Api-Version: 2.20 Sep 08 11:17:48.646985 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:17:48.646985 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:17:48.646985 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 364c37fba48647df9953911ecaa86e73 Sep 08 11:17:48.646985 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-269023239 Sep 08 11:17:48.646985 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:17:48.646985 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:17:48.646985 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/364c37fba48647df9953911ecaa86e73"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/364c37fba48647df9953911ecaa86e73"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_364c37fba48647df9953911ecaa86e73"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/364c37fba48647df9953911ecaa86e73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:17:48.646985 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-AttachVolumeShelveTestJSON-269023239 Sep 08 11:17:48.646985 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 364c37fba48647df9953911ecaa86e73 Sep 08 11:17:48.646985 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-269023239 Sep 08 11:17:48.646985 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-AttachVolumeShelveTestJSON-269023239-project Sep 08 11:17:48.646985 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:17:48.646985 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:17:48.646985 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 2e0da79f00a24cdb9312036aa4137aa0 Sep 08 11:17:48.646985 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-AttachVolumeShelveTestJSON-269023239-project Sep 08 11:17:48.646985 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 11:17:48.646985 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance f9c23be4-60f4-4bff-9e0d-8040618b552e could not be found. Sep 08 11:17:48.646985 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': 'f9c23be4-60f4-4bff-9e0d-8040618b552e'} Sep 08 11:17:48.646985 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:17:48.646985 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:17:48.646985 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:17:48.646985 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:17:48.646985 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:17:48.646985 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:17:48.646985 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:17:48.646985 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:17:48.646985 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:17:48.646985 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:17:48.646985 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9c23be4-60f4-4bff-9e0d-8040618b552e could not be found. Sep 08 11:17:48.646985 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:17:48.646985 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:17:48.646985 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:17:48.646985 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:17:48.646985 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:17:48.646985 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:17:48.646985 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:17:48.646985 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:17:48.646985 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:17:48.646985 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:17:48.646985 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:17:48.646985 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:17:48.646985 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:17:48.646985 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:17:48.646985 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:17:48.646985 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:17:48.646985 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9c23be4-60f4-4bff-9e0d-8040618b552e could not be found. Sep 08 11:17:48.646985 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:17:48.646985 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:17:48.651426 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:17:48.651426 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:17:48.651426 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:17:48.651426 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:17:48.651426 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:17:48.651426 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:17:48.651426 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9c23be4-60f4-4bff-9e0d-8040618b552e could not be found. Sep 08 11:17:48.651426 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:17:48.651426 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1a90ce3e-4908-4c83-b3c1-0931317ee303 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] Returning 404 to user: Instance f9c23be4-60f4-4bff-9e0d-8040618b552e could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:17:48.651426 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1a90ce3e-4908-4c83-b3c1-0931317ee303 tempest-AttachVolumeShelveTestJSON-269023239 tempest-AttachVolumeShelveTestJSON-269023239-project] 10.222.0.27 "GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e" status: 404 len: 111 microversion: 2.20 time: 0.057415 Sep 08 11:17:48.654616 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3115/6109] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 11:17:48 2022] GET /compute/v2.1/servers/f9c23be4-60f4-4bff-9e0d-8040618b552e => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 11:17:48.826024 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-9c8e084c-4b06-4adf-9cec-0d76c101b8f5 req-8cebb8de-2c9e-468e-9e97-fe4c8440f6de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85a3ba9d-cc78-422b-8327-4191b2067feb", "name": "network-vif-deleted", "tag": "6bdfb525-38ed-4bf1-b293-5310c08a39a1"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:17:48.840764 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-9c8e084c-4b06-4adf-9cec-0d76c101b8f5 req-8cebb8de-2c9e-468e-9e97-fe4c8440f6de service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:48.844126 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-9c8e084c-4b06-4adf-9cec-0d76c101b8f5 req-8cebb8de-2c9e-468e-9e97-fe4c8440f6de service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:48.845935 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-9c8e084c-4b06-4adf-9cec-0d76c101b8f5 req-8cebb8de-2c9e-468e-9e97-fe4c8440f6de service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:48.869909 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-9c8e084c-4b06-4adf-9cec-0d76c101b8f5 req-8cebb8de-2c9e-468e-9e97-fe4c8440f6de service nova] Creating event network-vif-deleted:6bdfb525-38ed-4bf1-b293-5310c08a39a1 for instance 85a3ba9d-cc78-422b-8327-4191b2067feb on n-h2-850501-12 Sep 08 11:17:48.880664 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-9c8e084c-4b06-4adf-9cec-0d76c101b8f5 req-8cebb8de-2c9e-468e-9e97-fe4c8440f6de service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058712 Sep 08 11:17:48.881305 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2995/6110] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:17:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:17:49.426884 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4c44f5bc-d0e1-4199-b2de-521354a475c2 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:17:49.427513 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4c44f5bc-d0e1-4199-b2de-521354a475c2 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 85a3ba9d-cc78-422b-8327-4191b2067feb] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:17:49.443849 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4c44f5bc-d0e1-4199-b2de-521354a475c2 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:49.444348 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4c44f5bc-d0e1-4199-b2de-521354a475c2 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:49.444776 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4c44f5bc-d0e1-4199-b2de-521354a475c2 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:49.445720 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4c44f5bc-d0e1-4199-b2de-521354a475c2 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:49.446327 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4c44f5bc-d0e1-4199-b2de-521354a475c2 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:49.446906 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4c44f5bc-d0e1-4199-b2de-521354a475c2 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:49.581001 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4c44f5bc-d0e1-4199-b2de-521354a475c2 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:49.581463 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4c44f5bc-d0e1-4199-b2de-521354a475c2 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:49.589416 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4c44f5bc-d0e1-4199-b2de-521354a475c2 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:49.590535 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-4c44f5bc-d0e1-4199-b2de-521354a475c2 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lazy-loading 'fault' on Instance uuid 85a3ba9d-cc78-422b-8327-4191b2067feb {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:17:49.651854 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4c44f5bc-d0e1-4199-b2de-521354a475c2 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:17:49.660366 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4c44f5bc-d0e1-4199-b2de-521354a475c2 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb" status: 200 len: 1356 microversion: 2.1 time: 0.237279 Sep 08 11:17:49.664272 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3116/6111] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:17:49 2022] GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb => generated 1356 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:17:49.823053 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cbfe434c-0e8b-4742-ba61-4fb3444c18f0 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:17:49.826340 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cbfe434c-0e8b-4742-ba61-4fb3444c18f0 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: 77e88235-e334-40dc-bd38-680e467ac4e2] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:17:49.833691 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cbfe434c-0e8b-4742-ba61-4fb3444c18f0 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:49.834435 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cbfe434c-0e8b-4742-ba61-4fb3444c18f0 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:49.834877 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cbfe434c-0e8b-4742-ba61-4fb3444c18f0 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:49.835751 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cbfe434c-0e8b-4742-ba61-4fb3444c18f0 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:49.836218 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cbfe434c-0e8b-4742-ba61-4fb3444c18f0 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:49.836650 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cbfe434c-0e8b-4742-ba61-4fb3444c18f0 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:49.872851 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cbfe434c-0e8b-4742-ba61-4fb3444c18f0 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "GET /compute/v2.1/servers/77e88235-e334-40dc-bd38-680e467ac4e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055894 Sep 08 11:17:49.886029 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e0688b7f-9f96-47e1-8f23-5c4423fad483 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:17:49.886532 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e0688b7f-9f96-47e1-8f23-5c4423fad483 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: 77e88235-e334-40dc-bd38-680e467ac4e2] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:17:49.892761 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2996/6112] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 11:17:49 2022] GET /compute/v2.1/servers/77e88235-e334-40dc-bd38-680e467ac4e2/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:17:49.895594 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e0688b7f-9f96-47e1-8f23-5c4423fad483 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:49.896255 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e0688b7f-9f96-47e1-8f23-5c4423fad483 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:49.897018 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e0688b7f-9f96-47e1-8f23-5c4423fad483 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:49.898404 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e0688b7f-9f96-47e1-8f23-5c4423fad483 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:49.899028 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e0688b7f-9f96-47e1-8f23-5c4423fad483 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:49.899615 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e0688b7f-9f96-47e1-8f23-5c4423fad483 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:49.937478 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e0688b7f-9f96-47e1-8f23-5c4423fad483 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "GET /compute/v2.1/servers/77e88235-e334-40dc-bd38-680e467ac4e2/os-volume_attachments/1ff11e91-21cd-4a2d-9bca-268f27762de0" status: 200 len: 194 microversion: 2.1 time: 0.055501 Sep 08 11:17:49.938099 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3117/6113] 10.222.0.27 () {58 vars in 1413 bytes} [Thu Sep 8 11:17:49 2022] GET /compute/v2.1/servers/77e88235-e334-40dc-bd38-680e467ac4e2/os-volume_attachments/1ff11e91-21cd-4a2d-9bca-268f27762de0 => generated 194 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:17:50.691487 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-00b90c61-2dbf-4db0-af90-a9ebb9b4089b tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:17:50.692624 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-00b90c61-2dbf-4db0-af90-a9ebb9b4089b tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 85a3ba9d-cc78-422b-8327-4191b2067feb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:17:50.717732 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00b90c61-2dbf-4db0-af90-a9ebb9b4089b tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:50.719077 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00b90c61-2dbf-4db0-af90-a9ebb9b4089b tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:50.719727 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00b90c61-2dbf-4db0-af90-a9ebb9b4089b tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:50.721403 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00b90c61-2dbf-4db0-af90-a9ebb9b4089b tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:50.722165 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00b90c61-2dbf-4db0-af90-a9ebb9b4089b tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:50.722916 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00b90c61-2dbf-4db0-af90-a9ebb9b4089b tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:50.750711 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-00b90c61-2dbf-4db0-af90-a9ebb9b4089b tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] HTTP exception thrown: Instance 85a3ba9d-cc78-422b-8327-4191b2067feb could not be found. Sep 08 11:17:50.753157 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-00b90c61-2dbf-4db0-af90-a9ebb9b4089b tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Request method failure captured: Sep 08 11:17:50.753157 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb HTTP/1.1 Sep 08 11:17:50.753157 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 11:17:50.753157 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 11:17:50.753157 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 11:17:50.753157 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 11:17:50.753157 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 11:17:50.753157 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 11:17:50.753157 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 11:17:50.753157 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 11:17:50.753157 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGc4eLGLW59QQolLaaYcmDAiK1YbvX0P6Oar8zm2OskBZObiWASS3uPq8vhdcTC5ZdVCfihBjMcHmME9I_dk-w3cv_qjNt6vtGdn5VgVz6nIlOrAKGTn8XYgxYQT4bLviOyr8E8viE7U4gtGDdg6vP3Ww_5rPnGvOSYRnSwZtG3vZ7Ao Sep 08 11:17:50.753157 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 11:17:50.753157 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 11:17:50.753157 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 11:17:50.753157 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 11:17:50.753157 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 11:17:50.753157 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 11:17:50.753157 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: a0f9071124e74802a2f76cb326ca58df Sep 08 11:17:50.753157 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1864834353 Sep 08 11:17:50.753157 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 11:17:50.753157 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 11:17:50.753157 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a0f9071124e74802a2f76cb326ca58df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a0f9071124e74802a2f76cb326ca58df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a0f9071124e74802a2f76cb326ca58df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a0f9071124e74802a2f76cb326ca58df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:17:50.753157 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1864834353 Sep 08 11:17:50.753157 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: a0f9071124e74802a2f76cb326ca58df Sep 08 11:17:50.753157 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1864834353 Sep 08 11:17:50.753157 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-TestNetworkAdvancedServerOps-1864834353-project Sep 08 11:17:50.753157 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 11:17:50.753157 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 11:17:50.753157 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: c33e91fa4e3746aa8d8d23940e17bc1e Sep 08 11:17:50.753157 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1864834353-project Sep 08 11:17:50.753157 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 11:17:50.753157 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 85a3ba9d-cc78-422b-8327-4191b2067feb could not be found. Sep 08 11:17:50.753157 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '85a3ba9d-cc78-422b-8327-4191b2067feb'} Sep 08 11:17:50.753157 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:17:50.753157 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:17:50.753157 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:17:50.753157 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:17:50.753157 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:17:50.753157 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:17:50.753157 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:17:50.753157 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:17:50.753157 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:17:50.753157 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:17:50.753157 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85a3ba9d-cc78-422b-8327-4191b2067feb could not be found. Sep 08 11:17:50.753157 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:17:50.753157 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:17:50.753157 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:17:50.753157 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:17:50.753157 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:17:50.753157 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:17:50.753157 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:17:50.753157 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:17:50.753157 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:17:50.753157 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:17:50.753157 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:17:50.753157 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:17:50.753157 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:17:50.753157 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:17:50.753157 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:17:50.753157 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:17:50.753157 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85a3ba9d-cc78-422b-8327-4191b2067feb could not be found. Sep 08 11:17:50.753157 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:17:50.753157 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:17:50.757663 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:17:50.757663 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:17:50.757663 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:17:50.757663 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:17:50.757663 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:17:50.757663 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:17:50.757663 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85a3ba9d-cc78-422b-8327-4191b2067feb could not be found. Sep 08 11:17:50.757663 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:17:50.759242 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-00b90c61-2dbf-4db0-af90-a9ebb9b4089b tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Returning 404 to user: Instance 85a3ba9d-cc78-422b-8327-4191b2067feb could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:17:50.760334 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-00b90c61-2dbf-4db0-af90-a9ebb9b4089b tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb" status: 404 len: 111 microversion: 2.1 time: 0.075017 Sep 08 11:17:50.767239 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2997/6114] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:17:50 2022] GET /compute/v2.1/servers/85a3ba9d-cc78-422b-8327-4191b2067feb => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:17:52.635329 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-84ad0bdc-6849-44cf-8b12-eb1b6436b493 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3b24e580-ac76-4204-be44-2508c5756789"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:17:52.638403 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-84ad0bdc-6849-44cf-8b12-eb1b6436b493 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: 77e88235-e334-40dc-bd38-680e467ac4e2] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:17:52.647129 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-84ad0bdc-6849-44cf-8b12-eb1b6436b493 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:52.647885 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-84ad0bdc-6849-44cf-8b12-eb1b6436b493 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:52.648513 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-84ad0bdc-6849-44cf-8b12-eb1b6436b493 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:52.649429 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-84ad0bdc-6849-44cf-8b12-eb1b6436b493 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:52.650205 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-84ad0bdc-6849-44cf-8b12-eb1b6436b493 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:52.650795 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-84ad0bdc-6849-44cf-8b12-eb1b6436b493 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:53.110407 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:17:53.132658 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-84ad0bdc-6849-44cf-8b12-eb1b6436b493 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "POST /compute/v2.1/servers/77e88235-e334-40dc-bd38-680e467ac4e2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.505267 Sep 08 11:17:53.133230 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3118/6115] 10.222.0.27 () {60 vars in 1323 bytes} [Thu Sep 8 11:17:52 2022] POST /compute/v2.1/servers/77e88235-e334-40dc-bd38-680e467ac4e2/os-volume_attachments => generated 194 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:17:58.018742 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cf52bce1-cafe-4767-b046-8fcdf4e34ebb tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '.version_select at 0x7f68df2f7a60>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:17:58.123476 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cf52bce1-cafe-4767-b046-8fcdf4e34ebb tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1326606544" status: 202 len: 0 microversion: 2.1 time: 0.110186 Sep 08 11:17:58.124123 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3119/6116] 10.222.0.27 () {58 vars in 1284 bytes} [Thu Sep 8 11:17:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1326606544 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 11:17:58.165084 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a4524b45-de34-480e-bf52-12d675900612 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Action: 'create', calling method: .version_select at 0x7f68df23d310>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1485828680", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPrxv5MqTxWjo5SduoZUF3+M5oRzgL6JMnoBZ8o9tKZb9Jd7UU83AeJRMZgJlfC4Iqyl/Z0EYTx+u8/YHKIdiNxo0UMR0SR5bEC8zXbdRI9C+ax69IMI4u2v/Y9xZwyc0Q=="}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:17:58.189219 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-a4524b45-de34-480e-bf52-12d675900612 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Getting quotas for project a0f9071124e74802a2f76cb326ca58df. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:17:58.203329 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-63ddb2fd-c8ba-4445-a084-23a23a44e234 tempest-VolumesGetTestJSON-190741240 tempest-VolumesGetTestJSON-190741240-project] Action: 'create', calling method: .version_select at 0x7f68e8a4e160>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-110803360", "metadata": {"Type": "work"}}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:17:58.203866 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-a4524b45-de34-480e-bf52-12d675900612 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Getting quotas for user c33e91fa4e3746aa8d8d23940e17bc1e and project a0f9071124e74802a2f76cb326ca58df. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:17:58.248412 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a4524b45-de34-480e-bf52-12d675900612 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.087907 Sep 08 11:17:58.265210 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3120/6117] 10.222.0.27 () {60 vars in 1159 bytes} [Thu Sep 8 11:17:58 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:17:58.786337 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-63ddb2fd-c8ba-4445-a084-23a23a44e234 tempest-VolumesGetTestJSON-190741240 tempest-VolumesGetTestJSON-190741240-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.901418 Sep 08 11:17:58.787220 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2998/6118] 10.222.0.27 () {60 vars in 1156 bytes} [Thu Sep 8 11:17:57 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 903 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 08 11:17:58.803660 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ed05a29c-e77b-4792-9995-a1b2e8942142 tempest-VolumesGetTestJSON-190741240 tempest-VolumesGetTestJSON-190741240-project] Calling method '.version_select at 0x7f68df166b80>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:17:58.894081 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ed05a29c-e77b-4792-9995-a1b2e8942142 tempest-VolumesGetTestJSON-190741240 tempest-VolumesGetTestJSON-190741240-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/6209e8ec-af25-4250-a0af-17018a0f2446" status: 200 len: 352 microversion: 2.1 time: 0.096772 Sep 08 11:17:58.901870 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3121/6119] 10.222.0.27 () {58 vars in 1245 bytes} [Thu Sep 8 11:17:58 2022] GET /compute/v2.1/os-volumes/6209e8ec-af25-4250-a0af-17018a0f2446 => generated 352 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:17:59.915980 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-45fd1031-2e50-469a-8bd3-0c2dd3bbecc5 tempest-VolumesGetTestJSON-190741240 tempest-VolumesGetTestJSON-190741240-project] Calling method '.version_select at 0x7f68e42ffee0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:18:00.045357 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-45fd1031-2e50-469a-8bd3-0c2dd3bbecc5 tempest-VolumesGetTestJSON-190741240 tempest-VolumesGetTestJSON-190741240-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/6209e8ec-af25-4250-a0af-17018a0f2446" status: 200 len: 352 microversion: 2.1 time: 0.137891 Sep 08 11:18:00.053554 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2999/6120] 10.222.0.27 () {58 vars in 1245 bytes} [Thu Sep 8 11:17:59 2022] GET /compute/v2.1/os-volumes/6209e8ec-af25-4250-a0af-17018a0f2446 => generated 352 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:18:01.062016 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a2eb7a7f-3a66-427e-a38a-fa62c0cc8e93 tempest-VolumesGetTestJSON-190741240 tempest-VolumesGetTestJSON-190741240-project] Calling method '.version_select at 0x7f68e891f9d0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:18:01.121403 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a2eb7a7f-3a66-427e-a38a-fa62c0cc8e93 tempest-VolumesGetTestJSON-190741240 tempest-VolumesGetTestJSON-190741240-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/6209e8ec-af25-4250-a0af-17018a0f2446" status: 200 len: 353 microversion: 2.1 time: 0.064398 Sep 08 11:18:01.123223 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3122/6121] 10.222.0.27 () {58 vars in 1245 bytes} [Thu Sep 8 11:18:01 2022] GET /compute/v2.1/os-volumes/6209e8ec-af25-4250-a0af-17018a0f2446 => generated 353 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:18:01.134182 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=27,nova_api:DELETE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:18:01.135578 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=48 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:18:01.142600 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8844b3b5-2a64-44d1-896b-96d7b473a1d8 tempest-VolumesGetTestJSON-190741240 tempest-VolumesGetTestJSON-190741240-project] Calling method '.version_select at 0x7f68df6941f0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:18:01.205770 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8844b3b5-2a64-44d1-896b-96d7b473a1d8 tempest-VolumesGetTestJSON-190741240 tempest-VolumesGetTestJSON-190741240-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/6209e8ec-af25-4250-a0af-17018a0f2446" status: 200 len: 353 microversion: 2.1 time: 0.072372 Sep 08 11:18:01.206506 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3000/6122] 10.222.0.27 () {58 vars in 1245 bytes} [Thu Sep 8 11:18:01 2022] GET /compute/v2.1/os-volumes/6209e8ec-af25-4250-a0af-17018a0f2446 => generated 353 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:18:01.221002 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6dde0d79-67b6-4689-a582-65b6f770f36b tempest-VolumesGetTestJSON-190741240 tempest-VolumesGetTestJSON-190741240-project] Calling method '.version_select at 0x7f68e4a57f70>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:18:01.341213 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6dde0d79-67b6-4689-a582-65b6f770f36b tempest-VolumesGetTestJSON-190741240 tempest-VolumesGetTestJSON-190741240-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/6209e8ec-af25-4250-a0af-17018a0f2446" status: 202 len: 0 microversion: 2.1 time: 0.125039 Sep 08 11:18:01.343556 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3123/6123] 10.222.0.27 () {58 vars in 1248 bytes} [Thu Sep 8 11:18:01 2022] DELETE /compute/v2.1/os-volumes/6209e8ec-af25-4250-a0af-17018a0f2446 => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 11:18:01.351552 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f0dcbce8-b181-4121-b62d-b173a7d8d628 tempest-VolumesGetTestJSON-190741240 tempest-VolumesGetTestJSON-190741240-project] Calling method '.version_select at 0x7f68df6ced30>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:18:01.583988 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f0dcbce8-b181-4121-b62d-b173a7d8d628 tempest-VolumesGetTestJSON-190741240 tempest-VolumesGetTestJSON-190741240-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/6209e8ec-af25-4250-a0af-17018a0f2446" status: 200 len: 352 microversion: 2.1 time: 0.236403 Sep 08 11:18:01.584642 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3001/6124] 10.222.0.27 () {58 vars in 1245 bytes} [Thu Sep 8 11:18:01 2022] GET /compute/v2.1/os-volumes/6209e8ec-af25-4250-a0af-17018a0f2446 => generated 352 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:18:02.599945 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fb6c0d46-a75a-4bce-9446-41ffc79b762e tempest-VolumesGetTestJSON-190741240 tempest-VolumesGetTestJSON-190741240-project] Calling method '.version_select at 0x7f68e8962e50>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:18:02.665954 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fb6c0d46-a75a-4bce-9446-41ffc79b762e tempest-VolumesGetTestJSON-190741240 tempest-VolumesGetTestJSON-190741240-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/6209e8ec-af25-4250-a0af-17018a0f2446" status: 200 len: 352 microversion: 2.1 time: 0.070559 Sep 08 11:18:02.667840 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3124/6125] 10.222.0.27 () {58 vars in 1245 bytes} [Thu Sep 8 11:18:02 2022] GET /compute/v2.1/os-volumes/6209e8ec-af25-4250-a0af-17018a0f2446 => generated 352 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:18:03.696098 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-19ff7a8d-ed80-4bde-b2df-14c3d72e07c0 tempest-VolumesGetTestJSON-190741240 tempest-VolumesGetTestJSON-190741240-project] Calling method '.version_select at 0x7f68e41515e0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:18:03.807472 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-19ff7a8d-ed80-4bde-b2df-14c3d72e07c0 tempest-VolumesGetTestJSON-190741240 tempest-VolumesGetTestJSON-190741240-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/6209e8ec-af25-4250-a0af-17018a0f2446" status: 200 len: 352 microversion: 2.1 time: 0.116581 Sep 08 11:18:03.808442 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3002/6126] 10.222.0.27 () {58 vars in 1245 bytes} [Thu Sep 8 11:18:03 2022] GET /compute/v2.1/os-volumes/6209e8ec-af25-4250-a0af-17018a0f2446 => generated 352 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:18:04.822264 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-eb2f7b8c-d76f-47d9-a8cf-9e3be8df01a8 tempest-VolumesGetTestJSON-190741240 tempest-VolumesGetTestJSON-190741240-project] Calling method '.version_select at 0x7f68df2b9280>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:18:04.893294 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-eb2f7b8c-d76f-47d9-a8cf-9e3be8df01a8 tempest-VolumesGetTestJSON-190741240 tempest-VolumesGetTestJSON-190741240-project] HTTP exception thrown: Volume 6209e8ec-af25-4250-a0af-17018a0f2446 could not be found. Sep 08 11:18:04.899341 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-eb2f7b8c-d76f-47d9-a8cf-9e3be8df01a8 tempest-VolumesGetTestJSON-190741240 tempest-VolumesGetTestJSON-190741240-project] Request method failure captured: Sep 08 11:18:04.899341 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/os-volumes/6209e8ec-af25-4250-a0af-17018a0f2446 HTTP/1.1 Sep 08 11:18:04.899341 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:18:04.899341 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:18:04.899341 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:18:04.899341 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 11:18:04.899341 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:18:04.899341 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:18:04.899341 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:18:04.899341 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:18:04.899341 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGc9locJuFLpksG5YoWd30czs9WLfnUe7NrNS9dxbPiHnaeOhGL4bs-Wq4pfTEYk9JMR_zg__2mDNuVMRGux2Vrfd_H0UUtx8DL6TDglZ_o-ONCQ4xalpv5hxVAm88jczxYwj4IbEKuT0bL3Wnct3CggGH_ZLv32QJOh0oWig2Y2uypM Sep 08 11:18:04.899341 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:18:04.899341 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:18:04.899341 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:18:04.899341 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:18:04.899341 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:18:04.899341 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:18:04.899341 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 0e884beaf35a4d5fb9ef078094dcb84d Sep 08 11:18:04.899341 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-VolumesGetTestJSON-190741240 Sep 08 11:18:04.899341 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:18:04.899341 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:18:04.899341 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0e884beaf35a4d5fb9ef078094dcb84d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0e884beaf35a4d5fb9ef078094dcb84d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0e884beaf35a4d5fb9ef078094dcb84d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0e884beaf35a4d5fb9ef078094dcb84d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:18:04.899341 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-VolumesGetTestJSON-190741240 Sep 08 11:18:04.899341 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 0e884beaf35a4d5fb9ef078094dcb84d Sep 08 11:18:04.899341 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-VolumesGetTestJSON-190741240 Sep 08 11:18:04.899341 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-VolumesGetTestJSON-190741240-project Sep 08 11:18:04.899341 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:18:04.899341 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:18:04.899341 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 19f1ce320ce941be8d5577c658341c9e Sep 08 11:18:04.899341 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-VolumesGetTestJSON-190741240-project Sep 08 11:18:04.899341 n-d-850501-12 devstack@n-api.service[128861]: method: Sep 08 11:18:04.899341 n-d-850501-12 devstack@n-api.service[128861]: exception: Volume 6209e8ec-af25-4250-a0af-17018a0f2446 could not be found. Sep 08 11:18:04.899341 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '6209e8ec-af25-4250-a0af-17018a0f2446'} Sep 08 11:18:04.899341 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:18:04.899341 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:18:04.899341 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 11:18:04.899341 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 11:18:04.899341 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 11:18:04.899341 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 11:18:04.899341 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 11:18:04.899341 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 11:18:04.899341 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 11:18:04.899341 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 11:18:04.899341 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 11:18:04.899341 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 11:18:04.899341 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 11:18:04.899341 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 11:18:04.899341 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 11:18:04.899341 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 11:18:04.899341 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6209e8ec-af25-4250-a0af-17018a0f2446 could not be found. (HTTP 404) (Request-ID: req-1996f82d-f5a5-475f-8939-6eec4ad7f319) Sep 08 11:18:04.899341 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:18:04.899341 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:18:04.899341 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:18:04.899341 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:18:04.899341 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 08 11:18:04.899341 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 08 11:18:04.899341 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 08 11:18:04.899341 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 08 11:18:04.899341 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 08 11:18:04.899341 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 08 11:18:04.899341 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 08 11:18:04.899341 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 08 11:18:04.899341 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 11:18:04.903584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 11:18:04.903584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 11:18:04.903584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 11:18:04.903584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 11:18:04.903584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 11:18:04.903584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 11:18:04.903584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 11:18:04.903584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 11:18:04.903584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 11:18:04.903584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 11:18:04.903584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 11:18:04.903584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 11:18:04.903584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 11:18:04.903584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6209e8ec-af25-4250-a0af-17018a0f2446 could not be found. Sep 08 11:18:04.903584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:18:04.903584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:18:04.903584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:18:04.903584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:18:04.903584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:18:04.903584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:18:04.903584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:18:04.903584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:18:04.903584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 11:18:04.903584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 11:18:04.903584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:18:04.903584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:18:04.903584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 08 11:18:04.903584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:18:04.903584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6209e8ec-af25-4250-a0af-17018a0f2446 could not be found. Sep 08 11:18:04.903584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:18:04.903584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:18:04.903584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:18:04.903584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:18:04.903584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:18:04.903584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:18:04.903584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:18:04.903584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:18:04.903584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6209e8ec-af25-4250-a0af-17018a0f2446 could not be found. Sep 08 11:18:04.903584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:18:04.908960 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-eb2f7b8c-d76f-47d9-a8cf-9e3be8df01a8 tempest-VolumesGetTestJSON-190741240 tempest-VolumesGetTestJSON-190741240-project] Returning 404 to user: Volume 6209e8ec-af25-4250-a0af-17018a0f2446 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:18:04.910705 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-eb2f7b8c-d76f-47d9-a8cf-9e3be8df01a8 tempest-VolumesGetTestJSON-190741240 tempest-VolumesGetTestJSON-190741240-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/6209e8ec-af25-4250-a0af-17018a0f2446" status: 404 len: 109 microversion: 2.1 time: 0.092340 Sep 08 11:18:04.914934 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3125/6127] 10.222.0.27 () {58 vars in 1245 bytes} [Thu Sep 8 11:18:04 2022] GET /compute/v2.1/os-volumes/6209e8ec-af25-4250-a0af-17018a0f2446 => generated 109 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:18:07.820480 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a54415bb-29da-4c51-bb70-3bbc575783fa tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-62917001", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "2c803091-b871-41ec-967b-5ecc2c5874f2"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1485828680", "security_groups": [{"name": "tempest-secgroup-smoke-1077771082"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:18:07.995250 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-a54415bb-29da-4c51-bb70-3bbc575783fa tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] validate_networks() for [('2c803091-b871-41ec-967b-5ecc2c5874f2', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:18:08.352926 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=4 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:18:08.353736 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:18:08.768228 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-89db73c4-bb41-4c5b-acd3-f87e68acb121 tempest-VolumesNegativeTest-426093069 tempest-VolumesNegativeTest-426093069-project] Action: 'create', calling method: .version_select at 0x7f68e44fbdc0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-180006965", "metadata": {"Type": "work"}}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:18:08.773499 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-89db73c4-bb41-4c5b-acd3-f87e68acb121 tempest-VolumesNegativeTest-426093069 tempest-VolumesNegativeTest-426093069-project] Request method failure captured: Sep 08 11:18:08.773499 n-d-850501-12 devstack@n-api.service[128861]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 08 11:18:08.773499 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:18:08.773499 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:18:08.773499 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:18:08.773499 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 121 Sep 08 11:18:08.773499 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:18:08.773499 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:18:08.773499 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:18:08.773499 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:18:08.773499 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGc9wgD8pDJVD5LU6FU8z7r2S4A6PWvDbtyWiLxphMeTbAxo4Xsu7mpLd-jt19hvZww7HEGpsU4zVBh15dnEwdvyE0vjFvE5z0d4yBmNv5x8i5dh5EOC8uQB8yH6PkKq6b-_9NZrN3r-EsAHDHnSN3CUHpvRfAg5ciVhtbqc6X2Ac0Q0 Sep 08 11:18:08.773499 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:18:08.773499 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:18:08.773499 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:18:08.773499 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:18:08.773499 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:18:08.773499 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:18:08.773499 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: c32dde917168478b8018f24cf456985b Sep 08 11:18:08.773499 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-VolumesNegativeTest-426093069 Sep 08 11:18:08.773499 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:18:08.773499 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:18:08.773499 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c32dde917168478b8018f24cf456985b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c32dde917168478b8018f24cf456985b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c32dde917168478b8018f24cf456985b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c32dde917168478b8018f24cf456985b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:18:08.773499 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-VolumesNegativeTest-426093069 Sep 08 11:18:08.773499 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: c32dde917168478b8018f24cf456985b Sep 08 11:18:08.773499 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-VolumesNegativeTest-426093069 Sep 08 11:18:08.773499 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-VolumesNegativeTest-426093069-project Sep 08 11:18:08.773499 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:18:08.773499 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:18:08.773499 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 4b1e7206bbf74b19ba3c7eac6f9c8f52 Sep 08 11:18:08.773499 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-VolumesNegativeTest-426093069-project Sep 08 11:18:08.773499 n-d-850501-12 devstack@n-api.service[128861]: Sep 08 11:18:08.773499 n-d-850501-12 devstack@n-api.service[128861]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-180006965", "metadata": {"Type": "work"}}} Sep 08 11:18:08.773499 n-d-850501-12 devstack@n-api.service[128861]: method: Sep 08 11:18:08.773499 n-d-850501-12 devstack@n-api.service[128861]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 08 11:18:08.773499 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-180006965', 'metadata': {'Type': 'work'}}}} Sep 08 11:18:08.773499 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:18:08.773499 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:18:08.773499 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 11:18:08.773499 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 11:18:08.773499 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 11:18:08.773499 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise error Sep 08 11:18:08.773499 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 08 11:18:08.773499 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:18:08.773499 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 08 11:18:08.773499 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 08 11:18:08.773499 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:18:08.773499 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 08 11:18:08.773499 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi '#$%' Sep 08 11:18:08.773499 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:18:08.773499 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:18:08.773499 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:18:08.773499 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:18:08.773499 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:18:08.773499 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:18:08.773499 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:18:08.773499 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:18:08.773499 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 11:18:08.773499 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 11:18:08.773499 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:18:08.773499 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:18:08.773499 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 11:18:08.773499 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 11:18:08.773499 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 11:18:08.773499 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 11:18:08.773499 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 11:18:08.773499 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 11:18:08.779397 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 08 11:18:08.779397 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:18:08.779397 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:18:08.779397 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:18:08.779397 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:18:08.779397 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:18:08.779397 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:18:08.779397 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 11:18:08.779397 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 11:18:08.779397 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 08 11:18:08.779397 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:18:08.792391 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-89db73c4-bb41-4c5b-acd3-f87e68acb121 tempest-VolumesNegativeTest-426093069 tempest-VolumesNegativeTest-426093069-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:18:08.796664 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-89db73c4-bb41-4c5b-acd3-f87e68acb121 tempest-VolumesNegativeTest-426093069 tempest-VolumesNegativeTest-426093069-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.445148 Sep 08 11:18:08.802248 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3126/6128] 10.222.0.27 () {60 vars in 1156 bytes} [Thu Sep 8 11:18:08 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 451 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 08 11:18:08.808491 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ef386808-9f4c-4ff5-b1b6-7c4dade9b353 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:18:08.829701 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ef386808-9f4c-4ff5-b1b6-7c4dade9b353 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: 77e88235-e334-40dc-bd38-680e467ac4e2] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:18:08.858489 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ef386808-9f4c-4ff5-b1b6-7c4dade9b353 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:18:08.859043 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ef386808-9f4c-4ff5-b1b6-7c4dade9b353 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:18:08.859497 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ef386808-9f4c-4ff5-b1b6-7c4dade9b353 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:18:08.860241 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ef386808-9f4c-4ff5-b1b6-7c4dade9b353 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:18:08.860708 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ef386808-9f4c-4ff5-b1b6-7c4dade9b353 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:18:08.884866 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ef386808-9f4c-4ff5-b1b6-7c4dade9b353 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:18:08.989127 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ef386808-9f4c-4ff5-b1b6-7c4dade9b353 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "GET /compute/v2.1/servers/77e88235-e334-40dc-bd38-680e467ac4e2/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.185395 Sep 08 11:18:08.989982 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3127/6129] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 11:18:08 2022] GET /compute/v2.1/servers/77e88235-e334-40dc-bd38-680e467ac4e2/os-volume_attachments => generated 371 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:18:08.995106 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c5c2db07-d1fd-4ea7-9770-98f5a53260ec tempest-VolumesNegativeTest-426093069 tempest-VolumesNegativeTest-426093069-project] Action: 'create', calling method: .version_select at 0x7f68df2f7f70>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1527418979", "metadata": {"Type": "work"}}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:18:09.010760 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c5c2db07-d1fd-4ea7-9770-98f5a53260ec tempest-VolumesNegativeTest-426093069 tempest-VolumesNegativeTest-426093069-project] Request method failure captured: Sep 08 11:18:09.010760 n-d-850501-12 devstack@n-api.service[128861]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 08 11:18:09.010760 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:18:09.010760 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:18:09.010760 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:18:09.010760 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 120 Sep 08 11:18:09.010760 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:18:09.010760 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:18:09.010760 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:18:09.010760 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:18:09.010760 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGc9wgD8pDJVD5LU6FU8z7r2S4A6PWvDbtyWiLxphMeTbAxo4Xsu7mpLd-jt19hvZww7HEGpsU4zVBh15dnEwdvyE0vjFvE5z0d4yBmNv5x8i5dh5EOC8uQB8yH6PkKq6b-_9NZrN3r-EsAHDHnSN3CUHpvRfAg5ciVhtbqc6X2Ac0Q0 Sep 08 11:18:09.010760 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:18:09.010760 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:18:09.010760 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:18:09.010760 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:18:09.010760 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:18:09.010760 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:18:09.010760 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: c32dde917168478b8018f24cf456985b Sep 08 11:18:09.010760 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-VolumesNegativeTest-426093069 Sep 08 11:18:09.010760 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:18:09.010760 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:18:09.010760 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c32dde917168478b8018f24cf456985b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c32dde917168478b8018f24cf456985b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c32dde917168478b8018f24cf456985b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c32dde917168478b8018f24cf456985b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:18:09.010760 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-VolumesNegativeTest-426093069 Sep 08 11:18:09.010760 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: c32dde917168478b8018f24cf456985b Sep 08 11:18:09.010760 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-VolumesNegativeTest-426093069 Sep 08 11:18:09.010760 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-VolumesNegativeTest-426093069-project Sep 08 11:18:09.010760 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:18:09.010760 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:18:09.010760 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 4b1e7206bbf74b19ba3c7eac6f9c8f52 Sep 08 11:18:09.010760 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-VolumesNegativeTest-426093069-project Sep 08 11:18:09.010760 n-d-850501-12 devstack@n-api.service[128861]: Sep 08 11:18:09.010760 n-d-850501-12 devstack@n-api.service[128861]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1527418979", "metadata": {"Type": "work"}}} Sep 08 11:18:09.010760 n-d-850501-12 devstack@n-api.service[128861]: method: Sep 08 11:18:09.010760 n-d-850501-12 devstack@n-api.service[128861]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 08 11:18:09.010760 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1527418979', 'metadata': {'Type': 'work'}}}} Sep 08 11:18:09.010760 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:18:09.010760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:18:09.010760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 11:18:09.010760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 11:18:09.010760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 11:18:09.010760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise error Sep 08 11:18:09.010760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 08 11:18:09.010760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:18:09.010760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 08 11:18:09.010760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 08 11:18:09.010760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:18:09.010760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 08 11:18:09.010760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi '0' Sep 08 11:18:09.010760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:18:09.010760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:18:09.010760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:18:09.010760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:18:09.010760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:18:09.010760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:18:09.010760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:18:09.010760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:18:09.010760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 11:18:09.010760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 11:18:09.010760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:18:09.010760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:18:09.010760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 11:18:09.010760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 11:18:09.010760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 11:18:09.010760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 11:18:09.010760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 11:18:09.010760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 11:18:09.015729 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 08 11:18:09.015729 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:18:09.015729 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:18:09.015729 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:18:09.015729 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:18:09.015729 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:18:09.015729 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:18:09.015729 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 11:18:09.015729 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 11:18:09.015729 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 08 11:18:09.015729 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:18:09.015729 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c5c2db07-d1fd-4ea7-9770-98f5a53260ec tempest-VolumesNegativeTest-426093069 tempest-VolumesNegativeTest-426093069-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:18:09.015729 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c5c2db07-d1fd-4ea7-9770-98f5a53260ec tempest-VolumesNegativeTest-426093069 tempest-VolumesNegativeTest-426093069-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.021908 Sep 08 11:18:09.017228 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3128/6130] 10.222.0.27 () {60 vars in 1156 bytes} [Thu Sep 8 11:18:08 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 11:18:09.030630 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b5984082-8c66-4f47-a4db-f5aa4431b512 tempest-VolumesNegativeTest-426093069 tempest-VolumesNegativeTest-426093069-project] Action: 'create', calling method: .version_select at 0x7f68df197310>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2010988123", "metadata": {"Type": "work"}}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:18:09.036866 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b5984082-8c66-4f47-a4db-f5aa4431b512 tempest-VolumesNegativeTest-426093069 tempest-VolumesNegativeTest-426093069-project] Request method failure captured: Sep 08 11:18:09.036866 n-d-850501-12 devstack@n-api.service[128861]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 08 11:18:09.036866 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:18:09.036866 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:18:09.036866 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:18:09.036866 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 119 Sep 08 11:18:09.036866 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:18:09.036866 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:18:09.036866 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:18:09.036866 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:18:09.036866 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGc9wgD8pDJVD5LU6FU8z7r2S4A6PWvDbtyWiLxphMeTbAxo4Xsu7mpLd-jt19hvZww7HEGpsU4zVBh15dnEwdvyE0vjFvE5z0d4yBmNv5x8i5dh5EOC8uQB8yH6PkKq6b-_9NZrN3r-EsAHDHnSN3CUHpvRfAg5ciVhtbqc6X2Ac0Q0 Sep 08 11:18:09.036866 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:18:09.036866 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:18:09.036866 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:18:09.036866 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:18:09.036866 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:18:09.036866 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:18:09.036866 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: c32dde917168478b8018f24cf456985b Sep 08 11:18:09.036866 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-VolumesNegativeTest-426093069 Sep 08 11:18:09.036866 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:18:09.036866 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:18:09.036866 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c32dde917168478b8018f24cf456985b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c32dde917168478b8018f24cf456985b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c32dde917168478b8018f24cf456985b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c32dde917168478b8018f24cf456985b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:18:09.036866 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-VolumesNegativeTest-426093069 Sep 08 11:18:09.036866 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: c32dde917168478b8018f24cf456985b Sep 08 11:18:09.036866 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-VolumesNegativeTest-426093069 Sep 08 11:18:09.036866 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-VolumesNegativeTest-426093069-project Sep 08 11:18:09.036866 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:18:09.036866 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:18:09.036866 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 4b1e7206bbf74b19ba3c7eac6f9c8f52 Sep 08 11:18:09.036866 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-VolumesNegativeTest-426093069-project Sep 08 11:18:09.036866 n-d-850501-12 devstack@n-api.service[128861]: Sep 08 11:18:09.036866 n-d-850501-12 devstack@n-api.service[128861]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2010988123", "metadata": {"Type": "work"}}} Sep 08 11:18:09.036866 n-d-850501-12 devstack@n-api.service[128861]: method: Sep 08 11:18:09.036866 n-d-850501-12 devstack@n-api.service[128861]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 08 11:18:09.036866 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-2010988123', 'metadata': {'Type': 'work'}}}} Sep 08 11:18:09.036866 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:18:09.036866 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:18:09.036866 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 11:18:09.036866 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 11:18:09.036866 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 11:18:09.036866 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise error Sep 08 11:18:09.036866 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 08 11:18:09.036866 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:18:09.036866 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 08 11:18:09.036866 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 08 11:18:09.036866 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:18:09.036866 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 08 11:18:09.036866 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi '' Sep 08 11:18:09.036866 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:18:09.036866 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:18:09.036866 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:18:09.036866 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:18:09.036866 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:18:09.036866 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:18:09.036866 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:18:09.036866 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:18:09.036866 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 11:18:09.036866 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 11:18:09.036866 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:18:09.036866 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:18:09.036866 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 11:18:09.036866 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 11:18:09.036866 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 11:18:09.036866 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 11:18:09.036866 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 11:18:09.036866 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 11:18:09.041056 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 08 11:18:09.041056 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:18:09.041056 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:18:09.041056 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:18:09.041056 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:18:09.041056 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:18:09.041056 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:18:09.041056 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 11:18:09.041056 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 11:18:09.041056 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 08 11:18:09.041056 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:18:09.046429 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b5984082-8c66-4f47-a4db-f5aa4431b512 tempest-VolumesNegativeTest-426093069 tempest-VolumesNegativeTest-426093069-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:18:09.047531 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b5984082-8c66-4f47-a4db-f5aa4431b512 tempest-VolumesNegativeTest-426093069 tempest-VolumesNegativeTest-426093069-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.021244 Sep 08 11:18:09.048525 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3129/6131] 10.222.0.27 () {60 vars in 1156 bytes} [Thu Sep 8 11:18:09 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 11:18:09.065535 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c9ce86a8-84ab-4def-9297-1efd0ad6c695 tempest-VolumesNegativeTest-426093069 tempest-VolumesNegativeTest-426093069-project] Calling method '.version_select at 0x7f68df197ca0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:18:09.075422 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-a54415bb-29da-4c51-bb70-3bbc575783fa tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:18:09.075782 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-a54415bb-29da-4c51-bb70-3bbc575783fa tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:18:09.075981 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-a54415bb-29da-4c51-bb70-3bbc575783fa tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:18:09.077226 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-a54415bb-29da-4c51-bb70-3bbc575783fa tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:18:09.077809 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-a54415bb-29da-4c51-bb70-3bbc575783fa tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:18:09.089387 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a54415bb-29da-4c51-bb70-3bbc575783fa tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:18:09.091470 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a54415bb-29da-4c51-bb70-3bbc575783fa tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:18:09.092178 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a54415bb-29da-4c51-bb70-3bbc575783fa tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:18:09.093436 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a54415bb-29da-4c51-bb70-3bbc575783fa tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:18:09.094050 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a54415bb-29da-4c51-bb70-3bbc575783fa tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:18:09.094637 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a54415bb-29da-4c51-bb70-3bbc575783fa tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:18:09.118888 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-c9ce86a8-84ab-4def-9297-1efd0ad6c695 tempest-VolumesNegativeTest-426093069 tempest-VolumesNegativeTest-426093069-project] HTTP exception thrown: Volume tempest-invalid-268411659 could not be found. Sep 08 11:18:09.120933 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c9ce86a8-84ab-4def-9297-1efd0ad6c695 tempest-VolumesNegativeTest-426093069 tempest-VolumesNegativeTest-426093069-project] Request method failure captured: Sep 08 11:18:09.120933 n-d-850501-12 devstack@n-api.service[128861]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-268411659 HTTP/1.1 Sep 08 11:18:09.120933 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:18:09.120933 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:18:09.120933 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:18:09.120933 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 11:18:09.120933 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:18:09.120933 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:18:09.120933 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:18:09.120933 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:18:09.120933 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGc9wgD8pDJVD5LU6FU8z7r2S4A6PWvDbtyWiLxphMeTbAxo4Xsu7mpLd-jt19hvZww7HEGpsU4zVBh15dnEwdvyE0vjFvE5z0d4yBmNv5x8i5dh5EOC8uQB8yH6PkKq6b-_9NZrN3r-EsAHDHnSN3CUHpvRfAg5ciVhtbqc6X2Ac0Q0 Sep 08 11:18:09.120933 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:18:09.120933 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:18:09.120933 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:18:09.120933 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:18:09.120933 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:18:09.120933 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:18:09.120933 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: c32dde917168478b8018f24cf456985b Sep 08 11:18:09.120933 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-VolumesNegativeTest-426093069 Sep 08 11:18:09.120933 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:18:09.120933 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:18:09.120933 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c32dde917168478b8018f24cf456985b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c32dde917168478b8018f24cf456985b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c32dde917168478b8018f24cf456985b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c32dde917168478b8018f24cf456985b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:18:09.120933 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-VolumesNegativeTest-426093069 Sep 08 11:18:09.120933 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: c32dde917168478b8018f24cf456985b Sep 08 11:18:09.120933 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-VolumesNegativeTest-426093069 Sep 08 11:18:09.120933 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-VolumesNegativeTest-426093069-project Sep 08 11:18:09.120933 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:18:09.120933 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:18:09.120933 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 4b1e7206bbf74b19ba3c7eac6f9c8f52 Sep 08 11:18:09.120933 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-VolumesNegativeTest-426093069-project Sep 08 11:18:09.120933 n-d-850501-12 devstack@n-api.service[128861]: method: Sep 08 11:18:09.120933 n-d-850501-12 devstack@n-api.service[128861]: exception: Volume tempest-invalid-268411659 could not be found. Sep 08 11:18:09.120933 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': 'tempest-invalid-268411659'} Sep 08 11:18:09.120933 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:18:09.120933 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:18:09.120933 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 11:18:09.120933 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 11:18:09.120933 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 08 11:18:09.120933 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 08 11:18:09.120933 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 08 11:18:09.120933 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 08 11:18:09.120933 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 08 11:18:09.120933 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 08 11:18:09.120933 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 08 11:18:09.120933 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 08 11:18:09.120933 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 11:18:09.120933 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 11:18:09.120933 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 11:18:09.120933 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 11:18:09.120933 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-268411659 could not be found. (HTTP 404) (Request-ID: req-93405bd3-1b9b-4dd0-88de-3505ce81d9cc) Sep 08 11:18:09.120933 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:18:09.120933 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:18:09.120933 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:18:09.120933 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:18:09.120933 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 08 11:18:09.120933 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 08 11:18:09.120933 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 08 11:18:09.120933 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 08 11:18:09.120933 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 08 11:18:09.120933 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 08 11:18:09.120933 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 08 11:18:09.120933 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 08 11:18:09.120933 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 11:18:09.120933 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 11:18:09.127789 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 08 11:18:09.127789 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 08 11:18:09.127789 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 08 11:18:09.127789 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 08 11:18:09.127789 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 08 11:18:09.127789 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 08 11:18:09.127789 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 08 11:18:09.127789 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 08 11:18:09.127789 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 11:18:09.127789 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 11:18:09.127789 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 11:18:09.127789 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 11:18:09.127789 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-268411659 could not be found. Sep 08 11:18:09.127789 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:18:09.127789 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:18:09.127789 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:18:09.127789 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:18:09.127789 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:18:09.127789 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:18:09.127789 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:18:09.127789 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:18:09.127789 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 11:18:09.127789 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 11:18:09.127789 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:18:09.127789 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:18:09.127789 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 08 11:18:09.127789 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:18:09.127789 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-268411659 could not be found. Sep 08 11:18:09.127789 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:18:09.127789 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:18:09.127789 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:18:09.127789 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:18:09.127789 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:18:09.127789 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:18:09.127789 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:18:09.127789 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:18:09.127789 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-268411659 could not be found. Sep 08 11:18:09.127789 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:18:09.127789 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c9ce86a8-84ab-4def-9297-1efd0ad6c695 tempest-VolumesNegativeTest-426093069 tempest-VolumesNegativeTest-426093069-project] Returning 404 to user: Volume tempest-invalid-268411659 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:18:09.127789 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c9ce86a8-84ab-4def-9297-1efd0ad6c695 tempest-VolumesNegativeTest-426093069 tempest-VolumesNegativeTest-426093069-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/tempest-invalid-268411659" status: 404 len: 98 microversion: 2.1 time: 0.068186 Sep 08 11:18:09.127789 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3130/6132] 10.222.0.27 () {58 vars in 1215 bytes} [Thu Sep 8 11:18:09 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-268411659 => generated 98 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 08 11:18:09.143694 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-a54415bb-29da-4c51-bb70-3bbc575783fa tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Getting quotas for project a0f9071124e74802a2f76cb326ca58df. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:18:09.154603 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2758eba0-8097-4232-a4b3-d22459337215 tempest-VolumesNegativeTest-426093069 tempest-VolumesNegativeTest-426093069-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.025455 Sep 08 11:18:09.155698 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-a54415bb-29da-4c51-bb70-3bbc575783fa tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Getting quotas for user c33e91fa4e3746aa8d8d23940e17bc1e and project a0f9071124e74802a2f76cb326ca58df. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:18:09.155869 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3131/6133] 10.222.0.27 () {58 vars in 1140 bytes} [Thu Sep 8 11:18:09 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 28 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 08 11:18:09.165311 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6572850a-7c6a-4d60-8745-9ef209857134 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:18:09.165810 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6572850a-7c6a-4d60-8745-9ef209857134 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: 77e88235-e334-40dc-bd38-680e467ac4e2] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:18:09.173786 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a54415bb-29da-4c51-bb70-3bbc575783fa tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:18:09.176693 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a54415bb-29da-4c51-bb70-3bbc575783fa tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: b1cceddd-7c8d-4b5a-9814-7eee4f028c2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:18:09.182156 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6572850a-7c6a-4d60-8745-9ef209857134 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:18:09.182659 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6572850a-7c6a-4d60-8745-9ef209857134 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:18:09.183118 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6572850a-7c6a-4d60-8745-9ef209857134 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:18:09.183836 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6572850a-7c6a-4d60-8745-9ef209857134 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:18:09.184295 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6572850a-7c6a-4d60-8745-9ef209857134 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:18:09.184725 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6572850a-7c6a-4d60-8745-9ef209857134 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:18:09.254051 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6572850a-7c6a-4d60-8745-9ef209857134 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "GET /compute/v2.1/servers/77e88235-e334-40dc-bd38-680e467ac4e2/os-volume_attachments/1ff11e91-21cd-4a2d-9bca-268f27762de0" status: 200 len: 194 microversion: 2.1 time: 0.092684 Sep 08 11:18:09.254788 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3132/6134] 10.222.0.27 () {58 vars in 1413 bytes} [Thu Sep 8 11:18:09 2022] GET /compute/v2.1/servers/77e88235-e334-40dc-bd38-680e467ac4e2/os-volume_attachments/1ff11e91-21cd-4a2d-9bca-268f27762de0 => generated 194 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:18:09.259728 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bc7fda55-f850-4f66-883b-11ba31477212 tempest-VolumesNegativeTest-426093069 tempest-VolumesNegativeTest-426093069-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003950 Sep 08 11:18:09.265865 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3133/6135] 10.222.0.27 () {58 vars in 1137 bytes} [Thu Sep 8 11:18:09 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 08 11:18:09.271313 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-68ed5565-9bf1-451f-9ff0-7209e9b379dc tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:18:09.272077 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-68ed5565-9bf1-451f-9ff0-7209e9b379dc tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: 77e88235-e334-40dc-bd38-680e467ac4e2] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:18:09.278646 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-68ed5565-9bf1-451f-9ff0-7209e9b379dc tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:18:09.280060 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-68ed5565-9bf1-451f-9ff0-7209e9b379dc tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:18:09.280933 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-68ed5565-9bf1-451f-9ff0-7209e9b379dc tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:18:09.281945 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-68ed5565-9bf1-451f-9ff0-7209e9b379dc tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:18:09.282576 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-68ed5565-9bf1-451f-9ff0-7209e9b379dc tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:18:09.283162 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-68ed5565-9bf1-451f-9ff0-7209e9b379dc tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:18:09.372218 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a54415bb-29da-4c51-bb70-3bbc575783fa tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.558174 Sep 08 11:18:09.372872 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3003/6136] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 11:18:07 2022] POST /compute/v2.1/servers => generated 406 bytes in 1560 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:18:09.384771 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7bc53828-b285-45f9-9112-9f4cd4c637ca tempest-VolumesNegativeTest-426093069 tempest-VolumesNegativeTest-426093069-project] Calling method '.version_select at 0x7f68e892c040>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:18:09.444713 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-7bc53828-b285-45f9-9112-9f4cd4c637ca tempest-VolumesNegativeTest-426093069 tempest-VolumesNegativeTest-426093069-project] HTTP exception thrown: Volume d15e40c8-48a1-4b1f-b2d3-bd8ac2928a4f could not be found. Sep 08 11:18:09.465721 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-68ed5565-9bf1-451f-9ff0-7209e9b379dc tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lazy-loading 'services' on Instance uuid 77e88235-e334-40dc-bd38-680e467ac4e2 {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:18:09.483008 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7bc53828-b285-45f9-9112-9f4cd4c637ca tempest-VolumesNegativeTest-426093069 tempest-VolumesNegativeTest-426093069-project] Request method failure captured: Sep 08 11:18:09.483008 n-d-850501-12 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/os-volumes/d15e40c8-48a1-4b1f-b2d3-bd8ac2928a4f HTTP/1.1 Sep 08 11:18:09.483008 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 11:18:09.483008 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 11:18:09.483008 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 11:18:09.483008 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 11:18:09.483008 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 11:18:09.483008 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 11:18:09.483008 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 11:18:09.483008 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 11:18:09.483008 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGc9wgD8pDJVD5LU6FU8z7r2S4A6PWvDbtyWiLxphMeTbAxo4Xsu7mpLd-jt19hvZww7HEGpsU4zVBh15dnEwdvyE0vjFvE5z0d4yBmNv5x8i5dh5EOC8uQB8yH6PkKq6b-_9NZrN3r-EsAHDHnSN3CUHpvRfAg5ciVhtbqc6X2Ac0Q0 Sep 08 11:18:09.483008 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 11:18:09.483008 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 11:18:09.483008 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 11:18:09.483008 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 11:18:09.483008 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 11:18:09.483008 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 11:18:09.483008 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: c32dde917168478b8018f24cf456985b Sep 08 11:18:09.483008 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-VolumesNegativeTest-426093069 Sep 08 11:18:09.483008 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 11:18:09.483008 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 11:18:09.483008 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c32dde917168478b8018f24cf456985b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c32dde917168478b8018f24cf456985b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c32dde917168478b8018f24cf456985b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c32dde917168478b8018f24cf456985b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:18:09.483008 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-VolumesNegativeTest-426093069 Sep 08 11:18:09.483008 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: c32dde917168478b8018f24cf456985b Sep 08 11:18:09.483008 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-VolumesNegativeTest-426093069 Sep 08 11:18:09.483008 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-VolumesNegativeTest-426093069-project Sep 08 11:18:09.483008 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 11:18:09.483008 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 11:18:09.483008 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 4b1e7206bbf74b19ba3c7eac6f9c8f52 Sep 08 11:18:09.483008 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-VolumesNegativeTest-426093069-project Sep 08 11:18:09.483008 n-d-850501-12 devstack@n-api.service[128862]: method: Sep 08 11:18:09.483008 n-d-850501-12 devstack@n-api.service[128862]: exception: Volume d15e40c8-48a1-4b1f-b2d3-bd8ac2928a4f could not be found. Sep 08 11:18:09.483008 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'd15e40c8-48a1-4b1f-b2d3-bd8ac2928a4f'} Sep 08 11:18:09.483008 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:18:09.483008 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:18:09.483008 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 11:18:09.483008 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 11:18:09.483008 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 08 11:18:09.483008 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 08 11:18:09.483008 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 08 11:18:09.483008 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 08 11:18:09.483008 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 08 11:18:09.483008 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 08 11:18:09.483008 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 08 11:18:09.483008 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 08 11:18:09.483008 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 11:18:09.483008 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 11:18:09.483008 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 11:18:09.483008 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 11:18:09.483008 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d15e40c8-48a1-4b1f-b2d3-bd8ac2928a4f could not be found. (HTTP 404) (Request-ID: req-72186f67-1db3-4d3e-afda-1f79360fc254) Sep 08 11:18:09.483008 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:18:09.483008 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:18:09.483008 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:18:09.483008 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:18:09.483008 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 08 11:18:09.483008 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 08 11:18:09.483008 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 08 11:18:09.483008 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 08 11:18:09.483008 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 08 11:18:09.483008 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 08 11:18:09.483008 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 08 11:18:09.483008 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 08 11:18:09.483008 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 11:18:09.494215 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 11:18:09.494215 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 08 11:18:09.494215 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 08 11:18:09.494215 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 08 11:18:09.494215 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 08 11:18:09.494215 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 08 11:18:09.494215 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 08 11:18:09.494215 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 08 11:18:09.494215 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 08 11:18:09.494215 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 11:18:09.494215 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 11:18:09.494215 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 11:18:09.494215 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 11:18:09.494215 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d15e40c8-48a1-4b1f-b2d3-bd8ac2928a4f could not be found. Sep 08 11:18:09.494215 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:18:09.494215 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:18:09.494215 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:18:09.494215 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:18:09.494215 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:18:09.494215 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:18:09.494215 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:18:09.494215 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:18:09.494215 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 11:18:09.494215 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 11:18:09.494215 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:18:09.494215 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:18:09.494215 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 08 11:18:09.494215 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:18:09.494215 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d15e40c8-48a1-4b1f-b2d3-bd8ac2928a4f could not be found. Sep 08 11:18:09.494215 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:18:09.494215 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:18:09.494215 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:18:09.494215 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:18:09.494215 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:18:09.494215 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:18:09.494215 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:18:09.494215 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:18:09.494215 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d15e40c8-48a1-4b1f-b2d3-bd8ac2928a4f could not be found. Sep 08 11:18:09.494215 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:18:09.494215 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7bc53828-b285-45f9-9112-9f4cd4c637ca tempest-VolumesNegativeTest-426093069 tempest-VolumesNegativeTest-426093069-project] Returning 404 to user: Volume d15e40c8-48a1-4b1f-b2d3-bd8ac2928a4f could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:18:09.494215 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7bc53828-b285-45f9-9112-9f4cd4c637ca tempest-VolumesNegativeTest-426093069 tempest-VolumesNegativeTest-426093069-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/d15e40c8-48a1-4b1f-b2d3-bd8ac2928a4f" status: 404 len: 109 microversion: 2.1 time: 0.103802 Sep 08 11:18:09.494215 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3004/6137] 10.222.0.27 () {58 vars in 1248 bytes} [Thu Sep 8 11:18:09 2022] DELETE /compute/v2.1/os-volumes/d15e40c8-48a1-4b1f-b2d3-bd8ac2928a4f => generated 109 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:18:09.494215 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e08b4ac1-8433-404c-8e7f-5397e55b625a tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:18:09.494215 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e08b4ac1-8433-404c-8e7f-5397e55b625a tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: b1cceddd-7c8d-4b5a-9814-7eee4f028c2e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:18:09.611307 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-68ed5565-9bf1-451f-9ff0-7209e9b379dc tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "DELETE /compute/v2.1/servers/77e88235-e334-40dc-bd38-680e467ac4e2/os-volume_attachments/1ff11e91-21cd-4a2d-9bca-268f27762de0" status: 202 len: 0 microversion: 2.1 time: 0.343794 Sep 08 11:18:09.612942 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3134/6138] 10.222.0.27 () {58 vars in 1416 bytes} [Thu Sep 8 11:18:09 2022] DELETE /compute/v2.1/servers/77e88235-e334-40dc-bd38-680e467ac4e2/os-volume_attachments/1ff11e91-21cd-4a2d-9bca-268f27762de0 => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:18:09.632834 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e08b4ac1-8433-404c-8e7f-5397e55b625a tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:18:09.646294 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e08b4ac1-8433-404c-8e7f-5397e55b625a tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/b1cceddd-7c8d-4b5a-9814-7eee4f028c2e" status: 200 len: 1265 microversion: 2.1 time: 0.159972 Sep 08 11:18:09.648098 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3005/6139] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:18:09 2022] GET /compute/v2.1/servers/b1cceddd-7c8d-4b5a-9814-7eee4f028c2e => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:18:09.668708 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fb01c948-6b16-48e5-85f7-0e1149cc70cc tempest-VolumesNegativeTest-426093069 tempest-VolumesNegativeTest-426093069-project] Calling method '.version_select at 0x7f68df197b80>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:18:09.719233 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-fb01c948-6b16-48e5-85f7-0e1149cc70cc tempest-VolumesNegativeTest-426093069 tempest-VolumesNegativeTest-426093069-project] HTTP exception thrown: Volume 053f0891-f3d3-44d6-a200-dd58ecef5a74 could not be found. Sep 08 11:18:09.721675 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fb01c948-6b16-48e5-85f7-0e1149cc70cc tempest-VolumesNegativeTest-426093069 tempest-VolumesNegativeTest-426093069-project] Request method failure captured: Sep 08 11:18:09.721675 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/os-volumes/053f0891-f3d3-44d6-a200-dd58ecef5a74 HTTP/1.1 Sep 08 11:18:09.721675 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:18:09.721675 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:18:09.721675 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:18:09.721675 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 11:18:09.721675 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:18:09.721675 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:18:09.721675 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:18:09.721675 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:18:09.721675 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGc9wgD8pDJVD5LU6FU8z7r2S4A6PWvDbtyWiLxphMeTbAxo4Xsu7mpLd-jt19hvZww7HEGpsU4zVBh15dnEwdvyE0vjFvE5z0d4yBmNv5x8i5dh5EOC8uQB8yH6PkKq6b-_9NZrN3r-EsAHDHnSN3CUHpvRfAg5ciVhtbqc6X2Ac0Q0 Sep 08 11:18:09.721675 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:18:09.721675 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:18:09.721675 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:18:09.721675 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:18:09.721675 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:18:09.721675 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:18:09.721675 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: c32dde917168478b8018f24cf456985b Sep 08 11:18:09.721675 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-VolumesNegativeTest-426093069 Sep 08 11:18:09.721675 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:18:09.721675 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:18:09.721675 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c32dde917168478b8018f24cf456985b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c32dde917168478b8018f24cf456985b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c32dde917168478b8018f24cf456985b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c32dde917168478b8018f24cf456985b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:18:09.721675 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-VolumesNegativeTest-426093069 Sep 08 11:18:09.721675 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: c32dde917168478b8018f24cf456985b Sep 08 11:18:09.721675 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-VolumesNegativeTest-426093069 Sep 08 11:18:09.721675 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-VolumesNegativeTest-426093069-project Sep 08 11:18:09.721675 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:18:09.721675 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:18:09.721675 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 4b1e7206bbf74b19ba3c7eac6f9c8f52 Sep 08 11:18:09.721675 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-VolumesNegativeTest-426093069-project Sep 08 11:18:09.721675 n-d-850501-12 devstack@n-api.service[128861]: method: Sep 08 11:18:09.721675 n-d-850501-12 devstack@n-api.service[128861]: exception: Volume 053f0891-f3d3-44d6-a200-dd58ecef5a74 could not be found. Sep 08 11:18:09.721675 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '053f0891-f3d3-44d6-a200-dd58ecef5a74'} Sep 08 11:18:09.721675 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:18:09.721675 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:18:09.721675 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 11:18:09.721675 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 11:18:09.721675 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 11:18:09.721675 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 11:18:09.721675 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 11:18:09.721675 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 11:18:09.721675 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 11:18:09.721675 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 11:18:09.721675 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 11:18:09.721675 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 11:18:09.721675 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 11:18:09.721675 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 11:18:09.721675 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 11:18:09.721675 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 11:18:09.721675 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 053f0891-f3d3-44d6-a200-dd58ecef5a74 could not be found. (HTTP 404) (Request-ID: req-623fc88e-a40a-485c-aff7-3a34cd47c4f4) Sep 08 11:18:09.721675 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:18:09.721675 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:18:09.721675 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:18:09.721675 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:18:09.721675 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 08 11:18:09.721675 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 08 11:18:09.721675 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 08 11:18:09.721675 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 08 11:18:09.721675 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 08 11:18:09.721675 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 08 11:18:09.721675 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 08 11:18:09.721675 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 08 11:18:09.721675 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 11:18:09.726818 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 11:18:09.726818 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 11:18:09.726818 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 11:18:09.726818 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 11:18:09.726818 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 11:18:09.726818 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 11:18:09.726818 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 11:18:09.726818 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 11:18:09.726818 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 11:18:09.726818 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 11:18:09.726818 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 11:18:09.726818 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 11:18:09.726818 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 11:18:09.726818 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 053f0891-f3d3-44d6-a200-dd58ecef5a74 could not be found. Sep 08 11:18:09.726818 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:18:09.726818 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:18:09.726818 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:18:09.726818 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:18:09.726818 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:18:09.726818 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:18:09.726818 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:18:09.726818 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:18:09.726818 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 11:18:09.726818 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 11:18:09.726818 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:18:09.726818 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:18:09.726818 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 08 11:18:09.726818 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:18:09.726818 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 053f0891-f3d3-44d6-a200-dd58ecef5a74 could not be found. Sep 08 11:18:09.726818 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:18:09.726818 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:18:09.726818 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:18:09.726818 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:18:09.726818 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:18:09.726818 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:18:09.726818 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:18:09.726818 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:18:09.726818 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 053f0891-f3d3-44d6-a200-dd58ecef5a74 could not be found. Sep 08 11:18:09.726818 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:18:09.726818 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fb01c948-6b16-48e5-85f7-0e1149cc70cc tempest-VolumesNegativeTest-426093069 tempest-VolumesNegativeTest-426093069-project] Returning 404 to user: Volume 053f0891-f3d3-44d6-a200-dd58ecef5a74 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:18:09.726818 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fb01c948-6b16-48e5-85f7-0e1149cc70cc tempest-VolumesNegativeTest-426093069 tempest-VolumesNegativeTest-426093069-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/053f0891-f3d3-44d6-a200-dd58ecef5a74" status: 404 len: 109 microversion: 2.1 time: 0.108725 Sep 08 11:18:09.726818 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3135/6140] 10.222.0.27 () {58 vars in 1245 bytes} [Thu Sep 8 11:18:09 2022] GET /compute/v2.1/os-volumes/053f0891-f3d3-44d6-a200-dd58ecef5a74 => generated 109 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:18:10.673818 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c5748fcd-fec2-4099-96d7-0406092367b8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:18:10.674449 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c5748fcd-fec2-4099-96d7-0406092367b8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: b1cceddd-7c8d-4b5a-9814-7eee4f028c2e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:18:10.688494 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5748fcd-fec2-4099-96d7-0406092367b8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:18:10.689437 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5748fcd-fec2-4099-96d7-0406092367b8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:18:10.693054 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5748fcd-fec2-4099-96d7-0406092367b8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:18:10.694072 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5748fcd-fec2-4099-96d7-0406092367b8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:18:10.694741 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5748fcd-fec2-4099-96d7-0406092367b8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:18:10.696756 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5748fcd-fec2-4099-96d7-0406092367b8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:18:10.918803 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c5748fcd-fec2-4099-96d7-0406092367b8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:18:10.935079 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c5748fcd-fec2-4099-96d7-0406092367b8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/b1cceddd-7c8d-4b5a-9814-7eee4f028c2e" status: 200 len: 1317 microversion: 2.1 time: 0.261690 Sep 08 11:18:10.935915 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3006/6141] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:18:10 2022] GET /compute/v2.1/servers/b1cceddd-7c8d-4b5a-9814-7eee4f028c2e => generated 1317 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:18:11.978723 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3b5325a4-6d2a-484f-90cf-e02af06be1cb tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:18:11.979576 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3b5325a4-6d2a-484f-90cf-e02af06be1cb tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: b1cceddd-7c8d-4b5a-9814-7eee4f028c2e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:18:12.020847 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3b5325a4-6d2a-484f-90cf-e02af06be1cb tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:18:12.021756 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3b5325a4-6d2a-484f-90cf-e02af06be1cb tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:18:12.028807 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3b5325a4-6d2a-484f-90cf-e02af06be1cb tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:18:12.031280 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3b5325a4-6d2a-484f-90cf-e02af06be1cb tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:18:12.035876 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3b5325a4-6d2a-484f-90cf-e02af06be1cb tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:18:12.036670 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3b5325a4-6d2a-484f-90cf-e02af06be1cb tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:18:12.519171 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-3b5325a4-6d2a-484f-90cf-e02af06be1cb tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:18:12.531734 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3b5325a4-6d2a-484f-90cf-e02af06be1cb tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/b1cceddd-7c8d-4b5a-9814-7eee4f028c2e" status: 200 len: 1323 microversion: 2.1 time: 0.574784 Sep 08 11:18:12.547890 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3136/6142] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:18:11 2022] GET /compute/v2.1/servers/b1cceddd-7c8d-4b5a-9814-7eee4f028c2e => generated 1323 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:18:13.560435 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1e557f05-6904-4f56-afbf-79b573b2f1c5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:18:13.560933 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1e557f05-6904-4f56-afbf-79b573b2f1c5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: b1cceddd-7c8d-4b5a-9814-7eee4f028c2e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:18:13.584701 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e557f05-6904-4f56-afbf-79b573b2f1c5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:18:13.585245 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e557f05-6904-4f56-afbf-79b573b2f1c5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:18:13.585687 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e557f05-6904-4f56-afbf-79b573b2f1c5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:18:13.586415 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e557f05-6904-4f56-afbf-79b573b2f1c5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:18:13.586872 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e557f05-6904-4f56-afbf-79b573b2f1c5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:18:13.587300 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e557f05-6904-4f56-afbf-79b573b2f1c5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:18:13.832698 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1e557f05-6904-4f56-afbf-79b573b2f1c5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:18:13.855060 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1e557f05-6904-4f56-afbf-79b573b2f1c5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/b1cceddd-7c8d-4b5a-9814-7eee4f028c2e" status: 200 len: 1391 microversion: 2.1 time: 0.288431 Sep 08 11:18:13.862947 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3007/6143] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:18:13 2022] GET /compute/v2.1/servers/b1cceddd-7c8d-4b5a-9814-7eee4f028c2e => generated 1391 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:18:14.886695 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0c6299a8-96f9-4cae-87bc-a7837275f12b tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:18:14.887354 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0c6299a8-96f9-4cae-87bc-a7837275f12b tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: b1cceddd-7c8d-4b5a-9814-7eee4f028c2e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:18:14.901114 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0c6299a8-96f9-4cae-87bc-a7837275f12b tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:18:14.901613 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0c6299a8-96f9-4cae-87bc-a7837275f12b tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:18:14.912437 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0c6299a8-96f9-4cae-87bc-a7837275f12b tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:18:14.913245 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0c6299a8-96f9-4cae-87bc-a7837275f12b tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:18:14.913932 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0c6299a8-96f9-4cae-87bc-a7837275f12b tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:18:14.914768 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0c6299a8-96f9-4cae-87bc-a7837275f12b tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:18:15.266859 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0c6299a8-96f9-4cae-87bc-a7837275f12b tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:18:15.283763 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-60a3357c-bfd9-413f-9526-1d685d458e0f req-0acfef13-1233-40e6-8707-1528392d68a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1cceddd-7c8d-4b5a-9814-7eee4f028c2e", "tag": "8008ff5e-612f-433f-b5c9-d52c4ac5df08"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:18:15.305420 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0c6299a8-96f9-4cae-87bc-a7837275f12b tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/b1cceddd-7c8d-4b5a-9814-7eee4f028c2e" status: 200 len: 1391 microversion: 2.1 time: 0.420732 Sep 08 11:18:15.319882 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3137/6144] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:18:14 2022] GET /compute/v2.1/servers/b1cceddd-7c8d-4b5a-9814-7eee4f028c2e => generated 1391 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:18:15.329285 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-60a3357c-bfd9-413f-9526-1d685d458e0f req-0acfef13-1233-40e6-8707-1528392d68a9 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:18:15.347478 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-60a3357c-bfd9-413f-9526-1d685d458e0f req-0acfef13-1233-40e6-8707-1528392d68a9 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:18:15.348216 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-60a3357c-bfd9-413f-9526-1d685d458e0f req-0acfef13-1233-40e6-8707-1528392d68a9 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:18:15.385086 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-60a3357c-bfd9-413f-9526-1d685d458e0f req-0acfef13-1233-40e6-8707-1528392d68a9 service nova] Creating event network-changed:8008ff5e-612f-433f-b5c9-d52c4ac5df08 for instance b1cceddd-7c8d-4b5a-9814-7eee4f028c2e on n-h2-850501-12 Sep 08 11:18:15.405140 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-60a3357c-bfd9-413f-9526-1d685d458e0f req-0acfef13-1233-40e6-8707-1528392d68a9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122001 Sep 08 11:18:15.407069 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3008/6145] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:18:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:18:16.334188 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-04decaaf-7a59-4543-aeb5-c4e6fb8567f5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:18:16.335912 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-04decaaf-7a59-4543-aeb5-c4e6fb8567f5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: b1cceddd-7c8d-4b5a-9814-7eee4f028c2e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:18:16.348720 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-04decaaf-7a59-4543-aeb5-c4e6fb8567f5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:18:16.351033 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-04decaaf-7a59-4543-aeb5-c4e6fb8567f5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:18:16.353853 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-04decaaf-7a59-4543-aeb5-c4e6fb8567f5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:18:16.356960 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-04decaaf-7a59-4543-aeb5-c4e6fb8567f5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:18:16.358197 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-04decaaf-7a59-4543-aeb5-c4e6fb8567f5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:18:16.362224 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-04decaaf-7a59-4543-aeb5-c4e6fb8567f5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:18:16.558478 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-04decaaf-7a59-4543-aeb5-c4e6fb8567f5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:18:16.569541 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-04decaaf-7a59-4543-aeb5-c4e6fb8567f5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/b1cceddd-7c8d-4b5a-9814-7eee4f028c2e" status: 200 len: 1391 microversion: 2.1 time: 0.239698 Sep 08 11:18:16.583160 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3138/6146] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:18:16 2022] GET /compute/v2.1/servers/b1cceddd-7c8d-4b5a-9814-7eee4f028c2e => generated 1391 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:18:17.596738 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-44fdefa7-bd50-4b4c-b898-3201a4f14024 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:18:17.597597 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-44fdefa7-bd50-4b4c-b898-3201a4f14024 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: b1cceddd-7c8d-4b5a-9814-7eee4f028c2e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:18:17.606534 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-44fdefa7-bd50-4b4c-b898-3201a4f14024 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:18:17.607939 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-44fdefa7-bd50-4b4c-b898-3201a4f14024 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:18:17.608776 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-44fdefa7-bd50-4b4c-b898-3201a4f14024 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:18:17.609730 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-44fdefa7-bd50-4b4c-b898-3201a4f14024 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:18:17.610382 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-44fdefa7-bd50-4b4c-b898-3201a4f14024 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:18:17.610902 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-44fdefa7-bd50-4b4c-b898-3201a4f14024 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:18:17.841056 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-44fdefa7-bd50-4b4c-b898-3201a4f14024 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:18:17.856566 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-44fdefa7-bd50-4b4c-b898-3201a4f14024 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/b1cceddd-7c8d-4b5a-9814-7eee4f028c2e" status: 200 len: 1391 microversion: 2.1 time: 0.265812 Sep 08 11:18:17.860442 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3009/6147] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:18:17 2022] GET /compute/v2.1/servers/b1cceddd-7c8d-4b5a-9814-7eee4f028c2e => generated 1391 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:18:18.866462 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-98e20a92-1497-4a4e-9880-aca479a6b017 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:18:18.866988 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-98e20a92-1497-4a4e-9880-aca479a6b017 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: 77e88235-e334-40dc-bd38-680e467ac4e2] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:18:18.875334 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-98e20a92-1497-4a4e-9880-aca479a6b017 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:18:18.875843 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-98e20a92-1497-4a4e-9880-aca479a6b017 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:18:18.876339 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-98e20a92-1497-4a4e-9880-aca479a6b017 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:18:18.877306 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-98e20a92-1497-4a4e-9880-aca479a6b017 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:18:18.877973 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-98e20a92-1497-4a4e-9880-aca479a6b017 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:18:18.887177 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6b74a41a-6e99-4fc1-9913-266fda64e2ee tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:18:18.889542 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-98e20a92-1497-4a4e-9880-aca479a6b017 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:18:18.891712 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6b74a41a-6e99-4fc1-9913-266fda64e2ee tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: b1cceddd-7c8d-4b5a-9814-7eee4f028c2e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:18:18.907832 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b74a41a-6e99-4fc1-9913-266fda64e2ee tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:18:18.908628 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b74a41a-6e99-4fc1-9913-266fda64e2ee tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:18:18.909361 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b74a41a-6e99-4fc1-9913-266fda64e2ee tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:18:18.920020 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b74a41a-6e99-4fc1-9913-266fda64e2ee tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:18:18.921000 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b74a41a-6e99-4fc1-9913-266fda64e2ee tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:18:18.921643 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b74a41a-6e99-4fc1-9913-266fda64e2ee tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:18:18.971464 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-98e20a92-1497-4a4e-9880-aca479a6b017 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "GET /compute/v2.1/servers/77e88235-e334-40dc-bd38-680e467ac4e2/os-volume_attachments/3b24e580-ac76-4204-be44-2508c5756789" status: 200 len: 194 microversion: 2.1 time: 0.109231 Sep 08 11:18:18.977622 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3139/6148] 10.222.0.27 () {58 vars in 1413 bytes} [Thu Sep 8 11:18:18 2022] GET /compute/v2.1/servers/77e88235-e334-40dc-bd38-680e467ac4e2/os-volume_attachments/3b24e580-ac76-4204-be44-2508c5756789 => generated 194 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:18:18.983183 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f5fa5fbc-a9ea-47d0-a244-f4efaea6ff65 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:18:18.983940 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f5fa5fbc-a9ea-47d0-a244-f4efaea6ff65 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: 77e88235-e334-40dc-bd38-680e467ac4e2] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:18:18.993386 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f5fa5fbc-a9ea-47d0-a244-f4efaea6ff65 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:18:18.994356 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f5fa5fbc-a9ea-47d0-a244-f4efaea6ff65 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:18:18.995027 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f5fa5fbc-a9ea-47d0-a244-f4efaea6ff65 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:18:18.995905 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f5fa5fbc-a9ea-47d0-a244-f4efaea6ff65 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:18:18.996733 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f5fa5fbc-a9ea-47d0-a244-f4efaea6ff65 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:18:18.997350 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f5fa5fbc-a9ea-47d0-a244-f4efaea6ff65 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:18:19.109967 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:18:19.172496 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6b74a41a-6e99-4fc1-9913-266fda64e2ee tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:18:19.183812 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6b74a41a-6e99-4fc1-9913-266fda64e2ee tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/b1cceddd-7c8d-4b5a-9814-7eee4f028c2e" status: 200 len: 1391 microversion: 2.1 time: 0.303278 Sep 08 11:18:19.184760 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-f5fa5fbc-a9ea-47d0-a244-f4efaea6ff65 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lazy-loading 'services' on Instance uuid 77e88235-e334-40dc-bd38-680e467ac4e2 {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:18:19.185672 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3010/6149] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:18:18 2022] GET /compute/v2.1/servers/b1cceddd-7c8d-4b5a-9814-7eee4f028c2e => generated 1391 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:18:19.307007 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f5fa5fbc-a9ea-47d0-a244-f4efaea6ff65 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "DELETE /compute/v2.1/servers/77e88235-e334-40dc-bd38-680e467ac4e2/os-volume_attachments/3b24e580-ac76-4204-be44-2508c5756789" status: 202 len: 0 microversion: 2.1 time: 0.326728 Sep 08 11:18:19.307668 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3140/6150] 10.222.0.27 () {58 vars in 1416 bytes} [Thu Sep 8 11:18:18 2022] DELETE /compute/v2.1/servers/77e88235-e334-40dc-bd38-680e467ac4e2/os-volume_attachments/3b24e580-ac76-4204-be44-2508c5756789 => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:18:20.214252 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-77b94591-eeed-4de1-a67e-da00c4351604 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:18:20.215771 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-77b94591-eeed-4de1-a67e-da00c4351604 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: b1cceddd-7c8d-4b5a-9814-7eee4f028c2e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:18:20.217947 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=8 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:18:20.230486 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-77b94591-eeed-4de1-a67e-da00c4351604 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:18:20.230996 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-77b94591-eeed-4de1-a67e-da00c4351604 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:18:20.231476 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-77b94591-eeed-4de1-a67e-da00c4351604 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:18:20.232244 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-77b94591-eeed-4de1-a67e-da00c4351604 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:18:20.232923 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-77b94591-eeed-4de1-a67e-da00c4351604 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:18:20.233627 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-77b94591-eeed-4de1-a67e-da00c4351604 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:18:21.103767 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-77b94591-eeed-4de1-a67e-da00c4351604 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:18:21.121534 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-77b94591-eeed-4de1-a67e-da00c4351604 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/b1cceddd-7c8d-4b5a-9814-7eee4f028c2e" status: 200 len: 1391 microversion: 2.1 time: 0.916889 Sep 08 11:18:21.122737 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3011/6151] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:18:20 2022] GET /compute/v2.1/servers/b1cceddd-7c8d-4b5a-9814-7eee4f028c2e => generated 1391 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:18:21.275948 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-6472f62b-9611-4a1e-80ef-28db903e0889 req-34bea8b2-3619-4c1b-93b2-f96727609564 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1cceddd-7c8d-4b5a-9814-7eee4f028c2e", "name": "network-vif-plugged", "status": "completed", "tag": "8008ff5e-612f-433f-b5c9-d52c4ac5df08"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:18:21.290665 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-6472f62b-9611-4a1e-80ef-28db903e0889 req-34bea8b2-3619-4c1b-93b2-f96727609564 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:18:21.291375 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-6472f62b-9611-4a1e-80ef-28db903e0889 req-34bea8b2-3619-4c1b-93b2-f96727609564 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:18:21.292783 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-6472f62b-9611-4a1e-80ef-28db903e0889 req-34bea8b2-3619-4c1b-93b2-f96727609564 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:18:21.308611 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-6472f62b-9611-4a1e-80ef-28db903e0889 req-34bea8b2-3619-4c1b-93b2-f96727609564 service nova] Creating event network-vif-plugged:8008ff5e-612f-433f-b5c9-d52c4ac5df08 for instance b1cceddd-7c8d-4b5a-9814-7eee4f028c2e on n-h2-850501-12 Sep 08 11:18:21.319456 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-6472f62b-9611-4a1e-80ef-28db903e0889 req-34bea8b2-3619-4c1b-93b2-f96727609564 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.285629 Sep 08 11:18:21.320646 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3141/6152] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:18:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:18:22.149254 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7ae529cb-f555-4e97-b7d9-f92d97eebc4c tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:18:22.149889 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7ae529cb-f555-4e97-b7d9-f92d97eebc4c tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: b1cceddd-7c8d-4b5a-9814-7eee4f028c2e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:18:22.158058 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ae529cb-f555-4e97-b7d9-f92d97eebc4c tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:18:22.158758 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ae529cb-f555-4e97-b7d9-f92d97eebc4c tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:18:22.159861 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ae529cb-f555-4e97-b7d9-f92d97eebc4c tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:18:22.172584 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ae529cb-f555-4e97-b7d9-f92d97eebc4c tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:18:22.173748 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ae529cb-f555-4e97-b7d9-f92d97eebc4c tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:18:22.178409 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ae529cb-f555-4e97-b7d9-f92d97eebc4c tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:18:22.385799 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7ae529cb-f555-4e97-b7d9-f92d97eebc4c tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:18:22.395718 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7ae529cb-f555-4e97-b7d9-f92d97eebc4c tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/b1cceddd-7c8d-4b5a-9814-7eee4f028c2e" status: 200 len: 1391 microversion: 2.1 time: 0.250180 Sep 08 11:18:22.396683 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3012/6153] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:18:22 2022] GET /compute/v2.1/servers/b1cceddd-7c8d-4b5a-9814-7eee4f028c2e => generated 1391 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:18:23.427115 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4cb35dd8-b919-4ebb-bbd2-cd19893b57f2 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:18:23.428529 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4cb35dd8-b919-4ebb-bbd2-cd19893b57f2 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: b1cceddd-7c8d-4b5a-9814-7eee4f028c2e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:18:23.438087 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4cb35dd8-b919-4ebb-bbd2-cd19893b57f2 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:18:23.438893 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4cb35dd8-b919-4ebb-bbd2-cd19893b57f2 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:18:23.439690 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4cb35dd8-b919-4ebb-bbd2-cd19893b57f2 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:18:23.440602 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4cb35dd8-b919-4ebb-bbd2-cd19893b57f2 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:18:23.441293 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4cb35dd8-b919-4ebb-bbd2-cd19893b57f2 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:18:23.441917 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4cb35dd8-b919-4ebb-bbd2-cd19893b57f2 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:18:23.648378 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4cb35dd8-b919-4ebb-bbd2-cd19893b57f2 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:18:23.657807 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4cb35dd8-b919-4ebb-bbd2-cd19893b57f2 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/b1cceddd-7c8d-4b5a-9814-7eee4f028c2e" status: 200 len: 1563 microversion: 2.1 time: 0.239539 Sep 08 11:18:23.658699 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3142/6154] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:18:23 2022] GET /compute/v2.1/servers/b1cceddd-7c8d-4b5a-9814-7eee4f028c2e => generated 1563 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:18:23.682179 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-98082013-448a-4dd2-8607-e9bf28ef2229 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:18:23.683419 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-98082013-448a-4dd2-8607-e9bf28ef2229 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: b1cceddd-7c8d-4b5a-9814-7eee4f028c2e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:18:23.692015 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-98082013-448a-4dd2-8607-e9bf28ef2229 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:18:23.692637 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-98082013-448a-4dd2-8607-e9bf28ef2229 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:18:23.693175 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-98082013-448a-4dd2-8607-e9bf28ef2229 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:18:23.694402 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-98082013-448a-4dd2-8607-e9bf28ef2229 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:18:23.695491 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-98082013-448a-4dd2-8607-e9bf28ef2229 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:18:23.696142 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-98082013-448a-4dd2-8607-e9bf28ef2229 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:18:23.882282 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-98082013-448a-4dd2-8607-e9bf28ef2229 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:18:23.895445 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-98082013-448a-4dd2-8607-e9bf28ef2229 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/b1cceddd-7c8d-4b5a-9814-7eee4f028c2e" status: 200 len: 1563 microversion: 2.1 time: 0.218078 Sep 08 11:18:23.909613 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3013/6155] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:18:23 2022] GET /compute/v2.1/servers/b1cceddd-7c8d-4b5a-9814-7eee4f028c2e => generated 1563 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:18:26.194197 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-efae813a-f331-4c9c-a055-ba79f98173cf req-861102de-2671-4217-b8a2-806d6b467ff5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1cceddd-7c8d-4b5a-9814-7eee4f028c2e", "tag": "8008ff5e-612f-433f-b5c9-d52c4ac5df08"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:18:26.196154 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b60ce8ee-89d1-4486-b669-5ffb7ac3d593 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:18:26.205822 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b60ce8ee-89d1-4486-b669-5ffb7ac3d593 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: b1cceddd-7c8d-4b5a-9814-7eee4f028c2e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:18:26.227999 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b60ce8ee-89d1-4486-b669-5ffb7ac3d593 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:18:26.228533 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b60ce8ee-89d1-4486-b669-5ffb7ac3d593 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:18:26.228987 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b60ce8ee-89d1-4486-b669-5ffb7ac3d593 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:18:26.229742 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b60ce8ee-89d1-4486-b669-5ffb7ac3d593 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:18:26.230211 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b60ce8ee-89d1-4486-b669-5ffb7ac3d593 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:18:26.230647 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b60ce8ee-89d1-4486-b669-5ffb7ac3d593 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:18:26.234179 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-efae813a-f331-4c9c-a055-ba79f98173cf req-861102de-2671-4217-b8a2-806d6b467ff5 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:18:26.234864 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-efae813a-f331-4c9c-a055-ba79f98173cf req-861102de-2671-4217-b8a2-806d6b467ff5 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:18:26.235313 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-efae813a-f331-4c9c-a055-ba79f98173cf req-861102de-2671-4217-b8a2-806d6b467ff5 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:18:26.261540 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-efae813a-f331-4c9c-a055-ba79f98173cf req-861102de-2671-4217-b8a2-806d6b467ff5 service nova] Creating event network-changed:8008ff5e-612f-433f-b5c9-d52c4ac5df08 for instance b1cceddd-7c8d-4b5a-9814-7eee4f028c2e on n-h2-850501-12 Sep 08 11:18:26.270154 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-efae813a-f331-4c9c-a055-ba79f98173cf req-861102de-2671-4217-b8a2-806d6b467ff5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083197 Sep 08 11:18:26.271154 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3014/6156] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:18:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:18:26.277616 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6aef03e4-49bf-4ccc-a137-34f5779d4304 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:18:26.280476 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6aef03e4-49bf-4ccc-a137-34f5779d4304 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: 77e88235-e334-40dc-bd38-680e467ac4e2] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:18:26.287252 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6aef03e4-49bf-4ccc-a137-34f5779d4304 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:18:26.287748 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6aef03e4-49bf-4ccc-a137-34f5779d4304 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:18:26.288194 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6aef03e4-49bf-4ccc-a137-34f5779d4304 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:18:26.288938 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6aef03e4-49bf-4ccc-a137-34f5779d4304 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:18:26.289426 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6aef03e4-49bf-4ccc-a137-34f5779d4304 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:18:26.290035 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6aef03e4-49bf-4ccc-a137-34f5779d4304 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:18:26.341011 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6aef03e4-49bf-4ccc-a137-34f5779d4304 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "GET /compute/v2.1/servers/77e88235-e334-40dc-bd38-680e467ac4e2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.067535 Sep 08 11:18:26.341011 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3015/6157] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 11:18:26 2022] GET /compute/v2.1/servers/77e88235-e334-40dc-bd38-680e467ac4e2/os-volume_attachments => generated 25 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 11:18:26.607772 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ab1aeec7-b7d9-4804-9ae2-379c971a7d81 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:18:26.610356 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ab1aeec7-b7d9-4804-9ae2-379c971a7d81 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: 77e88235-e334-40dc-bd38-680e467ac4e2] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:18:26.624456 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab1aeec7-b7d9-4804-9ae2-379c971a7d81 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:18:26.625331 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab1aeec7-b7d9-4804-9ae2-379c971a7d81 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:18:26.626986 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab1aeec7-b7d9-4804-9ae2-379c971a7d81 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:18:26.630484 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab1aeec7-b7d9-4804-9ae2-379c971a7d81 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:18:26.631207 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab1aeec7-b7d9-4804-9ae2-379c971a7d81 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:18:26.631839 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab1aeec7-b7d9-4804-9ae2-379c971a7d81 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:18:26.700215 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ab1aeec7-b7d9-4804-9ae2-379c971a7d81 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "GET /compute/v2.1/servers/77e88235-e334-40dc-bd38-680e467ac4e2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.098379 Sep 08 11:18:26.700974 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3016/6158] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 11:18:26 2022] GET /compute/v2.1/servers/77e88235-e334-40dc-bd38-680e467ac4e2/os-volume_attachments => generated 25 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 11:18:26.799225 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b60ce8ee-89d1-4486-b669-5ffb7ac3d593 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:18:26.805338 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-789df845-33c5-4eee-98d0-ca8282ef48d6 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:18:26.806074 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-789df845-33c5-4eee-98d0-ca8282ef48d6 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: 77e88235-e334-40dc-bd38-680e467ac4e2] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:18:26.808754 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b60ce8ee-89d1-4486-b669-5ffb7ac3d593 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/b1cceddd-7c8d-4b5a-9814-7eee4f028c2e" status: 200 len: 1563 microversion: 2.1 time: 0.633899 Sep 08 11:18:26.809387 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3143/6159] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:18:26 2022] GET /compute/v2.1/servers/b1cceddd-7c8d-4b5a-9814-7eee4f028c2e => generated 1563 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:18:26.818198 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-789df845-33c5-4eee-98d0-ca8282ef48d6 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:18:26.818864 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-789df845-33c5-4eee-98d0-ca8282ef48d6 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:18:26.821414 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-789df845-33c5-4eee-98d0-ca8282ef48d6 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:18:26.822381 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-789df845-33c5-4eee-98d0-ca8282ef48d6 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:18:26.822936 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-789df845-33c5-4eee-98d0-ca8282ef48d6 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:18:26.823847 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-789df845-33c5-4eee-98d0-ca8282ef48d6 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:18:26.870116 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-789df845-33c5-4eee-98d0-ca8282ef48d6 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: 77e88235-e334-40dc-bd38-680e467ac4e2] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:18:27.088639 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-789df845-33c5-4eee-98d0-ca8282ef48d6 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "DELETE /compute/v2.1/servers/77e88235-e334-40dc-bd38-680e467ac4e2" status: 204 len: 0 microversion: 2.1 time: 0.288190 Sep 08 11:18:27.094042 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3017/6160] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:18:26 2022] DELETE /compute/v2.1/servers/77e88235-e334-40dc-bd38-680e467ac4e2 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:18:27.102081 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-77446059-6fb9-43ce-9e6b-ba6adbe17e3f tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:18:27.102701 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-77446059-6fb9-43ce-9e6b-ba6adbe17e3f tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: 77e88235-e334-40dc-bd38-680e467ac4e2] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:18:27.124713 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-77446059-6fb9-43ce-9e6b-ba6adbe17e3f tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:18:27.126110 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-77446059-6fb9-43ce-9e6b-ba6adbe17e3f tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:18:27.127200 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-77446059-6fb9-43ce-9e6b-ba6adbe17e3f tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:18:27.128622 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-77446059-6fb9-43ce-9e6b-ba6adbe17e3f tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:18:27.129766 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-77446059-6fb9-43ce-9e6b-ba6adbe17e3f tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:18:27.130720 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-77446059-6fb9-43ce-9e6b-ba6adbe17e3f tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:18:27.810688 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-77446059-6fb9-43ce-9e6b-ba6adbe17e3f tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bdfecc6c7a43608095044b0174b48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfe795da0e4988a50c38f19200ea7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:18:27.822480 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-77446059-6fb9-43ce-9e6b-ba6adbe17e3f tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "GET /compute/v2.1/servers/77e88235-e334-40dc-bd38-680e467ac4e2" status: 200 len: 1674 microversion: 2.1 time: 0.724288 Sep 08 11:18:27.823084 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3144/6161] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:18:27 2022] GET /compute/v2.1/servers/77e88235-e334-40dc-bd38-680e467ac4e2 => generated 1674 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:18:28.849518 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ad6c7376-69ba-4d4d-917b-6c8e7a1d421f tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:18:28.850931 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ad6c7376-69ba-4d4d-917b-6c8e7a1d421f tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: 77e88235-e334-40dc-bd38-680e467ac4e2] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:18:28.864187 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad6c7376-69ba-4d4d-917b-6c8e7a1d421f tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:18:28.865053 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad6c7376-69ba-4d4d-917b-6c8e7a1d421f tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:18:28.865609 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad6c7376-69ba-4d4d-917b-6c8e7a1d421f tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:18:28.866354 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad6c7376-69ba-4d4d-917b-6c8e7a1d421f tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:18:28.867067 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad6c7376-69ba-4d4d-917b-6c8e7a1d421f tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:18:28.867710 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad6c7376-69ba-4d4d-917b-6c8e7a1d421f tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:18:29.176622 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ad6c7376-69ba-4d4d-917b-6c8e7a1d421f tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bdfecc6c7a43608095044b0174b48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfe795da0e4988a50c38f19200ea7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:18:29.187816 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ad6c7376-69ba-4d4d-917b-6c8e7a1d421f tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "GET /compute/v2.1/servers/77e88235-e334-40dc-bd38-680e467ac4e2" status: 200 len: 1674 microversion: 2.1 time: 0.342892 Sep 08 11:18:29.188756 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3018/6162] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:18:28 2022] GET /compute/v2.1/servers/77e88235-e334-40dc-bd38-680e467ac4e2 => generated 1674 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:18:30.211696 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d26f031d-4990-4ac7-91e1-2dc168152fcd tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:18:30.213166 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d26f031d-4990-4ac7-91e1-2dc168152fcd tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: 77e88235-e334-40dc-bd38-680e467ac4e2] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:18:30.233945 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d26f031d-4990-4ac7-91e1-2dc168152fcd tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:18:30.234473 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d26f031d-4990-4ac7-91e1-2dc168152fcd tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:18:30.234929 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d26f031d-4990-4ac7-91e1-2dc168152fcd tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:18:30.235660 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d26f031d-4990-4ac7-91e1-2dc168152fcd tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:18:30.236130 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d26f031d-4990-4ac7-91e1-2dc168152fcd tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:18:30.236569 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d26f031d-4990-4ac7-91e1-2dc168152fcd tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:18:30.341463 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d26f031d-4990-4ac7-91e1-2dc168152fcd tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bdfecc6c7a43608095044b0174b48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfe795da0e4988a50c38f19200ea7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:18:30.352970 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d26f031d-4990-4ac7-91e1-2dc168152fcd tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "GET /compute/v2.1/servers/77e88235-e334-40dc-bd38-680e467ac4e2" status: 200 len: 1607 microversion: 2.1 time: 0.145067 Sep 08 11:18:30.354174 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3145/6163] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:18:30 2022] GET /compute/v2.1/servers/77e88235-e334-40dc-bd38-680e467ac4e2 => generated 1607 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:18:30.855686 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-700da5d2-edbd-4127-b57f-12449f9a44c4 req-bb01d93f-dcbc-45ce-9cb1-e27c6f21957d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77e88235-e334-40dc-bd38-680e467ac4e2", "name": "network-vif-deleted", "tag": "3cdfc914-8511-4b1c-8d54-621c9c0e8153"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:18:30.882312 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-700da5d2-edbd-4127-b57f-12449f9a44c4 req-bb01d93f-dcbc-45ce-9cb1-e27c6f21957d service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:18:30.883049 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-700da5d2-edbd-4127-b57f-12449f9a44c4 req-bb01d93f-dcbc-45ce-9cb1-e27c6f21957d service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:18:30.884049 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-700da5d2-edbd-4127-b57f-12449f9a44c4 req-bb01d93f-dcbc-45ce-9cb1-e27c6f21957d service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:18:30.902127 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-700da5d2-edbd-4127-b57f-12449f9a44c4 req-bb01d93f-dcbc-45ce-9cb1-e27c6f21957d service nova] Creating event network-vif-deleted:3cdfc914-8511-4b1c-8d54-621c9c0e8153 for instance 77e88235-e334-40dc-bd38-680e467ac4e2 on n-h1-850501-12 Sep 08 11:18:30.909326 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-700da5d2-edbd-4127-b57f-12449f9a44c4 req-bb01d93f-dcbc-45ce-9cb1-e27c6f21957d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.450587 Sep 08 11:18:30.910177 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3019/6164] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:18:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:18:31.380853 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f880761b-951c-49fc-82a2-1f1230322f69 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:18:31.381505 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f880761b-951c-49fc-82a2-1f1230322f69 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: 77e88235-e334-40dc-bd38-680e467ac4e2] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:18:31.399370 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f880761b-951c-49fc-82a2-1f1230322f69 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:18:31.400054 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f880761b-951c-49fc-82a2-1f1230322f69 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:18:31.400639 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f880761b-951c-49fc-82a2-1f1230322f69 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:18:31.401581 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f880761b-951c-49fc-82a2-1f1230322f69 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:18:31.402186 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f880761b-951c-49fc-82a2-1f1230322f69 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:18:31.402755 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f880761b-951c-49fc-82a2-1f1230322f69 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:18:31.422822 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-f880761b-951c-49fc-82a2-1f1230322f69 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] HTTP exception thrown: Instance 77e88235-e334-40dc-bd38-680e467ac4e2 could not be found. Sep 08 11:18:31.424823 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f880761b-951c-49fc-82a2-1f1230322f69 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Request method failure captured: Sep 08 11:18:31.424823 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/77e88235-e334-40dc-bd38-680e467ac4e2 HTTP/1.1 Sep 08 11:18:31.424823 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:18:31.424823 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:18:31.424823 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:18:31.424823 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 11:18:31.424823 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:18:31.424823 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:18:31.424823 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:18:31.424823 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:18:31.424823 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGc45zUR61ebW_EzHCMbc6VtgxjxpBxZ1vn5tgJ28f5PYNkUZtw8FaeV_00ITw9X5j_OhMo8wdwdGnvQypZIm7by57nIIuLznoxOH3I_DFxPJc5kV_Mb8xXudQqjS13CJLT0Ff3sasdqmyCun3dDf3vf5N50OTTdpyz93Jie4GOJmzWE Sep 08 11:18:31.424823 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:18:31.424823 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:18:31.424823 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:18:31.424823 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:18:31.424823 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:18:31.424823 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:18:31.424823 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 09dfe795da0e4988a50c38f19200ea7e Sep 08 11:18:31.424823 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-AttachVolumeTestJSON-306053878 Sep 08 11:18:31.424823 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:18:31.424823 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:18:31.424823 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/09dfe795da0e4988a50c38f19200ea7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/09dfe795da0e4988a50c38f19200ea7e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_09dfe795da0e4988a50c38f19200ea7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/09dfe795da0e4988a50c38f19200ea7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:18:31.424823 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-AttachVolumeTestJSON-306053878 Sep 08 11:18:31.424823 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 09dfe795da0e4988a50c38f19200ea7e Sep 08 11:18:31.424823 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-AttachVolumeTestJSON-306053878 Sep 08 11:18:31.424823 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-AttachVolumeTestJSON-306053878-project Sep 08 11:18:31.424823 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:18:31.424823 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:18:31.424823 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: d6bdfecc6c7a43608095044b0174b48f Sep 08 11:18:31.424823 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-AttachVolumeTestJSON-306053878-project Sep 08 11:18:31.424823 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 11:18:31.424823 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 77e88235-e334-40dc-bd38-680e467ac4e2 could not be found. Sep 08 11:18:31.424823 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '77e88235-e334-40dc-bd38-680e467ac4e2'} Sep 08 11:18:31.424823 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:18:31.424823 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:18:31.424823 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:18:31.424823 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:18:31.424823 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:18:31.424823 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:18:31.424823 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:18:31.424823 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:18:31.424823 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:18:31.424823 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:18:31.424823 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77e88235-e334-40dc-bd38-680e467ac4e2 could not be found. Sep 08 11:18:31.424823 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:18:31.424823 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:18:31.424823 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:18:31.424823 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:18:31.424823 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:18:31.424823 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:18:31.424823 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:18:31.424823 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:18:31.424823 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:18:31.424823 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:18:31.424823 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:18:31.424823 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:18:31.424823 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:18:31.424823 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:18:31.424823 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:18:31.424823 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:18:31.424823 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77e88235-e334-40dc-bd38-680e467ac4e2 could not be found. Sep 08 11:18:31.424823 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:18:31.424823 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:18:31.424823 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:18:31.430182 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:18:31.430182 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:18:31.430182 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:18:31.430182 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:18:31.430182 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:18:31.430182 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77e88235-e334-40dc-bd38-680e467ac4e2 could not be found. Sep 08 11:18:31.430182 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:18:31.430182 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f880761b-951c-49fc-82a2-1f1230322f69 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Returning 404 to user: Instance 77e88235-e334-40dc-bd38-680e467ac4e2 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:18:31.430182 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f880761b-951c-49fc-82a2-1f1230322f69 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "GET /compute/v2.1/servers/77e88235-e334-40dc-bd38-680e467ac4e2" status: 404 len: 111 microversion: 2.1 time: 0.053257 Sep 08 11:18:31.430182 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3146/6165] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:18:31 2022] GET /compute/v2.1/servers/77e88235-e334-40dc-bd38-680e467ac4e2 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:18:31.438164 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5c90deea-084a-4df7-92eb-c9b0082fed08 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Calling method '.version_select at 0x7f68e8a58160>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:18:31.456762 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:18:31.472291 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5c90deea-084a-4df7-92eb-c9b0082fed08 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1181098926" status: 202 len: 0 microversion: 2.1 time: 0.039756 Sep 08 11:18:31.473358 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3020/6166] 10.222.0.27 () {58 vars in 1221 bytes} [Thu Sep 8 11:18:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1181098926 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:18:44.544336 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c961a29e-4ed8-473a-b1b9-8ad3117c6e7f tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:18:44.547607 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c961a29e-4ed8-473a-b1b9-8ad3117c6e7f tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: 77e88235-e334-40dc-bd38-680e467ac4e2] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:18:44.555007 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=28 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:18:44.556344 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=82,nova_cell1:INSERT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:18:44.559516 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c961a29e-4ed8-473a-b1b9-8ad3117c6e7f tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:18:44.560319 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c961a29e-4ed8-473a-b1b9-8ad3117c6e7f tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:18:44.560945 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c961a29e-4ed8-473a-b1b9-8ad3117c6e7f tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:18:44.562391 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c961a29e-4ed8-473a-b1b9-8ad3117c6e7f tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:18:44.563217 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c961a29e-4ed8-473a-b1b9-8ad3117c6e7f tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:18:44.563886 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c961a29e-4ed8-473a-b1b9-8ad3117c6e7f tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:18:44.591586 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-c961a29e-4ed8-473a-b1b9-8ad3117c6e7f tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] HTTP exception thrown: Instance 77e88235-e334-40dc-bd38-680e467ac4e2 could not be found. Sep 08 11:18:44.593760 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c961a29e-4ed8-473a-b1b9-8ad3117c6e7f tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Request method failure captured: Sep 08 11:18:44.593760 n-d-850501-12 devstack@n-api.service[128861]: request: DELETE /compute/v2.1/servers/77e88235-e334-40dc-bd38-680e467ac4e2 HTTP/1.1 Sep 08 11:18:44.593760 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:18:44.593760 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:18:44.593760 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:18:44.593760 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 11:18:44.593760 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:18:44.593760 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:18:44.593760 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:18:44.593760 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:18:44.593760 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGc45zUR61ebW_EzHCMbc6VtgxjxpBxZ1vn5tgJ28f5PYNkUZtw8FaeV_00ITw9X5j_OhMo8wdwdGnvQypZIm7by57nIIuLznoxOH3I_DFxPJc5kV_Mb8xXudQqjS13CJLT0Ff3sasdqmyCun3dDf3vf5N50OTTdpyz93Jie4GOJmzWE Sep 08 11:18:44.593760 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:18:44.593760 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:18:44.593760 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:18:44.593760 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:18:44.593760 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:18:44.593760 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:18:44.593760 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 09dfe795da0e4988a50c38f19200ea7e Sep 08 11:18:44.593760 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-AttachVolumeTestJSON-306053878 Sep 08 11:18:44.593760 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:18:44.593760 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:18:44.593760 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/09dfe795da0e4988a50c38f19200ea7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/09dfe795da0e4988a50c38f19200ea7e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_09dfe795da0e4988a50c38f19200ea7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/09dfe795da0e4988a50c38f19200ea7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:18:44.593760 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-AttachVolumeTestJSON-306053878 Sep 08 11:18:44.593760 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 09dfe795da0e4988a50c38f19200ea7e Sep 08 11:18:44.593760 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-AttachVolumeTestJSON-306053878 Sep 08 11:18:44.593760 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-AttachVolumeTestJSON-306053878-project Sep 08 11:18:44.593760 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:18:44.593760 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:18:44.593760 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: d6bdfecc6c7a43608095044b0174b48f Sep 08 11:18:44.593760 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-AttachVolumeTestJSON-306053878-project Sep 08 11:18:44.593760 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 11:18:44.593760 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 77e88235-e334-40dc-bd38-680e467ac4e2 could not be found. Sep 08 11:18:44.593760 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '77e88235-e334-40dc-bd38-680e467ac4e2'} Sep 08 11:18:44.593760 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:18:44.593760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:18:44.593760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:18:44.593760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:18:44.593760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:18:44.593760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:18:44.593760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:18:44.593760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:18:44.593760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:18:44.593760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:18:44.593760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77e88235-e334-40dc-bd38-680e467ac4e2 could not be found. Sep 08 11:18:44.593760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:18:44.593760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:18:44.593760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:18:44.593760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:18:44.593760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:18:44.593760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:18:44.593760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:18:44.593760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:18:44.593760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:18:44.593760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:18:44.593760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 11:18:44.593760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 11:18:44.593760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 11:18:44.593760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 11:18:44.593760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:18:44.593760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:18:44.593760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:18:44.593760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:18:44.598305 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77e88235-e334-40dc-bd38-680e467ac4e2 could not be found. Sep 08 11:18:44.598305 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:18:44.598305 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:18:44.598305 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:18:44.598305 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:18:44.598305 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:18:44.598305 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:18:44.598305 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:18:44.598305 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:18:44.598305 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77e88235-e334-40dc-bd38-680e467ac4e2 could not be found. Sep 08 11:18:44.598305 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:18:44.598305 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c961a29e-4ed8-473a-b1b9-8ad3117c6e7f tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Returning 404 to user: Instance 77e88235-e334-40dc-bd38-680e467ac4e2 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:18:44.598305 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c961a29e-4ed8-473a-b1b9-8ad3117c6e7f tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "DELETE /compute/v2.1/servers/77e88235-e334-40dc-bd38-680e467ac4e2" status: 404 len: 111 microversion: 2.1 time: 0.056331 Sep 08 11:18:44.598305 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3147/6167] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:18:44 2022] DELETE /compute/v2.1/servers/77e88235-e334-40dc-bd38-680e467ac4e2 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:18:44.605136 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e823be72-a707-493a-9d1f-83b4d3cdd0c7 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:18:44.608125 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e823be72-a707-493a-9d1f-83b4d3cdd0c7 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: 77e88235-e334-40dc-bd38-680e467ac4e2] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:18:44.637324 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:18:44.653910 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e823be72-a707-493a-9d1f-83b4d3cdd0c7 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:18:44.659984 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e823be72-a707-493a-9d1f-83b4d3cdd0c7 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:18:44.661766 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e823be72-a707-493a-9d1f-83b4d3cdd0c7 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:18:44.665981 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e823be72-a707-493a-9d1f-83b4d3cdd0c7 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:18:44.667312 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e823be72-a707-493a-9d1f-83b4d3cdd0c7 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:18:44.669525 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e823be72-a707-493a-9d1f-83b4d3cdd0c7 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:18:44.731817 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-e823be72-a707-493a-9d1f-83b4d3cdd0c7 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] HTTP exception thrown: Instance 77e88235-e334-40dc-bd38-680e467ac4e2 could not be found. Sep 08 11:18:44.735302 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e823be72-a707-493a-9d1f-83b4d3cdd0c7 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Request method failure captured: Sep 08 11:18:44.735302 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/77e88235-e334-40dc-bd38-680e467ac4e2 HTTP/1.1 Sep 08 11:18:44.735302 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 11:18:44.735302 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 11:18:44.735302 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 11:18:44.735302 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 11:18:44.735302 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 11:18:44.735302 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 11:18:44.735302 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 11:18:44.735302 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 11:18:44.735302 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGc45zUR61ebW_EzHCMbc6VtgxjxpBxZ1vn5tgJ28f5PYNkUZtw8FaeV_00ITw9X5j_OhMo8wdwdGnvQypZIm7by57nIIuLznoxOH3I_DFxPJc5kV_Mb8xXudQqjS13CJLT0Ff3sasdqmyCun3dDf3vf5N50OTTdpyz93Jie4GOJmzWE Sep 08 11:18:44.735302 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 11:18:44.735302 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 11:18:44.735302 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 11:18:44.735302 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 11:18:44.735302 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 11:18:44.735302 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 11:18:44.735302 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 09dfe795da0e4988a50c38f19200ea7e Sep 08 11:18:44.735302 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-AttachVolumeTestJSON-306053878 Sep 08 11:18:44.735302 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 11:18:44.735302 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 11:18:44.735302 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/09dfe795da0e4988a50c38f19200ea7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/09dfe795da0e4988a50c38f19200ea7e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_09dfe795da0e4988a50c38f19200ea7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/09dfe795da0e4988a50c38f19200ea7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:18:44.735302 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-AttachVolumeTestJSON-306053878 Sep 08 11:18:44.735302 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 09dfe795da0e4988a50c38f19200ea7e Sep 08 11:18:44.735302 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-AttachVolumeTestJSON-306053878 Sep 08 11:18:44.735302 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-AttachVolumeTestJSON-306053878-project Sep 08 11:18:44.735302 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 11:18:44.735302 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 11:18:44.735302 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: d6bdfecc6c7a43608095044b0174b48f Sep 08 11:18:44.735302 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-AttachVolumeTestJSON-306053878-project Sep 08 11:18:44.735302 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 11:18:44.735302 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 77e88235-e334-40dc-bd38-680e467ac4e2 could not be found. Sep 08 11:18:44.735302 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '77e88235-e334-40dc-bd38-680e467ac4e2'} Sep 08 11:18:44.735302 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:18:44.735302 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:18:44.735302 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:18:44.735302 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:18:44.735302 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:18:44.735302 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:18:44.735302 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:18:44.735302 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:18:44.735302 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:18:44.735302 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:18:44.735302 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77e88235-e334-40dc-bd38-680e467ac4e2 could not be found. Sep 08 11:18:44.735302 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:18:44.735302 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:18:44.735302 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:18:44.735302 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:18:44.735302 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:18:44.735302 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:18:44.735302 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:18:44.735302 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:18:44.735302 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:18:44.735302 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:18:44.735302 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:18:44.735302 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:18:44.735302 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:18:44.735302 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:18:44.735302 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:18:44.735302 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:18:44.735302 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77e88235-e334-40dc-bd38-680e467ac4e2 could not be found. Sep 08 11:18:44.735302 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:18:44.735302 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:18:44.735302 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:18:44.743090 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:18:44.743090 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:18:44.743090 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:18:44.743090 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:18:44.743090 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:18:44.743090 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77e88235-e334-40dc-bd38-680e467ac4e2 could not be found. Sep 08 11:18:44.743090 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:18:44.746945 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e823be72-a707-493a-9d1f-83b4d3cdd0c7 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Returning 404 to user: Instance 77e88235-e334-40dc-bd38-680e467ac4e2 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:18:44.748876 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e823be72-a707-493a-9d1f-83b4d3cdd0c7 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "GET /compute/v2.1/servers/77e88235-e334-40dc-bd38-680e467ac4e2" status: 404 len: 111 microversion: 2.1 time: 0.147656 Sep 08 11:18:44.750075 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3021/6168] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:18:44 2022] GET /compute/v2.1/servers/77e88235-e334-40dc-bd38-680e467ac4e2 => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:18:51.323663 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-475e8eca-e52a-49f7-95bf-0440a0022787 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:18:51.329139 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-475e8eca-e52a-49f7-95bf-0440a0022787 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: b1cceddd-7c8d-4b5a-9814-7eee4f028c2e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:18:51.334836 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-475e8eca-e52a-49f7-95bf-0440a0022787 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:18:51.335470 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-475e8eca-e52a-49f7-95bf-0440a0022787 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:18:51.335989 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-475e8eca-e52a-49f7-95bf-0440a0022787 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:18:51.336738 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-475e8eca-e52a-49f7-95bf-0440a0022787 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:18:51.337522 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-475e8eca-e52a-49f7-95bf-0440a0022787 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:18:51.338126 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-475e8eca-e52a-49f7-95bf-0440a0022787 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:18:51.403822 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-475e8eca-e52a-49f7-95bf-0440a0022787 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "POST /compute/v2.1/servers/b1cceddd-7c8d-4b5a-9814-7eee4f028c2e/action" status: 200 len: 24573 microversion: 2.1 time: 0.083905 Sep 08 11:18:51.404514 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3148/6169] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 11:18:51 2022] POST /compute/v2.1/servers/b1cceddd-7c8d-4b5a-9814-7eee4f028c2e/action => generated 24573 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 11:18:51.555945 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-add8559a-5105-44f0-9d89-6d9de07452ee tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:18:51.556519 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-add8559a-5105-44f0-9d89-6d9de07452ee tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: a13b5e51-8a1d-4cb4-9485-a183b5a20c8d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:18:51.572400 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-add8559a-5105-44f0-9d89-6d9de07452ee tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:18:51.572903 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-add8559a-5105-44f0-9d89-6d9de07452ee tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:18:51.573380 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-add8559a-5105-44f0-9d89-6d9de07452ee tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:18:51.574174 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-add8559a-5105-44f0-9d89-6d9de07452ee tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:18:51.574659 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-add8559a-5105-44f0-9d89-6d9de07452ee tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:18:51.575096 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-add8559a-5105-44f0-9d89-6d9de07452ee tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:18:51.609428 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-add8559a-5105-44f0-9d89-6d9de07452ee tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] HTTP exception thrown: Instance a13b5e51-8a1d-4cb4-9485-a183b5a20c8d could not be found. Sep 08 11:18:51.619680 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-add8559a-5105-44f0-9d89-6d9de07452ee tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Request method failure captured: Sep 08 11:18:51.619680 n-d-850501-12 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d HTTP/1.1 Sep 08 11:18:51.619680 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 11:18:51.619680 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 11:18:51.619680 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 11:18:51.619680 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 11:18:51.619680 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 11:18:51.619680 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 11:18:51.619680 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 11:18:51.619680 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 11:18:51.619680 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGc45zUR61ebW_EzHCMbc6VtgxjxpBxZ1vn5tgJ28f5PYNkUZtw8FaeV_00ITw9X5j_OhMo8wdwdGnvQypZIm7by57nIIuLznoxOH3I_DFxPJc5kV_Mb8xXudQqjS13CJLT0Ff3sasdqmyCun3dDf3vf5N50OTTdpyz93Jie4GOJmzWE Sep 08 11:18:51.619680 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 11:18:51.619680 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 11:18:51.619680 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 11:18:51.619680 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 11:18:51.619680 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 11:18:51.619680 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 11:18:51.619680 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 09dfe795da0e4988a50c38f19200ea7e Sep 08 11:18:51.619680 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-AttachVolumeTestJSON-306053878 Sep 08 11:18:51.619680 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 11:18:51.619680 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 11:18:51.619680 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/09dfe795da0e4988a50c38f19200ea7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/09dfe795da0e4988a50c38f19200ea7e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_09dfe795da0e4988a50c38f19200ea7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/09dfe795da0e4988a50c38f19200ea7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:18:51.619680 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-AttachVolumeTestJSON-306053878 Sep 08 11:18:51.619680 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 09dfe795da0e4988a50c38f19200ea7e Sep 08 11:18:51.619680 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-AttachVolumeTestJSON-306053878 Sep 08 11:18:51.619680 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-AttachVolumeTestJSON-306053878-project Sep 08 11:18:51.619680 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 11:18:51.619680 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 11:18:51.619680 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: d6bdfecc6c7a43608095044b0174b48f Sep 08 11:18:51.619680 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-AttachVolumeTestJSON-306053878-project Sep 08 11:18:51.619680 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 11:18:51.619680 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance a13b5e51-8a1d-4cb4-9485-a183b5a20c8d could not be found. Sep 08 11:18:51.619680 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'a13b5e51-8a1d-4cb4-9485-a183b5a20c8d'} Sep 08 11:18:51.619680 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:18:51.619680 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:18:51.619680 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:18:51.619680 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:18:51.619680 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:18:51.619680 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:18:51.619680 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:18:51.619680 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:18:51.619680 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:18:51.619680 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:18:51.619680 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a13b5e51-8a1d-4cb4-9485-a183b5a20c8d could not be found. Sep 08 11:18:51.619680 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:18:51.619680 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:18:51.619680 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:18:51.619680 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:18:51.619680 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:18:51.619680 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:18:51.619680 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:18:51.619680 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:18:51.619680 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:18:51.619680 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:18:51.619680 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 11:18:51.619680 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 11:18:51.619680 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 11:18:51.619680 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 11:18:51.619680 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:18:51.619680 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:18:51.619680 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:18:51.619680 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:18:51.624370 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a13b5e51-8a1d-4cb4-9485-a183b5a20c8d could not be found. Sep 08 11:18:51.624370 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:18:51.624370 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:18:51.624370 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:18:51.624370 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:18:51.624370 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:18:51.624370 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:18:51.624370 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:18:51.624370 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:18:51.624370 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a13b5e51-8a1d-4cb4-9485-a183b5a20c8d could not be found. Sep 08 11:18:51.624370 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:18:51.626244 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-add8559a-5105-44f0-9d89-6d9de07452ee tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Returning 404 to user: Instance a13b5e51-8a1d-4cb4-9485-a183b5a20c8d could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:18:51.627522 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-add8559a-5105-44f0-9d89-6d9de07452ee tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d" status: 404 len: 111 microversion: 2.1 time: 0.075649 Sep 08 11:18:51.628840 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3022/6170] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:18:51 2022] DELETE /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:18:51.637528 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-74666ee1-d3e7-4e77-8853-10f861534072 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:18:51.638357 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-74666ee1-d3e7-4e77-8853-10f861534072 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] [instance: a13b5e51-8a1d-4cb4-9485-a183b5a20c8d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:18:51.645974 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-74666ee1-d3e7-4e77-8853-10f861534072 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:18:51.646581 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-74666ee1-d3e7-4e77-8853-10f861534072 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:18:51.647147 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-74666ee1-d3e7-4e77-8853-10f861534072 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:18:51.648139 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-74666ee1-d3e7-4e77-8853-10f861534072 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:18:51.648814 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-74666ee1-d3e7-4e77-8853-10f861534072 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:18:51.649482 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-74666ee1-d3e7-4e77-8853-10f861534072 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:18:51.678082 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-74666ee1-d3e7-4e77-8853-10f861534072 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] HTTP exception thrown: Instance a13b5e51-8a1d-4cb4-9485-a183b5a20c8d could not be found. Sep 08 11:18:51.679958 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-74666ee1-d3e7-4e77-8853-10f861534072 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Request method failure captured: Sep 08 11:18:51.679958 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d HTTP/1.1 Sep 08 11:18:51.679958 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:18:51.679958 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:18:51.679958 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:18:51.679958 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 11:18:51.679958 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:18:51.679958 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:18:51.679958 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:18:51.679958 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:18:51.679958 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGc45zUR61ebW_EzHCMbc6VtgxjxpBxZ1vn5tgJ28f5PYNkUZtw8FaeV_00ITw9X5j_OhMo8wdwdGnvQypZIm7by57nIIuLznoxOH3I_DFxPJc5kV_Mb8xXudQqjS13CJLT0Ff3sasdqmyCun3dDf3vf5N50OTTdpyz93Jie4GOJmzWE Sep 08 11:18:51.679958 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:18:51.679958 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:18:51.679958 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:18:51.679958 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:18:51.679958 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:18:51.679958 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:18:51.679958 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 09dfe795da0e4988a50c38f19200ea7e Sep 08 11:18:51.679958 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-AttachVolumeTestJSON-306053878 Sep 08 11:18:51.679958 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:18:51.679958 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:18:51.679958 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/09dfe795da0e4988a50c38f19200ea7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/09dfe795da0e4988a50c38f19200ea7e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_09dfe795da0e4988a50c38f19200ea7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/09dfe795da0e4988a50c38f19200ea7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:18:51.679958 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-AttachVolumeTestJSON-306053878 Sep 08 11:18:51.679958 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 09dfe795da0e4988a50c38f19200ea7e Sep 08 11:18:51.679958 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-AttachVolumeTestJSON-306053878 Sep 08 11:18:51.679958 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-AttachVolumeTestJSON-306053878-project Sep 08 11:18:51.679958 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:18:51.679958 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:18:51.679958 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: d6bdfecc6c7a43608095044b0174b48f Sep 08 11:18:51.679958 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-AttachVolumeTestJSON-306053878-project Sep 08 11:18:51.679958 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 11:18:51.679958 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance a13b5e51-8a1d-4cb4-9485-a183b5a20c8d could not be found. Sep 08 11:18:51.679958 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': 'a13b5e51-8a1d-4cb4-9485-a183b5a20c8d'} Sep 08 11:18:51.679958 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:18:51.679958 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:18:51.679958 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:18:51.679958 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:18:51.679958 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:18:51.679958 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:18:51.679958 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:18:51.679958 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:18:51.679958 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:18:51.679958 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:18:51.679958 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a13b5e51-8a1d-4cb4-9485-a183b5a20c8d could not be found. Sep 08 11:18:51.679958 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:18:51.679958 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:18:51.679958 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:18:51.679958 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:18:51.679958 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:18:51.679958 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:18:51.679958 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:18:51.679958 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:18:51.679958 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:18:51.679958 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:18:51.679958 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:18:51.679958 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:18:51.679958 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:18:51.679958 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:18:51.679958 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:18:51.679958 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:18:51.679958 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a13b5e51-8a1d-4cb4-9485-a183b5a20c8d could not be found. Sep 08 11:18:51.679958 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:18:51.679958 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:18:51.679958 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:18:51.684311 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:18:51.684311 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:18:51.684311 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:18:51.684311 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:18:51.684311 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:18:51.684311 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a13b5e51-8a1d-4cb4-9485-a183b5a20c8d could not be found. Sep 08 11:18:51.684311 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:18:51.684311 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-74666ee1-d3e7-4e77-8853-10f861534072 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] Returning 404 to user: Instance a13b5e51-8a1d-4cb4-9485-a183b5a20c8d could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:18:51.688828 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-74666ee1-d3e7-4e77-8853-10f861534072 tempest-AttachVolumeTestJSON-306053878 tempest-AttachVolumeTestJSON-306053878-project] 10.222.0.27 "GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d" status: 404 len: 111 microversion: 2.1 time: 0.048198 Sep 08 11:18:51.693146 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3149/6171] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:18:51 2022] GET /compute/v2.1/servers/a13b5e51-8a1d-4cb4-9485-a183b5a20c8d => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:18:53.834070 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-141bf2f3-cf0b-46f3-a5be-aa12e3afd1ec tempest-PortsAdminExtendedAttrsTestJSON-1650476084 tempest-PortsAdminExtendedAttrsTestJSON-1650476084-project-admin] Calling method '.version_select at 0x7f68e491b9d0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:18:53.836079 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-141bf2f3-cf0b-46f3-a5be-aa12e3afd1ec tempest-PortsAdminExtendedAttrsTestJSON-1650476084 tempest-PortsAdminExtendedAttrsTestJSON-1650476084-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:18:53.836993 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-141bf2f3-cf0b-46f3-a5be-aa12e3afd1ec tempest-PortsAdminExtendedAttrsTestJSON-1650476084 tempest-PortsAdminExtendedAttrsTestJSON-1650476084-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:18:53.837532 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-141bf2f3-cf0b-46f3-a5be-aa12e3afd1ec tempest-PortsAdminExtendedAttrsTestJSON-1650476084 tempest-PortsAdminExtendedAttrsTestJSON-1650476084-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:18:53.879460 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-141bf2f3-cf0b-46f3-a5be-aa12e3afd1ec tempest-PortsAdminExtendedAttrsTestJSON-1650476084 tempest-PortsAdminExtendedAttrsTestJSON-1650476084-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:18:53.880078 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-141bf2f3-cf0b-46f3-a5be-aa12e3afd1ec tempest-PortsAdminExtendedAttrsTestJSON-1650476084 tempest-PortsAdminExtendedAttrsTestJSON-1650476084-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:18:53.880755 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-141bf2f3-cf0b-46f3-a5be-aa12e3afd1ec tempest-PortsAdminExtendedAttrsTestJSON-1650476084 tempest-PortsAdminExtendedAttrsTestJSON-1650476084-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:18:53.906483 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-141bf2f3-cf0b-46f3-a5be-aa12e3afd1ec tempest-PortsAdminExtendedAttrsTestJSON-1650476084 tempest-PortsAdminExtendedAttrsTestJSON-1650476084-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:18:53.907208 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-141bf2f3-cf0b-46f3-a5be-aa12e3afd1ec tempest-PortsAdminExtendedAttrsTestJSON-1650476084 tempest-PortsAdminExtendedAttrsTestJSON-1650476084-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:18:53.907864 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-141bf2f3-cf0b-46f3-a5be-aa12e3afd1ec tempest-PortsAdminExtendedAttrsTestJSON-1650476084 tempest-PortsAdminExtendedAttrsTestJSON-1650476084-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:18:53.915108 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-141bf2f3-cf0b-46f3-a5be-aa12e3afd1ec tempest-PortsAdminExtendedAttrsTestJSON-1650476084 tempest-PortsAdminExtendedAttrsTestJSON-1650476084-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.360752 Sep 08 11:18:53.917177 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3023/6172] 10.222.0.27 () {58 vars in 1146 bytes} [Thu Sep 8 11:18:53 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:18:59.787682 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-69192812-401d-4474-9eb6-ace6b6cbf1ee tempest-VolumesSnapshotsTestJSON-345478965 tempest-VolumesSnapshotsTestJSON-345478965-project] Action: 'create', calling method: .version_select at 0x7f68df16d820>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1387685563"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:19:00.312278 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-69192812-401d-4474-9eb6-ace6b6cbf1ee tempest-VolumesSnapshotsTestJSON-345478965 tempest-VolumesSnapshotsTestJSON-345478965-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.687496 Sep 08 11:19:00.312684 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3150/6173] 10.222.0.27 () {60 vars in 1155 bytes} [Thu Sep 8 11:18:59 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 689 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 08 11:19:00.329568 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d5e6fe13-7830-4905-97b8-e7f895f09b49 tempest-VolumesSnapshotsTestJSON-345478965 tempest-VolumesSnapshotsTestJSON-345478965-project] Calling method '.version_select at 0x7f68e8aace50>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:19:00.431769 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d5e6fe13-7830-4905-97b8-e7f895f09b49 tempest-VolumesSnapshotsTestJSON-345478965 tempest-VolumesSnapshotsTestJSON-345478965-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/ceea62b1-2ba4-48f2-a6a3-4f903bf6773b" status: 200 len: 345 microversion: 2.1 time: 0.106734 Sep 08 11:19:00.432346 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3024/6174] 10.222.0.27 () {58 vars in 1245 bytes} [Thu Sep 8 11:19:00 2022] GET /compute/v2.1/os-volumes/ceea62b1-2ba4-48f2-a6a3-4f903bf6773b => generated 345 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:19:01.447321 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-847612df-2829-4f4c-a298-5d09a9a98496 tempest-VolumesSnapshotsTestJSON-345478965 tempest-VolumesSnapshotsTestJSON-345478965-project] Calling method '.version_select at 0x7f68df20fee0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:19:01.536596 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-847612df-2829-4f4c-a298-5d09a9a98496 tempest-VolumesSnapshotsTestJSON-345478965 tempest-VolumesSnapshotsTestJSON-345478965-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/ceea62b1-2ba4-48f2-a6a3-4f903bf6773b" status: 200 len: 346 microversion: 2.1 time: 0.093520 Sep 08 11:19:01.539147 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3151/6175] 10.222.0.27 () {58 vars in 1245 bytes} [Thu Sep 8 11:19:01 2022] GET /compute/v2.1/os-volumes/ceea62b1-2ba4-48f2-a6a3-4f903bf6773b => generated 346 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:19:01.554526 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-31089098-93e9-4d42-afc3-229795f81b10 tempest-VolumesSnapshotsTestJSON-345478965 tempest-VolumesSnapshotsTestJSON-345478965-project] Action: 'create', calling method: .version_select at 0x7f68e8a588b0>, body: {"snapshot": {"volume_id": "ceea62b1-2ba4-48f2-a6a3-4f903bf6773b", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1025026594"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:19:01.842895 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-31089098-93e9-4d42-afc3-229795f81b10 tempest-VolumesSnapshotsTestJSON-345478965 tempest-VolumesSnapshotsTestJSON-345478965-project] 10.222.0.27 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.290732 Sep 08 11:19:01.843690 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3025/6176] 10.222.0.27 () {60 vars in 1162 bytes} [Thu Sep 8 11:19:01 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:19:01.852111 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=6 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:19:01.852983 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=8 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:19:01.859531 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7043a41d-47c1-4b0e-900a-196275ffaf03 tempest-VolumesSnapshotsTestJSON-345478965 tempest-VolumesSnapshotsTestJSON-345478965-project] Calling method '.version_select at 0x7f68df22cee0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:19:01.915192 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7043a41d-47c1-4b0e-900a-196275ffaf03 tempest-VolumesSnapshotsTestJSON-345478965 tempest-VolumesSnapshotsTestJSON-345478965-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/5c2f8def-24c2-4e62-80ee-e0bc0b95a76a" status: 200 len: 287 microversion: 2.1 time: 0.056837 Sep 08 11:19:01.922847 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3152/6177] 10.222.0.27 () {58 vars in 1251 bytes} [Thu Sep 8 11:19:01 2022] GET /compute/v2.1/os-snapshots/5c2f8def-24c2-4e62-80ee-e0bc0b95a76a => generated 287 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:19:01.929155 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-971f8037-c5b1-48a4-adc1-0c1729f208c1 tempest-VolumesSnapshotsTestJSON-345478965 tempest-VolumesSnapshotsTestJSON-345478965-project] Calling method '.version_select at 0x7f68e57c8160>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:19:01.979083 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-971f8037-c5b1-48a4-adc1-0c1729f208c1 tempest-VolumesSnapshotsTestJSON-345478965 tempest-VolumesSnapshotsTestJSON-345478965-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.053997 Sep 08 11:19:01.981243 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3026/6178] 10.222.0.27 () {58 vars in 1140 bytes} [Thu Sep 8 11:19:01 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:19:02.005876 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-45fdc776-44c3-4dae-a23e-2529c844f3b3 tempest-VolumesSnapshotsTestJSON-345478965 tempest-VolumesSnapshotsTestJSON-345478965-project] Calling method '.version_select at 0x7f68df2f7430>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:19:02.055214 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-45fdc776-44c3-4dae-a23e-2529c844f3b3 tempest-VolumesSnapshotsTestJSON-345478965 tempest-VolumesSnapshotsTestJSON-345478965-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/5c2f8def-24c2-4e62-80ee-e0bc0b95a76a" status: 200 len: 287 microversion: 2.1 time: 0.065821 Sep 08 11:19:02.056007 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3153/6179] 10.222.0.27 () {58 vars in 1251 bytes} [Thu Sep 8 11:19:01 2022] GET /compute/v2.1/os-snapshots/5c2f8def-24c2-4e62-80ee-e0bc0b95a76a => generated 287 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:19:02.454222 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cec788e9-f32e-4b47-a2c1-b37f05e0e713 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:19:02.454879 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cec788e9-f32e-4b47-a2c1-b37f05e0e713 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: b1cceddd-7c8d-4b5a-9814-7eee4f028c2e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:19:02.461798 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cec788e9-f32e-4b47-a2c1-b37f05e0e713 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:02.462303 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cec788e9-f32e-4b47-a2c1-b37f05e0e713 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:02.462988 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cec788e9-f32e-4b47-a2c1-b37f05e0e713 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:02.463906 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cec788e9-f32e-4b47-a2c1-b37f05e0e713 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:02.464640 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cec788e9-f32e-4b47-a2c1-b37f05e0e713 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:02.465605 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cec788e9-f32e-4b47-a2c1-b37f05e0e713 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:02.698335 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cec788e9-f32e-4b47-a2c1-b37f05e0e713 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:19:02.737810 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cec788e9-f32e-4b47-a2c1-b37f05e0e713 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/b1cceddd-7c8d-4b5a-9814-7eee4f028c2e" status: 200 len: 1681 microversion: 2.1 time: 0.286404 Sep 08 11:19:02.742538 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3027/6180] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:19:02 2022] GET /compute/v2.1/servers/b1cceddd-7c8d-4b5a-9814-7eee4f028c2e => generated 1681 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:19:02.906434 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4ec29311-b2e1-40fd-933d-6834d4f62d4c tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:19:02.910602 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4ec29311-b2e1-40fd-933d-6834d4f62d4c tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: b1cceddd-7c8d-4b5a-9814-7eee4f028c2e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:19:02.945865 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ec29311-b2e1-40fd-933d-6834d4f62d4c tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:02.946465 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ec29311-b2e1-40fd-933d-6834d4f62d4c tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:02.947186 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ec29311-b2e1-40fd-933d-6834d4f62d4c tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:02.947972 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ec29311-b2e1-40fd-933d-6834d4f62d4c tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:02.949451 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ec29311-b2e1-40fd-933d-6834d4f62d4c tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:02.950130 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ec29311-b2e1-40fd-933d-6834d4f62d4c tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:03.015988 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4ec29311-b2e1-40fd-933d-6834d4f62d4c tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "POST /compute/v2.1/servers/b1cceddd-7c8d-4b5a-9814-7eee4f028c2e/action" status: 200 len: 32639 microversion: 2.1 time: 0.118098 Sep 08 11:19:03.024398 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3154/6181] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 11:19:02 2022] POST /compute/v2.1/servers/b1cceddd-7c8d-4b5a-9814-7eee4f028c2e/action => generated 32639 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 11:19:03.069464 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a109ac76-9406-4766-b359-2b6eb67ca1d8 tempest-VolumesSnapshotsTestJSON-345478965 tempest-VolumesSnapshotsTestJSON-345478965-project] Calling method '.version_select at 0x7f68e4039a60>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:19:03.130763 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a109ac76-9406-4766-b359-2b6eb67ca1d8 tempest-VolumesSnapshotsTestJSON-345478965 tempest-VolumesSnapshotsTestJSON-345478965-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/5c2f8def-24c2-4e62-80ee-e0bc0b95a76a" status: 200 len: 287 microversion: 2.1 time: 0.066201 Sep 08 11:19:03.131320 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3028/6182] 10.222.0.27 () {58 vars in 1251 bytes} [Thu Sep 8 11:19:03 2022] GET /compute/v2.1/os-snapshots/5c2f8def-24c2-4e62-80ee-e0bc0b95a76a => generated 287 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:19:03.163329 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0f939a06-298e-40e3-a81a-d728127b7856 tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:19:03.164071 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0f939a06-298e-40e3-a81a-d728127b7856 tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] [instance: b1cceddd-7c8d-4b5a-9814-7eee4f028c2e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:19:03.175234 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0f939a06-298e-40e3-a81a-d728127b7856 tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:03.178080 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0f939a06-298e-40e3-a81a-d728127b7856 tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:03.178554 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0f939a06-298e-40e3-a81a-d728127b7856 tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:03.181387 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0f939a06-298e-40e3-a81a-d728127b7856 tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:03.182073 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0f939a06-298e-40e3-a81a-d728127b7856 tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:03.182526 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0f939a06-298e-40e3-a81a-d728127b7856 tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:03.409882 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0f939a06-298e-40e3-a81a-d728127b7856 tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/b1cceddd-7c8d-4b5a-9814-7eee4f028c2e" status: 200 len: 1834 microversion: 2.1 time: 0.251253 Sep 08 11:19:03.411087 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3155/6183] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:19:03 2022] GET /compute/v2.1/servers/b1cceddd-7c8d-4b5a-9814-7eee4f028c2e => generated 1834 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:19:03.463684 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-de34bea3-aa1a-48c9-9c14-0a856228b229 tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:19:03.468322 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-de34bea3-aa1a-48c9-9c14-0a856228b229 tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] [instance: b1cceddd-7c8d-4b5a-9814-7eee4f028c2e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:19:03.477985 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de34bea3-aa1a-48c9-9c14-0a856228b229 tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:03.478868 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de34bea3-aa1a-48c9-9c14-0a856228b229 tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:03.479397 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de34bea3-aa1a-48c9-9c14-0a856228b229 tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:03.480611 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de34bea3-aa1a-48c9-9c14-0a856228b229 tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:03.481475 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de34bea3-aa1a-48c9-9c14-0a856228b229 tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:03.482100 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de34bea3-aa1a-48c9-9c14-0a856228b229 tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:03.515175 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-de34bea3-aa1a-48c9-9c14-0a856228b229 tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] Lazy-loading 'flavor' on Instance uuid b1cceddd-7c8d-4b5a-9814-7eee4f028c2e {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:19:03.531807 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-de34bea3-aa1a-48c9-9c14-0a856228b229 tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] [instance: b1cceddd-7c8d-4b5a-9814-7eee4f028c2e] Going to try to live migrate instance to another host {{(pid=128862) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 08 11:19:04.145485 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e1c8bced-ab89-462f-8878-ff3898ad759a tempest-VolumesSnapshotsTestJSON-345478965 tempest-VolumesSnapshotsTestJSON-345478965-project] Calling method '.version_select at 0x7f68df316790>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:19:04.197387 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e1c8bced-ab89-462f-8878-ff3898ad759a tempest-VolumesSnapshotsTestJSON-345478965 tempest-VolumesSnapshotsTestJSON-345478965-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/5c2f8def-24c2-4e62-80ee-e0bc0b95a76a" status: 200 len: 288 microversion: 2.1 time: 0.057010 Sep 08 11:19:04.197941 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3156/6184] 10.222.0.27 () {58 vars in 1251 bytes} [Thu Sep 8 11:19:04 2022] GET /compute/v2.1/os-snapshots/5c2f8def-24c2-4e62-80ee-e0bc0b95a76a => generated 288 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:19:04.216943 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9c7b2a70-50ae-4eb4-902d-a5531e18b8e6 tempest-VolumesSnapshotsTestJSON-345478965 tempest-VolumesSnapshotsTestJSON-345478965-project] Calling method '.version_select at 0x7f68df1ab0d0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:19:04.359255 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9c7b2a70-50ae-4eb4-902d-a5531e18b8e6 tempest-VolumesSnapshotsTestJSON-345478965 tempest-VolumesSnapshotsTestJSON-345478965-project] 10.222.0.27 "DELETE /compute/v2.1/os-snapshots/5c2f8def-24c2-4e62-80ee-e0bc0b95a76a" status: 202 len: 0 microversion: 2.1 time: 0.153501 Sep 08 11:19:04.360523 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3157/6185] 10.222.0.27 () {58 vars in 1254 bytes} [Thu Sep 8 11:19:04 2022] DELETE /compute/v2.1/os-snapshots/5c2f8def-24c2-4e62-80ee-e0bc0b95a76a => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 11:19:04.377659 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-dc0db491-8c42-4fd1-90a3-fab252a53920 tempest-VolumesSnapshotsTestJSON-345478965 tempest-VolumesSnapshotsTestJSON-345478965-project] Calling method '.version_select at 0x7f68df316ca0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:19:04.458549 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-dc0db491-8c42-4fd1-90a3-fab252a53920 tempest-VolumesSnapshotsTestJSON-345478965 tempest-VolumesSnapshotsTestJSON-345478965-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/5c2f8def-24c2-4e62-80ee-e0bc0b95a76a" status: 200 len: 287 microversion: 2.1 time: 0.091479 Sep 08 11:19:04.461984 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3158/6186] 10.222.0.27 () {58 vars in 1251 bytes} [Thu Sep 8 11:19:04 2022] GET /compute/v2.1/os-snapshots/5c2f8def-24c2-4e62-80ee-e0bc0b95a76a => generated 287 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:19:05.474954 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-de23deb4-f75d-4aec-9176-17072813c637 tempest-VolumesSnapshotsTestJSON-345478965 tempest-VolumesSnapshotsTestJSON-345478965-project] Calling method '.version_select at 0x7f68df166670>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:19:05.537917 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-de23deb4-f75d-4aec-9176-17072813c637 tempest-VolumesSnapshotsTestJSON-345478965 tempest-VolumesSnapshotsTestJSON-345478965-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/5c2f8def-24c2-4e62-80ee-e0bc0b95a76a" status: 200 len: 287 microversion: 2.1 time: 0.067166 Sep 08 11:19:05.538896 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3159/6187] 10.222.0.27 () {58 vars in 1251 bytes} [Thu Sep 8 11:19:05 2022] GET /compute/v2.1/os-snapshots/5c2f8def-24c2-4e62-80ee-e0bc0b95a76a => generated 287 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:19:06.552967 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-52c053b5-8678-4494-b00c-f03785fafa45 tempest-VolumesSnapshotsTestJSON-345478965 tempest-VolumesSnapshotsTestJSON-345478965-project] Calling method '.version_select at 0x7f68df22c670>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:19:06.597518 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-52c053b5-8678-4494-b00c-f03785fafa45 tempest-VolumesSnapshotsTestJSON-345478965 tempest-VolumesSnapshotsTestJSON-345478965-project] HTTP exception thrown: Snapshot 5c2f8def-24c2-4e62-80ee-e0bc0b95a76a could not be found. Sep 08 11:19:06.616272 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-52c053b5-8678-4494-b00c-f03785fafa45 tempest-VolumesSnapshotsTestJSON-345478965 tempest-VolumesSnapshotsTestJSON-345478965-project] Request method failure captured: Sep 08 11:19:06.616272 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/os-snapshots/5c2f8def-24c2-4e62-80ee-e0bc0b95a76a HTTP/1.1 Sep 08 11:19:06.616272 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:19:06.616272 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:19:06.616272 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:19:06.616272 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 11:19:06.616272 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:19:06.616272 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:19:06.616272 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:19:06.616272 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:19:06.616272 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGc-jVVtwiq4kKya4hTRHx1-pS-qU5qt6fJPmp1c6tkpwOdJnMZ_G6INuRWjqP9H9EYWTIiINpgODqUSerB2-W7lrEtAmaFp_j1fsWr3P7ir4dfH-t1HEl13tUmbc3pdzuYj0kP0tK4QUhKjwXuEuCg8XA0VJI7gPNS8MyoPazGgamjA Sep 08 11:19:06.616272 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:19:06.616272 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:19:06.616272 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:19:06.616272 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:19:06.616272 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:19:06.616272 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:19:06.616272 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 95cd4870a313405cb232c1833e33cd40 Sep 08 11:19:06.616272 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-345478965 Sep 08 11:19:06.616272 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:19:06.616272 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:19:06.616272 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/95cd4870a313405cb232c1833e33cd40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/95cd4870a313405cb232c1833e33cd40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_95cd4870a313405cb232c1833e33cd40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/95cd4870a313405cb232c1833e33cd40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:19:06.616272 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-VolumesSnapshotsTestJSON-345478965 Sep 08 11:19:06.616272 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 95cd4870a313405cb232c1833e33cd40 Sep 08 11:19:06.616272 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-345478965 Sep 08 11:19:06.616272 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-VolumesSnapshotsTestJSON-345478965-project Sep 08 11:19:06.616272 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:19:06.616272 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:19:06.616272 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 39c5a7c2ed244c9896239ab0bf2a8777 Sep 08 11:19:06.616272 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-VolumesSnapshotsTestJSON-345478965-project Sep 08 11:19:06.616272 n-d-850501-12 devstack@n-api.service[128861]: method: Sep 08 11:19:06.616272 n-d-850501-12 devstack@n-api.service[128861]: exception: Snapshot 5c2f8def-24c2-4e62-80ee-e0bc0b95a76a could not be found. Sep 08 11:19:06.616272 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '5c2f8def-24c2-4e62-80ee-e0bc0b95a76a'} Sep 08 11:19:06.616272 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:19:06.616272 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:19:06.616272 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 08 11:19:06.616272 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 08 11:19:06.616272 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 08 11:19:06.616272 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 08 11:19:06.616272 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 08 11:19:06.616272 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 08 11:19:06.616272 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 11:19:06.616272 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 11:19:06.616272 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 11:19:06.616272 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 11:19:06.616272 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 11:19:06.616272 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 11:19:06.616272 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 11:19:06.616272 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 11:19:06.616272 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 5c2f8def-24c2-4e62-80ee-e0bc0b95a76a could not be found. (HTTP 404) (Request-ID: req-fc85327a-477d-4c86-ba94-ab2ca5bed2f0) Sep 08 11:19:06.616272 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:19:06.616272 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:19:06.616272 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:19:06.616272 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:19:06.616272 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 08 11:19:06.616272 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 08 11:19:06.616272 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 08 11:19:06.616272 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 08 11:19:06.616272 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 08 11:19:06.616272 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 08 11:19:06.616272 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 08 11:19:06.616272 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 08 11:19:06.623102 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 08 11:19:06.623102 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 08 11:19:06.623102 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 08 11:19:06.623102 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 08 11:19:06.623102 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 08 11:19:06.623102 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 08 11:19:06.623102 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 11:19:06.623102 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 11:19:06.623102 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 11:19:06.623102 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 11:19:06.623102 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 11:19:06.623102 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 11:19:06.623102 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 11:19:06.623102 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 11:19:06.623102 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 5c2f8def-24c2-4e62-80ee-e0bc0b95a76a could not be found. Sep 08 11:19:06.623102 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:19:06.623102 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:19:06.623102 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:19:06.623102 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:19:06.623102 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:19:06.623102 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:19:06.623102 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:19:06.623102 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:19:06.623102 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 11:19:06.623102 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 11:19:06.623102 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:19:06.623102 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:19:06.623102 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 08 11:19:06.623102 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:19:06.623102 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 5c2f8def-24c2-4e62-80ee-e0bc0b95a76a could not be found. Sep 08 11:19:06.623102 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:19:06.623102 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:19:06.623102 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:19:06.623102 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:19:06.623102 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:19:06.623102 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:19:06.623102 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:19:06.623102 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:19:06.623102 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 5c2f8def-24c2-4e62-80ee-e0bc0b95a76a could not be found. Sep 08 11:19:06.623102 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:19:06.623102 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-52c053b5-8678-4494-b00c-f03785fafa45 tempest-VolumesSnapshotsTestJSON-345478965 tempest-VolumesSnapshotsTestJSON-345478965-project] Returning 404 to user: Snapshot 5c2f8def-24c2-4e62-80ee-e0bc0b95a76a could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:19:06.627989 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-52c053b5-8678-4494-b00c-f03785fafa45 tempest-VolumesSnapshotsTestJSON-345478965 tempest-VolumesSnapshotsTestJSON-345478965-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/5c2f8def-24c2-4e62-80ee-e0bc0b95a76a" status: 404 len: 111 microversion: 2.1 time: 0.074340 Sep 08 11:19:06.632143 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3160/6188] 10.222.0.27 () {58 vars in 1251 bytes} [Thu Sep 8 11:19:06 2022] GET /compute/v2.1/os-snapshots/5c2f8def-24c2-4e62-80ee-e0bc0b95a76a => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 11:19:06.651530 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-414f8a02-f362-480e-a04c-fd07b5c13393 tempest-VolumesSnapshotsTestJSON-345478965 tempest-VolumesSnapshotsTestJSON-345478965-project] Calling method '.version_select at 0x7f68e4923160>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:19:06.844913 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-414f8a02-f362-480e-a04c-fd07b5c13393 tempest-VolumesSnapshotsTestJSON-345478965 tempest-VolumesSnapshotsTestJSON-345478965-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/ceea62b1-2ba4-48f2-a6a3-4f903bf6773b" status: 202 len: 0 microversion: 2.1 time: 0.210963 Sep 08 11:19:06.845801 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3161/6189] 10.222.0.27 () {58 vars in 1248 bytes} [Thu Sep 8 11:19:06 2022] DELETE /compute/v2.1/os-volumes/ceea62b1-2ba4-48f2-a6a3-4f903bf6773b => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:19:06.854495 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8f0452e2-ec85-4535-9ff2-cd07bfb930d0 tempest-VolumesSnapshotsTestJSON-345478965 tempest-VolumesSnapshotsTestJSON-345478965-project] Calling method '.version_select at 0x7f68df4e4670>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:19:06.975509 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8f0452e2-ec85-4535-9ff2-cd07bfb930d0 tempest-VolumesSnapshotsTestJSON-345478965 tempest-VolumesSnapshotsTestJSON-345478965-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/ceea62b1-2ba4-48f2-a6a3-4f903bf6773b" status: 200 len: 345 microversion: 2.1 time: 0.124780 Sep 08 11:19:06.978652 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3162/6190] 10.222.0.27 () {58 vars in 1245 bytes} [Thu Sep 8 11:19:06 2022] GET /compute/v2.1/os-volumes/ceea62b1-2ba4-48f2-a6a3-4f903bf6773b => generated 345 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:19:06.993444 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-de34bea3-aa1a-48c9-9c14-0a856228b229 tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/b1cceddd-7c8d-4b5a-9814-7eee4f028c2e/action" status: 202 len: 0 microversion: 2.1 time: 3.534081 Sep 08 11:19:07.000679 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3029/6191] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 11:19:03 2022] POST /compute/v2.1/servers/b1cceddd-7c8d-4b5a-9814-7eee4f028c2e/action => generated 0 bytes in 3542 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:19:07.011457 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f0f2ac3e-5c41-45c8-9e5b-0b296d65b521 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:19:07.013855 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f0f2ac3e-5c41-45c8-9e5b-0b296d65b521 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: b1cceddd-7c8d-4b5a-9814-7eee4f028c2e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:19:07.025786 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f0f2ac3e-5c41-45c8-9e5b-0b296d65b521 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:07.027419 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f0f2ac3e-5c41-45c8-9e5b-0b296d65b521 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:07.030007 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f0f2ac3e-5c41-45c8-9e5b-0b296d65b521 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:07.031136 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f0f2ac3e-5c41-45c8-9e5b-0b296d65b521 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:07.042286 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f0f2ac3e-5c41-45c8-9e5b-0b296d65b521 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:07.049965 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f0f2ac3e-5c41-45c8-9e5b-0b296d65b521 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:07.407901 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f0f2ac3e-5c41-45c8-9e5b-0b296d65b521 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:19:07.416255 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f0f2ac3e-5c41-45c8-9e5b-0b296d65b521 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/b1cceddd-7c8d-4b5a-9814-7eee4f028c2e" status: 200 len: 1691 microversion: 2.1 time: 0.410305 Sep 08 11:19:07.419682 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3163/6192] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:19:07 2022] GET /compute/v2.1/servers/b1cceddd-7c8d-4b5a-9814-7eee4f028c2e => generated 1691 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:19:07.996540 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-38141ed7-5693-43d9-9bc8-65b2148c1d7e tempest-VolumesSnapshotsTestJSON-345478965 tempest-VolumesSnapshotsTestJSON-345478965-project] Calling method '.version_select at 0x7f68e8a58700>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:19:08.085665 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-38141ed7-5693-43d9-9bc8-65b2148c1d7e tempest-VolumesSnapshotsTestJSON-345478965 tempest-VolumesSnapshotsTestJSON-345478965-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/ceea62b1-2ba4-48f2-a6a3-4f903bf6773b" status: 200 len: 345 microversion: 2.1 time: 0.096523 Sep 08 11:19:08.086250 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3030/6193] 10.222.0.27 () {58 vars in 1245 bytes} [Thu Sep 8 11:19:07 2022] GET /compute/v2.1/os-volumes/ceea62b1-2ba4-48f2-a6a3-4f903bf6773b => generated 345 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:19:08.450513 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1c98603d-1bef-4264-841a-f8150b41a6ec tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:19:08.451188 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1c98603d-1bef-4264-841a-f8150b41a6ec tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: b1cceddd-7c8d-4b5a-9814-7eee4f028c2e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:19:08.458536 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1c98603d-1bef-4264-841a-f8150b41a6ec tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:08.460825 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1c98603d-1bef-4264-841a-f8150b41a6ec tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:08.461335 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1c98603d-1bef-4264-841a-f8150b41a6ec tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:08.462102 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1c98603d-1bef-4264-841a-f8150b41a6ec tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:08.462730 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1c98603d-1bef-4264-841a-f8150b41a6ec tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:08.463172 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1c98603d-1bef-4264-841a-f8150b41a6ec tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:08.826324 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1c98603d-1bef-4264-841a-f8150b41a6ec tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:19:08.836831 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1c98603d-1bef-4264-841a-f8150b41a6ec tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/b1cceddd-7c8d-4b5a-9814-7eee4f028c2e" status: 200 len: 1691 microversion: 2.1 time: 0.391351 Sep 08 11:19:08.838230 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3164/6194] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:19:08 2022] GET /compute/v2.1/servers/b1cceddd-7c8d-4b5a-9814-7eee4f028c2e => generated 1691 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:19:09.103305 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-88dbe7c1-d1e1-44b9-a32f-315541ecfc28 tempest-VolumesSnapshotsTestJSON-345478965 tempest-VolumesSnapshotsTestJSON-345478965-project] Calling method '.version_select at 0x7f68e4039940>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:19:09.238801 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-88dbe7c1-d1e1-44b9-a32f-315541ecfc28 tempest-VolumesSnapshotsTestJSON-345478965 tempest-VolumesSnapshotsTestJSON-345478965-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/ceea62b1-2ba4-48f2-a6a3-4f903bf6773b" status: 200 len: 345 microversion: 2.1 time: 0.141434 Sep 08 11:19:09.239375 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3031/6195] 10.222.0.27 () {58 vars in 1245 bytes} [Thu Sep 8 11:19:09 2022] GET /compute/v2.1/os-volumes/ceea62b1-2ba4-48f2-a6a3-4f903bf6773b => generated 345 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:19:09.520609 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-ee938a6e-61f0-4eff-a26e-9e4a7e6c1001 req-19b33be9-d7f1-4a07-821d-3e3d956f4c66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1cceddd-7c8d-4b5a-9814-7eee4f028c2e", "name": "network-vif-unplugged", "status": "completed", "tag": "8008ff5e-612f-433f-b5c9-d52c4ac5df08"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:19:09.559810 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-ee938a6e-61f0-4eff-a26e-9e4a7e6c1001 req-19b33be9-d7f1-4a07-821d-3e3d956f4c66 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:09.567369 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-ee938a6e-61f0-4eff-a26e-9e4a7e6c1001 req-19b33be9-d7f1-4a07-821d-3e3d956f4c66 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:09.567841 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-ee938a6e-61f0-4eff-a26e-9e4a7e6c1001 req-19b33be9-d7f1-4a07-821d-3e3d956f4c66 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:09.605314 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-ee938a6e-61f0-4eff-a26e-9e4a7e6c1001 req-19b33be9-d7f1-4a07-821d-3e3d956f4c66 service nova] Creating event network-vif-unplugged:8008ff5e-612f-433f-b5c9-d52c4ac5df08 for instance b1cceddd-7c8d-4b5a-9814-7eee4f028c2e on n-h2-850501-12 Sep 08 11:19:09.624139 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-ee938a6e-61f0-4eff-a26e-9e4a7e6c1001 req-19b33be9-d7f1-4a07-821d-3e3d956f4c66 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.107008 Sep 08 11:19:09.629187 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3165/6196] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:19:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:19:09.875579 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-845b7018-0fbe-47f2-bd99-0a5d255faffa tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:19:09.876354 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-845b7018-0fbe-47f2-bd99-0a5d255faffa tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: b1cceddd-7c8d-4b5a-9814-7eee4f028c2e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:19:09.900666 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-845b7018-0fbe-47f2-bd99-0a5d255faffa tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:09.901231 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-845b7018-0fbe-47f2-bd99-0a5d255faffa tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:09.901920 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-845b7018-0fbe-47f2-bd99-0a5d255faffa tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:09.902929 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-845b7018-0fbe-47f2-bd99-0a5d255faffa tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:09.903646 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-845b7018-0fbe-47f2-bd99-0a5d255faffa tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:09.904248 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-845b7018-0fbe-47f2-bd99-0a5d255faffa tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:10.253992 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-03eb5f25-876a-4988-affb-9d1feac31f4c tempest-VolumesSnapshotsTestJSON-345478965 tempest-VolumesSnapshotsTestJSON-345478965-project] Calling method '.version_select at 0x7f68df16ddc0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:19:10.392320 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-03eb5f25-876a-4988-affb-9d1feac31f4c tempest-VolumesSnapshotsTestJSON-345478965 tempest-VolumesSnapshotsTestJSON-345478965-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/ceea62b1-2ba4-48f2-a6a3-4f903bf6773b" status: 200 len: 345 microversion: 2.1 time: 0.142534 Sep 08 11:19:10.393652 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3166/6197] 10.222.0.27 () {58 vars in 1245 bytes} [Thu Sep 8 11:19:10 2022] GET /compute/v2.1/os-volumes/ceea62b1-2ba4-48f2-a6a3-4f903bf6773b => generated 345 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:19:10.554720 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-845b7018-0fbe-47f2-bd99-0a5d255faffa tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:19:10.564550 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-845b7018-0fbe-47f2-bd99-0a5d255faffa tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/b1cceddd-7c8d-4b5a-9814-7eee4f028c2e" status: 200 len: 1691 microversion: 2.1 time: 0.694348 Sep 08 11:19:10.568731 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3032/6198] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:19:09 2022] GET /compute/v2.1/servers/b1cceddd-7c8d-4b5a-9814-7eee4f028c2e => generated 1691 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:19:11.408449 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-27453833-b0bd-4125-babb-982b4f30c12a tempest-VolumesSnapshotsTestJSON-345478965 tempest-VolumesSnapshotsTestJSON-345478965-project] Calling method '.version_select at 0x7f68df1b7940>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:19:11.463124 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-27453833-b0bd-4125-babb-982b4f30c12a tempest-VolumesSnapshotsTestJSON-345478965 tempest-VolumesSnapshotsTestJSON-345478965-project] HTTP exception thrown: Volume ceea62b1-2ba4-48f2-a6a3-4f903bf6773b could not be found. Sep 08 11:19:11.465522 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-27453833-b0bd-4125-babb-982b4f30c12a tempest-VolumesSnapshotsTestJSON-345478965 tempest-VolumesSnapshotsTestJSON-345478965-project] Request method failure captured: Sep 08 11:19:11.465522 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/os-volumes/ceea62b1-2ba4-48f2-a6a3-4f903bf6773b HTTP/1.1 Sep 08 11:19:11.465522 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:19:11.465522 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:19:11.465522 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:19:11.465522 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 11:19:11.465522 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:19:11.465522 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:19:11.465522 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:19:11.465522 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:19:11.465522 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGc-jVVtwiq4kKya4hTRHx1-pS-qU5qt6fJPmp1c6tkpwOdJnMZ_G6INuRWjqP9H9EYWTIiINpgODqUSerB2-W7lrEtAmaFp_j1fsWr3P7ir4dfH-t1HEl13tUmbc3pdzuYj0kP0tK4QUhKjwXuEuCg8XA0VJI7gPNS8MyoPazGgamjA Sep 08 11:19:11.465522 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:19:11.465522 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:19:11.465522 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:19:11.465522 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:19:11.465522 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:19:11.465522 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:19:11.465522 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 95cd4870a313405cb232c1833e33cd40 Sep 08 11:19:11.465522 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-345478965 Sep 08 11:19:11.465522 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:19:11.465522 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:19:11.465522 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/95cd4870a313405cb232c1833e33cd40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/95cd4870a313405cb232c1833e33cd40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_95cd4870a313405cb232c1833e33cd40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/95cd4870a313405cb232c1833e33cd40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:19:11.465522 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-VolumesSnapshotsTestJSON-345478965 Sep 08 11:19:11.465522 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 95cd4870a313405cb232c1833e33cd40 Sep 08 11:19:11.465522 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-345478965 Sep 08 11:19:11.465522 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-VolumesSnapshotsTestJSON-345478965-project Sep 08 11:19:11.465522 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:19:11.465522 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:19:11.465522 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 39c5a7c2ed244c9896239ab0bf2a8777 Sep 08 11:19:11.465522 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-VolumesSnapshotsTestJSON-345478965-project Sep 08 11:19:11.465522 n-d-850501-12 devstack@n-api.service[128861]: method: Sep 08 11:19:11.465522 n-d-850501-12 devstack@n-api.service[128861]: exception: Volume ceea62b1-2ba4-48f2-a6a3-4f903bf6773b could not be found. Sep 08 11:19:11.465522 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': 'ceea62b1-2ba4-48f2-a6a3-4f903bf6773b'} Sep 08 11:19:11.465522 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:19:11.465522 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:19:11.465522 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 11:19:11.465522 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 11:19:11.465522 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 11:19:11.465522 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 11:19:11.465522 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 11:19:11.465522 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 11:19:11.465522 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 11:19:11.465522 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 11:19:11.465522 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 11:19:11.465522 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 11:19:11.465522 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 11:19:11.465522 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 11:19:11.465522 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 11:19:11.465522 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 11:19:11.465522 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ceea62b1-2ba4-48f2-a6a3-4f903bf6773b could not be found. (HTTP 404) (Request-ID: req-31bebac8-3ba6-4bbc-a649-d1d60d5242d3) Sep 08 11:19:11.465522 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:19:11.465522 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:19:11.465522 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:19:11.465522 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:19:11.465522 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 08 11:19:11.465522 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 08 11:19:11.465522 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 08 11:19:11.465522 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 08 11:19:11.465522 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 08 11:19:11.465522 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 08 11:19:11.465522 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 08 11:19:11.465522 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 08 11:19:11.465522 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 11:19:11.469919 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 11:19:11.469919 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 11:19:11.469919 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 11:19:11.469919 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 11:19:11.469919 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 11:19:11.469919 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 11:19:11.469919 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 11:19:11.469919 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 11:19:11.469919 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 11:19:11.469919 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 11:19:11.469919 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 11:19:11.469919 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 11:19:11.469919 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 11:19:11.469919 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ceea62b1-2ba4-48f2-a6a3-4f903bf6773b could not be found. Sep 08 11:19:11.469919 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:19:11.469919 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:19:11.469919 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:19:11.469919 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:19:11.469919 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:19:11.469919 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:19:11.469919 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:19:11.469919 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:19:11.469919 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 11:19:11.469919 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 11:19:11.469919 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:19:11.469919 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:19:11.469919 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 08 11:19:11.469919 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:19:11.469919 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ceea62b1-2ba4-48f2-a6a3-4f903bf6773b could not be found. Sep 08 11:19:11.469919 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:19:11.469919 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:19:11.469919 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:19:11.469919 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:19:11.469919 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:19:11.469919 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:19:11.469919 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:19:11.469919 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:19:11.469919 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ceea62b1-2ba4-48f2-a6a3-4f903bf6773b could not be found. Sep 08 11:19:11.469919 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:19:11.473963 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-27453833-b0bd-4125-babb-982b4f30c12a tempest-VolumesSnapshotsTestJSON-345478965 tempest-VolumesSnapshotsTestJSON-345478965-project] Returning 404 to user: Volume ceea62b1-2ba4-48f2-a6a3-4f903bf6773b could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:19:11.475653 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-27453833-b0bd-4125-babb-982b4f30c12a tempest-VolumesSnapshotsTestJSON-345478965 tempest-VolumesSnapshotsTestJSON-345478965-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/ceea62b1-2ba4-48f2-a6a3-4f903bf6773b" status: 404 len: 109 microversion: 2.1 time: 0.071990 Sep 08 11:19:11.476758 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3167/6199] 10.222.0.27 () {58 vars in 1245 bytes} [Thu Sep 8 11:19:11 2022] GET /compute/v2.1/os-volumes/ceea62b1-2ba4-48f2-a6a3-4f903bf6773b => generated 109 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:19:11.487721 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ebfd71fe-f3ac-4ce3-a611-c8afda4ff95e tempest-VolumesSnapshotsTestJSON-345478965 tempest-VolumesSnapshotsTestJSON-345478965-project] Calling method '.version_select at 0x7f68e4806700>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:19:11.564518 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-ebfd71fe-f3ac-4ce3-a611-c8afda4ff95e tempest-VolumesSnapshotsTestJSON-345478965 tempest-VolumesSnapshotsTestJSON-345478965-project] HTTP exception thrown: Volume ceea62b1-2ba4-48f2-a6a3-4f903bf6773b could not be found. Sep 08 11:19:11.566559 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ebfd71fe-f3ac-4ce3-a611-c8afda4ff95e tempest-VolumesSnapshotsTestJSON-345478965 tempest-VolumesSnapshotsTestJSON-345478965-project] Request method failure captured: Sep 08 11:19:11.566559 n-d-850501-12 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/os-volumes/ceea62b1-2ba4-48f2-a6a3-4f903bf6773b HTTP/1.1 Sep 08 11:19:11.566559 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 11:19:11.566559 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 11:19:11.566559 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 11:19:11.566559 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 11:19:11.566559 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 11:19:11.566559 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 11:19:11.566559 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 11:19:11.566559 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 11:19:11.566559 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGc-jVVtwiq4kKya4hTRHx1-pS-qU5qt6fJPmp1c6tkpwOdJnMZ_G6INuRWjqP9H9EYWTIiINpgODqUSerB2-W7lrEtAmaFp_j1fsWr3P7ir4dfH-t1HEl13tUmbc3pdzuYj0kP0tK4QUhKjwXuEuCg8XA0VJI7gPNS8MyoPazGgamjA Sep 08 11:19:11.566559 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 11:19:11.566559 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 11:19:11.566559 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 11:19:11.566559 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 11:19:11.566559 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 11:19:11.566559 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 11:19:11.566559 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 95cd4870a313405cb232c1833e33cd40 Sep 08 11:19:11.566559 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-345478965 Sep 08 11:19:11.566559 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 11:19:11.566559 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 11:19:11.566559 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/95cd4870a313405cb232c1833e33cd40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/95cd4870a313405cb232c1833e33cd40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_95cd4870a313405cb232c1833e33cd40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/95cd4870a313405cb232c1833e33cd40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:19:11.566559 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-VolumesSnapshotsTestJSON-345478965 Sep 08 11:19:11.566559 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 95cd4870a313405cb232c1833e33cd40 Sep 08 11:19:11.566559 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-345478965 Sep 08 11:19:11.566559 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-VolumesSnapshotsTestJSON-345478965-project Sep 08 11:19:11.566559 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 11:19:11.566559 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 11:19:11.566559 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 39c5a7c2ed244c9896239ab0bf2a8777 Sep 08 11:19:11.566559 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-VolumesSnapshotsTestJSON-345478965-project Sep 08 11:19:11.566559 n-d-850501-12 devstack@n-api.service[128862]: method: Sep 08 11:19:11.566559 n-d-850501-12 devstack@n-api.service[128862]: exception: Volume ceea62b1-2ba4-48f2-a6a3-4f903bf6773b could not be found. Sep 08 11:19:11.566559 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'ceea62b1-2ba4-48f2-a6a3-4f903bf6773b'} Sep 08 11:19:11.566559 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:19:11.566559 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:19:11.566559 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 11:19:11.566559 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 11:19:11.566559 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 08 11:19:11.566559 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 08 11:19:11.566559 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 08 11:19:11.566559 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 08 11:19:11.566559 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 08 11:19:11.566559 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 08 11:19:11.566559 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 08 11:19:11.566559 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 08 11:19:11.566559 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 11:19:11.566559 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 11:19:11.566559 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 11:19:11.566559 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 11:19:11.566559 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ceea62b1-2ba4-48f2-a6a3-4f903bf6773b could not be found. (HTTP 404) (Request-ID: req-4fa2f1f0-3524-4eb9-a8c0-b7f544bed884) Sep 08 11:19:11.566559 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:19:11.566559 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:19:11.566559 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:19:11.566559 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:19:11.566559 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 08 11:19:11.566559 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 08 11:19:11.566559 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 08 11:19:11.566559 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 08 11:19:11.566559 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 08 11:19:11.566559 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 08 11:19:11.566559 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 08 11:19:11.566559 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 08 11:19:11.566559 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 11:19:11.570633 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 11:19:11.570633 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 08 11:19:11.570633 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 08 11:19:11.570633 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 08 11:19:11.570633 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 08 11:19:11.570633 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 08 11:19:11.570633 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 08 11:19:11.570633 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 08 11:19:11.570633 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 08 11:19:11.570633 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 11:19:11.570633 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 11:19:11.570633 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 11:19:11.570633 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 11:19:11.570633 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ceea62b1-2ba4-48f2-a6a3-4f903bf6773b could not be found. Sep 08 11:19:11.570633 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:19:11.570633 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:19:11.570633 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:19:11.570633 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:19:11.570633 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:19:11.570633 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:19:11.570633 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:19:11.570633 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:19:11.570633 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 11:19:11.570633 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 11:19:11.570633 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:19:11.570633 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:19:11.570633 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 08 11:19:11.570633 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:19:11.570633 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ceea62b1-2ba4-48f2-a6a3-4f903bf6773b could not be found. Sep 08 11:19:11.570633 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:19:11.570633 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:19:11.570633 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:19:11.570633 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:19:11.570633 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:19:11.570633 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:19:11.570633 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:19:11.570633 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:19:11.570633 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ceea62b1-2ba4-48f2-a6a3-4f903bf6773b could not be found. Sep 08 11:19:11.570633 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:19:11.578621 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ebfd71fe-f3ac-4ce3-a611-c8afda4ff95e tempest-VolumesSnapshotsTestJSON-345478965 tempest-VolumesSnapshotsTestJSON-345478965-project] Returning 404 to user: Volume ceea62b1-2ba4-48f2-a6a3-4f903bf6773b could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:19:11.580280 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ebfd71fe-f3ac-4ce3-a611-c8afda4ff95e tempest-VolumesSnapshotsTestJSON-345478965 tempest-VolumesSnapshotsTestJSON-345478965-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/ceea62b1-2ba4-48f2-a6a3-4f903bf6773b" status: 404 len: 109 microversion: 2.1 time: 0.096132 Sep 08 11:19:11.581088 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3033/6200] 10.222.0.27 () {58 vars in 1248 bytes} [Thu Sep 8 11:19:11 2022] DELETE /compute/v2.1/os-volumes/ceea62b1-2ba4-48f2-a6a3-4f903bf6773b => generated 109 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:19:11.590354 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-372aa804-70e2-4bba-928d-74bec7777076 tempest-VolumesSnapshotsTestJSON-345478965 tempest-VolumesSnapshotsTestJSON-345478965-project] Calling method '.version_select at 0x7f68df25fee0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:19:11.615683 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d8123720-f760-4183-8eee-851f534e24f4 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:19:11.626073 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d8123720-f760-4183-8eee-851f534e24f4 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: b1cceddd-7c8d-4b5a-9814-7eee4f028c2e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:19:11.633340 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d8123720-f760-4183-8eee-851f534e24f4 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:11.634204 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d8123720-f760-4183-8eee-851f534e24f4 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:11.634877 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d8123720-f760-4183-8eee-851f534e24f4 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:11.640993 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-372aa804-70e2-4bba-928d-74bec7777076 tempest-VolumesSnapshotsTestJSON-345478965 tempest-VolumesSnapshotsTestJSON-345478965-project] HTTP exception thrown: Volume ceea62b1-2ba4-48f2-a6a3-4f903bf6773b could not be found. Sep 08 11:19:11.643495 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-372aa804-70e2-4bba-928d-74bec7777076 tempest-VolumesSnapshotsTestJSON-345478965 tempest-VolumesSnapshotsTestJSON-345478965-project] Request method failure captured: Sep 08 11:19:11.643495 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/os-volumes/ceea62b1-2ba4-48f2-a6a3-4f903bf6773b HTTP/1.1 Sep 08 11:19:11.643495 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:19:11.643495 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:19:11.643495 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:19:11.643495 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 11:19:11.643495 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:19:11.643495 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:19:11.643495 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:19:11.643495 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:19:11.643495 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGc-jVVtwiq4kKya4hTRHx1-pS-qU5qt6fJPmp1c6tkpwOdJnMZ_G6INuRWjqP9H9EYWTIiINpgODqUSerB2-W7lrEtAmaFp_j1fsWr3P7ir4dfH-t1HEl13tUmbc3pdzuYj0kP0tK4QUhKjwXuEuCg8XA0VJI7gPNS8MyoPazGgamjA Sep 08 11:19:11.643495 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:19:11.643495 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:19:11.643495 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:19:11.643495 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:19:11.643495 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:19:11.643495 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:19:11.643495 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 95cd4870a313405cb232c1833e33cd40 Sep 08 11:19:11.643495 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-345478965 Sep 08 11:19:11.643495 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:19:11.643495 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:19:11.643495 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/95cd4870a313405cb232c1833e33cd40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/95cd4870a313405cb232c1833e33cd40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_95cd4870a313405cb232c1833e33cd40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/95cd4870a313405cb232c1833e33cd40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:19:11.643495 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-VolumesSnapshotsTestJSON-345478965 Sep 08 11:19:11.643495 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 95cd4870a313405cb232c1833e33cd40 Sep 08 11:19:11.643495 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-345478965 Sep 08 11:19:11.643495 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-VolumesSnapshotsTestJSON-345478965-project Sep 08 11:19:11.643495 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:19:11.643495 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:19:11.643495 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 39c5a7c2ed244c9896239ab0bf2a8777 Sep 08 11:19:11.643495 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-VolumesSnapshotsTestJSON-345478965-project Sep 08 11:19:11.643495 n-d-850501-12 devstack@n-api.service[128861]: method: Sep 08 11:19:11.643495 n-d-850501-12 devstack@n-api.service[128861]: exception: Volume ceea62b1-2ba4-48f2-a6a3-4f903bf6773b could not be found. Sep 08 11:19:11.643495 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': 'ceea62b1-2ba4-48f2-a6a3-4f903bf6773b'} Sep 08 11:19:11.643495 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:19:11.643495 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:19:11.643495 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 11:19:11.643495 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 11:19:11.643495 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 11:19:11.643495 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 11:19:11.643495 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 11:19:11.643495 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 11:19:11.643495 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 11:19:11.643495 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 11:19:11.643495 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 11:19:11.643495 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 11:19:11.643495 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 11:19:11.643495 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 11:19:11.643495 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 11:19:11.643495 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 11:19:11.643495 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ceea62b1-2ba4-48f2-a6a3-4f903bf6773b could not be found. (HTTP 404) (Request-ID: req-35390253-7d9a-4c51-85fc-011d51dd8988) Sep 08 11:19:11.643495 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:19:11.643495 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:19:11.643495 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:19:11.643495 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:19:11.643495 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 08 11:19:11.643495 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 08 11:19:11.643495 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 08 11:19:11.643495 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 08 11:19:11.643495 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 08 11:19:11.643495 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 08 11:19:11.643495 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 08 11:19:11.643495 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 08 11:19:11.643495 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 11:19:11.647309 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 11:19:11.647309 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 11:19:11.647309 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 11:19:11.647309 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 11:19:11.647309 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 11:19:11.647309 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 11:19:11.647309 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 11:19:11.647309 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 11:19:11.647309 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 11:19:11.647309 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 11:19:11.647309 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 11:19:11.647309 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 11:19:11.647309 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 11:19:11.647309 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ceea62b1-2ba4-48f2-a6a3-4f903bf6773b could not be found. Sep 08 11:19:11.647309 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:19:11.647309 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:19:11.647309 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:19:11.647309 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:19:11.647309 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:19:11.647309 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:19:11.647309 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:19:11.647309 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:19:11.647309 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 11:19:11.647309 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 11:19:11.647309 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:19:11.647309 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:19:11.647309 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 08 11:19:11.647309 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:19:11.647309 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ceea62b1-2ba4-48f2-a6a3-4f903bf6773b could not be found. Sep 08 11:19:11.647309 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:19:11.647309 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:19:11.647309 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:19:11.647309 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:19:11.647309 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:19:11.647309 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:19:11.647309 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:19:11.647309 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:19:11.647309 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ceea62b1-2ba4-48f2-a6a3-4f903bf6773b could not be found. Sep 08 11:19:11.647309 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:19:11.652251 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-372aa804-70e2-4bba-928d-74bec7777076 tempest-VolumesSnapshotsTestJSON-345478965 tempest-VolumesSnapshotsTestJSON-345478965-project] Returning 404 to user: Volume ceea62b1-2ba4-48f2-a6a3-4f903bf6773b could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:19:11.653656 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-372aa804-70e2-4bba-928d-74bec7777076 tempest-VolumesSnapshotsTestJSON-345478965 tempest-VolumesSnapshotsTestJSON-345478965-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/ceea62b1-2ba4-48f2-a6a3-4f903bf6773b" status: 404 len: 109 microversion: 2.1 time: 0.067198 Sep 08 11:19:11.654807 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3168/6201] 10.222.0.27 () {58 vars in 1245 bytes} [Thu Sep 8 11:19:11 2022] GET /compute/v2.1/os-volumes/ceea62b1-2ba4-48f2-a6a3-4f903bf6773b => generated 109 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:19:11.655595 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d8123720-f760-4183-8eee-851f534e24f4 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:11.656333 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d8123720-f760-4183-8eee-851f534e24f4 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:11.657005 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d8123720-f760-4183-8eee-851f534e24f4 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:12.052811 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-78fcd8d0-b1b0-41b5-a33e-1161413030c3 req-dbe2dfc7-3f56-4501-9122-3d1a111a7a89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1cceddd-7c8d-4b5a-9814-7eee4f028c2e", "tag": "8008ff5e-612f-433f-b5c9-d52c4ac5df08"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:19:12.108793 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-78fcd8d0-b1b0-41b5-a33e-1161413030c3 req-dbe2dfc7-3f56-4501-9122-3d1a111a7a89 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:12.109592 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-78fcd8d0-b1b0-41b5-a33e-1161413030c3 req-dbe2dfc7-3f56-4501-9122-3d1a111a7a89 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:12.111308 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-78fcd8d0-b1b0-41b5-a33e-1161413030c3 req-dbe2dfc7-3f56-4501-9122-3d1a111a7a89 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:12.161679 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d8123720-f760-4183-8eee-851f534e24f4 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:19:12.182918 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-78fcd8d0-b1b0-41b5-a33e-1161413030c3 req-dbe2dfc7-3f56-4501-9122-3d1a111a7a89 service nova] Creating event network-changed:8008ff5e-612f-433f-b5c9-d52c4ac5df08 for instance b1cceddd-7c8d-4b5a-9814-7eee4f028c2e on n-h2-850501-12 Sep 08 11:19:12.188760 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d8123720-f760-4183-8eee-851f534e24f4 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/b1cceddd-7c8d-4b5a-9814-7eee4f028c2e" status: 200 len: 1691 microversion: 2.1 time: 0.596832 Sep 08 11:19:12.189618 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3034/6202] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:19:11 2022] GET /compute/v2.1/servers/b1cceddd-7c8d-4b5a-9814-7eee4f028c2e => generated 1691 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:19:12.206949 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-78fcd8d0-b1b0-41b5-a33e-1161413030c3 req-dbe2dfc7-3f56-4501-9122-3d1a111a7a89 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.159902 Sep 08 11:19:12.207998 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3169/6203] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:19:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:19:13.214944 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7f7b850f-6e62-46d8-94ea-f9866d05f087 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:19:13.216738 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7f7b850f-6e62-46d8-94ea-f9866d05f087 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: b1cceddd-7c8d-4b5a-9814-7eee4f028c2e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:19:13.227273 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f7b850f-6e62-46d8-94ea-f9866d05f087 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:13.228220 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f7b850f-6e62-46d8-94ea-f9866d05f087 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:13.229115 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f7b850f-6e62-46d8-94ea-f9866d05f087 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:13.230172 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f7b850f-6e62-46d8-94ea-f9866d05f087 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:13.231144 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f7b850f-6e62-46d8-94ea-f9866d05f087 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:13.232197 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f7b850f-6e62-46d8-94ea-f9866d05f087 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:13.493499 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7f7b850f-6e62-46d8-94ea-f9866d05f087 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:19:13.503110 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7f7b850f-6e62-46d8-94ea-f9866d05f087 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/b1cceddd-7c8d-4b5a-9814-7eee4f028c2e" status: 200 len: 1691 microversion: 2.1 time: 0.292176 Sep 08 11:19:13.517852 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3035/6204] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:19:13 2022] GET /compute/v2.1/servers/b1cceddd-7c8d-4b5a-9814-7eee4f028c2e => generated 1691 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:19:14.544884 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-336e80e0-3649-4f60-8e54-406e3d6452bc tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:19:14.546277 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-336e80e0-3649-4f60-8e54-406e3d6452bc tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: b1cceddd-7c8d-4b5a-9814-7eee4f028c2e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:19:14.571478 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-336e80e0-3649-4f60-8e54-406e3d6452bc tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:14.571992 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-336e80e0-3649-4f60-8e54-406e3d6452bc tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:14.572431 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-336e80e0-3649-4f60-8e54-406e3d6452bc tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:14.573188 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-336e80e0-3649-4f60-8e54-406e3d6452bc tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:14.573653 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-336e80e0-3649-4f60-8e54-406e3d6452bc tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:14.574080 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-336e80e0-3649-4f60-8e54-406e3d6452bc tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:14.875069 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-336e80e0-3649-4f60-8e54-406e3d6452bc tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:19:14.888888 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-336e80e0-3649-4f60-8e54-406e3d6452bc tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/b1cceddd-7c8d-4b5a-9814-7eee4f028c2e" status: 200 len: 1691 microversion: 2.1 time: 0.363683 Sep 08 11:19:14.904573 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3170/6205] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:19:14 2022] GET /compute/v2.1/servers/b1cceddd-7c8d-4b5a-9814-7eee4f028c2e => generated 1691 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:19:15.922173 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0ec286a3-ebb3-4a89-b251-b060ab4bfe73 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:19:15.922698 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0ec286a3-ebb3-4a89-b251-b060ab4bfe73 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: b1cceddd-7c8d-4b5a-9814-7eee4f028c2e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:19:15.928991 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=23,nova_api:DELETE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:19:15.930768 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ec286a3-ebb3-4a89-b251-b060ab4bfe73 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:15.931652 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ec286a3-ebb3-4a89-b251-b060ab4bfe73 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:15.932343 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ec286a3-ebb3-4a89-b251-b060ab4bfe73 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:15.933333 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ec286a3-ebb3-4a89-b251-b060ab4bfe73 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:15.933998 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ec286a3-ebb3-4a89-b251-b060ab4bfe73 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:15.935341 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ec286a3-ebb3-4a89-b251-b060ab4bfe73 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:16.132759 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8218d20c-345d-4731-9169-083688964b8c tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Action: 'create', calling method: .version_select at 0x7f68df3eb550>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1136544873", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLmqzohI52Z7K2vgVK3h52p0MnXo8XXlF7DqLmGSJACk7wxiH8wX7Xvd+wwGFnecNtp9H8l38txE8JiInsonZB8hSa7VOKbB+SW/yIZwt9yPi67qdDIpqAQAnjZ11Glh+A=="}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:19:16.151170 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-8218d20c-345d-4731-9169-083688964b8c tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Getting quotas for project 74cef405056649b8a9697533c5c7fc52. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:19:16.158472 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-8218d20c-345d-4731-9169-083688964b8c tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Getting quotas for user 3a6d32139caf4574abec46fe34dc00da and project 74cef405056649b8a9697533c5c7fc52. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:19:16.176955 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0ec286a3-ebb3-4a89-b251-b060ab4bfe73 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:19:16.190242 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0ec286a3-ebb3-4a89-b251-b060ab4bfe73 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/b1cceddd-7c8d-4b5a-9814-7eee4f028c2e" status: 200 len: 1691 microversion: 2.1 time: 0.271568 Sep 08 11:19:16.190783 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8218d20c-345d-4731-9169-083688964b8c tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.062103 Sep 08 11:19:16.191141 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3036/6206] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:19:15 2022] GET /compute/v2.1/servers/b1cceddd-7c8d-4b5a-9814-7eee4f028c2e => generated 1691 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:19:16.199831 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3171/6207] 10.222.0.27 () {60 vars in 1159 bytes} [Thu Sep 8 11:19:16 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:19:17.218351 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-94b07433-680e-447e-b3f0-b88cf8cd0542 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:19:17.219211 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-94b07433-680e-447e-b3f0-b88cf8cd0542 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: b1cceddd-7c8d-4b5a-9814-7eee4f028c2e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:19:17.233000 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94b07433-680e-447e-b3f0-b88cf8cd0542 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:17.233761 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94b07433-680e-447e-b3f0-b88cf8cd0542 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:17.234487 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94b07433-680e-447e-b3f0-b88cf8cd0542 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:17.235496 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94b07433-680e-447e-b3f0-b88cf8cd0542 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:17.238019 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94b07433-680e-447e-b3f0-b88cf8cd0542 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:17.240571 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94b07433-680e-447e-b3f0-b88cf8cd0542 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:17.545234 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-94b07433-680e-447e-b3f0-b88cf8cd0542 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:19:17.556771 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-94b07433-680e-447e-b3f0-b88cf8cd0542 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/b1cceddd-7c8d-4b5a-9814-7eee4f028c2e" status: 200 len: 1691 microversion: 2.1 time: 0.343464 Sep 08 11:19:17.559363 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3037/6208] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:19:17 2022] GET /compute/v2.1/servers/b1cceddd-7c8d-4b5a-9814-7eee4f028c2e => generated 1691 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:19:18.258870 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-13c0d0a5-a0b2-4dd4-948a-c0db66c507af tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1705179664", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "3f1ae3e0-c69f-439e-b293-218cb7b05396", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1136544873", "security_groups": [{"name": "tempest-secgroup-smoke-1454067882"}], "networks": [{"uuid": "156eeeba-a24f-479e-b1cc-8c9e3c6a5737"}]}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:19:18.578734 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-13c0d0a5-a0b2-4dd4-948a-c0db66c507af tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] validate_networks() for [('156eeeba-a24f-479e-b1cc-8c9e3c6a5737', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:19:18.585909 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-32c48960-b6a2-4a9e-8636-e674882460e6 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:19:18.586533 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-32c48960-b6a2-4a9e-8636-e674882460e6 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: b1cceddd-7c8d-4b5a-9814-7eee4f028c2e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:19:18.597788 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-32c48960-b6a2-4a9e-8636-e674882460e6 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:18.602916 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-32c48960-b6a2-4a9e-8636-e674882460e6 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:18.605635 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-32c48960-b6a2-4a9e-8636-e674882460e6 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:18.606632 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-32c48960-b6a2-4a9e-8636-e674882460e6 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:18.609253 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-32c48960-b6a2-4a9e-8636-e674882460e6 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:18.609812 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-32c48960-b6a2-4a9e-8636-e674882460e6 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:19.187699 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-32c48960-b6a2-4a9e-8636-e674882460e6 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:19:19.207343 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-32c48960-b6a2-4a9e-8636-e674882460e6 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/b1cceddd-7c8d-4b5a-9814-7eee4f028c2e" status: 200 len: 1691 microversion: 2.1 time: 0.624928 Sep 08 11:19:19.208335 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3038/6209] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:19:18 2022] GET /compute/v2.1/servers/b1cceddd-7c8d-4b5a-9814-7eee4f028c2e => generated 1691 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:19:19.556129 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-13c0d0a5-a0b2-4dd4-948a-c0db66c507af tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:19:19.556621 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-13c0d0a5-a0b2-4dd4-948a-c0db66c507af tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:19:19.557011 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-13c0d0a5-a0b2-4dd4-948a-c0db66c507af tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:19:19.557444 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-13c0d0a5-a0b2-4dd4-948a-c0db66c507af tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:19:19.557847 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-13c0d0a5-a0b2-4dd4-948a-c0db66c507af tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:19:19.581343 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-13c0d0a5-a0b2-4dd4-948a-c0db66c507af tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:19.582000 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-13c0d0a5-a0b2-4dd4-948a-c0db66c507af tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:19.583153 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-13c0d0a5-a0b2-4dd4-948a-c0db66c507af tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:19.584217 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-13c0d0a5-a0b2-4dd4-948a-c0db66c507af tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:19.585622 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-13c0d0a5-a0b2-4dd4-948a-c0db66c507af tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:19.586206 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-13c0d0a5-a0b2-4dd4-948a-c0db66c507af tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:19.615627 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-13c0d0a5-a0b2-4dd4-948a-c0db66c507af tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Getting quotas for project 74cef405056649b8a9697533c5c7fc52. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:19:19.625334 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-13c0d0a5-a0b2-4dd4-948a-c0db66c507af tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Getting quotas for user 3a6d32139caf4574abec46fe34dc00da and project 74cef405056649b8a9697533c5c7fc52. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:19:19.701945 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-13c0d0a5-a0b2-4dd4-948a-c0db66c507af tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:19:19.705648 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-13c0d0a5-a0b2-4dd4-948a-c0db66c507af tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] [instance: 838e470e-405d-4ac9-b222-0a0a5792b05b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3f1ae3e0-c69f-439e-b293-218cb7b05396',volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:19:19.915894 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-13c0d0a5-a0b2-4dd4-948a-c0db66c507af tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.673893 Sep 08 11:19:19.921111 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3172/6210] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 11:19:18 2022] POST /compute/v2.1/servers => generated 406 bytes in 1682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:19:19.932554 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a3d5182d-8114-491b-b001-8c3388874f84 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:19:19.933247 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a3d5182d-8114-491b-b001-8c3388874f84 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] [instance: 838e470e-405d-4ac9-b222-0a0a5792b05b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:19:20.026614 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a3d5182d-8114-491b-b001-8c3388874f84 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a6d32139caf4574abec46fe34dc00da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74cef405056649b8a9697533c5c7fc52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:19:20.036775 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a3d5182d-8114-491b-b001-8c3388874f84 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] 10.222.0.27 "GET /compute/v2.1/servers/838e470e-405d-4ac9-b222-0a0a5792b05b" status: 200 len: 1099 microversion: 2.1 time: 0.108154 Sep 08 11:19:20.049170 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3039/6211] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:19:19 2022] GET /compute/v2.1/servers/838e470e-405d-4ac9-b222-0a0a5792b05b => generated 1099 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:19:20.232610 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-500256bd-e6d4-4dd1-9d79-6cf9cae898f6 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:19:20.233269 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-500256bd-e6d4-4dd1-9d79-6cf9cae898f6 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: b1cceddd-7c8d-4b5a-9814-7eee4f028c2e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:19:20.248372 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-500256bd-e6d4-4dd1-9d79-6cf9cae898f6 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:20.252292 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-500256bd-e6d4-4dd1-9d79-6cf9cae898f6 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:20.252782 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-500256bd-e6d4-4dd1-9d79-6cf9cae898f6 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:20.257751 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-500256bd-e6d4-4dd1-9d79-6cf9cae898f6 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:20.258265 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-500256bd-e6d4-4dd1-9d79-6cf9cae898f6 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:20.261578 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-500256bd-e6d4-4dd1-9d79-6cf9cae898f6 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:20.503133 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-500256bd-e6d4-4dd1-9d79-6cf9cae898f6 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:19:20.521344 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-500256bd-e6d4-4dd1-9d79-6cf9cae898f6 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/b1cceddd-7c8d-4b5a-9814-7eee4f028c2e" status: 200 len: 1691 microversion: 2.1 time: 0.292945 Sep 08 11:19:20.533200 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3173/6212] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:19:20 2022] GET /compute/v2.1/servers/b1cceddd-7c8d-4b5a-9814-7eee4f028c2e => generated 1691 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:19:21.072696 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d29a3b1b-5db2-42f9-915b-b5a8d7c573f8 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:19:21.073564 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d29a3b1b-5db2-42f9-915b-b5a8d7c573f8 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] [instance: 838e470e-405d-4ac9-b222-0a0a5792b05b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:19:21.089552 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d29a3b1b-5db2-42f9-915b-b5a8d7c573f8 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:21.090481 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d29a3b1b-5db2-42f9-915b-b5a8d7c573f8 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:21.091093 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d29a3b1b-5db2-42f9-915b-b5a8d7c573f8 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:21.093419 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d29a3b1b-5db2-42f9-915b-b5a8d7c573f8 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:21.094081 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d29a3b1b-5db2-42f9-915b-b5a8d7c573f8 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:21.094700 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d29a3b1b-5db2-42f9-915b-b5a8d7c573f8 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:21.386485 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d29a3b1b-5db2-42f9-915b-b5a8d7c573f8 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a6d32139caf4574abec46fe34dc00da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74cef405056649b8a9697533c5c7fc52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:19:21.412907 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d29a3b1b-5db2-42f9-915b-b5a8d7c573f8 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] 10.222.0.27 "GET /compute/v2.1/servers/838e470e-405d-4ac9-b222-0a0a5792b05b" status: 200 len: 1141 microversion: 2.1 time: 0.334150 Sep 08 11:19:21.414098 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3040/6213] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:19:21 2022] GET /compute/v2.1/servers/838e470e-405d-4ac9-b222-0a0a5792b05b => generated 1141 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:19:21.548634 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-07182653-ae4f-4102-ba93-6457a5cca0d2 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:19:21.550022 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-07182653-ae4f-4102-ba93-6457a5cca0d2 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: b1cceddd-7c8d-4b5a-9814-7eee4f028c2e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:19:21.559190 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-07182653-ae4f-4102-ba93-6457a5cca0d2 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:21.559816 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-07182653-ae4f-4102-ba93-6457a5cca0d2 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:21.561410 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-07182653-ae4f-4102-ba93-6457a5cca0d2 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:21.563341 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-07182653-ae4f-4102-ba93-6457a5cca0d2 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:21.564228 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-07182653-ae4f-4102-ba93-6457a5cca0d2 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:21.564890 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-07182653-ae4f-4102-ba93-6457a5cca0d2 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:21.746370 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-07182653-ae4f-4102-ba93-6457a5cca0d2 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:19:21.764515 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-07182653-ae4f-4102-ba93-6457a5cca0d2 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/b1cceddd-7c8d-4b5a-9814-7eee4f028c2e" status: 200 len: 1681 microversion: 2.1 time: 0.220982 Sep 08 11:19:21.776580 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3174/6214] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:19:21 2022] GET /compute/v2.1/servers/b1cceddd-7c8d-4b5a-9814-7eee4f028c2e => generated 1681 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:19:21.792572 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-30eaf956-eef2-4066-89fa-67b4c5c7658a tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:19:21.793364 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-30eaf956-eef2-4066-89fa-67b4c5c7658a tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] [instance: b1cceddd-7c8d-4b5a-9814-7eee4f028c2e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:19:21.800925 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-30eaf956-eef2-4066-89fa-67b4c5c7658a tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:21.801860 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-30eaf956-eef2-4066-89fa-67b4c5c7658a tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:21.802389 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-30eaf956-eef2-4066-89fa-67b4c5c7658a tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:21.803351 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-30eaf956-eef2-4066-89fa-67b4c5c7658a tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:21.803901 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-30eaf956-eef2-4066-89fa-67b4c5c7658a tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:21.804409 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-30eaf956-eef2-4066-89fa-67b4c5c7658a tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:21.809471 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:19:22.034933 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-30eaf956-eef2-4066-89fa-67b4c5c7658a tempest-TestNetworkAdvancedServerOps-1536282347 tempest-TestNetworkAdvancedServerOps-1536282347-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/b1cceddd-7c8d-4b5a-9814-7eee4f028c2e" status: 200 len: 1834 microversion: 2.1 time: 0.246969 Sep 08 11:19:22.046051 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3041/6215] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:19:21 2022] GET /compute/v2.1/servers/b1cceddd-7c8d-4b5a-9814-7eee4f028c2e => generated 1834 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:19:22.061910 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e1230999-57a0-4d18-9598-aeb6d4ff02c2 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:19:22.062548 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e1230999-57a0-4d18-9598-aeb6d4ff02c2 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: b1cceddd-7c8d-4b5a-9814-7eee4f028c2e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:19:22.068867 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e1230999-57a0-4d18-9598-aeb6d4ff02c2 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:22.069409 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e1230999-57a0-4d18-9598-aeb6d4ff02c2 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:22.070171 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e1230999-57a0-4d18-9598-aeb6d4ff02c2 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:22.070894 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e1230999-57a0-4d18-9598-aeb6d4ff02c2 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:22.071350 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e1230999-57a0-4d18-9598-aeb6d4ff02c2 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:22.078902 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e1230999-57a0-4d18-9598-aeb6d4ff02c2 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:22.358421 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e1230999-57a0-4d18-9598-aeb6d4ff02c2 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:19:22.379275 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e1230999-57a0-4d18-9598-aeb6d4ff02c2 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/b1cceddd-7c8d-4b5a-9814-7eee4f028c2e" status: 200 len: 1681 microversion: 2.1 time: 0.322734 Sep 08 11:19:22.394904 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3175/6216] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:19:22 2022] GET /compute/v2.1/servers/b1cceddd-7c8d-4b5a-9814-7eee4f028c2e => generated 1681 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:19:22.439941 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-51194620-a83e-49a9-a1eb-2ecb01805c43 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:19:22.440571 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-51194620-a83e-49a9-a1eb-2ecb01805c43 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] [instance: 838e470e-405d-4ac9-b222-0a0a5792b05b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:19:22.458221 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51194620-a83e-49a9-a1eb-2ecb01805c43 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:22.458724 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51194620-a83e-49a9-a1eb-2ecb01805c43 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:22.463145 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51194620-a83e-49a9-a1eb-2ecb01805c43 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:22.468093 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51194620-a83e-49a9-a1eb-2ecb01805c43 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:22.468698 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51194620-a83e-49a9-a1eb-2ecb01805c43 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:22.469203 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51194620-a83e-49a9-a1eb-2ecb01805c43 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:22.637431 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-51194620-a83e-49a9-a1eb-2ecb01805c43 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a6d32139caf4574abec46fe34dc00da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74cef405056649b8a9697533c5c7fc52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:19:22.648266 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-51194620-a83e-49a9-a1eb-2ecb01805c43 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] 10.222.0.27 "GET /compute/v2.1/servers/838e470e-405d-4ac9-b222-0a0a5792b05b" status: 200 len: 1215 microversion: 2.1 time: 0.214369 Sep 08 11:19:22.653070 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3042/6217] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:19:22 2022] GET /compute/v2.1/servers/838e470e-405d-4ac9-b222-0a0a5792b05b => generated 1215 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:19:23.675643 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5208e29e-991b-4566-bf8f-106ce6507b1c tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:19:23.676431 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5208e29e-991b-4566-bf8f-106ce6507b1c tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] [instance: 838e470e-405d-4ac9-b222-0a0a5792b05b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:19:23.692463 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5208e29e-991b-4566-bf8f-106ce6507b1c tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:23.693840 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5208e29e-991b-4566-bf8f-106ce6507b1c tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:23.694726 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5208e29e-991b-4566-bf8f-106ce6507b1c tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:23.700311 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5208e29e-991b-4566-bf8f-106ce6507b1c tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:23.701657 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5208e29e-991b-4566-bf8f-106ce6507b1c tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:23.703355 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5208e29e-991b-4566-bf8f-106ce6507b1c tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:24.141414 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5208e29e-991b-4566-bf8f-106ce6507b1c tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a6d32139caf4574abec46fe34dc00da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74cef405056649b8a9697533c5c7fc52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:19:24.151178 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5208e29e-991b-4566-bf8f-106ce6507b1c tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] 10.222.0.27 "GET /compute/v2.1/servers/838e470e-405d-4ac9-b222-0a0a5792b05b" status: 200 len: 1283 microversion: 2.1 time: 0.479902 Sep 08 11:19:24.151956 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3176/6218] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:19:23 2022] GET /compute/v2.1/servers/838e470e-405d-4ac9-b222-0a0a5792b05b => generated 1283 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:19:24.526323 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-614ba65d-a676-4c28-b530-0b201490dc21 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:19:24.529217 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-614ba65d-a676-4c28-b530-0b201490dc21 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: b1cceddd-7c8d-4b5a-9814-7eee4f028c2e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:19:24.550498 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-614ba65d-a676-4c28-b530-0b201490dc21 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:24.551034 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-614ba65d-a676-4c28-b530-0b201490dc21 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:24.551496 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-614ba65d-a676-4c28-b530-0b201490dc21 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:24.557057 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-614ba65d-a676-4c28-b530-0b201490dc21 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:24.557682 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-614ba65d-a676-4c28-b530-0b201490dc21 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:24.558153 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-614ba65d-a676-4c28-b530-0b201490dc21 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:24.649160 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-614ba65d-a676-4c28-b530-0b201490dc21 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "POST /compute/v2.1/servers/b1cceddd-7c8d-4b5a-9814-7eee4f028c2e/action" status: 200 len: 38628 microversion: 2.1 time: 0.128596 Sep 08 11:19:24.650601 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3043/6219] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 11:19:24 2022] POST /compute/v2.1/servers/b1cceddd-7c8d-4b5a-9814-7eee4f028c2e/action => generated 38628 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 11:19:25.176971 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9571cade-dd26-4e21-9d33-b52b1b440b02 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:19:25.177731 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9571cade-dd26-4e21-9d33-b52b1b440b02 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] [instance: 838e470e-405d-4ac9-b222-0a0a5792b05b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:19:25.186737 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9571cade-dd26-4e21-9d33-b52b1b440b02 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:25.187594 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9571cade-dd26-4e21-9d33-b52b1b440b02 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:25.188194 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9571cade-dd26-4e21-9d33-b52b1b440b02 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:25.189171 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9571cade-dd26-4e21-9d33-b52b1b440b02 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:25.189850 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9571cade-dd26-4e21-9d33-b52b1b440b02 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:25.190473 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9571cade-dd26-4e21-9d33-b52b1b440b02 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:25.496235 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9571cade-dd26-4e21-9d33-b52b1b440b02 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a6d32139caf4574abec46fe34dc00da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74cef405056649b8a9697533c5c7fc52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:19:25.509445 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9571cade-dd26-4e21-9d33-b52b1b440b02 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] 10.222.0.27 "GET /compute/v2.1/servers/838e470e-405d-4ac9-b222-0a0a5792b05b" status: 200 len: 1283 microversion: 2.1 time: 0.332840 Sep 08 11:19:25.510398 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3177/6220] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:19:25 2022] GET /compute/v2.1/servers/838e470e-405d-4ac9-b222-0a0a5792b05b => generated 1283 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:19:25.653507 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-58ea0734-0429-4006-808d-1b5be6cc1df5 req-0c5d38b8-2961-4868-8cda-68de5d823630 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "838e470e-405d-4ac9-b222-0a0a5792b05b", "tag": "7f905fe2-0728-49a8-9146-ac142f3d8007"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:19:25.688802 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-58ea0734-0429-4006-808d-1b5be6cc1df5 req-0c5d38b8-2961-4868-8cda-68de5d823630 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:25.691272 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-58ea0734-0429-4006-808d-1b5be6cc1df5 req-0c5d38b8-2961-4868-8cda-68de5d823630 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:25.692984 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-58ea0734-0429-4006-808d-1b5be6cc1df5 req-0c5d38b8-2961-4868-8cda-68de5d823630 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:25.749935 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-58ea0734-0429-4006-808d-1b5be6cc1df5 req-0c5d38b8-2961-4868-8cda-68de5d823630 service nova] Creating event network-changed:7f905fe2-0728-49a8-9146-ac142f3d8007 for instance 838e470e-405d-4ac9-b222-0a0a5792b05b on n-h2-850501-12 Sep 08 11:19:25.763173 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-58ea0734-0429-4006-808d-1b5be6cc1df5 req-0c5d38b8-2961-4868-8cda-68de5d823630 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114756 Sep 08 11:19:25.765918 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3044/6221] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:19:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:19:26.532336 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7b51442f-cc0a-4553-8887-bd9cbd0a9d84 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:19:26.532956 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7b51442f-cc0a-4553-8887-bd9cbd0a9d84 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] [instance: 838e470e-405d-4ac9-b222-0a0a5792b05b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:19:26.547633 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7b51442f-cc0a-4553-8887-bd9cbd0a9d84 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:26.554012 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7b51442f-cc0a-4553-8887-bd9cbd0a9d84 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:26.554712 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7b51442f-cc0a-4553-8887-bd9cbd0a9d84 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:26.563884 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7b51442f-cc0a-4553-8887-bd9cbd0a9d84 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:26.564575 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7b51442f-cc0a-4553-8887-bd9cbd0a9d84 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:26.565060 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7b51442f-cc0a-4553-8887-bd9cbd0a9d84 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:26.952110 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7b51442f-cc0a-4553-8887-bd9cbd0a9d84 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a6d32139caf4574abec46fe34dc00da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74cef405056649b8a9697533c5c7fc52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:19:26.960272 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7b51442f-cc0a-4553-8887-bd9cbd0a9d84 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] 10.222.0.27 "GET /compute/v2.1/servers/838e470e-405d-4ac9-b222-0a0a5792b05b" status: 200 len: 1283 microversion: 2.1 time: 0.432306 Sep 08 11:19:26.966779 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3178/6222] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:19:26 2022] GET /compute/v2.1/servers/838e470e-405d-4ac9-b222-0a0a5792b05b => generated 1283 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:19:27.287167 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3af3aa4a-88d3-4df8-a113-f828d0c341a4 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:19:27.287766 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3af3aa4a-88d3-4df8-a113-f828d0c341a4 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: b1cceddd-7c8d-4b5a-9814-7eee4f028c2e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:19:27.305748 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-68de460c-f3ef-4f1b-a9af-c1be30333f42 req-8224cbab-0dba-4c69-873f-5eefa7dc9d5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1cceddd-7c8d-4b5a-9814-7eee4f028c2e", "tag": "8008ff5e-612f-433f-b5c9-d52c4ac5df08"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:19:27.318888 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3af3aa4a-88d3-4df8-a113-f828d0c341a4 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:27.319184 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3af3aa4a-88d3-4df8-a113-f828d0c341a4 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:27.321515 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3af3aa4a-88d3-4df8-a113-f828d0c341a4 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:27.322849 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3af3aa4a-88d3-4df8-a113-f828d0c341a4 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:27.323329 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-68de460c-f3ef-4f1b-a9af-c1be30333f42 req-8224cbab-0dba-4c69-873f-5eefa7dc9d5c service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:27.323998 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3af3aa4a-88d3-4df8-a113-f828d0c341a4 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:27.324947 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-68de460c-f3ef-4f1b-a9af-c1be30333f42 req-8224cbab-0dba-4c69-873f-5eefa7dc9d5c service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:27.325589 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3af3aa4a-88d3-4df8-a113-f828d0c341a4 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:27.326338 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-68de460c-f3ef-4f1b-a9af-c1be30333f42 req-8224cbab-0dba-4c69-873f-5eefa7dc9d5c service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:27.368908 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-68de460c-f3ef-4f1b-a9af-c1be30333f42 req-8224cbab-0dba-4c69-873f-5eefa7dc9d5c service nova] Creating event network-changed:8008ff5e-612f-433f-b5c9-d52c4ac5df08 for instance b1cceddd-7c8d-4b5a-9814-7eee4f028c2e on n-h1-850501-12 Sep 08 11:19:27.403933 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-68de460c-f3ef-4f1b-a9af-c1be30333f42 req-8224cbab-0dba-4c69-873f-5eefa7dc9d5c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108114 Sep 08 11:19:27.429016 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3179/6223] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:19:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:19:27.440293 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3af3aa4a-88d3-4df8-a113-f828d0c341a4 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: b1cceddd-7c8d-4b5a-9814-7eee4f028c2e] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:19:27.642236 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3af3aa4a-88d3-4df8-a113-f828d0c341a4 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b1cceddd-7c8d-4b5a-9814-7eee4f028c2e" status: 204 len: 0 microversion: 2.1 time: 0.359792 Sep 08 11:19:27.647097 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3045/6224] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:19:27 2022] DELETE /compute/v2.1/servers/b1cceddd-7c8d-4b5a-9814-7eee4f028c2e => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:19:27.657144 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-591d30cc-bf69-4387-b66b-1b14e86ae19c tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:19:27.657866 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-591d30cc-bf69-4387-b66b-1b14e86ae19c tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: b1cceddd-7c8d-4b5a-9814-7eee4f028c2e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:19:27.675283 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-591d30cc-bf69-4387-b66b-1b14e86ae19c tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:27.676928 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-591d30cc-bf69-4387-b66b-1b14e86ae19c tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:27.677791 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-591d30cc-bf69-4387-b66b-1b14e86ae19c tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:27.679353 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-591d30cc-bf69-4387-b66b-1b14e86ae19c tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:27.681120 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-591d30cc-bf69-4387-b66b-1b14e86ae19c tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:27.684563 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-591d30cc-bf69-4387-b66b-1b14e86ae19c tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:27.992814 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f29c67d0-e0f5-4e75-8afd-4fda3587513a tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:19:27.993956 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f29c67d0-e0f5-4e75-8afd-4fda3587513a tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] [instance: 838e470e-405d-4ac9-b222-0a0a5792b05b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:19:28.012978 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f29c67d0-e0f5-4e75-8afd-4fda3587513a tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:28.015876 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f29c67d0-e0f5-4e75-8afd-4fda3587513a tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:28.036189 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f29c67d0-e0f5-4e75-8afd-4fda3587513a tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:28.040629 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f29c67d0-e0f5-4e75-8afd-4fda3587513a tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:28.041532 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f29c67d0-e0f5-4e75-8afd-4fda3587513a tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:28.042319 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f29c67d0-e0f5-4e75-8afd-4fda3587513a tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:28.133120 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-591d30cc-bf69-4387-b66b-1b14e86ae19c tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:19:28.149561 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-591d30cc-bf69-4387-b66b-1b14e86ae19c tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/b1cceddd-7c8d-4b5a-9814-7eee4f028c2e" status: 200 len: 1687 microversion: 2.1 time: 0.497228 Sep 08 11:19:28.157115 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3180/6225] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:19:27 2022] GET /compute/v2.1/servers/b1cceddd-7c8d-4b5a-9814-7eee4f028c2e => generated 1687 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:19:29.185231 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-eb670413-c77a-40a5-9f55-4189d92749be tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:19:29.185806 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-eb670413-c77a-40a5-9f55-4189d92749be tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: b1cceddd-7c8d-4b5a-9814-7eee4f028c2e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:19:29.198701 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eb670413-c77a-40a5-9f55-4189d92749be tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:29.202903 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eb670413-c77a-40a5-9f55-4189d92749be tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:29.208110 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eb670413-c77a-40a5-9f55-4189d92749be tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:29.209510 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eb670413-c77a-40a5-9f55-4189d92749be tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:29.212389 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eb670413-c77a-40a5-9f55-4189d92749be tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:29.213437 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eb670413-c77a-40a5-9f55-4189d92749be tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:29.603325 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:19:29.636648 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=10 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:19:29.679508 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-eb670413-c77a-40a5-9f55-4189d92749be tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:19:29.705239 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-eb670413-c77a-40a5-9f55-4189d92749be tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/b1cceddd-7c8d-4b5a-9814-7eee4f028c2e" status: 200 len: 1619 microversion: 2.1 time: 0.524280 Sep 08 11:19:29.713089 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3181/6226] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:19:29 2022] GET /compute/v2.1/servers/b1cceddd-7c8d-4b5a-9814-7eee4f028c2e => generated 1619 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:19:29.736344 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-039239b0-84c0-4d14-b86a-f5cd477827fe req-a67b9d26-3356-4c9d-b105-d88ff40bf57e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1cceddd-7c8d-4b5a-9814-7eee4f028c2e", "name": "network-vif-deleted", "tag": "8008ff5e-612f-433f-b5c9-d52c4ac5df08"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:19:29.800494 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-039239b0-84c0-4d14-b86a-f5cd477827fe req-a67b9d26-3356-4c9d-b105-d88ff40bf57e service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:29.801187 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-039239b0-84c0-4d14-b86a-f5cd477827fe req-a67b9d26-3356-4c9d-b105-d88ff40bf57e service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:29.801637 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-039239b0-84c0-4d14-b86a-f5cd477827fe req-a67b9d26-3356-4c9d-b105-d88ff40bf57e service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:29.852483 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-039239b0-84c0-4d14-b86a-f5cd477827fe req-a67b9d26-3356-4c9d-b105-d88ff40bf57e service nova] Creating event network-vif-deleted:8008ff5e-612f-433f-b5c9-d52c4ac5df08 for instance b1cceddd-7c8d-4b5a-9814-7eee4f028c2e on n-h1-850501-12 Sep 08 11:19:29.870965 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-039239b0-84c0-4d14-b86a-f5cd477827fe req-a67b9d26-3356-4c9d-b105-d88ff40bf57e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158603 Sep 08 11:19:29.872421 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3182/6227] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:19:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:19:30.032347 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:19:30.415590 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f29c67d0-e0f5-4e75-8afd-4fda3587513a tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a6d32139caf4574abec46fe34dc00da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74cef405056649b8a9697533c5c7fc52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:19:30.433580 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f29c67d0-e0f5-4e75-8afd-4fda3587513a tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] 10.222.0.27 "GET /compute/v2.1/servers/838e470e-405d-4ac9-b222-0a0a5792b05b" status: 200 len: 1283 microversion: 2.1 time: 2.445356 Sep 08 11:19:30.449161 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3046/6228] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:19:27 2022] GET /compute/v2.1/servers/838e470e-405d-4ac9-b222-0a0a5792b05b => generated 1283 bytes in 2450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:19:30.745568 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-eb9d986e-b5a5-4355-958c-b58cecf389cf tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:19:30.758470 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-eb9d986e-b5a5-4355-958c-b58cecf389cf tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: b1cceddd-7c8d-4b5a-9814-7eee4f028c2e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:19:30.794695 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eb9d986e-b5a5-4355-958c-b58cecf389cf tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:30.797883 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eb9d986e-b5a5-4355-958c-b58cecf389cf tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:30.798611 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eb9d986e-b5a5-4355-958c-b58cecf389cf tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:30.800891 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eb9d986e-b5a5-4355-958c-b58cecf389cf tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:30.802648 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eb9d986e-b5a5-4355-958c-b58cecf389cf tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:30.803983 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eb9d986e-b5a5-4355-958c-b58cecf389cf tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:30.821577 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-eb9d986e-b5a5-4355-958c-b58cecf389cf tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] HTTP exception thrown: Instance b1cceddd-7c8d-4b5a-9814-7eee4f028c2e could not be found. Sep 08 11:19:30.824274 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-eb9d986e-b5a5-4355-958c-b58cecf389cf tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Request method failure captured: Sep 08 11:19:30.824274 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/b1cceddd-7c8d-4b5a-9814-7eee4f028c2e HTTP/1.1 Sep 08 11:19:30.824274 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:19:30.824274 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:19:30.824274 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:19:30.824274 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 11:19:30.824274 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:19:30.824274 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:19:30.824274 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:19:30.824274 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:19:30.824274 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGc4eLGLW59QQolLaaYcmDAiK1YbvX0P6Oar8zm2OskBZObiWASS3uPq8vhdcTC5ZdVCfihBjMcHmME9I_dk-w3cv_qjNt6vtGdn5VgVz6nIlOrAKGTn8XYgxYQT4bLviOyr8E8viE7U4gtGDdg6vP3Ww_5rPnGvOSYRnSwZtG3vZ7Ao Sep 08 11:19:30.824274 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:19:30.824274 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:19:30.824274 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:19:30.824274 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:19:30.824274 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:19:30.824274 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:19:30.824274 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: a0f9071124e74802a2f76cb326ca58df Sep 08 11:19:30.824274 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1864834353 Sep 08 11:19:30.824274 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:19:30.824274 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:19:30.824274 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a0f9071124e74802a2f76cb326ca58df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a0f9071124e74802a2f76cb326ca58df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a0f9071124e74802a2f76cb326ca58df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a0f9071124e74802a2f76cb326ca58df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:19:30.824274 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1864834353 Sep 08 11:19:30.824274 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: a0f9071124e74802a2f76cb326ca58df Sep 08 11:19:30.824274 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1864834353 Sep 08 11:19:30.824274 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-TestNetworkAdvancedServerOps-1864834353-project Sep 08 11:19:30.824274 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:19:30.824274 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:19:30.824274 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: c33e91fa4e3746aa8d8d23940e17bc1e Sep 08 11:19:30.824274 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1864834353-project Sep 08 11:19:30.824274 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 11:19:30.824274 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance b1cceddd-7c8d-4b5a-9814-7eee4f028c2e could not be found. Sep 08 11:19:30.824274 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': 'b1cceddd-7c8d-4b5a-9814-7eee4f028c2e'} Sep 08 11:19:30.824274 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:19:30.824274 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:19:30.824274 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:19:30.824274 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:19:30.824274 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:19:30.824274 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:19:30.824274 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:19:30.824274 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:19:30.824274 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:19:30.824274 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:19:30.824274 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1cceddd-7c8d-4b5a-9814-7eee4f028c2e could not be found. Sep 08 11:19:30.824274 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:19:30.824274 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:19:30.824274 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:19:30.824274 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:19:30.824274 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:19:30.824274 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:19:30.824274 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:19:30.824274 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:19:30.824274 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:19:30.824274 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:19:30.824274 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:19:30.824274 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:19:30.824274 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:19:30.824274 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:19:30.824274 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:19:30.824274 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:19:30.824274 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1cceddd-7c8d-4b5a-9814-7eee4f028c2e could not be found. Sep 08 11:19:30.824274 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:19:30.824274 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:19:30.831635 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:19:30.831635 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:19:30.831635 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:19:30.831635 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:19:30.831635 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:19:30.831635 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:19:30.831635 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1cceddd-7c8d-4b5a-9814-7eee4f028c2e could not be found. Sep 08 11:19:30.831635 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:19:30.832912 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-eb9d986e-b5a5-4355-958c-b58cecf389cf tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Returning 404 to user: Instance b1cceddd-7c8d-4b5a-9814-7eee4f028c2e could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:19:30.833943 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-eb9d986e-b5a5-4355-958c-b58cecf389cf tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/b1cceddd-7c8d-4b5a-9814-7eee4f028c2e" status: 404 len: 111 microversion: 2.1 time: 0.098923 Sep 08 11:19:30.834975 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3183/6229] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:19:30 2022] GET /compute/v2.1/servers/b1cceddd-7c8d-4b5a-9814-7eee4f028c2e => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:19:31.465973 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-63a56318-6091-42ea-b8a8-0025019b543b tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:19:31.466599 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-63a56318-6091-42ea-b8a8-0025019b543b tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] [instance: 838e470e-405d-4ac9-b222-0a0a5792b05b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:19:31.486534 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63a56318-6091-42ea-b8a8-0025019b543b tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:31.487411 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63a56318-6091-42ea-b8a8-0025019b543b tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:31.489103 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63a56318-6091-42ea-b8a8-0025019b543b tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:31.490109 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63a56318-6091-42ea-b8a8-0025019b543b tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:31.491330 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63a56318-6091-42ea-b8a8-0025019b543b tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:31.492000 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63a56318-6091-42ea-b8a8-0025019b543b tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:31.753513 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-63a56318-6091-42ea-b8a8-0025019b543b tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a6d32139caf4574abec46fe34dc00da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74cef405056649b8a9697533c5c7fc52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:19:31.771081 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-63a56318-6091-42ea-b8a8-0025019b543b tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] 10.222.0.27 "GET /compute/v2.1/servers/838e470e-405d-4ac9-b222-0a0a5792b05b" status: 200 len: 1283 microversion: 2.1 time: 0.311774 Sep 08 11:19:31.778506 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3047/6230] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:19:31 2022] GET /compute/v2.1/servers/838e470e-405d-4ac9-b222-0a0a5792b05b => generated 1283 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:19:32.795119 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-870ebf5f-9ad4-41a5-abfa-2c33da2a8200 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:19:32.795747 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-870ebf5f-9ad4-41a5-abfa-2c33da2a8200 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] [instance: 838e470e-405d-4ac9-b222-0a0a5792b05b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:19:32.799032 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=4 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:19:32.809557 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-870ebf5f-9ad4-41a5-abfa-2c33da2a8200 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:32.811156 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-870ebf5f-9ad4-41a5-abfa-2c33da2a8200 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:32.812279 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-870ebf5f-9ad4-41a5-abfa-2c33da2a8200 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:32.813522 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-870ebf5f-9ad4-41a5-abfa-2c33da2a8200 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:32.814003 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-870ebf5f-9ad4-41a5-abfa-2c33da2a8200 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:32.814433 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-870ebf5f-9ad4-41a5-abfa-2c33da2a8200 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:32.821472 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=89 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:19:33.110164 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-870ebf5f-9ad4-41a5-abfa-2c33da2a8200 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a6d32139caf4574abec46fe34dc00da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74cef405056649b8a9697533c5c7fc52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:19:33.121647 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-870ebf5f-9ad4-41a5-abfa-2c33da2a8200 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] 10.222.0.27 "GET /compute/v2.1/servers/838e470e-405d-4ac9-b222-0a0a5792b05b" status: 200 len: 1271 microversion: 2.1 time: 0.329056 Sep 08 11:19:33.125564 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3184/6231] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:19:32 2022] GET /compute/v2.1/servers/838e470e-405d-4ac9-b222-0a0a5792b05b => generated 1271 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:19:34.148693 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d0456a56-acd3-44dc-a7e0-fdbf73e743a6 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:19:34.149333 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d0456a56-acd3-44dc-a7e0-fdbf73e743a6 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] [instance: 838e470e-405d-4ac9-b222-0a0a5792b05b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:19:34.161393 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d0456a56-acd3-44dc-a7e0-fdbf73e743a6 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:34.162248 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d0456a56-acd3-44dc-a7e0-fdbf73e743a6 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:34.163144 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d0456a56-acd3-44dc-a7e0-fdbf73e743a6 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:34.164189 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d0456a56-acd3-44dc-a7e0-fdbf73e743a6 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:34.164816 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d0456a56-acd3-44dc-a7e0-fdbf73e743a6 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:34.165433 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d0456a56-acd3-44dc-a7e0-fdbf73e743a6 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:35.307633 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d0456a56-acd3-44dc-a7e0-fdbf73e743a6 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a6d32139caf4574abec46fe34dc00da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74cef405056649b8a9697533c5c7fc52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:19:35.320236 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d0456a56-acd3-44dc-a7e0-fdbf73e743a6 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] 10.222.0.27 "GET /compute/v2.1/servers/838e470e-405d-4ac9-b222-0a0a5792b05b" status: 200 len: 1271 microversion: 2.1 time: 1.172283 Sep 08 11:19:35.321492 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3048/6232] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:19:34 2022] GET /compute/v2.1/servers/838e470e-405d-4ac9-b222-0a0a5792b05b => generated 1271 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:19:36.348997 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a8056008-e123-46d4-8961-e6c92fcc7cf2 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:19:36.355801 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a8056008-e123-46d4-8961-e6c92fcc7cf2 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] [instance: 838e470e-405d-4ac9-b222-0a0a5792b05b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:19:36.378597 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a8056008-e123-46d4-8961-e6c92fcc7cf2 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:36.382298 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a8056008-e123-46d4-8961-e6c92fcc7cf2 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:36.383287 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a8056008-e123-46d4-8961-e6c92fcc7cf2 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:36.385336 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a8056008-e123-46d4-8961-e6c92fcc7cf2 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:36.385995 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a8056008-e123-46d4-8961-e6c92fcc7cf2 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:36.386755 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a8056008-e123-46d4-8961-e6c92fcc7cf2 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:36.630845 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a8056008-e123-46d4-8961-e6c92fcc7cf2 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a6d32139caf4574abec46fe34dc00da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74cef405056649b8a9697533c5c7fc52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:19:36.643860 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a8056008-e123-46d4-8961-e6c92fcc7cf2 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] 10.222.0.27 "GET /compute/v2.1/servers/838e470e-405d-4ac9-b222-0a0a5792b05b" status: 200 len: 1271 microversion: 2.1 time: 0.301675 Sep 08 11:19:36.654794 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3185/6233] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:19:36 2022] GET /compute/v2.1/servers/838e470e-405d-4ac9-b222-0a0a5792b05b => generated 1271 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:19:37.555075 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-361bcc37-35d5-4b15-b13f-7dfe4e07725b tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '.version_select at 0x7f68e8a4ee50>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:19:37.590765 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-361bcc37-35d5-4b15-b13f-7dfe4e07725b tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1485828680" status: 202 len: 0 microversion: 2.1 time: 0.039638 Sep 08 11:19:37.591634 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3049/6234] 10.222.0.27 () {58 vars in 1284 bytes} [Thu Sep 8 11:19:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1485828680 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:19:37.626994 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-53b5fe5c-fdb5-4585-b978-932938de5758 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Action: 'create', calling method: .version_select at 0x7f68df3f1430>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1701457310", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIG7x1QdgDwd4Fwjkq0PH7IQmF9/YkcZE2W8P/8tWgFSdLVFGRxMMSKlsfI/SAxHxXM+mCQ6179DqvzJ1qQRmJhhhwGSO4rJv6rj351LgBukS/YdXdG1y5XWtmPBHzP9Pw=="}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:19:37.648716 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-53b5fe5c-fdb5-4585-b978-932938de5758 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Getting quotas for project a0f9071124e74802a2f76cb326ca58df. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:19:37.655369 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-53b5fe5c-fdb5-4585-b978-932938de5758 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Getting quotas for user c33e91fa4e3746aa8d8d23940e17bc1e and project a0f9071124e74802a2f76cb326ca58df. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:19:37.677549 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6e980908-b1b7-45b2-9a89-47be81b09a8a tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:19:37.678617 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6e980908-b1b7-45b2-9a89-47be81b09a8a tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] [instance: 838e470e-405d-4ac9-b222-0a0a5792b05b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:19:37.694323 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6e980908-b1b7-45b2-9a89-47be81b09a8a tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:37.695662 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6e980908-b1b7-45b2-9a89-47be81b09a8a tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:37.697286 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6e980908-b1b7-45b2-9a89-47be81b09a8a tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:37.703376 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6e980908-b1b7-45b2-9a89-47be81b09a8a tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:37.705412 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6e980908-b1b7-45b2-9a89-47be81b09a8a tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:37.707751 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6e980908-b1b7-45b2-9a89-47be81b09a8a tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:37.713884 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-53b5fe5c-fdb5-4585-b978-932938de5758 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.091430 Sep 08 11:19:37.718126 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3186/6235] 10.222.0.27 () {60 vars in 1159 bytes} [Thu Sep 8 11:19:37 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:19:37.931862 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6e980908-b1b7-45b2-9a89-47be81b09a8a tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a6d32139caf4574abec46fe34dc00da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74cef405056649b8a9697533c5c7fc52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:19:37.944035 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6e980908-b1b7-45b2-9a89-47be81b09a8a tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] 10.222.0.27 "GET /compute/v2.1/servers/838e470e-405d-4ac9-b222-0a0a5792b05b" status: 200 len: 1271 microversion: 2.1 time: 0.270635 Sep 08 11:19:37.954803 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3050/6236] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:19:37 2022] GET /compute/v2.1/servers/838e470e-405d-4ac9-b222-0a0a5792b05b => generated 1271 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:19:38.971317 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4b940e60-1385-4409-95ce-79f9ccd3bc44 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:19:38.972780 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4b940e60-1385-4409-95ce-79f9ccd3bc44 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] [instance: 838e470e-405d-4ac9-b222-0a0a5792b05b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:19:38.984921 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4b940e60-1385-4409-95ce-79f9ccd3bc44 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:38.987759 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4b940e60-1385-4409-95ce-79f9ccd3bc44 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:38.989412 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4b940e60-1385-4409-95ce-79f9ccd3bc44 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:38.990155 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4b940e60-1385-4409-95ce-79f9ccd3bc44 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:38.990618 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4b940e60-1385-4409-95ce-79f9ccd3bc44 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:38.993160 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4b940e60-1385-4409-95ce-79f9ccd3bc44 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:39.824577 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4b940e60-1385-4409-95ce-79f9ccd3bc44 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a6d32139caf4574abec46fe34dc00da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74cef405056649b8a9697533c5c7fc52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:19:39.839106 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4b940e60-1385-4409-95ce-79f9ccd3bc44 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] 10.222.0.27 "GET /compute/v2.1/servers/838e470e-405d-4ac9-b222-0a0a5792b05b" status: 200 len: 1271 microversion: 2.1 time: 0.874703 Sep 08 11:19:39.859096 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3187/6237] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:19:38 2022] GET /compute/v2.1/servers/838e470e-405d-4ac9-b222-0a0a5792b05b => generated 1271 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:19:40.865302 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-22912a66-3df8-45d7-9969-fe89c6dbfefc tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:19:40.866558 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-22912a66-3df8-45d7-9969-fe89c6dbfefc tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] [instance: 838e470e-405d-4ac9-b222-0a0a5792b05b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:19:40.878954 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-22912a66-3df8-45d7-9969-fe89c6dbfefc tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:40.879939 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-22912a66-3df8-45d7-9969-fe89c6dbfefc tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:40.880987 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-22912a66-3df8-45d7-9969-fe89c6dbfefc tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:40.883270 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-22912a66-3df8-45d7-9969-fe89c6dbfefc tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:40.883956 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-22912a66-3df8-45d7-9969-fe89c6dbfefc tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:40.884595 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-22912a66-3df8-45d7-9969-fe89c6dbfefc tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:41.355587 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-22912a66-3df8-45d7-9969-fe89c6dbfefc tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a6d32139caf4574abec46fe34dc00da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74cef405056649b8a9697533c5c7fc52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:19:41.368570 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-22912a66-3df8-45d7-9969-fe89c6dbfefc tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] 10.222.0.27 "GET /compute/v2.1/servers/838e470e-405d-4ac9-b222-0a0a5792b05b" status: 200 len: 1271 microversion: 2.1 time: 0.508135 Sep 08 11:19:41.369214 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3051/6238] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:19:40 2022] GET /compute/v2.1/servers/838e470e-405d-4ac9-b222-0a0a5792b05b => generated 1271 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:19:42.401183 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8b662cd4-461d-46a0-bbad-3edd4320c1ec tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:19:42.405188 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8b662cd4-461d-46a0-bbad-3edd4320c1ec tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] [instance: 838e470e-405d-4ac9-b222-0a0a5792b05b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:19:42.418510 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8b662cd4-461d-46a0-bbad-3edd4320c1ec tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:42.419923 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8b662cd4-461d-46a0-bbad-3edd4320c1ec tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:42.420612 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8b662cd4-461d-46a0-bbad-3edd4320c1ec tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:42.421672 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8b662cd4-461d-46a0-bbad-3edd4320c1ec tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:42.423179 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8b662cd4-461d-46a0-bbad-3edd4320c1ec tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:42.423868 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8b662cd4-461d-46a0-bbad-3edd4320c1ec tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:42.731451 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8b662cd4-461d-46a0-bbad-3edd4320c1ec tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a6d32139caf4574abec46fe34dc00da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74cef405056649b8a9697533c5c7fc52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:19:42.742501 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8b662cd4-461d-46a0-bbad-3edd4320c1ec tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] 10.222.0.27 "GET /compute/v2.1/servers/838e470e-405d-4ac9-b222-0a0a5792b05b" status: 200 len: 1271 microversion: 2.1 time: 0.348575 Sep 08 11:19:42.746821 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3188/6239] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:19:42 2022] GET /compute/v2.1/servers/838e470e-405d-4ac9-b222-0a0a5792b05b => generated 1271 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:19:43.737010 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-7039b45c-a950-45b4-bd94-eb5859649934 req-828456a0-45cd-41b5-9755-db2c7f292567 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "838e470e-405d-4ac9-b222-0a0a5792b05b", "name": "network-vif-plugged", "status": "completed", "tag": "7f905fe2-0728-49a8-9146-ac142f3d8007"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:19:43.756484 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-7039b45c-a950-45b4-bd94-eb5859649934 req-828456a0-45cd-41b5-9755-db2c7f292567 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:43.758266 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-7039b45c-a950-45b4-bd94-eb5859649934 req-828456a0-45cd-41b5-9755-db2c7f292567 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:43.759956 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-7039b45c-a950-45b4-bd94-eb5859649934 req-828456a0-45cd-41b5-9755-db2c7f292567 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:43.773441 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f85ec4db-659e-4816-9cd3-bccf05055c96 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:19:43.775285 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f85ec4db-659e-4816-9cd3-bccf05055c96 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] [instance: 838e470e-405d-4ac9-b222-0a0a5792b05b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:19:43.785961 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f85ec4db-659e-4816-9cd3-bccf05055c96 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:43.789142 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f85ec4db-659e-4816-9cd3-bccf05055c96 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:43.789846 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f85ec4db-659e-4816-9cd3-bccf05055c96 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:43.791896 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f85ec4db-659e-4816-9cd3-bccf05055c96 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:43.792798 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f85ec4db-659e-4816-9cd3-bccf05055c96 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:43.793482 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f85ec4db-659e-4816-9cd3-bccf05055c96 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:43.811703 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-7039b45c-a950-45b4-bd94-eb5859649934 req-828456a0-45cd-41b5-9755-db2c7f292567 service nova] Creating event network-vif-plugged:7f905fe2-0728-49a8-9146-ac142f3d8007 for instance 838e470e-405d-4ac9-b222-0a0a5792b05b on n-h2-850501-12 Sep 08 11:19:43.831446 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-7039b45c-a950-45b4-bd94-eb5859649934 req-828456a0-45cd-41b5-9755-db2c7f292567 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093639 Sep 08 11:19:43.834948 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3052/6240] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:19:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:19:44.164302 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f85ec4db-659e-4816-9cd3-bccf05055c96 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a6d32139caf4574abec46fe34dc00da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74cef405056649b8a9697533c5c7fc52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:19:44.180990 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f85ec4db-659e-4816-9cd3-bccf05055c96 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] 10.222.0.27 "GET /compute/v2.1/servers/838e470e-405d-4ac9-b222-0a0a5792b05b" status: 200 len: 1271 microversion: 2.1 time: 0.411505 Sep 08 11:19:44.185996 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3189/6241] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:19:43 2022] GET /compute/v2.1/servers/838e470e-405d-4ac9-b222-0a0a5792b05b => generated 1271 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:19:45.208635 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-200eab57-cac5-48f0-b52d-5c9ed0bced10 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:19:45.210787 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-200eab57-cac5-48f0-b52d-5c9ed0bced10 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] [instance: 838e470e-405d-4ac9-b222-0a0a5792b05b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:19:45.222490 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-200eab57-cac5-48f0-b52d-5c9ed0bced10 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:45.227379 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-200eab57-cac5-48f0-b52d-5c9ed0bced10 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:45.237889 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-200eab57-cac5-48f0-b52d-5c9ed0bced10 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:45.239070 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-200eab57-cac5-48f0-b52d-5c9ed0bced10 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:45.239834 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-200eab57-cac5-48f0-b52d-5c9ed0bced10 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:45.240501 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-200eab57-cac5-48f0-b52d-5c9ed0bced10 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:45.539407 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-200eab57-cac5-48f0-b52d-5c9ed0bced10 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a6d32139caf4574abec46fe34dc00da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74cef405056649b8a9697533c5c7fc52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:19:45.552070 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-200eab57-cac5-48f0-b52d-5c9ed0bced10 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] 10.222.0.27 "GET /compute/v2.1/servers/838e470e-405d-4ac9-b222-0a0a5792b05b" status: 200 len: 1271 microversion: 2.1 time: 0.347298 Sep 08 11:19:45.553925 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3053/6242] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:19:45 2022] GET /compute/v2.1/servers/838e470e-405d-4ac9-b222-0a0a5792b05b => generated 1271 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:19:46.578667 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d6733c42-ea30-4ae1-93a8-8bde91c422ea tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:19:46.583804 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d6733c42-ea30-4ae1-93a8-8bde91c422ea tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] [instance: 838e470e-405d-4ac9-b222-0a0a5792b05b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:19:46.599179 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d6733c42-ea30-4ae1-93a8-8bde91c422ea tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:46.605239 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d6733c42-ea30-4ae1-93a8-8bde91c422ea tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:46.605804 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d6733c42-ea30-4ae1-93a8-8bde91c422ea tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:46.606578 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d6733c42-ea30-4ae1-93a8-8bde91c422ea tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:46.607057 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d6733c42-ea30-4ae1-93a8-8bde91c422ea tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:46.607489 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d6733c42-ea30-4ae1-93a8-8bde91c422ea tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:47.030234 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d6733c42-ea30-4ae1-93a8-8bde91c422ea tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a6d32139caf4574abec46fe34dc00da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74cef405056649b8a9697533c5c7fc52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:19:47.041328 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d6733c42-ea30-4ae1-93a8-8bde91c422ea tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] 10.222.0.27 "GET /compute/v2.1/servers/838e470e-405d-4ac9-b222-0a0a5792b05b" status: 200 len: 1459 microversion: 2.1 time: 0.468810 Sep 08 11:19:47.041932 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3190/6243] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:19:46 2022] GET /compute/v2.1/servers/838e470e-405d-4ac9-b222-0a0a5792b05b => generated 1459 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:19:47.068569 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2cb88a0e-a209-4180-9d52-d06fd2a18a1c tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:19:47.069405 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2cb88a0e-a209-4180-9d52-d06fd2a18a1c tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] [instance: 838e470e-405d-4ac9-b222-0a0a5792b05b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:19:47.076069 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:19:47.077562 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2cb88a0e-a209-4180-9d52-d06fd2a18a1c tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:47.078090 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2cb88a0e-a209-4180-9d52-d06fd2a18a1c tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:47.078482 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2cb88a0e-a209-4180-9d52-d06fd2a18a1c tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:47.079411 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2cb88a0e-a209-4180-9d52-d06fd2a18a1c tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:47.079993 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2cb88a0e-a209-4180-9d52-d06fd2a18a1c tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:47.080429 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2cb88a0e-a209-4180-9d52-d06fd2a18a1c tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:47.309567 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2cb88a0e-a209-4180-9d52-d06fd2a18a1c tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a6d32139caf4574abec46fe34dc00da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74cef405056649b8a9697533c5c7fc52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:19:47.326314 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2cb88a0e-a209-4180-9d52-d06fd2a18a1c tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] 10.222.0.27 "GET /compute/v2.1/servers/838e470e-405d-4ac9-b222-0a0a5792b05b" status: 200 len: 1459 microversion: 2.1 time: 0.262121 Sep 08 11:19:47.326919 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3054/6244] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:19:47 2022] GET /compute/v2.1/servers/838e470e-405d-4ac9-b222-0a0a5792b05b => generated 1459 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:19:49.303641 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-73da82c3-5c86-4488-8b4f-8e228526a3d7 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-607143778", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "d7e55523-543a-4a19-95de-d62f323f9275"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1701457310", "security_groups": [{"name": "tempest-secgroup-smoke-1061474075"}]}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:19:49.334625 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=4 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:19:49.653318 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-73da82c3-5c86-4488-8b4f-8e228526a3d7 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] validate_networks() for [('d7e55523-543a-4a19-95de-d62f323f9275', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:19:50.854640 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-73da82c3-5c86-4488-8b4f-8e228526a3d7 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:19:50.855225 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-73da82c3-5c86-4488-8b4f-8e228526a3d7 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:19:50.855962 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-73da82c3-5c86-4488-8b4f-8e228526a3d7 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:19:50.857087 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-73da82c3-5c86-4488-8b4f-8e228526a3d7 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:19:50.857776 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-73da82c3-5c86-4488-8b4f-8e228526a3d7 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:19:50.893701 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-73da82c3-5c86-4488-8b4f-8e228526a3d7 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:50.899468 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-73da82c3-5c86-4488-8b4f-8e228526a3d7 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:50.901672 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-73da82c3-5c86-4488-8b4f-8e228526a3d7 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:50.904045 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-73da82c3-5c86-4488-8b4f-8e228526a3d7 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:50.908810 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-d4fdcfdd-222a-49ff-b982-53e5cf2bc1bd req-969daaad-6ea5-41bc-9975-239c72dedbd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "838e470e-405d-4ac9-b222-0a0a5792b05b", "tag": "7f905fe2-0728-49a8-9146-ac142f3d8007"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:19:50.909981 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-73da82c3-5c86-4488-8b4f-8e228526a3d7 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:50.910619 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-73da82c3-5c86-4488-8b4f-8e228526a3d7 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:50.938470 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d4fdcfdd-222a-49ff-b982-53e5cf2bc1bd req-969daaad-6ea5-41bc-9975-239c72dedbd0 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:50.939941 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d4fdcfdd-222a-49ff-b982-53e5cf2bc1bd req-969daaad-6ea5-41bc-9975-239c72dedbd0 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:50.940687 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d4fdcfdd-222a-49ff-b982-53e5cf2bc1bd req-969daaad-6ea5-41bc-9975-239c72dedbd0 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:50.964435 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-d4fdcfdd-222a-49ff-b982-53e5cf2bc1bd req-969daaad-6ea5-41bc-9975-239c72dedbd0 service nova] Creating event network-changed:7f905fe2-0728-49a8-9146-ac142f3d8007 for instance 838e470e-405d-4ac9-b222-0a0a5792b05b on n-h2-850501-12 Sep 08 11:19:50.971636 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-d4fdcfdd-222a-49ff-b982-53e5cf2bc1bd req-969daaad-6ea5-41bc-9975-239c72dedbd0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071009 Sep 08 11:19:50.973994 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-73da82c3-5c86-4488-8b4f-8e228526a3d7 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Getting quotas for project a0f9071124e74802a2f76cb326ca58df. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:19:50.977423 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3055/6245] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:19:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:19:50.995085 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-73da82c3-5c86-4488-8b4f-8e228526a3d7 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Getting quotas for user c33e91fa4e3746aa8d8d23940e17bc1e and project a0f9071124e74802a2f76cb326ca58df. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:19:51.036938 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-73da82c3-5c86-4488-8b4f-8e228526a3d7 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:19:51.044193 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-73da82c3-5c86-4488-8b4f-8e228526a3d7 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 32ae7194-7c7b-401a-9ffc-8ba37edade77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:19:51.217886 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-73da82c3-5c86-4488-8b4f-8e228526a3d7 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.918252 Sep 08 11:19:51.222000 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3191/6246] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 11:19:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 1923 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:19:51.245495 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9b55ef99-94f9-409b-a2c9-015d991fcaa5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:19:51.248147 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9b55ef99-94f9-409b-a2c9-015d991fcaa5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 32ae7194-7c7b-401a-9ffc-8ba37edade77] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:19:51.540770 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9b55ef99-94f9-409b-a2c9-015d991fcaa5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:19:51.550045 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9b55ef99-94f9-409b-a2c9-015d991fcaa5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/32ae7194-7c7b-401a-9ffc-8ba37edade77" status: 200 len: 1266 microversion: 2.1 time: 0.318052 Sep 08 11:19:51.550501 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3056/6247] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:19:51 2022] GET /compute/v2.1/servers/32ae7194-7c7b-401a-9ffc-8ba37edade77 => generated 1266 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:19:52.572689 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-53978a85-e04e-4c39-b656-ae81960dd92a tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:19:52.573454 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-53978a85-e04e-4c39-b656-ae81960dd92a tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 32ae7194-7c7b-401a-9ffc-8ba37edade77] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:19:52.591017 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-53978a85-e04e-4c39-b656-ae81960dd92a tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:52.591308 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-53978a85-e04e-4c39-b656-ae81960dd92a tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:52.592482 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-53978a85-e04e-4c39-b656-ae81960dd92a tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:52.593482 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-53978a85-e04e-4c39-b656-ae81960dd92a tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:52.595342 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-53978a85-e04e-4c39-b656-ae81960dd92a tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:52.596357 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-53978a85-e04e-4c39-b656-ae81960dd92a tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:52.784338 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-53978a85-e04e-4c39-b656-ae81960dd92a tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:19:52.799708 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-53978a85-e04e-4c39-b656-ae81960dd92a tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/32ae7194-7c7b-401a-9ffc-8ba37edade77" status: 200 len: 1318 microversion: 2.1 time: 0.231152 Sep 08 11:19:52.800732 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3192/6248] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:19:52 2022] GET /compute/v2.1/servers/32ae7194-7c7b-401a-9ffc-8ba37edade77 => generated 1318 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:19:53.825603 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e3189c18-e6b9-43f4-90bd-fc9dd7772925 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:19:53.826380 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e3189c18-e6b9-43f4-90bd-fc9dd7772925 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 32ae7194-7c7b-401a-9ffc-8ba37edade77] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:19:53.843307 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e3189c18-e6b9-43f4-90bd-fc9dd7772925 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:53.843961 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e3189c18-e6b9-43f4-90bd-fc9dd7772925 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:53.844317 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e3189c18-e6b9-43f4-90bd-fc9dd7772925 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:53.845080 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e3189c18-e6b9-43f4-90bd-fc9dd7772925 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:53.845794 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e3189c18-e6b9-43f4-90bd-fc9dd7772925 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:53.846501 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e3189c18-e6b9-43f4-90bd-fc9dd7772925 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:53.867479 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:19:54.119731 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e3189c18-e6b9-43f4-90bd-fc9dd7772925 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:19:54.137644 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e3189c18-e6b9-43f4-90bd-fc9dd7772925 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/32ae7194-7c7b-401a-9ffc-8ba37edade77" status: 200 len: 1324 microversion: 2.1 time: 0.316016 Sep 08 11:19:54.139500 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3057/6249] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:19:53 2022] GET /compute/v2.1/servers/32ae7194-7c7b-401a-9ffc-8ba37edade77 => generated 1324 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:19:54.853715 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-8f30386c-331c-4305-a784-0719f362f7f5 req-0a7271e8-096f-412c-9134-5b5d8933c2e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "838e470e-405d-4ac9-b222-0a0a5792b05b", "tag": "7f905fe2-0728-49a8-9146-ac142f3d8007"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:19:54.867190 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-8f30386c-331c-4305-a784-0719f362f7f5 req-0a7271e8-096f-412c-9134-5b5d8933c2e5 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:54.870584 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-8f30386c-331c-4305-a784-0719f362f7f5 req-0a7271e8-096f-412c-9134-5b5d8933c2e5 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:54.873756 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-8f30386c-331c-4305-a784-0719f362f7f5 req-0a7271e8-096f-412c-9134-5b5d8933c2e5 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:54.903199 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-8f30386c-331c-4305-a784-0719f362f7f5 req-0a7271e8-096f-412c-9134-5b5d8933c2e5 service nova] Creating event network-changed:7f905fe2-0728-49a8-9146-ac142f3d8007 for instance 838e470e-405d-4ac9-b222-0a0a5792b05b on n-h2-850501-12 Sep 08 11:19:54.913276 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-8f30386c-331c-4305-a784-0719f362f7f5 req-0a7271e8-096f-412c-9134-5b5d8933c2e5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063210 Sep 08 11:19:54.917135 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3193/6250] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:19:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:19:55.168025 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4800bcb2-68d8-4940-ba82-d368b10c7573 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:19:55.171192 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4800bcb2-68d8-4940-ba82-d368b10c7573 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 32ae7194-7c7b-401a-9ffc-8ba37edade77] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:19:55.182393 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4800bcb2-68d8-4940-ba82-d368b10c7573 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:55.184015 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4800bcb2-68d8-4940-ba82-d368b10c7573 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:55.184638 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4800bcb2-68d8-4940-ba82-d368b10c7573 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:55.185784 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4800bcb2-68d8-4940-ba82-d368b10c7573 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:55.186422 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4800bcb2-68d8-4940-ba82-d368b10c7573 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:55.187013 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4800bcb2-68d8-4940-ba82-d368b10c7573 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:55.765219 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4800bcb2-68d8-4940-ba82-d368b10c7573 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:19:55.789663 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4800bcb2-68d8-4940-ba82-d368b10c7573 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/32ae7194-7c7b-401a-9ffc-8ba37edade77" status: 200 len: 1392 microversion: 2.1 time: 0.626817 Sep 08 11:19:55.790878 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3058/6251] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:19:55 2022] GET /compute/v2.1/servers/32ae7194-7c7b-401a-9ffc-8ba37edade77 => generated 1392 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:19:56.817617 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5375eeed-1a05-4ddb-bc72-fa947f4d3fdc tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:19:56.818980 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5375eeed-1a05-4ddb-bc72-fa947f4d3fdc tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 32ae7194-7c7b-401a-9ffc-8ba37edade77] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:19:56.847352 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5375eeed-1a05-4ddb-bc72-fa947f4d3fdc tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:56.847875 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5375eeed-1a05-4ddb-bc72-fa947f4d3fdc tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:56.848321 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5375eeed-1a05-4ddb-bc72-fa947f4d3fdc tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:56.856115 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5375eeed-1a05-4ddb-bc72-fa947f4d3fdc tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:56.857290 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5375eeed-1a05-4ddb-bc72-fa947f4d3fdc tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:56.858427 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5375eeed-1a05-4ddb-bc72-fa947f4d3fdc tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:56.954314 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-3ad986af-e5ef-4f17-9a2c-f1d42a0812d8 req-9de60179-9723-45ef-8834-d0d28dc749d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "838e470e-405d-4ac9-b222-0a0a5792b05b", "tag": "7f905fe2-0728-49a8-9146-ac142f3d8007"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:19:56.982227 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-3ad986af-e5ef-4f17-9a2c-f1d42a0812d8 req-9de60179-9723-45ef-8834-d0d28dc749d6 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:56.983229 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-3ad986af-e5ef-4f17-9a2c-f1d42a0812d8 req-9de60179-9723-45ef-8834-d0d28dc749d6 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:56.983868 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-3ad986af-e5ef-4f17-9a2c-f1d42a0812d8 req-9de60179-9723-45ef-8834-d0d28dc749d6 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:57.002233 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-3ad986af-e5ef-4f17-9a2c-f1d42a0812d8 req-9de60179-9723-45ef-8834-d0d28dc749d6 service nova] Creating event network-changed:7f905fe2-0728-49a8-9146-ac142f3d8007 for instance 838e470e-405d-4ac9-b222-0a0a5792b05b on n-h2-850501-12 Sep 08 11:19:57.012387 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-3ad986af-e5ef-4f17-9a2c-f1d42a0812d8 req-9de60179-9723-45ef-8834-d0d28dc749d6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061775 Sep 08 11:19:57.013528 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3059/6252] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:19:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:19:57.242847 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5375eeed-1a05-4ddb-bc72-fa947f4d3fdc tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:19:57.259188 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5375eeed-1a05-4ddb-bc72-fa947f4d3fdc tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/32ae7194-7c7b-401a-9ffc-8ba37edade77" status: 200 len: 1392 microversion: 2.1 time: 0.449152 Sep 08 11:19:57.279927 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3194/6253] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:19:56 2022] GET /compute/v2.1/servers/32ae7194-7c7b-401a-9ffc-8ba37edade77 => generated 1392 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:19:57.293378 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-334ef652-6f15-4c99-8af7-a2b9c19a6130 req-1c83b674-e63e-4502-80f0-a793c6531762 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32ae7194-7c7b-401a-9ffc-8ba37edade77", "tag": "9fb97025-3ccf-4a27-a965-ddd3f1b88d13"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:19:57.309895 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-334ef652-6f15-4c99-8af7-a2b9c19a6130 req-1c83b674-e63e-4502-80f0-a793c6531762 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:57.310785 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-334ef652-6f15-4c99-8af7-a2b9c19a6130 req-1c83b674-e63e-4502-80f0-a793c6531762 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:57.312379 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-334ef652-6f15-4c99-8af7-a2b9c19a6130 req-1c83b674-e63e-4502-80f0-a793c6531762 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:57.338996 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-334ef652-6f15-4c99-8af7-a2b9c19a6130 req-1c83b674-e63e-4502-80f0-a793c6531762 service nova] Creating event network-changed:9fb97025-3ccf-4a27-a965-ddd3f1b88d13 for instance 32ae7194-7c7b-401a-9ffc-8ba37edade77 on n-h1-850501-12 Sep 08 11:19:57.345251 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-334ef652-6f15-4c99-8af7-a2b9c19a6130 req-1c83b674-e63e-4502-80f0-a793c6531762 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059207 Sep 08 11:19:57.346743 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3060/6254] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:19:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:19:58.293248 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fe827e0b-43ac-4448-a629-8c2a7cbb54ed tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:19:58.294578 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fe827e0b-43ac-4448-a629-8c2a7cbb54ed tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 32ae7194-7c7b-401a-9ffc-8ba37edade77] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:19:58.309259 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fe827e0b-43ac-4448-a629-8c2a7cbb54ed tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:58.310475 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fe827e0b-43ac-4448-a629-8c2a7cbb54ed tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:58.310995 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fe827e0b-43ac-4448-a629-8c2a7cbb54ed tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:58.311812 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fe827e0b-43ac-4448-a629-8c2a7cbb54ed tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:58.312644 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fe827e0b-43ac-4448-a629-8c2a7cbb54ed tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:58.313420 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fe827e0b-43ac-4448-a629-8c2a7cbb54ed tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:58.571258 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-fe827e0b-43ac-4448-a629-8c2a7cbb54ed tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:19:58.590159 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fe827e0b-43ac-4448-a629-8c2a7cbb54ed tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/32ae7194-7c7b-401a-9ffc-8ba37edade77" status: 200 len: 1392 microversion: 2.1 time: 0.305273 Sep 08 11:19:58.591420 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3195/6255] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:19:58 2022] GET /compute/v2.1/servers/32ae7194-7c7b-401a-9ffc-8ba37edade77 => generated 1392 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:19:59.619792 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-66604b34-8858-4494-b003-062c8cf3f93b tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:19:59.620603 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-66604b34-8858-4494-b003-062c8cf3f93b tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 32ae7194-7c7b-401a-9ffc-8ba37edade77] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:19:59.631119 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-66604b34-8858-4494-b003-062c8cf3f93b tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:59.636346 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-66604b34-8858-4494-b003-062c8cf3f93b tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:59.637218 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-66604b34-8858-4494-b003-062c8cf3f93b tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:59.638161 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-66604b34-8858-4494-b003-062c8cf3f93b tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:59.641354 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-66604b34-8858-4494-b003-062c8cf3f93b tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:59.642130 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-66604b34-8858-4494-b003-062c8cf3f93b tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:00.070698 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-66604b34-8858-4494-b003-062c8cf3f93b tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:20:00.082905 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-66604b34-8858-4494-b003-062c8cf3f93b tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/32ae7194-7c7b-401a-9ffc-8ba37edade77" status: 200 len: 1392 microversion: 2.1 time: 0.468352 Sep 08 11:20:00.083663 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3061/6256] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:19:59 2022] GET /compute/v2.1/servers/32ae7194-7c7b-401a-9ffc-8ba37edade77 => generated 1392 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:20:01.106530 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-02c19def-0c2c-4194-b3c0-1ee691105949 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:20:01.107740 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-02c19def-0c2c-4194-b3c0-1ee691105949 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 32ae7194-7c7b-401a-9ffc-8ba37edade77] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:20:01.110905 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:20:01.113333 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=6 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:20:01.121475 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-02c19def-0c2c-4194-b3c0-1ee691105949 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:01.122163 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-02c19def-0c2c-4194-b3c0-1ee691105949 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:01.122801 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-02c19def-0c2c-4194-b3c0-1ee691105949 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:01.123907 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-02c19def-0c2c-4194-b3c0-1ee691105949 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:01.124532 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-02c19def-0c2c-4194-b3c0-1ee691105949 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:01.125161 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-02c19def-0c2c-4194-b3c0-1ee691105949 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:01.474860 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-02c19def-0c2c-4194-b3c0-1ee691105949 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:20:01.484728 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-02c19def-0c2c-4194-b3c0-1ee691105949 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/32ae7194-7c7b-401a-9ffc-8ba37edade77" status: 200 len: 1392 microversion: 2.1 time: 0.382035 Sep 08 11:20:01.485384 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3196/6257] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:20:01 2022] GET /compute/v2.1/servers/32ae7194-7c7b-401a-9ffc-8ba37edade77 => generated 1392 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:20:02.508658 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-99d00383-c471-41a5-9a12-5c3c5a3c2a42 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:20:02.509885 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-99d00383-c471-41a5-9a12-5c3c5a3c2a42 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 32ae7194-7c7b-401a-9ffc-8ba37edade77] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:20:02.516672 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:20:02.519129 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-99d00383-c471-41a5-9a12-5c3c5a3c2a42 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:02.520164 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-99d00383-c471-41a5-9a12-5c3c5a3c2a42 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:02.522037 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-99d00383-c471-41a5-9a12-5c3c5a3c2a42 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:02.523187 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-99d00383-c471-41a5-9a12-5c3c5a3c2a42 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:02.523880 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-99d00383-c471-41a5-9a12-5c3c5a3c2a42 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:02.524669 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-99d00383-c471-41a5-9a12-5c3c5a3c2a42 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:02.764017 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-99d00383-c471-41a5-9a12-5c3c5a3c2a42 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:20:02.773354 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-99d00383-c471-41a5-9a12-5c3c5a3c2a42 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/32ae7194-7c7b-401a-9ffc-8ba37edade77" status: 200 len: 1392 microversion: 2.1 time: 0.268510 Sep 08 11:20:02.774664 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3062/6258] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:20:02 2022] GET /compute/v2.1/servers/32ae7194-7c7b-401a-9ffc-8ba37edade77 => generated 1392 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:20:03.179948 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-7549aa1e-0696-4e8f-9fe2-7787bd3648f0 req-cbd5f78f-0cc6-48e3-ae50-42d58d519bf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32ae7194-7c7b-401a-9ffc-8ba37edade77", "name": "network-vif-plugged", "status": "completed", "tag": "9fb97025-3ccf-4a27-a965-ddd3f1b88d13"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:20:03.202554 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=4 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:20:03.205147 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-7549aa1e-0696-4e8f-9fe2-7787bd3648f0 req-cbd5f78f-0cc6-48e3-ae50-42d58d519bf3 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:03.210450 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-7549aa1e-0696-4e8f-9fe2-7787bd3648f0 req-cbd5f78f-0cc6-48e3-ae50-42d58d519bf3 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:03.212232 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-7549aa1e-0696-4e8f-9fe2-7787bd3648f0 req-cbd5f78f-0cc6-48e3-ae50-42d58d519bf3 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:03.230747 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=64 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:20:03.252946 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-7549aa1e-0696-4e8f-9fe2-7787bd3648f0 req-cbd5f78f-0cc6-48e3-ae50-42d58d519bf3 service nova] Creating event network-vif-plugged:9fb97025-3ccf-4a27-a965-ddd3f1b88d13 for instance 32ae7194-7c7b-401a-9ffc-8ba37edade77 on n-h1-850501-12 Sep 08 11:20:03.264705 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-7549aa1e-0696-4e8f-9fe2-7787bd3648f0 req-cbd5f78f-0cc6-48e3-ae50-42d58d519bf3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091678 Sep 08 11:20:03.266411 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3197/6259] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:20:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:20:03.799161 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2fdd71b3-3a07-471d-a0f8-cea4233c7ac5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:20:03.800917 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2fdd71b3-3a07-471d-a0f8-cea4233c7ac5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 32ae7194-7c7b-401a-9ffc-8ba37edade77] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:20:03.808161 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2fdd71b3-3a07-471d-a0f8-cea4233c7ac5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:03.808918 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2fdd71b3-3a07-471d-a0f8-cea4233c7ac5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:03.809384 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2fdd71b3-3a07-471d-a0f8-cea4233c7ac5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:03.810108 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2fdd71b3-3a07-471d-a0f8-cea4233c7ac5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:03.810573 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2fdd71b3-3a07-471d-a0f8-cea4233c7ac5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:03.811004 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2fdd71b3-3a07-471d-a0f8-cea4233c7ac5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:04.059719 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2fdd71b3-3a07-471d-a0f8-cea4233c7ac5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:20:04.070381 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2fdd71b3-3a07-471d-a0f8-cea4233c7ac5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/32ae7194-7c7b-401a-9ffc-8ba37edade77" status: 200 len: 1392 microversion: 2.1 time: 0.274927 Sep 08 11:20:04.071293 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3063/6260] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:20:03 2022] GET /compute/v2.1/servers/32ae7194-7c7b-401a-9ffc-8ba37edade77 => generated 1392 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:20:05.098149 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-906b928b-8ef5-4771-a9d8-5eee3d400973 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:20:05.099266 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-906b928b-8ef5-4771-a9d8-5eee3d400973 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 32ae7194-7c7b-401a-9ffc-8ba37edade77] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:20:05.107909 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-906b928b-8ef5-4771-a9d8-5eee3d400973 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:05.109020 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-906b928b-8ef5-4771-a9d8-5eee3d400973 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:05.117258 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-906b928b-8ef5-4771-a9d8-5eee3d400973 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:05.118038 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-906b928b-8ef5-4771-a9d8-5eee3d400973 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:05.119081 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-906b928b-8ef5-4771-a9d8-5eee3d400973 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:05.119758 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-906b928b-8ef5-4771-a9d8-5eee3d400973 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:05.467163 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-906b928b-8ef5-4771-a9d8-5eee3d400973 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:20:05.475795 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-906b928b-8ef5-4771-a9d8-5eee3d400973 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/32ae7194-7c7b-401a-9ffc-8ba37edade77" status: 200 len: 1564 microversion: 2.1 time: 0.384480 Sep 08 11:20:05.476387 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3198/6261] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:20:05 2022] GET /compute/v2.1/servers/32ae7194-7c7b-401a-9ffc-8ba37edade77 => generated 1564 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:20:05.498468 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-43d4c557-6a01-4300-93f0-28be09949870 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:20:05.499362 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-43d4c557-6a01-4300-93f0-28be09949870 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 32ae7194-7c7b-401a-9ffc-8ba37edade77] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:20:05.507444 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-43d4c557-6a01-4300-93f0-28be09949870 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:05.507946 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-43d4c557-6a01-4300-93f0-28be09949870 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:05.508390 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-43d4c557-6a01-4300-93f0-28be09949870 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:05.509098 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-43d4c557-6a01-4300-93f0-28be09949870 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:05.509583 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-43d4c557-6a01-4300-93f0-28be09949870 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:05.510118 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-43d4c557-6a01-4300-93f0-28be09949870 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:05.658131 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-43d4c557-6a01-4300-93f0-28be09949870 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:20:05.667528 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-43d4c557-6a01-4300-93f0-28be09949870 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/32ae7194-7c7b-401a-9ffc-8ba37edade77" status: 200 len: 1564 microversion: 2.1 time: 0.173130 Sep 08 11:20:05.668188 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3064/6262] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:20:05 2022] GET /compute/v2.1/servers/32ae7194-7c7b-401a-9ffc-8ba37edade77 => generated 1564 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:20:08.021770 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9c7071d8-953d-414a-a7bb-0edc1e4eb6fc tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:20:08.027962 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-b632f82d-e339-4e3d-86c1-ea6b8c3526be req-d3e19255-1f2a-4ec2-b5e6-5d7025a276b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32ae7194-7c7b-401a-9ffc-8ba37edade77", "tag": "9fb97025-3ccf-4a27-a965-ddd3f1b88d13"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:20:08.031170 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9c7071d8-953d-414a-a7bb-0edc1e4eb6fc tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 32ae7194-7c7b-401a-9ffc-8ba37edade77] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:20:08.055260 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9c7071d8-953d-414a-a7bb-0edc1e4eb6fc tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:08.055763 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9c7071d8-953d-414a-a7bb-0edc1e4eb6fc tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:08.058908 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9c7071d8-953d-414a-a7bb-0edc1e4eb6fc tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:08.061771 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9c7071d8-953d-414a-a7bb-0edc1e4eb6fc tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:08.064803 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9c7071d8-953d-414a-a7bb-0edc1e4eb6fc tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:08.064989 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b632f82d-e339-4e3d-86c1-ea6b8c3526be req-d3e19255-1f2a-4ec2-b5e6-5d7025a276b1 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:08.065603 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b632f82d-e339-4e3d-86c1-ea6b8c3526be req-d3e19255-1f2a-4ec2-b5e6-5d7025a276b1 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:08.066083 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b632f82d-e339-4e3d-86c1-ea6b8c3526be req-d3e19255-1f2a-4ec2-b5e6-5d7025a276b1 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:08.068428 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9c7071d8-953d-414a-a7bb-0edc1e4eb6fc tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:08.099611 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-b632f82d-e339-4e3d-86c1-ea6b8c3526be req-d3e19255-1f2a-4ec2-b5e6-5d7025a276b1 service nova] Creating event network-changed:9fb97025-3ccf-4a27-a965-ddd3f1b88d13 for instance 32ae7194-7c7b-401a-9ffc-8ba37edade77 on n-h1-850501-12 Sep 08 11:20:08.115609 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-b632f82d-e339-4e3d-86c1-ea6b8c3526be req-d3e19255-1f2a-4ec2-b5e6-5d7025a276b1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091805 Sep 08 11:20:08.117144 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3065/6263] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:20:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:20:08.532822 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9c7071d8-953d-414a-a7bb-0edc1e4eb6fc tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:20:08.549232 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9c7071d8-953d-414a-a7bb-0edc1e4eb6fc tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/32ae7194-7c7b-401a-9ffc-8ba37edade77" status: 200 len: 1564 microversion: 2.1 time: 0.532619 Sep 08 11:20:08.551950 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3199/6264] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:20:08 2022] GET /compute/v2.1/servers/32ae7194-7c7b-401a-9ffc-8ba37edade77 => generated 1564 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:20:27.720895 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=25 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:20:27.721676 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=41 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:20:27.726925 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cf9b21e7-a325-49ad-9d02-87088259e9bd tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:20:27.727534 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cf9b21e7-a325-49ad-9d02-87088259e9bd tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] [instance: 838e470e-405d-4ac9-b222-0a0a5792b05b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:20:27.734140 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cf9b21e7-a325-49ad-9d02-87088259e9bd tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:27.734645 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cf9b21e7-a325-49ad-9d02-87088259e9bd tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:27.735089 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cf9b21e7-a325-49ad-9d02-87088259e9bd tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:27.735810 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cf9b21e7-a325-49ad-9d02-87088259e9bd tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:27.736283 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cf9b21e7-a325-49ad-9d02-87088259e9bd tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:27.736414 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=5 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:20:27.736842 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cf9b21e7-a325-49ad-9d02-87088259e9bd tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:27.737054 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=13 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:20:27.742813 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-fe1480ae-b62e-4573-b814-7425fea977a3 req-7215c02a-91d5-4646-aba3-63f84698b488 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "838e470e-405d-4ac9-b222-0a0a5792b05b", "tag": "7f905fe2-0728-49a8-9146-ac142f3d8007"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:20:27.771694 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-fe1480ae-b62e-4573-b814-7425fea977a3 req-7215c02a-91d5-4646-aba3-63f84698b488 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:27.772182 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-fe1480ae-b62e-4573-b814-7425fea977a3 req-7215c02a-91d5-4646-aba3-63f84698b488 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:27.772618 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-fe1480ae-b62e-4573-b814-7425fea977a3 req-7215c02a-91d5-4646-aba3-63f84698b488 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:27.782910 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cf9b21e7-a325-49ad-9d02-87088259e9bd tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] [instance: 838e470e-405d-4ac9-b222-0a0a5792b05b] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:20:27.806069 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-fe1480ae-b62e-4573-b814-7425fea977a3 req-7215c02a-91d5-4646-aba3-63f84698b488 service nova] Creating event network-changed:7f905fe2-0728-49a8-9146-ac142f3d8007 for instance 838e470e-405d-4ac9-b222-0a0a5792b05b on n-h2-850501-12 Sep 08 11:20:27.814425 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-fe1480ae-b62e-4573-b814-7425fea977a3 req-7215c02a-91d5-4646-aba3-63f84698b488 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079075 Sep 08 11:20:27.815557 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3200/6265] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:20:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:20:27.908939 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cf9b21e7-a325-49ad-9d02-87088259e9bd tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] 10.222.0.27 "DELETE /compute/v2.1/servers/838e470e-405d-4ac9-b222-0a0a5792b05b" status: 204 len: 0 microversion: 2.1 time: 0.189305 Sep 08 11:20:27.909741 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3066/6266] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:20:27 2022] DELETE /compute/v2.1/servers/838e470e-405d-4ac9-b222-0a0a5792b05b => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:20:27.922142 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4e59186b-ab5a-4666-9a44-58e774ffceb1 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:20:27.922867 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4e59186b-ab5a-4666-9a44-58e774ffceb1 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] [instance: 838e470e-405d-4ac9-b222-0a0a5792b05b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:20:27.931945 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4e59186b-ab5a-4666-9a44-58e774ffceb1 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:27.932701 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4e59186b-ab5a-4666-9a44-58e774ffceb1 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:27.934677 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4e59186b-ab5a-4666-9a44-58e774ffceb1 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:27.936022 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4e59186b-ab5a-4666-9a44-58e774ffceb1 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:27.936940 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4e59186b-ab5a-4666-9a44-58e774ffceb1 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:27.937583 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4e59186b-ab5a-4666-9a44-58e774ffceb1 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:28.265939 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4e59186b-ab5a-4666-9a44-58e774ffceb1 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a6d32139caf4574abec46fe34dc00da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74cef405056649b8a9697533c5c7fc52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:20:28.277234 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4e59186b-ab5a-4666-9a44-58e774ffceb1 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] 10.222.0.27 "GET /compute/v2.1/servers/838e470e-405d-4ac9-b222-0a0a5792b05b" status: 200 len: 1583 microversion: 2.1 time: 0.360126 Sep 08 11:20:28.278836 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3201/6267] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:20:27 2022] GET /compute/v2.1/servers/838e470e-405d-4ac9-b222-0a0a5792b05b => generated 1583 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:20:29.309801 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4e525b70-74ef-4baf-a09d-815076fbd11d tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:20:29.310623 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4e525b70-74ef-4baf-a09d-815076fbd11d tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] [instance: 838e470e-405d-4ac9-b222-0a0a5792b05b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:20:29.329566 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e525b70-74ef-4baf-a09d-815076fbd11d tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:29.330513 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e525b70-74ef-4baf-a09d-815076fbd11d tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:29.331288 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e525b70-74ef-4baf-a09d-815076fbd11d tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:29.332481 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e525b70-74ef-4baf-a09d-815076fbd11d tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:29.338970 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e525b70-74ef-4baf-a09d-815076fbd11d tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:29.340385 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e525b70-74ef-4baf-a09d-815076fbd11d tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:29.668164 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4e525b70-74ef-4baf-a09d-815076fbd11d tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a6d32139caf4574abec46fe34dc00da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74cef405056649b8a9697533c5c7fc52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:20:29.683461 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4e525b70-74ef-4baf-a09d-815076fbd11d tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] 10.222.0.27 "GET /compute/v2.1/servers/838e470e-405d-4ac9-b222-0a0a5792b05b" status: 200 len: 1583 microversion: 2.1 time: 0.380634 Sep 08 11:20:29.684549 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3067/6268] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:20:29 2022] GET /compute/v2.1/servers/838e470e-405d-4ac9-b222-0a0a5792b05b => generated 1583 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:20:30.712896 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-94a07fd9-bfd9-4941-96b0-c1bf9df83cdf tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:20:30.713596 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-94a07fd9-bfd9-4941-96b0-c1bf9df83cdf tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] [instance: 838e470e-405d-4ac9-b222-0a0a5792b05b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:20:30.731168 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-94a07fd9-bfd9-4941-96b0-c1bf9df83cdf tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:30.731580 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-94a07fd9-bfd9-4941-96b0-c1bf9df83cdf tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:30.732017 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-94a07fd9-bfd9-4941-96b0-c1bf9df83cdf tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:30.732732 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-94a07fd9-bfd9-4941-96b0-c1bf9df83cdf tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:30.742037 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-94a07fd9-bfd9-4941-96b0-c1bf9df83cdf tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:30.742627 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-94a07fd9-bfd9-4941-96b0-c1bf9df83cdf tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:31.121221 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-94a07fd9-bfd9-4941-96b0-c1bf9df83cdf tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a6d32139caf4574abec46fe34dc00da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74cef405056649b8a9697533c5c7fc52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:20:31.142319 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-94a07fd9-bfd9-4941-96b0-c1bf9df83cdf tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] 10.222.0.27 "GET /compute/v2.1/servers/838e470e-405d-4ac9-b222-0a0a5792b05b" status: 200 len: 1465 microversion: 2.1 time: 0.433968 Sep 08 11:20:31.143795 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3202/6269] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:20:30 2022] GET /compute/v2.1/servers/838e470e-405d-4ac9-b222-0a0a5792b05b => generated 1465 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:20:31.405581 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-97a11dda-2520-4a7a-859e-08310c2b7acd req-e737d936-dcde-4a30-9e3a-25941b7639a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "838e470e-405d-4ac9-b222-0a0a5792b05b", "name": "network-vif-deleted", "tag": "7f905fe2-0728-49a8-9146-ac142f3d8007"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:20:31.432619 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-97a11dda-2520-4a7a-859e-08310c2b7acd req-e737d936-dcde-4a30-9e3a-25941b7639a5 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:31.437564 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-97a11dda-2520-4a7a-859e-08310c2b7acd req-e737d936-dcde-4a30-9e3a-25941b7639a5 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:31.438195 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-97a11dda-2520-4a7a-859e-08310c2b7acd req-e737d936-dcde-4a30-9e3a-25941b7639a5 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:31.466763 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-97a11dda-2520-4a7a-859e-08310c2b7acd req-e737d936-dcde-4a30-9e3a-25941b7639a5 service nova] Creating event network-vif-deleted:7f905fe2-0728-49a8-9146-ac142f3d8007 for instance 838e470e-405d-4ac9-b222-0a0a5792b05b on n-h2-850501-12 Sep 08 11:20:31.478146 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-97a11dda-2520-4a7a-859e-08310c2b7acd req-e737d936-dcde-4a30-9e3a-25941b7639a5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.346519 Sep 08 11:20:31.480179 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3068/6270] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:20:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:20:31.996094 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bdce9405-ebb2-4964-b8b1-6a9c5e470918 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:20:31.998925 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bdce9405-ebb2-4964-b8b1-6a9c5e470918 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 32ae7194-7c7b-401a-9ffc-8ba37edade77] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:20:32.007131 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bdce9405-ebb2-4964-b8b1-6a9c5e470918 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:32.007640 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bdce9405-ebb2-4964-b8b1-6a9c5e470918 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:32.008080 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bdce9405-ebb2-4964-b8b1-6a9c5e470918 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:32.008825 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bdce9405-ebb2-4964-b8b1-6a9c5e470918 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:32.009340 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bdce9405-ebb2-4964-b8b1-6a9c5e470918 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:32.009767 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bdce9405-ebb2-4964-b8b1-6a9c5e470918 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:32.071838 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bdce9405-ebb2-4964-b8b1-6a9c5e470918 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "POST /compute/v2.1/servers/32ae7194-7c7b-401a-9ffc-8ba37edade77/action" status: 200 len: 24566 microversion: 2.1 time: 0.079240 Sep 08 11:20:32.074207 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3203/6271] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 11:20:31 2022] POST /compute/v2.1/servers/32ae7194-7c7b-401a-9ffc-8ba37edade77/action => generated 24566 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 11:20:32.167925 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9c625550-1a80-4936-8da5-a999c2cf8c65 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:20:32.168673 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9c625550-1a80-4936-8da5-a999c2cf8c65 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] [instance: 838e470e-405d-4ac9-b222-0a0a5792b05b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:20:32.178016 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9c625550-1a80-4936-8da5-a999c2cf8c65 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:32.178804 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9c625550-1a80-4936-8da5-a999c2cf8c65 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:32.179719 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9c625550-1a80-4936-8da5-a999c2cf8c65 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:32.180477 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9c625550-1a80-4936-8da5-a999c2cf8c65 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:32.180956 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9c625550-1a80-4936-8da5-a999c2cf8c65 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:32.181666 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9c625550-1a80-4936-8da5-a999c2cf8c65 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:32.254555 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9c625550-1a80-4936-8da5-a999c2cf8c65 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a6d32139caf4574abec46fe34dc00da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74cef405056649b8a9697533c5c7fc52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:20:32.264679 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9c625550-1a80-4936-8da5-a999c2cf8c65 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] 10.222.0.27 "GET /compute/v2.1/servers/838e470e-405d-4ac9-b222-0a0a5792b05b" status: 200 len: 1230 microversion: 2.1 time: 0.101216 Sep 08 11:20:32.265639 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3069/6272] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:20:32 2022] GET /compute/v2.1/servers/838e470e-405d-4ac9-b222-0a0a5792b05b => generated 1230 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:20:33.293506 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e7cd378a-42a8-429d-8bc5-5c8b6df9ad70 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:20:33.294320 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e7cd378a-42a8-429d-8bc5-5c8b6df9ad70 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] [instance: 838e470e-405d-4ac9-b222-0a0a5792b05b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:20:33.309683 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e7cd378a-42a8-429d-8bc5-5c8b6df9ad70 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:33.310295 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e7cd378a-42a8-429d-8bc5-5c8b6df9ad70 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:33.310812 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e7cd378a-42a8-429d-8bc5-5c8b6df9ad70 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:33.311599 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e7cd378a-42a8-429d-8bc5-5c8b6df9ad70 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:33.312133 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e7cd378a-42a8-429d-8bc5-5c8b6df9ad70 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:33.312627 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e7cd378a-42a8-429d-8bc5-5c8b6df9ad70 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:33.484003 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e7cd378a-42a8-429d-8bc5-5c8b6df9ad70 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a6d32139caf4574abec46fe34dc00da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74cef405056649b8a9697533c5c7fc52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:20:33.492987 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e7cd378a-42a8-429d-8bc5-5c8b6df9ad70 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] 10.222.0.27 "GET /compute/v2.1/servers/838e470e-405d-4ac9-b222-0a0a5792b05b" status: 200 len: 1230 microversion: 2.1 time: 0.204046 Sep 08 11:20:33.493610 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3204/6273] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:20:33 2022] GET /compute/v2.1/servers/838e470e-405d-4ac9-b222-0a0a5792b05b => generated 1230 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:20:34.520840 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e30f2e07-06a2-4b48-b6ad-dffeb2db06b7 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:20:34.521840 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e30f2e07-06a2-4b48-b6ad-dffeb2db06b7 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] [instance: 838e470e-405d-4ac9-b222-0a0a5792b05b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:20:34.539590 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e30f2e07-06a2-4b48-b6ad-dffeb2db06b7 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:34.540846 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e30f2e07-06a2-4b48-b6ad-dffeb2db06b7 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:34.542406 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e30f2e07-06a2-4b48-b6ad-dffeb2db06b7 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:34.543672 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e30f2e07-06a2-4b48-b6ad-dffeb2db06b7 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:34.545461 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e30f2e07-06a2-4b48-b6ad-dffeb2db06b7 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:34.547589 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e30f2e07-06a2-4b48-b6ad-dffeb2db06b7 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:34.679639 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e30f2e07-06a2-4b48-b6ad-dffeb2db06b7 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a6d32139caf4574abec46fe34dc00da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74cef405056649b8a9697533c5c7fc52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:20:34.693711 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e30f2e07-06a2-4b48-b6ad-dffeb2db06b7 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] 10.222.0.27 "GET /compute/v2.1/servers/838e470e-405d-4ac9-b222-0a0a5792b05b" status: 200 len: 1230 microversion: 2.1 time: 0.177578 Sep 08 11:20:34.697570 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3070/6274] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:20:34 2022] GET /compute/v2.1/servers/838e470e-405d-4ac9-b222-0a0a5792b05b => generated 1230 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:20:35.722051 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6391218f-c1e7-49e5-9bdd-ebf6eaa58e72 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:20:35.723426 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6391218f-c1e7-49e5-9bdd-ebf6eaa58e72 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] [instance: 838e470e-405d-4ac9-b222-0a0a5792b05b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:20:35.733511 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6391218f-c1e7-49e5-9bdd-ebf6eaa58e72 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:35.734249 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6391218f-c1e7-49e5-9bdd-ebf6eaa58e72 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:35.736078 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6391218f-c1e7-49e5-9bdd-ebf6eaa58e72 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:35.737055 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6391218f-c1e7-49e5-9bdd-ebf6eaa58e72 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:35.737758 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6391218f-c1e7-49e5-9bdd-ebf6eaa58e72 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:35.738477 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6391218f-c1e7-49e5-9bdd-ebf6eaa58e72 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:35.882068 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6391218f-c1e7-49e5-9bdd-ebf6eaa58e72 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a6d32139caf4574abec46fe34dc00da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74cef405056649b8a9697533c5c7fc52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:20:35.906974 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6391218f-c1e7-49e5-9bdd-ebf6eaa58e72 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] 10.222.0.27 "GET /compute/v2.1/servers/838e470e-405d-4ac9-b222-0a0a5792b05b" status: 200 len: 1230 microversion: 2.1 time: 0.190192 Sep 08 11:20:35.907826 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3205/6275] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:20:35 2022] GET /compute/v2.1/servers/838e470e-405d-4ac9-b222-0a0a5792b05b => generated 1230 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:20:36.936485 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5e856dff-0113-4c57-9ca1-d966d143b670 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:20:36.937162 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5e856dff-0113-4c57-9ca1-d966d143b670 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] [instance: 838e470e-405d-4ac9-b222-0a0a5792b05b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:20:36.948271 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5e856dff-0113-4c57-9ca1-d966d143b670 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:36.950343 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5e856dff-0113-4c57-9ca1-d966d143b670 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:36.950721 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5e856dff-0113-4c57-9ca1-d966d143b670 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:36.951491 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5e856dff-0113-4c57-9ca1-d966d143b670 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:36.951952 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5e856dff-0113-4c57-9ca1-d966d143b670 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:36.952587 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5e856dff-0113-4c57-9ca1-d966d143b670 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:37.026963 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5e856dff-0113-4c57-9ca1-d966d143b670 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:37.029969 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5e856dff-0113-4c57-9ca1-d966d143b670 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:37.030549 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5e856dff-0113-4c57-9ca1-d966d143b670 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:37.031158 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-5e856dff-0113-4c57-9ca1-d966d143b670 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lazy-loading 'fault' on Instance uuid 838e470e-405d-4ac9-b222-0a0a5792b05b {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:20:37.128278 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5e856dff-0113-4c57-9ca1-d966d143b670 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a6d32139caf4574abec46fe34dc00da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74cef405056649b8a9697533c5c7fc52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:20:37.139021 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5e856dff-0113-4c57-9ca1-d966d143b670 tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] 10.222.0.27 "GET /compute/v2.1/servers/838e470e-405d-4ac9-b222-0a0a5792b05b" status: 200 len: 1189 microversion: 2.1 time: 0.205580 Sep 08 11:20:37.139647 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3071/6276] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:20:36 2022] GET /compute/v2.1/servers/838e470e-405d-4ac9-b222-0a0a5792b05b => generated 1189 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:20:38.169190 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e71d4185-c0ea-43fa-b00f-b3bcab834b2c tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:20:38.170737 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e71d4185-c0ea-43fa-b00f-b3bcab834b2c tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] [instance: 838e470e-405d-4ac9-b222-0a0a5792b05b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:20:38.178222 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e71d4185-c0ea-43fa-b00f-b3bcab834b2c tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:38.179256 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e71d4185-c0ea-43fa-b00f-b3bcab834b2c tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:38.179975 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e71d4185-c0ea-43fa-b00f-b3bcab834b2c tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:38.181472 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e71d4185-c0ea-43fa-b00f-b3bcab834b2c tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:38.182175 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e71d4185-c0ea-43fa-b00f-b3bcab834b2c tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:38.182834 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e71d4185-c0ea-43fa-b00f-b3bcab834b2c tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:38.202325 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-e71d4185-c0ea-43fa-b00f-b3bcab834b2c tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] HTTP exception thrown: Instance 838e470e-405d-4ac9-b222-0a0a5792b05b could not be found. Sep 08 11:20:38.205256 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e71d4185-c0ea-43fa-b00f-b3bcab834b2c tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Request method failure captured: Sep 08 11:20:38.205256 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/838e470e-405d-4ac9-b222-0a0a5792b05b HTTP/1.1 Sep 08 11:20:38.205256 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:20:38.205256 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:20:38.205256 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:20:38.205256 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 11:20:38.205256 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:20:38.205256 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:20:38.205256 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:20:38.205256 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:20:38.205256 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGc74lmusFHGCiHcfUvjQjosMMKrtHoCO3z6evruElnPFMhSxcDbL9JeTIwDGMYjaLDN6nSsW5yIw_EQ0-n7tfS2OgA23j2ngnOa_lC4vJYfunD9VkeRvWYXzWvtt-sZJdXsv9DZJ2i2UTLh8ZoLQOkHWCh6wn2B-XgvsyodhFFfJtrk Sep 08 11:20:38.205256 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:20:38.205256 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:20:38.205256 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:20:38.205256 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:20:38.205256 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:20:38.205256 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:20:38.205256 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 74cef405056649b8a9697533c5c7fc52 Sep 08 11:20:38.205256 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-TestVolumeBackupRestore-1960928177 Sep 08 11:20:38.205256 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:20:38.205256 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:20:38.205256 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/74cef405056649b8a9697533c5c7fc52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/74cef405056649b8a9697533c5c7fc52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_74cef405056649b8a9697533c5c7fc52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/74cef405056649b8a9697533c5c7fc52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:20:38.205256 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-TestVolumeBackupRestore-1960928177 Sep 08 11:20:38.205256 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 74cef405056649b8a9697533c5c7fc52 Sep 08 11:20:38.205256 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-TestVolumeBackupRestore-1960928177 Sep 08 11:20:38.205256 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-TestVolumeBackupRestore-1960928177-project Sep 08 11:20:38.205256 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:20:38.205256 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:20:38.205256 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 3a6d32139caf4574abec46fe34dc00da Sep 08 11:20:38.205256 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-TestVolumeBackupRestore-1960928177-project Sep 08 11:20:38.205256 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 11:20:38.205256 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 838e470e-405d-4ac9-b222-0a0a5792b05b could not be found. Sep 08 11:20:38.205256 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '838e470e-405d-4ac9-b222-0a0a5792b05b'} Sep 08 11:20:38.205256 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:20:38.205256 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:20:38.205256 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:20:38.205256 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:20:38.205256 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:20:38.205256 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:20:38.205256 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:20:38.205256 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:20:38.205256 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:20:38.205256 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:20:38.205256 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 838e470e-405d-4ac9-b222-0a0a5792b05b could not be found. Sep 08 11:20:38.205256 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:20:38.205256 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:20:38.205256 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:20:38.205256 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:20:38.205256 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:20:38.205256 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:20:38.205256 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:20:38.205256 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:20:38.205256 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:20:38.205256 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:20:38.205256 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:20:38.205256 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:20:38.205256 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:20:38.205256 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:20:38.205256 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:20:38.205256 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:20:38.205256 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 838e470e-405d-4ac9-b222-0a0a5792b05b could not be found. Sep 08 11:20:38.205256 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:20:38.205256 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:20:38.205256 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:20:38.210214 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:20:38.210214 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:20:38.210214 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:20:38.210214 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:20:38.210214 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:20:38.210214 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 838e470e-405d-4ac9-b222-0a0a5792b05b could not be found. Sep 08 11:20:38.210214 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:20:38.213170 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e71d4185-c0ea-43fa-b00f-b3bcab834b2c tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Returning 404 to user: Instance 838e470e-405d-4ac9-b222-0a0a5792b05b could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:20:38.219336 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e71d4185-c0ea-43fa-b00f-b3bcab834b2c tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] 10.222.0.27 "GET /compute/v2.1/servers/838e470e-405d-4ac9-b222-0a0a5792b05b" status: 404 len: 111 microversion: 2.1 time: 0.056517 Sep 08 11:20:38.224114 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3206/6277] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:20:38 2022] GET /compute/v2.1/servers/838e470e-405d-4ac9-b222-0a0a5792b05b => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:20:38.504889 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-541d3591-ea88-4e0c-87dd-e3c79e3a28ba tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] Calling method '.version_select at 0x7f68e8aacca0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:20:38.529532 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-541d3591-ea88-4e0c-87dd-e3c79e3a28ba tempest-TestVolumeBackupRestore-1960928177 tempest-TestVolumeBackupRestore-1960928177-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1136544873" status: 202 len: 0 microversion: 2.1 time: 0.028505 Sep 08 11:20:38.533527 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3072/6278] 10.222.0.27 () {58 vars in 1269 bytes} [Thu Sep 8 11:20:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1136544873 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:20:43.063202 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-aa9afc04-9a24-415b-8f36-c9c2135fdd0a tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:20:43.068133 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-aa9afc04-9a24-415b-8f36-c9c2135fdd0a tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 32ae7194-7c7b-401a-9ffc-8ba37edade77] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:20:43.089129 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aa9afc04-9a24-415b-8f36-c9c2135fdd0a tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:43.091934 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aa9afc04-9a24-415b-8f36-c9c2135fdd0a tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:43.092423 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aa9afc04-9a24-415b-8f36-c9c2135fdd0a tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:43.093303 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aa9afc04-9a24-415b-8f36-c9c2135fdd0a tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:43.093756 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aa9afc04-9a24-415b-8f36-c9c2135fdd0a tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:43.097505 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aa9afc04-9a24-415b-8f36-c9c2135fdd0a tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:43.276500 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-aa9afc04-9a24-415b-8f36-c9c2135fdd0a tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:20:43.276923 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-aa9afc04-9a24-415b-8f36-c9c2135fdd0a tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:20:43.277429 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-aa9afc04-9a24-415b-8f36-c9c2135fdd0a tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:20:43.277840 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-aa9afc04-9a24-415b-8f36-c9c2135fdd0a tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:20:43.278260 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-aa9afc04-9a24-415b-8f36-c9c2135fdd0a tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:20:43.389194 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-aa9afc04-9a24-415b-8f36-c9c2135fdd0a tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 32ae7194-7c7b-401a-9ffc-8ba37edade77] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:20:43.397577 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aa9afc04-9a24-415b-8f36-c9c2135fdd0a tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:43.398324 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aa9afc04-9a24-415b-8f36-c9c2135fdd0a tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:43.399085 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aa9afc04-9a24-415b-8f36-c9c2135fdd0a tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:43.400275 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aa9afc04-9a24-415b-8f36-c9c2135fdd0a tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:43.401004 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aa9afc04-9a24-415b-8f36-c9c2135fdd0a tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:43.402075 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aa9afc04-9a24-415b-8f36-c9c2135fdd0a tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:43.439626 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-aa9afc04-9a24-415b-8f36-c9c2135fdd0a tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "POST /compute/v2.1/servers/32ae7194-7c7b-401a-9ffc-8ba37edade77/action" status: 202 len: 1136 microversion: 2.1 time: 0.382070 Sep 08 11:20:43.440882 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3207/6279] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 11:20:43 2022] POST /compute/v2.1/servers/32ae7194-7c7b-401a-9ffc-8ba37edade77/action => generated 1136 bytes in 385 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 08 11:20:43.491634 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-92d45212-6c25-43ff-af49-d1de4593645c tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:20:43.492789 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-92d45212-6c25-43ff-af49-d1de4593645c tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 32ae7194-7c7b-401a-9ffc-8ba37edade77] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:20:43.507199 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-92d45212-6c25-43ff-af49-d1de4593645c tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:43.508893 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-92d45212-6c25-43ff-af49-d1de4593645c tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:43.509792 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-92d45212-6c25-43ff-af49-d1de4593645c tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:43.511070 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-92d45212-6c25-43ff-af49-d1de4593645c tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:43.511906 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-92d45212-6c25-43ff-af49-d1de4593645c tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:43.512655 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-92d45212-6c25-43ff-af49-d1de4593645c tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:43.879617 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-92d45212-6c25-43ff-af49-d1de4593645c tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:20:43.932743 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-92d45212-6c25-43ff-af49-d1de4593645c tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/32ae7194-7c7b-401a-9ffc-8ba37edade77" status: 200 len: 1691 microversion: 2.1 time: 0.464334 Sep 08 11:20:43.962358 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3073/6280] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:20:43 2022] GET /compute/v2.1/servers/32ae7194-7c7b-401a-9ffc-8ba37edade77 => generated 1691 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:20:44.965336 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-35a48398-892f-4473-a635-0031412189f6 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:20:44.966442 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-35a48398-892f-4473-a635-0031412189f6 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 32ae7194-7c7b-401a-9ffc-8ba37edade77] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:20:44.981627 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-35a48398-892f-4473-a635-0031412189f6 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:44.982247 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-35a48398-892f-4473-a635-0031412189f6 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:44.982942 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-35a48398-892f-4473-a635-0031412189f6 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:44.985670 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-35a48398-892f-4473-a635-0031412189f6 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:44.987489 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-35a48398-892f-4473-a635-0031412189f6 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:44.988123 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-35a48398-892f-4473-a635-0031412189f6 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:45.445833 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-35a48398-892f-4473-a635-0031412189f6 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:20:45.458645 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-35a48398-892f-4473-a635-0031412189f6 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/32ae7194-7c7b-401a-9ffc-8ba37edade77" status: 200 len: 1691 microversion: 2.1 time: 0.498565 Sep 08 11:20:45.467609 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3208/6281] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:20:44 2022] GET /compute/v2.1/servers/32ae7194-7c7b-401a-9ffc-8ba37edade77 => generated 1691 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:20:46.492487 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-545194d4-bdf4-44d9-b440-8f6dce4b0e43 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:20:46.493170 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-545194d4-bdf4-44d9-b440-8f6dce4b0e43 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 32ae7194-7c7b-401a-9ffc-8ba37edade77] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:20:46.502008 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-545194d4-bdf4-44d9-b440-8f6dce4b0e43 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:46.502503 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-545194d4-bdf4-44d9-b440-8f6dce4b0e43 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:46.502941 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-545194d4-bdf4-44d9-b440-8f6dce4b0e43 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:46.503656 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-545194d4-bdf4-44d9-b440-8f6dce4b0e43 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:46.504141 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-545194d4-bdf4-44d9-b440-8f6dce4b0e43 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:46.504546 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-545194d4-bdf4-44d9-b440-8f6dce4b0e43 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:47.068388 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-540cc600-9d27-46ea-88f5-627813e024f4 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:20:47.069985 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-540cc600-9d27-46ea-88f5-627813e024f4 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] [instance: 9426a1f8-7d16-47ec-af01-70d0c7766eb9] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:20:47.078585 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-540cc600-9d27-46ea-88f5-627813e024f4 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:47.079485 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-540cc600-9d27-46ea-88f5-627813e024f4 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:47.080210 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-540cc600-9d27-46ea-88f5-627813e024f4 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:47.081319 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-540cc600-9d27-46ea-88f5-627813e024f4 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:47.082691 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-540cc600-9d27-46ea-88f5-627813e024f4 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:47.083360 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-540cc600-9d27-46ea-88f5-627813e024f4 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:47.122637 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-540cc600-9d27-46ea-88f5-627813e024f4 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] [instance: 9426a1f8-7d16-47ec-af01-70d0c7766eb9] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:20:47.182803 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-545194d4-bdf4-44d9-b440-8f6dce4b0e43 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:20:47.200807 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-545194d4-bdf4-44d9-b440-8f6dce4b0e43 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/32ae7194-7c7b-401a-9ffc-8ba37edade77" status: 200 len: 1691 microversion: 2.1 time: 0.718020 Sep 08 11:20:47.201447 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3074/6282] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:20:46 2022] GET /compute/v2.1/servers/32ae7194-7c7b-401a-9ffc-8ba37edade77 => generated 1691 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:20:47.276170 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-540cc600-9d27-46ea-88f5-627813e024f4 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9426a1f8-7d16-47ec-af01-70d0c7766eb9" status: 204 len: 0 microversion: 2.1 time: 0.749871 Sep 08 11:20:47.277596 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3209/6283] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:20:46 2022] DELETE /compute/v2.1/servers/9426a1f8-7d16-47ec-af01-70d0c7766eb9 => generated 0 bytes in 753 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:20:47.286946 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7cea5d1b-78ab-4c37-9580-404ae5ef16b7 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:20:47.287569 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7cea5d1b-78ab-4c37-9580-404ae5ef16b7 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] [instance: 9426a1f8-7d16-47ec-af01-70d0c7766eb9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:20:47.295694 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7cea5d1b-78ab-4c37-9580-404ae5ef16b7 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:47.296508 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7cea5d1b-78ab-4c37-9580-404ae5ef16b7 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:47.297146 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7cea5d1b-78ab-4c37-9580-404ae5ef16b7 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:47.298104 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7cea5d1b-78ab-4c37-9580-404ae5ef16b7 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:47.298762 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7cea5d1b-78ab-4c37-9580-404ae5ef16b7 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:47.299409 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7cea5d1b-78ab-4c37-9580-404ae5ef16b7 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:47.640999 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7cea5d1b-78ab-4c37-9580-404ae5ef16b7 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f3aa2815fd4dcc8767242bc5cd1c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f4fec1839448c28e7a0a3d16236ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:20:47.658166 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7cea5d1b-78ab-4c37-9580-404ae5ef16b7 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] 10.222.0.27 "GET /compute/v2.1/servers/9426a1f8-7d16-47ec-af01-70d0c7766eb9" status: 200 len: 1734 microversion: 2.1 time: 0.375225 Sep 08 11:20:47.668102 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3075/6284] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:20:47 2022] GET /compute/v2.1/servers/9426a1f8-7d16-47ec-af01-70d0c7766eb9 => generated 1734 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:20:48.240679 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-852616d0-c6e2-4768-9250-fe5de3e71290 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:20:48.242441 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-852616d0-c6e2-4768-9250-fe5de3e71290 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 32ae7194-7c7b-401a-9ffc-8ba37edade77] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:20:48.268696 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-852616d0-c6e2-4768-9250-fe5de3e71290 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:48.269281 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-852616d0-c6e2-4768-9250-fe5de3e71290 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:48.271432 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-852616d0-c6e2-4768-9250-fe5de3e71290 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:48.273015 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-852616d0-c6e2-4768-9250-fe5de3e71290 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:48.273851 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-852616d0-c6e2-4768-9250-fe5de3e71290 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:48.274443 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-852616d0-c6e2-4768-9250-fe5de3e71290 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:48.701159 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b376f5b6-e75b-4344-bee1-0489c844e5d8 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:20:48.702454 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b376f5b6-e75b-4344-bee1-0489c844e5d8 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] [instance: 9426a1f8-7d16-47ec-af01-70d0c7766eb9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:20:48.712966 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b376f5b6-e75b-4344-bee1-0489c844e5d8 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:48.717882 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b376f5b6-e75b-4344-bee1-0489c844e5d8 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:48.718719 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b376f5b6-e75b-4344-bee1-0489c844e5d8 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:48.719824 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b376f5b6-e75b-4344-bee1-0489c844e5d8 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:48.727335 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b376f5b6-e75b-4344-bee1-0489c844e5d8 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:48.728203 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b376f5b6-e75b-4344-bee1-0489c844e5d8 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:49.263637 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b376f5b6-e75b-4344-bee1-0489c844e5d8 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f3aa2815fd4dcc8767242bc5cd1c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f4fec1839448c28e7a0a3d16236ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:20:49.288156 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b376f5b6-e75b-4344-bee1-0489c844e5d8 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] 10.222.0.27 "GET /compute/v2.1/servers/9426a1f8-7d16-47ec-af01-70d0c7766eb9" status: 200 len: 1734 microversion: 2.1 time: 0.590794 Sep 08 11:20:49.289792 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3076/6285] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:20:48 2022] GET /compute/v2.1/servers/9426a1f8-7d16-47ec-af01-70d0c7766eb9 => generated 1734 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:20:49.423699 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-852616d0-c6e2-4768-9250-fe5de3e71290 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:20:49.442848 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-852616d0-c6e2-4768-9250-fe5de3e71290 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/32ae7194-7c7b-401a-9ffc-8ba37edade77" status: 200 len: 1691 microversion: 2.1 time: 1.217722 Sep 08 11:20:49.458288 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3210/6286] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:20:48 2022] GET /compute/v2.1/servers/32ae7194-7c7b-401a-9ffc-8ba37edade77 => generated 1691 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:20:50.317068 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e9961081-91ce-4ec5-aa02-dbca98d530bd tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:20:50.318564 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e9961081-91ce-4ec5-aa02-dbca98d530bd tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] [instance: 9426a1f8-7d16-47ec-af01-70d0c7766eb9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:20:50.338281 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9961081-91ce-4ec5-aa02-dbca98d530bd tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:50.338794 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9961081-91ce-4ec5-aa02-dbca98d530bd tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:50.339234 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9961081-91ce-4ec5-aa02-dbca98d530bd tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:50.339987 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9961081-91ce-4ec5-aa02-dbca98d530bd tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:50.341199 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9961081-91ce-4ec5-aa02-dbca98d530bd tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:50.342064 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9961081-91ce-4ec5-aa02-dbca98d530bd tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:50.469078 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-90a7b10c-5e82-44a8-a8b9-3286ffc2e852 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:20:50.470438 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-90a7b10c-5e82-44a8-a8b9-3286ffc2e852 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 32ae7194-7c7b-401a-9ffc-8ba37edade77] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:20:50.478778 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90a7b10c-5e82-44a8-a8b9-3286ffc2e852 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:50.481841 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90a7b10c-5e82-44a8-a8b9-3286ffc2e852 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:50.482466 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90a7b10c-5e82-44a8-a8b9-3286ffc2e852 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:50.483530 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90a7b10c-5e82-44a8-a8b9-3286ffc2e852 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:50.485310 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90a7b10c-5e82-44a8-a8b9-3286ffc2e852 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:50.486021 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90a7b10c-5e82-44a8-a8b9-3286ffc2e852 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:50.708804 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e9961081-91ce-4ec5-aa02-dbca98d530bd tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f3aa2815fd4dcc8767242bc5cd1c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f4fec1839448c28e7a0a3d16236ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:20:50.720679 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e9961081-91ce-4ec5-aa02-dbca98d530bd tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] 10.222.0.27 "GET /compute/v2.1/servers/9426a1f8-7d16-47ec-af01-70d0c7766eb9" status: 200 len: 1734 microversion: 2.1 time: 0.408324 Sep 08 11:20:50.724100 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3077/6287] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:20:50 2022] GET /compute/v2.1/servers/9426a1f8-7d16-47ec-af01-70d0c7766eb9 => generated 1734 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:20:51.003074 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-90a7b10c-5e82-44a8-a8b9-3286ffc2e852 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:20:51.013773 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-90a7b10c-5e82-44a8-a8b9-3286ffc2e852 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/32ae7194-7c7b-401a-9ffc-8ba37edade77" status: 200 len: 1691 microversion: 2.1 time: 0.547971 Sep 08 11:20:51.015172 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3211/6288] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:20:50 2022] GET /compute/v2.1/servers/32ae7194-7c7b-401a-9ffc-8ba37edade77 => generated 1691 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:20:51.603986 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-7da65e59-6bf4-4e12-8019-edde2119cbae req-e50b7975-a6a2-44b2-812d-d759afdefdfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9426a1f8-7d16-47ec-af01-70d0c7766eb9", "name": "network-vif-deleted", "tag": "bbc00306-8e8e-49d3-b545-cbe4ab9bdea8"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:20:51.629873 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-7da65e59-6bf4-4e12-8019-edde2119cbae req-e50b7975-a6a2-44b2-812d-d759afdefdfe service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:51.630365 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-7da65e59-6bf4-4e12-8019-edde2119cbae req-e50b7975-a6a2-44b2-812d-d759afdefdfe service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:51.630795 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-7da65e59-6bf4-4e12-8019-edde2119cbae req-e50b7975-a6a2-44b2-812d-d759afdefdfe service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:51.646474 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-7da65e59-6bf4-4e12-8019-edde2119cbae req-e50b7975-a6a2-44b2-812d-d759afdefdfe service nova] Creating event network-vif-deleted:bbc00306-8e8e-49d3-b545-cbe4ab9bdea8 for instance 9426a1f8-7d16-47ec-af01-70d0c7766eb9 on n-h1-850501-12 Sep 08 11:20:51.652770 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-7da65e59-6bf4-4e12-8019-edde2119cbae req-e50b7975-a6a2-44b2-812d-d759afdefdfe service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052859 Sep 08 11:20:51.654167 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3078/6289] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:20:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:20:51.750832 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f8c43a4e-a925-49bb-b3d6-27252974352d tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:20:51.752172 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f8c43a4e-a925-49bb-b3d6-27252974352d tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] [instance: 9426a1f8-7d16-47ec-af01-70d0c7766eb9] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:20:51.762086 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f8c43a4e-a925-49bb-b3d6-27252974352d tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:51.763683 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f8c43a4e-a925-49bb-b3d6-27252974352d tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:51.764286 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f8c43a4e-a925-49bb-b3d6-27252974352d tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:51.765257 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f8c43a4e-a925-49bb-b3d6-27252974352d tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:51.765928 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f8c43a4e-a925-49bb-b3d6-27252974352d tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:51.766780 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f8c43a4e-a925-49bb-b3d6-27252974352d tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:51.816172 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f8c43a4e-a925-49bb-b3d6-27252974352d tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:51.816890 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f8c43a4e-a925-49bb-b3d6-27252974352d tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:51.817669 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f8c43a4e-a925-49bb-b3d6-27252974352d tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:51.818137 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-f8c43a4e-a925-49bb-b3d6-27252974352d tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lazy-loading 'fault' on Instance uuid 9426a1f8-7d16-47ec-af01-70d0c7766eb9 {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:20:52.040195 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-28b8ca35-a511-4311-96c5-af8d88035cef tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:20:52.041383 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-28b8ca35-a511-4311-96c5-af8d88035cef tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 32ae7194-7c7b-401a-9ffc-8ba37edade77] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:20:52.059135 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28b8ca35-a511-4311-96c5-af8d88035cef tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:52.059924 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28b8ca35-a511-4311-96c5-af8d88035cef tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:52.060546 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28b8ca35-a511-4311-96c5-af8d88035cef tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:52.061462 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28b8ca35-a511-4311-96c5-af8d88035cef tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:52.062081 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28b8ca35-a511-4311-96c5-af8d88035cef tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:52.062676 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28b8ca35-a511-4311-96c5-af8d88035cef tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:52.073239 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f8c43a4e-a925-49bb-b3d6-27252974352d tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f3aa2815fd4dcc8767242bc5cd1c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f4fec1839448c28e7a0a3d16236ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:20:52.095816 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f8c43a4e-a925-49bb-b3d6-27252974352d tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] 10.222.0.27 "GET /compute/v2.1/servers/9426a1f8-7d16-47ec-af01-70d0c7766eb9" status: 200 len: 1389 microversion: 2.1 time: 0.350322 Sep 08 11:20:52.101075 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3212/6290] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:20:51 2022] GET /compute/v2.1/servers/9426a1f8-7d16-47ec-af01-70d0c7766eb9 => generated 1389 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:20:52.474827 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-28b8ca35-a511-4311-96c5-af8d88035cef tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:20:52.484134 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-28b8ca35-a511-4311-96c5-af8d88035cef tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/32ae7194-7c7b-401a-9ffc-8ba37edade77" status: 200 len: 1691 microversion: 2.1 time: 0.448952 Sep 08 11:20:52.489906 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3079/6291] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:20:52 2022] GET /compute/v2.1/servers/32ae7194-7c7b-401a-9ffc-8ba37edade77 => generated 1691 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:20:53.123634 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8fabb559-6426-476e-85e3-5dddc33ef38d tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:20:53.124259 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8fabb559-6426-476e-85e3-5dddc33ef38d tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] [instance: 9426a1f8-7d16-47ec-af01-70d0c7766eb9] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:20:53.134974 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8fabb559-6426-476e-85e3-5dddc33ef38d tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:53.141316 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8fabb559-6426-476e-85e3-5dddc33ef38d tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:53.142033 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8fabb559-6426-476e-85e3-5dddc33ef38d tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:53.142979 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8fabb559-6426-476e-85e3-5dddc33ef38d tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:53.143604 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8fabb559-6426-476e-85e3-5dddc33ef38d tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:53.144193 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8fabb559-6426-476e-85e3-5dddc33ef38d tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:53.179781 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-8fabb559-6426-476e-85e3-5dddc33ef38d tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] HTTP exception thrown: Instance 9426a1f8-7d16-47ec-af01-70d0c7766eb9 could not be found. Sep 08 11:20:53.182573 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8fabb559-6426-476e-85e3-5dddc33ef38d tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Request method failure captured: Sep 08 11:20:53.182573 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/9426a1f8-7d16-47ec-af01-70d0c7766eb9 HTTP/1.1 Sep 08 11:20:53.182573 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:20:53.182573 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:20:53.182573 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:20:53.182573 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 11:20:53.182573 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:20:53.182573 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:20:53.182573 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:20:53.182573 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:20:53.182573 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGc7MgeFuuIXBq2az_mwj9MvLesl3gqr2OGng63B246TAkfaEkHbfgNGcgI2NosOtTHrh9dC5edS9rwtcl2xaHinv1lAb0BAY4_XGz-phF2hHkYH60TyCUutOne6NlpedciKCS15lX5KbuCKYw18qPDZw5xKSCJUbl6WCI7SwGGDJ_xg Sep 08 11:20:53.182573 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:20:53.182573 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:20:53.182573 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:20:53.182573 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:20:53.182573 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:20:53.182573 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:20:53.182573 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 56f4fec1839448c28e7a0a3d16236ab6 Sep 08 11:20:53.182573 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-TestServerBasicOps-1023076899 Sep 08 11:20:53.182573 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:20:53.182573 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:20:53.182573 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/56f4fec1839448c28e7a0a3d16236ab6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/56f4fec1839448c28e7a0a3d16236ab6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_56f4fec1839448c28e7a0a3d16236ab6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/56f4fec1839448c28e7a0a3d16236ab6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:20:53.182573 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-TestServerBasicOps-1023076899 Sep 08 11:20:53.182573 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 56f4fec1839448c28e7a0a3d16236ab6 Sep 08 11:20:53.182573 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-TestServerBasicOps-1023076899 Sep 08 11:20:53.182573 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-TestServerBasicOps-1023076899-project Sep 08 11:20:53.182573 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:20:53.182573 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:20:53.182573 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: f9f3aa2815fd4dcc8767242bc5cd1c1d Sep 08 11:20:53.182573 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-TestServerBasicOps-1023076899-project Sep 08 11:20:53.182573 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 11:20:53.182573 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 9426a1f8-7d16-47ec-af01-70d0c7766eb9 could not be found. Sep 08 11:20:53.182573 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '9426a1f8-7d16-47ec-af01-70d0c7766eb9'} Sep 08 11:20:53.182573 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:20:53.182573 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:20:53.182573 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:20:53.182573 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:20:53.182573 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:20:53.182573 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:20:53.182573 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:20:53.182573 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:20:53.182573 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:20:53.182573 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:20:53.182573 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9426a1f8-7d16-47ec-af01-70d0c7766eb9 could not be found. Sep 08 11:20:53.182573 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:20:53.182573 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:20:53.182573 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:20:53.182573 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:20:53.182573 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:20:53.182573 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:20:53.182573 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:20:53.182573 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:20:53.182573 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:20:53.182573 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:20:53.182573 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:20:53.182573 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:20:53.182573 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:20:53.182573 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:20:53.182573 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:20:53.182573 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:20:53.182573 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9426a1f8-7d16-47ec-af01-70d0c7766eb9 could not be found. Sep 08 11:20:53.182573 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:20:53.182573 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:20:53.182573 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:20:53.187453 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:20:53.187453 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:20:53.187453 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:20:53.187453 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:20:53.187453 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:20:53.187453 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9426a1f8-7d16-47ec-af01-70d0c7766eb9 could not be found. Sep 08 11:20:53.187453 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:20:53.188694 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8fabb559-6426-476e-85e3-5dddc33ef38d tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Returning 404 to user: Instance 9426a1f8-7d16-47ec-af01-70d0c7766eb9 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:20:53.189752 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8fabb559-6426-476e-85e3-5dddc33ef38d tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] 10.222.0.27 "GET /compute/v2.1/servers/9426a1f8-7d16-47ec-af01-70d0c7766eb9" status: 404 len: 111 microversion: 2.1 time: 0.070124 Sep 08 11:20:53.190476 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3213/6292] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:20:53 2022] GET /compute/v2.1/servers/9426a1f8-7d16-47ec-af01-70d0c7766eb9 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:20:53.518697 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e0589855-adcd-4574-afbb-c4a6f31a44d4 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:20:53.520833 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e0589855-adcd-4574-afbb-c4a6f31a44d4 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 32ae7194-7c7b-401a-9ffc-8ba37edade77] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:20:53.548582 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0589855-adcd-4574-afbb-c4a6f31a44d4 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:53.549117 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0589855-adcd-4574-afbb-c4a6f31a44d4 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:53.549571 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0589855-adcd-4574-afbb-c4a6f31a44d4 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:53.550306 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0589855-adcd-4574-afbb-c4a6f31a44d4 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:53.550776 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0589855-adcd-4574-afbb-c4a6f31a44d4 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:53.551212 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0589855-adcd-4574-afbb-c4a6f31a44d4 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:53.931436 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e0589855-adcd-4574-afbb-c4a6f31a44d4 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:20:53.948034 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e0589855-adcd-4574-afbb-c4a6f31a44d4 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/32ae7194-7c7b-401a-9ffc-8ba37edade77" status: 200 len: 1691 microversion: 2.1 time: 0.436319 Sep 08 11:20:53.949323 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3080/6293] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:20:53 2022] GET /compute/v2.1/servers/32ae7194-7c7b-401a-9ffc-8ba37edade77 => generated 1691 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:20:54.688176 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c7ba9639-7eb0-42d4-be2d-003864d6f1d0 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:20:54.689351 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c7ba9639-7eb0-42d4-be2d-003864d6f1d0 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] [instance: 9426a1f8-7d16-47ec-af01-70d0c7766eb9] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:20:54.704909 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c7ba9639-7eb0-42d4-be2d-003864d6f1d0 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:54.705684 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c7ba9639-7eb0-42d4-be2d-003864d6f1d0 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:54.707180 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c7ba9639-7eb0-42d4-be2d-003864d6f1d0 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:54.709417 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c7ba9639-7eb0-42d4-be2d-003864d6f1d0 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:54.711731 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c7ba9639-7eb0-42d4-be2d-003864d6f1d0 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:54.712699 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c7ba9639-7eb0-42d4-be2d-003864d6f1d0 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:54.738278 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-c7ba9639-7eb0-42d4-be2d-003864d6f1d0 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] HTTP exception thrown: Instance 9426a1f8-7d16-47ec-af01-70d0c7766eb9 could not be found. Sep 08 11:20:54.740304 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c7ba9639-7eb0-42d4-be2d-003864d6f1d0 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Request method failure captured: Sep 08 11:20:54.740304 n-d-850501-12 devstack@n-api.service[128861]: request: DELETE /compute/v2.1/servers/9426a1f8-7d16-47ec-af01-70d0c7766eb9 HTTP/1.1 Sep 08 11:20:54.740304 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:20:54.740304 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:20:54.740304 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:20:54.740304 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 11:20:54.740304 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:20:54.740304 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:20:54.740304 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:20:54.740304 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:20:54.740304 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGc7MgeFuuIXBq2az_mwj9MvLesl3gqr2OGng63B246TAkfaEkHbfgNGcgI2NosOtTHrh9dC5edS9rwtcl2xaHinv1lAb0BAY4_XGz-phF2hHkYH60TyCUutOne6NlpedciKCS15lX5KbuCKYw18qPDZw5xKSCJUbl6WCI7SwGGDJ_xg Sep 08 11:20:54.740304 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:20:54.740304 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:20:54.740304 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:20:54.740304 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:20:54.740304 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:20:54.740304 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:20:54.740304 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 56f4fec1839448c28e7a0a3d16236ab6 Sep 08 11:20:54.740304 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-TestServerBasicOps-1023076899 Sep 08 11:20:54.740304 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:20:54.740304 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:20:54.740304 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/56f4fec1839448c28e7a0a3d16236ab6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/56f4fec1839448c28e7a0a3d16236ab6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_56f4fec1839448c28e7a0a3d16236ab6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/56f4fec1839448c28e7a0a3d16236ab6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:20:54.740304 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-TestServerBasicOps-1023076899 Sep 08 11:20:54.740304 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 56f4fec1839448c28e7a0a3d16236ab6 Sep 08 11:20:54.740304 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-TestServerBasicOps-1023076899 Sep 08 11:20:54.740304 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-TestServerBasicOps-1023076899-project Sep 08 11:20:54.740304 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:20:54.740304 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:20:54.740304 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: f9f3aa2815fd4dcc8767242bc5cd1c1d Sep 08 11:20:54.740304 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-TestServerBasicOps-1023076899-project Sep 08 11:20:54.740304 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 11:20:54.740304 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 9426a1f8-7d16-47ec-af01-70d0c7766eb9 could not be found. Sep 08 11:20:54.740304 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '9426a1f8-7d16-47ec-af01-70d0c7766eb9'} Sep 08 11:20:54.740304 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:20:54.740304 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:20:54.740304 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:20:54.740304 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:20:54.740304 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:20:54.740304 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:20:54.740304 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:20:54.740304 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:20:54.740304 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:20:54.740304 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:20:54.740304 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9426a1f8-7d16-47ec-af01-70d0c7766eb9 could not be found. Sep 08 11:20:54.740304 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:20:54.740304 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:20:54.740304 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:20:54.740304 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:20:54.740304 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:20:54.740304 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:20:54.740304 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:20:54.740304 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:20:54.740304 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:20:54.740304 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:20:54.740304 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 11:20:54.740304 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 11:20:54.740304 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 11:20:54.740304 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 11:20:54.740304 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:20:54.740304 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:20:54.740304 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:20:54.740304 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:20:54.744414 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9426a1f8-7d16-47ec-af01-70d0c7766eb9 could not be found. Sep 08 11:20:54.744414 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:20:54.744414 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:20:54.744414 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:20:54.744414 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:20:54.744414 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:20:54.744414 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:20:54.744414 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:20:54.744414 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:20:54.744414 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9426a1f8-7d16-47ec-af01-70d0c7766eb9 could not be found. Sep 08 11:20:54.744414 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:20:54.747610 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c7ba9639-7eb0-42d4-be2d-003864d6f1d0 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Returning 404 to user: Instance 9426a1f8-7d16-47ec-af01-70d0c7766eb9 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:20:54.748735 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c7ba9639-7eb0-42d4-be2d-003864d6f1d0 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9426a1f8-7d16-47ec-af01-70d0c7766eb9" status: 404 len: 111 microversion: 2.1 time: 0.070900 Sep 08 11:20:54.749877 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3214/6294] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:20:54 2022] DELETE /compute/v2.1/servers/9426a1f8-7d16-47ec-af01-70d0c7766eb9 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:20:54.759137 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-18964364-1fdf-4dd7-95ab-56138e023237 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:20:54.760718 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-18964364-1fdf-4dd7-95ab-56138e023237 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] [instance: 9426a1f8-7d16-47ec-af01-70d0c7766eb9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:20:54.774723 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-18964364-1fdf-4dd7-95ab-56138e023237 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:54.775222 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-18964364-1fdf-4dd7-95ab-56138e023237 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:54.775705 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-18964364-1fdf-4dd7-95ab-56138e023237 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:54.792122 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-18964364-1fdf-4dd7-95ab-56138e023237 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:54.792122 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-18964364-1fdf-4dd7-95ab-56138e023237 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:54.792122 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-18964364-1fdf-4dd7-95ab-56138e023237 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:54.812730 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-18964364-1fdf-4dd7-95ab-56138e023237 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] HTTP exception thrown: Instance 9426a1f8-7d16-47ec-af01-70d0c7766eb9 could not be found. Sep 08 11:20:54.814493 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-18964364-1fdf-4dd7-95ab-56138e023237 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Request method failure captured: Sep 08 11:20:54.814493 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/9426a1f8-7d16-47ec-af01-70d0c7766eb9 HTTP/1.1 Sep 08 11:20:54.814493 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 11:20:54.814493 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 11:20:54.814493 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 11:20:54.814493 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 11:20:54.814493 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 11:20:54.814493 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 11:20:54.814493 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 11:20:54.814493 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 11:20:54.814493 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGc7MgeFuuIXBq2az_mwj9MvLesl3gqr2OGng63B246TAkfaEkHbfgNGcgI2NosOtTHrh9dC5edS9rwtcl2xaHinv1lAb0BAY4_XGz-phF2hHkYH60TyCUutOne6NlpedciKCS15lX5KbuCKYw18qPDZw5xKSCJUbl6WCI7SwGGDJ_xg Sep 08 11:20:54.814493 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 11:20:54.814493 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 11:20:54.814493 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 11:20:54.814493 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 11:20:54.814493 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 11:20:54.814493 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 11:20:54.814493 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 56f4fec1839448c28e7a0a3d16236ab6 Sep 08 11:20:54.814493 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-TestServerBasicOps-1023076899 Sep 08 11:20:54.814493 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 11:20:54.814493 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 11:20:54.814493 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/56f4fec1839448c28e7a0a3d16236ab6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/56f4fec1839448c28e7a0a3d16236ab6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_56f4fec1839448c28e7a0a3d16236ab6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/56f4fec1839448c28e7a0a3d16236ab6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:20:54.814493 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-TestServerBasicOps-1023076899 Sep 08 11:20:54.814493 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 56f4fec1839448c28e7a0a3d16236ab6 Sep 08 11:20:54.814493 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-TestServerBasicOps-1023076899 Sep 08 11:20:54.814493 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-TestServerBasicOps-1023076899-project Sep 08 11:20:54.814493 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 11:20:54.814493 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 11:20:54.814493 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: f9f3aa2815fd4dcc8767242bc5cd1c1d Sep 08 11:20:54.814493 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-TestServerBasicOps-1023076899-project Sep 08 11:20:54.814493 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 11:20:54.814493 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 9426a1f8-7d16-47ec-af01-70d0c7766eb9 could not be found. Sep 08 11:20:54.814493 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '9426a1f8-7d16-47ec-af01-70d0c7766eb9'} Sep 08 11:20:54.814493 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:20:54.814493 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:20:54.814493 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:20:54.814493 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:20:54.814493 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:20:54.814493 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:20:54.814493 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:20:54.814493 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:20:54.814493 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:20:54.814493 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:20:54.814493 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9426a1f8-7d16-47ec-af01-70d0c7766eb9 could not be found. Sep 08 11:20:54.814493 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:20:54.814493 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:20:54.814493 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:20:54.814493 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:20:54.814493 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:20:54.814493 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:20:54.814493 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:20:54.814493 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:20:54.814493 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:20:54.814493 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:20:54.814493 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:20:54.814493 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:20:54.814493 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:20:54.814493 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:20:54.814493 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:20:54.814493 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:20:54.814493 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9426a1f8-7d16-47ec-af01-70d0c7766eb9 could not be found. Sep 08 11:20:54.814493 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:20:54.814493 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:20:54.814493 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:20:54.818474 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:20:54.818474 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:20:54.818474 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:20:54.818474 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:20:54.818474 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:20:54.818474 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9426a1f8-7d16-47ec-af01-70d0c7766eb9 could not be found. Sep 08 11:20:54.818474 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:20:54.818474 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-18964364-1fdf-4dd7-95ab-56138e023237 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Returning 404 to user: Instance 9426a1f8-7d16-47ec-af01-70d0c7766eb9 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:20:54.818474 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-18964364-1fdf-4dd7-95ab-56138e023237 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] 10.222.0.27 "GET /compute/v2.1/servers/9426a1f8-7d16-47ec-af01-70d0c7766eb9" status: 404 len: 111 microversion: 2.1 time: 0.062112 Sep 08 11:20:54.818474 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3081/6295] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:20:54 2022] GET /compute/v2.1/servers/9426a1f8-7d16-47ec-af01-70d0c7766eb9 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:20:54.978353 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2000ae7f-a7f9-4d5e-b5d6-137f64ee4483 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:20:54.979216 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2000ae7f-a7f9-4d5e-b5d6-137f64ee4483 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 32ae7194-7c7b-401a-9ffc-8ba37edade77] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:20:54.990692 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2000ae7f-a7f9-4d5e-b5d6-137f64ee4483 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:54.991209 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2000ae7f-a7f9-4d5e-b5d6-137f64ee4483 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:54.991654 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2000ae7f-a7f9-4d5e-b5d6-137f64ee4483 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:54.998713 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2000ae7f-a7f9-4d5e-b5d6-137f64ee4483 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:54.999246 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2000ae7f-a7f9-4d5e-b5d6-137f64ee4483 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:54.999705 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2000ae7f-a7f9-4d5e-b5d6-137f64ee4483 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:55.048472 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:20:55.358866 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2000ae7f-a7f9-4d5e-b5d6-137f64ee4483 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:20:55.370492 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2000ae7f-a7f9-4d5e-b5d6-137f64ee4483 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/32ae7194-7c7b-401a-9ffc-8ba37edade77" status: 200 len: 1691 microversion: 2.1 time: 0.398209 Sep 08 11:20:55.385051 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3215/6296] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:20:54 2022] GET /compute/v2.1/servers/32ae7194-7c7b-401a-9ffc-8ba37edade77 => generated 1691 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:20:55.463814 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dae85b44-ec3a-4057-bfdb-c810e8731758 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] Calling method '.version_select at 0x7f68e8a5bdc0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:20:55.488088 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-dae85b44-ec3a-4057-bfdb-c810e8731758 tempest-TestServerBasicOps-1023076899 tempest-TestServerBasicOps-1023076899-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1946750982" status: 202 len: 0 microversion: 2.1 time: 0.028399 Sep 08 11:20:55.489070 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3082/6297] 10.222.0.27 () {58 vars in 1254 bytes} [Thu Sep 8 11:20:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1946750982 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:20:56.396640 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5abebf1c-4908-45d4-a4c0-e7b25e3cd02b tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:20:56.398877 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5abebf1c-4908-45d4-a4c0-e7b25e3cd02b tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 32ae7194-7c7b-401a-9ffc-8ba37edade77] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:20:56.406664 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5abebf1c-4908-45d4-a4c0-e7b25e3cd02b tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:56.408290 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5abebf1c-4908-45d4-a4c0-e7b25e3cd02b tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:56.408760 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5abebf1c-4908-45d4-a4c0-e7b25e3cd02b tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:56.409530 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5abebf1c-4908-45d4-a4c0-e7b25e3cd02b tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:56.410009 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5abebf1c-4908-45d4-a4c0-e7b25e3cd02b tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:56.410460 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5abebf1c-4908-45d4-a4c0-e7b25e3cd02b tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:56.754887 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5abebf1c-4908-45d4-a4c0-e7b25e3cd02b tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:20:56.776635 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5abebf1c-4908-45d4-a4c0-e7b25e3cd02b tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/32ae7194-7c7b-401a-9ffc-8ba37edade77" status: 200 len: 1697 microversion: 2.1 time: 0.384430 Sep 08 11:20:56.777309 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3216/6298] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:20:56 2022] GET /compute/v2.1/servers/32ae7194-7c7b-401a-9ffc-8ba37edade77 => generated 1697 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:20:57.803490 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e6265cc7-3a89-4d32-a2c2-60c8dd7669a5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:20:57.804861 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e6265cc7-3a89-4d32-a2c2-60c8dd7669a5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 32ae7194-7c7b-401a-9ffc-8ba37edade77] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:20:57.808336 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:20:57.813461 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e6265cc7-3a89-4d32-a2c2-60c8dd7669a5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:57.813928 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e6265cc7-3a89-4d32-a2c2-60c8dd7669a5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:57.814575 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e6265cc7-3a89-4d32-a2c2-60c8dd7669a5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:57.815340 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e6265cc7-3a89-4d32-a2c2-60c8dd7669a5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:57.815825 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e6265cc7-3a89-4d32-a2c2-60c8dd7669a5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:57.816283 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e6265cc7-3a89-4d32-a2c2-60c8dd7669a5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:57.821938 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:20:58.223004 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e6265cc7-3a89-4d32-a2c2-60c8dd7669a5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:20:58.233860 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e6265cc7-3a89-4d32-a2c2-60c8dd7669a5 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/32ae7194-7c7b-401a-9ffc-8ba37edade77" status: 200 len: 1697 microversion: 2.1 time: 0.435981 Sep 08 11:20:58.234456 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3083/6299] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:20:57 2022] GET /compute/v2.1/servers/32ae7194-7c7b-401a-9ffc-8ba37edade77 => generated 1697 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:20:59.266046 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6e8182b6-5900-47cc-91aa-d2ec3fd8f854 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:20:59.268263 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6e8182b6-5900-47cc-91aa-d2ec3fd8f854 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 32ae7194-7c7b-401a-9ffc-8ba37edade77] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:20:59.281104 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:20:59.284042 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6e8182b6-5900-47cc-91aa-d2ec3fd8f854 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:59.285224 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6e8182b6-5900-47cc-91aa-d2ec3fd8f854 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:59.286306 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6e8182b6-5900-47cc-91aa-d2ec3fd8f854 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:59.287809 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6e8182b6-5900-47cc-91aa-d2ec3fd8f854 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:59.289016 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6e8182b6-5900-47cc-91aa-d2ec3fd8f854 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:59.291045 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6e8182b6-5900-47cc-91aa-d2ec3fd8f854 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:59.853910 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6e8182b6-5900-47cc-91aa-d2ec3fd8f854 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:20:59.867930 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6e8182b6-5900-47cc-91aa-d2ec3fd8f854 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/32ae7194-7c7b-401a-9ffc-8ba37edade77" status: 200 len: 1682 microversion: 2.1 time: 0.608485 Sep 08 11:20:59.869803 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3217/6300] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:20:59 2022] GET /compute/v2.1/servers/32ae7194-7c7b-401a-9ffc-8ba37edade77 => generated 1682 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:21:01.358478 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-a051a5b4-fac2-45c5-8961-912ed89814c9 req-f7ce2789-f090-490e-89da-9936348890fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32ae7194-7c7b-401a-9ffc-8ba37edade77", "name": "network-vif-plugged", "status": "completed", "tag": "9fb97025-3ccf-4a27-a965-ddd3f1b88d13"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:21:01.425335 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a051a5b4-fac2-45c5-8961-912ed89814c9 req-f7ce2789-f090-490e-89da-9936348890fe service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:01.430501 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a051a5b4-fac2-45c5-8961-912ed89814c9 req-f7ce2789-f090-490e-89da-9936348890fe service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:01.431290 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a051a5b4-fac2-45c5-8961-912ed89814c9 req-f7ce2789-f090-490e-89da-9936348890fe service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:01.449246 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-a051a5b4-fac2-45c5-8961-912ed89814c9 req-f7ce2789-f090-490e-89da-9936348890fe service nova] Creating event network-vif-plugged:9fb97025-3ccf-4a27-a965-ddd3f1b88d13 for instance 32ae7194-7c7b-401a-9ffc-8ba37edade77 on n-h1-850501-12 Sep 08 11:21:01.481740 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-a051a5b4-fac2-45c5-8961-912ed89814c9 req-f7ce2789-f090-490e-89da-9936348890fe service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127521 Sep 08 11:21:01.483616 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3084/6301] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:21:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:21:26.361651 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-88a86a67-c33f-4b96-9575-3d77ffbaeeed tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:21:26.367439 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-88a86a67-c33f-4b96-9575-3d77ffbaeeed tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 32ae7194-7c7b-401a-9ffc-8ba37edade77] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:21:26.380503 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:21:26.382018 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=14 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:21:26.384070 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88a86a67-c33f-4b96-9575-3d77ffbaeeed tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:26.384831 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88a86a67-c33f-4b96-9575-3d77ffbaeeed tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:26.393178 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88a86a67-c33f-4b96-9575-3d77ffbaeeed tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:26.394639 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88a86a67-c33f-4b96-9575-3d77ffbaeeed tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:26.395346 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88a86a67-c33f-4b96-9575-3d77ffbaeeed tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:26.395950 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88a86a67-c33f-4b96-9575-3d77ffbaeeed tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:26.467137 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-88a86a67-c33f-4b96-9575-3d77ffbaeeed tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "POST /compute/v2.1/servers/32ae7194-7c7b-401a-9ffc-8ba37edade77/action" status: 200 len: 24551 microversion: 2.1 time: 0.111934 Sep 08 11:21:26.475970 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3218/6302] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 11:21:26 2022] POST /compute/v2.1/servers/32ae7194-7c7b-401a-9ffc-8ba37edade77/action => generated 24551 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 11:21:40.262553 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-08df7352-4ebd-465f-a0c8-f953609fc9e8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:21:40.263165 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-08df7352-4ebd-465f-a0c8-f953609fc9e8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 32ae7194-7c7b-401a-9ffc-8ba37edade77] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:21:40.268655 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-075f2025-f924-487e-a893-20e9fcad5656 req-76f059d0-c35d-47e3-8f60-d06771518409 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32ae7194-7c7b-401a-9ffc-8ba37edade77", "tag": "9fb97025-3ccf-4a27-a965-ddd3f1b88d13"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:21:40.276889 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:21:40.280753 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=7 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:21:40.282875 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08df7352-4ebd-465f-a0c8-f953609fc9e8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:40.286520 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08df7352-4ebd-465f-a0c8-f953609fc9e8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:40.288354 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08df7352-4ebd-465f-a0c8-f953609fc9e8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:40.290407 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08df7352-4ebd-465f-a0c8-f953609fc9e8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:40.291634 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08df7352-4ebd-465f-a0c8-f953609fc9e8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:40.292078 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08df7352-4ebd-465f-a0c8-f953609fc9e8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:40.297276 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:21:40.298876 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=4 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:21:40.306815 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-075f2025-f924-487e-a893-20e9fcad5656 req-76f059d0-c35d-47e3-8f60-d06771518409 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:40.307872 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-075f2025-f924-487e-a893-20e9fcad5656 req-76f059d0-c35d-47e3-8f60-d06771518409 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:40.309777 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-075f2025-f924-487e-a893-20e9fcad5656 req-76f059d0-c35d-47e3-8f60-d06771518409 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:40.332648 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-075f2025-f924-487e-a893-20e9fcad5656 req-76f059d0-c35d-47e3-8f60-d06771518409 service nova] Creating event network-changed:9fb97025-3ccf-4a27-a965-ddd3f1b88d13 for instance 32ae7194-7c7b-401a-9ffc-8ba37edade77 on n-h1-850501-12 Sep 08 11:21:40.339278 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-075f2025-f924-487e-a893-20e9fcad5656 req-76f059d0-c35d-47e3-8f60-d06771518409 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074956 Sep 08 11:21:40.346659 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3219/6303] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:21:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:21:40.360794 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-08df7352-4ebd-465f-a0c8-f953609fc9e8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 32ae7194-7c7b-401a-9ffc-8ba37edade77] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:21:40.575127 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-08df7352-4ebd-465f-a0c8-f953609fc9e8 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "DELETE /compute/v2.1/servers/32ae7194-7c7b-401a-9ffc-8ba37edade77" status: 204 len: 0 microversion: 2.1 time: 0.316219 Sep 08 11:21:40.576259 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3085/6304] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:21:40 2022] DELETE /compute/v2.1/servers/32ae7194-7c7b-401a-9ffc-8ba37edade77 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:21:40.589118 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-43ec7592-013a-4aa9-888c-4371d7b4ae6e tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:21:40.590733 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-43ec7592-013a-4aa9-888c-4371d7b4ae6e tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 32ae7194-7c7b-401a-9ffc-8ba37edade77] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:21:40.600500 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-43ec7592-013a-4aa9-888c-4371d7b4ae6e tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:40.601612 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-43ec7592-013a-4aa9-888c-4371d7b4ae6e tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:40.602836 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-43ec7592-013a-4aa9-888c-4371d7b4ae6e tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:40.603987 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-43ec7592-013a-4aa9-888c-4371d7b4ae6e tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:40.604762 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-43ec7592-013a-4aa9-888c-4371d7b4ae6e tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:40.605770 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-43ec7592-013a-4aa9-888c-4371d7b4ae6e tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:40.999163 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-43ec7592-013a-4aa9-888c-4371d7b4ae6e tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:21:41.009933 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-43ec7592-013a-4aa9-888c-4371d7b4ae6e tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/32ae7194-7c7b-401a-9ffc-8ba37edade77" status: 200 len: 1688 microversion: 2.1 time: 0.427586 Sep 08 11:21:41.026419 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3220/6305] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:21:40 2022] GET /compute/v2.1/servers/32ae7194-7c7b-401a-9ffc-8ba37edade77 => generated 1688 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:21:42.040611 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-65333c9b-7c83-4118-aa8a-695e25753507 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:21:42.041355 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-65333c9b-7c83-4118-aa8a-695e25753507 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 32ae7194-7c7b-401a-9ffc-8ba37edade77] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:21:42.049979 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-65333c9b-7c83-4118-aa8a-695e25753507 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:42.050893 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-65333c9b-7c83-4118-aa8a-695e25753507 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:42.051568 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-65333c9b-7c83-4118-aa8a-695e25753507 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:42.052721 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-65333c9b-7c83-4118-aa8a-695e25753507 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:42.053456 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-65333c9b-7c83-4118-aa8a-695e25753507 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:42.054119 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-65333c9b-7c83-4118-aa8a-695e25753507 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:42.401542 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-65333c9b-7c83-4118-aa8a-695e25753507 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:21:42.414524 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-65333c9b-7c83-4118-aa8a-695e25753507 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/32ae7194-7c7b-401a-9ffc-8ba37edade77" status: 200 len: 1688 microversion: 2.1 time: 0.378369 Sep 08 11:21:42.416076 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3086/6306] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:21:42 2022] GET /compute/v2.1/servers/32ae7194-7c7b-401a-9ffc-8ba37edade77 => generated 1688 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:21:43.400237 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-8ccbfb94-789c-4f18-90f8-08490619c040 req-ed1f55db-4948-4a19-abbb-e3dfef8cb6f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32ae7194-7c7b-401a-9ffc-8ba37edade77", "name": "network-vif-deleted", "tag": "9fb97025-3ccf-4a27-a965-ddd3f1b88d13"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:21:43.435616 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-8ccbfb94-789c-4f18-90f8-08490619c040 req-ed1f55db-4948-4a19-abbb-e3dfef8cb6f1 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:43.436141 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-8ccbfb94-789c-4f18-90f8-08490619c040 req-ed1f55db-4948-4a19-abbb-e3dfef8cb6f1 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:43.436768 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-8ccbfb94-789c-4f18-90f8-08490619c040 req-ed1f55db-4948-4a19-abbb-e3dfef8cb6f1 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:43.441140 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9353a7a0-8047-4d4f-885e-fd919199513c tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:21:43.442364 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9353a7a0-8047-4d4f-885e-fd919199513c tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 32ae7194-7c7b-401a-9ffc-8ba37edade77] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:21:43.456194 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-8ccbfb94-789c-4f18-90f8-08490619c040 req-ed1f55db-4948-4a19-abbb-e3dfef8cb6f1 service nova] Creating event network-vif-deleted:9fb97025-3ccf-4a27-a965-ddd3f1b88d13 for instance 32ae7194-7c7b-401a-9ffc-8ba37edade77 on n-h1-850501-12 Sep 08 11:21:43.460094 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9353a7a0-8047-4d4f-885e-fd919199513c tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:43.460603 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9353a7a0-8047-4d4f-885e-fd919199513c tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:43.461062 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9353a7a0-8047-4d4f-885e-fd919199513c tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:43.461800 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9353a7a0-8047-4d4f-885e-fd919199513c tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:43.466675 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-8ccbfb94-789c-4f18-90f8-08490619c040 req-ed1f55db-4948-4a19-abbb-e3dfef8cb6f1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073348 Sep 08 11:21:43.467923 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3221/6307] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:21:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:21:43.468405 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9353a7a0-8047-4d4f-885e-fd919199513c tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:43.472159 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9353a7a0-8047-4d4f-885e-fd919199513c tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:43.608834 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9353a7a0-8047-4d4f-885e-fd919199513c tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33e91fa4e3746aa8d8d23940e17bc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f9071124e74802a2f76cb326ca58df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:21:43.622926 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9353a7a0-8047-4d4f-885e-fd919199513c tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/32ae7194-7c7b-401a-9ffc-8ba37edade77" status: 200 len: 1351 microversion: 2.1 time: 0.184700 Sep 08 11:21:43.624151 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3087/6308] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:21:43 2022] GET /compute/v2.1/servers/32ae7194-7c7b-401a-9ffc-8ba37edade77 => generated 1351 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:21:44.655430 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f7185a3c-74d3-444d-a293-813e64259972 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:21:44.656861 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f7185a3c-74d3-444d-a293-813e64259972 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] [instance: 32ae7194-7c7b-401a-9ffc-8ba37edade77] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:21:44.670463 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f7185a3c-74d3-444d-a293-813e64259972 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:44.671018 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f7185a3c-74d3-444d-a293-813e64259972 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:44.671468 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f7185a3c-74d3-444d-a293-813e64259972 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:44.672952 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f7185a3c-74d3-444d-a293-813e64259972 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:44.673462 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f7185a3c-74d3-444d-a293-813e64259972 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:44.675165 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f7185a3c-74d3-444d-a293-813e64259972 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:44.708145 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-f7185a3c-74d3-444d-a293-813e64259972 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] HTTP exception thrown: Instance 32ae7194-7c7b-401a-9ffc-8ba37edade77 could not be found. Sep 08 11:21:44.710130 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f7185a3c-74d3-444d-a293-813e64259972 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Request method failure captured: Sep 08 11:21:44.710130 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/32ae7194-7c7b-401a-9ffc-8ba37edade77 HTTP/1.1 Sep 08 11:21:44.710130 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:21:44.710130 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:21:44.710130 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:21:44.710130 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 11:21:44.710130 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:21:44.710130 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:21:44.710130 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:21:44.710130 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:21:44.710130 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGc4eLGLW59QQolLaaYcmDAiK1YbvX0P6Oar8zm2OskBZObiWASS3uPq8vhdcTC5ZdVCfihBjMcHmME9I_dk-w3cv_qjNt6vtGdn5VgVz6nIlOrAKGTn8XYgxYQT4bLviOyr8E8viE7U4gtGDdg6vP3Ww_5rPnGvOSYRnSwZtG3vZ7Ao Sep 08 11:21:44.710130 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:21:44.710130 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:21:44.710130 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:21:44.710130 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:21:44.710130 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:21:44.710130 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:21:44.710130 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: a0f9071124e74802a2f76cb326ca58df Sep 08 11:21:44.710130 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1864834353 Sep 08 11:21:44.710130 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:21:44.710130 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:21:44.710130 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a0f9071124e74802a2f76cb326ca58df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a0f9071124e74802a2f76cb326ca58df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a0f9071124e74802a2f76cb326ca58df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a0f9071124e74802a2f76cb326ca58df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:21:44.710130 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1864834353 Sep 08 11:21:44.710130 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: a0f9071124e74802a2f76cb326ca58df Sep 08 11:21:44.710130 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1864834353 Sep 08 11:21:44.710130 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-TestNetworkAdvancedServerOps-1864834353-project Sep 08 11:21:44.710130 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:21:44.710130 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:21:44.710130 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: c33e91fa4e3746aa8d8d23940e17bc1e Sep 08 11:21:44.710130 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1864834353-project Sep 08 11:21:44.710130 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 11:21:44.710130 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 32ae7194-7c7b-401a-9ffc-8ba37edade77 could not be found. Sep 08 11:21:44.710130 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '32ae7194-7c7b-401a-9ffc-8ba37edade77'} Sep 08 11:21:44.710130 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:21:44.710130 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:21:44.710130 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:21:44.710130 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:21:44.710130 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:21:44.710130 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:21:44.710130 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:21:44.710130 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:21:44.710130 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:21:44.710130 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:21:44.710130 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32ae7194-7c7b-401a-9ffc-8ba37edade77 could not be found. Sep 08 11:21:44.710130 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:21:44.710130 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:21:44.710130 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:21:44.710130 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:21:44.710130 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:21:44.710130 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:21:44.710130 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:21:44.710130 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:21:44.710130 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:21:44.710130 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:21:44.710130 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:21:44.710130 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:21:44.710130 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:21:44.710130 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:21:44.710130 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:21:44.710130 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:21:44.710130 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32ae7194-7c7b-401a-9ffc-8ba37edade77 could not be found. Sep 08 11:21:44.710130 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:21:44.710130 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:21:44.717702 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:21:44.717702 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:21:44.717702 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:21:44.717702 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:21:44.717702 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:21:44.717702 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:21:44.717702 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32ae7194-7c7b-401a-9ffc-8ba37edade77 could not be found. Sep 08 11:21:44.717702 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:21:44.717702 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f7185a3c-74d3-444d-a293-813e64259972 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Returning 404 to user: Instance 32ae7194-7c7b-401a-9ffc-8ba37edade77 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:21:44.717702 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f7185a3c-74d3-444d-a293-813e64259972 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "GET /compute/v2.1/servers/32ae7194-7c7b-401a-9ffc-8ba37edade77" status: 404 len: 111 microversion: 2.1 time: 0.062907 Sep 08 11:21:44.717702 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3222/6309] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:21:44 2022] GET /compute/v2.1/servers/32ae7194-7c7b-401a-9ffc-8ba37edade77 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:21:54.063214 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0aa5d971-1070-4529-9de7-cf87d75aa948 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] Calling method '.version_select at 0x7f68e4e5c310>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:21:54.068875 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:21:54.074556 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:21:54.099111 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0aa5d971-1070-4529-9de7-cf87d75aa948 tempest-TestNetworkAdvancedServerOps-1864834353 tempest-TestNetworkAdvancedServerOps-1864834353-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1701457310" status: 202 len: 0 microversion: 2.1 time: 0.040971 Sep 08 11:21:54.099675 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3088/6310] 10.222.0.27 () {58 vars in 1284 bytes} [Thu Sep 8 11:21:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1701457310 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:22:08.704629 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9c80c736-be70-48e3-868a-e93d527dee6e tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Action: 'create', calling method: .version_select at 0x7f68df2e3550>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-244292021", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCW806BM/ifKYKy9Vyixy6ICiEAD660lUslzFwJ034y8whYayPcSGF34DgX5ObdfEao2idCEnRNoWkJS4s6+oakJlKhH1VOdBH4ioKsaogehToumahOavs5eP85/X3EXw=="}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:22:08.713776 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=8 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:22:08.714432 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=12 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:22:08.733751 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-9c80c736-be70-48e3-868a-e93d527dee6e tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Getting quotas for project 8f85ab8354294e359cabfca999283d5a. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:22:08.741823 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-9c80c736-be70-48e3-868a-e93d527dee6e tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Getting quotas for user 761124676b5e4a8db0bc59740c1f535e and project 8f85ab8354294e359cabfca999283d5a. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:22:08.775874 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9c80c736-be70-48e3-868a-e93d527dee6e tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.074215 Sep 08 11:22:08.785268 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3223/6311] 10.222.0.27 () {60 vars in 1159 bytes} [Thu Sep 8 11:22:08 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:22:10.696129 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:22:10.700783 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-833b72d8-f8d9-4e58-9ae4-77c34c157648 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1607553964", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "8891913e-f30e-479d-8a72-155082097add"}], "key_name": "tempest-TestNetworkBasicOps-244292021", "security_groups": [{"name": "tempest-secgroup-smoke-796085776"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:22:10.855499 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-833b72d8-f8d9-4e58-9ae4-77c34c157648 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] validate_networks() for [('8891913e-f30e-479d-8a72-155082097add', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:22:11.464365 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-833b72d8-f8d9-4e58-9ae4-77c34c157648 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:22:11.464793 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-833b72d8-f8d9-4e58-9ae4-77c34c157648 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:22:11.465309 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-833b72d8-f8d9-4e58-9ae4-77c34c157648 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:22:11.465723 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-833b72d8-f8d9-4e58-9ae4-77c34c157648 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:22:11.466141 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-833b72d8-f8d9-4e58-9ae4-77c34c157648 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:22:11.491273 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-833b72d8-f8d9-4e58-9ae4-77c34c157648 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:22:11.492642 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-833b72d8-f8d9-4e58-9ae4-77c34c157648 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:22:11.493265 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-833b72d8-f8d9-4e58-9ae4-77c34c157648 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:22:11.494318 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-833b72d8-f8d9-4e58-9ae4-77c34c157648 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:22:11.495524 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-833b72d8-f8d9-4e58-9ae4-77c34c157648 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:22:11.496147 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-833b72d8-f8d9-4e58-9ae4-77c34c157648 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:22:11.544707 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-833b72d8-f8d9-4e58-9ae4-77c34c157648 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Getting quotas for project 8f85ab8354294e359cabfca999283d5a. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:22:11.552491 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-833b72d8-f8d9-4e58-9ae4-77c34c157648 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Getting quotas for user 761124676b5e4a8db0bc59740c1f535e and project 8f85ab8354294e359cabfca999283d5a. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:22:11.570478 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-833b72d8-f8d9-4e58-9ae4-77c34c157648 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:22:11.581064 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-833b72d8-f8d9-4e58-9ae4-77c34c157648 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] [instance: b06cee3a-5166-4195-a2fc-465c711726d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:22:11.658390 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-833b72d8-f8d9-4e58-9ae4-77c34c157648 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.963712 Sep 08 11:22:11.659213 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3089/6312] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 11:22:10 2022] POST /compute/v2.1/servers => generated 405 bytes in 966 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:22:11.673752 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f9f545ef-aa17-42fd-8ddf-48a1f04c57ef tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:22:11.675301 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f9f545ef-aa17-42fd-8ddf-48a1f04c57ef tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] [instance: b06cee3a-5166-4195-a2fc-465c711726d0] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:22:11.822677 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f9f545ef-aa17-42fd-8ddf-48a1f04c57ef tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761124676b5e4a8db0bc59740c1f535e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f85ab8354294e359cabfca999283d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:22:11.843334 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f9f545ef-aa17-42fd-8ddf-48a1f04c57ef tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] 10.222.0.27 "GET /compute/v2.1/servers/b06cee3a-5166-4195-a2fc-465c711726d0" status: 200 len: 1248 microversion: 2.1 time: 0.176092 Sep 08 11:22:11.849927 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3224/6313] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:22:11 2022] GET /compute/v2.1/servers/b06cee3a-5166-4195-a2fc-465c711726d0 => generated 1248 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:22:12.876873 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5c7233e7-dc41-4159-af96-75ae1c9cb463 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:22:12.878406 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5c7233e7-dc41-4159-af96-75ae1c9cb463 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] [instance: b06cee3a-5166-4195-a2fc-465c711726d0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:22:12.894896 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c7233e7-dc41-4159-af96-75ae1c9cb463 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:22:12.895526 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c7233e7-dc41-4159-af96-75ae1c9cb463 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:22:12.896035 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c7233e7-dc41-4159-af96-75ae1c9cb463 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:22:12.896939 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c7233e7-dc41-4159-af96-75ae1c9cb463 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:22:12.897611 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c7233e7-dc41-4159-af96-75ae1c9cb463 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:22:12.898736 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c7233e7-dc41-4159-af96-75ae1c9cb463 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:22:13.002277 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5c7233e7-dc41-4159-af96-75ae1c9cb463 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761124676b5e4a8db0bc59740c1f535e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f85ab8354294e359cabfca999283d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:22:13.042003 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5c7233e7-dc41-4159-af96-75ae1c9cb463 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] 10.222.0.27 "GET /compute/v2.1/servers/b06cee3a-5166-4195-a2fc-465c711726d0" status: 200 len: 1300 microversion: 2.1 time: 0.171316 Sep 08 11:22:13.044533 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3090/6314] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:22:12 2022] GET /compute/v2.1/servers/b06cee3a-5166-4195-a2fc-465c711726d0 => generated 1300 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:22:14.075186 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7a442ec6-cd10-4335-b7ec-d10be7999f9f tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:22:14.077419 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7a442ec6-cd10-4335-b7ec-d10be7999f9f tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] [instance: b06cee3a-5166-4195-a2fc-465c711726d0] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:22:14.085683 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a442ec6-cd10-4335-b7ec-d10be7999f9f tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:22:14.086492 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a442ec6-cd10-4335-b7ec-d10be7999f9f tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:22:14.086937 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a442ec6-cd10-4335-b7ec-d10be7999f9f tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:22:14.087840 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a442ec6-cd10-4335-b7ec-d10be7999f9f tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:22:14.088315 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a442ec6-cd10-4335-b7ec-d10be7999f9f tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:22:14.088750 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a442ec6-cd10-4335-b7ec-d10be7999f9f tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:22:14.226494 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7a442ec6-cd10-4335-b7ec-d10be7999f9f tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761124676b5e4a8db0bc59740c1f535e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f85ab8354294e359cabfca999283d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:22:14.241736 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7a442ec6-cd10-4335-b7ec-d10be7999f9f tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] 10.222.0.27 "GET /compute/v2.1/servers/b06cee3a-5166-4195-a2fc-465c711726d0" status: 200 len: 1306 microversion: 2.1 time: 0.171231 Sep 08 11:22:14.244306 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3225/6315] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:22:14 2022] GET /compute/v2.1/servers/b06cee3a-5166-4195-a2fc-465c711726d0 => generated 1306 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:22:15.267525 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0fcf5b0a-35d4-41d1-836c-049476e21c00 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:22:15.268076 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0fcf5b0a-35d4-41d1-836c-049476e21c00 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] [instance: b06cee3a-5166-4195-a2fc-465c711726d0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:22:15.275627 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0fcf5b0a-35d4-41d1-836c-049476e21c00 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:22:15.276429 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0fcf5b0a-35d4-41d1-836c-049476e21c00 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:22:15.276728 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0fcf5b0a-35d4-41d1-836c-049476e21c00 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:22:15.277531 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0fcf5b0a-35d4-41d1-836c-049476e21c00 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:22:15.278090 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0fcf5b0a-35d4-41d1-836c-049476e21c00 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:22:15.278585 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0fcf5b0a-35d4-41d1-836c-049476e21c00 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:22:15.352572 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0fcf5b0a-35d4-41d1-836c-049476e21c00 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761124676b5e4a8db0bc59740c1f535e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f85ab8354294e359cabfca999283d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:22:15.366519 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0fcf5b0a-35d4-41d1-836c-049476e21c00 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] 10.222.0.27 "GET /compute/v2.1/servers/b06cee3a-5166-4195-a2fc-465c711726d0" status: 200 len: 1306 microversion: 2.1 time: 0.103637 Sep 08 11:22:15.367918 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3091/6316] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:22:15 2022] GET /compute/v2.1/servers/b06cee3a-5166-4195-a2fc-465c711726d0 => generated 1306 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:22:16.395228 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2aa4bafb-7b19-48b5-8de0-eebbd63e800e tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:22:16.395855 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2aa4bafb-7b19-48b5-8de0-eebbd63e800e tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] [instance: b06cee3a-5166-4195-a2fc-465c711726d0] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:22:16.402623 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2aa4bafb-7b19-48b5-8de0-eebbd63e800e tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:22:16.409644 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2aa4bafb-7b19-48b5-8de0-eebbd63e800e tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:22:16.410242 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2aa4bafb-7b19-48b5-8de0-eebbd63e800e tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:22:16.411099 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2aa4bafb-7b19-48b5-8de0-eebbd63e800e tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:22:16.413327 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2aa4bafb-7b19-48b5-8de0-eebbd63e800e tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:22:16.414055 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2aa4bafb-7b19-48b5-8de0-eebbd63e800e tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:22:16.823505 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2aa4bafb-7b19-48b5-8de0-eebbd63e800e tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761124676b5e4a8db0bc59740c1f535e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f85ab8354294e359cabfca999283d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:22:16.836488 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2aa4bafb-7b19-48b5-8de0-eebbd63e800e tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] 10.222.0.27 "GET /compute/v2.1/servers/b06cee3a-5166-4195-a2fc-465c711726d0" status: 200 len: 1373 microversion: 2.1 time: 0.443678 Sep 08 11:22:16.838647 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3226/6317] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:22:16 2022] GET /compute/v2.1/servers/b06cee3a-5166-4195-a2fc-465c711726d0 => generated 1373 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:22:17.232511 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-309fccc7-85ca-4c96-b467-2ac9dac23cba req-599ea020-e872-4db4-8fc1-526153c7438a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b06cee3a-5166-4195-a2fc-465c711726d0", "tag": "99690eff-0cda-4a9d-ade3-d491c8966a33"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:22:17.283552 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-309fccc7-85ca-4c96-b467-2ac9dac23cba req-599ea020-e872-4db4-8fc1-526153c7438a service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:22:17.286045 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-309fccc7-85ca-4c96-b467-2ac9dac23cba req-599ea020-e872-4db4-8fc1-526153c7438a service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:22:17.287790 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-309fccc7-85ca-4c96-b467-2ac9dac23cba req-599ea020-e872-4db4-8fc1-526153c7438a service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:22:17.315885 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-309fccc7-85ca-4c96-b467-2ac9dac23cba req-599ea020-e872-4db4-8fc1-526153c7438a service nova] Creating event network-changed:99690eff-0cda-4a9d-ade3-d491c8966a33 for instance b06cee3a-5166-4195-a2fc-465c711726d0 on n-h1-850501-12 Sep 08 11:22:17.335491 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-309fccc7-85ca-4c96-b467-2ac9dac23cba req-599ea020-e872-4db4-8fc1-526153c7438a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109692 Sep 08 11:22:17.336490 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3092/6318] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:22:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:22:17.865420 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-04c43f67-21df-4c64-9c7e-5308e8747841 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:22:17.866042 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-04c43f67-21df-4c64-9c7e-5308e8747841 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] [instance: b06cee3a-5166-4195-a2fc-465c711726d0] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:22:17.872906 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-04c43f67-21df-4c64-9c7e-5308e8747841 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:22:17.875047 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-04c43f67-21df-4c64-9c7e-5308e8747841 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:22:17.875931 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-04c43f67-21df-4c64-9c7e-5308e8747841 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:22:17.877077 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-04c43f67-21df-4c64-9c7e-5308e8747841 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:22:17.878027 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-04c43f67-21df-4c64-9c7e-5308e8747841 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:22:17.878757 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-04c43f67-21df-4c64-9c7e-5308e8747841 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:22:18.190865 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-04c43f67-21df-4c64-9c7e-5308e8747841 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761124676b5e4a8db0bc59740c1f535e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f85ab8354294e359cabfca999283d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:22:18.209620 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-04c43f67-21df-4c64-9c7e-5308e8747841 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] 10.222.0.27 "GET /compute/v2.1/servers/b06cee3a-5166-4195-a2fc-465c711726d0" status: 200 len: 1373 microversion: 2.1 time: 0.348262 Sep 08 11:22:18.211307 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3227/6319] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:22:17 2022] GET /compute/v2.1/servers/b06cee3a-5166-4195-a2fc-465c711726d0 => generated 1373 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:22:19.238200 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-eb9e09d4-1571-4d31-9657-c8edd05a56f3 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:22:19.239059 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-eb9e09d4-1571-4d31-9657-c8edd05a56f3 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] [instance: b06cee3a-5166-4195-a2fc-465c711726d0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:22:19.248760 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb9e09d4-1571-4d31-9657-c8edd05a56f3 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:22:19.251149 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb9e09d4-1571-4d31-9657-c8edd05a56f3 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:22:19.252184 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb9e09d4-1571-4d31-9657-c8edd05a56f3 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:22:19.253696 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb9e09d4-1571-4d31-9657-c8edd05a56f3 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:22:19.254745 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb9e09d4-1571-4d31-9657-c8edd05a56f3 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:22:19.255661 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb9e09d4-1571-4d31-9657-c8edd05a56f3 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:22:19.544323 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-eb9e09d4-1571-4d31-9657-c8edd05a56f3 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761124676b5e4a8db0bc59740c1f535e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f85ab8354294e359cabfca999283d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:22:19.553932 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-eb9e09d4-1571-4d31-9657-c8edd05a56f3 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] 10.222.0.27 "GET /compute/v2.1/servers/b06cee3a-5166-4195-a2fc-465c711726d0" status: 200 len: 1373 microversion: 2.1 time: 0.321139 Sep 08 11:22:19.555160 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3093/6320] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:22:19 2022] GET /compute/v2.1/servers/b06cee3a-5166-4195-a2fc-465c711726d0 => generated 1373 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:22:20.581849 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e802b8b5-4b94-4863-9e0f-53bfc1f4a296 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:22:20.583329 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e802b8b5-4b94-4863-9e0f-53bfc1f4a296 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] [instance: b06cee3a-5166-4195-a2fc-465c711726d0] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:22:20.591859 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e802b8b5-4b94-4863-9e0f-53bfc1f4a296 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:22:20.593212 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e802b8b5-4b94-4863-9e0f-53bfc1f4a296 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:22:20.593847 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e802b8b5-4b94-4863-9e0f-53bfc1f4a296 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:22:20.594802 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e802b8b5-4b94-4863-9e0f-53bfc1f4a296 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:22:20.596065 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e802b8b5-4b94-4863-9e0f-53bfc1f4a296 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:22:20.596687 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e802b8b5-4b94-4863-9e0f-53bfc1f4a296 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:22:20.859993 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e802b8b5-4b94-4863-9e0f-53bfc1f4a296 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761124676b5e4a8db0bc59740c1f535e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f85ab8354294e359cabfca999283d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:22:20.875540 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e802b8b5-4b94-4863-9e0f-53bfc1f4a296 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] 10.222.0.27 "GET /compute/v2.1/servers/b06cee3a-5166-4195-a2fc-465c711726d0" status: 200 len: 1373 microversion: 2.1 time: 0.297987 Sep 08 11:22:20.876307 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3228/6321] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:22:20 2022] GET /compute/v2.1/servers/b06cee3a-5166-4195-a2fc-465c711726d0 => generated 1373 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:22:21.899887 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bde0167a-8e72-43a9-a2fc-a0c977adcbcd tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:22:21.900511 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bde0167a-8e72-43a9-a2fc-a0c977adcbcd tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] [instance: b06cee3a-5166-4195-a2fc-465c711726d0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:22:21.903416 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:22:21.904520 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:22:21.930529 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bde0167a-8e72-43a9-a2fc-a0c977adcbcd tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:22:21.931319 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bde0167a-8e72-43a9-a2fc-a0c977adcbcd tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:22:21.932158 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bde0167a-8e72-43a9-a2fc-a0c977adcbcd tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:22:21.933489 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bde0167a-8e72-43a9-a2fc-a0c977adcbcd tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:22:21.934214 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bde0167a-8e72-43a9-a2fc-a0c977adcbcd tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:22:21.935639 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bde0167a-8e72-43a9-a2fc-a0c977adcbcd tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:22:22.200759 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bde0167a-8e72-43a9-a2fc-a0c977adcbcd tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761124676b5e4a8db0bc59740c1f535e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f85ab8354294e359cabfca999283d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:22:22.221524 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bde0167a-8e72-43a9-a2fc-a0c977adcbcd tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] 10.222.0.27 "GET /compute/v2.1/servers/b06cee3a-5166-4195-a2fc-465c711726d0" status: 200 len: 1373 microversion: 2.1 time: 0.325388 Sep 08 11:22:22.222744 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3094/6322] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:22:21 2022] GET /compute/v2.1/servers/b06cee3a-5166-4195-a2fc-465c711726d0 => generated 1373 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:22:23.258240 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d64a0dc4-25c2-4bff-8af6-ba1a5e56e972 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:22:23.264242 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d64a0dc4-25c2-4bff-8af6-ba1a5e56e972 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] [instance: b06cee3a-5166-4195-a2fc-465c711726d0] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:22:23.288961 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=6 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:22:23.294728 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d64a0dc4-25c2-4bff-8af6-ba1a5e56e972 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:22:23.299995 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d64a0dc4-25c2-4bff-8af6-ba1a5e56e972 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:22:23.301850 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d64a0dc4-25c2-4bff-8af6-ba1a5e56e972 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:22:23.304953 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d64a0dc4-25c2-4bff-8af6-ba1a5e56e972 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:22:23.306912 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d64a0dc4-25c2-4bff-8af6-ba1a5e56e972 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:22:23.311064 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d64a0dc4-25c2-4bff-8af6-ba1a5e56e972 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:22:23.620119 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d64a0dc4-25c2-4bff-8af6-ba1a5e56e972 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761124676b5e4a8db0bc59740c1f535e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f85ab8354294e359cabfca999283d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:22:23.629303 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d64a0dc4-25c2-4bff-8af6-ba1a5e56e972 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] 10.222.0.27 "GET /compute/v2.1/servers/b06cee3a-5166-4195-a2fc-465c711726d0" status: 200 len: 1373 microversion: 2.1 time: 0.385401 Sep 08 11:22:23.641800 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3229/6323] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:22:23 2022] GET /compute/v2.1/servers/b06cee3a-5166-4195-a2fc-465c711726d0 => generated 1373 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:22:24.207798 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-c5339b70-26c8-4a6f-95b4-10a5c1f435b5 req-e0ccd338-efdd-4a52-810f-7067178df50e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b06cee3a-5166-4195-a2fc-465c711726d0", "name": "network-vif-plugged", "status": "completed", "tag": "99690eff-0cda-4a9d-ade3-d491c8966a33"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:22:24.224520 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c5339b70-26c8-4a6f-95b4-10a5c1f435b5 req-e0ccd338-efdd-4a52-810f-7067178df50e service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:22:24.225139 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c5339b70-26c8-4a6f-95b4-10a5c1f435b5 req-e0ccd338-efdd-4a52-810f-7067178df50e service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:22:24.226048 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c5339b70-26c8-4a6f-95b4-10a5c1f435b5 req-e0ccd338-efdd-4a52-810f-7067178df50e service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:22:24.241198 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-c5339b70-26c8-4a6f-95b4-10a5c1f435b5 req-e0ccd338-efdd-4a52-810f-7067178df50e service nova] Creating event network-vif-plugged:99690eff-0cda-4a9d-ade3-d491c8966a33 for instance b06cee3a-5166-4195-a2fc-465c711726d0 on n-h1-850501-12 Sep 08 11:22:24.252446 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-c5339b70-26c8-4a6f-95b4-10a5c1f435b5 req-e0ccd338-efdd-4a52-810f-7067178df50e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048219 Sep 08 11:22:24.254223 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3095/6324] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:22:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:22:24.654654 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9e79dcc5-db94-4c67-b7a5-3d312647ec12 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:22:24.656419 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9e79dcc5-db94-4c67-b7a5-3d312647ec12 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] [instance: b06cee3a-5166-4195-a2fc-465c711726d0] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:22:24.669998 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e79dcc5-db94-4c67-b7a5-3d312647ec12 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:22:24.670544 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e79dcc5-db94-4c67-b7a5-3d312647ec12 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:22:24.671040 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e79dcc5-db94-4c67-b7a5-3d312647ec12 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:22:24.672085 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e79dcc5-db94-4c67-b7a5-3d312647ec12 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:22:24.672550 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e79dcc5-db94-4c67-b7a5-3d312647ec12 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:22:24.673192 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e79dcc5-db94-4c67-b7a5-3d312647ec12 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:22:25.137212 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9e79dcc5-db94-4c67-b7a5-3d312647ec12 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761124676b5e4a8db0bc59740c1f535e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f85ab8354294e359cabfca999283d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:22:25.156922 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9e79dcc5-db94-4c67-b7a5-3d312647ec12 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] 10.222.0.27 "GET /compute/v2.1/servers/b06cee3a-5166-4195-a2fc-465c711726d0" status: 200 len: 1373 microversion: 2.1 time: 0.506361 Sep 08 11:22:25.159028 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3230/6325] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:22:24 2022] GET /compute/v2.1/servers/b06cee3a-5166-4195-a2fc-465c711726d0 => generated 1373 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:22:26.196713 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ed453415-225f-43a2-aa1c-f739867b2df0 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:22:26.198133 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ed453415-225f-43a2-aa1c-f739867b2df0 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] [instance: b06cee3a-5166-4195-a2fc-465c711726d0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:22:26.210349 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ed453415-225f-43a2-aa1c-f739867b2df0 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:22:26.211122 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ed453415-225f-43a2-aa1c-f739867b2df0 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:22:26.211759 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ed453415-225f-43a2-aa1c-f739867b2df0 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:22:26.212665 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ed453415-225f-43a2-aa1c-f739867b2df0 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:22:26.213358 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ed453415-225f-43a2-aa1c-f739867b2df0 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:22:26.214940 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ed453415-225f-43a2-aa1c-f739867b2df0 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:22:26.475816 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ed453415-225f-43a2-aa1c-f739867b2df0 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761124676b5e4a8db0bc59740c1f535e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f85ab8354294e359cabfca999283d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:22:26.486020 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ed453415-225f-43a2-aa1c-f739867b2df0 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] 10.222.0.27 "GET /compute/v2.1/servers/b06cee3a-5166-4195-a2fc-465c711726d0" status: 200 len: 1544 microversion: 2.1 time: 0.295428 Sep 08 11:22:26.502508 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3096/6326] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:22:26 2022] GET /compute/v2.1/servers/b06cee3a-5166-4195-a2fc-465c711726d0 => generated 1544 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:22:26.511503 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a5a19ef1-e1ff-4edb-ae91-cdbe99638be4 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:22:26.513528 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a5a19ef1-e1ff-4edb-ae91-cdbe99638be4 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] [instance: b06cee3a-5166-4195-a2fc-465c711726d0] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:22:26.521510 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a5a19ef1-e1ff-4edb-ae91-cdbe99638be4 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:22:26.522853 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a5a19ef1-e1ff-4edb-ae91-cdbe99638be4 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:22:26.523479 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a5a19ef1-e1ff-4edb-ae91-cdbe99638be4 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:22:26.524431 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a5a19ef1-e1ff-4edb-ae91-cdbe99638be4 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:22:26.525122 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a5a19ef1-e1ff-4edb-ae91-cdbe99638be4 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:22:26.525719 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a5a19ef1-e1ff-4edb-ae91-cdbe99638be4 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:22:26.826960 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a5a19ef1-e1ff-4edb-ae91-cdbe99638be4 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761124676b5e4a8db0bc59740c1f535e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f85ab8354294e359cabfca999283d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:22:26.839088 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a5a19ef1-e1ff-4edb-ae91-cdbe99638be4 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] 10.222.0.27 "GET /compute/v2.1/servers/b06cee3a-5166-4195-a2fc-465c711726d0" status: 200 len: 1544 microversion: 2.1 time: 0.331674 Sep 08 11:22:26.840530 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3231/6327] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:22:26 2022] GET /compute/v2.1/servers/b06cee3a-5166-4195-a2fc-465c711726d0 => generated 1544 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:22:30.864284 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-d6a036bf-0abf-436c-8277-5e9928f9ce6a req-70a0481d-4640-49fe-b487-6e631c659985 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b06cee3a-5166-4195-a2fc-465c711726d0", "tag": "99690eff-0cda-4a9d-ade3-d491c8966a33"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:22:30.892098 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d6a036bf-0abf-436c-8277-5e9928f9ce6a req-70a0481d-4640-49fe-b487-6e631c659985 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:22:30.892979 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d6a036bf-0abf-436c-8277-5e9928f9ce6a req-70a0481d-4640-49fe-b487-6e631c659985 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:22:30.893693 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d6a036bf-0abf-436c-8277-5e9928f9ce6a req-70a0481d-4640-49fe-b487-6e631c659985 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:22:30.917317 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-d6a036bf-0abf-436c-8277-5e9928f9ce6a req-70a0481d-4640-49fe-b487-6e631c659985 service nova] Creating event network-changed:99690eff-0cda-4a9d-ade3-d491c8966a33 for instance b06cee3a-5166-4195-a2fc-465c711726d0 on n-h1-850501-12 Sep 08 11:22:30.925058 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-d6a036bf-0abf-436c-8277-5e9928f9ce6a req-70a0481d-4640-49fe-b487-6e631c659985 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067594 Sep 08 11:22:30.925973 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3097/6328] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:22:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:22:52.465320 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c0959ef3-b523-4c77-8d8d-df977ea19efe tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:22:52.468609 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c0959ef3-b523-4c77-8d8d-df977ea19efe tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] [instance: b06cee3a-5166-4195-a2fc-465c711726d0] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:22:52.478111 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:22:52.480259 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=42 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:22:52.483287 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c0959ef3-b523-4c77-8d8d-df977ea19efe tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:22:52.484114 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c0959ef3-b523-4c77-8d8d-df977ea19efe tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:22:52.484816 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c0959ef3-b523-4c77-8d8d-df977ea19efe tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:22:52.485898 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c0959ef3-b523-4c77-8d8d-df977ea19efe tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:22:52.486923 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c0959ef3-b523-4c77-8d8d-df977ea19efe tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:22:52.488534 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c0959ef3-b523-4c77-8d8d-df977ea19efe tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:22:52.553851 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c0959ef3-b523-4c77-8d8d-df977ea19efe tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] 10.222.0.27 "POST /compute/v2.1/servers/b06cee3a-5166-4195-a2fc-465c711726d0/action" status: 200 len: 24570 microversion: 2.1 time: 0.093724 Sep 08 11:22:52.555178 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3232/6329] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 11:22:52 2022] POST /compute/v2.1/servers/b06cee3a-5166-4195-a2fc-465c711726d0/action => generated 24570 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 11:22:57.333987 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:22:57.334753 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=38 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:22:57.463293 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-794f0098-73ec-4b83-b09d-8005f05d7656 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-691346125", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "193bca7c-2398-48b0-ad6b-419768c8111f"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:22:57.643778 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-794f0098-73ec-4b83-b09d-8005f05d7656 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] validate_networks() for [('193bca7c-2398-48b0-ad6b-419768c8111f', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:22:58.028050 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-794f0098-73ec-4b83-b09d-8005f05d7656 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:22:58.028480 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-794f0098-73ec-4b83-b09d-8005f05d7656 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:22:58.028959 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-794f0098-73ec-4b83-b09d-8005f05d7656 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:22:58.029427 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-794f0098-73ec-4b83-b09d-8005f05d7656 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:22:58.029845 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-794f0098-73ec-4b83-b09d-8005f05d7656 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:22:58.039522 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-794f0098-73ec-4b83-b09d-8005f05d7656 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:22:58.039938 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-794f0098-73ec-4b83-b09d-8005f05d7656 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:22:58.040382 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-794f0098-73ec-4b83-b09d-8005f05d7656 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:22:58.041156 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-794f0098-73ec-4b83-b09d-8005f05d7656 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:22:58.041616 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-794f0098-73ec-4b83-b09d-8005f05d7656 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:22:58.042050 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-794f0098-73ec-4b83-b09d-8005f05d7656 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:22:58.060655 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-794f0098-73ec-4b83-b09d-8005f05d7656 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Getting quotas for project 8f82606f1ba14669aece0c49946b0c45. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:22:58.066732 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-794f0098-73ec-4b83-b09d-8005f05d7656 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Getting quotas for user f69dbf339ee94a529d1871ec241398c9 and project 8f82606f1ba14669aece0c49946b0c45. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:22:58.084404 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-794f0098-73ec-4b83-b09d-8005f05d7656 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:22:58.087013 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-794f0098-73ec-4b83-b09d-8005f05d7656 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] [instance: 8976776e-4c76-4233-84c7-32aaeb229df5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:22:58.135979 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-794f0098-73ec-4b83-b09d-8005f05d7656 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.805471 Sep 08 11:22:58.136801 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3098/6330] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 11:22:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 807 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 11:22:58.148639 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-20a9df50-42e8-476f-8394-9ca300f2cab7 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:22:58.149589 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-20a9df50-42e8-476f-8394-9ca300f2cab7 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] [instance: 8976776e-4c76-4233-84c7-32aaeb229df5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:22:58.356805 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-20a9df50-42e8-476f-8394-9ca300f2cab7 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69dbf339ee94a529d1871ec241398c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f82606f1ba14669aece0c49946b0c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:22:58.364757 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-20a9df50-42e8-476f-8394-9ca300f2cab7 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] 10.222.0.27 "GET /compute/v2.1/servers/8976776e-4c76-4233-84c7-32aaeb229df5" status: 200 len: 1213 microversion: 2.1 time: 0.220581 Sep 08 11:22:58.366412 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3233/6331] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:22:58 2022] GET /compute/v2.1/servers/8976776e-4c76-4233-84c7-32aaeb229df5 => generated 1213 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:22:59.400523 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1a682de9-f566-44de-97f6-51bf3d31b68c tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:22:59.401510 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1a682de9-f566-44de-97f6-51bf3d31b68c tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] [instance: 8976776e-4c76-4233-84c7-32aaeb229df5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:22:59.408912 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1a682de9-f566-44de-97f6-51bf3d31b68c tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:22:59.409550 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1a682de9-f566-44de-97f6-51bf3d31b68c tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:22:59.410548 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1a682de9-f566-44de-97f6-51bf3d31b68c tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:22:59.411331 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1a682de9-f566-44de-97f6-51bf3d31b68c tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:22:59.411860 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1a682de9-f566-44de-97f6-51bf3d31b68c tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:22:59.412353 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1a682de9-f566-44de-97f6-51bf3d31b68c tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:22:59.480827 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1a682de9-f566-44de-97f6-51bf3d31b68c tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69dbf339ee94a529d1871ec241398c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f82606f1ba14669aece0c49946b0c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:22:59.489308 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1a682de9-f566-44de-97f6-51bf3d31b68c tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] 10.222.0.27 "GET /compute/v2.1/servers/8976776e-4c76-4233-84c7-32aaeb229df5" status: 200 len: 1217 microversion: 2.1 time: 0.105428 Sep 08 11:22:59.490243 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3099/6332] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:22:59 2022] GET /compute/v2.1/servers/8976776e-4c76-4233-84c7-32aaeb229df5 => generated 1217 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:23:00.514290 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2244481e-675e-43b0-a698-d3321cfdba4c tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:23:00.515869 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2244481e-675e-43b0-a698-d3321cfdba4c tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] [instance: 8976776e-4c76-4233-84c7-32aaeb229df5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:23:00.525642 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2244481e-675e-43b0-a698-d3321cfdba4c tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:00.526423 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2244481e-675e-43b0-a698-d3321cfdba4c tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:00.527060 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2244481e-675e-43b0-a698-d3321cfdba4c tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:00.527959 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2244481e-675e-43b0-a698-d3321cfdba4c tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:00.528618 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2244481e-675e-43b0-a698-d3321cfdba4c tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:00.529267 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2244481e-675e-43b0-a698-d3321cfdba4c tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:00.615208 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2244481e-675e-43b0-a698-d3321cfdba4c tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69dbf339ee94a529d1871ec241398c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f82606f1ba14669aece0c49946b0c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:23:00.623585 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2244481e-675e-43b0-a698-d3321cfdba4c tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] 10.222.0.27 "GET /compute/v2.1/servers/8976776e-4c76-4233-84c7-32aaeb229df5" status: 200 len: 1271 microversion: 2.1 time: 0.114450 Sep 08 11:23:00.624167 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3234/6333] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:23:00 2022] GET /compute/v2.1/servers/8976776e-4c76-4233-84c7-32aaeb229df5 => generated 1271 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:23:01.649789 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0e054467-8a1b-443a-9df1-0d487814212b tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:23:01.651087 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0e054467-8a1b-443a-9df1-0d487814212b tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] [instance: 8976776e-4c76-4233-84c7-32aaeb229df5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:23:01.660593 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e054467-8a1b-443a-9df1-0d487814212b tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:01.662381 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e054467-8a1b-443a-9df1-0d487814212b tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:01.662381 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e054467-8a1b-443a-9df1-0d487814212b tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:01.662858 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e054467-8a1b-443a-9df1-0d487814212b tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:01.663424 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e054467-8a1b-443a-9df1-0d487814212b tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:01.663962 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e054467-8a1b-443a-9df1-0d487814212b tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:01.834037 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0e054467-8a1b-443a-9df1-0d487814212b tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69dbf339ee94a529d1871ec241398c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f82606f1ba14669aece0c49946b0c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:23:01.845418 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0e054467-8a1b-443a-9df1-0d487814212b tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] 10.222.0.27 "GET /compute/v2.1/servers/8976776e-4c76-4233-84c7-32aaeb229df5" status: 200 len: 1313 microversion: 2.1 time: 0.200190 Sep 08 11:23:01.846555 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3100/6334] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:23:01 2022] GET /compute/v2.1/servers/8976776e-4c76-4233-84c7-32aaeb229df5 => generated 1313 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:23:01.953355 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-8880a55f-5ea3-4c70-bb0e-2916464f0523 req-0886209e-1f47-40b3-b2f2-547dbe5d632c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8976776e-4c76-4233-84c7-32aaeb229df5", "tag": "8311e60b-2580-4399-9c76-559e7d61a3f5"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:23:01.969106 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-8880a55f-5ea3-4c70-bb0e-2916464f0523 req-0886209e-1f47-40b3-b2f2-547dbe5d632c service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:01.969863 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-8880a55f-5ea3-4c70-bb0e-2916464f0523 req-0886209e-1f47-40b3-b2f2-547dbe5d632c service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:01.970545 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-8880a55f-5ea3-4c70-bb0e-2916464f0523 req-0886209e-1f47-40b3-b2f2-547dbe5d632c service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:01.983440 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-8880a55f-5ea3-4c70-bb0e-2916464f0523 req-0886209e-1f47-40b3-b2f2-547dbe5d632c service nova] Creating event network-changed:8311e60b-2580-4399-9c76-559e7d61a3f5 for instance 8976776e-4c76-4233-84c7-32aaeb229df5 on n-h2-850501-12 Sep 08 11:23:01.992221 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-8880a55f-5ea3-4c70-bb0e-2916464f0523 req-0886209e-1f47-40b3-b2f2-547dbe5d632c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043201 Sep 08 11:23:01.993564 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3235/6335] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:23:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:23:02.870828 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4e86ed74-ffd0-425c-a388-ef9f194c4096 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:23:02.871907 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4e86ed74-ffd0-425c-a388-ef9f194c4096 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] [instance: 8976776e-4c76-4233-84c7-32aaeb229df5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:23:02.878726 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e86ed74-ffd0-425c-a388-ef9f194c4096 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:02.879419 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e86ed74-ffd0-425c-a388-ef9f194c4096 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:02.879876 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e86ed74-ffd0-425c-a388-ef9f194c4096 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:02.880568 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e86ed74-ffd0-425c-a388-ef9f194c4096 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:02.881056 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e86ed74-ffd0-425c-a388-ef9f194c4096 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:02.881496 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e86ed74-ffd0-425c-a388-ef9f194c4096 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:03.025698 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4e86ed74-ffd0-425c-a388-ef9f194c4096 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69dbf339ee94a529d1871ec241398c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f82606f1ba14669aece0c49946b0c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:23:03.038972 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4e86ed74-ffd0-425c-a388-ef9f194c4096 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] 10.222.0.27 "GET /compute/v2.1/servers/8976776e-4c76-4233-84c7-32aaeb229df5" status: 200 len: 1313 microversion: 2.1 time: 0.172135 Sep 08 11:23:03.049128 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3101/6336] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:23:02 2022] GET /compute/v2.1/servers/8976776e-4c76-4233-84c7-32aaeb229df5 => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:23:04.064742 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6c7bd7a7-d460-4591-b3a3-e408fb444b97 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:23:04.066799 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6c7bd7a7-d460-4591-b3a3-e408fb444b97 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] [instance: 8976776e-4c76-4233-84c7-32aaeb229df5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:23:04.076820 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6c7bd7a7-d460-4591-b3a3-e408fb444b97 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:04.077817 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6c7bd7a7-d460-4591-b3a3-e408fb444b97 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:04.078434 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6c7bd7a7-d460-4591-b3a3-e408fb444b97 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:04.079454 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6c7bd7a7-d460-4591-b3a3-e408fb444b97 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:04.080251 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6c7bd7a7-d460-4591-b3a3-e408fb444b97 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:04.081264 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6c7bd7a7-d460-4591-b3a3-e408fb444b97 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:04.337161 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6c7bd7a7-d460-4591-b3a3-e408fb444b97 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69dbf339ee94a529d1871ec241398c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f82606f1ba14669aece0c49946b0c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:23:04.345246 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6c7bd7a7-d460-4591-b3a3-e408fb444b97 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] 10.222.0.27 "GET /compute/v2.1/servers/8976776e-4c76-4233-84c7-32aaeb229df5" status: 200 len: 1313 microversion: 2.1 time: 0.285417 Sep 08 11:23:04.346193 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3236/6337] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:23:04 2022] GET /compute/v2.1/servers/8976776e-4c76-4233-84c7-32aaeb229df5 => generated 1313 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:23:05.371009 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e8e9b6ba-d08f-4e4f-a430-89205b69027f tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:23:05.371859 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e8e9b6ba-d08f-4e4f-a430-89205b69027f tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] [instance: 8976776e-4c76-4233-84c7-32aaeb229df5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:23:05.379457 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e8e9b6ba-d08f-4e4f-a430-89205b69027f tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:05.379926 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e8e9b6ba-d08f-4e4f-a430-89205b69027f tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:05.380363 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e8e9b6ba-d08f-4e4f-a430-89205b69027f tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:05.381096 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e8e9b6ba-d08f-4e4f-a430-89205b69027f tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:05.381557 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e8e9b6ba-d08f-4e4f-a430-89205b69027f tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:05.382010 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e8e9b6ba-d08f-4e4f-a430-89205b69027f tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:05.523738 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e8e9b6ba-d08f-4e4f-a430-89205b69027f tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69dbf339ee94a529d1871ec241398c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f82606f1ba14669aece0c49946b0c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:23:05.532022 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e8e9b6ba-d08f-4e4f-a430-89205b69027f tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] 10.222.0.27 "GET /compute/v2.1/servers/8976776e-4c76-4233-84c7-32aaeb229df5" status: 200 len: 1313 microversion: 2.1 time: 0.165285 Sep 08 11:23:05.532627 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3102/6338] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:23:05 2022] GET /compute/v2.1/servers/8976776e-4c76-4233-84c7-32aaeb229df5 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:23:06.556848 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-07d579f5-aa4f-4cc7-a5df-f51c38a79546 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:23:06.557511 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-07d579f5-aa4f-4cc7-a5df-f51c38a79546 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] [instance: 8976776e-4c76-4233-84c7-32aaeb229df5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:23:06.564638 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-07d579f5-aa4f-4cc7-a5df-f51c38a79546 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:06.565174 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-07d579f5-aa4f-4cc7-a5df-f51c38a79546 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:06.565661 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-07d579f5-aa4f-4cc7-a5df-f51c38a79546 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:06.566477 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-07d579f5-aa4f-4cc7-a5df-f51c38a79546 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:06.566946 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-07d579f5-aa4f-4cc7-a5df-f51c38a79546 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:06.567384 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-07d579f5-aa4f-4cc7-a5df-f51c38a79546 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:06.713392 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-07d579f5-aa4f-4cc7-a5df-f51c38a79546 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69dbf339ee94a529d1871ec241398c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f82606f1ba14669aece0c49946b0c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:23:06.721672 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-07d579f5-aa4f-4cc7-a5df-f51c38a79546 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] 10.222.0.27 "GET /compute/v2.1/servers/8976776e-4c76-4233-84c7-32aaeb229df5" status: 200 len: 1313 microversion: 2.1 time: 0.168980 Sep 08 11:23:06.722284 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3237/6339] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:23:06 2022] GET /compute/v2.1/servers/8976776e-4c76-4233-84c7-32aaeb229df5 => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:23:07.744884 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-19bbf4e4-4919-438e-9b18-8d4443ce11fd tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:23:07.745538 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-19bbf4e4-4919-438e-9b18-8d4443ce11fd tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] [instance: 8976776e-4c76-4233-84c7-32aaeb229df5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:23:07.765486 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-19bbf4e4-4919-438e-9b18-8d4443ce11fd tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:07.765988 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-19bbf4e4-4919-438e-9b18-8d4443ce11fd tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:07.766431 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-19bbf4e4-4919-438e-9b18-8d4443ce11fd tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:07.767430 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-19bbf4e4-4919-438e-9b18-8d4443ce11fd tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:07.767893 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-19bbf4e4-4919-438e-9b18-8d4443ce11fd tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:07.768325 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-19bbf4e4-4919-438e-9b18-8d4443ce11fd tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:08.040011 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-3b15a888-ca30-4a98-addb-65c5349be7bc req-2aa46bd6-cb16-4940-bd6c-7495585401c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8976776e-4c76-4233-84c7-32aaeb229df5", "name": "network-vif-plugged", "status": "completed", "tag": "8311e60b-2580-4399-9c76-559e7d61a3f5"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:23:08.048949 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:23:08.067531 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-3b15a888-ca30-4a98-addb-65c5349be7bc req-2aa46bd6-cb16-4940-bd6c-7495585401c8 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:08.068313 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-3b15a888-ca30-4a98-addb-65c5349be7bc req-2aa46bd6-cb16-4940-bd6c-7495585401c8 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:08.068914 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-3b15a888-ca30-4a98-addb-65c5349be7bc req-2aa46bd6-cb16-4940-bd6c-7495585401c8 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:08.076583 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:23:08.091576 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-3b15a888-ca30-4a98-addb-65c5349be7bc req-2aa46bd6-cb16-4940-bd6c-7495585401c8 service nova] Creating event network-vif-plugged:8311e60b-2580-4399-9c76-559e7d61a3f5 for instance 8976776e-4c76-4233-84c7-32aaeb229df5 on n-h2-850501-12 Sep 08 11:23:08.098686 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-3b15a888-ca30-4a98-addb-65c5349be7bc req-2aa46bd6-cb16-4940-bd6c-7495585401c8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061619 Sep 08 11:23:08.099775 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3238/6340] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:23:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:23:08.359533 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-19bbf4e4-4919-438e-9b18-8d4443ce11fd tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69dbf339ee94a529d1871ec241398c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f82606f1ba14669aece0c49946b0c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:23:08.372419 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-19bbf4e4-4919-438e-9b18-8d4443ce11fd tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] 10.222.0.27 "GET /compute/v2.1/servers/8976776e-4c76-4233-84c7-32aaeb229df5" status: 200 len: 1313 microversion: 2.1 time: 0.631279 Sep 08 11:23:08.373770 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3103/6341] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:23:07 2022] GET /compute/v2.1/servers/8976776e-4c76-4233-84c7-32aaeb229df5 => generated 1313 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:23:09.021280 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:23:09.025948 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7790549a-d1c7-47ad-98f0-c718e44addac tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Action: 'create', calling method: .version_select at 0x7f68df37ab80>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-861300180", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJlz5rjv1qCAQd/uYNg21DxF9vOjyN2F1K0Adk8Ag4sbMS8/JS3rGmEMUwndS2e/1ROX298hiDOdHOGAtG9uoqYVihciCrCh8LeipOUg3YtOHy9KdThOzpw0Vp88mQzXA=="}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:23:09.044659 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-7790549a-d1c7-47ad-98f0-c718e44addac tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Getting quotas for project 8f85ab8354294e359cabfca999283d5a. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:23:09.050995 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-7790549a-d1c7-47ad-98f0-c718e44addac tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Getting quotas for user 761124676b5e4a8db0bc59740c1f535e and project 8f85ab8354294e359cabfca999283d5a. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:23:09.093805 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7790549a-d1c7-47ad-98f0-c718e44addac tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.074218 Sep 08 11:23:09.100949 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3239/6342] 10.222.0.27 () {60 vars in 1159 bytes} [Thu Sep 8 11:23:09 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:23:09.397722 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f1bda018-59fc-43d8-8bb4-b6b3bcf339e1 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:23:09.399011 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f1bda018-59fc-43d8-8bb4-b6b3bcf339e1 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] [instance: 8976776e-4c76-4233-84c7-32aaeb229df5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:23:09.408798 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1bda018-59fc-43d8-8bb4-b6b3bcf339e1 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:09.409337 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1bda018-59fc-43d8-8bb4-b6b3bcf339e1 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:09.409784 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1bda018-59fc-43d8-8bb4-b6b3bcf339e1 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:09.410570 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1bda018-59fc-43d8-8bb4-b6b3bcf339e1 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:09.411218 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1bda018-59fc-43d8-8bb4-b6b3bcf339e1 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:09.411664 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1bda018-59fc-43d8-8bb4-b6b3bcf339e1 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:09.592812 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f1bda018-59fc-43d8-8bb4-b6b3bcf339e1 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69dbf339ee94a529d1871ec241398c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f82606f1ba14669aece0c49946b0c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:23:09.604890 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f1bda018-59fc-43d8-8bb4-b6b3bcf339e1 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] 10.222.0.27 "GET /compute/v2.1/servers/8976776e-4c76-4233-84c7-32aaeb229df5" status: 200 len: 1313 microversion: 2.1 time: 0.212473 Sep 08 11:23:09.606234 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3104/6343] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:23:09 2022] GET /compute/v2.1/servers/8976776e-4c76-4233-84c7-32aaeb229df5 => generated 1313 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:23:10.359576 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9d8e7bf3-b5c5-4e10-b1fd-0224a77eaa73 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1251649152", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "63bf965c-3ce8-4c1b-854e-8a871ce49248"}], "key_name": "tempest-TestNetworkBasicOps-861300180", "security_groups": [{"name": "tempest-secgroup-smoke-1151916052"}]}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:23:10.486875 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-9d8e7bf3-b5c5-4e10-b1fd-0224a77eaa73 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] validate_networks() for [('63bf965c-3ce8-4c1b-854e-8a871ce49248', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:23:10.631958 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-24852d70-f94b-45f5-8f8b-7544d1f3bc52 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:23:10.632778 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-24852d70-f94b-45f5-8f8b-7544d1f3bc52 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] [instance: 8976776e-4c76-4233-84c7-32aaeb229df5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:23:10.639911 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-24852d70-f94b-45f5-8f8b-7544d1f3bc52 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:10.640530 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-24852d70-f94b-45f5-8f8b-7544d1f3bc52 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:10.641108 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-24852d70-f94b-45f5-8f8b-7544d1f3bc52 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:10.641920 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-24852d70-f94b-45f5-8f8b-7544d1f3bc52 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:10.642516 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-24852d70-f94b-45f5-8f8b-7544d1f3bc52 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:10.643146 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-24852d70-f94b-45f5-8f8b-7544d1f3bc52 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:10.812957 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-24852d70-f94b-45f5-8f8b-7544d1f3bc52 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69dbf339ee94a529d1871ec241398c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f82606f1ba14669aece0c49946b0c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:23:10.828043 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-24852d70-f94b-45f5-8f8b-7544d1f3bc52 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] 10.222.0.27 "GET /compute/v2.1/servers/8976776e-4c76-4233-84c7-32aaeb229df5" status: 200 len: 1498 microversion: 2.1 time: 0.200632 Sep 08 11:23:10.830263 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3105/6344] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:23:10 2022] GET /compute/v2.1/servers/8976776e-4c76-4233-84c7-32aaeb229df5 => generated 1498 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:23:10.959559 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-9d8e7bf3-b5c5-4e10-b1fd-0224a77eaa73 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:23:10.959995 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-9d8e7bf3-b5c5-4e10-b1fd-0224a77eaa73 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:23:10.960489 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-9d8e7bf3-b5c5-4e10-b1fd-0224a77eaa73 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:23:10.960910 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-9d8e7bf3-b5c5-4e10-b1fd-0224a77eaa73 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:23:10.968144 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-9d8e7bf3-b5c5-4e10-b1fd-0224a77eaa73 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:23:10.990832 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9d8e7bf3-b5c5-4e10-b1fd-0224a77eaa73 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:10.991592 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9d8e7bf3-b5c5-4e10-b1fd-0224a77eaa73 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:10.992173 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9d8e7bf3-b5c5-4e10-b1fd-0224a77eaa73 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:10.993949 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9d8e7bf3-b5c5-4e10-b1fd-0224a77eaa73 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:10.994670 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9d8e7bf3-b5c5-4e10-b1fd-0224a77eaa73 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:10.995233 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9d8e7bf3-b5c5-4e10-b1fd-0224a77eaa73 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:11.020694 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-9d8e7bf3-b5c5-4e10-b1fd-0224a77eaa73 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Getting quotas for project 8f85ab8354294e359cabfca999283d5a. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:23:11.027367 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-9d8e7bf3-b5c5-4e10-b1fd-0224a77eaa73 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Getting quotas for user 761124676b5e4a8db0bc59740c1f535e and project 8f85ab8354294e359cabfca999283d5a. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:23:11.047188 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9d8e7bf3-b5c5-4e10-b1fd-0224a77eaa73 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:23:11.049783 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9d8e7bf3-b5c5-4e10-b1fd-0224a77eaa73 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] [instance: 372bed7d-b007-4a5c-878e-d4289b74dda7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:23:11.113296 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9d8e7bf3-b5c5-4e10-b1fd-0224a77eaa73 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.758444 Sep 08 11:23:11.120489 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3240/6345] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 11:23:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:23:11.126407 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3db103d2-546b-46b4-87a3-296dc2b89d38 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:23:11.126914 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3db103d2-546b-46b4-87a3-296dc2b89d38 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] [instance: 372bed7d-b007-4a5c-878e-d4289b74dda7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:23:11.315726 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3db103d2-546b-46b4-87a3-296dc2b89d38 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761124676b5e4a8db0bc59740c1f535e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f85ab8354294e359cabfca999283d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:23:11.330277 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3db103d2-546b-46b4-87a3-296dc2b89d38 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] 10.222.0.27 "GET /compute/v2.1/servers/372bed7d-b007-4a5c-878e-d4289b74dda7" status: 200 len: 1248 microversion: 2.1 time: 0.208058 Sep 08 11:23:11.341226 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3106/6346] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:23:11 2022] GET /compute/v2.1/servers/372bed7d-b007-4a5c-878e-d4289b74dda7 => generated 1248 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:23:12.356395 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ea29bc4e-d185-449a-bf11-f420f2c94edb tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:23:12.357046 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ea29bc4e-d185-449a-bf11-f420f2c94edb tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] [instance: 372bed7d-b007-4a5c-878e-d4289b74dda7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:23:12.371237 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ea29bc4e-d185-449a-bf11-f420f2c94edb tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:12.371755 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ea29bc4e-d185-449a-bf11-f420f2c94edb tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:12.372334 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ea29bc4e-d185-449a-bf11-f420f2c94edb tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:12.373284 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ea29bc4e-d185-449a-bf11-f420f2c94edb tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:12.373827 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ea29bc4e-d185-449a-bf11-f420f2c94edb tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:12.374350 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ea29bc4e-d185-449a-bf11-f420f2c94edb tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:12.458960 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ea29bc4e-d185-449a-bf11-f420f2c94edb tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761124676b5e4a8db0bc59740c1f535e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f85ab8354294e359cabfca999283d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:23:12.468619 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ea29bc4e-d185-449a-bf11-f420f2c94edb tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] 10.222.0.27 "GET /compute/v2.1/servers/372bed7d-b007-4a5c-878e-d4289b74dda7" status: 200 len: 1300 microversion: 2.1 time: 0.116720 Sep 08 11:23:12.475682 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3241/6347] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:23:12 2022] GET /compute/v2.1/servers/372bed7d-b007-4a5c-878e-d4289b74dda7 => generated 1300 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:23:13.493732 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-963e2f32-3b91-49cb-a6e6-3b39235bfd15 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:23:13.494409 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-963e2f32-3b91-49cb-a6e6-3b39235bfd15 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] [instance: 372bed7d-b007-4a5c-878e-d4289b74dda7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:23:13.518579 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-963e2f32-3b91-49cb-a6e6-3b39235bfd15 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:13.519087 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-963e2f32-3b91-49cb-a6e6-3b39235bfd15 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:13.519533 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-963e2f32-3b91-49cb-a6e6-3b39235bfd15 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:13.520327 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-963e2f32-3b91-49cb-a6e6-3b39235bfd15 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:13.520791 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-963e2f32-3b91-49cb-a6e6-3b39235bfd15 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:13.521262 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-963e2f32-3b91-49cb-a6e6-3b39235bfd15 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:13.888346 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-963e2f32-3b91-49cb-a6e6-3b39235bfd15 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761124676b5e4a8db0bc59740c1f535e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f85ab8354294e359cabfca999283d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:23:13.902435 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-963e2f32-3b91-49cb-a6e6-3b39235bfd15 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] 10.222.0.27 "GET /compute/v2.1/servers/372bed7d-b007-4a5c-878e-d4289b74dda7" status: 200 len: 1374 microversion: 2.1 time: 0.411615 Sep 08 11:23:13.903920 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3107/6348] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:23:13 2022] GET /compute/v2.1/servers/372bed7d-b007-4a5c-878e-d4289b74dda7 => generated 1374 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:23:14.372135 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-5a2308ea-8085-4025-8fa4-41e8d63cf90f req-bd33c998-b7f4-4171-bd61-8865770335b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "372bed7d-b007-4a5c-878e-d4289b74dda7", "tag": "81cb6ba6-a8f1-4dbf-b585-df2e8e64a827"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:23:14.387867 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-5a2308ea-8085-4025-8fa4-41e8d63cf90f req-bd33c998-b7f4-4171-bd61-8865770335b7 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:14.388806 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-5a2308ea-8085-4025-8fa4-41e8d63cf90f req-bd33c998-b7f4-4171-bd61-8865770335b7 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:14.389454 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-5a2308ea-8085-4025-8fa4-41e8d63cf90f req-bd33c998-b7f4-4171-bd61-8865770335b7 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:14.403431 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-5a2308ea-8085-4025-8fa4-41e8d63cf90f req-bd33c998-b7f4-4171-bd61-8865770335b7 service nova] Creating event network-changed:81cb6ba6-a8f1-4dbf-b585-df2e8e64a827 for instance 372bed7d-b007-4a5c-878e-d4289b74dda7 on n-h1-850501-12 Sep 08 11:23:14.408599 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-5a2308ea-8085-4025-8fa4-41e8d63cf90f req-bd33c998-b7f4-4171-bd61-8865770335b7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041929 Sep 08 11:23:14.409264 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3242/6349] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:23:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:23:14.613810 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ec8b0944-b64c-4029-9414-8ac552684299 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:23:14.614383 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ec8b0944-b64c-4029-9414-8ac552684299 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] [instance: 8976776e-4c76-4233-84c7-32aaeb229df5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:23:14.620966 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec8b0944-b64c-4029-9414-8ac552684299 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:14.621510 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec8b0944-b64c-4029-9414-8ac552684299 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:14.621953 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec8b0944-b64c-4029-9414-8ac552684299 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:14.622662 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec8b0944-b64c-4029-9414-8ac552684299 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:14.623123 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec8b0944-b64c-4029-9414-8ac552684299 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:14.623550 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec8b0944-b64c-4029-9414-8ac552684299 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:14.651000 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ec8b0944-b64c-4029-9414-8ac552684299 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] [instance: 8976776e-4c76-4233-84c7-32aaeb229df5] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:23:14.733254 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ec8b0944-b64c-4029-9414-8ac552684299 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8976776e-4c76-4233-84c7-32aaeb229df5" status: 204 len: 0 microversion: 2.1 time: 0.122798 Sep 08 11:23:14.733553 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3108/6350] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:23:14 2022] DELETE /compute/v2.1/servers/8976776e-4c76-4233-84c7-32aaeb229df5 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:23:14.743257 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-be8b8c21-d4b8-4a2d-b313-e7733e177141 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:23:14.744073 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-be8b8c21-d4b8-4a2d-b313-e7733e177141 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] [instance: 8976776e-4c76-4233-84c7-32aaeb229df5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:23:14.750431 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-be8b8c21-d4b8-4a2d-b313-e7733e177141 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:14.750925 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-be8b8c21-d4b8-4a2d-b313-e7733e177141 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:14.751363 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-be8b8c21-d4b8-4a2d-b313-e7733e177141 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:14.752056 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-be8b8c21-d4b8-4a2d-b313-e7733e177141 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:14.752514 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-be8b8c21-d4b8-4a2d-b313-e7733e177141 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:14.752936 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-be8b8c21-d4b8-4a2d-b313-e7733e177141 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:14.904958 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-be8b8c21-d4b8-4a2d-b313-e7733e177141 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69dbf339ee94a529d1871ec241398c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f82606f1ba14669aece0c49946b0c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:23:14.913166 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-be8b8c21-d4b8-4a2d-b313-e7733e177141 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] 10.222.0.27 "GET /compute/v2.1/servers/8976776e-4c76-4233-84c7-32aaeb229df5" status: 200 len: 1504 microversion: 2.1 time: 0.174744 Sep 08 11:23:14.913750 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3243/6351] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:23:14 2022] GET /compute/v2.1/servers/8976776e-4c76-4233-84c7-32aaeb229df5 => generated 1504 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:23:14.932656 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4f4fc3fe-97fc-42af-92c5-43c9e8ee842d tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:23:14.933389 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4f4fc3fe-97fc-42af-92c5-43c9e8ee842d tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] [instance: 372bed7d-b007-4a5c-878e-d4289b74dda7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:23:14.939887 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f4fc3fe-97fc-42af-92c5-43c9e8ee842d tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:14.940378 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f4fc3fe-97fc-42af-92c5-43c9e8ee842d tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:14.940815 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f4fc3fe-97fc-42af-92c5-43c9e8ee842d tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:14.941541 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f4fc3fe-97fc-42af-92c5-43c9e8ee842d tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:14.942630 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f4fc3fe-97fc-42af-92c5-43c9e8ee842d tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:14.943060 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f4fc3fe-97fc-42af-92c5-43c9e8ee842d tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:15.086182 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4f4fc3fe-97fc-42af-92c5-43c9e8ee842d tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761124676b5e4a8db0bc59740c1f535e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f85ab8354294e359cabfca999283d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:23:15.095402 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4f4fc3fe-97fc-42af-92c5-43c9e8ee842d tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] 10.222.0.27 "GET /compute/v2.1/servers/372bed7d-b007-4a5c-878e-d4289b74dda7" status: 200 len: 1374 microversion: 2.1 time: 0.167015 Sep 08 11:23:15.096162 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3109/6352] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:23:14 2022] GET /compute/v2.1/servers/372bed7d-b007-4a5c-878e-d4289b74dda7 => generated 1374 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:23:15.935903 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-01120ee1-53e6-4f24-92a4-32c5d507b3ec tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:23:15.937496 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-01120ee1-53e6-4f24-92a4-32c5d507b3ec tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] [instance: 8976776e-4c76-4233-84c7-32aaeb229df5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:23:15.946388 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-01120ee1-53e6-4f24-92a4-32c5d507b3ec tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:15.947482 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-01120ee1-53e6-4f24-92a4-32c5d507b3ec tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:15.948402 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-01120ee1-53e6-4f24-92a4-32c5d507b3ec tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:15.949348 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-01120ee1-53e6-4f24-92a4-32c5d507b3ec tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:15.950009 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-01120ee1-53e6-4f24-92a4-32c5d507b3ec tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:15.950769 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-01120ee1-53e6-4f24-92a4-32c5d507b3ec tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:16.119964 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8eee348f-ee26-436a-96a5-cf7a12a85c1c tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:23:16.120768 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8eee348f-ee26-436a-96a5-cf7a12a85c1c tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] [instance: 372bed7d-b007-4a5c-878e-d4289b74dda7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:23:16.132174 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8eee348f-ee26-436a-96a5-cf7a12a85c1c tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:16.132954 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8eee348f-ee26-436a-96a5-cf7a12a85c1c tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:16.133713 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8eee348f-ee26-436a-96a5-cf7a12a85c1c tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:16.134663 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8eee348f-ee26-436a-96a5-cf7a12a85c1c tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:16.135321 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8eee348f-ee26-436a-96a5-cf7a12a85c1c tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:16.137555 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8eee348f-ee26-436a-96a5-cf7a12a85c1c tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:16.219335 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-01120ee1-53e6-4f24-92a4-32c5d507b3ec tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69dbf339ee94a529d1871ec241398c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f82606f1ba14669aece0c49946b0c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:23:16.240031 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-01120ee1-53e6-4f24-92a4-32c5d507b3ec tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] 10.222.0.27 "GET /compute/v2.1/servers/8976776e-4c76-4233-84c7-32aaeb229df5" status: 200 len: 1504 microversion: 2.1 time: 0.307033 Sep 08 11:23:16.241336 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3244/6353] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:23:15 2022] GET /compute/v2.1/servers/8976776e-4c76-4233-84c7-32aaeb229df5 => generated 1504 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:23:16.317401 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8eee348f-ee26-436a-96a5-cf7a12a85c1c tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761124676b5e4a8db0bc59740c1f535e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f85ab8354294e359cabfca999283d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:23:16.326086 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8eee348f-ee26-436a-96a5-cf7a12a85c1c tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] 10.222.0.27 "GET /compute/v2.1/servers/372bed7d-b007-4a5c-878e-d4289b74dda7" status: 200 len: 1374 microversion: 2.1 time: 0.210556 Sep 08 11:23:16.327129 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3110/6354] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:23:16 2022] GET /compute/v2.1/servers/372bed7d-b007-4a5c-878e-d4289b74dda7 => generated 1374 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:23:17.095365 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-2f7ea3bd-99d5-48db-8d4b-2e24df73af30 req-86f8deed-b4ce-4103-b192-23a014074b02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8976776e-4c76-4233-84c7-32aaeb229df5", "name": "network-vif-deleted", "tag": "8311e60b-2580-4399-9c76-559e7d61a3f5"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:23:17.111573 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-2f7ea3bd-99d5-48db-8d4b-2e24df73af30 req-86f8deed-b4ce-4103-b192-23a014074b02 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:17.112579 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-2f7ea3bd-99d5-48db-8d4b-2e24df73af30 req-86f8deed-b4ce-4103-b192-23a014074b02 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:17.113061 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-2f7ea3bd-99d5-48db-8d4b-2e24df73af30 req-86f8deed-b4ce-4103-b192-23a014074b02 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:17.129835 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-2f7ea3bd-99d5-48db-8d4b-2e24df73af30 req-86f8deed-b4ce-4103-b192-23a014074b02 service nova] Creating event network-vif-deleted:8311e60b-2580-4399-9c76-559e7d61a3f5 for instance 8976776e-4c76-4233-84c7-32aaeb229df5 on n-h2-850501-12 Sep 08 11:23:17.135578 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-2f7ea3bd-99d5-48db-8d4b-2e24df73af30 req-86f8deed-b4ce-4103-b192-23a014074b02 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044243 Sep 08 11:23:17.136270 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3245/6355] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:23:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:23:17.264282 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0aaaacf5-757b-4880-9dd1-a53d77b506b1 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:23:17.265197 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0aaaacf5-757b-4880-9dd1-a53d77b506b1 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] [instance: 8976776e-4c76-4233-84c7-32aaeb229df5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:23:17.273492 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0aaaacf5-757b-4880-9dd1-a53d77b506b1 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:17.274114 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0aaaacf5-757b-4880-9dd1-a53d77b506b1 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:17.275602 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0aaaacf5-757b-4880-9dd1-a53d77b506b1 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:17.276342 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0aaaacf5-757b-4880-9dd1-a53d77b506b1 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:17.276804 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0aaaacf5-757b-4880-9dd1-a53d77b506b1 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:17.277305 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0aaaacf5-757b-4880-9dd1-a53d77b506b1 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:17.310736 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0aaaacf5-757b-4880-9dd1-a53d77b506b1 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:17.311221 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0aaaacf5-757b-4880-9dd1-a53d77b506b1 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:17.311659 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0aaaacf5-757b-4880-9dd1-a53d77b506b1 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:17.312105 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-0aaaacf5-757b-4880-9dd1-a53d77b506b1 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Lazy-loading 'fault' on Instance uuid 8976776e-4c76-4233-84c7-32aaeb229df5 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:23:17.351932 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-56eb9d1e-9c84-41cc-a481-547a346a2902 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:23:17.352989 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-56eb9d1e-9c84-41cc-a481-547a346a2902 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] [instance: 372bed7d-b007-4a5c-878e-d4289b74dda7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:23:17.357671 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0aaaacf5-757b-4880-9dd1-a53d77b506b1 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69dbf339ee94a529d1871ec241398c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f82606f1ba14669aece0c49946b0c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:23:17.359551 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-56eb9d1e-9c84-41cc-a481-547a346a2902 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:17.360285 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-56eb9d1e-9c84-41cc-a481-547a346a2902 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:17.360823 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-56eb9d1e-9c84-41cc-a481-547a346a2902 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:17.361807 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-56eb9d1e-9c84-41cc-a481-547a346a2902 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:17.362467 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-56eb9d1e-9c84-41cc-a481-547a346a2902 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:17.363099 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-56eb9d1e-9c84-41cc-a481-547a346a2902 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:17.366796 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0aaaacf5-757b-4880-9dd1-a53d77b506b1 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] 10.222.0.27 "GET /compute/v2.1/servers/8976776e-4c76-4233-84c7-32aaeb229df5" status: 200 len: 1303 microversion: 2.1 time: 0.106708 Sep 08 11:23:17.367396 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3111/6356] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:23:17 2022] GET /compute/v2.1/servers/8976776e-4c76-4233-84c7-32aaeb229df5 => generated 1303 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:23:17.505948 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-56eb9d1e-9c84-41cc-a481-547a346a2902 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761124676b5e4a8db0bc59740c1f535e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f85ab8354294e359cabfca999283d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:23:17.513733 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-56eb9d1e-9c84-41cc-a481-547a346a2902 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] 10.222.0.27 "GET /compute/v2.1/servers/372bed7d-b007-4a5c-878e-d4289b74dda7" status: 200 len: 1374 microversion: 2.1 time: 0.167037 Sep 08 11:23:17.524618 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3246/6357] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:23:17 2022] GET /compute/v2.1/servers/372bed7d-b007-4a5c-878e-d4289b74dda7 => generated 1374 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:23:18.390162 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f0e8c2a7-f72a-47b2-af42-f3fd851fb8f5 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:23:18.390748 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f0e8c2a7-f72a-47b2-af42-f3fd851fb8f5 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] [instance: 8976776e-4c76-4233-84c7-32aaeb229df5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:23:18.398160 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0e8c2a7-f72a-47b2-af42-f3fd851fb8f5 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:18.398656 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0e8c2a7-f72a-47b2-af42-f3fd851fb8f5 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:18.399102 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0e8c2a7-f72a-47b2-af42-f3fd851fb8f5 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:18.399812 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0e8c2a7-f72a-47b2-af42-f3fd851fb8f5 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:18.400337 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0e8c2a7-f72a-47b2-af42-f3fd851fb8f5 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:18.400807 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0e8c2a7-f72a-47b2-af42-f3fd851fb8f5 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:18.415426 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-f0e8c2a7-f72a-47b2-af42-f3fd851fb8f5 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] HTTP exception thrown: Instance 8976776e-4c76-4233-84c7-32aaeb229df5 could not be found. Sep 08 11:23:18.417140 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f0e8c2a7-f72a-47b2-af42-f3fd851fb8f5 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Request method failure captured: Sep 08 11:23:18.417140 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/8976776e-4c76-4233-84c7-32aaeb229df5 HTTP/1.1 Sep 08 11:23:18.417140 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 11:23:18.417140 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 11:23:18.417140 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 11:23:18.417140 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 11:23:18.417140 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 11:23:18.417140 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 11:23:18.417140 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 11:23:18.417140 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 11:23:18.417140 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGdCPlCkL4aARfc7Oh30wD_mDIZtEdT6ScxmZ17ygWIpiidDYNqv65BZNhHZ8brkfXcn3NRLBA87bdqOuaZJe14MEKaEZjMCfBbW6TeaIxeOOkg08iBabQYPpEsGiW3YtyIFfZdJAqJ3N2m6l-gfejffoNVmwDg5b2VQe7AoJm4eD6kw Sep 08 11:23:18.417140 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 11:23:18.417140 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 11:23:18.417140 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 11:23:18.417140 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 11:23:18.417140 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 11:23:18.417140 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 11:23:18.417140 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 8f82606f1ba14669aece0c49946b0c45 Sep 08 11:23:18.417140 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-VolumesActionsTest-1211726018 Sep 08 11:23:18.417140 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 11:23:18.417140 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 11:23:18.417140 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8f82606f1ba14669aece0c49946b0c45"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8f82606f1ba14669aece0c49946b0c45"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8f82606f1ba14669aece0c49946b0c45"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8f82606f1ba14669aece0c49946b0c45"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:23:18.417140 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-VolumesActionsTest-1211726018 Sep 08 11:23:18.417140 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 8f82606f1ba14669aece0c49946b0c45 Sep 08 11:23:18.417140 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-VolumesActionsTest-1211726018 Sep 08 11:23:18.417140 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-VolumesActionsTest-1211726018-project Sep 08 11:23:18.417140 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 11:23:18.417140 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 11:23:18.417140 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: f69dbf339ee94a529d1871ec241398c9 Sep 08 11:23:18.417140 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-VolumesActionsTest-1211726018-project Sep 08 11:23:18.417140 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 11:23:18.417140 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 8976776e-4c76-4233-84c7-32aaeb229df5 could not be found. Sep 08 11:23:18.417140 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '8976776e-4c76-4233-84c7-32aaeb229df5'} Sep 08 11:23:18.417140 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:23:18.417140 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:23:18.417140 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:23:18.417140 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:23:18.417140 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:23:18.417140 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:23:18.417140 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:23:18.417140 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:23:18.417140 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:23:18.417140 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:23:18.417140 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8976776e-4c76-4233-84c7-32aaeb229df5 could not be found. Sep 08 11:23:18.417140 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:23:18.417140 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:23:18.417140 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:23:18.417140 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:23:18.417140 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:23:18.417140 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:23:18.417140 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:23:18.417140 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:23:18.417140 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:23:18.417140 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:23:18.417140 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:23:18.417140 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:23:18.417140 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:23:18.417140 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:23:18.417140 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:23:18.417140 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:23:18.417140 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8976776e-4c76-4233-84c7-32aaeb229df5 could not be found. Sep 08 11:23:18.417140 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:23:18.417140 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:23:18.417140 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:23:18.422270 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:23:18.422270 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:23:18.422270 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:23:18.422270 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:23:18.422270 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:23:18.422270 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8976776e-4c76-4233-84c7-32aaeb229df5 could not be found. Sep 08 11:23:18.422270 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:23:18.422270 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f0e8c2a7-f72a-47b2-af42-f3fd851fb8f5 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] Returning 404 to user: Instance 8976776e-4c76-4233-84c7-32aaeb229df5 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:23:18.422270 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f0e8c2a7-f72a-47b2-af42-f3fd851fb8f5 tempest-VolumesActionsTest-1211726018 tempest-VolumesActionsTest-1211726018-project] 10.222.0.27 "GET /compute/v2.1/servers/8976776e-4c76-4233-84c7-32aaeb229df5" status: 404 len: 111 microversion: 2.1 time: 0.032454 Sep 08 11:23:18.422270 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3112/6358] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:23:18 2022] GET /compute/v2.1/servers/8976776e-4c76-4233-84c7-32aaeb229df5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:23:18.541092 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c7736e68-84a8-4333-a715-5c0ae23b36bd tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:23:18.541992 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c7736e68-84a8-4333-a715-5c0ae23b36bd tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] [instance: 372bed7d-b007-4a5c-878e-d4289b74dda7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:23:18.549063 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c7736e68-84a8-4333-a715-5c0ae23b36bd tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:18.549536 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c7736e68-84a8-4333-a715-5c0ae23b36bd tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:18.550199 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c7736e68-84a8-4333-a715-5c0ae23b36bd tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:18.550895 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c7736e68-84a8-4333-a715-5c0ae23b36bd tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:18.551832 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c7736e68-84a8-4333-a715-5c0ae23b36bd tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:18.552337 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c7736e68-84a8-4333-a715-5c0ae23b36bd tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:18.741555 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c7736e68-84a8-4333-a715-5c0ae23b36bd tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761124676b5e4a8db0bc59740c1f535e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f85ab8354294e359cabfca999283d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:23:18.751019 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c7736e68-84a8-4333-a715-5c0ae23b36bd tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] 10.222.0.27 "GET /compute/v2.1/servers/372bed7d-b007-4a5c-878e-d4289b74dda7" status: 200 len: 1374 microversion: 2.1 time: 0.214090 Sep 08 11:23:18.751727 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3247/6359] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:23:18 2022] GET /compute/v2.1/servers/372bed7d-b007-4a5c-878e-d4289b74dda7 => generated 1374 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:23:19.787293 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-63fac8c4-502f-4f5c-90b9-c0beaa58c8a1 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:23:19.787910 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-63fac8c4-502f-4f5c-90b9-c0beaa58c8a1 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] [instance: 372bed7d-b007-4a5c-878e-d4289b74dda7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:23:19.794735 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63fac8c4-502f-4f5c-90b9-c0beaa58c8a1 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:19.795222 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63fac8c4-502f-4f5c-90b9-c0beaa58c8a1 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:19.795659 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63fac8c4-502f-4f5c-90b9-c0beaa58c8a1 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:19.796362 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63fac8c4-502f-4f5c-90b9-c0beaa58c8a1 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:19.796824 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63fac8c4-502f-4f5c-90b9-c0beaa58c8a1 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:19.797278 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63fac8c4-502f-4f5c-90b9-c0beaa58c8a1 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:19.949796 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-63fac8c4-502f-4f5c-90b9-c0beaa58c8a1 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761124676b5e4a8db0bc59740c1f535e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f85ab8354294e359cabfca999283d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:23:19.958764 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-63fac8c4-502f-4f5c-90b9-c0beaa58c8a1 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] 10.222.0.27 "GET /compute/v2.1/servers/372bed7d-b007-4a5c-878e-d4289b74dda7" status: 200 len: 1374 microversion: 2.1 time: 0.176203 Sep 08 11:23:19.959684 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3113/6360] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:23:19 2022] GET /compute/v2.1/servers/372bed7d-b007-4a5c-878e-d4289b74dda7 => generated 1374 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:23:20.062870 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-311070e0-c2a5-4d95-a142-453453adfcbc req-f94634de-15f2-46d3-a3b2-09ee3fd737c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "372bed7d-b007-4a5c-878e-d4289b74dda7", "name": "network-vif-plugged", "status": "completed", "tag": "81cb6ba6-a8f1-4dbf-b585-df2e8e64a827"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:23:20.072161 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-311070e0-c2a5-4d95-a142-453453adfcbc req-f94634de-15f2-46d3-a3b2-09ee3fd737c5 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:20.072956 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-311070e0-c2a5-4d95-a142-453453adfcbc req-f94634de-15f2-46d3-a3b2-09ee3fd737c5 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:20.073428 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-311070e0-c2a5-4d95-a142-453453adfcbc req-f94634de-15f2-46d3-a3b2-09ee3fd737c5 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:20.087079 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-311070e0-c2a5-4d95-a142-453453adfcbc req-f94634de-15f2-46d3-a3b2-09ee3fd737c5 service nova] Creating event network-vif-plugged:81cb6ba6-a8f1-4dbf-b585-df2e8e64a827 for instance 372bed7d-b007-4a5c-878e-d4289b74dda7 on n-h1-850501-12 Sep 08 11:23:20.092462 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-311070e0-c2a5-4d95-a142-453453adfcbc req-f94634de-15f2-46d3-a3b2-09ee3fd737c5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035166 Sep 08 11:23:20.093207 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3248/6361] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:23:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:23:20.983919 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0eaba42f-0d54-48e1-85e8-5baa84d26429 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:23:20.984530 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0eaba42f-0d54-48e1-85e8-5baa84d26429 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] [instance: 372bed7d-b007-4a5c-878e-d4289b74dda7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:23:20.992457 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0eaba42f-0d54-48e1-85e8-5baa84d26429 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:20.992956 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0eaba42f-0d54-48e1-85e8-5baa84d26429 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:20.993425 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0eaba42f-0d54-48e1-85e8-5baa84d26429 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:20.994167 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0eaba42f-0d54-48e1-85e8-5baa84d26429 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:20.994825 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0eaba42f-0d54-48e1-85e8-5baa84d26429 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:20.995475 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0eaba42f-0d54-48e1-85e8-5baa84d26429 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:21.161572 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0eaba42f-0d54-48e1-85e8-5baa84d26429 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761124676b5e4a8db0bc59740c1f535e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f85ab8354294e359cabfca999283d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:23:21.167109 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:23:21.176938 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0eaba42f-0d54-48e1-85e8-5baa84d26429 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] 10.222.0.27 "GET /compute/v2.1/servers/372bed7d-b007-4a5c-878e-d4289b74dda7" status: 200 len: 1374 microversion: 2.1 time: 0.196340 Sep 08 11:23:21.177526 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3114/6362] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:23:20 2022] GET /compute/v2.1/servers/372bed7d-b007-4a5c-878e-d4289b74dda7 => generated 1374 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:23:22.197355 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:23:22.198879 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=10 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:23:22.206708 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-68104be0-df8e-428a-87a9-cf866d3b2b5b tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:23:22.212247 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-68104be0-df8e-428a-87a9-cf866d3b2b5b tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] [instance: 372bed7d-b007-4a5c-878e-d4289b74dda7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:23:22.226079 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-68104be0-df8e-428a-87a9-cf866d3b2b5b tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:22.226611 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-68104be0-df8e-428a-87a9-cf866d3b2b5b tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:22.227090 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-68104be0-df8e-428a-87a9-cf866d3b2b5b tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:22.227738 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-68104be0-df8e-428a-87a9-cf866d3b2b5b tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:22.228195 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-68104be0-df8e-428a-87a9-cf866d3b2b5b tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:22.228624 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-68104be0-df8e-428a-87a9-cf866d3b2b5b tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:22.398213 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-68104be0-df8e-428a-87a9-cf866d3b2b5b tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761124676b5e4a8db0bc59740c1f535e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f85ab8354294e359cabfca999283d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:23:22.408553 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-68104be0-df8e-428a-87a9-cf866d3b2b5b tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] 10.222.0.27 "GET /compute/v2.1/servers/372bed7d-b007-4a5c-878e-d4289b74dda7" status: 200 len: 1546 microversion: 2.1 time: 0.212353 Sep 08 11:23:22.417523 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3249/6363] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:23:22 2022] GET /compute/v2.1/servers/372bed7d-b007-4a5c-878e-d4289b74dda7 => generated 1546 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:23:22.435360 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5fe225ac-5cf7-420a-be88-42dfda44ae67 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:23:22.436523 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5fe225ac-5cf7-420a-be88-42dfda44ae67 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] [instance: 372bed7d-b007-4a5c-878e-d4289b74dda7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:23:22.444171 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:23:22.450243 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5fe225ac-5cf7-420a-be88-42dfda44ae67 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:22.451347 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5fe225ac-5cf7-420a-be88-42dfda44ae67 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:22.452144 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5fe225ac-5cf7-420a-be88-42dfda44ae67 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:22.453066 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5fe225ac-5cf7-420a-be88-42dfda44ae67 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:22.453720 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5fe225ac-5cf7-420a-be88-42dfda44ae67 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:22.454149 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5fe225ac-5cf7-420a-be88-42dfda44ae67 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:22.606024 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5fe225ac-5cf7-420a-be88-42dfda44ae67 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761124676b5e4a8db0bc59740c1f535e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f85ab8354294e359cabfca999283d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:23:22.618540 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5fe225ac-5cf7-420a-be88-42dfda44ae67 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] 10.222.0.27 "GET /compute/v2.1/servers/372bed7d-b007-4a5c-878e-d4289b74dda7" status: 200 len: 1546 microversion: 2.1 time: 0.188352 Sep 08 11:23:22.620129 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3115/6364] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:23:22 2022] GET /compute/v2.1/servers/372bed7d-b007-4a5c-878e-d4289b74dda7 => generated 1546 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:23:51.327437 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c0f5f6d0-3784-4596-b7d6-c2f103d2d280 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:23:51.327868 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c0f5f6d0-3784-4596-b7d6-c2f103d2d280 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] [instance: 372bed7d-b007-4a5c-878e-d4289b74dda7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:23:51.331537 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=4 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:23:51.332509 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=70 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:23:51.337267 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c0f5f6d0-3784-4596-b7d6-c2f103d2d280 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:51.337996 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c0f5f6d0-3784-4596-b7d6-c2f103d2d280 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:51.338443 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c0f5f6d0-3784-4596-b7d6-c2f103d2d280 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:51.339172 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c0f5f6d0-3784-4596-b7d6-c2f103d2d280 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:51.339643 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c0f5f6d0-3784-4596-b7d6-c2f103d2d280 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:51.340077 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c0f5f6d0-3784-4596-b7d6-c2f103d2d280 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:51.370407 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c0f5f6d0-3784-4596-b7d6-c2f103d2d280 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] [instance: 372bed7d-b007-4a5c-878e-d4289b74dda7] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:23:51.477464 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c0f5f6d0-3784-4596-b7d6-c2f103d2d280 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] 10.222.0.27 "DELETE /compute/v2.1/servers/372bed7d-b007-4a5c-878e-d4289b74dda7" status: 204 len: 0 microversion: 2.1 time: 0.153448 Sep 08 11:23:51.478745 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3250/6365] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:23:51 2022] DELETE /compute/v2.1/servers/372bed7d-b007-4a5c-878e-d4289b74dda7 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:23:51.489545 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ff80382a-2a67-467f-abfe-b3b722c284e2 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:23:51.493643 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ff80382a-2a67-467f-abfe-b3b722c284e2 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] [instance: 372bed7d-b007-4a5c-878e-d4289b74dda7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:23:51.497008 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:23:51.498460 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:23:51.505387 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff80382a-2a67-467f-abfe-b3b722c284e2 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:51.506381 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff80382a-2a67-467f-abfe-b3b722c284e2 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:51.507199 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff80382a-2a67-467f-abfe-b3b722c284e2 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:51.509139 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff80382a-2a67-467f-abfe-b3b722c284e2 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:51.509871 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff80382a-2a67-467f-abfe-b3b722c284e2 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:51.510485 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff80382a-2a67-467f-abfe-b3b722c284e2 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:51.695860 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ff80382a-2a67-467f-abfe-b3b722c284e2 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761124676b5e4a8db0bc59740c1f535e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f85ab8354294e359cabfca999283d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:23:51.705941 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ff80382a-2a67-467f-abfe-b3b722c284e2 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] 10.222.0.27 "GET /compute/v2.1/servers/372bed7d-b007-4a5c-878e-d4289b74dda7" status: 200 len: 1552 microversion: 2.1 time: 0.222377 Sep 08 11:23:51.706480 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3116/6366] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:23:51 2022] GET /compute/v2.1/servers/372bed7d-b007-4a5c-878e-d4289b74dda7 => generated 1552 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:23:52.732436 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1e874659-002f-45fd-a00b-98332bb1c888 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:23:52.734551 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1e874659-002f-45fd-a00b-98332bb1c888 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] [instance: 372bed7d-b007-4a5c-878e-d4289b74dda7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:23:52.743285 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e874659-002f-45fd-a00b-98332bb1c888 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:52.744860 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e874659-002f-45fd-a00b-98332bb1c888 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:52.748161 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e874659-002f-45fd-a00b-98332bb1c888 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:52.749264 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e874659-002f-45fd-a00b-98332bb1c888 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:52.749964 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e874659-002f-45fd-a00b-98332bb1c888 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:52.750717 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e874659-002f-45fd-a00b-98332bb1c888 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:53.005545 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1e874659-002f-45fd-a00b-98332bb1c888 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761124676b5e4a8db0bc59740c1f535e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f85ab8354294e359cabfca999283d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:23:53.016758 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1e874659-002f-45fd-a00b-98332bb1c888 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] 10.222.0.27 "GET /compute/v2.1/servers/372bed7d-b007-4a5c-878e-d4289b74dda7" status: 200 len: 1552 microversion: 2.1 time: 0.291010 Sep 08 11:23:53.017990 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3251/6367] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:23:52 2022] GET /compute/v2.1/servers/372bed7d-b007-4a5c-878e-d4289b74dda7 => generated 1552 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:23:53.758945 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-90c56825-ce8a-4234-b4d5-44fca3ccbc4d req-e1075275-3aca-45ee-8789-72d5725844d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "372bed7d-b007-4a5c-878e-d4289b74dda7", "name": "network-vif-deleted", "tag": "81cb6ba6-a8f1-4dbf-b585-df2e8e64a827"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:23:53.770870 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-90c56825-ce8a-4234-b4d5-44fca3ccbc4d req-e1075275-3aca-45ee-8789-72d5725844d8 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:53.771351 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-90c56825-ce8a-4234-b4d5-44fca3ccbc4d req-e1075275-3aca-45ee-8789-72d5725844d8 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:53.771800 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-90c56825-ce8a-4234-b4d5-44fca3ccbc4d req-e1075275-3aca-45ee-8789-72d5725844d8 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:53.784485 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-90c56825-ce8a-4234-b4d5-44fca3ccbc4d req-e1075275-3aca-45ee-8789-72d5725844d8 service nova] Creating event network-vif-deleted:81cb6ba6-a8f1-4dbf-b585-df2e8e64a827 for instance 372bed7d-b007-4a5c-878e-d4289b74dda7 on n-h1-850501-12 Sep 08 11:23:53.791133 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-90c56825-ce8a-4234-b4d5-44fca3ccbc4d req-e1075275-3aca-45ee-8789-72d5725844d8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035921 Sep 08 11:23:53.792634 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3117/6368] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:23:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:23:54.060790 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-30d5f40f-c26a-4e53-9485-11a3f100afe0 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:23:54.062248 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-30d5f40f-c26a-4e53-9485-11a3f100afe0 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] [instance: 372bed7d-b007-4a5c-878e-d4289b74dda7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:23:54.070136 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-30d5f40f-c26a-4e53-9485-11a3f100afe0 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:54.071419 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-30d5f40f-c26a-4e53-9485-11a3f100afe0 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:54.072181 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-30d5f40f-c26a-4e53-9485-11a3f100afe0 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:54.073448 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-30d5f40f-c26a-4e53-9485-11a3f100afe0 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:54.074430 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-30d5f40f-c26a-4e53-9485-11a3f100afe0 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:54.075504 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-30d5f40f-c26a-4e53-9485-11a3f100afe0 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:54.122377 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-30d5f40f-c26a-4e53-9485-11a3f100afe0 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:54.122890 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-30d5f40f-c26a-4e53-9485-11a3f100afe0 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:54.123342 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-30d5f40f-c26a-4e53-9485-11a3f100afe0 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:54.123813 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-30d5f40f-c26a-4e53-9485-11a3f100afe0 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lazy-loading 'fault' on Instance uuid 372bed7d-b007-4a5c-878e-d4289b74dda7 {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:23:54.180446 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-30d5f40f-c26a-4e53-9485-11a3f100afe0 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761124676b5e4a8db0bc59740c1f535e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f85ab8354294e359cabfca999283d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:23:54.191201 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-30d5f40f-c26a-4e53-9485-11a3f100afe0 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] 10.222.0.27 "GET /compute/v2.1/servers/372bed7d-b007-4a5c-878e-d4289b74dda7" status: 200 len: 1338 microversion: 2.1 time: 0.138778 Sep 08 11:23:54.192547 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3252/6369] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:23:54 2022] GET /compute/v2.1/servers/372bed7d-b007-4a5c-878e-d4289b74dda7 => generated 1338 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:23:55.217472 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-16e3a751-0523-4fee-bd00-b02d9b429033 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:23:55.218191 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-16e3a751-0523-4fee-bd00-b02d9b429033 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] [instance: 372bed7d-b007-4a5c-878e-d4289b74dda7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:23:55.230072 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-16e3a751-0523-4fee-bd00-b02d9b429033 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:55.230583 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-16e3a751-0523-4fee-bd00-b02d9b429033 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:55.231024 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-16e3a751-0523-4fee-bd00-b02d9b429033 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:55.231754 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-16e3a751-0523-4fee-bd00-b02d9b429033 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:55.232216 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-16e3a751-0523-4fee-bd00-b02d9b429033 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:55.232654 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-16e3a751-0523-4fee-bd00-b02d9b429033 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:55.248820 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-16e3a751-0523-4fee-bd00-b02d9b429033 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] HTTP exception thrown: Instance 372bed7d-b007-4a5c-878e-d4289b74dda7 could not be found. Sep 08 11:23:55.254276 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-16e3a751-0523-4fee-bd00-b02d9b429033 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Request method failure captured: Sep 08 11:23:55.254276 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/372bed7d-b007-4a5c-878e-d4289b74dda7 HTTP/1.1 Sep 08 11:23:55.254276 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 11:23:55.254276 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 11:23:55.254276 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 11:23:55.254276 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 11:23:55.254276 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 11:23:55.254276 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 11:23:55.254276 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 11:23:55.254276 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 11:23:55.254276 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGdBWwDrpfILJHSWnIxsJn5HeyBGxHJFzd2g8Lexoa9iPun5JSvLnbnWMoG-UTTC5Yq0S0M1Vi2RL_9uQOqR8ZnH_IWdlgnhUwsXmNPdFb0ZnfgmU2FcucNYnYdjIcv_WCtIyaGFbtccdMcuXnjIQDt4hJ8BjINuDA046uTxlkRTRqL0 Sep 08 11:23:55.254276 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 11:23:55.254276 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 11:23:55.254276 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 11:23:55.254276 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 11:23:55.254276 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 11:23:55.254276 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 11:23:55.254276 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 8f85ab8354294e359cabfca999283d5a Sep 08 11:23:55.254276 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-TestNetworkBasicOps-1488807265 Sep 08 11:23:55.254276 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 11:23:55.254276 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 11:23:55.254276 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8f85ab8354294e359cabfca999283d5a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8f85ab8354294e359cabfca999283d5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8f85ab8354294e359cabfca999283d5a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8f85ab8354294e359cabfca999283d5a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:23:55.254276 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-TestNetworkBasicOps-1488807265 Sep 08 11:23:55.254276 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 8f85ab8354294e359cabfca999283d5a Sep 08 11:23:55.254276 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-TestNetworkBasicOps-1488807265 Sep 08 11:23:55.254276 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-TestNetworkBasicOps-1488807265-project Sep 08 11:23:55.254276 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 11:23:55.254276 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 11:23:55.254276 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 761124676b5e4a8db0bc59740c1f535e Sep 08 11:23:55.254276 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-TestNetworkBasicOps-1488807265-project Sep 08 11:23:55.254276 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 11:23:55.254276 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 372bed7d-b007-4a5c-878e-d4289b74dda7 could not be found. Sep 08 11:23:55.254276 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '372bed7d-b007-4a5c-878e-d4289b74dda7'} Sep 08 11:23:55.254276 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:23:55.254276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:23:55.254276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:23:55.254276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:23:55.254276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:23:55.254276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:23:55.254276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:23:55.254276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:23:55.254276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:23:55.254276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:23:55.254276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 372bed7d-b007-4a5c-878e-d4289b74dda7 could not be found. Sep 08 11:23:55.254276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:23:55.254276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:23:55.254276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:23:55.254276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:23:55.254276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:23:55.254276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:23:55.254276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:23:55.254276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:23:55.254276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:23:55.254276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:23:55.254276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:23:55.254276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:23:55.254276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:23:55.254276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:23:55.254276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:23:55.254276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:23:55.254276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 372bed7d-b007-4a5c-878e-d4289b74dda7 could not be found. Sep 08 11:23:55.254276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:23:55.254276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:23:55.254276 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:23:55.264548 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:23:55.264548 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:23:55.264548 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:23:55.264548 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:23:55.264548 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:23:55.264548 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 372bed7d-b007-4a5c-878e-d4289b74dda7 could not be found. Sep 08 11:23:55.264548 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:23:55.264548 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-16e3a751-0523-4fee-bd00-b02d9b429033 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Returning 404 to user: Instance 372bed7d-b007-4a5c-878e-d4289b74dda7 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:23:55.264548 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-16e3a751-0523-4fee-bd00-b02d9b429033 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] 10.222.0.27 "GET /compute/v2.1/servers/372bed7d-b007-4a5c-878e-d4289b74dda7" status: 404 len: 111 microversion: 2.1 time: 0.043582 Sep 08 11:23:55.264548 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3118/6370] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:23:55 2022] GET /compute/v2.1/servers/372bed7d-b007-4a5c-878e-d4289b74dda7 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:23:55.467216 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-86e8cb87-ad4f-47f9-bca4-bb2b7ce3ef55 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Calling method '.version_select at 0x7f68e4a57820>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:23:55.495372 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-86e8cb87-ad4f-47f9-bca4-bb2b7ce3ef55 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-861300180" status: 202 len: 0 microversion: 2.1 time: 0.031768 Sep 08 11:23:55.497701 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3253/6371] 10.222.0.27 () {58 vars in 1254 bytes} [Thu Sep 8 11:23:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-861300180 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:23:58.177768 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-6b29f9e6-a6fe-44de-9304-eeae79717c8f req-b4ed92e4-8407-4f91-82ee-9a27469589d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b06cee3a-5166-4195-a2fc-465c711726d0", "tag": "99690eff-0cda-4a9d-ade3-d491c8966a33"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:23:58.180832 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9ddeba02-6e4a-4635-8d54-c64134a5aa31 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:23:58.181695 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9ddeba02-6e4a-4635-8d54-c64134a5aa31 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] [instance: b06cee3a-5166-4195-a2fc-465c711726d0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:23:58.193958 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9ddeba02-6e4a-4635-8d54-c64134a5aa31 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:58.195597 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9ddeba02-6e4a-4635-8d54-c64134a5aa31 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:58.196295 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9ddeba02-6e4a-4635-8d54-c64134a5aa31 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:58.196733 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-6b29f9e6-a6fe-44de-9304-eeae79717c8f req-b4ed92e4-8407-4f91-82ee-9a27469589d2 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:58.197519 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9ddeba02-6e4a-4635-8d54-c64134a5aa31 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:58.198252 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9ddeba02-6e4a-4635-8d54-c64134a5aa31 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:58.198901 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9ddeba02-6e4a-4635-8d54-c64134a5aa31 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:58.199259 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-6b29f9e6-a6fe-44de-9304-eeae79717c8f req-b4ed92e4-8407-4f91-82ee-9a27469589d2 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:58.199784 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-6b29f9e6-a6fe-44de-9304-eeae79717c8f req-b4ed92e4-8407-4f91-82ee-9a27469589d2 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:58.216849 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-6b29f9e6-a6fe-44de-9304-eeae79717c8f req-b4ed92e4-8407-4f91-82ee-9a27469589d2 service nova] Creating event network-changed:99690eff-0cda-4a9d-ade3-d491c8966a33 for instance b06cee3a-5166-4195-a2fc-465c711726d0 on n-h1-850501-12 Sep 08 11:23:58.224146 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-6b29f9e6-a6fe-44de-9304-eeae79717c8f req-b4ed92e4-8407-4f91-82ee-9a27469589d2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049783 Sep 08 11:23:58.226142 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3254/6372] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:23:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:23:58.249882 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9ddeba02-6e4a-4635-8d54-c64134a5aa31 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] [instance: b06cee3a-5166-4195-a2fc-465c711726d0] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:23:58.355641 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9ddeba02-6e4a-4635-8d54-c64134a5aa31 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b06cee3a-5166-4195-a2fc-465c711726d0" status: 204 len: 0 microversion: 2.1 time: 0.185246 Sep 08 11:23:58.357940 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3119/6373] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:23:58 2022] DELETE /compute/v2.1/servers/b06cee3a-5166-4195-a2fc-465c711726d0 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:23:58.368695 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-266725db-5165-4f19-b98a-43d193bf0940 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:23:58.369541 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-266725db-5165-4f19-b98a-43d193bf0940 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] [instance: b06cee3a-5166-4195-a2fc-465c711726d0] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:23:58.381088 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-266725db-5165-4f19-b98a-43d193bf0940 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:58.384193 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-266725db-5165-4f19-b98a-43d193bf0940 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:58.385650 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-266725db-5165-4f19-b98a-43d193bf0940 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:58.387504 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-266725db-5165-4f19-b98a-43d193bf0940 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:58.388267 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-266725db-5165-4f19-b98a-43d193bf0940 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:58.388974 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-266725db-5165-4f19-b98a-43d193bf0940 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:58.593433 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-266725db-5165-4f19-b98a-43d193bf0940 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761124676b5e4a8db0bc59740c1f535e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f85ab8354294e359cabfca999283d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:23:58.606285 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-266725db-5165-4f19-b98a-43d193bf0940 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] 10.222.0.27 "GET /compute/v2.1/servers/b06cee3a-5166-4195-a2fc-465c711726d0" status: 200 len: 1669 microversion: 2.1 time: 0.242025 Sep 08 11:23:58.622368 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3255/6374] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:23:58 2022] GET /compute/v2.1/servers/b06cee3a-5166-4195-a2fc-465c711726d0 => generated 1669 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:23:59.642582 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-08f7a9ae-a86b-498f-a497-1dab982499fc tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:23:59.643384 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-08f7a9ae-a86b-498f-a497-1dab982499fc tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] [instance: b06cee3a-5166-4195-a2fc-465c711726d0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:23:59.659513 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08f7a9ae-a86b-498f-a497-1dab982499fc tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:59.659707 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08f7a9ae-a86b-498f-a497-1dab982499fc tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:59.660056 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08f7a9ae-a86b-498f-a497-1dab982499fc tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:59.661935 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08f7a9ae-a86b-498f-a497-1dab982499fc tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:59.663210 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08f7a9ae-a86b-498f-a497-1dab982499fc tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:59.663902 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08f7a9ae-a86b-498f-a497-1dab982499fc tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:59.854049 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-08f7a9ae-a86b-498f-a497-1dab982499fc tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761124676b5e4a8db0bc59740c1f535e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f85ab8354294e359cabfca999283d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:23:59.862161 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-08f7a9ae-a86b-498f-a497-1dab982499fc tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] 10.222.0.27 "GET /compute/v2.1/servers/b06cee3a-5166-4195-a2fc-465c711726d0" status: 200 len: 1669 microversion: 2.1 time: 0.226214 Sep 08 11:23:59.878563 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3120/6375] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:23:59 2022] GET /compute/v2.1/servers/b06cee3a-5166-4195-a2fc-465c711726d0 => generated 1669 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:24:00.763365 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-9c316e28-2b3d-444e-b314-39992c74c0df req-a8cef1c9-c5be-46a1-85dc-2f99f9680c5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b06cee3a-5166-4195-a2fc-465c711726d0", "name": "network-vif-deleted", "tag": "99690eff-0cda-4a9d-ade3-d491c8966a33"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:24:00.787120 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-9c316e28-2b3d-444e-b314-39992c74c0df req-a8cef1c9-c5be-46a1-85dc-2f99f9680c5e service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:00.787843 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-9c316e28-2b3d-444e-b314-39992c74c0df req-a8cef1c9-c5be-46a1-85dc-2f99f9680c5e service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:00.788329 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-9c316e28-2b3d-444e-b314-39992c74c0df req-a8cef1c9-c5be-46a1-85dc-2f99f9680c5e service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:00.805756 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-9c316e28-2b3d-444e-b314-39992c74c0df req-a8cef1c9-c5be-46a1-85dc-2f99f9680c5e service nova] Creating event network-vif-deleted:99690eff-0cda-4a9d-ade3-d491c8966a33 for instance b06cee3a-5166-4195-a2fc-465c711726d0 on n-h1-850501-12 Sep 08 11:24:00.811320 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-9c316e28-2b3d-444e-b314-39992c74c0df req-a8cef1c9-c5be-46a1-85dc-2f99f9680c5e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.318101 Sep 08 11:24:00.812185 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3256/6376] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:24:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:24:00.899685 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5af2d16d-4894-4262-a102-92f719cf5ebd tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:24:00.900329 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5af2d16d-4894-4262-a102-92f719cf5ebd tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] [instance: b06cee3a-5166-4195-a2fc-465c711726d0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:24:00.921916 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5af2d16d-4894-4262-a102-92f719cf5ebd tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:00.922427 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5af2d16d-4894-4262-a102-92f719cf5ebd tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:00.923082 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5af2d16d-4894-4262-a102-92f719cf5ebd tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:00.924356 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5af2d16d-4894-4262-a102-92f719cf5ebd tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:00.931166 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5af2d16d-4894-4262-a102-92f719cf5ebd tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:00.931926 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5af2d16d-4894-4262-a102-92f719cf5ebd tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:00.973797 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5af2d16d-4894-4262-a102-92f719cf5ebd tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:00.974606 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5af2d16d-4894-4262-a102-92f719cf5ebd tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:00.975091 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5af2d16d-4894-4262-a102-92f719cf5ebd tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:00.975622 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-5af2d16d-4894-4262-a102-92f719cf5ebd tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lazy-loading 'fault' on Instance uuid b06cee3a-5166-4195-a2fc-465c711726d0 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:24:01.053538 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5af2d16d-4894-4262-a102-92f719cf5ebd tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761124676b5e4a8db0bc59740c1f535e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f85ab8354294e359cabfca999283d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:24:01.074895 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5af2d16d-4894-4262-a102-92f719cf5ebd tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] 10.222.0.27 "GET /compute/v2.1/servers/b06cee3a-5166-4195-a2fc-465c711726d0" status: 200 len: 1338 microversion: 2.1 time: 0.192602 Sep 08 11:24:01.076536 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3121/6377] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:24:00 2022] GET /compute/v2.1/servers/b06cee3a-5166-4195-a2fc-465c711726d0 => generated 1338 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:24:02.101069 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-766e00b7-9a15-45d8-9097-d251ece9bb55 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:24:02.101706 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-766e00b7-9a15-45d8-9097-d251ece9bb55 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] [instance: b06cee3a-5166-4195-a2fc-465c711726d0] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:24:02.108191 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-766e00b7-9a15-45d8-9097-d251ece9bb55 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:02.108682 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-766e00b7-9a15-45d8-9097-d251ece9bb55 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:02.109262 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-766e00b7-9a15-45d8-9097-d251ece9bb55 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:02.109966 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-766e00b7-9a15-45d8-9097-d251ece9bb55 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:02.110421 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-766e00b7-9a15-45d8-9097-d251ece9bb55 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:02.110990 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-766e00b7-9a15-45d8-9097-d251ece9bb55 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:02.124970 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-766e00b7-9a15-45d8-9097-d251ece9bb55 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] HTTP exception thrown: Instance b06cee3a-5166-4195-a2fc-465c711726d0 could not be found. Sep 08 11:24:02.126726 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-766e00b7-9a15-45d8-9097-d251ece9bb55 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Request method failure captured: Sep 08 11:24:02.126726 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/b06cee3a-5166-4195-a2fc-465c711726d0 HTTP/1.1 Sep 08 11:24:02.126726 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:24:02.126726 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:24:02.126726 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:24:02.126726 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 11:24:02.126726 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:24:02.126726 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:24:02.126726 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:24:02.126726 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:24:02.126726 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGdBWwDrpfILJHSWnIxsJn5HeyBGxHJFzd2g8Lexoa9iPun5JSvLnbnWMoG-UTTC5Yq0S0M1Vi2RL_9uQOqR8ZnH_IWdlgnhUwsXmNPdFb0ZnfgmU2FcucNYnYdjIcv_WCtIyaGFbtccdMcuXnjIQDt4hJ8BjINuDA046uTxlkRTRqL0 Sep 08 11:24:02.126726 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:24:02.126726 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:24:02.126726 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:24:02.126726 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:24:02.126726 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:24:02.126726 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:24:02.126726 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 8f85ab8354294e359cabfca999283d5a Sep 08 11:24:02.126726 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-TestNetworkBasicOps-1488807265 Sep 08 11:24:02.126726 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:24:02.126726 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:24:02.126726 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8f85ab8354294e359cabfca999283d5a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8f85ab8354294e359cabfca999283d5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8f85ab8354294e359cabfca999283d5a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8f85ab8354294e359cabfca999283d5a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:24:02.126726 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-TestNetworkBasicOps-1488807265 Sep 08 11:24:02.126726 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 8f85ab8354294e359cabfca999283d5a Sep 08 11:24:02.126726 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-TestNetworkBasicOps-1488807265 Sep 08 11:24:02.126726 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-TestNetworkBasicOps-1488807265-project Sep 08 11:24:02.126726 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:24:02.126726 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:24:02.126726 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 761124676b5e4a8db0bc59740c1f535e Sep 08 11:24:02.126726 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-TestNetworkBasicOps-1488807265-project Sep 08 11:24:02.126726 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 11:24:02.126726 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance b06cee3a-5166-4195-a2fc-465c711726d0 could not be found. Sep 08 11:24:02.126726 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': 'b06cee3a-5166-4195-a2fc-465c711726d0'} Sep 08 11:24:02.126726 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:24:02.126726 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:24:02.126726 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:24:02.126726 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:24:02.126726 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:24:02.126726 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:24:02.126726 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:24:02.126726 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:24:02.126726 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:24:02.126726 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:24:02.126726 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b06cee3a-5166-4195-a2fc-465c711726d0 could not be found. Sep 08 11:24:02.126726 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:24:02.126726 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:24:02.126726 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:24:02.126726 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:24:02.126726 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:24:02.126726 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:24:02.126726 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:24:02.126726 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:24:02.126726 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:24:02.126726 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:24:02.126726 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:24:02.126726 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:24:02.126726 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:24:02.126726 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:24:02.126726 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:24:02.126726 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:24:02.126726 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b06cee3a-5166-4195-a2fc-465c711726d0 could not be found. Sep 08 11:24:02.126726 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:24:02.126726 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:24:02.126726 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:24:02.134970 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:24:02.134970 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:24:02.134970 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:24:02.134970 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:24:02.134970 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:24:02.134970 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b06cee3a-5166-4195-a2fc-465c711726d0 could not be found. Sep 08 11:24:02.134970 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:24:02.134970 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-766e00b7-9a15-45d8-9097-d251ece9bb55 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Returning 404 to user: Instance b06cee3a-5166-4195-a2fc-465c711726d0 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:24:02.134970 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-766e00b7-9a15-45d8-9097-d251ece9bb55 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] 10.222.0.27 "GET /compute/v2.1/servers/b06cee3a-5166-4195-a2fc-465c711726d0" status: 404 len: 111 microversion: 2.1 time: 0.032901 Sep 08 11:24:02.141193 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3257/6378] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:24:02 2022] GET /compute/v2.1/servers/b06cee3a-5166-4195-a2fc-465c711726d0 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:24:02.303181 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e71bc862-02c3-4b56-a8a3-4385b6acec4a tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Calling method '.version_select at 0x7f68e45cb790>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:24:02.353921 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e71bc862-02c3-4b56-a8a3-4385b6acec4a tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-244292021" status: 202 len: 0 microversion: 2.1 time: 0.055169 Sep 08 11:24:02.354778 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3122/6379] 10.222.0.27 () {58 vars in 1254 bytes} [Thu Sep 8 11:24:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-244292021 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:24:10.688370 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-64c940b1-4102-43f1-9e5a-3f3d6f179af1 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1154634315", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "01a3acbc-dad6-4d43-be2e-ca90d0f0dc79"}]}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:24:10.762051 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-64c940b1-4102-43f1-9e5a-3f3d6f179af1 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] validate_networks() for [('01a3acbc-dad6-4d43-be2e-ca90d0f0dc79', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:24:11.540157 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-64c940b1-4102-43f1-9e5a-3f3d6f179af1 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:24:11.540596 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-64c940b1-4102-43f1-9e5a-3f3d6f179af1 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:24:11.541178 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-64c940b1-4102-43f1-9e5a-3f3d6f179af1 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:24:11.541809 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-64c940b1-4102-43f1-9e5a-3f3d6f179af1 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:24:11.542389 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-64c940b1-4102-43f1-9e5a-3f3d6f179af1 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:24:11.569367 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64c940b1-4102-43f1-9e5a-3f3d6f179af1 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:11.569974 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64c940b1-4102-43f1-9e5a-3f3d6f179af1 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:11.571057 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64c940b1-4102-43f1-9e5a-3f3d6f179af1 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:11.572062 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64c940b1-4102-43f1-9e5a-3f3d6f179af1 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:11.572532 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64c940b1-4102-43f1-9e5a-3f3d6f179af1 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:11.572971 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64c940b1-4102-43f1-9e5a-3f3d6f179af1 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:11.642746 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-64c940b1-4102-43f1-9e5a-3f3d6f179af1 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Getting quotas for project 6536c0f9eb1745378692b21905d79e6d. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:24:11.658366 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-64c940b1-4102-43f1-9e5a-3f3d6f179af1 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Getting quotas for user 2d1a8ff15d81430ab50eec828b55ce64 and project 6536c0f9eb1745378692b21905d79e6d. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:24:11.694446 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-64c940b1-4102-43f1-9e5a-3f3d6f179af1 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:24:11.696869 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-64c940b1-4102-43f1-9e5a-3f3d6f179af1 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] [instance: 5d33cfed-409f-4da3-9cdf-1b7a83d72532] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:24:11.817762 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-64c940b1-4102-43f1-9e5a-3f3d6f179af1 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.295570 Sep 08 11:24:11.818848 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3258/6380] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 11:24:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1297 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:24:11.828837 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:24:11.835212 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1744a40d-3482-4447-8676-8e10f0bc941e tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:24:11.837074 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1744a40d-3482-4447-8676-8e10f0bc941e tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] [instance: 5d33cfed-409f-4da3-9cdf-1b7a83d72532] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:24:12.068210 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1744a40d-3482-4447-8676-8e10f0bc941e tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1a8ff15d81430ab50eec828b55ce64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6536c0f9eb1745378692b21905d79e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:24:12.083801 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1744a40d-3482-4447-8676-8e10f0bc941e tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] 10.222.0.27 "GET /compute/v2.1/servers/5d33cfed-409f-4da3-9cdf-1b7a83d72532" status: 200 len: 1215 microversion: 2.1 time: 0.256709 Sep 08 11:24:12.089735 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3123/6381] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:24:11 2022] GET /compute/v2.1/servers/5d33cfed-409f-4da3-9cdf-1b7a83d72532 => generated 1215 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:24:13.119543 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d7bc5fcf-fdf3-410b-96ed-6901ca22a860 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:24:13.120281 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d7bc5fcf-fdf3-410b-96ed-6901ca22a860 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] [instance: 5d33cfed-409f-4da3-9cdf-1b7a83d72532] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:24:13.137887 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d7bc5fcf-fdf3-410b-96ed-6901ca22a860 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:13.140122 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d7bc5fcf-fdf3-410b-96ed-6901ca22a860 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:13.140631 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d7bc5fcf-fdf3-410b-96ed-6901ca22a860 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:13.142557 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d7bc5fcf-fdf3-410b-96ed-6901ca22a860 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:13.144100 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d7bc5fcf-fdf3-410b-96ed-6901ca22a860 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:13.145787 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d7bc5fcf-fdf3-410b-96ed-6901ca22a860 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:13.284351 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d7bc5fcf-fdf3-410b-96ed-6901ca22a860 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1a8ff15d81430ab50eec828b55ce64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6536c0f9eb1745378692b21905d79e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:24:13.311318 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d7bc5fcf-fdf3-410b-96ed-6901ca22a860 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] 10.222.0.27 "GET /compute/v2.1/servers/5d33cfed-409f-4da3-9cdf-1b7a83d72532" status: 200 len: 1267 microversion: 2.1 time: 0.201379 Sep 08 11:24:13.313070 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3259/6382] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:24:13 2022] GET /compute/v2.1/servers/5d33cfed-409f-4da3-9cdf-1b7a83d72532 => generated 1267 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:24:14.338958 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9fd27b1b-bf09-4462-9c2a-aea2e073fd38 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:24:14.339674 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9fd27b1b-bf09-4462-9c2a-aea2e073fd38 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] [instance: 5d33cfed-409f-4da3-9cdf-1b7a83d72532] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:24:14.350989 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9fd27b1b-bf09-4462-9c2a-aea2e073fd38 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:14.353818 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9fd27b1b-bf09-4462-9c2a-aea2e073fd38 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:14.354278 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9fd27b1b-bf09-4462-9c2a-aea2e073fd38 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:14.355011 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9fd27b1b-bf09-4462-9c2a-aea2e073fd38 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:14.355469 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9fd27b1b-bf09-4462-9c2a-aea2e073fd38 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:14.355898 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9fd27b1b-bf09-4462-9c2a-aea2e073fd38 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:14.514478 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9fd27b1b-bf09-4462-9c2a-aea2e073fd38 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1a8ff15d81430ab50eec828b55ce64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6536c0f9eb1745378692b21905d79e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:24:14.523004 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9fd27b1b-bf09-4462-9c2a-aea2e073fd38 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] 10.222.0.27 "GET /compute/v2.1/servers/5d33cfed-409f-4da3-9cdf-1b7a83d72532" status: 200 len: 1273 microversion: 2.1 time: 0.189377 Sep 08 11:24:14.523683 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3124/6383] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:24:14 2022] GET /compute/v2.1/servers/5d33cfed-409f-4da3-9cdf-1b7a83d72532 => generated 1273 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:24:14.551684 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ec0c6ee6-120a-4716-86af-4bbc9bc1853d tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Action: 'create', calling method: .version_select at 0x7f68df0c3c10>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-5337725", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPqxHWyohyq47ouj3lzAJ0HX8hAWpqVxRXnj+fm11MhaGUfOjLPA7+1yC+qcAEJJKjSeeEM2wtJKZ/CbpavbgD0hZRnfxqQKw0ZHzHzmz+kxAHsQpLkopwJqYQumBW8Zhg=="}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:24:14.571415 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-ec0c6ee6-120a-4716-86af-4bbc9bc1853d tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Getting quotas for project 8f85ab8354294e359cabfca999283d5a. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:24:14.579807 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-ec0c6ee6-120a-4716-86af-4bbc9bc1853d tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Getting quotas for user 761124676b5e4a8db0bc59740c1f535e and project 8f85ab8354294e359cabfca999283d5a. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:24:14.620958 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ec0c6ee6-120a-4716-86af-4bbc9bc1853d tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.073577 Sep 08 11:24:14.621992 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3260/6384] 10.222.0.27 () {60 vars in 1159 bytes} [Thu Sep 8 11:24:14 2022] POST /compute/v2.1/os-keypairs => generated 395 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:24:15.548366 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1911d60b-20e5-4e9c-bde8-5a8cdb78289f tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:24:15.548998 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1911d60b-20e5-4e9c-bde8-5a8cdb78289f tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] [instance: 5d33cfed-409f-4da3-9cdf-1b7a83d72532] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:24:15.563367 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1911d60b-20e5-4e9c-bde8-5a8cdb78289f tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:15.563870 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1911d60b-20e5-4e9c-bde8-5a8cdb78289f tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:15.564315 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1911d60b-20e5-4e9c-bde8-5a8cdb78289f tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:15.565273 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1911d60b-20e5-4e9c-bde8-5a8cdb78289f tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:15.577798 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1911d60b-20e5-4e9c-bde8-5a8cdb78289f tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:15.578317 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1911d60b-20e5-4e9c-bde8-5a8cdb78289f tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:15.842538 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1911d60b-20e5-4e9c-bde8-5a8cdb78289f tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1a8ff15d81430ab50eec828b55ce64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6536c0f9eb1745378692b21905d79e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:24:15.856148 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1911d60b-20e5-4e9c-bde8-5a8cdb78289f tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] 10.222.0.27 "GET /compute/v2.1/servers/5d33cfed-409f-4da3-9cdf-1b7a83d72532" status: 200 len: 1315 microversion: 2.1 time: 0.311764 Sep 08 11:24:15.857297 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3125/6385] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:24:15 2022] GET /compute/v2.1/servers/5d33cfed-409f-4da3-9cdf-1b7a83d72532 => generated 1315 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:24:16.083112 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-c8f91799-dead-40cd-a647-4980ca786977 req-bd2b118f-0f70-4ca1-9e15-1cf6c3d93026 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d33cfed-409f-4da3-9cdf-1b7a83d72532", "tag": "d5d6bbd7-ea4a-404e-9fe1-10fff55175e0"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:24:16.121252 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-c8f91799-dead-40cd-a647-4980ca786977 req-bd2b118f-0f70-4ca1-9e15-1cf6c3d93026 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:16.122121 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-c8f91799-dead-40cd-a647-4980ca786977 req-bd2b118f-0f70-4ca1-9e15-1cf6c3d93026 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:16.122904 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-c8f91799-dead-40cd-a647-4980ca786977 req-bd2b118f-0f70-4ca1-9e15-1cf6c3d93026 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:16.139046 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-c8f91799-dead-40cd-a647-4980ca786977 req-bd2b118f-0f70-4ca1-9e15-1cf6c3d93026 service nova] Creating event network-changed:d5d6bbd7-ea4a-404e-9fe1-10fff55175e0 for instance 5d33cfed-409f-4da3-9cdf-1b7a83d72532 on n-h1-850501-12 Sep 08 11:24:16.146256 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-c8f91799-dead-40cd-a647-4980ca786977 req-bd2b118f-0f70-4ca1-9e15-1cf6c3d93026 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071219 Sep 08 11:24:16.147359 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3261/6386] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:24:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:24:16.415395 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b57afaf3-ff07-407e-b972-896bf80dc5d4 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-979114019", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "b95afd19-ebd7-4da6-bf07-3e767ef18857"}], "key_name": "tempest-TestNetworkBasicOps-5337725", "security_groups": [{"name": "tempest-secgroup-smoke-619156639"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:24:16.642102 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-b57afaf3-ff07-407e-b972-896bf80dc5d4 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] validate_networks() for [('b95afd19-ebd7-4da6-bf07-3e767ef18857', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:24:16.884446 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-89434cf5-aa38-4827-97d8-af44eb36633a tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:24:16.885635 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-89434cf5-aa38-4827-97d8-af44eb36633a tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] [instance: 5d33cfed-409f-4da3-9cdf-1b7a83d72532] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:24:16.900840 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-89434cf5-aa38-4827-97d8-af44eb36633a tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:16.901510 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-89434cf5-aa38-4827-97d8-af44eb36633a tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:16.902033 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-89434cf5-aa38-4827-97d8-af44eb36633a tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:16.902851 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-89434cf5-aa38-4827-97d8-af44eb36633a tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:16.903397 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-89434cf5-aa38-4827-97d8-af44eb36633a tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:16.903916 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-89434cf5-aa38-4827-97d8-af44eb36633a tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:17.123253 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-89434cf5-aa38-4827-97d8-af44eb36633a tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1a8ff15d81430ab50eec828b55ce64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6536c0f9eb1745378692b21905d79e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:24:17.134181 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-89434cf5-aa38-4827-97d8-af44eb36633a tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] 10.222.0.27 "GET /compute/v2.1/servers/5d33cfed-409f-4da3-9cdf-1b7a83d72532" status: 200 len: 1315 microversion: 2.1 time: 0.254329 Sep 08 11:24:17.143907 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3262/6387] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:24:16 2022] GET /compute/v2.1/servers/5d33cfed-409f-4da3-9cdf-1b7a83d72532 => generated 1315 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:24:17.465916 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-b57afaf3-ff07-407e-b972-896bf80dc5d4 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:24:17.465916 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-b57afaf3-ff07-407e-b972-896bf80dc5d4 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:24:17.467113 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-b57afaf3-ff07-407e-b972-896bf80dc5d4 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:24:17.467113 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-b57afaf3-ff07-407e-b972-896bf80dc5d4 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:24:17.467113 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-b57afaf3-ff07-407e-b972-896bf80dc5d4 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:24:17.476695 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b57afaf3-ff07-407e-b972-896bf80dc5d4 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:17.477594 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b57afaf3-ff07-407e-b972-896bf80dc5d4 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:17.478057 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b57afaf3-ff07-407e-b972-896bf80dc5d4 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:17.478825 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b57afaf3-ff07-407e-b972-896bf80dc5d4 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:17.479299 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b57afaf3-ff07-407e-b972-896bf80dc5d4 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:17.479730 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b57afaf3-ff07-407e-b972-896bf80dc5d4 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:17.503080 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-b57afaf3-ff07-407e-b972-896bf80dc5d4 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Getting quotas for project 8f85ab8354294e359cabfca999283d5a. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:24:17.511016 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-b57afaf3-ff07-407e-b972-896bf80dc5d4 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Getting quotas for user 761124676b5e4a8db0bc59740c1f535e and project 8f85ab8354294e359cabfca999283d5a. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:24:17.526805 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b57afaf3-ff07-407e-b972-896bf80dc5d4 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:24:17.530303 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b57afaf3-ff07-407e-b972-896bf80dc5d4 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] [instance: 9a6f7017-293f-41a6-8df5-aea670d317de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:24:17.586032 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b57afaf3-ff07-407e-b972-896bf80dc5d4 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.174623 Sep 08 11:24:17.587128 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3126/6388] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 11:24:16 2022] POST /compute/v2.1/servers => generated 405 bytes in 1177 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:24:17.598476 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b7cbb4dc-39f6-4341-b760-4c670da07bc6 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:24:17.599114 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b7cbb4dc-39f6-4341-b760-4c670da07bc6 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] [instance: 9a6f7017-293f-41a6-8df5-aea670d317de] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:24:17.676985 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b7cbb4dc-39f6-4341-b760-4c670da07bc6 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761124676b5e4a8db0bc59740c1f535e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f85ab8354294e359cabfca999283d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:24:17.687912 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b7cbb4dc-39f6-4341-b760-4c670da07bc6 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] 10.222.0.27 "GET /compute/v2.1/servers/9a6f7017-293f-41a6-8df5-aea670d317de" status: 200 len: 1245 microversion: 2.1 time: 0.093274 Sep 08 11:24:17.688508 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3263/6389] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:24:17 2022] GET /compute/v2.1/servers/9a6f7017-293f-41a6-8df5-aea670d317de => generated 1245 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:24:18.158003 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7f11b755-ecfc-409f-9797-6694d5d43e5a tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:24:18.159688 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7f11b755-ecfc-409f-9797-6694d5d43e5a tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] [instance: 5d33cfed-409f-4da3-9cdf-1b7a83d72532] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:24:18.167616 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f11b755-ecfc-409f-9797-6694d5d43e5a tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:18.168691 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f11b755-ecfc-409f-9797-6694d5d43e5a tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:18.169622 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f11b755-ecfc-409f-9797-6694d5d43e5a tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:18.170682 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f11b755-ecfc-409f-9797-6694d5d43e5a tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:18.171318 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f11b755-ecfc-409f-9797-6694d5d43e5a tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:18.171961 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f11b755-ecfc-409f-9797-6694d5d43e5a tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:18.456605 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7f11b755-ecfc-409f-9797-6694d5d43e5a tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1a8ff15d81430ab50eec828b55ce64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6536c0f9eb1745378692b21905d79e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:24:18.464828 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7f11b755-ecfc-409f-9797-6694d5d43e5a tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] 10.222.0.27 "GET /compute/v2.1/servers/5d33cfed-409f-4da3-9cdf-1b7a83d72532" status: 200 len: 1315 microversion: 2.1 time: 0.310671 Sep 08 11:24:18.465449 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3127/6390] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:24:18 2022] GET /compute/v2.1/servers/5d33cfed-409f-4da3-9cdf-1b7a83d72532 => generated 1315 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:24:18.713934 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c3b41ce1-bcd6-4ca8-8e75-009565d4f8c9 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:24:18.714571 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c3b41ce1-bcd6-4ca8-8e75-009565d4f8c9 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] [instance: 9a6f7017-293f-41a6-8df5-aea670d317de] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:24:18.733529 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c3b41ce1-bcd6-4ca8-8e75-009565d4f8c9 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:18.734014 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c3b41ce1-bcd6-4ca8-8e75-009565d4f8c9 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:18.734453 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c3b41ce1-bcd6-4ca8-8e75-009565d4f8c9 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:18.735168 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c3b41ce1-bcd6-4ca8-8e75-009565d4f8c9 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:18.735625 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c3b41ce1-bcd6-4ca8-8e75-009565d4f8c9 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:18.736051 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c3b41ce1-bcd6-4ca8-8e75-009565d4f8c9 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:18.857127 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c3b41ce1-bcd6-4ca8-8e75-009565d4f8c9 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761124676b5e4a8db0bc59740c1f535e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f85ab8354294e359cabfca999283d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:24:18.865349 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c3b41ce1-bcd6-4ca8-8e75-009565d4f8c9 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] 10.222.0.27 "GET /compute/v2.1/servers/9a6f7017-293f-41a6-8df5-aea670d317de" status: 200 len: 1297 microversion: 2.1 time: 0.156918 Sep 08 11:24:18.866519 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3264/6391] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:24:18 2022] GET /compute/v2.1/servers/9a6f7017-293f-41a6-8df5-aea670d317de => generated 1297 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:24:19.489908 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d03b6a88-6899-49ff-bab6-c86434399209 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:24:19.491354 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d03b6a88-6899-49ff-bab6-c86434399209 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] [instance: 5d33cfed-409f-4da3-9cdf-1b7a83d72532] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:24:19.502500 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d03b6a88-6899-49ff-bab6-c86434399209 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:19.503438 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d03b6a88-6899-49ff-bab6-c86434399209 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:19.504064 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d03b6a88-6899-49ff-bab6-c86434399209 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:19.504958 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d03b6a88-6899-49ff-bab6-c86434399209 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:19.505604 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d03b6a88-6899-49ff-bab6-c86434399209 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:19.506203 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d03b6a88-6899-49ff-bab6-c86434399209 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:19.678830 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d03b6a88-6899-49ff-bab6-c86434399209 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1a8ff15d81430ab50eec828b55ce64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6536c0f9eb1745378692b21905d79e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:24:19.694490 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d03b6a88-6899-49ff-bab6-c86434399209 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] 10.222.0.27 "GET /compute/v2.1/servers/5d33cfed-409f-4da3-9cdf-1b7a83d72532" status: 200 len: 1315 microversion: 2.1 time: 0.209668 Sep 08 11:24:19.695337 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3128/6392] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:24:19 2022] GET /compute/v2.1/servers/5d33cfed-409f-4da3-9cdf-1b7a83d72532 => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:24:19.890382 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-06bcb201-30f5-459d-8afb-25a3e511f567 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:24:19.891790 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-06bcb201-30f5-459d-8afb-25a3e511f567 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] [instance: 9a6f7017-293f-41a6-8df5-aea670d317de] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:24:19.901304 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06bcb201-30f5-459d-8afb-25a3e511f567 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:19.902041 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06bcb201-30f5-459d-8afb-25a3e511f567 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:19.902880 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06bcb201-30f5-459d-8afb-25a3e511f567 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:19.903773 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06bcb201-30f5-459d-8afb-25a3e511f567 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:19.904583 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06bcb201-30f5-459d-8afb-25a3e511f567 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:19.905237 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06bcb201-30f5-459d-8afb-25a3e511f567 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:20.200155 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-06bcb201-30f5-459d-8afb-25a3e511f567 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761124676b5e4a8db0bc59740c1f535e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f85ab8354294e359cabfca999283d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:24:20.230014 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-06bcb201-30f5-459d-8afb-25a3e511f567 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] 10.222.0.27 "GET /compute/v2.1/servers/9a6f7017-293f-41a6-8df5-aea670d317de" status: 200 len: 1370 microversion: 2.1 time: 0.340029 Sep 08 11:24:20.230883 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3265/6393] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:24:19 2022] GET /compute/v2.1/servers/9a6f7017-293f-41a6-8df5-aea670d317de => generated 1370 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:24:20.718689 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-21c93892-5d5e-446e-bddb-de48b43a0e45 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:24:20.719251 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-21c93892-5d5e-446e-bddb-de48b43a0e45 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] [instance: 5d33cfed-409f-4da3-9cdf-1b7a83d72532] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:24:20.733785 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-21c93892-5d5e-446e-bddb-de48b43a0e45 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:20.734473 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-21c93892-5d5e-446e-bddb-de48b43a0e45 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:20.735202 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-21c93892-5d5e-446e-bddb-de48b43a0e45 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:20.737183 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-21c93892-5d5e-446e-bddb-de48b43a0e45 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:20.738386 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-21c93892-5d5e-446e-bddb-de48b43a0e45 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:20.739182 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-21c93892-5d5e-446e-bddb-de48b43a0e45 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:20.918617 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-21c93892-5d5e-446e-bddb-de48b43a0e45 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1a8ff15d81430ab50eec828b55ce64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6536c0f9eb1745378692b21905d79e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:24:20.928400 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-21c93892-5d5e-446e-bddb-de48b43a0e45 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] 10.222.0.27 "GET /compute/v2.1/servers/5d33cfed-409f-4da3-9cdf-1b7a83d72532" status: 200 len: 1315 microversion: 2.1 time: 0.213722 Sep 08 11:24:20.929379 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3129/6394] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:24:20 2022] GET /compute/v2.1/servers/5d33cfed-409f-4da3-9cdf-1b7a83d72532 => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:24:21.266275 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-500fb231-ff59-490a-bf85-5d741f5ac7d7 req-9488d420-612b-4bf0-a911-3099a65049ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a6f7017-293f-41a6-8df5-aea670d317de", "tag": "cc9328fc-985d-4dc1-80c7-60a8e0e47da0"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:24:21.267969 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-21a261ed-7b43-4660-9857-0432a7bbdbc5 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:24:21.268612 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-21a261ed-7b43-4660-9857-0432a7bbdbc5 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] [instance: 9a6f7017-293f-41a6-8df5-aea670d317de] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:24:21.281950 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-21a261ed-7b43-4660-9857-0432a7bbdbc5 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:21.282774 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-21a261ed-7b43-4660-9857-0432a7bbdbc5 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:21.283399 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-21a261ed-7b43-4660-9857-0432a7bbdbc5 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:21.284378 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-21a261ed-7b43-4660-9857-0432a7bbdbc5 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:21.285204 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-21a261ed-7b43-4660-9857-0432a7bbdbc5 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:21.285821 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-21a261ed-7b43-4660-9857-0432a7bbdbc5 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:21.296007 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-500fb231-ff59-490a-bf85-5d741f5ac7d7 req-9488d420-612b-4bf0-a911-3099a65049ad service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:21.296621 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-500fb231-ff59-490a-bf85-5d741f5ac7d7 req-9488d420-612b-4bf0-a911-3099a65049ad service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:21.296943 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-500fb231-ff59-490a-bf85-5d741f5ac7d7 req-9488d420-612b-4bf0-a911-3099a65049ad service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:21.312472 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-500fb231-ff59-490a-bf85-5d741f5ac7d7 req-9488d420-612b-4bf0-a911-3099a65049ad service nova] Creating event network-changed:cc9328fc-985d-4dc1-80c7-60a8e0e47da0 for instance 9a6f7017-293f-41a6-8df5-aea670d317de on n-h2-850501-12 Sep 08 11:24:21.318995 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-500fb231-ff59-490a-bf85-5d741f5ac7d7 req-9488d420-612b-4bf0-a911-3099a65049ad service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058172 Sep 08 11:24:21.320597 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3130/6395] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:24:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:24:21.608404 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:24:21.613855 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-21a261ed-7b43-4660-9857-0432a7bbdbc5 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761124676b5e4a8db0bc59740c1f535e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f85ab8354294e359cabfca999283d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:24:21.616470 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:24:21.630937 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-21a261ed-7b43-4660-9857-0432a7bbdbc5 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] 10.222.0.27 "GET /compute/v2.1/servers/9a6f7017-293f-41a6-8df5-aea670d317de" status: 200 len: 1370 microversion: 2.1 time: 0.379197 Sep 08 11:24:21.641193 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3266/6396] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:24:21 2022] GET /compute/v2.1/servers/9a6f7017-293f-41a6-8df5-aea670d317de => generated 1370 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:24:21.965179 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7ef6a87f-ecde-45d8-b485-4ce76fe8e77d tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:24:21.966156 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7ef6a87f-ecde-45d8-b485-4ce76fe8e77d tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] [instance: 5d33cfed-409f-4da3-9cdf-1b7a83d72532] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:24:21.970006 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:24:21.975103 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ef6a87f-ecde-45d8-b485-4ce76fe8e77d tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:21.975882 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ef6a87f-ecde-45d8-b485-4ce76fe8e77d tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:21.976333 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ef6a87f-ecde-45d8-b485-4ce76fe8e77d tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:21.977618 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ef6a87f-ecde-45d8-b485-4ce76fe8e77d tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:21.977916 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ef6a87f-ecde-45d8-b485-4ce76fe8e77d tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:21.978534 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ef6a87f-ecde-45d8-b485-4ce76fe8e77d tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:22.127408 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7ef6a87f-ecde-45d8-b485-4ce76fe8e77d tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1a8ff15d81430ab50eec828b55ce64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6536c0f9eb1745378692b21905d79e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:24:22.144652 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7ef6a87f-ecde-45d8-b485-4ce76fe8e77d tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] 10.222.0.27 "GET /compute/v2.1/servers/5d33cfed-409f-4da3-9cdf-1b7a83d72532" status: 200 len: 1315 microversion: 2.1 time: 0.188719 Sep 08 11:24:22.155790 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3131/6397] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:24:21 2022] GET /compute/v2.1/servers/5d33cfed-409f-4da3-9cdf-1b7a83d72532 => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:24:22.462272 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-c533ec7d-9602-40c4-a308-81bf501b3949 req-cb613575-9619-4019-9d8e-ac892aa06d2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d33cfed-409f-4da3-9cdf-1b7a83d72532", "name": "network-vif-plugged", "status": "completed", "tag": "d5d6bbd7-ea4a-404e-9fe1-10fff55175e0"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:24:22.467371 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:24:22.473235 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-c533ec7d-9602-40c4-a308-81bf501b3949 req-cb613575-9619-4019-9d8e-ac892aa06d2f service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:22.473795 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-c533ec7d-9602-40c4-a308-81bf501b3949 req-cb613575-9619-4019-9d8e-ac892aa06d2f service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:22.474298 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-c533ec7d-9602-40c4-a308-81bf501b3949 req-cb613575-9619-4019-9d8e-ac892aa06d2f service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:22.486395 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-c533ec7d-9602-40c4-a308-81bf501b3949 req-cb613575-9619-4019-9d8e-ac892aa06d2f service nova] Creating event network-vif-plugged:d5d6bbd7-ea4a-404e-9fe1-10fff55175e0 for instance 5d33cfed-409f-4da3-9cdf-1b7a83d72532 on n-h1-850501-12 Sep 08 11:24:22.491492 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-c533ec7d-9602-40c4-a308-81bf501b3949 req-cb613575-9619-4019-9d8e-ac892aa06d2f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.244293 Sep 08 11:24:22.492568 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3267/6398] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:24:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:24:22.656284 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-858e38bf-f8ac-457e-a400-5316eea96bff tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:24:22.657111 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-858e38bf-f8ac-457e-a400-5316eea96bff tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] [instance: 9a6f7017-293f-41a6-8df5-aea670d317de] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:24:22.663468 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-858e38bf-f8ac-457e-a400-5316eea96bff tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:22.663972 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-858e38bf-f8ac-457e-a400-5316eea96bff tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:22.664512 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-858e38bf-f8ac-457e-a400-5316eea96bff tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:22.665439 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-858e38bf-f8ac-457e-a400-5316eea96bff tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:22.665909 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-858e38bf-f8ac-457e-a400-5316eea96bff tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:22.666358 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-858e38bf-f8ac-457e-a400-5316eea96bff tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:22.824116 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-858e38bf-f8ac-457e-a400-5316eea96bff tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761124676b5e4a8db0bc59740c1f535e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f85ab8354294e359cabfca999283d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:24:22.833268 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-858e38bf-f8ac-457e-a400-5316eea96bff tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] 10.222.0.27 "GET /compute/v2.1/servers/9a6f7017-293f-41a6-8df5-aea670d317de" status: 200 len: 1370 microversion: 2.1 time: 0.182406 Sep 08 11:24:22.834364 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3132/6399] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:24:22 2022] GET /compute/v2.1/servers/9a6f7017-293f-41a6-8df5-aea670d317de => generated 1370 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:24:23.175178 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2c234a35-0ec8-46e2-92b8-3a47bfeec3c9 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:24:23.176306 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2c234a35-0ec8-46e2-92b8-3a47bfeec3c9 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] [instance: 5d33cfed-409f-4da3-9cdf-1b7a83d72532] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:24:23.187661 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2c234a35-0ec8-46e2-92b8-3a47bfeec3c9 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:23.188346 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2c234a35-0ec8-46e2-92b8-3a47bfeec3c9 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:23.188865 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2c234a35-0ec8-46e2-92b8-3a47bfeec3c9 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:23.190173 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2c234a35-0ec8-46e2-92b8-3a47bfeec3c9 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:23.190173 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2c234a35-0ec8-46e2-92b8-3a47bfeec3c9 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:23.190797 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2c234a35-0ec8-46e2-92b8-3a47bfeec3c9 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:23.458187 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2c234a35-0ec8-46e2-92b8-3a47bfeec3c9 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1a8ff15d81430ab50eec828b55ce64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6536c0f9eb1745378692b21905d79e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:24:23.467797 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2c234a35-0ec8-46e2-92b8-3a47bfeec3c9 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] 10.222.0.27 "GET /compute/v2.1/servers/5d33cfed-409f-4da3-9cdf-1b7a83d72532" status: 200 len: 1315 microversion: 2.1 time: 0.300640 Sep 08 11:24:23.493039 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3268/6400] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:24:23 2022] GET /compute/v2.1/servers/5d33cfed-409f-4da3-9cdf-1b7a83d72532 => generated 1315 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:24:23.858531 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-035a774f-8b5b-44f1-9072-91664e192c6b tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:24:23.859120 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-035a774f-8b5b-44f1-9072-91664e192c6b tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] [instance: 9a6f7017-293f-41a6-8df5-aea670d317de] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:24:23.866826 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-035a774f-8b5b-44f1-9072-91664e192c6b tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:23.867248 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-035a774f-8b5b-44f1-9072-91664e192c6b tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:23.868328 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-035a774f-8b5b-44f1-9072-91664e192c6b tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:23.869088 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-035a774f-8b5b-44f1-9072-91664e192c6b tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:23.869545 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-035a774f-8b5b-44f1-9072-91664e192c6b tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:23.869970 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-035a774f-8b5b-44f1-9072-91664e192c6b tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:24.018804 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-035a774f-8b5b-44f1-9072-91664e192c6b tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761124676b5e4a8db0bc59740c1f535e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f85ab8354294e359cabfca999283d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:24:24.026915 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-035a774f-8b5b-44f1-9072-91664e192c6b tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] 10.222.0.27 "GET /compute/v2.1/servers/9a6f7017-293f-41a6-8df5-aea670d317de" status: 200 len: 1370 microversion: 2.1 time: 0.173464 Sep 08 11:24:24.027509 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3133/6401] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:24:23 2022] GET /compute/v2.1/servers/9a6f7017-293f-41a6-8df5-aea670d317de => generated 1370 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:24:24.491236 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2c9d3295-6e78-4508-b3f3-b22d32485faa tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:24:24.491834 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2c9d3295-6e78-4508-b3f3-b22d32485faa tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] [instance: 5d33cfed-409f-4da3-9cdf-1b7a83d72532] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:24:24.498676 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2c9d3295-6e78-4508-b3f3-b22d32485faa tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:24.499172 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2c9d3295-6e78-4508-b3f3-b22d32485faa tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:24.499672 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2c9d3295-6e78-4508-b3f3-b22d32485faa tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:24.500380 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2c9d3295-6e78-4508-b3f3-b22d32485faa tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:24.500839 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2c9d3295-6e78-4508-b3f3-b22d32485faa tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:24.501298 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2c9d3295-6e78-4508-b3f3-b22d32485faa tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:24.648690 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2c9d3295-6e78-4508-b3f3-b22d32485faa tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1a8ff15d81430ab50eec828b55ce64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6536c0f9eb1745378692b21905d79e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:24:24.657701 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2c9d3295-6e78-4508-b3f3-b22d32485faa tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] 10.222.0.27 "GET /compute/v2.1/servers/5d33cfed-409f-4da3-9cdf-1b7a83d72532" status: 200 len: 1502 microversion: 2.1 time: 0.170320 Sep 08 11:24:24.658294 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3269/6402] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:24:24 2022] GET /compute/v2.1/servers/5d33cfed-409f-4da3-9cdf-1b7a83d72532 => generated 1502 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:24:24.681117 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-63eb470c-8252-424f-bf21-f433a6a8c872 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:24:24.682012 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-63eb470c-8252-424f-bf21-f433a6a8c872 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] [instance: 5d33cfed-409f-4da3-9cdf-1b7a83d72532] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:24:24.688910 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63eb470c-8252-424f-bf21-f433a6a8c872 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:24.690284 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63eb470c-8252-424f-bf21-f433a6a8c872 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:24.690737 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63eb470c-8252-424f-bf21-f433a6a8c872 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:24.691837 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63eb470c-8252-424f-bf21-f433a6a8c872 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:24.692521 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63eb470c-8252-424f-bf21-f433a6a8c872 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:24.692967 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63eb470c-8252-424f-bf21-f433a6a8c872 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:24.838689 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-63eb470c-8252-424f-bf21-f433a6a8c872 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1a8ff15d81430ab50eec828b55ce64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6536c0f9eb1745378692b21905d79e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:24:24.847315 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-63eb470c-8252-424f-bf21-f433a6a8c872 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] 10.222.0.27 "GET /compute/v2.1/servers/5d33cfed-409f-4da3-9cdf-1b7a83d72532" status: 200 len: 1502 microversion: 2.1 time: 0.170423 Sep 08 11:24:24.847920 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3134/6403] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:24:24 2022] GET /compute/v2.1/servers/5d33cfed-409f-4da3-9cdf-1b7a83d72532 => generated 1502 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:24:24.871257 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5ea8c7e7-adf2-47ad-ae57-9cce02d08955 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:24:24.871980 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5ea8c7e7-adf2-47ad-ae57-9cce02d08955 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] [instance: 5d33cfed-409f-4da3-9cdf-1b7a83d72532] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:24:24.879042 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5ea8c7e7-adf2-47ad-ae57-9cce02d08955 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:24.879919 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5ea8c7e7-adf2-47ad-ae57-9cce02d08955 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:24.880392 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5ea8c7e7-adf2-47ad-ae57-9cce02d08955 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:24.881266 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5ea8c7e7-adf2-47ad-ae57-9cce02d08955 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:24.881833 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5ea8c7e7-adf2-47ad-ae57-9cce02d08955 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:24.882869 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5ea8c7e7-adf2-47ad-ae57-9cce02d08955 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:24.908777 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-5ea8c7e7-adf2-47ad-ae57-9cce02d08955 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lazy-loading 'flavor' on Instance uuid 5d33cfed-409f-4da3-9cdf-1b7a83d72532 {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:24:24.977273 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5ea8c7e7-adf2-47ad-ae57-9cce02d08955 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] 10.222.0.27 "POST /compute/v2.1/servers/5d33cfed-409f-4da3-9cdf-1b7a83d72532/action" status: 202 len: 0 microversion: 2.1 time: 0.111076 Sep 08 11:24:24.980915 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3270/6404] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 11:24:24 2022] POST /compute/v2.1/servers/5d33cfed-409f-4da3-9cdf-1b7a83d72532/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:24:24.986962 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c2270b2e-3b80-4650-9599-7faf9b8ab6a3 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:24:24.987591 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c2270b2e-3b80-4650-9599-7faf9b8ab6a3 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] [instance: 5d33cfed-409f-4da3-9cdf-1b7a83d72532] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:24:24.995152 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2270b2e-3b80-4650-9599-7faf9b8ab6a3 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:24.995605 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2270b2e-3b80-4650-9599-7faf9b8ab6a3 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:24.996051 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2270b2e-3b80-4650-9599-7faf9b8ab6a3 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:24.996907 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2270b2e-3b80-4650-9599-7faf9b8ab6a3 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:24.997626 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2270b2e-3b80-4650-9599-7faf9b8ab6a3 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:24.998206 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2270b2e-3b80-4650-9599-7faf9b8ab6a3 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:25.059426 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bd826731-4c12-45a6-8b0f-9fa2a59e9cb6 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:24:25.061083 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bd826731-4c12-45a6-8b0f-9fa2a59e9cb6 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] [instance: 9a6f7017-293f-41a6-8df5-aea670d317de] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:24:25.075644 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bd826731-4c12-45a6-8b0f-9fa2a59e9cb6 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:25.076693 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bd826731-4c12-45a6-8b0f-9fa2a59e9cb6 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:25.077236 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bd826731-4c12-45a6-8b0f-9fa2a59e9cb6 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:25.078116 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bd826731-4c12-45a6-8b0f-9fa2a59e9cb6 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:25.079197 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bd826731-4c12-45a6-8b0f-9fa2a59e9cb6 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:25.079899 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bd826731-4c12-45a6-8b0f-9fa2a59e9cb6 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:25.220594 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c2270b2e-3b80-4650-9599-7faf9b8ab6a3 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1a8ff15d81430ab50eec828b55ce64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6536c0f9eb1745378692b21905d79e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:24:25.232632 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c2270b2e-3b80-4650-9599-7faf9b8ab6a3 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] 10.222.0.27 "GET /compute/v2.1/servers/5d33cfed-409f-4da3-9cdf-1b7a83d72532" status: 200 len: 1510 microversion: 2.1 time: 0.250183 Sep 08 11:24:25.233643 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3135/6405] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:24:24 2022] GET /compute/v2.1/servers/5d33cfed-409f-4da3-9cdf-1b7a83d72532 => generated 1510 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:24:25.298637 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-bd826731-4c12-45a6-8b0f-9fa2a59e9cb6 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761124676b5e4a8db0bc59740c1f535e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f85ab8354294e359cabfca999283d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:24:25.310956 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bd826731-4c12-45a6-8b0f-9fa2a59e9cb6 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] 10.222.0.27 "GET /compute/v2.1/servers/9a6f7017-293f-41a6-8df5-aea670d317de" status: 200 len: 1370 microversion: 2.1 time: 0.262118 Sep 08 11:24:25.311618 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3271/6406] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:24:25 2022] GET /compute/v2.1/servers/9a6f7017-293f-41a6-8df5-aea670d317de => generated 1370 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:24:26.263738 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ad47b65d-3405-4f2b-805d-873ecf7e2d96 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:24:26.265003 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ad47b65d-3405-4f2b-805d-873ecf7e2d96 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] [instance: 5d33cfed-409f-4da3-9cdf-1b7a83d72532] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:24:26.272175 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad47b65d-3405-4f2b-805d-873ecf7e2d96 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:26.272664 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad47b65d-3405-4f2b-805d-873ecf7e2d96 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:26.273128 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad47b65d-3405-4f2b-805d-873ecf7e2d96 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:26.273987 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad47b65d-3405-4f2b-805d-873ecf7e2d96 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:26.274539 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad47b65d-3405-4f2b-805d-873ecf7e2d96 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:26.274974 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad47b65d-3405-4f2b-805d-873ecf7e2d96 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:26.340998 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1190a0ad-9e7f-4b9d-aa97-2e1e952bf7f5 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:24:26.342099 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1190a0ad-9e7f-4b9d-aa97-2e1e952bf7f5 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] [instance: 9a6f7017-293f-41a6-8df5-aea670d317de] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:24:26.356978 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1190a0ad-9e7f-4b9d-aa97-2e1e952bf7f5 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:26.357700 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1190a0ad-9e7f-4b9d-aa97-2e1e952bf7f5 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:26.358248 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1190a0ad-9e7f-4b9d-aa97-2e1e952bf7f5 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:26.359049 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1190a0ad-9e7f-4b9d-aa97-2e1e952bf7f5 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:26.359608 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1190a0ad-9e7f-4b9d-aa97-2e1e952bf7f5 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:26.360134 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1190a0ad-9e7f-4b9d-aa97-2e1e952bf7f5 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:26.449521 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ad47b65d-3405-4f2b-805d-873ecf7e2d96 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1a8ff15d81430ab50eec828b55ce64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6536c0f9eb1745378692b21905d79e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:24:26.458424 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ad47b65d-3405-4f2b-805d-873ecf7e2d96 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] 10.222.0.27 "GET /compute/v2.1/servers/5d33cfed-409f-4da3-9cdf-1b7a83d72532" status: 200 len: 1493 microversion: 2.1 time: 0.198613 Sep 08 11:24:26.459016 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3136/6407] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:24:26 2022] GET /compute/v2.1/servers/5d33cfed-409f-4da3-9cdf-1b7a83d72532 => generated 1493 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:24:26.464873 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-907c4804-8352-4b3e-8f2d-ae390c41c4b8 req-af76b91c-ae0d-4f5d-9143-33dd151e82b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a6f7017-293f-41a6-8df5-aea670d317de", "name": "network-vif-plugged", "status": "completed", "tag": "cc9328fc-985d-4dc1-80c7-60a8e0e47da0"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:24:26.475498 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-907c4804-8352-4b3e-8f2d-ae390c41c4b8 req-af76b91c-ae0d-4f5d-9143-33dd151e82b3 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:26.476171 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-907c4804-8352-4b3e-8f2d-ae390c41c4b8 req-af76b91c-ae0d-4f5d-9143-33dd151e82b3 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:26.476793 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-907c4804-8352-4b3e-8f2d-ae390c41c4b8 req-af76b91c-ae0d-4f5d-9143-33dd151e82b3 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:26.490682 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-907c4804-8352-4b3e-8f2d-ae390c41c4b8 req-af76b91c-ae0d-4f5d-9143-33dd151e82b3 service nova] Creating event network-vif-plugged:cc9328fc-985d-4dc1-80c7-60a8e0e47da0 for instance 9a6f7017-293f-41a6-8df5-aea670d317de on n-h2-850501-12 Sep 08 11:24:26.497711 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-907c4804-8352-4b3e-8f2d-ae390c41c4b8 req-af76b91c-ae0d-4f5d-9143-33dd151e82b3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037303 Sep 08 11:24:26.501409 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3137/6408] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:24:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:24:26.507111 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-33e77c88-8aa7-4eb3-a5cd-1c0f2af5cb98 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:24:26.507744 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-33e77c88-8aa7-4eb3-a5cd-1c0f2af5cb98 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] [instance: 5d33cfed-409f-4da3-9cdf-1b7a83d72532] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:24:26.515844 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33e77c88-8aa7-4eb3-a5cd-1c0f2af5cb98 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:26.516578 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33e77c88-8aa7-4eb3-a5cd-1c0f2af5cb98 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:26.517016 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33e77c88-8aa7-4eb3-a5cd-1c0f2af5cb98 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:26.517742 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33e77c88-8aa7-4eb3-a5cd-1c0f2af5cb98 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:26.518198 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33e77c88-8aa7-4eb3-a5cd-1c0f2af5cb98 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:26.518626 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33e77c88-8aa7-4eb3-a5cd-1c0f2af5cb98 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:26.529522 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1190a0ad-9e7f-4b9d-aa97-2e1e952bf7f5 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761124676b5e4a8db0bc59740c1f535e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f85ab8354294e359cabfca999283d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:24:26.539154 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1190a0ad-9e7f-4b9d-aa97-2e1e952bf7f5 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] 10.222.0.27 "GET /compute/v2.1/servers/9a6f7017-293f-41a6-8df5-aea670d317de" status: 200 len: 1370 microversion: 2.1 time: 0.203401 Sep 08 11:24:26.540585 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3272/6409] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:24:26 2022] GET /compute/v2.1/servers/9a6f7017-293f-41a6-8df5-aea670d317de => generated 1370 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:24:26.599408 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-33e77c88-8aa7-4eb3-a5cd-1c0f2af5cb98 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] 10.222.0.27 "POST /compute/v2.1/servers/5d33cfed-409f-4da3-9cdf-1b7a83d72532/action" status: 202 len: 0 microversion: 2.1 time: 0.096412 Sep 08 11:24:26.600331 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3138/6410] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 11:24:26 2022] POST /compute/v2.1/servers/5d33cfed-409f-4da3-9cdf-1b7a83d72532/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:24:26.609192 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a9feb084-079b-4c41-9666-081443a1d34a tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:24:26.609989 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a9feb084-079b-4c41-9666-081443a1d34a tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] [instance: 5d33cfed-409f-4da3-9cdf-1b7a83d72532] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:24:26.616984 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a9feb084-079b-4c41-9666-081443a1d34a tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:26.618430 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a9feb084-079b-4c41-9666-081443a1d34a tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:26.619100 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a9feb084-079b-4c41-9666-081443a1d34a tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:26.620080 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a9feb084-079b-4c41-9666-081443a1d34a tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:26.620620 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a9feb084-079b-4c41-9666-081443a1d34a tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:26.621172 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a9feb084-079b-4c41-9666-081443a1d34a tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:26.820392 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a9feb084-079b-4c41-9666-081443a1d34a tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1a8ff15d81430ab50eec828b55ce64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6536c0f9eb1745378692b21905d79e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:24:26.833940 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a9feb084-079b-4c41-9666-081443a1d34a tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] 10.222.0.27 "GET /compute/v2.1/servers/5d33cfed-409f-4da3-9cdf-1b7a83d72532" status: 200 len: 1499 microversion: 2.1 time: 0.229007 Sep 08 11:24:26.834727 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3273/6411] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:24:26 2022] GET /compute/v2.1/servers/5d33cfed-409f-4da3-9cdf-1b7a83d72532 => generated 1499 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:24:27.566410 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:24:27.568199 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=8 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:24:27.578306 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-24c2aa30-1ae8-4861-9406-a426d9ccb338 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:24:27.580116 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-24c2aa30-1ae8-4861-9406-a426d9ccb338 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] [instance: 9a6f7017-293f-41a6-8df5-aea670d317de] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:24:27.590187 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-24c2aa30-1ae8-4861-9406-a426d9ccb338 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:27.590773 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-24c2aa30-1ae8-4861-9406-a426d9ccb338 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:27.591275 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-24c2aa30-1ae8-4861-9406-a426d9ccb338 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:27.592264 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-24c2aa30-1ae8-4861-9406-a426d9ccb338 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:27.592867 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-24c2aa30-1ae8-4861-9406-a426d9ccb338 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:27.593394 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-24c2aa30-1ae8-4861-9406-a426d9ccb338 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:27.755979 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-24c2aa30-1ae8-4861-9406-a426d9ccb338 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761124676b5e4a8db0bc59740c1f535e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f85ab8354294e359cabfca999283d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:24:27.766400 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-24c2aa30-1ae8-4861-9406-a426d9ccb338 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] 10.222.0.27 "GET /compute/v2.1/servers/9a6f7017-293f-41a6-8df5-aea670d317de" status: 200 len: 1370 microversion: 2.1 time: 0.203448 Sep 08 11:24:27.766931 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3139/6412] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:24:27 2022] GET /compute/v2.1/servers/9a6f7017-293f-41a6-8df5-aea670d317de => generated 1370 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:24:27.860295 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5dd06e70-5b79-409e-854a-31635c8ccdcf tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:24:27.861466 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5dd06e70-5b79-409e-854a-31635c8ccdcf tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] [instance: 5d33cfed-409f-4da3-9cdf-1b7a83d72532] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:24:27.864494 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=12 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:24:27.872086 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5dd06e70-5b79-409e-854a-31635c8ccdcf tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:27.872586 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5dd06e70-5b79-409e-854a-31635c8ccdcf tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:27.873293 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5dd06e70-5b79-409e-854a-31635c8ccdcf tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:27.874231 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5dd06e70-5b79-409e-854a-31635c8ccdcf tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:27.874867 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5dd06e70-5b79-409e-854a-31635c8ccdcf tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:27.875467 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5dd06e70-5b79-409e-854a-31635c8ccdcf tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:28.101555 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5dd06e70-5b79-409e-854a-31635c8ccdcf tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1a8ff15d81430ab50eec828b55ce64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6536c0f9eb1745378692b21905d79e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:24:28.110765 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5dd06e70-5b79-409e-854a-31635c8ccdcf tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] 10.222.0.27 "GET /compute/v2.1/servers/5d33cfed-409f-4da3-9cdf-1b7a83d72532" status: 200 len: 1499 microversion: 2.1 time: 0.255284 Sep 08 11:24:28.111677 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3274/6413] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:24:27 2022] GET /compute/v2.1/servers/5d33cfed-409f-4da3-9cdf-1b7a83d72532 => generated 1499 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:24:28.804346 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-45bb7bff-01c7-4499-9ec4-49b6bccd76ea tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:24:28.805838 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-45bb7bff-01c7-4499-9ec4-49b6bccd76ea tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] [instance: 9a6f7017-293f-41a6-8df5-aea670d317de] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:24:28.813623 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-45bb7bff-01c7-4499-9ec4-49b6bccd76ea tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:28.814114 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-45bb7bff-01c7-4499-9ec4-49b6bccd76ea tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:28.814728 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-45bb7bff-01c7-4499-9ec4-49b6bccd76ea tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:28.815572 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-45bb7bff-01c7-4499-9ec4-49b6bccd76ea tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:28.816035 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-45bb7bff-01c7-4499-9ec4-49b6bccd76ea tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:28.816457 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-45bb7bff-01c7-4499-9ec4-49b6bccd76ea tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:28.956102 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-45bb7bff-01c7-4499-9ec4-49b6bccd76ea tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761124676b5e4a8db0bc59740c1f535e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f85ab8354294e359cabfca999283d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:24:28.964312 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-45bb7bff-01c7-4499-9ec4-49b6bccd76ea tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] 10.222.0.27 "GET /compute/v2.1/servers/9a6f7017-293f-41a6-8df5-aea670d317de" status: 200 len: 1542 microversion: 2.1 time: 0.164033 Sep 08 11:24:28.964896 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3140/6414] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:24:28 2022] GET /compute/v2.1/servers/9a6f7017-293f-41a6-8df5-aea670d317de => generated 1542 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:24:28.987193 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b0445489-1759-4225-bb06-e31a10a60575 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:24:28.987817 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b0445489-1759-4225-bb06-e31a10a60575 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] [instance: 9a6f7017-293f-41a6-8df5-aea670d317de] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:24:28.995733 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b0445489-1759-4225-bb06-e31a10a60575 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:28.996247 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b0445489-1759-4225-bb06-e31a10a60575 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:28.996693 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b0445489-1759-4225-bb06-e31a10a60575 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:28.997428 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b0445489-1759-4225-bb06-e31a10a60575 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:28.997894 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b0445489-1759-4225-bb06-e31a10a60575 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:28.998529 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b0445489-1759-4225-bb06-e31a10a60575 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:29.135724 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e25b4bb4-1e3f-45d0-956a-ec9a08b004f5 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:24:29.136333 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e25b4bb4-1e3f-45d0-956a-ec9a08b004f5 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] [instance: 5d33cfed-409f-4da3-9cdf-1b7a83d72532] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:24:29.142518 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e25b4bb4-1e3f-45d0-956a-ec9a08b004f5 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:29.142981 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e25b4bb4-1e3f-45d0-956a-ec9a08b004f5 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:29.143429 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e25b4bb4-1e3f-45d0-956a-ec9a08b004f5 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:29.144149 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e25b4bb4-1e3f-45d0-956a-ec9a08b004f5 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:29.144795 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e25b4bb4-1e3f-45d0-956a-ec9a08b004f5 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:29.145463 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e25b4bb4-1e3f-45d0-956a-ec9a08b004f5 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:29.145638 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b0445489-1759-4225-bb06-e31a10a60575 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761124676b5e4a8db0bc59740c1f535e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f85ab8354294e359cabfca999283d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:24:29.154178 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b0445489-1759-4225-bb06-e31a10a60575 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] 10.222.0.27 "GET /compute/v2.1/servers/9a6f7017-293f-41a6-8df5-aea670d317de" status: 200 len: 1542 microversion: 2.1 time: 0.170771 Sep 08 11:24:29.154762 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3275/6415] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:24:28 2022] GET /compute/v2.1/servers/9a6f7017-293f-41a6-8df5-aea670d317de => generated 1542 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:24:29.166579 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:24:29.323108 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e25b4bb4-1e3f-45d0-956a-ec9a08b004f5 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1a8ff15d81430ab50eec828b55ce64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6536c0f9eb1745378692b21905d79e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:24:29.331411 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e25b4bb4-1e3f-45d0-956a-ec9a08b004f5 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] 10.222.0.27 "GET /compute/v2.1/servers/5d33cfed-409f-4da3-9cdf-1b7a83d72532" status: 200 len: 1502 microversion: 2.1 time: 0.200177 Sep 08 11:24:29.333080 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3141/6416] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:24:29 2022] GET /compute/v2.1/servers/5d33cfed-409f-4da3-9cdf-1b7a83d72532 => generated 1502 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:24:29.355768 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d85b4fa3-5bf9-49ee-8138-fca4a071d30c tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:24:29.356315 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d85b4fa3-5bf9-49ee-8138-fca4a071d30c tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] [instance: 5d33cfed-409f-4da3-9cdf-1b7a83d72532] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:24:29.362436 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d85b4fa3-5bf9-49ee-8138-fca4a071d30c tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:29.362934 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d85b4fa3-5bf9-49ee-8138-fca4a071d30c tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:29.363368 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d85b4fa3-5bf9-49ee-8138-fca4a071d30c tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:29.364074 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d85b4fa3-5bf9-49ee-8138-fca4a071d30c tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:29.364704 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d85b4fa3-5bf9-49ee-8138-fca4a071d30c tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:29.365322 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d85b4fa3-5bf9-49ee-8138-fca4a071d30c tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:29.392522 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-d85b4fa3-5bf9-49ee-8138-fca4a071d30c tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lazy-loading 'flavor' on Instance uuid 5d33cfed-409f-4da3-9cdf-1b7a83d72532 {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:24:29.478187 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d85b4fa3-5bf9-49ee-8138-fca4a071d30c tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] 10.222.0.27 "POST /compute/v2.1/servers/5d33cfed-409f-4da3-9cdf-1b7a83d72532/action" status: 202 len: 0 microversion: 2.1 time: 0.126319 Sep 08 11:24:29.479041 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3276/6417] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 11:24:29 2022] POST /compute/v2.1/servers/5d33cfed-409f-4da3-9cdf-1b7a83d72532/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:24:29.496364 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-60431908-5096-4741-aa48-2f54b638c214 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:24:29.497203 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-60431908-5096-4741-aa48-2f54b638c214 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] [instance: 5d33cfed-409f-4da3-9cdf-1b7a83d72532] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:24:29.506479 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-60431908-5096-4741-aa48-2f54b638c214 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:29.507485 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-60431908-5096-4741-aa48-2f54b638c214 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:29.508906 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-60431908-5096-4741-aa48-2f54b638c214 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:29.510741 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-60431908-5096-4741-aa48-2f54b638c214 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:29.511623 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-60431908-5096-4741-aa48-2f54b638c214 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:29.513570 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-60431908-5096-4741-aa48-2f54b638c214 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:29.736746 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-60431908-5096-4741-aa48-2f54b638c214 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1a8ff15d81430ab50eec828b55ce64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6536c0f9eb1745378692b21905d79e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:24:29.753164 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-60431908-5096-4741-aa48-2f54b638c214 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] 10.222.0.27 "GET /compute/v2.1/servers/5d33cfed-409f-4da3-9cdf-1b7a83d72532" status: 200 len: 1510 microversion: 2.1 time: 0.269997 Sep 08 11:24:29.753959 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3142/6418] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:24:29 2022] GET /compute/v2.1/servers/5d33cfed-409f-4da3-9cdf-1b7a83d72532 => generated 1510 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:24:30.781919 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7966c9f3-54e0-4d52-b964-87a2e602a0da tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:24:30.783070 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7966c9f3-54e0-4d52-b964-87a2e602a0da tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] [instance: 5d33cfed-409f-4da3-9cdf-1b7a83d72532] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:24:30.793833 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7966c9f3-54e0-4d52-b964-87a2e602a0da tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:30.795321 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7966c9f3-54e0-4d52-b964-87a2e602a0da tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:30.796295 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7966c9f3-54e0-4d52-b964-87a2e602a0da tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:30.797801 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7966c9f3-54e0-4d52-b964-87a2e602a0da tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:30.798924 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7966c9f3-54e0-4d52-b964-87a2e602a0da tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:30.799375 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7966c9f3-54e0-4d52-b964-87a2e602a0da tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:31.039056 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7966c9f3-54e0-4d52-b964-87a2e602a0da tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1a8ff15d81430ab50eec828b55ce64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6536c0f9eb1745378692b21905d79e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:24:31.048828 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7966c9f3-54e0-4d52-b964-87a2e602a0da tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] 10.222.0.27 "GET /compute/v2.1/servers/5d33cfed-409f-4da3-9cdf-1b7a83d72532" status: 200 len: 1493 microversion: 2.1 time: 0.273412 Sep 08 11:24:31.050360 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3277/6419] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:24:30 2022] GET /compute/v2.1/servers/5d33cfed-409f-4da3-9cdf-1b7a83d72532 => generated 1493 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:24:31.081753 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-53384669-a653-4a79-82c7-46db91d64cf5 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:24:31.082974 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-53384669-a653-4a79-82c7-46db91d64cf5 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] [instance: 5d33cfed-409f-4da3-9cdf-1b7a83d72532] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:24:31.090612 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53384669-a653-4a79-82c7-46db91d64cf5 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:31.091113 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53384669-a653-4a79-82c7-46db91d64cf5 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:31.091863 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53384669-a653-4a79-82c7-46db91d64cf5 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:31.092570 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53384669-a653-4a79-82c7-46db91d64cf5 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:31.093019 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53384669-a653-4a79-82c7-46db91d64cf5 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:31.093679 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53384669-a653-4a79-82c7-46db91d64cf5 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:31.198712 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-53384669-a653-4a79-82c7-46db91d64cf5 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] 10.222.0.27 "POST /compute/v2.1/servers/5d33cfed-409f-4da3-9cdf-1b7a83d72532/action" status: 202 len: 0 microversion: 2.1 time: 0.121044 Sep 08 11:24:31.200290 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3143/6420] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 11:24:31 2022] POST /compute/v2.1/servers/5d33cfed-409f-4da3-9cdf-1b7a83d72532/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:24:31.210493 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-86087c6b-3974-4cd8-9d43-9196bb0cb276 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:24:31.211789 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-86087c6b-3974-4cd8-9d43-9196bb0cb276 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] [instance: 5d33cfed-409f-4da3-9cdf-1b7a83d72532] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:24:31.219880 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-86087c6b-3974-4cd8-9d43-9196bb0cb276 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:31.220610 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-86087c6b-3974-4cd8-9d43-9196bb0cb276 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:31.221382 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-86087c6b-3974-4cd8-9d43-9196bb0cb276 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:31.222603 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-86087c6b-3974-4cd8-9d43-9196bb0cb276 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:31.223083 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-86087c6b-3974-4cd8-9d43-9196bb0cb276 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:31.223894 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-86087c6b-3974-4cd8-9d43-9196bb0cb276 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:31.410112 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-72c9718b-e865-4646-843a-5ae1d39ec56e req-44bbc679-8f87-44fa-9beb-8cec0d2dd175 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a6f7017-293f-41a6-8df5-aea670d317de", "tag": "cc9328fc-985d-4dc1-80c7-60a8e0e47da0"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:24:31.423943 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-72c9718b-e865-4646-843a-5ae1d39ec56e req-44bbc679-8f87-44fa-9beb-8cec0d2dd175 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:31.424939 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-72c9718b-e865-4646-843a-5ae1d39ec56e req-44bbc679-8f87-44fa-9beb-8cec0d2dd175 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:31.426809 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-72c9718b-e865-4646-843a-5ae1d39ec56e req-44bbc679-8f87-44fa-9beb-8cec0d2dd175 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:31.453970 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-72c9718b-e865-4646-843a-5ae1d39ec56e req-44bbc679-8f87-44fa-9beb-8cec0d2dd175 service nova] Creating event network-changed:cc9328fc-985d-4dc1-80c7-60a8e0e47da0 for instance 9a6f7017-293f-41a6-8df5-aea670d317de on n-h2-850501-12 Sep 08 11:24:31.465180 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-72c9718b-e865-4646-843a-5ae1d39ec56e req-44bbc679-8f87-44fa-9beb-8cec0d2dd175 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066571 Sep 08 11:24:31.467492 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3144/6421] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:24:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:24:31.558896 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-86087c6b-3974-4cd8-9d43-9196bb0cb276 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1a8ff15d81430ab50eec828b55ce64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6536c0f9eb1745378692b21905d79e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:24:31.573717 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-86087c6b-3974-4cd8-9d43-9196bb0cb276 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] 10.222.0.27 "GET /compute/v2.1/servers/5d33cfed-409f-4da3-9cdf-1b7a83d72532" status: 200 len: 1499 microversion: 2.1 time: 0.368148 Sep 08 11:24:31.574948 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3278/6422] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:24:31 2022] GET /compute/v2.1/servers/5d33cfed-409f-4da3-9cdf-1b7a83d72532 => generated 1499 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:24:32.599874 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d4a3c4e8-4ce5-4197-969f-74b5ff231439 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:24:32.601362 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d4a3c4e8-4ce5-4197-969f-74b5ff231439 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] [instance: 5d33cfed-409f-4da3-9cdf-1b7a83d72532] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:24:32.613169 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d4a3c4e8-4ce5-4197-969f-74b5ff231439 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:32.613748 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d4a3c4e8-4ce5-4197-969f-74b5ff231439 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:32.614254 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d4a3c4e8-4ce5-4197-969f-74b5ff231439 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:32.615180 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d4a3c4e8-4ce5-4197-969f-74b5ff231439 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:32.616073 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d4a3c4e8-4ce5-4197-969f-74b5ff231439 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:32.616714 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d4a3c4e8-4ce5-4197-969f-74b5ff231439 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:32.790519 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d4a3c4e8-4ce5-4197-969f-74b5ff231439 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1a8ff15d81430ab50eec828b55ce64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6536c0f9eb1745378692b21905d79e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:24:32.800447 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d4a3c4e8-4ce5-4197-969f-74b5ff231439 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] 10.222.0.27 "GET /compute/v2.1/servers/5d33cfed-409f-4da3-9cdf-1b7a83d72532" status: 200 len: 1499 microversion: 2.1 time: 0.206359 Sep 08 11:24:32.805091 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3145/6423] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:24:32 2022] GET /compute/v2.1/servers/5d33cfed-409f-4da3-9cdf-1b7a83d72532 => generated 1499 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:24:33.823733 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e625bcb6-cb8d-45ad-b9a9-535cdc1498c5 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:24:33.824370 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e625bcb6-cb8d-45ad-b9a9-535cdc1498c5 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] [instance: 5d33cfed-409f-4da3-9cdf-1b7a83d72532] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:24:33.832296 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e625bcb6-cb8d-45ad-b9a9-535cdc1498c5 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:33.832790 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e625bcb6-cb8d-45ad-b9a9-535cdc1498c5 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:33.833260 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e625bcb6-cb8d-45ad-b9a9-535cdc1498c5 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:33.833972 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e625bcb6-cb8d-45ad-b9a9-535cdc1498c5 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:33.834433 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e625bcb6-cb8d-45ad-b9a9-535cdc1498c5 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:33.834863 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e625bcb6-cb8d-45ad-b9a9-535cdc1498c5 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:33.983710 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e625bcb6-cb8d-45ad-b9a9-535cdc1498c5 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1a8ff15d81430ab50eec828b55ce64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6536c0f9eb1745378692b21905d79e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:24:33.991618 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e625bcb6-cb8d-45ad-b9a9-535cdc1498c5 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] 10.222.0.27 "GET /compute/v2.1/servers/5d33cfed-409f-4da3-9cdf-1b7a83d72532" status: 200 len: 1502 microversion: 2.1 time: 0.171913 Sep 08 11:24:33.992186 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3279/6424] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:24:33 2022] GET /compute/v2.1/servers/5d33cfed-409f-4da3-9cdf-1b7a83d72532 => generated 1502 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:24:34.014149 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d6cdd4af-04d7-4f28-910f-31905048e05a tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:24:34.014718 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d6cdd4af-04d7-4f28-910f-31905048e05a tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] [instance: 5d33cfed-409f-4da3-9cdf-1b7a83d72532] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:24:34.021609 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d6cdd4af-04d7-4f28-910f-31905048e05a tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:34.022102 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d6cdd4af-04d7-4f28-910f-31905048e05a tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:34.022544 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d6cdd4af-04d7-4f28-910f-31905048e05a tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:34.023252 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d6cdd4af-04d7-4f28-910f-31905048e05a tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:34.023714 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d6cdd4af-04d7-4f28-910f-31905048e05a tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:34.024666 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d6cdd4af-04d7-4f28-910f-31905048e05a tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:34.051580 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d6cdd4af-04d7-4f28-910f-31905048e05a tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] [instance: 5d33cfed-409f-4da3-9cdf-1b7a83d72532] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:24:34.134257 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d6cdd4af-04d7-4f28-910f-31905048e05a tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5d33cfed-409f-4da3-9cdf-1b7a83d72532" status: 204 len: 0 microversion: 2.1 time: 0.123518 Sep 08 11:24:34.135420 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3146/6425] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:24:34 2022] DELETE /compute/v2.1/servers/5d33cfed-409f-4da3-9cdf-1b7a83d72532 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:24:34.143806 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-90153590-adbf-4273-982b-80aa595ee9d7 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:24:34.144632 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-90153590-adbf-4273-982b-80aa595ee9d7 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] [instance: 5d33cfed-409f-4da3-9cdf-1b7a83d72532] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:24:34.153423 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90153590-adbf-4273-982b-80aa595ee9d7 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:34.153976 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90153590-adbf-4273-982b-80aa595ee9d7 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:34.154608 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90153590-adbf-4273-982b-80aa595ee9d7 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:34.155357 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90153590-adbf-4273-982b-80aa595ee9d7 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:34.155827 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90153590-adbf-4273-982b-80aa595ee9d7 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:34.156253 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90153590-adbf-4273-982b-80aa595ee9d7 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:34.307249 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-90153590-adbf-4273-982b-80aa595ee9d7 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1a8ff15d81430ab50eec828b55ce64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6536c0f9eb1745378692b21905d79e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:24:34.309617 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:24:34.318165 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-90153590-adbf-4273-982b-80aa595ee9d7 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] 10.222.0.27 "GET /compute/v2.1/servers/5d33cfed-409f-4da3-9cdf-1b7a83d72532" status: 200 len: 1508 microversion: 2.1 time: 0.178327 Sep 08 11:24:34.318749 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3280/6426] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:24:34 2022] GET /compute/v2.1/servers/5d33cfed-409f-4da3-9cdf-1b7a83d72532 => generated 1508 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:24:35.344941 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-08fcf2f7-6b02-4fd9-8445-30168c243737 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:24:35.345715 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-08fcf2f7-6b02-4fd9-8445-30168c243737 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] [instance: 5d33cfed-409f-4da3-9cdf-1b7a83d72532] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:24:35.354007 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08fcf2f7-6b02-4fd9-8445-30168c243737 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:35.354509 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08fcf2f7-6b02-4fd9-8445-30168c243737 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:35.355199 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08fcf2f7-6b02-4fd9-8445-30168c243737 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:35.356431 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08fcf2f7-6b02-4fd9-8445-30168c243737 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:35.356952 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08fcf2f7-6b02-4fd9-8445-30168c243737 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:35.357415 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08fcf2f7-6b02-4fd9-8445-30168c243737 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:35.523575 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-08fcf2f7-6b02-4fd9-8445-30168c243737 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1a8ff15d81430ab50eec828b55ce64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6536c0f9eb1745378692b21905d79e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:24:35.533859 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-08fcf2f7-6b02-4fd9-8445-30168c243737 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] 10.222.0.27 "GET /compute/v2.1/servers/5d33cfed-409f-4da3-9cdf-1b7a83d72532" status: 200 len: 1508 microversion: 2.1 time: 0.193192 Sep 08 11:24:35.534469 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3147/6427] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:24:35 2022] GET /compute/v2.1/servers/5d33cfed-409f-4da3-9cdf-1b7a83d72532 => generated 1508 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:24:36.561084 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2fe535b6-ce2f-48b8-aa73-f15ad676b555 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:24:36.561878 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2fe535b6-ce2f-48b8-aa73-f15ad676b555 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] [instance: 5d33cfed-409f-4da3-9cdf-1b7a83d72532] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:24:36.581795 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2fe535b6-ce2f-48b8-aa73-f15ad676b555 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:36.582372 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2fe535b6-ce2f-48b8-aa73-f15ad676b555 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:36.582879 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2fe535b6-ce2f-48b8-aa73-f15ad676b555 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:36.583962 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2fe535b6-ce2f-48b8-aa73-f15ad676b555 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:36.584998 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2fe535b6-ce2f-48b8-aa73-f15ad676b555 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:36.585714 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2fe535b6-ce2f-48b8-aa73-f15ad676b555 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:36.673206 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2fe535b6-ce2f-48b8-aa73-f15ad676b555 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1a8ff15d81430ab50eec828b55ce64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6536c0f9eb1745378692b21905d79e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:24:36.683057 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2fe535b6-ce2f-48b8-aa73-f15ad676b555 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] 10.222.0.27 "GET /compute/v2.1/servers/5d33cfed-409f-4da3-9cdf-1b7a83d72532" status: 200 len: 1466 microversion: 2.1 time: 0.127534 Sep 08 11:24:36.699663 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3281/6428] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:24:36 2022] GET /compute/v2.1/servers/5d33cfed-409f-4da3-9cdf-1b7a83d72532 => generated 1466 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:24:36.720234 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-53570bac-6859-43ae-bbdb-5f678699d5f3 req-0d64be95-4e10-47f1-821c-3e427c7733ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d33cfed-409f-4da3-9cdf-1b7a83d72532", "name": "network-vif-deleted", "tag": "d5d6bbd7-ea4a-404e-9fe1-10fff55175e0"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:24:36.731427 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-53570bac-6859-43ae-bbdb-5f678699d5f3 req-0d64be95-4e10-47f1-821c-3e427c7733ed service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:36.731933 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-53570bac-6859-43ae-bbdb-5f678699d5f3 req-0d64be95-4e10-47f1-821c-3e427c7733ed service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:36.732355 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-53570bac-6859-43ae-bbdb-5f678699d5f3 req-0d64be95-4e10-47f1-821c-3e427c7733ed service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:36.748464 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-53570bac-6859-43ae-bbdb-5f678699d5f3 req-0d64be95-4e10-47f1-821c-3e427c7733ed service nova] Creating event network-vif-deleted:d5d6bbd7-ea4a-404e-9fe1-10fff55175e0 for instance 5d33cfed-409f-4da3-9cdf-1b7a83d72532 on n-h1-850501-12 Sep 08 11:24:36.755470 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-53570bac-6859-43ae-bbdb-5f678699d5f3 req-0d64be95-4e10-47f1-821c-3e427c7733ed service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038830 Sep 08 11:24:36.756095 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3148/6429] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:24:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:24:37.708028 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cd626514-0c1f-4065-8c94-448042cd2987 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:24:37.709288 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cd626514-0c1f-4065-8c94-448042cd2987 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] [instance: 5d33cfed-409f-4da3-9cdf-1b7a83d72532] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:24:37.716985 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cd626514-0c1f-4065-8c94-448042cd2987 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:37.717547 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cd626514-0c1f-4065-8c94-448042cd2987 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:37.717993 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cd626514-0c1f-4065-8c94-448042cd2987 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:37.718702 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cd626514-0c1f-4065-8c94-448042cd2987 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:37.719160 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cd626514-0c1f-4065-8c94-448042cd2987 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:37.719586 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cd626514-0c1f-4065-8c94-448042cd2987 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:37.735246 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-cd626514-0c1f-4065-8c94-448042cd2987 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] HTTP exception thrown: Instance 5d33cfed-409f-4da3-9cdf-1b7a83d72532 could not be found. Sep 08 11:24:37.736926 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cd626514-0c1f-4065-8c94-448042cd2987 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Request method failure captured: Sep 08 11:24:37.736926 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/5d33cfed-409f-4da3-9cdf-1b7a83d72532 HTTP/1.1 Sep 08 11:24:37.736926 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:24:37.736926 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:24:37.736926 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:24:37.736926 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 11:24:37.736926 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:24:37.736926 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:24:37.736926 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:24:37.736926 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:24:37.736926 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGdDYKw1cWdu6pcIxo_BzpyfUiO1jMA3SRRST3jG1Ok2tNscMcMIW_Br5iZhIecd-omF7wTESDePzm6YgGlA-peNvtYvLKVio-i5Gyowl_zkoYwN0c5IUTclprEZSY9v8vAWzXivEN6dlivsLQ3iNRxF7K6UodqS4RSWJJVebApDV4AQ Sep 08 11:24:37.736926 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:24:37.736926 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:24:37.736926 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:24:37.736926 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:24:37.736926 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:24:37.736926 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:24:37.736926 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 6536c0f9eb1745378692b21905d79e6d Sep 08 11:24:37.736926 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-TestServerAdvancedOps-999333512 Sep 08 11:24:37.736926 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:24:37.736926 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:24:37.736926 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6536c0f9eb1745378692b21905d79e6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6536c0f9eb1745378692b21905d79e6d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6536c0f9eb1745378692b21905d79e6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6536c0f9eb1745378692b21905d79e6d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:24:37.736926 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-TestServerAdvancedOps-999333512 Sep 08 11:24:37.736926 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 6536c0f9eb1745378692b21905d79e6d Sep 08 11:24:37.736926 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-TestServerAdvancedOps-999333512 Sep 08 11:24:37.736926 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-TestServerAdvancedOps-999333512-project Sep 08 11:24:37.736926 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:24:37.736926 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:24:37.736926 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 2d1a8ff15d81430ab50eec828b55ce64 Sep 08 11:24:37.736926 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-TestServerAdvancedOps-999333512-project Sep 08 11:24:37.736926 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 11:24:37.736926 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 5d33cfed-409f-4da3-9cdf-1b7a83d72532 could not be found. Sep 08 11:24:37.736926 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '5d33cfed-409f-4da3-9cdf-1b7a83d72532'} Sep 08 11:24:37.736926 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:24:37.736926 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:24:37.736926 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:24:37.736926 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:24:37.736926 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:24:37.736926 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:24:37.736926 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:24:37.736926 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:24:37.736926 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:24:37.736926 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:24:37.736926 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d33cfed-409f-4da3-9cdf-1b7a83d72532 could not be found. Sep 08 11:24:37.736926 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:24:37.736926 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:24:37.736926 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:24:37.736926 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:24:37.736926 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:24:37.736926 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:24:37.736926 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:24:37.736926 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:24:37.736926 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:24:37.736926 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:24:37.736926 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:24:37.736926 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:24:37.736926 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:24:37.736926 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:24:37.736926 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:24:37.736926 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:24:37.736926 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d33cfed-409f-4da3-9cdf-1b7a83d72532 could not be found. Sep 08 11:24:37.736926 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:24:37.736926 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:24:37.736926 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:24:37.741921 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:24:37.741921 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:24:37.741921 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:24:37.741921 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:24:37.741921 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:24:37.741921 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d33cfed-409f-4da3-9cdf-1b7a83d72532 could not be found. Sep 08 11:24:37.741921 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:24:37.741921 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cd626514-0c1f-4065-8c94-448042cd2987 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] Returning 404 to user: Instance 5d33cfed-409f-4da3-9cdf-1b7a83d72532 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:24:37.741921 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cd626514-0c1f-4065-8c94-448042cd2987 tempest-TestServerAdvancedOps-999333512 tempest-TestServerAdvancedOps-999333512-project] 10.222.0.27 "GET /compute/v2.1/servers/5d33cfed-409f-4da3-9cdf-1b7a83d72532" status: 404 len: 111 microversion: 2.1 time: 0.035416 Sep 08 11:24:37.743145 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3282/6430] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:24:37 2022] GET /compute/v2.1/servers/5d33cfed-409f-4da3-9cdf-1b7a83d72532 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:24:52.017525 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:24:52.019017 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:24:52.246401 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-da54d1d6-d78f-4f76-b2a9-1c396482fb0a tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:24:52.248638 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-da54d1d6-d78f-4f76-b2a9-1c396482fb0a tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:52.249447 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-da54d1d6-d78f-4f76-b2a9-1c396482fb0a tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:52.250134 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-da54d1d6-d78f-4f76-b2a9-1c396482fb0a tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:52.251140 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-da54d1d6-d78f-4f76-b2a9-1c396482fb0a tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:52.252314 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-da54d1d6-d78f-4f76-b2a9-1c396482fb0a tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:52.253013 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-da54d1d6-d78f-4f76-b2a9-1c396482fb0a tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:52.285979 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-da54d1d6-d78f-4f76-b2a9-1c396482fb0a tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] 10.222.0.27 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.270974 Sep 08 11:24:52.286579 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3149/6431] 10.222.0.27 () {58 vars in 1185 bytes} [Thu Sep 8 11:24:52 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:24:52.421826 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f3a4df4b-68fb-461d-a615-7d455ff7b368 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1642327689", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "availability_zone": "nova:n-h2-850501-12", "networks": [{"uuid": "427d4be2-a500-4778-b15e-6bf0fcbbeced"}]}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:24:52.429737 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=31 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:24:52.430536 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=9 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:24:52.516264 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-f3a4df4b-68fb-461d-a615-7d455ff7b368 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] validate_networks() for [('427d4be2-a500-4778-b15e-6bf0fcbbeced', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:24:53.143396 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-f3a4df4b-68fb-461d-a615-7d455ff7b368 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:24:53.143847 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-f3a4df4b-68fb-461d-a615-7d455ff7b368 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:24:53.144323 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-f3a4df4b-68fb-461d-a615-7d455ff7b368 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:24:53.144870 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-f3a4df4b-68fb-461d-a615-7d455ff7b368 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:24:53.145356 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-f3a4df4b-68fb-461d-a615-7d455ff7b368 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:24:53.154677 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f3a4df4b-68fb-461d-a615-7d455ff7b368 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:53.155168 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f3a4df4b-68fb-461d-a615-7d455ff7b368 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:53.155605 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f3a4df4b-68fb-461d-a615-7d455ff7b368 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:53.156325 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f3a4df4b-68fb-461d-a615-7d455ff7b368 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:53.156784 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f3a4df4b-68fb-461d-a615-7d455ff7b368 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:53.157242 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f3a4df4b-68fb-461d-a615-7d455ff7b368 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:53.180073 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-f3a4df4b-68fb-461d-a615-7d455ff7b368 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Getting quotas for project 37600c283df4428ca12e4008470eb25a. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:24:53.187368 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-f3a4df4b-68fb-461d-a615-7d455ff7b368 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Getting quotas for user 9859c5e819714ca4bc9a694743219b1e and project 37600c283df4428ca12e4008470eb25a. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:24:53.202873 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f3a4df4b-68fb-461d-a615-7d455ff7b368 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:24:53.205300 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f3a4df4b-68fb-461d-a615-7d455ff7b368 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] [instance: feaa887b-3ece-4a97-918a-8610910bf1f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:24:53.261648 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f3a4df4b-68fb-461d-a615-7d455ff7b368 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.843706 Sep 08 11:24:53.262789 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3283/6432] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 11:24:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 845 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:24:53.273511 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-59aa67f4-7101-4fd9-bb54-6f7baafb9ae4 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:24:53.274562 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-59aa67f4-7101-4fd9-bb54-6f7baafb9ae4 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] [instance: feaa887b-3ece-4a97-918a-8610910bf1f1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:24:53.343080 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-59aa67f4-7101-4fd9-bb54-6f7baafb9ae4 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/feaa887b-3ece-4a97-918a-8610910bf1f1" status: 200 len: 1329 microversion: 2.1 time: 0.073661 Sep 08 11:24:53.344309 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3150/6433] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:24:53 2022] GET /compute/v2.1/servers/feaa887b-3ece-4a97-918a-8610910bf1f1 => generated 1329 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:24:54.366249 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-41264391-660a-42a3-9093-42422ebb7240 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:24:54.366781 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-41264391-660a-42a3-9093-42422ebb7240 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] [instance: feaa887b-3ece-4a97-918a-8610910bf1f1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:24:54.376467 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41264391-660a-42a3-9093-42422ebb7240 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:54.377126 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41264391-660a-42a3-9093-42422ebb7240 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:54.377496 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41264391-660a-42a3-9093-42422ebb7240 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:54.378209 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41264391-660a-42a3-9093-42422ebb7240 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:54.378657 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41264391-660a-42a3-9093-42422ebb7240 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:54.379082 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41264391-660a-42a3-9093-42422ebb7240 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:54.455189 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-41264391-660a-42a3-9093-42422ebb7240 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/feaa887b-3ece-4a97-918a-8610910bf1f1" status: 200 len: 1418 microversion: 2.1 time: 0.092706 Sep 08 11:24:54.456071 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3284/6434] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:24:54 2022] GET /compute/v2.1/servers/feaa887b-3ece-4a97-918a-8610910bf1f1 => generated 1418 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:24:55.484210 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-360945e0-f627-4e9d-bd80-784cebf26a2c tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:24:55.487298 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-360945e0-f627-4e9d-bd80-784cebf26a2c tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] [instance: feaa887b-3ece-4a97-918a-8610910bf1f1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:24:55.505352 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-360945e0-f627-4e9d-bd80-784cebf26a2c tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:55.506057 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-360945e0-f627-4e9d-bd80-784cebf26a2c tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:55.508972 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-360945e0-f627-4e9d-bd80-784cebf26a2c tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:55.511674 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-360945e0-f627-4e9d-bd80-784cebf26a2c tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:55.512315 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-360945e0-f627-4e9d-bd80-784cebf26a2c tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:55.514105 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-360945e0-f627-4e9d-bd80-784cebf26a2c tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:55.737190 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-360945e0-f627-4e9d-bd80-784cebf26a2c tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/feaa887b-3ece-4a97-918a-8610910bf1f1" status: 200 len: 1466 microversion: 2.1 time: 0.262112 Sep 08 11:24:55.753719 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3151/6435] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:24:55 2022] GET /compute/v2.1/servers/feaa887b-3ece-4a97-918a-8610910bf1f1 => generated 1466 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:24:55.812535 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-483a222b-65ab-4e8e-a238-8b43ece7c85a tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:24:55.816609 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-483a222b-65ab-4e8e-a238-8b43ece7c85a tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] [instance: 9a6f7017-293f-41a6-8df5-aea670d317de] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:24:55.825275 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-483a222b-65ab-4e8e-a238-8b43ece7c85a tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:55.825778 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-483a222b-65ab-4e8e-a238-8b43ece7c85a tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:55.826756 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-483a222b-65ab-4e8e-a238-8b43ece7c85a tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:55.827493 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-483a222b-65ab-4e8e-a238-8b43ece7c85a tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:55.827957 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-483a222b-65ab-4e8e-a238-8b43ece7c85a tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:55.829678 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-483a222b-65ab-4e8e-a238-8b43ece7c85a tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:55.930379 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-483a222b-65ab-4e8e-a238-8b43ece7c85a tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] 10.222.0.27 "POST /compute/v2.1/servers/9a6f7017-293f-41a6-8df5-aea670d317de/action" status: 200 len: 24575 microversion: 2.1 time: 0.132329 Sep 08 11:24:55.933607 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3285/6436] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 11:24:55 2022] POST /compute/v2.1/servers/9a6f7017-293f-41a6-8df5-aea670d317de/action => generated 24575 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 11:24:56.187400 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-b63d1179-7eec-4b61-b5cc-56047b1ddc69 req-a61078b7-a6f1-48fa-bc12-aec40db38099 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "feaa887b-3ece-4a97-918a-8610910bf1f1", "tag": "554a0ff2-0452-4459-810c-5d4f9f90fb38"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:24:56.202113 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b63d1179-7eec-4b61-b5cc-56047b1ddc69 req-a61078b7-a6f1-48fa-bc12-aec40db38099 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:56.203630 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b63d1179-7eec-4b61-b5cc-56047b1ddc69 req-a61078b7-a6f1-48fa-bc12-aec40db38099 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:56.204273 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b63d1179-7eec-4b61-b5cc-56047b1ddc69 req-a61078b7-a6f1-48fa-bc12-aec40db38099 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:56.219415 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-b63d1179-7eec-4b61-b5cc-56047b1ddc69 req-a61078b7-a6f1-48fa-bc12-aec40db38099 service nova] Creating event network-changed:554a0ff2-0452-4459-810c-5d4f9f90fb38 for instance feaa887b-3ece-4a97-918a-8610910bf1f1 on n-h2-850501-12 Sep 08 11:24:56.225604 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-b63d1179-7eec-4b61-b5cc-56047b1ddc69 req-a61078b7-a6f1-48fa-bc12-aec40db38099 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044734 Sep 08 11:24:56.226353 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3152/6437] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:24:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:24:56.764300 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-105caf16-e226-40d5-9856-5889e736ec99 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:24:56.764988 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-105caf16-e226-40d5-9856-5889e736ec99 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] [instance: feaa887b-3ece-4a97-918a-8610910bf1f1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:24:56.772980 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-105caf16-e226-40d5-9856-5889e736ec99 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:56.773494 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-105caf16-e226-40d5-9856-5889e736ec99 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:56.774098 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-105caf16-e226-40d5-9856-5889e736ec99 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:56.774800 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-105caf16-e226-40d5-9856-5889e736ec99 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:56.775909 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-105caf16-e226-40d5-9856-5889e736ec99 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:56.776490 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-105caf16-e226-40d5-9856-5889e736ec99 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:56.922010 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-105caf16-e226-40d5-9856-5889e736ec99 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/feaa887b-3ece-4a97-918a-8610910bf1f1" status: 200 len: 1466 microversion: 2.1 time: 0.162886 Sep 08 11:24:56.923344 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3286/6438] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:24:56 2022] GET /compute/v2.1/servers/feaa887b-3ece-4a97-918a-8610910bf1f1 => generated 1466 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:24:57.947786 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a3c80353-7f10-4423-a68b-4aef4eb3d390 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:24:57.948657 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a3c80353-7f10-4423-a68b-4aef4eb3d390 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] [instance: feaa887b-3ece-4a97-918a-8610910bf1f1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:24:57.956322 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a3c80353-7f10-4423-a68b-4aef4eb3d390 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:57.957017 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a3c80353-7f10-4423-a68b-4aef4eb3d390 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:57.957482 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a3c80353-7f10-4423-a68b-4aef4eb3d390 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:57.958201 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a3c80353-7f10-4423-a68b-4aef4eb3d390 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:57.958693 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a3c80353-7f10-4423-a68b-4aef4eb3d390 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:57.959306 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a3c80353-7f10-4423-a68b-4aef4eb3d390 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:58.112725 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a3c80353-7f10-4423-a68b-4aef4eb3d390 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/feaa887b-3ece-4a97-918a-8610910bf1f1" status: 200 len: 1466 microversion: 2.1 time: 0.169514 Sep 08 11:24:58.113353 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3153/6439] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:24:57 2022] GET /compute/v2.1/servers/feaa887b-3ece-4a97-918a-8610910bf1f1 => generated 1466 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:24:59.136208 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2060e7de-6180-484c-8c50-af75216843ed tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:24:59.136828 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2060e7de-6180-484c-8c50-af75216843ed tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] [instance: feaa887b-3ece-4a97-918a-8610910bf1f1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:24:59.144614 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2060e7de-6180-484c-8c50-af75216843ed tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:59.145145 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2060e7de-6180-484c-8c50-af75216843ed tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:59.145590 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2060e7de-6180-484c-8c50-af75216843ed tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:59.146298 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2060e7de-6180-484c-8c50-af75216843ed tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:59.146791 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2060e7de-6180-484c-8c50-af75216843ed tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:59.147225 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2060e7de-6180-484c-8c50-af75216843ed tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:59.279542 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2060e7de-6180-484c-8c50-af75216843ed tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/feaa887b-3ece-4a97-918a-8610910bf1f1" status: 200 len: 1466 microversion: 2.1 time: 0.147432 Sep 08 11:24:59.280094 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3287/6440] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:24:59 2022] GET /compute/v2.1/servers/feaa887b-3ece-4a97-918a-8610910bf1f1 => generated 1466 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:25:00.302856 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5636be7c-a8a1-4cf4-81be-bd283f6c49b8 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:25:00.303410 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5636be7c-a8a1-4cf4-81be-bd283f6c49b8 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] [instance: feaa887b-3ece-4a97-918a-8610910bf1f1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:00.311124 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5636be7c-a8a1-4cf4-81be-bd283f6c49b8 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:00.311614 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5636be7c-a8a1-4cf4-81be-bd283f6c49b8 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:00.312049 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5636be7c-a8a1-4cf4-81be-bd283f6c49b8 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:00.312747 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5636be7c-a8a1-4cf4-81be-bd283f6c49b8 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:00.313242 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5636be7c-a8a1-4cf4-81be-bd283f6c49b8 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:00.313696 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5636be7c-a8a1-4cf4-81be-bd283f6c49b8 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:00.455133 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5636be7c-a8a1-4cf4-81be-bd283f6c49b8 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/feaa887b-3ece-4a97-918a-8610910bf1f1" status: 200 len: 1466 microversion: 2.1 time: 0.156161 Sep 08 11:25:00.461763 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3154/6441] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:25:00 2022] GET /compute/v2.1/servers/feaa887b-3ece-4a97-918a-8610910bf1f1 => generated 1466 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:25:00.614511 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-ca4268c7-0e2a-4c27-8946-ec3531cbe5bc req-537f55cd-a99d-4f17-870c-070616fe82d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "feaa887b-3ece-4a97-918a-8610910bf1f1", "name": "network-vif-plugged", "status": "completed", "tag": "554a0ff2-0452-4459-810c-5d4f9f90fb38"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:25:00.628722 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-ca4268c7-0e2a-4c27-8946-ec3531cbe5bc req-537f55cd-a99d-4f17-870c-070616fe82d1 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:00.629413 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-ca4268c7-0e2a-4c27-8946-ec3531cbe5bc req-537f55cd-a99d-4f17-870c-070616fe82d1 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:00.629869 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-ca4268c7-0e2a-4c27-8946-ec3531cbe5bc req-537f55cd-a99d-4f17-870c-070616fe82d1 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:00.929680 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-ca4268c7-0e2a-4c27-8946-ec3531cbe5bc req-537f55cd-a99d-4f17-870c-070616fe82d1 service nova] Creating event network-vif-plugged:554a0ff2-0452-4459-810c-5d4f9f90fb38 for instance feaa887b-3ece-4a97-918a-8610910bf1f1 on n-h2-850501-12 Sep 08 11:25:00.935308 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-ca4268c7-0e2a-4c27-8946-ec3531cbe5bc req-537f55cd-a99d-4f17-870c-070616fe82d1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.346093 Sep 08 11:25:00.936161 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3288/6442] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:25:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:25:01.480044 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-23f64ddd-050d-4976-852e-0dccf96faeed tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:25:01.480663 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-23f64ddd-050d-4976-852e-0dccf96faeed tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] [instance: feaa887b-3ece-4a97-918a-8610910bf1f1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:01.487683 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23f64ddd-050d-4976-852e-0dccf96faeed tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:01.488172 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23f64ddd-050d-4976-852e-0dccf96faeed tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:01.488618 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23f64ddd-050d-4976-852e-0dccf96faeed tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:01.489757 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23f64ddd-050d-4976-852e-0dccf96faeed tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:01.490228 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23f64ddd-050d-4976-852e-0dccf96faeed tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:01.490665 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23f64ddd-050d-4976-852e-0dccf96faeed tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:01.635522 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-23f64ddd-050d-4976-852e-0dccf96faeed tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/feaa887b-3ece-4a97-918a-8610910bf1f1" status: 200 len: 1466 microversion: 2.1 time: 0.160018 Sep 08 11:25:01.642619 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3155/6443] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:25:01 2022] GET /compute/v2.1/servers/feaa887b-3ece-4a97-918a-8610910bf1f1 => generated 1466 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:25:02.660427 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ef521ee7-64b0-4c31-9778-3a81cd603986 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:25:02.661877 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ef521ee7-64b0-4c31-9778-3a81cd603986 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] [instance: feaa887b-3ece-4a97-918a-8610910bf1f1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:02.670020 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ef521ee7-64b0-4c31-9778-3a81cd603986 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:02.670710 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ef521ee7-64b0-4c31-9778-3a81cd603986 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:02.671183 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ef521ee7-64b0-4c31-9778-3a81cd603986 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:02.671879 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ef521ee7-64b0-4c31-9778-3a81cd603986 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:02.672346 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ef521ee7-64b0-4c31-9778-3a81cd603986 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:02.672770 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ef521ee7-64b0-4c31-9778-3a81cd603986 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:02.803816 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ef521ee7-64b0-4c31-9778-3a81cd603986 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/feaa887b-3ece-4a97-918a-8610910bf1f1" status: 200 len: 1651 microversion: 2.1 time: 0.148336 Sep 08 11:25:02.804436 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3289/6444] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:25:02 2022] GET /compute/v2.1/servers/feaa887b-3ece-4a97-918a-8610910bf1f1 => generated 1651 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:25:02.827185 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-090de592-a82a-42c9-bbf5-2b19b780f705 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:25:02.827846 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-090de592-a82a-42c9-bbf5-2b19b780f705 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] [instance: feaa887b-3ece-4a97-918a-8610910bf1f1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:02.829935 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:25:02.836523 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-090de592-a82a-42c9-bbf5-2b19b780f705 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:02.837020 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-090de592-a82a-42c9-bbf5-2b19b780f705 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:02.837482 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-090de592-a82a-42c9-bbf5-2b19b780f705 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:02.838762 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-090de592-a82a-42c9-bbf5-2b19b780f705 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:02.839495 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-090de592-a82a-42c9-bbf5-2b19b780f705 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:02.840106 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-090de592-a82a-42c9-bbf5-2b19b780f705 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:02.976621 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-090de592-a82a-42c9-bbf5-2b19b780f705 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/feaa887b-3ece-4a97-918a-8610910bf1f1" status: 200 len: 1651 microversion: 2.1 time: 0.153417 Sep 08 11:25:02.977234 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3156/6445] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:25:02 2022] GET /compute/v2.1/servers/feaa887b-3ece-4a97-918a-8610910bf1f1 => generated 1651 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:25:02.998705 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cc9c59d7-36ec-4523-82d7-b6df2ce1132f tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:25:02.999468 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cc9c59d7-36ec-4523-82d7-b6df2ce1132f tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] [instance: feaa887b-3ece-4a97-918a-8610910bf1f1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:03.005681 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc9c59d7-36ec-4523-82d7-b6df2ce1132f tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:03.006244 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc9c59d7-36ec-4523-82d7-b6df2ce1132f tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:03.006744 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc9c59d7-36ec-4523-82d7-b6df2ce1132f tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:03.007503 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc9c59d7-36ec-4523-82d7-b6df2ce1132f tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:03.008026 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc9c59d7-36ec-4523-82d7-b6df2ce1132f tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:03.008538 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc9c59d7-36ec-4523-82d7-b6df2ce1132f tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:03.151024 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cc9c59d7-36ec-4523-82d7-b6df2ce1132f tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/feaa887b-3ece-4a97-918a-8610910bf1f1" status: 200 len: 1651 microversion: 2.1 time: 0.156319 Sep 08 11:25:03.151940 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3290/6446] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:25:02 2022] GET /compute/v2.1/servers/feaa887b-3ece-4a97-918a-8610910bf1f1 => generated 1651 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:25:03.228405 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-963ca72a-19f8-49c7-b604-ebc393b7ec2a tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-769900593", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "availability_zone": "nova:n-h1-850501-12", "networks": [{"uuid": "427d4be2-a500-4778-b15e-6bf0fcbbeced"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:25:03.291726 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-963ca72a-19f8-49c7-b604-ebc393b7ec2a tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] validate_networks() for [('427d4be2-a500-4778-b15e-6bf0fcbbeced', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:25:03.342183 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:25:03.688379 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-963ca72a-19f8-49c7-b604-ebc393b7ec2a tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:25:03.688802 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-963ca72a-19f8-49c7-b604-ebc393b7ec2a tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:25:03.689302 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-963ca72a-19f8-49c7-b604-ebc393b7ec2a tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:25:03.689712 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-963ca72a-19f8-49c7-b604-ebc393b7ec2a tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:25:03.690158 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-963ca72a-19f8-49c7-b604-ebc393b7ec2a tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:25:03.700809 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-963ca72a-19f8-49c7-b604-ebc393b7ec2a tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:03.701340 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-963ca72a-19f8-49c7-b604-ebc393b7ec2a tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:03.701923 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-963ca72a-19f8-49c7-b604-ebc393b7ec2a tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:03.702669 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-963ca72a-19f8-49c7-b604-ebc393b7ec2a tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:03.703126 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-963ca72a-19f8-49c7-b604-ebc393b7ec2a tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:03.703554 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-963ca72a-19f8-49c7-b604-ebc393b7ec2a tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:03.724268 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-963ca72a-19f8-49c7-b604-ebc393b7ec2a tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Getting quotas for project 37600c283df4428ca12e4008470eb25a. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:25:03.730416 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-963ca72a-19f8-49c7-b604-ebc393b7ec2a tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Getting quotas for user 9859c5e819714ca4bc9a694743219b1e and project 37600c283df4428ca12e4008470eb25a. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:25:03.743757 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-963ca72a-19f8-49c7-b604-ebc393b7ec2a tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:25:03.746477 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-963ca72a-19f8-49c7-b604-ebc393b7ec2a tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] [instance: 06df62d6-464a-455d-b0e8-e83e9008fb4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:25:03.812908 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-963ca72a-19f8-49c7-b604-ebc393b7ec2a tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.588163 Sep 08 11:25:03.813628 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3157/6447] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 11:25:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:25:03.826561 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b90bf774-1f23-42ba-9a8f-b64dcb4e386e tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:25:03.827445 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b90bf774-1f23-42ba-9a8f-b64dcb4e386e tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] [instance: 06df62d6-464a-455d-b0e8-e83e9008fb4c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:03.829660 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:25:03.830825 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=6 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:25:03.907820 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b90bf774-1f23-42ba-9a8f-b64dcb4e386e tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/06df62d6-464a-455d-b0e8-e83e9008fb4c" status: 200 len: 1328 microversion: 2.1 time: 0.086700 Sep 08 11:25:03.908989 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3291/6448] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:25:03 2022] GET /compute/v2.1/servers/06df62d6-464a-455d-b0e8-e83e9008fb4c => generated 1328 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:25:04.930852 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f136f799-dede-4228-baa4-c6db5de0b70f tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:25:04.931483 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f136f799-dede-4228-baa4-c6db5de0b70f tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] [instance: 06df62d6-464a-455d-b0e8-e83e9008fb4c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:04.940219 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f136f799-dede-4228-baa4-c6db5de0b70f tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:04.940984 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f136f799-dede-4228-baa4-c6db5de0b70f tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:04.941667 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f136f799-dede-4228-baa4-c6db5de0b70f tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:04.942603 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f136f799-dede-4228-baa4-c6db5de0b70f tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:04.943262 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f136f799-dede-4228-baa4-c6db5de0b70f tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:04.943911 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f136f799-dede-4228-baa4-c6db5de0b70f tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:05.031188 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f136f799-dede-4228-baa4-c6db5de0b70f tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/06df62d6-464a-455d-b0e8-e83e9008fb4c" status: 200 len: 1425 microversion: 2.1 time: 0.104021 Sep 08 11:25:05.031784 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3158/6449] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:25:04 2022] GET /compute/v2.1/servers/06df62d6-464a-455d-b0e8-e83e9008fb4c => generated 1425 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:25:06.055322 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1d4bc69b-1040-43e5-8d6e-f22457aefe03 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:25:06.055969 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1d4bc69b-1040-43e5-8d6e-f22457aefe03 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] [instance: 06df62d6-464a-455d-b0e8-e83e9008fb4c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:06.064993 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1d4bc69b-1040-43e5-8d6e-f22457aefe03 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:06.065528 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1d4bc69b-1040-43e5-8d6e-f22457aefe03 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:06.065972 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1d4bc69b-1040-43e5-8d6e-f22457aefe03 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:06.066690 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1d4bc69b-1040-43e5-8d6e-f22457aefe03 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:06.067377 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1d4bc69b-1040-43e5-8d6e-f22457aefe03 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:06.067822 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1d4bc69b-1040-43e5-8d6e-f22457aefe03 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:06.216191 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1d4bc69b-1040-43e5-8d6e-f22457aefe03 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/06df62d6-464a-455d-b0e8-e83e9008fb4c" status: 200 len: 1465 microversion: 2.1 time: 0.164282 Sep 08 11:25:06.217183 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3292/6450] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:25:06 2022] GET /compute/v2.1/servers/06df62d6-464a-455d-b0e8-e83e9008fb4c => generated 1465 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:25:06.526641 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-b63a9630-9b6c-47af-b024-15487215c574 req-52174e7d-a68e-4d98-965a-5c1d608902ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06df62d6-464a-455d-b0e8-e83e9008fb4c", "tag": "32154e43-877a-4c8f-a067-51e79855bedf"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:25:06.538394 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b63a9630-9b6c-47af-b024-15487215c574 req-52174e7d-a68e-4d98-965a-5c1d608902ae service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:06.538886 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b63a9630-9b6c-47af-b024-15487215c574 req-52174e7d-a68e-4d98-965a-5c1d608902ae service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:06.539503 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b63a9630-9b6c-47af-b024-15487215c574 req-52174e7d-a68e-4d98-965a-5c1d608902ae service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:06.552093 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-b63a9630-9b6c-47af-b024-15487215c574 req-52174e7d-a68e-4d98-965a-5c1d608902ae service nova] Creating event network-changed:32154e43-877a-4c8f-a067-51e79855bedf for instance 06df62d6-464a-455d-b0e8-e83e9008fb4c on n-h1-850501-12 Sep 08 11:25:06.557366 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-b63a9630-9b6c-47af-b024-15487215c574 req-52174e7d-a68e-4d98-965a-5c1d608902ae service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035461 Sep 08 11:25:06.558143 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3159/6451] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:25:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:25:06.909853 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c72d96ad-7f55-49e9-8e51-ee34bff19469 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:25:06.912764 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c72d96ad-7f55-49e9-8e51-ee34bff19469 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] [instance: 9a6f7017-293f-41a6-8df5-aea670d317de] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:06.920010 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c72d96ad-7f55-49e9-8e51-ee34bff19469 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:06.920594 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c72d96ad-7f55-49e9-8e51-ee34bff19469 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:06.921366 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c72d96ad-7f55-49e9-8e51-ee34bff19469 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:06.922180 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c72d96ad-7f55-49e9-8e51-ee34bff19469 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:06.922722 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c72d96ad-7f55-49e9-8e51-ee34bff19469 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:06.923220 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c72d96ad-7f55-49e9-8e51-ee34bff19469 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:06.977055 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c72d96ad-7f55-49e9-8e51-ee34bff19469 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] 10.222.0.27 "POST /compute/v2.1/servers/9a6f7017-293f-41a6-8df5-aea670d317de/action" status: 200 len: 32644 microversion: 2.1 time: 0.071248 Sep 08 11:25:06.978723 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3293/6452] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 11:25:06 2022] POST /compute/v2.1/servers/9a6f7017-293f-41a6-8df5-aea670d317de/action => generated 32644 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 11:25:07.241965 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9823a0bd-468d-4c81-bd52-26a4925c5082 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:25:07.242993 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9823a0bd-468d-4c81-bd52-26a4925c5082 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] [instance: 06df62d6-464a-455d-b0e8-e83e9008fb4c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:07.251397 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9823a0bd-468d-4c81-bd52-26a4925c5082 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:07.252197 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9823a0bd-468d-4c81-bd52-26a4925c5082 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:07.252802 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9823a0bd-468d-4c81-bd52-26a4925c5082 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:07.253761 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9823a0bd-468d-4c81-bd52-26a4925c5082 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:07.254511 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9823a0bd-468d-4c81-bd52-26a4925c5082 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:07.255132 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9823a0bd-468d-4c81-bd52-26a4925c5082 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:07.431371 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9823a0bd-468d-4c81-bd52-26a4925c5082 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/06df62d6-464a-455d-b0e8-e83e9008fb4c" status: 200 len: 1465 microversion: 2.1 time: 0.193963 Sep 08 11:25:07.432575 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3160/6453] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:25:07 2022] GET /compute/v2.1/servers/06df62d6-464a-455d-b0e8-e83e9008fb4c => generated 1465 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:25:08.459528 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8ec8f207-9fa7-4db5-9392-fcac63d1629f tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:25:08.460203 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8ec8f207-9fa7-4db5-9392-fcac63d1629f tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] [instance: 9a6f7017-293f-41a6-8df5-aea670d317de] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:08.462976 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e36e7b12-a43b-45a5-b60c-63810bdddcb9 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:25:08.464874 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e36e7b12-a43b-45a5-b60c-63810bdddcb9 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] [instance: 06df62d6-464a-455d-b0e8-e83e9008fb4c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:08.474922 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e36e7b12-a43b-45a5-b60c-63810bdddcb9 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:08.475516 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e36e7b12-a43b-45a5-b60c-63810bdddcb9 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:08.475897 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ec8f207-9fa7-4db5-9392-fcac63d1629f tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:08.476702 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ec8f207-9fa7-4db5-9392-fcac63d1629f tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:08.477224 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e36e7b12-a43b-45a5-b60c-63810bdddcb9 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:08.477986 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ec8f207-9fa7-4db5-9392-fcac63d1629f tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:08.478422 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e36e7b12-a43b-45a5-b60c-63810bdddcb9 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:08.479976 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ec8f207-9fa7-4db5-9392-fcac63d1629f tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:08.480705 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e36e7b12-a43b-45a5-b60c-63810bdddcb9 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:08.480811 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ec8f207-9fa7-4db5-9392-fcac63d1629f tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:08.481387 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ec8f207-9fa7-4db5-9392-fcac63d1629f tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:08.481850 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e36e7b12-a43b-45a5-b60c-63810bdddcb9 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:08.516132 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8ec8f207-9fa7-4db5-9392-fcac63d1629f tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] [instance: 9a6f7017-293f-41a6-8df5-aea670d317de] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:25:08.639957 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8ec8f207-9fa7-4db5-9392-fcac63d1629f tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9a6f7017-293f-41a6-8df5-aea670d317de" status: 204 len: 0 microversion: 2.1 time: 0.184332 Sep 08 11:25:08.653050 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3161/6454] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:25:08 2022] DELETE /compute/v2.1/servers/9a6f7017-293f-41a6-8df5-aea670d317de => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:25:08.653848 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e36e7b12-a43b-45a5-b60c-63810bdddcb9 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/06df62d6-464a-455d-b0e8-e83e9008fb4c" status: 200 len: 1465 microversion: 2.1 time: 0.200932 Sep 08 11:25:08.654984 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3294/6455] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:25:08 2022] GET /compute/v2.1/servers/06df62d6-464a-455d-b0e8-e83e9008fb4c => generated 1465 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:25:08.664991 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-f9680867-f2a7-4eea-b925-c002f1d0ea19 req-92e3a6a9-3868-45e0-9fed-20513b9b0992 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a6f7017-293f-41a6-8df5-aea670d317de", "tag": "cc9328fc-985d-4dc1-80c7-60a8e0e47da0"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:25:08.672993 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fd1d9e51-d301-48e3-8216-7968883e31bc tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:25:08.675392 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fd1d9e51-d301-48e3-8216-7968883e31bc tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] [instance: 9a6f7017-293f-41a6-8df5-aea670d317de] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:08.676342 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-f9680867-f2a7-4eea-b925-c002f1d0ea19 req-92e3a6a9-3868-45e0-9fed-20513b9b0992 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:08.676832 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-f9680867-f2a7-4eea-b925-c002f1d0ea19 req-92e3a6a9-3868-45e0-9fed-20513b9b0992 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:08.677442 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-f9680867-f2a7-4eea-b925-c002f1d0ea19 req-92e3a6a9-3868-45e0-9fed-20513b9b0992 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:08.690517 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-f9680867-f2a7-4eea-b925-c002f1d0ea19 req-92e3a6a9-3868-45e0-9fed-20513b9b0992 service nova] Creating event network-changed:cc9328fc-985d-4dc1-80c7-60a8e0e47da0 for instance 9a6f7017-293f-41a6-8df5-aea670d317de on n-h2-850501-12 Sep 08 11:25:08.691915 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fd1d9e51-d301-48e3-8216-7968883e31bc tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:08.692615 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fd1d9e51-d301-48e3-8216-7968883e31bc tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:08.693258 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fd1d9e51-d301-48e3-8216-7968883e31bc tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:08.695530 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fd1d9e51-d301-48e3-8216-7968883e31bc tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:08.696432 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-f9680867-f2a7-4eea-b925-c002f1d0ea19 req-92e3a6a9-3868-45e0-9fed-20513b9b0992 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042469 Sep 08 11:25:08.696831 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fd1d9e51-d301-48e3-8216-7968883e31bc tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:08.697519 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fd1d9e51-d301-48e3-8216-7968883e31bc tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:08.698283 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3162/6456] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:25:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:25:08.854877 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-fd1d9e51-d301-48e3-8216-7968883e31bc tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761124676b5e4a8db0bc59740c1f535e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f85ab8354294e359cabfca999283d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:25:08.863574 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fd1d9e51-d301-48e3-8216-7968883e31bc tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] 10.222.0.27 "GET /compute/v2.1/servers/9a6f7017-293f-41a6-8df5-aea670d317de" status: 200 len: 1666 microversion: 2.1 time: 0.207489 Sep 08 11:25:08.864147 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3295/6457] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:25:08 2022] GET /compute/v2.1/servers/9a6f7017-293f-41a6-8df5-aea670d317de => generated 1666 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:25:09.680116 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b1c331c9-7084-4d1a-80c6-8f6d1643879c tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:25:09.681180 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b1c331c9-7084-4d1a-80c6-8f6d1643879c tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] [instance: 06df62d6-464a-455d-b0e8-e83e9008fb4c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:09.688436 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1c331c9-7084-4d1a-80c6-8f6d1643879c tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:09.688937 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1c331c9-7084-4d1a-80c6-8f6d1643879c tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:09.689438 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1c331c9-7084-4d1a-80c6-8f6d1643879c tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:09.690156 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1c331c9-7084-4d1a-80c6-8f6d1643879c tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:09.690617 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1c331c9-7084-4d1a-80c6-8f6d1643879c tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:09.691048 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1c331c9-7084-4d1a-80c6-8f6d1643879c tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:09.829515 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b1c331c9-7084-4d1a-80c6-8f6d1643879c tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/06df62d6-464a-455d-b0e8-e83e9008fb4c" status: 200 len: 1465 microversion: 2.1 time: 0.154375 Sep 08 11:25:09.830103 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3163/6458] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:25:09 2022] GET /compute/v2.1/servers/06df62d6-464a-455d-b0e8-e83e9008fb4c => generated 1465 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:25:09.888435 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6e568e6e-212d-4bc0-b32a-e6ef8ca7d859 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:25:09.889075 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6e568e6e-212d-4bc0-b32a-e6ef8ca7d859 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] [instance: 9a6f7017-293f-41a6-8df5-aea670d317de] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:09.896494 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6e568e6e-212d-4bc0-b32a-e6ef8ca7d859 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:09.896988 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6e568e6e-212d-4bc0-b32a-e6ef8ca7d859 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:09.897459 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6e568e6e-212d-4bc0-b32a-e6ef8ca7d859 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:09.898162 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6e568e6e-212d-4bc0-b32a-e6ef8ca7d859 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:09.898620 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6e568e6e-212d-4bc0-b32a-e6ef8ca7d859 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:09.899049 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6e568e6e-212d-4bc0-b32a-e6ef8ca7d859 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:10.505826 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6e568e6e-212d-4bc0-b32a-e6ef8ca7d859 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761124676b5e4a8db0bc59740c1f535e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f85ab8354294e359cabfca999283d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:25:10.516518 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6e568e6e-212d-4bc0-b32a-e6ef8ca7d859 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] 10.222.0.27 "GET /compute/v2.1/servers/9a6f7017-293f-41a6-8df5-aea670d317de" status: 200 len: 1666 microversion: 2.1 time: 0.632137 Sep 08 11:25:10.517521 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3296/6459] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:25:09 2022] GET /compute/v2.1/servers/9a6f7017-293f-41a6-8df5-aea670d317de => generated 1666 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:25:10.577708 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-ce42ced9-3f39-4757-8cd3-bf38ae11a455 req-4ff17ca8-1f90-4cff-a605-b6babddbf4b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a6f7017-293f-41a6-8df5-aea670d317de", "name": "network-vif-deleted", "tag": "cc9328fc-985d-4dc1-80c7-60a8e0e47da0"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:25:10.588527 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ce42ced9-3f39-4757-8cd3-bf38ae11a455 req-4ff17ca8-1f90-4cff-a605-b6babddbf4b2 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:10.589015 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ce42ced9-3f39-4757-8cd3-bf38ae11a455 req-4ff17ca8-1f90-4cff-a605-b6babddbf4b2 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:10.589863 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ce42ced9-3f39-4757-8cd3-bf38ae11a455 req-4ff17ca8-1f90-4cff-a605-b6babddbf4b2 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:10.602684 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-ce42ced9-3f39-4757-8cd3-bf38ae11a455 req-4ff17ca8-1f90-4cff-a605-b6babddbf4b2 service nova] Creating event network-vif-deleted:cc9328fc-985d-4dc1-80c7-60a8e0e47da0 for instance 9a6f7017-293f-41a6-8df5-aea670d317de on n-h2-850501-12 Sep 08 11:25:10.610952 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-ce42ced9-3f39-4757-8cd3-bf38ae11a455 req-4ff17ca8-1f90-4cff-a605-b6babddbf4b2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044222 Sep 08 11:25:10.611618 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3164/6460] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:25:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:25:10.854456 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fa8ba926-c399-4e6e-826a-dc6c39503a69 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:25:10.855101 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fa8ba926-c399-4e6e-826a-dc6c39503a69 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] [instance: 06df62d6-464a-455d-b0e8-e83e9008fb4c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:10.861536 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fa8ba926-c399-4e6e-826a-dc6c39503a69 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:10.862739 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fa8ba926-c399-4e6e-826a-dc6c39503a69 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:10.863188 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fa8ba926-c399-4e6e-826a-dc6c39503a69 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:10.863911 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fa8ba926-c399-4e6e-826a-dc6c39503a69 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:10.864382 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fa8ba926-c399-4e6e-826a-dc6c39503a69 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:10.864809 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fa8ba926-c399-4e6e-826a-dc6c39503a69 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:11.012610 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fa8ba926-c399-4e6e-826a-dc6c39503a69 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/06df62d6-464a-455d-b0e8-e83e9008fb4c" status: 200 len: 1465 microversion: 2.1 time: 0.163622 Sep 08 11:25:11.019146 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3297/6461] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:25:10 2022] GET /compute/v2.1/servers/06df62d6-464a-455d-b0e8-e83e9008fb4c => generated 1465 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:25:11.545351 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-503137c9-65e3-42f9-af3c-5690d4fdbbdf tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:25:11.546058 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-503137c9-65e3-42f9-af3c-5690d4fdbbdf tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] [instance: 9a6f7017-293f-41a6-8df5-aea670d317de] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:11.552337 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-503137c9-65e3-42f9-af3c-5690d4fdbbdf tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:11.552824 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-503137c9-65e3-42f9-af3c-5690d4fdbbdf tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:11.553289 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-503137c9-65e3-42f9-af3c-5690d4fdbbdf tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:11.553992 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-503137c9-65e3-42f9-af3c-5690d4fdbbdf tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:11.554452 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-503137c9-65e3-42f9-af3c-5690d4fdbbdf tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:11.554886 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-503137c9-65e3-42f9-af3c-5690d4fdbbdf tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:11.569326 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-503137c9-65e3-42f9-af3c-5690d4fdbbdf tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] HTTP exception thrown: Instance 9a6f7017-293f-41a6-8df5-aea670d317de could not be found. Sep 08 11:25:11.570993 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-503137c9-65e3-42f9-af3c-5690d4fdbbdf tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Request method failure captured: Sep 08 11:25:11.570993 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/9a6f7017-293f-41a6-8df5-aea670d317de HTTP/1.1 Sep 08 11:25:11.570993 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 11:25:11.570993 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 11:25:11.570993 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 11:25:11.570993 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 11:25:11.570993 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 11:25:11.570993 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 11:25:11.570993 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 11:25:11.570993 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 11:25:11.570993 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGdBWwDrpfILJHSWnIxsJn5HeyBGxHJFzd2g8Lexoa9iPun5JSvLnbnWMoG-UTTC5Yq0S0M1Vi2RL_9uQOqR8ZnH_IWdlgnhUwsXmNPdFb0ZnfgmU2FcucNYnYdjIcv_WCtIyaGFbtccdMcuXnjIQDt4hJ8BjINuDA046uTxlkRTRqL0 Sep 08 11:25:11.570993 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 11:25:11.570993 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 11:25:11.570993 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 11:25:11.570993 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 11:25:11.570993 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 11:25:11.570993 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 11:25:11.570993 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 8f85ab8354294e359cabfca999283d5a Sep 08 11:25:11.570993 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-TestNetworkBasicOps-1488807265 Sep 08 11:25:11.570993 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 11:25:11.570993 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 11:25:11.570993 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8f85ab8354294e359cabfca999283d5a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8f85ab8354294e359cabfca999283d5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8f85ab8354294e359cabfca999283d5a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8f85ab8354294e359cabfca999283d5a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:25:11.570993 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-TestNetworkBasicOps-1488807265 Sep 08 11:25:11.570993 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 8f85ab8354294e359cabfca999283d5a Sep 08 11:25:11.570993 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-TestNetworkBasicOps-1488807265 Sep 08 11:25:11.570993 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-TestNetworkBasicOps-1488807265-project Sep 08 11:25:11.570993 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 11:25:11.570993 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 11:25:11.570993 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 761124676b5e4a8db0bc59740c1f535e Sep 08 11:25:11.570993 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-TestNetworkBasicOps-1488807265-project Sep 08 11:25:11.570993 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 11:25:11.570993 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 9a6f7017-293f-41a6-8df5-aea670d317de could not be found. Sep 08 11:25:11.570993 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '9a6f7017-293f-41a6-8df5-aea670d317de'} Sep 08 11:25:11.570993 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:25:11.570993 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:25:11.570993 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:25:11.570993 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:25:11.570993 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:25:11.570993 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:25:11.570993 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:25:11.570993 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:25:11.570993 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:25:11.570993 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:25:11.570993 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a6f7017-293f-41a6-8df5-aea670d317de could not be found. Sep 08 11:25:11.570993 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:25:11.570993 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:25:11.570993 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:25:11.570993 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:25:11.570993 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:25:11.570993 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:25:11.570993 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:25:11.570993 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:25:11.570993 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:25:11.570993 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:25:11.570993 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:25:11.570993 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:25:11.570993 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:25:11.570993 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:25:11.570993 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:25:11.570993 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:25:11.570993 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a6f7017-293f-41a6-8df5-aea670d317de could not be found. Sep 08 11:25:11.570993 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:25:11.570993 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:25:11.570993 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:25:11.574865 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:25:11.574865 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:25:11.574865 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:25:11.574865 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:25:11.574865 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:25:11.574865 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a6f7017-293f-41a6-8df5-aea670d317de could not be found. Sep 08 11:25:11.574865 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:25:11.574865 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-503137c9-65e3-42f9-af3c-5690d4fdbbdf tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Returning 404 to user: Instance 9a6f7017-293f-41a6-8df5-aea670d317de could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:25:11.574865 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-503137c9-65e3-42f9-af3c-5690d4fdbbdf tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] 10.222.0.27 "GET /compute/v2.1/servers/9a6f7017-293f-41a6-8df5-aea670d317de" status: 404 len: 111 microversion: 2.1 time: 0.032924 Sep 08 11:25:11.574865 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3165/6462] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:25:11 2022] GET /compute/v2.1/servers/9a6f7017-293f-41a6-8df5-aea670d317de => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:25:11.738046 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fcf15c7f-6cc2-4761-9b8c-c5487110d816 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] Calling method '.version_select at 0x7f68df197b80>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:25:11.759699 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fcf15c7f-6cc2-4761-9b8c-c5487110d816 tempest-TestNetworkBasicOps-1488807265 tempest-TestNetworkBasicOps-1488807265-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-5337725" status: 202 len: 0 microversion: 2.1 time: 0.025479 Sep 08 11:25:11.760701 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3298/6463] 10.222.0.27 () {58 vars in 1248 bytes} [Thu Sep 8 11:25:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-5337725 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:25:12.035774 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-10617394-4f9a-4ab3-a67e-57b87eb26f60 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:25:12.036400 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-10617394-4f9a-4ab3-a67e-57b87eb26f60 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] [instance: 06df62d6-464a-455d-b0e8-e83e9008fb4c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:12.043210 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10617394-4f9a-4ab3-a67e-57b87eb26f60 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:12.043723 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10617394-4f9a-4ab3-a67e-57b87eb26f60 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:12.044327 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10617394-4f9a-4ab3-a67e-57b87eb26f60 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:12.045124 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10617394-4f9a-4ab3-a67e-57b87eb26f60 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:12.045524 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10617394-4f9a-4ab3-a67e-57b87eb26f60 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:12.045955 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10617394-4f9a-4ab3-a67e-57b87eb26f60 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:12.269279 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-10617394-4f9a-4ab3-a67e-57b87eb26f60 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/06df62d6-464a-455d-b0e8-e83e9008fb4c" status: 200 len: 1465 microversion: 2.1 time: 0.237183 Sep 08 11:25:12.269864 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3166/6464] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:25:12 2022] GET /compute/v2.1/servers/06df62d6-464a-455d-b0e8-e83e9008fb4c => generated 1465 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:25:12.498233 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-d0a2ced2-0882-44d5-bacc-18abcea722e9 req-4b1e1c9b-1b2f-4444-976d-eae935d6aa90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06df62d6-464a-455d-b0e8-e83e9008fb4c", "name": "network-vif-plugged", "status": "completed", "tag": "32154e43-877a-4c8f-a067-51e79855bedf"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:25:12.512217 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-d0a2ced2-0882-44d5-bacc-18abcea722e9 req-4b1e1c9b-1b2f-4444-976d-eae935d6aa90 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:12.512758 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-d0a2ced2-0882-44d5-bacc-18abcea722e9 req-4b1e1c9b-1b2f-4444-976d-eae935d6aa90 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:12.513240 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-d0a2ced2-0882-44d5-bacc-18abcea722e9 req-4b1e1c9b-1b2f-4444-976d-eae935d6aa90 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:12.524132 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-d0a2ced2-0882-44d5-bacc-18abcea722e9 req-4b1e1c9b-1b2f-4444-976d-eae935d6aa90 service nova] Creating event network-vif-plugged:32154e43-877a-4c8f-a067-51e79855bedf for instance 06df62d6-464a-455d-b0e8-e83e9008fb4c on n-h1-850501-12 Sep 08 11:25:12.530816 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-d0a2ced2-0882-44d5-bacc-18abcea722e9 req-4b1e1c9b-1b2f-4444-976d-eae935d6aa90 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037199 Sep 08 11:25:12.531816 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3299/6465] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:25:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:25:13.294121 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-56f37066-019e-4830-8420-0868f2a2aa0d tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:25:13.295804 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-56f37066-019e-4830-8420-0868f2a2aa0d tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] [instance: 06df62d6-464a-455d-b0e8-e83e9008fb4c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:13.303867 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-56f37066-019e-4830-8420-0868f2a2aa0d tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:13.304437 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-56f37066-019e-4830-8420-0868f2a2aa0d tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:13.304927 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-56f37066-019e-4830-8420-0868f2a2aa0d tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:13.305704 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-56f37066-019e-4830-8420-0868f2a2aa0d tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:13.306337 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-56f37066-019e-4830-8420-0868f2a2aa0d tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:13.306776 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-56f37066-019e-4830-8420-0868f2a2aa0d tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:13.478563 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-56f37066-019e-4830-8420-0868f2a2aa0d tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/06df62d6-464a-455d-b0e8-e83e9008fb4c" status: 200 len: 1465 microversion: 2.1 time: 0.188698 Sep 08 11:25:13.479440 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3167/6466] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:25:13 2022] GET /compute/v2.1/servers/06df62d6-464a-455d-b0e8-e83e9008fb4c => generated 1465 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:25:14.503710 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-42c0982d-e564-4764-8502-57a95fa0f0b7 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:25:14.504358 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-42c0982d-e564-4764-8502-57a95fa0f0b7 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] [instance: 06df62d6-464a-455d-b0e8-e83e9008fb4c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:14.509101 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:25:14.514686 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-42c0982d-e564-4764-8502-57a95fa0f0b7 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:14.515194 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-42c0982d-e564-4764-8502-57a95fa0f0b7 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:14.515642 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-42c0982d-e564-4764-8502-57a95fa0f0b7 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:14.516373 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-42c0982d-e564-4764-8502-57a95fa0f0b7 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:14.516869 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-42c0982d-e564-4764-8502-57a95fa0f0b7 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:14.517341 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-42c0982d-e564-4764-8502-57a95fa0f0b7 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:14.668961 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-42c0982d-e564-4764-8502-57a95fa0f0b7 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/06df62d6-464a-455d-b0e8-e83e9008fb4c" status: 200 len: 1650 microversion: 2.1 time: 0.169369 Sep 08 11:25:14.669627 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3300/6467] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:25:14 2022] GET /compute/v2.1/servers/06df62d6-464a-455d-b0e8-e83e9008fb4c => generated 1650 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:25:14.692251 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f096d81e-2e47-4d7e-9c1f-d4536e811b79 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:25:14.693482 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f096d81e-2e47-4d7e-9c1f-d4536e811b79 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] [instance: 06df62d6-464a-455d-b0e8-e83e9008fb4c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:14.695813 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:25:14.696525 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:25:14.705445 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f096d81e-2e47-4d7e-9c1f-d4536e811b79 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:14.706357 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f096d81e-2e47-4d7e-9c1f-d4536e811b79 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:14.706944 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f096d81e-2e47-4d7e-9c1f-d4536e811b79 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:14.708633 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f096d81e-2e47-4d7e-9c1f-d4536e811b79 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:14.709395 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f096d81e-2e47-4d7e-9c1f-d4536e811b79 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:14.710211 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f096d81e-2e47-4d7e-9c1f-d4536e811b79 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:14.929933 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f096d81e-2e47-4d7e-9c1f-d4536e811b79 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/06df62d6-464a-455d-b0e8-e83e9008fb4c" status: 200 len: 1650 microversion: 2.1 time: 0.241609 Sep 08 11:25:14.930529 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3168/6468] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:25:14 2022] GET /compute/v2.1/servers/06df62d6-464a-455d-b0e8-e83e9008fb4c => generated 1650 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:25:14.955845 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3a25efb7-b126-4688-9724-27903472dfc7 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:25:14.956474 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3a25efb7-b126-4688-9724-27903472dfc7 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] [instance: 06df62d6-464a-455d-b0e8-e83e9008fb4c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:14.964038 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3a25efb7-b126-4688-9724-27903472dfc7 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:14.964559 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3a25efb7-b126-4688-9724-27903472dfc7 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:14.965247 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3a25efb7-b126-4688-9724-27903472dfc7 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:14.965931 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3a25efb7-b126-4688-9724-27903472dfc7 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:14.966428 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3a25efb7-b126-4688-9724-27903472dfc7 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:14.966875 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3a25efb7-b126-4688-9724-27903472dfc7 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:15.220228 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3a25efb7-b126-4688-9724-27903472dfc7 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/06df62d6-464a-455d-b0e8-e83e9008fb4c" status: 200 len: 1650 microversion: 2.1 time: 0.269571 Sep 08 11:25:15.220800 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3301/6469] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:25:14 2022] GET /compute/v2.1/servers/06df62d6-464a-455d-b0e8-e83e9008fb4c => generated 1650 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:25:15.243209 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f8a44425-4b66-4d6a-9996-ae532e17fca8 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:25:15.243708 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f8a44425-4b66-4d6a-9996-ae532e17fca8 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] [instance: 06df62d6-464a-455d-b0e8-e83e9008fb4c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:15.259651 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f8a44425-4b66-4d6a-9996-ae532e17fca8 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:15.260161 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f8a44425-4b66-4d6a-9996-ae532e17fca8 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:15.260798 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f8a44425-4b66-4d6a-9996-ae532e17fca8 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:15.261859 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f8a44425-4b66-4d6a-9996-ae532e17fca8 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:15.262415 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f8a44425-4b66-4d6a-9996-ae532e17fca8 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:15.263096 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f8a44425-4b66-4d6a-9996-ae532e17fca8 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:15.285281 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:25:15.295304 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f8a44425-4b66-4d6a-9996-ae532e17fca8 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] [instance: 06df62d6-464a-455d-b0e8-e83e9008fb4c] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:25:15.399853 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f8a44425-4b66-4d6a-9996-ae532e17fca8 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] 10.222.0.27 "DELETE /compute/v2.1/servers/06df62d6-464a-455d-b0e8-e83e9008fb4c" status: 204 len: 0 microversion: 2.1 time: 0.159564 Sep 08 11:25:15.401509 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3169/6470] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:25:15 2022] DELETE /compute/v2.1/servers/06df62d6-464a-455d-b0e8-e83e9008fb4c => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:25:15.414358 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-096b141a-f522-4c9d-bfd4-d3cfc42d15a6 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:25:15.414358 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-096b141a-f522-4c9d-bfd4-d3cfc42d15a6 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] [instance: 06df62d6-464a-455d-b0e8-e83e9008fb4c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:15.420414 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-096b141a-f522-4c9d-bfd4-d3cfc42d15a6 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:15.420920 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-096b141a-f522-4c9d-bfd4-d3cfc42d15a6 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:15.421384 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-096b141a-f522-4c9d-bfd4-d3cfc42d15a6 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:15.422101 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-096b141a-f522-4c9d-bfd4-d3cfc42d15a6 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:15.422562 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-096b141a-f522-4c9d-bfd4-d3cfc42d15a6 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:15.423134 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-096b141a-f522-4c9d-bfd4-d3cfc42d15a6 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:15.578216 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-096b141a-f522-4c9d-bfd4-d3cfc42d15a6 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/06df62d6-464a-455d-b0e8-e83e9008fb4c" status: 200 len: 1656 microversion: 2.1 time: 0.171465 Sep 08 11:25:15.579359 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3302/6471] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:25:15 2022] GET /compute/v2.1/servers/06df62d6-464a-455d-b0e8-e83e9008fb4c => generated 1656 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:25:16.607122 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7e5bea30-b1ad-4a81-9d92-4cefe0c5c746 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:25:16.607888 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7e5bea30-b1ad-4a81-9d92-4cefe0c5c746 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] [instance: 06df62d6-464a-455d-b0e8-e83e9008fb4c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:16.616473 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e5bea30-b1ad-4a81-9d92-4cefe0c5c746 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:16.617261 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e5bea30-b1ad-4a81-9d92-4cefe0c5c746 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:16.617722 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e5bea30-b1ad-4a81-9d92-4cefe0c5c746 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:16.619003 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e5bea30-b1ad-4a81-9d92-4cefe0c5c746 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:16.619647 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e5bea30-b1ad-4a81-9d92-4cefe0c5c746 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:16.620386 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e5bea30-b1ad-4a81-9d92-4cefe0c5c746 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:16.792207 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7e5bea30-b1ad-4a81-9d92-4cefe0c5c746 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/06df62d6-464a-455d-b0e8-e83e9008fb4c" status: 200 len: 1656 microversion: 2.1 time: 0.191228 Sep 08 11:25:16.792719 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3170/6472] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:25:16 2022] GET /compute/v2.1/servers/06df62d6-464a-455d-b0e8-e83e9008fb4c => generated 1656 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:25:17.379213 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-8541799b-c2bf-4789-b3ef-74b9de25d85f req-972bfc20-06db-495e-8c26-7d290a8694f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06df62d6-464a-455d-b0e8-e83e9008fb4c", "name": "network-vif-deleted", "tag": "32154e43-877a-4c8f-a067-51e79855bedf"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:25:17.419175 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-8541799b-c2bf-4789-b3ef-74b9de25d85f req-972bfc20-06db-495e-8c26-7d290a8694f8 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:17.420148 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-8541799b-c2bf-4789-b3ef-74b9de25d85f req-972bfc20-06db-495e-8c26-7d290a8694f8 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:17.420664 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-8541799b-c2bf-4789-b3ef-74b9de25d85f req-972bfc20-06db-495e-8c26-7d290a8694f8 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:17.439394 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-8541799b-c2bf-4789-b3ef-74b9de25d85f req-972bfc20-06db-495e-8c26-7d290a8694f8 service nova] Creating event network-vif-deleted:32154e43-877a-4c8f-a067-51e79855bedf for instance 06df62d6-464a-455d-b0e8-e83e9008fb4c on n-h1-850501-12 Sep 08 11:25:17.458964 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-8541799b-c2bf-4789-b3ef-74b9de25d85f req-972bfc20-06db-495e-8c26-7d290a8694f8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085600 Sep 08 11:25:17.463644 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3303/6473] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:25:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:25:17.816937 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b8b5d7dc-61bb-4dbc-950e-c4a8d86d2043 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:25:17.817652 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b8b5d7dc-61bb-4dbc-950e-c4a8d86d2043 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] [instance: 06df62d6-464a-455d-b0e8-e83e9008fb4c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:17.825724 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8b5d7dc-61bb-4dbc-950e-c4a8d86d2043 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:17.826232 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8b5d7dc-61bb-4dbc-950e-c4a8d86d2043 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:17.826681 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8b5d7dc-61bb-4dbc-950e-c4a8d86d2043 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:17.827649 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8b5d7dc-61bb-4dbc-950e-c4a8d86d2043 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:17.828222 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8b5d7dc-61bb-4dbc-950e-c4a8d86d2043 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:17.828726 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8b5d7dc-61bb-4dbc-950e-c4a8d86d2043 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:17.865498 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8b5d7dc-61bb-4dbc-950e-c4a8d86d2043 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:17.865708 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8b5d7dc-61bb-4dbc-950e-c4a8d86d2043 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:17.866136 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8b5d7dc-61bb-4dbc-950e-c4a8d86d2043 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:17.866601 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-b8b5d7dc-61bb-4dbc-950e-c4a8d86d2043 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lazy-loading 'fault' on Instance uuid 06df62d6-464a-455d-b0e8-e83e9008fb4c {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:25:17.943231 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b8b5d7dc-61bb-4dbc-950e-c4a8d86d2043 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/06df62d6-464a-455d-b0e8-e83e9008fb4c" status: 200 len: 1455 microversion: 2.1 time: 0.129847 Sep 08 11:25:17.944050 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3171/6474] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:25:17 2022] GET /compute/v2.1/servers/06df62d6-464a-455d-b0e8-e83e9008fb4c => generated 1455 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:25:18.973255 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4dc02e6e-96de-410b-8a41-98bf869752fa tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:25:18.974557 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4dc02e6e-96de-410b-8a41-98bf869752fa tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] [instance: 06df62d6-464a-455d-b0e8-e83e9008fb4c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:18.982083 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4dc02e6e-96de-410b-8a41-98bf869752fa tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:18.983091 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4dc02e6e-96de-410b-8a41-98bf869752fa tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:18.983705 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4dc02e6e-96de-410b-8a41-98bf869752fa tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:18.984546 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4dc02e6e-96de-410b-8a41-98bf869752fa tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:18.985274 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4dc02e6e-96de-410b-8a41-98bf869752fa tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:18.985708 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4dc02e6e-96de-410b-8a41-98bf869752fa tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:19.001343 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-4dc02e6e-96de-410b-8a41-98bf869752fa tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] HTTP exception thrown: Instance 06df62d6-464a-455d-b0e8-e83e9008fb4c could not be found. Sep 08 11:25:19.003414 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4dc02e6e-96de-410b-8a41-98bf869752fa tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Request method failure captured: Sep 08 11:25:19.003414 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/06df62d6-464a-455d-b0e8-e83e9008fb4c HTTP/1.1 Sep 08 11:25:19.003414 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:25:19.003414 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:25:19.003414 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:25:19.003414 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 11:25:19.003414 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:25:19.003414 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:25:19.003414 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:25:19.003414 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:25:19.003414 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGdEDgtq8Mn2Yl1gKFWdk00Wk0Cp0a_6TVNkfqXxwdkShs9xV-9HNrHPd7_vVWYmiSzZN4qsS8Vu8nMQ9uU8TMxZWERQoy7Ee0JmWqjpS_NAD5XDyGZrY_NjIpJdZkg4ksodCleXuiypFYG8fLl9_vvo5dlB4QZk806i3P8JjPABvUP8 Sep 08 11:25:19.003414 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:25:19.003414 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:25:19.003414 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:25:19.003414 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:25:19.003414 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:25:19.003414 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:25:19.003414 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 37600c283df4428ca12e4008470eb25a Sep 08 11:25:19.003414 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-TestServerMultinode-296174608 Sep 08 11:25:19.003414 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,admin,member Sep 08 11:25:19.003414 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,admin,member Sep 08 11:25:19.003414 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/37600c283df4428ca12e4008470eb25a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/37600c283df4428ca12e4008470eb25a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_37600c283df4428ca12e4008470eb25a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/37600c283df4428ca12e4008470eb25a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:25:19.003414 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-TestServerMultinode-296174608 Sep 08 11:25:19.003414 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 37600c283df4428ca12e4008470eb25a Sep 08 11:25:19.003414 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-TestServerMultinode-296174608 Sep 08 11:25:19.003414 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-TestServerMultinode-296174608-project-admin Sep 08 11:25:19.003414 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:25:19.003414 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:25:19.003414 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 9859c5e819714ca4bc9a694743219b1e Sep 08 11:25:19.003414 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-TestServerMultinode-296174608-project-admin Sep 08 11:25:19.003414 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 11:25:19.003414 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 06df62d6-464a-455d-b0e8-e83e9008fb4c could not be found. Sep 08 11:25:19.003414 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '06df62d6-464a-455d-b0e8-e83e9008fb4c'} Sep 08 11:25:19.003414 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:25:19.003414 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:25:19.003414 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:25:19.003414 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:25:19.003414 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:25:19.003414 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:25:19.003414 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:25:19.003414 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:25:19.003414 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:25:19.003414 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:25:19.003414 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06df62d6-464a-455d-b0e8-e83e9008fb4c could not be found. Sep 08 11:25:19.003414 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:25:19.003414 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:25:19.003414 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:25:19.003414 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:25:19.003414 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:25:19.003414 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:25:19.003414 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:25:19.003414 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:25:19.003414 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:25:19.003414 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:25:19.003414 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:25:19.003414 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:25:19.003414 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:25:19.003414 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:25:19.003414 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:25:19.003414 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:25:19.003414 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06df62d6-464a-455d-b0e8-e83e9008fb4c could not be found. Sep 08 11:25:19.003414 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:25:19.003414 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:25:19.003414 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:25:19.007004 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:25:19.007004 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:25:19.007004 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:25:19.007004 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:25:19.007004 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:25:19.007004 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06df62d6-464a-455d-b0e8-e83e9008fb4c could not be found. Sep 08 11:25:19.007004 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:25:19.007004 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4dc02e6e-96de-410b-8a41-98bf869752fa tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Returning 404 to user: Instance 06df62d6-464a-455d-b0e8-e83e9008fb4c could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:25:19.007004 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4dc02e6e-96de-410b-8a41-98bf869752fa tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/06df62d6-464a-455d-b0e8-e83e9008fb4c" status: 404 len: 111 microversion: 2.1 time: 0.038212 Sep 08 11:25:19.007004 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3304/6475] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:25:18 2022] GET /compute/v2.1/servers/06df62d6-464a-455d-b0e8-e83e9008fb4c => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:25:19.015561 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5bea7ed9-f169-4449-afe3-749676ef7be4 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:25:19.016064 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5bea7ed9-f169-4449-afe3-749676ef7be4 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] [instance: feaa887b-3ece-4a97-918a-8610910bf1f1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:19.022972 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5bea7ed9-f169-4449-afe3-749676ef7be4 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:19.023399 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5bea7ed9-f169-4449-afe3-749676ef7be4 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:19.023833 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5bea7ed9-f169-4449-afe3-749676ef7be4 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:19.024717 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5bea7ed9-f169-4449-afe3-749676ef7be4 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:19.025208 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5bea7ed9-f169-4449-afe3-749676ef7be4 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:19.025636 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5bea7ed9-f169-4449-afe3-749676ef7be4 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:19.053239 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5bea7ed9-f169-4449-afe3-749676ef7be4 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] [instance: feaa887b-3ece-4a97-918a-8610910bf1f1] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:25:19.171177 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5bea7ed9-f169-4449-afe3-749676ef7be4 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] 10.222.0.27 "DELETE /compute/v2.1/servers/feaa887b-3ece-4a97-918a-8610910bf1f1" status: 204 len: 0 microversion: 2.1 time: 0.159068 Sep 08 11:25:19.174958 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3172/6476] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:25:19 2022] DELETE /compute/v2.1/servers/feaa887b-3ece-4a97-918a-8610910bf1f1 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:25:19.180145 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-15e1824b-fba8-4646-990a-ff77be3d9a24 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:25:19.180773 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-15e1824b-fba8-4646-990a-ff77be3d9a24 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] [instance: feaa887b-3ece-4a97-918a-8610910bf1f1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:19.187335 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-15e1824b-fba8-4646-990a-ff77be3d9a24 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:19.187844 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-15e1824b-fba8-4646-990a-ff77be3d9a24 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:19.188344 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-15e1824b-fba8-4646-990a-ff77be3d9a24 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:19.189086 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-15e1824b-fba8-4646-990a-ff77be3d9a24 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:19.189553 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-15e1824b-fba8-4646-990a-ff77be3d9a24 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:19.189993 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-15e1824b-fba8-4646-990a-ff77be3d9a24 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:19.211603 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=100 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:25:19.342904 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-15e1824b-fba8-4646-990a-ff77be3d9a24 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/feaa887b-3ece-4a97-918a-8610910bf1f1" status: 200 len: 1657 microversion: 2.1 time: 0.166538 Sep 08 11:25:19.343480 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3305/6477] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:25:19 2022] GET /compute/v2.1/servers/feaa887b-3ece-4a97-918a-8610910bf1f1 => generated 1657 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:25:20.366650 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8af2c7ce-4442-4458-9bfd-0e708e805f65 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:25:20.367539 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8af2c7ce-4442-4458-9bfd-0e708e805f65 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] [instance: feaa887b-3ece-4a97-918a-8610910bf1f1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:20.375006 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8af2c7ce-4442-4458-9bfd-0e708e805f65 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:20.375513 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8af2c7ce-4442-4458-9bfd-0e708e805f65 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:20.376132 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8af2c7ce-4442-4458-9bfd-0e708e805f65 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:20.376929 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8af2c7ce-4442-4458-9bfd-0e708e805f65 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:20.377512 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8af2c7ce-4442-4458-9bfd-0e708e805f65 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:20.377938 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8af2c7ce-4442-4458-9bfd-0e708e805f65 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:20.907157 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8af2c7ce-4442-4458-9bfd-0e708e805f65 tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/feaa887b-3ece-4a97-918a-8610910bf1f1" status: 200 len: 1657 microversion: 2.1 time: 0.544577 Sep 08 11:25:20.909013 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3173/6478] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:25:20 2022] GET /compute/v2.1/servers/feaa887b-3ece-4a97-918a-8610910bf1f1 => generated 1657 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:25:21.093174 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-75537998-b40e-45dd-ba93-38f404d8b71c req-cb83c495-c3cd-4bf5-9cf4-80556beb0652 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "feaa887b-3ece-4a97-918a-8610910bf1f1", "name": "network-vif-deleted", "tag": "554a0ff2-0452-4459-810c-5d4f9f90fb38"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:25:21.123903 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-75537998-b40e-45dd-ba93-38f404d8b71c req-cb83c495-c3cd-4bf5-9cf4-80556beb0652 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:21.124406 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-75537998-b40e-45dd-ba93-38f404d8b71c req-cb83c495-c3cd-4bf5-9cf4-80556beb0652 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:21.124858 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-75537998-b40e-45dd-ba93-38f404d8b71c req-cb83c495-c3cd-4bf5-9cf4-80556beb0652 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:21.143552 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-75537998-b40e-45dd-ba93-38f404d8b71c req-cb83c495-c3cd-4bf5-9cf4-80556beb0652 service nova] Creating event network-vif-deleted:554a0ff2-0452-4459-810c-5d4f9f90fb38 for instance feaa887b-3ece-4a97-918a-8610910bf1f1 on n-h2-850501-12 Sep 08 11:25:21.156058 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-75537998-b40e-45dd-ba93-38f404d8b71c req-cb83c495-c3cd-4bf5-9cf4-80556beb0652 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074654 Sep 08 11:25:21.157712 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3306/6479] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:25:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:25:21.935245 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-911ff02c-1d21-4b2f-ae05-f4c6f1a66eec tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:25:21.939132 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-911ff02c-1d21-4b2f-ae05-f4c6f1a66eec tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] [instance: feaa887b-3ece-4a97-918a-8610910bf1f1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:21.952051 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-911ff02c-1d21-4b2f-ae05-f4c6f1a66eec tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:21.953530 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-911ff02c-1d21-4b2f-ae05-f4c6f1a66eec tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:21.954345 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-911ff02c-1d21-4b2f-ae05-f4c6f1a66eec tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:21.955423 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-911ff02c-1d21-4b2f-ae05-f4c6f1a66eec tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:21.956127 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-911ff02c-1d21-4b2f-ae05-f4c6f1a66eec tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:21.958191 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-911ff02c-1d21-4b2f-ae05-f4c6f1a66eec tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:21.996767 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-911ff02c-1d21-4b2f-ae05-f4c6f1a66eec tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] HTTP exception thrown: Instance feaa887b-3ece-4a97-918a-8610910bf1f1 could not be found. Sep 08 11:25:21.998579 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-911ff02c-1d21-4b2f-ae05-f4c6f1a66eec tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Request method failure captured: Sep 08 11:25:21.998579 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/feaa887b-3ece-4a97-918a-8610910bf1f1 HTTP/1.1 Sep 08 11:25:21.998579 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 11:25:21.998579 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 11:25:21.998579 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 11:25:21.998579 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 11:25:21.998579 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 11:25:21.998579 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 11:25:21.998579 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 11:25:21.998579 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 11:25:21.998579 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGdEDgtq8Mn2Yl1gKFWdk00Wk0Cp0a_6TVNkfqXxwdkShs9xV-9HNrHPd7_vVWYmiSzZN4qsS8Vu8nMQ9uU8TMxZWERQoy7Ee0JmWqjpS_NAD5XDyGZrY_NjIpJdZkg4ksodCleXuiypFYG8fLl9_vvo5dlB4QZk806i3P8JjPABvUP8 Sep 08 11:25:21.998579 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 11:25:21.998579 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 11:25:21.998579 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 11:25:21.998579 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 11:25:21.998579 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 11:25:21.998579 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 11:25:21.998579 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 37600c283df4428ca12e4008470eb25a Sep 08 11:25:21.998579 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-TestServerMultinode-296174608 Sep 08 11:25:21.998579 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,admin,member Sep 08 11:25:21.998579 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,admin,member Sep 08 11:25:21.998579 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/37600c283df4428ca12e4008470eb25a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/37600c283df4428ca12e4008470eb25a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_37600c283df4428ca12e4008470eb25a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/37600c283df4428ca12e4008470eb25a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:25:21.998579 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-TestServerMultinode-296174608 Sep 08 11:25:21.998579 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 37600c283df4428ca12e4008470eb25a Sep 08 11:25:21.998579 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-TestServerMultinode-296174608 Sep 08 11:25:21.998579 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-TestServerMultinode-296174608-project-admin Sep 08 11:25:21.998579 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 11:25:21.998579 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 11:25:21.998579 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 9859c5e819714ca4bc9a694743219b1e Sep 08 11:25:21.998579 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-TestServerMultinode-296174608-project-admin Sep 08 11:25:21.998579 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 11:25:21.998579 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance feaa887b-3ece-4a97-918a-8610910bf1f1 could not be found. Sep 08 11:25:21.998579 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'feaa887b-3ece-4a97-918a-8610910bf1f1'} Sep 08 11:25:21.998579 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:25:21.998579 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:25:21.998579 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:25:21.998579 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:25:21.998579 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:25:21.998579 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:25:21.998579 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:25:21.998579 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:25:21.998579 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:25:21.998579 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:25:21.998579 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance feaa887b-3ece-4a97-918a-8610910bf1f1 could not be found. Sep 08 11:25:21.998579 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:25:21.998579 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:25:21.998579 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:25:21.998579 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:25:21.998579 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:25:21.998579 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:25:21.998579 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:25:21.998579 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:25:21.998579 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:25:21.998579 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:25:21.998579 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:25:21.998579 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:25:21.998579 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:25:21.998579 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:25:21.998579 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:25:21.998579 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:25:21.998579 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance feaa887b-3ece-4a97-918a-8610910bf1f1 could not be found. Sep 08 11:25:21.998579 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:25:21.998579 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:25:21.998579 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:25:22.003044 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:25:22.003044 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:25:22.003044 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:25:22.003044 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:25:22.003044 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:25:22.003044 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance feaa887b-3ece-4a97-918a-8610910bf1f1 could not be found. Sep 08 11:25:22.003044 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:25:22.005226 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-911ff02c-1d21-4b2f-ae05-f4c6f1a66eec tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] Returning 404 to user: Instance feaa887b-3ece-4a97-918a-8610910bf1f1 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:25:22.006896 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-911ff02c-1d21-4b2f-ae05-f4c6f1a66eec tempest-TestServerMultinode-296174608 tempest-TestServerMultinode-296174608-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/feaa887b-3ece-4a97-918a-8610910bf1f1" status: 404 len: 111 microversion: 2.1 time: 0.076246 Sep 08 11:25:22.008098 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3174/6480] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:25:21 2022] GET /compute/v2.1/servers/feaa887b-3ece-4a97-918a-8610910bf1f1 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:25:32.342974 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-29502f57-bbb6-44c4-8733-6f68c68ce8b2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1275613041", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "a2a7174e-22fd-4803-904a-06caa95d8c3b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6c224653-dc3b-48b8-9084-30761e623f71"}]}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:25:32.353951 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:25:32.354619 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=4 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:25:32.435053 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-29502f57-bbb6-44c4-8733-6f68c68ce8b2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] validate_networks() for [('6c224653-dc3b-48b8-9084-30761e623f71', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:25:32.932148 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-29502f57-bbb6-44c4-8733-6f68c68ce8b2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:25:32.932666 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-29502f57-bbb6-44c4-8733-6f68c68ce8b2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:25:32.933802 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-29502f57-bbb6-44c4-8733-6f68c68ce8b2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:25:32.934275 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-29502f57-bbb6-44c4-8733-6f68c68ce8b2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:25:32.934801 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-29502f57-bbb6-44c4-8733-6f68c68ce8b2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:25:32.944953 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-29502f57-bbb6-44c4-8733-6f68c68ce8b2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:32.945522 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-29502f57-bbb6-44c4-8733-6f68c68ce8b2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:32.945979 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-29502f57-bbb6-44c4-8733-6f68c68ce8b2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:32.947887 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-29502f57-bbb6-44c4-8733-6f68c68ce8b2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:32.948460 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-29502f57-bbb6-44c4-8733-6f68c68ce8b2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:32.949500 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-29502f57-bbb6-44c4-8733-6f68c68ce8b2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:32.968968 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-29502f57-bbb6-44c4-8733-6f68c68ce8b2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Getting quotas for project 747bb5860ba14a20bba3b1c2197ea75d. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:25:32.975212 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-29502f57-bbb6-44c4-8733-6f68c68ce8b2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Getting quotas for user bc18639e461e4ef5bfcf4380c561f329 and project 747bb5860ba14a20bba3b1c2197ea75d. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:25:33.041120 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-29502f57-bbb6-44c4-8733-6f68c68ce8b2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:25:33.044544 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-29502f57-bbb6-44c4-8733-6f68c68ce8b2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 80ad72b4-4f10-4b6e-960f-a8e093f5e3e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a2a7174e-22fd-4803-904a-06caa95d8c3b',volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:25:33.224700 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-29502f57-bbb6-44c4-8733-6f68c68ce8b2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.886672 Sep 08 11:25:33.226240 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3307/6481] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 11:25:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 889 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:25:33.242932 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-04be9a72-648c-4e79-8aea-4da9a6cc2380 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:25:33.243840 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-04be9a72-648c-4e79-8aea-4da9a6cc2380 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 80ad72b4-4f10-4b6e-960f-a8e093f5e3e3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:33.248761 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:25:33.249472 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:25:33.316771 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-04be9a72-648c-4e79-8aea-4da9a6cc2380 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:25:33.325358 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-04be9a72-648c-4e79-8aea-4da9a6cc2380 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/80ad72b4-4f10-4b6e-960f-a8e093f5e3e3" status: 200 len: 1057 microversion: 2.1 time: 0.086431 Sep 08 11:25:33.328966 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3175/6482] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:25:33 2022] GET /compute/v2.1/servers/80ad72b4-4f10-4b6e-960f-a8e093f5e3e3 => generated 1057 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:25:34.352899 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1b9a2e5c-b376-47f5-ac10-cc59c0423b4e tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:25:34.353559 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1b9a2e5c-b376-47f5-ac10-cc59c0423b4e tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 80ad72b4-4f10-4b6e-960f-a8e093f5e3e3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:34.361247 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1b9a2e5c-b376-47f5-ac10-cc59c0423b4e tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:34.361755 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1b9a2e5c-b376-47f5-ac10-cc59c0423b4e tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:34.362193 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1b9a2e5c-b376-47f5-ac10-cc59c0423b4e tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:34.362939 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1b9a2e5c-b376-47f5-ac10-cc59c0423b4e tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:34.363398 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1b9a2e5c-b376-47f5-ac10-cc59c0423b4e tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:34.363829 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1b9a2e5c-b376-47f5-ac10-cc59c0423b4e tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:34.430115 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1b9a2e5c-b376-47f5-ac10-cc59c0423b4e tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:25:34.438564 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1b9a2e5c-b376-47f5-ac10-cc59c0423b4e tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/80ad72b4-4f10-4b6e-960f-a8e093f5e3e3" status: 200 len: 1155 microversion: 2.1 time: 0.090526 Sep 08 11:25:34.439187 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3308/6483] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:25:34 2022] GET /compute/v2.1/servers/80ad72b4-4f10-4b6e-960f-a8e093f5e3e3 => generated 1155 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:25:35.465194 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-06e1a333-231a-4f44-8990-8e8cc430bd0d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:25:35.465930 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-06e1a333-231a-4f44-8990-8e8cc430bd0d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 80ad72b4-4f10-4b6e-960f-a8e093f5e3e3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:35.473304 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-06e1a333-231a-4f44-8990-8e8cc430bd0d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:35.473885 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-06e1a333-231a-4f44-8990-8e8cc430bd0d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:35.474574 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-06e1a333-231a-4f44-8990-8e8cc430bd0d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:35.475651 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-06e1a333-231a-4f44-8990-8e8cc430bd0d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:35.476218 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-06e1a333-231a-4f44-8990-8e8cc430bd0d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:35.476727 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-06e1a333-231a-4f44-8990-8e8cc430bd0d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:35.691367 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-06e1a333-231a-4f44-8990-8e8cc430bd0d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:25:35.704862 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-06e1a333-231a-4f44-8990-8e8cc430bd0d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/80ad72b4-4f10-4b6e-960f-a8e093f5e3e3" status: 200 len: 1215 microversion: 2.1 time: 0.246153 Sep 08 11:25:35.719298 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3176/6484] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:25:35 2022] GET /compute/v2.1/servers/80ad72b4-4f10-4b6e-960f-a8e093f5e3e3 => generated 1215 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:25:36.000390 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-b211df48-f12f-4cf3-9a46-5f28aac8d25a req-84c3cc40-3395-4756-bd65-70dc664a9a3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80ad72b4-4f10-4b6e-960f-a8e093f5e3e3", "tag": "b0dd684e-aef0-4213-97e5-5809e02c7bbe"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:25:36.012948 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-b211df48-f12f-4cf3-9a46-5f28aac8d25a req-84c3cc40-3395-4756-bd65-70dc664a9a3f service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:36.013741 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-b211df48-f12f-4cf3-9a46-5f28aac8d25a req-84c3cc40-3395-4756-bd65-70dc664a9a3f service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:36.014339 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-b211df48-f12f-4cf3-9a46-5f28aac8d25a req-84c3cc40-3395-4756-bd65-70dc664a9a3f service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:36.028112 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-b211df48-f12f-4cf3-9a46-5f28aac8d25a req-84c3cc40-3395-4756-bd65-70dc664a9a3f service nova] Creating event network-changed:b0dd684e-aef0-4213-97e5-5809e02c7bbe for instance 80ad72b4-4f10-4b6e-960f-a8e093f5e3e3 on n-h1-850501-12 Sep 08 11:25:36.035059 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-b211df48-f12f-4cf3-9a46-5f28aac8d25a req-84c3cc40-3395-4756-bd65-70dc664a9a3f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039231 Sep 08 11:25:36.036510 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3309/6485] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:25:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:25:36.734375 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bb483519-49ad-4a07-8502-8d01d53e4a62 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:25:36.735673 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bb483519-49ad-4a07-8502-8d01d53e4a62 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 80ad72b4-4f10-4b6e-960f-a8e093f5e3e3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:36.742526 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb483519-49ad-4a07-8502-8d01d53e4a62 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:36.743023 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb483519-49ad-4a07-8502-8d01d53e4a62 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:36.743465 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb483519-49ad-4a07-8502-8d01d53e4a62 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:36.744179 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb483519-49ad-4a07-8502-8d01d53e4a62 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:36.744643 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb483519-49ad-4a07-8502-8d01d53e4a62 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:36.745119 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb483519-49ad-4a07-8502-8d01d53e4a62 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:36.984418 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bb483519-49ad-4a07-8502-8d01d53e4a62 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:25:36.992484 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bb483519-49ad-4a07-8502-8d01d53e4a62 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/80ad72b4-4f10-4b6e-960f-a8e093f5e3e3" status: 200 len: 1215 microversion: 2.1 time: 0.262447 Sep 08 11:25:36.993241 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3177/6486] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:25:36 2022] GET /compute/v2.1/servers/80ad72b4-4f10-4b6e-960f-a8e093f5e3e3 => generated 1215 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:25:38.017415 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1701ccb7-5db6-41b0-a577-250b9c7b0cab tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:25:38.018224 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1701ccb7-5db6-41b0-a577-250b9c7b0cab tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 80ad72b4-4f10-4b6e-960f-a8e093f5e3e3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:38.025463 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1701ccb7-5db6-41b0-a577-250b9c7b0cab tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:38.025953 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1701ccb7-5db6-41b0-a577-250b9c7b0cab tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:38.026524 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1701ccb7-5db6-41b0-a577-250b9c7b0cab tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:38.027747 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1701ccb7-5db6-41b0-a577-250b9c7b0cab tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:38.028278 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1701ccb7-5db6-41b0-a577-250b9c7b0cab tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:38.028776 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1701ccb7-5db6-41b0-a577-250b9c7b0cab tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:38.179115 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1701ccb7-5db6-41b0-a577-250b9c7b0cab tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:25:38.187280 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1701ccb7-5db6-41b0-a577-250b9c7b0cab tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/80ad72b4-4f10-4b6e-960f-a8e093f5e3e3" status: 200 len: 1215 microversion: 2.1 time: 0.175091 Sep 08 11:25:38.187866 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3310/6487] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:25:38 2022] GET /compute/v2.1/servers/80ad72b4-4f10-4b6e-960f-a8e093f5e3e3 => generated 1215 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:25:39.211011 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ab268e18-c235-4bd1-a9e4-44c153bd38a2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:25:39.211650 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ab268e18-c235-4bd1-a9e4-44c153bd38a2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 80ad72b4-4f10-4b6e-960f-a8e093f5e3e3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:39.219296 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab268e18-c235-4bd1-a9e4-44c153bd38a2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:39.219813 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab268e18-c235-4bd1-a9e4-44c153bd38a2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:39.220263 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab268e18-c235-4bd1-a9e4-44c153bd38a2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:39.220977 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab268e18-c235-4bd1-a9e4-44c153bd38a2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:39.221472 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab268e18-c235-4bd1-a9e4-44c153bd38a2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:39.221908 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab268e18-c235-4bd1-a9e4-44c153bd38a2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:39.366181 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ab268e18-c235-4bd1-a9e4-44c153bd38a2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:25:39.375479 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ab268e18-c235-4bd1-a9e4-44c153bd38a2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/80ad72b4-4f10-4b6e-960f-a8e093f5e3e3" status: 200 len: 1215 microversion: 2.1 time: 0.168941 Sep 08 11:25:39.376070 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3178/6488] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:25:39 2022] GET /compute/v2.1/servers/80ad72b4-4f10-4b6e-960f-a8e093f5e3e3 => generated 1215 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:25:40.398219 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-68179e49-34c3-4f61-b044-82469394ea58 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:25:40.398833 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-68179e49-34c3-4f61-b044-82469394ea58 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 80ad72b4-4f10-4b6e-960f-a8e093f5e3e3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:40.405690 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-68179e49-34c3-4f61-b044-82469394ea58 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:40.406179 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-68179e49-34c3-4f61-b044-82469394ea58 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:40.406617 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-68179e49-34c3-4f61-b044-82469394ea58 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:40.407306 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-68179e49-34c3-4f61-b044-82469394ea58 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:40.407765 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-68179e49-34c3-4f61-b044-82469394ea58 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:40.408191 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-68179e49-34c3-4f61-b044-82469394ea58 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:40.539438 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-68179e49-34c3-4f61-b044-82469394ea58 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:25:40.547617 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-68179e49-34c3-4f61-b044-82469394ea58 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/80ad72b4-4f10-4b6e-960f-a8e093f5e3e3" status: 200 len: 1203 microversion: 2.1 time: 0.153281 Sep 08 11:25:40.548185 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3311/6489] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:25:40 2022] GET /compute/v2.1/servers/80ad72b4-4f10-4b6e-960f-a8e093f5e3e3 => generated 1203 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:25:41.571610 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-87fe1b43-40b9-4982-bdac-b6f2f8708186 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:25:41.572244 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-87fe1b43-40b9-4982-bdac-b6f2f8708186 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 80ad72b4-4f10-4b6e-960f-a8e093f5e3e3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:41.579877 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87fe1b43-40b9-4982-bdac-b6f2f8708186 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:41.580540 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87fe1b43-40b9-4982-bdac-b6f2f8708186 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:41.580793 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87fe1b43-40b9-4982-bdac-b6f2f8708186 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:41.581517 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87fe1b43-40b9-4982-bdac-b6f2f8708186 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:41.581977 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87fe1b43-40b9-4982-bdac-b6f2f8708186 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:41.582398 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87fe1b43-40b9-4982-bdac-b6f2f8708186 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:41.718098 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-87fe1b43-40b9-4982-bdac-b6f2f8708186 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:25:41.726151 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-87fe1b43-40b9-4982-bdac-b6f2f8708186 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/80ad72b4-4f10-4b6e-960f-a8e093f5e3e3" status: 200 len: 1203 microversion: 2.1 time: 0.158665 Sep 08 11:25:41.726744 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3179/6490] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:25:41 2022] GET /compute/v2.1/servers/80ad72b4-4f10-4b6e-960f-a8e093f5e3e3 => generated 1203 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:25:42.749257 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4362978b-06ca-4e36-b1e4-69cce09773ab tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:25:42.749916 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4362978b-06ca-4e36-b1e4-69cce09773ab tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 80ad72b4-4f10-4b6e-960f-a8e093f5e3e3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:42.756934 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4362978b-06ca-4e36-b1e4-69cce09773ab tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:42.757465 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4362978b-06ca-4e36-b1e4-69cce09773ab tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:42.757935 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4362978b-06ca-4e36-b1e4-69cce09773ab tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:42.758645 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4362978b-06ca-4e36-b1e4-69cce09773ab tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:42.759108 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4362978b-06ca-4e36-b1e4-69cce09773ab tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:42.759543 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4362978b-06ca-4e36-b1e4-69cce09773ab tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:42.891430 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4362978b-06ca-4e36-b1e4-69cce09773ab tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:25:42.899576 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4362978b-06ca-4e36-b1e4-69cce09773ab tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/80ad72b4-4f10-4b6e-960f-a8e093f5e3e3" status: 200 len: 1203 microversion: 2.1 time: 0.154295 Sep 08 11:25:42.900147 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3312/6491] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:25:42 2022] GET /compute/v2.1/servers/80ad72b4-4f10-4b6e-960f-a8e093f5e3e3 => generated 1203 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:25:43.924833 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1b33a957-4292-444f-9e77-db9d81b37d3d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:25:43.925517 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1b33a957-4292-444f-9e77-db9d81b37d3d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 80ad72b4-4f10-4b6e-960f-a8e093f5e3e3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:43.928127 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:25:43.933638 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b33a957-4292-444f-9e77-db9d81b37d3d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:43.934123 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b33a957-4292-444f-9e77-db9d81b37d3d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:43.934561 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b33a957-4292-444f-9e77-db9d81b37d3d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:43.935910 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b33a957-4292-444f-9e77-db9d81b37d3d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:43.936479 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b33a957-4292-444f-9e77-db9d81b37d3d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:43.936909 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b33a957-4292-444f-9e77-db9d81b37d3d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:44.065066 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1b33a957-4292-444f-9e77-db9d81b37d3d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:25:44.072813 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1b33a957-4292-444f-9e77-db9d81b37d3d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/80ad72b4-4f10-4b6e-960f-a8e093f5e3e3" status: 200 len: 1203 microversion: 2.1 time: 0.151957 Sep 08 11:25:44.073423 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3180/6492] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:25:43 2022] GET /compute/v2.1/servers/80ad72b4-4f10-4b6e-960f-a8e093f5e3e3 => generated 1203 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:25:45.096476 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cab902ab-53d6-4395-b61c-836513e7d76a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:25:45.097182 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cab902ab-53d6-4395-b61c-836513e7d76a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 80ad72b4-4f10-4b6e-960f-a8e093f5e3e3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:45.099298 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:25:45.100446 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=6 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:25:45.108028 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cab902ab-53d6-4395-b61c-836513e7d76a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:45.108666 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cab902ab-53d6-4395-b61c-836513e7d76a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:45.109142 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cab902ab-53d6-4395-b61c-836513e7d76a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:45.109862 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cab902ab-53d6-4395-b61c-836513e7d76a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:45.110328 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cab902ab-53d6-4395-b61c-836513e7d76a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:45.110758 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cab902ab-53d6-4395-b61c-836513e7d76a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:45.251249 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-cab902ab-53d6-4395-b61c-836513e7d76a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:25:45.259941 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cab902ab-53d6-4395-b61c-836513e7d76a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/80ad72b4-4f10-4b6e-960f-a8e093f5e3e3" status: 200 len: 1203 microversion: 2.1 time: 0.168499 Sep 08 11:25:45.260533 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3313/6493] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:25:45 2022] GET /compute/v2.1/servers/80ad72b4-4f10-4b6e-960f-a8e093f5e3e3 => generated 1203 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:25:46.283290 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6144126d-dccc-474d-b752-ffa1115d7d62 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:25:46.283906 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6144126d-dccc-474d-b752-ffa1115d7d62 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 80ad72b4-4f10-4b6e-960f-a8e093f5e3e3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:46.290767 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6144126d-dccc-474d-b752-ffa1115d7d62 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:46.291267 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6144126d-dccc-474d-b752-ffa1115d7d62 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:46.291695 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6144126d-dccc-474d-b752-ffa1115d7d62 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:46.292384 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6144126d-dccc-474d-b752-ffa1115d7d62 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:46.292843 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6144126d-dccc-474d-b752-ffa1115d7d62 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:46.293302 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6144126d-dccc-474d-b752-ffa1115d7d62 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:46.428748 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6144126d-dccc-474d-b752-ffa1115d7d62 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:25:46.437012 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6144126d-dccc-474d-b752-ffa1115d7d62 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/80ad72b4-4f10-4b6e-960f-a8e093f5e3e3" status: 200 len: 1203 microversion: 2.1 time: 0.158328 Sep 08 11:25:46.437637 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3181/6494] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:25:46 2022] GET /compute/v2.1/servers/80ad72b4-4f10-4b6e-960f-a8e093f5e3e3 => generated 1203 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:25:47.459562 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-033a5a5b-f332-45ab-b98c-c763f8828dd5 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:25:47.460185 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-033a5a5b-f332-45ab-b98c-c763f8828dd5 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 80ad72b4-4f10-4b6e-960f-a8e093f5e3e3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:47.467196 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-033a5a5b-f332-45ab-b98c-c763f8828dd5 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:47.467686 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-033a5a5b-f332-45ab-b98c-c763f8828dd5 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:47.468125 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-033a5a5b-f332-45ab-b98c-c763f8828dd5 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:47.468822 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-033a5a5b-f332-45ab-b98c-c763f8828dd5 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:47.469309 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-033a5a5b-f332-45ab-b98c-c763f8828dd5 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:47.469741 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-033a5a5b-f332-45ab-b98c-c763f8828dd5 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:47.604613 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-033a5a5b-f332-45ab-b98c-c763f8828dd5 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:25:47.613059 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-033a5a5b-f332-45ab-b98c-c763f8828dd5 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/80ad72b4-4f10-4b6e-960f-a8e093f5e3e3" status: 200 len: 1203 microversion: 2.1 time: 0.157720 Sep 08 11:25:47.613631 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3314/6495] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:25:47 2022] GET /compute/v2.1/servers/80ad72b4-4f10-4b6e-960f-a8e093f5e3e3 => generated 1203 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:25:48.635912 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-80b9e030-e148-478f-863e-a97857bff2e3 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:25:48.636750 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-80b9e030-e148-478f-863e-a97857bff2e3 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 80ad72b4-4f10-4b6e-960f-a8e093f5e3e3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:48.644796 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80b9e030-e148-478f-863e-a97857bff2e3 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:48.645341 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80b9e030-e148-478f-863e-a97857bff2e3 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:48.645774 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80b9e030-e148-478f-863e-a97857bff2e3 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:48.646489 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80b9e030-e148-478f-863e-a97857bff2e3 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:48.646951 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80b9e030-e148-478f-863e-a97857bff2e3 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:48.647379 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80b9e030-e148-478f-863e-a97857bff2e3 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:48.671851 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-6bea2ba0-d3f0-4245-a0b1-c5d413d60b1e req-e9033d63-2d18-45ef-920b-91c019f36d90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80ad72b4-4f10-4b6e-960f-a8e093f5e3e3", "name": "network-vif-plugged", "status": "completed", "tag": "b0dd684e-aef0-4213-97e5-5809e02c7bbe"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:25:48.686916 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-6bea2ba0-d3f0-4245-a0b1-c5d413d60b1e req-e9033d63-2d18-45ef-920b-91c019f36d90 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:48.687513 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-6bea2ba0-d3f0-4245-a0b1-c5d413d60b1e req-e9033d63-2d18-45ef-920b-91c019f36d90 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:48.688030 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-6bea2ba0-d3f0-4245-a0b1-c5d413d60b1e req-e9033d63-2d18-45ef-920b-91c019f36d90 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:48.701779 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-6bea2ba0-d3f0-4245-a0b1-c5d413d60b1e req-e9033d63-2d18-45ef-920b-91c019f36d90 service nova] Creating event network-vif-plugged:b0dd684e-aef0-4213-97e5-5809e02c7bbe for instance 80ad72b4-4f10-4b6e-960f-a8e093f5e3e3 on n-h1-850501-12 Sep 08 11:25:48.707309 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-6bea2ba0-d3f0-4245-a0b1-c5d413d60b1e req-e9033d63-2d18-45ef-920b-91c019f36d90 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040773 Sep 08 11:25:48.708299 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3315/6496] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:25:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:25:48.792721 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-80b9e030-e148-478f-863e-a97857bff2e3 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:25:48.801462 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-80b9e030-e148-478f-863e-a97857bff2e3 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/80ad72b4-4f10-4b6e-960f-a8e093f5e3e3" status: 200 len: 1203 microversion: 2.1 time: 0.169469 Sep 08 11:25:48.802060 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3182/6497] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:25:48 2022] GET /compute/v2.1/servers/80ad72b4-4f10-4b6e-960f-a8e093f5e3e3 => generated 1203 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:25:49.823714 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f625b96f-e618-4c11-a1b0-d2c22bfd132f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:25:49.824478 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f625b96f-e618-4c11-a1b0-d2c22bfd132f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 80ad72b4-4f10-4b6e-960f-a8e093f5e3e3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:49.832257 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f625b96f-e618-4c11-a1b0-d2c22bfd132f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:49.832752 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f625b96f-e618-4c11-a1b0-d2c22bfd132f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:49.833231 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f625b96f-e618-4c11-a1b0-d2c22bfd132f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:49.833940 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f625b96f-e618-4c11-a1b0-d2c22bfd132f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:49.834406 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f625b96f-e618-4c11-a1b0-d2c22bfd132f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:49.835089 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f625b96f-e618-4c11-a1b0-d2c22bfd132f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:49.998158 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f625b96f-e618-4c11-a1b0-d2c22bfd132f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:25:50.008253 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f625b96f-e618-4c11-a1b0-d2c22bfd132f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/80ad72b4-4f10-4b6e-960f-a8e093f5e3e3" status: 200 len: 1203 microversion: 2.1 time: 0.188793 Sep 08 11:25:50.008906 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3316/6498] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:25:49 2022] GET /compute/v2.1/servers/80ad72b4-4f10-4b6e-960f-a8e093f5e3e3 => generated 1203 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:25:51.032504 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dcb89d6c-f69b-40d1-adc6-1f8f1918df97 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:25:51.033156 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-dcb89d6c-f69b-40d1-adc6-1f8f1918df97 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 80ad72b4-4f10-4b6e-960f-a8e093f5e3e3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:51.040088 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dcb89d6c-f69b-40d1-adc6-1f8f1918df97 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:51.040590 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dcb89d6c-f69b-40d1-adc6-1f8f1918df97 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:51.041067 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dcb89d6c-f69b-40d1-adc6-1f8f1918df97 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:51.041770 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dcb89d6c-f69b-40d1-adc6-1f8f1918df97 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:51.042234 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dcb89d6c-f69b-40d1-adc6-1f8f1918df97 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:51.042669 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dcb89d6c-f69b-40d1-adc6-1f8f1918df97 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:51.176855 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-dcb89d6c-f69b-40d1-adc6-1f8f1918df97 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:25:51.184875 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-dcb89d6c-f69b-40d1-adc6-1f8f1918df97 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/80ad72b4-4f10-4b6e-960f-a8e093f5e3e3" status: 200 len: 1390 microversion: 2.1 time: 0.157274 Sep 08 11:25:51.186103 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3183/6499] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:25:51 2022] GET /compute/v2.1/servers/80ad72b4-4f10-4b6e-960f-a8e093f5e3e3 => generated 1390 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:25:51.207422 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ac39c1ef-ccf1-4286-9832-86c84ac91c04 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:25:51.208051 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ac39c1ef-ccf1-4286-9832-86c84ac91c04 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 80ad72b4-4f10-4b6e-960f-a8e093f5e3e3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:51.215217 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ac39c1ef-ccf1-4286-9832-86c84ac91c04 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:51.215718 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ac39c1ef-ccf1-4286-9832-86c84ac91c04 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:51.216170 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ac39c1ef-ccf1-4286-9832-86c84ac91c04 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:51.216941 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ac39c1ef-ccf1-4286-9832-86c84ac91c04 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:51.217678 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ac39c1ef-ccf1-4286-9832-86c84ac91c04 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:51.218118 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ac39c1ef-ccf1-4286-9832-86c84ac91c04 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:51.352461 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ac39c1ef-ccf1-4286-9832-86c84ac91c04 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:25:51.360947 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ac39c1ef-ccf1-4286-9832-86c84ac91c04 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/80ad72b4-4f10-4b6e-960f-a8e093f5e3e3" status: 200 len: 1390 microversion: 2.1 time: 0.157407 Sep 08 11:25:51.361564 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3317/6500] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:25:51 2022] GET /compute/v2.1/servers/80ad72b4-4f10-4b6e-960f-a8e093f5e3e3 => generated 1390 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:25:51.383139 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-51017cac-e131-466a-8909-32a0977f488d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:25:51.383761 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-51017cac-e131-466a-8909-32a0977f488d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 80ad72b4-4f10-4b6e-960f-a8e093f5e3e3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:51.390196 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51017cac-e131-466a-8909-32a0977f488d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:51.390694 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51017cac-e131-466a-8909-32a0977f488d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:51.391141 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51017cac-e131-466a-8909-32a0977f488d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:51.391848 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51017cac-e131-466a-8909-32a0977f488d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:51.392317 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51017cac-e131-466a-8909-32a0977f488d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:51.392752 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51017cac-e131-466a-8909-32a0977f488d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:51.524829 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-51017cac-e131-466a-8909-32a0977f488d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:25:51.534136 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-51017cac-e131-466a-8909-32a0977f488d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/80ad72b4-4f10-4b6e-960f-a8e093f5e3e3" status: 200 len: 1390 microversion: 2.1 time: 0.154884 Sep 08 11:25:51.535385 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3184/6501] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:25:51 2022] GET /compute/v2.1/servers/80ad72b4-4f10-4b6e-960f-a8e093f5e3e3 => generated 1390 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:25:51.556581 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cb9ed31a-677e-4b2d-8908-ec6c6c53b19f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:25:51.557089 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cb9ed31a-677e-4b2d-8908-ec6c6c53b19f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 80ad72b4-4f10-4b6e-960f-a8e093f5e3e3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:51.563313 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb9ed31a-677e-4b2d-8908-ec6c6c53b19f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:51.563801 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb9ed31a-677e-4b2d-8908-ec6c6c53b19f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:51.564273 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb9ed31a-677e-4b2d-8908-ec6c6c53b19f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:51.564979 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb9ed31a-677e-4b2d-8908-ec6c6c53b19f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:51.565462 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb9ed31a-677e-4b2d-8908-ec6c6c53b19f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:51.565891 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb9ed31a-677e-4b2d-8908-ec6c6c53b19f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:51.590365 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cb9ed31a-677e-4b2d-8908-ec6c6c53b19f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 80ad72b4-4f10-4b6e-960f-a8e093f5e3e3] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:25:51.670453 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cb9ed31a-677e-4b2d-8908-ec6c6c53b19f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "DELETE /compute/v2.1/servers/80ad72b4-4f10-4b6e-960f-a8e093f5e3e3" status: 204 len: 0 microversion: 2.1 time: 0.116851 Sep 08 11:25:51.671067 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3318/6502] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:25:51 2022] DELETE /compute/v2.1/servers/80ad72b4-4f10-4b6e-960f-a8e093f5e3e3 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:25:51.679298 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6a38a3fb-a6e1-46ea-a876-06fc11790cf0 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:25:51.679923 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6a38a3fb-a6e1-46ea-a876-06fc11790cf0 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 80ad72b4-4f10-4b6e-960f-a8e093f5e3e3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:51.686073 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a38a3fb-a6e1-46ea-a876-06fc11790cf0 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:51.686566 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a38a3fb-a6e1-46ea-a876-06fc11790cf0 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:51.687012 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a38a3fb-a6e1-46ea-a876-06fc11790cf0 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:51.687718 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a38a3fb-a6e1-46ea-a876-06fc11790cf0 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:51.688185 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a38a3fb-a6e1-46ea-a876-06fc11790cf0 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:51.688617 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a38a3fb-a6e1-46ea-a876-06fc11790cf0 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:51.830062 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6a38a3fb-a6e1-46ea-a876-06fc11790cf0 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:25:51.844664 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6a38a3fb-a6e1-46ea-a876-06fc11790cf0 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/80ad72b4-4f10-4b6e-960f-a8e093f5e3e3" status: 200 len: 1396 microversion: 2.1 time: 0.169212 Sep 08 11:25:51.845348 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3185/6503] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:25:51 2022] GET /compute/v2.1/servers/80ad72b4-4f10-4b6e-960f-a8e093f5e3e3 => generated 1396 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:25:52.871923 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3ee00891-3c11-4801-9d1a-6177f25d9aca tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:25:52.872844 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3ee00891-3c11-4801-9d1a-6177f25d9aca tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 80ad72b4-4f10-4b6e-960f-a8e093f5e3e3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:52.881071 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3ee00891-3c11-4801-9d1a-6177f25d9aca tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:52.881667 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3ee00891-3c11-4801-9d1a-6177f25d9aca tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:52.882109 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3ee00891-3c11-4801-9d1a-6177f25d9aca tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:52.882824 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3ee00891-3c11-4801-9d1a-6177f25d9aca tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:52.883282 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3ee00891-3c11-4801-9d1a-6177f25d9aca tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:52.883753 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3ee00891-3c11-4801-9d1a-6177f25d9aca tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:53.039814 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-3ee00891-3c11-4801-9d1a-6177f25d9aca tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:25:53.049443 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3ee00891-3c11-4801-9d1a-6177f25d9aca tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/80ad72b4-4f10-4b6e-960f-a8e093f5e3e3" status: 200 len: 1396 microversion: 2.1 time: 0.181916 Sep 08 11:25:53.050499 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3319/6504] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:25:52 2022] GET /compute/v2.1/servers/80ad72b4-4f10-4b6e-960f-a8e093f5e3e3 => generated 1396 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:25:53.714788 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-3eac1cb2-8ce1-42aa-9a9e-d6c216b81f36 req-d59144a5-79b3-4e3e-b535-42550ec3ac14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80ad72b4-4f10-4b6e-960f-a8e093f5e3e3", "name": "network-vif-deleted", "tag": "b0dd684e-aef0-4213-97e5-5809e02c7bbe"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:25:53.727457 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-3eac1cb2-8ce1-42aa-9a9e-d6c216b81f36 req-d59144a5-79b3-4e3e-b535-42550ec3ac14 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:53.728205 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-3eac1cb2-8ce1-42aa-9a9e-d6c216b81f36 req-d59144a5-79b3-4e3e-b535-42550ec3ac14 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:53.728688 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-3eac1cb2-8ce1-42aa-9a9e-d6c216b81f36 req-d59144a5-79b3-4e3e-b535-42550ec3ac14 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:53.742070 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-3eac1cb2-8ce1-42aa-9a9e-d6c216b81f36 req-d59144a5-79b3-4e3e-b535-42550ec3ac14 service nova] Creating event network-vif-deleted:b0dd684e-aef0-4213-97e5-5809e02c7bbe for instance 80ad72b4-4f10-4b6e-960f-a8e093f5e3e3 on n-h1-850501-12 Sep 08 11:25:53.747463 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-3eac1cb2-8ce1-42aa-9a9e-d6c216b81f36 req-d59144a5-79b3-4e3e-b535-42550ec3ac14 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036252 Sep 08 11:25:53.749229 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3186/6505] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:25:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:25:54.073268 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-49934e6b-3a2a-45b8-8b53-82b2832d2a13 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:25:54.073889 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-49934e6b-3a2a-45b8-8b53-82b2832d2a13 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 80ad72b4-4f10-4b6e-960f-a8e093f5e3e3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:54.081412 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-49934e6b-3a2a-45b8-8b53-82b2832d2a13 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:54.081903 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-49934e6b-3a2a-45b8-8b53-82b2832d2a13 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:54.082338 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-49934e6b-3a2a-45b8-8b53-82b2832d2a13 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:54.083033 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-49934e6b-3a2a-45b8-8b53-82b2832d2a13 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:54.083498 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-49934e6b-3a2a-45b8-8b53-82b2832d2a13 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:54.083925 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-49934e6b-3a2a-45b8-8b53-82b2832d2a13 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:54.147295 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-49934e6b-3a2a-45b8-8b53-82b2832d2a13 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:25:54.155852 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-49934e6b-3a2a-45b8-8b53-82b2832d2a13 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/80ad72b4-4f10-4b6e-960f-a8e093f5e3e3" status: 200 len: 1188 microversion: 2.1 time: 0.086501 Sep 08 11:25:54.156620 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3320/6506] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:25:54 2022] GET /compute/v2.1/servers/80ad72b4-4f10-4b6e-960f-a8e093f5e3e3 => generated 1188 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:25:55.181507 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9173e390-6115-40b5-aaae-f87e6c712fb1 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:25:55.182214 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9173e390-6115-40b5-aaae-f87e6c712fb1 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 80ad72b4-4f10-4b6e-960f-a8e093f5e3e3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:55.188573 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9173e390-6115-40b5-aaae-f87e6c712fb1 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:55.189088 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9173e390-6115-40b5-aaae-f87e6c712fb1 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:55.189528 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9173e390-6115-40b5-aaae-f87e6c712fb1 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:55.190229 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9173e390-6115-40b5-aaae-f87e6c712fb1 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:55.190685 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9173e390-6115-40b5-aaae-f87e6c712fb1 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:55.191106 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9173e390-6115-40b5-aaae-f87e6c712fb1 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:55.256488 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9173e390-6115-40b5-aaae-f87e6c712fb1 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:25:55.265233 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9173e390-6115-40b5-aaae-f87e6c712fb1 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/80ad72b4-4f10-4b6e-960f-a8e093f5e3e3" status: 200 len: 1188 microversion: 2.1 time: 0.089073 Sep 08 11:25:55.265806 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3187/6507] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:25:55 2022] GET /compute/v2.1/servers/80ad72b4-4f10-4b6e-960f-a8e093f5e3e3 => generated 1188 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:25:56.287779 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-72c2aaf9-87a5-41b0-ae96-45683a0b0296 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:25:56.288399 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-72c2aaf9-87a5-41b0-ae96-45683a0b0296 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 80ad72b4-4f10-4b6e-960f-a8e093f5e3e3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:56.296490 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-72c2aaf9-87a5-41b0-ae96-45683a0b0296 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:56.296987 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-72c2aaf9-87a5-41b0-ae96-45683a0b0296 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:56.297594 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-72c2aaf9-87a5-41b0-ae96-45683a0b0296 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:56.298302 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-72c2aaf9-87a5-41b0-ae96-45683a0b0296 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:56.298768 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-72c2aaf9-87a5-41b0-ae96-45683a0b0296 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:56.299201 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-72c2aaf9-87a5-41b0-ae96-45683a0b0296 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:56.363587 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-72c2aaf9-87a5-41b0-ae96-45683a0b0296 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:25:56.371665 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-72c2aaf9-87a5-41b0-ae96-45683a0b0296 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/80ad72b4-4f10-4b6e-960f-a8e093f5e3e3" status: 200 len: 1188 microversion: 2.1 time: 0.087926 Sep 08 11:25:56.372222 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3321/6508] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:25:56 2022] GET /compute/v2.1/servers/80ad72b4-4f10-4b6e-960f-a8e093f5e3e3 => generated 1188 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:25:57.394870 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-901052b5-d75b-4168-9d2e-783b4e1bf160 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:25:57.395427 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-901052b5-d75b-4168-9d2e-783b4e1bf160 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 80ad72b4-4f10-4b6e-960f-a8e093f5e3e3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:57.402445 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-901052b5-d75b-4168-9d2e-783b4e1bf160 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:57.402939 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-901052b5-d75b-4168-9d2e-783b4e1bf160 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:57.403371 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-901052b5-d75b-4168-9d2e-783b4e1bf160 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:57.404064 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-901052b5-d75b-4168-9d2e-783b4e1bf160 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:57.405219 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-901052b5-d75b-4168-9d2e-783b4e1bf160 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:57.405443 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-901052b5-d75b-4168-9d2e-783b4e1bf160 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:57.471536 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-901052b5-d75b-4168-9d2e-783b4e1bf160 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:25:57.479525 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-901052b5-d75b-4168-9d2e-783b4e1bf160 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/80ad72b4-4f10-4b6e-960f-a8e093f5e3e3" status: 200 len: 1188 microversion: 2.1 time: 0.088779 Sep 08 11:25:57.480097 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3188/6509] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:25:57 2022] GET /compute/v2.1/servers/80ad72b4-4f10-4b6e-960f-a8e093f5e3e3 => generated 1188 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:25:58.503581 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8908b741-623f-47ac-8716-9c3a4e9ff175 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:25:58.504151 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8908b741-623f-47ac-8716-9c3a4e9ff175 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 80ad72b4-4f10-4b6e-960f-a8e093f5e3e3] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:58.511268 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8908b741-623f-47ac-8716-9c3a4e9ff175 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:58.511759 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8908b741-623f-47ac-8716-9c3a4e9ff175 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:58.512199 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8908b741-623f-47ac-8716-9c3a4e9ff175 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:58.512898 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8908b741-623f-47ac-8716-9c3a4e9ff175 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:58.513388 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8908b741-623f-47ac-8716-9c3a4e9ff175 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:58.514559 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8908b741-623f-47ac-8716-9c3a4e9ff175 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:58.527934 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-8908b741-623f-47ac-8716-9c3a4e9ff175 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] HTTP exception thrown: Instance 80ad72b4-4f10-4b6e-960f-a8e093f5e3e3 could not be found. Sep 08 11:25:58.529625 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8908b741-623f-47ac-8716-9c3a4e9ff175 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Request method failure captured: Sep 08 11:25:58.529625 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/80ad72b4-4f10-4b6e-960f-a8e093f5e3e3 HTTP/1.1 Sep 08 11:25:58.529625 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:25:58.529625 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:25:58.529625 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:25:58.529625 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 11:25:58.529625 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:25:58.529625 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:25:58.529625 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:25:58.529625 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:25:58.529625 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGdEih_jYhjrfzcEat7QOG_17jH52nIZFToedVJMJ8Jj4pTKrcjanm3D8dChnqEL9d7jV5rq3NW7Z60oajSkgXZAcEtwDn7-PJMU6a9_UOAo8UiiyZ8L4GogQF4UWk_-Vlyi8Q447m99c-S3nr2fWKYhvhV9-SsmuV-ccLSbm0hBFVVM Sep 08 11:25:58.529625 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:25:58.529625 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:25:58.529625 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:25:58.529625 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:25:58.529625 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:25:58.529625 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:25:58.529625 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 747bb5860ba14a20bba3b1c2197ea75d Sep 08 11:25:58.529625 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-TestVolumeBootPattern-1812135790 Sep 08 11:25:58.529625 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:25:58.529625 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:25:58.529625 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/747bb5860ba14a20bba3b1c2197ea75d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/747bb5860ba14a20bba3b1c2197ea75d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_747bb5860ba14a20bba3b1c2197ea75d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/747bb5860ba14a20bba3b1c2197ea75d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:25:58.529625 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-TestVolumeBootPattern-1812135790 Sep 08 11:25:58.529625 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 747bb5860ba14a20bba3b1c2197ea75d Sep 08 11:25:58.529625 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-TestVolumeBootPattern-1812135790 Sep 08 11:25:58.529625 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-TestVolumeBootPattern-1812135790-project Sep 08 11:25:58.529625 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:25:58.529625 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:25:58.529625 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: bc18639e461e4ef5bfcf4380c561f329 Sep 08 11:25:58.529625 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-TestVolumeBootPattern-1812135790-project Sep 08 11:25:58.529625 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 11:25:58.529625 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 80ad72b4-4f10-4b6e-960f-a8e093f5e3e3 could not be found. Sep 08 11:25:58.529625 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '80ad72b4-4f10-4b6e-960f-a8e093f5e3e3'} Sep 08 11:25:58.529625 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:25:58.529625 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:25:58.529625 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:25:58.529625 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:25:58.529625 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:25:58.529625 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:25:58.529625 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:25:58.529625 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:25:58.529625 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:25:58.529625 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:25:58.529625 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80ad72b4-4f10-4b6e-960f-a8e093f5e3e3 could not be found. Sep 08 11:25:58.529625 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:25:58.529625 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:25:58.529625 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:25:58.529625 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:25:58.529625 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:25:58.529625 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:25:58.529625 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:25:58.529625 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:25:58.529625 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:25:58.529625 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:25:58.529625 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:25:58.529625 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:25:58.529625 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:25:58.529625 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:25:58.529625 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:25:58.529625 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:25:58.529625 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80ad72b4-4f10-4b6e-960f-a8e093f5e3e3 could not be found. Sep 08 11:25:58.529625 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:25:58.529625 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:25:58.529625 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:25:58.533613 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:25:58.533613 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:25:58.533613 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:25:58.533613 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:25:58.533613 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:25:58.533613 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80ad72b4-4f10-4b6e-960f-a8e093f5e3e3 could not be found. Sep 08 11:25:58.533613 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:25:58.533613 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8908b741-623f-47ac-8716-9c3a4e9ff175 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Returning 404 to user: Instance 80ad72b4-4f10-4b6e-960f-a8e093f5e3e3 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:25:58.533613 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8908b741-623f-47ac-8716-9c3a4e9ff175 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/80ad72b4-4f10-4b6e-960f-a8e093f5e3e3" status: 404 len: 111 microversion: 2.1 time: 0.032093 Sep 08 11:25:58.533613 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3322/6510] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:25:58 2022] GET /compute/v2.1/servers/80ad72b4-4f10-4b6e-960f-a8e093f5e3e3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:26:03.491426 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8c7ed97e-82ba-4a25-9bd8-a14735e60d76 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-573900756", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "dd588236-7bfc-4506-99a1-59f0b30058c0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6c224653-dc3b-48b8-9084-30761e623f71"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:26:03.502164 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=31 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:26:03.551664 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-8c7ed97e-82ba-4a25-9bd8-a14735e60d76 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] validate_networks() for [('6c224653-dc3b-48b8-9084-30761e623f71', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:26:03.926091 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-8c7ed97e-82ba-4a25-9bd8-a14735e60d76 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:26:03.926629 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-8c7ed97e-82ba-4a25-9bd8-a14735e60d76 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:26:03.927119 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-8c7ed97e-82ba-4a25-9bd8-a14735e60d76 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:26:03.927536 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-8c7ed97e-82ba-4a25-9bd8-a14735e60d76 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:26:03.927957 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-8c7ed97e-82ba-4a25-9bd8-a14735e60d76 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:26:03.936972 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c7ed97e-82ba-4a25-9bd8-a14735e60d76 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:26:03.937496 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c7ed97e-82ba-4a25-9bd8-a14735e60d76 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:26:03.937958 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c7ed97e-82ba-4a25-9bd8-a14735e60d76 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:26:03.938682 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c7ed97e-82ba-4a25-9bd8-a14735e60d76 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:26:03.939145 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c7ed97e-82ba-4a25-9bd8-a14735e60d76 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:26:03.939577 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c7ed97e-82ba-4a25-9bd8-a14735e60d76 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:26:03.947526 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=75 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:26:03.959506 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-8c7ed97e-82ba-4a25-9bd8-a14735e60d76 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Getting quotas for project 747bb5860ba14a20bba3b1c2197ea75d. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:26:03.965017 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-8c7ed97e-82ba-4a25-9bd8-a14735e60d76 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Getting quotas for user bc18639e461e4ef5bfcf4380c561f329 and project 747bb5860ba14a20bba3b1c2197ea75d. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:26:04.023674 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8c7ed97e-82ba-4a25-9bd8-a14735e60d76 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:26:04.025740 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8c7ed97e-82ba-4a25-9bd8-a14735e60d76 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 18435f91-68e2-4867-949a-0c6a91fd27ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='dd588236-7bfc-4506-99a1-59f0b30058c0',volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:26:04.152072 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8c7ed97e-82ba-4a25-9bd8-a14735e60d76 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.664540 Sep 08 11:26:04.152726 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3189/6511] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 11:26:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:26:04.165222 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-770a92e6-16a1-4b3c-9982-0a296577cf75 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:26:04.165848 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-770a92e6-16a1-4b3c-9982-0a296577cf75 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 18435f91-68e2-4867-949a-0c6a91fd27ed] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:26:04.169643 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:26:04.226418 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-770a92e6-16a1-4b3c-9982-0a296577cf75 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:26:04.233793 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-770a92e6-16a1-4b3c-9982-0a296577cf75 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/18435f91-68e2-4867-949a-0c6a91fd27ed" status: 200 len: 1056 microversion: 2.1 time: 0.073331 Sep 08 11:26:04.234391 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3323/6512] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:26:04 2022] GET /compute/v2.1/servers/18435f91-68e2-4867-949a-0c6a91fd27ed => generated 1056 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:26:05.257850 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a6f65ad3-d756-4ef0-9717-afe7d7aba7d8 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:26:05.258482 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a6f65ad3-d756-4ef0-9717-afe7d7aba7d8 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 18435f91-68e2-4867-949a-0c6a91fd27ed] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:26:05.265770 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a6f65ad3-d756-4ef0-9717-afe7d7aba7d8 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:26:05.266271 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a6f65ad3-d756-4ef0-9717-afe7d7aba7d8 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:26:05.266798 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a6f65ad3-d756-4ef0-9717-afe7d7aba7d8 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:26:05.267814 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a6f65ad3-d756-4ef0-9717-afe7d7aba7d8 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:26:05.268286 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a6f65ad3-d756-4ef0-9717-afe7d7aba7d8 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:26:05.268711 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a6f65ad3-d756-4ef0-9717-afe7d7aba7d8 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:26:05.354025 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a6f65ad3-d756-4ef0-9717-afe7d7aba7d8 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:26:05.364231 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a6f65ad3-d756-4ef0-9717-afe7d7aba7d8 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/18435f91-68e2-4867-949a-0c6a91fd27ed" status: 200 len: 1172 microversion: 2.1 time: 0.110336 Sep 08 11:26:05.364829 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3190/6513] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:26:05 2022] GET /compute/v2.1/servers/18435f91-68e2-4867-949a-0c6a91fd27ed => generated 1172 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:26:06.393086 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f53d85f0-5ab4-4043-b403-e0f2d13372b3 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:26:06.393899 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f53d85f0-5ab4-4043-b403-e0f2d13372b3 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 18435f91-68e2-4867-949a-0c6a91fd27ed] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:26:06.402666 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f53d85f0-5ab4-4043-b403-e0f2d13372b3 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:26:06.403177 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f53d85f0-5ab4-4043-b403-e0f2d13372b3 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:26:06.403630 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f53d85f0-5ab4-4043-b403-e0f2d13372b3 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:26:06.404356 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f53d85f0-5ab4-4043-b403-e0f2d13372b3 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:26:06.404997 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f53d85f0-5ab4-4043-b403-e0f2d13372b3 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:26:06.405465 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f53d85f0-5ab4-4043-b403-e0f2d13372b3 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:26:06.410097 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:26:06.564502 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f53d85f0-5ab4-4043-b403-e0f2d13372b3 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:26:06.573723 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f53d85f0-5ab4-4043-b403-e0f2d13372b3 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/18435f91-68e2-4867-949a-0c6a91fd27ed" status: 200 len: 1214 microversion: 2.1 time: 0.185826 Sep 08 11:26:06.574428 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3324/6514] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:26:06 2022] GET /compute/v2.1/servers/18435f91-68e2-4867-949a-0c6a91fd27ed => generated 1214 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:26:06.676554 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-489a72cd-886c-458f-9821-c8e3076da103 req-0812d635-3859-4dde-91b2-245a97902bc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18435f91-68e2-4867-949a-0c6a91fd27ed", "tag": "2833df08-7634-4860-9423-dc4517652a46"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:26:06.688944 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-489a72cd-886c-458f-9821-c8e3076da103 req-0812d635-3859-4dde-91b2-245a97902bc1 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:26:06.689668 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-489a72cd-886c-458f-9821-c8e3076da103 req-0812d635-3859-4dde-91b2-245a97902bc1 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:26:06.690186 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-489a72cd-886c-458f-9821-c8e3076da103 req-0812d635-3859-4dde-91b2-245a97902bc1 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:26:06.702521 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-489a72cd-886c-458f-9821-c8e3076da103 req-0812d635-3859-4dde-91b2-245a97902bc1 service nova] Creating event network-changed:2833df08-7634-4860-9423-dc4517652a46 for instance 18435f91-68e2-4867-949a-0c6a91fd27ed on n-h1-850501-12 Sep 08 11:26:06.708615 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-489a72cd-886c-458f-9821-c8e3076da103 req-0812d635-3859-4dde-91b2-245a97902bc1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036973 Sep 08 11:26:06.709376 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3191/6515] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:26:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:26:07.599130 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d9279226-4feb-48d9-8352-f46652e09ddd tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:26:07.600196 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d9279226-4feb-48d9-8352-f46652e09ddd tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 18435f91-68e2-4867-949a-0c6a91fd27ed] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:26:07.610612 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d9279226-4feb-48d9-8352-f46652e09ddd tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:26:07.611139 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d9279226-4feb-48d9-8352-f46652e09ddd tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:26:07.611599 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d9279226-4feb-48d9-8352-f46652e09ddd tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:26:07.612422 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d9279226-4feb-48d9-8352-f46652e09ddd tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:26:07.612980 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d9279226-4feb-48d9-8352-f46652e09ddd tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:26:07.613460 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d9279226-4feb-48d9-8352-f46652e09ddd tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:26:07.757966 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d9279226-4feb-48d9-8352-f46652e09ddd tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:26:07.766595 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d9279226-4feb-48d9-8352-f46652e09ddd tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/18435f91-68e2-4867-949a-0c6a91fd27ed" status: 200 len: 1214 microversion: 2.1 time: 0.171703 Sep 08 11:26:07.767856 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3325/6516] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:26:07 2022] GET /compute/v2.1/servers/18435f91-68e2-4867-949a-0c6a91fd27ed => generated 1214 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:26:08.791283 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ff69f3f1-3ea4-42a9-8c51-a067b92b8941 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:26:08.791886 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ff69f3f1-3ea4-42a9-8c51-a067b92b8941 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 18435f91-68e2-4867-949a-0c6a91fd27ed] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:26:08.799070 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff69f3f1-3ea4-42a9-8c51-a067b92b8941 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:26:08.799568 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff69f3f1-3ea4-42a9-8c51-a067b92b8941 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:26:08.800009 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff69f3f1-3ea4-42a9-8c51-a067b92b8941 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:26:08.800713 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff69f3f1-3ea4-42a9-8c51-a067b92b8941 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:26:08.801216 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff69f3f1-3ea4-42a9-8c51-a067b92b8941 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:26:08.801708 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff69f3f1-3ea4-42a9-8c51-a067b92b8941 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:26:08.937892 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ff69f3f1-3ea4-42a9-8c51-a067b92b8941 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:26:08.946048 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ff69f3f1-3ea4-42a9-8c51-a067b92b8941 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/18435f91-68e2-4867-949a-0c6a91fd27ed" status: 200 len: 1214 microversion: 2.1 time: 0.160002 Sep 08 11:26:08.946668 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3192/6517] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:26:08 2022] GET /compute/v2.1/servers/18435f91-68e2-4867-949a-0c6a91fd27ed => generated 1214 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:26:09.969696 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5f42c52e-107a-4968-b62d-01e43a940bb2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:26:09.970378 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5f42c52e-107a-4968-b62d-01e43a940bb2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 18435f91-68e2-4867-949a-0c6a91fd27ed] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:26:09.978081 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5f42c52e-107a-4968-b62d-01e43a940bb2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:26:09.978601 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5f42c52e-107a-4968-b62d-01e43a940bb2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:26:09.979039 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5f42c52e-107a-4968-b62d-01e43a940bb2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:26:09.979768 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5f42c52e-107a-4968-b62d-01e43a940bb2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:26:09.980240 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5f42c52e-107a-4968-b62d-01e43a940bb2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:26:09.980668 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5f42c52e-107a-4968-b62d-01e43a940bb2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:26:10.126755 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5f42c52e-107a-4968-b62d-01e43a940bb2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:26:10.134753 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5f42c52e-107a-4968-b62d-01e43a940bb2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/18435f91-68e2-4867-949a-0c6a91fd27ed" status: 200 len: 1214 microversion: 2.1 time: 0.169449 Sep 08 11:26:10.135337 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3326/6518] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:26:09 2022] GET /compute/v2.1/servers/18435f91-68e2-4867-949a-0c6a91fd27ed => generated 1214 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:26:11.159648 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2adf1bcf-5dca-476f-b952-552e0873e867 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:26:11.160268 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2adf1bcf-5dca-476f-b952-552e0873e867 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 18435f91-68e2-4867-949a-0c6a91fd27ed] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:26:11.167180 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2adf1bcf-5dca-476f-b952-552e0873e867 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:26:11.167679 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2adf1bcf-5dca-476f-b952-552e0873e867 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:26:11.168122 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2adf1bcf-5dca-476f-b952-552e0873e867 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:26:11.168823 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2adf1bcf-5dca-476f-b952-552e0873e867 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:26:11.169310 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2adf1bcf-5dca-476f-b952-552e0873e867 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:26:11.169749 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2adf1bcf-5dca-476f-b952-552e0873e867 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:26:11.297860 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2adf1bcf-5dca-476f-b952-552e0873e867 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:26:11.305690 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2adf1bcf-5dca-476f-b952-552e0873e867 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/18435f91-68e2-4867-949a-0c6a91fd27ed" status: 200 len: 1202 microversion: 2.1 time: 0.150796 Sep 08 11:26:11.306269 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3193/6519] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:26:11 2022] GET /compute/v2.1/servers/18435f91-68e2-4867-949a-0c6a91fd27ed => generated 1202 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:26:12.327967 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b8711bd7-4e52-4c94-af7f-259d72cd8ea6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:26:12.328742 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b8711bd7-4e52-4c94-af7f-259d72cd8ea6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 18435f91-68e2-4867-949a-0c6a91fd27ed] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:26:12.335678 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b8711bd7-4e52-4c94-af7f-259d72cd8ea6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:26:12.336425 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b8711bd7-4e52-4c94-af7f-259d72cd8ea6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:26:12.336867 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b8711bd7-4e52-4c94-af7f-259d72cd8ea6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:26:12.337686 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b8711bd7-4e52-4c94-af7f-259d72cd8ea6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:26:12.338143 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b8711bd7-4e52-4c94-af7f-259d72cd8ea6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:26:12.338569 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b8711bd7-4e52-4c94-af7f-259d72cd8ea6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:26:12.467475 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b8711bd7-4e52-4c94-af7f-259d72cd8ea6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:26:12.475887 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b8711bd7-4e52-4c94-af7f-259d72cd8ea6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/18435f91-68e2-4867-949a-0c6a91fd27ed" status: 200 len: 1202 microversion: 2.1 time: 0.151931 Sep 08 11:26:12.476456 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3327/6520] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:26:12 2022] GET /compute/v2.1/servers/18435f91-68e2-4867-949a-0c6a91fd27ed => generated 1202 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:26:13.499089 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-97ab56fa-d1f6-486c-b7b2-dcbc39bba8c9 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:26:13.499706 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-97ab56fa-d1f6-486c-b7b2-dcbc39bba8c9 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 18435f91-68e2-4867-949a-0c6a91fd27ed] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:26:13.506806 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-97ab56fa-d1f6-486c-b7b2-dcbc39bba8c9 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:26:13.507297 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-97ab56fa-d1f6-486c-b7b2-dcbc39bba8c9 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:26:13.507739 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-97ab56fa-d1f6-486c-b7b2-dcbc39bba8c9 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:26:13.508435 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-97ab56fa-d1f6-486c-b7b2-dcbc39bba8c9 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:26:13.508897 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-97ab56fa-d1f6-486c-b7b2-dcbc39bba8c9 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:26:13.509361 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-97ab56fa-d1f6-486c-b7b2-dcbc39bba8c9 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:26:13.640349 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-97ab56fa-d1f6-486c-b7b2-dcbc39bba8c9 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:26:13.648653 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-97ab56fa-d1f6-486c-b7b2-dcbc39bba8c9 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/18435f91-68e2-4867-949a-0c6a91fd27ed" status: 200 len: 1202 microversion: 2.1 time: 0.153536 Sep 08 11:26:13.649263 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3194/6521] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:26:13 2022] GET /compute/v2.1/servers/18435f91-68e2-4867-949a-0c6a91fd27ed => generated 1202 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:26:14.672815 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-161f5253-83f7-4712-919a-1f4a759a9abf tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:26:14.673492 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-161f5253-83f7-4712-919a-1f4a759a9abf tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 18435f91-68e2-4867-949a-0c6a91fd27ed] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:26:14.676550 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:26:14.682087 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-161f5253-83f7-4712-919a-1f4a759a9abf tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:26:14.682575 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-161f5253-83f7-4712-919a-1f4a759a9abf tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:26:14.683011 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-161f5253-83f7-4712-919a-1f4a759a9abf tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:26:14.683713 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-161f5253-83f7-4712-919a-1f4a759a9abf tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:26:14.684169 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-161f5253-83f7-4712-919a-1f4a759a9abf tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:26:14.684615 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-161f5253-83f7-4712-919a-1f4a759a9abf tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:26:14.816855 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-161f5253-83f7-4712-919a-1f4a759a9abf tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:26:14.824818 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-161f5253-83f7-4712-919a-1f4a759a9abf tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/18435f91-68e2-4867-949a-0c6a91fd27ed" status: 200 len: 1202 microversion: 2.1 time: 0.156516 Sep 08 11:26:14.825368 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3328/6522] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:26:14 2022] GET /compute/v2.1/servers/18435f91-68e2-4867-949a-0c6a91fd27ed => generated 1202 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:26:15.849755 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fc724518-2cb4-4bd8-9ad5-618aa300ba18 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:26:15.850376 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fc724518-2cb4-4bd8-9ad5-618aa300ba18 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 18435f91-68e2-4867-949a-0c6a91fd27ed] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:26:15.852378 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:26:15.853087 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:26:15.859382 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fc724518-2cb4-4bd8-9ad5-618aa300ba18 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:26:15.860373 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fc724518-2cb4-4bd8-9ad5-618aa300ba18 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:26:15.860822 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fc724518-2cb4-4bd8-9ad5-618aa300ba18 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:26:15.861574 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fc724518-2cb4-4bd8-9ad5-618aa300ba18 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:26:15.862034 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fc724518-2cb4-4bd8-9ad5-618aa300ba18 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:26:15.862469 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fc724518-2cb4-4bd8-9ad5-618aa300ba18 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:26:15.999694 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fc724518-2cb4-4bd8-9ad5-618aa300ba18 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:26:16.008027 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fc724518-2cb4-4bd8-9ad5-618aa300ba18 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/18435f91-68e2-4867-949a-0c6a91fd27ed" status: 200 len: 1202 microversion: 2.1 time: 0.162375 Sep 08 11:26:16.008618 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3195/6523] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:26:15 2022] GET /compute/v2.1/servers/18435f91-68e2-4867-949a-0c6a91fd27ed => generated 1202 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:26:17.030887 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-41ad56e2-a439-47b0-af0a-406caee291d3 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:26:17.031668 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-41ad56e2-a439-47b0-af0a-406caee291d3 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 18435f91-68e2-4867-949a-0c6a91fd27ed] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:26:17.039870 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41ad56e2-a439-47b0-af0a-406caee291d3 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:26:17.040380 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41ad56e2-a439-47b0-af0a-406caee291d3 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:26:17.040864 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41ad56e2-a439-47b0-af0a-406caee291d3 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:26:17.041631 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41ad56e2-a439-47b0-af0a-406caee291d3 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:26:17.042102 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41ad56e2-a439-47b0-af0a-406caee291d3 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:26:17.042541 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41ad56e2-a439-47b0-af0a-406caee291d3 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:26:17.179131 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-41ad56e2-a439-47b0-af0a-406caee291d3 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:26:17.186956 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-41ad56e2-a439-47b0-af0a-406caee291d3 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/18435f91-68e2-4867-949a-0c6a91fd27ed" status: 200 len: 1202 microversion: 2.1 time: 0.160244 Sep 08 11:26:17.187526 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3329/6524] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:26:17 2022] GET /compute/v2.1/servers/18435f91-68e2-4867-949a-0c6a91fd27ed => generated 1202 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:26:18.210016 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f7bf0654-83a0-49d1-8f32-fb9ee3b46fe8 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:26:18.210634 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f7bf0654-83a0-49d1-8f32-fb9ee3b46fe8 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 18435f91-68e2-4867-949a-0c6a91fd27ed] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:26:18.217864 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f7bf0654-83a0-49d1-8f32-fb9ee3b46fe8 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:26:18.218360 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f7bf0654-83a0-49d1-8f32-fb9ee3b46fe8 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:26:18.218796 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f7bf0654-83a0-49d1-8f32-fb9ee3b46fe8 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:26:18.220002 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f7bf0654-83a0-49d1-8f32-fb9ee3b46fe8 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:26:18.220457 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f7bf0654-83a0-49d1-8f32-fb9ee3b46fe8 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:26:18.220881 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f7bf0654-83a0-49d1-8f32-fb9ee3b46fe8 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:26:18.354989 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f7bf0654-83a0-49d1-8f32-fb9ee3b46fe8 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:26:18.363568 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f7bf0654-83a0-49d1-8f32-fb9ee3b46fe8 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/18435f91-68e2-4867-949a-0c6a91fd27ed" status: 200 len: 1202 microversion: 2.1 time: 0.157798 Sep 08 11:26:18.364143 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3196/6525] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:26:18 2022] GET /compute/v2.1/servers/18435f91-68e2-4867-949a-0c6a91fd27ed => generated 1202 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:26:18.848990 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-f3e1a961-6ef5-41e8-b0bc-bbf328bad7d4 req-712c73c7-605b-48ac-96e9-0b5454a3043d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18435f91-68e2-4867-949a-0c6a91fd27ed", "name": "network-vif-plugged", "status": "completed", "tag": "2833df08-7634-4860-9423-dc4517652a46"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:26:18.859282 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-f3e1a961-6ef5-41e8-b0bc-bbf328bad7d4 req-712c73c7-605b-48ac-96e9-0b5454a3043d service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:26:18.859790 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-f3e1a961-6ef5-41e8-b0bc-bbf328bad7d4 req-712c73c7-605b-48ac-96e9-0b5454a3043d service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:26:18.861616 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-f3e1a961-6ef5-41e8-b0bc-bbf328bad7d4 req-712c73c7-605b-48ac-96e9-0b5454a3043d service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:26:18.871600 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-f3e1a961-6ef5-41e8-b0bc-bbf328bad7d4 req-712c73c7-605b-48ac-96e9-0b5454a3043d service nova] Creating event network-vif-plugged:2833df08-7634-4860-9423-dc4517652a46 for instance 18435f91-68e2-4867-949a-0c6a91fd27ed on n-h1-850501-12 Sep 08 11:26:18.877449 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-f3e1a961-6ef5-41e8-b0bc-bbf328bad7d4 req-712c73c7-605b-48ac-96e9-0b5454a3043d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033203 Sep 08 11:26:18.878078 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3330/6526] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:26:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:26:19.386241 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8e7d8276-15f3-43a1-8771-2418dfb9a6a6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:26:19.386784 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8e7d8276-15f3-43a1-8771-2418dfb9a6a6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 18435f91-68e2-4867-949a-0c6a91fd27ed] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:26:19.394354 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e7d8276-15f3-43a1-8771-2418dfb9a6a6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:26:19.394934 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e7d8276-15f3-43a1-8771-2418dfb9a6a6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:26:19.395419 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e7d8276-15f3-43a1-8771-2418dfb9a6a6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:26:19.396217 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e7d8276-15f3-43a1-8771-2418dfb9a6a6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:26:19.396675 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e7d8276-15f3-43a1-8771-2418dfb9a6a6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:26:19.397246 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e7d8276-15f3-43a1-8771-2418dfb9a6a6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:26:19.537011 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8e7d8276-15f3-43a1-8771-2418dfb9a6a6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:26:19.545171 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8e7d8276-15f3-43a1-8771-2418dfb9a6a6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/18435f91-68e2-4867-949a-0c6a91fd27ed" status: 200 len: 1202 microversion: 2.1 time: 0.162869 Sep 08 11:26:19.545754 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3197/6527] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:26:19 2022] GET /compute/v2.1/servers/18435f91-68e2-4867-949a-0c6a91fd27ed => generated 1202 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:26:20.570412 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b246d5ce-8be9-43aa-9c8b-e160f5852beb tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:26:20.571075 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b246d5ce-8be9-43aa-9c8b-e160f5852beb tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 18435f91-68e2-4867-949a-0c6a91fd27ed] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:26:20.577427 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b246d5ce-8be9-43aa-9c8b-e160f5852beb tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:26:20.577915 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b246d5ce-8be9-43aa-9c8b-e160f5852beb tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:26:20.578354 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b246d5ce-8be9-43aa-9c8b-e160f5852beb tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:26:20.579327 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b246d5ce-8be9-43aa-9c8b-e160f5852beb tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:26:20.579788 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b246d5ce-8be9-43aa-9c8b-e160f5852beb tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:26:20.580218 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b246d5ce-8be9-43aa-9c8b-e160f5852beb tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:26:20.711752 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b246d5ce-8be9-43aa-9c8b-e160f5852beb tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:26:20.720314 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b246d5ce-8be9-43aa-9c8b-e160f5852beb tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/18435f91-68e2-4867-949a-0c6a91fd27ed" status: 200 len: 1389 microversion: 2.1 time: 0.155372 Sep 08 11:26:20.721011 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3331/6528] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:26:20 2022] GET /compute/v2.1/servers/18435f91-68e2-4867-949a-0c6a91fd27ed => generated 1389 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:26:20.742940 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ef88cb8c-f972-42a0-b244-fe12524f417a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:26:20.743555 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ef88cb8c-f972-42a0-b244-fe12524f417a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 18435f91-68e2-4867-949a-0c6a91fd27ed] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:26:20.750423 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef88cb8c-f972-42a0-b244-fe12524f417a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:26:20.751002 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef88cb8c-f972-42a0-b244-fe12524f417a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:26:20.751443 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef88cb8c-f972-42a0-b244-fe12524f417a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:26:20.752143 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef88cb8c-f972-42a0-b244-fe12524f417a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:26:20.752604 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef88cb8c-f972-42a0-b244-fe12524f417a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:26:20.753048 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef88cb8c-f972-42a0-b244-fe12524f417a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:26:20.886883 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ef88cb8c-f972-42a0-b244-fe12524f417a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:26:20.895670 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ef88cb8c-f972-42a0-b244-fe12524f417a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/18435f91-68e2-4867-949a-0c6a91fd27ed" status: 200 len: 1389 microversion: 2.1 time: 0.156554 Sep 08 11:26:20.896269 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3198/6529] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:26:20 2022] GET /compute/v2.1/servers/18435f91-68e2-4867-949a-0c6a91fd27ed => generated 1389 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:26:20.917964 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-04198466-45f2-45a7-a1a6-3a8e7533682a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:26:20.918817 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-04198466-45f2-45a7-a1a6-3a8e7533682a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 18435f91-68e2-4867-949a-0c6a91fd27ed] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:26:20.924947 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-04198466-45f2-45a7-a1a6-3a8e7533682a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:26:20.925473 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-04198466-45f2-45a7-a1a6-3a8e7533682a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:26:20.925914 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-04198466-45f2-45a7-a1a6-3a8e7533682a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:26:20.926612 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-04198466-45f2-45a7-a1a6-3a8e7533682a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:26:20.927070 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-04198466-45f2-45a7-a1a6-3a8e7533682a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:26:20.927497 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-04198466-45f2-45a7-a1a6-3a8e7533682a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:26:21.059996 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-04198466-45f2-45a7-a1a6-3a8e7533682a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:26:21.067981 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-04198466-45f2-45a7-a1a6-3a8e7533682a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/18435f91-68e2-4867-949a-0c6a91fd27ed" status: 200 len: 1389 microversion: 2.1 time: 0.153916 Sep 08 11:26:21.068555 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3332/6530] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:26:20 2022] GET /compute/v2.1/servers/18435f91-68e2-4867-949a-0c6a91fd27ed => generated 1389 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:26:21.090229 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c38ef49e-aa22-40f5-9720-4f61e6c4fefe tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:26:21.090657 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c38ef49e-aa22-40f5-9720-4f61e6c4fefe tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 18435f91-68e2-4867-949a-0c6a91fd27ed] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:26:21.098456 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c38ef49e-aa22-40f5-9720-4f61e6c4fefe tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:26:21.099078 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c38ef49e-aa22-40f5-9720-4f61e6c4fefe tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:26:21.099699 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c38ef49e-aa22-40f5-9720-4f61e6c4fefe tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:26:21.100617 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c38ef49e-aa22-40f5-9720-4f61e6c4fefe tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:26:21.101075 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c38ef49e-aa22-40f5-9720-4f61e6c4fefe tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:26:21.101467 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c38ef49e-aa22-40f5-9720-4f61e6c4fefe tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:26:21.126927 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c38ef49e-aa22-40f5-9720-4f61e6c4fefe tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 18435f91-68e2-4867-949a-0c6a91fd27ed] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:26:21.203714 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c38ef49e-aa22-40f5-9720-4f61e6c4fefe tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "DELETE /compute/v2.1/servers/18435f91-68e2-4867-949a-0c6a91fd27ed" status: 204 len: 0 microversion: 2.1 time: 0.117131 Sep 08 11:26:21.205107 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3199/6531] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:26:21 2022] DELETE /compute/v2.1/servers/18435f91-68e2-4867-949a-0c6a91fd27ed => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:26:21.213832 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f350ff5b-f1e3-45f4-848b-9c4d1e12e1c2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:26:21.214545 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f350ff5b-f1e3-45f4-848b-9c4d1e12e1c2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 18435f91-68e2-4867-949a-0c6a91fd27ed] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:26:21.220803 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f350ff5b-f1e3-45f4-848b-9c4d1e12e1c2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:26:21.221331 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f350ff5b-f1e3-45f4-848b-9c4d1e12e1c2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:26:21.221769 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f350ff5b-f1e3-45f4-848b-9c4d1e12e1c2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:26:21.222476 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f350ff5b-f1e3-45f4-848b-9c4d1e12e1c2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:26:21.222935 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f350ff5b-f1e3-45f4-848b-9c4d1e12e1c2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:26:21.223382 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f350ff5b-f1e3-45f4-848b-9c4d1e12e1c2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:26:21.359980 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f350ff5b-f1e3-45f4-848b-9c4d1e12e1c2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:26:21.368156 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f350ff5b-f1e3-45f4-848b-9c4d1e12e1c2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/18435f91-68e2-4867-949a-0c6a91fd27ed" status: 200 len: 1395 microversion: 2.1 time: 0.158522 Sep 08 11:26:21.368746 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3333/6532] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:26:21 2022] GET /compute/v2.1/servers/18435f91-68e2-4867-949a-0c6a91fd27ed => generated 1395 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:26:22.392983 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9fa84975-9870-4b9d-87ef-cea504c2bb57 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:26:22.393724 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9fa84975-9870-4b9d-87ef-cea504c2bb57 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 18435f91-68e2-4867-949a-0c6a91fd27ed] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:26:22.400745 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9fa84975-9870-4b9d-87ef-cea504c2bb57 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:26:22.401285 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9fa84975-9870-4b9d-87ef-cea504c2bb57 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:26:22.401753 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9fa84975-9870-4b9d-87ef-cea504c2bb57 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:26:22.402472 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9fa84975-9870-4b9d-87ef-cea504c2bb57 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:26:22.402933 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9fa84975-9870-4b9d-87ef-cea504c2bb57 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:26:22.403365 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9fa84975-9870-4b9d-87ef-cea504c2bb57 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:26:22.543150 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9fa84975-9870-4b9d-87ef-cea504c2bb57 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:26:22.551697 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9fa84975-9870-4b9d-87ef-cea504c2bb57 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/18435f91-68e2-4867-949a-0c6a91fd27ed" status: 200 len: 1395 microversion: 2.1 time: 0.163491 Sep 08 11:26:22.552278 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3200/6533] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:26:22 2022] GET /compute/v2.1/servers/18435f91-68e2-4867-949a-0c6a91fd27ed => generated 1395 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:26:23.472492 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-b21916eb-ba5f-4e9f-b58f-bf97877bdadb req-b7830ed0-dd09-4a76-9a33-c4d5a2d721bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18435f91-68e2-4867-949a-0c6a91fd27ed", "name": "network-vif-deleted", "tag": "2833df08-7634-4860-9423-dc4517652a46"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:26:23.483912 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-b21916eb-ba5f-4e9f-b58f-bf97877bdadb req-b7830ed0-dd09-4a76-9a33-c4d5a2d721bf service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:26:23.484440 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-b21916eb-ba5f-4e9f-b58f-bf97877bdadb req-b7830ed0-dd09-4a76-9a33-c4d5a2d721bf service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:26:23.484912 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-b21916eb-ba5f-4e9f-b58f-bf97877bdadb req-b7830ed0-dd09-4a76-9a33-c4d5a2d721bf service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:26:23.498458 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-b21916eb-ba5f-4e9f-b58f-bf97877bdadb req-b7830ed0-dd09-4a76-9a33-c4d5a2d721bf service nova] Creating event network-vif-deleted:2833df08-7634-4860-9423-dc4517652a46 for instance 18435f91-68e2-4867-949a-0c6a91fd27ed on n-h1-850501-12 Sep 08 11:26:23.505001 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-b21916eb-ba5f-4e9f-b58f-bf97877bdadb req-b7830ed0-dd09-4a76-9a33-c4d5a2d721bf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036746 Sep 08 11:26:23.505990 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3334/6534] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:26:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:26:23.574717 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5dca7637-af38-49fd-8bb5-fb75e903e286 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:26:23.576252 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5dca7637-af38-49fd-8bb5-fb75e903e286 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 18435f91-68e2-4867-949a-0c6a91fd27ed] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:26:23.586372 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5dca7637-af38-49fd-8bb5-fb75e903e286 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:26:23.587463 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5dca7637-af38-49fd-8bb5-fb75e903e286 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:26:23.588058 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5dca7637-af38-49fd-8bb5-fb75e903e286 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:26:23.588932 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5dca7637-af38-49fd-8bb5-fb75e903e286 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:26:23.589600 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5dca7637-af38-49fd-8bb5-fb75e903e286 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:26:23.590312 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5dca7637-af38-49fd-8bb5-fb75e903e286 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:26:23.672147 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5dca7637-af38-49fd-8bb5-fb75e903e286 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:26:23.680595 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5dca7637-af38-49fd-8bb5-fb75e903e286 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/18435f91-68e2-4867-949a-0c6a91fd27ed" status: 200 len: 1187 microversion: 2.1 time: 0.109694 Sep 08 11:26:23.681224 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3201/6535] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:26:23 2022] GET /compute/v2.1/servers/18435f91-68e2-4867-949a-0c6a91fd27ed => generated 1187 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:26:24.706639 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e60ae792-4ea7-45b6-b6df-37d5e14ece08 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:26:24.707341 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e60ae792-4ea7-45b6-b6df-37d5e14ece08 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 18435f91-68e2-4867-949a-0c6a91fd27ed] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:26:24.714140 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e60ae792-4ea7-45b6-b6df-37d5e14ece08 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:26:24.714633 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e60ae792-4ea7-45b6-b6df-37d5e14ece08 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:26:24.715073 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e60ae792-4ea7-45b6-b6df-37d5e14ece08 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:26:24.715775 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e60ae792-4ea7-45b6-b6df-37d5e14ece08 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:26:24.716231 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e60ae792-4ea7-45b6-b6df-37d5e14ece08 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:26:24.716656 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e60ae792-4ea7-45b6-b6df-37d5e14ece08 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:26:24.783950 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e60ae792-4ea7-45b6-b6df-37d5e14ece08 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:26:24.792395 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e60ae792-4ea7-45b6-b6df-37d5e14ece08 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/18435f91-68e2-4867-949a-0c6a91fd27ed" status: 200 len: 1187 microversion: 2.1 time: 0.091925 Sep 08 11:26:24.792986 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3335/6536] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:26:24 2022] GET /compute/v2.1/servers/18435f91-68e2-4867-949a-0c6a91fd27ed => generated 1187 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:26:25.817635 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2d3a48dd-6459-448d-a516-402208aeaf54 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:26:25.818257 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2d3a48dd-6459-448d-a516-402208aeaf54 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 18435f91-68e2-4867-949a-0c6a91fd27ed] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:26:25.825177 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2d3a48dd-6459-448d-a516-402208aeaf54 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:26:25.825673 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2d3a48dd-6459-448d-a516-402208aeaf54 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:26:25.826117 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2d3a48dd-6459-448d-a516-402208aeaf54 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:26:25.826826 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2d3a48dd-6459-448d-a516-402208aeaf54 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:26:25.827292 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2d3a48dd-6459-448d-a516-402208aeaf54 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:26:25.827727 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2d3a48dd-6459-448d-a516-402208aeaf54 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:26:25.892072 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2d3a48dd-6459-448d-a516-402208aeaf54 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:26:25.900689 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2d3a48dd-6459-448d-a516-402208aeaf54 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/18435f91-68e2-4867-949a-0c6a91fd27ed" status: 200 len: 1187 microversion: 2.1 time: 0.087335 Sep 08 11:26:25.901328 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3202/6537] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:26:25 2022] GET /compute/v2.1/servers/18435f91-68e2-4867-949a-0c6a91fd27ed => generated 1187 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:26:26.924205 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7300118c-3a6f-4696-a54d-f30a35bb5eac tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:26:26.925117 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7300118c-3a6f-4696-a54d-f30a35bb5eac tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 18435f91-68e2-4867-949a-0c6a91fd27ed] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:26:26.932100 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7300118c-3a6f-4696-a54d-f30a35bb5eac tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:26:26.932596 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7300118c-3a6f-4696-a54d-f30a35bb5eac tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:26:26.933054 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7300118c-3a6f-4696-a54d-f30a35bb5eac tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:26:26.933772 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7300118c-3a6f-4696-a54d-f30a35bb5eac tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:26:26.934234 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7300118c-3a6f-4696-a54d-f30a35bb5eac tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:26:26.934666 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7300118c-3a6f-4696-a54d-f30a35bb5eac tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:26:27.002130 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7300118c-3a6f-4696-a54d-f30a35bb5eac tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:26:27.010292 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7300118c-3a6f-4696-a54d-f30a35bb5eac tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/18435f91-68e2-4867-949a-0c6a91fd27ed" status: 200 len: 1187 microversion: 2.1 time: 0.090251 Sep 08 11:26:27.010823 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3336/6538] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:26:26 2022] GET /compute/v2.1/servers/18435f91-68e2-4867-949a-0c6a91fd27ed => generated 1187 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:26:28.034105 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0e8a1377-7450-4539-8929-5a4f0613b313 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:26:28.034715 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0e8a1377-7450-4539-8929-5a4f0613b313 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 18435f91-68e2-4867-949a-0c6a91fd27ed] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:26:28.041839 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e8a1377-7450-4539-8929-5a4f0613b313 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:26:28.042327 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e8a1377-7450-4539-8929-5a4f0613b313 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:26:28.042759 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e8a1377-7450-4539-8929-5a4f0613b313 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:26:28.043455 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e8a1377-7450-4539-8929-5a4f0613b313 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:26:28.043909 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e8a1377-7450-4539-8929-5a4f0613b313 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:26:28.044364 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e8a1377-7450-4539-8929-5a4f0613b313 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:26:28.083264 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e8a1377-7450-4539-8929-5a4f0613b313 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:26:28.083809 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e8a1377-7450-4539-8929-5a4f0613b313 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:26:28.084252 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e8a1377-7450-4539-8929-5a4f0613b313 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:26:28.084865 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-0e8a1377-7450-4539-8929-5a4f0613b313 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lazy-loading 'fault' on Instance uuid 18435f91-68e2-4867-949a-0c6a91fd27ed {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:26:28.131680 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0e8a1377-7450-4539-8929-5a4f0613b313 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:26:28.138784 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0e8a1377-7450-4539-8929-5a4f0613b313 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/18435f91-68e2-4867-949a-0c6a91fd27ed" status: 200 len: 1146 microversion: 2.1 time: 0.109092 Sep 08 11:26:28.139359 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3203/6539] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:26:28 2022] GET /compute/v2.1/servers/18435f91-68e2-4867-949a-0c6a91fd27ed => generated 1146 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:26:29.161787 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e7879ecb-5caf-4b46-b7ec-dd4f76b07640 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:26:29.162351 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e7879ecb-5caf-4b46-b7ec-dd4f76b07640 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 18435f91-68e2-4867-949a-0c6a91fd27ed] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:26:29.169309 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e7879ecb-5caf-4b46-b7ec-dd4f76b07640 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:26:29.169861 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e7879ecb-5caf-4b46-b7ec-dd4f76b07640 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:26:29.170305 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e7879ecb-5caf-4b46-b7ec-dd4f76b07640 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:26:29.171001 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e7879ecb-5caf-4b46-b7ec-dd4f76b07640 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:26:29.171457 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e7879ecb-5caf-4b46-b7ec-dd4f76b07640 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:26:29.171885 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e7879ecb-5caf-4b46-b7ec-dd4f76b07640 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:26:29.185656 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-e7879ecb-5caf-4b46-b7ec-dd4f76b07640 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] HTTP exception thrown: Instance 18435f91-68e2-4867-949a-0c6a91fd27ed could not be found. Sep 08 11:26:29.187335 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e7879ecb-5caf-4b46-b7ec-dd4f76b07640 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Request method failure captured: Sep 08 11:26:29.187335 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/18435f91-68e2-4867-949a-0c6a91fd27ed HTTP/1.1 Sep 08 11:26:29.187335 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:26:29.187335 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:26:29.187335 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:26:29.187335 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 11:26:29.187335 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:26:29.187335 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:26:29.187335 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:26:29.187335 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:26:29.187335 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGdEih_jYhjrfzcEat7QOG_17jH52nIZFToedVJMJ8Jj4pTKrcjanm3D8dChnqEL9d7jV5rq3NW7Z60oajSkgXZAcEtwDn7-PJMU6a9_UOAo8UiiyZ8L4GogQF4UWk_-Vlyi8Q447m99c-S3nr2fWKYhvhV9-SsmuV-ccLSbm0hBFVVM Sep 08 11:26:29.187335 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:26:29.187335 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:26:29.187335 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:26:29.187335 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:26:29.187335 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:26:29.187335 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:26:29.187335 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 747bb5860ba14a20bba3b1c2197ea75d Sep 08 11:26:29.187335 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-TestVolumeBootPattern-1812135790 Sep 08 11:26:29.187335 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:26:29.187335 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:26:29.187335 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/747bb5860ba14a20bba3b1c2197ea75d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/747bb5860ba14a20bba3b1c2197ea75d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_747bb5860ba14a20bba3b1c2197ea75d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/747bb5860ba14a20bba3b1c2197ea75d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:26:29.187335 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-TestVolumeBootPattern-1812135790 Sep 08 11:26:29.187335 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 747bb5860ba14a20bba3b1c2197ea75d Sep 08 11:26:29.187335 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-TestVolumeBootPattern-1812135790 Sep 08 11:26:29.187335 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-TestVolumeBootPattern-1812135790-project Sep 08 11:26:29.187335 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:26:29.187335 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:26:29.187335 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: bc18639e461e4ef5bfcf4380c561f329 Sep 08 11:26:29.187335 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-TestVolumeBootPattern-1812135790-project Sep 08 11:26:29.187335 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 11:26:29.187335 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 18435f91-68e2-4867-949a-0c6a91fd27ed could not be found. Sep 08 11:26:29.187335 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '18435f91-68e2-4867-949a-0c6a91fd27ed'} Sep 08 11:26:29.187335 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:26:29.187335 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:26:29.187335 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:26:29.187335 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:26:29.187335 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:26:29.187335 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:26:29.187335 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:26:29.187335 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:26:29.187335 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:26:29.187335 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:26:29.187335 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18435f91-68e2-4867-949a-0c6a91fd27ed could not be found. Sep 08 11:26:29.187335 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:26:29.187335 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:26:29.187335 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:26:29.187335 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:26:29.187335 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:26:29.187335 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:26:29.187335 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:26:29.187335 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:26:29.187335 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:26:29.187335 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:26:29.187335 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:26:29.187335 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:26:29.187335 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:26:29.187335 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:26:29.187335 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:26:29.187335 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:26:29.187335 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18435f91-68e2-4867-949a-0c6a91fd27ed could not be found. Sep 08 11:26:29.187335 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:26:29.187335 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:26:29.187335 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:26:29.191668 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:26:29.191668 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:26:29.191668 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:26:29.191668 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:26:29.191668 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:26:29.191668 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18435f91-68e2-4867-949a-0c6a91fd27ed could not be found. Sep 08 11:26:29.191668 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:26:29.191668 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e7879ecb-5caf-4b46-b7ec-dd4f76b07640 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Returning 404 to user: Instance 18435f91-68e2-4867-949a-0c6a91fd27ed could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:26:29.191668 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e7879ecb-5caf-4b46-b7ec-dd4f76b07640 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/18435f91-68e2-4867-949a-0c6a91fd27ed" status: 404 len: 111 microversion: 2.1 time: 0.031073 Sep 08 11:26:29.191668 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3337/6540] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:26:29 2022] GET /compute/v2.1/servers/18435f91-68e2-4867-949a-0c6a91fd27ed => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:26:50.201919 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-135f7d6d-cd23-49d8-82ba-3bda95064951 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-749874756", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "5b3815a5-3aec-4c40-9de1-45d37db03e08", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "6c224653-dc3b-48b8-9084-30761e623f71"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:26:50.213044 n-d-850501-12 devstack@n-api.service[128862]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 11:26:50.213178 n-d-850501-12 devstack@n-api.service[128862]: Thu Sep 8 11:26:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.27) !!! Sep 08 11:26:50.214964 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:26:50.215625 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:26:50.299160 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-135f7d6d-cd23-49d8-82ba-3bda95064951 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] validate_networks() for [('6c224653-dc3b-48b8-9084-30761e623f71', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:26:50.664507 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-135f7d6d-cd23-49d8-82ba-3bda95064951 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:26:50.664929 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-135f7d6d-cd23-49d8-82ba-3bda95064951 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:26:50.665455 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-135f7d6d-cd23-49d8-82ba-3bda95064951 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:26:50.665863 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-135f7d6d-cd23-49d8-82ba-3bda95064951 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:26:50.666281 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-135f7d6d-cd23-49d8-82ba-3bda95064951 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:26:50.679581 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-135f7d6d-cd23-49d8-82ba-3bda95064951 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:26:50.680066 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-135f7d6d-cd23-49d8-82ba-3bda95064951 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:26:50.680501 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-135f7d6d-cd23-49d8-82ba-3bda95064951 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:26:50.681289 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-135f7d6d-cd23-49d8-82ba-3bda95064951 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:26:50.681738 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-135f7d6d-cd23-49d8-82ba-3bda95064951 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:26:50.682161 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-135f7d6d-cd23-49d8-82ba-3bda95064951 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:26:50.699273 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-135f7d6d-cd23-49d8-82ba-3bda95064951 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Getting quotas for project 747bb5860ba14a20bba3b1c2197ea75d. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:26:50.704815 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-135f7d6d-cd23-49d8-82ba-3bda95064951 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Getting quotas for user bc18639e461e4ef5bfcf4380c561f329 and project 747bb5860ba14a20bba3b1c2197ea75d. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:26:50.718128 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-135f7d6d-cd23-49d8-82ba-3bda95064951 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:26:50.720219 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-135f7d6d-cd23-49d8-82ba-3bda95064951 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 18122c92-14ea-4f8c-a6f5-35225127e753] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='5b3815a5-3aec-4c40-9de1-45d37db03e08',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:26:50.797282 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-135f7d6d-cd23-49d8-82ba-3bda95064951 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.599431 Sep 08 11:26:50.798181 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3204/6541] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 11:26:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:26:50.810762 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-85f0f9b1-f6fb-4410-92fc-3d30eb0f7029 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:26:50.811395 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-85f0f9b1-f6fb-4410-92fc-3d30eb0f7029 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 18122c92-14ea-4f8c-a6f5-35225127e753] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:26:50.815361 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=31 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:26:50.816938 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=71 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:26:50.871672 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-85f0f9b1-f6fb-4410-92fc-3d30eb0f7029 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:26:50.879341 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-85f0f9b1-f6fb-4410-92fc-3d30eb0f7029 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/18122c92-14ea-4f8c-a6f5-35225127e753" status: 200 len: 1056 microversion: 2.1 time: 0.072346 Sep 08 11:26:50.879966 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3338/6542] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:26:50 2022] GET /compute/v2.1/servers/18122c92-14ea-4f8c-a6f5-35225127e753 => generated 1056 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:26:51.902790 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-008b0165-1c8a-4797-886c-c7d193b6c090 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:26:51.903491 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-008b0165-1c8a-4797-886c-c7d193b6c090 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 18122c92-14ea-4f8c-a6f5-35225127e753] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:26:51.910519 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-008b0165-1c8a-4797-886c-c7d193b6c090 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:26:51.911110 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-008b0165-1c8a-4797-886c-c7d193b6c090 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:26:51.917623 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-008b0165-1c8a-4797-886c-c7d193b6c090 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:26:51.918514 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-008b0165-1c8a-4797-886c-c7d193b6c090 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:26:51.919067 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-008b0165-1c8a-4797-886c-c7d193b6c090 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:26:51.919564 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-008b0165-1c8a-4797-886c-c7d193b6c090 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:26:51.998413 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-008b0165-1c8a-4797-886c-c7d193b6c090 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:26:52.007371 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-008b0165-1c8a-4797-886c-c7d193b6c090 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/18122c92-14ea-4f8c-a6f5-35225127e753" status: 200 len: 1126 microversion: 2.1 time: 0.109094 Sep 08 11:26:52.008326 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3205/6543] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:26:51 2022] GET /compute/v2.1/servers/18122c92-14ea-4f8c-a6f5-35225127e753 => generated 1126 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:26:53.031492 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1d8dacbf-8c01-4895-94bb-7eb81153b4b7 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:26:53.032277 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1d8dacbf-8c01-4895-94bb-7eb81153b4b7 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 18122c92-14ea-4f8c-a6f5-35225127e753] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:26:53.041388 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1d8dacbf-8c01-4895-94bb-7eb81153b4b7 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:26:53.042049 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1d8dacbf-8c01-4895-94bb-7eb81153b4b7 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:26:53.042607 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1d8dacbf-8c01-4895-94bb-7eb81153b4b7 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:26:53.043433 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1d8dacbf-8c01-4895-94bb-7eb81153b4b7 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:26:53.044179 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1d8dacbf-8c01-4895-94bb-7eb81153b4b7 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:26:53.044815 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1d8dacbf-8c01-4895-94bb-7eb81153b4b7 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:26:53.235736 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1d8dacbf-8c01-4895-94bb-7eb81153b4b7 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:26:53.246186 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1d8dacbf-8c01-4895-94bb-7eb81153b4b7 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/18122c92-14ea-4f8c-a6f5-35225127e753" status: 200 len: 1168 microversion: 2.1 time: 0.218664 Sep 08 11:26:53.246927 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3339/6544] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:26:53 2022] GET /compute/v2.1/servers/18122c92-14ea-4f8c-a6f5-35225127e753 => generated 1168 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:26:53.360683 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-34e0932d-573a-4825-956f-2b39d474879e req-87ea6e62-3de3-4346-b3d1-361252cee40e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18122c92-14ea-4f8c-a6f5-35225127e753", "tag": "d33ce48c-8ca0-45fd-a6e9-32828764b8c3"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:26:53.374008 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-34e0932d-573a-4825-956f-2b39d474879e req-87ea6e62-3de3-4346-b3d1-361252cee40e service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:26:53.374554 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-34e0932d-573a-4825-956f-2b39d474879e req-87ea6e62-3de3-4346-b3d1-361252cee40e service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:26:53.375695 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-34e0932d-573a-4825-956f-2b39d474879e req-87ea6e62-3de3-4346-b3d1-361252cee40e service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:26:53.391108 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-34e0932d-573a-4825-956f-2b39d474879e req-87ea6e62-3de3-4346-b3d1-361252cee40e service nova] Creating event network-changed:d33ce48c-8ca0-45fd-a6e9-32828764b8c3 for instance 18122c92-14ea-4f8c-a6f5-35225127e753 on n-h1-850501-12 Sep 08 11:26:53.396344 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-34e0932d-573a-4825-956f-2b39d474879e req-87ea6e62-3de3-4346-b3d1-361252cee40e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040122 Sep 08 11:26:53.397394 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3206/6545] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:26:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:26:54.270923 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a214564a-b091-4cf0-83ef-f8d8606bcbed tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:26:54.271888 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a214564a-b091-4cf0-83ef-f8d8606bcbed tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 18122c92-14ea-4f8c-a6f5-35225127e753] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:26:54.278706 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a214564a-b091-4cf0-83ef-f8d8606bcbed tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:26:54.279365 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a214564a-b091-4cf0-83ef-f8d8606bcbed tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:26:54.279916 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a214564a-b091-4cf0-83ef-f8d8606bcbed tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:26:54.280743 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a214564a-b091-4cf0-83ef-f8d8606bcbed tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:26:54.281474 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a214564a-b091-4cf0-83ef-f8d8606bcbed tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:26:54.282148 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a214564a-b091-4cf0-83ef-f8d8606bcbed tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:26:54.441794 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a214564a-b091-4cf0-83ef-f8d8606bcbed tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:26:54.449972 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a214564a-b091-4cf0-83ef-f8d8606bcbed tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/18122c92-14ea-4f8c-a6f5-35225127e753" status: 200 len: 1168 microversion: 2.1 time: 0.183883 Sep 08 11:26:54.450565 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3340/6546] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:26:54 2022] GET /compute/v2.1/servers/18122c92-14ea-4f8c-a6f5-35225127e753 => generated 1168 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:26:55.478756 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3cf447b8-ef68-46e4-accd-6f92458149ac tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:26:55.479467 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3cf447b8-ef68-46e4-accd-6f92458149ac tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 18122c92-14ea-4f8c-a6f5-35225127e753] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:26:55.486100 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3cf447b8-ef68-46e4-accd-6f92458149ac tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:26:55.486793 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3cf447b8-ef68-46e4-accd-6f92458149ac tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:26:55.487233 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3cf447b8-ef68-46e4-accd-6f92458149ac tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:26:55.488109 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3cf447b8-ef68-46e4-accd-6f92458149ac tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:26:55.488915 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3cf447b8-ef68-46e4-accd-6f92458149ac tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:26:55.489520 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3cf447b8-ef68-46e4-accd-6f92458149ac tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:26:55.667782 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3cf447b8-ef68-46e4-accd-6f92458149ac tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:26:55.675849 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3cf447b8-ef68-46e4-accd-6f92458149ac tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/18122c92-14ea-4f8c-a6f5-35225127e753" status: 200 len: 1168 microversion: 2.1 time: 0.203273 Sep 08 11:26:55.676476 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3207/6547] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:26:55 2022] GET /compute/v2.1/servers/18122c92-14ea-4f8c-a6f5-35225127e753 => generated 1168 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:26:56.702129 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e4472003-5716-41f8-921f-bf6dc4e949ab tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:26:56.703338 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e4472003-5716-41f8-921f-bf6dc4e949ab tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 18122c92-14ea-4f8c-a6f5-35225127e753] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:26:56.711302 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e4472003-5716-41f8-921f-bf6dc4e949ab tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:26:56.711796 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e4472003-5716-41f8-921f-bf6dc4e949ab tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:26:56.712239 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e4472003-5716-41f8-921f-bf6dc4e949ab tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:26:56.712947 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e4472003-5716-41f8-921f-bf6dc4e949ab tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:26:56.713448 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e4472003-5716-41f8-921f-bf6dc4e949ab tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:26:56.714304 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e4472003-5716-41f8-921f-bf6dc4e949ab tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:26:56.900452 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e4472003-5716-41f8-921f-bf6dc4e949ab tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:26:56.913383 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e4472003-5716-41f8-921f-bf6dc4e949ab tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/18122c92-14ea-4f8c-a6f5-35225127e753" status: 200 len: 1168 microversion: 2.1 time: 0.216848 Sep 08 11:26:56.924939 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3341/6548] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:26:56 2022] GET /compute/v2.1/servers/18122c92-14ea-4f8c-a6f5-35225127e753 => generated 1168 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:26:57.944597 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a27c3fc1-b92f-4851-a0c4-70f4cb710953 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:26:57.945964 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a27c3fc1-b92f-4851-a0c4-70f4cb710953 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 18122c92-14ea-4f8c-a6f5-35225127e753] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:26:57.955943 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a27c3fc1-b92f-4851-a0c4-70f4cb710953 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:26:57.956410 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a27c3fc1-b92f-4851-a0c4-70f4cb710953 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:26:57.957645 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a27c3fc1-b92f-4851-a0c4-70f4cb710953 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:26:57.958415 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a27c3fc1-b92f-4851-a0c4-70f4cb710953 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:26:57.958830 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a27c3fc1-b92f-4851-a0c4-70f4cb710953 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:26:57.959429 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a27c3fc1-b92f-4851-a0c4-70f4cb710953 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:26:58.123947 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a27c3fc1-b92f-4851-a0c4-70f4cb710953 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:26:58.136183 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a27c3fc1-b92f-4851-a0c4-70f4cb710953 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/18122c92-14ea-4f8c-a6f5-35225127e753" status: 200 len: 1168 microversion: 2.1 time: 0.195504 Sep 08 11:26:58.149413 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3208/6549] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:26:57 2022] GET /compute/v2.1/servers/18122c92-14ea-4f8c-a6f5-35225127e753 => generated 1168 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:26:59.162602 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9e67e326-754d-44f7-a613-85af1dcde827 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:26:59.163392 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9e67e326-754d-44f7-a613-85af1dcde827 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 18122c92-14ea-4f8c-a6f5-35225127e753] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:26:59.170562 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e67e326-754d-44f7-a613-85af1dcde827 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:26:59.171054 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e67e326-754d-44f7-a613-85af1dcde827 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:26:59.171500 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e67e326-754d-44f7-a613-85af1dcde827 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:26:59.172203 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e67e326-754d-44f7-a613-85af1dcde827 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:26:59.172663 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e67e326-754d-44f7-a613-85af1dcde827 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:26:59.173119 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e67e326-754d-44f7-a613-85af1dcde827 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:26:59.317104 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9e67e326-754d-44f7-a613-85af1dcde827 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:26:59.326454 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9e67e326-754d-44f7-a613-85af1dcde827 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/18122c92-14ea-4f8c-a6f5-35225127e753" status: 200 len: 1168 microversion: 2.1 time: 0.168344 Sep 08 11:26:59.341368 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3342/6550] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:26:59 2022] GET /compute/v2.1/servers/18122c92-14ea-4f8c-a6f5-35225127e753 => generated 1168 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:27:00.350217 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-50d1689e-ab24-4a86-a187-5778ff24a70c tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:27:00.350763 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-50d1689e-ab24-4a86-a187-5778ff24a70c tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 18122c92-14ea-4f8c-a6f5-35225127e753] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:27:00.357382 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-50d1689e-ab24-4a86-a187-5778ff24a70c tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:00.357867 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-50d1689e-ab24-4a86-a187-5778ff24a70c tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:00.358303 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-50d1689e-ab24-4a86-a187-5778ff24a70c tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:00.358986 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-50d1689e-ab24-4a86-a187-5778ff24a70c tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:00.359437 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-50d1689e-ab24-4a86-a187-5778ff24a70c tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:00.359859 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-50d1689e-ab24-4a86-a187-5778ff24a70c tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:00.489928 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-50d1689e-ab24-4a86-a187-5778ff24a70c tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:27:00.497638 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-50d1689e-ab24-4a86-a187-5778ff24a70c tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/18122c92-14ea-4f8c-a6f5-35225127e753" status: 200 len: 1168 microversion: 2.1 time: 0.151457 Sep 08 11:27:00.498221 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3209/6551] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:27:00 2022] GET /compute/v2.1/servers/18122c92-14ea-4f8c-a6f5-35225127e753 => generated 1168 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:27:01.521533 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a2711064-a735-4682-ba65-01738b110e6d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:27:01.522168 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a2711064-a735-4682-ba65-01738b110e6d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 18122c92-14ea-4f8c-a6f5-35225127e753] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:27:01.524964 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:27:01.530659 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a2711064-a735-4682-ba65-01738b110e6d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:01.531180 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a2711064-a735-4682-ba65-01738b110e6d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:01.531616 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a2711064-a735-4682-ba65-01738b110e6d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:01.532336 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a2711064-a735-4682-ba65-01738b110e6d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:01.532804 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a2711064-a735-4682-ba65-01738b110e6d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:01.533301 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a2711064-a735-4682-ba65-01738b110e6d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:01.682693 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a2711064-a735-4682-ba65-01738b110e6d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:27:01.690620 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a2711064-a735-4682-ba65-01738b110e6d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/18122c92-14ea-4f8c-a6f5-35225127e753" status: 200 len: 1168 microversion: 2.1 time: 0.173436 Sep 08 11:27:01.691197 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3343/6552] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:27:01 2022] GET /compute/v2.1/servers/18122c92-14ea-4f8c-a6f5-35225127e753 => generated 1168 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:27:02.715333 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a619cd1b-7f13-4ea2-ab0b-2d086169b5d8 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:27:02.715960 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a619cd1b-7f13-4ea2-ab0b-2d086169b5d8 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 18122c92-14ea-4f8c-a6f5-35225127e753] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:27:02.717950 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:27:02.719307 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:27:02.726162 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a619cd1b-7f13-4ea2-ab0b-2d086169b5d8 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:02.726654 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a619cd1b-7f13-4ea2-ab0b-2d086169b5d8 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:02.727088 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a619cd1b-7f13-4ea2-ab0b-2d086169b5d8 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:02.727791 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a619cd1b-7f13-4ea2-ab0b-2d086169b5d8 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:02.728245 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a619cd1b-7f13-4ea2-ab0b-2d086169b5d8 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:02.728686 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a619cd1b-7f13-4ea2-ab0b-2d086169b5d8 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:02.863322 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a619cd1b-7f13-4ea2-ab0b-2d086169b5d8 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:27:02.871422 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a619cd1b-7f13-4ea2-ab0b-2d086169b5d8 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/18122c92-14ea-4f8c-a6f5-35225127e753" status: 200 len: 1168 microversion: 2.1 time: 0.161166 Sep 08 11:27:02.872010 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3210/6553] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:27:02 2022] GET /compute/v2.1/servers/18122c92-14ea-4f8c-a6f5-35225127e753 => generated 1168 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:27:03.893850 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-647ec583-de4e-4233-9231-417d761f6bf9 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:27:03.894525 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-647ec583-de4e-4233-9231-417d761f6bf9 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 18122c92-14ea-4f8c-a6f5-35225127e753] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:27:03.902353 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-647ec583-de4e-4233-9231-417d761f6bf9 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:03.902852 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-647ec583-de4e-4233-9231-417d761f6bf9 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:03.903294 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-647ec583-de4e-4233-9231-417d761f6bf9 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:03.903998 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-647ec583-de4e-4233-9231-417d761f6bf9 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:03.904457 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-647ec583-de4e-4233-9231-417d761f6bf9 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:03.904883 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-647ec583-de4e-4233-9231-417d761f6bf9 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:04.037650 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-647ec583-de4e-4233-9231-417d761f6bf9 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:27:04.045631 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-647ec583-de4e-4233-9231-417d761f6bf9 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/18122c92-14ea-4f8c-a6f5-35225127e753" status: 200 len: 1168 microversion: 2.1 time: 0.155636 Sep 08 11:27:04.046218 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3344/6554] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:27:03 2022] GET /compute/v2.1/servers/18122c92-14ea-4f8c-a6f5-35225127e753 => generated 1168 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:27:05.068409 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f2f4922c-de35-49f3-bd1a-238aac94caba tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:27:05.069052 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f2f4922c-de35-49f3-bd1a-238aac94caba tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 18122c92-14ea-4f8c-a6f5-35225127e753] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:27:05.075872 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f2f4922c-de35-49f3-bd1a-238aac94caba tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:05.076360 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f2f4922c-de35-49f3-bd1a-238aac94caba tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:05.076800 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f2f4922c-de35-49f3-bd1a-238aac94caba tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:05.077552 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f2f4922c-de35-49f3-bd1a-238aac94caba tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:05.078003 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f2f4922c-de35-49f3-bd1a-238aac94caba tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:05.078427 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f2f4922c-de35-49f3-bd1a-238aac94caba tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:05.219241 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f2f4922c-de35-49f3-bd1a-238aac94caba tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:27:05.227841 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f2f4922c-de35-49f3-bd1a-238aac94caba tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/18122c92-14ea-4f8c-a6f5-35225127e753" status: 200 len: 1168 microversion: 2.1 time: 0.163758 Sep 08 11:27:05.228437 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3211/6555] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:27:05 2022] GET /compute/v2.1/servers/18122c92-14ea-4f8c-a6f5-35225127e753 => generated 1168 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:27:06.250711 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-24613098-7c63-4a31-b56c-47194f0df104 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:27:06.251339 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-24613098-7c63-4a31-b56c-47194f0df104 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 18122c92-14ea-4f8c-a6f5-35225127e753] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:27:06.259481 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24613098-7c63-4a31-b56c-47194f0df104 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:06.259985 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24613098-7c63-4a31-b56c-47194f0df104 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:06.260443 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24613098-7c63-4a31-b56c-47194f0df104 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:06.261184 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24613098-7c63-4a31-b56c-47194f0df104 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:06.261662 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24613098-7c63-4a31-b56c-47194f0df104 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:06.262101 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24613098-7c63-4a31-b56c-47194f0df104 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:06.405687 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-24613098-7c63-4a31-b56c-47194f0df104 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:27:06.414551 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-24613098-7c63-4a31-b56c-47194f0df104 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/18122c92-14ea-4f8c-a6f5-35225127e753" status: 200 len: 1214 microversion: 2.1 time: 0.167900 Sep 08 11:27:06.415132 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3345/6556] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:27:06 2022] GET /compute/v2.1/servers/18122c92-14ea-4f8c-a6f5-35225127e753 => generated 1214 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:27:07.437283 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-22c852be-89de-4bce-9144-b4176b4eb502 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:27:07.438159 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-22c852be-89de-4bce-9144-b4176b4eb502 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 18122c92-14ea-4f8c-a6f5-35225127e753] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:27:07.446604 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-22c852be-89de-4bce-9144-b4176b4eb502 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:07.447101 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-22c852be-89de-4bce-9144-b4176b4eb502 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:07.447568 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-22c852be-89de-4bce-9144-b4176b4eb502 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:07.448428 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-22c852be-89de-4bce-9144-b4176b4eb502 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:07.448939 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-22c852be-89de-4bce-9144-b4176b4eb502 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:07.449582 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-22c852be-89de-4bce-9144-b4176b4eb502 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:07.583723 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-22c852be-89de-4bce-9144-b4176b4eb502 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:27:07.591804 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-22c852be-89de-4bce-9144-b4176b4eb502 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/18122c92-14ea-4f8c-a6f5-35225127e753" status: 200 len: 1202 microversion: 2.1 time: 0.158869 Sep 08 11:27:07.592370 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3212/6557] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:27:07 2022] GET /compute/v2.1/servers/18122c92-14ea-4f8c-a6f5-35225127e753 => generated 1202 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:27:08.615209 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9076cc9b-c22f-4960-9a37-d228f40e9e39 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:27:08.615834 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9076cc9b-c22f-4960-9a37-d228f40e9e39 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 18122c92-14ea-4f8c-a6f5-35225127e753] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:27:08.623060 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9076cc9b-c22f-4960-9a37-d228f40e9e39 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:08.623557 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9076cc9b-c22f-4960-9a37-d228f40e9e39 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:08.624000 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9076cc9b-c22f-4960-9a37-d228f40e9e39 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:08.624706 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9076cc9b-c22f-4960-9a37-d228f40e9e39 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:08.625208 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9076cc9b-c22f-4960-9a37-d228f40e9e39 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:08.625646 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9076cc9b-c22f-4960-9a37-d228f40e9e39 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:08.754860 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9076cc9b-c22f-4960-9a37-d228f40e9e39 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:27:08.762829 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9076cc9b-c22f-4960-9a37-d228f40e9e39 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/18122c92-14ea-4f8c-a6f5-35225127e753" status: 200 len: 1202 microversion: 2.1 time: 0.152209 Sep 08 11:27:08.763399 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3346/6558] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:27:08 2022] GET /compute/v2.1/servers/18122c92-14ea-4f8c-a6f5-35225127e753 => generated 1202 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:27:09.786381 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0dec4512-1abf-4c22-b69b-fef1640a7f98 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:27:09.787021 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0dec4512-1abf-4c22-b69b-fef1640a7f98 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 18122c92-14ea-4f8c-a6f5-35225127e753] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:27:09.793902 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0dec4512-1abf-4c22-b69b-fef1640a7f98 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:09.794405 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0dec4512-1abf-4c22-b69b-fef1640a7f98 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:09.794823 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0dec4512-1abf-4c22-b69b-fef1640a7f98 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:09.795513 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0dec4512-1abf-4c22-b69b-fef1640a7f98 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:09.795967 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0dec4512-1abf-4c22-b69b-fef1640a7f98 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:09.796390 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0dec4512-1abf-4c22-b69b-fef1640a7f98 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:09.932077 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0dec4512-1abf-4c22-b69b-fef1640a7f98 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:27:09.939870 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0dec4512-1abf-4c22-b69b-fef1640a7f98 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/18122c92-14ea-4f8c-a6f5-35225127e753" status: 200 len: 1202 microversion: 2.1 time: 0.158034 Sep 08 11:27:09.940448 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3213/6559] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:27:09 2022] GET /compute/v2.1/servers/18122c92-14ea-4f8c-a6f5-35225127e753 => generated 1202 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:27:10.963983 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c8b92834-74a0-4fcb-bb63-b8ddff4cfc15 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:27:10.964858 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c8b92834-74a0-4fcb-bb63-b8ddff4cfc15 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 18122c92-14ea-4f8c-a6f5-35225127e753] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:27:10.971981 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c8b92834-74a0-4fcb-bb63-b8ddff4cfc15 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:10.972474 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c8b92834-74a0-4fcb-bb63-b8ddff4cfc15 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:10.972917 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c8b92834-74a0-4fcb-bb63-b8ddff4cfc15 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:10.973643 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c8b92834-74a0-4fcb-bb63-b8ddff4cfc15 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:10.974141 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c8b92834-74a0-4fcb-bb63-b8ddff4cfc15 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:10.974777 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c8b92834-74a0-4fcb-bb63-b8ddff4cfc15 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:11.113097 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c8b92834-74a0-4fcb-bb63-b8ddff4cfc15 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:27:11.121506 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c8b92834-74a0-4fcb-bb63-b8ddff4cfc15 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/18122c92-14ea-4f8c-a6f5-35225127e753" status: 200 len: 1202 microversion: 2.1 time: 0.161551 Sep 08 11:27:11.122087 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3347/6560] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:27:10 2022] GET /compute/v2.1/servers/18122c92-14ea-4f8c-a6f5-35225127e753 => generated 1202 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:27:12.144135 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d4b99255-aeb9-4973-be88-8c8a709abbe0 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:27:12.144654 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d4b99255-aeb9-4973-be88-8c8a709abbe0 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 18122c92-14ea-4f8c-a6f5-35225127e753] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:27:12.151707 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d4b99255-aeb9-4973-be88-8c8a709abbe0 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:12.152196 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d4b99255-aeb9-4973-be88-8c8a709abbe0 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:12.152632 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d4b99255-aeb9-4973-be88-8c8a709abbe0 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:12.153368 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d4b99255-aeb9-4973-be88-8c8a709abbe0 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:12.153825 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d4b99255-aeb9-4973-be88-8c8a709abbe0 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:12.154247 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d4b99255-aeb9-4973-be88-8c8a709abbe0 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:12.291800 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d4b99255-aeb9-4973-be88-8c8a709abbe0 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:27:12.300569 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d4b99255-aeb9-4973-be88-8c8a709abbe0 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/18122c92-14ea-4f8c-a6f5-35225127e753" status: 200 len: 1202 microversion: 2.1 time: 0.160354 Sep 08 11:27:12.301266 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3214/6561] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:27:12 2022] GET /compute/v2.1/servers/18122c92-14ea-4f8c-a6f5-35225127e753 => generated 1202 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:27:13.325899 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-56e951e1-317c-42ac-9d60-e3cbf95576c2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:27:13.326579 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-56e951e1-317c-42ac-9d60-e3cbf95576c2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 18122c92-14ea-4f8c-a6f5-35225127e753] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:27:13.333251 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-56e951e1-317c-42ac-9d60-e3cbf95576c2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:13.333889 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-56e951e1-317c-42ac-9d60-e3cbf95576c2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:13.334700 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-56e951e1-317c-42ac-9d60-e3cbf95576c2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:13.339204 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-56e951e1-317c-42ac-9d60-e3cbf95576c2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:13.339204 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-56e951e1-317c-42ac-9d60-e3cbf95576c2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:13.339204 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-56e951e1-317c-42ac-9d60-e3cbf95576c2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:13.478434 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-56e951e1-317c-42ac-9d60-e3cbf95576c2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:27:13.486485 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-56e951e1-317c-42ac-9d60-e3cbf95576c2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/18122c92-14ea-4f8c-a6f5-35225127e753" status: 200 len: 1202 microversion: 2.1 time: 0.164720 Sep 08 11:27:13.487060 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3348/6562] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:27:13 2022] GET /compute/v2.1/servers/18122c92-14ea-4f8c-a6f5-35225127e753 => generated 1202 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:27:14.511215 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e14ba421-b861-4368-bc5e-992d00e2d78b tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:27:14.511847 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e14ba421-b861-4368-bc5e-992d00e2d78b tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 18122c92-14ea-4f8c-a6f5-35225127e753] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:27:14.518681 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e14ba421-b861-4368-bc5e-992d00e2d78b tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:14.519174 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e14ba421-b861-4368-bc5e-992d00e2d78b tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:14.519645 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e14ba421-b861-4368-bc5e-992d00e2d78b tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:14.520392 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e14ba421-b861-4368-bc5e-992d00e2d78b tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:14.520806 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e14ba421-b861-4368-bc5e-992d00e2d78b tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:14.522184 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e14ba421-b861-4368-bc5e-992d00e2d78b tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:14.654788 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e14ba421-b861-4368-bc5e-992d00e2d78b tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:27:14.663501 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e14ba421-b861-4368-bc5e-992d00e2d78b tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/18122c92-14ea-4f8c-a6f5-35225127e753" status: 200 len: 1202 microversion: 2.1 time: 0.156511 Sep 08 11:27:14.664066 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3215/6563] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:27:14 2022] GET /compute/v2.1/servers/18122c92-14ea-4f8c-a6f5-35225127e753 => generated 1202 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:27:15.111158 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-e10b6788-f19c-4a3e-9600-9417a80d698a req-631db03d-388c-4d6e-9fef-4d9509661b50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18122c92-14ea-4f8c-a6f5-35225127e753", "name": "network-vif-plugged", "status": "completed", "tag": "d33ce48c-8ca0-45fd-a6e9-32828764b8c3"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:27:15.121420 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-e10b6788-f19c-4a3e-9600-9417a80d698a req-631db03d-388c-4d6e-9fef-4d9509661b50 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:15.121925 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-e10b6788-f19c-4a3e-9600-9417a80d698a req-631db03d-388c-4d6e-9fef-4d9509661b50 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:15.122372 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-e10b6788-f19c-4a3e-9600-9417a80d698a req-631db03d-388c-4d6e-9fef-4d9509661b50 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:15.134477 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-e10b6788-f19c-4a3e-9600-9417a80d698a req-631db03d-388c-4d6e-9fef-4d9509661b50 service nova] Creating event network-vif-plugged:d33ce48c-8ca0-45fd-a6e9-32828764b8c3 for instance 18122c92-14ea-4f8c-a6f5-35225127e753 on n-h1-850501-12 Sep 08 11:27:15.147945 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-e10b6788-f19c-4a3e-9600-9417a80d698a req-631db03d-388c-4d6e-9fef-4d9509661b50 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033043 Sep 08 11:27:15.147945 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3349/6564] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:27:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:27:15.687138 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b886a0aa-439e-4398-ae82-a9754871def1 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:27:15.687750 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b886a0aa-439e-4398-ae82-a9754871def1 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 18122c92-14ea-4f8c-a6f5-35225127e753] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:27:15.694871 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b886a0aa-439e-4398-ae82-a9754871def1 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:15.695365 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b886a0aa-439e-4398-ae82-a9754871def1 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:15.695804 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b886a0aa-439e-4398-ae82-a9754871def1 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:15.696501 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b886a0aa-439e-4398-ae82-a9754871def1 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:15.696954 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b886a0aa-439e-4398-ae82-a9754871def1 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:15.697410 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b886a0aa-439e-4398-ae82-a9754871def1 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:15.834682 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b886a0aa-439e-4398-ae82-a9754871def1 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:27:15.843477 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b886a0aa-439e-4398-ae82-a9754871def1 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/18122c92-14ea-4f8c-a6f5-35225127e753" status: 200 len: 1202 microversion: 2.1 time: 0.160190 Sep 08 11:27:15.844058 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3216/6565] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:27:15 2022] GET /compute/v2.1/servers/18122c92-14ea-4f8c-a6f5-35225127e753 => generated 1202 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:27:16.869054 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d278672b-6097-44d4-9c64-31142abe4a7d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:27:16.869769 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d278672b-6097-44d4-9c64-31142abe4a7d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 18122c92-14ea-4f8c-a6f5-35225127e753] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:27:16.876094 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d278672b-6097-44d4-9c64-31142abe4a7d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:16.876592 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d278672b-6097-44d4-9c64-31142abe4a7d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:16.877053 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d278672b-6097-44d4-9c64-31142abe4a7d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:16.877762 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d278672b-6097-44d4-9c64-31142abe4a7d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:16.878229 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d278672b-6097-44d4-9c64-31142abe4a7d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:16.878665 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d278672b-6097-44d4-9c64-31142abe4a7d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:17.016316 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d278672b-6097-44d4-9c64-31142abe4a7d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:27:17.024774 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d278672b-6097-44d4-9c64-31142abe4a7d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/18122c92-14ea-4f8c-a6f5-35225127e753" status: 200 len: 1388 microversion: 2.1 time: 0.161851 Sep 08 11:27:17.025371 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3350/6566] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:27:16 2022] GET /compute/v2.1/servers/18122c92-14ea-4f8c-a6f5-35225127e753 => generated 1388 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:27:17.047866 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dfbf1191-debe-4508-b5f8-e201db3eac21 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:27:17.048490 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-dfbf1191-debe-4508-b5f8-e201db3eac21 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 18122c92-14ea-4f8c-a6f5-35225127e753] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:27:17.055844 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dfbf1191-debe-4508-b5f8-e201db3eac21 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:17.056348 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dfbf1191-debe-4508-b5f8-e201db3eac21 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:17.057555 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dfbf1191-debe-4508-b5f8-e201db3eac21 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:17.057555 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dfbf1191-debe-4508-b5f8-e201db3eac21 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:17.057984 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dfbf1191-debe-4508-b5f8-e201db3eac21 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:17.058409 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dfbf1191-debe-4508-b5f8-e201db3eac21 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:17.196613 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-dfbf1191-debe-4508-b5f8-e201db3eac21 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:27:17.204481 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-dfbf1191-debe-4508-b5f8-e201db3eac21 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/18122c92-14ea-4f8c-a6f5-35225127e753" status: 200 len: 1388 microversion: 2.1 time: 0.160625 Sep 08 11:27:17.205079 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3217/6567] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:27:17 2022] GET /compute/v2.1/servers/18122c92-14ea-4f8c-a6f5-35225127e753 => generated 1388 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:27:17.228306 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4bcb8c2f-104b-4893-b590-6db825e0058e tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:27:17.228930 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4bcb8c2f-104b-4893-b590-6db825e0058e tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 18122c92-14ea-4f8c-a6f5-35225127e753] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:27:17.235089 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4bcb8c2f-104b-4893-b590-6db825e0058e tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:17.235586 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4bcb8c2f-104b-4893-b590-6db825e0058e tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:17.236031 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4bcb8c2f-104b-4893-b590-6db825e0058e tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:17.236745 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4bcb8c2f-104b-4893-b590-6db825e0058e tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:17.237252 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4bcb8c2f-104b-4893-b590-6db825e0058e tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:17.237691 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4bcb8c2f-104b-4893-b590-6db825e0058e tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:17.370256 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4bcb8c2f-104b-4893-b590-6db825e0058e tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:27:17.378178 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4bcb8c2f-104b-4893-b590-6db825e0058e tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/18122c92-14ea-4f8c-a6f5-35225127e753" status: 200 len: 1388 microversion: 2.1 time: 0.154745 Sep 08 11:27:17.378791 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3351/6568] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:27:17 2022] GET /compute/v2.1/servers/18122c92-14ea-4f8c-a6f5-35225127e753 => generated 1388 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:27:17.459445 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0650769c-5a6a-4a63-93a8-9c4782b0fb82 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:27:17.459987 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0650769c-5a6a-4a63-93a8-9c4782b0fb82 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 18122c92-14ea-4f8c-a6f5-35225127e753] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:27:17.466244 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0650769c-5a6a-4a63-93a8-9c4782b0fb82 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:17.466738 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0650769c-5a6a-4a63-93a8-9c4782b0fb82 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:17.467182 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0650769c-5a6a-4a63-93a8-9c4782b0fb82 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:17.467891 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0650769c-5a6a-4a63-93a8-9c4782b0fb82 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:17.468353 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0650769c-5a6a-4a63-93a8-9c4782b0fb82 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:17.468790 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0650769c-5a6a-4a63-93a8-9c4782b0fb82 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:17.493415 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0650769c-5a6a-4a63-93a8-9c4782b0fb82 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 18122c92-14ea-4f8c-a6f5-35225127e753] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:27:17.567099 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0650769c-5a6a-4a63-93a8-9c4782b0fb82 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "DELETE /compute/v2.1/servers/18122c92-14ea-4f8c-a6f5-35225127e753" status: 204 len: 0 microversion: 2.1 time: 0.111865 Sep 08 11:27:17.568500 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3218/6569] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:27:17 2022] DELETE /compute/v2.1/servers/18122c92-14ea-4f8c-a6f5-35225127e753 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 11:27:17.576864 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b35ade1b-8a98-40ab-820c-55d82a7c59af tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:27:17.577516 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b35ade1b-8a98-40ab-820c-55d82a7c59af tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 18122c92-14ea-4f8c-a6f5-35225127e753] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:27:17.583693 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b35ade1b-8a98-40ab-820c-55d82a7c59af tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:17.584196 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b35ade1b-8a98-40ab-820c-55d82a7c59af tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:17.584642 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b35ade1b-8a98-40ab-820c-55d82a7c59af tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:17.585418 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b35ade1b-8a98-40ab-820c-55d82a7c59af tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:17.586370 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b35ade1b-8a98-40ab-820c-55d82a7c59af tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:17.586798 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b35ade1b-8a98-40ab-820c-55d82a7c59af tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:17.724643 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b35ade1b-8a98-40ab-820c-55d82a7c59af tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:27:17.736508 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b35ade1b-8a98-40ab-820c-55d82a7c59af tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/18122c92-14ea-4f8c-a6f5-35225127e753" status: 200 len: 1394 microversion: 2.1 time: 0.163288 Sep 08 11:27:17.737494 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3352/6570] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:27:17 2022] GET /compute/v2.1/servers/18122c92-14ea-4f8c-a6f5-35225127e753 => generated 1394 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:27:18.760435 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ecfb6069-621c-48e8-8f64-091d8d44a467 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:27:18.761224 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ecfb6069-621c-48e8-8f64-091d8d44a467 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 18122c92-14ea-4f8c-a6f5-35225127e753] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:27:18.768303 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ecfb6069-621c-48e8-8f64-091d8d44a467 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:18.768801 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ecfb6069-621c-48e8-8f64-091d8d44a467 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:18.769267 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ecfb6069-621c-48e8-8f64-091d8d44a467 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:18.769980 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ecfb6069-621c-48e8-8f64-091d8d44a467 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:18.770433 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ecfb6069-621c-48e8-8f64-091d8d44a467 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:18.770859 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ecfb6069-621c-48e8-8f64-091d8d44a467 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:18.912419 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ecfb6069-621c-48e8-8f64-091d8d44a467 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:27:18.922897 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ecfb6069-621c-48e8-8f64-091d8d44a467 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/18122c92-14ea-4f8c-a6f5-35225127e753" status: 200 len: 1394 microversion: 2.1 time: 0.166548 Sep 08 11:27:18.923703 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3219/6571] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:27:18 2022] GET /compute/v2.1/servers/18122c92-14ea-4f8c-a6f5-35225127e753 => generated 1394 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:27:19.544217 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-27fa80ce-a333-4990-bec3-c57788f23c16 req-8097aba2-fd83-497b-a397-ef84c5463502 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18122c92-14ea-4f8c-a6f5-35225127e753", "name": "network-vif-deleted", "tag": "d33ce48c-8ca0-45fd-a6e9-32828764b8c3"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:27:19.556482 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-27fa80ce-a333-4990-bec3-c57788f23c16 req-8097aba2-fd83-497b-a397-ef84c5463502 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:19.556976 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-27fa80ce-a333-4990-bec3-c57788f23c16 req-8097aba2-fd83-497b-a397-ef84c5463502 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:19.557460 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-27fa80ce-a333-4990-bec3-c57788f23c16 req-8097aba2-fd83-497b-a397-ef84c5463502 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:19.573620 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-27fa80ce-a333-4990-bec3-c57788f23c16 req-8097aba2-fd83-497b-a397-ef84c5463502 service nova] Creating event network-vif-deleted:d33ce48c-8ca0-45fd-a6e9-32828764b8c3 for instance 18122c92-14ea-4f8c-a6f5-35225127e753 on n-h1-850501-12 Sep 08 11:27:19.579248 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-27fa80ce-a333-4990-bec3-c57788f23c16 req-8097aba2-fd83-497b-a397-ef84c5463502 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038587 Sep 08 11:27:19.580268 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3353/6572] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:27:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:27:19.945842 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1c5bd2f1-e75c-4af5-af8a-3656fc86a911 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:27:19.946628 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1c5bd2f1-e75c-4af5-af8a-3656fc86a911 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 18122c92-14ea-4f8c-a6f5-35225127e753] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:27:19.953708 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c5bd2f1-e75c-4af5-af8a-3656fc86a911 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:19.954201 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c5bd2f1-e75c-4af5-af8a-3656fc86a911 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:19.954639 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c5bd2f1-e75c-4af5-af8a-3656fc86a911 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:19.955341 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c5bd2f1-e75c-4af5-af8a-3656fc86a911 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:19.955799 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c5bd2f1-e75c-4af5-af8a-3656fc86a911 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:19.956229 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c5bd2f1-e75c-4af5-af8a-3656fc86a911 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:19.960532 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:27:20.023101 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1c5bd2f1-e75c-4af5-af8a-3656fc86a911 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:27:20.031093 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1c5bd2f1-e75c-4af5-af8a-3656fc86a911 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/18122c92-14ea-4f8c-a6f5-35225127e753" status: 200 len: 1187 microversion: 2.1 time: 0.089173 Sep 08 11:27:20.031927 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3220/6573] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:27:19 2022] GET /compute/v2.1/servers/18122c92-14ea-4f8c-a6f5-35225127e753 => generated 1187 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:27:21.057287 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a358f18b-a3ed-40ce-b84d-fa01586da6a3 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:27:21.058017 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a358f18b-a3ed-40ce-b84d-fa01586da6a3 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 18122c92-14ea-4f8c-a6f5-35225127e753] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:27:21.060116 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=35 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:27:21.066348 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a358f18b-a3ed-40ce-b84d-fa01586da6a3 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:21.066848 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a358f18b-a3ed-40ce-b84d-fa01586da6a3 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:21.067294 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a358f18b-a3ed-40ce-b84d-fa01586da6a3 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:21.068045 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a358f18b-a3ed-40ce-b84d-fa01586da6a3 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:21.069310 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a358f18b-a3ed-40ce-b84d-fa01586da6a3 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:21.069705 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a358f18b-a3ed-40ce-b84d-fa01586da6a3 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:21.072537 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=83 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:27:21.138564 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a358f18b-a3ed-40ce-b84d-fa01586da6a3 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:27:21.147111 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a358f18b-a3ed-40ce-b84d-fa01586da6a3 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/18122c92-14ea-4f8c-a6f5-35225127e753" status: 200 len: 1187 microversion: 2.1 time: 0.095778 Sep 08 11:27:21.147631 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3354/6574] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:27:21 2022] GET /compute/v2.1/servers/18122c92-14ea-4f8c-a6f5-35225127e753 => generated 1187 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:27:22.170174 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0316248c-3e99-4d0b-9cb8-f7a418b2fcfd tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:27:22.170949 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0316248c-3e99-4d0b-9cb8-f7a418b2fcfd tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 18122c92-14ea-4f8c-a6f5-35225127e753] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:27:22.174168 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:27:22.180369 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0316248c-3e99-4d0b-9cb8-f7a418b2fcfd tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:22.180947 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0316248c-3e99-4d0b-9cb8-f7a418b2fcfd tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:22.181488 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0316248c-3e99-4d0b-9cb8-f7a418b2fcfd tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:22.182277 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0316248c-3e99-4d0b-9cb8-f7a418b2fcfd tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:22.183064 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0316248c-3e99-4d0b-9cb8-f7a418b2fcfd tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:22.183498 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0316248c-3e99-4d0b-9cb8-f7a418b2fcfd tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:22.249840 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0316248c-3e99-4d0b-9cb8-f7a418b2fcfd tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:27:22.258592 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0316248c-3e99-4d0b-9cb8-f7a418b2fcfd tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/18122c92-14ea-4f8c-a6f5-35225127e753" status: 200 len: 1187 microversion: 2.1 time: 0.092915 Sep 08 11:27:22.259173 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3221/6575] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:27:22 2022] GET /compute/v2.1/servers/18122c92-14ea-4f8c-a6f5-35225127e753 => generated 1187 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:27:23.281528 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d894be3e-8756-4b2b-9209-fdc77a367caf tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:27:23.282251 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d894be3e-8756-4b2b-9209-fdc77a367caf tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 18122c92-14ea-4f8c-a6f5-35225127e753] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:27:23.289858 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d894be3e-8756-4b2b-9209-fdc77a367caf tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:23.290369 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d894be3e-8756-4b2b-9209-fdc77a367caf tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:23.290812 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d894be3e-8756-4b2b-9209-fdc77a367caf tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:23.291509 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d894be3e-8756-4b2b-9209-fdc77a367caf tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:23.291966 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d894be3e-8756-4b2b-9209-fdc77a367caf tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:23.292393 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d894be3e-8756-4b2b-9209-fdc77a367caf tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:23.361937 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d894be3e-8756-4b2b-9209-fdc77a367caf tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:27:23.370219 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d894be3e-8756-4b2b-9209-fdc77a367caf tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/18122c92-14ea-4f8c-a6f5-35225127e753" status: 200 len: 1187 microversion: 2.1 time: 0.092585 Sep 08 11:27:23.370811 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3355/6576] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:27:23 2022] GET /compute/v2.1/servers/18122c92-14ea-4f8c-a6f5-35225127e753 => generated 1187 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:27:24.396076 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fbb0cac9-6746-4733-b4e2-19a9bc46d91d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:27:24.396770 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fbb0cac9-6746-4733-b4e2-19a9bc46d91d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 18122c92-14ea-4f8c-a6f5-35225127e753] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:27:24.404566 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fbb0cac9-6746-4733-b4e2-19a9bc46d91d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:24.405084 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fbb0cac9-6746-4733-b4e2-19a9bc46d91d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:24.405532 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fbb0cac9-6746-4733-b4e2-19a9bc46d91d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:24.406252 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fbb0cac9-6746-4733-b4e2-19a9bc46d91d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:24.406709 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fbb0cac9-6746-4733-b4e2-19a9bc46d91d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:24.407155 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fbb0cac9-6746-4733-b4e2-19a9bc46d91d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:24.441569 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fbb0cac9-6746-4733-b4e2-19a9bc46d91d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:24.442049 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fbb0cac9-6746-4733-b4e2-19a9bc46d91d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:24.442481 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fbb0cac9-6746-4733-b4e2-19a9bc46d91d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:24.442927 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-fbb0cac9-6746-4733-b4e2-19a9bc46d91d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lazy-loading 'fault' on Instance uuid 18122c92-14ea-4f8c-a6f5-35225127e753 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:27:24.492115 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fbb0cac9-6746-4733-b4e2-19a9bc46d91d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:27:24.502656 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fbb0cac9-6746-4733-b4e2-19a9bc46d91d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/18122c92-14ea-4f8c-a6f5-35225127e753" status: 200 len: 1192 microversion: 2.1 time: 0.111484 Sep 08 11:27:24.503247 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3222/6577] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:27:24 2022] GET /compute/v2.1/servers/18122c92-14ea-4f8c-a6f5-35225127e753 => generated 1192 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:27:25.527545 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2c07cf25-b9e2-478a-be37-563590bd86c4 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:27:25.528173 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2c07cf25-b9e2-478a-be37-563590bd86c4 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 18122c92-14ea-4f8c-a6f5-35225127e753] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:27:25.535025 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2c07cf25-b9e2-478a-be37-563590bd86c4 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:25.535511 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2c07cf25-b9e2-478a-be37-563590bd86c4 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:25.535946 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2c07cf25-b9e2-478a-be37-563590bd86c4 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:25.536644 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2c07cf25-b9e2-478a-be37-563590bd86c4 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:25.537421 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2c07cf25-b9e2-478a-be37-563590bd86c4 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:25.538068 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2c07cf25-b9e2-478a-be37-563590bd86c4 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:25.551818 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-2c07cf25-b9e2-478a-be37-563590bd86c4 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] HTTP exception thrown: Instance 18122c92-14ea-4f8c-a6f5-35225127e753 could not be found. Sep 08 11:27:25.554136 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2c07cf25-b9e2-478a-be37-563590bd86c4 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Request method failure captured: Sep 08 11:27:25.554136 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/18122c92-14ea-4f8c-a6f5-35225127e753 HTTP/1.1 Sep 08 11:27:25.554136 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:27:25.554136 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:27:25.554136 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:27:25.554136 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 11:27:25.554136 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:27:25.554136 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:27:25.554136 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:27:25.554136 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:27:25.554136 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGdEih_jYhjrfzcEat7QOG_17jH52nIZFToedVJMJ8Jj4pTKrcjanm3D8dChnqEL9d7jV5rq3NW7Z60oajSkgXZAcEtwDn7-PJMU6a9_UOAo8UiiyZ8L4GogQF4UWk_-Vlyi8Q447m99c-S3nr2fWKYhvhV9-SsmuV-ccLSbm0hBFVVM Sep 08 11:27:25.554136 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:27:25.554136 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:27:25.554136 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:27:25.554136 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:27:25.554136 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:27:25.554136 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:27:25.554136 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 747bb5860ba14a20bba3b1c2197ea75d Sep 08 11:27:25.554136 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-TestVolumeBootPattern-1812135790 Sep 08 11:27:25.554136 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:27:25.554136 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:27:25.554136 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/747bb5860ba14a20bba3b1c2197ea75d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/747bb5860ba14a20bba3b1c2197ea75d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_747bb5860ba14a20bba3b1c2197ea75d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/747bb5860ba14a20bba3b1c2197ea75d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:27:25.554136 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-TestVolumeBootPattern-1812135790 Sep 08 11:27:25.554136 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 747bb5860ba14a20bba3b1c2197ea75d Sep 08 11:27:25.554136 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-TestVolumeBootPattern-1812135790 Sep 08 11:27:25.554136 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-TestVolumeBootPattern-1812135790-project Sep 08 11:27:25.554136 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:27:25.554136 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:27:25.554136 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: bc18639e461e4ef5bfcf4380c561f329 Sep 08 11:27:25.554136 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-TestVolumeBootPattern-1812135790-project Sep 08 11:27:25.554136 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 11:27:25.554136 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 18122c92-14ea-4f8c-a6f5-35225127e753 could not be found. Sep 08 11:27:25.554136 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '18122c92-14ea-4f8c-a6f5-35225127e753'} Sep 08 11:27:25.554136 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:27:25.554136 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:27:25.554136 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:27:25.554136 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:27:25.554136 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:27:25.554136 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:27:25.554136 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:27:25.554136 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:27:25.554136 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:27:25.554136 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:27:25.554136 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18122c92-14ea-4f8c-a6f5-35225127e753 could not be found. Sep 08 11:27:25.554136 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:27:25.554136 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:27:25.554136 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:27:25.554136 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:27:25.554136 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:27:25.554136 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:27:25.554136 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:27:25.554136 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:27:25.554136 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:27:25.554136 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:27:25.554136 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:27:25.554136 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:27:25.554136 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:27:25.554136 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:27:25.554136 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:27:25.554136 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:27:25.554136 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18122c92-14ea-4f8c-a6f5-35225127e753 could not be found. Sep 08 11:27:25.554136 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:27:25.554136 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:27:25.554136 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:27:25.559339 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:27:25.559339 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:27:25.559339 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:27:25.559339 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:27:25.559339 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:27:25.559339 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18122c92-14ea-4f8c-a6f5-35225127e753 could not be found. Sep 08 11:27:25.559339 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:27:25.559339 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2c07cf25-b9e2-478a-be37-563590bd86c4 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Returning 404 to user: Instance 18122c92-14ea-4f8c-a6f5-35225127e753 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:27:25.559339 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2c07cf25-b9e2-478a-be37-563590bd86c4 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/18122c92-14ea-4f8c-a6f5-35225127e753" status: 404 len: 111 microversion: 2.1 time: 0.032130 Sep 08 11:27:25.560071 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3356/6578] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:27:25 2022] GET /compute/v2.1/servers/18122c92-14ea-4f8c-a6f5-35225127e753 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:27:26.644572 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3185fe11-ce00-4635-a290-4f1c17e563c6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:27:26.645116 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3185fe11-ce00-4635-a290-4f1c17e563c6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 18122c92-14ea-4f8c-a6f5-35225127e753] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:27:26.652975 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3185fe11-ce00-4635-a290-4f1c17e563c6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:26.653503 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3185fe11-ce00-4635-a290-4f1c17e563c6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:26.653946 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3185fe11-ce00-4635-a290-4f1c17e563c6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:26.654655 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3185fe11-ce00-4635-a290-4f1c17e563c6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:26.655116 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3185fe11-ce00-4635-a290-4f1c17e563c6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:26.655544 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3185fe11-ce00-4635-a290-4f1c17e563c6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:26.673578 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-3185fe11-ce00-4635-a290-4f1c17e563c6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] HTTP exception thrown: Instance 18122c92-14ea-4f8c-a6f5-35225127e753 could not be found. Sep 08 11:27:26.675498 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3185fe11-ce00-4635-a290-4f1c17e563c6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Request method failure captured: Sep 08 11:27:26.675498 n-d-850501-12 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/servers/18122c92-14ea-4f8c-a6f5-35225127e753 HTTP/1.1 Sep 08 11:27:26.675498 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 11:27:26.675498 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 11:27:26.675498 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 11:27:26.675498 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 11:27:26.675498 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 11:27:26.675498 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 11:27:26.675498 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 11:27:26.675498 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 11:27:26.675498 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGdEih_jYhjrfzcEat7QOG_17jH52nIZFToedVJMJ8Jj4pTKrcjanm3D8dChnqEL9d7jV5rq3NW7Z60oajSkgXZAcEtwDn7-PJMU6a9_UOAo8UiiyZ8L4GogQF4UWk_-Vlyi8Q447m99c-S3nr2fWKYhvhV9-SsmuV-ccLSbm0hBFVVM Sep 08 11:27:26.675498 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 11:27:26.675498 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 11:27:26.675498 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 11:27:26.675498 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 11:27:26.675498 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 11:27:26.675498 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 11:27:26.675498 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 747bb5860ba14a20bba3b1c2197ea75d Sep 08 11:27:26.675498 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-TestVolumeBootPattern-1812135790 Sep 08 11:27:26.675498 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 11:27:26.675498 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 11:27:26.675498 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/747bb5860ba14a20bba3b1c2197ea75d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/747bb5860ba14a20bba3b1c2197ea75d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_747bb5860ba14a20bba3b1c2197ea75d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/747bb5860ba14a20bba3b1c2197ea75d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:27:26.675498 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-TestVolumeBootPattern-1812135790 Sep 08 11:27:26.675498 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 747bb5860ba14a20bba3b1c2197ea75d Sep 08 11:27:26.675498 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-TestVolumeBootPattern-1812135790 Sep 08 11:27:26.675498 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-TestVolumeBootPattern-1812135790-project Sep 08 11:27:26.675498 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 11:27:26.675498 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 11:27:26.675498 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: bc18639e461e4ef5bfcf4380c561f329 Sep 08 11:27:26.675498 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-TestVolumeBootPattern-1812135790-project Sep 08 11:27:26.675498 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 11:27:26.675498 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 18122c92-14ea-4f8c-a6f5-35225127e753 could not be found. Sep 08 11:27:26.675498 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '18122c92-14ea-4f8c-a6f5-35225127e753'} Sep 08 11:27:26.675498 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:27:26.675498 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:27:26.675498 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:27:26.675498 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:27:26.675498 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:27:26.675498 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:27:26.675498 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:27:26.675498 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:27:26.675498 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:27:26.675498 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:27:26.675498 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18122c92-14ea-4f8c-a6f5-35225127e753 could not be found. Sep 08 11:27:26.675498 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:27:26.675498 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:27:26.675498 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:27:26.675498 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:27:26.675498 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:27:26.675498 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:27:26.675498 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:27:26.675498 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:27:26.675498 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:27:26.675498 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:27:26.675498 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 11:27:26.675498 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 11:27:26.675498 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 11:27:26.675498 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 11:27:26.675498 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:27:26.675498 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:27:26.675498 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:27:26.675498 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:27:26.680285 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18122c92-14ea-4f8c-a6f5-35225127e753 could not be found. Sep 08 11:27:26.680285 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:27:26.680285 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:27:26.680285 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:27:26.680285 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:27:26.680285 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:27:26.680285 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:27:26.680285 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:27:26.680285 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:27:26.680285 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18122c92-14ea-4f8c-a6f5-35225127e753 could not be found. Sep 08 11:27:26.680285 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:27:26.681805 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3185fe11-ce00-4635-a290-4f1c17e563c6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Returning 404 to user: Instance 18122c92-14ea-4f8c-a6f5-35225127e753 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:27:26.682676 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3185fe11-ce00-4635-a290-4f1c17e563c6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "DELETE /compute/v2.1/servers/18122c92-14ea-4f8c-a6f5-35225127e753" status: 404 len: 111 microversion: 2.1 time: 0.042128 Sep 08 11:27:26.683239 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3223/6579] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:27:26 2022] DELETE /compute/v2.1/servers/18122c92-14ea-4f8c-a6f5-35225127e753 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 11:27:26.691824 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2d1b5d3b-559e-47a3-b666-b7b41b5c31e2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:27:26.692449 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2d1b5d3b-559e-47a3-b666-b7b41b5c31e2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 18122c92-14ea-4f8c-a6f5-35225127e753] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:27:26.699603 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2d1b5d3b-559e-47a3-b666-b7b41b5c31e2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:26.700101 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2d1b5d3b-559e-47a3-b666-b7b41b5c31e2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:26.700913 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2d1b5d3b-559e-47a3-b666-b7b41b5c31e2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:26.701675 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2d1b5d3b-559e-47a3-b666-b7b41b5c31e2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:26.702142 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2d1b5d3b-559e-47a3-b666-b7b41b5c31e2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:26.702579 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2d1b5d3b-559e-47a3-b666-b7b41b5c31e2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:26.717285 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-2d1b5d3b-559e-47a3-b666-b7b41b5c31e2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] HTTP exception thrown: Instance 18122c92-14ea-4f8c-a6f5-35225127e753 could not be found. Sep 08 11:27:26.718937 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2d1b5d3b-559e-47a3-b666-b7b41b5c31e2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Request method failure captured: Sep 08 11:27:26.718937 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/18122c92-14ea-4f8c-a6f5-35225127e753 HTTP/1.1 Sep 08 11:27:26.718937 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:27:26.718937 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:27:26.718937 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:27:26.718937 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 11:27:26.718937 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:27:26.718937 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:27:26.718937 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:27:26.718937 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:27:26.718937 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGdEih_jYhjrfzcEat7QOG_17jH52nIZFToedVJMJ8Jj4pTKrcjanm3D8dChnqEL9d7jV5rq3NW7Z60oajSkgXZAcEtwDn7-PJMU6a9_UOAo8UiiyZ8L4GogQF4UWk_-Vlyi8Q447m99c-S3nr2fWKYhvhV9-SsmuV-ccLSbm0hBFVVM Sep 08 11:27:26.718937 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:27:26.718937 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:27:26.718937 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:27:26.718937 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:27:26.718937 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:27:26.718937 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:27:26.718937 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 747bb5860ba14a20bba3b1c2197ea75d Sep 08 11:27:26.718937 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-TestVolumeBootPattern-1812135790 Sep 08 11:27:26.718937 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:27:26.718937 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:27:26.718937 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/747bb5860ba14a20bba3b1c2197ea75d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/747bb5860ba14a20bba3b1c2197ea75d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_747bb5860ba14a20bba3b1c2197ea75d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/747bb5860ba14a20bba3b1c2197ea75d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:27:26.718937 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-TestVolumeBootPattern-1812135790 Sep 08 11:27:26.718937 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 747bb5860ba14a20bba3b1c2197ea75d Sep 08 11:27:26.718937 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-TestVolumeBootPattern-1812135790 Sep 08 11:27:26.718937 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-TestVolumeBootPattern-1812135790-project Sep 08 11:27:26.718937 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:27:26.718937 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:27:26.718937 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: bc18639e461e4ef5bfcf4380c561f329 Sep 08 11:27:26.718937 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-TestVolumeBootPattern-1812135790-project Sep 08 11:27:26.718937 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 11:27:26.718937 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 18122c92-14ea-4f8c-a6f5-35225127e753 could not be found. Sep 08 11:27:26.718937 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '18122c92-14ea-4f8c-a6f5-35225127e753'} Sep 08 11:27:26.718937 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:27:26.718937 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:27:26.718937 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:27:26.718937 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:27:26.718937 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:27:26.718937 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:27:26.718937 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:27:26.718937 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:27:26.718937 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:27:26.718937 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:27:26.718937 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18122c92-14ea-4f8c-a6f5-35225127e753 could not be found. Sep 08 11:27:26.718937 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:27:26.718937 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:27:26.718937 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:27:26.718937 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:27:26.718937 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:27:26.718937 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:27:26.718937 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:27:26.718937 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:27:26.718937 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:27:26.718937 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:27:26.718937 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:27:26.718937 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:27:26.718937 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:27:26.718937 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:27:26.718937 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:27:26.718937 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:27:26.718937 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18122c92-14ea-4f8c-a6f5-35225127e753 could not be found. Sep 08 11:27:26.718937 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:27:26.718937 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:27:26.718937 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:27:26.727584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:27:26.727584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:27:26.727584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:27:26.727584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:27:26.727584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:27:26.727584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18122c92-14ea-4f8c-a6f5-35225127e753 could not be found. Sep 08 11:27:26.727584 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:27:26.727584 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2d1b5d3b-559e-47a3-b666-b7b41b5c31e2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Returning 404 to user: Instance 18122c92-14ea-4f8c-a6f5-35225127e753 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:27:26.727584 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2d1b5d3b-559e-47a3-b666-b7b41b5c31e2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/18122c92-14ea-4f8c-a6f5-35225127e753" status: 404 len: 111 microversion: 2.1 time: 0.032557 Sep 08 11:27:26.727584 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3357/6580] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:27:26 2022] GET /compute/v2.1/servers/18122c92-14ea-4f8c-a6f5-35225127e753 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:27:46.415548 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5bf86775-d170-434d-b557-489c82300f38 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1233656183", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "bdc479c0-f09f-4983-a88d-6e0d8ff41440", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "6c224653-dc3b-48b8-9084-30761e623f71"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:27:46.425839 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=7 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:27:46.426495 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=20 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:27:46.481045 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-5bf86775-d170-434d-b557-489c82300f38 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] validate_networks() for [('6c224653-dc3b-48b8-9084-30761e623f71', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:27:47.007479 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-5bf86775-d170-434d-b557-489c82300f38 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:27:47.008174 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-5bf86775-d170-434d-b557-489c82300f38 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:27:47.008658 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-5bf86775-d170-434d-b557-489c82300f38 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:27:47.009097 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-5bf86775-d170-434d-b557-489c82300f38 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:27:47.009572 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-5bf86775-d170-434d-b557-489c82300f38 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:27:47.018409 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5bf86775-d170-434d-b557-489c82300f38 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:47.018890 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5bf86775-d170-434d-b557-489c82300f38 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:47.019324 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5bf86775-d170-434d-b557-489c82300f38 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:47.020046 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5bf86775-d170-434d-b557-489c82300f38 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:47.020497 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5bf86775-d170-434d-b557-489c82300f38 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:47.020918 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5bf86775-d170-434d-b557-489c82300f38 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:47.040310 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-5bf86775-d170-434d-b557-489c82300f38 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Getting quotas for project 747bb5860ba14a20bba3b1c2197ea75d. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:27:47.045631 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-5bf86775-d170-434d-b557-489c82300f38 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Getting quotas for user bc18639e461e4ef5bfcf4380c561f329 and project 747bb5860ba14a20bba3b1c2197ea75d. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:27:47.104507 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5bf86775-d170-434d-b557-489c82300f38 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:27:47.107420 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5bf86775-d170-434d-b557-489c82300f38 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: cd4021f3-ff9e-47c7-9a1c-0578b5fd79db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bdc479c0-f09f-4983-a88d-6e0d8ff41440',volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:27:47.238526 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5bf86775-d170-434d-b557-489c82300f38 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.827577 Sep 08 11:27:47.239168 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3224/6581] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 11:27:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 829 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:27:47.250866 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a1210730-40fa-4635-a8a5-da5fe8479eb1 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:27:47.251848 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a1210730-40fa-4635-a8a5-da5fe8479eb1 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: cd4021f3-ff9e-47c7-9a1c-0578b5fd79db] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:27:47.255843 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=7 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:27:47.256678 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=15 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:27:47.311829 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a1210730-40fa-4635-a8a5-da5fe8479eb1 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:27:47.318738 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a1210730-40fa-4635-a8a5-da5fe8479eb1 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/cd4021f3-ff9e-47c7-9a1c-0578b5fd79db" status: 200 len: 1071 microversion: 2.1 time: 0.071989 Sep 08 11:27:47.319408 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3358/6582] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:27:47 2022] GET /compute/v2.1/servers/cd4021f3-ff9e-47c7-9a1c-0578b5fd79db => generated 1071 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:27:48.344639 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-811ddee5-b01f-4f48-a08c-ac28895bf08d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:27:48.345327 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-811ddee5-b01f-4f48-a08c-ac28895bf08d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: cd4021f3-ff9e-47c7-9a1c-0578b5fd79db] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:27:48.351878 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-811ddee5-b01f-4f48-a08c-ac28895bf08d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:48.352626 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-811ddee5-b01f-4f48-a08c-ac28895bf08d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:48.353440 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-811ddee5-b01f-4f48-a08c-ac28895bf08d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:48.354176 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-811ddee5-b01f-4f48-a08c-ac28895bf08d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:48.354645 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-811ddee5-b01f-4f48-a08c-ac28895bf08d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:48.355104 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-811ddee5-b01f-4f48-a08c-ac28895bf08d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:48.438315 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-811ddee5-b01f-4f48-a08c-ac28895bf08d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:27:48.452309 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-811ddee5-b01f-4f48-a08c-ac28895bf08d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/cd4021f3-ff9e-47c7-9a1c-0578b5fd79db" status: 200 len: 1187 microversion: 2.1 time: 0.111888 Sep 08 11:27:48.453965 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3225/6583] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:27:48 2022] GET /compute/v2.1/servers/cd4021f3-ff9e-47c7-9a1c-0578b5fd79db => generated 1187 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:27:49.477958 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0de8f2e0-3403-471a-a9c5-bde290169f95 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:27:49.479441 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0de8f2e0-3403-471a-a9c5-bde290169f95 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: cd4021f3-ff9e-47c7-9a1c-0578b5fd79db] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:27:49.487774 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0de8f2e0-3403-471a-a9c5-bde290169f95 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:49.488273 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0de8f2e0-3403-471a-a9c5-bde290169f95 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:49.488724 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0de8f2e0-3403-471a-a9c5-bde290169f95 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:49.489457 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0de8f2e0-3403-471a-a9c5-bde290169f95 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:49.490119 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0de8f2e0-3403-471a-a9c5-bde290169f95 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:49.490561 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0de8f2e0-3403-471a-a9c5-bde290169f95 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:49.628224 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0de8f2e0-3403-471a-a9c5-bde290169f95 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:27:49.642161 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0de8f2e0-3403-471a-a9c5-bde290169f95 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/cd4021f3-ff9e-47c7-9a1c-0578b5fd79db" status: 200 len: 1229 microversion: 2.1 time: 0.168246 Sep 08 11:27:49.652166 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-2bac34fd-65b8-4805-9d3e-ee64fd656e65 req-9341ceea-67e4-446f-be82-a3ffcd53ee5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd4021f3-ff9e-47c7-9a1c-0578b5fd79db", "tag": "ea1b6336-b8ba-4704-b239-32e300dedf92"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:27:49.656033 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3359/6584] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:27:49 2022] GET /compute/v2.1/servers/cd4021f3-ff9e-47c7-9a1c-0578b5fd79db => generated 1229 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:27:49.666015 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-2bac34fd-65b8-4805-9d3e-ee64fd656e65 req-9341ceea-67e4-446f-be82-a3ffcd53ee5a service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:49.667128 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-2bac34fd-65b8-4805-9d3e-ee64fd656e65 req-9341ceea-67e4-446f-be82-a3ffcd53ee5a service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:49.667609 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-2bac34fd-65b8-4805-9d3e-ee64fd656e65 req-9341ceea-67e4-446f-be82-a3ffcd53ee5a service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:49.681421 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-2bac34fd-65b8-4805-9d3e-ee64fd656e65 req-9341ceea-67e4-446f-be82-a3ffcd53ee5a service nova] Creating event network-changed:ea1b6336-b8ba-4704-b239-32e300dedf92 for instance cd4021f3-ff9e-47c7-9a1c-0578b5fd79db on n-h1-850501-12 Sep 08 11:27:49.686631 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-2bac34fd-65b8-4805-9d3e-ee64fd656e65 req-9341ceea-67e4-446f-be82-a3ffcd53ee5a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039465 Sep 08 11:27:49.687632 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3226/6585] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:27:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:27:50.666286 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a2a24113-e040-4c89-8814-3595804eda6a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:27:50.666976 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a2a24113-e040-4c89-8814-3595804eda6a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: cd4021f3-ff9e-47c7-9a1c-0578b5fd79db] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:27:50.675050 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a2a24113-e040-4c89-8814-3595804eda6a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:50.675575 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a2a24113-e040-4c89-8814-3595804eda6a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:50.676021 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a2a24113-e040-4c89-8814-3595804eda6a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:50.676959 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a2a24113-e040-4c89-8814-3595804eda6a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:50.677609 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a2a24113-e040-4c89-8814-3595804eda6a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:50.678359 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a2a24113-e040-4c89-8814-3595804eda6a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:50.835469 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a2a24113-e040-4c89-8814-3595804eda6a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:27:50.844542 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a2a24113-e040-4c89-8814-3595804eda6a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/cd4021f3-ff9e-47c7-9a1c-0578b5fd79db" status: 200 len: 1229 microversion: 2.1 time: 0.183022 Sep 08 11:27:50.852801 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3360/6586] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:27:50 2022] GET /compute/v2.1/servers/cd4021f3-ff9e-47c7-9a1c-0578b5fd79db => generated 1229 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:27:51.869629 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-df086f25-53b4-4f4f-aa2a-f3aec961efe6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:27:51.870338 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-df086f25-53b4-4f4f-aa2a-f3aec961efe6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: cd4021f3-ff9e-47c7-9a1c-0578b5fd79db] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:27:51.876583 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df086f25-53b4-4f4f-aa2a-f3aec961efe6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:51.877105 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df086f25-53b4-4f4f-aa2a-f3aec961efe6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:51.877550 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df086f25-53b4-4f4f-aa2a-f3aec961efe6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:51.878251 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df086f25-53b4-4f4f-aa2a-f3aec961efe6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:51.878706 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df086f25-53b4-4f4f-aa2a-f3aec961efe6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:51.879132 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df086f25-53b4-4f4f-aa2a-f3aec961efe6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:52.026093 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-df086f25-53b4-4f4f-aa2a-f3aec961efe6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:27:52.034515 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-df086f25-53b4-4f4f-aa2a-f3aec961efe6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/cd4021f3-ff9e-47c7-9a1c-0578b5fd79db" status: 200 len: 1229 microversion: 2.1 time: 0.170571 Sep 08 11:27:52.035098 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3227/6587] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:27:51 2022] GET /compute/v2.1/servers/cd4021f3-ff9e-47c7-9a1c-0578b5fd79db => generated 1229 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:27:53.057058 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9630a43c-166d-44f1-86d3-80058ced7a02 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:27:53.057788 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9630a43c-166d-44f1-86d3-80058ced7a02 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: cd4021f3-ff9e-47c7-9a1c-0578b5fd79db] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:27:53.065426 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9630a43c-166d-44f1-86d3-80058ced7a02 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:53.066213 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9630a43c-166d-44f1-86d3-80058ced7a02 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:53.066763 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9630a43c-166d-44f1-86d3-80058ced7a02 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:53.067938 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9630a43c-166d-44f1-86d3-80058ced7a02 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:53.068798 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9630a43c-166d-44f1-86d3-80058ced7a02 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:53.069454 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9630a43c-166d-44f1-86d3-80058ced7a02 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:53.208853 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9630a43c-166d-44f1-86d3-80058ced7a02 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:27:53.218034 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9630a43c-166d-44f1-86d3-80058ced7a02 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/cd4021f3-ff9e-47c7-9a1c-0578b5fd79db" status: 200 len: 1229 microversion: 2.1 time: 0.165201 Sep 08 11:27:53.218617 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3361/6588] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:27:53 2022] GET /compute/v2.1/servers/cd4021f3-ff9e-47c7-9a1c-0578b5fd79db => generated 1229 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:27:54.242276 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3ba52b2f-5754-4663-86de-af4b3fcd9f16 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:27:54.242940 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3ba52b2f-5754-4663-86de-af4b3fcd9f16 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: cd4021f3-ff9e-47c7-9a1c-0578b5fd79db] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:27:54.250281 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3ba52b2f-5754-4663-86de-af4b3fcd9f16 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:54.250767 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3ba52b2f-5754-4663-86de-af4b3fcd9f16 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:54.251233 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3ba52b2f-5754-4663-86de-af4b3fcd9f16 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:54.251954 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3ba52b2f-5754-4663-86de-af4b3fcd9f16 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:54.252407 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3ba52b2f-5754-4663-86de-af4b3fcd9f16 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:54.252832 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3ba52b2f-5754-4663-86de-af4b3fcd9f16 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:54.383127 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3ba52b2f-5754-4663-86de-af4b3fcd9f16 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:27:54.391317 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3ba52b2f-5754-4663-86de-af4b3fcd9f16 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/cd4021f3-ff9e-47c7-9a1c-0578b5fd79db" status: 200 len: 1217 microversion: 2.1 time: 0.153060 Sep 08 11:27:54.391903 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3228/6589] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:27:54 2022] GET /compute/v2.1/servers/cd4021f3-ff9e-47c7-9a1c-0578b5fd79db => generated 1217 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:27:55.415062 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9ce0ba3a-6f1e-475e-8c7d-d7a9d77effa6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:27:55.415690 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9ce0ba3a-6f1e-475e-8c7d-d7a9d77effa6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: cd4021f3-ff9e-47c7-9a1c-0578b5fd79db] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:27:55.418881 n-d-850501-12 devstack@n-api.service[128861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 11:27:55.419047 n-d-850501-12 devstack@n-api.service[128861]: Thu Sep 8 11:27:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cd4021f3-ff9e-47c7-9a1c-0578b5fd79db (ip 10.222.0.27) !!! Sep 08 11:27:55.425367 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ce0ba3a-6f1e-475e-8c7d-d7a9d77effa6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:55.425871 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ce0ba3a-6f1e-475e-8c7d-d7a9d77effa6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:55.426315 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ce0ba3a-6f1e-475e-8c7d-d7a9d77effa6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:55.427116 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ce0ba3a-6f1e-475e-8c7d-d7a9d77effa6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:55.427580 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ce0ba3a-6f1e-475e-8c7d-d7a9d77effa6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:55.428014 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ce0ba3a-6f1e-475e-8c7d-d7a9d77effa6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:55.560953 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9ce0ba3a-6f1e-475e-8c7d-d7a9d77effa6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:27:55.568879 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9ce0ba3a-6f1e-475e-8c7d-d7a9d77effa6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/cd4021f3-ff9e-47c7-9a1c-0578b5fd79db" status: 200 len: 1217 microversion: 2.1 time: 0.157779 Sep 08 11:27:55.569500 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3362/6590] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:27:55 2022] GET /compute/v2.1/servers/cd4021f3-ff9e-47c7-9a1c-0578b5fd79db => generated 1217 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:27:56.592632 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3d981122-6fb4-4347-83f9-7f6c3889c1a0 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:27:56.593271 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3d981122-6fb4-4347-83f9-7f6c3889c1a0 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: cd4021f3-ff9e-47c7-9a1c-0578b5fd79db] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:27:56.600080 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d981122-6fb4-4347-83f9-7f6c3889c1a0 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:56.600565 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d981122-6fb4-4347-83f9-7f6c3889c1a0 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:56.600996 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d981122-6fb4-4347-83f9-7f6c3889c1a0 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:56.601710 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d981122-6fb4-4347-83f9-7f6c3889c1a0 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:56.602165 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d981122-6fb4-4347-83f9-7f6c3889c1a0 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:56.602594 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d981122-6fb4-4347-83f9-7f6c3889c1a0 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:56.739039 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3d981122-6fb4-4347-83f9-7f6c3889c1a0 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:27:56.747361 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3d981122-6fb4-4347-83f9-7f6c3889c1a0 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/cd4021f3-ff9e-47c7-9a1c-0578b5fd79db" status: 200 len: 1217 microversion: 2.1 time: 0.159731 Sep 08 11:27:56.747935 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3229/6591] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:27:56 2022] GET /compute/v2.1/servers/cd4021f3-ff9e-47c7-9a1c-0578b5fd79db => generated 1217 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:27:57.771881 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-81bc9132-3aad-4b1f-8aa5-4cd91ad81676 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:27:57.772537 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-81bc9132-3aad-4b1f-8aa5-4cd91ad81676 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: cd4021f3-ff9e-47c7-9a1c-0578b5fd79db] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:27:57.775363 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:27:57.781424 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-81bc9132-3aad-4b1f-8aa5-4cd91ad81676 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:57.781918 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-81bc9132-3aad-4b1f-8aa5-4cd91ad81676 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:57.782356 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-81bc9132-3aad-4b1f-8aa5-4cd91ad81676 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:57.783060 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-81bc9132-3aad-4b1f-8aa5-4cd91ad81676 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:57.783514 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-81bc9132-3aad-4b1f-8aa5-4cd91ad81676 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:57.783942 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-81bc9132-3aad-4b1f-8aa5-4cd91ad81676 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:57.917690 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-81bc9132-3aad-4b1f-8aa5-4cd91ad81676 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:27:57.925525 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-81bc9132-3aad-4b1f-8aa5-4cd91ad81676 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/cd4021f3-ff9e-47c7-9a1c-0578b5fd79db" status: 200 len: 1217 microversion: 2.1 time: 0.157629 Sep 08 11:27:57.926112 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3363/6592] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:27:57 2022] GET /compute/v2.1/servers/cd4021f3-ff9e-47c7-9a1c-0578b5fd79db => generated 1217 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:27:58.948215 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-29852a01-161b-4fee-b49e-6a76b75fe0b5 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:27:58.949009 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-29852a01-161b-4fee-b49e-6a76b75fe0b5 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: cd4021f3-ff9e-47c7-9a1c-0578b5fd79db] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:27:58.951028 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:27:58.951807 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:27:58.962708 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-29852a01-161b-4fee-b49e-6a76b75fe0b5 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:58.963747 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-29852a01-161b-4fee-b49e-6a76b75fe0b5 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:58.964462 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-29852a01-161b-4fee-b49e-6a76b75fe0b5 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:58.965325 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-29852a01-161b-4fee-b49e-6a76b75fe0b5 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:58.965792 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-29852a01-161b-4fee-b49e-6a76b75fe0b5 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:58.966226 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-29852a01-161b-4fee-b49e-6a76b75fe0b5 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:59.256080 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-29852a01-161b-4fee-b49e-6a76b75fe0b5 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:27:59.264935 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-29852a01-161b-4fee-b49e-6a76b75fe0b5 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/cd4021f3-ff9e-47c7-9a1c-0578b5fd79db" status: 200 len: 1217 microversion: 2.1 time: 0.320731 Sep 08 11:27:59.265700 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3230/6593] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:27:58 2022] GET /compute/v2.1/servers/cd4021f3-ff9e-47c7-9a1c-0578b5fd79db => generated 1217 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:28:00.288250 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-11a86d45-b8c3-46f2-861f-971dde011139 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:28:00.288871 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-11a86d45-b8c3-46f2-861f-971dde011139 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: cd4021f3-ff9e-47c7-9a1c-0578b5fd79db] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:28:00.296865 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-11a86d45-b8c3-46f2-861f-971dde011139 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:00.297466 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-11a86d45-b8c3-46f2-861f-971dde011139 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:00.297906 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-11a86d45-b8c3-46f2-861f-971dde011139 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:00.298605 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-11a86d45-b8c3-46f2-861f-971dde011139 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:00.299097 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-11a86d45-b8c3-46f2-861f-971dde011139 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:00.299524 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-11a86d45-b8c3-46f2-861f-971dde011139 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:00.488740 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-11a86d45-b8c3-46f2-861f-971dde011139 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:28:00.496488 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-11a86d45-b8c3-46f2-861f-971dde011139 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/cd4021f3-ff9e-47c7-9a1c-0578b5fd79db" status: 200 len: 1217 microversion: 2.1 time: 0.212180 Sep 08 11:28:00.497086 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3364/6594] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:28:00 2022] GET /compute/v2.1/servers/cd4021f3-ff9e-47c7-9a1c-0578b5fd79db => generated 1217 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:28:01.520282 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7a244920-6962-45ff-9e70-04615a11c282 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:28:01.520803 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7a244920-6962-45ff-9e70-04615a11c282 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: cd4021f3-ff9e-47c7-9a1c-0578b5fd79db] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:28:01.527541 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7a244920-6962-45ff-9e70-04615a11c282 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:01.528059 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7a244920-6962-45ff-9e70-04615a11c282 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:01.528494 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7a244920-6962-45ff-9e70-04615a11c282 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:01.529236 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7a244920-6962-45ff-9e70-04615a11c282 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:01.529695 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7a244920-6962-45ff-9e70-04615a11c282 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:01.530144 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7a244920-6962-45ff-9e70-04615a11c282 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:01.677412 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7a244920-6962-45ff-9e70-04615a11c282 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:28:01.691300 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7a244920-6962-45ff-9e70-04615a11c282 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/cd4021f3-ff9e-47c7-9a1c-0578b5fd79db" status: 200 len: 1217 microversion: 2.1 time: 0.175019 Sep 08 11:28:01.691917 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3231/6595] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:28:01 2022] GET /compute/v2.1/servers/cd4021f3-ff9e-47c7-9a1c-0578b5fd79db => generated 1217 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:28:02.714446 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-368336e5-ca5d-4553-81f9-6babe91c7252 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:28:02.715073 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-368336e5-ca5d-4553-81f9-6babe91c7252 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: cd4021f3-ff9e-47c7-9a1c-0578b5fd79db] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:28:02.722278 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-368336e5-ca5d-4553-81f9-6babe91c7252 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:02.722774 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-368336e5-ca5d-4553-81f9-6babe91c7252 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:02.723216 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-368336e5-ca5d-4553-81f9-6babe91c7252 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:02.723923 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-368336e5-ca5d-4553-81f9-6babe91c7252 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:02.724390 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-368336e5-ca5d-4553-81f9-6babe91c7252 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:02.724822 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-368336e5-ca5d-4553-81f9-6babe91c7252 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:02.858350 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-368336e5-ca5d-4553-81f9-6babe91c7252 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:28:02.866500 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-368336e5-ca5d-4553-81f9-6babe91c7252 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/cd4021f3-ff9e-47c7-9a1c-0578b5fd79db" status: 200 len: 1217 microversion: 2.1 time: 0.156033 Sep 08 11:28:02.867084 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3365/6596] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:28:02 2022] GET /compute/v2.1/servers/cd4021f3-ff9e-47c7-9a1c-0578b5fd79db => generated 1217 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:28:03.408836 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-61132c41-f0ef-4fa5-b861-4fc71a40e3fd req-53cae511-7df7-464a-9b35-74fd8cbdf21c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd4021f3-ff9e-47c7-9a1c-0578b5fd79db", "name": "network-vif-plugged", "status": "completed", "tag": "ea1b6336-b8ba-4704-b239-32e300dedf92"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:28:03.420240 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-61132c41-f0ef-4fa5-b861-4fc71a40e3fd req-53cae511-7df7-464a-9b35-74fd8cbdf21c service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:03.420725 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-61132c41-f0ef-4fa5-b861-4fc71a40e3fd req-53cae511-7df7-464a-9b35-74fd8cbdf21c service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:03.421191 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-61132c41-f0ef-4fa5-b861-4fc71a40e3fd req-53cae511-7df7-464a-9b35-74fd8cbdf21c service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:03.433456 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-61132c41-f0ef-4fa5-b861-4fc71a40e3fd req-53cae511-7df7-464a-9b35-74fd8cbdf21c service nova] Creating event network-vif-plugged:ea1b6336-b8ba-4704-b239-32e300dedf92 for instance cd4021f3-ff9e-47c7-9a1c-0578b5fd79db on n-h1-850501-12 Sep 08 11:28:03.438682 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-61132c41-f0ef-4fa5-b861-4fc71a40e3fd req-53cae511-7df7-464a-9b35-74fd8cbdf21c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033849 Sep 08 11:28:03.439264 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3232/6597] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:28:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:28:03.890945 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e71060a5-23f9-4f03-830f-008353b91c13 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:28:03.891582 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e71060a5-23f9-4f03-830f-008353b91c13 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: cd4021f3-ff9e-47c7-9a1c-0578b5fd79db] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:28:03.898726 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e71060a5-23f9-4f03-830f-008353b91c13 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:03.899229 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e71060a5-23f9-4f03-830f-008353b91c13 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:03.899677 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e71060a5-23f9-4f03-830f-008353b91c13 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:03.900401 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e71060a5-23f9-4f03-830f-008353b91c13 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:03.901723 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e71060a5-23f9-4f03-830f-008353b91c13 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:03.902413 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e71060a5-23f9-4f03-830f-008353b91c13 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:04.041668 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e71060a5-23f9-4f03-830f-008353b91c13 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:28:04.049691 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e71060a5-23f9-4f03-830f-008353b91c13 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/cd4021f3-ff9e-47c7-9a1c-0578b5fd79db" status: 200 len: 1217 microversion: 2.1 time: 0.162980 Sep 08 11:28:04.050279 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3366/6598] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:28:03 2022] GET /compute/v2.1/servers/cd4021f3-ff9e-47c7-9a1c-0578b5fd79db => generated 1217 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:28:05.074395 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fda504d4-2cd7-4062-b35f-4dd87afa0d16 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:28:05.075093 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fda504d4-2cd7-4062-b35f-4dd87afa0d16 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: cd4021f3-ff9e-47c7-9a1c-0578b5fd79db] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:28:05.081442 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fda504d4-2cd7-4062-b35f-4dd87afa0d16 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:05.081932 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fda504d4-2cd7-4062-b35f-4dd87afa0d16 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:05.082369 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fda504d4-2cd7-4062-b35f-4dd87afa0d16 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:05.083070 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fda504d4-2cd7-4062-b35f-4dd87afa0d16 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:05.083529 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fda504d4-2cd7-4062-b35f-4dd87afa0d16 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:05.083992 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fda504d4-2cd7-4062-b35f-4dd87afa0d16 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:05.217860 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fda504d4-2cd7-4062-b35f-4dd87afa0d16 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:28:05.225702 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fda504d4-2cd7-4062-b35f-4dd87afa0d16 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/cd4021f3-ff9e-47c7-9a1c-0578b5fd79db" status: 200 len: 1403 microversion: 2.1 time: 0.156774 Sep 08 11:28:05.226277 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3233/6599] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:28:05 2022] GET /compute/v2.1/servers/cd4021f3-ff9e-47c7-9a1c-0578b5fd79db => generated 1403 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:28:05.248476 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ccdf8dba-fba7-42d6-920a-f9e78baddb1a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:28:05.249201 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ccdf8dba-fba7-42d6-920a-f9e78baddb1a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: cd4021f3-ff9e-47c7-9a1c-0578b5fd79db] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:28:05.256545 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ccdf8dba-fba7-42d6-920a-f9e78baddb1a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:05.257067 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ccdf8dba-fba7-42d6-920a-f9e78baddb1a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:05.257512 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ccdf8dba-fba7-42d6-920a-f9e78baddb1a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:05.258427 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ccdf8dba-fba7-42d6-920a-f9e78baddb1a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:05.258920 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ccdf8dba-fba7-42d6-920a-f9e78baddb1a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:05.259357 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ccdf8dba-fba7-42d6-920a-f9e78baddb1a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:05.394855 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ccdf8dba-fba7-42d6-920a-f9e78baddb1a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:28:05.403250 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ccdf8dba-fba7-42d6-920a-f9e78baddb1a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/cd4021f3-ff9e-47c7-9a1c-0578b5fd79db" status: 200 len: 1403 microversion: 2.1 time: 0.158945 Sep 08 11:28:05.403827 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3367/6600] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:28:05 2022] GET /compute/v2.1/servers/cd4021f3-ff9e-47c7-9a1c-0578b5fd79db => generated 1403 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:28:05.425906 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-239337a5-a428-410b-b2b9-e212295aba46 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1344275476"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:28:05.428205 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-239337a5-a428-410b-b2b9-e212295aba46 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: cd4021f3-ff9e-47c7-9a1c-0578b5fd79db] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:28:05.434282 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-239337a5-a428-410b-b2b9-e212295aba46 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:05.434767 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-239337a5-a428-410b-b2b9-e212295aba46 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:05.435201 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-239337a5-a428-410b-b2b9-e212295aba46 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:05.435889 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-239337a5-a428-410b-b2b9-e212295aba46 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:05.436339 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-239337a5-a428-410b-b2b9-e212295aba46 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:05.436760 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-239337a5-a428-410b-b2b9-e212295aba46 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:05.528631 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.compute.api [None req-239337a5-a428-410b-b2b9-e212295aba46 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: cd4021f3-ff9e-47c7-9a1c-0578b5fd79db] Attempting to quiesce instance before volume snapshot. Sep 08 11:28:05.596906 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.compute.api [None req-239337a5-a428-410b-b2b9-e212295aba46 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: cd4021f3-ff9e-47c7-9a1c-0578b5fd79db] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Sep 08 11:28:05.668022 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-239337a5-a428-410b-b2b9-e212295aba46 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: cd4021f3-ff9e-47c7-9a1c-0578b5fd79db] Creating snapshot from volume bdc479c0-f09f-4983-a88d-6e0d8ff41440. {{(pid=128862) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Sep 08 11:28:06.554681 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-239337a5-a428-410b-b2b9-e212295aba46 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "POST /compute/v2.1/servers/cd4021f3-ff9e-47c7-9a1c-0578b5fd79db/action" status: 202 len: 0 microversion: 2.1 time: 1.132696 Sep 08 11:28:06.560738 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3234/6601] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 11:28:05 2022] POST /compute/v2.1/servers/cd4021f3-ff9e-47c7-9a1c-0578b5fd79db/action => generated 0 bytes in 1134 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Sep 08 11:28:07.712927 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b3afdce6-8c48-4ab6-a411-3acf3879adff tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1125934", "imageRef": "f6f72b10-02b7-4d4d-af7c-ab7fea7bc0bc", "flavorRef": "452", "networks": [{"uuid": "6c224653-dc3b-48b8-9084-30761e623f71"}]}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:28:07.773451 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-b3afdce6-8c48-4ab6-a411-3acf3879adff tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] validate_networks() for [('6c224653-dc3b-48b8-9084-30761e623f71', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:28:08.149126 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-b3afdce6-8c48-4ab6-a411-3acf3879adff tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:28:08.149589 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-b3afdce6-8c48-4ab6-a411-3acf3879adff tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:28:08.150076 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-b3afdce6-8c48-4ab6-a411-3acf3879adff tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:28:08.150502 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-b3afdce6-8c48-4ab6-a411-3acf3879adff tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:28:08.151850 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-b3afdce6-8c48-4ab6-a411-3acf3879adff tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:28:08.161151 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b3afdce6-8c48-4ab6-a411-3acf3879adff tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:08.161679 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b3afdce6-8c48-4ab6-a411-3acf3879adff tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:08.162122 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b3afdce6-8c48-4ab6-a411-3acf3879adff tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:08.162863 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b3afdce6-8c48-4ab6-a411-3acf3879adff tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:08.163329 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b3afdce6-8c48-4ab6-a411-3acf3879adff tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:08.163767 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b3afdce6-8c48-4ab6-a411-3acf3879adff tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:08.181804 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-b3afdce6-8c48-4ab6-a411-3acf3879adff tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Getting quotas for project 747bb5860ba14a20bba3b1c2197ea75d. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:28:08.187729 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-b3afdce6-8c48-4ab6-a411-3acf3879adff tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Getting quotas for user bc18639e461e4ef5bfcf4380c561f329 and project 747bb5860ba14a20bba3b1c2197ea75d. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:28:08.200017 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b3afdce6-8c48-4ab6-a411-3acf3879adff tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:28:08.202646 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b3afdce6-8c48-4ab6-a411-3acf3879adff tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 8b29da4a-f26f-46fc-b141-2887c22c372a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='7441992a-bb06-446e-b2ed-e63d489f0efe',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:28:08.284383 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b3afdce6-8c48-4ab6-a411-3acf3879adff tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.575270 Sep 08 11:28:08.285134 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3368/6602] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 11:28:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 577 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:28:08.298897 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ba9891ad-1ab8-4d42-a4ef-442472825431 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:28:08.299711 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ba9891ad-1ab8-4d42-a4ef-442472825431 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 8b29da4a-f26f-46fc-b141-2887c22c372a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:28:08.359288 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ba9891ad-1ab8-4d42-a4ef-442472825431 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:28:08.366113 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ba9891ad-1ab8-4d42-a4ef-442472825431 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/8b29da4a-f26f-46fc-b141-2887c22c372a" status: 200 len: 1227 microversion: 2.1 time: 0.072773 Sep 08 11:28:08.366691 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3235/6603] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:28:08 2022] GET /compute/v2.1/servers/8b29da4a-f26f-46fc-b141-2887c22c372a => generated 1227 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:28:09.389719 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-58022533-b374-473c-a2ae-1575d7066911 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:28:09.390345 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-58022533-b374-473c-a2ae-1575d7066911 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 8b29da4a-f26f-46fc-b141-2887c22c372a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:28:09.398153 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-58022533-b374-473c-a2ae-1575d7066911 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:09.398656 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-58022533-b374-473c-a2ae-1575d7066911 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:09.399098 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-58022533-b374-473c-a2ae-1575d7066911 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:09.399801 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-58022533-b374-473c-a2ae-1575d7066911 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:09.400438 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-58022533-b374-473c-a2ae-1575d7066911 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:09.401375 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-58022533-b374-473c-a2ae-1575d7066911 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:09.484284 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-58022533-b374-473c-a2ae-1575d7066911 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:28:09.492579 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-58022533-b374-473c-a2ae-1575d7066911 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/8b29da4a-f26f-46fc-b141-2887c22c372a" status: 200 len: 1287 microversion: 2.1 time: 0.108058 Sep 08 11:28:09.493450 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3369/6604] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:28:09 2022] GET /compute/v2.1/servers/8b29da4a-f26f-46fc-b141-2887c22c372a => generated 1287 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:28:10.516836 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8817cdcf-669f-438f-a350-ac5d3a9f53ba tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:28:10.517708 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8817cdcf-669f-438f-a350-ac5d3a9f53ba tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 8b29da4a-f26f-46fc-b141-2887c22c372a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:28:10.525375 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8817cdcf-669f-438f-a350-ac5d3a9f53ba tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:10.526611 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8817cdcf-669f-438f-a350-ac5d3a9f53ba tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:10.527360 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8817cdcf-669f-438f-a350-ac5d3a9f53ba tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:10.528268 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8817cdcf-669f-438f-a350-ac5d3a9f53ba tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:10.528926 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8817cdcf-669f-438f-a350-ac5d3a9f53ba tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:10.529390 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8817cdcf-669f-438f-a350-ac5d3a9f53ba tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:10.684860 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8817cdcf-669f-438f-a350-ac5d3a9f53ba tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:28:10.698936 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8817cdcf-669f-438f-a350-ac5d3a9f53ba tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/8b29da4a-f26f-46fc-b141-2887c22c372a" status: 200 len: 1339 microversion: 2.1 time: 0.185413 Sep 08 11:28:10.699673 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3236/6605] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:28:10 2022] GET /compute/v2.1/servers/8b29da4a-f26f-46fc-b141-2887c22c372a => generated 1339 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:28:11.006504 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-4943be8d-c394-44d8-b6fc-59ae4b1e06cc req-a9354d08-6378-427e-8329-4254fe2c0111 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b29da4a-f26f-46fc-b141-2887c22c372a", "tag": "21320923-dc66-4e8e-be22-95835bbbc60e"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:28:11.016990 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-4943be8d-c394-44d8-b6fc-59ae4b1e06cc req-a9354d08-6378-427e-8329-4254fe2c0111 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:11.017756 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-4943be8d-c394-44d8-b6fc-59ae4b1e06cc req-a9354d08-6378-427e-8329-4254fe2c0111 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:11.018126 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-4943be8d-c394-44d8-b6fc-59ae4b1e06cc req-a9354d08-6378-427e-8329-4254fe2c0111 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:11.030755 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-4943be8d-c394-44d8-b6fc-59ae4b1e06cc req-a9354d08-6378-427e-8329-4254fe2c0111 service nova] Creating event network-changed:21320923-dc66-4e8e-be22-95835bbbc60e for instance 8b29da4a-f26f-46fc-b141-2887c22c372a on n-h2-850501-12 Sep 08 11:28:11.036091 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-4943be8d-c394-44d8-b6fc-59ae4b1e06cc req-a9354d08-6378-427e-8329-4254fe2c0111 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151665 Sep 08 11:28:11.037463 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3370/6606] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:28:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:28:11.722018 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c3b0ac54-cc45-4de1-bb69-b88d7ddb27a2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:28:11.722813 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c3b0ac54-cc45-4de1-bb69-b88d7ddb27a2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 8b29da4a-f26f-46fc-b141-2887c22c372a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:28:11.730061 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c3b0ac54-cc45-4de1-bb69-b88d7ddb27a2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:11.730760 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c3b0ac54-cc45-4de1-bb69-b88d7ddb27a2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:11.731310 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c3b0ac54-cc45-4de1-bb69-b88d7ddb27a2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:11.732137 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c3b0ac54-cc45-4de1-bb69-b88d7ddb27a2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:11.732729 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c3b0ac54-cc45-4de1-bb69-b88d7ddb27a2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:11.733310 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c3b0ac54-cc45-4de1-bb69-b88d7ddb27a2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:11.871347 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c3b0ac54-cc45-4de1-bb69-b88d7ddb27a2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:28:11.879671 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c3b0ac54-cc45-4de1-bb69-b88d7ddb27a2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/8b29da4a-f26f-46fc-b141-2887c22c372a" status: 200 len: 1339 microversion: 2.1 time: 0.161909 Sep 08 11:28:11.880539 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3237/6607] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:28:11 2022] GET /compute/v2.1/servers/8b29da4a-f26f-46fc-b141-2887c22c372a => generated 1339 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:28:12.906010 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-13e02677-9d55-4bf1-83c3-b0b4c55832d8 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:28:12.906716 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-13e02677-9d55-4bf1-83c3-b0b4c55832d8 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 8b29da4a-f26f-46fc-b141-2887c22c372a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:28:12.912985 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-13e02677-9d55-4bf1-83c3-b0b4c55832d8 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:12.913516 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-13e02677-9d55-4bf1-83c3-b0b4c55832d8 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:12.913955 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-13e02677-9d55-4bf1-83c3-b0b4c55832d8 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:12.914661 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-13e02677-9d55-4bf1-83c3-b0b4c55832d8 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:12.915149 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-13e02677-9d55-4bf1-83c3-b0b4c55832d8 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:12.915576 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-13e02677-9d55-4bf1-83c3-b0b4c55832d8 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:13.071326 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-13e02677-9d55-4bf1-83c3-b0b4c55832d8 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:28:13.091395 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-13e02677-9d55-4bf1-83c3-b0b4c55832d8 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/8b29da4a-f26f-46fc-b141-2887c22c372a" status: 200 len: 1339 microversion: 2.1 time: 0.190747 Sep 08 11:28:13.092772 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3371/6608] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:28:12 2022] GET /compute/v2.1/servers/8b29da4a-f26f-46fc-b141-2887c22c372a => generated 1339 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:28:14.117689 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4348dea4-7fb1-4038-bd6f-3edd84652bb6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:28:14.118387 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4348dea4-7fb1-4038-bd6f-3edd84652bb6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 8b29da4a-f26f-46fc-b141-2887c22c372a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:28:14.126530 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4348dea4-7fb1-4038-bd6f-3edd84652bb6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:14.127045 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4348dea4-7fb1-4038-bd6f-3edd84652bb6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:14.127500 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4348dea4-7fb1-4038-bd6f-3edd84652bb6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:14.128223 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4348dea4-7fb1-4038-bd6f-3edd84652bb6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:14.128810 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4348dea4-7fb1-4038-bd6f-3edd84652bb6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:14.129292 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4348dea4-7fb1-4038-bd6f-3edd84652bb6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:14.340861 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4348dea4-7fb1-4038-bd6f-3edd84652bb6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:28:14.353522 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4348dea4-7fb1-4038-bd6f-3edd84652bb6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/8b29da4a-f26f-46fc-b141-2887c22c372a" status: 200 len: 1339 microversion: 2.1 time: 0.241230 Sep 08 11:28:14.355916 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3238/6609] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:28:14 2022] GET /compute/v2.1/servers/8b29da4a-f26f-46fc-b141-2887c22c372a => generated 1339 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:28:15.383354 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e1c9dcfa-6c3a-4dc8-b7ad-51810027485f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:28:15.384176 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e1c9dcfa-6c3a-4dc8-b7ad-51810027485f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 8b29da4a-f26f-46fc-b141-2887c22c372a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:28:15.392357 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e1c9dcfa-6c3a-4dc8-b7ad-51810027485f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:15.392855 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e1c9dcfa-6c3a-4dc8-b7ad-51810027485f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:15.393336 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e1c9dcfa-6c3a-4dc8-b7ad-51810027485f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:15.394040 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e1c9dcfa-6c3a-4dc8-b7ad-51810027485f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:15.394509 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e1c9dcfa-6c3a-4dc8-b7ad-51810027485f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:15.394942 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e1c9dcfa-6c3a-4dc8-b7ad-51810027485f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:15.556299 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e1c9dcfa-6c3a-4dc8-b7ad-51810027485f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:28:15.568076 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e1c9dcfa-6c3a-4dc8-b7ad-51810027485f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/8b29da4a-f26f-46fc-b141-2887c22c372a" status: 200 len: 1339 microversion: 2.1 time: 0.190977 Sep 08 11:28:15.575167 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3372/6610] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:28:15 2022] GET /compute/v2.1/servers/8b29da4a-f26f-46fc-b141-2887c22c372a => generated 1339 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:28:16.591904 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7afafc2a-961a-455c-a279-8801f5700d96 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:28:16.592605 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7afafc2a-961a-455c-a279-8801f5700d96 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 8b29da4a-f26f-46fc-b141-2887c22c372a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:28:16.596366 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:28:16.603980 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7afafc2a-961a-455c-a279-8801f5700d96 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:16.604568 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7afafc2a-961a-455c-a279-8801f5700d96 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:16.605218 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7afafc2a-961a-455c-a279-8801f5700d96 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:16.606055 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7afafc2a-961a-455c-a279-8801f5700d96 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:16.606681 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7afafc2a-961a-455c-a279-8801f5700d96 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:16.606960 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7afafc2a-961a-455c-a279-8801f5700d96 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:16.625354 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=81,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:28:16.763851 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7afafc2a-961a-455c-a279-8801f5700d96 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:28:16.772267 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7afafc2a-961a-455c-a279-8801f5700d96 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/8b29da4a-f26f-46fc-b141-2887c22c372a" status: 200 len: 1339 microversion: 2.1 time: 0.184686 Sep 08 11:28:16.772902 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3239/6611] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:28:16 2022] GET /compute/v2.1/servers/8b29da4a-f26f-46fc-b141-2887c22c372a => generated 1339 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:28:17.797914 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8725e88c-4bf6-4350-b828-8fb5a02e0278 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:28:17.798565 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8725e88c-4bf6-4350-b828-8fb5a02e0278 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 8b29da4a-f26f-46fc-b141-2887c22c372a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:28:17.802579 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:28:17.806544 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8725e88c-4bf6-4350-b828-8fb5a02e0278 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:17.807049 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8725e88c-4bf6-4350-b828-8fb5a02e0278 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:17.807770 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8725e88c-4bf6-4350-b828-8fb5a02e0278 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:17.808610 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8725e88c-4bf6-4350-b828-8fb5a02e0278 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:17.809085 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8725e88c-4bf6-4350-b828-8fb5a02e0278 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:17.809522 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8725e88c-4bf6-4350-b828-8fb5a02e0278 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:17.814554 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=77 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:28:17.956046 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8725e88c-4bf6-4350-b828-8fb5a02e0278 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:28:17.965016 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8725e88c-4bf6-4350-b828-8fb5a02e0278 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/8b29da4a-f26f-46fc-b141-2887c22c372a" status: 200 len: 1339 microversion: 2.1 time: 0.170776 Sep 08 11:28:17.965677 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3373/6612] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:28:17 2022] GET /compute/v2.1/servers/8b29da4a-f26f-46fc-b141-2887c22c372a => generated 1339 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:28:18.989466 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-119fabe3-7255-4708-acb4-2c9b91ba7b9f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:28:18.990327 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-119fabe3-7255-4708-acb4-2c9b91ba7b9f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 8b29da4a-f26f-46fc-b141-2887c22c372a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:28:18.992794 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:28:18.998890 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-119fabe3-7255-4708-acb4-2c9b91ba7b9f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:18.999433 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-119fabe3-7255-4708-acb4-2c9b91ba7b9f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:18.999963 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-119fabe3-7255-4708-acb4-2c9b91ba7b9f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:19.000689 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-119fabe3-7255-4708-acb4-2c9b91ba7b9f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:19.001195 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-119fabe3-7255-4708-acb4-2c9b91ba7b9f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:19.001694 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-119fabe3-7255-4708-acb4-2c9b91ba7b9f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:19.146431 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-119fabe3-7255-4708-acb4-2c9b91ba7b9f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:28:19.154639 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-119fabe3-7255-4708-acb4-2c9b91ba7b9f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/8b29da4a-f26f-46fc-b141-2887c22c372a" status: 200 len: 1339 microversion: 2.1 time: 0.169179 Sep 08 11:28:19.155206 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3240/6613] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:28:18 2022] GET /compute/v2.1/servers/8b29da4a-f26f-46fc-b141-2887c22c372a => generated 1339 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:28:20.178141 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6ad199f2-3da9-4208-9096-6ec09f7050d2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:28:20.178875 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6ad199f2-3da9-4208-9096-6ec09f7050d2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 8b29da4a-f26f-46fc-b141-2887c22c372a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:28:20.180837 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:28:20.181737 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=6 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:28:20.189605 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6ad199f2-3da9-4208-9096-6ec09f7050d2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:20.190112 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6ad199f2-3da9-4208-9096-6ec09f7050d2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:20.190591 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6ad199f2-3da9-4208-9096-6ec09f7050d2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:20.191308 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6ad199f2-3da9-4208-9096-6ec09f7050d2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:20.191807 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6ad199f2-3da9-4208-9096-6ec09f7050d2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:20.192245 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6ad199f2-3da9-4208-9096-6ec09f7050d2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:20.335046 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6ad199f2-3da9-4208-9096-6ec09f7050d2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:28:20.343055 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6ad199f2-3da9-4208-9096-6ec09f7050d2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/8b29da4a-f26f-46fc-b141-2887c22c372a" status: 200 len: 1339 microversion: 2.1 time: 0.168831 Sep 08 11:28:20.344126 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3374/6614] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:28:20 2022] GET /compute/v2.1/servers/8b29da4a-f26f-46fc-b141-2887c22c372a => generated 1339 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:28:21.366640 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-496af90e-b9cc-4e14-ada6-c1f7a3e39ad8 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:28:21.367274 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-496af90e-b9cc-4e14-ada6-c1f7a3e39ad8 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 8b29da4a-f26f-46fc-b141-2887c22c372a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:28:21.374908 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-496af90e-b9cc-4e14-ada6-c1f7a3e39ad8 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:21.375414 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-496af90e-b9cc-4e14-ada6-c1f7a3e39ad8 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:21.375861 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-496af90e-b9cc-4e14-ada6-c1f7a3e39ad8 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:21.376580 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-496af90e-b9cc-4e14-ada6-c1f7a3e39ad8 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:21.377065 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-496af90e-b9cc-4e14-ada6-c1f7a3e39ad8 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:21.377508 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-496af90e-b9cc-4e14-ada6-c1f7a3e39ad8 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:21.518149 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-496af90e-b9cc-4e14-ada6-c1f7a3e39ad8 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:28:21.527068 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-496af90e-b9cc-4e14-ada6-c1f7a3e39ad8 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/8b29da4a-f26f-46fc-b141-2887c22c372a" status: 200 len: 1339 microversion: 2.1 time: 0.163658 Sep 08 11:28:21.541050 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3241/6615] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:28:21 2022] GET /compute/v2.1/servers/8b29da4a-f26f-46fc-b141-2887c22c372a => generated 1339 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:28:22.550239 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c9f03767-c0aa-41a8-9bc4-710659249fc1 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:28:22.550904 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c9f03767-c0aa-41a8-9bc4-710659249fc1 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 8b29da4a-f26f-46fc-b141-2887c22c372a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:28:22.559472 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c9f03767-c0aa-41a8-9bc4-710659249fc1 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:22.559969 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c9f03767-c0aa-41a8-9bc4-710659249fc1 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:22.560413 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c9f03767-c0aa-41a8-9bc4-710659249fc1 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:22.561154 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c9f03767-c0aa-41a8-9bc4-710659249fc1 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:22.561621 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c9f03767-c0aa-41a8-9bc4-710659249fc1 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:22.562055 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c9f03767-c0aa-41a8-9bc4-710659249fc1 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:22.700159 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c9f03767-c0aa-41a8-9bc4-710659249fc1 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:28:22.709062 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c9f03767-c0aa-41a8-9bc4-710659249fc1 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/8b29da4a-f26f-46fc-b141-2887c22c372a" status: 200 len: 1339 microversion: 2.1 time: 0.163010 Sep 08 11:28:22.709751 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3375/6616] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:28:22 2022] GET /compute/v2.1/servers/8b29da4a-f26f-46fc-b141-2887c22c372a => generated 1339 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:28:23.733470 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8428f4b3-966d-4fa2-9bad-ed12f9e1fdf2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:28:23.734138 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8428f4b3-966d-4fa2-9bad-ed12f9e1fdf2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 8b29da4a-f26f-46fc-b141-2887c22c372a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:28:23.741697 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8428f4b3-966d-4fa2-9bad-ed12f9e1fdf2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:23.742211 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8428f4b3-966d-4fa2-9bad-ed12f9e1fdf2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:23.742763 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8428f4b3-966d-4fa2-9bad-ed12f9e1fdf2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:23.743561 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8428f4b3-966d-4fa2-9bad-ed12f9e1fdf2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:23.744040 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8428f4b3-966d-4fa2-9bad-ed12f9e1fdf2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:23.744587 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8428f4b3-966d-4fa2-9bad-ed12f9e1fdf2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:23.908443 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8428f4b3-966d-4fa2-9bad-ed12f9e1fdf2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:28:23.922900 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8428f4b3-966d-4fa2-9bad-ed12f9e1fdf2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/8b29da4a-f26f-46fc-b141-2887c22c372a" status: 200 len: 1339 microversion: 2.1 time: 0.193913 Sep 08 11:28:23.923713 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3242/6617] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:28:23 2022] GET /compute/v2.1/servers/8b29da4a-f26f-46fc-b141-2887c22c372a => generated 1339 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:28:24.946826 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f559706d-77c4-4b53-8d09-df1b3f2ddeab tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:28:24.947594 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f559706d-77c4-4b53-8d09-df1b3f2ddeab tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 8b29da4a-f26f-46fc-b141-2887c22c372a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:28:24.956126 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f559706d-77c4-4b53-8d09-df1b3f2ddeab tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:24.956638 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f559706d-77c4-4b53-8d09-df1b3f2ddeab tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:24.957121 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f559706d-77c4-4b53-8d09-df1b3f2ddeab tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:24.957880 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f559706d-77c4-4b53-8d09-df1b3f2ddeab tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:24.958346 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f559706d-77c4-4b53-8d09-df1b3f2ddeab tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:24.958784 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f559706d-77c4-4b53-8d09-df1b3f2ddeab tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:25.105080 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f559706d-77c4-4b53-8d09-df1b3f2ddeab tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:28:25.113293 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f559706d-77c4-4b53-8d09-df1b3f2ddeab tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/8b29da4a-f26f-46fc-b141-2887c22c372a" status: 200 len: 1373 microversion: 2.1 time: 0.170509 Sep 08 11:28:25.113872 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3376/6618] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:28:24 2022] GET /compute/v2.1/servers/8b29da4a-f26f-46fc-b141-2887c22c372a => generated 1373 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:28:26.137229 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e985c872-c8bb-4de3-8ac1-57e00724fed7 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:28:26.137888 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e985c872-c8bb-4de3-8ac1-57e00724fed7 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 8b29da4a-f26f-46fc-b141-2887c22c372a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:28:26.145120 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e985c872-c8bb-4de3-8ac1-57e00724fed7 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:26.145824 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e985c872-c8bb-4de3-8ac1-57e00724fed7 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:26.146373 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e985c872-c8bb-4de3-8ac1-57e00724fed7 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:26.147080 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e985c872-c8bb-4de3-8ac1-57e00724fed7 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:26.147547 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e985c872-c8bb-4de3-8ac1-57e00724fed7 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:26.147986 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e985c872-c8bb-4de3-8ac1-57e00724fed7 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:26.300106 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e985c872-c8bb-4de3-8ac1-57e00724fed7 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:28:26.310362 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e985c872-c8bb-4de3-8ac1-57e00724fed7 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/8b29da4a-f26f-46fc-b141-2887c22c372a" status: 200 len: 1373 microversion: 2.1 time: 0.177777 Sep 08 11:28:26.310960 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3243/6619] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:28:26 2022] GET /compute/v2.1/servers/8b29da4a-f26f-46fc-b141-2887c22c372a => generated 1373 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:28:27.335172 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-897b1510-8026-4188-9c12-76f572864b9c tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:28:27.335882 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-897b1510-8026-4188-9c12-76f572864b9c tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 8b29da4a-f26f-46fc-b141-2887c22c372a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:28:27.344496 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-897b1510-8026-4188-9c12-76f572864b9c tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:27.345002 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-897b1510-8026-4188-9c12-76f572864b9c tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:27.345468 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-897b1510-8026-4188-9c12-76f572864b9c tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:27.346271 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-897b1510-8026-4188-9c12-76f572864b9c tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:27.346754 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-897b1510-8026-4188-9c12-76f572864b9c tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:27.347186 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-897b1510-8026-4188-9c12-76f572864b9c tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:27.495260 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-897b1510-8026-4188-9c12-76f572864b9c tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:28:27.503739 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-897b1510-8026-4188-9c12-76f572864b9c tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/8b29da4a-f26f-46fc-b141-2887c22c372a" status: 200 len: 1373 microversion: 2.1 time: 0.172601 Sep 08 11:28:27.504367 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3377/6620] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:28:27 2022] GET /compute/v2.1/servers/8b29da4a-f26f-46fc-b141-2887c22c372a => generated 1373 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:28:28.527693 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-97be5006-a5db-4568-9b09-b830f6ef2a28 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:28:28.528358 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-97be5006-a5db-4568-9b09-b830f6ef2a28 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 8b29da4a-f26f-46fc-b141-2887c22c372a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:28:28.535421 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-97be5006-a5db-4568-9b09-b830f6ef2a28 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:28.535925 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-97be5006-a5db-4568-9b09-b830f6ef2a28 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:28.536401 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-97be5006-a5db-4568-9b09-b830f6ef2a28 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:28.537142 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-97be5006-a5db-4568-9b09-b830f6ef2a28 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:28.537617 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-97be5006-a5db-4568-9b09-b830f6ef2a28 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:28.538052 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-97be5006-a5db-4568-9b09-b830f6ef2a28 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:28.675237 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-97be5006-a5db-4568-9b09-b830f6ef2a28 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:28:28.684155 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-97be5006-a5db-4568-9b09-b830f6ef2a28 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/8b29da4a-f26f-46fc-b141-2887c22c372a" status: 200 len: 1373 microversion: 2.1 time: 0.159874 Sep 08 11:28:28.684155 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3244/6621] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:28:28 2022] GET /compute/v2.1/servers/8b29da4a-f26f-46fc-b141-2887c22c372a => generated 1373 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:28:29.709827 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-74ef7247-9e5c-4134-901b-e5b41922f47d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:28:29.710719 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-74ef7247-9e5c-4134-901b-e5b41922f47d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 8b29da4a-f26f-46fc-b141-2887c22c372a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:28:29.718573 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-74ef7247-9e5c-4134-901b-e5b41922f47d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:29.719438 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-74ef7247-9e5c-4134-901b-e5b41922f47d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:29.719845 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-74ef7247-9e5c-4134-901b-e5b41922f47d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:29.720580 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-74ef7247-9e5c-4134-901b-e5b41922f47d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:29.721111 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-74ef7247-9e5c-4134-901b-e5b41922f47d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:29.721544 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-74ef7247-9e5c-4134-901b-e5b41922f47d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:29.879932 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-74ef7247-9e5c-4134-901b-e5b41922f47d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:28:29.888855 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-74ef7247-9e5c-4134-901b-e5b41922f47d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/8b29da4a-f26f-46fc-b141-2887c22c372a" status: 200 len: 1373 microversion: 2.1 time: 0.185455 Sep 08 11:28:29.889549 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3378/6622] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:28:29 2022] GET /compute/v2.1/servers/8b29da4a-f26f-46fc-b141-2887c22c372a => generated 1373 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:28:30.913604 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-404d22b6-301a-49d8-b903-6358eef9820b tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:28:30.914233 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-404d22b6-301a-49d8-b903-6358eef9820b tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 8b29da4a-f26f-46fc-b141-2887c22c372a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:28:30.922940 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-404d22b6-301a-49d8-b903-6358eef9820b tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:30.923459 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-404d22b6-301a-49d8-b903-6358eef9820b tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:30.923887 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-404d22b6-301a-49d8-b903-6358eef9820b tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:30.924658 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-404d22b6-301a-49d8-b903-6358eef9820b tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:30.925161 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-404d22b6-301a-49d8-b903-6358eef9820b tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:30.925675 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-404d22b6-301a-49d8-b903-6358eef9820b tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:31.078154 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-404d22b6-301a-49d8-b903-6358eef9820b tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:28:31.086934 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-404d22b6-301a-49d8-b903-6358eef9820b tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/8b29da4a-f26f-46fc-b141-2887c22c372a" status: 200 len: 1373 microversion: 2.1 time: 0.177232 Sep 08 11:28:31.087706 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3245/6623] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:28:30 2022] GET /compute/v2.1/servers/8b29da4a-f26f-46fc-b141-2887c22c372a => generated 1373 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:28:32.115400 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5b43f209-66b1-4ac1-aec2-2fc17c1c0445 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:28:32.115946 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5b43f209-66b1-4ac1-aec2-2fc17c1c0445 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 8b29da4a-f26f-46fc-b141-2887c22c372a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:28:32.123667 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5b43f209-66b1-4ac1-aec2-2fc17c1c0445 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:32.124596 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5b43f209-66b1-4ac1-aec2-2fc17c1c0445 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:32.125436 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5b43f209-66b1-4ac1-aec2-2fc17c1c0445 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:32.126350 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5b43f209-66b1-4ac1-aec2-2fc17c1c0445 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:32.126830 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5b43f209-66b1-4ac1-aec2-2fc17c1c0445 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:32.127273 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5b43f209-66b1-4ac1-aec2-2fc17c1c0445 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:32.266755 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5b43f209-66b1-4ac1-aec2-2fc17c1c0445 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:28:32.275708 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5b43f209-66b1-4ac1-aec2-2fc17c1c0445 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/8b29da4a-f26f-46fc-b141-2887c22c372a" status: 200 len: 1373 microversion: 2.1 time: 0.164464 Sep 08 11:28:32.277068 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3379/6624] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:28:32 2022] GET /compute/v2.1/servers/8b29da4a-f26f-46fc-b141-2887c22c372a => generated 1373 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:28:33.299943 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9c578be5-8a4f-4e33-bc0d-cb2a5fbc9fe5 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:28:33.300574 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9c578be5-8a4f-4e33-bc0d-cb2a5fbc9fe5 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 8b29da4a-f26f-46fc-b141-2887c22c372a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:28:33.307764 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9c578be5-8a4f-4e33-bc0d-cb2a5fbc9fe5 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:33.308280 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9c578be5-8a4f-4e33-bc0d-cb2a5fbc9fe5 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:33.308735 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9c578be5-8a4f-4e33-bc0d-cb2a5fbc9fe5 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:33.309486 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9c578be5-8a4f-4e33-bc0d-cb2a5fbc9fe5 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:33.309961 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9c578be5-8a4f-4e33-bc0d-cb2a5fbc9fe5 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:33.310404 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9c578be5-8a4f-4e33-bc0d-cb2a5fbc9fe5 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:33.446339 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9c578be5-8a4f-4e33-bc0d-cb2a5fbc9fe5 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:28:33.454935 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9c578be5-8a4f-4e33-bc0d-cb2a5fbc9fe5 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/8b29da4a-f26f-46fc-b141-2887c22c372a" status: 200 len: 1373 microversion: 2.1 time: 0.158843 Sep 08 11:28:33.455750 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3246/6625] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:28:33 2022] GET /compute/v2.1/servers/8b29da4a-f26f-46fc-b141-2887c22c372a => generated 1373 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:28:33.474045 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-7d39f76b-df31-4f48-9fd7-33fc22c03bee req-2244382e-9f29-4c9e-a02b-3b430dd1c285 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b29da4a-f26f-46fc-b141-2887c22c372a", "name": "network-vif-plugged", "status": "completed", "tag": "21320923-dc66-4e8e-be22-95835bbbc60e"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:28:33.485585 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-7d39f76b-df31-4f48-9fd7-33fc22c03bee req-2244382e-9f29-4c9e-a02b-3b430dd1c285 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:33.486165 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-7d39f76b-df31-4f48-9fd7-33fc22c03bee req-2244382e-9f29-4c9e-a02b-3b430dd1c285 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:33.486680 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-7d39f76b-df31-4f48-9fd7-33fc22c03bee req-2244382e-9f29-4c9e-a02b-3b430dd1c285 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:33.498547 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-7d39f76b-df31-4f48-9fd7-33fc22c03bee req-2244382e-9f29-4c9e-a02b-3b430dd1c285 service nova] Creating event network-vif-plugged:21320923-dc66-4e8e-be22-95835bbbc60e for instance 8b29da4a-f26f-46fc-b141-2887c22c372a on n-h2-850501-12 Sep 08 11:28:33.503823 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-7d39f76b-df31-4f48-9fd7-33fc22c03bee req-2244382e-9f29-4c9e-a02b-3b430dd1c285 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033928 Sep 08 11:28:33.504525 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3380/6626] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:28:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:28:34.479841 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b83929e9-581e-4f79-a395-45df88b809e8 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:28:34.480515 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b83929e9-581e-4f79-a395-45df88b809e8 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 8b29da4a-f26f-46fc-b141-2887c22c372a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:28:34.488902 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b83929e9-581e-4f79-a395-45df88b809e8 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:34.489489 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b83929e9-581e-4f79-a395-45df88b809e8 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:34.489945 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b83929e9-581e-4f79-a395-45df88b809e8 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:34.490684 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b83929e9-581e-4f79-a395-45df88b809e8 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:34.491275 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b83929e9-581e-4f79-a395-45df88b809e8 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:34.491759 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b83929e9-581e-4f79-a395-45df88b809e8 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:34.652234 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b83929e9-581e-4f79-a395-45df88b809e8 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:28:34.662602 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b83929e9-581e-4f79-a395-45df88b809e8 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/8b29da4a-f26f-46fc-b141-2887c22c372a" status: 200 len: 1373 microversion: 2.1 time: 0.187002 Sep 08 11:28:34.663665 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3247/6627] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:28:34 2022] GET /compute/v2.1/servers/8b29da4a-f26f-46fc-b141-2887c22c372a => generated 1373 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:28:35.689545 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-562694c8-9956-4cfc-839b-697dade45b10 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:28:35.690263 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-562694c8-9956-4cfc-839b-697dade45b10 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 8b29da4a-f26f-46fc-b141-2887c22c372a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:28:35.696826 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-562694c8-9956-4cfc-839b-697dade45b10 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:35.697433 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-562694c8-9956-4cfc-839b-697dade45b10 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:35.697802 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-562694c8-9956-4cfc-839b-697dade45b10 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:35.698592 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-562694c8-9956-4cfc-839b-697dade45b10 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:35.699110 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-562694c8-9956-4cfc-839b-697dade45b10 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:35.699544 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-562694c8-9956-4cfc-839b-697dade45b10 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:35.849004 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-562694c8-9956-4cfc-839b-697dade45b10 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:28:35.858895 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-562694c8-9956-4cfc-839b-697dade45b10 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/8b29da4a-f26f-46fc-b141-2887c22c372a" status: 200 len: 1559 microversion: 2.1 time: 0.174710 Sep 08 11:28:35.859520 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3381/6628] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:28:35 2022] GET /compute/v2.1/servers/8b29da4a-f26f-46fc-b141-2887c22c372a => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:28:35.883213 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-645f40c6-81f3-492f-b61a-2725528dc148 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:28:35.883843 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-645f40c6-81f3-492f-b61a-2725528dc148 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 8b29da4a-f26f-46fc-b141-2887c22c372a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:28:35.891477 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-645f40c6-81f3-492f-b61a-2725528dc148 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:35.891988 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-645f40c6-81f3-492f-b61a-2725528dc148 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:35.892440 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-645f40c6-81f3-492f-b61a-2725528dc148 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:35.893284 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-645f40c6-81f3-492f-b61a-2725528dc148 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:35.893759 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-645f40c6-81f3-492f-b61a-2725528dc148 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:35.894199 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-645f40c6-81f3-492f-b61a-2725528dc148 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:36.038747 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-645f40c6-81f3-492f-b61a-2725528dc148 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:28:36.048463 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-645f40c6-81f3-492f-b61a-2725528dc148 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/8b29da4a-f26f-46fc-b141-2887c22c372a" status: 200 len: 1559 microversion: 2.1 time: 0.168984 Sep 08 11:28:36.049325 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3248/6629] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:28:35 2022] GET /compute/v2.1/servers/8b29da4a-f26f-46fc-b141-2887c22c372a => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:28:36.131596 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5b3fb490-f26b-4ae6-bb91-9bd6e3b1b44f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:28:36.132092 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5b3fb490-f26b-4ae6-bb91-9bd6e3b1b44f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 8b29da4a-f26f-46fc-b141-2887c22c372a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:28:36.139077 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5b3fb490-f26b-4ae6-bb91-9bd6e3b1b44f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:36.139680 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5b3fb490-f26b-4ae6-bb91-9bd6e3b1b44f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:36.140159 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5b3fb490-f26b-4ae6-bb91-9bd6e3b1b44f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:36.140872 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5b3fb490-f26b-4ae6-bb91-9bd6e3b1b44f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:36.141355 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5b3fb490-f26b-4ae6-bb91-9bd6e3b1b44f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:36.141791 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5b3fb490-f26b-4ae6-bb91-9bd6e3b1b44f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:36.172079 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5b3fb490-f26b-4ae6-bb91-9bd6e3b1b44f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 8b29da4a-f26f-46fc-b141-2887c22c372a] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:28:36.264346 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5b3fb490-f26b-4ae6-bb91-9bd6e3b1b44f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8b29da4a-f26f-46fc-b141-2887c22c372a" status: 204 len: 0 microversion: 2.1 time: 0.134295 Sep 08 11:28:36.265733 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3382/6630] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:28:36 2022] DELETE /compute/v2.1/servers/8b29da4a-f26f-46fc-b141-2887c22c372a => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:28:36.277415 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fa9006f7-1ebf-4119-baa2-5ddc31b222c3 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:28:36.278572 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fa9006f7-1ebf-4119-baa2-5ddc31b222c3 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 8b29da4a-f26f-46fc-b141-2887c22c372a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:28:36.289143 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fa9006f7-1ebf-4119-baa2-5ddc31b222c3 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:36.289909 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fa9006f7-1ebf-4119-baa2-5ddc31b222c3 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:36.290685 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fa9006f7-1ebf-4119-baa2-5ddc31b222c3 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:36.291573 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fa9006f7-1ebf-4119-baa2-5ddc31b222c3 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:36.292364 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fa9006f7-1ebf-4119-baa2-5ddc31b222c3 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:36.292920 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fa9006f7-1ebf-4119-baa2-5ddc31b222c3 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:36.467776 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fa9006f7-1ebf-4119-baa2-5ddc31b222c3 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:28:36.477049 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fa9006f7-1ebf-4119-baa2-5ddc31b222c3 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/8b29da4a-f26f-46fc-b141-2887c22c372a" status: 200 len: 1565 microversion: 2.1 time: 0.206578 Sep 08 11:28:36.477646 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3249/6631] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:28:36 2022] GET /compute/v2.1/servers/8b29da4a-f26f-46fc-b141-2887c22c372a => generated 1565 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:28:37.503712 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-89f5ef76-b199-4e23-9797-c6178b2c1462 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:28:37.504800 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-89f5ef76-b199-4e23-9797-c6178b2c1462 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 8b29da4a-f26f-46fc-b141-2887c22c372a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:28:37.513168 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-89f5ef76-b199-4e23-9797-c6178b2c1462 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:37.514973 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-89f5ef76-b199-4e23-9797-c6178b2c1462 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:37.515582 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-89f5ef76-b199-4e23-9797-c6178b2c1462 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:37.516433 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-89f5ef76-b199-4e23-9797-c6178b2c1462 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:37.516941 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-89f5ef76-b199-4e23-9797-c6178b2c1462 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:37.517397 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-89f5ef76-b199-4e23-9797-c6178b2c1462 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:37.662173 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-89f5ef76-b199-4e23-9797-c6178b2c1462 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:28:37.671038 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-89f5ef76-b199-4e23-9797-c6178b2c1462 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/8b29da4a-f26f-46fc-b141-2887c22c372a" status: 200 len: 1565 microversion: 2.1 time: 0.173431 Sep 08 11:28:37.671661 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3383/6632] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:28:37 2022] GET /compute/v2.1/servers/8b29da4a-f26f-46fc-b141-2887c22c372a => generated 1565 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:28:38.451844 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-cf33cb3b-4dec-4363-856a-8b7e9fbd02e1 req-890d1d3e-2f45-4640-b5f2-b37718cf9717 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b29da4a-f26f-46fc-b141-2887c22c372a", "name": "network-vif-deleted", "tag": "21320923-dc66-4e8e-be22-95835bbbc60e"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:28:38.469822 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-cf33cb3b-4dec-4363-856a-8b7e9fbd02e1 req-890d1d3e-2f45-4640-b5f2-b37718cf9717 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:38.470342 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-cf33cb3b-4dec-4363-856a-8b7e9fbd02e1 req-890d1d3e-2f45-4640-b5f2-b37718cf9717 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:38.470801 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-cf33cb3b-4dec-4363-856a-8b7e9fbd02e1 req-890d1d3e-2f45-4640-b5f2-b37718cf9717 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:38.491854 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-cf33cb3b-4dec-4363-856a-8b7e9fbd02e1 req-890d1d3e-2f45-4640-b5f2-b37718cf9717 service nova] Creating event network-vif-deleted:21320923-dc66-4e8e-be22-95835bbbc60e for instance 8b29da4a-f26f-46fc-b141-2887c22c372a on n-h2-850501-12 Sep 08 11:28:38.498651 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-cf33cb3b-4dec-4363-856a-8b7e9fbd02e1 req-890d1d3e-2f45-4640-b5f2-b37718cf9717 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052300 Sep 08 11:28:38.499837 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3250/6633] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:28:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:28:38.695795 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cb459e63-5e0d-4989-843d-c46e103e6eb6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:28:38.696470 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cb459e63-5e0d-4989-843d-c46e103e6eb6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 8b29da4a-f26f-46fc-b141-2887c22c372a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:28:38.703970 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb459e63-5e0d-4989-843d-c46e103e6eb6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:38.704463 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb459e63-5e0d-4989-843d-c46e103e6eb6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:38.704909 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb459e63-5e0d-4989-843d-c46e103e6eb6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:38.705654 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb459e63-5e0d-4989-843d-c46e103e6eb6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:38.706114 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb459e63-5e0d-4989-843d-c46e103e6eb6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:38.706543 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb459e63-5e0d-4989-843d-c46e103e6eb6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:38.780252 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-cb459e63-5e0d-4989-843d-c46e103e6eb6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:28:38.788920 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cb459e63-5e0d-4989-843d-c46e103e6eb6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/8b29da4a-f26f-46fc-b141-2887c22c372a" status: 200 len: 1358 microversion: 2.1 time: 0.098174 Sep 08 11:28:38.789881 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3384/6634] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:28:38 2022] GET /compute/v2.1/servers/8b29da4a-f26f-46fc-b141-2887c22c372a => generated 1358 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:28:39.814798 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-abddc14e-4507-4690-bebe-1725fdb2f29a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:28:39.815689 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-abddc14e-4507-4690-bebe-1725fdb2f29a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 8b29da4a-f26f-46fc-b141-2887c22c372a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:28:39.822188 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-abddc14e-4507-4690-bebe-1725fdb2f29a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:39.822795 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-abddc14e-4507-4690-bebe-1725fdb2f29a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:39.823314 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-abddc14e-4507-4690-bebe-1725fdb2f29a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:39.824103 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-abddc14e-4507-4690-bebe-1725fdb2f29a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:39.824647 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-abddc14e-4507-4690-bebe-1725fdb2f29a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:39.825489 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-abddc14e-4507-4690-bebe-1725fdb2f29a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:39.896898 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-abddc14e-4507-4690-bebe-1725fdb2f29a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:28:39.906196 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-abddc14e-4507-4690-bebe-1725fdb2f29a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/8b29da4a-f26f-46fc-b141-2887c22c372a" status: 200 len: 1358 microversion: 2.1 time: 0.095578 Sep 08 11:28:39.906806 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3251/6635] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:28:39 2022] GET /compute/v2.1/servers/8b29da4a-f26f-46fc-b141-2887c22c372a => generated 1358 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:28:40.931314 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-faed4706-7038-4453-bad5-64fa393c163d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:28:40.932071 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-faed4706-7038-4453-bad5-64fa393c163d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 8b29da4a-f26f-46fc-b141-2887c22c372a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:28:40.939469 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-faed4706-7038-4453-bad5-64fa393c163d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:40.939972 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-faed4706-7038-4453-bad5-64fa393c163d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:40.940415 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-faed4706-7038-4453-bad5-64fa393c163d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:40.941238 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-faed4706-7038-4453-bad5-64fa393c163d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:40.941709 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-faed4706-7038-4453-bad5-64fa393c163d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:40.942140 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-faed4706-7038-4453-bad5-64fa393c163d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:41.010727 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-faed4706-7038-4453-bad5-64fa393c163d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:28:41.019546 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-faed4706-7038-4453-bad5-64fa393c163d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/8b29da4a-f26f-46fc-b141-2887c22c372a" status: 200 len: 1358 microversion: 2.1 time: 0.092203 Sep 08 11:28:41.020128 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3385/6636] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:28:40 2022] GET /compute/v2.1/servers/8b29da4a-f26f-46fc-b141-2887c22c372a => generated 1358 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:28:42.042487 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1df51835-aba0-4b19-b36b-c171b3c8c9b2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:28:42.043084 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1df51835-aba0-4b19-b36b-c171b3c8c9b2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 8b29da4a-f26f-46fc-b141-2887c22c372a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:28:42.051008 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1df51835-aba0-4b19-b36b-c171b3c8c9b2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:42.051516 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1df51835-aba0-4b19-b36b-c171b3c8c9b2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:42.051964 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1df51835-aba0-4b19-b36b-c171b3c8c9b2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:42.052679 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1df51835-aba0-4b19-b36b-c171b3c8c9b2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:42.053193 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1df51835-aba0-4b19-b36b-c171b3c8c9b2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:42.053635 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1df51835-aba0-4b19-b36b-c171b3c8c9b2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:42.118867 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1df51835-aba0-4b19-b36b-c171b3c8c9b2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:28:42.128011 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1df51835-aba0-4b19-b36b-c171b3c8c9b2 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/8b29da4a-f26f-46fc-b141-2887c22c372a" status: 200 len: 1358 microversion: 2.1 time: 0.089408 Sep 08 11:28:42.128617 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3252/6637] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:28:42 2022] GET /compute/v2.1/servers/8b29da4a-f26f-46fc-b141-2887c22c372a => generated 1358 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:28:43.150488 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-589088d8-6d56-4095-8a43-36a145695a52 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:28:43.151061 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-589088d8-6d56-4095-8a43-36a145695a52 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 8b29da4a-f26f-46fc-b141-2887c22c372a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:28:43.161038 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-589088d8-6d56-4095-8a43-36a145695a52 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:43.161578 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-589088d8-6d56-4095-8a43-36a145695a52 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:43.162042 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-589088d8-6d56-4095-8a43-36a145695a52 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:43.162768 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-589088d8-6d56-4095-8a43-36a145695a52 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:43.163419 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-589088d8-6d56-4095-8a43-36a145695a52 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:43.163873 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-589088d8-6d56-4095-8a43-36a145695a52 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:43.200642 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-589088d8-6d56-4095-8a43-36a145695a52 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:43.201183 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-589088d8-6d56-4095-8a43-36a145695a52 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:43.202292 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-589088d8-6d56-4095-8a43-36a145695a52 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:43.202768 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-589088d8-6d56-4095-8a43-36a145695a52 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lazy-loading 'fault' on Instance uuid 8b29da4a-f26f-46fc-b141-2887c22c372a {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:28:43.255637 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-589088d8-6d56-4095-8a43-36a145695a52 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:28:43.264913 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-589088d8-6d56-4095-8a43-36a145695a52 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/8b29da4a-f26f-46fc-b141-2887c22c372a" status: 200 len: 1363 microversion: 2.1 time: 0.117810 Sep 08 11:28:43.266107 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3386/6638] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:28:43 2022] GET /compute/v2.1/servers/8b29da4a-f26f-46fc-b141-2887c22c372a => generated 1363 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:28:44.288499 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4ebab08e-ac8c-4f7a-8f45-c68b604b7b2c tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:28:44.289149 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4ebab08e-ac8c-4f7a-8f45-c68b604b7b2c tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 8b29da4a-f26f-46fc-b141-2887c22c372a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:28:44.295958 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ebab08e-ac8c-4f7a-8f45-c68b604b7b2c tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:44.296460 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ebab08e-ac8c-4f7a-8f45-c68b604b7b2c tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:44.296901 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ebab08e-ac8c-4f7a-8f45-c68b604b7b2c tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:44.297845 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ebab08e-ac8c-4f7a-8f45-c68b604b7b2c tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:44.298204 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ebab08e-ac8c-4f7a-8f45-c68b604b7b2c tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:44.298614 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ebab08e-ac8c-4f7a-8f45-c68b604b7b2c tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:44.313537 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-4ebab08e-ac8c-4f7a-8f45-c68b604b7b2c tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] HTTP exception thrown: Instance 8b29da4a-f26f-46fc-b141-2887c22c372a could not be found. Sep 08 11:28:44.315205 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4ebab08e-ac8c-4f7a-8f45-c68b604b7b2c tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Request method failure captured: Sep 08 11:28:44.315205 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/8b29da4a-f26f-46fc-b141-2887c22c372a HTTP/1.1 Sep 08 11:28:44.315205 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 11:28:44.315205 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 11:28:44.315205 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 11:28:44.315205 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 11:28:44.315205 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 11:28:44.315205 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 11:28:44.315205 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 11:28:44.315205 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 11:28:44.315205 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGdEih_jYhjrfzcEat7QOG_17jH52nIZFToedVJMJ8Jj4pTKrcjanm3D8dChnqEL9d7jV5rq3NW7Z60oajSkgXZAcEtwDn7-PJMU6a9_UOAo8UiiyZ8L4GogQF4UWk_-Vlyi8Q447m99c-S3nr2fWKYhvhV9-SsmuV-ccLSbm0hBFVVM Sep 08 11:28:44.315205 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 11:28:44.315205 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 11:28:44.315205 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 11:28:44.315205 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 11:28:44.315205 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 11:28:44.315205 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 11:28:44.315205 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 747bb5860ba14a20bba3b1c2197ea75d Sep 08 11:28:44.315205 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-TestVolumeBootPattern-1812135790 Sep 08 11:28:44.315205 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 11:28:44.315205 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 11:28:44.315205 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/747bb5860ba14a20bba3b1c2197ea75d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/747bb5860ba14a20bba3b1c2197ea75d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_747bb5860ba14a20bba3b1c2197ea75d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/747bb5860ba14a20bba3b1c2197ea75d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:28:44.315205 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-TestVolumeBootPattern-1812135790 Sep 08 11:28:44.315205 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 747bb5860ba14a20bba3b1c2197ea75d Sep 08 11:28:44.315205 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-TestVolumeBootPattern-1812135790 Sep 08 11:28:44.315205 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-TestVolumeBootPattern-1812135790-project Sep 08 11:28:44.315205 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 11:28:44.315205 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 11:28:44.315205 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: bc18639e461e4ef5bfcf4380c561f329 Sep 08 11:28:44.315205 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-TestVolumeBootPattern-1812135790-project Sep 08 11:28:44.315205 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 11:28:44.315205 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 8b29da4a-f26f-46fc-b141-2887c22c372a could not be found. Sep 08 11:28:44.315205 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '8b29da4a-f26f-46fc-b141-2887c22c372a'} Sep 08 11:28:44.315205 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:28:44.315205 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:28:44.315205 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:28:44.315205 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:28:44.315205 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:28:44.315205 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:28:44.315205 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:28:44.315205 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:28:44.315205 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:28:44.315205 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:28:44.315205 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b29da4a-f26f-46fc-b141-2887c22c372a could not be found. Sep 08 11:28:44.315205 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:28:44.315205 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:28:44.315205 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:28:44.315205 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:28:44.315205 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:28:44.315205 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:28:44.315205 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:28:44.315205 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:28:44.315205 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:28:44.315205 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:28:44.315205 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:28:44.315205 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:28:44.315205 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:28:44.315205 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:28:44.315205 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:28:44.315205 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:28:44.315205 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b29da4a-f26f-46fc-b141-2887c22c372a could not be found. Sep 08 11:28:44.315205 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:28:44.315205 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:28:44.315205 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:28:44.321316 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:28:44.321316 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:28:44.321316 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:28:44.321316 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:28:44.321316 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:28:44.321316 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b29da4a-f26f-46fc-b141-2887c22c372a could not be found. Sep 08 11:28:44.321316 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:28:44.321316 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4ebab08e-ac8c-4f7a-8f45-c68b604b7b2c tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Returning 404 to user: Instance 8b29da4a-f26f-46fc-b141-2887c22c372a could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:28:44.321316 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4ebab08e-ac8c-4f7a-8f45-c68b604b7b2c tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/8b29da4a-f26f-46fc-b141-2887c22c372a" status: 404 len: 111 microversion: 2.1 time: 0.032681 Sep 08 11:28:44.321316 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3253/6639] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:28:44 2022] GET /compute/v2.1/servers/8b29da4a-f26f-46fc-b141-2887c22c372a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:28:48.628670 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cdf7b736-d236-4f65-b421-282b8574f328 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:28:48.629235 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cdf7b736-d236-4f65-b421-282b8574f328 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: cd4021f3-ff9e-47c7-9a1c-0578b5fd79db] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:28:48.632028 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:28:48.637492 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cdf7b736-d236-4f65-b421-282b8574f328 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:48.637984 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cdf7b736-d236-4f65-b421-282b8574f328 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:48.638420 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cdf7b736-d236-4f65-b421-282b8574f328 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:48.639113 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cdf7b736-d236-4f65-b421-282b8574f328 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:48.639979 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cdf7b736-d236-4f65-b421-282b8574f328 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:48.640185 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cdf7b736-d236-4f65-b421-282b8574f328 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:48.643540 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:28:48.668240 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cdf7b736-d236-4f65-b421-282b8574f328 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: cd4021f3-ff9e-47c7-9a1c-0578b5fd79db] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:28:48.752395 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cdf7b736-d236-4f65-b421-282b8574f328 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "DELETE /compute/v2.1/servers/cd4021f3-ff9e-47c7-9a1c-0578b5fd79db" status: 204 len: 0 microversion: 2.1 time: 0.127616 Sep 08 11:28:48.753570 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3387/6640] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:28:48 2022] DELETE /compute/v2.1/servers/cd4021f3-ff9e-47c7-9a1c-0578b5fd79db => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:28:48.762084 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-714e9a4f-073d-4979-9a6d-35f9a65b819e tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:28:48.762857 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-714e9a4f-073d-4979-9a6d-35f9a65b819e tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: cd4021f3-ff9e-47c7-9a1c-0578b5fd79db] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:28:48.769137 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=30 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:28:48.770820 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-714e9a4f-073d-4979-9a6d-35f9a65b819e tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:48.771342 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-714e9a4f-073d-4979-9a6d-35f9a65b819e tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:48.771795 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-714e9a4f-073d-4979-9a6d-35f9a65b819e tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:48.772555 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-714e9a4f-073d-4979-9a6d-35f9a65b819e tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:48.773046 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-714e9a4f-073d-4979-9a6d-35f9a65b819e tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:48.773490 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-714e9a4f-073d-4979-9a6d-35f9a65b819e tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:48.779331 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=82 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:28:48.913642 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-714e9a4f-073d-4979-9a6d-35f9a65b819e tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:28:48.926793 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-714e9a4f-073d-4979-9a6d-35f9a65b819e tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/cd4021f3-ff9e-47c7-9a1c-0578b5fd79db" status: 200 len: 1409 microversion: 2.1 time: 0.168512 Sep 08 11:28:48.927382 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3254/6641] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:28:48 2022] GET /compute/v2.1/servers/cd4021f3-ff9e-47c7-9a1c-0578b5fd79db => generated 1409 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:28:49.953513 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2d99d995-f923-4d25-a1c2-f037e363e2b6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:28:49.954138 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2d99d995-f923-4d25-a1c2-f037e363e2b6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: cd4021f3-ff9e-47c7-9a1c-0578b5fd79db] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:28:49.961273 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2d99d995-f923-4d25-a1c2-f037e363e2b6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:49.961772 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2d99d995-f923-4d25-a1c2-f037e363e2b6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:49.962217 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2d99d995-f923-4d25-a1c2-f037e363e2b6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:49.962922 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2d99d995-f923-4d25-a1c2-f037e363e2b6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:49.963381 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2d99d995-f923-4d25-a1c2-f037e363e2b6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:49.963988 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2d99d995-f923-4d25-a1c2-f037e363e2b6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:50.104576 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2d99d995-f923-4d25-a1c2-f037e363e2b6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:28:50.113726 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2d99d995-f923-4d25-a1c2-f037e363e2b6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/cd4021f3-ff9e-47c7-9a1c-0578b5fd79db" status: 200 len: 1409 microversion: 2.1 time: 0.164591 Sep 08 11:28:50.114417 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3388/6642] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:28:49 2022] GET /compute/v2.1/servers/cd4021f3-ff9e-47c7-9a1c-0578b5fd79db => generated 1409 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:28:50.810101 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-9560450d-8d23-4eb5-9b12-ffcbcd05dcca req-e60d5ea8-7559-492c-b48c-4c329026021d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd4021f3-ff9e-47c7-9a1c-0578b5fd79db", "name": "network-vif-deleted", "tag": "ea1b6336-b8ba-4704-b239-32e300dedf92"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:28:50.823589 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-9560450d-8d23-4eb5-9b12-ffcbcd05dcca req-e60d5ea8-7559-492c-b48c-4c329026021d service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:50.824388 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-9560450d-8d23-4eb5-9b12-ffcbcd05dcca req-e60d5ea8-7559-492c-b48c-4c329026021d service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:50.824848 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-9560450d-8d23-4eb5-9b12-ffcbcd05dcca req-e60d5ea8-7559-492c-b48c-4c329026021d service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:50.838080 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-9560450d-8d23-4eb5-9b12-ffcbcd05dcca req-e60d5ea8-7559-492c-b48c-4c329026021d service nova] Creating event network-vif-deleted:ea1b6336-b8ba-4704-b239-32e300dedf92 for instance cd4021f3-ff9e-47c7-9a1c-0578b5fd79db on n-h1-850501-12 Sep 08 11:28:50.843581 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-9560450d-8d23-4eb5-9b12-ffcbcd05dcca req-e60d5ea8-7559-492c-b48c-4c329026021d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036783 Sep 08 11:28:50.844278 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3255/6643] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:28:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:28:51.137099 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cd89c701-0180-47ec-94e4-0e40ad017260 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:28:51.138155 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cd89c701-0180-47ec-94e4-0e40ad017260 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: cd4021f3-ff9e-47c7-9a1c-0578b5fd79db] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:28:51.145500 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cd89c701-0180-47ec-94e4-0e40ad017260 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:51.146261 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cd89c701-0180-47ec-94e4-0e40ad017260 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:51.146818 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cd89c701-0180-47ec-94e4-0e40ad017260 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:51.147539 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cd89c701-0180-47ec-94e4-0e40ad017260 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:51.148189 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cd89c701-0180-47ec-94e4-0e40ad017260 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:51.148623 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cd89c701-0180-47ec-94e4-0e40ad017260 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:51.223386 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-cd89c701-0180-47ec-94e4-0e40ad017260 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:28:51.231888 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cd89c701-0180-47ec-94e4-0e40ad017260 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/cd4021f3-ff9e-47c7-9a1c-0578b5fd79db" status: 200 len: 1202 microversion: 2.1 time: 0.098935 Sep 08 11:28:51.232775 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3389/6644] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:28:51 2022] GET /compute/v2.1/servers/cd4021f3-ff9e-47c7-9a1c-0578b5fd79db => generated 1202 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:28:52.257783 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c674b14b-865a-4ea9-90bb-7dac2f0f001e tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:28:52.258525 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c674b14b-865a-4ea9-90bb-7dac2f0f001e tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: cd4021f3-ff9e-47c7-9a1c-0578b5fd79db] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:28:52.265053 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c674b14b-865a-4ea9-90bb-7dac2f0f001e tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:52.265648 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c674b14b-865a-4ea9-90bb-7dac2f0f001e tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:52.266107 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c674b14b-865a-4ea9-90bb-7dac2f0f001e tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:52.266829 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c674b14b-865a-4ea9-90bb-7dac2f0f001e tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:52.267300 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c674b14b-865a-4ea9-90bb-7dac2f0f001e tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:52.267771 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c674b14b-865a-4ea9-90bb-7dac2f0f001e tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:52.333600 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c674b14b-865a-4ea9-90bb-7dac2f0f001e tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:28:52.341997 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c674b14b-865a-4ea9-90bb-7dac2f0f001e tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/cd4021f3-ff9e-47c7-9a1c-0578b5fd79db" status: 200 len: 1202 microversion: 2.1 time: 0.089485 Sep 08 11:28:52.342599 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3256/6645] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:28:52 2022] GET /compute/v2.1/servers/cd4021f3-ff9e-47c7-9a1c-0578b5fd79db => generated 1202 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:28:53.365267 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8f43f746-a3fd-4a8d-aca8-9bb6d7fe9686 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:28:53.365886 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8f43f746-a3fd-4a8d-aca8-9bb6d7fe9686 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: cd4021f3-ff9e-47c7-9a1c-0578b5fd79db] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:28:53.373070 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f43f746-a3fd-4a8d-aca8-9bb6d7fe9686 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:53.373569 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f43f746-a3fd-4a8d-aca8-9bb6d7fe9686 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:53.374514 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f43f746-a3fd-4a8d-aca8-9bb6d7fe9686 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:53.375269 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f43f746-a3fd-4a8d-aca8-9bb6d7fe9686 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:53.375767 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f43f746-a3fd-4a8d-aca8-9bb6d7fe9686 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:53.376197 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f43f746-a3fd-4a8d-aca8-9bb6d7fe9686 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:53.439865 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8f43f746-a3fd-4a8d-aca8-9bb6d7fe9686 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:28:53.447986 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8f43f746-a3fd-4a8d-aca8-9bb6d7fe9686 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/cd4021f3-ff9e-47c7-9a1c-0578b5fd79db" status: 200 len: 1202 microversion: 2.1 time: 0.086656 Sep 08 11:28:53.448643 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3390/6646] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:28:53 2022] GET /compute/v2.1/servers/cd4021f3-ff9e-47c7-9a1c-0578b5fd79db => generated 1202 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:28:54.472973 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3bc1c5d0-f514-42ed-a794-39686c49ab08 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:28:54.473641 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3bc1c5d0-f514-42ed-a794-39686c49ab08 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: cd4021f3-ff9e-47c7-9a1c-0578b5fd79db] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:28:54.480572 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3bc1c5d0-f514-42ed-a794-39686c49ab08 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:54.481159 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3bc1c5d0-f514-42ed-a794-39686c49ab08 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:54.481619 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3bc1c5d0-f514-42ed-a794-39686c49ab08 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:54.482338 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3bc1c5d0-f514-42ed-a794-39686c49ab08 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:54.482815 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3bc1c5d0-f514-42ed-a794-39686c49ab08 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:54.483399 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3bc1c5d0-f514-42ed-a794-39686c49ab08 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:54.569092 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3bc1c5d0-f514-42ed-a794-39686c49ab08 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:28:54.578937 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3bc1c5d0-f514-42ed-a794-39686c49ab08 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/cd4021f3-ff9e-47c7-9a1c-0578b5fd79db" status: 200 len: 1202 microversion: 2.1 time: 0.110931 Sep 08 11:28:54.579537 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3257/6647] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:28:54 2022] GET /compute/v2.1/servers/cd4021f3-ff9e-47c7-9a1c-0578b5fd79db => generated 1202 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:28:55.603281 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9043d834-52ad-4da8-a928-914dde608807 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:28:55.603911 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9043d834-52ad-4da8-a928-914dde608807 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: cd4021f3-ff9e-47c7-9a1c-0578b5fd79db] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:28:55.610770 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9043d834-52ad-4da8-a928-914dde608807 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:55.611271 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9043d834-52ad-4da8-a928-914dde608807 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:55.611800 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9043d834-52ad-4da8-a928-914dde608807 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:55.612522 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9043d834-52ad-4da8-a928-914dde608807 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:55.612994 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9043d834-52ad-4da8-a928-914dde608807 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:55.613483 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9043d834-52ad-4da8-a928-914dde608807 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:55.627943 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-9043d834-52ad-4da8-a928-914dde608807 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] HTTP exception thrown: Instance cd4021f3-ff9e-47c7-9a1c-0578b5fd79db could not be found. Sep 08 11:28:55.629663 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9043d834-52ad-4da8-a928-914dde608807 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Request method failure captured: Sep 08 11:28:55.629663 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/cd4021f3-ff9e-47c7-9a1c-0578b5fd79db HTTP/1.1 Sep 08 11:28:55.629663 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:28:55.629663 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:28:55.629663 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:28:55.629663 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 11:28:55.629663 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:28:55.629663 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:28:55.629663 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:28:55.629663 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:28:55.629663 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGdEih_jYhjrfzcEat7QOG_17jH52nIZFToedVJMJ8Jj4pTKrcjanm3D8dChnqEL9d7jV5rq3NW7Z60oajSkgXZAcEtwDn7-PJMU6a9_UOAo8UiiyZ8L4GogQF4UWk_-Vlyi8Q447m99c-S3nr2fWKYhvhV9-SsmuV-ccLSbm0hBFVVM Sep 08 11:28:55.629663 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:28:55.629663 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:28:55.629663 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:28:55.629663 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:28:55.629663 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:28:55.629663 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:28:55.629663 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 747bb5860ba14a20bba3b1c2197ea75d Sep 08 11:28:55.629663 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-TestVolumeBootPattern-1812135790 Sep 08 11:28:55.629663 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:28:55.629663 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:28:55.629663 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/747bb5860ba14a20bba3b1c2197ea75d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/747bb5860ba14a20bba3b1c2197ea75d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_747bb5860ba14a20bba3b1c2197ea75d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/747bb5860ba14a20bba3b1c2197ea75d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:28:55.629663 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-TestVolumeBootPattern-1812135790 Sep 08 11:28:55.629663 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 747bb5860ba14a20bba3b1c2197ea75d Sep 08 11:28:55.629663 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-TestVolumeBootPattern-1812135790 Sep 08 11:28:55.629663 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-TestVolumeBootPattern-1812135790-project Sep 08 11:28:55.629663 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:28:55.629663 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:28:55.629663 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: bc18639e461e4ef5bfcf4380c561f329 Sep 08 11:28:55.629663 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-TestVolumeBootPattern-1812135790-project Sep 08 11:28:55.629663 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 11:28:55.629663 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance cd4021f3-ff9e-47c7-9a1c-0578b5fd79db could not be found. Sep 08 11:28:55.629663 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': 'cd4021f3-ff9e-47c7-9a1c-0578b5fd79db'} Sep 08 11:28:55.629663 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:28:55.629663 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:28:55.629663 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:28:55.629663 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:28:55.629663 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:28:55.629663 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:28:55.629663 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:28:55.629663 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:28:55.629663 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:28:55.629663 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:28:55.629663 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd4021f3-ff9e-47c7-9a1c-0578b5fd79db could not be found. Sep 08 11:28:55.629663 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:28:55.629663 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:28:55.629663 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:28:55.629663 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:28:55.629663 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:28:55.629663 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:28:55.629663 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:28:55.629663 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:28:55.629663 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:28:55.629663 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:28:55.629663 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:28:55.629663 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:28:55.629663 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:28:55.629663 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:28:55.629663 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:28:55.629663 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:28:55.629663 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd4021f3-ff9e-47c7-9a1c-0578b5fd79db could not be found. Sep 08 11:28:55.629663 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:28:55.629663 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:28:55.629663 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:28:55.633581 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:28:55.633581 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:28:55.633581 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:28:55.633581 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:28:55.633581 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:28:55.633581 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd4021f3-ff9e-47c7-9a1c-0578b5fd79db could not be found. Sep 08 11:28:55.633581 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:28:55.633581 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9043d834-52ad-4da8-a928-914dde608807 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Returning 404 to user: Instance cd4021f3-ff9e-47c7-9a1c-0578b5fd79db could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:28:55.633581 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9043d834-52ad-4da8-a928-914dde608807 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/cd4021f3-ff9e-47c7-9a1c-0578b5fd79db" status: 404 len: 111 microversion: 2.1 time: 0.032071 Sep 08 11:28:55.633581 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3391/6648] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:28:55 2022] GET /compute/v2.1/servers/cd4021f3-ff9e-47c7-9a1c-0578b5fd79db => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:28:57.776576 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a63a6e69-8a53-4ed9-a1a9-acdbb5d33310 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:28:57.777140 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a63a6e69-8a53-4ed9-a1a9-acdbb5d33310 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 8b29da4a-f26f-46fc-b141-2887c22c372a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:28:57.784894 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a63a6e69-8a53-4ed9-a1a9-acdbb5d33310 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:57.785441 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a63a6e69-8a53-4ed9-a1a9-acdbb5d33310 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:57.786069 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a63a6e69-8a53-4ed9-a1a9-acdbb5d33310 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:57.787001 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a63a6e69-8a53-4ed9-a1a9-acdbb5d33310 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:57.787480 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a63a6e69-8a53-4ed9-a1a9-acdbb5d33310 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:57.787935 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a63a6e69-8a53-4ed9-a1a9-acdbb5d33310 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:57.802801 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-a63a6e69-8a53-4ed9-a1a9-acdbb5d33310 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] HTTP exception thrown: Instance 8b29da4a-f26f-46fc-b141-2887c22c372a could not be found. Sep 08 11:28:57.804502 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a63a6e69-8a53-4ed9-a1a9-acdbb5d33310 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Request method failure captured: Sep 08 11:28:57.804502 n-d-850501-12 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/servers/8b29da4a-f26f-46fc-b141-2887c22c372a HTTP/1.1 Sep 08 11:28:57.804502 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 11:28:57.804502 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 11:28:57.804502 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 11:28:57.804502 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 11:28:57.804502 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 11:28:57.804502 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 11:28:57.804502 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 11:28:57.804502 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 11:28:57.804502 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGdEih_jYhjrfzcEat7QOG_17jH52nIZFToedVJMJ8Jj4pTKrcjanm3D8dChnqEL9d7jV5rq3NW7Z60oajSkgXZAcEtwDn7-PJMU6a9_UOAo8UiiyZ8L4GogQF4UWk_-Vlyi8Q447m99c-S3nr2fWKYhvhV9-SsmuV-ccLSbm0hBFVVM Sep 08 11:28:57.804502 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 11:28:57.804502 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 11:28:57.804502 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 11:28:57.804502 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 11:28:57.804502 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 11:28:57.804502 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 11:28:57.804502 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 747bb5860ba14a20bba3b1c2197ea75d Sep 08 11:28:57.804502 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-TestVolumeBootPattern-1812135790 Sep 08 11:28:57.804502 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 11:28:57.804502 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 11:28:57.804502 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/747bb5860ba14a20bba3b1c2197ea75d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/747bb5860ba14a20bba3b1c2197ea75d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_747bb5860ba14a20bba3b1c2197ea75d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/747bb5860ba14a20bba3b1c2197ea75d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:28:57.804502 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-TestVolumeBootPattern-1812135790 Sep 08 11:28:57.804502 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 747bb5860ba14a20bba3b1c2197ea75d Sep 08 11:28:57.804502 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-TestVolumeBootPattern-1812135790 Sep 08 11:28:57.804502 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-TestVolumeBootPattern-1812135790-project Sep 08 11:28:57.804502 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 11:28:57.804502 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 11:28:57.804502 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: bc18639e461e4ef5bfcf4380c561f329 Sep 08 11:28:57.804502 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-TestVolumeBootPattern-1812135790-project Sep 08 11:28:57.804502 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 11:28:57.804502 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 8b29da4a-f26f-46fc-b141-2887c22c372a could not be found. Sep 08 11:28:57.804502 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '8b29da4a-f26f-46fc-b141-2887c22c372a'} Sep 08 11:28:57.804502 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:28:57.804502 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:28:57.804502 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:28:57.804502 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:28:57.804502 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:28:57.804502 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:28:57.804502 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:28:57.804502 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:28:57.804502 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:28:57.804502 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:28:57.804502 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b29da4a-f26f-46fc-b141-2887c22c372a could not be found. Sep 08 11:28:57.804502 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:28:57.804502 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:28:57.804502 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:28:57.804502 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:28:57.804502 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:28:57.804502 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:28:57.804502 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:28:57.804502 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:28:57.804502 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:28:57.804502 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:28:57.804502 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 11:28:57.804502 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 11:28:57.804502 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 11:28:57.804502 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 11:28:57.804502 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:28:57.804502 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:28:57.804502 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:28:57.804502 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:28:57.808453 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b29da4a-f26f-46fc-b141-2887c22c372a could not be found. Sep 08 11:28:57.808453 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:28:57.808453 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:28:57.808453 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:28:57.808453 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:28:57.808453 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:28:57.808453 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:28:57.808453 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:28:57.808453 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:28:57.808453 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b29da4a-f26f-46fc-b141-2887c22c372a could not be found. Sep 08 11:28:57.808453 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:28:57.808453 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a63a6e69-8a53-4ed9-a1a9-acdbb5d33310 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Returning 404 to user: Instance 8b29da4a-f26f-46fc-b141-2887c22c372a could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:28:57.808453 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a63a6e69-8a53-4ed9-a1a9-acdbb5d33310 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8b29da4a-f26f-46fc-b141-2887c22c372a" status: 404 len: 111 microversion: 2.1 time: 0.033696 Sep 08 11:28:57.808453 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3258/6649] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:28:57 2022] DELETE /compute/v2.1/servers/8b29da4a-f26f-46fc-b141-2887c22c372a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:28:57.815078 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e5d5665f-524e-48a6-94f9-fa88fd655603 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:28:57.815708 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e5d5665f-524e-48a6-94f9-fa88fd655603 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 8b29da4a-f26f-46fc-b141-2887c22c372a] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:28:57.822728 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e5d5665f-524e-48a6-94f9-fa88fd655603 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:57.823375 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e5d5665f-524e-48a6-94f9-fa88fd655603 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:57.823673 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e5d5665f-524e-48a6-94f9-fa88fd655603 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:57.824390 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e5d5665f-524e-48a6-94f9-fa88fd655603 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:57.824854 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e5d5665f-524e-48a6-94f9-fa88fd655603 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:57.825313 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e5d5665f-524e-48a6-94f9-fa88fd655603 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:57.839476 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-e5d5665f-524e-48a6-94f9-fa88fd655603 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] HTTP exception thrown: Instance 8b29da4a-f26f-46fc-b141-2887c22c372a could not be found. Sep 08 11:28:57.841078 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e5d5665f-524e-48a6-94f9-fa88fd655603 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Request method failure captured: Sep 08 11:28:57.841078 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/8b29da4a-f26f-46fc-b141-2887c22c372a HTTP/1.1 Sep 08 11:28:57.841078 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:28:57.841078 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:28:57.841078 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:28:57.841078 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 11:28:57.841078 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:28:57.841078 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:28:57.841078 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:28:57.841078 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:28:57.841078 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGdEih_jYhjrfzcEat7QOG_17jH52nIZFToedVJMJ8Jj4pTKrcjanm3D8dChnqEL9d7jV5rq3NW7Z60oajSkgXZAcEtwDn7-PJMU6a9_UOAo8UiiyZ8L4GogQF4UWk_-Vlyi8Q447m99c-S3nr2fWKYhvhV9-SsmuV-ccLSbm0hBFVVM Sep 08 11:28:57.841078 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:28:57.841078 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:28:57.841078 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:28:57.841078 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:28:57.841078 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:28:57.841078 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:28:57.841078 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 747bb5860ba14a20bba3b1c2197ea75d Sep 08 11:28:57.841078 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-TestVolumeBootPattern-1812135790 Sep 08 11:28:57.841078 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:28:57.841078 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:28:57.841078 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/747bb5860ba14a20bba3b1c2197ea75d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/747bb5860ba14a20bba3b1c2197ea75d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_747bb5860ba14a20bba3b1c2197ea75d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/747bb5860ba14a20bba3b1c2197ea75d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:28:57.841078 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-TestVolumeBootPattern-1812135790 Sep 08 11:28:57.841078 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 747bb5860ba14a20bba3b1c2197ea75d Sep 08 11:28:57.841078 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-TestVolumeBootPattern-1812135790 Sep 08 11:28:57.841078 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-TestVolumeBootPattern-1812135790-project Sep 08 11:28:57.841078 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:28:57.841078 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:28:57.841078 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: bc18639e461e4ef5bfcf4380c561f329 Sep 08 11:28:57.841078 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-TestVolumeBootPattern-1812135790-project Sep 08 11:28:57.841078 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 11:28:57.841078 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 8b29da4a-f26f-46fc-b141-2887c22c372a could not be found. Sep 08 11:28:57.841078 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '8b29da4a-f26f-46fc-b141-2887c22c372a'} Sep 08 11:28:57.841078 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:28:57.841078 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:28:57.841078 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:28:57.841078 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:28:57.841078 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:28:57.841078 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:28:57.841078 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:28:57.841078 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:28:57.841078 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:28:57.841078 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:28:57.841078 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b29da4a-f26f-46fc-b141-2887c22c372a could not be found. Sep 08 11:28:57.841078 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:28:57.841078 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:28:57.841078 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:28:57.841078 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:28:57.841078 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:28:57.841078 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:28:57.841078 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:28:57.841078 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:28:57.841078 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:28:57.841078 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:28:57.841078 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:28:57.841078 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:28:57.841078 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:28:57.841078 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:28:57.841078 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:28:57.841078 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:28:57.841078 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b29da4a-f26f-46fc-b141-2887c22c372a could not be found. Sep 08 11:28:57.841078 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:28:57.841078 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:28:57.841078 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:28:57.849202 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:28:57.849202 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:28:57.849202 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:28:57.849202 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:28:57.849202 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:28:57.849202 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b29da4a-f26f-46fc-b141-2887c22c372a could not be found. Sep 08 11:28:57.849202 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:28:57.849202 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e5d5665f-524e-48a6-94f9-fa88fd655603 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Returning 404 to user: Instance 8b29da4a-f26f-46fc-b141-2887c22c372a could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:28:57.849202 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e5d5665f-524e-48a6-94f9-fa88fd655603 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/8b29da4a-f26f-46fc-b141-2887c22c372a" status: 404 len: 111 microversion: 2.1 time: 0.031835 Sep 08 11:28:57.849202 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3392/6650] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:28:57 2022] GET /compute/v2.1/servers/8b29da4a-f26f-46fc-b141-2887c22c372a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:28:58.230107 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-999760c4-5839-4a3f-9930-f0e380feba2a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:28:58.230614 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-999760c4-5839-4a3f-9930-f0e380feba2a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: cd4021f3-ff9e-47c7-9a1c-0578b5fd79db] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:28:58.237512 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-999760c4-5839-4a3f-9930-f0e380feba2a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:58.238050 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-999760c4-5839-4a3f-9930-f0e380feba2a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:58.238559 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-999760c4-5839-4a3f-9930-f0e380feba2a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:58.239234 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-999760c4-5839-4a3f-9930-f0e380feba2a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:58.239711 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-999760c4-5839-4a3f-9930-f0e380feba2a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:58.240155 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-999760c4-5839-4a3f-9930-f0e380feba2a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:58.254540 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-999760c4-5839-4a3f-9930-f0e380feba2a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] HTTP exception thrown: Instance cd4021f3-ff9e-47c7-9a1c-0578b5fd79db could not be found. Sep 08 11:28:58.256099 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-999760c4-5839-4a3f-9930-f0e380feba2a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Request method failure captured: Sep 08 11:28:58.256099 n-d-850501-12 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/servers/cd4021f3-ff9e-47c7-9a1c-0578b5fd79db HTTP/1.1 Sep 08 11:28:58.256099 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 11:28:58.256099 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 11:28:58.256099 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 11:28:58.256099 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 11:28:58.256099 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 11:28:58.256099 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 11:28:58.256099 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 11:28:58.256099 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 11:28:58.256099 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGdEih_jYhjrfzcEat7QOG_17jH52nIZFToedVJMJ8Jj4pTKrcjanm3D8dChnqEL9d7jV5rq3NW7Z60oajSkgXZAcEtwDn7-PJMU6a9_UOAo8UiiyZ8L4GogQF4UWk_-Vlyi8Q447m99c-S3nr2fWKYhvhV9-SsmuV-ccLSbm0hBFVVM Sep 08 11:28:58.256099 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 11:28:58.256099 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 11:28:58.256099 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 11:28:58.256099 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 11:28:58.256099 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 11:28:58.256099 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 11:28:58.256099 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 747bb5860ba14a20bba3b1c2197ea75d Sep 08 11:28:58.256099 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-TestVolumeBootPattern-1812135790 Sep 08 11:28:58.256099 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 11:28:58.256099 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 11:28:58.256099 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/747bb5860ba14a20bba3b1c2197ea75d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/747bb5860ba14a20bba3b1c2197ea75d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_747bb5860ba14a20bba3b1c2197ea75d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/747bb5860ba14a20bba3b1c2197ea75d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:28:58.256099 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-TestVolumeBootPattern-1812135790 Sep 08 11:28:58.256099 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 747bb5860ba14a20bba3b1c2197ea75d Sep 08 11:28:58.256099 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-TestVolumeBootPattern-1812135790 Sep 08 11:28:58.256099 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-TestVolumeBootPattern-1812135790-project Sep 08 11:28:58.256099 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 11:28:58.256099 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 11:28:58.256099 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: bc18639e461e4ef5bfcf4380c561f329 Sep 08 11:28:58.256099 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-TestVolumeBootPattern-1812135790-project Sep 08 11:28:58.256099 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 11:28:58.256099 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance cd4021f3-ff9e-47c7-9a1c-0578b5fd79db could not be found. Sep 08 11:28:58.256099 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'cd4021f3-ff9e-47c7-9a1c-0578b5fd79db'} Sep 08 11:28:58.256099 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:28:58.256099 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:28:58.256099 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:28:58.256099 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:28:58.256099 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:28:58.256099 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:28:58.256099 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:28:58.256099 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:28:58.256099 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:28:58.256099 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:28:58.256099 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd4021f3-ff9e-47c7-9a1c-0578b5fd79db could not be found. Sep 08 11:28:58.256099 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:28:58.256099 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:28:58.256099 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:28:58.256099 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:28:58.256099 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:28:58.256099 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:28:58.256099 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:28:58.256099 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:28:58.256099 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:28:58.256099 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:28:58.256099 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 11:28:58.256099 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 11:28:58.256099 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 11:28:58.256099 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 11:28:58.256099 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:28:58.256099 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:28:58.256099 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:28:58.256099 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:28:58.260251 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd4021f3-ff9e-47c7-9a1c-0578b5fd79db could not be found. Sep 08 11:28:58.260251 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:28:58.260251 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:28:58.260251 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:28:58.260251 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:28:58.260251 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:28:58.260251 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:28:58.260251 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:28:58.260251 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:28:58.260251 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd4021f3-ff9e-47c7-9a1c-0578b5fd79db could not be found. Sep 08 11:28:58.260251 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:28:58.260251 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-999760c4-5839-4a3f-9930-f0e380feba2a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Returning 404 to user: Instance cd4021f3-ff9e-47c7-9a1c-0578b5fd79db could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:28:58.260251 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-999760c4-5839-4a3f-9930-f0e380feba2a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "DELETE /compute/v2.1/servers/cd4021f3-ff9e-47c7-9a1c-0578b5fd79db" status: 404 len: 111 microversion: 2.1 time: 0.031590 Sep 08 11:28:58.260251 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3259/6651] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:28:58 2022] DELETE /compute/v2.1/servers/cd4021f3-ff9e-47c7-9a1c-0578b5fd79db => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:28:58.266751 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b4bbf171-38f3-404f-ac2f-4ac4cac73dab tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:28:58.267379 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b4bbf171-38f3-404f-ac2f-4ac4cac73dab tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: cd4021f3-ff9e-47c7-9a1c-0578b5fd79db] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:28:58.273470 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b4bbf171-38f3-404f-ac2f-4ac4cac73dab tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:58.273960 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b4bbf171-38f3-404f-ac2f-4ac4cac73dab tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:58.274402 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b4bbf171-38f3-404f-ac2f-4ac4cac73dab tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:58.275104 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b4bbf171-38f3-404f-ac2f-4ac4cac73dab tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:58.275569 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b4bbf171-38f3-404f-ac2f-4ac4cac73dab tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:58.276025 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b4bbf171-38f3-404f-ac2f-4ac4cac73dab tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:58.289978 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-b4bbf171-38f3-404f-ac2f-4ac4cac73dab tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] HTTP exception thrown: Instance cd4021f3-ff9e-47c7-9a1c-0578b5fd79db could not be found. Sep 08 11:28:58.291631 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b4bbf171-38f3-404f-ac2f-4ac4cac73dab tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Request method failure captured: Sep 08 11:28:58.291631 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/cd4021f3-ff9e-47c7-9a1c-0578b5fd79db HTTP/1.1 Sep 08 11:28:58.291631 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:28:58.291631 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:28:58.291631 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:28:58.291631 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 11:28:58.291631 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:28:58.291631 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:28:58.291631 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:28:58.291631 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:28:58.291631 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGdEih_jYhjrfzcEat7QOG_17jH52nIZFToedVJMJ8Jj4pTKrcjanm3D8dChnqEL9d7jV5rq3NW7Z60oajSkgXZAcEtwDn7-PJMU6a9_UOAo8UiiyZ8L4GogQF4UWk_-Vlyi8Q447m99c-S3nr2fWKYhvhV9-SsmuV-ccLSbm0hBFVVM Sep 08 11:28:58.291631 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:28:58.291631 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:28:58.291631 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:28:58.291631 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:28:58.291631 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:28:58.291631 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:28:58.291631 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 747bb5860ba14a20bba3b1c2197ea75d Sep 08 11:28:58.291631 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-TestVolumeBootPattern-1812135790 Sep 08 11:28:58.291631 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:28:58.291631 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:28:58.291631 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/747bb5860ba14a20bba3b1c2197ea75d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/747bb5860ba14a20bba3b1c2197ea75d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_747bb5860ba14a20bba3b1c2197ea75d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/747bb5860ba14a20bba3b1c2197ea75d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:28:58.291631 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-TestVolumeBootPattern-1812135790 Sep 08 11:28:58.291631 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 747bb5860ba14a20bba3b1c2197ea75d Sep 08 11:28:58.291631 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-TestVolumeBootPattern-1812135790 Sep 08 11:28:58.291631 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-TestVolumeBootPattern-1812135790-project Sep 08 11:28:58.291631 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:28:58.291631 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:28:58.291631 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: bc18639e461e4ef5bfcf4380c561f329 Sep 08 11:28:58.291631 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-TestVolumeBootPattern-1812135790-project Sep 08 11:28:58.291631 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 11:28:58.291631 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance cd4021f3-ff9e-47c7-9a1c-0578b5fd79db could not be found. Sep 08 11:28:58.291631 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': 'cd4021f3-ff9e-47c7-9a1c-0578b5fd79db'} Sep 08 11:28:58.291631 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:28:58.291631 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:28:58.291631 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:28:58.291631 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:28:58.291631 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:28:58.291631 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:28:58.291631 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:28:58.291631 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:28:58.291631 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:28:58.291631 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:28:58.291631 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd4021f3-ff9e-47c7-9a1c-0578b5fd79db could not be found. Sep 08 11:28:58.291631 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:28:58.291631 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:28:58.291631 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:28:58.291631 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:28:58.291631 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:28:58.291631 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:28:58.291631 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:28:58.291631 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:28:58.291631 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:28:58.291631 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:28:58.291631 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:28:58.291631 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:28:58.291631 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:28:58.291631 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:28:58.291631 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:28:58.291631 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:28:58.291631 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd4021f3-ff9e-47c7-9a1c-0578b5fd79db could not be found. Sep 08 11:28:58.291631 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:28:58.291631 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:28:58.291631 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:28:58.298770 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:28:58.298770 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:28:58.298770 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:28:58.298770 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:28:58.298770 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:28:58.298770 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd4021f3-ff9e-47c7-9a1c-0578b5fd79db could not be found. Sep 08 11:28:58.298770 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:28:58.298770 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b4bbf171-38f3-404f-ac2f-4ac4cac73dab tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Returning 404 to user: Instance cd4021f3-ff9e-47c7-9a1c-0578b5fd79db could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:28:58.298770 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b4bbf171-38f3-404f-ac2f-4ac4cac73dab tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/cd4021f3-ff9e-47c7-9a1c-0578b5fd79db" status: 404 len: 111 microversion: 2.1 time: 0.030447 Sep 08 11:28:58.298770 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3393/6652] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:28:58 2022] GET /compute/v2.1/servers/cd4021f3-ff9e-47c7-9a1c-0578b5fd79db => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:28:58.371817 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7530d82e-d950-4f67-9d14-b3c074245bf7 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Action: 'create', calling method: .version_select at 0x7f68df71f9d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1515082793", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO6doCB5jxdM8yTKBua0LO00uQQhbDlCloGrvQcunnZeK/cGkdu+vlb3fv0/lRQO8ltEuhtMyobqDI7yYh9Z7WHpv/8VJnW4BFv7nkiAeodUKx/1mxLUff+wgqByiOOjOA=="}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:28:58.388168 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-7530d82e-d950-4f67-9d14-b3c074245bf7 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Getting quotas for project 747bb5860ba14a20bba3b1c2197ea75d. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:28:58.393458 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-7530d82e-d950-4f67-9d14-b3c074245bf7 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Getting quotas for user bc18639e461e4ef5bfcf4380c561f329 and project 747bb5860ba14a20bba3b1c2197ea75d. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:28:58.419604 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7530d82e-d950-4f67-9d14-b3c074245bf7 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.051716 Sep 08 11:28:58.420208 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3260/6653] 10.222.0.27 () {60 vars in 1159 bytes} [Thu Sep 8 11:28:58 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:29:14.653927 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-452158e2-ad3a-4b85-85d0-039693f2b69f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1936348970", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1515082793", "security_groups": [{"name": "tempest-secgroup-smoke-389085655"}], "block_device_mapping_v2": [{"uuid": "641e3535-e5b7-4869-9df5-b2270b0be460", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6c224653-dc3b-48b8-9084-30761e623f71"}]}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:29:14.664836 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:29:14.665745 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:29:14.779801 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-452158e2-ad3a-4b85-85d0-039693f2b69f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] validate_networks() for [('6c224653-dc3b-48b8-9084-30761e623f71', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:29:15.156495 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-452158e2-ad3a-4b85-85d0-039693f2b69f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:29:15.156919 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-452158e2-ad3a-4b85-85d0-039693f2b69f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:29:15.157437 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-452158e2-ad3a-4b85-85d0-039693f2b69f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:29:15.157851 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-452158e2-ad3a-4b85-85d0-039693f2b69f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:29:15.158321 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-452158e2-ad3a-4b85-85d0-039693f2b69f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:29:15.167185 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-452158e2-ad3a-4b85-85d0-039693f2b69f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:15.167737 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-452158e2-ad3a-4b85-85d0-039693f2b69f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:15.168183 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-452158e2-ad3a-4b85-85d0-039693f2b69f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:15.168908 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-452158e2-ad3a-4b85-85d0-039693f2b69f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:15.169390 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-452158e2-ad3a-4b85-85d0-039693f2b69f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:15.169818 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-452158e2-ad3a-4b85-85d0-039693f2b69f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:15.187018 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-452158e2-ad3a-4b85-85d0-039693f2b69f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Getting quotas for project 747bb5860ba14a20bba3b1c2197ea75d. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:29:15.192196 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-452158e2-ad3a-4b85-85d0-039693f2b69f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Getting quotas for user bc18639e461e4ef5bfcf4380c561f329 and project 747bb5860ba14a20bba3b1c2197ea75d. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:29:15.250210 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-452158e2-ad3a-4b85-85d0-039693f2b69f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:29:15.252375 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-452158e2-ad3a-4b85-85d0-039693f2b69f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 523b814d-0826-4b99-8a04-f3641f013caa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='641e3535-e5b7-4869-9df5-b2270b0be460',volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:29:15.377248 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-452158e2-ad3a-4b85-85d0-039693f2b69f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.727264 Sep 08 11:29:15.377903 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3394/6654] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 11:29:14 2022] POST /compute/v2.1/servers => generated 405 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:29:15.387312 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=23 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:29:15.388088 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=4 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:29:15.388735 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=22,nova_api:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:29:15.393301 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ee1c0137-a01a-48f5-a1c1-e00cf835aa24 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:29:15.393930 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ee1c0137-a01a-48f5-a1c1-e00cf835aa24 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 523b814d-0826-4b99-8a04-f3641f013caa] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:29:15.451226 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ee1c0137-a01a-48f5-a1c1-e00cf835aa24 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:29:15.458825 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ee1c0137-a01a-48f5-a1c1-e00cf835aa24 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/523b814d-0826-4b99-8a04-f3641f013caa" status: 200 len: 1095 microversion: 2.1 time: 0.073585 Sep 08 11:29:15.459740 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3261/6655] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:29:15 2022] GET /compute/v2.1/servers/523b814d-0826-4b99-8a04-f3641f013caa => generated 1095 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:29:16.484700 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-25bb4538-7c09-4da0-bce5-a04f467f673d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:29:16.485382 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-25bb4538-7c09-4da0-bce5-a04f467f673d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 523b814d-0826-4b99-8a04-f3641f013caa] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:29:16.492512 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-25bb4538-7c09-4da0-bce5-a04f467f673d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:16.493018 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-25bb4538-7c09-4da0-bce5-a04f467f673d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:16.493482 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-25bb4538-7c09-4da0-bce5-a04f467f673d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:16.494192 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-25bb4538-7c09-4da0-bce5-a04f467f673d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:16.494651 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-25bb4538-7c09-4da0-bce5-a04f467f673d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:16.495205 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-25bb4538-7c09-4da0-bce5-a04f467f673d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:16.569787 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-25bb4538-7c09-4da0-bce5-a04f467f673d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:29:16.579293 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-25bb4538-7c09-4da0-bce5-a04f467f673d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/523b814d-0826-4b99-8a04-f3641f013caa" status: 200 len: 1211 microversion: 2.1 time: 0.100148 Sep 08 11:29:16.580098 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3395/6656] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:29:16 2022] GET /compute/v2.1/servers/523b814d-0826-4b99-8a04-f3641f013caa => generated 1211 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:29:17.602875 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a841c76f-2d7e-4b33-807c-822965ad4a91 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:29:17.604116 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a841c76f-2d7e-4b33-807c-822965ad4a91 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 523b814d-0826-4b99-8a04-f3641f013caa] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:29:17.611168 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a841c76f-2d7e-4b33-807c-822965ad4a91 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:17.611678 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a841c76f-2d7e-4b33-807c-822965ad4a91 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:17.612134 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a841c76f-2d7e-4b33-807c-822965ad4a91 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:17.612879 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a841c76f-2d7e-4b33-807c-822965ad4a91 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:17.613364 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a841c76f-2d7e-4b33-807c-822965ad4a91 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:17.613935 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a841c76f-2d7e-4b33-807c-822965ad4a91 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:17.813018 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a841c76f-2d7e-4b33-807c-822965ad4a91 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:29:17.821406 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a841c76f-2d7e-4b33-807c-822965ad4a91 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/523b814d-0826-4b99-8a04-f3641f013caa" status: 200 len: 1278 microversion: 2.1 time: 0.222294 Sep 08 11:29:17.821908 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3262/6657] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:29:17 2022] GET /compute/v2.1/servers/523b814d-0826-4b99-8a04-f3641f013caa => generated 1278 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:29:17.980209 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-3faa3800-85a1-49c5-b104-930e99ed4613 req-44410dd9-bb8d-4321-b3ae-0711948cdc64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "523b814d-0826-4b99-8a04-f3641f013caa", "tag": "14fe01b2-755f-4e02-8d2b-da75b0cbd360"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:29:17.991635 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-3faa3800-85a1-49c5-b104-930e99ed4613 req-44410dd9-bb8d-4321-b3ae-0711948cdc64 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:17.992411 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-3faa3800-85a1-49c5-b104-930e99ed4613 req-44410dd9-bb8d-4321-b3ae-0711948cdc64 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:17.992853 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-3faa3800-85a1-49c5-b104-930e99ed4613 req-44410dd9-bb8d-4321-b3ae-0711948cdc64 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:18.007360 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-3faa3800-85a1-49c5-b104-930e99ed4613 req-44410dd9-bb8d-4321-b3ae-0711948cdc64 service nova] Creating event network-changed:14fe01b2-755f-4e02-8d2b-da75b0cbd360 for instance 523b814d-0826-4b99-8a04-f3641f013caa on n-h1-850501-12 Sep 08 11:29:18.013640 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-3faa3800-85a1-49c5-b104-930e99ed4613 req-44410dd9-bb8d-4321-b3ae-0711948cdc64 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126456 Sep 08 11:29:18.014686 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3396/6658] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:29:18.845261 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4b1e83f3-3215-4e90-9710-5625d112eccc tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:29:18.846369 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4b1e83f3-3215-4e90-9710-5625d112eccc tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 523b814d-0826-4b99-8a04-f3641f013caa] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:29:18.854464 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4b1e83f3-3215-4e90-9710-5625d112eccc tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:18.855170 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4b1e83f3-3215-4e90-9710-5625d112eccc tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:18.855621 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4b1e83f3-3215-4e90-9710-5625d112eccc tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:18.856378 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4b1e83f3-3215-4e90-9710-5625d112eccc tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:18.856820 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4b1e83f3-3215-4e90-9710-5625d112eccc tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:18.857287 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4b1e83f3-3215-4e90-9710-5625d112eccc tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:19.241796 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4b1e83f3-3215-4e90-9710-5625d112eccc tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:29:19.250771 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4b1e83f3-3215-4e90-9710-5625d112eccc tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/523b814d-0826-4b99-8a04-f3641f013caa" status: 200 len: 1278 microversion: 2.1 time: 0.410241 Sep 08 11:29:19.251609 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3263/6659] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:29:18 2022] GET /compute/v2.1/servers/523b814d-0826-4b99-8a04-f3641f013caa => generated 1278 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:29:20.275516 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-099beff5-046c-49a2-b8df-99cd982dc908 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:29:20.276229 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-099beff5-046c-49a2-b8df-99cd982dc908 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 523b814d-0826-4b99-8a04-f3641f013caa] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:29:20.284204 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-099beff5-046c-49a2-b8df-99cd982dc908 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:20.284702 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-099beff5-046c-49a2-b8df-99cd982dc908 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:20.285185 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-099beff5-046c-49a2-b8df-99cd982dc908 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:20.285904 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-099beff5-046c-49a2-b8df-99cd982dc908 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:20.286367 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-099beff5-046c-49a2-b8df-99cd982dc908 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:20.286797 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-099beff5-046c-49a2-b8df-99cd982dc908 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:20.431125 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-099beff5-046c-49a2-b8df-99cd982dc908 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:29:20.439582 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-099beff5-046c-49a2-b8df-99cd982dc908 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/523b814d-0826-4b99-8a04-f3641f013caa" status: 200 len: 1278 microversion: 2.1 time: 0.168341 Sep 08 11:29:20.440172 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3397/6660] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:29:20 2022] GET /compute/v2.1/servers/523b814d-0826-4b99-8a04-f3641f013caa => generated 1278 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:29:21.462418 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bb7e9211-e960-4e62-8714-26b06c7826e3 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:29:21.463333 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bb7e9211-e960-4e62-8714-26b06c7826e3 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 523b814d-0826-4b99-8a04-f3641f013caa] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:29:21.470390 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb7e9211-e960-4e62-8714-26b06c7826e3 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:21.470901 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb7e9211-e960-4e62-8714-26b06c7826e3 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:21.471609 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb7e9211-e960-4e62-8714-26b06c7826e3 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:21.472327 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb7e9211-e960-4e62-8714-26b06c7826e3 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:21.472822 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb7e9211-e960-4e62-8714-26b06c7826e3 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:21.473423 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb7e9211-e960-4e62-8714-26b06c7826e3 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:21.613404 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bb7e9211-e960-4e62-8714-26b06c7826e3 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:29:21.621111 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bb7e9211-e960-4e62-8714-26b06c7826e3 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/523b814d-0826-4b99-8a04-f3641f013caa" status: 200 len: 1278 microversion: 2.1 time: 0.162603 Sep 08 11:29:21.621689 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3264/6661] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:29:21 2022] GET /compute/v2.1/servers/523b814d-0826-4b99-8a04-f3641f013caa => generated 1278 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:29:22.644449 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-abd4565b-a249-4486-a1c8-09bf254c5609 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:29:22.645097 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-abd4565b-a249-4486-a1c8-09bf254c5609 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 523b814d-0826-4b99-8a04-f3641f013caa] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:29:22.652114 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-abd4565b-a249-4486-a1c8-09bf254c5609 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:22.652613 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-abd4565b-a249-4486-a1c8-09bf254c5609 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:22.653083 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-abd4565b-a249-4486-a1c8-09bf254c5609 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:22.653788 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-abd4565b-a249-4486-a1c8-09bf254c5609 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:22.654250 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-abd4565b-a249-4486-a1c8-09bf254c5609 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:22.654682 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-abd4565b-a249-4486-a1c8-09bf254c5609 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:22.787944 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-abd4565b-a249-4486-a1c8-09bf254c5609 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:29:22.795820 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-abd4565b-a249-4486-a1c8-09bf254c5609 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/523b814d-0826-4b99-8a04-f3641f013caa" status: 200 len: 1266 microversion: 2.1 time: 0.155977 Sep 08 11:29:22.797057 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3398/6662] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:29:22 2022] GET /compute/v2.1/servers/523b814d-0826-4b99-8a04-f3641f013caa => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:29:23.819285 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-416b062d-30ce-46d8-b2d5-6691f2ff4a4c tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:29:23.819917 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-416b062d-30ce-46d8-b2d5-6691f2ff4a4c tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 523b814d-0826-4b99-8a04-f3641f013caa] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:29:23.827100 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-416b062d-30ce-46d8-b2d5-6691f2ff4a4c tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:23.827864 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-416b062d-30ce-46d8-b2d5-6691f2ff4a4c tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:23.828321 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-416b062d-30ce-46d8-b2d5-6691f2ff4a4c tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:23.829060 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-416b062d-30ce-46d8-b2d5-6691f2ff4a4c tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:23.829543 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-416b062d-30ce-46d8-b2d5-6691f2ff4a4c tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:23.829975 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-416b062d-30ce-46d8-b2d5-6691f2ff4a4c tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:23.978943 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-416b062d-30ce-46d8-b2d5-6691f2ff4a4c tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:29:23.987129 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-416b062d-30ce-46d8-b2d5-6691f2ff4a4c tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/523b814d-0826-4b99-8a04-f3641f013caa" status: 200 len: 1266 microversion: 2.1 time: 0.171755 Sep 08 11:29:23.987736 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3265/6663] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:29:23 2022] GET /compute/v2.1/servers/523b814d-0826-4b99-8a04-f3641f013caa => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:29:25.010430 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0bda68c0-93aa-4087-ad70-d411e6053b4b tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:29:25.011071 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0bda68c0-93aa-4087-ad70-d411e6053b4b tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 523b814d-0826-4b99-8a04-f3641f013caa] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:29:25.018090 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0bda68c0-93aa-4087-ad70-d411e6053b4b tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:25.018583 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0bda68c0-93aa-4087-ad70-d411e6053b4b tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:25.019032 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0bda68c0-93aa-4087-ad70-d411e6053b4b tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:25.019735 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0bda68c0-93aa-4087-ad70-d411e6053b4b tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:25.020203 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0bda68c0-93aa-4087-ad70-d411e6053b4b tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:25.020636 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0bda68c0-93aa-4087-ad70-d411e6053b4b tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:25.162993 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0bda68c0-93aa-4087-ad70-d411e6053b4b tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:29:25.170967 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0bda68c0-93aa-4087-ad70-d411e6053b4b tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/523b814d-0826-4b99-8a04-f3641f013caa" status: 200 len: 1266 microversion: 2.1 time: 0.164485 Sep 08 11:29:25.172104 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3399/6664] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:29:25 2022] GET /compute/v2.1/servers/523b814d-0826-4b99-8a04-f3641f013caa => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:29:26.195304 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8030bbc8-dbd2-41bc-a6b7-1800c440b98e tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:29:26.195929 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8030bbc8-dbd2-41bc-a6b7-1800c440b98e tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 523b814d-0826-4b99-8a04-f3641f013caa] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:29:26.198676 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:29:26.204239 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8030bbc8-dbd2-41bc-a6b7-1800c440b98e tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:26.204750 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8030bbc8-dbd2-41bc-a6b7-1800c440b98e tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:26.205241 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8030bbc8-dbd2-41bc-a6b7-1800c440b98e tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:26.205956 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8030bbc8-dbd2-41bc-a6b7-1800c440b98e tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:26.206427 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8030bbc8-dbd2-41bc-a6b7-1800c440b98e tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:26.206866 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8030bbc8-dbd2-41bc-a6b7-1800c440b98e tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:26.337637 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8030bbc8-dbd2-41bc-a6b7-1800c440b98e tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:29:26.346032 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8030bbc8-dbd2-41bc-a6b7-1800c440b98e tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/523b814d-0826-4b99-8a04-f3641f013caa" status: 200 len: 1266 microversion: 2.1 time: 0.154659 Sep 08 11:29:26.346887 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3266/6665] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:29:26 2022] GET /compute/v2.1/servers/523b814d-0826-4b99-8a04-f3641f013caa => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:29:27.369446 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2b969212-f93e-4197-a576-a3036228958f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:29:27.370259 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2b969212-f93e-4197-a576-a3036228958f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 523b814d-0826-4b99-8a04-f3641f013caa] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:29:27.372458 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:29:27.373153 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=6 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:29:27.383809 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2b969212-f93e-4197-a576-a3036228958f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:27.384347 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2b969212-f93e-4197-a576-a3036228958f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:27.384789 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2b969212-f93e-4197-a576-a3036228958f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:27.385542 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2b969212-f93e-4197-a576-a3036228958f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:27.386009 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2b969212-f93e-4197-a576-a3036228958f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:27.386442 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2b969212-f93e-4197-a576-a3036228958f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:27.529659 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2b969212-f93e-4197-a576-a3036228958f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:29:27.538437 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2b969212-f93e-4197-a576-a3036228958f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/523b814d-0826-4b99-8a04-f3641f013caa" status: 200 len: 1266 microversion: 2.1 time: 0.173195 Sep 08 11:29:27.539022 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3400/6666] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:29:27 2022] GET /compute/v2.1/servers/523b814d-0826-4b99-8a04-f3641f013caa => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:29:28.562735 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1a06d936-695d-43ae-9d67-a11e9a417c16 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:29:28.563455 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1a06d936-695d-43ae-9d67-a11e9a417c16 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 523b814d-0826-4b99-8a04-f3641f013caa] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:29:28.570389 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1a06d936-695d-43ae-9d67-a11e9a417c16 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:28.570887 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1a06d936-695d-43ae-9d67-a11e9a417c16 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:28.571344 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1a06d936-695d-43ae-9d67-a11e9a417c16 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:28.572083 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1a06d936-695d-43ae-9d67-a11e9a417c16 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:28.572553 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1a06d936-695d-43ae-9d67-a11e9a417c16 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:28.572992 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1a06d936-695d-43ae-9d67-a11e9a417c16 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:28.711158 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1a06d936-695d-43ae-9d67-a11e9a417c16 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:29:28.718925 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1a06d936-695d-43ae-9d67-a11e9a417c16 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/523b814d-0826-4b99-8a04-f3641f013caa" status: 200 len: 1266 microversion: 2.1 time: 0.160866 Sep 08 11:29:28.719676 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3267/6667] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:29:28 2022] GET /compute/v2.1/servers/523b814d-0826-4b99-8a04-f3641f013caa => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:29:29.742809 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5c70e7e0-019c-463e-bbb1-308c03955d12 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:29:29.743570 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5c70e7e0-019c-463e-bbb1-308c03955d12 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 523b814d-0826-4b99-8a04-f3641f013caa] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:29:29.751392 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5c70e7e0-019c-463e-bbb1-308c03955d12 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:29.751896 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5c70e7e0-019c-463e-bbb1-308c03955d12 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:29.752342 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5c70e7e0-019c-463e-bbb1-308c03955d12 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:29.753088 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5c70e7e0-019c-463e-bbb1-308c03955d12 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:29.753560 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5c70e7e0-019c-463e-bbb1-308c03955d12 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:29.754021 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5c70e7e0-019c-463e-bbb1-308c03955d12 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:29.893059 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5c70e7e0-019c-463e-bbb1-308c03955d12 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:29:29.901130 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5c70e7e0-019c-463e-bbb1-308c03955d12 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/523b814d-0826-4b99-8a04-f3641f013caa" status: 200 len: 1266 microversion: 2.1 time: 0.162367 Sep 08 11:29:29.901710 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3401/6668] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:29:29 2022] GET /compute/v2.1/servers/523b814d-0826-4b99-8a04-f3641f013caa => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:29:30.028562 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-c319aa51-c0f3-4c3f-8857-f86c7c734efa req-f0a7f000-7acb-4157-a41e-343a553a8243 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "523b814d-0826-4b99-8a04-f3641f013caa", "name": "network-vif-plugged", "status": "completed", "tag": "14fe01b2-755f-4e02-8d2b-da75b0cbd360"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:29:30.038097 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c319aa51-c0f3-4c3f-8857-f86c7c734efa req-f0a7f000-7acb-4157-a41e-343a553a8243 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:30.038597 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c319aa51-c0f3-4c3f-8857-f86c7c734efa req-f0a7f000-7acb-4157-a41e-343a553a8243 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:30.039043 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c319aa51-c0f3-4c3f-8857-f86c7c734efa req-f0a7f000-7acb-4157-a41e-343a553a8243 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:30.050488 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-c319aa51-c0f3-4c3f-8857-f86c7c734efa req-f0a7f000-7acb-4157-a41e-343a553a8243 service nova] Creating event network-vif-plugged:14fe01b2-755f-4e02-8d2b-da75b0cbd360 for instance 523b814d-0826-4b99-8a04-f3641f013caa on n-h1-850501-12 Sep 08 11:29:30.055505 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-c319aa51-c0f3-4c3f-8857-f86c7c734efa req-f0a7f000-7acb-4157-a41e-343a553a8243 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102611 Sep 08 11:29:30.056111 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3268/6669] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:29:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:29:30.924112 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d6d3de47-ef06-4d21-938e-412e24542da5 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:29:30.924794 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d6d3de47-ef06-4d21-938e-412e24542da5 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 523b814d-0826-4b99-8a04-f3641f013caa] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:29:30.931919 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d6d3de47-ef06-4d21-938e-412e24542da5 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:30.932420 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d6d3de47-ef06-4d21-938e-412e24542da5 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:30.932863 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d6d3de47-ef06-4d21-938e-412e24542da5 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:30.933614 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d6d3de47-ef06-4d21-938e-412e24542da5 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:30.934116 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d6d3de47-ef06-4d21-938e-412e24542da5 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:30.934548 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d6d3de47-ef06-4d21-938e-412e24542da5 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:31.102277 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d6d3de47-ef06-4d21-938e-412e24542da5 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:29:31.111188 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d6d3de47-ef06-4d21-938e-412e24542da5 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/523b814d-0826-4b99-8a04-f3641f013caa" status: 200 len: 1266 microversion: 2.1 time: 0.191199 Sep 08 11:29:31.111772 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3402/6670] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:29:30 2022] GET /compute/v2.1/servers/523b814d-0826-4b99-8a04-f3641f013caa => generated 1266 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:29:32.138297 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d643c3fd-2f59-4932-8d92-78465690c120 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:29:32.138931 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d643c3fd-2f59-4932-8d92-78465690c120 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 523b814d-0826-4b99-8a04-f3641f013caa] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:29:32.146158 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d643c3fd-2f59-4932-8d92-78465690c120 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:32.146670 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d643c3fd-2f59-4932-8d92-78465690c120 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:32.147126 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d643c3fd-2f59-4932-8d92-78465690c120 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:32.147851 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d643c3fd-2f59-4932-8d92-78465690c120 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:32.148331 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d643c3fd-2f59-4932-8d92-78465690c120 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:32.148775 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d643c3fd-2f59-4932-8d92-78465690c120 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:32.282634 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d643c3fd-2f59-4932-8d92-78465690c120 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:29:32.290503 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d643c3fd-2f59-4932-8d92-78465690c120 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/523b814d-0826-4b99-8a04-f3641f013caa" status: 200 len: 1452 microversion: 2.1 time: 0.159288 Sep 08 11:29:32.291078 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3269/6671] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:29:32 2022] GET /compute/v2.1/servers/523b814d-0826-4b99-8a04-f3641f013caa => generated 1452 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:29:32.313388 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-567d7539-44b2-4dde-bbf8-a4ee22f5e521 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:29:32.313999 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-567d7539-44b2-4dde-bbf8-a4ee22f5e521 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 523b814d-0826-4b99-8a04-f3641f013caa] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:29:32.320752 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-567d7539-44b2-4dde-bbf8-a4ee22f5e521 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:32.321276 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-567d7539-44b2-4dde-bbf8-a4ee22f5e521 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:32.321714 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-567d7539-44b2-4dde-bbf8-a4ee22f5e521 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:32.322407 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-567d7539-44b2-4dde-bbf8-a4ee22f5e521 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:32.322865 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-567d7539-44b2-4dde-bbf8-a4ee22f5e521 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:32.323291 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-567d7539-44b2-4dde-bbf8-a4ee22f5e521 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:32.455821 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-567d7539-44b2-4dde-bbf8-a4ee22f5e521 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:29:32.463834 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-567d7539-44b2-4dde-bbf8-a4ee22f5e521 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/523b814d-0826-4b99-8a04-f3641f013caa" status: 200 len: 1452 microversion: 2.1 time: 0.154995 Sep 08 11:29:32.464422 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3403/6672] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:29:32 2022] GET /compute/v2.1/servers/523b814d-0826-4b99-8a04-f3641f013caa => generated 1452 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:29:34.087274 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-f2100e24-ed01-4a4a-998d-8eb58076532a req-a0809467-7fb9-441d-af10-7f84de87d8e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "523b814d-0826-4b99-8a04-f3641f013caa", "tag": "14fe01b2-755f-4e02-8d2b-da75b0cbd360"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:29:34.098144 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-f2100e24-ed01-4a4a-998d-8eb58076532a req-a0809467-7fb9-441d-af10-7f84de87d8e4 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:34.098726 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-f2100e24-ed01-4a4a-998d-8eb58076532a req-a0809467-7fb9-441d-af10-7f84de87d8e4 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:34.099083 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-f2100e24-ed01-4a4a-998d-8eb58076532a req-a0809467-7fb9-441d-af10-7f84de87d8e4 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:34.111044 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-f2100e24-ed01-4a4a-998d-8eb58076532a req-a0809467-7fb9-441d-af10-7f84de87d8e4 service nova] Creating event network-changed:14fe01b2-755f-4e02-8d2b-da75b0cbd360 for instance 523b814d-0826-4b99-8a04-f3641f013caa on n-h1-850501-12 Sep 08 11:29:34.116231 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-f2100e24-ed01-4a4a-998d-8eb58076532a req-a0809467-7fb9-441d-af10-7f84de87d8e4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032765 Sep 08 11:29:34.116841 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3270/6673] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:29:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:31:26.308961 n-d-850501-12 devstack@n-api.service[128861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 08 11:31:26.309665 n-d-850501-12 devstack@n-api.service[128861]: Thu Sep 8 11:31:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/523b814d-0826-4b99-8a04-f3641f013caa (ip 10.222.0.27) !!! Sep 08 11:31:26.310376 n-d-850501-12 devstack@n-api.service[128861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 08 11:31:26.310518 n-d-850501-12 devstack@n-api.service[128861]: Thu Sep 8 11:31:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/523b814d-0826-4b99-8a04-f3641f013caa (ip 10.222.0.27) !!! Sep 08 11:31:26.311542 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:31:26.312295 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=52 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:31:26.374365 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7f3ff008-98f6-458e-a95a-bf0a325ea989 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:31:26.374873 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7f3ff008-98f6-458e-a95a-bf0a325ea989 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 523b814d-0826-4b99-8a04-f3641f013caa] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:31:26.380862 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7f3ff008-98f6-458e-a95a-bf0a325ea989 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:26.381390 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7f3ff008-98f6-458e-a95a-bf0a325ea989 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:26.381838 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7f3ff008-98f6-458e-a95a-bf0a325ea989 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:26.382536 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7f3ff008-98f6-458e-a95a-bf0a325ea989 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:26.382999 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7f3ff008-98f6-458e-a95a-bf0a325ea989 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:26.383929 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7f3ff008-98f6-458e-a95a-bf0a325ea989 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:26.410139 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7f3ff008-98f6-458e-a95a-bf0a325ea989 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 523b814d-0826-4b99-8a04-f3641f013caa] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:31:26.489937 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7f3ff008-98f6-458e-a95a-bf0a325ea989 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "DELETE /compute/v2.1/servers/523b814d-0826-4b99-8a04-f3641f013caa" status: 204 len: 0 microversion: 2.1 time: 0.183597 Sep 08 11:31:26.490546 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3404/6674] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:31:26 2022] DELETE /compute/v2.1/servers/523b814d-0826-4b99-8a04-f3641f013caa => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:31:26.498788 n-d-850501-12 devstack@n-api.service[128862]: ERROR oslo.messaging._drivers.impl_rabbit [-] [081d0b47-1bf7-423f-b545-ebb7179d143a] AMQP server on 10.222.0.27:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 08 11:31:26.499428 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=22 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:31:26.500249 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=46 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:31:26.501072 n-d-850501-12 devstack@n-api.service[128862]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 11:31:26.501300 n-d-850501-12 devstack@n-api.service[128862]: Thu Sep 8 11:31:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/523b814d-0826-4b99-8a04-f3641f013caa (ip 10.222.0.27) !!! Sep 08 11:31:26.507973 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7c7386af-fb55-42f1-b5ae-08cb892c51bc tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:31:26.509489 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7c7386af-fb55-42f1-b5ae-08cb892c51bc tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 523b814d-0826-4b99-8a04-f3641f013caa] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:31:26.520442 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c7386af-fb55-42f1-b5ae-08cb892c51bc tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:26.520955 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c7386af-fb55-42f1-b5ae-08cb892c51bc tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:26.521444 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c7386af-fb55-42f1-b5ae-08cb892c51bc tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:26.522206 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c7386af-fb55-42f1-b5ae-08cb892c51bc tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:26.522693 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c7386af-fb55-42f1-b5ae-08cb892c51bc tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:26.523137 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c7386af-fb55-42f1-b5ae-08cb892c51bc tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:26.669141 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7c7386af-fb55-42f1-b5ae-08cb892c51bc tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:31:26.677442 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7c7386af-fb55-42f1-b5ae-08cb892c51bc tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/523b814d-0826-4b99-8a04-f3641f013caa" status: 200 len: 1577 microversion: 2.1 time: 0.181492 Sep 08 11:31:26.678035 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3271/6675] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:31:26 2022] GET /compute/v2.1/servers/523b814d-0826-4b99-8a04-f3641f013caa => generated 1577 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:31:27.702111 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-65a898f1-e765-4593-9a1f-c10894214ae0 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:31:27.702850 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-65a898f1-e765-4593-9a1f-c10894214ae0 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 523b814d-0826-4b99-8a04-f3641f013caa] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:31:27.710245 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-65a898f1-e765-4593-9a1f-c10894214ae0 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:27.710744 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-65a898f1-e765-4593-9a1f-c10894214ae0 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:27.711221 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-65a898f1-e765-4593-9a1f-c10894214ae0 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:27.712155 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-65a898f1-e765-4593-9a1f-c10894214ae0 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:27.712616 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-65a898f1-e765-4593-9a1f-c10894214ae0 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:27.713079 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-65a898f1-e765-4593-9a1f-c10894214ae0 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:27.874684 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-65a898f1-e765-4593-9a1f-c10894214ae0 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:31:27.883296 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-65a898f1-e765-4593-9a1f-c10894214ae0 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/523b814d-0826-4b99-8a04-f3641f013caa" status: 200 len: 1577 microversion: 2.1 time: 0.185500 Sep 08 11:31:27.884206 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3405/6676] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:31:27 2022] GET /compute/v2.1/servers/523b814d-0826-4b99-8a04-f3641f013caa => generated 1577 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:31:28.906963 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4a745d80-64d1-4a22-adb1-5d7382238317 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:31:28.907592 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4a745d80-64d1-4a22-adb1-5d7382238317 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 523b814d-0826-4b99-8a04-f3641f013caa] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:31:28.916526 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a745d80-64d1-4a22-adb1-5d7382238317 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:28.916998 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a745d80-64d1-4a22-adb1-5d7382238317 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:28.917672 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a745d80-64d1-4a22-adb1-5d7382238317 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:28.918427 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a745d80-64d1-4a22-adb1-5d7382238317 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:28.918858 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a745d80-64d1-4a22-adb1-5d7382238317 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:28.919300 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a745d80-64d1-4a22-adb1-5d7382238317 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:28.941566 n-d-850501-12 devstack@n-api.service[128862]: INFO oslo.messaging._drivers.impl_rabbit [-] [081d0b47-1bf7-423f-b545-ebb7179d143a] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 40042. Sep 08 11:31:29.019068 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4a745d80-64d1-4a22-adb1-5d7382238317 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:31:29.028503 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4a745d80-64d1-4a22-adb1-5d7382238317 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/523b814d-0826-4b99-8a04-f3641f013caa" status: 200 len: 1510 microversion: 2.1 time: 0.125336 Sep 08 11:31:29.041397 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3272/6677] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:31:28 2022] GET /compute/v2.1/servers/523b814d-0826-4b99-8a04-f3641f013caa => generated 1510 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:31:29.303446 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-3da1a168-1394-412f-9df9-75ff7115d550 req-bfe6bfac-4c5d-4214-8f50-2f78c8f7bfa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "523b814d-0826-4b99-8a04-f3641f013caa", "name": "network-vif-deleted", "tag": "14fe01b2-755f-4e02-8d2b-da75b0cbd360"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:31:29.319184 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-3da1a168-1394-412f-9df9-75ff7115d550 req-bfe6bfac-4c5d-4214-8f50-2f78c8f7bfa0 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:29.319703 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-3da1a168-1394-412f-9df9-75ff7115d550 req-bfe6bfac-4c5d-4214-8f50-2f78c8f7bfa0 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:29.320333 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-3da1a168-1394-412f-9df9-75ff7115d550 req-bfe6bfac-4c5d-4214-8f50-2f78c8f7bfa0 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:29.333862 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-3da1a168-1394-412f-9df9-75ff7115d550 req-bfe6bfac-4c5d-4214-8f50-2f78c8f7bfa0 service nova] Creating event network-vif-deleted:14fe01b2-755f-4e02-8d2b-da75b0cbd360 for instance 523b814d-0826-4b99-8a04-f3641f013caa on n-h1-850501-12 Sep 08 11:31:29.340301 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-3da1a168-1394-412f-9df9-75ff7115d550 req-bfe6bfac-4c5d-4214-8f50-2f78c8f7bfa0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040573 Sep 08 11:31:29.343983 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3406/6678] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:31:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:31:30.053326 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-13cf58c0-085d-4222-85e5-8e416113dd9a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:31:30.054562 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-13cf58c0-085d-4222-85e5-8e416113dd9a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 523b814d-0826-4b99-8a04-f3641f013caa] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:31:30.061350 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-13cf58c0-085d-4222-85e5-8e416113dd9a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:30.061869 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-13cf58c0-085d-4222-85e5-8e416113dd9a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:30.062313 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-13cf58c0-085d-4222-85e5-8e416113dd9a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:30.063039 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-13cf58c0-085d-4222-85e5-8e416113dd9a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:30.063505 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-13cf58c0-085d-4222-85e5-8e416113dd9a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:30.064132 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-13cf58c0-085d-4222-85e5-8e416113dd9a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:30.138159 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-13cf58c0-085d-4222-85e5-8e416113dd9a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:31:30.147480 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-13cf58c0-085d-4222-85e5-8e416113dd9a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/523b814d-0826-4b99-8a04-f3641f013caa" status: 200 len: 1226 microversion: 2.1 time: 0.098365 Sep 08 11:31:30.148720 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3273/6679] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:31:30 2022] GET /compute/v2.1/servers/523b814d-0826-4b99-8a04-f3641f013caa => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:31:31.173212 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f2872c4c-e621-4237-a141-6248728dbc59 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:31:31.173844 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f2872c4c-e621-4237-a141-6248728dbc59 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 523b814d-0826-4b99-8a04-f3641f013caa] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:31:31.180232 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f2872c4c-e621-4237-a141-6248728dbc59 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:31.180767 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f2872c4c-e621-4237-a141-6248728dbc59 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:31.181323 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f2872c4c-e621-4237-a141-6248728dbc59 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:31.182190 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f2872c4c-e621-4237-a141-6248728dbc59 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:31.183017 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f2872c4c-e621-4237-a141-6248728dbc59 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:31.183460 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f2872c4c-e621-4237-a141-6248728dbc59 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:31.253606 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f2872c4c-e621-4237-a141-6248728dbc59 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:31:31.261878 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f2872c4c-e621-4237-a141-6248728dbc59 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/523b814d-0826-4b99-8a04-f3641f013caa" status: 200 len: 1226 microversion: 2.1 time: 0.094193 Sep 08 11:31:31.262783 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3407/6680] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:31:31 2022] GET /compute/v2.1/servers/523b814d-0826-4b99-8a04-f3641f013caa => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:31:32.289321 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-eef93e36-9282-4f42-b644-b7c1c4fbccdf tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:31:32.289973 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-eef93e36-9282-4f42-b644-b7c1c4fbccdf tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 523b814d-0826-4b99-8a04-f3641f013caa] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:31:32.298369 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eef93e36-9282-4f42-b644-b7c1c4fbccdf tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:32.299013 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eef93e36-9282-4f42-b644-b7c1c4fbccdf tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:32.299504 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eef93e36-9282-4f42-b644-b7c1c4fbccdf tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:32.300251 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eef93e36-9282-4f42-b644-b7c1c4fbccdf tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:32.300717 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eef93e36-9282-4f42-b644-b7c1c4fbccdf tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:32.301192 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eef93e36-9282-4f42-b644-b7c1c4fbccdf tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:32.372190 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-eef93e36-9282-4f42-b644-b7c1c4fbccdf tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:31:32.380568 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-eef93e36-9282-4f42-b644-b7c1c4fbccdf tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/523b814d-0826-4b99-8a04-f3641f013caa" status: 200 len: 1226 microversion: 2.1 time: 0.095272 Sep 08 11:31:32.381184 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3274/6681] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:31:32 2022] GET /compute/v2.1/servers/523b814d-0826-4b99-8a04-f3641f013caa => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:31:33.404040 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-06d38b17-e36a-4a46-8e49-b4a29dc34c62 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:31:33.404752 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-06d38b17-e36a-4a46-8e49-b4a29dc34c62 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 523b814d-0826-4b99-8a04-f3641f013caa] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:31:33.411879 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06d38b17-e36a-4a46-8e49-b4a29dc34c62 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:33.412107 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06d38b17-e36a-4a46-8e49-b4a29dc34c62 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:33.412548 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06d38b17-e36a-4a46-8e49-b4a29dc34c62 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:33.413276 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06d38b17-e36a-4a46-8e49-b4a29dc34c62 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:33.413738 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06d38b17-e36a-4a46-8e49-b4a29dc34c62 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:33.414169 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06d38b17-e36a-4a46-8e49-b4a29dc34c62 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:33.482245 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-06d38b17-e36a-4a46-8e49-b4a29dc34c62 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:31:33.492183 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-06d38b17-e36a-4a46-8e49-b4a29dc34c62 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/523b814d-0826-4b99-8a04-f3641f013caa" status: 200 len: 1226 microversion: 2.1 time: 0.092640 Sep 08 11:31:33.493130 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3408/6682] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:31:33 2022] GET /compute/v2.1/servers/523b814d-0826-4b99-8a04-f3641f013caa => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:31:34.516986 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-55ea1385-17fc-45e0-bf46-39ac7f25281d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:31:34.517640 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-55ea1385-17fc-45e0-bf46-39ac7f25281d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 523b814d-0826-4b99-8a04-f3641f013caa] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:31:34.524498 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55ea1385-17fc-45e0-bf46-39ac7f25281d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:34.525854 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55ea1385-17fc-45e0-bf46-39ac7f25281d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:34.526463 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55ea1385-17fc-45e0-bf46-39ac7f25281d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:34.527214 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55ea1385-17fc-45e0-bf46-39ac7f25281d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:34.527794 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55ea1385-17fc-45e0-bf46-39ac7f25281d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:34.528242 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55ea1385-17fc-45e0-bf46-39ac7f25281d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:34.541977 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-55ea1385-17fc-45e0-bf46-39ac7f25281d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] HTTP exception thrown: Instance 523b814d-0826-4b99-8a04-f3641f013caa could not be found. Sep 08 11:31:34.543634 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-55ea1385-17fc-45e0-bf46-39ac7f25281d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Request method failure captured: Sep 08 11:31:34.543634 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/523b814d-0826-4b99-8a04-f3641f013caa HTTP/1.1 Sep 08 11:31:34.543634 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 11:31:34.543634 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 11:31:34.543634 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 11:31:34.543634 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 11:31:34.543634 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 11:31:34.543634 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 11:31:34.543634 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 11:31:34.543634 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 11:31:34.543634 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGdEih_jYhjrfzcEat7QOG_17jH52nIZFToedVJMJ8Jj4pTKrcjanm3D8dChnqEL9d7jV5rq3NW7Z60oajSkgXZAcEtwDn7-PJMU6a9_UOAo8UiiyZ8L4GogQF4UWk_-Vlyi8Q447m99c-S3nr2fWKYhvhV9-SsmuV-ccLSbm0hBFVVM Sep 08 11:31:34.543634 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 11:31:34.543634 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 11:31:34.543634 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 11:31:34.543634 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 11:31:34.543634 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 11:31:34.543634 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 11:31:34.543634 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 747bb5860ba14a20bba3b1c2197ea75d Sep 08 11:31:34.543634 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-TestVolumeBootPattern-1812135790 Sep 08 11:31:34.543634 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 11:31:34.543634 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 11:31:34.543634 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/747bb5860ba14a20bba3b1c2197ea75d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/747bb5860ba14a20bba3b1c2197ea75d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_747bb5860ba14a20bba3b1c2197ea75d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/747bb5860ba14a20bba3b1c2197ea75d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:31:34.543634 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-TestVolumeBootPattern-1812135790 Sep 08 11:31:34.543634 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 747bb5860ba14a20bba3b1c2197ea75d Sep 08 11:31:34.543634 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-TestVolumeBootPattern-1812135790 Sep 08 11:31:34.543634 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-TestVolumeBootPattern-1812135790-project Sep 08 11:31:34.543634 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 11:31:34.543634 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 11:31:34.543634 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: bc18639e461e4ef5bfcf4380c561f329 Sep 08 11:31:34.543634 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-TestVolumeBootPattern-1812135790-project Sep 08 11:31:34.543634 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 11:31:34.543634 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 523b814d-0826-4b99-8a04-f3641f013caa could not be found. Sep 08 11:31:34.543634 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '523b814d-0826-4b99-8a04-f3641f013caa'} Sep 08 11:31:34.543634 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:31:34.543634 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:31:34.543634 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:31:34.543634 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:31:34.543634 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:31:34.543634 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:31:34.543634 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:31:34.543634 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:31:34.543634 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:31:34.543634 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:31:34.543634 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 523b814d-0826-4b99-8a04-f3641f013caa could not be found. Sep 08 11:31:34.543634 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:31:34.543634 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:31:34.543634 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:31:34.543634 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:31:34.543634 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:31:34.543634 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:31:34.543634 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:31:34.543634 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:31:34.543634 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:31:34.543634 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:31:34.543634 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:31:34.543634 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:31:34.543634 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:31:34.543634 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:31:34.543634 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:31:34.543634 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:31:34.543634 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 523b814d-0826-4b99-8a04-f3641f013caa could not be found. Sep 08 11:31:34.543634 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:31:34.543634 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:31:34.543634 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:31:34.547898 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:31:34.547898 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:31:34.547898 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:31:34.547898 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:31:34.547898 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:31:34.547898 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 523b814d-0826-4b99-8a04-f3641f013caa could not be found. Sep 08 11:31:34.547898 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:31:34.547898 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-55ea1385-17fc-45e0-bf46-39ac7f25281d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Returning 404 to user: Instance 523b814d-0826-4b99-8a04-f3641f013caa could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:31:34.547898 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-55ea1385-17fc-45e0-bf46-39ac7f25281d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/523b814d-0826-4b99-8a04-f3641f013caa" status: 404 len: 111 microversion: 2.1 time: 0.032233 Sep 08 11:31:34.547898 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3275/6683] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:31:34 2022] GET /compute/v2.1/servers/523b814d-0826-4b99-8a04-f3641f013caa => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:31:34.593166 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7be13406-417b-4b84-b2aa-3f5b9043be00 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1659478976", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1515082793", "security_groups": [{"name": "tempest-secgroup-smoke-389085655"}], "block_device_mapping_v2": [{"uuid": "641e3535-e5b7-4869-9df5-b2270b0be460", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6c224653-dc3b-48b8-9084-30761e623f71"}]}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:31:34.709439 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-7be13406-417b-4b84-b2aa-3f5b9043be00 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] validate_networks() for [('6c224653-dc3b-48b8-9084-30761e623f71', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:31:35.128155 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-7be13406-417b-4b84-b2aa-3f5b9043be00 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:31:35.128594 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-7be13406-417b-4b84-b2aa-3f5b9043be00 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:31:35.129099 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-7be13406-417b-4b84-b2aa-3f5b9043be00 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:31:35.129519 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-7be13406-417b-4b84-b2aa-3f5b9043be00 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:31:35.129937 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-7be13406-417b-4b84-b2aa-3f5b9043be00 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:31:35.139762 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7be13406-417b-4b84-b2aa-3f5b9043be00 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:35.140288 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7be13406-417b-4b84-b2aa-3f5b9043be00 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:35.140735 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7be13406-417b-4b84-b2aa-3f5b9043be00 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:35.141529 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7be13406-417b-4b84-b2aa-3f5b9043be00 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:35.141993 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7be13406-417b-4b84-b2aa-3f5b9043be00 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:35.142423 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7be13406-417b-4b84-b2aa-3f5b9043be00 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:35.166970 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-7be13406-417b-4b84-b2aa-3f5b9043be00 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Getting quotas for project 747bb5860ba14a20bba3b1c2197ea75d. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:31:35.172513 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-7be13406-417b-4b84-b2aa-3f5b9043be00 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Getting quotas for user bc18639e461e4ef5bfcf4380c561f329 and project 747bb5860ba14a20bba3b1c2197ea75d. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:31:35.231755 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7be13406-417b-4b84-b2aa-3f5b9043be00 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:31:35.234023 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7be13406-417b-4b84-b2aa-3f5b9043be00 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 3718be4c-8edc-4133-9563-6241a5a5bb4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='641e3535-e5b7-4869-9df5-b2270b0be460',volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:31:35.364668 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7be13406-417b-4b84-b2aa-3f5b9043be00 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.775378 Sep 08 11:31:35.365359 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3409/6684] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 11:31:34 2022] POST /compute/v2.1/servers => generated 405 bytes in 777 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 11:31:35.377336 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dc2e4576-7082-486c-b38a-c9179d175473 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:31:35.377967 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-dc2e4576-7082-486c-b38a-c9179d175473 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 3718be4c-8edc-4133-9563-6241a5a5bb4b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:31:35.437193 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-dc2e4576-7082-486c-b38a-c9179d175473 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:31:35.446786 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-dc2e4576-7082-486c-b38a-c9179d175473 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/3718be4c-8edc-4133-9563-6241a5a5bb4b" status: 200 len: 1095 microversion: 2.1 time: 0.073428 Sep 08 11:31:35.447881 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3276/6685] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:31:35 2022] GET /compute/v2.1/servers/3718be4c-8edc-4133-9563-6241a5a5bb4b => generated 1095 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:31:36.470850 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bf7cf962-ddca-41e4-bf47-c938d03af33a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:31:36.471598 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bf7cf962-ddca-41e4-bf47-c938d03af33a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 3718be4c-8edc-4133-9563-6241a5a5bb4b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:31:36.479510 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf7cf962-ddca-41e4-bf47-c938d03af33a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:36.481553 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf7cf962-ddca-41e4-bf47-c938d03af33a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:36.482278 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf7cf962-ddca-41e4-bf47-c938d03af33a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:36.483257 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf7cf962-ddca-41e4-bf47-c938d03af33a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:36.483936 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf7cf962-ddca-41e4-bf47-c938d03af33a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:36.484591 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf7cf962-ddca-41e4-bf47-c938d03af33a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:36.560302 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-bf7cf962-ddca-41e4-bf47-c938d03af33a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:31:36.574229 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bf7cf962-ddca-41e4-bf47-c938d03af33a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/3718be4c-8edc-4133-9563-6241a5a5bb4b" status: 200 len: 1211 microversion: 2.1 time: 0.106543 Sep 08 11:31:36.575849 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3410/6686] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:31:36 2022] GET /compute/v2.1/servers/3718be4c-8edc-4133-9563-6241a5a5bb4b => generated 1211 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:31:37.608732 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e3aba952-d97a-48c9-9024-a88de2081f4a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:31:37.609561 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e3aba952-d97a-48c9-9024-a88de2081f4a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 3718be4c-8edc-4133-9563-6241a5a5bb4b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:31:37.617590 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e3aba952-d97a-48c9-9024-a88de2081f4a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:37.618104 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e3aba952-d97a-48c9-9024-a88de2081f4a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:37.618825 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e3aba952-d97a-48c9-9024-a88de2081f4a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:37.619796 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e3aba952-d97a-48c9-9024-a88de2081f4a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:37.620280 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e3aba952-d97a-48c9-9024-a88de2081f4a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:37.620886 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e3aba952-d97a-48c9-9024-a88de2081f4a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:37.876814 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e3aba952-d97a-48c9-9024-a88de2081f4a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:31:37.885041 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e3aba952-d97a-48c9-9024-a88de2081f4a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/3718be4c-8edc-4133-9563-6241a5a5bb4b" status: 200 len: 1278 microversion: 2.1 time: 0.281225 Sep 08 11:31:37.885848 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3277/6687] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:31:37 2022] GET /compute/v2.1/servers/3718be4c-8edc-4133-9563-6241a5a5bb4b => generated 1278 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:31:38.094273 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-b67708da-4fae-476f-bc2c-b55ec1a013a7 req-a894c7dd-5409-4dbb-90b4-e565019dd551 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3718be4c-8edc-4133-9563-6241a5a5bb4b", "tag": "735915a5-fe49-4d6e-8bbb-f52430191b74"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:31:38.118948 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-b67708da-4fae-476f-bc2c-b55ec1a013a7 req-a894c7dd-5409-4dbb-90b4-e565019dd551 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:38.119600 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-b67708da-4fae-476f-bc2c-b55ec1a013a7 req-a894c7dd-5409-4dbb-90b4-e565019dd551 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:38.120302 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-b67708da-4fae-476f-bc2c-b55ec1a013a7 req-a894c7dd-5409-4dbb-90b4-e565019dd551 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:38.135830 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-b67708da-4fae-476f-bc2c-b55ec1a013a7 req-a894c7dd-5409-4dbb-90b4-e565019dd551 service nova] Creating event network-changed:735915a5-fe49-4d6e-8bbb-f52430191b74 for instance 3718be4c-8edc-4133-9563-6241a5a5bb4b on n-h1-850501-12 Sep 08 11:31:38.142785 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-b67708da-4fae-476f-bc2c-b55ec1a013a7 req-a894c7dd-5409-4dbb-90b4-e565019dd551 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052146 Sep 08 11:31:38.144342 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3411/6688] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:31:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:31:38.910199 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8e17dfde-2355-41f3-bde0-96998c7b59ff tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:31:38.910987 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8e17dfde-2355-41f3-bde0-96998c7b59ff tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 3718be4c-8edc-4133-9563-6241a5a5bb4b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:31:38.924969 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e17dfde-2355-41f3-bde0-96998c7b59ff tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:38.925568 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e17dfde-2355-41f3-bde0-96998c7b59ff tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:38.926028 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e17dfde-2355-41f3-bde0-96998c7b59ff tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:38.926776 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e17dfde-2355-41f3-bde0-96998c7b59ff tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:38.927258 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e17dfde-2355-41f3-bde0-96998c7b59ff tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:38.927703 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e17dfde-2355-41f3-bde0-96998c7b59ff tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:39.153522 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8e17dfde-2355-41f3-bde0-96998c7b59ff tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:31:39.168122 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8e17dfde-2355-41f3-bde0-96998c7b59ff tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/3718be4c-8edc-4133-9563-6241a5a5bb4b" status: 200 len: 1278 microversion: 2.1 time: 0.261544 Sep 08 11:31:39.168747 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3278/6689] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:31:38 2022] GET /compute/v2.1/servers/3718be4c-8edc-4133-9563-6241a5a5bb4b => generated 1278 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:31:40.191213 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e910fabd-e27e-4d63-88c7-efec096ef8c5 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:31:40.191933 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e910fabd-e27e-4d63-88c7-efec096ef8c5 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 3718be4c-8edc-4133-9563-6241a5a5bb4b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:31:40.199271 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e910fabd-e27e-4d63-88c7-efec096ef8c5 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:40.199987 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e910fabd-e27e-4d63-88c7-efec096ef8c5 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:40.200446 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e910fabd-e27e-4d63-88c7-efec096ef8c5 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:40.201203 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e910fabd-e27e-4d63-88c7-efec096ef8c5 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:40.201675 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e910fabd-e27e-4d63-88c7-efec096ef8c5 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:40.202116 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e910fabd-e27e-4d63-88c7-efec096ef8c5 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:40.336218 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e910fabd-e27e-4d63-88c7-efec096ef8c5 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:31:40.345056 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e910fabd-e27e-4d63-88c7-efec096ef8c5 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/3718be4c-8edc-4133-9563-6241a5a5bb4b" status: 200 len: 1278 microversion: 2.1 time: 0.158150 Sep 08 11:31:40.345638 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3412/6690] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:31:40 2022] GET /compute/v2.1/servers/3718be4c-8edc-4133-9563-6241a5a5bb4b => generated 1278 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:31:41.368103 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d0f83a55-c840-431b-8eaa-444a6c4ba1f4 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:31:41.368775 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d0f83a55-c840-431b-8eaa-444a6c4ba1f4 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 3718be4c-8edc-4133-9563-6241a5a5bb4b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:31:41.377279 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d0f83a55-c840-431b-8eaa-444a6c4ba1f4 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:41.377796 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d0f83a55-c840-431b-8eaa-444a6c4ba1f4 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:41.378255 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d0f83a55-c840-431b-8eaa-444a6c4ba1f4 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:41.378992 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d0f83a55-c840-431b-8eaa-444a6c4ba1f4 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:41.379469 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d0f83a55-c840-431b-8eaa-444a6c4ba1f4 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:41.379918 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d0f83a55-c840-431b-8eaa-444a6c4ba1f4 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:41.529772 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d0f83a55-c840-431b-8eaa-444a6c4ba1f4 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:31:41.537632 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d0f83a55-c840-431b-8eaa-444a6c4ba1f4 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/3718be4c-8edc-4133-9563-6241a5a5bb4b" status: 200 len: 1278 microversion: 2.1 time: 0.173606 Sep 08 11:31:41.538204 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3279/6691] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:31:41 2022] GET /compute/v2.1/servers/3718be4c-8edc-4133-9563-6241a5a5bb4b => generated 1278 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:31:42.561838 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d61d8d6d-af94-4915-8365-0edf081bb378 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:31:42.562449 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d61d8d6d-af94-4915-8365-0edf081bb378 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 3718be4c-8edc-4133-9563-6241a5a5bb4b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:31:42.569778 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d61d8d6d-af94-4915-8365-0edf081bb378 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:42.570238 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d61d8d6d-af94-4915-8365-0edf081bb378 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:42.570679 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d61d8d6d-af94-4915-8365-0edf081bb378 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:42.571390 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d61d8d6d-af94-4915-8365-0edf081bb378 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:42.571849 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d61d8d6d-af94-4915-8365-0edf081bb378 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:42.572280 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d61d8d6d-af94-4915-8365-0edf081bb378 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:42.707851 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d61d8d6d-af94-4915-8365-0edf081bb378 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:31:42.715864 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d61d8d6d-af94-4915-8365-0edf081bb378 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/3718be4c-8edc-4133-9563-6241a5a5bb4b" status: 200 len: 1266 microversion: 2.1 time: 0.158888 Sep 08 11:31:42.716434 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3413/6692] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:31:42 2022] GET /compute/v2.1/servers/3718be4c-8edc-4133-9563-6241a5a5bb4b => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:31:43.739005 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5f25a9fa-31ad-41ca-a837-df70840d1c0f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:31:43.739635 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5f25a9fa-31ad-41ca-a837-df70840d1c0f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 3718be4c-8edc-4133-9563-6241a5a5bb4b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:31:43.747249 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5f25a9fa-31ad-41ca-a837-df70840d1c0f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:43.747752 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5f25a9fa-31ad-41ca-a837-df70840d1c0f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:43.748203 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5f25a9fa-31ad-41ca-a837-df70840d1c0f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:43.748921 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5f25a9fa-31ad-41ca-a837-df70840d1c0f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:43.749417 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5f25a9fa-31ad-41ca-a837-df70840d1c0f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:43.749861 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5f25a9fa-31ad-41ca-a837-df70840d1c0f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:43.893896 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5f25a9fa-31ad-41ca-a837-df70840d1c0f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:31:43.901604 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5f25a9fa-31ad-41ca-a837-df70840d1c0f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/3718be4c-8edc-4133-9563-6241a5a5bb4b" status: 200 len: 1266 microversion: 2.1 time: 0.166517 Sep 08 11:31:43.902399 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3280/6693] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:31:43 2022] GET /compute/v2.1/servers/3718be4c-8edc-4133-9563-6241a5a5bb4b => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:31:44.924185 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-51c0f236-4f6c-451a-a6da-de80b497877a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:31:44.924804 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-51c0f236-4f6c-451a-a6da-de80b497877a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 3718be4c-8edc-4133-9563-6241a5a5bb4b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:31:44.931501 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-51c0f236-4f6c-451a-a6da-de80b497877a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:44.931986 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-51c0f236-4f6c-451a-a6da-de80b497877a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:44.932421 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-51c0f236-4f6c-451a-a6da-de80b497877a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:44.933282 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-51c0f236-4f6c-451a-a6da-de80b497877a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:44.933807 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-51c0f236-4f6c-451a-a6da-de80b497877a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:44.934272 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-51c0f236-4f6c-451a-a6da-de80b497877a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:45.068093 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-51c0f236-4f6c-451a-a6da-de80b497877a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:31:45.076661 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-51c0f236-4f6c-451a-a6da-de80b497877a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/3718be4c-8edc-4133-9563-6241a5a5bb4b" status: 200 len: 1266 microversion: 2.1 time: 0.156389 Sep 08 11:31:45.077289 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3414/6694] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:31:44 2022] GET /compute/v2.1/servers/3718be4c-8edc-4133-9563-6241a5a5bb4b => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:31:46.100819 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d77937d9-dcb5-48ec-b88e-148a89c7e55c tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:31:46.101426 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d77937d9-dcb5-48ec-b88e-148a89c7e55c tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 3718be4c-8edc-4133-9563-6241a5a5bb4b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:31:46.104582 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:31:46.111602 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d77937d9-dcb5-48ec-b88e-148a89c7e55c tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:46.112112 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d77937d9-dcb5-48ec-b88e-148a89c7e55c tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:46.112567 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d77937d9-dcb5-48ec-b88e-148a89c7e55c tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:46.113318 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d77937d9-dcb5-48ec-b88e-148a89c7e55c tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:46.113792 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d77937d9-dcb5-48ec-b88e-148a89c7e55c tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:46.114234 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d77937d9-dcb5-48ec-b88e-148a89c7e55c tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:46.245784 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d77937d9-dcb5-48ec-b88e-148a89c7e55c tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:31:46.254160 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d77937d9-dcb5-48ec-b88e-148a89c7e55c tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/3718be4c-8edc-4133-9563-6241a5a5bb4b" status: 200 len: 1266 microversion: 2.1 time: 0.157424 Sep 08 11:31:46.254742 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3281/6695] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:31:46 2022] GET /compute/v2.1/servers/3718be4c-8edc-4133-9563-6241a5a5bb4b => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:31:47.277280 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3146a40c-150f-44bc-bc7c-86110766133d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:31:47.278049 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3146a40c-150f-44bc-bc7c-86110766133d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 3718be4c-8edc-4133-9563-6241a5a5bb4b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:31:47.280010 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:31:47.280674 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=6 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:31:47.287411 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3146a40c-150f-44bc-bc7c-86110766133d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:47.287906 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3146a40c-150f-44bc-bc7c-86110766133d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:47.288346 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3146a40c-150f-44bc-bc7c-86110766133d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:47.289086 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3146a40c-150f-44bc-bc7c-86110766133d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:47.289546 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3146a40c-150f-44bc-bc7c-86110766133d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:47.289979 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3146a40c-150f-44bc-bc7c-86110766133d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:47.440073 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-3146a40c-150f-44bc-bc7c-86110766133d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:31:47.448080 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3146a40c-150f-44bc-bc7c-86110766133d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/3718be4c-8edc-4133-9563-6241a5a5bb4b" status: 200 len: 1266 microversion: 2.1 time: 0.174770 Sep 08 11:31:47.448670 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3415/6696] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:31:47 2022] GET /compute/v2.1/servers/3718be4c-8edc-4133-9563-6241a5a5bb4b => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:31:48.472083 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5f20a2c1-1212-498d-ad39-3ed7a80fece0 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:31:48.472712 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5f20a2c1-1212-498d-ad39-3ed7a80fece0 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 3718be4c-8edc-4133-9563-6241a5a5bb4b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:31:48.479894 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5f20a2c1-1212-498d-ad39-3ed7a80fece0 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:48.480395 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5f20a2c1-1212-498d-ad39-3ed7a80fece0 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:48.480893 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5f20a2c1-1212-498d-ad39-3ed7a80fece0 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:48.481641 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5f20a2c1-1212-498d-ad39-3ed7a80fece0 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:48.482110 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5f20a2c1-1212-498d-ad39-3ed7a80fece0 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:48.482550 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5f20a2c1-1212-498d-ad39-3ed7a80fece0 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:48.619599 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5f20a2c1-1212-498d-ad39-3ed7a80fece0 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:31:48.627573 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5f20a2c1-1212-498d-ad39-3ed7a80fece0 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/3718be4c-8edc-4133-9563-6241a5a5bb4b" status: 200 len: 1266 microversion: 2.1 time: 0.159548 Sep 08 11:31:48.628142 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3282/6697] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:31:48 2022] GET /compute/v2.1/servers/3718be4c-8edc-4133-9563-6241a5a5bb4b => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:31:49.651066 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2c11d0ae-69c6-4a9f-85f1-b42edd91b1c0 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:31:49.651598 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2c11d0ae-69c6-4a9f-85f1-b42edd91b1c0 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 3718be4c-8edc-4133-9563-6241a5a5bb4b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:31:49.658571 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2c11d0ae-69c6-4a9f-85f1-b42edd91b1c0 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:49.659072 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2c11d0ae-69c6-4a9f-85f1-b42edd91b1c0 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:49.659514 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2c11d0ae-69c6-4a9f-85f1-b42edd91b1c0 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:49.660229 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2c11d0ae-69c6-4a9f-85f1-b42edd91b1c0 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:49.660692 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2c11d0ae-69c6-4a9f-85f1-b42edd91b1c0 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:49.661158 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2c11d0ae-69c6-4a9f-85f1-b42edd91b1c0 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:49.794577 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2c11d0ae-69c6-4a9f-85f1-b42edd91b1c0 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:31:49.802565 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2c11d0ae-69c6-4a9f-85f1-b42edd91b1c0 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/3718be4c-8edc-4133-9563-6241a5a5bb4b" status: 200 len: 1266 microversion: 2.1 time: 0.155585 Sep 08 11:31:49.803145 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3416/6698] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:31:49 2022] GET /compute/v2.1/servers/3718be4c-8edc-4133-9563-6241a5a5bb4b => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:31:50.825746 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8b888113-267a-47d7-a678-c4b40a1507aa tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:31:50.826329 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8b888113-267a-47d7-a678-c4b40a1507aa tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 3718be4c-8edc-4133-9563-6241a5a5bb4b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:31:50.833736 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8b888113-267a-47d7-a678-c4b40a1507aa tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:50.834333 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8b888113-267a-47d7-a678-c4b40a1507aa tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:50.834872 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8b888113-267a-47d7-a678-c4b40a1507aa tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:50.835648 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8b888113-267a-47d7-a678-c4b40a1507aa tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:50.836167 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8b888113-267a-47d7-a678-c4b40a1507aa tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:50.836605 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8b888113-267a-47d7-a678-c4b40a1507aa tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:50.973157 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8b888113-267a-47d7-a678-c4b40a1507aa tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:31:50.983162 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8b888113-267a-47d7-a678-c4b40a1507aa tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/3718be4c-8edc-4133-9563-6241a5a5bb4b" status: 200 len: 1266 microversion: 2.1 time: 0.161205 Sep 08 11:31:50.983851 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3283/6699] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:31:50 2022] GET /compute/v2.1/servers/3718be4c-8edc-4133-9563-6241a5a5bb4b => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:31:52.006559 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-21d8dc40-6566-499d-b73c-5f7e99c3aaa6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:31:52.007318 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-21d8dc40-6566-499d-b73c-5f7e99c3aaa6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 3718be4c-8edc-4133-9563-6241a5a5bb4b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:31:52.014726 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-21d8dc40-6566-499d-b73c-5f7e99c3aaa6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:52.015259 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-21d8dc40-6566-499d-b73c-5f7e99c3aaa6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:52.015704 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-21d8dc40-6566-499d-b73c-5f7e99c3aaa6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:52.016424 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-21d8dc40-6566-499d-b73c-5f7e99c3aaa6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:52.016889 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-21d8dc40-6566-499d-b73c-5f7e99c3aaa6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:52.017360 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-21d8dc40-6566-499d-b73c-5f7e99c3aaa6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:52.151444 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-21d8dc40-6566-499d-b73c-5f7e99c3aaa6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:31:52.160459 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-21d8dc40-6566-499d-b73c-5f7e99c3aaa6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/3718be4c-8edc-4133-9563-6241a5a5bb4b" status: 200 len: 1266 microversion: 2.1 time: 0.157866 Sep 08 11:31:52.161045 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3417/6700] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:31:52 2022] GET /compute/v2.1/servers/3718be4c-8edc-4133-9563-6241a5a5bb4b => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:31:52.442393 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-d465e428-93cc-4a89-89c5-7348d9cf3955 req-4c2f2aa5-032b-46b3-97dd-8039715dcc44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3718be4c-8edc-4133-9563-6241a5a5bb4b", "name": "network-vif-plugged", "status": "completed", "tag": "735915a5-fe49-4d6e-8bbb-f52430191b74"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:31:52.460422 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d465e428-93cc-4a89-89c5-7348d9cf3955 req-4c2f2aa5-032b-46b3-97dd-8039715dcc44 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:52.464975 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d465e428-93cc-4a89-89c5-7348d9cf3955 req-4c2f2aa5-032b-46b3-97dd-8039715dcc44 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:52.465674 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d465e428-93cc-4a89-89c5-7348d9cf3955 req-4c2f2aa5-032b-46b3-97dd-8039715dcc44 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:52.478577 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-d465e428-93cc-4a89-89c5-7348d9cf3955 req-4c2f2aa5-032b-46b3-97dd-8039715dcc44 service nova] Creating event network-vif-plugged:735915a5-fe49-4d6e-8bbb-f52430191b74 for instance 3718be4c-8edc-4133-9563-6241a5a5bb4b on n-h1-850501-12 Sep 08 11:31:52.485341 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-d465e428-93cc-4a89-89c5-7348d9cf3955 req-4c2f2aa5-032b-46b3-97dd-8039715dcc44 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046425 Sep 08 11:31:52.486270 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3284/6701] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:31:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:31:53.183693 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2f8df310-6f34-4465-a2e9-5caecbc0872b tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:31:53.184363 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2f8df310-6f34-4465-a2e9-5caecbc0872b tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 3718be4c-8edc-4133-9563-6241a5a5bb4b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:31:53.191544 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2f8df310-6f34-4465-a2e9-5caecbc0872b tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:53.192038 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2f8df310-6f34-4465-a2e9-5caecbc0872b tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:53.193224 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2f8df310-6f34-4465-a2e9-5caecbc0872b tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:53.199422 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2f8df310-6f34-4465-a2e9-5caecbc0872b tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:53.199992 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2f8df310-6f34-4465-a2e9-5caecbc0872b tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:53.200480 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2f8df310-6f34-4465-a2e9-5caecbc0872b tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:53.346519 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2f8df310-6f34-4465-a2e9-5caecbc0872b tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:31:53.354768 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2f8df310-6f34-4465-a2e9-5caecbc0872b tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/3718be4c-8edc-4133-9563-6241a5a5bb4b" status: 200 len: 1266 microversion: 2.1 time: 0.175047 Sep 08 11:31:53.355343 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3418/6702] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:31:53 2022] GET /compute/v2.1/servers/3718be4c-8edc-4133-9563-6241a5a5bb4b => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:31:54.378758 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bd3e2fac-fd10-43c4-a25a-15df79835415 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:31:54.379481 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bd3e2fac-fd10-43c4-a25a-15df79835415 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 3718be4c-8edc-4133-9563-6241a5a5bb4b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:31:54.385780 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bd3e2fac-fd10-43c4-a25a-15df79835415 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:54.386290 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bd3e2fac-fd10-43c4-a25a-15df79835415 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:54.386748 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bd3e2fac-fd10-43c4-a25a-15df79835415 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:54.387604 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bd3e2fac-fd10-43c4-a25a-15df79835415 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:54.388021 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bd3e2fac-fd10-43c4-a25a-15df79835415 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:54.388465 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bd3e2fac-fd10-43c4-a25a-15df79835415 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:54.522580 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bd3e2fac-fd10-43c4-a25a-15df79835415 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:31:54.531055 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bd3e2fac-fd10-43c4-a25a-15df79835415 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/3718be4c-8edc-4133-9563-6241a5a5bb4b" status: 200 len: 1452 microversion: 2.1 time: 0.157521 Sep 08 11:31:54.531644 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3285/6703] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:31:54 2022] GET /compute/v2.1/servers/3718be4c-8edc-4133-9563-6241a5a5bb4b => generated 1452 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:31:54.553871 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-598176d2-8853-4a3b-8eed-0b98e68b75a3 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:31:54.554484 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-598176d2-8853-4a3b-8eed-0b98e68b75a3 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 3718be4c-8edc-4133-9563-6241a5a5bb4b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:31:54.561829 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-598176d2-8853-4a3b-8eed-0b98e68b75a3 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:54.562601 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-598176d2-8853-4a3b-8eed-0b98e68b75a3 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:54.563046 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-598176d2-8853-4a3b-8eed-0b98e68b75a3 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:54.563867 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-598176d2-8853-4a3b-8eed-0b98e68b75a3 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:54.564332 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-598176d2-8853-4a3b-8eed-0b98e68b75a3 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:54.564761 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-598176d2-8853-4a3b-8eed-0b98e68b75a3 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:54.698289 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-598176d2-8853-4a3b-8eed-0b98e68b75a3 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:31:54.706533 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-598176d2-8853-4a3b-8eed-0b98e68b75a3 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/3718be4c-8edc-4133-9563-6241a5a5bb4b" status: 200 len: 1452 microversion: 2.1 time: 0.156749 Sep 08 11:31:54.707115 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3419/6704] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:31:54 2022] GET /compute/v2.1/servers/3718be4c-8edc-4133-9563-6241a5a5bb4b => generated 1452 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:31:56.637836 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-cc229e7d-acca-4f67-aa97-594004981fd8 req-ed26a8d6-9941-474e-8967-a653f936199f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3718be4c-8edc-4133-9563-6241a5a5bb4b", "tag": "735915a5-fe49-4d6e-8bbb-f52430191b74"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:31:56.644885 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=33 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:31:56.651353 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-cc229e7d-acca-4f67-aa97-594004981fd8 req-ed26a8d6-9941-474e-8967-a653f936199f service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:56.651850 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-cc229e7d-acca-4f67-aa97-594004981fd8 req-ed26a8d6-9941-474e-8967-a653f936199f service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:56.652293 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-cc229e7d-acca-4f67-aa97-594004981fd8 req-ed26a8d6-9941-474e-8967-a653f936199f service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:56.655016 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=77 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:31:56.665673 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-cc229e7d-acca-4f67-aa97-594004981fd8 req-ed26a8d6-9941-474e-8967-a653f936199f service nova] Creating event network-changed:735915a5-fe49-4d6e-8bbb-f52430191b74 for instance 3718be4c-8edc-4133-9563-6241a5a5bb4b on n-h1-850501-12 Sep 08 11:31:56.671031 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-cc229e7d-acca-4f67-aa97-594004981fd8 req-ed26a8d6-9941-474e-8967-a653f936199f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036843 Sep 08 11:31:56.671649 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3286/6705] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:31:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:33:46.636971 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cc8dbecf-c44d-4a25-b880-de224ffc9a01 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1561063034", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1515082793", "security_groups": [{"name": "tempest-secgroup-smoke-389085655"}], "block_device_mapping_v2": [{"uuid": "e034fe1d-596a-4ce6-b399-c33924353cb2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6c224653-dc3b-48b8-9084-30761e623f71"}]}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:33:46.647620 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:33:46.648285 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:33:46.930092 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-cc8dbecf-c44d-4a25-b880-de224ffc9a01 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] validate_networks() for [('6c224653-dc3b-48b8-9084-30761e623f71', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:33:47.319974 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-cc8dbecf-c44d-4a25-b880-de224ffc9a01 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:33:47.320406 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-cc8dbecf-c44d-4a25-b880-de224ffc9a01 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:33:47.320884 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-cc8dbecf-c44d-4a25-b880-de224ffc9a01 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:33:47.321333 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-cc8dbecf-c44d-4a25-b880-de224ffc9a01 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:33:47.321751 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-cc8dbecf-c44d-4a25-b880-de224ffc9a01 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:33:47.330823 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc8dbecf-c44d-4a25-b880-de224ffc9a01 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:33:47.331306 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc8dbecf-c44d-4a25-b880-de224ffc9a01 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:33:47.331740 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc8dbecf-c44d-4a25-b880-de224ffc9a01 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:33:47.332469 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc8dbecf-c44d-4a25-b880-de224ffc9a01 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:33:47.332925 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc8dbecf-c44d-4a25-b880-de224ffc9a01 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:33:47.333376 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc8dbecf-c44d-4a25-b880-de224ffc9a01 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:33:47.349989 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-cc8dbecf-c44d-4a25-b880-de224ffc9a01 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Getting quotas for project 747bb5860ba14a20bba3b1c2197ea75d. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:33:47.356022 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-cc8dbecf-c44d-4a25-b880-de224ffc9a01 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Getting quotas for user bc18639e461e4ef5bfcf4380c561f329 and project 747bb5860ba14a20bba3b1c2197ea75d. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:33:47.413182 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cc8dbecf-c44d-4a25-b880-de224ffc9a01 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:33:47.415338 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cc8dbecf-c44d-4a25-b880-de224ffc9a01 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 00a3e430-8bea-4db7-b36a-edca9fb29ab7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e034fe1d-596a-4ce6-b399-c33924353cb2',volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:33:47.551928 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cc8dbecf-c44d-4a25-b880-de224ffc9a01 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.919822 Sep 08 11:33:47.552658 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3420/6706] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 11:33:46 2022] POST /compute/v2.1/servers => generated 405 bytes in 921 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:33:47.562511 n-d-850501-12 devstack@n-api.service[128862]: ERROR oslo.messaging._drivers.impl_rabbit [-] [570aaa6f-7e4b-4ecb-864e-7bad38a49265] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 08 11:33:47.566518 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a78f2aff-62fa-41b8-8f32-a4b8ced93981 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:33:47.567232 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a78f2aff-62fa-41b8-8f32-a4b8ced93981 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 00a3e430-8bea-4db7-b36a-edca9fb29ab7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:33:47.569680 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:33:47.570444 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:33:47.571624 n-d-850501-12 devstack@n-api.service[128862]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 11:33:47.571809 n-d-850501-12 devstack@n-api.service[128862]: Thu Sep 8 11:33:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/00a3e430-8bea-4db7-b36a-edca9fb29ab7 (ip 10.222.0.27) !!! Sep 08 11:33:47.696152 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a78f2aff-62fa-41b8-8f32-a4b8ced93981 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:33:47.703748 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a78f2aff-62fa-41b8-8f32-a4b8ced93981 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/00a3e430-8bea-4db7-b36a-edca9fb29ab7" status: 200 len: 1095 microversion: 2.1 time: 0.143398 Sep 08 11:33:47.704330 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3287/6707] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:33:47 2022] GET /compute/v2.1/servers/00a3e430-8bea-4db7-b36a-edca9fb29ab7 => generated 1095 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:33:48.728512 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c3956173-ffb3-4388-82f9-aab5cce887d8 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:33:48.730827 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c3956173-ffb3-4388-82f9-aab5cce887d8 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 00a3e430-8bea-4db7-b36a-edca9fb29ab7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:33:48.738806 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c3956173-ffb3-4388-82f9-aab5cce887d8 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:33:48.739394 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c3956173-ffb3-4388-82f9-aab5cce887d8 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:33:48.739960 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c3956173-ffb3-4388-82f9-aab5cce887d8 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:33:48.740911 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c3956173-ffb3-4388-82f9-aab5cce887d8 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:33:48.741405 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c3956173-ffb3-4388-82f9-aab5cce887d8 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:33:48.741844 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c3956173-ffb3-4388-82f9-aab5cce887d8 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:33:48.824463 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c3956173-ffb3-4388-82f9-aab5cce887d8 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:33:48.832575 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c3956173-ffb3-4388-82f9-aab5cce887d8 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/00a3e430-8bea-4db7-b36a-edca9fb29ab7" status: 200 len: 1211 microversion: 2.1 time: 0.108821 Sep 08 11:33:48.833168 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3421/6708] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:33:48 2022] GET /compute/v2.1/servers/00a3e430-8bea-4db7-b36a-edca9fb29ab7 => generated 1211 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:33:49.857320 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fd378b69-b054-4ebb-94bc-75cf2f5aa48b tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:33:49.858421 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fd378b69-b054-4ebb-94bc-75cf2f5aa48b tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 00a3e430-8bea-4db7-b36a-edca9fb29ab7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:33:49.871677 n-d-850501-12 devstack@n-api.service[128862]: INFO oslo.messaging._drivers.impl_rabbit [-] [570aaa6f-7e4b-4ecb-864e-7bad38a49265] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 40254. Sep 08 11:33:49.878499 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd378b69-b054-4ebb-94bc-75cf2f5aa48b tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:33:49.879015 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd378b69-b054-4ebb-94bc-75cf2f5aa48b tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:33:49.879477 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd378b69-b054-4ebb-94bc-75cf2f5aa48b tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:33:49.880781 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd378b69-b054-4ebb-94bc-75cf2f5aa48b tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:33:49.881302 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd378b69-b054-4ebb-94bc-75cf2f5aa48b tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:33:49.881823 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd378b69-b054-4ebb-94bc-75cf2f5aa48b tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:33:50.034899 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fd378b69-b054-4ebb-94bc-75cf2f5aa48b tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:33:50.043937 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fd378b69-b054-4ebb-94bc-75cf2f5aa48b tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/00a3e430-8bea-4db7-b36a-edca9fb29ab7" status: 200 len: 1278 microversion: 2.1 time: 0.191971 Sep 08 11:33:50.044893 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3288/6709] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:33:49 2022] GET /compute/v2.1/servers/00a3e430-8bea-4db7-b36a-edca9fb29ab7 => generated 1278 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:33:50.311651 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-b60c5231-966d-4729-b148-c494687cd385 req-9d703e22-7b42-4db1-bf51-5505fc48dd36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00a3e430-8bea-4db7-b36a-edca9fb29ab7", "tag": "49679858-cf1f-4bb5-9e4e-08614fb2e8c7"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:33:50.323385 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-b60c5231-966d-4729-b148-c494687cd385 req-9d703e22-7b42-4db1-bf51-5505fc48dd36 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:33:50.324206 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-b60c5231-966d-4729-b148-c494687cd385 req-9d703e22-7b42-4db1-bf51-5505fc48dd36 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:33:50.325007 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-b60c5231-966d-4729-b148-c494687cd385 req-9d703e22-7b42-4db1-bf51-5505fc48dd36 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:33:50.338371 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-b60c5231-966d-4729-b148-c494687cd385 req-9d703e22-7b42-4db1-bf51-5505fc48dd36 service nova] Creating event network-changed:49679858-cf1f-4bb5-9e4e-08614fb2e8c7 for instance 00a3e430-8bea-4db7-b36a-edca9fb29ab7 on n-h2-850501-12 Sep 08 11:33:50.343700 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-b60c5231-966d-4729-b148-c494687cd385 req-9d703e22-7b42-4db1-bf51-5505fc48dd36 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110288 Sep 08 11:33:50.344394 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3422/6710] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:33:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:33:51.068007 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f90a6569-362e-4c46-9adc-862176edca21 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:33:51.068950 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f90a6569-362e-4c46-9adc-862176edca21 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 00a3e430-8bea-4db7-b36a-edca9fb29ab7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:33:51.076844 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f90a6569-362e-4c46-9adc-862176edca21 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:33:51.077519 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f90a6569-362e-4c46-9adc-862176edca21 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:33:51.078091 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f90a6569-362e-4c46-9adc-862176edca21 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:33:51.078988 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f90a6569-362e-4c46-9adc-862176edca21 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:33:51.079553 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f90a6569-362e-4c46-9adc-862176edca21 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:33:51.080089 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f90a6569-362e-4c46-9adc-862176edca21 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:33:51.229851 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f90a6569-362e-4c46-9adc-862176edca21 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:33:51.239859 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f90a6569-362e-4c46-9adc-862176edca21 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/00a3e430-8bea-4db7-b36a-edca9fb29ab7" status: 200 len: 1278 microversion: 2.1 time: 0.175475 Sep 08 11:33:51.241070 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3289/6711] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:33:51 2022] GET /compute/v2.1/servers/00a3e430-8bea-4db7-b36a-edca9fb29ab7 => generated 1278 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:33:52.267215 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7bdd82db-bacf-482c-9957-090c7f6ebed1 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:33:52.268234 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7bdd82db-bacf-482c-9957-090c7f6ebed1 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 00a3e430-8bea-4db7-b36a-edca9fb29ab7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:33:52.275158 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7bdd82db-bacf-482c-9957-090c7f6ebed1 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:33:52.277312 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7bdd82db-bacf-482c-9957-090c7f6ebed1 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:33:52.277889 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7bdd82db-bacf-482c-9957-090c7f6ebed1 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:33:52.278762 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7bdd82db-bacf-482c-9957-090c7f6ebed1 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:33:52.279327 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7bdd82db-bacf-482c-9957-090c7f6ebed1 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:33:52.279851 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7bdd82db-bacf-482c-9957-090c7f6ebed1 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:33:52.425862 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7bdd82db-bacf-482c-9957-090c7f6ebed1 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:33:52.435323 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7bdd82db-bacf-482c-9957-090c7f6ebed1 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/00a3e430-8bea-4db7-b36a-edca9fb29ab7" status: 200 len: 1278 microversion: 2.1 time: 0.173514 Sep 08 11:33:52.436073 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3423/6712] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:33:52 2022] GET /compute/v2.1/servers/00a3e430-8bea-4db7-b36a-edca9fb29ab7 => generated 1278 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:33:53.459425 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-eddf87ec-0601-4388-996d-ac9df65b8e37 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:33:53.460068 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-eddf87ec-0601-4388-996d-ac9df65b8e37 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 00a3e430-8bea-4db7-b36a-edca9fb29ab7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:33:53.467865 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eddf87ec-0601-4388-996d-ac9df65b8e37 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:33:53.468427 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eddf87ec-0601-4388-996d-ac9df65b8e37 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:33:53.468851 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eddf87ec-0601-4388-996d-ac9df65b8e37 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:33:53.469628 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eddf87ec-0601-4388-996d-ac9df65b8e37 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:33:53.470099 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eddf87ec-0601-4388-996d-ac9df65b8e37 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:33:53.470543 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eddf87ec-0601-4388-996d-ac9df65b8e37 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:33:53.620849 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-eddf87ec-0601-4388-996d-ac9df65b8e37 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:33:53.630172 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-eddf87ec-0601-4388-996d-ac9df65b8e37 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/00a3e430-8bea-4db7-b36a-edca9fb29ab7" status: 200 len: 1278 microversion: 2.1 time: 0.174825 Sep 08 11:33:53.630765 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3290/6713] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:33:53 2022] GET /compute/v2.1/servers/00a3e430-8bea-4db7-b36a-edca9fb29ab7 => generated 1278 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:33:54.654015 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6bfa3137-c43e-4a2a-bd1c-b93207df143e tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:33:54.654681 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6bfa3137-c43e-4a2a-bd1c-b93207df143e tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 00a3e430-8bea-4db7-b36a-edca9fb29ab7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:33:54.662023 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6bfa3137-c43e-4a2a-bd1c-b93207df143e tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:33:54.662526 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6bfa3137-c43e-4a2a-bd1c-b93207df143e tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:33:54.662974 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6bfa3137-c43e-4a2a-bd1c-b93207df143e tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:33:54.663726 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6bfa3137-c43e-4a2a-bd1c-b93207df143e tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:33:54.664258 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6bfa3137-c43e-4a2a-bd1c-b93207df143e tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:33:54.664734 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6bfa3137-c43e-4a2a-bd1c-b93207df143e tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:33:54.803209 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6bfa3137-c43e-4a2a-bd1c-b93207df143e tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:33:54.811568 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6bfa3137-c43e-4a2a-bd1c-b93207df143e tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/00a3e430-8bea-4db7-b36a-edca9fb29ab7" status: 200 len: 1266 microversion: 2.1 time: 0.161609 Sep 08 11:33:54.812152 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3424/6714] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:33:54 2022] GET /compute/v2.1/servers/00a3e430-8bea-4db7-b36a-edca9fb29ab7 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:33:55.834237 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-568b31c0-0430-4d3a-8059-1fb9f0b430af tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:33:55.834900 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-568b31c0-0430-4d3a-8059-1fb9f0b430af tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 00a3e430-8bea-4db7-b36a-edca9fb29ab7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:33:55.842063 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-568b31c0-0430-4d3a-8059-1fb9f0b430af tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:33:55.842568 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-568b31c0-0430-4d3a-8059-1fb9f0b430af tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:33:55.843011 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-568b31c0-0430-4d3a-8059-1fb9f0b430af tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:33:55.843721 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-568b31c0-0430-4d3a-8059-1fb9f0b430af tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:33:55.844187 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-568b31c0-0430-4d3a-8059-1fb9f0b430af tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:33:55.844624 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-568b31c0-0430-4d3a-8059-1fb9f0b430af tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:33:55.981386 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-568b31c0-0430-4d3a-8059-1fb9f0b430af tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:33:55.989058 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-568b31c0-0430-4d3a-8059-1fb9f0b430af tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/00a3e430-8bea-4db7-b36a-edca9fb29ab7" status: 200 len: 1266 microversion: 2.1 time: 0.158761 Sep 08 11:33:55.989630 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3291/6715] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:33:55 2022] GET /compute/v2.1/servers/00a3e430-8bea-4db7-b36a-edca9fb29ab7 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:33:57.013178 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-15470900-ed3f-4e7a-9303-e2911f0257ce tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:33:57.013803 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-15470900-ed3f-4e7a-9303-e2911f0257ce tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 00a3e430-8bea-4db7-b36a-edca9fb29ab7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:33:57.020687 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-15470900-ed3f-4e7a-9303-e2911f0257ce tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:33:57.021224 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-15470900-ed3f-4e7a-9303-e2911f0257ce tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:33:57.021668 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-15470900-ed3f-4e7a-9303-e2911f0257ce tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:33:57.022366 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-15470900-ed3f-4e7a-9303-e2911f0257ce tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:33:57.022829 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-15470900-ed3f-4e7a-9303-e2911f0257ce tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:33:57.023259 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-15470900-ed3f-4e7a-9303-e2911f0257ce tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:33:57.155634 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-15470900-ed3f-4e7a-9303-e2911f0257ce tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:33:57.163421 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-15470900-ed3f-4e7a-9303-e2911f0257ce tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/00a3e430-8bea-4db7-b36a-edca9fb29ab7" status: 200 len: 1266 microversion: 2.1 time: 0.154729 Sep 08 11:33:57.163991 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3425/6716] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:33:57 2022] GET /compute/v2.1/servers/00a3e430-8bea-4db7-b36a-edca9fb29ab7 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:33:58.186773 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-95ef1bd9-ec3a-4569-99a7-7965d1f016fa tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:33:58.187384 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-95ef1bd9-ec3a-4569-99a7-7965d1f016fa tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 00a3e430-8bea-4db7-b36a-edca9fb29ab7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:33:58.190114 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:33:58.195572 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-95ef1bd9-ec3a-4569-99a7-7965d1f016fa tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:33:58.196067 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-95ef1bd9-ec3a-4569-99a7-7965d1f016fa tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:33:58.196515 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-95ef1bd9-ec3a-4569-99a7-7965d1f016fa tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:33:58.197260 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-95ef1bd9-ec3a-4569-99a7-7965d1f016fa tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:33:58.198370 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-95ef1bd9-ec3a-4569-99a7-7965d1f016fa tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:33:58.198993 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-95ef1bd9-ec3a-4569-99a7-7965d1f016fa tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:33:58.331843 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-95ef1bd9-ec3a-4569-99a7-7965d1f016fa tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:33:58.340019 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-95ef1bd9-ec3a-4569-99a7-7965d1f016fa tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/00a3e430-8bea-4db7-b36a-edca9fb29ab7" status: 200 len: 1266 microversion: 2.1 time: 0.157048 Sep 08 11:33:58.340595 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3292/6717] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:33:58 2022] GET /compute/v2.1/servers/00a3e430-8bea-4db7-b36a-edca9fb29ab7 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:33:59.362661 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7323dc5c-d385-4a68-9905-f85801a6d919 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:33:59.363288 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7323dc5c-d385-4a68-9905-f85801a6d919 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 00a3e430-8bea-4db7-b36a-edca9fb29ab7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:33:59.365301 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:33:59.366112 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=6 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:33:59.374994 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7323dc5c-d385-4a68-9905-f85801a6d919 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:33:59.375493 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7323dc5c-d385-4a68-9905-f85801a6d919 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:33:59.375932 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7323dc5c-d385-4a68-9905-f85801a6d919 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:33:59.376672 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7323dc5c-d385-4a68-9905-f85801a6d919 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:33:59.377162 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7323dc5c-d385-4a68-9905-f85801a6d919 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:33:59.377618 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7323dc5c-d385-4a68-9905-f85801a6d919 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:33:59.510551 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7323dc5c-d385-4a68-9905-f85801a6d919 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:33:59.518691 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7323dc5c-d385-4a68-9905-f85801a6d919 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/00a3e430-8bea-4db7-b36a-edca9fb29ab7" status: 200 len: 1266 microversion: 2.1 time: 0.160052 Sep 08 11:33:59.519272 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3426/6718] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:33:59 2022] GET /compute/v2.1/servers/00a3e430-8bea-4db7-b36a-edca9fb29ab7 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:34:00.542594 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-260d4f97-ea99-4e9e-89a7-39172a5f5da6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:34:00.543279 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-260d4f97-ea99-4e9e-89a7-39172a5f5da6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 00a3e430-8bea-4db7-b36a-edca9fb29ab7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:34:00.550015 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-260d4f97-ea99-4e9e-89a7-39172a5f5da6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:34:00.550457 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-260d4f97-ea99-4e9e-89a7-39172a5f5da6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:34:00.550908 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-260d4f97-ea99-4e9e-89a7-39172a5f5da6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:34:00.551619 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-260d4f97-ea99-4e9e-89a7-39172a5f5da6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:34:00.552090 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-260d4f97-ea99-4e9e-89a7-39172a5f5da6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:34:00.552531 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-260d4f97-ea99-4e9e-89a7-39172a5f5da6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:34:00.689318 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-260d4f97-ea99-4e9e-89a7-39172a5f5da6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:34:00.697092 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-260d4f97-ea99-4e9e-89a7-39172a5f5da6 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/00a3e430-8bea-4db7-b36a-edca9fb29ab7" status: 200 len: 1266 microversion: 2.1 time: 0.158489 Sep 08 11:34:00.697669 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3293/6719] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:34:00 2022] GET /compute/v2.1/servers/00a3e430-8bea-4db7-b36a-edca9fb29ab7 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:34:01.720231 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-743c4740-7d06-4d63-8655-c79fcf97af3b tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:34:01.720885 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-743c4740-7d06-4d63-8655-c79fcf97af3b tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 00a3e430-8bea-4db7-b36a-edca9fb29ab7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:34:01.727748 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-743c4740-7d06-4d63-8655-c79fcf97af3b tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:34:01.728234 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-743c4740-7d06-4d63-8655-c79fcf97af3b tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:34:01.728671 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-743c4740-7d06-4d63-8655-c79fcf97af3b tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:34:01.729406 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-743c4740-7d06-4d63-8655-c79fcf97af3b tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:34:01.729894 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-743c4740-7d06-4d63-8655-c79fcf97af3b tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:34:01.730320 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-743c4740-7d06-4d63-8655-c79fcf97af3b tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:34:01.875056 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-743c4740-7d06-4d63-8655-c79fcf97af3b tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:34:01.885140 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-743c4740-7d06-4d63-8655-c79fcf97af3b tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/00a3e430-8bea-4db7-b36a-edca9fb29ab7" status: 200 len: 1266 microversion: 2.1 time: 0.168636 Sep 08 11:34:01.886568 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3427/6720] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:34:01 2022] GET /compute/v2.1/servers/00a3e430-8bea-4db7-b36a-edca9fb29ab7 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:34:02.908574 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-410a2800-96cb-4d53-afd4-d2f569cf7c3f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:34:02.909379 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-410a2800-96cb-4d53-afd4-d2f569cf7c3f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 00a3e430-8bea-4db7-b36a-edca9fb29ab7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:34:02.917248 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-410a2800-96cb-4d53-afd4-d2f569cf7c3f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:34:02.917817 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-410a2800-96cb-4d53-afd4-d2f569cf7c3f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:34:02.918685 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-410a2800-96cb-4d53-afd4-d2f569cf7c3f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:34:02.919549 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-410a2800-96cb-4d53-afd4-d2f569cf7c3f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:34:02.920091 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-410a2800-96cb-4d53-afd4-d2f569cf7c3f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:34:02.920445 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-410a2800-96cb-4d53-afd4-d2f569cf7c3f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:34:03.063904 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-410a2800-96cb-4d53-afd4-d2f569cf7c3f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:34:03.071686 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-410a2800-96cb-4d53-afd4-d2f569cf7c3f tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/00a3e430-8bea-4db7-b36a-edca9fb29ab7" status: 200 len: 1266 microversion: 2.1 time: 0.167035 Sep 08 11:34:03.072260 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3294/6721] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:34:02 2022] GET /compute/v2.1/servers/00a3e430-8bea-4db7-b36a-edca9fb29ab7 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:34:04.095784 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-46a92906-eb39-4fee-92fc-72011d20791a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:34:04.096349 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-46a92906-eb39-4fee-92fc-72011d20791a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 00a3e430-8bea-4db7-b36a-edca9fb29ab7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:34:04.103226 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-46a92906-eb39-4fee-92fc-72011d20791a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:34:04.103712 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-46a92906-eb39-4fee-92fc-72011d20791a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:34:04.104150 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-46a92906-eb39-4fee-92fc-72011d20791a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:34:04.105898 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-46a92906-eb39-4fee-92fc-72011d20791a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:34:04.106554 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-46a92906-eb39-4fee-92fc-72011d20791a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:34:04.106989 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-46a92906-eb39-4fee-92fc-72011d20791a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:34:04.238385 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-46a92906-eb39-4fee-92fc-72011d20791a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:34:04.246314 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-46a92906-eb39-4fee-92fc-72011d20791a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/00a3e430-8bea-4db7-b36a-edca9fb29ab7" status: 200 len: 1266 microversion: 2.1 time: 0.154554 Sep 08 11:34:04.246895 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3428/6722] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:34:04 2022] GET /compute/v2.1/servers/00a3e430-8bea-4db7-b36a-edca9fb29ab7 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:34:04.689463 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-fae7b6c0-63f4-4794-8128-af0c2b4c42ce req-9ad0ba9f-1341-4b7d-af19-807b21830dc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00a3e430-8bea-4db7-b36a-edca9fb29ab7", "name": "network-vif-plugged", "status": "completed", "tag": "49679858-cf1f-4bb5-9e4e-08614fb2e8c7"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:34:04.701065 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-fae7b6c0-63f4-4794-8128-af0c2b4c42ce req-9ad0ba9f-1341-4b7d-af19-807b21830dc9 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:34:04.701930 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-fae7b6c0-63f4-4794-8128-af0c2b4c42ce req-9ad0ba9f-1341-4b7d-af19-807b21830dc9 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:34:04.702384 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-fae7b6c0-63f4-4794-8128-af0c2b4c42ce req-9ad0ba9f-1341-4b7d-af19-807b21830dc9 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:34:04.713784 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-fae7b6c0-63f4-4794-8128-af0c2b4c42ce req-9ad0ba9f-1341-4b7d-af19-807b21830dc9 service nova] Creating event network-vif-plugged:49679858-cf1f-4bb5-9e4e-08614fb2e8c7 for instance 00a3e430-8bea-4db7-b36a-edca9fb29ab7 on n-h2-850501-12 Sep 08 11:34:04.718833 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-fae7b6c0-63f4-4794-8128-af0c2b4c42ce req-9ad0ba9f-1341-4b7d-af19-807b21830dc9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033308 Sep 08 11:34:04.719426 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3295/6723] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:34:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:34:05.268816 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-154ccace-91eb-4d69-a698-8f4751a6eb6a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:34:05.269470 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-154ccace-91eb-4d69-a698-8f4751a6eb6a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 00a3e430-8bea-4db7-b36a-edca9fb29ab7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:34:05.276433 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-154ccace-91eb-4d69-a698-8f4751a6eb6a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:34:05.276927 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-154ccace-91eb-4d69-a698-8f4751a6eb6a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:34:05.278130 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-154ccace-91eb-4d69-a698-8f4751a6eb6a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:34:05.278930 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-154ccace-91eb-4d69-a698-8f4751a6eb6a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:34:05.279398 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-154ccace-91eb-4d69-a698-8f4751a6eb6a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:34:05.279832 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-154ccace-91eb-4d69-a698-8f4751a6eb6a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:34:05.412958 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-154ccace-91eb-4d69-a698-8f4751a6eb6a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:34:05.420926 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-154ccace-91eb-4d69-a698-8f4751a6eb6a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/00a3e430-8bea-4db7-b36a-edca9fb29ab7" status: 200 len: 1266 microversion: 2.1 time: 0.156093 Sep 08 11:34:05.421551 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3429/6724] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:34:05 2022] GET /compute/v2.1/servers/00a3e430-8bea-4db7-b36a-edca9fb29ab7 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:34:06.446298 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1a0c32b9-0049-4b16-a6c3-3e34fb607ea9 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:34:06.447017 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1a0c32b9-0049-4b16-a6c3-3e34fb607ea9 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 00a3e430-8bea-4db7-b36a-edca9fb29ab7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:34:06.453305 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1a0c32b9-0049-4b16-a6c3-3e34fb607ea9 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:34:06.453808 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1a0c32b9-0049-4b16-a6c3-3e34fb607ea9 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:34:06.454260 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1a0c32b9-0049-4b16-a6c3-3e34fb607ea9 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:34:06.454971 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1a0c32b9-0049-4b16-a6c3-3e34fb607ea9 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:34:06.455443 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1a0c32b9-0049-4b16-a6c3-3e34fb607ea9 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:34:06.455889 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1a0c32b9-0049-4b16-a6c3-3e34fb607ea9 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:34:06.587943 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1a0c32b9-0049-4b16-a6c3-3e34fb607ea9 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:34:06.596372 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1a0c32b9-0049-4b16-a6c3-3e34fb607ea9 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/00a3e430-8bea-4db7-b36a-edca9fb29ab7" status: 200 len: 1452 microversion: 2.1 time: 0.155135 Sep 08 11:34:06.596948 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3296/6725] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:34:06 2022] GET /compute/v2.1/servers/00a3e430-8bea-4db7-b36a-edca9fb29ab7 => generated 1452 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:34:06.618998 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3cd4c56a-805d-4b7d-8d1f-b68ff611b71e tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:34:06.619635 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3cd4c56a-805d-4b7d-8d1f-b68ff611b71e tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 00a3e430-8bea-4db7-b36a-edca9fb29ab7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:34:06.626900 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3cd4c56a-805d-4b7d-8d1f-b68ff611b71e tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:34:06.627398 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3cd4c56a-805d-4b7d-8d1f-b68ff611b71e tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:34:06.627845 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3cd4c56a-805d-4b7d-8d1f-b68ff611b71e tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:34:06.628552 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3cd4c56a-805d-4b7d-8d1f-b68ff611b71e tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:34:06.629099 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3cd4c56a-805d-4b7d-8d1f-b68ff611b71e tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:34:06.629541 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3cd4c56a-805d-4b7d-8d1f-b68ff611b71e tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:34:06.764247 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-3cd4c56a-805d-4b7d-8d1f-b68ff611b71e tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:34:06.772133 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3cd4c56a-805d-4b7d-8d1f-b68ff611b71e tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/00a3e430-8bea-4db7-b36a-edca9fb29ab7" status: 200 len: 1452 microversion: 2.1 time: 0.157096 Sep 08 11:34:06.772702 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3430/6726] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:34:06 2022] GET /compute/v2.1/servers/00a3e430-8bea-4db7-b36a-edca9fb29ab7 => generated 1452 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:34:08.627422 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-40867ff1-3d06-43cf-a987-aa9d098c84a0 req-6a4b8420-3fa5-4a00-9df9-36bc85e1b5fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00a3e430-8bea-4db7-b36a-edca9fb29ab7", "tag": "49679858-cf1f-4bb5-9e4e-08614fb2e8c7"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:34:08.638683 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-40867ff1-3d06-43cf-a987-aa9d098c84a0 req-6a4b8420-3fa5-4a00-9df9-36bc85e1b5fd service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:34:08.639261 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-40867ff1-3d06-43cf-a987-aa9d098c84a0 req-6a4b8420-3fa5-4a00-9df9-36bc85e1b5fd service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:34:08.639779 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-40867ff1-3d06-43cf-a987-aa9d098c84a0 req-6a4b8420-3fa5-4a00-9df9-36bc85e1b5fd service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:34:08.651068 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-40867ff1-3d06-43cf-a987-aa9d098c84a0 req-6a4b8420-3fa5-4a00-9df9-36bc85e1b5fd service nova] Creating event network-changed:49679858-cf1f-4bb5-9e4e-08614fb2e8c7 for instance 00a3e430-8bea-4db7-b36a-edca9fb29ab7 on n-h2-850501-12 Sep 08 11:34:08.656781 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-40867ff1-3d06-43cf-a987-aa9d098c84a0 req-6a4b8420-3fa5-4a00-9df9-36bc85e1b5fd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033240 Sep 08 11:34:08.657565 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3297/6727] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:34:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:35:48.528642 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:35:48.530118 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=58 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:35:48.531861 n-d-850501-12 devstack@n-api.service[128861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 11:35:48.532045 n-d-850501-12 devstack@n-api.service[128861]: Thu Sep 8 11:35:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/00a3e430-8bea-4db7-b36a-edca9fb29ab7 (ip 10.222.0.27) !!! Sep 08 11:35:48.536682 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-eb057991-80f5-4664-8632-a4073ada2199 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:35:48.537362 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-eb057991-80f5-4664-8632-a4073ada2199 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 00a3e430-8bea-4db7-b36a-edca9fb29ab7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:35:48.552439 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eb057991-80f5-4664-8632-a4073ada2199 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:35:48.552950 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eb057991-80f5-4664-8632-a4073ada2199 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:35:48.553434 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eb057991-80f5-4664-8632-a4073ada2199 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:35:48.554155 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eb057991-80f5-4664-8632-a4073ada2199 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:35:48.555111 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eb057991-80f5-4664-8632-a4073ada2199 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:35:48.555578 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eb057991-80f5-4664-8632-a4073ada2199 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:35:48.583786 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-eb057991-80f5-4664-8632-a4073ada2199 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 00a3e430-8bea-4db7-b36a-edca9fb29ab7] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:35:48.623419 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=24 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:35:48.624833 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=52 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:35:48.626202 n-d-850501-12 devstack@n-api.service[128862]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 11:35:48.626367 n-d-850501-12 devstack@n-api.service[128862]: Thu Sep 8 11:35:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.27) !!! Sep 08 11:35:48.678525 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-eb057991-80f5-4664-8632-a4073ada2199 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "DELETE /compute/v2.1/servers/00a3e430-8bea-4db7-b36a-edca9fb29ab7" status: 204 len: 0 microversion: 2.1 time: 0.151742 Sep 08 11:35:48.679313 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3431/6728] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:35:48 2022] DELETE /compute/v2.1/servers/00a3e430-8bea-4db7-b36a-edca9fb29ab7 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:35:48.689765 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6116d305-c0c0-47a7-99ef-2a27e6c3b1a8 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:35:48.690486 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6116d305-c0c0-47a7-99ef-2a27e6c3b1a8 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 00a3e430-8bea-4db7-b36a-edca9fb29ab7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:35:48.696881 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6116d305-c0c0-47a7-99ef-2a27e6c3b1a8 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:35:48.697420 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6116d305-c0c0-47a7-99ef-2a27e6c3b1a8 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:35:48.697860 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6116d305-c0c0-47a7-99ef-2a27e6c3b1a8 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:35:48.698567 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6116d305-c0c0-47a7-99ef-2a27e6c3b1a8 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:35:48.699024 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6116d305-c0c0-47a7-99ef-2a27e6c3b1a8 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:35:48.699453 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6116d305-c0c0-47a7-99ef-2a27e6c3b1a8 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:35:48.734534 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-974a2792-41b8-468c-8ecf-08ab10e72f04 req-1d47b0c7-2b56-4522-af47-adb6874c7a03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00a3e430-8bea-4db7-b36a-edca9fb29ab7", "tag": "49679858-cf1f-4bb5-9e4e-08614fb2e8c7"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:35:48.746135 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-974a2792-41b8-468c-8ecf-08ab10e72f04 req-1d47b0c7-2b56-4522-af47-adb6874c7a03 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:35:48.746896 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-974a2792-41b8-468c-8ecf-08ab10e72f04 req-1d47b0c7-2b56-4522-af47-adb6874c7a03 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:35:48.747513 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-974a2792-41b8-468c-8ecf-08ab10e72f04 req-1d47b0c7-2b56-4522-af47-adb6874c7a03 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:35:48.758675 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-974a2792-41b8-468c-8ecf-08ab10e72f04 req-1d47b0c7-2b56-4522-af47-adb6874c7a03 service nova] Creating event network-changed:49679858-cf1f-4bb5-9e4e-08614fb2e8c7 for instance 00a3e430-8bea-4db7-b36a-edca9fb29ab7 on n-h2-850501-12 Sep 08 11:35:48.764013 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-974a2792-41b8-468c-8ecf-08ab10e72f04 req-1d47b0c7-2b56-4522-af47-adb6874c7a03 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143818 Sep 08 11:35:48.765017 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3298/6729] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:35:48.975035 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6116d305-c0c0-47a7-99ef-2a27e6c3b1a8 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:35:48.983715 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6116d305-c0c0-47a7-99ef-2a27e6c3b1a8 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/00a3e430-8bea-4db7-b36a-edca9fb29ab7" status: 200 len: 1577 microversion: 2.1 time: 0.298438 Sep 08 11:35:48.984313 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3432/6730] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:35:48 2022] GET /compute/v2.1/servers/00a3e430-8bea-4db7-b36a-edca9fb29ab7 => generated 1577 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:35:50.009564 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d20db8a9-bcb3-48a0-b360-941fbc4e1c4e tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:35:50.010290 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d20db8a9-bcb3-48a0-b360-941fbc4e1c4e tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 00a3e430-8bea-4db7-b36a-edca9fb29ab7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:35:50.016509 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d20db8a9-bcb3-48a0-b360-941fbc4e1c4e tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:35:50.017015 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d20db8a9-bcb3-48a0-b360-941fbc4e1c4e tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:35:50.017498 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d20db8a9-bcb3-48a0-b360-941fbc4e1c4e tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:35:50.018230 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d20db8a9-bcb3-48a0-b360-941fbc4e1c4e tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:35:50.018704 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d20db8a9-bcb3-48a0-b360-941fbc4e1c4e tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:35:50.019152 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d20db8a9-bcb3-48a0-b360-941fbc4e1c4e tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:35:50.247651 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d20db8a9-bcb3-48a0-b360-941fbc4e1c4e tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:35:50.255596 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d20db8a9-bcb3-48a0-b360-941fbc4e1c4e tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/00a3e430-8bea-4db7-b36a-edca9fb29ab7" status: 200 len: 1577 microversion: 2.1 time: 0.251806 Sep 08 11:35:50.256097 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3299/6731] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:35:50 2022] GET /compute/v2.1/servers/00a3e430-8bea-4db7-b36a-edca9fb29ab7 => generated 1577 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:35:51.036694 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-5c65dfb6-9ea3-4c77-8786-3bb4b2172b56 req-9207e502-08f3-46d5-b958-c37c3944ff9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00a3e430-8bea-4db7-b36a-edca9fb29ab7", "name": "network-vif-deleted", "tag": "49679858-cf1f-4bb5-9e4e-08614fb2e8c7"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:35:51.046922 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-5c65dfb6-9ea3-4c77-8786-3bb4b2172b56 req-9207e502-08f3-46d5-b958-c37c3944ff9f service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:35:51.047409 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-5c65dfb6-9ea3-4c77-8786-3bb4b2172b56 req-9207e502-08f3-46d5-b958-c37c3944ff9f service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:35:51.047846 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-5c65dfb6-9ea3-4c77-8786-3bb4b2172b56 req-9207e502-08f3-46d5-b958-c37c3944ff9f service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:35:51.063204 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-5c65dfb6-9ea3-4c77-8786-3bb4b2172b56 req-9207e502-08f3-46d5-b958-c37c3944ff9f service nova] Creating event network-vif-deleted:49679858-cf1f-4bb5-9e4e-08614fb2e8c7 for instance 00a3e430-8bea-4db7-b36a-edca9fb29ab7 on n-h2-850501-12 Sep 08 11:35:51.068598 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-5c65dfb6-9ea3-4c77-8786-3bb4b2172b56 req-9207e502-08f3-46d5-b958-c37c3944ff9f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088941 Sep 08 11:35:51.069464 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3433/6732] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:35:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:35:51.280122 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5f8f975a-9269-4986-80c2-5af3f237b851 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:35:51.280749 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5f8f975a-9269-4986-80c2-5af3f237b851 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 00a3e430-8bea-4db7-b36a-edca9fb29ab7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:35:51.288671 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5f8f975a-9269-4986-80c2-5af3f237b851 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:35:51.289420 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5f8f975a-9269-4986-80c2-5af3f237b851 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:35:51.289978 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5f8f975a-9269-4986-80c2-5af3f237b851 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:35:51.290699 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5f8f975a-9269-4986-80c2-5af3f237b851 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:35:51.291345 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5f8f975a-9269-4986-80c2-5af3f237b851 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:35:51.291873 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5f8f975a-9269-4986-80c2-5af3f237b851 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:35:51.369588 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5f8f975a-9269-4986-80c2-5af3f237b851 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:35:51.377538 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5f8f975a-9269-4986-80c2-5af3f237b851 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/00a3e430-8bea-4db7-b36a-edca9fb29ab7" status: 200 len: 1226 microversion: 2.1 time: 0.101527 Sep 08 11:35:51.378258 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3300/6733] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:35:51 2022] GET /compute/v2.1/servers/00a3e430-8bea-4db7-b36a-edca9fb29ab7 => generated 1226 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:35:52.403043 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-96f8dd30-8b1f-4153-8e3d-63cc7daa0c6a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:35:52.403754 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-96f8dd30-8b1f-4153-8e3d-63cc7daa0c6a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 00a3e430-8bea-4db7-b36a-edca9fb29ab7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:35:52.411660 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-96f8dd30-8b1f-4153-8e3d-63cc7daa0c6a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:35:52.412414 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-96f8dd30-8b1f-4153-8e3d-63cc7daa0c6a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:35:52.413065 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-96f8dd30-8b1f-4153-8e3d-63cc7daa0c6a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:35:52.413949 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-96f8dd30-8b1f-4153-8e3d-63cc7daa0c6a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:35:52.414406 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-96f8dd30-8b1f-4153-8e3d-63cc7daa0c6a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:35:52.415037 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-96f8dd30-8b1f-4153-8e3d-63cc7daa0c6a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:35:52.487357 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-96f8dd30-8b1f-4153-8e3d-63cc7daa0c6a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:35:52.495512 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-96f8dd30-8b1f-4153-8e3d-63cc7daa0c6a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/00a3e430-8bea-4db7-b36a-edca9fb29ab7" status: 200 len: 1226 microversion: 2.1 time: 0.097787 Sep 08 11:35:52.496156 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3434/6734] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:35:52 2022] GET /compute/v2.1/servers/00a3e430-8bea-4db7-b36a-edca9fb29ab7 => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:35:53.518224 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b1b3855c-7072-4372-8498-e86784ed9c32 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:35:53.518857 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b1b3855c-7072-4372-8498-e86784ed9c32 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 00a3e430-8bea-4db7-b36a-edca9fb29ab7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:35:53.526328 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1b3855c-7072-4372-8498-e86784ed9c32 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:35:53.526827 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1b3855c-7072-4372-8498-e86784ed9c32 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:35:53.527282 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1b3855c-7072-4372-8498-e86784ed9c32 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:35:53.528005 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1b3855c-7072-4372-8498-e86784ed9c32 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:35:53.528478 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1b3855c-7072-4372-8498-e86784ed9c32 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:35:53.528920 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1b3855c-7072-4372-8498-e86784ed9c32 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:35:53.592120 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b1b3855c-7072-4372-8498-e86784ed9c32 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:35:53.599993 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b1b3855c-7072-4372-8498-e86784ed9c32 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/00a3e430-8bea-4db7-b36a-edca9fb29ab7" status: 200 len: 1226 microversion: 2.1 time: 0.085720 Sep 08 11:35:53.600579 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3301/6735] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:35:53 2022] GET /compute/v2.1/servers/00a3e430-8bea-4db7-b36a-edca9fb29ab7 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:35:54.623641 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7fbe9dab-0360-46c7-8e79-f018cd5f144d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:35:54.624172 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7fbe9dab-0360-46c7-8e79-f018cd5f144d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 00a3e430-8bea-4db7-b36a-edca9fb29ab7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:35:54.631006 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7fbe9dab-0360-46c7-8e79-f018cd5f144d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:35:54.631510 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7fbe9dab-0360-46c7-8e79-f018cd5f144d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:35:54.631965 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7fbe9dab-0360-46c7-8e79-f018cd5f144d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:35:54.633384 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7fbe9dab-0360-46c7-8e79-f018cd5f144d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:35:54.634261 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7fbe9dab-0360-46c7-8e79-f018cd5f144d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:35:54.635828 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7fbe9dab-0360-46c7-8e79-f018cd5f144d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:35:54.701770 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7fbe9dab-0360-46c7-8e79-f018cd5f144d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:35:54.709930 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7fbe9dab-0360-46c7-8e79-f018cd5f144d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/00a3e430-8bea-4db7-b36a-edca9fb29ab7" status: 200 len: 1226 microversion: 2.1 time: 0.090412 Sep 08 11:35:54.710609 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3435/6736] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:35:54 2022] GET /compute/v2.1/servers/00a3e430-8bea-4db7-b36a-edca9fb29ab7 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:35:55.734089 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f577bbc1-3f6a-4d71-94d6-e6422b48895a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:35:55.734658 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f577bbc1-3f6a-4d71-94d6-e6422b48895a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 00a3e430-8bea-4db7-b36a-edca9fb29ab7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:35:55.741540 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f577bbc1-3f6a-4d71-94d6-e6422b48895a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:35:55.742703 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f577bbc1-3f6a-4d71-94d6-e6422b48895a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:35:55.743163 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f577bbc1-3f6a-4d71-94d6-e6422b48895a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:35:55.743885 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f577bbc1-3f6a-4d71-94d6-e6422b48895a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:35:55.744357 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f577bbc1-3f6a-4d71-94d6-e6422b48895a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:35:55.744798 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f577bbc1-3f6a-4d71-94d6-e6422b48895a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:35:55.761072 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-f577bbc1-3f6a-4d71-94d6-e6422b48895a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] HTTP exception thrown: Instance 00a3e430-8bea-4db7-b36a-edca9fb29ab7 could not be found. Sep 08 11:35:55.762727 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f577bbc1-3f6a-4d71-94d6-e6422b48895a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Request method failure captured: Sep 08 11:35:55.762727 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/00a3e430-8bea-4db7-b36a-edca9fb29ab7 HTTP/1.1 Sep 08 11:35:55.762727 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 11:35:55.762727 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 11:35:55.762727 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 11:35:55.762727 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 11:35:55.762727 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 11:35:55.762727 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 11:35:55.762727 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 11:35:55.762727 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 11:35:55.762727 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGdEih_jYhjrfzcEat7QOG_17jH52nIZFToedVJMJ8Jj4pTKrcjanm3D8dChnqEL9d7jV5rq3NW7Z60oajSkgXZAcEtwDn7-PJMU6a9_UOAo8UiiyZ8L4GogQF4UWk_-Vlyi8Q447m99c-S3nr2fWKYhvhV9-SsmuV-ccLSbm0hBFVVM Sep 08 11:35:55.762727 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 11:35:55.762727 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 11:35:55.762727 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 11:35:55.762727 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 11:35:55.762727 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 11:35:55.762727 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 11:35:55.762727 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 747bb5860ba14a20bba3b1c2197ea75d Sep 08 11:35:55.762727 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-TestVolumeBootPattern-1812135790 Sep 08 11:35:55.762727 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 11:35:55.762727 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 11:35:55.762727 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/747bb5860ba14a20bba3b1c2197ea75d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/747bb5860ba14a20bba3b1c2197ea75d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_747bb5860ba14a20bba3b1c2197ea75d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/747bb5860ba14a20bba3b1c2197ea75d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:35:55.762727 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-TestVolumeBootPattern-1812135790 Sep 08 11:35:55.762727 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 747bb5860ba14a20bba3b1c2197ea75d Sep 08 11:35:55.762727 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-TestVolumeBootPattern-1812135790 Sep 08 11:35:55.762727 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-TestVolumeBootPattern-1812135790-project Sep 08 11:35:55.762727 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 11:35:55.762727 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 11:35:55.762727 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: bc18639e461e4ef5bfcf4380c561f329 Sep 08 11:35:55.762727 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-TestVolumeBootPattern-1812135790-project Sep 08 11:35:55.762727 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 11:35:55.762727 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 00a3e430-8bea-4db7-b36a-edca9fb29ab7 could not be found. Sep 08 11:35:55.762727 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '00a3e430-8bea-4db7-b36a-edca9fb29ab7'} Sep 08 11:35:55.762727 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:35:55.762727 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:35:55.762727 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:35:55.762727 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:35:55.762727 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:35:55.762727 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:35:55.762727 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:35:55.762727 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:35:55.762727 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:35:55.762727 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:35:55.762727 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00a3e430-8bea-4db7-b36a-edca9fb29ab7 could not be found. Sep 08 11:35:55.762727 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:35:55.762727 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:35:55.762727 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:35:55.762727 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:35:55.762727 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:35:55.762727 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:35:55.762727 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:35:55.762727 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:35:55.762727 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:35:55.762727 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:35:55.762727 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:35:55.762727 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:35:55.762727 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:35:55.762727 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:35:55.762727 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:35:55.762727 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:35:55.762727 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00a3e430-8bea-4db7-b36a-edca9fb29ab7 could not be found. Sep 08 11:35:55.762727 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:35:55.762727 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:35:55.762727 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:35:55.766896 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:35:55.766896 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:35:55.766896 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:35:55.766896 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:35:55.766896 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:35:55.766896 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00a3e430-8bea-4db7-b36a-edca9fb29ab7 could not be found. Sep 08 11:35:55.766896 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:35:55.766896 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f577bbc1-3f6a-4d71-94d6-e6422b48895a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Returning 404 to user: Instance 00a3e430-8bea-4db7-b36a-edca9fb29ab7 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:35:55.766896 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f577bbc1-3f6a-4d71-94d6-e6422b48895a tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/00a3e430-8bea-4db7-b36a-edca9fb29ab7" status: 404 len: 111 microversion: 2.1 time: 0.034369 Sep 08 11:35:55.766896 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3302/6737] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:35:55 2022] GET /compute/v2.1/servers/00a3e430-8bea-4db7-b36a-edca9fb29ab7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:36:02.002566 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9568b474-a188-49dc-900b-70dd443f5047 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:36:02.008293 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-1a18309d-41b6-4f2f-85f7-24e73e12d057 req-06855138-15f4-48e9-a765-8f3885d675d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3718be4c-8edc-4133-9563-6241a5a5bb4b", "tag": "735915a5-fe49-4d6e-8bbb-f52430191b74"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:36:02.013634 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9568b474-a188-49dc-900b-70dd443f5047 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 3718be4c-8edc-4133-9563-6241a5a5bb4b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:36:02.021102 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9568b474-a188-49dc-900b-70dd443f5047 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:02.021865 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9568b474-a188-49dc-900b-70dd443f5047 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:02.022321 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9568b474-a188-49dc-900b-70dd443f5047 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:02.022786 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-1a18309d-41b6-4f2f-85f7-24e73e12d057 req-06855138-15f4-48e9-a765-8f3885d675d4 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:02.023329 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9568b474-a188-49dc-900b-70dd443f5047 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:02.023638 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-1a18309d-41b6-4f2f-85f7-24e73e12d057 req-06855138-15f4-48e9-a765-8f3885d675d4 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:02.023804 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9568b474-a188-49dc-900b-70dd443f5047 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:02.024096 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-1a18309d-41b6-4f2f-85f7-24e73e12d057 req-06855138-15f4-48e9-a765-8f3885d675d4 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:02.024417 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9568b474-a188-49dc-900b-70dd443f5047 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:02.040476 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-1a18309d-41b6-4f2f-85f7-24e73e12d057 req-06855138-15f4-48e9-a765-8f3885d675d4 service nova] Creating event network-changed:735915a5-fe49-4d6e-8bbb-f52430191b74 for instance 3718be4c-8edc-4133-9563-6241a5a5bb4b on n-h1-850501-12 Sep 08 11:36:02.046269 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-1a18309d-41b6-4f2f-85f7-24e73e12d057 req-06855138-15f4-48e9-a765-8f3885d675d4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042194 Sep 08 11:36:02.046943 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3303/6738] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:36:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:36:02.056377 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9568b474-a188-49dc-900b-70dd443f5047 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 3718be4c-8edc-4133-9563-6241a5a5bb4b] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:36:02.150505 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9568b474-a188-49dc-900b-70dd443f5047 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3718be4c-8edc-4133-9563-6241a5a5bb4b" status: 204 len: 0 microversion: 2.1 time: 0.151576 Sep 08 11:36:02.151285 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3436/6739] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:36:01 2022] DELETE /compute/v2.1/servers/3718be4c-8edc-4133-9563-6241a5a5bb4b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:36:02.160330 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2274c596-958a-4705-bdfe-93a98e3f1c88 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:36:02.161448 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2274c596-958a-4705-bdfe-93a98e3f1c88 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 3718be4c-8edc-4133-9563-6241a5a5bb4b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:36:02.168905 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2274c596-958a-4705-bdfe-93a98e3f1c88 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:02.169800 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2274c596-958a-4705-bdfe-93a98e3f1c88 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:02.170477 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2274c596-958a-4705-bdfe-93a98e3f1c88 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:02.171444 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2274c596-958a-4705-bdfe-93a98e3f1c88 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:02.172119 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2274c596-958a-4705-bdfe-93a98e3f1c88 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:02.172763 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2274c596-958a-4705-bdfe-93a98e3f1c88 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:02.362105 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2274c596-958a-4705-bdfe-93a98e3f1c88 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:36:02.371452 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2274c596-958a-4705-bdfe-93a98e3f1c88 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/3718be4c-8edc-4133-9563-6241a5a5bb4b" status: 200 len: 1576 microversion: 2.1 time: 0.215436 Sep 08 11:36:02.371952 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3304/6740] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:36:02 2022] GET /compute/v2.1/servers/3718be4c-8edc-4133-9563-6241a5a5bb4b => generated 1576 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:36:03.396778 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5096bca6-dbb1-431e-aa80-96c0d123dc77 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:36:03.397519 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5096bca6-dbb1-431e-aa80-96c0d123dc77 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 3718be4c-8edc-4133-9563-6241a5a5bb4b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:36:03.406895 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5096bca6-dbb1-431e-aa80-96c0d123dc77 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:03.407392 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5096bca6-dbb1-431e-aa80-96c0d123dc77 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:03.407843 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5096bca6-dbb1-431e-aa80-96c0d123dc77 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:03.408552 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5096bca6-dbb1-431e-aa80-96c0d123dc77 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:03.409011 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5096bca6-dbb1-431e-aa80-96c0d123dc77 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:03.409466 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5096bca6-dbb1-431e-aa80-96c0d123dc77 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:03.578200 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5096bca6-dbb1-431e-aa80-96c0d123dc77 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:36:03.589112 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5096bca6-dbb1-431e-aa80-96c0d123dc77 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/3718be4c-8edc-4133-9563-6241a5a5bb4b" status: 200 len: 1576 microversion: 2.1 time: 0.194010 Sep 08 11:36:03.589112 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3437/6741] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:36:03 2022] GET /compute/v2.1/servers/3718be4c-8edc-4133-9563-6241a5a5bb4b => generated 1576 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:36:04.260841 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-8352cd89-13a8-444e-9b3f-87a7c2d7b03e req-9c36d148-e604-4c38-a3ca-54557d8aa381 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3718be4c-8edc-4133-9563-6241a5a5bb4b", "name": "network-vif-deleted", "tag": "735915a5-fe49-4d6e-8bbb-f52430191b74"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:36:04.276280 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-8352cd89-13a8-444e-9b3f-87a7c2d7b03e req-9c36d148-e604-4c38-a3ca-54557d8aa381 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:04.276776 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-8352cd89-13a8-444e-9b3f-87a7c2d7b03e req-9c36d148-e604-4c38-a3ca-54557d8aa381 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:04.277319 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-8352cd89-13a8-444e-9b3f-87a7c2d7b03e req-9c36d148-e604-4c38-a3ca-54557d8aa381 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:04.291020 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-8352cd89-13a8-444e-9b3f-87a7c2d7b03e req-9c36d148-e604-4c38-a3ca-54557d8aa381 service nova] Creating event network-vif-deleted:735915a5-fe49-4d6e-8bbb-f52430191b74 for instance 3718be4c-8edc-4133-9563-6241a5a5bb4b on n-h1-850501-12 Sep 08 11:36:04.296836 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-8352cd89-13a8-444e-9b3f-87a7c2d7b03e req-9c36d148-e604-4c38-a3ca-54557d8aa381 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040697 Sep 08 11:36:04.297467 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3305/6742] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:36:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:36:04.611463 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7f124c3b-b78c-40e6-8894-aa66897a465b tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:36:04.611993 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7f124c3b-b78c-40e6-8894-aa66897a465b tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 3718be4c-8edc-4133-9563-6241a5a5bb4b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:36:04.619229 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7f124c3b-b78c-40e6-8894-aa66897a465b tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:04.619830 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7f124c3b-b78c-40e6-8894-aa66897a465b tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:04.620463 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7f124c3b-b78c-40e6-8894-aa66897a465b tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:04.621437 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7f124c3b-b78c-40e6-8894-aa66897a465b tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:04.622059 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7f124c3b-b78c-40e6-8894-aa66897a465b tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:04.622494 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7f124c3b-b78c-40e6-8894-aa66897a465b tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:04.691895 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7f124c3b-b78c-40e6-8894-aa66897a465b tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:36:04.700500 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7f124c3b-b78c-40e6-8894-aa66897a465b tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/3718be4c-8edc-4133-9563-6241a5a5bb4b" status: 200 len: 1226 microversion: 2.1 time: 0.094136 Sep 08 11:36:04.701111 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3438/6743] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:36:04 2022] GET /compute/v2.1/servers/3718be4c-8edc-4133-9563-6241a5a5bb4b => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:36:05.724256 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-53d04cad-a8cd-41cf-8a67-678a4146cdb4 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:36:05.725035 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-53d04cad-a8cd-41cf-8a67-678a4146cdb4 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 3718be4c-8edc-4133-9563-6241a5a5bb4b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:36:05.733453 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53d04cad-a8cd-41cf-8a67-678a4146cdb4 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:05.733898 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53d04cad-a8cd-41cf-8a67-678a4146cdb4 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:05.734357 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53d04cad-a8cd-41cf-8a67-678a4146cdb4 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:05.735083 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53d04cad-a8cd-41cf-8a67-678a4146cdb4 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:05.735558 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53d04cad-a8cd-41cf-8a67-678a4146cdb4 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:05.736000 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53d04cad-a8cd-41cf-8a67-678a4146cdb4 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:05.801217 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-53d04cad-a8cd-41cf-8a67-678a4146cdb4 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:36:05.809758 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-53d04cad-a8cd-41cf-8a67-678a4146cdb4 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/3718be4c-8edc-4133-9563-6241a5a5bb4b" status: 200 len: 1226 microversion: 2.1 time: 0.089683 Sep 08 11:36:05.810342 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3306/6744] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:36:05 2022] GET /compute/v2.1/servers/3718be4c-8edc-4133-9563-6241a5a5bb4b => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:36:06.831981 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4a5f1f46-f23d-48de-a682-e59eb956867b tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:36:06.832602 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4a5f1f46-f23d-48de-a682-e59eb956867b tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 3718be4c-8edc-4133-9563-6241a5a5bb4b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:36:06.839775 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a5f1f46-f23d-48de-a682-e59eb956867b tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:06.840259 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a5f1f46-f23d-48de-a682-e59eb956867b tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:06.840702 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a5f1f46-f23d-48de-a682-e59eb956867b tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:06.841459 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a5f1f46-f23d-48de-a682-e59eb956867b tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:06.841921 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a5f1f46-f23d-48de-a682-e59eb956867b tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:06.842349 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a5f1f46-f23d-48de-a682-e59eb956867b tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:06.909797 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4a5f1f46-f23d-48de-a682-e59eb956867b tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:36:06.918661 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4a5f1f46-f23d-48de-a682-e59eb956867b tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/3718be4c-8edc-4133-9563-6241a5a5bb4b" status: 200 len: 1226 microversion: 2.1 time: 0.090589 Sep 08 11:36:06.919461 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3439/6745] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:36:06 2022] GET /compute/v2.1/servers/3718be4c-8edc-4133-9563-6241a5a5bb4b => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:36:07.941336 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1b24a0be-c369-42bd-9bff-8683622aec5d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:36:07.941962 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1b24a0be-c369-42bd-9bff-8683622aec5d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 3718be4c-8edc-4133-9563-6241a5a5bb4b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:36:07.950536 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b24a0be-c369-42bd-9bff-8683622aec5d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:07.951040 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b24a0be-c369-42bd-9bff-8683622aec5d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:07.951491 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b24a0be-c369-42bd-9bff-8683622aec5d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:07.952214 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b24a0be-c369-42bd-9bff-8683622aec5d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:07.952665 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b24a0be-c369-42bd-9bff-8683622aec5d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:07.953124 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b24a0be-c369-42bd-9bff-8683622aec5d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:08.017231 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1b24a0be-c369-42bd-9bff-8683622aec5d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc18639e461e4ef5bfcf4380c561f329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747bb5860ba14a20bba3b1c2197ea75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:36:08.025757 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1b24a0be-c369-42bd-9bff-8683622aec5d tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/3718be4c-8edc-4133-9563-6241a5a5bb4b" status: 200 len: 1226 microversion: 2.1 time: 0.088283 Sep 08 11:36:08.026352 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3307/6746] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:36:07 2022] GET /compute/v2.1/servers/3718be4c-8edc-4133-9563-6241a5a5bb4b => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:36:09.048369 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-444dc852-d957-4bb8-8280-8465ca9ce6ba tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:36:09.048877 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-444dc852-d957-4bb8-8280-8465ca9ce6ba tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 3718be4c-8edc-4133-9563-6241a5a5bb4b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:36:09.055736 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-444dc852-d957-4bb8-8280-8465ca9ce6ba tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:09.056225 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-444dc852-d957-4bb8-8280-8465ca9ce6ba tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:09.056662 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-444dc852-d957-4bb8-8280-8465ca9ce6ba tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:09.057535 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-444dc852-d957-4bb8-8280-8465ca9ce6ba tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:09.057848 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-444dc852-d957-4bb8-8280-8465ca9ce6ba tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:09.058277 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-444dc852-d957-4bb8-8280-8465ca9ce6ba tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:09.072187 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-444dc852-d957-4bb8-8280-8465ca9ce6ba tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] HTTP exception thrown: Instance 3718be4c-8edc-4133-9563-6241a5a5bb4b could not be found. Sep 08 11:36:09.073865 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-444dc852-d957-4bb8-8280-8465ca9ce6ba tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Request method failure captured: Sep 08 11:36:09.073865 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/3718be4c-8edc-4133-9563-6241a5a5bb4b HTTP/1.1 Sep 08 11:36:09.073865 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:36:09.073865 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:36:09.073865 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:36:09.073865 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 11:36:09.073865 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:36:09.073865 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:36:09.073865 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:36:09.073865 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:36:09.073865 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGdEih_jYhjrfzcEat7QOG_17jH52nIZFToedVJMJ8Jj4pTKrcjanm3D8dChnqEL9d7jV5rq3NW7Z60oajSkgXZAcEtwDn7-PJMU6a9_UOAo8UiiyZ8L4GogQF4UWk_-Vlyi8Q447m99c-S3nr2fWKYhvhV9-SsmuV-ccLSbm0hBFVVM Sep 08 11:36:09.073865 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:36:09.073865 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:36:09.073865 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:36:09.073865 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:36:09.073865 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:36:09.073865 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:36:09.073865 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 747bb5860ba14a20bba3b1c2197ea75d Sep 08 11:36:09.073865 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-TestVolumeBootPattern-1812135790 Sep 08 11:36:09.073865 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:36:09.073865 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:36:09.073865 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/747bb5860ba14a20bba3b1c2197ea75d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/747bb5860ba14a20bba3b1c2197ea75d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_747bb5860ba14a20bba3b1c2197ea75d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/747bb5860ba14a20bba3b1c2197ea75d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:36:09.073865 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-TestVolumeBootPattern-1812135790 Sep 08 11:36:09.073865 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 747bb5860ba14a20bba3b1c2197ea75d Sep 08 11:36:09.073865 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-TestVolumeBootPattern-1812135790 Sep 08 11:36:09.073865 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-TestVolumeBootPattern-1812135790-project Sep 08 11:36:09.073865 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:36:09.073865 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:36:09.073865 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: bc18639e461e4ef5bfcf4380c561f329 Sep 08 11:36:09.073865 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-TestVolumeBootPattern-1812135790-project Sep 08 11:36:09.073865 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 11:36:09.073865 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 3718be4c-8edc-4133-9563-6241a5a5bb4b could not be found. Sep 08 11:36:09.073865 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '3718be4c-8edc-4133-9563-6241a5a5bb4b'} Sep 08 11:36:09.073865 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:36:09.073865 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:36:09.073865 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:36:09.073865 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:36:09.073865 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:36:09.073865 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:36:09.073865 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:36:09.073865 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:36:09.073865 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:36:09.073865 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:36:09.073865 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3718be4c-8edc-4133-9563-6241a5a5bb4b could not be found. Sep 08 11:36:09.073865 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:36:09.073865 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:36:09.073865 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:36:09.073865 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:36:09.073865 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:36:09.073865 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:36:09.073865 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:36:09.073865 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:36:09.073865 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:36:09.073865 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:36:09.073865 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:36:09.073865 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:36:09.073865 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:36:09.073865 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:36:09.073865 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:36:09.073865 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:36:09.073865 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3718be4c-8edc-4133-9563-6241a5a5bb4b could not be found. Sep 08 11:36:09.073865 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:36:09.073865 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:36:09.073865 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:36:09.078272 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:36:09.078272 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:36:09.078272 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:36:09.078272 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:36:09.078272 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:36:09.078272 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3718be4c-8edc-4133-9563-6241a5a5bb4b could not be found. Sep 08 11:36:09.078272 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:36:09.078272 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-444dc852-d957-4bb8-8280-8465ca9ce6ba tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Returning 404 to user: Instance 3718be4c-8edc-4133-9563-6241a5a5bb4b could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:36:09.078272 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-444dc852-d957-4bb8-8280-8465ca9ce6ba tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/3718be4c-8edc-4133-9563-6241a5a5bb4b" status: 404 len: 111 microversion: 2.1 time: 0.030914 Sep 08 11:36:09.078272 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3440/6747] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:36:09 2022] GET /compute/v2.1/servers/3718be4c-8edc-4133-9563-6241a5a5bb4b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:36:09.532818 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-92931f86-de2e-4be2-9f52-c1f966036327 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:36:09.533349 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-92931f86-de2e-4be2-9f52-c1f966036327 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 523b814d-0826-4b99-8a04-f3641f013caa] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:36:09.540221 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-92931f86-de2e-4be2-9f52-c1f966036327 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:09.540723 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-92931f86-de2e-4be2-9f52-c1f966036327 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:09.541204 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-92931f86-de2e-4be2-9f52-c1f966036327 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:09.541923 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-92931f86-de2e-4be2-9f52-c1f966036327 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:09.542394 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-92931f86-de2e-4be2-9f52-c1f966036327 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:09.542834 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-92931f86-de2e-4be2-9f52-c1f966036327 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:09.556816 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-92931f86-de2e-4be2-9f52-c1f966036327 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] HTTP exception thrown: Instance 523b814d-0826-4b99-8a04-f3641f013caa could not be found. Sep 08 11:36:09.558530 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-92931f86-de2e-4be2-9f52-c1f966036327 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Request method failure captured: Sep 08 11:36:09.558530 n-d-850501-12 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/servers/523b814d-0826-4b99-8a04-f3641f013caa HTTP/1.1 Sep 08 11:36:09.558530 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 11:36:09.558530 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 11:36:09.558530 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 11:36:09.558530 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 11:36:09.558530 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 11:36:09.558530 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 11:36:09.558530 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 11:36:09.558530 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 11:36:09.558530 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGdEih_jYhjrfzcEat7QOG_17jH52nIZFToedVJMJ8Jj4pTKrcjanm3D8dChnqEL9d7jV5rq3NW7Z60oajSkgXZAcEtwDn7-PJMU6a9_UOAo8UiiyZ8L4GogQF4UWk_-Vlyi8Q447m99c-S3nr2fWKYhvhV9-SsmuV-ccLSbm0hBFVVM Sep 08 11:36:09.558530 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 11:36:09.558530 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 11:36:09.558530 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 11:36:09.558530 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 11:36:09.558530 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 11:36:09.558530 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 11:36:09.558530 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 747bb5860ba14a20bba3b1c2197ea75d Sep 08 11:36:09.558530 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-TestVolumeBootPattern-1812135790 Sep 08 11:36:09.558530 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 11:36:09.558530 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 11:36:09.558530 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/747bb5860ba14a20bba3b1c2197ea75d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/747bb5860ba14a20bba3b1c2197ea75d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_747bb5860ba14a20bba3b1c2197ea75d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/747bb5860ba14a20bba3b1c2197ea75d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:36:09.558530 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-TestVolumeBootPattern-1812135790 Sep 08 11:36:09.558530 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 747bb5860ba14a20bba3b1c2197ea75d Sep 08 11:36:09.558530 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-TestVolumeBootPattern-1812135790 Sep 08 11:36:09.558530 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-TestVolumeBootPattern-1812135790-project Sep 08 11:36:09.558530 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 11:36:09.558530 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 11:36:09.558530 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: bc18639e461e4ef5bfcf4380c561f329 Sep 08 11:36:09.558530 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-TestVolumeBootPattern-1812135790-project Sep 08 11:36:09.558530 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 11:36:09.558530 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 523b814d-0826-4b99-8a04-f3641f013caa could not be found. Sep 08 11:36:09.558530 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '523b814d-0826-4b99-8a04-f3641f013caa'} Sep 08 11:36:09.558530 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:36:09.558530 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:36:09.558530 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:36:09.558530 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:36:09.558530 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:36:09.558530 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:36:09.558530 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:36:09.558530 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:36:09.558530 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:36:09.558530 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:36:09.558530 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 523b814d-0826-4b99-8a04-f3641f013caa could not be found. Sep 08 11:36:09.558530 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:36:09.558530 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:36:09.558530 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:36:09.558530 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:36:09.558530 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:36:09.558530 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:36:09.558530 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:36:09.558530 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:36:09.558530 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:36:09.558530 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:36:09.558530 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 11:36:09.558530 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 11:36:09.558530 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 11:36:09.558530 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 11:36:09.558530 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:36:09.558530 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:36:09.558530 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:36:09.558530 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:36:09.563037 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 523b814d-0826-4b99-8a04-f3641f013caa could not be found. Sep 08 11:36:09.563037 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:36:09.563037 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:36:09.563037 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:36:09.563037 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:36:09.563037 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:36:09.563037 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:36:09.563037 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:36:09.563037 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:36:09.563037 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 523b814d-0826-4b99-8a04-f3641f013caa could not be found. Sep 08 11:36:09.563037 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:36:09.563037 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-92931f86-de2e-4be2-9f52-c1f966036327 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Returning 404 to user: Instance 523b814d-0826-4b99-8a04-f3641f013caa could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:36:09.563037 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-92931f86-de2e-4be2-9f52-c1f966036327 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "DELETE /compute/v2.1/servers/523b814d-0826-4b99-8a04-f3641f013caa" status: 404 len: 111 microversion: 2.1 time: 0.031038 Sep 08 11:36:09.563037 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3308/6748] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:36:09 2022] DELETE /compute/v2.1/servers/523b814d-0826-4b99-8a04-f3641f013caa => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:36:09.569410 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ddf9bad1-5148-45b2-8067-77c92c4d08d4 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:36:09.570037 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ddf9bad1-5148-45b2-8067-77c92c4d08d4 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] [instance: 523b814d-0826-4b99-8a04-f3641f013caa] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:36:09.576841 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ddf9bad1-5148-45b2-8067-77c92c4d08d4 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:09.577378 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ddf9bad1-5148-45b2-8067-77c92c4d08d4 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:09.577817 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ddf9bad1-5148-45b2-8067-77c92c4d08d4 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:09.578513 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ddf9bad1-5148-45b2-8067-77c92c4d08d4 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:09.578977 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ddf9bad1-5148-45b2-8067-77c92c4d08d4 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:09.579411 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ddf9bad1-5148-45b2-8067-77c92c4d08d4 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:09.592997 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-ddf9bad1-5148-45b2-8067-77c92c4d08d4 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] HTTP exception thrown: Instance 523b814d-0826-4b99-8a04-f3641f013caa could not be found. Sep 08 11:36:09.594552 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ddf9bad1-5148-45b2-8067-77c92c4d08d4 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Request method failure captured: Sep 08 11:36:09.594552 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/523b814d-0826-4b99-8a04-f3641f013caa HTTP/1.1 Sep 08 11:36:09.594552 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:36:09.594552 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:36:09.594552 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:36:09.594552 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 11:36:09.594552 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:36:09.594552 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:36:09.594552 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:36:09.594552 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:36:09.594552 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGdEih_jYhjrfzcEat7QOG_17jH52nIZFToedVJMJ8Jj4pTKrcjanm3D8dChnqEL9d7jV5rq3NW7Z60oajSkgXZAcEtwDn7-PJMU6a9_UOAo8UiiyZ8L4GogQF4UWk_-Vlyi8Q447m99c-S3nr2fWKYhvhV9-SsmuV-ccLSbm0hBFVVM Sep 08 11:36:09.594552 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:36:09.594552 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:36:09.594552 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:36:09.594552 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:36:09.594552 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:36:09.594552 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:36:09.594552 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 747bb5860ba14a20bba3b1c2197ea75d Sep 08 11:36:09.594552 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-TestVolumeBootPattern-1812135790 Sep 08 11:36:09.594552 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:36:09.594552 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:36:09.594552 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/747bb5860ba14a20bba3b1c2197ea75d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/747bb5860ba14a20bba3b1c2197ea75d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_747bb5860ba14a20bba3b1c2197ea75d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/747bb5860ba14a20bba3b1c2197ea75d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:36:09.594552 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-TestVolumeBootPattern-1812135790 Sep 08 11:36:09.594552 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 747bb5860ba14a20bba3b1c2197ea75d Sep 08 11:36:09.594552 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-TestVolumeBootPattern-1812135790 Sep 08 11:36:09.594552 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-TestVolumeBootPattern-1812135790-project Sep 08 11:36:09.594552 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:36:09.594552 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:36:09.594552 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: bc18639e461e4ef5bfcf4380c561f329 Sep 08 11:36:09.594552 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-TestVolumeBootPattern-1812135790-project Sep 08 11:36:09.594552 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 11:36:09.594552 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 523b814d-0826-4b99-8a04-f3641f013caa could not be found. Sep 08 11:36:09.594552 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '523b814d-0826-4b99-8a04-f3641f013caa'} Sep 08 11:36:09.594552 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:36:09.594552 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:36:09.594552 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:36:09.594552 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:36:09.594552 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:36:09.594552 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:36:09.594552 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:36:09.594552 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:36:09.594552 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:36:09.594552 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:36:09.594552 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 523b814d-0826-4b99-8a04-f3641f013caa could not be found. Sep 08 11:36:09.594552 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:36:09.594552 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:36:09.594552 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:36:09.594552 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:36:09.594552 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:36:09.594552 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:36:09.594552 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:36:09.594552 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:36:09.594552 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:36:09.594552 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:36:09.594552 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:36:09.594552 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:36:09.594552 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:36:09.594552 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:36:09.594552 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:36:09.594552 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:36:09.594552 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 523b814d-0826-4b99-8a04-f3641f013caa could not be found. Sep 08 11:36:09.594552 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:36:09.594552 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:36:09.594552 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:36:09.598464 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:36:09.598464 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:36:09.598464 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:36:09.598464 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:36:09.598464 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:36:09.598464 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 523b814d-0826-4b99-8a04-f3641f013caa could not be found. Sep 08 11:36:09.598464 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:36:09.598464 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ddf9bad1-5148-45b2-8067-77c92c4d08d4 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Returning 404 to user: Instance 523b814d-0826-4b99-8a04-f3641f013caa could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:36:09.598464 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ddf9bad1-5148-45b2-8067-77c92c4d08d4 tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "GET /compute/v2.1/servers/523b814d-0826-4b99-8a04-f3641f013caa" status: 404 len: 111 microversion: 2.1 time: 0.030502 Sep 08 11:36:09.598464 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3441/6749] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:36:09 2022] GET /compute/v2.1/servers/523b814d-0826-4b99-8a04-f3641f013caa => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:36:13.049717 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dfbcefef-245d-48e3-a8da-250fd99ebfba tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] Calling method '.version_select at 0x7f68df732a60>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:36:13.077325 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-dfbcefef-245d-48e3-a8da-250fd99ebfba tempest-TestVolumeBootPattern-1812135790 tempest-TestVolumeBootPattern-1812135790-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1515082793" status: 202 len: 0 microversion: 2.1 time: 0.031569 Sep 08 11:36:13.077910 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3309/6750] 10.222.0.27 () {58 vars in 1263 bytes} [Thu Sep 8 11:36:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1515082793 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:36:31.524840 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:36:31.525618 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:36:31.638421 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-77a86837-f084-44bb-a77e-f92a6d70636a tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1392212980", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:36:31.691126 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-77a86837-f084-44bb-a77e-f92a6d70636a tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] validate_networks() for None {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:36:31.973456 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-77a86837-f084-44bb-a77e-f92a6d70636a tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:36:31.973890 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-77a86837-f084-44bb-a77e-f92a6d70636a tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:36:31.974380 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-77a86837-f084-44bb-a77e-f92a6d70636a tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:36:31.974798 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-77a86837-f084-44bb-a77e-f92a6d70636a tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:36:31.975230 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-77a86837-f084-44bb-a77e-f92a6d70636a tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:36:31.987776 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-77a86837-f084-44bb-a77e-f92a6d70636a tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:31.988268 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-77a86837-f084-44bb-a77e-f92a6d70636a tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:31.988713 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-77a86837-f084-44bb-a77e-f92a6d70636a tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:31.989490 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-77a86837-f084-44bb-a77e-f92a6d70636a tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:31.989954 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-77a86837-f084-44bb-a77e-f92a6d70636a tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:31.990388 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-77a86837-f084-44bb-a77e-f92a6d70636a tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:32.009157 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-77a86837-f084-44bb-a77e-f92a6d70636a tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Getting quotas for project c4478e152a6f4568840d90f8c978f24b. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:36:32.014333 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-77a86837-f084-44bb-a77e-f92a6d70636a tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Getting quotas for user 3feb9894a1ff49d2b0e923215473be4a and project c4478e152a6f4568840d90f8c978f24b. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:36:32.027993 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-77a86837-f084-44bb-a77e-f92a6d70636a tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:36:32.030351 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-77a86837-f084-44bb-a77e-f92a6d70636a tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] [instance: 7e300b4a-0e01-42ac-a828-6369b53c8357] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:36:32.075148 n-d-850501-12 devstack@n-api.service[128861]: ERROR oslo.messaging._drivers.impl_rabbit [None req-77a86837-f084-44bb-a77e-f92a6d70636a tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] [3dc4eafa-478c-4bf1-bf79-8e49cffb8753] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 08 11:36:33.082428 n-d-850501-12 devstack@n-api.service[128861]: INFO oslo.messaging._drivers.impl_rabbit [None req-77a86837-f084-44bb-a77e-f92a6d70636a tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] [3dc4eafa-478c-4bf1-bf79-8e49cffb8753] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 40552. Sep 08 11:36:33.086785 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-77a86837-f084-44bb-a77e-f92a6d70636a tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.567184 Sep 08 11:36:33.087455 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3442/6751] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 11:36:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1569 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:36:33.097762 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=46 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:36:33.098706 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:36:33.103722 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-992bb498-612b-43a2-84ce-b115c7210ef2 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:36:33.104347 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-992bb498-612b-43a2-84ce-b115c7210ef2 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] [instance: 7e300b4a-0e01-42ac-a828-6369b53c8357] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:36:33.161452 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-992bb498-612b-43a2-84ce-b115c7210ef2 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3feb9894a1ff49d2b0e923215473be4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4478e152a6f4568840d90f8c978f24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:36:33.172049 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-992bb498-612b-43a2-84ce-b115c7210ef2 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] 10.222.0.27 "GET /compute/v2.1/servers/7e300b4a-0e01-42ac-a828-6369b53c8357" status: 200 len: 1222 microversion: 2.1 time: 0.076066 Sep 08 11:36:33.172624 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3310/6752] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:36:33 2022] GET /compute/v2.1/servers/7e300b4a-0e01-42ac-a828-6369b53c8357 => generated 1222 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:36:34.197765 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a00c35c6-a278-4062-a973-c6287a16d8e9 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:36:34.198382 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a00c35c6-a278-4062-a973-c6287a16d8e9 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] [instance: 7e300b4a-0e01-42ac-a828-6369b53c8357] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:36:34.251954 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a00c35c6-a278-4062-a973-c6287a16d8e9 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3feb9894a1ff49d2b0e923215473be4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4478e152a6f4568840d90f8c978f24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:36:34.259829 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a00c35c6-a278-4062-a973-c6287a16d8e9 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] 10.222.0.27 "GET /compute/v2.1/servers/7e300b4a-0e01-42ac-a828-6369b53c8357" status: 200 len: 1222 microversion: 2.1 time: 0.067897 Sep 08 11:36:34.260526 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3443/6753] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:36:34 2022] GET /compute/v2.1/servers/7e300b4a-0e01-42ac-a828-6369b53c8357 => generated 1222 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:36:35.283503 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2d438cd9-2f37-490c-b824-16de86a43dcf tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:36:35.284136 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2d438cd9-2f37-490c-b824-16de86a43dcf tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] [instance: 7e300b4a-0e01-42ac-a828-6369b53c8357] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:36:35.342322 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2d438cd9-2f37-490c-b824-16de86a43dcf tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3feb9894a1ff49d2b0e923215473be4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4478e152a6f4568840d90f8c978f24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:36:35.349303 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2d438cd9-2f37-490c-b824-16de86a43dcf tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] 10.222.0.27 "GET /compute/v2.1/servers/7e300b4a-0e01-42ac-a828-6369b53c8357" status: 200 len: 1222 microversion: 2.1 time: 0.069579 Sep 08 11:36:35.349961 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3311/6754] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:36:35 2022] GET /compute/v2.1/servers/7e300b4a-0e01-42ac-a828-6369b53c8357 => generated 1222 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:36:36.373895 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-62b5f8bd-e88e-46af-8518-cd356e00f5d1 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:36:36.374522 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-62b5f8bd-e88e-46af-8518-cd356e00f5d1 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] [instance: 7e300b4a-0e01-42ac-a828-6369b53c8357] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:36:36.431696 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-62b5f8bd-e88e-46af-8518-cd356e00f5d1 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3feb9894a1ff49d2b0e923215473be4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4478e152a6f4568840d90f8c978f24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:36:36.438756 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-62b5f8bd-e88e-46af-8518-cd356e00f5d1 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] 10.222.0.27 "GET /compute/v2.1/servers/7e300b4a-0e01-42ac-a828-6369b53c8357" status: 200 len: 1222 microversion: 2.1 time: 0.068867 Sep 08 11:36:36.439327 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3444/6755] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:36:36 2022] GET /compute/v2.1/servers/7e300b4a-0e01-42ac-a828-6369b53c8357 => generated 1222 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:36:37.462544 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-76c49cbd-b05b-48ff-811e-72548ee68db4 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:36:37.463251 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-76c49cbd-b05b-48ff-811e-72548ee68db4 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] [instance: 7e300b4a-0e01-42ac-a828-6369b53c8357] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:36:37.470107 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76c49cbd-b05b-48ff-811e-72548ee68db4 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:37.470607 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76c49cbd-b05b-48ff-811e-72548ee68db4 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:37.471056 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76c49cbd-b05b-48ff-811e-72548ee68db4 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:37.471758 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76c49cbd-b05b-48ff-811e-72548ee68db4 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:37.472224 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76c49cbd-b05b-48ff-811e-72548ee68db4 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:37.472660 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76c49cbd-b05b-48ff-811e-72548ee68db4 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:37.538165 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-76c49cbd-b05b-48ff-811e-72548ee68db4 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3feb9894a1ff49d2b0e923215473be4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4478e152a6f4568840d90f8c978f24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:36:37.546853 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-76c49cbd-b05b-48ff-811e-72548ee68db4 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] 10.222.0.27 "GET /compute/v2.1/servers/7e300b4a-0e01-42ac-a828-6369b53c8357" status: 200 len: 1226 microversion: 2.1 time: 0.088390 Sep 08 11:36:37.547439 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3312/6756] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:36:37 2022] GET /compute/v2.1/servers/7e300b4a-0e01-42ac-a828-6369b53c8357 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:36:38.569809 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2b26ad82-e492-4562-aac1-6d7272017624 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:36:38.570422 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2b26ad82-e492-4562-aac1-6d7272017624 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] [instance: 7e300b4a-0e01-42ac-a828-6369b53c8357] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:36:38.579249 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2b26ad82-e492-4562-aac1-6d7272017624 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:38.579740 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2b26ad82-e492-4562-aac1-6d7272017624 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:38.580182 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2b26ad82-e492-4562-aac1-6d7272017624 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:38.580888 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2b26ad82-e492-4562-aac1-6d7272017624 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:38.581372 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2b26ad82-e492-4562-aac1-6d7272017624 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:38.581804 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2b26ad82-e492-4562-aac1-6d7272017624 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:38.658908 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2b26ad82-e492-4562-aac1-6d7272017624 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3feb9894a1ff49d2b0e923215473be4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4478e152a6f4568840d90f8c978f24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:36:38.666943 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2b26ad82-e492-4562-aac1-6d7272017624 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] 10.222.0.27 "GET /compute/v2.1/servers/7e300b4a-0e01-42ac-a828-6369b53c8357" status: 200 len: 1280 microversion: 2.1 time: 0.101013 Sep 08 11:36:38.667533 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3445/6757] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:36:38 2022] GET /compute/v2.1/servers/7e300b4a-0e01-42ac-a828-6369b53c8357 => generated 1280 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:36:39.691891 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fbcd8e39-9123-4727-a9f0-c339a0fe9469 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:36:39.692604 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fbcd8e39-9123-4727-a9f0-c339a0fe9469 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] [instance: 7e300b4a-0e01-42ac-a828-6369b53c8357] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:36:39.702062 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fbcd8e39-9123-4727-a9f0-c339a0fe9469 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:39.702755 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fbcd8e39-9123-4727-a9f0-c339a0fe9469 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:39.703282 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fbcd8e39-9123-4727-a9f0-c339a0fe9469 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:39.704017 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fbcd8e39-9123-4727-a9f0-c339a0fe9469 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:39.704494 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fbcd8e39-9123-4727-a9f0-c339a0fe9469 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:39.704949 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fbcd8e39-9123-4727-a9f0-c339a0fe9469 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:39.800584 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-f728defe-3fd8-4436-a178-7ea1ea6c5f9e req-44571b9d-8823-49c2-bb20-4861cb4741fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e300b4a-0e01-42ac-a828-6369b53c8357", "tag": "468ab22e-0933-4b38-95ec-7dbcdb3e1241"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:36:39.817817 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-f728defe-3fd8-4436-a178-7ea1ea6c5f9e req-44571b9d-8823-49c2-bb20-4861cb4741fb service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:39.818626 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-f728defe-3fd8-4436-a178-7ea1ea6c5f9e req-44571b9d-8823-49c2-bb20-4861cb4741fb service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:39.819268 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-f728defe-3fd8-4436-a178-7ea1ea6c5f9e req-44571b9d-8823-49c2-bb20-4861cb4741fb service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:39.834028 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-f728defe-3fd8-4436-a178-7ea1ea6c5f9e req-44571b9d-8823-49c2-bb20-4861cb4741fb service nova] Creating event network-changed:468ab22e-0933-4b38-95ec-7dbcdb3e1241 for instance 7e300b4a-0e01-42ac-a828-6369b53c8357 on n-h1-850501-12 Sep 08 11:36:39.839845 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-f728defe-3fd8-4436-a178-7ea1ea6c5f9e req-44571b9d-8823-49c2-bb20-4861cb4741fb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048375 Sep 08 11:36:39.840572 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3446/6758] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:36:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:36:39.864764 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fbcd8e39-9123-4727-a9f0-c339a0fe9469 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3feb9894a1ff49d2b0e923215473be4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4478e152a6f4568840d90f8c978f24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:36:39.874326 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fbcd8e39-9123-4727-a9f0-c339a0fe9469 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] 10.222.0.27 "GET /compute/v2.1/servers/7e300b4a-0e01-42ac-a828-6369b53c8357" status: 200 len: 1322 microversion: 2.1 time: 0.186364 Sep 08 11:36:39.874932 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3313/6759] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:36:39 2022] GET /compute/v2.1/servers/7e300b4a-0e01-42ac-a828-6369b53c8357 => generated 1322 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:36:40.900731 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b7009f25-fb31-403b-832e-9cccfa4db5c1 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:36:40.901503 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b7009f25-fb31-403b-832e-9cccfa4db5c1 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] [instance: 7e300b4a-0e01-42ac-a828-6369b53c8357] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:36:40.907963 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b7009f25-fb31-403b-832e-9cccfa4db5c1 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:40.908456 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b7009f25-fb31-403b-832e-9cccfa4db5c1 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:40.908899 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b7009f25-fb31-403b-832e-9cccfa4db5c1 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:40.909643 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b7009f25-fb31-403b-832e-9cccfa4db5c1 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:40.910104 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b7009f25-fb31-403b-832e-9cccfa4db5c1 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:40.910538 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b7009f25-fb31-403b-832e-9cccfa4db5c1 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:41.052692 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b7009f25-fb31-403b-832e-9cccfa4db5c1 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3feb9894a1ff49d2b0e923215473be4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4478e152a6f4568840d90f8c978f24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:36:41.062603 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b7009f25-fb31-403b-832e-9cccfa4db5c1 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] 10.222.0.27 "GET /compute/v2.1/servers/7e300b4a-0e01-42ac-a828-6369b53c8357" status: 200 len: 1322 microversion: 2.1 time: 0.167105 Sep 08 11:36:41.063199 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3447/6760] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:36:40 2022] GET /compute/v2.1/servers/7e300b4a-0e01-42ac-a828-6369b53c8357 => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:36:42.086297 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d726fb88-ad4f-4f13-b7fa-041aaaf2897d tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:36:42.086922 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d726fb88-ad4f-4f13-b7fa-041aaaf2897d tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] [instance: 7e300b4a-0e01-42ac-a828-6369b53c8357] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:36:42.094433 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d726fb88-ad4f-4f13-b7fa-041aaaf2897d tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:42.094939 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d726fb88-ad4f-4f13-b7fa-041aaaf2897d tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:42.095388 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d726fb88-ad4f-4f13-b7fa-041aaaf2897d tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:42.096097 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d726fb88-ad4f-4f13-b7fa-041aaaf2897d tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:42.096565 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d726fb88-ad4f-4f13-b7fa-041aaaf2897d tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:42.097003 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d726fb88-ad4f-4f13-b7fa-041aaaf2897d tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:42.233537 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d726fb88-ad4f-4f13-b7fa-041aaaf2897d tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3feb9894a1ff49d2b0e923215473be4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4478e152a6f4568840d90f8c978f24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:36:42.241434 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d726fb88-ad4f-4f13-b7fa-041aaaf2897d tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] 10.222.0.27 "GET /compute/v2.1/servers/7e300b4a-0e01-42ac-a828-6369b53c8357" status: 200 len: 1322 microversion: 2.1 time: 0.159110 Sep 08 11:36:42.242003 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3314/6761] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:36:42 2022] GET /compute/v2.1/servers/7e300b4a-0e01-42ac-a828-6369b53c8357 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:36:43.264341 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cc5e29b1-bd86-46c3-8998-31614af42360 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:36:43.264976 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cc5e29b1-bd86-46c3-8998-31614af42360 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] [instance: 7e300b4a-0e01-42ac-a828-6369b53c8357] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:36:43.267540 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:36:43.273080 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc5e29b1-bd86-46c3-8998-31614af42360 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:43.273572 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc5e29b1-bd86-46c3-8998-31614af42360 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:43.274010 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc5e29b1-bd86-46c3-8998-31614af42360 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:43.275209 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc5e29b1-bd86-46c3-8998-31614af42360 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:43.275900 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc5e29b1-bd86-46c3-8998-31614af42360 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:43.276325 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc5e29b1-bd86-46c3-8998-31614af42360 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:43.415415 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-cc5e29b1-bd86-46c3-8998-31614af42360 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3feb9894a1ff49d2b0e923215473be4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4478e152a6f4568840d90f8c978f24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:36:43.423503 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cc5e29b1-bd86-46c3-8998-31614af42360 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] 10.222.0.27 "GET /compute/v2.1/servers/7e300b4a-0e01-42ac-a828-6369b53c8357" status: 200 len: 1322 microversion: 2.1 time: 0.163542 Sep 08 11:36:43.424087 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3448/6762] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:36:43 2022] GET /compute/v2.1/servers/7e300b4a-0e01-42ac-a828-6369b53c8357 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:36:44.446175 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a71287df-7428-4f93-9bb2-92435523b01a tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:36:44.446896 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a71287df-7428-4f93-9bb2-92435523b01a tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] [instance: 7e300b4a-0e01-42ac-a828-6369b53c8357] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:36:44.453986 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a71287df-7428-4f93-9bb2-92435523b01a tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:44.454493 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a71287df-7428-4f93-9bb2-92435523b01a tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:44.454944 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a71287df-7428-4f93-9bb2-92435523b01a tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:44.455660 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a71287df-7428-4f93-9bb2-92435523b01a tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:44.456130 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a71287df-7428-4f93-9bb2-92435523b01a tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:44.456575 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a71287df-7428-4f93-9bb2-92435523b01a tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:44.593466 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a71287df-7428-4f93-9bb2-92435523b01a tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3feb9894a1ff49d2b0e923215473be4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4478e152a6f4568840d90f8c978f24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:36:44.601322 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a71287df-7428-4f93-9bb2-92435523b01a tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] 10.222.0.27 "GET /compute/v2.1/servers/7e300b4a-0e01-42ac-a828-6369b53c8357" status: 200 len: 1322 microversion: 2.1 time: 0.158956 Sep 08 11:36:44.601900 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3315/6763] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:36:44 2022] GET /compute/v2.1/servers/7e300b4a-0e01-42ac-a828-6369b53c8357 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:36:45.625371 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6907926c-68c5-445f-b7b0-d541a853430a tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:36:45.625976 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6907926c-68c5-445f-b7b0-d541a853430a tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] [instance: 7e300b4a-0e01-42ac-a828-6369b53c8357] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:36:45.633311 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6907926c-68c5-445f-b7b0-d541a853430a tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:45.633806 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6907926c-68c5-445f-b7b0-d541a853430a tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:45.634251 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6907926c-68c5-445f-b7b0-d541a853430a tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:45.634959 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6907926c-68c5-445f-b7b0-d541a853430a tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:45.635423 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6907926c-68c5-445f-b7b0-d541a853430a tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:45.635852 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6907926c-68c5-445f-b7b0-d541a853430a tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:45.777234 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6907926c-68c5-445f-b7b0-d541a853430a tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3feb9894a1ff49d2b0e923215473be4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4478e152a6f4568840d90f8c978f24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:36:45.785434 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6907926c-68c5-445f-b7b0-d541a853430a tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] 10.222.0.27 "GET /compute/v2.1/servers/7e300b4a-0e01-42ac-a828-6369b53c8357" status: 200 len: 1322 microversion: 2.1 time: 0.164233 Sep 08 11:36:45.786014 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3449/6764] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:36:45 2022] GET /compute/v2.1/servers/7e300b4a-0e01-42ac-a828-6369b53c8357 => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:36:45.939475 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=4 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:36:45.996335 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-7264aaf7-c409-4f5f-a70d-5d70bfc5d0a8 req-1cc4f5fb-99d9-4aaa-9c70-b997ed0daff5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e300b4a-0e01-42ac-a828-6369b53c8357", "name": "network-vif-plugged", "status": "completed", "tag": "468ab22e-0933-4b38-95ec-7dbcdb3e1241"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:36:46.006061 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-7264aaf7-c409-4f5f-a70d-5d70bfc5d0a8 req-1cc4f5fb-99d9-4aaa-9c70-b997ed0daff5 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:46.006555 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-7264aaf7-c409-4f5f-a70d-5d70bfc5d0a8 req-1cc4f5fb-99d9-4aaa-9c70-b997ed0daff5 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:46.006996 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-7264aaf7-c409-4f5f-a70d-5d70bfc5d0a8 req-1cc4f5fb-99d9-4aaa-9c70-b997ed0daff5 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:46.018445 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-7264aaf7-c409-4f5f-a70d-5d70bfc5d0a8 req-1cc4f5fb-99d9-4aaa-9c70-b997ed0daff5 service nova] Creating event network-vif-plugged:468ab22e-0933-4b38-95ec-7dbcdb3e1241 for instance 7e300b4a-0e01-42ac-a828-6369b53c8357 on n-h1-850501-12 Sep 08 11:36:46.023412 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-7264aaf7-c409-4f5f-a70d-5d70bfc5d0a8 req-1cc4f5fb-99d9-4aaa-9c70-b997ed0daff5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088567 Sep 08 11:36:46.023999 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3316/6765] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:36:46.809821 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f5725cd4-13fd-4957-acbf-bddc7d0ad8fb tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:36:46.810420 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f5725cd4-13fd-4957-acbf-bddc7d0ad8fb tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] [instance: 7e300b4a-0e01-42ac-a828-6369b53c8357] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:36:46.812341 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=10 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:36:46.818733 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f5725cd4-13fd-4957-acbf-bddc7d0ad8fb tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:46.819233 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f5725cd4-13fd-4957-acbf-bddc7d0ad8fb tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:46.819679 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f5725cd4-13fd-4957-acbf-bddc7d0ad8fb tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:46.820394 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f5725cd4-13fd-4957-acbf-bddc7d0ad8fb tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:46.820855 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f5725cd4-13fd-4957-acbf-bddc7d0ad8fb tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:46.821315 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f5725cd4-13fd-4957-acbf-bddc7d0ad8fb tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:46.962656 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f5725cd4-13fd-4957-acbf-bddc7d0ad8fb tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3feb9894a1ff49d2b0e923215473be4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4478e152a6f4568840d90f8c978f24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:36:46.971322 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f5725cd4-13fd-4957-acbf-bddc7d0ad8fb tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] 10.222.0.27 "GET /compute/v2.1/servers/7e300b4a-0e01-42ac-a828-6369b53c8357" status: 200 len: 1322 microversion: 2.1 time: 0.166324 Sep 08 11:36:46.971929 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3450/6766] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:36:46 2022] GET /compute/v2.1/servers/7e300b4a-0e01-42ac-a828-6369b53c8357 => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:36:47.995750 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8037b9d2-9848-44cb-8032-94dac50c39cc tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:36:47.996483 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8037b9d2-9848-44cb-8032-94dac50c39cc tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] [instance: 7e300b4a-0e01-42ac-a828-6369b53c8357] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:36:48.005128 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8037b9d2-9848-44cb-8032-94dac50c39cc tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:48.005635 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8037b9d2-9848-44cb-8032-94dac50c39cc tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:48.006092 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8037b9d2-9848-44cb-8032-94dac50c39cc tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:48.006802 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8037b9d2-9848-44cb-8032-94dac50c39cc tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:48.007272 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8037b9d2-9848-44cb-8032-94dac50c39cc tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:48.007717 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8037b9d2-9848-44cb-8032-94dac50c39cc tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:48.143174 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8037b9d2-9848-44cb-8032-94dac50c39cc tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3feb9894a1ff49d2b0e923215473be4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4478e152a6f4568840d90f8c978f24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:36:48.152590 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8037b9d2-9848-44cb-8032-94dac50c39cc tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] 10.222.0.27 "GET /compute/v2.1/servers/7e300b4a-0e01-42ac-a828-6369b53c8357" status: 200 len: 1472 microversion: 2.1 time: 0.161887 Sep 08 11:36:48.153204 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3317/6767] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:36:47 2022] GET /compute/v2.1/servers/7e300b4a-0e01-42ac-a828-6369b53c8357 => generated 1472 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:36:48.225435 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c571f6ce-95d6-4698-ae0d-a892e9fe373b tempest-ServersAdminNegativeTestJSON-555670176 tempest-ServersAdminNegativeTestJSON-555670176-project-admin] Calling method '.version_select at 0x7f68e45d0550>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:36:48.294414 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c571f6ce-95d6-4698-ae0d-a892e9fe373b tempest-ServersAdminNegativeTestJSON-555670176 tempest-ServersAdminNegativeTestJSON-555670176-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/b87bfa49270347348c16877b67d501c8" status: 200 len: 371 microversion: 2.1 time: 0.120874 Sep 08 11:36:48.294998 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3451/6768] 10.222.0.27 () {58 vars in 1242 bytes} [Thu Sep 8 11:36:48 2022] GET /compute/v2.1/os-quota-sets/b87bfa49270347348c16877b67d501c8 => generated 371 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:36:48.307375 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a6cbd96e-6f3b-4c28-9004-c801fa842bac tempest-ServersAdminNegativeTestJSON-555670176 tempest-ServersAdminNegativeTestJSON-555670176-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-2002821791", "id": 1832314470, "os-flavor-access:is_public": "True"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:36:48.327881 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a6cbd96e-6f3b-4c28-9004-c801fa842bac tempest-ServersAdminNegativeTestJSON-555670176 tempest-ServersAdminNegativeTestJSON-555670176-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.024677 Sep 08 11:36:48.328478 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3318/6769] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 11:36:48 2022] POST /compute/v2.1/flavors => generated 438 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:36:48.340945 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3f75a3c9-8593-480c-93c7-1a0341c36cff tempest-ServersAdminNegativeTestJSON-555670176 tempest-ServersAdminNegativeTestJSON-555670176-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1832314470"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:36:48.343366 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3f75a3c9-8593-480c-93c7-1a0341c36cff tempest-ServersAdminNegativeTestJSON-555670176 tempest-ServersAdminNegativeTestJSON-555670176-project-admin] [instance: 7e300b4a-0e01-42ac-a828-6369b53c8357] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:36:48.349501 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3f75a3c9-8593-480c-93c7-1a0341c36cff tempest-ServersAdminNegativeTestJSON-555670176 tempest-ServersAdminNegativeTestJSON-555670176-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:48.349996 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3f75a3c9-8593-480c-93c7-1a0341c36cff tempest-ServersAdminNegativeTestJSON-555670176 tempest-ServersAdminNegativeTestJSON-555670176-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:48.350447 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3f75a3c9-8593-480c-93c7-1a0341c36cff tempest-ServersAdminNegativeTestJSON-555670176 tempest-ServersAdminNegativeTestJSON-555670176-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:48.351151 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3f75a3c9-8593-480c-93c7-1a0341c36cff tempest-ServersAdminNegativeTestJSON-555670176 tempest-ServersAdminNegativeTestJSON-555670176-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:48.351614 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3f75a3c9-8593-480c-93c7-1a0341c36cff tempest-ServersAdminNegativeTestJSON-555670176 tempest-ServersAdminNegativeTestJSON-555670176-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:48.352052 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3f75a3c9-8593-480c-93c7-1a0341c36cff tempest-ServersAdminNegativeTestJSON-555670176 tempest-ServersAdminNegativeTestJSON-555670176-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:48.564572 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-3f75a3c9-8593-480c-93c7-1a0341c36cff tempest-ServersAdminNegativeTestJSON-555670176 tempest-ServersAdminNegativeTestJSON-555670176-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '74f7deae078a4201878497f713242863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87bfa49270347348c16877b67d501c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:36:48.575427 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3f75a3c9-8593-480c-93c7-1a0341c36cff tempest-ServersAdminNegativeTestJSON-555670176 tempest-ServersAdminNegativeTestJSON-555670176-project-admin] [instance: 7e300b4a-0e01-42ac-a828-6369b53c8357] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-2002821791 {{(pid=128861) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 08 11:36:48.582316 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3f75a3c9-8593-480c-93c7-1a0341c36cff tempest-ServersAdminNegativeTestJSON-555670176 tempest-ServersAdminNegativeTestJSON-555670176-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:48.582805 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3f75a3c9-8593-480c-93c7-1a0341c36cff tempest-ServersAdminNegativeTestJSON-555670176 tempest-ServersAdminNegativeTestJSON-555670176-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:48.583245 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3f75a3c9-8593-480c-93c7-1a0341c36cff tempest-ServersAdminNegativeTestJSON-555670176 tempest-ServersAdminNegativeTestJSON-555670176-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:48.583985 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3f75a3c9-8593-480c-93c7-1a0341c36cff tempest-ServersAdminNegativeTestJSON-555670176 tempest-ServersAdminNegativeTestJSON-555670176-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:48.584445 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3f75a3c9-8593-480c-93c7-1a0341c36cff tempest-ServersAdminNegativeTestJSON-555670176 tempest-ServersAdminNegativeTestJSON-555670176-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:48.584875 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3f75a3c9-8593-480c-93c7-1a0341c36cff tempest-ServersAdminNegativeTestJSON-555670176 tempest-ServersAdminNegativeTestJSON-555670176-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:48.607399 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-3f75a3c9-8593-480c-93c7-1a0341c36cff tempest-ServersAdminNegativeTestJSON-555670176 tempest-ServersAdminNegativeTestJSON-555670176-project-admin] Getting quotas for project c4478e152a6f4568840d90f8c978f24b. Resources: {'ram', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:36:48.612917 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-3f75a3c9-8593-480c-93c7-1a0341c36cff tempest-ServersAdminNegativeTestJSON-555670176 tempest-ServersAdminNegativeTestJSON-555670176-project-admin] Getting quotas for user 3feb9894a1ff49d2b0e923215473be4a and project c4478e152a6f4568840d90f8c978f24b. Resources: {'ram', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:36:48.626038 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.compute.api [None req-3f75a3c9-8593-480c-93c7-1a0341c36cff tempest-ServersAdminNegativeTestJSON-555670176 tempest-ServersAdminNegativeTestJSON-555670176-project-admin] ram quota exceeded for b87bfa49270347348c16877b67d501c8, tried to resize instance. Sep 08 11:36:48.626577 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-3f75a3c9-8593-480c-93c7-1a0341c36cff tempest-ServersAdminNegativeTestJSON-555670176 tempest-ServersAdminNegativeTestJSON-555670176-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 08 11:36:48.628686 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3f75a3c9-8593-480c-93c7-1a0341c36cff tempest-ServersAdminNegativeTestJSON-555670176 tempest-ServersAdminNegativeTestJSON-555670176-project-admin] Request method failure captured: Sep 08 11:36:48.628686 n-d-850501-12 devstack@n-api.service[128861]: request: POST /compute/v2.1/servers/7e300b4a-0e01-42ac-a828-6369b53c8357/action HTTP/1.1 Sep 08 11:36:48.628686 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:36:48.628686 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:36:48.628686 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:36:48.628686 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 39 Sep 08 11:36:48.628686 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:36:48.628686 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:36:48.628686 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:36:48.628686 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:36:48.628686 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGdO_NmbsfiXlMdTqUJdNUYd1IlDtK2Xifq8-8r7q0K7p3PfKf2GfO4owfAWlfsFTap_pU9gv0CMHvHHEaexOxflrdINA7rr0hxNSlA9BOpwJOxqnG6juV6W1edoJNm3yxglRphxXxpyJ_u5WZ4rnObHYIlxalejQVBoXFXiE38WRLDk Sep 08 11:36:48.628686 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:36:48.628686 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:36:48.628686 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:36:48.628686 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:36:48.628686 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:36:48.628686 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:36:48.628686 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: b87bfa49270347348c16877b67d501c8 Sep 08 11:36:48.628686 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-555670176 Sep 08 11:36:48.628686 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,admin,member Sep 08 11:36:48.628686 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,admin,member Sep 08 11:36:48.628686 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b87bfa49270347348c16877b67d501c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b87bfa49270347348c16877b67d501c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b87bfa49270347348c16877b67d501c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b87bfa49270347348c16877b67d501c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:36:48.628686 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServersAdminNegativeTestJSON-555670176 Sep 08 11:36:48.628686 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: b87bfa49270347348c16877b67d501c8 Sep 08 11:36:48.628686 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-555670176 Sep 08 11:36:48.628686 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServersAdminNegativeTestJSON-555670176-project-admin Sep 08 11:36:48.628686 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:36:48.628686 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:36:48.628686 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 74f7deae078a4201878497f713242863 Sep 08 11:36:48.628686 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServersAdminNegativeTestJSON-555670176-project-admin Sep 08 11:36:48.628686 n-d-850501-12 devstack@n-api.service[128861]: Sep 08 11:36:48.628686 n-d-850501-12 devstack@n-api.service[128861]: {"resize": {"flavorRef": "1832314470"}} Sep 08 11:36:48.628686 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 11:36:48.628686 n-d-850501-12 devstack@n-api.service[128861]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 08 11:36:48.628686 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '7e300b4a-0e01-42ac-a828-6369b53c8357', 'body': {'resize': {'flavorRef': '1832314470'}}} Sep 08 11:36:48.628686 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:36:48.628686 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:36:48.628686 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Sep 08 11:36:48.628686 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Sep 08 11:36:48.628686 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 11:36:48.628686 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 11:36:48.628686 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 08 11:36:48.628686 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc Sep 08 11:36:48.628686 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 08 11:36:48.628686 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 08 11:36:48.628686 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 11:36:48.628686 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 11:36:48.628686 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 08 11:36:48.628686 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 08 11:36:48.628686 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 08 11:36:48.628686 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 08 11:36:48.628686 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Sep 08 11:36:48.628686 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 08 11:36:48.628686 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Sep 08 11:36:48.628686 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:36:48.628686 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:36:48.628686 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:36:48.628686 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:36:48.628686 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Sep 08 11:36:48.628686 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Sep 08 11:36:48.628686 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 08 11:36:48.628686 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 11:36:48.628686 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 08 11:36:48.632879 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 08 11:36:48.632879 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 08 11:36:48.632879 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 08 11:36:48.632879 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 11:36:48.632879 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 11:36:48.632879 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 08 11:36:48.632879 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 08 11:36:48.632879 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 08 11:36:48.632879 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 11:36:48.632879 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Sep 08 11:36:48.632879 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Sep 08 11:36:48.632879 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Sep 08 11:36:48.632879 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 08 11:36:48.632879 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 08 11:36:48.632879 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:36:48.632879 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:36:48.632879 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:36:48.632879 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:36:48.632879 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:36:48.632879 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:36:48.632879 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:36:48.632879 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:36:48.632879 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:36:48.632879 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:36:48.632879 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 11:36:48.632879 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 11:36:48.632879 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 08 11:36:48.632879 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 08 11:36:48.632879 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Sep 08 11:36:48.632879 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 08 11:36:48.632879 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 08 11:36:48.632879 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:36:48.632879 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:36:48.632879 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:36:48.632879 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:36:48.632879 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:36:48.632879 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:36:48.632879 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:36:48.632879 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:36:48.632879 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 08 11:36:48.632879 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:36:48.632879 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3f75a3c9-8593-480c-93c7-1a0341c36cff tempest-ServersAdminNegativeTestJSON-555670176 tempest-ServersAdminNegativeTestJSON-555670176-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:36:48.632879 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3f75a3c9-8593-480c-93c7-1a0341c36cff tempest-ServersAdminNegativeTestJSON-555670176 tempest-ServersAdminNegativeTestJSON-555670176-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/7e300b4a-0e01-42ac-a828-6369b53c8357/action" status: 403 len: 118 microversion: 2.1 time: 0.293497 Sep 08 11:36:48.632879 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3452/6770] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 11:36:48 2022] POST /compute/v2.1/servers/7e300b4a-0e01-42ac-a828-6369b53c8357/action => generated 118 bytes in 295 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 08 11:36:48.640353 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2176e8a0-13ee-4d1d-bc42-a137d4986bf4 tempest-ServersAdminNegativeTestJSON-555670176 tempest-ServersAdminNegativeTestJSON-555670176-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:36:48.657553 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2176e8a0-13ee-4d1d-bc42-a137d4986bf4 tempest-ServersAdminNegativeTestJSON-555670176 tempest-ServersAdminNegativeTestJSON-555670176-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1832314470" status: 202 len: 0 microversion: 2.1 time: 0.020827 Sep 08 11:36:48.658180 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3319/6771] 10.222.0.27 () {58 vars in 1161 bytes} [Thu Sep 8 11:36:48 2022] DELETE /compute/v2.1/flavors/1832314470 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:36:48.666753 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-34b66c1b-e087-48e6-97d9-c15a18ceafa7 tempest-ServersAdminNegativeTestJSON-555670176 tempest-ServersAdminNegativeTestJSON-555670176-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:36:48.687337 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-34b66c1b-e087-48e6-97d9-c15a18ceafa7 tempest-ServersAdminNegativeTestJSON-555670176 tempest-ServersAdminNegativeTestJSON-555670176-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024947 Sep 08 11:36:48.687843 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3453/6772] 10.222.0.27 () {58 vars in 1146 bytes} [Thu Sep 8 11:36:48 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:36:48.708085 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0135e5c2-53b6-4b6f-90b3-0b945db56e73 tempest-ServersAdminNegativeTestJSON-555670176 tempest-ServersAdminNegativeTestJSON-555670176-project-admin] Calling method '.version_select at 0x7f68df5e7d30>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:36:48.776585 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0135e5c2-53b6-4b6f-90b3-0b945db56e73 tempest-ServersAdminNegativeTestJSON-555670176 tempest-ServersAdminNegativeTestJSON-555670176-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/b87bfa49270347348c16877b67d501c8" status: 200 len: 371 microversion: 2.1 time: 0.072081 Sep 08 11:36:48.777203 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3320/6773] 10.222.0.27 () {58 vars in 1242 bytes} [Thu Sep 8 11:36:48 2022] GET /compute/v2.1/os-quota-sets/b87bfa49270347348c16877b67d501c8 => generated 371 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:36:48.789120 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a4df2a3e-3ffa-4a94-a180-d408b936d81e tempest-ServersAdminNegativeTestJSON-555670176 tempest-ServersAdminNegativeTestJSON-555670176-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-207387143", "id": 727322946, "os-flavor-access:is_public": "True"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:36:48.808733 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a4df2a3e-3ffa-4a94-a180-d408b936d81e tempest-ServersAdminNegativeTestJSON-555670176 tempest-ServersAdminNegativeTestJSON-555670176-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 433 microversion: 2.1 time: 0.023397 Sep 08 11:36:48.809376 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3454/6774] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 11:36:48 2022] POST /compute/v2.1/flavors => generated 433 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:36:48.821371 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f6956c00-7f78-43fc-a295-697c0451fc50 tempest-ServersAdminNegativeTestJSON-555670176 tempest-ServersAdminNegativeTestJSON-555670176-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "727322946"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:36:48.823915 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f6956c00-7f78-43fc-a295-697c0451fc50 tempest-ServersAdminNegativeTestJSON-555670176 tempest-ServersAdminNegativeTestJSON-555670176-project-admin] [instance: 7e300b4a-0e01-42ac-a828-6369b53c8357] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:36:48.830007 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f6956c00-7f78-43fc-a295-697c0451fc50 tempest-ServersAdminNegativeTestJSON-555670176 tempest-ServersAdminNegativeTestJSON-555670176-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:48.830506 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f6956c00-7f78-43fc-a295-697c0451fc50 tempest-ServersAdminNegativeTestJSON-555670176 tempest-ServersAdminNegativeTestJSON-555670176-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:48.830957 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f6956c00-7f78-43fc-a295-697c0451fc50 tempest-ServersAdminNegativeTestJSON-555670176 tempest-ServersAdminNegativeTestJSON-555670176-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:48.831664 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f6956c00-7f78-43fc-a295-697c0451fc50 tempest-ServersAdminNegativeTestJSON-555670176 tempest-ServersAdminNegativeTestJSON-555670176-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:48.832137 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f6956c00-7f78-43fc-a295-697c0451fc50 tempest-ServersAdminNegativeTestJSON-555670176 tempest-ServersAdminNegativeTestJSON-555670176-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:48.832584 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f6956c00-7f78-43fc-a295-697c0451fc50 tempest-ServersAdminNegativeTestJSON-555670176 tempest-ServersAdminNegativeTestJSON-555670176-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:49.001780 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f6956c00-7f78-43fc-a295-697c0451fc50 tempest-ServersAdminNegativeTestJSON-555670176 tempest-ServersAdminNegativeTestJSON-555670176-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '74f7deae078a4201878497f713242863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87bfa49270347348c16877b67d501c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:36:49.008086 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f6956c00-7f78-43fc-a295-697c0451fc50 tempest-ServersAdminNegativeTestJSON-555670176 tempest-ServersAdminNegativeTestJSON-555670176-project-admin] [instance: 7e300b4a-0e01-42ac-a828-6369b53c8357] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-207387143 {{(pid=128862) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 08 11:36:49.015119 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f6956c00-7f78-43fc-a295-697c0451fc50 tempest-ServersAdminNegativeTestJSON-555670176 tempest-ServersAdminNegativeTestJSON-555670176-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:49.015621 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f6956c00-7f78-43fc-a295-697c0451fc50 tempest-ServersAdminNegativeTestJSON-555670176 tempest-ServersAdminNegativeTestJSON-555670176-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:49.016077 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f6956c00-7f78-43fc-a295-697c0451fc50 tempest-ServersAdminNegativeTestJSON-555670176 tempest-ServersAdminNegativeTestJSON-555670176-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:49.016830 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f6956c00-7f78-43fc-a295-697c0451fc50 tempest-ServersAdminNegativeTestJSON-555670176 tempest-ServersAdminNegativeTestJSON-555670176-project-admin] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:49.017333 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f6956c00-7f78-43fc-a295-697c0451fc50 tempest-ServersAdminNegativeTestJSON-555670176 tempest-ServersAdminNegativeTestJSON-555670176-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:49.017801 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f6956c00-7f78-43fc-a295-697c0451fc50 tempest-ServersAdminNegativeTestJSON-555670176 tempest-ServersAdminNegativeTestJSON-555670176-project-admin] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:49.045183 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-f6956c00-7f78-43fc-a295-697c0451fc50 tempest-ServersAdminNegativeTestJSON-555670176 tempest-ServersAdminNegativeTestJSON-555670176-project-admin] Getting quotas for project c4478e152a6f4568840d90f8c978f24b. Resources: {'ram', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:36:49.050681 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-f6956c00-7f78-43fc-a295-697c0451fc50 tempest-ServersAdminNegativeTestJSON-555670176 tempest-ServersAdminNegativeTestJSON-555670176-project-admin] Getting quotas for user 3feb9894a1ff49d2b0e923215473be4a and project c4478e152a6f4568840d90f8c978f24b. Resources: {'ram', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:36:49.063868 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.compute.api [None req-f6956c00-7f78-43fc-a295-697c0451fc50 tempest-ServersAdminNegativeTestJSON-555670176 tempest-ServersAdminNegativeTestJSON-555670176-project-admin] cores quota exceeded for b87bfa49270347348c16877b67d501c8, tried to resize instance. Sep 08 11:36:49.064418 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-f6956c00-7f78-43fc-a295-697c0451fc50 tempest-ServersAdminNegativeTestJSON-555670176 tempest-ServersAdminNegativeTestJSON-555670176-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 08 11:36:49.066521 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f6956c00-7f78-43fc-a295-697c0451fc50 tempest-ServersAdminNegativeTestJSON-555670176 tempest-ServersAdminNegativeTestJSON-555670176-project-admin] Request method failure captured: Sep 08 11:36:49.066521 n-d-850501-12 devstack@n-api.service[128862]: request: POST /compute/v2.1/servers/7e300b4a-0e01-42ac-a828-6369b53c8357/action HTTP/1.1 Sep 08 11:36:49.066521 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 11:36:49.066521 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 11:36:49.066521 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 11:36:49.066521 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 38 Sep 08 11:36:49.066521 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 11:36:49.066521 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 11:36:49.066521 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 11:36:49.066521 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 11:36:49.066521 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGdO_NmbsfiXlMdTqUJdNUYd1IlDtK2Xifq8-8r7q0K7p3PfKf2GfO4owfAWlfsFTap_pU9gv0CMHvHHEaexOxflrdINA7rr0hxNSlA9BOpwJOxqnG6juV6W1edoJNm3yxglRphxXxpyJ_u5WZ4rnObHYIlxalejQVBoXFXiE38WRLDk Sep 08 11:36:49.066521 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 11:36:49.066521 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 11:36:49.066521 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 11:36:49.066521 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 11:36:49.066521 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 11:36:49.066521 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 11:36:49.066521 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: b87bfa49270347348c16877b67d501c8 Sep 08 11:36:49.066521 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-555670176 Sep 08 11:36:49.066521 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,admin,member Sep 08 11:36:49.066521 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,admin,member Sep 08 11:36:49.066521 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b87bfa49270347348c16877b67d501c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b87bfa49270347348c16877b67d501c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b87bfa49270347348c16877b67d501c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b87bfa49270347348c16877b67d501c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:36:49.066521 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServersAdminNegativeTestJSON-555670176 Sep 08 11:36:49.066521 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: b87bfa49270347348c16877b67d501c8 Sep 08 11:36:49.066521 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-555670176 Sep 08 11:36:49.066521 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServersAdminNegativeTestJSON-555670176-project-admin Sep 08 11:36:49.066521 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 11:36:49.066521 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 11:36:49.066521 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 74f7deae078a4201878497f713242863 Sep 08 11:36:49.066521 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServersAdminNegativeTestJSON-555670176-project-admin Sep 08 11:36:49.066521 n-d-850501-12 devstack@n-api.service[128862]: Sep 08 11:36:49.066521 n-d-850501-12 devstack@n-api.service[128862]: {"resize": {"flavorRef": "727322946"}} Sep 08 11:36:49.066521 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 11:36:49.066521 n-d-850501-12 devstack@n-api.service[128862]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 08 11:36:49.066521 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '7e300b4a-0e01-42ac-a828-6369b53c8357', 'body': {'resize': {'flavorRef': '727322946'}}} Sep 08 11:36:49.066521 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:36:49.066521 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:36:49.066521 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Sep 08 11:36:49.066521 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Sep 08 11:36:49.066521 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 11:36:49.066521 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 11:36:49.066521 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 08 11:36:49.066521 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc Sep 08 11:36:49.066521 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 08 11:36:49.066521 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 08 11:36:49.066521 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 11:36:49.066521 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 11:36:49.066521 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 08 11:36:49.066521 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 08 11:36:49.066521 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 08 11:36:49.066521 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 08 11:36:49.066521 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Sep 08 11:36:49.066521 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 08 11:36:49.066521 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Sep 08 11:36:49.066521 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:36:49.066521 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:36:49.066521 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:36:49.066521 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:36:49.066521 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Sep 08 11:36:49.066521 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Sep 08 11:36:49.066521 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 08 11:36:49.066521 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 11:36:49.066521 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 08 11:36:49.071019 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 08 11:36:49.071019 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 08 11:36:49.071019 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 08 11:36:49.071019 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 11:36:49.071019 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 11:36:49.071019 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 08 11:36:49.071019 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 08 11:36:49.071019 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 08 11:36:49.071019 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 11:36:49.071019 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Sep 08 11:36:49.071019 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Sep 08 11:36:49.071019 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Sep 08 11:36:49.071019 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 08 11:36:49.071019 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 08 11:36:49.071019 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:36:49.071019 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:36:49.071019 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:36:49.071019 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:36:49.071019 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:36:49.071019 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:36:49.071019 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:36:49.071019 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:36:49.071019 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:36:49.071019 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:36:49.071019 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 11:36:49.071019 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 11:36:49.071019 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 08 11:36:49.071019 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 08 11:36:49.071019 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Sep 08 11:36:49.071019 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 08 11:36:49.071019 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 08 11:36:49.071019 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:36:49.071019 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:36:49.071019 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:36:49.071019 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:36:49.071019 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:36:49.071019 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:36:49.071019 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:36:49.071019 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:36:49.071019 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 08 11:36:49.071019 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:36:49.071019 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f6956c00-7f78-43fc-a295-697c0451fc50 tempest-ServersAdminNegativeTestJSON-555670176 tempest-ServersAdminNegativeTestJSON-555670176-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:36:49.071019 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f6956c00-7f78-43fc-a295-697c0451fc50 tempest-ServersAdminNegativeTestJSON-555670176 tempest-ServersAdminNegativeTestJSON-555670176-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/7e300b4a-0e01-42ac-a828-6369b53c8357/action" status: 403 len: 113 microversion: 2.1 time: 0.250518 Sep 08 11:36:49.071019 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3321/6775] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 11:36:48 2022] POST /compute/v2.1/servers/7e300b4a-0e01-42ac-a828-6369b53c8357/action => generated 113 bytes in 252 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:36:49.077225 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-68658d36-1a8f-4d99-ab3d-0fd9cc6eed32 tempest-ServersAdminNegativeTestJSON-555670176 tempest-ServersAdminNegativeTestJSON-555670176-project-admin] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:36:49.094571 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-68658d36-1a8f-4d99-ab3d-0fd9cc6eed32 tempest-ServersAdminNegativeTestJSON-555670176 tempest-ServersAdminNegativeTestJSON-555670176-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/727322946" status: 202 len: 0 microversion: 2.1 time: 0.021204 Sep 08 11:36:49.095131 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3455/6776] 10.222.0.27 () {58 vars in 1158 bytes} [Thu Sep 8 11:36:49 2022] DELETE /compute/v2.1/flavors/727322946 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 11:36:49.103738 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c9e5e311-c544-4dc2-b0d2-1c1a8ecabc95 tempest-ServersAdminNegativeTestJSON-555670176 tempest-ServersAdminNegativeTestJSON-555670176-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:36:49.123568 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c9e5e311-c544-4dc2-b0d2-1c1a8ecabc95 tempest-ServersAdminNegativeTestJSON-555670176 tempest-ServersAdminNegativeTestJSON-555670176-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024182 Sep 08 11:36:49.124138 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3322/6777] 10.222.0.27 () {58 vars in 1146 bytes} [Thu Sep 8 11:36:49 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:36:49.144487 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c988ab5b-8615-4bb8-8ab2-8a6484ee3e82 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:36:49.145015 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c988ab5b-8615-4bb8-8ab2-8a6484ee3e82 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] [instance: 7e300b4a-0e01-42ac-a828-6369b53c8357] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:36:49.152703 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c988ab5b-8615-4bb8-8ab2-8a6484ee3e82 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:49.153254 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c988ab5b-8615-4bb8-8ab2-8a6484ee3e82 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:49.153711 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c988ab5b-8615-4bb8-8ab2-8a6484ee3e82 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:49.154428 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c988ab5b-8615-4bb8-8ab2-8a6484ee3e82 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:49.154897 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c988ab5b-8615-4bb8-8ab2-8a6484ee3e82 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:49.155337 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c988ab5b-8615-4bb8-8ab2-8a6484ee3e82 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:49.186333 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c988ab5b-8615-4bb8-8ab2-8a6484ee3e82 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] [instance: 7e300b4a-0e01-42ac-a828-6369b53c8357] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:36:49.265369 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c988ab5b-8615-4bb8-8ab2-8a6484ee3e82 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7e300b4a-0e01-42ac-a828-6369b53c8357" status: 204 len: 0 microversion: 2.1 time: 0.124327 Sep 08 11:36:49.266313 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3456/6778] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:36:49 2022] DELETE /compute/v2.1/servers/7e300b4a-0e01-42ac-a828-6369b53c8357 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:36:49.274497 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-38d3f970-4d77-4002-a7e7-050ac31c163a tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:36:49.275653 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-38d3f970-4d77-4002-a7e7-050ac31c163a tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] [instance: 7e300b4a-0e01-42ac-a828-6369b53c8357] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:36:49.283219 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38d3f970-4d77-4002-a7e7-050ac31c163a tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:49.283729 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38d3f970-4d77-4002-a7e7-050ac31c163a tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:49.284191 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38d3f970-4d77-4002-a7e7-050ac31c163a tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:49.284906 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38d3f970-4d77-4002-a7e7-050ac31c163a tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:49.285404 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38d3f970-4d77-4002-a7e7-050ac31c163a tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:49.285847 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38d3f970-4d77-4002-a7e7-050ac31c163a tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:49.428347 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-38d3f970-4d77-4002-a7e7-050ac31c163a tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3feb9894a1ff49d2b0e923215473be4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4478e152a6f4568840d90f8c978f24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:36:49.437422 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-38d3f970-4d77-4002-a7e7-050ac31c163a tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] 10.222.0.27 "GET /compute/v2.1/servers/7e300b4a-0e01-42ac-a828-6369b53c8357" status: 200 len: 1478 microversion: 2.1 time: 0.166740 Sep 08 11:36:49.438009 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3323/6779] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:36:49 2022] GET /compute/v2.1/servers/7e300b4a-0e01-42ac-a828-6369b53c8357 => generated 1478 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:36:50.462412 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5c0a6b76-8382-4503-84c2-e8c0bbb325e8 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:36:50.463119 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5c0a6b76-8382-4503-84c2-e8c0bbb325e8 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] [instance: 7e300b4a-0e01-42ac-a828-6369b53c8357] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:36:50.470294 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5c0a6b76-8382-4503-84c2-e8c0bbb325e8 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:50.470800 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5c0a6b76-8382-4503-84c2-e8c0bbb325e8 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:50.471256 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5c0a6b76-8382-4503-84c2-e8c0bbb325e8 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:50.471977 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5c0a6b76-8382-4503-84c2-e8c0bbb325e8 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:50.472448 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5c0a6b76-8382-4503-84c2-e8c0bbb325e8 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:50.472879 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5c0a6b76-8382-4503-84c2-e8c0bbb325e8 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:50.628010 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5c0a6b76-8382-4503-84c2-e8c0bbb325e8 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3feb9894a1ff49d2b0e923215473be4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4478e152a6f4568840d90f8c978f24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:36:50.636521 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5c0a6b76-8382-4503-84c2-e8c0bbb325e8 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] 10.222.0.27 "GET /compute/v2.1/servers/7e300b4a-0e01-42ac-a828-6369b53c8357" status: 200 len: 1478 microversion: 2.1 time: 0.178514 Sep 08 11:36:50.637128 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3457/6780] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:36:50 2022] GET /compute/v2.1/servers/7e300b4a-0e01-42ac-a828-6369b53c8357 => generated 1478 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:36:51.360404 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-6345a0cb-d80d-4f08-a93a-a2735d43df69 req-ac1bbcf8-56f6-4827-8588-76403372ddd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e300b4a-0e01-42ac-a828-6369b53c8357", "name": "network-vif-deleted", "tag": "468ab22e-0933-4b38-95ec-7dbcdb3e1241"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:36:51.371929 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-6345a0cb-d80d-4f08-a93a-a2735d43df69 req-ac1bbcf8-56f6-4827-8588-76403372ddd8 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:51.372423 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-6345a0cb-d80d-4f08-a93a-a2735d43df69 req-ac1bbcf8-56f6-4827-8588-76403372ddd8 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:51.373689 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-6345a0cb-d80d-4f08-a93a-a2735d43df69 req-ac1bbcf8-56f6-4827-8588-76403372ddd8 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:51.389633 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-6345a0cb-d80d-4f08-a93a-a2735d43df69 req-ac1bbcf8-56f6-4827-8588-76403372ddd8 service nova] Creating event network-vif-deleted:468ab22e-0933-4b38-95ec-7dbcdb3e1241 for instance 7e300b4a-0e01-42ac-a828-6369b53c8357 on n-h1-850501-12 Sep 08 11:36:51.397239 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-6345a0cb-d80d-4f08-a93a-a2735d43df69 req-ac1bbcf8-56f6-4827-8588-76403372ddd8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039973 Sep 08 11:36:51.398519 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3324/6781] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:36:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:36:51.660023 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8eb1a448-43e1-4084-ab9c-2bbc9783ee40 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:36:51.660576 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8eb1a448-43e1-4084-ab9c-2bbc9783ee40 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] [instance: 7e300b4a-0e01-42ac-a828-6369b53c8357] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:36:51.668158 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8eb1a448-43e1-4084-ab9c-2bbc9783ee40 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:51.668665 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8eb1a448-43e1-4084-ab9c-2bbc9783ee40 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:51.669128 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8eb1a448-43e1-4084-ab9c-2bbc9783ee40 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:51.669847 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8eb1a448-43e1-4084-ab9c-2bbc9783ee40 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:51.670309 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8eb1a448-43e1-4084-ab9c-2bbc9783ee40 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:51.670745 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8eb1a448-43e1-4084-ab9c-2bbc9783ee40 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:51.705926 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8eb1a448-43e1-4084-ab9c-2bbc9783ee40 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:51.706423 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8eb1a448-43e1-4084-ab9c-2bbc9783ee40 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:51.706861 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8eb1a448-43e1-4084-ab9c-2bbc9783ee40 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:51.707317 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-8eb1a448-43e1-4084-ab9c-2bbc9783ee40 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Lazy-loading 'fault' on Instance uuid 7e300b4a-0e01-42ac-a828-6369b53c8357 {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:36:51.755996 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8eb1a448-43e1-4084-ab9c-2bbc9783ee40 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3feb9894a1ff49d2b0e923215473be4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4478e152a6f4568840d90f8c978f24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:36:51.764478 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8eb1a448-43e1-4084-ab9c-2bbc9783ee40 tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] 10.222.0.27 "GET /compute/v2.1/servers/7e300b4a-0e01-42ac-a828-6369b53c8357" status: 200 len: 1312 microversion: 2.1 time: 0.108444 Sep 08 11:36:51.765083 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3458/6782] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:36:51 2022] GET /compute/v2.1/servers/7e300b4a-0e01-42ac-a828-6369b53c8357 => generated 1312 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:36:52.789671 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-726c19d7-03ca-4fcb-96ad-ffe3d554496a tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:36:52.790294 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-726c19d7-03ca-4fcb-96ad-ffe3d554496a tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] [instance: 7e300b4a-0e01-42ac-a828-6369b53c8357] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:36:52.797646 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-726c19d7-03ca-4fcb-96ad-ffe3d554496a tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:52.798150 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-726c19d7-03ca-4fcb-96ad-ffe3d554496a tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:52.798723 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-726c19d7-03ca-4fcb-96ad-ffe3d554496a tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:52.799443 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-726c19d7-03ca-4fcb-96ad-ffe3d554496a tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:52.799911 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-726c19d7-03ca-4fcb-96ad-ffe3d554496a tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:52.800346 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-726c19d7-03ca-4fcb-96ad-ffe3d554496a tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:52.814830 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-726c19d7-03ca-4fcb-96ad-ffe3d554496a tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] HTTP exception thrown: Instance 7e300b4a-0e01-42ac-a828-6369b53c8357 could not be found. Sep 08 11:36:52.816488 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-726c19d7-03ca-4fcb-96ad-ffe3d554496a tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Request method failure captured: Sep 08 11:36:52.816488 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/7e300b4a-0e01-42ac-a828-6369b53c8357 HTTP/1.1 Sep 08 11:36:52.816488 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 11:36:52.816488 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 11:36:52.816488 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 11:36:52.816488 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 11:36:52.816488 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 11:36:52.816488 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 11:36:52.816488 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 11:36:52.816488 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 11:36:52.816488 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGdO-fSqZJFdF-kbOND_6_h2fyIdTXBH6SNPu4rklDOXjbOpzba1nW-0YsXGgb4GTCRsEZw9D6tg0UMrSkUeivgpK--JFnx04mdAutbinZRXt8cciu0HN0uImRmgBO8UOOlotmNzO_AOfxi9u-lSIfHttDys-OkTX-fQAuNznEfKutK0 Sep 08 11:36:52.816488 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 11:36:52.816488 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 11:36:52.816488 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 11:36:52.816488 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 11:36:52.816488 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 11:36:52.816488 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 11:36:52.816488 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: c4478e152a6f4568840d90f8c978f24b Sep 08 11:36:52.816488 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1701572210 Sep 08 11:36:52.816488 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 11:36:52.816488 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 11:36:52.816488 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c4478e152a6f4568840d90f8c978f24b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c4478e152a6f4568840d90f8c978f24b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c4478e152a6f4568840d90f8c978f24b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c4478e152a6f4568840d90f8c978f24b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:36:52.816488 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1701572210 Sep 08 11:36:52.816488 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: c4478e152a6f4568840d90f8c978f24b Sep 08 11:36:52.816488 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1701572210 Sep 08 11:36:52.816488 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServersAdminNegativeTestJSON-1701572210-project Sep 08 11:36:52.816488 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 11:36:52.816488 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 11:36:52.816488 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 3feb9894a1ff49d2b0e923215473be4a Sep 08 11:36:52.816488 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1701572210-project Sep 08 11:36:52.816488 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 11:36:52.816488 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 7e300b4a-0e01-42ac-a828-6369b53c8357 could not be found. Sep 08 11:36:52.816488 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '7e300b4a-0e01-42ac-a828-6369b53c8357'} Sep 08 11:36:52.816488 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:36:52.816488 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:36:52.816488 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:36:52.816488 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:36:52.816488 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:36:52.816488 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:36:52.816488 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:36:52.816488 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:36:52.816488 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:36:52.816488 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:36:52.816488 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e300b4a-0e01-42ac-a828-6369b53c8357 could not be found. Sep 08 11:36:52.816488 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:36:52.816488 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:36:52.816488 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:36:52.816488 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:36:52.816488 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:36:52.816488 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:36:52.816488 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:36:52.816488 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:36:52.816488 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:36:52.816488 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:36:52.816488 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:36:52.816488 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:36:52.816488 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:36:52.816488 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:36:52.816488 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:36:52.816488 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:36:52.816488 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e300b4a-0e01-42ac-a828-6369b53c8357 could not be found. Sep 08 11:36:52.816488 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:36:52.816488 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:36:52.820628 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:36:52.820628 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:36:52.820628 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:36:52.820628 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:36:52.820628 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:36:52.820628 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:36:52.820628 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e300b4a-0e01-42ac-a828-6369b53c8357 could not be found. Sep 08 11:36:52.820628 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:36:52.820628 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-726c19d7-03ca-4fcb-96ad-ffe3d554496a tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] Returning 404 to user: Instance 7e300b4a-0e01-42ac-a828-6369b53c8357 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:36:52.820628 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-726c19d7-03ca-4fcb-96ad-ffe3d554496a tempest-ServersAdminNegativeTestJSON-1701572210 tempest-ServersAdminNegativeTestJSON-1701572210-project] 10.222.0.27 "GET /compute/v2.1/servers/7e300b4a-0e01-42ac-a828-6369b53c8357" status: 404 len: 111 microversion: 2.1 time: 0.033875 Sep 08 11:36:52.820628 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3325/6783] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:36:52 2022] GET /compute/v2.1/servers/7e300b4a-0e01-42ac-a828-6369b53c8357 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:36:58.622157 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:36:58.623040 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=3 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:36:58.746240 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1c9db4b3-2c6c-4f99-9830-48c2cd3a2282 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1534411556", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "7f3390d4-23e3-4b84-b5b7-c3b3e760280d"}]}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:36:58.802479 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-1c9db4b3-2c6c-4f99-9830-48c2cd3a2282 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] validate_networks() for [('7f3390d4-23e3-4b84-b5b7-c3b3e760280d', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:36:59.505729 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-1c9db4b3-2c6c-4f99-9830-48c2cd3a2282 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:36:59.506303 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-1c9db4b3-2c6c-4f99-9830-48c2cd3a2282 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:36:59.506792 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-1c9db4b3-2c6c-4f99-9830-48c2cd3a2282 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:36:59.507356 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-1c9db4b3-2c6c-4f99-9830-48c2cd3a2282 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:36:59.507782 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-1c9db4b3-2c6c-4f99-9830-48c2cd3a2282 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:36:59.517369 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1c9db4b3-2c6c-4f99-9830-48c2cd3a2282 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:59.517792 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1c9db4b3-2c6c-4f99-9830-48c2cd3a2282 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:59.518236 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1c9db4b3-2c6c-4f99-9830-48c2cd3a2282 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:59.518982 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1c9db4b3-2c6c-4f99-9830-48c2cd3a2282 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:59.519445 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1c9db4b3-2c6c-4f99-9830-48c2cd3a2282 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:59.519877 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1c9db4b3-2c6c-4f99-9830-48c2cd3a2282 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:59.538270 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-1c9db4b3-2c6c-4f99-9830-48c2cd3a2282 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Getting quotas for project 1ef8ff07efb44f0da2a55967b7bb5843. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:36:59.545546 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-1c9db4b3-2c6c-4f99-9830-48c2cd3a2282 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Getting quotas for user 4e084870bbd046019e14bce31711eed0 and project 1ef8ff07efb44f0da2a55967b7bb5843. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:36:59.558662 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1c9db4b3-2c6c-4f99-9830-48c2cd3a2282 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:36:59.561002 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1c9db4b3-2c6c-4f99-9830-48c2cd3a2282 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] [instance: 27fad958-f21e-4c3a-a74b-27736cc5aad6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:36:59.611421 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1c9db4b3-2c6c-4f99-9830-48c2cd3a2282 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.995289 Sep 08 11:36:59.612092 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3459/6784] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 11:36:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 997 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:36:59.624888 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-256fecc8-70ec-4a94-bcaf-2c11ea32b64e tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:36:59.625642 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-256fecc8-70ec-4a94-bcaf-2c11ea32b64e tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] [instance: 27fad958-f21e-4c3a-a74b-27736cc5aad6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:36:59.628376 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:36:59.630390 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:36:59.709066 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-256fecc8-70ec-4a94-bcaf-2c11ea32b64e tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e084870bbd046019e14bce31711eed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef8ff07efb44f0da2a55967b7bb5843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:36:59.717913 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-256fecc8-70ec-4a94-bcaf-2c11ea32b64e tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] 10.222.0.27 "GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6" status: 200 len: 1215 microversion: 2.1 time: 0.097853 Sep 08 11:36:59.718547 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3326/6785] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:36:59 2022] GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6 => generated 1215 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:37:00.742682 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fdef4f8c-008f-46e1-8e10-3c7458ef675a tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:37:00.744283 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fdef4f8c-008f-46e1-8e10-3c7458ef675a tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] [instance: 27fad958-f21e-4c3a-a74b-27736cc5aad6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:37:00.753278 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fdef4f8c-008f-46e1-8e10-3c7458ef675a tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:00.754139 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fdef4f8c-008f-46e1-8e10-3c7458ef675a tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:00.755203 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fdef4f8c-008f-46e1-8e10-3c7458ef675a tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:00.756185 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fdef4f8c-008f-46e1-8e10-3c7458ef675a tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:00.756723 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fdef4f8c-008f-46e1-8e10-3c7458ef675a tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:00.757403 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fdef4f8c-008f-46e1-8e10-3c7458ef675a tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:00.847115 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-fdef4f8c-008f-46e1-8e10-3c7458ef675a tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e084870bbd046019e14bce31711eed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef8ff07efb44f0da2a55967b7bb5843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:37:00.861378 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fdef4f8c-008f-46e1-8e10-3c7458ef675a tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] 10.222.0.27 "GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6" status: 200 len: 1275 microversion: 2.1 time: 0.123435 Sep 08 11:37:00.863652 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3460/6786] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:37:00 2022] GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6 => generated 1275 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:37:01.891947 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-35476f3a-63d4-4c41-bbe7-c7653b963890 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:37:01.894510 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-35476f3a-63d4-4c41-bbe7-c7653b963890 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] [instance: 27fad958-f21e-4c3a-a74b-27736cc5aad6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:37:01.903141 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35476f3a-63d4-4c41-bbe7-c7653b963890 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:01.903648 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35476f3a-63d4-4c41-bbe7-c7653b963890 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:01.904099 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35476f3a-63d4-4c41-bbe7-c7653b963890 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:01.904818 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35476f3a-63d4-4c41-bbe7-c7653b963890 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:01.905323 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35476f3a-63d4-4c41-bbe7-c7653b963890 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:01.905744 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35476f3a-63d4-4c41-bbe7-c7653b963890 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:02.057491 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-35476f3a-63d4-4c41-bbe7-c7653b963890 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e084870bbd046019e14bce31711eed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef8ff07efb44f0da2a55967b7bb5843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:37:02.065843 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-35476f3a-63d4-4c41-bbe7-c7653b963890 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] 10.222.0.27 "GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6" status: 200 len: 1315 microversion: 2.1 time: 0.182282 Sep 08 11:37:02.068281 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3327/6787] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:37:01 2022] GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6 => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:37:02.205517 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-8d914e79-4620-4069-9c65-924489c7e3c1 req-ac873de6-5f43-4f3b-a9dc-9460ed06de7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27fad958-f21e-4c3a-a74b-27736cc5aad6", "tag": "10e8cfbc-dcf3-494d-b2a0-d94e0bebd442"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:37:02.214344 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=7,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:37:02.220577 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-8d914e79-4620-4069-9c65-924489c7e3c1 req-ac873de6-5f43-4f3b-a9dc-9460ed06de7b service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:02.221440 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-8d914e79-4620-4069-9c65-924489c7e3c1 req-ac873de6-5f43-4f3b-a9dc-9460ed06de7b service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:02.221980 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-8d914e79-4620-4069-9c65-924489c7e3c1 req-ac873de6-5f43-4f3b-a9dc-9460ed06de7b service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:02.225307 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:37:02.245661 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-8d914e79-4620-4069-9c65-924489c7e3c1 req-ac873de6-5f43-4f3b-a9dc-9460ed06de7b service nova] Creating event network-changed:10e8cfbc-dcf3-494d-b2a0-d94e0bebd442 for instance 27fad958-f21e-4c3a-a74b-27736cc5aad6 on n-h1-850501-12 Sep 08 11:37:02.257874 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-8d914e79-4620-4069-9c65-924489c7e3c1 req-ac873de6-5f43-4f3b-a9dc-9460ed06de7b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057458 Sep 08 11:37:02.260378 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3461/6788] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:37:03.091649 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-49257dcf-77eb-4820-82fc-e45bd5396777 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:37:03.092199 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-49257dcf-77eb-4820-82fc-e45bd5396777 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] [instance: 27fad958-f21e-4c3a-a74b-27736cc5aad6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:37:03.099338 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49257dcf-77eb-4820-82fc-e45bd5396777 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:03.099850 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49257dcf-77eb-4820-82fc-e45bd5396777 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:03.100306 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49257dcf-77eb-4820-82fc-e45bd5396777 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:03.101040 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49257dcf-77eb-4820-82fc-e45bd5396777 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:03.101524 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49257dcf-77eb-4820-82fc-e45bd5396777 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:03.101965 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49257dcf-77eb-4820-82fc-e45bd5396777 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:03.121555 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=64 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:37:03.245545 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-49257dcf-77eb-4820-82fc-e45bd5396777 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e084870bbd046019e14bce31711eed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef8ff07efb44f0da2a55967b7bb5843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:37:03.253404 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-49257dcf-77eb-4820-82fc-e45bd5396777 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] 10.222.0.27 "GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6" status: 200 len: 1315 microversion: 2.1 time: 0.165730 Sep 08 11:37:03.253997 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3328/6789] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:37:03 2022] GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:37:04.278184 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9736d387-dcc7-43bf-992e-f136e58139af tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:37:04.278947 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9736d387-dcc7-43bf-992e-f136e58139af tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] [instance: 27fad958-f21e-4c3a-a74b-27736cc5aad6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:37:04.285328 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9736d387-dcc7-43bf-992e-f136e58139af tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:04.285818 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9736d387-dcc7-43bf-992e-f136e58139af tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:04.286252 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9736d387-dcc7-43bf-992e-f136e58139af tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:04.286946 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9736d387-dcc7-43bf-992e-f136e58139af tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:04.287405 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9736d387-dcc7-43bf-992e-f136e58139af tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:04.287839 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9736d387-dcc7-43bf-992e-f136e58139af tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:04.428674 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9736d387-dcc7-43bf-992e-f136e58139af tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e084870bbd046019e14bce31711eed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef8ff07efb44f0da2a55967b7bb5843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:37:04.437376 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9736d387-dcc7-43bf-992e-f136e58139af tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] 10.222.0.27 "GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6" status: 200 len: 1315 microversion: 2.1 time: 0.164908 Sep 08 11:37:04.437986 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3462/6790] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:37:04 2022] GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:37:05.461436 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3f9a727c-0653-494d-aa25-0ef6ef166605 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:37:05.462596 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3f9a727c-0653-494d-aa25-0ef6ef166605 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] [instance: 27fad958-f21e-4c3a-a74b-27736cc5aad6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:37:05.465338 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:37:05.470700 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3f9a727c-0653-494d-aa25-0ef6ef166605 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:05.471212 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3f9a727c-0653-494d-aa25-0ef6ef166605 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:05.471672 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3f9a727c-0653-494d-aa25-0ef6ef166605 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:05.472391 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3f9a727c-0653-494d-aa25-0ef6ef166605 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:05.472867 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3f9a727c-0653-494d-aa25-0ef6ef166605 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:05.473338 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3f9a727c-0653-494d-aa25-0ef6ef166605 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:05.610256 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3f9a727c-0653-494d-aa25-0ef6ef166605 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e084870bbd046019e14bce31711eed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef8ff07efb44f0da2a55967b7bb5843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:37:05.617993 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3f9a727c-0653-494d-aa25-0ef6ef166605 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] 10.222.0.27 "GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6" status: 200 len: 1315 microversion: 2.1 time: 0.160491 Sep 08 11:37:05.618508 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3329/6791] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:37:05 2022] GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:37:06.641313 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-24cbf8e4-80b4-46e6-a148-771ea13416a7 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:37:06.641967 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-24cbf8e4-80b4-46e6-a148-771ea13416a7 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] [instance: 27fad958-f21e-4c3a-a74b-27736cc5aad6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:37:06.648934 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24cbf8e4-80b4-46e6-a148-771ea13416a7 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:06.650106 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24cbf8e4-80b4-46e6-a148-771ea13416a7 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:06.650614 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24cbf8e4-80b4-46e6-a148-771ea13416a7 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:06.651316 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24cbf8e4-80b4-46e6-a148-771ea13416a7 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:06.651778 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24cbf8e4-80b4-46e6-a148-771ea13416a7 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:06.652212 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24cbf8e4-80b4-46e6-a148-771ea13416a7 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:06.790412 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-24cbf8e4-80b4-46e6-a148-771ea13416a7 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e084870bbd046019e14bce31711eed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef8ff07efb44f0da2a55967b7bb5843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:37:06.798496 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-24cbf8e4-80b4-46e6-a148-771ea13416a7 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] 10.222.0.27 "GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6" status: 200 len: 1315 microversion: 2.1 time: 0.161249 Sep 08 11:37:06.799071 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3463/6792] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:37:06 2022] GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:37:07.827647 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f83e99bd-721a-41a7-93bf-45846ce2a1c6 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:37:07.828189 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f83e99bd-721a-41a7-93bf-45846ce2a1c6 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] [instance: 27fad958-f21e-4c3a-a74b-27736cc5aad6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:37:07.834939 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f83e99bd-721a-41a7-93bf-45846ce2a1c6 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:07.835429 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f83e99bd-721a-41a7-93bf-45846ce2a1c6 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:07.835873 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f83e99bd-721a-41a7-93bf-45846ce2a1c6 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:07.836602 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f83e99bd-721a-41a7-93bf-45846ce2a1c6 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:07.837094 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f83e99bd-721a-41a7-93bf-45846ce2a1c6 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:07.837534 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f83e99bd-721a-41a7-93bf-45846ce2a1c6 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:07.973634 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f83e99bd-721a-41a7-93bf-45846ce2a1c6 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e084870bbd046019e14bce31711eed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef8ff07efb44f0da2a55967b7bb5843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:37:07.981893 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f83e99bd-721a-41a7-93bf-45846ce2a1c6 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] 10.222.0.27 "GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6" status: 200 len: 1315 microversion: 2.1 time: 0.158332 Sep 08 11:37:07.982491 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3330/6793] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:37:07 2022] GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:37:08.054431 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-f01e61db-02f2-4d87-808a-8acd0c9f1951 req-e17e7be2-2fd9-4b5b-a878-0ca1dcc0135f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27fad958-f21e-4c3a-a74b-27736cc5aad6", "name": "network-vif-plugged", "status": "completed", "tag": "10e8cfbc-dcf3-494d-b2a0-d94e0bebd442"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:37:08.066403 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-f01e61db-02f2-4d87-808a-8acd0c9f1951 req-e17e7be2-2fd9-4b5b-a878-0ca1dcc0135f service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:08.066894 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-f01e61db-02f2-4d87-808a-8acd0c9f1951 req-e17e7be2-2fd9-4b5b-a878-0ca1dcc0135f service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:08.067415 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-f01e61db-02f2-4d87-808a-8acd0c9f1951 req-e17e7be2-2fd9-4b5b-a878-0ca1dcc0135f service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:08.079897 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-f01e61db-02f2-4d87-808a-8acd0c9f1951 req-e17e7be2-2fd9-4b5b-a878-0ca1dcc0135f service nova] Creating event network-vif-plugged:10e8cfbc-dcf3-494d-b2a0-d94e0bebd442 for instance 27fad958-f21e-4c3a-a74b-27736cc5aad6 on n-h1-850501-12 Sep 08 11:37:08.085159 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-f01e61db-02f2-4d87-808a-8acd0c9f1951 req-e17e7be2-2fd9-4b5b-a878-0ca1dcc0135f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034684 Sep 08 11:37:08.085849 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3464/6794] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:37:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:37:09.005845 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-23e722b6-4f83-4f8c-ac28-5c6fc7b87c1b tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:37:09.006439 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-23e722b6-4f83-4f8c-ac28-5c6fc7b87c1b tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] [instance: 27fad958-f21e-4c3a-a74b-27736cc5aad6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:37:09.013549 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23e722b6-4f83-4f8c-ac28-5c6fc7b87c1b tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:09.014059 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23e722b6-4f83-4f8c-ac28-5c6fc7b87c1b tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:09.014511 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23e722b6-4f83-4f8c-ac28-5c6fc7b87c1b tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:09.015232 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23e722b6-4f83-4f8c-ac28-5c6fc7b87c1b tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:09.015706 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23e722b6-4f83-4f8c-ac28-5c6fc7b87c1b tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:09.016147 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23e722b6-4f83-4f8c-ac28-5c6fc7b87c1b tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:09.165600 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-23e722b6-4f83-4f8c-ac28-5c6fc7b87c1b tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e084870bbd046019e14bce31711eed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef8ff07efb44f0da2a55967b7bb5843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:37:09.174324 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-23e722b6-4f83-4f8c-ac28-5c6fc7b87c1b tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] 10.222.0.27 "GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6" status: 200 len: 1315 microversion: 2.1 time: 0.172540 Sep 08 11:37:09.174923 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3331/6795] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:37:09 2022] GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:37:10.195215 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:37:10.195949 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=6 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:37:10.200647 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ced667cc-218b-40b3-b228-d5fe81780f8f tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:37:10.201382 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ced667cc-218b-40b3-b228-d5fe81780f8f tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] [instance: 27fad958-f21e-4c3a-a74b-27736cc5aad6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:37:10.208476 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ced667cc-218b-40b3-b228-d5fe81780f8f tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:10.208968 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ced667cc-218b-40b3-b228-d5fe81780f8f tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:10.209447 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ced667cc-218b-40b3-b228-d5fe81780f8f tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:10.210149 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ced667cc-218b-40b3-b228-d5fe81780f8f tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:10.210628 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ced667cc-218b-40b3-b228-d5fe81780f8f tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:10.211042 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ced667cc-218b-40b3-b228-d5fe81780f8f tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:10.343543 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ced667cc-218b-40b3-b228-d5fe81780f8f tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e084870bbd046019e14bce31711eed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef8ff07efb44f0da2a55967b7bb5843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:37:10.351422 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ced667cc-218b-40b3-b228-d5fe81780f8f tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] 10.222.0.27 "GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6" status: 200 len: 1502 microversion: 2.1 time: 0.158055 Sep 08 11:37:10.351996 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3465/6796] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:37:10 2022] GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6 => generated 1502 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:37:10.375200 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-acb407a0-befa-43ec-a2e7-8a03fe57ea23 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:37:10.377710 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-acb407a0-befa-43ec-a2e7-8a03fe57ea23 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] [instance: 27fad958-f21e-4c3a-a74b-27736cc5aad6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:37:10.379813 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:37:10.386533 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-acb407a0-befa-43ec-a2e7-8a03fe57ea23 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:10.387017 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-acb407a0-befa-43ec-a2e7-8a03fe57ea23 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:10.387467 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-acb407a0-befa-43ec-a2e7-8a03fe57ea23 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:10.388173 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-acb407a0-befa-43ec-a2e7-8a03fe57ea23 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:10.388640 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-acb407a0-befa-43ec-a2e7-8a03fe57ea23 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:10.389112 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-acb407a0-befa-43ec-a2e7-8a03fe57ea23 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:10.419169 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-acb407a0-befa-43ec-a2e7-8a03fe57ea23 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '4e084870bbd046019e14bce31711eed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef8ff07efb44f0da2a55967b7bb5843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:37:10.424656 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-acb407a0-befa-43ec-a2e7-8a03fe57ea23 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] [instance: 27fad958-f21e-4c3a-a74b-27736cc5aad6] Old instance type m1.heat2, new instance type m1.heat {{(pid=128862) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 08 11:37:10.431097 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-acb407a0-befa-43ec-a2e7-8a03fe57ea23 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:37:10.431528 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-acb407a0-befa-43ec-a2e7-8a03fe57ea23 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:37:10.432756 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-acb407a0-befa-43ec-a2e7-8a03fe57ea23 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:37:10.433230 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-acb407a0-befa-43ec-a2e7-8a03fe57ea23 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:37:10.433654 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-acb407a0-befa-43ec-a2e7-8a03fe57ea23 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:37:10.499323 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-acb407a0-befa-43ec-a2e7-8a03fe57ea23 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] 10.222.0.27 "POST /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6/action" status: 202 len: 0 microversion: 2.1 time: 0.128261 Sep 08 11:37:10.499862 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3332/6797] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 11:37:10 2022] POST /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:37:10.508079 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1963232d-f00e-4b23-bd32-1b19046e95d8 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:37:10.508702 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1963232d-f00e-4b23-bd32-1b19046e95d8 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] [instance: 27fad958-f21e-4c3a-a74b-27736cc5aad6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:37:10.515394 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1963232d-f00e-4b23-bd32-1b19046e95d8 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:10.515894 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1963232d-f00e-4b23-bd32-1b19046e95d8 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:10.516337 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1963232d-f00e-4b23-bd32-1b19046e95d8 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:10.517164 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1963232d-f00e-4b23-bd32-1b19046e95d8 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:10.517689 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1963232d-f00e-4b23-bd32-1b19046e95d8 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:10.518124 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1963232d-f00e-4b23-bd32-1b19046e95d8 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:10.661472 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1963232d-f00e-4b23-bd32-1b19046e95d8 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e084870bbd046019e14bce31711eed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef8ff07efb44f0da2a55967b7bb5843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:37:10.670235 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1963232d-f00e-4b23-bd32-1b19046e95d8 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] 10.222.0.27 "GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6" status: 200 len: 1511 microversion: 2.1 time: 0.166030 Sep 08 11:37:10.670857 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3466/6798] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:37:10 2022] GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6 => generated 1511 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:37:11.694798 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7055ca1a-883f-4b8b-bd3e-c44221b21b14 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:37:11.695431 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7055ca1a-883f-4b8b-bd3e-c44221b21b14 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] [instance: 27fad958-f21e-4c3a-a74b-27736cc5aad6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:37:11.702966 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7055ca1a-883f-4b8b-bd3e-c44221b21b14 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:11.703505 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7055ca1a-883f-4b8b-bd3e-c44221b21b14 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:11.703965 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7055ca1a-883f-4b8b-bd3e-c44221b21b14 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:11.704685 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7055ca1a-883f-4b8b-bd3e-c44221b21b14 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:11.705187 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7055ca1a-883f-4b8b-bd3e-c44221b21b14 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:11.705638 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7055ca1a-883f-4b8b-bd3e-c44221b21b14 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:11.839614 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7055ca1a-883f-4b8b-bd3e-c44221b21b14 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e084870bbd046019e14bce31711eed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef8ff07efb44f0da2a55967b7bb5843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:37:11.847637 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7055ca1a-883f-4b8b-bd3e-c44221b21b14 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] 10.222.0.27 "GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6" status: 200 len: 1511 microversion: 2.1 time: 0.157585 Sep 08 11:37:11.848210 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3333/6799] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:37:11 2022] GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6 => generated 1511 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:37:12.871686 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1a93de1a-51a6-4c78-a4a4-38842296530f tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:37:12.872202 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1a93de1a-51a6-4c78-a4a4-38842296530f tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] [instance: 27fad958-f21e-4c3a-a74b-27736cc5aad6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:37:12.879115 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1a93de1a-51a6-4c78-a4a4-38842296530f tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:12.879606 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1a93de1a-51a6-4c78-a4a4-38842296530f tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:12.880044 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1a93de1a-51a6-4c78-a4a4-38842296530f tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:12.880739 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1a93de1a-51a6-4c78-a4a4-38842296530f tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:12.881240 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1a93de1a-51a6-4c78-a4a4-38842296530f tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:12.881671 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1a93de1a-51a6-4c78-a4a4-38842296530f tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:13.017218 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1a93de1a-51a6-4c78-a4a4-38842296530f tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e084870bbd046019e14bce31711eed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef8ff07efb44f0da2a55967b7bb5843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:37:13.025047 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1a93de1a-51a6-4c78-a4a4-38842296530f tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] 10.222.0.27 "GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6" status: 200 len: 1516 microversion: 2.1 time: 0.157464 Sep 08 11:37:13.025923 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3467/6800] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:37:12 2022] GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6 => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:37:14.048771 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c1f34de3-be51-407f-aaa8-49d1cc6277ff tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:37:14.049447 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c1f34de3-be51-407f-aaa8-49d1cc6277ff tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] [instance: 27fad958-f21e-4c3a-a74b-27736cc5aad6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:37:14.056798 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c1f34de3-be51-407f-aaa8-49d1cc6277ff tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:14.057671 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c1f34de3-be51-407f-aaa8-49d1cc6277ff tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:14.058132 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c1f34de3-be51-407f-aaa8-49d1cc6277ff tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:14.058941 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c1f34de3-be51-407f-aaa8-49d1cc6277ff tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:14.059421 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c1f34de3-be51-407f-aaa8-49d1cc6277ff tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:14.059864 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c1f34de3-be51-407f-aaa8-49d1cc6277ff tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:14.195764 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c1f34de3-be51-407f-aaa8-49d1cc6277ff tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e084870bbd046019e14bce31711eed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef8ff07efb44f0da2a55967b7bb5843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:37:14.204310 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c1f34de3-be51-407f-aaa8-49d1cc6277ff tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] 10.222.0.27 "GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6" status: 200 len: 1516 microversion: 2.1 time: 0.159595 Sep 08 11:37:14.204912 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3334/6801] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:37:14 2022] GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6 => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:37:15.227910 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3c767f65-8c00-4a5d-8b3f-6f0e10fe43f1 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:37:15.229195 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3c767f65-8c00-4a5d-8b3f-6f0e10fe43f1 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] [instance: 27fad958-f21e-4c3a-a74b-27736cc5aad6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:37:15.236263 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3c767f65-8c00-4a5d-8b3f-6f0e10fe43f1 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:15.236751 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3c767f65-8c00-4a5d-8b3f-6f0e10fe43f1 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:15.237223 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3c767f65-8c00-4a5d-8b3f-6f0e10fe43f1 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:15.237935 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3c767f65-8c00-4a5d-8b3f-6f0e10fe43f1 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:15.238376 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3c767f65-8c00-4a5d-8b3f-6f0e10fe43f1 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:15.238803 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3c767f65-8c00-4a5d-8b3f-6f0e10fe43f1 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:15.399650 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-3c767f65-8c00-4a5d-8b3f-6f0e10fe43f1 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e084870bbd046019e14bce31711eed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef8ff07efb44f0da2a55967b7bb5843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:37:15.408108 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3c767f65-8c00-4a5d-8b3f-6f0e10fe43f1 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] 10.222.0.27 "GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6" status: 200 len: 1516 microversion: 2.1 time: 0.184198 Sep 08 11:37:15.408688 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3468/6802] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:37:15 2022] GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6 => generated 1516 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:37:16.432598 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-800339cb-34c4-47c4-a438-4fafbda20fc1 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:37:16.433474 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-800339cb-34c4-47c4-a438-4fafbda20fc1 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] [instance: 27fad958-f21e-4c3a-a74b-27736cc5aad6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:37:16.440548 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-800339cb-34c4-47c4-a438-4fafbda20fc1 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:16.441082 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-800339cb-34c4-47c4-a438-4fafbda20fc1 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:16.441541 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-800339cb-34c4-47c4-a438-4fafbda20fc1 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:16.442250 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-800339cb-34c4-47c4-a438-4fafbda20fc1 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:16.442729 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-800339cb-34c4-47c4-a438-4fafbda20fc1 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:16.443166 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-800339cb-34c4-47c4-a438-4fafbda20fc1 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:16.573247 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-800339cb-34c4-47c4-a438-4fafbda20fc1 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e084870bbd046019e14bce31711eed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef8ff07efb44f0da2a55967b7bb5843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:37:16.581002 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-800339cb-34c4-47c4-a438-4fafbda20fc1 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] 10.222.0.27 "GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6" status: 200 len: 1516 microversion: 2.1 time: 0.153152 Sep 08 11:37:16.581607 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3335/6803] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:37:16 2022] GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6 => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:37:17.604586 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d458330c-b4e0-4a20-85e3-6c48aad31a62 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:37:17.605298 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d458330c-b4e0-4a20-85e3-6c48aad31a62 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] [instance: 27fad958-f21e-4c3a-a74b-27736cc5aad6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:37:17.612789 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d458330c-b4e0-4a20-85e3-6c48aad31a62 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:17.613325 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d458330c-b4e0-4a20-85e3-6c48aad31a62 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:17.613769 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d458330c-b4e0-4a20-85e3-6c48aad31a62 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:17.614502 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d458330c-b4e0-4a20-85e3-6c48aad31a62 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:17.614988 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d458330c-b4e0-4a20-85e3-6c48aad31a62 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:17.615441 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d458330c-b4e0-4a20-85e3-6c48aad31a62 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:17.752982 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d458330c-b4e0-4a20-85e3-6c48aad31a62 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e084870bbd046019e14bce31711eed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef8ff07efb44f0da2a55967b7bb5843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:37:17.761688 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d458330c-b4e0-4a20-85e3-6c48aad31a62 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] 10.222.0.27 "GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6" status: 200 len: 1516 microversion: 2.1 time: 0.161883 Sep 08 11:37:17.762264 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3469/6804] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:37:17 2022] GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6 => generated 1516 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:37:18.785284 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-73f80bc0-9df0-4559-a65e-7d909ad38fd4 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:37:18.786054 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-73f80bc0-9df0-4559-a65e-7d909ad38fd4 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] [instance: 27fad958-f21e-4c3a-a74b-27736cc5aad6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:37:18.793627 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-73f80bc0-9df0-4559-a65e-7d909ad38fd4 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:18.794129 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-73f80bc0-9df0-4559-a65e-7d909ad38fd4 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:18.794575 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-73f80bc0-9df0-4559-a65e-7d909ad38fd4 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:18.795307 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-73f80bc0-9df0-4559-a65e-7d909ad38fd4 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:18.795769 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-73f80bc0-9df0-4559-a65e-7d909ad38fd4 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:18.796230 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-73f80bc0-9df0-4559-a65e-7d909ad38fd4 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:18.926752 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-73f80bc0-9df0-4559-a65e-7d909ad38fd4 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e084870bbd046019e14bce31711eed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef8ff07efb44f0da2a55967b7bb5843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:37:18.935337 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-73f80bc0-9df0-4559-a65e-7d909ad38fd4 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] 10.222.0.27 "GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6" status: 200 len: 1516 microversion: 2.1 time: 0.154023 Sep 08 11:37:18.935914 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3336/6805] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:37:18 2022] GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6 => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:37:19.958629 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cda1af9b-7c80-4bff-bfd0-bfad238d3951 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:37:19.959253 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cda1af9b-7c80-4bff-bfd0-bfad238d3951 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] [instance: 27fad958-f21e-4c3a-a74b-27736cc5aad6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:37:19.967052 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cda1af9b-7c80-4bff-bfd0-bfad238d3951 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:19.967565 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cda1af9b-7c80-4bff-bfd0-bfad238d3951 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:19.968014 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cda1af9b-7c80-4bff-bfd0-bfad238d3951 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:19.968719 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cda1af9b-7c80-4bff-bfd0-bfad238d3951 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:19.969231 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cda1af9b-7c80-4bff-bfd0-bfad238d3951 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:19.969661 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cda1af9b-7c80-4bff-bfd0-bfad238d3951 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:20.107024 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-cda1af9b-7c80-4bff-bfd0-bfad238d3951 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e084870bbd046019e14bce31711eed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef8ff07efb44f0da2a55967b7bb5843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:37:20.115075 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cda1af9b-7c80-4bff-bfd0-bfad238d3951 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] 10.222.0.27 "GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6" status: 200 len: 1516 microversion: 2.1 time: 0.160390 Sep 08 11:37:20.115651 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3470/6806] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:37:19 2022] GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6 => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:37:21.138316 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ceec899a-a625-4dc6-83f3-3a80f490306e tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:37:21.138994 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ceec899a-a625-4dc6-83f3-3a80f490306e tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] [instance: 27fad958-f21e-4c3a-a74b-27736cc5aad6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:37:21.145746 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ceec899a-a625-4dc6-83f3-3a80f490306e tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:21.146180 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ceec899a-a625-4dc6-83f3-3a80f490306e tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:21.146628 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ceec899a-a625-4dc6-83f3-3a80f490306e tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:21.147330 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ceec899a-a625-4dc6-83f3-3a80f490306e tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:21.147795 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ceec899a-a625-4dc6-83f3-3a80f490306e tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:21.148233 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ceec899a-a625-4dc6-83f3-3a80f490306e tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:21.282988 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ceec899a-a625-4dc6-83f3-3a80f490306e tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e084870bbd046019e14bce31711eed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef8ff07efb44f0da2a55967b7bb5843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:37:21.290804 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ceec899a-a625-4dc6-83f3-3a80f490306e tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] 10.222.0.27 "GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6" status: 200 len: 1516 microversion: 2.1 time: 0.156588 Sep 08 11:37:21.291390 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3337/6807] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:37:21 2022] GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6 => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:37:22.315206 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-90c9735b-14f7-48f1-96ee-3ad8e42e3c92 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:37:22.315828 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-90c9735b-14f7-48f1-96ee-3ad8e42e3c92 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] [instance: 27fad958-f21e-4c3a-a74b-27736cc5aad6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:37:22.323268 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90c9735b-14f7-48f1-96ee-3ad8e42e3c92 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:22.323769 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90c9735b-14f7-48f1-96ee-3ad8e42e3c92 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:22.324265 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90c9735b-14f7-48f1-96ee-3ad8e42e3c92 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:22.325396 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90c9735b-14f7-48f1-96ee-3ad8e42e3c92 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:22.325867 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90c9735b-14f7-48f1-96ee-3ad8e42e3c92 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:22.326308 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90c9735b-14f7-48f1-96ee-3ad8e42e3c92 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:22.463193 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-90c9735b-14f7-48f1-96ee-3ad8e42e3c92 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e084870bbd046019e14bce31711eed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef8ff07efb44f0da2a55967b7bb5843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:37:22.471653 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-90c9735b-14f7-48f1-96ee-3ad8e42e3c92 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] 10.222.0.27 "GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6" status: 200 len: 1516 microversion: 2.1 time: 0.160482 Sep 08 11:37:22.472241 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3471/6808] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:37:22 2022] GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6 => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:37:23.495962 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-09d8b991-55b6-40b1-88d7-d50f7425057d tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:37:23.496576 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-09d8b991-55b6-40b1-88d7-d50f7425057d tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] [instance: 27fad958-f21e-4c3a-a74b-27736cc5aad6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:37:23.503451 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-09d8b991-55b6-40b1-88d7-d50f7425057d tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:23.503950 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-09d8b991-55b6-40b1-88d7-d50f7425057d tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:23.504395 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-09d8b991-55b6-40b1-88d7-d50f7425057d tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:23.505121 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-09d8b991-55b6-40b1-88d7-d50f7425057d tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:23.505589 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-09d8b991-55b6-40b1-88d7-d50f7425057d tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:23.506026 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-09d8b991-55b6-40b1-88d7-d50f7425057d tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:23.635880 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-09d8b991-55b6-40b1-88d7-d50f7425057d tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e084870bbd046019e14bce31711eed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef8ff07efb44f0da2a55967b7bb5843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:37:23.643783 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-09d8b991-55b6-40b1-88d7-d50f7425057d tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] 10.222.0.27 "GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6" status: 200 len: 1516 microversion: 2.1 time: 0.151876 Sep 08 11:37:23.644359 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3338/6809] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:37:23 2022] GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6 => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:37:24.666793 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f1062409-e70c-43e3-b932-8de35853c2fd tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:37:24.667419 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f1062409-e70c-43e3-b932-8de35853c2fd tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] [instance: 27fad958-f21e-4c3a-a74b-27736cc5aad6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:37:24.675634 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f1062409-e70c-43e3-b932-8de35853c2fd tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:24.676151 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f1062409-e70c-43e3-b932-8de35853c2fd tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:24.676608 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f1062409-e70c-43e3-b932-8de35853c2fd tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:24.677323 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f1062409-e70c-43e3-b932-8de35853c2fd tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:24.677826 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f1062409-e70c-43e3-b932-8de35853c2fd tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:24.678229 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f1062409-e70c-43e3-b932-8de35853c2fd tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:24.814464 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f1062409-e70c-43e3-b932-8de35853c2fd tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e084870bbd046019e14bce31711eed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef8ff07efb44f0da2a55967b7bb5843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:37:24.822688 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f1062409-e70c-43e3-b932-8de35853c2fd tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] 10.222.0.27 "GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6" status: 200 len: 1516 microversion: 2.1 time: 0.159962 Sep 08 11:37:24.823281 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3472/6810] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:37:24 2022] GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6 => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:37:25.846083 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-333fef7f-9517-4780-9c34-7796948226a1 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:37:25.846705 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-333fef7f-9517-4780-9c34-7796948226a1 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] [instance: 27fad958-f21e-4c3a-a74b-27736cc5aad6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:37:25.853604 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-333fef7f-9517-4780-9c34-7796948226a1 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:25.854171 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-333fef7f-9517-4780-9c34-7796948226a1 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:25.854650 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-333fef7f-9517-4780-9c34-7796948226a1 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:25.856261 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-333fef7f-9517-4780-9c34-7796948226a1 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:25.856790 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-333fef7f-9517-4780-9c34-7796948226a1 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:25.857254 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-333fef7f-9517-4780-9c34-7796948226a1 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:26.001401 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-333fef7f-9517-4780-9c34-7796948226a1 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e084870bbd046019e14bce31711eed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef8ff07efb44f0da2a55967b7bb5843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:37:26.009955 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-333fef7f-9517-4780-9c34-7796948226a1 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] 10.222.0.27 "GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6" status: 200 len: 1516 microversion: 2.1 time: 0.167731 Sep 08 11:37:26.010544 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3339/6811] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:37:25 2022] GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6 => generated 1516 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:37:27.034311 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9d0d5152-a8a9-4f0c-8f48-4b985709fc30 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:37:27.034978 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9d0d5152-a8a9-4f0c-8f48-4b985709fc30 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] [instance: 27fad958-f21e-4c3a-a74b-27736cc5aad6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:37:27.042428 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9d0d5152-a8a9-4f0c-8f48-4b985709fc30 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:27.042975 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9d0d5152-a8a9-4f0c-8f48-4b985709fc30 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:27.043421 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9d0d5152-a8a9-4f0c-8f48-4b985709fc30 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:27.044129 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9d0d5152-a8a9-4f0c-8f48-4b985709fc30 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:27.044595 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9d0d5152-a8a9-4f0c-8f48-4b985709fc30 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:27.045054 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9d0d5152-a8a9-4f0c-8f48-4b985709fc30 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:27.196521 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9d0d5152-a8a9-4f0c-8f48-4b985709fc30 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e084870bbd046019e14bce31711eed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef8ff07efb44f0da2a55967b7bb5843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:37:27.205556 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9d0d5152-a8a9-4f0c-8f48-4b985709fc30 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] 10.222.0.27 "GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6" status: 200 len: 1516 microversion: 2.1 time: 0.175106 Sep 08 11:37:27.206146 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3473/6812] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:37:27 2022] GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6 => generated 1516 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:37:28.228726 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6a6ac6de-4e96-4681-bd6e-fe95dbbb078c tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:37:28.229386 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6a6ac6de-4e96-4681-bd6e-fe95dbbb078c tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] [instance: 27fad958-f21e-4c3a-a74b-27736cc5aad6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:37:28.237766 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a6ac6de-4e96-4681-bd6e-fe95dbbb078c tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:28.238299 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a6ac6de-4e96-4681-bd6e-fe95dbbb078c tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:28.238822 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a6ac6de-4e96-4681-bd6e-fe95dbbb078c tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:28.239576 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a6ac6de-4e96-4681-bd6e-fe95dbbb078c tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:28.240043 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a6ac6de-4e96-4681-bd6e-fe95dbbb078c tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:28.240481 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a6ac6de-4e96-4681-bd6e-fe95dbbb078c tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:28.381177 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6a6ac6de-4e96-4681-bd6e-fe95dbbb078c tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e084870bbd046019e14bce31711eed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef8ff07efb44f0da2a55967b7bb5843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:37:28.389686 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6a6ac6de-4e96-4681-bd6e-fe95dbbb078c tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] 10.222.0.27 "GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6" status: 200 len: 1516 microversion: 2.1 time: 0.165081 Sep 08 11:37:28.390260 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3340/6813] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:37:28 2022] GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6 => generated 1516 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:37:29.413699 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-57d87808-e360-4376-8806-ab8918b225f9 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:37:29.414328 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-57d87808-e360-4376-8806-ab8918b225f9 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] [instance: 27fad958-f21e-4c3a-a74b-27736cc5aad6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:37:29.423230 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-57d87808-e360-4376-8806-ab8918b225f9 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:29.423734 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-57d87808-e360-4376-8806-ab8918b225f9 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:29.424182 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-57d87808-e360-4376-8806-ab8918b225f9 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:29.424905 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-57d87808-e360-4376-8806-ab8918b225f9 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:29.425425 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-57d87808-e360-4376-8806-ab8918b225f9 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:29.425865 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-57d87808-e360-4376-8806-ab8918b225f9 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:29.568381 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-57d87808-e360-4376-8806-ab8918b225f9 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e084870bbd046019e14bce31711eed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef8ff07efb44f0da2a55967b7bb5843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:37:29.576587 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-57d87808-e360-4376-8806-ab8918b225f9 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] 10.222.0.27 "GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6" status: 200 len: 1516 microversion: 2.1 time: 0.167000 Sep 08 11:37:29.577208 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3474/6814] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:37:29 2022] GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6 => generated 1516 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:37:30.600614 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-84682a48-1192-4e65-ac51-cfd15515be53 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:37:30.601299 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-84682a48-1192-4e65-ac51-cfd15515be53 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] [instance: 27fad958-f21e-4c3a-a74b-27736cc5aad6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:37:30.609726 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-84682a48-1192-4e65-ac51-cfd15515be53 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:30.610237 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-84682a48-1192-4e65-ac51-cfd15515be53 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:30.610693 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-84682a48-1192-4e65-ac51-cfd15515be53 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:30.611407 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-84682a48-1192-4e65-ac51-cfd15515be53 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:30.611881 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-84682a48-1192-4e65-ac51-cfd15515be53 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:30.612325 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-84682a48-1192-4e65-ac51-cfd15515be53 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:30.750662 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-84682a48-1192-4e65-ac51-cfd15515be53 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e084870bbd046019e14bce31711eed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef8ff07efb44f0da2a55967b7bb5843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:37:30.758695 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-84682a48-1192-4e65-ac51-cfd15515be53 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] 10.222.0.27 "GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6" status: 200 len: 1516 microversion: 2.1 time: 0.162210 Sep 08 11:37:30.759279 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3341/6815] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:37:30 2022] GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6 => generated 1516 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:37:31.781727 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f1b20d6c-1b57-4ea8-bbcb-ed810240eb3a tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:37:31.782334 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f1b20d6c-1b57-4ea8-bbcb-ed810240eb3a tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] [instance: 27fad958-f21e-4c3a-a74b-27736cc5aad6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:37:31.789233 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f1b20d6c-1b57-4ea8-bbcb-ed810240eb3a tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:31.789724 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f1b20d6c-1b57-4ea8-bbcb-ed810240eb3a tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:31.790167 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f1b20d6c-1b57-4ea8-bbcb-ed810240eb3a tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:31.790859 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f1b20d6c-1b57-4ea8-bbcb-ed810240eb3a tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:31.791316 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f1b20d6c-1b57-4ea8-bbcb-ed810240eb3a tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:31.791807 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f1b20d6c-1b57-4ea8-bbcb-ed810240eb3a tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:31.930506 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f1b20d6c-1b57-4ea8-bbcb-ed810240eb3a tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e084870bbd046019e14bce31711eed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef8ff07efb44f0da2a55967b7bb5843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:37:31.939407 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f1b20d6c-1b57-4ea8-bbcb-ed810240eb3a tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] 10.222.0.27 "GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6" status: 200 len: 1516 microversion: 2.1 time: 0.161571 Sep 08 11:37:31.940095 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3475/6816] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:37:31 2022] GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6 => generated 1516 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:37:32.963138 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c0486273-7b61-4983-9d0c-8d24b7a3eb9e tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:37:32.963756 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c0486273-7b61-4983-9d0c-8d24b7a3eb9e tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] [instance: 27fad958-f21e-4c3a-a74b-27736cc5aad6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:37:32.971923 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c0486273-7b61-4983-9d0c-8d24b7a3eb9e tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:32.972427 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c0486273-7b61-4983-9d0c-8d24b7a3eb9e tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:32.972874 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c0486273-7b61-4983-9d0c-8d24b7a3eb9e tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:32.973609 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c0486273-7b61-4983-9d0c-8d24b7a3eb9e tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:32.974076 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c0486273-7b61-4983-9d0c-8d24b7a3eb9e tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:32.974509 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c0486273-7b61-4983-9d0c-8d24b7a3eb9e tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:33.106015 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c0486273-7b61-4983-9d0c-8d24b7a3eb9e tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e084870bbd046019e14bce31711eed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef8ff07efb44f0da2a55967b7bb5843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:37:33.114145 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c0486273-7b61-4983-9d0c-8d24b7a3eb9e tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] 10.222.0.27 "GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6" status: 200 len: 1516 microversion: 2.1 time: 0.154946 Sep 08 11:37:33.114762 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3342/6817] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:37:32 2022] GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:37:34.138359 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cc9e1362-7796-4eb2-bd96-b5f5fdc6fd89 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:37:34.139233 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cc9e1362-7796-4eb2-bd96-b5f5fdc6fd89 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] [instance: 27fad958-f21e-4c3a-a74b-27736cc5aad6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:37:34.146267 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc9e1362-7796-4eb2-bd96-b5f5fdc6fd89 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:34.146724 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc9e1362-7796-4eb2-bd96-b5f5fdc6fd89 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:34.147161 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc9e1362-7796-4eb2-bd96-b5f5fdc6fd89 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:34.147851 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc9e1362-7796-4eb2-bd96-b5f5fdc6fd89 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:34.148307 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc9e1362-7796-4eb2-bd96-b5f5fdc6fd89 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:34.148732 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc9e1362-7796-4eb2-bd96-b5f5fdc6fd89 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:34.151307 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=82 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:37:34.288927 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-cc9e1362-7796-4eb2-bd96-b5f5fdc6fd89 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e084870bbd046019e14bce31711eed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef8ff07efb44f0da2a55967b7bb5843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:37:34.296831 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cc9e1362-7796-4eb2-bd96-b5f5fdc6fd89 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] 10.222.0.27 "GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6" status: 200 len: 1516 microversion: 2.1 time: 0.162717 Sep 08 11:37:34.297442 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3476/6818] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:37:34 2022] GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6 => generated 1516 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:37:35.319817 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0347c516-c052-4395-8b1f-c0ed4239c88e tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:37:35.320445 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0347c516-c052-4395-8b1f-c0ed4239c88e tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] [instance: 27fad958-f21e-4c3a-a74b-27736cc5aad6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:37:35.327862 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0347c516-c052-4395-8b1f-c0ed4239c88e tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:35.328359 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0347c516-c052-4395-8b1f-c0ed4239c88e tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:35.328815 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0347c516-c052-4395-8b1f-c0ed4239c88e tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:35.329578 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0347c516-c052-4395-8b1f-c0ed4239c88e tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:35.330051 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0347c516-c052-4395-8b1f-c0ed4239c88e tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:35.330498 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0347c516-c052-4395-8b1f-c0ed4239c88e tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:35.333145 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:37:35.465808 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0347c516-c052-4395-8b1f-c0ed4239c88e tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e084870bbd046019e14bce31711eed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef8ff07efb44f0da2a55967b7bb5843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:37:35.474427 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0347c516-c052-4395-8b1f-c0ed4239c88e tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] 10.222.0.27 "GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6" status: 200 len: 1516 microversion: 2.1 time: 0.158510 Sep 08 11:37:35.475007 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3343/6819] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:37:35 2022] GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6 => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:37:36.499030 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-78b09a36-41fc-42e2-b77e-ac36a31fc569 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:37:36.499954 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-78b09a36-41fc-42e2-b77e-ac36a31fc569 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] [instance: 27fad958-f21e-4c3a-a74b-27736cc5aad6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:37:36.502732 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=32 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:37:36.508020 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-78b09a36-41fc-42e2-b77e-ac36a31fc569 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:36.508525 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-78b09a36-41fc-42e2-b77e-ac36a31fc569 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:36.508975 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-78b09a36-41fc-42e2-b77e-ac36a31fc569 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:36.509714 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-78b09a36-41fc-42e2-b77e-ac36a31fc569 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:36.510185 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-78b09a36-41fc-42e2-b77e-ac36a31fc569 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:36.510628 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-78b09a36-41fc-42e2-b77e-ac36a31fc569 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:36.643756 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-78b09a36-41fc-42e2-b77e-ac36a31fc569 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e084870bbd046019e14bce31711eed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef8ff07efb44f0da2a55967b7bb5843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:37:36.651703 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-78b09a36-41fc-42e2-b77e-ac36a31fc569 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] 10.222.0.27 "GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6" status: 200 len: 1516 microversion: 2.1 time: 0.157112 Sep 08 11:37:36.652278 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3477/6820] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:37:36 2022] GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6 => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:37:37.674205 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d9d1c695-5d2e-4c32-83ae-7eb7c3a08019 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:37:37.674833 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d9d1c695-5d2e-4c32-83ae-7eb7c3a08019 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] [instance: 27fad958-f21e-4c3a-a74b-27736cc5aad6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:37:37.677542 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=34 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:37:37.682939 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d9d1c695-5d2e-4c32-83ae-7eb7c3a08019 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:37.683438 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d9d1c695-5d2e-4c32-83ae-7eb7c3a08019 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:37.683884 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d9d1c695-5d2e-4c32-83ae-7eb7c3a08019 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:37.684589 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d9d1c695-5d2e-4c32-83ae-7eb7c3a08019 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:37.685153 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d9d1c695-5d2e-4c32-83ae-7eb7c3a08019 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:37.685669 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d9d1c695-5d2e-4c32-83ae-7eb7c3a08019 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:37.822544 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d9d1c695-5d2e-4c32-83ae-7eb7c3a08019 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e084870bbd046019e14bce31711eed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef8ff07efb44f0da2a55967b7bb5843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:37:37.832356 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d9d1c695-5d2e-4c32-83ae-7eb7c3a08019 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] 10.222.0.27 "GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6" status: 200 len: 1516 microversion: 2.1 time: 0.161969 Sep 08 11:37:37.832947 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3344/6821] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:37:37 2022] GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6 => generated 1516 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:37:38.856424 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-89aac647-7788-49a6-b725-644c3cfd402b tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:37:38.857687 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-89aac647-7788-49a6-b725-644c3cfd402b tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] [instance: 27fad958-f21e-4c3a-a74b-27736cc5aad6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:37:38.865396 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-89aac647-7788-49a6-b725-644c3cfd402b tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:38.865894 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-89aac647-7788-49a6-b725-644c3cfd402b tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:38.866330 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-89aac647-7788-49a6-b725-644c3cfd402b tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:38.867043 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-89aac647-7788-49a6-b725-644c3cfd402b tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:38.867503 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-89aac647-7788-49a6-b725-644c3cfd402b tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:38.867933 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-89aac647-7788-49a6-b725-644c3cfd402b tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:39.012888 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-89aac647-7788-49a6-b725-644c3cfd402b tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e084870bbd046019e14bce31711eed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef8ff07efb44f0da2a55967b7bb5843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:37:39.021054 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-89aac647-7788-49a6-b725-644c3cfd402b tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] 10.222.0.27 "GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6" status: 200 len: 1516 microversion: 2.1 time: 0.168675 Sep 08 11:37:39.021641 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3478/6822] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:37:38 2022] GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6 => generated 1516 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:37:40.043877 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-566ad5a8-cd6b-4698-b732-a6573eeb101e tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:37:40.044683 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-566ad5a8-cd6b-4698-b732-a6573eeb101e tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] [instance: 27fad958-f21e-4c3a-a74b-27736cc5aad6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:37:40.051693 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-566ad5a8-cd6b-4698-b732-a6573eeb101e tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:40.052194 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-566ad5a8-cd6b-4698-b732-a6573eeb101e tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:40.052821 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-566ad5a8-cd6b-4698-b732-a6573eeb101e tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:40.053563 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-566ad5a8-cd6b-4698-b732-a6573eeb101e tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:40.054030 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-566ad5a8-cd6b-4698-b732-a6573eeb101e tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:40.054467 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-566ad5a8-cd6b-4698-b732-a6573eeb101e tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:40.298649 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-566ad5a8-cd6b-4698-b732-a6573eeb101e tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e084870bbd046019e14bce31711eed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef8ff07efb44f0da2a55967b7bb5843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:37:40.306658 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-566ad5a8-cd6b-4698-b732-a6573eeb101e tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] 10.222.0.27 "GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6" status: 200 len: 1515 microversion: 2.1 time: 0.266758 Sep 08 11:37:40.307226 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3345/6823] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:37:40 2022] GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6 => generated 1515 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:37:40.448627 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-e04b1b28-0319-4029-9a19-727b4bc41d19 req-d59ae020-7918-456f-8c2f-89b4a738e1cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27fad958-f21e-4c3a-a74b-27736cc5aad6", "name": "network-vif-unplugged", "status": "completed", "tag": "10e8cfbc-dcf3-494d-b2a0-d94e0bebd442"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:37:40.459986 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-e04b1b28-0319-4029-9a19-727b4bc41d19 req-d59ae020-7918-456f-8c2f-89b4a738e1cf service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:40.460606 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-e04b1b28-0319-4029-9a19-727b4bc41d19 req-d59ae020-7918-456f-8c2f-89b4a738e1cf service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:40.461147 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-e04b1b28-0319-4029-9a19-727b4bc41d19 req-d59ae020-7918-456f-8c2f-89b4a738e1cf service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:40.474612 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-e04b1b28-0319-4029-9a19-727b4bc41d19 req-d59ae020-7918-456f-8c2f-89b4a738e1cf service nova] Creating event network-vif-unplugged:10e8cfbc-dcf3-494d-b2a0-d94e0bebd442 for instance 27fad958-f21e-4c3a-a74b-27736cc5aad6 on n-h2-850501-12 Sep 08 11:37:40.480248 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [req-e04b1b28-0319-4029-9a19-727b4bc41d19 req-d59ae020-7918-456f-8c2f-89b4a738e1cf service nova] Instance 27fad958-f21e-4c3a-a74b-27736cc5aad6 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850501-12', 'n-h1-850501-12'} {{(pid=128861) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 11:37:40.492098 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-e04b1b28-0319-4029-9a19-727b4bc41d19 req-d59ae020-7918-456f-8c2f-89b4a738e1cf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047788 Sep 08 11:37:40.493118 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3479/6824] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:37:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:37:41.331999 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4b52490d-bceb-4c25-8d15-698aa4cd4ce6 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:37:41.332531 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4b52490d-bceb-4c25-8d15-698aa4cd4ce6 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] [instance: 27fad958-f21e-4c3a-a74b-27736cc5aad6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:37:41.339929 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4b52490d-bceb-4c25-8d15-698aa4cd4ce6 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:41.340441 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4b52490d-bceb-4c25-8d15-698aa4cd4ce6 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:41.340898 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4b52490d-bceb-4c25-8d15-698aa4cd4ce6 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:41.342500 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4b52490d-bceb-4c25-8d15-698aa4cd4ce6 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:41.342987 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4b52490d-bceb-4c25-8d15-698aa4cd4ce6 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:41.343435 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4b52490d-bceb-4c25-8d15-698aa4cd4ce6 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:41.483137 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4b52490d-bceb-4c25-8d15-698aa4cd4ce6 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e084870bbd046019e14bce31711eed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef8ff07efb44f0da2a55967b7bb5843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:37:41.491141 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4b52490d-bceb-4c25-8d15-698aa4cd4ce6 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] 10.222.0.27 "GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6" status: 200 len: 1515 microversion: 2.1 time: 0.163377 Sep 08 11:37:41.491716 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3346/6825] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:37:41 2022] GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6 => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:37:42.509016 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-777461ee-f4fd-43ad-8d43-3f09f3aaa6bf req-a8e64982-b0d4-42bc-9e45-fdf0437d6f95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27fad958-f21e-4c3a-a74b-27736cc5aad6", "tag": "10e8cfbc-dcf3-494d-b2a0-d94e0bebd442"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:37:42.515075 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-928cfdf3-f04b-46f3-810a-58ef6e0881d5 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:37:42.515790 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-928cfdf3-f04b-46f3-810a-58ef6e0881d5 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] [instance: 27fad958-f21e-4c3a-a74b-27736cc5aad6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:37:42.520144 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-777461ee-f4fd-43ad-8d43-3f09f3aaa6bf req-a8e64982-b0d4-42bc-9e45-fdf0437d6f95 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:42.520627 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-777461ee-f4fd-43ad-8d43-3f09f3aaa6bf req-a8e64982-b0d4-42bc-9e45-fdf0437d6f95 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:42.521084 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-777461ee-f4fd-43ad-8d43-3f09f3aaa6bf req-a8e64982-b0d4-42bc-9e45-fdf0437d6f95 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:42.522605 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-928cfdf3-f04b-46f3-810a-58ef6e0881d5 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:42.523109 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-928cfdf3-f04b-46f3-810a-58ef6e0881d5 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:42.523564 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-928cfdf3-f04b-46f3-810a-58ef6e0881d5 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:42.524284 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-928cfdf3-f04b-46f3-810a-58ef6e0881d5 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:42.524760 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-928cfdf3-f04b-46f3-810a-58ef6e0881d5 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:42.525242 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-928cfdf3-f04b-46f3-810a-58ef6e0881d5 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:42.533718 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-777461ee-f4fd-43ad-8d43-3f09f3aaa6bf req-a8e64982-b0d4-42bc-9e45-fdf0437d6f95 service nova] Creating event network-changed:10e8cfbc-dcf3-494d-b2a0-d94e0bebd442 for instance 27fad958-f21e-4c3a-a74b-27736cc5aad6 on n-h2-850501-12 Sep 08 11:37:42.539666 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [req-777461ee-f4fd-43ad-8d43-3f09f3aaa6bf req-a8e64982-b0d4-42bc-9e45-fdf0437d6f95 service nova] Instance 27fad958-f21e-4c3a-a74b-27736cc5aad6 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850501-12', 'n-h1-850501-12'} {{(pid=128861) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 11:37:42.551708 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-777461ee-f4fd-43ad-8d43-3f09f3aaa6bf req-a8e64982-b0d4-42bc-9e45-fdf0437d6f95 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047137 Sep 08 11:37:42.552572 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3480/6826] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:37:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:37:42.676480 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-928cfdf3-f04b-46f3-810a-58ef6e0881d5 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e084870bbd046019e14bce31711eed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef8ff07efb44f0da2a55967b7bb5843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:37:42.684385 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-928cfdf3-f04b-46f3-810a-58ef6e0881d5 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] 10.222.0.27 "GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6" status: 200 len: 1513 microversion: 2.1 time: 0.173661 Sep 08 11:37:42.684967 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3347/6827] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:37:42 2022] GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6 => generated 1513 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:37:43.708874 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2675a130-4a64-43cc-9619-81c0ca099b32 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:37:43.709617 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2675a130-4a64-43cc-9619-81c0ca099b32 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] [instance: 27fad958-f21e-4c3a-a74b-27736cc5aad6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:37:43.717377 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2675a130-4a64-43cc-9619-81c0ca099b32 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:43.717841 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2675a130-4a64-43cc-9619-81c0ca099b32 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:43.718284 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2675a130-4a64-43cc-9619-81c0ca099b32 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:43.718999 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2675a130-4a64-43cc-9619-81c0ca099b32 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:43.719454 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2675a130-4a64-43cc-9619-81c0ca099b32 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:43.719884 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2675a130-4a64-43cc-9619-81c0ca099b32 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:43.860196 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2675a130-4a64-43cc-9619-81c0ca099b32 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e084870bbd046019e14bce31711eed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef8ff07efb44f0da2a55967b7bb5843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:37:43.868369 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2675a130-4a64-43cc-9619-81c0ca099b32 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] 10.222.0.27 "GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6" status: 200 len: 1510 microversion: 2.1 time: 0.163940 Sep 08 11:37:43.868973 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3481/6828] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:37:43 2022] GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6 => generated 1510 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:37:43.891379 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-680af5f1-c59c-4387-a9b4-5155a623cca1 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:37:43.891927 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-680af5f1-c59c-4387-a9b4-5155a623cca1 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] [instance: 27fad958-f21e-4c3a-a74b-27736cc5aad6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:37:43.899031 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-680af5f1-c59c-4387-a9b4-5155a623cca1 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:43.899543 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-680af5f1-c59c-4387-a9b4-5155a623cca1 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:43.899999 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-680af5f1-c59c-4387-a9b4-5155a623cca1 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:43.900727 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-680af5f1-c59c-4387-a9b4-5155a623cca1 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:43.901232 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-680af5f1-c59c-4387-a9b4-5155a623cca1 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:43.901679 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-680af5f1-c59c-4387-a9b4-5155a623cca1 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:43.931119 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-680af5f1-c59c-4387-a9b4-5155a623cca1 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] [instance: 27fad958-f21e-4c3a-a74b-27736cc5aad6] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:37:43.983351 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.compute.api [None req-680af5f1-c59c-4387-a9b4-5155a623cca1 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] [instance: 27fad958-f21e-4c3a-a74b-27736cc5aad6] Found an unconfirmed migration during delete, id: 16, status: finished Sep 08 11:37:45.705614 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-680af5f1-c59c-4387-a9b4-5155a623cca1 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] 10.222.0.27 "DELETE /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6" status: 204 len: 0 microversion: 2.1 time: 1.817629 Sep 08 11:37:45.707132 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3348/6829] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:37:43 2022] DELETE /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6 => generated 0 bytes in 1820 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:37:45.715701 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4206bc9b-a492-445f-98af-1ab22625aba5 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:37:45.717179 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4206bc9b-a492-445f-98af-1ab22625aba5 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] [instance: 27fad958-f21e-4c3a-a74b-27736cc5aad6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:37:45.724531 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4206bc9b-a492-445f-98af-1ab22625aba5 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:45.725138 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4206bc9b-a492-445f-98af-1ab22625aba5 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:45.725646 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4206bc9b-a492-445f-98af-1ab22625aba5 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:45.726445 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4206bc9b-a492-445f-98af-1ab22625aba5 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:45.726907 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4206bc9b-a492-445f-98af-1ab22625aba5 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:45.727335 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4206bc9b-a492-445f-98af-1ab22625aba5 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:45.869383 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4206bc9b-a492-445f-98af-1ab22625aba5 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e084870bbd046019e14bce31711eed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef8ff07efb44f0da2a55967b7bb5843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:37:45.878353 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4206bc9b-a492-445f-98af-1ab22625aba5 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] 10.222.0.27 "GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6" status: 200 len: 1502 microversion: 2.1 time: 0.166703 Sep 08 11:37:45.878948 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3482/6830] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:37:45 2022] GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6 => generated 1502 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:37:46.901690 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-071c02ab-36c2-4408-ad11-dfbb6db6478d tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:37:46.902429 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-071c02ab-36c2-4408-ad11-dfbb6db6478d tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] [instance: 27fad958-f21e-4c3a-a74b-27736cc5aad6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:37:46.915999 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-071c02ab-36c2-4408-ad11-dfbb6db6478d tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:46.916529 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-071c02ab-36c2-4408-ad11-dfbb6db6478d tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:46.916994 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-071c02ab-36c2-4408-ad11-dfbb6db6478d tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:46.917759 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-071c02ab-36c2-4408-ad11-dfbb6db6478d tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:46.918234 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-071c02ab-36c2-4408-ad11-dfbb6db6478d tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:46.918677 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-071c02ab-36c2-4408-ad11-dfbb6db6478d tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:47.070440 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-071c02ab-36c2-4408-ad11-dfbb6db6478d tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e084870bbd046019e14bce31711eed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef8ff07efb44f0da2a55967b7bb5843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:37:47.079153 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-071c02ab-36c2-4408-ad11-dfbb6db6478d tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] 10.222.0.27 "GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6" status: 200 len: 1502 microversion: 2.1 time: 0.181644 Sep 08 11:37:47.079734 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3349/6831] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:37:46 2022] GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6 => generated 1502 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:37:47.656147 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-2f51e79a-1f67-4bda-96c1-04821ffdeb17 req-c935ba24-b504-411b-843a-537fd9bbb576 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27fad958-f21e-4c3a-a74b-27736cc5aad6", "name": "network-vif-deleted", "tag": "10e8cfbc-dcf3-494d-b2a0-d94e0bebd442"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:37:47.675311 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-2f51e79a-1f67-4bda-96c1-04821ffdeb17 req-c935ba24-b504-411b-843a-537fd9bbb576 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:47.675812 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-2f51e79a-1f67-4bda-96c1-04821ffdeb17 req-c935ba24-b504-411b-843a-537fd9bbb576 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:47.676247 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-2f51e79a-1f67-4bda-96c1-04821ffdeb17 req-c935ba24-b504-411b-843a-537fd9bbb576 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:47.691925 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-2f51e79a-1f67-4bda-96c1-04821ffdeb17 req-c935ba24-b504-411b-843a-537fd9bbb576 service nova] Creating event network-vif-deleted:10e8cfbc-dcf3-494d-b2a0-d94e0bebd442 for instance 27fad958-f21e-4c3a-a74b-27736cc5aad6 on n-h2-850501-12 Sep 08 11:37:47.702061 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-2f51e79a-1f67-4bda-96c1-04821ffdeb17 req-c935ba24-b504-411b-843a-537fd9bbb576 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049404 Sep 08 11:37:47.702863 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3483/6832] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:37:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:37:48.105205 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0526a31d-1aa6-495a-8df9-4546c70e44d1 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:37:48.105778 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0526a31d-1aa6-495a-8df9-4546c70e44d1 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] [instance: 27fad958-f21e-4c3a-a74b-27736cc5aad6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:37:48.113526 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0526a31d-1aa6-495a-8df9-4546c70e44d1 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:48.114029 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0526a31d-1aa6-495a-8df9-4546c70e44d1 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:48.114476 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0526a31d-1aa6-495a-8df9-4546c70e44d1 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:48.115185 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0526a31d-1aa6-495a-8df9-4546c70e44d1 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:48.115652 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0526a31d-1aa6-495a-8df9-4546c70e44d1 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:48.116089 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0526a31d-1aa6-495a-8df9-4546c70e44d1 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:48.152208 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0526a31d-1aa6-495a-8df9-4546c70e44d1 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:48.152737 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0526a31d-1aa6-495a-8df9-4546c70e44d1 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:48.153223 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0526a31d-1aa6-495a-8df9-4546c70e44d1 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:48.153755 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-0526a31d-1aa6-495a-8df9-4546c70e44d1 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lazy-loading 'fault' on Instance uuid 27fad958-f21e-4c3a-a74b-27736cc5aad6 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:37:48.199658 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0526a31d-1aa6-495a-8df9-4546c70e44d1 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e084870bbd046019e14bce31711eed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef8ff07efb44f0da2a55967b7bb5843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:37:48.207720 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0526a31d-1aa6-495a-8df9-4546c70e44d1 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] 10.222.0.27 "GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6" status: 200 len: 1305 microversion: 2.1 time: 0.106457 Sep 08 11:37:48.208335 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3350/6833] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:37:48 2022] GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6 => generated 1305 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:37:49.232100 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-34d20aa9-c4e5-4e0a-81db-b0ae8d00798d tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:37:49.233825 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-34d20aa9-c4e5-4e0a-81db-b0ae8d00798d tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] [instance: 27fad958-f21e-4c3a-a74b-27736cc5aad6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:37:49.241270 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-34d20aa9-c4e5-4e0a-81db-b0ae8d00798d tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:49.241771 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-34d20aa9-c4e5-4e0a-81db-b0ae8d00798d tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:49.242219 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-34d20aa9-c4e5-4e0a-81db-b0ae8d00798d tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:49.242922 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-34d20aa9-c4e5-4e0a-81db-b0ae8d00798d tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:49.243388 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-34d20aa9-c4e5-4e0a-81db-b0ae8d00798d tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:49.243824 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-34d20aa9-c4e5-4e0a-81db-b0ae8d00798d tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:49.257368 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-34d20aa9-c4e5-4e0a-81db-b0ae8d00798d tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] HTTP exception thrown: Instance 27fad958-f21e-4c3a-a74b-27736cc5aad6 could not be found. Sep 08 11:37:49.259060 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-34d20aa9-c4e5-4e0a-81db-b0ae8d00798d tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Request method failure captured: Sep 08 11:37:49.259060 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6 HTTP/1.1 Sep 08 11:37:49.259060 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:37:49.259060 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:37:49.259060 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:37:49.259060 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 11:37:49.259060 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:37:49.259060 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:37:49.259060 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:37:49.259060 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:37:49.259060 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGdPargSfNMZ56DZvslTBMas880EIUE_3656lY_xmgS7Wuih8I4aiv8HnI4uHG2GFW-WCt7vzmUDhleNh4i13_MhT-WUH2KXJHJH8u44gVU6rNZkkgGB-x-Dg4he4-7L3Bg72yIeKNAr83aFUYyIeqecHMRaoKaOqHNqqUcg5IsvNKSA Sep 08 11:37:49.259060 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:37:49.259060 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:37:49.259060 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:37:49.259060 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:37:49.259060 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:37:49.259060 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:37:49.259060 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 1ef8ff07efb44f0da2a55967b7bb5843 Sep 08 11:37:49.259060 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-DeleteServersTestJSON-348261830 Sep 08 11:37:49.259060 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:37:49.259060 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:37:49.259060 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1ef8ff07efb44f0da2a55967b7bb5843"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1ef8ff07efb44f0da2a55967b7bb5843"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1ef8ff07efb44f0da2a55967b7bb5843"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1ef8ff07efb44f0da2a55967b7bb5843"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:37:49.259060 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-DeleteServersTestJSON-348261830 Sep 08 11:37:49.259060 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 1ef8ff07efb44f0da2a55967b7bb5843 Sep 08 11:37:49.259060 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-DeleteServersTestJSON-348261830 Sep 08 11:37:49.259060 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-DeleteServersTestJSON-348261830-project Sep 08 11:37:49.259060 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:37:49.259060 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:37:49.259060 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 4e084870bbd046019e14bce31711eed0 Sep 08 11:37:49.259060 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-DeleteServersTestJSON-348261830-project Sep 08 11:37:49.259060 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 11:37:49.259060 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 27fad958-f21e-4c3a-a74b-27736cc5aad6 could not be found. Sep 08 11:37:49.259060 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '27fad958-f21e-4c3a-a74b-27736cc5aad6'} Sep 08 11:37:49.259060 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:37:49.259060 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:37:49.259060 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:37:49.259060 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:37:49.259060 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:37:49.259060 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:37:49.259060 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:37:49.259060 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:37:49.259060 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:37:49.259060 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:37:49.259060 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27fad958-f21e-4c3a-a74b-27736cc5aad6 could not be found. Sep 08 11:37:49.259060 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:37:49.259060 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:37:49.259060 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:37:49.259060 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:37:49.259060 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:37:49.259060 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:37:49.259060 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:37:49.259060 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:37:49.259060 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:37:49.259060 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:37:49.259060 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:37:49.259060 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:37:49.259060 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:37:49.259060 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:37:49.259060 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:37:49.259060 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:37:49.259060 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27fad958-f21e-4c3a-a74b-27736cc5aad6 could not be found. Sep 08 11:37:49.259060 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:37:49.259060 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:37:49.259060 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:37:49.263768 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:37:49.263768 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:37:49.263768 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:37:49.263768 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:37:49.263768 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:37:49.263768 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27fad958-f21e-4c3a-a74b-27736cc5aad6 could not be found. Sep 08 11:37:49.263768 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:37:49.263768 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-34d20aa9-c4e5-4e0a-81db-b0ae8d00798d tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Returning 404 to user: Instance 27fad958-f21e-4c3a-a74b-27736cc5aad6 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:37:49.263768 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-34d20aa9-c4e5-4e0a-81db-b0ae8d00798d tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] 10.222.0.27 "GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6" status: 404 len: 111 microversion: 2.1 time: 0.032715 Sep 08 11:37:49.263768 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3484/6834] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:37:49 2022] GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:37:49.275811 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3575d63e-1701-4010-ba62-4412197ada85 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:37:49.276310 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3575d63e-1701-4010-ba62-4412197ada85 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] [instance: 27fad958-f21e-4c3a-a74b-27736cc5aad6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:37:49.283757 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3575d63e-1701-4010-ba62-4412197ada85 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:49.284260 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3575d63e-1701-4010-ba62-4412197ada85 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:49.284715 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3575d63e-1701-4010-ba62-4412197ada85 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:49.285482 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3575d63e-1701-4010-ba62-4412197ada85 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:49.285954 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3575d63e-1701-4010-ba62-4412197ada85 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:49.286393 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3575d63e-1701-4010-ba62-4412197ada85 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:49.300391 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-3575d63e-1701-4010-ba62-4412197ada85 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] HTTP exception thrown: Instance 27fad958-f21e-4c3a-a74b-27736cc5aad6 could not be found. Sep 08 11:37:49.302082 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3575d63e-1701-4010-ba62-4412197ada85 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Request method failure captured: Sep 08 11:37:49.302082 n-d-850501-12 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6 HTTP/1.1 Sep 08 11:37:49.302082 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 11:37:49.302082 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 11:37:49.302082 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 11:37:49.302082 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 11:37:49.302082 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 11:37:49.302082 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 11:37:49.302082 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 11:37:49.302082 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 11:37:49.302082 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGdPargSfNMZ56DZvslTBMas880EIUE_3656lY_xmgS7Wuih8I4aiv8HnI4uHG2GFW-WCt7vzmUDhleNh4i13_MhT-WUH2KXJHJH8u44gVU6rNZkkgGB-x-Dg4he4-7L3Bg72yIeKNAr83aFUYyIeqecHMRaoKaOqHNqqUcg5IsvNKSA Sep 08 11:37:49.302082 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 11:37:49.302082 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 11:37:49.302082 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 11:37:49.302082 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 11:37:49.302082 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 11:37:49.302082 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 11:37:49.302082 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 1ef8ff07efb44f0da2a55967b7bb5843 Sep 08 11:37:49.302082 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-DeleteServersTestJSON-348261830 Sep 08 11:37:49.302082 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 11:37:49.302082 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 11:37:49.302082 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1ef8ff07efb44f0da2a55967b7bb5843"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1ef8ff07efb44f0da2a55967b7bb5843"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1ef8ff07efb44f0da2a55967b7bb5843"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1ef8ff07efb44f0da2a55967b7bb5843"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:37:49.302082 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-DeleteServersTestJSON-348261830 Sep 08 11:37:49.302082 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 1ef8ff07efb44f0da2a55967b7bb5843 Sep 08 11:37:49.302082 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-DeleteServersTestJSON-348261830 Sep 08 11:37:49.302082 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-DeleteServersTestJSON-348261830-project Sep 08 11:37:49.302082 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 11:37:49.302082 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 11:37:49.302082 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 4e084870bbd046019e14bce31711eed0 Sep 08 11:37:49.302082 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-DeleteServersTestJSON-348261830-project Sep 08 11:37:49.302082 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 11:37:49.302082 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 27fad958-f21e-4c3a-a74b-27736cc5aad6 could not be found. Sep 08 11:37:49.302082 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '27fad958-f21e-4c3a-a74b-27736cc5aad6'} Sep 08 11:37:49.302082 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:37:49.302082 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:37:49.302082 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:37:49.302082 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:37:49.302082 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:37:49.302082 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:37:49.302082 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:37:49.302082 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:37:49.302082 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:37:49.302082 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:37:49.302082 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27fad958-f21e-4c3a-a74b-27736cc5aad6 could not be found. Sep 08 11:37:49.302082 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:37:49.302082 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:37:49.302082 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:37:49.302082 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:37:49.302082 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:37:49.302082 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:37:49.302082 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:37:49.302082 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:37:49.302082 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:37:49.302082 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:37:49.302082 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 11:37:49.302082 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 11:37:49.302082 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 11:37:49.302082 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 11:37:49.302082 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:37:49.302082 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:37:49.302082 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:37:49.302082 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:37:49.306372 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27fad958-f21e-4c3a-a74b-27736cc5aad6 could not be found. Sep 08 11:37:49.306372 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:37:49.306372 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:37:49.306372 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:37:49.306372 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:37:49.306372 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:37:49.306372 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:37:49.306372 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:37:49.306372 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:37:49.306372 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27fad958-f21e-4c3a-a74b-27736cc5aad6 could not be found. Sep 08 11:37:49.306372 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:37:49.306372 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3575d63e-1701-4010-ba62-4412197ada85 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Returning 404 to user: Instance 27fad958-f21e-4c3a-a74b-27736cc5aad6 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:37:49.306372 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3575d63e-1701-4010-ba62-4412197ada85 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] 10.222.0.27 "DELETE /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6" status: 404 len: 111 microversion: 2.1 time: 0.031712 Sep 08 11:37:49.306372 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3351/6835] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:37:49 2022] DELETE /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:37:49.312143 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a17b40ba-318b-4c62-8019-c7113f194354 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:37:49.312758 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a17b40ba-318b-4c62-8019-c7113f194354 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] [instance: 27fad958-f21e-4c3a-a74b-27736cc5aad6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:37:49.318682 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a17b40ba-318b-4c62-8019-c7113f194354 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:49.319168 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a17b40ba-318b-4c62-8019-c7113f194354 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:49.319602 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a17b40ba-318b-4c62-8019-c7113f194354 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:49.320288 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a17b40ba-318b-4c62-8019-c7113f194354 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:49.320744 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a17b40ba-318b-4c62-8019-c7113f194354 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:49.321348 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a17b40ba-318b-4c62-8019-c7113f194354 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:49.334809 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-a17b40ba-318b-4c62-8019-c7113f194354 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] HTTP exception thrown: Instance 27fad958-f21e-4c3a-a74b-27736cc5aad6 could not be found. Sep 08 11:37:49.336322 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a17b40ba-318b-4c62-8019-c7113f194354 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Request method failure captured: Sep 08 11:37:49.336322 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6 HTTP/1.1 Sep 08 11:37:49.336322 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:37:49.336322 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:37:49.336322 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:37:49.336322 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 11:37:49.336322 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:37:49.336322 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:37:49.336322 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:37:49.336322 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:37:49.336322 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGdPargSfNMZ56DZvslTBMas880EIUE_3656lY_xmgS7Wuih8I4aiv8HnI4uHG2GFW-WCt7vzmUDhleNh4i13_MhT-WUH2KXJHJH8u44gVU6rNZkkgGB-x-Dg4he4-7L3Bg72yIeKNAr83aFUYyIeqecHMRaoKaOqHNqqUcg5IsvNKSA Sep 08 11:37:49.336322 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:37:49.336322 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:37:49.336322 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:37:49.336322 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:37:49.336322 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:37:49.336322 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:37:49.336322 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 1ef8ff07efb44f0da2a55967b7bb5843 Sep 08 11:37:49.336322 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-DeleteServersTestJSON-348261830 Sep 08 11:37:49.336322 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:37:49.336322 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:37:49.336322 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1ef8ff07efb44f0da2a55967b7bb5843"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1ef8ff07efb44f0da2a55967b7bb5843"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1ef8ff07efb44f0da2a55967b7bb5843"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1ef8ff07efb44f0da2a55967b7bb5843"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:37:49.336322 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-DeleteServersTestJSON-348261830 Sep 08 11:37:49.336322 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 1ef8ff07efb44f0da2a55967b7bb5843 Sep 08 11:37:49.336322 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-DeleteServersTestJSON-348261830 Sep 08 11:37:49.336322 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-DeleteServersTestJSON-348261830-project Sep 08 11:37:49.336322 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:37:49.336322 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:37:49.336322 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 4e084870bbd046019e14bce31711eed0 Sep 08 11:37:49.336322 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-DeleteServersTestJSON-348261830-project Sep 08 11:37:49.336322 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 11:37:49.336322 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 27fad958-f21e-4c3a-a74b-27736cc5aad6 could not be found. Sep 08 11:37:49.336322 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '27fad958-f21e-4c3a-a74b-27736cc5aad6'} Sep 08 11:37:49.336322 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:37:49.336322 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:37:49.336322 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:37:49.336322 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:37:49.336322 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:37:49.336322 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:37:49.336322 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:37:49.336322 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:37:49.336322 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:37:49.336322 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:37:49.336322 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27fad958-f21e-4c3a-a74b-27736cc5aad6 could not be found. Sep 08 11:37:49.336322 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:37:49.336322 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:37:49.336322 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:37:49.336322 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:37:49.336322 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:37:49.336322 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:37:49.336322 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:37:49.336322 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:37:49.336322 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:37:49.336322 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:37:49.336322 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:37:49.336322 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:37:49.336322 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:37:49.336322 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:37:49.336322 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:37:49.336322 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:37:49.336322 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27fad958-f21e-4c3a-a74b-27736cc5aad6 could not be found. Sep 08 11:37:49.336322 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:37:49.336322 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:37:49.336322 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:37:49.341102 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:37:49.341102 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:37:49.341102 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:37:49.341102 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:37:49.341102 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:37:49.341102 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27fad958-f21e-4c3a-a74b-27736cc5aad6 could not be found. Sep 08 11:37:49.341102 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:37:49.341102 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a17b40ba-318b-4c62-8019-c7113f194354 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] Returning 404 to user: Instance 27fad958-f21e-4c3a-a74b-27736cc5aad6 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:37:49.341102 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a17b40ba-318b-4c62-8019-c7113f194354 tempest-DeleteServersTestJSON-348261830 tempest-DeleteServersTestJSON-348261830-project] 10.222.0.27 "GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6" status: 404 len: 111 microversion: 2.1 time: 0.029579 Sep 08 11:37:49.341102 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3485/6836] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:37:49 2022] GET /compute/v2.1/servers/27fad958-f21e-4c3a-a74b-27736cc5aad6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:37:57.907950 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6762e1ff-21c2-489c-8564-8bafea1dcb03 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1878510859", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "847a216b-c0e6-4537-aa91-74d50830ab0b"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:37:57.964193 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-6762e1ff-21c2-489c-8564-8bafea1dcb03 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] validate_networks() for [('847a216b-c0e6-4537-aa91-74d50830ab0b', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:37:58.387038 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-6762e1ff-21c2-489c-8564-8bafea1dcb03 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:37:58.387471 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-6762e1ff-21c2-489c-8564-8bafea1dcb03 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:37:58.387959 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-6762e1ff-21c2-489c-8564-8bafea1dcb03 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:37:58.388380 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-6762e1ff-21c2-489c-8564-8bafea1dcb03 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:37:58.389604 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-6762e1ff-21c2-489c-8564-8bafea1dcb03 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:37:58.398814 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6762e1ff-21c2-489c-8564-8bafea1dcb03 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:58.399341 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6762e1ff-21c2-489c-8564-8bafea1dcb03 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:58.399789 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6762e1ff-21c2-489c-8564-8bafea1dcb03 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:58.400531 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6762e1ff-21c2-489c-8564-8bafea1dcb03 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:58.400996 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6762e1ff-21c2-489c-8564-8bafea1dcb03 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:58.401464 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6762e1ff-21c2-489c-8564-8bafea1dcb03 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:58.418529 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-6762e1ff-21c2-489c-8564-8bafea1dcb03 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Getting quotas for project 0689a134e68a415c9e51179bdf0263ae. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:37:58.424127 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-6762e1ff-21c2-489c-8564-8bafea1dcb03 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Getting quotas for user 4d4c855c2a5a47e4b0fe9815d30697b3 and project 0689a134e68a415c9e51179bdf0263ae. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:37:58.438528 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6762e1ff-21c2-489c-8564-8bafea1dcb03 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:37:58.440882 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6762e1ff-21c2-489c-8564-8bafea1dcb03 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: e2589778-4bad-49f3-a3fa-5c3351c6568e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:37:58.486106 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6762e1ff-21c2-489c-8564-8bafea1dcb03 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.710968 Sep 08 11:37:58.486775 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3352/6837] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 11:37:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:37:58.498715 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e08cf020-e45b-4cf3-b0bc-d9d1a74c7055 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:37:58.499430 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e08cf020-e45b-4cf3-b0bc-d9d1a74c7055 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: e2589778-4bad-49f3-a3fa-5c3351c6568e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:37:58.565235 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e08cf020-e45b-4cf3-b0bc-d9d1a74c7055 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:37:58.572683 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e08cf020-e45b-4cf3-b0bc-d9d1a74c7055 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e" status: 200 len: 1218 microversion: 2.1 time: 0.078567 Sep 08 11:37:58.573212 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3486/6838] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:37:58 2022] GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:37:59.600550 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b4b6265d-a65f-4210-b6d9-1d24d0b1c536 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:37:59.601830 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b4b6265d-a65f-4210-b6d9-1d24d0b1c536 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: e2589778-4bad-49f3-a3fa-5c3351c6568e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:37:59.609793 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4b6265d-a65f-4210-b6d9-1d24d0b1c536 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:59.610910 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4b6265d-a65f-4210-b6d9-1d24d0b1c536 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:59.611596 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4b6265d-a65f-4210-b6d9-1d24d0b1c536 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:59.612543 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4b6265d-a65f-4210-b6d9-1d24d0b1c536 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:37:59.613264 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4b6265d-a65f-4210-b6d9-1d24d0b1c536 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:37:59.613939 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4b6265d-a65f-4210-b6d9-1d24d0b1c536 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:37:59.692175 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b4b6265d-a65f-4210-b6d9-1d24d0b1c536 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:37:59.704387 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b4b6265d-a65f-4210-b6d9-1d24d0b1c536 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e" status: 200 len: 1278 microversion: 2.1 time: 0.110391 Sep 08 11:37:59.706571 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3353/6839] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:37:59 2022] GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e => generated 1278 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:38:00.728954 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-195178ba-8f53-4d87-a133-803e6ae72baa tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:38:00.729655 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-195178ba-8f53-4d87-a133-803e6ae72baa tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: e2589778-4bad-49f3-a3fa-5c3351c6568e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:38:00.731720 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=43 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:38:00.739514 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-195178ba-8f53-4d87-a133-803e6ae72baa tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:00.740012 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-195178ba-8f53-4d87-a133-803e6ae72baa tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:00.740450 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-195178ba-8f53-4d87-a133-803e6ae72baa tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:00.741227 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-195178ba-8f53-4d87-a133-803e6ae72baa tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:00.741685 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-195178ba-8f53-4d87-a133-803e6ae72baa tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:00.742112 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-195178ba-8f53-4d87-a133-803e6ae72baa tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:00.896707 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-195178ba-8f53-4d87-a133-803e6ae72baa tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:38:00.906639 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-195178ba-8f53-4d87-a133-803e6ae72baa tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e" status: 200 len: 1318 microversion: 2.1 time: 0.181776 Sep 08 11:38:00.907524 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3487/6840] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:38:00 2022] GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:38:01.114345 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-c71a8b7b-3e95-44ef-be15-d732963d733e req-21778f0a-4ae9-4e3c-bac8-b6d7ebf4f7ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2589778-4bad-49f3-a3fa-5c3351c6568e", "tag": "4446ba80-5d8e-45d1-96ae-1c27596919ea"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:38:01.132685 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c71a8b7b-3e95-44ef-be15-d732963d733e req-21778f0a-4ae9-4e3c-bac8-b6d7ebf4f7ed service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:01.133243 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c71a8b7b-3e95-44ef-be15-d732963d733e req-21778f0a-4ae9-4e3c-bac8-b6d7ebf4f7ed service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:01.133875 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c71a8b7b-3e95-44ef-be15-d732963d733e req-21778f0a-4ae9-4e3c-bac8-b6d7ebf4f7ed service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:01.147899 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-c71a8b7b-3e95-44ef-be15-d732963d733e req-21778f0a-4ae9-4e3c-bac8-b6d7ebf4f7ed service nova] Creating event network-changed:4446ba80-5d8e-45d1-96ae-1c27596919ea for instance e2589778-4bad-49f3-a3fa-5c3351c6568e on n-h2-850501-12 Sep 08 11:38:01.153302 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-c71a8b7b-3e95-44ef-be15-d732963d733e req-21778f0a-4ae9-4e3c-bac8-b6d7ebf4f7ed service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042956 Sep 08 11:38:01.154595 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3354/6841] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:38:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:38:01.931774 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-796ed093-311b-4c41-a1a9-c45086e40795 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:38:01.932388 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-796ed093-311b-4c41-a1a9-c45086e40795 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: e2589778-4bad-49f3-a3fa-5c3351c6568e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:38:01.939787 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-796ed093-311b-4c41-a1a9-c45086e40795 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:01.940271 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-796ed093-311b-4c41-a1a9-c45086e40795 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:01.940707 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-796ed093-311b-4c41-a1a9-c45086e40795 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:01.941432 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-796ed093-311b-4c41-a1a9-c45086e40795 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:01.941887 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-796ed093-311b-4c41-a1a9-c45086e40795 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:01.942312 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-796ed093-311b-4c41-a1a9-c45086e40795 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:02.081878 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-796ed093-311b-4c41-a1a9-c45086e40795 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:38:02.089601 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-796ed093-311b-4c41-a1a9-c45086e40795 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e" status: 200 len: 1318 microversion: 2.1 time: 0.161816 Sep 08 11:38:02.090182 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3488/6842] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:38:01 2022] GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:38:03.114593 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a594ba00-7aec-42a2-ba27-c78caca3baf1 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:38:03.115688 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a594ba00-7aec-42a2-ba27-c78caca3baf1 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: e2589778-4bad-49f3-a3fa-5c3351c6568e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:38:03.122128 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a594ba00-7aec-42a2-ba27-c78caca3baf1 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:03.122672 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a594ba00-7aec-42a2-ba27-c78caca3baf1 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:03.123339 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a594ba00-7aec-42a2-ba27-c78caca3baf1 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:03.124325 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a594ba00-7aec-42a2-ba27-c78caca3baf1 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:03.124818 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a594ba00-7aec-42a2-ba27-c78caca3baf1 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:03.125315 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a594ba00-7aec-42a2-ba27-c78caca3baf1 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:03.327236 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a594ba00-7aec-42a2-ba27-c78caca3baf1 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:38:03.335787 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a594ba00-7aec-42a2-ba27-c78caca3baf1 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e" status: 200 len: 1318 microversion: 2.1 time: 0.226598 Sep 08 11:38:03.336365 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3355/6843] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:38:03 2022] GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:38:04.360573 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c640195f-816c-474e-b053-da4bc720ee93 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:38:04.361292 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c640195f-816c-474e-b053-da4bc720ee93 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: e2589778-4bad-49f3-a3fa-5c3351c6568e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:38:04.368234 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c640195f-816c-474e-b053-da4bc720ee93 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:04.368723 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c640195f-816c-474e-b053-da4bc720ee93 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:04.369193 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c640195f-816c-474e-b053-da4bc720ee93 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:04.369887 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c640195f-816c-474e-b053-da4bc720ee93 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:04.370346 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c640195f-816c-474e-b053-da4bc720ee93 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:04.370770 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c640195f-816c-474e-b053-da4bc720ee93 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:04.507825 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c640195f-816c-474e-b053-da4bc720ee93 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:38:04.517311 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c640195f-816c-474e-b053-da4bc720ee93 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e" status: 200 len: 1318 microversion: 2.1 time: 0.161388 Sep 08 11:38:04.517886 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3489/6844] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:38:04 2022] GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:38:05.540128 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-869d9b04-82dc-49ea-9874-a804d9acacc9 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:38:05.540756 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-869d9b04-82dc-49ea-9874-a804d9acacc9 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: e2589778-4bad-49f3-a3fa-5c3351c6568e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:38:05.548054 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-869d9b04-82dc-49ea-9874-a804d9acacc9 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:05.548559 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-869d9b04-82dc-49ea-9874-a804d9acacc9 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:05.549010 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-869d9b04-82dc-49ea-9874-a804d9acacc9 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:05.549750 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-869d9b04-82dc-49ea-9874-a804d9acacc9 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:05.550222 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-869d9b04-82dc-49ea-9874-a804d9acacc9 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:05.550661 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-869d9b04-82dc-49ea-9874-a804d9acacc9 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:05.553403 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:38:05.688230 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-869d9b04-82dc-49ea-9874-a804d9acacc9 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:38:05.695935 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-869d9b04-82dc-49ea-9874-a804d9acacc9 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e" status: 200 len: 1318 microversion: 2.1 time: 0.159731 Sep 08 11:38:05.696769 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3356/6845] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:38:05 2022] GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:38:06.719414 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-87fceabd-f0de-49e5-802d-ffcc93df26c9 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:38:06.720029 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-87fceabd-f0de-49e5-802d-ffcc93df26c9 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: e2589778-4bad-49f3-a3fa-5c3351c6568e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:38:06.722722 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=28 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:38:06.728656 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-87fceabd-f0de-49e5-802d-ffcc93df26c9 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:06.729190 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-87fceabd-f0de-49e5-802d-ffcc93df26c9 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:06.729636 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-87fceabd-f0de-49e5-802d-ffcc93df26c9 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:06.730347 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-87fceabd-f0de-49e5-802d-ffcc93df26c9 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:06.730813 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-87fceabd-f0de-49e5-802d-ffcc93df26c9 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:06.731245 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-87fceabd-f0de-49e5-802d-ffcc93df26c9 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:06.866086 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-87fceabd-f0de-49e5-802d-ffcc93df26c9 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:38:06.874953 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-87fceabd-f0de-49e5-802d-ffcc93df26c9 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e" status: 200 len: 1318 microversion: 2.1 time: 0.159021 Sep 08 11:38:06.875522 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3490/6846] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:38:06 2022] GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:38:07.872162 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-a2ff8000-53d3-4eee-b51c-ecb175326cde req-8ed8c26a-b5f0-4bae-9fa8-51d1dbd12443 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2589778-4bad-49f3-a3fa-5c3351c6568e", "name": "network-vif-plugged", "status": "completed", "tag": "4446ba80-5d8e-45d1-96ae-1c27596919ea"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:38:07.878226 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:38:07.883934 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a2ff8000-53d3-4eee-b51c-ecb175326cde req-8ed8c26a-b5f0-4bae-9fa8-51d1dbd12443 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:07.884508 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a2ff8000-53d3-4eee-b51c-ecb175326cde req-8ed8c26a-b5f0-4bae-9fa8-51d1dbd12443 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:07.884951 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a2ff8000-53d3-4eee-b51c-ecb175326cde req-8ed8c26a-b5f0-4bae-9fa8-51d1dbd12443 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:07.897702 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-79199cd6-4f27-41b2-b041-05dfdad4ee88 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:38:07.898417 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-79199cd6-4f27-41b2-b041-05dfdad4ee88 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: e2589778-4bad-49f3-a3fa-5c3351c6568e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:38:07.901984 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-a2ff8000-53d3-4eee-b51c-ecb175326cde req-8ed8c26a-b5f0-4bae-9fa8-51d1dbd12443 service nova] Creating event network-vif-plugged:4446ba80-5d8e-45d1-96ae-1c27596919ea for instance e2589778-4bad-49f3-a3fa-5c3351c6568e on n-h2-850501-12 Sep 08 11:38:07.907843 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-79199cd6-4f27-41b2-b041-05dfdad4ee88 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:07.907998 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-a2ff8000-53d3-4eee-b51c-ecb175326cde req-8ed8c26a-b5f0-4bae-9fa8-51d1dbd12443 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039636 Sep 08 11:38:07.908358 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-79199cd6-4f27-41b2-b041-05dfdad4ee88 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:07.908750 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3357/6847] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:38:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:38:07.908875 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-79199cd6-4f27-41b2-b041-05dfdad4ee88 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:07.909978 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-79199cd6-4f27-41b2-b041-05dfdad4ee88 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:07.910457 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-79199cd6-4f27-41b2-b041-05dfdad4ee88 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:07.910891 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-79199cd6-4f27-41b2-b041-05dfdad4ee88 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:08.071865 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-79199cd6-4f27-41b2-b041-05dfdad4ee88 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:38:08.080506 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-79199cd6-4f27-41b2-b041-05dfdad4ee88 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e" status: 200 len: 1318 microversion: 2.1 time: 0.186774 Sep 08 11:38:08.081119 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3491/6848] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:38:07 2022] GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:38:09.101421 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:38:09.102214 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:38:09.108707 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-226b5a36-b82b-4a7f-a815-eb00de3d96b5 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:38:09.109608 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-226b5a36-b82b-4a7f-a815-eb00de3d96b5 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: e2589778-4bad-49f3-a3fa-5c3351c6568e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:38:09.116670 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-226b5a36-b82b-4a7f-a815-eb00de3d96b5 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:09.117230 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-226b5a36-b82b-4a7f-a815-eb00de3d96b5 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:09.117686 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-226b5a36-b82b-4a7f-a815-eb00de3d96b5 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:09.118398 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-226b5a36-b82b-4a7f-a815-eb00de3d96b5 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:09.118870 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-226b5a36-b82b-4a7f-a815-eb00de3d96b5 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:09.119312 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-226b5a36-b82b-4a7f-a815-eb00de3d96b5 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:09.259790 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-226b5a36-b82b-4a7f-a815-eb00de3d96b5 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:38:09.268448 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-226b5a36-b82b-4a7f-a815-eb00de3d96b5 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e" status: 200 len: 1318 microversion: 2.1 time: 0.167930 Sep 08 11:38:09.269271 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3358/6849] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:38:09 2022] GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:38:10.291235 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bd7b3c9f-d8be-4d0b-811d-44e4459c2769 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:38:10.291793 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bd7b3c9f-d8be-4d0b-811d-44e4459c2769 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: e2589778-4bad-49f3-a3fa-5c3351c6568e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:38:10.293679 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:38:10.300862 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bd7b3c9f-d8be-4d0b-811d-44e4459c2769 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:10.301386 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bd7b3c9f-d8be-4d0b-811d-44e4459c2769 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:10.301828 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bd7b3c9f-d8be-4d0b-811d-44e4459c2769 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:10.302533 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bd7b3c9f-d8be-4d0b-811d-44e4459c2769 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:10.302984 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bd7b3c9f-d8be-4d0b-811d-44e4459c2769 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:10.303407 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bd7b3c9f-d8be-4d0b-811d-44e4459c2769 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:10.436768 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-bd7b3c9f-d8be-4d0b-811d-44e4459c2769 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:38:10.445196 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bd7b3c9f-d8be-4d0b-811d-44e4459c2769 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e" status: 200 len: 1508 microversion: 2.1 time: 0.157904 Sep 08 11:38:10.445762 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3492/6850] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:38:10 2022] GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:38:10.467555 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9449df70-119e-4820-bb6b-9126b447447e tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:38:10.468186 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9449df70-119e-4820-bb6b-9126b447447e tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: e2589778-4bad-49f3-a3fa-5c3351c6568e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:38:10.475000 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9449df70-119e-4820-bb6b-9126b447447e tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:10.475503 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9449df70-119e-4820-bb6b-9126b447447e tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:10.475956 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9449df70-119e-4820-bb6b-9126b447447e tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:10.476665 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9449df70-119e-4820-bb6b-9126b447447e tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:10.477199 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9449df70-119e-4820-bb6b-9126b447447e tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:10.477640 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9449df70-119e-4820-bb6b-9126b447447e tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:10.608297 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9449df70-119e-4820-bb6b-9126b447447e tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:38:10.616705 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9449df70-119e-4820-bb6b-9126b447447e tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e" status: 200 len: 1508 microversion: 2.1 time: 0.152939 Sep 08 11:38:10.617308 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3359/6851] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:38:10 2022] GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:38:10.639266 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-21b241d5-894d-4272-bb7e-3610adb13168 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:38:10.642434 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-21b241d5-894d-4272-bb7e-3610adb13168 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: e2589778-4bad-49f3-a3fa-5c3351c6568e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:38:10.648455 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-21b241d5-894d-4272-bb7e-3610adb13168 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:10.648944 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-21b241d5-894d-4272-bb7e-3610adb13168 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:10.649419 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-21b241d5-894d-4272-bb7e-3610adb13168 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:10.650118 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-21b241d5-894d-4272-bb7e-3610adb13168 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:10.650575 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-21b241d5-894d-4272-bb7e-3610adb13168 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:10.651009 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-21b241d5-894d-4272-bb7e-3610adb13168 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:10.715983 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-21b241d5-894d-4272-bb7e-3610adb13168 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "PUT /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e" status: 200 len: 1080 microversion: 2.1 time: 0.080564 Sep 08 11:38:10.716792 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3493/6852] 10.222.0.27 () {60 vars in 1256 bytes} [Thu Sep 8 11:38:10 2022] PUT /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e => generated 1080 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:38:10.736966 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-33dca2f9-6d31-4de9-aa1c-e1caa65e25fc tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:38:10.737625 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-33dca2f9-6d31-4de9-aa1c-e1caa65e25fc tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: e2589778-4bad-49f3-a3fa-5c3351c6568e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:38:10.743735 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33dca2f9-6d31-4de9-aa1c-e1caa65e25fc tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:10.744241 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33dca2f9-6d31-4de9-aa1c-e1caa65e25fc tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:10.744694 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33dca2f9-6d31-4de9-aa1c-e1caa65e25fc tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:10.745445 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33dca2f9-6d31-4de9-aa1c-e1caa65e25fc tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:10.745919 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33dca2f9-6d31-4de9-aa1c-e1caa65e25fc tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:10.746363 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33dca2f9-6d31-4de9-aa1c-e1caa65e25fc tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:10.876334 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-33dca2f9-6d31-4de9-aa1c-e1caa65e25fc tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:38:10.884089 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-33dca2f9-6d31-4de9-aa1c-e1caa65e25fc tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e" status: 200 len: 1506 microversion: 2.1 time: 0.151339 Sep 08 11:38:10.884664 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3360/6853] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:38:10 2022] GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:38:10.907169 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-eca3677c-a3c9-4a06-b88c-4eaec8d598ef tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:38:10.907781 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-eca3677c-a3c9-4a06-b88c-4eaec8d598ef tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: e2589778-4bad-49f3-a3fa-5c3351c6568e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:38:10.914090 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eca3677c-a3c9-4a06-b88c-4eaec8d598ef tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:10.914585 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eca3677c-a3c9-4a06-b88c-4eaec8d598ef tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:10.915024 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eca3677c-a3c9-4a06-b88c-4eaec8d598ef tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:10.915724 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eca3677c-a3c9-4a06-b88c-4eaec8d598ef tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:10.916184 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eca3677c-a3c9-4a06-b88c-4eaec8d598ef tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:10.916615 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eca3677c-a3c9-4a06-b88c-4eaec8d598ef tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:11.046153 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-eca3677c-a3c9-4a06-b88c-4eaec8d598ef tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:38:11.054112 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-eca3677c-a3c9-4a06-b88c-4eaec8d598ef tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e" status: 200 len: 1506 microversion: 2.1 time: 0.151465 Sep 08 11:38:11.054685 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3494/6854] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:38:10 2022] GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:38:11.076377 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8998617f-89de-40df-a33b-758a216b63b2 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:38:11.079259 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8998617f-89de-40df-a33b-758a216b63b2 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: e2589778-4bad-49f3-a3fa-5c3351c6568e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:38:11.085349 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8998617f-89de-40df-a33b-758a216b63b2 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:11.085850 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8998617f-89de-40df-a33b-758a216b63b2 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:11.086300 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8998617f-89de-40df-a33b-758a216b63b2 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:11.087006 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8998617f-89de-40df-a33b-758a216b63b2 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:11.087475 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8998617f-89de-40df-a33b-758a216b63b2 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:11.087906 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8998617f-89de-40df-a33b-758a216b63b2 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:11.116173 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8998617f-89de-40df-a33b-758a216b63b2 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:38:11.121654 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8998617f-89de-40df-a33b-758a216b63b2 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: e2589778-4bad-49f3-a3fa-5c3351c6568e] Old instance type m1.heat2, new instance type m1.heat {{(pid=128862) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 08 11:38:11.128728 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-8998617f-89de-40df-a33b-758a216b63b2 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:38:11.129208 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-8998617f-89de-40df-a33b-758a216b63b2 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:38:11.129727 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-8998617f-89de-40df-a33b-758a216b63b2 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:38:11.130158 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-8998617f-89de-40df-a33b-758a216b63b2 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:38:11.130586 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-8998617f-89de-40df-a33b-758a216b63b2 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:38:11.194744 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8998617f-89de-40df-a33b-758a216b63b2 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "POST /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e/action" status: 202 len: 0 microversion: 2.1 time: 0.122296 Sep 08 11:38:11.195548 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3361/6855] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 11:38:11 2022] POST /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:38:11.204392 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-37bbd42d-db20-4326-a71f-3ac641b6576d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:38:11.205013 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-37bbd42d-db20-4326-a71f-3ac641b6576d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: e2589778-4bad-49f3-a3fa-5c3351c6568e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:38:11.211003 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-37bbd42d-db20-4326-a71f-3ac641b6576d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:11.211499 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-37bbd42d-db20-4326-a71f-3ac641b6576d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:11.211936 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-37bbd42d-db20-4326-a71f-3ac641b6576d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:11.212639 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-37bbd42d-db20-4326-a71f-3ac641b6576d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:11.213125 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-37bbd42d-db20-4326-a71f-3ac641b6576d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:11.213556 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-37bbd42d-db20-4326-a71f-3ac641b6576d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:11.354487 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-37bbd42d-db20-4326-a71f-3ac641b6576d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:38:11.363874 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-37bbd42d-db20-4326-a71f-3ac641b6576d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e" status: 200 len: 1517 microversion: 2.1 time: 0.163960 Sep 08 11:38:11.364500 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3495/6856] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:38:11 2022] GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e => generated 1517 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:38:12.387731 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-862b79ae-7731-4b3f-9ca0-0d1e8073077e tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:38:12.388473 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-862b79ae-7731-4b3f-9ca0-0d1e8073077e tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: e2589778-4bad-49f3-a3fa-5c3351c6568e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:38:12.397608 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-862b79ae-7731-4b3f-9ca0-0d1e8073077e tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:12.398125 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-862b79ae-7731-4b3f-9ca0-0d1e8073077e tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:12.398580 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-862b79ae-7731-4b3f-9ca0-0d1e8073077e tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:12.399306 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-862b79ae-7731-4b3f-9ca0-0d1e8073077e tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:12.399799 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-862b79ae-7731-4b3f-9ca0-0d1e8073077e tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:12.400229 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-862b79ae-7731-4b3f-9ca0-0d1e8073077e tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:12.632996 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-862b79ae-7731-4b3f-9ca0-0d1e8073077e tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:38:12.641724 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-862b79ae-7731-4b3f-9ca0-0d1e8073077e tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e" status: 200 len: 1517 microversion: 2.1 time: 0.257894 Sep 08 11:38:12.642384 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3362/6857] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:38:12 2022] GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e => generated 1517 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:38:13.664985 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9ae0684b-5f0d-42d0-9d48-b752a6b49234 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:38:13.665638 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9ae0684b-5f0d-42d0-9d48-b752a6b49234 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: e2589778-4bad-49f3-a3fa-5c3351c6568e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:38:13.672270 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ae0684b-5f0d-42d0-9d48-b752a6b49234 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:13.672824 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ae0684b-5f0d-42d0-9d48-b752a6b49234 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:13.673286 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ae0684b-5f0d-42d0-9d48-b752a6b49234 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:13.673975 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ae0684b-5f0d-42d0-9d48-b752a6b49234 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:13.674433 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ae0684b-5f0d-42d0-9d48-b752a6b49234 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:13.674897 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ae0684b-5f0d-42d0-9d48-b752a6b49234 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:13.811164 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9ae0684b-5f0d-42d0-9d48-b752a6b49234 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:38:13.818996 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9ae0684b-5f0d-42d0-9d48-b752a6b49234 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e" status: 200 len: 1522 microversion: 2.1 time: 0.157890 Sep 08 11:38:13.819588 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3496/6858] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:38:13 2022] GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:38:14.842736 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b34061c4-677c-4be4-b21f-a166c09b5037 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:38:14.843361 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b34061c4-677c-4be4-b21f-a166c09b5037 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: e2589778-4bad-49f3-a3fa-5c3351c6568e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:38:14.850934 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b34061c4-677c-4be4-b21f-a166c09b5037 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:14.851434 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b34061c4-677c-4be4-b21f-a166c09b5037 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:14.851882 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b34061c4-677c-4be4-b21f-a166c09b5037 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:14.852650 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b34061c4-677c-4be4-b21f-a166c09b5037 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:14.853148 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b34061c4-677c-4be4-b21f-a166c09b5037 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:14.853587 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b34061c4-677c-4be4-b21f-a166c09b5037 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:14.990173 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b34061c4-677c-4be4-b21f-a166c09b5037 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:38:14.998079 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b34061c4-677c-4be4-b21f-a166c09b5037 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e" status: 200 len: 1522 microversion: 2.1 time: 0.159301 Sep 08 11:38:14.998652 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3363/6859] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:38:14 2022] GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:38:16.023341 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e4be6c8d-fc0f-4fab-833c-fcc9809da548 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:38:16.023967 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e4be6c8d-fc0f-4fab-833c-fcc9809da548 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: e2589778-4bad-49f3-a3fa-5c3351c6568e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:38:16.030851 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e4be6c8d-fc0f-4fab-833c-fcc9809da548 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:16.031981 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e4be6c8d-fc0f-4fab-833c-fcc9809da548 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:16.032423 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e4be6c8d-fc0f-4fab-833c-fcc9809da548 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:16.033164 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e4be6c8d-fc0f-4fab-833c-fcc9809da548 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:16.033617 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e4be6c8d-fc0f-4fab-833c-fcc9809da548 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:16.034071 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e4be6c8d-fc0f-4fab-833c-fcc9809da548 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:16.166061 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e4be6c8d-fc0f-4fab-833c-fcc9809da548 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:38:16.173924 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e4be6c8d-fc0f-4fab-833c-fcc9809da548 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e" status: 200 len: 1522 microversion: 2.1 time: 0.154573 Sep 08 11:38:16.174505 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3497/6860] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:38:16 2022] GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:38:17.197634 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bf0425fc-219c-426c-89db-2e7d8d8ce034 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:38:17.198276 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bf0425fc-219c-426c-89db-2e7d8d8ce034 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: e2589778-4bad-49f3-a3fa-5c3351c6568e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:38:17.205251 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf0425fc-219c-426c-89db-2e7d8d8ce034 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:17.205738 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf0425fc-219c-426c-89db-2e7d8d8ce034 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:17.206183 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf0425fc-219c-426c-89db-2e7d8d8ce034 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:17.206885 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf0425fc-219c-426c-89db-2e7d8d8ce034 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:17.207360 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf0425fc-219c-426c-89db-2e7d8d8ce034 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:17.207788 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf0425fc-219c-426c-89db-2e7d8d8ce034 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:17.341177 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bf0425fc-219c-426c-89db-2e7d8d8ce034 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:38:17.349651 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bf0425fc-219c-426c-89db-2e7d8d8ce034 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e" status: 200 len: 1522 microversion: 2.1 time: 0.155949 Sep 08 11:38:17.350232 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3364/6861] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:38:17 2022] GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:38:18.372949 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-96ddf280-860e-4f06-982a-383023393a6d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:38:18.373654 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-96ddf280-860e-4f06-982a-383023393a6d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: e2589778-4bad-49f3-a3fa-5c3351c6568e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:38:18.381217 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-96ddf280-860e-4f06-982a-383023393a6d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:18.381703 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-96ddf280-860e-4f06-982a-383023393a6d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:18.382139 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-96ddf280-860e-4f06-982a-383023393a6d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:18.382839 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-96ddf280-860e-4f06-982a-383023393a6d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:18.383296 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-96ddf280-860e-4f06-982a-383023393a6d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:18.383723 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-96ddf280-860e-4f06-982a-383023393a6d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:18.512304 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-96ddf280-860e-4f06-982a-383023393a6d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:38:18.520286 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-96ddf280-860e-4f06-982a-383023393a6d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e" status: 200 len: 1522 microversion: 2.1 time: 0.151240 Sep 08 11:38:18.520868 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3498/6862] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:38:18 2022] GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:38:19.543703 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3a396f2a-85f0-4aec-92d2-d3e4fdd6bf6d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:38:19.544356 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3a396f2a-85f0-4aec-92d2-d3e4fdd6bf6d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: e2589778-4bad-49f3-a3fa-5c3351c6568e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:38:19.552013 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a396f2a-85f0-4aec-92d2-d3e4fdd6bf6d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:19.552511 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a396f2a-85f0-4aec-92d2-d3e4fdd6bf6d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:19.552951 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a396f2a-85f0-4aec-92d2-d3e4fdd6bf6d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:19.553677 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a396f2a-85f0-4aec-92d2-d3e4fdd6bf6d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:19.554140 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a396f2a-85f0-4aec-92d2-d3e4fdd6bf6d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:19.554571 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a396f2a-85f0-4aec-92d2-d3e4fdd6bf6d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:19.936596 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3a396f2a-85f0-4aec-92d2-d3e4fdd6bf6d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:38:19.944381 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3a396f2a-85f0-4aec-92d2-d3e4fdd6bf6d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e" status: 200 len: 1522 microversion: 2.1 time: 0.404591 Sep 08 11:38:19.945117 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3365/6863] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:38:19 2022] GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e => generated 1522 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:38:20.966973 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-803c8fb6-20bb-413d-8e68-d4591b544ec9 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:38:20.967627 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-803c8fb6-20bb-413d-8e68-d4591b544ec9 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: e2589778-4bad-49f3-a3fa-5c3351c6568e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:38:20.974906 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-803c8fb6-20bb-413d-8e68-d4591b544ec9 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:20.975395 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-803c8fb6-20bb-413d-8e68-d4591b544ec9 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:20.975836 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-803c8fb6-20bb-413d-8e68-d4591b544ec9 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:20.976534 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-803c8fb6-20bb-413d-8e68-d4591b544ec9 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:20.976993 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-803c8fb6-20bb-413d-8e68-d4591b544ec9 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:20.977471 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-803c8fb6-20bb-413d-8e68-d4591b544ec9 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:21.125610 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-803c8fb6-20bb-413d-8e68-d4591b544ec9 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:38:21.133822 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-803c8fb6-20bb-413d-8e68-d4591b544ec9 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e" status: 200 len: 1522 microversion: 2.1 time: 0.170786 Sep 08 11:38:21.134393 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3499/6864] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:38:20 2022] GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:38:22.155846 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c4d204f2-ae4c-43eb-b190-b88adc4f6827 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:38:22.157442 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c4d204f2-ae4c-43eb-b190-b88adc4f6827 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: e2589778-4bad-49f3-a3fa-5c3351c6568e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:38:22.164837 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c4d204f2-ae4c-43eb-b190-b88adc4f6827 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:22.165366 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c4d204f2-ae4c-43eb-b190-b88adc4f6827 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:22.165846 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c4d204f2-ae4c-43eb-b190-b88adc4f6827 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:22.166553 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c4d204f2-ae4c-43eb-b190-b88adc4f6827 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:22.167018 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c4d204f2-ae4c-43eb-b190-b88adc4f6827 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:22.167464 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c4d204f2-ae4c-43eb-b190-b88adc4f6827 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:22.300757 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c4d204f2-ae4c-43eb-b190-b88adc4f6827 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:38:22.308495 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c4d204f2-ae4c-43eb-b190-b88adc4f6827 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e" status: 200 len: 1522 microversion: 2.1 time: 0.156696 Sep 08 11:38:22.309070 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3366/6865] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:38:22 2022] GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:38:23.331467 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9805e89e-6348-47c1-9a66-5aca7f5d2b25 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:38:23.332073 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9805e89e-6348-47c1-9a66-5aca7f5d2b25 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: e2589778-4bad-49f3-a3fa-5c3351c6568e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:38:23.339145 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9805e89e-6348-47c1-9a66-5aca7f5d2b25 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:23.339629 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9805e89e-6348-47c1-9a66-5aca7f5d2b25 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:23.340066 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9805e89e-6348-47c1-9a66-5aca7f5d2b25 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:23.340782 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9805e89e-6348-47c1-9a66-5aca7f5d2b25 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:23.341261 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9805e89e-6348-47c1-9a66-5aca7f5d2b25 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:23.341689 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9805e89e-6348-47c1-9a66-5aca7f5d2b25 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:23.475027 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9805e89e-6348-47c1-9a66-5aca7f5d2b25 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:38:23.482906 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9805e89e-6348-47c1-9a66-5aca7f5d2b25 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e" status: 200 len: 1522 microversion: 2.1 time: 0.155401 Sep 08 11:38:23.483468 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3500/6866] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:38:23 2022] GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:38:24.506957 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6f143ceb-ae72-407d-9198-94f0776c3854 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:38:24.507590 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6f143ceb-ae72-407d-9198-94f0776c3854 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: e2589778-4bad-49f3-a3fa-5c3351c6568e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:38:24.514480 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f143ceb-ae72-407d-9198-94f0776c3854 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:24.514984 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f143ceb-ae72-407d-9198-94f0776c3854 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:24.515503 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f143ceb-ae72-407d-9198-94f0776c3854 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:24.516393 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f143ceb-ae72-407d-9198-94f0776c3854 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:24.516867 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f143ceb-ae72-407d-9198-94f0776c3854 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:24.517340 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f143ceb-ae72-407d-9198-94f0776c3854 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:24.646709 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6f143ceb-ae72-407d-9198-94f0776c3854 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:38:24.654390 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6f143ceb-ae72-407d-9198-94f0776c3854 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e" status: 200 len: 1522 microversion: 2.1 time: 0.151408 Sep 08 11:38:24.654956 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3367/6867] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:38:24 2022] GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:38:25.678633 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-23d131c3-c417-46be-a71a-be94b637fdc8 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:38:25.679259 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-23d131c3-c417-46be-a71a-be94b637fdc8 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: e2589778-4bad-49f3-a3fa-5c3351c6568e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:38:25.685749 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-23d131c3-c417-46be-a71a-be94b637fdc8 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:25.686237 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-23d131c3-c417-46be-a71a-be94b637fdc8 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:25.686671 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-23d131c3-c417-46be-a71a-be94b637fdc8 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:25.688167 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-23d131c3-c417-46be-a71a-be94b637fdc8 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:25.688633 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-23d131c3-c417-46be-a71a-be94b637fdc8 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:25.689097 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-23d131c3-c417-46be-a71a-be94b637fdc8 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:25.827096 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-23d131c3-c417-46be-a71a-be94b637fdc8 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:38:25.835915 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-23d131c3-c417-46be-a71a-be94b637fdc8 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e" status: 200 len: 1522 microversion: 2.1 time: 0.161414 Sep 08 11:38:25.836498 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3501/6868] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:38:25 2022] GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:38:26.858637 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5ede8dbe-afef-41e7-8f3f-05bc1c7319f8 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:38:26.859252 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5ede8dbe-afef-41e7-8f3f-05bc1c7319f8 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: e2589778-4bad-49f3-a3fa-5c3351c6568e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:38:26.866598 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ede8dbe-afef-41e7-8f3f-05bc1c7319f8 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:26.867100 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ede8dbe-afef-41e7-8f3f-05bc1c7319f8 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:26.867551 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ede8dbe-afef-41e7-8f3f-05bc1c7319f8 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:26.868253 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ede8dbe-afef-41e7-8f3f-05bc1c7319f8 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:26.868718 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ede8dbe-afef-41e7-8f3f-05bc1c7319f8 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:26.869192 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ede8dbe-afef-41e7-8f3f-05bc1c7319f8 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:27.004887 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5ede8dbe-afef-41e7-8f3f-05bc1c7319f8 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:38:27.012608 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5ede8dbe-afef-41e7-8f3f-05bc1c7319f8 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e" status: 200 len: 1522 microversion: 2.1 time: 0.157960 Sep 08 11:38:27.013196 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3368/6869] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:38:26 2022] GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:38:28.036717 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bb00ceb7-2feb-4544-adc7-58fc304c4088 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:38:28.037184 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bb00ceb7-2feb-4544-adc7-58fc304c4088 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: e2589778-4bad-49f3-a3fa-5c3351c6568e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:38:28.044308 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bb00ceb7-2feb-4544-adc7-58fc304c4088 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:28.044612 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bb00ceb7-2feb-4544-adc7-58fc304c4088 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:28.045341 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bb00ceb7-2feb-4544-adc7-58fc304c4088 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:28.046054 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bb00ceb7-2feb-4544-adc7-58fc304c4088 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:28.046547 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bb00ceb7-2feb-4544-adc7-58fc304c4088 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:28.047555 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bb00ceb7-2feb-4544-adc7-58fc304c4088 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:28.189636 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-bb00ceb7-2feb-4544-adc7-58fc304c4088 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:38:28.193300 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:38:28.198092 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bb00ceb7-2feb-4544-adc7-58fc304c4088 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e" status: 200 len: 1522 microversion: 2.1 time: 0.165647 Sep 08 11:38:28.198682 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3502/6870] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:38:28 2022] GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:38:29.221392 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ee76493f-217a-46b6-90ae-78d874b81d9f tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:38:29.222091 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ee76493f-217a-46b6-90ae-78d874b81d9f tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: e2589778-4bad-49f3-a3fa-5c3351c6568e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:38:29.228950 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ee76493f-217a-46b6-90ae-78d874b81d9f tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:29.229647 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ee76493f-217a-46b6-90ae-78d874b81d9f tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:29.230102 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ee76493f-217a-46b6-90ae-78d874b81d9f tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:29.230819 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ee76493f-217a-46b6-90ae-78d874b81d9f tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:29.231295 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ee76493f-217a-46b6-90ae-78d874b81d9f tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:29.231735 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ee76493f-217a-46b6-90ae-78d874b81d9f tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:29.363498 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ee76493f-217a-46b6-90ae-78d874b81d9f tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:38:29.371338 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ee76493f-217a-46b6-90ae-78d874b81d9f tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e" status: 200 len: 1522 microversion: 2.1 time: 0.153957 Sep 08 11:38:29.371905 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3369/6871] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:38:29 2022] GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:38:30.396236 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-905550d4-3d5b-4871-80af-0f5ba0be5532 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:38:30.396876 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-905550d4-3d5b-4871-80af-0f5ba0be5532 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: e2589778-4bad-49f3-a3fa-5c3351c6568e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:38:30.404728 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-905550d4-3d5b-4871-80af-0f5ba0be5532 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:30.405247 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-905550d4-3d5b-4871-80af-0f5ba0be5532 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:30.405685 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-905550d4-3d5b-4871-80af-0f5ba0be5532 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:30.406674 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-905550d4-3d5b-4871-80af-0f5ba0be5532 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:30.407482 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-905550d4-3d5b-4871-80af-0f5ba0be5532 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:30.407916 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-905550d4-3d5b-4871-80af-0f5ba0be5532 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:30.537917 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-905550d4-3d5b-4871-80af-0f5ba0be5532 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:38:30.545997 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-905550d4-3d5b-4871-80af-0f5ba0be5532 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e" status: 200 len: 1522 microversion: 2.1 time: 0.154176 Sep 08 11:38:30.546630 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3503/6872] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:38:30 2022] GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:38:31.570170 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-22593460-4824-40bf-b0a6-5215f13e8a6a tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:38:31.570806 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-22593460-4824-40bf-b0a6-5215f13e8a6a tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: e2589778-4bad-49f3-a3fa-5c3351c6568e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:38:31.577925 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-22593460-4824-40bf-b0a6-5215f13e8a6a tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:31.579015 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-22593460-4824-40bf-b0a6-5215f13e8a6a tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:31.579432 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-22593460-4824-40bf-b0a6-5215f13e8a6a tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:31.580166 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-22593460-4824-40bf-b0a6-5215f13e8a6a tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:31.580643 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-22593460-4824-40bf-b0a6-5215f13e8a6a tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:31.581118 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-22593460-4824-40bf-b0a6-5215f13e8a6a tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:31.764504 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-22593460-4824-40bf-b0a6-5215f13e8a6a tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:38:31.773060 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-22593460-4824-40bf-b0a6-5215f13e8a6a tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e" status: 200 len: 1522 microversion: 2.1 time: 0.206749 Sep 08 11:38:31.773633 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3370/6873] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:38:31 2022] GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:38:32.797439 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8394e4b8-4fd8-488e-b00a-42be86f918db tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:38:32.798065 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8394e4b8-4fd8-488e-b00a-42be86f918db tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: e2589778-4bad-49f3-a3fa-5c3351c6568e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:38:32.805851 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8394e4b8-4fd8-488e-b00a-42be86f918db tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:32.806350 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8394e4b8-4fd8-488e-b00a-42be86f918db tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:32.806794 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8394e4b8-4fd8-488e-b00a-42be86f918db tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:32.807751 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8394e4b8-4fd8-488e-b00a-42be86f918db tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:32.807962 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8394e4b8-4fd8-488e-b00a-42be86f918db tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:32.808391 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8394e4b8-4fd8-488e-b00a-42be86f918db tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:32.944415 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8394e4b8-4fd8-488e-b00a-42be86f918db tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:38:32.952375 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8394e4b8-4fd8-488e-b00a-42be86f918db tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e" status: 200 len: 1522 microversion: 2.1 time: 0.159059 Sep 08 11:38:32.952947 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3504/6874] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:38:32 2022] GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:38:33.975561 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b642dea9-4859-4c24-b214-346b6612c155 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:38:33.976191 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b642dea9-4859-4c24-b214-346b6612c155 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: e2589778-4bad-49f3-a3fa-5c3351c6568e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:38:33.983198 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b642dea9-4859-4c24-b214-346b6612c155 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:33.983700 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b642dea9-4859-4c24-b214-346b6612c155 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:33.984152 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b642dea9-4859-4c24-b214-346b6612c155 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:33.985700 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b642dea9-4859-4c24-b214-346b6612c155 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:33.986173 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b642dea9-4859-4c24-b214-346b6612c155 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:33.986620 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b642dea9-4859-4c24-b214-346b6612c155 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:34.121942 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b642dea9-4859-4c24-b214-346b6612c155 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:38:34.130407 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b642dea9-4859-4c24-b214-346b6612c155 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e" status: 200 len: 1522 microversion: 2.1 time: 0.158825 Sep 08 11:38:34.130979 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3371/6875] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:38:33 2022] GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:38:35.152671 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a628d2ef-af17-4bed-9156-ff03c3992938 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:38:35.153350 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a628d2ef-af17-4bed-9156-ff03c3992938 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: e2589778-4bad-49f3-a3fa-5c3351c6568e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:38:35.161088 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a628d2ef-af17-4bed-9156-ff03c3992938 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:35.161587 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a628d2ef-af17-4bed-9156-ff03c3992938 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:35.162026 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a628d2ef-af17-4bed-9156-ff03c3992938 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:35.162729 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a628d2ef-af17-4bed-9156-ff03c3992938 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:35.163189 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a628d2ef-af17-4bed-9156-ff03c3992938 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:35.163618 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a628d2ef-af17-4bed-9156-ff03c3992938 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:35.291828 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a628d2ef-af17-4bed-9156-ff03c3992938 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:38:35.300354 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a628d2ef-af17-4bed-9156-ff03c3992938 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e" status: 200 len: 1522 microversion: 2.1 time: 0.151682 Sep 08 11:38:35.300931 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3505/6876] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:38:35 2022] GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:38:36.324112 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-df370672-79c1-4bf0-b917-7fe9ad631f5f tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:38:36.324742 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-df370672-79c1-4bf0-b917-7fe9ad631f5f tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: e2589778-4bad-49f3-a3fa-5c3351c6568e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:38:36.332201 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df370672-79c1-4bf0-b917-7fe9ad631f5f tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:36.332707 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df370672-79c1-4bf0-b917-7fe9ad631f5f tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:36.333193 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df370672-79c1-4bf0-b917-7fe9ad631f5f tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:36.333908 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df370672-79c1-4bf0-b917-7fe9ad631f5f tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:36.334386 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df370672-79c1-4bf0-b917-7fe9ad631f5f tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:36.334988 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df370672-79c1-4bf0-b917-7fe9ad631f5f tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:36.338935 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:38:36.467862 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-df370672-79c1-4bf0-b917-7fe9ad631f5f tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:38:36.476001 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-df370672-79c1-4bf0-b917-7fe9ad631f5f tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e" status: 200 len: 1522 microversion: 2.1 time: 0.155878 Sep 08 11:38:36.476570 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3372/6877] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:38:36 2022] GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:38:37.498985 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d85ec7b3-cb8b-43e6-be91-00360b6b63a1 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:38:37.499638 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d85ec7b3-cb8b-43e6-be91-00360b6b63a1 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: e2589778-4bad-49f3-a3fa-5c3351c6568e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:38:37.502623 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=32 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:38:37.508002 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d85ec7b3-cb8b-43e6-be91-00360b6b63a1 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:37.508494 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d85ec7b3-cb8b-43e6-be91-00360b6b63a1 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:37.508932 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d85ec7b3-cb8b-43e6-be91-00360b6b63a1 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:37.509654 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d85ec7b3-cb8b-43e6-be91-00360b6b63a1 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:37.510110 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d85ec7b3-cb8b-43e6-be91-00360b6b63a1 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:37.510536 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d85ec7b3-cb8b-43e6-be91-00360b6b63a1 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:37.646131 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d85ec7b3-cb8b-43e6-be91-00360b6b63a1 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:38:37.654107 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d85ec7b3-cb8b-43e6-be91-00360b6b63a1 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e" status: 200 len: 1522 microversion: 2.1 time: 0.158992 Sep 08 11:38:37.654692 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3506/6878] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:38:37 2022] GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:38:38.677822 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7e50127c-b17a-4b94-a2e2-0d5a9b307152 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:38:38.678450 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7e50127c-b17a-4b94-a2e2-0d5a9b307152 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: e2589778-4bad-49f3-a3fa-5c3351c6568e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:38:38.681524 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=36 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:38:38.686589 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e50127c-b17a-4b94-a2e2-0d5a9b307152 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:38.687100 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e50127c-b17a-4b94-a2e2-0d5a9b307152 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:38.688048 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e50127c-b17a-4b94-a2e2-0d5a9b307152 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:38.688798 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e50127c-b17a-4b94-a2e2-0d5a9b307152 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:38.689299 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e50127c-b17a-4b94-a2e2-0d5a9b307152 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:38.689746 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e50127c-b17a-4b94-a2e2-0d5a9b307152 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:38.825204 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7e50127c-b17a-4b94-a2e2-0d5a9b307152 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:38:38.833710 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7e50127c-b17a-4b94-a2e2-0d5a9b307152 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e" status: 200 len: 1522 microversion: 2.1 time: 0.159917 Sep 08 11:38:38.834289 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3373/6879] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:38:38 2022] GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:38:39.857421 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-17f6646e-df43-4c06-a34c-c55d21a2972f tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:38:39.858066 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-17f6646e-df43-4c06-a34c-c55d21a2972f tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: e2589778-4bad-49f3-a3fa-5c3351c6568e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:38:39.865299 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-17f6646e-df43-4c06-a34c-c55d21a2972f tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:39.865792 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-17f6646e-df43-4c06-a34c-c55d21a2972f tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:39.866233 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-17f6646e-df43-4c06-a34c-c55d21a2972f tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:39.866933 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-17f6646e-df43-4c06-a34c-c55d21a2972f tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:39.867670 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-17f6646e-df43-4c06-a34c-c55d21a2972f tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:39.867828 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-17f6646e-df43-4c06-a34c-c55d21a2972f tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:40.001414 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-17f6646e-df43-4c06-a34c-c55d21a2972f tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:38:40.009316 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-17f6646e-df43-4c06-a34c-c55d21a2972f tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e" status: 200 len: 1522 microversion: 2.1 time: 0.155846 Sep 08 11:38:40.010099 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3507/6880] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:38:39 2022] GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:38:40.656089 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-c3b7f0bf-45ba-40b4-bd70-2e5a9c225515 req-6d969948-095b-4e1a-8abb-5820541e37c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2589778-4bad-49f3-a3fa-5c3351c6568e", "name": "network-vif-unplugged", "status": "completed", "tag": "4446ba80-5d8e-45d1-96ae-1c27596919ea"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:38:40.668039 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c3b7f0bf-45ba-40b4-bd70-2e5a9c225515 req-6d969948-095b-4e1a-8abb-5820541e37c2 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:40.668583 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c3b7f0bf-45ba-40b4-bd70-2e5a9c225515 req-6d969948-095b-4e1a-8abb-5820541e37c2 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:40.669104 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c3b7f0bf-45ba-40b4-bd70-2e5a9c225515 req-6d969948-095b-4e1a-8abb-5820541e37c2 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:40.681521 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-c3b7f0bf-45ba-40b4-bd70-2e5a9c225515 req-6d969948-095b-4e1a-8abb-5820541e37c2 service nova] Creating event network-vif-unplugged:4446ba80-5d8e-45d1-96ae-1c27596919ea for instance e2589778-4bad-49f3-a3fa-5c3351c6568e on n-h1-850501-12 Sep 08 11:38:40.687036 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [req-c3b7f0bf-45ba-40b4-bd70-2e5a9c225515 req-6d969948-095b-4e1a-8abb-5820541e37c2 service nova] Instance e2589778-4bad-49f3-a3fa-5c3351c6568e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850501-12', 'n-h1-850501-12'} {{(pid=128862) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 11:38:40.698316 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-c3b7f0bf-45ba-40b4-bd70-2e5a9c225515 req-6d969948-095b-4e1a-8abb-5820541e37c2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046050 Sep 08 11:38:40.698938 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3374/6881] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:38:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:38:41.033489 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-364a5ad9-cb9f-44ce-9f8d-050b2759e34c tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:38:41.034138 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-364a5ad9-cb9f-44ce-9f8d-050b2759e34c tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: e2589778-4bad-49f3-a3fa-5c3351c6568e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:38:41.041373 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-364a5ad9-cb9f-44ce-9f8d-050b2759e34c tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:41.041876 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-364a5ad9-cb9f-44ce-9f8d-050b2759e34c tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:41.042312 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-364a5ad9-cb9f-44ce-9f8d-050b2759e34c tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:41.043026 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-364a5ad9-cb9f-44ce-9f8d-050b2759e34c tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:41.043520 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-364a5ad9-cb9f-44ce-9f8d-050b2759e34c tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:41.043949 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-364a5ad9-cb9f-44ce-9f8d-050b2759e34c tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:41.274666 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-364a5ad9-cb9f-44ce-9f8d-050b2759e34c tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:38:41.282949 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-364a5ad9-cb9f-44ce-9f8d-050b2759e34c tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e" status: 200 len: 1521 microversion: 2.1 time: 0.253812 Sep 08 11:38:41.283551 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3508/6882] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:38:41 2022] GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:38:42.308778 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2d7d4fdf-fa88-4558-b28c-9057029454b9 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:38:42.309520 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2d7d4fdf-fa88-4558-b28c-9057029454b9 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: e2589778-4bad-49f3-a3fa-5c3351c6568e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:38:42.316994 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2d7d4fdf-fa88-4558-b28c-9057029454b9 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:42.317627 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2d7d4fdf-fa88-4558-b28c-9057029454b9 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:42.318155 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2d7d4fdf-fa88-4558-b28c-9057029454b9 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:42.318869 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2d7d4fdf-fa88-4558-b28c-9057029454b9 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:42.319338 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2d7d4fdf-fa88-4558-b28c-9057029454b9 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:42.319777 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2d7d4fdf-fa88-4558-b28c-9057029454b9 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:42.460603 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2d7d4fdf-fa88-4558-b28c-9057029454b9 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:38:42.468713 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2d7d4fdf-fa88-4558-b28c-9057029454b9 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e" status: 200 len: 1519 microversion: 2.1 time: 0.165241 Sep 08 11:38:42.469352 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3375/6883] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:38:42 2022] GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:38:42.725803 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-36b79578-86e1-4aeb-b16a-b79e4b4e0526 req-4aa98e55-9763-44d0-9d38-3c3e603cb56c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2589778-4bad-49f3-a3fa-5c3351c6568e", "tag": "4446ba80-5d8e-45d1-96ae-1c27596919ea"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:38:42.737365 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-36b79578-86e1-4aeb-b16a-b79e4b4e0526 req-4aa98e55-9763-44d0-9d38-3c3e603cb56c service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:42.738117 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-36b79578-86e1-4aeb-b16a-b79e4b4e0526 req-4aa98e55-9763-44d0-9d38-3c3e603cb56c service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:42.738553 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-36b79578-86e1-4aeb-b16a-b79e4b4e0526 req-4aa98e55-9763-44d0-9d38-3c3e603cb56c service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:42.751357 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-36b79578-86e1-4aeb-b16a-b79e4b4e0526 req-4aa98e55-9763-44d0-9d38-3c3e603cb56c service nova] Creating event network-changed:4446ba80-5d8e-45d1-96ae-1c27596919ea for instance e2589778-4bad-49f3-a3fa-5c3351c6568e on n-h1-850501-12 Sep 08 11:38:42.758393 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [req-36b79578-86e1-4aeb-b16a-b79e4b4e0526 req-4aa98e55-9763-44d0-9d38-3c3e603cb56c service nova] Instance e2589778-4bad-49f3-a3fa-5c3351c6568e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850501-12', 'n-h1-850501-12'} {{(pid=128861) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 11:38:42.769797 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-36b79578-86e1-4aeb-b16a-b79e4b4e0526 req-4aa98e55-9763-44d0-9d38-3c3e603cb56c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047708 Sep 08 11:38:42.770541 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3509/6884] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:38:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:38:43.492269 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e873e552-95e2-40e8-b098-9fd7f45a7c3b tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:38:43.493620 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e873e552-95e2-40e8-b098-9fd7f45a7c3b tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: e2589778-4bad-49f3-a3fa-5c3351c6568e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:38:43.501802 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e873e552-95e2-40e8-b098-9fd7f45a7c3b tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:43.502770 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e873e552-95e2-40e8-b098-9fd7f45a7c3b tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:43.503665 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e873e552-95e2-40e8-b098-9fd7f45a7c3b tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:43.504582 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e873e552-95e2-40e8-b098-9fd7f45a7c3b tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:43.505246 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e873e552-95e2-40e8-b098-9fd7f45a7c3b tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:43.505840 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e873e552-95e2-40e8-b098-9fd7f45a7c3b tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:43.663631 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e873e552-95e2-40e8-b098-9fd7f45a7c3b tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:38:43.672549 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e873e552-95e2-40e8-b098-9fd7f45a7c3b tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e" status: 200 len: 1516 microversion: 2.1 time: 0.184025 Sep 08 11:38:43.673175 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3376/6885] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:38:43 2022] GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e => generated 1516 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:38:43.696461 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c13823b5-fe05-434b-971c-563ac672ad61 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:38:43.697110 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c13823b5-fe05-434b-971c-563ac672ad61 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: e2589778-4bad-49f3-a3fa-5c3351c6568e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:38:43.703688 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c13823b5-fe05-434b-971c-563ac672ad61 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:43.704181 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c13823b5-fe05-434b-971c-563ac672ad61 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:43.704620 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c13823b5-fe05-434b-971c-563ac672ad61 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:43.705903 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c13823b5-fe05-434b-971c-563ac672ad61 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:43.706444 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c13823b5-fe05-434b-971c-563ac672ad61 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:43.706864 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c13823b5-fe05-434b-971c-563ac672ad61 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:43.769286 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c13823b5-fe05-434b-971c-563ac672ad61 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "POST /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e/action" status: 204 len: 0 microversion: 2.1 time: 0.077307 Sep 08 11:38:43.769940 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3510/6886] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 11:38:43 2022] POST /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e/action => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 11:38:43.778843 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f27e0a9c-9d41-496e-8ee8-670bac3eaa54 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:38:43.779474 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f27e0a9c-9d41-496e-8ee8-670bac3eaa54 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: e2589778-4bad-49f3-a3fa-5c3351c6568e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:38:43.786397 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f27e0a9c-9d41-496e-8ee8-670bac3eaa54 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:43.786901 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f27e0a9c-9d41-496e-8ee8-670bac3eaa54 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:43.787549 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f27e0a9c-9d41-496e-8ee8-670bac3eaa54 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:43.788270 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f27e0a9c-9d41-496e-8ee8-670bac3eaa54 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:43.788889 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f27e0a9c-9d41-496e-8ee8-670bac3eaa54 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:43.789346 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f27e0a9c-9d41-496e-8ee8-670bac3eaa54 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:44.002637 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f27e0a9c-9d41-496e-8ee8-670bac3eaa54 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:38:44.011988 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f27e0a9c-9d41-496e-8ee8-670bac3eaa54 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e" status: 200 len: 1516 microversion: 2.1 time: 0.237140 Sep 08 11:38:44.012955 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3377/6887] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:38:43 2022] GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e => generated 1516 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:38:45.038681 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8b9cb03d-cb7d-4219-b4de-d2d31588eac6 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:38:45.039448 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8b9cb03d-cb7d-4219-b4de-d2d31588eac6 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: e2589778-4bad-49f3-a3fa-5c3351c6568e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:38:45.046216 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8b9cb03d-cb7d-4219-b4de-d2d31588eac6 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:45.046719 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8b9cb03d-cb7d-4219-b4de-d2d31588eac6 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:45.047191 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8b9cb03d-cb7d-4219-b4de-d2d31588eac6 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:45.047905 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8b9cb03d-cb7d-4219-b4de-d2d31588eac6 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:45.048367 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8b9cb03d-cb7d-4219-b4de-d2d31588eac6 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:45.048802 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8b9cb03d-cb7d-4219-b4de-d2d31588eac6 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:45.192830 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8b9cb03d-cb7d-4219-b4de-d2d31588eac6 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:38:45.200906 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8b9cb03d-cb7d-4219-b4de-d2d31588eac6 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e" status: 200 len: 1516 microversion: 2.1 time: 0.168214 Sep 08 11:38:45.201511 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3511/6888] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:38:45 2022] GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e => generated 1516 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:38:46.224359 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9c874371-d8bf-4304-ab94-82a6f458acb0 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:38:46.225019 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9c874371-d8bf-4304-ab94-82a6f458acb0 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: e2589778-4bad-49f3-a3fa-5c3351c6568e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:38:46.231956 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9c874371-d8bf-4304-ab94-82a6f458acb0 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:46.232470 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9c874371-d8bf-4304-ab94-82a6f458acb0 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:46.232932 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9c874371-d8bf-4304-ab94-82a6f458acb0 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:46.233693 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9c874371-d8bf-4304-ab94-82a6f458acb0 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:46.234174 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9c874371-d8bf-4304-ab94-82a6f458acb0 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:46.234625 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9c874371-d8bf-4304-ab94-82a6f458acb0 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:46.366980 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9c874371-d8bf-4304-ab94-82a6f458acb0 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:38:46.375311 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9c874371-d8bf-4304-ab94-82a6f458acb0 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e" status: 200 len: 1508 microversion: 2.1 time: 0.155344 Sep 08 11:38:46.375903 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3378/6889] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:38:46 2022] GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:38:46.398044 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-36f0143b-8dfa-4ef8-8358-5ba36885e107 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:38:46.398776 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-36f0143b-8dfa-4ef8-8358-5ba36885e107 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: e2589778-4bad-49f3-a3fa-5c3351c6568e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:38:46.406245 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-36f0143b-8dfa-4ef8-8358-5ba36885e107 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:46.406741 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-8debeca4-15cc-40d9-b610-8736ebfaf639 req-83880ad0-b260-47c0-a16f-a756500841fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2589778-4bad-49f3-a3fa-5c3351c6568e", "name": "network-vif-plugged", "status": "completed", "tag": "4446ba80-5d8e-45d1-96ae-1c27596919ea"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:38:46.406913 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-36f0143b-8dfa-4ef8-8358-5ba36885e107 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:46.407407 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-36f0143b-8dfa-4ef8-8358-5ba36885e107 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:46.408189 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-36f0143b-8dfa-4ef8-8358-5ba36885e107 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:46.409270 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-36f0143b-8dfa-4ef8-8358-5ba36885e107 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:46.409879 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-36f0143b-8dfa-4ef8-8358-5ba36885e107 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:46.419002 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-8debeca4-15cc-40d9-b610-8736ebfaf639 req-83880ad0-b260-47c0-a16f-a756500841fc service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:46.419749 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-8debeca4-15cc-40d9-b610-8736ebfaf639 req-83880ad0-b260-47c0-a16f-a756500841fc service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:46.420272 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-8debeca4-15cc-40d9-b610-8736ebfaf639 req-83880ad0-b260-47c0-a16f-a756500841fc service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:46.435199 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-8debeca4-15cc-40d9-b610-8736ebfaf639 req-83880ad0-b260-47c0-a16f-a756500841fc service nova] Creating event network-vif-plugged:4446ba80-5d8e-45d1-96ae-1c27596919ea for instance e2589778-4bad-49f3-a3fa-5c3351c6568e on n-h1-850501-12 Sep 08 11:38:46.441974 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-8debeca4-15cc-40d9-b610-8736ebfaf639 req-83880ad0-b260-47c0-a16f-a756500841fc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037960 Sep 08 11:38:46.443043 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3379/6890] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:38:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:38:46.564339 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-36f0143b-8dfa-4ef8-8358-5ba36885e107 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:38:46.572317 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-36f0143b-8dfa-4ef8-8358-5ba36885e107 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e" status: 200 len: 1508 microversion: 2.1 time: 0.178507 Sep 08 11:38:46.573059 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3512/6891] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:38:46 2022] GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e => generated 1508 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:38:46.599420 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cbf27388-374e-4f2b-b1a4-4f5b4a074318 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Action: 'create', calling method: .version_select at 0x7f68df7030d0>, body: {"keypair": {"name": "tempest-keypair-1041629780", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAC8UaQdOoZtt/ekPzIWYkJwYhwynIleMvgHgShcCt+tl/mJtbDg30UUsPTaPlXAlQwmWg+b/YLZbJFu3UrIxu+twLWOWvD6w5IykgFQ/qEGufYzrRcf5zqs/gnKmhGKPw=="}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:38:46.616307 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-cbf27388-374e-4f2b-b1a4-4f5b4a074318 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Getting quotas for project 0689a134e68a415c9e51179bdf0263ae. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:38:46.621410 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-cbf27388-374e-4f2b-b1a4-4f5b4a074318 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Getting quotas for user 4d4c855c2a5a47e4b0fe9815d30697b3 and project 0689a134e68a415c9e51179bdf0263ae. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:38:46.647100 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cbf27388-374e-4f2b-b1a4-4f5b4a074318 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.052903 Sep 08 11:38:46.647715 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3380/6892] 10.222.0.27 () {60 vars in 1159 bytes} [Thu Sep 8 11:38:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:38:47.848752 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-52c98bc1-8548-4235-b6c9-ba2bd1416800 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:38:47.849437 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-52c98bc1-8548-4235-b6c9-ba2bd1416800 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: e2589778-4bad-49f3-a3fa-5c3351c6568e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:38:47.856297 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-52c98bc1-8548-4235-b6c9-ba2bd1416800 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:47.856789 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-52c98bc1-8548-4235-b6c9-ba2bd1416800 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:47.857341 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-52c98bc1-8548-4235-b6c9-ba2bd1416800 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:47.858183 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-52c98bc1-8548-4235-b6c9-ba2bd1416800 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:47.858645 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-52c98bc1-8548-4235-b6c9-ba2bd1416800 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:47.859075 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-52c98bc1-8548-4235-b6c9-ba2bd1416800 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:47.992886 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-52c98bc1-8548-4235-b6c9-ba2bd1416800 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:38:48.000732 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-52c98bc1-8548-4235-b6c9-ba2bd1416800 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e" status: 200 len: 1508 microversion: 2.1 time: 0.156729 Sep 08 11:38:48.001327 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3513/6893] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:38:47 2022] GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:38:48.024967 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-39eee9ac-8fd9-45b8-ba86-70c13dc63515 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:38:48.025664 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-39eee9ac-8fd9-45b8-ba86-70c13dc63515 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: e2589778-4bad-49f3-a3fa-5c3351c6568e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:38:48.032457 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-39eee9ac-8fd9-45b8-ba86-70c13dc63515 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:48.032960 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-39eee9ac-8fd9-45b8-ba86-70c13dc63515 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:48.034074 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-39eee9ac-8fd9-45b8-ba86-70c13dc63515 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:48.035041 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-39eee9ac-8fd9-45b8-ba86-70c13dc63515 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:48.035530 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-39eee9ac-8fd9-45b8-ba86-70c13dc63515 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:48.035943 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-39eee9ac-8fd9-45b8-ba86-70c13dc63515 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:48.062575 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-39eee9ac-8fd9-45b8-ba86-70c13dc63515 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: e2589778-4bad-49f3-a3fa-5c3351c6568e] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:38:48.143267 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-39eee9ac-8fd9-45b8-ba86-70c13dc63515 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e" status: 204 len: 0 microversion: 2.1 time: 0.122250 Sep 08 11:38:48.144060 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3381/6894] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:38:48 2022] DELETE /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:38:48.209364 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5ee9883b-935f-4b44-b971-9b2adb28e2d1 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-880083354", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "847a216b-c0e6-4537-aa91-74d50830ab0b"}]}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:38:48.270671 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-5ee9883b-935f-4b44-b971-9b2adb28e2d1 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] validate_networks() for [('847a216b-c0e6-4537-aa91-74d50830ab0b', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:38:48.689172 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-5ee9883b-935f-4b44-b971-9b2adb28e2d1 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:38:48.690095 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-5ee9883b-935f-4b44-b971-9b2adb28e2d1 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:38:48.690570 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-5ee9883b-935f-4b44-b971-9b2adb28e2d1 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:38:48.690981 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-5ee9883b-935f-4b44-b971-9b2adb28e2d1 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:38:48.692448 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-5ee9883b-935f-4b44-b971-9b2adb28e2d1 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:38:48.701922 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5ee9883b-935f-4b44-b971-9b2adb28e2d1 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:48.701922 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5ee9883b-935f-4b44-b971-9b2adb28e2d1 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:48.702905 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5ee9883b-935f-4b44-b971-9b2adb28e2d1 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:48.703209 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5ee9883b-935f-4b44-b971-9b2adb28e2d1 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:48.703713 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5ee9883b-935f-4b44-b971-9b2adb28e2d1 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:48.704128 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5ee9883b-935f-4b44-b971-9b2adb28e2d1 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:48.728152 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-5ee9883b-935f-4b44-b971-9b2adb28e2d1 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Getting quotas for project 0689a134e68a415c9e51179bdf0263ae. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:38:48.733900 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-5ee9883b-935f-4b44-b971-9b2adb28e2d1 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Getting quotas for user 4d4c855c2a5a47e4b0fe9815d30697b3 and project 0689a134e68a415c9e51179bdf0263ae. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:38:48.748674 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5ee9883b-935f-4b44-b971-9b2adb28e2d1 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:38:48.751125 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5ee9883b-935f-4b44-b971-9b2adb28e2d1 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: 3a858979-cb26-4d08-b5b8-6cf237259c9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:38:48.807258 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5ee9883b-935f-4b44-b971-9b2adb28e2d1 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.605161 Sep 08 11:38:48.807937 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3514/6895] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 11:38:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 607 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 11:38:48.822979 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-88d24a2c-a49b-4b6d-bcac-ea91de349a9d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:38:48.825284 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-88d24a2c-a49b-4b6d-bcac-ea91de349a9d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: 3a858979-cb26-4d08-b5b8-6cf237259c9d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:38:48.886537 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-88d24a2c-a49b-4b6d-bcac-ea91de349a9d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:38:48.896687 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-88d24a2c-a49b-4b6d-bcac-ea91de349a9d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d" status: 200 len: 1217 microversion: 2.1 time: 0.079926 Sep 08 11:38:48.897312 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3382/6896] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:38:48 2022] GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:38:49.926874 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7a1e42d4-5747-47a5-9e68-aa167577c587 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:38:49.928106 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7a1e42d4-5747-47a5-9e68-aa167577c587 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: 3a858979-cb26-4d08-b5b8-6cf237259c9d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:38:49.935586 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a1e42d4-5747-47a5-9e68-aa167577c587 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:49.936082 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a1e42d4-5747-47a5-9e68-aa167577c587 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:49.936520 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a1e42d4-5747-47a5-9e68-aa167577c587 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:49.937268 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a1e42d4-5747-47a5-9e68-aa167577c587 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:49.937729 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a1e42d4-5747-47a5-9e68-aa167577c587 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:49.938156 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a1e42d4-5747-47a5-9e68-aa167577c587 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:50.023196 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7a1e42d4-5747-47a5-9e68-aa167577c587 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:38:50.033068 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7a1e42d4-5747-47a5-9e68-aa167577c587 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d" status: 200 len: 1269 microversion: 2.1 time: 0.113833 Sep 08 11:38:50.034379 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3515/6897] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:38:49 2022] GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d => generated 1269 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:38:50.279336 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-d6e4fb99-d46d-4cf5-a786-d974a21edcf7 req-7446d35a-a5c6-4cbb-b4af-3ceba5f1c73d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2589778-4bad-49f3-a3fa-5c3351c6568e", "name": "network-vif-deleted", "tag": "4446ba80-5d8e-45d1-96ae-1c27596919ea"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:38:50.291581 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d6e4fb99-d46d-4cf5-a786-d974a21edcf7 req-7446d35a-a5c6-4cbb-b4af-3ceba5f1c73d service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:50.292087 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d6e4fb99-d46d-4cf5-a786-d974a21edcf7 req-7446d35a-a5c6-4cbb-b4af-3ceba5f1c73d service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:50.292540 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d6e4fb99-d46d-4cf5-a786-d974a21edcf7 req-7446d35a-a5c6-4cbb-b4af-3ceba5f1c73d service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:50.306916 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-d6e4fb99-d46d-4cf5-a786-d974a21edcf7 req-7446d35a-a5c6-4cbb-b4af-3ceba5f1c73d service nova] Creating event network-vif-deleted:4446ba80-5d8e-45d1-96ae-1c27596919ea for instance e2589778-4bad-49f3-a3fa-5c3351c6568e on n-h1-850501-12 Sep 08 11:38:50.314138 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-d6e4fb99-d46d-4cf5-a786-d974a21edcf7 req-7446d35a-a5c6-4cbb-b4af-3ceba5f1c73d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040002 Sep 08 11:38:50.315603 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3383/6898] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:38:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:38:51.056056 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0f3bedc1-a0e9-4285-acf0-f869f114f0c7 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:38:51.057314 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0f3bedc1-a0e9-4285-acf0-f869f114f0c7 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: 3a858979-cb26-4d08-b5b8-6cf237259c9d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:38:51.063860 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0f3bedc1-a0e9-4285-acf0-f869f114f0c7 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:51.064347 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0f3bedc1-a0e9-4285-acf0-f869f114f0c7 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:51.065064 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0f3bedc1-a0e9-4285-acf0-f869f114f0c7 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:51.065925 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0f3bedc1-a0e9-4285-acf0-f869f114f0c7 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:51.067246 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0f3bedc1-a0e9-4285-acf0-f869f114f0c7 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:51.068052 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0f3bedc1-a0e9-4285-acf0-f869f114f0c7 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:51.207761 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0f3bedc1-a0e9-4285-acf0-f869f114f0c7 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:38:51.215971 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0f3bedc1-a0e9-4285-acf0-f869f114f0c7 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d" status: 200 len: 1317 microversion: 2.1 time: 0.163928 Sep 08 11:38:51.216648 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3516/6899] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:38:51 2022] GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:38:51.808504 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-060dc43a-27c1-47e8-8f15-543a0ea681df req-2d055d93-02f4-4dde-9923-8be0ad1cfab8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a858979-cb26-4d08-b5b8-6cf237259c9d", "tag": "bcd1646d-79cc-4579-b63e-7b5b432207a7"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:38:51.819080 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-060dc43a-27c1-47e8-8f15-543a0ea681df req-2d055d93-02f4-4dde-9923-8be0ad1cfab8 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:51.819679 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-060dc43a-27c1-47e8-8f15-543a0ea681df req-2d055d93-02f4-4dde-9923-8be0ad1cfab8 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:51.820131 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-060dc43a-27c1-47e8-8f15-543a0ea681df req-2d055d93-02f4-4dde-9923-8be0ad1cfab8 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:51.833338 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-060dc43a-27c1-47e8-8f15-543a0ea681df req-2d055d93-02f4-4dde-9923-8be0ad1cfab8 service nova] Creating event network-changed:bcd1646d-79cc-4579-b63e-7b5b432207a7 for instance 3a858979-cb26-4d08-b5b8-6cf237259c9d on n-h2-850501-12 Sep 08 11:38:51.838801 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-060dc43a-27c1-47e8-8f15-543a0ea681df req-2d055d93-02f4-4dde-9923-8be0ad1cfab8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035458 Sep 08 11:38:51.839417 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3384/6900] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:38:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:38:52.244706 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1e65865b-0ef7-44cb-9c42-89fe65ce522d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:38:52.245282 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1e65865b-0ef7-44cb-9c42-89fe65ce522d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: 3a858979-cb26-4d08-b5b8-6cf237259c9d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:38:52.251889 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e65865b-0ef7-44cb-9c42-89fe65ce522d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:52.252705 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e65865b-0ef7-44cb-9c42-89fe65ce522d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:52.259023 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e65865b-0ef7-44cb-9c42-89fe65ce522d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:52.259797 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e65865b-0ef7-44cb-9c42-89fe65ce522d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:52.260277 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e65865b-0ef7-44cb-9c42-89fe65ce522d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:52.260715 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e65865b-0ef7-44cb-9c42-89fe65ce522d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:52.398301 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1e65865b-0ef7-44cb-9c42-89fe65ce522d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:38:52.406189 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1e65865b-0ef7-44cb-9c42-89fe65ce522d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d" status: 200 len: 1317 microversion: 2.1 time: 0.166077 Sep 08 11:38:52.406774 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3517/6901] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:38:52 2022] GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:38:53.431851 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-db41962b-8b11-4403-9fb0-e2054f87033c tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:38:53.432598 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-db41962b-8b11-4403-9fb0-e2054f87033c tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: 3a858979-cb26-4d08-b5b8-6cf237259c9d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:38:53.439000 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db41962b-8b11-4403-9fb0-e2054f87033c tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:53.439799 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db41962b-8b11-4403-9fb0-e2054f87033c tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:53.440083 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db41962b-8b11-4403-9fb0-e2054f87033c tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:53.440969 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db41962b-8b11-4403-9fb0-e2054f87033c tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:53.441314 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db41962b-8b11-4403-9fb0-e2054f87033c tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:53.441755 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db41962b-8b11-4403-9fb0-e2054f87033c tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:53.663780 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-db41962b-8b11-4403-9fb0-e2054f87033c tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:38:53.671769 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-db41962b-8b11-4403-9fb0-e2054f87033c tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d" status: 200 len: 1317 microversion: 2.1 time: 0.245771 Sep 08 11:38:53.672448 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3385/6902] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:38:53 2022] GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d => generated 1317 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:38:54.694703 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-31a4d11b-2c90-4f29-8cb0-43af23a439d7 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:38:54.695412 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-31a4d11b-2c90-4f29-8cb0-43af23a439d7 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: 3a858979-cb26-4d08-b5b8-6cf237259c9d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:38:54.702511 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-31a4d11b-2c90-4f29-8cb0-43af23a439d7 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:54.702991 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-31a4d11b-2c90-4f29-8cb0-43af23a439d7 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:54.703419 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-31a4d11b-2c90-4f29-8cb0-43af23a439d7 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:54.704120 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-31a4d11b-2c90-4f29-8cb0-43af23a439d7 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:54.704567 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-31a4d11b-2c90-4f29-8cb0-43af23a439d7 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:54.704988 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-31a4d11b-2c90-4f29-8cb0-43af23a439d7 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:54.839842 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-31a4d11b-2c90-4f29-8cb0-43af23a439d7 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:38:54.848442 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-31a4d11b-2c90-4f29-8cb0-43af23a439d7 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d" status: 200 len: 1317 microversion: 2.1 time: 0.157672 Sep 08 11:38:54.849009 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3518/6903] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:38:54 2022] GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:38:55.871876 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d7e1f0e5-ac30-4105-8a02-17a27b778898 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:38:55.872531 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d7e1f0e5-ac30-4105-8a02-17a27b778898 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: 3a858979-cb26-4d08-b5b8-6cf237259c9d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:38:55.879415 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d7e1f0e5-ac30-4105-8a02-17a27b778898 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:55.879917 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d7e1f0e5-ac30-4105-8a02-17a27b778898 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:55.880368 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d7e1f0e5-ac30-4105-8a02-17a27b778898 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:55.881097 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d7e1f0e5-ac30-4105-8a02-17a27b778898 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:55.881569 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d7e1f0e5-ac30-4105-8a02-17a27b778898 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:55.882007 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d7e1f0e5-ac30-4105-8a02-17a27b778898 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:56.015745 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d7e1f0e5-ac30-4105-8a02-17a27b778898 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:38:56.023695 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d7e1f0e5-ac30-4105-8a02-17a27b778898 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d" status: 200 len: 1317 microversion: 2.1 time: 0.155697 Sep 08 11:38:56.024268 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3386/6904] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:38:55 2022] GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:38:57.047148 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ab8dca21-45d8-4eb2-aa3a-8b2ca4c6b77c tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:38:57.047763 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ab8dca21-45d8-4eb2-aa3a-8b2ca4c6b77c tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: 3a858979-cb26-4d08-b5b8-6cf237259c9d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:38:57.055357 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ab8dca21-45d8-4eb2-aa3a-8b2ca4c6b77c tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:57.055844 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ab8dca21-45d8-4eb2-aa3a-8b2ca4c6b77c tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:57.056280 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ab8dca21-45d8-4eb2-aa3a-8b2ca4c6b77c tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:57.056966 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ab8dca21-45d8-4eb2-aa3a-8b2ca4c6b77c tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:57.057450 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ab8dca21-45d8-4eb2-aa3a-8b2ca4c6b77c tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:57.057875 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ab8dca21-45d8-4eb2-aa3a-8b2ca4c6b77c tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:57.073574 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:38:57.192374 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ab8dca21-45d8-4eb2-aa3a-8b2ca4c6b77c tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:38:57.200159 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ab8dca21-45d8-4eb2-aa3a-8b2ca4c6b77c tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d" status: 200 len: 1317 microversion: 2.1 time: 0.156912 Sep 08 11:38:57.200734 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3519/6905] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:38:57 2022] GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:38:58.173406 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-66b2d37e-2c02-4693-b002-9897dacedbc0 req-c7af6ba4-feff-46f1-a955-69606543da62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a858979-cb26-4d08-b5b8-6cf237259c9d", "name": "network-vif-plugged", "status": "completed", "tag": "bcd1646d-79cc-4579-b63e-7b5b432207a7"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:38:58.185129 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-66b2d37e-2c02-4693-b002-9897dacedbc0 req-c7af6ba4-feff-46f1-a955-69606543da62 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:58.185634 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-66b2d37e-2c02-4693-b002-9897dacedbc0 req-c7af6ba4-feff-46f1-a955-69606543da62 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:58.186076 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-66b2d37e-2c02-4693-b002-9897dacedbc0 req-c7af6ba4-feff-46f1-a955-69606543da62 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:58.198223 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-66b2d37e-2c02-4693-b002-9897dacedbc0 req-c7af6ba4-feff-46f1-a955-69606543da62 service nova] Creating event network-vif-plugged:bcd1646d-79cc-4579-b63e-7b5b432207a7 for instance 3a858979-cb26-4d08-b5b8-6cf237259c9d on n-h2-850501-12 Sep 08 11:38:58.203422 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-66b2d37e-2c02-4693-b002-9897dacedbc0 req-c7af6ba4-feff-46f1-a955-69606543da62 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033733 Sep 08 11:38:58.204259 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3387/6906] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:38:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:38:58.223490 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7b5fad98-8ad3-4f83-8bef-308c140b05c9 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:38:58.224913 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7b5fad98-8ad3-4f83-8bef-308c140b05c9 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: 3a858979-cb26-4d08-b5b8-6cf237259c9d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:38:58.235401 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7b5fad98-8ad3-4f83-8bef-308c140b05c9 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:58.236946 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7b5fad98-8ad3-4f83-8bef-308c140b05c9 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:58.238253 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7b5fad98-8ad3-4f83-8bef-308c140b05c9 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:58.239505 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7b5fad98-8ad3-4f83-8bef-308c140b05c9 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:58.240351 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7b5fad98-8ad3-4f83-8bef-308c140b05c9 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:58.240950 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7b5fad98-8ad3-4f83-8bef-308c140b05c9 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:58.380414 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7b5fad98-8ad3-4f83-8bef-308c140b05c9 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:38:58.388208 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7b5fad98-8ad3-4f83-8bef-308c140b05c9 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d" status: 200 len: 1317 microversion: 2.1 time: 0.169340 Sep 08 11:38:58.388784 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3520/6907] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:38:58 2022] GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:38:59.413264 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8daf8ddf-0dda-47cc-b4e8-0ac78f6e5e11 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:38:59.413983 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8daf8ddf-0dda-47cc-b4e8-0ac78f6e5e11 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: 3a858979-cb26-4d08-b5b8-6cf237259c9d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:38:59.416122 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:38:59.422258 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8daf8ddf-0dda-47cc-b4e8-0ac78f6e5e11 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:59.422766 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8daf8ddf-0dda-47cc-b4e8-0ac78f6e5e11 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:59.423215 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8daf8ddf-0dda-47cc-b4e8-0ac78f6e5e11 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:59.423926 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8daf8ddf-0dda-47cc-b4e8-0ac78f6e5e11 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:59.424485 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8daf8ddf-0dda-47cc-b4e8-0ac78f6e5e11 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:59.425082 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8daf8ddf-0dda-47cc-b4e8-0ac78f6e5e11 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:59.562253 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8daf8ddf-0dda-47cc-b4e8-0ac78f6e5e11 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:38:59.572599 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8daf8ddf-0dda-47cc-b4e8-0ac78f6e5e11 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d" status: 200 len: 1317 microversion: 2.1 time: 0.164692 Sep 08 11:38:59.573274 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3388/6908] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:38:59 2022] GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:39:00.597380 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9dcf9152-0f88-4a3d-b531-ade5294e6c78 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:39:00.597995 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9dcf9152-0f88-4a3d-b531-ade5294e6c78 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: 3a858979-cb26-4d08-b5b8-6cf237259c9d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:39:00.599828 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:39:00.600623 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=6 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:39:00.607336 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9dcf9152-0f88-4a3d-b531-ade5294e6c78 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:00.607822 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9dcf9152-0f88-4a3d-b531-ade5294e6c78 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:00.608261 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9dcf9152-0f88-4a3d-b531-ade5294e6c78 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:00.608951 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9dcf9152-0f88-4a3d-b531-ade5294e6c78 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:00.609432 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9dcf9152-0f88-4a3d-b531-ade5294e6c78 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:00.609859 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9dcf9152-0f88-4a3d-b531-ade5294e6c78 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:00.743730 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9dcf9152-0f88-4a3d-b531-ade5294e6c78 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:39:00.751440 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9dcf9152-0f88-4a3d-b531-ade5294e6c78 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d" status: 200 len: 1507 microversion: 2.1 time: 0.158561 Sep 08 11:39:00.752041 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3521/6909] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:39:00 2022] GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d => generated 1507 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:39:00.774032 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3d428ae6-8a78-47ae-97e4-4522fbe37042 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:39:00.774717 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3d428ae6-8a78-47ae-97e4-4522fbe37042 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: 3a858979-cb26-4d08-b5b8-6cf237259c9d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:39:00.781596 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d428ae6-8a78-47ae-97e4-4522fbe37042 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:00.782100 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d428ae6-8a78-47ae-97e4-4522fbe37042 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:00.782556 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d428ae6-8a78-47ae-97e4-4522fbe37042 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:00.783273 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d428ae6-8a78-47ae-97e4-4522fbe37042 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:00.784418 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d428ae6-8a78-47ae-97e4-4522fbe37042 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:00.784876 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d428ae6-8a78-47ae-97e4-4522fbe37042 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:00.922773 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3d428ae6-8a78-47ae-97e4-4522fbe37042 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:39:00.930790 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3d428ae6-8a78-47ae-97e4-4522fbe37042 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d" status: 200 len: 1507 microversion: 2.1 time: 0.160644 Sep 08 11:39:00.931369 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3389/6910] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:39:00 2022] GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:39:00.952999 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3881cc7f-bca0-448d-b793-0cd8f891720f tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:39:00.955352 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3881cc7f-bca0-448d-b793-0cd8f891720f tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: 3a858979-cb26-4d08-b5b8-6cf237259c9d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:39:00.962273 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3881cc7f-bca0-448d-b793-0cd8f891720f tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:00.962764 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3881cc7f-bca0-448d-b793-0cd8f891720f tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:00.963206 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3881cc7f-bca0-448d-b793-0cd8f891720f tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:00.963902 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3881cc7f-bca0-448d-b793-0cd8f891720f tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:00.964363 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3881cc7f-bca0-448d-b793-0cd8f891720f tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:00.964789 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3881cc7f-bca0-448d-b793-0cd8f891720f tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:01.039332 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-3881cc7f-bca0-448d-b793-0cd8f891720f tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:39:01.045211 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3881cc7f-bca0-448d-b793-0cd8f891720f tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: 3a858979-cb26-4d08-b5b8-6cf237259c9d] Old instance type m1.heat2, new instance type m1.heat {{(pid=128861) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 08 11:39:01.051813 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-3881cc7f-bca0-448d-b793-0cd8f891720f tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:39:01.052238 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-3881cc7f-bca0-448d-b793-0cd8f891720f tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:39:01.052714 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-3881cc7f-bca0-448d-b793-0cd8f891720f tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:39:01.053151 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-3881cc7f-bca0-448d-b793-0cd8f891720f tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:39:01.053565 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-3881cc7f-bca0-448d-b793-0cd8f891720f tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:39:01.161246 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3881cc7f-bca0-448d-b793-0cd8f891720f tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "POST /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d/action" status: 202 len: 0 microversion: 2.1 time: 0.211941 Sep 08 11:39:01.162018 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3522/6911] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 11:39:00 2022] POST /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:39:01.170445 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-95abf5db-da19-469d-90c2-0ec9115e6b41 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:39:01.171105 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-95abf5db-da19-469d-90c2-0ec9115e6b41 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: 3a858979-cb26-4d08-b5b8-6cf237259c9d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:39:01.177539 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-95abf5db-da19-469d-90c2-0ec9115e6b41 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:01.178048 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-95abf5db-da19-469d-90c2-0ec9115e6b41 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:01.178498 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-95abf5db-da19-469d-90c2-0ec9115e6b41 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:01.179214 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-95abf5db-da19-469d-90c2-0ec9115e6b41 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:01.179686 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-95abf5db-da19-469d-90c2-0ec9115e6b41 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:01.180122 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-95abf5db-da19-469d-90c2-0ec9115e6b41 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:01.334149 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-95abf5db-da19-469d-90c2-0ec9115e6b41 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:39:01.342118 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-95abf5db-da19-469d-90c2-0ec9115e6b41 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d" status: 200 len: 1514 microversion: 2.1 time: 0.175660 Sep 08 11:39:01.342696 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3390/6912] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:39:01 2022] GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d => generated 1514 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:39:02.365843 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-24cfd4ba-8b9c-4130-9290-0a64febfedd9 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:39:02.366561 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-24cfd4ba-8b9c-4130-9290-0a64febfedd9 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: 3a858979-cb26-4d08-b5b8-6cf237259c9d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:39:02.373864 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24cfd4ba-8b9c-4130-9290-0a64febfedd9 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:02.374359 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24cfd4ba-8b9c-4130-9290-0a64febfedd9 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:02.374794 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24cfd4ba-8b9c-4130-9290-0a64febfedd9 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:02.375506 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24cfd4ba-8b9c-4130-9290-0a64febfedd9 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:02.375959 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24cfd4ba-8b9c-4130-9290-0a64febfedd9 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:02.376382 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24cfd4ba-8b9c-4130-9290-0a64febfedd9 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:02.520404 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-24cfd4ba-8b9c-4130-9290-0a64febfedd9 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:39:02.528427 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-24cfd4ba-8b9c-4130-9290-0a64febfedd9 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d" status: 200 len: 1514 microversion: 2.1 time: 0.168152 Sep 08 11:39:02.529113 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3523/6913] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:39:02 2022] GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d => generated 1514 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:39:03.552439 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-99d7d2aa-5aaf-4d61-9e9a-b9eb523de1df tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:39:03.553276 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-99d7d2aa-5aaf-4d61-9e9a-b9eb523de1df tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: 3a858979-cb26-4d08-b5b8-6cf237259c9d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:39:03.560323 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-99d7d2aa-5aaf-4d61-9e9a-b9eb523de1df tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:03.560819 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-99d7d2aa-5aaf-4d61-9e9a-b9eb523de1df tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:03.561300 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-99d7d2aa-5aaf-4d61-9e9a-b9eb523de1df tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:03.562018 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-99d7d2aa-5aaf-4d61-9e9a-b9eb523de1df tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:03.562491 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-99d7d2aa-5aaf-4d61-9e9a-b9eb523de1df tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:03.562926 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-99d7d2aa-5aaf-4d61-9e9a-b9eb523de1df tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:03.699061 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-99d7d2aa-5aaf-4d61-9e9a-b9eb523de1df tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:39:03.706987 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-99d7d2aa-5aaf-4d61-9e9a-b9eb523de1df tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d" status: 200 len: 1519 microversion: 2.1 time: 0.159094 Sep 08 11:39:03.707566 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3391/6914] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:39:03 2022] GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:39:04.730374 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-05393f13-40d1-4e57-873d-c917a2aaf0f0 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:39:04.730898 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-05393f13-40d1-4e57-873d-c917a2aaf0f0 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: 3a858979-cb26-4d08-b5b8-6cf237259c9d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:39:04.738849 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-05393f13-40d1-4e57-873d-c917a2aaf0f0 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:04.739352 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-05393f13-40d1-4e57-873d-c917a2aaf0f0 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:04.739763 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-05393f13-40d1-4e57-873d-c917a2aaf0f0 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:04.740454 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-05393f13-40d1-4e57-873d-c917a2aaf0f0 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:04.740906 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-05393f13-40d1-4e57-873d-c917a2aaf0f0 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:04.741356 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-05393f13-40d1-4e57-873d-c917a2aaf0f0 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:04.874246 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-05393f13-40d1-4e57-873d-c917a2aaf0f0 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:39:04.882524 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-05393f13-40d1-4e57-873d-c917a2aaf0f0 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d" status: 200 len: 1519 microversion: 2.1 time: 0.156342 Sep 08 11:39:04.883096 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3524/6915] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:39:04 2022] GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:39:05.905542 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-807bf088-aaff-4e52-88f0-86d53cfc40de tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:39:05.906167 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-807bf088-aaff-4e52-88f0-86d53cfc40de tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: 3a858979-cb26-4d08-b5b8-6cf237259c9d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:39:05.913806 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-807bf088-aaff-4e52-88f0-86d53cfc40de tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:05.914309 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-807bf088-aaff-4e52-88f0-86d53cfc40de tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:05.914759 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-807bf088-aaff-4e52-88f0-86d53cfc40de tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:05.915482 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-807bf088-aaff-4e52-88f0-86d53cfc40de tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:05.915946 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-807bf088-aaff-4e52-88f0-86d53cfc40de tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:05.916387 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-807bf088-aaff-4e52-88f0-86d53cfc40de tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:05.919130 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:39:06.048456 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-807bf088-aaff-4e52-88f0-86d53cfc40de tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:39:06.056355 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-807bf088-aaff-4e52-88f0-86d53cfc40de tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d" status: 200 len: 1519 microversion: 2.1 time: 0.154714 Sep 08 11:39:06.056936 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3392/6916] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:39:05 2022] GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:39:07.078775 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1c95a3f6-2f25-4975-badc-baf675ba2a8d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:39:07.079298 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1c95a3f6-2f25-4975-badc-baf675ba2a8d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: 3a858979-cb26-4d08-b5b8-6cf237259c9d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:39:07.086512 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1c95a3f6-2f25-4975-badc-baf675ba2a8d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:07.087002 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1c95a3f6-2f25-4975-badc-baf675ba2a8d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:07.087445 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1c95a3f6-2f25-4975-badc-baf675ba2a8d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:07.088149 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1c95a3f6-2f25-4975-badc-baf675ba2a8d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:07.088648 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1c95a3f6-2f25-4975-badc-baf675ba2a8d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:07.089100 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1c95a3f6-2f25-4975-badc-baf675ba2a8d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:07.222645 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1c95a3f6-2f25-4975-badc-baf675ba2a8d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:39:07.230440 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1c95a3f6-2f25-4975-badc-baf675ba2a8d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d" status: 200 len: 1519 microversion: 2.1 time: 0.155783 Sep 08 11:39:07.231013 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3525/6917] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:39:07 2022] GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:39:08.255344 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-02d1cc32-953a-4b0a-98a3-95793b4139d7 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:39:08.255980 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-02d1cc32-953a-4b0a-98a3-95793b4139d7 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: 3a858979-cb26-4d08-b5b8-6cf237259c9d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:39:08.262962 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02d1cc32-953a-4b0a-98a3-95793b4139d7 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:08.263468 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02d1cc32-953a-4b0a-98a3-95793b4139d7 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:08.263924 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02d1cc32-953a-4b0a-98a3-95793b4139d7 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:08.264640 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02d1cc32-953a-4b0a-98a3-95793b4139d7 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:08.265143 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02d1cc32-953a-4b0a-98a3-95793b4139d7 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:08.265591 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02d1cc32-953a-4b0a-98a3-95793b4139d7 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:08.401648 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-02d1cc32-953a-4b0a-98a3-95793b4139d7 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:39:08.409492 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-02d1cc32-953a-4b0a-98a3-95793b4139d7 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d" status: 200 len: 1519 microversion: 2.1 time: 0.158826 Sep 08 11:39:08.409931 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3393/6918] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:39:08 2022] GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:39:09.432686 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-94d8a1a0-c479-4487-97ea-7e6297e17d44 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:39:09.433332 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-94d8a1a0-c479-4487-97ea-7e6297e17d44 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: 3a858979-cb26-4d08-b5b8-6cf237259c9d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:39:09.436409 n-d-850501-12 devstack@n-api.service[128861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 11:39:09.436540 n-d-850501-12 devstack@n-api.service[128861]: Thu Sep 8 11:39:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d (ip 10.222.0.27) !!! Sep 08 11:39:09.437520 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:39:09.444628 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-94d8a1a0-c479-4487-97ea-7e6297e17d44 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:09.445144 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-94d8a1a0-c479-4487-97ea-7e6297e17d44 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:09.445586 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-94d8a1a0-c479-4487-97ea-7e6297e17d44 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:09.446287 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-94d8a1a0-c479-4487-97ea-7e6297e17d44 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:09.446743 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-94d8a1a0-c479-4487-97ea-7e6297e17d44 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:09.447173 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-94d8a1a0-c479-4487-97ea-7e6297e17d44 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:09.582763 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-94d8a1a0-c479-4487-97ea-7e6297e17d44 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:39:09.590682 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-94d8a1a0-c479-4487-97ea-7e6297e17d44 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d" status: 200 len: 1519 microversion: 2.1 time: 0.161951 Sep 08 11:39:09.591258 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3526/6919] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:39:09 2022] GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:39:10.614470 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-92221776-5b1b-4081-ae7d-03a550a849ab tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:39:10.615096 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-92221776-5b1b-4081-ae7d-03a550a849ab tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: 3a858979-cb26-4d08-b5b8-6cf237259c9d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:39:10.618734 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:39:10.625330 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-92221776-5b1b-4081-ae7d-03a550a849ab tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:10.625836 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-92221776-5b1b-4081-ae7d-03a550a849ab tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:10.626290 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-92221776-5b1b-4081-ae7d-03a550a849ab tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:10.627007 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-92221776-5b1b-4081-ae7d-03a550a849ab tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:10.627658 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-92221776-5b1b-4081-ae7d-03a550a849ab tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:10.627958 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-92221776-5b1b-4081-ae7d-03a550a849ab tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:10.762731 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-92221776-5b1b-4081-ae7d-03a550a849ab tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:39:10.770724 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-92221776-5b1b-4081-ae7d-03a550a849ab tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d" status: 200 len: 1519 microversion: 2.1 time: 0.160705 Sep 08 11:39:10.771319 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3394/6920] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:39:10 2022] GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:39:11.793629 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5e09a73b-c3bc-4355-ba31-6680217c85eb tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:39:11.794245 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5e09a73b-c3bc-4355-ba31-6680217c85eb tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: 3a858979-cb26-4d08-b5b8-6cf237259c9d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:39:11.801635 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5e09a73b-c3bc-4355-ba31-6680217c85eb tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:11.802125 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5e09a73b-c3bc-4355-ba31-6680217c85eb tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:11.802566 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5e09a73b-c3bc-4355-ba31-6680217c85eb tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:11.803268 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5e09a73b-c3bc-4355-ba31-6680217c85eb tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:11.803727 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5e09a73b-c3bc-4355-ba31-6680217c85eb tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:11.804155 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5e09a73b-c3bc-4355-ba31-6680217c85eb tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:11.938353 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5e09a73b-c3bc-4355-ba31-6680217c85eb tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:39:11.946915 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5e09a73b-c3bc-4355-ba31-6680217c85eb tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d" status: 200 len: 1519 microversion: 2.1 time: 0.157210 Sep 08 11:39:11.947486 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3527/6921] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:39:11 2022] GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:39:12.970199 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-327d0ae6-10c1-4e4f-889a-1cbc1b271899 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:39:12.970821 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-327d0ae6-10c1-4e4f-889a-1cbc1b271899 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: 3a858979-cb26-4d08-b5b8-6cf237259c9d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:39:12.980751 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-327d0ae6-10c1-4e4f-889a-1cbc1b271899 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:12.981296 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-327d0ae6-10c1-4e4f-889a-1cbc1b271899 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:12.981761 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-327d0ae6-10c1-4e4f-889a-1cbc1b271899 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:12.982454 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-327d0ae6-10c1-4e4f-889a-1cbc1b271899 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:12.982919 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-327d0ae6-10c1-4e4f-889a-1cbc1b271899 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:12.983353 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-327d0ae6-10c1-4e4f-889a-1cbc1b271899 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:13.113430 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-327d0ae6-10c1-4e4f-889a-1cbc1b271899 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:39:13.121354 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-327d0ae6-10c1-4e4f-889a-1cbc1b271899 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d" status: 200 len: 1519 microversion: 2.1 time: 0.154951 Sep 08 11:39:13.121933 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3395/6922] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:39:12 2022] GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:39:14.145075 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fad70dc4-8e2f-4389-b889-eae9bad1ddcb tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:39:14.145598 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fad70dc4-8e2f-4389-b889-eae9bad1ddcb tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: 3a858979-cb26-4d08-b5b8-6cf237259c9d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:39:14.152041 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fad70dc4-8e2f-4389-b889-eae9bad1ddcb tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:14.152523 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fad70dc4-8e2f-4389-b889-eae9bad1ddcb tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:14.152957 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fad70dc4-8e2f-4389-b889-eae9bad1ddcb tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:14.153678 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fad70dc4-8e2f-4389-b889-eae9bad1ddcb tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:14.154135 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fad70dc4-8e2f-4389-b889-eae9bad1ddcb tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:14.154560 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fad70dc4-8e2f-4389-b889-eae9bad1ddcb tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:14.290862 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-fad70dc4-8e2f-4389-b889-eae9bad1ddcb tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:39:14.298528 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fad70dc4-8e2f-4389-b889-eae9bad1ddcb tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d" status: 200 len: 1519 microversion: 2.1 time: 0.157821 Sep 08 11:39:14.299106 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3528/6923] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:39:14 2022] GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:39:15.321359 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b27ca939-46c7-4753-ac1f-6f276905344a tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:39:15.321986 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b27ca939-46c7-4753-ac1f-6f276905344a tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: 3a858979-cb26-4d08-b5b8-6cf237259c9d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:39:15.328838 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b27ca939-46c7-4753-ac1f-6f276905344a tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:15.329379 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b27ca939-46c7-4753-ac1f-6f276905344a tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:15.329835 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b27ca939-46c7-4753-ac1f-6f276905344a tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:15.330536 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b27ca939-46c7-4753-ac1f-6f276905344a tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:15.331005 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b27ca939-46c7-4753-ac1f-6f276905344a tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:15.331444 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b27ca939-46c7-4753-ac1f-6f276905344a tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:15.464995 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b27ca939-46c7-4753-ac1f-6f276905344a tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:39:15.473316 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b27ca939-46c7-4753-ac1f-6f276905344a tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d" status: 200 len: 1519 microversion: 2.1 time: 0.155882 Sep 08 11:39:15.473884 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3396/6924] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:39:15 2022] GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:39:16.497210 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fbd6d656-f9b1-43fb-9726-bb0e31d752e7 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:39:16.497850 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fbd6d656-f9b1-43fb-9726-bb0e31d752e7 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: 3a858979-cb26-4d08-b5b8-6cf237259c9d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:39:16.505473 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fbd6d656-f9b1-43fb-9726-bb0e31d752e7 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:16.505955 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fbd6d656-f9b1-43fb-9726-bb0e31d752e7 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:16.506391 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fbd6d656-f9b1-43fb-9726-bb0e31d752e7 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:16.507079 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fbd6d656-f9b1-43fb-9726-bb0e31d752e7 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:16.507531 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fbd6d656-f9b1-43fb-9726-bb0e31d752e7 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:16.507958 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fbd6d656-f9b1-43fb-9726-bb0e31d752e7 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:16.638884 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-fbd6d656-f9b1-43fb-9726-bb0e31d752e7 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:39:16.647110 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fbd6d656-f9b1-43fb-9726-bb0e31d752e7 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d" status: 200 len: 1519 microversion: 2.1 time: 0.153867 Sep 08 11:39:16.647685 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3529/6925] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:39:16 2022] GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:39:17.669838 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-68bf83c1-b548-493c-87bf-6edf9e5ada6f tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:39:17.670468 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-68bf83c1-b548-493c-87bf-6edf9e5ada6f tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: 3a858979-cb26-4d08-b5b8-6cf237259c9d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:39:17.677360 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68bf83c1-b548-493c-87bf-6edf9e5ada6f tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:17.677863 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68bf83c1-b548-493c-87bf-6edf9e5ada6f tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:17.678313 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68bf83c1-b548-493c-87bf-6edf9e5ada6f tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:17.679019 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68bf83c1-b548-493c-87bf-6edf9e5ada6f tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:17.679491 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68bf83c1-b548-493c-87bf-6edf9e5ada6f tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:17.679932 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68bf83c1-b548-493c-87bf-6edf9e5ada6f tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:17.810856 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-68bf83c1-b548-493c-87bf-6edf9e5ada6f tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:39:17.819103 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-68bf83c1-b548-493c-87bf-6edf9e5ada6f tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d" status: 200 len: 1519 microversion: 2.1 time: 0.153335 Sep 08 11:39:17.819673 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3397/6926] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:39:17 2022] GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:39:18.842641 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cc6f5701-29a6-4c77-a44b-68a04b76ea73 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:39:18.843299 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cc6f5701-29a6-4c77-a44b-68a04b76ea73 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: 3a858979-cb26-4d08-b5b8-6cf237259c9d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:39:18.851108 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc6f5701-29a6-4c77-a44b-68a04b76ea73 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:18.851603 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc6f5701-29a6-4c77-a44b-68a04b76ea73 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:18.852049 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc6f5701-29a6-4c77-a44b-68a04b76ea73 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:18.852754 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc6f5701-29a6-4c77-a44b-68a04b76ea73 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:18.853243 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc6f5701-29a6-4c77-a44b-68a04b76ea73 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:18.853687 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc6f5701-29a6-4c77-a44b-68a04b76ea73 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:18.990162 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-cc6f5701-29a6-4c77-a44b-68a04b76ea73 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:39:18.997960 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cc6f5701-29a6-4c77-a44b-68a04b76ea73 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d" status: 200 len: 1519 microversion: 2.1 time: 0.159273 Sep 08 11:39:18.998566 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3530/6927] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:39:18 2022] GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:39:20.021247 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d93d5f61-ff56-4fe1-80d4-90c9b20f3f7d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:39:20.021881 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d93d5f61-ff56-4fe1-80d4-90c9b20f3f7d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: 3a858979-cb26-4d08-b5b8-6cf237259c9d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:39:20.028524 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d93d5f61-ff56-4fe1-80d4-90c9b20f3f7d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:20.029055 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d93d5f61-ff56-4fe1-80d4-90c9b20f3f7d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:20.029503 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d93d5f61-ff56-4fe1-80d4-90c9b20f3f7d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:20.030210 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d93d5f61-ff56-4fe1-80d4-90c9b20f3f7d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:20.030682 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d93d5f61-ff56-4fe1-80d4-90c9b20f3f7d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:20.031121 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d93d5f61-ff56-4fe1-80d4-90c9b20f3f7d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:20.168503 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d93d5f61-ff56-4fe1-80d4-90c9b20f3f7d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:39:20.177046 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d93d5f61-ff56-4fe1-80d4-90c9b20f3f7d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d" status: 200 len: 1519 microversion: 2.1 time: 0.159913 Sep 08 11:39:20.177613 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3398/6928] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:39:20 2022] GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:39:21.199818 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9310225a-efe7-42b1-b506-07d68524e25d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:39:21.200428 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9310225a-efe7-42b1-b506-07d68524e25d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: 3a858979-cb26-4d08-b5b8-6cf237259c9d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:39:21.207369 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9310225a-efe7-42b1-b506-07d68524e25d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:21.207851 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9310225a-efe7-42b1-b506-07d68524e25d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:21.208289 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9310225a-efe7-42b1-b506-07d68524e25d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:21.208977 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9310225a-efe7-42b1-b506-07d68524e25d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:21.209457 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9310225a-efe7-42b1-b506-07d68524e25d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:21.209882 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9310225a-efe7-42b1-b506-07d68524e25d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:21.346643 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9310225a-efe7-42b1-b506-07d68524e25d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:39:21.355155 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9310225a-efe7-42b1-b506-07d68524e25d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d" status: 200 len: 1519 microversion: 2.1 time: 0.159269 Sep 08 11:39:21.355738 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3531/6929] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:39:21 2022] GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:39:22.379693 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-02c1d652-880a-4438-9876-a9aef6d329bb tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:39:22.380326 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-02c1d652-880a-4438-9876-a9aef6d329bb tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: 3a858979-cb26-4d08-b5b8-6cf237259c9d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:39:22.387310 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02c1d652-880a-4438-9876-a9aef6d329bb tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:22.387814 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02c1d652-880a-4438-9876-a9aef6d329bb tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:22.388267 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02c1d652-880a-4438-9876-a9aef6d329bb tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:22.388975 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02c1d652-880a-4438-9876-a9aef6d329bb tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:22.389469 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02c1d652-880a-4438-9876-a9aef6d329bb tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:22.389908 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02c1d652-880a-4438-9876-a9aef6d329bb tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:22.523539 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-02c1d652-880a-4438-9876-a9aef6d329bb tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:39:22.532165 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-02c1d652-880a-4438-9876-a9aef6d329bb tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d" status: 200 len: 1519 microversion: 2.1 time: 0.156656 Sep 08 11:39:22.532757 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3399/6930] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:39:22 2022] GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:39:23.556011 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7cea5d63-8919-4607-8871-a7b200fbc3e7 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:39:23.556647 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7cea5d63-8919-4607-8871-a7b200fbc3e7 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: 3a858979-cb26-4d08-b5b8-6cf237259c9d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:39:23.563494 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7cea5d63-8919-4607-8871-a7b200fbc3e7 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:23.563979 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7cea5d63-8919-4607-8871-a7b200fbc3e7 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:23.564413 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7cea5d63-8919-4607-8871-a7b200fbc3e7 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:23.565129 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7cea5d63-8919-4607-8871-a7b200fbc3e7 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:23.565588 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7cea5d63-8919-4607-8871-a7b200fbc3e7 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:23.566182 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7cea5d63-8919-4607-8871-a7b200fbc3e7 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:23.697214 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7cea5d63-8919-4607-8871-a7b200fbc3e7 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:39:23.704881 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7cea5d63-8919-4607-8871-a7b200fbc3e7 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d" status: 200 len: 1519 microversion: 2.1 time: 0.152828 Sep 08 11:39:23.705491 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3532/6931] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:39:23 2022] GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:39:24.729079 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c68395bb-2d3a-47a8-ad96-76fd224eec4c tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:39:24.729736 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c68395bb-2d3a-47a8-ad96-76fd224eec4c tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: 3a858979-cb26-4d08-b5b8-6cf237259c9d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:39:24.736794 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c68395bb-2d3a-47a8-ad96-76fd224eec4c tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:24.737319 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c68395bb-2d3a-47a8-ad96-76fd224eec4c tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:24.738573 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c68395bb-2d3a-47a8-ad96-76fd224eec4c tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:24.739292 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c68395bb-2d3a-47a8-ad96-76fd224eec4c tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:24.739760 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c68395bb-2d3a-47a8-ad96-76fd224eec4c tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:24.740200 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c68395bb-2d3a-47a8-ad96-76fd224eec4c tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:24.871640 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c68395bb-2d3a-47a8-ad96-76fd224eec4c tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:39:24.879780 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c68395bb-2d3a-47a8-ad96-76fd224eec4c tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d" status: 200 len: 1519 microversion: 2.1 time: 0.154632 Sep 08 11:39:24.880358 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3400/6932] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:39:24 2022] GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:39:25.903152 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-66359518-18a2-4b88-a143-3a6627a4a22a tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:39:25.903777 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-66359518-18a2-4b88-a143-3a6627a4a22a tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: 3a858979-cb26-4d08-b5b8-6cf237259c9d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:39:25.910621 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-66359518-18a2-4b88-a143-3a6627a4a22a tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:25.911101 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-66359518-18a2-4b88-a143-3a6627a4a22a tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:25.911572 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-66359518-18a2-4b88-a143-3a6627a4a22a tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:25.912274 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-66359518-18a2-4b88-a143-3a6627a4a22a tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:25.912758 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-66359518-18a2-4b88-a143-3a6627a4a22a tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:25.913222 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-66359518-18a2-4b88-a143-3a6627a4a22a tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:26.046274 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-66359518-18a2-4b88-a143-3a6627a4a22a tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:39:26.054293 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-66359518-18a2-4b88-a143-3a6627a4a22a tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d" status: 200 len: 1519 microversion: 2.1 time: 0.155061 Sep 08 11:39:26.054880 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3533/6933] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:39:25 2022] GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:39:27.077782 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-702b4693-1ce6-4f71-9d99-83769db40499 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:39:27.078409 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-702b4693-1ce6-4f71-9d99-83769db40499 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: 3a858979-cb26-4d08-b5b8-6cf237259c9d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:39:27.086043 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-702b4693-1ce6-4f71-9d99-83769db40499 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:27.086546 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-702b4693-1ce6-4f71-9d99-83769db40499 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:27.087005 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-702b4693-1ce6-4f71-9d99-83769db40499 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:27.087705 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-702b4693-1ce6-4f71-9d99-83769db40499 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:27.088173 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-702b4693-1ce6-4f71-9d99-83769db40499 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:27.088614 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-702b4693-1ce6-4f71-9d99-83769db40499 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:27.228960 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-702b4693-1ce6-4f71-9d99-83769db40499 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:39:27.237010 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-702b4693-1ce6-4f71-9d99-83769db40499 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d" status: 200 len: 1519 microversion: 2.1 time: 0.163179 Sep 08 11:39:27.237751 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3401/6934] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:39:27 2022] GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:39:28.259902 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0a7bc63b-5f08-40b8-8b7b-edbcd3b471c4 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:39:28.260569 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0a7bc63b-5f08-40b8-8b7b-edbcd3b471c4 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: 3a858979-cb26-4d08-b5b8-6cf237259c9d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:39:28.267428 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0a7bc63b-5f08-40b8-8b7b-edbcd3b471c4 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:28.267908 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0a7bc63b-5f08-40b8-8b7b-edbcd3b471c4 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:28.268341 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0a7bc63b-5f08-40b8-8b7b-edbcd3b471c4 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:28.269356 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0a7bc63b-5f08-40b8-8b7b-edbcd3b471c4 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:28.269847 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0a7bc63b-5f08-40b8-8b7b-edbcd3b471c4 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:28.270271 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0a7bc63b-5f08-40b8-8b7b-edbcd3b471c4 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:28.274278 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:39:28.411335 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0a7bc63b-5f08-40b8-8b7b-edbcd3b471c4 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:39:28.420668 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0a7bc63b-5f08-40b8-8b7b-edbcd3b471c4 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d" status: 200 len: 1519 microversion: 2.1 time: 0.164744 Sep 08 11:39:28.421472 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3534/6935] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:39:28 2022] GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:39:29.445444 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-21e068c6-ef09-44b5-9426-bd50f807eddb tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:39:29.446078 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-21e068c6-ef09-44b5-9426-bd50f807eddb tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: 3a858979-cb26-4d08-b5b8-6cf237259c9d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:39:29.452615 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-21e068c6-ef09-44b5-9426-bd50f807eddb tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:29.453171 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-21e068c6-ef09-44b5-9426-bd50f807eddb tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:29.453629 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-21e068c6-ef09-44b5-9426-bd50f807eddb tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:29.454345 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-21e068c6-ef09-44b5-9426-bd50f807eddb tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:29.454818 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-21e068c6-ef09-44b5-9426-bd50f807eddb tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:29.455261 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-21e068c6-ef09-44b5-9426-bd50f807eddb tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:29.590551 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-21e068c6-ef09-44b5-9426-bd50f807eddb tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:39:29.599641 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-21e068c6-ef09-44b5-9426-bd50f807eddb tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d" status: 200 len: 1519 microversion: 2.1 time: 0.158312 Sep 08 11:39:29.600241 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3402/6936] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:39:29 2022] GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:39:30.615063 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-d4110453-fee0-40f5-9e1f-64c28bd9623e req-7b4ca77f-60dc-49e6-87f9-cedc78e6f608 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a858979-cb26-4d08-b5b8-6cf237259c9d", "name": "network-vif-unplugged", "status": "completed", "tag": "bcd1646d-79cc-4579-b63e-7b5b432207a7"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:39:30.624489 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a607dd4b-d555-4ebd-8444-569dd87bd4c6 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:39:30.625150 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a607dd4b-d555-4ebd-8444-569dd87bd4c6 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: 3a858979-cb26-4d08-b5b8-6cf237259c9d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:39:30.635558 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a607dd4b-d555-4ebd-8444-569dd87bd4c6 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:30.635971 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-d4110453-fee0-40f5-9e1f-64c28bd9623e req-7b4ca77f-60dc-49e6-87f9-cedc78e6f608 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:30.636125 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a607dd4b-d555-4ebd-8444-569dd87bd4c6 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:30.636520 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a607dd4b-d555-4ebd-8444-569dd87bd4c6 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:30.636632 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-d4110453-fee0-40f5-9e1f-64c28bd9623e req-7b4ca77f-60dc-49e6-87f9-cedc78e6f608 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:30.637572 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-d4110453-fee0-40f5-9e1f-64c28bd9623e req-7b4ca77f-60dc-49e6-87f9-cedc78e6f608 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:30.637699 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a607dd4b-d555-4ebd-8444-569dd87bd4c6 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:30.637783 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a607dd4b-d555-4ebd-8444-569dd87bd4c6 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:30.638163 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a607dd4b-d555-4ebd-8444-569dd87bd4c6 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:30.650275 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-d4110453-fee0-40f5-9e1f-64c28bd9623e req-7b4ca77f-60dc-49e6-87f9-cedc78e6f608 service nova] Creating event network-vif-unplugged:bcd1646d-79cc-4579-b63e-7b5b432207a7 for instance 3a858979-cb26-4d08-b5b8-6cf237259c9d on n-h1-850501-12 Sep 08 11:39:30.656221 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [req-d4110453-fee0-40f5-9e1f-64c28bd9623e req-7b4ca77f-60dc-49e6-87f9-cedc78e6f608 service nova] Instance 3a858979-cb26-4d08-b5b8-6cf237259c9d is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850501-12', 'n-h1-850501-12'} {{(pid=128861) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 11:39:30.667568 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-d4110453-fee0-40f5-9e1f-64c28bd9623e req-7b4ca77f-60dc-49e6-87f9-cedc78e6f608 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057369 Sep 08 11:39:30.668545 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3535/6937] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:39:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:39:30.777578 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a607dd4b-d555-4ebd-8444-569dd87bd4c6 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:39:30.786131 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a607dd4b-d555-4ebd-8444-569dd87bd4c6 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d" status: 200 len: 1518 microversion: 2.1 time: 0.165455 Sep 08 11:39:30.786715 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3403/6938] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:39:30 2022] GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d => generated 1518 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:39:31.810857 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-eb2c607f-7d0c-4e1c-b540-8520ed8cd489 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:39:31.811570 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-eb2c607f-7d0c-4e1c-b540-8520ed8cd489 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: 3a858979-cb26-4d08-b5b8-6cf237259c9d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:39:31.818666 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eb2c607f-7d0c-4e1c-b540-8520ed8cd489 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:31.819157 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eb2c607f-7d0c-4e1c-b540-8520ed8cd489 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:31.819597 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eb2c607f-7d0c-4e1c-b540-8520ed8cd489 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:31.820308 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eb2c607f-7d0c-4e1c-b540-8520ed8cd489 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:31.820767 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eb2c607f-7d0c-4e1c-b540-8520ed8cd489 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:31.821235 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eb2c607f-7d0c-4e1c-b540-8520ed8cd489 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:31.968243 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-eb2c607f-7d0c-4e1c-b540-8520ed8cd489 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:39:31.976357 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-eb2c607f-7d0c-4e1c-b540-8520ed8cd489 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d" status: 200 len: 1516 microversion: 2.1 time: 0.170679 Sep 08 11:39:31.976946 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3536/6939] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:39:31 2022] GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d => generated 1516 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:39:32.683076 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-fb0eda1d-c12a-449e-9a8c-03205e7c6247 req-901120ba-445c-4b72-a9ea-a338ff0e8924 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a858979-cb26-4d08-b5b8-6cf237259c9d", "tag": "bcd1646d-79cc-4579-b63e-7b5b432207a7"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:39:32.693895 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-fb0eda1d-c12a-449e-9a8c-03205e7c6247 req-901120ba-445c-4b72-a9ea-a338ff0e8924 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:32.694402 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-fb0eda1d-c12a-449e-9a8c-03205e7c6247 req-901120ba-445c-4b72-a9ea-a338ff0e8924 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:32.694850 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-fb0eda1d-c12a-449e-9a8c-03205e7c6247 req-901120ba-445c-4b72-a9ea-a338ff0e8924 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:32.709391 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-fb0eda1d-c12a-449e-9a8c-03205e7c6247 req-901120ba-445c-4b72-a9ea-a338ff0e8924 service nova] Creating event network-changed:bcd1646d-79cc-4579-b63e-7b5b432207a7 for instance 3a858979-cb26-4d08-b5b8-6cf237259c9d on n-h1-850501-12 Sep 08 11:39:32.715192 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [req-fb0eda1d-c12a-449e-9a8c-03205e7c6247 req-901120ba-445c-4b72-a9ea-a338ff0e8924 service nova] Instance 3a858979-cb26-4d08-b5b8-6cf237259c9d is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850501-12', 'n-h1-850501-12'} {{(pid=128862) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 11:39:32.726818 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-fb0eda1d-c12a-449e-9a8c-03205e7c6247 req-901120ba-445c-4b72-a9ea-a338ff0e8924 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047475 Sep 08 11:39:32.727453 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3404/6940] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:39:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:39:33.001666 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a8369a88-d401-4831-8c59-3f0fa9d01537 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:39:33.002962 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a8369a88-d401-4831-8c59-3f0fa9d01537 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: 3a858979-cb26-4d08-b5b8-6cf237259c9d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:39:33.010802 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a8369a88-d401-4831-8c59-3f0fa9d01537 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:33.011332 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a8369a88-d401-4831-8c59-3f0fa9d01537 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:33.011776 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a8369a88-d401-4831-8c59-3f0fa9d01537 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:33.012665 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a8369a88-d401-4831-8c59-3f0fa9d01537 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:33.013307 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a8369a88-d401-4831-8c59-3f0fa9d01537 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:33.013970 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a8369a88-d401-4831-8c59-3f0fa9d01537 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:33.249722 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a8369a88-d401-4831-8c59-3f0fa9d01537 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:39:33.257814 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a8369a88-d401-4831-8c59-3f0fa9d01537 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d" status: 200 len: 1513 microversion: 2.1 time: 0.260127 Sep 08 11:39:33.273053 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3537/6941] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:39:32 2022] GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d => generated 1513 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:39:33.283010 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6896e4c5-ffde-4820-978a-86b61ba2816a tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:39:33.283846 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6896e4c5-ffde-4820-978a-86b61ba2816a tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: 3a858979-cb26-4d08-b5b8-6cf237259c9d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:39:33.292154 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6896e4c5-ffde-4820-978a-86b61ba2816a tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:33.292673 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6896e4c5-ffde-4820-978a-86b61ba2816a tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:33.293162 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6896e4c5-ffde-4820-978a-86b61ba2816a tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:33.294021 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6896e4c5-ffde-4820-978a-86b61ba2816a tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:33.294499 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6896e4c5-ffde-4820-978a-86b61ba2816a tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:33.294941 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6896e4c5-ffde-4820-978a-86b61ba2816a tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:33.364314 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6896e4c5-ffde-4820-978a-86b61ba2816a tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "POST /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d/action" status: 204 len: 0 microversion: 2.1 time: 0.085129 Sep 08 11:39:33.365269 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3405/6942] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 11:39:33 2022] POST /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d/action => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:39:33.375696 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-90ff1e29-f5c9-4dba-9bf1-5a24d4fbfc83 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:39:33.377065 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-90ff1e29-f5c9-4dba-9bf1-5a24d4fbfc83 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: 3a858979-cb26-4d08-b5b8-6cf237259c9d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:39:33.386128 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90ff1e29-f5c9-4dba-9bf1-5a24d4fbfc83 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:33.387073 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90ff1e29-f5c9-4dba-9bf1-5a24d4fbfc83 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:33.387798 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90ff1e29-f5c9-4dba-9bf1-5a24d4fbfc83 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:33.389165 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90ff1e29-f5c9-4dba-9bf1-5a24d4fbfc83 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:33.390103 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90ff1e29-f5c9-4dba-9bf1-5a24d4fbfc83 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:33.390795 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90ff1e29-f5c9-4dba-9bf1-5a24d4fbfc83 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:33.583535 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-90ff1e29-f5c9-4dba-9bf1-5a24d4fbfc83 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:39:33.591826 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-90ff1e29-f5c9-4dba-9bf1-5a24d4fbfc83 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d" status: 200 len: 1513 microversion: 2.1 time: 0.221352 Sep 08 11:39:33.592411 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3538/6943] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:39:33 2022] GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d => generated 1513 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:39:34.620281 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-aa5e0841-3f57-4940-ba8d-89ea766cb411 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:39:34.621016 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-aa5e0841-3f57-4940-ba8d-89ea766cb411 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: 3a858979-cb26-4d08-b5b8-6cf237259c9d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:39:34.628624 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa5e0841-3f57-4940-ba8d-89ea766cb411 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:34.629210 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa5e0841-3f57-4940-ba8d-89ea766cb411 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:34.630098 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa5e0841-3f57-4940-ba8d-89ea766cb411 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:34.631100 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa5e0841-3f57-4940-ba8d-89ea766cb411 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:34.631620 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa5e0841-3f57-4940-ba8d-89ea766cb411 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:34.632085 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa5e0841-3f57-4940-ba8d-89ea766cb411 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:34.816300 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-aa5e0841-3f57-4940-ba8d-89ea766cb411 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:39:34.826187 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-aa5e0841-3f57-4940-ba8d-89ea766cb411 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d" status: 200 len: 1505 microversion: 2.1 time: 0.213790 Sep 08 11:39:34.826780 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3406/6944] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:39:34 2022] GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d => generated 1505 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:39:34.850856 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9ea65f61-1218-417d-88de-5dd379a97ac2 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:39:34.851598 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9ea65f61-1218-417d-88de-5dd379a97ac2 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: 3a858979-cb26-4d08-b5b8-6cf237259c9d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:39:34.859710 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ea65f61-1218-417d-88de-5dd379a97ac2 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:34.860365 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ea65f61-1218-417d-88de-5dd379a97ac2 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:34.861034 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ea65f61-1218-417d-88de-5dd379a97ac2 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:34.862056 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ea65f61-1218-417d-88de-5dd379a97ac2 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:34.864761 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ea65f61-1218-417d-88de-5dd379a97ac2 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:34.865283 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ea65f61-1218-417d-88de-5dd379a97ac2 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:35.280489 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9ea65f61-1218-417d-88de-5dd379a97ac2 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:39:35.289215 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9ea65f61-1218-417d-88de-5dd379a97ac2 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d" status: 200 len: 1505 microversion: 2.1 time: 0.443060 Sep 08 11:39:35.289803 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3539/6945] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:39:34 2022] GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d => generated 1505 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:39:35.311179 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4aaf140c-eb89-41d3-b339-d27bfc616c52 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:39:35.311812 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4aaf140c-eb89-41d3-b339-d27bfc616c52 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: 3a858979-cb26-4d08-b5b8-6cf237259c9d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:39:35.318518 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4aaf140c-eb89-41d3-b339-d27bfc616c52 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:35.319258 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4aaf140c-eb89-41d3-b339-d27bfc616c52 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:35.319531 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4aaf140c-eb89-41d3-b339-d27bfc616c52 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:35.320178 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4aaf140c-eb89-41d3-b339-d27bfc616c52 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:35.320651 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4aaf140c-eb89-41d3-b339-d27bfc616c52 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:35.321131 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4aaf140c-eb89-41d3-b339-d27bfc616c52 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:35.455017 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4aaf140c-eb89-41d3-b339-d27bfc616c52 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:39:35.459259 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:39:35.464639 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4aaf140c-eb89-41d3-b339-d27bfc616c52 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d" status: 200 len: 1505 microversion: 2.1 time: 0.157346 Sep 08 11:39:35.465253 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3407/6946] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:39:35 2022] GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:39:35.486587 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1c8c1c04-8eed-4753-b5fc-d8c7d624e617 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:39:35.487023 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1c8c1c04-8eed-4753-b5fc-d8c7d624e617 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: 3a858979-cb26-4d08-b5b8-6cf237259c9d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:39:35.493439 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1c8c1c04-8eed-4753-b5fc-d8c7d624e617 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:35.493930 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1c8c1c04-8eed-4753-b5fc-d8c7d624e617 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:35.494365 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1c8c1c04-8eed-4753-b5fc-d8c7d624e617 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:35.495065 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1c8c1c04-8eed-4753-b5fc-d8c7d624e617 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:35.495521 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1c8c1c04-8eed-4753-b5fc-d8c7d624e617 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:35.495949 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1c8c1c04-8eed-4753-b5fc-d8c7d624e617 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:35.522075 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1c8c1c04-8eed-4753-b5fc-d8c7d624e617 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: 3a858979-cb26-4d08-b5b8-6cf237259c9d] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:39:35.597844 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1c8c1c04-8eed-4753-b5fc-d8c7d624e617 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d" status: 204 len: 0 microversion: 2.1 time: 0.114872 Sep 08 11:39:35.598448 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3540/6947] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:39:35 2022] DELETE /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:39:35.618993 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-39a852bc-b752-4b94-b4c3-bd6c9fa3cb05 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:39:35.619523 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-39a852bc-b752-4b94-b4c3-bd6c9fa3cb05 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: 3a858979-cb26-4d08-b5b8-6cf237259c9d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:39:35.629570 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-39a852bc-b752-4b94-b4c3-bd6c9fa3cb05 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:35.630870 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-39a852bc-b752-4b94-b4c3-bd6c9fa3cb05 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:35.630870 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-39a852bc-b752-4b94-b4c3-bd6c9fa3cb05 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:35.631272 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-39a852bc-b752-4b94-b4c3-bd6c9fa3cb05 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:35.631751 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-39a852bc-b752-4b94-b4c3-bd6c9fa3cb05 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:35.632245 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-39a852bc-b752-4b94-b4c3-bd6c9fa3cb05 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:35.660517 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-39a852bc-b752-4b94-b4c3-bd6c9fa3cb05 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: 3a858979-cb26-4d08-b5b8-6cf237259c9d] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:39:35.707173 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.compute.api [None req-39a852bc-b752-4b94-b4c3-bd6c9fa3cb05 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: 3a858979-cb26-4d08-b5b8-6cf237259c9d] Instance is already in deleting state, ignoring this request Sep 08 11:39:35.708034 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-39a852bc-b752-4b94-b4c3-bd6c9fa3cb05 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d" status: 204 len: 0 microversion: 2.1 time: 0.096690 Sep 08 11:39:35.708630 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3408/6948] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:39:35 2022] DELETE /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d => generated 0 bytes in 98 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:39:35.717516 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bab24c85-0973-483d-8fe2-96f6fb8ae451 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:39:35.718294 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bab24c85-0973-483d-8fe2-96f6fb8ae451 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: 3a858979-cb26-4d08-b5b8-6cf237259c9d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:39:35.724688 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bab24c85-0973-483d-8fe2-96f6fb8ae451 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:35.725290 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bab24c85-0973-483d-8fe2-96f6fb8ae451 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:35.725776 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bab24c85-0973-483d-8fe2-96f6fb8ae451 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:35.726943 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bab24c85-0973-483d-8fe2-96f6fb8ae451 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:35.727086 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bab24c85-0973-483d-8fe2-96f6fb8ae451 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:35.727623 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bab24c85-0973-483d-8fe2-96f6fb8ae451 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:35.870212 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-bab24c85-0973-483d-8fe2-96f6fb8ae451 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:39:35.878189 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bab24c85-0973-483d-8fe2-96f6fb8ae451 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d" status: 200 len: 1511 microversion: 2.1 time: 0.165030 Sep 08 11:39:35.878840 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3541/6949] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:39:35 2022] GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d => generated 1511 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:39:36.553918 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-3b497505-1fe3-4495-aa36-bd2c4573861e req-54edc3f1-c0d7-4024-ae78-c0d2782b1c85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a858979-cb26-4d08-b5b8-6cf237259c9d", "name": "network-vif-plugged", "status": "completed", "tag": "bcd1646d-79cc-4579-b63e-7b5b432207a7"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:39:36.563912 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-3b497505-1fe3-4495-aa36-bd2c4573861e req-54edc3f1-c0d7-4024-ae78-c0d2782b1c85 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:36.564434 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-3b497505-1fe3-4495-aa36-bd2c4573861e req-54edc3f1-c0d7-4024-ae78-c0d2782b1c85 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:36.564933 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-3b497505-1fe3-4495-aa36-bd2c4573861e req-54edc3f1-c0d7-4024-ae78-c0d2782b1c85 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:36.581385 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-3b497505-1fe3-4495-aa36-bd2c4573861e req-54edc3f1-c0d7-4024-ae78-c0d2782b1c85 service nova] Creating event network-vif-plugged:bcd1646d-79cc-4579-b63e-7b5b432207a7 for instance 3a858979-cb26-4d08-b5b8-6cf237259c9d on n-h1-850501-12 Sep 08 11:39:36.586768 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-3b497505-1fe3-4495-aa36-bd2c4573861e req-54edc3f1-c0d7-4024-ae78-c0d2782b1c85 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037930 Sep 08 11:39:36.587698 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3409/6950] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:39:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:39:36.902301 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2844c3e7-1745-4458-a2b2-446e51f1240d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:39:36.902920 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2844c3e7-1745-4458-a2b2-446e51f1240d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: 3a858979-cb26-4d08-b5b8-6cf237259c9d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:39:36.909904 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2844c3e7-1745-4458-a2b2-446e51f1240d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:36.910395 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2844c3e7-1745-4458-a2b2-446e51f1240d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:36.910835 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2844c3e7-1745-4458-a2b2-446e51f1240d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:36.911567 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2844c3e7-1745-4458-a2b2-446e51f1240d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:36.912028 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2844c3e7-1745-4458-a2b2-446e51f1240d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:36.912498 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2844c3e7-1745-4458-a2b2-446e51f1240d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:37.130226 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2844c3e7-1745-4458-a2b2-446e51f1240d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c855c2a5a47e4b0fe9815d30697b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0689a134e68a415c9e51179bdf0263ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:39:37.137967 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2844c3e7-1745-4458-a2b2-446e51f1240d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d" status: 200 len: 1511 microversion: 2.1 time: 0.239563 Sep 08 11:39:37.138549 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3542/6951] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:39:36 2022] GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d => generated 1511 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:39:37.480402 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-f8c22471-4846-4d58-84e1-388e4eee5894 req-fd9490a8-c8ce-418e-b1de-8323c418a322 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a858979-cb26-4d08-b5b8-6cf237259c9d", "name": "network-vif-deleted", "tag": "bcd1646d-79cc-4579-b63e-7b5b432207a7"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:39:37.495531 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-f8c22471-4846-4d58-84e1-388e4eee5894 req-fd9490a8-c8ce-418e-b1de-8323c418a322 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:37.496042 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-f8c22471-4846-4d58-84e1-388e4eee5894 req-fd9490a8-c8ce-418e-b1de-8323c418a322 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:37.496498 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-f8c22471-4846-4d58-84e1-388e4eee5894 req-fd9490a8-c8ce-418e-b1de-8323c418a322 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:37.510354 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-f8c22471-4846-4d58-84e1-388e4eee5894 req-fd9490a8-c8ce-418e-b1de-8323c418a322 service nova] Creating event network-vif-deleted:bcd1646d-79cc-4579-b63e-7b5b432207a7 for instance 3a858979-cb26-4d08-b5b8-6cf237259c9d on n-h1-850501-12 Sep 08 11:39:37.515623 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-f8c22471-4846-4d58-84e1-388e4eee5894 req-fd9490a8-c8ce-418e-b1de-8323c418a322 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041087 Sep 08 11:39:37.516568 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3410/6952] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:39:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:39:38.163193 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1b62b180-8d9a-4f0c-a6eb-2589d02f44e5 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:39:38.163980 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1b62b180-8d9a-4f0c-a6eb-2589d02f44e5 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: 3a858979-cb26-4d08-b5b8-6cf237259c9d] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:39:38.171660 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1b62b180-8d9a-4f0c-a6eb-2589d02f44e5 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:38.172149 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1b62b180-8d9a-4f0c-a6eb-2589d02f44e5 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:38.172589 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1b62b180-8d9a-4f0c-a6eb-2589d02f44e5 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:38.173354 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1b62b180-8d9a-4f0c-a6eb-2589d02f44e5 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:38.173814 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1b62b180-8d9a-4f0c-a6eb-2589d02f44e5 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:38.174278 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1b62b180-8d9a-4f0c-a6eb-2589d02f44e5 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:38.190377 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-1b62b180-8d9a-4f0c-a6eb-2589d02f44e5 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] HTTP exception thrown: Instance 3a858979-cb26-4d08-b5b8-6cf237259c9d could not be found. Sep 08 11:39:38.192187 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1b62b180-8d9a-4f0c-a6eb-2589d02f44e5 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Request method failure captured: Sep 08 11:39:38.192187 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d HTTP/1.1 Sep 08 11:39:38.192187 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:39:38.192187 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:39:38.192187 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:39:38.192187 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 11:39:38.192187 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:39:38.192187 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:39:38.192187 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:39:38.192187 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:39:38.192187 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGdQVqLQheb33h3fSmgJmUkOECZMa_ySuZVCdUA1-fnRyt9gx9f9CjxdjsAHm23M2DOb5HMyP1IHZS3SBrnczw7e3sK-nmiDAc9-NdIhZd3CWEve1J2itrbuSvMqEMtXxxd_WymgUe02_c2C8XJHVzhkYzRSuu12ZSg0igynCN-Wgcpw Sep 08 11:39:38.192187 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:39:38.192187 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:39:38.192187 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:39:38.192187 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:39:38.192187 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:39:38.192187 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:39:38.192187 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 0689a134e68a415c9e51179bdf0263ae Sep 08 11:39:38.192187 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServerDiskConfigTestJSON-580738008 Sep 08 11:39:38.192187 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:39:38.192187 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:39:38.192187 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0689a134e68a415c9e51179bdf0263ae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0689a134e68a415c9e51179bdf0263ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0689a134e68a415c9e51179bdf0263ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0689a134e68a415c9e51179bdf0263ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:39:38.192187 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServerDiskConfigTestJSON-580738008 Sep 08 11:39:38.192187 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 0689a134e68a415c9e51179bdf0263ae Sep 08 11:39:38.192187 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-580738008 Sep 08 11:39:38.192187 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServerDiskConfigTestJSON-580738008-project Sep 08 11:39:38.192187 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:39:38.192187 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:39:38.192187 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 4d4c855c2a5a47e4b0fe9815d30697b3 Sep 08 11:39:38.192187 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServerDiskConfigTestJSON-580738008-project Sep 08 11:39:38.192187 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 11:39:38.192187 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 3a858979-cb26-4d08-b5b8-6cf237259c9d could not be found. Sep 08 11:39:38.192187 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '3a858979-cb26-4d08-b5b8-6cf237259c9d'} Sep 08 11:39:38.192187 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:39:38.192187 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:39:38.192187 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:39:38.192187 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:39:38.192187 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:39:38.192187 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:39:38.192187 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:39:38.192187 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:39:38.192187 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:39:38.192187 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:39:38.192187 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a858979-cb26-4d08-b5b8-6cf237259c9d could not be found. Sep 08 11:39:38.192187 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:39:38.192187 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:39:38.192187 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:39:38.192187 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:39:38.192187 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:39:38.192187 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:39:38.192187 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:39:38.192187 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:39:38.192187 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:39:38.192187 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:39:38.192187 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:39:38.192187 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:39:38.192187 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:39:38.192187 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:39:38.192187 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:39:38.192187 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:39:38.192187 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a858979-cb26-4d08-b5b8-6cf237259c9d could not be found. Sep 08 11:39:38.192187 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:39:38.192187 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:39:38.192187 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:39:38.196531 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:39:38.196531 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:39:38.196531 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:39:38.196531 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:39:38.196531 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:39:38.196531 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a858979-cb26-4d08-b5b8-6cf237259c9d could not be found. Sep 08 11:39:38.196531 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:39:38.196531 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1b62b180-8d9a-4f0c-a6eb-2589d02f44e5 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Returning 404 to user: Instance 3a858979-cb26-4d08-b5b8-6cf237259c9d could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:39:38.196531 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1b62b180-8d9a-4f0c-a6eb-2589d02f44e5 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d" status: 404 len: 111 microversion: 2.1 time: 0.035263 Sep 08 11:39:38.196531 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3543/6953] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:39:38 2022] GET /compute/v2.1/servers/3a858979-cb26-4d08-b5b8-6cf237259c9d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:39:38.203037 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5193baf3-c5e7-4f15-b82b-8071d4f96e56 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '.version_select at 0x7f68df703820>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:39:38.225218 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5193baf3-c5e7-4f15-b82b-8071d4f96e56 tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1041629780" status: 202 len: 0 microversion: 2.1 time: 0.026281 Sep 08 11:39:38.225807 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3411/6954] 10.222.0.27 () {58 vars in 1221 bytes} [Thu Sep 8 11:39:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1041629780 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:39:38.838485 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6adc11a8-3b1b-41a2-8b5a-eddd5649f10f tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:39:38.838981 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6adc11a8-3b1b-41a2-8b5a-eddd5649f10f tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: e2589778-4bad-49f3-a3fa-5c3351c6568e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:39:38.844968 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6adc11a8-3b1b-41a2-8b5a-eddd5649f10f tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:38.845398 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6adc11a8-3b1b-41a2-8b5a-eddd5649f10f tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:38.845828 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6adc11a8-3b1b-41a2-8b5a-eddd5649f10f tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:38.846510 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6adc11a8-3b1b-41a2-8b5a-eddd5649f10f tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:38.847051 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6adc11a8-3b1b-41a2-8b5a-eddd5649f10f tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:38.847631 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6adc11a8-3b1b-41a2-8b5a-eddd5649f10f tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:38.861001 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-6adc11a8-3b1b-41a2-8b5a-eddd5649f10f tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] HTTP exception thrown: Instance e2589778-4bad-49f3-a3fa-5c3351c6568e could not be found. Sep 08 11:39:38.863441 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6adc11a8-3b1b-41a2-8b5a-eddd5649f10f tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Request method failure captured: Sep 08 11:39:38.863441 n-d-850501-12 devstack@n-api.service[128861]: request: DELETE /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e HTTP/1.1 Sep 08 11:39:38.863441 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:39:38.863441 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:39:38.863441 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:39:38.863441 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 11:39:38.863441 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:39:38.863441 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:39:38.863441 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:39:38.863441 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:39:38.863441 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGdQVqLQheb33h3fSmgJmUkOECZMa_ySuZVCdUA1-fnRyt9gx9f9CjxdjsAHm23M2DOb5HMyP1IHZS3SBrnczw7e3sK-nmiDAc9-NdIhZd3CWEve1J2itrbuSvMqEMtXxxd_WymgUe02_c2C8XJHVzhkYzRSuu12ZSg0igynCN-Wgcpw Sep 08 11:39:38.863441 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:39:38.863441 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:39:38.863441 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:39:38.863441 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:39:38.863441 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:39:38.863441 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:39:38.863441 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 0689a134e68a415c9e51179bdf0263ae Sep 08 11:39:38.863441 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServerDiskConfigTestJSON-580738008 Sep 08 11:39:38.863441 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:39:38.863441 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:39:38.863441 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0689a134e68a415c9e51179bdf0263ae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0689a134e68a415c9e51179bdf0263ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0689a134e68a415c9e51179bdf0263ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0689a134e68a415c9e51179bdf0263ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:39:38.863441 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServerDiskConfigTestJSON-580738008 Sep 08 11:39:38.863441 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 0689a134e68a415c9e51179bdf0263ae Sep 08 11:39:38.863441 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-580738008 Sep 08 11:39:38.863441 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServerDiskConfigTestJSON-580738008-project Sep 08 11:39:38.863441 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:39:38.863441 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:39:38.863441 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 4d4c855c2a5a47e4b0fe9815d30697b3 Sep 08 11:39:38.863441 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServerDiskConfigTestJSON-580738008-project Sep 08 11:39:38.863441 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 11:39:38.863441 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance e2589778-4bad-49f3-a3fa-5c3351c6568e could not be found. Sep 08 11:39:38.863441 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': 'e2589778-4bad-49f3-a3fa-5c3351c6568e'} Sep 08 11:39:38.863441 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:39:38.863441 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:39:38.863441 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:39:38.863441 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:39:38.863441 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:39:38.863441 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:39:38.863441 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:39:38.863441 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:39:38.863441 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:39:38.863441 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:39:38.863441 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2589778-4bad-49f3-a3fa-5c3351c6568e could not be found. Sep 08 11:39:38.863441 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:39:38.863441 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:39:38.863441 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:39:38.863441 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:39:38.863441 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:39:38.863441 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:39:38.863441 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:39:38.863441 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:39:38.863441 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:39:38.863441 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:39:38.863441 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 11:39:38.863441 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 11:39:38.863441 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 11:39:38.863441 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 11:39:38.863441 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:39:38.863441 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:39:38.863441 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:39:38.863441 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:39:38.867648 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2589778-4bad-49f3-a3fa-5c3351c6568e could not be found. Sep 08 11:39:38.867648 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:39:38.867648 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:39:38.867648 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:39:38.867648 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:39:38.867648 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:39:38.867648 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:39:38.867648 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:39:38.867648 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:39:38.867648 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2589778-4bad-49f3-a3fa-5c3351c6568e could not be found. Sep 08 11:39:38.867648 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:39:38.867648 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6adc11a8-3b1b-41a2-8b5a-eddd5649f10f tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Returning 404 to user: Instance e2589778-4bad-49f3-a3fa-5c3351c6568e could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:39:38.867648 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6adc11a8-3b1b-41a2-8b5a-eddd5649f10f tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e" status: 404 len: 111 microversion: 2.1 time: 0.030416 Sep 08 11:39:38.867648 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3544/6955] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:39:38 2022] DELETE /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:39:38.874384 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-eb8b1705-8d50-4e4f-ad41-5b1db6233b2d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:39:38.875131 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-eb8b1705-8d50-4e4f-ad41-5b1db6233b2d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] [instance: e2589778-4bad-49f3-a3fa-5c3351c6568e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:39:38.883046 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb8b1705-8d50-4e4f-ad41-5b1db6233b2d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:38.883560 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb8b1705-8d50-4e4f-ad41-5b1db6233b2d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:38.884009 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb8b1705-8d50-4e4f-ad41-5b1db6233b2d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:38.884717 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb8b1705-8d50-4e4f-ad41-5b1db6233b2d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:38.885237 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb8b1705-8d50-4e4f-ad41-5b1db6233b2d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:38.885686 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb8b1705-8d50-4e4f-ad41-5b1db6233b2d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:38.899640 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-eb8b1705-8d50-4e4f-ad41-5b1db6233b2d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] HTTP exception thrown: Instance e2589778-4bad-49f3-a3fa-5c3351c6568e could not be found. Sep 08 11:39:38.901337 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-eb8b1705-8d50-4e4f-ad41-5b1db6233b2d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Request method failure captured: Sep 08 11:39:38.901337 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e HTTP/1.1 Sep 08 11:39:38.901337 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 11:39:38.901337 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 11:39:38.901337 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 11:39:38.901337 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 11:39:38.901337 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 11:39:38.901337 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 11:39:38.901337 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 11:39:38.901337 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 11:39:38.901337 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGdQVqLQheb33h3fSmgJmUkOECZMa_ySuZVCdUA1-fnRyt9gx9f9CjxdjsAHm23M2DOb5HMyP1IHZS3SBrnczw7e3sK-nmiDAc9-NdIhZd3CWEve1J2itrbuSvMqEMtXxxd_WymgUe02_c2C8XJHVzhkYzRSuu12ZSg0igynCN-Wgcpw Sep 08 11:39:38.901337 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 11:39:38.901337 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 11:39:38.901337 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 11:39:38.901337 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 11:39:38.901337 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 11:39:38.901337 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 11:39:38.901337 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 0689a134e68a415c9e51179bdf0263ae Sep 08 11:39:38.901337 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServerDiskConfigTestJSON-580738008 Sep 08 11:39:38.901337 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 11:39:38.901337 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 11:39:38.901337 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0689a134e68a415c9e51179bdf0263ae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0689a134e68a415c9e51179bdf0263ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0689a134e68a415c9e51179bdf0263ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0689a134e68a415c9e51179bdf0263ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:39:38.901337 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServerDiskConfigTestJSON-580738008 Sep 08 11:39:38.901337 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 0689a134e68a415c9e51179bdf0263ae Sep 08 11:39:38.901337 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-580738008 Sep 08 11:39:38.901337 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServerDiskConfigTestJSON-580738008-project Sep 08 11:39:38.901337 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 11:39:38.901337 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 11:39:38.901337 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 4d4c855c2a5a47e4b0fe9815d30697b3 Sep 08 11:39:38.901337 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServerDiskConfigTestJSON-580738008-project Sep 08 11:39:38.901337 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 11:39:38.901337 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance e2589778-4bad-49f3-a3fa-5c3351c6568e could not be found. Sep 08 11:39:38.901337 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'e2589778-4bad-49f3-a3fa-5c3351c6568e'} Sep 08 11:39:38.901337 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:39:38.901337 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:39:38.901337 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:39:38.901337 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:39:38.901337 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:39:38.901337 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:39:38.901337 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:39:38.901337 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:39:38.901337 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:39:38.901337 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:39:38.901337 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2589778-4bad-49f3-a3fa-5c3351c6568e could not be found. Sep 08 11:39:38.901337 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:39:38.901337 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:39:38.901337 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:39:38.901337 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:39:38.901337 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:39:38.901337 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:39:38.901337 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:39:38.901337 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:39:38.901337 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:39:38.901337 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:39:38.901337 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:39:38.901337 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:39:38.901337 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:39:38.901337 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:39:38.901337 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:39:38.901337 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:39:38.901337 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2589778-4bad-49f3-a3fa-5c3351c6568e could not be found. Sep 08 11:39:38.901337 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:39:38.901337 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:39:38.901337 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:39:38.905937 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:39:38.905937 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:39:38.905937 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:39:38.905937 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:39:38.905937 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:39:38.905937 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2589778-4bad-49f3-a3fa-5c3351c6568e could not be found. Sep 08 11:39:38.905937 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:39:38.905937 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-eb8b1705-8d50-4e4f-ad41-5b1db6233b2d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] Returning 404 to user: Instance e2589778-4bad-49f3-a3fa-5c3351c6568e could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:39:38.905937 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-eb8b1705-8d50-4e4f-ad41-5b1db6233b2d tempest-ServerDiskConfigTestJSON-580738008 tempest-ServerDiskConfigTestJSON-580738008-project] 10.222.0.27 "GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e" status: 404 len: 111 microversion: 2.1 time: 0.033107 Sep 08 11:39:38.905937 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3412/6956] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:39:38 2022] GET /compute/v2.1/servers/e2589778-4bad-49f3-a3fa-5c3351c6568e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 11:39:47.388975 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2fb85fd8-e8c5-43e6-9054-5c944bef90f9 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Action: 'create', calling method: .version_select at 0x7f68e8962940>, body: {"keypair": {"name": "tempest-keypair-1229154192", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBME4iq7DX+srw252DPlONPgK/stGw2skU5VkTUfgsZYrlVHEXofLeqmvnNn2puws5mdIQMQL2KURVdu0YVes182ato5D7fti7nyPbPDCXEfWclE3dbVLuuNEWa1NcsvgtQ=="}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:39:47.394587 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:39:47.412685 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-2fb85fd8-e8c5-43e6-9054-5c944bef90f9 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Getting quotas for project 5e7adfbb1417415b9eafeeb23b7a7c18. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:39:47.418157 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-2fb85fd8-e8c5-43e6-9054-5c944bef90f9 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Getting quotas for user f38a21e862664942bf35c93870df1c36 and project 5e7adfbb1417415b9eafeeb23b7a7c18. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:39:47.448688 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2fb85fd8-e8c5-43e6-9054-5c944bef90f9 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.207169 Sep 08 11:39:47.450542 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3545/6957] 10.222.0.27 () {60 vars in 1159 bytes} [Thu Sep 8 11:39:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:39:49.086502 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2241c7a5-edc8-44d0-8214-366b2c332df6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1103546419", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "99f4db14-10f1-4ebf-99cd-d7459087f008"}], "security_groups": [{"name": "tempest-securitygroup--1605450961"}], "key_name": "tempest-keypair-1229154192", "user_data": "}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:39:49.096120 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:39:49.096809 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:39:49.201271 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-2241c7a5-edc8-44d0-8214-366b2c332df6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] validate_networks() for [('99f4db14-10f1-4ebf-99cd-d7459087f008', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:39:49.600223 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-2241c7a5-edc8-44d0-8214-366b2c332df6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:39:49.600671 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-2241c7a5-edc8-44d0-8214-366b2c332df6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:39:49.601295 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-2241c7a5-edc8-44d0-8214-366b2c332df6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:39:49.601735 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-2241c7a5-edc8-44d0-8214-366b2c332df6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:39:49.602167 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-2241c7a5-edc8-44d0-8214-366b2c332df6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:39:49.612064 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2241c7a5-edc8-44d0-8214-366b2c332df6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:49.612621 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2241c7a5-edc8-44d0-8214-366b2c332df6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:49.613594 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2241c7a5-edc8-44d0-8214-366b2c332df6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:49.614683 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2241c7a5-edc8-44d0-8214-366b2c332df6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:49.615163 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2241c7a5-edc8-44d0-8214-366b2c332df6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:49.615638 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2241c7a5-edc8-44d0-8214-366b2c332df6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:49.634041 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-2241c7a5-edc8-44d0-8214-366b2c332df6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Getting quotas for project 5e7adfbb1417415b9eafeeb23b7a7c18. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:39:49.639550 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-2241c7a5-edc8-44d0-8214-366b2c332df6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Getting quotas for user f38a21e862664942bf35c93870df1c36 and project 5e7adfbb1417415b9eafeeb23b7a7c18. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:39:49.658739 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2241c7a5-edc8-44d0-8214-366b2c332df6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:39:49.658739 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2241c7a5-edc8-44d0-8214-366b2c332df6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: d2b1d042-8a22-4fe2-8b67-03b3376c8ce0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:39:49.709779 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2241c7a5-edc8-44d0-8214-366b2c332df6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.628090 Sep 08 11:39:49.710435 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3413/6958] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 11:39:49 2022] POST /compute/v2.1/servers => generated 409 bytes in 630 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:39:49.724768 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-128af590-175e-4721-afcd-8302d3b7605c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:39:49.725558 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-128af590-175e-4721-afcd-8302d3b7605c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: d2b1d042-8a22-4fe2-8b67-03b3376c8ce0] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:39:49.734483 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:39:49.832823 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-128af590-175e-4721-afcd-8302d3b7605c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:39:49.842665 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-128af590-175e-4721-afcd-8302d3b7605c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0" status: 200 len: 1239 microversion: 2.1 time: 0.123209 Sep 08 11:39:49.843483 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3546/6959] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:39:49 2022] GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 => generated 1239 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:39:50.872561 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-36ff8cb3-e2a0-4a45-bc4c-690d3b9d0c73 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:39:50.873384 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-36ff8cb3-e2a0-4a45-bc4c-690d3b9d0c73 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: d2b1d042-8a22-4fe2-8b67-03b3376c8ce0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:39:50.883378 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36ff8cb3-e2a0-4a45-bc4c-690d3b9d0c73 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:50.884462 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36ff8cb3-e2a0-4a45-bc4c-690d3b9d0c73 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:50.884951 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36ff8cb3-e2a0-4a45-bc4c-690d3b9d0c73 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:50.885726 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36ff8cb3-e2a0-4a45-bc4c-690d3b9d0c73 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:50.886204 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36ff8cb3-e2a0-4a45-bc4c-690d3b9d0c73 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:50.886817 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36ff8cb3-e2a0-4a45-bc4c-690d3b9d0c73 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:50.974428 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-36ff8cb3-e2a0-4a45-bc4c-690d3b9d0c73 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:39:50.982855 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-36ff8cb3-e2a0-4a45-bc4c-690d3b9d0c73 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0" status: 200 len: 1291 microversion: 2.1 time: 0.114808 Sep 08 11:39:50.984266 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3414/6960] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:39:50 2022] GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 => generated 1291 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:39:52.006842 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-be8ea3ab-287b-4ae3-87e6-34ab94e5c04b tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:39:52.007746 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-be8ea3ab-287b-4ae3-87e6-34ab94e5c04b tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: d2b1d042-8a22-4fe2-8b67-03b3376c8ce0] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:39:52.015814 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-be8ea3ab-287b-4ae3-87e6-34ab94e5c04b tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:52.016576 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-be8ea3ab-287b-4ae3-87e6-34ab94e5c04b tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:52.017282 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-be8ea3ab-287b-4ae3-87e6-34ab94e5c04b tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:52.018432 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-be8ea3ab-287b-4ae3-87e6-34ab94e5c04b tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:52.019616 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-be8ea3ab-287b-4ae3-87e6-34ab94e5c04b tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:52.020281 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-be8ea3ab-287b-4ae3-87e6-34ab94e5c04b tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:52.199003 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-be8ea3ab-287b-4ae3-87e6-34ab94e5c04b tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:39:52.208753 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-be8ea3ab-287b-4ae3-87e6-34ab94e5c04b tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0" status: 200 len: 1365 microversion: 2.1 time: 0.205851 Sep 08 11:39:52.217506 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3547/6961] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:39:52 2022] GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 => generated 1365 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:39:52.528105 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-39072cba-fcd6-4a60-9faa-d2e5fdb1f862 req-dd20eca8-d7f6-426e-8f1e-152416f2d460 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2b1d042-8a22-4fe2-8b67-03b3376c8ce0", "tag": "4a47c552-2d6f-46fd-8b75-ebd5d65faa2b"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:39:52.559918 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-39072cba-fcd6-4a60-9faa-d2e5fdb1f862 req-dd20eca8-d7f6-426e-8f1e-152416f2d460 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:52.560790 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-39072cba-fcd6-4a60-9faa-d2e5fdb1f862 req-dd20eca8-d7f6-426e-8f1e-152416f2d460 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:52.561716 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-39072cba-fcd6-4a60-9faa-d2e5fdb1f862 req-dd20eca8-d7f6-426e-8f1e-152416f2d460 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:52.582512 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-39072cba-fcd6-4a60-9faa-d2e5fdb1f862 req-dd20eca8-d7f6-426e-8f1e-152416f2d460 service nova] Creating event network-changed:4a47c552-2d6f-46fd-8b75-ebd5d65faa2b for instance d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 on n-h2-850501-12 Sep 08 11:39:52.587963 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-39072cba-fcd6-4a60-9faa-d2e5fdb1f862 req-dd20eca8-d7f6-426e-8f1e-152416f2d460 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075613 Sep 08 11:39:52.588928 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3415/6962] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:39:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:39:53.231869 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-11f4fecf-33c1-4e3e-8804-2959596de5b1 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:39:53.232490 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-11f4fecf-33c1-4e3e-8804-2959596de5b1 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: d2b1d042-8a22-4fe2-8b67-03b3376c8ce0] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:39:53.240286 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-11f4fecf-33c1-4e3e-8804-2959596de5b1 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:53.240786 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-11f4fecf-33c1-4e3e-8804-2959596de5b1 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:53.241260 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-11f4fecf-33c1-4e3e-8804-2959596de5b1 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:53.241972 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-11f4fecf-33c1-4e3e-8804-2959596de5b1 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:53.242431 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-11f4fecf-33c1-4e3e-8804-2959596de5b1 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:53.242875 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-11f4fecf-33c1-4e3e-8804-2959596de5b1 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:53.374548 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-11f4fecf-33c1-4e3e-8804-2959596de5b1 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:39:53.382835 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-11f4fecf-33c1-4e3e-8804-2959596de5b1 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0" status: 200 len: 1365 microversion: 2.1 time: 0.154899 Sep 08 11:39:53.383420 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3548/6963] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:39:53 2022] GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:39:54.406464 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3a92ee38-e750-4761-8f64-34445fd2a73a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:39:54.407193 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3a92ee38-e750-4761-8f64-34445fd2a73a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: d2b1d042-8a22-4fe2-8b67-03b3376c8ce0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:39:54.414295 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a92ee38-e750-4761-8f64-34445fd2a73a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:54.414808 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a92ee38-e750-4761-8f64-34445fd2a73a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:54.415262 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a92ee38-e750-4761-8f64-34445fd2a73a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:54.415988 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a92ee38-e750-4761-8f64-34445fd2a73a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:54.416464 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a92ee38-e750-4761-8f64-34445fd2a73a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:54.416911 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a92ee38-e750-4761-8f64-34445fd2a73a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:54.630527 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3a92ee38-e750-4761-8f64-34445fd2a73a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:39:54.638478 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3a92ee38-e750-4761-8f64-34445fd2a73a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0" status: 200 len: 1365 microversion: 2.1 time: 0.237141 Sep 08 11:39:54.639073 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3416/6964] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:39:54 2022] GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 => generated 1365 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:39:55.660468 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a74b1904-548d-47f7-b19c-ac2887c591d3 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:39:55.661109 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a74b1904-548d-47f7-b19c-ac2887c591d3 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: d2b1d042-8a22-4fe2-8b67-03b3376c8ce0] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:39:55.668070 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a74b1904-548d-47f7-b19c-ac2887c591d3 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:55.668565 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a74b1904-548d-47f7-b19c-ac2887c591d3 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:55.669005 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a74b1904-548d-47f7-b19c-ac2887c591d3 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:55.669727 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a74b1904-548d-47f7-b19c-ac2887c591d3 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:55.670192 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a74b1904-548d-47f7-b19c-ac2887c591d3 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:55.670624 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a74b1904-548d-47f7-b19c-ac2887c591d3 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:55.804590 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a74b1904-548d-47f7-b19c-ac2887c591d3 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:39:55.812410 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a74b1904-548d-47f7-b19c-ac2887c591d3 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0" status: 200 len: 1365 microversion: 2.1 time: 0.156060 Sep 08 11:39:55.812985 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3549/6965] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:39:55 2022] GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:39:56.836352 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1babdc63-b3b7-43b6-a2ec-cd21a90c3b57 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:39:56.836984 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1babdc63-b3b7-43b6-a2ec-cd21a90c3b57 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: d2b1d042-8a22-4fe2-8b67-03b3376c8ce0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:39:56.844038 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1babdc63-b3b7-43b6-a2ec-cd21a90c3b57 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:56.844508 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1babdc63-b3b7-43b6-a2ec-cd21a90c3b57 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:56.844967 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1babdc63-b3b7-43b6-a2ec-cd21a90c3b57 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:56.845738 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1babdc63-b3b7-43b6-a2ec-cd21a90c3b57 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:56.846216 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1babdc63-b3b7-43b6-a2ec-cd21a90c3b57 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:56.846668 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1babdc63-b3b7-43b6-a2ec-cd21a90c3b57 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:56.983593 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1babdc63-b3b7-43b6-a2ec-cd21a90c3b57 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:39:56.991869 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1babdc63-b3b7-43b6-a2ec-cd21a90c3b57 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0" status: 200 len: 1365 microversion: 2.1 time: 0.160205 Sep 08 11:39:56.992441 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3417/6966] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:39:56 2022] GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:39:58.015179 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-350ba894-a933-4a6b-bd50-d6c952575a45 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:39:58.015707 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-350ba894-a933-4a6b-bd50-d6c952575a45 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: d2b1d042-8a22-4fe2-8b67-03b3376c8ce0] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:39:58.023230 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-350ba894-a933-4a6b-bd50-d6c952575a45 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:58.023744 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-350ba894-a933-4a6b-bd50-d6c952575a45 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:58.024187 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-350ba894-a933-4a6b-bd50-d6c952575a45 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:58.024870 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-350ba894-a933-4a6b-bd50-d6c952575a45 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:58.025354 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-350ba894-a933-4a6b-bd50-d6c952575a45 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:58.025779 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-350ba894-a933-4a6b-bd50-d6c952575a45 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:58.162187 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-350ba894-a933-4a6b-bd50-d6c952575a45 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:39:58.170536 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-350ba894-a933-4a6b-bd50-d6c952575a45 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0" status: 200 len: 1365 microversion: 2.1 time: 0.159578 Sep 08 11:39:58.171109 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3550/6967] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:39:58 2022] GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:39:58.470180 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-d060920e-552a-40a7-a387-dd5153056aa8 req-00c64c2a-8ba9-4b07-a87b-da32db4617bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2b1d042-8a22-4fe2-8b67-03b3376c8ce0", "name": "network-vif-plugged", "status": "completed", "tag": "4a47c552-2d6f-46fd-8b75-ebd5d65faa2b"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:39:58.481671 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d060920e-552a-40a7-a387-dd5153056aa8 req-00c64c2a-8ba9-4b07-a87b-da32db4617bb service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:58.482185 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d060920e-552a-40a7-a387-dd5153056aa8 req-00c64c2a-8ba9-4b07-a87b-da32db4617bb service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:58.482638 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d060920e-552a-40a7-a387-dd5153056aa8 req-00c64c2a-8ba9-4b07-a87b-da32db4617bb service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:58.494951 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-d060920e-552a-40a7-a387-dd5153056aa8 req-00c64c2a-8ba9-4b07-a87b-da32db4617bb service nova] Creating event network-vif-plugged:4a47c552-2d6f-46fd-8b75-ebd5d65faa2b for instance d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 on n-h2-850501-12 Sep 08 11:39:58.499915 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-d060920e-552a-40a7-a387-dd5153056aa8 req-00c64c2a-8ba9-4b07-a87b-da32db4617bb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033629 Sep 08 11:39:58.500519 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3418/6968] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:39:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:39:59.193823 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d565587c-4cb8-4c64-bf88-6671337f6b5a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:39:59.194444 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d565587c-4cb8-4c64-bf88-6671337f6b5a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: d2b1d042-8a22-4fe2-8b67-03b3376c8ce0] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:39:59.201281 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d565587c-4cb8-4c64-bf88-6671337f6b5a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:59.201773 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d565587c-4cb8-4c64-bf88-6671337f6b5a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:59.202212 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d565587c-4cb8-4c64-bf88-6671337f6b5a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:59.202905 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d565587c-4cb8-4c64-bf88-6671337f6b5a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:59.203368 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d565587c-4cb8-4c64-bf88-6671337f6b5a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:59.203798 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d565587c-4cb8-4c64-bf88-6671337f6b5a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:59.339383 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d565587c-4cb8-4c64-bf88-6671337f6b5a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:39:59.347070 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d565587c-4cb8-4c64-bf88-6671337f6b5a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0" status: 200 len: 1365 microversion: 2.1 time: 0.157780 Sep 08 11:39:59.347643 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3551/6969] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:39:59 2022] GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:40:00.368273 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:40:00.369099 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:40:00.373380 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5050ecea-3b97-4919-b15a-dd539a6ab34b tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:40:00.374105 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5050ecea-3b97-4919-b15a-dd539a6ab34b tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: d2b1d042-8a22-4fe2-8b67-03b3376c8ce0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:40:00.381587 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5050ecea-3b97-4919-b15a-dd539a6ab34b tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:40:00.382106 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5050ecea-3b97-4919-b15a-dd539a6ab34b tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:40:00.382560 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5050ecea-3b97-4919-b15a-dd539a6ab34b tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:40:00.383282 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5050ecea-3b97-4919-b15a-dd539a6ab34b tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:40:00.383763 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5050ecea-3b97-4919-b15a-dd539a6ab34b tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:40:00.384211 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5050ecea-3b97-4919-b15a-dd539a6ab34b tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:40:00.516517 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5050ecea-3b97-4919-b15a-dd539a6ab34b tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:40:00.525635 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5050ecea-3b97-4919-b15a-dd539a6ab34b tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0" status: 200 len: 1552 microversion: 2.1 time: 0.159215 Sep 08 11:40:00.526222 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3419/6970] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:40:00 2022] GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 => generated 1552 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:40:00.548188 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9714f01e-36f3-4374-ba4d-f3bc858ef07e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:40:00.548689 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9714f01e-36f3-4374-ba4d-f3bc858ef07e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: d2b1d042-8a22-4fe2-8b67-03b3376c8ce0] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:40:00.550565 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=6 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:40:00.557109 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9714f01e-36f3-4374-ba4d-f3bc858ef07e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:40:00.557630 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9714f01e-36f3-4374-ba4d-f3bc858ef07e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:40:00.558073 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9714f01e-36f3-4374-ba4d-f3bc858ef07e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:40:00.558773 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9714f01e-36f3-4374-ba4d-f3bc858ef07e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:40:00.559267 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9714f01e-36f3-4374-ba4d-f3bc858ef07e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:40:00.559702 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9714f01e-36f3-4374-ba4d-f3bc858ef07e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:40:00.642478 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9714f01e-36f3-4374-ba4d-f3bc858ef07e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098036 Sep 08 11:40:00.643078 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3552/6971] 10.222.0.27 () {58 vars in 1275 bytes} [Thu Sep 8 11:40:00 2022] GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:40:01.575747 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-cc10bf02-4c02-4ffb-9ea3-963303f84df4 req-f3e0e10f-fe81-4ec1-8d91-0d88bf9403aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2b1d042-8a22-4fe2-8b67-03b3376c8ce0", "tag": "4a47c552-2d6f-46fd-8b75-ebd5d65faa2b"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:40:01.586926 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-cc10bf02-4c02-4ffb-9ea3-963303f84df4 req-f3e0e10f-fe81-4ec1-8d91-0d88bf9403aa service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:40:01.587435 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-cc10bf02-4c02-4ffb-9ea3-963303f84df4 req-f3e0e10f-fe81-4ec1-8d91-0d88bf9403aa service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:40:01.587885 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-cc10bf02-4c02-4ffb-9ea3-963303f84df4 req-f3e0e10f-fe81-4ec1-8d91-0d88bf9403aa service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:40:01.599921 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-cc10bf02-4c02-4ffb-9ea3-963303f84df4 req-f3e0e10f-fe81-4ec1-8d91-0d88bf9403aa service nova] Creating event network-changed:4a47c552-2d6f-46fd-8b75-ebd5d65faa2b for instance d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 on n-h2-850501-12 Sep 08 11:40:01.604858 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-cc10bf02-4c02-4ffb-9ea3-963303f84df4 req-f3e0e10f-fe81-4ec1-8d91-0d88bf9403aa service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033002 Sep 08 11:40:01.605738 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3420/6972] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:40:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:40:37.626285 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:40:37.627109 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=34 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:40:37.631728 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ba01196d-3ad2-4974-adcd-dea22aeaf796 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:40:37.632340 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ba01196d-3ad2-4974-adcd-dea22aeaf796 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: d2b1d042-8a22-4fe2-8b67-03b3376c8ce0] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:40:37.639476 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ba01196d-3ad2-4974-adcd-dea22aeaf796 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:40:37.639973 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ba01196d-3ad2-4974-adcd-dea22aeaf796 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:40:37.640422 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ba01196d-3ad2-4974-adcd-dea22aeaf796 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:40:37.641155 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ba01196d-3ad2-4974-adcd-dea22aeaf796 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:40:37.641625 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ba01196d-3ad2-4974-adcd-dea22aeaf796 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:40:37.642060 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ba01196d-3ad2-4974-adcd-dea22aeaf796 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:40:37.779484 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ba01196d-3ad2-4974-adcd-dea22aeaf796 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:40:37.787363 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ba01196d-3ad2-4974-adcd-dea22aeaf796 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0" status: 200 len: 1671 microversion: 2.1 time: 0.163111 Sep 08 11:40:37.787949 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3553/6973] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:40:37 2022] GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 => generated 1671 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:40:37.809344 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:40:37.810126 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=32 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:40:37.820366 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-80874a1b-b063-477e-9f5a-a969058f6b88 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:40:37.821248 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-80874a1b-b063-477e-9f5a-a969058f6b88 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: d2b1d042-8a22-4fe2-8b67-03b3376c8ce0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:40:37.828687 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80874a1b-b063-477e-9f5a-a969058f6b88 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:40:37.829323 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80874a1b-b063-477e-9f5a-a969058f6b88 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:40:37.829774 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80874a1b-b063-477e-9f5a-a969058f6b88 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:40:37.834429 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80874a1b-b063-477e-9f5a-a969058f6b88 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:40:37.834919 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80874a1b-b063-477e-9f5a-a969058f6b88 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:40:37.835366 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80874a1b-b063-477e-9f5a-a969058f6b88 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:40:37.971362 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-80874a1b-b063-477e-9f5a-a969058f6b88 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:40:37.979777 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-80874a1b-b063-477e-9f5a-a969058f6b88 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0" status: 200 len: 1671 microversion: 2.1 time: 0.172802 Sep 08 11:40:37.980356 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3421/6974] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:40:37 2022] GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 => generated 1671 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:40:38.002349 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-993a0c35-d535-4a41-bf81-5cda7e4a8360 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:40:38.002965 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-993a0c35-d535-4a41-bf81-5cda7e4a8360 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: d2b1d042-8a22-4fe2-8b67-03b3376c8ce0] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:40:38.009547 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-993a0c35-d535-4a41-bf81-5cda7e4a8360 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:40:38.010040 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-993a0c35-d535-4a41-bf81-5cda7e4a8360 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:40:38.010482 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-993a0c35-d535-4a41-bf81-5cda7e4a8360 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:40:38.011177 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-993a0c35-d535-4a41-bf81-5cda7e4a8360 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:40:38.011638 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-993a0c35-d535-4a41-bf81-5cda7e4a8360 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:40:38.012065 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-993a0c35-d535-4a41-bf81-5cda7e4a8360 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:40:38.143290 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-993a0c35-d535-4a41-bf81-5cda7e4a8360 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:40:38.151279 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-993a0c35-d535-4a41-bf81-5cda7e4a8360 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0" status: 200 len: 1671 microversion: 2.1 time: 0.152728 Sep 08 11:40:38.151855 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3554/6975] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:40:37 2022] GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 => generated 1671 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:40:38.174563 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-de68897d-d9b6-4bd0-8d8e-4e0f4404961c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:40:38.177541 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-de68897d-d9b6-4bd0-8d8e-4e0f4404961c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: d2b1d042-8a22-4fe2-8b67-03b3376c8ce0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:40:38.183574 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de68897d-d9b6-4bd0-8d8e-4e0f4404961c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:40:38.184076 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de68897d-d9b6-4bd0-8d8e-4e0f4404961c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:40:38.184529 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de68897d-d9b6-4bd0-8d8e-4e0f4404961c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:40:38.185264 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de68897d-d9b6-4bd0-8d8e-4e0f4404961c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:40:38.185786 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de68897d-d9b6-4bd0-8d8e-4e0f4404961c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:40:38.186176 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de68897d-d9b6-4bd0-8d8e-4e0f4404961c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:40:38.217915 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-de68897d-d9b6-4bd0-8d8e-4e0f4404961c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:40:38.223989 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-de68897d-d9b6-4bd0-8d8e-4e0f4404961c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: d2b1d042-8a22-4fe2-8b67-03b3376c8ce0] Old instance type m1.heat2, new instance type m1.heat {{(pid=128862) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 08 11:40:38.230791 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-de68897d-d9b6-4bd0-8d8e-4e0f4404961c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:40:38.231246 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-de68897d-d9b6-4bd0-8d8e-4e0f4404961c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:40:38.231730 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-de68897d-d9b6-4bd0-8d8e-4e0f4404961c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:40:38.232158 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-de68897d-d9b6-4bd0-8d8e-4e0f4404961c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:40:38.232583 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-de68897d-d9b6-4bd0-8d8e-4e0f4404961c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:40:38.300466 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-de68897d-d9b6-4bd0-8d8e-4e0f4404961c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "POST /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0/action" status: 202 len: 0 microversion: 2.1 time: 0.129822 Sep 08 11:40:38.304102 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3422/6976] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 11:40:38 2022] POST /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:40:38.309558 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4288e175-9ccc-4c6f-b231-df3e9b5b0b61 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:40:38.310169 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4288e175-9ccc-4c6f-b231-df3e9b5b0b61 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: d2b1d042-8a22-4fe2-8b67-03b3376c8ce0] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:40:38.316017 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4288e175-9ccc-4c6f-b231-df3e9b5b0b61 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:40:38.316477 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4288e175-9ccc-4c6f-b231-df3e9b5b0b61 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:40:38.316923 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4288e175-9ccc-4c6f-b231-df3e9b5b0b61 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:40:38.317847 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4288e175-9ccc-4c6f-b231-df3e9b5b0b61 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:40:38.318437 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4288e175-9ccc-4c6f-b231-df3e9b5b0b61 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:40:38.318863 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4288e175-9ccc-4c6f-b231-df3e9b5b0b61 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:40:38.456499 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4288e175-9ccc-4c6f-b231-df3e9b5b0b61 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:40:38.465215 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4288e175-9ccc-4c6f-b231-df3e9b5b0b61 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0" status: 200 len: 1680 microversion: 2.1 time: 0.159679 Sep 08 11:40:38.465812 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3555/6977] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:40:38 2022] GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:40:39.492474 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c16c88e3-83c2-4942-9936-e7da0ff59c8c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:40:39.493075 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c16c88e3-83c2-4942-9936-e7da0ff59c8c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: d2b1d042-8a22-4fe2-8b67-03b3376c8ce0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:40:39.501372 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c16c88e3-83c2-4942-9936-e7da0ff59c8c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:40:39.501950 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c16c88e3-83c2-4942-9936-e7da0ff59c8c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:40:39.502472 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c16c88e3-83c2-4942-9936-e7da0ff59c8c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:40:39.503303 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c16c88e3-83c2-4942-9936-e7da0ff59c8c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:40:39.504385 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c16c88e3-83c2-4942-9936-e7da0ff59c8c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:40:39.504897 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c16c88e3-83c2-4942-9936-e7da0ff59c8c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:40:39.738972 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c16c88e3-83c2-4942-9936-e7da0ff59c8c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:40:39.747398 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c16c88e3-83c2-4942-9936-e7da0ff59c8c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0" status: 200 len: 1680 microversion: 2.1 time: 0.263309 Sep 08 11:40:39.748188 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3423/6978] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:40:39 2022] GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 => generated 1680 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:40:40.772308 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-76a742a0-fc14-4b95-829b-4e64a2d34629 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:40:40.772944 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-76a742a0-fc14-4b95-829b-4e64a2d34629 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: d2b1d042-8a22-4fe2-8b67-03b3376c8ce0] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:40:40.779780 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-76a742a0-fc14-4b95-829b-4e64a2d34629 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:40:40.780264 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-76a742a0-fc14-4b95-829b-4e64a2d34629 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:40:40.780697 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-76a742a0-fc14-4b95-829b-4e64a2d34629 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:40:40.781423 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-76a742a0-fc14-4b95-829b-4e64a2d34629 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:40:40.781879 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-76a742a0-fc14-4b95-829b-4e64a2d34629 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:40:40.782307 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-76a742a0-fc14-4b95-829b-4e64a2d34629 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:40:40.916214 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-76a742a0-fc14-4b95-829b-4e64a2d34629 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:40:40.924314 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-76a742a0-fc14-4b95-829b-4e64a2d34629 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0" status: 200 len: 1685 microversion: 2.1 time: 0.156422 Sep 08 11:40:40.924889 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3556/6979] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:40:40 2022] GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 => generated 1685 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:40:41.948397 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7dd37f98-02f5-42a7-ab70-6316a1377f23 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:40:41.949041 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7dd37f98-02f5-42a7-ab70-6316a1377f23 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: d2b1d042-8a22-4fe2-8b67-03b3376c8ce0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:40:41.955858 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7dd37f98-02f5-42a7-ab70-6316a1377f23 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:40:41.956357 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7dd37f98-02f5-42a7-ab70-6316a1377f23 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:40:41.957558 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7dd37f98-02f5-42a7-ab70-6316a1377f23 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:40:41.958367 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7dd37f98-02f5-42a7-ab70-6316a1377f23 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:40:41.958838 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7dd37f98-02f5-42a7-ab70-6316a1377f23 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:40:41.959279 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7dd37f98-02f5-42a7-ab70-6316a1377f23 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:40:42.089885 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7dd37f98-02f5-42a7-ab70-6316a1377f23 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:40:42.097738 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7dd37f98-02f5-42a7-ab70-6316a1377f23 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0" status: 200 len: 1685 microversion: 2.1 time: 0.153300 Sep 08 11:40:42.098310 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3424/6980] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:40:41 2022] GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 => generated 1685 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:40:43.122796 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-326d069e-1068-4169-b771-d2b3855425e9 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:40:43.123636 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-326d069e-1068-4169-b771-d2b3855425e9 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: d2b1d042-8a22-4fe2-8b67-03b3376c8ce0] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:40:43.130603 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-326d069e-1068-4169-b771-d2b3855425e9 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:40:43.131094 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-326d069e-1068-4169-b771-d2b3855425e9 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:40:43.131529 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-326d069e-1068-4169-b771-d2b3855425e9 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:40:43.132230 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-326d069e-1068-4169-b771-d2b3855425e9 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:40:43.132684 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-326d069e-1068-4169-b771-d2b3855425e9 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:40:43.133162 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-326d069e-1068-4169-b771-d2b3855425e9 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:40:43.268058 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-326d069e-1068-4169-b771-d2b3855425e9 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:40:43.276645 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-326d069e-1068-4169-b771-d2b3855425e9 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0" status: 200 len: 1685 microversion: 2.1 time: 0.158052 Sep 08 11:40:43.277250 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3557/6981] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:40:43 2022] GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 => generated 1685 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:40:44.300159 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cb0bce65-ea91-464a-b5f4-1a63c14a2b4a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:40:44.301292 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cb0bce65-ea91-464a-b5f4-1a63c14a2b4a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: d2b1d042-8a22-4fe2-8b67-03b3376c8ce0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:40:44.308337 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb0bce65-ea91-464a-b5f4-1a63c14a2b4a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:40:44.308843 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb0bce65-ea91-464a-b5f4-1a63c14a2b4a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:40:44.309323 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb0bce65-ea91-464a-b5f4-1a63c14a2b4a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:40:44.310031 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb0bce65-ea91-464a-b5f4-1a63c14a2b4a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:40:44.310500 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb0bce65-ea91-464a-b5f4-1a63c14a2b4a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:40:44.310937 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb0bce65-ea91-464a-b5f4-1a63c14a2b4a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:40:44.445399 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cb0bce65-ea91-464a-b5f4-1a63c14a2b4a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:40:44.453472 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cb0bce65-ea91-464a-b5f4-1a63c14a2b4a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0" status: 200 len: 1685 microversion: 2.1 time: 0.157343 Sep 08 11:40:44.454041 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3425/6982] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:40:44 2022] GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 => generated 1685 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:40:45.476975 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-73d700c0-c3a5-4ec7-960d-7e0641b4d783 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:40:45.477591 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-73d700c0-c3a5-4ec7-960d-7e0641b4d783 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: d2b1d042-8a22-4fe2-8b67-03b3376c8ce0] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:40:45.484380 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-73d700c0-c3a5-4ec7-960d-7e0641b4d783 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:40:45.484863 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-73d700c0-c3a5-4ec7-960d-7e0641b4d783 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:40:45.485328 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-73d700c0-c3a5-4ec7-960d-7e0641b4d783 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:40:45.486016 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-73d700c0-c3a5-4ec7-960d-7e0641b4d783 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:40:45.486473 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-73d700c0-c3a5-4ec7-960d-7e0641b4d783 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:40:45.487168 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-73d700c0-c3a5-4ec7-960d-7e0641b4d783 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:40:45.618648 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-73d700c0-c3a5-4ec7-960d-7e0641b4d783 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:40:45.626508 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-73d700c0-c3a5-4ec7-960d-7e0641b4d783 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0" status: 200 len: 1685 microversion: 2.1 time: 0.153491 Sep 08 11:40:45.627081 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3558/6983] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:40:45 2022] GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 => generated 1685 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:40:46.649545 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9e2e76a3-09ba-4a41-9cbb-0f97b1857cf6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:40:46.650177 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9e2e76a3-09ba-4a41-9cbb-0f97b1857cf6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: d2b1d042-8a22-4fe2-8b67-03b3376c8ce0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:40:46.657068 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9e2e76a3-09ba-4a41-9cbb-0f97b1857cf6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:40:46.657579 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9e2e76a3-09ba-4a41-9cbb-0f97b1857cf6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:40:46.658034 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9e2e76a3-09ba-4a41-9cbb-0f97b1857cf6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:40:46.658748 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9e2e76a3-09ba-4a41-9cbb-0f97b1857cf6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:40:46.659221 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9e2e76a3-09ba-4a41-9cbb-0f97b1857cf6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:40:46.659735 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9e2e76a3-09ba-4a41-9cbb-0f97b1857cf6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:40:46.790911 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9e2e76a3-09ba-4a41-9cbb-0f97b1857cf6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:40:46.798783 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9e2e76a3-09ba-4a41-9cbb-0f97b1857cf6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0" status: 200 len: 1685 microversion: 2.1 time: 0.153209 Sep 08 11:40:46.799363 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3426/6984] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:40:46 2022] GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 => generated 1685 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:40:47.823534 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2cc2a9d9-680a-46f4-8e22-e9fd946261d4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:40:47.824068 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2cc2a9d9-680a-46f4-8e22-e9fd946261d4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: d2b1d042-8a22-4fe2-8b67-03b3376c8ce0] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:40:47.831045 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2cc2a9d9-680a-46f4-8e22-e9fd946261d4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:40:47.831610 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2cc2a9d9-680a-46f4-8e22-e9fd946261d4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:40:47.832168 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2cc2a9d9-680a-46f4-8e22-e9fd946261d4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:40:47.832842 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2cc2a9d9-680a-46f4-8e22-e9fd946261d4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:40:47.833337 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2cc2a9d9-680a-46f4-8e22-e9fd946261d4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:40:47.833770 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2cc2a9d9-680a-46f4-8e22-e9fd946261d4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:40:47.971441 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2cc2a9d9-680a-46f4-8e22-e9fd946261d4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:40:47.979898 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2cc2a9d9-680a-46f4-8e22-e9fd946261d4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0" status: 200 len: 1685 microversion: 2.1 time: 0.161132 Sep 08 11:40:47.980478 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3559/6985] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:40:47 2022] GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 => generated 1685 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:40:49.007686 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cfeb3677-8034-4d22-843e-86e7b9410ee5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:40:49.008370 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cfeb3677-8034-4d22-843e-86e7b9410ee5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: d2b1d042-8a22-4fe2-8b67-03b3376c8ce0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:40:49.015633 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cfeb3677-8034-4d22-843e-86e7b9410ee5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:40:49.016147 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cfeb3677-8034-4d22-843e-86e7b9410ee5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:40:49.016611 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cfeb3677-8034-4d22-843e-86e7b9410ee5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:40:49.017383 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cfeb3677-8034-4d22-843e-86e7b9410ee5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:40:49.017865 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cfeb3677-8034-4d22-843e-86e7b9410ee5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:40:49.018316 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cfeb3677-8034-4d22-843e-86e7b9410ee5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:40:49.151534 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cfeb3677-8034-4d22-843e-86e7b9410ee5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:40:49.159205 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cfeb3677-8034-4d22-843e-86e7b9410ee5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0" status: 200 len: 1685 microversion: 2.1 time: 0.159368 Sep 08 11:40:49.160521 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3427/6986] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:40:48 2022] GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 => generated 1685 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:40:50.185996 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-038ff25b-c704-449a-9837-fa0c52a10b77 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:40:50.186644 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-038ff25b-c704-449a-9837-fa0c52a10b77 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: d2b1d042-8a22-4fe2-8b67-03b3376c8ce0] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:40:50.195232 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-038ff25b-c704-449a-9837-fa0c52a10b77 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:40:50.195727 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-038ff25b-c704-449a-9837-fa0c52a10b77 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:40:50.196166 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-038ff25b-c704-449a-9837-fa0c52a10b77 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:40:50.196870 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-038ff25b-c704-449a-9837-fa0c52a10b77 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:40:50.197358 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-038ff25b-c704-449a-9837-fa0c52a10b77 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:40:50.197930 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-038ff25b-c704-449a-9837-fa0c52a10b77 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:40:50.379200 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-038ff25b-c704-449a-9837-fa0c52a10b77 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:40:50.386858 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-038ff25b-c704-449a-9837-fa0c52a10b77 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0" status: 200 len: 1685 microversion: 2.1 time: 0.205096 Sep 08 11:40:50.387433 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3560/6987] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:40:50 2022] GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 => generated 1685 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:40:51.411659 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-71a465f1-6422-488b-a201-ea3a08300c5b tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:40:51.412264 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-71a465f1-6422-488b-a201-ea3a08300c5b tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: d2b1d042-8a22-4fe2-8b67-03b3376c8ce0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:40:51.419894 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71a465f1-6422-488b-a201-ea3a08300c5b tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:40:51.420413 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71a465f1-6422-488b-a201-ea3a08300c5b tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:40:51.420846 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71a465f1-6422-488b-a201-ea3a08300c5b tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:40:51.421576 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71a465f1-6422-488b-a201-ea3a08300c5b tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:40:51.422046 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71a465f1-6422-488b-a201-ea3a08300c5b tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:40:51.422483 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71a465f1-6422-488b-a201-ea3a08300c5b tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:40:51.608444 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-71a465f1-6422-488b-a201-ea3a08300c5b tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:40:51.616782 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-71a465f1-6422-488b-a201-ea3a08300c5b tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0" status: 200 len: 1685 microversion: 2.1 time: 0.209925 Sep 08 11:40:51.617397 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3428/6988] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:40:51 2022] GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 => generated 1685 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:40:52.641139 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-574e80f4-a6af-4323-8ebe-db53e3871f1f tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:40:52.641901 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-574e80f4-a6af-4323-8ebe-db53e3871f1f tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: d2b1d042-8a22-4fe2-8b67-03b3376c8ce0] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:40:52.650210 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-574e80f4-a6af-4323-8ebe-db53e3871f1f tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:40:52.650848 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-574e80f4-a6af-4323-8ebe-db53e3871f1f tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:40:52.651294 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-574e80f4-a6af-4323-8ebe-db53e3871f1f tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:40:52.652056 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-574e80f4-a6af-4323-8ebe-db53e3871f1f tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:40:52.652516 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-574e80f4-a6af-4323-8ebe-db53e3871f1f tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:40:52.652948 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-574e80f4-a6af-4323-8ebe-db53e3871f1f tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:40:52.813196 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-574e80f4-a6af-4323-8ebe-db53e3871f1f tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:40:52.822345 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-574e80f4-a6af-4323-8ebe-db53e3871f1f tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0" status: 200 len: 1685 microversion: 2.1 time: 0.185152 Sep 08 11:40:52.822939 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3561/6989] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:40:52 2022] GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 => generated 1685 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:40:53.846947 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4e6d482c-355a-4fd3-a55a-161180873e43 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:40:53.847505 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4e6d482c-355a-4fd3-a55a-161180873e43 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: d2b1d042-8a22-4fe2-8b67-03b3376c8ce0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:40:53.855292 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e6d482c-355a-4fd3-a55a-161180873e43 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:40:53.855798 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e6d482c-355a-4fd3-a55a-161180873e43 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:40:53.856253 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e6d482c-355a-4fd3-a55a-161180873e43 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:40:53.857040 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e6d482c-355a-4fd3-a55a-161180873e43 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:40:53.857645 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e6d482c-355a-4fd3-a55a-161180873e43 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:40:53.858228 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e6d482c-355a-4fd3-a55a-161180873e43 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:40:53.990232 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4e6d482c-355a-4fd3-a55a-161180873e43 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:40:53.998105 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4e6d482c-355a-4fd3-a55a-161180873e43 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0" status: 200 len: 1685 microversion: 2.1 time: 0.155152 Sep 08 11:40:53.998683 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3429/6990] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:40:53 2022] GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 => generated 1685 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:40:55.021723 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-82dfd35a-e4f8-4d02-ad38-45a0244ee1e1 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:40:55.022347 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-82dfd35a-e4f8-4d02-ad38-45a0244ee1e1 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: d2b1d042-8a22-4fe2-8b67-03b3376c8ce0] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:40:55.028821 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-82dfd35a-e4f8-4d02-ad38-45a0244ee1e1 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:40:55.029352 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-82dfd35a-e4f8-4d02-ad38-45a0244ee1e1 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:40:55.029796 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-82dfd35a-e4f8-4d02-ad38-45a0244ee1e1 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:40:55.030492 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-82dfd35a-e4f8-4d02-ad38-45a0244ee1e1 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:40:55.030951 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-82dfd35a-e4f8-4d02-ad38-45a0244ee1e1 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:40:55.031380 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-82dfd35a-e4f8-4d02-ad38-45a0244ee1e1 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:40:55.160696 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-82dfd35a-e4f8-4d02-ad38-45a0244ee1e1 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:40:55.169441 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-82dfd35a-e4f8-4d02-ad38-45a0244ee1e1 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0" status: 200 len: 1685 microversion: 2.1 time: 0.151811 Sep 08 11:40:55.170019 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3562/6991] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:40:55 2022] GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 => generated 1685 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:40:56.192988 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8d8d779b-be5e-4fa2-a3c1-fb1d2cae1553 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:40:56.194598 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8d8d779b-be5e-4fa2-a3c1-fb1d2cae1553 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: d2b1d042-8a22-4fe2-8b67-03b3376c8ce0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:40:56.202097 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d8d779b-be5e-4fa2-a3c1-fb1d2cae1553 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:40:56.202604 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d8d779b-be5e-4fa2-a3c1-fb1d2cae1553 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:40:56.203056 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d8d779b-be5e-4fa2-a3c1-fb1d2cae1553 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:40:56.203803 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d8d779b-be5e-4fa2-a3c1-fb1d2cae1553 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:40:56.204275 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d8d779b-be5e-4fa2-a3c1-fb1d2cae1553 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:40:56.204713 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d8d779b-be5e-4fa2-a3c1-fb1d2cae1553 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:40:56.339278 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8d8d779b-be5e-4fa2-a3c1-fb1d2cae1553 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:40:56.347074 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8d8d779b-be5e-4fa2-a3c1-fb1d2cae1553 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0" status: 200 len: 1685 microversion: 2.1 time: 0.158042 Sep 08 11:40:56.347656 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3430/6992] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:40:56 2022] GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 => generated 1685 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:40:57.371231 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-143e9be6-9944-4a46-aec5-b24c8e98939d tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:40:57.371931 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-143e9be6-9944-4a46-aec5-b24c8e98939d tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: d2b1d042-8a22-4fe2-8b67-03b3376c8ce0] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:40:57.378756 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-143e9be6-9944-4a46-aec5-b24c8e98939d tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:40:57.379251 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-143e9be6-9944-4a46-aec5-b24c8e98939d tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:40:57.379845 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-143e9be6-9944-4a46-aec5-b24c8e98939d tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:40:57.380581 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-143e9be6-9944-4a46-aec5-b24c8e98939d tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:40:57.381204 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-143e9be6-9944-4a46-aec5-b24c8e98939d tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:40:57.381734 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-143e9be6-9944-4a46-aec5-b24c8e98939d tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:40:57.585722 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-143e9be6-9944-4a46-aec5-b24c8e98939d tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:40:57.593534 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-143e9be6-9944-4a46-aec5-b24c8e98939d tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0" status: 200 len: 1684 microversion: 2.1 time: 0.226277 Sep 08 11:40:57.594124 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3563/6993] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:40:57 2022] GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 => generated 1684 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:40:57.969552 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-0af1bfa1-196a-4042-964e-226e15bfe1ee req-e598752b-deb0-4ae2-867a-1f5e1ed527ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2b1d042-8a22-4fe2-8b67-03b3376c8ce0", "name": "network-vif-unplugged", "status": "completed", "tag": "4a47c552-2d6f-46fd-8b75-ebd5d65faa2b"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:40:57.979878 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-0af1bfa1-196a-4042-964e-226e15bfe1ee req-e598752b-deb0-4ae2-867a-1f5e1ed527ab service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:40:57.980378 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-0af1bfa1-196a-4042-964e-226e15bfe1ee req-e598752b-deb0-4ae2-867a-1f5e1ed527ab service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:40:57.980823 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-0af1bfa1-196a-4042-964e-226e15bfe1ee req-e598752b-deb0-4ae2-867a-1f5e1ed527ab service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:40:57.993294 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-0af1bfa1-196a-4042-964e-226e15bfe1ee req-e598752b-deb0-4ae2-867a-1f5e1ed527ab service nova] Creating event network-vif-unplugged:4a47c552-2d6f-46fd-8b75-ebd5d65faa2b for instance d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 on n-h1-850501-12 Sep 08 11:40:57.998733 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [req-0af1bfa1-196a-4042-964e-226e15bfe1ee req-e598752b-deb0-4ae2-867a-1f5e1ed527ab service nova] Instance d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850501-12', 'n-h1-850501-12'} {{(pid=128862) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 11:40:58.010142 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-0af1bfa1-196a-4042-964e-226e15bfe1ee req-e598752b-deb0-4ae2-867a-1f5e1ed527ab service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.104835 Sep 08 11:40:58.010832 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3431/6994] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:40:58.618530 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-724bb453-480c-4b2d-8d58-36636acf4f85 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:40:58.619307 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-724bb453-480c-4b2d-8d58-36636acf4f85 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: d2b1d042-8a22-4fe2-8b67-03b3376c8ce0] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:40:58.626285 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-724bb453-480c-4b2d-8d58-36636acf4f85 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:40:58.626872 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-724bb453-480c-4b2d-8d58-36636acf4f85 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:40:58.627385 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-724bb453-480c-4b2d-8d58-36636acf4f85 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:40:58.628100 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-724bb453-480c-4b2d-8d58-36636acf4f85 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:40:58.628560 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-724bb453-480c-4b2d-8d58-36636acf4f85 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:40:58.629000 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-724bb453-480c-4b2d-8d58-36636acf4f85 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:40:59.083575 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-724bb453-480c-4b2d-8d58-36636acf4f85 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:40:59.091699 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-724bb453-480c-4b2d-8d58-36636acf4f85 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0" status: 200 len: 1684 microversion: 2.1 time: 0.477909 Sep 08 11:40:59.092285 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3564/6995] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:40:58 2022] GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 => generated 1684 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:41:00.031775 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-c66f7327-1918-4eba-9dd0-3c19aeeceab2 req-3879fa18-de09-4c4e-aa9f-1d9b994583c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2b1d042-8a22-4fe2-8b67-03b3376c8ce0", "tag": "4a47c552-2d6f-46fd-8b75-ebd5d65faa2b"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:41:00.042529 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c66f7327-1918-4eba-9dd0-3c19aeeceab2 req-3879fa18-de09-4c4e-aa9f-1d9b994583c1 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:00.043031 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c66f7327-1918-4eba-9dd0-3c19aeeceab2 req-3879fa18-de09-4c4e-aa9f-1d9b994583c1 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:00.043481 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c66f7327-1918-4eba-9dd0-3c19aeeceab2 req-3879fa18-de09-4c4e-aa9f-1d9b994583c1 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:00.057643 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-c66f7327-1918-4eba-9dd0-3c19aeeceab2 req-3879fa18-de09-4c4e-aa9f-1d9b994583c1 service nova] Creating event network-changed:4a47c552-2d6f-46fd-8b75-ebd5d65faa2b for instance d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 on n-h1-850501-12 Sep 08 11:41:00.063342 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [req-c66f7327-1918-4eba-9dd0-3c19aeeceab2 req-3879fa18-de09-4c4e-aa9f-1d9b994583c1 service nova] Instance d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850501-12', 'n-h1-850501-12'} {{(pid=128862) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 11:41:00.076177 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-c66f7327-1918-4eba-9dd0-3c19aeeceab2 req-3879fa18-de09-4c4e-aa9f-1d9b994583c1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049499 Sep 08 11:41:00.077087 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3432/6996] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:41:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:41:00.115903 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bbccaf76-e975-4ac5-b53a-404cf3a83a26 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:41:00.116640 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bbccaf76-e975-4ac5-b53a-404cf3a83a26 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: d2b1d042-8a22-4fe2-8b67-03b3376c8ce0] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:41:00.123583 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bbccaf76-e975-4ac5-b53a-404cf3a83a26 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:00.124080 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bbccaf76-e975-4ac5-b53a-404cf3a83a26 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:00.124523 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bbccaf76-e975-4ac5-b53a-404cf3a83a26 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:00.125251 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bbccaf76-e975-4ac5-b53a-404cf3a83a26 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:00.125708 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bbccaf76-e975-4ac5-b53a-404cf3a83a26 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:00.126139 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bbccaf76-e975-4ac5-b53a-404cf3a83a26 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:00.273960 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-bbccaf76-e975-4ac5-b53a-404cf3a83a26 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:41:00.283857 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bbccaf76-e975-4ac5-b53a-404cf3a83a26 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0" status: 200 len: 1682 microversion: 2.1 time: 0.172611 Sep 08 11:41:00.284451 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3565/6997] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:41:00 2022] GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 => generated 1682 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:41:01.308835 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-129b3586-5fba-42c4-a3e8-7fc483c33c3f tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:41:01.309492 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-129b3586-5fba-42c4-a3e8-7fc483c33c3f tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: d2b1d042-8a22-4fe2-8b67-03b3376c8ce0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:41:01.316954 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-129b3586-5fba-42c4-a3e8-7fc483c33c3f tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:01.317493 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-129b3586-5fba-42c4-a3e8-7fc483c33c3f tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:01.317946 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-129b3586-5fba-42c4-a3e8-7fc483c33c3f tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:01.318657 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-129b3586-5fba-42c4-a3e8-7fc483c33c3f tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:01.319138 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-129b3586-5fba-42c4-a3e8-7fc483c33c3f tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:01.319612 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-129b3586-5fba-42c4-a3e8-7fc483c33c3f tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:01.453584 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-129b3586-5fba-42c4-a3e8-7fc483c33c3f tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:41:01.461542 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-129b3586-5fba-42c4-a3e8-7fc483c33c3f tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0" status: 200 len: 1679 microversion: 2.1 time: 0.157828 Sep 08 11:41:01.462245 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3433/6998] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:41:01 2022] GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:41:01.484942 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-48975ad8-1295-4b0f-9bd4-e6548d1f8479 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:41:01.485506 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-48975ad8-1295-4b0f-9bd4-e6548d1f8479 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: d2b1d042-8a22-4fe2-8b67-03b3376c8ce0] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:41:01.493454 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-48975ad8-1295-4b0f-9bd4-e6548d1f8479 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:01.493955 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-48975ad8-1295-4b0f-9bd4-e6548d1f8479 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:01.494399 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-48975ad8-1295-4b0f-9bd4-e6548d1f8479 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:01.495103 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-48975ad8-1295-4b0f-9bd4-e6548d1f8479 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:01.495574 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-48975ad8-1295-4b0f-9bd4-e6548d1f8479 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:01.496007 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-48975ad8-1295-4b0f-9bd4-e6548d1f8479 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:01.553846 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-48975ad8-1295-4b0f-9bd4-e6548d1f8479 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "POST /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0/action" status: 204 len: 0 microversion: 2.1 time: 0.072554 Sep 08 11:41:01.554485 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3566/6999] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 11:41:01 2022] POST /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0/action => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:41:01.563563 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bee866f5-8d19-47fc-9e18-6d6eb130ca85 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:41:01.564159 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bee866f5-8d19-47fc-9e18-6d6eb130ca85 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: d2b1d042-8a22-4fe2-8b67-03b3376c8ce0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:41:01.571035 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bee866f5-8d19-47fc-9e18-6d6eb130ca85 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:01.572046 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bee866f5-8d19-47fc-9e18-6d6eb130ca85 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:01.572532 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bee866f5-8d19-47fc-9e18-6d6eb130ca85 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:01.573323 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bee866f5-8d19-47fc-9e18-6d6eb130ca85 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:01.574075 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bee866f5-8d19-47fc-9e18-6d6eb130ca85 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:01.574893 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bee866f5-8d19-47fc-9e18-6d6eb130ca85 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:01.805338 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bee866f5-8d19-47fc-9e18-6d6eb130ca85 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:41:01.813279 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bee866f5-8d19-47fc-9e18-6d6eb130ca85 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0" status: 200 len: 1679 microversion: 2.1 time: 0.253816 Sep 08 11:41:01.813936 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3434/7000] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:41:01 2022] GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 => generated 1679 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:41:02.840355 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f89ca546-971c-4cbc-bccd-325820705290 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:41:02.841131 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f89ca546-971c-4cbc-bccd-325820705290 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: d2b1d042-8a22-4fe2-8b67-03b3376c8ce0] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:41:02.848433 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f89ca546-971c-4cbc-bccd-325820705290 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:02.849213 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f89ca546-971c-4cbc-bccd-325820705290 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:02.849654 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f89ca546-971c-4cbc-bccd-325820705290 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:02.850379 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f89ca546-971c-4cbc-bccd-325820705290 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:02.850833 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f89ca546-971c-4cbc-bccd-325820705290 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:02.851255 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f89ca546-971c-4cbc-bccd-325820705290 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:02.999124 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f89ca546-971c-4cbc-bccd-325820705290 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:41:03.007642 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f89ca546-971c-4cbc-bccd-325820705290 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0" status: 200 len: 1679 microversion: 2.1 time: 0.174719 Sep 08 11:41:03.008861 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3567/7001] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:41:02 2022] GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 => generated 1679 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:41:04.034075 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-feec6bf5-6eec-4a5b-927c-f7589e83cb4e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:41:04.034712 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-feec6bf5-6eec-4a5b-927c-f7589e83cb4e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: d2b1d042-8a22-4fe2-8b67-03b3376c8ce0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:41:04.042066 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-feec6bf5-6eec-4a5b-927c-f7589e83cb4e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:04.042581 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-feec6bf5-6eec-4a5b-927c-f7589e83cb4e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:04.043041 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-feec6bf5-6eec-4a5b-927c-f7589e83cb4e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:04.043764 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-feec6bf5-6eec-4a5b-927c-f7589e83cb4e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:04.044245 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-feec6bf5-6eec-4a5b-927c-f7589e83cb4e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:04.044703 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-feec6bf5-6eec-4a5b-927c-f7589e83cb4e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:04.178063 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-feec6bf5-6eec-4a5b-927c-f7589e83cb4e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:41:04.186574 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-feec6bf5-6eec-4a5b-927c-f7589e83cb4e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0" status: 200 len: 1671 microversion: 2.1 time: 0.156463 Sep 08 11:41:04.187169 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3435/7002] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:41:04 2022] GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 => generated 1671 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:41:04.209349 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ada2b539-19a6-422f-8003-12b55059289a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:41:04.210013 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ada2b539-19a6-422f-8003-12b55059289a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: d2b1d042-8a22-4fe2-8b67-03b3376c8ce0] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:41:04.217704 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ada2b539-19a6-422f-8003-12b55059289a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:04.218201 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ada2b539-19a6-422f-8003-12b55059289a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:04.218645 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ada2b539-19a6-422f-8003-12b55059289a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:04.219346 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ada2b539-19a6-422f-8003-12b55059289a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:04.219807 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ada2b539-19a6-422f-8003-12b55059289a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:04.220239 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ada2b539-19a6-422f-8003-12b55059289a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:04.235799 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:41:04.354399 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ada2b539-19a6-422f-8003-12b55059289a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:41:04.362440 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ada2b539-19a6-422f-8003-12b55059289a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0" status: 200 len: 1671 microversion: 2.1 time: 0.156765 Sep 08 11:41:04.363008 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3568/7003] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:41:04 2022] GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 => generated 1671 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:41:04.385595 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1f3cf13e-a031-4933-b3d4-179c1ddb8593 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:41:04.386223 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1f3cf13e-a031-4933-b3d4-179c1ddb8593 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: d2b1d042-8a22-4fe2-8b67-03b3376c8ce0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:41:04.392201 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f3cf13e-a031-4933-b3d4-179c1ddb8593 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:04.392705 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f3cf13e-a031-4933-b3d4-179c1ddb8593 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:04.393187 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f3cf13e-a031-4933-b3d4-179c1ddb8593 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:04.393899 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f3cf13e-a031-4933-b3d4-179c1ddb8593 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:04.394366 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f3cf13e-a031-4933-b3d4-179c1ddb8593 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:04.394804 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f3cf13e-a031-4933-b3d4-179c1ddb8593 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:04.525241 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1f3cf13e-a031-4933-b3d4-179c1ddb8593 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:41:04.528752 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:41:04.534211 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1f3cf13e-a031-4933-b3d4-179c1ddb8593 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0" status: 200 len: 1671 microversion: 2.1 time: 0.152829 Sep 08 11:41:04.534783 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3436/7004] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:41:04 2022] GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 => generated 1671 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:41:04.555764 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-88a4c312-2089-4d9a-b7c5-c55dfcc016d9 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:41:04.556260 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-88a4c312-2089-4d9a-b7c5-c55dfcc016d9 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: d2b1d042-8a22-4fe2-8b67-03b3376c8ce0] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:41:04.562282 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88a4c312-2089-4d9a-b7c5-c55dfcc016d9 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:04.562761 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88a4c312-2089-4d9a-b7c5-c55dfcc016d9 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:04.563200 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88a4c312-2089-4d9a-b7c5-c55dfcc016d9 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:04.563882 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88a4c312-2089-4d9a-b7c5-c55dfcc016d9 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:04.564334 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88a4c312-2089-4d9a-b7c5-c55dfcc016d9 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:04.564755 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88a4c312-2089-4d9a-b7c5-c55dfcc016d9 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:04.590770 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-88a4c312-2089-4d9a-b7c5-c55dfcc016d9 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: d2b1d042-8a22-4fe2-8b67-03b3376c8ce0] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:41:04.665647 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-88a4c312-2089-4d9a-b7c5-c55dfcc016d9 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0" status: 204 len: 0 microversion: 2.1 time: 0.113444 Sep 08 11:41:04.666251 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3569/7005] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:41:04 2022] DELETE /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:41:04.676174 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6beb9663-600d-40da-abda-510d94854283 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:41:04.676811 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6beb9663-600d-40da-abda-510d94854283 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: d2b1d042-8a22-4fe2-8b67-03b3376c8ce0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:41:04.684262 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6beb9663-600d-40da-abda-510d94854283 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:04.684782 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6beb9663-600d-40da-abda-510d94854283 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:04.685281 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6beb9663-600d-40da-abda-510d94854283 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:04.686004 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6beb9663-600d-40da-abda-510d94854283 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:04.686476 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6beb9663-600d-40da-abda-510d94854283 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:04.686922 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6beb9663-600d-40da-abda-510d94854283 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:04.832075 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6beb9663-600d-40da-abda-510d94854283 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:41:04.842521 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6beb9663-600d-40da-abda-510d94854283 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0" status: 200 len: 1677 microversion: 2.1 time: 0.171374 Sep 08 11:41:04.843132 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3437/7006] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:41:04 2022] GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 => generated 1677 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:41:04.985140 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-5d329aca-0036-4388-bec3-e5a84181e111 req-fa9527e1-2f19-43b1-b3c4-0dae67bf0d75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2b1d042-8a22-4fe2-8b67-03b3376c8ce0", "name": "network-vif-plugged", "status": "completed", "tag": "4a47c552-2d6f-46fd-8b75-ebd5d65faa2b"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:41:04.996134 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-5d329aca-0036-4388-bec3-e5a84181e111 req-fa9527e1-2f19-43b1-b3c4-0dae67bf0d75 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:04.996605 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-5d329aca-0036-4388-bec3-e5a84181e111 req-fa9527e1-2f19-43b1-b3c4-0dae67bf0d75 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:04.997059 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-5d329aca-0036-4388-bec3-e5a84181e111 req-fa9527e1-2f19-43b1-b3c4-0dae67bf0d75 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:05.010884 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-5d329aca-0036-4388-bec3-e5a84181e111 req-fa9527e1-2f19-43b1-b3c4-0dae67bf0d75 service nova] Creating event network-vif-plugged:4a47c552-2d6f-46fd-8b75-ebd5d65faa2b for instance d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 on n-h1-850501-12 Sep 08 11:41:05.016466 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-5d329aca-0036-4388-bec3-e5a84181e111 req-fa9527e1-2f19-43b1-b3c4-0dae67bf0d75 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035048 Sep 08 11:41:05.016771 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3570/7007] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:41:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:41:05.866783 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ea90cae4-5b98-45fa-aff5-c3266a116e03 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:41:05.868155 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ea90cae4-5b98-45fa-aff5-c3266a116e03 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: d2b1d042-8a22-4fe2-8b67-03b3376c8ce0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:41:05.875600 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea90cae4-5b98-45fa-aff5-c3266a116e03 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:05.876115 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea90cae4-5b98-45fa-aff5-c3266a116e03 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:05.876564 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea90cae4-5b98-45fa-aff5-c3266a116e03 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:05.877325 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea90cae4-5b98-45fa-aff5-c3266a116e03 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:05.877800 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea90cae4-5b98-45fa-aff5-c3266a116e03 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:05.878248 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea90cae4-5b98-45fa-aff5-c3266a116e03 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:06.020529 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ea90cae4-5b98-45fa-aff5-c3266a116e03 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:41:06.028697 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ea90cae4-5b98-45fa-aff5-c3266a116e03 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0" status: 200 len: 1677 microversion: 2.1 time: 0.166329 Sep 08 11:41:06.029310 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3438/7008] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:41:05 2022] GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:41:06.998462 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-a0255ab3-b599-4a48-a9a7-c74649d24e09 req-bfb6fb94-7a39-4ed8-9b27-ca97d9bce851 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2b1d042-8a22-4fe2-8b67-03b3376c8ce0", "name": "network-vif-deleted", "tag": "4a47c552-2d6f-46fd-8b75-ebd5d65faa2b"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:41:07.010460 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-a0255ab3-b599-4a48-a9a7-c74649d24e09 req-bfb6fb94-7a39-4ed8-9b27-ca97d9bce851 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:07.011214 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-a0255ab3-b599-4a48-a9a7-c74649d24e09 req-bfb6fb94-7a39-4ed8-9b27-ca97d9bce851 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:07.011832 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-a0255ab3-b599-4a48-a9a7-c74649d24e09 req-bfb6fb94-7a39-4ed8-9b27-ca97d9bce851 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:07.025299 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-a0255ab3-b599-4a48-a9a7-c74649d24e09 req-bfb6fb94-7a39-4ed8-9b27-ca97d9bce851 service nova] Creating event network-vif-deleted:4a47c552-2d6f-46fd-8b75-ebd5d65faa2b for instance d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 on n-h1-850501-12 Sep 08 11:41:07.030156 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-a0255ab3-b599-4a48-a9a7-c74649d24e09 req-bfb6fb94-7a39-4ed8-9b27-ca97d9bce851 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036727 Sep 08 11:41:07.030768 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3571/7009] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:41:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:41:07.052057 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-08ab8ec1-832f-4970-b872-695a8357e48a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:41:07.053471 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-08ab8ec1-832f-4970-b872-695a8357e48a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: d2b1d042-8a22-4fe2-8b67-03b3376c8ce0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:41:07.061531 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08ab8ec1-832f-4970-b872-695a8357e48a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:07.062143 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08ab8ec1-832f-4970-b872-695a8357e48a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:07.062706 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08ab8ec1-832f-4970-b872-695a8357e48a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:07.063501 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08ab8ec1-832f-4970-b872-695a8357e48a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:07.064188 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08ab8ec1-832f-4970-b872-695a8357e48a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:07.064859 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08ab8ec1-832f-4970-b872-695a8357e48a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:07.135559 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-08ab8ec1-832f-4970-b872-695a8357e48a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:41:07.143757 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-08ab8ec1-832f-4970-b872-695a8357e48a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0" status: 200 len: 1324 microversion: 2.1 time: 0.095577 Sep 08 11:41:07.144512 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3439/7010] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:41:07 2022] GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 => generated 1324 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:41:08.169827 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-73c6385f-6382-4d38-bad6-8a90de81b25d tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:41:08.170569 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-73c6385f-6382-4d38-bad6-8a90de81b25d tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: d2b1d042-8a22-4fe2-8b67-03b3376c8ce0] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:41:08.172634 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:41:08.178914 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-73c6385f-6382-4d38-bad6-8a90de81b25d tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:08.179410 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-73c6385f-6382-4d38-bad6-8a90de81b25d tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:08.179976 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-73c6385f-6382-4d38-bad6-8a90de81b25d tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:08.180972 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-73c6385f-6382-4d38-bad6-8a90de81b25d tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:08.181544 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-73c6385f-6382-4d38-bad6-8a90de81b25d tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:08.181976 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-73c6385f-6382-4d38-bad6-8a90de81b25d tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:08.199216 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-73c6385f-6382-4d38-bad6-8a90de81b25d tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] HTTP exception thrown: Instance d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 could not be found. Sep 08 11:41:08.200875 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-73c6385f-6382-4d38-bad6-8a90de81b25d tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Request method failure captured: Sep 08 11:41:08.200875 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 HTTP/1.1 Sep 08 11:41:08.200875 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:41:08.200875 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:41:08.200875 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:41:08.200875 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 11:41:08.200875 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:41:08.200875 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:41:08.200875 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:41:08.200875 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:41:08.200875 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGdSDvOwoS57OkYb_-Yl1XUx78kih9MULmYIyzFLt-u36W2wjj2KtWXAZ7aX14KpVLwWCBvBeF4bTqW87i3VTvG-qHq5mt1bIpxmJHowTqwKpzB7zzorSV7BPwI-U0G6PWcbOtFoIJUt5uu58duhf3xUQD9p0cNz13ICJbtKWoYuCsmY Sep 08 11:41:08.200875 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:41:08.200875 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:41:08.200875 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:41:08.200875 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:41:08.200875 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:41:08.200875 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:41:08.200875 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 5e7adfbb1417415b9eafeeb23b7a7c18 Sep 08 11:41:08.200875 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServerActionsTestJSON-143982609 Sep 08 11:41:08.200875 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:41:08.200875 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:41:08.200875 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5e7adfbb1417415b9eafeeb23b7a7c18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5e7adfbb1417415b9eafeeb23b7a7c18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5e7adfbb1417415b9eafeeb23b7a7c18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5e7adfbb1417415b9eafeeb23b7a7c18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:41:08.200875 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServerActionsTestJSON-143982609 Sep 08 11:41:08.200875 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 5e7adfbb1417415b9eafeeb23b7a7c18 Sep 08 11:41:08.200875 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServerActionsTestJSON-143982609 Sep 08 11:41:08.200875 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServerActionsTestJSON-143982609-project Sep 08 11:41:08.200875 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:41:08.200875 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:41:08.200875 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: f38a21e862664942bf35c93870df1c36 Sep 08 11:41:08.200875 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServerActionsTestJSON-143982609-project Sep 08 11:41:08.200875 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 11:41:08.200875 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 could not be found. Sep 08 11:41:08.200875 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': 'd2b1d042-8a22-4fe2-8b67-03b3376c8ce0'} Sep 08 11:41:08.200875 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:41:08.200875 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:41:08.200875 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:41:08.200875 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:41:08.200875 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:41:08.200875 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:41:08.200875 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:41:08.200875 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:41:08.200875 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:41:08.200875 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:41:08.200875 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 could not be found. Sep 08 11:41:08.200875 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:41:08.200875 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:41:08.200875 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:41:08.200875 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:41:08.200875 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:41:08.200875 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:41:08.200875 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:41:08.200875 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:41:08.200875 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:41:08.200875 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:41:08.200875 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:41:08.200875 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:41:08.200875 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:41:08.200875 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:41:08.200875 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:41:08.200875 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:41:08.200875 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 could not be found. Sep 08 11:41:08.200875 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:41:08.200875 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:41:08.200875 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:41:08.205281 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:41:08.205281 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:41:08.205281 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:41:08.205281 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:41:08.205281 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:41:08.205281 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 could not be found. Sep 08 11:41:08.205281 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:41:08.205281 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-73c6385f-6382-4d38-bad6-8a90de81b25d tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Returning 404 to user: Instance d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:41:08.205281 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-73c6385f-6382-4d38-bad6-8a90de81b25d tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0" status: 404 len: 111 microversion: 2.1 time: 0.038439 Sep 08 11:41:08.205281 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3572/7011] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:41:08 2022] GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:41:08.215349 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-180a4863-331c-4ff4-a050-d85fefd9d984 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:41:08.215925 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-180a4863-331c-4ff4-a050-d85fefd9d984 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: d2b1d042-8a22-4fe2-8b67-03b3376c8ce0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:41:08.218751 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=43 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:41:08.224699 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-180a4863-331c-4ff4-a050-d85fefd9d984 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:08.225245 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-180a4863-331c-4ff4-a050-d85fefd9d984 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:08.225734 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-180a4863-331c-4ff4-a050-d85fefd9d984 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:08.226462 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-180a4863-331c-4ff4-a050-d85fefd9d984 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:08.227170 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-180a4863-331c-4ff4-a050-d85fefd9d984 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:08.227781 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-180a4863-331c-4ff4-a050-d85fefd9d984 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:08.241860 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-180a4863-331c-4ff4-a050-d85fefd9d984 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] HTTP exception thrown: Instance d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 could not be found. Sep 08 11:41:08.243999 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-180a4863-331c-4ff4-a050-d85fefd9d984 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Request method failure captured: Sep 08 11:41:08.243999 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 HTTP/1.1 Sep 08 11:41:08.243999 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 11:41:08.243999 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 11:41:08.243999 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 11:41:08.243999 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 11:41:08.243999 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 11:41:08.243999 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 11:41:08.243999 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 11:41:08.243999 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 11:41:08.243999 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGdSDvOwoS57OkYb_-Yl1XUx78kih9MULmYIyzFLt-u36W2wjj2KtWXAZ7aX14KpVLwWCBvBeF4bTqW87i3VTvG-qHq5mt1bIpxmJHowTqwKpzB7zzorSV7BPwI-U0G6PWcbOtFoIJUt5uu58duhf3xUQD9p0cNz13ICJbtKWoYuCsmY Sep 08 11:41:08.243999 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 11:41:08.243999 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 11:41:08.243999 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 11:41:08.243999 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 11:41:08.243999 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 11:41:08.243999 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 11:41:08.243999 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 5e7adfbb1417415b9eafeeb23b7a7c18 Sep 08 11:41:08.243999 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServerActionsTestJSON-143982609 Sep 08 11:41:08.243999 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 11:41:08.243999 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 11:41:08.243999 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5e7adfbb1417415b9eafeeb23b7a7c18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5e7adfbb1417415b9eafeeb23b7a7c18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5e7adfbb1417415b9eafeeb23b7a7c18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5e7adfbb1417415b9eafeeb23b7a7c18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:41:08.243999 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServerActionsTestJSON-143982609 Sep 08 11:41:08.243999 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 5e7adfbb1417415b9eafeeb23b7a7c18 Sep 08 11:41:08.243999 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServerActionsTestJSON-143982609 Sep 08 11:41:08.243999 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServerActionsTestJSON-143982609-project Sep 08 11:41:08.243999 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 11:41:08.243999 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 11:41:08.243999 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: f38a21e862664942bf35c93870df1c36 Sep 08 11:41:08.243999 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServerActionsTestJSON-143982609-project Sep 08 11:41:08.243999 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 11:41:08.243999 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 could not be found. Sep 08 11:41:08.243999 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'd2b1d042-8a22-4fe2-8b67-03b3376c8ce0'} Sep 08 11:41:08.243999 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:41:08.243999 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:41:08.243999 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:41:08.243999 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:41:08.243999 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:41:08.243999 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:41:08.243999 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:41:08.243999 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:41:08.243999 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:41:08.243999 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:41:08.243999 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 could not be found. Sep 08 11:41:08.243999 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:41:08.243999 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:41:08.243999 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:41:08.243999 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:41:08.243999 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:41:08.243999 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:41:08.243999 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:41:08.243999 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:41:08.243999 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:41:08.243999 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:41:08.243999 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:41:08.243999 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:41:08.243999 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:41:08.243999 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:41:08.243999 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:41:08.243999 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:41:08.243999 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 could not be found. Sep 08 11:41:08.243999 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:41:08.243999 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:41:08.243999 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:41:08.248866 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:41:08.248866 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:41:08.248866 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:41:08.248866 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:41:08.248866 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:41:08.248866 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 could not be found. Sep 08 11:41:08.248866 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:41:08.248866 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-180a4863-331c-4ff4-a050-d85fefd9d984 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Returning 404 to user: Instance d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:41:08.248866 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-180a4863-331c-4ff4-a050-d85fefd9d984 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0" status: 404 len: 111 microversion: 2.1 time: 0.034585 Sep 08 11:41:08.248866 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3440/7012] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:41:08 2022] GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 11:41:08.294667 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2d2238cf-973e-41a1-8cc4-95397a3fdc90 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-239354095", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "99f4db14-10f1-4ebf-99cd-d7459087f008"}], "security_groups": [{"name": "tempest-securitygroup--1605450961"}], "key_name": "tempest-keypair-1229154192", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:41:08.406011 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-2d2238cf-973e-41a1-8cc4-95397a3fdc90 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] validate_networks() for [('99f4db14-10f1-4ebf-99cd-d7459087f008', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:41:08.774000 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-2d2238cf-973e-41a1-8cc4-95397a3fdc90 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:41:08.774422 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-2d2238cf-973e-41a1-8cc4-95397a3fdc90 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:41:08.774903 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-2d2238cf-973e-41a1-8cc4-95397a3fdc90 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:41:08.775353 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-2d2238cf-973e-41a1-8cc4-95397a3fdc90 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:41:08.775803 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-2d2238cf-973e-41a1-8cc4-95397a3fdc90 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:41:08.784675 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2d2238cf-973e-41a1-8cc4-95397a3fdc90 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:08.785218 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2d2238cf-973e-41a1-8cc4-95397a3fdc90 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:08.785664 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2d2238cf-973e-41a1-8cc4-95397a3fdc90 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:08.786399 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2d2238cf-973e-41a1-8cc4-95397a3fdc90 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:08.786859 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2d2238cf-973e-41a1-8cc4-95397a3fdc90 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:08.787291 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2d2238cf-973e-41a1-8cc4-95397a3fdc90 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:08.803831 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-2d2238cf-973e-41a1-8cc4-95397a3fdc90 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Getting quotas for project 5e7adfbb1417415b9eafeeb23b7a7c18. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:41:08.809847 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-2d2238cf-973e-41a1-8cc4-95397a3fdc90 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Getting quotas for user f38a21e862664942bf35c93870df1c36 and project 5e7adfbb1417415b9eafeeb23b7a7c18. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:41:08.822889 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2d2238cf-973e-41a1-8cc4-95397a3fdc90 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:41:08.825249 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2d2238cf-973e-41a1-8cc4-95397a3fdc90 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 753dbd0e-be58-4254-9250-230a680bbc81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:41:08.872485 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2d2238cf-973e-41a1-8cc4-95397a3fdc90 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.581642 Sep 08 11:41:08.879382 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3573/7013] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 11:41:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:41:08.885467 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-45376634-8dbd-4470-b00a-43974203540c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:41:08.890904 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-45376634-8dbd-4470-b00a-43974203540c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 753dbd0e-be58-4254-9250-230a680bbc81] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:41:08.948767 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-45376634-8dbd-4470-b00a-43974203540c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:41:08.956674 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-45376634-8dbd-4470-b00a-43974203540c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81" status: 200 len: 1238 microversion: 2.1 time: 0.075988 Sep 08 11:41:08.957594 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3441/7014] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:41:08 2022] GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81 => generated 1238 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:41:09.982554 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b119e612-4320-4db3-950f-0a56f4f1faae tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:41:09.983410 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b119e612-4320-4db3-950f-0a56f4f1faae tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 753dbd0e-be58-4254-9250-230a680bbc81] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:41:09.992996 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b119e612-4320-4db3-950f-0a56f4f1faae tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:09.993677 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b119e612-4320-4db3-950f-0a56f4f1faae tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:09.994275 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b119e612-4320-4db3-950f-0a56f4f1faae tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:09.995778 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b119e612-4320-4db3-950f-0a56f4f1faae tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:09.995778 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b119e612-4320-4db3-950f-0a56f4f1faae tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:09.996018 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b119e612-4320-4db3-950f-0a56f4f1faae tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:10.080411 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b119e612-4320-4db3-950f-0a56f4f1faae tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:41:10.088999 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b119e612-4320-4db3-950f-0a56f4f1faae tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81" status: 200 len: 1296 microversion: 2.1 time: 0.112885 Sep 08 11:41:10.089895 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3574/7015] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:41:09 2022] GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81 => generated 1296 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:41:11.114660 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3fc49421-3cec-4a2e-888d-d56de98e90f6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:41:11.115298 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3fc49421-3cec-4a2e-888d-d56de98e90f6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 753dbd0e-be58-4254-9250-230a680bbc81] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:41:11.124252 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3fc49421-3cec-4a2e-888d-d56de98e90f6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:11.124767 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3fc49421-3cec-4a2e-888d-d56de98e90f6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:11.125257 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3fc49421-3cec-4a2e-888d-d56de98e90f6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:11.125981 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3fc49421-3cec-4a2e-888d-d56de98e90f6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:11.126467 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3fc49421-3cec-4a2e-888d-d56de98e90f6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:11.127228 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3fc49421-3cec-4a2e-888d-d56de98e90f6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:11.269491 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3fc49421-3cec-4a2e-888d-d56de98e90f6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:41:11.278121 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3fc49421-3cec-4a2e-888d-d56de98e90f6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81" status: 200 len: 1364 microversion: 2.1 time: 0.167635 Sep 08 11:41:11.278722 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3442/7016] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:41:11 2022] GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81 => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:41:11.290061 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-e028c6b4-af79-4b05-b653-64a51e6d870b req-f875411b-1400-44e2-be20-89ef2322f8b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "753dbd0e-be58-4254-9250-230a680bbc81", "tag": "82d0ddb6-c98c-4ea9-9fa6-8ebbdb376653"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:41:11.301155 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-e028c6b4-af79-4b05-b653-64a51e6d870b req-f875411b-1400-44e2-be20-89ef2322f8b6 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:11.301796 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-e028c6b4-af79-4b05-b653-64a51e6d870b req-f875411b-1400-44e2-be20-89ef2322f8b6 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:11.302458 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-e028c6b4-af79-4b05-b653-64a51e6d870b req-f875411b-1400-44e2-be20-89ef2322f8b6 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:11.315090 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-e028c6b4-af79-4b05-b653-64a51e6d870b req-f875411b-1400-44e2-be20-89ef2322f8b6 service nova] Creating event network-changed:82d0ddb6-c98c-4ea9-9fa6-8ebbdb376653 for instance 753dbd0e-be58-4254-9250-230a680bbc81 on n-h1-850501-12 Sep 08 11:41:11.320763 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-e028c6b4-af79-4b05-b653-64a51e6d870b req-f875411b-1400-44e2-be20-89ef2322f8b6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035588 Sep 08 11:41:11.321434 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3575/7017] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:41:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:41:12.302914 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-25bbe4a2-5370-4af6-ba56-564f4c8b9691 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:41:12.303564 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-25bbe4a2-5370-4af6-ba56-564f4c8b9691 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 753dbd0e-be58-4254-9250-230a680bbc81] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:41:12.310714 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25bbe4a2-5370-4af6-ba56-564f4c8b9691 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:12.311220 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25bbe4a2-5370-4af6-ba56-564f4c8b9691 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:12.311673 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25bbe4a2-5370-4af6-ba56-564f4c8b9691 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:12.312393 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25bbe4a2-5370-4af6-ba56-564f4c8b9691 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:12.312867 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25bbe4a2-5370-4af6-ba56-564f4c8b9691 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:12.313343 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25bbe4a2-5370-4af6-ba56-564f4c8b9691 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:12.466271 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-25bbe4a2-5370-4af6-ba56-564f4c8b9691 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:41:12.474186 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-25bbe4a2-5370-4af6-ba56-564f4c8b9691 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81" status: 200 len: 1364 microversion: 2.1 time: 0.175216 Sep 08 11:41:12.474764 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3443/7018] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:41:12 2022] GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81 => generated 1364 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:41:13.499393 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9d873590-9dc8-4b3d-a300-0bc86edc398e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:41:13.500090 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9d873590-9dc8-4b3d-a300-0bc86edc398e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 753dbd0e-be58-4254-9250-230a680bbc81] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:41:13.506669 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9d873590-9dc8-4b3d-a300-0bc86edc398e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:13.507160 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9d873590-9dc8-4b3d-a300-0bc86edc398e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:13.507589 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9d873590-9dc8-4b3d-a300-0bc86edc398e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:13.509259 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9d873590-9dc8-4b3d-a300-0bc86edc398e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:13.509506 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9d873590-9dc8-4b3d-a300-0bc86edc398e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:13.509932 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9d873590-9dc8-4b3d-a300-0bc86edc398e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:13.929243 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9d873590-9dc8-4b3d-a300-0bc86edc398e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:41:13.937627 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9d873590-9dc8-4b3d-a300-0bc86edc398e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81" status: 200 len: 1364 microversion: 2.1 time: 0.443387 Sep 08 11:41:13.938392 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3576/7019] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:41:13 2022] GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81 => generated 1364 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:41:14.962172 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-803a24d3-2c71-41f4-961a-453fb54063b6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:41:14.962951 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-803a24d3-2c71-41f4-961a-453fb54063b6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 753dbd0e-be58-4254-9250-230a680bbc81] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:41:14.969693 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-803a24d3-2c71-41f4-961a-453fb54063b6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:14.970206 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-803a24d3-2c71-41f4-961a-453fb54063b6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:14.970660 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-803a24d3-2c71-41f4-961a-453fb54063b6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:14.971383 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-803a24d3-2c71-41f4-961a-453fb54063b6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:14.971860 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-803a24d3-2c71-41f4-961a-453fb54063b6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:14.972311 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-803a24d3-2c71-41f4-961a-453fb54063b6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:15.110107 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-803a24d3-2c71-41f4-961a-453fb54063b6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:41:15.118854 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-803a24d3-2c71-41f4-961a-453fb54063b6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81" status: 200 len: 1364 microversion: 2.1 time: 0.161024 Sep 08 11:41:15.119823 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3444/7020] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:41:14 2022] GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:41:16.143307 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-904c9335-6151-49e8-8689-7bb2e2e2a757 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:41:16.143855 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-904c9335-6151-49e8-8689-7bb2e2e2a757 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 753dbd0e-be58-4254-9250-230a680bbc81] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:41:16.151035 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-904c9335-6151-49e8-8689-7bb2e2e2a757 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:16.151561 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-904c9335-6151-49e8-8689-7bb2e2e2a757 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:16.152006 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-904c9335-6151-49e8-8689-7bb2e2e2a757 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:16.153142 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-904c9335-6151-49e8-8689-7bb2e2e2a757 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:16.153613 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-904c9335-6151-49e8-8689-7bb2e2e2a757 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:16.154047 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-904c9335-6151-49e8-8689-7bb2e2e2a757 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:16.284375 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-904c9335-6151-49e8-8689-7bb2e2e2a757 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:41:16.292492 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-904c9335-6151-49e8-8689-7bb2e2e2a757 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81" status: 200 len: 1364 microversion: 2.1 time: 0.153387 Sep 08 11:41:16.293096 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3577/7021] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:41:16 2022] GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:41:17.049151 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-aa62f35a-b245-4afb-96d9-61ca5dbeda41 req-579c50ba-0a5c-47b2-b6d4-9ee83cbef445 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "753dbd0e-be58-4254-9250-230a680bbc81", "name": "network-vif-plugged", "status": "completed", "tag": "82d0ddb6-c98c-4ea9-9fa6-8ebbdb376653"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:41:17.061780 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-aa62f35a-b245-4afb-96d9-61ca5dbeda41 req-579c50ba-0a5c-47b2-b6d4-9ee83cbef445 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:17.062201 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-aa62f35a-b245-4afb-96d9-61ca5dbeda41 req-579c50ba-0a5c-47b2-b6d4-9ee83cbef445 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:17.062717 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-aa62f35a-b245-4afb-96d9-61ca5dbeda41 req-579c50ba-0a5c-47b2-b6d4-9ee83cbef445 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:17.075197 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-aa62f35a-b245-4afb-96d9-61ca5dbeda41 req-579c50ba-0a5c-47b2-b6d4-9ee83cbef445 service nova] Creating event network-vif-plugged:82d0ddb6-c98c-4ea9-9fa6-8ebbdb376653 for instance 753dbd0e-be58-4254-9250-230a680bbc81 on n-h1-850501-12 Sep 08 11:41:17.080452 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-aa62f35a-b245-4afb-96d9-61ca5dbeda41 req-579c50ba-0a5c-47b2-b6d4-9ee83cbef445 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035189 Sep 08 11:41:17.081771 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3445/7022] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:41:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:41:17.316933 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f679f68f-34cd-41af-b42e-5048aabccc04 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:41:17.317556 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f679f68f-34cd-41af-b42e-5048aabccc04 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 753dbd0e-be58-4254-9250-230a680bbc81] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:41:17.325162 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f679f68f-34cd-41af-b42e-5048aabccc04 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:17.325653 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f679f68f-34cd-41af-b42e-5048aabccc04 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:17.326087 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f679f68f-34cd-41af-b42e-5048aabccc04 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:17.326783 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f679f68f-34cd-41af-b42e-5048aabccc04 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:17.327238 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f679f68f-34cd-41af-b42e-5048aabccc04 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:17.327661 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f679f68f-34cd-41af-b42e-5048aabccc04 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:17.459300 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f679f68f-34cd-41af-b42e-5048aabccc04 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:41:17.468676 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f679f68f-34cd-41af-b42e-5048aabccc04 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81" status: 200 len: 1364 microversion: 2.1 time: 0.155654 Sep 08 11:41:17.469284 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3578/7023] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:41:17 2022] GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:41:18.491966 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-25f41271-f95a-4aac-bec8-9cb1d126e0c4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:41:18.492773 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-25f41271-f95a-4aac-bec8-9cb1d126e0c4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 753dbd0e-be58-4254-9250-230a680bbc81] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:41:18.499830 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25f41271-f95a-4aac-bec8-9cb1d126e0c4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:18.500333 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25f41271-f95a-4aac-bec8-9cb1d126e0c4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:18.500785 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25f41271-f95a-4aac-bec8-9cb1d126e0c4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:18.501525 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25f41271-f95a-4aac-bec8-9cb1d126e0c4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:18.501997 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25f41271-f95a-4aac-bec8-9cb1d126e0c4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:18.502445 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25f41271-f95a-4aac-bec8-9cb1d126e0c4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:18.634210 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-25f41271-f95a-4aac-bec8-9cb1d126e0c4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:41:18.641966 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-25f41271-f95a-4aac-bec8-9cb1d126e0c4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81" status: 200 len: 1550 microversion: 2.1 time: 0.154550 Sep 08 11:41:18.642537 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3446/7024] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:41:18 2022] GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81 => generated 1550 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:41:18.666665 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2479d5c8-d7d2-47ad-a6c5-d5cc6450bb7a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:41:18.667201 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2479d5c8-d7d2-47ad-a6c5-d5cc6450bb7a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 753dbd0e-be58-4254-9250-230a680bbc81] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:41:18.674004 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2479d5c8-d7d2-47ad-a6c5-d5cc6450bb7a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:18.674495 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2479d5c8-d7d2-47ad-a6c5-d5cc6450bb7a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:18.674935 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2479d5c8-d7d2-47ad-a6c5-d5cc6450bb7a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:18.675626 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2479d5c8-d7d2-47ad-a6c5-d5cc6450bb7a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:18.676089 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2479d5c8-d7d2-47ad-a6c5-d5cc6450bb7a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:18.676516 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2479d5c8-d7d2-47ad-a6c5-d5cc6450bb7a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:18.764949 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2479d5c8-d7d2-47ad-a6c5-d5cc6450bb7a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102658 Sep 08 11:41:18.765577 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3579/7025] 10.222.0.27 () {58 vars in 1275 bytes} [Thu Sep 8 11:41:18 2022] GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:41:20.031824 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:41:20.085789 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-4e36225c-59e0-42b6-b7bb-78ce0ce4090f req-73cefa53-a008-4c69-b275-1e5498dc7a55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "753dbd0e-be58-4254-9250-230a680bbc81", "tag": "82d0ddb6-c98c-4ea9-9fa6-8ebbdb376653"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:41:20.096264 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-4e36225c-59e0-42b6-b7bb-78ce0ce4090f req-73cefa53-a008-4c69-b275-1e5498dc7a55 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:20.096879 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-4e36225c-59e0-42b6-b7bb-78ce0ce4090f req-73cefa53-a008-4c69-b275-1e5498dc7a55 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:20.097540 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-4e36225c-59e0-42b6-b7bb-78ce0ce4090f req-73cefa53-a008-4c69-b275-1e5498dc7a55 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:20.109750 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-4e36225c-59e0-42b6-b7bb-78ce0ce4090f req-73cefa53-a008-4c69-b275-1e5498dc7a55 service nova] Creating event network-changed:82d0ddb6-c98c-4ea9-9fa6-8ebbdb376653 for instance 753dbd0e-be58-4254-9250-230a680bbc81 on n-h1-850501-12 Sep 08 11:41:20.115296 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-4e36225c-59e0-42b6-b7bb-78ce0ce4090f req-73cefa53-a008-4c69-b275-1e5498dc7a55 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088120 Sep 08 11:41:20.116102 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3447/7026] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:41:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:41:54.984270 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:41:54.985551 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=6 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:41:54.988913 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:41:54.989989 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:41:54.995606 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-137e7b0a-4648-4501-9544-d5266cdb1191 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:41:55.006080 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-137e7b0a-4648-4501-9544-d5266cdb1191 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:55.006789 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-137e7b0a-4648-4501-9544-d5266cdb1191 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:55.007243 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-137e7b0a-4648-4501-9544-d5266cdb1191 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:55.043319 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-137e7b0a-4648-4501-9544-d5266cdb1191 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 753dbd0e-be58-4254-9250-230a680bbc81] Going to try to stop instance {{(pid=128861) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 08 11:41:55.101246 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-137e7b0a-4648-4501-9544-d5266cdb1191 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "POST /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81/action" status: 202 len: 0 microversion: 2.1 time: 0.118274 Sep 08 11:41:55.101932 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3580/7027] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 11:41:54 2022] POST /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:41:55.110897 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-67b81e39-400a-4867-9551-a1cb62c1eca0 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:41:55.111619 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-67b81e39-400a-4867-9551-a1cb62c1eca0 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 753dbd0e-be58-4254-9250-230a680bbc81] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:41:55.114397 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=17 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:41:55.115071 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=48 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:41:55.121091 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67b81e39-400a-4867-9551-a1cb62c1eca0 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:55.121622 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67b81e39-400a-4867-9551-a1cb62c1eca0 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:55.122671 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67b81e39-400a-4867-9551-a1cb62c1eca0 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:55.123589 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67b81e39-400a-4867-9551-a1cb62c1eca0 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:55.124083 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67b81e39-400a-4867-9551-a1cb62c1eca0 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:55.124612 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67b81e39-400a-4867-9551-a1cb62c1eca0 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:55.296329 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-67b81e39-400a-4867-9551-a1cb62c1eca0 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:41:55.304921 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-67b81e39-400a-4867-9551-a1cb62c1eca0 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81" status: 200 len: 1679 microversion: 2.1 time: 0.198262 Sep 08 11:41:55.305548 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3448/7028] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:41:55 2022] GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81 => generated 1679 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:41:56.330771 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-75865262-9ee7-4f0c-86e1-eae312c56010 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:41:56.331470 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-75865262-9ee7-4f0c-86e1-eae312c56010 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 753dbd0e-be58-4254-9250-230a680bbc81] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:41:56.337711 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-75865262-9ee7-4f0c-86e1-eae312c56010 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:56.338190 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-75865262-9ee7-4f0c-86e1-eae312c56010 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:56.338623 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-75865262-9ee7-4f0c-86e1-eae312c56010 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:56.339316 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-75865262-9ee7-4f0c-86e1-eae312c56010 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:56.339771 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-75865262-9ee7-4f0c-86e1-eae312c56010 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:56.340192 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-75865262-9ee7-4f0c-86e1-eae312c56010 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:56.479756 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-75865262-9ee7-4f0c-86e1-eae312c56010 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:41:56.487929 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-75865262-9ee7-4f0c-86e1-eae312c56010 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81" status: 200 len: 1679 microversion: 2.1 time: 0.162734 Sep 08 11:41:56.488505 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3581/7029] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:41:56 2022] GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81 => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:41:57.511006 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dca7c2ae-9ae7-467f-bac1-83613424be87 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:41:57.511621 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-dca7c2ae-9ae7-467f-bac1-83613424be87 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 753dbd0e-be58-4254-9250-230a680bbc81] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:41:57.519954 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dca7c2ae-9ae7-467f-bac1-83613424be87 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:57.520468 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dca7c2ae-9ae7-467f-bac1-83613424be87 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:57.520925 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dca7c2ae-9ae7-467f-bac1-83613424be87 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:57.521682 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dca7c2ae-9ae7-467f-bac1-83613424be87 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:57.522160 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dca7c2ae-9ae7-467f-bac1-83613424be87 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:57.522608 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dca7c2ae-9ae7-467f-bac1-83613424be87 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:57.656033 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-dca7c2ae-9ae7-467f-bac1-83613424be87 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:41:57.663904 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-dca7c2ae-9ae7-467f-bac1-83613424be87 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81" status: 200 len: 1679 microversion: 2.1 time: 0.156816 Sep 08 11:41:57.664486 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3449/7030] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:41:57 2022] GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:41:58.686769 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2b0b6b83-a4f9-4aed-906b-eccb2ff72754 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:41:58.687393 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2b0b6b83-a4f9-4aed-906b-eccb2ff72754 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 753dbd0e-be58-4254-9250-230a680bbc81] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:41:58.694263 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2b0b6b83-a4f9-4aed-906b-eccb2ff72754 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:58.694752 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2b0b6b83-a4f9-4aed-906b-eccb2ff72754 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:58.695190 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2b0b6b83-a4f9-4aed-906b-eccb2ff72754 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:58.695889 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2b0b6b83-a4f9-4aed-906b-eccb2ff72754 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:58.696347 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2b0b6b83-a4f9-4aed-906b-eccb2ff72754 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:58.696776 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2b0b6b83-a4f9-4aed-906b-eccb2ff72754 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:58.827235 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2b0b6b83-a4f9-4aed-906b-eccb2ff72754 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:41:58.834933 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2b0b6b83-a4f9-4aed-906b-eccb2ff72754 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81" status: 200 len: 1679 microversion: 2.1 time: 0.152096 Sep 08 11:41:58.835507 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3582/7031] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:41:58 2022] GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:41:59.860497 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-21149557-f7ed-463c-bab2-f00339e5e61d tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:41:59.861145 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-21149557-f7ed-463c-bab2-f00339e5e61d tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 753dbd0e-be58-4254-9250-230a680bbc81] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:41:59.868019 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-21149557-f7ed-463c-bab2-f00339e5e61d tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:59.868517 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-21149557-f7ed-463c-bab2-f00339e5e61d tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:59.868965 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-21149557-f7ed-463c-bab2-f00339e5e61d tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:59.869697 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-21149557-f7ed-463c-bab2-f00339e5e61d tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:59.870166 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-21149557-f7ed-463c-bab2-f00339e5e61d tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:59.870609 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-21149557-f7ed-463c-bab2-f00339e5e61d tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:00.007348 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-21149557-f7ed-463c-bab2-f00339e5e61d tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:42:00.015883 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-21149557-f7ed-463c-bab2-f00339e5e61d tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81" status: 200 len: 1679 microversion: 2.1 time: 0.159889 Sep 08 11:42:00.016504 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3450/7032] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:41:59 2022] GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:42:01.047396 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2a44bb2a-9b24-4409-a88a-5c4ec3f54c9c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:42:01.048233 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2a44bb2a-9b24-4409-a88a-5c4ec3f54c9c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 753dbd0e-be58-4254-9250-230a680bbc81] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:42:01.055215 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2a44bb2a-9b24-4409-a88a-5c4ec3f54c9c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:01.055758 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2a44bb2a-9b24-4409-a88a-5c4ec3f54c9c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:01.056199 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2a44bb2a-9b24-4409-a88a-5c4ec3f54c9c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:01.056910 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2a44bb2a-9b24-4409-a88a-5c4ec3f54c9c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:01.057403 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2a44bb2a-9b24-4409-a88a-5c4ec3f54c9c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:01.057830 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2a44bb2a-9b24-4409-a88a-5c4ec3f54c9c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:01.191584 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2a44bb2a-9b24-4409-a88a-5c4ec3f54c9c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:42:01.199765 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2a44bb2a-9b24-4409-a88a-5c4ec3f54c9c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81" status: 200 len: 1679 microversion: 2.1 time: 0.157001 Sep 08 11:42:01.200622 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3583/7033] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:42:01 2022] GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:42:02.222483 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-048db4eb-51b4-45d3-bce7-052d6187a874 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:42:02.223113 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-048db4eb-51b4-45d3-bce7-052d6187a874 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 753dbd0e-be58-4254-9250-230a680bbc81] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:42:02.230340 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-048db4eb-51b4-45d3-bce7-052d6187a874 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:02.230841 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-048db4eb-51b4-45d3-bce7-052d6187a874 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:02.231829 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-048db4eb-51b4-45d3-bce7-052d6187a874 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:02.232547 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-048db4eb-51b4-45d3-bce7-052d6187a874 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:02.233019 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-048db4eb-51b4-45d3-bce7-052d6187a874 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:02.233480 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-048db4eb-51b4-45d3-bce7-052d6187a874 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:02.367342 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-048db4eb-51b4-45d3-bce7-052d6187a874 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:42:02.375787 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-048db4eb-51b4-45d3-bce7-052d6187a874 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81" status: 200 len: 1679 microversion: 2.1 time: 0.157243 Sep 08 11:42:02.376370 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3451/7034] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:42:02 2022] GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:42:03.398979 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-300140df-daa2-43b6-95c6-e48e5e06ec33 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:42:03.399605 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-300140df-daa2-43b6-95c6-e48e5e06ec33 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 753dbd0e-be58-4254-9250-230a680bbc81] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:42:03.406999 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-300140df-daa2-43b6-95c6-e48e5e06ec33 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:03.407497 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-300140df-daa2-43b6-95c6-e48e5e06ec33 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:03.407942 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-300140df-daa2-43b6-95c6-e48e5e06ec33 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:03.408682 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-300140df-daa2-43b6-95c6-e48e5e06ec33 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:03.409180 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-300140df-daa2-43b6-95c6-e48e5e06ec33 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:03.409620 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-300140df-daa2-43b6-95c6-e48e5e06ec33 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:03.538572 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-300140df-daa2-43b6-95c6-e48e5e06ec33 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:42:03.546435 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-300140df-daa2-43b6-95c6-e48e5e06ec33 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81" status: 200 len: 1679 microversion: 2.1 time: 0.151345 Sep 08 11:42:03.547008 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3584/7035] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:42:03 2022] GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:42:04.571924 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4a5f480f-d7bd-4567-a94e-8c4690ead377 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:42:04.572537 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4a5f480f-d7bd-4567-a94e-8c4690ead377 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 753dbd0e-be58-4254-9250-230a680bbc81] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:42:04.580078 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a5f480f-d7bd-4567-a94e-8c4690ead377 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:04.580588 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a5f480f-d7bd-4567-a94e-8c4690ead377 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:04.581054 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a5f480f-d7bd-4567-a94e-8c4690ead377 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:04.581770 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a5f480f-d7bd-4567-a94e-8c4690ead377 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:04.582241 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a5f480f-d7bd-4567-a94e-8c4690ead377 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:04.582677 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a5f480f-d7bd-4567-a94e-8c4690ead377 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:04.713897 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4a5f480f-d7bd-4567-a94e-8c4690ead377 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:42:04.723158 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4a5f480f-d7bd-4567-a94e-8c4690ead377 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81" status: 200 len: 1679 microversion: 2.1 time: 0.155187 Sep 08 11:42:04.723919 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3452/7036] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:42:04 2022] GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:42:05.747233 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f07a9f86-3e2e-48c6-91ee-4fe6097d58f0 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:42:05.747983 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f07a9f86-3e2e-48c6-91ee-4fe6097d58f0 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 753dbd0e-be58-4254-9250-230a680bbc81] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:42:05.755164 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f07a9f86-3e2e-48c6-91ee-4fe6097d58f0 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:05.755645 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f07a9f86-3e2e-48c6-91ee-4fe6097d58f0 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:05.756083 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f07a9f86-3e2e-48c6-91ee-4fe6097d58f0 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:05.756782 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f07a9f86-3e2e-48c6-91ee-4fe6097d58f0 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:05.757290 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f07a9f86-3e2e-48c6-91ee-4fe6097d58f0 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:05.757716 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f07a9f86-3e2e-48c6-91ee-4fe6097d58f0 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:05.888115 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f07a9f86-3e2e-48c6-91ee-4fe6097d58f0 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:42:05.896334 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f07a9f86-3e2e-48c6-91ee-4fe6097d58f0 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81" status: 200 len: 1679 microversion: 2.1 time: 0.153198 Sep 08 11:42:05.896912 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3585/7037] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:42:05 2022] GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:42:06.921081 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fe7de076-427f-41a5-9126-813b3ff8cd12 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:42:06.921796 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fe7de076-427f-41a5-9126-813b3ff8cd12 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 753dbd0e-be58-4254-9250-230a680bbc81] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:42:06.928891 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fe7de076-427f-41a5-9126-813b3ff8cd12 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:06.929444 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fe7de076-427f-41a5-9126-813b3ff8cd12 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:06.929901 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fe7de076-427f-41a5-9126-813b3ff8cd12 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:06.930623 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fe7de076-427f-41a5-9126-813b3ff8cd12 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:06.931099 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fe7de076-427f-41a5-9126-813b3ff8cd12 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:06.931544 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fe7de076-427f-41a5-9126-813b3ff8cd12 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:07.068575 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fe7de076-427f-41a5-9126-813b3ff8cd12 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:42:07.076908 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fe7de076-427f-41a5-9126-813b3ff8cd12 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81" status: 200 len: 1679 microversion: 2.1 time: 0.160483 Sep 08 11:42:07.077513 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3453/7038] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:42:06 2022] GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:42:08.100099 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8ebd41c3-ffc4-4e39-9657-9ab03e0083a6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:42:08.100718 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8ebd41c3-ffc4-4e39-9657-9ab03e0083a6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 753dbd0e-be58-4254-9250-230a680bbc81] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:42:08.108347 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8ebd41c3-ffc4-4e39-9657-9ab03e0083a6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:08.108851 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8ebd41c3-ffc4-4e39-9657-9ab03e0083a6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:08.109464 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8ebd41c3-ffc4-4e39-9657-9ab03e0083a6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:08.110183 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8ebd41c3-ffc4-4e39-9657-9ab03e0083a6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:08.110646 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8ebd41c3-ffc4-4e39-9657-9ab03e0083a6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:08.111079 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8ebd41c3-ffc4-4e39-9657-9ab03e0083a6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:08.261653 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8ebd41c3-ffc4-4e39-9657-9ab03e0083a6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:42:08.271416 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8ebd41c3-ffc4-4e39-9657-9ab03e0083a6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81" status: 200 len: 1679 microversion: 2.1 time: 0.174263 Sep 08 11:42:08.271416 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3586/7039] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:42:08 2022] GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81 => generated 1679 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:42:09.294090 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-04b69528-c7e1-4399-9870-cc3ac5b22da5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:42:09.294714 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-04b69528-c7e1-4399-9870-cc3ac5b22da5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 753dbd0e-be58-4254-9250-230a680bbc81] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:42:09.301844 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04b69528-c7e1-4399-9870-cc3ac5b22da5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:09.302346 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04b69528-c7e1-4399-9870-cc3ac5b22da5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:09.302796 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04b69528-c7e1-4399-9870-cc3ac5b22da5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:09.303511 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04b69528-c7e1-4399-9870-cc3ac5b22da5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:09.303987 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04b69528-c7e1-4399-9870-cc3ac5b22da5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:09.304432 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04b69528-c7e1-4399-9870-cc3ac5b22da5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:09.436276 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-04b69528-c7e1-4399-9870-cc3ac5b22da5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:42:09.444162 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-04b69528-c7e1-4399-9870-cc3ac5b22da5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81" status: 200 len: 1679 microversion: 2.1 time: 0.154027 Sep 08 11:42:09.444733 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3454/7040] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:42:09 2022] GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:42:10.468406 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e943ec6e-d102-4f7b-ab50-b1d95355cf55 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:42:10.469194 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e943ec6e-d102-4f7b-ab50-b1d95355cf55 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 753dbd0e-be58-4254-9250-230a680bbc81] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:42:10.476062 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e943ec6e-d102-4f7b-ab50-b1d95355cf55 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:10.476553 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e943ec6e-d102-4f7b-ab50-b1d95355cf55 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:10.476985 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e943ec6e-d102-4f7b-ab50-b1d95355cf55 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:10.477715 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e943ec6e-d102-4f7b-ab50-b1d95355cf55 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:10.478167 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e943ec6e-d102-4f7b-ab50-b1d95355cf55 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:10.478591 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e943ec6e-d102-4f7b-ab50-b1d95355cf55 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:10.610482 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e943ec6e-d102-4f7b-ab50-b1d95355cf55 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:42:10.618467 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e943ec6e-d102-4f7b-ab50-b1d95355cf55 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81" status: 200 len: 1656 microversion: 2.1 time: 0.154467 Sep 08 11:42:10.619038 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3587/7041] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:42:10 2022] GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81 => generated 1656 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:42:10.642027 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cfb374e7-9254-473c-8624-30c4d36e693c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:42:10.644471 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cfb374e7-9254-473c-8624-30c4d36e693c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 753dbd0e-be58-4254-9250-230a680bbc81] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:42:10.651329 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cfb374e7-9254-473c-8624-30c4d36e693c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:10.651838 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cfb374e7-9254-473c-8624-30c4d36e693c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:10.652296 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cfb374e7-9254-473c-8624-30c4d36e693c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:10.653074 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cfb374e7-9254-473c-8624-30c4d36e693c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:10.653560 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cfb374e7-9254-473c-8624-30c4d36e693c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:10.654003 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cfb374e7-9254-473c-8624-30c4d36e693c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:10.683056 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cfb374e7-9254-473c-8624-30c4d36e693c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:42:10.689292 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cfb374e7-9254-473c-8624-30c4d36e693c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 753dbd0e-be58-4254-9250-230a680bbc81] Old instance type m1.heat2, new instance type m1.heat {{(pid=128862) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 08 11:42:10.695822 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-cfb374e7-9254-473c-8624-30c4d36e693c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:42:10.696267 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-cfb374e7-9254-473c-8624-30c4d36e693c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:42:10.696761 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-cfb374e7-9254-473c-8624-30c4d36e693c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:42:10.697222 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-cfb374e7-9254-473c-8624-30c4d36e693c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:42:10.697654 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-cfb374e7-9254-473c-8624-30c4d36e693c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:42:10.761820 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cfb374e7-9254-473c-8624-30c4d36e693c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "POST /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81/action" status: 202 len: 0 microversion: 2.1 time: 0.124141 Sep 08 11:42:10.762674 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3455/7042] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 11:42:10 2022] POST /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:42:10.770965 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-673011ac-c5a4-4c4e-a9e2-86bd216031c6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:42:10.771596 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-673011ac-c5a4-4c4e-a9e2-86bd216031c6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 753dbd0e-be58-4254-9250-230a680bbc81] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:42:10.778781 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-673011ac-c5a4-4c4e-a9e2-86bd216031c6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:10.779386 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-673011ac-c5a4-4c4e-a9e2-86bd216031c6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:10.779771 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-673011ac-c5a4-4c4e-a9e2-86bd216031c6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:10.780509 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-673011ac-c5a4-4c4e-a9e2-86bd216031c6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:10.780975 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-673011ac-c5a4-4c4e-a9e2-86bd216031c6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:10.781424 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-673011ac-c5a4-4c4e-a9e2-86bd216031c6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:10.930490 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-673011ac-c5a4-4c4e-a9e2-86bd216031c6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:42:10.938395 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-673011ac-c5a4-4c4e-a9e2-86bd216031c6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81" status: 200 len: 1679 microversion: 2.1 time: 0.171403 Sep 08 11:42:10.938969 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3588/7043] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:42:10 2022] GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81 => generated 1679 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:42:11.963117 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-22b74bc1-95d8-42f4-9f0a-f8973e4536d3 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:42:11.963775 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-22b74bc1-95d8-42f4-9f0a-f8973e4536d3 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 753dbd0e-be58-4254-9250-230a680bbc81] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:42:11.970678 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-22b74bc1-95d8-42f4-9f0a-f8973e4536d3 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:11.971182 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-22b74bc1-95d8-42f4-9f0a-f8973e4536d3 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:11.971635 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-22b74bc1-95d8-42f4-9f0a-f8973e4536d3 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:11.972381 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-22b74bc1-95d8-42f4-9f0a-f8973e4536d3 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:11.972852 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-22b74bc1-95d8-42f4-9f0a-f8973e4536d3 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:11.973371 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-22b74bc1-95d8-42f4-9f0a-f8973e4536d3 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:12.116303 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-22b74bc1-95d8-42f4-9f0a-f8973e4536d3 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:42:12.124925 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-22b74bc1-95d8-42f4-9f0a-f8973e4536d3 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81" status: 200 len: 1679 microversion: 2.1 time: 0.166573 Sep 08 11:42:12.125538 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3456/7044] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:42:11 2022] GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81 => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:42:13.148834 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-59accd95-76bf-4843-b2eb-59a8c5025397 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:42:13.149414 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-59accd95-76bf-4843-b2eb-59a8c5025397 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 753dbd0e-be58-4254-9250-230a680bbc81] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:42:13.156661 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-59accd95-76bf-4843-b2eb-59a8c5025397 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:13.157210 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-59accd95-76bf-4843-b2eb-59a8c5025397 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:13.157686 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-59accd95-76bf-4843-b2eb-59a8c5025397 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:13.158434 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-59accd95-76bf-4843-b2eb-59a8c5025397 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:13.158902 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-59accd95-76bf-4843-b2eb-59a8c5025397 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:13.159336 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-59accd95-76bf-4843-b2eb-59a8c5025397 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:13.299535 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-59accd95-76bf-4843-b2eb-59a8c5025397 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:42:13.307549 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-59accd95-76bf-4843-b2eb-59a8c5025397 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81" status: 200 len: 1684 microversion: 2.1 time: 0.162938 Sep 08 11:42:13.308131 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3589/7045] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:42:13 2022] GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81 => generated 1684 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:42:14.331327 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-224abde4-142c-44b9-8733-a58d73bab00d tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:42:14.332023 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-224abde4-142c-44b9-8733-a58d73bab00d tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 753dbd0e-be58-4254-9250-230a680bbc81] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:42:14.339251 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-224abde4-142c-44b9-8733-a58d73bab00d tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:14.339768 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-224abde4-142c-44b9-8733-a58d73bab00d tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:14.340228 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-224abde4-142c-44b9-8733-a58d73bab00d tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:14.341530 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-224abde4-142c-44b9-8733-a58d73bab00d tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:14.342010 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-224abde4-142c-44b9-8733-a58d73bab00d tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:14.342457 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-224abde4-142c-44b9-8733-a58d73bab00d tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:14.477005 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-224abde4-142c-44b9-8733-a58d73bab00d tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:42:14.487165 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-224abde4-142c-44b9-8733-a58d73bab00d tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81" status: 200 len: 1684 microversion: 2.1 time: 0.159687 Sep 08 11:42:14.488019 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3457/7046] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:42:14 2022] GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81 => generated 1684 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:42:15.139280 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-b841ba63-62f9-4ed8-9457-655cc47e68e4 req-130c4347-12bc-4e66-a069-280077514290 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "753dbd0e-be58-4254-9250-230a680bbc81", "name": "network-vif-unplugged", "status": "completed", "tag": "82d0ddb6-c98c-4ea9-9fa6-8ebbdb376653"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:42:15.149800 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-b841ba63-62f9-4ed8-9457-655cc47e68e4 req-130c4347-12bc-4e66-a069-280077514290 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:15.150381 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-b841ba63-62f9-4ed8-9457-655cc47e68e4 req-130c4347-12bc-4e66-a069-280077514290 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:15.150821 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-b841ba63-62f9-4ed8-9457-655cc47e68e4 req-130c4347-12bc-4e66-a069-280077514290 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:15.163031 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-b841ba63-62f9-4ed8-9457-655cc47e68e4 req-130c4347-12bc-4e66-a069-280077514290 service nova] Creating event network-vif-unplugged:82d0ddb6-c98c-4ea9-9fa6-8ebbdb376653 for instance 753dbd0e-be58-4254-9250-230a680bbc81 on n-h2-850501-12 Sep 08 11:42:15.168337 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [req-b841ba63-62f9-4ed8-9457-655cc47e68e4 req-130c4347-12bc-4e66-a069-280077514290 service nova] Instance 753dbd0e-be58-4254-9250-230a680bbc81 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850501-12', 'n-h1-850501-12'} {{(pid=128861) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 11:42:15.180241 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-b841ba63-62f9-4ed8-9457-655cc47e68e4 req-130c4347-12bc-4e66-a069-280077514290 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044616 Sep 08 11:42:15.180858 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3590/7047] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:42:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:42:15.510686 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3762279c-ccc0-4186-8512-b093d035706f tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:42:15.511319 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3762279c-ccc0-4186-8512-b093d035706f tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 753dbd0e-be58-4254-9250-230a680bbc81] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:42:15.518486 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3762279c-ccc0-4186-8512-b093d035706f tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:15.519010 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3762279c-ccc0-4186-8512-b093d035706f tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:15.519459 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3762279c-ccc0-4186-8512-b093d035706f tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:15.520178 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3762279c-ccc0-4186-8512-b093d035706f tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:15.520650 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3762279c-ccc0-4186-8512-b093d035706f tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:15.521111 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3762279c-ccc0-4186-8512-b093d035706f tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:15.706808 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3762279c-ccc0-4186-8512-b093d035706f tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:42:15.717328 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3762279c-ccc0-4186-8512-b093d035706f tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81" status: 200 len: 1683 microversion: 2.1 time: 0.210483 Sep 08 11:42:15.717941 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3458/7048] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:42:15 2022] GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81 => generated 1683 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:42:16.743394 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ab339d36-04f9-4856-860b-7931df4a5986 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:42:16.744097 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ab339d36-04f9-4856-860b-7931df4a5986 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 753dbd0e-be58-4254-9250-230a680bbc81] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:42:16.750303 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ab339d36-04f9-4856-860b-7931df4a5986 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:16.750787 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ab339d36-04f9-4856-860b-7931df4a5986 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:16.751233 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ab339d36-04f9-4856-860b-7931df4a5986 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:16.751922 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ab339d36-04f9-4856-860b-7931df4a5986 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:16.752379 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ab339d36-04f9-4856-860b-7931df4a5986 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:16.752806 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ab339d36-04f9-4856-860b-7931df4a5986 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:16.886800 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ab339d36-04f9-4856-860b-7931df4a5986 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:42:16.895807 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ab339d36-04f9-4856-860b-7931df4a5986 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81" status: 200 len: 1681 microversion: 2.1 time: 0.157937 Sep 08 11:42:16.896423 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3591/7049] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:42:16 2022] GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:42:17.236443 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-cc6596d1-1e02-4a0f-9bea-f650e63c6f68 req-46ab1622-1447-4d76-855b-bc6bbe85e0bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "753dbd0e-be58-4254-9250-230a680bbc81", "tag": "82d0ddb6-c98c-4ea9-9fa6-8ebbdb376653"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:42:17.247450 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-cc6596d1-1e02-4a0f-9bea-f650e63c6f68 req-46ab1622-1447-4d76-855b-bc6bbe85e0bb service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:17.247945 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-cc6596d1-1e02-4a0f-9bea-f650e63c6f68 req-46ab1622-1447-4d76-855b-bc6bbe85e0bb service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:17.248397 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-cc6596d1-1e02-4a0f-9bea-f650e63c6f68 req-46ab1622-1447-4d76-855b-bc6bbe85e0bb service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:17.260398 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-cc6596d1-1e02-4a0f-9bea-f650e63c6f68 req-46ab1622-1447-4d76-855b-bc6bbe85e0bb service nova] Creating event network-changed:82d0ddb6-c98c-4ea9-9fa6-8ebbdb376653 for instance 753dbd0e-be58-4254-9250-230a680bbc81 on n-h2-850501-12 Sep 08 11:42:17.267075 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [req-cc6596d1-1e02-4a0f-9bea-f650e63c6f68 req-46ab1622-1447-4d76-855b-bc6bbe85e0bb service nova] Instance 753dbd0e-be58-4254-9250-230a680bbc81 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850501-12', 'n-h1-850501-12'} {{(pid=128862) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 11:42:17.278027 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-cc6596d1-1e02-4a0f-9bea-f650e63c6f68 req-46ab1622-1447-4d76-855b-bc6bbe85e0bb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045939 Sep 08 11:42:17.278941 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3459/7050] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:42:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:42:17.920216 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-69a3d0e7-4de0-4383-880e-1de6c91ed25a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:42:17.920885 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-69a3d0e7-4de0-4383-880e-1de6c91ed25a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 753dbd0e-be58-4254-9250-230a680bbc81] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:42:17.927863 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-69a3d0e7-4de0-4383-880e-1de6c91ed25a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:17.928357 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-69a3d0e7-4de0-4383-880e-1de6c91ed25a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:17.928795 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-69a3d0e7-4de0-4383-880e-1de6c91ed25a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:17.929516 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-69a3d0e7-4de0-4383-880e-1de6c91ed25a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:17.929972 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-69a3d0e7-4de0-4383-880e-1de6c91ed25a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:17.930432 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-69a3d0e7-4de0-4383-880e-1de6c91ed25a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:18.067467 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-69a3d0e7-4de0-4383-880e-1de6c91ed25a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:42:18.075649 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-69a3d0e7-4de0-4383-880e-1de6c91ed25a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81" status: 200 len: 1677 microversion: 2.1 time: 0.159574 Sep 08 11:42:18.076225 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3592/7051] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:42:17 2022] GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81 => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:42:18.103006 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ac8208d5-ec4a-4f82-881c-9be4159c1822 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:42:18.103691 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ac8208d5-ec4a-4f82-881c-9be4159c1822 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 753dbd0e-be58-4254-9250-230a680bbc81] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:42:18.110838 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ac8208d5-ec4a-4f82-881c-9be4159c1822 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:18.111360 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ac8208d5-ec4a-4f82-881c-9be4159c1822 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:18.111822 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ac8208d5-ec4a-4f82-881c-9be4159c1822 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:18.112555 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ac8208d5-ec4a-4f82-881c-9be4159c1822 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:18.113316 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ac8208d5-ec4a-4f82-881c-9be4159c1822 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:18.113768 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ac8208d5-ec4a-4f82-881c-9be4159c1822 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:18.178592 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ac8208d5-ec4a-4f82-881c-9be4159c1822 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "POST /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81/action" status: 204 len: 0 microversion: 2.1 time: 0.080598 Sep 08 11:42:18.179278 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3460/7052] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 11:42:18 2022] POST /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81/action => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:42:18.190849 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-08db92f0-cf51-4875-b561-e1169ba6a6b5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:42:18.191495 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-08db92f0-cf51-4875-b561-e1169ba6a6b5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 753dbd0e-be58-4254-9250-230a680bbc81] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:42:18.198448 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-08db92f0-cf51-4875-b561-e1169ba6a6b5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:18.199375 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-08db92f0-cf51-4875-b561-e1169ba6a6b5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:18.199986 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-08db92f0-cf51-4875-b561-e1169ba6a6b5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:18.201048 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-08db92f0-cf51-4875-b561-e1169ba6a6b5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:18.201590 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-08db92f0-cf51-4875-b561-e1169ba6a6b5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:18.202301 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-08db92f0-cf51-4875-b561-e1169ba6a6b5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:18.425488 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-08db92f0-cf51-4875-b561-e1169ba6a6b5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:42:18.433517 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-08db92f0-cf51-4875-b561-e1169ba6a6b5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81" status: 200 len: 1677 microversion: 2.1 time: 0.246938 Sep 08 11:42:18.434295 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3593/7053] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:42:18 2022] GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81 => generated 1677 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:42:19.459835 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9459ff37-c821-4212-b859-0b1e53b547a9 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:42:19.460679 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9459ff37-c821-4212-b859-0b1e53b547a9 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 753dbd0e-be58-4254-9250-230a680bbc81] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:42:19.466986 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9459ff37-c821-4212-b859-0b1e53b547a9 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:19.467574 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9459ff37-c821-4212-b859-0b1e53b547a9 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:19.468230 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9459ff37-c821-4212-b859-0b1e53b547a9 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:19.468955 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9459ff37-c821-4212-b859-0b1e53b547a9 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:19.469459 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9459ff37-c821-4212-b859-0b1e53b547a9 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:19.469907 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9459ff37-c821-4212-b859-0b1e53b547a9 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:19.612536 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9459ff37-c821-4212-b859-0b1e53b547a9 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:42:19.620768 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9459ff37-c821-4212-b859-0b1e53b547a9 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81" status: 200 len: 1656 microversion: 2.1 time: 0.166280 Sep 08 11:42:19.621372 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3461/7054] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:42:19 2022] GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81 => generated 1656 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:42:19.643301 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6b049e14-0526-46f4-bf55-d061a45caea5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:42:19.644039 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6b049e14-0526-46f4-bf55-d061a45caea5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 753dbd0e-be58-4254-9250-230a680bbc81] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:42:19.650864 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6b049e14-0526-46f4-bf55-d061a45caea5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:19.651350 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6b049e14-0526-46f4-bf55-d061a45caea5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:19.651782 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6b049e14-0526-46f4-bf55-d061a45caea5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:19.652477 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6b049e14-0526-46f4-bf55-d061a45caea5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:19.652932 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6b049e14-0526-46f4-bf55-d061a45caea5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:19.653388 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6b049e14-0526-46f4-bf55-d061a45caea5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:19.784632 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6b049e14-0526-46f4-bf55-d061a45caea5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:42:19.792853 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6b049e14-0526-46f4-bf55-d061a45caea5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81" status: 200 len: 1656 microversion: 2.1 time: 0.153475 Sep 08 11:42:19.793500 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3594/7055] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:42:19 2022] GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81 => generated 1656 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:42:19.814930 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3c10a75f-ca08-4dc5-bd12-56c428a75368 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:42:19.820990 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c10a75f-ca08-4dc5-bd12-56c428a75368 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:19.821528 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c10a75f-ca08-4dc5-bd12-56c428a75368 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:19.821984 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c10a75f-ca08-4dc5-bd12-56c428a75368 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:19.836185 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:42:19.846397 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3c10a75f-ca08-4dc5-bd12-56c428a75368 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 753dbd0e-be58-4254-9250-230a680bbc81] Going to try to start instance {{(pid=128862) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 08 11:42:19.892939 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3c10a75f-ca08-4dc5-bd12-56c428a75368 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "POST /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81/action" status: 202 len: 0 microversion: 2.1 time: 0.081140 Sep 08 11:42:19.893778 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3462/7056] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 11:42:19 2022] POST /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:42:19.903005 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d4171e8b-f38a-471e-a753-f58efc3096e6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:42:19.903618 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d4171e8b-f38a-471e-a753-f58efc3096e6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 753dbd0e-be58-4254-9250-230a680bbc81] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:42:19.910598 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d4171e8b-f38a-471e-a753-f58efc3096e6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:19.911178 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d4171e8b-f38a-471e-a753-f58efc3096e6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:19.912153 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d4171e8b-f38a-471e-a753-f58efc3096e6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:19.913044 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d4171e8b-f38a-471e-a753-f58efc3096e6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:19.913505 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d4171e8b-f38a-471e-a753-f58efc3096e6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:19.913934 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d4171e8b-f38a-471e-a753-f58efc3096e6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:20.055742 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d4171e8b-f38a-471e-a753-f58efc3096e6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:42:20.060012 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:42:20.065319 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d4171e8b-f38a-471e-a753-f58efc3096e6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81" status: 200 len: 1665 microversion: 2.1 time: 0.167239 Sep 08 11:42:20.066073 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3595/7057] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:42:19 2022] GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81 => generated 1665 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:42:21.075013 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-50e2865d-7d15-488c-b9a8-87329bb01f5a req-2d3f12f5-9b64-40ba-837c-750aa17c244d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "753dbd0e-be58-4254-9250-230a680bbc81", "name": "network-vif-plugged", "status": "completed", "tag": "82d0ddb6-c98c-4ea9-9fa6-8ebbdb376653"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:42:21.089926 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-eee949e4-166f-464d-a085-45e55a124a36 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:42:21.090544 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-eee949e4-166f-464d-a085-45e55a124a36 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 753dbd0e-be58-4254-9250-230a680bbc81] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:42:21.098743 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-50e2865d-7d15-488c-b9a8-87329bb01f5a req-2d3f12f5-9b64-40ba-837c-750aa17c244d service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:21.099184 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-50e2865d-7d15-488c-b9a8-87329bb01f5a req-2d3f12f5-9b64-40ba-837c-750aa17c244d service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:21.099633 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-50e2865d-7d15-488c-b9a8-87329bb01f5a req-2d3f12f5-9b64-40ba-837c-750aa17c244d service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:21.105525 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eee949e4-166f-464d-a085-45e55a124a36 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:21.106025 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eee949e4-166f-464d-a085-45e55a124a36 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:21.106464 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eee949e4-166f-464d-a085-45e55a124a36 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:21.107180 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eee949e4-166f-464d-a085-45e55a124a36 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:21.107636 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eee949e4-166f-464d-a085-45e55a124a36 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:21.108118 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eee949e4-166f-464d-a085-45e55a124a36 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:21.119067 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-50e2865d-7d15-488c-b9a8-87329bb01f5a req-2d3f12f5-9b64-40ba-837c-750aa17c244d service nova] Creating event network-vif-plugged:82d0ddb6-c98c-4ea9-9fa6-8ebbdb376653 for instance 753dbd0e-be58-4254-9250-230a680bbc81 on n-h2-850501-12 Sep 08 11:42:21.125345 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-50e2865d-7d15-488c-b9a8-87329bb01f5a req-2d3f12f5-9b64-40ba-837c-750aa17c244d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112889 Sep 08 11:42:21.126208 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3463/7058] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:42:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:42:21.247890 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-eee949e4-166f-464d-a085-45e55a124a36 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:42:21.255876 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-eee949e4-166f-464d-a085-45e55a124a36 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81" status: 200 len: 1669 microversion: 2.1 time: 0.169968 Sep 08 11:42:21.256448 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3596/7059] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:42:21 2022] GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81 => generated 1669 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:42:21.278757 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e2748a9c-bebb-4d14-814c-88e07ceb6154 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:42:21.279355 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e2748a9c-bebb-4d14-814c-88e07ceb6154 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 753dbd0e-be58-4254-9250-230a680bbc81] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:42:21.286123 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e2748a9c-bebb-4d14-814c-88e07ceb6154 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:21.286621 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e2748a9c-bebb-4d14-814c-88e07ceb6154 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:21.287069 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e2748a9c-bebb-4d14-814c-88e07ceb6154 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:21.287773 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e2748a9c-bebb-4d14-814c-88e07ceb6154 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:21.288247 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e2748a9c-bebb-4d14-814c-88e07ceb6154 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:21.288678 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e2748a9c-bebb-4d14-814c-88e07ceb6154 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:21.313473 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e2748a9c-bebb-4d14-814c-88e07ceb6154 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 753dbd0e-be58-4254-9250-230a680bbc81] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:42:21.388895 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e2748a9c-bebb-4d14-814c-88e07ceb6154 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "DELETE /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81" status: 204 len: 0 microversion: 2.1 time: 0.113979 Sep 08 11:42:21.389521 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3464/7060] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:42:21 2022] DELETE /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:42:21.399722 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9feeadc5-0074-4460-a1df-29455f193f6e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:42:21.400332 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9feeadc5-0074-4460-a1df-29455f193f6e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 753dbd0e-be58-4254-9250-230a680bbc81] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:42:21.406480 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9feeadc5-0074-4460-a1df-29455f193f6e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:21.406990 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9feeadc5-0074-4460-a1df-29455f193f6e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:21.407421 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9feeadc5-0074-4460-a1df-29455f193f6e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:21.408683 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9feeadc5-0074-4460-a1df-29455f193f6e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:21.409486 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9feeadc5-0074-4460-a1df-29455f193f6e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:21.409774 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9feeadc5-0074-4460-a1df-29455f193f6e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:21.544872 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9feeadc5-0074-4460-a1df-29455f193f6e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:42:21.553124 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9feeadc5-0074-4460-a1df-29455f193f6e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81" status: 200 len: 1675 microversion: 2.1 time: 0.158407 Sep 08 11:42:21.553697 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3597/7061] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:42:21 2022] GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81 => generated 1675 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:42:22.577872 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4c291866-92bd-48b9-b524-cd8d1cc7de4b tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:42:22.578603 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4c291866-92bd-48b9-b524-cd8d1cc7de4b tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 753dbd0e-be58-4254-9250-230a680bbc81] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:42:22.585816 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c291866-92bd-48b9-b524-cd8d1cc7de4b tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:22.586327 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c291866-92bd-48b9-b524-cd8d1cc7de4b tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:22.586791 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c291866-92bd-48b9-b524-cd8d1cc7de4b tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:22.587508 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c291866-92bd-48b9-b524-cd8d1cc7de4b tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:22.587986 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c291866-92bd-48b9-b524-cd8d1cc7de4b tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:22.588434 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c291866-92bd-48b9-b524-cd8d1cc7de4b tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:22.724147 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4c291866-92bd-48b9-b524-cd8d1cc7de4b tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:42:22.732010 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4c291866-92bd-48b9-b524-cd8d1cc7de4b tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81" status: 200 len: 1675 microversion: 2.1 time: 0.158725 Sep 08 11:42:22.732586 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3465/7062] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:42:22 2022] GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81 => generated 1675 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:42:23.756748 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bf15458a-93aa-46dd-9dc6-8bb644bfe1a2 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:42:23.757829 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bf15458a-93aa-46dd-9dc6-8bb644bfe1a2 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 753dbd0e-be58-4254-9250-230a680bbc81] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:42:23.763976 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf15458a-93aa-46dd-9dc6-8bb644bfe1a2 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:23.764466 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf15458a-93aa-46dd-9dc6-8bb644bfe1a2 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:23.764906 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf15458a-93aa-46dd-9dc6-8bb644bfe1a2 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:23.765651 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf15458a-93aa-46dd-9dc6-8bb644bfe1a2 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:23.766108 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf15458a-93aa-46dd-9dc6-8bb644bfe1a2 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:23.766542 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf15458a-93aa-46dd-9dc6-8bb644bfe1a2 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:23.829939 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-bf15458a-93aa-46dd-9dc6-8bb644bfe1a2 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:42:23.838489 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bf15458a-93aa-46dd-9dc6-8bb644bfe1a2 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81" status: 200 len: 1607 microversion: 2.1 time: 0.086609 Sep 08 11:42:23.839105 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3598/7063] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:42:23 2022] GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81 => generated 1607 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:42:23.935338 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-069a8750-eed2-4190-9d9e-e11e7d2b5aa6 req-6715e2bc-4919-4b83-aabd-a7cbe4e4722d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "753dbd0e-be58-4254-9250-230a680bbc81", "name": "network-vif-deleted", "tag": "82d0ddb6-c98c-4ea9-9fa6-8ebbdb376653"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:42:23.946884 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-069a8750-eed2-4190-9d9e-e11e7d2b5aa6 req-6715e2bc-4919-4b83-aabd-a7cbe4e4722d service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:23.947379 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-069a8750-eed2-4190-9d9e-e11e7d2b5aa6 req-6715e2bc-4919-4b83-aabd-a7cbe4e4722d service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:23.947823 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-069a8750-eed2-4190-9d9e-e11e7d2b5aa6 req-6715e2bc-4919-4b83-aabd-a7cbe4e4722d service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:23.959791 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-069a8750-eed2-4190-9d9e-e11e7d2b5aa6 req-6715e2bc-4919-4b83-aabd-a7cbe4e4722d service nova] Creating event network-vif-deleted:82d0ddb6-c98c-4ea9-9fa6-8ebbdb376653 for instance 753dbd0e-be58-4254-9250-230a680bbc81 on n-h2-850501-12 Sep 08 11:42:23.964781 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-069a8750-eed2-4190-9d9e-e11e7d2b5aa6 req-6715e2bc-4919-4b83-aabd-a7cbe4e4722d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034047 Sep 08 11:42:23.965654 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3466/7064] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:42:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:42:24.863116 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4c9fd8fb-2a18-4d05-9935-5529f62609c7 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:42:24.863660 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4c9fd8fb-2a18-4d05-9935-5529f62609c7 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 753dbd0e-be58-4254-9250-230a680bbc81] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:42:24.871881 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4c9fd8fb-2a18-4d05-9935-5529f62609c7 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:24.872647 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4c9fd8fb-2a18-4d05-9935-5529f62609c7 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:24.872844 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4c9fd8fb-2a18-4d05-9935-5529f62609c7 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:24.873492 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4c9fd8fb-2a18-4d05-9935-5529f62609c7 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:24.873945 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4c9fd8fb-2a18-4d05-9935-5529f62609c7 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:24.874370 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4c9fd8fb-2a18-4d05-9935-5529f62609c7 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:24.889655 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-4c9fd8fb-2a18-4d05-9935-5529f62609c7 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] HTTP exception thrown: Instance 753dbd0e-be58-4254-9250-230a680bbc81 could not be found. Sep 08 11:42:24.891487 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4c9fd8fb-2a18-4d05-9935-5529f62609c7 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Request method failure captured: Sep 08 11:42:24.891487 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81 HTTP/1.1 Sep 08 11:42:24.891487 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:42:24.891487 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:42:24.891487 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:42:24.891487 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 11:42:24.891487 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:42:24.891487 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:42:24.891487 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:42:24.891487 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:42:24.891487 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGdSDvOwoS57OkYb_-Yl1XUx78kih9MULmYIyzFLt-u36W2wjj2KtWXAZ7aX14KpVLwWCBvBeF4bTqW87i3VTvG-qHq5mt1bIpxmJHowTqwKpzB7zzorSV7BPwI-U0G6PWcbOtFoIJUt5uu58duhf3xUQD9p0cNz13ICJbtKWoYuCsmY Sep 08 11:42:24.891487 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:42:24.891487 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:42:24.891487 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:42:24.891487 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:42:24.891487 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:42:24.891487 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:42:24.891487 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 5e7adfbb1417415b9eafeeb23b7a7c18 Sep 08 11:42:24.891487 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServerActionsTestJSON-143982609 Sep 08 11:42:24.891487 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:42:24.891487 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:42:24.891487 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5e7adfbb1417415b9eafeeb23b7a7c18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5e7adfbb1417415b9eafeeb23b7a7c18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5e7adfbb1417415b9eafeeb23b7a7c18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5e7adfbb1417415b9eafeeb23b7a7c18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:42:24.891487 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServerActionsTestJSON-143982609 Sep 08 11:42:24.891487 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 5e7adfbb1417415b9eafeeb23b7a7c18 Sep 08 11:42:24.891487 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServerActionsTestJSON-143982609 Sep 08 11:42:24.891487 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServerActionsTestJSON-143982609-project Sep 08 11:42:24.891487 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:42:24.891487 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:42:24.891487 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: f38a21e862664942bf35c93870df1c36 Sep 08 11:42:24.891487 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServerActionsTestJSON-143982609-project Sep 08 11:42:24.891487 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 11:42:24.891487 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 753dbd0e-be58-4254-9250-230a680bbc81 could not be found. Sep 08 11:42:24.891487 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '753dbd0e-be58-4254-9250-230a680bbc81'} Sep 08 11:42:24.891487 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:42:24.891487 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:42:24.891487 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:42:24.891487 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:42:24.891487 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:42:24.891487 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:42:24.891487 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:42:24.891487 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:42:24.891487 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:42:24.891487 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:42:24.891487 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 753dbd0e-be58-4254-9250-230a680bbc81 could not be found. Sep 08 11:42:24.891487 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:42:24.891487 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:42:24.891487 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:42:24.891487 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:42:24.891487 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:42:24.891487 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:42:24.891487 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:42:24.891487 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:42:24.891487 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:42:24.891487 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:42:24.891487 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:42:24.891487 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:42:24.891487 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:42:24.891487 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:42:24.891487 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:42:24.891487 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:42:24.891487 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 753dbd0e-be58-4254-9250-230a680bbc81 could not be found. Sep 08 11:42:24.891487 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:42:24.891487 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:42:24.891487 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:42:24.896402 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:42:24.896402 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:42:24.896402 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:42:24.896402 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:42:24.896402 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:42:24.896402 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 753dbd0e-be58-4254-9250-230a680bbc81 could not be found. Sep 08 11:42:24.896402 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:42:24.896402 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4c9fd8fb-2a18-4d05-9935-5529f62609c7 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Returning 404 to user: Instance 753dbd0e-be58-4254-9250-230a680bbc81 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:42:24.896402 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4c9fd8fb-2a18-4d05-9935-5529f62609c7 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81" status: 404 len: 111 microversion: 2.1 time: 0.034958 Sep 08 11:42:24.898386 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3599/7065] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:42:24 2022] GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:42:24.910729 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-61627c93-41c7-4675-b642-22a28b4267d8 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:42:24.911518 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-61627c93-41c7-4675-b642-22a28b4267d8 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 753dbd0e-be58-4254-9250-230a680bbc81] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:42:24.918433 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-61627c93-41c7-4675-b642-22a28b4267d8 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:24.918985 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-61627c93-41c7-4675-b642-22a28b4267d8 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:24.919349 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-61627c93-41c7-4675-b642-22a28b4267d8 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:24.920083 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-61627c93-41c7-4675-b642-22a28b4267d8 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:24.920557 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-61627c93-41c7-4675-b642-22a28b4267d8 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:24.921001 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-61627c93-41c7-4675-b642-22a28b4267d8 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:24.935919 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-61627c93-41c7-4675-b642-22a28b4267d8 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] HTTP exception thrown: Instance 753dbd0e-be58-4254-9250-230a680bbc81 could not be found. Sep 08 11:42:24.937630 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-61627c93-41c7-4675-b642-22a28b4267d8 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Request method failure captured: Sep 08 11:42:24.937630 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81 HTTP/1.1 Sep 08 11:42:24.937630 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 11:42:24.937630 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 11:42:24.937630 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 11:42:24.937630 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 11:42:24.937630 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 11:42:24.937630 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 11:42:24.937630 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 11:42:24.937630 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 11:42:24.937630 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGdSDvOwoS57OkYb_-Yl1XUx78kih9MULmYIyzFLt-u36W2wjj2KtWXAZ7aX14KpVLwWCBvBeF4bTqW87i3VTvG-qHq5mt1bIpxmJHowTqwKpzB7zzorSV7BPwI-U0G6PWcbOtFoIJUt5uu58duhf3xUQD9p0cNz13ICJbtKWoYuCsmY Sep 08 11:42:24.937630 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 11:42:24.937630 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 11:42:24.937630 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 11:42:24.937630 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 11:42:24.937630 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 11:42:24.937630 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 11:42:24.937630 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 5e7adfbb1417415b9eafeeb23b7a7c18 Sep 08 11:42:24.937630 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServerActionsTestJSON-143982609 Sep 08 11:42:24.937630 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 11:42:24.937630 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 11:42:24.937630 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5e7adfbb1417415b9eafeeb23b7a7c18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5e7adfbb1417415b9eafeeb23b7a7c18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5e7adfbb1417415b9eafeeb23b7a7c18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5e7adfbb1417415b9eafeeb23b7a7c18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:42:24.937630 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServerActionsTestJSON-143982609 Sep 08 11:42:24.937630 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 5e7adfbb1417415b9eafeeb23b7a7c18 Sep 08 11:42:24.937630 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServerActionsTestJSON-143982609 Sep 08 11:42:24.937630 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServerActionsTestJSON-143982609-project Sep 08 11:42:24.937630 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 11:42:24.937630 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 11:42:24.937630 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: f38a21e862664942bf35c93870df1c36 Sep 08 11:42:24.937630 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServerActionsTestJSON-143982609-project Sep 08 11:42:24.937630 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 11:42:24.937630 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 753dbd0e-be58-4254-9250-230a680bbc81 could not be found. Sep 08 11:42:24.937630 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '753dbd0e-be58-4254-9250-230a680bbc81'} Sep 08 11:42:24.937630 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:42:24.937630 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:42:24.937630 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:42:24.937630 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:42:24.937630 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:42:24.937630 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:42:24.937630 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:42:24.937630 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:42:24.937630 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:42:24.937630 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:42:24.937630 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 753dbd0e-be58-4254-9250-230a680bbc81 could not be found. Sep 08 11:42:24.937630 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:42:24.937630 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:42:24.937630 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:42:24.937630 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:42:24.937630 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:42:24.937630 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:42:24.937630 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:42:24.937630 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:42:24.937630 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:42:24.937630 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:42:24.937630 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:42:24.937630 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:42:24.937630 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:42:24.937630 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:42:24.937630 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:42:24.937630 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:42:24.937630 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 753dbd0e-be58-4254-9250-230a680bbc81 could not be found. Sep 08 11:42:24.937630 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:42:24.937630 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:42:24.937630 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:42:24.941824 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:42:24.941824 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:42:24.941824 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:42:24.941824 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:42:24.941824 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:42:24.941824 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 753dbd0e-be58-4254-9250-230a680bbc81 could not be found. Sep 08 11:42:24.941824 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:42:24.941824 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-61627c93-41c7-4675-b642-22a28b4267d8 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Returning 404 to user: Instance 753dbd0e-be58-4254-9250-230a680bbc81 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:42:24.941824 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-61627c93-41c7-4675-b642-22a28b4267d8 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81" status: 404 len: 111 microversion: 2.1 time: 0.033920 Sep 08 11:42:24.941824 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3467/7066] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:42:24 2022] GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:42:24.988917 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1ed7f852-4cb7-45b3-89a3-6a5604cf4fd4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-989302850", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "99f4db14-10f1-4ebf-99cd-d7459087f008"}], "security_groups": [{"name": "tempest-securitygroup--1605450961"}], "key_name": "tempest-keypair-1229154192", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:42:25.093740 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-1ed7f852-4cb7-45b3-89a3-6a5604cf4fd4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] validate_networks() for [('99f4db14-10f1-4ebf-99cd-d7459087f008', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:42:25.272370 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=43 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:42:25.505971 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-1ed7f852-4cb7-45b3-89a3-6a5604cf4fd4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:42:25.506397 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-1ed7f852-4cb7-45b3-89a3-6a5604cf4fd4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:42:25.506867 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-1ed7f852-4cb7-45b3-89a3-6a5604cf4fd4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:42:25.507317 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-1ed7f852-4cb7-45b3-89a3-6a5604cf4fd4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:42:25.507711 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-1ed7f852-4cb7-45b3-89a3-6a5604cf4fd4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:42:25.516391 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1ed7f852-4cb7-45b3-89a3-6a5604cf4fd4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:25.516873 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1ed7f852-4cb7-45b3-89a3-6a5604cf4fd4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:25.517987 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1ed7f852-4cb7-45b3-89a3-6a5604cf4fd4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:25.518798 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1ed7f852-4cb7-45b3-89a3-6a5604cf4fd4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:25.519162 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1ed7f852-4cb7-45b3-89a3-6a5604cf4fd4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:25.519585 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1ed7f852-4cb7-45b3-89a3-6a5604cf4fd4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:25.535883 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-1ed7f852-4cb7-45b3-89a3-6a5604cf4fd4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Getting quotas for project 5e7adfbb1417415b9eafeeb23b7a7c18. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:42:25.540984 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-1ed7f852-4cb7-45b3-89a3-6a5604cf4fd4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Getting quotas for user f38a21e862664942bf35c93870df1c36 and project 5e7adfbb1417415b9eafeeb23b7a7c18. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:42:25.553530 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1ed7f852-4cb7-45b3-89a3-6a5604cf4fd4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:42:25.555840 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1ed7f852-4cb7-45b3-89a3-6a5604cf4fd4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 654a0638-6345-4150-9a9b-b58143e2213f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:42:25.603058 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1ed7f852-4cb7-45b3-89a3-6a5604cf4fd4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.619232 Sep 08 11:42:25.603692 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3600/7067] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 11:42:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:42:25.615348 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ed8e5427-bc1e-4835-8ae3-d9a7a902849b tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:42:25.616066 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ed8e5427-bc1e-4835-8ae3-d9a7a902849b tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 654a0638-6345-4150-9a9b-b58143e2213f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:42:25.618938 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:42:25.676673 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ed8e5427-bc1e-4835-8ae3-d9a7a902849b tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:42:25.686196 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ed8e5427-bc1e-4835-8ae3-d9a7a902849b tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f" status: 200 len: 1238 microversion: 2.1 time: 0.075132 Sep 08 11:42:25.686662 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3468/7068] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:42:25 2022] GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f => generated 1238 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:42:26.711153 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-da207113-dc77-4efe-8741-db8939ab2a1a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:42:26.711779 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-da207113-dc77-4efe-8741-db8939ab2a1a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 654a0638-6345-4150-9a9b-b58143e2213f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:42:26.719214 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-da207113-dc77-4efe-8741-db8939ab2a1a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:26.719719 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-da207113-dc77-4efe-8741-db8939ab2a1a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:26.720220 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-da207113-dc77-4efe-8741-db8939ab2a1a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:26.720907 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-da207113-dc77-4efe-8741-db8939ab2a1a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:26.721726 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-da207113-dc77-4efe-8741-db8939ab2a1a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:26.722232 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-da207113-dc77-4efe-8741-db8939ab2a1a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:26.800656 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-da207113-dc77-4efe-8741-db8939ab2a1a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:42:26.809657 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-da207113-dc77-4efe-8741-db8939ab2a1a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f" status: 200 len: 1296 microversion: 2.1 time: 0.103434 Sep 08 11:42:26.810344 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3601/7069] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:42:26 2022] GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f => generated 1296 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:42:27.835469 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8dc75217-fb8f-44b8-a95b-9e516e2c7f6c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:42:27.836194 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8dc75217-fb8f-44b8-a95b-9e516e2c7f6c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 654a0638-6345-4150-9a9b-b58143e2213f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:42:27.843268 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8dc75217-fb8f-44b8-a95b-9e516e2c7f6c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:27.843781 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8dc75217-fb8f-44b8-a95b-9e516e2c7f6c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:27.844249 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8dc75217-fb8f-44b8-a95b-9e516e2c7f6c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:27.844978 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8dc75217-fb8f-44b8-a95b-9e516e2c7f6c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:27.845620 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8dc75217-fb8f-44b8-a95b-9e516e2c7f6c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:27.846075 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8dc75217-fb8f-44b8-a95b-9e516e2c7f6c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:27.980236 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8dc75217-fb8f-44b8-a95b-9e516e2c7f6c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:42:27.988511 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8dc75217-fb8f-44b8-a95b-9e516e2c7f6c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f" status: 200 len: 1364 microversion: 2.1 time: 0.157037 Sep 08 11:42:27.989161 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3469/7070] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:42:27 2022] GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:42:28.372407 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-31229733-5712-4823-932f-79f064263bc6 req-4bf00ee2-1330-452c-b178-997deff3d82b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "654a0638-6345-4150-9a9b-b58143e2213f", "tag": "7f3e106a-7992-4c1a-aab4-364d46cd930e"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:42:28.384162 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-31229733-5712-4823-932f-79f064263bc6 req-4bf00ee2-1330-452c-b178-997deff3d82b service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:28.384808 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-31229733-5712-4823-932f-79f064263bc6 req-4bf00ee2-1330-452c-b178-997deff3d82b service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:28.385108 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-31229733-5712-4823-932f-79f064263bc6 req-4bf00ee2-1330-452c-b178-997deff3d82b service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:28.398382 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-31229733-5712-4823-932f-79f064263bc6 req-4bf00ee2-1330-452c-b178-997deff3d82b service nova] Creating event network-changed:7f3e106a-7992-4c1a-aab4-364d46cd930e for instance 654a0638-6345-4150-9a9b-b58143e2213f on n-h1-850501-12 Sep 08 11:42:28.403739 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-31229733-5712-4823-932f-79f064263bc6 req-4bf00ee2-1330-452c-b178-997deff3d82b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035038 Sep 08 11:42:28.404701 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3602/7071] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:42:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:42:29.013426 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f18e60e7-a0c2-4b60-96a9-0d399c7e670f tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:42:29.014005 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f18e60e7-a0c2-4b60-96a9-0d399c7e670f tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 654a0638-6345-4150-9a9b-b58143e2213f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:42:29.021449 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f18e60e7-a0c2-4b60-96a9-0d399c7e670f tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:29.021952 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f18e60e7-a0c2-4b60-96a9-0d399c7e670f tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:29.022419 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f18e60e7-a0c2-4b60-96a9-0d399c7e670f tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:29.023163 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f18e60e7-a0c2-4b60-96a9-0d399c7e670f tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:29.023613 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f18e60e7-a0c2-4b60-96a9-0d399c7e670f tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:29.024080 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f18e60e7-a0c2-4b60-96a9-0d399c7e670f tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:29.164110 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f18e60e7-a0c2-4b60-96a9-0d399c7e670f tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:42:29.172229 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f18e60e7-a0c2-4b60-96a9-0d399c7e670f tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f" status: 200 len: 1364 microversion: 2.1 time: 0.162896 Sep 08 11:42:29.172822 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3470/7072] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:42:29 2022] GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:42:30.198055 n-d-850501-12 devstack@n-api.service[128861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 11:42:30.198634 n-d-850501-12 devstack@n-api.service[128861]: Thu Sep 8 11:42:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f (ip 10.222.0.27) !!! Sep 08 11:42:30.203458 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5ef31dda-0501-464d-ba26-8d1e3d2d2d7c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:42:30.204214 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5ef31dda-0501-464d-ba26-8d1e3d2d2d7c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 654a0638-6345-4150-9a9b-b58143e2213f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:42:30.213484 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5ef31dda-0501-464d-ba26-8d1e3d2d2d7c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:30.213969 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5ef31dda-0501-464d-ba26-8d1e3d2d2d7c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:30.214402 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5ef31dda-0501-464d-ba26-8d1e3d2d2d7c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:30.215098 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5ef31dda-0501-464d-ba26-8d1e3d2d2d7c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:30.215553 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5ef31dda-0501-464d-ba26-8d1e3d2d2d7c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:30.215977 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5ef31dda-0501-464d-ba26-8d1e3d2d2d7c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:30.349901 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5ef31dda-0501-464d-ba26-8d1e3d2d2d7c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:42:30.357589 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5ef31dda-0501-464d-ba26-8d1e3d2d2d7c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f" status: 200 len: 1364 microversion: 2.1 time: 0.163924 Sep 08 11:42:30.358155 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3603/7073] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:42:30 2022] GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:42:31.381705 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5ff40af8-f562-435f-ab50-fa87d9640b2b tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:42:31.382337 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5ff40af8-f562-435f-ab50-fa87d9640b2b tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 654a0638-6345-4150-9a9b-b58143e2213f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:42:31.389266 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ff40af8-f562-435f-ab50-fa87d9640b2b tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:31.389781 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ff40af8-f562-435f-ab50-fa87d9640b2b tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:31.390229 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ff40af8-f562-435f-ab50-fa87d9640b2b tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:31.390941 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ff40af8-f562-435f-ab50-fa87d9640b2b tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:31.391441 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ff40af8-f562-435f-ab50-fa87d9640b2b tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:31.391920 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ff40af8-f562-435f-ab50-fa87d9640b2b tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:31.418455 n-d-850501-12 devstack@n-api.service[128862]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 11:42:31.418653 n-d-850501-12 devstack@n-api.service[128862]: Thu Sep 8 11:42:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f (ip 10.222.0.27) !!! Sep 08 11:42:31.536716 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5ff40af8-f562-435f-ab50-fa87d9640b2b tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:42:31.547381 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5ff40af8-f562-435f-ab50-fa87d9640b2b tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f" status: 200 len: 1364 microversion: 2.1 time: 0.170408 Sep 08 11:42:31.548400 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3471/7074] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:42:31 2022] GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:42:32.571768 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fa4dd0ab-3e94-4f2e-bf69-027f50d12855 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:42:32.572380 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fa4dd0ab-3e94-4f2e-bf69-027f50d12855 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 654a0638-6345-4150-9a9b-b58143e2213f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:42:32.579271 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fa4dd0ab-3e94-4f2e-bf69-027f50d12855 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:32.579797 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fa4dd0ab-3e94-4f2e-bf69-027f50d12855 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:32.580233 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fa4dd0ab-3e94-4f2e-bf69-027f50d12855 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:32.580932 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fa4dd0ab-3e94-4f2e-bf69-027f50d12855 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:32.581420 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fa4dd0ab-3e94-4f2e-bf69-027f50d12855 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:32.581848 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fa4dd0ab-3e94-4f2e-bf69-027f50d12855 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:32.711118 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-fa4dd0ab-3e94-4f2e-bf69-027f50d12855 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:42:32.718721 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fa4dd0ab-3e94-4f2e-bf69-027f50d12855 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f" status: 200 len: 1364 microversion: 2.1 time: 0.150891 Sep 08 11:42:32.719285 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3604/7075] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:42:32 2022] GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:42:33.523216 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-e3fc41a4-853e-4ef1-8e31-7d76c24e0921 req-5638e677-0edf-4ef2-92b7-d5b8d1e4f4de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "654a0638-6345-4150-9a9b-b58143e2213f", "name": "network-vif-plugged", "status": "completed", "tag": "7f3e106a-7992-4c1a-aab4-364d46cd930e"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:42:33.535891 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e3fc41a4-853e-4ef1-8e31-7d76c24e0921 req-5638e677-0edf-4ef2-92b7-d5b8d1e4f4de service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:33.536650 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e3fc41a4-853e-4ef1-8e31-7d76c24e0921 req-5638e677-0edf-4ef2-92b7-d5b8d1e4f4de service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:33.537205 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e3fc41a4-853e-4ef1-8e31-7d76c24e0921 req-5638e677-0edf-4ef2-92b7-d5b8d1e4f4de service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:33.550377 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-e3fc41a4-853e-4ef1-8e31-7d76c24e0921 req-5638e677-0edf-4ef2-92b7-d5b8d1e4f4de service nova] Creating event network-vif-plugged:7f3e106a-7992-4c1a-aab4-364d46cd930e for instance 654a0638-6345-4150-9a9b-b58143e2213f on n-h1-850501-12 Sep 08 11:42:33.555852 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-e3fc41a4-853e-4ef1-8e31-7d76c24e0921 req-5638e677-0edf-4ef2-92b7-d5b8d1e4f4de service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036359 Sep 08 11:42:33.556473 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3472/7076] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:42:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:42:33.741672 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e07be922-3267-4088-b38f-1ef091659847 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:42:33.742271 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e07be922-3267-4088-b38f-1ef091659847 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 654a0638-6345-4150-9a9b-b58143e2213f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:42:33.749218 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e07be922-3267-4088-b38f-1ef091659847 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:33.749712 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e07be922-3267-4088-b38f-1ef091659847 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:33.750144 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e07be922-3267-4088-b38f-1ef091659847 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:33.750850 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e07be922-3267-4088-b38f-1ef091659847 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:33.751302 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e07be922-3267-4088-b38f-1ef091659847 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:33.752295 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e07be922-3267-4088-b38f-1ef091659847 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:33.947564 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e07be922-3267-4088-b38f-1ef091659847 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:42:33.956518 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e07be922-3267-4088-b38f-1ef091659847 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f" status: 200 len: 1364 microversion: 2.1 time: 0.218708 Sep 08 11:42:33.957143 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3605/7077] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:42:33 2022] GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f => generated 1364 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:42:34.981761 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-320304fc-a928-4162-b49a-c32b4ab0371c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:42:34.982509 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-320304fc-a928-4162-b49a-c32b4ab0371c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 654a0638-6345-4150-9a9b-b58143e2213f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:42:34.990726 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-320304fc-a928-4162-b49a-c32b4ab0371c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:34.991364 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-320304fc-a928-4162-b49a-c32b4ab0371c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:34.991874 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-320304fc-a928-4162-b49a-c32b4ab0371c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:34.992601 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-320304fc-a928-4162-b49a-c32b4ab0371c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:34.993111 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-320304fc-a928-4162-b49a-c32b4ab0371c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:34.993556 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-320304fc-a928-4162-b49a-c32b4ab0371c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:35.135177 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-320304fc-a928-4162-b49a-c32b4ab0371c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:42:35.143352 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-320304fc-a928-4162-b49a-c32b4ab0371c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f" status: 200 len: 1364 microversion: 2.1 time: 0.166817 Sep 08 11:42:35.143868 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3473/7078] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:42:34 2022] GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:42:36.168462 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4d2f9123-233b-4868-920a-003fac340e51 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:42:36.169133 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4d2f9123-233b-4868-920a-003fac340e51 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 654a0638-6345-4150-9a9b-b58143e2213f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:42:36.171853 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:42:36.172676 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=6 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:42:36.179621 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4d2f9123-233b-4868-920a-003fac340e51 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:36.180112 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4d2f9123-233b-4868-920a-003fac340e51 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:36.180547 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4d2f9123-233b-4868-920a-003fac340e51 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:36.181272 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4d2f9123-233b-4868-920a-003fac340e51 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:36.181726 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4d2f9123-233b-4868-920a-003fac340e51 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:36.182151 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4d2f9123-233b-4868-920a-003fac340e51 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:36.325773 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4d2f9123-233b-4868-920a-003fac340e51 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:42:36.334201 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4d2f9123-233b-4868-920a-003fac340e51 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f" status: 200 len: 1551 microversion: 2.1 time: 0.169746 Sep 08 11:42:36.334772 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3606/7079] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:42:36 2022] GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f => generated 1551 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:42:36.358139 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b5305479-e13a-4a68-b7d7-da1ec626bf0e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:42:36.358705 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b5305479-e13a-4a68-b7d7-da1ec626bf0e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 654a0638-6345-4150-9a9b-b58143e2213f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:42:36.360626 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:42:36.368770 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b5305479-e13a-4a68-b7d7-da1ec626bf0e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:36.369318 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b5305479-e13a-4a68-b7d7-da1ec626bf0e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:36.369780 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b5305479-e13a-4a68-b7d7-da1ec626bf0e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:36.370534 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b5305479-e13a-4a68-b7d7-da1ec626bf0e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:36.371012 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b5305479-e13a-4a68-b7d7-da1ec626bf0e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:36.371462 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b5305479-e13a-4a68-b7d7-da1ec626bf0e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:36.449730 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b5305479-e13a-4a68-b7d7-da1ec626bf0e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095692 Sep 08 11:42:36.450338 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3474/7080] 10.222.0.27 () {58 vars in 1275 bytes} [Thu Sep 8 11:42:36 2022] GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:42:37.394125 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-3472722d-544e-448b-bb94-838a0c20ca13 req-aa22a83c-e005-443b-b352-b6df1b08462e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "654a0638-6345-4150-9a9b-b58143e2213f", "tag": "7f3e106a-7992-4c1a-aab4-364d46cd930e"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:42:37.405306 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-3472722d-544e-448b-bb94-838a0c20ca13 req-aa22a83c-e005-443b-b352-b6df1b08462e service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:42:37.405887 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-3472722d-544e-448b-bb94-838a0c20ca13 req-aa22a83c-e005-443b-b352-b6df1b08462e service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:42:37.406385 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-3472722d-544e-448b-bb94-838a0c20ca13 req-aa22a83c-e005-443b-b352-b6df1b08462e service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:42:37.421053 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-3472722d-544e-448b-bb94-838a0c20ca13 req-aa22a83c-e005-443b-b352-b6df1b08462e service nova] Creating event network-changed:7f3e106a-7992-4c1a-aab4-364d46cd930e for instance 654a0638-6345-4150-9a9b-b58143e2213f on n-h1-850501-12 Sep 08 11:42:37.427078 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-3472722d-544e-448b-bb94-838a0c20ca13 req-aa22a83c-e005-443b-b352-b6df1b08462e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036815 Sep 08 11:42:37.427958 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3607/7081] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:42:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:43:12.313664 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=15 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:43:12.314932 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:43:12.319300 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-252bb837-a305-4ca5-b881-f07f02acaa61 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:43:12.321589 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-252bb837-a305-4ca5-b881-f07f02acaa61 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 654a0638-6345-4150-9a9b-b58143e2213f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:43:12.330322 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-252bb837-a305-4ca5-b881-f07f02acaa61 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:12.330835 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-252bb837-a305-4ca5-b881-f07f02acaa61 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:12.331287 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-252bb837-a305-4ca5-b881-f07f02acaa61 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:12.332012 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-252bb837-a305-4ca5-b881-f07f02acaa61 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:12.332481 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-252bb837-a305-4ca5-b881-f07f02acaa61 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:12.332921 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-252bb837-a305-4ca5-b881-f07f02acaa61 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:12.363384 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-252bb837-a305-4ca5-b881-f07f02acaa61 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:43:12.369080 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-252bb837-a305-4ca5-b881-f07f02acaa61 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 654a0638-6345-4150-9a9b-b58143e2213f] Old instance type m1.heat2, new instance type m1.heat {{(pid=128862) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 08 11:43:12.376536 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-252bb837-a305-4ca5-b881-f07f02acaa61 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:43:12.376987 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-252bb837-a305-4ca5-b881-f07f02acaa61 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:43:12.377639 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-252bb837-a305-4ca5-b881-f07f02acaa61 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:43:12.378063 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-252bb837-a305-4ca5-b881-f07f02acaa61 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:43:12.378501 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-252bb837-a305-4ca5-b881-f07f02acaa61 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:43:12.452820 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-252bb837-a305-4ca5-b881-f07f02acaa61 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "POST /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f/action" status: 202 len: 0 microversion: 2.1 time: 0.142141 Sep 08 11:43:12.454417 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3475/7082] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 11:43:12 2022] POST /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:43:12.462336 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=3 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:43:12.463697 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=56 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:43:12.468254 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-defaba82-4ef2-4cf9-87ca-c1c10d45dff5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:43:12.468705 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-defaba82-4ef2-4cf9-87ca-c1c10d45dff5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 654a0638-6345-4150-9a9b-b58143e2213f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:43:12.476443 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-defaba82-4ef2-4cf9-87ca-c1c10d45dff5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:12.476976 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-defaba82-4ef2-4cf9-87ca-c1c10d45dff5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:12.477408 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-defaba82-4ef2-4cf9-87ca-c1c10d45dff5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:12.478136 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-defaba82-4ef2-4cf9-87ca-c1c10d45dff5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:12.478605 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-defaba82-4ef2-4cf9-87ca-c1c10d45dff5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:12.479108 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-defaba82-4ef2-4cf9-87ca-c1c10d45dff5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:12.626172 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-defaba82-4ef2-4cf9-87ca-c1c10d45dff5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:43:12.634355 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-defaba82-4ef2-4cf9-87ca-c1c10d45dff5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f" status: 200 len: 1679 microversion: 2.1 time: 0.174383 Sep 08 11:43:12.635165 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3608/7083] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:43:12 2022] GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f => generated 1679 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:43:13.659009 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5a57884e-cf2e-4d8b-bef3-13e8be3dc87a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:43:13.659621 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5a57884e-cf2e-4d8b-bef3-13e8be3dc87a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 654a0638-6345-4150-9a9b-b58143e2213f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:43:13.668411 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a57884e-cf2e-4d8b-bef3-13e8be3dc87a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:13.668921 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a57884e-cf2e-4d8b-bef3-13e8be3dc87a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:13.669410 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a57884e-cf2e-4d8b-bef3-13e8be3dc87a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:13.670270 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a57884e-cf2e-4d8b-bef3-13e8be3dc87a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:13.670751 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a57884e-cf2e-4d8b-bef3-13e8be3dc87a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:13.671217 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a57884e-cf2e-4d8b-bef3-13e8be3dc87a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:13.813664 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5a57884e-cf2e-4d8b-bef3-13e8be3dc87a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:43:13.821802 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5a57884e-cf2e-4d8b-bef3-13e8be3dc87a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f" status: 200 len: 1679 microversion: 2.1 time: 0.167353 Sep 08 11:43:13.822469 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3476/7084] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:43:13 2022] GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f => generated 1679 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:43:14.845557 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-dbd93e06-b339-4f2d-90ea-8adb7daa1ef4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:43:14.846166 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-dbd93e06-b339-4f2d-90ea-8adb7daa1ef4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 654a0638-6345-4150-9a9b-b58143e2213f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:43:14.852746 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dbd93e06-b339-4f2d-90ea-8adb7daa1ef4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:14.853266 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dbd93e06-b339-4f2d-90ea-8adb7daa1ef4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:14.853697 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dbd93e06-b339-4f2d-90ea-8adb7daa1ef4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:14.854386 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dbd93e06-b339-4f2d-90ea-8adb7daa1ef4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:14.854844 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dbd93e06-b339-4f2d-90ea-8adb7daa1ef4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:14.855268 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dbd93e06-b339-4f2d-90ea-8adb7daa1ef4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:14.990730 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-dbd93e06-b339-4f2d-90ea-8adb7daa1ef4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:43:14.998802 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-dbd93e06-b339-4f2d-90ea-8adb7daa1ef4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f" status: 200 len: 1684 microversion: 2.1 time: 0.157173 Sep 08 11:43:14.999398 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3609/7085] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:43:14 2022] GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f => generated 1684 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:43:16.023693 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fa09213c-c1e4-4975-9b3e-759d87c57f50 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:43:16.024397 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fa09213c-c1e4-4975-9b3e-759d87c57f50 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 654a0638-6345-4150-9a9b-b58143e2213f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:43:16.031321 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fa09213c-c1e4-4975-9b3e-759d87c57f50 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:16.032492 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fa09213c-c1e4-4975-9b3e-759d87c57f50 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:16.032955 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fa09213c-c1e4-4975-9b3e-759d87c57f50 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:16.033772 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fa09213c-c1e4-4975-9b3e-759d87c57f50 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:16.034251 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fa09213c-c1e4-4975-9b3e-759d87c57f50 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:16.034695 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fa09213c-c1e4-4975-9b3e-759d87c57f50 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:16.165721 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fa09213c-c1e4-4975-9b3e-759d87c57f50 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:43:16.173883 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fa09213c-c1e4-4975-9b3e-759d87c57f50 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f" status: 200 len: 1684 microversion: 2.1 time: 0.154164 Sep 08 11:43:16.174473 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3477/7086] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:43:16 2022] GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:43:17.197751 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ef98f605-a300-4439-ac11-a9cc817cca97 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:43:17.198370 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ef98f605-a300-4439-ac11-a9cc817cca97 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 654a0638-6345-4150-9a9b-b58143e2213f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:43:17.205726 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ef98f605-a300-4439-ac11-a9cc817cca97 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:17.206220 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ef98f605-a300-4439-ac11-a9cc817cca97 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:17.206663 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ef98f605-a300-4439-ac11-a9cc817cca97 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:17.207359 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ef98f605-a300-4439-ac11-a9cc817cca97 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:17.207819 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ef98f605-a300-4439-ac11-a9cc817cca97 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:17.208248 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ef98f605-a300-4439-ac11-a9cc817cca97 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:17.342367 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ef98f605-a300-4439-ac11-a9cc817cca97 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:43:17.350892 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ef98f605-a300-4439-ac11-a9cc817cca97 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f" status: 200 len: 1684 microversion: 2.1 time: 0.157009 Sep 08 11:43:17.351476 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3610/7087] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:43:17 2022] GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f => generated 1684 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:43:18.373681 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4aeaa781-bd84-4b9d-ada5-9429ba59fdf8 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:43:18.374317 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4aeaa781-bd84-4b9d-ada5-9429ba59fdf8 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 654a0638-6345-4150-9a9b-b58143e2213f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:43:18.381475 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4aeaa781-bd84-4b9d-ada5-9429ba59fdf8 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:18.381915 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4aeaa781-bd84-4b9d-ada5-9429ba59fdf8 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:18.382364 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4aeaa781-bd84-4b9d-ada5-9429ba59fdf8 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:18.383079 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4aeaa781-bd84-4b9d-ada5-9429ba59fdf8 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:18.383556 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4aeaa781-bd84-4b9d-ada5-9429ba59fdf8 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:18.383994 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4aeaa781-bd84-4b9d-ada5-9429ba59fdf8 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:18.524166 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4aeaa781-bd84-4b9d-ada5-9429ba59fdf8 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:43:18.532495 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4aeaa781-bd84-4b9d-ada5-9429ba59fdf8 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f" status: 200 len: 1684 microversion: 2.1 time: 0.162600 Sep 08 11:43:18.533238 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3478/7088] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:43:18 2022] GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f => generated 1684 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:43:19.556490 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7390bcde-25b2-4e87-b9b6-815507092630 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:43:19.557167 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7390bcde-25b2-4e87-b9b6-815507092630 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 654a0638-6345-4150-9a9b-b58143e2213f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:43:19.564542 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7390bcde-25b2-4e87-b9b6-815507092630 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:19.565051 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7390bcde-25b2-4e87-b9b6-815507092630 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:19.565477 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7390bcde-25b2-4e87-b9b6-815507092630 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:19.566165 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7390bcde-25b2-4e87-b9b6-815507092630 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:19.566616 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7390bcde-25b2-4e87-b9b6-815507092630 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:19.567036 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7390bcde-25b2-4e87-b9b6-815507092630 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:19.696043 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7390bcde-25b2-4e87-b9b6-815507092630 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:43:19.703970 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7390bcde-25b2-4e87-b9b6-815507092630 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f" status: 200 len: 1684 microversion: 2.1 time: 0.151200 Sep 08 11:43:19.704551 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3611/7089] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:43:19 2022] GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:43:20.726842 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9d1edebd-4e77-4b97-aca4-296b9bfabd72 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:43:20.727477 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9d1edebd-4e77-4b97-aca4-296b9bfabd72 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 654a0638-6345-4150-9a9b-b58143e2213f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:43:20.734306 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d1edebd-4e77-4b97-aca4-296b9bfabd72 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:20.734817 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d1edebd-4e77-4b97-aca4-296b9bfabd72 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:20.735272 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d1edebd-4e77-4b97-aca4-296b9bfabd72 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:20.735994 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d1edebd-4e77-4b97-aca4-296b9bfabd72 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:20.736465 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d1edebd-4e77-4b97-aca4-296b9bfabd72 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:20.736909 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d1edebd-4e77-4b97-aca4-296b9bfabd72 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:20.866793 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9d1edebd-4e77-4b97-aca4-296b9bfabd72 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:43:20.874964 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9d1edebd-4e77-4b97-aca4-296b9bfabd72 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f" status: 200 len: 1684 microversion: 2.1 time: 0.152102 Sep 08 11:43:20.876043 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3479/7090] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:43:20 2022] GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:43:21.898510 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0f3b6192-217b-4d1b-a0cf-8d8b4bf8d9e4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:43:21.899134 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0f3b6192-217b-4d1b-a0cf-8d8b4bf8d9e4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 654a0638-6345-4150-9a9b-b58143e2213f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:43:21.905986 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0f3b6192-217b-4d1b-a0cf-8d8b4bf8d9e4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:21.906797 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0f3b6192-217b-4d1b-a0cf-8d8b4bf8d9e4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:21.907171 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0f3b6192-217b-4d1b-a0cf-8d8b4bf8d9e4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:21.908008 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0f3b6192-217b-4d1b-a0cf-8d8b4bf8d9e4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:21.908474 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0f3b6192-217b-4d1b-a0cf-8d8b4bf8d9e4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:21.908906 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0f3b6192-217b-4d1b-a0cf-8d8b4bf8d9e4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:22.039200 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0f3b6192-217b-4d1b-a0cf-8d8b4bf8d9e4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:43:22.046952 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0f3b6192-217b-4d1b-a0cf-8d8b4bf8d9e4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f" status: 200 len: 1684 microversion: 2.1 time: 0.152319 Sep 08 11:43:22.048248 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3612/7091] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:43:21 2022] GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:43:23.071072 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9be2ddba-c80d-4b6d-874d-c1c6f40ada6e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:43:23.071701 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9be2ddba-c80d-4b6d-874d-c1c6f40ada6e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 654a0638-6345-4150-9a9b-b58143e2213f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:43:23.080126 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9be2ddba-c80d-4b6d-874d-c1c6f40ada6e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:23.080728 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9be2ddba-c80d-4b6d-874d-c1c6f40ada6e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:23.081244 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9be2ddba-c80d-4b6d-874d-c1c6f40ada6e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:23.082075 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9be2ddba-c80d-4b6d-874d-c1c6f40ada6e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:23.082535 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9be2ddba-c80d-4b6d-874d-c1c6f40ada6e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:23.083073 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9be2ddba-c80d-4b6d-874d-c1c6f40ada6e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:23.220504 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9be2ddba-c80d-4b6d-874d-c1c6f40ada6e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:43:23.228385 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9be2ddba-c80d-4b6d-874d-c1c6f40ada6e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f" status: 200 len: 1684 microversion: 2.1 time: 0.161278 Sep 08 11:43:23.228955 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3480/7092] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:43:23 2022] GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f => generated 1684 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:43:24.251932 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5a3634a1-a62b-4c59-be14-94886a78b0ba tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:43:24.252533 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5a3634a1-a62b-4c59-be14-94886a78b0ba tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 654a0638-6345-4150-9a9b-b58143e2213f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:43:24.259656 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5a3634a1-a62b-4c59-be14-94886a78b0ba tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:24.260148 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5a3634a1-a62b-4c59-be14-94886a78b0ba tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:24.260583 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5a3634a1-a62b-4c59-be14-94886a78b0ba tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:24.261335 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5a3634a1-a62b-4c59-be14-94886a78b0ba tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:24.261814 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5a3634a1-a62b-4c59-be14-94886a78b0ba tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:24.262219 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5a3634a1-a62b-4c59-be14-94886a78b0ba tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:24.408960 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5a3634a1-a62b-4c59-be14-94886a78b0ba tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:43:24.416971 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5a3634a1-a62b-4c59-be14-94886a78b0ba tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f" status: 200 len: 1684 microversion: 2.1 time: 0.169057 Sep 08 11:43:24.417598 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3613/7093] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:43:24 2022] GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f => generated 1684 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:43:25.440307 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cc20b407-9e75-4644-98a0-ed7591c33cf4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:43:25.440943 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cc20b407-9e75-4644-98a0-ed7591c33cf4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 654a0638-6345-4150-9a9b-b58143e2213f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:43:25.448054 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc20b407-9e75-4644-98a0-ed7591c33cf4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:25.448570 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc20b407-9e75-4644-98a0-ed7591c33cf4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:25.449046 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc20b407-9e75-4644-98a0-ed7591c33cf4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:25.449872 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc20b407-9e75-4644-98a0-ed7591c33cf4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:25.450352 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc20b407-9e75-4644-98a0-ed7591c33cf4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:25.450888 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc20b407-9e75-4644-98a0-ed7591c33cf4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:25.590396 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cc20b407-9e75-4644-98a0-ed7591c33cf4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:43:25.599280 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cc20b407-9e75-4644-98a0-ed7591c33cf4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f" status: 200 len: 1684 microversion: 2.1 time: 0.163310 Sep 08 11:43:25.599866 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3481/7094] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:43:25 2022] GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f => generated 1684 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:43:26.623117 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9c15221d-6e80-4fb0-b620-8d5e776a3880 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:43:26.623729 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9c15221d-6e80-4fb0-b620-8d5e776a3880 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 654a0638-6345-4150-9a9b-b58143e2213f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:43:26.630680 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9c15221d-6e80-4fb0-b620-8d5e776a3880 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:26.631170 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9c15221d-6e80-4fb0-b620-8d5e776a3880 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:26.631611 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9c15221d-6e80-4fb0-b620-8d5e776a3880 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:26.632304 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9c15221d-6e80-4fb0-b620-8d5e776a3880 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:26.632765 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9c15221d-6e80-4fb0-b620-8d5e776a3880 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:26.633225 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9c15221d-6e80-4fb0-b620-8d5e776a3880 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:26.764571 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9c15221d-6e80-4fb0-b620-8d5e776a3880 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:43:26.772313 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9c15221d-6e80-4fb0-b620-8d5e776a3880 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f" status: 200 len: 1684 microversion: 2.1 time: 0.153149 Sep 08 11:43:26.772889 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3614/7095] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:43:26 2022] GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:43:27.795763 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1e4de94c-dfea-4f9c-857b-eda3f455a830 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:43:27.796434 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1e4de94c-dfea-4f9c-857b-eda3f455a830 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 654a0638-6345-4150-9a9b-b58143e2213f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:43:27.803963 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e4de94c-dfea-4f9c-857b-eda3f455a830 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:27.804473 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e4de94c-dfea-4f9c-857b-eda3f455a830 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:27.804927 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e4de94c-dfea-4f9c-857b-eda3f455a830 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:27.805677 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e4de94c-dfea-4f9c-857b-eda3f455a830 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:27.806147 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e4de94c-dfea-4f9c-857b-eda3f455a830 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:27.806594 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e4de94c-dfea-4f9c-857b-eda3f455a830 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:27.939137 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1e4de94c-dfea-4f9c-857b-eda3f455a830 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:43:27.946875 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1e4de94c-dfea-4f9c-857b-eda3f455a830 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f" status: 200 len: 1684 microversion: 2.1 time: 0.155057 Sep 08 11:43:27.947454 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3482/7096] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:43:27 2022] GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:43:28.970585 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2d3b8b69-55db-4cfe-a247-83d4a29ea0ce tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:43:28.971201 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2d3b8b69-55db-4cfe-a247-83d4a29ea0ce tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 654a0638-6345-4150-9a9b-b58143e2213f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:43:28.977999 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2d3b8b69-55db-4cfe-a247-83d4a29ea0ce tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:28.978502 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2d3b8b69-55db-4cfe-a247-83d4a29ea0ce tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:28.978917 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2d3b8b69-55db-4cfe-a247-83d4a29ea0ce tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:28.979610 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2d3b8b69-55db-4cfe-a247-83d4a29ea0ce tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:28.980067 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2d3b8b69-55db-4cfe-a247-83d4a29ea0ce tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:28.980488 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2d3b8b69-55db-4cfe-a247-83d4a29ea0ce tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:29.117302 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2d3b8b69-55db-4cfe-a247-83d4a29ea0ce tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:43:29.124990 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2d3b8b69-55db-4cfe-a247-83d4a29ea0ce tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f" status: 200 len: 1684 microversion: 2.1 time: 0.158314 Sep 08 11:43:29.126179 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3615/7097] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:43:28 2022] GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f => generated 1684 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:43:30.149616 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-71af38ad-cd7b-445c-b58e-e4bb4f191c2a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:43:30.150169 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-71af38ad-cd7b-445c-b58e-e4bb4f191c2a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 654a0638-6345-4150-9a9b-b58143e2213f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:43:30.157952 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71af38ad-cd7b-445c-b58e-e4bb4f191c2a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:30.158482 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71af38ad-cd7b-445c-b58e-e4bb4f191c2a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:30.158946 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71af38ad-cd7b-445c-b58e-e4bb4f191c2a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:30.159689 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71af38ad-cd7b-445c-b58e-e4bb4f191c2a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:30.160168 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71af38ad-cd7b-445c-b58e-e4bb4f191c2a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:30.160620 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71af38ad-cd7b-445c-b58e-e4bb4f191c2a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:30.302573 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-71af38ad-cd7b-445c-b58e-e4bb4f191c2a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:43:30.310742 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-71af38ad-cd7b-445c-b58e-e4bb4f191c2a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f" status: 200 len: 1684 microversion: 2.1 time: 0.164951 Sep 08 11:43:30.311343 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3483/7098] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:43:30 2022] GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f => generated 1684 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:43:31.335408 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a510aba5-98a5-4c5d-b765-320951052405 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:43:31.335941 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a510aba5-98a5-4c5d-b765-320951052405 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 654a0638-6345-4150-9a9b-b58143e2213f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:43:31.342796 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a510aba5-98a5-4c5d-b765-320951052405 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:31.343283 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a510aba5-98a5-4c5d-b765-320951052405 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:31.343753 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a510aba5-98a5-4c5d-b765-320951052405 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:31.344941 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a510aba5-98a5-4c5d-b765-320951052405 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:31.345492 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a510aba5-98a5-4c5d-b765-320951052405 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:31.345986 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a510aba5-98a5-4c5d-b765-320951052405 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:31.481398 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a510aba5-98a5-4c5d-b765-320951052405 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:43:31.489774 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a510aba5-98a5-4c5d-b765-320951052405 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f" status: 200 len: 1683 microversion: 2.1 time: 0.158271 Sep 08 11:43:31.490396 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3616/7099] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:43:31 2022] GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:43:31.656316 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-6fe62792-dfe7-4188-b083-8aa6e9429d95 req-55441f07-70e6-49fb-bca8-f957f8aff196 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "654a0638-6345-4150-9a9b-b58143e2213f", "name": "network-vif-unplugged", "status": "completed", "tag": "7f3e106a-7992-4c1a-aab4-364d46cd930e"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:43:31.668253 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-6fe62792-dfe7-4188-b083-8aa6e9429d95 req-55441f07-70e6-49fb-bca8-f957f8aff196 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:31.668765 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-6fe62792-dfe7-4188-b083-8aa6e9429d95 req-55441f07-70e6-49fb-bca8-f957f8aff196 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:31.669246 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-6fe62792-dfe7-4188-b083-8aa6e9429d95 req-55441f07-70e6-49fb-bca8-f957f8aff196 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:31.685128 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-6fe62792-dfe7-4188-b083-8aa6e9429d95 req-55441f07-70e6-49fb-bca8-f957f8aff196 service nova] Creating event network-vif-unplugged:7f3e106a-7992-4c1a-aab4-364d46cd930e for instance 654a0638-6345-4150-9a9b-b58143e2213f on n-h2-850501-12 Sep 08 11:43:31.690672 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [req-6fe62792-dfe7-4188-b083-8aa6e9429d95 req-55441f07-70e6-49fb-bca8-f957f8aff196 service nova] Instance 654a0638-6345-4150-9a9b-b58143e2213f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850501-12', 'n-h1-850501-12'} {{(pid=128862) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 11:43:31.701918 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-6fe62792-dfe7-4188-b083-8aa6e9429d95 req-55441f07-70e6-49fb-bca8-f957f8aff196 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049397 Sep 08 11:43:31.702614 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3484/7100] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:43:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:43:32.513698 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-23a46821-8924-43e8-af6f-d82057683612 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:43:32.514318 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-23a46821-8924-43e8-af6f-d82057683612 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 654a0638-6345-4150-9a9b-b58143e2213f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:43:32.522897 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-23a46821-8924-43e8-af6f-d82057683612 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:32.523625 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-23a46821-8924-43e8-af6f-d82057683612 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:32.524252 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-23a46821-8924-43e8-af6f-d82057683612 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:32.525012 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-23a46821-8924-43e8-af6f-d82057683612 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:32.525482 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-23a46821-8924-43e8-af6f-d82057683612 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:32.525912 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-23a46821-8924-43e8-af6f-d82057683612 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:32.666907 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-23a46821-8924-43e8-af6f-d82057683612 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:43:32.674978 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-23a46821-8924-43e8-af6f-d82057683612 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f" status: 200 len: 1683 microversion: 2.1 time: 0.165179 Sep 08 11:43:32.675561 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3617/7101] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:43:32 2022] GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f => generated 1683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:43:33.700849 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5903cb07-7804-4288-ba65-67bb3f3dd2eb tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:43:33.701677 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5903cb07-7804-4288-ba65-67bb3f3dd2eb tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 654a0638-6345-4150-9a9b-b58143e2213f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:43:33.708564 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5903cb07-7804-4288-ba65-67bb3f3dd2eb tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:33.709097 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5903cb07-7804-4288-ba65-67bb3f3dd2eb tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:33.709556 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5903cb07-7804-4288-ba65-67bb3f3dd2eb tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:33.710277 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5903cb07-7804-4288-ba65-67bb3f3dd2eb tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:33.710754 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5903cb07-7804-4288-ba65-67bb3f3dd2eb tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:33.711233 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5903cb07-7804-4288-ba65-67bb3f3dd2eb tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:33.739335 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-daa38bd9-2255-4ac7-9f60-184fbcb28901 req-7131fe11-5298-4bcc-808f-1f57f1648247 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "654a0638-6345-4150-9a9b-b58143e2213f", "tag": "7f3e106a-7992-4c1a-aab4-364d46cd930e"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:43:33.750194 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-daa38bd9-2255-4ac7-9f60-184fbcb28901 req-7131fe11-5298-4bcc-808f-1f57f1648247 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:33.750803 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-daa38bd9-2255-4ac7-9f60-184fbcb28901 req-7131fe11-5298-4bcc-808f-1f57f1648247 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:33.751230 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-daa38bd9-2255-4ac7-9f60-184fbcb28901 req-7131fe11-5298-4bcc-808f-1f57f1648247 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:33.763420 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-daa38bd9-2255-4ac7-9f60-184fbcb28901 req-7131fe11-5298-4bcc-808f-1f57f1648247 service nova] Creating event network-changed:7f3e106a-7992-4c1a-aab4-364d46cd930e for instance 654a0638-6345-4150-9a9b-b58143e2213f on n-h2-850501-12 Sep 08 11:43:33.769542 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [req-daa38bd9-2255-4ac7-9f60-184fbcb28901 req-7131fe11-5298-4bcc-808f-1f57f1648247 service nova] Instance 654a0638-6345-4150-9a9b-b58143e2213f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850501-12', 'n-h1-850501-12'} {{(pid=128861) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 11:43:33.780774 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-daa38bd9-2255-4ac7-9f60-184fbcb28901 req-7131fe11-5298-4bcc-808f-1f57f1648247 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045548 Sep 08 11:43:33.782322 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3618/7102] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:43:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:43:33.854835 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5903cb07-7804-4288-ba65-67bb3f3dd2eb tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:43:33.863476 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5903cb07-7804-4288-ba65-67bb3f3dd2eb tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f" status: 200 len: 1681 microversion: 2.1 time: 0.167554 Sep 08 11:43:33.864061 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3485/7103] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:43:33 2022] GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f => generated 1681 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:43:34.888795 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ec519d5c-27fd-4552-a1ce-662b62c835e3 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:43:34.890132 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ec519d5c-27fd-4552-a1ce-662b62c835e3 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 654a0638-6345-4150-9a9b-b58143e2213f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:43:34.896578 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ec519d5c-27fd-4552-a1ce-662b62c835e3 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:34.897089 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ec519d5c-27fd-4552-a1ce-662b62c835e3 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:34.897523 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ec519d5c-27fd-4552-a1ce-662b62c835e3 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:34.898216 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ec519d5c-27fd-4552-a1ce-662b62c835e3 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:34.898668 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ec519d5c-27fd-4552-a1ce-662b62c835e3 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:34.899091 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ec519d5c-27fd-4552-a1ce-662b62c835e3 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:35.032937 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ec519d5c-27fd-4552-a1ce-662b62c835e3 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:43:35.040713 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ec519d5c-27fd-4552-a1ce-662b62c835e3 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f" status: 200 len: 1678 microversion: 2.1 time: 0.157255 Sep 08 11:43:35.041321 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3619/7104] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:43:34 2022] GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:43:35.064787 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8db64f70-1598-40c4-8565-7899c7732c63 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:43:35.065639 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8db64f70-1598-40c4-8565-7899c7732c63 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 654a0638-6345-4150-9a9b-b58143e2213f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:43:35.072548 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8db64f70-1598-40c4-8565-7899c7732c63 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:35.073083 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8db64f70-1598-40c4-8565-7899c7732c63 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:35.073543 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8db64f70-1598-40c4-8565-7899c7732c63 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:35.074266 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8db64f70-1598-40c4-8565-7899c7732c63 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:35.074750 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8db64f70-1598-40c4-8565-7899c7732c63 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:35.075197 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8db64f70-1598-40c4-8565-7899c7732c63 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:35.113418 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8db64f70-1598-40c4-8565-7899c7732c63 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:35.113923 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8db64f70-1598-40c4-8565-7899c7732c63 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:35.114380 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8db64f70-1598-40c4-8565-7899c7732c63 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:35.115133 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8db64f70-1598-40c4-8565-7899c7732c63 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:35.115607 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8db64f70-1598-40c4-8565-7899c7732c63 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:35.116050 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8db64f70-1598-40c4-8565-7899c7732c63 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:35.136365 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-8db64f70-1598-40c4-8565-7899c7732c63 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Getting quotas for project 5e7adfbb1417415b9eafeeb23b7a7c18. Resources: {'ram', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:43:35.141597 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-8db64f70-1598-40c4-8565-7899c7732c63 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Getting quotas for user f38a21e862664942bf35c93870df1c36 and project 5e7adfbb1417415b9eafeeb23b7a7c18. Resources: {'ram', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:43:35.246542 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8db64f70-1598-40c4-8565-7899c7732c63 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "POST /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f/action" status: 202 len: 0 microversion: 2.1 time: 0.186109 Sep 08 11:43:35.247211 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3486/7105] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 11:43:35 2022] POST /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:43:35.255853 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-037d8577-9914-4693-a229-699af765165d tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:43:35.256482 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-037d8577-9914-4693-a229-699af765165d tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 654a0638-6345-4150-9a9b-b58143e2213f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:43:35.262974 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-037d8577-9914-4693-a229-699af765165d tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:35.263473 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-037d8577-9914-4693-a229-699af765165d tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:35.263906 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-037d8577-9914-4693-a229-699af765165d tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:35.265145 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-037d8577-9914-4693-a229-699af765165d tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:35.266604 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-037d8577-9914-4693-a229-699af765165d tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:35.267184 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-037d8577-9914-4693-a229-699af765165d tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:35.415370 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-037d8577-9914-4693-a229-699af765165d tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:43:35.425072 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-037d8577-9914-4693-a229-699af765165d tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f" status: 200 len: 1677 microversion: 2.1 time: 0.172989 Sep 08 11:43:35.425888 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3620/7106] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:43:35 2022] GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f => generated 1677 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:43:36.449379 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b570417f-8513-4c97-8280-6b3b0dba5cb3 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:43:36.450104 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b570417f-8513-4c97-8280-6b3b0dba5cb3 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 654a0638-6345-4150-9a9b-b58143e2213f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:43:36.457201 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b570417f-8513-4c97-8280-6b3b0dba5cb3 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:36.457713 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b570417f-8513-4c97-8280-6b3b0dba5cb3 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:36.458171 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b570417f-8513-4c97-8280-6b3b0dba5cb3 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:36.458890 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b570417f-8513-4c97-8280-6b3b0dba5cb3 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:36.459369 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b570417f-8513-4c97-8280-6b3b0dba5cb3 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:36.459816 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b570417f-8513-4c97-8280-6b3b0dba5cb3 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:36.478280 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:43:36.599063 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b570417f-8513-4c97-8280-6b3b0dba5cb3 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:43:36.607083 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b570417f-8513-4c97-8280-6b3b0dba5cb3 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f" status: 200 len: 1677 microversion: 2.1 time: 0.162878 Sep 08 11:43:36.607675 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3487/7107] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:43:36 2022] GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:43:37.404029 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-4ec6b182-4c8e-4099-b7f6-abe45a955451 req-9add237d-b7a6-4d35-9342-847cfb076ec3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "654a0638-6345-4150-9a9b-b58143e2213f", "name": "network-vif-plugged", "status": "completed", "tag": "7f3e106a-7992-4c1a-aab4-364d46cd930e"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:43:37.417155 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-4ec6b182-4c8e-4099-b7f6-abe45a955451 req-9add237d-b7a6-4d35-9342-847cfb076ec3 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:37.417884 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-4ec6b182-4c8e-4099-b7f6-abe45a955451 req-9add237d-b7a6-4d35-9342-847cfb076ec3 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:37.418326 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-4ec6b182-4c8e-4099-b7f6-abe45a955451 req-9add237d-b7a6-4d35-9342-847cfb076ec3 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:37.431366 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-4ec6b182-4c8e-4099-b7f6-abe45a955451 req-9add237d-b7a6-4d35-9342-847cfb076ec3 service nova] Creating event network-vif-plugged:7f3e106a-7992-4c1a-aab4-364d46cd930e for instance 654a0638-6345-4150-9a9b-b58143e2213f on n-h2-850501-12 Sep 08 11:43:37.436911 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [req-4ec6b182-4c8e-4099-b7f6-abe45a955451 req-9add237d-b7a6-4d35-9342-847cfb076ec3 service nova] Instance 654a0638-6345-4150-9a9b-b58143e2213f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850501-12', 'n-h1-850501-12'} {{(pid=128861) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 11:43:37.448491 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-4ec6b182-4c8e-4099-b7f6-abe45a955451 req-9add237d-b7a6-4d35-9342-847cfb076ec3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048177 Sep 08 11:43:37.449139 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3621/7108] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:43:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:43:37.630436 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bb81a37a-435b-4081-97c4-aa43637b4453 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:43:37.631073 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bb81a37a-435b-4081-97c4-aa43637b4453 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 654a0638-6345-4150-9a9b-b58143e2213f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:43:37.637992 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb81a37a-435b-4081-97c4-aa43637b4453 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:37.638506 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb81a37a-435b-4081-97c4-aa43637b4453 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:37.638964 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb81a37a-435b-4081-97c4-aa43637b4453 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:37.639676 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb81a37a-435b-4081-97c4-aa43637b4453 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:37.640154 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb81a37a-435b-4081-97c4-aa43637b4453 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:37.641183 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb81a37a-435b-4081-97c4-aa43637b4453 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:37.772522 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bb81a37a-435b-4081-97c4-aa43637b4453 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:43:37.780581 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bb81a37a-435b-4081-97c4-aa43637b4453 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f" status: 200 len: 1677 microversion: 2.1 time: 0.154088 Sep 08 11:43:37.781221 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3488/7109] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:43:37 2022] GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:43:38.631355 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-60e4ddde-3cef-4aca-b749-c756c835b8cb req-3da99c1b-a6eb-4eaa-9b79-189c1efc70ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "654a0638-6345-4150-9a9b-b58143e2213f", "name": "network-vif-unplugged", "status": "completed", "tag": "7f3e106a-7992-4c1a-aab4-364d46cd930e"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:43:38.641768 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-60e4ddde-3cef-4aca-b749-c756c835b8cb req-3da99c1b-a6eb-4eaa-9b79-189c1efc70ef service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:38.642258 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-60e4ddde-3cef-4aca-b749-c756c835b8cb req-3da99c1b-a6eb-4eaa-9b79-189c1efc70ef service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:38.642687 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-60e4ddde-3cef-4aca-b749-c756c835b8cb req-3da99c1b-a6eb-4eaa-9b79-189c1efc70ef service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:38.654813 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-60e4ddde-3cef-4aca-b749-c756c835b8cb req-3da99c1b-a6eb-4eaa-9b79-189c1efc70ef service nova] Creating event network-vif-unplugged:7f3e106a-7992-4c1a-aab4-364d46cd930e for instance 654a0638-6345-4150-9a9b-b58143e2213f on n-h1-850501-12 Sep 08 11:43:38.660994 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [req-60e4ddde-3cef-4aca-b749-c756c835b8cb req-3da99c1b-a6eb-4eaa-9b79-189c1efc70ef service nova] Instance 654a0638-6345-4150-9a9b-b58143e2213f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850501-12', 'n-h1-850501-12'} {{(pid=128861) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 11:43:38.671746 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-60e4ddde-3cef-4aca-b749-c756c835b8cb req-3da99c1b-a6eb-4eaa-9b79-189c1efc70ef service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045554 Sep 08 11:43:38.673525 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3622/7110] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:43:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:43:38.805950 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2d25488e-3283-4a8c-8473-0eb9827fb628 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:43:38.806606 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2d25488e-3283-4a8c-8473-0eb9827fb628 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 654a0638-6345-4150-9a9b-b58143e2213f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:43:38.814184 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2d25488e-3283-4a8c-8473-0eb9827fb628 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:38.814702 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2d25488e-3283-4a8c-8473-0eb9827fb628 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:38.815161 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2d25488e-3283-4a8c-8473-0eb9827fb628 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:38.815902 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2d25488e-3283-4a8c-8473-0eb9827fb628 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:38.816378 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2d25488e-3283-4a8c-8473-0eb9827fb628 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:38.816823 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2d25488e-3283-4a8c-8473-0eb9827fb628 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:38.957883 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2d25488e-3283-4a8c-8473-0eb9827fb628 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:43:38.966321 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2d25488e-3283-4a8c-8473-0eb9827fb628 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f" status: 200 len: 1677 microversion: 2.1 time: 0.164441 Sep 08 11:43:38.967138 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3489/7111] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:43:38 2022] GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:43:39.991985 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-69f8084d-4fd1-4207-9974-885446782236 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:43:39.992684 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-69f8084d-4fd1-4207-9974-885446782236 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 654a0638-6345-4150-9a9b-b58143e2213f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:43:39.998789 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-69f8084d-4fd1-4207-9974-885446782236 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:39.999272 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-69f8084d-4fd1-4207-9974-885446782236 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:39.999708 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-69f8084d-4fd1-4207-9974-885446782236 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:40.000531 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-69f8084d-4fd1-4207-9974-885446782236 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:40.000977 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-69f8084d-4fd1-4207-9974-885446782236 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:40.001430 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-69f8084d-4fd1-4207-9974-885446782236 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:40.139863 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-69f8084d-4fd1-4207-9974-885446782236 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:43:40.150636 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-69f8084d-4fd1-4207-9974-885446782236 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f" status: 200 len: 1677 microversion: 2.1 time: 0.163952 Sep 08 11:43:40.151227 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3623/7112] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:43:39 2022] GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:43:41.001900 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-818b6893-64cd-4c68-84e3-7999d611b848 req-f953334c-2bcb-4980-a5ec-8c8d85738ab4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "654a0638-6345-4150-9a9b-b58143e2213f", "tag": "7f3e106a-7992-4c1a-aab4-364d46cd930e"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:43:41.012472 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-818b6893-64cd-4c68-84e3-7999d611b848 req-f953334c-2bcb-4980-a5ec-8c8d85738ab4 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:41.012979 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-818b6893-64cd-4c68-84e3-7999d611b848 req-f953334c-2bcb-4980-a5ec-8c8d85738ab4 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:41.013473 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-818b6893-64cd-4c68-84e3-7999d611b848 req-f953334c-2bcb-4980-a5ec-8c8d85738ab4 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:41.030012 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-818b6893-64cd-4c68-84e3-7999d611b848 req-f953334c-2bcb-4980-a5ec-8c8d85738ab4 service nova] Creating event network-changed:7f3e106a-7992-4c1a-aab4-364d46cd930e for instance 654a0638-6345-4150-9a9b-b58143e2213f on n-h1-850501-12 Sep 08 11:43:41.037691 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [req-818b6893-64cd-4c68-84e3-7999d611b848 req-f953334c-2bcb-4980-a5ec-8c8d85738ab4 service nova] Instance 654a0638-6345-4150-9a9b-b58143e2213f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850501-12', 'n-h1-850501-12'} {{(pid=128862) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 11:43:41.052419 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-818b6893-64cd-4c68-84e3-7999d611b848 req-f953334c-2bcb-4980-a5ec-8c8d85738ab4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054899 Sep 08 11:43:41.053115 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3490/7113] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:43:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:43:41.177209 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-00f0325c-48f5-4378-8e96-64b86c4f65c9 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:43:41.178054 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-00f0325c-48f5-4378-8e96-64b86c4f65c9 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 654a0638-6345-4150-9a9b-b58143e2213f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:43:41.188805 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-00f0325c-48f5-4378-8e96-64b86c4f65c9 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:41.189826 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-00f0325c-48f5-4378-8e96-64b86c4f65c9 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:41.190450 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-00f0325c-48f5-4378-8e96-64b86c4f65c9 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:41.192440 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-00f0325c-48f5-4378-8e96-64b86c4f65c9 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:41.193158 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-00f0325c-48f5-4378-8e96-64b86c4f65c9 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:41.193797 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-00f0325c-48f5-4378-8e96-64b86c4f65c9 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:41.374764 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-00f0325c-48f5-4378-8e96-64b86c4f65c9 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:43:41.389265 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-00f0325c-48f5-4378-8e96-64b86c4f65c9 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f" status: 200 len: 1677 microversion: 2.1 time: 0.217807 Sep 08 11:43:41.391699 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3624/7114] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:43:41 2022] GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f => generated 1677 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:43:42.414523 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cb25b8e6-b8dc-4d4e-b72d-be456c924a8d tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:43:42.415252 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cb25b8e6-b8dc-4d4e-b72d-be456c924a8d tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 654a0638-6345-4150-9a9b-b58143e2213f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:43:42.418113 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:43:42.424071 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb25b8e6-b8dc-4d4e-b72d-be456c924a8d tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:42.424591 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb25b8e6-b8dc-4d4e-b72d-be456c924a8d tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:42.425082 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb25b8e6-b8dc-4d4e-b72d-be456c924a8d tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:42.425828 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb25b8e6-b8dc-4d4e-b72d-be456c924a8d tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:42.426314 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb25b8e6-b8dc-4d4e-b72d-be456c924a8d tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:42.426761 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb25b8e6-b8dc-4d4e-b72d-be456c924a8d tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:42.568945 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cb25b8e6-b8dc-4d4e-b72d-be456c924a8d tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:43:42.577162 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cb25b8e6-b8dc-4d4e-b72d-be456c924a8d tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f" status: 200 len: 1670 microversion: 2.1 time: 0.166902 Sep 08 11:43:42.577762 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3491/7115] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:43:42 2022] GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f => generated 1670 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:43:42.602367 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-de72b7e2-f71d-488c-a2c0-f95ec8d1c8ed tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:43:42.602994 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-de72b7e2-f71d-488c-a2c0-f95ec8d1c8ed tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 654a0638-6345-4150-9a9b-b58143e2213f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:43:42.605847 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=35 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:43:42.611167 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-de72b7e2-f71d-488c-a2c0-f95ec8d1c8ed tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:42.611662 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-de72b7e2-f71d-488c-a2c0-f95ec8d1c8ed tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:42.612100 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-de72b7e2-f71d-488c-a2c0-f95ec8d1c8ed tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:42.612802 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-de72b7e2-f71d-488c-a2c0-f95ec8d1c8ed tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:42.613550 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-de72b7e2-f71d-488c-a2c0-f95ec8d1c8ed tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:42.613981 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-de72b7e2-f71d-488c-a2c0-f95ec8d1c8ed tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:42.616819 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=97 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:43:42.752258 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-de72b7e2-f71d-488c-a2c0-f95ec8d1c8ed tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:43:42.760023 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-de72b7e2-f71d-488c-a2c0-f95ec8d1c8ed tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f" status: 200 len: 1670 microversion: 2.1 time: 0.161627 Sep 08 11:43:42.760610 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3625/7116] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:43:42 2022] GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f => generated 1670 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:43:42.782492 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a39dd729-7736-4268-97d5-1f08a7cbb8e1 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:43:42.783057 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a39dd729-7736-4268-97d5-1f08a7cbb8e1 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 654a0638-6345-4150-9a9b-b58143e2213f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:43:42.789228 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a39dd729-7736-4268-97d5-1f08a7cbb8e1 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:42.789741 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a39dd729-7736-4268-97d5-1f08a7cbb8e1 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:42.790203 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a39dd729-7736-4268-97d5-1f08a7cbb8e1 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:42.790921 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a39dd729-7736-4268-97d5-1f08a7cbb8e1 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:42.791403 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a39dd729-7736-4268-97d5-1f08a7cbb8e1 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:42.791853 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a39dd729-7736-4268-97d5-1f08a7cbb8e1 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:42.923019 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a39dd729-7736-4268-97d5-1f08a7cbb8e1 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:43:42.930899 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a39dd729-7736-4268-97d5-1f08a7cbb8e1 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f" status: 200 len: 1670 microversion: 2.1 time: 0.152768 Sep 08 11:43:42.931486 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3492/7117] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:43:42 2022] GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f => generated 1670 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:43:42.953936 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d73cba57-faed-43ee-b209-52c51a2fc347 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:43:42.954440 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d73cba57-faed-43ee-b209-52c51a2fc347 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 654a0638-6345-4150-9a9b-b58143e2213f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:43:42.960539 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d73cba57-faed-43ee-b209-52c51a2fc347 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:42.961037 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d73cba57-faed-43ee-b209-52c51a2fc347 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:42.961487 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d73cba57-faed-43ee-b209-52c51a2fc347 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:42.962174 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d73cba57-faed-43ee-b209-52c51a2fc347 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:42.962630 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d73cba57-faed-43ee-b209-52c51a2fc347 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:42.963078 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d73cba57-faed-43ee-b209-52c51a2fc347 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:42.988842 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d73cba57-faed-43ee-b209-52c51a2fc347 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 654a0638-6345-4150-9a9b-b58143e2213f] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:43:43.065107 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d73cba57-faed-43ee-b209-52c51a2fc347 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "DELETE /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f" status: 204 len: 0 microversion: 2.1 time: 0.114972 Sep 08 11:43:43.065852 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3626/7118] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:43:42 2022] DELETE /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:43:43.074319 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b2b348ff-3d4f-44a5-8f34-3bc890830858 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:43:43.074958 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b2b348ff-3d4f-44a5-8f34-3bc890830858 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 654a0638-6345-4150-9a9b-b58143e2213f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:43:43.081376 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b2b348ff-3d4f-44a5-8f34-3bc890830858 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:43.081887 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b2b348ff-3d4f-44a5-8f34-3bc890830858 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:43.082344 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b2b348ff-3d4f-44a5-8f34-3bc890830858 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:43.083082 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b2b348ff-3d4f-44a5-8f34-3bc890830858 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:43.083555 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b2b348ff-3d4f-44a5-8f34-3bc890830858 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:43.084001 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b2b348ff-3d4f-44a5-8f34-3bc890830858 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:43.227458 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b2b348ff-3d4f-44a5-8f34-3bc890830858 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:43:43.237265 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b2b348ff-3d4f-44a5-8f34-3bc890830858 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f" status: 200 len: 1676 microversion: 2.1 time: 0.166736 Sep 08 11:43:43.238007 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3493/7119] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:43:43 2022] GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f => generated 1676 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:43:43.881579 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-802bd556-4da7-452b-8ec2-ab9e0a8f28c7 req-02317554-14d9-4756-a411-529a39074d1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "654a0638-6345-4150-9a9b-b58143e2213f", "name": "network-vif-plugged", "status": "completed", "tag": "7f3e106a-7992-4c1a-aab4-364d46cd930e"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:43:43.891313 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-802bd556-4da7-452b-8ec2-ab9e0a8f28c7 req-02317554-14d9-4756-a411-529a39074d1d service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:43.892296 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-802bd556-4da7-452b-8ec2-ab9e0a8f28c7 req-02317554-14d9-4756-a411-529a39074d1d service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:43.893082 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-802bd556-4da7-452b-8ec2-ab9e0a8f28c7 req-02317554-14d9-4756-a411-529a39074d1d service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:43.907913 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-802bd556-4da7-452b-8ec2-ab9e0a8f28c7 req-02317554-14d9-4756-a411-529a39074d1d service nova] Creating event network-vif-plugged:7f3e106a-7992-4c1a-aab4-364d46cd930e for instance 654a0638-6345-4150-9a9b-b58143e2213f on n-h1-850501-12 Sep 08 11:43:43.912999 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-802bd556-4da7-452b-8ec2-ab9e0a8f28c7 req-02317554-14d9-4756-a411-529a39074d1d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036142 Sep 08 11:43:43.913906 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3627/7120] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:43:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:43:44.261597 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a4bcf306-0439-4835-888b-d0788032cbe4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:43:44.262249 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a4bcf306-0439-4835-888b-d0788032cbe4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 654a0638-6345-4150-9a9b-b58143e2213f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:43:44.271612 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a4bcf306-0439-4835-888b-d0788032cbe4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:44.272135 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a4bcf306-0439-4835-888b-d0788032cbe4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:44.272601 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a4bcf306-0439-4835-888b-d0788032cbe4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:44.273374 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a4bcf306-0439-4835-888b-d0788032cbe4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:44.273858 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a4bcf306-0439-4835-888b-d0788032cbe4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:44.274310 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a4bcf306-0439-4835-888b-d0788032cbe4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:44.422146 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a4bcf306-0439-4835-888b-d0788032cbe4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:43:44.430300 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a4bcf306-0439-4835-888b-d0788032cbe4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f" status: 200 len: 1676 microversion: 2.1 time: 0.172671 Sep 08 11:43:44.430885 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3494/7121] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:43:44 2022] GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f => generated 1676 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:43:45.311469 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-77c7f2ba-9ab3-4aba-9054-59fde07c274b req-778b0819-d7f9-4587-a52a-b68d09ebeec3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "654a0638-6345-4150-9a9b-b58143e2213f", "name": "network-vif-deleted", "tag": "7f3e106a-7992-4c1a-aab4-364d46cd930e"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:43:45.324028 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-77c7f2ba-9ab3-4aba-9054-59fde07c274b req-778b0819-d7f9-4587-a52a-b68d09ebeec3 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:45.325125 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-77c7f2ba-9ab3-4aba-9054-59fde07c274b req-778b0819-d7f9-4587-a52a-b68d09ebeec3 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:45.325669 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-77c7f2ba-9ab3-4aba-9054-59fde07c274b req-778b0819-d7f9-4587-a52a-b68d09ebeec3 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:45.339488 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-77c7f2ba-9ab3-4aba-9054-59fde07c274b req-778b0819-d7f9-4587-a52a-b68d09ebeec3 service nova] Creating event network-vif-deleted:7f3e106a-7992-4c1a-aab4-364d46cd930e for instance 654a0638-6345-4150-9a9b-b58143e2213f on n-h1-850501-12 Sep 08 11:43:45.345136 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-77c7f2ba-9ab3-4aba-9054-59fde07c274b req-778b0819-d7f9-4587-a52a-b68d09ebeec3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038888 Sep 08 11:43:45.345743 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3628/7122] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:43:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:43:45.463899 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2ac4f939-393f-4ca5-b0ec-60896ba39fb6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:43:45.464759 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2ac4f939-393f-4ca5-b0ec-60896ba39fb6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 654a0638-6345-4150-9a9b-b58143e2213f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:43:45.466845 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:43:45.480457 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2ac4f939-393f-4ca5-b0ec-60896ba39fb6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:45.480977 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2ac4f939-393f-4ca5-b0ec-60896ba39fb6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:45.481465 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2ac4f939-393f-4ca5-b0ec-60896ba39fb6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:45.482201 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2ac4f939-393f-4ca5-b0ec-60896ba39fb6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:45.482696 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2ac4f939-393f-4ca5-b0ec-60896ba39fb6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:45.483143 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2ac4f939-393f-4ca5-b0ec-60896ba39fb6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:45.523651 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2ac4f939-393f-4ca5-b0ec-60896ba39fb6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:45.524428 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2ac4f939-393f-4ca5-b0ec-60896ba39fb6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:45.525071 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2ac4f939-393f-4ca5-b0ec-60896ba39fb6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:45.525732 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-2ac4f939-393f-4ca5-b0ec-60896ba39fb6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lazy-loading 'fault' on Instance uuid 654a0638-6345-4150-9a9b-b58143e2213f {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:43:45.579565 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2ac4f939-393f-4ca5-b0ec-60896ba39fb6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:43:45.587295 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2ac4f939-393f-4ca5-b0ec-60896ba39fb6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f" status: 200 len: 1328 microversion: 2.1 time: 0.136348 Sep 08 11:43:45.588068 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3495/7123] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:43:45 2022] GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f => generated 1328 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:43:46.613082 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c3a8ed60-79d3-4211-8506-d5499d4bd34c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:43:46.613962 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c3a8ed60-79d3-4211-8506-d5499d4bd34c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 654a0638-6345-4150-9a9b-b58143e2213f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:43:46.620120 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c3a8ed60-79d3-4211-8506-d5499d4bd34c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:46.620604 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c3a8ed60-79d3-4211-8506-d5499d4bd34c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:46.621064 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c3a8ed60-79d3-4211-8506-d5499d4bd34c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:46.621761 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c3a8ed60-79d3-4211-8506-d5499d4bd34c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:46.622226 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c3a8ed60-79d3-4211-8506-d5499d4bd34c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:46.622653 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c3a8ed60-79d3-4211-8506-d5499d4bd34c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:46.636908 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-c3a8ed60-79d3-4211-8506-d5499d4bd34c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] HTTP exception thrown: Instance 654a0638-6345-4150-9a9b-b58143e2213f could not be found. Sep 08 11:43:46.638567 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c3a8ed60-79d3-4211-8506-d5499d4bd34c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Request method failure captured: Sep 08 11:43:46.638567 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f HTTP/1.1 Sep 08 11:43:46.638567 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:43:46.638567 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:43:46.638567 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:43:46.638567 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 11:43:46.638567 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:43:46.638567 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:43:46.638567 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:43:46.638567 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:43:46.638567 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGdSDvOwoS57OkYb_-Yl1XUx78kih9MULmYIyzFLt-u36W2wjj2KtWXAZ7aX14KpVLwWCBvBeF4bTqW87i3VTvG-qHq5mt1bIpxmJHowTqwKpzB7zzorSV7BPwI-U0G6PWcbOtFoIJUt5uu58duhf3xUQD9p0cNz13ICJbtKWoYuCsmY Sep 08 11:43:46.638567 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:43:46.638567 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:43:46.638567 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:43:46.638567 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:43:46.638567 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:43:46.638567 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:43:46.638567 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 5e7adfbb1417415b9eafeeb23b7a7c18 Sep 08 11:43:46.638567 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServerActionsTestJSON-143982609 Sep 08 11:43:46.638567 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:43:46.638567 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:43:46.638567 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5e7adfbb1417415b9eafeeb23b7a7c18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5e7adfbb1417415b9eafeeb23b7a7c18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5e7adfbb1417415b9eafeeb23b7a7c18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5e7adfbb1417415b9eafeeb23b7a7c18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:43:46.638567 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServerActionsTestJSON-143982609 Sep 08 11:43:46.638567 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 5e7adfbb1417415b9eafeeb23b7a7c18 Sep 08 11:43:46.638567 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServerActionsTestJSON-143982609 Sep 08 11:43:46.638567 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServerActionsTestJSON-143982609-project Sep 08 11:43:46.638567 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:43:46.638567 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:43:46.638567 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: f38a21e862664942bf35c93870df1c36 Sep 08 11:43:46.638567 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServerActionsTestJSON-143982609-project Sep 08 11:43:46.638567 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 11:43:46.638567 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 654a0638-6345-4150-9a9b-b58143e2213f could not be found. Sep 08 11:43:46.638567 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '654a0638-6345-4150-9a9b-b58143e2213f'} Sep 08 11:43:46.638567 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:43:46.638567 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:43:46.638567 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:43:46.638567 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:43:46.638567 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:43:46.638567 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:43:46.638567 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:43:46.638567 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:43:46.638567 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:43:46.638567 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:43:46.638567 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 654a0638-6345-4150-9a9b-b58143e2213f could not be found. Sep 08 11:43:46.638567 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:43:46.638567 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:43:46.638567 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:43:46.638567 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:43:46.638567 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:43:46.638567 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:43:46.638567 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:43:46.638567 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:43:46.638567 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:43:46.638567 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:43:46.638567 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:43:46.638567 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:43:46.638567 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:43:46.638567 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:43:46.638567 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:43:46.638567 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:43:46.638567 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 654a0638-6345-4150-9a9b-b58143e2213f could not be found. Sep 08 11:43:46.638567 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:43:46.638567 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:43:46.638567 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:43:46.643567 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:43:46.643567 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:43:46.643567 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:43:46.643567 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:43:46.643567 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:43:46.643567 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 654a0638-6345-4150-9a9b-b58143e2213f could not be found. Sep 08 11:43:46.643567 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:43:46.643567 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c3a8ed60-79d3-4211-8506-d5499d4bd34c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Returning 404 to user: Instance 654a0638-6345-4150-9a9b-b58143e2213f could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:43:46.643567 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c3a8ed60-79d3-4211-8506-d5499d4bd34c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f" status: 404 len: 111 microversion: 2.1 time: 0.032583 Sep 08 11:43:46.643567 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3629/7124] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:43:46 2022] GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 11:43:46.657480 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1fe341c3-b575-41f4-bf63-de1298f0e412 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:43:46.658206 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1fe341c3-b575-41f4-bf63-de1298f0e412 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 654a0638-6345-4150-9a9b-b58143e2213f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:43:46.664973 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1fe341c3-b575-41f4-bf63-de1298f0e412 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:46.665511 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1fe341c3-b575-41f4-bf63-de1298f0e412 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:46.665962 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1fe341c3-b575-41f4-bf63-de1298f0e412 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:46.666676 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1fe341c3-b575-41f4-bf63-de1298f0e412 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:46.667150 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1fe341c3-b575-41f4-bf63-de1298f0e412 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:46.667593 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1fe341c3-b575-41f4-bf63-de1298f0e412 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:46.681804 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-1fe341c3-b575-41f4-bf63-de1298f0e412 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] HTTP exception thrown: Instance 654a0638-6345-4150-9a9b-b58143e2213f could not be found. Sep 08 11:43:46.683482 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1fe341c3-b575-41f4-bf63-de1298f0e412 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Request method failure captured: Sep 08 11:43:46.683482 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f HTTP/1.1 Sep 08 11:43:46.683482 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 11:43:46.683482 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 11:43:46.683482 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 11:43:46.683482 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 11:43:46.683482 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 11:43:46.683482 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 11:43:46.683482 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 11:43:46.683482 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 11:43:46.683482 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGdSDvOwoS57OkYb_-Yl1XUx78kih9MULmYIyzFLt-u36W2wjj2KtWXAZ7aX14KpVLwWCBvBeF4bTqW87i3VTvG-qHq5mt1bIpxmJHowTqwKpzB7zzorSV7BPwI-U0G6PWcbOtFoIJUt5uu58duhf3xUQD9p0cNz13ICJbtKWoYuCsmY Sep 08 11:43:46.683482 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 11:43:46.683482 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 11:43:46.683482 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 11:43:46.683482 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 11:43:46.683482 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 11:43:46.683482 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 11:43:46.683482 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 5e7adfbb1417415b9eafeeb23b7a7c18 Sep 08 11:43:46.683482 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServerActionsTestJSON-143982609 Sep 08 11:43:46.683482 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 11:43:46.683482 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 11:43:46.683482 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5e7adfbb1417415b9eafeeb23b7a7c18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5e7adfbb1417415b9eafeeb23b7a7c18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5e7adfbb1417415b9eafeeb23b7a7c18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5e7adfbb1417415b9eafeeb23b7a7c18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:43:46.683482 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServerActionsTestJSON-143982609 Sep 08 11:43:46.683482 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 5e7adfbb1417415b9eafeeb23b7a7c18 Sep 08 11:43:46.683482 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServerActionsTestJSON-143982609 Sep 08 11:43:46.683482 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServerActionsTestJSON-143982609-project Sep 08 11:43:46.683482 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 11:43:46.683482 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 11:43:46.683482 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: f38a21e862664942bf35c93870df1c36 Sep 08 11:43:46.683482 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServerActionsTestJSON-143982609-project Sep 08 11:43:46.683482 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 11:43:46.683482 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 654a0638-6345-4150-9a9b-b58143e2213f could not be found. Sep 08 11:43:46.683482 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '654a0638-6345-4150-9a9b-b58143e2213f'} Sep 08 11:43:46.683482 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:43:46.683482 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:43:46.683482 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:43:46.683482 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:43:46.683482 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:43:46.683482 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:43:46.683482 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:43:46.683482 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:43:46.683482 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:43:46.683482 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:43:46.683482 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 654a0638-6345-4150-9a9b-b58143e2213f could not be found. Sep 08 11:43:46.683482 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:43:46.683482 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:43:46.683482 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:43:46.683482 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:43:46.683482 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:43:46.683482 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:43:46.683482 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:43:46.683482 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:43:46.683482 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:43:46.683482 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:43:46.683482 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:43:46.683482 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:43:46.683482 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:43:46.683482 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:43:46.683482 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:43:46.683482 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:43:46.683482 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 654a0638-6345-4150-9a9b-b58143e2213f could not be found. Sep 08 11:43:46.683482 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:43:46.683482 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:43:46.683482 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:43:46.688871 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:43:46.688871 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:43:46.688871 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:43:46.688871 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:43:46.688871 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:43:46.688871 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 654a0638-6345-4150-9a9b-b58143e2213f could not be found. Sep 08 11:43:46.688871 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:43:46.688871 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1fe341c3-b575-41f4-bf63-de1298f0e412 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Returning 404 to user: Instance 654a0638-6345-4150-9a9b-b58143e2213f could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:43:46.688871 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1fe341c3-b575-41f4-bf63-de1298f0e412 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f" status: 404 len: 111 microversion: 2.1 time: 0.031369 Sep 08 11:43:46.688871 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3496/7125] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:43:46 2022] GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:43:46.737264 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-532fc7dc-73ab-4142-84c3-75154c5314aa tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-699248966", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "99f4db14-10f1-4ebf-99cd-d7459087f008"}], "security_groups": [{"name": "tempest-securitygroup--1605450961"}], "key_name": "tempest-keypair-1229154192", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:43:46.844658 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-532fc7dc-73ab-4142-84c3-75154c5314aa tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] validate_networks() for [('99f4db14-10f1-4ebf-99cd-d7459087f008', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:43:47.269531 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-532fc7dc-73ab-4142-84c3-75154c5314aa tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:43:47.269961 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-532fc7dc-73ab-4142-84c3-75154c5314aa tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:43:47.270442 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-532fc7dc-73ab-4142-84c3-75154c5314aa tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:43:47.270854 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-532fc7dc-73ab-4142-84c3-75154c5314aa tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:43:47.271270 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-532fc7dc-73ab-4142-84c3-75154c5314aa tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:43:47.284708 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-532fc7dc-73ab-4142-84c3-75154c5314aa tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:47.285236 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-532fc7dc-73ab-4142-84c3-75154c5314aa tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:47.285678 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-532fc7dc-73ab-4142-84c3-75154c5314aa tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:47.286409 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-532fc7dc-73ab-4142-84c3-75154c5314aa tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:47.286867 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-532fc7dc-73ab-4142-84c3-75154c5314aa tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:47.287297 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-532fc7dc-73ab-4142-84c3-75154c5314aa tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:47.304275 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-532fc7dc-73ab-4142-84c3-75154c5314aa tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Getting quotas for project 5e7adfbb1417415b9eafeeb23b7a7c18. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:43:47.309493 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-532fc7dc-73ab-4142-84c3-75154c5314aa tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Getting quotas for user f38a21e862664942bf35c93870df1c36 and project 5e7adfbb1417415b9eafeeb23b7a7c18. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:43:47.322133 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-532fc7dc-73ab-4142-84c3-75154c5314aa tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:43:47.324452 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-532fc7dc-73ab-4142-84c3-75154c5314aa tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: a2e7fa5c-3b4e-4842-9228-dba10ed065d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:43:47.371067 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-532fc7dc-73ab-4142-84c3-75154c5314aa tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.638254 Sep 08 11:43:47.371711 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3630/7126] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 11:43:46 2022] POST /compute/v2.1/servers => generated 406 bytes in 640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:43:47.383966 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-64cc5c39-7637-4fcb-a6c2-fe9d8d0e7764 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:43:47.384599 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-64cc5c39-7637-4fcb-a6c2-fe9d8d0e7764 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: a2e7fa5c-3b4e-4842-9228-dba10ed065d5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:43:47.444647 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-64cc5c39-7637-4fcb-a6c2-fe9d8d0e7764 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:43:47.451863 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-64cc5c39-7637-4fcb-a6c2-fe9d8d0e7764 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5" status: 200 len: 1238 microversion: 2.1 time: 0.071886 Sep 08 11:43:47.452465 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3497/7127] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:43:47 2022] GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5 => generated 1238 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:43:48.476030 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e83f8686-589b-4fe5-bdb6-c62d35a9272e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:43:48.476642 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e83f8686-589b-4fe5-bdb6-c62d35a9272e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: a2e7fa5c-3b4e-4842-9228-dba10ed065d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:43:48.483675 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e83f8686-589b-4fe5-bdb6-c62d35a9272e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:48.484880 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e83f8686-589b-4fe5-bdb6-c62d35a9272e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:48.485412 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e83f8686-589b-4fe5-bdb6-c62d35a9272e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:48.486408 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e83f8686-589b-4fe5-bdb6-c62d35a9272e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:48.486871 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e83f8686-589b-4fe5-bdb6-c62d35a9272e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:48.487304 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e83f8686-589b-4fe5-bdb6-c62d35a9272e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:48.557354 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e83f8686-589b-4fe5-bdb6-c62d35a9272e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:43:48.565643 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e83f8686-589b-4fe5-bdb6-c62d35a9272e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5" status: 200 len: 1298 microversion: 2.1 time: 0.094321 Sep 08 11:43:48.566218 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3631/7128] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:43:48 2022] GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5 => generated 1298 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:43:49.589563 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-708a5d59-7758-499c-b6c1-12810b5d495d tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:43:49.590216 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-708a5d59-7758-499c-b6c1-12810b5d495d tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: a2e7fa5c-3b4e-4842-9228-dba10ed065d5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:43:49.598597 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-708a5d59-7758-499c-b6c1-12810b5d495d tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:49.599119 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-708a5d59-7758-499c-b6c1-12810b5d495d tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:49.599585 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-708a5d59-7758-499c-b6c1-12810b5d495d tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:49.600322 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-708a5d59-7758-499c-b6c1-12810b5d495d tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:49.600804 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-708a5d59-7758-499c-b6c1-12810b5d495d tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:49.601291 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-708a5d59-7758-499c-b6c1-12810b5d495d tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:49.851894 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-708a5d59-7758-499c-b6c1-12810b5d495d tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:43:49.860659 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-708a5d59-7758-499c-b6c1-12810b5d495d tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5" status: 200 len: 1364 microversion: 2.1 time: 0.274851 Sep 08 11:43:49.861284 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3498/7129] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:43:49 2022] GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5 => generated 1364 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:43:50.003636 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-86f980ce-c658-4c9d-bfd9-d45a08284157 req-8f549635-4e6e-4479-924c-b7427f69c5b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2e7fa5c-3b4e-4842-9228-dba10ed065d5", "tag": "6f56977b-8a11-4779-86b1-a9b9da907d2e"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:43:50.017666 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-86f980ce-c658-4c9d-bfd9-d45a08284157 req-8f549635-4e6e-4479-924c-b7427f69c5b2 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:50.018824 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-86f980ce-c658-4c9d-bfd9-d45a08284157 req-8f549635-4e6e-4479-924c-b7427f69c5b2 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:50.019433 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-86f980ce-c658-4c9d-bfd9-d45a08284157 req-8f549635-4e6e-4479-924c-b7427f69c5b2 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:50.033567 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-86f980ce-c658-4c9d-bfd9-d45a08284157 req-8f549635-4e6e-4479-924c-b7427f69c5b2 service nova] Creating event network-changed:6f56977b-8a11-4779-86b1-a9b9da907d2e for instance a2e7fa5c-3b4e-4842-9228-dba10ed065d5 on n-h2-850501-12 Sep 08 11:43:50.038664 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-86f980ce-c658-4c9d-bfd9-d45a08284157 req-8f549635-4e6e-4479-924c-b7427f69c5b2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038896 Sep 08 11:43:50.039267 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3632/7130] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:43:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:43:50.885104 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-08de8198-65ac-4cc7-b442-2ad2f5dbbaa1 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:43:50.885733 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-08de8198-65ac-4cc7-b442-2ad2f5dbbaa1 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: a2e7fa5c-3b4e-4842-9228-dba10ed065d5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:43:50.893405 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08de8198-65ac-4cc7-b442-2ad2f5dbbaa1 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:50.893918 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08de8198-65ac-4cc7-b442-2ad2f5dbbaa1 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:50.894393 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08de8198-65ac-4cc7-b442-2ad2f5dbbaa1 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:50.895111 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08de8198-65ac-4cc7-b442-2ad2f5dbbaa1 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:50.895582 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08de8198-65ac-4cc7-b442-2ad2f5dbbaa1 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:50.896020 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08de8198-65ac-4cc7-b442-2ad2f5dbbaa1 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:51.030272 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-08de8198-65ac-4cc7-b442-2ad2f5dbbaa1 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:43:51.038944 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-08de8198-65ac-4cc7-b442-2ad2f5dbbaa1 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5" status: 200 len: 1364 microversion: 2.1 time: 0.158120 Sep 08 11:43:51.039531 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3499/7131] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:43:50 2022] GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:43:52.064147 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c0ae7e6c-2712-4dbf-ab15-aec2fcaef91c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:43:52.064779 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c0ae7e6c-2712-4dbf-ab15-aec2fcaef91c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: a2e7fa5c-3b4e-4842-9228-dba10ed065d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:43:52.071796 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c0ae7e6c-2712-4dbf-ab15-aec2fcaef91c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:52.072283 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c0ae7e6c-2712-4dbf-ab15-aec2fcaef91c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:52.072720 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c0ae7e6c-2712-4dbf-ab15-aec2fcaef91c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:52.073526 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c0ae7e6c-2712-4dbf-ab15-aec2fcaef91c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:52.073983 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c0ae7e6c-2712-4dbf-ab15-aec2fcaef91c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:52.074406 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c0ae7e6c-2712-4dbf-ab15-aec2fcaef91c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:52.208207 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c0ae7e6c-2712-4dbf-ab15-aec2fcaef91c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:43:52.216137 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c0ae7e6c-2712-4dbf-ab15-aec2fcaef91c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5" status: 200 len: 1364 microversion: 2.1 time: 0.156853 Sep 08 11:43:52.216719 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3633/7132] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:43:52 2022] GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:43:53.239970 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7967d96a-e24b-47a5-a965-8f8edf3883c0 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:43:53.240603 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7967d96a-e24b-47a5-a965-8f8edf3883c0 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: a2e7fa5c-3b4e-4842-9228-dba10ed065d5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:43:53.247628 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7967d96a-e24b-47a5-a965-8f8edf3883c0 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:53.248134 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7967d96a-e24b-47a5-a965-8f8edf3883c0 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:53.248590 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7967d96a-e24b-47a5-a965-8f8edf3883c0 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:53.249333 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7967d96a-e24b-47a5-a965-8f8edf3883c0 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:53.249826 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7967d96a-e24b-47a5-a965-8f8edf3883c0 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:53.250259 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7967d96a-e24b-47a5-a965-8f8edf3883c0 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:53.388315 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7967d96a-e24b-47a5-a965-8f8edf3883c0 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:43:53.396893 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7967d96a-e24b-47a5-a965-8f8edf3883c0 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5" status: 200 len: 1364 microversion: 2.1 time: 0.160983 Sep 08 11:43:53.397588 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3500/7133] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:43:53 2022] GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:43:54.420991 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-66ac89cb-8d92-4b5f-bd9a-5d1de59fc689 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:43:54.422243 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-66ac89cb-8d92-4b5f-bd9a-5d1de59fc689 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: a2e7fa5c-3b4e-4842-9228-dba10ed065d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:43:54.428703 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-66ac89cb-8d92-4b5f-bd9a-5d1de59fc689 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:54.429223 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-66ac89cb-8d92-4b5f-bd9a-5d1de59fc689 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:54.429663 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-66ac89cb-8d92-4b5f-bd9a-5d1de59fc689 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:54.430351 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-66ac89cb-8d92-4b5f-bd9a-5d1de59fc689 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:54.430807 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-66ac89cb-8d92-4b5f-bd9a-5d1de59fc689 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:54.431232 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-66ac89cb-8d92-4b5f-bd9a-5d1de59fc689 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:54.564459 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-66ac89cb-8d92-4b5f-bd9a-5d1de59fc689 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:43:54.572146 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-66ac89cb-8d92-4b5f-bd9a-5d1de59fc689 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5" status: 200 len: 1364 microversion: 2.1 time: 0.155462 Sep 08 11:43:54.572725 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3634/7134] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:43:54 2022] GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:43:55.501802 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-280d6a5c-9f7c-4db4-9b2b-d2dce5e43e99 req-0d236afb-f2c2-46a6-a97a-6c9515c52e1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2e7fa5c-3b4e-4842-9228-dba10ed065d5", "name": "network-vif-plugged", "status": "completed", "tag": "6f56977b-8a11-4779-86b1-a9b9da907d2e"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:43:55.513465 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-280d6a5c-9f7c-4db4-9b2b-d2dce5e43e99 req-0d236afb-f2c2-46a6-a97a-6c9515c52e1a service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:55.514029 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-280d6a5c-9f7c-4db4-9b2b-d2dce5e43e99 req-0d236afb-f2c2-46a6-a97a-6c9515c52e1a service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:55.514667 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-280d6a5c-9f7c-4db4-9b2b-d2dce5e43e99 req-0d236afb-f2c2-46a6-a97a-6c9515c52e1a service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:55.528408 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-280d6a5c-9f7c-4db4-9b2b-d2dce5e43e99 req-0d236afb-f2c2-46a6-a97a-6c9515c52e1a service nova] Creating event network-vif-plugged:6f56977b-8a11-4779-86b1-a9b9da907d2e for instance a2e7fa5c-3b4e-4842-9228-dba10ed065d5 on n-h2-850501-12 Sep 08 11:43:55.534103 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-280d6a5c-9f7c-4db4-9b2b-d2dce5e43e99 req-0d236afb-f2c2-46a6-a97a-6c9515c52e1a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036930 Sep 08 11:43:55.534707 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3501/7135] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:43:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:43:55.596358 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fc8e6893-3efc-4e0a-ba07-e8c5e83723b1 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:43:55.597009 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fc8e6893-3efc-4e0a-ba07-e8c5e83723b1 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: a2e7fa5c-3b4e-4842-9228-dba10ed065d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:43:55.604153 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fc8e6893-3efc-4e0a-ba07-e8c5e83723b1 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:55.604647 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fc8e6893-3efc-4e0a-ba07-e8c5e83723b1 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:55.605117 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fc8e6893-3efc-4e0a-ba07-e8c5e83723b1 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:55.606354 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fc8e6893-3efc-4e0a-ba07-e8c5e83723b1 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:55.607122 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fc8e6893-3efc-4e0a-ba07-e8c5e83723b1 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:55.607552 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fc8e6893-3efc-4e0a-ba07-e8c5e83723b1 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:55.749093 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-fc8e6893-3efc-4e0a-ba07-e8c5e83723b1 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:43:55.758078 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fc8e6893-3efc-4e0a-ba07-e8c5e83723b1 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5" status: 200 len: 1364 microversion: 2.1 time: 0.165857 Sep 08 11:43:55.758669 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3635/7136] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:43:55 2022] GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5 => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:43:56.783122 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-50184125-8ccc-46d3-b974-4e759f36e859 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:43:56.783851 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-50184125-8ccc-46d3-b974-4e759f36e859 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: a2e7fa5c-3b4e-4842-9228-dba10ed065d5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:43:56.791134 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-50184125-8ccc-46d3-b974-4e759f36e859 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:56.791646 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-50184125-8ccc-46d3-b974-4e759f36e859 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:56.792104 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-50184125-8ccc-46d3-b974-4e759f36e859 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:56.792825 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-50184125-8ccc-46d3-b974-4e759f36e859 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:56.793332 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-50184125-8ccc-46d3-b974-4e759f36e859 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:56.793781 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-50184125-8ccc-46d3-b974-4e759f36e859 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:56.933924 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-50184125-8ccc-46d3-b974-4e759f36e859 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:43:56.941978 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-50184125-8ccc-46d3-b974-4e759f36e859 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5" status: 200 len: 1364 microversion: 2.1 time: 0.163328 Sep 08 11:43:56.942555 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3502/7137] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:43:56 2022] GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:43:57.966258 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1ccecac2-0d5e-41e9-98ad-f9411169d651 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:43:57.966872 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1ccecac2-0d5e-41e9-98ad-f9411169d651 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: a2e7fa5c-3b4e-4842-9228-dba10ed065d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:43:57.969652 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:43:57.970524 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=6 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:43:57.976530 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1ccecac2-0d5e-41e9-98ad-f9411169d651 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:57.977040 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1ccecac2-0d5e-41e9-98ad-f9411169d651 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:57.977486 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1ccecac2-0d5e-41e9-98ad-f9411169d651 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:57.978184 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1ccecac2-0d5e-41e9-98ad-f9411169d651 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:57.978642 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1ccecac2-0d5e-41e9-98ad-f9411169d651 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:57.979072 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1ccecac2-0d5e-41e9-98ad-f9411169d651 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:58.107929 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1ccecac2-0d5e-41e9-98ad-f9411169d651 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:43:58.117166 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1ccecac2-0d5e-41e9-98ad-f9411169d651 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5" status: 200 len: 1551 microversion: 2.1 time: 0.154744 Sep 08 11:43:58.117739 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3636/7138] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:43:57 2022] GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5 => generated 1551 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:43:58.141706 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4fba4929-2335-4f63-a9bd-bb8b0b80af75 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:43:58.142253 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4fba4929-2335-4f63-a9bd-bb8b0b80af75 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: a2e7fa5c-3b4e-4842-9228-dba10ed065d5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:43:58.144465 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:43:58.150981 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4fba4929-2335-4f63-a9bd-bb8b0b80af75 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:58.151500 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4fba4929-2335-4f63-a9bd-bb8b0b80af75 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:58.151952 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4fba4929-2335-4f63-a9bd-bb8b0b80af75 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:58.152680 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4fba4929-2335-4f63-a9bd-bb8b0b80af75 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:58.153186 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4fba4929-2335-4f63-a9bd-bb8b0b80af75 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:58.153627 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4fba4929-2335-4f63-a9bd-bb8b0b80af75 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:58.240645 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4fba4929-2335-4f63-a9bd-bb8b0b80af75 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.103395 Sep 08 11:43:58.241291 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3503/7139] 10.222.0.27 () {58 vars in 1275 bytes} [Thu Sep 8 11:43:58 2022] GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:43:59.160710 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-deb1f2cc-31c0-4873-9011-e1a47ed8e8ad req-5cab3765-49ce-49d1-bffb-11375182d057 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2e7fa5c-3b4e-4842-9228-dba10ed065d5", "tag": "6f56977b-8a11-4779-86b1-a9b9da907d2e"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:43:59.171092 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-deb1f2cc-31c0-4873-9011-e1a47ed8e8ad req-5cab3765-49ce-49d1-bffb-11375182d057 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:59.172258 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-deb1f2cc-31c0-4873-9011-e1a47ed8e8ad req-5cab3765-49ce-49d1-bffb-11375182d057 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:59.172689 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-deb1f2cc-31c0-4873-9011-e1a47ed8e8ad req-5cab3765-49ce-49d1-bffb-11375182d057 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:59.184373 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-deb1f2cc-31c0-4873-9011-e1a47ed8e8ad req-5cab3765-49ce-49d1-bffb-11375182d057 service nova] Creating event network-changed:6f56977b-8a11-4779-86b1-a9b9da907d2e for instance a2e7fa5c-3b4e-4842-9228-dba10ed065d5 on n-h2-850501-12 Sep 08 11:43:59.191235 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-deb1f2cc-31c0-4873-9011-e1a47ed8e8ad req-5cab3765-49ce-49d1-bffb-11375182d057 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033731 Sep 08 11:43:59.191842 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3637/7140] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:43:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:44:41.345549 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=29 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:44:41.346387 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=82 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:44:41.351338 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-45542e3b-54e1-4c10-9c45-a7d783877954 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:44:41.351956 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-45542e3b-54e1-4c10-9c45-a7d783877954 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: a2e7fa5c-3b4e-4842-9228-dba10ed065d5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:44:41.359090 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-45542e3b-54e1-4c10-9c45-a7d783877954 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:44:41.359590 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-45542e3b-54e1-4c10-9c45-a7d783877954 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:44:41.360048 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-45542e3b-54e1-4c10-9c45-a7d783877954 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:44:41.360755 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-45542e3b-54e1-4c10-9c45-a7d783877954 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:44:41.361263 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-45542e3b-54e1-4c10-9c45-a7d783877954 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:44:41.361718 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-45542e3b-54e1-4c10-9c45-a7d783877954 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:44:41.496270 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-45542e3b-54e1-4c10-9c45-a7d783877954 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:44:41.504047 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-45542e3b-54e1-4c10-9c45-a7d783877954 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5" status: 200 len: 1670 microversion: 2.1 time: 0.160556 Sep 08 11:44:41.504616 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3504/7141] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:44:41 2022] GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5 => generated 1670 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:44:41.527668 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-79d57132-930e-4245-919b-638401fca2dd tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a2de8137-8cf6-4d70-a7ee-6f99e6944627"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:44:41.530150 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-79d57132-930e-4245-919b-638401fca2dd tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: a2e7fa5c-3b4e-4842-9228-dba10ed065d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:44:41.532277 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:44:41.533145 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:44:41.540774 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-79d57132-930e-4245-919b-638401fca2dd tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:44:41.541292 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-79d57132-930e-4245-919b-638401fca2dd tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:44:41.541777 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-79d57132-930e-4245-919b-638401fca2dd tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:44:41.542418 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-79d57132-930e-4245-919b-638401fca2dd tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:44:41.542871 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-79d57132-930e-4245-919b-638401fca2dd tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:44:41.543293 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-79d57132-930e-4245-919b-638401fca2dd tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:44:41.795727 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-79d57132-930e-4245-919b-638401fca2dd tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "POST /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272417 Sep 08 11:44:41.796266 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3638/7142] 10.222.0.27 () {60 vars in 1323 bytes} [Thu Sep 8 11:44:41 2022] POST /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:44:52.691012 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cbfa94a7-494f-466a-958e-e30a93b52f1c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:44:52.693421 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cbfa94a7-494f-466a-958e-e30a93b52f1c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: a2e7fa5c-3b4e-4842-9228-dba10ed065d5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:44:52.696508 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:44:52.697456 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:44:52.702763 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cbfa94a7-494f-466a-958e-e30a93b52f1c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:44:52.703278 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cbfa94a7-494f-466a-958e-e30a93b52f1c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:44:52.703737 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cbfa94a7-494f-466a-958e-e30a93b52f1c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:44:52.704463 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cbfa94a7-494f-466a-958e-e30a93b52f1c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:44:52.704936 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cbfa94a7-494f-466a-958e-e30a93b52f1c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:44:52.705409 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cbfa94a7-494f-466a-958e-e30a93b52f1c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:44:52.734916 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cbfa94a7-494f-466a-958e-e30a93b52f1c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:44:52.740607 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cbfa94a7-494f-466a-958e-e30a93b52f1c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: a2e7fa5c-3b4e-4842-9228-dba10ed065d5] Old instance type m1.heat2, new instance type m1.heat {{(pid=128862) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 08 11:44:52.748485 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-cbfa94a7-494f-466a-958e-e30a93b52f1c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:44:52.748937 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-cbfa94a7-494f-466a-958e-e30a93b52f1c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:44:52.749454 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-cbfa94a7-494f-466a-958e-e30a93b52f1c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:44:52.749881 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-cbfa94a7-494f-466a-958e-e30a93b52f1c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:44:52.750375 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-cbfa94a7-494f-466a-958e-e30a93b52f1c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:44:52.818998 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cbfa94a7-494f-466a-958e-e30a93b52f1c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "POST /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5/action" status: 202 len: 0 microversion: 2.1 time: 0.132228 Sep 08 11:44:52.819797 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3505/7143] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 11:44:52 2022] POST /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:44:52.826912 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:44:52.828390 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:44:52.833563 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bb3340de-d4ee-4a20-ac78-5dcfd161b8a2 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:44:52.833704 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bb3340de-d4ee-4a20-ac78-5dcfd161b8a2 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: a2e7fa5c-3b4e-4842-9228-dba10ed065d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:44:52.841970 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bb3340de-d4ee-4a20-ac78-5dcfd161b8a2 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:44:52.842958 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bb3340de-d4ee-4a20-ac78-5dcfd161b8a2 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:44:52.843492 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bb3340de-d4ee-4a20-ac78-5dcfd161b8a2 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:44:52.844200 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bb3340de-d4ee-4a20-ac78-5dcfd161b8a2 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:44:52.844695 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bb3340de-d4ee-4a20-ac78-5dcfd161b8a2 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:44:52.845185 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bb3340de-d4ee-4a20-ac78-5dcfd161b8a2 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:44:52.998285 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-bb3340de-d4ee-4a20-ac78-5dcfd161b8a2 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:44:53.006834 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bb3340de-d4ee-4a20-ac78-5dcfd161b8a2 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5" status: 200 len: 1725 microversion: 2.1 time: 0.181843 Sep 08 11:44:53.019297 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3639/7144] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:44:52 2022] GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5 => generated 1725 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:44:54.031950 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b7a1475f-d0b9-4b17-83aa-71de817c41b6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:44:54.032581 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b7a1475f-d0b9-4b17-83aa-71de817c41b6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: a2e7fa5c-3b4e-4842-9228-dba10ed065d5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:44:54.042602 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b7a1475f-d0b9-4b17-83aa-71de817c41b6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:44:54.043115 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b7a1475f-d0b9-4b17-83aa-71de817c41b6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:44:54.043643 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b7a1475f-d0b9-4b17-83aa-71de817c41b6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:44:54.044353 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b7a1475f-d0b9-4b17-83aa-71de817c41b6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:44:54.044824 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b7a1475f-d0b9-4b17-83aa-71de817c41b6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:44:54.045287 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b7a1475f-d0b9-4b17-83aa-71de817c41b6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:44:54.252508 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b7a1475f-d0b9-4b17-83aa-71de817c41b6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:44:54.261738 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b7a1475f-d0b9-4b17-83aa-71de817c41b6 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5" status: 200 len: 1725 microversion: 2.1 time: 0.234508 Sep 08 11:44:54.262344 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3506/7145] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:44:54 2022] GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5 => generated 1725 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:44:55.285942 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-704cf0f3-ea6c-40ea-8b6a-3911c8cbfc95 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:44:55.286560 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-704cf0f3-ea6c-40ea-8b6a-3911c8cbfc95 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: a2e7fa5c-3b4e-4842-9228-dba10ed065d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:44:55.293579 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-704cf0f3-ea6c-40ea-8b6a-3911c8cbfc95 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:44:55.294073 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-704cf0f3-ea6c-40ea-8b6a-3911c8cbfc95 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:44:55.294515 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-704cf0f3-ea6c-40ea-8b6a-3911c8cbfc95 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:44:55.295210 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-704cf0f3-ea6c-40ea-8b6a-3911c8cbfc95 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:44:55.295672 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-704cf0f3-ea6c-40ea-8b6a-3911c8cbfc95 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:44:55.296101 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-704cf0f3-ea6c-40ea-8b6a-3911c8cbfc95 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:44:55.425759 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-704cf0f3-ea6c-40ea-8b6a-3911c8cbfc95 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:44:55.434909 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-704cf0f3-ea6c-40ea-8b6a-3911c8cbfc95 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5" status: 200 len: 1730 microversion: 2.1 time: 0.152936 Sep 08 11:44:55.435602 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3640/7146] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:44:55 2022] GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:44:56.457834 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-aeb89caf-fe13-4774-ab45-26e2e8c2c8e8 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:44:56.458459 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-aeb89caf-fe13-4774-ab45-26e2e8c2c8e8 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: a2e7fa5c-3b4e-4842-9228-dba10ed065d5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:44:56.466404 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aeb89caf-fe13-4774-ab45-26e2e8c2c8e8 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:44:56.466902 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aeb89caf-fe13-4774-ab45-26e2e8c2c8e8 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:44:56.467353 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aeb89caf-fe13-4774-ab45-26e2e8c2c8e8 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:44:56.468063 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aeb89caf-fe13-4774-ab45-26e2e8c2c8e8 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:44:56.468531 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aeb89caf-fe13-4774-ab45-26e2e8c2c8e8 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:44:56.468968 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aeb89caf-fe13-4774-ab45-26e2e8c2c8e8 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:44:56.607547 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-aeb89caf-fe13-4774-ab45-26e2e8c2c8e8 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:44:56.616242 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-aeb89caf-fe13-4774-ab45-26e2e8c2c8e8 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5" status: 200 len: 1730 microversion: 2.1 time: 0.162480 Sep 08 11:44:56.616820 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3507/7147] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:44:56 2022] GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:44:57.643079 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9ff150d4-c1d8-4f4c-989d-33621f19b3ae tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:44:57.643687 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9ff150d4-c1d8-4f4c-989d-33621f19b3ae tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: a2e7fa5c-3b4e-4842-9228-dba10ed065d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:44:57.651287 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ff150d4-c1d8-4f4c-989d-33621f19b3ae tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:44:57.651771 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ff150d4-c1d8-4f4c-989d-33621f19b3ae tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:44:57.652203 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ff150d4-c1d8-4f4c-989d-33621f19b3ae tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:44:57.652886 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ff150d4-c1d8-4f4c-989d-33621f19b3ae tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:44:57.653382 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ff150d4-c1d8-4f4c-989d-33621f19b3ae tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:44:57.653803 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ff150d4-c1d8-4f4c-989d-33621f19b3ae tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:44:57.788430 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9ff150d4-c1d8-4f4c-989d-33621f19b3ae tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:44:57.796621 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9ff150d4-c1d8-4f4c-989d-33621f19b3ae tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5" status: 200 len: 1730 microversion: 2.1 time: 0.157525 Sep 08 11:44:57.797228 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3641/7148] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:44:57 2022] GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:44:58.819665 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b977ced8-bb49-4229-baf1-602a9b13f949 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:44:58.820379 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b977ced8-bb49-4229-baf1-602a9b13f949 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: a2e7fa5c-3b4e-4842-9228-dba10ed065d5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:44:58.827846 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b977ced8-bb49-4229-baf1-602a9b13f949 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:44:58.828346 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b977ced8-bb49-4229-baf1-602a9b13f949 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:44:58.828797 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b977ced8-bb49-4229-baf1-602a9b13f949 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:44:58.829542 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b977ced8-bb49-4229-baf1-602a9b13f949 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:44:58.830010 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b977ced8-bb49-4229-baf1-602a9b13f949 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:44:58.830448 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b977ced8-bb49-4229-baf1-602a9b13f949 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:44:58.964851 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b977ced8-bb49-4229-baf1-602a9b13f949 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:44:58.973223 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b977ced8-bb49-4229-baf1-602a9b13f949 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5" status: 200 len: 1730 microversion: 2.1 time: 0.157443 Sep 08 11:44:58.973805 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3508/7149] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:44:58 2022] GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:44:59.997786 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-60588110-59de-4694-b23e-b56aa19a4948 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:44:59.998436 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-60588110-59de-4694-b23e-b56aa19a4948 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: a2e7fa5c-3b4e-4842-9228-dba10ed065d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:45:00.005268 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-60588110-59de-4694-b23e-b56aa19a4948 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:00.005764 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-60588110-59de-4694-b23e-b56aa19a4948 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:00.006208 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-60588110-59de-4694-b23e-b56aa19a4948 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:00.006904 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-60588110-59de-4694-b23e-b56aa19a4948 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:00.007361 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-60588110-59de-4694-b23e-b56aa19a4948 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:00.008338 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-60588110-59de-4694-b23e-b56aa19a4948 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:00.140141 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-60588110-59de-4694-b23e-b56aa19a4948 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:45:00.148551 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-60588110-59de-4694-b23e-b56aa19a4948 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5" status: 200 len: 1730 microversion: 2.1 time: 0.154664 Sep 08 11:45:00.149162 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3642/7150] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:44:59 2022] GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:45:01.172117 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-49b5d46c-aecc-4da2-9796-e46c266a09a7 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:45:01.172681 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-49b5d46c-aecc-4da2-9796-e46c266a09a7 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: a2e7fa5c-3b4e-4842-9228-dba10ed065d5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:45:01.180211 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49b5d46c-aecc-4da2-9796-e46c266a09a7 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:01.180759 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49b5d46c-aecc-4da2-9796-e46c266a09a7 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:01.181297 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49b5d46c-aecc-4da2-9796-e46c266a09a7 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:01.182039 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49b5d46c-aecc-4da2-9796-e46c266a09a7 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:01.182516 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49b5d46c-aecc-4da2-9796-e46c266a09a7 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:01.182961 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49b5d46c-aecc-4da2-9796-e46c266a09a7 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:01.320786 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-49b5d46c-aecc-4da2-9796-e46c266a09a7 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:45:01.329293 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-49b5d46c-aecc-4da2-9796-e46c266a09a7 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5" status: 200 len: 1730 microversion: 2.1 time: 0.161205 Sep 08 11:45:01.329879 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3509/7151] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:45:01 2022] GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:45:02.351487 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ab4e24bc-cb08-46e5-aee4-f7d6dcd249fe tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:45:02.352166 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ab4e24bc-cb08-46e5-aee4-f7d6dcd249fe tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: a2e7fa5c-3b4e-4842-9228-dba10ed065d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:45:02.358999 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ab4e24bc-cb08-46e5-aee4-f7d6dcd249fe tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:02.359485 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ab4e24bc-cb08-46e5-aee4-f7d6dcd249fe tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:02.359924 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ab4e24bc-cb08-46e5-aee4-f7d6dcd249fe tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:02.360623 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ab4e24bc-cb08-46e5-aee4-f7d6dcd249fe tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:02.361105 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ab4e24bc-cb08-46e5-aee4-f7d6dcd249fe tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:02.361538 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ab4e24bc-cb08-46e5-aee4-f7d6dcd249fe tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:02.495949 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ab4e24bc-cb08-46e5-aee4-f7d6dcd249fe tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:45:02.504197 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ab4e24bc-cb08-46e5-aee4-f7d6dcd249fe tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5" status: 200 len: 1730 microversion: 2.1 time: 0.156598 Sep 08 11:45:02.504766 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3643/7152] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:45:02 2022] GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:45:03.528629 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b4be38f0-5785-4bb8-a070-d8fbaaf7696c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:45:03.529419 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b4be38f0-5785-4bb8-a070-d8fbaaf7696c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: a2e7fa5c-3b4e-4842-9228-dba10ed065d5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:45:03.536411 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4be38f0-5785-4bb8-a070-d8fbaaf7696c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:03.536912 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4be38f0-5785-4bb8-a070-d8fbaaf7696c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:03.537393 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4be38f0-5785-4bb8-a070-d8fbaaf7696c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:03.538105 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4be38f0-5785-4bb8-a070-d8fbaaf7696c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:03.538574 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4be38f0-5785-4bb8-a070-d8fbaaf7696c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:03.539088 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4be38f0-5785-4bb8-a070-d8fbaaf7696c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:03.672659 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b4be38f0-5785-4bb8-a070-d8fbaaf7696c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:45:03.681133 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b4be38f0-5785-4bb8-a070-d8fbaaf7696c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5" status: 200 len: 1730 microversion: 2.1 time: 0.156721 Sep 08 11:45:03.681711 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3510/7153] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:45:03 2022] GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:45:04.704760 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d13c3d06-9fbb-4c10-9673-2956a039ea28 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:45:04.705437 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d13c3d06-9fbb-4c10-9673-2956a039ea28 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: a2e7fa5c-3b4e-4842-9228-dba10ed065d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:45:04.713313 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d13c3d06-9fbb-4c10-9673-2956a039ea28 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:04.713831 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d13c3d06-9fbb-4c10-9673-2956a039ea28 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:04.714266 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d13c3d06-9fbb-4c10-9673-2956a039ea28 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:04.715012 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d13c3d06-9fbb-4c10-9673-2956a039ea28 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:04.715423 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d13c3d06-9fbb-4c10-9673-2956a039ea28 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:04.715853 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d13c3d06-9fbb-4c10-9673-2956a039ea28 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:04.848364 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d13c3d06-9fbb-4c10-9673-2956a039ea28 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:45:04.857641 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d13c3d06-9fbb-4c10-9673-2956a039ea28 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5" status: 200 len: 1730 microversion: 2.1 time: 0.156778 Sep 08 11:45:04.858222 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3644/7154] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:45:04 2022] GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:45:05.881601 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2442446b-7f0b-4cea-8715-f2057d9b7307 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:45:05.882231 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2442446b-7f0b-4cea-8715-f2057d9b7307 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: a2e7fa5c-3b4e-4842-9228-dba10ed065d5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:45:05.890208 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2442446b-7f0b-4cea-8715-f2057d9b7307 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:05.890719 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2442446b-7f0b-4cea-8715-f2057d9b7307 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:05.891168 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2442446b-7f0b-4cea-8715-f2057d9b7307 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:05.892026 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2442446b-7f0b-4cea-8715-f2057d9b7307 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:05.892342 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2442446b-7f0b-4cea-8715-f2057d9b7307 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:05.892781 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2442446b-7f0b-4cea-8715-f2057d9b7307 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:06.034423 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2442446b-7f0b-4cea-8715-f2057d9b7307 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:45:06.042863 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2442446b-7f0b-4cea-8715-f2057d9b7307 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5" status: 200 len: 1730 microversion: 2.1 time: 0.165159 Sep 08 11:45:06.043445 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3511/7155] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:45:05 2022] GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:45:07.066255 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-41991417-d54a-4d5c-bbdb-8c0d868c1c9c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:45:07.066823 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-41991417-d54a-4d5c-bbdb-8c0d868c1c9c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: a2e7fa5c-3b4e-4842-9228-dba10ed065d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:45:07.073871 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41991417-d54a-4d5c-bbdb-8c0d868c1c9c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:07.074369 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41991417-d54a-4d5c-bbdb-8c0d868c1c9c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:07.074822 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41991417-d54a-4d5c-bbdb-8c0d868c1c9c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:07.075526 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41991417-d54a-4d5c-bbdb-8c0d868c1c9c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:07.075992 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41991417-d54a-4d5c-bbdb-8c0d868c1c9c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:07.076427 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41991417-d54a-4d5c-bbdb-8c0d868c1c9c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:07.212170 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-41991417-d54a-4d5c-bbdb-8c0d868c1c9c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:45:07.220695 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-41991417-d54a-4d5c-bbdb-8c0d868c1c9c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5" status: 200 len: 1730 microversion: 2.1 time: 0.158464 Sep 08 11:45:07.221302 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3645/7156] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:45:07 2022] GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:45:08.245099 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f3aae350-4270-4de1-8be8-20999590ec5b tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:45:08.245764 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f3aae350-4270-4de1-8be8-20999590ec5b tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: a2e7fa5c-3b4e-4842-9228-dba10ed065d5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:45:08.252782 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f3aae350-4270-4de1-8be8-20999590ec5b tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:08.253319 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f3aae350-4270-4de1-8be8-20999590ec5b tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:08.253779 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f3aae350-4270-4de1-8be8-20999590ec5b tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:08.254490 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f3aae350-4270-4de1-8be8-20999590ec5b tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:08.254966 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f3aae350-4270-4de1-8be8-20999590ec5b tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:08.255409 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f3aae350-4270-4de1-8be8-20999590ec5b tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:08.391279 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f3aae350-4270-4de1-8be8-20999590ec5b tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:45:08.400240 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f3aae350-4270-4de1-8be8-20999590ec5b tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5" status: 200 len: 1730 microversion: 2.1 time: 0.159856 Sep 08 11:45:08.400819 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3512/7157] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:45:08 2022] GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:45:09.424311 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-88cab0d7-9521-4fe7-b7bf-0ed761ee2084 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:45:09.424939 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-88cab0d7-9521-4fe7-b7bf-0ed761ee2084 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: a2e7fa5c-3b4e-4842-9228-dba10ed065d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:45:09.432341 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88cab0d7-9521-4fe7-b7bf-0ed761ee2084 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:09.432826 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88cab0d7-9521-4fe7-b7bf-0ed761ee2084 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:09.433299 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88cab0d7-9521-4fe7-b7bf-0ed761ee2084 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:09.434002 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88cab0d7-9521-4fe7-b7bf-0ed761ee2084 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:09.434459 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88cab0d7-9521-4fe7-b7bf-0ed761ee2084 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:09.434887 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88cab0d7-9521-4fe7-b7bf-0ed761ee2084 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:09.564578 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-88cab0d7-9521-4fe7-b7bf-0ed761ee2084 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:45:09.573612 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-88cab0d7-9521-4fe7-b7bf-0ed761ee2084 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5" status: 200 len: 1730 microversion: 2.1 time: 0.153166 Sep 08 11:45:09.574198 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3646/7158] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:45:09 2022] GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:45:10.597392 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6595a428-d6a6-4725-af76-a8d32164f851 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:45:10.597958 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6595a428-d6a6-4725-af76-a8d32164f851 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: a2e7fa5c-3b4e-4842-9228-dba10ed065d5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:45:10.605599 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6595a428-d6a6-4725-af76-a8d32164f851 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:10.606105 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6595a428-d6a6-4725-af76-a8d32164f851 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:10.606563 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6595a428-d6a6-4725-af76-a8d32164f851 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:10.607280 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6595a428-d6a6-4725-af76-a8d32164f851 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:10.607752 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6595a428-d6a6-4725-af76-a8d32164f851 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:10.608197 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6595a428-d6a6-4725-af76-a8d32164f851 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:10.742026 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6595a428-d6a6-4725-af76-a8d32164f851 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:45:10.750702 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6595a428-d6a6-4725-af76-a8d32164f851 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5" status: 200 len: 1730 microversion: 2.1 time: 0.157439 Sep 08 11:45:10.751285 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3513/7159] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:45:10 2022] GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:45:11.773875 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7c25966b-98b6-40e6-b29b-4376f9f031d4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:45:11.774517 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7c25966b-98b6-40e6-b29b-4376f9f031d4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: a2e7fa5c-3b4e-4842-9228-dba10ed065d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:45:11.782112 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c25966b-98b6-40e6-b29b-4376f9f031d4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:11.782604 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c25966b-98b6-40e6-b29b-4376f9f031d4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:11.783039 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c25966b-98b6-40e6-b29b-4376f9f031d4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:11.783738 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c25966b-98b6-40e6-b29b-4376f9f031d4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:11.784194 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c25966b-98b6-40e6-b29b-4376f9f031d4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:11.784622 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c25966b-98b6-40e6-b29b-4376f9f031d4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:11.913658 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7c25966b-98b6-40e6-b29b-4376f9f031d4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:45:11.922545 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7c25966b-98b6-40e6-b29b-4376f9f031d4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5" status: 200 len: 1730 microversion: 2.1 time: 0.152512 Sep 08 11:45:11.923130 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3647/7160] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:45:11 2022] GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:45:12.946465 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-760b3d1d-1533-4a51-83c6-6a521bd5ef82 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:45:12.947819 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-760b3d1d-1533-4a51-83c6-6a521bd5ef82 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: a2e7fa5c-3b4e-4842-9228-dba10ed065d5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:45:12.955033 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-760b3d1d-1533-4a51-83c6-6a521bd5ef82 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:12.955540 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-760b3d1d-1533-4a51-83c6-6a521bd5ef82 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:12.955998 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-760b3d1d-1533-4a51-83c6-6a521bd5ef82 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:12.956722 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-760b3d1d-1533-4a51-83c6-6a521bd5ef82 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:12.957233 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-760b3d1d-1533-4a51-83c6-6a521bd5ef82 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:12.957679 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-760b3d1d-1533-4a51-83c6-6a521bd5ef82 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:13.089337 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-760b3d1d-1533-4a51-83c6-6a521bd5ef82 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:45:13.097705 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-760b3d1d-1533-4a51-83c6-6a521bd5ef82 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5" status: 200 len: 1730 microversion: 2.1 time: 0.155512 Sep 08 11:45:13.098286 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3514/7161] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:45:12 2022] GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:45:14.121500 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9e33c7ff-d9f4-4074-ba51-758ca0dcf2b8 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:45:14.122117 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9e33c7ff-d9f4-4074-ba51-758ca0dcf2b8 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: a2e7fa5c-3b4e-4842-9228-dba10ed065d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:45:14.128680 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e33c7ff-d9f4-4074-ba51-758ca0dcf2b8 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:14.129192 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e33c7ff-d9f4-4074-ba51-758ca0dcf2b8 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:14.129625 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e33c7ff-d9f4-4074-ba51-758ca0dcf2b8 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:14.130325 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e33c7ff-d9f4-4074-ba51-758ca0dcf2b8 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:14.130781 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e33c7ff-d9f4-4074-ba51-758ca0dcf2b8 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:14.131214 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e33c7ff-d9f4-4074-ba51-758ca0dcf2b8 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:14.275930 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9e33c7ff-d9f4-4074-ba51-758ca0dcf2b8 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:45:14.285077 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9e33c7ff-d9f4-4074-ba51-758ca0dcf2b8 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5" status: 200 len: 1730 microversion: 2.1 time: 0.167972 Sep 08 11:45:14.285667 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3648/7162] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:45:14 2022] GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:45:14.810118 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-0a5a8024-a622-4b6b-97d5-a8f5dd1bab86 req-500d4174-2fe3-4569-8a53-68f69a8e90af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2e7fa5c-3b4e-4842-9228-dba10ed065d5", "name": "network-vif-unplugged", "status": "completed", "tag": "6f56977b-8a11-4779-86b1-a9b9da907d2e"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:45:14.821373 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-0a5a8024-a622-4b6b-97d5-a8f5dd1bab86 req-500d4174-2fe3-4569-8a53-68f69a8e90af service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:14.822446 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-0a5a8024-a622-4b6b-97d5-a8f5dd1bab86 req-500d4174-2fe3-4569-8a53-68f69a8e90af service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:14.823265 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-0a5a8024-a622-4b6b-97d5-a8f5dd1bab86 req-500d4174-2fe3-4569-8a53-68f69a8e90af service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:14.835564 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-0a5a8024-a622-4b6b-97d5-a8f5dd1bab86 req-500d4174-2fe3-4569-8a53-68f69a8e90af service nova] Creating event network-vif-unplugged:6f56977b-8a11-4779-86b1-a9b9da907d2e for instance a2e7fa5c-3b4e-4842-9228-dba10ed065d5 on n-h1-850501-12 Sep 08 11:45:14.841992 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [req-0a5a8024-a622-4b6b-97d5-a8f5dd1bab86 req-500d4174-2fe3-4569-8a53-68f69a8e90af service nova] Instance a2e7fa5c-3b4e-4842-9228-dba10ed065d5 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850501-12', 'n-h1-850501-12'} {{(pid=128862) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 11:45:14.852943 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-0a5a8024-a622-4b6b-97d5-a8f5dd1bab86 req-500d4174-2fe3-4569-8a53-68f69a8e90af service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048371 Sep 08 11:45:14.854157 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3515/7163] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:45:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:45:15.308751 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1a440479-a11e-419c-b092-e23207674e99 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:45:15.309400 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1a440479-a11e-419c-b092-e23207674e99 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: a2e7fa5c-3b4e-4842-9228-dba10ed065d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:45:15.316789 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1a440479-a11e-419c-b092-e23207674e99 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:15.317327 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1a440479-a11e-419c-b092-e23207674e99 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:15.317767 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1a440479-a11e-419c-b092-e23207674e99 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:15.318475 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1a440479-a11e-419c-b092-e23207674e99 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:15.318936 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1a440479-a11e-419c-b092-e23207674e99 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:15.319362 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1a440479-a11e-419c-b092-e23207674e99 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:15.526132 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1a440479-a11e-419c-b092-e23207674e99 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:45:15.535284 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1a440479-a11e-419c-b092-e23207674e99 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5" status: 200 len: 1729 microversion: 2.1 time: 0.230577 Sep 08 11:45:15.536079 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3649/7164] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:45:15 2022] GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5 => generated 1729 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:45:16.560775 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-de84ba02-00bd-4851-a417-33fb3b2d7ab2 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:45:16.561618 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-de84ba02-00bd-4851-a417-33fb3b2d7ab2 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: a2e7fa5c-3b4e-4842-9228-dba10ed065d5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:45:16.568194 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de84ba02-00bd-4851-a417-33fb3b2d7ab2 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:16.568707 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de84ba02-00bd-4851-a417-33fb3b2d7ab2 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:16.569208 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de84ba02-00bd-4851-a417-33fb3b2d7ab2 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:16.569935 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de84ba02-00bd-4851-a417-33fb3b2d7ab2 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:16.570417 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de84ba02-00bd-4851-a417-33fb3b2d7ab2 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:16.570866 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de84ba02-00bd-4851-a417-33fb3b2d7ab2 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:16.708581 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-de84ba02-00bd-4851-a417-33fb3b2d7ab2 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:45:16.717711 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-de84ba02-00bd-4851-a417-33fb3b2d7ab2 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5" status: 200 len: 1727 microversion: 2.1 time: 0.162913 Sep 08 11:45:16.718501 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3516/7165] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:45:16 2022] GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5 => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:45:16.890788 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-bcd229c4-626e-4ce5-8eb8-22d45ff6983d req-e1d9d2d5-ab72-4823-831c-d05f4b5de655 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2e7fa5c-3b4e-4842-9228-dba10ed065d5", "tag": "6f56977b-8a11-4779-86b1-a9b9da907d2e"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:45:16.902650 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-bcd229c4-626e-4ce5-8eb8-22d45ff6983d req-e1d9d2d5-ab72-4823-831c-d05f4b5de655 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:16.903129 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-bcd229c4-626e-4ce5-8eb8-22d45ff6983d req-e1d9d2d5-ab72-4823-831c-d05f4b5de655 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:16.903559 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-bcd229c4-626e-4ce5-8eb8-22d45ff6983d req-e1d9d2d5-ab72-4823-831c-d05f4b5de655 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:16.917368 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-bcd229c4-626e-4ce5-8eb8-22d45ff6983d req-e1d9d2d5-ab72-4823-831c-d05f4b5de655 service nova] Creating event network-changed:6f56977b-8a11-4779-86b1-a9b9da907d2e for instance a2e7fa5c-3b4e-4842-9228-dba10ed065d5 on n-h1-850501-12 Sep 08 11:45:16.923733 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [req-bcd229c4-626e-4ce5-8eb8-22d45ff6983d req-e1d9d2d5-ab72-4823-831c-d05f4b5de655 service nova] Instance a2e7fa5c-3b4e-4842-9228-dba10ed065d5 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850501-12', 'n-h1-850501-12'} {{(pid=128861) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 11:45:16.934863 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-bcd229c4-626e-4ce5-8eb8-22d45ff6983d req-e1d9d2d5-ab72-4823-831c-d05f4b5de655 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047963 Sep 08 11:45:16.935537 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3650/7166] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:45:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:45:17.741587 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5234cb19-8de6-43f1-8e22-beae6c15e0cf tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:45:17.742215 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5234cb19-8de6-43f1-8e22-beae6c15e0cf tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: a2e7fa5c-3b4e-4842-9228-dba10ed065d5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:45:17.750024 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5234cb19-8de6-43f1-8e22-beae6c15e0cf tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:17.750532 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5234cb19-8de6-43f1-8e22-beae6c15e0cf tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:17.750980 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5234cb19-8de6-43f1-8e22-beae6c15e0cf tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:17.751697 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5234cb19-8de6-43f1-8e22-beae6c15e0cf tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:17.752163 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5234cb19-8de6-43f1-8e22-beae6c15e0cf tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:17.752598 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5234cb19-8de6-43f1-8e22-beae6c15e0cf tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:17.893624 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5234cb19-8de6-43f1-8e22-beae6c15e0cf tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:45:17.902944 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5234cb19-8de6-43f1-8e22-beae6c15e0cf tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5" status: 200 len: 1727 microversion: 2.1 time: 0.165578 Sep 08 11:45:17.903543 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3517/7167] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:45:17 2022] GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5 => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:45:18.928382 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-69b3d962-5fd3-4e38-b654-76596d3cc140 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:45:18.929231 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-69b3d962-5fd3-4e38-b654-76596d3cc140 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: a2e7fa5c-3b4e-4842-9228-dba10ed065d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:45:18.935983 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-69b3d962-5fd3-4e38-b654-76596d3cc140 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:18.936468 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-69b3d962-5fd3-4e38-b654-76596d3cc140 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:18.936898 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-69b3d962-5fd3-4e38-b654-76596d3cc140 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:18.937610 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-69b3d962-5fd3-4e38-b654-76596d3cc140 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:18.938064 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-69b3d962-5fd3-4e38-b654-76596d3cc140 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:18.938487 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-69b3d962-5fd3-4e38-b654-76596d3cc140 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:19.071445 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-69b3d962-5fd3-4e38-b654-76596d3cc140 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:45:19.080760 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-69b3d962-5fd3-4e38-b654-76596d3cc140 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5" status: 200 len: 1727 microversion: 2.1 time: 0.157435 Sep 08 11:45:19.081369 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3651/7168] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:45:18 2022] GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:45:20.104696 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ff2ff09b-c783-4770-b0e0-e006a11273ea tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:45:20.105417 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ff2ff09b-c783-4770-b0e0-e006a11273ea tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: a2e7fa5c-3b4e-4842-9228-dba10ed065d5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:45:20.112091 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff2ff09b-c783-4770-b0e0-e006a11273ea tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:20.112598 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff2ff09b-c783-4770-b0e0-e006a11273ea tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:20.113069 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff2ff09b-c783-4770-b0e0-e006a11273ea tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:20.114052 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff2ff09b-c783-4770-b0e0-e006a11273ea tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:20.114523 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff2ff09b-c783-4770-b0e0-e006a11273ea tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:20.114963 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff2ff09b-c783-4770-b0e0-e006a11273ea tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:20.263645 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ff2ff09b-c783-4770-b0e0-e006a11273ea tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:45:20.272232 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ff2ff09b-c783-4770-b0e0-e006a11273ea tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5" status: 200 len: 1727 microversion: 2.1 time: 0.172340 Sep 08 11:45:20.272825 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3518/7169] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:45:20 2022] GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5 => generated 1727 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:45:21.296192 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c6759095-71c9-448f-8346-5daa94151db5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:45:21.296829 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c6759095-71c9-448f-8346-5daa94151db5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: a2e7fa5c-3b4e-4842-9228-dba10ed065d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:45:21.303966 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c6759095-71c9-448f-8346-5daa94151db5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:21.304464 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c6759095-71c9-448f-8346-5daa94151db5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:21.304907 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c6759095-71c9-448f-8346-5daa94151db5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:21.305641 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c6759095-71c9-448f-8346-5daa94151db5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:21.306604 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c6759095-71c9-448f-8346-5daa94151db5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:21.307077 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c6759095-71c9-448f-8346-5daa94151db5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:21.452671 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c6759095-71c9-448f-8346-5daa94151db5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:45:21.461017 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c6759095-71c9-448f-8346-5daa94151db5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5" status: 200 len: 1727 microversion: 2.1 time: 0.168741 Sep 08 11:45:21.461615 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3652/7170] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:45:21 2022] GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5 => generated 1727 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:45:22.486099 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ce88e6ff-2a11-4ac2-b045-f2d16f18a242 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:45:22.486636 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ce88e6ff-2a11-4ac2-b045-f2d16f18a242 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: a2e7fa5c-3b4e-4842-9228-dba10ed065d5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:45:22.493955 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ce88e6ff-2a11-4ac2-b045-f2d16f18a242 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:22.494459 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ce88e6ff-2a11-4ac2-b045-f2d16f18a242 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:22.494915 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ce88e6ff-2a11-4ac2-b045-f2d16f18a242 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:22.495627 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ce88e6ff-2a11-4ac2-b045-f2d16f18a242 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:22.496103 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ce88e6ff-2a11-4ac2-b045-f2d16f18a242 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:22.496547 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ce88e6ff-2a11-4ac2-b045-f2d16f18a242 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:22.630455 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ce88e6ff-2a11-4ac2-b045-f2d16f18a242 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:45:22.639759 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ce88e6ff-2a11-4ac2-b045-f2d16f18a242 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5" status: 200 len: 1727 microversion: 2.1 time: 0.157662 Sep 08 11:45:22.640342 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3519/7171] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:45:22 2022] GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:45:23.663194 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5d0b69c3-b4d5-4cab-b319-39a98194b421 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:45:23.663796 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5d0b69c3-b4d5-4cab-b319-39a98194b421 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: a2e7fa5c-3b4e-4842-9228-dba10ed065d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:45:23.667326 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=29 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:45:23.672719 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5d0b69c3-b4d5-4cab-b319-39a98194b421 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:23.673240 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5d0b69c3-b4d5-4cab-b319-39a98194b421 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:23.673677 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5d0b69c3-b4d5-4cab-b319-39a98194b421 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:23.674374 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5d0b69c3-b4d5-4cab-b319-39a98194b421 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:23.674832 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5d0b69c3-b4d5-4cab-b319-39a98194b421 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:23.675259 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5d0b69c3-b4d5-4cab-b319-39a98194b421 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:23.678038 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=83 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:45:23.808543 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5d0b69c3-b4d5-4cab-b319-39a98194b421 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:45:23.816831 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5d0b69c3-b4d5-4cab-b319-39a98194b421 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5" status: 200 len: 1727 microversion: 2.1 time: 0.157811 Sep 08 11:45:23.817427 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3653/7172] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:45:23 2022] GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:45:24.840361 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fc79b174-c454-4a6b-8421-934bd098a50a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:45:24.840990 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fc79b174-c454-4a6b-8421-934bd098a50a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: a2e7fa5c-3b4e-4842-9228-dba10ed065d5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:45:24.843912 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=35 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:45:24.849348 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fc79b174-c454-4a6b-8421-934bd098a50a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:24.849853 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fc79b174-c454-4a6b-8421-934bd098a50a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:24.850303 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fc79b174-c454-4a6b-8421-934bd098a50a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:24.851017 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fc79b174-c454-4a6b-8421-934bd098a50a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:24.851483 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fc79b174-c454-4a6b-8421-934bd098a50a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:24.851923 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fc79b174-c454-4a6b-8421-934bd098a50a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:24.855386 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:45:24.988407 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fc79b174-c454-4a6b-8421-934bd098a50a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:45:24.998166 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fc79b174-c454-4a6b-8421-934bd098a50a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5" status: 200 len: 1727 microversion: 2.1 time: 0.162356 Sep 08 11:45:24.998749 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3520/7173] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:45:24 2022] GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5 => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:45:26.023138 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3549ab6e-9a0c-4a11-a552-de4e047faaa0 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:45:26.023786 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3549ab6e-9a0c-4a11-a552-de4e047faaa0 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: a2e7fa5c-3b4e-4842-9228-dba10ed065d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:45:26.031143 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3549ab6e-9a0c-4a11-a552-de4e047faaa0 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:26.031635 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3549ab6e-9a0c-4a11-a552-de4e047faaa0 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:26.032074 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3549ab6e-9a0c-4a11-a552-de4e047faaa0 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:26.032772 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3549ab6e-9a0c-4a11-a552-de4e047faaa0 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:26.033270 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3549ab6e-9a0c-4a11-a552-de4e047faaa0 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:26.033702 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3549ab6e-9a0c-4a11-a552-de4e047faaa0 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:26.164631 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-3549ab6e-9a0c-4a11-a552-de4e047faaa0 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:45:26.173595 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3549ab6e-9a0c-4a11-a552-de4e047faaa0 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5" status: 200 len: 1727 microversion: 2.1 time: 0.154551 Sep 08 11:45:26.174185 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3654/7174] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:45:26 2022] GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:45:27.199275 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-accbba07-b911-4fd0-8052-bac4bdf54dc2 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:45:27.199892 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-accbba07-b911-4fd0-8052-bac4bdf54dc2 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: a2e7fa5c-3b4e-4842-9228-dba10ed065d5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:45:27.207435 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-accbba07-b911-4fd0-8052-bac4bdf54dc2 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:27.207942 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-accbba07-b911-4fd0-8052-bac4bdf54dc2 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:27.208470 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-accbba07-b911-4fd0-8052-bac4bdf54dc2 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:27.209294 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-accbba07-b911-4fd0-8052-bac4bdf54dc2 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:27.209768 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-accbba07-b911-4fd0-8052-bac4bdf54dc2 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:27.210328 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-accbba07-b911-4fd0-8052-bac4bdf54dc2 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:27.352244 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-accbba07-b911-4fd0-8052-bac4bdf54dc2 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:45:27.361462 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-accbba07-b911-4fd0-8052-bac4bdf54dc2 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5" status: 200 len: 1727 microversion: 2.1 time: 0.167086 Sep 08 11:45:27.362052 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3521/7175] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:45:27 2022] GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5 => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:45:28.386692 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-68660736-6479-4318-baf3-9c1ad21b162a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:45:28.387469 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-68660736-6479-4318-baf3-9c1ad21b162a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: a2e7fa5c-3b4e-4842-9228-dba10ed065d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:45:28.395249 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-68660736-6479-4318-baf3-9c1ad21b162a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:28.395747 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-68660736-6479-4318-baf3-9c1ad21b162a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:28.396191 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-68660736-6479-4318-baf3-9c1ad21b162a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:28.396898 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-68660736-6479-4318-baf3-9c1ad21b162a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:28.397392 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-68660736-6479-4318-baf3-9c1ad21b162a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:28.397824 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-68660736-6479-4318-baf3-9c1ad21b162a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:28.551992 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-68660736-6479-4318-baf3-9c1ad21b162a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:45:28.561994 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-68660736-6479-4318-baf3-9c1ad21b162a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5" status: 200 len: 1724 microversion: 2.1 time: 0.179760 Sep 08 11:45:28.563036 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3655/7176] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:45:28 2022] GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5 => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:45:28.585431 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4ff2e6f5-c830-4e30-90d2-7ee7a3a2502a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:45:28.585996 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4ff2e6f5-c830-4e30-90d2-7ee7a3a2502a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: a2e7fa5c-3b4e-4842-9228-dba10ed065d5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:45:28.593540 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ff2e6f5-c830-4e30-90d2-7ee7a3a2502a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:28.594045 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ff2e6f5-c830-4e30-90d2-7ee7a3a2502a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:28.594493 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ff2e6f5-c830-4e30-90d2-7ee7a3a2502a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:28.595216 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ff2e6f5-c830-4e30-90d2-7ee7a3a2502a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:28.595685 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ff2e6f5-c830-4e30-90d2-7ee7a3a2502a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:28.596125 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ff2e6f5-c830-4e30-90d2-7ee7a3a2502a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:28.638262 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ff2e6f5-c830-4e30-90d2-7ee7a3a2502a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:28.638766 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ff2e6f5-c830-4e30-90d2-7ee7a3a2502a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:28.639220 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ff2e6f5-c830-4e30-90d2-7ee7a3a2502a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:28.640251 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ff2e6f5-c830-4e30-90d2-7ee7a3a2502a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:28.640792 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ff2e6f5-c830-4e30-90d2-7ee7a3a2502a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:28.641328 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ff2e6f5-c830-4e30-90d2-7ee7a3a2502a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:28.663159 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-4ff2e6f5-c830-4e30-90d2-7ee7a3a2502a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Getting quotas for project 5e7adfbb1417415b9eafeeb23b7a7c18. Resources: {'ram', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:45:28.670169 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-4ff2e6f5-c830-4e30-90d2-7ee7a3a2502a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Getting quotas for user f38a21e862664942bf35c93870df1c36 and project 5e7adfbb1417415b9eafeeb23b7a7c18. Resources: {'ram', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:45:28.779118 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4ff2e6f5-c830-4e30-90d2-7ee7a3a2502a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "POST /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5/action" status: 202 len: 0 microversion: 2.1 time: 0.197396 Sep 08 11:45:28.779850 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3522/7177] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 11:45:28 2022] POST /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5/action => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:45:28.788835 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9a193726-c3ba-4d42-9187-758ec211d178 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:45:28.789485 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9a193726-c3ba-4d42-9187-758ec211d178 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: a2e7fa5c-3b4e-4842-9228-dba10ed065d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:45:28.795738 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9a193726-c3ba-4d42-9187-758ec211d178 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:28.796517 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9a193726-c3ba-4d42-9187-758ec211d178 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:28.796955 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9a193726-c3ba-4d42-9187-758ec211d178 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:28.797766 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9a193726-c3ba-4d42-9187-758ec211d178 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:28.798258 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9a193726-c3ba-4d42-9187-758ec211d178 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:28.798746 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9a193726-c3ba-4d42-9187-758ec211d178 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:29.015283 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9a193726-c3ba-4d42-9187-758ec211d178 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:45:29.033273 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9a193726-c3ba-4d42-9187-758ec211d178 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5" status: 200 len: 1723 microversion: 2.1 time: 0.248487 Sep 08 11:45:29.034788 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3656/7178] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:45:28 2022] GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5 => generated 1723 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:45:30.072205 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-55f77ce0-59f0-4912-9c01-754d799355e2 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:45:30.072929 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-55f77ce0-59f0-4912-9c01-754d799355e2 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: a2e7fa5c-3b4e-4842-9228-dba10ed065d5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:45:30.080263 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55f77ce0-59f0-4912-9c01-754d799355e2 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:30.080775 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55f77ce0-59f0-4912-9c01-754d799355e2 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:30.081262 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55f77ce0-59f0-4912-9c01-754d799355e2 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:30.081991 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55f77ce0-59f0-4912-9c01-754d799355e2 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:30.082460 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55f77ce0-59f0-4912-9c01-754d799355e2 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:30.082906 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55f77ce0-59f0-4912-9c01-754d799355e2 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:30.232646 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-55f77ce0-59f0-4912-9c01-754d799355e2 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:45:30.241955 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-55f77ce0-59f0-4912-9c01-754d799355e2 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5" status: 200 len: 1723 microversion: 2.1 time: 0.174960 Sep 08 11:45:30.242553 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3523/7179] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:45:30 2022] GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:45:30.427932 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-e5657b8d-7094-414b-9684-b94c11101adc req-6fb3548d-a682-4c7d-b2fd-e31a219b6034 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2e7fa5c-3b4e-4842-9228-dba10ed065d5", "name": "network-vif-plugged", "status": "completed", "tag": "6f56977b-8a11-4779-86b1-a9b9da907d2e"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:45:30.438312 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-e5657b8d-7094-414b-9684-b94c11101adc req-6fb3548d-a682-4c7d-b2fd-e31a219b6034 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:30.438794 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-e5657b8d-7094-414b-9684-b94c11101adc req-6fb3548d-a682-4c7d-b2fd-e31a219b6034 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:30.439254 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-e5657b8d-7094-414b-9684-b94c11101adc req-6fb3548d-a682-4c7d-b2fd-e31a219b6034 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:30.452880 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-e5657b8d-7094-414b-9684-b94c11101adc req-6fb3548d-a682-4c7d-b2fd-e31a219b6034 service nova] Creating event network-vif-plugged:6f56977b-8a11-4779-86b1-a9b9da907d2e for instance a2e7fa5c-3b4e-4842-9228-dba10ed065d5 on n-h1-850501-12 Sep 08 11:45:30.458716 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [req-e5657b8d-7094-414b-9684-b94c11101adc req-6fb3548d-a682-4c7d-b2fd-e31a219b6034 service nova] Instance a2e7fa5c-3b4e-4842-9228-dba10ed065d5 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850501-12', 'n-h1-850501-12'} {{(pid=128861) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 11:45:30.470569 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-e5657b8d-7094-414b-9684-b94c11101adc req-6fb3548d-a682-4c7d-b2fd-e31a219b6034 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046296 Sep 08 11:45:30.471189 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3657/7180] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:45:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:45:31.267747 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-782aabfd-17dc-488a-b7d8-926fdb98d22a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:45:31.268375 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-782aabfd-17dc-488a-b7d8-926fdb98d22a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: a2e7fa5c-3b4e-4842-9228-dba10ed065d5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:45:31.275936 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-782aabfd-17dc-488a-b7d8-926fdb98d22a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:31.276447 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-782aabfd-17dc-488a-b7d8-926fdb98d22a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:31.276909 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-782aabfd-17dc-488a-b7d8-926fdb98d22a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:31.277659 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-782aabfd-17dc-488a-b7d8-926fdb98d22a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:31.278139 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-782aabfd-17dc-488a-b7d8-926fdb98d22a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:31.278586 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-782aabfd-17dc-488a-b7d8-926fdb98d22a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:31.425561 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-782aabfd-17dc-488a-b7d8-926fdb98d22a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:45:31.435094 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-782aabfd-17dc-488a-b7d8-926fdb98d22a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5" status: 200 len: 1723 microversion: 2.1 time: 0.173092 Sep 08 11:45:31.435842 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3524/7181] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:45:31 2022] GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:45:32.459014 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d095d217-0aec-4768-bc87-3da00b2f3627 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:45:32.459621 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d095d217-0aec-4768-bc87-3da00b2f3627 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: a2e7fa5c-3b4e-4842-9228-dba10ed065d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:45:32.466529 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d095d217-0aec-4768-bc87-3da00b2f3627 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:32.467033 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d095d217-0aec-4768-bc87-3da00b2f3627 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:32.467454 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d095d217-0aec-4768-bc87-3da00b2f3627 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:32.468145 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d095d217-0aec-4768-bc87-3da00b2f3627 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:32.468604 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d095d217-0aec-4768-bc87-3da00b2f3627 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:32.469055 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d095d217-0aec-4768-bc87-3da00b2f3627 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:32.604683 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d095d217-0aec-4768-bc87-3da00b2f3627 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:45:32.613250 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d095d217-0aec-4768-bc87-3da00b2f3627 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5" status: 200 len: 1723 microversion: 2.1 time: 0.159467 Sep 08 11:45:32.614082 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3658/7182] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:45:32 2022] GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:45:33.638163 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4f185385-7585-4416-bc8f-87d4deddca10 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:45:33.638807 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4f185385-7585-4416-bc8f-87d4deddca10 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: a2e7fa5c-3b4e-4842-9228-dba10ed065d5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:45:33.646037 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f185385-7585-4416-bc8f-87d4deddca10 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:33.646545 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f185385-7585-4416-bc8f-87d4deddca10 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:33.647004 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f185385-7585-4416-bc8f-87d4deddca10 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:33.647731 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f185385-7585-4416-bc8f-87d4deddca10 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:33.648204 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f185385-7585-4416-bc8f-87d4deddca10 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:33.648649 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f185385-7585-4416-bc8f-87d4deddca10 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:33.784913 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4f185385-7585-4416-bc8f-87d4deddca10 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:45:33.793958 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4f185385-7585-4416-bc8f-87d4deddca10 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5" status: 200 len: 1723 microversion: 2.1 time: 0.160382 Sep 08 11:45:33.794587 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3525/7183] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:45:33 2022] GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:45:34.275101 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-4ca9dee3-636c-4953-8387-9a8d007b0f19 req-638b30ed-1e8b-4e55-a457-18b3e89acad5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2e7fa5c-3b4e-4842-9228-dba10ed065d5", "name": "network-vif-unplugged", "status": "completed", "tag": "6f56977b-8a11-4779-86b1-a9b9da907d2e"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:45:34.288383 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-4ca9dee3-636c-4953-8387-9a8d007b0f19 req-638b30ed-1e8b-4e55-a457-18b3e89acad5 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:34.289137 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-4ca9dee3-636c-4953-8387-9a8d007b0f19 req-638b30ed-1e8b-4e55-a457-18b3e89acad5 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:34.289577 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-4ca9dee3-636c-4953-8387-9a8d007b0f19 req-638b30ed-1e8b-4e55-a457-18b3e89acad5 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:34.302547 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-4ca9dee3-636c-4953-8387-9a8d007b0f19 req-638b30ed-1e8b-4e55-a457-18b3e89acad5 service nova] Creating event network-vif-unplugged:6f56977b-8a11-4779-86b1-a9b9da907d2e for instance a2e7fa5c-3b4e-4842-9228-dba10ed065d5 on n-h2-850501-12 Sep 08 11:45:34.309213 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [req-4ca9dee3-636c-4953-8387-9a8d007b0f19 req-638b30ed-1e8b-4e55-a457-18b3e89acad5 service nova] Instance a2e7fa5c-3b4e-4842-9228-dba10ed065d5 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850501-12', 'n-h1-850501-12'} {{(pid=128861) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 11:45:34.323345 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-4ca9dee3-636c-4953-8387-9a8d007b0f19 req-638b30ed-1e8b-4e55-a457-18b3e89acad5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053253 Sep 08 11:45:34.324630 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3659/7184] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:45:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:45:34.818572 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c8fe94ee-0b32-483b-9ff6-9f535c110d8c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:45:34.819199 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c8fe94ee-0b32-483b-9ff6-9f535c110d8c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: a2e7fa5c-3b4e-4842-9228-dba10ed065d5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:45:34.826122 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c8fe94ee-0b32-483b-9ff6-9f535c110d8c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:34.826640 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c8fe94ee-0b32-483b-9ff6-9f535c110d8c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:34.827094 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c8fe94ee-0b32-483b-9ff6-9f535c110d8c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:34.827821 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c8fe94ee-0b32-483b-9ff6-9f535c110d8c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:34.828372 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c8fe94ee-0b32-483b-9ff6-9f535c110d8c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:34.828810 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c8fe94ee-0b32-483b-9ff6-9f535c110d8c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:34.967328 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c8fe94ee-0b32-483b-9ff6-9f535c110d8c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:45:34.975910 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c8fe94ee-0b32-483b-9ff6-9f535c110d8c tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5" status: 200 len: 1723 microversion: 2.1 time: 0.161400 Sep 08 11:45:34.976489 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3526/7185] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:45:34 2022] GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:45:36.001888 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-610ed64e-c973-46b0-9876-8e38f0874b36 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:45:36.002601 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-610ed64e-c973-46b0-9876-8e38f0874b36 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: a2e7fa5c-3b4e-4842-9228-dba10ed065d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:45:36.009265 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-610ed64e-c973-46b0-9876-8e38f0874b36 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:36.009768 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-610ed64e-c973-46b0-9876-8e38f0874b36 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:36.010207 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-610ed64e-c973-46b0-9876-8e38f0874b36 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:36.010922 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-610ed64e-c973-46b0-9876-8e38f0874b36 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:36.011379 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-610ed64e-c973-46b0-9876-8e38f0874b36 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:36.011808 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-610ed64e-c973-46b0-9876-8e38f0874b36 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:36.148344 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-610ed64e-c973-46b0-9876-8e38f0874b36 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:45:36.158235 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-610ed64e-c973-46b0-9876-8e38f0874b36 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5" status: 200 len: 1723 microversion: 2.1 time: 0.161677 Sep 08 11:45:36.159029 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3660/7186] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:45:35 2022] GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:45:36.358837 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-d5c02c01-708d-4481-b15e-a28631cb68d2 req-6bdab17e-1818-480c-a012-592a355aa098 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2e7fa5c-3b4e-4842-9228-dba10ed065d5", "tag": "6f56977b-8a11-4779-86b1-a9b9da907d2e"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:45:36.370816 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d5c02c01-708d-4481-b15e-a28631cb68d2 req-6bdab17e-1818-480c-a012-592a355aa098 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:36.371326 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d5c02c01-708d-4481-b15e-a28631cb68d2 req-6bdab17e-1818-480c-a012-592a355aa098 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:36.371779 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d5c02c01-708d-4481-b15e-a28631cb68d2 req-6bdab17e-1818-480c-a012-592a355aa098 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:36.386945 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-d5c02c01-708d-4481-b15e-a28631cb68d2 req-6bdab17e-1818-480c-a012-592a355aa098 service nova] Creating event network-changed:6f56977b-8a11-4779-86b1-a9b9da907d2e for instance a2e7fa5c-3b4e-4842-9228-dba10ed065d5 on n-h2-850501-12 Sep 08 11:45:36.392520 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [req-d5c02c01-708d-4481-b15e-a28631cb68d2 req-6bdab17e-1818-480c-a012-592a355aa098 service nova] Instance a2e7fa5c-3b4e-4842-9228-dba10ed065d5 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850501-12', 'n-h1-850501-12'} {{(pid=128862) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 11:45:36.404519 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-d5c02c01-708d-4481-b15e-a28631cb68d2 req-6bdab17e-1818-480c-a012-592a355aa098 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052527 Sep 08 11:45:36.405050 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3527/7187] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:45:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:45:37.183317 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1fbfb67f-9946-453c-8310-3cf9ff3cc7d8 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:45:37.184137 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1fbfb67f-9946-453c-8310-3cf9ff3cc7d8 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: a2e7fa5c-3b4e-4842-9228-dba10ed065d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:45:37.191854 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1fbfb67f-9946-453c-8310-3cf9ff3cc7d8 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:37.192357 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1fbfb67f-9946-453c-8310-3cf9ff3cc7d8 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:37.192796 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1fbfb67f-9946-453c-8310-3cf9ff3cc7d8 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:37.193733 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1fbfb67f-9946-453c-8310-3cf9ff3cc7d8 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:37.194195 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1fbfb67f-9946-453c-8310-3cf9ff3cc7d8 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:37.194632 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1fbfb67f-9946-453c-8310-3cf9ff3cc7d8 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:37.390082 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1fbfb67f-9946-453c-8310-3cf9ff3cc7d8 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:45:37.401802 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1fbfb67f-9946-453c-8310-3cf9ff3cc7d8 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5" status: 200 len: 1723 microversion: 2.1 time: 0.223233 Sep 08 11:45:37.402544 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3661/7188] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:45:37 2022] GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5 => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:45:38.427682 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-96cbf260-5a65-4cf3-b7b0-05e0b8bdb3bb tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:45:38.428422 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-96cbf260-5a65-4cf3-b7b0-05e0b8bdb3bb tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: a2e7fa5c-3b4e-4842-9228-dba10ed065d5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:45:38.434970 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-96cbf260-5a65-4cf3-b7b0-05e0b8bdb3bb tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:38.435485 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-96cbf260-5a65-4cf3-b7b0-05e0b8bdb3bb tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:38.435947 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-96cbf260-5a65-4cf3-b7b0-05e0b8bdb3bb tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:38.436670 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-96cbf260-5a65-4cf3-b7b0-05e0b8bdb3bb tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:38.437174 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-96cbf260-5a65-4cf3-b7b0-05e0b8bdb3bb tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:38.437620 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-96cbf260-5a65-4cf3-b7b0-05e0b8bdb3bb tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:38.575829 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-96cbf260-5a65-4cf3-b7b0-05e0b8bdb3bb tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:45:38.585202 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-96cbf260-5a65-4cf3-b7b0-05e0b8bdb3bb tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5" status: 200 len: 1723 microversion: 2.1 time: 0.162474 Sep 08 11:45:38.585658 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3528/7189] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:45:38 2022] GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:45:39.609309 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9e331c32-7e74-4dce-b886-5a3c71d133cb tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:45:39.610222 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9e331c32-7e74-4dce-b886-5a3c71d133cb tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: a2e7fa5c-3b4e-4842-9228-dba10ed065d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:45:39.617435 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e331c32-7e74-4dce-b886-5a3c71d133cb tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:39.617922 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e331c32-7e74-4dce-b886-5a3c71d133cb tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:39.619072 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e331c32-7e74-4dce-b886-5a3c71d133cb tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:39.619858 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e331c32-7e74-4dce-b886-5a3c71d133cb tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:39.620433 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e331c32-7e74-4dce-b886-5a3c71d133cb tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:39.621346 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e331c32-7e74-4dce-b886-5a3c71d133cb tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:39.761001 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9e331c32-7e74-4dce-b886-5a3c71d133cb tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:45:39.771254 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9e331c32-7e74-4dce-b886-5a3c71d133cb tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5" status: 200 len: 1723 microversion: 2.1 time: 0.165977 Sep 08 11:45:39.772130 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3662/7190] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:45:39 2022] GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:45:40.794873 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3c6671ff-c765-4592-b0b3-6c45604bc533 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:45:40.795496 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3c6671ff-c765-4592-b0b3-6c45604bc533 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: a2e7fa5c-3b4e-4842-9228-dba10ed065d5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:45:40.797538 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:45:40.804204 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c6671ff-c765-4592-b0b3-6c45604bc533 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:40.804727 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c6671ff-c765-4592-b0b3-6c45604bc533 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:40.805224 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c6671ff-c765-4592-b0b3-6c45604bc533 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:40.806585 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c6671ff-c765-4592-b0b3-6c45604bc533 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:40.807171 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c6671ff-c765-4592-b0b3-6c45604bc533 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:40.807594 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c6671ff-c765-4592-b0b3-6c45604bc533 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:40.945422 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3c6671ff-c765-4592-b0b3-6c45604bc533 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:45:40.954458 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3c6671ff-c765-4592-b0b3-6c45604bc533 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5" status: 200 len: 1723 microversion: 2.1 time: 0.163639 Sep 08 11:45:40.955044 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3529/7191] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:45:40 2022] GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:45:41.978337 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-79c1f173-9186-4f99-91f0-838f7d01eb9a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:45:41.978946 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-79c1f173-9186-4f99-91f0-838f7d01eb9a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: a2e7fa5c-3b4e-4842-9228-dba10ed065d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:45:41.985843 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-79c1f173-9186-4f99-91f0-838f7d01eb9a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:41.986330 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-79c1f173-9186-4f99-91f0-838f7d01eb9a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:41.986858 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-79c1f173-9186-4f99-91f0-838f7d01eb9a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:41.987554 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-79c1f173-9186-4f99-91f0-838f7d01eb9a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:41.988007 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-79c1f173-9186-4f99-91f0-838f7d01eb9a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:41.988432 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-79c1f173-9186-4f99-91f0-838f7d01eb9a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:42.119226 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-79c1f173-9186-4f99-91f0-838f7d01eb9a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:45:42.127622 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-79c1f173-9186-4f99-91f0-838f7d01eb9a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5" status: 200 len: 1723 microversion: 2.1 time: 0.153346 Sep 08 11:45:42.128190 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3663/7192] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:45:41 2022] GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:45:43.152094 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-56698b72-2622-468f-b440-50e0211f3d65 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:45:43.152630 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-56698b72-2622-468f-b440-50e0211f3d65 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: a2e7fa5c-3b4e-4842-9228-dba10ed065d5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:45:43.159593 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-56698b72-2622-468f-b440-50e0211f3d65 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:43.160106 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-56698b72-2622-468f-b440-50e0211f3d65 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:43.160560 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-56698b72-2622-468f-b440-50e0211f3d65 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:43.161302 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-56698b72-2622-468f-b440-50e0211f3d65 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:43.161777 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-56698b72-2622-468f-b440-50e0211f3d65 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:43.162219 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-56698b72-2622-468f-b440-50e0211f3d65 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:43.303325 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-56698b72-2622-468f-b440-50e0211f3d65 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:45:43.313448 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-56698b72-2622-468f-b440-50e0211f3d65 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5" status: 200 len: 1723 microversion: 2.1 time: 0.165858 Sep 08 11:45:43.314048 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3530/7193] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:45:43 2022] GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:45:44.338247 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b737b0cc-9ad9-4600-92c4-f40ec283438f tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:45:44.338869 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b737b0cc-9ad9-4600-92c4-f40ec283438f tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: a2e7fa5c-3b4e-4842-9228-dba10ed065d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:45:44.345571 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b737b0cc-9ad9-4600-92c4-f40ec283438f tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:44.346068 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b737b0cc-9ad9-4600-92c4-f40ec283438f tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:44.346517 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b737b0cc-9ad9-4600-92c4-f40ec283438f tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:44.347220 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b737b0cc-9ad9-4600-92c4-f40ec283438f tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:44.347720 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b737b0cc-9ad9-4600-92c4-f40ec283438f tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:44.348156 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b737b0cc-9ad9-4600-92c4-f40ec283438f tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:44.482159 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b737b0cc-9ad9-4600-92c4-f40ec283438f tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:45:44.490850 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b737b0cc-9ad9-4600-92c4-f40ec283438f tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5" status: 200 len: 1723 microversion: 2.1 time: 0.157506 Sep 08 11:45:44.491419 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3664/7194] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:45:44 2022] GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:45:45.514002 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4f7e628c-9975-44e6-9f64-43e85877de56 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:45:45.514626 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4f7e628c-9975-44e6-9f64-43e85877de56 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: a2e7fa5c-3b4e-4842-9228-dba10ed065d5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:45:45.521781 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f7e628c-9975-44e6-9f64-43e85877de56 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:45.522283 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f7e628c-9975-44e6-9f64-43e85877de56 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:45.522736 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f7e628c-9975-44e6-9f64-43e85877de56 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:45.523447 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f7e628c-9975-44e6-9f64-43e85877de56 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:45.523916 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f7e628c-9975-44e6-9f64-43e85877de56 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:45.524360 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f7e628c-9975-44e6-9f64-43e85877de56 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:45.663145 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4f7e628c-9975-44e6-9f64-43e85877de56 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:45:45.672125 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4f7e628c-9975-44e6-9f64-43e85877de56 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5" status: 200 len: 1723 microversion: 2.1 time: 0.162083 Sep 08 11:45:45.672735 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3531/7195] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:45:45 2022] GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:45:46.695845 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-094aad67-c385-43fe-9c54-0ed72d68df4f tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:45:46.697172 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-094aad67-c385-43fe-9c54-0ed72d68df4f tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: a2e7fa5c-3b4e-4842-9228-dba10ed065d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:45:46.703929 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-094aad67-c385-43fe-9c54-0ed72d68df4f tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:46.704415 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-094aad67-c385-43fe-9c54-0ed72d68df4f tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:46.704847 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-094aad67-c385-43fe-9c54-0ed72d68df4f tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:46.705565 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-094aad67-c385-43fe-9c54-0ed72d68df4f tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:46.706021 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-094aad67-c385-43fe-9c54-0ed72d68df4f tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:46.706444 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-094aad67-c385-43fe-9c54-0ed72d68df4f tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:46.851185 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-094aad67-c385-43fe-9c54-0ed72d68df4f tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:45:46.859537 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-094aad67-c385-43fe-9c54-0ed72d68df4f tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5" status: 200 len: 1723 microversion: 2.1 time: 0.167595 Sep 08 11:45:46.860120 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3665/7196] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:45:46 2022] GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:45:47.941908 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-91999d7d-c856-40c4-86a4-711a641a5061 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:45:47.942547 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-91999d7d-c856-40c4-86a4-711a641a5061 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: a2e7fa5c-3b4e-4842-9228-dba10ed065d5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:45:47.949945 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-91999d7d-c856-40c4-86a4-711a641a5061 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:47.950465 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-91999d7d-c856-40c4-86a4-711a641a5061 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:47.950926 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-91999d7d-c856-40c4-86a4-711a641a5061 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:47.951664 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-91999d7d-c856-40c4-86a4-711a641a5061 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:47.952175 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-91999d7d-c856-40c4-86a4-711a641a5061 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:47.952777 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-91999d7d-c856-40c4-86a4-711a641a5061 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:48.096654 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-91999d7d-c856-40c4-86a4-711a641a5061 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:45:48.106536 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-91999d7d-c856-40c4-86a4-711a641a5061 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5" status: 200 len: 1716 microversion: 2.1 time: 0.168575 Sep 08 11:45:48.107254 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3532/7197] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:45:47 2022] GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5 => generated 1716 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:45:48.131194 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c83f1f47-1bd3-464b-93e3-194f45a101e5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:45:48.132609 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c83f1f47-1bd3-464b-93e3-194f45a101e5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: a2e7fa5c-3b4e-4842-9228-dba10ed065d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:45:48.142813 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c83f1f47-1bd3-464b-93e3-194f45a101e5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:48.143432 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c83f1f47-1bd3-464b-93e3-194f45a101e5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:48.144160 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c83f1f47-1bd3-464b-93e3-194f45a101e5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:48.145308 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c83f1f47-1bd3-464b-93e3-194f45a101e5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:48.146189 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c83f1f47-1bd3-464b-93e3-194f45a101e5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:48.146649 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c83f1f47-1bd3-464b-93e3-194f45a101e5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:48.291124 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c83f1f47-1bd3-464b-93e3-194f45a101e5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:45:48.299577 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c83f1f47-1bd3-464b-93e3-194f45a101e5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5" status: 200 len: 1716 microversion: 2.1 time: 0.173288 Sep 08 11:45:48.300155 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3666/7198] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:45:48 2022] GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5 => generated 1716 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:45:48.323424 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f3f8b513-fe6f-4810-b835-f0a9b49fa1a2 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:45:48.324229 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f3f8b513-fe6f-4810-b835-f0a9b49fa1a2 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: a2e7fa5c-3b4e-4842-9228-dba10ed065d5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:45:48.332923 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f3f8b513-fe6f-4810-b835-f0a9b49fa1a2 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:48.333863 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f3f8b513-fe6f-4810-b835-f0a9b49fa1a2 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:48.334534 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f3f8b513-fe6f-4810-b835-f0a9b49fa1a2 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:48.335897 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f3f8b513-fe6f-4810-b835-f0a9b49fa1a2 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:48.336539 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f3f8b513-fe6f-4810-b835-f0a9b49fa1a2 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:48.338047 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f3f8b513-fe6f-4810-b835-f0a9b49fa1a2 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:48.475254 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f3f8b513-fe6f-4810-b835-f0a9b49fa1a2 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:45:48.483865 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f3f8b513-fe6f-4810-b835-f0a9b49fa1a2 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5" status: 200 len: 1716 microversion: 2.1 time: 0.165402 Sep 08 11:45:48.484458 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3533/7199] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:45:48 2022] GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5 => generated 1716 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:45:48.506760 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a71ddfbf-a121-472a-a50c-12c7766a53c3 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:45:48.507254 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a71ddfbf-a121-472a-a50c-12c7766a53c3 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: a2e7fa5c-3b4e-4842-9228-dba10ed065d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:45:48.514163 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a71ddfbf-a121-472a-a50c-12c7766a53c3 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:48.514755 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a71ddfbf-a121-472a-a50c-12c7766a53c3 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:48.515194 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a71ddfbf-a121-472a-a50c-12c7766a53c3 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:48.515882 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a71ddfbf-a121-472a-a50c-12c7766a53c3 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:48.516337 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a71ddfbf-a121-472a-a50c-12c7766a53c3 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:48.516841 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a71ddfbf-a121-472a-a50c-12c7766a53c3 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:48.541713 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a71ddfbf-a121-472a-a50c-12c7766a53c3 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: a2e7fa5c-3b4e-4842-9228-dba10ed065d5] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:45:48.617358 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a71ddfbf-a121-472a-a50c-12c7766a53c3 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5" status: 204 len: 0 microversion: 2.1 time: 0.114111 Sep 08 11:45:48.618854 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3667/7200] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:45:48 2022] DELETE /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:45:48.628241 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3625e41a-97c0-4aab-b61c-2e6b27d54c93 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:45:48.629062 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3625e41a-97c0-4aab-b61c-2e6b27d54c93 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: a2e7fa5c-3b4e-4842-9228-dba10ed065d5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:45:48.636459 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3625e41a-97c0-4aab-b61c-2e6b27d54c93 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:48.636981 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3625e41a-97c0-4aab-b61c-2e6b27d54c93 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:48.637501 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3625e41a-97c0-4aab-b61c-2e6b27d54c93 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:48.638368 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3625e41a-97c0-4aab-b61c-2e6b27d54c93 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:48.638839 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3625e41a-97c0-4aab-b61c-2e6b27d54c93 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:48.639299 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3625e41a-97c0-4aab-b61c-2e6b27d54c93 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:48.642302 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:45:48.788185 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3625e41a-97c0-4aab-b61c-2e6b27d54c93 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:45:48.797035 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3625e41a-97c0-4aab-b61c-2e6b27d54c93 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5" status: 200 len: 1722 microversion: 2.1 time: 0.173294 Sep 08 11:45:48.797561 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3534/7201] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:45:48 2022] GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:45:49.822656 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cbc62e14-b0d0-49ea-9ac4-ba6de56f2b12 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:45:49.823413 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cbc62e14-b0d0-49ea-9ac4-ba6de56f2b12 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: a2e7fa5c-3b4e-4842-9228-dba10ed065d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:45:49.829959 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cbc62e14-b0d0-49ea-9ac4-ba6de56f2b12 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:49.830431 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cbc62e14-b0d0-49ea-9ac4-ba6de56f2b12 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:49.830869 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cbc62e14-b0d0-49ea-9ac4-ba6de56f2b12 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:49.831573 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cbc62e14-b0d0-49ea-9ac4-ba6de56f2b12 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:49.832033 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cbc62e14-b0d0-49ea-9ac4-ba6de56f2b12 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:49.832460 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cbc62e14-b0d0-49ea-9ac4-ba6de56f2b12 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:49.928067 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-c1e98ffb-baaa-4eff-80f2-c73af1890d17 req-1d630440-026a-4231-a5b3-64a9f7aece1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2e7fa5c-3b4e-4842-9228-dba10ed065d5", "name": "network-vif-plugged", "status": "completed", "tag": "6f56977b-8a11-4779-86b1-a9b9da907d2e"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:45:49.940751 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c1e98ffb-baaa-4eff-80f2-c73af1890d17 req-1d630440-026a-4231-a5b3-64a9f7aece1a service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:49.941444 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c1e98ffb-baaa-4eff-80f2-c73af1890d17 req-1d630440-026a-4231-a5b3-64a9f7aece1a service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:49.941909 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c1e98ffb-baaa-4eff-80f2-c73af1890d17 req-1d630440-026a-4231-a5b3-64a9f7aece1a service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:49.955762 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-c1e98ffb-baaa-4eff-80f2-c73af1890d17 req-1d630440-026a-4231-a5b3-64a9f7aece1a service nova] Creating event network-vif-plugged:6f56977b-8a11-4779-86b1-a9b9da907d2e for instance a2e7fa5c-3b4e-4842-9228-dba10ed065d5 on n-h2-850501-12 Sep 08 11:45:49.961488 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-c1e98ffb-baaa-4eff-80f2-c73af1890d17 req-1d630440-026a-4231-a5b3-64a9f7aece1a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037165 Sep 08 11:45:49.963558 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3535/7202] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:45:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:45:50.065115 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-cbc62e14-b0d0-49ea-9ac4-ba6de56f2b12 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:45:50.067507 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:45:50.075352 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cbc62e14-b0d0-49ea-9ac4-ba6de56f2b12 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5" status: 200 len: 1722 microversion: 2.1 time: 0.257870 Sep 08 11:45:50.075926 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3668/7203] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:45:49 2022] GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5 => generated 1722 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:45:51.103077 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-87e85f16-eee3-4510-a407-a6c5731cf6d0 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:45:51.104346 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-87e85f16-eee3-4510-a407-a6c5731cf6d0 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: a2e7fa5c-3b4e-4842-9228-dba10ed065d5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:45:51.112193 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87e85f16-eee3-4510-a407-a6c5731cf6d0 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:51.112810 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87e85f16-eee3-4510-a407-a6c5731cf6d0 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:51.113424 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87e85f16-eee3-4510-a407-a6c5731cf6d0 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:51.114589 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87e85f16-eee3-4510-a407-a6c5731cf6d0 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:51.115165 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87e85f16-eee3-4510-a407-a6c5731cf6d0 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:51.115718 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87e85f16-eee3-4510-a407-a6c5731cf6d0 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:51.302249 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-87e85f16-eee3-4510-a407-a6c5731cf6d0 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:45:51.311370 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-87e85f16-eee3-4510-a407-a6c5731cf6d0 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5" status: 200 len: 1722 microversion: 2.1 time: 0.215000 Sep 08 11:45:51.311962 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3536/7204] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:45:51 2022] GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5 => generated 1722 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:45:51.831615 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-1ab802db-2d6a-4605-bb4a-a1c23a8eec89 req-cd8fd967-9ecc-4adb-9352-4ada27aa5886 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2e7fa5c-3b4e-4842-9228-dba10ed065d5", "name": "network-vif-deleted", "tag": "6f56977b-8a11-4779-86b1-a9b9da907d2e"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:45:51.845451 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-1ab802db-2d6a-4605-bb4a-a1c23a8eec89 req-cd8fd967-9ecc-4adb-9352-4ada27aa5886 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:51.845939 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-1ab802db-2d6a-4605-bb4a-a1c23a8eec89 req-cd8fd967-9ecc-4adb-9352-4ada27aa5886 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:51.846376 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-1ab802db-2d6a-4605-bb4a-a1c23a8eec89 req-cd8fd967-9ecc-4adb-9352-4ada27aa5886 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:51.859520 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-1ab802db-2d6a-4605-bb4a-a1c23a8eec89 req-cd8fd967-9ecc-4adb-9352-4ada27aa5886 service nova] Creating event network-vif-deleted:6f56977b-8a11-4779-86b1-a9b9da907d2e for instance a2e7fa5c-3b4e-4842-9228-dba10ed065d5 on n-h2-850501-12 Sep 08 11:45:51.865631 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-1ab802db-2d6a-4605-bb4a-a1c23a8eec89 req-cd8fd967-9ecc-4adb-9352-4ada27aa5886 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042600 Sep 08 11:45:51.866226 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3669/7205] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:45:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:45:52.335819 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fe1c8efa-8374-4351-aeda-d1e395383c86 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:45:52.337182 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fe1c8efa-8374-4351-aeda-d1e395383c86 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: a2e7fa5c-3b4e-4842-9228-dba10ed065d5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:45:52.344586 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fe1c8efa-8374-4351-aeda-d1e395383c86 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:52.345371 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fe1c8efa-8374-4351-aeda-d1e395383c86 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:52.346008 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fe1c8efa-8374-4351-aeda-d1e395383c86 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:52.346741 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fe1c8efa-8374-4351-aeda-d1e395383c86 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:52.347218 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fe1c8efa-8374-4351-aeda-d1e395383c86 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:52.347667 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fe1c8efa-8374-4351-aeda-d1e395383c86 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:52.418564 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fe1c8efa-8374-4351-aeda-d1e395383c86 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:45:52.427903 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fe1c8efa-8374-4351-aeda-d1e395383c86 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5" status: 200 len: 1369 microversion: 2.1 time: 0.095948 Sep 08 11:45:52.428549 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3537/7206] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:45:52 2022] GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5 => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:45:53.454430 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ee8bb816-44e4-4dbf-818c-45aa12a63d3e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:45:53.455224 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ee8bb816-44e4-4dbf-818c-45aa12a63d3e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: a2e7fa5c-3b4e-4842-9228-dba10ed065d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:45:53.462292 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ee8bb816-44e4-4dbf-818c-45aa12a63d3e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:53.462955 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ee8bb816-44e4-4dbf-818c-45aa12a63d3e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:53.463393 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ee8bb816-44e4-4dbf-818c-45aa12a63d3e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:53.464102 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ee8bb816-44e4-4dbf-818c-45aa12a63d3e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:53.464562 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ee8bb816-44e4-4dbf-818c-45aa12a63d3e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:53.464990 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ee8bb816-44e4-4dbf-818c-45aa12a63d3e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:53.536319 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ee8bb816-44e4-4dbf-818c-45aa12a63d3e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:45:53.546335 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ee8bb816-44e4-4dbf-818c-45aa12a63d3e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5" status: 200 len: 1369 microversion: 2.1 time: 0.096964 Sep 08 11:45:53.546919 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3670/7207] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:45:53 2022] GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5 => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:45:54.569504 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ab8feb85-5afa-4466-b689-1d9e02a567d4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:45:54.570039 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ab8feb85-5afa-4466-b689-1d9e02a567d4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: a2e7fa5c-3b4e-4842-9228-dba10ed065d5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:45:54.577277 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab8feb85-5afa-4466-b689-1d9e02a567d4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:54.577786 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab8feb85-5afa-4466-b689-1d9e02a567d4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:54.578243 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab8feb85-5afa-4466-b689-1d9e02a567d4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:54.578958 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab8feb85-5afa-4466-b689-1d9e02a567d4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:54.579437 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab8feb85-5afa-4466-b689-1d9e02a567d4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:54.579879 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab8feb85-5afa-4466-b689-1d9e02a567d4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:54.645792 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ab8feb85-5afa-4466-b689-1d9e02a567d4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:45:54.654316 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ab8feb85-5afa-4466-b689-1d9e02a567d4 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5" status: 200 len: 1369 microversion: 2.1 time: 0.088876 Sep 08 11:45:54.654911 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3538/7208] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:45:54 2022] GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:45:55.678207 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-beb8ea67-e1ad-44c5-a67a-23579b263c78 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:45:55.678828 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-beb8ea67-e1ad-44c5-a67a-23579b263c78 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: a2e7fa5c-3b4e-4842-9228-dba10ed065d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:45:55.681611 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:45:55.686948 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-beb8ea67-e1ad-44c5-a67a-23579b263c78 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:55.687442 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-beb8ea67-e1ad-44c5-a67a-23579b263c78 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:55.687883 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-beb8ea67-e1ad-44c5-a67a-23579b263c78 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:55.688583 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-beb8ea67-e1ad-44c5-a67a-23579b263c78 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:55.689056 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-beb8ea67-e1ad-44c5-a67a-23579b263c78 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:55.689494 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-beb8ea67-e1ad-44c5-a67a-23579b263c78 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:55.753481 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-beb8ea67-e1ad-44c5-a67a-23579b263c78 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38a21e862664942bf35c93870df1c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfbb1417415b9eafeeb23b7a7c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:45:55.761825 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-beb8ea67-e1ad-44c5-a67a-23579b263c78 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5" status: 200 len: 1369 microversion: 2.1 time: 0.087634 Sep 08 11:45:55.762416 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3671/7209] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:45:55 2022] GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:45:56.785739 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cbd9544c-65ef-4f69-b827-868cd6a22c5a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:45:56.786371 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cbd9544c-65ef-4f69-b827-868cd6a22c5a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: a2e7fa5c-3b4e-4842-9228-dba10ed065d5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:45:56.789267 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:45:56.795208 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cbd9544c-65ef-4f69-b827-868cd6a22c5a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:56.795710 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cbd9544c-65ef-4f69-b827-868cd6a22c5a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:56.796158 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cbd9544c-65ef-4f69-b827-868cd6a22c5a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:56.796868 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cbd9544c-65ef-4f69-b827-868cd6a22c5a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:56.797367 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cbd9544c-65ef-4f69-b827-868cd6a22c5a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:56.797841 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cbd9544c-65ef-4f69-b827-868cd6a22c5a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:56.812897 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-cbd9544c-65ef-4f69-b827-868cd6a22c5a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] HTTP exception thrown: Instance a2e7fa5c-3b4e-4842-9228-dba10ed065d5 could not be found. Sep 08 11:45:56.814586 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cbd9544c-65ef-4f69-b827-868cd6a22c5a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Request method failure captured: Sep 08 11:45:56.814586 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5 HTTP/1.1 Sep 08 11:45:56.814586 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 11:45:56.814586 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 11:45:56.814586 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 11:45:56.814586 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 11:45:56.814586 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 11:45:56.814586 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 11:45:56.814586 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 11:45:56.814586 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 11:45:56.814586 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGdSDvOwoS57OkYb_-Yl1XUx78kih9MULmYIyzFLt-u36W2wjj2KtWXAZ7aX14KpVLwWCBvBeF4bTqW87i3VTvG-qHq5mt1bIpxmJHowTqwKpzB7zzorSV7BPwI-U0G6PWcbOtFoIJUt5uu58duhf3xUQD9p0cNz13ICJbtKWoYuCsmY Sep 08 11:45:56.814586 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 11:45:56.814586 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 11:45:56.814586 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 11:45:56.814586 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 11:45:56.814586 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 11:45:56.814586 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 11:45:56.814586 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 5e7adfbb1417415b9eafeeb23b7a7c18 Sep 08 11:45:56.814586 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServerActionsTestJSON-143982609 Sep 08 11:45:56.814586 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 11:45:56.814586 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 11:45:56.814586 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5e7adfbb1417415b9eafeeb23b7a7c18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5e7adfbb1417415b9eafeeb23b7a7c18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5e7adfbb1417415b9eafeeb23b7a7c18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5e7adfbb1417415b9eafeeb23b7a7c18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:45:56.814586 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServerActionsTestJSON-143982609 Sep 08 11:45:56.814586 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 5e7adfbb1417415b9eafeeb23b7a7c18 Sep 08 11:45:56.814586 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServerActionsTestJSON-143982609 Sep 08 11:45:56.814586 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServerActionsTestJSON-143982609-project Sep 08 11:45:56.814586 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 11:45:56.814586 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 11:45:56.814586 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: f38a21e862664942bf35c93870df1c36 Sep 08 11:45:56.814586 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServerActionsTestJSON-143982609-project Sep 08 11:45:56.814586 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 11:45:56.814586 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance a2e7fa5c-3b4e-4842-9228-dba10ed065d5 could not be found. Sep 08 11:45:56.814586 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'a2e7fa5c-3b4e-4842-9228-dba10ed065d5'} Sep 08 11:45:56.814586 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:45:56.814586 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:45:56.814586 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:45:56.814586 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:45:56.814586 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:45:56.814586 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:45:56.814586 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:45:56.814586 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:45:56.814586 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:45:56.814586 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:45:56.814586 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2e7fa5c-3b4e-4842-9228-dba10ed065d5 could not be found. Sep 08 11:45:56.814586 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:45:56.814586 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:45:56.814586 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:45:56.814586 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:45:56.814586 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:45:56.814586 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:45:56.814586 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:45:56.814586 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:45:56.814586 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:45:56.814586 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:45:56.814586 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:45:56.814586 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:45:56.814586 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:45:56.814586 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:45:56.814586 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:45:56.814586 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:45:56.814586 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2e7fa5c-3b4e-4842-9228-dba10ed065d5 could not be found. Sep 08 11:45:56.814586 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:45:56.814586 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:45:56.814586 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:45:56.819991 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:45:56.819991 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:45:56.819991 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:45:56.819991 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:45:56.819991 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:45:56.819991 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2e7fa5c-3b4e-4842-9228-dba10ed065d5 could not be found. Sep 08 11:45:56.819991 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:45:56.819991 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cbd9544c-65ef-4f69-b827-868cd6a22c5a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Returning 404 to user: Instance a2e7fa5c-3b4e-4842-9228-dba10ed065d5 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:45:56.819991 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cbd9544c-65ef-4f69-b827-868cd6a22c5a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5" status: 404 len: 111 microversion: 2.1 time: 0.034216 Sep 08 11:45:56.819991 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3539/7210] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:45:56 2022] GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:45:56.879470 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a1b1ff12-99bd-499f-a4fe-004aa6a2f164 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:45:56.881658 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a1b1ff12-99bd-499f-a4fe-004aa6a2f164 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: a2e7fa5c-3b4e-4842-9228-dba10ed065d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:45:56.888790 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a1b1ff12-99bd-499f-a4fe-004aa6a2f164 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:56.889313 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a1b1ff12-99bd-499f-a4fe-004aa6a2f164 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:56.889759 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a1b1ff12-99bd-499f-a4fe-004aa6a2f164 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:56.890470 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a1b1ff12-99bd-499f-a4fe-004aa6a2f164 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:56.890933 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a1b1ff12-99bd-499f-a4fe-004aa6a2f164 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:56.891366 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a1b1ff12-99bd-499f-a4fe-004aa6a2f164 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:56.904223 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-a1b1ff12-99bd-499f-a4fe-004aa6a2f164 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] HTTP exception thrown: Instance a2e7fa5c-3b4e-4842-9228-dba10ed065d5 could not be found. Sep 08 11:45:56.905945 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a1b1ff12-99bd-499f-a4fe-004aa6a2f164 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Request method failure captured: Sep 08 11:45:56.905945 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5/os-volume_attachments HTTP/1.1 Sep 08 11:45:56.905945 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:45:56.905945 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:45:56.905945 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:45:56.905945 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 11:45:56.905945 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:45:56.905945 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:45:56.905945 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:45:56.905945 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:45:56.905945 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGdSDvOwoS57OkYb_-Yl1XUx78kih9MULmYIyzFLt-u36W2wjj2KtWXAZ7aX14KpVLwWCBvBeF4bTqW87i3VTvG-qHq5mt1bIpxmJHowTqwKpzB7zzorSV7BPwI-U0G6PWcbOtFoIJUt5uu58duhf3xUQD9p0cNz13ICJbtKWoYuCsmY Sep 08 11:45:56.905945 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:45:56.905945 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:45:56.905945 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:45:56.905945 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:45:56.905945 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:45:56.905945 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:45:56.905945 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 5e7adfbb1417415b9eafeeb23b7a7c18 Sep 08 11:45:56.905945 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServerActionsTestJSON-143982609 Sep 08 11:45:56.905945 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:45:56.905945 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:45:56.905945 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5e7adfbb1417415b9eafeeb23b7a7c18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5e7adfbb1417415b9eafeeb23b7a7c18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5e7adfbb1417415b9eafeeb23b7a7c18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5e7adfbb1417415b9eafeeb23b7a7c18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:45:56.905945 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServerActionsTestJSON-143982609 Sep 08 11:45:56.905945 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 5e7adfbb1417415b9eafeeb23b7a7c18 Sep 08 11:45:56.905945 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServerActionsTestJSON-143982609 Sep 08 11:45:56.905945 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServerActionsTestJSON-143982609-project Sep 08 11:45:56.905945 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:45:56.905945 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:45:56.905945 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: f38a21e862664942bf35c93870df1c36 Sep 08 11:45:56.905945 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServerActionsTestJSON-143982609-project Sep 08 11:45:56.905945 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 11:45:56.905945 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance a2e7fa5c-3b4e-4842-9228-dba10ed065d5 could not be found. Sep 08 11:45:56.905945 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'server_id': 'a2e7fa5c-3b4e-4842-9228-dba10ed065d5'} Sep 08 11:45:56.905945 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:45:56.905945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:45:56.905945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:45:56.905945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:45:56.905945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:45:56.905945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:45:56.905945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:45:56.905945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:45:56.905945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:45:56.905945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:45:56.905945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2e7fa5c-3b4e-4842-9228-dba10ed065d5 could not be found. Sep 08 11:45:56.905945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:45:56.905945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:45:56.905945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:45:56.905945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:45:56.905945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:45:56.905945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:45:56.905945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:45:56.905945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:45:56.905945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:45:56.905945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:45:56.905945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 08 11:45:56.905945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 11:45:56.905945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 08 11:45:56.905945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 11:45:56.905945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 08 11:45:56.905945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 08 11:45:56.905945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:45:56.905945 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:45:56.910867 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2e7fa5c-3b4e-4842-9228-dba10ed065d5 could not be found. Sep 08 11:45:56.910867 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:45:56.910867 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:45:56.910867 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:45:56.910867 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:45:56.910867 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:45:56.910867 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:45:56.910867 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:45:56.910867 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:45:56.910867 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2e7fa5c-3b4e-4842-9228-dba10ed065d5 could not be found. Sep 08 11:45:56.910867 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:45:56.910867 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a1b1ff12-99bd-499f-a4fe-004aa6a2f164 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Returning 404 to user: Instance a2e7fa5c-3b4e-4842-9228-dba10ed065d5 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:45:56.910867 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a1b1ff12-99bd-499f-a4fe-004aa6a2f164 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.031849 Sep 08 11:45:56.910867 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3672/7211] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 11:45:56 2022] GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5/os-volume_attachments => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:46:00.243656 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-707c9ae3-d61f-4db4-a46d-f5e0d8f41cf5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:46:00.244532 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-707c9ae3-d61f-4db4-a46d-f5e0d8f41cf5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: a2e7fa5c-3b4e-4842-9228-dba10ed065d5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:46:00.251146 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-707c9ae3-d61f-4db4-a46d-f5e0d8f41cf5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:00.251651 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-707c9ae3-d61f-4db4-a46d-f5e0d8f41cf5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:00.252106 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-707c9ae3-d61f-4db4-a46d-f5e0d8f41cf5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:00.252986 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-707c9ae3-d61f-4db4-a46d-f5e0d8f41cf5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:00.253489 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-707c9ae3-d61f-4db4-a46d-f5e0d8f41cf5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:00.253932 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-707c9ae3-d61f-4db4-a46d-f5e0d8f41cf5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:00.267996 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-707c9ae3-d61f-4db4-a46d-f5e0d8f41cf5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] HTTP exception thrown: Instance a2e7fa5c-3b4e-4842-9228-dba10ed065d5 could not be found. Sep 08 11:46:00.269556 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-707c9ae3-d61f-4db4-a46d-f5e0d8f41cf5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Request method failure captured: Sep 08 11:46:00.269556 n-d-850501-12 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5 HTTP/1.1 Sep 08 11:46:00.269556 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 11:46:00.269556 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 11:46:00.269556 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 11:46:00.269556 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 11:46:00.269556 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 11:46:00.269556 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 11:46:00.269556 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 11:46:00.269556 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 11:46:00.269556 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGdSDvOwoS57OkYb_-Yl1XUx78kih9MULmYIyzFLt-u36W2wjj2KtWXAZ7aX14KpVLwWCBvBeF4bTqW87i3VTvG-qHq5mt1bIpxmJHowTqwKpzB7zzorSV7BPwI-U0G6PWcbOtFoIJUt5uu58duhf3xUQD9p0cNz13ICJbtKWoYuCsmY Sep 08 11:46:00.269556 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 11:46:00.269556 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 11:46:00.269556 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 11:46:00.269556 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 11:46:00.269556 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 11:46:00.269556 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 11:46:00.269556 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 5e7adfbb1417415b9eafeeb23b7a7c18 Sep 08 11:46:00.269556 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServerActionsTestJSON-143982609 Sep 08 11:46:00.269556 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 11:46:00.269556 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 11:46:00.269556 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5e7adfbb1417415b9eafeeb23b7a7c18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5e7adfbb1417415b9eafeeb23b7a7c18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5e7adfbb1417415b9eafeeb23b7a7c18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5e7adfbb1417415b9eafeeb23b7a7c18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:46:00.269556 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServerActionsTestJSON-143982609 Sep 08 11:46:00.269556 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 5e7adfbb1417415b9eafeeb23b7a7c18 Sep 08 11:46:00.269556 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServerActionsTestJSON-143982609 Sep 08 11:46:00.269556 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServerActionsTestJSON-143982609-project Sep 08 11:46:00.269556 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 11:46:00.269556 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 11:46:00.269556 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: f38a21e862664942bf35c93870df1c36 Sep 08 11:46:00.269556 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServerActionsTestJSON-143982609-project Sep 08 11:46:00.269556 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 11:46:00.269556 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance a2e7fa5c-3b4e-4842-9228-dba10ed065d5 could not be found. Sep 08 11:46:00.269556 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'a2e7fa5c-3b4e-4842-9228-dba10ed065d5'} Sep 08 11:46:00.269556 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:46:00.269556 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:46:00.269556 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:46:00.269556 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:46:00.269556 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:46:00.269556 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:46:00.269556 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:46:00.269556 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:46:00.269556 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:46:00.269556 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:46:00.269556 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2e7fa5c-3b4e-4842-9228-dba10ed065d5 could not be found. Sep 08 11:46:00.269556 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:46:00.269556 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:46:00.269556 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:46:00.269556 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:46:00.269556 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:46:00.269556 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:46:00.269556 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:46:00.269556 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:46:00.269556 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:46:00.269556 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:46:00.269556 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 11:46:00.269556 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 11:46:00.269556 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 11:46:00.269556 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 11:46:00.269556 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:46:00.269556 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:46:00.269556 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:46:00.269556 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:46:00.273518 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2e7fa5c-3b4e-4842-9228-dba10ed065d5 could not be found. Sep 08 11:46:00.273518 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:46:00.273518 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:46:00.273518 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:46:00.273518 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:46:00.273518 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:46:00.273518 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:46:00.273518 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:46:00.273518 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:46:00.273518 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2e7fa5c-3b4e-4842-9228-dba10ed065d5 could not be found. Sep 08 11:46:00.273518 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:46:00.273518 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-707c9ae3-d61f-4db4-a46d-f5e0d8f41cf5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Returning 404 to user: Instance a2e7fa5c-3b4e-4842-9228-dba10ed065d5 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:46:00.273518 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-707c9ae3-d61f-4db4-a46d-f5e0d8f41cf5 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5" status: 404 len: 111 microversion: 2.1 time: 0.032538 Sep 08 11:46:00.273518 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3540/7212] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:46:00 2022] DELETE /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 11:46:00.279512 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a38e34a6-bf30-4617-941e-6793d0ca8166 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:46:00.280130 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a38e34a6-bf30-4617-941e-6793d0ca8166 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: a2e7fa5c-3b4e-4842-9228-dba10ed065d5] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:46:00.287176 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a38e34a6-bf30-4617-941e-6793d0ca8166 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:00.287667 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a38e34a6-bf30-4617-941e-6793d0ca8166 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:00.288109 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a38e34a6-bf30-4617-941e-6793d0ca8166 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:00.288811 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a38e34a6-bf30-4617-941e-6793d0ca8166 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:00.289313 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a38e34a6-bf30-4617-941e-6793d0ca8166 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:00.290392 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a38e34a6-bf30-4617-941e-6793d0ca8166 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:00.312457 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-a38e34a6-bf30-4617-941e-6793d0ca8166 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] HTTP exception thrown: Instance a2e7fa5c-3b4e-4842-9228-dba10ed065d5 could not be found. Sep 08 11:46:00.314078 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a38e34a6-bf30-4617-941e-6793d0ca8166 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Request method failure captured: Sep 08 11:46:00.314078 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5 HTTP/1.1 Sep 08 11:46:00.314078 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:46:00.314078 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:46:00.314078 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:46:00.314078 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 11:46:00.314078 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:46:00.314078 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:46:00.314078 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:46:00.314078 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:46:00.314078 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGdSDvOwoS57OkYb_-Yl1XUx78kih9MULmYIyzFLt-u36W2wjj2KtWXAZ7aX14KpVLwWCBvBeF4bTqW87i3VTvG-qHq5mt1bIpxmJHowTqwKpzB7zzorSV7BPwI-U0G6PWcbOtFoIJUt5uu58duhf3xUQD9p0cNz13ICJbtKWoYuCsmY Sep 08 11:46:00.314078 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:46:00.314078 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:46:00.314078 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:46:00.314078 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:46:00.314078 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:46:00.314078 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:46:00.314078 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 5e7adfbb1417415b9eafeeb23b7a7c18 Sep 08 11:46:00.314078 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServerActionsTestJSON-143982609 Sep 08 11:46:00.314078 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:46:00.314078 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:46:00.314078 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5e7adfbb1417415b9eafeeb23b7a7c18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5e7adfbb1417415b9eafeeb23b7a7c18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5e7adfbb1417415b9eafeeb23b7a7c18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5e7adfbb1417415b9eafeeb23b7a7c18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:46:00.314078 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServerActionsTestJSON-143982609 Sep 08 11:46:00.314078 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 5e7adfbb1417415b9eafeeb23b7a7c18 Sep 08 11:46:00.314078 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServerActionsTestJSON-143982609 Sep 08 11:46:00.314078 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServerActionsTestJSON-143982609-project Sep 08 11:46:00.314078 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:46:00.314078 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:46:00.314078 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: f38a21e862664942bf35c93870df1c36 Sep 08 11:46:00.314078 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServerActionsTestJSON-143982609-project Sep 08 11:46:00.314078 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 11:46:00.314078 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance a2e7fa5c-3b4e-4842-9228-dba10ed065d5 could not be found. Sep 08 11:46:00.314078 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': 'a2e7fa5c-3b4e-4842-9228-dba10ed065d5'} Sep 08 11:46:00.314078 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:46:00.314078 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:46:00.314078 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:46:00.314078 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:46:00.314078 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:46:00.314078 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:46:00.314078 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:46:00.314078 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:46:00.314078 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:46:00.314078 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:46:00.314078 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2e7fa5c-3b4e-4842-9228-dba10ed065d5 could not be found. Sep 08 11:46:00.314078 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:46:00.314078 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:46:00.314078 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:46:00.314078 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:46:00.314078 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:46:00.314078 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:46:00.314078 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:46:00.314078 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:46:00.314078 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:46:00.314078 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:46:00.314078 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:46:00.314078 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:46:00.314078 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:46:00.314078 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:46:00.314078 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:46:00.314078 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:46:00.314078 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2e7fa5c-3b4e-4842-9228-dba10ed065d5 could not be found. Sep 08 11:46:00.314078 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:46:00.314078 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:46:00.314078 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:46:00.319172 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:46:00.319172 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:46:00.319172 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:46:00.319172 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:46:00.319172 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:46:00.319172 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2e7fa5c-3b4e-4842-9228-dba10ed065d5 could not be found. Sep 08 11:46:00.319172 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:46:00.319172 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a38e34a6-bf30-4617-941e-6793d0ca8166 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Returning 404 to user: Instance a2e7fa5c-3b4e-4842-9228-dba10ed065d5 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:46:00.319172 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a38e34a6-bf30-4617-941e-6793d0ca8166 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5" status: 404 len: 111 microversion: 2.1 time: 0.039823 Sep 08 11:46:00.319172 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3673/7213] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:46:00 2022] GET /compute/v2.1/servers/a2e7fa5c-3b4e-4842-9228-dba10ed065d5 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:46:00.324292 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-58f066da-993a-4f40-9e8d-adda1fcb5869 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:46:00.324810 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-58f066da-993a-4f40-9e8d-adda1fcb5869 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 654a0638-6345-4150-9a9b-b58143e2213f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:46:00.330931 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-58f066da-993a-4f40-9e8d-adda1fcb5869 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:00.331441 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-58f066da-993a-4f40-9e8d-adda1fcb5869 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:00.331898 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-58f066da-993a-4f40-9e8d-adda1fcb5869 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:00.332615 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-58f066da-993a-4f40-9e8d-adda1fcb5869 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:00.333118 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-58f066da-993a-4f40-9e8d-adda1fcb5869 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:00.333568 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-58f066da-993a-4f40-9e8d-adda1fcb5869 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:00.347570 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-58f066da-993a-4f40-9e8d-adda1fcb5869 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] HTTP exception thrown: Instance 654a0638-6345-4150-9a9b-b58143e2213f could not be found. Sep 08 11:46:00.349182 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-58f066da-993a-4f40-9e8d-adda1fcb5869 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Request method failure captured: Sep 08 11:46:00.349182 n-d-850501-12 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f HTTP/1.1 Sep 08 11:46:00.349182 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 11:46:00.349182 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 11:46:00.349182 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 11:46:00.349182 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 11:46:00.349182 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 11:46:00.349182 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 11:46:00.349182 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 11:46:00.349182 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 11:46:00.349182 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGdSDvOwoS57OkYb_-Yl1XUx78kih9MULmYIyzFLt-u36W2wjj2KtWXAZ7aX14KpVLwWCBvBeF4bTqW87i3VTvG-qHq5mt1bIpxmJHowTqwKpzB7zzorSV7BPwI-U0G6PWcbOtFoIJUt5uu58duhf3xUQD9p0cNz13ICJbtKWoYuCsmY Sep 08 11:46:00.349182 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 11:46:00.349182 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 11:46:00.349182 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 11:46:00.349182 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 11:46:00.349182 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 11:46:00.349182 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 11:46:00.349182 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 5e7adfbb1417415b9eafeeb23b7a7c18 Sep 08 11:46:00.349182 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServerActionsTestJSON-143982609 Sep 08 11:46:00.349182 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 11:46:00.349182 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 11:46:00.349182 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5e7adfbb1417415b9eafeeb23b7a7c18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5e7adfbb1417415b9eafeeb23b7a7c18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5e7adfbb1417415b9eafeeb23b7a7c18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5e7adfbb1417415b9eafeeb23b7a7c18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:46:00.349182 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServerActionsTestJSON-143982609 Sep 08 11:46:00.349182 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 5e7adfbb1417415b9eafeeb23b7a7c18 Sep 08 11:46:00.349182 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServerActionsTestJSON-143982609 Sep 08 11:46:00.349182 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServerActionsTestJSON-143982609-project Sep 08 11:46:00.349182 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 11:46:00.349182 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 11:46:00.349182 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: f38a21e862664942bf35c93870df1c36 Sep 08 11:46:00.349182 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServerActionsTestJSON-143982609-project Sep 08 11:46:00.349182 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 11:46:00.349182 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 654a0638-6345-4150-9a9b-b58143e2213f could not be found. Sep 08 11:46:00.349182 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '654a0638-6345-4150-9a9b-b58143e2213f'} Sep 08 11:46:00.349182 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:46:00.349182 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:46:00.349182 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:46:00.349182 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:46:00.349182 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:46:00.349182 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:46:00.349182 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:46:00.349182 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:46:00.349182 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:46:00.349182 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:46:00.349182 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 654a0638-6345-4150-9a9b-b58143e2213f could not be found. Sep 08 11:46:00.349182 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:46:00.349182 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:46:00.349182 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:46:00.349182 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:46:00.349182 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:46:00.349182 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:46:00.349182 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:46:00.349182 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:46:00.349182 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:46:00.349182 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:46:00.349182 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 11:46:00.349182 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 11:46:00.349182 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 11:46:00.349182 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 11:46:00.349182 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:46:00.349182 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:46:00.349182 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:46:00.349182 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:46:00.354764 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 654a0638-6345-4150-9a9b-b58143e2213f could not be found. Sep 08 11:46:00.354764 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:46:00.354764 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:46:00.354764 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:46:00.354764 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:46:00.354764 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:46:00.354764 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:46:00.354764 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:46:00.354764 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:46:00.354764 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 654a0638-6345-4150-9a9b-b58143e2213f could not be found. Sep 08 11:46:00.354764 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:46:00.354764 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-58f066da-993a-4f40-9e8d-adda1fcb5869 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Returning 404 to user: Instance 654a0638-6345-4150-9a9b-b58143e2213f could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:46:00.354764 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-58f066da-993a-4f40-9e8d-adda1fcb5869 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "DELETE /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f" status: 404 len: 111 microversion: 2.1 time: 0.030252 Sep 08 11:46:00.354764 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3541/7214] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:46:00 2022] DELETE /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:46:00.359708 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c3ca7205-005c-4ba2-acb4-4f168680915e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:46:00.360343 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c3ca7205-005c-4ba2-acb4-4f168680915e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 654a0638-6345-4150-9a9b-b58143e2213f] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:46:00.366458 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c3ca7205-005c-4ba2-acb4-4f168680915e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:00.366942 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c3ca7205-005c-4ba2-acb4-4f168680915e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:00.367376 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c3ca7205-005c-4ba2-acb4-4f168680915e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:00.368686 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c3ca7205-005c-4ba2-acb4-4f168680915e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:00.369172 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c3ca7205-005c-4ba2-acb4-4f168680915e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:00.369598 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c3ca7205-005c-4ba2-acb4-4f168680915e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:00.382639 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-c3ca7205-005c-4ba2-acb4-4f168680915e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] HTTP exception thrown: Instance 654a0638-6345-4150-9a9b-b58143e2213f could not be found. Sep 08 11:46:00.384291 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c3ca7205-005c-4ba2-acb4-4f168680915e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Request method failure captured: Sep 08 11:46:00.384291 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f HTTP/1.1 Sep 08 11:46:00.384291 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:46:00.384291 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:46:00.384291 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:46:00.384291 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 11:46:00.384291 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:46:00.384291 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:46:00.384291 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:46:00.384291 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:46:00.384291 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGdSDvOwoS57OkYb_-Yl1XUx78kih9MULmYIyzFLt-u36W2wjj2KtWXAZ7aX14KpVLwWCBvBeF4bTqW87i3VTvG-qHq5mt1bIpxmJHowTqwKpzB7zzorSV7BPwI-U0G6PWcbOtFoIJUt5uu58duhf3xUQD9p0cNz13ICJbtKWoYuCsmY Sep 08 11:46:00.384291 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:46:00.384291 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:46:00.384291 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:46:00.384291 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:46:00.384291 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:46:00.384291 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:46:00.384291 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 5e7adfbb1417415b9eafeeb23b7a7c18 Sep 08 11:46:00.384291 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServerActionsTestJSON-143982609 Sep 08 11:46:00.384291 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:46:00.384291 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:46:00.384291 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5e7adfbb1417415b9eafeeb23b7a7c18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5e7adfbb1417415b9eafeeb23b7a7c18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5e7adfbb1417415b9eafeeb23b7a7c18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5e7adfbb1417415b9eafeeb23b7a7c18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:46:00.384291 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServerActionsTestJSON-143982609 Sep 08 11:46:00.384291 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 5e7adfbb1417415b9eafeeb23b7a7c18 Sep 08 11:46:00.384291 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServerActionsTestJSON-143982609 Sep 08 11:46:00.384291 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServerActionsTestJSON-143982609-project Sep 08 11:46:00.384291 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:46:00.384291 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:46:00.384291 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: f38a21e862664942bf35c93870df1c36 Sep 08 11:46:00.384291 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServerActionsTestJSON-143982609-project Sep 08 11:46:00.384291 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 11:46:00.384291 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 654a0638-6345-4150-9a9b-b58143e2213f could not be found. Sep 08 11:46:00.384291 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '654a0638-6345-4150-9a9b-b58143e2213f'} Sep 08 11:46:00.384291 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:46:00.384291 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:46:00.384291 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:46:00.384291 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:46:00.384291 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:46:00.384291 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:46:00.384291 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:46:00.384291 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:46:00.384291 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:46:00.384291 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:46:00.384291 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 654a0638-6345-4150-9a9b-b58143e2213f could not be found. Sep 08 11:46:00.384291 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:46:00.384291 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:46:00.384291 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:46:00.384291 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:46:00.384291 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:46:00.384291 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:46:00.384291 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:46:00.384291 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:46:00.384291 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:46:00.384291 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:46:00.384291 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:46:00.384291 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:46:00.384291 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:46:00.384291 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:46:00.384291 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:46:00.384291 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:46:00.384291 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 654a0638-6345-4150-9a9b-b58143e2213f could not be found. Sep 08 11:46:00.384291 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:46:00.384291 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:46:00.384291 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:46:00.388953 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:46:00.388953 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:46:00.388953 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:46:00.388953 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:46:00.388953 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:46:00.388953 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 654a0638-6345-4150-9a9b-b58143e2213f could not be found. Sep 08 11:46:00.388953 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:46:00.388953 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c3ca7205-005c-4ba2-acb4-4f168680915e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Returning 404 to user: Instance 654a0638-6345-4150-9a9b-b58143e2213f could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:46:00.388953 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c3ca7205-005c-4ba2-acb4-4f168680915e tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f" status: 404 len: 111 microversion: 2.1 time: 0.029855 Sep 08 11:46:00.388953 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3674/7215] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:46:00 2022] GET /compute/v2.1/servers/654a0638-6345-4150-9a9b-b58143e2213f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:46:00.394164 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ff6a6206-107f-4faa-8d24-84ff8ba1f435 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:46:00.394681 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ff6a6206-107f-4faa-8d24-84ff8ba1f435 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 753dbd0e-be58-4254-9250-230a680bbc81] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:46:00.400831 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff6a6206-107f-4faa-8d24-84ff8ba1f435 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:00.401378 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff6a6206-107f-4faa-8d24-84ff8ba1f435 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:00.401840 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff6a6206-107f-4faa-8d24-84ff8ba1f435 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:00.402570 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff6a6206-107f-4faa-8d24-84ff8ba1f435 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:00.403046 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff6a6206-107f-4faa-8d24-84ff8ba1f435 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:00.403495 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff6a6206-107f-4faa-8d24-84ff8ba1f435 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:00.419184 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-ff6a6206-107f-4faa-8d24-84ff8ba1f435 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] HTTP exception thrown: Instance 753dbd0e-be58-4254-9250-230a680bbc81 could not be found. Sep 08 11:46:00.420798 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ff6a6206-107f-4faa-8d24-84ff8ba1f435 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Request method failure captured: Sep 08 11:46:00.420798 n-d-850501-12 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81 HTTP/1.1 Sep 08 11:46:00.420798 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 11:46:00.420798 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 11:46:00.420798 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 11:46:00.420798 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 11:46:00.420798 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 11:46:00.420798 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 11:46:00.420798 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 11:46:00.420798 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 11:46:00.420798 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGdSDvOwoS57OkYb_-Yl1XUx78kih9MULmYIyzFLt-u36W2wjj2KtWXAZ7aX14KpVLwWCBvBeF4bTqW87i3VTvG-qHq5mt1bIpxmJHowTqwKpzB7zzorSV7BPwI-U0G6PWcbOtFoIJUt5uu58duhf3xUQD9p0cNz13ICJbtKWoYuCsmY Sep 08 11:46:00.420798 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 11:46:00.420798 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 11:46:00.420798 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 11:46:00.420798 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 11:46:00.420798 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 11:46:00.420798 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 11:46:00.420798 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 5e7adfbb1417415b9eafeeb23b7a7c18 Sep 08 11:46:00.420798 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServerActionsTestJSON-143982609 Sep 08 11:46:00.420798 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 11:46:00.420798 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 11:46:00.420798 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5e7adfbb1417415b9eafeeb23b7a7c18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5e7adfbb1417415b9eafeeb23b7a7c18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5e7adfbb1417415b9eafeeb23b7a7c18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5e7adfbb1417415b9eafeeb23b7a7c18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:46:00.420798 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServerActionsTestJSON-143982609 Sep 08 11:46:00.420798 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 5e7adfbb1417415b9eafeeb23b7a7c18 Sep 08 11:46:00.420798 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServerActionsTestJSON-143982609 Sep 08 11:46:00.420798 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServerActionsTestJSON-143982609-project Sep 08 11:46:00.420798 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 11:46:00.420798 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 11:46:00.420798 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: f38a21e862664942bf35c93870df1c36 Sep 08 11:46:00.420798 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServerActionsTestJSON-143982609-project Sep 08 11:46:00.420798 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 11:46:00.420798 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 753dbd0e-be58-4254-9250-230a680bbc81 could not be found. Sep 08 11:46:00.420798 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '753dbd0e-be58-4254-9250-230a680bbc81'} Sep 08 11:46:00.420798 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:46:00.420798 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:46:00.420798 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:46:00.420798 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:46:00.420798 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:46:00.420798 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:46:00.420798 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:46:00.420798 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:46:00.420798 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:46:00.420798 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:46:00.420798 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 753dbd0e-be58-4254-9250-230a680bbc81 could not be found. Sep 08 11:46:00.420798 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:46:00.420798 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:46:00.420798 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:46:00.420798 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:46:00.420798 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:46:00.420798 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:46:00.420798 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:46:00.420798 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:46:00.420798 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:46:00.420798 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:46:00.420798 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 11:46:00.420798 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 11:46:00.420798 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 11:46:00.420798 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 11:46:00.420798 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:46:00.420798 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:46:00.420798 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:46:00.420798 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:46:00.425285 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 753dbd0e-be58-4254-9250-230a680bbc81 could not be found. Sep 08 11:46:00.425285 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:46:00.425285 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:46:00.425285 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:46:00.425285 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:46:00.425285 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:46:00.425285 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:46:00.425285 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:46:00.425285 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:46:00.425285 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 753dbd0e-be58-4254-9250-230a680bbc81 could not be found. Sep 08 11:46:00.425285 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:46:00.425285 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ff6a6206-107f-4faa-8d24-84ff8ba1f435 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Returning 404 to user: Instance 753dbd0e-be58-4254-9250-230a680bbc81 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:46:00.425285 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ff6a6206-107f-4faa-8d24-84ff8ba1f435 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "DELETE /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81" status: 404 len: 111 microversion: 2.1 time: 0.032059 Sep 08 11:46:00.425285 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3542/7216] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:46:00 2022] DELETE /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:46:00.431690 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0ee046fe-56cf-434e-8711-8c40368883de tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:46:00.432312 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0ee046fe-56cf-434e-8711-8c40368883de tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: 753dbd0e-be58-4254-9250-230a680bbc81] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:46:00.438660 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0ee046fe-56cf-434e-8711-8c40368883de tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:00.439154 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0ee046fe-56cf-434e-8711-8c40368883de tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:00.439593 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0ee046fe-56cf-434e-8711-8c40368883de tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:00.440308 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0ee046fe-56cf-434e-8711-8c40368883de tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:00.440768 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0ee046fe-56cf-434e-8711-8c40368883de tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:00.441229 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0ee046fe-56cf-434e-8711-8c40368883de tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:00.456335 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-0ee046fe-56cf-434e-8711-8c40368883de tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] HTTP exception thrown: Instance 753dbd0e-be58-4254-9250-230a680bbc81 could not be found. Sep 08 11:46:00.457932 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0ee046fe-56cf-434e-8711-8c40368883de tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Request method failure captured: Sep 08 11:46:00.457932 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81 HTTP/1.1 Sep 08 11:46:00.457932 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:46:00.457932 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:46:00.457932 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:46:00.457932 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 11:46:00.457932 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:46:00.457932 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:46:00.457932 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:46:00.457932 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:46:00.457932 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGdSDvOwoS57OkYb_-Yl1XUx78kih9MULmYIyzFLt-u36W2wjj2KtWXAZ7aX14KpVLwWCBvBeF4bTqW87i3VTvG-qHq5mt1bIpxmJHowTqwKpzB7zzorSV7BPwI-U0G6PWcbOtFoIJUt5uu58duhf3xUQD9p0cNz13ICJbtKWoYuCsmY Sep 08 11:46:00.457932 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:46:00.457932 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:46:00.457932 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:46:00.457932 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:46:00.457932 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:46:00.457932 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:46:00.457932 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 5e7adfbb1417415b9eafeeb23b7a7c18 Sep 08 11:46:00.457932 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServerActionsTestJSON-143982609 Sep 08 11:46:00.457932 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:46:00.457932 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:46:00.457932 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5e7adfbb1417415b9eafeeb23b7a7c18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5e7adfbb1417415b9eafeeb23b7a7c18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5e7adfbb1417415b9eafeeb23b7a7c18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5e7adfbb1417415b9eafeeb23b7a7c18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:46:00.457932 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServerActionsTestJSON-143982609 Sep 08 11:46:00.457932 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 5e7adfbb1417415b9eafeeb23b7a7c18 Sep 08 11:46:00.457932 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServerActionsTestJSON-143982609 Sep 08 11:46:00.457932 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServerActionsTestJSON-143982609-project Sep 08 11:46:00.457932 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:46:00.457932 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:46:00.457932 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: f38a21e862664942bf35c93870df1c36 Sep 08 11:46:00.457932 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServerActionsTestJSON-143982609-project Sep 08 11:46:00.457932 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 11:46:00.457932 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 753dbd0e-be58-4254-9250-230a680bbc81 could not be found. Sep 08 11:46:00.457932 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '753dbd0e-be58-4254-9250-230a680bbc81'} Sep 08 11:46:00.457932 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:46:00.457932 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:46:00.457932 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:46:00.457932 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:46:00.457932 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:46:00.457932 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:46:00.457932 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:46:00.457932 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:46:00.457932 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:46:00.457932 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:46:00.457932 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 753dbd0e-be58-4254-9250-230a680bbc81 could not be found. Sep 08 11:46:00.457932 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:46:00.457932 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:46:00.457932 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:46:00.457932 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:46:00.457932 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:46:00.457932 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:46:00.457932 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:46:00.457932 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:46:00.457932 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:46:00.457932 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:46:00.457932 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:46:00.457932 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:46:00.457932 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:46:00.457932 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:46:00.457932 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:46:00.457932 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:46:00.457932 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 753dbd0e-be58-4254-9250-230a680bbc81 could not be found. Sep 08 11:46:00.457932 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:46:00.457932 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:46:00.457932 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:46:00.464463 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:46:00.464463 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:46:00.464463 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:46:00.464463 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:46:00.464463 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:46:00.464463 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 753dbd0e-be58-4254-9250-230a680bbc81 could not be found. Sep 08 11:46:00.464463 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:46:00.464463 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0ee046fe-56cf-434e-8711-8c40368883de tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Returning 404 to user: Instance 753dbd0e-be58-4254-9250-230a680bbc81 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:46:00.464463 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0ee046fe-56cf-434e-8711-8c40368883de tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81" status: 404 len: 111 microversion: 2.1 time: 0.035324 Sep 08 11:46:00.464463 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3675/7217] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:46:00 2022] GET /compute/v2.1/servers/753dbd0e-be58-4254-9250-230a680bbc81 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:46:00.472131 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-03aa6f02-fc35-44a9-8924-827368d10d52 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:46:00.472781 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-03aa6f02-fc35-44a9-8924-827368d10d52 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: d2b1d042-8a22-4fe2-8b67-03b3376c8ce0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:46:00.480062 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03aa6f02-fc35-44a9-8924-827368d10d52 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:00.480664 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03aa6f02-fc35-44a9-8924-827368d10d52 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:00.481224 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03aa6f02-fc35-44a9-8924-827368d10d52 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:00.482092 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03aa6f02-fc35-44a9-8924-827368d10d52 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:00.482674 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03aa6f02-fc35-44a9-8924-827368d10d52 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:00.483191 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03aa6f02-fc35-44a9-8924-827368d10d52 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:00.498803 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-03aa6f02-fc35-44a9-8924-827368d10d52 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] HTTP exception thrown: Instance d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 could not be found. Sep 08 11:46:00.500520 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-03aa6f02-fc35-44a9-8924-827368d10d52 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Request method failure captured: Sep 08 11:46:00.500520 n-d-850501-12 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 HTTP/1.1 Sep 08 11:46:00.500520 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 11:46:00.500520 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 11:46:00.500520 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 11:46:00.500520 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 11:46:00.500520 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 11:46:00.500520 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 11:46:00.500520 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 11:46:00.500520 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 11:46:00.500520 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGdSDvOwoS57OkYb_-Yl1XUx78kih9MULmYIyzFLt-u36W2wjj2KtWXAZ7aX14KpVLwWCBvBeF4bTqW87i3VTvG-qHq5mt1bIpxmJHowTqwKpzB7zzorSV7BPwI-U0G6PWcbOtFoIJUt5uu58duhf3xUQD9p0cNz13ICJbtKWoYuCsmY Sep 08 11:46:00.500520 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 11:46:00.500520 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 11:46:00.500520 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 11:46:00.500520 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 11:46:00.500520 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 11:46:00.500520 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 11:46:00.500520 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 5e7adfbb1417415b9eafeeb23b7a7c18 Sep 08 11:46:00.500520 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServerActionsTestJSON-143982609 Sep 08 11:46:00.500520 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 11:46:00.500520 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 11:46:00.500520 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5e7adfbb1417415b9eafeeb23b7a7c18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5e7adfbb1417415b9eafeeb23b7a7c18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5e7adfbb1417415b9eafeeb23b7a7c18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5e7adfbb1417415b9eafeeb23b7a7c18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:46:00.500520 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServerActionsTestJSON-143982609 Sep 08 11:46:00.500520 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 5e7adfbb1417415b9eafeeb23b7a7c18 Sep 08 11:46:00.500520 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServerActionsTestJSON-143982609 Sep 08 11:46:00.500520 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServerActionsTestJSON-143982609-project Sep 08 11:46:00.500520 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 11:46:00.500520 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 11:46:00.500520 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: f38a21e862664942bf35c93870df1c36 Sep 08 11:46:00.500520 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServerActionsTestJSON-143982609-project Sep 08 11:46:00.500520 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 11:46:00.500520 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 could not be found. Sep 08 11:46:00.500520 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'd2b1d042-8a22-4fe2-8b67-03b3376c8ce0'} Sep 08 11:46:00.500520 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:46:00.500520 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:46:00.500520 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:46:00.500520 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:46:00.500520 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:46:00.500520 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:46:00.500520 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:46:00.500520 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:46:00.500520 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:46:00.500520 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:46:00.500520 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 could not be found. Sep 08 11:46:00.500520 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:46:00.500520 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:46:00.500520 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:46:00.500520 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:46:00.500520 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:46:00.500520 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:46:00.500520 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:46:00.500520 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:46:00.500520 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:46:00.500520 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:46:00.500520 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 11:46:00.500520 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 11:46:00.500520 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 11:46:00.500520 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 11:46:00.500520 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:46:00.500520 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:46:00.500520 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:46:00.500520 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:46:00.505015 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 could not be found. Sep 08 11:46:00.505015 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:46:00.505015 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:46:00.505015 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:46:00.505015 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:46:00.505015 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:46:00.505015 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:46:00.505015 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:46:00.505015 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:46:00.505015 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 could not be found. Sep 08 11:46:00.505015 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:46:00.505015 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-03aa6f02-fc35-44a9-8924-827368d10d52 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Returning 404 to user: Instance d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:46:00.505015 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-03aa6f02-fc35-44a9-8924-827368d10d52 tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0" status: 404 len: 111 microversion: 2.1 time: 0.035369 Sep 08 11:46:00.509556 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3543/7218] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:46:00 2022] DELETE /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:46:00.514857 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f045a8c1-28eb-4e1c-ac09-f246aea2c32a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:46:00.515468 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f045a8c1-28eb-4e1c-ac09-f246aea2c32a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [instance: d2b1d042-8a22-4fe2-8b67-03b3376c8ce0] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:46:00.521523 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f045a8c1-28eb-4e1c-ac09-f246aea2c32a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:00.521946 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f045a8c1-28eb-4e1c-ac09-f246aea2c32a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:00.522378 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f045a8c1-28eb-4e1c-ac09-f246aea2c32a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:00.523062 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f045a8c1-28eb-4e1c-ac09-f246aea2c32a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:00.523514 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f045a8c1-28eb-4e1c-ac09-f246aea2c32a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:00.524590 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f045a8c1-28eb-4e1c-ac09-f246aea2c32a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:00.538319 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-f045a8c1-28eb-4e1c-ac09-f246aea2c32a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] HTTP exception thrown: Instance d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 could not be found. Sep 08 11:46:00.540579 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f045a8c1-28eb-4e1c-ac09-f246aea2c32a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Request method failure captured: Sep 08 11:46:00.540579 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 HTTP/1.1 Sep 08 11:46:00.540579 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:46:00.540579 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:46:00.540579 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:46:00.540579 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 11:46:00.540579 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:46:00.540579 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:46:00.540579 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:46:00.540579 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:46:00.540579 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGdSDvOwoS57OkYb_-Yl1XUx78kih9MULmYIyzFLt-u36W2wjj2KtWXAZ7aX14KpVLwWCBvBeF4bTqW87i3VTvG-qHq5mt1bIpxmJHowTqwKpzB7zzorSV7BPwI-U0G6PWcbOtFoIJUt5uu58duhf3xUQD9p0cNz13ICJbtKWoYuCsmY Sep 08 11:46:00.540579 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:46:00.540579 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:46:00.540579 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:46:00.540579 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:46:00.540579 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:46:00.540579 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:46:00.540579 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 5e7adfbb1417415b9eafeeb23b7a7c18 Sep 08 11:46:00.540579 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServerActionsTestJSON-143982609 Sep 08 11:46:00.540579 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:46:00.540579 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:46:00.540579 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5e7adfbb1417415b9eafeeb23b7a7c18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5e7adfbb1417415b9eafeeb23b7a7c18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5e7adfbb1417415b9eafeeb23b7a7c18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5e7adfbb1417415b9eafeeb23b7a7c18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:46:00.540579 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServerActionsTestJSON-143982609 Sep 08 11:46:00.540579 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 5e7adfbb1417415b9eafeeb23b7a7c18 Sep 08 11:46:00.540579 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServerActionsTestJSON-143982609 Sep 08 11:46:00.540579 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServerActionsTestJSON-143982609-project Sep 08 11:46:00.540579 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:46:00.540579 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:46:00.540579 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: f38a21e862664942bf35c93870df1c36 Sep 08 11:46:00.540579 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServerActionsTestJSON-143982609-project Sep 08 11:46:00.540579 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 11:46:00.540579 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 could not be found. Sep 08 11:46:00.540579 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': 'd2b1d042-8a22-4fe2-8b67-03b3376c8ce0'} Sep 08 11:46:00.540579 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:46:00.540579 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:46:00.540579 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:46:00.540579 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:46:00.540579 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:46:00.540579 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:46:00.540579 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:46:00.540579 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:46:00.540579 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:46:00.540579 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:46:00.540579 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 could not be found. Sep 08 11:46:00.540579 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:46:00.540579 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:46:00.540579 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:46:00.540579 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:46:00.540579 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:46:00.540579 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:46:00.540579 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:46:00.540579 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:46:00.540579 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:46:00.540579 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:46:00.540579 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:46:00.540579 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:46:00.540579 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:46:00.540579 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:46:00.540579 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:46:00.540579 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:46:00.540579 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 could not be found. Sep 08 11:46:00.540579 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:46:00.540579 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:46:00.540579 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:46:00.545541 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:46:00.545541 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:46:00.545541 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:46:00.545541 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:46:00.545541 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:46:00.545541 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 could not be found. Sep 08 11:46:00.545541 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:46:00.545541 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f045a8c1-28eb-4e1c-ac09-f246aea2c32a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Returning 404 to user: Instance d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:46:00.545541 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f045a8c1-28eb-4e1c-ac09-f246aea2c32a tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0" status: 404 len: 111 microversion: 2.1 time: 0.030957 Sep 08 11:46:00.545541 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3676/7219] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:46:00 2022] GET /compute/v2.1/servers/d2b1d042-8a22-4fe2-8b67-03b3376c8ce0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:46:00.551058 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5fa29f3d-bdec-4411-8285-15eab157afca tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] Calling method '.version_select at 0x7f68e4ba78b0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:46:00.556283 n-d-850501-12 devstack@n-api.service[128862]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5fa29f3d-bdec-4411-8285-15eab157afca tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [b0c801de-0373-4c4c-89db-ae41eb7b49ab] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 08 11:46:01.563183 n-d-850501-12 devstack@n-api.service[128862]: INFO oslo.messaging._drivers.impl_rabbit [None req-5fa29f3d-bdec-4411-8285-15eab157afca tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] [b0c801de-0373-4c4c-89db-ae41eb7b49ab] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 42236. Sep 08 11:46:01.585623 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5fa29f3d-bdec-4411-8285-15eab157afca tempest-ServerActionsTestJSON-143982609 tempest-ServerActionsTestJSON-143982609-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1229154192" status: 202 len: 0 microversion: 2.1 time: 1.038388 Sep 08 11:46:01.586707 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3544/7220] 10.222.0.27 () {58 vars in 1221 bytes} [Thu Sep 8 11:46:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1229154192 => generated 0 bytes in 1040 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:46:10.981633 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=11 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:46:10.982387 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=25 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:46:11.104584 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c3b35041-273b-41be-8044-9e1fa65ae084 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-885542028", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "49031c68-d900-4b67-84d8-802d4fb4206f"}]}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:46:11.169847 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-c3b35041-273b-41be-8044-9e1fa65ae084 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] validate_networks() for [('49031c68-d900-4b67-84d8-802d4fb4206f', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:46:11.557720 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-c3b35041-273b-41be-8044-9e1fa65ae084 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:46:11.558144 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-c3b35041-273b-41be-8044-9e1fa65ae084 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:46:11.558616 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-c3b35041-273b-41be-8044-9e1fa65ae084 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:46:11.559031 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-c3b35041-273b-41be-8044-9e1fa65ae084 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:46:11.559471 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-c3b35041-273b-41be-8044-9e1fa65ae084 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:46:11.568734 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c3b35041-273b-41be-8044-9e1fa65ae084 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:11.569256 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c3b35041-273b-41be-8044-9e1fa65ae084 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:11.569695 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c3b35041-273b-41be-8044-9e1fa65ae084 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:11.571044 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c3b35041-273b-41be-8044-9e1fa65ae084 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:11.571660 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c3b35041-273b-41be-8044-9e1fa65ae084 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:11.572074 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c3b35041-273b-41be-8044-9e1fa65ae084 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:11.589268 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-c3b35041-273b-41be-8044-9e1fa65ae084 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Getting quotas for project 400495b89ad44cbcaa9a1a25844f04f3. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:46:11.594403 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-c3b35041-273b-41be-8044-9e1fa65ae084 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Getting quotas for user 8b307070f23b4be285fc50bd6303b827 and project 400495b89ad44cbcaa9a1a25844f04f3. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:46:11.606807 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c3b35041-273b-41be-8044-9e1fa65ae084 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:46:11.609122 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c3b35041-273b-41be-8044-9e1fa65ae084 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] [instance: b3cba6d4-25c2-4038-aef4-06b5bdf303e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:46:11.657201 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c3b35041-273b-41be-8044-9e1fa65ae084 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.681694 Sep 08 11:46:11.657863 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3677/7221] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 11:46:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 683 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:46:11.666959 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=35 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:46:11.667907 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:46:11.672603 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-89067b51-d83f-4acd-a8e3-97a37ea8b3c4 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:46:11.673260 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-89067b51-d83f-4acd-a8e3-97a37ea8b3c4 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] [instance: b3cba6d4-25c2-4038-aef4-06b5bdf303e4] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:46:11.729136 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-89067b51-d83f-4acd-a8e3-97a37ea8b3c4 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b307070f23b4be285fc50bd6303b827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400495b89ad44cbcaa9a1a25844f04f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:46:11.736696 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-89067b51-d83f-4acd-a8e3-97a37ea8b3c4 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] 10.222.0.27 "GET /compute/v2.1/servers/b3cba6d4-25c2-4038-aef4-06b5bdf303e4" status: 200 len: 1216 microversion: 2.1 time: 0.071357 Sep 08 11:46:11.738575 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3545/7222] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:46:11 2022] GET /compute/v2.1/servers/b3cba6d4-25c2-4038-aef4-06b5bdf303e4 => generated 1216 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:46:12.763886 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-96de0a44-1cfe-457f-a08c-3d1ceaa97a83 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:46:12.764637 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-96de0a44-1cfe-457f-a08c-3d1ceaa97a83 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] [instance: b3cba6d4-25c2-4038-aef4-06b5bdf303e4] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:46:12.824017 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-96de0a44-1cfe-457f-a08c-3d1ceaa97a83 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b307070f23b4be285fc50bd6303b827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400495b89ad44cbcaa9a1a25844f04f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:46:12.831410 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-96de0a44-1cfe-457f-a08c-3d1ceaa97a83 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] 10.222.0.27 "GET /compute/v2.1/servers/b3cba6d4-25c2-4038-aef4-06b5bdf303e4" status: 200 len: 1216 microversion: 2.1 time: 0.075240 Sep 08 11:46:12.832122 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3678/7223] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:46:12 2022] GET /compute/v2.1/servers/b3cba6d4-25c2-4038-aef4-06b5bdf303e4 => generated 1216 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:46:13.854645 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-faabc782-493a-4b47-8503-1dea79d0caae tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:46:13.855884 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-faabc782-493a-4b47-8503-1dea79d0caae tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] [instance: b3cba6d4-25c2-4038-aef4-06b5bdf303e4] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:46:13.922797 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-faabc782-493a-4b47-8503-1dea79d0caae tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b307070f23b4be285fc50bd6303b827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400495b89ad44cbcaa9a1a25844f04f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:46:13.931727 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-faabc782-493a-4b47-8503-1dea79d0caae tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] 10.222.0.27 "GET /compute/v2.1/servers/b3cba6d4-25c2-4038-aef4-06b5bdf303e4" status: 200 len: 1216 microversion: 2.1 time: 0.081358 Sep 08 11:46:13.932329 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3546/7224] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:46:13 2022] GET /compute/v2.1/servers/b3cba6d4-25c2-4038-aef4-06b5bdf303e4 => generated 1216 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:46:14.954797 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-76e091b8-72b1-4425-905f-f068b4415b86 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:46:14.955417 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-76e091b8-72b1-4425-905f-f068b4415b86 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] [instance: b3cba6d4-25c2-4038-aef4-06b5bdf303e4] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:46:15.013826 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-76e091b8-72b1-4425-905f-f068b4415b86 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b307070f23b4be285fc50bd6303b827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400495b89ad44cbcaa9a1a25844f04f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:46:15.021131 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-76e091b8-72b1-4425-905f-f068b4415b86 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] 10.222.0.27 "GET /compute/v2.1/servers/b3cba6d4-25c2-4038-aef4-06b5bdf303e4" status: 200 len: 1216 microversion: 2.1 time: 0.070235 Sep 08 11:46:15.036175 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3679/7225] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:46:14 2022] GET /compute/v2.1/servers/b3cba6d4-25c2-4038-aef4-06b5bdf303e4 => generated 1216 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:46:16.050274 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-df4775ca-fefa-47d1-98f6-f8105932a099 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:46:16.050911 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-df4775ca-fefa-47d1-98f6-f8105932a099 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] [instance: b3cba6d4-25c2-4038-aef4-06b5bdf303e4] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:46:16.058003 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df4775ca-fefa-47d1-98f6-f8105932a099 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:16.058580 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df4775ca-fefa-47d1-98f6-f8105932a099 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:16.059276 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df4775ca-fefa-47d1-98f6-f8105932a099 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:16.060058 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df4775ca-fefa-47d1-98f6-f8105932a099 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:16.060681 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df4775ca-fefa-47d1-98f6-f8105932a099 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:16.061248 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df4775ca-fefa-47d1-98f6-f8105932a099 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:16.124602 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-df4775ca-fefa-47d1-98f6-f8105932a099 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b307070f23b4be285fc50bd6303b827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400495b89ad44cbcaa9a1a25844f04f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:46:16.132381 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-df4775ca-fefa-47d1-98f6-f8105932a099 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] 10.222.0.27 "GET /compute/v2.1/servers/b3cba6d4-25c2-4038-aef4-06b5bdf303e4" status: 200 len: 1220 microversion: 2.1 time: 0.092355 Sep 08 11:46:16.133581 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3547/7226] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:46:16 2022] GET /compute/v2.1/servers/b3cba6d4-25c2-4038-aef4-06b5bdf303e4 => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:46:17.155901 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cebe55e3-2ce2-4274-9252-1cf01cb1e8c0 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:46:17.156647 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cebe55e3-2ce2-4274-9252-1cf01cb1e8c0 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] [instance: b3cba6d4-25c2-4038-aef4-06b5bdf303e4] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:46:17.165050 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cebe55e3-2ce2-4274-9252-1cf01cb1e8c0 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:17.165578 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cebe55e3-2ce2-4274-9252-1cf01cb1e8c0 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:17.166044 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cebe55e3-2ce2-4274-9252-1cf01cb1e8c0 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:17.167341 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cebe55e3-2ce2-4274-9252-1cf01cb1e8c0 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:17.167838 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cebe55e3-2ce2-4274-9252-1cf01cb1e8c0 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:17.168273 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cebe55e3-2ce2-4274-9252-1cf01cb1e8c0 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:17.246789 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-cebe55e3-2ce2-4274-9252-1cf01cb1e8c0 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b307070f23b4be285fc50bd6303b827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400495b89ad44cbcaa9a1a25844f04f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:46:17.254456 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cebe55e3-2ce2-4274-9252-1cf01cb1e8c0 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] 10.222.0.27 "GET /compute/v2.1/servers/b3cba6d4-25c2-4038-aef4-06b5bdf303e4" status: 200 len: 1274 microversion: 2.1 time: 0.102632 Sep 08 11:46:17.255023 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3680/7227] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:46:17 2022] GET /compute/v2.1/servers/b3cba6d4-25c2-4038-aef4-06b5bdf303e4 => generated 1274 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:46:18.256053 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-f65ad021-56c2-400e-a22b-8000666c9447 req-c613926d-a2c7-429f-8e82-47b0176995de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3cba6d4-25c2-4038-aef4-06b5bdf303e4", "tag": "25e688b9-2ff7-4b46-bd05-1c6106a86865"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:46:18.267011 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-f65ad021-56c2-400e-a22b-8000666c9447 req-c613926d-a2c7-429f-8e82-47b0176995de service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:18.267673 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-f65ad021-56c2-400e-a22b-8000666c9447 req-c613926d-a2c7-429f-8e82-47b0176995de service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:18.268333 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-f65ad021-56c2-400e-a22b-8000666c9447 req-c613926d-a2c7-429f-8e82-47b0176995de service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:18.278614 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4d442162-bf18-465b-98fc-3d678034ee07 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:46:18.279917 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4d442162-bf18-465b-98fc-3d678034ee07 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] [instance: b3cba6d4-25c2-4038-aef4-06b5bdf303e4] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:46:18.280758 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-f65ad021-56c2-400e-a22b-8000666c9447 req-c613926d-a2c7-429f-8e82-47b0176995de service nova] Creating event network-changed:25e688b9-2ff7-4b46-bd05-1c6106a86865 for instance b3cba6d4-25c2-4038-aef4-06b5bdf303e4 on n-h1-850501-12 Sep 08 11:46:18.286992 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-f65ad021-56c2-400e-a22b-8000666c9447 req-c613926d-a2c7-429f-8e82-47b0176995de service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103335 Sep 08 11:46:18.287178 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4d442162-bf18-465b-98fc-3d678034ee07 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:18.287778 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4d442162-bf18-465b-98fc-3d678034ee07 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:18.288284 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4d442162-bf18-465b-98fc-3d678034ee07 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:18.288549 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3548/7228] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:46:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:46:18.290037 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4d442162-bf18-465b-98fc-3d678034ee07 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:18.290640 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4d442162-bf18-465b-98fc-3d678034ee07 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:18.291226 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4d442162-bf18-465b-98fc-3d678034ee07 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:18.491053 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4d442162-bf18-465b-98fc-3d678034ee07 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b307070f23b4be285fc50bd6303b827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400495b89ad44cbcaa9a1a25844f04f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:46:18.499561 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4d442162-bf18-465b-98fc-3d678034ee07 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] 10.222.0.27 "GET /compute/v2.1/servers/b3cba6d4-25c2-4038-aef4-06b5bdf303e4" status: 200 len: 1316 microversion: 2.1 time: 0.225146 Sep 08 11:46:18.500146 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3681/7229] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:46:18 2022] GET /compute/v2.1/servers/b3cba6d4-25c2-4038-aef4-06b5bdf303e4 => generated 1316 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:46:19.524460 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b8bad834-5583-4932-be20-45df747a7024 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:46:19.525288 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b8bad834-5583-4932-be20-45df747a7024 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] [instance: b3cba6d4-25c2-4038-aef4-06b5bdf303e4] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:46:19.532756 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8bad834-5583-4932-be20-45df747a7024 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:19.533299 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8bad834-5583-4932-be20-45df747a7024 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:19.533754 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8bad834-5583-4932-be20-45df747a7024 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:19.534471 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8bad834-5583-4932-be20-45df747a7024 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:19.534950 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8bad834-5583-4932-be20-45df747a7024 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:19.535389 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8bad834-5583-4932-be20-45df747a7024 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:19.677355 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b8bad834-5583-4932-be20-45df747a7024 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b307070f23b4be285fc50bd6303b827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400495b89ad44cbcaa9a1a25844f04f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:46:19.687709 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b8bad834-5583-4932-be20-45df747a7024 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] 10.222.0.27 "GET /compute/v2.1/servers/b3cba6d4-25c2-4038-aef4-06b5bdf303e4" status: 200 len: 1316 microversion: 2.1 time: 0.167835 Sep 08 11:46:19.688420 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3549/7230] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:46:19 2022] GET /compute/v2.1/servers/b3cba6d4-25c2-4038-aef4-06b5bdf303e4 => generated 1316 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:46:20.710798 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7c80a866-42f1-47a0-9eb3-d8a82dfa3e82 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:46:20.712075 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7c80a866-42f1-47a0-9eb3-d8a82dfa3e82 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] [instance: b3cba6d4-25c2-4038-aef4-06b5bdf303e4] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:46:20.719478 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c80a866-42f1-47a0-9eb3-d8a82dfa3e82 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:20.720033 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c80a866-42f1-47a0-9eb3-d8a82dfa3e82 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:20.720581 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c80a866-42f1-47a0-9eb3-d8a82dfa3e82 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:20.721464 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c80a866-42f1-47a0-9eb3-d8a82dfa3e82 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:20.722022 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c80a866-42f1-47a0-9eb3-d8a82dfa3e82 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:20.722550 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c80a866-42f1-47a0-9eb3-d8a82dfa3e82 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:20.862027 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7c80a866-42f1-47a0-9eb3-d8a82dfa3e82 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b307070f23b4be285fc50bd6303b827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400495b89ad44cbcaa9a1a25844f04f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:46:20.870973 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7c80a866-42f1-47a0-9eb3-d8a82dfa3e82 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] 10.222.0.27 "GET /compute/v2.1/servers/b3cba6d4-25c2-4038-aef4-06b5bdf303e4" status: 200 len: 1316 microversion: 2.1 time: 0.164214 Sep 08 11:46:20.871557 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3682/7231] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:46:20 2022] GET /compute/v2.1/servers/b3cba6d4-25c2-4038-aef4-06b5bdf303e4 => generated 1316 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:46:21.894810 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7639c8a3-a15b-4737-bab4-dced04badcdb tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:46:21.895445 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7639c8a3-a15b-4737-bab4-dced04badcdb tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] [instance: b3cba6d4-25c2-4038-aef4-06b5bdf303e4] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:46:21.903426 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7639c8a3-a15b-4737-bab4-dced04badcdb tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:21.903927 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7639c8a3-a15b-4737-bab4-dced04badcdb tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:21.904378 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7639c8a3-a15b-4737-bab4-dced04badcdb tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:21.905112 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7639c8a3-a15b-4737-bab4-dced04badcdb tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:21.905581 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7639c8a3-a15b-4737-bab4-dced04badcdb tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:21.906019 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7639c8a3-a15b-4737-bab4-dced04badcdb tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:22.037604 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7639c8a3-a15b-4737-bab4-dced04badcdb tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b307070f23b4be285fc50bd6303b827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400495b89ad44cbcaa9a1a25844f04f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:46:22.046207 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7639c8a3-a15b-4737-bab4-dced04badcdb tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] 10.222.0.27 "GET /compute/v2.1/servers/b3cba6d4-25c2-4038-aef4-06b5bdf303e4" status: 200 len: 1316 microversion: 2.1 time: 0.155349 Sep 08 11:46:22.046820 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3550/7232] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:46:21 2022] GET /compute/v2.1/servers/b3cba6d4-25c2-4038-aef4-06b5bdf303e4 => generated 1316 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:46:22.631118 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-ce34b83d-a472-4aae-a450-a5e41709730d req-b025c0f2-47f0-4960-b25c-790fe502f400 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3cba6d4-25c2-4038-aef4-06b5bdf303e4", "name": "network-vif-plugged", "status": "completed", "tag": "25e688b9-2ff7-4b46-bd05-1c6106a86865"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:46:22.638927 n-d-850501-12 devstack@n-api.service[128861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 11:46:22.639071 n-d-850501-12 devstack@n-api.service[128861]: Thu Sep 8 11:46:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.27) !!! Sep 08 11:46:22.641202 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:46:22.652815 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-ce34b83d-a472-4aae-a450-a5e41709730d req-b025c0f2-47f0-4960-b25c-790fe502f400 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:22.653333 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-ce34b83d-a472-4aae-a450-a5e41709730d req-b025c0f2-47f0-4960-b25c-790fe502f400 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:22.653767 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-ce34b83d-a472-4aae-a450-a5e41709730d req-b025c0f2-47f0-4960-b25c-790fe502f400 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:22.666219 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-ce34b83d-a472-4aae-a450-a5e41709730d req-b025c0f2-47f0-4960-b25c-790fe502f400 service nova] Creating event network-vif-plugged:25e688b9-2ff7-4b46-bd05-1c6106a86865 for instance b3cba6d4-25c2-4038-aef4-06b5bdf303e4 on n-h1-850501-12 Sep 08 11:46:22.671221 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-ce34b83d-a472-4aae-a450-a5e41709730d req-b025c0f2-47f0-4960-b25c-790fe502f400 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043898 Sep 08 11:46:22.671827 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3683/7233] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:46:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:46:23.069535 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fa802640-2d21-42c5-ac49-96b775229c55 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:46:23.070193 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fa802640-2d21-42c5-ac49-96b775229c55 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] [instance: b3cba6d4-25c2-4038-aef4-06b5bdf303e4] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:46:23.078017 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fa802640-2d21-42c5-ac49-96b775229c55 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:23.078521 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fa802640-2d21-42c5-ac49-96b775229c55 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:23.078968 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fa802640-2d21-42c5-ac49-96b775229c55 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:23.079687 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fa802640-2d21-42c5-ac49-96b775229c55 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:23.080153 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fa802640-2d21-42c5-ac49-96b775229c55 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:23.080588 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fa802640-2d21-42c5-ac49-96b775229c55 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:23.228403 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fa802640-2d21-42c5-ac49-96b775229c55 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b307070f23b4be285fc50bd6303b827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400495b89ad44cbcaa9a1a25844f04f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:46:23.236488 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fa802640-2d21-42c5-ac49-96b775229c55 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] 10.222.0.27 "GET /compute/v2.1/servers/b3cba6d4-25c2-4038-aef4-06b5bdf303e4" status: 200 len: 1316 microversion: 2.1 time: 0.171170 Sep 08 11:46:23.237095 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3551/7234] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:46:23 2022] GET /compute/v2.1/servers/b3cba6d4-25c2-4038-aef4-06b5bdf303e4 => generated 1316 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:46:24.261871 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0ea1949b-97b7-4337-a4da-c065a46c27d3 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:46:24.262574 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0ea1949b-97b7-4337-a4da-c065a46c27d3 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] [instance: b3cba6d4-25c2-4038-aef4-06b5bdf303e4] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:46:24.268816 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0ea1949b-97b7-4337-a4da-c065a46c27d3 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:24.269343 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0ea1949b-97b7-4337-a4da-c065a46c27d3 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:24.269785 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0ea1949b-97b7-4337-a4da-c065a46c27d3 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:24.270480 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0ea1949b-97b7-4337-a4da-c065a46c27d3 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:24.270938 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0ea1949b-97b7-4337-a4da-c065a46c27d3 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:24.271368 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0ea1949b-97b7-4337-a4da-c065a46c27d3 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:24.407095 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0ea1949b-97b7-4337-a4da-c065a46c27d3 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b307070f23b4be285fc50bd6303b827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400495b89ad44cbcaa9a1a25844f04f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:46:24.414906 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0ea1949b-97b7-4337-a4da-c065a46c27d3 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] 10.222.0.27 "GET /compute/v2.1/servers/b3cba6d4-25c2-4038-aef4-06b5bdf303e4" status: 200 len: 1506 microversion: 2.1 time: 0.158905 Sep 08 11:46:24.416267 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3684/7235] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:46:24 2022] GET /compute/v2.1/servers/b3cba6d4-25c2-4038-aef4-06b5bdf303e4 => generated 1506 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:46:24.477413 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fa0c3de1-05c8-48df-a0a7-3bda972cbf75 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-279170140", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "49031c68-d900-4b67-84d8-802d4fb4206f"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:46:24.486494 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=4 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:46:24.532943 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-fa0c3de1-05c8-48df-a0a7-3bda972cbf75 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] validate_networks() for [('49031c68-d900-4b67-84d8-802d4fb4206f', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:46:24.952871 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-fa0c3de1-05c8-48df-a0a7-3bda972cbf75 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:46:24.953338 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-fa0c3de1-05c8-48df-a0a7-3bda972cbf75 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:46:24.953826 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-fa0c3de1-05c8-48df-a0a7-3bda972cbf75 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:46:24.954245 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-fa0c3de1-05c8-48df-a0a7-3bda972cbf75 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:46:24.954668 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-fa0c3de1-05c8-48df-a0a7-3bda972cbf75 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:46:24.964219 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fa0c3de1-05c8-48df-a0a7-3bda972cbf75 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:24.964714 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fa0c3de1-05c8-48df-a0a7-3bda972cbf75 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:24.965195 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fa0c3de1-05c8-48df-a0a7-3bda972cbf75 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:24.965938 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fa0c3de1-05c8-48df-a0a7-3bda972cbf75 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:24.966405 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fa0c3de1-05c8-48df-a0a7-3bda972cbf75 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:24.966843 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fa0c3de1-05c8-48df-a0a7-3bda972cbf75 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:24.983185 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-fa0c3de1-05c8-48df-a0a7-3bda972cbf75 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Getting quotas for project 400495b89ad44cbcaa9a1a25844f04f3. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:46:24.988383 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-fa0c3de1-05c8-48df-a0a7-3bda972cbf75 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Getting quotas for user 8b307070f23b4be285fc50bd6303b827 and project 400495b89ad44cbcaa9a1a25844f04f3. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:46:25.001102 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fa0c3de1-05c8-48df-a0a7-3bda972cbf75 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:46:25.003387 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fa0c3de1-05c8-48df-a0a7-3bda972cbf75 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] [instance: 207b751f-ecbf-48c1-ba1f-c40883dcd4f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:46:25.049197 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fa0c3de1-05c8-48df-a0a7-3bda972cbf75 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.575591 Sep 08 11:46:25.049867 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3552/7236] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 11:46:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 577 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:46:25.061361 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fd039a82-cd9d-4fc4-bf44-064329e564b8 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:46:25.062143 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fd039a82-cd9d-4fc4-bf44-064329e564b8 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] [instance: 207b751f-ecbf-48c1-ba1f-c40883dcd4f1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:46:25.064454 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=10 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:46:25.122958 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-fd039a82-cd9d-4fc4-bf44-064329e564b8 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b307070f23b4be285fc50bd6303b827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400495b89ad44cbcaa9a1a25844f04f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:46:25.130430 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fd039a82-cd9d-4fc4-bf44-064329e564b8 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] 10.222.0.27 "GET /compute/v2.1/servers/207b751f-ecbf-48c1-ba1f-c40883dcd4f1" status: 200 len: 1216 microversion: 2.1 time: 0.073093 Sep 08 11:46:25.131207 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3685/7237] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:46:25 2022] GET /compute/v2.1/servers/207b751f-ecbf-48c1-ba1f-c40883dcd4f1 => generated 1216 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:46:26.156107 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b9d43667-4c14-4827-bac4-1b8da6d7e364 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:46:26.156653 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b9d43667-4c14-4827-bac4-1b8da6d7e364 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] [instance: 207b751f-ecbf-48c1-ba1f-c40883dcd4f1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:46:26.164585 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b9d43667-4c14-4827-bac4-1b8da6d7e364 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:26.164846 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b9d43667-4c14-4827-bac4-1b8da6d7e364 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:26.166038 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b9d43667-4c14-4827-bac4-1b8da6d7e364 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:26.167141 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b9d43667-4c14-4827-bac4-1b8da6d7e364 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:26.167628 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b9d43667-4c14-4827-bac4-1b8da6d7e364 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:26.168147 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b9d43667-4c14-4827-bac4-1b8da6d7e364 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:26.239625 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b9d43667-4c14-4827-bac4-1b8da6d7e364 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b307070f23b4be285fc50bd6303b827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400495b89ad44cbcaa9a1a25844f04f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:46:26.248890 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b9d43667-4c14-4827-bac4-1b8da6d7e364 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] 10.222.0.27 "GET /compute/v2.1/servers/207b751f-ecbf-48c1-ba1f-c40883dcd4f1" status: 200 len: 1276 microversion: 2.1 time: 0.098235 Sep 08 11:46:26.255774 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3553/7238] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:46:26 2022] GET /compute/v2.1/servers/207b751f-ecbf-48c1-ba1f-c40883dcd4f1 => generated 1276 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:46:27.272201 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6f12af8d-5a75-4de5-8255-3a299354651f tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:46:27.273116 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6f12af8d-5a75-4de5-8255-3a299354651f tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] [instance: 207b751f-ecbf-48c1-ba1f-c40883dcd4f1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:46:27.280925 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6f12af8d-5a75-4de5-8255-3a299354651f tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:27.281456 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6f12af8d-5a75-4de5-8255-3a299354651f tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:27.281898 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6f12af8d-5a75-4de5-8255-3a299354651f tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:27.282600 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6f12af8d-5a75-4de5-8255-3a299354651f tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:27.283093 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6f12af8d-5a75-4de5-8255-3a299354651f tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:27.283521 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6f12af8d-5a75-4de5-8255-3a299354651f tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:27.518258 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6f12af8d-5a75-4de5-8255-3a299354651f tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b307070f23b4be285fc50bd6303b827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400495b89ad44cbcaa9a1a25844f04f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:46:27.527000 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6f12af8d-5a75-4de5-8255-3a299354651f tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] 10.222.0.27 "GET /compute/v2.1/servers/207b751f-ecbf-48c1-ba1f-c40883dcd4f1" status: 200 len: 1316 microversion: 2.1 time: 0.258717 Sep 08 11:46:27.527607 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3686/7239] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:46:27 2022] GET /compute/v2.1/servers/207b751f-ecbf-48c1-ba1f-c40883dcd4f1 => generated 1316 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:46:27.914752 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-3dc45b96-3415-4bcd-98b8-a94ee6919781 req-d4e09191-ee62-46b0-a7eb-8a48e5f2851b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "207b751f-ecbf-48c1-ba1f-c40883dcd4f1", "tag": "0e68e5bc-d048-4c28-a0d2-9ed95e27ab02"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:46:27.928399 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-3dc45b96-3415-4bcd-98b8-a94ee6919781 req-d4e09191-ee62-46b0-a7eb-8a48e5f2851b service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:27.928911 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-3dc45b96-3415-4bcd-98b8-a94ee6919781 req-d4e09191-ee62-46b0-a7eb-8a48e5f2851b service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:27.929398 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-3dc45b96-3415-4bcd-98b8-a94ee6919781 req-d4e09191-ee62-46b0-a7eb-8a48e5f2851b service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:27.945105 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-3dc45b96-3415-4bcd-98b8-a94ee6919781 req-d4e09191-ee62-46b0-a7eb-8a48e5f2851b service nova] Creating event network-changed:0e68e5bc-d048-4c28-a0d2-9ed95e27ab02 for instance 207b751f-ecbf-48c1-ba1f-c40883dcd4f1 on n-h2-850501-12 Sep 08 11:46:27.952307 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-3dc45b96-3415-4bcd-98b8-a94ee6919781 req-d4e09191-ee62-46b0-a7eb-8a48e5f2851b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041832 Sep 08 11:46:27.953201 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3554/7240] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:46:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:46:28.550205 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ad183387-ab7f-444a-988b-628438762bd8 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:46:28.550815 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ad183387-ab7f-444a-988b-628438762bd8 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] [instance: 207b751f-ecbf-48c1-ba1f-c40883dcd4f1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:46:28.558477 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ad183387-ab7f-444a-988b-628438762bd8 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:28.558970 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ad183387-ab7f-444a-988b-628438762bd8 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:28.559413 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ad183387-ab7f-444a-988b-628438762bd8 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:28.560117 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ad183387-ab7f-444a-988b-628438762bd8 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:28.560577 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ad183387-ab7f-444a-988b-628438762bd8 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:28.561003 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ad183387-ab7f-444a-988b-628438762bd8 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:28.698845 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ad183387-ab7f-444a-988b-628438762bd8 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b307070f23b4be285fc50bd6303b827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400495b89ad44cbcaa9a1a25844f04f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:46:28.706565 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ad183387-ab7f-444a-988b-628438762bd8 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] 10.222.0.27 "GET /compute/v2.1/servers/207b751f-ecbf-48c1-ba1f-c40883dcd4f1" status: 200 len: 1316 microversion: 2.1 time: 0.160273 Sep 08 11:46:28.707127 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3687/7241] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:46:28 2022] GET /compute/v2.1/servers/207b751f-ecbf-48c1-ba1f-c40883dcd4f1 => generated 1316 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:46:29.732189 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cf37ca97-cb82-444a-9c2d-a2470a9ae33f tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:46:29.732915 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cf37ca97-cb82-444a-9c2d-a2470a9ae33f tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] [instance: 207b751f-ecbf-48c1-ba1f-c40883dcd4f1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:46:29.739971 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cf37ca97-cb82-444a-9c2d-a2470a9ae33f tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:29.740480 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cf37ca97-cb82-444a-9c2d-a2470a9ae33f tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:29.740941 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cf37ca97-cb82-444a-9c2d-a2470a9ae33f tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:29.741687 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cf37ca97-cb82-444a-9c2d-a2470a9ae33f tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:29.742162 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cf37ca97-cb82-444a-9c2d-a2470a9ae33f tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:29.742609 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cf37ca97-cb82-444a-9c2d-a2470a9ae33f tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:29.875695 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cf37ca97-cb82-444a-9c2d-a2470a9ae33f tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b307070f23b4be285fc50bd6303b827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400495b89ad44cbcaa9a1a25844f04f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:46:29.885875 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cf37ca97-cb82-444a-9c2d-a2470a9ae33f tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] 10.222.0.27 "GET /compute/v2.1/servers/207b751f-ecbf-48c1-ba1f-c40883dcd4f1" status: 200 len: 1316 microversion: 2.1 time: 0.158895 Sep 08 11:46:29.886462 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3555/7242] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:46:29 2022] GET /compute/v2.1/servers/207b751f-ecbf-48c1-ba1f-c40883dcd4f1 => generated 1316 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:46:30.907853 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5fb323e3-7afb-4905-9406-893aaf4b57a0 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:46:30.908474 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5fb323e3-7afb-4905-9406-893aaf4b57a0 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] [instance: 207b751f-ecbf-48c1-ba1f-c40883dcd4f1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:46:30.915968 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5fb323e3-7afb-4905-9406-893aaf4b57a0 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:30.916452 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5fb323e3-7afb-4905-9406-893aaf4b57a0 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:30.916886 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5fb323e3-7afb-4905-9406-893aaf4b57a0 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:30.917614 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5fb323e3-7afb-4905-9406-893aaf4b57a0 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:30.918068 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5fb323e3-7afb-4905-9406-893aaf4b57a0 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:30.918495 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5fb323e3-7afb-4905-9406-893aaf4b57a0 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:31.053313 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5fb323e3-7afb-4905-9406-893aaf4b57a0 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b307070f23b4be285fc50bd6303b827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400495b89ad44cbcaa9a1a25844f04f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:46:31.061047 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5fb323e3-7afb-4905-9406-893aaf4b57a0 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] 10.222.0.27 "GET /compute/v2.1/servers/207b751f-ecbf-48c1-ba1f-c40883dcd4f1" status: 200 len: 1316 microversion: 2.1 time: 0.157185 Sep 08 11:46:31.061632 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3688/7243] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:46:30 2022] GET /compute/v2.1/servers/207b751f-ecbf-48c1-ba1f-c40883dcd4f1 => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:46:32.083259 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7e237459-a350-4f78-b616-c423ec9ba8ec tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:46:32.083875 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7e237459-a350-4f78-b616-c423ec9ba8ec tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] [instance: 207b751f-ecbf-48c1-ba1f-c40883dcd4f1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:46:32.091106 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e237459-a350-4f78-b616-c423ec9ba8ec tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:32.091616 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e237459-a350-4f78-b616-c423ec9ba8ec tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:32.092074 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e237459-a350-4f78-b616-c423ec9ba8ec tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:32.092796 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e237459-a350-4f78-b616-c423ec9ba8ec tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:32.093301 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e237459-a350-4f78-b616-c423ec9ba8ec tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:32.093751 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e237459-a350-4f78-b616-c423ec9ba8ec tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:32.153693 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-b2b0e625-84bf-4f79-9d8f-59e43835facb req-8d0b7ea1-bc61-4cbe-8acf-51139cde82c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "207b751f-ecbf-48c1-ba1f-c40883dcd4f1", "name": "network-vif-plugged", "status": "completed", "tag": "0e68e5bc-d048-4c28-a0d2-9ed95e27ab02"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:46:32.166463 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-b2b0e625-84bf-4f79-9d8f-59e43835facb req-8d0b7ea1-bc61-4cbe-8acf-51139cde82c0 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:32.167195 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-b2b0e625-84bf-4f79-9d8f-59e43835facb req-8d0b7ea1-bc61-4cbe-8acf-51139cde82c0 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:32.167930 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-b2b0e625-84bf-4f79-9d8f-59e43835facb req-8d0b7ea1-bc61-4cbe-8acf-51139cde82c0 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:32.180130 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-b2b0e625-84bf-4f79-9d8f-59e43835facb req-8d0b7ea1-bc61-4cbe-8acf-51139cde82c0 service nova] Creating event network-vif-plugged:0e68e5bc-d048-4c28-a0d2-9ed95e27ab02 for instance 207b751f-ecbf-48c1-ba1f-c40883dcd4f1 on n-h2-850501-12 Sep 08 11:46:32.186925 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-b2b0e625-84bf-4f79-9d8f-59e43835facb req-8d0b7ea1-bc61-4cbe-8acf-51139cde82c0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037017 Sep 08 11:46:32.187711 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3689/7244] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:46:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:46:32.239742 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7e237459-a350-4f78-b616-c423ec9ba8ec tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b307070f23b4be285fc50bd6303b827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400495b89ad44cbcaa9a1a25844f04f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:46:32.248659 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7e237459-a350-4f78-b616-c423ec9ba8ec tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] 10.222.0.27 "GET /compute/v2.1/servers/207b751f-ecbf-48c1-ba1f-c40883dcd4f1" status: 200 len: 1316 microversion: 2.1 time: 0.169220 Sep 08 11:46:32.249308 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3556/7245] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:46:32 2022] GET /compute/v2.1/servers/207b751f-ecbf-48c1-ba1f-c40883dcd4f1 => generated 1316 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:46:33.272124 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-dd86b210-1e52-47f4-bc25-8a8f89e20fe6 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:46:33.272827 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-dd86b210-1e52-47f4-bc25-8a8f89e20fe6 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] [instance: 207b751f-ecbf-48c1-ba1f-c40883dcd4f1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:46:33.279840 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd86b210-1e52-47f4-bc25-8a8f89e20fe6 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:33.280334 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd86b210-1e52-47f4-bc25-8a8f89e20fe6 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:33.281805 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd86b210-1e52-47f4-bc25-8a8f89e20fe6 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:33.282527 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd86b210-1e52-47f4-bc25-8a8f89e20fe6 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:33.282996 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd86b210-1e52-47f4-bc25-8a8f89e20fe6 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:33.283440 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd86b210-1e52-47f4-bc25-8a8f89e20fe6 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:33.423053 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-dd86b210-1e52-47f4-bc25-8a8f89e20fe6 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b307070f23b4be285fc50bd6303b827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400495b89ad44cbcaa9a1a25844f04f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:46:33.431413 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-dd86b210-1e52-47f4-bc25-8a8f89e20fe6 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] 10.222.0.27 "GET /compute/v2.1/servers/207b751f-ecbf-48c1-ba1f-c40883dcd4f1" status: 200 len: 1316 microversion: 2.1 time: 0.164225 Sep 08 11:46:33.432278 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3690/7246] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:46:33 2022] GET /compute/v2.1/servers/207b751f-ecbf-48c1-ba1f-c40883dcd4f1 => generated 1316 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:46:34.455227 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2157a2b6-e351-4be5-a19d-befa18ba9d39 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:46:34.456083 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2157a2b6-e351-4be5-a19d-befa18ba9d39 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] [instance: 207b751f-ecbf-48c1-ba1f-c40883dcd4f1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:46:34.463178 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2157a2b6-e351-4be5-a19d-befa18ba9d39 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:34.463735 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2157a2b6-e351-4be5-a19d-befa18ba9d39 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:34.464252 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2157a2b6-e351-4be5-a19d-befa18ba9d39 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:34.465195 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2157a2b6-e351-4be5-a19d-befa18ba9d39 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:34.465912 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2157a2b6-e351-4be5-a19d-befa18ba9d39 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:34.466297 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2157a2b6-e351-4be5-a19d-befa18ba9d39 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:34.611496 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2157a2b6-e351-4be5-a19d-befa18ba9d39 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b307070f23b4be285fc50bd6303b827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400495b89ad44cbcaa9a1a25844f04f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:46:34.620780 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2157a2b6-e351-4be5-a19d-befa18ba9d39 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] 10.222.0.27 "GET /compute/v2.1/servers/207b751f-ecbf-48c1-ba1f-c40883dcd4f1" status: 200 len: 1506 microversion: 2.1 time: 0.169546 Sep 08 11:46:34.621416 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3557/7247] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:46:34 2022] GET /compute/v2.1/servers/207b751f-ecbf-48c1-ba1f-c40883dcd4f1 => generated 1506 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:46:34.643252 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-efe7e071-738f-4b08-858e-e155f2cb8514 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:46:34.643815 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-efe7e071-738f-4b08-858e-e155f2cb8514 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] [instance: 207b751f-ecbf-48c1-ba1f-c40883dcd4f1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:46:34.651340 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-efe7e071-738f-4b08-858e-e155f2cb8514 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:34.651820 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-efe7e071-738f-4b08-858e-e155f2cb8514 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:34.652252 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-efe7e071-738f-4b08-858e-e155f2cb8514 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:34.652950 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-efe7e071-738f-4b08-858e-e155f2cb8514 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:34.653434 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-efe7e071-738f-4b08-858e-e155f2cb8514 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:34.653857 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-efe7e071-738f-4b08-858e-e155f2cb8514 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:34.679720 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-efe7e071-738f-4b08-858e-e155f2cb8514 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] [instance: 207b751f-ecbf-48c1-ba1f-c40883dcd4f1] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:46:34.758052 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-efe7e071-738f-4b08-858e-e155f2cb8514 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] 10.222.0.27 "DELETE /compute/v2.1/servers/207b751f-ecbf-48c1-ba1f-c40883dcd4f1" status: 204 len: 0 microversion: 2.1 time: 0.118217 Sep 08 11:46:34.758909 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3691/7248] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:46:34 2022] DELETE /compute/v2.1/servers/207b751f-ecbf-48c1-ba1f-c40883dcd4f1 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 11:46:34.770879 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-25eccbea-3c31-475f-9fe9-59cb2387d9e3 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:46:34.771805 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-25eccbea-3c31-475f-9fe9-59cb2387d9e3 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] [instance: 207b751f-ecbf-48c1-ba1f-c40883dcd4f1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:46:34.781229 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25eccbea-3c31-475f-9fe9-59cb2387d9e3 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:34.782014 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25eccbea-3c31-475f-9fe9-59cb2387d9e3 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:34.782755 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25eccbea-3c31-475f-9fe9-59cb2387d9e3 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:34.783850 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25eccbea-3c31-475f-9fe9-59cb2387d9e3 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:34.785440 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25eccbea-3c31-475f-9fe9-59cb2387d9e3 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:34.786095 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25eccbea-3c31-475f-9fe9-59cb2387d9e3 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:34.948466 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-25eccbea-3c31-475f-9fe9-59cb2387d9e3 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b307070f23b4be285fc50bd6303b827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400495b89ad44cbcaa9a1a25844f04f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:46:34.956507 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-25eccbea-3c31-475f-9fe9-59cb2387d9e3 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] 10.222.0.27 "GET /compute/v2.1/servers/207b751f-ecbf-48c1-ba1f-c40883dcd4f1" status: 200 len: 1512 microversion: 2.1 time: 0.192521 Sep 08 11:46:34.957161 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3558/7249] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:46:34 2022] GET /compute/v2.1/servers/207b751f-ecbf-48c1-ba1f-c40883dcd4f1 => generated 1512 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:46:35.981236 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2eb970a0-671c-4c5e-92b8-f070dbe0bd30 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:46:35.982026 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2eb970a0-671c-4c5e-92b8-f070dbe0bd30 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] [instance: 207b751f-ecbf-48c1-ba1f-c40883dcd4f1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:46:35.983889 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:46:35.990795 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2eb970a0-671c-4c5e-92b8-f070dbe0bd30 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:35.991283 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2eb970a0-671c-4c5e-92b8-f070dbe0bd30 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:35.991723 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2eb970a0-671c-4c5e-92b8-f070dbe0bd30 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:35.992418 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2eb970a0-671c-4c5e-92b8-f070dbe0bd30 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:35.993539 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2eb970a0-671c-4c5e-92b8-f070dbe0bd30 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:35.993959 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2eb970a0-671c-4c5e-92b8-f070dbe0bd30 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:36.127544 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2eb970a0-671c-4c5e-92b8-f070dbe0bd30 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b307070f23b4be285fc50bd6303b827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400495b89ad44cbcaa9a1a25844f04f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:46:36.135441 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2eb970a0-671c-4c5e-92b8-f070dbe0bd30 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] 10.222.0.27 "GET /compute/v2.1/servers/207b751f-ecbf-48c1-ba1f-c40883dcd4f1" status: 200 len: 1512 microversion: 2.1 time: 0.159217 Sep 08 11:46:36.136020 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3692/7250] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:46:35 2022] GET /compute/v2.1/servers/207b751f-ecbf-48c1-ba1f-c40883dcd4f1 => generated 1512 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:46:36.635887 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-dd4d72d6-4840-4ca0-8b65-829bc0f993f1 req-0907efa9-5e22-4942-9b45-cbecf045dc6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "207b751f-ecbf-48c1-ba1f-c40883dcd4f1", "name": "network-vif-deleted", "tag": "0e68e5bc-d048-4c28-a0d2-9ed95e27ab02"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:46:36.641829 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:46:36.643190 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:46:36.652697 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-dd4d72d6-4840-4ca0-8b65-829bc0f993f1 req-0907efa9-5e22-4942-9b45-cbecf045dc6e service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:36.653722 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-dd4d72d6-4840-4ca0-8b65-829bc0f993f1 req-0907efa9-5e22-4942-9b45-cbecf045dc6e service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:36.654370 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-dd4d72d6-4840-4ca0-8b65-829bc0f993f1 req-0907efa9-5e22-4942-9b45-cbecf045dc6e service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:36.673437 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-dd4d72d6-4840-4ca0-8b65-829bc0f993f1 req-0907efa9-5e22-4942-9b45-cbecf045dc6e service nova] Creating event network-vif-deleted:0e68e5bc-d048-4c28-a0d2-9ed95e27ab02 for instance 207b751f-ecbf-48c1-ba1f-c40883dcd4f1 on n-h2-850501-12 Sep 08 11:46:36.686581 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-dd4d72d6-4840-4ca0-8b65-829bc0f993f1 req-0907efa9-5e22-4942-9b45-cbecf045dc6e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054971 Sep 08 11:46:36.687205 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3559/7251] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:46:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:46:37.159404 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e63e3a7d-c137-4a9b-bc9b-818ec79ef7d0 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:46:37.160001 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e63e3a7d-c137-4a9b-bc9b-818ec79ef7d0 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] [instance: 207b751f-ecbf-48c1-ba1f-c40883dcd4f1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:46:37.167246 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e63e3a7d-c137-4a9b-bc9b-818ec79ef7d0 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:37.167744 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e63e3a7d-c137-4a9b-bc9b-818ec79ef7d0 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:37.168208 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e63e3a7d-c137-4a9b-bc9b-818ec79ef7d0 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:37.168915 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e63e3a7d-c137-4a9b-bc9b-818ec79ef7d0 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:37.169429 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e63e3a7d-c137-4a9b-bc9b-818ec79ef7d0 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:37.169865 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e63e3a7d-c137-4a9b-bc9b-818ec79ef7d0 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:37.205596 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e63e3a7d-c137-4a9b-bc9b-818ec79ef7d0 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:37.206480 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e63e3a7d-c137-4a9b-bc9b-818ec79ef7d0 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:37.207157 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e63e3a7d-c137-4a9b-bc9b-818ec79ef7d0 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:37.207795 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-e63e3a7d-c137-4a9b-bc9b-818ec79ef7d0 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lazy-loading 'fault' on Instance uuid 207b751f-ecbf-48c1-ba1f-c40883dcd4f1 {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:46:37.254409 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e63e3a7d-c137-4a9b-bc9b-818ec79ef7d0 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b307070f23b4be285fc50bd6303b827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400495b89ad44cbcaa9a1a25844f04f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:46:37.262585 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e63e3a7d-c137-4a9b-bc9b-818ec79ef7d0 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] 10.222.0.27 "GET /compute/v2.1/servers/207b751f-ecbf-48c1-ba1f-c40883dcd4f1" status: 200 len: 1306 microversion: 2.1 time: 0.107230 Sep 08 11:46:37.263207 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3693/7252] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:46:37 2022] GET /compute/v2.1/servers/207b751f-ecbf-48c1-ba1f-c40883dcd4f1 => generated 1306 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:46:38.297302 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-227a08c0-c971-48a3-9105-1e2d490aea06 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:46:38.298027 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-227a08c0-c971-48a3-9105-1e2d490aea06 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] [instance: 207b751f-ecbf-48c1-ba1f-c40883dcd4f1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:46:38.304471 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-227a08c0-c971-48a3-9105-1e2d490aea06 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:38.304965 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-227a08c0-c971-48a3-9105-1e2d490aea06 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:38.306077 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-227a08c0-c971-48a3-9105-1e2d490aea06 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:38.306843 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-227a08c0-c971-48a3-9105-1e2d490aea06 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:38.307317 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-227a08c0-c971-48a3-9105-1e2d490aea06 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:38.307759 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-227a08c0-c971-48a3-9105-1e2d490aea06 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:38.321219 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-227a08c0-c971-48a3-9105-1e2d490aea06 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] HTTP exception thrown: Instance 207b751f-ecbf-48c1-ba1f-c40883dcd4f1 could not be found. Sep 08 11:46:38.322825 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-227a08c0-c971-48a3-9105-1e2d490aea06 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Request method failure captured: Sep 08 11:46:38.322825 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/207b751f-ecbf-48c1-ba1f-c40883dcd4f1 HTTP/1.1 Sep 08 11:46:38.322825 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 11:46:38.322825 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 11:46:38.322825 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 11:46:38.322825 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 11:46:38.322825 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 11:46:38.322825 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 11:46:38.322825 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 11:46:38.322825 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 11:46:38.322825 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGdYCnAkTIisfwqserMQTRR_BRp7nXTqwzh7nOvRZh-cTJdNTrRqnhBXAn-HIWbuGTezIBNuDK2dJXyH7zoeVzZgcRXiotyp3pS5LQ9IYowTw86HqZ_wNh2APl0fm1MktnCBKC_0bJIDDleCVUERy9asMj_HMxpo6aHM2cYWEiwbQ5qE Sep 08 11:46:38.322825 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 11:46:38.322825 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 11:46:38.322825 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 11:46:38.322825 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 11:46:38.322825 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 11:46:38.322825 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 11:46:38.322825 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 400495b89ad44cbcaa9a1a25844f04f3 Sep 08 11:46:38.322825 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersNegativeTestJSON-957841266 Sep 08 11:46:38.322825 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 11:46:38.322825 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 11:46:38.322825 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/400495b89ad44cbcaa9a1a25844f04f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/400495b89ad44cbcaa9a1a25844f04f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_400495b89ad44cbcaa9a1a25844f04f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/400495b89ad44cbcaa9a1a25844f04f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:46:38.322825 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServersNegativeTestJSON-957841266 Sep 08 11:46:38.322825 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 400495b89ad44cbcaa9a1a25844f04f3 Sep 08 11:46:38.322825 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersNegativeTestJSON-957841266 Sep 08 11:46:38.322825 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServersNegativeTestJSON-957841266-project Sep 08 11:46:38.322825 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 11:46:38.322825 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 11:46:38.322825 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 8b307070f23b4be285fc50bd6303b827 Sep 08 11:46:38.322825 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServersNegativeTestJSON-957841266-project Sep 08 11:46:38.322825 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 11:46:38.322825 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 207b751f-ecbf-48c1-ba1f-c40883dcd4f1 could not be found. Sep 08 11:46:38.322825 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '207b751f-ecbf-48c1-ba1f-c40883dcd4f1'} Sep 08 11:46:38.322825 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:46:38.322825 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:46:38.322825 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:46:38.322825 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:46:38.322825 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:46:38.322825 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:46:38.322825 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:46:38.322825 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:46:38.322825 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:46:38.322825 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:46:38.322825 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 207b751f-ecbf-48c1-ba1f-c40883dcd4f1 could not be found. Sep 08 11:46:38.322825 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:46:38.322825 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:46:38.322825 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:46:38.322825 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:46:38.322825 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:46:38.322825 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:46:38.322825 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:46:38.322825 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:46:38.322825 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:46:38.322825 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:46:38.322825 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:46:38.322825 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:46:38.322825 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:46:38.322825 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:46:38.322825 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:46:38.322825 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:46:38.322825 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 207b751f-ecbf-48c1-ba1f-c40883dcd4f1 could not be found. Sep 08 11:46:38.322825 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:46:38.322825 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:46:38.322825 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:46:38.328195 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:46:38.328195 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:46:38.328195 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:46:38.328195 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:46:38.328195 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:46:38.328195 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 207b751f-ecbf-48c1-ba1f-c40883dcd4f1 could not be found. Sep 08 11:46:38.328195 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:46:38.328195 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-227a08c0-c971-48a3-9105-1e2d490aea06 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Returning 404 to user: Instance 207b751f-ecbf-48c1-ba1f-c40883dcd4f1 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:46:38.328195 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-227a08c0-c971-48a3-9105-1e2d490aea06 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] 10.222.0.27 "GET /compute/v2.1/servers/207b751f-ecbf-48c1-ba1f-c40883dcd4f1" status: 404 len: 111 microversion: 2.1 time: 0.032086 Sep 08 11:46:38.328195 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3560/7253] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:46:38 2022] GET /compute/v2.1/servers/207b751f-ecbf-48c1-ba1f-c40883dcd4f1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 11:46:38.336574 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-eb6124a4-32b4-4417-9b57-3a06b72ad365 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:46:38.337590 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-eb6124a4-32b4-4417-9b57-3a06b72ad365 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] [instance: b3cba6d4-25c2-4038-aef4-06b5bdf303e4] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:46:38.345396 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eb6124a4-32b4-4417-9b57-3a06b72ad365 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:38.346281 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eb6124a4-32b4-4417-9b57-3a06b72ad365 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:38.346281 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eb6124a4-32b4-4417-9b57-3a06b72ad365 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:38.347485 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eb6124a4-32b4-4417-9b57-3a06b72ad365 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:38.347485 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eb6124a4-32b4-4417-9b57-3a06b72ad365 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:38.348558 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eb6124a4-32b4-4417-9b57-3a06b72ad365 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:38.481310 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-eb6124a4-32b4-4417-9b57-3a06b72ad365 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b307070f23b4be285fc50bd6303b827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400495b89ad44cbcaa9a1a25844f04f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:46:38.489289 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-eb6124a4-32b4-4417-9b57-3a06b72ad365 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] 10.222.0.27 "GET /compute/v2.1/servers/b3cba6d4-25c2-4038-aef4-06b5bdf303e4" status: 200 len: 1506 microversion: 2.1 time: 0.158621 Sep 08 11:46:38.489858 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3694/7254] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:46:38 2022] GET /compute/v2.1/servers/b3cba6d4-25c2-4038-aef4-06b5bdf303e4 => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:46:38.512602 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e4017882-99e7-4d50-926f-72cac10f0295 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:46:38.514883 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e4017882-99e7-4d50-926f-72cac10f0295 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] [instance: 12bca809-a462-45c1-a79f-fa4001402c4a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:46:38.520323 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-e4017882-99e7-4d50-926f-72cac10f0295 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] HTTP exception thrown: Instance 12bca809-a462-45c1-a79f-fa4001402c4a could not be found. Sep 08 11:46:38.521911 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e4017882-99e7-4d50-926f-72cac10f0295 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Request method failure captured: Sep 08 11:46:38.521911 n-d-850501-12 devstack@n-api.service[128862]: request: POST /compute/v2.1/servers/12bca809-a462-45c1-a79f-fa4001402c4a/action HTTP/1.1 Sep 08 11:46:38.521911 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 11:46:38.521911 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 11:46:38.521911 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 11:46:38.521911 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 32 Sep 08 11:46:38.521911 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 11:46:38.521911 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 11:46:38.521911 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 11:46:38.521911 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 11:46:38.521911 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGdYCnAkTIisfwqserMQTRR_BRp7nXTqwzh7nOvRZh-cTJdNTrRqnhBXAn-HIWbuGTezIBNuDK2dJXyH7zoeVzZgcRXiotyp3pS5LQ9IYowTw86HqZ_wNh2APl0fm1MktnCBKC_0bJIDDleCVUERy9asMj_HMxpo6aHM2cYWEiwbQ5qE Sep 08 11:46:38.521911 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 11:46:38.521911 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 11:46:38.521911 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 11:46:38.521911 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 11:46:38.521911 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 11:46:38.521911 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 11:46:38.521911 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 400495b89ad44cbcaa9a1a25844f04f3 Sep 08 11:46:38.521911 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersNegativeTestJSON-957841266 Sep 08 11:46:38.521911 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 11:46:38.521911 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 11:46:38.521911 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/400495b89ad44cbcaa9a1a25844f04f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/400495b89ad44cbcaa9a1a25844f04f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_400495b89ad44cbcaa9a1a25844f04f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/400495b89ad44cbcaa9a1a25844f04f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:46:38.521911 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServersNegativeTestJSON-957841266 Sep 08 11:46:38.521911 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 400495b89ad44cbcaa9a1a25844f04f3 Sep 08 11:46:38.521911 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersNegativeTestJSON-957841266 Sep 08 11:46:38.521911 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServersNegativeTestJSON-957841266-project Sep 08 11:46:38.521911 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 11:46:38.521911 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 11:46:38.521911 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 8b307070f23b4be285fc50bd6303b827 Sep 08 11:46:38.521911 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServersNegativeTestJSON-957841266-project Sep 08 11:46:38.521911 n-d-850501-12 devstack@n-api.service[128862]: Sep 08 11:46:38.521911 n-d-850501-12 devstack@n-api.service[128862]: {"resize": {"flavorRef": "452"}} Sep 08 11:46:38.521911 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 11:46:38.521911 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 12bca809-a462-45c1-a79f-fa4001402c4a could not be found. Sep 08 11:46:38.521911 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '12bca809-a462-45c1-a79f-fa4001402c4a', 'body': {'resize': {'flavorRef': '452'}}} Sep 08 11:46:38.521911 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:46:38.521911 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:46:38.521911 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:46:38.521911 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:46:38.521911 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:46:38.521911 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:46:38.521911 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 08 11:46:38.521911 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 08 11:46:38.521911 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12bca809-a462-45c1-a79f-fa4001402c4a could not be found. Sep 08 11:46:38.521911 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:46:38.521911 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:46:38.521911 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:46:38.521911 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:46:38.521911 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:46:38.521911 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:46:38.521911 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:46:38.521911 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:46:38.521911 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:46:38.521911 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:46:38.521911 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 11:46:38.521911 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 11:46:38.521911 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 08 11:46:38.521911 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 08 11:46:38.521911 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Sep 08 11:46:38.521911 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Sep 08 11:46:38.521911 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:46:38.521911 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:46:38.521911 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:46:38.521911 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:46:38.527161 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12bca809-a462-45c1-a79f-fa4001402c4a could not be found. Sep 08 11:46:38.527161 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:46:38.527161 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:46:38.527161 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:46:38.527161 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:46:38.527161 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:46:38.527161 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:46:38.527161 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:46:38.527161 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:46:38.527161 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12bca809-a462-45c1-a79f-fa4001402c4a could not be found. Sep 08 11:46:38.527161 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:46:38.527161 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e4017882-99e7-4d50-926f-72cac10f0295 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Returning 404 to user: Instance 12bca809-a462-45c1-a79f-fa4001402c4a could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:46:38.527161 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e4017882-99e7-4d50-926f-72cac10f0295 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] 10.222.0.27 "POST /compute/v2.1/servers/12bca809-a462-45c1-a79f-fa4001402c4a/action" status: 404 len: 111 microversion: 2.1 time: 0.015407 Sep 08 11:46:38.527161 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3561/7255] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 11:46:38 2022] POST /compute/v2.1/servers/12bca809-a462-45c1-a79f-fa4001402c4a/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:46:38.532913 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0416439d-d227-4fb3-9e3d-79e9ecab7b50 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:46:38.533585 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0416439d-d227-4fb3-9e3d-79e9ecab7b50 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] [instance: b3cba6d4-25c2-4038-aef4-06b5bdf303e4] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:46:38.539701 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0416439d-d227-4fb3-9e3d-79e9ecab7b50 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:38.540196 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0416439d-d227-4fb3-9e3d-79e9ecab7b50 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:38.540642 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0416439d-d227-4fb3-9e3d-79e9ecab7b50 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:38.541371 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0416439d-d227-4fb3-9e3d-79e9ecab7b50 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:38.541836 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0416439d-d227-4fb3-9e3d-79e9ecab7b50 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:38.542267 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0416439d-d227-4fb3-9e3d-79e9ecab7b50 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:38.687027 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0416439d-d227-4fb3-9e3d-79e9ecab7b50 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b307070f23b4be285fc50bd6303b827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400495b89ad44cbcaa9a1a25844f04f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:46:38.695134 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0416439d-d227-4fb3-9e3d-79e9ecab7b50 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] 10.222.0.27 "GET /compute/v2.1/servers/b3cba6d4-25c2-4038-aef4-06b5bdf303e4" status: 200 len: 1506 microversion: 2.1 time: 0.167175 Sep 08 11:46:38.695715 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3695/7256] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:46:38 2022] GET /compute/v2.1/servers/b3cba6d4-25c2-4038-aef4-06b5bdf303e4 => generated 1506 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:46:38.718955 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bdc5f6c0-e657-4548-9a08-7d4523c3d9d5 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:46:38.719582 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bdc5f6c0-e657-4548-9a08-7d4523c3d9d5 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] [instance: b3cba6d4-25c2-4038-aef4-06b5bdf303e4] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:46:38.727046 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bdc5f6c0-e657-4548-9a08-7d4523c3d9d5 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:38.728203 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bdc5f6c0-e657-4548-9a08-7d4523c3d9d5 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:38.728750 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bdc5f6c0-e657-4548-9a08-7d4523c3d9d5 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:38.729514 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bdc5f6c0-e657-4548-9a08-7d4523c3d9d5 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:38.729987 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bdc5f6c0-e657-4548-9a08-7d4523c3d9d5 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:38.730436 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bdc5f6c0-e657-4548-9a08-7d4523c3d9d5 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:38.871792 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bdc5f6c0-e657-4548-9a08-7d4523c3d9d5 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b307070f23b4be285fc50bd6303b827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400495b89ad44cbcaa9a1a25844f04f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:46:38.879664 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bdc5f6c0-e657-4548-9a08-7d4523c3d9d5 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] 10.222.0.27 "GET /compute/v2.1/servers/b3cba6d4-25c2-4038-aef4-06b5bdf303e4" status: 200 len: 1506 microversion: 2.1 time: 0.164682 Sep 08 11:46:38.880216 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3562/7257] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:46:38 2022] GET /compute/v2.1/servers/b3cba6d4-25c2-4038-aef4-06b5bdf303e4 => generated 1506 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:46:38.903684 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5a95e4d0-65b9-4948-ada1-a318012189cb tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "aef8db3d-d73b-4f4b-b5cb-fe359e16f394"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:46:38.905975 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5a95e4d0-65b9-4948-ada1-a318012189cb tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] [instance: b3cba6d4-25c2-4038-aef4-06b5bdf303e4] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:46:38.911995 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5a95e4d0-65b9-4948-ada1-a318012189cb tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:38.912485 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5a95e4d0-65b9-4948-ada1-a318012189cb tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:38.913042 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5a95e4d0-65b9-4948-ada1-a318012189cb tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:38.913745 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5a95e4d0-65b9-4948-ada1-a318012189cb tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:38.914201 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5a95e4d0-65b9-4948-ada1-a318012189cb tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:38.914639 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5a95e4d0-65b9-4948-ada1-a318012189cb tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:38.947058 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:46:38.950635 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5a95e4d0-65b9-4948-ada1-a318012189cb tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '8b307070f23b4be285fc50bd6303b827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400495b89ad44cbcaa9a1a25844f04f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:46:38.956611 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-5a95e4d0-65b9-4948-ada1-a318012189cb tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] HTTP exception thrown: Flavor aef8db3d-d73b-4f4b-b5cb-fe359e16f394 could not be found. Sep 08 11:46:38.958602 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5a95e4d0-65b9-4948-ada1-a318012189cb tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Request method failure captured: Sep 08 11:46:38.958602 n-d-850501-12 devstack@n-api.service[128861]: request: POST /compute/v2.1/servers/b3cba6d4-25c2-4038-aef4-06b5bdf303e4/action HTTP/1.1 Sep 08 11:46:38.958602 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:46:38.958602 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:46:38.958602 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:46:38.958602 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 65 Sep 08 11:46:38.958602 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:46:38.958602 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:46:38.958602 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:46:38.958602 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:46:38.958602 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGdYCnAkTIisfwqserMQTRR_BRp7nXTqwzh7nOvRZh-cTJdNTrRqnhBXAn-HIWbuGTezIBNuDK2dJXyH7zoeVzZgcRXiotyp3pS5LQ9IYowTw86HqZ_wNh2APl0fm1MktnCBKC_0bJIDDleCVUERy9asMj_HMxpo6aHM2cYWEiwbQ5qE Sep 08 11:46:38.958602 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:46:38.958602 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:46:38.958602 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:46:38.958602 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:46:38.958602 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:46:38.958602 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:46:38.958602 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 400495b89ad44cbcaa9a1a25844f04f3 Sep 08 11:46:38.958602 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServersNegativeTestJSON-957841266 Sep 08 11:46:38.958602 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:46:38.958602 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:46:38.958602 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/400495b89ad44cbcaa9a1a25844f04f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/400495b89ad44cbcaa9a1a25844f04f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_400495b89ad44cbcaa9a1a25844f04f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/400495b89ad44cbcaa9a1a25844f04f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:46:38.958602 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServersNegativeTestJSON-957841266 Sep 08 11:46:38.958602 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 400495b89ad44cbcaa9a1a25844f04f3 Sep 08 11:46:38.958602 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServersNegativeTestJSON-957841266 Sep 08 11:46:38.958602 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServersNegativeTestJSON-957841266-project Sep 08 11:46:38.958602 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:46:38.958602 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:46:38.958602 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 8b307070f23b4be285fc50bd6303b827 Sep 08 11:46:38.958602 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServersNegativeTestJSON-957841266-project Sep 08 11:46:38.958602 n-d-850501-12 devstack@n-api.service[128861]: Sep 08 11:46:38.958602 n-d-850501-12 devstack@n-api.service[128861]: {"resize": {"flavorRef": "aef8db3d-d73b-4f4b-b5cb-fe359e16f394"}} Sep 08 11:46:38.958602 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 11:46:38.958602 n-d-850501-12 devstack@n-api.service[128861]: exception: Flavor aef8db3d-d73b-4f4b-b5cb-fe359e16f394 could not be found. Sep 08 11:46:38.958602 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': 'b3cba6d4-25c2-4038-aef4-06b5bdf303e4', 'body': {'resize': {'flavorRef': 'aef8db3d-d73b-4f4b-b5cb-fe359e16f394'}}} Sep 08 11:46:38.958602 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:46:38.958602 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:46:38.958602 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Sep 08 11:46:38.958602 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Sep 08 11:46:38.958602 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 08 11:46:38.958602 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 11:46:38.958602 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 08 11:46:38.958602 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 08 11:46:38.958602 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 08 11:46:38.958602 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 08 11:46:38.958602 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 11:46:38.958602 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 11:46:38.958602 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 08 11:46:38.958602 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 08 11:46:38.958602 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 08 11:46:38.958602 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 11:46:38.958602 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4200, in resize Sep 08 11:46:38.958602 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Sep 08 11:46:38.958602 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 08 11:46:38.958602 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 08 11:46:38.958602 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 11:46:38.958602 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 11:46:38.958602 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 08 11:46:38.958602 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 08 11:46:38.958602 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 08 11:46:38.958602 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:46:38.958602 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 08 11:46:38.974042 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 08 11:46:38.974042 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor aef8db3d-d73b-4f4b-b5cb-fe359e16f394 could not be found. Sep 08 11:46:38.974042 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:46:38.974042 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:46:38.974042 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:46:38.974042 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:46:38.974042 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:46:38.974042 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:46:38.974042 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:46:38.974042 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:46:38.974042 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:46:38.974042 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:46:38.974042 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 11:46:38.974042 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 11:46:38.974042 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 08 11:46:38.974042 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 08 11:46:38.974042 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Sep 08 11:46:38.974042 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 08 11:46:38.974042 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor aef8db3d-d73b-4f4b-b5cb-fe359e16f394 could not be found. Sep 08 11:46:38.974042 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:46:38.974042 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:46:38.974042 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:46:38.974042 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:46:38.974042 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:46:38.974042 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:46:38.974042 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:46:38.974042 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:46:38.974042 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor aef8db3d-d73b-4f4b-b5cb-fe359e16f394 could not be found. Sep 08 11:46:38.974042 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:46:38.974042 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5a95e4d0-65b9-4948-ada1-a318012189cb tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Returning 400 to user: Flavor aef8db3d-d73b-4f4b-b5cb-fe359e16f394 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:46:38.974042 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5a95e4d0-65b9-4948-ada1-a318012189cb tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] 10.222.0.27 "POST /compute/v2.1/servers/b3cba6d4-25c2-4038-aef4-06b5bdf303e4/action" status: 400 len: 107 microversion: 2.1 time: 0.060871 Sep 08 11:46:38.974042 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3696/7258] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 11:46:38 2022] POST /compute/v2.1/servers/b3cba6d4-25c2-4038-aef4-06b5bdf303e4/action => generated 107 bytes in 62 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 11:46:38.979832 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ec22e0a6-db5a-4705-8b4c-a3b6bd83b39f tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:46:38.980910 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ec22e0a6-db5a-4705-8b4c-a3b6bd83b39f tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] [instance: b3cba6d4-25c2-4038-aef4-06b5bdf303e4] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:46:38.987471 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec22e0a6-db5a-4705-8b4c-a3b6bd83b39f tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:38.987990 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec22e0a6-db5a-4705-8b4c-a3b6bd83b39f tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:38.988437 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec22e0a6-db5a-4705-8b4c-a3b6bd83b39f tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:38.989435 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec22e0a6-db5a-4705-8b4c-a3b6bd83b39f tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:38.989904 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec22e0a6-db5a-4705-8b4c-a3b6bd83b39f tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:38.990434 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec22e0a6-db5a-4705-8b4c-a3b6bd83b39f tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:39.133641 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ec22e0a6-db5a-4705-8b4c-a3b6bd83b39f tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b307070f23b4be285fc50bd6303b827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400495b89ad44cbcaa9a1a25844f04f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:46:39.142432 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ec22e0a6-db5a-4705-8b4c-a3b6bd83b39f tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] 10.222.0.27 "GET /compute/v2.1/servers/b3cba6d4-25c2-4038-aef4-06b5bdf303e4" status: 200 len: 1506 microversion: 2.1 time: 0.169207 Sep 08 11:46:39.143211 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3563/7259] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:46:38 2022] GET /compute/v2.1/servers/b3cba6d4-25c2-4038-aef4-06b5bdf303e4 => generated 1506 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:46:39.168281 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0f3084dc-ce78-4592-bbda-4ff8a9173e75 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:46:39.168895 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0f3084dc-ce78-4592-bbda-4ff8a9173e75 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] [instance: b3cba6d4-25c2-4038-aef4-06b5bdf303e4] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:46:39.175369 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0f3084dc-ce78-4592-bbda-4ff8a9173e75 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:39.175855 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0f3084dc-ce78-4592-bbda-4ff8a9173e75 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:39.176312 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0f3084dc-ce78-4592-bbda-4ff8a9173e75 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:39.176997 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0f3084dc-ce78-4592-bbda-4ff8a9173e75 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:39.177563 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0f3084dc-ce78-4592-bbda-4ff8a9173e75 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:39.177970 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0f3084dc-ce78-4592-bbda-4ff8a9173e75 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:39.326286 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0f3084dc-ce78-4592-bbda-4ff8a9173e75 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b307070f23b4be285fc50bd6303b827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400495b89ad44cbcaa9a1a25844f04f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:46:39.335174 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0f3084dc-ce78-4592-bbda-4ff8a9173e75 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] 10.222.0.27 "GET /compute/v2.1/servers/b3cba6d4-25c2-4038-aef4-06b5bdf303e4" status: 200 len: 1506 microversion: 2.1 time: 0.172066 Sep 08 11:46:39.335762 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3697/7260] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:46:39 2022] GET /compute/v2.1/servers/b3cba6d4-25c2-4038-aef4-06b5bdf303e4 => generated 1506 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:46:39.359416 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-296c989d-2dfb-4054-8474-a1e9a5000df1 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:46:39.363613 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-296c989d-2dfb-4054-8474-a1e9a5000df1 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Request method failure captured: Sep 08 11:46:39.363613 n-d-850501-12 devstack@n-api.service[128862]: request: POST /compute/v2.1/servers/b3cba6d4-25c2-4038-aef4-06b5bdf303e4/action HTTP/1.1 Sep 08 11:46:39.363613 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 11:46:39.363613 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 11:46:39.363613 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 11:46:39.363613 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 29 Sep 08 11:46:39.363613 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 11:46:39.363613 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 11:46:39.363613 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 11:46:39.363613 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 11:46:39.363613 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGdYCnAkTIisfwqserMQTRR_BRp7nXTqwzh7nOvRZh-cTJdNTrRqnhBXAn-HIWbuGTezIBNuDK2dJXyH7zoeVzZgcRXiotyp3pS5LQ9IYowTw86HqZ_wNh2APl0fm1MktnCBKC_0bJIDDleCVUERy9asMj_HMxpo6aHM2cYWEiwbQ5qE Sep 08 11:46:39.363613 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 11:46:39.363613 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 11:46:39.363613 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 11:46:39.363613 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 11:46:39.363613 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 11:46:39.363613 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 11:46:39.363613 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 400495b89ad44cbcaa9a1a25844f04f3 Sep 08 11:46:39.363613 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersNegativeTestJSON-957841266 Sep 08 11:46:39.363613 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 11:46:39.363613 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 11:46:39.363613 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/400495b89ad44cbcaa9a1a25844f04f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/400495b89ad44cbcaa9a1a25844f04f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_400495b89ad44cbcaa9a1a25844f04f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/400495b89ad44cbcaa9a1a25844f04f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:46:39.363613 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServersNegativeTestJSON-957841266 Sep 08 11:46:39.363613 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 400495b89ad44cbcaa9a1a25844f04f3 Sep 08 11:46:39.363613 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersNegativeTestJSON-957841266 Sep 08 11:46:39.363613 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServersNegativeTestJSON-957841266-project Sep 08 11:46:39.363613 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 11:46:39.363613 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 11:46:39.363613 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 8b307070f23b4be285fc50bd6303b827 Sep 08 11:46:39.363613 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServersNegativeTestJSON-957841266-project Sep 08 11:46:39.363613 n-d-850501-12 devstack@n-api.service[128862]: Sep 08 11:46:39.363613 n-d-850501-12 devstack@n-api.service[128862]: {"resize": {"flavorRef": ""}} Sep 08 11:46:39.363613 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 11:46:39.363613 n-d-850501-12 devstack@n-api.service[128862]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Sep 08 11:46:39.363613 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'b3cba6d4-25c2-4038-aef4-06b5bdf303e4', 'body': {'resize': {'flavorRef': ''}}} Sep 08 11:46:39.363613 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:46:39.363613 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:46:39.363613 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 11:46:39.363613 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 11:46:39.363613 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 11:46:39.363613 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise error Sep 08 11:46:39.363613 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 08 11:46:39.363613 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:46:39.363613 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Sep 08 11:46:39.363613 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Sep 08 11:46:39.363613 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:46:39.363613 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi On instance['resize']: Sep 08 11:46:39.363613 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi '' Sep 08 11:46:39.363613 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:46:39.363613 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:46:39.363613 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:46:39.363613 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:46:39.363613 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:46:39.363613 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:46:39.363613 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:46:39.363613 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:46:39.363613 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:46:39.363613 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:46:39.363613 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 11:46:39.363613 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 11:46:39.363613 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 11:46:39.363613 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 11:46:39.363613 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 11:46:39.363613 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 11:46:39.363613 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Sep 08 11:46:39.363613 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:46:39.363613 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:46:39.372199 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:46:39.372199 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:46:39.372199 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:46:39.372199 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:46:39.372199 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 11:46:39.372199 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 11:46:39.372199 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Sep 08 11:46:39.372199 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:46:39.372199 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-296c989d-2dfb-4054-8474-a1e9a5000df1 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:46:39.372199 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-296c989d-2dfb-4054-8474-a1e9a5000df1 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] 10.222.0.27 "POST /compute/v2.1/servers/b3cba6d4-25c2-4038-aef4-06b5bdf303e4/action" status: 400 len: 113 microversion: 2.1 time: 0.011295 Sep 08 11:46:39.372199 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3564/7261] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 11:46:39 2022] POST /compute/v2.1/servers/b3cba6d4-25c2-4038-aef4-06b5bdf303e4/action => generated 113 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 08 11:46:39.376176 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9158b456-7e90-49ac-9d03-aeb3e435d15d tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:46:39.376793 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9158b456-7e90-49ac-9d03-aeb3e435d15d tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] [instance: b3cba6d4-25c2-4038-aef4-06b5bdf303e4] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:46:39.382951 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9158b456-7e90-49ac-9d03-aeb3e435d15d tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:39.383526 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9158b456-7e90-49ac-9d03-aeb3e435d15d tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:39.383976 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9158b456-7e90-49ac-9d03-aeb3e435d15d tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:39.384681 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9158b456-7e90-49ac-9d03-aeb3e435d15d tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:39.385198 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9158b456-7e90-49ac-9d03-aeb3e435d15d tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:39.385628 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9158b456-7e90-49ac-9d03-aeb3e435d15d tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:39.518108 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9158b456-7e90-49ac-9d03-aeb3e435d15d tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b307070f23b4be285fc50bd6303b827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400495b89ad44cbcaa9a1a25844f04f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:46:39.527629 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9158b456-7e90-49ac-9d03-aeb3e435d15d tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] 10.222.0.27 "GET /compute/v2.1/servers/b3cba6d4-25c2-4038-aef4-06b5bdf303e4" status: 200 len: 1506 microversion: 2.1 time: 0.155286 Sep 08 11:46:39.528224 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3698/7262] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:46:39 2022] GET /compute/v2.1/servers/b3cba6d4-25c2-4038-aef4-06b5bdf303e4 => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:46:39.554138 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-64ac792b-6d4e-456a-aafb-7f1169b65ee9 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:46:39.555611 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-64ac792b-6d4e-456a-aafb-7f1169b65ee9 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] [instance: 207b751f-ecbf-48c1-ba1f-c40883dcd4f1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:46:39.562404 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64ac792b-6d4e-456a-aafb-7f1169b65ee9 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:39.562917 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64ac792b-6d4e-456a-aafb-7f1169b65ee9 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:39.563373 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64ac792b-6d4e-456a-aafb-7f1169b65ee9 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:39.564088 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64ac792b-6d4e-456a-aafb-7f1169b65ee9 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:39.564562 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64ac792b-6d4e-456a-aafb-7f1169b65ee9 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:39.565005 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64ac792b-6d4e-456a-aafb-7f1169b65ee9 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:39.579359 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-64ac792b-6d4e-456a-aafb-7f1169b65ee9 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] HTTP exception thrown: Instance 207b751f-ecbf-48c1-ba1f-c40883dcd4f1 could not be found. Sep 08 11:46:39.580952 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-64ac792b-6d4e-456a-aafb-7f1169b65ee9 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Request method failure captured: Sep 08 11:46:39.580952 n-d-850501-12 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/servers/207b751f-ecbf-48c1-ba1f-c40883dcd4f1 HTTP/1.1 Sep 08 11:46:39.580952 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 11:46:39.580952 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 11:46:39.580952 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 11:46:39.580952 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 11:46:39.580952 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 11:46:39.580952 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 11:46:39.580952 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 11:46:39.580952 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 11:46:39.580952 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGdYCnAkTIisfwqserMQTRR_BRp7nXTqwzh7nOvRZh-cTJdNTrRqnhBXAn-HIWbuGTezIBNuDK2dJXyH7zoeVzZgcRXiotyp3pS5LQ9IYowTw86HqZ_wNh2APl0fm1MktnCBKC_0bJIDDleCVUERy9asMj_HMxpo6aHM2cYWEiwbQ5qE Sep 08 11:46:39.580952 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 11:46:39.580952 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 11:46:39.580952 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 11:46:39.580952 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 11:46:39.580952 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 11:46:39.580952 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 11:46:39.580952 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 400495b89ad44cbcaa9a1a25844f04f3 Sep 08 11:46:39.580952 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersNegativeTestJSON-957841266 Sep 08 11:46:39.580952 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 11:46:39.580952 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 11:46:39.580952 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/400495b89ad44cbcaa9a1a25844f04f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/400495b89ad44cbcaa9a1a25844f04f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_400495b89ad44cbcaa9a1a25844f04f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/400495b89ad44cbcaa9a1a25844f04f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:46:39.580952 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServersNegativeTestJSON-957841266 Sep 08 11:46:39.580952 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 400495b89ad44cbcaa9a1a25844f04f3 Sep 08 11:46:39.580952 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersNegativeTestJSON-957841266 Sep 08 11:46:39.580952 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServersNegativeTestJSON-957841266-project Sep 08 11:46:39.580952 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 11:46:39.580952 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 11:46:39.580952 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 8b307070f23b4be285fc50bd6303b827 Sep 08 11:46:39.580952 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServersNegativeTestJSON-957841266-project Sep 08 11:46:39.580952 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 11:46:39.580952 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 207b751f-ecbf-48c1-ba1f-c40883dcd4f1 could not be found. Sep 08 11:46:39.580952 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '207b751f-ecbf-48c1-ba1f-c40883dcd4f1'} Sep 08 11:46:39.580952 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:46:39.580952 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:46:39.580952 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:46:39.580952 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:46:39.580952 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:46:39.580952 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:46:39.580952 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:46:39.580952 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:46:39.580952 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:46:39.580952 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:46:39.580952 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 207b751f-ecbf-48c1-ba1f-c40883dcd4f1 could not be found. Sep 08 11:46:39.580952 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:46:39.580952 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:46:39.580952 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:46:39.580952 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:46:39.580952 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:46:39.580952 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:46:39.580952 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:46:39.580952 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:46:39.580952 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:46:39.580952 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:46:39.580952 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 11:46:39.580952 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 11:46:39.580952 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 11:46:39.580952 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 11:46:39.580952 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:46:39.580952 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:46:39.580952 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:46:39.580952 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:46:39.585206 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 207b751f-ecbf-48c1-ba1f-c40883dcd4f1 could not be found. Sep 08 11:46:39.585206 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:46:39.585206 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:46:39.585206 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:46:39.585206 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:46:39.585206 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:46:39.585206 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:46:39.585206 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:46:39.585206 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:46:39.585206 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 207b751f-ecbf-48c1-ba1f-c40883dcd4f1 could not be found. Sep 08 11:46:39.585206 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:46:39.585206 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-64ac792b-6d4e-456a-aafb-7f1169b65ee9 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Returning 404 to user: Instance 207b751f-ecbf-48c1-ba1f-c40883dcd4f1 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:46:39.585206 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-64ac792b-6d4e-456a-aafb-7f1169b65ee9 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] 10.222.0.27 "DELETE /compute/v2.1/servers/207b751f-ecbf-48c1-ba1f-c40883dcd4f1" status: 404 len: 111 microversion: 2.1 time: 0.033119 Sep 08 11:46:39.585206 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3565/7263] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:46:39 2022] DELETE /compute/v2.1/servers/207b751f-ecbf-48c1-ba1f-c40883dcd4f1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:46:39.592225 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bb42a1dc-0cda-4d20-bf0c-c10b77ba6b33 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:46:39.592845 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bb42a1dc-0cda-4d20-bf0c-c10b77ba6b33 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] [instance: 207b751f-ecbf-48c1-ba1f-c40883dcd4f1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:46:39.598955 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bb42a1dc-0cda-4d20-bf0c-c10b77ba6b33 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:39.599450 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bb42a1dc-0cda-4d20-bf0c-c10b77ba6b33 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:39.599887 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bb42a1dc-0cda-4d20-bf0c-c10b77ba6b33 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:39.600584 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bb42a1dc-0cda-4d20-bf0c-c10b77ba6b33 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:39.601062 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bb42a1dc-0cda-4d20-bf0c-c10b77ba6b33 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:39.601492 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bb42a1dc-0cda-4d20-bf0c-c10b77ba6b33 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:39.618176 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-bb42a1dc-0cda-4d20-bf0c-c10b77ba6b33 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] HTTP exception thrown: Instance 207b751f-ecbf-48c1-ba1f-c40883dcd4f1 could not be found. Sep 08 11:46:39.619741 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bb42a1dc-0cda-4d20-bf0c-c10b77ba6b33 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Request method failure captured: Sep 08 11:46:39.619741 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/207b751f-ecbf-48c1-ba1f-c40883dcd4f1 HTTP/1.1 Sep 08 11:46:39.619741 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:46:39.619741 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:46:39.619741 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:46:39.619741 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 11:46:39.619741 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:46:39.619741 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:46:39.619741 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:46:39.619741 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:46:39.619741 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGdYCnAkTIisfwqserMQTRR_BRp7nXTqwzh7nOvRZh-cTJdNTrRqnhBXAn-HIWbuGTezIBNuDK2dJXyH7zoeVzZgcRXiotyp3pS5LQ9IYowTw86HqZ_wNh2APl0fm1MktnCBKC_0bJIDDleCVUERy9asMj_HMxpo6aHM2cYWEiwbQ5qE Sep 08 11:46:39.619741 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:46:39.619741 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:46:39.619741 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:46:39.619741 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:46:39.619741 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:46:39.619741 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:46:39.619741 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: 400495b89ad44cbcaa9a1a25844f04f3 Sep 08 11:46:39.619741 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-ServersNegativeTestJSON-957841266 Sep 08 11:46:39.619741 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:46:39.619741 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:46:39.619741 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/400495b89ad44cbcaa9a1a25844f04f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/400495b89ad44cbcaa9a1a25844f04f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_400495b89ad44cbcaa9a1a25844f04f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/400495b89ad44cbcaa9a1a25844f04f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:46:39.619741 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-ServersNegativeTestJSON-957841266 Sep 08 11:46:39.619741 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: 400495b89ad44cbcaa9a1a25844f04f3 Sep 08 11:46:39.619741 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-ServersNegativeTestJSON-957841266 Sep 08 11:46:39.619741 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-ServersNegativeTestJSON-957841266-project Sep 08 11:46:39.619741 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:46:39.619741 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:46:39.619741 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 8b307070f23b4be285fc50bd6303b827 Sep 08 11:46:39.619741 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-ServersNegativeTestJSON-957841266-project Sep 08 11:46:39.619741 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 11:46:39.619741 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 207b751f-ecbf-48c1-ba1f-c40883dcd4f1 could not be found. Sep 08 11:46:39.619741 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '207b751f-ecbf-48c1-ba1f-c40883dcd4f1'} Sep 08 11:46:39.619741 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:46:39.619741 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:46:39.619741 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:46:39.619741 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:46:39.619741 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:46:39.619741 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:46:39.619741 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:46:39.619741 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:46:39.619741 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:46:39.619741 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:46:39.619741 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 207b751f-ecbf-48c1-ba1f-c40883dcd4f1 could not be found. Sep 08 11:46:39.619741 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:46:39.619741 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:46:39.619741 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:46:39.619741 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:46:39.619741 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:46:39.619741 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:46:39.619741 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:46:39.619741 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:46:39.619741 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:46:39.619741 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:46:39.619741 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:46:39.619741 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:46:39.619741 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:46:39.619741 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:46:39.619741 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:46:39.619741 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:46:39.619741 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 207b751f-ecbf-48c1-ba1f-c40883dcd4f1 could not be found. Sep 08 11:46:39.619741 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:46:39.619741 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:46:39.619741 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:46:39.625540 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:46:39.625540 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:46:39.625540 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:46:39.625540 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:46:39.625540 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:46:39.625540 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 207b751f-ecbf-48c1-ba1f-c40883dcd4f1 could not be found. Sep 08 11:46:39.625540 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:46:39.625540 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bb42a1dc-0cda-4d20-bf0c-c10b77ba6b33 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Returning 404 to user: Instance 207b751f-ecbf-48c1-ba1f-c40883dcd4f1 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:46:39.625540 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bb42a1dc-0cda-4d20-bf0c-c10b77ba6b33 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] 10.222.0.27 "GET /compute/v2.1/servers/207b751f-ecbf-48c1-ba1f-c40883dcd4f1" status: 404 len: 111 microversion: 2.1 time: 0.033001 Sep 08 11:46:39.625540 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3699/7264] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:46:39 2022] GET /compute/v2.1/servers/207b751f-ecbf-48c1-ba1f-c40883dcd4f1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:46:39.630943 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1c0f3bea-fe05-4d81-9c1d-bdf372e9b5e7 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:46:39.631465 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1c0f3bea-fe05-4d81-9c1d-bdf372e9b5e7 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] [instance: b3cba6d4-25c2-4038-aef4-06b5bdf303e4] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:46:39.638386 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c0f3bea-fe05-4d81-9c1d-bdf372e9b5e7 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:39.638901 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c0f3bea-fe05-4d81-9c1d-bdf372e9b5e7 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:39.639363 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c0f3bea-fe05-4d81-9c1d-bdf372e9b5e7 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:39.640086 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c0f3bea-fe05-4d81-9c1d-bdf372e9b5e7 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:39.640573 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c0f3bea-fe05-4d81-9c1d-bdf372e9b5e7 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:39.641062 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c0f3bea-fe05-4d81-9c1d-bdf372e9b5e7 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:39.669762 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1c0f3bea-fe05-4d81-9c1d-bdf372e9b5e7 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] [instance: b3cba6d4-25c2-4038-aef4-06b5bdf303e4] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:46:39.757717 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1c0f3bea-fe05-4d81-9c1d-bdf372e9b5e7 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b3cba6d4-25c2-4038-aef4-06b5bdf303e4" status: 204 len: 0 microversion: 2.1 time: 0.130265 Sep 08 11:46:39.758881 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3566/7265] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:46:39 2022] DELETE /compute/v2.1/servers/b3cba6d4-25c2-4038-aef4-06b5bdf303e4 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:46:39.767237 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6e008b8b-10fe-4205-a82f-279e708e4e18 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:46:39.768288 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6e008b8b-10fe-4205-a82f-279e708e4e18 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] [instance: b3cba6d4-25c2-4038-aef4-06b5bdf303e4] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:46:39.775670 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6e008b8b-10fe-4205-a82f-279e708e4e18 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:39.776319 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6e008b8b-10fe-4205-a82f-279e708e4e18 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:39.776760 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6e008b8b-10fe-4205-a82f-279e708e4e18 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:39.777500 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6e008b8b-10fe-4205-a82f-279e708e4e18 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:39.778151 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6e008b8b-10fe-4205-a82f-279e708e4e18 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:39.778609 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6e008b8b-10fe-4205-a82f-279e708e4e18 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:39.937536 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6e008b8b-10fe-4205-a82f-279e708e4e18 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b307070f23b4be285fc50bd6303b827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400495b89ad44cbcaa9a1a25844f04f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:46:39.945865 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6e008b8b-10fe-4205-a82f-279e708e4e18 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] 10.222.0.27 "GET /compute/v2.1/servers/b3cba6d4-25c2-4038-aef4-06b5bdf303e4" status: 200 len: 1512 microversion: 2.1 time: 0.182487 Sep 08 11:46:39.947119 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3700/7266] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:46:39 2022] GET /compute/v2.1/servers/b3cba6d4-25c2-4038-aef4-06b5bdf303e4 => generated 1512 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:46:40.970970 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-80921603-41b7-4a89-b23a-1ac6fa797eea tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:46:40.971700 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-80921603-41b7-4a89-b23a-1ac6fa797eea tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] [instance: b3cba6d4-25c2-4038-aef4-06b5bdf303e4] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:46:40.979858 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80921603-41b7-4a89-b23a-1ac6fa797eea tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:40.980359 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80921603-41b7-4a89-b23a-1ac6fa797eea tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:40.980812 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80921603-41b7-4a89-b23a-1ac6fa797eea tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:40.981657 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80921603-41b7-4a89-b23a-1ac6fa797eea tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:40.982139 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80921603-41b7-4a89-b23a-1ac6fa797eea tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:40.982581 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80921603-41b7-4a89-b23a-1ac6fa797eea tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:41.123754 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-80921603-41b7-4a89-b23a-1ac6fa797eea tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b307070f23b4be285fc50bd6303b827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400495b89ad44cbcaa9a1a25844f04f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:46:41.127442 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:46:41.132550 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-80921603-41b7-4a89-b23a-1ac6fa797eea tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] 10.222.0.27 "GET /compute/v2.1/servers/b3cba6d4-25c2-4038-aef4-06b5bdf303e4" status: 200 len: 1512 microversion: 2.1 time: 0.166035 Sep 08 11:46:41.133151 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3567/7267] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:46:40 2022] GET /compute/v2.1/servers/b3cba6d4-25c2-4038-aef4-06b5bdf303e4 => generated 1512 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:46:41.664020 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-66a32065-8bb1-4e77-9b9a-889390c1c694 req-04d24693-701b-4617-bb38-fb87d07d460b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3cba6d4-25c2-4038-aef4-06b5bdf303e4", "name": "network-vif-deleted", "tag": "25e688b9-2ff7-4b46-bd05-1c6106a86865"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:46:41.671049 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:46:41.678553 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-66a32065-8bb1-4e77-9b9a-889390c1c694 req-04d24693-701b-4617-bb38-fb87d07d460b service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:41.679335 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-66a32065-8bb1-4e77-9b9a-889390c1c694 req-04d24693-701b-4617-bb38-fb87d07d460b service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:41.679938 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-66a32065-8bb1-4e77-9b9a-889390c1c694 req-04d24693-701b-4617-bb38-fb87d07d460b service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:41.693956 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-66a32065-8bb1-4e77-9b9a-889390c1c694 req-04d24693-701b-4617-bb38-fb87d07d460b service nova] Creating event network-vif-deleted:25e688b9-2ff7-4b46-bd05-1c6106a86865 for instance b3cba6d4-25c2-4038-aef4-06b5bdf303e4 on n-h1-850501-12 Sep 08 11:46:41.703102 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-66a32065-8bb1-4e77-9b9a-889390c1c694 req-04d24693-701b-4617-bb38-fb87d07d460b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048403 Sep 08 11:46:41.703102 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3701/7268] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:46:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:46:42.157767 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-693ce319-aeec-4adc-ac3b-6cd93b273619 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:46:42.158551 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-693ce319-aeec-4adc-ac3b-6cd93b273619 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] [instance: b3cba6d4-25c2-4038-aef4-06b5bdf303e4] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:46:42.162284 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:46:42.166807 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-693ce319-aeec-4adc-ac3b-6cd93b273619 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:42.167468 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-693ce319-aeec-4adc-ac3b-6cd93b273619 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:42.167938 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-693ce319-aeec-4adc-ac3b-6cd93b273619 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:42.168749 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-693ce319-aeec-4adc-ac3b-6cd93b273619 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:42.169291 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-693ce319-aeec-4adc-ac3b-6cd93b273619 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:42.169783 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-693ce319-aeec-4adc-ac3b-6cd93b273619 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:42.186478 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-693ce319-aeec-4adc-ac3b-6cd93b273619 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] HTTP exception thrown: Instance b3cba6d4-25c2-4038-aef4-06b5bdf303e4 could not be found. Sep 08 11:46:42.188250 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-693ce319-aeec-4adc-ac3b-6cd93b273619 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Request method failure captured: Sep 08 11:46:42.188250 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/b3cba6d4-25c2-4038-aef4-06b5bdf303e4 HTTP/1.1 Sep 08 11:46:42.188250 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 11:46:42.188250 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 11:46:42.188250 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 11:46:42.188250 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 11:46:42.188250 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 11:46:42.188250 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 11:46:42.188250 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 11:46:42.188250 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 11:46:42.188250 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGdYCnAkTIisfwqserMQTRR_BRp7nXTqwzh7nOvRZh-cTJdNTrRqnhBXAn-HIWbuGTezIBNuDK2dJXyH7zoeVzZgcRXiotyp3pS5LQ9IYowTw86HqZ_wNh2APl0fm1MktnCBKC_0bJIDDleCVUERy9asMj_HMxpo6aHM2cYWEiwbQ5qE Sep 08 11:46:42.188250 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 11:46:42.188250 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 11:46:42.188250 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 11:46:42.188250 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 11:46:42.188250 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 11:46:42.188250 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 11:46:42.188250 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: 400495b89ad44cbcaa9a1a25844f04f3 Sep 08 11:46:42.188250 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersNegativeTestJSON-957841266 Sep 08 11:46:42.188250 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 11:46:42.188250 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 11:46:42.188250 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/400495b89ad44cbcaa9a1a25844f04f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/400495b89ad44cbcaa9a1a25844f04f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_400495b89ad44cbcaa9a1a25844f04f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/400495b89ad44cbcaa9a1a25844f04f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:46:42.188250 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-ServersNegativeTestJSON-957841266 Sep 08 11:46:42.188250 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: 400495b89ad44cbcaa9a1a25844f04f3 Sep 08 11:46:42.188250 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersNegativeTestJSON-957841266 Sep 08 11:46:42.188250 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-ServersNegativeTestJSON-957841266-project Sep 08 11:46:42.188250 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 11:46:42.188250 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 11:46:42.188250 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 8b307070f23b4be285fc50bd6303b827 Sep 08 11:46:42.188250 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-ServersNegativeTestJSON-957841266-project Sep 08 11:46:42.188250 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 11:46:42.188250 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance b3cba6d4-25c2-4038-aef4-06b5bdf303e4 could not be found. Sep 08 11:46:42.188250 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'b3cba6d4-25c2-4038-aef4-06b5bdf303e4'} Sep 08 11:46:42.188250 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:46:42.188250 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:46:42.188250 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:46:42.188250 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:46:42.188250 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:46:42.188250 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:46:42.188250 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:46:42.188250 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:46:42.188250 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:46:42.188250 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:46:42.188250 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3cba6d4-25c2-4038-aef4-06b5bdf303e4 could not be found. Sep 08 11:46:42.188250 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:46:42.188250 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:46:42.188250 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:46:42.188250 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:46:42.188250 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:46:42.188250 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:46:42.188250 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:46:42.188250 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:46:42.188250 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:46:42.188250 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:46:42.188250 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:46:42.188250 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:46:42.188250 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:46:42.188250 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:46:42.188250 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:46:42.188250 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:46:42.188250 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3cba6d4-25c2-4038-aef4-06b5bdf303e4 could not be found. Sep 08 11:46:42.188250 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:46:42.188250 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:46:42.188250 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:46:42.192271 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:46:42.192271 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:46:42.192271 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:46:42.192271 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:46:42.192271 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:46:42.192271 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3cba6d4-25c2-4038-aef4-06b5bdf303e4 could not be found. Sep 08 11:46:42.192271 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:46:42.192271 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-693ce319-aeec-4adc-ac3b-6cd93b273619 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] Returning 404 to user: Instance b3cba6d4-25c2-4038-aef4-06b5bdf303e4 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:46:42.192271 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-693ce319-aeec-4adc-ac3b-6cd93b273619 tempest-ServersNegativeTestJSON-957841266 tempest-ServersNegativeTestJSON-957841266-project] 10.222.0.27 "GET /compute/v2.1/servers/b3cba6d4-25c2-4038-aef4-06b5bdf303e4" status: 404 len: 111 microversion: 2.1 time: 0.036646 Sep 08 11:46:42.192271 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3568/7269] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:46:42 2022] GET /compute/v2.1/servers/b3cba6d4-25c2-4038-aef4-06b5bdf303e4 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:47:13.594889 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=22 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:47:13.787803 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6f4d9c8f-7b73-405e-af97-ba8ddd65464c tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Action: 'create', calling method: .version_select at 0x7f68df02c790>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-391187230", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMC6ENqv9u2E52bYSS7B9FE3y3vKqdDF6X7QGhO03pzA3PpIkM6Z5MWw1+FJ4vqa1H8AA/5tgHp21nHw1UxUfkJ4NoIHPuTSi5JBNQtEDXo1ha9ANpv8gv32GSfirAvaQw=="}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:47:13.819391 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-6f4d9c8f-7b73-405e-af97-ba8ddd65464c tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Getting quotas for project eb883d25c960430aa07ef867fae8a4cb. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:47:13.828101 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-6f4d9c8f-7b73-405e-af97-ba8ddd65464c tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Getting quotas for user fc1fafbc7eb84004b96f0b4a82d37c21 and project eb883d25c960430aa07ef867fae8a4cb. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:47:13.858492 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6f4d9c8f-7b73-405e-af97-ba8ddd65464c tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.265932 Sep 08 11:47:13.859119 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3702/7270] 10.222.0.27 () {60 vars in 1159 bytes} [Thu Sep 8 11:47:13 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:47:13.914980 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fbda2b85-c745-4c86-b436-0d372001c18f tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1641364716", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-391187230", "networks": [{"uuid": "bc9b5977-c89a-4665-9707-9e55e005b094"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:47:13.924552 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:47:13.975388 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-fbda2b85-c745-4c86-b436-0d372001c18f tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] validate_networks() for [('bc9b5977-c89a-4665-9707-9e55e005b094', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:47:14.370021 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-fbda2b85-c745-4c86-b436-0d372001c18f tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:47:14.370623 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-fbda2b85-c745-4c86-b436-0d372001c18f tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:47:14.371750 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-fbda2b85-c745-4c86-b436-0d372001c18f tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:47:14.372282 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-fbda2b85-c745-4c86-b436-0d372001c18f tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:47:14.372866 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-fbda2b85-c745-4c86-b436-0d372001c18f tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:47:14.384500 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fbda2b85-c745-4c86-b436-0d372001c18f tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:47:14.385009 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fbda2b85-c745-4c86-b436-0d372001c18f tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:47:14.385495 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fbda2b85-c745-4c86-b436-0d372001c18f tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:47:14.386243 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fbda2b85-c745-4c86-b436-0d372001c18f tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:47:14.386712 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fbda2b85-c745-4c86-b436-0d372001c18f tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:47:14.387156 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fbda2b85-c745-4c86-b436-0d372001c18f tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:47:14.404246 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-fbda2b85-c745-4c86-b436-0d372001c18f tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Getting quotas for project eb883d25c960430aa07ef867fae8a4cb. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:47:14.409603 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-fbda2b85-c745-4c86-b436-0d372001c18f tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Getting quotas for user fc1fafbc7eb84004b96f0b4a82d37c21 and project eb883d25c960430aa07ef867fae8a4cb. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:47:14.423309 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fbda2b85-c745-4c86-b436-0d372001c18f tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:47:14.425696 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fbda2b85-c745-4c86-b436-0d372001c18f tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] [instance: cf7763fa-7c2c-4d12-91db-527476cd3799] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:47:14.474390 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fbda2b85-c745-4c86-b436-0d372001c18f tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.564869 Sep 08 11:47:14.475223 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3569/7271] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 11:47:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:47:14.486000 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4e48b449-6c3a-46a7-807c-07a519666fe5 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:47:14.486768 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4e48b449-6c3a-46a7-807c-07a519666fe5 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] [instance: cf7763fa-7c2c-4d12-91db-527476cd3799] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:47:14.543151 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4e48b449-6c3a-46a7-807c-07a519666fe5 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fafbc7eb84004b96f0b4a82d37c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb883d25c960430aa07ef867fae8a4cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:47:14.550017 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4e48b449-6c3a-46a7-807c-07a519666fe5 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "GET /compute/v2.1/servers/cf7763fa-7c2c-4d12-91db-527476cd3799" status: 200 len: 1262 microversion: 2.1 time: 0.067894 Sep 08 11:47:14.550590 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3703/7272] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:47:14 2022] GET /compute/v2.1/servers/cf7763fa-7c2c-4d12-91db-527476cd3799 => generated 1262 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:47:15.574837 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-876cab35-6ebb-43b7-840b-cdc4df41e0e9 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:47:15.579344 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-876cab35-6ebb-43b7-840b-cdc4df41e0e9 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] [instance: cf7763fa-7c2c-4d12-91db-527476cd3799] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:47:15.591137 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-876cab35-6ebb-43b7-840b-cdc4df41e0e9 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:47:15.591874 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-876cab35-6ebb-43b7-840b-cdc4df41e0e9 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:47:15.592571 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-876cab35-6ebb-43b7-840b-cdc4df41e0e9 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:47:15.593805 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-876cab35-6ebb-43b7-840b-cdc4df41e0e9 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:47:15.594893 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-876cab35-6ebb-43b7-840b-cdc4df41e0e9 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:47:15.596218 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-876cab35-6ebb-43b7-840b-cdc4df41e0e9 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:47:15.698362 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-876cab35-6ebb-43b7-840b-cdc4df41e0e9 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fafbc7eb84004b96f0b4a82d37c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb883d25c960430aa07ef867fae8a4cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:47:15.707993 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-876cab35-6ebb-43b7-840b-cdc4df41e0e9 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "GET /compute/v2.1/servers/cf7763fa-7c2c-4d12-91db-527476cd3799" status: 200 len: 1322 microversion: 2.1 time: 0.137812 Sep 08 11:47:15.724422 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3570/7273] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:47:15 2022] GET /compute/v2.1/servers/cf7763fa-7c2c-4d12-91db-527476cd3799 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:47:16.733546 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b85286d9-b454-460e-9a81-adb2730ed35f tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:47:16.734901 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b85286d9-b454-460e-9a81-adb2730ed35f tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] [instance: cf7763fa-7c2c-4d12-91db-527476cd3799] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:47:16.744307 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b85286d9-b454-460e-9a81-adb2730ed35f tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:47:16.745094 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b85286d9-b454-460e-9a81-adb2730ed35f tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:47:16.745727 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b85286d9-b454-460e-9a81-adb2730ed35f tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:47:16.746611 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b85286d9-b454-460e-9a81-adb2730ed35f tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:47:16.747368 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b85286d9-b454-460e-9a81-adb2730ed35f tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:47:16.748088 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b85286d9-b454-460e-9a81-adb2730ed35f tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:47:16.941332 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b85286d9-b454-460e-9a81-adb2730ed35f tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fafbc7eb84004b96f0b4a82d37c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb883d25c960430aa07ef867fae8a4cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:47:16.949815 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b85286d9-b454-460e-9a81-adb2730ed35f tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "GET /compute/v2.1/servers/cf7763fa-7c2c-4d12-91db-527476cd3799" status: 200 len: 1362 microversion: 2.1 time: 0.220578 Sep 08 11:47:16.950617 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3704/7274] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:47:16 2022] GET /compute/v2.1/servers/cf7763fa-7c2c-4d12-91db-527476cd3799 => generated 1362 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:47:17.070763 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-cf545e6e-f808-41c9-bfe7-33ffe876dc4c req-f47d5db2-84d4-411c-820d-9ee061cd8b58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf7763fa-7c2c-4d12-91db-527476cd3799", "tag": "e406488d-13c9-4b0d-b279-41b2e6c5c9d4"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:47:17.085336 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-cf545e6e-f808-41c9-bfe7-33ffe876dc4c req-f47d5db2-84d4-411c-820d-9ee061cd8b58 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:47:17.087420 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-cf545e6e-f808-41c9-bfe7-33ffe876dc4c req-f47d5db2-84d4-411c-820d-9ee061cd8b58 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:47:17.087998 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-cf545e6e-f808-41c9-bfe7-33ffe876dc4c req-f47d5db2-84d4-411c-820d-9ee061cd8b58 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:47:17.101713 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-cf545e6e-f808-41c9-bfe7-33ffe876dc4c req-f47d5db2-84d4-411c-820d-9ee061cd8b58 service nova] Creating event network-changed:e406488d-13c9-4b0d-b279-41b2e6c5c9d4 for instance cf7763fa-7c2c-4d12-91db-527476cd3799 on n-h1-850501-12 Sep 08 11:47:17.108683 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-cf545e6e-f808-41c9-bfe7-33ffe876dc4c req-f47d5db2-84d4-411c-820d-9ee061cd8b58 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041787 Sep 08 11:47:17.109916 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3571/7275] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:47:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:47:17.973240 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8fcaa74f-e0ac-4905-9d9c-7f5b02d93d23 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:47:17.974119 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8fcaa74f-e0ac-4905-9d9c-7f5b02d93d23 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] [instance: cf7763fa-7c2c-4d12-91db-527476cd3799] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:47:17.982107 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8fcaa74f-e0ac-4905-9d9c-7f5b02d93d23 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:47:17.982793 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8fcaa74f-e0ac-4905-9d9c-7f5b02d93d23 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:47:17.983583 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8fcaa74f-e0ac-4905-9d9c-7f5b02d93d23 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:47:17.984300 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8fcaa74f-e0ac-4905-9d9c-7f5b02d93d23 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:47:17.984799 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8fcaa74f-e0ac-4905-9d9c-7f5b02d93d23 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:47:17.985316 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8fcaa74f-e0ac-4905-9d9c-7f5b02d93d23 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:47:18.152716 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8fcaa74f-e0ac-4905-9d9c-7f5b02d93d23 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fafbc7eb84004b96f0b4a82d37c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb883d25c960430aa07ef867fae8a4cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:47:18.161759 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8fcaa74f-e0ac-4905-9d9c-7f5b02d93d23 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "GET /compute/v2.1/servers/cf7763fa-7c2c-4d12-91db-527476cd3799" status: 200 len: 1362 microversion: 2.1 time: 0.192384 Sep 08 11:47:18.162717 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3705/7276] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:47:17 2022] GET /compute/v2.1/servers/cf7763fa-7c2c-4d12-91db-527476cd3799 => generated 1362 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:47:19.193077 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a400b833-a91b-4671-a901-1b097ea99198 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:47:19.193795 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a400b833-a91b-4671-a901-1b097ea99198 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] [instance: cf7763fa-7c2c-4d12-91db-527476cd3799] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:47:19.201585 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a400b833-a91b-4671-a901-1b097ea99198 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:47:19.202093 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a400b833-a91b-4671-a901-1b097ea99198 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:47:19.202769 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a400b833-a91b-4671-a901-1b097ea99198 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:47:19.203636 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a400b833-a91b-4671-a901-1b097ea99198 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:47:19.204202 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a400b833-a91b-4671-a901-1b097ea99198 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:47:19.204692 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a400b833-a91b-4671-a901-1b097ea99198 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:47:19.345606 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a400b833-a91b-4671-a901-1b097ea99198 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fafbc7eb84004b96f0b4a82d37c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb883d25c960430aa07ef867fae8a4cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:47:19.354357 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a400b833-a91b-4671-a901-1b097ea99198 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "GET /compute/v2.1/servers/cf7763fa-7c2c-4d12-91db-527476cd3799" status: 200 len: 1362 microversion: 2.1 time: 0.165737 Sep 08 11:47:19.354937 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3572/7277] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:47:19 2022] GET /compute/v2.1/servers/cf7763fa-7c2c-4d12-91db-527476cd3799 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:47:20.380994 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e5483eaf-3764-46ed-947e-eb76159dbc5a tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:47:20.381644 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e5483eaf-3764-46ed-947e-eb76159dbc5a tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] [instance: cf7763fa-7c2c-4d12-91db-527476cd3799] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:47:20.389305 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e5483eaf-3764-46ed-947e-eb76159dbc5a tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:47:20.389802 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e5483eaf-3764-46ed-947e-eb76159dbc5a tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:47:20.390243 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e5483eaf-3764-46ed-947e-eb76159dbc5a tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:47:20.390949 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e5483eaf-3764-46ed-947e-eb76159dbc5a tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:47:20.391410 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e5483eaf-3764-46ed-947e-eb76159dbc5a tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:47:20.391840 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e5483eaf-3764-46ed-947e-eb76159dbc5a tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:47:20.528814 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e5483eaf-3764-46ed-947e-eb76159dbc5a tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fafbc7eb84004b96f0b4a82d37c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb883d25c960430aa07ef867fae8a4cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:47:20.536528 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e5483eaf-3764-46ed-947e-eb76159dbc5a tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "GET /compute/v2.1/servers/cf7763fa-7c2c-4d12-91db-527476cd3799" status: 200 len: 1362 microversion: 2.1 time: 0.159475 Sep 08 11:47:20.537121 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3706/7278] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:47:20 2022] GET /compute/v2.1/servers/cf7763fa-7c2c-4d12-91db-527476cd3799 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:47:21.559813 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-42fa6561-fdf3-490d-93f6-0eb86b510c3a tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:47:21.560446 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-42fa6561-fdf3-490d-93f6-0eb86b510c3a tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] [instance: cf7763fa-7c2c-4d12-91db-527476cd3799] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:47:21.567170 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42fa6561-fdf3-490d-93f6-0eb86b510c3a tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:47:21.567679 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42fa6561-fdf3-490d-93f6-0eb86b510c3a tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:47:21.568129 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42fa6561-fdf3-490d-93f6-0eb86b510c3a tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:47:21.568866 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42fa6561-fdf3-490d-93f6-0eb86b510c3a tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:47:21.569368 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42fa6561-fdf3-490d-93f6-0eb86b510c3a tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:47:21.569809 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42fa6561-fdf3-490d-93f6-0eb86b510c3a tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:47:21.716026 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-42fa6561-fdf3-490d-93f6-0eb86b510c3a tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fafbc7eb84004b96f0b4a82d37c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb883d25c960430aa07ef867fae8a4cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:47:21.723781 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-42fa6561-fdf3-490d-93f6-0eb86b510c3a tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "GET /compute/v2.1/servers/cf7763fa-7c2c-4d12-91db-527476cd3799" status: 200 len: 1362 microversion: 2.1 time: 0.168290 Sep 08 11:47:21.724362 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3573/7279] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:47:21 2022] GET /compute/v2.1/servers/cf7763fa-7c2c-4d12-91db-527476cd3799 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:47:22.746604 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9caebd1d-51cd-4eb0-91ae-b0e4911f617c tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:47:22.747212 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9caebd1d-51cd-4eb0-91ae-b0e4911f617c tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] [instance: cf7763fa-7c2c-4d12-91db-527476cd3799] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:47:22.754081 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9caebd1d-51cd-4eb0-91ae-b0e4911f617c tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:47:22.754563 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9caebd1d-51cd-4eb0-91ae-b0e4911f617c tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:47:22.754996 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9caebd1d-51cd-4eb0-91ae-b0e4911f617c tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:47:22.755678 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9caebd1d-51cd-4eb0-91ae-b0e4911f617c tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:47:22.756130 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9caebd1d-51cd-4eb0-91ae-b0e4911f617c tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:47:22.756548 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9caebd1d-51cd-4eb0-91ae-b0e4911f617c tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:47:22.890458 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9caebd1d-51cd-4eb0-91ae-b0e4911f617c tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fafbc7eb84004b96f0b4a82d37c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb883d25c960430aa07ef867fae8a4cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:47:22.900850 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9caebd1d-51cd-4eb0-91ae-b0e4911f617c tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "GET /compute/v2.1/servers/cf7763fa-7c2c-4d12-91db-527476cd3799" status: 200 len: 1362 microversion: 2.1 time: 0.157129 Sep 08 11:47:22.901576 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3707/7280] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:47:22 2022] GET /compute/v2.1/servers/cf7763fa-7c2c-4d12-91db-527476cd3799 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:47:23.182167 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-39579e81-70b5-46da-bb9d-65fea6e35ea2 req-7b5f7fbd-0a45-4ef6-8889-f2f5ba475208 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf7763fa-7c2c-4d12-91db-527476cd3799", "name": "network-vif-plugged", "status": "completed", "tag": "e406488d-13c9-4b0d-b279-41b2e6c5c9d4"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:47:23.192072 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-39579e81-70b5-46da-bb9d-65fea6e35ea2 req-7b5f7fbd-0a45-4ef6-8889-f2f5ba475208 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:47:23.192572 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-39579e81-70b5-46da-bb9d-65fea6e35ea2 req-7b5f7fbd-0a45-4ef6-8889-f2f5ba475208 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:47:23.193017 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-39579e81-70b5-46da-bb9d-65fea6e35ea2 req-7b5f7fbd-0a45-4ef6-8889-f2f5ba475208 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:47:23.205862 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-39579e81-70b5-46da-bb9d-65fea6e35ea2 req-7b5f7fbd-0a45-4ef6-8889-f2f5ba475208 service nova] Creating event network-vif-plugged:e406488d-13c9-4b0d-b279-41b2e6c5c9d4 for instance cf7763fa-7c2c-4d12-91db-527476cd3799 on n-h1-850501-12 Sep 08 11:47:23.211362 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-39579e81-70b5-46da-bb9d-65fea6e35ea2 req-7b5f7fbd-0a45-4ef6-8889-f2f5ba475208 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093332 Sep 08 11:47:23.212144 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3574/7281] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:47:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:47:23.924403 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b38728ab-65fa-40df-b2a2-2683e598a3d9 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:47:23.925688 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b38728ab-65fa-40df-b2a2-2683e598a3d9 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] [instance: cf7763fa-7c2c-4d12-91db-527476cd3799] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:47:23.933542 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b38728ab-65fa-40df-b2a2-2683e598a3d9 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:47:23.933542 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b38728ab-65fa-40df-b2a2-2683e598a3d9 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:47:23.934448 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b38728ab-65fa-40df-b2a2-2683e598a3d9 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:47:23.935149 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b38728ab-65fa-40df-b2a2-2683e598a3d9 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:47:23.935680 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b38728ab-65fa-40df-b2a2-2683e598a3d9 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:47:23.936138 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b38728ab-65fa-40df-b2a2-2683e598a3d9 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:47:24.086765 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b38728ab-65fa-40df-b2a2-2683e598a3d9 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fafbc7eb84004b96f0b4a82d37c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb883d25c960430aa07ef867fae8a4cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:47:24.095298 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b38728ab-65fa-40df-b2a2-2683e598a3d9 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "GET /compute/v2.1/servers/cf7763fa-7c2c-4d12-91db-527476cd3799" status: 200 len: 1362 microversion: 2.1 time: 0.174857 Sep 08 11:47:24.095888 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3708/7282] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:47:23 2022] GET /compute/v2.1/servers/cf7763fa-7c2c-4d12-91db-527476cd3799 => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:47:25.117539 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:47:25.118988 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:47:25.123643 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-416f1e28-c9da-4d2f-b57a-289ee234cf8a tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:47:25.124370 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-416f1e28-c9da-4d2f-b57a-289ee234cf8a tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] [instance: cf7763fa-7c2c-4d12-91db-527476cd3799] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:47:25.131562 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-416f1e28-c9da-4d2f-b57a-289ee234cf8a tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:47:25.132005 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-416f1e28-c9da-4d2f-b57a-289ee234cf8a tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:47:25.132455 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-416f1e28-c9da-4d2f-b57a-289ee234cf8a tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:47:25.133207 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-416f1e28-c9da-4d2f-b57a-289ee234cf8a tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:47:25.133681 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-416f1e28-c9da-4d2f-b57a-289ee234cf8a tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:47:25.134779 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-416f1e28-c9da-4d2f-b57a-289ee234cf8a tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:47:25.273253 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-416f1e28-c9da-4d2f-b57a-289ee234cf8a tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fafbc7eb84004b96f0b4a82d37c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb883d25c960430aa07ef867fae8a4cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:47:25.281484 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-416f1e28-c9da-4d2f-b57a-289ee234cf8a tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "GET /compute/v2.1/servers/cf7763fa-7c2c-4d12-91db-527476cd3799" status: 200 len: 1553 microversion: 2.1 time: 0.165766 Sep 08 11:47:25.282064 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3575/7283] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:47:25 2022] GET /compute/v2.1/servers/cf7763fa-7c2c-4d12-91db-527476cd3799 => generated 1553 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:47:25.304287 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-85c8203b-252d-4f27-b441-e6a456611f2e tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:47:25.304892 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-85c8203b-252d-4f27-b441-e6a456611f2e tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] [instance: cf7763fa-7c2c-4d12-91db-527476cd3799] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:47:25.307578 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=6 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:47:25.316760 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-85c8203b-252d-4f27-b441-e6a456611f2e tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:47:25.317636 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-85c8203b-252d-4f27-b441-e6a456611f2e tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:47:25.318392 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-85c8203b-252d-4f27-b441-e6a456611f2e tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:47:25.319574 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-85c8203b-252d-4f27-b441-e6a456611f2e tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:47:25.320368 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-85c8203b-252d-4f27-b441-e6a456611f2e tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:47:25.321148 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-85c8203b-252d-4f27-b441-e6a456611f2e tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:47:25.483284 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-85c8203b-252d-4f27-b441-e6a456611f2e tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fafbc7eb84004b96f0b4a82d37c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb883d25c960430aa07ef867fae8a4cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:47:25.491395 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-85c8203b-252d-4f27-b441-e6a456611f2e tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "GET /compute/v2.1/servers/cf7763fa-7c2c-4d12-91db-527476cd3799" status: 200 len: 1553 microversion: 2.1 time: 0.190980 Sep 08 11:47:25.491972 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3709/7284] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:47:25 2022] GET /compute/v2.1/servers/cf7763fa-7c2c-4d12-91db-527476cd3799 => generated 1553 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:47:27.108840 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c67fa915-4fc1-429d-9bf7-6e3588ea05dd tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d49be2b7-1c37-444d-bea8-fa3414e98ef4"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:47:27.111229 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c67fa915-4fc1-429d-9bf7-6e3588ea05dd tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] [instance: cf7763fa-7c2c-4d12-91db-527476cd3799] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:47:27.118426 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c67fa915-4fc1-429d-9bf7-6e3588ea05dd tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:47:27.118897 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c67fa915-4fc1-429d-9bf7-6e3588ea05dd tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:47:27.119346 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c67fa915-4fc1-429d-9bf7-6e3588ea05dd tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:47:27.120084 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c67fa915-4fc1-429d-9bf7-6e3588ea05dd tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:47:27.120613 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c67fa915-4fc1-429d-9bf7-6e3588ea05dd tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:47:27.121073 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c67fa915-4fc1-429d-9bf7-6e3588ea05dd tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:47:27.369442 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c67fa915-4fc1-429d-9bf7-6e3588ea05dd tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "POST /compute/v2.1/servers/cf7763fa-7c2c-4d12-91db-527476cd3799/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.264320 Sep 08 11:47:27.369990 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3576/7285] 10.222.0.27 () {60 vars in 1323 bytes} [Thu Sep 8 11:47:27 2022] POST /compute/v2.1/servers/cf7763fa-7c2c-4d12-91db-527476cd3799/os-volume_attachments => generated 194 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:47:38.122479 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-655d0593-b688-4e74-ae95-6336720dbe21 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:47:38.123054 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-655d0593-b688-4e74-ae95-6336720dbe21 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] [instance: cf7763fa-7c2c-4d12-91db-527476cd3799] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:47:38.125789 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:47:38.126510 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=36 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:47:38.133354 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-655d0593-b688-4e74-ae95-6336720dbe21 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:47:38.134548 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-655d0593-b688-4e74-ae95-6336720dbe21 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:47:38.134989 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-655d0593-b688-4e74-ae95-6336720dbe21 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:47:38.135702 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-655d0593-b688-4e74-ae95-6336720dbe21 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:47:38.136153 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-655d0593-b688-4e74-ae95-6336720dbe21 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:47:38.136580 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-655d0593-b688-4e74-ae95-6336720dbe21 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:47:38.222589 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-655d0593-b688-4e74-ae95-6336720dbe21 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lazy-loading 'services' on Instance uuid cf7763fa-7c2c-4d12-91db-527476cd3799 {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:47:38.296865 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-655d0593-b688-4e74-ae95-6336720dbe21 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "DELETE /compute/v2.1/servers/cf7763fa-7c2c-4d12-91db-527476cd3799/os-volume_attachments/d49be2b7-1c37-444d-bea8-fa3414e98ef4" status: 202 len: 0 microversion: 2.1 time: 0.177830 Sep 08 11:47:38.297829 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3710/7286] 10.222.0.27 () {58 vars in 1416 bytes} [Thu Sep 8 11:47:38 2022] DELETE /compute/v2.1/servers/cf7763fa-7c2c-4d12-91db-527476cd3799/os-volume_attachments/d49be2b7-1c37-444d-bea8-fa3414e98ef4 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:47:38.304053 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:47:38.304854 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:47:38.310363 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-44621cf1-83f1-4234-b112-7407298c975f tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:47:38.312976 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-44621cf1-83f1-4234-b112-7407298c975f tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] [instance: cf7763fa-7c2c-4d12-91db-527476cd3799] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:47:38.322234 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-44621cf1-83f1-4234-b112-7407298c975f tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:47:38.322688 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-44621cf1-83f1-4234-b112-7407298c975f tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:47:38.323189 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-44621cf1-83f1-4234-b112-7407298c975f tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:47:38.323918 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-44621cf1-83f1-4234-b112-7407298c975f tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:47:38.324395 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-44621cf1-83f1-4234-b112-7407298c975f tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:47:38.324839 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-44621cf1-83f1-4234-b112-7407298c975f tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:47:38.359477 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-44621cf1-83f1-4234-b112-7407298c975f tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "GET /compute/v2.1/servers/cf7763fa-7c2c-4d12-91db-527476cd3799/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057235 Sep 08 11:47:38.360062 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3577/7287] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 11:47:38 2022] GET /compute/v2.1/servers/cf7763fa-7c2c-4d12-91db-527476cd3799/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:47:39.373014 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c54150ef-70e7-4fff-aa93-297445354737 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:47:39.375388 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c54150ef-70e7-4fff-aa93-297445354737 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] [instance: cf7763fa-7c2c-4d12-91db-527476cd3799] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:47:39.382562 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c54150ef-70e7-4fff-aa93-297445354737 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:47:39.383061 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c54150ef-70e7-4fff-aa93-297445354737 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:47:39.384141 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c54150ef-70e7-4fff-aa93-297445354737 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:47:39.384825 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c54150ef-70e7-4fff-aa93-297445354737 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:47:39.385325 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c54150ef-70e7-4fff-aa93-297445354737 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:47:39.385759 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c54150ef-70e7-4fff-aa93-297445354737 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:47:39.417436 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c54150ef-70e7-4fff-aa93-297445354737 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "GET /compute/v2.1/servers/cf7763fa-7c2c-4d12-91db-527476cd3799/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049158 Sep 08 11:47:39.418041 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3711/7288] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 11:47:39 2022] GET /compute/v2.1/servers/cf7763fa-7c2c-4d12-91db-527476cd3799/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:47:40.431787 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e9ecc84c-1bf9-4e9e-977d-e9aeaf7b157d tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:47:40.434327 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e9ecc84c-1bf9-4e9e-977d-e9aeaf7b157d tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] [instance: cf7763fa-7c2c-4d12-91db-527476cd3799] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:47:40.441793 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9ecc84c-1bf9-4e9e-977d-e9aeaf7b157d tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:47:40.442433 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9ecc84c-1bf9-4e9e-977d-e9aeaf7b157d tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:47:40.442897 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9ecc84c-1bf9-4e9e-977d-e9aeaf7b157d tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:47:40.443636 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9ecc84c-1bf9-4e9e-977d-e9aeaf7b157d tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:47:40.444114 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9ecc84c-1bf9-4e9e-977d-e9aeaf7b157d tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:47:40.444557 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9ecc84c-1bf9-4e9e-977d-e9aeaf7b157d tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:47:40.479597 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e9ecc84c-1bf9-4e9e-977d-e9aeaf7b157d tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "GET /compute/v2.1/servers/cf7763fa-7c2c-4d12-91db-527476cd3799/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052222 Sep 08 11:47:40.480203 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3578/7289] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 11:47:40 2022] GET /compute/v2.1/servers/cf7763fa-7c2c-4d12-91db-527476cd3799/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:47:41.492395 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ce23036b-b423-4d5a-90f0-446fc519e660 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:47:41.495155 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ce23036b-b423-4d5a-90f0-446fc519e660 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] [instance: cf7763fa-7c2c-4d12-91db-527476cd3799] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:47:41.502217 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ce23036b-b423-4d5a-90f0-446fc519e660 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:47:41.502631 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ce23036b-b423-4d5a-90f0-446fc519e660 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:47:41.503072 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ce23036b-b423-4d5a-90f0-446fc519e660 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:47:41.503804 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ce23036b-b423-4d5a-90f0-446fc519e660 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:47:41.504225 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ce23036b-b423-4d5a-90f0-446fc519e660 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:47:41.504666 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ce23036b-b423-4d5a-90f0-446fc519e660 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:47:41.539647 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ce23036b-b423-4d5a-90f0-446fc519e660 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "GET /compute/v2.1/servers/cf7763fa-7c2c-4d12-91db-527476cd3799/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051608 Sep 08 11:47:41.540266 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3712/7290] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 11:47:41 2022] GET /compute/v2.1/servers/cf7763fa-7c2c-4d12-91db-527476cd3799/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:47:42.552076 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6da7ab29-54db-4a5b-8bc1-7dcb3b57cf6b tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:47:42.554411 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6da7ab29-54db-4a5b-8bc1-7dcb3b57cf6b tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] [instance: cf7763fa-7c2c-4d12-91db-527476cd3799] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:47:42.562091 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6da7ab29-54db-4a5b-8bc1-7dcb3b57cf6b tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:47:42.562684 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6da7ab29-54db-4a5b-8bc1-7dcb3b57cf6b tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:47:42.563243 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6da7ab29-54db-4a5b-8bc1-7dcb3b57cf6b tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:47:42.564028 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6da7ab29-54db-4a5b-8bc1-7dcb3b57cf6b tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:47:42.564567 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6da7ab29-54db-4a5b-8bc1-7dcb3b57cf6b tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:47:42.565102 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6da7ab29-54db-4a5b-8bc1-7dcb3b57cf6b tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:47:42.598096 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6da7ab29-54db-4a5b-8bc1-7dcb3b57cf6b tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "GET /compute/v2.1/servers/cf7763fa-7c2c-4d12-91db-527476cd3799/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050008 Sep 08 11:47:42.602638 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3579/7291] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 11:47:42 2022] GET /compute/v2.1/servers/cf7763fa-7c2c-4d12-91db-527476cd3799/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:47:43.610556 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bf5ca78d-ad8f-4470-a12a-27e7154be5f0 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:47:43.612717 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bf5ca78d-ad8f-4470-a12a-27e7154be5f0 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] [instance: cf7763fa-7c2c-4d12-91db-527476cd3799] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:47:43.620517 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf5ca78d-ad8f-4470-a12a-27e7154be5f0 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:47:43.621037 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf5ca78d-ad8f-4470-a12a-27e7154be5f0 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:47:43.621481 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf5ca78d-ad8f-4470-a12a-27e7154be5f0 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:47:43.622183 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf5ca78d-ad8f-4470-a12a-27e7154be5f0 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:47:43.622648 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf5ca78d-ad8f-4470-a12a-27e7154be5f0 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:47:43.623065 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf5ca78d-ad8f-4470-a12a-27e7154be5f0 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:47:43.653766 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bf5ca78d-ad8f-4470-a12a-27e7154be5f0 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "GET /compute/v2.1/servers/cf7763fa-7c2c-4d12-91db-527476cd3799/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047185 Sep 08 11:47:43.654342 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3713/7292] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 11:47:43 2022] GET /compute/v2.1/servers/cf7763fa-7c2c-4d12-91db-527476cd3799/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 11:47:43.666431 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ea367cf4-28b0-4ca4-a702-e8a71845ae3b tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:47:43.666998 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ea367cf4-28b0-4ca4-a702-e8a71845ae3b tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] [instance: cf7763fa-7c2c-4d12-91db-527476cd3799] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:47:43.673964 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea367cf4-28b0-4ca4-a702-e8a71845ae3b tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:47:43.674472 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea367cf4-28b0-4ca4-a702-e8a71845ae3b tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:47:43.674948 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea367cf4-28b0-4ca4-a702-e8a71845ae3b tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:47:43.675687 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea367cf4-28b0-4ca4-a702-e8a71845ae3b tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:47:43.676155 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea367cf4-28b0-4ca4-a702-e8a71845ae3b tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:47:43.676627 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea367cf4-28b0-4ca4-a702-e8a71845ae3b tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:47:43.759765 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-ea367cf4-28b0-4ca4-a702-e8a71845ae3b tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] HTTP exception thrown: Instance cf7763fa-7c2c-4d12-91db-527476cd3799 is not attached to volume d49be2b7-1c37-444d-bea8-fa3414e98ef4 Sep 08 11:47:43.772583 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ea367cf4-28b0-4ca4-a702-e8a71845ae3b tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Request method failure captured: Sep 08 11:47:43.772583 n-d-850501-12 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/servers/cf7763fa-7c2c-4d12-91db-527476cd3799/os-volume_attachments/d49be2b7-1c37-444d-bea8-fa3414e98ef4 HTTP/1.1 Sep 08 11:47:43.772583 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 11:47:43.772583 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 11:47:43.772583 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 11:47:43.772583 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 11:47:43.772583 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 11:47:43.772583 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 11:47:43.772583 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 11:47:43.772583 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 11:47:43.772583 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGdY8gUeJdpjSGW7jdIynOwQtfPRRhOFAU_kUawURrTao31k-U7JhDXRTiBz-xLd1NLJK73p_170PApmzvFFr9yhED0yBrXqu9R8kNuwTLD4PsPuJhtBR65uKQb_FEr2KnfUiesq9tYlsz1hotiyJdDnImi3VzMhBfsbVOY8PHP27k1Q Sep 08 11:47:43.772583 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 11:47:43.772583 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 11:47:43.772583 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 11:47:43.772583 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 11:47:43.772583 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 11:47:43.772583 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 11:47:43.772583 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: eb883d25c960430aa07ef867fae8a4cb Sep 08 11:47:43.772583 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1722295247 Sep 08 11:47:43.772583 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 11:47:43.772583 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 11:47:43.772583 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/eb883d25c960430aa07ef867fae8a4cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eb883d25c960430aa07ef867fae8a4cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_eb883d25c960430aa07ef867fae8a4cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eb883d25c960430aa07ef867fae8a4cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:47:43.772583 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-TestEncryptedCinderVolumes-1722295247 Sep 08 11:47:43.772583 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: eb883d25c960430aa07ef867fae8a4cb Sep 08 11:47:43.772583 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1722295247 Sep 08 11:47:43.772583 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-TestEncryptedCinderVolumes-1722295247-project Sep 08 11:47:43.772583 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 11:47:43.772583 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 11:47:43.772583 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: fc1fafbc7eb84004b96f0b4a82d37c21 Sep 08 11:47:43.772583 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-TestEncryptedCinderVolumes-1722295247-project Sep 08 11:47:43.772583 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 11:47:43.772583 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance cf7763fa-7c2c-4d12-91db-527476cd3799 is not attached to volume d49be2b7-1c37-444d-bea8-fa3414e98ef4 Sep 08 11:47:43.772583 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'server_id': 'cf7763fa-7c2c-4d12-91db-527476cd3799', 'id': 'd49be2b7-1c37-444d-bea8-fa3414e98ef4'} Sep 08 11:47:43.772583 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:47:43.772583 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:47:43.772583 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 08 11:47:43.772583 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 08 11:47:43.772583 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 11:47:43.772583 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 11:47:43.772583 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 08 11:47:43.772583 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 08 11:47:43.772583 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d49be2b7-1c37-444d-bea8-fa3414e98ef4. Sep 08 11:47:43.772583 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:47:43.772583 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:47:43.772583 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:47:43.772583 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:47:43.772583 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:47:43.772583 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:47:43.772583 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:47:43.772583 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:47:43.772583 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:47:43.772583 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:47:43.772583 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 08 11:47:43.772583 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 08 11:47:43.772583 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf7763fa-7c2c-4d12-91db-527476cd3799 is not attached to volume d49be2b7-1c37-444d-bea8-fa3414e98ef4 Sep 08 11:47:43.772583 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:47:43.772583 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:47:43.772583 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:47:43.772583 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:47:43.772583 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:47:43.772583 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:47:43.778067 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:47:43.778067 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:47:43.778067 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf7763fa-7c2c-4d12-91db-527476cd3799 is not attached to volume d49be2b7-1c37-444d-bea8-fa3414e98ef4 Sep 08 11:47:43.778067 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:47:43.778067 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ea367cf4-28b0-4ca4-a702-e8a71845ae3b tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Returning 404 to user: Instance cf7763fa-7c2c-4d12-91db-527476cd3799 is not attached to volume d49be2b7-1c37-444d-bea8-fa3414e98ef4 {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:47:43.778067 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ea367cf4-28b0-4ca4-a702-e8a71845ae3b tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "DELETE /compute/v2.1/servers/cf7763fa-7c2c-4d12-91db-527476cd3799/os-volume_attachments/d49be2b7-1c37-444d-bea8-fa3414e98ef4" status: 404 len: 154 microversion: 2.1 time: 0.112728 Sep 08 11:47:43.778067 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3580/7293] 10.222.0.27 () {58 vars in 1416 bytes} [Thu Sep 8 11:47:43 2022] DELETE /compute/v2.1/servers/cf7763fa-7c2c-4d12-91db-527476cd3799/os-volume_attachments/d49be2b7-1c37-444d-bea8-fa3414e98ef4 => generated 154 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:47:47.151723 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cd7017ed-593b-4652-8302-da75d0718129 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:47:47.152334 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cd7017ed-593b-4652-8302-da75d0718129 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] [instance: cf7763fa-7c2c-4d12-91db-527476cd3799] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:47:47.159723 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cd7017ed-593b-4652-8302-da75d0718129 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:47:47.160243 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cd7017ed-593b-4652-8302-da75d0718129 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:47:47.160687 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cd7017ed-593b-4652-8302-da75d0718129 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:47:47.161436 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cd7017ed-593b-4652-8302-da75d0718129 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:47:47.161897 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cd7017ed-593b-4652-8302-da75d0718129 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:47:47.162328 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cd7017ed-593b-4652-8302-da75d0718129 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:47:47.189168 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cd7017ed-593b-4652-8302-da75d0718129 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] [instance: cf7763fa-7c2c-4d12-91db-527476cd3799] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:47:47.285314 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cd7017ed-593b-4652-8302-da75d0718129 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "DELETE /compute/v2.1/servers/cf7763fa-7c2c-4d12-91db-527476cd3799" status: 204 len: 0 microversion: 2.1 time: 0.138212 Sep 08 11:47:47.289139 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3714/7294] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:47:47 2022] DELETE /compute/v2.1/servers/cf7763fa-7c2c-4d12-91db-527476cd3799 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:47:47.294831 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e7f28a9d-5b9d-449d-a511-ca9b646af1d0 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:47:47.295397 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e7f28a9d-5b9d-449d-a511-ca9b646af1d0 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] [instance: cf7763fa-7c2c-4d12-91db-527476cd3799] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:47:47.302424 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7f28a9d-5b9d-449d-a511-ca9b646af1d0 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:47:47.302935 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7f28a9d-5b9d-449d-a511-ca9b646af1d0 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:47:47.303397 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7f28a9d-5b9d-449d-a511-ca9b646af1d0 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:47:47.304123 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7f28a9d-5b9d-449d-a511-ca9b646af1d0 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:47:47.304590 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7f28a9d-5b9d-449d-a511-ca9b646af1d0 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:47:47.305589 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7f28a9d-5b9d-449d-a511-ca9b646af1d0 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:47:47.463650 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e7f28a9d-5b9d-449d-a511-ca9b646af1d0 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fafbc7eb84004b96f0b4a82d37c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb883d25c960430aa07ef867fae8a4cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:47:47.472815 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e7f28a9d-5b9d-449d-a511-ca9b646af1d0 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "GET /compute/v2.1/servers/cf7763fa-7c2c-4d12-91db-527476cd3799" status: 200 len: 1559 microversion: 2.1 time: 0.182181 Sep 08 11:47:47.473444 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3581/7295] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:47:47 2022] GET /compute/v2.1/servers/cf7763fa-7c2c-4d12-91db-527476cd3799 => generated 1559 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:47:48.497549 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9a7fc1fd-4783-42e4-8aef-9ffa1bf9df6d tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:47:48.498266 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9a7fc1fd-4783-42e4-8aef-9ffa1bf9df6d tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] [instance: cf7763fa-7c2c-4d12-91db-527476cd3799] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:47:48.508185 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9a7fc1fd-4783-42e4-8aef-9ffa1bf9df6d tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:47:48.509095 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9a7fc1fd-4783-42e4-8aef-9ffa1bf9df6d tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:47:48.509789 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9a7fc1fd-4783-42e4-8aef-9ffa1bf9df6d tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:47:48.510659 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9a7fc1fd-4783-42e4-8aef-9ffa1bf9df6d tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:47:48.511250 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9a7fc1fd-4783-42e4-8aef-9ffa1bf9df6d tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:47:48.511689 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9a7fc1fd-4783-42e4-8aef-9ffa1bf9df6d tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:47:48.668631 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9a7fc1fd-4783-42e4-8aef-9ffa1bf9df6d tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fafbc7eb84004b96f0b4a82d37c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb883d25c960430aa07ef867fae8a4cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:47:48.676973 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9a7fc1fd-4783-42e4-8aef-9ffa1bf9df6d tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "GET /compute/v2.1/servers/cf7763fa-7c2c-4d12-91db-527476cd3799" status: 200 len: 1559 microversion: 2.1 time: 0.184427 Sep 08 11:47:48.677599 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3715/7296] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:47:48 2022] GET /compute/v2.1/servers/cf7763fa-7c2c-4d12-91db-527476cd3799 => generated 1559 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:47:49.456249 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-b6a9547d-6da6-44e5-b722-444a6dc74ccf req-c36eee8d-269c-4945-84b7-2adb50be7dbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf7763fa-7c2c-4d12-91db-527476cd3799", "name": "network-vif-deleted", "tag": "e406488d-13c9-4b0d-b279-41b2e6c5c9d4"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:47:49.469215 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b6a9547d-6da6-44e5-b722-444a6dc74ccf req-c36eee8d-269c-4945-84b7-2adb50be7dbc service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:47:49.469732 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b6a9547d-6da6-44e5-b722-444a6dc74ccf req-c36eee8d-269c-4945-84b7-2adb50be7dbc service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:47:49.470191 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b6a9547d-6da6-44e5-b722-444a6dc74ccf req-c36eee8d-269c-4945-84b7-2adb50be7dbc service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:47:49.495564 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-b6a9547d-6da6-44e5-b722-444a6dc74ccf req-c36eee8d-269c-4945-84b7-2adb50be7dbc service nova] Creating event network-vif-deleted:e406488d-13c9-4b0d-b279-41b2e6c5c9d4 for instance cf7763fa-7c2c-4d12-91db-527476cd3799 on n-h1-850501-12 Sep 08 11:47:49.500794 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-b6a9547d-6da6-44e5-b722-444a6dc74ccf req-c36eee8d-269c-4945-84b7-2adb50be7dbc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048196 Sep 08 11:47:49.501853 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3582/7297] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:47:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:47:49.704492 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8f3a39d5-804a-44c4-bf99-ebb6a2ad1d03 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:47:49.706025 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8f3a39d5-804a-44c4-bf99-ebb6a2ad1d03 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] [instance: cf7763fa-7c2c-4d12-91db-527476cd3799] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:47:49.714617 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f3a39d5-804a-44c4-bf99-ebb6a2ad1d03 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:47:49.715116 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f3a39d5-804a-44c4-bf99-ebb6a2ad1d03 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:47:49.715574 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f3a39d5-804a-44c4-bf99-ebb6a2ad1d03 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:47:49.716273 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f3a39d5-804a-44c4-bf99-ebb6a2ad1d03 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:47:49.716733 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f3a39d5-804a-44c4-bf99-ebb6a2ad1d03 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:47:49.717212 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f3a39d5-804a-44c4-bf99-ebb6a2ad1d03 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:47:49.752026 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f3a39d5-804a-44c4-bf99-ebb6a2ad1d03 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:47:49.752507 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f3a39d5-804a-44c4-bf99-ebb6a2ad1d03 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:47:49.752945 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f3a39d5-804a-44c4-bf99-ebb6a2ad1d03 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:47:49.753429 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-8f3a39d5-804a-44c4-bf99-ebb6a2ad1d03 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lazy-loading 'fault' on Instance uuid cf7763fa-7c2c-4d12-91db-527476cd3799 {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:47:49.802177 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8f3a39d5-804a-44c4-bf99-ebb6a2ad1d03 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fafbc7eb84004b96f0b4a82d37c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb883d25c960430aa07ef867fae8a4cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:47:49.810430 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8f3a39d5-804a-44c4-bf99-ebb6a2ad1d03 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "GET /compute/v2.1/servers/cf7763fa-7c2c-4d12-91db-527476cd3799" status: 200 len: 1352 microversion: 2.1 time: 0.111851 Sep 08 11:47:49.811012 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3716/7298] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:47:49 2022] GET /compute/v2.1/servers/cf7763fa-7c2c-4d12-91db-527476cd3799 => generated 1352 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:47:50.835672 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-76d31ad5-ec69-4e15-9c2a-0cdef4c87191 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:47:50.836704 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-76d31ad5-ec69-4e15-9c2a-0cdef4c87191 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] [instance: cf7763fa-7c2c-4d12-91db-527476cd3799] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:47:50.843014 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76d31ad5-ec69-4e15-9c2a-0cdef4c87191 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:47:50.843526 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76d31ad5-ec69-4e15-9c2a-0cdef4c87191 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:47:50.843982 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76d31ad5-ec69-4e15-9c2a-0cdef4c87191 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:47:50.844696 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76d31ad5-ec69-4e15-9c2a-0cdef4c87191 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:47:50.845204 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76d31ad5-ec69-4e15-9c2a-0cdef4c87191 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:47:50.845653 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76d31ad5-ec69-4e15-9c2a-0cdef4c87191 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:47:50.859223 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-76d31ad5-ec69-4e15-9c2a-0cdef4c87191 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] HTTP exception thrown: Instance cf7763fa-7c2c-4d12-91db-527476cd3799 could not be found. Sep 08 11:47:50.860874 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-76d31ad5-ec69-4e15-9c2a-0cdef4c87191 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Request method failure captured: Sep 08 11:47:50.860874 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/cf7763fa-7c2c-4d12-91db-527476cd3799 HTTP/1.1 Sep 08 11:47:50.860874 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 11:47:50.860874 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 11:47:50.860874 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 11:47:50.860874 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 11:47:50.860874 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 11:47:50.860874 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 11:47:50.860874 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 11:47:50.860874 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 11:47:50.860874 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGdY8gUeJdpjSGW7jdIynOwQtfPRRhOFAU_kUawURrTao31k-U7JhDXRTiBz-xLd1NLJK73p_170PApmzvFFr9yhED0yBrXqu9R8kNuwTLD4PsPuJhtBR65uKQb_FEr2KnfUiesq9tYlsz1hotiyJdDnImi3VzMhBfsbVOY8PHP27k1Q Sep 08 11:47:50.860874 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 11:47:50.860874 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 11:47:50.860874 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 11:47:50.860874 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 11:47:50.860874 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 11:47:50.860874 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 11:47:50.860874 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: eb883d25c960430aa07ef867fae8a4cb Sep 08 11:47:50.860874 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1722295247 Sep 08 11:47:50.860874 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 11:47:50.860874 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 11:47:50.860874 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/eb883d25c960430aa07ef867fae8a4cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eb883d25c960430aa07ef867fae8a4cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_eb883d25c960430aa07ef867fae8a4cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eb883d25c960430aa07ef867fae8a4cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:47:50.860874 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-TestEncryptedCinderVolumes-1722295247 Sep 08 11:47:50.860874 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: eb883d25c960430aa07ef867fae8a4cb Sep 08 11:47:50.860874 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1722295247 Sep 08 11:47:50.860874 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-TestEncryptedCinderVolumes-1722295247-project Sep 08 11:47:50.860874 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 11:47:50.860874 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 11:47:50.860874 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: fc1fafbc7eb84004b96f0b4a82d37c21 Sep 08 11:47:50.860874 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-TestEncryptedCinderVolumes-1722295247-project Sep 08 11:47:50.860874 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 11:47:50.860874 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance cf7763fa-7c2c-4d12-91db-527476cd3799 could not be found. Sep 08 11:47:50.860874 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'cf7763fa-7c2c-4d12-91db-527476cd3799'} Sep 08 11:47:50.860874 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:47:50.860874 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:47:50.860874 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:47:50.860874 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:47:50.860874 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:47:50.860874 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:47:50.860874 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:47:50.860874 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:47:50.860874 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:47:50.860874 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:47:50.860874 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf7763fa-7c2c-4d12-91db-527476cd3799 could not be found. Sep 08 11:47:50.860874 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:47:50.860874 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:47:50.860874 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:47:50.860874 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:47:50.860874 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:47:50.860874 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:47:50.860874 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:47:50.860874 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:47:50.860874 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:47:50.860874 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:47:50.860874 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:47:50.860874 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:47:50.860874 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:47:50.860874 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:47:50.860874 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:47:50.860874 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:47:50.860874 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf7763fa-7c2c-4d12-91db-527476cd3799 could not be found. Sep 08 11:47:50.860874 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:47:50.860874 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:47:50.865610 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:47:50.865610 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:47:50.865610 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:47:50.865610 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:47:50.865610 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:47:50.865610 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:47:50.865610 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf7763fa-7c2c-4d12-91db-527476cd3799 could not be found. Sep 08 11:47:50.865610 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:47:50.865610 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-76d31ad5-ec69-4e15-9c2a-0cdef4c87191 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Returning 404 to user: Instance cf7763fa-7c2c-4d12-91db-527476cd3799 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:47:50.865610 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-76d31ad5-ec69-4e15-9c2a-0cdef4c87191 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "GET /compute/v2.1/servers/cf7763fa-7c2c-4d12-91db-527476cd3799" status: 404 len: 111 microversion: 2.1 time: 0.031914 Sep 08 11:47:50.865610 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3583/7299] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:47:50 2022] GET /compute/v2.1/servers/cf7763fa-7c2c-4d12-91db-527476cd3799 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:47:50.872315 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-16d42d09-055b-4220-bcf5-1d704aab93e8 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Calling method '.version_select at 0x7f68df166700>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:47:50.895162 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-16d42d09-055b-4220-bcf5-1d704aab93e8 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-391187230" status: 202 len: 0 microversion: 2.1 time: 0.026408 Sep 08 11:47:50.895329 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3717/7300] 10.222.0.27 () {58 vars in 1275 bytes} [Thu Sep 8 11:47:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-391187230 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:47:50.912995 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ff48a04f-68f7-456b-98e0-88ef8018b95d tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Action: 'create', calling method: .version_select at 0x7f68e46c9550>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-2003695958", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOOXsF/RR3X4w1p+hVflq7xL7IJCg+zkw4SqwUBQcFNGTooeMvxNhHAiVNq6sO1i5awfu0D4T96S32i/4rhJF6ABFDU6h0YHwsTDQdhhbLfCTyyDQfe6Htu68wBrx6KN6Q=="}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:47:50.928607 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-ff48a04f-68f7-456b-98e0-88ef8018b95d tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Getting quotas for project eb883d25c960430aa07ef867fae8a4cb. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:47:50.934313 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-ff48a04f-68f7-456b-98e0-88ef8018b95d tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Getting quotas for user fc1fafbc7eb84004b96f0b4a82d37c21 and project eb883d25c960430aa07ef867fae8a4cb. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:47:50.960066 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ff48a04f-68f7-456b-98e0-88ef8018b95d tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.051199 Sep 08 11:47:50.960682 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3584/7301] 10.222.0.27 () {60 vars in 1159 bytes} [Thu Sep 8 11:47:50 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:47:51.014758 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c7b6dfe8-d136-496a-ac8a-4b64fc443923 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-46804206", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-2003695958", "networks": [{"uuid": "bc9b5977-c89a-4665-9707-9e55e005b094"}]}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:47:51.067276 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-c7b6dfe8-d136-496a-ac8a-4b64fc443923 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] validate_networks() for [('bc9b5977-c89a-4665-9707-9e55e005b094', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:47:51.545604 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-c7b6dfe8-d136-496a-ac8a-4b64fc443923 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:47:51.546079 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-c7b6dfe8-d136-496a-ac8a-4b64fc443923 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:47:51.546905 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-c7b6dfe8-d136-496a-ac8a-4b64fc443923 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:47:51.547323 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-c7b6dfe8-d136-496a-ac8a-4b64fc443923 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:47:51.547736 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-c7b6dfe8-d136-496a-ac8a-4b64fc443923 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:47:51.558115 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c7b6dfe8-d136-496a-ac8a-4b64fc443923 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:47:51.558599 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c7b6dfe8-d136-496a-ac8a-4b64fc443923 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:47:51.559029 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c7b6dfe8-d136-496a-ac8a-4b64fc443923 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:47:51.559750 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c7b6dfe8-d136-496a-ac8a-4b64fc443923 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:47:51.560200 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c7b6dfe8-d136-496a-ac8a-4b64fc443923 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:47:51.560621 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c7b6dfe8-d136-496a-ac8a-4b64fc443923 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:47:51.578860 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-c7b6dfe8-d136-496a-ac8a-4b64fc443923 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Getting quotas for project eb883d25c960430aa07ef867fae8a4cb. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:47:51.584050 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-c7b6dfe8-d136-496a-ac8a-4b64fc443923 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Getting quotas for user fc1fafbc7eb84004b96f0b4a82d37c21 and project eb883d25c960430aa07ef867fae8a4cb. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:47:51.596925 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c7b6dfe8-d136-496a-ac8a-4b64fc443923 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:47:51.599301 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c7b6dfe8-d136-496a-ac8a-4b64fc443923 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] [instance: 68d593d9-89e9-4ffd-8ad2-4661e7568e2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:47:51.649535 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c7b6dfe8-d136-496a-ac8a-4b64fc443923 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.638141 Sep 08 11:47:51.650186 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3718/7302] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 11:47:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:47:51.661974 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e49caee9-3b01-47c5-adf3-493e943fa459 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:47:51.662644 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e49caee9-3b01-47c5-adf3-493e943fa459 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] [instance: 68d593d9-89e9-4ffd-8ad2-4661e7568e2c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:47:51.729304 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e49caee9-3b01-47c5-adf3-493e943fa459 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fafbc7eb84004b96f0b4a82d37c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb883d25c960430aa07ef867fae8a4cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:47:51.737297 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e49caee9-3b01-47c5-adf3-493e943fa459 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "GET /compute/v2.1/servers/68d593d9-89e9-4ffd-8ad2-4661e7568e2c" status: 200 len: 1261 microversion: 2.1 time: 0.079609 Sep 08 11:47:51.737937 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3585/7303] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:47:51 2022] GET /compute/v2.1/servers/68d593d9-89e9-4ffd-8ad2-4661e7568e2c => generated 1261 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:47:52.761870 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-60b63a4c-dbbf-4473-ac0f-4bc4a604eeff tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:47:52.763363 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-60b63a4c-dbbf-4473-ac0f-4bc4a604eeff tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] [instance: 68d593d9-89e9-4ffd-8ad2-4661e7568e2c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:47:52.771963 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-60b63a4c-dbbf-4473-ac0f-4bc4a604eeff tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:47:52.772935 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-60b63a4c-dbbf-4473-ac0f-4bc4a604eeff tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:47:52.773470 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-60b63a4c-dbbf-4473-ac0f-4bc4a604eeff tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:47:52.774307 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-60b63a4c-dbbf-4473-ac0f-4bc4a604eeff tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:47:52.774823 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-60b63a4c-dbbf-4473-ac0f-4bc4a604eeff tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:47:52.775465 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-60b63a4c-dbbf-4473-ac0f-4bc4a604eeff tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:47:52.860918 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-60b63a4c-dbbf-4473-ac0f-4bc4a604eeff tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fafbc7eb84004b96f0b4a82d37c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb883d25c960430aa07ef867fae8a4cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:47:52.873980 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-60b63a4c-dbbf-4473-ac0f-4bc4a604eeff tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "GET /compute/v2.1/servers/68d593d9-89e9-4ffd-8ad2-4661e7568e2c" status: 200 len: 1321 microversion: 2.1 time: 0.116679 Sep 08 11:47:52.875232 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3719/7304] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:47:52 2022] GET /compute/v2.1/servers/68d593d9-89e9-4ffd-8ad2-4661e7568e2c => generated 1321 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:47:53.898052 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ac20a894-e3ca-4132-9d53-86a80ef222ff tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:47:53.898778 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ac20a894-e3ca-4132-9d53-86a80ef222ff tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] [instance: 68d593d9-89e9-4ffd-8ad2-4661e7568e2c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:47:53.906141 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ac20a894-e3ca-4132-9d53-86a80ef222ff tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:47:53.906583 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ac20a894-e3ca-4132-9d53-86a80ef222ff tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:47:53.907029 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ac20a894-e3ca-4132-9d53-86a80ef222ff tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:47:53.907742 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ac20a894-e3ca-4132-9d53-86a80ef222ff tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:47:53.908213 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ac20a894-e3ca-4132-9d53-86a80ef222ff tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:47:53.908661 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ac20a894-e3ca-4132-9d53-86a80ef222ff tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:47:54.050257 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ac20a894-e3ca-4132-9d53-86a80ef222ff tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fafbc7eb84004b96f0b4a82d37c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb883d25c960430aa07ef867fae8a4cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:47:54.059166 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ac20a894-e3ca-4132-9d53-86a80ef222ff tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "GET /compute/v2.1/servers/68d593d9-89e9-4ffd-8ad2-4661e7568e2c" status: 200 len: 1361 microversion: 2.1 time: 0.164958 Sep 08 11:47:54.059763 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3586/7305] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:47:53 2022] GET /compute/v2.1/servers/68d593d9-89e9-4ffd-8ad2-4661e7568e2c => generated 1361 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:47:54.254791 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-e44c973e-a419-4510-8356-e6c79f9dde44 req-000173de-7c38-4c23-9296-ed8e69f30594 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68d593d9-89e9-4ffd-8ad2-4661e7568e2c", "tag": "be88e6fe-cc16-4cdd-8ad1-66110776701a"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:47:54.265284 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-e44c973e-a419-4510-8356-e6c79f9dde44 req-000173de-7c38-4c23-9296-ed8e69f30594 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:47:54.266528 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-e44c973e-a419-4510-8356-e6c79f9dde44 req-000173de-7c38-4c23-9296-ed8e69f30594 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:47:54.266528 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-e44c973e-a419-4510-8356-e6c79f9dde44 req-000173de-7c38-4c23-9296-ed8e69f30594 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:47:54.279237 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-e44c973e-a419-4510-8356-e6c79f9dde44 req-000173de-7c38-4c23-9296-ed8e69f30594 service nova] Creating event network-changed:be88e6fe-cc16-4cdd-8ad1-66110776701a for instance 68d593d9-89e9-4ffd-8ad2-4661e7568e2c on n-h1-850501-12 Sep 08 11:47:54.284815 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-e44c973e-a419-4510-8356-e6c79f9dde44 req-000173de-7c38-4c23-9296-ed8e69f30594 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034323 Sep 08 11:47:54.286517 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3720/7306] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:47:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:47:55.082367 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-89468d80-81c0-4be1-baf0-756fbb20b583 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:47:55.082989 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-89468d80-81c0-4be1-baf0-756fbb20b583 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] [instance: 68d593d9-89e9-4ffd-8ad2-4661e7568e2c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:47:55.090823 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89468d80-81c0-4be1-baf0-756fbb20b583 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:47:55.091328 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89468d80-81c0-4be1-baf0-756fbb20b583 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:47:55.091785 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89468d80-81c0-4be1-baf0-756fbb20b583 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:47:55.092509 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89468d80-81c0-4be1-baf0-756fbb20b583 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:47:55.092974 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89468d80-81c0-4be1-baf0-756fbb20b583 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:47:55.093437 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89468d80-81c0-4be1-baf0-756fbb20b583 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:47:55.228432 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-89468d80-81c0-4be1-baf0-756fbb20b583 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fafbc7eb84004b96f0b4a82d37c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb883d25c960430aa07ef867fae8a4cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:47:55.242144 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-89468d80-81c0-4be1-baf0-756fbb20b583 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "GET /compute/v2.1/servers/68d593d9-89e9-4ffd-8ad2-4661e7568e2c" status: 200 len: 1361 microversion: 2.1 time: 0.162754 Sep 08 11:47:55.242144 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3587/7307] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:47:55 2022] GET /compute/v2.1/servers/68d593d9-89e9-4ffd-8ad2-4661e7568e2c => generated 1361 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:47:56.272726 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-66e562c8-f03e-4572-82bf-4ad0b81f131f tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:47:56.273457 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-66e562c8-f03e-4572-82bf-4ad0b81f131f tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] [instance: 68d593d9-89e9-4ffd-8ad2-4661e7568e2c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:47:56.280283 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-66e562c8-f03e-4572-82bf-4ad0b81f131f tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:47:56.280802 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-66e562c8-f03e-4572-82bf-4ad0b81f131f tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:47:56.281269 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-66e562c8-f03e-4572-82bf-4ad0b81f131f tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:47:56.281964 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-66e562c8-f03e-4572-82bf-4ad0b81f131f tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:47:56.282424 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-66e562c8-f03e-4572-82bf-4ad0b81f131f tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:47:56.282852 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-66e562c8-f03e-4572-82bf-4ad0b81f131f tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:47:56.423288 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-66e562c8-f03e-4572-82bf-4ad0b81f131f tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fafbc7eb84004b96f0b4a82d37c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb883d25c960430aa07ef867fae8a4cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:47:56.431212 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-66e562c8-f03e-4572-82bf-4ad0b81f131f tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "GET /compute/v2.1/servers/68d593d9-89e9-4ffd-8ad2-4661e7568e2c" status: 200 len: 1361 microversion: 2.1 time: 0.163584 Sep 08 11:47:56.431839 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3721/7308] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:47:56 2022] GET /compute/v2.1/servers/68d593d9-89e9-4ffd-8ad2-4661e7568e2c => generated 1361 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:47:57.454858 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fb202bea-6a98-4ff1-a3af-979e97c28959 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:47:57.455528 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fb202bea-6a98-4ff1-a3af-979e97c28959 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] [instance: 68d593d9-89e9-4ffd-8ad2-4661e7568e2c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:47:57.462908 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb202bea-6a98-4ff1-a3af-979e97c28959 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:47:57.463428 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb202bea-6a98-4ff1-a3af-979e97c28959 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:47:57.463890 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb202bea-6a98-4ff1-a3af-979e97c28959 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:47:57.464625 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb202bea-6a98-4ff1-a3af-979e97c28959 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:47:57.465138 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb202bea-6a98-4ff1-a3af-979e97c28959 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:47:57.465584 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb202bea-6a98-4ff1-a3af-979e97c28959 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:47:57.612824 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fb202bea-6a98-4ff1-a3af-979e97c28959 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fafbc7eb84004b96f0b4a82d37c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb883d25c960430aa07ef867fae8a4cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:47:57.621267 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fb202bea-6a98-4ff1-a3af-979e97c28959 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "GET /compute/v2.1/servers/68d593d9-89e9-4ffd-8ad2-4661e7568e2c" status: 200 len: 1361 microversion: 2.1 time: 0.170310 Sep 08 11:47:57.621877 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3588/7309] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:47:57 2022] GET /compute/v2.1/servers/68d593d9-89e9-4ffd-8ad2-4661e7568e2c => generated 1361 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:47:58.644210 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-926f02de-97e2-4c0a-9001-f88595c6bc3e tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:47:58.644811 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-926f02de-97e2-4c0a-9001-f88595c6bc3e tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] [instance: 68d593d9-89e9-4ffd-8ad2-4661e7568e2c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:47:58.651719 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-926f02de-97e2-4c0a-9001-f88595c6bc3e tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:47:58.652202 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-926f02de-97e2-4c0a-9001-f88595c6bc3e tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:47:58.652635 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-926f02de-97e2-4c0a-9001-f88595c6bc3e tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:47:58.653349 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-926f02de-97e2-4c0a-9001-f88595c6bc3e tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:47:58.653800 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-926f02de-97e2-4c0a-9001-f88595c6bc3e tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:47:58.654222 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-926f02de-97e2-4c0a-9001-f88595c6bc3e tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:47:58.787158 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-926f02de-97e2-4c0a-9001-f88595c6bc3e tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fafbc7eb84004b96f0b4a82d37c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb883d25c960430aa07ef867fae8a4cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:47:58.796119 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-926f02de-97e2-4c0a-9001-f88595c6bc3e tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "GET /compute/v2.1/servers/68d593d9-89e9-4ffd-8ad2-4661e7568e2c" status: 200 len: 1361 microversion: 2.1 time: 0.155858 Sep 08 11:47:58.796717 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3722/7310] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:47:58 2022] GET /compute/v2.1/servers/68d593d9-89e9-4ffd-8ad2-4661e7568e2c => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:47:59.174033 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-510a36db-4ff5-4068-8d35-47a4b2883fbb req-581c936d-bf3e-4b94-8b17-c7144eb240d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68d593d9-89e9-4ffd-8ad2-4661e7568e2c", "name": "network-vif-plugged", "status": "completed", "tag": "be88e6fe-cc16-4cdd-8ad1-66110776701a"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:47:59.185310 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-510a36db-4ff5-4068-8d35-47a4b2883fbb req-581c936d-bf3e-4b94-8b17-c7144eb240d2 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:47:59.185815 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-510a36db-4ff5-4068-8d35-47a4b2883fbb req-581c936d-bf3e-4b94-8b17-c7144eb240d2 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:47:59.186257 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-510a36db-4ff5-4068-8d35-47a4b2883fbb req-581c936d-bf3e-4b94-8b17-c7144eb240d2 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:47:59.199299 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-510a36db-4ff5-4068-8d35-47a4b2883fbb req-581c936d-bf3e-4b94-8b17-c7144eb240d2 service nova] Creating event network-vif-plugged:be88e6fe-cc16-4cdd-8ad1-66110776701a for instance 68d593d9-89e9-4ffd-8ad2-4661e7568e2c on n-h1-850501-12 Sep 08 11:47:59.207374 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-510a36db-4ff5-4068-8d35-47a4b2883fbb req-581c936d-bf3e-4b94-8b17-c7144eb240d2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036489 Sep 08 11:47:59.208113 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3589/7311] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:47:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:47:59.819419 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-087d50e5-32d1-416d-8f39-2f66f2993dc1 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:47:59.820027 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-087d50e5-32d1-416d-8f39-2f66f2993dc1 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] [instance: 68d593d9-89e9-4ffd-8ad2-4661e7568e2c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:47:59.827396 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-087d50e5-32d1-416d-8f39-2f66f2993dc1 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:47:59.827886 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-087d50e5-32d1-416d-8f39-2f66f2993dc1 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:47:59.828322 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-087d50e5-32d1-416d-8f39-2f66f2993dc1 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:47:59.829041 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-087d50e5-32d1-416d-8f39-2f66f2993dc1 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:47:59.829502 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-087d50e5-32d1-416d-8f39-2f66f2993dc1 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:47:59.829927 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-087d50e5-32d1-416d-8f39-2f66f2993dc1 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:47:59.965845 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-087d50e5-32d1-416d-8f39-2f66f2993dc1 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fafbc7eb84004b96f0b4a82d37c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb883d25c960430aa07ef867fae8a4cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:47:59.973992 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-087d50e5-32d1-416d-8f39-2f66f2993dc1 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "GET /compute/v2.1/servers/68d593d9-89e9-4ffd-8ad2-4661e7568e2c" status: 200 len: 1361 microversion: 2.1 time: 0.158350 Sep 08 11:47:59.974575 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3723/7312] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:47:59 2022] GET /compute/v2.1/servers/68d593d9-89e9-4ffd-8ad2-4661e7568e2c => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:48:00.999658 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e9a8f2da-0ec8-46f4-9e84-fc30b0e36592 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:48:01.000380 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e9a8f2da-0ec8-46f4-9e84-fc30b0e36592 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] [instance: 68d593d9-89e9-4ffd-8ad2-4661e7568e2c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:48:01.006606 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9a8f2da-0ec8-46f4-9e84-fc30b0e36592 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:01.007112 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9a8f2da-0ec8-46f4-9e84-fc30b0e36592 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:01.007570 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9a8f2da-0ec8-46f4-9e84-fc30b0e36592 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:01.008286 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9a8f2da-0ec8-46f4-9e84-fc30b0e36592 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:01.008786 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9a8f2da-0ec8-46f4-9e84-fc30b0e36592 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:01.009559 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9a8f2da-0ec8-46f4-9e84-fc30b0e36592 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:01.142591 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e9a8f2da-0ec8-46f4-9e84-fc30b0e36592 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fafbc7eb84004b96f0b4a82d37c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb883d25c960430aa07ef867fae8a4cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:48:01.150287 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e9a8f2da-0ec8-46f4-9e84-fc30b0e36592 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "GET /compute/v2.1/servers/68d593d9-89e9-4ffd-8ad2-4661e7568e2c" status: 200 len: 1553 microversion: 2.1 time: 0.155841 Sep 08 11:48:01.150948 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3590/7313] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:48:00 2022] GET /compute/v2.1/servers/68d593d9-89e9-4ffd-8ad2-4661e7568e2c => generated 1553 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:48:01.173229 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ca35c800-3012-495e-afe7-c7b72b7f9efc tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:48:01.173847 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ca35c800-3012-495e-afe7-c7b72b7f9efc tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] [instance: 68d593d9-89e9-4ffd-8ad2-4661e7568e2c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:48:01.181469 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ca35c800-3012-495e-afe7-c7b72b7f9efc tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:01.181957 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ca35c800-3012-495e-afe7-c7b72b7f9efc tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:01.182396 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ca35c800-3012-495e-afe7-c7b72b7f9efc tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:01.183089 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ca35c800-3012-495e-afe7-c7b72b7f9efc tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:01.183545 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ca35c800-3012-495e-afe7-c7b72b7f9efc tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:01.183974 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ca35c800-3012-495e-afe7-c7b72b7f9efc tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:01.322910 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ca35c800-3012-495e-afe7-c7b72b7f9efc tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fafbc7eb84004b96f0b4a82d37c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb883d25c960430aa07ef867fae8a4cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:48:01.331296 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ca35c800-3012-495e-afe7-c7b72b7f9efc tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "GET /compute/v2.1/servers/68d593d9-89e9-4ffd-8ad2-4661e7568e2c" status: 200 len: 1553 microversion: 2.1 time: 0.161958 Sep 08 11:48:01.331877 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3724/7314] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:48:01 2022] GET /compute/v2.1/servers/68d593d9-89e9-4ffd-8ad2-4661e7568e2c => generated 1553 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:48:02.893268 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fe476a4d-ad99-4d0e-a327-8f2bb706eba6 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "beb64a09-a07f-4b70-a75d-277c657b814e"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:48:02.895319 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fe476a4d-ad99-4d0e-a327-8f2bb706eba6 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] [instance: 68d593d9-89e9-4ffd-8ad2-4661e7568e2c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:48:02.897366 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:48:02.905596 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fe476a4d-ad99-4d0e-a327-8f2bb706eba6 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:02.906110 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fe476a4d-ad99-4d0e-a327-8f2bb706eba6 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:02.906572 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fe476a4d-ad99-4d0e-a327-8f2bb706eba6 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:02.907327 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fe476a4d-ad99-4d0e-a327-8f2bb706eba6 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:02.907815 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fe476a4d-ad99-4d0e-a327-8f2bb706eba6 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:02.908262 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fe476a4d-ad99-4d0e-a327-8f2bb706eba6 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:03.152603 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fe476a4d-ad99-4d0e-a327-8f2bb706eba6 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "POST /compute/v2.1/servers/68d593d9-89e9-4ffd-8ad2-4661e7568e2c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.263410 Sep 08 11:48:03.153296 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3591/7315] 10.222.0.27 () {60 vars in 1323 bytes} [Thu Sep 8 11:48:02 2022] POST /compute/v2.1/servers/68d593d9-89e9-4ffd-8ad2-4661e7568e2c/os-volume_attachments => generated 194 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:48:13.887754 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-301e7a1d-6940-48db-8cab-b2f6122aba76 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:48:13.888300 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-301e7a1d-6940-48db-8cab-b2f6122aba76 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] [instance: 68d593d9-89e9-4ffd-8ad2-4661e7568e2c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:48:13.890505 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:48:13.891220 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=6 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:48:13.893980 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:48:13.893980 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:48:13.902843 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-301e7a1d-6940-48db-8cab-b2f6122aba76 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:13.903550 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-301e7a1d-6940-48db-8cab-b2f6122aba76 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:13.903987 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-301e7a1d-6940-48db-8cab-b2f6122aba76 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:13.904699 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-301e7a1d-6940-48db-8cab-b2f6122aba76 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:13.905206 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-301e7a1d-6940-48db-8cab-b2f6122aba76 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:13.905642 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-301e7a1d-6940-48db-8cab-b2f6122aba76 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:13.991529 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-301e7a1d-6940-48db-8cab-b2f6122aba76 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lazy-loading 'services' on Instance uuid 68d593d9-89e9-4ffd-8ad2-4661e7568e2c {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:48:14.065074 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-301e7a1d-6940-48db-8cab-b2f6122aba76 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "DELETE /compute/v2.1/servers/68d593d9-89e9-4ffd-8ad2-4661e7568e2c/os-volume_attachments/beb64a09-a07f-4b70-a75d-277c657b814e" status: 202 len: 0 microversion: 2.1 time: 0.181647 Sep 08 11:48:14.065741 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3725/7316] 10.222.0.27 () {58 vars in 1416 bytes} [Thu Sep 8 11:48:13 2022] DELETE /compute/v2.1/servers/68d593d9-89e9-4ffd-8ad2-4661e7568e2c/os-volume_attachments/beb64a09-a07f-4b70-a75d-277c657b814e => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:48:14.078277 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fd28c607-a87f-456d-af36-f404805a1b29 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:48:14.080676 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fd28c607-a87f-456d-af36-f404805a1b29 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] [instance: 68d593d9-89e9-4ffd-8ad2-4661e7568e2c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:48:14.083661 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:48:14.084466 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:48:14.091748 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd28c607-a87f-456d-af36-f404805a1b29 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:14.092262 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd28c607-a87f-456d-af36-f404805a1b29 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:14.092713 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd28c607-a87f-456d-af36-f404805a1b29 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:14.093468 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd28c607-a87f-456d-af36-f404805a1b29 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:14.094138 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd28c607-a87f-456d-af36-f404805a1b29 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:14.094587 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd28c607-a87f-456d-af36-f404805a1b29 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:14.128764 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fd28c607-a87f-456d-af36-f404805a1b29 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "GET /compute/v2.1/servers/68d593d9-89e9-4ffd-8ad2-4661e7568e2c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057845 Sep 08 11:48:14.129376 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3592/7317] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 11:48:14 2022] GET /compute/v2.1/servers/68d593d9-89e9-4ffd-8ad2-4661e7568e2c/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:48:15.143262 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a7518d46-7fa4-4602-a85c-feedd67e0249 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:48:15.145669 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a7518d46-7fa4-4602-a85c-feedd67e0249 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] [instance: 68d593d9-89e9-4ffd-8ad2-4661e7568e2c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:48:15.152606 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a7518d46-7fa4-4602-a85c-feedd67e0249 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:15.153214 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a7518d46-7fa4-4602-a85c-feedd67e0249 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:15.153717 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a7518d46-7fa4-4602-a85c-feedd67e0249 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:15.154479 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a7518d46-7fa4-4602-a85c-feedd67e0249 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:15.154937 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a7518d46-7fa4-4602-a85c-feedd67e0249 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:15.155359 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a7518d46-7fa4-4602-a85c-feedd67e0249 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:15.187112 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a7518d46-7fa4-4602-a85c-feedd67e0249 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "GET /compute/v2.1/servers/68d593d9-89e9-4ffd-8ad2-4661e7568e2c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049047 Sep 08 11:48:15.187711 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3726/7318] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 11:48:15 2022] GET /compute/v2.1/servers/68d593d9-89e9-4ffd-8ad2-4661e7568e2c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:48:16.201089 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ed1836f2-5073-47fb-b324-7377ac091871 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:48:16.203343 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ed1836f2-5073-47fb-b324-7377ac091871 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] [instance: 68d593d9-89e9-4ffd-8ad2-4661e7568e2c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:48:16.210502 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ed1836f2-5073-47fb-b324-7377ac091871 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:16.211019 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ed1836f2-5073-47fb-b324-7377ac091871 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:16.211482 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ed1836f2-5073-47fb-b324-7377ac091871 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:16.212588 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ed1836f2-5073-47fb-b324-7377ac091871 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:16.213097 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ed1836f2-5073-47fb-b324-7377ac091871 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:16.213550 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ed1836f2-5073-47fb-b324-7377ac091871 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:16.248486 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ed1836f2-5073-47fb-b324-7377ac091871 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "GET /compute/v2.1/servers/68d593d9-89e9-4ffd-8ad2-4661e7568e2c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052554 Sep 08 11:48:16.249102 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3593/7319] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 11:48:16 2022] GET /compute/v2.1/servers/68d593d9-89e9-4ffd-8ad2-4661e7568e2c/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:48:17.260471 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7f2e4d66-42f7-46ea-9dd6-3b7c130aa0f1 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:48:17.262652 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7f2e4d66-42f7-46ea-9dd6-3b7c130aa0f1 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] [instance: 68d593d9-89e9-4ffd-8ad2-4661e7568e2c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:48:17.269843 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7f2e4d66-42f7-46ea-9dd6-3b7c130aa0f1 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:17.270337 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7f2e4d66-42f7-46ea-9dd6-3b7c130aa0f1 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:17.270775 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7f2e4d66-42f7-46ea-9dd6-3b7c130aa0f1 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:17.271478 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7f2e4d66-42f7-46ea-9dd6-3b7c130aa0f1 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:17.271935 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7f2e4d66-42f7-46ea-9dd6-3b7c130aa0f1 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:17.272361 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7f2e4d66-42f7-46ea-9dd6-3b7c130aa0f1 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:17.306478 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7f2e4d66-42f7-46ea-9dd6-3b7c130aa0f1 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "GET /compute/v2.1/servers/68d593d9-89e9-4ffd-8ad2-4661e7568e2c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050041 Sep 08 11:48:17.307050 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3727/7320] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 11:48:17 2022] GET /compute/v2.1/servers/68d593d9-89e9-4ffd-8ad2-4661e7568e2c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:48:18.319073 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-13b0a474-2da1-4c3e-812b-34a96e1b1e35 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:48:18.321896 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-13b0a474-2da1-4c3e-812b-34a96e1b1e35 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] [instance: 68d593d9-89e9-4ffd-8ad2-4661e7568e2c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:48:18.329052 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-13b0a474-2da1-4c3e-812b-34a96e1b1e35 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:18.329574 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-13b0a474-2da1-4c3e-812b-34a96e1b1e35 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:18.330034 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-13b0a474-2da1-4c3e-812b-34a96e1b1e35 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:18.330759 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-13b0a474-2da1-4c3e-812b-34a96e1b1e35 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:18.331236 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-13b0a474-2da1-4c3e-812b-34a96e1b1e35 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:18.331683 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-13b0a474-2da1-4c3e-812b-34a96e1b1e35 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:18.362906 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-13b0a474-2da1-4c3e-812b-34a96e1b1e35 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "GET /compute/v2.1/servers/68d593d9-89e9-4ffd-8ad2-4661e7568e2c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047760 Sep 08 11:48:18.363497 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3594/7321] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 11:48:18 2022] GET /compute/v2.1/servers/68d593d9-89e9-4ffd-8ad2-4661e7568e2c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:48:19.375798 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3e25aa76-3285-4171-81ee-1fcd25078cb6 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:48:19.377973 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3e25aa76-3285-4171-81ee-1fcd25078cb6 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] [instance: 68d593d9-89e9-4ffd-8ad2-4661e7568e2c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:48:19.384911 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3e25aa76-3285-4171-81ee-1fcd25078cb6 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:19.385429 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3e25aa76-3285-4171-81ee-1fcd25078cb6 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:19.385861 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3e25aa76-3285-4171-81ee-1fcd25078cb6 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:19.386556 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3e25aa76-3285-4171-81ee-1fcd25078cb6 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:19.387005 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3e25aa76-3285-4171-81ee-1fcd25078cb6 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:19.387424 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3e25aa76-3285-4171-81ee-1fcd25078cb6 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:19.417409 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3e25aa76-3285-4171-81ee-1fcd25078cb6 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "GET /compute/v2.1/servers/68d593d9-89e9-4ffd-8ad2-4661e7568e2c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045480 Sep 08 11:48:19.418060 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3728/7322] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 11:48:19 2022] GET /compute/v2.1/servers/68d593d9-89e9-4ffd-8ad2-4661e7568e2c/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 11:48:19.428718 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-70ccfb66-ddaf-4018-aadd-bef96f2f13d6 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:48:19.429267 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-70ccfb66-ddaf-4018-aadd-bef96f2f13d6 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] [instance: 68d593d9-89e9-4ffd-8ad2-4661e7568e2c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:48:19.436268 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70ccfb66-ddaf-4018-aadd-bef96f2f13d6 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:19.436775 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70ccfb66-ddaf-4018-aadd-bef96f2f13d6 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:19.437261 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70ccfb66-ddaf-4018-aadd-bef96f2f13d6 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:19.437980 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70ccfb66-ddaf-4018-aadd-bef96f2f13d6 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:19.438457 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70ccfb66-ddaf-4018-aadd-bef96f2f13d6 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:19.438902 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70ccfb66-ddaf-4018-aadd-bef96f2f13d6 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:19.520464 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-70ccfb66-ddaf-4018-aadd-bef96f2f13d6 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] HTTP exception thrown: Instance 68d593d9-89e9-4ffd-8ad2-4661e7568e2c is not attached to volume beb64a09-a07f-4b70-a75d-277c657b814e Sep 08 11:48:19.522159 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-70ccfb66-ddaf-4018-aadd-bef96f2f13d6 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Request method failure captured: Sep 08 11:48:19.522159 n-d-850501-12 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/servers/68d593d9-89e9-4ffd-8ad2-4661e7568e2c/os-volume_attachments/beb64a09-a07f-4b70-a75d-277c657b814e HTTP/1.1 Sep 08 11:48:19.522159 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 11:48:19.522159 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 11:48:19.522159 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 11:48:19.522159 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 11:48:19.522159 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 11:48:19.522159 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 11:48:19.522159 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 11:48:19.522159 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 11:48:19.522159 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGdY8gUeJdpjSGW7jdIynOwQtfPRRhOFAU_kUawURrTao31k-U7JhDXRTiBz-xLd1NLJK73p_170PApmzvFFr9yhED0yBrXqu9R8kNuwTLD4PsPuJhtBR65uKQb_FEr2KnfUiesq9tYlsz1hotiyJdDnImi3VzMhBfsbVOY8PHP27k1Q Sep 08 11:48:19.522159 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 11:48:19.522159 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 11:48:19.522159 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 11:48:19.522159 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 11:48:19.522159 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 11:48:19.522159 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 11:48:19.522159 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: eb883d25c960430aa07ef867fae8a4cb Sep 08 11:48:19.522159 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1722295247 Sep 08 11:48:19.522159 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 11:48:19.522159 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 11:48:19.522159 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/eb883d25c960430aa07ef867fae8a4cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eb883d25c960430aa07ef867fae8a4cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_eb883d25c960430aa07ef867fae8a4cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eb883d25c960430aa07ef867fae8a4cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:48:19.522159 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-TestEncryptedCinderVolumes-1722295247 Sep 08 11:48:19.522159 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: eb883d25c960430aa07ef867fae8a4cb Sep 08 11:48:19.522159 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1722295247 Sep 08 11:48:19.522159 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-TestEncryptedCinderVolumes-1722295247-project Sep 08 11:48:19.522159 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 11:48:19.522159 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 11:48:19.522159 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: fc1fafbc7eb84004b96f0b4a82d37c21 Sep 08 11:48:19.522159 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-TestEncryptedCinderVolumes-1722295247-project Sep 08 11:48:19.522159 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 11:48:19.522159 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 68d593d9-89e9-4ffd-8ad2-4661e7568e2c is not attached to volume beb64a09-a07f-4b70-a75d-277c657b814e Sep 08 11:48:19.522159 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'server_id': '68d593d9-89e9-4ffd-8ad2-4661e7568e2c', 'id': 'beb64a09-a07f-4b70-a75d-277c657b814e'} Sep 08 11:48:19.522159 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:48:19.522159 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:48:19.522159 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 08 11:48:19.522159 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 08 11:48:19.522159 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 11:48:19.522159 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 11:48:19.522159 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 08 11:48:19.522159 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 08 11:48:19.522159 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id beb64a09-a07f-4b70-a75d-277c657b814e. Sep 08 11:48:19.522159 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:48:19.522159 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:48:19.522159 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:48:19.522159 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:48:19.522159 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:48:19.522159 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:48:19.522159 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:48:19.522159 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:48:19.522159 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:48:19.522159 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:48:19.522159 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 08 11:48:19.522159 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 08 11:48:19.522159 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68d593d9-89e9-4ffd-8ad2-4661e7568e2c is not attached to volume beb64a09-a07f-4b70-a75d-277c657b814e Sep 08 11:48:19.522159 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:48:19.522159 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:48:19.522159 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:48:19.522159 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:48:19.522159 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:48:19.522159 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:48:19.526721 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:48:19.526721 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:48:19.526721 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68d593d9-89e9-4ffd-8ad2-4661e7568e2c is not attached to volume beb64a09-a07f-4b70-a75d-277c657b814e Sep 08 11:48:19.526721 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:48:19.526721 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-70ccfb66-ddaf-4018-aadd-bef96f2f13d6 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Returning 404 to user: Instance 68d593d9-89e9-4ffd-8ad2-4661e7568e2c is not attached to volume beb64a09-a07f-4b70-a75d-277c657b814e {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:48:19.526721 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-70ccfb66-ddaf-4018-aadd-bef96f2f13d6 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "DELETE /compute/v2.1/servers/68d593d9-89e9-4ffd-8ad2-4661e7568e2c/os-volume_attachments/beb64a09-a07f-4b70-a75d-277c657b814e" status: 404 len: 154 microversion: 2.1 time: 0.099021 Sep 08 11:48:19.526721 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3595/7323] 10.222.0.27 () {58 vars in 1416 bytes} [Thu Sep 8 11:48:19 2022] DELETE /compute/v2.1/servers/68d593d9-89e9-4ffd-8ad2-4661e7568e2c/os-volume_attachments/beb64a09-a07f-4b70-a75d-277c657b814e => generated 154 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:48:22.879534 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-00f59f44-669a-446f-94b5-0be7feadcbd1 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:48:22.880049 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-00f59f44-669a-446f-94b5-0be7feadcbd1 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] [instance: 68d593d9-89e9-4ffd-8ad2-4661e7568e2c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:48:22.887684 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-00f59f44-669a-446f-94b5-0be7feadcbd1 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:22.888184 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-00f59f44-669a-446f-94b5-0be7feadcbd1 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:22.888621 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-00f59f44-669a-446f-94b5-0be7feadcbd1 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:22.889362 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-00f59f44-669a-446f-94b5-0be7feadcbd1 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:22.889823 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-00f59f44-669a-446f-94b5-0be7feadcbd1 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:22.890253 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-00f59f44-669a-446f-94b5-0be7feadcbd1 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:22.917060 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-00f59f44-669a-446f-94b5-0be7feadcbd1 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] [instance: 68d593d9-89e9-4ffd-8ad2-4661e7568e2c] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:48:23.007159 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-00f59f44-669a-446f-94b5-0be7feadcbd1 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "DELETE /compute/v2.1/servers/68d593d9-89e9-4ffd-8ad2-4661e7568e2c" status: 204 len: 0 microversion: 2.1 time: 0.131082 Sep 08 11:48:23.008631 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3729/7324] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:48:22 2022] DELETE /compute/v2.1/servers/68d593d9-89e9-4ffd-8ad2-4661e7568e2c => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:48:23.017712 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2a208a2e-b26c-40af-ac21-2c906378a85f tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:48:23.018357 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2a208a2e-b26c-40af-ac21-2c906378a85f tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] [instance: 68d593d9-89e9-4ffd-8ad2-4661e7568e2c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:48:23.029073 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2a208a2e-b26c-40af-ac21-2c906378a85f tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:23.029596 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2a208a2e-b26c-40af-ac21-2c906378a85f tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:23.030055 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2a208a2e-b26c-40af-ac21-2c906378a85f tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:23.031336 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2a208a2e-b26c-40af-ac21-2c906378a85f tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:23.032479 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2a208a2e-b26c-40af-ac21-2c906378a85f tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:23.033011 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2a208a2e-b26c-40af-ac21-2c906378a85f tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:23.201959 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2a208a2e-b26c-40af-ac21-2c906378a85f tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fafbc7eb84004b96f0b4a82d37c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb883d25c960430aa07ef867fae8a4cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:48:23.210441 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2a208a2e-b26c-40af-ac21-2c906378a85f tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "GET /compute/v2.1/servers/68d593d9-89e9-4ffd-8ad2-4661e7568e2c" status: 200 len: 1559 microversion: 2.1 time: 0.197013 Sep 08 11:48:23.211046 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3596/7325] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:48:23 2022] GET /compute/v2.1/servers/68d593d9-89e9-4ffd-8ad2-4661e7568e2c => generated 1559 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:48:24.238355 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6ddced3f-49e3-4fcd-bea1-2fba66235bc1 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:48:24.245713 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6ddced3f-49e3-4fcd-bea1-2fba66235bc1 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] [instance: 68d593d9-89e9-4ffd-8ad2-4661e7568e2c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:48:24.246247 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6ddced3f-49e3-4fcd-bea1-2fba66235bc1 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:24.246742 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6ddced3f-49e3-4fcd-bea1-2fba66235bc1 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:24.247176 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6ddced3f-49e3-4fcd-bea1-2fba66235bc1 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:24.247883 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6ddced3f-49e3-4fcd-bea1-2fba66235bc1 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:24.248330 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6ddced3f-49e3-4fcd-bea1-2fba66235bc1 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:24.248890 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6ddced3f-49e3-4fcd-bea1-2fba66235bc1 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:24.394370 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6ddced3f-49e3-4fcd-bea1-2fba66235bc1 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fafbc7eb84004b96f0b4a82d37c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb883d25c960430aa07ef867fae8a4cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:48:24.404330 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6ddced3f-49e3-4fcd-bea1-2fba66235bc1 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "GET /compute/v2.1/servers/68d593d9-89e9-4ffd-8ad2-4661e7568e2c" status: 200 len: 1559 microversion: 2.1 time: 0.170120 Sep 08 11:48:24.405102 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3730/7326] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:48:24 2022] GET /compute/v2.1/servers/68d593d9-89e9-4ffd-8ad2-4661e7568e2c => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:48:25.183896 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-04a53c5c-52b8-4f6b-beea-9c2125298b40 req-a2f8b5ea-4177-454b-af35-8a679e0453c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68d593d9-89e9-4ffd-8ad2-4661e7568e2c", "name": "network-vif-deleted", "tag": "be88e6fe-cc16-4cdd-8ad1-66110776701a"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:48:25.205834 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-04a53c5c-52b8-4f6b-beea-9c2125298b40 req-a2f8b5ea-4177-454b-af35-8a679e0453c2 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:25.206344 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-04a53c5c-52b8-4f6b-beea-9c2125298b40 req-a2f8b5ea-4177-454b-af35-8a679e0453c2 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:25.206798 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-04a53c5c-52b8-4f6b-beea-9c2125298b40 req-a2f8b5ea-4177-454b-af35-8a679e0453c2 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:25.224501 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-04a53c5c-52b8-4f6b-beea-9c2125298b40 req-a2f8b5ea-4177-454b-af35-8a679e0453c2 service nova] Creating event network-vif-deleted:be88e6fe-cc16-4cdd-8ad1-66110776701a for instance 68d593d9-89e9-4ffd-8ad2-4661e7568e2c on n-h1-850501-12 Sep 08 11:48:25.231385 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-04a53c5c-52b8-4f6b-beea-9c2125298b40 req-a2f8b5ea-4177-454b-af35-8a679e0453c2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052387 Sep 08 11:48:25.232444 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3597/7327] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:48:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:48:25.427941 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8781ebeb-cfde-4b3c-b53b-c4c208b89c29 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:48:25.428626 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8781ebeb-cfde-4b3c-b53b-c4c208b89c29 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] [instance: 68d593d9-89e9-4ffd-8ad2-4661e7568e2c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:48:25.435895 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8781ebeb-cfde-4b3c-b53b-c4c208b89c29 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:25.436387 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8781ebeb-cfde-4b3c-b53b-c4c208b89c29 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:25.436824 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8781ebeb-cfde-4b3c-b53b-c4c208b89c29 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:25.437560 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8781ebeb-cfde-4b3c-b53b-c4c208b89c29 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:25.438013 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8781ebeb-cfde-4b3c-b53b-c4c208b89c29 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:25.438437 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8781ebeb-cfde-4b3c-b53b-c4c208b89c29 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:25.471217 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8781ebeb-cfde-4b3c-b53b-c4c208b89c29 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:25.471699 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8781ebeb-cfde-4b3c-b53b-c4c208b89c29 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:25.472131 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8781ebeb-cfde-4b3c-b53b-c4c208b89c29 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:25.472578 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-8781ebeb-cfde-4b3c-b53b-c4c208b89c29 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lazy-loading 'fault' on Instance uuid 68d593d9-89e9-4ffd-8ad2-4661e7568e2c {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:48:25.516602 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8781ebeb-cfde-4b3c-b53b-c4c208b89c29 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fafbc7eb84004b96f0b4a82d37c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb883d25c960430aa07ef867fae8a4cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:48:25.525932 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8781ebeb-cfde-4b3c-b53b-c4c208b89c29 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "GET /compute/v2.1/servers/68d593d9-89e9-4ffd-8ad2-4661e7568e2c" status: 200 len: 1351 microversion: 2.1 time: 0.101419 Sep 08 11:48:25.527049 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3731/7328] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:48:25 2022] GET /compute/v2.1/servers/68d593d9-89e9-4ffd-8ad2-4661e7568e2c => generated 1351 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:48:26.550978 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a3d02bc1-f8de-4b0d-b678-c4580d79306a tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:48:26.551610 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a3d02bc1-f8de-4b0d-b678-c4580d79306a tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] [instance: 68d593d9-89e9-4ffd-8ad2-4661e7568e2c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:48:26.559333 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a3d02bc1-f8de-4b0d-b678-c4580d79306a tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:26.559833 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a3d02bc1-f8de-4b0d-b678-c4580d79306a tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:26.560280 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a3d02bc1-f8de-4b0d-b678-c4580d79306a tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:26.560992 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a3d02bc1-f8de-4b0d-b678-c4580d79306a tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:26.561482 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a3d02bc1-f8de-4b0d-b678-c4580d79306a tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:26.561920 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a3d02bc1-f8de-4b0d-b678-c4580d79306a tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:26.575549 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-a3d02bc1-f8de-4b0d-b678-c4580d79306a tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] HTTP exception thrown: Instance 68d593d9-89e9-4ffd-8ad2-4661e7568e2c could not be found. Sep 08 11:48:26.577254 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a3d02bc1-f8de-4b0d-b678-c4580d79306a tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Request method failure captured: Sep 08 11:48:26.577254 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/68d593d9-89e9-4ffd-8ad2-4661e7568e2c HTTP/1.1 Sep 08 11:48:26.577254 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 11:48:26.577254 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 11:48:26.577254 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 11:48:26.577254 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 11:48:26.577254 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 11:48:26.577254 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 11:48:26.577254 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 11:48:26.577254 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 11:48:26.577254 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGdY8gUeJdpjSGW7jdIynOwQtfPRRhOFAU_kUawURrTao31k-U7JhDXRTiBz-xLd1NLJK73p_170PApmzvFFr9yhED0yBrXqu9R8kNuwTLD4PsPuJhtBR65uKQb_FEr2KnfUiesq9tYlsz1hotiyJdDnImi3VzMhBfsbVOY8PHP27k1Q Sep 08 11:48:26.577254 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 11:48:26.577254 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 11:48:26.577254 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 11:48:26.577254 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 11:48:26.577254 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 11:48:26.577254 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 11:48:26.577254 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: eb883d25c960430aa07ef867fae8a4cb Sep 08 11:48:26.577254 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1722295247 Sep 08 11:48:26.577254 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 11:48:26.577254 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 11:48:26.577254 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/eb883d25c960430aa07ef867fae8a4cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eb883d25c960430aa07ef867fae8a4cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_eb883d25c960430aa07ef867fae8a4cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eb883d25c960430aa07ef867fae8a4cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:48:26.577254 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-TestEncryptedCinderVolumes-1722295247 Sep 08 11:48:26.577254 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: eb883d25c960430aa07ef867fae8a4cb Sep 08 11:48:26.577254 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1722295247 Sep 08 11:48:26.577254 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-TestEncryptedCinderVolumes-1722295247-project Sep 08 11:48:26.577254 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 11:48:26.577254 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 11:48:26.577254 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: fc1fafbc7eb84004b96f0b4a82d37c21 Sep 08 11:48:26.577254 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-TestEncryptedCinderVolumes-1722295247-project Sep 08 11:48:26.577254 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 11:48:26.577254 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 68d593d9-89e9-4ffd-8ad2-4661e7568e2c could not be found. Sep 08 11:48:26.577254 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '68d593d9-89e9-4ffd-8ad2-4661e7568e2c'} Sep 08 11:48:26.577254 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:48:26.577254 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:48:26.577254 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:48:26.577254 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:48:26.577254 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:48:26.577254 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:48:26.577254 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:48:26.577254 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:48:26.577254 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:48:26.577254 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:48:26.577254 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68d593d9-89e9-4ffd-8ad2-4661e7568e2c could not be found. Sep 08 11:48:26.577254 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:48:26.577254 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:48:26.577254 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:48:26.577254 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:48:26.577254 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:48:26.577254 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:48:26.577254 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:48:26.577254 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:48:26.577254 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:48:26.577254 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:48:26.577254 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:48:26.577254 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:48:26.577254 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:48:26.577254 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:48:26.577254 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:48:26.577254 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:48:26.577254 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68d593d9-89e9-4ffd-8ad2-4661e7568e2c could not be found. Sep 08 11:48:26.577254 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:48:26.577254 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:48:26.582338 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:48:26.582338 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:48:26.582338 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:48:26.582338 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:48:26.582338 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:48:26.582338 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:48:26.582338 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68d593d9-89e9-4ffd-8ad2-4661e7568e2c could not be found. Sep 08 11:48:26.582338 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:48:26.582338 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a3d02bc1-f8de-4b0d-b678-c4580d79306a tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Returning 404 to user: Instance 68d593d9-89e9-4ffd-8ad2-4661e7568e2c could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:48:26.582338 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a3d02bc1-f8de-4b0d-b678-c4580d79306a tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "GET /compute/v2.1/servers/68d593d9-89e9-4ffd-8ad2-4661e7568e2c" status: 404 len: 111 microversion: 2.1 time: 0.032100 Sep 08 11:48:26.582338 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3598/7329] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:48:26 2022] GET /compute/v2.1/servers/68d593d9-89e9-4ffd-8ad2-4661e7568e2c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:48:26.587345 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e698e39c-bb9a-4716-bdbf-9674c5354965 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Calling method '.version_select at 0x7f68df02b3a0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:48:26.610105 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e698e39c-bb9a-4716-bdbf-9674c5354965 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-2003695958" status: 202 len: 0 microversion: 2.1 time: 0.026491 Sep 08 11:48:26.610690 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3732/7330] 10.222.0.27 () {58 vars in 1278 bytes} [Thu Sep 8 11:48:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-2003695958 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:48:26.628563 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ecba4361-ac12-48c7-8bc7-46485019c0a2 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Action: 'create', calling method: .version_select at 0x7f68e4586ca0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1356251603", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNKiOlhk8TglDVh/HEjujzNAqavMqPI6/m1NWsFo01oxSIM2wLb8ZrpfyeMc4ywTijhJUbGwGhLHQOZY25dR5PRJcAmPlA+9YSfrg8ub5w56rjT3IM9inVfp8ag7Y5MafA=="}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:48:26.644140 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-ecba4361-ac12-48c7-8bc7-46485019c0a2 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Getting quotas for project eb883d25c960430aa07ef867fae8a4cb. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:48:26.649422 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-ecba4361-ac12-48c7-8bc7-46485019c0a2 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Getting quotas for user fc1fafbc7eb84004b96f0b4a82d37c21 and project eb883d25c960430aa07ef867fae8a4cb. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:48:26.673444 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ecba4361-ac12-48c7-8bc7-46485019c0a2 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.048787 Sep 08 11:48:26.674078 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3599/7331] 10.222.0.27 () {60 vars in 1159 bytes} [Thu Sep 8 11:48:26 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:48:26.725523 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-be65fc73-3855-4f3f-8f63-74069806d34f tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-410405105", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1356251603", "networks": [{"uuid": "bc9b5977-c89a-4665-9707-9e55e005b094"}]}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:48:26.779192 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-be65fc73-3855-4f3f-8f63-74069806d34f tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] validate_networks() for [('bc9b5977-c89a-4665-9707-9e55e005b094', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:48:27.150190 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-be65fc73-3855-4f3f-8f63-74069806d34f tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:48:27.150608 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-be65fc73-3855-4f3f-8f63-74069806d34f tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:48:27.151109 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-be65fc73-3855-4f3f-8f63-74069806d34f tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:48:27.151515 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-be65fc73-3855-4f3f-8f63-74069806d34f tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:48:27.151925 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-be65fc73-3855-4f3f-8f63-74069806d34f tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:48:27.160855 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-be65fc73-3855-4f3f-8f63-74069806d34f tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:27.161396 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-be65fc73-3855-4f3f-8f63-74069806d34f tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:27.161835 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-be65fc73-3855-4f3f-8f63-74069806d34f tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:27.162568 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-be65fc73-3855-4f3f-8f63-74069806d34f tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:27.163026 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-be65fc73-3855-4f3f-8f63-74069806d34f tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:27.163455 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-be65fc73-3855-4f3f-8f63-74069806d34f tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:27.183339 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-be65fc73-3855-4f3f-8f63-74069806d34f tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Getting quotas for project eb883d25c960430aa07ef867fae8a4cb. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:48:27.188718 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-be65fc73-3855-4f3f-8f63-74069806d34f tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Getting quotas for user fc1fafbc7eb84004b96f0b4a82d37c21 and project eb883d25c960430aa07ef867fae8a4cb. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:48:27.202464 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-be65fc73-3855-4f3f-8f63-74069806d34f tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:48:27.204789 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-be65fc73-3855-4f3f-8f63-74069806d34f tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] [instance: c259dc22-1bf5-427c-b36e-e68244f50369] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:48:27.250574 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-be65fc73-3855-4f3f-8f63-74069806d34f tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.528950 Sep 08 11:48:27.251223 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3733/7332] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 11:48:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 530 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:48:27.263319 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1ec4a6dd-2cd7-424a-b008-d36e01bc471e tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:48:27.263947 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1ec4a6dd-2cd7-424a-b008-d36e01bc471e tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] [instance: c259dc22-1bf5-427c-b36e-e68244f50369] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:48:27.324772 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1ec4a6dd-2cd7-424a-b008-d36e01bc471e tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fafbc7eb84004b96f0b4a82d37c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb883d25c960430aa07ef867fae8a4cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:48:27.332722 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1ec4a6dd-2cd7-424a-b008-d36e01bc471e tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "GET /compute/v2.1/servers/c259dc22-1bf5-427c-b36e-e68244f50369" status: 200 len: 1262 microversion: 2.1 time: 0.073526 Sep 08 11:48:27.333323 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3600/7333] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:48:27 2022] GET /compute/v2.1/servers/c259dc22-1bf5-427c-b36e-e68244f50369 => generated 1262 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:48:28.358122 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e0ded060-ead4-42e0-9787-0d5a9193dbc2 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:48:28.358755 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e0ded060-ead4-42e0-9787-0d5a9193dbc2 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] [instance: c259dc22-1bf5-427c-b36e-e68244f50369] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:48:28.368022 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e0ded060-ead4-42e0-9787-0d5a9193dbc2 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:28.368986 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e0ded060-ead4-42e0-9787-0d5a9193dbc2 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:28.369464 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e0ded060-ead4-42e0-9787-0d5a9193dbc2 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:28.370233 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e0ded060-ead4-42e0-9787-0d5a9193dbc2 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:28.371146 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e0ded060-ead4-42e0-9787-0d5a9193dbc2 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:28.371521 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e0ded060-ead4-42e0-9787-0d5a9193dbc2 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:28.448762 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e0ded060-ead4-42e0-9787-0d5a9193dbc2 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fafbc7eb84004b96f0b4a82d37c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb883d25c960430aa07ef867fae8a4cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:48:28.457184 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e0ded060-ead4-42e0-9787-0d5a9193dbc2 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "GET /compute/v2.1/servers/c259dc22-1bf5-427c-b36e-e68244f50369" status: 200 len: 1320 microversion: 2.1 time: 0.104925 Sep 08 11:48:28.457783 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3734/7334] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:48:28 2022] GET /compute/v2.1/servers/c259dc22-1bf5-427c-b36e-e68244f50369 => generated 1320 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:48:29.483743 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-387289e3-b31e-49e7-b0b0-12c9e7fc134b tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:48:29.484383 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-387289e3-b31e-49e7-b0b0-12c9e7fc134b tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] [instance: c259dc22-1bf5-427c-b36e-e68244f50369] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:48:29.491972 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-387289e3-b31e-49e7-b0b0-12c9e7fc134b tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:29.492534 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-387289e3-b31e-49e7-b0b0-12c9e7fc134b tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:29.493341 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-387289e3-b31e-49e7-b0b0-12c9e7fc134b tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:29.494152 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-387289e3-b31e-49e7-b0b0-12c9e7fc134b tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:29.494669 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-387289e3-b31e-49e7-b0b0-12c9e7fc134b tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:29.495126 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-387289e3-b31e-49e7-b0b0-12c9e7fc134b tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:29.641338 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-387289e3-b31e-49e7-b0b0-12c9e7fc134b tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fafbc7eb84004b96f0b4a82d37c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb883d25c960430aa07ef867fae8a4cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:48:29.650352 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-387289e3-b31e-49e7-b0b0-12c9e7fc134b tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "GET /compute/v2.1/servers/c259dc22-1bf5-427c-b36e-e68244f50369" status: 200 len: 1362 microversion: 2.1 time: 0.170457 Sep 08 11:48:29.650956 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3601/7335] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:48:29 2022] GET /compute/v2.1/servers/c259dc22-1bf5-427c-b36e-e68244f50369 => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:48:29.940283 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-ba1fc220-a861-4d41-a1c3-d77e0f4a54f1 req-ab0761fa-aa1c-45ca-8b1e-622c8ee9ae3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c259dc22-1bf5-427c-b36e-e68244f50369", "tag": "13a4ab34-f7fd-4b84-bfd8-337193920b30"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:48:29.961464 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-ba1fc220-a861-4d41-a1c3-d77e0f4a54f1 req-ab0761fa-aa1c-45ca-8b1e-622c8ee9ae3f service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:29.962441 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-ba1fc220-a861-4d41-a1c3-d77e0f4a54f1 req-ab0761fa-aa1c-45ca-8b1e-622c8ee9ae3f service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:29.963216 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-ba1fc220-a861-4d41-a1c3-d77e0f4a54f1 req-ab0761fa-aa1c-45ca-8b1e-622c8ee9ae3f service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:30.261406 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-ba1fc220-a861-4d41-a1c3-d77e0f4a54f1 req-ab0761fa-aa1c-45ca-8b1e-622c8ee9ae3f service nova] Creating event network-changed:13a4ab34-f7fd-4b84-bfd8-337193920b30 for instance c259dc22-1bf5-427c-b36e-e68244f50369 on n-h1-850501-12 Sep 08 11:48:30.266494 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-ba1fc220-a861-4d41-a1c3-d77e0f4a54f1 req-ab0761fa-aa1c-45ca-8b1e-622c8ee9ae3f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.329904 Sep 08 11:48:30.267246 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3735/7336] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:48:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:48:30.673519 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-42fd0717-51e5-4ccb-981a-8d7fed2eb6e8 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:48:30.674105 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-42fd0717-51e5-4ccb-981a-8d7fed2eb6e8 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] [instance: c259dc22-1bf5-427c-b36e-e68244f50369] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:48:30.681180 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42fd0717-51e5-4ccb-981a-8d7fed2eb6e8 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:30.681691 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42fd0717-51e5-4ccb-981a-8d7fed2eb6e8 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:30.682147 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42fd0717-51e5-4ccb-981a-8d7fed2eb6e8 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:30.682868 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42fd0717-51e5-4ccb-981a-8d7fed2eb6e8 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:30.683371 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42fd0717-51e5-4ccb-981a-8d7fed2eb6e8 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:30.683892 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42fd0717-51e5-4ccb-981a-8d7fed2eb6e8 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:30.822448 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-42fd0717-51e5-4ccb-981a-8d7fed2eb6e8 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fafbc7eb84004b96f0b4a82d37c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb883d25c960430aa07ef867fae8a4cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:48:30.830581 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-42fd0717-51e5-4ccb-981a-8d7fed2eb6e8 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "GET /compute/v2.1/servers/c259dc22-1bf5-427c-b36e-e68244f50369" status: 200 len: 1362 microversion: 2.1 time: 0.161086 Sep 08 11:48:30.831184 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3602/7337] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:48:30 2022] GET /compute/v2.1/servers/c259dc22-1bf5-427c-b36e-e68244f50369 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:48:31.856804 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0a82d8a3-c194-45c0-b4c9-4cf9850ccb1a tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:48:31.857452 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0a82d8a3-c194-45c0-b4c9-4cf9850ccb1a tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] [instance: c259dc22-1bf5-427c-b36e-e68244f50369] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:48:31.863603 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0a82d8a3-c194-45c0-b4c9-4cf9850ccb1a tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:31.864094 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0a82d8a3-c194-45c0-b4c9-4cf9850ccb1a tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:31.864794 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0a82d8a3-c194-45c0-b4c9-4cf9850ccb1a tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:31.865523 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0a82d8a3-c194-45c0-b4c9-4cf9850ccb1a tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:31.865981 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0a82d8a3-c194-45c0-b4c9-4cf9850ccb1a tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:31.866410 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0a82d8a3-c194-45c0-b4c9-4cf9850ccb1a tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:31.998021 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0a82d8a3-c194-45c0-b4c9-4cf9850ccb1a tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fafbc7eb84004b96f0b4a82d37c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb883d25c960430aa07ef867fae8a4cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:48:32.005667 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0a82d8a3-c194-45c0-b4c9-4cf9850ccb1a tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "GET /compute/v2.1/servers/c259dc22-1bf5-427c-b36e-e68244f50369" status: 200 len: 1362 microversion: 2.1 time: 0.154913 Sep 08 11:48:32.006240 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3736/7338] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:48:31 2022] GET /compute/v2.1/servers/c259dc22-1bf5-427c-b36e-e68244f50369 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:48:33.035216 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ad8ace54-4d36-418a-8f52-53d12a668b20 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:48:33.035854 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ad8ace54-4d36-418a-8f52-53d12a668b20 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] [instance: c259dc22-1bf5-427c-b36e-e68244f50369] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:48:33.043102 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad8ace54-4d36-418a-8f52-53d12a668b20 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:33.043364 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad8ace54-4d36-418a-8f52-53d12a668b20 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:33.043809 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad8ace54-4d36-418a-8f52-53d12a668b20 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:33.044531 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad8ace54-4d36-418a-8f52-53d12a668b20 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:33.045126 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad8ace54-4d36-418a-8f52-53d12a668b20 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:33.045487 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad8ace54-4d36-418a-8f52-53d12a668b20 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:33.182716 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ad8ace54-4d36-418a-8f52-53d12a668b20 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fafbc7eb84004b96f0b4a82d37c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb883d25c960430aa07ef867fae8a4cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:48:33.190447 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ad8ace54-4d36-418a-8f52-53d12a668b20 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "GET /compute/v2.1/servers/c259dc22-1bf5-427c-b36e-e68244f50369" status: 200 len: 1362 microversion: 2.1 time: 0.159194 Sep 08 11:48:33.191027 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3603/7339] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:48:33 2022] GET /compute/v2.1/servers/c259dc22-1bf5-427c-b36e-e68244f50369 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:48:34.213496 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0465d2e4-509f-4fd3-834d-df7cba9c3b66 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:48:34.214115 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0465d2e4-509f-4fd3-834d-df7cba9c3b66 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] [instance: c259dc22-1bf5-427c-b36e-e68244f50369] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:48:34.220977 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0465d2e4-509f-4fd3-834d-df7cba9c3b66 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:34.221497 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0465d2e4-509f-4fd3-834d-df7cba9c3b66 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:34.221953 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0465d2e4-509f-4fd3-834d-df7cba9c3b66 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:34.222635 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0465d2e4-509f-4fd3-834d-df7cba9c3b66 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:34.223099 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0465d2e4-509f-4fd3-834d-df7cba9c3b66 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:34.223531 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0465d2e4-509f-4fd3-834d-df7cba9c3b66 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:34.357237 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0465d2e4-509f-4fd3-834d-df7cba9c3b66 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fafbc7eb84004b96f0b4a82d37c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb883d25c960430aa07ef867fae8a4cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:48:34.365248 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0465d2e4-509f-4fd3-834d-df7cba9c3b66 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "GET /compute/v2.1/servers/c259dc22-1bf5-427c-b36e-e68244f50369" status: 200 len: 1362 microversion: 2.1 time: 0.156167 Sep 08 11:48:34.365813 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3737/7340] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:48:34 2022] GET /compute/v2.1/servers/c259dc22-1bf5-427c-b36e-e68244f50369 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:48:35.388543 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1f02c74f-b31e-40f1-9d0c-400342d845ac tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:48:35.389216 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1f02c74f-b31e-40f1-9d0c-400342d845ac tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] [instance: c259dc22-1bf5-427c-b36e-e68244f50369] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:48:35.391637 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-6ebb821b-a1f8-49d1-b543-483e2b774609 req-e90bc83b-ad37-490e-a7f2-6f3ee1c006f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c259dc22-1bf5-427c-b36e-e68244f50369", "name": "network-vif-plugged", "status": "completed", "tag": "13a4ab34-f7fd-4b84-bfd8-337193920b30"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:48:35.396574 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f02c74f-b31e-40f1-9d0c-400342d845ac tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:35.397444 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f02c74f-b31e-40f1-9d0c-400342d845ac tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:35.398142 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f02c74f-b31e-40f1-9d0c-400342d845ac tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:35.399101 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f02c74f-b31e-40f1-9d0c-400342d845ac tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:35.399712 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f02c74f-b31e-40f1-9d0c-400342d845ac tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:35.400291 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f02c74f-b31e-40f1-9d0c-400342d845ac tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:35.407225 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-6ebb821b-a1f8-49d1-b543-483e2b774609 req-e90bc83b-ad37-490e-a7f2-6f3ee1c006f5 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:35.407752 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-6ebb821b-a1f8-49d1-b543-483e2b774609 req-e90bc83b-ad37-490e-a7f2-6f3ee1c006f5 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:35.408194 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-6ebb821b-a1f8-49d1-b543-483e2b774609 req-e90bc83b-ad37-490e-a7f2-6f3ee1c006f5 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:35.429329 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-6ebb821b-a1f8-49d1-b543-483e2b774609 req-e90bc83b-ad37-490e-a7f2-6f3ee1c006f5 service nova] Creating event network-vif-plugged:13a4ab34-f7fd-4b84-bfd8-337193920b30 for instance c259dc22-1bf5-427c-b36e-e68244f50369 on n-h1-850501-12 Sep 08 11:48:35.435775 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-6ebb821b-a1f8-49d1-b543-483e2b774609 req-e90bc83b-ad37-490e-a7f2-6f3ee1c006f5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047908 Sep 08 11:48:35.436752 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3738/7341] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:48:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:48:35.550372 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1f02c74f-b31e-40f1-9d0c-400342d845ac tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fafbc7eb84004b96f0b4a82d37c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb883d25c960430aa07ef867fae8a4cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:48:35.558833 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1f02c74f-b31e-40f1-9d0c-400342d845ac tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "GET /compute/v2.1/servers/c259dc22-1bf5-427c-b36e-e68244f50369" status: 200 len: 1362 microversion: 2.1 time: 0.174882 Sep 08 11:48:35.559423 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3604/7342] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:48:35 2022] GET /compute/v2.1/servers/c259dc22-1bf5-427c-b36e-e68244f50369 => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:48:36.584571 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2c7a1e2a-4778-4094-9c7d-abcf797b3c0e tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:48:36.585702 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2c7a1e2a-4778-4094-9c7d-abcf797b3c0e tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] [instance: c259dc22-1bf5-427c-b36e-e68244f50369] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:48:36.592824 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2c7a1e2a-4778-4094-9c7d-abcf797b3c0e tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:36.593367 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2c7a1e2a-4778-4094-9c7d-abcf797b3c0e tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:36.593810 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2c7a1e2a-4778-4094-9c7d-abcf797b3c0e tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:36.594794 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2c7a1e2a-4778-4094-9c7d-abcf797b3c0e tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:36.595538 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2c7a1e2a-4778-4094-9c7d-abcf797b3c0e tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:36.596146 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2c7a1e2a-4778-4094-9c7d-abcf797b3c0e tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:36.741250 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2c7a1e2a-4778-4094-9c7d-abcf797b3c0e tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fafbc7eb84004b96f0b4a82d37c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb883d25c960430aa07ef867fae8a4cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:48:36.749851 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2c7a1e2a-4778-4094-9c7d-abcf797b3c0e tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "GET /compute/v2.1/servers/c259dc22-1bf5-427c-b36e-e68244f50369" status: 200 len: 1554 microversion: 2.1 time: 0.171183 Sep 08 11:48:36.750430 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3739/7343] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:48:36 2022] GET /compute/v2.1/servers/c259dc22-1bf5-427c-b36e-e68244f50369 => generated 1554 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:48:36.772587 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c42f0073-1507-48af-8078-ed2f8ee71b44 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:48:36.773243 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c42f0073-1507-48af-8078-ed2f8ee71b44 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] [instance: c259dc22-1bf5-427c-b36e-e68244f50369] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:48:36.780460 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c42f0073-1507-48af-8078-ed2f8ee71b44 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:36.780983 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c42f0073-1507-48af-8078-ed2f8ee71b44 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:36.781570 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c42f0073-1507-48af-8078-ed2f8ee71b44 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:36.782330 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c42f0073-1507-48af-8078-ed2f8ee71b44 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:36.782812 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c42f0073-1507-48af-8078-ed2f8ee71b44 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:36.783262 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c42f0073-1507-48af-8078-ed2f8ee71b44 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:36.923100 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c42f0073-1507-48af-8078-ed2f8ee71b44 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fafbc7eb84004b96f0b4a82d37c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb883d25c960430aa07ef867fae8a4cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:48:36.930988 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c42f0073-1507-48af-8078-ed2f8ee71b44 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "GET /compute/v2.1/servers/c259dc22-1bf5-427c-b36e-e68244f50369" status: 200 len: 1554 microversion: 2.1 time: 0.162238 Sep 08 11:48:36.932011 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3605/7344] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:48:36 2022] GET /compute/v2.1/servers/c259dc22-1bf5-427c-b36e-e68244f50369 => generated 1554 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:48:38.428777 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d2dfdcd4-e4f3-44bc-8f98-7c226d8902ae tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "40210dbd-de18-4c43-a6f3-f96dc6fdba2f"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:48:38.431180 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d2dfdcd4-e4f3-44bc-8f98-7c226d8902ae tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] [instance: c259dc22-1bf5-427c-b36e-e68244f50369] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:48:38.433671 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:48:38.434420 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=6 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:48:38.441332 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d2dfdcd4-e4f3-44bc-8f98-7c226d8902ae tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:38.441831 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d2dfdcd4-e4f3-44bc-8f98-7c226d8902ae tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:38.442278 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d2dfdcd4-e4f3-44bc-8f98-7c226d8902ae tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:38.442983 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d2dfdcd4-e4f3-44bc-8f98-7c226d8902ae tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:38.443448 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d2dfdcd4-e4f3-44bc-8f98-7c226d8902ae tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:38.443882 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d2dfdcd4-e4f3-44bc-8f98-7c226d8902ae tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:38.669435 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:48:38.689319 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d2dfdcd4-e4f3-44bc-8f98-7c226d8902ae tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "POST /compute/v2.1/servers/c259dc22-1bf5-427c-b36e-e68244f50369/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.264312 Sep 08 11:48:38.690099 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3740/7345] 10.222.0.27 () {60 vars in 1323 bytes} [Thu Sep 8 11:48:38 2022] POST /compute/v2.1/servers/c259dc22-1bf5-427c-b36e-e68244f50369/os-volume_attachments => generated 194 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:48:49.448651 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-adfbe8a3-fe62-40c5-a556-d2a6369d5471 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:48:49.449375 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-adfbe8a3-fe62-40c5-a556-d2a6369d5471 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] [instance: c259dc22-1bf5-427c-b36e-e68244f50369] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:48:49.451613 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:48:49.453313 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:48:49.454062 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=64 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:48:49.460716 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-adfbe8a3-fe62-40c5-a556-d2a6369d5471 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:49.461255 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-adfbe8a3-fe62-40c5-a556-d2a6369d5471 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:49.461709 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-adfbe8a3-fe62-40c5-a556-d2a6369d5471 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:49.463102 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-adfbe8a3-fe62-40c5-a556-d2a6369d5471 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:49.463653 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-adfbe8a3-fe62-40c5-a556-d2a6369d5471 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:49.464155 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-adfbe8a3-fe62-40c5-a556-d2a6369d5471 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:49.547483 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-adfbe8a3-fe62-40c5-a556-d2a6369d5471 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lazy-loading 'services' on Instance uuid c259dc22-1bf5-427c-b36e-e68244f50369 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:48:49.620867 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-adfbe8a3-fe62-40c5-a556-d2a6369d5471 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c259dc22-1bf5-427c-b36e-e68244f50369/os-volume_attachments/40210dbd-de18-4c43-a6f3-f96dc6fdba2f" status: 202 len: 0 microversion: 2.1 time: 0.176859 Sep 08 11:48:49.621510 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3606/7346] 10.222.0.27 () {58 vars in 1416 bytes} [Thu Sep 8 11:48:49 2022] DELETE /compute/v2.1/servers/c259dc22-1bf5-427c-b36e-e68244f50369/os-volume_attachments/40210dbd-de18-4c43-a6f3-f96dc6fdba2f => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:48:49.630813 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-36a4714d-d321-4296-8041-1100a25f75ee tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:48:49.633225 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-36a4714d-d321-4296-8041-1100a25f75ee tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] [instance: c259dc22-1bf5-427c-b36e-e68244f50369] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:48:49.636722 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:48:49.637901 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=1,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:48:49.645447 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-36a4714d-d321-4296-8041-1100a25f75ee tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:49.645933 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-36a4714d-d321-4296-8041-1100a25f75ee tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:49.646370 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-36a4714d-d321-4296-8041-1100a25f75ee tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:49.647088 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-36a4714d-d321-4296-8041-1100a25f75ee tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:49.647546 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-36a4714d-d321-4296-8041-1100a25f75ee tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:49.647972 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-36a4714d-d321-4296-8041-1100a25f75ee tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:49.688271 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-36a4714d-d321-4296-8041-1100a25f75ee tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "GET /compute/v2.1/servers/c259dc22-1bf5-427c-b36e-e68244f50369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061895 Sep 08 11:48:49.688859 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3741/7347] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 11:48:49 2022] GET /compute/v2.1/servers/c259dc22-1bf5-427c-b36e-e68244f50369/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:48:50.704334 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3267d56b-d584-46ab-9201-9b2cd3edd1da tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:48:50.706744 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3267d56b-d584-46ab-9201-9b2cd3edd1da tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] [instance: c259dc22-1bf5-427c-b36e-e68244f50369] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:48:50.713516 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3267d56b-d584-46ab-9201-9b2cd3edd1da tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:50.714041 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3267d56b-d584-46ab-9201-9b2cd3edd1da tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:50.714507 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3267d56b-d584-46ab-9201-9b2cd3edd1da tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:50.715242 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3267d56b-d584-46ab-9201-9b2cd3edd1da tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:50.715722 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3267d56b-d584-46ab-9201-9b2cd3edd1da tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:50.716169 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3267d56b-d584-46ab-9201-9b2cd3edd1da tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:50.749118 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3267d56b-d584-46ab-9201-9b2cd3edd1da tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "GET /compute/v2.1/servers/c259dc22-1bf5-427c-b36e-e68244f50369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050337 Sep 08 11:48:50.750343 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3607/7348] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 11:48:50 2022] GET /compute/v2.1/servers/c259dc22-1bf5-427c-b36e-e68244f50369/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:48:51.763433 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d85d06bf-66d9-44d5-a04a-77f3c1680a97 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:48:51.765665 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d85d06bf-66d9-44d5-a04a-77f3c1680a97 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] [instance: c259dc22-1bf5-427c-b36e-e68244f50369] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:48:51.771942 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d85d06bf-66d9-44d5-a04a-77f3c1680a97 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:51.772436 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d85d06bf-66d9-44d5-a04a-77f3c1680a97 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:51.772874 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d85d06bf-66d9-44d5-a04a-77f3c1680a97 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:51.773612 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d85d06bf-66d9-44d5-a04a-77f3c1680a97 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:51.774073 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d85d06bf-66d9-44d5-a04a-77f3c1680a97 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:51.774499 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d85d06bf-66d9-44d5-a04a-77f3c1680a97 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:51.805322 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d85d06bf-66d9-44d5-a04a-77f3c1680a97 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "GET /compute/v2.1/servers/c259dc22-1bf5-427c-b36e-e68244f50369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046824 Sep 08 11:48:51.807750 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3742/7349] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 11:48:51 2022] GET /compute/v2.1/servers/c259dc22-1bf5-427c-b36e-e68244f50369/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:48:52.818703 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8d89538a-b008-495d-8762-4a53b7daa667 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:48:52.820815 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8d89538a-b008-495d-8762-4a53b7daa667 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] [instance: c259dc22-1bf5-427c-b36e-e68244f50369] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:48:52.829793 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d89538a-b008-495d-8762-4a53b7daa667 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:52.830294 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d89538a-b008-495d-8762-4a53b7daa667 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:52.830961 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d89538a-b008-495d-8762-4a53b7daa667 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:52.831691 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d89538a-b008-495d-8762-4a53b7daa667 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:52.832164 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d89538a-b008-495d-8762-4a53b7daa667 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:52.832780 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d89538a-b008-495d-8762-4a53b7daa667 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:52.865828 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8d89538a-b008-495d-8762-4a53b7daa667 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "GET /compute/v2.1/servers/c259dc22-1bf5-427c-b36e-e68244f50369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051023 Sep 08 11:48:52.871613 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3608/7350] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 11:48:52 2022] GET /compute/v2.1/servers/c259dc22-1bf5-427c-b36e-e68244f50369/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:48:53.879661 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ea772c86-99ec-4ec3-bd1a-d3d09f9d9cb5 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:48:53.881842 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ea772c86-99ec-4ec3-bd1a-d3d09f9d9cb5 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] [instance: c259dc22-1bf5-427c-b36e-e68244f50369] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:48:53.889877 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ea772c86-99ec-4ec3-bd1a-d3d09f9d9cb5 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:53.890378 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ea772c86-99ec-4ec3-bd1a-d3d09f9d9cb5 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:53.890817 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ea772c86-99ec-4ec3-bd1a-d3d09f9d9cb5 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:53.891535 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ea772c86-99ec-4ec3-bd1a-d3d09f9d9cb5 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:53.891992 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ea772c86-99ec-4ec3-bd1a-d3d09f9d9cb5 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:53.892416 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ea772c86-99ec-4ec3-bd1a-d3d09f9d9cb5 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:53.924840 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ea772c86-99ec-4ec3-bd1a-d3d09f9d9cb5 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "GET /compute/v2.1/servers/c259dc22-1bf5-427c-b36e-e68244f50369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049273 Sep 08 11:48:53.925443 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3743/7351] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 11:48:53 2022] GET /compute/v2.1/servers/c259dc22-1bf5-427c-b36e-e68244f50369/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:48:54.937393 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4c5ccb8b-a79c-476e-9570-ad4631da0d46 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:48:54.939764 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4c5ccb8b-a79c-476e-9570-ad4631da0d46 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] [instance: c259dc22-1bf5-427c-b36e-e68244f50369] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:48:54.947118 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c5ccb8b-a79c-476e-9570-ad4631da0d46 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:54.947669 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c5ccb8b-a79c-476e-9570-ad4631da0d46 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:54.948080 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c5ccb8b-a79c-476e-9570-ad4631da0d46 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:54.948803 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c5ccb8b-a79c-476e-9570-ad4631da0d46 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:54.949294 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c5ccb8b-a79c-476e-9570-ad4631da0d46 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:54.949740 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c5ccb8b-a79c-476e-9570-ad4631da0d46 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:54.985582 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4c5ccb8b-a79c-476e-9570-ad4631da0d46 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "GET /compute/v2.1/servers/c259dc22-1bf5-427c-b36e-e68244f50369/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052030 Sep 08 11:48:54.986169 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3609/7352] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 11:48:54 2022] GET /compute/v2.1/servers/c259dc22-1bf5-427c-b36e-e68244f50369/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 11:48:54.998271 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7c0cf202-ec81-4ef7-932b-7bdc0ccc9cce tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:48:54.998830 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7c0cf202-ec81-4ef7-932b-7bdc0ccc9cce tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] [instance: c259dc22-1bf5-427c-b36e-e68244f50369] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:48:55.005336 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c0cf202-ec81-4ef7-932b-7bdc0ccc9cce tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:55.005827 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c0cf202-ec81-4ef7-932b-7bdc0ccc9cce tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:55.006267 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c0cf202-ec81-4ef7-932b-7bdc0ccc9cce tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:55.006964 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c0cf202-ec81-4ef7-932b-7bdc0ccc9cce tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:55.007421 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c0cf202-ec81-4ef7-932b-7bdc0ccc9cce tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:55.007846 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c0cf202-ec81-4ef7-932b-7bdc0ccc9cce tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:55.088129 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-7c0cf202-ec81-4ef7-932b-7bdc0ccc9cce tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] HTTP exception thrown: Instance c259dc22-1bf5-427c-b36e-e68244f50369 is not attached to volume 40210dbd-de18-4c43-a6f3-f96dc6fdba2f Sep 08 11:48:55.090260 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7c0cf202-ec81-4ef7-932b-7bdc0ccc9cce tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Request method failure captured: Sep 08 11:48:55.090260 n-d-850501-12 devstack@n-api.service[128861]: request: DELETE /compute/v2.1/servers/c259dc22-1bf5-427c-b36e-e68244f50369/os-volume_attachments/40210dbd-de18-4c43-a6f3-f96dc6fdba2f HTTP/1.1 Sep 08 11:48:55.090260 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:48:55.090260 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:48:55.090260 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:48:55.090260 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 11:48:55.090260 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:48:55.090260 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:48:55.090260 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:48:55.090260 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:48:55.090260 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGdY8gUeJdpjSGW7jdIynOwQtfPRRhOFAU_kUawURrTao31k-U7JhDXRTiBz-xLd1NLJK73p_170PApmzvFFr9yhED0yBrXqu9R8kNuwTLD4PsPuJhtBR65uKQb_FEr2KnfUiesq9tYlsz1hotiyJdDnImi3VzMhBfsbVOY8PHP27k1Q Sep 08 11:48:55.090260 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:48:55.090260 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:48:55.090260 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:48:55.090260 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:48:55.090260 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:48:55.090260 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:48:55.090260 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: eb883d25c960430aa07ef867fae8a4cb Sep 08 11:48:55.090260 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1722295247 Sep 08 11:48:55.090260 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:48:55.090260 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:48:55.090260 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/eb883d25c960430aa07ef867fae8a4cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eb883d25c960430aa07ef867fae8a4cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_eb883d25c960430aa07ef867fae8a4cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eb883d25c960430aa07ef867fae8a4cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:48:55.090260 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-TestEncryptedCinderVolumes-1722295247 Sep 08 11:48:55.090260 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: eb883d25c960430aa07ef867fae8a4cb Sep 08 11:48:55.090260 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1722295247 Sep 08 11:48:55.090260 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-TestEncryptedCinderVolumes-1722295247-project Sep 08 11:48:55.090260 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:48:55.090260 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:48:55.090260 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: fc1fafbc7eb84004b96f0b4a82d37c21 Sep 08 11:48:55.090260 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-TestEncryptedCinderVolumes-1722295247-project Sep 08 11:48:55.090260 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 11:48:55.090260 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance c259dc22-1bf5-427c-b36e-e68244f50369 is not attached to volume 40210dbd-de18-4c43-a6f3-f96dc6fdba2f Sep 08 11:48:55.090260 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'server_id': 'c259dc22-1bf5-427c-b36e-e68244f50369', 'id': '40210dbd-de18-4c43-a6f3-f96dc6fdba2f'} Sep 08 11:48:55.090260 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:48:55.090260 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:48:55.090260 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 08 11:48:55.090260 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 08 11:48:55.090260 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 11:48:55.090260 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 11:48:55.090260 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 08 11:48:55.090260 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 08 11:48:55.090260 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 40210dbd-de18-4c43-a6f3-f96dc6fdba2f. Sep 08 11:48:55.090260 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:48:55.090260 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:48:55.090260 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:48:55.090260 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:48:55.090260 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:48:55.090260 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:48:55.090260 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:48:55.090260 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:48:55.090260 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:48:55.090260 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:48:55.090260 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 08 11:48:55.090260 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 08 11:48:55.090260 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c259dc22-1bf5-427c-b36e-e68244f50369 is not attached to volume 40210dbd-de18-4c43-a6f3-f96dc6fdba2f Sep 08 11:48:55.090260 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:48:55.090260 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:48:55.090260 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:48:55.090260 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:48:55.090260 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:48:55.090260 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:48:55.094953 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:48:55.094953 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:48:55.094953 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c259dc22-1bf5-427c-b36e-e68244f50369 is not attached to volume 40210dbd-de18-4c43-a6f3-f96dc6fdba2f Sep 08 11:48:55.094953 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:48:55.094953 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7c0cf202-ec81-4ef7-932b-7bdc0ccc9cce tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Returning 404 to user: Instance c259dc22-1bf5-427c-b36e-e68244f50369 is not attached to volume 40210dbd-de18-4c43-a6f3-f96dc6fdba2f {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:48:55.094953 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7c0cf202-ec81-4ef7-932b-7bdc0ccc9cce tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c259dc22-1bf5-427c-b36e-e68244f50369/os-volume_attachments/40210dbd-de18-4c43-a6f3-f96dc6fdba2f" status: 404 len: 154 microversion: 2.1 time: 0.097691 Sep 08 11:48:55.094953 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3744/7353] 10.222.0.27 () {58 vars in 1416 bytes} [Thu Sep 8 11:48:54 2022] DELETE /compute/v2.1/servers/c259dc22-1bf5-427c-b36e-e68244f50369/os-volume_attachments/40210dbd-de18-4c43-a6f3-f96dc6fdba2f => generated 154 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:48:58.471486 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2acf1c56-66b1-491b-866d-bef2d51727ef tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:48:58.471986 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2acf1c56-66b1-491b-866d-bef2d51727ef tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] [instance: c259dc22-1bf5-427c-b36e-e68244f50369] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:48:58.480315 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2acf1c56-66b1-491b-866d-bef2d51727ef tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:58.480315 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2acf1c56-66b1-491b-866d-bef2d51727ef tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:58.480315 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2acf1c56-66b1-491b-866d-bef2d51727ef tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:58.483852 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2acf1c56-66b1-491b-866d-bef2d51727ef tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:58.483852 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2acf1c56-66b1-491b-866d-bef2d51727ef tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:58.483852 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2acf1c56-66b1-491b-866d-bef2d51727ef tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:58.513312 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2acf1c56-66b1-491b-866d-bef2d51727ef tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] [instance: c259dc22-1bf5-427c-b36e-e68244f50369] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:48:58.599589 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2acf1c56-66b1-491b-866d-bef2d51727ef tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c259dc22-1bf5-427c-b36e-e68244f50369" status: 204 len: 0 microversion: 2.1 time: 0.131513 Sep 08 11:48:58.600441 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3610/7354] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:48:58 2022] DELETE /compute/v2.1/servers/c259dc22-1bf5-427c-b36e-e68244f50369 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:48:58.611249 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a9d1e5fc-ef47-46c9-8fa8-3c4c0aaac92c tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:48:58.612299 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a9d1e5fc-ef47-46c9-8fa8-3c4c0aaac92c tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] [instance: c259dc22-1bf5-427c-b36e-e68244f50369] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:48:58.624122 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a9d1e5fc-ef47-46c9-8fa8-3c4c0aaac92c tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:58.625113 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a9d1e5fc-ef47-46c9-8fa8-3c4c0aaac92c tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:58.626046 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a9d1e5fc-ef47-46c9-8fa8-3c4c0aaac92c tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:58.627276 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a9d1e5fc-ef47-46c9-8fa8-3c4c0aaac92c tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:58.627832 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a9d1e5fc-ef47-46c9-8fa8-3c4c0aaac92c tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:58.628575 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a9d1e5fc-ef47-46c9-8fa8-3c4c0aaac92c tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:58.788880 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a9d1e5fc-ef47-46c9-8fa8-3c4c0aaac92c tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fafbc7eb84004b96f0b4a82d37c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb883d25c960430aa07ef867fae8a4cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:48:58.799100 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a9d1e5fc-ef47-46c9-8fa8-3c4c0aaac92c tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "GET /compute/v2.1/servers/c259dc22-1bf5-427c-b36e-e68244f50369" status: 200 len: 1560 microversion: 2.1 time: 0.193087 Sep 08 11:48:58.799689 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3745/7355] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:48:58 2022] GET /compute/v2.1/servers/c259dc22-1bf5-427c-b36e-e68244f50369 => generated 1560 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:48:59.826224 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c194eee2-53c6-4ead-9b69-52e647ef5c1d tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:48:59.826959 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c194eee2-53c6-4ead-9b69-52e647ef5c1d tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] [instance: c259dc22-1bf5-427c-b36e-e68244f50369] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:48:59.836082 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c194eee2-53c6-4ead-9b69-52e647ef5c1d tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:59.836659 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c194eee2-53c6-4ead-9b69-52e647ef5c1d tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:59.837367 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c194eee2-53c6-4ead-9b69-52e647ef5c1d tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:59.838202 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c194eee2-53c6-4ead-9b69-52e647ef5c1d tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:59.838721 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c194eee2-53c6-4ead-9b69-52e647ef5c1d tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:59.839136 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c194eee2-53c6-4ead-9b69-52e647ef5c1d tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:59.983468 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c194eee2-53c6-4ead-9b69-52e647ef5c1d tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fafbc7eb84004b96f0b4a82d37c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb883d25c960430aa07ef867fae8a4cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:48:59.993942 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c194eee2-53c6-4ead-9b69-52e647ef5c1d tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "GET /compute/v2.1/servers/c259dc22-1bf5-427c-b36e-e68244f50369" status: 200 len: 1560 microversion: 2.1 time: 0.173158 Sep 08 11:48:59.994576 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3611/7356] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:48:59 2022] GET /compute/v2.1/servers/c259dc22-1bf5-427c-b36e-e68244f50369 => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:49:00.755868 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-2267408a-85c3-4a78-b51b-6c043cbc6a8c req-4f22b06a-a24e-4486-a51b-5bc1dfef84ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c259dc22-1bf5-427c-b36e-e68244f50369", "name": "network-vif-deleted", "tag": "13a4ab34-f7fd-4b84-bfd8-337193920b30"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:49:00.767453 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-2267408a-85c3-4a78-b51b-6c043cbc6a8c req-4f22b06a-a24e-4486-a51b-5bc1dfef84ea service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:49:00.768056 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-2267408a-85c3-4a78-b51b-6c043cbc6a8c req-4f22b06a-a24e-4486-a51b-5bc1dfef84ea service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:49:00.768506 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-2267408a-85c3-4a78-b51b-6c043cbc6a8c req-4f22b06a-a24e-4486-a51b-5bc1dfef84ea service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:49:00.781155 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-2267408a-85c3-4a78-b51b-6c043cbc6a8c req-4f22b06a-a24e-4486-a51b-5bc1dfef84ea service nova] Creating event network-vif-deleted:13a4ab34-f7fd-4b84-bfd8-337193920b30 for instance c259dc22-1bf5-427c-b36e-e68244f50369 on n-h1-850501-12 Sep 08 11:49:00.793277 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-2267408a-85c3-4a78-b51b-6c043cbc6a8c req-4f22b06a-a24e-4486-a51b-5bc1dfef84ea service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040895 Sep 08 11:49:00.794199 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3746/7357] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:49:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:49:01.021954 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2d585850-78ed-4ae7-bb20-196744409861 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:49:01.022585 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2d585850-78ed-4ae7-bb20-196744409861 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] [instance: c259dc22-1bf5-427c-b36e-e68244f50369] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:49:01.030386 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2d585850-78ed-4ae7-bb20-196744409861 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:49:01.030901 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2d585850-78ed-4ae7-bb20-196744409861 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:49:01.031358 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2d585850-78ed-4ae7-bb20-196744409861 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:49:01.032089 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2d585850-78ed-4ae7-bb20-196744409861 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:49:01.032563 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2d585850-78ed-4ae7-bb20-196744409861 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:49:01.033013 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2d585850-78ed-4ae7-bb20-196744409861 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:49:01.066386 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2d585850-78ed-4ae7-bb20-196744409861 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:49:01.066892 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2d585850-78ed-4ae7-bb20-196744409861 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:49:01.067351 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2d585850-78ed-4ae7-bb20-196744409861 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:49:01.067821 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-2d585850-78ed-4ae7-bb20-196744409861 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lazy-loading 'fault' on Instance uuid c259dc22-1bf5-427c-b36e-e68244f50369 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:49:01.110448 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2d585850-78ed-4ae7-bb20-196744409861 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fafbc7eb84004b96f0b4a82d37c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb883d25c960430aa07ef867fae8a4cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:49:01.118826 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2d585850-78ed-4ae7-bb20-196744409861 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "GET /compute/v2.1/servers/c259dc22-1bf5-427c-b36e-e68244f50369" status: 200 len: 1352 microversion: 2.1 time: 0.100565 Sep 08 11:49:01.119544 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3612/7358] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:49:01 2022] GET /compute/v2.1/servers/c259dc22-1bf5-427c-b36e-e68244f50369 => generated 1352 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:49:02.143857 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-55255295-8f36-4e74-b695-4fcac6ce439b tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:49:02.144495 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-55255295-8f36-4e74-b695-4fcac6ce439b tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] [instance: c259dc22-1bf5-427c-b36e-e68244f50369] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:49:02.150902 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-55255295-8f36-4e74-b695-4fcac6ce439b tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:49:02.151390 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-55255295-8f36-4e74-b695-4fcac6ce439b tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:49:02.151838 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-55255295-8f36-4e74-b695-4fcac6ce439b tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:49:02.152562 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-55255295-8f36-4e74-b695-4fcac6ce439b tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:49:02.153107 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-55255295-8f36-4e74-b695-4fcac6ce439b tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:49:02.153547 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-55255295-8f36-4e74-b695-4fcac6ce439b tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:49:02.167800 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-55255295-8f36-4e74-b695-4fcac6ce439b tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] HTTP exception thrown: Instance c259dc22-1bf5-427c-b36e-e68244f50369 could not be found. Sep 08 11:49:02.169467 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-55255295-8f36-4e74-b695-4fcac6ce439b tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Request method failure captured: Sep 08 11:49:02.169467 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/c259dc22-1bf5-427c-b36e-e68244f50369 HTTP/1.1 Sep 08 11:49:02.169467 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 11:49:02.169467 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 11:49:02.169467 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 11:49:02.169467 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 11:49:02.169467 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 11:49:02.169467 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 11:49:02.169467 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 11:49:02.169467 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 11:49:02.169467 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGdY8gUeJdpjSGW7jdIynOwQtfPRRhOFAU_kUawURrTao31k-U7JhDXRTiBz-xLd1NLJK73p_170PApmzvFFr9yhED0yBrXqu9R8kNuwTLD4PsPuJhtBR65uKQb_FEr2KnfUiesq9tYlsz1hotiyJdDnImi3VzMhBfsbVOY8PHP27k1Q Sep 08 11:49:02.169467 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 11:49:02.169467 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 11:49:02.169467 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 11:49:02.169467 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 11:49:02.169467 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 11:49:02.169467 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 11:49:02.169467 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: eb883d25c960430aa07ef867fae8a4cb Sep 08 11:49:02.169467 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1722295247 Sep 08 11:49:02.169467 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 11:49:02.169467 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 11:49:02.169467 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/eb883d25c960430aa07ef867fae8a4cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eb883d25c960430aa07ef867fae8a4cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_eb883d25c960430aa07ef867fae8a4cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eb883d25c960430aa07ef867fae8a4cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:49:02.169467 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-TestEncryptedCinderVolumes-1722295247 Sep 08 11:49:02.169467 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: eb883d25c960430aa07ef867fae8a4cb Sep 08 11:49:02.169467 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1722295247 Sep 08 11:49:02.169467 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-TestEncryptedCinderVolumes-1722295247-project Sep 08 11:49:02.169467 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 11:49:02.169467 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 11:49:02.169467 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: fc1fafbc7eb84004b96f0b4a82d37c21 Sep 08 11:49:02.169467 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-TestEncryptedCinderVolumes-1722295247-project Sep 08 11:49:02.169467 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 11:49:02.169467 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance c259dc22-1bf5-427c-b36e-e68244f50369 could not be found. Sep 08 11:49:02.169467 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': 'c259dc22-1bf5-427c-b36e-e68244f50369'} Sep 08 11:49:02.169467 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:49:02.169467 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:49:02.169467 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:49:02.169467 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:49:02.169467 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:49:02.169467 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:49:02.169467 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:49:02.169467 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:49:02.169467 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:49:02.169467 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:49:02.169467 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c259dc22-1bf5-427c-b36e-e68244f50369 could not be found. Sep 08 11:49:02.169467 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:49:02.169467 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:49:02.169467 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:49:02.169467 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:49:02.169467 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:49:02.169467 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:49:02.169467 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:49:02.169467 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:49:02.169467 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:49:02.169467 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:49:02.169467 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:49:02.169467 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:49:02.169467 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:49:02.169467 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:49:02.169467 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:49:02.169467 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:49:02.169467 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c259dc22-1bf5-427c-b36e-e68244f50369 could not be found. Sep 08 11:49:02.169467 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:49:02.169467 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:49:02.174551 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:49:02.174551 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:49:02.174551 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:49:02.174551 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:49:02.174551 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:49:02.174551 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:49:02.174551 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c259dc22-1bf5-427c-b36e-e68244f50369 could not be found. Sep 08 11:49:02.174551 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 11:49:02.174551 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-55255295-8f36-4e74-b695-4fcac6ce439b tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Returning 404 to user: Instance c259dc22-1bf5-427c-b36e-e68244f50369 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:49:02.174551 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-55255295-8f36-4e74-b695-4fcac6ce439b tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "GET /compute/v2.1/servers/c259dc22-1bf5-427c-b36e-e68244f50369" status: 404 len: 111 microversion: 2.1 time: 0.032297 Sep 08 11:49:02.174551 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3747/7359] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:49:02 2022] GET /compute/v2.1/servers/c259dc22-1bf5-427c-b36e-e68244f50369 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:49:02.179646 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-eb32d27e-b7c3-405e-acb6-f07c181972b0 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] Calling method '.version_select at 0x7f68e46c9dc0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:49:02.208488 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-eb32d27e-b7c3-405e-acb6-f07c181972b0 tempest-TestEncryptedCinderVolumes-1722295247 tempest-TestEncryptedCinderVolumes-1722295247-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1356251603" status: 202 len: 0 microversion: 2.1 time: 0.032535 Sep 08 11:49:02.209270 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3613/7360] 10.222.0.27 () {58 vars in 1278 bytes} [Thu Sep 8 11:49:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1356251603 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:49:29.440663 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f9e56688-6904-47b2-b722-cb788d95ed18 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Action: 'create', calling method: .version_select at 0x7f68deffbf70>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-420690434", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAXwVVCfs6qCZOC5wih13BCQxHfynp5Hpp3x/KXy0yc5jTIaM7D5+Yo+jOYGPspLBZ5vZ8i7HvUqlG2mgr2xVyMISjiGspkcVw0SDpjqrcsBsWHuOPuoz0+qHDXcXlD/Jw=="}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:49:29.447386 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=14 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:49:29.448060 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=34 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:49:29.459813 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-f9e56688-6904-47b2-b722-cb788d95ed18 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Getting quotas for project b4e4076abe344b879519de24063d992a. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:49:29.465256 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-f9e56688-6904-47b2-b722-cb788d95ed18 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Getting quotas for user b343d30c733d41b3a6b2f2648e7a3a09 and project b4e4076abe344b879519de24063d992a. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:49:29.488584 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f9e56688-6904-47b2-b722-cb788d95ed18 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.052098 Sep 08 11:49:29.489198 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3748/7361] 10.222.0.27 () {60 vars in 1159 bytes} [Thu Sep 8 11:49:29 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:49:29.537781 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:49:29.538550 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:49:29.543146 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-70fc35b0-8d4f-4b50-af26-2bd6cf2e29b2 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1369357678", "imageRef": "fe51d57f-8de2-4c89-b976-d53c07dfe88d", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-420690434", "networks": [{"uuid": "8965aaec-00c4-4191-bc41-899115ac6261"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:49:29.598381 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-70fc35b0-8d4f-4b50-af26-2bd6cf2e29b2 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] validate_networks() for [('8965aaec-00c4-4191-bc41-899115ac6261', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:49:30.001232 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-70fc35b0-8d4f-4b50-af26-2bd6cf2e29b2 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:49:30.001677 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-70fc35b0-8d4f-4b50-af26-2bd6cf2e29b2 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:49:30.002168 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-70fc35b0-8d4f-4b50-af26-2bd6cf2e29b2 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:49:30.002594 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-70fc35b0-8d4f-4b50-af26-2bd6cf2e29b2 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:49:30.003021 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-70fc35b0-8d4f-4b50-af26-2bd6cf2e29b2 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:49:30.012026 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70fc35b0-8d4f-4b50-af26-2bd6cf2e29b2 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:49:30.012526 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70fc35b0-8d4f-4b50-af26-2bd6cf2e29b2 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:49:30.012975 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70fc35b0-8d4f-4b50-af26-2bd6cf2e29b2 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:49:30.013754 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70fc35b0-8d4f-4b50-af26-2bd6cf2e29b2 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:49:30.014227 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70fc35b0-8d4f-4b50-af26-2bd6cf2e29b2 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:49:30.014676 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70fc35b0-8d4f-4b50-af26-2bd6cf2e29b2 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:49:30.032417 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-70fc35b0-8d4f-4b50-af26-2bd6cf2e29b2 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Getting quotas for project b4e4076abe344b879519de24063d992a. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:49:30.037681 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-70fc35b0-8d4f-4b50-af26-2bd6cf2e29b2 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Getting quotas for user b343d30c733d41b3a6b2f2648e7a3a09 and project b4e4076abe344b879519de24063d992a. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:49:30.050528 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-70fc35b0-8d4f-4b50-af26-2bd6cf2e29b2 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:49:30.052762 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-70fc35b0-8d4f-4b50-af26-2bd6cf2e29b2 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: f7ea9d81-12b6-4fea-ae3c-a06034c59318] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe51d57f-8de2-4c89-b976-d53c07dfe88d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:49:30.098572 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-70fc35b0-8d4f-4b50-af26-2bd6cf2e29b2 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.562853 Sep 08 11:49:30.099225 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3614/7362] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 11:49:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 564 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:49:30.111920 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-edc028b6-a7ee-4084-8d79-b6d53cac1531 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:49:30.112558 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-edc028b6-a7ee-4084-8d79-b6d53cac1531 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: f7ea9d81-12b6-4fea-ae3c-a06034c59318] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:49:30.186584 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-edc028b6-a7ee-4084-8d79-b6d53cac1531 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b343d30c733d41b3a6b2f2648e7a3a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e4076abe344b879519de24063d992a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:49:30.193665 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-edc028b6-a7ee-4084-8d79-b6d53cac1531 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318" status: 200 len: 1258 microversion: 2.1 time: 0.086512 Sep 08 11:49:30.208824 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3749/7363] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:49:30 2022] GET /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318 => generated 1258 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:49:31.219318 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-78a22955-f679-4495-967a-ee467f6f8902 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:49:31.220877 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-78a22955-f679-4495-967a-ee467f6f8902 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: f7ea9d81-12b6-4fea-ae3c-a06034c59318] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:49:31.229088 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-78a22955-f679-4495-967a-ee467f6f8902 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:49:31.229972 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-78a22955-f679-4495-967a-ee467f6f8902 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:49:31.230609 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-78a22955-f679-4495-967a-ee467f6f8902 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:49:31.231415 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-78a22955-f679-4495-967a-ee467f6f8902 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:49:31.231896 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-78a22955-f679-4495-967a-ee467f6f8902 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:49:31.232374 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-78a22955-f679-4495-967a-ee467f6f8902 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:49:31.300221 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-78a22955-f679-4495-967a-ee467f6f8902 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b343d30c733d41b3a6b2f2648e7a3a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e4076abe344b879519de24063d992a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:49:31.309064 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-78a22955-f679-4495-967a-ee467f6f8902 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318" status: 200 len: 1328 microversion: 2.1 time: 0.096787 Sep 08 11:49:31.309652 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3615/7364] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:49:31 2022] GET /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318 => generated 1328 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:49:32.332902 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-19c1ce10-ef1a-4d5d-b273-baa8aa21e5cc tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:49:32.334686 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-19c1ce10-ef1a-4d5d-b273-baa8aa21e5cc tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: f7ea9d81-12b6-4fea-ae3c-a06034c59318] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:49:32.343312 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-19c1ce10-ef1a-4d5d-b273-baa8aa21e5cc tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:49:32.355909 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-19c1ce10-ef1a-4d5d-b273-baa8aa21e5cc tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:49:32.356618 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-19c1ce10-ef1a-4d5d-b273-baa8aa21e5cc tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:49:32.357716 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-19c1ce10-ef1a-4d5d-b273-baa8aa21e5cc tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:49:32.358502 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-19c1ce10-ef1a-4d5d-b273-baa8aa21e5cc tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:49:32.359102 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-19c1ce10-ef1a-4d5d-b273-baa8aa21e5cc tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:49:32.520389 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-19c1ce10-ef1a-4d5d-b273-baa8aa21e5cc tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b343d30c733d41b3a6b2f2648e7a3a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e4076abe344b879519de24063d992a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:49:32.530021 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-19c1ce10-ef1a-4d5d-b273-baa8aa21e5cc tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318" status: 200 len: 1358 microversion: 2.1 time: 0.201947 Sep 08 11:49:32.530717 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3750/7365] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:49:32 2022] GET /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318 => generated 1358 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:49:33.553846 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3e8bf0b4-5160-40b7-ad5c-2ae590d01454 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:49:33.554755 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3e8bf0b4-5160-40b7-ad5c-2ae590d01454 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: f7ea9d81-12b6-4fea-ae3c-a06034c59318] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:49:33.562767 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e8bf0b4-5160-40b7-ad5c-2ae590d01454 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:49:33.563370 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e8bf0b4-5160-40b7-ad5c-2ae590d01454 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:49:33.563924 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e8bf0b4-5160-40b7-ad5c-2ae590d01454 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:49:33.564763 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e8bf0b4-5160-40b7-ad5c-2ae590d01454 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:49:33.565422 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e8bf0b4-5160-40b7-ad5c-2ae590d01454 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:49:33.565942 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e8bf0b4-5160-40b7-ad5c-2ae590d01454 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:49:33.721634 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3e8bf0b4-5160-40b7-ad5c-2ae590d01454 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b343d30c733d41b3a6b2f2648e7a3a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e4076abe344b879519de24063d992a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:49:33.731090 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3e8bf0b4-5160-40b7-ad5c-2ae590d01454 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318" status: 200 len: 1358 microversion: 2.1 time: 0.181150 Sep 08 11:49:33.731804 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3616/7366] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:49:33 2022] GET /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:49:34.755860 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6362413b-4c2d-4d62-b5a0-7bf36280d32b tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:49:34.756487 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6362413b-4c2d-4d62-b5a0-7bf36280d32b tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: f7ea9d81-12b6-4fea-ae3c-a06034c59318] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:49:34.763877 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6362413b-4c2d-4d62-b5a0-7bf36280d32b tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:49:34.764400 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6362413b-4c2d-4d62-b5a0-7bf36280d32b tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:49:34.764883 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6362413b-4c2d-4d62-b5a0-7bf36280d32b tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:49:34.765643 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6362413b-4c2d-4d62-b5a0-7bf36280d32b tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:49:34.766119 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6362413b-4c2d-4d62-b5a0-7bf36280d32b tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:49:34.766545 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6362413b-4c2d-4d62-b5a0-7bf36280d32b tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:49:34.922182 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6362413b-4c2d-4d62-b5a0-7bf36280d32b tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b343d30c733d41b3a6b2f2648e7a3a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e4076abe344b879519de24063d992a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:49:34.930218 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6362413b-4c2d-4d62-b5a0-7bf36280d32b tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318" status: 200 len: 1358 microversion: 2.1 time: 0.178268 Sep 08 11:49:34.930808 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3751/7367] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:49:34 2022] GET /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:49:35.953676 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ffab80e7-c3c6-448e-b3e4-6acc24ace482 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:49:35.954309 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ffab80e7-c3c6-448e-b3e4-6acc24ace482 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: f7ea9d81-12b6-4fea-ae3c-a06034c59318] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:49:35.964932 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ffab80e7-c3c6-448e-b3e4-6acc24ace482 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:49:35.977146 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ffab80e7-c3c6-448e-b3e4-6acc24ace482 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:49:35.978953 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ffab80e7-c3c6-448e-b3e4-6acc24ace482 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:49:35.980981 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ffab80e7-c3c6-448e-b3e4-6acc24ace482 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:49:35.982066 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ffab80e7-c3c6-448e-b3e4-6acc24ace482 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:49:35.982755 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ffab80e7-c3c6-448e-b3e4-6acc24ace482 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:49:36.132812 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ffab80e7-c3c6-448e-b3e4-6acc24ace482 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b343d30c733d41b3a6b2f2648e7a3a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e4076abe344b879519de24063d992a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:49:36.141638 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ffab80e7-c3c6-448e-b3e4-6acc24ace482 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318" status: 200 len: 1358 microversion: 2.1 time: 0.191697 Sep 08 11:49:36.142644 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3617/7368] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:49:35 2022] GET /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318 => generated 1358 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:49:37.165707 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-73c1bd76-1ab4-44e8-9d80-29a2ba01c527 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:49:37.166647 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-73c1bd76-1ab4-44e8-9d80-29a2ba01c527 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: f7ea9d81-12b6-4fea-ae3c-a06034c59318] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:49:37.174157 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-73c1bd76-1ab4-44e8-9d80-29a2ba01c527 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:49:37.174989 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-73c1bd76-1ab4-44e8-9d80-29a2ba01c527 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:49:37.175439 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-73c1bd76-1ab4-44e8-9d80-29a2ba01c527 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:49:37.176167 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-73c1bd76-1ab4-44e8-9d80-29a2ba01c527 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:49:37.176632 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-73c1bd76-1ab4-44e8-9d80-29a2ba01c527 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:49:37.177091 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-73c1bd76-1ab4-44e8-9d80-29a2ba01c527 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:49:37.325594 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-73c1bd76-1ab4-44e8-9d80-29a2ba01c527 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b343d30c733d41b3a6b2f2648e7a3a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e4076abe344b879519de24063d992a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:49:37.336259 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-73c1bd76-1ab4-44e8-9d80-29a2ba01c527 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318" status: 200 len: 1358 microversion: 2.1 time: 0.174803 Sep 08 11:49:37.350209 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3752/7369] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:49:37 2022] GET /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318 => generated 1358 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:49:38.376210 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5119b4bd-deac-443c-97fe-54f65a402182 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:49:38.377723 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5119b4bd-deac-443c-97fe-54f65a402182 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: f7ea9d81-12b6-4fea-ae3c-a06034c59318] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:49:38.396736 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5119b4bd-deac-443c-97fe-54f65a402182 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:49:38.397686 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5119b4bd-deac-443c-97fe-54f65a402182 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:49:38.398494 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5119b4bd-deac-443c-97fe-54f65a402182 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:49:38.399772 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5119b4bd-deac-443c-97fe-54f65a402182 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:49:38.400904 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5119b4bd-deac-443c-97fe-54f65a402182 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:49:38.401734 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5119b4bd-deac-443c-97fe-54f65a402182 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:49:38.545731 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5119b4bd-deac-443c-97fe-54f65a402182 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b343d30c733d41b3a6b2f2648e7a3a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e4076abe344b879519de24063d992a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:49:38.555090 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5119b4bd-deac-443c-97fe-54f65a402182 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318" status: 200 len: 1358 microversion: 2.1 time: 0.199982 Sep 08 11:49:38.555884 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3618/7370] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:49:38 2022] GET /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318 => generated 1358 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:49:39.578671 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6bbaafb4-61d6-4cf7-bb96-ab8b479a1c5a tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:49:39.579300 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6bbaafb4-61d6-4cf7-bb96-ab8b479a1c5a tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: f7ea9d81-12b6-4fea-ae3c-a06034c59318] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:49:39.586373 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6bbaafb4-61d6-4cf7-bb96-ab8b479a1c5a tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:49:39.586871 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6bbaafb4-61d6-4cf7-bb96-ab8b479a1c5a tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:49:39.587353 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6bbaafb4-61d6-4cf7-bb96-ab8b479a1c5a tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:49:39.588131 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6bbaafb4-61d6-4cf7-bb96-ab8b479a1c5a tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:49:39.588531 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6bbaafb4-61d6-4cf7-bb96-ab8b479a1c5a tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:49:39.588962 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6bbaafb4-61d6-4cf7-bb96-ab8b479a1c5a tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:49:39.807606 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6bbaafb4-61d6-4cf7-bb96-ab8b479a1c5a tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b343d30c733d41b3a6b2f2648e7a3a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e4076abe344b879519de24063d992a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:49:39.827504 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6bbaafb4-61d6-4cf7-bb96-ab8b479a1c5a tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318" status: 200 len: 1358 microversion: 2.1 time: 0.252721 Sep 08 11:49:39.828099 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3753/7371] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:49:39 2022] GET /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318 => generated 1358 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:49:40.076707 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-950a78c6-96f9-4cdc-ab51-0949acd885f0 req-bb0289b5-b2a3-45a4-ae75-770bb4bbd443 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7ea9d81-12b6-4fea-ae3c-a06034c59318", "tag": "2b1b9029-1271-49ed-845c-3188c3880bce"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:49:40.085368 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:49:40.086442 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:49:40.096147 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-950a78c6-96f9-4cdc-ab51-0949acd885f0 req-bb0289b5-b2a3-45a4-ae75-770bb4bbd443 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:49:40.097322 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-950a78c6-96f9-4cdc-ab51-0949acd885f0 req-bb0289b5-b2a3-45a4-ae75-770bb4bbd443 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:49:40.097847 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-950a78c6-96f9-4cdc-ab51-0949acd885f0 req-bb0289b5-b2a3-45a4-ae75-770bb4bbd443 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:49:40.112441 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-950a78c6-96f9-4cdc-ab51-0949acd885f0 req-bb0289b5-b2a3-45a4-ae75-770bb4bbd443 service nova] Creating event network-changed:2b1b9029-1271-49ed-845c-3188c3880bce for instance f7ea9d81-12b6-4fea-ae3c-a06034c59318 on n-h1-850501-12 Sep 08 11:49:40.117994 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-950a78c6-96f9-4cdc-ab51-0949acd885f0 req-bb0289b5-b2a3-45a4-ae75-770bb4bbd443 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045779 Sep 08 11:49:40.119012 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3619/7372] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:49:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:49:40.851033 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8b4623f7-2f2e-410b-b4f4-2672332ecea3 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:49:40.851677 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8b4623f7-2f2e-410b-b4f4-2672332ecea3 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: f7ea9d81-12b6-4fea-ae3c-a06034c59318] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:49:40.854255 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=6 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:49:40.860417 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8b4623f7-2f2e-410b-b4f4-2672332ecea3 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:49:40.860915 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8b4623f7-2f2e-410b-b4f4-2672332ecea3 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:49:40.861385 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8b4623f7-2f2e-410b-b4f4-2672332ecea3 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:49:40.862151 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8b4623f7-2f2e-410b-b4f4-2672332ecea3 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:49:40.862659 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8b4623f7-2f2e-410b-b4f4-2672332ecea3 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:49:40.863153 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8b4623f7-2f2e-410b-b4f4-2672332ecea3 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:49:40.998857 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8b4623f7-2f2e-410b-b4f4-2672332ecea3 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b343d30c733d41b3a6b2f2648e7a3a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e4076abe344b879519de24063d992a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:49:41.007373 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8b4623f7-2f2e-410b-b4f4-2672332ecea3 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318" status: 200 len: 1358 microversion: 2.1 time: 0.160167 Sep 08 11:49:41.008205 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3754/7373] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:49:40 2022] GET /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:49:42.031219 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-009739bc-2f1e-4fd6-b681-80aa34693492 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:49:42.031939 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-009739bc-2f1e-4fd6-b681-80aa34693492 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: f7ea9d81-12b6-4fea-ae3c-a06034c59318] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:49:42.039093 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-009739bc-2f1e-4fd6-b681-80aa34693492 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:49:42.039601 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-009739bc-2f1e-4fd6-b681-80aa34693492 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:49:42.040056 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-009739bc-2f1e-4fd6-b681-80aa34693492 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:49:42.041307 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-009739bc-2f1e-4fd6-b681-80aa34693492 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:49:42.041841 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-009739bc-2f1e-4fd6-b681-80aa34693492 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:49:42.042316 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-009739bc-2f1e-4fd6-b681-80aa34693492 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:49:42.183754 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-009739bc-2f1e-4fd6-b681-80aa34693492 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b343d30c733d41b3a6b2f2648e7a3a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e4076abe344b879519de24063d992a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:49:42.191849 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-009739bc-2f1e-4fd6-b681-80aa34693492 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318" status: 200 len: 1358 microversion: 2.1 time: 0.164865 Sep 08 11:49:42.192682 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3620/7374] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:49:42 2022] GET /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:49:43.217123 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bb0607df-6e1e-4da3-9294-561d33fd1abc tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:49:43.218130 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bb0607df-6e1e-4da3-9294-561d33fd1abc tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: f7ea9d81-12b6-4fea-ae3c-a06034c59318] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:49:43.225244 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bb0607df-6e1e-4da3-9294-561d33fd1abc tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:49:43.225738 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bb0607df-6e1e-4da3-9294-561d33fd1abc tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:49:43.226172 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bb0607df-6e1e-4da3-9294-561d33fd1abc tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:49:43.226875 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bb0607df-6e1e-4da3-9294-561d33fd1abc tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:49:43.227331 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bb0607df-6e1e-4da3-9294-561d33fd1abc tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:49:43.228242 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bb0607df-6e1e-4da3-9294-561d33fd1abc tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:49:43.361738 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-bb0607df-6e1e-4da3-9294-561d33fd1abc tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b343d30c733d41b3a6b2f2648e7a3a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e4076abe344b879519de24063d992a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:49:43.370297 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bb0607df-6e1e-4da3-9294-561d33fd1abc tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318" status: 200 len: 1358 microversion: 2.1 time: 0.158670 Sep 08 11:49:43.370859 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3755/7375] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:49:43 2022] GET /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:49:44.393556 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1b1115d8-1389-432c-885b-c3d1277436cb tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:49:44.394183 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1b1115d8-1389-432c-885b-c3d1277436cb tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: f7ea9d81-12b6-4fea-ae3c-a06034c59318] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:49:44.402230 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b1115d8-1389-432c-885b-c3d1277436cb tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:49:44.402739 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b1115d8-1389-432c-885b-c3d1277436cb tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:49:44.403197 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b1115d8-1389-432c-885b-c3d1277436cb tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:49:44.403919 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b1115d8-1389-432c-885b-c3d1277436cb tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:49:44.404402 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b1115d8-1389-432c-885b-c3d1277436cb tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:49:44.404841 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b1115d8-1389-432c-885b-c3d1277436cb tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:49:44.536363 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1b1115d8-1389-432c-885b-c3d1277436cb tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b343d30c733d41b3a6b2f2648e7a3a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e4076abe344b879519de24063d992a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:49:44.545242 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1b1115d8-1389-432c-885b-c3d1277436cb tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318" status: 200 len: 1358 microversion: 2.1 time: 0.155616 Sep 08 11:49:44.545825 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3621/7376] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:49:44 2022] GET /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:49:45.567939 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-640ac597-7613-41d4-9891-378482a449b5 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:49:45.568578 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-640ac597-7613-41d4-9891-378482a449b5 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: f7ea9d81-12b6-4fea-ae3c-a06034c59318] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:49:45.576289 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-640ac597-7613-41d4-9891-378482a449b5 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:49:45.576785 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-640ac597-7613-41d4-9891-378482a449b5 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:49:45.577389 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-640ac597-7613-41d4-9891-378482a449b5 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:49:45.578349 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-640ac597-7613-41d4-9891-378482a449b5 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:49:45.579018 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-640ac597-7613-41d4-9891-378482a449b5 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:49:45.579465 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-640ac597-7613-41d4-9891-378482a449b5 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:49:45.722173 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-5e102f24-02fa-4734-8c01-3855d62c1a47 req-5e99da8a-8418-443c-9a8a-b4c258f95f0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7ea9d81-12b6-4fea-ae3c-a06034c59318", "name": "network-vif-plugged", "status": "completed", "tag": "2b1b9029-1271-49ed-845c-3188c3880bce"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:49:45.733387 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-640ac597-7613-41d4-9891-378482a449b5 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b343d30c733d41b3a6b2f2648e7a3a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e4076abe344b879519de24063d992a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:49:45.736252 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-5e102f24-02fa-4734-8c01-3855d62c1a47 req-5e99da8a-8418-443c-9a8a-b4c258f95f0e service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:49:45.736868 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-5e102f24-02fa-4734-8c01-3855d62c1a47 req-5e99da8a-8418-443c-9a8a-b4c258f95f0e service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:49:45.737437 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-5e102f24-02fa-4734-8c01-3855d62c1a47 req-5e99da8a-8418-443c-9a8a-b4c258f95f0e service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:49:45.741389 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-640ac597-7613-41d4-9891-378482a449b5 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318" status: 200 len: 1358 microversion: 2.1 time: 0.177389 Sep 08 11:49:45.742358 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3756/7377] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:49:45 2022] GET /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318 => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:49:45.751154 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-5e102f24-02fa-4734-8c01-3855d62c1a47 req-5e99da8a-8418-443c-9a8a-b4c258f95f0e service nova] Creating event network-vif-plugged:2b1b9029-1271-49ed-845c-3188c3880bce for instance f7ea9d81-12b6-4fea-ae3c-a06034c59318 on n-h1-850501-12 Sep 08 11:49:45.756909 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-5e102f24-02fa-4734-8c01-3855d62c1a47 req-5e99da8a-8418-443c-9a8a-b4c258f95f0e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038891 Sep 08 11:49:45.758065 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3622/7378] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:49:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:49:46.764940 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9f8a283e-9c42-46a9-b69a-ec9cd6ebcf54 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:49:46.765614 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9f8a283e-9c42-46a9-b69a-ec9cd6ebcf54 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: f7ea9d81-12b6-4fea-ae3c-a06034c59318] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:49:46.773357 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f8a283e-9c42-46a9-b69a-ec9cd6ebcf54 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:49:46.773857 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f8a283e-9c42-46a9-b69a-ec9cd6ebcf54 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:49:46.774294 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f8a283e-9c42-46a9-b69a-ec9cd6ebcf54 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:49:46.775006 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f8a283e-9c42-46a9-b69a-ec9cd6ebcf54 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:49:46.775465 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f8a283e-9c42-46a9-b69a-ec9cd6ebcf54 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:49:46.775892 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f8a283e-9c42-46a9-b69a-ec9cd6ebcf54 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:49:46.921318 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9f8a283e-9c42-46a9-b69a-ec9cd6ebcf54 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b343d30c733d41b3a6b2f2648e7a3a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e4076abe344b879519de24063d992a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:49:46.933067 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9f8a283e-9c42-46a9-b69a-ec9cd6ebcf54 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318" status: 200 len: 1358 microversion: 2.1 time: 0.171863 Sep 08 11:49:46.933691 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3757/7379] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:49:46 2022] GET /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:49:47.956211 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-30991997-5f5a-4f63-ab83-a3d31ed15577 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:49:47.956927 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-30991997-5f5a-4f63-ab83-a3d31ed15577 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: f7ea9d81-12b6-4fea-ae3c-a06034c59318] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:49:47.964186 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-30991997-5f5a-4f63-ab83-a3d31ed15577 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:49:47.964688 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-30991997-5f5a-4f63-ab83-a3d31ed15577 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:49:47.965158 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-30991997-5f5a-4f63-ab83-a3d31ed15577 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:49:47.965872 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-30991997-5f5a-4f63-ab83-a3d31ed15577 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:49:47.966339 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-30991997-5f5a-4f63-ab83-a3d31ed15577 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:49:47.966780 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-30991997-5f5a-4f63-ab83-a3d31ed15577 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:49:48.112248 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-30991997-5f5a-4f63-ab83-a3d31ed15577 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b343d30c733d41b3a6b2f2648e7a3a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e4076abe344b879519de24063d992a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:49:48.120351 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-30991997-5f5a-4f63-ab83-a3d31ed15577 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318" status: 200 len: 1548 microversion: 2.1 time: 0.168371 Sep 08 11:49:48.120937 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3623/7380] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:49:47 2022] GET /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318 => generated 1548 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:49:48.142268 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ce357b33-6bd9-41a7-aa19-409691a3971f tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:49:48.142943 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ce357b33-6bd9-41a7-aa19-409691a3971f tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: f7ea9d81-12b6-4fea-ae3c-a06034c59318] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:49:48.149802 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ce357b33-6bd9-41a7-aa19-409691a3971f tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:49:48.150279 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ce357b33-6bd9-41a7-aa19-409691a3971f tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:49:48.150723 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ce357b33-6bd9-41a7-aa19-409691a3971f tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:49:48.152040 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ce357b33-6bd9-41a7-aa19-409691a3971f tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:49:48.152501 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ce357b33-6bd9-41a7-aa19-409691a3971f tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:49:48.152935 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ce357b33-6bd9-41a7-aa19-409691a3971f tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:49:48.281486 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ce357b33-6bd9-41a7-aa19-409691a3971f tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b343d30c733d41b3a6b2f2648e7a3a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e4076abe344b879519de24063d992a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:49:48.289563 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ce357b33-6bd9-41a7-aa19-409691a3971f tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318" status: 200 len: 1548 microversion: 2.1 time: 0.151198 Sep 08 11:49:48.290140 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3758/7381] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:49:48 2022] GET /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318 => generated 1548 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:49:48.311858 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-525c6c15-c134-4b8f-9d87-b39494e24186 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:49:48.316533 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-525c6c15-c134-4b8f-9d87-b39494e24186 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b343d30c733d41b3a6b2f2648e7a3a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e4076abe344b879519de24063d992a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:49:48.317367 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-525c6c15-c134-4b8f-9d87-b39494e24186 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Searching by: {'deleted': False, 'project_id': 'b4e4076abe344b879519de24063d992a'} {{(pid=128862) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 11:49:48.322820 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-525c6c15-c134-4b8f-9d87-b39494e24186 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:49:48.323535 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-525c6c15-c134-4b8f-9d87-b39494e24186 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:49:48.323988 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-525c6c15-c134-4b8f-9d87-b39494e24186 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:49:48.324801 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-525c6c15-c134-4b8f-9d87-b39494e24186 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:49:48.325294 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-525c6c15-c134-4b8f-9d87-b39494e24186 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:49:48.325734 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-525c6c15-c134-4b8f-9d87-b39494e24186 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:49:48.351191 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.multi_cell_list [None req-525c6c15-c134-4b8f-9d87-b39494e24186 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128862) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 11:49:48.379620 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-525c6c15-c134-4b8f-9d87-b39494e24186 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.071507 Sep 08 11:49:48.380215 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3624/7382] 10.222.0.27 () {58 vars in 1125 bytes} [Thu Sep 8 11:49:48 2022] GET /compute/v2.1/servers => generated 343 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:49:48.392246 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d2336ce6-4eff-44cd-81fc-6debe1e3b0f2 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:49:48.392865 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d2336ce6-4eff-44cd-81fc-6debe1e3b0f2 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: f7ea9d81-12b6-4fea-ae3c-a06034c59318] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:49:48.399072 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d2336ce6-4eff-44cd-81fc-6debe1e3b0f2 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:49:48.399535 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d2336ce6-4eff-44cd-81fc-6debe1e3b0f2 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:49:48.399976 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d2336ce6-4eff-44cd-81fc-6debe1e3b0f2 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:49:48.400671 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d2336ce6-4eff-44cd-81fc-6debe1e3b0f2 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:49:48.401669 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d2336ce6-4eff-44cd-81fc-6debe1e3b0f2 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:49:48.402098 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d2336ce6-4eff-44cd-81fc-6debe1e3b0f2 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:49:48.536692 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d2336ce6-4eff-44cd-81fc-6debe1e3b0f2 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b343d30c733d41b3a6b2f2648e7a3a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e4076abe344b879519de24063d992a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:49:48.544771 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d2336ce6-4eff-44cd-81fc-6debe1e3b0f2 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318" status: 200 len: 1548 microversion: 2.1 time: 0.156425 Sep 08 11:49:48.545389 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3759/7383] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:49:48 2022] GET /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318 => generated 1548 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:49:50.085232 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3bc372bc-1e47-4616-ae19-d82b0e1ed095 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "382cde2c-22fc-44ea-bd80-ff8da487c560"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:49:50.087695 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3bc372bc-1e47-4616-ae19-d82b0e1ed095 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: f7ea9d81-12b6-4fea-ae3c-a06034c59318] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:49:50.095656 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3bc372bc-1e47-4616-ae19-d82b0e1ed095 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:49:50.096230 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3bc372bc-1e47-4616-ae19-d82b0e1ed095 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:49:50.096692 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3bc372bc-1e47-4616-ae19-d82b0e1ed095 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:49:50.097485 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3bc372bc-1e47-4616-ae19-d82b0e1ed095 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:49:50.097970 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3bc372bc-1e47-4616-ae19-d82b0e1ed095 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:49:50.098422 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3bc372bc-1e47-4616-ae19-d82b0e1ed095 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:49:50.341397 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3bc372bc-1e47-4616-ae19-d82b0e1ed095 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "POST /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.260024 Sep 08 11:49:50.342237 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3625/7384] 10.222.0.27 () {60 vars in 1323 bytes} [Thu Sep 8 11:49:50 2022] POST /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318/os-volume_attachments => generated 194 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:50:03.417764 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-74942802-6dac-4593-ab9e-27b4f76a2d14 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:50:03.418380 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-74942802-6dac-4593-ab9e-27b4f76a2d14 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: f7ea9d81-12b6-4fea-ae3c-a06034c59318] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:50:03.421545 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:50:03.422204 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=60 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:50:03.428622 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-74942802-6dac-4593-ab9e-27b4f76a2d14 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:50:03.429141 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-74942802-6dac-4593-ab9e-27b4f76a2d14 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:50:03.429583 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-74942802-6dac-4593-ab9e-27b4f76a2d14 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:50:03.430275 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-74942802-6dac-4593-ab9e-27b4f76a2d14 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:50:03.430731 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-74942802-6dac-4593-ab9e-27b4f76a2d14 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:50:03.431159 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-74942802-6dac-4593-ab9e-27b4f76a2d14 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:50:03.569407 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-74942802-6dac-4593-ab9e-27b4f76a2d14 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b343d30c733d41b3a6b2f2648e7a3a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e4076abe344b879519de24063d992a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:50:03.578756 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-74942802-6dac-4593-ab9e-27b4f76a2d14 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318" status: 200 len: 1594 microversion: 2.1 time: 0.165081 Sep 08 11:50:03.579336 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3760/7385] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:50:03 2022] GET /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318 => generated 1594 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:50:05.771513 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:50:05.772713 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:50:05.773767 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:50:05.976738 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-c1b8d23f-b377-442b-b330-d06864a06b82 req-5f290957-2255-4ce4-8b2c-cfce837ef9d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7ea9d81-12b6-4fea-ae3c-a06034c59318", "tag": "2b1b9029-1271-49ed-845c-3188c3880bce"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:50:05.994213 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c1b8d23f-b377-442b-b330-d06864a06b82 req-5f290957-2255-4ce4-8b2c-cfce837ef9d1 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:50:05.995104 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c1b8d23f-b377-442b-b330-d06864a06b82 req-5f290957-2255-4ce4-8b2c-cfce837ef9d1 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:50:05.995293 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c1b8d23f-b377-442b-b330-d06864a06b82 req-5f290957-2255-4ce4-8b2c-cfce837ef9d1 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:50:06.008280 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-c1b8d23f-b377-442b-b330-d06864a06b82 req-5f290957-2255-4ce4-8b2c-cfce837ef9d1 service nova] Creating event network-changed:2b1b9029-1271-49ed-845c-3188c3880bce for instance f7ea9d81-12b6-4fea-ae3c-a06034c59318 on n-h1-850501-12 Sep 08 11:50:06.014352 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-c1b8d23f-b377-442b-b330-d06864a06b82 req-5f290957-2255-4ce4-8b2c-cfce837ef9d1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.244524 Sep 08 11:50:06.015627 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3626/7386] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:50:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:50:06.891806 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4fb3be4f-6498-4230-82df-a7ca8a6600d8 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1035921001"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:50:06.892357 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4fb3be4f-6498-4230-82df-a7ca8a6600d8 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: f7ea9d81-12b6-4fea-ae3c-a06034c59318] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:50:06.900121 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4fb3be4f-6498-4230-82df-a7ca8a6600d8 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:50:06.901261 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4fb3be4f-6498-4230-82df-a7ca8a6600d8 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:50:06.901917 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4fb3be4f-6498-4230-82df-a7ca8a6600d8 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:50:06.902721 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4fb3be4f-6498-4230-82df-a7ca8a6600d8 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:50:06.903340 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4fb3be4f-6498-4230-82df-a7ca8a6600d8 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:50:06.903991 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4fb3be4f-6498-4230-82df-a7ca8a6600d8 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:50:07.049854 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.network.security_group_api [None req-4fb3be4f-6498-4230-82df-a7ca8a6600d8 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Adding security group 274f295f-f4b7-4f82-8d09-5598415abd79 to port 2b1b9029-1271-49ed-845c-3188c3880bce Sep 08 11:50:07.384578 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4fb3be4f-6498-4230-82df-a7ca8a6600d8 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "POST /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318/action" status: 202 len: 0 microversion: 2.1 time: 0.496946 Sep 08 11:50:07.389537 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3761/7387] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 11:50:06 2022] POST /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318/action => generated 0 bytes in 503 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:50:07.395687 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e6c19ef7-e611-4e63-8567-e25c02d5f05e tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:50:07.396896 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e6c19ef7-e611-4e63-8567-e25c02d5f05e tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: f7ea9d81-12b6-4fea-ae3c-a06034c59318] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:50:07.397899 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-b377c405-5769-4648-af34-77f498a67beb req-d0b17298-18dd-4b97-bf3a-04205408ca90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7ea9d81-12b6-4fea-ae3c-a06034c59318", "tag": "2b1b9029-1271-49ed-845c-3188c3880bce"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:50:07.408478 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e6c19ef7-e611-4e63-8567-e25c02d5f05e tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:50:07.408999 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e6c19ef7-e611-4e63-8567-e25c02d5f05e tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:50:07.410038 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e6c19ef7-e611-4e63-8567-e25c02d5f05e tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:50:07.410779 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e6c19ef7-e611-4e63-8567-e25c02d5f05e tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:50:07.411443 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e6c19ef7-e611-4e63-8567-e25c02d5f05e tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:50:07.412084 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e6c19ef7-e611-4e63-8567-e25c02d5f05e tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:50:07.414741 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b377c405-5769-4648-af34-77f498a67beb req-d0b17298-18dd-4b97-bf3a-04205408ca90 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:50:07.416660 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b377c405-5769-4648-af34-77f498a67beb req-d0b17298-18dd-4b97-bf3a-04205408ca90 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:50:07.419800 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b377c405-5769-4648-af34-77f498a67beb req-d0b17298-18dd-4b97-bf3a-04205408ca90 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:50:07.440812 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-b377c405-5769-4648-af34-77f498a67beb req-d0b17298-18dd-4b97-bf3a-04205408ca90 service nova] Creating event network-changed:2b1b9029-1271-49ed-845c-3188c3880bce for instance f7ea9d81-12b6-4fea-ae3c-a06034c59318 on n-h1-850501-12 Sep 08 11:50:07.454796 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-b377c405-5769-4648-af34-77f498a67beb req-d0b17298-18dd-4b97-bf3a-04205408ca90 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062477 Sep 08 11:50:07.456768 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3627/7388] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:50:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:50:07.685379 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e6c19ef7-e611-4e63-8567-e25c02d5f05e tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b343d30c733d41b3a6b2f2648e7a3a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e4076abe344b879519de24063d992a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:50:07.697333 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e6c19ef7-e611-4e63-8567-e25c02d5f05e tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318" status: 200 len: 1760 microversion: 2.1 time: 0.306112 Sep 08 11:50:07.699087 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3762/7389] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:50:07 2022] GET /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318 => generated 1760 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:51:46.174931 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=4 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:51:46.183893 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=4 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:51:46.183893 n-d-850501-12 devstack@n-api.service[128862]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Sep 08 11:51:46.183893 n-d-850501-12 devstack@n-api.service[128862]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Sep 08 11:51:46.191009 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d3887c38-1c2c-4e28-af33-c45f28066ebf tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:51:46.193706 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d3887c38-1c2c-4e28-af33-c45f28066ebf tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: f7ea9d81-12b6-4fea-ae3c-a06034c59318] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:51:46.201979 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d3887c38-1c2c-4e28-af33-c45f28066ebf tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:51:46.202647 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d3887c38-1c2c-4e28-af33-c45f28066ebf tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:51:46.203333 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d3887c38-1c2c-4e28-af33-c45f28066ebf tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:51:46.208029 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d3887c38-1c2c-4e28-af33-c45f28066ebf tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:51:46.208516 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d3887c38-1c2c-4e28-af33-c45f28066ebf tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:51:46.208957 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d3887c38-1c2c-4e28-af33-c45f28066ebf tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:51:46.286949 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d3887c38-1c2c-4e28-af33-c45f28066ebf tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "POST /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318/action" status: 202 len: 0 microversion: 2.1 time: 0.114535 Sep 08 11:51:46.287616 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3628/7390] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 11:51:46 2022] POST /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:51:46.299005 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-690db736-d23f-4649-b0f1-ca8983cc25d8 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:51:46.299638 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-690db736-d23f-4649-b0f1-ca8983cc25d8 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: f7ea9d81-12b6-4fea-ae3c-a06034c59318] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:51:46.302343 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=6 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:51:46.303024 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=16 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:51:46.304286 n-d-850501-12 devstack@n-api.service[128861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 11:51:46.304462 n-d-850501-12 devstack@n-api.service[128861]: Thu Sep 8 11:51:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318 (ip 10.222.0.27) !!! Sep 08 11:51:46.312645 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-690db736-d23f-4649-b0f1-ca8983cc25d8 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:51:46.313257 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-690db736-d23f-4649-b0f1-ca8983cc25d8 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:51:46.313710 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-690db736-d23f-4649-b0f1-ca8983cc25d8 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:51:46.314440 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-690db736-d23f-4649-b0f1-ca8983cc25d8 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:51:46.314909 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-690db736-d23f-4649-b0f1-ca8983cc25d8 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:51:46.315846 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-690db736-d23f-4649-b0f1-ca8983cc25d8 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:51:46.649003 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-690db736-d23f-4649-b0f1-ca8983cc25d8 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b343d30c733d41b3a6b2f2648e7a3a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e4076abe344b879519de24063d992a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:51:46.657962 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-690db736-d23f-4649-b0f1-ca8983cc25d8 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318" status: 200 len: 1762 microversion: 2.1 time: 0.363796 Sep 08 11:51:46.658480 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3763/7391] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:51:46 2022] GET /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318 => generated 1762 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:51:47.682862 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-68e07c77-ec48-4ec8-91d3-9e6f8c9759c1 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:51:47.683581 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-68e07c77-ec48-4ec8-91d3-9e6f8c9759c1 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: f7ea9d81-12b6-4fea-ae3c-a06034c59318] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:51:47.690994 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68e07c77-ec48-4ec8-91d3-9e6f8c9759c1 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:51:47.691502 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68e07c77-ec48-4ec8-91d3-9e6f8c9759c1 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:51:47.691953 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68e07c77-ec48-4ec8-91d3-9e6f8c9759c1 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:51:47.693306 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68e07c77-ec48-4ec8-91d3-9e6f8c9759c1 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:51:47.693859 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68e07c77-ec48-4ec8-91d3-9e6f8c9759c1 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:51:47.694300 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68e07c77-ec48-4ec8-91d3-9e6f8c9759c1 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:51:47.893097 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-68e07c77-ec48-4ec8-91d3-9e6f8c9759c1 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b343d30c733d41b3a6b2f2648e7a3a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e4076abe344b879519de24063d992a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:51:47.901758 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-68e07c77-ec48-4ec8-91d3-9e6f8c9759c1 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318" status: 200 len: 1767 microversion: 2.1 time: 0.223181 Sep 08 11:51:47.902331 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3629/7392] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:51:47 2022] GET /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318 => generated 1767 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:51:48.926365 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-77ed1e75-ef94-4e63-8914-48a1dcb9e319 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:51:48.927767 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-77ed1e75-ef94-4e63-8914-48a1dcb9e319 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: f7ea9d81-12b6-4fea-ae3c-a06034c59318] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:51:48.935013 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-77ed1e75-ef94-4e63-8914-48a1dcb9e319 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:51:48.935523 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-77ed1e75-ef94-4e63-8914-48a1dcb9e319 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:51:48.936003 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-77ed1e75-ef94-4e63-8914-48a1dcb9e319 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:51:48.936714 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-77ed1e75-ef94-4e63-8914-48a1dcb9e319 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:51:48.937220 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-77ed1e75-ef94-4e63-8914-48a1dcb9e319 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:51:48.937657 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-77ed1e75-ef94-4e63-8914-48a1dcb9e319 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:51:49.082611 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-77ed1e75-ef94-4e63-8914-48a1dcb9e319 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b343d30c733d41b3a6b2f2648e7a3a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e4076abe344b879519de24063d992a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:51:49.091529 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-77ed1e75-ef94-4e63-8914-48a1dcb9e319 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318" status: 200 len: 1767 microversion: 2.1 time: 0.169130 Sep 08 11:51:49.092113 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3764/7393] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:51:48 2022] GET /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318 => generated 1767 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:51:50.116551 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d52c6929-1cee-46dc-a322-57e97715b944 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:51:50.117211 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d52c6929-1cee-46dc-a322-57e97715b944 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: f7ea9d81-12b6-4fea-ae3c-a06034c59318] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:51:50.123829 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d52c6929-1cee-46dc-a322-57e97715b944 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:51:50.124332 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d52c6929-1cee-46dc-a322-57e97715b944 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:51:50.124789 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d52c6929-1cee-46dc-a322-57e97715b944 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:51:50.125538 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d52c6929-1cee-46dc-a322-57e97715b944 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:51:50.126016 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d52c6929-1cee-46dc-a322-57e97715b944 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:51:50.126459 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d52c6929-1cee-46dc-a322-57e97715b944 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:51:50.275206 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d52c6929-1cee-46dc-a322-57e97715b944 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b343d30c733d41b3a6b2f2648e7a3a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e4076abe344b879519de24063d992a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:51:50.283576 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d52c6929-1cee-46dc-a322-57e97715b944 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318" status: 200 len: 1767 microversion: 2.1 time: 0.172266 Sep 08 11:51:50.284162 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3630/7394] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:51:50 2022] GET /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318 => generated 1767 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:51:51.307026 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-260cd11c-3295-4e12-b64c-6ed0c7690b27 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:51:51.307645 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-260cd11c-3295-4e12-b64c-6ed0c7690b27 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: f7ea9d81-12b6-4fea-ae3c-a06034c59318] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:51:51.314542 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-260cd11c-3295-4e12-b64c-6ed0c7690b27 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:51:51.315033 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-260cd11c-3295-4e12-b64c-6ed0c7690b27 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:51:51.315471 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-260cd11c-3295-4e12-b64c-6ed0c7690b27 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:51:51.316167 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-260cd11c-3295-4e12-b64c-6ed0c7690b27 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:51:51.316626 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-260cd11c-3295-4e12-b64c-6ed0c7690b27 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:51:51.317217 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-260cd11c-3295-4e12-b64c-6ed0c7690b27 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:51:51.468772 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-260cd11c-3295-4e12-b64c-6ed0c7690b27 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b343d30c733d41b3a6b2f2648e7a3a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e4076abe344b879519de24063d992a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:51:51.479574 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-260cd11c-3295-4e12-b64c-6ed0c7690b27 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318" status: 200 len: 1767 microversion: 2.1 time: 0.176552 Sep 08 11:51:51.480162 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3765/7395] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:51:51 2022] GET /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318 => generated 1767 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:51:52.504103 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c19ffe1f-69f2-42e7-ae97-6dfceab57a11 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:51:52.505183 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c19ffe1f-69f2-42e7-ae97-6dfceab57a11 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: f7ea9d81-12b6-4fea-ae3c-a06034c59318] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:51:52.512462 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c19ffe1f-69f2-42e7-ae97-6dfceab57a11 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:51:52.512900 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c19ffe1f-69f2-42e7-ae97-6dfceab57a11 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:51:52.513383 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c19ffe1f-69f2-42e7-ae97-6dfceab57a11 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:51:52.514767 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c19ffe1f-69f2-42e7-ae97-6dfceab57a11 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:51:52.515601 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c19ffe1f-69f2-42e7-ae97-6dfceab57a11 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:51:52.515747 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c19ffe1f-69f2-42e7-ae97-6dfceab57a11 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:51:52.671383 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c19ffe1f-69f2-42e7-ae97-6dfceab57a11 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b343d30c733d41b3a6b2f2648e7a3a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e4076abe344b879519de24063d992a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:51:52.680537 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c19ffe1f-69f2-42e7-ae97-6dfceab57a11 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318" status: 200 len: 1767 microversion: 2.1 time: 0.180328 Sep 08 11:51:52.681071 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3631/7396] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:51:52 2022] GET /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318 => generated 1767 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:51:53.703897 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-933182b5-4c3e-4654-a927-312284767af5 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:51:53.704502 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-933182b5-4c3e-4654-a927-312284767af5 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: f7ea9d81-12b6-4fea-ae3c-a06034c59318] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:51:53.711797 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-933182b5-4c3e-4654-a927-312284767af5 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:51:53.712291 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-933182b5-4c3e-4654-a927-312284767af5 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:51:53.712753 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-933182b5-4c3e-4654-a927-312284767af5 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:51:53.713509 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-933182b5-4c3e-4654-a927-312284767af5 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:51:53.713972 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-933182b5-4c3e-4654-a927-312284767af5 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:51:53.714399 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-933182b5-4c3e-4654-a927-312284767af5 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:51:53.857739 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-933182b5-4c3e-4654-a927-312284767af5 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b343d30c733d41b3a6b2f2648e7a3a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e4076abe344b879519de24063d992a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:51:53.866807 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-933182b5-4c3e-4654-a927-312284767af5 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318" status: 200 len: 1760 microversion: 2.1 time: 0.166867 Sep 08 11:51:53.867383 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3766/7397] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:51:53 2022] GET /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318 => generated 1760 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:53:00.434339 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=8 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:53:00.435161 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:53:00.440440 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e0afb215-7078-44c8-b99c-4f97f0f3ab66 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1035921001"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:53:00.440985 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e0afb215-7078-44c8-b99c-4f97f0f3ab66 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: f7ea9d81-12b6-4fea-ae3c-a06034c59318] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:53:00.449520 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0afb215-7078-44c8-b99c-4f97f0f3ab66 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:53:00.450029 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0afb215-7078-44c8-b99c-4f97f0f3ab66 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:53:00.450484 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0afb215-7078-44c8-b99c-4f97f0f3ab66 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:53:00.451203 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0afb215-7078-44c8-b99c-4f97f0f3ab66 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:53:00.451677 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0afb215-7078-44c8-b99c-4f97f0f3ab66 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:53:00.452093 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0afb215-7078-44c8-b99c-4f97f0f3ab66 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:53:00.583132 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.network.security_group_api [None req-e0afb215-7078-44c8-b99c-4f97f0f3ab66 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Removing security group 274f295f-f4b7-4f82-8d09-5598415abd79 from port 2b1b9029-1271-49ed-845c-3188c3880bce Sep 08 11:53:00.914136 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e0afb215-7078-44c8-b99c-4f97f0f3ab66 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "POST /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318/action" status: 202 len: 0 microversion: 2.1 time: 0.481791 Sep 08 11:53:00.922501 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3632/7398] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 11:53:00 2022] POST /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318/action => generated 0 bytes in 491 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:53:00.924892 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-bd75162e-f63a-4343-b688-cc421a6485dc req-5d3a5757-73ad-494c-80f0-e0767af832b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7ea9d81-12b6-4fea-ae3c-a06034c59318", "tag": "2b1b9029-1271-49ed-845c-3188c3880bce"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:53:00.934003 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=8 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:53:00.935059 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=24 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:53:00.942600 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-bd75162e-f63a-4343-b688-cc421a6485dc req-5d3a5757-73ad-494c-80f0-e0767af832b0 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:53:00.943428 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-bd75162e-f63a-4343-b688-cc421a6485dc req-5d3a5757-73ad-494c-80f0-e0767af832b0 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:53:00.944090 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-bd75162e-f63a-4343-b688-cc421a6485dc req-5d3a5757-73ad-494c-80f0-e0767af832b0 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:53:00.960143 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-bd75162e-f63a-4343-b688-cc421a6485dc req-5d3a5757-73ad-494c-80f0-e0767af832b0 service nova] Creating event network-changed:2b1b9029-1271-49ed-845c-3188c3880bce for instance f7ea9d81-12b6-4fea-ae3c-a06034c59318 on n-h1-850501-12 Sep 08 11:53:00.971600 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-bd75162e-f63a-4343-b688-cc421a6485dc req-5d3a5757-73ad-494c-80f0-e0767af832b0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050800 Sep 08 11:53:00.972838 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3767/7399] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:53:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:53:02.140778 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d4d554fe-e407-40ce-b78b-228b6e9018a7 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:53:02.141438 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d4d554fe-e407-40ce-b78b-228b6e9018a7 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: f7ea9d81-12b6-4fea-ae3c-a06034c59318] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:53:02.147675 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d4d554fe-e407-40ce-b78b-228b6e9018a7 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:53:02.148177 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d4d554fe-e407-40ce-b78b-228b6e9018a7 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:53:02.148630 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d4d554fe-e407-40ce-b78b-228b6e9018a7 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:53:02.149468 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d4d554fe-e407-40ce-b78b-228b6e9018a7 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:53:02.150010 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d4d554fe-e407-40ce-b78b-228b6e9018a7 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:53:02.150456 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d4d554fe-e407-40ce-b78b-228b6e9018a7 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:53:02.234541 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-d4d554fe-e407-40ce-b78b-228b6e9018a7 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lazy-loading 'services' on Instance uuid f7ea9d81-12b6-4fea-ae3c-a06034c59318 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:53:02.310392 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d4d554fe-e407-40ce-b78b-228b6e9018a7 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318/os-volume_attachments/382cde2c-22fc-44ea-bd80-ff8da487c560" status: 202 len: 0 microversion: 2.1 time: 0.174370 Sep 08 11:53:02.310911 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3633/7400] 10.222.0.27 () {58 vars in 1416 bytes} [Thu Sep 8 11:53:02 2022] DELETE /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318/os-volume_attachments/382cde2c-22fc-44ea-bd80-ff8da487c560 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 11:53:02.324897 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cd8945ca-adc3-4037-9e79-c712dd3e1dee tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:53:02.327550 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cd8945ca-adc3-4037-9e79-c712dd3e1dee tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: f7ea9d81-12b6-4fea-ae3c-a06034c59318] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:53:02.334769 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cd8945ca-adc3-4037-9e79-c712dd3e1dee tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:53:02.335359 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cd8945ca-adc3-4037-9e79-c712dd3e1dee tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:53:02.335989 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cd8945ca-adc3-4037-9e79-c712dd3e1dee tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:53:02.336957 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cd8945ca-adc3-4037-9e79-c712dd3e1dee tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:53:02.337849 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cd8945ca-adc3-4037-9e79-c712dd3e1dee tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:53:02.339511 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cd8945ca-adc3-4037-9e79-c712dd3e1dee tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:53:02.381412 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cd8945ca-adc3-4037-9e79-c712dd3e1dee tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063016 Sep 08 11:53:02.381996 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3768/7401] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 11:53:02 2022] GET /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:53:02.987874 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-643d7050-3162-4ed5-a82d-ce90d693dfc7 req-943a0cc7-20af-4094-bfff-27e9442dc41c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7ea9d81-12b6-4fea-ae3c-a06034c59318", "tag": "2b1b9029-1271-49ed-845c-3188c3880bce"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:53:02.999454 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-643d7050-3162-4ed5-a82d-ce90d693dfc7 req-943a0cc7-20af-4094-bfff-27e9442dc41c service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:53:02.999879 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-643d7050-3162-4ed5-a82d-ce90d693dfc7 req-943a0cc7-20af-4094-bfff-27e9442dc41c service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:53:03.000321 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-643d7050-3162-4ed5-a82d-ce90d693dfc7 req-943a0cc7-20af-4094-bfff-27e9442dc41c service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:53:03.013568 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-643d7050-3162-4ed5-a82d-ce90d693dfc7 req-943a0cc7-20af-4094-bfff-27e9442dc41c service nova] Creating event network-changed:2b1b9029-1271-49ed-845c-3188c3880bce for instance f7ea9d81-12b6-4fea-ae3c-a06034c59318 on n-h1-850501-12 Sep 08 11:53:03.026366 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-643d7050-3162-4ed5-a82d-ce90d693dfc7 req-943a0cc7-20af-4094-bfff-27e9442dc41c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034922 Sep 08 11:53:03.026366 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3634/7402] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:53:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:53:03.395062 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-32092c51-91a1-489b-8913-4e754caf266a tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:53:03.397484 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-32092c51-91a1-489b-8913-4e754caf266a tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: f7ea9d81-12b6-4fea-ae3c-a06034c59318] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:53:03.404636 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-32092c51-91a1-489b-8913-4e754caf266a tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:53:03.404969 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-32092c51-91a1-489b-8913-4e754caf266a tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:53:03.405353 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-32092c51-91a1-489b-8913-4e754caf266a tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:53:03.406061 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-32092c51-91a1-489b-8913-4e754caf266a tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:53:03.406517 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-32092c51-91a1-489b-8913-4e754caf266a tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:53:03.406943 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-32092c51-91a1-489b-8913-4e754caf266a tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:53:03.439984 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-32092c51-91a1-489b-8913-4e754caf266a tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049352 Sep 08 11:53:03.441148 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3769/7403] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 11:53:03 2022] GET /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:53:04.453972 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-57759b3a-ef5f-4413-8641-3b3762a519e6 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:53:04.456311 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-57759b3a-ef5f-4413-8641-3b3762a519e6 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: f7ea9d81-12b6-4fea-ae3c-a06034c59318] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:53:04.464193 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-57759b3a-ef5f-4413-8641-3b3762a519e6 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:53:04.464707 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-57759b3a-ef5f-4413-8641-3b3762a519e6 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:53:04.465191 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-57759b3a-ef5f-4413-8641-3b3762a519e6 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:53:04.466143 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-57759b3a-ef5f-4413-8641-3b3762a519e6 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:53:04.466386 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-57759b3a-ef5f-4413-8641-3b3762a519e6 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:53:04.466824 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-57759b3a-ef5f-4413-8641-3b3762a519e6 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:53:04.510311 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-57759b3a-ef5f-4413-8641-3b3762a519e6 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061439 Sep 08 11:53:04.510893 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3635/7404] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 11:53:04 2022] GET /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:53:05.523084 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cfdc177c-9a93-4f4f-81b8-5885ee6b31ee tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:53:05.526080 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cfdc177c-9a93-4f4f-81b8-5885ee6b31ee tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: f7ea9d81-12b6-4fea-ae3c-a06034c59318] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:53:05.532870 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cfdc177c-9a93-4f4f-81b8-5885ee6b31ee tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:53:05.533392 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cfdc177c-9a93-4f4f-81b8-5885ee6b31ee tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:53:05.533840 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cfdc177c-9a93-4f4f-81b8-5885ee6b31ee tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:53:05.534535 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cfdc177c-9a93-4f4f-81b8-5885ee6b31ee tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:53:05.534996 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cfdc177c-9a93-4f4f-81b8-5885ee6b31ee tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:53:05.535423 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cfdc177c-9a93-4f4f-81b8-5885ee6b31ee tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:53:05.569568 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cfdc177c-9a93-4f4f-81b8-5885ee6b31ee tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050551 Sep 08 11:53:05.570339 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3770/7405] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 11:53:05 2022] GET /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:53:06.582956 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-31f7f855-3c14-46d9-8ab1-38816e6effd5 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:53:06.585198 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-31f7f855-3c14-46d9-8ab1-38816e6effd5 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: f7ea9d81-12b6-4fea-ae3c-a06034c59318] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:53:06.592883 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-31f7f855-3c14-46d9-8ab1-38816e6effd5 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:53:06.593427 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-31f7f855-3c14-46d9-8ab1-38816e6effd5 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:53:06.593885 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-31f7f855-3c14-46d9-8ab1-38816e6effd5 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:53:06.594846 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-31f7f855-3c14-46d9-8ab1-38816e6effd5 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:53:06.595237 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-31f7f855-3c14-46d9-8ab1-38816e6effd5 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:53:06.595601 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-31f7f855-3c14-46d9-8ab1-38816e6effd5 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:53:06.626903 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-31f7f855-3c14-46d9-8ab1-38816e6effd5 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047948 Sep 08 11:53:06.627476 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3636/7406] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 11:53:06 2022] GET /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:53:07.640268 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2e6df551-9240-47ab-8887-dafa122bf2bc tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:53:07.643913 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2e6df551-9240-47ab-8887-dafa122bf2bc tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: f7ea9d81-12b6-4fea-ae3c-a06034c59318] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:53:07.651757 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2e6df551-9240-47ab-8887-dafa122bf2bc tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:53:07.652254 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2e6df551-9240-47ab-8887-dafa122bf2bc tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:53:07.652690 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2e6df551-9240-47ab-8887-dafa122bf2bc tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:53:07.653418 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2e6df551-9240-47ab-8887-dafa122bf2bc tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:53:07.653875 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2e6df551-9240-47ab-8887-dafa122bf2bc tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:53:07.654297 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2e6df551-9240-47ab-8887-dafa122bf2bc tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:53:07.684658 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2e6df551-9240-47ab-8887-dafa122bf2bc tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048495 Sep 08 11:53:07.685276 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3771/7407] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 11:53:07 2022] GET /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 11:53:07.696002 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0db81adf-8ed0-41b4-9c50-c70d1db9b518 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:53:07.696917 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0db81adf-8ed0-41b4-9c50-c70d1db9b518 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: f7ea9d81-12b6-4fea-ae3c-a06034c59318] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:53:07.704143 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0db81adf-8ed0-41b4-9c50-c70d1db9b518 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:53:07.704654 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0db81adf-8ed0-41b4-9c50-c70d1db9b518 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:53:07.705139 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0db81adf-8ed0-41b4-9c50-c70d1db9b518 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:53:07.705862 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0db81adf-8ed0-41b4-9c50-c70d1db9b518 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:53:07.706342 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0db81adf-8ed0-41b4-9c50-c70d1db9b518 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:53:07.706789 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0db81adf-8ed0-41b4-9c50-c70d1db9b518 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:53:07.787331 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-0db81adf-8ed0-41b4-9c50-c70d1db9b518 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] HTTP exception thrown: Instance f7ea9d81-12b6-4fea-ae3c-a06034c59318 is not attached to volume 382cde2c-22fc-44ea-bd80-ff8da487c560 Sep 08 11:53:07.788971 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0db81adf-8ed0-41b4-9c50-c70d1db9b518 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Request method failure captured: Sep 08 11:53:07.788971 n-d-850501-12 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318/os-volume_attachments/382cde2c-22fc-44ea-bd80-ff8da487c560 HTTP/1.1 Sep 08 11:53:07.788971 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 11:53:07.788971 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 11:53:07.788971 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 11:53:07.788971 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 11:53:07.788971 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 11:53:07.788971 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 11:53:07.788971 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 11:53:07.788971 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 11:53:07.788971 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGda6lt0OjQky38i1I7zhTNEPFh3M7HMD5N2Z6L8DcuJK8H27LSlRofjxr8N1ZePurD5L0_b2saB9rphWkmMqKZblvSLPEPBdKBfbjQ_RIeFv7nQIdh5-cXWLnDkBoJwO0lrVfpVc2Lh8vDtjoonozBib4-rCvZ3wwEJlVQ77AWI7LIM Sep 08 11:53:07.788971 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 11:53:07.788971 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 11:53:07.788971 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 11:53:07.788971 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 11:53:07.788971 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 11:53:07.788971 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 11:53:07.788971 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: b4e4076abe344b879519de24063d992a Sep 08 11:53:07.788971 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-TestMinimumBasicScenario-1082017553 Sep 08 11:53:07.788971 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 11:53:07.788971 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 11:53:07.788971 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b4e4076abe344b879519de24063d992a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b4e4076abe344b879519de24063d992a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b4e4076abe344b879519de24063d992a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b4e4076abe344b879519de24063d992a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:53:07.788971 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-TestMinimumBasicScenario-1082017553 Sep 08 11:53:07.788971 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: b4e4076abe344b879519de24063d992a Sep 08 11:53:07.788971 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1082017553 Sep 08 11:53:07.788971 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-TestMinimumBasicScenario-1082017553-project Sep 08 11:53:07.788971 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 11:53:07.788971 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 11:53:07.788971 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: b343d30c733d41b3a6b2f2648e7a3a09 Sep 08 11:53:07.788971 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-TestMinimumBasicScenario-1082017553-project Sep 08 11:53:07.788971 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 11:53:07.788971 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance f7ea9d81-12b6-4fea-ae3c-a06034c59318 is not attached to volume 382cde2c-22fc-44ea-bd80-ff8da487c560 Sep 08 11:53:07.788971 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'server_id': 'f7ea9d81-12b6-4fea-ae3c-a06034c59318', 'id': '382cde2c-22fc-44ea-bd80-ff8da487c560'} Sep 08 11:53:07.788971 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:53:07.788971 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:53:07.788971 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 08 11:53:07.788971 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 08 11:53:07.788971 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 11:53:07.788971 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 11:53:07.788971 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 08 11:53:07.788971 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 08 11:53:07.788971 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 382cde2c-22fc-44ea-bd80-ff8da487c560. Sep 08 11:53:07.788971 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:53:07.788971 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:53:07.788971 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:53:07.788971 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:53:07.788971 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:53:07.788971 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:53:07.788971 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:53:07.788971 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:53:07.788971 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:53:07.788971 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:53:07.788971 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 08 11:53:07.788971 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 08 11:53:07.788971 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7ea9d81-12b6-4fea-ae3c-a06034c59318 is not attached to volume 382cde2c-22fc-44ea-bd80-ff8da487c560 Sep 08 11:53:07.788971 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:53:07.788971 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:53:07.788971 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:53:07.788971 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:53:07.788971 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:53:07.788971 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:53:07.794849 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:53:07.794849 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:53:07.794849 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7ea9d81-12b6-4fea-ae3c-a06034c59318 is not attached to volume 382cde2c-22fc-44ea-bd80-ff8da487c560 Sep 08 11:53:07.794849 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:53:07.794849 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0db81adf-8ed0-41b4-9c50-c70d1db9b518 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Returning 404 to user: Instance f7ea9d81-12b6-4fea-ae3c-a06034c59318 is not attached to volume 382cde2c-22fc-44ea-bd80-ff8da487c560 {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:53:07.794849 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0db81adf-8ed0-41b4-9c50-c70d1db9b518 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318/os-volume_attachments/382cde2c-22fc-44ea-bd80-ff8da487c560" status: 404 len: 154 microversion: 2.1 time: 0.099094 Sep 08 11:53:07.794849 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3637/7408] 10.222.0.27 () {58 vars in 1416 bytes} [Thu Sep 8 11:53:07 2022] DELETE /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318/os-volume_attachments/382cde2c-22fc-44ea-bd80-ff8da487c560 => generated 154 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:53:11.054754 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9a25519d-28b3-4b0b-82a3-3e8719e80f76 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:53:11.056054 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9a25519d-28b3-4b0b-82a3-3e8719e80f76 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: f7ea9d81-12b6-4fea-ae3c-a06034c59318] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:53:11.063164 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9a25519d-28b3-4b0b-82a3-3e8719e80f76 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:53:11.063655 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9a25519d-28b3-4b0b-82a3-3e8719e80f76 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:53:11.064100 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9a25519d-28b3-4b0b-82a3-3e8719e80f76 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:53:11.064805 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9a25519d-28b3-4b0b-82a3-3e8719e80f76 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:53:11.065295 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9a25519d-28b3-4b0b-82a3-3e8719e80f76 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:53:11.065724 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9a25519d-28b3-4b0b-82a3-3e8719e80f76 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:53:11.092493 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9a25519d-28b3-4b0b-82a3-3e8719e80f76 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: f7ea9d81-12b6-4fea-ae3c-a06034c59318] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:53:11.175990 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9a25519d-28b3-4b0b-82a3-3e8719e80f76 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318" status: 204 len: 0 microversion: 2.1 time: 0.125010 Sep 08 11:53:11.176979 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3772/7409] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:53:11 2022] DELETE /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:53:11.187575 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2bb2af28-cf58-429d-bb2d-1a919264ea26 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:53:11.188286 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2bb2af28-cf58-429d-bb2d-1a919264ea26 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: f7ea9d81-12b6-4fea-ae3c-a06034c59318] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:53:11.195708 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2bb2af28-cf58-429d-bb2d-1a919264ea26 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:53:11.196761 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2bb2af28-cf58-429d-bb2d-1a919264ea26 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:53:11.197432 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2bb2af28-cf58-429d-bb2d-1a919264ea26 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:53:11.198162 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2bb2af28-cf58-429d-bb2d-1a919264ea26 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:53:11.198641 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2bb2af28-cf58-429d-bb2d-1a919264ea26 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:53:11.199091 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2bb2af28-cf58-429d-bb2d-1a919264ea26 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:53:11.361257 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2bb2af28-cf58-429d-bb2d-1a919264ea26 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b343d30c733d41b3a6b2f2648e7a3a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e4076abe344b879519de24063d992a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:53:11.370697 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2bb2af28-cf58-429d-bb2d-1a919264ea26 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318" status: 200 len: 1554 microversion: 2.1 time: 0.186999 Sep 08 11:53:11.371284 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3638/7410] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:53:11 2022] GET /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318 => generated 1554 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:53:12.394293 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-dd122877-7a92-462a-abcf-7d6439bbd5f8 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:53:12.395004 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-dd122877-7a92-462a-abcf-7d6439bbd5f8 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: f7ea9d81-12b6-4fea-ae3c-a06034c59318] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:53:12.403358 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd122877-7a92-462a-abcf-7d6439bbd5f8 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:53:12.403850 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd122877-7a92-462a-abcf-7d6439bbd5f8 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:53:12.404292 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd122877-7a92-462a-abcf-7d6439bbd5f8 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:53:12.405004 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd122877-7a92-462a-abcf-7d6439bbd5f8 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:53:12.405491 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd122877-7a92-462a-abcf-7d6439bbd5f8 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:53:12.405918 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd122877-7a92-462a-abcf-7d6439bbd5f8 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:53:12.543080 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-dd122877-7a92-462a-abcf-7d6439bbd5f8 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b343d30c733d41b3a6b2f2648e7a3a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e4076abe344b879519de24063d992a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:53:12.552555 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-dd122877-7a92-462a-abcf-7d6439bbd5f8 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318" status: 200 len: 1554 microversion: 2.1 time: 0.162509 Sep 08 11:53:12.553732 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3773/7411] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:53:12 2022] GET /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318 => generated 1554 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:53:13.579837 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3e4ecbbf-300e-448a-b763-787251699e61 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:53:13.581304 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3e4ecbbf-300e-448a-b763-787251699e61 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: f7ea9d81-12b6-4fea-ae3c-a06034c59318] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:53:13.589482 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3e4ecbbf-300e-448a-b763-787251699e61 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:53:13.589989 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3e4ecbbf-300e-448a-b763-787251699e61 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:53:13.590438 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3e4ecbbf-300e-448a-b763-787251699e61 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:53:13.591153 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3e4ecbbf-300e-448a-b763-787251699e61 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:53:13.591620 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3e4ecbbf-300e-448a-b763-787251699e61 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:53:13.592058 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3e4ecbbf-300e-448a-b763-787251699e61 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:53:13.608705 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-e2960a2f-ab5e-4034-8dcc-05d176123af9 req-4089218a-2fb0-4eeb-8145-68a7b3b34db1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7ea9d81-12b6-4fea-ae3c-a06034c59318", "name": "network-vif-deleted", "tag": "2b1b9029-1271-49ed-845c-3188c3880bce"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:53:13.620643 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e2960a2f-ab5e-4034-8dcc-05d176123af9 req-4089218a-2fb0-4eeb-8145-68a7b3b34db1 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:53:13.621357 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e2960a2f-ab5e-4034-8dcc-05d176123af9 req-4089218a-2fb0-4eeb-8145-68a7b3b34db1 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:53:13.621812 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e2960a2f-ab5e-4034-8dcc-05d176123af9 req-4089218a-2fb0-4eeb-8145-68a7b3b34db1 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:53:13.636783 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-e2960a2f-ab5e-4034-8dcc-05d176123af9 req-4089218a-2fb0-4eeb-8145-68a7b3b34db1 service nova] Creating event network-vif-deleted:2b1b9029-1271-49ed-845c-3188c3880bce for instance f7ea9d81-12b6-4fea-ae3c-a06034c59318 on n-h1-850501-12 Sep 08 11:53:13.643397 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-e2960a2f-ab5e-4034-8dcc-05d176123af9 req-4089218a-2fb0-4eeb-8145-68a7b3b34db1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100275 Sep 08 11:53:13.644024 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3639/7412] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:53:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:53:13.665699 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-3e4ecbbf-300e-448a-b763-787251699e61 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b343d30c733d41b3a6b2f2648e7a3a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e4076abe344b879519de24063d992a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:53:13.674181 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3e4ecbbf-300e-448a-b763-787251699e61 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318" status: 200 len: 1343 microversion: 2.1 time: 0.098250 Sep 08 11:53:13.674950 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3774/7413] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:53:13 2022] GET /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318 => generated 1343 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:53:14.698706 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-086b8733-aa8b-44e6-a79e-0609e37fb442 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:53:14.699432 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-086b8733-aa8b-44e6-a79e-0609e37fb442 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: f7ea9d81-12b6-4fea-ae3c-a06034c59318] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:53:14.707385 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-086b8733-aa8b-44e6-a79e-0609e37fb442 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:53:14.707823 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-086b8733-aa8b-44e6-a79e-0609e37fb442 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:53:14.708282 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-086b8733-aa8b-44e6-a79e-0609e37fb442 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:53:14.709002 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-086b8733-aa8b-44e6-a79e-0609e37fb442 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:53:14.709506 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-086b8733-aa8b-44e6-a79e-0609e37fb442 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:53:14.709972 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-086b8733-aa8b-44e6-a79e-0609e37fb442 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:53:14.724507 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-086b8733-aa8b-44e6-a79e-0609e37fb442 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] HTTP exception thrown: Instance f7ea9d81-12b6-4fea-ae3c-a06034c59318 could not be found. Sep 08 11:53:14.726177 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-086b8733-aa8b-44e6-a79e-0609e37fb442 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Request method failure captured: Sep 08 11:53:14.726177 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318 HTTP/1.1 Sep 08 11:53:14.726177 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 11:53:14.726177 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 11:53:14.726177 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 11:53:14.726177 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 11:53:14.726177 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 11:53:14.726177 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 11:53:14.726177 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 11:53:14.726177 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 11:53:14.726177 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGda6lt0OjQky38i1I7zhTNEPFh3M7HMD5N2Z6L8DcuJK8H27LSlRofjxr8N1ZePurD5L0_b2saB9rphWkmMqKZblvSLPEPBdKBfbjQ_RIeFv7nQIdh5-cXWLnDkBoJwO0lrVfpVc2Lh8vDtjoonozBib4-rCvZ3wwEJlVQ77AWI7LIM Sep 08 11:53:14.726177 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 11:53:14.726177 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 11:53:14.726177 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 11:53:14.726177 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 11:53:14.726177 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 11:53:14.726177 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 11:53:14.726177 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: b4e4076abe344b879519de24063d992a Sep 08 11:53:14.726177 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-TestMinimumBasicScenario-1082017553 Sep 08 11:53:14.726177 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 11:53:14.726177 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 11:53:14.726177 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b4e4076abe344b879519de24063d992a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b4e4076abe344b879519de24063d992a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b4e4076abe344b879519de24063d992a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b4e4076abe344b879519de24063d992a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:53:14.726177 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-TestMinimumBasicScenario-1082017553 Sep 08 11:53:14.726177 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: b4e4076abe344b879519de24063d992a Sep 08 11:53:14.726177 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1082017553 Sep 08 11:53:14.726177 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-TestMinimumBasicScenario-1082017553-project Sep 08 11:53:14.726177 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 11:53:14.726177 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 11:53:14.726177 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: b343d30c733d41b3a6b2f2648e7a3a09 Sep 08 11:53:14.726177 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-TestMinimumBasicScenario-1082017553-project Sep 08 11:53:14.726177 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 11:53:14.726177 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance f7ea9d81-12b6-4fea-ae3c-a06034c59318 could not be found. Sep 08 11:53:14.726177 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'f7ea9d81-12b6-4fea-ae3c-a06034c59318'} Sep 08 11:53:14.726177 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:53:14.726177 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:53:14.726177 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:53:14.726177 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:53:14.726177 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:53:14.726177 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:53:14.726177 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:53:14.726177 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:53:14.726177 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:53:14.726177 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:53:14.726177 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7ea9d81-12b6-4fea-ae3c-a06034c59318 could not be found. Sep 08 11:53:14.726177 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:53:14.726177 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:53:14.726177 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:53:14.726177 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:53:14.726177 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:53:14.726177 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:53:14.726177 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:53:14.726177 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:53:14.726177 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:53:14.726177 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:53:14.726177 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:53:14.726177 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:53:14.726177 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:53:14.726177 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:53:14.726177 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:53:14.726177 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:53:14.726177 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7ea9d81-12b6-4fea-ae3c-a06034c59318 could not be found. Sep 08 11:53:14.726177 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:53:14.726177 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:53:14.726177 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:53:14.732097 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:53:14.732097 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:53:14.732097 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:53:14.732097 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:53:14.732097 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:53:14.732097 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7ea9d81-12b6-4fea-ae3c-a06034c59318 could not be found. Sep 08 11:53:14.732097 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:53:14.732097 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-086b8733-aa8b-44e6-a79e-0609e37fb442 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Returning 404 to user: Instance f7ea9d81-12b6-4fea-ae3c-a06034c59318 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:53:14.732097 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-086b8733-aa8b-44e6-a79e-0609e37fb442 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318" status: 404 len: 111 microversion: 2.1 time: 0.034323 Sep 08 11:53:14.732097 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3640/7414] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:53:14 2022] GET /compute/v2.1/servers/f7ea9d81-12b6-4fea-ae3c-a06034c59318 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 11:53:14.737779 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f0275476-d2e2-458b-8fd6-6da7c418c726 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '.version_select at 0x7f68df4e4a60>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:53:14.758415 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f0275476-d2e2-458b-8fd6-6da7c418c726 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-420690434" status: 202 len: 0 microversion: 2.1 time: 0.024708 Sep 08 11:53:14.759600 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3775/7415] 10.222.0.27 () {58 vars in 1269 bytes} [Thu Sep 8 11:53:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-420690434 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:53:23.966512 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-973710fe-e3f3-46da-b060-62eae85f2697 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Action: 'create', calling method: .version_select at 0x7f68e4143430>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2131463749", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDsB2Ore/I0XEYxndRR06AoWKgOgOp3cRQeg0RFEPdwMKcZU6xPTJe/UMe/6YgqTCbCSp+Nr79j7U+f/n9EG+x9WgX6OtP5FFlCzk4cb7zRyqZmyTvd0hbj26ubTNbYWtg=="}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:53:23.983457 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-973710fe-e3f3-46da-b060-62eae85f2697 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Getting quotas for project b4e4076abe344b879519de24063d992a. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:53:23.989775 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-973710fe-e3f3-46da-b060-62eae85f2697 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Getting quotas for user b343d30c733d41b3a6b2f2648e7a3a09 and project b4e4076abe344b879519de24063d992a. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:53:24.017468 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-973710fe-e3f3-46da-b060-62eae85f2697 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.054898 Sep 08 11:53:24.018070 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3641/7416] 10.222.0.27 () {60 vars in 1159 bytes} [Thu Sep 8 11:53:23 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:53:24.071469 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:53:24.075739 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-82a88ab9-fff8-44bf-80e3-388b67c0aa1f tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-527674581", "imageRef": "c60c63c1-1a63-4948-b0ef-88198e4f9986", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2131463749", "networks": [{"uuid": "8965aaec-00c4-4191-bc41-899115ac6261"}]}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:53:24.128696 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-82a88ab9-fff8-44bf-80e3-388b67c0aa1f tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] validate_networks() for [('8965aaec-00c4-4191-bc41-899115ac6261', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:53:24.552608 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-82a88ab9-fff8-44bf-80e3-388b67c0aa1f tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:53:24.553080 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-82a88ab9-fff8-44bf-80e3-388b67c0aa1f tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:53:24.553568 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-82a88ab9-fff8-44bf-80e3-388b67c0aa1f tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:53:24.553982 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-82a88ab9-fff8-44bf-80e3-388b67c0aa1f tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:53:24.554416 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-82a88ab9-fff8-44bf-80e3-388b67c0aa1f tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:53:24.563813 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-82a88ab9-fff8-44bf-80e3-388b67c0aa1f tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:53:24.564294 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-82a88ab9-fff8-44bf-80e3-388b67c0aa1f tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:53:24.564757 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-82a88ab9-fff8-44bf-80e3-388b67c0aa1f tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:53:24.565577 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-82a88ab9-fff8-44bf-80e3-388b67c0aa1f tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:53:24.566033 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-82a88ab9-fff8-44bf-80e3-388b67c0aa1f tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:53:24.566444 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-82a88ab9-fff8-44bf-80e3-388b67c0aa1f tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:53:24.585319 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-82a88ab9-fff8-44bf-80e3-388b67c0aa1f tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Getting quotas for project b4e4076abe344b879519de24063d992a. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:53:24.591289 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-82a88ab9-fff8-44bf-80e3-388b67c0aa1f tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Getting quotas for user b343d30c733d41b3a6b2f2648e7a3a09 and project b4e4076abe344b879519de24063d992a. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:53:24.603486 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-82a88ab9-fff8-44bf-80e3-388b67c0aa1f tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:53:24.605763 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-82a88ab9-fff8-44bf-80e3-388b67c0aa1f tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: e60da7f9-2db5-4c85-b831-2257da186047] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c60c63c1-1a63-4948-b0ef-88198e4f9986',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:53:24.652820 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-82a88ab9-fff8-44bf-80e3-388b67c0aa1f tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.583450 Sep 08 11:53:24.653513 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3776/7417] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 11:53:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:53:24.664638 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f8536bd8-23e3-4536-b97d-550f90b83fdc tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:53:24.665378 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f8536bd8-23e3-4536-b97d-550f90b83fdc tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: e60da7f9-2db5-4c85-b831-2257da186047] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:53:24.716074 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:53:24.719922 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f8536bd8-23e3-4536-b97d-550f90b83fdc tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b343d30c733d41b3a6b2f2648e7a3a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e4076abe344b879519de24063d992a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:53:24.727952 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f8536bd8-23e3-4536-b97d-550f90b83fdc tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047" status: 200 len: 1258 microversion: 2.1 time: 0.067279 Sep 08 11:53:24.728524 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3642/7418] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:53:24 2022] GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047 => generated 1258 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:53:25.751919 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9ff3ce96-162f-4e72-8440-2de44a10dab7 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:53:25.752540 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9ff3ce96-162f-4e72-8440-2de44a10dab7 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: e60da7f9-2db5-4c85-b831-2257da186047] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:53:25.807365 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9ff3ce96-162f-4e72-8440-2de44a10dab7 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b343d30c733d41b3a6b2f2648e7a3a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e4076abe344b879519de24063d992a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:53:25.814436 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9ff3ce96-162f-4e72-8440-2de44a10dab7 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047" status: 200 len: 1258 microversion: 2.1 time: 0.067435 Sep 08 11:53:25.815141 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3777/7419] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:53:25 2022] GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047 => generated 1258 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:53:26.837799 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d2304218-8b1f-4c5a-a77b-87ba8e9e3b0c tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:53:26.838440 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d2304218-8b1f-4c5a-a77b-87ba8e9e3b0c tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: e60da7f9-2db5-4c85-b831-2257da186047] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:53:26.899387 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d2304218-8b1f-4c5a-a77b-87ba8e9e3b0c tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b343d30c733d41b3a6b2f2648e7a3a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e4076abe344b879519de24063d992a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:53:26.906835 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d2304218-8b1f-4c5a-a77b-87ba8e9e3b0c tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047" status: 200 len: 1258 microversion: 2.1 time: 0.073293 Sep 08 11:53:26.907572 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3643/7420] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:53:26 2022] GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047 => generated 1258 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:53:27.931510 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-687b0747-068a-42f3-a7ab-5ea3704f11f6 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:53:27.932125 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-687b0747-068a-42f3-a7ab-5ea3704f11f6 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: e60da7f9-2db5-4c85-b831-2257da186047] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:53:27.985469 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-687b0747-068a-42f3-a7ab-5ea3704f11f6 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b343d30c733d41b3a6b2f2648e7a3a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e4076abe344b879519de24063d992a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:53:27.996830 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-687b0747-068a-42f3-a7ab-5ea3704f11f6 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047" status: 200 len: 1258 microversion: 2.1 time: 0.069916 Sep 08 11:53:27.997630 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3778/7421] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:53:27 2022] GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047 => generated 1258 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:53:29.020726 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-416103c5-99d4-48b2-b5ce-09548bc05293 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:53:29.021382 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-416103c5-99d4-48b2-b5ce-09548bc05293 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: e60da7f9-2db5-4c85-b831-2257da186047] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:53:29.028850 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-416103c5-99d4-48b2-b5ce-09548bc05293 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:53:29.029383 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-416103c5-99d4-48b2-b5ce-09548bc05293 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:53:29.029840 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-416103c5-99d4-48b2-b5ce-09548bc05293 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:53:29.030542 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-416103c5-99d4-48b2-b5ce-09548bc05293 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:53:29.031009 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-416103c5-99d4-48b2-b5ce-09548bc05293 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:53:29.031446 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-416103c5-99d4-48b2-b5ce-09548bc05293 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:53:29.092644 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-416103c5-99d4-48b2-b5ce-09548bc05293 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b343d30c733d41b3a6b2f2648e7a3a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e4076abe344b879519de24063d992a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:53:29.100459 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-416103c5-99d4-48b2-b5ce-09548bc05293 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047" status: 200 len: 1262 microversion: 2.1 time: 0.083808 Sep 08 11:53:29.101051 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3644/7422] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:53:29 2022] GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047 => generated 1262 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:53:30.124582 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-057cfd7c-79b8-44b9-87a3-e85c37402025 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:53:30.125410 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-057cfd7c-79b8-44b9-87a3-e85c37402025 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: e60da7f9-2db5-4c85-b831-2257da186047] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:53:30.139927 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-057cfd7c-79b8-44b9-87a3-e85c37402025 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:53:30.150742 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-057cfd7c-79b8-44b9-87a3-e85c37402025 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:53:30.151626 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-057cfd7c-79b8-44b9-87a3-e85c37402025 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:53:30.152859 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-057cfd7c-79b8-44b9-87a3-e85c37402025 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:53:30.153744 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-057cfd7c-79b8-44b9-87a3-e85c37402025 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:53:30.154481 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-057cfd7c-79b8-44b9-87a3-e85c37402025 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:53:30.253600 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-057cfd7c-79b8-44b9-87a3-e85c37402025 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b343d30c733d41b3a6b2f2648e7a3a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e4076abe344b879519de24063d992a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:53:30.264136 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-057cfd7c-79b8-44b9-87a3-e85c37402025 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047" status: 200 len: 1316 microversion: 2.1 time: 0.144113 Sep 08 11:53:30.265003 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3779/7423] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:53:30 2022] GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047 => generated 1316 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:53:31.291478 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-639e5739-eae5-4371-a556-07bca303ce99 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:53:31.292865 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-639e5739-eae5-4371-a556-07bca303ce99 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: e60da7f9-2db5-4c85-b831-2257da186047] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:53:31.299528 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:53:31.301774 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-639e5739-eae5-4371-a556-07bca303ce99 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:53:31.302737 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-639e5739-eae5-4371-a556-07bca303ce99 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:53:31.303459 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-639e5739-eae5-4371-a556-07bca303ce99 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:53:31.304437 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-639e5739-eae5-4371-a556-07bca303ce99 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:53:31.305903 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-639e5739-eae5-4371-a556-07bca303ce99 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:53:31.306593 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-639e5739-eae5-4371-a556-07bca303ce99 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:53:31.491071 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-639e5739-eae5-4371-a556-07bca303ce99 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b343d30c733d41b3a6b2f2648e7a3a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e4076abe344b879519de24063d992a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:53:31.499923 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-639e5739-eae5-4371-a556-07bca303ce99 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047" status: 200 len: 1358 microversion: 2.1 time: 0.214773 Sep 08 11:53:31.501078 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3645/7424] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:53:31 2022] GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047 => generated 1358 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:53:32.523806 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8751a235-a97b-4b16-92d3-6763e026b555 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:53:32.524451 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8751a235-a97b-4b16-92d3-6763e026b555 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: e60da7f9-2db5-4c85-b831-2257da186047] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:53:32.527226 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:53:32.532592 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8751a235-a97b-4b16-92d3-6763e026b555 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:53:32.533146 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8751a235-a97b-4b16-92d3-6763e026b555 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:53:32.533585 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8751a235-a97b-4b16-92d3-6763e026b555 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:53:32.534287 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8751a235-a97b-4b16-92d3-6763e026b555 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:53:32.534751 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8751a235-a97b-4b16-92d3-6763e026b555 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:53:32.535186 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8751a235-a97b-4b16-92d3-6763e026b555 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:53:32.690921 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8751a235-a97b-4b16-92d3-6763e026b555 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b343d30c733d41b3a6b2f2648e7a3a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e4076abe344b879519de24063d992a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:53:32.700140 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8751a235-a97b-4b16-92d3-6763e026b555 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047" status: 200 len: 1358 microversion: 2.1 time: 0.180394 Sep 08 11:53:32.700741 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3780/7425] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:53:32 2022] GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047 => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:53:33.725983 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0513a8ca-be41-4f65-8097-bfee2a9d2215 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:53:33.727844 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0513a8ca-be41-4f65-8097-bfee2a9d2215 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: e60da7f9-2db5-4c85-b831-2257da186047] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:53:33.739903 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0513a8ca-be41-4f65-8097-bfee2a9d2215 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:53:33.740623 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0513a8ca-be41-4f65-8097-bfee2a9d2215 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:53:33.751556 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0513a8ca-be41-4f65-8097-bfee2a9d2215 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:53:33.752827 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0513a8ca-be41-4f65-8097-bfee2a9d2215 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:53:33.753733 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0513a8ca-be41-4f65-8097-bfee2a9d2215 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:53:33.754354 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0513a8ca-be41-4f65-8097-bfee2a9d2215 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:53:33.931715 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0513a8ca-be41-4f65-8097-bfee2a9d2215 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b343d30c733d41b3a6b2f2648e7a3a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e4076abe344b879519de24063d992a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:53:33.945345 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0513a8ca-be41-4f65-8097-bfee2a9d2215 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047" status: 200 len: 1358 microversion: 2.1 time: 0.223132 Sep 08 11:53:33.946024 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3646/7426] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:53:33 2022] GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047 => generated 1358 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:53:34.973514 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-41df7608-ac34-4881-ba7b-42ca72de67d1 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:53:34.974157 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-41df7608-ac34-4881-ba7b-42ca72de67d1 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: e60da7f9-2db5-4c85-b831-2257da186047] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:53:34.977488 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:53:34.983593 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41df7608-ac34-4881-ba7b-42ca72de67d1 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:53:34.984328 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41df7608-ac34-4881-ba7b-42ca72de67d1 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:53:34.984957 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41df7608-ac34-4881-ba7b-42ca72de67d1 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:53:34.985704 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41df7608-ac34-4881-ba7b-42ca72de67d1 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:53:34.986161 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41df7608-ac34-4881-ba7b-42ca72de67d1 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:53:34.986777 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41df7608-ac34-4881-ba7b-42ca72de67d1 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:53:35.122594 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-41df7608-ac34-4881-ba7b-42ca72de67d1 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b343d30c733d41b3a6b2f2648e7a3a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e4076abe344b879519de24063d992a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:53:35.130476 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-41df7608-ac34-4881-ba7b-42ca72de67d1 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047" status: 200 len: 1358 microversion: 2.1 time: 0.161744 Sep 08 11:53:35.131067 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3781/7427] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:53:34 2022] GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:53:36.154920 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-68e4f1fb-815f-4c54-b5ff-cf89774a35f3 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:53:36.155496 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-68e4f1fb-815f-4c54-b5ff-cf89774a35f3 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: e60da7f9-2db5-4c85-b831-2257da186047] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:53:36.162665 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68e4f1fb-815f-4c54-b5ff-cf89774a35f3 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:53:36.163217 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68e4f1fb-815f-4c54-b5ff-cf89774a35f3 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:53:36.163681 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68e4f1fb-815f-4c54-b5ff-cf89774a35f3 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:53:36.165050 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68e4f1fb-815f-4c54-b5ff-cf89774a35f3 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:53:36.165850 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68e4f1fb-815f-4c54-b5ff-cf89774a35f3 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:53:36.166323 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68e4f1fb-815f-4c54-b5ff-cf89774a35f3 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:53:36.300994 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-68e4f1fb-815f-4c54-b5ff-cf89774a35f3 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b343d30c733d41b3a6b2f2648e7a3a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e4076abe344b879519de24063d992a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:53:36.309442 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-68e4f1fb-815f-4c54-b5ff-cf89774a35f3 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047" status: 200 len: 1358 microversion: 2.1 time: 0.158570 Sep 08 11:53:36.310058 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3647/7428] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:53:36 2022] GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:53:37.331383 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2233f955-7027-41ac-907a-37d1cfb23063 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:53:37.332108 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2233f955-7027-41ac-907a-37d1cfb23063 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: e60da7f9-2db5-4c85-b831-2257da186047] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:53:37.339733 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2233f955-7027-41ac-907a-37d1cfb23063 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:53:37.340236 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2233f955-7027-41ac-907a-37d1cfb23063 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:53:37.340685 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2233f955-7027-41ac-907a-37d1cfb23063 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:53:37.341421 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2233f955-7027-41ac-907a-37d1cfb23063 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:53:37.341890 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2233f955-7027-41ac-907a-37d1cfb23063 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:53:37.342326 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2233f955-7027-41ac-907a-37d1cfb23063 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:53:37.493006 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2233f955-7027-41ac-907a-37d1cfb23063 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b343d30c733d41b3a6b2f2648e7a3a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e4076abe344b879519de24063d992a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:53:37.502793 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2233f955-7027-41ac-907a-37d1cfb23063 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047" status: 200 len: 1358 microversion: 2.1 time: 0.175277 Sep 08 11:53:37.503598 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3782/7429] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:53:37 2022] GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:53:38.527183 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-93d04131-9452-4a9e-8b0c-b6108ee61bc9 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:53:38.528436 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-93d04131-9452-4a9e-8b0c-b6108ee61bc9 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: e60da7f9-2db5-4c85-b831-2257da186047] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:53:38.534928 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=8 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:53:38.538455 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-93d04131-9452-4a9e-8b0c-b6108ee61bc9 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:53:38.539082 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-93d04131-9452-4a9e-8b0c-b6108ee61bc9 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:53:38.540120 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-93d04131-9452-4a9e-8b0c-b6108ee61bc9 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:53:38.541116 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-93d04131-9452-4a9e-8b0c-b6108ee61bc9 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:53:38.541682 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-93d04131-9452-4a9e-8b0c-b6108ee61bc9 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:53:38.542187 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-93d04131-9452-4a9e-8b0c-b6108ee61bc9 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:53:38.682321 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-93d04131-9452-4a9e-8b0c-b6108ee61bc9 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b343d30c733d41b3a6b2f2648e7a3a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e4076abe344b879519de24063d992a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:53:38.690279 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-93d04131-9452-4a9e-8b0c-b6108ee61bc9 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047" status: 200 len: 1358 microversion: 2.1 time: 0.167764 Sep 08 11:53:38.690871 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3648/7430] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:53:38 2022] GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:53:39.715540 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9b626b60-34d2-4d5a-bc22-a4c9ceb4655b tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:53:39.716167 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9b626b60-34d2-4d5a-bc22-a4c9ceb4655b tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: e60da7f9-2db5-4c85-b831-2257da186047] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:53:39.719315 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=10 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:53:39.728080 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9b626b60-34d2-4d5a-bc22-a4c9ceb4655b tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:53:39.728576 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9b626b60-34d2-4d5a-bc22-a4c9ceb4655b tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:53:39.729211 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9b626b60-34d2-4d5a-bc22-a4c9ceb4655b tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:53:39.729950 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9b626b60-34d2-4d5a-bc22-a4c9ceb4655b tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:53:39.730665 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9b626b60-34d2-4d5a-bc22-a4c9ceb4655b tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:53:39.731048 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9b626b60-34d2-4d5a-bc22-a4c9ceb4655b tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:53:39.886518 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9b626b60-34d2-4d5a-bc22-a4c9ceb4655b tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b343d30c733d41b3a6b2f2648e7a3a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e4076abe344b879519de24063d992a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:53:39.900984 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9b626b60-34d2-4d5a-bc22-a4c9ceb4655b tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047" status: 200 len: 1358 microversion: 2.1 time: 0.189929 Sep 08 11:53:39.902266 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3783/7431] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:53:39 2022] GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047 => generated 1358 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:53:40.932292 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-154e7033-63fa-4496-b44b-5fda07064e9e tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:53:40.933162 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-154e7033-63fa-4496-b44b-5fda07064e9e tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: e60da7f9-2db5-4c85-b831-2257da186047] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:53:40.940463 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-154e7033-63fa-4496-b44b-5fda07064e9e tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:53:40.940979 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-154e7033-63fa-4496-b44b-5fda07064e9e tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:53:40.941464 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-154e7033-63fa-4496-b44b-5fda07064e9e tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:53:40.942447 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-154e7033-63fa-4496-b44b-5fda07064e9e tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:53:40.942940 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-154e7033-63fa-4496-b44b-5fda07064e9e tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:53:40.943413 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-154e7033-63fa-4496-b44b-5fda07064e9e tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:53:41.084600 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-154e7033-63fa-4496-b44b-5fda07064e9e tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b343d30c733d41b3a6b2f2648e7a3a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e4076abe344b879519de24063d992a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:53:41.093471 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-154e7033-63fa-4496-b44b-5fda07064e9e tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047" status: 200 len: 1358 microversion: 2.1 time: 0.165787 Sep 08 11:53:41.094061 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3649/7432] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:53:40 2022] GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:53:41.476584 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-e66b0bf3-d122-480b-98f0-bf38824181ce req-4d46f290-182f-412e-8fb1-5ea8dd0f3421 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e60da7f9-2db5-4c85-b831-2257da186047", "tag": "f5b6f1ec-8a06-4fd1-b80f-3139c92cceb2"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:53:41.497075 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-e66b0bf3-d122-480b-98f0-bf38824181ce req-4d46f290-182f-412e-8fb1-5ea8dd0f3421 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:53:41.497567 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-e66b0bf3-d122-480b-98f0-bf38824181ce req-4d46f290-182f-412e-8fb1-5ea8dd0f3421 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:53:41.498005 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-e66b0bf3-d122-480b-98f0-bf38824181ce req-4d46f290-182f-412e-8fb1-5ea8dd0f3421 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:53:41.510019 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-e66b0bf3-d122-480b-98f0-bf38824181ce req-4d46f290-182f-412e-8fb1-5ea8dd0f3421 service nova] Creating event network-changed:f5b6f1ec-8a06-4fd1-b80f-3139c92cceb2 for instance e60da7f9-2db5-4c85-b831-2257da186047 on n-h1-850501-12 Sep 08 11:53:41.515647 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-e66b0bf3-d122-480b-98f0-bf38824181ce req-4d46f290-182f-412e-8fb1-5ea8dd0f3421 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043594 Sep 08 11:53:41.516588 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3784/7433] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:53:42.117803 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fe90f51d-8b86-4a62-969f-811a667d3f92 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:53:42.118525 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fe90f51d-8b86-4a62-969f-811a667d3f92 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: e60da7f9-2db5-4c85-b831-2257da186047] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:53:42.125566 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fe90f51d-8b86-4a62-969f-811a667d3f92 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:53:42.126077 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fe90f51d-8b86-4a62-969f-811a667d3f92 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:53:42.126525 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fe90f51d-8b86-4a62-969f-811a667d3f92 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:53:42.127241 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fe90f51d-8b86-4a62-969f-811a667d3f92 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:53:42.127707 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fe90f51d-8b86-4a62-969f-811a667d3f92 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:53:42.128183 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fe90f51d-8b86-4a62-969f-811a667d3f92 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:53:42.267334 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fe90f51d-8b86-4a62-969f-811a667d3f92 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b343d30c733d41b3a6b2f2648e7a3a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e4076abe344b879519de24063d992a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:53:42.276406 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fe90f51d-8b86-4a62-969f-811a667d3f92 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047" status: 200 len: 1358 microversion: 2.1 time: 0.163033 Sep 08 11:53:42.277003 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3650/7434] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:53:42 2022] GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:53:43.300710 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-22e8e4aa-a010-4179-bda7-a1a8a27e20b2 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:53:43.301461 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-22e8e4aa-a010-4179-bda7-a1a8a27e20b2 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: e60da7f9-2db5-4c85-b831-2257da186047] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:53:43.310024 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-22e8e4aa-a010-4179-bda7-a1a8a27e20b2 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:53:43.310737 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-22e8e4aa-a010-4179-bda7-a1a8a27e20b2 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:53:43.311250 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-22e8e4aa-a010-4179-bda7-a1a8a27e20b2 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:53:43.312093 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-22e8e4aa-a010-4179-bda7-a1a8a27e20b2 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:53:43.312770 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-22e8e4aa-a010-4179-bda7-a1a8a27e20b2 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:53:43.313299 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-22e8e4aa-a010-4179-bda7-a1a8a27e20b2 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:53:43.451664 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-22e8e4aa-a010-4179-bda7-a1a8a27e20b2 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b343d30c733d41b3a6b2f2648e7a3a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e4076abe344b879519de24063d992a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:53:43.459646 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-22e8e4aa-a010-4179-bda7-a1a8a27e20b2 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047" status: 200 len: 1358 microversion: 2.1 time: 0.163465 Sep 08 11:53:43.460252 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3785/7435] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:53:43 2022] GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:53:44.484327 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6b54565a-40d8-4e52-8e6d-f683eb5de671 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:53:44.485499 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6b54565a-40d8-4e52-8e6d-f683eb5de671 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: e60da7f9-2db5-4c85-b831-2257da186047] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:53:44.495287 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b54565a-40d8-4e52-8e6d-f683eb5de671 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:53:44.495795 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b54565a-40d8-4e52-8e6d-f683eb5de671 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:53:44.496262 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b54565a-40d8-4e52-8e6d-f683eb5de671 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:53:44.497299 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b54565a-40d8-4e52-8e6d-f683eb5de671 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:53:44.497778 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b54565a-40d8-4e52-8e6d-f683eb5de671 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:53:44.498275 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b54565a-40d8-4e52-8e6d-f683eb5de671 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:53:44.647359 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6b54565a-40d8-4e52-8e6d-f683eb5de671 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b343d30c733d41b3a6b2f2648e7a3a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e4076abe344b879519de24063d992a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:53:44.655533 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6b54565a-40d8-4e52-8e6d-f683eb5de671 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047" status: 200 len: 1358 microversion: 2.1 time: 0.175548 Sep 08 11:53:44.656099 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3651/7436] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:53:44 2022] GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:53:45.101565 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-97d72511-5bfe-4d1e-b0db-47ce0235a396 req-d43699cb-baec-432c-a134-1407f1313408 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e60da7f9-2db5-4c85-b831-2257da186047", "name": "network-vif-plugged", "status": "completed", "tag": "f5b6f1ec-8a06-4fd1-b80f-3139c92cceb2"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:53:45.111186 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-97d72511-5bfe-4d1e-b0db-47ce0235a396 req-d43699cb-baec-432c-a134-1407f1313408 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:53:45.111657 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-97d72511-5bfe-4d1e-b0db-47ce0235a396 req-d43699cb-baec-432c-a134-1407f1313408 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:53:45.112089 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-97d72511-5bfe-4d1e-b0db-47ce0235a396 req-d43699cb-baec-432c-a134-1407f1313408 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:53:45.124482 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-97d72511-5bfe-4d1e-b0db-47ce0235a396 req-d43699cb-baec-432c-a134-1407f1313408 service nova] Creating event network-vif-plugged:f5b6f1ec-8a06-4fd1-b80f-3139c92cceb2 for instance e60da7f9-2db5-4c85-b831-2257da186047 on n-h1-850501-12 Sep 08 11:53:45.129601 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-97d72511-5bfe-4d1e-b0db-47ce0235a396 req-d43699cb-baec-432c-a134-1407f1313408 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095669 Sep 08 11:53:45.130546 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3786/7437] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:53:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:53:45.679026 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-53c1d03a-a249-4651-b768-e5ed3331d9c3 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:53:45.679673 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-53c1d03a-a249-4651-b768-e5ed3331d9c3 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: e60da7f9-2db5-4c85-b831-2257da186047] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:53:45.687629 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53c1d03a-a249-4651-b768-e5ed3331d9c3 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:53:45.688391 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53c1d03a-a249-4651-b768-e5ed3331d9c3 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:53:45.688504 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53c1d03a-a249-4651-b768-e5ed3331d9c3 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:53:45.689230 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53c1d03a-a249-4651-b768-e5ed3331d9c3 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:53:45.689708 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53c1d03a-a249-4651-b768-e5ed3331d9c3 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:53:45.690146 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53c1d03a-a249-4651-b768-e5ed3331d9c3 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:53:45.827883 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-53c1d03a-a249-4651-b768-e5ed3331d9c3 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b343d30c733d41b3a6b2f2648e7a3a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e4076abe344b879519de24063d992a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:53:45.837698 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-53c1d03a-a249-4651-b768-e5ed3331d9c3 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047" status: 200 len: 1358 microversion: 2.1 time: 0.162622 Sep 08 11:53:45.838291 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3652/7438] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:53:45 2022] GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:53:46.862825 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e1a25ffd-d248-436a-b08d-36a47e4f25dc tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:53:46.863437 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e1a25ffd-d248-436a-b08d-36a47e4f25dc tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: e60da7f9-2db5-4c85-b831-2257da186047] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:53:46.870792 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e1a25ffd-d248-436a-b08d-36a47e4f25dc tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:53:46.871278 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e1a25ffd-d248-436a-b08d-36a47e4f25dc tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:53:46.871737 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e1a25ffd-d248-436a-b08d-36a47e4f25dc tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:53:46.872408 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e1a25ffd-d248-436a-b08d-36a47e4f25dc tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:53:46.872865 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e1a25ffd-d248-436a-b08d-36a47e4f25dc tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:53:46.873317 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e1a25ffd-d248-436a-b08d-36a47e4f25dc tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:53:47.010739 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e1a25ffd-d248-436a-b08d-36a47e4f25dc tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b343d30c733d41b3a6b2f2648e7a3a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e4076abe344b879519de24063d992a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:53:47.018619 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e1a25ffd-d248-436a-b08d-36a47e4f25dc tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047" status: 200 len: 1548 microversion: 2.1 time: 0.161045 Sep 08 11:53:47.019199 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3787/7439] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:53:46 2022] GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047 => generated 1548 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:53:47.041443 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8eae6ea6-1a69-4d89-93c5-84315c695708 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:53:47.042104 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8eae6ea6-1a69-4d89-93c5-84315c695708 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: e60da7f9-2db5-4c85-b831-2257da186047] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:53:47.048986 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8eae6ea6-1a69-4d89-93c5-84315c695708 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:53:47.049622 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8eae6ea6-1a69-4d89-93c5-84315c695708 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:53:47.050074 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8eae6ea6-1a69-4d89-93c5-84315c695708 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:53:47.050780 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8eae6ea6-1a69-4d89-93c5-84315c695708 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:53:47.051247 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8eae6ea6-1a69-4d89-93c5-84315c695708 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:53:47.051683 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8eae6ea6-1a69-4d89-93c5-84315c695708 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:53:47.187758 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8eae6ea6-1a69-4d89-93c5-84315c695708 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b343d30c733d41b3a6b2f2648e7a3a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e4076abe344b879519de24063d992a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:53:47.195592 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8eae6ea6-1a69-4d89-93c5-84315c695708 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047" status: 200 len: 1548 microversion: 2.1 time: 0.158695 Sep 08 11:53:47.196183 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3653/7440] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:53:47 2022] GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047 => generated 1548 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:53:47.216930 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-54344e44-32f2-42cf-be21-ccfc16d2af6e tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:53:47.221752 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-54344e44-32f2-42cf-be21-ccfc16d2af6e tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b343d30c733d41b3a6b2f2648e7a3a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e4076abe344b879519de24063d992a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:53:47.222516 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-54344e44-32f2-42cf-be21-ccfc16d2af6e tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Searching by: {'deleted': False, 'project_id': 'b4e4076abe344b879519de24063d992a'} {{(pid=128861) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 11:53:47.228498 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-54344e44-32f2-42cf-be21-ccfc16d2af6e tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:53:47.228985 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-54344e44-32f2-42cf-be21-ccfc16d2af6e tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:53:47.229445 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-54344e44-32f2-42cf-be21-ccfc16d2af6e tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:53:47.230168 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-54344e44-32f2-42cf-be21-ccfc16d2af6e tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:53:47.230623 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-54344e44-32f2-42cf-be21-ccfc16d2af6e tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:53:47.231046 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-54344e44-32f2-42cf-be21-ccfc16d2af6e tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:53:47.255928 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.multi_cell_list [None req-54344e44-32f2-42cf-be21-ccfc16d2af6e tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128861) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 11:53:47.283377 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-54344e44-32f2-42cf-be21-ccfc16d2af6e tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.070250 Sep 08 11:53:47.283958 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3788/7441] 10.222.0.27 () {58 vars in 1125 bytes} [Thu Sep 8 11:53:47 2022] GET /compute/v2.1/servers => generated 342 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:53:47.296535 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c5331e75-6cb8-4778-9811-38db16558b83 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:53:47.297209 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c5331e75-6cb8-4778-9811-38db16558b83 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: e60da7f9-2db5-4c85-b831-2257da186047] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:53:47.303265 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5331e75-6cb8-4778-9811-38db16558b83 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:53:47.303801 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5331e75-6cb8-4778-9811-38db16558b83 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:53:47.304267 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5331e75-6cb8-4778-9811-38db16558b83 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:53:47.304994 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5331e75-6cb8-4778-9811-38db16558b83 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:53:47.305824 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5331e75-6cb8-4778-9811-38db16558b83 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:53:47.306336 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5331e75-6cb8-4778-9811-38db16558b83 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:53:47.438112 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c5331e75-6cb8-4778-9811-38db16558b83 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b343d30c733d41b3a6b2f2648e7a3a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e4076abe344b879519de24063d992a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:53:47.446172 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c5331e75-6cb8-4778-9811-38db16558b83 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047" status: 200 len: 1548 microversion: 2.1 time: 0.153361 Sep 08 11:53:47.447017 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3654/7442] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:53:47 2022] GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047 => generated 1548 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:53:49.158199 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d995d86c-df4e-4d58-adb2-cd3d8dc440fb tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "276b06c3-be98-4cbe-9150-5710bc2b0d81"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:53:49.160621 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d995d86c-df4e-4d58-adb2-cd3d8dc440fb tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: e60da7f9-2db5-4c85-b831-2257da186047] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:53:49.169614 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d995d86c-df4e-4d58-adb2-cd3d8dc440fb tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:53:49.170113 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d995d86c-df4e-4d58-adb2-cd3d8dc440fb tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:53:49.170561 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d995d86c-df4e-4d58-adb2-cd3d8dc440fb tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:53:49.171269 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d995d86c-df4e-4d58-adb2-cd3d8dc440fb tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:53:49.171738 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d995d86c-df4e-4d58-adb2-cd3d8dc440fb tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:53:49.172173 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d995d86c-df4e-4d58-adb2-cd3d8dc440fb tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:53:49.414399 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d995d86c-df4e-4d58-adb2-cd3d8dc440fb tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "POST /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.260005 Sep 08 11:53:49.415196 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3789/7443] 10.222.0.27 () {60 vars in 1323 bytes} [Thu Sep 8 11:53:49 2022] POST /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047/os-volume_attachments => generated 194 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:54:00.208863 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d65dd2f3-37a0-44b2-89a0-06366887f690 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:54:00.209534 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d65dd2f3-37a0-44b2-89a0-06366887f690 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: e60da7f9-2db5-4c85-b831-2257da186047] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:54:00.212501 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=19 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:54:00.213207 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=66 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:54:00.219389 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d65dd2f3-37a0-44b2-89a0-06366887f690 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:54:00.219895 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d65dd2f3-37a0-44b2-89a0-06366887f690 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:54:00.220345 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d65dd2f3-37a0-44b2-89a0-06366887f690 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:54:00.221083 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d65dd2f3-37a0-44b2-89a0-06366887f690 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:54:00.221558 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d65dd2f3-37a0-44b2-89a0-06366887f690 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:54:00.221999 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d65dd2f3-37a0-44b2-89a0-06366887f690 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:54:00.355560 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d65dd2f3-37a0-44b2-89a0-06366887f690 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b343d30c733d41b3a6b2f2648e7a3a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e4076abe344b879519de24063d992a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:54:00.363783 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d65dd2f3-37a0-44b2-89a0-06366887f690 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047" status: 200 len: 1594 microversion: 2.1 time: 0.159053 Sep 08 11:54:00.364362 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3655/7444] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:54:00 2022] GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047 => generated 1594 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:54:02.346063 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:54:02.347300 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=19 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:54:02.348152 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:54:02.353143 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-ce7524c5-2515-41a7-9cda-21482f47e52c req-2476cedd-c30b-4275-a2d8-31ffa70e5b23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e60da7f9-2db5-4c85-b831-2257da186047", "tag": "f5b6f1ec-8a06-4fd1-b80f-3139c92cceb2"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:54:02.365639 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-ce7524c5-2515-41a7-9cda-21482f47e52c req-2476cedd-c30b-4275-a2d8-31ffa70e5b23 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:54:02.366126 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-ce7524c5-2515-41a7-9cda-21482f47e52c req-2476cedd-c30b-4275-a2d8-31ffa70e5b23 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:54:02.366601 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-ce7524c5-2515-41a7-9cda-21482f47e52c req-2476cedd-c30b-4275-a2d8-31ffa70e5b23 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:54:02.380874 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-ce7524c5-2515-41a7-9cda-21482f47e52c req-2476cedd-c30b-4275-a2d8-31ffa70e5b23 service nova] Creating event network-changed:f5b6f1ec-8a06-4fd1-b80f-3139c92cceb2 for instance e60da7f9-2db5-4c85-b831-2257da186047 on n-h1-850501-12 Sep 08 11:54:02.386991 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-ce7524c5-2515-41a7-9cda-21482f47e52c req-2476cedd-c30b-4275-a2d8-31ffa70e5b23 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042643 Sep 08 11:54:02.393707 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3790/7445] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:54:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:54:03.493200 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-96c19958-9483-4eb8-b9d9-830608f5c023 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1939032318"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:54:03.494483 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-96c19958-9483-4eb8-b9d9-830608f5c023 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: e60da7f9-2db5-4c85-b831-2257da186047] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:54:03.501954 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-96c19958-9483-4eb8-b9d9-830608f5c023 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:54:03.502533 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-96c19958-9483-4eb8-b9d9-830608f5c023 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:54:03.503053 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-96c19958-9483-4eb8-b9d9-830608f5c023 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:54:03.503840 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-96c19958-9483-4eb8-b9d9-830608f5c023 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:54:03.504390 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-96c19958-9483-4eb8-b9d9-830608f5c023 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:54:03.504955 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-96c19958-9483-4eb8-b9d9-830608f5c023 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:54:03.651412 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.network.security_group_api [None req-96c19958-9483-4eb8-b9d9-830608f5c023 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Adding security group 25d11b61-948b-4628-bec0-5f9cd56700e6 to port f5b6f1ec-8a06-4fd1-b80f-3139c92cceb2 Sep 08 11:54:03.985226 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-96c19958-9483-4eb8-b9d9-830608f5c023 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "POST /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047/action" status: 202 len: 0 microversion: 2.1 time: 0.496808 Sep 08 11:54:03.986421 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3656/7446] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 11:54:03 2022] POST /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047/action => generated 0 bytes in 499 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:54:03.999602 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-82fbc0b4-bc59-4e55-b65b-fb2b35ee97f8 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:54:04.000606 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-82fbc0b4-bc59-4e55-b65b-fb2b35ee97f8 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: e60da7f9-2db5-4c85-b831-2257da186047] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:54:04.011075 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-82fbc0b4-bc59-4e55-b65b-fb2b35ee97f8 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:54:04.011727 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-82fbc0b4-bc59-4e55-b65b-fb2b35ee97f8 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:54:04.012216 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-82fbc0b4-bc59-4e55-b65b-fb2b35ee97f8 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:54:04.013007 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-82fbc0b4-bc59-4e55-b65b-fb2b35ee97f8 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:54:04.013714 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-82fbc0b4-bc59-4e55-b65b-fb2b35ee97f8 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:54:04.014404 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-82fbc0b4-bc59-4e55-b65b-fb2b35ee97f8 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:54:04.191553 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-82fbc0b4-bc59-4e55-b65b-fb2b35ee97f8 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b343d30c733d41b3a6b2f2648e7a3a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e4076abe344b879519de24063d992a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:54:04.203235 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-82fbc0b4-bc59-4e55-b65b-fb2b35ee97f8 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047" status: 200 len: 1760 microversion: 2.1 time: 0.211414 Sep 08 11:54:04.204280 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3791/7447] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:54:03 2022] GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047 => generated 1760 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:54:04.404431 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-c035579c-69ab-48d1-93b2-7165ff5e5423 req-f655978e-c53a-442b-97b9-2497fe3f8025 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e60da7f9-2db5-4c85-b831-2257da186047", "tag": "f5b6f1ec-8a06-4fd1-b80f-3139c92cceb2"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:54:04.414059 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c035579c-69ab-48d1-93b2-7165ff5e5423 req-f655978e-c53a-442b-97b9-2497fe3f8025 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:54:04.414617 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c035579c-69ab-48d1-93b2-7165ff5e5423 req-f655978e-c53a-442b-97b9-2497fe3f8025 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:54:04.415107 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c035579c-69ab-48d1-93b2-7165ff5e5423 req-f655978e-c53a-442b-97b9-2497fe3f8025 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:54:04.427230 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-c035579c-69ab-48d1-93b2-7165ff5e5423 req-f655978e-c53a-442b-97b9-2497fe3f8025 service nova] Creating event network-changed:f5b6f1ec-8a06-4fd1-b80f-3139c92cceb2 for instance e60da7f9-2db5-4c85-b831-2257da186047 on n-h1-850501-12 Sep 08 11:54:04.433093 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-c035579c-69ab-48d1-93b2-7165ff5e5423 req-f655978e-c53a-442b-97b9-2497fe3f8025 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032271 Sep 08 11:54:04.434307 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3657/7448] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:54:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:54:20.246397 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=4 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:54:20.247448 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=8 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:54:20.295660 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ad34157a-a3c3-432a-bbca-3567dd1d6a97 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:54:20.298117 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ad34157a-a3c3-432a-bbca-3567dd1d6a97 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: e60da7f9-2db5-4c85-b831-2257da186047] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:54:20.304279 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ad34157a-a3c3-432a-bbca-3567dd1d6a97 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:54:20.304897 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ad34157a-a3c3-432a-bbca-3567dd1d6a97 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:54:20.305380 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ad34157a-a3c3-432a-bbca-3567dd1d6a97 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:54:20.306091 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ad34157a-a3c3-432a-bbca-3567dd1d6a97 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:54:20.307068 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ad34157a-a3c3-432a-bbca-3567dd1d6a97 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:54:20.307473 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ad34157a-a3c3-432a-bbca-3567dd1d6a97 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:54:20.385162 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ad34157a-a3c3-432a-bbca-3567dd1d6a97 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "POST /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047/action" status: 202 len: 0 microversion: 2.1 time: 0.148448 Sep 08 11:54:20.385900 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3792/7449] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 11:54:20 2022] POST /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:54:20.395673 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c3032489-03af-4fc4-a7b4-93a06ee578b9 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:54:20.396391 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c3032489-03af-4fc4-a7b4-93a06ee578b9 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: e60da7f9-2db5-4c85-b831-2257da186047] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:54:20.399370 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:54:20.400044 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=12 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:54:20.407422 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c3032489-03af-4fc4-a7b4-93a06ee578b9 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:54:20.407933 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c3032489-03af-4fc4-a7b4-93a06ee578b9 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:54:20.408986 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c3032489-03af-4fc4-a7b4-93a06ee578b9 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:54:20.409812 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c3032489-03af-4fc4-a7b4-93a06ee578b9 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:54:20.410495 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c3032489-03af-4fc4-a7b4-93a06ee578b9 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:54:20.411038 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c3032489-03af-4fc4-a7b4-93a06ee578b9 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:54:20.587180 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c3032489-03af-4fc4-a7b4-93a06ee578b9 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b343d30c733d41b3a6b2f2648e7a3a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e4076abe344b879519de24063d992a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:54:20.596440 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c3032489-03af-4fc4-a7b4-93a06ee578b9 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047" status: 200 len: 1752 microversion: 2.1 time: 0.205279 Sep 08 11:54:20.597057 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3658/7450] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:54:20 2022] GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047 => generated 1752 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:54:21.621606 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-677a925e-bfbb-4c29-9682-67af374a85cd tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:54:21.622340 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-677a925e-bfbb-4c29-9682-67af374a85cd tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: e60da7f9-2db5-4c85-b831-2257da186047] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:54:21.628883 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-677a925e-bfbb-4c29-9682-67af374a85cd tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:54:21.629409 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-677a925e-bfbb-4c29-9682-67af374a85cd tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:54:21.629849 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-677a925e-bfbb-4c29-9682-67af374a85cd tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:54:21.630562 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-677a925e-bfbb-4c29-9682-67af374a85cd tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:54:21.631021 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-677a925e-bfbb-4c29-9682-67af374a85cd tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:54:21.631484 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-677a925e-bfbb-4c29-9682-67af374a85cd tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:54:21.784512 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-677a925e-bfbb-4c29-9682-67af374a85cd tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b343d30c733d41b3a6b2f2648e7a3a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e4076abe344b879519de24063d992a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:54:21.792989 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-677a925e-bfbb-4c29-9682-67af374a85cd tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047" status: 200 len: 1757 microversion: 2.1 time: 0.176699 Sep 08 11:54:21.793585 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3793/7451] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:54:21 2022] GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047 => generated 1757 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:54:22.817613 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6c324b25-0572-41ac-9b32-7bbcd6d77216 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:54:22.818179 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6c324b25-0572-41ac-9b32-7bbcd6d77216 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: e60da7f9-2db5-4c85-b831-2257da186047] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:54:22.825437 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6c324b25-0572-41ac-9b32-7bbcd6d77216 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:54:22.825940 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6c324b25-0572-41ac-9b32-7bbcd6d77216 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:54:22.826398 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6c324b25-0572-41ac-9b32-7bbcd6d77216 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:54:22.827132 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6c324b25-0572-41ac-9b32-7bbcd6d77216 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:54:22.827595 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6c324b25-0572-41ac-9b32-7bbcd6d77216 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:54:22.828040 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6c324b25-0572-41ac-9b32-7bbcd6d77216 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:54:22.975693 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6c324b25-0572-41ac-9b32-7bbcd6d77216 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b343d30c733d41b3a6b2f2648e7a3a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e4076abe344b879519de24063d992a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:54:22.984285 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6c324b25-0572-41ac-9b32-7bbcd6d77216 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047" status: 200 len: 1757 microversion: 2.1 time: 0.170765 Sep 08 11:54:22.984915 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3659/7452] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:54:22 2022] GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047 => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:54:24.008160 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e3bed86c-53f2-478e-85d9-1a321b82149a tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:54:24.008772 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e3bed86c-53f2-478e-85d9-1a321b82149a tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: e60da7f9-2db5-4c85-b831-2257da186047] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:54:24.016394 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e3bed86c-53f2-478e-85d9-1a321b82149a tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:54:24.016913 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e3bed86c-53f2-478e-85d9-1a321b82149a tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:54:24.017382 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e3bed86c-53f2-478e-85d9-1a321b82149a tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:54:24.018081 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e3bed86c-53f2-478e-85d9-1a321b82149a tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:54:24.018536 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e3bed86c-53f2-478e-85d9-1a321b82149a tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:54:24.018962 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e3bed86c-53f2-478e-85d9-1a321b82149a tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:54:24.168783 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e3bed86c-53f2-478e-85d9-1a321b82149a tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b343d30c733d41b3a6b2f2648e7a3a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e4076abe344b879519de24063d992a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:54:24.177384 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e3bed86c-53f2-478e-85d9-1a321b82149a tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047" status: 200 len: 1757 microversion: 2.1 time: 0.173349 Sep 08 11:54:24.177966 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3794/7453] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:54:24 2022] GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047 => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:54:25.202624 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4702c93a-5039-4905-89f5-d8323f22d6f6 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:54:25.203260 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4702c93a-5039-4905-89f5-d8323f22d6f6 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: e60da7f9-2db5-4c85-b831-2257da186047] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:54:25.210229 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4702c93a-5039-4905-89f5-d8323f22d6f6 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:54:25.210736 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4702c93a-5039-4905-89f5-d8323f22d6f6 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:54:25.211191 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4702c93a-5039-4905-89f5-d8323f22d6f6 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:54:25.211909 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4702c93a-5039-4905-89f5-d8323f22d6f6 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:54:25.212383 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4702c93a-5039-4905-89f5-d8323f22d6f6 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:54:25.212828 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4702c93a-5039-4905-89f5-d8323f22d6f6 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:54:25.375216 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4702c93a-5039-4905-89f5-d8323f22d6f6 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b343d30c733d41b3a6b2f2648e7a3a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e4076abe344b879519de24063d992a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:54:25.384607 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4702c93a-5039-4905-89f5-d8323f22d6f6 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047" status: 200 len: 1757 microversion: 2.1 time: 0.186570 Sep 08 11:54:25.385186 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3660/7454] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:54:25 2022] GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047 => generated 1757 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:54:26.410980 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8804ddde-4913-4784-ae16-963740ed0cce tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:54:26.411599 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8804ddde-4913-4784-ae16-963740ed0cce tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: e60da7f9-2db5-4c85-b831-2257da186047] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:54:26.418581 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8804ddde-4913-4784-ae16-963740ed0cce tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:54:26.419065 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8804ddde-4913-4784-ae16-963740ed0cce tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:54:26.419506 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8804ddde-4913-4784-ae16-963740ed0cce tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:54:26.420199 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8804ddde-4913-4784-ae16-963740ed0cce tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:54:26.420720 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8804ddde-4913-4784-ae16-963740ed0cce tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:54:26.421189 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8804ddde-4913-4784-ae16-963740ed0cce tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:54:26.571613 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8804ddde-4913-4784-ae16-963740ed0cce tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b343d30c733d41b3a6b2f2648e7a3a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e4076abe344b879519de24063d992a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:54:26.580923 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8804ddde-4913-4784-ae16-963740ed0cce tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047" status: 200 len: 1757 microversion: 2.1 time: 0.174043 Sep 08 11:54:26.581540 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3795/7455] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:54:26 2022] GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047 => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:54:27.603811 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-37478142-0e30-47e2-9431-c59620687feb tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:54:27.604499 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-37478142-0e30-47e2-9431-c59620687feb tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: e60da7f9-2db5-4c85-b831-2257da186047] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:54:27.611423 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-37478142-0e30-47e2-9431-c59620687feb tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:54:27.611921 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-37478142-0e30-47e2-9431-c59620687feb tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:54:27.612372 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-37478142-0e30-47e2-9431-c59620687feb tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:54:27.613097 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-37478142-0e30-47e2-9431-c59620687feb tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:54:27.613566 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-37478142-0e30-47e2-9431-c59620687feb tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:54:27.614004 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-37478142-0e30-47e2-9431-c59620687feb tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:54:27.762780 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-37478142-0e30-47e2-9431-c59620687feb tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b343d30c733d41b3a6b2f2648e7a3a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e4076abe344b879519de24063d992a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:54:27.771516 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-37478142-0e30-47e2-9431-c59620687feb tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047" status: 200 len: 1757 microversion: 2.1 time: 0.171543 Sep 08 11:54:27.772113 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3661/7456] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:54:27 2022] GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047 => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:54:28.796031 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a034726c-b17c-4cb5-8900-b535cb1f037a tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:54:28.796580 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a034726c-b17c-4cb5-8900-b535cb1f037a tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: e60da7f9-2db5-4c85-b831-2257da186047] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:54:28.803661 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a034726c-b17c-4cb5-8900-b535cb1f037a tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:54:28.804149 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a034726c-b17c-4cb5-8900-b535cb1f037a tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:54:28.804586 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a034726c-b17c-4cb5-8900-b535cb1f037a tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:54:28.805370 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a034726c-b17c-4cb5-8900-b535cb1f037a tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:54:28.805825 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a034726c-b17c-4cb5-8900-b535cb1f037a tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:54:28.806252 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a034726c-b17c-4cb5-8900-b535cb1f037a tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:54:28.954334 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a034726c-b17c-4cb5-8900-b535cb1f037a tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b343d30c733d41b3a6b2f2648e7a3a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e4076abe344b879519de24063d992a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:54:28.962801 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a034726c-b17c-4cb5-8900-b535cb1f037a tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047" status: 200 len: 1757 microversion: 2.1 time: 0.171397 Sep 08 11:54:28.963371 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3796/7457] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:54:28 2022] GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047 => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:54:29.986899 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0441742a-2112-43a2-add7-07642eb666ab tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:54:29.987448 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0441742a-2112-43a2-add7-07642eb666ab tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: e60da7f9-2db5-4c85-b831-2257da186047] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:54:29.994492 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0441742a-2112-43a2-add7-07642eb666ab tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:54:29.995025 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0441742a-2112-43a2-add7-07642eb666ab tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:54:29.995476 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0441742a-2112-43a2-add7-07642eb666ab tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:54:29.996188 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0441742a-2112-43a2-add7-07642eb666ab tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:54:29.996666 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0441742a-2112-43a2-add7-07642eb666ab tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:54:29.997138 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0441742a-2112-43a2-add7-07642eb666ab tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:54:30.141871 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0441742a-2112-43a2-add7-07642eb666ab tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b343d30c733d41b3a6b2f2648e7a3a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e4076abe344b879519de24063d992a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:54:30.150194 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0441742a-2112-43a2-add7-07642eb666ab tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047" status: 200 len: 1757 microversion: 2.1 time: 0.167387 Sep 08 11:54:30.150767 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3662/7458] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:54:29 2022] GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:54:31.174018 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c8c7aa90-2fc0-4e0f-ac1d-4521311f65a1 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:54:31.174557 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c8c7aa90-2fc0-4e0f-ac1d-4521311f65a1 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: e60da7f9-2db5-4c85-b831-2257da186047] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:54:31.181751 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c8c7aa90-2fc0-4e0f-ac1d-4521311f65a1 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:54:31.182315 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c8c7aa90-2fc0-4e0f-ac1d-4521311f65a1 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:54:31.183600 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c8c7aa90-2fc0-4e0f-ac1d-4521311f65a1 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:54:31.184439 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c8c7aa90-2fc0-4e0f-ac1d-4521311f65a1 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:54:31.185015 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c8c7aa90-2fc0-4e0f-ac1d-4521311f65a1 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:54:31.185378 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c8c7aa90-2fc0-4e0f-ac1d-4521311f65a1 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:54:31.332116 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c8c7aa90-2fc0-4e0f-ac1d-4521311f65a1 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b343d30c733d41b3a6b2f2648e7a3a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e4076abe344b879519de24063d992a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:54:31.341731 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c8c7aa90-2fc0-4e0f-ac1d-4521311f65a1 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047" status: 200 len: 1757 microversion: 2.1 time: 0.171704 Sep 08 11:54:31.342337 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3797/7459] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:54:31 2022] GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047 => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:54:32.365349 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fdb024e9-8e77-45c9-bb65-d8309c70c2b2 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:54:32.365983 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fdb024e9-8e77-45c9-bb65-d8309c70c2b2 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: e60da7f9-2db5-4c85-b831-2257da186047] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:54:32.373096 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fdb024e9-8e77-45c9-bb65-d8309c70c2b2 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:54:32.373602 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fdb024e9-8e77-45c9-bb65-d8309c70c2b2 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:54:32.374057 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fdb024e9-8e77-45c9-bb65-d8309c70c2b2 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:54:32.374774 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fdb024e9-8e77-45c9-bb65-d8309c70c2b2 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:54:32.375255 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fdb024e9-8e77-45c9-bb65-d8309c70c2b2 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:54:32.375704 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fdb024e9-8e77-45c9-bb65-d8309c70c2b2 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:54:32.521886 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fdb024e9-8e77-45c9-bb65-d8309c70c2b2 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b343d30c733d41b3a6b2f2648e7a3a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e4076abe344b879519de24063d992a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:54:32.531240 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fdb024e9-8e77-45c9-bb65-d8309c70c2b2 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047" status: 200 len: 1760 microversion: 2.1 time: 0.170101 Sep 08 11:54:32.531824 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3663/7460] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:54:32 2022] GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047 => generated 1760 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:55:04.964654 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d615432c-b091-4164-8663-414274f6288d tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1939032318"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:55:04.965296 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d615432c-b091-4164-8663-414274f6288d tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: e60da7f9-2db5-4c85-b831-2257da186047] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:55:04.967949 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=12 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:55:04.968815 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:55:04.974815 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d615432c-b091-4164-8663-414274f6288d tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:55:04.975329 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d615432c-b091-4164-8663-414274f6288d tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:55:04.975767 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d615432c-b091-4164-8663-414274f6288d tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:55:04.976464 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d615432c-b091-4164-8663-414274f6288d tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:55:04.976919 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d615432c-b091-4164-8663-414274f6288d tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:55:04.977372 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d615432c-b091-4164-8663-414274f6288d tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:55:05.117151 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.network.security_group_api [None req-d615432c-b091-4164-8663-414274f6288d tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Removing security group 25d11b61-948b-4628-bec0-5f9cd56700e6 from port f5b6f1ec-8a06-4fd1-b80f-3139c92cceb2 Sep 08 11:55:05.829829 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d615432c-b091-4164-8663-414274f6288d tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "POST /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047/action" status: 202 len: 0 microversion: 2.1 time: 0.869411 Sep 08 11:55:05.833518 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3798/7461] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 11:55:04 2022] POST /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047/action => generated 0 bytes in 871 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:55:05.875251 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-3dfa7c87-8599-4e30-88ea-4d9b5e75b988 req-c47cf96d-9a6d-4819-8a21-3bdb6864eabd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e60da7f9-2db5-4c85-b831-2257da186047", "tag": "f5b6f1ec-8a06-4fd1-b80f-3139c92cceb2"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:55:05.884186 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=12 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:55:05.885353 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=36 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:55:05.888819 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-3dfa7c87-8599-4e30-88ea-4d9b5e75b988 req-c47cf96d-9a6d-4819-8a21-3bdb6864eabd service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:55:05.890025 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-3dfa7c87-8599-4e30-88ea-4d9b5e75b988 req-c47cf96d-9a6d-4819-8a21-3bdb6864eabd service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:55:05.890761 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-3dfa7c87-8599-4e30-88ea-4d9b5e75b988 req-c47cf96d-9a6d-4819-8a21-3bdb6864eabd service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:55:05.906891 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-3dfa7c87-8599-4e30-88ea-4d9b5e75b988 req-c47cf96d-9a6d-4819-8a21-3bdb6864eabd service nova] Creating event network-changed:f5b6f1ec-8a06-4fd1-b80f-3139c92cceb2 for instance e60da7f9-2db5-4c85-b831-2257da186047 on n-h1-850501-12 Sep 08 11:55:05.914666 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-3dfa7c87-8599-4e30-88ea-4d9b5e75b988 req-c47cf96d-9a6d-4819-8a21-3bdb6864eabd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043802 Sep 08 11:55:05.916017 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3664/7462] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:55:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:55:06.995394 n-d-850501-12 devstack@n-api.service[128862]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 11:55:06.995983 n-d-850501-12 devstack@n-api.service[128862]: Thu Sep 8 11:55:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.27) !!! Sep 08 11:55:06.997879 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b2a1ea17-b7e5-42ca-900e-82ff2dbcacdb tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:55:06.998478 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b2a1ea17-b7e5-42ca-900e-82ff2dbcacdb tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: e60da7f9-2db5-4c85-b831-2257da186047] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:55:07.014601 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b2a1ea17-b7e5-42ca-900e-82ff2dbcacdb tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:55:07.015246 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b2a1ea17-b7e5-42ca-900e-82ff2dbcacdb tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:55:07.015833 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b2a1ea17-b7e5-42ca-900e-82ff2dbcacdb tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:55:07.016575 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b2a1ea17-b7e5-42ca-900e-82ff2dbcacdb tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:55:07.017063 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b2a1ea17-b7e5-42ca-900e-82ff2dbcacdb tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:55:07.017654 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b2a1ea17-b7e5-42ca-900e-82ff2dbcacdb tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:55:07.065901 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-15bb634f-1f7e-4bbd-a6e1-5dbdc755dd41 req-a2ee3c3a-c60c-4ca9-8a01-2e6221ca9092 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e60da7f9-2db5-4c85-b831-2257da186047", "tag": "f5b6f1ec-8a06-4fd1-b80f-3139c92cceb2"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:55:07.078196 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-15bb634f-1f7e-4bbd-a6e1-5dbdc755dd41 req-a2ee3c3a-c60c-4ca9-8a01-2e6221ca9092 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:55:07.078913 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-15bb634f-1f7e-4bbd-a6e1-5dbdc755dd41 req-a2ee3c3a-c60c-4ca9-8a01-2e6221ca9092 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:55:07.079378 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-15bb634f-1f7e-4bbd-a6e1-5dbdc755dd41 req-a2ee3c3a-c60c-4ca9-8a01-2e6221ca9092 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:55:07.091100 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-15bb634f-1f7e-4bbd-a6e1-5dbdc755dd41 req-a2ee3c3a-c60c-4ca9-8a01-2e6221ca9092 service nova] Creating event network-changed:f5b6f1ec-8a06-4fd1-b80f-3139c92cceb2 for instance e60da7f9-2db5-4c85-b831-2257da186047 on n-h1-850501-12 Sep 08 11:55:07.097641 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-15bb634f-1f7e-4bbd-a6e1-5dbdc755dd41 req-a2ee3c3a-c60c-4ca9-8a01-2e6221ca9092 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103323 Sep 08 11:55:07.098248 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3665/7463] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:55:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:55:07.106376 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-b2a1ea17-b7e5-42ca-900e-82ff2dbcacdb tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lazy-loading 'services' on Instance uuid e60da7f9-2db5-4c85-b831-2257da186047 {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:55:07.188447 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b2a1ea17-b7e5-42ca-900e-82ff2dbcacdb tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047/os-volume_attachments/276b06c3-be98-4cbe-9150-5710bc2b0d81" status: 202 len: 0 microversion: 2.1 time: 0.196798 Sep 08 11:55:07.189096 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3799/7464] 10.222.0.27 () {58 vars in 1416 bytes} [Thu Sep 8 11:55:06 2022] DELETE /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047/os-volume_attachments/276b06c3-be98-4cbe-9150-5710bc2b0d81 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:55:07.199952 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f6c1a5b5-6f82-4d5a-85ee-a7c1abc612ea tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:55:07.203183 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f6c1a5b5-6f82-4d5a-85ee-a7c1abc612ea tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: e60da7f9-2db5-4c85-b831-2257da186047] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:55:07.210723 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f6c1a5b5-6f82-4d5a-85ee-a7c1abc612ea tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:55:07.211493 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f6c1a5b5-6f82-4d5a-85ee-a7c1abc612ea tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:55:07.212148 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f6c1a5b5-6f82-4d5a-85ee-a7c1abc612ea tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:55:07.212869 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f6c1a5b5-6f82-4d5a-85ee-a7c1abc612ea tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:55:07.213733 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f6c1a5b5-6f82-4d5a-85ee-a7c1abc612ea tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:55:07.214426 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f6c1a5b5-6f82-4d5a-85ee-a7c1abc612ea tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:55:07.260708 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f6c1a5b5-6f82-4d5a-85ee-a7c1abc612ea tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066056 Sep 08 11:55:07.261386 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3666/7465] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 11:55:07 2022] GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:55:08.276360 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e990b6e8-9b1e-4476-b59f-b2bd446f2075 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:55:08.278691 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e990b6e8-9b1e-4476-b59f-b2bd446f2075 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: e60da7f9-2db5-4c85-b831-2257da186047] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:55:08.285575 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e990b6e8-9b1e-4476-b59f-b2bd446f2075 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:55:08.286069 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e990b6e8-9b1e-4476-b59f-b2bd446f2075 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:55:08.286510 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e990b6e8-9b1e-4476-b59f-b2bd446f2075 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:55:08.287221 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e990b6e8-9b1e-4476-b59f-b2bd446f2075 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:55:08.287679 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e990b6e8-9b1e-4476-b59f-b2bd446f2075 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:55:08.288110 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e990b6e8-9b1e-4476-b59f-b2bd446f2075 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:55:08.319618 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e990b6e8-9b1e-4476-b59f-b2bd446f2075 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049419 Sep 08 11:55:08.320397 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3800/7466] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 11:55:08 2022] GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:55:09.333215 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ad43a3ef-cb57-47e1-9581-1e3f8e624d81 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:55:09.335056 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ad43a3ef-cb57-47e1-9581-1e3f8e624d81 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: e60da7f9-2db5-4c85-b831-2257da186047] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:55:09.342762 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad43a3ef-cb57-47e1-9581-1e3f8e624d81 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:55:09.342762 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad43a3ef-cb57-47e1-9581-1e3f8e624d81 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:55:09.343156 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad43a3ef-cb57-47e1-9581-1e3f8e624d81 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:55:09.343881 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad43a3ef-cb57-47e1-9581-1e3f8e624d81 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:55:09.344344 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad43a3ef-cb57-47e1-9581-1e3f8e624d81 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:55:09.344785 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad43a3ef-cb57-47e1-9581-1e3f8e624d81 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:55:09.377434 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ad43a3ef-cb57-47e1-9581-1e3f8e624d81 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049029 Sep 08 11:55:09.378017 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3667/7467] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 11:55:09 2022] GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:55:10.391703 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-07b1795d-9c71-4cd3-85bc-646d1c208d2f tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:55:10.394055 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-07b1795d-9c71-4cd3-85bc-646d1c208d2f tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: e60da7f9-2db5-4c85-b831-2257da186047] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:55:10.403733 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-07b1795d-9c71-4cd3-85bc-646d1c208d2f tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:55:10.404784 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-07b1795d-9c71-4cd3-85bc-646d1c208d2f tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:55:10.405256 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-07b1795d-9c71-4cd3-85bc-646d1c208d2f tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:55:10.405978 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-07b1795d-9c71-4cd3-85bc-646d1c208d2f tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:55:10.406621 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-07b1795d-9c71-4cd3-85bc-646d1c208d2f tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:55:10.407068 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-07b1795d-9c71-4cd3-85bc-646d1c208d2f tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:55:10.440074 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-07b1795d-9c71-4cd3-85bc-646d1c208d2f tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053961 Sep 08 11:55:10.440669 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3801/7468] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 11:55:10 2022] GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:55:11.452823 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6f9a5645-511e-4ed0-af06-4903f0d55758 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:55:11.455060 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6f9a5645-511e-4ed0-af06-4903f0d55758 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: e60da7f9-2db5-4c85-b831-2257da186047] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:55:11.462410 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f9a5645-511e-4ed0-af06-4903f0d55758 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:55:11.462913 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f9a5645-511e-4ed0-af06-4903f0d55758 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:55:11.463359 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f9a5645-511e-4ed0-af06-4903f0d55758 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:55:11.464073 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f9a5645-511e-4ed0-af06-4903f0d55758 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:55:11.464540 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f9a5645-511e-4ed0-af06-4903f0d55758 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:55:11.464991 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f9a5645-511e-4ed0-af06-4903f0d55758 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:55:11.500322 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6f9a5645-511e-4ed0-af06-4903f0d55758 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052416 Sep 08 11:55:11.500908 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3668/7469] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 11:55:11 2022] GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:55:12.512923 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9918cc0a-f8b4-4613-ab5c-667e52d29b8a tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:55:12.515440 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9918cc0a-f8b4-4613-ab5c-667e52d29b8a tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: e60da7f9-2db5-4c85-b831-2257da186047] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:55:12.522472 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9918cc0a-f8b4-4613-ab5c-667e52d29b8a tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:55:12.522760 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9918cc0a-f8b4-4613-ab5c-667e52d29b8a tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:55:12.523203 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9918cc0a-f8b4-4613-ab5c-667e52d29b8a tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:55:12.523899 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9918cc0a-f8b4-4613-ab5c-667e52d29b8a tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:55:12.524445 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9918cc0a-f8b4-4613-ab5c-667e52d29b8a tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:55:12.524777 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9918cc0a-f8b4-4613-ab5c-667e52d29b8a tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:55:12.554325 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9918cc0a-f8b4-4613-ab5c-667e52d29b8a tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045479 Sep 08 11:55:12.554872 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3802/7470] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 11:55:12 2022] GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 11:55:12.566572 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-edcd5413-f3ef-4e2d-9fd9-fb1f977c36cc tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:55:12.567132 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-edcd5413-f3ef-4e2d-9fd9-fb1f977c36cc tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: e60da7f9-2db5-4c85-b831-2257da186047] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:55:12.573961 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-edcd5413-f3ef-4e2d-9fd9-fb1f977c36cc tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:55:12.574471 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-edcd5413-f3ef-4e2d-9fd9-fb1f977c36cc tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:55:12.574927 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-edcd5413-f3ef-4e2d-9fd9-fb1f977c36cc tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:55:12.575644 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-edcd5413-f3ef-4e2d-9fd9-fb1f977c36cc tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:55:12.576156 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-edcd5413-f3ef-4e2d-9fd9-fb1f977c36cc tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:55:12.576880 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-edcd5413-f3ef-4e2d-9fd9-fb1f977c36cc tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:55:12.653210 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-edcd5413-f3ef-4e2d-9fd9-fb1f977c36cc tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] HTTP exception thrown: Instance e60da7f9-2db5-4c85-b831-2257da186047 is not attached to volume 276b06c3-be98-4cbe-9150-5710bc2b0d81 Sep 08 11:55:12.655902 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-edcd5413-f3ef-4e2d-9fd9-fb1f977c36cc tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Request method failure captured: Sep 08 11:55:12.655902 n-d-850501-12 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047/os-volume_attachments/276b06c3-be98-4cbe-9150-5710bc2b0d81 HTTP/1.1 Sep 08 11:55:12.655902 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 11:55:12.655902 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 11:55:12.655902 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 11:55:12.655902 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 11:55:12.655902 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 11:55:12.655902 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 11:55:12.655902 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 11:55:12.655902 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 11:55:12.655902 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGda6lt0OjQky38i1I7zhTNEPFh3M7HMD5N2Z6L8DcuJK8H27LSlRofjxr8N1ZePurD5L0_b2saB9rphWkmMqKZblvSLPEPBdKBfbjQ_RIeFv7nQIdh5-cXWLnDkBoJwO0lrVfpVc2Lh8vDtjoonozBib4-rCvZ3wwEJlVQ77AWI7LIM Sep 08 11:55:12.655902 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 11:55:12.655902 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 11:55:12.655902 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 11:55:12.655902 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 11:55:12.655902 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 11:55:12.655902 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 11:55:12.655902 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: b4e4076abe344b879519de24063d992a Sep 08 11:55:12.655902 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-TestMinimumBasicScenario-1082017553 Sep 08 11:55:12.655902 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 11:55:12.655902 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 11:55:12.655902 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b4e4076abe344b879519de24063d992a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b4e4076abe344b879519de24063d992a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b4e4076abe344b879519de24063d992a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b4e4076abe344b879519de24063d992a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:55:12.655902 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-TestMinimumBasicScenario-1082017553 Sep 08 11:55:12.655902 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: b4e4076abe344b879519de24063d992a Sep 08 11:55:12.655902 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1082017553 Sep 08 11:55:12.655902 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-TestMinimumBasicScenario-1082017553-project Sep 08 11:55:12.655902 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 11:55:12.655902 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 11:55:12.655902 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: b343d30c733d41b3a6b2f2648e7a3a09 Sep 08 11:55:12.655902 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-TestMinimumBasicScenario-1082017553-project Sep 08 11:55:12.655902 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 11:55:12.655902 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance e60da7f9-2db5-4c85-b831-2257da186047 is not attached to volume 276b06c3-be98-4cbe-9150-5710bc2b0d81 Sep 08 11:55:12.655902 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'server_id': 'e60da7f9-2db5-4c85-b831-2257da186047', 'id': '276b06c3-be98-4cbe-9150-5710bc2b0d81'} Sep 08 11:55:12.655902 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:55:12.655902 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:55:12.655902 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 08 11:55:12.655902 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 08 11:55:12.655902 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 11:55:12.655902 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 11:55:12.655902 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 08 11:55:12.655902 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 08 11:55:12.655902 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 276b06c3-be98-4cbe-9150-5710bc2b0d81. Sep 08 11:55:12.655902 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:55:12.655902 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:55:12.655902 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:55:12.655902 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:55:12.655902 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:55:12.655902 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:55:12.655902 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:55:12.655902 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:55:12.655902 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:55:12.655902 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:55:12.655902 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 08 11:55:12.655902 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 08 11:55:12.655902 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e60da7f9-2db5-4c85-b831-2257da186047 is not attached to volume 276b06c3-be98-4cbe-9150-5710bc2b0d81 Sep 08 11:55:12.655902 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:55:12.655902 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:55:12.655902 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:55:12.655902 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:55:12.655902 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:55:12.655902 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:55:12.660728 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:55:12.660728 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:55:12.660728 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e60da7f9-2db5-4c85-b831-2257da186047 is not attached to volume 276b06c3-be98-4cbe-9150-5710bc2b0d81 Sep 08 11:55:12.660728 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:55:12.660728 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-edcd5413-f3ef-4e2d-9fd9-fb1f977c36cc tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Returning 404 to user: Instance e60da7f9-2db5-4c85-b831-2257da186047 is not attached to volume 276b06c3-be98-4cbe-9150-5710bc2b0d81 {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:55:12.660728 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-edcd5413-f3ef-4e2d-9fd9-fb1f977c36cc tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047/os-volume_attachments/276b06c3-be98-4cbe-9150-5710bc2b0d81" status: 404 len: 154 microversion: 2.1 time: 0.094990 Sep 08 11:55:12.660728 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3669/7471] 10.222.0.27 () {58 vars in 1416 bytes} [Thu Sep 8 11:55:12 2022] DELETE /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047/os-volume_attachments/276b06c3-be98-4cbe-9150-5710bc2b0d81 => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 11:55:15.911051 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b5c46cd9-6a18-4ff1-a786-5c9fe26c4649 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:55:15.911582 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b5c46cd9-6a18-4ff1-a786-5c9fe26c4649 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: e60da7f9-2db5-4c85-b831-2257da186047] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:55:15.919345 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b5c46cd9-6a18-4ff1-a786-5c9fe26c4649 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:55:15.920958 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b5c46cd9-6a18-4ff1-a786-5c9fe26c4649 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:55:15.921441 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b5c46cd9-6a18-4ff1-a786-5c9fe26c4649 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:55:15.922169 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b5c46cd9-6a18-4ff1-a786-5c9fe26c4649 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:55:15.922636 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b5c46cd9-6a18-4ff1-a786-5c9fe26c4649 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:55:15.923066 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b5c46cd9-6a18-4ff1-a786-5c9fe26c4649 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:55:15.948801 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b5c46cd9-6a18-4ff1-a786-5c9fe26c4649 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: e60da7f9-2db5-4c85-b831-2257da186047] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:55:16.032582 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b5c46cd9-6a18-4ff1-a786-5c9fe26c4649 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047" status: 204 len: 0 microversion: 2.1 time: 0.125344 Sep 08 11:55:16.037299 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3803/7472] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:55:15 2022] DELETE /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:55:16.045398 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3c67da62-775c-4496-ad48-8c26f19982ac tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:55:16.047600 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3c67da62-775c-4496-ad48-8c26f19982ac tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: e60da7f9-2db5-4c85-b831-2257da186047] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:55:16.059547 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c67da62-775c-4496-ad48-8c26f19982ac tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:55:16.060059 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c67da62-775c-4496-ad48-8c26f19982ac tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:55:16.060569 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c67da62-775c-4496-ad48-8c26f19982ac tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:55:16.061502 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c67da62-775c-4496-ad48-8c26f19982ac tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:55:16.061981 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c67da62-775c-4496-ad48-8c26f19982ac tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:55:16.062435 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c67da62-775c-4496-ad48-8c26f19982ac tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:55:16.208464 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3c67da62-775c-4496-ad48-8c26f19982ac tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b343d30c733d41b3a6b2f2648e7a3a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e4076abe344b879519de24063d992a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:55:16.217365 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3c67da62-775c-4496-ad48-8c26f19982ac tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047" status: 200 len: 1554 microversion: 2.1 time: 0.177418 Sep 08 11:55:16.218125 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3670/7473] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:55:16 2022] GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047 => generated 1554 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:55:17.243508 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4b466162-d532-4f30-b152-e0759de098bc tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:55:17.244220 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4b466162-d532-4f30-b152-e0759de098bc tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: e60da7f9-2db5-4c85-b831-2257da186047] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:55:17.251922 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4b466162-d532-4f30-b152-e0759de098bc tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:55:17.252416 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4b466162-d532-4f30-b152-e0759de098bc tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:55:17.252861 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4b466162-d532-4f30-b152-e0759de098bc tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:55:17.253610 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4b466162-d532-4f30-b152-e0759de098bc tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:55:17.254074 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4b466162-d532-4f30-b152-e0759de098bc tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:55:17.254505 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4b466162-d532-4f30-b152-e0759de098bc tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:55:17.395243 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4b466162-d532-4f30-b152-e0759de098bc tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b343d30c733d41b3a6b2f2648e7a3a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e4076abe344b879519de24063d992a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:55:17.403218 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4b466162-d532-4f30-b152-e0759de098bc tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047" status: 200 len: 1554 microversion: 2.1 time: 0.164215 Sep 08 11:55:17.403801 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3804/7474] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:55:17 2022] GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047 => generated 1554 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:55:18.239783 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-53983bc8-1cbd-49f8-a815-1211ee0b7f19 req-51df776c-56e7-4ebd-8830-2f355cd144d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e60da7f9-2db5-4c85-b831-2257da186047", "name": "network-vif-deleted", "tag": "f5b6f1ec-8a06-4fd1-b80f-3139c92cceb2"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:55:18.250995 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-53983bc8-1cbd-49f8-a815-1211ee0b7f19 req-51df776c-56e7-4ebd-8830-2f355cd144d6 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:55:18.251499 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-53983bc8-1cbd-49f8-a815-1211ee0b7f19 req-51df776c-56e7-4ebd-8830-2f355cd144d6 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:55:18.251946 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-53983bc8-1cbd-49f8-a815-1211ee0b7f19 req-51df776c-56e7-4ebd-8830-2f355cd144d6 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:55:18.264418 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-53983bc8-1cbd-49f8-a815-1211ee0b7f19 req-51df776c-56e7-4ebd-8830-2f355cd144d6 service nova] Creating event network-vif-deleted:f5b6f1ec-8a06-4fd1-b80f-3139c92cceb2 for instance e60da7f9-2db5-4c85-b831-2257da186047 on n-h1-850501-12 Sep 08 11:55:18.270200 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-53983bc8-1cbd-49f8-a815-1211ee0b7f19 req-51df776c-56e7-4ebd-8830-2f355cd144d6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034345 Sep 08 11:55:18.270820 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3671/7475] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:55:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:55:18.426831 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1ea43186-0e2d-41bc-ab38-925edefdcede tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:55:18.427455 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1ea43186-0e2d-41bc-ab38-925edefdcede tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: e60da7f9-2db5-4c85-b831-2257da186047] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:55:18.435437 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1ea43186-0e2d-41bc-ab38-925edefdcede tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:55:18.435761 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1ea43186-0e2d-41bc-ab38-925edefdcede tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:55:18.436206 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1ea43186-0e2d-41bc-ab38-925edefdcede tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:55:18.436925 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1ea43186-0e2d-41bc-ab38-925edefdcede tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:55:18.437437 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1ea43186-0e2d-41bc-ab38-925edefdcede tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:55:18.437915 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1ea43186-0e2d-41bc-ab38-925edefdcede tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:55:18.472202 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1ea43186-0e2d-41bc-ab38-925edefdcede tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:55:18.472615 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1ea43186-0e2d-41bc-ab38-925edefdcede tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:55:18.473090 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1ea43186-0e2d-41bc-ab38-925edefdcede tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:55:18.473556 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-1ea43186-0e2d-41bc-ab38-925edefdcede tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lazy-loading 'fault' on Instance uuid e60da7f9-2db5-4c85-b831-2257da186047 {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:55:18.517833 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1ea43186-0e2d-41bc-ab38-925edefdcede tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b343d30c733d41b3a6b2f2648e7a3a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e4076abe344b879519de24063d992a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:55:18.525942 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1ea43186-0e2d-41bc-ab38-925edefdcede tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047" status: 200 len: 1348 microversion: 2.1 time: 0.103087 Sep 08 11:55:18.526735 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3805/7476] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:55:18 2022] GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047 => generated 1348 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:55:19.551901 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f705f970-0564-4fc4-9b0b-d4f56b9b1d35 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:55:19.552621 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f705f970-0564-4fc4-9b0b-d4f56b9b1d35 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] [instance: e60da7f9-2db5-4c85-b831-2257da186047] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:55:19.558884 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f705f970-0564-4fc4-9b0b-d4f56b9b1d35 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:55:19.559389 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f705f970-0564-4fc4-9b0b-d4f56b9b1d35 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:55:19.559843 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f705f970-0564-4fc4-9b0b-d4f56b9b1d35 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:55:19.560568 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f705f970-0564-4fc4-9b0b-d4f56b9b1d35 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:55:19.561045 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f705f970-0564-4fc4-9b0b-d4f56b9b1d35 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:55:19.561497 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f705f970-0564-4fc4-9b0b-d4f56b9b1d35 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:55:19.575160 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-f705f970-0564-4fc4-9b0b-d4f56b9b1d35 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] HTTP exception thrown: Instance e60da7f9-2db5-4c85-b831-2257da186047 could not be found. Sep 08 11:55:19.576797 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f705f970-0564-4fc4-9b0b-d4f56b9b1d35 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Request method failure captured: Sep 08 11:55:19.576797 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047 HTTP/1.1 Sep 08 11:55:19.576797 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 11:55:19.576797 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 11:55:19.576797 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 11:55:19.576797 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 11:55:19.576797 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 11:55:19.576797 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 11:55:19.576797 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 11:55:19.576797 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 11:55:19.576797 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGda6lt0OjQky38i1I7zhTNEPFh3M7HMD5N2Z6L8DcuJK8H27LSlRofjxr8N1ZePurD5L0_b2saB9rphWkmMqKZblvSLPEPBdKBfbjQ_RIeFv7nQIdh5-cXWLnDkBoJwO0lrVfpVc2Lh8vDtjoonozBib4-rCvZ3wwEJlVQ77AWI7LIM Sep 08 11:55:19.576797 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 11:55:19.576797 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 11:55:19.576797 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 11:55:19.576797 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 11:55:19.576797 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 11:55:19.576797 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 11:55:19.576797 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: b4e4076abe344b879519de24063d992a Sep 08 11:55:19.576797 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-TestMinimumBasicScenario-1082017553 Sep 08 11:55:19.576797 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 11:55:19.576797 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 11:55:19.576797 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b4e4076abe344b879519de24063d992a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b4e4076abe344b879519de24063d992a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b4e4076abe344b879519de24063d992a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b4e4076abe344b879519de24063d992a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:55:19.576797 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-TestMinimumBasicScenario-1082017553 Sep 08 11:55:19.576797 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: b4e4076abe344b879519de24063d992a Sep 08 11:55:19.576797 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1082017553 Sep 08 11:55:19.576797 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-TestMinimumBasicScenario-1082017553-project Sep 08 11:55:19.576797 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 11:55:19.576797 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 11:55:19.576797 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: b343d30c733d41b3a6b2f2648e7a3a09 Sep 08 11:55:19.576797 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-TestMinimumBasicScenario-1082017553-project Sep 08 11:55:19.576797 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 11:55:19.576797 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance e60da7f9-2db5-4c85-b831-2257da186047 could not be found. Sep 08 11:55:19.576797 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'e60da7f9-2db5-4c85-b831-2257da186047'} Sep 08 11:55:19.576797 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:55:19.576797 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:55:19.576797 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:55:19.576797 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:55:19.576797 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:55:19.576797 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:55:19.576797 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:55:19.576797 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:55:19.576797 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:55:19.576797 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:55:19.576797 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e60da7f9-2db5-4c85-b831-2257da186047 could not be found. Sep 08 11:55:19.576797 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:55:19.576797 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:55:19.576797 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:55:19.576797 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:55:19.576797 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:55:19.576797 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:55:19.576797 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:55:19.576797 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:55:19.576797 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:55:19.576797 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:55:19.576797 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:55:19.576797 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:55:19.576797 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:55:19.576797 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:55:19.576797 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:55:19.576797 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:55:19.576797 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e60da7f9-2db5-4c85-b831-2257da186047 could not be found. Sep 08 11:55:19.576797 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:55:19.576797 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:55:19.576797 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:55:19.581483 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:55:19.581483 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:55:19.581483 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:55:19.581483 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:55:19.581483 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:55:19.581483 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e60da7f9-2db5-4c85-b831-2257da186047 could not be found. Sep 08 11:55:19.581483 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:55:19.581483 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f705f970-0564-4fc4-9b0b-d4f56b9b1d35 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Returning 404 to user: Instance e60da7f9-2db5-4c85-b831-2257da186047 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:55:19.581483 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f705f970-0564-4fc4-9b0b-d4f56b9b1d35 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047" status: 404 len: 111 microversion: 2.1 time: 0.032134 Sep 08 11:55:19.581483 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3672/7477] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:55:19 2022] GET /compute/v2.1/servers/e60da7f9-2db5-4c85-b831-2257da186047 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:55:19.587270 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bc2cc529-5dd6-4fb6-b305-bc354bd90cd3 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] Calling method '.version_select at 0x7f68e89a6310>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:55:19.609802 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bc2cc529-5dd6-4fb6-b305-bc354bd90cd3 tempest-TestMinimumBasicScenario-1082017553 tempest-TestMinimumBasicScenario-1082017553-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2131463749" status: 202 len: 0 microversion: 2.1 time: 0.025188 Sep 08 11:55:19.610290 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3806/7478] 10.222.0.27 () {58 vars in 1272 bytes} [Thu Sep 8 11:55:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2131463749 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:55:28.951556 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-70704451-e9dc-4708-a20d-1164ba028500 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Action: 'create', calling method: .version_select at 0x7f68e4ff99d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-300798508", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK/BVp8mpTn0ujg1nxtlzZ6kzCVkxgRc/eBdpIeRxzauF53f/8goORGz9EGVCmJ+xn+/2mS2eAejmpJfq6s02fL7SYFf4GbQDGhtmQw80KgI5QkaDq8VMikbtg+ASMv2GQ=="}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:55:28.967220 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-70704451-e9dc-4708-a20d-1164ba028500 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Getting quotas for project f00a6070707c4334b4beb7d530b15814. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:55:28.973410 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-70704451-e9dc-4708-a20d-1164ba028500 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Getting quotas for user 4a16b57190c243a5b78e7717eb4a016b and project f00a6070707c4334b4beb7d530b15814. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:55:28.998537 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-70704451-e9dc-4708-a20d-1164ba028500 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.216550 Sep 08 11:55:28.999135 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3673/7479] 10.222.0.27 () {60 vars in 1159 bytes} [Thu Sep 8 11:55:28 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:55:34.571453 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=59,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:55:34.572225 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:55:34.582214 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bed8bcc6-0498-460b-b332-652aedb83bd4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-558228635", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "cecfce44-f627-4c81-8a69-d7c5f7437077"}], "key_name": "tempest-TestNetworkAdvancedServerOps-300798508", "security_groups": [{"name": "tempest-secgroup-smoke-411197820"}]}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:55:35.039349 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-bed8bcc6-0498-460b-b332-652aedb83bd4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] validate_networks() for [('cecfce44-f627-4c81-8a69-d7c5f7437077', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:55:35.533363 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-bed8bcc6-0498-460b-b332-652aedb83bd4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:55:35.533945 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-bed8bcc6-0498-460b-b332-652aedb83bd4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:55:35.534439 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-bed8bcc6-0498-460b-b332-652aedb83bd4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:55:35.535143 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-bed8bcc6-0498-460b-b332-652aedb83bd4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:55:35.535577 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-bed8bcc6-0498-460b-b332-652aedb83bd4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:55:35.554250 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bed8bcc6-0498-460b-b332-652aedb83bd4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:55:35.554763 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bed8bcc6-0498-460b-b332-652aedb83bd4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:55:35.555210 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bed8bcc6-0498-460b-b332-652aedb83bd4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:55:35.555956 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bed8bcc6-0498-460b-b332-652aedb83bd4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:55:35.557215 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bed8bcc6-0498-460b-b332-652aedb83bd4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:55:35.557967 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bed8bcc6-0498-460b-b332-652aedb83bd4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:55:35.586470 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-bed8bcc6-0498-460b-b332-652aedb83bd4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Getting quotas for project f00a6070707c4334b4beb7d530b15814. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:55:35.593907 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-bed8bcc6-0498-460b-b332-652aedb83bd4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Getting quotas for user 4a16b57190c243a5b78e7717eb4a016b and project f00a6070707c4334b4beb7d530b15814. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:55:35.609532 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bed8bcc6-0498-460b-b332-652aedb83bd4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:55:35.612939 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bed8bcc6-0498-460b-b332-652aedb83bd4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 88471b07-ce65-49f5-86a2-98fd68512252] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:55:35.667977 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bed8bcc6-0498-460b-b332-652aedb83bd4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.098571 Sep 08 11:55:35.676874 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3807/7480] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 11:55:34 2022] POST /compute/v2.1/servers => generated 405 bytes in 1108 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:55:35.681211 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b50c785a-c844-4743-882e-cba26efa5ffc tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:55:35.681853 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b50c785a-c844-4743-882e-cba26efa5ffc tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 88471b07-ce65-49f5-86a2-98fd68512252] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:55:35.683901 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=38 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:55:35.757564 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b50c785a-c844-4743-882e-cba26efa5ffc tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:55:35.766458 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b50c785a-c844-4743-882e-cba26efa5ffc tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/88471b07-ce65-49f5-86a2-98fd68512252" status: 200 len: 1265 microversion: 2.1 time: 0.089126 Sep 08 11:55:35.769255 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3674/7481] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:55:35 2022] GET /compute/v2.1/servers/88471b07-ce65-49f5-86a2-98fd68512252 => generated 1265 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:55:36.792125 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bec6c195-5148-40b9-b672-d00da68fbf76 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:55:36.793540 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bec6c195-5148-40b9-b672-d00da68fbf76 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 88471b07-ce65-49f5-86a2-98fd68512252] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:55:36.802992 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bec6c195-5148-40b9-b672-d00da68fbf76 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:55:36.803655 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bec6c195-5148-40b9-b672-d00da68fbf76 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:55:36.804109 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bec6c195-5148-40b9-b672-d00da68fbf76 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:55:36.804840 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bec6c195-5148-40b9-b672-d00da68fbf76 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:55:36.805516 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bec6c195-5148-40b9-b672-d00da68fbf76 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:55:36.806161 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bec6c195-5148-40b9-b672-d00da68fbf76 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:55:36.880615 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-bec6c195-5148-40b9-b672-d00da68fbf76 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:55:36.889492 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bec6c195-5148-40b9-b672-d00da68fbf76 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/88471b07-ce65-49f5-86a2-98fd68512252" status: 200 len: 1317 microversion: 2.1 time: 0.101333 Sep 08 11:55:36.901593 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3808/7482] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:55:36 2022] GET /compute/v2.1/servers/88471b07-ce65-49f5-86a2-98fd68512252 => generated 1317 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:55:37.916005 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3c65510e-2d32-44d2-a9c5-282bf8d77188 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:55:37.916005 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3c65510e-2d32-44d2-a9c5-282bf8d77188 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 88471b07-ce65-49f5-86a2-98fd68512252] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:55:37.923865 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:55:37.925930 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c65510e-2d32-44d2-a9c5-282bf8d77188 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:55:37.926684 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c65510e-2d32-44d2-a9c5-282bf8d77188 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:55:37.927327 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c65510e-2d32-44d2-a9c5-282bf8d77188 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:55:37.928204 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c65510e-2d32-44d2-a9c5-282bf8d77188 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:55:37.928781 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c65510e-2d32-44d2-a9c5-282bf8d77188 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:55:37.929359 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c65510e-2d32-44d2-a9c5-282bf8d77188 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:55:38.083172 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3c65510e-2d32-44d2-a9c5-282bf8d77188 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:55:38.091005 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3c65510e-2d32-44d2-a9c5-282bf8d77188 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/88471b07-ce65-49f5-86a2-98fd68512252" status: 200 len: 1390 microversion: 2.1 time: 0.180687 Sep 08 11:55:38.104092 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3675/7483] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:55:37 2022] GET /compute/v2.1/servers/88471b07-ce65-49f5-86a2-98fd68512252 => generated 1390 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:55:38.621472 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-f91724c1-9a81-4cd0-9d21-908ea0800b92 req-42e257af-ad93-4c08-b0e5-bdbe2cba57df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88471b07-ce65-49f5-86a2-98fd68512252", "tag": "cace8d66-c7b3-427c-a77f-c9665722ba59"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:55:38.633218 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-f91724c1-9a81-4cd0-9d21-908ea0800b92 req-42e257af-ad93-4c08-b0e5-bdbe2cba57df service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:55:38.633969 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-f91724c1-9a81-4cd0-9d21-908ea0800b92 req-42e257af-ad93-4c08-b0e5-bdbe2cba57df service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:55:38.634615 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-f91724c1-9a81-4cd0-9d21-908ea0800b92 req-42e257af-ad93-4c08-b0e5-bdbe2cba57df service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:55:38.649891 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-f91724c1-9a81-4cd0-9d21-908ea0800b92 req-42e257af-ad93-4c08-b0e5-bdbe2cba57df service nova] Creating event network-changed:cace8d66-c7b3-427c-a77f-c9665722ba59 for instance 88471b07-ce65-49f5-86a2-98fd68512252 on n-h2-850501-12 Sep 08 11:55:38.655237 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-f91724c1-9a81-4cd0-9d21-908ea0800b92 req-42e257af-ad93-4c08-b0e5-bdbe2cba57df service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037561 Sep 08 11:55:38.656455 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3809/7484] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:55:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:55:39.115448 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-909e4d75-2b93-4261-a9f3-916e3fc18c3d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:55:39.116059 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-909e4d75-2b93-4261-a9f3-916e3fc18c3d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 88471b07-ce65-49f5-86a2-98fd68512252] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:55:39.122930 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-909e4d75-2b93-4261-a9f3-916e3fc18c3d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:55:39.123441 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-909e4d75-2b93-4261-a9f3-916e3fc18c3d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:55:39.123894 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-909e4d75-2b93-4261-a9f3-916e3fc18c3d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:55:39.124605 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-909e4d75-2b93-4261-a9f3-916e3fc18c3d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:55:39.125130 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-909e4d75-2b93-4261-a9f3-916e3fc18c3d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:55:39.125573 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-909e4d75-2b93-4261-a9f3-916e3fc18c3d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:55:39.265734 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-909e4d75-2b93-4261-a9f3-916e3fc18c3d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:55:39.274114 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-909e4d75-2b93-4261-a9f3-916e3fc18c3d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/88471b07-ce65-49f5-86a2-98fd68512252" status: 200 len: 1390 microversion: 2.1 time: 0.163548 Sep 08 11:55:39.274888 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3676/7485] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:55:39 2022] GET /compute/v2.1/servers/88471b07-ce65-49f5-86a2-98fd68512252 => generated 1390 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:55:40.298722 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c91c453d-4f8e-4447-b0df-1325eb9ad486 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:55:40.300040 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c91c453d-4f8e-4447-b0df-1325eb9ad486 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 88471b07-ce65-49f5-86a2-98fd68512252] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:55:40.306425 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c91c453d-4f8e-4447-b0df-1325eb9ad486 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:55:40.306919 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c91c453d-4f8e-4447-b0df-1325eb9ad486 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:55:40.307361 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c91c453d-4f8e-4447-b0df-1325eb9ad486 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:55:40.308070 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c91c453d-4f8e-4447-b0df-1325eb9ad486 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:55:40.308532 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c91c453d-4f8e-4447-b0df-1325eb9ad486 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:55:40.308966 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c91c453d-4f8e-4447-b0df-1325eb9ad486 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:55:40.512423 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c91c453d-4f8e-4447-b0df-1325eb9ad486 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:55:40.520327 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c91c453d-4f8e-4447-b0df-1325eb9ad486 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/88471b07-ce65-49f5-86a2-98fd68512252" status: 200 len: 1390 microversion: 2.1 time: 0.226736 Sep 08 11:55:40.520912 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3810/7486] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:55:40 2022] GET /compute/v2.1/servers/88471b07-ce65-49f5-86a2-98fd68512252 => generated 1390 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:55:41.543348 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-41f20c6a-6c9e-4f90-b0c3-706ebf9aa974 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:55:41.544074 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-41f20c6a-6c9e-4f90-b0c3-706ebf9aa974 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 88471b07-ce65-49f5-86a2-98fd68512252] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:55:41.551663 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-41f20c6a-6c9e-4f90-b0c3-706ebf9aa974 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:55:41.552173 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-41f20c6a-6c9e-4f90-b0c3-706ebf9aa974 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:55:41.552634 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-41f20c6a-6c9e-4f90-b0c3-706ebf9aa974 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:55:41.553399 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-41f20c6a-6c9e-4f90-b0c3-706ebf9aa974 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:55:41.553883 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-41f20c6a-6c9e-4f90-b0c3-706ebf9aa974 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:55:41.554334 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-41f20c6a-6c9e-4f90-b0c3-706ebf9aa974 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:55:41.688757 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-41f20c6a-6c9e-4f90-b0c3-706ebf9aa974 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:55:41.697181 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-41f20c6a-6c9e-4f90-b0c3-706ebf9aa974 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/88471b07-ce65-49f5-86a2-98fd68512252" status: 200 len: 1390 microversion: 2.1 time: 0.157758 Sep 08 11:55:41.697757 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3677/7487] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:55:41 2022] GET /compute/v2.1/servers/88471b07-ce65-49f5-86a2-98fd68512252 => generated 1390 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:55:42.719832 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-677ac646-6ca6-47b2-9990-f5de149775cc tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:55:42.720453 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-677ac646-6ca6-47b2-9990-f5de149775cc tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 88471b07-ce65-49f5-86a2-98fd68512252] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:55:42.727438 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-677ac646-6ca6-47b2-9990-f5de149775cc tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:55:42.727931 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-677ac646-6ca6-47b2-9990-f5de149775cc tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:55:42.728374 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-677ac646-6ca6-47b2-9990-f5de149775cc tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:55:42.729089 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-677ac646-6ca6-47b2-9990-f5de149775cc tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:55:42.729584 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-677ac646-6ca6-47b2-9990-f5de149775cc tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:55:42.730054 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-677ac646-6ca6-47b2-9990-f5de149775cc tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:55:42.883200 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-677ac646-6ca6-47b2-9990-f5de149775cc tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:55:42.891470 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-677ac646-6ca6-47b2-9990-f5de149775cc tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/88471b07-ce65-49f5-86a2-98fd68512252" status: 200 len: 1390 microversion: 2.1 time: 0.175559 Sep 08 11:55:42.900561 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3811/7488] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:55:42 2022] GET /compute/v2.1/servers/88471b07-ce65-49f5-86a2-98fd68512252 => generated 1390 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:55:43.916405 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a3ea0841-c3c6-4063-8835-e006c93f40e7 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:55:43.917061 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a3ea0841-c3c6-4063-8835-e006c93f40e7 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 88471b07-ce65-49f5-86a2-98fd68512252] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:55:43.923284 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a3ea0841-c3c6-4063-8835-e006c93f40e7 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:55:43.923779 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a3ea0841-c3c6-4063-8835-e006c93f40e7 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:55:43.924230 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a3ea0841-c3c6-4063-8835-e006c93f40e7 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:55:43.924957 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a3ea0841-c3c6-4063-8835-e006c93f40e7 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:55:43.925462 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a3ea0841-c3c6-4063-8835-e006c93f40e7 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:55:43.925902 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a3ea0841-c3c6-4063-8835-e006c93f40e7 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:55:44.068964 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a3ea0841-c3c6-4063-8835-e006c93f40e7 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:55:44.077906 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a3ea0841-c3c6-4063-8835-e006c93f40e7 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/88471b07-ce65-49f5-86a2-98fd68512252" status: 200 len: 1390 microversion: 2.1 time: 0.166366 Sep 08 11:55:44.078502 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3678/7489] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:55:43 2022] GET /compute/v2.1/servers/88471b07-ce65-49f5-86a2-98fd68512252 => generated 1390 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:55:44.484377 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-48c19215-5f35-4160-8476-b8bd95a6bde2 req-3d902cf4-4b5c-44e6-9f4b-01787dfa8e66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88471b07-ce65-49f5-86a2-98fd68512252", "name": "network-vif-plugged", "status": "completed", "tag": "cace8d66-c7b3-427c-a77f-c9665722ba59"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:55:44.495343 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-48c19215-5f35-4160-8476-b8bd95a6bde2 req-3d902cf4-4b5c-44e6-9f4b-01787dfa8e66 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:55:44.495828 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-48c19215-5f35-4160-8476-b8bd95a6bde2 req-3d902cf4-4b5c-44e6-9f4b-01787dfa8e66 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:55:44.496281 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-48c19215-5f35-4160-8476-b8bd95a6bde2 req-3d902cf4-4b5c-44e6-9f4b-01787dfa8e66 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:55:44.508543 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-48c19215-5f35-4160-8476-b8bd95a6bde2 req-3d902cf4-4b5c-44e6-9f4b-01787dfa8e66 service nova] Creating event network-vif-plugged:cace8d66-c7b3-427c-a77f-c9665722ba59 for instance 88471b07-ce65-49f5-86a2-98fd68512252 on n-h2-850501-12 Sep 08 11:55:44.513607 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-48c19215-5f35-4160-8476-b8bd95a6bde2 req-3d902cf4-4b5c-44e6-9f4b-01787dfa8e66 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033221 Sep 08 11:55:44.514210 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3812/7490] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:55:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:55:45.102494 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b7cf7483-cab5-4264-86f5-953be25d46d4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:55:45.103125 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b7cf7483-cab5-4264-86f5-953be25d46d4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 88471b07-ce65-49f5-86a2-98fd68512252] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:55:45.110018 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b7cf7483-cab5-4264-86f5-953be25d46d4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:55:45.110551 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b7cf7483-cab5-4264-86f5-953be25d46d4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:55:45.111012 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b7cf7483-cab5-4264-86f5-953be25d46d4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:55:45.111765 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b7cf7483-cab5-4264-86f5-953be25d46d4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:55:45.112244 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b7cf7483-cab5-4264-86f5-953be25d46d4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:55:45.112693 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b7cf7483-cab5-4264-86f5-953be25d46d4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:55:45.248030 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b7cf7483-cab5-4264-86f5-953be25d46d4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:55:45.255791 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b7cf7483-cab5-4264-86f5-953be25d46d4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/88471b07-ce65-49f5-86a2-98fd68512252" status: 200 len: 1390 microversion: 2.1 time: 0.157234 Sep 08 11:55:45.256371 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3679/7491] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:55:45 2022] GET /compute/v2.1/servers/88471b07-ce65-49f5-86a2-98fd68512252 => generated 1390 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:55:46.277210 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:55:46.278373 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=6 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:55:46.282957 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-98ec899c-b5a5-4bdd-92b5-1e6934a642ed tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:55:46.284166 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-98ec899c-b5a5-4bdd-92b5-1e6934a642ed tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 88471b07-ce65-49f5-86a2-98fd68512252] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:55:46.291246 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-98ec899c-b5a5-4bdd-92b5-1e6934a642ed tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:55:46.291736 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-98ec899c-b5a5-4bdd-92b5-1e6934a642ed tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:55:46.292178 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-98ec899c-b5a5-4bdd-92b5-1e6934a642ed tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:55:46.292870 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-98ec899c-b5a5-4bdd-92b5-1e6934a642ed tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:55:46.293352 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-98ec899c-b5a5-4bdd-92b5-1e6934a642ed tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:55:46.293780 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-98ec899c-b5a5-4bdd-92b5-1e6934a642ed tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:55:46.427653 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-98ec899c-b5a5-4bdd-92b5-1e6934a642ed tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:55:46.435435 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-98ec899c-b5a5-4bdd-92b5-1e6934a642ed tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/88471b07-ce65-49f5-86a2-98fd68512252" status: 200 len: 1562 microversion: 2.1 time: 0.160088 Sep 08 11:55:46.436008 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3813/7492] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:55:46 2022] GET /compute/v2.1/servers/88471b07-ce65-49f5-86a2-98fd68512252 => generated 1562 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:55:46.457289 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-70fde661-2206-48b0-bfb0-e59f93ae42a2 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:55:46.457920 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-70fde661-2206-48b0-bfb0-e59f93ae42a2 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 88471b07-ce65-49f5-86a2-98fd68512252] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:55:46.459769 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:55:46.465862 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70fde661-2206-48b0-bfb0-e59f93ae42a2 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:55:46.466359 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70fde661-2206-48b0-bfb0-e59f93ae42a2 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:55:46.466813 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70fde661-2206-48b0-bfb0-e59f93ae42a2 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:55:46.467514 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70fde661-2206-48b0-bfb0-e59f93ae42a2 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:55:46.467984 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70fde661-2206-48b0-bfb0-e59f93ae42a2 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:55:46.468421 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70fde661-2206-48b0-bfb0-e59f93ae42a2 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:55:46.604839 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-70fde661-2206-48b0-bfb0-e59f93ae42a2 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:55:46.612621 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-70fde661-2206-48b0-bfb0-e59f93ae42a2 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/88471b07-ce65-49f5-86a2-98fd68512252" status: 200 len: 1562 microversion: 2.1 time: 0.159387 Sep 08 11:55:46.613222 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3680/7493] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:55:46 2022] GET /compute/v2.1/servers/88471b07-ce65-49f5-86a2-98fd68512252 => generated 1562 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:55:48.210441 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9e37be4a-82c9-4a93-aa66-678cb3b92971 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:55:48.211183 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9e37be4a-82c9-4a93-aa66-678cb3b92971 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 88471b07-ce65-49f5-86a2-98fd68512252] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:55:48.213100 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-e017d82b-0c4a-4757-baa9-396bc867c5f8 req-8ec05adf-6d0c-4e6a-ad2b-e2e7a384d924 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88471b07-ce65-49f5-86a2-98fd68512252", "tag": "cace8d66-c7b3-427c-a77f-c9665722ba59"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:55:48.218530 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e37be4a-82c9-4a93-aa66-678cb3b92971 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:55:48.219104 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e37be4a-82c9-4a93-aa66-678cb3b92971 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:55:48.219821 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e37be4a-82c9-4a93-aa66-678cb3b92971 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:55:48.220597 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e37be4a-82c9-4a93-aa66-678cb3b92971 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:55:48.221917 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e37be4a-82c9-4a93-aa66-678cb3b92971 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:55:48.222633 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e37be4a-82c9-4a93-aa66-678cb3b92971 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:55:48.224643 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e017d82b-0c4a-4757-baa9-396bc867c5f8 req-8ec05adf-6d0c-4e6a-ad2b-e2e7a384d924 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:55:48.225178 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e017d82b-0c4a-4757-baa9-396bc867c5f8 req-8ec05adf-6d0c-4e6a-ad2b-e2e7a384d924 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:55:48.225619 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e017d82b-0c4a-4757-baa9-396bc867c5f8 req-8ec05adf-6d0c-4e6a-ad2b-e2e7a384d924 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:55:48.237573 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-e017d82b-0c4a-4757-baa9-396bc867c5f8 req-8ec05adf-6d0c-4e6a-ad2b-e2e7a384d924 service nova] Creating event network-changed:cace8d66-c7b3-427c-a77f-c9665722ba59 for instance 88471b07-ce65-49f5-86a2-98fd68512252 on n-h2-850501-12 Sep 08 11:55:48.243079 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-e017d82b-0c4a-4757-baa9-396bc867c5f8 req-8ec05adf-6d0c-4e6a-ad2b-e2e7a384d924 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033819 Sep 08 11:55:48.243916 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3681/7494] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:55:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:55:48.461538 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9e37be4a-82c9-4a93-aa66-678cb3b92971 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:55:48.469820 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9e37be4a-82c9-4a93-aa66-678cb3b92971 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/88471b07-ce65-49f5-86a2-98fd68512252" status: 200 len: 1562 microversion: 2.1 time: 0.264176 Sep 08 11:55:48.470410 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3814/7495] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:55:48 2022] GET /compute/v2.1/servers/88471b07-ce65-49f5-86a2-98fd68512252 => generated 1562 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:56:13.724337 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4f725e48-1fa8-4c29-9fc9-96f421df1121 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:56:13.727351 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4f725e48-1fa8-4c29-9fc9-96f421df1121 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 88471b07-ce65-49f5-86a2-98fd68512252] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:56:13.729840 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=13 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:56:13.730518 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=38 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:56:13.736975 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f725e48-1fa8-4c29-9fc9-96f421df1121 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:56:13.737513 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f725e48-1fa8-4c29-9fc9-96f421df1121 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:56:13.737968 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f725e48-1fa8-4c29-9fc9-96f421df1121 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:56:13.738694 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f725e48-1fa8-4c29-9fc9-96f421df1121 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:56:13.739425 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f725e48-1fa8-4c29-9fc9-96f421df1121 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:56:13.739865 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f725e48-1fa8-4c29-9fc9-96f421df1121 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:56:13.798578 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4f725e48-1fa8-4c29-9fc9-96f421df1121 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "POST /compute/v2.1/servers/88471b07-ce65-49f5-86a2-98fd68512252/action" status: 200 len: 24576 microversion: 2.1 time: 0.078342 Sep 08 11:56:13.799237 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3682/7496] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 11:56:13 2022] POST /compute/v2.1/servers/88471b07-ce65-49f5-86a2-98fd68512252/action => generated 24576 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 11:56:24.790068 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8a62fb4f-58a9-45e5-b5d8-efdda57ce656 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:56:24.790671 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8a62fb4f-58a9-45e5-b5d8-efdda57ce656 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 88471b07-ce65-49f5-86a2-98fd68512252] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:56:24.792992 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:56:24.793687 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=36 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:56:24.800339 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8a62fb4f-58a9-45e5-b5d8-efdda57ce656 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:56:24.800839 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8a62fb4f-58a9-45e5-b5d8-efdda57ce656 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:56:24.801307 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8a62fb4f-58a9-45e5-b5d8-efdda57ce656 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:56:24.802009 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8a62fb4f-58a9-45e5-b5d8-efdda57ce656 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:56:24.803088 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8a62fb4f-58a9-45e5-b5d8-efdda57ce656 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:56:24.803524 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8a62fb4f-58a9-45e5-b5d8-efdda57ce656 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:56:24.873394 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8a62fb4f-58a9-45e5-b5d8-efdda57ce656 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "POST /compute/v2.1/servers/88471b07-ce65-49f5-86a2-98fd68512252/action" status: 202 len: 0 microversion: 2.1 time: 0.087674 Sep 08 11:56:24.874021 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3815/7497] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 11:56:24 2022] POST /compute/v2.1/servers/88471b07-ce65-49f5-86a2-98fd68512252/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:56:24.883065 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b4bbd425-bc7e-40a2-97f9-8510876e9105 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:56:24.883786 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b4bbd425-bc7e-40a2-97f9-8510876e9105 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 88471b07-ce65-49f5-86a2-98fd68512252] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:56:24.887501 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:56:24.888336 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=4 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:56:24.893358 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4bbd425-bc7e-40a2-97f9-8510876e9105 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:56:24.894342 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4bbd425-bc7e-40a2-97f9-8510876e9105 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:56:24.894598 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4bbd425-bc7e-40a2-97f9-8510876e9105 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:56:24.895510 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4bbd425-bc7e-40a2-97f9-8510876e9105 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:56:24.896029 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4bbd425-bc7e-40a2-97f9-8510876e9105 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:56:24.896669 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4bbd425-bc7e-40a2-97f9-8510876e9105 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:56:25.041791 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b4bbd425-bc7e-40a2-97f9-8510876e9105 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:56:25.049488 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b4bbd425-bc7e-40a2-97f9-8510876e9105 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/88471b07-ce65-49f5-86a2-98fd68512252" status: 200 len: 1686 microversion: 2.1 time: 0.171086 Sep 08 11:56:25.050065 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3683/7498] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:56:24 2022] GET /compute/v2.1/servers/88471b07-ce65-49f5-86a2-98fd68512252 => generated 1686 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:56:26.076505 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-38c17c59-7622-43a7-9e04-25aed32e6f00 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:56:26.077268 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-38c17c59-7622-43a7-9e04-25aed32e6f00 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 88471b07-ce65-49f5-86a2-98fd68512252] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:56:26.083438 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-38c17c59-7622-43a7-9e04-25aed32e6f00 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:56:26.083924 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-38c17c59-7622-43a7-9e04-25aed32e6f00 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:56:26.084364 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-38c17c59-7622-43a7-9e04-25aed32e6f00 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:56:26.085072 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-38c17c59-7622-43a7-9e04-25aed32e6f00 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:56:26.085533 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-38c17c59-7622-43a7-9e04-25aed32e6f00 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:56:26.085957 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-38c17c59-7622-43a7-9e04-25aed32e6f00 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:56:26.224823 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-38c17c59-7622-43a7-9e04-25aed32e6f00 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:56:26.232801 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-38c17c59-7622-43a7-9e04-25aed32e6f00 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/88471b07-ce65-49f5-86a2-98fd68512252" status: 200 len: 1666 microversion: 2.1 time: 0.161785 Sep 08 11:56:26.233397 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3816/7499] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:56:26 2022] GET /compute/v2.1/servers/88471b07-ce65-49f5-86a2-98fd68512252 => generated 1666 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:56:27.327344 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-66b991ed-e92c-4e05-aca0-2a5016d0ebf4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:56:27.329578 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-66b991ed-e92c-4e05-aca0-2a5016d0ebf4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 88471b07-ce65-49f5-86a2-98fd68512252] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:56:27.337777 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-66b991ed-e92c-4e05-aca0-2a5016d0ebf4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:56:27.338278 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-66b991ed-e92c-4e05-aca0-2a5016d0ebf4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:56:27.338730 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-66b991ed-e92c-4e05-aca0-2a5016d0ebf4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:56:27.339441 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-66b991ed-e92c-4e05-aca0-2a5016d0ebf4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:56:27.339908 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-66b991ed-e92c-4e05-aca0-2a5016d0ebf4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:56:27.340346 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-66b991ed-e92c-4e05-aca0-2a5016d0ebf4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:56:27.404731 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-66b991ed-e92c-4e05-aca0-2a5016d0ebf4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "POST /compute/v2.1/servers/88471b07-ce65-49f5-86a2-98fd68512252/action" status: 200 len: 32649 microversion: 2.1 time: 0.081231 Sep 08 11:56:27.405413 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3684/7500] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 11:56:27 2022] POST /compute/v2.1/servers/88471b07-ce65-49f5-86a2-98fd68512252/action => generated 32649 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 11:56:27.417435 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-868ceddd-6ef5-4f09-89a1-be7866e801d9 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:56:27.417984 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-868ceddd-6ef5-4f09-89a1-be7866e801d9 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 88471b07-ce65-49f5-86a2-98fd68512252] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:56:27.424856 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-868ceddd-6ef5-4f09-89a1-be7866e801d9 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:56:27.425392 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-868ceddd-6ef5-4f09-89a1-be7866e801d9 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:56:27.425838 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-868ceddd-6ef5-4f09-89a1-be7866e801d9 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:56:27.426542 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-868ceddd-6ef5-4f09-89a1-be7866e801d9 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:56:27.427010 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-868ceddd-6ef5-4f09-89a1-be7866e801d9 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:56:27.427939 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-868ceddd-6ef5-4f09-89a1-be7866e801d9 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:56:27.498138 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-868ceddd-6ef5-4f09-89a1-be7866e801d9 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "POST /compute/v2.1/servers/88471b07-ce65-49f5-86a2-98fd68512252/action" status: 202 len: 0 microversion: 2.1 time: 0.084651 Sep 08 11:56:27.498798 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3817/7501] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 11:56:27 2022] POST /compute/v2.1/servers/88471b07-ce65-49f5-86a2-98fd68512252/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:56:27.509284 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-12cc345c-ea8c-4305-a917-721e347a8d63 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:56:27.510014 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-12cc345c-ea8c-4305-a917-721e347a8d63 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 88471b07-ce65-49f5-86a2-98fd68512252] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:56:27.518663 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12cc345c-ea8c-4305-a917-721e347a8d63 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:56:27.519182 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12cc345c-ea8c-4305-a917-721e347a8d63 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:56:27.519996 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12cc345c-ea8c-4305-a917-721e347a8d63 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:56:27.520731 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12cc345c-ea8c-4305-a917-721e347a8d63 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:56:27.521287 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12cc345c-ea8c-4305-a917-721e347a8d63 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:56:27.522091 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12cc345c-ea8c-4305-a917-721e347a8d63 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:56:27.662242 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-12cc345c-ea8c-4305-a917-721e347a8d63 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:56:27.671598 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-12cc345c-ea8c-4305-a917-721e347a8d63 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/88471b07-ce65-49f5-86a2-98fd68512252" status: 200 len: 1673 microversion: 2.1 time: 0.168048 Sep 08 11:56:27.672874 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3685/7502] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:56:27 2022] GET /compute/v2.1/servers/88471b07-ce65-49f5-86a2-98fd68512252 => generated 1673 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:56:28.699144 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-47fc1fc8-fa11-45be-a8f0-0a9ffa6f33a5 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:56:28.699857 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-47fc1fc8-fa11-45be-a8f0-0a9ffa6f33a5 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 88471b07-ce65-49f5-86a2-98fd68512252] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:56:28.706093 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-47fc1fc8-fa11-45be-a8f0-0a9ffa6f33a5 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:56:28.706585 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-47fc1fc8-fa11-45be-a8f0-0a9ffa6f33a5 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:56:28.707028 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-47fc1fc8-fa11-45be-a8f0-0a9ffa6f33a5 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:56:28.707725 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-47fc1fc8-fa11-45be-a8f0-0a9ffa6f33a5 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:56:28.708185 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-47fc1fc8-fa11-45be-a8f0-0a9ffa6f33a5 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:56:28.709673 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-47fc1fc8-fa11-45be-a8f0-0a9ffa6f33a5 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:56:28.844864 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-47fc1fc8-fa11-45be-a8f0-0a9ffa6f33a5 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:56:28.852994 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-47fc1fc8-fa11-45be-a8f0-0a9ffa6f33a5 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/88471b07-ce65-49f5-86a2-98fd68512252" status: 200 len: 1681 microversion: 2.1 time: 0.159778 Sep 08 11:56:28.853596 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3818/7503] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:56:28 2022] GET /compute/v2.1/servers/88471b07-ce65-49f5-86a2-98fd68512252 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:56:28.951083 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1881c2d4-0d19-4f4a-a81c-a68cbbf05ddc tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:56:28.953328 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1881c2d4-0d19-4f4a-a81c-a68cbbf05ddc tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 88471b07-ce65-49f5-86a2-98fd68512252] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:56:28.960990 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1881c2d4-0d19-4f4a-a81c-a68cbbf05ddc tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:56:28.961514 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1881c2d4-0d19-4f4a-a81c-a68cbbf05ddc tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:56:28.961962 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1881c2d4-0d19-4f4a-a81c-a68cbbf05ddc tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:56:28.962670 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1881c2d4-0d19-4f4a-a81c-a68cbbf05ddc tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:56:28.963135 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1881c2d4-0d19-4f4a-a81c-a68cbbf05ddc tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:56:28.963573 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1881c2d4-0d19-4f4a-a81c-a68cbbf05ddc tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:56:29.024072 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1881c2d4-0d19-4f4a-a81c-a68cbbf05ddc tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "POST /compute/v2.1/servers/88471b07-ce65-49f5-86a2-98fd68512252/action" status: 200 len: 38443 microversion: 2.1 time: 0.077127 Sep 08 11:56:29.024796 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3686/7504] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 11:56:28 2022] POST /compute/v2.1/servers/88471b07-ce65-49f5-86a2-98fd68512252/action => generated 38443 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 11:56:30.018240 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-014f8384-f8b3-4807-a185-80cb8b25fd9d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:56:30.018993 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-014f8384-f8b3-4807-a185-80cb8b25fd9d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 88471b07-ce65-49f5-86a2-98fd68512252] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:56:30.020393 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-c28641d4-0271-4c64-855b-746b930b15b1 req-87c12c52-0082-44ea-a160-758319652fe7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88471b07-ce65-49f5-86a2-98fd68512252", "tag": "cace8d66-c7b3-427c-a77f-c9665722ba59"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:56:30.027422 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-014f8384-f8b3-4807-a185-80cb8b25fd9d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:56:30.028264 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-014f8384-f8b3-4807-a185-80cb8b25fd9d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:56:30.028779 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-014f8384-f8b3-4807-a185-80cb8b25fd9d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:56:30.029755 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-014f8384-f8b3-4807-a185-80cb8b25fd9d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:56:30.030293 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-014f8384-f8b3-4807-a185-80cb8b25fd9d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:56:30.030796 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-014f8384-f8b3-4807-a185-80cb8b25fd9d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:56:30.032574 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c28641d4-0271-4c64-855b-746b930b15b1 req-87c12c52-0082-44ea-a160-758319652fe7 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:56:30.033099 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c28641d4-0271-4c64-855b-746b930b15b1 req-87c12c52-0082-44ea-a160-758319652fe7 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:56:30.033760 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c28641d4-0271-4c64-855b-746b930b15b1 req-87c12c52-0082-44ea-a160-758319652fe7 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:56:30.046171 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-c28641d4-0271-4c64-855b-746b930b15b1 req-87c12c52-0082-44ea-a160-758319652fe7 service nova] Creating event network-changed:cace8d66-c7b3-427c-a77f-c9665722ba59 for instance 88471b07-ce65-49f5-86a2-98fd68512252 on n-h2-850501-12 Sep 08 11:56:30.052088 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-c28641d4-0271-4c64-855b-746b930b15b1 req-87c12c52-0082-44ea-a160-758319652fe7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035800 Sep 08 11:56:30.053344 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3687/7505] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:56:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:56:30.058392 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-014f8384-f8b3-4807-a185-80cb8b25fd9d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 88471b07-ce65-49f5-86a2-98fd68512252] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:56:30.155844 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-014f8384-f8b3-4807-a185-80cb8b25fd9d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "DELETE /compute/v2.1/servers/88471b07-ce65-49f5-86a2-98fd68512252" status: 204 len: 0 microversion: 2.1 time: 0.141618 Sep 08 11:56:30.156457 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3819/7506] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:56:30 2022] DELETE /compute/v2.1/servers/88471b07-ce65-49f5-86a2-98fd68512252 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:56:30.168094 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9c91d2bb-d82b-42f1-ac0f-8a48dd786293 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:56:30.169111 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9c91d2bb-d82b-42f1-ac0f-8a48dd786293 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 88471b07-ce65-49f5-86a2-98fd68512252] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:56:30.177654 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9c91d2bb-d82b-42f1-ac0f-8a48dd786293 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:56:30.178083 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9c91d2bb-d82b-42f1-ac0f-8a48dd786293 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:56:30.178735 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9c91d2bb-d82b-42f1-ac0f-8a48dd786293 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:56:30.179570 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9c91d2bb-d82b-42f1-ac0f-8a48dd786293 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:56:30.180232 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9c91d2bb-d82b-42f1-ac0f-8a48dd786293 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:56:30.180946 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9c91d2bb-d82b-42f1-ac0f-8a48dd786293 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:56:30.324865 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9c91d2bb-d82b-42f1-ac0f-8a48dd786293 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:56:30.332790 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9c91d2bb-d82b-42f1-ac0f-8a48dd786293 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/88471b07-ce65-49f5-86a2-98fd68512252" status: 200 len: 1687 microversion: 2.1 time: 0.171138 Sep 08 11:56:30.333479 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3688/7507] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:56:30 2022] GET /compute/v2.1/servers/88471b07-ce65-49f5-86a2-98fd68512252 => generated 1687 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:56:31.358169 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5bdd77d0-168c-4518-82ce-0a6d975a0bb4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:56:31.358972 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5bdd77d0-168c-4518-82ce-0a6d975a0bb4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 88471b07-ce65-49f5-86a2-98fd68512252] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:56:31.366705 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5bdd77d0-168c-4518-82ce-0a6d975a0bb4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:56:31.367201 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5bdd77d0-168c-4518-82ce-0a6d975a0bb4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:56:31.367654 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5bdd77d0-168c-4518-82ce-0a6d975a0bb4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:56:31.368367 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5bdd77d0-168c-4518-82ce-0a6d975a0bb4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:56:31.368835 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5bdd77d0-168c-4518-82ce-0a6d975a0bb4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:56:31.369304 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5bdd77d0-168c-4518-82ce-0a6d975a0bb4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:56:31.503536 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5bdd77d0-168c-4518-82ce-0a6d975a0bb4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:56:31.511558 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5bdd77d0-168c-4518-82ce-0a6d975a0bb4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/88471b07-ce65-49f5-86a2-98fd68512252" status: 200 len: 1687 microversion: 2.1 time: 0.157789 Sep 08 11:56:31.512136 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3820/7508] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:56:31 2022] GET /compute/v2.1/servers/88471b07-ce65-49f5-86a2-98fd68512252 => generated 1687 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:56:32.534852 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1089135c-aeac-4e3e-9e02-9fe40dda6869 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:56:32.535592 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1089135c-aeac-4e3e-9e02-9fe40dda6869 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 88471b07-ce65-49f5-86a2-98fd68512252] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:56:32.543356 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1089135c-aeac-4e3e-9e02-9fe40dda6869 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:56:32.543863 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1089135c-aeac-4e3e-9e02-9fe40dda6869 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:56:32.544315 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1089135c-aeac-4e3e-9e02-9fe40dda6869 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:56:32.545063 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1089135c-aeac-4e3e-9e02-9fe40dda6869 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:56:32.545533 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1089135c-aeac-4e3e-9e02-9fe40dda6869 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:56:32.545972 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1089135c-aeac-4e3e-9e02-9fe40dda6869 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:56:32.759253 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1089135c-aeac-4e3e-9e02-9fe40dda6869 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:56:32.767203 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1089135c-aeac-4e3e-9e02-9fe40dda6869 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/88471b07-ce65-49f5-86a2-98fd68512252" status: 200 len: 1501 microversion: 2.1 time: 0.236244 Sep 08 11:56:32.767858 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3689/7509] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:56:32 2022] GET /compute/v2.1/servers/88471b07-ce65-49f5-86a2-98fd68512252 => generated 1501 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:56:32.794829 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-76d3cfb6-b8b2-4cb5-a294-5fa8aab28aa5 req-f2e26b23-2ff0-4f40-af6f-8f17339e0709 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88471b07-ce65-49f5-86a2-98fd68512252", "name": "network-vif-deleted", "tag": "cace8d66-c7b3-427c-a77f-c9665722ba59"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:56:32.806011 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-76d3cfb6-b8b2-4cb5-a294-5fa8aab28aa5 req-f2e26b23-2ff0-4f40-af6f-8f17339e0709 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:56:32.806854 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-76d3cfb6-b8b2-4cb5-a294-5fa8aab28aa5 req-f2e26b23-2ff0-4f40-af6f-8f17339e0709 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:56:32.807295 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-76d3cfb6-b8b2-4cb5-a294-5fa8aab28aa5 req-f2e26b23-2ff0-4f40-af6f-8f17339e0709 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:56:32.820094 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-76d3cfb6-b8b2-4cb5-a294-5fa8aab28aa5 req-f2e26b23-2ff0-4f40-af6f-8f17339e0709 service nova] Creating event network-vif-deleted:cace8d66-c7b3-427c-a77f-c9665722ba59 for instance 88471b07-ce65-49f5-86a2-98fd68512252 on n-h2-850501-12 Sep 08 11:56:32.825689 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-76d3cfb6-b8b2-4cb5-a294-5fa8aab28aa5 req-f2e26b23-2ff0-4f40-af6f-8f17339e0709 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034508 Sep 08 11:56:32.826317 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3821/7510] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:56:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:56:33.792168 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-902f15cd-1bf1-4794-9b71-19855da313e9 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:56:33.792716 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-902f15cd-1bf1-4794-9b71-19855da313e9 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 88471b07-ce65-49f5-86a2-98fd68512252] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:56:33.799563 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-902f15cd-1bf1-4794-9b71-19855da313e9 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:56:33.800065 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-902f15cd-1bf1-4794-9b71-19855da313e9 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:56:33.800520 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-902f15cd-1bf1-4794-9b71-19855da313e9 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:56:33.801340 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-902f15cd-1bf1-4794-9b71-19855da313e9 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:56:33.801818 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-902f15cd-1bf1-4794-9b71-19855da313e9 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:56:33.802985 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-902f15cd-1bf1-4794-9b71-19855da313e9 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:56:33.816564 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-902f15cd-1bf1-4794-9b71-19855da313e9 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] HTTP exception thrown: Instance 88471b07-ce65-49f5-86a2-98fd68512252 could not be found. Sep 08 11:56:33.818519 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-902f15cd-1bf1-4794-9b71-19855da313e9 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Request method failure captured: Sep 08 11:56:33.818519 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/88471b07-ce65-49f5-86a2-98fd68512252 HTTP/1.1 Sep 08 11:56:33.818519 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 11:56:33.818519 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 11:56:33.818519 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 11:56:33.818519 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 11:56:33.818519 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 11:56:33.818519 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 11:56:33.818519 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 11:56:33.818519 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 11:56:33.818519 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGdgwe3QmhiGsoiILM5bGeIE-EHzsnjM6KQuMFsKvCXbg967J71JinBeGFRd1mku6-Z-m4JQ9yWbqYK6Z1MSuErSUTO54qKxQVH-rPnvuL8XP6AL5ODpR7jo94wp_BdEp1m68Loc1_k9cMRb5G6-FLWWIE65rAilwZFS7jxy1f7IqtpQ Sep 08 11:56:33.818519 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 11:56:33.818519 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 11:56:33.818519 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 11:56:33.818519 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 11:56:33.818519 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 11:56:33.818519 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 11:56:33.818519 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: f00a6070707c4334b4beb7d530b15814 Sep 08 11:56:33.818519 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1687454490 Sep 08 11:56:33.818519 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 11:56:33.818519 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 11:56:33.818519 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f00a6070707c4334b4beb7d530b15814"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f00a6070707c4334b4beb7d530b15814"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f00a6070707c4334b4beb7d530b15814"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f00a6070707c4334b4beb7d530b15814"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:56:33.818519 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1687454490 Sep 08 11:56:33.818519 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: f00a6070707c4334b4beb7d530b15814 Sep 08 11:56:33.818519 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1687454490 Sep 08 11:56:33.818519 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-TestNetworkAdvancedServerOps-1687454490-project Sep 08 11:56:33.818519 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 11:56:33.818519 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 11:56:33.818519 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 4a16b57190c243a5b78e7717eb4a016b Sep 08 11:56:33.818519 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1687454490-project Sep 08 11:56:33.818519 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 11:56:33.818519 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 88471b07-ce65-49f5-86a2-98fd68512252 could not be found. Sep 08 11:56:33.818519 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '88471b07-ce65-49f5-86a2-98fd68512252'} Sep 08 11:56:33.818519 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:56:33.818519 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:56:33.818519 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:56:33.818519 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:56:33.818519 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:56:33.818519 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:56:33.818519 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:56:33.818519 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:56:33.818519 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:56:33.818519 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:56:33.818519 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88471b07-ce65-49f5-86a2-98fd68512252 could not be found. Sep 08 11:56:33.818519 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:56:33.818519 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:56:33.818519 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:56:33.818519 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:56:33.818519 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:56:33.818519 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:56:33.818519 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:56:33.818519 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:56:33.818519 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:56:33.818519 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:56:33.818519 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:56:33.818519 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:56:33.818519 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:56:33.818519 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:56:33.818519 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:56:33.818519 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:56:33.818519 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88471b07-ce65-49f5-86a2-98fd68512252 could not be found. Sep 08 11:56:33.818519 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:56:33.818519 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:56:33.823137 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:56:33.823137 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:56:33.823137 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:56:33.823137 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:56:33.823137 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:56:33.823137 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:56:33.823137 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88471b07-ce65-49f5-86a2-98fd68512252 could not be found. Sep 08 11:56:33.823137 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:56:33.823137 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-902f15cd-1bf1-4794-9b71-19855da313e9 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Returning 404 to user: Instance 88471b07-ce65-49f5-86a2-98fd68512252 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:56:33.823137 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-902f15cd-1bf1-4794-9b71-19855da313e9 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/88471b07-ce65-49f5-86a2-98fd68512252" status: 404 len: 111 microversion: 2.1 time: 0.031902 Sep 08 11:56:33.823137 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3690/7511] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:56:33 2022] GET /compute/v2.1/servers/88471b07-ce65-49f5-86a2-98fd68512252 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:56:37.201391 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ae5b4363-a459-44eb-924f-4760a96bc69e tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '.version_select at 0x7f68df4e4160>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:56:37.235327 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ae5b4363-a459-44eb-924f-4760a96bc69e tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-300798508" status: 202 len: 0 microversion: 2.1 time: 0.039336 Sep 08 11:56:37.235933 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3822/7512] 10.222.0.27 () {58 vars in 1281 bytes} [Thu Sep 8 11:56:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-300798508 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:56:37.262692 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-00245a96-e328-4cfa-931e-c5471a129666 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Action: 'create', calling method: .version_select at 0x7f68e41a9ee0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1802414351", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM0RePZ9Tjh88g0Sj6Dp/cedOfRlIXs54pEDeZiP0zg552KRZuf8VKl1fEX/VWSR7VaP7BT4nDaBMAI8YoOI7CSX+dYa9JxcCnjwK00L5hN0MEFH6IrOwBm5Y/eoYzEdrg=="}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:56:37.282241 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-00245a96-e328-4cfa-931e-c5471a129666 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Getting quotas for project f00a6070707c4334b4beb7d530b15814. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:56:37.288099 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-00245a96-e328-4cfa-931e-c5471a129666 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Getting quotas for user 4a16b57190c243a5b78e7717eb4a016b and project f00a6070707c4334b4beb7d530b15814. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:56:37.313317 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-00245a96-e328-4cfa-931e-c5471a129666 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.054519 Sep 08 11:56:37.313930 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3691/7513] 10.222.0.27 () {60 vars in 1159 bytes} [Thu Sep 8 11:56:37 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:56:43.057488 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-163eedf1-d41e-4056-a818-ab9875de47c9 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2079244286", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "6fc071ef-1567-4c7c-86f6-8d98ed460365"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1802414351", "security_groups": [{"name": "tempest-secgroup-smoke-1321326488"}]}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:56:43.074619 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:56:43.199060 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-163eedf1-d41e-4056-a818-ab9875de47c9 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] validate_networks() for [('6fc071ef-1567-4c7c-86f6-8d98ed460365', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:56:43.641965 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-163eedf1-d41e-4056-a818-ab9875de47c9 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:56:43.642398 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-163eedf1-d41e-4056-a818-ab9875de47c9 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:56:43.643119 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-163eedf1-d41e-4056-a818-ab9875de47c9 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:56:43.644035 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-163eedf1-d41e-4056-a818-ab9875de47c9 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:56:43.644462 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-163eedf1-d41e-4056-a818-ab9875de47c9 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:56:43.653919 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-163eedf1-d41e-4056-a818-ab9875de47c9 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:56:43.654414 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-163eedf1-d41e-4056-a818-ab9875de47c9 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:56:43.654857 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-163eedf1-d41e-4056-a818-ab9875de47c9 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:56:43.655596 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-163eedf1-d41e-4056-a818-ab9875de47c9 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:56:43.656060 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-163eedf1-d41e-4056-a818-ab9875de47c9 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:56:43.656512 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-163eedf1-d41e-4056-a818-ab9875de47c9 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:56:43.675072 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-163eedf1-d41e-4056-a818-ab9875de47c9 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Getting quotas for project f00a6070707c4334b4beb7d530b15814. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:56:43.681376 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-163eedf1-d41e-4056-a818-ab9875de47c9 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Getting quotas for user 4a16b57190c243a5b78e7717eb4a016b and project f00a6070707c4334b4beb7d530b15814. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:56:43.694569 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-163eedf1-d41e-4056-a818-ab9875de47c9 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:56:43.697119 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-163eedf1-d41e-4056-a818-ab9875de47c9 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 44bc75aa-0b86-4f08-8202-b9036e767a81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:56:43.746403 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-163eedf1-d41e-4056-a818-ab9875de47c9 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.694811 Sep 08 11:56:43.746785 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3823/7514] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 11:56:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 696 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:56:43.759692 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2586be35-f9b2-419a-bda6-d6a12ec847e3 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:56:43.762090 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2586be35-f9b2-419a-bda6-d6a12ec847e3 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 44bc75aa-0b86-4f08-8202-b9036e767a81] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:56:43.808697 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=36 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:56:43.824648 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2586be35-f9b2-419a-bda6-d6a12ec847e3 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:56:43.832737 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2586be35-f9b2-419a-bda6-d6a12ec847e3 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/44bc75aa-0b86-4f08-8202-b9036e767a81" status: 200 len: 1267 microversion: 2.1 time: 0.078466 Sep 08 11:56:43.834730 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3692/7515] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:56:43 2022] GET /compute/v2.1/servers/44bc75aa-0b86-4f08-8202-b9036e767a81 => generated 1267 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:56:44.858761 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a2df76e9-a9b6-46ce-98a9-7b4199f747b3 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:56:44.859386 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a2df76e9-a9b6-46ce-98a9-7b4199f747b3 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 44bc75aa-0b86-4f08-8202-b9036e767a81] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:56:44.867080 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a2df76e9-a9b6-46ce-98a9-7b4199f747b3 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:56:44.867823 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a2df76e9-a9b6-46ce-98a9-7b4199f747b3 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:56:44.868062 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a2df76e9-a9b6-46ce-98a9-7b4199f747b3 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:56:44.869469 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a2df76e9-a9b6-46ce-98a9-7b4199f747b3 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:56:44.869949 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a2df76e9-a9b6-46ce-98a9-7b4199f747b3 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:56:44.870390 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a2df76e9-a9b6-46ce-98a9-7b4199f747b3 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:56:45.008473 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a2df76e9-a9b6-46ce-98a9-7b4199f747b3 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:56:45.017472 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a2df76e9-a9b6-46ce-98a9-7b4199f747b3 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/44bc75aa-0b86-4f08-8202-b9036e767a81" status: 200 len: 1319 microversion: 2.1 time: 0.163419 Sep 08 11:56:45.018092 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3824/7516] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:56:44 2022] GET /compute/v2.1/servers/44bc75aa-0b86-4f08-8202-b9036e767a81 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:56:46.042899 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-11e1517f-0eaa-4799-86ca-e758b812eae3 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:56:46.043642 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-11e1517f-0eaa-4799-86ca-e758b812eae3 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 44bc75aa-0b86-4f08-8202-b9036e767a81] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:56:46.051540 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-11e1517f-0eaa-4799-86ca-e758b812eae3 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:56:46.052881 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-11e1517f-0eaa-4799-86ca-e758b812eae3 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:56:46.053605 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-11e1517f-0eaa-4799-86ca-e758b812eae3 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:56:46.054522 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-11e1517f-0eaa-4799-86ca-e758b812eae3 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:56:46.055192 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-11e1517f-0eaa-4799-86ca-e758b812eae3 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:56:46.055638 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-11e1517f-0eaa-4799-86ca-e758b812eae3 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:56:46.206666 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-11e1517f-0eaa-4799-86ca-e758b812eae3 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:56:46.215670 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-11e1517f-0eaa-4799-86ca-e758b812eae3 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/44bc75aa-0b86-4f08-8202-b9036e767a81" status: 200 len: 1393 microversion: 2.1 time: 0.176651 Sep 08 11:56:46.219394 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3693/7517] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:56:46 2022] GET /compute/v2.1/servers/44bc75aa-0b86-4f08-8202-b9036e767a81 => generated 1393 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:56:46.944618 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-e5940858-c909-47b2-a095-3ea4559e45da req-34739905-97d8-41a1-bc5f-836e7d5cb583 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44bc75aa-0b86-4f08-8202-b9036e767a81", "tag": "921e81d8-d1a0-47ad-929f-b01fd11364eb"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:56:46.957266 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-e5940858-c909-47b2-a095-3ea4559e45da req-34739905-97d8-41a1-bc5f-836e7d5cb583 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:56:46.958782 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-e5940858-c909-47b2-a095-3ea4559e45da req-34739905-97d8-41a1-bc5f-836e7d5cb583 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:56:46.959497 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-e5940858-c909-47b2-a095-3ea4559e45da req-34739905-97d8-41a1-bc5f-836e7d5cb583 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:56:46.971978 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-e5940858-c909-47b2-a095-3ea4559e45da req-34739905-97d8-41a1-bc5f-836e7d5cb583 service nova] Creating event network-changed:921e81d8-d1a0-47ad-929f-b01fd11364eb for instance 44bc75aa-0b86-4f08-8202-b9036e767a81 on n-h1-850501-12 Sep 08 11:56:46.978099 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-e5940858-c909-47b2-a095-3ea4559e45da req-34739905-97d8-41a1-bc5f-836e7d5cb583 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038196 Sep 08 11:56:46.979232 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3825/7518] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:56:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:56:47.240056 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a14b3a6b-4905-406b-a9f4-9449c977fa49 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:56:47.240721 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a14b3a6b-4905-406b-a9f4-9449c977fa49 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 44bc75aa-0b86-4f08-8202-b9036e767a81] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:56:47.248306 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a14b3a6b-4905-406b-a9f4-9449c977fa49 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:56:47.248828 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a14b3a6b-4905-406b-a9f4-9449c977fa49 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:56:47.249301 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a14b3a6b-4905-406b-a9f4-9449c977fa49 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:56:47.250096 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a14b3a6b-4905-406b-a9f4-9449c977fa49 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:56:47.250562 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a14b3a6b-4905-406b-a9f4-9449c977fa49 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:56:47.250999 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a14b3a6b-4905-406b-a9f4-9449c977fa49 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:56:47.461846 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a14b3a6b-4905-406b-a9f4-9449c977fa49 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:56:47.469934 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a14b3a6b-4905-406b-a9f4-9449c977fa49 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/44bc75aa-0b86-4f08-8202-b9036e767a81" status: 200 len: 1393 microversion: 2.1 time: 0.234535 Sep 08 11:56:47.470614 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3694/7519] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:56:47 2022] GET /compute/v2.1/servers/44bc75aa-0b86-4f08-8202-b9036e767a81 => generated 1393 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:56:48.493890 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fa9071bd-29a0-4845-83b1-f365aa0cb3e3 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:56:48.494673 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fa9071bd-29a0-4845-83b1-f365aa0cb3e3 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 44bc75aa-0b86-4f08-8202-b9036e767a81] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:56:48.502412 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fa9071bd-29a0-4845-83b1-f365aa0cb3e3 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:56:48.502915 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fa9071bd-29a0-4845-83b1-f365aa0cb3e3 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:56:48.503361 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fa9071bd-29a0-4845-83b1-f365aa0cb3e3 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:56:48.504073 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fa9071bd-29a0-4845-83b1-f365aa0cb3e3 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:56:48.504543 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fa9071bd-29a0-4845-83b1-f365aa0cb3e3 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:56:48.505062 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fa9071bd-29a0-4845-83b1-f365aa0cb3e3 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:56:48.787172 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-fa9071bd-29a0-4845-83b1-f365aa0cb3e3 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:56:48.795362 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fa9071bd-29a0-4845-83b1-f365aa0cb3e3 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/44bc75aa-0b86-4f08-8202-b9036e767a81" status: 200 len: 1393 microversion: 2.1 time: 0.306454 Sep 08 11:56:48.796292 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3826/7520] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:56:48 2022] GET /compute/v2.1/servers/44bc75aa-0b86-4f08-8202-b9036e767a81 => generated 1393 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:56:49.819284 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b3020162-7cd9-4de3-815c-a294a9560557 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:56:49.819917 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b3020162-7cd9-4de3-815c-a294a9560557 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 44bc75aa-0b86-4f08-8202-b9036e767a81] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:56:49.826897 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3020162-7cd9-4de3-815c-a294a9560557 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:56:49.827405 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3020162-7cd9-4de3-815c-a294a9560557 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:56:49.827857 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3020162-7cd9-4de3-815c-a294a9560557 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:56:49.828568 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3020162-7cd9-4de3-815c-a294a9560557 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:56:49.829056 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3020162-7cd9-4de3-815c-a294a9560557 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:56:49.829503 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3020162-7cd9-4de3-815c-a294a9560557 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:56:49.968166 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b3020162-7cd9-4de3-815c-a294a9560557 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:56:49.977377 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b3020162-7cd9-4de3-815c-a294a9560557 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/44bc75aa-0b86-4f08-8202-b9036e767a81" status: 200 len: 1393 microversion: 2.1 time: 0.162018 Sep 08 11:56:49.977975 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3695/7521] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:56:49 2022] GET /compute/v2.1/servers/44bc75aa-0b86-4f08-8202-b9036e767a81 => generated 1393 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:56:51.000588 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-23d6530b-c9eb-4c9d-bc1f-9b7459086591 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:56:51.001216 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-23d6530b-c9eb-4c9d-bc1f-9b7459086591 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 44bc75aa-0b86-4f08-8202-b9036e767a81] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:56:51.008780 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-23d6530b-c9eb-4c9d-bc1f-9b7459086591 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:56:51.009397 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-23d6530b-c9eb-4c9d-bc1f-9b7459086591 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:56:51.009834 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-23d6530b-c9eb-4c9d-bc1f-9b7459086591 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:56:51.010652 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-23d6530b-c9eb-4c9d-bc1f-9b7459086591 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:56:51.010994 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-23d6530b-c9eb-4c9d-bc1f-9b7459086591 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:56:51.011418 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-23d6530b-c9eb-4c9d-bc1f-9b7459086591 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:56:51.150567 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-23d6530b-c9eb-4c9d-bc1f-9b7459086591 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:56:51.158522 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-23d6530b-c9eb-4c9d-bc1f-9b7459086591 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/44bc75aa-0b86-4f08-8202-b9036e767a81" status: 200 len: 1393 microversion: 2.1 time: 0.161952 Sep 08 11:56:51.159107 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3827/7522] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:56:50 2022] GET /compute/v2.1/servers/44bc75aa-0b86-4f08-8202-b9036e767a81 => generated 1393 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:56:52.182319 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d86c1be9-b17d-4f4f-b378-cdb2ed99173a tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:56:52.182952 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d86c1be9-b17d-4f4f-b378-cdb2ed99173a tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 44bc75aa-0b86-4f08-8202-b9036e767a81] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:56:52.190530 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d86c1be9-b17d-4f4f-b378-cdb2ed99173a tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:56:52.191064 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d86c1be9-b17d-4f4f-b378-cdb2ed99173a tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:56:52.191523 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d86c1be9-b17d-4f4f-b378-cdb2ed99173a tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:56:52.192331 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d86c1be9-b17d-4f4f-b378-cdb2ed99173a tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:56:52.192908 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d86c1be9-b17d-4f4f-b378-cdb2ed99173a tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:56:52.193550 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d86c1be9-b17d-4f4f-b378-cdb2ed99173a tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:56:52.350293 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d86c1be9-b17d-4f4f-b378-cdb2ed99173a tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:56:52.358289 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d86c1be9-b17d-4f4f-b378-cdb2ed99173a tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/44bc75aa-0b86-4f08-8202-b9036e767a81" status: 200 len: 1393 microversion: 2.1 time: 0.180130 Sep 08 11:56:52.358868 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3696/7523] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:56:52 2022] GET /compute/v2.1/servers/44bc75aa-0b86-4f08-8202-b9036e767a81 => generated 1393 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:56:53.382013 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2da298fe-0000-4000-b003-d398cc864333 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:56:53.382542 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2da298fe-0000-4000-b003-d398cc864333 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 44bc75aa-0b86-4f08-8202-b9036e767a81] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:56:53.389361 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2da298fe-0000-4000-b003-d398cc864333 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:56:53.389853 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2da298fe-0000-4000-b003-d398cc864333 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:56:53.390295 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2da298fe-0000-4000-b003-d398cc864333 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:56:53.390989 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2da298fe-0000-4000-b003-d398cc864333 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:56:53.391446 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2da298fe-0000-4000-b003-d398cc864333 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:56:53.391876 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2da298fe-0000-4000-b003-d398cc864333 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:56:53.524056 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2da298fe-0000-4000-b003-d398cc864333 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:56:53.532612 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2da298fe-0000-4000-b003-d398cc864333 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/44bc75aa-0b86-4f08-8202-b9036e767a81" status: 200 len: 1393 microversion: 2.1 time: 0.154523 Sep 08 11:56:53.533253 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3828/7524] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:56:53 2022] GET /compute/v2.1/servers/44bc75aa-0b86-4f08-8202-b9036e767a81 => generated 1393 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:56:53.691471 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-650fb730-4679-4727-882f-f1dd215b56c8 req-eaf7b544-5aaa-48ab-990b-2afd9c037361 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44bc75aa-0b86-4f08-8202-b9036e767a81", "name": "network-vif-plugged", "status": "completed", "tag": "921e81d8-d1a0-47ad-929f-b01fd11364eb"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:56:53.703574 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-650fb730-4679-4727-882f-f1dd215b56c8 req-eaf7b544-5aaa-48ab-990b-2afd9c037361 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:56:53.704088 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-650fb730-4679-4727-882f-f1dd215b56c8 req-eaf7b544-5aaa-48ab-990b-2afd9c037361 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:56:53.704550 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-650fb730-4679-4727-882f-f1dd215b56c8 req-eaf7b544-5aaa-48ab-990b-2afd9c037361 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:56:53.716801 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-650fb730-4679-4727-882f-f1dd215b56c8 req-eaf7b544-5aaa-48ab-990b-2afd9c037361 service nova] Creating event network-vif-plugged:921e81d8-d1a0-47ad-929f-b01fd11364eb for instance 44bc75aa-0b86-4f08-8202-b9036e767a81 on n-h1-850501-12 Sep 08 11:56:53.721979 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-650fb730-4679-4727-882f-f1dd215b56c8 req-eaf7b544-5aaa-48ab-990b-2afd9c037361 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034357 Sep 08 11:56:53.722675 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3697/7525] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:56:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:56:54.556945 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-aee689b2-6a5a-403b-99bc-1fd7e22fd2f6 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:56:54.557598 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-aee689b2-6a5a-403b-99bc-1fd7e22fd2f6 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 44bc75aa-0b86-4f08-8202-b9036e767a81] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:56:54.559785 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:56:54.560471 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=6 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:56:54.567948 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aee689b2-6a5a-403b-99bc-1fd7e22fd2f6 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:56:54.568504 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aee689b2-6a5a-403b-99bc-1fd7e22fd2f6 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:56:54.569003 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aee689b2-6a5a-403b-99bc-1fd7e22fd2f6 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:56:54.569753 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aee689b2-6a5a-403b-99bc-1fd7e22fd2f6 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:56:54.570220 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aee689b2-6a5a-403b-99bc-1fd7e22fd2f6 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:56:54.570653 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aee689b2-6a5a-403b-99bc-1fd7e22fd2f6 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:56:54.715543 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-aee689b2-6a5a-403b-99bc-1fd7e22fd2f6 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:56:54.724424 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-aee689b2-6a5a-403b-99bc-1fd7e22fd2f6 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/44bc75aa-0b86-4f08-8202-b9036e767a81" status: 200 len: 1393 microversion: 2.1 time: 0.171116 Sep 08 11:56:54.725043 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3829/7526] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:56:54 2022] GET /compute/v2.1/servers/44bc75aa-0b86-4f08-8202-b9036e767a81 => generated 1393 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:56:55.745840 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:56:55.750853 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6d87227d-5079-4dd5-a42a-eadaf7e13e11 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:56:55.751569 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6d87227d-5079-4dd5-a42a-eadaf7e13e11 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 44bc75aa-0b86-4f08-8202-b9036e767a81] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:56:55.753430 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:56:55.759556 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d87227d-5079-4dd5-a42a-eadaf7e13e11 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:56:55.760054 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d87227d-5079-4dd5-a42a-eadaf7e13e11 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:56:55.760504 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d87227d-5079-4dd5-a42a-eadaf7e13e11 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:56:55.761342 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d87227d-5079-4dd5-a42a-eadaf7e13e11 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:56:55.761818 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d87227d-5079-4dd5-a42a-eadaf7e13e11 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:56:55.762255 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d87227d-5079-4dd5-a42a-eadaf7e13e11 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:56:55.899106 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6d87227d-5079-4dd5-a42a-eadaf7e13e11 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:56:55.908809 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6d87227d-5079-4dd5-a42a-eadaf7e13e11 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/44bc75aa-0b86-4f08-8202-b9036e767a81" status: 200 len: 1566 microversion: 2.1 time: 0.163838 Sep 08 11:56:55.909349 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3698/7527] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:56:55 2022] GET /compute/v2.1/servers/44bc75aa-0b86-4f08-8202-b9036e767a81 => generated 1566 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:56:55.931871 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-720e270a-b369-4ea4-a3bf-de6ad43df611 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:56:55.932492 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-720e270a-b369-4ea4-a3bf-de6ad43df611 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 44bc75aa-0b86-4f08-8202-b9036e767a81] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:56:55.935203 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:56:55.940536 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-720e270a-b369-4ea4-a3bf-de6ad43df611 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:56:55.941056 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-720e270a-b369-4ea4-a3bf-de6ad43df611 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:56:55.941499 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-720e270a-b369-4ea4-a3bf-de6ad43df611 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:56:55.942593 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-720e270a-b369-4ea4-a3bf-de6ad43df611 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:56:55.943064 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-720e270a-b369-4ea4-a3bf-de6ad43df611 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:56:55.943501 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-720e270a-b369-4ea4-a3bf-de6ad43df611 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:56:56.076277 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-720e270a-b369-4ea4-a3bf-de6ad43df611 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:56:56.084775 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-720e270a-b369-4ea4-a3bf-de6ad43df611 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/44bc75aa-0b86-4f08-8202-b9036e767a81" status: 200 len: 1566 microversion: 2.1 time: 0.156852 Sep 08 11:56:56.085399 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3830/7528] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:56:55 2022] GET /compute/v2.1/servers/44bc75aa-0b86-4f08-8202-b9036e767a81 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:56:57.990249 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1ebade7e-b8b0-40a0-ba3c-6a1ef0bd22bf tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:56:57.991060 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1ebade7e-b8b0-40a0-ba3c-6a1ef0bd22bf tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 44bc75aa-0b86-4f08-8202-b9036e767a81] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:56:57.992370 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-f5ba5725-b6f9-460d-b574-5c0e21ff6a0d req-9e8a6c7d-0e44-482b-bd98-c59c29dc42a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44bc75aa-0b86-4f08-8202-b9036e767a81", "tag": "921e81d8-d1a0-47ad-929f-b01fd11364eb"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:56:57.998015 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ebade7e-b8b0-40a0-ba3c-6a1ef0bd22bf tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:56:57.998518 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ebade7e-b8b0-40a0-ba3c-6a1ef0bd22bf tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:56:57.999181 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ebade7e-b8b0-40a0-ba3c-6a1ef0bd22bf tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:56:57.999909 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ebade7e-b8b0-40a0-ba3c-6a1ef0bd22bf tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:56:58.000378 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ebade7e-b8b0-40a0-ba3c-6a1ef0bd22bf tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:56:58.001134 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ebade7e-b8b0-40a0-ba3c-6a1ef0bd22bf tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:56:58.004278 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-f5ba5725-b6f9-460d-b574-5c0e21ff6a0d req-9e8a6c7d-0e44-482b-bd98-c59c29dc42a8 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:56:58.006170 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-f5ba5725-b6f9-460d-b574-5c0e21ff6a0d req-9e8a6c7d-0e44-482b-bd98-c59c29dc42a8 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:56:58.006862 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-f5ba5725-b6f9-460d-b574-5c0e21ff6a0d req-9e8a6c7d-0e44-482b-bd98-c59c29dc42a8 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:56:58.023161 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-f5ba5725-b6f9-460d-b574-5c0e21ff6a0d req-9e8a6c7d-0e44-482b-bd98-c59c29dc42a8 service nova] Creating event network-changed:921e81d8-d1a0-47ad-929f-b01fd11364eb for instance 44bc75aa-0b86-4f08-8202-b9036e767a81 on n-h1-850501-12 Sep 08 11:56:58.028602 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-f5ba5725-b6f9-460d-b574-5c0e21ff6a0d req-9e8a6c7d-0e44-482b-bd98-c59c29dc42a8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040990 Sep 08 11:56:58.029356 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3831/7529] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:56:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:56:58.149833 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1ebade7e-b8b0-40a0-ba3c-6a1ef0bd22bf tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:56:58.158210 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1ebade7e-b8b0-40a0-ba3c-6a1ef0bd22bf tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/44bc75aa-0b86-4f08-8202-b9036e767a81" status: 200 len: 1566 microversion: 2.1 time: 0.172958 Sep 08 11:56:58.159853 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3699/7530] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:56:57 2022] GET /compute/v2.1/servers/44bc75aa-0b86-4f08-8202-b9036e767a81 => generated 1566 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:57:20.485086 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=3 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:57:20.485843 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=42 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:57:20.491143 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b1001979-466d-4395-8337-963b0aca46a2 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:57:20.493516 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b1001979-466d-4395-8337-963b0aca46a2 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 44bc75aa-0b86-4f08-8202-b9036e767a81] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:57:20.500556 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b1001979-466d-4395-8337-963b0aca46a2 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:57:20.501074 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b1001979-466d-4395-8337-963b0aca46a2 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:57:20.501521 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b1001979-466d-4395-8337-963b0aca46a2 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:57:20.502229 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b1001979-466d-4395-8337-963b0aca46a2 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:57:20.502729 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b1001979-466d-4395-8337-963b0aca46a2 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:57:20.503180 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b1001979-466d-4395-8337-963b0aca46a2 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:57:20.557166 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b1001979-466d-4395-8337-963b0aca46a2 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "POST /compute/v2.1/servers/44bc75aa-0b86-4f08-8202-b9036e767a81/action" status: 200 len: 24568 microversion: 2.1 time: 0.073746 Sep 08 11:57:20.557854 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3832/7531] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 11:57:20 2022] POST /compute/v2.1/servers/44bc75aa-0b86-4f08-8202-b9036e767a81/action => generated 24568 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 11:57:31.569947 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-95b2d74e-396f-4255-b860-601e81d70263 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:57:31.572209 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-95b2d74e-396f-4255-b860-601e81d70263 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 44bc75aa-0b86-4f08-8202-b9036e767a81] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:57:31.574729 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:57:31.575418 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=38 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:57:31.581575 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-95b2d74e-396f-4255-b860-601e81d70263 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:57:31.582083 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-95b2d74e-396f-4255-b860-601e81d70263 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:57:31.583123 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-95b2d74e-396f-4255-b860-601e81d70263 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:57:31.583849 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-95b2d74e-396f-4255-b860-601e81d70263 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:57:31.584319 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-95b2d74e-396f-4255-b860-601e81d70263 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:57:31.584757 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-95b2d74e-396f-4255-b860-601e81d70263 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:57:31.663616 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-95b2d74e-396f-4255-b860-601e81d70263 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "POST /compute/v2.1/servers/44bc75aa-0b86-4f08-8202-b9036e767a81/action" status: 202 len: 0 microversion: 2.1 time: 0.097780 Sep 08 11:57:31.664266 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3700/7532] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 11:57:31 2022] POST /compute/v2.1/servers/44bc75aa-0b86-4f08-8202-b9036e767a81/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:57:31.675655 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5469533b-6e7b-471e-a780-bd6c36a6c373 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:57:31.676404 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5469533b-6e7b-471e-a780-bd6c36a6c373 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 44bc75aa-0b86-4f08-8202-b9036e767a81] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:57:31.678942 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:57:31.679746 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=4 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:57:31.686075 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5469533b-6e7b-471e-a780-bd6c36a6c373 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:57:31.686594 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5469533b-6e7b-471e-a780-bd6c36a6c373 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:57:31.687037 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5469533b-6e7b-471e-a780-bd6c36a6c373 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:57:31.687771 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5469533b-6e7b-471e-a780-bd6c36a6c373 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:57:31.688234 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5469533b-6e7b-471e-a780-bd6c36a6c373 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:57:31.688669 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5469533b-6e7b-471e-a780-bd6c36a6c373 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:57:32.240271 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5469533b-6e7b-471e-a780-bd6c36a6c373 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:57:32.248061 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5469533b-6e7b-471e-a780-bd6c36a6c373 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/44bc75aa-0b86-4f08-8202-b9036e767a81" status: 200 len: 1676 microversion: 2.1 time: 0.578312 Sep 08 11:57:32.248861 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3833/7533] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:57:31 2022] GET /compute/v2.1/servers/44bc75aa-0b86-4f08-8202-b9036e767a81 => generated 1676 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:57:33.272447 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6415482c-dbac-4413-9820-f617b94fc15b tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:57:33.273196 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6415482c-dbac-4413-9820-f617b94fc15b tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 44bc75aa-0b86-4f08-8202-b9036e767a81] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:57:33.280998 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6415482c-dbac-4413-9820-f617b94fc15b tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:57:33.281621 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6415482c-dbac-4413-9820-f617b94fc15b tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:57:33.282148 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6415482c-dbac-4413-9820-f617b94fc15b tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:57:33.282984 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6415482c-dbac-4413-9820-f617b94fc15b tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:57:33.283490 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6415482c-dbac-4413-9820-f617b94fc15b tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:57:33.283959 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6415482c-dbac-4413-9820-f617b94fc15b tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:57:33.425587 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6415482c-dbac-4413-9820-f617b94fc15b tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:57:33.434045 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6415482c-dbac-4413-9820-f617b94fc15b tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/44bc75aa-0b86-4f08-8202-b9036e767a81" status: 200 len: 1681 microversion: 2.1 time: 0.166149 Sep 08 11:57:33.434620 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3701/7534] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:57:33 2022] GET /compute/v2.1/servers/44bc75aa-0b86-4f08-8202-b9036e767a81 => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:57:34.459448 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4cbcfeee-54c2-4650-8e7e-f7e08dcdd9af tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:57:34.460069 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4cbcfeee-54c2-4650-8e7e-f7e08dcdd9af tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 44bc75aa-0b86-4f08-8202-b9036e767a81] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:57:34.467792 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4cbcfeee-54c2-4650-8e7e-f7e08dcdd9af tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:57:34.468282 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4cbcfeee-54c2-4650-8e7e-f7e08dcdd9af tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:57:34.468726 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4cbcfeee-54c2-4650-8e7e-f7e08dcdd9af tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:57:34.469447 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4cbcfeee-54c2-4650-8e7e-f7e08dcdd9af tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:57:34.469906 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4cbcfeee-54c2-4650-8e7e-f7e08dcdd9af tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:57:34.470333 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4cbcfeee-54c2-4650-8e7e-f7e08dcdd9af tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:57:34.612031 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4cbcfeee-54c2-4650-8e7e-f7e08dcdd9af tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:57:34.620966 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4cbcfeee-54c2-4650-8e7e-f7e08dcdd9af tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/44bc75aa-0b86-4f08-8202-b9036e767a81" status: 200 len: 1681 microversion: 2.1 time: 0.166012 Sep 08 11:57:34.621584 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3834/7535] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:57:34 2022] GET /compute/v2.1/servers/44bc75aa-0b86-4f08-8202-b9036e767a81 => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:57:35.645572 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-32fde3e3-8621-4e20-90e6-033bf77a01d1 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:57:35.646239 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-32fde3e3-8621-4e20-90e6-033bf77a01d1 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 44bc75aa-0b86-4f08-8202-b9036e767a81] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:57:35.653134 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-32fde3e3-8621-4e20-90e6-033bf77a01d1 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:57:35.653639 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-32fde3e3-8621-4e20-90e6-033bf77a01d1 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:57:35.654092 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-32fde3e3-8621-4e20-90e6-033bf77a01d1 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:57:35.654802 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-32fde3e3-8621-4e20-90e6-033bf77a01d1 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:57:35.655276 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-32fde3e3-8621-4e20-90e6-033bf77a01d1 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:57:35.655717 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-32fde3e3-8621-4e20-90e6-033bf77a01d1 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:57:35.789649 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-32fde3e3-8621-4e20-90e6-033bf77a01d1 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:57:35.797541 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-32fde3e3-8621-4e20-90e6-033bf77a01d1 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/44bc75aa-0b86-4f08-8202-b9036e767a81" status: 200 len: 1681 microversion: 2.1 time: 0.156647 Sep 08 11:57:35.798122 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3702/7536] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:57:35 2022] GET /compute/v2.1/servers/44bc75aa-0b86-4f08-8202-b9036e767a81 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:57:36.821513 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e988c330-eeb1-4b4c-bc05-721c3dad99d1 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:57:36.822140 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e988c330-eeb1-4b4c-bc05-721c3dad99d1 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 44bc75aa-0b86-4f08-8202-b9036e767a81] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:57:36.829048 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e988c330-eeb1-4b4c-bc05-721c3dad99d1 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:57:36.829557 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e988c330-eeb1-4b4c-bc05-721c3dad99d1 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:57:36.830002 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e988c330-eeb1-4b4c-bc05-721c3dad99d1 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:57:36.830707 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e988c330-eeb1-4b4c-bc05-721c3dad99d1 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:57:36.831171 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e988c330-eeb1-4b4c-bc05-721c3dad99d1 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:57:36.831610 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e988c330-eeb1-4b4c-bc05-721c3dad99d1 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:57:36.962980 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e988c330-eeb1-4b4c-bc05-721c3dad99d1 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:57:36.970931 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e988c330-eeb1-4b4c-bc05-721c3dad99d1 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/44bc75aa-0b86-4f08-8202-b9036e767a81" status: 200 len: 1681 microversion: 2.1 time: 0.153523 Sep 08 11:57:36.971506 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3835/7537] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:57:36 2022] GET /compute/v2.1/servers/44bc75aa-0b86-4f08-8202-b9036e767a81 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:57:37.995781 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ff5076cb-c3a7-409f-9b6c-c7312eb195ab tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:57:37.996417 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ff5076cb-c3a7-409f-9b6c-c7312eb195ab tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 44bc75aa-0b86-4f08-8202-b9036e767a81] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:57:38.003327 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff5076cb-c3a7-409f-9b6c-c7312eb195ab tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:57:38.003840 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff5076cb-c3a7-409f-9b6c-c7312eb195ab tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:57:38.004445 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff5076cb-c3a7-409f-9b6c-c7312eb195ab tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:57:38.005199 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff5076cb-c3a7-409f-9b6c-c7312eb195ab tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:57:38.005682 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff5076cb-c3a7-409f-9b6c-c7312eb195ab tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:57:38.006161 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff5076cb-c3a7-409f-9b6c-c7312eb195ab tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:57:38.148190 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ff5076cb-c3a7-409f-9b6c-c7312eb195ab tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:57:38.155993 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ff5076cb-c3a7-409f-9b6c-c7312eb195ab tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/44bc75aa-0b86-4f08-8202-b9036e767a81" status: 200 len: 1681 microversion: 2.1 time: 0.164219 Sep 08 11:57:38.156565 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3703/7538] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:57:37 2022] GET /compute/v2.1/servers/44bc75aa-0b86-4f08-8202-b9036e767a81 => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:57:39.180217 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-be7bae79-88f8-497a-8335-a69d95c72ce4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:57:39.180876 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-be7bae79-88f8-497a-8335-a69d95c72ce4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 44bc75aa-0b86-4f08-8202-b9036e767a81] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:57:39.187783 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-be7bae79-88f8-497a-8335-a69d95c72ce4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:57:39.188277 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-be7bae79-88f8-497a-8335-a69d95c72ce4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:57:39.188729 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-be7bae79-88f8-497a-8335-a69d95c72ce4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:57:39.189457 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-be7bae79-88f8-497a-8335-a69d95c72ce4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:57:39.189922 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-be7bae79-88f8-497a-8335-a69d95c72ce4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:57:39.190354 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-be7bae79-88f8-497a-8335-a69d95c72ce4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:57:39.324202 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-be7bae79-88f8-497a-8335-a69d95c72ce4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:57:39.332116 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-be7bae79-88f8-497a-8335-a69d95c72ce4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/44bc75aa-0b86-4f08-8202-b9036e767a81" status: 200 len: 1681 microversion: 2.1 time: 0.156395 Sep 08 11:57:39.332675 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3836/7539] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:57:39 2022] GET /compute/v2.1/servers/44bc75aa-0b86-4f08-8202-b9036e767a81 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:57:40.356349 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fb89ba29-ba2b-4245-a9f2-371100b037bf tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:57:40.356982 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fb89ba29-ba2b-4245-a9f2-371100b037bf tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 44bc75aa-0b86-4f08-8202-b9036e767a81] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:57:40.364103 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb89ba29-ba2b-4245-a9f2-371100b037bf tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:57:40.365338 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb89ba29-ba2b-4245-a9f2-371100b037bf tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:57:40.365801 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb89ba29-ba2b-4245-a9f2-371100b037bf tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:57:40.366519 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb89ba29-ba2b-4245-a9f2-371100b037bf tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:57:40.366998 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb89ba29-ba2b-4245-a9f2-371100b037bf tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:57:40.367441 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb89ba29-ba2b-4245-a9f2-371100b037bf tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:57:40.500333 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fb89ba29-ba2b-4245-a9f2-371100b037bf tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:57:40.508273 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fb89ba29-ba2b-4245-a9f2-371100b037bf tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/44bc75aa-0b86-4f08-8202-b9036e767a81" status: 200 len: 1681 microversion: 2.1 time: 0.155864 Sep 08 11:57:40.508842 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3704/7540] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:57:40 2022] GET /compute/v2.1/servers/44bc75aa-0b86-4f08-8202-b9036e767a81 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:57:41.531744 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5e23ad31-dcfa-438b-b83e-613f10f0887b tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:57:41.532367 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5e23ad31-dcfa-438b-b83e-613f10f0887b tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 44bc75aa-0b86-4f08-8202-b9036e767a81] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:57:41.539913 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5e23ad31-dcfa-438b-b83e-613f10f0887b tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:57:41.540407 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5e23ad31-dcfa-438b-b83e-613f10f0887b tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:57:41.540851 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5e23ad31-dcfa-438b-b83e-613f10f0887b tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:57:41.541591 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5e23ad31-dcfa-438b-b83e-613f10f0887b tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:57:41.542059 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5e23ad31-dcfa-438b-b83e-613f10f0887b tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:57:41.542494 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5e23ad31-dcfa-438b-b83e-613f10f0887b tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:57:41.679836 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5e23ad31-dcfa-438b-b83e-613f10f0887b tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:57:41.687819 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5e23ad31-dcfa-438b-b83e-613f10f0887b tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/44bc75aa-0b86-4f08-8202-b9036e767a81" status: 200 len: 1681 microversion: 2.1 time: 0.159974 Sep 08 11:57:41.688373 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3837/7541] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:57:41 2022] GET /compute/v2.1/servers/44bc75aa-0b86-4f08-8202-b9036e767a81 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:57:42.711364 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bc7b8651-92db-44bd-939e-3eb5ce614682 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:57:42.711991 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bc7b8651-92db-44bd-939e-3eb5ce614682 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 44bc75aa-0b86-4f08-8202-b9036e767a81] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:57:42.719112 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bc7b8651-92db-44bd-939e-3eb5ce614682 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:57:42.719598 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bc7b8651-92db-44bd-939e-3eb5ce614682 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:57:42.720044 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bc7b8651-92db-44bd-939e-3eb5ce614682 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:57:42.720754 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bc7b8651-92db-44bd-939e-3eb5ce614682 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:57:42.721261 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bc7b8651-92db-44bd-939e-3eb5ce614682 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:57:42.721701 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bc7b8651-92db-44bd-939e-3eb5ce614682 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:57:42.865989 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bc7b8651-92db-44bd-939e-3eb5ce614682 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:57:42.878348 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bc7b8651-92db-44bd-939e-3eb5ce614682 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/44bc75aa-0b86-4f08-8202-b9036e767a81" status: 200 len: 1681 microversion: 2.1 time: 0.170830 Sep 08 11:57:42.879094 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3705/7542] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:57:42 2022] GET /compute/v2.1/servers/44bc75aa-0b86-4f08-8202-b9036e767a81 => generated 1681 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:57:43.902599 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-99dd9bf1-c8f6-4a8f-bb7e-c7339ec78f4f tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:57:43.903223 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-99dd9bf1-c8f6-4a8f-bb7e-c7339ec78f4f tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 44bc75aa-0b86-4f08-8202-b9036e767a81] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:57:43.910295 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-99dd9bf1-c8f6-4a8f-bb7e-c7339ec78f4f tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:57:43.910788 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-99dd9bf1-c8f6-4a8f-bb7e-c7339ec78f4f tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:57:43.911384 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-99dd9bf1-c8f6-4a8f-bb7e-c7339ec78f4f tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:57:43.911994 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-99dd9bf1-c8f6-4a8f-bb7e-c7339ec78f4f tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:57:43.912460 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-99dd9bf1-c8f6-4a8f-bb7e-c7339ec78f4f tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:57:43.912944 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-99dd9bf1-c8f6-4a8f-bb7e-c7339ec78f4f tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:57:44.048626 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-99dd9bf1-c8f6-4a8f-bb7e-c7339ec78f4f tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:57:44.057519 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-99dd9bf1-c8f6-4a8f-bb7e-c7339ec78f4f tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/44bc75aa-0b86-4f08-8202-b9036e767a81" status: 200 len: 1681 microversion: 2.1 time: 0.158847 Sep 08 11:57:44.058120 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3838/7543] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:57:43 2022] GET /compute/v2.1/servers/44bc75aa-0b86-4f08-8202-b9036e767a81 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:57:45.081852 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e811ae15-b434-48d3-81e6-1158800b6db1 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:57:45.082509 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e811ae15-b434-48d3-81e6-1158800b6db1 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 44bc75aa-0b86-4f08-8202-b9036e767a81] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:57:45.090136 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e811ae15-b434-48d3-81e6-1158800b6db1 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:57:45.090635 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e811ae15-b434-48d3-81e6-1158800b6db1 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:57:45.091113 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e811ae15-b434-48d3-81e6-1158800b6db1 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:57:45.091823 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e811ae15-b434-48d3-81e6-1158800b6db1 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:57:45.092288 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e811ae15-b434-48d3-81e6-1158800b6db1 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:57:45.092724 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e811ae15-b434-48d3-81e6-1158800b6db1 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:57:45.238710 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e811ae15-b434-48d3-81e6-1158800b6db1 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:57:45.246869 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e811ae15-b434-48d3-81e6-1158800b6db1 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/44bc75aa-0b86-4f08-8202-b9036e767a81" status: 200 len: 1681 microversion: 2.1 time: 0.168988 Sep 08 11:57:45.247456 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3706/7544] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:57:45 2022] GET /compute/v2.1/servers/44bc75aa-0b86-4f08-8202-b9036e767a81 => generated 1681 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:57:46.273407 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-065f2a71-1665-4ef1-8cf9-24fd25c8507d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:57:46.274589 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-065f2a71-1665-4ef1-8cf9-24fd25c8507d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 44bc75aa-0b86-4f08-8202-b9036e767a81] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:57:46.287870 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-065f2a71-1665-4ef1-8cf9-24fd25c8507d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:57:46.288790 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-065f2a71-1665-4ef1-8cf9-24fd25c8507d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:57:46.289664 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-065f2a71-1665-4ef1-8cf9-24fd25c8507d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:57:46.290921 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-065f2a71-1665-4ef1-8cf9-24fd25c8507d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:57:46.291828 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-065f2a71-1665-4ef1-8cf9-24fd25c8507d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:57:46.292636 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-065f2a71-1665-4ef1-8cf9-24fd25c8507d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:57:46.431271 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-065f2a71-1665-4ef1-8cf9-24fd25c8507d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:57:46.439074 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-065f2a71-1665-4ef1-8cf9-24fd25c8507d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/44bc75aa-0b86-4f08-8202-b9036e767a81" status: 200 len: 1681 microversion: 2.1 time: 0.171572 Sep 08 11:57:46.439655 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3839/7545] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:57:46 2022] GET /compute/v2.1/servers/44bc75aa-0b86-4f08-8202-b9036e767a81 => generated 1681 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:57:47.462540 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ad354b28-651c-4008-b55f-100bd8b606db tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:57:47.463169 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ad354b28-651c-4008-b55f-100bd8b606db tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 44bc75aa-0b86-4f08-8202-b9036e767a81] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:57:47.470226 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad354b28-651c-4008-b55f-100bd8b606db tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:57:47.470733 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad354b28-651c-4008-b55f-100bd8b606db tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:57:47.471185 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad354b28-651c-4008-b55f-100bd8b606db tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:57:47.471893 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad354b28-651c-4008-b55f-100bd8b606db tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:57:47.472360 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad354b28-651c-4008-b55f-100bd8b606db tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:57:47.472804 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad354b28-651c-4008-b55f-100bd8b606db tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:57:47.606215 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ad354b28-651c-4008-b55f-100bd8b606db tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:57:47.614225 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ad354b28-651c-4008-b55f-100bd8b606db tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/44bc75aa-0b86-4f08-8202-b9036e767a81" status: 200 len: 1681 microversion: 2.1 time: 0.155485 Sep 08 11:57:47.614916 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3707/7546] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:57:47 2022] GET /compute/v2.1/servers/44bc75aa-0b86-4f08-8202-b9036e767a81 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:57:48.637887 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-53d7886e-9f96-4002-b6e8-dfbfda267233 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:57:48.638520 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-53d7886e-9f96-4002-b6e8-dfbfda267233 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 44bc75aa-0b86-4f08-8202-b9036e767a81] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:57:48.645578 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-53d7886e-9f96-4002-b6e8-dfbfda267233 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:57:48.646433 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-53d7886e-9f96-4002-b6e8-dfbfda267233 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:57:48.646892 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-53d7886e-9f96-4002-b6e8-dfbfda267233 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:57:48.647608 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-53d7886e-9f96-4002-b6e8-dfbfda267233 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:57:48.648078 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-53d7886e-9f96-4002-b6e8-dfbfda267233 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:57:48.648540 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-53d7886e-9f96-4002-b6e8-dfbfda267233 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:57:48.781950 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-53d7886e-9f96-4002-b6e8-dfbfda267233 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:57:48.790906 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-53d7886e-9f96-4002-b6e8-dfbfda267233 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/44bc75aa-0b86-4f08-8202-b9036e767a81" status: 200 len: 1684 microversion: 2.1 time: 0.157022 Sep 08 11:57:48.791489 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3840/7547] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:57:48 2022] GET /compute/v2.1/servers/44bc75aa-0b86-4f08-8202-b9036e767a81 => generated 1684 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:58:14.996297 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c451618b-ca14-4704-b953-d9afe7d03335 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:58:14.998478 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c451618b-ca14-4704-b953-d9afe7d03335 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 44bc75aa-0b86-4f08-8202-b9036e767a81] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:58:15.000808 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=16 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:58:15.001528 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:58:15.008160 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c451618b-ca14-4704-b953-d9afe7d03335 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:58:15.008668 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c451618b-ca14-4704-b953-d9afe7d03335 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:58:15.009157 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c451618b-ca14-4704-b953-d9afe7d03335 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:58:15.009878 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c451618b-ca14-4704-b953-d9afe7d03335 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:58:15.010348 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c451618b-ca14-4704-b953-d9afe7d03335 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:58:15.010789 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c451618b-ca14-4704-b953-d9afe7d03335 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:58:15.068115 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c451618b-ca14-4704-b953-d9afe7d03335 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "POST /compute/v2.1/servers/44bc75aa-0b86-4f08-8202-b9036e767a81/action" status: 200 len: 68987 microversion: 2.1 time: 0.076116 Sep 08 11:58:15.068820 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3708/7548] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 11:58:14 2022] POST /compute/v2.1/servers/44bc75aa-0b86-4f08-8202-b9036e767a81/action => generated 68987 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 11:58:22.139780 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4800904e-89d6-4c06-8883-005db10a1b2d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:58:22.140323 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4800904e-89d6-4c06-8883-005db10a1b2d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 44bc75aa-0b86-4f08-8202-b9036e767a81] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:58:22.142831 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=16 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:58:22.144008 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=48 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:58:22.151789 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4800904e-89d6-4c06-8883-005db10a1b2d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:58:22.152297 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4800904e-89d6-4c06-8883-005db10a1b2d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:58:22.152865 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4800904e-89d6-4c06-8883-005db10a1b2d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:58:22.153871 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4800904e-89d6-4c06-8883-005db10a1b2d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:58:22.154343 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4800904e-89d6-4c06-8883-005db10a1b2d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:58:22.154788 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4800904e-89d6-4c06-8883-005db10a1b2d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:58:22.184134 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4800904e-89d6-4c06-8883-005db10a1b2d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 44bc75aa-0b86-4f08-8202-b9036e767a81] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:58:22.205323 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-386b7e65-36d1-4b42-8d50-bfa8e91350dc req-3eeb8ad2-a40d-4519-a078-a6c7494cd248 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44bc75aa-0b86-4f08-8202-b9036e767a81", "tag": "921e81d8-d1a0-47ad-929f-b01fd11364eb"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:58:22.219912 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-386b7e65-36d1-4b42-8d50-bfa8e91350dc req-3eeb8ad2-a40d-4519-a078-a6c7494cd248 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:58:22.220532 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-386b7e65-36d1-4b42-8d50-bfa8e91350dc req-3eeb8ad2-a40d-4519-a078-a6c7494cd248 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:58:22.221061 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-386b7e65-36d1-4b42-8d50-bfa8e91350dc req-3eeb8ad2-a40d-4519-a078-a6c7494cd248 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:58:22.234886 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-386b7e65-36d1-4b42-8d50-bfa8e91350dc req-3eeb8ad2-a40d-4519-a078-a6c7494cd248 service nova] Creating event network-changed:921e81d8-d1a0-47ad-929f-b01fd11364eb for instance 44bc75aa-0b86-4f08-8202-b9036e767a81 on n-h1-850501-12 Sep 08 11:58:22.245415 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-386b7e65-36d1-4b42-8d50-bfa8e91350dc req-3eeb8ad2-a40d-4519-a078-a6c7494cd248 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104222 Sep 08 11:58:22.245415 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3709/7549] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:58:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:58:22.284043 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4800904e-89d6-4c06-8883-005db10a1b2d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "DELETE /compute/v2.1/servers/44bc75aa-0b86-4f08-8202-b9036e767a81" status: 204 len: 0 microversion: 2.1 time: 0.148270 Sep 08 11:58:22.286225 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3841/7550] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 11:58:22 2022] DELETE /compute/v2.1/servers/44bc75aa-0b86-4f08-8202-b9036e767a81 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:58:22.299181 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3a0d81b2-83c5-4d26-b6d5-51c23028a063 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:58:22.299910 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3a0d81b2-83c5-4d26-b6d5-51c23028a063 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 44bc75aa-0b86-4f08-8202-b9036e767a81] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:58:22.307612 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a0d81b2-83c5-4d26-b6d5-51c23028a063 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:58:22.308170 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a0d81b2-83c5-4d26-b6d5-51c23028a063 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:58:22.308776 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a0d81b2-83c5-4d26-b6d5-51c23028a063 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:58:22.310130 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a0d81b2-83c5-4d26-b6d5-51c23028a063 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:58:22.310130 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a0d81b2-83c5-4d26-b6d5-51c23028a063 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:58:22.310847 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a0d81b2-83c5-4d26-b6d5-51c23028a063 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:58:22.476383 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3a0d81b2-83c5-4d26-b6d5-51c23028a063 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:58:22.485078 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3a0d81b2-83c5-4d26-b6d5-51c23028a063 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/44bc75aa-0b86-4f08-8202-b9036e767a81" status: 200 len: 1690 microversion: 2.1 time: 0.193881 Sep 08 11:58:22.485649 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3710/7551] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:58:22 2022] GET /compute/v2.1/servers/44bc75aa-0b86-4f08-8202-b9036e767a81 => generated 1690 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:58:23.510902 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3777a60e-9c98-4b6f-9ef9-7fec23fa70fe tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:58:23.511621 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3777a60e-9c98-4b6f-9ef9-7fec23fa70fe tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 44bc75aa-0b86-4f08-8202-b9036e767a81] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:58:23.518704 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3777a60e-9c98-4b6f-9ef9-7fec23fa70fe tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:58:23.519199 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3777a60e-9c98-4b6f-9ef9-7fec23fa70fe tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:58:23.519660 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3777a60e-9c98-4b6f-9ef9-7fec23fa70fe tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:58:23.520382 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3777a60e-9c98-4b6f-9ef9-7fec23fa70fe tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:58:23.520851 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3777a60e-9c98-4b6f-9ef9-7fec23fa70fe tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:58:23.521311 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3777a60e-9c98-4b6f-9ef9-7fec23fa70fe tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:58:23.659228 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-3777a60e-9c98-4b6f-9ef9-7fec23fa70fe tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:58:23.668686 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3777a60e-9c98-4b6f-9ef9-7fec23fa70fe tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/44bc75aa-0b86-4f08-8202-b9036e767a81" status: 200 len: 1690 microversion: 2.1 time: 0.161968 Sep 08 11:58:23.669687 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3842/7552] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:58:23 2022] GET /compute/v2.1/servers/44bc75aa-0b86-4f08-8202-b9036e767a81 => generated 1690 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:58:24.468123 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-5e585ee2-871b-4d82-ab99-1962e16bd408 req-6fb00add-196c-4bf2-a077-3848215a98ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44bc75aa-0b86-4f08-8202-b9036e767a81", "name": "network-vif-deleted", "tag": "921e81d8-d1a0-47ad-929f-b01fd11364eb"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:58:24.481486 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-5e585ee2-871b-4d82-ab99-1962e16bd408 req-6fb00add-196c-4bf2-a077-3848215a98ff service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:58:24.482089 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-5e585ee2-871b-4d82-ab99-1962e16bd408 req-6fb00add-196c-4bf2-a077-3848215a98ff service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:58:24.482647 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-5e585ee2-871b-4d82-ab99-1962e16bd408 req-6fb00add-196c-4bf2-a077-3848215a98ff service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:58:24.496179 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-5e585ee2-871b-4d82-ab99-1962e16bd408 req-6fb00add-196c-4bf2-a077-3848215a98ff service nova] Creating event network-vif-deleted:921e81d8-d1a0-47ad-929f-b01fd11364eb for instance 44bc75aa-0b86-4f08-8202-b9036e767a81 on n-h1-850501-12 Sep 08 11:58:24.501760 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-5e585ee2-871b-4d82-ab99-1962e16bd408 req-6fb00add-196c-4bf2-a077-3848215a98ff service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036793 Sep 08 11:58:24.502682 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3711/7553] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:58:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:58:24.694530 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b0277006-2d44-4d7b-b2ef-e5f1afcb48d9 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:58:24.695156 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b0277006-2d44-4d7b-b2ef-e5f1afcb48d9 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 44bc75aa-0b86-4f08-8202-b9036e767a81] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:58:24.702010 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b0277006-2d44-4d7b-b2ef-e5f1afcb48d9 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:58:24.702499 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b0277006-2d44-4d7b-b2ef-e5f1afcb48d9 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:58:24.702939 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b0277006-2d44-4d7b-b2ef-e5f1afcb48d9 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:58:24.703658 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b0277006-2d44-4d7b-b2ef-e5f1afcb48d9 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:58:24.704120 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b0277006-2d44-4d7b-b2ef-e5f1afcb48d9 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:58:24.704561 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b0277006-2d44-4d7b-b2ef-e5f1afcb48d9 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:58:24.740564 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b0277006-2d44-4d7b-b2ef-e5f1afcb48d9 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:58:24.741084 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b0277006-2d44-4d7b-b2ef-e5f1afcb48d9 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:58:24.741532 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b0277006-2d44-4d7b-b2ef-e5f1afcb48d9 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:58:24.741993 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-b0277006-2d44-4d7b-b2ef-e5f1afcb48d9 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lazy-loading 'fault' on Instance uuid 44bc75aa-0b86-4f08-8202-b9036e767a81 {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:58:24.786821 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b0277006-2d44-4d7b-b2ef-e5f1afcb48d9 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:58:24.795431 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b0277006-2d44-4d7b-b2ef-e5f1afcb48d9 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/44bc75aa-0b86-4f08-8202-b9036e767a81" status: 200 len: 1357 microversion: 2.1 time: 0.105023 Sep 08 11:58:24.796026 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3843/7554] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:58:24 2022] GET /compute/v2.1/servers/44bc75aa-0b86-4f08-8202-b9036e767a81 => generated 1357 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:58:25.819848 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-94934c3a-f3c5-47cd-8f12-829ea945d186 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:58:25.820439 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-94934c3a-f3c5-47cd-8f12-829ea945d186 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 44bc75aa-0b86-4f08-8202-b9036e767a81] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:58:25.827619 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94934c3a-f3c5-47cd-8f12-829ea945d186 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:58:25.828123 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94934c3a-f3c5-47cd-8f12-829ea945d186 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:58:25.828572 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94934c3a-f3c5-47cd-8f12-829ea945d186 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:58:25.829305 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94934c3a-f3c5-47cd-8f12-829ea945d186 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:58:25.829778 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94934c3a-f3c5-47cd-8f12-829ea945d186 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:58:25.830215 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94934c3a-f3c5-47cd-8f12-829ea945d186 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:58:25.843714 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-94934c3a-f3c5-47cd-8f12-829ea945d186 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] HTTP exception thrown: Instance 44bc75aa-0b86-4f08-8202-b9036e767a81 could not be found. Sep 08 11:58:25.845374 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-94934c3a-f3c5-47cd-8f12-829ea945d186 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Request method failure captured: Sep 08 11:58:25.845374 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/44bc75aa-0b86-4f08-8202-b9036e767a81 HTTP/1.1 Sep 08 11:58:25.845374 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 11:58:25.845374 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 11:58:25.845374 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 11:58:25.845374 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 11:58:25.845374 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 11:58:25.845374 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 11:58:25.845374 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 11:58:25.845374 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 11:58:25.845374 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGdgwe3QmhiGsoiILM5bGeIE-EHzsnjM6KQuMFsKvCXbg967J71JinBeGFRd1mku6-Z-m4JQ9yWbqYK6Z1MSuErSUTO54qKxQVH-rPnvuL8XP6AL5ODpR7jo94wp_BdEp1m68Loc1_k9cMRb5G6-FLWWIE65rAilwZFS7jxy1f7IqtpQ Sep 08 11:58:25.845374 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 11:58:25.845374 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 11:58:25.845374 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 11:58:25.845374 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 11:58:25.845374 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 11:58:25.845374 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 11:58:25.845374 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: f00a6070707c4334b4beb7d530b15814 Sep 08 11:58:25.845374 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1687454490 Sep 08 11:58:25.845374 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 11:58:25.845374 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 11:58:25.845374 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f00a6070707c4334b4beb7d530b15814"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f00a6070707c4334b4beb7d530b15814"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f00a6070707c4334b4beb7d530b15814"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f00a6070707c4334b4beb7d530b15814"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 11:58:25.845374 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1687454490 Sep 08 11:58:25.845374 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: f00a6070707c4334b4beb7d530b15814 Sep 08 11:58:25.845374 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1687454490 Sep 08 11:58:25.845374 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-TestNetworkAdvancedServerOps-1687454490-project Sep 08 11:58:25.845374 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 11:58:25.845374 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 11:58:25.845374 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 4a16b57190c243a5b78e7717eb4a016b Sep 08 11:58:25.845374 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1687454490-project Sep 08 11:58:25.845374 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 11:58:25.845374 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 44bc75aa-0b86-4f08-8202-b9036e767a81 could not be found. Sep 08 11:58:25.845374 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '44bc75aa-0b86-4f08-8202-b9036e767a81'} Sep 08 11:58:25.845374 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:58:25.845374 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:58:25.845374 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:58:25.845374 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:58:25.845374 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:58:25.845374 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:58:25.845374 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:58:25.845374 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:58:25.845374 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:58:25.845374 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:58:25.845374 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44bc75aa-0b86-4f08-8202-b9036e767a81 could not be found. Sep 08 11:58:25.845374 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:58:25.845374 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:58:25.845374 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:58:25.845374 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:58:25.845374 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:58:25.845374 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:58:25.845374 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:58:25.845374 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:58:25.845374 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:58:25.845374 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:58:25.845374 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:58:25.845374 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:58:25.845374 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:58:25.845374 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:58:25.845374 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:58:25.845374 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:58:25.845374 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44bc75aa-0b86-4f08-8202-b9036e767a81 could not be found. Sep 08 11:58:25.845374 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:58:25.845374 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:58:25.850903 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:58:25.850903 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:58:25.850903 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:58:25.850903 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:58:25.850903 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:58:25.850903 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:58:25.850903 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44bc75aa-0b86-4f08-8202-b9036e767a81 could not be found. Sep 08 11:58:25.850903 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 11:58:25.850903 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-94934c3a-f3c5-47cd-8f12-829ea945d186 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Returning 404 to user: Instance 44bc75aa-0b86-4f08-8202-b9036e767a81 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:58:25.850903 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-94934c3a-f3c5-47cd-8f12-829ea945d186 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/44bc75aa-0b86-4f08-8202-b9036e767a81" status: 404 len: 111 microversion: 2.1 time: 0.032088 Sep 08 11:58:25.850903 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3712/7555] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:58:25 2022] GET /compute/v2.1/servers/44bc75aa-0b86-4f08-8202-b9036e767a81 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:58:29.199985 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6c84a008-b0d3-4d60-8931-9d536e4fff80 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '.version_select at 0x7f68e892fee0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:58:29.225549 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6c84a008-b0d3-4d60-8931-9d536e4fff80 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1802414351" status: 202 len: 0 microversion: 2.1 time: 0.029465 Sep 08 11:58:29.226172 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3844/7556] 10.222.0.27 () {58 vars in 1284 bytes} [Thu Sep 8 11:58:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1802414351 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:58:29.255319 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9ff69089-cb48-44ed-9426-c53f94d8a690 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Action: 'create', calling method: .version_select at 0x7f68e8af0310>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-72209515", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPhRIAv1JjUR5lr1r86UHsO7H3NXYYA7uYiONTeE+UPs1gGi4SNkdL6Fy8qbcFBdPogNARO8fqakqo1hcuPUeA4//8PGeLAhyuyI6XxrAncBqwGXT1rGBnCMonEAz2xYLA=="}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:58:29.263225 n-d-850501-12 devstack@n-api.service[128862]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 11:58:29.263371 n-d-850501-12 devstack@n-api.service[128862]: Thu Sep 8 11:58:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.27) !!! Sep 08 11:58:29.296523 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-9ff69089-cb48-44ed-9426-c53f94d8a690 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Getting quotas for project f00a6070707c4334b4beb7d530b15814. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:58:29.302687 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-9ff69089-cb48-44ed-9426-c53f94d8a690 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Getting quotas for user 4a16b57190c243a5b78e7717eb4a016b and project f00a6070707c4334b4beb7d530b15814. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:58:29.328294 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9ff69089-cb48-44ed-9426-c53f94d8a690 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.076972 Sep 08 11:58:29.328908 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3713/7557] 10.222.0.27 () {60 vars in 1159 bytes} [Thu Sep 8 11:58:29 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:58:35.264196 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:58:35.273302 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2b38f8bf-f24c-405d-bb82-0f0a396ee1d4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-628902605", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "acf0eac2-58c1-4c5a-90be-c48256504cb6"}], "key_name": "tempest-TestNetworkAdvancedServerOps-72209515", "security_groups": [{"name": "tempest-secgroup-smoke-378555303"}]}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:58:35.399305 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-2b38f8bf-f24c-405d-bb82-0f0a396ee1d4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] validate_networks() for [('acf0eac2-58c1-4c5a-90be-c48256504cb6', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:58:35.892149 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-2b38f8bf-f24c-405d-bb82-0f0a396ee1d4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:58:35.892586 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-2b38f8bf-f24c-405d-bb82-0f0a396ee1d4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:58:35.893096 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-2b38f8bf-f24c-405d-bb82-0f0a396ee1d4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:58:35.894838 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-2b38f8bf-f24c-405d-bb82-0f0a396ee1d4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:58:35.895633 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-2b38f8bf-f24c-405d-bb82-0f0a396ee1d4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:58:35.905172 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2b38f8bf-f24c-405d-bb82-0f0a396ee1d4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:58:35.905677 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2b38f8bf-f24c-405d-bb82-0f0a396ee1d4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:58:35.906127 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2b38f8bf-f24c-405d-bb82-0f0a396ee1d4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:58:35.906873 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2b38f8bf-f24c-405d-bb82-0f0a396ee1d4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:58:35.907342 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2b38f8bf-f24c-405d-bb82-0f0a396ee1d4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:58:35.907783 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2b38f8bf-f24c-405d-bb82-0f0a396ee1d4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:58:35.936248 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-2b38f8bf-f24c-405d-bb82-0f0a396ee1d4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Getting quotas for project f00a6070707c4334b4beb7d530b15814. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:58:35.943628 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-2b38f8bf-f24c-405d-bb82-0f0a396ee1d4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Getting quotas for user 4a16b57190c243a5b78e7717eb4a016b and project f00a6070707c4334b4beb7d530b15814. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:58:35.958666 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2b38f8bf-f24c-405d-bb82-0f0a396ee1d4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:58:35.965876 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2b38f8bf-f24c-405d-bb82-0f0a396ee1d4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: d52b08d3-0741-4be6-8935-779db732ae49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:58:36.025959 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2b38f8bf-f24c-405d-bb82-0f0a396ee1d4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.763463 Sep 08 11:58:36.027223 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3845/7558] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 11:58:35 2022] POST /compute/v2.1/servers => generated 405 bytes in 765 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:58:36.039617 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1b04c3f1-0936-4035-929e-fe93f5b9af86 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:58:36.041077 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1b04c3f1-0936-4035-929e-fe93f5b9af86 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: d52b08d3-0741-4be6-8935-779db732ae49] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:58:36.049716 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=16 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:58:36.111709 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1b04c3f1-0936-4035-929e-fe93f5b9af86 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:58:36.120546 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1b04c3f1-0936-4035-929e-fe93f5b9af86 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49" status: 200 len: 1264 microversion: 2.1 time: 0.086025 Sep 08 11:58:36.121352 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3714/7559] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:58:36 2022] GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49 => generated 1264 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:58:37.146884 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0841e292-a4cc-4f48-b84f-765a2fcae0b1 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:58:37.147508 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0841e292-a4cc-4f48-b84f-765a2fcae0b1 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: d52b08d3-0741-4be6-8935-779db732ae49] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:58:37.154735 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0841e292-a4cc-4f48-b84f-765a2fcae0b1 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:58:37.155397 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0841e292-a4cc-4f48-b84f-765a2fcae0b1 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:58:37.155920 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0841e292-a4cc-4f48-b84f-765a2fcae0b1 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:58:37.156842 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0841e292-a4cc-4f48-b84f-765a2fcae0b1 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:58:37.157339 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0841e292-a4cc-4f48-b84f-765a2fcae0b1 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:58:37.157776 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0841e292-a4cc-4f48-b84f-765a2fcae0b1 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:58:37.237529 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0841e292-a4cc-4f48-b84f-765a2fcae0b1 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:58:37.251905 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0841e292-a4cc-4f48-b84f-765a2fcae0b1 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49" status: 200 len: 1316 microversion: 2.1 time: 0.109967 Sep 08 11:58:37.254001 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3846/7560] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:58:37 2022] GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49 => generated 1316 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:58:38.276143 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-799ebd11-fe8c-4df7-b165-57834eb17071 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:58:38.277874 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-799ebd11-fe8c-4df7-b165-57834eb17071 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: d52b08d3-0741-4be6-8935-779db732ae49] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:58:38.286205 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-799ebd11-fe8c-4df7-b165-57834eb17071 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:58:38.286727 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-799ebd11-fe8c-4df7-b165-57834eb17071 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:58:38.287260 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-799ebd11-fe8c-4df7-b165-57834eb17071 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:58:38.288011 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-799ebd11-fe8c-4df7-b165-57834eb17071 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:58:38.288497 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-799ebd11-fe8c-4df7-b165-57834eb17071 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:58:38.288946 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-799ebd11-fe8c-4df7-b165-57834eb17071 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:58:38.509633 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-799ebd11-fe8c-4df7-b165-57834eb17071 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:58:38.517546 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-799ebd11-fe8c-4df7-b165-57834eb17071 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49" status: 200 len: 1389 microversion: 2.1 time: 0.245511 Sep 08 11:58:38.518149 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3715/7561] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:58:38 2022] GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49 => generated 1389 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:58:38.866114 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-587fb52b-1d29-43ff-987a-791855e4451d req-6fe12276-3054-47a0-b701-1da30dcaf3df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d52b08d3-0741-4be6-8935-779db732ae49", "tag": "5372787c-b9e9-45d4-b439-04dbca635e62"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:58:38.883113 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-587fb52b-1d29-43ff-987a-791855e4451d req-6fe12276-3054-47a0-b701-1da30dcaf3df service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:58:38.883606 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-587fb52b-1d29-43ff-987a-791855e4451d req-6fe12276-3054-47a0-b701-1da30dcaf3df service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:58:38.884049 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-587fb52b-1d29-43ff-987a-791855e4451d req-6fe12276-3054-47a0-b701-1da30dcaf3df service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:58:38.920565 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-587fb52b-1d29-43ff-987a-791855e4451d req-6fe12276-3054-47a0-b701-1da30dcaf3df service nova] Creating event network-changed:5372787c-b9e9-45d4-b439-04dbca635e62 for instance d52b08d3-0741-4be6-8935-779db732ae49 on n-h2-850501-12 Sep 08 11:58:38.927324 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-587fb52b-1d29-43ff-987a-791855e4451d req-6fe12276-3054-47a0-b701-1da30dcaf3df service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068166 Sep 08 11:58:38.928146 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3847/7562] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:58:39.541728 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b9b21ba3-4c1e-4660-abd0-438cbad8599e tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:58:39.542376 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b9b21ba3-4c1e-4660-abd0-438cbad8599e tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: d52b08d3-0741-4be6-8935-779db732ae49] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:58:39.549288 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b9b21ba3-4c1e-4660-abd0-438cbad8599e tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:58:39.549790 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b9b21ba3-4c1e-4660-abd0-438cbad8599e tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:58:39.550974 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b9b21ba3-4c1e-4660-abd0-438cbad8599e tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:58:39.551698 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b9b21ba3-4c1e-4660-abd0-438cbad8599e tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:58:39.552164 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b9b21ba3-4c1e-4660-abd0-438cbad8599e tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:58:39.552603 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b9b21ba3-4c1e-4660-abd0-438cbad8599e tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:58:39.683605 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b9b21ba3-4c1e-4660-abd0-438cbad8599e tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:58:39.691544 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b9b21ba3-4c1e-4660-abd0-438cbad8599e tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49" status: 200 len: 1389 microversion: 2.1 time: 0.153616 Sep 08 11:58:39.692128 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3716/7563] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:58:39 2022] GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49 => generated 1389 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:58:40.717216 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-634fca7f-8ba9-4a11-bfc2-c2b3c11cc410 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:58:40.717933 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-634fca7f-8ba9-4a11-bfc2-c2b3c11cc410 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: d52b08d3-0741-4be6-8935-779db732ae49] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:58:40.725791 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-634fca7f-8ba9-4a11-bfc2-c2b3c11cc410 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:58:40.726307 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-634fca7f-8ba9-4a11-bfc2-c2b3c11cc410 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:58:40.726721 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-634fca7f-8ba9-4a11-bfc2-c2b3c11cc410 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:58:40.727480 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-634fca7f-8ba9-4a11-bfc2-c2b3c11cc410 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:58:40.727993 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-634fca7f-8ba9-4a11-bfc2-c2b3c11cc410 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:58:40.728550 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-634fca7f-8ba9-4a11-bfc2-c2b3c11cc410 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:58:40.871690 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-634fca7f-8ba9-4a11-bfc2-c2b3c11cc410 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:58:40.879629 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-634fca7f-8ba9-4a11-bfc2-c2b3c11cc410 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49" status: 200 len: 1389 microversion: 2.1 time: 0.168908 Sep 08 11:58:40.880201 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3848/7564] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:58:40 2022] GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49 => generated 1389 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:58:41.903285 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-eb9b5eea-3bbb-4950-95c8-f5e855d181fa tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:58:41.903908 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-eb9b5eea-3bbb-4950-95c8-f5e855d181fa tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: d52b08d3-0741-4be6-8935-779db732ae49] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:58:41.911333 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb9b5eea-3bbb-4950-95c8-f5e855d181fa tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:58:41.911862 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb9b5eea-3bbb-4950-95c8-f5e855d181fa tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:58:41.912943 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb9b5eea-3bbb-4950-95c8-f5e855d181fa tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:58:41.913707 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb9b5eea-3bbb-4950-95c8-f5e855d181fa tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:58:41.914182 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb9b5eea-3bbb-4950-95c8-f5e855d181fa tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:58:41.914626 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb9b5eea-3bbb-4950-95c8-f5e855d181fa tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:58:42.049289 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-eb9b5eea-3bbb-4950-95c8-f5e855d181fa tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:58:42.057939 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-eb9b5eea-3bbb-4950-95c8-f5e855d181fa tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49" status: 200 len: 1389 microversion: 2.1 time: 0.158516 Sep 08 11:58:42.058537 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3717/7565] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:58:41 2022] GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49 => generated 1389 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:58:43.081704 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f4875afe-bd01-4dc5-b2b7-f3dc48d5bb40 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:58:43.083029 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f4875afe-bd01-4dc5-b2b7-f3dc48d5bb40 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: d52b08d3-0741-4be6-8935-779db732ae49] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:58:43.091505 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f4875afe-bd01-4dc5-b2b7-f3dc48d5bb40 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:58:43.092000 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f4875afe-bd01-4dc5-b2b7-f3dc48d5bb40 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:58:43.092441 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f4875afe-bd01-4dc5-b2b7-f3dc48d5bb40 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:58:43.093209 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f4875afe-bd01-4dc5-b2b7-f3dc48d5bb40 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:58:43.093676 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f4875afe-bd01-4dc5-b2b7-f3dc48d5bb40 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:58:43.094107 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f4875afe-bd01-4dc5-b2b7-f3dc48d5bb40 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:58:43.230582 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f4875afe-bd01-4dc5-b2b7-f3dc48d5bb40 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:58:43.239574 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f4875afe-bd01-4dc5-b2b7-f3dc48d5bb40 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49" status: 200 len: 1389 microversion: 2.1 time: 0.161683 Sep 08 11:58:43.240192 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3849/7566] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:58:43 2022] GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49 => generated 1389 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:58:44.262850 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-aca0f317-a72e-4aee-b9f3-b0ed641305c8 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:58:44.263480 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-aca0f317-a72e-4aee-b9f3-b0ed641305c8 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: d52b08d3-0741-4be6-8935-779db732ae49] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:58:44.270521 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aca0f317-a72e-4aee-b9f3-b0ed641305c8 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:58:44.271022 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aca0f317-a72e-4aee-b9f3-b0ed641305c8 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:58:44.271473 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aca0f317-a72e-4aee-b9f3-b0ed641305c8 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:58:44.272177 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aca0f317-a72e-4aee-b9f3-b0ed641305c8 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:58:44.272644 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aca0f317-a72e-4aee-b9f3-b0ed641305c8 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:58:44.273111 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aca0f317-a72e-4aee-b9f3-b0ed641305c8 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:58:44.404396 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-aca0f317-a72e-4aee-b9f3-b0ed641305c8 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:58:44.412546 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-aca0f317-a72e-4aee-b9f3-b0ed641305c8 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49" status: 200 len: 1389 microversion: 2.1 time: 0.153608 Sep 08 11:58:44.413140 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3718/7567] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:58:44 2022] GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49 => generated 1389 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:58:45.317482 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-a9a353c3-aad6-4c88-b5a3-5d8ab5df82a5 req-f6870fa9-ff67-4e54-a7a5-c55147b47db9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d52b08d3-0741-4be6-8935-779db732ae49", "name": "network-vif-plugged", "status": "completed", "tag": "5372787c-b9e9-45d4-b439-04dbca635e62"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:58:45.327406 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-a9a353c3-aad6-4c88-b5a3-5d8ab5df82a5 req-f6870fa9-ff67-4e54-a7a5-c55147b47db9 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:58:45.327893 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-a9a353c3-aad6-4c88-b5a3-5d8ab5df82a5 req-f6870fa9-ff67-4e54-a7a5-c55147b47db9 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:58:45.328326 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-a9a353c3-aad6-4c88-b5a3-5d8ab5df82a5 req-f6870fa9-ff67-4e54-a7a5-c55147b47db9 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:58:45.340109 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-a9a353c3-aad6-4c88-b5a3-5d8ab5df82a5 req-f6870fa9-ff67-4e54-a7a5-c55147b47db9 service nova] Creating event network-vif-plugged:5372787c-b9e9-45d4-b439-04dbca635e62 for instance d52b08d3-0741-4be6-8935-779db732ae49 on n-h2-850501-12 Sep 08 11:58:45.345013 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-a9a353c3-aad6-4c88-b5a3-5d8ab5df82a5 req-f6870fa9-ff67-4e54-a7a5-c55147b47db9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098550 Sep 08 11:58:45.345634 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3850/7568] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:58:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:58:45.435995 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-abf38378-a3a3-410e-9b88-b9c2d92412d2 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:58:45.436618 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-abf38378-a3a3-410e-9b88-b9c2d92412d2 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: d52b08d3-0741-4be6-8935-779db732ae49] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:58:45.439338 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:58:45.447012 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-abf38378-a3a3-410e-9b88-b9c2d92412d2 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:58:45.447528 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-abf38378-a3a3-410e-9b88-b9c2d92412d2 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:58:45.447979 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-abf38378-a3a3-410e-9b88-b9c2d92412d2 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:58:45.448705 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-abf38378-a3a3-410e-9b88-b9c2d92412d2 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:58:45.449234 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-abf38378-a3a3-410e-9b88-b9c2d92412d2 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:58:45.449678 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-abf38378-a3a3-410e-9b88-b9c2d92412d2 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:58:45.605899 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-abf38378-a3a3-410e-9b88-b9c2d92412d2 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:58:45.614185 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-abf38378-a3a3-410e-9b88-b9c2d92412d2 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49" status: 200 len: 1389 microversion: 2.1 time: 0.181864 Sep 08 11:58:45.614760 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3719/7569] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:58:45 2022] GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49 => generated 1389 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:58:46.634927 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:58:46.635723 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=6 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:58:46.641190 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-46c7996c-7e74-4b88-9760-4a26cacfcf3c tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:58:46.641857 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-46c7996c-7e74-4b88-9760-4a26cacfcf3c tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: d52b08d3-0741-4be6-8935-779db732ae49] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:58:46.649920 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-46c7996c-7e74-4b88-9760-4a26cacfcf3c tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:58:46.650432 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-46c7996c-7e74-4b88-9760-4a26cacfcf3c tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:58:46.650881 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-46c7996c-7e74-4b88-9760-4a26cacfcf3c tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:58:46.651600 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-46c7996c-7e74-4b88-9760-4a26cacfcf3c tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:58:46.652100 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-46c7996c-7e74-4b88-9760-4a26cacfcf3c tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:58:46.652484 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-46c7996c-7e74-4b88-9760-4a26cacfcf3c tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:58:46.808852 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-46c7996c-7e74-4b88-9760-4a26cacfcf3c tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:58:46.818226 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-46c7996c-7e74-4b88-9760-4a26cacfcf3c tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49" status: 200 len: 1389 microversion: 2.1 time: 0.184207 Sep 08 11:58:46.818966 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3851/7570] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:58:46 2022] GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49 => generated 1389 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:58:47.842959 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-90ddbd7a-1669-41e8-b220-a516b9a08c2b tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:58:47.843600 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-90ddbd7a-1669-41e8-b220-a516b9a08c2b tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: d52b08d3-0741-4be6-8935-779db732ae49] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:58:47.845511 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:58:47.852541 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-90ddbd7a-1669-41e8-b220-a516b9a08c2b tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:58:47.853088 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-90ddbd7a-1669-41e8-b220-a516b9a08c2b tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:58:47.853553 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-90ddbd7a-1669-41e8-b220-a516b9a08c2b tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:58:47.854265 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-90ddbd7a-1669-41e8-b220-a516b9a08c2b tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:58:47.854736 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-90ddbd7a-1669-41e8-b220-a516b9a08c2b tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:58:47.855181 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-90ddbd7a-1669-41e8-b220-a516b9a08c2b tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:58:47.994704 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-90ddbd7a-1669-41e8-b220-a516b9a08c2b tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:58:48.002517 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-90ddbd7a-1669-41e8-b220-a516b9a08c2b tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49" status: 200 len: 1560 microversion: 2.1 time: 0.163507 Sep 08 11:58:48.003090 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3720/7571] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:58:47 2022] GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:58:48.026027 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0e0e5bcf-1872-4bd3-80dd-ca50c226fca6 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:58:48.026680 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0e0e5bcf-1872-4bd3-80dd-ca50c226fca6 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: d52b08d3-0741-4be6-8935-779db732ae49] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:58:48.034376 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e0e5bcf-1872-4bd3-80dd-ca50c226fca6 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:58:48.035550 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e0e5bcf-1872-4bd3-80dd-ca50c226fca6 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:58:48.036457 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e0e5bcf-1872-4bd3-80dd-ca50c226fca6 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:58:48.037313 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e0e5bcf-1872-4bd3-80dd-ca50c226fca6 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:58:48.037843 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e0e5bcf-1872-4bd3-80dd-ca50c226fca6 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:58:48.038285 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e0e5bcf-1872-4bd3-80dd-ca50c226fca6 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:58:48.183370 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0e0e5bcf-1872-4bd3-80dd-ca50c226fca6 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:58:48.191735 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0e0e5bcf-1872-4bd3-80dd-ca50c226fca6 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49" status: 200 len: 1560 microversion: 2.1 time: 0.169828 Sep 08 11:58:48.192350 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3852/7572] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:58:48 2022] GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49 => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:58:50.085621 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a7d1c26b-8449-47bf-b247-95e1276cd5d0 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:58:50.086259 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a7d1c26b-8449-47bf-b247-95e1276cd5d0 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: d52b08d3-0741-4be6-8935-779db732ae49] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:58:50.088065 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-267b7fcd-0fe4-4a03-bd67-0455e9f55bc0 req-577c7c5f-d5c7-4e24-bc22-b7a538b5cf07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d52b08d3-0741-4be6-8935-779db732ae49", "tag": "5372787c-b9e9-45d4-b439-04dbca635e62"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:58:50.093200 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a7d1c26b-8449-47bf-b247-95e1276cd5d0 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:58:50.093711 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a7d1c26b-8449-47bf-b247-95e1276cd5d0 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:58:50.094164 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a7d1c26b-8449-47bf-b247-95e1276cd5d0 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:58:50.095117 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a7d1c26b-8449-47bf-b247-95e1276cd5d0 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:58:50.095816 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a7d1c26b-8449-47bf-b247-95e1276cd5d0 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:58:50.096509 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a7d1c26b-8449-47bf-b247-95e1276cd5d0 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:58:50.101372 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-267b7fcd-0fe4-4a03-bd67-0455e9f55bc0 req-577c7c5f-d5c7-4e24-bc22-b7a538b5cf07 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:58:50.101867 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-267b7fcd-0fe4-4a03-bd67-0455e9f55bc0 req-577c7c5f-d5c7-4e24-bc22-b7a538b5cf07 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:58:50.102324 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-267b7fcd-0fe4-4a03-bd67-0455e9f55bc0 req-577c7c5f-d5c7-4e24-bc22-b7a538b5cf07 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:58:50.116145 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-267b7fcd-0fe4-4a03-bd67-0455e9f55bc0 req-577c7c5f-d5c7-4e24-bc22-b7a538b5cf07 service nova] Creating event network-changed:5372787c-b9e9-45d4-b439-04dbca635e62 for instance d52b08d3-0741-4be6-8935-779db732ae49 on n-h2-850501-12 Sep 08 11:58:50.121829 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-267b7fcd-0fe4-4a03-bd67-0455e9f55bc0 req-577c7c5f-d5c7-4e24-bc22-b7a538b5cf07 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038294 Sep 08 11:58:50.122823 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3853/7573] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:58:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:58:50.326411 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a7d1c26b-8449-47bf-b247-95e1276cd5d0 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:58:50.335631 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a7d1c26b-8449-47bf-b247-95e1276cd5d0 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49" status: 200 len: 1560 microversion: 2.1 time: 0.255038 Sep 08 11:58:50.336542 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3721/7574] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:58:50 2022] GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49 => generated 1560 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:59:13.663618 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d958ee0b-8a47-43ee-a3b1-00a0406765b2 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:59:13.665901 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d958ee0b-8a47-43ee-a3b1-00a0406765b2 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: d52b08d3-0741-4be6-8935-779db732ae49] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:59:13.668381 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:59:13.669064 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=38 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:59:13.676547 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d958ee0b-8a47-43ee-a3b1-00a0406765b2 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:59:13.677070 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d958ee0b-8a47-43ee-a3b1-00a0406765b2 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:59:13.677843 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d958ee0b-8a47-43ee-a3b1-00a0406765b2 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:59:13.678602 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d958ee0b-8a47-43ee-a3b1-00a0406765b2 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:59:13.679072 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d958ee0b-8a47-43ee-a3b1-00a0406765b2 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:59:13.679528 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d958ee0b-8a47-43ee-a3b1-00a0406765b2 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:59:13.737760 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d958ee0b-8a47-43ee-a3b1-00a0406765b2 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "POST /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49/action" status: 200 len: 24512 microversion: 2.1 time: 0.079246 Sep 08 11:59:13.738448 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3854/7575] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 11:59:13 2022] POST /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49/action => generated 24512 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 11:59:24.669165 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5db39e55-60ce-447a-9df3-e2928c28d296 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:59:24.671440 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5db39e55-60ce-447a-9df3-e2928c28d296 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: d52b08d3-0741-4be6-8935-779db732ae49] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:59:24.673545 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=5 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:59:24.674390 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=42 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:59:24.680217 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5db39e55-60ce-447a-9df3-e2928c28d296 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:59:24.680729 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5db39e55-60ce-447a-9df3-e2928c28d296 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:59:24.681223 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5db39e55-60ce-447a-9df3-e2928c28d296 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:59:24.681945 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5db39e55-60ce-447a-9df3-e2928c28d296 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:59:24.682413 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5db39e55-60ce-447a-9df3-e2928c28d296 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:59:24.682854 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5db39e55-60ce-447a-9df3-e2928c28d296 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:59:24.780337 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5db39e55-60ce-447a-9df3-e2928c28d296 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:59:24.787302 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5db39e55-60ce-447a-9df3-e2928c28d296 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: d52b08d3-0741-4be6-8935-779db732ae49] Old instance type m1.heat2, new instance type m1.heat {{(pid=128862) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 08 11:59:24.793964 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-5db39e55-60ce-447a-9df3-e2928c28d296 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:59:24.794406 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-5db39e55-60ce-447a-9df3-e2928c28d296 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:59:24.794898 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-5db39e55-60ce-447a-9df3-e2928c28d296 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:59:24.795328 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-5db39e55-60ce-447a-9df3-e2928c28d296 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:59:24.795760 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-5db39e55-60ce-447a-9df3-e2928c28d296 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:59:24.868623 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5db39e55-60ce-447a-9df3-e2928c28d296 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "POST /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49/action" status: 202 len: 0 microversion: 2.1 time: 0.203715 Sep 08 11:59:24.869326 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3722/7576] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 11:59:24 2022] POST /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49/action => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:59:24.877990 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-14286757-5251-4618-89f5-67ae10e7edef tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:59:24.879153 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-14286757-5251-4618-89f5-67ae10e7edef tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: d52b08d3-0741-4be6-8935-779db732ae49] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:59:24.882292 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=4 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:59:24.882907 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:59:24.889863 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-14286757-5251-4618-89f5-67ae10e7edef tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:59:24.890360 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-14286757-5251-4618-89f5-67ae10e7edef tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:59:24.890800 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-14286757-5251-4618-89f5-67ae10e7edef tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:59:24.891510 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-14286757-5251-4618-89f5-67ae10e7edef tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:59:24.891966 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-14286757-5251-4618-89f5-67ae10e7edef tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:59:24.893247 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-14286757-5251-4618-89f5-67ae10e7edef tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:59:25.046915 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-14286757-5251-4618-89f5-67ae10e7edef tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:59:25.056068 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-14286757-5251-4618-89f5-67ae10e7edef tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49" status: 200 len: 1687 microversion: 2.1 time: 0.182311 Sep 08 11:59:25.056750 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3855/7577] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:59:24 2022] GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49 => generated 1687 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:59:26.080363 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2cddb7bc-5ed7-4694-9603-1cd0e9d2b6ee tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:59:26.081157 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2cddb7bc-5ed7-4694-9603-1cd0e9d2b6ee tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: d52b08d3-0741-4be6-8935-779db732ae49] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:59:26.089145 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2cddb7bc-5ed7-4694-9603-1cd0e9d2b6ee tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:59:26.089678 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2cddb7bc-5ed7-4694-9603-1cd0e9d2b6ee tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:59:26.090136 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2cddb7bc-5ed7-4694-9603-1cd0e9d2b6ee tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:59:26.090892 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2cddb7bc-5ed7-4694-9603-1cd0e9d2b6ee tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:59:26.091364 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2cddb7bc-5ed7-4694-9603-1cd0e9d2b6ee tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:59:26.091806 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2cddb7bc-5ed7-4694-9603-1cd0e9d2b6ee tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:59:26.234425 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2cddb7bc-5ed7-4694-9603-1cd0e9d2b6ee tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:59:26.243434 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2cddb7bc-5ed7-4694-9603-1cd0e9d2b6ee tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49" status: 200 len: 1687 microversion: 2.1 time: 0.168123 Sep 08 11:59:26.244031 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3723/7578] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:59:26 2022] GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49 => generated 1687 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:59:27.269889 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-77356df1-11aa-4a52-b4fa-71ae7f7c0fcf tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:59:27.271587 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-77356df1-11aa-4a52-b4fa-71ae7f7c0fcf tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: d52b08d3-0741-4be6-8935-779db732ae49] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:59:27.278376 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-77356df1-11aa-4a52-b4fa-71ae7f7c0fcf tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:59:27.278919 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-77356df1-11aa-4a52-b4fa-71ae7f7c0fcf tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:59:27.279473 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-77356df1-11aa-4a52-b4fa-71ae7f7c0fcf tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:59:27.280463 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-77356df1-11aa-4a52-b4fa-71ae7f7c0fcf tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:59:27.280963 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-77356df1-11aa-4a52-b4fa-71ae7f7c0fcf tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:59:27.281502 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-77356df1-11aa-4a52-b4fa-71ae7f7c0fcf tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:59:27.421587 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-77356df1-11aa-4a52-b4fa-71ae7f7c0fcf tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:59:27.430086 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-77356df1-11aa-4a52-b4fa-71ae7f7c0fcf tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49" status: 200 len: 1687 microversion: 2.1 time: 0.165203 Sep 08 11:59:27.430658 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3856/7579] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:59:27 2022] GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49 => generated 1687 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:59:28.453978 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7e392ada-64f2-438f-8abe-07356ec5abd1 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:59:28.454613 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7e392ada-64f2-438f-8abe-07356ec5abd1 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: d52b08d3-0741-4be6-8935-779db732ae49] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:59:28.462281 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e392ada-64f2-438f-8abe-07356ec5abd1 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:59:28.462795 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e392ada-64f2-438f-8abe-07356ec5abd1 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:59:28.463254 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e392ada-64f2-438f-8abe-07356ec5abd1 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:59:28.463979 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e392ada-64f2-438f-8abe-07356ec5abd1 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:59:28.464455 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e392ada-64f2-438f-8abe-07356ec5abd1 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:59:28.464941 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e392ada-64f2-438f-8abe-07356ec5abd1 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:59:28.602334 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7e392ada-64f2-438f-8abe-07356ec5abd1 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:59:28.610056 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7e392ada-64f2-438f-8abe-07356ec5abd1 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49" status: 200 len: 1692 microversion: 2.1 time: 0.160003 Sep 08 11:59:28.610624 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3724/7580] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:59:28 2022] GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49 => generated 1692 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:59:29.634283 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-75178e11-57c8-42bc-a092-a5aa847268c8 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:59:29.634900 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-75178e11-57c8-42bc-a092-a5aa847268c8 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: d52b08d3-0741-4be6-8935-779db732ae49] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:59:29.641687 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-75178e11-57c8-42bc-a092-a5aa847268c8 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:59:29.642178 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-75178e11-57c8-42bc-a092-a5aa847268c8 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:59:29.642612 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-75178e11-57c8-42bc-a092-a5aa847268c8 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:59:29.643304 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-75178e11-57c8-42bc-a092-a5aa847268c8 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:59:29.643867 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-75178e11-57c8-42bc-a092-a5aa847268c8 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:59:29.644304 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-75178e11-57c8-42bc-a092-a5aa847268c8 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:59:29.776546 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-75178e11-57c8-42bc-a092-a5aa847268c8 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:59:29.784442 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-75178e11-57c8-42bc-a092-a5aa847268c8 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49" status: 200 len: 1692 microversion: 2.1 time: 0.154426 Sep 08 11:59:29.785041 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3857/7581] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:59:29 2022] GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49 => generated 1692 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:59:30.809635 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-352e191f-fc8b-4074-839e-4cac7180a91d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:59:30.810269 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-352e191f-fc8b-4074-839e-4cac7180a91d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: d52b08d3-0741-4be6-8935-779db732ae49] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:59:30.816964 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-352e191f-fc8b-4074-839e-4cac7180a91d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:59:30.817549 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-352e191f-fc8b-4074-839e-4cac7180a91d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:59:30.818295 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-352e191f-fc8b-4074-839e-4cac7180a91d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:59:30.819023 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-352e191f-fc8b-4074-839e-4cac7180a91d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:59:30.819505 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-352e191f-fc8b-4074-839e-4cac7180a91d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:59:30.819955 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-352e191f-fc8b-4074-839e-4cac7180a91d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:59:30.965273 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-352e191f-fc8b-4074-839e-4cac7180a91d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:59:30.973317 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-352e191f-fc8b-4074-839e-4cac7180a91d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49" status: 200 len: 1692 microversion: 2.1 time: 0.167791 Sep 08 11:59:30.974529 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3725/7582] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:59:30 2022] GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49 => generated 1692 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:59:31.998182 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e591c97b-d228-44ed-ac55-6f0f0849474d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:59:31.998803 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e591c97b-d228-44ed-ac55-6f0f0849474d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: d52b08d3-0741-4be6-8935-779db732ae49] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:59:32.006546 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e591c97b-d228-44ed-ac55-6f0f0849474d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:59:32.007044 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e591c97b-d228-44ed-ac55-6f0f0849474d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:59:32.007489 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e591c97b-d228-44ed-ac55-6f0f0849474d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:59:32.008197 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e591c97b-d228-44ed-ac55-6f0f0849474d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:59:32.008661 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e591c97b-d228-44ed-ac55-6f0f0849474d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:59:32.009128 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e591c97b-d228-44ed-ac55-6f0f0849474d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:59:32.144583 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e591c97b-d228-44ed-ac55-6f0f0849474d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:59:32.152537 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e591c97b-d228-44ed-ac55-6f0f0849474d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49" status: 200 len: 1692 microversion: 2.1 time: 0.158336 Sep 08 11:59:32.153162 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3858/7583] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:59:31 2022] GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49 => generated 1692 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:59:33.176041 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a587e3d8-516e-4588-b154-ffba00a66887 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:59:33.176837 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a587e3d8-516e-4588-b154-ffba00a66887 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: d52b08d3-0741-4be6-8935-779db732ae49] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:59:33.184077 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a587e3d8-516e-4588-b154-ffba00a66887 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:59:33.184587 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a587e3d8-516e-4588-b154-ffba00a66887 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:59:33.185091 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a587e3d8-516e-4588-b154-ffba00a66887 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:59:33.185851 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a587e3d8-516e-4588-b154-ffba00a66887 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:59:33.186325 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a587e3d8-516e-4588-b154-ffba00a66887 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:59:33.186797 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a587e3d8-516e-4588-b154-ffba00a66887 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:59:33.322274 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a587e3d8-516e-4588-b154-ffba00a66887 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:59:33.332810 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a587e3d8-516e-4588-b154-ffba00a66887 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49" status: 200 len: 1692 microversion: 2.1 time: 0.160908 Sep 08 11:59:33.333834 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3726/7584] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:59:33 2022] GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49 => generated 1692 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:59:34.357702 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ae59d67c-125f-4b16-b8b0-eaa76bd6015e tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:59:34.358320 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ae59d67c-125f-4b16-b8b0-eaa76bd6015e tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: d52b08d3-0741-4be6-8935-779db732ae49] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:59:34.366003 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ae59d67c-125f-4b16-b8b0-eaa76bd6015e tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:59:34.366492 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ae59d67c-125f-4b16-b8b0-eaa76bd6015e tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:59:34.366957 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ae59d67c-125f-4b16-b8b0-eaa76bd6015e tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:59:34.367700 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ae59d67c-125f-4b16-b8b0-eaa76bd6015e tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:59:34.368158 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ae59d67c-125f-4b16-b8b0-eaa76bd6015e tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:59:34.368592 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ae59d67c-125f-4b16-b8b0-eaa76bd6015e tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:59:34.508230 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ae59d67c-125f-4b16-b8b0-eaa76bd6015e tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:59:34.517384 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ae59d67c-125f-4b16-b8b0-eaa76bd6015e tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49" status: 200 len: 1692 microversion: 2.1 time: 0.163825 Sep 08 11:59:34.517971 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3859/7585] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:59:34 2022] GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49 => generated 1692 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:59:35.543405 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bf6791c7-f504-4c96-b701-128ec8c07bd6 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:59:35.544025 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bf6791c7-f504-4c96-b701-128ec8c07bd6 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: d52b08d3-0741-4be6-8935-779db732ae49] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:59:35.551341 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf6791c7-f504-4c96-b701-128ec8c07bd6 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:59:35.551856 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf6791c7-f504-4c96-b701-128ec8c07bd6 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:59:35.552320 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf6791c7-f504-4c96-b701-128ec8c07bd6 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:59:35.553940 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf6791c7-f504-4c96-b701-128ec8c07bd6 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:59:35.554450 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf6791c7-f504-4c96-b701-128ec8c07bd6 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:59:35.554904 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf6791c7-f504-4c96-b701-128ec8c07bd6 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:59:35.695568 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bf6791c7-f504-4c96-b701-128ec8c07bd6 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:59:35.703721 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bf6791c7-f504-4c96-b701-128ec8c07bd6 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49" status: 200 len: 1692 microversion: 2.1 time: 0.164165 Sep 08 11:59:35.704532 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3727/7586] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:59:35 2022] GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49 => generated 1692 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:59:36.730308 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-19566345-0de2-4145-b225-adb180b7ea78 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:59:36.730945 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-19566345-0de2-4145-b225-adb180b7ea78 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: d52b08d3-0741-4be6-8935-779db732ae49] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:59:36.738338 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-19566345-0de2-4145-b225-adb180b7ea78 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:59:36.739096 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-19566345-0de2-4145-b225-adb180b7ea78 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:59:36.739539 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-19566345-0de2-4145-b225-adb180b7ea78 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:59:36.740257 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-19566345-0de2-4145-b225-adb180b7ea78 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:59:36.740719 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-19566345-0de2-4145-b225-adb180b7ea78 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:59:36.741183 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-19566345-0de2-4145-b225-adb180b7ea78 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:59:36.877868 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-19566345-0de2-4145-b225-adb180b7ea78 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:59:36.885760 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-19566345-0de2-4145-b225-adb180b7ea78 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49" status: 200 len: 1692 microversion: 2.1 time: 0.160104 Sep 08 11:59:36.886339 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3860/7587] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:59:36 2022] GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49 => generated 1692 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:59:37.909811 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-16ae505c-9416-4172-a798-5a2ea35fe504 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:59:37.910441 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-16ae505c-9416-4172-a798-5a2ea35fe504 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: d52b08d3-0741-4be6-8935-779db732ae49] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:59:37.918075 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-16ae505c-9416-4172-a798-5a2ea35fe504 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:59:37.918578 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-16ae505c-9416-4172-a798-5a2ea35fe504 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:59:37.919025 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-16ae505c-9416-4172-a798-5a2ea35fe504 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:59:37.919735 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-16ae505c-9416-4172-a798-5a2ea35fe504 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:59:37.920200 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-16ae505c-9416-4172-a798-5a2ea35fe504 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:59:37.920635 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-16ae505c-9416-4172-a798-5a2ea35fe504 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:59:38.056060 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-16ae505c-9416-4172-a798-5a2ea35fe504 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:59:38.063924 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-16ae505c-9416-4172-a798-5a2ea35fe504 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49" status: 200 len: 1692 microversion: 2.1 time: 0.158314 Sep 08 11:59:38.064498 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3728/7588] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:59:37 2022] GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49 => generated 1692 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:59:39.087474 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-89a96406-5f8f-478b-8cd7-5882e720bc18 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:59:39.088144 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-89a96406-5f8f-478b-8cd7-5882e720bc18 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: d52b08d3-0741-4be6-8935-779db732ae49] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:59:39.095182 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-89a96406-5f8f-478b-8cd7-5882e720bc18 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:59:39.095673 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-89a96406-5f8f-478b-8cd7-5882e720bc18 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:59:39.096117 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-89a96406-5f8f-478b-8cd7-5882e720bc18 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:59:39.096814 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-89a96406-5f8f-478b-8cd7-5882e720bc18 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:59:39.097312 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-89a96406-5f8f-478b-8cd7-5882e720bc18 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:59:39.097753 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-89a96406-5f8f-478b-8cd7-5882e720bc18 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:59:39.237482 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-89a96406-5f8f-478b-8cd7-5882e720bc18 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:59:39.247961 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-89a96406-5f8f-478b-8cd7-5882e720bc18 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49" status: 200 len: 1692 microversion: 2.1 time: 0.164621 Sep 08 11:59:39.248549 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3861/7589] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:59:39 2022] GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49 => generated 1692 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:59:40.272067 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7b7e6047-cc9a-470b-91bb-cdbf65696751 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:59:40.272688 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7b7e6047-cc9a-470b-91bb-cdbf65696751 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: d52b08d3-0741-4be6-8935-779db732ae49] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:59:40.279571 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7b7e6047-cc9a-470b-91bb-cdbf65696751 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:59:40.280087 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7b7e6047-cc9a-470b-91bb-cdbf65696751 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:59:40.280529 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7b7e6047-cc9a-470b-91bb-cdbf65696751 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:59:40.281398 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7b7e6047-cc9a-470b-91bb-cdbf65696751 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:59:40.281881 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7b7e6047-cc9a-470b-91bb-cdbf65696751 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:59:40.282469 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7b7e6047-cc9a-470b-91bb-cdbf65696751 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:59:40.418123 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7b7e6047-cc9a-470b-91bb-cdbf65696751 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:59:40.425923 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7b7e6047-cc9a-470b-91bb-cdbf65696751 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49" status: 200 len: 1692 microversion: 2.1 time: 0.157749 Sep 08 11:59:40.426507 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3729/7590] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:59:40 2022] GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49 => generated 1692 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:59:41.450170 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1cf69d57-45b4-4c5f-8c28-44d581d1bcea tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:59:41.450791 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1cf69d57-45b4-4c5f-8c28-44d581d1bcea tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: d52b08d3-0741-4be6-8935-779db732ae49] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:59:41.459826 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1cf69d57-45b4-4c5f-8c28-44d581d1bcea tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:59:41.460371 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1cf69d57-45b4-4c5f-8c28-44d581d1bcea tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:59:41.460896 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1cf69d57-45b4-4c5f-8c28-44d581d1bcea tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:59:41.461631 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1cf69d57-45b4-4c5f-8c28-44d581d1bcea tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:59:41.462097 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1cf69d57-45b4-4c5f-8c28-44d581d1bcea tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:59:41.462531 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1cf69d57-45b4-4c5f-8c28-44d581d1bcea tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:59:41.594095 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1cf69d57-45b4-4c5f-8c28-44d581d1bcea tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:59:41.602330 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1cf69d57-45b4-4c5f-8c28-44d581d1bcea tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49" status: 200 len: 1692 microversion: 2.1 time: 0.156109 Sep 08 11:59:41.602896 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3862/7591] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:59:41 2022] GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49 => generated 1692 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:59:42.626551 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-aed29be3-788b-4f08-898f-9a95dff38dec tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:59:42.627165 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-aed29be3-788b-4f08-898f-9a95dff38dec tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: d52b08d3-0741-4be6-8935-779db732ae49] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:59:42.635070 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aed29be3-788b-4f08-898f-9a95dff38dec tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:59:42.635572 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aed29be3-788b-4f08-898f-9a95dff38dec tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:59:42.636027 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aed29be3-788b-4f08-898f-9a95dff38dec tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:59:42.636744 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aed29be3-788b-4f08-898f-9a95dff38dec tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:59:42.637246 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aed29be3-788b-4f08-898f-9a95dff38dec tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:59:42.637693 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aed29be3-788b-4f08-898f-9a95dff38dec tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:59:42.789934 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-aed29be3-788b-4f08-898f-9a95dff38dec tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:59:42.798282 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-aed29be3-788b-4f08-898f-9a95dff38dec tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49" status: 200 len: 1692 microversion: 2.1 time: 0.175607 Sep 08 11:59:42.798871 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3730/7592] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:59:42 2022] GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49 => generated 1692 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:59:43.822730 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-88aba326-8ae7-4441-ad76-bab20deff261 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:59:43.823372 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-88aba326-8ae7-4441-ad76-bab20deff261 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: d52b08d3-0741-4be6-8935-779db732ae49] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:59:43.830781 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88aba326-8ae7-4441-ad76-bab20deff261 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:59:43.831281 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88aba326-8ae7-4441-ad76-bab20deff261 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:59:43.831728 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88aba326-8ae7-4441-ad76-bab20deff261 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:59:43.832433 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88aba326-8ae7-4441-ad76-bab20deff261 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:59:43.832895 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88aba326-8ae7-4441-ad76-bab20deff261 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:59:43.833360 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88aba326-8ae7-4441-ad76-bab20deff261 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:59:43.974136 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-88aba326-8ae7-4441-ad76-bab20deff261 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:59:43.983182 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-88aba326-8ae7-4441-ad76-bab20deff261 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49" status: 200 len: 1692 microversion: 2.1 time: 0.164495 Sep 08 11:59:43.983761 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3863/7593] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:59:43 2022] GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49 => generated 1692 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:59:44.908317 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-f5b62b20-f7a9-4cc3-bfed-ca78d2e4a4bc req-d5c13aef-91ee-4f8d-8e2b-1324c8354460 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d52b08d3-0741-4be6-8935-779db732ae49", "name": "network-vif-unplugged", "status": "completed", "tag": "5372787c-b9e9-45d4-b439-04dbca635e62"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:59:44.919037 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-f5b62b20-f7a9-4cc3-bfed-ca78d2e4a4bc req-d5c13aef-91ee-4f8d-8e2b-1324c8354460 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:59:44.919590 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-f5b62b20-f7a9-4cc3-bfed-ca78d2e4a4bc req-d5c13aef-91ee-4f8d-8e2b-1324c8354460 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:59:44.920108 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-f5b62b20-f7a9-4cc3-bfed-ca78d2e4a4bc req-d5c13aef-91ee-4f8d-8e2b-1324c8354460 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:59:44.934028 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-f5b62b20-f7a9-4cc3-bfed-ca78d2e4a4bc req-d5c13aef-91ee-4f8d-8e2b-1324c8354460 service nova] Creating event network-vif-unplugged:5372787c-b9e9-45d4-b439-04dbca635e62 for instance d52b08d3-0741-4be6-8935-779db732ae49 on n-h1-850501-12 Sep 08 11:59:44.939667 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [req-f5b62b20-f7a9-4cc3-bfed-ca78d2e4a4bc req-d5c13aef-91ee-4f8d-8e2b-1324c8354460 service nova] Instance d52b08d3-0741-4be6-8935-779db732ae49 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850501-12', 'n-h1-850501-12'} {{(pid=128862) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 11:59:44.951935 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-f5b62b20-f7a9-4cc3-bfed-ca78d2e4a4bc req-d5c13aef-91ee-4f8d-8e2b-1324c8354460 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047590 Sep 08 11:59:44.952632 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3731/7594] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:59:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:59:45.009290 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-26713ebf-20e7-4aa0-9d5c-74b082e98eb5 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:59:45.009938 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-26713ebf-20e7-4aa0-9d5c-74b082e98eb5 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: d52b08d3-0741-4be6-8935-779db732ae49] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:59:45.017053 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-26713ebf-20e7-4aa0-9d5c-74b082e98eb5 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:59:45.017562 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-26713ebf-20e7-4aa0-9d5c-74b082e98eb5 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:59:45.018012 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-26713ebf-20e7-4aa0-9d5c-74b082e98eb5 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:59:45.018731 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-26713ebf-20e7-4aa0-9d5c-74b082e98eb5 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:59:45.019202 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-26713ebf-20e7-4aa0-9d5c-74b082e98eb5 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:59:45.019641 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-26713ebf-20e7-4aa0-9d5c-74b082e98eb5 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:59:45.161515 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-26713ebf-20e7-4aa0-9d5c-74b082e98eb5 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:59:45.169746 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-26713ebf-20e7-4aa0-9d5c-74b082e98eb5 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49" status: 200 len: 1691 microversion: 2.1 time: 0.165836 Sep 08 11:59:45.170334 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3864/7595] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:59:45 2022] GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49 => generated 1691 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:59:46.197218 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4a4cd49a-b472-4067-9c34-8fd64331e571 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:59:46.197964 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4a4cd49a-b472-4067-9c34-8fd64331e571 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: d52b08d3-0741-4be6-8935-779db732ae49] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:59:46.204231 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a4cd49a-b472-4067-9c34-8fd64331e571 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:59:46.204734 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a4cd49a-b472-4067-9c34-8fd64331e571 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:59:46.205220 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a4cd49a-b472-4067-9c34-8fd64331e571 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:59:46.205937 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a4cd49a-b472-4067-9c34-8fd64331e571 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:59:46.206411 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a4cd49a-b472-4067-9c34-8fd64331e571 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:59:46.206855 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a4cd49a-b472-4067-9c34-8fd64331e571 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:59:46.360360 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4a4cd49a-b472-4067-9c34-8fd64331e571 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:59:46.369187 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4a4cd49a-b472-4067-9c34-8fd64331e571 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49" status: 200 len: 1689 microversion: 2.1 time: 0.177432 Sep 08 11:59:46.369778 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3732/7596] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:59:46 2022] GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49 => generated 1689 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:59:46.990218 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-e5c484aa-a7d4-4eb4-b66d-93bf64684910 req-e7602702-c92c-4e2c-ace2-eb18c32192af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d52b08d3-0741-4be6-8935-779db732ae49", "tag": "5372787c-b9e9-45d4-b439-04dbca635e62"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:59:47.000966 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-e5c484aa-a7d4-4eb4-b66d-93bf64684910 req-e7602702-c92c-4e2c-ace2-eb18c32192af service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:59:47.001482 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-e5c484aa-a7d4-4eb4-b66d-93bf64684910 req-e7602702-c92c-4e2c-ace2-eb18c32192af service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:59:47.001914 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-e5c484aa-a7d4-4eb4-b66d-93bf64684910 req-e7602702-c92c-4e2c-ace2-eb18c32192af service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:59:47.018590 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-e5c484aa-a7d4-4eb4-b66d-93bf64684910 req-e7602702-c92c-4e2c-ace2-eb18c32192af service nova] Creating event network-changed:5372787c-b9e9-45d4-b439-04dbca635e62 for instance d52b08d3-0741-4be6-8935-779db732ae49 on n-h1-850501-12 Sep 08 11:59:47.025605 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [req-e5c484aa-a7d4-4eb4-b66d-93bf64684910 req-e7602702-c92c-4e2c-ace2-eb18c32192af service nova] Instance d52b08d3-0741-4be6-8935-779db732ae49 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850501-12', 'n-h1-850501-12'} {{(pid=128861) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 11:59:47.036554 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-e5c484aa-a7d4-4eb4-b66d-93bf64684910 req-e7602702-c92c-4e2c-ace2-eb18c32192af service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050431 Sep 08 11:59:47.037199 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3865/7597] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:59:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:59:47.394215 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ab9eff2b-f56d-4216-8f97-9f4861468fdf tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:59:47.395587 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ab9eff2b-f56d-4216-8f97-9f4861468fdf tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: d52b08d3-0741-4be6-8935-779db732ae49] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:59:47.404113 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab9eff2b-f56d-4216-8f97-9f4861468fdf tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:59:47.404636 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab9eff2b-f56d-4216-8f97-9f4861468fdf tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:59:47.405362 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab9eff2b-f56d-4216-8f97-9f4861468fdf tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:59:47.406111 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab9eff2b-f56d-4216-8f97-9f4861468fdf tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:59:47.406598 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab9eff2b-f56d-4216-8f97-9f4861468fdf tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:59:47.407220 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab9eff2b-f56d-4216-8f97-9f4861468fdf tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:59:47.737684 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ab9eff2b-f56d-4216-8f97-9f4861468fdf tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:59:47.747045 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ab9eff2b-f56d-4216-8f97-9f4861468fdf tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49" status: 200 len: 1689 microversion: 2.1 time: 0.357049 Sep 08 11:59:47.747757 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3733/7598] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:59:47 2022] GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49 => generated 1689 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:59:48.773225 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c05a25ec-fcf7-4fe8-bdf5-e0020c96fbb7 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:59:48.774833 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c05a25ec-fcf7-4fe8-bdf5-e0020c96fbb7 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: d52b08d3-0741-4be6-8935-779db732ae49] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:59:48.781682 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c05a25ec-fcf7-4fe8-bdf5-e0020c96fbb7 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:59:48.782186 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c05a25ec-fcf7-4fe8-bdf5-e0020c96fbb7 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:59:48.782631 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c05a25ec-fcf7-4fe8-bdf5-e0020c96fbb7 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:59:48.783353 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c05a25ec-fcf7-4fe8-bdf5-e0020c96fbb7 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:59:48.783982 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c05a25ec-fcf7-4fe8-bdf5-e0020c96fbb7 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:59:48.784421 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c05a25ec-fcf7-4fe8-bdf5-e0020c96fbb7 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:59:48.952496 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c05a25ec-fcf7-4fe8-bdf5-e0020c96fbb7 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:59:48.962970 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c05a25ec-fcf7-4fe8-bdf5-e0020c96fbb7 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49" status: 200 len: 1686 microversion: 2.1 time: 0.195324 Sep 08 11:59:48.963886 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3866/7599] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:59:48 2022] GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49 => generated 1686 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:59:48.987131 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1cb9f396-9f43-484f-8ecc-f14835000fa4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:59:48.987681 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1cb9f396-9f43-484f-8ecc-f14835000fa4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: d52b08d3-0741-4be6-8935-779db732ae49] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:59:48.997003 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1cb9f396-9f43-484f-8ecc-f14835000fa4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:59:48.997545 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1cb9f396-9f43-484f-8ecc-f14835000fa4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:59:48.998207 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1cb9f396-9f43-484f-8ecc-f14835000fa4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:59:48.998936 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1cb9f396-9f43-484f-8ecc-f14835000fa4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:59:48.999402 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1cb9f396-9f43-484f-8ecc-f14835000fa4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:59:48.999845 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1cb9f396-9f43-484f-8ecc-f14835000fa4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:59:49.069922 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1cb9f396-9f43-484f-8ecc-f14835000fa4 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "POST /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49/action" status: 204 len: 0 microversion: 2.1 time: 0.086175 Sep 08 11:59:49.070871 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3734/7600] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 11:59:48 2022] POST /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49/action => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:59:49.080329 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-448a1627-1eb1-416e-bc6e-46658ff30d6c tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:59:49.081965 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-448a1627-1eb1-416e-bc6e-46658ff30d6c tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: d52b08d3-0741-4be6-8935-779db732ae49] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:59:49.089692 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-448a1627-1eb1-416e-bc6e-46658ff30d6c tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:59:49.089936 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-448a1627-1eb1-416e-bc6e-46658ff30d6c tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:59:49.090331 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-448a1627-1eb1-416e-bc6e-46658ff30d6c tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:59:49.091197 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-448a1627-1eb1-416e-bc6e-46658ff30d6c tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:59:49.091197 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-448a1627-1eb1-416e-bc6e-46658ff30d6c tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:59:49.091197 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-448a1627-1eb1-416e-bc6e-46658ff30d6c tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:59:49.267136 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-448a1627-1eb1-416e-bc6e-46658ff30d6c tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:59:49.277785 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-448a1627-1eb1-416e-bc6e-46658ff30d6c tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49" status: 200 len: 1686 microversion: 2.1 time: 0.202177 Sep 08 11:59:49.278385 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3867/7601] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:59:49 2022] GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49 => generated 1686 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:59:49.303782 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e2843208-acd3-4989-a512-2768adff4fb9 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:59:49.304698 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e2843208-acd3-4989-a512-2768adff4fb9 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: d52b08d3-0741-4be6-8935-779db732ae49] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:59:49.310996 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e2843208-acd3-4989-a512-2768adff4fb9 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:59:49.311510 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e2843208-acd3-4989-a512-2768adff4fb9 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:59:49.311974 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e2843208-acd3-4989-a512-2768adff4fb9 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:59:49.312776 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e2843208-acd3-4989-a512-2768adff4fb9 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:59:49.313286 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e2843208-acd3-4989-a512-2768adff4fb9 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:59:49.313739 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e2843208-acd3-4989-a512-2768adff4fb9 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:59:49.559090 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e2843208-acd3-4989-a512-2768adff4fb9 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:59:49.566975 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e2843208-acd3-4989-a512-2768adff4fb9 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49" status: 200 len: 1686 microversion: 2.1 time: 0.269151 Sep 08 11:59:49.567570 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3735/7602] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:59:49 2022] GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49 => generated 1686 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:59:50.588530 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-de9e0128-1daa-4203-828d-8b5227634a97 req-fcee78d9-44b5-466b-a9e7-dd557bd67862 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d52b08d3-0741-4be6-8935-779db732ae49", "name": "network-vif-plugged", "status": "completed", "tag": "5372787c-b9e9-45d4-b439-04dbca635e62"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:59:50.589744 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0e52c404-d445-40f5-b7eb-26064072a336 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:59:50.590383 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0e52c404-d445-40f5-b7eb-26064072a336 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: d52b08d3-0741-4be6-8935-779db732ae49] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:59:50.596769 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e52c404-d445-40f5-b7eb-26064072a336 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:59:50.597548 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e52c404-d445-40f5-b7eb-26064072a336 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:59:50.598190 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e52c404-d445-40f5-b7eb-26064072a336 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:59:50.599113 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e52c404-d445-40f5-b7eb-26064072a336 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:59:50.599836 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e52c404-d445-40f5-b7eb-26064072a336 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:59:50.600443 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e52c404-d445-40f5-b7eb-26064072a336 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:59:50.601561 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-de9e0128-1daa-4203-828d-8b5227634a97 req-fcee78d9-44b5-466b-a9e7-dd557bd67862 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:59:50.603170 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-de9e0128-1daa-4203-828d-8b5227634a97 req-fcee78d9-44b5-466b-a9e7-dd557bd67862 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:59:50.603753 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-de9e0128-1daa-4203-828d-8b5227634a97 req-fcee78d9-44b5-466b-a9e7-dd557bd67862 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:59:50.621811 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-de9e0128-1daa-4203-828d-8b5227634a97 req-fcee78d9-44b5-466b-a9e7-dd557bd67862 service nova] Creating event network-vif-plugged:5372787c-b9e9-45d4-b439-04dbca635e62 for instance d52b08d3-0741-4be6-8935-779db732ae49 on n-h1-850501-12 Sep 08 11:59:50.627562 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:59:50.628097 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-de9e0128-1daa-4203-828d-8b5227634a97 req-fcee78d9-44b5-466b-a9e7-dd557bd67862 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043691 Sep 08 11:59:50.629146 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3868/7603] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 11:59:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:59:50.751394 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0e52c404-d445-40f5-b7eb-26064072a336 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:59:50.759611 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0e52c404-d445-40f5-b7eb-26064072a336 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49" status: 200 len: 1678 microversion: 2.1 time: 0.174088 Sep 08 11:59:50.760217 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3736/7604] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 11:59:50 2022] GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49 => generated 1678 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:00:12.952818 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f26deede-5370-4974-a432-95eda1a1f646 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:00:12.955191 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f26deede-5370-4974-a432-95eda1a1f646 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: d52b08d3-0741-4be6-8935-779db732ae49] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:00:12.958353 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=28 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:00:12.958945 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=78 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:00:12.966217 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f26deede-5370-4974-a432-95eda1a1f646 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:00:12.966710 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f26deede-5370-4974-a432-95eda1a1f646 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:00:12.967168 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f26deede-5370-4974-a432-95eda1a1f646 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:00:12.967886 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f26deede-5370-4974-a432-95eda1a1f646 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:00:12.968344 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f26deede-5370-4974-a432-95eda1a1f646 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:00:12.968771 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f26deede-5370-4974-a432-95eda1a1f646 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:00:13.023120 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f26deede-5370-4974-a432-95eda1a1f646 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "POST /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49/action" status: 200 len: 24577 microversion: 2.1 time: 0.074369 Sep 08 12:00:13.023800 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3869/7605] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 12:00:12 2022] POST /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49/action => generated 24577 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 12:00:20.537692 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b9d75266-6f4c-4edb-936e-55c50b07aa6e tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:00:20.538587 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b9d75266-6f4c-4edb-936e-55c50b07aa6e tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: d52b08d3-0741-4be6-8935-779db732ae49] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:00:20.540478 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=34 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:00:20.541831 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:00:20.555480 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b9d75266-6f4c-4edb-936e-55c50b07aa6e tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:00:20.556354 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b9d75266-6f4c-4edb-936e-55c50b07aa6e tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:00:20.556651 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b9d75266-6f4c-4edb-936e-55c50b07aa6e tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:00:20.557397 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b9d75266-6f4c-4edb-936e-55c50b07aa6e tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:00:20.557866 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b9d75266-6f4c-4edb-936e-55c50b07aa6e tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:00:20.558304 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b9d75266-6f4c-4edb-936e-55c50b07aa6e tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:00:20.586899 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b9d75266-6f4c-4edb-936e-55c50b07aa6e tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: d52b08d3-0741-4be6-8935-779db732ae49] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:00:20.640349 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-a5f76af3-6b70-409e-8457-efbf6bda5f59 req-621acd37-0600-4ef0-82f9-205d1458ca5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d52b08d3-0741-4be6-8935-779db732ae49", "tag": "5372787c-b9e9-45d4-b439-04dbca635e62"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:00:20.653320 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-a5f76af3-6b70-409e-8457-efbf6bda5f59 req-621acd37-0600-4ef0-82f9-205d1458ca5c service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:00:20.653809 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-a5f76af3-6b70-409e-8457-efbf6bda5f59 req-621acd37-0600-4ef0-82f9-205d1458ca5c service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:00:20.655411 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-a5f76af3-6b70-409e-8457-efbf6bda5f59 req-621acd37-0600-4ef0-82f9-205d1458ca5c service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:00:20.676961 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b9d75266-6f4c-4edb-936e-55c50b07aa6e tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49" status: 204 len: 0 microversion: 2.1 time: 0.142793 Sep 08 12:00:20.678010 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3737/7606] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 12:00:20 2022] DELETE /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:00:20.687048 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-01feba2a-b724-4725-955d-4b5ada7ee00d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:00:20.687779 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-01feba2a-b724-4725-955d-4b5ada7ee00d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: d52b08d3-0741-4be6-8935-779db732ae49] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:00:20.694221 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-a5f76af3-6b70-409e-8457-efbf6bda5f59 req-621acd37-0600-4ef0-82f9-205d1458ca5c service nova] Creating event network-changed:5372787c-b9e9-45d4-b439-04dbca635e62 for instance d52b08d3-0741-4be6-8935-779db732ae49 on n-h1-850501-12 Sep 08 12:00:20.695169 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01feba2a-b724-4725-955d-4b5ada7ee00d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:00:20.695697 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01feba2a-b724-4725-955d-4b5ada7ee00d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:00:20.696158 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01feba2a-b724-4725-955d-4b5ada7ee00d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:00:20.696891 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01feba2a-b724-4725-955d-4b5ada7ee00d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:00:20.697420 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01feba2a-b724-4725-955d-4b5ada7ee00d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:00:20.697868 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01feba2a-b724-4725-955d-4b5ada7ee00d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:00:20.702670 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-a5f76af3-6b70-409e-8457-efbf6bda5f59 req-621acd37-0600-4ef0-82f9-205d1458ca5c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.166348 Sep 08 12:00:20.703288 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3870/7607] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 12:00:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 12:00:20.856169 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-01feba2a-b724-4725-955d-4b5ada7ee00d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:00:20.864843 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-01feba2a-b724-4725-955d-4b5ada7ee00d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49" status: 200 len: 1684 microversion: 2.1 time: 0.182384 Sep 08 12:00:20.866496 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3738/7608] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:00:20 2022] GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49 => generated 1684 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:00:21.897002 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6d4994f1-ddd6-464d-8de0-69ee4bf05568 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:00:21.897762 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6d4994f1-ddd6-464d-8de0-69ee4bf05568 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: d52b08d3-0741-4be6-8935-779db732ae49] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:00:21.904634 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6d4994f1-ddd6-464d-8de0-69ee4bf05568 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:00:21.905177 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6d4994f1-ddd6-464d-8de0-69ee4bf05568 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:00:21.905631 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6d4994f1-ddd6-464d-8de0-69ee4bf05568 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:00:21.906359 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6d4994f1-ddd6-464d-8de0-69ee4bf05568 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:00:21.906829 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6d4994f1-ddd6-464d-8de0-69ee4bf05568 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:00:21.907270 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6d4994f1-ddd6-464d-8de0-69ee4bf05568 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:00:22.065149 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6d4994f1-ddd6-464d-8de0-69ee4bf05568 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:00:22.080219 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6d4994f1-ddd6-464d-8de0-69ee4bf05568 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49" status: 200 len: 1684 microversion: 2.1 time: 0.191756 Sep 08 12:00:22.081059 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3871/7609] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:00:21 2022] GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49 => generated 1684 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:00:22.685649 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-11b3a920-d9ca-41a2-85a7-c28276035b9d req-dabdf0bc-39df-4cd5-bd7d-e3510ccac0a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d52b08d3-0741-4be6-8935-779db732ae49", "name": "network-vif-deleted", "tag": "5372787c-b9e9-45d4-b439-04dbca635e62"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:00:22.699702 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-11b3a920-d9ca-41a2-85a7-c28276035b9d req-dabdf0bc-39df-4cd5-bd7d-e3510ccac0a4 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:00:22.700231 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-11b3a920-d9ca-41a2-85a7-c28276035b9d req-dabdf0bc-39df-4cd5-bd7d-e3510ccac0a4 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:00:22.701239 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-11b3a920-d9ca-41a2-85a7-c28276035b9d req-dabdf0bc-39df-4cd5-bd7d-e3510ccac0a4 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:00:22.715062 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-11b3a920-d9ca-41a2-85a7-c28276035b9d req-dabdf0bc-39df-4cd5-bd7d-e3510ccac0a4 service nova] Creating event network-vif-deleted:5372787c-b9e9-45d4-b439-04dbca635e62 for instance d52b08d3-0741-4be6-8935-779db732ae49 on n-h1-850501-12 Sep 08 12:00:22.720297 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-11b3a920-d9ca-41a2-85a7-c28276035b9d req-dabdf0bc-39df-4cd5-bd7d-e3510ccac0a4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038551 Sep 08 12:00:22.720980 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3739/7610] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 12:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:00:23.105131 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7e753f87-b45b-45c9-b7de-b73c41226ffc tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:00:23.105764 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7e753f87-b45b-45c9-b7de-b73c41226ffc tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: d52b08d3-0741-4be6-8935-779db732ae49] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:00:23.113721 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7e753f87-b45b-45c9-b7de-b73c41226ffc tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:00:23.114100 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7e753f87-b45b-45c9-b7de-b73c41226ffc tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:00:23.114548 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7e753f87-b45b-45c9-b7de-b73c41226ffc tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:00:23.115777 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7e753f87-b45b-45c9-b7de-b73c41226ffc tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:00:23.116263 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7e753f87-b45b-45c9-b7de-b73c41226ffc tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:00:23.116777 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7e753f87-b45b-45c9-b7de-b73c41226ffc tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:00:23.151464 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7e753f87-b45b-45c9-b7de-b73c41226ffc tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:00:23.151960 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7e753f87-b45b-45c9-b7de-b73c41226ffc tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:00:23.152402 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7e753f87-b45b-45c9-b7de-b73c41226ffc tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:00:23.152855 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-7e753f87-b45b-45c9-b7de-b73c41226ffc tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lazy-loading 'fault' on Instance uuid d52b08d3-0741-4be6-8935-779db732ae49 {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:00:23.198462 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7e753f87-b45b-45c9-b7de-b73c41226ffc tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:00:23.206533 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7e753f87-b45b-45c9-b7de-b73c41226ffc tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49" status: 200 len: 1354 microversion: 2.1 time: 0.105503 Sep 08 12:00:23.207120 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3872/7611] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:00:23 2022] GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49 => generated 1354 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:00:24.232370 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e9f8e24a-dd31-428e-bae4-1b1fa791cb9f tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:00:24.233196 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e9f8e24a-dd31-428e-bae4-1b1fa791cb9f tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: d52b08d3-0741-4be6-8935-779db732ae49] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:00:24.239657 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9f8e24a-dd31-428e-bae4-1b1fa791cb9f tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:00:24.240161 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9f8e24a-dd31-428e-bae4-1b1fa791cb9f tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:00:24.240614 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9f8e24a-dd31-428e-bae4-1b1fa791cb9f tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:00:24.241358 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9f8e24a-dd31-428e-bae4-1b1fa791cb9f tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:00:24.242632 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9f8e24a-dd31-428e-bae4-1b1fa791cb9f tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:00:24.243126 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9f8e24a-dd31-428e-bae4-1b1fa791cb9f tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:00:24.256476 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-e9f8e24a-dd31-428e-bae4-1b1fa791cb9f tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] HTTP exception thrown: Instance d52b08d3-0741-4be6-8935-779db732ae49 could not be found. Sep 08 12:00:24.258175 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e9f8e24a-dd31-428e-bae4-1b1fa791cb9f tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Request method failure captured: Sep 08 12:00:24.258175 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49 HTTP/1.1 Sep 08 12:00:24.258175 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 12:00:24.258175 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 12:00:24.258175 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 12:00:24.258175 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 12:00:24.258175 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 12:00:24.258175 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 12:00:24.258175 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 12:00:24.258175 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 12:00:24.258175 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGdgwe3QmhiGsoiILM5bGeIE-EHzsnjM6KQuMFsKvCXbg967J71JinBeGFRd1mku6-Z-m4JQ9yWbqYK6Z1MSuErSUTO54qKxQVH-rPnvuL8XP6AL5ODpR7jo94wp_BdEp1m68Loc1_k9cMRb5G6-FLWWIE65rAilwZFS7jxy1f7IqtpQ Sep 08 12:00:24.258175 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 12:00:24.258175 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 12:00:24.258175 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 12:00:24.258175 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 12:00:24.258175 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 12:00:24.258175 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 12:00:24.258175 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: f00a6070707c4334b4beb7d530b15814 Sep 08 12:00:24.258175 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1687454490 Sep 08 12:00:24.258175 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 12:00:24.258175 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 12:00:24.258175 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f00a6070707c4334b4beb7d530b15814"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f00a6070707c4334b4beb7d530b15814"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f00a6070707c4334b4beb7d530b15814"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f00a6070707c4334b4beb7d530b15814"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 12:00:24.258175 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1687454490 Sep 08 12:00:24.258175 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: f00a6070707c4334b4beb7d530b15814 Sep 08 12:00:24.258175 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1687454490 Sep 08 12:00:24.258175 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-TestNetworkAdvancedServerOps-1687454490-project Sep 08 12:00:24.258175 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 12:00:24.258175 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 12:00:24.258175 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 4a16b57190c243a5b78e7717eb4a016b Sep 08 12:00:24.258175 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1687454490-project Sep 08 12:00:24.258175 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 12:00:24.258175 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance d52b08d3-0741-4be6-8935-779db732ae49 could not be found. Sep 08 12:00:24.258175 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'd52b08d3-0741-4be6-8935-779db732ae49'} Sep 08 12:00:24.258175 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:00:24.258175 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:00:24.258175 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:00:24.258175 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:00:24.258175 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:00:24.258175 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:00:24.258175 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:00:24.258175 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:00:24.258175 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:00:24.258175 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:00:24.258175 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d52b08d3-0741-4be6-8935-779db732ae49 could not be found. Sep 08 12:00:24.258175 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 12:00:24.258175 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:00:24.258175 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 12:00:24.258175 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:00:24.258175 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:00:24.258175 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:00:24.258175 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:00:24.258175 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:00:24.258175 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:00:24.258175 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:00:24.258175 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:00:24.258175 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:00:24.258175 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:00:24.258175 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:00:24.258175 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:00:24.258175 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:00:24.258175 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d52b08d3-0741-4be6-8935-779db732ae49 could not be found. Sep 08 12:00:24.258175 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 12:00:24.258175 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:00:24.262987 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 12:00:24.262987 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:00:24.262987 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:00:24.262987 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:00:24.262987 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:00:24.262987 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:00:24.262987 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d52b08d3-0741-4be6-8935-779db732ae49 could not be found. Sep 08 12:00:24.262987 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 12:00:24.262987 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e9f8e24a-dd31-428e-bae4-1b1fa791cb9f tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Returning 404 to user: Instance d52b08d3-0741-4be6-8935-779db732ae49 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:00:24.262987 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e9f8e24a-dd31-428e-bae4-1b1fa791cb9f tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49" status: 404 len: 111 microversion: 2.1 time: 0.032624 Sep 08 12:00:24.262987 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3740/7612] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:00:24 2022] GET /compute/v2.1/servers/d52b08d3-0741-4be6-8935-779db732ae49 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:00:27.295832 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a7b162e5-6a37-45ed-a604-ac350b98e546 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '.version_select at 0x7f68e4be89d0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:00:27.319068 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a7b162e5-6a37-45ed-a604-ac350b98e546 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-72209515" status: 202 len: 0 microversion: 2.1 time: 0.027236 Sep 08 12:00:27.320335 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3873/7613] 10.222.0.27 () {58 vars in 1278 bytes} [Thu Sep 8 12:00:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-72209515 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:00:27.349213 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d64fb581-dc90-4fcc-9457-1dbc33ce24f6 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Action: 'create', calling method: .version_select at 0x7f68e42411f0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1236023709", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCwiL3KBCyLQaRER+htv7+9Orwa+Vx7KEKy0W82Ybp78pu9tAVmDHzo9TTt4OwU7vBYYjyjyybQvt+Lvbvb5QzQgBywsAVZVRwwI4xD6CfS4CxTnIH68gDS1JiWskvP1TQ=="}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:00:27.370663 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-d64fb581-dc90-4fcc-9457-1dbc33ce24f6 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Getting quotas for project f00a6070707c4334b4beb7d530b15814. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:00:27.381721 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-d64fb581-dc90-4fcc-9457-1dbc33ce24f6 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Getting quotas for user 4a16b57190c243a5b78e7717eb4a016b and project f00a6070707c4334b4beb7d530b15814. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:00:27.417500 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d64fb581-dc90-4fcc-9457-1dbc33ce24f6 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.073278 Sep 08 12:00:27.418105 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3741/7614] 10.222.0.27 () {60 vars in 1159 bytes} [Thu Sep 8 12:00:27 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 12:00:33.462530 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=20 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:00:33.467659 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6069cd6f-d9f3-4706-a2b8-a9408d02111e tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2114254075", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "898df30e-54cc-4afd-8096-e48d7a9c804f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1236023709", "security_groups": [{"name": "tempest-secgroup-smoke-1120569430"}]}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:00:33.630362 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-6069cd6f-d9f3-4706-a2b8-a9408d02111e tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] validate_networks() for [('898df30e-54cc-4afd-8096-e48d7a9c804f', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:00:34.047584 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-6069cd6f-d9f3-4706-a2b8-a9408d02111e tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:00:34.048080 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-6069cd6f-d9f3-4706-a2b8-a9408d02111e tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:00:34.049057 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-6069cd6f-d9f3-4706-a2b8-a9408d02111e tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:00:34.049581 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-6069cd6f-d9f3-4706-a2b8-a9408d02111e tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:00:34.050066 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-6069cd6f-d9f3-4706-a2b8-a9408d02111e tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:00:34.060480 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6069cd6f-d9f3-4706-a2b8-a9408d02111e tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:00:34.060980 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6069cd6f-d9f3-4706-a2b8-a9408d02111e tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:00:34.061586 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6069cd6f-d9f3-4706-a2b8-a9408d02111e tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:00:34.062364 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6069cd6f-d9f3-4706-a2b8-a9408d02111e tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:00:34.062841 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6069cd6f-d9f3-4706-a2b8-a9408d02111e tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:00:34.063297 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6069cd6f-d9f3-4706-a2b8-a9408d02111e tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:00:34.082218 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-6069cd6f-d9f3-4706-a2b8-a9408d02111e tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Getting quotas for project f00a6070707c4334b4beb7d530b15814. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:00:34.088155 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-6069cd6f-d9f3-4706-a2b8-a9408d02111e tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Getting quotas for user 4a16b57190c243a5b78e7717eb4a016b and project f00a6070707c4334b4beb7d530b15814. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:00:34.101625 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6069cd6f-d9f3-4706-a2b8-a9408d02111e tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:00:34.104203 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6069cd6f-d9f3-4706-a2b8-a9408d02111e tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 84235177-b397-41d2-887c-1c6494d255b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:00:34.153914 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6069cd6f-d9f3-4706-a2b8-a9408d02111e tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.693245 Sep 08 12:00:34.154925 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3874/7615] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 12:00:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 695 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 12:00:34.168676 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b9724227-51a3-493a-9552-77fecfbb6a68 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:00:34.169340 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b9724227-51a3-493a-9552-77fecfbb6a68 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 84235177-b397-41d2-887c-1c6494d255b1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:00:34.234703 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b9724227-51a3-493a-9552-77fecfbb6a68 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:00:34.244006 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b9724227-51a3-493a-9552-77fecfbb6a68 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/84235177-b397-41d2-887c-1c6494d255b1" status: 200 len: 1267 microversion: 2.1 time: 0.081524 Sep 08 12:00:34.244931 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3742/7616] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:00:34 2022] GET /compute/v2.1/servers/84235177-b397-41d2-887c-1c6494d255b1 => generated 1267 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:00:35.266898 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e5e45c79-1d46-445f-b149-1b210aae08d0 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:00:35.268307 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e5e45c79-1d46-445f-b149-1b210aae08d0 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 84235177-b397-41d2-887c-1c6494d255b1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:00:35.277664 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e5e45c79-1d46-445f-b149-1b210aae08d0 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:00:35.278520 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e5e45c79-1d46-445f-b149-1b210aae08d0 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:00:35.279192 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e5e45c79-1d46-445f-b149-1b210aae08d0 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:00:35.280463 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e5e45c79-1d46-445f-b149-1b210aae08d0 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:00:35.281201 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e5e45c79-1d46-445f-b149-1b210aae08d0 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:00:35.281880 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e5e45c79-1d46-445f-b149-1b210aae08d0 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:00:35.370601 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e5e45c79-1d46-445f-b149-1b210aae08d0 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:00:35.383484 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e5e45c79-1d46-445f-b149-1b210aae08d0 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/84235177-b397-41d2-887c-1c6494d255b1" status: 200 len: 1327 microversion: 2.1 time: 0.120370 Sep 08 12:00:35.397133 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3875/7617] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:00:35 2022] GET /compute/v2.1/servers/84235177-b397-41d2-887c-1c6494d255b1 => generated 1327 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:00:36.409310 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b6b34fcd-91d0-4095-834c-fa643b809547 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:00:36.409891 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b6b34fcd-91d0-4095-834c-fa643b809547 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 84235177-b397-41d2-887c-1c6494d255b1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:00:36.411929 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:00:36.422517 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b6b34fcd-91d0-4095-834c-fa643b809547 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:00:36.423118 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b6b34fcd-91d0-4095-834c-fa643b809547 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:00:36.423572 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b6b34fcd-91d0-4095-834c-fa643b809547 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:00:36.424299 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b6b34fcd-91d0-4095-834c-fa643b809547 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:00:36.424767 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b6b34fcd-91d0-4095-834c-fa643b809547 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:00:36.425256 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b6b34fcd-91d0-4095-834c-fa643b809547 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:00:36.587109 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b6b34fcd-91d0-4095-834c-fa643b809547 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:00:36.595698 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b6b34fcd-91d0-4095-834c-fa643b809547 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/84235177-b397-41d2-887c-1c6494d255b1" status: 200 len: 1393 microversion: 2.1 time: 0.190568 Sep 08 12:00:36.596314 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3743/7618] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:00:36 2022] GET /compute/v2.1/servers/84235177-b397-41d2-887c-1c6494d255b1 => generated 1393 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:00:36.843868 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-ddad1cbf-ac1d-41a3-b84b-f6b1b907386c req-95a73662-ecaf-4a6f-81ad-32c940c422c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84235177-b397-41d2-887c-1c6494d255b1", "tag": "62dd80bb-8320-4c28-b4e1-2884caaf8ffa"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:00:36.856346 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-ddad1cbf-ac1d-41a3-b84b-f6b1b907386c req-95a73662-ecaf-4a6f-81ad-32c940c422c1 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:00:36.856840 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-ddad1cbf-ac1d-41a3-b84b-f6b1b907386c req-95a73662-ecaf-4a6f-81ad-32c940c422c1 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:00:36.857312 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-ddad1cbf-ac1d-41a3-b84b-f6b1b907386c req-95a73662-ecaf-4a6f-81ad-32c940c422c1 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:00:36.870551 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-ddad1cbf-ac1d-41a3-b84b-f6b1b907386c req-95a73662-ecaf-4a6f-81ad-32c940c422c1 service nova] Creating event network-changed:62dd80bb-8320-4c28-b4e1-2884caaf8ffa for instance 84235177-b397-41d2-887c-1c6494d255b1 on n-h1-850501-12 Sep 08 12:00:36.877848 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-ddad1cbf-ac1d-41a3-b84b-f6b1b907386c req-95a73662-ecaf-4a6f-81ad-32c940c422c1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037615 Sep 08 12:00:36.878512 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3876/7619] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 12:00:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:00:37.620726 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e8b2c97b-0d96-468d-8e97-7396657fd715 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:00:37.621373 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e8b2c97b-0d96-468d-8e97-7396657fd715 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 84235177-b397-41d2-887c-1c6494d255b1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:00:37.628645 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e8b2c97b-0d96-468d-8e97-7396657fd715 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:00:37.629191 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e8b2c97b-0d96-468d-8e97-7396657fd715 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:00:37.629654 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e8b2c97b-0d96-468d-8e97-7396657fd715 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:00:37.630377 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e8b2c97b-0d96-468d-8e97-7396657fd715 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:00:37.630855 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e8b2c97b-0d96-468d-8e97-7396657fd715 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:00:37.631302 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e8b2c97b-0d96-468d-8e97-7396657fd715 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:00:37.784432 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e8b2c97b-0d96-468d-8e97-7396657fd715 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:00:37.792959 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e8b2c97b-0d96-468d-8e97-7396657fd715 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/84235177-b397-41d2-887c-1c6494d255b1" status: 200 len: 1393 microversion: 2.1 time: 0.176674 Sep 08 12:00:37.793579 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3744/7620] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:00:37 2022] GET /compute/v2.1/servers/84235177-b397-41d2-887c-1c6494d255b1 => generated 1393 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:00:38.817256 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-80d5fde0-83dd-4a75-884d-dbb676baff15 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:00:38.818007 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-80d5fde0-83dd-4a75-884d-dbb676baff15 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 84235177-b397-41d2-887c-1c6494d255b1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:00:38.824430 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-80d5fde0-83dd-4a75-884d-dbb676baff15 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:00:38.824925 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-80d5fde0-83dd-4a75-884d-dbb676baff15 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:00:38.825409 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-80d5fde0-83dd-4a75-884d-dbb676baff15 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:00:38.826124 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-80d5fde0-83dd-4a75-884d-dbb676baff15 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:00:38.826589 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-80d5fde0-83dd-4a75-884d-dbb676baff15 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:00:38.827020 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-80d5fde0-83dd-4a75-884d-dbb676baff15 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:00:38.970237 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-80d5fde0-83dd-4a75-884d-dbb676baff15 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:00:38.978621 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-80d5fde0-83dd-4a75-884d-dbb676baff15 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/84235177-b397-41d2-887c-1c6494d255b1" status: 200 len: 1393 microversion: 2.1 time: 0.166528 Sep 08 12:00:38.979198 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3877/7621] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:00:38 2022] GET /compute/v2.1/servers/84235177-b397-41d2-887c-1c6494d255b1 => generated 1393 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:00:40.001465 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-66bee778-2657-49b0-b85d-06a08f122e5c tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:00:40.002095 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-66bee778-2657-49b0-b85d-06a08f122e5c tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 84235177-b397-41d2-887c-1c6494d255b1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:00:40.009007 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-66bee778-2657-49b0-b85d-06a08f122e5c tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:00:40.009536 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-66bee778-2657-49b0-b85d-06a08f122e5c tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:00:40.009985 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-66bee778-2657-49b0-b85d-06a08f122e5c tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:00:40.010711 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-66bee778-2657-49b0-b85d-06a08f122e5c tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:00:40.011180 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-66bee778-2657-49b0-b85d-06a08f122e5c tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:00:40.011617 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-66bee778-2657-49b0-b85d-06a08f122e5c tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:00:40.148943 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-66bee778-2657-49b0-b85d-06a08f122e5c tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:00:40.156686 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-66bee778-2657-49b0-b85d-06a08f122e5c tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/84235177-b397-41d2-887c-1c6494d255b1" status: 200 len: 1393 microversion: 2.1 time: 0.159249 Sep 08 12:00:40.157283 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3745/7622] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:00:39 2022] GET /compute/v2.1/servers/84235177-b397-41d2-887c-1c6494d255b1 => generated 1393 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:00:41.180759 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e8820957-7de0-4ee1-bf77-26a78ce3473d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:00:41.181437 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e8820957-7de0-4ee1-bf77-26a78ce3473d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 84235177-b397-41d2-887c-1c6494d255b1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:00:41.188308 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e8820957-7de0-4ee1-bf77-26a78ce3473d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:00:41.188889 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e8820957-7de0-4ee1-bf77-26a78ce3473d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:00:41.189382 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e8820957-7de0-4ee1-bf77-26a78ce3473d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:00:41.190093 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e8820957-7de0-4ee1-bf77-26a78ce3473d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:00:41.190558 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e8820957-7de0-4ee1-bf77-26a78ce3473d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:00:41.190991 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e8820957-7de0-4ee1-bf77-26a78ce3473d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:00:41.327792 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-e8820957-7de0-4ee1-bf77-26a78ce3473d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:00:41.336014 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e8820957-7de0-4ee1-bf77-26a78ce3473d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/84235177-b397-41d2-887c-1c6494d255b1" status: 200 len: 1393 microversion: 2.1 time: 0.159971 Sep 08 12:00:41.336603 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3878/7623] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:00:41 2022] GET /compute/v2.1/servers/84235177-b397-41d2-887c-1c6494d255b1 => generated 1393 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:00:42.359454 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dd2af515-381b-4625-a000-7f7b711a06c5 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:00:42.360114 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-dd2af515-381b-4625-a000-7f7b711a06c5 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 84235177-b397-41d2-887c-1c6494d255b1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:00:42.367710 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd2af515-381b-4625-a000-7f7b711a06c5 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:00:42.368215 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd2af515-381b-4625-a000-7f7b711a06c5 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:00:42.368662 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd2af515-381b-4625-a000-7f7b711a06c5 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:00:42.369403 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd2af515-381b-4625-a000-7f7b711a06c5 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:00:42.369872 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd2af515-381b-4625-a000-7f7b711a06c5 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:00:42.370309 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd2af515-381b-4625-a000-7f7b711a06c5 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:00:42.507966 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-dd2af515-381b-4625-a000-7f7b711a06c5 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:00:42.515618 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-dd2af515-381b-4625-a000-7f7b711a06c5 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/84235177-b397-41d2-887c-1c6494d255b1" status: 200 len: 1393 microversion: 2.1 time: 0.160060 Sep 08 12:00:42.516185 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3746/7624] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:00:42 2022] GET /compute/v2.1/servers/84235177-b397-41d2-887c-1c6494d255b1 => generated 1393 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:00:42.904931 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-be03fa6c-4eca-487e-88d4-fa7911aa2157 req-541d6cab-3c6d-49e3-9c76-2760f4e672bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84235177-b397-41d2-887c-1c6494d255b1", "name": "network-vif-plugged", "status": "completed", "tag": "62dd80bb-8320-4c28-b4e1-2884caaf8ffa"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:00:42.916778 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-be03fa6c-4eca-487e-88d4-fa7911aa2157 req-541d6cab-3c6d-49e3-9c76-2760f4e672bb service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:00:42.917295 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-be03fa6c-4eca-487e-88d4-fa7911aa2157 req-541d6cab-3c6d-49e3-9c76-2760f4e672bb service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:00:42.917758 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-be03fa6c-4eca-487e-88d4-fa7911aa2157 req-541d6cab-3c6d-49e3-9c76-2760f4e672bb service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:00:42.930736 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-be03fa6c-4eca-487e-88d4-fa7911aa2157 req-541d6cab-3c6d-49e3-9c76-2760f4e672bb service nova] Creating event network-vif-plugged:62dd80bb-8320-4c28-b4e1-2884caaf8ffa for instance 84235177-b397-41d2-887c-1c6494d255b1 on n-h1-850501-12 Sep 08 12:00:42.936066 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-be03fa6c-4eca-487e-88d4-fa7911aa2157 req-541d6cab-3c6d-49e3-9c76-2760f4e672bb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035411 Sep 08 12:00:42.936595 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3879/7625] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 12:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:00:43.538684 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4c2aa637-d56b-4c7b-b46d-67f56bfce27a tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:00:43.539311 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4c2aa637-d56b-4c7b-b46d-67f56bfce27a tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 84235177-b397-41d2-887c-1c6494d255b1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:00:43.546440 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c2aa637-d56b-4c7b-b46d-67f56bfce27a tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:00:43.546937 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c2aa637-d56b-4c7b-b46d-67f56bfce27a tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:00:43.547383 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c2aa637-d56b-4c7b-b46d-67f56bfce27a tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:00:43.548099 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c2aa637-d56b-4c7b-b46d-67f56bfce27a tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:00:43.548568 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c2aa637-d56b-4c7b-b46d-67f56bfce27a tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:00:43.549051 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c2aa637-d56b-4c7b-b46d-67f56bfce27a tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:00:43.693268 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4c2aa637-d56b-4c7b-b46d-67f56bfce27a tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:00:43.702702 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4c2aa637-d56b-4c7b-b46d-67f56bfce27a tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/84235177-b397-41d2-887c-1c6494d255b1" status: 200 len: 1393 microversion: 2.1 time: 0.167934 Sep 08 12:00:43.703304 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3747/7626] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:00:43 2022] GET /compute/v2.1/servers/84235177-b397-41d2-887c-1c6494d255b1 => generated 1393 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:00:44.723298 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:00:44.724082 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=6 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:00:44.728542 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1e964b6f-224c-42a0-80b1-4909d119df5c tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:00:44.729292 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1e964b6f-224c-42a0-80b1-4909d119df5c tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 84235177-b397-41d2-887c-1c6494d255b1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:00:44.731084 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:00:44.737756 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e964b6f-224c-42a0-80b1-4909d119df5c tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:00:44.738495 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e964b6f-224c-42a0-80b1-4909d119df5c tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:00:44.738946 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e964b6f-224c-42a0-80b1-4909d119df5c tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:00:44.739645 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e964b6f-224c-42a0-80b1-4909d119df5c tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:00:44.740105 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e964b6f-224c-42a0-80b1-4909d119df5c tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:00:44.740544 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e964b6f-224c-42a0-80b1-4909d119df5c tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:00:44.881338 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1e964b6f-224c-42a0-80b1-4909d119df5c tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:00:44.890620 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1e964b6f-224c-42a0-80b1-4909d119df5c tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/84235177-b397-41d2-887c-1c6494d255b1" status: 200 len: 1564 microversion: 2.1 time: 0.169087 Sep 08 12:00:44.891219 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3880/7627] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:00:44 2022] GET /compute/v2.1/servers/84235177-b397-41d2-887c-1c6494d255b1 => generated 1564 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:00:44.914195 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8c2d09c8-abdc-4257-bff3-ac7b6c5a03c7 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:00:44.914825 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8c2d09c8-abdc-4257-bff3-ac7b6c5a03c7 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 84235177-b397-41d2-887c-1c6494d255b1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:00:44.916768 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:00:44.924487 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c2d09c8-abdc-4257-bff3-ac7b6c5a03c7 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:00:44.925152 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c2d09c8-abdc-4257-bff3-ac7b6c5a03c7 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:00:44.925609 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c2d09c8-abdc-4257-bff3-ac7b6c5a03c7 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:00:44.926709 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c2d09c8-abdc-4257-bff3-ac7b6c5a03c7 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:00:44.927605 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c2d09c8-abdc-4257-bff3-ac7b6c5a03c7 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:00:44.928931 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c2d09c8-abdc-4257-bff3-ac7b6c5a03c7 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:00:45.085139 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8c2d09c8-abdc-4257-bff3-ac7b6c5a03c7 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:00:45.092953 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8c2d09c8-abdc-4257-bff3-ac7b6c5a03c7 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/84235177-b397-41d2-887c-1c6494d255b1" status: 200 len: 1564 microversion: 2.1 time: 0.182669 Sep 08 12:00:45.093563 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3748/7628] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:00:44 2022] GET /compute/v2.1/servers/84235177-b397-41d2-887c-1c6494d255b1 => generated 1564 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:00:46.721467 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-db9ae9bf-42d6-492a-ae76-1cec5dfe7b13 req-cd084b91-5ed5-49b6-93b8-7eb76621d10a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84235177-b397-41d2-887c-1c6494d255b1", "tag": "62dd80bb-8320-4c28-b4e1-2884caaf8ffa"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:00:46.723785 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-62f28d58-3e89-4584-9464-8961161a69b2 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:00:46.724488 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-62f28d58-3e89-4584-9464-8961161a69b2 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 84235177-b397-41d2-887c-1c6494d255b1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:00:46.732892 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-62f28d58-3e89-4584-9464-8961161a69b2 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:00:46.733648 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-62f28d58-3e89-4584-9464-8961161a69b2 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:00:46.734080 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-62f28d58-3e89-4584-9464-8961161a69b2 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:00:46.734837 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-62f28d58-3e89-4584-9464-8961161a69b2 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:00:46.735754 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-62f28d58-3e89-4584-9464-8961161a69b2 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:00:46.735927 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-62f28d58-3e89-4584-9464-8961161a69b2 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:00:46.740470 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-db9ae9bf-42d6-492a-ae76-1cec5dfe7b13 req-cd084b91-5ed5-49b6-93b8-7eb76621d10a service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:00:46.741903 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-db9ae9bf-42d6-492a-ae76-1cec5dfe7b13 req-cd084b91-5ed5-49b6-93b8-7eb76621d10a service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:00:46.742487 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-db9ae9bf-42d6-492a-ae76-1cec5dfe7b13 req-cd084b91-5ed5-49b6-93b8-7eb76621d10a service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:00:46.754191 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-db9ae9bf-42d6-492a-ae76-1cec5dfe7b13 req-cd084b91-5ed5-49b6-93b8-7eb76621d10a service nova] Creating event network-changed:62dd80bb-8320-4c28-b4e1-2884caaf8ffa for instance 84235177-b397-41d2-887c-1c6494d255b1 on n-h1-850501-12 Sep 08 12:00:46.759692 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-db9ae9bf-42d6-492a-ae76-1cec5dfe7b13 req-cd084b91-5ed5-49b6-93b8-7eb76621d10a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044681 Sep 08 12:00:46.760626 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3749/7629] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 12:00:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:00:46.964719 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-62f28d58-3e89-4584-9464-8961161a69b2 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:00:46.973229 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-62f28d58-3e89-4584-9464-8961161a69b2 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/84235177-b397-41d2-887c-1c6494d255b1" status: 200 len: 1564 microversion: 2.1 time: 0.259918 Sep 08 12:00:46.973838 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3881/7630] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:00:46 2022] GET /compute/v2.1/servers/84235177-b397-41d2-887c-1c6494d255b1 => generated 1564 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:01:10.226599 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:01:10.227371 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=38 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:01:10.231797 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bbcefd14-ad0e-4dcf-adc8-30a3e6698411 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:01:10.234124 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bbcefd14-ad0e-4dcf-adc8-30a3e6698411 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 84235177-b397-41d2-887c-1c6494d255b1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:01:10.242230 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bbcefd14-ad0e-4dcf-adc8-30a3e6698411 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:01:10.242741 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bbcefd14-ad0e-4dcf-adc8-30a3e6698411 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:01:10.243378 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bbcefd14-ad0e-4dcf-adc8-30a3e6698411 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:01:10.244102 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bbcefd14-ad0e-4dcf-adc8-30a3e6698411 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:01:10.244577 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bbcefd14-ad0e-4dcf-adc8-30a3e6698411 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:01:10.245045 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bbcefd14-ad0e-4dcf-adc8-30a3e6698411 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:01:10.310343 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bbcefd14-ad0e-4dcf-adc8-30a3e6698411 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "POST /compute/v2.1/servers/84235177-b397-41d2-887c-1c6494d255b1/action" status: 200 len: 24571 microversion: 2.1 time: 0.085796 Sep 08 12:01:10.311025 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3750/7631] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 12:01:10 2022] POST /compute/v2.1/servers/84235177-b397-41d2-887c-1c6494d255b1/action => generated 24571 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 12:01:16.765214 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b816fa1f-18a1-4833-8e56-7a17accb9614 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:01:16.767506 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=3 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:01:16.768348 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=36 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:01:16.775030 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b816fa1f-18a1-4833-8e56-7a17accb9614 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:01:16.775527 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b816fa1f-18a1-4833-8e56-7a17accb9614 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:01:16.775967 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b816fa1f-18a1-4833-8e56-7a17accb9614 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:01:16.800692 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b816fa1f-18a1-4833-8e56-7a17accb9614 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 84235177-b397-41d2-887c-1c6494d255b1] Going to try to stop instance {{(pid=128861) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 08 12:01:16.846092 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b816fa1f-18a1-4833-8e56-7a17accb9614 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "POST /compute/v2.1/servers/84235177-b397-41d2-887c-1c6494d255b1/action" status: 202 len: 0 microversion: 2.1 time: 0.084868 Sep 08 12:01:16.846992 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3882/7632] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 12:01:16 2022] POST /compute/v2.1/servers/84235177-b397-41d2-887c-1c6494d255b1/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:01:16.858084 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f31c45b4-201b-4ace-960d-ebb5759ec5dc tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:01:16.858808 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f31c45b4-201b-4ace-960d-ebb5759ec5dc tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 84235177-b397-41d2-887c-1c6494d255b1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:01:16.868417 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f31c45b4-201b-4ace-960d-ebb5759ec5dc tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:01:16.868938 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f31c45b4-201b-4ace-960d-ebb5759ec5dc tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:01:16.869514 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f31c45b4-201b-4ace-960d-ebb5759ec5dc tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:01:16.871426 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f31c45b4-201b-4ace-960d-ebb5759ec5dc tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:01:16.872175 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f31c45b4-201b-4ace-960d-ebb5759ec5dc tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:01:16.872634 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f31c45b4-201b-4ace-960d-ebb5759ec5dc tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:01:17.024498 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f31c45b4-201b-4ace-960d-ebb5759ec5dc tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:01:17.032629 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f31c45b4-201b-4ace-960d-ebb5759ec5dc tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/84235177-b397-41d2-887c-1c6494d255b1" status: 200 len: 1692 microversion: 2.1 time: 0.179194 Sep 08 12:01:17.033245 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3751/7633] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:01:16 2022] GET /compute/v2.1/servers/84235177-b397-41d2-887c-1c6494d255b1 => generated 1692 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:01:18.058318 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5345f190-b920-4d00-9009-7cb5e16e4cd1 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:01:18.059021 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5345f190-b920-4d00-9009-7cb5e16e4cd1 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 84235177-b397-41d2-887c-1c6494d255b1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:01:18.065375 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5345f190-b920-4d00-9009-7cb5e16e4cd1 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:01:18.065870 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5345f190-b920-4d00-9009-7cb5e16e4cd1 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:01:18.066309 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5345f190-b920-4d00-9009-7cb5e16e4cd1 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:01:18.067016 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5345f190-b920-4d00-9009-7cb5e16e4cd1 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:01:18.067466 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5345f190-b920-4d00-9009-7cb5e16e4cd1 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:01:18.067889 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5345f190-b920-4d00-9009-7cb5e16e4cd1 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:01:18.205984 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5345f190-b920-4d00-9009-7cb5e16e4cd1 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:01:18.214744 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5345f190-b920-4d00-9009-7cb5e16e4cd1 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/84235177-b397-41d2-887c-1c6494d255b1" status: 200 len: 1692 microversion: 2.1 time: 0.161904 Sep 08 12:01:18.215328 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3883/7634] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:01:18 2022] GET /compute/v2.1/servers/84235177-b397-41d2-887c-1c6494d255b1 => generated 1692 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:01:19.239515 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b3ecbf36-b185-4ac6-ac9d-baad8e43cf6a tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:01:19.240153 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b3ecbf36-b185-4ac6-ac9d-baad8e43cf6a tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 84235177-b397-41d2-887c-1c6494d255b1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:01:19.248218 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3ecbf36-b185-4ac6-ac9d-baad8e43cf6a tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:01:19.248732 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3ecbf36-b185-4ac6-ac9d-baad8e43cf6a tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:01:19.249218 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3ecbf36-b185-4ac6-ac9d-baad8e43cf6a tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:01:19.249943 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3ecbf36-b185-4ac6-ac9d-baad8e43cf6a tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:01:19.250420 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3ecbf36-b185-4ac6-ac9d-baad8e43cf6a tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:01:19.250863 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3ecbf36-b185-4ac6-ac9d-baad8e43cf6a tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:01:19.392081 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b3ecbf36-b185-4ac6-ac9d-baad8e43cf6a tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:01:19.401157 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b3ecbf36-b185-4ac6-ac9d-baad8e43cf6a tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/84235177-b397-41d2-887c-1c6494d255b1" status: 200 len: 1692 microversion: 2.1 time: 0.165810 Sep 08 12:01:19.401742 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3752/7635] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:01:19 2022] GET /compute/v2.1/servers/84235177-b397-41d2-887c-1c6494d255b1 => generated 1692 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:01:20.424445 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a30783a6-91ba-4a30-94b2-33fe79e4511e tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:01:20.425192 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a30783a6-91ba-4a30-94b2-33fe79e4511e tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 84235177-b397-41d2-887c-1c6494d255b1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:01:20.432735 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a30783a6-91ba-4a30-94b2-33fe79e4511e tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:01:20.433276 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a30783a6-91ba-4a30-94b2-33fe79e4511e tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:01:20.433718 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a30783a6-91ba-4a30-94b2-33fe79e4511e tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:01:20.434414 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a30783a6-91ba-4a30-94b2-33fe79e4511e tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:01:20.434870 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a30783a6-91ba-4a30-94b2-33fe79e4511e tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:01:20.435296 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a30783a6-91ba-4a30-94b2-33fe79e4511e tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:01:20.576733 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-a30783a6-91ba-4a30-94b2-33fe79e4511e tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:01:20.584589 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a30783a6-91ba-4a30-94b2-33fe79e4511e tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/84235177-b397-41d2-887c-1c6494d255b1" status: 200 len: 1692 microversion: 2.1 time: 0.164105 Sep 08 12:01:20.585754 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3884/7636] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:01:20 2022] GET /compute/v2.1/servers/84235177-b397-41d2-887c-1c6494d255b1 => generated 1692 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:01:21.608738 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5a1d511d-98dd-4944-a773-6a70ab574139 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:01:21.609400 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5a1d511d-98dd-4944-a773-6a70ab574139 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 84235177-b397-41d2-887c-1c6494d255b1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:01:21.616506 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a1d511d-98dd-4944-a773-6a70ab574139 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:01:21.617009 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a1d511d-98dd-4944-a773-6a70ab574139 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:01:21.617487 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a1d511d-98dd-4944-a773-6a70ab574139 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:01:21.618785 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a1d511d-98dd-4944-a773-6a70ab574139 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:01:21.619333 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a1d511d-98dd-4944-a773-6a70ab574139 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:01:21.619783 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a1d511d-98dd-4944-a773-6a70ab574139 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:01:21.752770 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5a1d511d-98dd-4944-a773-6a70ab574139 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:01:21.761382 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5a1d511d-98dd-4944-a773-6a70ab574139 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/84235177-b397-41d2-887c-1c6494d255b1" status: 200 len: 1692 microversion: 2.1 time: 0.156605 Sep 08 12:01:21.761965 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3753/7637] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:01:21 2022] GET /compute/v2.1/servers/84235177-b397-41d2-887c-1c6494d255b1 => generated 1692 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:01:22.786195 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8542b77f-77d0-4740-b7a1-19ec22e67b4d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:01:22.786870 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8542b77f-77d0-4740-b7a1-19ec22e67b4d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 84235177-b397-41d2-887c-1c6494d255b1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:01:22.794915 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8542b77f-77d0-4740-b7a1-19ec22e67b4d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:01:22.795485 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8542b77f-77d0-4740-b7a1-19ec22e67b4d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:01:22.795973 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8542b77f-77d0-4740-b7a1-19ec22e67b4d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:01:22.796648 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8542b77f-77d0-4740-b7a1-19ec22e67b4d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:01:22.797147 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8542b77f-77d0-4740-b7a1-19ec22e67b4d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:01:22.797586 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8542b77f-77d0-4740-b7a1-19ec22e67b4d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:01:22.941448 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8542b77f-77d0-4740-b7a1-19ec22e67b4d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:01:22.950229 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8542b77f-77d0-4740-b7a1-19ec22e67b4d tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/84235177-b397-41d2-887c-1c6494d255b1" status: 200 len: 1692 microversion: 2.1 time: 0.168218 Sep 08 12:01:22.950803 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3885/7638] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:01:22 2022] GET /compute/v2.1/servers/84235177-b397-41d2-887c-1c6494d255b1 => generated 1692 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:01:23.974776 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-99c4f9f2-d54f-4321-8d9b-8c937bf80e69 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:01:23.975435 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-99c4f9f2-d54f-4321-8d9b-8c937bf80e69 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 84235177-b397-41d2-887c-1c6494d255b1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:01:23.982949 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-99c4f9f2-d54f-4321-8d9b-8c937bf80e69 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:01:23.983454 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-99c4f9f2-d54f-4321-8d9b-8c937bf80e69 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:01:23.983907 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-99c4f9f2-d54f-4321-8d9b-8c937bf80e69 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:01:23.984628 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-99c4f9f2-d54f-4321-8d9b-8c937bf80e69 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:01:23.993668 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-99c4f9f2-d54f-4321-8d9b-8c937bf80e69 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:01:23.994139 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-99c4f9f2-d54f-4321-8d9b-8c937bf80e69 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:01:24.134005 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-99c4f9f2-d54f-4321-8d9b-8c937bf80e69 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:01:24.142471 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-99c4f9f2-d54f-4321-8d9b-8c937bf80e69 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/84235177-b397-41d2-887c-1c6494d255b1" status: 200 len: 1692 microversion: 2.1 time: 0.171584 Sep 08 12:01:24.142977 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3754/7639] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:01:23 2022] GET /compute/v2.1/servers/84235177-b397-41d2-887c-1c6494d255b1 => generated 1692 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:01:25.166539 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b46dfd82-ce02-4ca4-be15-15ab5e0037b3 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:01:25.167087 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b46dfd82-ce02-4ca4-be15-15ab5e0037b3 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 84235177-b397-41d2-887c-1c6494d255b1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:01:25.173856 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b46dfd82-ce02-4ca4-be15-15ab5e0037b3 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:01:25.174363 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b46dfd82-ce02-4ca4-be15-15ab5e0037b3 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:01:25.174786 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b46dfd82-ce02-4ca4-be15-15ab5e0037b3 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:01:25.175489 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b46dfd82-ce02-4ca4-be15-15ab5e0037b3 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:01:25.175947 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b46dfd82-ce02-4ca4-be15-15ab5e0037b3 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:01:25.176376 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b46dfd82-ce02-4ca4-be15-15ab5e0037b3 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:01:25.316597 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b46dfd82-ce02-4ca4-be15-15ab5e0037b3 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:01:25.325976 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b46dfd82-ce02-4ca4-be15-15ab5e0037b3 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/84235177-b397-41d2-887c-1c6494d255b1" status: 200 len: 1692 microversion: 2.1 time: 0.163456 Sep 08 12:01:25.326569 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3886/7640] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:01:25 2022] GET /compute/v2.1/servers/84235177-b397-41d2-887c-1c6494d255b1 => generated 1692 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:01:26.349833 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-38dbc8c4-0a56-44a6-af2c-82bf47ef8bfb tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:01:26.350546 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-38dbc8c4-0a56-44a6-af2c-82bf47ef8bfb tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 84235177-b397-41d2-887c-1c6494d255b1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:01:26.358440 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38dbc8c4-0a56-44a6-af2c-82bf47ef8bfb tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:01:26.358944 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38dbc8c4-0a56-44a6-af2c-82bf47ef8bfb tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:01:26.359399 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38dbc8c4-0a56-44a6-af2c-82bf47ef8bfb tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:01:26.360118 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38dbc8c4-0a56-44a6-af2c-82bf47ef8bfb tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:01:26.360588 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38dbc8c4-0a56-44a6-af2c-82bf47ef8bfb tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:01:26.361067 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38dbc8c4-0a56-44a6-af2c-82bf47ef8bfb tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:01:26.508731 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-38dbc8c4-0a56-44a6-af2c-82bf47ef8bfb tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:01:26.517114 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-38dbc8c4-0a56-44a6-af2c-82bf47ef8bfb tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/84235177-b397-41d2-887c-1c6494d255b1" status: 200 len: 1692 microversion: 2.1 time: 0.171386 Sep 08 12:01:26.517722 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3755/7641] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:01:26 2022] GET /compute/v2.1/servers/84235177-b397-41d2-887c-1c6494d255b1 => generated 1692 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:01:27.543716 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2d0a4914-d418-48ec-bc1b-fd42ed55e6a7 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:01:27.544614 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2d0a4914-d418-48ec-bc1b-fd42ed55e6a7 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 84235177-b397-41d2-887c-1c6494d255b1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:01:27.551582 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2d0a4914-d418-48ec-bc1b-fd42ed55e6a7 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:01:27.552072 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2d0a4914-d418-48ec-bc1b-fd42ed55e6a7 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:01:27.552509 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2d0a4914-d418-48ec-bc1b-fd42ed55e6a7 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:01:27.553237 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2d0a4914-d418-48ec-bc1b-fd42ed55e6a7 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:01:27.553698 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2d0a4914-d418-48ec-bc1b-fd42ed55e6a7 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:01:27.554125 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2d0a4914-d418-48ec-bc1b-fd42ed55e6a7 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:01:27.691001 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2d0a4914-d418-48ec-bc1b-fd42ed55e6a7 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:01:27.699337 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2d0a4914-d418-48ec-bc1b-fd42ed55e6a7 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/84235177-b397-41d2-887c-1c6494d255b1" status: 200 len: 1669 microversion: 2.1 time: 0.161225 Sep 08 12:01:27.699913 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3887/7642] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:01:27 2022] GET /compute/v2.1/servers/84235177-b397-41d2-887c-1c6494d255b1 => generated 1669 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:01:28.798005 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6a9aad47-025f-41d1-8e96-fa9254552aff tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:01:28.800157 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6a9aad47-025f-41d1-8e96-fa9254552aff tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 84235177-b397-41d2-887c-1c6494d255b1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:01:28.807821 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a9aad47-025f-41d1-8e96-fa9254552aff tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:01:28.808320 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a9aad47-025f-41d1-8e96-fa9254552aff tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:01:28.808772 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a9aad47-025f-41d1-8e96-fa9254552aff tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:01:28.809529 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a9aad47-025f-41d1-8e96-fa9254552aff tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:01:28.810003 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a9aad47-025f-41d1-8e96-fa9254552aff tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:01:28.810443 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a9aad47-025f-41d1-8e96-fa9254552aff tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:01:28.862714 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6a9aad47-025f-41d1-8e96-fa9254552aff tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "POST /compute/v2.1/servers/84235177-b397-41d2-887c-1c6494d255b1/action" status: 200 len: 35029 microversion: 2.1 time: 0.068406 Sep 08 12:01:28.863681 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3756/7643] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 12:01:28 2022] POST /compute/v2.1/servers/84235177-b397-41d2-887c-1c6494d255b1/action => generated 35029 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 12:01:28.876593 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2b2d8fa8-593e-4c47-a340-cf368ce4bda8 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:01:28.883604 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2b2d8fa8-593e-4c47-a340-cf368ce4bda8 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:01:28.884099 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2b2d8fa8-593e-4c47-a340-cf368ce4bda8 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:01:28.884541 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2b2d8fa8-593e-4c47-a340-cf368ce4bda8 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:01:28.907351 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2b2d8fa8-593e-4c47-a340-cf368ce4bda8 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 84235177-b397-41d2-887c-1c6494d255b1] Going to try to start instance {{(pid=128861) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 08 12:01:28.958150 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2b2d8fa8-593e-4c47-a340-cf368ce4bda8 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "POST /compute/v2.1/servers/84235177-b397-41d2-887c-1c6494d255b1/action" status: 202 len: 0 microversion: 2.1 time: 0.085315 Sep 08 12:01:28.958767 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3888/7644] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 12:01:28 2022] POST /compute/v2.1/servers/84235177-b397-41d2-887c-1c6494d255b1/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:01:28.968366 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8f8b2343-8fe7-4fe5-b927-1a5c2e6f9ff3 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:01:28.969114 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8f8b2343-8fe7-4fe5-b927-1a5c2e6f9ff3 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 84235177-b397-41d2-887c-1c6494d255b1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:01:28.976468 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f8b2343-8fe7-4fe5-b927-1a5c2e6f9ff3 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:01:28.976985 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f8b2343-8fe7-4fe5-b927-1a5c2e6f9ff3 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:01:28.977567 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f8b2343-8fe7-4fe5-b927-1a5c2e6f9ff3 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:01:28.979265 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f8b2343-8fe7-4fe5-b927-1a5c2e6f9ff3 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:01:28.979750 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f8b2343-8fe7-4fe5-b927-1a5c2e6f9ff3 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:01:28.980200 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f8b2343-8fe7-4fe5-b927-1a5c2e6f9ff3 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:01:29.126905 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8f8b2343-8fe7-4fe5-b927-1a5c2e6f9ff3 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:01:29.134986 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8f8b2343-8fe7-4fe5-b927-1a5c2e6f9ff3 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/84235177-b397-41d2-887c-1c6494d255b1" status: 200 len: 1678 microversion: 2.1 time: 0.170724 Sep 08 12:01:29.135573 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3757/7645] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:01:28 2022] GET /compute/v2.1/servers/84235177-b397-41d2-887c-1c6494d255b1 => generated 1678 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:01:30.160437 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b7d3b0da-2bd7-40e0-8b26-2aac792e88e8 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:01:30.161098 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b7d3b0da-2bd7-40e0-8b26-2aac792e88e8 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 84235177-b397-41d2-887c-1c6494d255b1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:01:30.167593 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b7d3b0da-2bd7-40e0-8b26-2aac792e88e8 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:01:30.168089 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b7d3b0da-2bd7-40e0-8b26-2aac792e88e8 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:01:30.168536 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b7d3b0da-2bd7-40e0-8b26-2aac792e88e8 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:01:30.169270 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b7d3b0da-2bd7-40e0-8b26-2aac792e88e8 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:01:30.169742 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b7d3b0da-2bd7-40e0-8b26-2aac792e88e8 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:01:30.170178 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b7d3b0da-2bd7-40e0-8b26-2aac792e88e8 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:01:30.303794 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b7d3b0da-2bd7-40e0-8b26-2aac792e88e8 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:01:30.311619 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b7d3b0da-2bd7-40e0-8b26-2aac792e88e8 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/84235177-b397-41d2-887c-1c6494d255b1" status: 200 len: 1682 microversion: 2.1 time: 0.156441 Sep 08 12:01:30.312192 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3889/7646] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:01:30 2022] GET /compute/v2.1/servers/84235177-b397-41d2-887c-1c6494d255b1 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:01:56.513644 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6d1fadf7-f190-4532-a361-fa4664de0f24 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:01:56.516023 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6d1fadf7-f190-4532-a361-fa4664de0f24 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 84235177-b397-41d2-887c-1c6494d255b1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:01:56.518943 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=16 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:01:56.519626 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=44 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:01:56.525662 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d1fadf7-f190-4532-a361-fa4664de0f24 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:01:56.526175 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d1fadf7-f190-4532-a361-fa4664de0f24 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:01:56.526657 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d1fadf7-f190-4532-a361-fa4664de0f24 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:01:56.527380 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d1fadf7-f190-4532-a361-fa4664de0f24 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:01:56.527852 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d1fadf7-f190-4532-a361-fa4664de0f24 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:01:56.528294 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d1fadf7-f190-4532-a361-fa4664de0f24 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:01:56.582929 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6d1fadf7-f190-4532-a361-fa4664de0f24 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "POST /compute/v2.1/servers/84235177-b397-41d2-887c-1c6494d255b1/action" status: 200 len: 59593 microversion: 2.1 time: 0.073016 Sep 08 12:01:56.583680 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3758/7647] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 12:01:56 2022] POST /compute/v2.1/servers/84235177-b397-41d2-887c-1c6494d255b1/action => generated 59593 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 12:02:04.201959 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-d65bb080-74fe-4175-b614-b90549c3422f req-18757874-8553-4569-9688-04a8e0a2c92a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84235177-b397-41d2-887c-1c6494d255b1", "tag": "62dd80bb-8320-4c28-b4e1-2884caaf8ffa"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:02:04.208351 n-d-850501-12 devstack@n-api.service[128862]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 12:02:04.208511 n-d-850501-12 devstack@n-api.service[128862]: Thu Sep 8 12:02:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.27) !!! Sep 08 12:02:04.210367 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9ba92500-ad33-4269-9243-6e2a65726c53 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:02:04.210903 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9ba92500-ad33-4269-9243-6e2a65726c53 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 84235177-b397-41d2-887c-1c6494d255b1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:02:04.218367 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=16 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:02:04.219009 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:02:04.221373 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ba92500-ad33-4269-9243-6e2a65726c53 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:02:04.221904 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ba92500-ad33-4269-9243-6e2a65726c53 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:02:04.222353 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ba92500-ad33-4269-9243-6e2a65726c53 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:02:04.223154 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ba92500-ad33-4269-9243-6e2a65726c53 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:02:04.223543 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ba92500-ad33-4269-9243-6e2a65726c53 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:02:04.223982 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ba92500-ad33-4269-9243-6e2a65726c53 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:02:04.225681 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d65bb080-74fe-4175-b614-b90549c3422f req-18757874-8553-4569-9688-04a8e0a2c92a service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:02:04.226179 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d65bb080-74fe-4175-b614-b90549c3422f req-18757874-8553-4569-9688-04a8e0a2c92a service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:02:04.226675 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d65bb080-74fe-4175-b614-b90549c3422f req-18757874-8553-4569-9688-04a8e0a2c92a service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:02:04.239662 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-d65bb080-74fe-4175-b614-b90549c3422f req-18757874-8553-4569-9688-04a8e0a2c92a service nova] Creating event network-changed:62dd80bb-8320-4c28-b4e1-2884caaf8ffa for instance 84235177-b397-41d2-887c-1c6494d255b1 on n-h1-850501-12 Sep 08 12:02:04.245730 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-d65bb080-74fe-4175-b614-b90549c3422f req-18757874-8553-4569-9688-04a8e0a2c92a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047710 Sep 08 12:02:04.246625 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3759/7648] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 12:02:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:02:04.259961 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9ba92500-ad33-4269-9243-6e2a65726c53 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 84235177-b397-41d2-887c-1c6494d255b1] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:02:04.369828 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9ba92500-ad33-4269-9243-6e2a65726c53 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "DELETE /compute/v2.1/servers/84235177-b397-41d2-887c-1c6494d255b1" status: 204 len: 0 microversion: 2.1 time: 0.174096 Sep 08 12:02:04.370800 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3890/7649] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 12:02:04 2022] DELETE /compute/v2.1/servers/84235177-b397-41d2-887c-1c6494d255b1 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:02:04.380159 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fd39a434-b0b1-4ed0-8d5b-32642d5bc92c tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:02:04.380891 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fd39a434-b0b1-4ed0-8d5b-32642d5bc92c tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 84235177-b397-41d2-887c-1c6494d255b1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:02:04.388542 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd39a434-b0b1-4ed0-8d5b-32642d5bc92c tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:02:04.389503 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd39a434-b0b1-4ed0-8d5b-32642d5bc92c tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:02:04.390234 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd39a434-b0b1-4ed0-8d5b-32642d5bc92c tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:02:04.392069 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd39a434-b0b1-4ed0-8d5b-32642d5bc92c tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:02:04.392069 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd39a434-b0b1-4ed0-8d5b-32642d5bc92c tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:02:04.392324 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd39a434-b0b1-4ed0-8d5b-32642d5bc92c tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:02:04.588244 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fd39a434-b0b1-4ed0-8d5b-32642d5bc92c tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:02:04.598181 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fd39a434-b0b1-4ed0-8d5b-32642d5bc92c tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/84235177-b397-41d2-887c-1c6494d255b1" status: 200 len: 1688 microversion: 2.1 time: 0.222786 Sep 08 12:02:04.598792 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3760/7650] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:02:04 2022] GET /compute/v2.1/servers/84235177-b397-41d2-887c-1c6494d255b1 => generated 1688 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:02:05.625969 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-59b1ba9c-5173-4106-b82f-1d0963362cdf tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:02:05.626755 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-59b1ba9c-5173-4106-b82f-1d0963362cdf tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 84235177-b397-41d2-887c-1c6494d255b1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:02:05.633654 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-59b1ba9c-5173-4106-b82f-1d0963362cdf tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:02:05.634199 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-59b1ba9c-5173-4106-b82f-1d0963362cdf tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:02:05.634744 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-59b1ba9c-5173-4106-b82f-1d0963362cdf tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:02:05.635357 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-59b1ba9c-5173-4106-b82f-1d0963362cdf tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:02:05.635817 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-59b1ba9c-5173-4106-b82f-1d0963362cdf tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:02:05.636284 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-59b1ba9c-5173-4106-b82f-1d0963362cdf tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:02:05.904080 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-59b1ba9c-5173-4106-b82f-1d0963362cdf tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:02:05.909349 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-59b1ba9c-5173-4106-b82f-1d0963362cdf tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/84235177-b397-41d2-887c-1c6494d255b1" status: 200 len: 1688 microversion: 2.1 time: 0.287890 Sep 08 12:02:05.909941 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3891/7651] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:02:05 2022] GET /compute/v2.1/servers/84235177-b397-41d2-887c-1c6494d255b1 => generated 1688 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:02:06.785937 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-032b86e9-a6ad-4d35-b78a-75784674faf6 req-d1f00319-6cfa-45a1-a856-340010654f01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84235177-b397-41d2-887c-1c6494d255b1", "name": "network-vif-deleted", "tag": "62dd80bb-8320-4c28-b4e1-2884caaf8ffa"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:02:06.798808 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-032b86e9-a6ad-4d35-b78a-75784674faf6 req-d1f00319-6cfa-45a1-a856-340010654f01 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:02:06.799461 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-032b86e9-a6ad-4d35-b78a-75784674faf6 req-d1f00319-6cfa-45a1-a856-340010654f01 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:02:06.800014 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-032b86e9-a6ad-4d35-b78a-75784674faf6 req-d1f00319-6cfa-45a1-a856-340010654f01 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:02:06.813182 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-032b86e9-a6ad-4d35-b78a-75784674faf6 req-d1f00319-6cfa-45a1-a856-340010654f01 service nova] Creating event network-vif-deleted:62dd80bb-8320-4c28-b4e1-2884caaf8ffa for instance 84235177-b397-41d2-887c-1c6494d255b1 on n-h1-850501-12 Sep 08 12:02:06.818925 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-032b86e9-a6ad-4d35-b78a-75784674faf6 req-d1f00319-6cfa-45a1-a856-340010654f01 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037299 Sep 08 12:02:06.819551 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3761/7652] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 12:02:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:02:06.935643 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ea0fbafd-774c-4093-9e93-9e0610d2a604 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:02:06.936275 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ea0fbafd-774c-4093-9e93-9e0610d2a604 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 84235177-b397-41d2-887c-1c6494d255b1] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:02:06.943226 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ea0fbafd-774c-4093-9e93-9e0610d2a604 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:02:06.943715 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ea0fbafd-774c-4093-9e93-9e0610d2a604 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:02:06.944361 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ea0fbafd-774c-4093-9e93-9e0610d2a604 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:02:06.945140 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ea0fbafd-774c-4093-9e93-9e0610d2a604 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:02:06.946206 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ea0fbafd-774c-4093-9e93-9e0610d2a604 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:02:06.946731 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ea0fbafd-774c-4093-9e93-9e0610d2a604 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:02:06.979994 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ea0fbafd-774c-4093-9e93-9e0610d2a604 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:02:06.980408 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ea0fbafd-774c-4093-9e93-9e0610d2a604 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:02:06.980843 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ea0fbafd-774c-4093-9e93-9e0610d2a604 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:02:06.981315 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-ea0fbafd-774c-4093-9e93-9e0610d2a604 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lazy-loading 'fault' on Instance uuid 84235177-b397-41d2-887c-1c6494d255b1 {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:02:07.030571 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ea0fbafd-774c-4093-9e93-9e0610d2a604 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:02:07.039370 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ea0fbafd-774c-4093-9e93-9e0610d2a604 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/84235177-b397-41d2-887c-1c6494d255b1" status: 200 len: 1357 microversion: 2.1 time: 0.107804 Sep 08 12:02:07.040089 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3892/7653] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:02:06 2022] GET /compute/v2.1/servers/84235177-b397-41d2-887c-1c6494d255b1 => generated 1357 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:02:08.064074 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d7f9cd0b-2ff3-4dfe-b621-694916be0693 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:02:08.064821 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d7f9cd0b-2ff3-4dfe-b621-694916be0693 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 84235177-b397-41d2-887c-1c6494d255b1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:02:08.071732 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d7f9cd0b-2ff3-4dfe-b621-694916be0693 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:02:08.072232 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d7f9cd0b-2ff3-4dfe-b621-694916be0693 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:02:08.072686 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d7f9cd0b-2ff3-4dfe-b621-694916be0693 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:02:08.073431 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d7f9cd0b-2ff3-4dfe-b621-694916be0693 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:02:08.073907 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d7f9cd0b-2ff3-4dfe-b621-694916be0693 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:02:08.074347 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d7f9cd0b-2ff3-4dfe-b621-694916be0693 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:02:08.088725 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-d7f9cd0b-2ff3-4dfe-b621-694916be0693 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] HTTP exception thrown: Instance 84235177-b397-41d2-887c-1c6494d255b1 could not be found. Sep 08 12:02:08.090802 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d7f9cd0b-2ff3-4dfe-b621-694916be0693 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Request method failure captured: Sep 08 12:02:08.090802 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/84235177-b397-41d2-887c-1c6494d255b1 HTTP/1.1 Sep 08 12:02:08.090802 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 12:02:08.090802 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 12:02:08.090802 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 12:02:08.090802 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 12:02:08.090802 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 12:02:08.090802 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 12:02:08.090802 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 12:02:08.090802 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 12:02:08.090802 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGdgwe3QmhiGsoiILM5bGeIE-EHzsnjM6KQuMFsKvCXbg967J71JinBeGFRd1mku6-Z-m4JQ9yWbqYK6Z1MSuErSUTO54qKxQVH-rPnvuL8XP6AL5ODpR7jo94wp_BdEp1m68Loc1_k9cMRb5G6-FLWWIE65rAilwZFS7jxy1f7IqtpQ Sep 08 12:02:08.090802 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 12:02:08.090802 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 12:02:08.090802 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 12:02:08.090802 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 12:02:08.090802 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 12:02:08.090802 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 12:02:08.090802 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: f00a6070707c4334b4beb7d530b15814 Sep 08 12:02:08.090802 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1687454490 Sep 08 12:02:08.090802 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 12:02:08.090802 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 12:02:08.090802 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f00a6070707c4334b4beb7d530b15814"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f00a6070707c4334b4beb7d530b15814"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f00a6070707c4334b4beb7d530b15814"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f00a6070707c4334b4beb7d530b15814"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 12:02:08.090802 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1687454490 Sep 08 12:02:08.090802 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: f00a6070707c4334b4beb7d530b15814 Sep 08 12:02:08.090802 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1687454490 Sep 08 12:02:08.090802 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-TestNetworkAdvancedServerOps-1687454490-project Sep 08 12:02:08.090802 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 12:02:08.090802 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 12:02:08.090802 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: 4a16b57190c243a5b78e7717eb4a016b Sep 08 12:02:08.090802 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1687454490-project Sep 08 12:02:08.090802 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 12:02:08.090802 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance 84235177-b397-41d2-887c-1c6494d255b1 could not be found. Sep 08 12:02:08.090802 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': '84235177-b397-41d2-887c-1c6494d255b1'} Sep 08 12:02:08.090802 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:02:08.090802 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:02:08.090802 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:02:08.090802 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:02:08.090802 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:02:08.090802 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:02:08.090802 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:02:08.090802 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:02:08.090802 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:02:08.090802 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:02:08.090802 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84235177-b397-41d2-887c-1c6494d255b1 could not be found. Sep 08 12:02:08.090802 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 12:02:08.090802 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:02:08.090802 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 12:02:08.090802 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:02:08.090802 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:02:08.090802 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:02:08.090802 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:02:08.090802 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:02:08.090802 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:02:08.090802 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:02:08.090802 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:02:08.090802 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:02:08.090802 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:02:08.090802 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:02:08.090802 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:02:08.090802 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:02:08.090802 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84235177-b397-41d2-887c-1c6494d255b1 could not be found. Sep 08 12:02:08.090802 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 12:02:08.090802 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:02:08.096032 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 12:02:08.096032 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:02:08.096032 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:02:08.096032 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:02:08.096032 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:02:08.096032 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:02:08.096032 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84235177-b397-41d2-887c-1c6494d255b1 could not be found. Sep 08 12:02:08.096032 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 12:02:08.096032 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d7f9cd0b-2ff3-4dfe-b621-694916be0693 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Returning 404 to user: Instance 84235177-b397-41d2-887c-1c6494d255b1 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:02:08.096032 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d7f9cd0b-2ff3-4dfe-b621-694916be0693 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/84235177-b397-41d2-887c-1c6494d255b1" status: 404 len: 111 microversion: 2.1 time: 0.033244 Sep 08 12:02:08.096032 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3762/7654] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:02:08 2022] GET /compute/v2.1/servers/84235177-b397-41d2-887c-1c6494d255b1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:02:11.124584 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fe19aaa0-f6f6-4196-b665-ec579dfacc37 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '.version_select at 0x7f68df9045e0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:02:11.155940 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fe19aaa0-f6f6-4196-b665-ec579dfacc37 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1236023709" status: 202 len: 0 microversion: 2.1 time: 0.035406 Sep 08 12:02:11.156855 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3893/7655] 10.222.0.27 () {58 vars in 1284 bytes} [Thu Sep 8 12:02:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1236023709 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:02:11.193875 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a217a548-bd41-4ea8-b191-1889a81bb30e tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Action: 'create', calling method: .version_select at 0x7f68e464b0d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-11869396", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG0En9LbP05bGr3H2V/SkDzsGTcIdDQ3UY+z4lIiX127O6tJlrptBcIVduRv+UrXlJhYBJRgMSUFYgFh250XO2WNiT495RmtcxyKeJpaxAvjf0V8CcZCcw615GIdiQo7wA=="}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:02:11.219513 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-a217a548-bd41-4ea8-b191-1889a81bb30e tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Getting quotas for project f00a6070707c4334b4beb7d530b15814. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:02:11.227173 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-a217a548-bd41-4ea8-b191-1889a81bb30e tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Getting quotas for user 4a16b57190c243a5b78e7717eb4a016b and project f00a6070707c4334b4beb7d530b15814. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:02:11.257342 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a217a548-bd41-4ea8-b191-1889a81bb30e tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.068112 Sep 08 12:02:11.258583 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3763/7656] 10.222.0.27 () {60 vars in 1159 bytes} [Thu Sep 8 12:02:11 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:02:16.923516 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2be48459-1287-4d85-a434-0e3ad53bb221 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-849048183", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "networks": [{"uuid": "f0430ed8-e6f4-49f7-ab85-40ed57d848c1"}], "key_name": "tempest-TestNetworkAdvancedServerOps-11869396", "security_groups": [{"name": "tempest-secgroup-smoke-253959917"}]}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:02:17.035013 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:02:17.070607 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-2be48459-1287-4d85-a434-0e3ad53bb221 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] validate_networks() for [('f0430ed8-e6f4-49f7-ab85-40ed57d848c1', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:02:17.515939 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-2be48459-1287-4d85-a434-0e3ad53bb221 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:02:17.516749 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-2be48459-1287-4d85-a434-0e3ad53bb221 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:02:17.517588 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-2be48459-1287-4d85-a434-0e3ad53bb221 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:02:17.518451 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-2be48459-1287-4d85-a434-0e3ad53bb221 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:02:17.519749 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-2be48459-1287-4d85-a434-0e3ad53bb221 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:02:17.536282 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2be48459-1287-4d85-a434-0e3ad53bb221 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:02:17.536971 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2be48459-1287-4d85-a434-0e3ad53bb221 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:02:17.537539 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2be48459-1287-4d85-a434-0e3ad53bb221 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:02:17.538577 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2be48459-1287-4d85-a434-0e3ad53bb221 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:02:17.539760 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2be48459-1287-4d85-a434-0e3ad53bb221 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:02:17.540301 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2be48459-1287-4d85-a434-0e3ad53bb221 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:02:17.559512 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-2be48459-1287-4d85-a434-0e3ad53bb221 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Getting quotas for project f00a6070707c4334b4beb7d530b15814. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:02:17.564941 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-2be48459-1287-4d85-a434-0e3ad53bb221 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Getting quotas for user 4a16b57190c243a5b78e7717eb4a016b and project f00a6070707c4334b4beb7d530b15814. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:02:17.578537 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2be48459-1287-4d85-a434-0e3ad53bb221 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:02:17.581085 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2be48459-1287-4d85-a434-0e3ad53bb221 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 13b34014-9a03-4817-9119-05664e761f76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:02:17.636308 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2be48459-1287-4d85-a434-0e3ad53bb221 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.718168 Sep 08 12:02:17.644128 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3894/7657] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 12:02:16 2022] POST /compute/v2.1/servers => generated 405 bytes in 727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 12:02:17.651093 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c50ca392-08d7-48cc-880c-a19a5b3ad0ff tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:02:17.651742 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c50ca392-08d7-48cc-880c-a19a5b3ad0ff tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 13b34014-9a03-4817-9119-05664e761f76] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:02:17.748924 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c50ca392-08d7-48cc-880c-a19a5b3ad0ff tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:02:17.759667 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c50ca392-08d7-48cc-880c-a19a5b3ad0ff tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/13b34014-9a03-4817-9119-05664e761f76" status: 200 len: 1264 microversion: 2.1 time: 0.112826 Sep 08 12:02:17.760672 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3764/7658] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:02:17 2022] GET /compute/v2.1/servers/13b34014-9a03-4817-9119-05664e761f76 => generated 1264 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:02:18.786288 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-227a86f1-0834-43fe-ab97-01d5c8d16142 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:02:18.787555 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-227a86f1-0834-43fe-ab97-01d5c8d16142 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 13b34014-9a03-4817-9119-05664e761f76] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:02:18.795426 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-227a86f1-0834-43fe-ab97-01d5c8d16142 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:02:18.796551 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-227a86f1-0834-43fe-ab97-01d5c8d16142 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:02:18.797370 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-227a86f1-0834-43fe-ab97-01d5c8d16142 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:02:18.798283 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-227a86f1-0834-43fe-ab97-01d5c8d16142 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:02:18.799037 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-227a86f1-0834-43fe-ab97-01d5c8d16142 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:02:18.799699 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-227a86f1-0834-43fe-ab97-01d5c8d16142 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:02:18.897912 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-227a86f1-0834-43fe-ab97-01d5c8d16142 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:02:18.910557 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-227a86f1-0834-43fe-ab97-01d5c8d16142 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/13b34014-9a03-4817-9119-05664e761f76" status: 200 len: 1316 microversion: 2.1 time: 0.131185 Sep 08 12:02:18.912025 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3895/7659] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:02:18 2022] GET /compute/v2.1/servers/13b34014-9a03-4817-9119-05664e761f76 => generated 1316 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:02:19.935163 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4e03de57-0c32-4957-a3a9-d89aa214f8df tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:02:19.935803 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4e03de57-0c32-4957-a3a9-d89aa214f8df tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 13b34014-9a03-4817-9119-05664e761f76] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:02:19.938250 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=16 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:02:19.946770 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e03de57-0c32-4957-a3a9-d89aa214f8df tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:02:19.947290 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e03de57-0c32-4957-a3a9-d89aa214f8df tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:02:19.947749 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e03de57-0c32-4957-a3a9-d89aa214f8df tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:02:19.948478 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e03de57-0c32-4957-a3a9-d89aa214f8df tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:02:19.948949 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e03de57-0c32-4957-a3a9-d89aa214f8df tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:02:19.949477 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e03de57-0c32-4957-a3a9-d89aa214f8df tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:02:20.495497 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4e03de57-0c32-4957-a3a9-d89aa214f8df tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:02:20.504620 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4e03de57-0c32-4957-a3a9-d89aa214f8df tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/13b34014-9a03-4817-9119-05664e761f76" status: 200 len: 1389 microversion: 2.1 time: 0.573187 Sep 08 12:02:20.505365 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3765/7660] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:02:19 2022] GET /compute/v2.1/servers/13b34014-9a03-4817-9119-05664e761f76 => generated 1389 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:02:20.863661 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-5c2d1e1e-ec2b-4f6a-a90b-d4085baa27d8 req-7c8d8655-30fa-492d-b063-c01a2ee71481 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13b34014-9a03-4817-9119-05664e761f76", "tag": "7fdfb0f4-c32c-49ff-ba30-7a18a507a382"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:02:20.877566 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-5c2d1e1e-ec2b-4f6a-a90b-d4085baa27d8 req-7c8d8655-30fa-492d-b063-c01a2ee71481 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:02:20.878608 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-5c2d1e1e-ec2b-4f6a-a90b-d4085baa27d8 req-7c8d8655-30fa-492d-b063-c01a2ee71481 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:02:20.879295 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-5c2d1e1e-ec2b-4f6a-a90b-d4085baa27d8 req-7c8d8655-30fa-492d-b063-c01a2ee71481 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:02:20.894860 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-5c2d1e1e-ec2b-4f6a-a90b-d4085baa27d8 req-7c8d8655-30fa-492d-b063-c01a2ee71481 service nova] Creating event network-changed:7fdfb0f4-c32c-49ff-ba30-7a18a507a382 for instance 13b34014-9a03-4817-9119-05664e761f76 on n-h2-850501-12 Sep 08 12:02:20.902886 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-5c2d1e1e-ec2b-4f6a-a90b-d4085baa27d8 req-7c8d8655-30fa-492d-b063-c01a2ee71481 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043911 Sep 08 12:02:20.903771 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3896/7661] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 12:02:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:02:21.528000 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4a04194b-58ec-4610-a79a-5ace063bd30c tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:02:21.528657 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4a04194b-58ec-4610-a79a-5ace063bd30c tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 13b34014-9a03-4817-9119-05664e761f76] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:02:21.535973 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a04194b-58ec-4610-a79a-5ace063bd30c tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:02:21.536478 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a04194b-58ec-4610-a79a-5ace063bd30c tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:02:21.536927 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a04194b-58ec-4610-a79a-5ace063bd30c tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:02:21.537657 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a04194b-58ec-4610-a79a-5ace063bd30c tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:02:21.538126 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a04194b-58ec-4610-a79a-5ace063bd30c tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:02:21.538603 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a04194b-58ec-4610-a79a-5ace063bd30c tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:02:21.682706 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4a04194b-58ec-4610-a79a-5ace063bd30c tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:02:21.690414 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4a04194b-58ec-4610-a79a-5ace063bd30c tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/13b34014-9a03-4817-9119-05664e761f76" status: 200 len: 1389 microversion: 2.1 time: 0.166353 Sep 08 12:02:21.690994 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3766/7662] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:02:21 2022] GET /compute/v2.1/servers/13b34014-9a03-4817-9119-05664e761f76 => generated 1389 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:02:22.715671 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-44c4f68c-1da1-42eb-bf10-6cf8e3055add tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:02:22.716388 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-44c4f68c-1da1-42eb-bf10-6cf8e3055add tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 13b34014-9a03-4817-9119-05664e761f76] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:02:22.722634 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-44c4f68c-1da1-42eb-bf10-6cf8e3055add tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:02:22.723130 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-44c4f68c-1da1-42eb-bf10-6cf8e3055add tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:02:22.723576 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-44c4f68c-1da1-42eb-bf10-6cf8e3055add tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:02:22.724280 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-44c4f68c-1da1-42eb-bf10-6cf8e3055add tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:02:22.724740 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-44c4f68c-1da1-42eb-bf10-6cf8e3055add tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:02:22.725216 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-44c4f68c-1da1-42eb-bf10-6cf8e3055add tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:02:22.867176 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-44c4f68c-1da1-42eb-bf10-6cf8e3055add tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:02:22.875200 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-44c4f68c-1da1-42eb-bf10-6cf8e3055add tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/13b34014-9a03-4817-9119-05664e761f76" status: 200 len: 1389 microversion: 2.1 time: 0.165169 Sep 08 12:02:22.875787 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3897/7663] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:02:22 2022] GET /compute/v2.1/servers/13b34014-9a03-4817-9119-05664e761f76 => generated 1389 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:02:23.899361 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-de5096ee-97b4-4a16-9c5d-18fc40b1c752 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:02:23.900124 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-de5096ee-97b4-4a16-9c5d-18fc40b1c752 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 13b34014-9a03-4817-9119-05664e761f76] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:02:23.906920 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de5096ee-97b4-4a16-9c5d-18fc40b1c752 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:02:23.907420 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de5096ee-97b4-4a16-9c5d-18fc40b1c752 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:02:23.907898 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de5096ee-97b4-4a16-9c5d-18fc40b1c752 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:02:23.908600 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de5096ee-97b4-4a16-9c5d-18fc40b1c752 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:02:23.909095 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de5096ee-97b4-4a16-9c5d-18fc40b1c752 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:02:23.909534 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de5096ee-97b4-4a16-9c5d-18fc40b1c752 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:02:24.050584 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-de5096ee-97b4-4a16-9c5d-18fc40b1c752 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:02:24.059360 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-de5096ee-97b4-4a16-9c5d-18fc40b1c752 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/13b34014-9a03-4817-9119-05664e761f76" status: 200 len: 1389 microversion: 2.1 time: 0.164474 Sep 08 12:02:24.060061 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3767/7664] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:02:23 2022] GET /compute/v2.1/servers/13b34014-9a03-4817-9119-05664e761f76 => generated 1389 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:02:25.083462 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-27990c06-8359-4bee-b5ca-1b0e6ecf32b3 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:02:25.084015 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-27990c06-8359-4bee-b5ca-1b0e6ecf32b3 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 13b34014-9a03-4817-9119-05664e761f76] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:02:25.090994 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-27990c06-8359-4bee-b5ca-1b0e6ecf32b3 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:02:25.091491 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-27990c06-8359-4bee-b5ca-1b0e6ecf32b3 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:02:25.091932 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-27990c06-8359-4bee-b5ca-1b0e6ecf32b3 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:02:25.092633 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-27990c06-8359-4bee-b5ca-1b0e6ecf32b3 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:02:25.093143 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-27990c06-8359-4bee-b5ca-1b0e6ecf32b3 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:02:25.093652 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-27990c06-8359-4bee-b5ca-1b0e6ecf32b3 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:02:25.231135 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-27990c06-8359-4bee-b5ca-1b0e6ecf32b3 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:02:25.239319 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-27990c06-8359-4bee-b5ca-1b0e6ecf32b3 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/13b34014-9a03-4817-9119-05664e761f76" status: 200 len: 1389 microversion: 2.1 time: 0.159890 Sep 08 12:02:25.239894 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3898/7665] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:02:25 2022] GET /compute/v2.1/servers/13b34014-9a03-4817-9119-05664e761f76 => generated 1389 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:02:26.151071 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-28ddf2ce-4202-4216-8111-df46e530cf42 req-7df71265-7eab-4700-95a0-46ceb7276af9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13b34014-9a03-4817-9119-05664e761f76", "name": "network-vif-plugged", "status": "completed", "tag": "7fdfb0f4-c32c-49ff-ba30-7a18a507a382"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:02:26.162634 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-28ddf2ce-4202-4216-8111-df46e530cf42 req-7df71265-7eab-4700-95a0-46ceb7276af9 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:02:26.163187 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-28ddf2ce-4202-4216-8111-df46e530cf42 req-7df71265-7eab-4700-95a0-46ceb7276af9 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:02:26.163658 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-28ddf2ce-4202-4216-8111-df46e530cf42 req-7df71265-7eab-4700-95a0-46ceb7276af9 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:02:26.174944 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-28ddf2ce-4202-4216-8111-df46e530cf42 req-7df71265-7eab-4700-95a0-46ceb7276af9 service nova] Creating event network-vif-plugged:7fdfb0f4-c32c-49ff-ba30-7a18a507a382 for instance 13b34014-9a03-4817-9119-05664e761f76 on n-h2-850501-12 Sep 08 12:02:26.180724 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-28ddf2ce-4202-4216-8111-df46e530cf42 req-7df71265-7eab-4700-95a0-46ceb7276af9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033619 Sep 08 12:02:26.181354 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3768/7666] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 12:02:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:02:26.262785 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-20264cbe-917e-4593-bf5d-c319275241f2 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:02:26.263416 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-20264cbe-917e-4593-bf5d-c319275241f2 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 13b34014-9a03-4817-9119-05664e761f76] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:02:26.270453 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-20264cbe-917e-4593-bf5d-c319275241f2 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:02:26.270945 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-20264cbe-917e-4593-bf5d-c319275241f2 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:02:26.271387 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-20264cbe-917e-4593-bf5d-c319275241f2 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:02:26.272091 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-20264cbe-917e-4593-bf5d-c319275241f2 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:02:26.272597 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-20264cbe-917e-4593-bf5d-c319275241f2 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:02:26.273124 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-20264cbe-917e-4593-bf5d-c319275241f2 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:02:26.408512 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-20264cbe-917e-4593-bf5d-c319275241f2 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:02:26.417422 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-20264cbe-917e-4593-bf5d-c319275241f2 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/13b34014-9a03-4817-9119-05664e761f76" status: 200 len: 1389 microversion: 2.1 time: 0.158484 Sep 08 12:02:26.418002 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3899/7667] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:02:26 2022] GET /compute/v2.1/servers/13b34014-9a03-4817-9119-05664e761f76 => generated 1389 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:02:27.441639 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-eb1f84ac-0aa1-47a2-9dc4-adc74ca29979 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:02:27.442369 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-eb1f84ac-0aa1-47a2-9dc4-adc74ca29979 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 13b34014-9a03-4817-9119-05664e761f76] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:02:27.445512 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:02:27.452623 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb1f84ac-0aa1-47a2-9dc4-adc74ca29979 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:02:27.453056 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb1f84ac-0aa1-47a2-9dc4-adc74ca29979 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:02:27.453519 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb1f84ac-0aa1-47a2-9dc4-adc74ca29979 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:02:27.454247 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb1f84ac-0aa1-47a2-9dc4-adc74ca29979 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:02:27.454745 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb1f84ac-0aa1-47a2-9dc4-adc74ca29979 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:02:27.455192 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb1f84ac-0aa1-47a2-9dc4-adc74ca29979 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:02:27.595196 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-eb1f84ac-0aa1-47a2-9dc4-adc74ca29979 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:02:27.604436 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-eb1f84ac-0aa1-47a2-9dc4-adc74ca29979 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/13b34014-9a03-4817-9119-05664e761f76" status: 200 len: 1389 microversion: 2.1 time: 0.167137 Sep 08 12:02:27.605066 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3769/7668] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:02:27 2022] GET /compute/v2.1/servers/13b34014-9a03-4817-9119-05664e761f76 => generated 1389 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:02:28.628366 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4aed4393-5b26-4737-bc44-3f9fa596c23f tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:02:28.628985 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4aed4393-5b26-4737-bc44-3f9fa596c23f tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 13b34014-9a03-4817-9119-05664e761f76] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:02:28.631854 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:02:28.633303 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=6 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:02:28.639586 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4aed4393-5b26-4737-bc44-3f9fa596c23f tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:02:28.640087 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4aed4393-5b26-4737-bc44-3f9fa596c23f tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:02:28.640526 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4aed4393-5b26-4737-bc44-3f9fa596c23f tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:02:28.641257 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4aed4393-5b26-4737-bc44-3f9fa596c23f tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:02:28.641716 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4aed4393-5b26-4737-bc44-3f9fa596c23f tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:02:28.642146 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4aed4393-5b26-4737-bc44-3f9fa596c23f tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:02:28.780861 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4aed4393-5b26-4737-bc44-3f9fa596c23f tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:02:28.788728 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4aed4393-5b26-4737-bc44-3f9fa596c23f tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/13b34014-9a03-4817-9119-05664e761f76" status: 200 len: 1561 microversion: 2.1 time: 0.164360 Sep 08 12:02:28.789362 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3900/7669] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:02:28 2022] GET /compute/v2.1/servers/13b34014-9a03-4817-9119-05664e761f76 => generated 1561 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:02:28.811162 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-334c0c9a-fc3e-446f-93c4-12563d1bb695 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:02:28.811794 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-334c0c9a-fc3e-446f-93c4-12563d1bb695 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 13b34014-9a03-4817-9119-05664e761f76] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:02:28.813789 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:02:28.820427 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-334c0c9a-fc3e-446f-93c4-12563d1bb695 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:02:28.821128 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-334c0c9a-fc3e-446f-93c4-12563d1bb695 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:02:28.821582 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-334c0c9a-fc3e-446f-93c4-12563d1bb695 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:02:28.822300 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-334c0c9a-fc3e-446f-93c4-12563d1bb695 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:02:28.822768 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-334c0c9a-fc3e-446f-93c4-12563d1bb695 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:02:28.823206 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-334c0c9a-fc3e-446f-93c4-12563d1bb695 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:02:28.956045 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-334c0c9a-fc3e-446f-93c4-12563d1bb695 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:02:28.964454 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-334c0c9a-fc3e-446f-93c4-12563d1bb695 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/13b34014-9a03-4817-9119-05664e761f76" status: 200 len: 1561 microversion: 2.1 time: 0.157320 Sep 08 12:02:28.965039 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3770/7670] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:02:28 2022] GET /compute/v2.1/servers/13b34014-9a03-4817-9119-05664e761f76 => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:02:30.556310 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b67cd427-5ee2-4857-aef8-c5d86da83972 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:02:30.557015 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b67cd427-5ee2-4857-aef8-c5d86da83972 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 13b34014-9a03-4817-9119-05664e761f76] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:02:30.558371 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-bbf52f50-5c46-4e80-9041-256bd85059fe req-d0694f40-3359-4394-8d50-65cf47df6d5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13b34014-9a03-4817-9119-05664e761f76", "tag": "7fdfb0f4-c32c-49ff-ba30-7a18a507a382"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:02:30.564904 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b67cd427-5ee2-4857-aef8-c5d86da83972 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:02:30.565507 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b67cd427-5ee2-4857-aef8-c5d86da83972 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:02:30.566018 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b67cd427-5ee2-4857-aef8-c5d86da83972 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:02:30.566996 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b67cd427-5ee2-4857-aef8-c5d86da83972 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:02:30.567549 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b67cd427-5ee2-4857-aef8-c5d86da83972 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:02:30.568239 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b67cd427-5ee2-4857-aef8-c5d86da83972 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:02:30.570170 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-bbf52f50-5c46-4e80-9041-256bd85059fe req-d0694f40-3359-4394-8d50-65cf47df6d5b service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:02:30.571259 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-bbf52f50-5c46-4e80-9041-256bd85059fe req-d0694f40-3359-4394-8d50-65cf47df6d5b service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:02:30.571644 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-bbf52f50-5c46-4e80-9041-256bd85059fe req-d0694f40-3359-4394-8d50-65cf47df6d5b service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:02:30.583159 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-bbf52f50-5c46-4e80-9041-256bd85059fe req-d0694f40-3359-4394-8d50-65cf47df6d5b service nova] Creating event network-changed:7fdfb0f4-c32c-49ff-ba30-7a18a507a382 for instance 13b34014-9a03-4817-9119-05664e761f76 on n-h2-850501-12 Sep 08 12:02:30.589000 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-bbf52f50-5c46-4e80-9041-256bd85059fe req-d0694f40-3359-4394-8d50-65cf47df6d5b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035117 Sep 08 12:02:30.590199 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3771/7671] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 12:02:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:02:30.710655 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b67cd427-5ee2-4857-aef8-c5d86da83972 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:02:30.720110 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b67cd427-5ee2-4857-aef8-c5d86da83972 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/13b34014-9a03-4817-9119-05664e761f76" status: 200 len: 1561 microversion: 2.1 time: 0.168636 Sep 08 12:02:30.738289 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3901/7672] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:02:30 2022] GET /compute/v2.1/servers/13b34014-9a03-4817-9119-05664e761f76 => generated 1561 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:02:55.977602 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=5 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:02:55.978357 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=34 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:02:55.982897 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-98501d9e-47c5-46e6-8f69-0904c608cfbb tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:02:55.985224 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-98501d9e-47c5-46e6-8f69-0904c608cfbb tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 13b34014-9a03-4817-9119-05664e761f76] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:02:55.992904 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-98501d9e-47c5-46e6-8f69-0904c608cfbb tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:02:55.993420 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-98501d9e-47c5-46e6-8f69-0904c608cfbb tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:02:55.993872 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-98501d9e-47c5-46e6-8f69-0904c608cfbb tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:02:55.994568 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-98501d9e-47c5-46e6-8f69-0904c608cfbb tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:02:55.995038 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-98501d9e-47c5-46e6-8f69-0904c608cfbb tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:02:55.995473 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-98501d9e-47c5-46e6-8f69-0904c608cfbb tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:02:56.055946 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-98501d9e-47c5-46e6-8f69-0904c608cfbb tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "POST /compute/v2.1/servers/13b34014-9a03-4817-9119-05664e761f76/action" status: 200 len: 24564 microversion: 2.1 time: 0.080102 Sep 08 12:02:56.056621 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3772/7673] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 12:02:55 2022] POST /compute/v2.1/servers/13b34014-9a03-4817-9119-05664e761f76/action => generated 24564 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 12:03:07.158966 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ec829565-4c8c-42e0-ba45-360b21aa004c tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:03:07.159546 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ec829565-4c8c-42e0-ba45-360b21aa004c tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 13b34014-9a03-4817-9119-05664e761f76] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:03:07.161804 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:03:07.162696 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=40 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:03:07.168953 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ec829565-4c8c-42e0-ba45-360b21aa004c tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:03:07.169478 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ec829565-4c8c-42e0-ba45-360b21aa004c tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:03:07.169923 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ec829565-4c8c-42e0-ba45-360b21aa004c tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:03:07.170628 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ec829565-4c8c-42e0-ba45-360b21aa004c tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:03:07.171093 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ec829565-4c8c-42e0-ba45-360b21aa004c tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:03:07.171524 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ec829565-4c8c-42e0-ba45-360b21aa004c tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:03:07.197051 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-ec829565-4c8c-42e0-ba45-360b21aa004c tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lazy-loading 'flavor' on Instance uuid 13b34014-9a03-4817-9119-05664e761f76 {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:03:07.266497 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ec829565-4c8c-42e0-ba45-360b21aa004c tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "POST /compute/v2.1/servers/13b34014-9a03-4817-9119-05664e761f76/action" status: 202 len: 0 microversion: 2.1 time: 0.111371 Sep 08 12:03:07.267141 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3902/7674] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 12:03:07 2022] POST /compute/v2.1/servers/13b34014-9a03-4817-9119-05664e761f76/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:03:07.275941 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a89d5343-df15-4496-abfc-617bb8a0e202 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:03:07.276662 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a89d5343-df15-4496-abfc-617bb8a0e202 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 13b34014-9a03-4817-9119-05664e761f76] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:03:07.279656 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:03:07.280414 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=4 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:03:07.286871 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a89d5343-df15-4496-abfc-617bb8a0e202 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:03:07.287408 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a89d5343-df15-4496-abfc-617bb8a0e202 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:03:07.287857 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a89d5343-df15-4496-abfc-617bb8a0e202 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:03:07.288572 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a89d5343-df15-4496-abfc-617bb8a0e202 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:03:07.289138 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a89d5343-df15-4496-abfc-617bb8a0e202 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:03:07.289579 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a89d5343-df15-4496-abfc-617bb8a0e202 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:03:07.443915 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a89d5343-df15-4496-abfc-617bb8a0e202 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:03:07.451875 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a89d5343-df15-4496-abfc-617bb8a0e202 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/13b34014-9a03-4817-9119-05664e761f76" status: 200 len: 1688 microversion: 2.1 time: 0.180274 Sep 08 12:03:07.452459 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3773/7675] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:03:07 2022] GET /compute/v2.1/servers/13b34014-9a03-4817-9119-05664e761f76 => generated 1688 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:03:08.479138 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fc513594-06c8-46c3-a1f9-fb1a08240111 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:03:08.479877 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fc513594-06c8-46c3-a1f9-fb1a08240111 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 13b34014-9a03-4817-9119-05664e761f76] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:03:08.486174 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fc513594-06c8-46c3-a1f9-fb1a08240111 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:03:08.486603 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fc513594-06c8-46c3-a1f9-fb1a08240111 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:03:08.487039 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fc513594-06c8-46c3-a1f9-fb1a08240111 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:03:08.487728 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fc513594-06c8-46c3-a1f9-fb1a08240111 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:03:08.488442 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fc513594-06c8-46c3-a1f9-fb1a08240111 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:03:08.488867 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fc513594-06c8-46c3-a1f9-fb1a08240111 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:03:08.622737 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-fc513594-06c8-46c3-a1f9-fb1a08240111 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:03:08.630505 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fc513594-06c8-46c3-a1f9-fb1a08240111 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/13b34014-9a03-4817-9119-05664e761f76" status: 200 len: 1671 microversion: 2.1 time: 0.156803 Sep 08 12:03:08.631835 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3903/7676] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:03:08 2022] GET /compute/v2.1/servers/13b34014-9a03-4817-9119-05664e761f76 => generated 1671 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:03:09.728802 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a2a08b61-ea14-4066-8a32-a5ddfab9786e tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:03:09.731066 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a2a08b61-ea14-4066-8a32-a5ddfab9786e tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 13b34014-9a03-4817-9119-05664e761f76] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:03:09.738977 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2a08b61-ea14-4066-8a32-a5ddfab9786e tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:03:09.739481 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2a08b61-ea14-4066-8a32-a5ddfab9786e tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:03:09.739935 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2a08b61-ea14-4066-8a32-a5ddfab9786e tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:03:09.740726 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2a08b61-ea14-4066-8a32-a5ddfab9786e tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:03:09.741233 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2a08b61-ea14-4066-8a32-a5ddfab9786e tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:03:09.741681 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2a08b61-ea14-4066-8a32-a5ddfab9786e tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:03:09.801581 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a2a08b61-ea14-4066-8a32-a5ddfab9786e tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "POST /compute/v2.1/servers/13b34014-9a03-4817-9119-05664e761f76/action" status: 200 len: 38377 microversion: 2.1 time: 0.076993 Sep 08 12:03:09.802545 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3774/7677] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 12:03:09 2022] POST /compute/v2.1/servers/13b34014-9a03-4817-9119-05664e761f76/action => generated 38377 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 12:03:09.814333 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a966e37f-975b-4130-bbb3-c13d3e6d7d53 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:03:09.814963 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a966e37f-975b-4130-bbb3-c13d3e6d7d53 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 13b34014-9a03-4817-9119-05664e761f76] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:03:09.822199 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a966e37f-975b-4130-bbb3-c13d3e6d7d53 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:03:09.822762 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a966e37f-975b-4130-bbb3-c13d3e6d7d53 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:03:09.823293 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a966e37f-975b-4130-bbb3-c13d3e6d7d53 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:03:09.823997 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a966e37f-975b-4130-bbb3-c13d3e6d7d53 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:03:09.824453 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a966e37f-975b-4130-bbb3-c13d3e6d7d53 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:03:09.824932 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a966e37f-975b-4130-bbb3-c13d3e6d7d53 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:03:09.899126 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a966e37f-975b-4130-bbb3-c13d3e6d7d53 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "POST /compute/v2.1/servers/13b34014-9a03-4817-9119-05664e761f76/action" status: 202 len: 0 microversion: 2.1 time: 0.088487 Sep 08 12:03:09.899788 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3904/7678] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 12:03:09 2022] POST /compute/v2.1/servers/13b34014-9a03-4817-9119-05664e761f76/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:03:09.910349 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-51fb7fa2-a834-4e14-8dc8-78764f88b4c8 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:03:09.911075 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-51fb7fa2-a834-4e14-8dc8-78764f88b4c8 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 13b34014-9a03-4817-9119-05664e761f76] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:03:09.925010 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51fb7fa2-a834-4e14-8dc8-78764f88b4c8 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:03:09.925553 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51fb7fa2-a834-4e14-8dc8-78764f88b4c8 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:03:09.926008 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51fb7fa2-a834-4e14-8dc8-78764f88b4c8 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:03:09.926732 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51fb7fa2-a834-4e14-8dc8-78764f88b4c8 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:03:09.927204 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51fb7fa2-a834-4e14-8dc8-78764f88b4c8 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:03:09.927701 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51fb7fa2-a834-4e14-8dc8-78764f88b4c8 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:03:10.146932 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-51fb7fa2-a834-4e14-8dc8-78764f88b4c8 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:03:10.154778 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-51fb7fa2-a834-4e14-8dc8-78764f88b4c8 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/13b34014-9a03-4817-9119-05664e761f76" status: 200 len: 1677 microversion: 2.1 time: 0.250100 Sep 08 12:03:10.155359 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3775/7679] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:03:09 2022] GET /compute/v2.1/servers/13b34014-9a03-4817-9119-05664e761f76 => generated 1677 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:03:11.180526 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-84a18eef-e0b3-47ee-b2f6-5cdf3c8fda2f tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:03:11.181269 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-84a18eef-e0b3-47ee-b2f6-5cdf3c8fda2f tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 13b34014-9a03-4817-9119-05664e761f76] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:03:11.188594 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-84a18eef-e0b3-47ee-b2f6-5cdf3c8fda2f tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:03:11.189281 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-84a18eef-e0b3-47ee-b2f6-5cdf3c8fda2f tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:03:11.189747 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-84a18eef-e0b3-47ee-b2f6-5cdf3c8fda2f tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:03:11.190447 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-84a18eef-e0b3-47ee-b2f6-5cdf3c8fda2f tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:03:11.190903 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-84a18eef-e0b3-47ee-b2f6-5cdf3c8fda2f tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:03:11.191329 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-84a18eef-e0b3-47ee-b2f6-5cdf3c8fda2f tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:03:11.331797 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-84a18eef-e0b3-47ee-b2f6-5cdf3c8fda2f tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:03:11.339830 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-84a18eef-e0b3-47ee-b2f6-5cdf3c8fda2f tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/13b34014-9a03-4817-9119-05664e761f76" status: 200 len: 1677 microversion: 2.1 time: 0.164618 Sep 08 12:03:11.340414 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3905/7680] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:03:11 2022] GET /compute/v2.1/servers/13b34014-9a03-4817-9119-05664e761f76 => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:03:12.364410 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2b7357d5-c7b8-4e7d-893e-5eaa83a8e5e0 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:03:12.365609 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2b7357d5-c7b8-4e7d-893e-5eaa83a8e5e0 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 13b34014-9a03-4817-9119-05664e761f76] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:03:12.372831 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b7357d5-c7b8-4e7d-893e-5eaa83a8e5e0 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:03:12.373372 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b7357d5-c7b8-4e7d-893e-5eaa83a8e5e0 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:03:12.373830 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b7357d5-c7b8-4e7d-893e-5eaa83a8e5e0 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:03:12.374549 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b7357d5-c7b8-4e7d-893e-5eaa83a8e5e0 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:03:12.375026 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b7357d5-c7b8-4e7d-893e-5eaa83a8e5e0 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:03:12.375474 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b7357d5-c7b8-4e7d-893e-5eaa83a8e5e0 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:03:12.509621 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2b7357d5-c7b8-4e7d-893e-5eaa83a8e5e0 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:03:12.517366 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2b7357d5-c7b8-4e7d-893e-5eaa83a8e5e0 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/13b34014-9a03-4817-9119-05664e761f76" status: 200 len: 1680 microversion: 2.1 time: 0.157146 Sep 08 12:03:12.517939 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3776/7681] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:03:12 2022] GET /compute/v2.1/servers/13b34014-9a03-4817-9119-05664e761f76 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:03:12.617915 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-93da699b-38e8-43db-a1dc-d21b3a227dc3 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:03:12.620118 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-93da699b-38e8-43db-a1dc-d21b3a227dc3 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 13b34014-9a03-4817-9119-05664e761f76] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:03:12.626956 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-93da699b-38e8-43db-a1dc-d21b3a227dc3 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:03:12.627453 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-93da699b-38e8-43db-a1dc-d21b3a227dc3 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:03:12.627896 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-93da699b-38e8-43db-a1dc-d21b3a227dc3 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:03:12.628597 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-93da699b-38e8-43db-a1dc-d21b3a227dc3 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:03:12.629087 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-93da699b-38e8-43db-a1dc-d21b3a227dc3 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:03:12.629521 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-93da699b-38e8-43db-a1dc-d21b3a227dc3 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:03:12.678862 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-93da699b-38e8-43db-a1dc-d21b3a227dc3 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "POST /compute/v2.1/servers/13b34014-9a03-4817-9119-05664e761f76/action" status: 200 len: 38377 microversion: 2.1 time: 0.065725 Sep 08 12:03:12.679801 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3906/7682] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 12:03:12 2022] POST /compute/v2.1/servers/13b34014-9a03-4817-9119-05664e761f76/action => generated 38377 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 12:03:14.003223 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-626ff546-e5a7-40c1-90cb-38e81fcb23b1 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:03:14.003778 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-626ff546-e5a7-40c1-90cb-38e81fcb23b1 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 13b34014-9a03-4817-9119-05664e761f76] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:03:14.008012 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-ffb8a6ef-79a1-48cf-860d-695dda3d9d21 req-5524ce5c-d545-4b6c-b632-8097659ba4d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13b34014-9a03-4817-9119-05664e761f76", "tag": "7fdfb0f4-c32c-49ff-ba30-7a18a507a382"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:03:14.011623 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-626ff546-e5a7-40c1-90cb-38e81fcb23b1 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:03:14.012126 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-626ff546-e5a7-40c1-90cb-38e81fcb23b1 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:03:14.012640 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-626ff546-e5a7-40c1-90cb-38e81fcb23b1 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:03:14.013363 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-626ff546-e5a7-40c1-90cb-38e81fcb23b1 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:03:14.013842 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-626ff546-e5a7-40c1-90cb-38e81fcb23b1 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:03:14.014281 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-626ff546-e5a7-40c1-90cb-38e81fcb23b1 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:03:14.018975 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-ffb8a6ef-79a1-48cf-860d-695dda3d9d21 req-5524ce5c-d545-4b6c-b632-8097659ba4d9 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:03:14.019469 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-ffb8a6ef-79a1-48cf-860d-695dda3d9d21 req-5524ce5c-d545-4b6c-b632-8097659ba4d9 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:03:14.019907 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-ffb8a6ef-79a1-48cf-860d-695dda3d9d21 req-5524ce5c-d545-4b6c-b632-8097659ba4d9 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:03:14.032411 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-ffb8a6ef-79a1-48cf-860d-695dda3d9d21 req-5524ce5c-d545-4b6c-b632-8097659ba4d9 service nova] Creating event network-changed:7fdfb0f4-c32c-49ff-ba30-7a18a507a382 for instance 13b34014-9a03-4817-9119-05664e761f76 on n-h2-850501-12 Sep 08 12:03:14.037777 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-ffb8a6ef-79a1-48cf-860d-695dda3d9d21 req-5524ce5c-d545-4b6c-b632-8097659ba4d9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035831 Sep 08 12:03:14.038519 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3907/7683] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 12:03:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:03:14.042482 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-626ff546-e5a7-40c1-90cb-38e81fcb23b1 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 13b34014-9a03-4817-9119-05664e761f76] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:03:14.130017 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-626ff546-e5a7-40c1-90cb-38e81fcb23b1 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "DELETE /compute/v2.1/servers/13b34014-9a03-4817-9119-05664e761f76" status: 204 len: 0 microversion: 2.1 time: 0.130789 Sep 08 12:03:14.131006 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3777/7684] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 12:03:13 2022] DELETE /compute/v2.1/servers/13b34014-9a03-4817-9119-05664e761f76 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:03:14.140575 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f4035e60-ba47-4881-9bae-a7f29bd4a078 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:03:14.141335 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f4035e60-ba47-4881-9bae-a7f29bd4a078 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 13b34014-9a03-4817-9119-05664e761f76] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:03:14.149330 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f4035e60-ba47-4881-9bae-a7f29bd4a078 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:03:14.149841 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f4035e60-ba47-4881-9bae-a7f29bd4a078 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:03:14.150292 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f4035e60-ba47-4881-9bae-a7f29bd4a078 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:03:14.151012 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f4035e60-ba47-4881-9bae-a7f29bd4a078 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:03:14.151483 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f4035e60-ba47-4881-9bae-a7f29bd4a078 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:03:14.151917 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f4035e60-ba47-4881-9bae-a7f29bd4a078 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:03:14.298520 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f4035e60-ba47-4881-9bae-a7f29bd4a078 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:03:14.307723 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f4035e60-ba47-4881-9bae-a7f29bd4a078 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/13b34014-9a03-4817-9119-05664e761f76" status: 200 len: 1686 microversion: 2.1 time: 0.171822 Sep 08 12:03:14.308321 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3908/7685] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:03:14 2022] GET /compute/v2.1/servers/13b34014-9a03-4817-9119-05664e761f76 => generated 1686 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:03:15.334871 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5750698d-3f2a-4267-a438-2e6d1838a447 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:03:15.335585 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5750698d-3f2a-4267-a438-2e6d1838a447 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 13b34014-9a03-4817-9119-05664e761f76] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:03:15.342380 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5750698d-3f2a-4267-a438-2e6d1838a447 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:03:15.342885 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5750698d-3f2a-4267-a438-2e6d1838a447 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:03:15.343338 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5750698d-3f2a-4267-a438-2e6d1838a447 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:03:15.344057 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5750698d-3f2a-4267-a438-2e6d1838a447 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:03:15.344525 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5750698d-3f2a-4267-a438-2e6d1838a447 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:03:15.344965 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5750698d-3f2a-4267-a438-2e6d1838a447 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:03:15.480470 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5750698d-3f2a-4267-a438-2e6d1838a447 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:03:15.488491 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5750698d-3f2a-4267-a438-2e6d1838a447 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/13b34014-9a03-4817-9119-05664e761f76" status: 200 len: 1686 microversion: 2.1 time: 0.158551 Sep 08 12:03:15.489088 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3778/7686] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:03:15 2022] GET /compute/v2.1/servers/13b34014-9a03-4817-9119-05664e761f76 => generated 1686 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:03:16.373352 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-619cbf15-b7c3-4667-98d6-a67040e35620 req-f7b4eddb-5df9-47df-bdd8-85a1e5cb7643 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13b34014-9a03-4817-9119-05664e761f76", "name": "network-vif-deleted", "tag": "7fdfb0f4-c32c-49ff-ba30-7a18a507a382"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:03:16.384947 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-619cbf15-b7c3-4667-98d6-a67040e35620 req-f7b4eddb-5df9-47df-bdd8-85a1e5cb7643 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:03:16.385391 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-619cbf15-b7c3-4667-98d6-a67040e35620 req-f7b4eddb-5df9-47df-bdd8-85a1e5cb7643 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:03:16.385832 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-619cbf15-b7c3-4667-98d6-a67040e35620 req-f7b4eddb-5df9-47df-bdd8-85a1e5cb7643 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:03:16.398149 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-619cbf15-b7c3-4667-98d6-a67040e35620 req-f7b4eddb-5df9-47df-bdd8-85a1e5cb7643 service nova] Creating event network-vif-deleted:7fdfb0f4-c32c-49ff-ba30-7a18a507a382 for instance 13b34014-9a03-4817-9119-05664e761f76 on n-h2-850501-12 Sep 08 12:03:16.403957 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-619cbf15-b7c3-4667-98d6-a67040e35620 req-f7b4eddb-5df9-47df-bdd8-85a1e5cb7643 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034461 Sep 08 12:03:16.404560 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3909/7687] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 12:03:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:03:16.516160 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e35f0168-bb53-4963-aa97-a7c7c19b1419 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:03:16.516829 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e35f0168-bb53-4963-aa97-a7c7c19b1419 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 13b34014-9a03-4817-9119-05664e761f76] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:03:16.524213 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e35f0168-bb53-4963-aa97-a7c7c19b1419 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:03:16.524763 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e35f0168-bb53-4963-aa97-a7c7c19b1419 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:03:16.525259 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e35f0168-bb53-4963-aa97-a7c7c19b1419 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:03:16.526038 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e35f0168-bb53-4963-aa97-a7c7c19b1419 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:03:16.526581 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e35f0168-bb53-4963-aa97-a7c7c19b1419 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:03:16.527084 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e35f0168-bb53-4963-aa97-a7c7c19b1419 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:03:16.560615 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e35f0168-bb53-4963-aa97-a7c7c19b1419 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:03:16.561171 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e35f0168-bb53-4963-aa97-a7c7c19b1419 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:03:16.561611 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e35f0168-bb53-4963-aa97-a7c7c19b1419 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:03:16.562074 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-e35f0168-bb53-4963-aa97-a7c7c19b1419 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lazy-loading 'fault' on Instance uuid 13b34014-9a03-4817-9119-05664e761f76 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:03:16.608837 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e35f0168-bb53-4963-aa97-a7c7c19b1419 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a16b57190c243a5b78e7717eb4a016b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00a6070707c4334b4beb7d530b15814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:03:16.617976 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e35f0168-bb53-4963-aa97-a7c7c19b1419 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/13b34014-9a03-4817-9119-05664e761f76" status: 200 len: 1354 microversion: 2.1 time: 0.109214 Sep 08 12:03:16.618558 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3779/7688] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:03:16 2022] GET /compute/v2.1/servers/13b34014-9a03-4817-9119-05664e761f76 => generated 1354 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:03:17.642384 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c52f899b-d42d-473a-9a2e-dc189e2cd9ab tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:03:17.643084 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c52f899b-d42d-473a-9a2e-dc189e2cd9ab tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] [instance: 13b34014-9a03-4817-9119-05664e761f76] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:03:17.650554 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c52f899b-d42d-473a-9a2e-dc189e2cd9ab tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:03:17.651045 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c52f899b-d42d-473a-9a2e-dc189e2cd9ab tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:03:17.651484 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c52f899b-d42d-473a-9a2e-dc189e2cd9ab tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:03:17.652187 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c52f899b-d42d-473a-9a2e-dc189e2cd9ab tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:03:17.652648 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c52f899b-d42d-473a-9a2e-dc189e2cd9ab tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:03:17.653117 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c52f899b-d42d-473a-9a2e-dc189e2cd9ab tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:03:17.667051 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-c52f899b-d42d-473a-9a2e-dc189e2cd9ab tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] HTTP exception thrown: Instance 13b34014-9a03-4817-9119-05664e761f76 could not be found. Sep 08 12:03:17.668865 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c52f899b-d42d-473a-9a2e-dc189e2cd9ab tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Request method failure captured: Sep 08 12:03:17.668865 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/13b34014-9a03-4817-9119-05664e761f76 HTTP/1.1 Sep 08 12:03:17.668865 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 12:03:17.668865 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 12:03:17.668865 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 12:03:17.668865 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 12:03:17.668865 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 12:03:17.668865 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 12:03:17.668865 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 12:03:17.668865 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 12:03:17.668865 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGdgwe3QmhiGsoiILM5bGeIE-EHzsnjM6KQuMFsKvCXbg967J71JinBeGFRd1mku6-Z-m4JQ9yWbqYK6Z1MSuErSUTO54qKxQVH-rPnvuL8XP6AL5ODpR7jo94wp_BdEp1m68Loc1_k9cMRb5G6-FLWWIE65rAilwZFS7jxy1f7IqtpQ Sep 08 12:03:17.668865 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 12:03:17.668865 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 12:03:17.668865 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 12:03:17.668865 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 12:03:17.668865 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 12:03:17.668865 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 12:03:17.668865 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: f00a6070707c4334b4beb7d530b15814 Sep 08 12:03:17.668865 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1687454490 Sep 08 12:03:17.668865 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 12:03:17.668865 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 12:03:17.668865 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f00a6070707c4334b4beb7d530b15814"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f00a6070707c4334b4beb7d530b15814"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f00a6070707c4334b4beb7d530b15814"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f00a6070707c4334b4beb7d530b15814"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 12:03:17.668865 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1687454490 Sep 08 12:03:17.668865 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: f00a6070707c4334b4beb7d530b15814 Sep 08 12:03:17.668865 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1687454490 Sep 08 12:03:17.668865 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-TestNetworkAdvancedServerOps-1687454490-project Sep 08 12:03:17.668865 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 12:03:17.668865 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 12:03:17.668865 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 4a16b57190c243a5b78e7717eb4a016b Sep 08 12:03:17.668865 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1687454490-project Sep 08 12:03:17.668865 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 12:03:17.668865 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 13b34014-9a03-4817-9119-05664e761f76 could not be found. Sep 08 12:03:17.668865 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '13b34014-9a03-4817-9119-05664e761f76'} Sep 08 12:03:17.668865 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:03:17.668865 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:03:17.668865 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:03:17.668865 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:03:17.668865 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:03:17.668865 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:03:17.668865 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:03:17.668865 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:03:17.668865 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:03:17.668865 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:03:17.668865 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13b34014-9a03-4817-9119-05664e761f76 could not be found. Sep 08 12:03:17.668865 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 12:03:17.668865 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:03:17.668865 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 12:03:17.668865 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:03:17.668865 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:03:17.668865 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:03:17.668865 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:03:17.668865 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:03:17.668865 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:03:17.668865 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:03:17.668865 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:03:17.668865 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:03:17.668865 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:03:17.668865 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:03:17.668865 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:03:17.668865 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:03:17.668865 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13b34014-9a03-4817-9119-05664e761f76 could not be found. Sep 08 12:03:17.668865 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 12:03:17.668865 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:03:17.675013 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 12:03:17.675013 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:03:17.675013 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:03:17.675013 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:03:17.675013 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:03:17.675013 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:03:17.675013 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13b34014-9a03-4817-9119-05664e761f76 could not be found. Sep 08 12:03:17.675013 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 12:03:17.675013 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c52f899b-d42d-473a-9a2e-dc189e2cd9ab tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Returning 404 to user: Instance 13b34014-9a03-4817-9119-05664e761f76 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:03:17.675013 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c52f899b-d42d-473a-9a2e-dc189e2cd9ab tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "GET /compute/v2.1/servers/13b34014-9a03-4817-9119-05664e761f76" status: 404 len: 111 microversion: 2.1 time: 0.032312 Sep 08 12:03:17.675013 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3910/7689] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:03:17 2022] GET /compute/v2.1/servers/13b34014-9a03-4817-9119-05664e761f76 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:03:20.686378 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-202a9504-a66e-4a8b-bb9f-ede79e4c17e8 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] Calling method '.version_select at 0x7f68df6803a0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:03:20.707639 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-202a9504-a66e-4a8b-bb9f-ede79e4c17e8 tempest-TestNetworkAdvancedServerOps-1687454490 tempest-TestNetworkAdvancedServerOps-1687454490-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-11869396" status: 202 len: 0 microversion: 2.1 time: 0.025203 Sep 08 12:03:20.713262 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3780/7690] 10.222.0.27 () {58 vars in 1278 bytes} [Thu Sep 8 12:03:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-11869396 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:03:32.183958 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=18 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:03:32.184800 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:03:32.362738 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-111d8281-06bb-4bca-b405-30954946d79d tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Action: 'create', calling method: .version_select at 0x7f68e4605e50>, body: {"keypair": {"name": "tempest-TestShelveInstance-1057966388", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3jg4oEkr1UQbAZYn/uC0+0jV7oljnPVdsYrCHwoDc7JfWbuqTNEwyxBFuGm19GCOvRNPIcfPnAKmU0M1eg5mvO1E6yZwRMm0dabRkj/aEJNKK7hPBNgyVIVCH7hYZR2A=="}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:03:32.378723 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-111d8281-06bb-4bca-b405-30954946d79d tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Getting quotas for project fa70812f059546fc945d0b8e5142785b. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:03:32.384436 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-111d8281-06bb-4bca-b405-30954946d79d tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Getting quotas for user e4e855b6c68941c695392bf233af695e and project fa70812f059546fc945d0b8e5142785b. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:03:32.411667 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-111d8281-06bb-4bca-b405-30954946d79d tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.233318 Sep 08 12:03:32.412264 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3911/7691] 10.222.0.27 () {60 vars in 1159 bytes} [Thu Sep 8 12:03:32 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:03:33.422298 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e3296a0a-9347-44ab-a3a7-dab012283952 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1285415812", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1057966388", "security_groups": [{"name": "tempest-secgroup-smoke-2011510961"}], "networks": [{"uuid": "bd8d9337-230b-464a-843c-a37518d63791"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:03:33.433970 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:03:33.434796 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:03:33.546092 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-e3296a0a-9347-44ab-a3a7-dab012283952 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] validate_networks() for [('bd8d9337-230b-464a-843c-a37518d63791', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:03:33.947924 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-e3296a0a-9347-44ab-a3a7-dab012283952 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:03:33.948440 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-e3296a0a-9347-44ab-a3a7-dab012283952 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:03:33.948936 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-e3296a0a-9347-44ab-a3a7-dab012283952 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:03:33.950031 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-e3296a0a-9347-44ab-a3a7-dab012283952 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:03:33.950474 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-e3296a0a-9347-44ab-a3a7-dab012283952 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:03:33.960694 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e3296a0a-9347-44ab-a3a7-dab012283952 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:03:33.961164 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e3296a0a-9347-44ab-a3a7-dab012283952 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:03:33.961617 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e3296a0a-9347-44ab-a3a7-dab012283952 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:03:33.962363 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e3296a0a-9347-44ab-a3a7-dab012283952 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:03:33.962833 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e3296a0a-9347-44ab-a3a7-dab012283952 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:03:33.963271 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e3296a0a-9347-44ab-a3a7-dab012283952 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:03:33.980370 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-e3296a0a-9347-44ab-a3a7-dab012283952 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Getting quotas for project fa70812f059546fc945d0b8e5142785b. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:03:33.985742 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-e3296a0a-9347-44ab-a3a7-dab012283952 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Getting quotas for user e4e855b6c68941c695392bf233af695e and project fa70812f059546fc945d0b8e5142785b. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:03:33.999260 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e3296a0a-9347-44ab-a3a7-dab012283952 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:03:34.001667 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e3296a0a-9347-44ab-a3a7-dab012283952 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:03:34.052422 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e3296a0a-9347-44ab-a3a7-dab012283952 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.633930 Sep 08 12:03:34.053001 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3781/7692] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 12:03:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 636 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 12:03:34.064379 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b83e80f2-129c-4684-bb18-a9d51643ec08 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:03:34.065002 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b83e80f2-129c-4684-bb18-a9d51643ec08 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:03:34.136885 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b83e80f2-129c-4684-bb18-a9d51643ec08 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:03:34.148471 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b83e80f2-129c-4684-bb18-a9d51643ec08 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11" status: 200 len: 1247 microversion: 2.1 time: 0.087915 Sep 08 12:03:34.149081 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3912/7693] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:03:34 2022] GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11 => generated 1247 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:03:35.172944 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9edbcd7a-8373-4be3-9c0c-b64b0dfe90e3 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:03:35.173659 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9edbcd7a-8373-4be3-9c0c-b64b0dfe90e3 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:03:35.184614 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9edbcd7a-8373-4be3-9c0c-b64b0dfe90e3 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:03:35.184854 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9edbcd7a-8373-4be3-9c0c-b64b0dfe90e3 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:03:35.185312 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9edbcd7a-8373-4be3-9c0c-b64b0dfe90e3 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:03:35.186092 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9edbcd7a-8373-4be3-9c0c-b64b0dfe90e3 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:03:35.186817 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9edbcd7a-8373-4be3-9c0c-b64b0dfe90e3 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:03:35.187520 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9edbcd7a-8373-4be3-9c0c-b64b0dfe90e3 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:03:35.262589 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9edbcd7a-8373-4be3-9c0c-b64b0dfe90e3 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:03:35.272312 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9edbcd7a-8373-4be3-9c0c-b64b0dfe90e3 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11" status: 200 len: 1299 microversion: 2.1 time: 0.104332 Sep 08 12:03:35.273411 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3782/7694] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:03:35 2022] GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11 => generated 1299 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:03:36.296060 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f863eb89-d62a-4cba-bb32-b846bf6d6350 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:03:36.296755 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f863eb89-d62a-4cba-bb32-b846bf6d6350 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:03:36.305834 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f863eb89-d62a-4cba-bb32-b846bf6d6350 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:03:36.306502 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f863eb89-d62a-4cba-bb32-b846bf6d6350 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:03:36.307131 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f863eb89-d62a-4cba-bb32-b846bf6d6350 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:03:36.307962 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f863eb89-d62a-4cba-bb32-b846bf6d6350 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:03:36.308657 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f863eb89-d62a-4cba-bb32-b846bf6d6350 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:03:36.309199 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f863eb89-d62a-4cba-bb32-b846bf6d6350 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:03:36.463076 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f863eb89-d62a-4cba-bb32-b846bf6d6350 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:03:36.472324 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f863eb89-d62a-4cba-bb32-b846bf6d6350 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11" status: 200 len: 1373 microversion: 2.1 time: 0.180171 Sep 08 12:03:36.473139 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3913/7695] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:03:36 2022] GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11 => generated 1373 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:03:36.927509 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-aa99663a-4b78-4e71-89f7-a09461256150 req-d74bacf7-623c-48a9-a7b3-5ad5700321fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11", "tag": "a6c86b57-ec69-4c2f-bda3-59de31ccf333"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:03:36.939004 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-aa99663a-4b78-4e71-89f7-a09461256150 req-d74bacf7-623c-48a9-a7b3-5ad5700321fc service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:03:36.939513 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-aa99663a-4b78-4e71-89f7-a09461256150 req-d74bacf7-623c-48a9-a7b3-5ad5700321fc service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:03:36.939963 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-aa99663a-4b78-4e71-89f7-a09461256150 req-d74bacf7-623c-48a9-a7b3-5ad5700321fc service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:03:36.956137 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-aa99663a-4b78-4e71-89f7-a09461256150 req-d74bacf7-623c-48a9-a7b3-5ad5700321fc service nova] Creating event network-changed:a6c86b57-ec69-4c2f-bda3-59de31ccf333 for instance ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11 on n-h1-850501-12 Sep 08 12:03:36.963663 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-aa99663a-4b78-4e71-89f7-a09461256150 req-d74bacf7-623c-48a9-a7b3-5ad5700321fc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039893 Sep 08 12:03:36.964206 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3783/7696] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 12:03:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:03:37.496424 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-589bc3c9-6ff0-4194-80d9-35f693005f2b tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:03:37.497077 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-589bc3c9-6ff0-4194-80d9-35f693005f2b tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:03:37.504001 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-589bc3c9-6ff0-4194-80d9-35f693005f2b tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:03:37.504498 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-589bc3c9-6ff0-4194-80d9-35f693005f2b tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:03:37.505762 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-589bc3c9-6ff0-4194-80d9-35f693005f2b tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:03:37.506526 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-589bc3c9-6ff0-4194-80d9-35f693005f2b tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:03:37.507048 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-589bc3c9-6ff0-4194-80d9-35f693005f2b tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:03:37.507492 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-589bc3c9-6ff0-4194-80d9-35f693005f2b tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:03:37.978232 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-589bc3c9-6ff0-4194-80d9-35f693005f2b tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:03:37.986922 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-589bc3c9-6ff0-4194-80d9-35f693005f2b tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11" status: 200 len: 1373 microversion: 2.1 time: 0.494443 Sep 08 12:03:37.987500 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3914/7697] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:03:37 2022] GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11 => generated 1373 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:03:39.011791 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9dc75d59-a0ec-49a3-8b47-299905e7f965 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:03:39.012638 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9dc75d59-a0ec-49a3-8b47-299905e7f965 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:03:39.019723 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9dc75d59-a0ec-49a3-8b47-299905e7f965 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:03:39.020799 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9dc75d59-a0ec-49a3-8b47-299905e7f965 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:03:39.021266 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9dc75d59-a0ec-49a3-8b47-299905e7f965 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:03:39.022005 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9dc75d59-a0ec-49a3-8b47-299905e7f965 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:03:39.022477 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9dc75d59-a0ec-49a3-8b47-299905e7f965 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:03:39.022919 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9dc75d59-a0ec-49a3-8b47-299905e7f965 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:03:39.158741 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9dc75d59-a0ec-49a3-8b47-299905e7f965 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:03:39.167306 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9dc75d59-a0ec-49a3-8b47-299905e7f965 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11" status: 200 len: 1373 microversion: 2.1 time: 0.160461 Sep 08 12:03:39.167967 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3784/7698] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:03:39 2022] GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11 => generated 1373 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:03:40.190616 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-109ed8ed-ab2a-46c2-87c8-fa03360144c7 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:03:40.191374 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-109ed8ed-ab2a-46c2-87c8-fa03360144c7 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:03:40.199573 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-109ed8ed-ab2a-46c2-87c8-fa03360144c7 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:03:40.200078 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-109ed8ed-ab2a-46c2-87c8-fa03360144c7 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:03:40.200518 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-109ed8ed-ab2a-46c2-87c8-fa03360144c7 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:03:40.201255 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-109ed8ed-ab2a-46c2-87c8-fa03360144c7 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:03:40.201721 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-109ed8ed-ab2a-46c2-87c8-fa03360144c7 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:03:40.202150 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-109ed8ed-ab2a-46c2-87c8-fa03360144c7 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:03:40.346592 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-109ed8ed-ab2a-46c2-87c8-fa03360144c7 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:03:40.354887 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-109ed8ed-ab2a-46c2-87c8-fa03360144c7 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11" status: 200 len: 1373 microversion: 2.1 time: 0.168184 Sep 08 12:03:40.355739 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3915/7699] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:03:40 2022] GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11 => generated 1373 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:03:41.378377 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0d59f5a1-da2c-4eda-b08b-6a2d124dd7c5 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:03:41.379000 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0d59f5a1-da2c-4eda-b08b-6a2d124dd7c5 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:03:41.386662 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d59f5a1-da2c-4eda-b08b-6a2d124dd7c5 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:03:41.387171 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d59f5a1-da2c-4eda-b08b-6a2d124dd7c5 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:03:41.387647 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d59f5a1-da2c-4eda-b08b-6a2d124dd7c5 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:03:41.388363 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d59f5a1-da2c-4eda-b08b-6a2d124dd7c5 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:03:41.388835 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d59f5a1-da2c-4eda-b08b-6a2d124dd7c5 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:03:41.389331 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d59f5a1-da2c-4eda-b08b-6a2d124dd7c5 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:03:41.522620 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0d59f5a1-da2c-4eda-b08b-6a2d124dd7c5 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:03:41.530350 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0d59f5a1-da2c-4eda-b08b-6a2d124dd7c5 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11" status: 200 len: 1373 microversion: 2.1 time: 0.155924 Sep 08 12:03:41.530911 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3785/7700] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:03:41 2022] GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11 => generated 1373 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:03:41.714760 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-d6500456-4d80-4669-8e92-285acc85c394 req-6bbdc991-2899-4acb-b9c1-e3ead9ee33b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11", "name": "network-vif-plugged", "status": "completed", "tag": "a6c86b57-ec69-4c2f-bda3-59de31ccf333"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:03:41.726675 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-d6500456-4d80-4669-8e92-285acc85c394 req-6bbdc991-2899-4acb-b9c1-e3ead9ee33b2 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:03:41.727167 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-d6500456-4d80-4669-8e92-285acc85c394 req-6bbdc991-2899-4acb-b9c1-e3ead9ee33b2 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:03:41.727599 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-d6500456-4d80-4669-8e92-285acc85c394 req-6bbdc991-2899-4acb-b9c1-e3ead9ee33b2 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:03:41.739315 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-d6500456-4d80-4669-8e92-285acc85c394 req-6bbdc991-2899-4acb-b9c1-e3ead9ee33b2 service nova] Creating event network-vif-plugged:a6c86b57-ec69-4c2f-bda3-59de31ccf333 for instance ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11 on n-h1-850501-12 Sep 08 12:03:41.744762 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-d6500456-4d80-4669-8e92-285acc85c394 req-6bbdc991-2899-4acb-b9c1-e3ead9ee33b2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033860 Sep 08 12:03:41.745623 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3916/7701] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 12:03:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:03:42.555555 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e595d29d-6326-4350-b26d-c54343a63514 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:03:42.556213 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e595d29d-6326-4350-b26d-c54343a63514 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:03:42.563157 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e595d29d-6326-4350-b26d-c54343a63514 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:03:42.563691 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e595d29d-6326-4350-b26d-c54343a63514 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:03:42.564140 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e595d29d-6326-4350-b26d-c54343a63514 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:03:42.564855 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e595d29d-6326-4350-b26d-c54343a63514 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:03:42.565358 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e595d29d-6326-4350-b26d-c54343a63514 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:03:42.565801 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e595d29d-6326-4350-b26d-c54343a63514 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:03:42.733130 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e595d29d-6326-4350-b26d-c54343a63514 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:03:42.741284 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e595d29d-6326-4350-b26d-c54343a63514 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11" status: 200 len: 1373 microversion: 2.1 time: 0.190820 Sep 08 12:03:42.741894 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3786/7702] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:03:42 2022] GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11 => generated 1373 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:03:43.765521 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cd9c7f2b-e2d1-4ce3-84cf-20179871df25 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:03:43.766231 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cd9c7f2b-e2d1-4ce3-84cf-20179871df25 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:03:43.773502 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cd9c7f2b-e2d1-4ce3-84cf-20179871df25 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:03:43.773984 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cd9c7f2b-e2d1-4ce3-84cf-20179871df25 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:03:43.774419 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cd9c7f2b-e2d1-4ce3-84cf-20179871df25 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:03:43.775110 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cd9c7f2b-e2d1-4ce3-84cf-20179871df25 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:03:43.775564 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cd9c7f2b-e2d1-4ce3-84cf-20179871df25 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:03:43.775994 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cd9c7f2b-e2d1-4ce3-84cf-20179871df25 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:03:43.916932 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-cd9c7f2b-e2d1-4ce3-84cf-20179871df25 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:03:43.924893 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cd9c7f2b-e2d1-4ce3-84cf-20179871df25 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11" status: 200 len: 1558 microversion: 2.1 time: 0.164727 Sep 08 12:03:43.925494 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3917/7703] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:03:43 2022] GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11 => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:03:43.951863 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6ff4aae8-53be-4ff0-a81f-c1e8d99691a1 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:03:43.952588 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6ff4aae8-53be-4ff0-a81f-c1e8d99691a1 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:03:43.960579 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ff4aae8-53be-4ff0-a81f-c1e8d99691a1 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:03:43.961218 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ff4aae8-53be-4ff0-a81f-c1e8d99691a1 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:03:43.961750 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ff4aae8-53be-4ff0-a81f-c1e8d99691a1 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:03:43.962507 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ff4aae8-53be-4ff0-a81f-c1e8d99691a1 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:03:43.962990 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ff4aae8-53be-4ff0-a81f-c1e8d99691a1 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:03:43.963442 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ff4aae8-53be-4ff0-a81f-c1e8d99691a1 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:03:43.980109 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:03:43.996464 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:03:44.103991 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6ff4aae8-53be-4ff0-a81f-c1e8d99691a1 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:03:44.112061 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6ff4aae8-53be-4ff0-a81f-c1e8d99691a1 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11" status: 200 len: 1558 microversion: 2.1 time: 0.164157 Sep 08 12:03:44.112645 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3787/7704] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:03:43 2022] GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11 => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:03:45.795930 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=6 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:03:45.854442 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-9bba7903-691e-4d22-9f0b-b09158ddc76f req-092aacd2-bcf9-4caa-bc95-7b017a05bbe9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11", "tag": "a6c86b57-ec69-4c2f-bda3-59de31ccf333"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:03:45.865477 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-9bba7903-691e-4d22-9f0b-b09158ddc76f req-092aacd2-bcf9-4caa-bc95-7b017a05bbe9 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:03:45.865981 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-9bba7903-691e-4d22-9f0b-b09158ddc76f req-092aacd2-bcf9-4caa-bc95-7b017a05bbe9 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:03:45.866422 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-9bba7903-691e-4d22-9f0b-b09158ddc76f req-092aacd2-bcf9-4caa-bc95-7b017a05bbe9 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:03:45.877550 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-9bba7903-691e-4d22-9f0b-b09158ddc76f req-092aacd2-bcf9-4caa-bc95-7b017a05bbe9 service nova] Creating event network-changed:a6c86b57-ec69-4c2f-bda3-59de31ccf333 for instance ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11 on n-h1-850501-12 Sep 08 12:03:45.883606 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-9bba7903-691e-4d22-9f0b-b09158ddc76f req-092aacd2-bcf9-4caa-bc95-7b017a05bbe9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092416 Sep 08 12:03:45.884460 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3918/7705] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 12:03:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:05:38.329515 n-d-850501-12 devstack@n-api.service[128862]: ERROR oslo.messaging._drivers.impl_rabbit [-] [081d0b47-1bf7-423f-b545-ebb7179d143a] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 08 12:05:38.331057 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:05:38.331912 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=34 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:05:38.336653 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e76e3cc1-dc57-42c4-a409-85fb32137585 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:05:38.337233 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e76e3cc1-dc57-42c4-a409-85fb32137585 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:05:38.345068 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e76e3cc1-dc57-42c4-a409-85fb32137585 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:05:38.345573 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e76e3cc1-dc57-42c4-a409-85fb32137585 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:05:38.346018 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e76e3cc1-dc57-42c4-a409-85fb32137585 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:05:38.346726 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e76e3cc1-dc57-42c4-a409-85fb32137585 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:05:38.347195 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e76e3cc1-dc57-42c4-a409-85fb32137585 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:05:38.347627 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e76e3cc1-dc57-42c4-a409-85fb32137585 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:05:38.371839 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-e76e3cc1-dc57-42c4-a409-85fb32137585 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lazy-loading 'flavor' on Instance uuid ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:05:38.562840 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e76e3cc1-dc57-42c4-a409-85fb32137585 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "POST /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11/action" status: 202 len: 0 microversion: 2.1 time: 0.235310 Sep 08 12:05:38.563631 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3788/7706] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 12:05:38 2022] POST /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11/action => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:05:38.571673 n-d-850501-12 devstack@n-api.service[128861]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8ef3926a-51be-4267-8b7c-50c9a352d2ae] AMQP server on 10.222.0.27:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 08 12:05:38.573144 n-d-850501-12 devstack@n-api.service[128861]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0785636a-6475-4dfc-a515-156caf1c5731] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 08 12:05:38.574382 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:05:38.574868 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=28 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:05:38.576010 n-d-850501-12 devstack@n-api.service[128861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 12:05:38.576153 n-d-850501-12 devstack@n-api.service[128861]: Thu Sep 8 12:05:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11 (ip 10.222.0.27) !!! Sep 08 12:05:38.581699 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7ae5f8e3-a682-486d-9813-e850fdc48894 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:05:38.582487 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7ae5f8e3-a682-486d-9813-e850fdc48894 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:05:38.593369 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7ae5f8e3-a682-486d-9813-e850fdc48894 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:05:38.593878 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7ae5f8e3-a682-486d-9813-e850fdc48894 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:05:38.594387 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7ae5f8e3-a682-486d-9813-e850fdc48894 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:05:38.602001 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7ae5f8e3-a682-486d-9813-e850fdc48894 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:05:38.602510 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7ae5f8e3-a682-486d-9813-e850fdc48894 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:05:38.602959 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7ae5f8e3-a682-486d-9813-e850fdc48894 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:05:38.760269 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7ae5f8e3-a682-486d-9813-e850fdc48894 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:05:38.768258 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7ae5f8e3-a682-486d-9813-e850fdc48894 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11" status: 200 len: 1683 microversion: 2.1 time: 0.199358 Sep 08 12:05:38.768916 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3919/7707] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:05:38 2022] GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11 => generated 1683 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:05:39.794735 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e0355d6e-2899-4d06-b00b-6777417b1fce tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:05:39.795449 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e0355d6e-2899-4d06-b00b-6777417b1fce tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:05:39.805269 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0355d6e-2899-4d06-b00b-6777417b1fce tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:05:39.805780 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0355d6e-2899-4d06-b00b-6777417b1fce tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:05:39.806258 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0355d6e-2899-4d06-b00b-6777417b1fce tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:05:39.806989 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0355d6e-2899-4d06-b00b-6777417b1fce tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:05:39.807459 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0355d6e-2899-4d06-b00b-6777417b1fce tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:05:39.807897 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0355d6e-2899-4d06-b00b-6777417b1fce tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:05:39.813694 n-d-850501-12 devstack@n-api.service[128862]: INFO oslo.messaging._drivers.impl_rabbit [-] [081d0b47-1bf7-423f-b545-ebb7179d143a] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 45332. Sep 08 12:05:39.954509 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e0355d6e-2899-4d06-b00b-6777417b1fce tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:05:39.962458 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e0355d6e-2899-4d06-b00b-6777417b1fce tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11" status: 200 len: 1683 microversion: 2.1 time: 0.174219 Sep 08 12:05:39.963055 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3789/7708] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:05:39 2022] GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11 => generated 1683 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:05:40.985762 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f611e688-ad4c-4489-bd6a-a32acd917cfc tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:05:40.986481 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f611e688-ad4c-4489-bd6a-a32acd917cfc tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:05:40.996387 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f611e688-ad4c-4489-bd6a-a32acd917cfc tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:05:40.996881 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f611e688-ad4c-4489-bd6a-a32acd917cfc tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:05:40.997347 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f611e688-ad4c-4489-bd6a-a32acd917cfc tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:05:40.998042 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f611e688-ad4c-4489-bd6a-a32acd917cfc tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:05:40.998503 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f611e688-ad4c-4489-bd6a-a32acd917cfc tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:05:40.998932 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f611e688-ad4c-4489-bd6a-a32acd917cfc tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:05:41.003577 n-d-850501-12 devstack@n-api.service[128861]: INFO oslo.messaging._drivers.impl_rabbit [-] [0785636a-6475-4dfc-a515-156caf1c5731] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 45338. Sep 08 12:05:41.007712 n-d-850501-12 devstack@n-api.service[128861]: INFO oslo.messaging._drivers.impl_rabbit [-] [8ef3926a-51be-4267-8b7c-50c9a352d2ae] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 45336. Sep 08 12:05:41.140055 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f611e688-ad4c-4489-bd6a-a32acd917cfc tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:05:41.148149 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f611e688-ad4c-4489-bd6a-a32acd917cfc tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11" status: 200 len: 1683 microversion: 2.1 time: 0.166295 Sep 08 12:05:41.148663 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3920/7709] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:05:40 2022] GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11 => generated 1683 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:05:42.172153 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-781255c1-ad5b-4f66-89a8-c70069b308cb tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:05:42.172803 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-781255c1-ad5b-4f66-89a8-c70069b308cb tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:05:42.180458 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-781255c1-ad5b-4f66-89a8-c70069b308cb tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:05:42.180966 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-781255c1-ad5b-4f66-89a8-c70069b308cb tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:05:42.181445 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-781255c1-ad5b-4f66-89a8-c70069b308cb tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:05:42.182162 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-781255c1-ad5b-4f66-89a8-c70069b308cb tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:05:42.182632 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-781255c1-ad5b-4f66-89a8-c70069b308cb tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:05:42.183072 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-781255c1-ad5b-4f66-89a8-c70069b308cb tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:05:42.319167 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-781255c1-ad5b-4f66-89a8-c70069b308cb tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:05:42.327153 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-781255c1-ad5b-4f66-89a8-c70069b308cb tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11" status: 200 len: 1683 microversion: 2.1 time: 0.159103 Sep 08 12:05:42.327733 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3790/7710] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:05:42 2022] GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11 => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:05:43.351130 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2c7671e4-f218-4965-b4c7-a2b104955acc tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:05:43.351746 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2c7671e4-f218-4965-b4c7-a2b104955acc tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:05:43.358701 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2c7671e4-f218-4965-b4c7-a2b104955acc tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:05:43.359196 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2c7671e4-f218-4965-b4c7-a2b104955acc tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:05:43.359638 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2c7671e4-f218-4965-b4c7-a2b104955acc tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:05:43.360341 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2c7671e4-f218-4965-b4c7-a2b104955acc tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:05:43.360802 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2c7671e4-f218-4965-b4c7-a2b104955acc tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:05:43.361262 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2c7671e4-f218-4965-b4c7-a2b104955acc tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:05:43.502874 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2c7671e4-f218-4965-b4c7-a2b104955acc tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:05:43.510989 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2c7671e4-f218-4965-b4c7-a2b104955acc tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11" status: 200 len: 1683 microversion: 2.1 time: 0.164582 Sep 08 12:05:43.511580 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3921/7711] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:05:43 2022] GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11 => generated 1683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:05:44.535031 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1ad0503c-a99d-407c-8d96-0b5c9c10e2b0 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:05:44.535651 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1ad0503c-a99d-407c-8d96-0b5c9c10e2b0 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:05:44.543679 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ad0503c-a99d-407c-8d96-0b5c9c10e2b0 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:05:44.544191 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ad0503c-a99d-407c-8d96-0b5c9c10e2b0 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:05:44.544669 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ad0503c-a99d-407c-8d96-0b5c9c10e2b0 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:05:44.545422 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ad0503c-a99d-407c-8d96-0b5c9c10e2b0 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:05:44.545898 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ad0503c-a99d-407c-8d96-0b5c9c10e2b0 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:05:44.546345 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ad0503c-a99d-407c-8d96-0b5c9c10e2b0 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:05:44.690450 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1ad0503c-a99d-407c-8d96-0b5c9c10e2b0 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:05:44.698615 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1ad0503c-a99d-407c-8d96-0b5c9c10e2b0 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11" status: 200 len: 1683 microversion: 2.1 time: 0.167497 Sep 08 12:05:44.699241 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3791/7712] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:05:44 2022] GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11 => generated 1683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:05:45.722136 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bdaaafba-8940-45d6-8e5d-91adf733699f tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:05:45.722751 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bdaaafba-8940-45d6-8e5d-91adf733699f tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:05:45.730469 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bdaaafba-8940-45d6-8e5d-91adf733699f tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:05:45.730973 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bdaaafba-8940-45d6-8e5d-91adf733699f tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:05:45.731442 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bdaaafba-8940-45d6-8e5d-91adf733699f tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:05:45.732140 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bdaaafba-8940-45d6-8e5d-91adf733699f tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:05:45.732612 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bdaaafba-8940-45d6-8e5d-91adf733699f tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:05:45.733106 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bdaaafba-8940-45d6-8e5d-91adf733699f tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:05:45.869524 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-bdaaafba-8940-45d6-8e5d-91adf733699f tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:05:45.877298 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bdaaafba-8940-45d6-8e5d-91adf733699f tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11" status: 200 len: 1683 microversion: 2.1 time: 0.159069 Sep 08 12:05:45.877882 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3922/7713] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:05:45 2022] GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11 => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:05:46.901040 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ad200d69-ec18-4910-851e-baba3719c08f tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:05:46.901680 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ad200d69-ec18-4910-851e-baba3719c08f tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:05:46.908558 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad200d69-ec18-4910-851e-baba3719c08f tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:05:46.909089 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad200d69-ec18-4910-851e-baba3719c08f tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:05:46.909544 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad200d69-ec18-4910-851e-baba3719c08f tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:05:46.910252 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad200d69-ec18-4910-851e-baba3719c08f tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:05:46.910731 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad200d69-ec18-4910-851e-baba3719c08f tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:05:46.912400 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad200d69-ec18-4910-851e-baba3719c08f tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:05:47.052690 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ad200d69-ec18-4910-851e-baba3719c08f tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:05:47.060650 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ad200d69-ec18-4910-851e-baba3719c08f tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11" status: 200 len: 1683 microversion: 2.1 time: 0.163584 Sep 08 12:05:47.061258 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3792/7714] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:05:46 2022] GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11 => generated 1683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:05:48.084234 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6e26cf1a-8ff7-4889-b847-91d09b6c03f2 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:05:48.084915 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6e26cf1a-8ff7-4889-b847-91d09b6c03f2 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:05:48.091629 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6e26cf1a-8ff7-4889-b847-91d09b6c03f2 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:05:48.092125 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6e26cf1a-8ff7-4889-b847-91d09b6c03f2 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:05:48.092568 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6e26cf1a-8ff7-4889-b847-91d09b6c03f2 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:05:48.093305 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6e26cf1a-8ff7-4889-b847-91d09b6c03f2 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:05:48.093773 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6e26cf1a-8ff7-4889-b847-91d09b6c03f2 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:05:48.094201 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6e26cf1a-8ff7-4889-b847-91d09b6c03f2 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:05:48.230406 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6e26cf1a-8ff7-4889-b847-91d09b6c03f2 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:05:48.240001 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6e26cf1a-8ff7-4889-b847-91d09b6c03f2 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11" status: 200 len: 1683 microversion: 2.1 time: 0.159502 Sep 08 12:05:48.240856 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3923/7715] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:05:48 2022] GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11 => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:05:49.263857 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-10b30b8e-5583-46ae-a154-8e4f230f6626 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:05:49.264481 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-10b30b8e-5583-46ae-a154-8e4f230f6626 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:05:49.271684 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10b30b8e-5583-46ae-a154-8e4f230f6626 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:05:49.271684 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10b30b8e-5583-46ae-a154-8e4f230f6626 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:05:49.272620 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10b30b8e-5583-46ae-a154-8e4f230f6626 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:05:49.273370 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10b30b8e-5583-46ae-a154-8e4f230f6626 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:05:49.273839 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10b30b8e-5583-46ae-a154-8e4f230f6626 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:05:49.274276 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10b30b8e-5583-46ae-a154-8e4f230f6626 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:05:49.410315 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-10b30b8e-5583-46ae-a154-8e4f230f6626 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:05:49.419593 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-10b30b8e-5583-46ae-a154-8e4f230f6626 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11" status: 200 len: 1704 microversion: 2.1 time: 0.159563 Sep 08 12:05:49.420188 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3793/7716] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:05:49 2022] GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11 => generated 1704 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:05:50.444089 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c53ac628-4d51-4c0a-8ab2-864bd195fd46 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:05:50.444838 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c53ac628-4d51-4c0a-8ab2-864bd195fd46 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:05:50.452022 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c53ac628-4d51-4c0a-8ab2-864bd195fd46 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:05:50.452767 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c53ac628-4d51-4c0a-8ab2-864bd195fd46 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:05:50.453251 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c53ac628-4d51-4c0a-8ab2-864bd195fd46 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:05:50.453979 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c53ac628-4d51-4c0a-8ab2-864bd195fd46 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:05:50.454449 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c53ac628-4d51-4c0a-8ab2-864bd195fd46 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:05:50.454891 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c53ac628-4d51-4c0a-8ab2-864bd195fd46 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:05:50.597102 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c53ac628-4d51-4c0a-8ab2-864bd195fd46 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:05:50.607137 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c53ac628-4d51-4c0a-8ab2-864bd195fd46 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11" status: 200 len: 1704 microversion: 2.1 time: 0.167174 Sep 08 12:05:50.607967 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3924/7717] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:05:50 2022] GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11 => generated 1704 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:05:51.632033 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b216f9c5-19c6-4907-8ece-04209e277872 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:05:51.632712 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b216f9c5-19c6-4907-8ece-04209e277872 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:05:51.639886 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b216f9c5-19c6-4907-8ece-04209e277872 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:05:51.640386 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b216f9c5-19c6-4907-8ece-04209e277872 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:05:51.640832 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b216f9c5-19c6-4907-8ece-04209e277872 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:05:51.641567 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b216f9c5-19c6-4907-8ece-04209e277872 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:05:51.642036 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b216f9c5-19c6-4907-8ece-04209e277872 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:05:51.642472 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b216f9c5-19c6-4907-8ece-04209e277872 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:05:52.099492 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b216f9c5-19c6-4907-8ece-04209e277872 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:05:52.107651 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b216f9c5-19c6-4907-8ece-04209e277872 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11" status: 200 len: 1704 microversion: 2.1 time: 0.479758 Sep 08 12:05:52.108221 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3794/7718] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:05:51 2022] GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11 => generated 1704 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:05:52.603852 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-a4b17ad2-027a-4f67-9ce8-918af9b015a2 req-e6f46d28-94e0-44a6-a792-095ef51fa843 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11", "name": "network-vif-plugged", "status": "completed", "tag": "a6c86b57-ec69-4c2f-bda3-59de31ccf333"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:05:52.618211 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-a4b17ad2-027a-4f67-9ce8-918af9b015a2 req-e6f46d28-94e0-44a6-a792-095ef51fa843 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:05:52.619026 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-a4b17ad2-027a-4f67-9ce8-918af9b015a2 req-e6f46d28-94e0-44a6-a792-095ef51fa843 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:05:52.619674 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-a4b17ad2-027a-4f67-9ce8-918af9b015a2 req-e6f46d28-94e0-44a6-a792-095ef51fa843 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:05:52.640698 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-a4b17ad2-027a-4f67-9ce8-918af9b015a2 req-e6f46d28-94e0-44a6-a792-095ef51fa843 service nova] Creating event network-vif-plugged:a6c86b57-ec69-4c2f-bda3-59de31ccf333 for instance ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11 on n-h1-850501-12 Sep 08 12:05:52.646563 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-a4b17ad2-027a-4f67-9ce8-918af9b015a2 req-e6f46d28-94e0-44a6-a792-095ef51fa843 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109133 Sep 08 12:05:52.647310 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3925/7719] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 12:05:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:05:53.131795 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-267409e9-f383-4305-9634-0735ec357e07 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:05:53.133058 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-267409e9-f383-4305-9634-0735ec357e07 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:05:53.144729 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-267409e9-f383-4305-9634-0735ec357e07 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:05:53.145884 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-267409e9-f383-4305-9634-0735ec357e07 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:05:53.147405 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-267409e9-f383-4305-9634-0735ec357e07 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:05:53.148407 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-267409e9-f383-4305-9634-0735ec357e07 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:05:53.149080 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-267409e9-f383-4305-9634-0735ec357e07 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:05:53.149714 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-267409e9-f383-4305-9634-0735ec357e07 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:05:53.325634 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-267409e9-f383-4305-9634-0735ec357e07 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:05:53.334584 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-267409e9-f383-4305-9634-0735ec357e07 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11" status: 200 len: 1699 microversion: 2.1 time: 0.207021 Sep 08 12:05:53.335222 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3795/7720] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:05:53 2022] GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11 => generated 1699 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:05:54.361386 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4072b5f2-34bc-49c6-a191-4dca8df85a77 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:05:54.362981 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4072b5f2-34bc-49c6-a191-4dca8df85a77 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:05:54.373642 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4072b5f2-34bc-49c6-a191-4dca8df85a77 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:05:54.374453 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4072b5f2-34bc-49c6-a191-4dca8df85a77 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:05:54.375258 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4072b5f2-34bc-49c6-a191-4dca8df85a77 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:05:54.376184 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4072b5f2-34bc-49c6-a191-4dca8df85a77 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:05:54.376651 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4072b5f2-34bc-49c6-a191-4dca8df85a77 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:05:54.377124 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4072b5f2-34bc-49c6-a191-4dca8df85a77 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:05:54.547730 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4072b5f2-34bc-49c6-a191-4dca8df85a77 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:05:54.557190 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4072b5f2-34bc-49c6-a191-4dca8df85a77 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11" status: 200 len: 1699 microversion: 2.1 time: 0.200890 Sep 08 12:05:54.558131 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3926/7721] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:05:54 2022] GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11 => generated 1699 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:05:55.580043 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-27fb80e7-5aa5-4df8-a60e-46c8629a01cf tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:05:55.580765 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-27fb80e7-5aa5-4df8-a60e-46c8629a01cf tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:05:55.588858 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27fb80e7-5aa5-4df8-a60e-46c8629a01cf tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:05:55.589404 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27fb80e7-5aa5-4df8-a60e-46c8629a01cf tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:05:55.589858 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27fb80e7-5aa5-4df8-a60e-46c8629a01cf tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:05:55.590627 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27fb80e7-5aa5-4df8-a60e-46c8629a01cf tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:05:55.591097 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27fb80e7-5aa5-4df8-a60e-46c8629a01cf tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:05:55.591537 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27fb80e7-5aa5-4df8-a60e-46c8629a01cf tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:05:55.768246 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-27fb80e7-5aa5-4df8-a60e-46c8629a01cf tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:05:55.776529 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-27fb80e7-5aa5-4df8-a60e-46c8629a01cf tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11" status: 200 len: 1699 microversion: 2.1 time: 0.200495 Sep 08 12:05:55.777133 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3796/7722] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:05:55 2022] GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11 => generated 1699 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:05:56.800690 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-50489f63-7f26-449a-be47-a12142283f94 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:05:56.805722 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-50489f63-7f26-449a-be47-a12142283f94 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:05:56.815562 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-50489f63-7f26-449a-be47-a12142283f94 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:05:56.816426 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-50489f63-7f26-449a-be47-a12142283f94 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:05:56.816880 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-50489f63-7f26-449a-be47-a12142283f94 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:05:56.818176 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-50489f63-7f26-449a-be47-a12142283f94 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:05:56.818646 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-50489f63-7f26-449a-be47-a12142283f94 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:05:56.819077 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-50489f63-7f26-449a-be47-a12142283f94 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:05:56.986056 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-50489f63-7f26-449a-be47-a12142283f94 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:05:56.995923 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-50489f63-7f26-449a-be47-a12142283f94 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11" status: 200 len: 1699 microversion: 2.1 time: 0.198912 Sep 08 12:05:56.996749 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3927/7723] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:05:56 2022] GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11 => generated 1699 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:05:58.021956 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-aa5007b1-a139-4698-8aeb-012059e1ee02 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:05:58.021956 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-aa5007b1-a139-4698-8aeb-012059e1ee02 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:05:58.029103 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa5007b1-a139-4698-8aeb-012059e1ee02 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:05:58.029649 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa5007b1-a139-4698-8aeb-012059e1ee02 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:05:58.030119 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa5007b1-a139-4698-8aeb-012059e1ee02 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:05:58.030905 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa5007b1-a139-4698-8aeb-012059e1ee02 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:05:58.031410 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa5007b1-a139-4698-8aeb-012059e1ee02 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:05:58.031970 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa5007b1-a139-4698-8aeb-012059e1ee02 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:05:58.189364 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-aa5007b1-a139-4698-8aeb-012059e1ee02 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:05:58.198615 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-aa5007b1-a139-4698-8aeb-012059e1ee02 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11" status: 200 len: 1699 microversion: 2.1 time: 0.182083 Sep 08 12:05:58.199445 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3797/7724] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:05:58 2022] GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11 => generated 1699 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:05:59.222942 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-09fd3d5b-87f6-49dd-8c87-e24e095a5bc0 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:05:59.225017 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-09fd3d5b-87f6-49dd-8c87-e24e095a5bc0 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:05:59.232504 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-09fd3d5b-87f6-49dd-8c87-e24e095a5bc0 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:05:59.233120 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-09fd3d5b-87f6-49dd-8c87-e24e095a5bc0 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:05:59.233839 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-09fd3d5b-87f6-49dd-8c87-e24e095a5bc0 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:05:59.234885 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-09fd3d5b-87f6-49dd-8c87-e24e095a5bc0 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:05:59.235650 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-09fd3d5b-87f6-49dd-8c87-e24e095a5bc0 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:05:59.236345 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-09fd3d5b-87f6-49dd-8c87-e24e095a5bc0 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:05:59.391141 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-09fd3d5b-87f6-49dd-8c87-e24e095a5bc0 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:05:59.404023 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-09fd3d5b-87f6-49dd-8c87-e24e095a5bc0 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11" status: 200 len: 1699 microversion: 2.1 time: 0.184916 Sep 08 12:05:59.404622 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3928/7725] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:05:59 2022] GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11 => generated 1699 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:06:00.428602 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8bbd4706-a2b9-4f29-8e5c-8740bc9847d4 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:06:00.429488 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8bbd4706-a2b9-4f29-8e5c-8740bc9847d4 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:06:00.436940 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8bbd4706-a2b9-4f29-8e5c-8740bc9847d4 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:06:00.437630 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8bbd4706-a2b9-4f29-8e5c-8740bc9847d4 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:06:00.438703 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8bbd4706-a2b9-4f29-8e5c-8740bc9847d4 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:06:00.439444 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8bbd4706-a2b9-4f29-8e5c-8740bc9847d4 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:06:00.439912 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8bbd4706-a2b9-4f29-8e5c-8740bc9847d4 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:06:00.440352 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8bbd4706-a2b9-4f29-8e5c-8740bc9847d4 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:06:00.613090 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8bbd4706-a2b9-4f29-8e5c-8740bc9847d4 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:06:00.622639 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8bbd4706-a2b9-4f29-8e5c-8740bc9847d4 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11" status: 200 len: 1699 microversion: 2.1 time: 0.198454 Sep 08 12:06:00.623423 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3798/7726] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:06:00 2022] GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11 => generated 1699 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:06:01.648437 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-dcff2665-43d9-49ec-8032-1125685b0a06 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:06:01.648990 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-dcff2665-43d9-49ec-8032-1125685b0a06 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:06:01.656173 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dcff2665-43d9-49ec-8032-1125685b0a06 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:06:01.656670 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dcff2665-43d9-49ec-8032-1125685b0a06 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:06:01.657157 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dcff2665-43d9-49ec-8032-1125685b0a06 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:06:01.657860 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dcff2665-43d9-49ec-8032-1125685b0a06 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:06:01.658317 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dcff2665-43d9-49ec-8032-1125685b0a06 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:06:01.658741 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dcff2665-43d9-49ec-8032-1125685b0a06 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:06:01.805764 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-dcff2665-43d9-49ec-8032-1125685b0a06 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:06:01.814081 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-dcff2665-43d9-49ec-8032-1125685b0a06 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11" status: 200 len: 1699 microversion: 2.1 time: 0.170725 Sep 08 12:06:01.814682 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3929/7727] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:06:01 2022] GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11 => generated 1699 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:06:02.838954 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6fad2d41-2e64-4fe4-b956-623a8338061c tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:06:02.839589 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6fad2d41-2e64-4fe4-b956-623a8338061c tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:06:02.846494 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6fad2d41-2e64-4fe4-b956-623a8338061c tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:06:02.847002 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6fad2d41-2e64-4fe4-b956-623a8338061c tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:06:02.847458 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6fad2d41-2e64-4fe4-b956-623a8338061c tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:06:02.848201 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6fad2d41-2e64-4fe4-b956-623a8338061c tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:06:02.848855 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6fad2d41-2e64-4fe4-b956-623a8338061c tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:06:02.849316 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6fad2d41-2e64-4fe4-b956-623a8338061c tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:06:03.090480 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6fad2d41-2e64-4fe4-b956-623a8338061c tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:06:03.098362 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6fad2d41-2e64-4fe4-b956-623a8338061c tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11" status: 200 len: 1681 microversion: 2.1 time: 0.263310 Sep 08 12:06:03.099021 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3799/7728] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:06:02 2022] GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11 => generated 1681 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:06:04.123527 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c958d264-aea6-4859-bb71-acb541ce4dcf tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:06:04.124150 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c958d264-aea6-4859-bb71-acb541ce4dcf tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:06:04.132265 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c958d264-aea6-4859-bb71-acb541ce4dcf tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:06:04.132762 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c958d264-aea6-4859-bb71-acb541ce4dcf tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:06:04.133274 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c958d264-aea6-4859-bb71-acb541ce4dcf tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:06:04.133998 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c958d264-aea6-4859-bb71-acb541ce4dcf tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:06:04.134468 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c958d264-aea6-4859-bb71-acb541ce4dcf tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:06:04.134903 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c958d264-aea6-4859-bb71-acb541ce4dcf tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:06:04.277285 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c958d264-aea6-4859-bb71-acb541ce4dcf tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:06:04.285242 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c958d264-aea6-4859-bb71-acb541ce4dcf tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11" status: 200 len: 1681 microversion: 2.1 time: 0.165653 Sep 08 12:06:04.286330 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3930/7729] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:06:04 2022] GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11 => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:06:05.308921 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-36d98552-93ab-4827-b7a0-7bcbab982e9f tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:06:05.309590 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-36d98552-93ab-4827-b7a0-7bcbab982e9f tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:06:05.317018 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36d98552-93ab-4827-b7a0-7bcbab982e9f tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:06:05.317914 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36d98552-93ab-4827-b7a0-7bcbab982e9f tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:06:05.318496 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36d98552-93ab-4827-b7a0-7bcbab982e9f tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:06:05.319236 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36d98552-93ab-4827-b7a0-7bcbab982e9f tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:06:05.319722 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36d98552-93ab-4827-b7a0-7bcbab982e9f tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:06:05.320173 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36d98552-93ab-4827-b7a0-7bcbab982e9f tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:06:05.464001 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-36d98552-93ab-4827-b7a0-7bcbab982e9f tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:06:05.471888 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-36d98552-93ab-4827-b7a0-7bcbab982e9f tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11" status: 200 len: 1624 microversion: 2.1 time: 0.166869 Sep 08 12:06:05.472469 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3800/7730] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:06:05 2022] GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11 => generated 1624 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:06:05.496172 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ccafe07f-648a-4bf9-87a3-121e0e4d9c26 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:06:05.496781 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ccafe07f-648a-4bf9-87a3-121e0e4d9c26 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:06:05.503770 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ccafe07f-648a-4bf9-87a3-121e0e4d9c26 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:06:05.504672 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ccafe07f-648a-4bf9-87a3-121e0e4d9c26 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:06:05.505599 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ccafe07f-648a-4bf9-87a3-121e0e4d9c26 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:06:05.506618 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ccafe07f-648a-4bf9-87a3-121e0e4d9c26 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:06:05.507306 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ccafe07f-648a-4bf9-87a3-121e0e4d9c26 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:06:05.507868 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ccafe07f-648a-4bf9-87a3-121e0e4d9c26 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:06:05.596628 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ccafe07f-648a-4bf9-87a3-121e0e4d9c26 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128861) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 08 12:06:05.666466 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ccafe07f-648a-4bf9-87a3-121e0e4d9c26 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "POST /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11/action" status: 202 len: 0 microversion: 2.1 time: 0.174528 Sep 08 12:06:05.667085 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3931/7731] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 12:06:05 2022] POST /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 12:06:05.675163 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b3a3a86b-14f1-46f4-9126-93581bb12316 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:06:05.675802 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b3a3a86b-14f1-46f4-9126-93581bb12316 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:06:05.682790 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3a3a86b-14f1-46f4-9126-93581bb12316 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:06:05.683417 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3a3a86b-14f1-46f4-9126-93581bb12316 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:06:05.683882 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3a3a86b-14f1-46f4-9126-93581bb12316 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:06:05.684606 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3a3a86b-14f1-46f4-9126-93581bb12316 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:06:05.685110 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3a3a86b-14f1-46f4-9126-93581bb12316 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:06:05.685560 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3a3a86b-14f1-46f4-9126-93581bb12316 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:06:05.822303 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b3a3a86b-14f1-46f4-9126-93581bb12316 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:06:05.831398 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b3a3a86b-14f1-46f4-9126-93581bb12316 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11" status: 200 len: 1632 microversion: 2.1 time: 0.160133 Sep 08 12:06:05.831971 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3801/7732] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:06:05 2022] GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11 => generated 1632 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:06:06.552719 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-cc08dfd8-945b-4604-aca9-0e2b46f66807 req-4e59a162-82c8-4ef6-b95e-4130a8db502b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11", "name": "network-vif-unplugged", "status": "completed", "tag": "a6c86b57-ec69-4c2f-bda3-59de31ccf333"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:06:06.567005 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-cc08dfd8-945b-4604-aca9-0e2b46f66807 req-4e59a162-82c8-4ef6-b95e-4130a8db502b service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:06:06.568450 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-cc08dfd8-945b-4604-aca9-0e2b46f66807 req-4e59a162-82c8-4ef6-b95e-4130a8db502b service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:06:06.569344 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-cc08dfd8-945b-4604-aca9-0e2b46f66807 req-4e59a162-82c8-4ef6-b95e-4130a8db502b service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:06:06.582033 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.compute.server_external_events [req-cc08dfd8-945b-4604-aca9-0e2b46f66807 req-4e59a162-82c8-4ef6-b95e-4130a8db502b service nova] Unable to find a host for instance ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11. Dropping event network-vif-unplugged {{(pid=128861) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 08 12:06:06.583220 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-cc08dfd8-945b-4604-aca9-0e2b46f66807 req-4e59a162-82c8-4ef6-b95e-4130a8db502b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.036105 Sep 08 12:06:06.584743 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3932/7733] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 12:06:06 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 38 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 08 12:06:06.856049 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b17bd6d1-1110-4de7-ba70-15998309e077 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:06:06.856689 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b17bd6d1-1110-4de7-ba70-15998309e077 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:06:06.864262 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b17bd6d1-1110-4de7-ba70-15998309e077 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:06:06.865738 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b17bd6d1-1110-4de7-ba70-15998309e077 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:06:06.865738 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b17bd6d1-1110-4de7-ba70-15998309e077 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:06:06.865738 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b17bd6d1-1110-4de7-ba70-15998309e077 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:06:06.866706 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b17bd6d1-1110-4de7-ba70-15998309e077 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:06:06.866955 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b17bd6d1-1110-4de7-ba70-15998309e077 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:06:06.885860 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:06:07.015124 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b17bd6d1-1110-4de7-ba70-15998309e077 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:06:07.024206 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b17bd6d1-1110-4de7-ba70-15998309e077 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11" status: 200 len: 1690 microversion: 2.1 time: 0.171993 Sep 08 12:06:07.024998 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3802/7734] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:06:06 2022] GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11 => generated 1690 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:06:08.049850 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d373b4aa-a743-4694-ad0c-a42c2c576ce6 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:06:08.051463 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d373b4aa-a743-4694-ad0c-a42c2c576ce6 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:06:08.064073 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d373b4aa-a743-4694-ad0c-a42c2c576ce6 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:06:08.065066 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d373b4aa-a743-4694-ad0c-a42c2c576ce6 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:06:08.066109 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d373b4aa-a743-4694-ad0c-a42c2c576ce6 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:06:08.068334 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d373b4aa-a743-4694-ad0c-a42c2c576ce6 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:06:08.069218 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d373b4aa-a743-4694-ad0c-a42c2c576ce6 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:06:08.070343 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d373b4aa-a743-4694-ad0c-a42c2c576ce6 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:06:08.241117 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d373b4aa-a743-4694-ad0c-a42c2c576ce6 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:06:08.251052 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d373b4aa-a743-4694-ad0c-a42c2c576ce6 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11" status: 200 len: 1690 microversion: 2.1 time: 0.206867 Sep 08 12:06:08.252168 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3933/7735] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:06:08 2022] GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11 => generated 1690 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:06:09.278073 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e50a89ad-6f4e-45ea-a797-152c36ed956d tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:06:09.279868 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e50a89ad-6f4e-45ea-a797-152c36ed956d tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:06:09.282907 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=31 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:06:09.291259 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e50a89ad-6f4e-45ea-a797-152c36ed956d tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:06:09.292142 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e50a89ad-6f4e-45ea-a797-152c36ed956d tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:06:09.292913 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e50a89ad-6f4e-45ea-a797-152c36ed956d tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:06:09.294012 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e50a89ad-6f4e-45ea-a797-152c36ed956d tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:06:09.294742 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e50a89ad-6f4e-45ea-a797-152c36ed956d tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:06:09.295432 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e50a89ad-6f4e-45ea-a797-152c36ed956d tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:06:09.445082 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e50a89ad-6f4e-45ea-a797-152c36ed956d tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:06:09.453606 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e50a89ad-6f4e-45ea-a797-152c36ed956d tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11" status: 200 len: 1690 microversion: 2.1 time: 0.179416 Sep 08 12:06:09.454481 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3803/7736] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:06:09 2022] GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11 => generated 1690 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:06:10.478633 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-54340bd6-cae2-4aa4-8eda-4c524b635a89 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:06:10.479937 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-54340bd6-cae2-4aa4-8eda-4c524b635a89 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:06:10.482956 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:06:10.488669 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-54340bd6-cae2-4aa4-8eda-4c524b635a89 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:06:10.489203 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-54340bd6-cae2-4aa4-8eda-4c524b635a89 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:06:10.490217 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-54340bd6-cae2-4aa4-8eda-4c524b635a89 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:06:10.490938 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-54340bd6-cae2-4aa4-8eda-4c524b635a89 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:06:10.491402 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-54340bd6-cae2-4aa4-8eda-4c524b635a89 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:06:10.492061 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-54340bd6-cae2-4aa4-8eda-4c524b635a89 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:06:10.495731 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:06:10.665019 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-54340bd6-cae2-4aa4-8eda-4c524b635a89 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:06:10.674253 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-54340bd6-cae2-4aa4-8eda-4c524b635a89 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11" status: 200 len: 1690 microversion: 2.1 time: 0.200068 Sep 08 12:06:10.674853 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3934/7737] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:06:10 2022] GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11 => generated 1690 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:06:11.700461 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bc33da25-86f7-4257-ba9d-ab4320d1a236 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:06:11.701115 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bc33da25-86f7-4257-ba9d-ab4320d1a236 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:06:11.708136 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bc33da25-86f7-4257-ba9d-ab4320d1a236 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:06:11.709299 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bc33da25-86f7-4257-ba9d-ab4320d1a236 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:06:11.709840 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bc33da25-86f7-4257-ba9d-ab4320d1a236 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:06:11.710479 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bc33da25-86f7-4257-ba9d-ab4320d1a236 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:06:11.710944 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bc33da25-86f7-4257-ba9d-ab4320d1a236 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:06:11.711382 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bc33da25-86f7-4257-ba9d-ab4320d1a236 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:06:11.870752 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bc33da25-86f7-4257-ba9d-ab4320d1a236 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:06:11.878715 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bc33da25-86f7-4257-ba9d-ab4320d1a236 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11" status: 200 len: 1690 microversion: 2.1 time: 0.182836 Sep 08 12:06:11.879285 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3804/7738] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:06:11 2022] GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11 => generated 1690 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:06:12.904051 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-971aab74-cc5e-4d51-aaa1-5c22194f11c0 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:06:12.904742 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-971aab74-cc5e-4d51-aaa1-5c22194f11c0 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:06:12.911411 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-971aab74-cc5e-4d51-aaa1-5c22194f11c0 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:06:12.911898 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-971aab74-cc5e-4d51-aaa1-5c22194f11c0 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:06:12.912351 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-971aab74-cc5e-4d51-aaa1-5c22194f11c0 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:06:12.913275 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-971aab74-cc5e-4d51-aaa1-5c22194f11c0 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:06:12.913743 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-971aab74-cc5e-4d51-aaa1-5c22194f11c0 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:06:12.914180 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-971aab74-cc5e-4d51-aaa1-5c22194f11c0 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:06:13.087975 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-971aab74-cc5e-4d51-aaa1-5c22194f11c0 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:06:13.096597 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-971aab74-cc5e-4d51-aaa1-5c22194f11c0 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11" status: 200 len: 1690 microversion: 2.1 time: 0.196927 Sep 08 12:06:13.097236 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3935/7739] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:06:12 2022] GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11 => generated 1690 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:06:14.121213 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-03d025c7-36e5-4932-86c8-2261041f9f6b tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:06:14.121854 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-03d025c7-36e5-4932-86c8-2261041f9f6b tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:06:14.133516 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03d025c7-36e5-4932-86c8-2261041f9f6b tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:06:14.134412 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03d025c7-36e5-4932-86c8-2261041f9f6b tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:06:14.135211 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03d025c7-36e5-4932-86c8-2261041f9f6b tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:06:14.136464 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03d025c7-36e5-4932-86c8-2261041f9f6b tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:06:14.137304 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03d025c7-36e5-4932-86c8-2261041f9f6b tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:06:14.138027 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03d025c7-36e5-4932-86c8-2261041f9f6b tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:06:14.291154 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-03d025c7-36e5-4932-86c8-2261041f9f6b tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:06:14.299446 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-03d025c7-36e5-4932-86c8-2261041f9f6b tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11" status: 200 len: 1690 microversion: 2.1 time: 0.182082 Sep 08 12:06:14.300147 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3805/7740] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:06:14 2022] GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11 => generated 1690 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:06:15.328248 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-69f3f6a7-8988-4fa2-afe2-f5c26d6446a5 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:06:15.329201 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-69f3f6a7-8988-4fa2-afe2-f5c26d6446a5 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:06:15.338049 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-69f3f6a7-8988-4fa2-afe2-f5c26d6446a5 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:06:15.338331 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-69f3f6a7-8988-4fa2-afe2-f5c26d6446a5 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:06:15.339959 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-69f3f6a7-8988-4fa2-afe2-f5c26d6446a5 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:06:15.339959 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-69f3f6a7-8988-4fa2-afe2-f5c26d6446a5 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:06:15.340338 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-69f3f6a7-8988-4fa2-afe2-f5c26d6446a5 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:06:15.340908 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-69f3f6a7-8988-4fa2-afe2-f5c26d6446a5 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:06:15.486498 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-69f3f6a7-8988-4fa2-afe2-f5c26d6446a5 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:06:15.495335 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-69f3f6a7-8988-4fa2-afe2-f5c26d6446a5 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11" status: 200 len: 1690 microversion: 2.1 time: 0.171668 Sep 08 12:06:15.496158 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3936/7741] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:06:15 2022] GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11 => generated 1690 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:06:16.522473 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bab081d3-dbd9-4c9c-84c2-5e699b6358bf tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:06:16.523025 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bab081d3-dbd9-4c9c-84c2-5e699b6358bf tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:06:16.530134 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bab081d3-dbd9-4c9c-84c2-5e699b6358bf tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:06:16.530650 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bab081d3-dbd9-4c9c-84c2-5e699b6358bf tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:06:16.531108 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bab081d3-dbd9-4c9c-84c2-5e699b6358bf tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:06:16.531831 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bab081d3-dbd9-4c9c-84c2-5e699b6358bf tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:06:16.532310 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bab081d3-dbd9-4c9c-84c2-5e699b6358bf tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:06:16.532788 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bab081d3-dbd9-4c9c-84c2-5e699b6358bf tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:06:16.671190 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bab081d3-dbd9-4c9c-84c2-5e699b6358bf tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:06:16.680972 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bab081d3-dbd9-4c9c-84c2-5e699b6358bf tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11" status: 200 len: 1690 microversion: 2.1 time: 0.162501 Sep 08 12:06:16.681586 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3806/7742] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:06:16 2022] GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11 => generated 1690 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:06:17.705387 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0d773a5f-18af-49df-a144-a63b400a6e70 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:06:17.706130 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0d773a5f-18af-49df-a144-a63b400a6e70 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:06:17.714869 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d773a5f-18af-49df-a144-a63b400a6e70 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:06:17.715487 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d773a5f-18af-49df-a144-a63b400a6e70 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:06:17.716006 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d773a5f-18af-49df-a144-a63b400a6e70 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:06:17.716861 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d773a5f-18af-49df-a144-a63b400a6e70 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:06:17.717379 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d773a5f-18af-49df-a144-a63b400a6e70 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:06:17.717832 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d773a5f-18af-49df-a144-a63b400a6e70 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:06:17.864562 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0d773a5f-18af-49df-a144-a63b400a6e70 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:06:17.872811 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0d773a5f-18af-49df-a144-a63b400a6e70 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11" status: 200 len: 1690 microversion: 2.1 time: 0.171365 Sep 08 12:06:17.873430 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3937/7743] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:06:17 2022] GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11 => generated 1690 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:06:18.898738 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-895759ae-68de-4991-9227-0b12f5a265f5 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:06:18.899372 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-895759ae-68de-4991-9227-0b12f5a265f5 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:06:18.906396 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-895759ae-68de-4991-9227-0b12f5a265f5 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:06:18.906897 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-895759ae-68de-4991-9227-0b12f5a265f5 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:06:18.907348 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-895759ae-68de-4991-9227-0b12f5a265f5 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:06:18.908064 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-895759ae-68de-4991-9227-0b12f5a265f5 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:06:18.908531 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-895759ae-68de-4991-9227-0b12f5a265f5 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:06:18.909004 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-895759ae-68de-4991-9227-0b12f5a265f5 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:06:19.049333 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-895759ae-68de-4991-9227-0b12f5a265f5 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:06:19.057974 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-895759ae-68de-4991-9227-0b12f5a265f5 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11" status: 200 len: 1690 microversion: 2.1 time: 0.164052 Sep 08 12:06:19.058560 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3807/7744] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:06:18 2022] GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11 => generated 1690 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:06:20.082610 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ce906204-563a-4c64-a10d-543d34074f76 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:06:20.083432 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ce906204-563a-4c64-a10d-543d34074f76 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:06:20.093865 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ce906204-563a-4c64-a10d-543d34074f76 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:06:20.094411 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ce906204-563a-4c64-a10d-543d34074f76 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:06:20.095089 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ce906204-563a-4c64-a10d-543d34074f76 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:06:20.095812 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ce906204-563a-4c64-a10d-543d34074f76 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:06:20.096278 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ce906204-563a-4c64-a10d-543d34074f76 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:06:20.096713 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ce906204-563a-4c64-a10d-543d34074f76 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:06:20.229537 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-ce906204-563a-4c64-a10d-543d34074f76 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:06:20.237609 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ce906204-563a-4c64-a10d-543d34074f76 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11" status: 200 len: 1690 microversion: 2.1 time: 0.159114 Sep 08 12:06:20.238187 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3938/7745] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:06:20 2022] GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11 => generated 1690 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:06:20.647961 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-d592660a-4d85-4483-bbd4-c0d61a7366f3 req-4380203a-6474-461d-9e2a-5b993dbc1d3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11", "name": "network-vif-plugged", "status": "completed", "tag": "a6c86b57-ec69-4c2f-bda3-59de31ccf333"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:06:20.659209 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d592660a-4d85-4483-bbd4-c0d61a7366f3 req-4380203a-6474-461d-9e2a-5b993dbc1d3e service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:06:20.659996 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d592660a-4d85-4483-bbd4-c0d61a7366f3 req-4380203a-6474-461d-9e2a-5b993dbc1d3e service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:06:20.660525 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d592660a-4d85-4483-bbd4-c0d61a7366f3 req-4380203a-6474-461d-9e2a-5b993dbc1d3e service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:06:20.674961 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-d592660a-4d85-4483-bbd4-c0d61a7366f3 req-4380203a-6474-461d-9e2a-5b993dbc1d3e service nova] Creating event network-vif-plugged:a6c86b57-ec69-4c2f-bda3-59de31ccf333 for instance ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11 on n-h1-850501-12 Sep 08 12:06:20.681509 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-d592660a-4d85-4483-bbd4-c0d61a7366f3 req-4380203a-6474-461d-9e2a-5b993dbc1d3e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038092 Sep 08 12:06:20.682553 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3808/7746] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 12:06:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:06:21.262879 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1772222b-cb59-45e6-b819-b6b5d133bce9 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:06:21.263513 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1772222b-cb59-45e6-b819-b6b5d133bce9 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:06:21.271072 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1772222b-cb59-45e6-b819-b6b5d133bce9 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:06:21.271761 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1772222b-cb59-45e6-b819-b6b5d133bce9 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:06:21.272219 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1772222b-cb59-45e6-b819-b6b5d133bce9 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:06:21.272934 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1772222b-cb59-45e6-b819-b6b5d133bce9 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:06:21.273438 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1772222b-cb59-45e6-b819-b6b5d133bce9 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:06:21.273877 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1772222b-cb59-45e6-b819-b6b5d133bce9 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:06:21.414842 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1772222b-cb59-45e6-b819-b6b5d133bce9 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:06:21.422762 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1772222b-cb59-45e6-b819-b6b5d133bce9 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11" status: 200 len: 1690 microversion: 2.1 time: 0.164276 Sep 08 12:06:21.423372 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3939/7747] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:06:21 2022] GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11 => generated 1690 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:06:22.448058 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c85a37bd-0bd6-4578-ae05-a3e54e919952 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:06:22.448770 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c85a37bd-0bd6-4578-ae05-a3e54e919952 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:06:22.455735 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c85a37bd-0bd6-4578-ae05-a3e54e919952 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:06:22.456231 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c85a37bd-0bd6-4578-ae05-a3e54e919952 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:06:22.456680 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c85a37bd-0bd6-4578-ae05-a3e54e919952 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:06:22.457421 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c85a37bd-0bd6-4578-ae05-a3e54e919952 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:06:22.458638 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c85a37bd-0bd6-4578-ae05-a3e54e919952 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:06:22.459358 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c85a37bd-0bd6-4578-ae05-a3e54e919952 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:06:22.609395 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c85a37bd-0bd6-4578-ae05-a3e54e919952 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:06:22.618292 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c85a37bd-0bd6-4578-ae05-a3e54e919952 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11" status: 200 len: 1690 microversion: 2.1 time: 0.175512 Sep 08 12:06:22.618875 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3809/7748] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:06:22 2022] GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11 => generated 1690 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:06:23.641293 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d1f465b9-c2c6-47d9-8b50-7a560447acbf tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:06:23.641919 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d1f465b9-c2c6-47d9-8b50-7a560447acbf tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:06:23.649938 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d1f465b9-c2c6-47d9-8b50-7a560447acbf tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:06:23.650438 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d1f465b9-c2c6-47d9-8b50-7a560447acbf tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:06:23.650884 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d1f465b9-c2c6-47d9-8b50-7a560447acbf tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:06:23.651590 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d1f465b9-c2c6-47d9-8b50-7a560447acbf tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:06:23.652055 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d1f465b9-c2c6-47d9-8b50-7a560447acbf tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:06:23.652518 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d1f465b9-c2c6-47d9-8b50-7a560447acbf tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:06:23.785798 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d1f465b9-c2c6-47d9-8b50-7a560447acbf tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:06:23.793661 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d1f465b9-c2c6-47d9-8b50-7a560447acbf tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11" status: 200 len: 1677 microversion: 2.1 time: 0.156440 Sep 08 12:06:23.794236 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3940/7749] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:06:23 2022] GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:07:40.656872 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=13 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:07:40.658323 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=40 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:07:40.660013 n-d-850501-12 devstack@n-api.service[128862]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 12:07:40.660451 n-d-850501-12 devstack@n-api.service[128862]: Thu Sep 8 12:07:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11 (ip 10.222.0.27) !!! Sep 08 12:07:40.661267 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=13 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:07:40.662330 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=41 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:07:40.663319 n-d-850501-12 devstack@n-api.service[128862]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 12:07:40.663454 n-d-850501-12 devstack@n-api.service[128862]: Thu Sep 8 12:07:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11 (ip 10.222.0.27) !!! Sep 08 12:07:40.668971 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-707d263a-57d4-4a93-a89b-573b6d76a0a0 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:07:40.669643 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-707d263a-57d4-4a93-a89b-573b6d76a0a0 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:07:40.690701 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-707d263a-57d4-4a93-a89b-573b6d76a0a0 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:07:40.691570 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-707d263a-57d4-4a93-a89b-573b6d76a0a0 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:07:40.692229 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-707d263a-57d4-4a93-a89b-573b6d76a0a0 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:07:40.693198 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-707d263a-57d4-4a93-a89b-573b6d76a0a0 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:07:40.693867 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-707d263a-57d4-4a93-a89b-573b6d76a0a0 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:07:40.694528 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-707d263a-57d4-4a93-a89b-573b6d76a0a0 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:07:40.733466 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-707d263a-57d4-4a93-a89b-573b6d76a0a0 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:07:40.767654 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-ed2628b7-310b-483c-8324-9a25dd2e3846 req-7409295f-2f19-4a9c-8c57-9f240332c6d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11", "tag": "a6c86b57-ec69-4c2f-bda3-59de31ccf333"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:07:40.778415 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-ed2628b7-310b-483c-8324-9a25dd2e3846 req-7409295f-2f19-4a9c-8c57-9f240332c6d4 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:07:40.779121 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-ed2628b7-310b-483c-8324-9a25dd2e3846 req-7409295f-2f19-4a9c-8c57-9f240332c6d4 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:07:40.779566 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-ed2628b7-310b-483c-8324-9a25dd2e3846 req-7409295f-2f19-4a9c-8c57-9f240332c6d4 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:07:40.792436 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-ed2628b7-310b-483c-8324-9a25dd2e3846 req-7409295f-2f19-4a9c-8c57-9f240332c6d4 service nova] Creating event network-changed:a6c86b57-ec69-4c2f-bda3-59de31ccf333 for instance ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11 on n-h1-850501-12 Sep 08 12:07:40.797920 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-ed2628b7-310b-483c-8324-9a25dd2e3846 req-7409295f-2f19-4a9c-8c57-9f240332c6d4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138374 Sep 08 12:07:40.799261 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3941/7750] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 12:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 12:07:40.832100 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-707d263a-57d4-4a93-a89b-573b6d76a0a0 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11" status: 204 len: 0 microversion: 2.1 time: 0.176872 Sep 08 12:07:40.833359 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3810/7751] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 12:07:40 2022] DELETE /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:07:40.842858 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2d80a63c-5d62-4fc1-acb4-d255b7bbc936 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:07:40.843575 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2d80a63c-5d62-4fc1-acb4-d255b7bbc936 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:07:40.850310 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2d80a63c-5d62-4fc1-acb4-d255b7bbc936 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:07:40.850804 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2d80a63c-5d62-4fc1-acb4-d255b7bbc936 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:07:40.851247 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2d80a63c-5d62-4fc1-acb4-d255b7bbc936 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:07:40.852167 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2d80a63c-5d62-4fc1-acb4-d255b7bbc936 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:07:40.853161 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2d80a63c-5d62-4fc1-acb4-d255b7bbc936 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:07:40.853594 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2d80a63c-5d62-4fc1-acb4-d255b7bbc936 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:07:41.070889 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2d80a63c-5d62-4fc1-acb4-d255b7bbc936 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:07:41.086800 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2d80a63c-5d62-4fc1-acb4-d255b7bbc936 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11" status: 200 len: 1683 microversion: 2.1 time: 0.247653 Sep 08 12:07:41.087750 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3942/7752] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:07:40 2022] GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11 => generated 1683 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:07:42.111919 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-752cf521-ec78-4824-bce5-1ecbcb0e9894 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:07:42.112909 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-752cf521-ec78-4824-bce5-1ecbcb0e9894 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:07:42.121093 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-752cf521-ec78-4824-bce5-1ecbcb0e9894 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:07:42.121611 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-752cf521-ec78-4824-bce5-1ecbcb0e9894 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:07:42.122059 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-752cf521-ec78-4824-bce5-1ecbcb0e9894 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:07:42.122782 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-752cf521-ec78-4824-bce5-1ecbcb0e9894 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:07:42.123276 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-752cf521-ec78-4824-bce5-1ecbcb0e9894 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:07:42.123710 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-752cf521-ec78-4824-bce5-1ecbcb0e9894 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:07:42.379333 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-752cf521-ec78-4824-bce5-1ecbcb0e9894 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:07:42.387545 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-752cf521-ec78-4824-bce5-1ecbcb0e9894 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11" status: 200 len: 1683 microversion: 2.1 time: 0.280012 Sep 08 12:07:42.388151 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3811/7753] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:07:42 2022] GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11 => generated 1683 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:07:42.867109 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-0602369f-9fa3-44be-b647-b6a4d8578490 req-0ddf260f-104b-41ff-ba76-77dd74e52a1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11", "name": "network-vif-deleted", "tag": "a6c86b57-ec69-4c2f-bda3-59de31ccf333"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:07:42.879502 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-0602369f-9fa3-44be-b647-b6a4d8578490 req-0ddf260f-104b-41ff-ba76-77dd74e52a1d service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:07:42.879999 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-0602369f-9fa3-44be-b647-b6a4d8578490 req-0ddf260f-104b-41ff-ba76-77dd74e52a1d service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:07:42.880475 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-0602369f-9fa3-44be-b647-b6a4d8578490 req-0ddf260f-104b-41ff-ba76-77dd74e52a1d service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:07:42.895907 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-0602369f-9fa3-44be-b647-b6a4d8578490 req-0ddf260f-104b-41ff-ba76-77dd74e52a1d service nova] Creating event network-vif-deleted:a6c86b57-ec69-4c2f-bda3-59de31ccf333 for instance ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11 on n-h1-850501-12 Sep 08 12:07:42.902249 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-0602369f-9fa3-44be-b647-b6a4d8578490 req-0ddf260f-104b-41ff-ba76-77dd74e52a1d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039162 Sep 08 12:07:42.902983 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3943/7754] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 12:07:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:07:43.414633 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-af269bb5-250c-461e-9175-88c0e19353ea tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:07:43.415218 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-af269bb5-250c-461e-9175-88c0e19353ea tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:07:43.425724 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af269bb5-250c-461e-9175-88c0e19353ea tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:07:43.426419 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af269bb5-250c-461e-9175-88c0e19353ea tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:07:43.426913 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af269bb5-250c-461e-9175-88c0e19353ea tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:07:43.427781 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af269bb5-250c-461e-9175-88c0e19353ea tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:07:43.428396 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af269bb5-250c-461e-9175-88c0e19353ea tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:07:43.428915 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af269bb5-250c-461e-9175-88c0e19353ea tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:07:43.444355 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-af269bb5-250c-461e-9175-88c0e19353ea tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] HTTP exception thrown: Instance ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11 could not be found. Sep 08 12:07:43.446254 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-af269bb5-250c-461e-9175-88c0e19353ea tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Request method failure captured: Sep 08 12:07:43.446254 n-d-850501-12 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11 HTTP/1.1 Sep 08 12:07:43.446254 n-d-850501-12 devstack@n-api.service[128862]: Accept: application/json Sep 08 12:07:43.446254 n-d-850501-12 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 08 12:07:43.446254 n-d-850501-12 devstack@n-api.service[128862]: Connection: close Sep 08 12:07:43.446254 n-d-850501-12 devstack@n-api.service[128862]: Content-Length: 0 Sep 08 12:07:43.446254 n-d-850501-12 devstack@n-api.service[128862]: Content-Type: application/json Sep 08 12:07:43.446254 n-d-850501-12 devstack@n-api.service[128862]: Host: 10.222.0.27 Sep 08 12:07:43.446254 n-d-850501-12 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 08 12:07:43.446254 n-d-850501-12 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 08 12:07:43.446254 n-d-850501-12 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjGdoO4kIo9UVj7mtt0EPHhw49b8A7qwdQMp38-j8zRh-2wvoqNvS9dV-36WJc9rHSGXFIfhD6h5i3TfzwKO64blwHvvgfNU3mr4G6da8Gy4HuHfdSjBV0l-wGxFfpPlGMQJ-K6qKyvGoQcxkpuMuIR_Ay7hHHa_VJZhb6CTFwV_UUXnk Sep 08 12:07:43.446254 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Id: None Sep 08 12:07:43.446254 n-d-850501-12 devstack@n-api.service[128862]: X-Domain-Name: None Sep 08 12:07:43.446254 n-d-850501-12 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 08 12:07:43.446254 n-d-850501-12 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 08 12:07:43.446254 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 08 12:07:43.446254 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 08 12:07:43.446254 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Id: fa70812f059546fc945d0b8e5142785b Sep 08 12:07:43.446254 n-d-850501-12 devstack@n-api.service[128862]: X-Project-Name: tempest-TestShelveInstance-24544356 Sep 08 12:07:43.446254 n-d-850501-12 devstack@n-api.service[128862]: X-Role: reader,member Sep 08 12:07:43.446254 n-d-850501-12 devstack@n-api.service[128862]: X-Roles: reader,member Sep 08 12:07:43.446254 n-d-850501-12 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fa70812f059546fc945d0b8e5142785b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fa70812f059546fc945d0b8e5142785b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fa70812f059546fc945d0b8e5142785b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fa70812f059546fc945d0b8e5142785b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 12:07:43.446254 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant: tempest-TestShelveInstance-24544356 Sep 08 12:07:43.446254 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Id: fa70812f059546fc945d0b8e5142785b Sep 08 12:07:43.446254 n-d-850501-12 devstack@n-api.service[128862]: X-Tenant-Name: tempest-TestShelveInstance-24544356 Sep 08 12:07:43.446254 n-d-850501-12 devstack@n-api.service[128862]: X-User: tempest-TestShelveInstance-24544356-project Sep 08 12:07:43.446254 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 08 12:07:43.446254 n-d-850501-12 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 08 12:07:43.446254 n-d-850501-12 devstack@n-api.service[128862]: X-User-Id: e4e855b6c68941c695392bf233af695e Sep 08 12:07:43.446254 n-d-850501-12 devstack@n-api.service[128862]: X-User-Name: tempest-TestShelveInstance-24544356-project Sep 08 12:07:43.446254 n-d-850501-12 devstack@n-api.service[128862]: method: > Sep 08 12:07:43.446254 n-d-850501-12 devstack@n-api.service[128862]: exception: Instance ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11 could not be found. Sep 08 12:07:43.446254 n-d-850501-12 devstack@n-api.service[128862]: action_args: {'id': 'ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11'} Sep 08 12:07:43.446254 n-d-850501-12 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:07:43.446254 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:07:43.446254 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:07:43.446254 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:07:43.446254 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:07:43.446254 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:07:43.446254 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:07:43.446254 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:07:43.446254 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:07:43.446254 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:07:43.446254 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11 could not be found. Sep 08 12:07:43.446254 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 12:07:43.446254 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:07:43.446254 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 12:07:43.446254 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:07:43.446254 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:07:43.446254 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:07:43.446254 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:07:43.446254 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:07:43.446254 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:07:43.446254 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:07:43.446254 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:07:43.446254 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:07:43.446254 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:07:43.446254 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:07:43.446254 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:07:43.446254 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:07:43.446254 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11 could not be found. Sep 08 12:07:43.446254 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 12:07:43.446254 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:07:43.446254 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 12:07:43.452866 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:07:43.452866 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:07:43.452866 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:07:43.452866 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:07:43.452866 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:07:43.452866 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11 could not be found. Sep 08 12:07:43.452866 n-d-850501-12 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 08 12:07:43.452866 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-af269bb5-250c-461e-9175-88c0e19353ea tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Returning 404 to user: Instance ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:07:43.452866 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-af269bb5-250c-461e-9175-88c0e19353ea tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11" status: 404 len: 111 microversion: 2.1 time: 0.038579 Sep 08 12:07:43.452866 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3812/7755] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:07:43 2022] GET /compute/v2.1/servers/ab3aba97-7eb8-4f6f-8063-d6fd3fd68b11 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:07:43.615793 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-57fb69dd-59f0-48ca-8aec-2099c383b61a tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '.version_select at 0x7f68e45338b0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:07:43.639262 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-57fb69dd-59f0-48ca-8aec-2099c383b61a tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1057966388" status: 202 len: 0 microversion: 2.1 time: 0.028177 Sep 08 12:07:43.639948 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3944/7756] 10.222.0.27 () {58 vars in 1254 bytes} [Thu Sep 8 12:07:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1057966388 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:07:43.663060 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-45cc6812-6a16-46ac-b0f2-c0a6b345cd6c tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Action: 'create', calling method: .version_select at 0x7f68e8b30430>, body: {"keypair": {"name": "tempest-TestShelveInstance-1114159399", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFMnPmcbb5p/oJh0iOTKsRgvr7QdilV494dVy71kbdY8Oqm+HDfWiZuyxJp+qzumplLqRXRSWlyNNNY/Jl5W/I3sAF2UGoDczn5k0Eclv22aq/9knatXlDxkWDVCvigPyQ=="}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:07:43.680861 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-45cc6812-6a16-46ac-b0f2-c0a6b345cd6c tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Getting quotas for project fa70812f059546fc945d0b8e5142785b. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:07:43.686204 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-45cc6812-6a16-46ac-b0f2-c0a6b345cd6c tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Getting quotas for user e4e855b6c68941c695392bf233af695e and project fa70812f059546fc945d0b8e5142785b. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:07:43.716037 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-45cc6812-6a16-46ac-b0f2-c0a6b345cd6c tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.056971 Sep 08 12:07:43.716679 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3813/7757] 10.222.0.27 () {60 vars in 1159 bytes} [Thu Sep 8 12:07:43 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:08:01.100793 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=10 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:08:01.102425 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:08:01.106693 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fb32cfad-d3c7-4cd8-92dc-d45004092e56 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-63560968", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1114159399", "security_groups": [{"name": "tempest-secgroup-smoke-14820512"}], "networks": [{"uuid": "bd8d9337-230b-464a-843c-a37518d63791"}], "block_device_mapping_v2": [{"uuid": "35038197-47d0-49da-a24e-8b0a45a19579", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:08:01.222954 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-fb32cfad-d3c7-4cd8-92dc-d45004092e56 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] validate_networks() for [('bd8d9337-230b-464a-843c-a37518d63791', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:08:01.603430 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-fb32cfad-d3c7-4cd8-92dc-d45004092e56 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:08:01.603864 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-fb32cfad-d3c7-4cd8-92dc-d45004092e56 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:08:01.604468 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-fb32cfad-d3c7-4cd8-92dc-d45004092e56 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:08:01.604884 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-fb32cfad-d3c7-4cd8-92dc-d45004092e56 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:08:01.605351 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-fb32cfad-d3c7-4cd8-92dc-d45004092e56 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:08:01.614545 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb32cfad-d3c7-4cd8-92dc-d45004092e56 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:08:01.615034 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb32cfad-d3c7-4cd8-92dc-d45004092e56 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:08:01.615474 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb32cfad-d3c7-4cd8-92dc-d45004092e56 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:08:01.616205 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb32cfad-d3c7-4cd8-92dc-d45004092e56 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:08:01.616908 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb32cfad-d3c7-4cd8-92dc-d45004092e56 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:08:01.617482 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb32cfad-d3c7-4cd8-92dc-d45004092e56 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:08:01.635130 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-fb32cfad-d3c7-4cd8-92dc-d45004092e56 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Getting quotas for project fa70812f059546fc945d0b8e5142785b. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:08:01.640378 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-fb32cfad-d3c7-4cd8-92dc-d45004092e56 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Getting quotas for user e4e855b6c68941c695392bf233af695e and project fa70812f059546fc945d0b8e5142785b. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:08:01.698179 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fb32cfad-d3c7-4cd8-92dc-d45004092e56 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:08:01.700800 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fb32cfad-d3c7-4cd8-92dc-d45004092e56 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='35038197-47d0-49da-a24e-8b0a45a19579',volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:08:01.830212 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fb32cfad-d3c7-4cd8-92dc-d45004092e56 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.731381 Sep 08 12:08:01.831062 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3945/7758] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 12:08:01 2022] POST /compute/v2.1/servers => generated 404 bytes in 733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 12:08:01.842715 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8349fe5e-dfdf-4cd8-aa15-d837f33325f3 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:08:01.843370 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8349fe5e-dfdf-4cd8-aa15-d837f33325f3 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:08:01.848832 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:08:01.849638 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=4 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:08:01.850341 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:08:01.914745 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8349fe5e-dfdf-4cd8-aa15-d837f33325f3 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:08:01.922344 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8349fe5e-dfdf-4cd8-aa15-d837f33325f3 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b" status: 200 len: 1087 microversion: 2.1 time: 0.083782 Sep 08 12:08:01.923416 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3814/7759] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:08:01 2022] GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b => generated 1087 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:08:02.947680 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f7129bcb-58ea-44e3-8154-7fd0e8cbaa14 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:08:02.948330 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f7129bcb-58ea-44e3-8154-7fd0e8cbaa14 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:08:02.956187 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f7129bcb-58ea-44e3-8154-7fd0e8cbaa14 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:08:02.956906 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f7129bcb-58ea-44e3-8154-7fd0e8cbaa14 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:08:02.957392 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f7129bcb-58ea-44e3-8154-7fd0e8cbaa14 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:08:02.958107 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f7129bcb-58ea-44e3-8154-7fd0e8cbaa14 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:08:02.958572 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f7129bcb-58ea-44e3-8154-7fd0e8cbaa14 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:08:02.959319 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f7129bcb-58ea-44e3-8154-7fd0e8cbaa14 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:08:03.045282 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f7129bcb-58ea-44e3-8154-7fd0e8cbaa14 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:08:03.054062 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f7129bcb-58ea-44e3-8154-7fd0e8cbaa14 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b" status: 200 len: 1203 microversion: 2.1 time: 0.111207 Sep 08 12:08:03.054710 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3946/7760] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:08:02 2022] GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b => generated 1203 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:08:04.077946 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f20a5963-e4c7-404e-8511-8fcdeeeed86d tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:08:04.078800 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f20a5963-e4c7-404e-8511-8fcdeeeed86d tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:08:04.086765 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f20a5963-e4c7-404e-8511-8fcdeeeed86d tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:08:04.087265 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f20a5963-e4c7-404e-8511-8fcdeeeed86d tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:08:04.087714 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f20a5963-e4c7-404e-8511-8fcdeeeed86d tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:08:04.088445 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f20a5963-e4c7-404e-8511-8fcdeeeed86d tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:08:04.088947 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f20a5963-e4c7-404e-8511-8fcdeeeed86d tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:08:04.089408 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f20a5963-e4c7-404e-8511-8fcdeeeed86d tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:08:04.228759 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f20a5963-e4c7-404e-8511-8fcdeeeed86d tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:08:04.238075 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f20a5963-e4c7-404e-8511-8fcdeeeed86d tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b" status: 200 len: 1269 microversion: 2.1 time: 0.164034 Sep 08 12:08:04.238944 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3815/7761] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:08:04 2022] GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b => generated 1269 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:08:04.630224 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-6dbce484-1dc0-4ad1-b07d-36f4728a5b3a req-fe24982f-460b-46c8-9023-0d2e0c22da91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b", "tag": "5125ac5d-9be1-440a-8d36-720220b29e72"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:08:04.643827 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-6dbce484-1dc0-4ad1-b07d-36f4728a5b3a req-fe24982f-460b-46c8-9023-0d2e0c22da91 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:08:04.654214 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-6dbce484-1dc0-4ad1-b07d-36f4728a5b3a req-fe24982f-460b-46c8-9023-0d2e0c22da91 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:08:04.656991 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-6dbce484-1dc0-4ad1-b07d-36f4728a5b3a req-fe24982f-460b-46c8-9023-0d2e0c22da91 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:08:04.670140 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-6dbce484-1dc0-4ad1-b07d-36f4728a5b3a req-fe24982f-460b-46c8-9023-0d2e0c22da91 service nova] Creating event network-changed:5125ac5d-9be1-440a-8d36-720220b29e72 for instance b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b on n-h1-850501-12 Sep 08 12:08:04.675696 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-6dbce484-1dc0-4ad1-b07d-36f4728a5b3a req-fe24982f-460b-46c8-9023-0d2e0c22da91 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050035 Sep 08 12:08:04.676481 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3947/7762] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 12:08:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:08:05.262161 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bedb4c58-389c-407e-8add-5e9525e5bcca tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:08:05.263842 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bedb4c58-389c-407e-8add-5e9525e5bcca tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:08:05.273053 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bedb4c58-389c-407e-8add-5e9525e5bcca tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:08:05.274228 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bedb4c58-389c-407e-8add-5e9525e5bcca tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:08:05.274870 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bedb4c58-389c-407e-8add-5e9525e5bcca tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:08:05.275813 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bedb4c58-389c-407e-8add-5e9525e5bcca tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:08:05.276464 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bedb4c58-389c-407e-8add-5e9525e5bcca tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:08:05.277124 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bedb4c58-389c-407e-8add-5e9525e5bcca tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:08:05.427906 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bedb4c58-389c-407e-8add-5e9525e5bcca tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:08:05.436287 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bedb4c58-389c-407e-8add-5e9525e5bcca tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b" status: 200 len: 1269 microversion: 2.1 time: 0.178162 Sep 08 12:08:05.436869 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3816/7763] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:08:05 2022] GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b => generated 1269 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:08:06.461970 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6b497b90-813e-4cbc-a17e-2d53a68bba02 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:08:06.462676 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6b497b90-813e-4cbc-a17e-2d53a68bba02 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:08:06.469057 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6b497b90-813e-4cbc-a17e-2d53a68bba02 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:08:06.469549 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6b497b90-813e-4cbc-a17e-2d53a68bba02 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:08:06.469980 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6b497b90-813e-4cbc-a17e-2d53a68bba02 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:08:06.470680 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6b497b90-813e-4cbc-a17e-2d53a68bba02 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:08:06.471139 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6b497b90-813e-4cbc-a17e-2d53a68bba02 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:08:06.471564 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6b497b90-813e-4cbc-a17e-2d53a68bba02 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:08:06.609052 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6b497b90-813e-4cbc-a17e-2d53a68bba02 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:08:06.617610 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6b497b90-813e-4cbc-a17e-2d53a68bba02 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b" status: 200 len: 1269 microversion: 2.1 time: 0.161413 Sep 08 12:08:06.618202 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3948/7764] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:08:06 2022] GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b => generated 1269 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:08:07.640226 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-456263a0-0344-4d03-b9f3-268372241a90 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:08:07.640857 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-456263a0-0344-4d03-b9f3-268372241a90 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:08:07.648559 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-456263a0-0344-4d03-b9f3-268372241a90 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:08:07.649083 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-456263a0-0344-4d03-b9f3-268372241a90 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:08:07.649540 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-456263a0-0344-4d03-b9f3-268372241a90 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:08:07.650263 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-456263a0-0344-4d03-b9f3-268372241a90 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:08:07.650737 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-456263a0-0344-4d03-b9f3-268372241a90 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:08:07.651171 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-456263a0-0344-4d03-b9f3-268372241a90 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:08:07.799003 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-456263a0-0344-4d03-b9f3-268372241a90 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:08:07.807288 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-456263a0-0344-4d03-b9f3-268372241a90 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b" status: 200 len: 1269 microversion: 2.1 time: 0.170954 Sep 08 12:08:07.807919 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3817/7765] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:08:07 2022] GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b => generated 1269 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:08:08.831228 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-096f797b-7dd6-4720-a5f5-c8b68114a6ce tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:08:08.831785 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-096f797b-7dd6-4720-a5f5-c8b68114a6ce tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:08:08.839483 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-096f797b-7dd6-4720-a5f5-c8b68114a6ce tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:08:08.839969 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-096f797b-7dd6-4720-a5f5-c8b68114a6ce tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:08:08.840404 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-096f797b-7dd6-4720-a5f5-c8b68114a6ce tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:08:08.841130 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-096f797b-7dd6-4720-a5f5-c8b68114a6ce tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:08:08.841590 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-096f797b-7dd6-4720-a5f5-c8b68114a6ce tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:08:08.842014 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-096f797b-7dd6-4720-a5f5-c8b68114a6ce tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:08:08.983258 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-096f797b-7dd6-4720-a5f5-c8b68114a6ce tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:08:08.991495 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-096f797b-7dd6-4720-a5f5-c8b68114a6ce tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b" status: 200 len: 1257 microversion: 2.1 time: 0.164668 Sep 08 12:08:08.992065 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3949/7766] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:08:08 2022] GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b => generated 1257 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:08:10.014781 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e274c9e1-2e80-4ada-ae88-e9e8d0235a31 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:08:10.015406 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e274c9e1-2e80-4ada-ae88-e9e8d0235a31 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:08:10.022050 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e274c9e1-2e80-4ada-ae88-e9e8d0235a31 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:08:10.022547 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e274c9e1-2e80-4ada-ae88-e9e8d0235a31 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:08:10.022994 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e274c9e1-2e80-4ada-ae88-e9e8d0235a31 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:08:10.023690 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e274c9e1-2e80-4ada-ae88-e9e8d0235a31 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:08:10.024664 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e274c9e1-2e80-4ada-ae88-e9e8d0235a31 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:08:10.025127 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e274c9e1-2e80-4ada-ae88-e9e8d0235a31 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:08:10.161454 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e274c9e1-2e80-4ada-ae88-e9e8d0235a31 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:08:10.169853 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e274c9e1-2e80-4ada-ae88-e9e8d0235a31 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b" status: 200 len: 1257 microversion: 2.1 time: 0.159110 Sep 08 12:08:10.170443 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3818/7767] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:08:10 2022] GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b => generated 1257 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:08:11.192428 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9e286b6d-1afa-412c-8ff0-8b699a7c7f6c tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:08:11.193062 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9e286b6d-1afa-412c-8ff0-8b699a7c7f6c tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:08:11.199490 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e286b6d-1afa-412c-8ff0-8b699a7c7f6c tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:08:11.199986 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e286b6d-1afa-412c-8ff0-8b699a7c7f6c tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:08:11.200428 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e286b6d-1afa-412c-8ff0-8b699a7c7f6c tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:08:11.201148 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e286b6d-1afa-412c-8ff0-8b699a7c7f6c tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:08:11.201613 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e286b6d-1afa-412c-8ff0-8b699a7c7f6c tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:08:11.202043 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e286b6d-1afa-412c-8ff0-8b699a7c7f6c tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:08:11.335654 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9e286b6d-1afa-412c-8ff0-8b699a7c7f6c tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:08:11.343794 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9e286b6d-1afa-412c-8ff0-8b699a7c7f6c tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b" status: 200 len: 1257 microversion: 2.1 time: 0.155382 Sep 08 12:08:11.344387 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3950/7768] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:08:11 2022] GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b => generated 1257 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:08:12.367511 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-179f9e0b-aa0b-4f9b-954a-b2df2dda43ca tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:08:12.369081 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-179f9e0b-aa0b-4f9b-954a-b2df2dda43ca tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:08:12.371849 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:08:12.377440 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-179f9e0b-aa0b-4f9b-954a-b2df2dda43ca tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:08:12.377950 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-179f9e0b-aa0b-4f9b-954a-b2df2dda43ca tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:08:12.378406 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-179f9e0b-aa0b-4f9b-954a-b2df2dda43ca tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:08:12.379148 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-179f9e0b-aa0b-4f9b-954a-b2df2dda43ca tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:08:12.379622 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-179f9e0b-aa0b-4f9b-954a-b2df2dda43ca tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:08:12.380064 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-179f9e0b-aa0b-4f9b-954a-b2df2dda43ca tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:08:12.511799 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-179f9e0b-aa0b-4f9b-954a-b2df2dda43ca tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:08:12.519746 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-179f9e0b-aa0b-4f9b-954a-b2df2dda43ca tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b" status: 200 len: 1257 microversion: 2.1 time: 0.156220 Sep 08 12:08:12.520329 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3819/7769] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:08:12 2022] GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b => generated 1257 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:08:13.543133 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-427358c2-c596-4ee9-a6c1-52f5003f55a9 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:08:13.543793 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-427358c2-c596-4ee9-a6c1-52f5003f55a9 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:08:13.546179 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:08:13.546870 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=6 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:08:13.554464 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-427358c2-c596-4ee9-a6c1-52f5003f55a9 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:08:13.555278 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-427358c2-c596-4ee9-a6c1-52f5003f55a9 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:08:13.555990 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-427358c2-c596-4ee9-a6c1-52f5003f55a9 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:08:13.556713 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-427358c2-c596-4ee9-a6c1-52f5003f55a9 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:08:13.557207 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-427358c2-c596-4ee9-a6c1-52f5003f55a9 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:08:13.557643 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-427358c2-c596-4ee9-a6c1-52f5003f55a9 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:08:13.713690 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-427358c2-c596-4ee9-a6c1-52f5003f55a9 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:08:13.721861 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-427358c2-c596-4ee9-a6c1-52f5003f55a9 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b" status: 200 len: 1257 microversion: 2.1 time: 0.182845 Sep 08 12:08:13.722444 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3951/7770] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:08:13 2022] GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b => generated 1257 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:08:14.744125 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fbce70b7-acfa-4fda-bd69-76becf11458e tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:08:14.744749 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fbce70b7-acfa-4fda-bd69-76becf11458e tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:08:14.751613 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fbce70b7-acfa-4fda-bd69-76becf11458e tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:08:14.752110 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fbce70b7-acfa-4fda-bd69-76becf11458e tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:08:14.752557 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fbce70b7-acfa-4fda-bd69-76becf11458e tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:08:14.753284 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fbce70b7-acfa-4fda-bd69-76becf11458e tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:08:14.753751 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fbce70b7-acfa-4fda-bd69-76becf11458e tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:08:14.754184 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fbce70b7-acfa-4fda-bd69-76becf11458e tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:08:14.886126 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fbce70b7-acfa-4fda-bd69-76becf11458e tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:08:14.894188 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fbce70b7-acfa-4fda-bd69-76becf11458e tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b" status: 200 len: 1257 microversion: 2.1 time: 0.154129 Sep 08 12:08:14.894771 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3820/7771] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:08:14 2022] GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b => generated 1257 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:08:15.918083 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7636cf9a-e563-4e23-89ef-58df7e59a2b7 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:08:15.918700 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7636cf9a-e563-4e23-89ef-58df7e59a2b7 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:08:15.925742 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7636cf9a-e563-4e23-89ef-58df7e59a2b7 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:08:15.926236 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7636cf9a-e563-4e23-89ef-58df7e59a2b7 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:08:15.926675 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7636cf9a-e563-4e23-89ef-58df7e59a2b7 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:08:15.927380 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7636cf9a-e563-4e23-89ef-58df7e59a2b7 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:08:15.927842 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7636cf9a-e563-4e23-89ef-58df7e59a2b7 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:08:15.928273 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7636cf9a-e563-4e23-89ef-58df7e59a2b7 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:08:16.061980 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7636cf9a-e563-4e23-89ef-58df7e59a2b7 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:08:16.070044 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7636cf9a-e563-4e23-89ef-58df7e59a2b7 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b" status: 200 len: 1257 microversion: 2.1 time: 0.156707 Sep 08 12:08:16.070628 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3952/7772] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:08:15 2022] GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b => generated 1257 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:08:17.092426 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-542cd72d-80cb-4350-acfb-23513bd5e7e7 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:08:17.093065 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-542cd72d-80cb-4350-acfb-23513bd5e7e7 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:08:17.100901 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-542cd72d-80cb-4350-acfb-23513bd5e7e7 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:08:17.101424 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-542cd72d-80cb-4350-acfb-23513bd5e7e7 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:08:17.102374 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-542cd72d-80cb-4350-acfb-23513bd5e7e7 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:08:17.103160 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-542cd72d-80cb-4350-acfb-23513bd5e7e7 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:08:17.103626 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-542cd72d-80cb-4350-acfb-23513bd5e7e7 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:08:17.104315 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-542cd72d-80cb-4350-acfb-23513bd5e7e7 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:08:17.244697 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-542cd72d-80cb-4350-acfb-23513bd5e7e7 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:08:17.253151 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-542cd72d-80cb-4350-acfb-23513bd5e7e7 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b" status: 200 len: 1257 microversion: 2.1 time: 0.164569 Sep 08 12:08:17.253748 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3821/7773] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:08:17 2022] GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b => generated 1257 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:08:18.275952 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b08df9ac-17af-4cc4-8052-e0417365306c tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:08:18.276550 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b08df9ac-17af-4cc4-8052-e0417365306c tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:08:18.283553 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b08df9ac-17af-4cc4-8052-e0417365306c tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:08:18.284023 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b08df9ac-17af-4cc4-8052-e0417365306c tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:08:18.284458 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b08df9ac-17af-4cc4-8052-e0417365306c tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:08:18.285187 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b08df9ac-17af-4cc4-8052-e0417365306c tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:08:18.285643 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b08df9ac-17af-4cc4-8052-e0417365306c tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:08:18.286071 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b08df9ac-17af-4cc4-8052-e0417365306c tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:08:18.418587 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-b08df9ac-17af-4cc4-8052-e0417365306c tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:08:18.426402 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b08df9ac-17af-4cc4-8052-e0417365306c tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b" status: 200 len: 1257 microversion: 2.1 time: 0.154558 Sep 08 12:08:18.426983 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3953/7774] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:08:18 2022] GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b => generated 1257 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:08:19.347248 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-ab1891f2-6dee-47c1-acdf-851383628a76 req-2f95a733-a060-4b87-b81f-d32efc4eada5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b", "name": "network-vif-plugged", "status": "completed", "tag": "5125ac5d-9be1-440a-8d36-720220b29e72"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:08:19.358243 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ab1891f2-6dee-47c1-acdf-851383628a76 req-2f95a733-a060-4b87-b81f-d32efc4eada5 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:08:19.358982 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ab1891f2-6dee-47c1-acdf-851383628a76 req-2f95a733-a060-4b87-b81f-d32efc4eada5 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:08:19.359449 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ab1891f2-6dee-47c1-acdf-851383628a76 req-2f95a733-a060-4b87-b81f-d32efc4eada5 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:08:19.371844 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-ab1891f2-6dee-47c1-acdf-851383628a76 req-2f95a733-a060-4b87-b81f-d32efc4eada5 service nova] Creating event network-vif-plugged:5125ac5d-9be1-440a-8d36-720220b29e72 for instance b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b on n-h1-850501-12 Sep 08 12:08:19.376974 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-ab1891f2-6dee-47c1-acdf-851383628a76 req-2f95a733-a060-4b87-b81f-d32efc4eada5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033574 Sep 08 12:08:19.378039 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3822/7775] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 12:08:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:08:19.449837 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2c0f9913-077b-4732-9586-f5a54c2f38b1 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:08:19.450543 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2c0f9913-077b-4732-9586-f5a54c2f38b1 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:08:19.457634 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2c0f9913-077b-4732-9586-f5a54c2f38b1 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:08:19.458132 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2c0f9913-077b-4732-9586-f5a54c2f38b1 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:08:19.458572 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2c0f9913-077b-4732-9586-f5a54c2f38b1 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:08:19.459290 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2c0f9913-077b-4732-9586-f5a54c2f38b1 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:08:19.459742 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2c0f9913-077b-4732-9586-f5a54c2f38b1 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:08:19.460226 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2c0f9913-077b-4732-9586-f5a54c2f38b1 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:08:19.622216 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-2c0f9913-077b-4732-9586-f5a54c2f38b1 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:08:19.630326 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2c0f9913-077b-4732-9586-f5a54c2f38b1 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b" status: 200 len: 1257 microversion: 2.1 time: 0.185244 Sep 08 12:08:19.630907 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3954/7776] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:08:19 2022] GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b => generated 1257 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:08:20.654177 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d11aaf15-8465-48dc-b19e-0c9bbe03b542 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:08:20.654910 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d11aaf15-8465-48dc-b19e-0c9bbe03b542 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:08:20.661990 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d11aaf15-8465-48dc-b19e-0c9bbe03b542 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:08:20.662499 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d11aaf15-8465-48dc-b19e-0c9bbe03b542 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:08:20.662953 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d11aaf15-8465-48dc-b19e-0c9bbe03b542 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:08:20.663686 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d11aaf15-8465-48dc-b19e-0c9bbe03b542 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:08:20.664162 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d11aaf15-8465-48dc-b19e-0c9bbe03b542 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:08:20.664632 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d11aaf15-8465-48dc-b19e-0c9bbe03b542 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:08:20.808346 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d11aaf15-8465-48dc-b19e-0c9bbe03b542 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:08:20.816404 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d11aaf15-8465-48dc-b19e-0c9bbe03b542 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b" status: 200 len: 1441 microversion: 2.1 time: 0.167453 Sep 08 12:08:20.816981 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3823/7777] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:08:20 2022] GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b => generated 1441 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:08:20.839630 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6a6060ad-4446-442e-9bd2-c0907634a8d0 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:08:20.840247 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6a6060ad-4446-442e-9bd2-c0907634a8d0 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:08:20.847064 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6a6060ad-4446-442e-9bd2-c0907634a8d0 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:08:20.847551 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6a6060ad-4446-442e-9bd2-c0907634a8d0 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:08:20.847987 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6a6060ad-4446-442e-9bd2-c0907634a8d0 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:08:20.848679 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6a6060ad-4446-442e-9bd2-c0907634a8d0 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:08:20.849172 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6a6060ad-4446-442e-9bd2-c0907634a8d0 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:08:20.849599 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6a6060ad-4446-442e-9bd2-c0907634a8d0 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:08:20.985363 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6a6060ad-4446-442e-9bd2-c0907634a8d0 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:08:20.994333 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6a6060ad-4446-442e-9bd2-c0907634a8d0 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b" status: 200 len: 1441 microversion: 2.1 time: 0.158470 Sep 08 12:08:20.995084 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3955/7778] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:08:20 2022] GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b => generated 1441 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:08:22.747822 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-f5b8db0c-f6cb-4933-9bc6-95c2656aa647 req-fbad3bfa-409f-42b1-9cee-080727bbc8b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b", "tag": "5125ac5d-9be1-440a-8d36-720220b29e72"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:08:22.758326 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-f5b8db0c-f6cb-4933-9bc6-95c2656aa647 req-fbad3bfa-409f-42b1-9cee-080727bbc8b0 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:08:22.758959 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-f5b8db0c-f6cb-4933-9bc6-95c2656aa647 req-fbad3bfa-409f-42b1-9cee-080727bbc8b0 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:08:22.759552 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-f5b8db0c-f6cb-4933-9bc6-95c2656aa647 req-fbad3bfa-409f-42b1-9cee-080727bbc8b0 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:08:22.771482 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-f5b8db0c-f6cb-4933-9bc6-95c2656aa647 req-fbad3bfa-409f-42b1-9cee-080727bbc8b0 service nova] Creating event network-changed:5125ac5d-9be1-440a-8d36-720220b29e72 for instance b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b on n-h1-850501-12 Sep 08 12:08:22.777646 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-f5b8db0c-f6cb-4933-9bc6-95c2656aa647 req-fbad3bfa-409f-42b1-9cee-080727bbc8b0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033299 Sep 08 12:08:22.778280 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3824/7779] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 12:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:10:15.285554 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:10:15.286304 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=58 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:10:15.334987 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3a3b627b-3c52-4c7c-bba4-88f9a9611019 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:10:15.335531 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3a3b627b-3c52-4c7c-bba4-88f9a9611019 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:10:15.342354 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3a3b627b-3c52-4c7c-bba4-88f9a9611019 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:10:15.342840 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3a3b627b-3c52-4c7c-bba4-88f9a9611019 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:10:15.343275 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3a3b627b-3c52-4c7c-bba4-88f9a9611019 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:10:15.343968 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3a3b627b-3c52-4c7c-bba4-88f9a9611019 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:10:15.344422 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3a3b627b-3c52-4c7c-bba4-88f9a9611019 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:10:15.344847 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3a3b627b-3c52-4c7c-bba4-88f9a9611019 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:10:15.368938 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-3a3b627b-3c52-4c7c-bba4-88f9a9611019 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lazy-loading 'flavor' on Instance uuid b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:10:15.443676 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3a3b627b-3c52-4c7c-bba4-88f9a9611019 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "POST /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b/action" status: 202 len: 0 microversion: 2.1 time: 0.163616 Sep 08 12:10:15.444427 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3956/7780] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 12:10:15 2022] POST /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b/action => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:10:15.452363 n-d-850501-12 devstack@n-api.service[128862]: ERROR oslo.messaging._drivers.impl_rabbit [-] [570aaa6f-7e4b-4ecb-864e-7bad38a49265] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 08 12:10:15.454660 n-d-850501-12 devstack@n-api.service[128862]: ERROR oslo.messaging._drivers.impl_rabbit [-] [081d0b47-1bf7-423f-b545-ebb7179d143a] AMQP server on 10.222.0.27:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 08 12:10:15.455300 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=24 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:10:15.456218 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=52 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:10:15.461834 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-117fc94a-3a27-4aec-8e2d-fb6045478878 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:10:15.462563 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-117fc94a-3a27-4aec-8e2d-fb6045478878 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:10:15.470747 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-117fc94a-3a27-4aec-8e2d-fb6045478878 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:10:15.471258 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-117fc94a-3a27-4aec-8e2d-fb6045478878 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:10:15.471720 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-117fc94a-3a27-4aec-8e2d-fb6045478878 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:10:15.472453 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-117fc94a-3a27-4aec-8e2d-fb6045478878 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:10:15.472930 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-117fc94a-3a27-4aec-8e2d-fb6045478878 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:10:15.473400 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-117fc94a-3a27-4aec-8e2d-fb6045478878 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:10:15.626866 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-117fc94a-3a27-4aec-8e2d-fb6045478878 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:10:15.634765 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-117fc94a-3a27-4aec-8e2d-fb6045478878 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b" status: 200 len: 1565 microversion: 2.1 time: 0.185355 Sep 08 12:10:15.635355 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3825/7781] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:10:15 2022] GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b => generated 1565 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:10:16.661240 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-db236a5b-67db-4ce4-9887-64cb57c517de tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:10:16.661957 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-db236a5b-67db-4ce4-9887-64cb57c517de tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:10:16.668775 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-db236a5b-67db-4ce4-9887-64cb57c517de tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:10:16.669379 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-db236a5b-67db-4ce4-9887-64cb57c517de tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:10:16.669956 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-db236a5b-67db-4ce4-9887-64cb57c517de tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:10:16.670807 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-db236a5b-67db-4ce4-9887-64cb57c517de tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:10:16.671299 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-db236a5b-67db-4ce4-9887-64cb57c517de tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:10:16.671734 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-db236a5b-67db-4ce4-9887-64cb57c517de tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:10:16.815738 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-db236a5b-67db-4ce4-9887-64cb57c517de tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:10:16.824969 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-db236a5b-67db-4ce4-9887-64cb57c517de tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b" status: 200 len: 1565 microversion: 2.1 time: 0.169531 Sep 08 12:10:16.825586 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3957/7782] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:10:16 2022] GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b => generated 1565 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:10:17.847928 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9406675a-11bd-4e11-88d5-7486a1348fb2 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:10:17.848562 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9406675a-11bd-4e11-88d5-7486a1348fb2 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:10:17.859448 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9406675a-11bd-4e11-88d5-7486a1348fb2 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:10:17.859954 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9406675a-11bd-4e11-88d5-7486a1348fb2 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:10:17.860443 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9406675a-11bd-4e11-88d5-7486a1348fb2 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:10:17.861229 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9406675a-11bd-4e11-88d5-7486a1348fb2 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:10:17.861982 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9406675a-11bd-4e11-88d5-7486a1348fb2 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:10:17.862424 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9406675a-11bd-4e11-88d5-7486a1348fb2 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:10:17.866795 n-d-850501-12 devstack@n-api.service[128862]: INFO oslo.messaging._drivers.impl_rabbit [-] [570aaa6f-7e4b-4ecb-864e-7bad38a49265] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 45908. Sep 08 12:10:17.870509 n-d-850501-12 devstack@n-api.service[128862]: INFO oslo.messaging._drivers.impl_rabbit [-] [081d0b47-1bf7-423f-b545-ebb7179d143a] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 45910. Sep 08 12:10:17.999578 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9406675a-11bd-4e11-88d5-7486a1348fb2 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:10:18.007434 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9406675a-11bd-4e11-88d5-7486a1348fb2 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b" status: 200 len: 1565 microversion: 2.1 time: 0.163397 Sep 08 12:10:18.008505 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3826/7783] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:10:17 2022] GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b => generated 1565 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:10:19.032007 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9222ee22-8052-46c2-8ab8-d17c71457162 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:10:19.032635 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9222ee22-8052-46c2-8ab8-d17c71457162 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:10:19.040024 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9222ee22-8052-46c2-8ab8-d17c71457162 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:10:19.040578 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9222ee22-8052-46c2-8ab8-d17c71457162 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:10:19.040962 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9222ee22-8052-46c2-8ab8-d17c71457162 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:10:19.041696 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9222ee22-8052-46c2-8ab8-d17c71457162 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:10:19.042159 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9222ee22-8052-46c2-8ab8-d17c71457162 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:10:19.042588 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9222ee22-8052-46c2-8ab8-d17c71457162 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:10:19.184251 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-9222ee22-8052-46c2-8ab8-d17c71457162 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:10:19.192258 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9222ee22-8052-46c2-8ab8-d17c71457162 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b" status: 200 len: 1565 microversion: 2.1 time: 0.164317 Sep 08 12:10:19.192833 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3958/7784] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:10:19 2022] GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b => generated 1565 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:10:20.216683 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e536bf7f-b8d8-4d1f-b5ce-5e89acb71941 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:10:20.217320 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e536bf7f-b8d8-4d1f-b5ce-5e89acb71941 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:10:20.224271 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e536bf7f-b8d8-4d1f-b5ce-5e89acb71941 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:10:20.224782 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e536bf7f-b8d8-4d1f-b5ce-5e89acb71941 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:10:20.225272 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e536bf7f-b8d8-4d1f-b5ce-5e89acb71941 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:10:20.225998 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e536bf7f-b8d8-4d1f-b5ce-5e89acb71941 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:10:20.226474 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e536bf7f-b8d8-4d1f-b5ce-5e89acb71941 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:10:20.226924 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e536bf7f-b8d8-4d1f-b5ce-5e89acb71941 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:10:20.367160 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e536bf7f-b8d8-4d1f-b5ce-5e89acb71941 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:10:20.375641 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e536bf7f-b8d8-4d1f-b5ce-5e89acb71941 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b" status: 200 len: 1565 microversion: 2.1 time: 0.163712 Sep 08 12:10:20.376227 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3827/7785] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:10:20 2022] GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b => generated 1565 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:10:21.399540 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-dc6d5bb0-c55f-4544-b892-1ce2954bd6bd tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:10:21.400221 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-dc6d5bb0-c55f-4544-b892-1ce2954bd6bd tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:10:21.407105 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dc6d5bb0-c55f-4544-b892-1ce2954bd6bd tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:10:21.407587 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dc6d5bb0-c55f-4544-b892-1ce2954bd6bd tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:10:21.408022 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dc6d5bb0-c55f-4544-b892-1ce2954bd6bd tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:10:21.408708 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dc6d5bb0-c55f-4544-b892-1ce2954bd6bd tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:10:21.409195 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dc6d5bb0-c55f-4544-b892-1ce2954bd6bd tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:10:21.409620 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dc6d5bb0-c55f-4544-b892-1ce2954bd6bd tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:10:21.548031 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-dc6d5bb0-c55f-4544-b892-1ce2954bd6bd tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:10:21.557203 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-dc6d5bb0-c55f-4544-b892-1ce2954bd6bd tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b" status: 200 len: 1565 microversion: 2.1 time: 0.161579 Sep 08 12:10:21.557780 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3959/7786] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:10:21 2022] GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b => generated 1565 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:10:22.582041 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b46a66f6-82f9-4374-8911-af12af1e90be tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:10:22.582656 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b46a66f6-82f9-4374-8911-af12af1e90be tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:10:22.591292 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b46a66f6-82f9-4374-8911-af12af1e90be tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:10:22.591809 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b46a66f6-82f9-4374-8911-af12af1e90be tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:10:22.592259 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b46a66f6-82f9-4374-8911-af12af1e90be tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:10:22.593143 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b46a66f6-82f9-4374-8911-af12af1e90be tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:10:22.593803 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b46a66f6-82f9-4374-8911-af12af1e90be tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:10:22.594413 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b46a66f6-82f9-4374-8911-af12af1e90be tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:10:22.746776 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b46a66f6-82f9-4374-8911-af12af1e90be tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:10:22.755873 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b46a66f6-82f9-4374-8911-af12af1e90be tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b" status: 200 len: 1565 microversion: 2.1 time: 0.178686 Sep 08 12:10:22.756487 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3828/7787] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:10:22 2022] GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b => generated 1565 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:10:23.785716 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7ef50ddf-1e81-41b1-9026-426f1e26bbeb tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:10:23.786331 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7ef50ddf-1e81-41b1-9026-426f1e26bbeb tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:10:23.793374 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7ef50ddf-1e81-41b1-9026-426f1e26bbeb tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:10:23.793862 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7ef50ddf-1e81-41b1-9026-426f1e26bbeb tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:10:23.794300 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7ef50ddf-1e81-41b1-9026-426f1e26bbeb tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:10:23.794992 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7ef50ddf-1e81-41b1-9026-426f1e26bbeb tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:10:23.795449 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7ef50ddf-1e81-41b1-9026-426f1e26bbeb tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:10:23.795875 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7ef50ddf-1e81-41b1-9026-426f1e26bbeb tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:10:23.929252 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7ef50ddf-1e81-41b1-9026-426f1e26bbeb tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:10:23.938142 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7ef50ddf-1e81-41b1-9026-426f1e26bbeb tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b" status: 200 len: 1565 microversion: 2.1 time: 0.156378 Sep 08 12:10:23.938714 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3960/7788] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:10:23 2022] GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b => generated 1565 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:10:24.961945 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-17321662-4739-48e3-b249-703c82f0c183 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:10:24.962721 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-17321662-4739-48e3-b249-703c82f0c183 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:10:24.969952 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-17321662-4739-48e3-b249-703c82f0c183 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:10:24.970559 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-17321662-4739-48e3-b249-703c82f0c183 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:10:24.971067 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-17321662-4739-48e3-b249-703c82f0c183 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:10:24.971851 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-17321662-4739-48e3-b249-703c82f0c183 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:10:24.972349 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-17321662-4739-48e3-b249-703c82f0c183 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:10:24.972791 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-17321662-4739-48e3-b249-703c82f0c183 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:10:25.106202 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-17321662-4739-48e3-b249-703c82f0c183 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:10:25.114558 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-17321662-4739-48e3-b249-703c82f0c183 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b" status: 200 len: 1565 microversion: 2.1 time: 0.157202 Sep 08 12:10:25.115150 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3829/7789] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:10:24 2022] GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:10:26.138986 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c35938a0-7f3f-4601-afc4-feac56a56e52 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:10:26.139602 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c35938a0-7f3f-4601-afc4-feac56a56e52 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:10:26.147012 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c35938a0-7f3f-4601-afc4-feac56a56e52 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:10:26.147420 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c35938a0-7f3f-4601-afc4-feac56a56e52 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:10:26.147863 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c35938a0-7f3f-4601-afc4-feac56a56e52 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:10:26.148581 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c35938a0-7f3f-4601-afc4-feac56a56e52 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:10:26.149378 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c35938a0-7f3f-4601-afc4-feac56a56e52 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:10:26.149592 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c35938a0-7f3f-4601-afc4-feac56a56e52 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:10:26.355847 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c35938a0-7f3f-4601-afc4-feac56a56e52 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:10:26.364043 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c35938a0-7f3f-4601-afc4-feac56a56e52 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b" status: 200 len: 1565 microversion: 2.1 time: 0.229027 Sep 08 12:10:26.364613 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3961/7790] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:10:26 2022] GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b => generated 1565 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:10:27.388739 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-79fc9e0d-589c-4727-bd6b-1844e32d94ec tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:10:27.389385 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-79fc9e0d-589c-4727-bd6b-1844e32d94ec tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:10:27.396643 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-79fc9e0d-589c-4727-bd6b-1844e32d94ec tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:10:27.397192 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-79fc9e0d-589c-4727-bd6b-1844e32d94ec tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:10:27.397644 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-79fc9e0d-589c-4727-bd6b-1844e32d94ec tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:10:27.398364 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-79fc9e0d-589c-4727-bd6b-1844e32d94ec tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:10:27.398876 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-79fc9e0d-589c-4727-bd6b-1844e32d94ec tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:10:27.399476 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-79fc9e0d-589c-4727-bd6b-1844e32d94ec tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:10:27.545609 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-79fc9e0d-589c-4727-bd6b-1844e32d94ec tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:10:27.553709 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-79fc9e0d-589c-4727-bd6b-1844e32d94ec tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b" status: 200 len: 1565 microversion: 2.1 time: 0.169074 Sep 08 12:10:27.554294 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3830/7791] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:10:27 2022] GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b => generated 1565 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:10:28.576954 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-551605c7-6a69-40a6-bf79-3f05228c945b tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:10:28.577530 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-551605c7-6a69-40a6-bf79-3f05228c945b tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:10:28.584481 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-551605c7-6a69-40a6-bf79-3f05228c945b tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:10:28.584999 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-551605c7-6a69-40a6-bf79-3f05228c945b tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:10:28.585467 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-551605c7-6a69-40a6-bf79-3f05228c945b tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:10:28.586169 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-551605c7-6a69-40a6-bf79-3f05228c945b tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:10:28.587225 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-551605c7-6a69-40a6-bf79-3f05228c945b tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:10:28.587707 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-551605c7-6a69-40a6-bf79-3f05228c945b tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:10:28.729087 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-551605c7-6a69-40a6-bf79-3f05228c945b tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:10:28.737817 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-551605c7-6a69-40a6-bf79-3f05228c945b tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b" status: 200 len: 1565 microversion: 2.1 time: 0.164908 Sep 08 12:10:28.738401 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3962/7792] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:10:28 2022] GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b => generated 1565 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:10:29.761380 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d57b8bb2-405d-4913-8737-57c6019390b7 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:10:29.762168 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d57b8bb2-405d-4913-8737-57c6019390b7 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:10:29.769428 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d57b8bb2-405d-4913-8737-57c6019390b7 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:10:29.769613 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d57b8bb2-405d-4913-8737-57c6019390b7 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:10:29.770108 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d57b8bb2-405d-4913-8737-57c6019390b7 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:10:29.770932 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d57b8bb2-405d-4913-8737-57c6019390b7 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:10:29.771646 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d57b8bb2-405d-4913-8737-57c6019390b7 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:10:29.772123 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d57b8bb2-405d-4913-8737-57c6019390b7 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:10:29.917077 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d57b8bb2-405d-4913-8737-57c6019390b7 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:10:29.925639 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d57b8bb2-405d-4913-8737-57c6019390b7 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b" status: 200 len: 1565 microversion: 2.1 time: 0.168506 Sep 08 12:10:29.926280 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3831/7793] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:10:29 2022] GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b => generated 1565 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:10:30.951821 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0b2781af-2b3d-4149-ad8b-5c77661a5bae tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:10:30.952427 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0b2781af-2b3d-4149-ad8b-5c77661a5bae tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:10:30.959337 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0b2781af-2b3d-4149-ad8b-5c77661a5bae tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:10:30.959821 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0b2781af-2b3d-4149-ad8b-5c77661a5bae tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:10:30.960297 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0b2781af-2b3d-4149-ad8b-5c77661a5bae tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:10:30.960989 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0b2781af-2b3d-4149-ad8b-5c77661a5bae tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:10:30.961698 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0b2781af-2b3d-4149-ad8b-5c77661a5bae tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:10:30.962116 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0b2781af-2b3d-4149-ad8b-5c77661a5bae tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:10:31.103152 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-0b2781af-2b3d-4149-ad8b-5c77661a5bae tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:10:31.113577 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0b2781af-2b3d-4149-ad8b-5c77661a5bae tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b" status: 200 len: 1506 microversion: 2.1 time: 0.165543 Sep 08 12:10:31.114176 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3963/7794] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:10:30 2022] GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b => generated 1506 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:10:31.137064 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3af5efed-70bd-4064-8569-908fa968600b tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:10:31.137678 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3af5efed-70bd-4064-8569-908fa968600b tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:10:31.144454 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3af5efed-70bd-4064-8569-908fa968600b tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:10:31.144894 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3af5efed-70bd-4064-8569-908fa968600b tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:10:31.145378 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3af5efed-70bd-4064-8569-908fa968600b tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:10:31.146078 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3af5efed-70bd-4064-8569-908fa968600b tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:10:31.146542 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3af5efed-70bd-4064-8569-908fa968600b tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:10:31.146978 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3af5efed-70bd-4064-8569-908fa968600b tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:10:31.253879 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3af5efed-70bd-4064-8569-908fa968600b tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128862) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 08 12:10:31.320587 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3af5efed-70bd-4064-8569-908fa968600b tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "POST /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b/action" status: 202 len: 0 microversion: 2.1 time: 0.188060 Sep 08 12:10:31.321482 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3832/7795] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 12:10:31 2022] POST /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:10:31.329966 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-84d0e205-8064-409e-9dfe-f6a2ba3fa4b5 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:10:31.330714 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-84d0e205-8064-409e-9dfe-f6a2ba3fa4b5 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:10:31.337896 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-84d0e205-8064-409e-9dfe-f6a2ba3fa4b5 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:10:31.338402 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-84d0e205-8064-409e-9dfe-f6a2ba3fa4b5 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:10:31.338893 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-84d0e205-8064-409e-9dfe-f6a2ba3fa4b5 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:10:31.339712 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-84d0e205-8064-409e-9dfe-f6a2ba3fa4b5 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:10:31.340264 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-84d0e205-8064-409e-9dfe-f6a2ba3fa4b5 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:10:31.340753 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-84d0e205-8064-409e-9dfe-f6a2ba3fa4b5 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:10:31.501308 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-84d0e205-8064-409e-9dfe-f6a2ba3fa4b5 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:10:31.509243 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-84d0e205-8064-409e-9dfe-f6a2ba3fa4b5 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b" status: 200 len: 1514 microversion: 2.1 time: 0.183117 Sep 08 12:10:31.509834 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3964/7796] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:10:31 2022] GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b => generated 1514 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:10:31.953776 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-c4348d61-7920-4b48-a16f-98206e03f2d6 req-b1dcdda6-1b63-4a04-848f-0c0900a5af2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b", "name": "network-vif-unplugged", "status": "completed", "tag": "5125ac5d-9be1-440a-8d36-720220b29e72"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:10:31.964798 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c4348d61-7920-4b48-a16f-98206e03f2d6 req-b1dcdda6-1b63-4a04-848f-0c0900a5af2c service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:10:31.965547 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c4348d61-7920-4b48-a16f-98206e03f2d6 req-b1dcdda6-1b63-4a04-848f-0c0900a5af2c service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:10:31.966177 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c4348d61-7920-4b48-a16f-98206e03f2d6 req-b1dcdda6-1b63-4a04-848f-0c0900a5af2c service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:10:31.978755 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.compute.server_external_events [req-c4348d61-7920-4b48-a16f-98206e03f2d6 req-b1dcdda6-1b63-4a04-848f-0c0900a5af2c service nova] Unable to find a host for instance b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b. Dropping event network-vif-unplugged {{(pid=128862) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 08 12:10:31.979650 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-c4348d61-7920-4b48-a16f-98206e03f2d6 req-b1dcdda6-1b63-4a04-848f-0c0900a5af2c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029973 Sep 08 12:10:31.980252 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3833/7797] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 12:10:31 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 08 12:10:32.532085 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f76660b2-e98b-470f-9c8d-906baa3d07a6 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:10:32.532690 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f76660b2-e98b-470f-9c8d-906baa3d07a6 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:10:32.539914 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f76660b2-e98b-470f-9c8d-906baa3d07a6 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:10:32.540405 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f76660b2-e98b-470f-9c8d-906baa3d07a6 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:10:32.540842 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f76660b2-e98b-470f-9c8d-906baa3d07a6 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:10:32.541576 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f76660b2-e98b-470f-9c8d-906baa3d07a6 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:10:32.542036 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f76660b2-e98b-470f-9c8d-906baa3d07a6 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:10:32.542465 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f76660b2-e98b-470f-9c8d-906baa3d07a6 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:10:32.684365 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f76660b2-e98b-470f-9c8d-906baa3d07a6 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:10:32.692590 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f76660b2-e98b-470f-9c8d-906baa3d07a6 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b" status: 200 len: 1516 microversion: 2.1 time: 0.164492 Sep 08 12:10:32.693198 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3965/7798] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:10:32 2022] GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b => generated 1516 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:10:33.718108 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-48760603-58eb-485b-917d-6dc28a8d56e7 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:10:33.718665 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-48760603-58eb-485b-917d-6dc28a8d56e7 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:10:33.725787 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-48760603-58eb-485b-917d-6dc28a8d56e7 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:10:33.726294 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-48760603-58eb-485b-917d-6dc28a8d56e7 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:10:33.726813 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-48760603-58eb-485b-917d-6dc28a8d56e7 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:10:33.727570 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-48760603-58eb-485b-917d-6dc28a8d56e7 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:10:33.728038 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-48760603-58eb-485b-917d-6dc28a8d56e7 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:10:33.728480 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-48760603-58eb-485b-917d-6dc28a8d56e7 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:10:33.862950 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-48760603-58eb-485b-917d-6dc28a8d56e7 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:10:33.871790 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-48760603-58eb-485b-917d-6dc28a8d56e7 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b" status: 200 len: 1516 microversion: 2.1 time: 0.157695 Sep 08 12:10:33.872375 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3834/7799] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:10:33 2022] GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:10:34.895865 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7c8ebfbc-bca6-496f-8479-850d5547320e tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:10:34.896485 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7c8ebfbc-bca6-496f-8479-850d5547320e tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:10:34.904350 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c8ebfbc-bca6-496f-8479-850d5547320e tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:10:34.904834 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c8ebfbc-bca6-496f-8479-850d5547320e tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:10:34.905303 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c8ebfbc-bca6-496f-8479-850d5547320e tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:10:34.906012 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c8ebfbc-bca6-496f-8479-850d5547320e tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:10:34.906476 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c8ebfbc-bca6-496f-8479-850d5547320e tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:10:34.906911 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c8ebfbc-bca6-496f-8479-850d5547320e tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:10:35.047610 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-7c8ebfbc-bca6-496f-8479-850d5547320e tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:10:35.056265 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7c8ebfbc-bca6-496f-8479-850d5547320e tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b" status: 200 len: 1516 microversion: 2.1 time: 0.164314 Sep 08 12:10:35.056863 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3966/7800] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:10:34 2022] GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b => generated 1516 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:10:36.081551 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3e915092-066d-427d-9f77-e2736a74820e tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:10:36.082085 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3e915092-066d-427d-9f77-e2736a74820e tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:10:36.090126 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e915092-066d-427d-9f77-e2736a74820e tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:10:36.091209 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e915092-066d-427d-9f77-e2736a74820e tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:10:36.091949 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e915092-066d-427d-9f77-e2736a74820e tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:10:36.092746 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e915092-066d-427d-9f77-e2736a74820e tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:10:36.093325 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e915092-066d-427d-9f77-e2736a74820e tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:10:36.093773 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e915092-066d-427d-9f77-e2736a74820e tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:10:36.226342 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3e915092-066d-427d-9f77-e2736a74820e tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:10:36.234949 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3e915092-066d-427d-9f77-e2736a74820e tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b" status: 200 len: 1516 microversion: 2.1 time: 0.158841 Sep 08 12:10:36.235519 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3835/7801] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:10:36 2022] GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:10:37.259046 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-726df38c-39d2-4a67-84df-c7326601961f tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:10:37.259707 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-726df38c-39d2-4a67-84df-c7326601961f tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:10:37.267225 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-726df38c-39d2-4a67-84df-c7326601961f tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:10:37.267754 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-726df38c-39d2-4a67-84df-c7326601961f tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:10:37.268204 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-726df38c-39d2-4a67-84df-c7326601961f tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:10:37.268911 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-726df38c-39d2-4a67-84df-c7326601961f tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:10:37.269424 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-726df38c-39d2-4a67-84df-c7326601961f tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:10:37.269857 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-726df38c-39d2-4a67-84df-c7326601961f tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:10:37.450980 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-726df38c-39d2-4a67-84df-c7326601961f tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:10:37.458834 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-726df38c-39d2-4a67-84df-c7326601961f tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b" status: 200 len: 1572 microversion: 2.1 time: 0.204210 Sep 08 12:10:37.459408 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3967/7802] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:10:37 2022] GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b => generated 1572 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:10:38.363299 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-236f0900-e8ba-49be-9ea2-58ed4ca22ab6 req-43bc036f-d4a7-48ba-9c5a-67863d54c85a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b", "tag": "5125ac5d-9be1-440a-8d36-720220b29e72"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:10:38.373377 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-236f0900-e8ba-49be-9ea2-58ed4ca22ab6 req-43bc036f-d4a7-48ba-9c5a-67863d54c85a service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:10:38.373884 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-236f0900-e8ba-49be-9ea2-58ed4ca22ab6 req-43bc036f-d4a7-48ba-9c5a-67863d54c85a service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:10:38.374330 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-236f0900-e8ba-49be-9ea2-58ed4ca22ab6 req-43bc036f-d4a7-48ba-9c5a-67863d54c85a service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:10:38.385521 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-236f0900-e8ba-49be-9ea2-58ed4ca22ab6 req-43bc036f-d4a7-48ba-9c5a-67863d54c85a service nova] Creating event network-changed:5125ac5d-9be1-440a-8d36-720220b29e72 for instance b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b on n-h2-850501-12 Sep 08 12:10:38.390682 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-236f0900-e8ba-49be-9ea2-58ed4ca22ab6 req-43bc036f-d4a7-48ba-9c5a-67863d54c85a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136813 Sep 08 12:10:38.391522 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3836/7803] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 12:10:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 12:10:38.483282 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d24b1e8b-6f4d-4d34-816f-f18f3703481a tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:10:38.483905 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d24b1e8b-6f4d-4d34-816f-f18f3703481a tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:10:38.490978 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d24b1e8b-6f4d-4d34-816f-f18f3703481a tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:10:38.491477 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d24b1e8b-6f4d-4d34-816f-f18f3703481a tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:10:38.491926 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d24b1e8b-6f4d-4d34-816f-f18f3703481a tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:10:38.493158 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d24b1e8b-6f4d-4d34-816f-f18f3703481a tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:10:38.493915 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d24b1e8b-6f4d-4d34-816f-f18f3703481a tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:10:38.494364 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d24b1e8b-6f4d-4d34-816f-f18f3703481a tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:10:38.728546 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-d24b1e8b-6f4d-4d34-816f-f18f3703481a tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:10:38.736944 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d24b1e8b-6f4d-4d34-816f-f18f3703481a tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b" status: 200 len: 1572 microversion: 2.1 time: 0.257426 Sep 08 12:10:38.737758 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3968/7804] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:10:38 2022] GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b => generated 1572 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:10:39.760269 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-adcc038a-3a7c-4151-8a66-75fbb3c5c979 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:10:39.760985 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-adcc038a-3a7c-4151-8a66-75fbb3c5c979 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:10:39.768520 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-adcc038a-3a7c-4151-8a66-75fbb3c5c979 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:10:39.769041 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-adcc038a-3a7c-4151-8a66-75fbb3c5c979 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:10:39.769513 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-adcc038a-3a7c-4151-8a66-75fbb3c5c979 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:10:39.770234 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-adcc038a-3a7c-4151-8a66-75fbb3c5c979 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:10:39.770705 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-adcc038a-3a7c-4151-8a66-75fbb3c5c979 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:10:39.771147 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-adcc038a-3a7c-4151-8a66-75fbb3c5c979 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:10:39.918673 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-adcc038a-3a7c-4151-8a66-75fbb3c5c979 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:10:39.926871 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-adcc038a-3a7c-4151-8a66-75fbb3c5c979 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b" status: 200 len: 1572 microversion: 2.1 time: 0.170877 Sep 08 12:10:39.927442 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3837/7805] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:10:39 2022] GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b => generated 1572 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:10:40.950655 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6ff3dd4e-d874-41d4-b59e-1136f75db55d tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:10:40.951269 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6ff3dd4e-d874-41d4-b59e-1136f75db55d tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:10:40.958376 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6ff3dd4e-d874-41d4-b59e-1136f75db55d tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:10:40.958867 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6ff3dd4e-d874-41d4-b59e-1136f75db55d tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:10:40.959301 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6ff3dd4e-d874-41d4-b59e-1136f75db55d tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:10:40.959993 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6ff3dd4e-d874-41d4-b59e-1136f75db55d tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:10:40.960446 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6ff3dd4e-d874-41d4-b59e-1136f75db55d tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:10:40.960875 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6ff3dd4e-d874-41d4-b59e-1136f75db55d tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:10:41.094772 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6ff3dd4e-d874-41d4-b59e-1136f75db55d tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:10:41.103484 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6ff3dd4e-d874-41d4-b59e-1136f75db55d tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b" status: 200 len: 1572 microversion: 2.1 time: 0.156559 Sep 08 12:10:41.107303 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3969/7806] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:10:40 2022] GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b => generated 1572 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:10:42.128437 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a2e87623-ec5e-40f7-9b45-cbdc7a15699d tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:10:42.129132 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a2e87623-ec5e-40f7-9b45-cbdc7a15699d tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:10:42.136918 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2e87623-ec5e-40f7-9b45-cbdc7a15699d tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:10:42.137459 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2e87623-ec5e-40f7-9b45-cbdc7a15699d tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:10:42.137916 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2e87623-ec5e-40f7-9b45-cbdc7a15699d tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:10:42.138633 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2e87623-ec5e-40f7-9b45-cbdc7a15699d tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:10:42.139110 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2e87623-ec5e-40f7-9b45-cbdc7a15699d tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:10:42.139555 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2e87623-ec5e-40f7-9b45-cbdc7a15699d tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:10:42.276730 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a2e87623-ec5e-40f7-9b45-cbdc7a15699d tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:10:42.284535 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a2e87623-ec5e-40f7-9b45-cbdc7a15699d tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b" status: 200 len: 1572 microversion: 2.1 time: 0.160000 Sep 08 12:10:42.285151 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3838/7807] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:10:42 2022] GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b => generated 1572 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:10:43.307808 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4f249942-612b-4dfe-933f-a37244d8ac5f tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:10:43.308522 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4f249942-612b-4dfe-933f-a37244d8ac5f tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:10:43.315336 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4f249942-612b-4dfe-933f-a37244d8ac5f tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:10:43.315829 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4f249942-612b-4dfe-933f-a37244d8ac5f tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:10:43.316268 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4f249942-612b-4dfe-933f-a37244d8ac5f tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:10:43.316963 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4f249942-612b-4dfe-933f-a37244d8ac5f tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:10:43.317452 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4f249942-612b-4dfe-933f-a37244d8ac5f tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:10:43.317886 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4f249942-612b-4dfe-933f-a37244d8ac5f tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:10:43.337334 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:10:43.459067 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4f249942-612b-4dfe-933f-a37244d8ac5f tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:10:43.467697 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4f249942-612b-4dfe-933f-a37244d8ac5f tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b" status: 200 len: 1572 microversion: 2.1 time: 0.164037 Sep 08 12:10:43.468262 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3970/7808] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:10:43 2022] GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b => generated 1572 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:10:44.491260 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6163abb4-b97d-4083-b98e-9be3ab4cbbda tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:10:44.491869 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6163abb4-b97d-4083-b98e-9be3ab4cbbda tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:10:44.499118 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6163abb4-b97d-4083-b98e-9be3ab4cbbda tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:10:44.499619 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6163abb4-b97d-4083-b98e-9be3ab4cbbda tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:10:44.500066 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6163abb4-b97d-4083-b98e-9be3ab4cbbda tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:10:44.500769 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6163abb4-b97d-4083-b98e-9be3ab4cbbda tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:10:44.501273 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6163abb4-b97d-4083-b98e-9be3ab4cbbda tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:10:44.501709 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6163abb4-b97d-4083-b98e-9be3ab4cbbda tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:10:44.634315 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6163abb4-b97d-4083-b98e-9be3ab4cbbda tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:10:44.642183 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6163abb4-b97d-4083-b98e-9be3ab4cbbda tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b" status: 200 len: 1572 microversion: 2.1 time: 0.154766 Sep 08 12:10:44.642751 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3839/7809] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:10:44 2022] GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b => generated 1572 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:10:45.666871 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f346f6b6-3fc5-4c4b-826c-f782fabb665c tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:10:45.667497 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f346f6b6-3fc5-4c4b-826c-f782fabb665c tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:10:45.670247 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=31 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:10:45.676249 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f346f6b6-3fc5-4c4b-826c-f782fabb665c tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:10:45.676746 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f346f6b6-3fc5-4c4b-826c-f782fabb665c tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:10:45.677223 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f346f6b6-3fc5-4c4b-826c-f782fabb665c tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:10:45.677930 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f346f6b6-3fc5-4c4b-826c-f782fabb665c tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:10:45.678393 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f346f6b6-3fc5-4c4b-826c-f782fabb665c tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:10:45.678826 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f346f6b6-3fc5-4c4b-826c-f782fabb665c tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:10:45.812052 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f346f6b6-3fc5-4c4b-826c-f782fabb665c tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:10:45.819976 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f346f6b6-3fc5-4c4b-826c-f782fabb665c tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b" status: 200 len: 1572 microversion: 2.1 time: 0.157830 Sep 08 12:10:45.820551 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3971/7810] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:10:45 2022] GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b => generated 1572 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:10:46.843241 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9fc23166-205f-4899-8785-8b7e23460666 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:10:46.844199 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9fc23166-205f-4899-8785-8b7e23460666 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:10:46.848240 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:10:46.857041 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9fc23166-205f-4899-8785-8b7e23460666 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:10:46.857800 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9fc23166-205f-4899-8785-8b7e23460666 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:10:46.858477 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9fc23166-205f-4899-8785-8b7e23460666 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:10:46.859549 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9fc23166-205f-4899-8785-8b7e23460666 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:10:46.860262 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9fc23166-205f-4899-8785-8b7e23460666 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:10:46.860960 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9fc23166-205f-4899-8785-8b7e23460666 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:10:46.867969 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:10:47.005398 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9fc23166-205f-4899-8785-8b7e23460666 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:10:47.013500 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9fc23166-205f-4899-8785-8b7e23460666 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b" status: 200 len: 1572 microversion: 2.1 time: 0.175241 Sep 08 12:10:47.014081 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3840/7811] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:10:46 2022] GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b => generated 1572 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:10:48.037037 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1373f673-2e7f-4811-9c1f-062ed5db4f25 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:10:48.037673 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1373f673-2e7f-4811-9c1f-062ed5db4f25 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:10:48.045379 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1373f673-2e7f-4811-9c1f-062ed5db4f25 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:10:48.045873 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1373f673-2e7f-4811-9c1f-062ed5db4f25 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:10:48.046312 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1373f673-2e7f-4811-9c1f-062ed5db4f25 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:10:48.047009 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1373f673-2e7f-4811-9c1f-062ed5db4f25 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:10:48.047468 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1373f673-2e7f-4811-9c1f-062ed5db4f25 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:10:48.047898 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1373f673-2e7f-4811-9c1f-062ed5db4f25 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:10:48.183765 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-1373f673-2e7f-4811-9c1f-062ed5db4f25 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:10:48.191695 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1373f673-2e7f-4811-9c1f-062ed5db4f25 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b" status: 200 len: 1572 microversion: 2.1 time: 0.158603 Sep 08 12:10:48.192276 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3972/7812] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:10:48 2022] GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b => generated 1572 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:10:49.216060 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a2656c22-ab4c-4947-9a9e-0acc3ebf6f10 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:10:49.216692 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a2656c22-ab4c-4947-9a9e-0acc3ebf6f10 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:10:49.222846 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2656c22-ab4c-4947-9a9e-0acc3ebf6f10 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:10:49.223346 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2656c22-ab4c-4947-9a9e-0acc3ebf6f10 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:10:49.223796 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2656c22-ab4c-4947-9a9e-0acc3ebf6f10 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:10:49.224502 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2656c22-ab4c-4947-9a9e-0acc3ebf6f10 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:10:49.224975 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2656c22-ab4c-4947-9a9e-0acc3ebf6f10 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:10:49.226012 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2656c22-ab4c-4947-9a9e-0acc3ebf6f10 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:10:49.358840 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a2656c22-ab4c-4947-9a9e-0acc3ebf6f10 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:10:49.366815 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a2656c22-ab4c-4947-9a9e-0acc3ebf6f10 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b" status: 200 len: 1572 microversion: 2.1 time: 0.155080 Sep 08 12:10:49.367382 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3841/7813] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:10:49 2022] GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b => generated 1572 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:10:50.391589 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-17efd8b8-b1e5-42d7-9285-3233ea5ecf99 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:10:50.392195 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-17efd8b8-b1e5-42d7-9285-3233ea5ecf99 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:10:50.399073 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-17efd8b8-b1e5-42d7-9285-3233ea5ecf99 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:10:50.399569 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-17efd8b8-b1e5-42d7-9285-3233ea5ecf99 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:10:50.400007 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-17efd8b8-b1e5-42d7-9285-3233ea5ecf99 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:10:50.400698 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-17efd8b8-b1e5-42d7-9285-3233ea5ecf99 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:10:50.401204 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-17efd8b8-b1e5-42d7-9285-3233ea5ecf99 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:10:50.401636 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-17efd8b8-b1e5-42d7-9285-3233ea5ecf99 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:10:50.448548 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-f3f281d3-69bf-472c-9af1-a676d1bbd334 req-667eb178-ddc2-4c3c-8158-46c1dd851ea1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b", "name": "network-vif-plugged", "status": "completed", "tag": "5125ac5d-9be1-440a-8d36-720220b29e72"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:10:50.462294 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-f3f281d3-69bf-472c-9af1-a676d1bbd334 req-667eb178-ddc2-4c3c-8158-46c1dd851ea1 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:10:50.462805 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-f3f281d3-69bf-472c-9af1-a676d1bbd334 req-667eb178-ddc2-4c3c-8158-46c1dd851ea1 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:10:50.463287 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-f3f281d3-69bf-472c-9af1-a676d1bbd334 req-667eb178-ddc2-4c3c-8158-46c1dd851ea1 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:10:50.475973 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-f3f281d3-69bf-472c-9af1-a676d1bbd334 req-667eb178-ddc2-4c3c-8158-46c1dd851ea1 service nova] Creating event network-vif-plugged:5125ac5d-9be1-440a-8d36-720220b29e72 for instance b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b on n-h2-850501-12 Sep 08 12:10:50.481695 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-f3f281d3-69bf-472c-9af1-a676d1bbd334 req-667eb178-ddc2-4c3c-8158-46c1dd851ea1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037664 Sep 08 12:10:50.482481 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3842/7814] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 12:10:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:10:50.547149 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-17efd8b8-b1e5-42d7-9285-3233ea5ecf99 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:10:50.554996 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-17efd8b8-b1e5-42d7-9285-3233ea5ecf99 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b" status: 200 len: 1572 microversion: 2.1 time: 0.167370 Sep 08 12:10:50.555566 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3973/7815] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:10:50 2022] GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b => generated 1572 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:10:51.580549 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c126b8c2-ebc5-42ab-9dce-df640bdd8891 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:10:51.581202 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c126b8c2-ebc5-42ab-9dce-df640bdd8891 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:10:51.587361 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c126b8c2-ebc5-42ab-9dce-df640bdd8891 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:10:51.587859 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c126b8c2-ebc5-42ab-9dce-df640bdd8891 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:10:51.588313 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c126b8c2-ebc5-42ab-9dce-df640bdd8891 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:10:51.589533 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c126b8c2-ebc5-42ab-9dce-df640bdd8891 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:10:51.590001 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c126b8c2-ebc5-42ab-9dce-df640bdd8891 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:10:51.590436 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c126b8c2-ebc5-42ab-9dce-df640bdd8891 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:10:51.725948 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c126b8c2-ebc5-42ab-9dce-df640bdd8891 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:10:51.734951 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c126b8c2-ebc5-42ab-9dce-df640bdd8891 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b" status: 200 len: 1572 microversion: 2.1 time: 0.159668 Sep 08 12:10:51.735539 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3843/7816] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:10:51 2022] GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b => generated 1572 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:10:52.759544 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-83bdab08-7063-42d5-935f-b8ab0041b5d5 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:10:52.761002 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-83bdab08-7063-42d5-935f-b8ab0041b5d5 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:10:52.767901 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-83bdab08-7063-42d5-935f-b8ab0041b5d5 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:10:52.768401 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-83bdab08-7063-42d5-935f-b8ab0041b5d5 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:10:52.768841 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-83bdab08-7063-42d5-935f-b8ab0041b5d5 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:10:52.769574 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-83bdab08-7063-42d5-935f-b8ab0041b5d5 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:10:52.770039 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-83bdab08-7063-42d5-935f-b8ab0041b5d5 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:10:52.770470 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-83bdab08-7063-42d5-935f-b8ab0041b5d5 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:10:52.909154 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-83bdab08-7063-42d5-935f-b8ab0041b5d5 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:10:52.917895 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-83bdab08-7063-42d5-935f-b8ab0041b5d5 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b" status: 200 len: 1559 microversion: 2.1 time: 0.162439 Sep 08 12:10:52.918598 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3974/7817] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:10:52 2022] GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:12:09.510772 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=7 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:12:09.511540 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=19 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:12:09.512359 n-d-850501-12 devstack@n-api.service[128862]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 12:12:09.512497 n-d-850501-12 devstack@n-api.service[128862]: Thu Sep 8 12:12:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b (ip 10.222.0.27) !!! Sep 08 12:12:09.516322 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=7 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:12:09.517598 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=26 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:12:09.518757 n-d-850501-12 devstack@n-api.service[128861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 12:12:09.518891 n-d-850501-12 devstack@n-api.service[128861]: Thu Sep 8 12:12:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.27) !!! Sep 08 12:12:09.524036 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c579ab59-4820-4237-aa49-2a1222927249 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:12:09.524546 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c579ab59-4820-4237-aa49-2a1222927249 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:12:09.529631 n-d-850501-12 devstack@n-api.service[128861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 12:12:09.529782 n-d-850501-12 devstack@n-api.service[128861]: Thu Sep 8 12:12:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.27) !!! Sep 08 12:12:09.534884 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-1db978d7-120d-436c-9a25-bb00da3aa2a4 req-16635631-19c8-48a9-86d3-819d9781bf92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b", "tag": "5125ac5d-9be1-440a-8d36-720220b29e72"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:12:09.539426 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c579ab59-4820-4237-aa49-2a1222927249 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:12:09.540169 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c579ab59-4820-4237-aa49-2a1222927249 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:12:09.541004 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c579ab59-4820-4237-aa49-2a1222927249 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:12:09.541947 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c579ab59-4820-4237-aa49-2a1222927249 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:12:09.542581 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c579ab59-4820-4237-aa49-2a1222927249 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:12:09.543193 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c579ab59-4820-4237-aa49-2a1222927249 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:12:09.548035 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-1db978d7-120d-436c-9a25-bb00da3aa2a4 req-16635631-19c8-48a9-86d3-819d9781bf92 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:12:09.548780 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-1db978d7-120d-436c-9a25-bb00da3aa2a4 req-16635631-19c8-48a9-86d3-819d9781bf92 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:12:09.549282 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-1db978d7-120d-436c-9a25-bb00da3aa2a4 req-16635631-19c8-48a9-86d3-819d9781bf92 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:12:09.562428 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-1db978d7-120d-436c-9a25-bb00da3aa2a4 req-16635631-19c8-48a9-86d3-819d9781bf92 service nova] Creating event network-changed:5125ac5d-9be1-440a-8d36-720220b29e72 for instance b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b on n-h2-850501-12 Sep 08 12:12:09.567528 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-1db978d7-120d-436c-9a25-bb00da3aa2a4 req-16635631-19c8-48a9-86d3-819d9781bf92 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053130 Sep 08 12:12:09.568430 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3975/7818] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 12:12:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:12:09.572785 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c579ab59-4820-4237-aa49-2a1222927249 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:12:09.666975 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c579ab59-4820-4237-aa49-2a1222927249 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b" status: 204 len: 0 microversion: 2.1 time: 0.157861 Sep 08 12:12:09.668108 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3844/7819] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 12:12:09 2022] DELETE /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 12:12:09.677298 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8334da14-35b5-4cdf-b527-9807986bb3dd tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:12:09.678004 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8334da14-35b5-4cdf-b527-9807986bb3dd tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:12:09.684663 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8334da14-35b5-4cdf-b527-9807986bb3dd tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:12:09.685174 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8334da14-35b5-4cdf-b527-9807986bb3dd tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:12:09.685611 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8334da14-35b5-4cdf-b527-9807986bb3dd tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:12:09.686311 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8334da14-35b5-4cdf-b527-9807986bb3dd tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:12:09.686766 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8334da14-35b5-4cdf-b527-9807986bb3dd tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:12:09.687195 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8334da14-35b5-4cdf-b527-9807986bb3dd tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:12:09.855387 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8334da14-35b5-4cdf-b527-9807986bb3dd tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:12:09.865241 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8334da14-35b5-4cdf-b527-9807986bb3dd tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b" status: 200 len: 1565 microversion: 2.1 time: 0.192615 Sep 08 12:12:09.866174 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3976/7820] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:12:09 2022] GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b => generated 1565 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:12:10.889570 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5b6b3de9-011c-4bab-89aa-72da9eb392a5 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:12:10.890293 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5b6b3de9-011c-4bab-89aa-72da9eb392a5 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:12:10.898444 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b6b3de9-011c-4bab-89aa-72da9eb392a5 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:12:10.898949 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b6b3de9-011c-4bab-89aa-72da9eb392a5 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:12:10.899400 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b6b3de9-011c-4bab-89aa-72da9eb392a5 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:12:10.900116 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b6b3de9-011c-4bab-89aa-72da9eb392a5 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:12:10.900588 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b6b3de9-011c-4bab-89aa-72da9eb392a5 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:12:10.901046 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b6b3de9-011c-4bab-89aa-72da9eb392a5 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:12:11.037663 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5b6b3de9-011c-4bab-89aa-72da9eb392a5 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:12:11.046116 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5b6b3de9-011c-4bab-89aa-72da9eb392a5 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b" status: 200 len: 1565 microversion: 2.1 time: 0.160525 Sep 08 12:12:11.058971 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3845/7821] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:12:10 2022] GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b => generated 1565 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:12:12.075000 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4d3d440d-955a-48ad-bc04-9469332ac209 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:12:12.075656 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4d3d440d-955a-48ad-bc04-9469332ac209 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:12:12.083865 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4d3d440d-955a-48ad-bc04-9469332ac209 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:12:12.084384 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4d3d440d-955a-48ad-bc04-9469332ac209 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:12:12.084833 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4d3d440d-955a-48ad-bc04-9469332ac209 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:12:12.085580 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4d3d440d-955a-48ad-bc04-9469332ac209 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:12:12.086048 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4d3d440d-955a-48ad-bc04-9469332ac209 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:12:12.086483 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4d3d440d-955a-48ad-bc04-9469332ac209 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:12:12.154307 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-4d3d440d-955a-48ad-bc04-9469332ac209 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:12:12.163547 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4d3d440d-955a-48ad-bc04-9469332ac209 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b" status: 200 len: 1381 microversion: 2.1 time: 0.095194 Sep 08 12:12:12.164142 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3977/7822] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:12:12 2022] GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b => generated 1381 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:12:12.309825 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-7333d5d3-b1c1-40fd-855a-408e6f4d41a9 req-6bfe4747-08f0-4ca6-b4f7-9044b462761f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b", "name": "network-vif-deleted", "tag": "5125ac5d-9be1-440a-8d36-720220b29e72"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:12:12.321940 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-7333d5d3-b1c1-40fd-855a-408e6f4d41a9 req-6bfe4747-08f0-4ca6-b4f7-9044b462761f service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:12:12.322463 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-7333d5d3-b1c1-40fd-855a-408e6f4d41a9 req-6bfe4747-08f0-4ca6-b4f7-9044b462761f service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:12:12.322900 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-7333d5d3-b1c1-40fd-855a-408e6f4d41a9 req-6bfe4747-08f0-4ca6-b4f7-9044b462761f service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:12:12.334617 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-7333d5d3-b1c1-40fd-855a-408e6f4d41a9 req-6bfe4747-08f0-4ca6-b4f7-9044b462761f service nova] Creating event network-vif-deleted:5125ac5d-9be1-440a-8d36-720220b29e72 for instance b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b on n-h2-850501-12 Sep 08 12:12:12.339804 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-7333d5d3-b1c1-40fd-855a-408e6f4d41a9 req-6bfe4747-08f0-4ca6-b4f7-9044b462761f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033738 Sep 08 12:12:12.340645 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3846/7823] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 12:12:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:12:13.196218 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-edc49231-2bae-4e7d-b43f-52043f5c12b0 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:12:13.197119 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-edc49231-2bae-4e7d-b43f-52043f5c12b0 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:12:13.208750 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-edc49231-2bae-4e7d-b43f-52043f5c12b0 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:12:13.209263 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-edc49231-2bae-4e7d-b43f-52043f5c12b0 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:12:13.210048 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-edc49231-2bae-4e7d-b43f-52043f5c12b0 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:12:13.211350 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-edc49231-2bae-4e7d-b43f-52043f5c12b0 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:12:13.211814 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-edc49231-2bae-4e7d-b43f-52043f5c12b0 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:12:13.212244 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-edc49231-2bae-4e7d-b43f-52043f5c12b0 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:12:13.279542 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-edc49231-2bae-4e7d-b43f-52043f5c12b0 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:12:13.287742 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-edc49231-2bae-4e7d-b43f-52043f5c12b0 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b" status: 200 len: 1218 microversion: 2.1 time: 0.103699 Sep 08 12:12:13.288385 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3978/7824] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:12:13 2022] GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b => generated 1218 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:12:14.312174 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-beeb94a1-3d73-4296-82d3-316f1d38f0ff tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:12:14.312883 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-beeb94a1-3d73-4296-82d3-316f1d38f0ff tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:12:14.319197 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-beeb94a1-3d73-4296-82d3-316f1d38f0ff tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:12:14.319696 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-beeb94a1-3d73-4296-82d3-316f1d38f0ff tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:12:14.320141 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-beeb94a1-3d73-4296-82d3-316f1d38f0ff tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:12:14.320855 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-beeb94a1-3d73-4296-82d3-316f1d38f0ff tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:12:14.321343 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-beeb94a1-3d73-4296-82d3-316f1d38f0ff tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:12:14.321781 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-beeb94a1-3d73-4296-82d3-316f1d38f0ff tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:12:14.386482 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-beeb94a1-3d73-4296-82d3-316f1d38f0ff tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:12:14.395219 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-beeb94a1-3d73-4296-82d3-316f1d38f0ff tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b" status: 200 len: 1218 microversion: 2.1 time: 0.088184 Sep 08 12:12:14.395795 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3847/7825] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:12:14 2022] GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:12:15.418873 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6f58c1e9-2c08-4a8b-9167-1790a6da8dbd tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:12:15.419498 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6f58c1e9-2c08-4a8b-9167-1790a6da8dbd tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:12:15.428419 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6f58c1e9-2c08-4a8b-9167-1790a6da8dbd tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:12:15.429205 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6f58c1e9-2c08-4a8b-9167-1790a6da8dbd tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:12:15.429885 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6f58c1e9-2c08-4a8b-9167-1790a6da8dbd tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:12:15.430963 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6f58c1e9-2c08-4a8b-9167-1790a6da8dbd tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:12:15.431712 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6f58c1e9-2c08-4a8b-9167-1790a6da8dbd tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:12:15.432426 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6f58c1e9-2c08-4a8b-9167-1790a6da8dbd tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:12:15.504158 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-6f58c1e9-2c08-4a8b-9167-1790a6da8dbd tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:12:15.512728 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6f58c1e9-2c08-4a8b-9167-1790a6da8dbd tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b" status: 200 len: 1218 microversion: 2.1 time: 0.097768 Sep 08 12:12:15.513627 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3979/7826] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:12:15 2022] GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b => generated 1218 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:12:16.536982 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-72fdc5ff-500e-4b60-8751-c529513dbfb0 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:12:16.538309 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-72fdc5ff-500e-4b60-8751-c529513dbfb0 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:12:16.545654 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-72fdc5ff-500e-4b60-8751-c529513dbfb0 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:12:16.546159 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-72fdc5ff-500e-4b60-8751-c529513dbfb0 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:12:16.546755 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-72fdc5ff-500e-4b60-8751-c529513dbfb0 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:12:16.547440 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-72fdc5ff-500e-4b60-8751-c529513dbfb0 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:12:16.547909 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-72fdc5ff-500e-4b60-8751-c529513dbfb0 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:12:16.549056 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-72fdc5ff-500e-4b60-8751-c529513dbfb0 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:12:16.582820 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-72fdc5ff-500e-4b60-8751-c529513dbfb0 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:12:16.583321 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-72fdc5ff-500e-4b60-8751-c529513dbfb0 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:12:16.583762 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-72fdc5ff-500e-4b60-8751-c529513dbfb0 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:12:16.584219 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-72fdc5ff-500e-4b60-8751-c529513dbfb0 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lazy-loading 'fault' on Instance uuid b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:12:16.630755 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-72fdc5ff-500e-4b60-8751-c529513dbfb0 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e855b6c68941c695392bf233af695e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70812f059546fc945d0b8e5142785b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:12:16.639099 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-72fdc5ff-500e-4b60-8751-c529513dbfb0 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b" status: 200 len: 1223 microversion: 2.1 time: 0.106539 Sep 08 12:12:16.639686 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3848/7827] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:12:16 2022] GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b => generated 1223 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:12:17.662132 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-646343fd-9566-482c-9551-2d4270194066 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:12:17.662688 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-646343fd-9566-482c-9551-2d4270194066 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] [instance: b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:12:17.669538 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-646343fd-9566-482c-9551-2d4270194066 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:12:17.670031 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-646343fd-9566-482c-9551-2d4270194066 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:12:17.670474 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-646343fd-9566-482c-9551-2d4270194066 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:12:17.671173 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-646343fd-9566-482c-9551-2d4270194066 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:12:17.671638 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-646343fd-9566-482c-9551-2d4270194066 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:12:17.672069 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-646343fd-9566-482c-9551-2d4270194066 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:12:17.686081 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-646343fd-9566-482c-9551-2d4270194066 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] HTTP exception thrown: Instance b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b could not be found. Sep 08 12:12:17.687760 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-646343fd-9566-482c-9551-2d4270194066 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Request method failure captured: Sep 08 12:12:17.687760 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b HTTP/1.1 Sep 08 12:12:17.687760 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 12:12:17.687760 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 12:12:17.687760 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 12:12:17.687760 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 12:12:17.687760 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 12:12:17.687760 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 12:12:17.687760 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 12:12:17.687760 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 12:12:17.687760 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGdoO4kIo9UVj7mtt0EPHhw49b8A7qwdQMp38-j8zRh-2wvoqNvS9dV-36WJc9rHSGXFIfhD6h5i3TfzwKO64blwHvvgfNU3mr4G6da8Gy4HuHfdSjBV0l-wGxFfpPlGMQJ-K6qKyvGoQcxkpuMuIR_Ay7hHHa_VJZhb6CTFwV_UUXnk Sep 08 12:12:17.687760 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 12:12:17.687760 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 12:12:17.687760 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 12:12:17.687760 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 12:12:17.687760 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 12:12:17.687760 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 12:12:17.687760 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: fa70812f059546fc945d0b8e5142785b Sep 08 12:12:17.687760 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-TestShelveInstance-24544356 Sep 08 12:12:17.687760 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 12:12:17.687760 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 12:12:17.687760 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fa70812f059546fc945d0b8e5142785b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fa70812f059546fc945d0b8e5142785b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fa70812f059546fc945d0b8e5142785b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fa70812f059546fc945d0b8e5142785b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 12:12:17.687760 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-TestShelveInstance-24544356 Sep 08 12:12:17.687760 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: fa70812f059546fc945d0b8e5142785b Sep 08 12:12:17.687760 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-TestShelveInstance-24544356 Sep 08 12:12:17.687760 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-TestShelveInstance-24544356-project Sep 08 12:12:17.687760 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 12:12:17.687760 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 12:12:17.687760 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: e4e855b6c68941c695392bf233af695e Sep 08 12:12:17.687760 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-TestShelveInstance-24544356-project Sep 08 12:12:17.687760 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 12:12:17.687760 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b could not be found. Sep 08 12:12:17.687760 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': 'b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b'} Sep 08 12:12:17.687760 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:12:17.687760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:12:17.687760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:12:17.687760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:12:17.687760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:12:17.687760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:12:17.687760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:12:17.687760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:12:17.687760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:12:17.687760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:12:17.687760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b could not be found. Sep 08 12:12:17.687760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 12:12:17.687760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:12:17.687760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 12:12:17.687760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:12:17.687760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:12:17.687760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:12:17.687760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:12:17.687760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:12:17.687760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:12:17.687760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:12:17.687760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:12:17.687760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:12:17.687760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:12:17.687760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:12:17.687760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:12:17.687760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:12:17.687760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b could not be found. Sep 08 12:12:17.687760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 12:12:17.687760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:12:17.687760 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 12:12:17.693450 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:12:17.693450 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:12:17.693450 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:12:17.693450 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:12:17.693450 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:12:17.693450 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b could not be found. Sep 08 12:12:17.693450 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 12:12:17.693450 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-646343fd-9566-482c-9551-2d4270194066 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Returning 404 to user: Instance b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:12:17.693450 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-646343fd-9566-482c-9551-2d4270194066 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b" status: 404 len: 111 microversion: 2.1 time: 0.031761 Sep 08 12:12:17.693450 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3980/7828] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:12:17 2022] GET /compute/v2.1/servers/b0c51c3b-e2f4-4d7c-88ac-2ca74617df3b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:12:17.860273 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8fc7010f-dcfa-41ed-b8e1-459331c9eb97 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] Calling method '.version_select at 0x7f68e4039040>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:12:17.902042 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8fc7010f-dcfa-41ed-b8e1-459331c9eb97 tempest-TestShelveInstance-24544356 tempest-TestShelveInstance-24544356-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1114159399" status: 202 len: 0 microversion: 2.1 time: 0.046156 Sep 08 12:12:17.902855 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3849/7829] 10.222.0.27 () {58 vars in 1254 bytes} [Thu Sep 8 12:12:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1114159399 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:12:35.661275 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=12 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:12:35.662028 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=28 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:12:35.841932 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-892564fb-572c-4b9d-8508-7429e276876a tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Action: 'create', calling method: .version_select at 0x7f68e46a2f70>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-251540423", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGXCPyhem4UqBSFAqBkibAB3mSi0i/5iq/YBxQzOGL1wX4eBbQI+g1iA5WJOEdnKhCqMolVf19Hq6CEy+341j2bBG9p5yx0OyDBGHR5AhUxnQvmUdJQbo9mnAvbHNxih6A=="}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:12:35.857866 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-892564fb-572c-4b9d-8508-7429e276876a tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Getting quotas for project fb8d85bb414641f5854b635418ce52ff. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:12:35.865064 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-892564fb-572c-4b9d-8508-7429e276876a tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Getting quotas for user 13f17e0f291f4f4bb0bf31718e1b3628 and project fb8d85bb414641f5854b635418ce52ff. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:12:35.898834 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-892564fb-572c-4b9d-8508-7429e276876a tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.244091 Sep 08 12:12:35.899448 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3981/7830] 10.222.0.27 () {60 vars in 1159 bytes} [Thu Sep 8 12:12:35 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:12:36.930255 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b0bd510c-abdd-448f-809f-a994792f8485 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1510264448", "imageRef": "503f4a0f-e18f-47fd-ad12-0289e3463117", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-251540423", "security_groups": [{"name": "tempest-secgroup-smoke-743161044"}], "networks": [{"uuid": "6888e028-e3fd-41f5-a829-0c0d5abf7be7"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:12:36.941144 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:12:36.941824 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:12:37.049171 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-b0bd510c-abdd-448f-809f-a994792f8485 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] validate_networks() for [('6888e028-e3fd-41f5-a829-0c0d5abf7be7', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:12:37.457050 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-b0bd510c-abdd-448f-809f-a994792f8485 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:12:37.457523 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-b0bd510c-abdd-448f-809f-a994792f8485 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:12:37.458022 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-b0bd510c-abdd-448f-809f-a994792f8485 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:12:37.458445 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-b0bd510c-abdd-448f-809f-a994792f8485 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:12:37.458864 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-b0bd510c-abdd-448f-809f-a994792f8485 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:12:37.467732 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b0bd510c-abdd-448f-809f-a994792f8485 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:12:37.468236 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b0bd510c-abdd-448f-809f-a994792f8485 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:12:37.468678 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b0bd510c-abdd-448f-809f-a994792f8485 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:12:37.470041 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b0bd510c-abdd-448f-809f-a994792f8485 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:12:37.470510 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b0bd510c-abdd-448f-809f-a994792f8485 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:12:37.470954 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b0bd510c-abdd-448f-809f-a994792f8485 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:12:37.489092 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-b0bd510c-abdd-448f-809f-a994792f8485 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Getting quotas for project fb8d85bb414641f5854b635418ce52ff. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:12:37.494381 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.quota [None req-b0bd510c-abdd-448f-809f-a994792f8485 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Getting quotas for user 13f17e0f291f4f4bb0bf31718e1b3628 and project fb8d85bb414641f5854b635418ce52ff. Resources: {'ram', 'instances', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:12:37.506769 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b0bd510c-abdd-448f-809f-a994792f8485 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:12:37.509151 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b0bd510c-abdd-448f-809f-a994792f8485 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] [instance: 4022c788-1312-4046-8b60-01b11709592b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='503f4a0f-e18f-47fd-ad12-0289e3463117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:12:37.558038 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b0bd510c-abdd-448f-809f-a994792f8485 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.632094 Sep 08 12:12:37.559072 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3850/7831] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 12:12:36 2022] POST /compute/v2.1/servers => generated 405 bytes in 634 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 12:12:37.571686 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c315c683-9b2a-4d94-896c-0f6afa0c5d2f tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:12:37.572463 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c315c683-9b2a-4d94-896c-0f6afa0c5d2f tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] [instance: 4022c788-1312-4046-8b60-01b11709592b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:12:37.633078 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c315c683-9b2a-4d94-896c-0f6afa0c5d2f tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f17e0f291f4f4bb0bf31718e1b3628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8d85bb414641f5854b635418ce52ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:12:37.641739 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c315c683-9b2a-4d94-896c-0f6afa0c5d2f tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] 10.222.0.27 "GET /compute/v2.1/servers/4022c788-1312-4046-8b60-01b11709592b" status: 200 len: 1248 microversion: 2.1 time: 0.074641 Sep 08 12:12:37.642346 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3982/7832] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:12:37 2022] GET /compute/v2.1/servers/4022c788-1312-4046-8b60-01b11709592b => generated 1248 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:12:38.665282 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-69318278-1d98-48bf-9026-15afdf4fb84c tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:12:38.666645 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-69318278-1d98-48bf-9026-15afdf4fb84c tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] [instance: 4022c788-1312-4046-8b60-01b11709592b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:12:38.674377 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-69318278-1d98-48bf-9026-15afdf4fb84c tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:12:38.674903 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-69318278-1d98-48bf-9026-15afdf4fb84c tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:12:38.675347 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-69318278-1d98-48bf-9026-15afdf4fb84c tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:12:38.676071 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-69318278-1d98-48bf-9026-15afdf4fb84c tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:12:38.676541 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-69318278-1d98-48bf-9026-15afdf4fb84c tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:12:38.676983 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-69318278-1d98-48bf-9026-15afdf4fb84c tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:12:38.775587 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-69318278-1d98-48bf-9026-15afdf4fb84c tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f17e0f291f4f4bb0bf31718e1b3628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8d85bb414641f5854b635418ce52ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:12:38.784293 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-69318278-1d98-48bf-9026-15afdf4fb84c tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] 10.222.0.27 "GET /compute/v2.1/servers/4022c788-1312-4046-8b60-01b11709592b" status: 200 len: 1300 microversion: 2.1 time: 0.123814 Sep 08 12:12:38.784890 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3851/7833] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:12:38 2022] GET /compute/v2.1/servers/4022c788-1312-4046-8b60-01b11709592b => generated 1300 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:12:39.807954 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f818b672-b885-4c4d-b949-2e2a2d2629a3 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:12:39.808431 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f818b672-b885-4c4d-b949-2e2a2d2629a3 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] [instance: 4022c788-1312-4046-8b60-01b11709592b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:12:39.816952 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f818b672-b885-4c4d-b949-2e2a2d2629a3 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:12:39.817744 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f818b672-b885-4c4d-b949-2e2a2d2629a3 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:12:39.818181 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f818b672-b885-4c4d-b949-2e2a2d2629a3 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:12:39.819085 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f818b672-b885-4c4d-b949-2e2a2d2629a3 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:12:39.819544 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f818b672-b885-4c4d-b949-2e2a2d2629a3 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:12:39.820139 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f818b672-b885-4c4d-b949-2e2a2d2629a3 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:12:40.062209 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f818b672-b885-4c4d-b949-2e2a2d2629a3 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f17e0f291f4f4bb0bf31718e1b3628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8d85bb414641f5854b635418ce52ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:12:40.070614 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f818b672-b885-4c4d-b949-2e2a2d2629a3 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] 10.222.0.27 "GET /compute/v2.1/servers/4022c788-1312-4046-8b60-01b11709592b" status: 200 len: 1373 microversion: 2.1 time: 0.266612 Sep 08 12:12:40.071129 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3983/7834] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:12:39 2022] GET /compute/v2.1/servers/4022c788-1312-4046-8b60-01b11709592b => generated 1373 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:12:40.475475 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-e184bda3-c3d3-4a9e-af36-8fe768139932 req-814bec4f-c468-4df6-a1f0-2db56e9c9168 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4022c788-1312-4046-8b60-01b11709592b", "tag": "a62d14d3-c02c-4a4c-ab54-2c55367ce235"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:12:40.490203 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e184bda3-c3d3-4a9e-af36-8fe768139932 req-814bec4f-c468-4df6-a1f0-2db56e9c9168 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:12:40.490804 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e184bda3-c3d3-4a9e-af36-8fe768139932 req-814bec4f-c468-4df6-a1f0-2db56e9c9168 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:12:40.491321 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e184bda3-c3d3-4a9e-af36-8fe768139932 req-814bec4f-c468-4df6-a1f0-2db56e9c9168 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:12:40.503620 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-e184bda3-c3d3-4a9e-af36-8fe768139932 req-814bec4f-c468-4df6-a1f0-2db56e9c9168 service nova] Creating event network-changed:a62d14d3-c02c-4a4c-ab54-2c55367ce235 for instance 4022c788-1312-4046-8b60-01b11709592b on n-h1-850501-12 Sep 08 12:12:40.509420 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-e184bda3-c3d3-4a9e-af36-8fe768139932 req-814bec4f-c468-4df6-a1f0-2db56e9c9168 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040207 Sep 08 12:12:40.510430 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3852/7835] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 12:12:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:12:41.094959 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-efdb0ba1-64c0-460b-a888-1709b2037955 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:12:41.095629 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-efdb0ba1-64c0-460b-a888-1709b2037955 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] [instance: 4022c788-1312-4046-8b60-01b11709592b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:12:41.102020 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-efdb0ba1-64c0-460b-a888-1709b2037955 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:12:41.102521 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-efdb0ba1-64c0-460b-a888-1709b2037955 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:12:41.102970 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-efdb0ba1-64c0-460b-a888-1709b2037955 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:12:41.103679 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-efdb0ba1-64c0-460b-a888-1709b2037955 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:12:41.104148 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-efdb0ba1-64c0-460b-a888-1709b2037955 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:12:41.104578 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-efdb0ba1-64c0-460b-a888-1709b2037955 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:12:41.325590 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-efdb0ba1-64c0-460b-a888-1709b2037955 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f17e0f291f4f4bb0bf31718e1b3628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8d85bb414641f5854b635418ce52ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:12:41.346574 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-efdb0ba1-64c0-460b-a888-1709b2037955 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] 10.222.0.27 "GET /compute/v2.1/servers/4022c788-1312-4046-8b60-01b11709592b" status: 200 len: 1373 microversion: 2.1 time: 0.255950 Sep 08 12:12:41.347870 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3984/7836] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:12:41 2022] GET /compute/v2.1/servers/4022c788-1312-4046-8b60-01b11709592b => generated 1373 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:12:42.373250 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fe58e38a-9039-4fe5-a156-fdd7798a362e tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:12:42.373996 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fe58e38a-9039-4fe5-a156-fdd7798a362e tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] [instance: 4022c788-1312-4046-8b60-01b11709592b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:12:42.381442 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fe58e38a-9039-4fe5-a156-fdd7798a362e tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:12:42.381954 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fe58e38a-9039-4fe5-a156-fdd7798a362e tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:12:42.382409 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fe58e38a-9039-4fe5-a156-fdd7798a362e tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:12:42.383127 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fe58e38a-9039-4fe5-a156-fdd7798a362e tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:12:42.383605 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fe58e38a-9039-4fe5-a156-fdd7798a362e tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:12:42.384051 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fe58e38a-9039-4fe5-a156-fdd7798a362e tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:12:42.571838 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fe58e38a-9039-4fe5-a156-fdd7798a362e tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f17e0f291f4f4bb0bf31718e1b3628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8d85bb414641f5854b635418ce52ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:12:42.579538 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fe58e38a-9039-4fe5-a156-fdd7798a362e tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] 10.222.0.27 "GET /compute/v2.1/servers/4022c788-1312-4046-8b60-01b11709592b" status: 200 len: 1373 microversion: 2.1 time: 0.212276 Sep 08 12:12:42.580116 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3853/7837] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:12:42 2022] GET /compute/v2.1/servers/4022c788-1312-4046-8b60-01b11709592b => generated 1373 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:12:43.602424 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5677652e-c7f6-4df2-8e40-bc2a95967821 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:12:43.602999 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5677652e-c7f6-4df2-8e40-bc2a95967821 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] [instance: 4022c788-1312-4046-8b60-01b11709592b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:12:43.610464 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5677652e-c7f6-4df2-8e40-bc2a95967821 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:12:43.610962 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5677652e-c7f6-4df2-8e40-bc2a95967821 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:12:43.611661 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5677652e-c7f6-4df2-8e40-bc2a95967821 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:12:43.612367 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5677652e-c7f6-4df2-8e40-bc2a95967821 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:12:43.612825 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5677652e-c7f6-4df2-8e40-bc2a95967821 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:12:43.613278 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5677652e-c7f6-4df2-8e40-bc2a95967821 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:12:43.749147 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-5677652e-c7f6-4df2-8e40-bc2a95967821 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f17e0f291f4f4bb0bf31718e1b3628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8d85bb414641f5854b635418ce52ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:12:43.756996 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5677652e-c7f6-4df2-8e40-bc2a95967821 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] 10.222.0.27 "GET /compute/v2.1/servers/4022c788-1312-4046-8b60-01b11709592b" status: 200 len: 1373 microversion: 2.1 time: 0.158611 Sep 08 12:12:43.757623 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3985/7838] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:12:43 2022] GET /compute/v2.1/servers/4022c788-1312-4046-8b60-01b11709592b => generated 1373 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:12:44.779859 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0dcda849-53f3-4cf0-9f1b-69d2b2d47267 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:12:44.780480 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0dcda849-53f3-4cf0-9f1b-69d2b2d47267 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] [instance: 4022c788-1312-4046-8b60-01b11709592b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:12:44.787718 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0dcda849-53f3-4cf0-9f1b-69d2b2d47267 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:12:44.788260 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0dcda849-53f3-4cf0-9f1b-69d2b2d47267 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:12:44.788960 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0dcda849-53f3-4cf0-9f1b-69d2b2d47267 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:12:44.789852 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0dcda849-53f3-4cf0-9f1b-69d2b2d47267 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:12:44.790358 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0dcda849-53f3-4cf0-9f1b-69d2b2d47267 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:12:44.790939 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0dcda849-53f3-4cf0-9f1b-69d2b2d47267 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:12:44.948521 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0dcda849-53f3-4cf0-9f1b-69d2b2d47267 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f17e0f291f4f4bb0bf31718e1b3628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8d85bb414641f5854b635418ce52ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:12:44.957054 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0dcda849-53f3-4cf0-9f1b-69d2b2d47267 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] 10.222.0.27 "GET /compute/v2.1/servers/4022c788-1312-4046-8b60-01b11709592b" status: 200 len: 1373 microversion: 2.1 time: 0.181017 Sep 08 12:12:44.957649 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3854/7839] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:12:44 2022] GET /compute/v2.1/servers/4022c788-1312-4046-8b60-01b11709592b => generated 1373 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:12:45.980239 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8297b171-189c-4727-a8a3-e6481d48ba07 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:12:45.980896 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8297b171-189c-4727-a8a3-e6481d48ba07 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] [instance: 4022c788-1312-4046-8b60-01b11709592b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:12:45.990568 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8297b171-189c-4727-a8a3-e6481d48ba07 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:12:45.991067 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8297b171-189c-4727-a8a3-e6481d48ba07 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:12:45.991508 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8297b171-189c-4727-a8a3-e6481d48ba07 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:12:45.992217 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8297b171-189c-4727-a8a3-e6481d48ba07 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:12:45.992673 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8297b171-189c-4727-a8a3-e6481d48ba07 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:12:45.993147 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8297b171-189c-4727-a8a3-e6481d48ba07 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:12:46.123605 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8297b171-189c-4727-a8a3-e6481d48ba07 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f17e0f291f4f4bb0bf31718e1b3628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8d85bb414641f5854b635418ce52ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:12:46.131615 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8297b171-189c-4727-a8a3-e6481d48ba07 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] 10.222.0.27 "GET /compute/v2.1/servers/4022c788-1312-4046-8b60-01b11709592b" status: 200 len: 1373 microversion: 2.1 time: 0.155738 Sep 08 12:12:46.132196 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3986/7840] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:12:45 2022] GET /compute/v2.1/servers/4022c788-1312-4046-8b60-01b11709592b => generated 1373 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:12:46.847752 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-253cd009-7141-4ce1-9ecd-158469521017 req-8716519f-0dfb-4581-b956-8e0e42081bca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4022c788-1312-4046-8b60-01b11709592b", "name": "network-vif-plugged", "status": "completed", "tag": "a62d14d3-c02c-4a4c-ab54-2c55367ce235"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:12:46.857813 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-253cd009-7141-4ce1-9ecd-158469521017 req-8716519f-0dfb-4581-b956-8e0e42081bca service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:12:46.858983 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-253cd009-7141-4ce1-9ecd-158469521017 req-8716519f-0dfb-4581-b956-8e0e42081bca service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:12:46.858983 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-253cd009-7141-4ce1-9ecd-158469521017 req-8716519f-0dfb-4581-b956-8e0e42081bca service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:12:46.870420 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-253cd009-7141-4ce1-9ecd-158469521017 req-8716519f-0dfb-4581-b956-8e0e42081bca service nova] Creating event network-vif-plugged:a62d14d3-c02c-4a4c-ab54-2c55367ce235 for instance 4022c788-1312-4046-8b60-01b11709592b on n-h1-850501-12 Sep 08 12:12:46.876384 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-253cd009-7141-4ce1-9ecd-158469521017 req-8716519f-0dfb-4581-b956-8e0e42081bca service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093114 Sep 08 12:12:46.877205 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3855/7841] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 12:12:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 12:12:47.154693 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-aff8f044-a6dc-41bd-91cf-8574ab7c69cd tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:12:47.155264 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-aff8f044-a6dc-41bd-91cf-8574ab7c69cd tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] [instance: 4022c788-1312-4046-8b60-01b11709592b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:12:47.162418 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aff8f044-a6dc-41bd-91cf-8574ab7c69cd tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:12:47.162903 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aff8f044-a6dc-41bd-91cf-8574ab7c69cd tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:12:47.163341 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aff8f044-a6dc-41bd-91cf-8574ab7c69cd tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:12:47.164035 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aff8f044-a6dc-41bd-91cf-8574ab7c69cd tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:12:47.164499 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aff8f044-a6dc-41bd-91cf-8574ab7c69cd tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:12:47.164922 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aff8f044-a6dc-41bd-91cf-8574ab7c69cd tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:12:47.299411 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-aff8f044-a6dc-41bd-91cf-8574ab7c69cd tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f17e0f291f4f4bb0bf31718e1b3628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8d85bb414641f5854b635418ce52ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:12:47.307708 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-aff8f044-a6dc-41bd-91cf-8574ab7c69cd tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] 10.222.0.27 "GET /compute/v2.1/servers/4022c788-1312-4046-8b60-01b11709592b" status: 200 len: 1373 microversion: 2.1 time: 0.156925 Sep 08 12:12:47.308359 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3987/7842] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:12:47 2022] GET /compute/v2.1/servers/4022c788-1312-4046-8b60-01b11709592b => generated 1373 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:12:48.329382 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:12:48.330302 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:12:48.335657 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5967fa68-6ae7-4e62-a04c-fecdffbb39e1 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:12:48.336401 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5967fa68-6ae7-4e62-a04c-fecdffbb39e1 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] [instance: 4022c788-1312-4046-8b60-01b11709592b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:12:48.343245 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5967fa68-6ae7-4e62-a04c-fecdffbb39e1 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:12:48.343750 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5967fa68-6ae7-4e62-a04c-fecdffbb39e1 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:12:48.344752 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5967fa68-6ae7-4e62-a04c-fecdffbb39e1 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:12:48.345508 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5967fa68-6ae7-4e62-a04c-fecdffbb39e1 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:12:48.345988 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5967fa68-6ae7-4e62-a04c-fecdffbb39e1 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:12:48.346434 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5967fa68-6ae7-4e62-a04c-fecdffbb39e1 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:12:48.494882 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5967fa68-6ae7-4e62-a04c-fecdffbb39e1 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f17e0f291f4f4bb0bf31718e1b3628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8d85bb414641f5854b635418ce52ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:12:48.502974 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5967fa68-6ae7-4e62-a04c-fecdffbb39e1 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] 10.222.0.27 "GET /compute/v2.1/servers/4022c788-1312-4046-8b60-01b11709592b" status: 200 len: 1558 microversion: 2.1 time: 0.174871 Sep 08 12:12:48.503548 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3856/7843] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:12:48 2022] GET /compute/v2.1/servers/4022c788-1312-4046-8b60-01b11709592b => generated 1558 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:12:48.525786 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8da50338-ec6e-4c8b-a9d9-4a2c29f95ee2 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:12:48.526409 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8da50338-ec6e-4c8b-a9d9-4a2c29f95ee2 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] [instance: 4022c788-1312-4046-8b60-01b11709592b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:12:48.528317 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=6 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:12:48.535589 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8da50338-ec6e-4c8b-a9d9-4a2c29f95ee2 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:12:48.536092 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8da50338-ec6e-4c8b-a9d9-4a2c29f95ee2 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:12:48.536537 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8da50338-ec6e-4c8b-a9d9-4a2c29f95ee2 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:12:48.537274 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8da50338-ec6e-4c8b-a9d9-4a2c29f95ee2 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:12:48.537740 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8da50338-ec6e-4c8b-a9d9-4a2c29f95ee2 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:12:48.538173 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8da50338-ec6e-4c8b-a9d9-4a2c29f95ee2 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:12:48.678352 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-8da50338-ec6e-4c8b-a9d9-4a2c29f95ee2 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f17e0f291f4f4bb0bf31718e1b3628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8d85bb414641f5854b635418ce52ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:12:48.686141 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8da50338-ec6e-4c8b-a9d9-4a2c29f95ee2 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] 10.222.0.27 "GET /compute/v2.1/servers/4022c788-1312-4046-8b60-01b11709592b" status: 200 len: 1558 microversion: 2.1 time: 0.164311 Sep 08 12:12:48.686719 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3988/7844] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:12:48 2022] GET /compute/v2.1/servers/4022c788-1312-4046-8b60-01b11709592b => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:12:50.625935 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-fb26f552-df1b-4884-a7fa-404830fd3dd1 req-8ea4f0e2-14cc-4ff7-9f90-327ec098db50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4022c788-1312-4046-8b60-01b11709592b", "tag": "a62d14d3-c02c-4a4c-ab54-2c55367ce235"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:12:50.636539 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-fb26f552-df1b-4884-a7fa-404830fd3dd1 req-8ea4f0e2-14cc-4ff7-9f90-327ec098db50 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:12:50.637148 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-fb26f552-df1b-4884-a7fa-404830fd3dd1 req-8ea4f0e2-14cc-4ff7-9f90-327ec098db50 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:12:50.637601 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-fb26f552-df1b-4884-a7fa-404830fd3dd1 req-8ea4f0e2-14cc-4ff7-9f90-327ec098db50 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:12:50.650098 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-fb26f552-df1b-4884-a7fa-404830fd3dd1 req-8ea4f0e2-14cc-4ff7-9f90-327ec098db50 service nova] Creating event network-changed:a62d14d3-c02c-4a4c-ab54-2c55367ce235 for instance 4022c788-1312-4046-8b60-01b11709592b on n-h1-850501-12 Sep 08 12:12:50.655274 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-fb26f552-df1b-4884-a7fa-404830fd3dd1 req-8ea4f0e2-14cc-4ff7-9f90-327ec098db50 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033702 Sep 08 12:12:50.655907 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3857/7845] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 12:12:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:14:45.795511 n-d-850501-12 devstack@n-api.service[128861]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0785636a-6475-4dfc-a515-156caf1c5731] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 08 12:14:45.796432 n-d-850501-12 devstack@n-api.service[128861]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8ef3926a-51be-4267-8b7c-50c9a352d2ae] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 08 12:14:45.796957 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:14:45.797954 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=36 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:14:45.803600 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6fa14ffb-a6bc-4d3c-aa92-5219a69db866 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-2012121802"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:14:45.806010 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6fa14ffb-a6bc-4d3c-aa92-5219a69db866 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] [instance: 4022c788-1312-4046-8b60-01b11709592b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:14:45.813861 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6fa14ffb-a6bc-4d3c-aa92-5219a69db866 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:14:45.814355 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6fa14ffb-a6bc-4d3c-aa92-5219a69db866 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:14:45.814795 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6fa14ffb-a6bc-4d3c-aa92-5219a69db866 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:14:45.815486 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6fa14ffb-a6bc-4d3c-aa92-5219a69db866 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:14:45.815941 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6fa14ffb-a6bc-4d3c-aa92-5219a69db866 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:14:45.816364 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6fa14ffb-a6bc-4d3c-aa92-5219a69db866 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:14:46.019768 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6fa14ffb-a6bc-4d3c-aa92-5219a69db866 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] 10.222.0.27 "POST /compute/v2.1/servers/4022c788-1312-4046-8b60-01b11709592b/action" status: 202 len: 0 microversion: 2.1 time: 0.226110 Sep 08 12:14:46.020418 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3989/7846] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 12:14:45 2022] POST /compute/v2.1/servers/4022c788-1312-4046-8b60-01b11709592b/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 08 12:14:51.449367 n-d-850501-12 devstack@n-api.service[128862]: ERROR oslo.messaging._drivers.impl_rabbit [-] [570aaa6f-7e4b-4ecb-864e-7bad38a49265] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 08 12:14:51.451700 n-d-850501-12 devstack@n-api.service[128862]: ERROR oslo.messaging._drivers.impl_rabbit [-] [081d0b47-1bf7-423f-b545-ebb7179d143a] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 08 12:14:51.456814 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:14:51.458579 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=32 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:14:51.461153 n-d-850501-12 devstack@n-api.service[128862]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 08 12:14:51.461652 n-d-850501-12 devstack@n-api.service[128862]: Thu Sep 8 12:14:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.27) !!! Sep 08 12:14:51.477650 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-b2dde036-f16e-4ec1-86ad-650ca55b6f06 req-be1a27b3-66a5-4487-860e-c7a8b2cdf56c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4022c788-1312-4046-8b60-01b11709592b", "name": "network-vif-plugged", "status": "completed", "tag": "a62d14d3-c02c-4a4c-ab54-2c55367ce235"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:14:51.489811 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b2dde036-f16e-4ec1-86ad-650ca55b6f06 req-be1a27b3-66a5-4487-860e-c7a8b2cdf56c service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:14:51.490716 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b2dde036-f16e-4ec1-86ad-650ca55b6f06 req-be1a27b3-66a5-4487-860e-c7a8b2cdf56c service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:14:51.491403 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b2dde036-f16e-4ec1-86ad-650ca55b6f06 req-be1a27b3-66a5-4487-860e-c7a8b2cdf56c service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:14:51.516746 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-b2dde036-f16e-4ec1-86ad-650ca55b6f06 req-be1a27b3-66a5-4487-860e-c7a8b2cdf56c service nova] Creating event network-vif-plugged:a62d14d3-c02c-4a4c-ab54-2c55367ce235 for instance 4022c788-1312-4046-8b60-01b11709592b on n-h1-850501-12 Sep 08 12:14:51.523087 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-b2dde036-f16e-4ec1-86ad-650ca55b6f06 req-be1a27b3-66a5-4487-860e-c7a8b2cdf56c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075352 Sep 08 12:14:51.524469 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3858/7847] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 12:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:14:59.613043 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a70f394b-b4ec-4fe6-832c-3bc631530636 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-2031282047", "imageRef": "a899d558-0c1e-43b1-83e7-bb1280866ebf", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-251540423", "security_groups": [{"name": "tempest-secgroup-smoke-743161044"}], "networks": [{"uuid": "6888e028-e3fd-41f5-a829-0c0d5abf7be7"}]}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:14:59.625142 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:14:59.625888 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:14:59.646568 n-d-850501-12 devstack@n-api.service[128861]: INFO oslo.messaging._drivers.impl_rabbit [-] [8ef3926a-51be-4267-8b7c-50c9a352d2ae] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 46412. Sep 08 12:14:59.649798 n-d-850501-12 devstack@n-api.service[128861]: INFO oslo.messaging._drivers.impl_rabbit [-] [0785636a-6475-4dfc-a515-156caf1c5731] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 46410. Sep 08 12:14:59.739453 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-a70f394b-b4ec-4fe6-832c-3bc631530636 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] validate_networks() for [('6888e028-e3fd-41f5-a829-0c0d5abf7be7', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:15:00.157954 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-a70f394b-b4ec-4fe6-832c-3bc631530636 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:15:00.158389 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-a70f394b-b4ec-4fe6-832c-3bc631530636 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:15:00.158920 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-a70f394b-b4ec-4fe6-832c-3bc631530636 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:15:00.159335 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-a70f394b-b4ec-4fe6-832c-3bc631530636 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:15:00.159801 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-a70f394b-b4ec-4fe6-832c-3bc631530636 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:15:00.169787 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a70f394b-b4ec-4fe6-832c-3bc631530636 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:15:00.170276 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a70f394b-b4ec-4fe6-832c-3bc631530636 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:15:00.170717 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a70f394b-b4ec-4fe6-832c-3bc631530636 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:15:00.171459 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a70f394b-b4ec-4fe6-832c-3bc631530636 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:15:00.171921 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a70f394b-b4ec-4fe6-832c-3bc631530636 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:15:00.172354 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a70f394b-b4ec-4fe6-832c-3bc631530636 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:15:00.189757 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-a70f394b-b4ec-4fe6-832c-3bc631530636 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Getting quotas for project fb8d85bb414641f5854b635418ce52ff. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:15:00.195379 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.quota [None req-a70f394b-b4ec-4fe6-832c-3bc631530636 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Getting quotas for user 13f17e0f291f4f4bb0bf31718e1b3628 and project fb8d85bb414641f5854b635418ce52ff. Resources: {'ram', 'instances', 'cores'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:15:00.208050 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a70f394b-b4ec-4fe6-832c-3bc631530636 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:15:00.210633 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a70f394b-b4ec-4fe6-832c-3bc631530636 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] [instance: eec50660-b603-407f-b4d3-9dd0161fee83] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a899d558-0c1e-43b1-83e7-bb1280866ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:15:00.259975 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a70f394b-b4ec-4fe6-832c-3bc631530636 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.651620 Sep 08 12:15:00.260641 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3990/7848] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 12:14:59 2022] POST /compute/v2.1/servers => generated 405 bytes in 653 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 12:15:00.272475 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1b1f080d-204d-46ff-a2ea-e772f0632bb8 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:15:00.273214 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1b1f080d-204d-46ff-a2ea-e772f0632bb8 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] [instance: eec50660-b603-407f-b4d3-9dd0161fee83] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:15:00.292740 n-d-850501-12 devstack@n-api.service[128862]: INFO oslo.messaging._drivers.impl_rabbit [-] [081d0b47-1bf7-423f-b545-ebb7179d143a] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 46428. Sep 08 12:15:00.298971 n-d-850501-12 devstack@n-api.service[128862]: INFO oslo.messaging._drivers.impl_rabbit [-] [570aaa6f-7e4b-4ecb-864e-7bad38a49265] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 46426. Sep 08 12:15:00.354857 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1b1f080d-204d-46ff-a2ea-e772f0632bb8 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f17e0f291f4f4bb0bf31718e1b3628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8d85bb414641f5854b635418ce52ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:15:00.362802 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1b1f080d-204d-46ff-a2ea-e772f0632bb8 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] 10.222.0.27 "GET /compute/v2.1/servers/eec50660-b603-407f-b4d3-9dd0161fee83" status: 200 len: 1248 microversion: 2.1 time: 0.094640 Sep 08 12:15:00.363364 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3859/7849] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:15:00 2022] GET /compute/v2.1/servers/eec50660-b603-407f-b4d3-9dd0161fee83 => generated 1248 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:15:01.389326 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f6520135-6334-48d9-b918-ad75835094af tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:15:01.390057 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f6520135-6334-48d9-b918-ad75835094af tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] [instance: eec50660-b603-407f-b4d3-9dd0161fee83] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:15:01.397632 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f6520135-6334-48d9-b918-ad75835094af tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:15:01.399357 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f6520135-6334-48d9-b918-ad75835094af tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:15:01.400056 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f6520135-6334-48d9-b918-ad75835094af tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:15:01.401254 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f6520135-6334-48d9-b918-ad75835094af tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:15:01.402002 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f6520135-6334-48d9-b918-ad75835094af tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:15:01.402967 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f6520135-6334-48d9-b918-ad75835094af tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:15:01.440357 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-747e0abe-9796-4d5b-9bdd-1046aeb1ceba req-7bed3ef3-0529-4e2e-9805-25ddf6848693 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4022c788-1312-4046-8b60-01b11709592b", "name": "network-vif-unplugged", "status": "completed", "tag": "a62d14d3-c02c-4a4c-ab54-2c55367ce235"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:15:01.465116 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-747e0abe-9796-4d5b-9bdd-1046aeb1ceba req-7bed3ef3-0529-4e2e-9805-25ddf6848693 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:15:01.472225 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-747e0abe-9796-4d5b-9bdd-1046aeb1ceba req-7bed3ef3-0529-4e2e-9805-25ddf6848693 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:15:01.472833 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-747e0abe-9796-4d5b-9bdd-1046aeb1ceba req-7bed3ef3-0529-4e2e-9805-25ddf6848693 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:15:01.495046 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f6520135-6334-48d9-b918-ad75835094af tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f17e0f291f4f4bb0bf31718e1b3628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8d85bb414641f5854b635418ce52ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:15:01.497459 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-747e0abe-9796-4d5b-9bdd-1046aeb1ceba req-7bed3ef3-0529-4e2e-9805-25ddf6848693 service nova] Creating event network-vif-unplugged:a62d14d3-c02c-4a4c-ab54-2c55367ce235 for instance 4022c788-1312-4046-8b60-01b11709592b on n-h1-850501-12 Sep 08 12:15:01.508529 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-747e0abe-9796-4d5b-9bdd-1046aeb1ceba req-7bed3ef3-0529-4e2e-9805-25ddf6848693 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070335 Sep 08 12:15:01.509442 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f6520135-6334-48d9-b918-ad75835094af tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] 10.222.0.27 "GET /compute/v2.1/servers/eec50660-b603-407f-b4d3-9dd0161fee83" status: 200 len: 1308 microversion: 2.1 time: 0.125833 Sep 08 12:15:01.510872 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3991/7850] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:15:01 2022] GET /compute/v2.1/servers/eec50660-b603-407f-b4d3-9dd0161fee83 => generated 1308 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:15:01.511240 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3860/7851] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 12:15:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 12:15:02.538633 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c51aaa1a-95af-4103-9d03-2e39be7e1c3d tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:15:02.539568 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c51aaa1a-95af-4103-9d03-2e39be7e1c3d tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] [instance: eec50660-b603-407f-b4d3-9dd0161fee83] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:15:02.553353 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c51aaa1a-95af-4103-9d03-2e39be7e1c3d tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:15:02.558137 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c51aaa1a-95af-4103-9d03-2e39be7e1c3d tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:15:02.559055 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c51aaa1a-95af-4103-9d03-2e39be7e1c3d tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:15:02.560021 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c51aaa1a-95af-4103-9d03-2e39be7e1c3d tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:15:02.560694 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c51aaa1a-95af-4103-9d03-2e39be7e1c3d tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:15:02.561368 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c51aaa1a-95af-4103-9d03-2e39be7e1c3d tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:15:02.744682 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-c51aaa1a-95af-4103-9d03-2e39be7e1c3d tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f17e0f291f4f4bb0bf31718e1b3628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8d85bb414641f5854b635418ce52ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:15:02.752699 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c51aaa1a-95af-4103-9d03-2e39be7e1c3d tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] 10.222.0.27 "GET /compute/v2.1/servers/eec50660-b603-407f-b4d3-9dd0161fee83" status: 200 len: 1373 microversion: 2.1 time: 0.219105 Sep 08 12:15:02.753229 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3992/7852] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:15:02 2022] GET /compute/v2.1/servers/eec50660-b603-407f-b4d3-9dd0161fee83 => generated 1373 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:15:03.777535 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4851f1df-8af9-4a4d-8fcb-1c32b2ff61fe tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:15:03.778354 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4851f1df-8af9-4a4d-8fcb-1c32b2ff61fe tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] [instance: eec50660-b603-407f-b4d3-9dd0161fee83] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:15:03.784864 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4851f1df-8af9-4a4d-8fcb-1c32b2ff61fe tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:15:03.785757 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4851f1df-8af9-4a4d-8fcb-1c32b2ff61fe tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:15:03.786325 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4851f1df-8af9-4a4d-8fcb-1c32b2ff61fe tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:15:03.787143 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4851f1df-8af9-4a4d-8fcb-1c32b2ff61fe tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:15:03.788365 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4851f1df-8af9-4a4d-8fcb-1c32b2ff61fe tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:15:03.789068 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4851f1df-8af9-4a4d-8fcb-1c32b2ff61fe tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:15:03.945844 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4851f1df-8af9-4a4d-8fcb-1c32b2ff61fe tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f17e0f291f4f4bb0bf31718e1b3628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8d85bb414641f5854b635418ce52ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:15:03.953727 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4851f1df-8af9-4a4d-8fcb-1c32b2ff61fe tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] 10.222.0.27 "GET /compute/v2.1/servers/eec50660-b603-407f-b4d3-9dd0161fee83" status: 200 len: 1373 microversion: 2.1 time: 0.181451 Sep 08 12:15:03.954300 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3861/7853] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:15:03 2022] GET /compute/v2.1/servers/eec50660-b603-407f-b4d3-9dd0161fee83 => generated 1373 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:15:04.976153 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-98f2b58a-d0da-46ea-96bd-d109870eb28a tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:15:04.977609 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-98f2b58a-d0da-46ea-96bd-d109870eb28a tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] [instance: eec50660-b603-407f-b4d3-9dd0161fee83] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:15:04.984659 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-98f2b58a-d0da-46ea-96bd-d109870eb28a tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:15:04.985482 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-98f2b58a-d0da-46ea-96bd-d109870eb28a tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:15:04.986413 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-98f2b58a-d0da-46ea-96bd-d109870eb28a tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:15:04.987349 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-98f2b58a-d0da-46ea-96bd-d109870eb28a tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:15:04.988023 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-98f2b58a-d0da-46ea-96bd-d109870eb28a tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:15:04.988662 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-98f2b58a-d0da-46ea-96bd-d109870eb28a tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:15:05.142543 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-98f2b58a-d0da-46ea-96bd-d109870eb28a tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f17e0f291f4f4bb0bf31718e1b3628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8d85bb414641f5854b635418ce52ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:15:05.150928 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-98f2b58a-d0da-46ea-96bd-d109870eb28a tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] 10.222.0.27 "GET /compute/v2.1/servers/eec50660-b603-407f-b4d3-9dd0161fee83" status: 200 len: 1373 microversion: 2.1 time: 0.178831 Sep 08 12:15:05.151753 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3993/7854] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:15:04 2022] GET /compute/v2.1/servers/eec50660-b603-407f-b4d3-9dd0161fee83 => generated 1373 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:15:06.174376 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ba761909-a18b-4705-beb8-9a6deae0721c tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:15:06.174956 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ba761909-a18b-4705-beb8-9a6deae0721c tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] [instance: eec50660-b603-407f-b4d3-9dd0161fee83] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:15:06.183077 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba761909-a18b-4705-beb8-9a6deae0721c tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:15:06.183590 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba761909-a18b-4705-beb8-9a6deae0721c tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:15:06.184048 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba761909-a18b-4705-beb8-9a6deae0721c tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:15:06.184774 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba761909-a18b-4705-beb8-9a6deae0721c tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:15:06.185272 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba761909-a18b-4705-beb8-9a6deae0721c tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:15:06.185716 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba761909-a18b-4705-beb8-9a6deae0721c tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:15:06.604673 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ba761909-a18b-4705-beb8-9a6deae0721c tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f17e0f291f4f4bb0bf31718e1b3628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8d85bb414641f5854b635418ce52ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:15:06.613268 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ba761909-a18b-4705-beb8-9a6deae0721c tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] 10.222.0.27 "GET /compute/v2.1/servers/eec50660-b603-407f-b4d3-9dd0161fee83" status: 200 len: 1373 microversion: 2.1 time: 0.442969 Sep 08 12:15:06.614077 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3862/7855] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:15:06 2022] GET /compute/v2.1/servers/eec50660-b603-407f-b4d3-9dd0161fee83 => generated 1373 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:15:07.637135 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-52a334a3-e4b5-4933-9663-bda157aaee50 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:15:07.637692 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-52a334a3-e4b5-4933-9663-bda157aaee50 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] [instance: eec50660-b603-407f-b4d3-9dd0161fee83] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:15:07.644587 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-52a334a3-e4b5-4933-9663-bda157aaee50 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:15:07.645305 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-52a334a3-e4b5-4933-9663-bda157aaee50 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:15:07.645768 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-52a334a3-e4b5-4933-9663-bda157aaee50 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:15:07.646477 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-52a334a3-e4b5-4933-9663-bda157aaee50 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:15:07.646977 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-52a334a3-e4b5-4933-9663-bda157aaee50 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:15:07.647402 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-52a334a3-e4b5-4933-9663-bda157aaee50 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:15:07.817273 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-52a334a3-e4b5-4933-9663-bda157aaee50 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f17e0f291f4f4bb0bf31718e1b3628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8d85bb414641f5854b635418ce52ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:15:07.830769 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-52a334a3-e4b5-4933-9663-bda157aaee50 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] 10.222.0.27 "GET /compute/v2.1/servers/eec50660-b603-407f-b4d3-9dd0161fee83" status: 200 len: 1373 microversion: 2.1 time: 0.197216 Sep 08 12:15:07.831740 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3994/7856] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:15:07 2022] GET /compute/v2.1/servers/eec50660-b603-407f-b4d3-9dd0161fee83 => generated 1373 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:15:08.856656 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-29577739-c8f7-4d85-8fcc-8357e2b53c3d tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:15:08.857417 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-29577739-c8f7-4d85-8fcc-8357e2b53c3d tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] [instance: eec50660-b603-407f-b4d3-9dd0161fee83] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:15:08.864503 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-29577739-c8f7-4d85-8fcc-8357e2b53c3d tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:15:08.865013 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-29577739-c8f7-4d85-8fcc-8357e2b53c3d tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:15:08.865577 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-29577739-c8f7-4d85-8fcc-8357e2b53c3d tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:15:08.866306 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-29577739-c8f7-4d85-8fcc-8357e2b53c3d tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:15:08.866789 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-29577739-c8f7-4d85-8fcc-8357e2b53c3d tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:15:08.867237 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-29577739-c8f7-4d85-8fcc-8357e2b53c3d tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:15:09.014721 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-29577739-c8f7-4d85-8fcc-8357e2b53c3d tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f17e0f291f4f4bb0bf31718e1b3628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8d85bb414641f5854b635418ce52ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:15:09.024094 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-29577739-c8f7-4d85-8fcc-8357e2b53c3d tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] 10.222.0.27 "GET /compute/v2.1/servers/eec50660-b603-407f-b4d3-9dd0161fee83" status: 200 len: 1373 microversion: 2.1 time: 0.171731 Sep 08 12:15:09.024941 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3863/7857] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:15:08 2022] GET /compute/v2.1/servers/eec50660-b603-407f-b4d3-9dd0161fee83 => generated 1373 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:15:10.046984 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f12f0250-f6e2-4da5-92ee-39cc299dd60d tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:15:10.047606 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f12f0250-f6e2-4da5-92ee-39cc299dd60d tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] [instance: eec50660-b603-407f-b4d3-9dd0161fee83] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:15:10.054848 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f12f0250-f6e2-4da5-92ee-39cc299dd60d tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:15:10.055345 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f12f0250-f6e2-4da5-92ee-39cc299dd60d tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:15:10.055788 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f12f0250-f6e2-4da5-92ee-39cc299dd60d tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:15:10.056500 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f12f0250-f6e2-4da5-92ee-39cc299dd60d tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:15:10.056961 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f12f0250-f6e2-4da5-92ee-39cc299dd60d tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:15:10.057424 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f12f0250-f6e2-4da5-92ee-39cc299dd60d tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:15:10.179444 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=2 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:15:10.202955 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-f12f0250-f6e2-4da5-92ee-39cc299dd60d tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f17e0f291f4f4bb0bf31718e1b3628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8d85bb414641f5854b635418ce52ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:15:10.205351 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell0:SELECT=6 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:15:10.213393 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f12f0250-f6e2-4da5-92ee-39cc299dd60d tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] 10.222.0.27 "GET /compute/v2.1/servers/eec50660-b603-407f-b4d3-9dd0161fee83" status: 200 len: 1373 microversion: 2.1 time: 0.170313 Sep 08 12:15:10.214032 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3995/7858] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:15:10 2022] GET /compute/v2.1/servers/eec50660-b603-407f-b4d3-9dd0161fee83 => generated 1373 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:15:10.832273 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:15:10.891829 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-e94a5540-9803-4939-84d4-9d587fbdaacf req-33c478ed-00af-4d43-b4b6-012e1319eee2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eec50660-b603-407f-b4d3-9dd0161fee83", "tag": "4f5d54c9-3280-42b5-a628-6b1fc30a0a01"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:15:10.902386 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e94a5540-9803-4939-84d4-9d587fbdaacf req-33c478ed-00af-4d43-b4b6-012e1319eee2 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:15:10.902882 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e94a5540-9803-4939-84d4-9d587fbdaacf req-33c478ed-00af-4d43-b4b6-012e1319eee2 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:15:10.903327 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e94a5540-9803-4939-84d4-9d587fbdaacf req-33c478ed-00af-4d43-b4b6-012e1319eee2 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:15:10.914820 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-e94a5540-9803-4939-84d4-9d587fbdaacf req-33c478ed-00af-4d43-b4b6-012e1319eee2 service nova] Creating event network-changed:4f5d54c9-3280-42b5-a628-6b1fc30a0a01 for instance eec50660-b603-407f-b4d3-9dd0161fee83 on n-h2-850501-12 Sep 08 12:15:10.920082 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-e94a5540-9803-4939-84d4-9d587fbdaacf req-33c478ed-00af-4d43-b4b6-012e1319eee2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101585 Sep 08 12:15:10.921115 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3864/7859] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 12:15:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:15:11.237368 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-dc808410-cd4f-46fc-b4bb-03e8bede5952 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:15:11.238013 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-dc808410-cd4f-46fc-b4bb-03e8bede5952 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] [instance: eec50660-b603-407f-b4d3-9dd0161fee83] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:15:11.245738 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dc808410-cd4f-46fc-b4bb-03e8bede5952 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:15:11.246235 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dc808410-cd4f-46fc-b4bb-03e8bede5952 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:15:11.246678 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dc808410-cd4f-46fc-b4bb-03e8bede5952 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:15:11.247411 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dc808410-cd4f-46fc-b4bb-03e8bede5952 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:15:11.247875 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dc808410-cd4f-46fc-b4bb-03e8bede5952 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:15:11.248307 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dc808410-cd4f-46fc-b4bb-03e8bede5952 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:15:11.390936 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-dc808410-cd4f-46fc-b4bb-03e8bede5952 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f17e0f291f4f4bb0bf31718e1b3628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8d85bb414641f5854b635418ce52ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:15:11.399432 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-dc808410-cd4f-46fc-b4bb-03e8bede5952 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] 10.222.0.27 "GET /compute/v2.1/servers/eec50660-b603-407f-b4d3-9dd0161fee83" status: 200 len: 1373 microversion: 2.1 time: 0.166192 Sep 08 12:15:11.400174 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3996/7860] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:15:11 2022] GET /compute/v2.1/servers/eec50660-b603-407f-b4d3-9dd0161fee83 => generated 1373 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:15:12.424305 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-669b6489-4dcd-40eb-94e9-38984f3e83b3 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:15:12.425114 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-669b6489-4dcd-40eb-94e9-38984f3e83b3 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] [instance: eec50660-b603-407f-b4d3-9dd0161fee83] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:15:12.432869 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-669b6489-4dcd-40eb-94e9-38984f3e83b3 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:15:12.433403 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-669b6489-4dcd-40eb-94e9-38984f3e83b3 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:15:12.433853 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-669b6489-4dcd-40eb-94e9-38984f3e83b3 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:15:12.434558 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-669b6489-4dcd-40eb-94e9-38984f3e83b3 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:15:12.435027 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-669b6489-4dcd-40eb-94e9-38984f3e83b3 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:15:12.435463 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-669b6489-4dcd-40eb-94e9-38984f3e83b3 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:15:12.577522 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-669b6489-4dcd-40eb-94e9-38984f3e83b3 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f17e0f291f4f4bb0bf31718e1b3628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8d85bb414641f5854b635418ce52ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:15:12.585639 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-669b6489-4dcd-40eb-94e9-38984f3e83b3 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] 10.222.0.27 "GET /compute/v2.1/servers/eec50660-b603-407f-b4d3-9dd0161fee83" status: 200 len: 1373 microversion: 2.1 time: 0.165857 Sep 08 12:15:12.586214 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3865/7861] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:15:12 2022] GET /compute/v2.1/servers/eec50660-b603-407f-b4d3-9dd0161fee83 => generated 1373 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:15:13.607882 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fc10c1ca-ead3-4a2d-86ed-f34e4870a3c8 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:15:13.608538 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fc10c1ca-ead3-4a2d-86ed-f34e4870a3c8 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] [instance: eec50660-b603-407f-b4d3-9dd0161fee83] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:15:13.615976 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fc10c1ca-ead3-4a2d-86ed-f34e4870a3c8 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:15:13.616465 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fc10c1ca-ead3-4a2d-86ed-f34e4870a3c8 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:15:13.616906 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fc10c1ca-ead3-4a2d-86ed-f34e4870a3c8 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:15:13.617634 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fc10c1ca-ead3-4a2d-86ed-f34e4870a3c8 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:15:13.618103 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fc10c1ca-ead3-4a2d-86ed-f34e4870a3c8 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:15:13.618536 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fc10c1ca-ead3-4a2d-86ed-f34e4870a3c8 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:15:13.759964 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-fc10c1ca-ead3-4a2d-86ed-f34e4870a3c8 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f17e0f291f4f4bb0bf31718e1b3628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8d85bb414641f5854b635418ce52ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:15:13.767778 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fc10c1ca-ead3-4a2d-86ed-f34e4870a3c8 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] 10.222.0.27 "GET /compute/v2.1/servers/eec50660-b603-407f-b4d3-9dd0161fee83" status: 200 len: 1373 microversion: 2.1 time: 0.163841 Sep 08 12:15:13.768357 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3997/7862] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:15:13 2022] GET /compute/v2.1/servers/eec50660-b603-407f-b4d3-9dd0161fee83 => generated 1373 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:15:14.791865 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-311ec278-4d71-45fc-826a-5bf600a9a5a6 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:15:14.792502 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-311ec278-4d71-45fc-826a-5bf600a9a5a6 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] [instance: eec50660-b603-407f-b4d3-9dd0161fee83] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:15:14.800520 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-311ec278-4d71-45fc-826a-5bf600a9a5a6 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:15:14.801831 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-311ec278-4d71-45fc-826a-5bf600a9a5a6 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:15:14.802687 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-311ec278-4d71-45fc-826a-5bf600a9a5a6 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:15:14.804546 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-311ec278-4d71-45fc-826a-5bf600a9a5a6 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:15:14.805508 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-311ec278-4d71-45fc-826a-5bf600a9a5a6 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:15:14.806788 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-311ec278-4d71-45fc-826a-5bf600a9a5a6 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:15:14.950163 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-311ec278-4d71-45fc-826a-5bf600a9a5a6 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f17e0f291f4f4bb0bf31718e1b3628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8d85bb414641f5854b635418ce52ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:15:14.957816 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-311ec278-4d71-45fc-826a-5bf600a9a5a6 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] 10.222.0.27 "GET /compute/v2.1/servers/eec50660-b603-407f-b4d3-9dd0161fee83" status: 200 len: 1373 microversion: 2.1 time: 0.170612 Sep 08 12:15:14.958385 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3866/7863] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:15:14 2022] GET /compute/v2.1/servers/eec50660-b603-407f-b4d3-9dd0161fee83 => generated 1373 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:15:15.475695 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-ed585f97-1607-4915-abcf-ba0e21b12729 req-fefc62f8-5b53-47aa-bbc4-aa4ef3d4a11d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eec50660-b603-407f-b4d3-9dd0161fee83", "name": "network-vif-plugged", "status": "completed", "tag": "4f5d54c9-3280-42b5-a628-6b1fc30a0a01"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:15:15.486982 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-ed585f97-1607-4915-abcf-ba0e21b12729 req-fefc62f8-5b53-47aa-bbc4-aa4ef3d4a11d service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:15:15.487464 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-ed585f97-1607-4915-abcf-ba0e21b12729 req-fefc62f8-5b53-47aa-bbc4-aa4ef3d4a11d service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:15:15.487904 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-ed585f97-1607-4915-abcf-ba0e21b12729 req-fefc62f8-5b53-47aa-bbc4-aa4ef3d4a11d service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:15:15.499482 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-ed585f97-1607-4915-abcf-ba0e21b12729 req-fefc62f8-5b53-47aa-bbc4-aa4ef3d4a11d service nova] Creating event network-vif-plugged:4f5d54c9-3280-42b5-a628-6b1fc30a0a01 for instance eec50660-b603-407f-b4d3-9dd0161fee83 on n-h2-850501-12 Sep 08 12:15:15.504735 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-ed585f97-1607-4915-abcf-ba0e21b12729 req-fefc62f8-5b53-47aa-bbc4-aa4ef3d4a11d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033493 Sep 08 12:15:15.505400 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3998/7864] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 12:15:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:15:15.980051 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0a506665-f675-4cba-b712-0db14881d5bb tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:15:15.980676 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0a506665-f675-4cba-b712-0db14881d5bb tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] [instance: eec50660-b603-407f-b4d3-9dd0161fee83] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:15:15.987751 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0a506665-f675-4cba-b712-0db14881d5bb tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:15:15.988249 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0a506665-f675-4cba-b712-0db14881d5bb tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:15:15.988700 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0a506665-f675-4cba-b712-0db14881d5bb tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:15:15.989437 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0a506665-f675-4cba-b712-0db14881d5bb tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:15:15.989904 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0a506665-f675-4cba-b712-0db14881d5bb tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:15:15.990340 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0a506665-f675-4cba-b712-0db14881d5bb tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:15:16.125575 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0a506665-f675-4cba-b712-0db14881d5bb tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f17e0f291f4f4bb0bf31718e1b3628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8d85bb414641f5854b635418ce52ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:15:16.134416 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0a506665-f675-4cba-b712-0db14881d5bb tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] 10.222.0.27 "GET /compute/v2.1/servers/eec50660-b603-407f-b4d3-9dd0161fee83" status: 200 len: 1373 microversion: 2.1 time: 0.158427 Sep 08 12:15:16.135040 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3867/7865] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:15:15 2022] GET /compute/v2.1/servers/eec50660-b603-407f-b4d3-9dd0161fee83 => generated 1373 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:15:17.158579 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-451f35f8-8eb4-41ec-906e-3280166c32fc tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:15:17.159200 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-451f35f8-8eb4-41ec-906e-3280166c32fc tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] [instance: eec50660-b603-407f-b4d3-9dd0161fee83] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:15:17.165823 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-451f35f8-8eb4-41ec-906e-3280166c32fc tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:15:17.166310 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-451f35f8-8eb4-41ec-906e-3280166c32fc tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:15:17.166749 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-451f35f8-8eb4-41ec-906e-3280166c32fc tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:15:17.167440 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-451f35f8-8eb4-41ec-906e-3280166c32fc tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:15:17.167900 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-451f35f8-8eb4-41ec-906e-3280166c32fc tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:15:17.168324 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-451f35f8-8eb4-41ec-906e-3280166c32fc tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:15:17.300100 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-451f35f8-8eb4-41ec-906e-3280166c32fc tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f17e0f291f4f4bb0bf31718e1b3628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8d85bb414641f5854b635418ce52ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:15:17.307905 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-451f35f8-8eb4-41ec-906e-3280166c32fc tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] 10.222.0.27 "GET /compute/v2.1/servers/eec50660-b603-407f-b4d3-9dd0161fee83" status: 200 len: 1558 microversion: 2.1 time: 0.154617 Sep 08 12:15:17.308478 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3999/7866] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:15:17 2022] GET /compute/v2.1/servers/eec50660-b603-407f-b4d3-9dd0161fee83 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:15:17.330104 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4102d153-8381-42f3-8bf7-5985ea6c3f80 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:15:17.330756 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4102d153-8381-42f3-8bf7-5985ea6c3f80 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] [instance: eec50660-b603-407f-b4d3-9dd0161fee83] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:15:17.338786 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4102d153-8381-42f3-8bf7-5985ea6c3f80 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:15:17.339321 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4102d153-8381-42f3-8bf7-5985ea6c3f80 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:15:17.339771 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4102d153-8381-42f3-8bf7-5985ea6c3f80 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:15:17.340487 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4102d153-8381-42f3-8bf7-5985ea6c3f80 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:15:17.340955 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4102d153-8381-42f3-8bf7-5985ea6c3f80 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:15:17.341419 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4102d153-8381-42f3-8bf7-5985ea6c3f80 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:15:17.478093 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4102d153-8381-42f3-8bf7-5985ea6c3f80 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f17e0f291f4f4bb0bf31718e1b3628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8d85bb414641f5854b635418ce52ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:15:17.486164 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4102d153-8381-42f3-8bf7-5985ea6c3f80 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] 10.222.0.27 "GET /compute/v2.1/servers/eec50660-b603-407f-b4d3-9dd0161fee83" status: 200 len: 1558 microversion: 2.1 time: 0.159698 Sep 08 12:15:17.486749 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3868/7867] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:15:17 2022] GET /compute/v2.1/servers/eec50660-b603-407f-b4d3-9dd0161fee83 => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:15:19.388139 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-83a2bb55-44fc-4451-8c37-2fcc99693474 req-6750b70c-f664-4e27-91fe-4ae274516233 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eec50660-b603-407f-b4d3-9dd0161fee83", "tag": "4f5d54c9-3280-42b5-a628-6b1fc30a0a01"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:15:19.399602 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-83a2bb55-44fc-4451-8c37-2fcc99693474 req-6750b70c-f664-4e27-91fe-4ae274516233 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:15:19.400083 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-83a2bb55-44fc-4451-8c37-2fcc99693474 req-6750b70c-f664-4e27-91fe-4ae274516233 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:15:19.401284 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-83a2bb55-44fc-4451-8c37-2fcc99693474 req-6750b70c-f664-4e27-91fe-4ae274516233 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:15:19.412167 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-83a2bb55-44fc-4451-8c37-2fcc99693474 req-6750b70c-f664-4e27-91fe-4ae274516233 service nova] Creating event network-changed:4f5d54c9-3280-42b5-a628-6b1fc30a0a01 for instance eec50660-b603-407f-b4d3-9dd0161fee83 on n-h2-850501-12 Sep 08 12:15:19.417645 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-83a2bb55-44fc-4451-8c37-2fcc99693474 req-6750b70c-f664-4e27-91fe-4ae274516233 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033226 Sep 08 12:15:19.418318 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 4000/7868] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 12:15:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:16:46.666810 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=24 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:16:46.668267 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=48 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:16:46.669367 n-d-850501-12 devstack@n-api.service[128862]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 12:16:46.669745 n-d-850501-12 devstack@n-api.service[128862]: Thu Sep 8 12:16:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/eec50660-b603-407f-b4d3-9dd0161fee83/action (ip 10.222.0.27) !!! Sep 08 12:16:46.675236 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-acedb435-8e80-4ea8-b76c-a2cc0760a5f9 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-545669342"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:16:46.677614 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-acedb435-8e80-4ea8-b76c-a2cc0760a5f9 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] [instance: eec50660-b603-407f-b4d3-9dd0161fee83] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:16:46.688051 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-acedb435-8e80-4ea8-b76c-a2cc0760a5f9 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:16:46.688558 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-acedb435-8e80-4ea8-b76c-a2cc0760a5f9 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:16:46.689008 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-acedb435-8e80-4ea8-b76c-a2cc0760a5f9 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:16:46.689745 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-acedb435-8e80-4ea8-b76c-a2cc0760a5f9 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:16:46.690223 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-acedb435-8e80-4ea8-b76c-a2cc0760a5f9 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:16:46.690693 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-acedb435-8e80-4ea8-b76c-a2cc0760a5f9 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:16:46.903508 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-acedb435-8e80-4ea8-b76c-a2cc0760a5f9 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] 10.222.0.27 "POST /compute/v2.1/servers/eec50660-b603-407f-b4d3-9dd0161fee83/action" status: 202 len: 0 microversion: 2.1 time: 0.238517 Sep 08 12:16:46.904169 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3869/7869] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 12:16:46 2022] POST /compute/v2.1/servers/eec50660-b603-407f-b4d3-9dd0161fee83/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 08 12:16:51.912140 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:16:51.914918 n-d-850501-12 devstack@n-api.service[128861]: DEBUG dbcounter [-] [128861] Writing DB stats nova_cell1:SELECT=54 {{(pid=128861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:16:51.919371 n-d-850501-12 devstack@n-api.service[128861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 12:16:51.920159 n-d-850501-12 devstack@n-api.service[128861]: Thu Sep 8 12:16:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.27) !!! Sep 08 12:16:51.933121 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-d4de32b7-1a70-4fca-b9f2-a7e420c9d3f3 req-4ec1051b-a38e-4868-8ab4-3143d28811e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eec50660-b603-407f-b4d3-9dd0161fee83", "name": "network-vif-plugged", "status": "completed", "tag": "4f5d54c9-3280-42b5-a628-6b1fc30a0a01"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:16:51.968123 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-d4de32b7-1a70-4fca-b9f2-a7e420c9d3f3 req-4ec1051b-a38e-4868-8ab4-3143d28811e2 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:16:51.968622 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-d4de32b7-1a70-4fca-b9f2-a7e420c9d3f3 req-4ec1051b-a38e-4868-8ab4-3143d28811e2 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:16:51.969112 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-d4de32b7-1a70-4fca-b9f2-a7e420c9d3f3 req-4ec1051b-a38e-4868-8ab4-3143d28811e2 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:16:51.996455 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-d4de32b7-1a70-4fca-b9f2-a7e420c9d3f3 req-4ec1051b-a38e-4868-8ab4-3143d28811e2 service nova] Creating event network-vif-plugged:4f5d54c9-3280-42b5-a628-6b1fc30a0a01 for instance eec50660-b603-407f-b4d3-9dd0161fee83 on n-h2-850501-12 Sep 08 12:16:52.002784 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-d4de32b7-1a70-4fca-b9f2-a7e420c9d3f3 req-4ec1051b-a38e-4868-8ab4-3143d28811e2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092853 Sep 08 12:16:52.003835 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 4001/7870] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 12:16:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:17:01.570891 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:17:01.571728 n-d-850501-12 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:17:01.576431 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4d053020-257b-46f0-a698-5cfd1c80fdc4 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:17:01.578165 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4d053020-257b-46f0-a698-5cfd1c80fdc4 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] [instance: eec50660-b603-407f-b4d3-9dd0161fee83] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:17:01.589139 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d053020-257b-46f0-a698-5cfd1c80fdc4 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:17:01.589768 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d053020-257b-46f0-a698-5cfd1c80fdc4 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:17:01.590312 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d053020-257b-46f0-a698-5cfd1c80fdc4 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:17:01.591049 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d053020-257b-46f0-a698-5cfd1c80fdc4 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:17:01.591526 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d053020-257b-46f0-a698-5cfd1c80fdc4 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:17:01.591972 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d053020-257b-46f0-a698-5cfd1c80fdc4 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:17:01.621085 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4d053020-257b-46f0-a698-5cfd1c80fdc4 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] [instance: eec50660-b603-407f-b4d3-9dd0161fee83] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:17:01.639778 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-dd38f87d-f8b8-43c4-a92b-26a387b50f4c req-37fdcc29-12e1-4455-b766-29b4dcbd4b57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eec50660-b603-407f-b4d3-9dd0161fee83", "tag": "4f5d54c9-3280-42b5-a628-6b1fc30a0a01"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:17:01.649866 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-dd38f87d-f8b8-43c4-a92b-26a387b50f4c req-37fdcc29-12e1-4455-b766-29b4dcbd4b57 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:17:01.650633 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-dd38f87d-f8b8-43c4-a92b-26a387b50f4c req-37fdcc29-12e1-4455-b766-29b4dcbd4b57 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:17:01.651319 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-dd38f87d-f8b8-43c4-a92b-26a387b50f4c req-37fdcc29-12e1-4455-b766-29b4dcbd4b57 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:17:01.663016 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-dd38f87d-f8b8-43c4-a92b-26a387b50f4c req-37fdcc29-12e1-4455-b766-29b4dcbd4b57 service nova] Creating event network-changed:4f5d54c9-3280-42b5-a628-6b1fc30a0a01 for instance eec50660-b603-407f-b4d3-9dd0161fee83 on n-h2-850501-12 Sep 08 12:17:01.668635 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-dd38f87d-f8b8-43c4-a92b-26a387b50f4c req-37fdcc29-12e1-4455-b766-29b4dcbd4b57 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097617 Sep 08 12:17:01.669280 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 4002/7871] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 12:17:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:17:01.707872 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4d053020-257b-46f0-a698-5cfd1c80fdc4 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] 10.222.0.27 "DELETE /compute/v2.1/servers/eec50660-b603-407f-b4d3-9dd0161fee83" status: 204 len: 0 microversion: 2.1 time: 0.139071 Sep 08 12:17:01.712062 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3870/7872] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 12:17:01 2022] DELETE /compute/v2.1/servers/eec50660-b603-407f-b4d3-9dd0161fee83 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:17:01.718683 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-aa36896f-765b-451c-b63e-f367a41fe050 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:17:01.720975 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-aa36896f-765b-451c-b63e-f367a41fe050 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] [instance: eec50660-b603-407f-b4d3-9dd0161fee83] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:17:01.728367 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aa36896f-765b-451c-b63e-f367a41fe050 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:17:01.729124 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aa36896f-765b-451c-b63e-f367a41fe050 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:17:01.729771 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aa36896f-765b-451c-b63e-f367a41fe050 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:17:01.730669 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aa36896f-765b-451c-b63e-f367a41fe050 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:17:01.731358 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aa36896f-765b-451c-b63e-f367a41fe050 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:17:01.731993 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aa36896f-765b-451c-b63e-f367a41fe050 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:17:01.875066 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-aa36896f-765b-451c-b63e-f367a41fe050 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f17e0f291f4f4bb0bf31718e1b3628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8d85bb414641f5854b635418ce52ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:17:01.883281 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-aa36896f-765b-451c-b63e-f367a41fe050 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] 10.222.0.27 "GET /compute/v2.1/servers/eec50660-b603-407f-b4d3-9dd0161fee83" status: 200 len: 1683 microversion: 2.1 time: 0.169794 Sep 08 12:17:01.883877 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 4003/7873] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:17:01 2022] GET /compute/v2.1/servers/eec50660-b603-407f-b4d3-9dd0161fee83 => generated 1683 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:17:02.910826 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-321bb147-1cff-4817-91fc-5c1767f0aec1 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:17:02.911548 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-321bb147-1cff-4817-91fc-5c1767f0aec1 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] [instance: eec50660-b603-407f-b4d3-9dd0161fee83] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:17:02.918741 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-321bb147-1cff-4817-91fc-5c1767f0aec1 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:17:02.919264 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-321bb147-1cff-4817-91fc-5c1767f0aec1 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:17:02.919723 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-321bb147-1cff-4817-91fc-5c1767f0aec1 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:17:02.920558 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-321bb147-1cff-4817-91fc-5c1767f0aec1 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:17:02.921428 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-321bb147-1cff-4817-91fc-5c1767f0aec1 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:17:02.921881 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-321bb147-1cff-4817-91fc-5c1767f0aec1 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:17:03.055984 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-321bb147-1cff-4817-91fc-5c1767f0aec1 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f17e0f291f4f4bb0bf31718e1b3628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8d85bb414641f5854b635418ce52ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:17:03.063828 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-321bb147-1cff-4817-91fc-5c1767f0aec1 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] 10.222.0.27 "GET /compute/v2.1/servers/eec50660-b603-407f-b4d3-9dd0161fee83" status: 200 len: 1683 microversion: 2.1 time: 0.159969 Sep 08 12:17:03.064406 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3871/7874] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:17:02 2022] GET /compute/v2.1/servers/eec50660-b603-407f-b4d3-9dd0161fee83 => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:17:04.090640 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cb0c9f74-b7e2-4843-90c3-05298f18880c tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:17:04.091322 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cb0c9f74-b7e2-4843-90c3-05298f18880c tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] [instance: eec50660-b603-407f-b4d3-9dd0161fee83] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:17:04.099125 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb0c9f74-b7e2-4843-90c3-05298f18880c tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:17:04.099652 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb0c9f74-b7e2-4843-90c3-05298f18880c tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:17:04.100102 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb0c9f74-b7e2-4843-90c3-05298f18880c tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:17:04.100826 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb0c9f74-b7e2-4843-90c3-05298f18880c tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:17:04.101363 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb0c9f74-b7e2-4843-90c3-05298f18880c tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:17:04.101803 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb0c9f74-b7e2-4843-90c3-05298f18880c tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:17:04.304516 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-cb0c9f74-b7e2-4843-90c3-05298f18880c tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f17e0f291f4f4bb0bf31718e1b3628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8d85bb414641f5854b635418ce52ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:17:04.313299 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cb0c9f74-b7e2-4843-90c3-05298f18880c tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] 10.222.0.27 "GET /compute/v2.1/servers/eec50660-b603-407f-b4d3-9dd0161fee83" status: 200 len: 1564 microversion: 2.1 time: 0.228760 Sep 08 12:17:04.313896 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 4004/7875] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:17:04 2022] GET /compute/v2.1/servers/eec50660-b603-407f-b4d3-9dd0161fee83 => generated 1564 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:17:04.450470 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-9c54c54d-5039-49ab-a09b-d88c0e8c5412 req-d496e4b5-e315-45c4-a509-49899462a8d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eec50660-b603-407f-b4d3-9dd0161fee83", "name": "network-vif-deleted", "tag": "4f5d54c9-3280-42b5-a628-6b1fc30a0a01"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:17:04.462303 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-9c54c54d-5039-49ab-a09b-d88c0e8c5412 req-d496e4b5-e315-45c4-a509-49899462a8d6 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:17:04.463544 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-9c54c54d-5039-49ab-a09b-d88c0e8c5412 req-d496e4b5-e315-45c4-a509-49899462a8d6 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:17:04.464007 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-9c54c54d-5039-49ab-a09b-d88c0e8c5412 req-d496e4b5-e315-45c4-a509-49899462a8d6 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:17:04.477271 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-9c54c54d-5039-49ab-a09b-d88c0e8c5412 req-d496e4b5-e315-45c4-a509-49899462a8d6 service nova] Creating event network-vif-deleted:4f5d54c9-3280-42b5-a628-6b1fc30a0a01 for instance eec50660-b603-407f-b4d3-9dd0161fee83 on n-h2-850501-12 Sep 08 12:17:04.483497 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-9c54c54d-5039-49ab-a09b-d88c0e8c5412 req-d496e4b5-e315-45c4-a509-49899462a8d6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036141 Sep 08 12:17:04.484128 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3872/7876] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 12:17:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:17:05.336290 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d1822053-a44d-4e1c-ac8a-c6c910dee753 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:17:05.336909 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d1822053-a44d-4e1c-ac8a-c6c910dee753 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] [instance: eec50660-b603-407f-b4d3-9dd0161fee83] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:17:05.344297 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d1822053-a44d-4e1c-ac8a-c6c910dee753 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:17:05.344784 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d1822053-a44d-4e1c-ac8a-c6c910dee753 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:17:05.345257 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d1822053-a44d-4e1c-ac8a-c6c910dee753 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:17:05.345954 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d1822053-a44d-4e1c-ac8a-c6c910dee753 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:17:05.346411 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d1822053-a44d-4e1c-ac8a-c6c910dee753 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:17:05.346837 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d1822053-a44d-4e1c-ac8a-c6c910dee753 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:17:05.364208 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-d1822053-a44d-4e1c-ac8a-c6c910dee753 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] HTTP exception thrown: Instance eec50660-b603-407f-b4d3-9dd0161fee83 could not be found. Sep 08 12:17:05.365899 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d1822053-a44d-4e1c-ac8a-c6c910dee753 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Request method failure captured: Sep 08 12:17:05.365899 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/eec50660-b603-407f-b4d3-9dd0161fee83 HTTP/1.1 Sep 08 12:17:05.365899 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 12:17:05.365899 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 12:17:05.365899 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 12:17:05.365899 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 12:17:05.365899 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 12:17:05.365899 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 12:17:05.365899 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 12:17:05.365899 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 12:17:05.365899 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGdwth9shgbES5POxefz8cwtIDnrsRK-1Pe1nXOuTrhlkN46N_Xp0-mpEgM0Tv8vOMugv6StFCzeyVJqZ8D4xEA8DMczcTc3AJZd7CmyxLXJ8_ziPxAsbRH9TzfoA7N_qXP7C9wjQXryDNtC7S9cPVmYPqBt1ZejjRikQnlEtHldmlWI Sep 08 12:17:05.365899 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 12:17:05.365899 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 12:17:05.365899 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 12:17:05.365899 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 12:17:05.365899 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 12:17:05.365899 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 12:17:05.365899 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: fb8d85bb414641f5854b635418ce52ff Sep 08 12:17:05.365899 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-TestSnapshotPattern-1202611316 Sep 08 12:17:05.365899 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 12:17:05.365899 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 12:17:05.365899 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fb8d85bb414641f5854b635418ce52ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fb8d85bb414641f5854b635418ce52ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fb8d85bb414641f5854b635418ce52ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fb8d85bb414641f5854b635418ce52ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 12:17:05.365899 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-TestSnapshotPattern-1202611316 Sep 08 12:17:05.365899 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: fb8d85bb414641f5854b635418ce52ff Sep 08 12:17:05.365899 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-TestSnapshotPattern-1202611316 Sep 08 12:17:05.365899 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-TestSnapshotPattern-1202611316-project Sep 08 12:17:05.365899 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 12:17:05.365899 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 12:17:05.365899 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 13f17e0f291f4f4bb0bf31718e1b3628 Sep 08 12:17:05.365899 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-TestSnapshotPattern-1202611316-project Sep 08 12:17:05.365899 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 12:17:05.365899 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance eec50660-b603-407f-b4d3-9dd0161fee83 could not be found. Sep 08 12:17:05.365899 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': 'eec50660-b603-407f-b4d3-9dd0161fee83'} Sep 08 12:17:05.365899 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:17:05.365899 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:17:05.365899 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:17:05.365899 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:17:05.365899 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:17:05.365899 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:17:05.365899 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:17:05.365899 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:17:05.365899 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:17:05.365899 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:17:05.365899 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eec50660-b603-407f-b4d3-9dd0161fee83 could not be found. Sep 08 12:17:05.365899 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 12:17:05.365899 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:17:05.365899 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 12:17:05.365899 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:17:05.365899 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:17:05.365899 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:17:05.365899 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:17:05.365899 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:17:05.365899 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:17:05.365899 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:17:05.365899 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:17:05.365899 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:17:05.365899 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:17:05.365899 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:17:05.365899 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:17:05.365899 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:17:05.365899 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eec50660-b603-407f-b4d3-9dd0161fee83 could not be found. Sep 08 12:17:05.365899 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 12:17:05.365899 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:17:05.365899 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 12:17:05.371643 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:17:05.371643 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:17:05.371643 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:17:05.371643 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:17:05.371643 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:17:05.371643 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eec50660-b603-407f-b4d3-9dd0161fee83 could not be found. Sep 08 12:17:05.371643 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 12:17:05.371643 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d1822053-a44d-4e1c-ac8a-c6c910dee753 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Returning 404 to user: Instance eec50660-b603-407f-b4d3-9dd0161fee83 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:17:05.371643 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d1822053-a44d-4e1c-ac8a-c6c910dee753 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] 10.222.0.27 "GET /compute/v2.1/servers/eec50660-b603-407f-b4d3-9dd0161fee83" status: 404 len: 111 microversion: 2.1 time: 0.034987 Sep 08 12:17:05.371643 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 4005/7877] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:17:05 2022] GET /compute/v2.1/servers/eec50660-b603-407f-b4d3-9dd0161fee83 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:17:06.736785 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bba5fc0d-d093-4e5f-8cdc-e489ad5695ec tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:17:06.737571 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bba5fc0d-d093-4e5f-8cdc-e489ad5695ec tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] [instance: 4022c788-1312-4046-8b60-01b11709592b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:17:06.738438 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-aebed077-5d7e-49d8-a204-48efbe82ed5d req-d4a3bba6-5cff-497e-aa8a-b4b5b0f02217 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4022c788-1312-4046-8b60-01b11709592b", "tag": "a62d14d3-c02c-4a4c-ab54-2c55367ce235"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:17:06.744617 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bba5fc0d-d093-4e5f-8cdc-e489ad5695ec tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:17:06.745153 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bba5fc0d-d093-4e5f-8cdc-e489ad5695ec tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:17:06.745639 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bba5fc0d-d093-4e5f-8cdc-e489ad5695ec tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:17:06.746360 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bba5fc0d-d093-4e5f-8cdc-e489ad5695ec tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:17:06.747032 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bba5fc0d-d093-4e5f-8cdc-e489ad5695ec tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:17:06.747800 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bba5fc0d-d093-4e5f-8cdc-e489ad5695ec tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:17:06.750476 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-aebed077-5d7e-49d8-a204-48efbe82ed5d req-d4a3bba6-5cff-497e-aa8a-b4b5b0f02217 service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:17:06.751042 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-aebed077-5d7e-49d8-a204-48efbe82ed5d req-d4a3bba6-5cff-497e-aa8a-b4b5b0f02217 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:17:06.751734 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-aebed077-5d7e-49d8-a204-48efbe82ed5d req-d4a3bba6-5cff-497e-aa8a-b4b5b0f02217 service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:17:06.763786 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-aebed077-5d7e-49d8-a204-48efbe82ed5d req-d4a3bba6-5cff-497e-aa8a-b4b5b0f02217 service nova] Creating event network-changed:a62d14d3-c02c-4a4c-ab54-2c55367ce235 for instance 4022c788-1312-4046-8b60-01b11709592b on n-h1-850501-12 Sep 08 12:17:06.770589 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-aebed077-5d7e-49d8-a204-48efbe82ed5d req-d4a3bba6-5cff-497e-aa8a-b4b5b0f02217 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036287 Sep 08 12:17:06.771772 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 4006/7878] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 12:17:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:17:06.784635 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bba5fc0d-d093-4e5f-8cdc-e489ad5695ec tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] [instance: 4022c788-1312-4046-8b60-01b11709592b] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:17:06.874624 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bba5fc0d-d093-4e5f-8cdc-e489ad5695ec tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4022c788-1312-4046-8b60-01b11709592b" status: 204 len: 0 microversion: 2.1 time: 0.142169 Sep 08 12:17:06.876179 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3873/7879] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 12:17:06 2022] DELETE /compute/v2.1/servers/4022c788-1312-4046-8b60-01b11709592b => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:17:06.885960 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bd43f340-1ce2-4bc4-a06d-33cc953ff35a tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:17:06.887000 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bd43f340-1ce2-4bc4-a06d-33cc953ff35a tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] [instance: 4022c788-1312-4046-8b60-01b11709592b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:17:06.895592 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bd43f340-1ce2-4bc4-a06d-33cc953ff35a tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:17:06.896107 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bd43f340-1ce2-4bc4-a06d-33cc953ff35a tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:17:06.897420 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bd43f340-1ce2-4bc4-a06d-33cc953ff35a tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:17:06.898373 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bd43f340-1ce2-4bc4-a06d-33cc953ff35a tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:17:06.898851 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bd43f340-1ce2-4bc4-a06d-33cc953ff35a tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:17:06.899294 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bd43f340-1ce2-4bc4-a06d-33cc953ff35a tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:17:07.075120 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.policy [None req-bd43f340-1ce2-4bc4-a06d-33cc953ff35a tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f17e0f291f4f4bb0bf31718e1b3628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8d85bb414641f5854b635418ce52ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:17:07.084922 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bd43f340-1ce2-4bc4-a06d-33cc953ff35a tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] 10.222.0.27 "GET /compute/v2.1/servers/4022c788-1312-4046-8b60-01b11709592b" status: 200 len: 1682 microversion: 2.1 time: 0.204132 Sep 08 12:17:07.085632 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 4007/7880] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:17:06 2022] GET /compute/v2.1/servers/4022c788-1312-4046-8b60-01b11709592b => generated 1682 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:17:08.111976 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f1ecc553-6ebd-48a0-83bc-33a4daa27fc3 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:17:08.112693 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f1ecc553-6ebd-48a0-83bc-33a4daa27fc3 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] [instance: 4022c788-1312-4046-8b60-01b11709592b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:17:08.119920 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1ecc553-6ebd-48a0-83bc-33a4daa27fc3 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:17:08.120473 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1ecc553-6ebd-48a0-83bc-33a4daa27fc3 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:17:08.120925 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1ecc553-6ebd-48a0-83bc-33a4daa27fc3 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:17:08.121739 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1ecc553-6ebd-48a0-83bc-33a4daa27fc3 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:17:08.122212 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1ecc553-6ebd-48a0-83bc-33a4daa27fc3 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:17:08.122657 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1ecc553-6ebd-48a0-83bc-33a4daa27fc3 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:17:08.270878 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f1ecc553-6ebd-48a0-83bc-33a4daa27fc3 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f17e0f291f4f4bb0bf31718e1b3628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8d85bb414641f5854b635418ce52ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:17:08.280297 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f1ecc553-6ebd-48a0-83bc-33a4daa27fc3 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] 10.222.0.27 "GET /compute/v2.1/servers/4022c788-1312-4046-8b60-01b11709592b" status: 200 len: 1682 microversion: 2.1 time: 0.173413 Sep 08 12:17:08.280994 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3874/7881] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:17:08 2022] GET /compute/v2.1/servers/4022c788-1312-4046-8b60-01b11709592b => generated 1682 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:17:09.070892 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-19501c3d-cabe-4629-b0db-9033389dc528 req-dadc8d52-8ed5-47a8-90aa-5f00296913aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4022c788-1312-4046-8b60-01b11709592b", "name": "network-vif-deleted", "tag": "a62d14d3-c02c-4a4c-ab54-2c55367ce235"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:17:09.083691 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-19501c3d-cabe-4629-b0db-9033389dc528 req-dadc8d52-8ed5-47a8-90aa-5f00296913aa service nova] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:17:09.084285 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-19501c3d-cabe-4629-b0db-9033389dc528 req-dadc8d52-8ed5-47a8-90aa-5f00296913aa service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:17:09.084741 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-19501c3d-cabe-4629-b0db-9033389dc528 req-dadc8d52-8ed5-47a8-90aa-5f00296913aa service nova] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:17:09.099469 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-19501c3d-cabe-4629-b0db-9033389dc528 req-dadc8d52-8ed5-47a8-90aa-5f00296913aa service nova] Creating event network-vif-deleted:a62d14d3-c02c-4a4c-ab54-2c55367ce235 for instance 4022c788-1312-4046-8b60-01b11709592b on n-h1-850501-12 Sep 08 12:17:09.104892 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-19501c3d-cabe-4629-b0db-9033389dc528 req-dadc8d52-8ed5-47a8-90aa-5f00296913aa service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037291 Sep 08 12:17:09.105968 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 4008/7882] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 12:17:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:17:09.308197 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4dc4cf99-0168-4408-b883-6efd830eec1b tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:17:09.308744 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4dc4cf99-0168-4408-b883-6efd830eec1b tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] [instance: 4022c788-1312-4046-8b60-01b11709592b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:17:09.318586 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4dc4cf99-0168-4408-b883-6efd830eec1b tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:17:09.319082 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4dc4cf99-0168-4408-b883-6efd830eec1b tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:17:09.319550 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4dc4cf99-0168-4408-b883-6efd830eec1b tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:17:09.320298 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4dc4cf99-0168-4408-b883-6efd830eec1b tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:17:09.320780 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4dc4cf99-0168-4408-b883-6efd830eec1b tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:17:09.321278 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4dc4cf99-0168-4408-b883-6efd830eec1b tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:17:09.395992 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4dc4cf99-0168-4408-b883-6efd830eec1b tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:17:09.396912 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4dc4cf99-0168-4408-b883-6efd830eec1b tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:17:09.397588 n-d-850501-12 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4dc4cf99-0168-4408-b883-6efd830eec1b tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:17:09.398452 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-4dc4cf99-0168-4408-b883-6efd830eec1b tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lazy-loading 'fault' on Instance uuid 4022c788-1312-4046-8b60-01b11709592b {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:17:09.454244 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4dc4cf99-0168-4408-b883-6efd830eec1b tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f17e0f291f4f4bb0bf31718e1b3628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8d85bb414641f5854b635418ce52ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:17:09.463568 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4dc4cf99-0168-4408-b883-6efd830eec1b tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] 10.222.0.27 "GET /compute/v2.1/servers/4022c788-1312-4046-8b60-01b11709592b" status: 200 len: 1338 microversion: 2.1 time: 0.159268 Sep 08 12:17:09.464515 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3875/7883] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:17:09 2022] GET /compute/v2.1/servers/4022c788-1312-4046-8b60-01b11709592b => generated 1338 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:17:10.489208 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d8b5a9b7-b157-49dc-a84e-4a057b7f65d2 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:17:10.489914 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d8b5a9b7-b157-49dc-a84e-4a057b7f65d2 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] [instance: 4022c788-1312-4046-8b60-01b11709592b] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:17:10.496133 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d8b5a9b7-b157-49dc-a84e-4a057b7f65d2 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:17:10.496627 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d8b5a9b7-b157-49dc-a84e-4a057b7f65d2 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:17:10.497094 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d8b5a9b7-b157-49dc-a84e-4a057b7f65d2 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:17:10.497793 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d8b5a9b7-b157-49dc-a84e-4a057b7f65d2 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Acquiring lock "2785b110-f847-4739-9d30-5b571c6d79f4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:17:10.499068 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d8b5a9b7-b157-49dc-a84e-4a057b7f65d2 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:17:10.499497 n-d-850501-12 devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d8b5a9b7-b157-49dc-a84e-4a057b7f65d2 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Lock "2785b110-f847-4739-9d30-5b571c6d79f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:17:10.512841 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-d8b5a9b7-b157-49dc-a84e-4a057b7f65d2 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] HTTP exception thrown: Instance 4022c788-1312-4046-8b60-01b11709592b could not be found. Sep 08 12:17:10.514593 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d8b5a9b7-b157-49dc-a84e-4a057b7f65d2 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Request method failure captured: Sep 08 12:17:10.514593 n-d-850501-12 devstack@n-api.service[128861]: request: GET /compute/v2.1/servers/4022c788-1312-4046-8b60-01b11709592b HTTP/1.1 Sep 08 12:17:10.514593 n-d-850501-12 devstack@n-api.service[128861]: Accept: application/json Sep 08 12:17:10.514593 n-d-850501-12 devstack@n-api.service[128861]: Accept-Encoding: identity Sep 08 12:17:10.514593 n-d-850501-12 devstack@n-api.service[128861]: Connection: close Sep 08 12:17:10.514593 n-d-850501-12 devstack@n-api.service[128861]: Content-Length: 0 Sep 08 12:17:10.514593 n-d-850501-12 devstack@n-api.service[128861]: Content-Type: application/json Sep 08 12:17:10.514593 n-d-850501-12 devstack@n-api.service[128861]: Host: 10.222.0.27 Sep 08 12:17:10.514593 n-d-850501-12 devstack@n-api.service[128861]: Openstack-System-Scope: None Sep 08 12:17:10.514593 n-d-850501-12 devstack@n-api.service[128861]: User-Agent: python-urllib3/1.26.12 Sep 08 12:17:10.514593 n-d-850501-12 devstack@n-api.service[128861]: X-Auth-Token: gAAAAABjGdwth9shgbES5POxefz8cwtIDnrsRK-1Pe1nXOuTrhlkN46N_Xp0-mpEgM0Tv8vOMugv6StFCzeyVJqZ8D4xEA8DMczcTc3AJZd7CmyxLXJ8_ziPxAsbRH9TzfoA7N_qXP7C9wjQXryDNtC7S9cPVmYPqBt1ZejjRikQnlEtHldmlWI Sep 08 12:17:10.514593 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Id: None Sep 08 12:17:10.514593 n-d-850501-12 devstack@n-api.service[128861]: X-Domain-Name: None Sep 08 12:17:10.514593 n-d-850501-12 devstack@n-api.service[128861]: X-Identity-Status: Confirmed Sep 08 12:17:10.514593 n-d-850501-12 devstack@n-api.service[128861]: X-Is-Admin-Project: True Sep 08 12:17:10.514593 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Id: default Sep 08 12:17:10.514593 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Domain-Name: Default Sep 08 12:17:10.514593 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Id: fb8d85bb414641f5854b635418ce52ff Sep 08 12:17:10.514593 n-d-850501-12 devstack@n-api.service[128861]: X-Project-Name: tempest-TestSnapshotPattern-1202611316 Sep 08 12:17:10.514593 n-d-850501-12 devstack@n-api.service[128861]: X-Role: reader,member Sep 08 12:17:10.514593 n-d-850501-12 devstack@n-api.service[128861]: X-Roles: reader,member Sep 08 12:17:10.514593 n-d-850501-12 devstack@n-api.service[128861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fb8d85bb414641f5854b635418ce52ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fb8d85bb414641f5854b635418ce52ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fb8d85bb414641f5854b635418ce52ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fb8d85bb414641f5854b635418ce52ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Sep 08 12:17:10.514593 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant: tempest-TestSnapshotPattern-1202611316 Sep 08 12:17:10.514593 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Id: fb8d85bb414641f5854b635418ce52ff Sep 08 12:17:10.514593 n-d-850501-12 devstack@n-api.service[128861]: X-Tenant-Name: tempest-TestSnapshotPattern-1202611316 Sep 08 12:17:10.514593 n-d-850501-12 devstack@n-api.service[128861]: X-User: tempest-TestSnapshotPattern-1202611316-project Sep 08 12:17:10.514593 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Id: default Sep 08 12:17:10.514593 n-d-850501-12 devstack@n-api.service[128861]: X-User-Domain-Name: Default Sep 08 12:17:10.514593 n-d-850501-12 devstack@n-api.service[128861]: X-User-Id: 13f17e0f291f4f4bb0bf31718e1b3628 Sep 08 12:17:10.514593 n-d-850501-12 devstack@n-api.service[128861]: X-User-Name: tempest-TestSnapshotPattern-1202611316-project Sep 08 12:17:10.514593 n-d-850501-12 devstack@n-api.service[128861]: method: > Sep 08 12:17:10.514593 n-d-850501-12 devstack@n-api.service[128861]: exception: Instance 4022c788-1312-4046-8b60-01b11709592b could not be found. Sep 08 12:17:10.514593 n-d-850501-12 devstack@n-api.service[128861]: action_args: {'id': '4022c788-1312-4046-8b60-01b11709592b'} Sep 08 12:17:10.514593 n-d-850501-12 devstack@n-api.service[128861]: {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:17:10.514593 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:17:10.514593 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:17:10.514593 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:17:10.514593 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:17:10.514593 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:17:10.514593 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:17:10.514593 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:17:10.514593 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:17:10.514593 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:17:10.514593 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4022c788-1312-4046-8b60-01b11709592b could not be found. Sep 08 12:17:10.514593 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 12:17:10.514593 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:17:10.514593 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 12:17:10.514593 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:17:10.514593 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:17:10.514593 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:17:10.514593 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:17:10.514593 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:17:10.514593 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:17:10.514593 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:17:10.514593 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:17:10.514593 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:17:10.514593 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:17:10.514593 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:17:10.514593 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:17:10.514593 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:17:10.514593 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4022c788-1312-4046-8b60-01b11709592b could not be found. Sep 08 12:17:10.514593 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 12:17:10.514593 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:17:10.514593 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 12:17:10.520529 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:17:10.520529 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:17:10.520529 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:17:10.520529 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:17:10.520529 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:17:10.520529 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4022c788-1312-4046-8b60-01b11709592b could not be found. Sep 08 12:17:10.520529 n-d-850501-12 devstack@n-api.service[128861]: ERROR nova.api.openstack.wsgi Sep 08 12:17:10.520529 n-d-850501-12 devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d8b5a9b7-b157-49dc-a84e-4a057b7f65d2 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Returning 404 to user: Instance 4022c788-1312-4046-8b60-01b11709592b could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:17:10.520529 n-d-850501-12 devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d8b5a9b7-b157-49dc-a84e-4a057b7f65d2 tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] 10.222.0.27 "GET /compute/v2.1/servers/4022c788-1312-4046-8b60-01b11709592b" status: 404 len: 111 microversion: 2.1 time: 0.032292 Sep 08 12:17:10.520529 n-d-850501-12 devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 4009/7884] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 12:17:10 2022] GET /compute/v2.1/servers/4022c788-1312-4046-8b60-01b11709592b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:17:10.683977 n-d-850501-12 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-74b6299d-2180-4943-9e51-08cd43d6d8ea tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] Calling method '.version_select at 0x7f68e4361b80>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:17:10.715998 n-d-850501-12 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-74b6299d-2180-4943-9e51-08cd43d6d8ea tempest-TestSnapshotPattern-1202611316 tempest-TestSnapshotPattern-1202611316-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-251540423" status: 202 len: 0 microversion: 2.1 time: 0.035835 Sep 08 12:17:10.716823 n-d-850501-12 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3876/7885] 10.222.0.27 () {58 vars in 1254 bytes} [Thu Sep 8 12:17:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-251540423 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)